Sep  4 16:30:27 ubuntu-1604 rsyslogd: [origin software="rsyslogd" swVersion="8.16.0" x-pid="316" x-info="http://www.rsyslog.com"] start
Sep  4 16:30:27 ubuntu-1604 rsyslogd-2222: command 'KLogPermitNonKernelFacility' is currently not permitted - did you already set it via a RainerScript command (v6+ config)? [v8.16.0 try http://www.rsyslog.com/e/2222 ]
Sep  4 16:30:27 ubuntu-1604 rsyslogd: rsyslogd's groupid changed to 108
Sep  4 16:30:27 ubuntu-1604 rsyslogd: rsyslogd's userid changed to 104
Sep  4 16:30:27 ubuntu-1604 rsyslogd-2039: Could not open output pipe '/dev/xconsole':: No such file or directory [v8.16.0 try http://www.rsyslog.com/e/2039 ]
Sep  4 16:30:27 ubuntu-1604 rsyslogd-2007: action 'action 9' suspended, next retry is Mon Sep  4 16:30:57 2017 [v8.16.0 try http://www.rsyslog.com/e/2007 ]
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] Initializing cgroup subsys cpuset
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] Initializing cgroup subsys cpu
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] Initializing cgroup subsys cpuacct
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] Linux version 4.4.0-87-generic (buildd@lcy01-31) (gcc version 5.4.0 20160609 (Ubuntu 5.4.0-6ubuntu1~16.04.4) ) #110-Ubuntu SMP Tue Jul 18 12:55:35 UTC 2017 (Ubuntu 4.4.0-87.110-generic 4.4.73)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-4.4.0-87-generic root=UUID=ff0effb5-4dd3-403f-b236-c5d5b1e676e4 ro quiet splash vt.handoff=7
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] KERNEL supported cpus:
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000]   Intel GenuineIntel
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000]   AMD AuthenticAMD
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000]   Centaur CentaurHauls
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] x86/fpu: Legacy x87 FPU detected.
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] x86/fpu: Using 'lazy' FPU context switches.
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] e820: BIOS-provided physical RAM map:
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000003ffdffff] usable
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] BIOS-e820: [mem 0x000000003ffe0000-0x000000003fffffff] reserved
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] NX (Execute Disable) protection: active
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] SMBIOS 2.8 present.
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS Ubuntu-1.8.2-1ubuntu1 04/01/2014
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] Hypervisor detected: KVM
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] e820: remove [mem 0x000a0000-0x000fffff] usable
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] e820: last_pfn = 0x3ffe0 max_arch_pfn = 0x400000000
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] MTRR default type: write-back
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] MTRR fixed ranges enabled:
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000]   00000-9FFFF write-back
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000]   A0000-BFFFF uncachable
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000]   C0000-FFFFF write-protect
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] MTRR variable ranges enabled:
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000]   0 base 0080000000 mask FF80000000 uncachable
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000]   1 disabled
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000]   2 disabled
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000]   3 disabled
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000]   4 disabled
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000]   5 disabled
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000]   6 disabled
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000]   7 disabled
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] x86/PAT: PAT not supported by CPU.
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] x86/PAT: Configuration [0-7]: WB  WT  UC- UC  WB  WT  UC- UC  
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] found SMP MP-table at [mem 0x000f6630-0x000f663f] mapped at [ffff8800000f6630]
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] Scanning 1 areas for low memory corruption
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] Base memory trampoline at [ffff880000099000] 99000 size 24576
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] BRK [0x0220c000, 0x0220cfff] PGTABLE
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] BRK [0x0220d000, 0x0220dfff] PGTABLE
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] BRK [0x0220e000, 0x0220efff] PGTABLE
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] BRK [0x0220f000, 0x0220ffff] PGTABLE
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] RAMDISK: [mem 0x3412a000-0x3608cfff]
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] ACPI: Early table checksum verification disabled
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] ACPI: RSDP 0x00000000000F6450 000014 (v00 BOCHS )
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] ACPI: RSDT 0x000000003FFE16EE 000034 (v01 BOCHS  BXPCRSDT 00000001 BXPC 00000001)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] ACPI: FACP 0x000000003FFE0C14 000074 (v01 BOCHS  BXPCFACP 00000001 BXPC 00000001)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] ACPI: DSDT 0x000000003FFE0040 000BD4 (v01 BOCHS  BXPCDSDT 00000001 BXPC 00000001)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] ACPI: FACS 0x000000003FFE0000 000040
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] ACPI: SSDT 0x000000003FFE0C88 0009B6 (v01 BOCHS  BXPCSSDT 00000001 BXPC 00000001)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] ACPI: APIC 0x000000003FFE163E 000078 (v01 BOCHS  BXPCAPIC 00000001 BXPC 00000001)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] ACPI: HPET 0x000000003FFE16B6 000038 (v01 BOCHS  BXPCHPET 00000001 BXPC 00000001)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] ACPI: Local APIC address 0xfee00000
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] No NUMA configuration found
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] Faking a node at [mem 0x0000000000000000-0x000000003ffdffff]
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] NODE_DATA(0) allocated [mem 0x3ffdb000-0x3ffdffff]
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] kvm-clock: cpu 0, msr 0:3ffd3001, primary cpu clock
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] kvm-clock: using sched offset of 335701410621 cycles
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] Zone ranges:
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000]   DMA      [mem 0x0000000000001000-0x0000000000ffffff]
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000]   DMA32    [mem 0x0000000001000000-0x000000003ffdffff]
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000]   Normal   empty
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000]   Device   empty
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] Movable zone start for each node
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] Early memory node ranges
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000]   node   0: [mem 0x0000000000001000-0x000000000009efff]
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000]   node   0: [mem 0x0000000000100000-0x000000003ffdffff]
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x000000003ffdffff]
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] On node 0 totalpages: 262014
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000]   DMA zone: 64 pages used for memmap
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000]   DMA zone: 21 pages reserved
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000]   DMA zone: 3998 pages, LIFO batch:0
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000]   DMA32 zone: 4032 pages used for memmap
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000]   DMA32 zone: 258016 pages, LIFO batch:31
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] ACPI: PM-Timer IO Port: 0x608
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] ACPI: Local APIC address 0xfee00000
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] ACPI: IRQ0 used by override.
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] ACPI: IRQ5 used by override.
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] ACPI: IRQ9 used by override.
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] ACPI: IRQ10 used by override.
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] ACPI: IRQ11 used by override.
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] Using ACPI (MADT) for SMP configuration information
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] smpboot: Allowing 1 CPUs, 0 hotplug CPUs
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff]
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff]
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000effff]
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] PM: Registered nosave memory: [mem 0x000f0000-0x000fffff]
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] e820: [mem 0x40000000-0xfeffbfff] available for PCI devices
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] Booting paravirtualized kernel on KVM
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] setup_percpu: NR_CPUS:512 nr_cpumask_bits:512 nr_cpu_ids:1 nr_node_ids:1
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] PERCPU: Embedded 33 pages/cpu @ffff88003fc00000 s98264 r8192 d28712 u2097152
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] pcpu-alloc: s98264 r8192 d28712 u2097152 alloc=1*2097152
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] pcpu-alloc: [0] 0 
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] KVM setup async PF for cpu 0
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] kvm-stealtime: cpu 0, msr 3fc0d9c0
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] Built 1 zonelists in Node order, mobility grouping on.  Total pages: 257897
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] Policy zone: DMA32
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-4.4.0-87-generic root=UUID=ff0effb5-4dd3-403f-b236-c5d5b1e676e4 ro quiet splash vt.handoff=7
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] Calgary: detecting Calgary via BIOS EBDA area
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] Calgary: Unable to locate Rio Grande table in EBDA - bailing!
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] Memory: 980508K/1048056K available (8474K kernel code, 1293K rwdata, 3984K rodata, 1488K init, 1316K bss, 67548K reserved, 0K cma-reserved)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] Hierarchical RCU implementation.
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] 	Build-time adjustment of leaf fanout to 64.
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] 	RCU restricting CPUs from NR_CPUS=512 to nr_cpu_ids=1.
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=64, nr_cpu_ids=1
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] NR_IRQS:33024 nr_irqs:256 16
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] vt handoff: transparent VT on vt#7
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] Console: colour dummy device 80x25
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] console [tty0] enabled
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] hpet clockevent registered
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.000000] tsc: Detected 2399.996 MHz processor
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.012139] Calibrating delay loop (skipped) preset value.. 4799.99 BogoMIPS (lpj=9599984)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.012141] pid_max: default: 32768 minimum: 301
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.012145] ACPI: Core revision 20150930
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.012939] ACPI: 2 ACPI AML tables successfully acquired and loaded
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.012953] Security Framework initialized
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.012954] Yama: becoming mindful.
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.012965] AppArmor: AppArmor initialized
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.013026] Dentry cache hash table entries: 131072 (order: 8, 1048576 bytes)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.013165] Inode-cache hash table entries: 65536 (order: 7, 524288 bytes)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.013231] Mount-cache hash table entries: 2048 (order: 2, 16384 bytes)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.013233] Mountpoint-cache hash table entries: 2048 (order: 2, 16384 bytes)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.013359] Initializing cgroup subsys io
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.013361] Initializing cgroup subsys memory
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.013366] Initializing cgroup subsys devices
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.013367] Initializing cgroup subsys freezer
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.013369] Initializing cgroup subsys net_cls
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.013370] Initializing cgroup subsys perf_event
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.013372] Initializing cgroup subsys net_prio
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.013374] Initializing cgroup subsys hugetlb
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.013375] Initializing cgroup subsys pids
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.013425] mce: CPU supports 10 MCE banks
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.013451] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.013452] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.029512] Freeing SMP alternatives memory: 32K (ffffffff820b9000 - ffffffff820c1000)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.033453] ftrace: allocating 32128 entries in 126 pages
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.055594] smpboot: APIC(0) Converting physical 0 to logical package 0
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.055595] smpboot: Max logical packages: 1
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.055708] x2apic enabled
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.055861] Switched APIC routing to physical x2apic.
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.056503] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.164098] smpboot: CPU0: Intel QEMU Virtual CPU version 2.5+ (family: 0x6, model: 0x6, stepping: 0x3)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.164112] Performance Events: Broken PMU hardware detected, using software events only.
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.165175] Failed to access perfctr msr (MSR c2 is 0)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.165764] x86: Booted up 1 node, 1 CPUs
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.165766] smpboot: Total of 1 processors activated (4799.99 BogoMIPS)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.165968] devtmpfs: initialized
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.167336] evm: security.selinux
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.167337] evm: security.SMACK64
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.167338] evm: security.SMACK64EXEC
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.167338] evm: security.SMACK64TRANSMUTE
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.167339] evm: security.SMACK64MMAP
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.167339] evm: security.ima
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.167340] evm: security.capability
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.167431] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.167436] futex hash table entries: 256 (order: 2, 16384 bytes)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.167492] pinctrl core: initialized pinctrl subsystem
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.167607] RTC time: 16:30:25, date: 09/04/17
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.167702] NET: Registered protocol family 16
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.167829] cpuidle: using governor ladder
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.167832] cpuidle: using governor menu
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.167833] PCCT header not found.
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.167891] ACPI: bus type PCI registered
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.167892] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.167974] PCI: Using configuration type 1 for base access
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.168985] ACPI: Added _OSI(Module Device)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.168987] ACPI: Added _OSI(Processor Device)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.168988] ACPI: Added _OSI(3.0 _SCP Extensions)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.168989] ACPI: Added _OSI(Processor Aggregator Device)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.169699] ACPI: Interpreter enabled
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.169710] ACPI: (supports S0 S3 S4 S5)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.169711] ACPI: Using IOAPIC for interrupt routing
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.169719] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.171423] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.171427] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI]
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.171430] acpi PNP0A03:00: _OSC failed (AE_NOT_FOUND); disabling ASPM
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.171435] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.171636] acpiphp: Slot [3] registered
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.171650] acpiphp: Slot [4] registered
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.171662] acpiphp: Slot [5] registered
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.171675] acpiphp: Slot [6] registered
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.171687] acpiphp: Slot [7] registered
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.171699] acpiphp: Slot [8] registered
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.171711] acpiphp: Slot [9] registered
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.171723] acpiphp: Slot [10] registered
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.171735] acpiphp: Slot [11] registered
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.171748] acpiphp: Slot [12] registered
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.171760] acpiphp: Slot [13] registered
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.171773] acpiphp: Slot [14] registered
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.171785] acpiphp: Slot [15] registered
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.171797] acpiphp: Slot [16] registered
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.171808] acpiphp: Slot [17] registered
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.171820] acpiphp: Slot [18] registered
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.171832] acpiphp: Slot [19] registered
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.171845] acpiphp: Slot [20] registered
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.171857] acpiphp: Slot [21] registered
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.171869] acpiphp: Slot [22] registered
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.171881] acpiphp: Slot [23] registered
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.171893] acpiphp: Slot [24] registered
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.171905] acpiphp: Slot [25] registered
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.171918] acpiphp: Slot [26] registered
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.171930] acpiphp: Slot [27] registered
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.171942] acpiphp: Slot [28] registered
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.171954] acpiphp: Slot [29] registered
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.171966] acpiphp: Slot [30] registered
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.171978] acpiphp: Slot [31] registered
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.171986] PCI host bridge to bus 0000:00
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.171988] pci_bus 0000:00: root bus resource [io  0x0000-0x0cf7 window]
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.171989] pci_bus 0000:00: root bus resource [io  0x0d00-0xffff window]
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.171991] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.171992] pci_bus 0000:00: root bus resource [mem 0x40000000-0xfebfffff window]
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.171994] pci_bus 0000:00: root bus resource [bus 00-ff]
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.172017] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.172287] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.172639] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.175576] pci 0000:00:01.1: reg 0x20: [io  0xc060-0xc06f]
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.176923] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io  0x01f0-0x01f7]
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.176925] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io  0x03f6]
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.176926] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io  0x0170-0x0177]
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.176927] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io  0x0376]
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.177039] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.177300] pci 0000:00:01.3: quirk: [io  0x0600-0x063f] claimed by PIIX4 ACPI
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.177306] pci 0000:00:01.3: quirk: [io  0x0700-0x070f] claimed by PIIX4 SMB
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.177444] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.180348] pci 0000:00:02.0: reg 0x10: [mem 0xfd000000-0xfdffffff pref]
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.183364] pci 0000:00:02.0: reg 0x18: [mem 0xfebd0000-0xfebd0fff]
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.188800] pci 0000:00:02.0: reg 0x30: [mem 0xfebc0000-0xfebcffff pref]
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.188991] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.189987] pci 0000:00:03.0: reg 0x10: [io  0xc040-0xc05f]
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.190975] pci 0000:00:03.0: reg 0x14: [mem 0xfebd1000-0xfebd1fff]
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.197226] pci 0000:00:03.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref]
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.197397] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.198337] pci 0000:00:04.0: reg 0x10: [io  0xc000-0xc03f]
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.199257] pci 0000:00:04.0: reg 0x14: [mem 0xfebd2000-0xfebd2fff]
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.204698] ACPI: PCI Interrupt Link [LNKA] (IRQs 5 *10 11)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.204764] ACPI: PCI Interrupt Link [LNKB] (IRQs 5 *10 11)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.204816] ACPI: PCI Interrupt Link [LNKC] (IRQs 5 10 *11)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.204867] ACPI: PCI Interrupt Link [LNKD] (IRQs 5 10 *11)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.204894] ACPI: PCI Interrupt Link [LNKS] (IRQs *9)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.205076] ACPI: Enabled 16 GPEs in block 00 to 0F
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.205270] vgaarb: setting as boot device: PCI:0000:00:02.0
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.205272] vgaarb: device added: PCI:0000:00:02.0,decodes=io+mem,owns=io+mem,locks=none
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.205273] vgaarb: loaded
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.205274] vgaarb: bridge control possible 0000:00:02.0
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.205503] SCSI subsystem initialized
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.205578] libata version 3.00 loaded.
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.205602] ACPI: bus type USB registered
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.205616] usbcore: registered new interface driver usbfs
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.205623] usbcore: registered new interface driver hub
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.205630] usbcore: registered new device driver usb
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.205752] PCI: Using ACPI for IRQ routing
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.205754] PCI: pci_cache_line_size set to 64 bytes
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.206638] e820: reserve RAM buffer [mem 0x0009fc00-0x0009ffff]
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.206643] e820: reserve RAM buffer [mem 0x3ffe0000-0x3fffffff]
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.206775] NetLabel: Initializing
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.206776] NetLabel:  domain hash size = 128
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.206777] NetLabel:  protocols = UNLABELED CIPSOv4
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.206790] NetLabel:  unlabeled traffic allowed by default
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.206913] HPET: 3 timers in total, 0 timers will be used for per-cpu timer
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.206923] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.206925] hpet0: 3 comparators, 64-bit 100.000000 MHz counter
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.211026] amd_nb: Cannot enumerate AMD northbridges
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.211043] clocksource: Switched to clocksource kvm-clock
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.216122] AppArmor: AppArmor Filesystem Enabled
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.216166] pnp: PnP ACPI init
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.216213] pnp 00:00: Plug and Play ACPI device, IDs PNP0b00 (active)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.216238] pnp 00:01: Plug and Play ACPI device, IDs PNP0303 (active)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.216256] pnp 00:02: Plug and Play ACPI device, IDs PNP0f13 (active)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.216273] pnp 00:03: [dma 2]
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.216284] pnp 00:03: Plug and Play ACPI device, IDs PNP0700 (active)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.216326] pnp 00:04: Plug and Play ACPI device, IDs PNP0400 (active)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.216361] pnp 00:05: Plug and Play ACPI device, IDs PNP0501 (active)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.216495] pnp: PnP ACPI: found 6 devices
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.221920] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.221930] pci_bus 0000:00: resource 4 [io  0x0000-0x0cf7 window]
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.221931] pci_bus 0000:00: resource 5 [io  0x0d00-0xffff window]
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.221933] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.221934] pci_bus 0000:00: resource 7 [mem 0x40000000-0xfebfffff window]
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.221963] NET: Registered protocol family 2
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.222082] TCP established hash table entries: 8192 (order: 4, 65536 bytes)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.222096] TCP bind hash table entries: 8192 (order: 5, 131072 bytes)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.222111] TCP: Hash tables configured (established 8192 bind 8192)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.222138] UDP hash table entries: 512 (order: 2, 16384 bytes)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.222142] UDP-Lite hash table entries: 512 (order: 2, 16384 bytes)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.222171] NET: Registered protocol family 1
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.222185] pci 0000:00:00.0: Limiting direct PCI/PCI transfers
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.222197] pci 0000:00:01.0: PIIX3: Enabling Passive Release
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.222209] pci 0000:00:01.0: Activating ISA DMA hang workarounds
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.222232] pci 0000:00:02.0: Video device with shadowed ROM
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.222250] PCI: CLS 0 bytes, default 64
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.222290] Unpacking initramfs...
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.648967] Freeing initrd memory: 32140K (ffff88003412a000 - ffff88003608d000)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.649205] Scanning for low memory corruption every 60 seconds
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.649469] audit: initializing netlink subsys (disabled)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.649500] audit: type=2000 audit(1504542626.147:1): initialized
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.649762] Initialise system trusted keyring
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.649869] HugeTLB registered 2 MB page size, pre-allocated 0 pages
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.651190] zbud: loaded
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.651358] VFS: Disk quotas dquot_6.6.0
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.651388] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.651646] squashfs: version 4.0 (2009/01/31) Phillip Lougher
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.651855] fuse init (API version 7.23)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.651989] Key type big_key registered
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.652005] Allocating IMA MOK and blacklist keyrings.
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.652268] Key type asymmetric registered
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.652271] Asymmetric key parser 'x509' registered
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.652305] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 249)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.652352] io scheduler noop registered
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.652355] io scheduler deadline registered (default)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.652383] io scheduler cfq registered
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.652466] pci_hotplug: PCI Hot Plug PCI Core version: 0.5
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.652472] pciehp: PCI Express Hot Plug Controller Driver version: 0.4
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.652501] efifb: probing for efifb
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.652514] efifb: framebuffer at 0xfd000000, mapped to 0xffffc90000200000, using 1408k, total 1408k
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.652515] efifb: mode is 800x600x24, linelength=2400, pages=1
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.652516] efifb: scrolling: redraw
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.652517] efifb: Truecolor: size=0:8:8:8, shift=0:16:8:0
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.652585] Console: switching to colour frame buffer device 100x37
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.652592] fb0: EFI VGA frame buffer device
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.652600] intel_idle: does not run on family 6 model 6
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.652653] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.652657] ACPI: Power Button [PWRF]
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.652778] GHES: HEST is not enabled!
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.671246] ACPI: PCI Interrupt Link [LNKC] enabled at IRQ 11
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.671280] virtio-pci 0000:00:03.0: virtio_pci: leaving for legacy driver
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.689811] ACPI: PCI Interrupt Link [LNKD] enabled at IRQ 10
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.689841] virtio-pci 0000:00:04.0: virtio_pci: leaving for legacy driver
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.690052] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.712645] 00:05: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.713641] Linux agpgart interface v0.103
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.715317] loop: module loaded
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.716755]  vda: vda1
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.716924] ata_piix 0000:00:01.1: version 2.13
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.717694] scsi host0: ata_piix
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.717772] scsi host1: ata_piix
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.717813] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc060 irq 14
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.717814] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc068 irq 15
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.717900] libphy: Fixed MDIO Bus: probed
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.717903] tun: Universal TUN/TAP device driver, 1.6
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.717904] tun: (C) 1999-2004 Max Krasnyansky <maxk@qualcomm.com>
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.718623] PPP generic driver version 2.4.2
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.718705] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.718712] ehci-pci: EHCI PCI platform driver
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.718720] ehci-platform: EHCI generic platform driver
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.718735] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.718738] ohci-pci: OHCI PCI platform driver
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.718753] ohci-platform: OHCI generic platform driver
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.718758] uhci_hcd: USB Universal Host Controller Interface driver
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.718810] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.719308] serio: i8042 KBD port at 0x60,0x64 irq 1
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.719312] serio: i8042 AUX port at 0x60,0x64 irq 12
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.719426] mousedev: PS/2 mouse device common for all mice
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.719608] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.719799] rtc_cmos 00:00: RTC can wake from S4
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.719979] rtc_cmos 00:00: rtc core: registered rtc_cmos as rtc0
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.720085] rtc_cmos 00:00: alarms up to one day, 114 bytes nvram, hpet irqs
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.720096] i2c /dev entries driver
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.720133] device-mapper: uevent: version 1.0.3
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.720176] device-mapper: ioctl: 4.34.0-ioctl (2015-10-28) initialised: dm-devel@redhat.com
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.720195] ledtrig-cpu: registered to indicate activity on CPUs
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.720570] NET: Registered protocol family 10
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.720709] NET: Registered protocol family 17
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.720716] Key type dns_resolver registered
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.720819] microcode: CPU0 sig=0x663, pf=0x1, revision=0x1
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.720837] microcode: Microcode Update Driver: v2.01 <tigran@aivazian.fsnet.co.uk>, Peter Oruba
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.720928] registered taskstats version 1
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.720945] Loading compiled-in X.509 certificates
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.721515] Loaded X.509 cert 'Build time autogenerated kernel key: 713bc24ccc5bf0d11d706d6f5bf7187ed23f7b25'
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.721527] zswap: loaded using pool lzo/zbud
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.722647] Key type trusted registered
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.724369] Key type encrypted registered
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.724373] AppArmor: AppArmor sha1 policy hashing enabled
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.724376] ima: No TPM chip found, activating TPM-bypass!
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.724389] evm: HMAC attrs: 0x1
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.724527]   Magic number: 1:493:539
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.724533] tty ttyS19: hash matches
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.724600] rtc_cmos 00:00: setting system clock to 2017-09-04 16:30:26 UTC (1504542626)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.724648] BIOS EDD facility v0.16 2004-Jun-25, 0 devices found
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.724649] EDD information not available.
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.724692] PM: Hibernation image not present or could not be loaded.
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.875318] ata2.01: NODEV after polling detection
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.875507] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.875808] ata2.00: configured for MWDMA2
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.876115] scsi 1:0:0:0: CD-ROM            QEMU     QEMU DVD-ROM     2.5+ PQ: 0 ANSI: 5
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.876630] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.876631] cdrom: Uniform CD-ROM driver Revision: 3.20
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.876691] sr 1:0:0:0: Attached scsi CD-ROM sr0
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.876868] sr 1:0:0:0: Attached scsi generic sg0 type 5
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.877953] Freeing unused kernel memory: 1488K (ffffffff81f45000 - ffffffff820b9000)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.877954] Write protecting the kernel read-only data: 14336k
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.878855] Freeing unused kernel memory: 1756K (ffff880001849000 - ffff880001a00000)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.879072] Freeing unused kernel memory: 112K (ffff880001de4000 - ffff880001e00000)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.885991] random: udevadm: uninitialized urandom read (16 bytes read, 1 bits of entropy available)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.886021] random: udevadm: uninitialized urandom read (16 bytes read, 1 bits of entropy available)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.886083] random: udevadm: uninitialized urandom read (16 bytes read, 1 bits of entropy available)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.886122] random: udevadm: uninitialized urandom read (16 bytes read, 1 bits of entropy available)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.886169] random: udevadm: uninitialized urandom read (16 bytes read, 1 bits of entropy available)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.886210] random: udevadm: uninitialized urandom read (16 bytes read, 1 bits of entropy available)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.886240] random: udevadm: uninitialized urandom read (16 bytes read, 1 bits of entropy available)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.886279] random: udevadm: uninitialized urandom read (16 bytes read, 1 bits of entropy available)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.886308] random: udevadm: uninitialized urandom read (16 bytes read, 1 bits of entropy available)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.887354] random: systemd-udevd: uninitialized urandom read (16 bytes read, 1 bits of entropy available)
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.918583] virtio_net virtio0 ens3: renamed from eth0
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.924624] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.924771] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.935843] Floppy drive(s): fd0 is 1.44M
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.951311] FDC 0 is a S82078B
Sep  4 16:30:27 ubuntu-1604 kernel: [    0.970534] EXT4-fs (vda1): mounted filesystem with ordered data mode. Opts: (null)
Sep  4 16:30:27 ubuntu-1604 kernel: [    1.051416] EXT4-fs (vda1): re-mounted. Opts: errors=remount-ro
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Started Nameserver information manager.
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Reached target Network (Pre).
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Starting udev Coldplug all Devices...
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Starting Load/Save Random Seed...
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Starting Flush Journal to Persistent Storage...
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Mounting FUSE Control File System...
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Starting Apply Kernel Variables...
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Starting Create Static Device Nodes in /dev...
Sep  4 16:30:27 ubuntu-1604 loadkeys[180]: Loading /etc/console-setup/cached.kmap.gz
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Started Set console keymap.
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Started Load/Save Random Seed.
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Started Apply Kernel Variables.
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Mounted FUSE Control File System.
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Started Create Static Device Nodes in /dev.
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Started Flush Journal to Persistent Storage.
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Started udev Coldplug all Devices.
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Starting udev Kernel Device Manager...
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Reached target Local File Systems (Pre).
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Reached target Local File Systems.
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Starting Create Volatile Files and Directories...
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Starting Raise network interfaces...
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Starting Commit a transient machine-id on disk...
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Starting Set console font and keymap...
Sep  4 16:30:27 ubuntu-1604 systemd-tmpfiles[253]: [/usr/lib/tmpfiles.d/var.conf:14] Duplicate line for path "/var/log", ignoring.
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Started Create Volatile Files and Directories.
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Starting Update UTMP about System Boot/Shutdown...
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Starting Network Time Synchronization...
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Started Commit a transient machine-id on disk.
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Started udev Kernel Device Manager.
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Started Network Time Synchronization.
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Started Update UTMP about System Boot/Shutdown.
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Reached target System Time Synchronized.
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Reached target System Initialization.
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Reached target Basic System.
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Starting System Logging Service...
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Starting getty on tty2-tty6 if dbus and logind are not available...
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Starting LSB: Record successful boot for GRUB...
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Started Daily Cleanup of Temporary Directories.
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Started Regular background program processing daemon.
Sep  4 16:30:27 ubuntu-1604 cron[322]: (CRON) INFO (pidfile fd = 3)
Sep  4 16:30:27 ubuntu-1604 cron[322]: (CRON) INFO (Running @reboot jobs)
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Starting LSB: Set the CPU Frequency Scaling governor to "ondemand"...
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Starting Permit User Sessions...
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Started System Logging Service.
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Started Permit User Sessions.
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Started LSB: Record successful boot for GRUB.
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Started LSB: Set the CPU Frequency Scaling governor to "ondemand".
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Started getty on tty2-tty6 if dbus and logind are not available.
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Starting Set console scheme...
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Started Set console scheme.
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Started Set console font and keymap.
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Created slice system-getty.slice.
Sep  4 16:30:27 ubuntu-1604 kernel: [    1.396823] parport_pc 00:04: reported by Plug and Play ACPI
Sep  4 16:30:27 ubuntu-1604 kernel: [    1.396930] parport0: PC-style at 0x378, irq 7 [PCSPP,TRISTATE]
Sep  4 16:30:27 ubuntu-1604 kernel: [    1.404601] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Started ifup for ens3.
Sep  4 16:30:27 ubuntu-1604 dhclient[403]: Internet Systems Consortium DHCP Client 4.3.3
Sep  4 16:30:27 ubuntu-1604 sh[395]: Internet Systems Consortium DHCP Client 4.3.3
Sep  4 16:30:27 ubuntu-1604 dhclient[403]: Copyright 2004-2015 Internet Systems Consortium.
Sep  4 16:30:27 ubuntu-1604 sh[395]: Copyright 2004-2015 Internet Systems Consortium.
Sep  4 16:30:27 ubuntu-1604 dhclient[403]: All rights reserved.
Sep  4 16:30:27 ubuntu-1604 sh[395]: All rights reserved.
Sep  4 16:30:27 ubuntu-1604 dhclient[403]: For info, please visit https://www.isc.org/software/dhcp/
Sep  4 16:30:27 ubuntu-1604 sh[395]: For info, please visit https://www.isc.org/software/dhcp/
Sep  4 16:30:27 ubuntu-1604 dhclient[403]: 
Sep  4 16:30:27 ubuntu-1604 dhclient[403]: Listening on LPF/ens3/52:54:00:12:34:56
Sep  4 16:30:27 ubuntu-1604 sh[395]: Listening on LPF/ens3/52:54:00:12:34:56
Sep  4 16:30:27 ubuntu-1604 dhclient[403]: Sending on   LPF/ens3/52:54:00:12:34:56
Sep  4 16:30:27 ubuntu-1604 sh[395]: Sending on   LPF/ens3/52:54:00:12:34:56
Sep  4 16:30:27 ubuntu-1604 dhclient[403]: Sending on   Socket/fallback
Sep  4 16:30:27 ubuntu-1604 sh[395]: Sending on   Socket/fallback
Sep  4 16:30:27 ubuntu-1604 dhclient[403]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 3 (xid=0x7483263a)
Sep  4 16:30:27 ubuntu-1604 sh[395]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 3 (xid=0x7483263a)
Sep  4 16:30:27 ubuntu-1604 dhclient[403]: DHCPREQUEST of 10.0.2.15 on ens3 to 255.255.255.255 port 67 (xid=0x3a268374)
Sep  4 16:30:27 ubuntu-1604 sh[395]: DHCPREQUEST of 10.0.2.15 on ens3 to 255.255.255.255 port 67 (xid=0x3a268374)
Sep  4 16:30:27 ubuntu-1604 dhclient[403]: DHCPOFFER of 10.0.2.15 from 10.0.2.2
Sep  4 16:30:27 ubuntu-1604 sh[395]: DHCPOFFER of 10.0.2.15 from 10.0.2.2
Sep  4 16:30:27 ubuntu-1604 dhclient[403]: DHCPACK of 10.0.2.15 from 10.0.2.2
Sep  4 16:30:27 ubuntu-1604 sh[395]: DHCPACK of 10.0.2.15 from 10.0.2.2
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Found device Virtio network device.
Sep  4 16:30:27 ubuntu-1604 dhclient[403]: bound to 10.0.2.15 -- renewal in 41182 seconds.
Sep  4 16:30:27 ubuntu-1604 sh[395]: bound to 10.0.2.15 -- renewal in 41182 seconds.
Sep  4 16:30:27 ubuntu-1604 kernel: [    1.551088] ppdev: user-space parallel port driver
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Started Raise network interfaces.
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Reached target Network.
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Starting OpenBSD Secure Shell server...
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Reached target Network is Online.
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Started Daily apt download activities.
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Started Daily apt upgrade and clean activities.
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Reached target Timers.
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Starting /etc/rc.local Compatibility...
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Started /etc/rc.local Compatibility.
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Started Getty on tty4.
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Started Getty on tty5.
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Started Getty on tty3.
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Started Getty on tty2.
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Started Getty on tty6.
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Started Getty on tty1.
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Reached target Login Prompts.
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Started OpenBSD Secure Shell server.
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Reached target Multi-User System.
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Reached target Graphical Interface.
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Starting Update UTMP about System Runlevel Changes...
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Started Update UTMP about System Runlevel Changes.
Sep  4 16:30:27 ubuntu-1604 systemd[1]: Startup finished in 860ms (kernel) + 629ms (userspace) = 1.489s.
Sep  4 16:30:27 ubuntu-1604 kernel: [    1.647080] tsc: Refined TSC clocksource calibration: 2400.033 MHz
Sep  4 16:30:27 ubuntu-1604 kernel: [    1.647083] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x22985670ae8, max_idle_ns: 440795228934 ns
Sep  4 16:30:33 ubuntu-1604 kernel: [    7.769583] random: nonblocking pool is initialized
Sep  4 16:30:41 ubuntu-1604 systemd[1]: Reloading.
Sep  4 16:30:48 ubuntu-1604 kernel: [   23.164805] SGI XFS with ACLs, security attributes, realtime, no debug enabled
Sep  4 16:30:49 ubuntu-1604 kernel: [   23.251045] raid6: sse2x1   gen() 10016 MB/s
Sep  4 16:30:49 ubuntu-1604 kernel: [   23.319044] raid6: sse2x1   xor()  7816 MB/s
Sep  4 16:30:49 ubuntu-1604 kernel: [   23.387047] raid6: sse2x2   gen() 12527 MB/s
Sep  4 16:30:49 ubuntu-1604 kernel: [   23.455043] raid6: sse2x2   xor()  8510 MB/s
Sep  4 16:30:49 ubuntu-1604 kernel: [   23.523045] raid6: sse2x4   gen() 14515 MB/s
Sep  4 16:30:49 ubuntu-1604 kernel: [   23.591045] raid6: sse2x4   xor()  9790 MB/s
Sep  4 16:30:49 ubuntu-1604 kernel: [   23.591046] raid6: using algorithm sse2x4 gen() 14515 MB/s
Sep  4 16:30:49 ubuntu-1604 kernel: [   23.591046] raid6: .... xor() 9790 MB/s, rmw enabled
Sep  4 16:30:49 ubuntu-1604 kernel: [   23.591047] raid6: using intx1 recovery algorithm
Sep  4 16:30:49 ubuntu-1604 kernel: [   23.592456] xor: measuring software checksum speed
Sep  4 16:30:49 ubuntu-1604 kernel: [   23.631046]    prefetch64-sse: 16021.000 MB/sec
Sep  4 16:30:49 ubuntu-1604 kernel: [   23.671044]    generic_sse: 14922.000 MB/sec
Sep  4 16:30:49 ubuntu-1604 kernel: [   23.671045] xor: using function: prefetch64-sse (16021.000 MB/sec)
Sep  4 16:30:49 ubuntu-1604 kernel: [   23.686780] Btrfs loaded
Sep  4 16:30:42 ubuntu-1604 systemd[1]: message repeated 2 times: [ Reloading.]
Sep  4 16:30:57 ubuntu-1604 systemd-timesyncd[260]: Synchronized to time server 91.189.91.157:123 (ntp.ubuntu.com).
Sep  4 16:31:29 ubuntu-1604 systemd[1]: Reloading.
Sep  4 16:31:29 ubuntu-1604 kernel: [   63.718566] blk_update_request: I/O error, dev fd0, sector 0
Sep  4 16:31:29 ubuntu-1604 kernel: [   63.718570] floppy: error -5 while reading block 0
Sep  4 16:31:29 ubuntu-1604 systemd[1]: Reloading.
Sep  4 16:31:29 ubuntu-1604 systemd[1]: Stopped target Sockets.
Sep  4 16:31:29 ubuntu-1604 systemd[1]: Stopping Sockets.
Sep  4 16:31:29 ubuntu-1604 systemd[1]: Listening on D-Bus System Message Bus Socket.
Sep  4 16:31:29 ubuntu-1604 systemd[1]: Reached target Sockets.
Sep  4 16:31:36 ubuntu-1604 systemd[1]: Reloading.
Sep  4 16:31:36 ubuntu-1604 systemd[1]: message repeated 4 times: [ Reloading.]
Sep  4 16:31:36 ubuntu-1604 systemd[1]: Started Unattended Upgrades Shutdown.
Sep  4 16:31:37 ubuntu-1604 systemd[1]: Reloading.
Sep  4 16:31:37 ubuntu-1604 systemd[1]: message repeated 4 times: [ Reloading.]
Sep  4 16:31:37 ubuntu-1604 systemd[1]: Started D-Bus System Message Bus.
Sep  4 16:31:37 ubuntu-1604 dbus[16548]: [system] AppArmor D-Bus mediation is enabled
Sep  4 16:31:37 ubuntu-1604 dbus[16548]: [system] Reloaded configuration
Sep  4 16:31:38 ubuntu-1604 systemd[1]: Reloading.
Sep  4 16:31:48 ubuntu-1604 systemd[1]: Reloading.
Sep  4 16:31:53 ubuntu-1604 systemd[1]: message repeated 8 times: [ Reloading.]
Sep  4 16:32:12 ubuntu-1604 systemd[1]: Closed Load/Save RF Kill Switch Status /dev/rfkill Watch.
Sep  4 16:32:12 ubuntu-1604 systemd[1]: Reached target Unmount All Filesystems.
Sep  4 16:32:12 ubuntu-1604 systemd[1]: Stopped target Timers.
Sep  4 16:32:12 ubuntu-1604 systemd[1]: Stopped Daily Cleanup of Temporary Directories.
Sep  4 16:32:12 ubuntu-1604 systemd[1]: Stopped Daily apt upgrade and clean activities.
Sep  4 16:32:12 ubuntu-1604 systemd[1]: Stopped Daily apt download activities.
Sep  4 16:32:12 ubuntu-1604 systemd[1]: Stopped target System Time Synchronized.
Sep  4 16:32:12 ubuntu-1604 systemd[1]: Stopped target Graphical Interface.
Sep  4 16:32:12 ubuntu-1604 systemd[1]: Stopped target Multi-User System.
Sep  4 16:32:12 ubuntu-1604 systemd[1]: Stopping Regular background program processing daemon...
Sep  4 16:32:12 ubuntu-1604 rsyslogd: [origin software="rsyslogd" swVersion="8.16.0" x-pid="316" x-info="http://www.rsyslog.com"] exiting on signal 15.
Sep 28 08:43:35 ubuntu-1604 rsyslogd: [origin software="rsyslogd" swVersion="8.16.0" x-pid="733" x-info="http://www.rsyslog.com"] start
Sep 28 08:43:34 ubuntu-1604 rsyslogd-2222: command 'KLogPermitNonKernelFacility' is currently not permitted - did you already set it via a RainerScript command (v6+ config)? [v8.16.0 try http://www.rsyslog.com/e/2222 ]
Sep 28 08:43:35 ubuntu-1604 rsyslogd: rsyslogd's groupid changed to 108
Sep 28 08:43:35 ubuntu-1604 rsyslogd: rsyslogd's userid changed to 104
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Starting Flush Journal to Persistent Storage...
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Started Load/Save Random Seed.
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Started udev Coldplug all Devices.
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Started Flush Journal to Persistent Storage.
Sep 28 08:43:35 ubuntu-1604 loadkeys[262]: Loading /etc/console-setup/cached.kmap.gz
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Started Set console keymap.
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Started Create Static Device Nodes in /dev.
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Reached target Local File Systems (Pre).
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Reached target Local File Systems.
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Starting Set console font and keymap...
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Starting Create Volatile Files and Directories...
Sep 28 08:43:35 ubuntu-1604 systemd-tmpfiles[318]: [/usr/lib/tmpfiles.d/var.conf:14] Duplicate line for path "/var/log", ignoring.
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Starting udev Kernel Device Manager...
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Started Create Volatile Files and Directories.
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Starting Network Time Synchronization...
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Starting Update UTMP about System Boot/Shutdown...
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Started Update UTMP about System Boot/Shutdown.
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Started Network Time Synchronization.
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Reached target System Time Synchronized.
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Started udev Kernel Device Manager.
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Started Set console font and keymap.
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Found device Virtio network device.
Sep 28 08:43:35 ubuntu-1604 cloud-init[293]: Cloud-init v. 0.7.9 running 'init-local' at Thu, 28 Sep 2017 08:42:45 +0000. Up 3.56 seconds.
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Started Initial cloud-init job (pre-networking).
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Reached target Network (Pre).
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Starting Raise network interfaces...
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Started ifup for ens3.
Sep 28 08:43:35 ubuntu-1604 dhclient[514]: Internet Systems Consortium DHCP Client 4.3.3
Sep 28 08:43:35 ubuntu-1604 sh[501]: Internet Systems Consortium DHCP Client 4.3.3
Sep 28 08:43:35 ubuntu-1604 sh[501]: Copyright 2004-2015 Internet Systems Consortium.
Sep 28 08:43:35 ubuntu-1604 sh[501]: All rights reserved.
Sep 28 08:43:35 ubuntu-1604 sh[501]: For info, please visit https://www.isc.org/software/dhcp/
Sep 28 08:43:35 ubuntu-1604 dhclient[514]: Copyright 2004-2015 Internet Systems Consortium.
Sep 28 08:43:35 ubuntu-1604 dhclient[514]: All rights reserved.
Sep 28 08:43:35 ubuntu-1604 dhclient[514]: For info, please visit https://www.isc.org/software/dhcp/
Sep 28 08:43:35 ubuntu-1604 dhclient[514]: 
Sep 28 08:43:35 ubuntu-1604 dhclient[558]: Internet Systems Consortium DHCP Client 4.3.3
Sep 28 08:43:35 ubuntu-1604 ifup[505]: Internet Systems Consortium DHCP Client 4.3.3
Sep 28 08:43:35 ubuntu-1604 ifup[505]: Copyright 2004-2015 Internet Systems Consortium.
Sep 28 08:43:35 ubuntu-1604 ifup[505]: All rights reserved.
Sep 28 08:43:35 ubuntu-1604 ifup[505]: For info, please visit https://www.isc.org/software/dhcp/
Sep 28 08:43:35 ubuntu-1604 dhclient[558]: Copyright 2004-2015 Internet Systems Consortium.
Sep 28 08:43:35 ubuntu-1604 dhclient[558]: All rights reserved.
Sep 28 08:43:35 ubuntu-1604 dhclient[558]: For info, please visit https://www.isc.org/software/dhcp/
Sep 28 08:43:35 ubuntu-1604 dhclient[558]: 
Sep 28 08:43:35 ubuntu-1604 dhclient[514]: Listening on LPF/ens3/ac:de:48:e8:1b:33
Sep 28 08:43:35 ubuntu-1604 sh[501]: Listening on LPF/ens3/ac:de:48:e8:1b:33
Sep 28 08:43:35 ubuntu-1604 sh[501]: Sending on   LPF/ens3/ac:de:48:e8:1b:33
Sep 28 08:43:35 ubuntu-1604 sh[501]: Sending on   Socket/fallback
Sep 28 08:43:35 ubuntu-1604 sh[501]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4fa51876)
Sep 28 08:43:35 ubuntu-1604 dhclient[514]: Sending on   LPF/ens3/ac:de:48:e8:1b:33
Sep 28 08:43:35 ubuntu-1604 ifup[505]: Listening on LPF/ens2/ac:de:48:29:81:2e
Sep 28 08:43:35 ubuntu-1604 ifup[505]: Sending on   LPF/ens2/ac:de:48:29:81:2e
Sep 28 08:43:35 ubuntu-1604 ifup[505]: Sending on   Socket/fallback
Sep 28 08:43:35 ubuntu-1604 ifup[505]: DHCPDISCOVER on ens2 to 255.255.255.255 port 67 interval 1 (xid=0x75f4103)
Sep 28 08:43:35 ubuntu-1604 dhclient[514]: Sending on   Socket/fallback
Sep 28 08:43:35 ubuntu-1604 dhclient[514]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4fa51876)
Sep 28 08:43:35 ubuntu-1604 dhclient[558]: Listening on LPF/ens2/ac:de:48:29:81:2e
Sep 28 08:43:35 ubuntu-1604 dhclient[558]: Sending on   LPF/ens2/ac:de:48:29:81:2e
Sep 28 08:43:35 ubuntu-1604 dhclient[558]: Sending on   Socket/fallback
Sep 28 08:43:35 ubuntu-1604 dhclient[558]: DHCPDISCOVER on ens2 to 255.255.255.255 port 67 interval 1 (xid=0x75f4103)
Sep 28 08:43:35 ubuntu-1604 dhclient[514]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4fa51876)
Sep 28 08:43:35 ubuntu-1604 sh[501]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4fa51876)
Sep 28 08:43:35 ubuntu-1604 ifup[505]: DHCPDISCOVER on ens2 to 255.255.255.255 port 67 interval 1 (xid=0x75f4103)
Sep 28 08:43:35 ubuntu-1604 dhclient[558]: DHCPDISCOVER on ens2 to 255.255.255.255 port 67 interval 1 (xid=0x75f4103)
Sep 28 08:43:35 ubuntu-1604 dhclient[514]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4fa51876)
Sep 28 08:43:35 ubuntu-1604 sh[501]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4fa51876)
Sep 28 08:43:35 ubuntu-1604 ifup[505]: DHCPREQUEST of 192.168.11.25 on ens2 to 255.255.255.255 port 67 (xid=0x3415f07)
Sep 28 08:43:35 ubuntu-1604 ifup[505]: DHCPOFFER of 192.168.11.25 from 192.168.11.3
Sep 28 08:43:35 ubuntu-1604 dhclient[558]: DHCPREQUEST of 192.168.11.25 on ens2 to 255.255.255.255 port 67 (xid=0x3415f07)
Sep 28 08:43:35 ubuntu-1604 dhclient[558]: DHCPOFFER of 192.168.11.25 from 192.168.11.3
Sep 28 08:43:35 ubuntu-1604 dhclient[558]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 08:43:35 ubuntu-1604 ifup[505]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Stopping Network Time Synchronization...
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Stopped Network Time Synchronization.
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Starting Network Time Synchronization...
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Started Network Time Synchronization.
Sep 28 08:43:35 ubuntu-1604 systemd-timesyncd[598]: Synchronized to time server 91.189.94.4:123 (91.189.94.4).
Sep 28 08:43:35 ubuntu-1604 dhclient[558]: bound to 192.168.11.25 -- renewal in 240 seconds.
Sep 28 08:43:35 ubuntu-1604 ifup[505]: bound to 192.168.11.25 -- renewal in 240 seconds.
Sep 28 08:43:35 ubuntu-1604 ifup[505]: /sbin/ifup: waiting for lock on /run/network/ifstate.ens3
Sep 28 08:43:35 ubuntu-1604 dhclient[514]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4fa51876)
Sep 28 08:43:35 ubuntu-1604 sh[501]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4fa51876)
Sep 28 08:43:35 ubuntu-1604 dhclient[514]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4fa51876)
Sep 28 08:43:35 ubuntu-1604 sh[501]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4fa51876)
Sep 28 08:43:35 ubuntu-1604 dhclient[514]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4fa51876)
Sep 28 08:43:35 ubuntu-1604 sh[501]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4fa51876)
Sep 28 08:43:35 ubuntu-1604 dhclient[514]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4fa51876)
Sep 28 08:43:35 ubuntu-1604 sh[501]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4fa51876)
Sep 28 08:43:35 ubuntu-1604 dhclient[514]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4fa51876)
Sep 28 08:43:35 ubuntu-1604 sh[501]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4fa51876)
Sep 28 08:43:35 ubuntu-1604 dhclient[514]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4fa51876)
Sep 28 08:43:35 ubuntu-1604 sh[501]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4fa51876)
Sep 28 08:43:35 ubuntu-1604 dhclient[514]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4fa51876)
Sep 28 08:43:35 ubuntu-1604 sh[501]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4fa51876)
Sep 28 08:43:35 ubuntu-1604 dhclient[514]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4fa51876)
Sep 28 08:43:35 ubuntu-1604 sh[501]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4fa51876)
Sep 28 08:43:35 ubuntu-1604 dhclient[514]: No DHCPOFFERS received.
Sep 28 08:43:35 ubuntu-1604 sh[501]: No DHCPOFFERS received.
Sep 28 08:43:35 ubuntu-1604 sh[501]: No working leases in persistent database - sleeping.
Sep 28 08:43:35 ubuntu-1604 dhclient[514]: No working leases in persistent database - sleeping.
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Stopping Network Time Synchronization...
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Stopped Network Time Synchronization.
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Starting Network Time Synchronization...
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Started Network Time Synchronization.
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Started Raise network interfaces.
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Starting Initial cloud-init job (metadata service crawler)...
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Reached target Network.
Sep 28 08:43:35 ubuntu-1604 systemd-timesyncd[625]: Synchronized to time server 91.189.91.157:123 (ntp.ubuntu.com).
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: Cloud-init v. 0.7.9 running 'init' at Thu, 28 Sep 2017 08:42:57 +0000. Up 15.26 seconds.
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: ci-info: ++++++++++++++++++++++++++++++++++++++Net device info+++++++++++++++++++++++++++++++++++++++
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: ci-info: +--------+------+------------------------------+---------------+-------+-------------------+
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: ci-info: | Device |  Up  |           Address            |      Mask     | Scope |     Hw-Address    |
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: ci-info: +--------+------+------------------------------+---------------+-------+-------------------+
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: ci-info: |  ens2  | True |        192.168.11.25         | 255.255.255.0 |   .   | ac:de:48:29:81:2e |
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: ci-info: |  ens2  | True | fe80::aede:48ff:fe29:812e/64 |       .       |  link | ac:de:48:29:81:2e |
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: ci-info: |   lo   | True |          127.0.0.1           |   255.0.0.0   |   .   |         .         |
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: ci-info: |   lo   | True |           ::1/128            |       .       |  host |         .         |
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: ci-info: |  ens3  | True |              .               |       .       |   .   | ac:de:48:e8:1b:33 |
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: ci-info: |  ens3  | True | fe80::aede:48ff:fee8:1b33/64 |       .       |  link | ac:de:48:e8:1b:33 |
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: ci-info: +--------+------+------------------------------+---------------+-------+-------------------+
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: ci-info: ++++++++++++++++++++++++++++++Route IPv4 info++++++++++++++++++++++++++++++
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: ci-info: +-------+--------------+--------------+---------------+-----------+-------+
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: ci-info: | Route | Destination  |   Gateway    |    Genmask    | Interface | Flags |
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: ci-info: +-------+--------------+--------------+---------------+-----------+-------+
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: ci-info: |   0   |   0.0.0.0    | 192.168.11.3 |    0.0.0.0    |    ens2   |   UG  |
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: ci-info: |   1   | 192.168.11.0 |   0.0.0.0    | 255.255.255.0 |    ens2   |   U   |
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: ci-info: +-------+--------------+--------------+---------------+-----------+-------+
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: 2017-09-28 08:42:58,821 - url_helper.py[WARNING]: Calling 'http://169.254.169.254/2009-04-04/meta-data/instance-id' failed [1/10s]: request error [HTTPConnectionPool(host='169.254.169.254', port=80): Max retries exceeded with url: /2009-04-04/meta-data/instance-id (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f20d636d828>: Failed to establish a new connection: [Errno 113] No route to host',))]
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: 2017-09-28 08:43:01,823 - url_helper.py[WARNING]: Calling 'http://169.254.169.254/2009-04-04/meta-data/instance-id' failed [4/10s]: request error [HTTPConnectionPool(host='169.254.169.254', port=80): Max retries exceeded with url: /2009-04-04/meta-data/instance-id (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f20d636dfd0>: Failed to establish a new connection: [Errno 113] No route to host',))]
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: 2017-09-28 08:43:05,829 - url_helper.py[WARNING]: Calling 'http://169.254.169.254/2009-04-04/meta-data/instance-id' failed [8/10s]: request error [HTTPConnectionPool(host='169.254.169.254', port=80): Max retries exceeded with url: /2009-04-04/meta-data/instance-id (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f20d63827b8>: Failed to establish a new connection: [Errno 113] No route to host',))]
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: 2017-09-28 08:43:06,832 - url_helper.py[WARNING]: Calling 'http://169.254.169.254/2009-04-04/meta-data/instance-id' failed [9/10s]: request error [HTTPConnectionPool(host='169.254.169.254', port=80): Max retries exceeded with url: /2009-04-04/meta-data/instance-id (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x7f20d6382fd0>: Failed to establish a new connection: [Errno 115] Operation now in progress',))]
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: 2017-09-28 08:43:07,833 - DataSourceEc2.py[CRITICAL]: Giving up on md from ['http://169.254.169.254/2009-04-04/meta-data/instance-id'] after 10 seconds
Sep 28 08:43:35 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x95ea2420)
Sep 28 08:43:35 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x95ea2420)]
Sep 28 08:43:35 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 08:43:35 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: Generating public/private rsa key pair.
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: Your identification has been saved in /etc/ssh/ssh_host_rsa_key.
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: Your public key has been saved in /etc/ssh/ssh_host_rsa_key.pub.
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: The key fingerprint is:
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: SHA256:apayq/erNHfnyb/pUNyw9tH9TavJHDfs1e1d3TUwNVE root@ubuntu-1604
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: The key's randomart image is:
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: +---[RSA 2048]----+
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: |               +E|
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: |              . .|
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: |            .o   |
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: |           . +o..|
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: |        S   = o.=|
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: |       o   o ..o@|
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: |    + * . o  ..=X|
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: |   ..B . + oo.*.=|
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: |  .o++o.  +o=* .o|
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: +----[SHA256]-----+
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: Generating public/private dsa key pair.
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: Your identification has been saved in /etc/ssh/ssh_host_dsa_key.
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: Your public key has been saved in /etc/ssh/ssh_host_dsa_key.pub.
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: The key fingerprint is:
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: SHA256:pW2EjyUXPz8bFTyV5GEhaRGirOqSo0P6Xay66s3ysQA root@ubuntu-1604
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: The key's randomart image is:
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: +---[DSA 1024]----+
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: |          .. +**=|
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: |        ...o.o++o|
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: |        oo= +  .o|
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: |        .@   o . |
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: |E      .S +   +  |
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: |..   ..  .     + |
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: |o. ...o       .  |
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: |.o+=+o           |
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: |o=OB=.           |
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: +----[SHA256]-----+
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: Generating public/private ecdsa key pair.
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: Your identification has been saved in /etc/ssh/ssh_host_ecdsa_key.
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: Your public key has been saved in /etc/ssh/ssh_host_ecdsa_key.pub.
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: The key fingerprint is:
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: SHA256:df84nxKVz5vxtLPi5zboCMFqnj3eA4P/wijd7JKeH7k root@ubuntu-1604
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: The key's randomart image is:
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: +---[ECDSA 256]---+
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: |                 |
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: |                 |
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: |          . .   .|
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: |        .. . . o |
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: |        So    o..|
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: |       ..oo  . ++|
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: |      .oB+o   =.B|
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: |     .o=+B=..+ @o|
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: |      o==E+++o*+=|
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: +----[SHA256]-----+
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: Generating public/private ed25519 key pair.
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: Your identification has been saved in /etc/ssh/ssh_host_ed25519_key.
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: Your public key has been saved in /etc/ssh/ssh_host_ed25519_key.pub.
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: The key fingerprint is:
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: SHA256:e3Dmj93knknlepmwXhwIPYXza67w38y/SRIS85IhZwY root@ubuntu-1604
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: The key's randomart image is:
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: +--[ED25519 256]--+
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: |         E    .. |
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: |          . .o.  |
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: |         . O oo  |
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: |          = B o. |
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: |        S o+ + .o|
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: |         *  o.o=.|
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: |        . o. .B++|
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: |         . +o*+X+|
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: |          . +=X=B|
Sep 28 08:43:35 ubuntu-1604 cloud-init[652]: +----[SHA256]-----+
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Started Initial cloud-init job (metadata service crawler).
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Reached target Cloud-config availability.
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Reached target Network is Online.
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Reached target System Initialization.
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Listening on D-Bus System Message Bus Socket.
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Reached target Sockets.
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Started Daily Cleanup of Temporary Directories.
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Started Daily apt upgrade and clean activities.
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Reached target Timers.
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Reached target Basic System.
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Starting System Logging Service...
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Started Regular background program processing daemon.
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Started Unattended Upgrades Shutdown.
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Starting Login Service...
Sep 28 08:43:35 ubuntu-1604 cron[734]: (CRON) INFO (pidfile fd = 3)
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Starting OpenBSD Secure Shell server...
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Started D-Bus System Message Bus.
Sep 28 08:43:35 ubuntu-1604 cron[734]: (CRON) INFO (Running @reboot jobs)
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] Linux version 4.8.0-41-generic (buildd@lcy01-01) (gcc version 5.4.0 20160609 (Ubuntu 5.4.0-6ubuntu1~16.04.4) ) #44~16.04.1-Ubuntu SMP Fri Mar 3 17:11:16 UTC 2017 (Ubuntu 4.8.0-41.44~16.04.1-generic 4.8.17)
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-4.8.0-41-generic root=UUID=ff0effb5-4dd3-403f-b236-c5d5b1e676e4 ro console=tty0 console=ttyS0,115200n8 console=tty0 console=ttyS0,115200n8
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] KERNEL supported cpus:
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000]   Intel GenuineIntel
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000]   AMD AuthenticAMD
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000]   Centaur CentaurHauls
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] x86/fpu: Legacy x87 FPU detected.
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] x86/fpu: Using 'eager' FPU context switches.
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] e820: BIOS-provided physical RAM map:
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffdefff] usable
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] BIOS-e820: [mem 0x00000000bffdf000-0x00000000bfffffff] reserved
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000033fffffff] usable
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] NX (Execute Disable) protection: active
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] SMBIOS 2.8 present.
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS Ubuntu-1.8.2-1ubuntu1 04/01/2014
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] Hypervisor detected: KVM
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] e820: remove [mem 0x000a0000-0x000fffff] usable
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] e820: last_pfn = 0x340000 max_arch_pfn = 0x400000000
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] MTRR default type: write-back
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] MTRR fixed ranges enabled:
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000]   00000-9FFFF write-back
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000]   A0000-BFFFF uncachable
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000]   C0000-FFFFF write-protect
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] MTRR variable ranges enabled:
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000]   0 base 00C0000000 mask FFC0000000 uncachable
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000]   1 disabled
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000]   2 disabled
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000]   3 disabled
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000]   4 disabled
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000]   5 disabled
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000]   6 disabled
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000]   7 disabled
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] x86/PAT: PAT not supported by CPU.
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] x86/PAT: Configuration [0-7]: WB  WT  UC- UC  WB  WT  UC- UC  
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] e820: last_pfn = 0xbffdf max_arch_pfn = 0x400000000
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] found SMP MP-table at [mem 0x000f65e0-0x000f65ef] mapped at [ffff91e4800f65e0]
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] Scanning 1 areas for low memory corruption
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] Base memory trampoline at [ffff91e480099000] 99000 size 24576
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] BRK [0x1f6e3c000, 0x1f6e3cfff] PGTABLE
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] BRK [0x1f6e3d000, 0x1f6e3dfff] PGTABLE
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] BRK [0x1f6e3e000, 0x1f6e3efff] PGTABLE
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] BRK [0x1f6e3f000, 0x1f6e3ffff] PGTABLE
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] BRK [0x1f6e40000, 0x1f6e40fff] PGTABLE
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] BRK [0x1f6e41000, 0x1f6e41fff] PGTABLE
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] BRK [0x1f6e42000, 0x1f6e42fff] PGTABLE
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] BRK [0x1f6e43000, 0x1f6e43fff] PGTABLE
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] RAMDISK: [mem 0x33ca8000-0x35e4bfff]
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] ACPI: Early table checksum verification disabled
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] ACPI: RSDP 0x00000000000F6590 000014 (v00 BOCHS )
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] ACPI: RSDT 0x00000000BFFE155D 000034 (v01 BOCHS  BXPCRSDT 00000001 BXPC 00000001)
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] ACPI: FACP 0x00000000BFFE0994 000074 (v01 BOCHS  BXPCFACP 00000001 BXPC 00000001)
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] ACPI: DSDT 0x00000000BFFDFDC0 000BD4 (v01 BOCHS  BXPCDSDT 00000001 BXPC 00000001)
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] ACPI: FACS 0x00000000BFFDFD80 000040
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] ACPI: SSDT 0x00000000BFFE0A08 000A8D (v01 BOCHS  BXPCSSDT 00000001 BXPC 00000001)
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] ACPI: APIC 0x00000000BFFE1495 000090 (v01 BOCHS  BXPCAPIC 00000001 BXPC 00000001)
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] ACPI: HPET 0x00000000BFFE1525 000038 (v01 BOCHS  BXPCHPET 00000001 BXPC 00000001)
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] ACPI: Local APIC address 0xfee00000
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] No NUMA configuration found
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] Faking a node at [mem 0x0000000000000000-0x000000033fffffff]
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] NODE_DATA(0) allocated [mem 0x33fff3000-0x33fff7fff]
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] kvm-clock: cpu 0, msr 3:3ffeb001, primary cpu clock
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] kvm-clock: using sched offset of 2963230678 cycles
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] Zone ranges:
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000]   DMA      [mem 0x0000000000001000-0x0000000000ffffff]
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000]   DMA32    [mem 0x0000000001000000-0x00000000ffffffff]
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000]   Normal   [mem 0x0000000100000000-0x000000033fffffff]
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000]   Device   empty
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] Movable zone start for each node
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] Early memory node ranges
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000]   node   0: [mem 0x0000000000001000-0x000000000009efff]
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000]   node   0: [mem 0x0000000000100000-0x00000000bffdefff]
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000]   node   0: [mem 0x0000000100000000-0x000000033fffffff]
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x000000033fffffff]
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] On node 0 totalpages: 3145597
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000]   DMA zone: 64 pages used for memmap
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000]   DMA zone: 21 pages reserved
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000]   DMA zone: 3998 pages, LIFO batch:0
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000]   DMA32 zone: 12224 pages used for memmap
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000]   DMA32 zone: 782303 pages, LIFO batch:31
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000]   Normal zone: 36864 pages used for memmap
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000]   Normal zone: 2359296 pages, LIFO batch:31
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] ACPI: PM-Timer IO Port: 0x608
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] ACPI: Local APIC address 0xfee00000
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] ACPI: IRQ0 used by override.
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] ACPI: IRQ5 used by override.
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] ACPI: IRQ9 used by override.
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] ACPI: IRQ10 used by override.
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] ACPI: IRQ11 used by override.
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] Using ACPI (MADT) for SMP configuration information
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff]
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff]
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000effff]
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] PM: Registered nosave memory: [mem 0x000f0000-0x000fffff]
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] PM: Registered nosave memory: [mem 0xbffdf000-0xbfffffff]
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] PM: Registered nosave memory: [mem 0xc0000000-0xfeffbfff]
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] PM: Registered nosave memory: [mem 0xfeffc000-0xfeffffff]
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] PM: Registered nosave memory: [mem 0xff000000-0xfffbffff]
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] PM: Registered nosave memory: [mem 0xfffc0000-0xffffffff]
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] e820: [mem 0xc0000000-0xfeffbfff] available for PCI devices
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] Booting paravirtualized kernel on KVM
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] setup_percpu: NR_CPUS:512 nr_cpumask_bits:512 nr_cpu_ids:4 nr_node_ids:1
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] percpu: Embedded 36 pages/cpu @ffff91e7bfc00000 s107864 r8192 d31400 u524288
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] pcpu-alloc: s107864 r8192 d31400 u524288 alloc=1*2097152
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] pcpu-alloc: [0] 0 1 2 3 
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] KVM setup async PF for cpu 0
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] kvm-stealtime: cpu 0, msr 33fc0d940
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] Built 1 zonelists in Node order, mobility grouping on.  Total pages: 3096424
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] Policy zone: Normal
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-4.8.0-41-generic root=UUID=ff0effb5-4dd3-403f-b236-c5d5b1e676e4 ro console=tty0 console=ttyS0,115200n8 console=tty0 console=ttyS0,115200n8
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] Calgary: detecting Calgary via BIOS EBDA area
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] Calgary: Unable to locate Rio Grande table in EBDA - bailing!
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] Memory: 12265568K/12582388K available (8833K kernel code, 1441K rwdata, 3836K rodata, 1552K init, 1296K bss, 316820K reserved, 0K cma-reserved)
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] Hierarchical RCU implementation.
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] 	Build-time adjustment of leaf fanout to 64.
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] 	RCU restricting CPUs from NR_CPUS=512 to nr_cpu_ids=4.
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=64, nr_cpu_ids=4
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] NR_IRQS:33024 nr_irqs:456 16
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] Console: colour dummy device 80x25
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] console [tty0] enabled
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] console [ttyS0] enabled
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] hpet clockevent registered
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.000000] tsc: Detected 3491.912 MHz processor
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.174538] Calibrating delay loop (skipped) preset value.. 6983.82 BogoMIPS (lpj=13967648)
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.175058] pid_max: default: 32768 minimum: 301
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.175349] ACPI: Core revision 20160422
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.176310] ACPI: 2 ACPI AML tables successfully acquired and loaded
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.176736] 
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.176851] Security Framework initialized
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.177107] Yama: becoming mindful.
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.177336] AppArmor: AppArmor initialized
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.178512] Dentry cache hash table entries: 2097152 (order: 12, 16777216 bytes)
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.184243] Inode-cache hash table entries: 1048576 (order: 11, 8388608 bytes)
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.186838] Mount-cache hash table entries: 32768 (order: 6, 262144 bytes)
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.187277] Mountpoint-cache hash table entries: 32768 (order: 6, 262144 bytes)
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.187944] mce: CPU supports 10 MCE banks
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.188234] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.188566] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.189795] Freeing SMP alternatives memory: 32K (ffffffff96aee000 - ffffffff96af6000)
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.194042] ftrace: allocating 33460 entries in 131 pages
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.216292] smpboot: APIC(0) Converting physical 0 to logical package 0
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.216720] smpboot: APIC(1) Converting physical 1 to logical package 1
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.217128] smpboot: APIC(2) Converting physical 2 to logical package 2
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.217534] smpboot: APIC(3) Converting physical 3 to logical package 3
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.217939] smpboot: Max logical packages: 4
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.218326] x2apic enabled
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.218635] Switched APIC routing to physical x2apic.
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.219520] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.326238] smpboot: CPU0: Intel QEMU Virtual CPU version 2.4.0 (family: 0x6, model: 0x6, stepping: 0x3)
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.326997] Performance Events: PMU not available due to virtualization, using software events only.
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.328296] x86: Booting SMP configuration:
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.328624] .... node  #0, CPUs:      #1
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.329023] kvm-clock: cpu 1, msr 3:3ffeb041, secondary cpu clock
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.349496] KVM setup async PF for cpu 1
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.349796] kvm-stealtime: cpu 1, msr 33fc8d940
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.350207]  #2
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.350421] kvm-clock: cpu 2, msr 3:3ffeb081, secondary cpu clock
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.370936] KVM setup async PF for cpu 2
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.371250] kvm-stealtime: cpu 2, msr 33fd0d940
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.371672]  #3
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.371879] kvm-clock: cpu 3, msr 3:3ffeb0c1, secondary cpu clock
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.392372] KVM setup async PF for cpu 3
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.392605] kvm-stealtime: cpu 3, msr 33fd8d940
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.392918] x86: Booted up 1 node, 4 CPUs
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.393179] smpboot: Total of 4 processors activated (27935.29 BogoMIPS)
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.394213] devtmpfs: initialized
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.394478] x86/mm: Memory block size: 128MB
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.396787] evm: security.selinux
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.397003] evm: security.SMACK64
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.397210] evm: security.SMACK64EXEC
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.397441] evm: security.SMACK64TRANSMUTE
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.397694] evm: security.SMACK64MMAP
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.397922] evm: security.ima
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.398110] evm: security.capability
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.398444] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.399093] pinctrl core: initialized pinctrl subsystem
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.399508] RTC time:  8:42:41, date: 09/28/17
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.399901] NET: Registered protocol family 16
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.410282] cpuidle: using governor ladder
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.422282] cpuidle: using governor menu
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.422629] PCCT header not found.
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.423027] ACPI: bus type PCI registered
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.423278] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.423735] PCI: Using configuration type 1 for base access
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.434419] HugeTLB registered 2 MB page size, pre-allocated 0 pages
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.435078] ACPI: Added _OSI(Module Device)
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.435391] ACPI: Added _OSI(Processor Device)
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.435663] ACPI: Added _OSI(3.0 _SCP Extensions)
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.435949] ACPI: Added _OSI(Processor Aggregator Device)
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.436922] ACPI: Interpreter enabled
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.437169] ACPI: (supports S0 S3 S4 S5)
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.437412] ACPI: Using IOAPIC for interrupt routing
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.437730] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.439835] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.440222] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI]
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.440651] acpi PNP0A03:00: _OSC failed (AE_NOT_FOUND); disabling ASPM
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.441060] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.441920] acpiphp: Slot [2] registered
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.442197] acpiphp: Slot [3] registered
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.442470] acpiphp: Slot [4] registered
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.442726] acpiphp: Slot [5] registered
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.442980] acpiphp: Slot [6] registered
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.443234] acpiphp: Slot [7] registered
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.443487] acpiphp: Slot [8] registered
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.443741] acpiphp: Slot [9] registered
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.443995] acpiphp: Slot [10] registered
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.444255] acpiphp: Slot [11] registered
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.444523] acpiphp: Slot [12] registered
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.444787] acpiphp: Slot [13] registered
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.445045] acpiphp: Slot [14] registered
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.445303] acpiphp: Slot [15] registered
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.445562] acpiphp: Slot [16] registered
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.445821] acpiphp: Slot [17] registered
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.446079] acpiphp: Slot [18] registered
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.446342] acpiphp: Slot [19] registered
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.446601] acpiphp: Slot [20] registered
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.446861] acpiphp: Slot [21] registered
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.447120] acpiphp: Slot [22] registered
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.447378] acpiphp: Slot [23] registered
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.447651] acpiphp: Slot [24] registered
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.447907] acpiphp: Slot [25] registered
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.448163] acpiphp: Slot [26] registered
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.448429] acpiphp: Slot [27] registered
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.448692] acpiphp: Slot [28] registered
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.448951] acpiphp: Slot [29] registered
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.449210] acpiphp: Slot [30] registered
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.449468] acpiphp: Slot [31] registered
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.449721] PCI host bridge to bus 0000:00
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.449975] pci_bus 0000:00: root bus resource [io  0x0000-0x0cf7 window]
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.450388] pci_bus 0000:00: root bus resource [io  0x0d00-0xffff window]
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.450798] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.451248] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.451697] pci_bus 0000:00: root bus resource [bus 00-ff]
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.452050] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.452258] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.452561] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.455453] pci 0000:00:01.1: reg 0x20: [io  0xc0c0-0xc0cf]
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.456776] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io  0x01f0-0x01f7]
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.457217] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io  0x03f6]
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.457612] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io  0x0170-0x0177]
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.458043] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io  0x0376]
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.458539] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.461872] pci 0000:00:01.2: reg 0x20: [io  0xc040-0xc05f]
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.463955] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.464153] pci 0000:00:01.3: quirk: [io  0x0600-0x063f] claimed by PIIX4 ACPI
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.464620] pci 0000:00:01.3: quirk: [io  0x0700-0x070f] claimed by PIIX4 SMB
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.465215] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.466116] pci 0000:00:02.0: reg 0x10: [io  0xc060-0xc07f]
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.466998] pci 0000:00:02.0: reg 0x14: [mem 0xfebc0000-0xfebc0fff]
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.471558] pci 0000:00:02.0: reg 0x30: [mem 0xfeb40000-0xfeb7ffff pref]
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.471738] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.473021] pci 0000:00:03.0: reg 0x10: [io  0xc080-0xc09f]
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.474927] pci 0000:00:03.0: reg 0x14: [mem 0xfebc1000-0xfebc1fff]
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.479163] pci 0000:00:03.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref]
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.479347] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.480220] pci 0000:00:04.0: reg 0x10: [io  0xc000-0xc03f]
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.481089] pci 0000:00:04.0: reg 0x14: [mem 0xfebc2000-0xfebc2fff]
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.487412] pci 0000:00:05.0: [1af4:1002] type 00 class 0x00ff00
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.487910] pci 0000:00:05.0: reg 0x10: [io  0xc0a0-0xc0bf]
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.491012] ACPI: PCI Interrupt Link [LNKA] (IRQs 5 *10 11)
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.491479] ACPI: PCI Interrupt Link [LNKB] (IRQs 5 *10 11)
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.491915] ACPI: PCI Interrupt Link [LNKC] (IRQs 5 10 *11)
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.492362] ACPI: PCI Interrupt Link [LNKD] (IRQs 5 10 *11)
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.492786] ACPI: PCI Interrupt Link [LNKS] (IRQs *9)
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.493380] ACPI: Enabled 16 GPEs in block 00 to 0F
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.493912] SCSI subsystem initialized
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.494242] libata version 3.00 loaded.
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.494283] vgaarb: loaded
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.494484] ACPI: bus type USB registered
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.494761] usbcore: registered new interface driver usbfs
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.495106] usbcore: registered new interface driver hub
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.495448] usbcore: registered new device driver usb
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.495952] PCI: Using ACPI for IRQ routing
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.496701] PCI: pci_cache_line_size set to 64 bytes
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.496775] e820: reserve RAM buffer [mem 0x0009fc00-0x0009ffff]
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.496776] e820: reserve RAM buffer [mem 0xbffdf000-0xbfffffff]
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.496855] NetLabel: Initializing
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.497072] NetLabel:  domain hash size = 128
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.497339] NetLabel:  protocols = UNLABELED CIPSOv4
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.497651] NetLabel:  unlabeled traffic allowed by default
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.498131] HPET: 3 timers in total, 0 timers will be used for per-cpu timer
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.498592] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.498923] hpet0: 3 comparators, 64-bit 100.000000 MHz counter
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.502571] clocksource: Switched to clocksource kvm-clock
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.509284] VFS: Disk quotas dquot_6.6.0
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.509575] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.510054] AppArmor: AppArmor Filesystem Enabled
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.510377] pnp: PnP ACPI init
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.510619] pnp 00:00: Plug and Play ACPI device, IDs PNP0b00 (active)
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.510645] pnp 00:01: Plug and Play ACPI device, IDs PNP0303 (active)
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.510668] pnp 00:02: Plug and Play ACPI device, IDs PNP0f13 (active)
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.510684] pnp 00:03: [dma 2]
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.510698] pnp 00:03: Plug and Play ACPI device, IDs PNP0700 (active)
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.510742] pnp 00:04: Plug and Play ACPI device, IDs PNP0501 (active)
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.510862] pnp: PnP ACPI: found 5 devices
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.517460] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.518005] pci_bus 0000:00: resource 4 [io  0x0000-0x0cf7 window]
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.518006] pci_bus 0000:00: resource 5 [io  0x0d00-0xffff window]
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.518007] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.518008] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window]
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.518027] NET: Registered protocol family 2
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.518453] TCP established hash table entries: 131072 (order: 8, 1048576 bytes)
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.519425] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.519888] TCP: Hash tables configured (established 131072 bind 65536)
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.520304] UDP hash table entries: 8192 (order: 6, 262144 bytes)
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.520701] UDP-Lite hash table entries: 8192 (order: 6, 262144 bytes)
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.521142] NET: Registered protocol family 1
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.521415] pci 0000:00:00.0: Limiting direct PCI/PCI transfers
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.521778] pci 0000:00:01.0: PIIX3: Enabling Passive Release
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.522134] pci 0000:00:01.0: Activating ISA DMA hang workarounds
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.537678] ACPI: PCI Interrupt Link [LNKD] enabled at IRQ 11
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.553401] PCI: CLS 0 bytes, default 64
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.553432] Trying to unpack rootfs image as initramfs...
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.906687] Freeing initrd memory: 34448K (ffff91e4b3ca8000 - ffff91e4b5e4c000)
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.907210] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.907602] software IO TLB [mem 0xbbfdf000-0xbffdf000] (64MB) mapped at [ffff91e53bfdf000-ffff91e53ffdefff]
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.908322] Scanning for low memory corruption every 60 seconds
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.908961] futex hash table entries: 1024 (order: 4, 65536 bytes)
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.909367] audit: initializing netlink subsys (disabled)
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.909712] audit: type=2000 audit(1506588162.046:1): initialized
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.910275] Initialise system trusted keyrings
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.910667] workingset: timestamp_bits=40 max_order=22 bucket_order=0
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.912268] zbud: loaded
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.912773] squashfs: version 4.0 (2009/01/31) Phillip Lougher
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.913337] fuse init (API version 7.25)
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.913715] Allocating IMA blacklist keyring.
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.915173] Key type asymmetric registered
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.915434] Asymmetric key parser 'x509' registered
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.915757] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.916254] io scheduler noop registered
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.916522] io scheduler deadline registered (default)
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.916847] io scheduler cfq registered
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.917142] pci_hotplug: PCI Hot Plug PCI Core version: 0.5
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.917488] pciehp: PCI Express Hot Plug Controller Driver version: 0.4
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.917908] efifb: probing for efifb
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.918134] efifb: framebuffer at 0xa0000, using 64k, total 64k
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.918495] efifb: mode is 640x480x1, linelength=80, pages=1
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.918887] efifb: scrolling: redraw
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.919109] efifb: Truecolor: size=8:8:8:8, shift=24:16:8:0
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.920138] Console: switching to colour frame buffer device 80x30
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.921094] fb0: EFI VGA frame buffer device
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.921374] intel_idle: does not run on family 6 model 6
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.921419] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.921891] ACPI: Power Button [PWRF]
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.922295] GHES: HEST is not enabled!
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.938193] ACPI: PCI Interrupt Link [LNKB] enabled at IRQ 10
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.938974] virtio-pci 0000:00:02.0: virtio_pci: leaving for legacy driver
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.955431] ACPI: PCI Interrupt Link [LNKC] enabled at IRQ 11
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.956182] virtio-pci 0000:00:03.0: virtio_pci: leaving for legacy driver
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.972477] virtio-pci 0000:00:04.0: virtio_pci: leaving for legacy driver
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.988617] ACPI: PCI Interrupt Link [LNKA] enabled at IRQ 10
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.989349] virtio-pci 0000:00:05.0: virtio_pci: leaving for legacy driver
Sep 28 08:43:35 ubuntu-1604 kernel: [    0.990661] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.013747] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.016039] Linux agpgart interface v0.103
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.018661] brd: module loaded
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.020585] loop: module loaded
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.021237] ata_piix 0000:00:01.1: version 2.13
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.021849] scsi host0: ata_piix
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.022504] scsi host1: ata_piix
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.023106] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc0c0 irq 14
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.023902] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc0c8 irq 15
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.024815] libphy: Fixed MDIO Bus: probed
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.025490] tun: Universal TUN/TAP device driver, 1.6
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.026158] tun: (C) 1999-2004 Max Krasnyansky <maxk@qualcomm.com>
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.026975] PPP generic driver version 2.4.2
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.027668] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.028443] ehci-pci: EHCI PCI platform driver
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.029114] ehci-platform: EHCI generic platform driver
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.029788] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.030516] ohci-pci: OHCI PCI platform driver
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.031177] ohci-platform: OHCI generic platform driver
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.031921] uhci_hcd: USB Universal Host Controller Interface driver
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.048512] uhci_hcd 0000:00:01.2: UHCI Host Controller
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.049229] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.050402] uhci_hcd 0000:00:01.2: detected 2 ports
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.051145] uhci_hcd 0000:00:01.2: irq 11, io base 0x0000c040
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.051898] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.052685] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.053832] usb usb1: Product: UHCI Host Controller
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.054480] usb usb1: Manufacturer: Linux 4.8.0-41-generic uhci_hcd
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.055205] usb usb1: SerialNumber: 0000:00:01.2
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.055922] hub 1-0:1.0: USB hub found
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.056528] hub 1-0:1.0: 2 ports detected
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.057238] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.058868] serio: i8042 KBD port at 0x60,0x64 irq 1
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.059547] serio: i8042 AUX port at 0x60,0x64 irq 12
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.060322] mousedev: PS/2 mouse device common for all mice
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.061246] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.062695] rtc_cmos 00:00: RTC can wake from S4
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.063531] rtc_cmos 00:00: rtc core: registered rtc_cmos as rtc0
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.064348] rtc_cmos 00:00: alarms up to one day, 114 bytes nvram, hpet irqs
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.065186] i2c /dev entries driver
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.065805] device-mapper: uevent: version 1.0.3
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.066523] device-mapper: ioctl: 4.35.0-ioctl (2016-06-23) initialised: dm-devel@redhat.com
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.067880] ledtrig-cpu: registered to indicate activity on CPUs
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.068935] NET: Registered protocol family 10
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.069806] NET: Registered protocol family 17
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.070468] Key type dns_resolver registered
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.071275] microcode: sig=0x663, pf=0x1, revision=0x1
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.072113] microcode: Microcode Update Driver: v2.01 <tigran@aivazian.fsnet.co.uk>, Peter Oruba
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.073562] registered taskstats version 1
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.074196] Loading compiled-in X.509 certificates
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.076635] Loaded X.509 cert 'Build time autogenerated kernel key: 77008747163565db24da512b7f053aca0a16755c'
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.078044] zswap: loaded using pool lzo/zbud
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.086942] Key type big_key registered
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.088617] Key type trusted registered
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.090249] Key type encrypted registered
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.090926] AppArmor: AppArmor sha1 policy hashing enabled
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.091620] ima: No TPM chip found, activating TPM-bypass!
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.092331] evm: HMAC attrs: 0x1
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.093080]   Magic number: 1:654:726
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.093681] block loop6: hash matches
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.094384] rtc_cmos 00:00: setting system clock to 2017-09-28 08:42:42 UTC (1506588162)
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.095698] BIOS EDD facility v0.16 2004-Jun-25, 0 devices found
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.096447] EDD information not available.
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.097086] PM: Hibernation image not present or could not be loaded.
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.183828] Freeing unused kernel memory: 1552K (ffffffff9696a000 - ffffffff96aee000)
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.185045] Write protecting the kernel read-only data: 14336k
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.186242] Freeing unused kernel memory: 1392K (ffff91e6764a4000 - ffff91e676600000)
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.187918] Freeing unused kernel memory: 260K (ffff91e6769bf000 - ffff91e676a00000)
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.193714] x86/mm: Checked W+X mappings: passed, no W+X pages found.
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.202617] random: systemd-udevd: uninitialized urandom read (16 bytes read)
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.203307] random: udevadm: uninitialized urandom read (16 bytes read)
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.203333] random: udevadm: uninitialized urandom read (16 bytes read)
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.203848] random: udevadm: uninitialized urandom read (16 bytes read)
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.203893] random: udevadm: uninitialized urandom read (16 bytes read)
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.203904] random: udevadm: uninitialized urandom read (16 bytes read)
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.204089] random: udevadm: uninitialized urandom read (16 bytes read)
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.204137] random: udevadm: uninitialized urandom read (16 bytes read)
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.204180] random: udevadm: uninitialized urandom read (16 bytes read)
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.204221] random: udevadm: uninitialized urandom read (16 bytes read)
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.233774] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.235161] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.237442]  vda: vda1
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.245510] virtio_net virtio1 ens3: renamed from eth1
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.255516] virtio_net virtio0 ens2: renamed from eth0
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.258924] FDC 0 is a S82078B
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.351027] EXT4-fs (vda1): mounted filesystem with ordered data mode. Opts: (null)
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.468537] random: fast init done
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.934634] tsc: Refined TSC clocksource calibration: 3491.775 MHz
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.935965] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x3254f68d2b6, max_idle_ns: 440795205840 ns
Sep 28 08:43:35 ubuntu-1604 kernel: [    1.966507] EXT4-fs (vda1): re-mounted. Opts: errors=remount-ro
Sep 28 08:43:35 ubuntu-1604 kernel: [    2.634853] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0
Sep 28 08:43:35 ubuntu-1604 kernel: [    2.641979] ppdev: user-space parallel port driver
Sep 28 08:43:35 ubuntu-1604 kernel: [   40.748023] EXT4-fs (vda1): resizing filesystem from 2047488 to 12799739 blocks
Sep 28 08:43:35 ubuntu-1604 kernel: [   42.769386] EXT4-fs (vda1): resized filesystem to 12799739
Sep 28 08:43:35 ubuntu-1604 rsyslogd-2039: Could not open output pipe '/dev/xconsole':: No such file or directory [v8.16.0 try http://www.rsyslog.com/e/2039 ]
Sep 28 08:43:35 ubuntu-1604 rsyslogd-2007: action 'action 10' suspended, next retry is Thu Sep 28 08:44:05 2017 [v8.16.0 try http://www.rsyslog.com/e/2007 ]
Sep 28 08:43:35 ubuntu-1604 dbus[737]: [system] AppArmor D-Bus mediation is enabled
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Starting /etc/rc.local Compatibility...
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Starting LSB: Record successful boot for GRUB...
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Starting The Salt Minion...
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Starting Apply the settings specified in cloud-config...
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Starting Permit User Sessions...
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Starting LSB: Set the CPU Frequency Scaling governor to "ondemand"...
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Started System Logging Service.
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Started OpenBSD Secure Shell server.
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Started /etc/rc.local Compatibility.
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Started Login Service.
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Starting Daily apt upgrade and clean activities...
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Started Permit User Sessions.
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Started Getty on tty1.
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Started Getty on ttyS0.
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Reached target Login Prompts.
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Starting Set console scheme...
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Started Set console scheme.
Sep 28 08:43:35 ubuntu-1604 systemd[1]: Started LSB: Set the CPU Frequency Scaling governor to "ondemand".
Sep 28 08:43:36 ubuntu-1604 systemd[1]: Started LSB: Record successful boot for GRUB.
Sep 28 08:43:36 ubuntu-1604 cloud-init[745]: Generating locales (this might take a while)...
Sep 28 08:43:37 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe3349645)
Sep 28 08:43:37 ubuntu-1604 cloud-init[745]:   en_US.UTF-8... done
Sep 28 08:43:37 ubuntu-1604 cloud-init[745]: Generation complete.
Sep 28 08:43:38 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe3349645)
Sep 28 08:43:39 ubuntu-1604 systemd[1]: Started The Salt Minion.
Sep 28 08:43:39 ubuntu-1604 systemd[1]: Reached target Multi-User System.
Sep 28 08:43:39 ubuntu-1604 systemd[1]: Reached target Graphical Interface.
Sep 28 08:43:39 ubuntu-1604 systemd[1]: Starting Update UTMP about System Runlevel Changes...
Sep 28 08:43:39 ubuntu-1604 systemd[1]: Started Update UTMP about System Runlevel Changes.
Sep 28 08:43:39 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe3349645)
Sep 28 08:43:41 ubuntu-1604 dhclient[627]: message repeated 2 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe3349645)]
Sep 28 08:43:42 ubuntu-1604 cloud-init[745]: Cloud-init v. 0.7.9 running 'modules:config' at Thu, 28 Sep 2017 08:43:35 +0000. Up 53.75 seconds.
Sep 28 08:43:42 ubuntu-1604 systemd[1]: Started Apply the settings specified in cloud-config.
Sep 28 08:43:42 ubuntu-1604 systemd[1]: Starting Execute cloud user/final scripts...
Sep 28 08:43:42 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe3349645)
Sep 28 08:43:43 ubuntu-1604 ec2: 
Sep 28 08:43:43 ubuntu-1604 ec2: #############################################################
Sep 28 08:43:43 ubuntu-1604 ec2: -----BEGIN SSH HOST KEY FINGERPRINTS-----
Sep 28 08:43:43 ubuntu-1604 ec2: 1024 SHA256:pW2EjyUXPz8bFTyV5GEhaRGirOqSo0P6Xay66s3ysQA root@ubuntu-1604 (DSA)
Sep 28 08:43:43 ubuntu-1604 ec2: 256 SHA256:df84nxKVz5vxtLPi5zboCMFqnj3eA4P/wijd7JKeH7k root@ubuntu-1604 (ECDSA)
Sep 28 08:43:43 ubuntu-1604 ec2: 256 SHA256:e3Dmj93knknlepmwXhwIPYXza67w38y/SRIS85IhZwY root@ubuntu-1604 (ED25519)
Sep 28 08:43:43 ubuntu-1604 ec2: 2048 SHA256:apayq/erNHfnyb/pUNyw9tH9TavJHDfs1e1d3TUwNVE root@ubuntu-1604 (RSA)
Sep 28 08:43:43 ubuntu-1604 ec2: -----END SSH HOST KEY FINGERPRINTS-----
Sep 28 08:43:43 ubuntu-1604 ec2: #############################################################
Sep 28 08:43:43 ubuntu-1604 cloud-init[839]: Cloud-init v. 0.7.9 running 'modules:final' at Thu, 28 Sep 2017 08:43:42 +0000. Up 60.87 seconds.
Sep 28 08:43:43 ubuntu-1604 cloud-init[839]: Cloud-init v. 0.7.9 finished at Thu, 28 Sep 2017 08:43:43 +0000. Datasource DataSourceNone.  Up 61.83 seconds
Sep 28 08:43:43 ubuntu-1604 cloud-init[839]: 2017-09-28 08:43:43,580 - cc_final_message.py[WARNING]: Used fallback datasource
Sep 28 08:43:43 ubuntu-1604 systemd[1]: Started Execute cloud user/final scripts.
Sep 28 08:43:43 ubuntu-1604 systemd[1]: Reached target Cloud-init target.
Sep 28 08:43:43 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe3349645)
Sep 28 08:43:47 ubuntu-1604 dhclient[627]: message repeated 4 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe3349645)]
Sep 28 08:43:48 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 08:43:48 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 08:43:49 ubuntu-1604 systemd[1]: Started Daily apt upgrade and clean activities.
Sep 28 08:43:49 ubuntu-1604 systemd[1]: Startup finished in 1.171s (kernel) + 1min 6.507s (userspace) = 1min 7.678s.
Sep 28 08:43:49 ubuntu-1604 salt-minion[744]: [WARNING ] IMPORTANT: Do not use md5 hashing algorithm! Please set "hash_type" to sha256 in Salt Minion config!
Sep 28 08:44:00 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x53dadc26)
Sep 28 08:44:10 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x53dadc26)]
Sep 28 08:44:11 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 08:44:11 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 08:44:33 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xde85463)
Sep 28 08:44:43 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xde85463)]
Sep 28 08:44:44 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 08:44:44 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 08:44:59 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa7476710)
Sep 28 08:45:09 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa7476710)]
Sep 28 08:45:10 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 08:45:10 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 08:45:12 ubuntu-1604 kernel: [  151.191522] random: crng init done
Sep 28 08:45:30 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9db08511)
Sep 28 08:45:40 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9db08511)]
Sep 28 08:45:41 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 08:45:41 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 08:45:58 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6758db3b)
Sep 28 08:46:08 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6758db3b)]
Sep 28 08:46:09 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 08:46:09 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 08:46:30 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x50a78058)
Sep 28 08:46:40 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x50a78058)]
Sep 28 08:46:41 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 08:46:41 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 08:46:48 ubuntu-1604 dhclient[600]: DHCPREQUEST of 192.168.11.25 on ens2 to 192.168.11.3 port 67 (xid=0x3415f07)
Sep 28 08:46:48 ubuntu-1604 dhclient[600]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 08:46:48 ubuntu-1604 systemd[1]: Stopping Network Time Synchronization...
Sep 28 08:46:48 ubuntu-1604 systemd[1]: Stopped Network Time Synchronization.
Sep 28 08:46:48 ubuntu-1604 systemd[1]: Starting Network Time Synchronization...
Sep 28 08:46:48 ubuntu-1604 systemd[1]: Started Network Time Synchronization.
Sep 28 08:46:48 ubuntu-1604 systemd-timesyncd[1070]: Synchronized to time server 91.189.94.4:123 (91.189.94.4).
Sep 28 08:46:48 ubuntu-1604 dhclient[600]: bound to 192.168.11.25 -- renewal in 239 seconds.
Sep 28 08:46:50 ubuntu-1604 salt-minion[744]: [ERROR   ] No contents found in top file
Sep 28 08:46:57 ubuntu-1604 salt-minion[744]: [WARNING ] /usr/lib/python2.7/dist-packages/salt/utils/templates.py:73: DeprecationWarning: Starting in 2015.5, cmd.run uses python_shell=False by default, which doesn't support shellisms (pipes, env variables, etc). cmd.run is currently aliased to cmd.shell to prevent breakage. Please switch to cmd.shell or set python_shell=True to avoid breakage in the future, when this aliasing is removed.
Sep 28 08:46:58 ubuntu-1604 salt-minion[744]: [ERROR   ] Exception encountered when attempting to inspect frame in dependency decorator: list index out of range
Sep 28 08:46:59 ubuntu-1604 salt-minion[744]: message repeated 8 times: [ [ERROR   ] Exception encountered when attempting to inspect frame in dependency decorator: list index out of range]
Sep 28 08:47:00 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x95b7de49)
Sep 28 08:47:03 ubuntu-1604 dhclient[627]: message repeated 3 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x95b7de49)]
Sep 28 08:47:04 ubuntu-1604 salt-minion[744]: [ERROR   ] Command 'while true; do salt-call saltutil.running|grep fun: && continue; salt-call --local service.restart salt-minion; break; done' failed with return code: None
Sep 28 08:47:04 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x95b7de49)
Sep 28 08:47:06 ubuntu-1604 dhclient[627]: message repeated 2 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x95b7de49)]
Sep 28 08:47:07 ubuntu-1604 salt-minion[744]: [INFO    ] Executing command ['systemctl', 'status', 'salt-minion.service', '-n', '0'] in directory '/root'
Sep 28 08:47:07 ubuntu-1604 salt-minion[744]: [INFO    ] Executing command ['systemctl', 'is-enabled', 'salt-minion.service'] in directory '/root'
Sep 28 08:47:07 ubuntu-1604 salt-minion[744]: [INFO    ] Executing command ['systemd-run', '--scope', 'systemctl', 'restart', 'salt-minion.service'] in directory '/root'
Sep 28 08:47:07 ubuntu-1604 systemd[1]: Started /bin/systemctl restart salt-minion.service.
Sep 28 08:47:07 ubuntu-1604 systemd[1]: Stopping The Salt Minion...
Sep 28 08:47:07 ubuntu-1604 salt-minion[744]: [WARNING ] Minion received a SIGTERM. Exiting.
Sep 28 08:47:07 ubuntu-1604 salt-minion[744]: The salt minion is shutdown. Minion received a SIGTERM. Exited.
Sep 28 08:47:07 ubuntu-1604 systemd[1]: Stopped The Salt Minion.
Sep 28 08:47:07 ubuntu-1604 systemd[1]: Starting The Salt Minion...
Sep 28 08:47:07 ubuntu-1604 systemd[1]: Started The Salt Minion.
Sep 28 08:47:07 ubuntu-1604 salt-minion[1851]: [INFO    ] Setting up the Salt Minion "ctl02.baremetal-mcp-ocata-ovs-ha.local"
Sep 28 08:47:07 ubuntu-1604 salt-minion[1851]: [INFO    ] Creating minion process manager
Sep 28 08:47:07 ubuntu-1604 salt-minion[1851]: [WARNING ] IMPORTANT: Do not use md5 hashing algorithm! Please set "hash_type" to sha256 in Salt Minion config!
Sep 28 08:47:07 ubuntu-1604 salt-minion[1851]: [INFO    ] The Salt Minion is starting up
Sep 28 08:47:07 ubuntu-1604 salt-minion[1851]: [INFO    ] Minion is starting as user 'root'
Sep 28 08:47:07 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting pull socket on /var/run/salt/minion/minion_event_37cabfca03_pull.ipc
Sep 28 08:47:07 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x95b7de49)
Sep 28 08:47:08 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['date', '+%z'] in directory '/root'
Sep 28 08:47:08 ubuntu-1604 salt-minion[1851]: [INFO    ] Updating job settings for scheduled job: __mine_interval
Sep 28 08:47:08 ubuntu-1604 salt-minion[1851]: [INFO    ] Added mine.update to scheduler
Sep 28 08:47:08 ubuntu-1604 salt-minion[1851]: [INFO    ] Minion is ready to receive requests!
Sep 28 08:47:08 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x95b7de49)
Sep 28 08:47:09 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command state.apply with jid 20170928084709127064
Sep 28 08:47:09 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 1939
Sep 28 08:47:09 ubuntu-1604 salt-minion[1851]: [INFO    ] Running scheduled job: __mine_interval
Sep 28 08:47:09 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x95b7de49)
Sep 28 08:47:10 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x95b7de49)
Sep 28 08:47:11 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 08:47:11 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 08:47:11 ubuntu-1604 systemd[1]: Stopping Network Time Synchronization...
Sep 28 08:47:11 ubuntu-1604 systemd[1]: Stopped Network Time Synchronization.
Sep 28 08:47:11 ubuntu-1604 systemd[1]: Starting Network Time Synchronization...
Sep 28 08:47:11 ubuntu-1604 systemd[1]: Started Network Time Synchronization.
Sep 28 08:47:12 ubuntu-1604 systemd-timesyncd[1963]: Synchronized to time server 91.189.91.157:123 (ntp.ubuntu.com).
Sep 28 08:47:12 ubuntu-1604 salt-minion[1851]: [INFO    ] Loading fresh modules for state activity
Sep 28 08:47:12 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/init.sls'
Sep 28 08:47:12 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/system/init.sls'
Sep 28 08:47:12 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/map.jinja'
Sep 28 08:47:12 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/system/env.sls'
Sep 28 08:47:12 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/map.jinja'
Sep 28 08:47:12 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/system/profile.sls'
Sep 28 08:47:12 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/map.jinja'
Sep 28 08:47:12 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/system/repo.sls'
Sep 28 08:47:12 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/map.jinja'
Sep 28 08:47:12 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/system/package.sls'
Sep 28 08:47:12 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/map.jinja'
Sep 28 08:47:12 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/system/timezone.sls'
Sep 28 08:47:12 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/map.jinja'
Sep 28 08:47:12 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/system/kernel.sls'
Sep 28 08:47:12 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/map.jinja'
Sep 28 08:47:12 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/system/cpu.sls'
Sep 28 08:47:13 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/map.jinja'
Sep 28 08:47:13 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/system/sysfs.sls'
Sep 28 08:47:13 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/map.jinja'
Sep 28 08:47:13 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/system/locale.sls'
Sep 28 08:47:13 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/map.jinja'
Sep 28 08:47:13 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/system/user.sls'
Sep 28 08:47:13 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/map.jinja'
Sep 28 08:47:13 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/system/group.sls'
Sep 28 08:47:13 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/map.jinja'
Sep 28 08:47:13 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/system/limit.sls'
Sep 28 08:47:13 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/map.jinja'
Sep 28 08:47:13 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/system/systemd.sls'
Sep 28 08:47:13 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/map.jinja'
Sep 28 08:47:13 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/network/init.sls'
Sep 28 08:47:13 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/map.jinja'
Sep 28 08:47:13 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/network/hostname.sls'
Sep 28 08:47:13 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/map.jinja'
Sep 28 08:47:13 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/network/host.sls'
Sep 28 08:47:14 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/map.jinja'
Sep 28 08:47:14 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/network/interface.sls'
Sep 28 08:47:14 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/map.jinja'
Sep 28 08:47:14 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/network/proxy.sls'
Sep 28 08:47:14 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/map.jinja'
Sep 28 08:47:14 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/storage/init.sls'
Sep 28 08:47:14 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/map.jinja'
Sep 28 08:47:14 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'ntp/init.sls'
Sep 28 08:47:14 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'ntp/client.sls'
Sep 28 08:47:14 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'ntp/map.jinja'
Sep 28 08:47:14 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'ntp/server.sls'
Sep 28 08:47:14 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'ntp/map.jinja'
Sep 28 08:47:14 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [/etc/environment] at time 08:47:14.602079
Sep 28 08:47:14 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state file.blockreplace for /etc/environment
Sep 28 08:47:14 ubuntu-1604 salt-minion[1851]: [INFO    ] File changed:
Sep 28 08:47:14 ubuntu-1604 salt-minion[1851]: ---
Sep 28 08:47:14 ubuntu-1604 salt-minion[1851]: +++
Sep 28 08:47:14 ubuntu-1604 salt-minion[1851]: @@ -1 +1,4 @@
Sep 28 08:47:14 ubuntu-1604 salt-minion[1851]:  PATH="/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games"
Sep 28 08:47:14 ubuntu-1604 salt-minion[1851]: +# SALT MANAGED VARIABLES - DO NOT EDIT - START
Sep 28 08:47:14 ubuntu-1604 salt-minion[1851]: +# +# SALT MANAGED VARIABLES - END
Sep 28 08:47:14 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [/etc/environment] at time 08:47:14.608491 duration_in_ms=6.412
Sep 28 08:47:14 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [/etc/profile.d] at time 08:47:14.608653
Sep 28 08:47:14 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state file.directory for /etc/profile.d
Sep 28 08:47:14 ubuntu-1604 salt-minion[1851]: [INFO    ] Directory /etc/profile.d is in the correct state
Sep 28 08:47:14 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [/etc/profile.d] at time 08:47:14.609632 duration_in_ms=0.979
Sep 28 08:47:14 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [linux_repo_prereq_pkgs] at time 08:47:14.916856
Sep 28 08:47:14 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state pkg.installed for linux_repo_prereq_pkgs
Sep 28 08:47:14 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 08:47:14 ubuntu-1604 salt-minion[1851]: [INFO    ] All specified packages are already installed
Sep 28 08:47:14 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [linux_repo_prereq_pkgs] at time 08:47:14.975771 duration_in_ms=58.914
Sep 28 08:47:14 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [/etc/apt/apt.conf.d/99proxies-salt-mirantis_openstack] at time 08:47:14.975969
Sep 28 08:47:14 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state file.absent for /etc/apt/apt.conf.d/99proxies-salt-mirantis_openstack
Sep 28 08:47:14 ubuntu-1604 salt-minion[1851]: [INFO    ] File /etc/apt/apt.conf.d/99proxies-salt-mirantis_openstack is not present
Sep 28 08:47:14 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [/etc/apt/apt.conf.d/99proxies-salt-mirantis_openstack] at time 08:47:14.976528 duration_in_ms=0.559
Sep 28 08:47:14 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [/etc/apt/preferences.d/mirantis_openstack] at time 08:47:14.976664
Sep 28 08:47:14 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state file.managed for /etc/apt/preferences.d/mirantis_openstack
Sep 28 08:47:14 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/files/preferences_repo'
Sep 28 08:47:15 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/map.jinja'
Sep 28 08:47:15 ubuntu-1604 salt-minion[1851]: [INFO    ] File changed:
Sep 28 08:47:15 ubuntu-1604 salt-minion[1851]: New file
Sep 28 08:47:15 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [/etc/apt/preferences.d/mirantis_openstack] at time 08:47:15.043867 duration_in_ms=67.203
Sep 28 08:47:15 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [deb http://mirror.fuel-infra.org/mcp-repos/ocata/xenial ocata main] at time 08:47:15.060527
Sep 28 08:47:15 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state pkgrepo.managed for deb http://mirror.fuel-infra.org/mcp-repos/ocata/xenial ocata main
Sep 28 08:47:19 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928084719251428
Sep 28 08:47:19 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 2020
Sep 28 08:47:19 ubuntu-1604 salt-minion[1851]: [INFO    ] Returning information for job: 20170928084719251428
Sep 28 08:47:29 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928084729357315
Sep 28 08:47:29 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 2025
Sep 28 08:47:29 ubuntu-1604 salt-minion[1851]: [INFO    ] Returning information for job: 20170928084729357315
Sep 28 08:47:31 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1bcb846e)
Sep 28 08:47:35 ubuntu-1604 dhclient[627]: message repeated 4 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1bcb846e)]
Sep 28 08:47:35 ubuntu-1604 salt-minion[1851]: [ERROR   ] Failed to configure repo 'deb http://mirror.fuel-infra.org/mcp-repos/ocata/xenial ocata main': Error: HTTP 599: Timeout reading http://mirror.fuel-infra.org/mcp-repos/ocata/xenial/archive-mcpocata.key
Sep 28 08:47:35 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [deb http://mirror.fuel-infra.org/mcp-repos/ocata/xenial ocata main] at time 08:47:35.279988 duration_in_ms=20219.46
Sep 28 08:47:35 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [/etc/apt/apt.conf.d/99proxies-salt-mirantis_openstack_updates] at time 08:47:35.280177
Sep 28 08:47:35 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state file.absent for /etc/apt/apt.conf.d/99proxies-salt-mirantis_openstack_updates
Sep 28 08:47:35 ubuntu-1604 salt-minion[1851]: [INFO    ] File /etc/apt/apt.conf.d/99proxies-salt-mirantis_openstack_updates is not present
Sep 28 08:47:35 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [/etc/apt/apt.conf.d/99proxies-salt-mirantis_openstack_updates] at time 08:47:35.280782 duration_in_ms=0.606
Sep 28 08:47:35 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [/etc/apt/preferences.d/mirantis_openstack_updates] at time 08:47:35.280923
Sep 28 08:47:35 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state file.managed for /etc/apt/preferences.d/mirantis_openstack_updates
Sep 28 08:47:35 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/files/preferences_repo'
Sep 28 08:47:35 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/map.jinja'
Sep 28 08:47:35 ubuntu-1604 salt-minion[1851]: [INFO    ] File changed:
Sep 28 08:47:35 ubuntu-1604 salt-minion[1851]: New file
Sep 28 08:47:35 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [/etc/apt/preferences.d/mirantis_openstack_updates] at time 08:47:35.346941 duration_in_ms=66.018
Sep 28 08:47:35 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [deb http://mirror.fuel-infra.org/mcp-repos/ocata/xenial ocata-updates main] at time 08:47:35.347567
Sep 28 08:47:35 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state pkgrepo.managed for deb http://mirror.fuel-infra.org/mcp-repos/ocata/xenial ocata-updates main
Sep 28 08:47:36 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1bcb846e)
Sep 28 08:47:39 ubuntu-1604 dhclient[627]: message repeated 3 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1bcb846e)]
Sep 28 08:47:39 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928084739390165
Sep 28 08:47:39 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 2032
Sep 28 08:47:39 ubuntu-1604 salt-minion[1851]: [INFO    ] Returning information for job: 20170928084739390165
Sep 28 08:47:40 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1bcb846e)
Sep 28 08:47:41 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1bcb846e)
Sep 28 08:47:42 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 08:47:42 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 08:47:49 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928084749520659
Sep 28 08:47:49 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 2042
Sep 28 08:47:49 ubuntu-1604 salt-minion[1851]: [INFO    ] Returning information for job: 20170928084749520659
Sep 28 08:47:54 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x15c11228)
Sep 28 08:47:55 ubuntu-1604 salt-minion[1851]: [ERROR   ] Failed to configure repo 'deb http://mirror.fuel-infra.org/mcp-repos/ocata/xenial ocata-updates main': Error: HTTP 599: Timeout reading http://mirror.fuel-infra.org/mcp-repos/ocata/xenial/archive-mcpocata.key
Sep 28 08:47:55 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [deb http://mirror.fuel-infra.org/mcp-repos/ocata/xenial ocata-updates main] at time 08:47:55.410495 duration_in_ms=20062.926
Sep 28 08:47:55 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [/etc/apt/apt.conf.d/99proxies-salt-mirantis_openstack_security] at time 08:47:55.410739
Sep 28 08:47:55 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state file.absent for /etc/apt/apt.conf.d/99proxies-salt-mirantis_openstack_security
Sep 28 08:47:55 ubuntu-1604 salt-minion[1851]: [INFO    ] File /etc/apt/apt.conf.d/99proxies-salt-mirantis_openstack_security is not present
Sep 28 08:47:55 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [/etc/apt/apt.conf.d/99proxies-salt-mirantis_openstack_security] at time 08:47:55.411412 duration_in_ms=0.673
Sep 28 08:47:55 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [/etc/apt/preferences.d/mirantis_openstack_security] at time 08:47:55.411591
Sep 28 08:47:55 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state file.managed for /etc/apt/preferences.d/mirantis_openstack_security
Sep 28 08:47:55 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/files/preferences_repo'
Sep 28 08:47:55 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/map.jinja'
Sep 28 08:47:55 ubuntu-1604 salt-minion[1851]: [INFO    ] File changed:
Sep 28 08:47:55 ubuntu-1604 salt-minion[1851]: New file
Sep 28 08:47:55 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [/etc/apt/preferences.d/mirantis_openstack_security] at time 08:47:55.480756 duration_in_ms=69.165
Sep 28 08:47:55 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [deb http://mirror.fuel-infra.org/mcp-repos/ocata/xenial ocata-security main] at time 08:47:55.481471
Sep 28 08:47:55 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state pkgrepo.managed for deb http://mirror.fuel-infra.org/mcp-repos/ocata/xenial ocata-security main
Sep 28 08:47:55 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x15c11228)
Sep 28 08:47:58 ubuntu-1604 dhclient[627]: message repeated 3 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x15c11228)]
Sep 28 08:47:59 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928084759562362
Sep 28 08:47:59 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 2049
Sep 28 08:47:59 ubuntu-1604 salt-minion[1851]: [INFO    ] Returning information for job: 20170928084759562362
Sep 28 08:47:59 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x15c11228)
Sep 28 08:48:04 ubuntu-1604 dhclient[627]: message repeated 5 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x15c11228)]
Sep 28 08:48:05 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 08:48:05 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 08:48:09 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928084809646105
Sep 28 08:48:09 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 2059
Sep 28 08:48:09 ubuntu-1604 salt-minion[1851]: [INFO    ] Returning information for job: 20170928084809646105
Sep 28 08:48:15 ubuntu-1604 salt-minion[1851]: [ERROR   ] Failed to configure repo 'deb http://mirror.fuel-infra.org/mcp-repos/ocata/xenial ocata-security main': Error: HTTP 599: Timeout reading http://mirror.fuel-infra.org/mcp-repos/ocata/xenial/archive-mcpocata.key
Sep 28 08:48:15 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [deb http://mirror.fuel-infra.org/mcp-repos/ocata/xenial ocata-security main] at time 08:48:15.545818 duration_in_ms=20064.345
Sep 28 08:48:15 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [/etc/apt/apt.conf.d/99proxies-salt-mk_openstack] at time 08:48:15.546069
Sep 28 08:48:15 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state file.absent for /etc/apt/apt.conf.d/99proxies-salt-mk_openstack
Sep 28 08:48:15 ubuntu-1604 salt-minion[1851]: [INFO    ] File /etc/apt/apt.conf.d/99proxies-salt-mk_openstack is not present
Sep 28 08:48:15 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [/etc/apt/apt.conf.d/99proxies-salt-mk_openstack] at time 08:48:15.546759 duration_in_ms=0.69
Sep 28 08:48:15 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [/etc/apt/preferences.d/mk_openstack] at time 08:48:15.546940
Sep 28 08:48:15 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state file.managed for /etc/apt/preferences.d/mk_openstack
Sep 28 08:48:15 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/files/preferences_repo'
Sep 28 08:48:15 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/map.jinja'
Sep 28 08:48:15 ubuntu-1604 salt-minion[1851]: [INFO    ] File changed:
Sep 28 08:48:15 ubuntu-1604 salt-minion[1851]: New file
Sep 28 08:48:15 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [/etc/apt/preferences.d/mk_openstack] at time 08:48:15.619245 duration_in_ms=72.305
Sep 28 08:48:15 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [deb [arch=amd64] http://apt-mk.mirantis.com/xenial/ nightly ocata] at time 08:48:15.620074
Sep 28 08:48:15 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state pkgrepo.managed for deb [arch=amd64] http://apt-mk.mirantis.com/xenial/ nightly ocata
Sep 28 08:48:15 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['apt-key', 'add', '/var/cache/salt/minion/extrn_files/base/apt-mk.mirantis.com/public.gpg'] in directory '/root'
Sep 28 08:48:16 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['apt-get', '-q', 'update'] in directory '/root'
Sep 28 08:48:19 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928084819749836
Sep 28 08:48:19 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 2438
Sep 28 08:48:19 ubuntu-1604 salt-minion[1851]: [INFO    ] Returning information for job: 20170928084819749836
Sep 28 08:48:27 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc81e361d)
Sep 28 08:48:28 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc81e361d)
Sep 28 08:48:29 ubuntu-1604 salt-minion[1851]: [INFO    ] {'repo': 'deb [arch=amd64] http://apt-mk.mirantis.com/xenial nightly ocata'}
Sep 28 08:48:29 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [deb [arch=amd64] http://apt-mk.mirantis.com/xenial/ nightly ocata] at time 08:48:29.307573 duration_in_ms=13687.498
Sep 28 08:48:29 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [/etc/apt/apt.conf.d/99proxies-salt-mcp_extra] at time 08:48:29.307930
Sep 28 08:48:29 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state file.absent for /etc/apt/apt.conf.d/99proxies-salt-mcp_extra
Sep 28 08:48:29 ubuntu-1604 salt-minion[1851]: [INFO    ] File /etc/apt/apt.conf.d/99proxies-salt-mcp_extra is not present
Sep 28 08:48:29 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [/etc/apt/apt.conf.d/99proxies-salt-mcp_extra] at time 08:48:29.308924 duration_in_ms=0.993
Sep 28 08:48:29 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [/etc/apt/preferences.d/mcp_extra] at time 08:48:29.309199
Sep 28 08:48:29 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state file.managed for /etc/apt/preferences.d/mcp_extra
Sep 28 08:48:29 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/files/preferences_repo'
Sep 28 08:48:29 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/map.jinja'
Sep 28 08:48:29 ubuntu-1604 salt-minion[1851]: [INFO    ] File changed:
Sep 28 08:48:29 ubuntu-1604 salt-minion[1851]: New file
Sep 28 08:48:29 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [/etc/apt/preferences.d/mcp_extra] at time 08:48:29.433711 duration_in_ms=124.512
Sep 28 08:48:29 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [deb [arch=amd64] http://apt-mk.mirantis.com/xenial/ nightly extra] at time 08:48:29.434506
Sep 28 08:48:29 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state pkgrepo.managed for deb [arch=amd64] http://apt-mk.mirantis.com/xenial/ nightly extra
Sep 28 08:48:29 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['apt-key', 'add', '/var/cache/salt/minion/extrn_files/base/apt-mk.mirantis.com/public.gpg'] in directory '/root'
Sep 28 08:48:29 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['apt-get', '-q', 'update'] in directory '/root'
Sep 28 08:48:29 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc81e361d)
Sep 28 08:48:29 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928084829843562
Sep 28 08:48:29 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 2743
Sep 28 08:48:29 ubuntu-1604 salt-minion[1851]: [INFO    ] Returning information for job: 20170928084829843562
Sep 28 08:48:30 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc81e361d)
Sep 28 08:48:31 ubuntu-1604 salt-minion[1851]: [INFO    ] Configured package repo 'deb [arch=amd64] http://apt-mk.mirantis.com/xenial/ nightly extra'
Sep 28 08:48:31 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [deb [arch=amd64] http://apt-mk.mirantis.com/xenial/ nightly extra] at time 08:48:31.599750 duration_in_ms=2165.243
Sep 28 08:48:31 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [/etc/apt/apt.conf.d/99proxies-salt-mirantis_openstack_holdback] at time 08:48:31.600091
Sep 28 08:48:31 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state file.absent for /etc/apt/apt.conf.d/99proxies-salt-mirantis_openstack_holdback
Sep 28 08:48:31 ubuntu-1604 salt-minion[1851]: [INFO    ] File /etc/apt/apt.conf.d/99proxies-salt-mirantis_openstack_holdback is not present
Sep 28 08:48:31 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [/etc/apt/apt.conf.d/99proxies-salt-mirantis_openstack_holdback] at time 08:48:31.601142 duration_in_ms=1.05
Sep 28 08:48:31 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [/etc/apt/preferences.d/mirantis_openstack_holdback] at time 08:48:31.601427
Sep 28 08:48:31 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state file.managed for /etc/apt/preferences.d/mirantis_openstack_holdback
Sep 28 08:48:31 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/files/preferences_repo'
Sep 28 08:48:31 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/map.jinja'
Sep 28 08:48:31 ubuntu-1604 salt-minion[1851]: [INFO    ] File changed:
Sep 28 08:48:31 ubuntu-1604 salt-minion[1851]: New file
Sep 28 08:48:31 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [/etc/apt/preferences.d/mirantis_openstack_holdback] at time 08:48:31.673694 duration_in_ms=72.267
Sep 28 08:48:31 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [deb http://mirror.fuel-infra.org/mcp-repos/ocata/xenial ocata-holdback main] at time 08:48:31.674478
Sep 28 08:48:31 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state pkgrepo.managed for deb http://mirror.fuel-infra.org/mcp-repos/ocata/xenial ocata-holdback main
Sep 28 08:48:31 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc81e361d)
Sep 28 08:48:37 ubuntu-1604 dhclient[627]: message repeated 6 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc81e361d)]
Sep 28 08:48:38 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 08:48:38 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 08:48:40 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928084840033479
Sep 28 08:48:40 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 2831
Sep 28 08:48:40 ubuntu-1604 salt-minion[1851]: [INFO    ] Returning information for job: 20170928084840033479
Sep 28 08:48:50 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928084850207756
Sep 28 08:48:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 2837
Sep 28 08:48:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Returning information for job: 20170928084850207756
Sep 28 08:48:51 ubuntu-1604 salt-minion[1851]: [ERROR   ] Failed to configure repo 'deb http://mirror.fuel-infra.org/mcp-repos/ocata/xenial ocata-holdback main': Error: HTTP 599: Timeout reading http://mirror.fuel-infra.org/mcp-repos/ocata/xenial/archive-mcpocata.key
Sep 28 08:48:51 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [deb http://mirror.fuel-infra.org/mcp-repos/ocata/xenial ocata-holdback main] at time 08:48:51.737557 duration_in_ms=20063.078
Sep 28 08:48:51 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [/etc/apt/apt.conf.d/99proxies-salt-mirantis_openstack_hotfix] at time 08:48:51.737809
Sep 28 08:48:51 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state file.absent for /etc/apt/apt.conf.d/99proxies-salt-mirantis_openstack_hotfix
Sep 28 08:48:51 ubuntu-1604 salt-minion[1851]: [INFO    ] File /etc/apt/apt.conf.d/99proxies-salt-mirantis_openstack_hotfix is not present
Sep 28 08:48:51 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [/etc/apt/apt.conf.d/99proxies-salt-mirantis_openstack_hotfix] at time 08:48:51.738552 duration_in_ms=0.742
Sep 28 08:48:51 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [/etc/apt/preferences.d/mirantis_openstack_hotfix] at time 08:48:51.738745
Sep 28 08:48:51 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state file.managed for /etc/apt/preferences.d/mirantis_openstack_hotfix
Sep 28 08:48:51 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/files/preferences_repo'
Sep 28 08:48:51 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/map.jinja'
Sep 28 08:48:51 ubuntu-1604 salt-minion[1851]: [INFO    ] File changed:
Sep 28 08:48:51 ubuntu-1604 salt-minion[1851]: New file
Sep 28 08:48:51 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [/etc/apt/preferences.d/mirantis_openstack_hotfix] at time 08:48:51.807314 duration_in_ms=68.569
Sep 28 08:48:51 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [deb http://mirror.fuel-infra.org/mcp-repos/ocata/xenial ocata-hotfix main] at time 08:48:51.807993
Sep 28 08:48:51 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state pkgrepo.managed for deb http://mirror.fuel-infra.org/mcp-repos/ocata/xenial ocata-hotfix main
Sep 28 08:48:58 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x88453e3d)
Sep 28 08:48:59 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x88453e3d)
Sep 28 08:49:00 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928084900287045
Sep 28 08:49:00 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 2844
Sep 28 08:49:00 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x88453e3d)
Sep 28 08:49:00 ubuntu-1604 salt-minion[1851]: [INFO    ] Returning information for job: 20170928084900287045
Sep 28 08:49:01 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x88453e3d)
Sep 28 08:49:08 ubuntu-1604 dhclient[627]: message repeated 7 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x88453e3d)]
Sep 28 08:49:09 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 08:49:09 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 08:49:10 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928084910346970
Sep 28 08:49:10 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 2854
Sep 28 08:49:10 ubuntu-1604 salt-minion[1851]: [INFO    ] Returning information for job: 20170928084910346970
Sep 28 08:49:11 ubuntu-1604 salt-minion[1851]: [ERROR   ] Failed to configure repo 'deb http://mirror.fuel-infra.org/mcp-repos/ocata/xenial ocata-hotfix main': Error: HTTP 599: Timeout reading http://mirror.fuel-infra.org/mcp-repos/ocata/xenial/archive-mcpocata.key
Sep 28 08:49:11 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [deb http://mirror.fuel-infra.org/mcp-repos/ocata/xenial ocata-hotfix main] at time 08:49:11.873312 duration_in_ms=20065.317
Sep 28 08:49:11 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [/etc/apt/apt.conf.d/99proxies-salt-salt] at time 08:49:11.873563
Sep 28 08:49:11 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state file.absent for /etc/apt/apt.conf.d/99proxies-salt-salt
Sep 28 08:49:11 ubuntu-1604 salt-minion[1851]: [INFO    ] File /etc/apt/apt.conf.d/99proxies-salt-salt is not present
Sep 28 08:49:11 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [/etc/apt/apt.conf.d/99proxies-salt-salt] at time 08:49:11.874263 duration_in_ms=0.699
Sep 28 08:49:11 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [/etc/apt/preferences.d/salt] at time 08:49:11.874448
Sep 28 08:49:11 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state file.absent for /etc/apt/preferences.d/salt
Sep 28 08:49:11 ubuntu-1604 salt-minion[1851]: [INFO    ] File /etc/apt/preferences.d/salt is not present
Sep 28 08:49:11 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [/etc/apt/preferences.d/salt] at time 08:49:11.875001 duration_in_ms=0.553
Sep 28 08:49:11 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [deb http://repo.saltstack.com/apt/ubuntu/16.04/amd64/2016.3 xenial main] at time 08:49:11.875694
Sep 28 08:49:11 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state pkgrepo.managed for deb http://repo.saltstack.com/apt/ubuntu/16.04/amd64/2016.3 xenial main
Sep 28 08:49:12 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['apt-key', 'add', '/var/cache/salt/minion/extrn_files/base/repo.saltstack.com/apt/ubuntu/16.04/amd64/2016.3/SALTSTACK-GPG-KEY.pub'] in directory '/root'
Sep 28 08:49:12 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['apt-get', '-q', 'update'] in directory '/root'
Sep 28 08:49:14 ubuntu-1604 salt-minion[1851]: [INFO    ] Configured package repo 'deb http://repo.saltstack.com/apt/ubuntu/16.04/amd64/2016.3 xenial main'
Sep 28 08:49:14 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [deb http://repo.saltstack.com/apt/ubuntu/16.04/amd64/2016.3 xenial main] at time 08:49:14.186716 duration_in_ms=2311.021
Sep 28 08:49:14 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [linux_extra_packages_purged] at time 08:49:14.187071
Sep 28 08:49:14 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state pkg.purged for linux_extra_packages_purged
Sep 28 08:49:14 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['systemd-run', '--scope', 'apt-get', '-q', '-y', 'purge', 'cloud-init'] in directory '/root'
Sep 28 08:49:14 ubuntu-1604 systemd[1]: Started /usr/bin/apt-get -q -y purge cloud-init.
Sep 28 08:49:15 ubuntu-1604 systemd[1]: Stopped Apply the settings specified in cloud-config.
Sep 28 08:49:15 ubuntu-1604 systemd[1]: Stopped target Cloud-config availability.
Sep 28 08:49:15 ubuntu-1604 systemd[1]: Stopped Execute cloud user/final scripts.
Sep 28 08:49:15 ubuntu-1604 systemd[1]: Stopped Initial cloud-init job (pre-networking).
Sep 28 08:49:15 ubuntu-1604 systemd[1]: Stopped Initial cloud-init job (metadata service crawler).
Sep 28 08:49:15 ubuntu-1604 systemd[1]: Stopped target Cloud-init target.
Sep 28 08:49:15 ubuntu-1604 systemd[1]: Reloading.
Sep 28 08:49:16 ubuntu-1604 systemd[1]: message repeated 5 times: [ Reloading.]
Sep 28 08:49:17 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 08:49:17 ubuntu-1604 salt-minion[1851]: [INFO    ] {'removed': {}, 'installed': {'cloud-init': {'new': '', 'old': '0.7.9-153-g16a7302f-0ubuntu1~16.04.2'}, 'ec2-init': {'new': '', 'old': '1'}}}
Sep 28 08:49:17 ubuntu-1604 salt-minion[1851]: [INFO    ] Loading fresh modules for state activity
Sep 28 08:49:17 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [linux_extra_packages_purged] at time 08:49:17.962648 duration_in_ms=3775.576
Sep 28 08:49:17 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [linux_extra_packages_latest] at time 08:49:17.967287
Sep 28 08:49:17 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state pkg.latest for linux_extra_packages_latest
Sep 28 08:49:18 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['apt-get', '-q', 'update'] in directory '/root'
Sep 28 08:49:19 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2ef76727)
Sep 28 08:49:20 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['apt-cache', '-q', 'policy', 'python-msgpack'] in directory '/root'
Sep 28 08:49:20 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['apt-cache', '-q', 'policy', 'python-pymysql'] in directory '/root'
Sep 28 08:49:20 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['apt-cache', '-q', 'policy', 'mcelog'] in directory '/root'
Sep 28 08:49:20 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['systemd-run', '--scope', 'apt-get', '-q', '-y', '-o', 'DPkg::Options::=--force-confold', '-o', 'DPkg::Options::=--force-confdef', 'install', 'mcelog'] in directory '/root'
Sep 28 08:49:20 ubuntu-1604 systemd[1]: Started /usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold -o DPkg::Options::=--force-confdef install mcelog.
Sep 28 08:49:20 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928084920517994
Sep 28 08:49:20 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 3662
Sep 28 08:49:20 ubuntu-1604 salt-minion[1851]: [INFO    ] Returning information for job: 20170928084920517994
Sep 28 08:49:20 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2ef76727)
Sep 28 08:49:21 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2ef76727)
Sep 28 08:49:22 ubuntu-1604 systemd[1]: Reloading.
Sep 28 08:49:22 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2ef76727)
Sep 28 08:49:24 ubuntu-1604 dhclient[627]: message repeated 2 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2ef76727)]
Sep 28 08:49:25 ubuntu-1604 systemd[1]: Reloading.
Sep 28 08:49:25 ubuntu-1604 systemd[1]: Reloading.
Sep 28 08:49:25 ubuntu-1604 systemd[1]: Starting LSB: Machine Check Exceptions (MCE) collector & decoder...
Sep 28 08:49:25 ubuntu-1604 mcelog[3761]: Starting Machine Check Exceptions decoder: mcelog.
Sep 28 08:49:25 ubuntu-1604 systemd[1]: Started LSB: Machine Check Exceptions (MCE) collector & decoder.
Sep 28 08:49:25 ubuntu-1604 systemd[1]: Reloading.
Sep 28 08:49:25 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2ef76727)
Sep 28 08:49:26 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 08:49:26 ubuntu-1604 salt-minion[1851]: [INFO    ] Made the following changes:
Sep 28 08:49:26 ubuntu-1604 salt-minion[1851]: 'mcelog' changed from 'absent' to '128+dfsg-1'
Sep 28 08:49:26 ubuntu-1604 salt-minion[1851]: [INFO    ] Loading fresh modules for state activity
Sep 28 08:49:26 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [linux_extra_packages_latest] at time 08:49:26.904824 duration_in_ms=8937.536
Sep 28 08:49:26 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [UTC] at time 08:49:26.915628
Sep 28 08:49:26 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state timezone.system for UTC
Sep 28 08:49:26 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['timedatectl'] in directory '/root'
Sep 28 08:49:26 ubuntu-1604 dbus[737]: [system] Activating via systemd: service name='org.freedesktop.timedate1' unit='dbus-org.freedesktop.timedate1.service'
Sep 28 08:49:26 ubuntu-1604 systemd[1]: Starting Time & Date Service...
Sep 28 08:49:26 ubuntu-1604 dbus[737]: [system] Successfully activated service 'org.freedesktop.timedate1'
Sep 28 08:49:26 ubuntu-1604 systemd[1]: Started Time & Date Service.
Sep 28 08:49:26 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2ef76727)
Sep 28 08:49:26 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['timedatectl'] in directory '/root'
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Timezone UTC already set, UTC already set to UTC
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [UTC] at time 08:49:27.007792 duration_in_ms=92.162
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [nf_conntrack] at time 08:49:27.016811
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state kmod.present for nf_conntrack
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command 'lsmod' in directory '/root'
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command 'lsmod' in directory '/root'
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command 'modprobe nf_conntrack' in directory '/root'
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command 'lsmod' in directory '/root'
Sep 28 08:49:27 ubuntu-1604 kernel: [  406.000163] nf_conntrack version 0.5.0 (65536 buckets, 262144 max)
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] {'nf_conntrack': 'loaded'}
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [nf_conntrack] at time 08:49:27.406734 duration_in_ms=389.922
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [kernel.panic] at time 08:49:27.408661
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state sysctl.present for kernel.panic
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command 'sysctl -a' in directory '/root'
Sep 28 08:49:27 ubuntu-1604 systemd[1]: proc-sys-fs-binfmt_misc.automount: Got automount request for /proc/sys/fs/binfmt_misc, triggered by 3833 (sysctl)
Sep 28 08:49:27 ubuntu-1604 systemd[1]: Mounting Arbitrary Executable File Formats File System...
Sep 28 08:49:27 ubuntu-1604 systemd[1]: Mounted Arbitrary Executable File Formats File System.
Sep 28 08:49:27 ubuntu-1604 kernel: [  406.102432] nr_pdflush_threads exported in /proc is scheduled for removal
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command 'sysctl -w kernel.panic="60"' in directory '/root'
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] {'kernel.panic': 60}
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [kernel.panic] at time 08:49:27.478218 duration_in_ms=69.556
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [net.ipv4.tcp_keepalive_probes] at time 08:49:27.478558
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state sysctl.present for net.ipv4.tcp_keepalive_probes
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command 'sysctl -a' in directory '/root'
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command 'sysctl -w net.ipv4.tcp_keepalive_probes="8"' in directory '/root'
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] {'net.ipv4.tcp_keepalive_probes': 8}
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [net.ipv4.tcp_keepalive_probes] at time 08:49:27.501124 duration_in_ms=22.564
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [fs.file-max] at time 08:49:27.501485
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state sysctl.present for fs.file-max
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command 'sysctl -a' in directory '/root'
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command 'sysctl -w fs.file-max="124165"' in directory '/root'
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] {'fs.file-max': 124165}
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [fs.file-max] at time 08:49:27.524031 duration_in_ms=22.545
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [net.core.somaxconn] at time 08:49:27.524403
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state sysctl.present for net.core.somaxconn
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command 'sysctl -a' in directory '/root'
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command 'sysctl -w net.core.somaxconn="4096"' in directory '/root'
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] {'net.core.somaxconn': 4096}
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [net.core.somaxconn] at time 08:49:27.547361 duration_in_ms=22.958
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [net.ipv4.tcp_max_syn_backlog] at time 08:49:27.547690
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state sysctl.present for net.ipv4.tcp_max_syn_backlog
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command 'sysctl -a' in directory '/root'
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command 'sysctl -w net.ipv4.tcp_max_syn_backlog="8192"' in directory '/root'
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] {'net.ipv4.tcp_max_syn_backlog': 8192}
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [net.ipv4.tcp_max_syn_backlog] at time 08:49:27.570810 duration_in_ms=23.119
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [net.ipv4.tcp_tw_reuse] at time 08:49:27.571142
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state sysctl.present for net.ipv4.tcp_tw_reuse
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command 'sysctl -a' in directory '/root'
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command 'sysctl -w net.ipv4.tcp_tw_reuse="1"' in directory '/root'
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] {'net.ipv4.tcp_tw_reuse': 1}
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [net.ipv4.tcp_tw_reuse] at time 08:49:27.593380 duration_in_ms=22.237
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [net.ipv4.tcp_retries2] at time 08:49:27.593708
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state sysctl.present for net.ipv4.tcp_retries2
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command 'sysctl -a' in directory '/root'
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command 'sysctl -w net.ipv4.tcp_retries2="5"' in directory '/root'
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] {'net.ipv4.tcp_retries2': 5}
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [net.ipv4.tcp_retries2] at time 08:49:27.615682 duration_in_ms=21.973
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [vm.swappiness] at time 08:49:27.616017
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state sysctl.present for vm.swappiness
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command 'sysctl -a' in directory '/root'
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command 'sysctl -w vm.swappiness="10"' in directory '/root'
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] {'vm.swappiness': 10}
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [vm.swappiness] at time 08:49:27.638556 duration_in_ms=22.538
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [net.ipv4.tcp_keepalive_intvl] at time 08:49:27.638893
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state sysctl.present for net.ipv4.tcp_keepalive_intvl
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command 'sysctl -a' in directory '/root'
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command 'sysctl -w net.ipv4.tcp_keepalive_intvl="3"' in directory '/root'
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] {'net.ipv4.tcp_keepalive_intvl': 3}
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [net.ipv4.tcp_keepalive_intvl] at time 08:49:27.661447 duration_in_ms=22.553
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [net.ipv4.neigh.default.gc_thresh1] at time 08:49:27.661777
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state sysctl.present for net.ipv4.neigh.default.gc_thresh1
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command 'sysctl -a' in directory '/root'
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command 'sysctl -w net.ipv4.neigh.default.gc_thresh1="4096"' in directory '/root'
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] {'net.ipv4.neigh.default.gc_thresh1': 4096}
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [net.ipv4.neigh.default.gc_thresh1] at time 08:49:27.684190 duration_in_ms=22.412
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [net.ipv4.neigh.default.gc_thresh2] at time 08:49:27.684568
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state sysctl.present for net.ipv4.neigh.default.gc_thresh2
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command 'sysctl -a' in directory '/root'
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command 'sysctl -w net.ipv4.neigh.default.gc_thresh2="8192"' in directory '/root'
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] {'net.ipv4.neigh.default.gc_thresh2': 8192}
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [net.ipv4.neigh.default.gc_thresh2] at time 08:49:27.706927 duration_in_ms=22.358
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [net.ipv4.neigh.default.gc_thresh3] at time 08:49:27.707253
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state sysctl.present for net.ipv4.neigh.default.gc_thresh3
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command 'sysctl -a' in directory '/root'
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command 'sysctl -w net.ipv4.neigh.default.gc_thresh3="16384"' in directory '/root'
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] {'net.ipv4.neigh.default.gc_thresh3': 16384}
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [net.ipv4.neigh.default.gc_thresh3] at time 08:49:27.730660 duration_in_ms=23.406
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [net.core.netdev_max_backlog] at time 08:49:27.730996
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state sysctl.present for net.core.netdev_max_backlog
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command 'sysctl -a' in directory '/root'
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command 'sysctl -w net.core.netdev_max_backlog="261144"' in directory '/root'
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] {'net.core.netdev_max_backlog': 261144}
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [net.core.netdev_max_backlog] at time 08:49:27.753572 duration_in_ms=22.575
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [net.ipv4.tcp_keepalive_time] at time 08:49:27.753915
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state sysctl.present for net.ipv4.tcp_keepalive_time
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command 'sysctl -a' in directory '/root'
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command 'sysctl -w net.ipv4.tcp_keepalive_time="30"' in directory '/root'
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] {'net.ipv4.tcp_keepalive_time': 30}
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [net.ipv4.tcp_keepalive_time] at time 08:49:27.776663 duration_in_ms=22.746
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [net.nf_conntrack_max] at time 08:49:27.777025
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state sysctl.present for net.nf_conntrack_max
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command 'sysctl -a' in directory '/root'
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command 'sysctl -w net.nf_conntrack_max="1048576"' in directory '/root'
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] {'net.nf_conntrack_max': 1048576}
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [net.nf_conntrack_max] at time 08:49:27.799763 duration_in_ms=22.737
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [linux_sysfs_package] at time 08:49:27.804703
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state pkg.installed for linux_sysfs_package
Sep 28 08:49:27 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['apt-cache', '-q', 'policy', 'sysfsutils'] in directory '/root'
Sep 28 08:49:27 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2ef76727)
Sep 28 08:49:28 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['apt-get', '-q', 'update'] in directory '/root'
Sep 28 08:49:28 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2ef76727)
Sep 28 08:49:29 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['systemd-run', '--scope', 'apt-get', '-q', '-y', '-o', 'DPkg::Options::=--force-confold', '-o', 'DPkg::Options::=--force-confdef', 'install', 'sysfsutils'] in directory '/root'
Sep 28 08:49:29 ubuntu-1604 systemd[1]: Started /usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold -o DPkg::Options::=--force-confdef install sysfsutils.
Sep 28 08:49:29 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2ef76727)
Sep 28 08:49:30 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928084930553370
Sep 28 08:49:30 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 4148
Sep 28 08:49:30 ubuntu-1604 salt-minion[1851]: [INFO    ] Returning information for job: 20170928084930553370
Sep 28 08:49:30 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 08:49:30 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 08:49:36 ubuntu-1604 systemd[1]: Reloading.
Sep 28 08:49:40 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928084940589781
Sep 28 08:49:40 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 4209
Sep 28 08:49:40 ubuntu-1604 salt-minion[1851]: [INFO    ] Returning information for job: 20170928084940589781
Sep 28 08:49:40 ubuntu-1604 systemd[1]: Reloading.
Sep 28 08:49:40 ubuntu-1604 systemd[1]: Reloading.
Sep 28 08:49:40 ubuntu-1604 systemd[1]: Starting LSB: Set sysfs variables from /etc/sysfs.conf...
Sep 28 08:49:40 ubuntu-1604 sysfsutils[4264]:  * Setting sysfs variables...
Sep 28 08:49:40 ubuntu-1604 sysfsutils[4264]:    ...done.
Sep 28 08:49:40 ubuntu-1604 systemd[1]: Started LSB: Set sysfs variables from /etc/sysfs.conf.
Sep 28 08:49:43 ubuntu-1604 systemd[1]: Reloading.
Sep 28 08:49:45 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 08:49:45 ubuntu-1604 salt-minion[1851]: [INFO    ] Made the following changes:
Sep 28 08:49:45 ubuntu-1604 salt-minion[1851]: 'libsysfs2' changed from 'absent' to '2.1.0+repack-4'
Sep 28 08:49:45 ubuntu-1604 salt-minion[1851]: 'sysfsutils' changed from 'absent' to '2.1.0+repack-4'
Sep 28 08:49:45 ubuntu-1604 salt-minion[1851]: [INFO    ] Loading fresh modules for state activity
Sep 28 08:49:45 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [linux_sysfs_package] at time 08:49:45.268635 duration_in_ms=17463.931
Sep 28 08:49:45 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [/etc/sysfs.d] at time 08:49:45.272483
Sep 28 08:49:45 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state file.directory for /etc/sysfs.d
Sep 28 08:49:45 ubuntu-1604 salt-minion[1851]: [INFO    ] Directory /etc/sysfs.d is in the correct state
Sep 28 08:49:45 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [/etc/sysfs.d] at time 08:49:45.276159 duration_in_ms=3.676
Sep 28 08:49:45 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [ondemand] at time 08:49:45.368456
Sep 28 08:49:45 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state service.dead for ondemand
Sep 28 08:49:45 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['systemctl', 'status', 'ondemand.service', '-n', '0'] in directory '/root'
Sep 28 08:49:45 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['systemctl', 'is-active', 'ondemand.service'] in directory '/root'
Sep 28 08:49:45 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['systemctl', 'is-enabled', 'ondemand.service'] in directory '/root'
Sep 28 08:49:45 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['systemd-run', '--scope', 'systemctl', 'stop', 'ondemand.service'] in directory '/root'
Sep 28 08:49:45 ubuntu-1604 systemd[1]: Started /bin/systemctl stop ondemand.service.
Sep 28 08:49:45 ubuntu-1604 systemd[1]: Stopping LSB: Set the CPU Frequency Scaling governor to "ondemand"...
Sep 28 08:49:45 ubuntu-1604 systemd[1]: Stopped LSB: Set the CPU Frequency Scaling governor to "ondemand".
Sep 28 08:49:45 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['systemctl', 'is-active', 'ondemand.service'] in directory '/root'
Sep 28 08:49:45 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['systemctl', 'is-enabled', 'ondemand.service'] in directory '/root'
Sep 28 08:49:45 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['systemctl', 'is-enabled', 'ondemand.service'] in directory '/root'
Sep 28 08:49:45 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['systemd-run', '--scope', '/usr/sbin/update-rc.d', '-f', 'ondemand', 'remove'] in directory '/root'
Sep 28 08:49:45 ubuntu-1604 systemd[1]: Started /usr/sbin/update-rc.d -f ondemand remove.
Sep 28 08:49:45 ubuntu-1604 systemd[1]: Reloading.
Sep 28 08:49:45 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['systemctl', 'is-enabled', 'ondemand.service'] in directory '/root'
Sep 28 08:49:45 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command 'runlevel' in directory '/root'
Sep 28 08:49:45 ubuntu-1604 salt-minion[1851]: [INFO    ] {'ondemand': True}
Sep 28 08:49:45 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [ondemand] at time 08:49:45.559728 duration_in_ms=191.271
Sep 28 08:49:45 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [cs_CZ.UTF-8] at time 08:49:45.650509
Sep 28 08:49:45 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state locale.present for cs_CZ.UTF-8
Sep 28 08:49:45 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command 'locale -a' in directory '/root'
Sep 28 08:49:45 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['locale-gen', 'cs_CZ.UTF-8'] in directory '/root'
Sep 28 08:49:46 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x78e3f407)
Sep 28 08:49:46 ubuntu-1604 salt-minion[1851]: [INFO    ] {'locale': 'cs_CZ.UTF-8'}
Sep 28 08:49:46 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [cs_CZ.UTF-8] at time 08:49:46.549580 duration_in_ms=899.07
Sep 28 08:49:46 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [en_US.UTF-8] at time 08:49:46.549965
Sep 28 08:49:46 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state locale.present for en_US.UTF-8
Sep 28 08:49:46 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command 'locale -a' in directory '/root'
Sep 28 08:49:46 ubuntu-1604 salt-minion[1851]: [INFO    ] Locale en_US.UTF-8 is already present
Sep 28 08:49:46 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [en_US.UTF-8] at time 08:49:46.560516 duration_in_ms=10.549
Sep 28 08:49:46 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [en_US.UTF-8] at time 08:49:46.561647
Sep 28 08:49:46 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state locale.system for en_US.UTF-8
Sep 28 08:49:46 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command 'localectl' in directory '/root'
Sep 28 08:49:46 ubuntu-1604 dbus[737]: [system] Activating via systemd: service name='org.freedesktop.locale1' unit='dbus-org.freedesktop.locale1.service'
Sep 28 08:49:46 ubuntu-1604 systemd[1]: Starting Locale Service...
Sep 28 08:49:46 ubuntu-1604 dbus[737]: [system] Successfully activated service 'org.freedesktop.locale1'
Sep 28 08:49:46 ubuntu-1604 systemd[1]: Started Locale Service.
Sep 28 08:49:46 ubuntu-1604 salt-minion[1851]: [INFO    ] System locale en_US.UTF-8 already set
Sep 28 08:49:46 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [en_US.UTF-8] at time 08:49:46.900666 duration_in_ms=339.016
Sep 28 08:49:46 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [root] at time 08:49:46.913485
Sep 28 08:49:46 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state user.present for root
Sep 28 08:49:46 ubuntu-1604 salt-minion[1851]: [INFO    ] {'passwd': 'XXX-REDACTED-XXX', 'lstchg': 17437}
Sep 28 08:49:46 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [root] at time 08:49:46.920027 duration_in_ms=6.542
Sep 28 08:49:46 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [/root] at time 08:49:46.921128
Sep 28 08:49:46 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state file.directory for /root
Sep 28 08:49:46 ubuntu-1604 salt-minion[1851]: [INFO    ] Directory /root is in the correct state
Sep 28 08:49:46 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [/root] at time 08:49:46.922579 duration_in_ms=1.451
Sep 28 08:49:46 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [/etc/sudoers.d/90-salt-user-root] at time 08:49:46.922951
Sep 28 08:49:46 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state file.absent for /etc/sudoers.d/90-salt-user-root
Sep 28 08:49:47 ubuntu-1604 salt-minion[1851]: [INFO    ] File /etc/sudoers.d/90-salt-user-root is not present
Sep 28 08:49:47 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [/etc/sudoers.d/90-salt-user-root] at time 08:49:47.052247 duration_in_ms=129.295
Sep 28 08:49:47 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [ubuntu] at time 08:49:47.052686
Sep 28 08:49:47 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state user.present for ubuntu
Sep 28 08:49:47 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['useradd', '-s', '/bin/bash', '-m', '-d', '/home/ubuntu', 'ubuntu'] in directory '/root'
Sep 28 08:49:47 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x78e3f407)
Sep 28 08:49:48 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x78e3f407)
Sep 28 08:49:49 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x78e3f407)
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: [INFO    ] {'shell': '/bin/bash', 'workphone': '', 'uid': 1000, 'passwd': 'x', 'roomnumber': '', 'groups': ['ubuntu'], 'home': '/home/ubuntu', 'password': 'XXX-REDACTED-XXX', 'name': 'ubuntu', 'gid': 1000, 'fullname': '', 'homephone': ''}
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [ubuntu] at time 08:49:49.450596 duration_in_ms=2397.907
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [/home/ubuntu] at time 08:49:49.451809
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state file.directory for /home/ubuntu
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: [INFO    ] {'mode': '0700'}
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [/home/ubuntu] at time 08:49:49.453550 duration_in_ms=1.741
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [/etc/sudoers.d/90-salt-user-ubuntu] at time 08:49:49.454311
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state file.managed for /etc/sudoers.d/90-salt-user-ubuntu
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/files/sudoer'
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command '/usr/sbin/visudo -c -f /tmp/tmpshfoCq' in directory '/root'
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: [INFO    ] File changed:
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: New file
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [/etc/sudoers.d/90-salt-user-ubuntu] at time 08:49:49.539748 duration_in_ms=85.437
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [/etc/security/limits.d/90-salt-default.conf] at time 08:49:49.540165
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state file.managed for /etc/security/limits.d/90-salt-default.conf
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/files/limits.conf'
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/map.jinja'
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: [INFO    ] File changed:
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: New file
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [/etc/security/limits.d/90-salt-default.conf] at time 08:49:49.616074 duration_in_ms=75.909
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [/etc/systemd/system.conf.d/90-salt.conf] at time 08:49:49.616498
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state file.managed for /etc/systemd/system.conf.d/90-salt.conf
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/files/systemd.conf'
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/map.jinja'
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: [INFO    ] File changed:
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: New file
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [/etc/systemd/system.conf.d/90-salt.conf] at time 08:49:49.704947 duration_in_ms=88.449
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [service.systemctl_reload] at time 08:49:49.706136
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state module.wait for service.systemctl_reload
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: [INFO    ] No changes made for service.systemctl_reload
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [service.systemctl_reload] at time 08:49:49.707118 duration_in_ms=0.982
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [service.systemctl_reload] at time 08:49:49.707414
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state module.mod_watch for service.systemctl_reload
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['systemctl', '--system', 'daemon-reload'] in directory '/root'
Sep 28 08:49:49 ubuntu-1604 systemd[1]: Reloading.
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: [INFO    ] {'ret': True}
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [service.systemctl_reload] at time 08:49:49.744141 duration_in_ms=36.725
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [/etc/hostname] at time 08:49:49.744604
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state file.managed for /etc/hostname
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/files/hostname'
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: [INFO    ] File changed:
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: ---
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: +++
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: @@ -1 +1 @@
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: -ubuntu-1604
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: +ctl02
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [/etc/hostname] at time 08:49:49.769172 duration_in_ms=24.568
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [hostname ctl02] at time 08:49:49.770846
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state cmd.wait for hostname ctl02
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: [INFO    ] No changes made for hostname ctl02
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [hostname ctl02] at time 08:49:49.771779 duration_in_ms=0.933
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [hostname ctl02] at time 08:49:49.772053
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state cmd.mod_watch for hostname ctl02
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command 'hostname ctl02' in directory '/root'
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: [INFO    ] {'pid': 4421, 'retcode': 0, 'stderr': '', 'stdout': ''}
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [hostname ctl02] at time 08:49:49.781476 duration_in_ms=9.421
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [mdb02.baremetal-mcp-ocata-ovs-ha.local] at time 08:49:49.849037
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for mdb02.baremetal-mcp-ocata-ovs-ha.local
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: [INFO    ] {'host': 'mdb02.baremetal-mcp-ocata-ovs-ha.local'}
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [mdb02.baremetal-mcp-ocata-ovs-ha.local] at time 08:49:49.851686 duration_in_ms=2.649
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [mdb02] at time 08:49:49.852082
Sep 28 08:49:49 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for mdb02
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] {'host': 'mdb02'}
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [mdb02] at time 08:49:50.021306 duration_in_ms=169.224
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [mdb03] at time 08:49:50.021708
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for mdb03
Sep 28 08:49:50 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x78e3f407)
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] {'host': 'mdb03'}
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [mdb03] at time 08:49:50.215710 duration_in_ms=194.002
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [mdb03.baremetal-mcp-ocata-ovs-ha.local] at time 08:49:50.215905
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for mdb03.baremetal-mcp-ocata-ovs-ha.local
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] {'host': 'mdb03.baremetal-mcp-ocata-ovs-ha.local'}
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [mdb03.baremetal-mcp-ocata-ovs-ha.local] at time 08:49:50.228112 duration_in_ms=12.207
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [mdb01.baremetal-mcp-ocata-ovs-ha.local] at time 08:49:50.228350
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for mdb01.baremetal-mcp-ocata-ovs-ha.local
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] {'host': 'mdb01.baremetal-mcp-ocata-ovs-ha.local'}
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [mdb01.baremetal-mcp-ocata-ovs-ha.local] at time 08:49:50.234355 duration_in_ms=6.004
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [mdb01] at time 08:49:50.234566
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for mdb01
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] {'host': 'mdb01'}
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [mdb01] at time 08:49:50.240194 duration_in_ms=5.628
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [mdb] at time 08:49:50.240447
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for mdb
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] {'host': 'mdb'}
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [mdb] at time 08:49:50.246150 duration_in_ms=5.702
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [mdb.baremetal-mcp-ocata-ovs-ha.local] at time 08:49:50.246357
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for mdb.baremetal-mcp-ocata-ovs-ha.local
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] {'host': 'mdb.baremetal-mcp-ocata-ovs-ha.local'}
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [mdb.baremetal-mcp-ocata-ovs-ha.local] at time 08:49:50.252317 duration_in_ms=5.96
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [prx02] at time 08:49:50.252559
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for prx02
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] {'host': 'prx02'}
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [prx02] at time 08:49:50.258392 duration_in_ms=5.833
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [prx02.baremetal-mcp-ocata-ovs-ha.local] at time 08:49:50.258594
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for prx02.baremetal-mcp-ocata-ovs-ha.local
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] {'host': 'prx02.baremetal-mcp-ocata-ovs-ha.local'}
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [prx02.baremetal-mcp-ocata-ovs-ha.local] at time 08:49:50.264403 duration_in_ms=5.808
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [prx01.baremetal-mcp-ocata-ovs-ha.local] at time 08:49:50.264617
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for prx01.baremetal-mcp-ocata-ovs-ha.local
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] {'host': 'prx01.baremetal-mcp-ocata-ovs-ha.local'}
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [prx01.baremetal-mcp-ocata-ovs-ha.local] at time 08:49:50.270218 duration_in_ms=5.601
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [prx01] at time 08:49:50.270411
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for prx01
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] {'host': 'prx01'}
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [prx01] at time 08:49:50.276319 duration_in_ms=5.908
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [kvm01.baremetal-mcp-ocata-ovs-ha.local] at time 08:49:50.276533
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for kvm01.baremetal-mcp-ocata-ovs-ha.local
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] {'host': 'kvm01.baremetal-mcp-ocata-ovs-ha.local'}
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [kvm01.baremetal-mcp-ocata-ovs-ha.local] at time 08:49:50.282303 duration_in_ms=5.77
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [kvm01] at time 08:49:50.282502
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for kvm01
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] {'host': 'kvm01'}
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [kvm01] at time 08:49:50.288539 duration_in_ms=6.036
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [kvm03.baremetal-mcp-ocata-ovs-ha.local] at time 08:49:50.288768
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for kvm03.baremetal-mcp-ocata-ovs-ha.local
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] {'host': 'kvm03.baremetal-mcp-ocata-ovs-ha.local'}
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [kvm03.baremetal-mcp-ocata-ovs-ha.local] at time 08:49:50.294426 duration_in_ms=5.658
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [kvm03] at time 08:49:50.294624
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for kvm03
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] {'host': 'kvm03'}
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [kvm03] at time 08:49:50.348200 duration_in_ms=53.574
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [kvm02.baremetal-mcp-ocata-ovs-ha.local] at time 08:49:50.348471
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for kvm02.baremetal-mcp-ocata-ovs-ha.local
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] {'host': 'kvm02.baremetal-mcp-ocata-ovs-ha.local'}
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [kvm02.baremetal-mcp-ocata-ovs-ha.local] at time 08:49:50.378806 duration_in_ms=30.335
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [kvm02] at time 08:49:50.379019
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for kvm02
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] {'host': 'kvm02'}
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [kvm02] at time 08:49:50.384690 duration_in_ms=5.671
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [dbs.baremetal-mcp-ocata-ovs-ha.local] at time 08:49:50.384901
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for dbs.baremetal-mcp-ocata-ovs-ha.local
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] {'host': 'dbs.baremetal-mcp-ocata-ovs-ha.local'}
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [dbs.baremetal-mcp-ocata-ovs-ha.local] at time 08:49:50.390689 duration_in_ms=5.788
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [dbs] at time 08:49:50.390880
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for dbs
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] {'host': 'dbs'}
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [dbs] at time 08:49:50.396684 duration_in_ms=5.803
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [prx.baremetal-mcp-ocata-ovs-ha.local] at time 08:49:50.396896
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for prx.baremetal-mcp-ocata-ovs-ha.local
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] {'host': 'prx.baremetal-mcp-ocata-ovs-ha.local'}
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [prx.baremetal-mcp-ocata-ovs-ha.local] at time 08:49:50.402960 duration_in_ms=6.064
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [prx] at time 08:49:50.403166
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for prx
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] {'host': 'prx'}
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [prx] at time 08:49:50.408911 duration_in_ms=5.745
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [gtw01] at time 08:49:50.409118
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for gtw01
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] {'host': 'gtw01'}
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [gtw01] at time 08:49:50.414761 duration_in_ms=5.642
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [gtw01.baremetal-mcp-ocata-ovs-ha.local] at time 08:49:50.414963
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for gtw01.baremetal-mcp-ocata-ovs-ha.local
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] {'host': 'gtw01.baremetal-mcp-ocata-ovs-ha.local'}
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [gtw01.baremetal-mcp-ocata-ovs-ha.local] at time 08:49:50.420746 duration_in_ms=5.783
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [gtw02] at time 08:49:50.420951
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for gtw02
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] {'host': 'gtw02'}
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [gtw02] at time 08:49:50.426835 duration_in_ms=5.884
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [gtw02.baremetal-mcp-ocata-ovs-ha.local] at time 08:49:50.427045
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for gtw02.baremetal-mcp-ocata-ovs-ha.local
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] {'host': 'gtw02.baremetal-mcp-ocata-ovs-ha.local'}
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [gtw02.baremetal-mcp-ocata-ovs-ha.local] at time 08:49:50.432847 duration_in_ms=5.802
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [msg02.baremetal-mcp-ocata-ovs-ha.local] at time 08:49:50.433057
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for msg02.baremetal-mcp-ocata-ovs-ha.local
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] {'host': 'msg02.baremetal-mcp-ocata-ovs-ha.local'}
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [msg02.baremetal-mcp-ocata-ovs-ha.local] at time 08:49:50.438921 duration_in_ms=5.864
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [msg02] at time 08:49:50.439112
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for msg02
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] {'host': 'msg02'}
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [msg02] at time 08:49:50.444947 duration_in_ms=5.834
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [msg03] at time 08:49:50.445158
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for msg03
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] {'host': 'msg03'}
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [msg03] at time 08:49:50.451099 duration_in_ms=5.941
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [msg03.baremetal-mcp-ocata-ovs-ha.local] at time 08:49:50.451306
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for msg03.baremetal-mcp-ocata-ovs-ha.local
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] {'host': 'msg03.baremetal-mcp-ocata-ovs-ha.local'}
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [msg03.baremetal-mcp-ocata-ovs-ha.local] at time 08:49:50.456863 duration_in_ms=5.557
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [msg01.baremetal-mcp-ocata-ovs-ha.local] at time 08:49:50.457074
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for msg01.baremetal-mcp-ocata-ovs-ha.local
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] {'host': 'msg01.baremetal-mcp-ocata-ovs-ha.local'}
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [msg01.baremetal-mcp-ocata-ovs-ha.local] at time 08:49:50.462879 duration_in_ms=5.804
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [msg01] at time 08:49:50.463085
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for msg01
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] {'host': 'msg01'}
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [msg01] at time 08:49:50.479496 duration_in_ms=16.41
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [msg] at time 08:49:50.479693
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for msg
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] {'host': 'msg'}
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [msg] at time 08:49:50.646794 duration_in_ms=167.101
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [msg.baremetal-mcp-ocata-ovs-ha.local] at time 08:49:50.647001
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for msg.baremetal-mcp-ocata-ovs-ha.local
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] {'host': 'msg.baremetal-mcp-ocata-ovs-ha.local'}
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [msg.baremetal-mcp-ocata-ovs-ha.local] at time 08:49:50.652680 duration_in_ms=5.678
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [cfg01.baremetal-mcp-ocata-ovs-ha.local] at time 08:49:50.652872
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for cfg01.baremetal-mcp-ocata-ovs-ha.local
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] {'host': 'cfg01.baremetal-mcp-ocata-ovs-ha.local'}
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [cfg01.baremetal-mcp-ocata-ovs-ha.local] at time 08:49:50.658588 duration_in_ms=5.716
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [cfg01] at time 08:49:50.658781
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for cfg01
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] {'host': 'cfg01'}
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [cfg01] at time 08:49:50.664794 duration_in_ms=6.013
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [cmp002] at time 08:49:50.664989
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for cmp002
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] {'host': 'cmp002'}
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [cmp002] at time 08:49:50.670621 duration_in_ms=5.631
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [cmp002.baremetal-mcp-ocata-ovs-ha.local] at time 08:49:50.670815
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for cmp002.baremetal-mcp-ocata-ovs-ha.local
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] {'host': 'cmp002.baremetal-mcp-ocata-ovs-ha.local'}
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [cmp002.baremetal-mcp-ocata-ovs-ha.local] at time 08:49:50.676648 duration_in_ms=5.832
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [cmp001] at time 08:49:50.676845
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for cmp001
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] {'host': 'cmp001'}
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [cmp001] at time 08:49:50.682664 duration_in_ms=5.819
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [cmp001.baremetal-mcp-ocata-ovs-ha.local] at time 08:49:50.682866
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for cmp001.baremetal-mcp-ocata-ovs-ha.local
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] {'host': 'cmp001.baremetal-mcp-ocata-ovs-ha.local'}
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [cmp001.baremetal-mcp-ocata-ovs-ha.local] at time 08:49:50.688804 duration_in_ms=5.938
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [dbs01] at time 08:49:50.689013
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for dbs01
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] {'host': 'dbs01'}
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [dbs01] at time 08:49:50.694684 duration_in_ms=5.671
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [dbs01.baremetal-mcp-ocata-ovs-ha.local] at time 08:49:50.694885
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for dbs01.baremetal-mcp-ocata-ovs-ha.local
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] {'host': 'dbs01.baremetal-mcp-ocata-ovs-ha.local'}
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [dbs01.baremetal-mcp-ocata-ovs-ha.local] at time 08:49:50.700673 duration_in_ms=5.788
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [dbs02.baremetal-mcp-ocata-ovs-ha.local] at time 08:49:50.700869
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for dbs02.baremetal-mcp-ocata-ovs-ha.local
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] {'host': 'dbs02.baremetal-mcp-ocata-ovs-ha.local'}
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [dbs02.baremetal-mcp-ocata-ovs-ha.local] at time 08:49:50.706762 duration_in_ms=5.893
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [dbs02] at time 08:49:50.706970
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for dbs02
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] {'host': 'dbs02'}
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [dbs02] at time 08:49:50.712828 duration_in_ms=5.857
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [dbs03.baremetal-mcp-ocata-ovs-ha.local] at time 08:49:50.713044
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for dbs03.baremetal-mcp-ocata-ovs-ha.local
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928084950706182
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] {'host': 'dbs03.baremetal-mcp-ocata-ovs-ha.local'}
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [dbs03.baremetal-mcp-ocata-ovs-ha.local] at time 08:49:50.718879 duration_in_ms=5.835
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [dbs03] at time 08:49:50.719055
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for dbs03
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] {'host': 'dbs03'}
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [dbs03] at time 08:49:50.724668 duration_in_ms=5.613
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [cfg01.baremetal-mcp-ocata-ovs-ha.local] at time 08:49:50.724829
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for cfg01.baremetal-mcp-ocata-ovs-ha.local
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Host cfg01.baremetal-mcp-ocata-ovs-ha.local (10.167.4.100) already present
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [cfg01.baremetal-mcp-ocata-ovs-ha.local] at time 08:49:50.725427 duration_in_ms=0.598
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [cfg01] at time 08:49:50.725580
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for cfg01
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Host cfg01 (10.167.4.100) already present
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [cfg01] at time 08:49:50.726149 duration_in_ms=0.569
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [mas01] at time 08:49:50.726300
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for mas01
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 4425
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] {'host': 'mas01'}
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [mas01] at time 08:49:50.730882 duration_in_ms=4.582
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [mas01.baremetal-mcp-ocata-ovs-ha.local] at time 08:49:50.731085
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for mas01.baremetal-mcp-ocata-ovs-ha.local
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] {'host': 'mas01.baremetal-mcp-ocata-ovs-ha.local'}
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [mas01.baremetal-mcp-ocata-ovs-ha.local] at time 08:49:50.733599 duration_in_ms=2.514
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [ctl02.baremetal-mcp-ocata-ovs-ha.local] at time 08:49:50.733782
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for ctl02.baremetal-mcp-ocata-ovs-ha.local
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] {'host': 'ctl02.baremetal-mcp-ocata-ovs-ha.local'}
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Returning information for job: 20170928084950706182
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [ctl02.baremetal-mcp-ocata-ovs-ha.local] at time 08:49:50.739615 duration_in_ms=5.832
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [ctl02] at time 08:49:50.739790
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for ctl02
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] {'host': 'ctl02'}
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [ctl02] at time 08:49:50.745643 duration_in_ms=5.853
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [ctl03] at time 08:49:50.745803
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for ctl03
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] {'host': 'ctl03'}
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [ctl03] at time 08:49:50.877716 duration_in_ms=131.914
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [ctl03.baremetal-mcp-ocata-ovs-ha.local] at time 08:49:50.877920
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for ctl03.baremetal-mcp-ocata-ovs-ha.local
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] {'host': 'ctl03.baremetal-mcp-ocata-ovs-ha.local'}
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [ctl03.baremetal-mcp-ocata-ovs-ha.local] at time 08:49:50.883642 duration_in_ms=5.722
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [ctl01.baremetal-mcp-ocata-ovs-ha.local] at time 08:49:50.883844
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for ctl01.baremetal-mcp-ocata-ovs-ha.local
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] {'host': 'ctl01.baremetal-mcp-ocata-ovs-ha.local'}
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [ctl01.baremetal-mcp-ocata-ovs-ha.local] at time 08:49:50.889706 duration_in_ms=5.862
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [ctl01] at time 08:49:50.889946
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for ctl01
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] {'host': 'ctl01'}
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [ctl01] at time 08:49:50.906586 duration_in_ms=16.64
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [ctl] at time 08:49:50.906784
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for ctl
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] {'host': 'ctl'}
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [ctl] at time 08:49:50.912070 duration_in_ms=5.286
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [ctl.baremetal-mcp-ocata-ovs-ha.local] at time 08:49:50.912304
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for ctl.baremetal-mcp-ocata-ovs-ha.local
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] {'host': 'ctl.baremetal-mcp-ocata-ovs-ha.local'}
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [ctl.baremetal-mcp-ocata-ovs-ha.local] at time 08:49:50.918122 duration_in_ms=5.818
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [ens2] at time 08:49:50.921595
Sep 28 08:49:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state network.managed for ens2
Sep 28 08:49:51 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x78e3f407)
Sep 28 08:49:51 ubuntu-1604 salt-minion[1851]: [INFO    ] Interface ens2 is up to date.
Sep 28 08:49:51 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [ens2] at time 08:49:51.356829 duration_in_ms=435.233
Sep 28 08:49:51 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [ens3] at time 08:49:51.357031
Sep 28 08:49:51 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state network.managed for ens3
Sep 28 08:49:51 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['ifdown', 'ens3'] in directory '/root'
Sep 28 08:49:51 ubuntu-1604 dhclient[627]: receive_packet failed on ens3: Network is down
Sep 28 08:49:51 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['ifup', 'ens3'] in directory '/root'
Sep 28 08:49:51 ubuntu-1604 systemd[1]: Reloading OpenBSD Secure Shell server.
Sep 28 08:49:51 ubuntu-1604 salt-minion[1851]: [INFO    ] {'interface': u'--- \n+++ \n@@ -1,3 +1,5 @@\n auto ens3\n\n-iface ens3 inet dhcp\n\n+iface ens3 inet static\n\n+    address 10.167.4.12\n\n+    netmask 255.255.255.0\n\n \n', 'status': 'Interface ens3 restart to validate'}
Sep 28 08:49:51 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [ens3] at time 08:49:51.515813 duration_in_ms=158.78
Sep 28 08:49:51 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [/etc/profile.d/proxy.sh] at time 08:49:51.516041
Sep 28 08:49:51 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state file.absent for /etc/profile.d/proxy.sh
Sep 28 08:49:51 ubuntu-1604 salt-minion[1851]: [INFO    ] File /etc/profile.d/proxy.sh is not present
Sep 28 08:49:51 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [/etc/profile.d/proxy.sh] at time 08:49:51.516692 duration_in_ms=0.651
Sep 28 08:49:51 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [/etc/apt/apt.conf.d/95proxies] at time 08:49:51.516843
Sep 28 08:49:51 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state file.absent for /etc/apt/apt.conf.d/95proxies
Sep 28 08:49:51 ubuntu-1604 salt-minion[1851]: [INFO    ] File /etc/apt/apt.conf.d/95proxies is not present
Sep 28 08:49:51 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [/etc/apt/apt.conf.d/95proxies] at time 08:49:51.517291 duration_in_ms=0.447
Sep 28 08:49:51 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [ntp] at time 08:49:51.521524
Sep 28 08:49:51 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state pkg.installed for ntp
Sep 28 08:49:51 ubuntu-1604 systemd[1]: Reloaded OpenBSD Secure Shell server.
Sep 28 08:49:51 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['systemd-run', '--scope', 'apt-get', '-q', '-y', '-o', 'DPkg::Options::=--force-confold', '-o', 'DPkg::Options::=--force-confdef', 'install', 'ntp'] in directory '/root'
Sep 28 08:49:51 ubuntu-1604 systemd[1]: Started /usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold -o DPkg::Options::=--force-confdef install ntp.
Sep 28 08:49:52 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x78e3f407)
Sep 28 08:49:55 ubuntu-1604 dhclient[627]: message repeated 3 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x78e3f407)]
Sep 28 08:49:56 ubuntu-1604 systemd[1]: Reloading.
Sep 28 08:49:56 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x78e3f407)
Sep 28 08:49:57 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 08:49:57 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 08:49:59 ubuntu-1604 systemd[1]: Reloading.
Sep 28 08:49:59 ubuntu-1604 systemd[1]: Reloading.
Sep 28 08:49:59 ubuntu-1604 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 08:50:00 ubuntu-1604 ntp[4702]:  * Starting NTP server ntpd
Sep 28 08:50:00 ubuntu-1604 ntpd[4709]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 08:50:00 ubuntu-1604 ntpd[4709]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 08:50:00 ubuntu-1604 ntp[4702]:    ...done.
Sep 28 08:50:00 ubuntu-1604 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 08:50:00 ubuntu-1604 ntpd[4712]: proto: precision = 0.042 usec (-24)
Sep 28 08:50:00 ubuntu-1604 ntpd[4712]: Listen and drop on 0 v6wildcard [::]:123
Sep 28 08:50:00 ubuntu-1604 ntpd[4712]: Listen and drop on 1 v4wildcard 0.0.0.0:123
Sep 28 08:50:00 ubuntu-1604 ntpd[4712]: Listen normally on 2 lo 127.0.0.1:123
Sep 28 08:50:00 ubuntu-1604 ntpd[4712]: Listen normally on 3 ens2 192.168.11.25:123
Sep 28 08:50:00 ubuntu-1604 ntpd[4712]: Listen normally on 4 ens3 10.167.4.12:123
Sep 28 08:50:00 ubuntu-1604 ntpd[4712]: Listen normally on 5 lo [::1]:123
Sep 28 08:50:00 ubuntu-1604 ntpd[4712]: Listen normally on 6 ens2 [fe80::aede:48ff:fe29:812e%2]:123
Sep 28 08:50:00 ubuntu-1604 ntpd[4712]: Listen normally on 7 ens3 [fe80::aede:48ff:fee8:1b33%3]:123
Sep 28 08:50:00 ubuntu-1604 ntpd[4712]: Listening on routing socket on fd #24 for interface updates
Sep 28 08:50:00 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928085000754465
Sep 28 08:50:00 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 4726
Sep 28 08:50:00 ubuntu-1604 salt-minion[1851]: [INFO    ] Returning information for job: 20170928085000754465
Sep 28 08:50:01 ubuntu-1604 systemd[1]: Reloading.
Sep 28 08:50:01 ubuntu-1604 ntpd[4712]: Soliciting pool server 198.206.133.14
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: [INFO    ] Made the following changes:
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: 'ntp' changed from 'absent' to '1:4.2.8p4+dfsg-3ubuntu5.7'
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: 'libopts25' changed from 'absent' to '1:5.18.7-3'
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: [INFO    ] Loading fresh modules for state activity
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [ntp] at time 08:50:02.043855 duration_in_ms=10522.33
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [/etc/ntp.conf] at time 08:50:02.046070
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state file.managed for /etc/ntp.conf
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'ntp/files/ntp.conf'
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'ntp/map.jinja'
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: [INFO    ] File changed:
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: ---
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: +++
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: @@ -1,66 +1,24 @@
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: -# /etc/ntp.conf, configuration for ntpd; see ntp.conf(5) for help
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]:  
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: -driftfile /var/lib/ntp/ntp.drift
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]:  
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: -# Enable this if you want statistics to be logged.
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: -#statsdir /var/log/ntpstats/
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: +# ntpd will only synchronize your clock.
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]:  
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: -statistics loopstats peerstats clockstats
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: -filegen loopstats file loopstats type day enable
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: -filegen peerstats file peerstats type day enable
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: -filegen clockstats file clockstats type day enable
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: +# For details, see:
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: +# - the ntp.conf man page
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: +# - http://support.ntp.org/bin/view/Support/GettingStarted
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: +# - https://wiki.archlinux.org/index.php/Network_Time_Protocol_daemon
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]:  
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: -# Specify one or more NTP servers.
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: +# Associate to cloud NTP pool servers
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: +server 1.pool.ntp.org iburst
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: +server 0.pool.ntp.org
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]:  
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: -# Use servers from the NTP Pool Project. Approved by Ubuntu Technical Board
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: -# on 2011-02-08 (LP: #104525). See http://www.pool.ntp.org/join.html for
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: -# more information.
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: -pool 0.ubuntu.pool.ntp.org iburst
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: -pool 1.ubuntu.pool.ntp.org iburst
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: -pool 2.ubuntu.pool.ntp.org iburst
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: -pool 3.ubuntu.pool.ntp.org iburst
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: -
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: -# Use Ubuntu's ntp server as a fallback.
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: -pool ntp.ubuntu.com
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: -
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: -# Access control configuration; see /usr/share/doc/ntp-doc/html/accopt.html for
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: -# details.  The web page <http://support.ntp.org/bin/view/Support/AccessRestrictions>
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: -# might also be helpful.
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: -#
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: -# Note that "restrict" applies to both servers and clients, so a configuration
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: -# that might be intended to block requests from certain clients could also end
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: -# up blocking replies from your own upstream servers.
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: -
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: -# By default, exchange time with everybody, but don't allow configuration.
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: -restrict -4 default kod notrap nomodify nopeer noquery limited
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: -restrict -6 default kod notrap nomodify nopeer noquery limited
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: -
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: -# Local users may interrogate the ntp server more closely.
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: +# Only allow read-only access from localhost
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: +restrict default noquery nopeer
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]:  restrict 127.0.0.1
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]:  restrict ::1
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]:  
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: -# Needed for adding pool entries
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: -restrict source notrap nomodify noquery
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: -
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: -# Clients from this (example!) subnet have unlimited access, but only if
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: -# cryptographically authenticated.
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: -#restrict 192.168.123.0 mask 255.255.255.0 notrust
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: +# mode7 is required for collectd monitoring
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]:  
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]:  
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: -# If you want to provide time to your local subnet, change the next line.
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: -# (Again, the address is an example only.)
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: -#broadcast 192.168.123.255
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: -
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: -# If you want to listen to time broadcasts on your local subnet, de-comment the
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: -# next lines.  Please do this only if you trust everybody on the network!
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: -#disable auth
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: -#broadcastclient
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: -
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: -#Changes recquired to use pps synchonisation as explained in documentation:
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: -#http://www.ntp.org/ntpfaq/NTP-s-config-adv.htm#AEN3918
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: -
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: -#server 127.127.8.1 mode 135 prefer    # Meinberg GPS167 with PPS
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: -#fudge 127.127.8.1 time1 0.0042        # relative to PPS for my hardware
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: -
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: -#server 127.127.22.1                   # ATOM(PPS)
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: -#fudge 127.127.22.1 flag3 1            # enable PPS API
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: +# Location of drift file
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: +driftfile /var/lib/ntp/ntp.drift
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: +logfile /var/log/ntp.log
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [/etc/ntp.conf] at time 08:50:02.099614 duration_in_ms=53.544
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [ntp] at time 08:50:02.161391
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state service.running for ntp
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['systemctl', 'status', 'ntp.service', '-n', '0'] in directory '/root'
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['systemctl', 'is-active', 'ntp.service'] in directory '/root'
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['systemctl', 'is-enabled', 'ntp.service'] in directory '/root'
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: [INFO    ] The service ntp is already running
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [ntp] at time 08:50:02.187350 duration_in_ms=25.958
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [ntp] at time 08:50:02.187507
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state service.mod_watch for ntp
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['systemctl', 'is-active', 'ntp.service'] in directory '/root'
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['systemctl', 'is-enabled', 'ntp.service'] in directory '/root'
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['systemd-run', '--scope', 'systemctl', 'restart', 'ntp.service'] in directory '/root'
Sep 28 08:50:02 ubuntu-1604 systemd[1]: Started /bin/systemctl restart ntp.service.
Sep 28 08:50:02 ubuntu-1604 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 08:50:02 ubuntu-1604 ntp[4806]:  * Stopping NTP server ntpd
Sep 28 08:50:02 ubuntu-1604 ntpd[4712]: ntpd exiting on signal 15 (Terminated)
Sep 28 08:50:02 ubuntu-1604 ntpd[4712]: 198.206.133.14 local addr 192.168.11.25 -> <null>
Sep 28 08:50:02 ubuntu-1604 ntp[4806]:    ...done.
Sep 28 08:50:02 ubuntu-1604 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 08:50:02 ubuntu-1604 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 08:50:02 ubuntu-1604 ntp[4817]:  * Starting NTP server ntpd
Sep 28 08:50:02 ubuntu-1604 ntpd[4824]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 08:50:02 ubuntu-1604 ntpd[4824]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 08:50:02 ubuntu-1604 ntp[4817]:    ...done.
Sep 28 08:50:02 ubuntu-1604 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: [INFO    ] {'ntp': True}
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [ntp] at time 08:50:02.253296 duration_in_ms=65.787
Sep 28 08:50:02 ubuntu-1604 salt-minion[1851]: [INFO    ] Returning information for job: 20170928084709127064
Sep 28 08:50:02 ubuntu-1604 ntpd[4827]: proto: precision = 0.042 usec (-24)
Sep 28 08:50:02 ubuntu-1604 ntpd[4827]: switching logging to file /var/log/ntp.log
Sep 28 08:50:19 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8afee771)
Sep 28 08:50:29 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8afee771)]
Sep 28 08:50:30 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 08:50:30 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 08:50:47 ubuntu-1604 dhclient[600]: DHCPREQUEST of 192.168.11.25 on ens2 to 192.168.11.3 port 67 (xid=0x3415f07)
Sep 28 08:50:47 ubuntu-1604 dhclient[600]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 08:50:47 ubuntu-1604 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 08:50:47 ubuntu-1604 ntp[4896]:  * Stopping NTP server ntpd
Sep 28 08:50:47 ubuntu-1604 ntp[4896]:    ...done.
Sep 28 08:50:47 ubuntu-1604 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 08:50:47 ubuntu-1604 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 08:50:47 ubuntu-1604 ntp[4907]:  * Starting NTP server ntpd
Sep 28 08:50:47 ubuntu-1604 ntpd[4914]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 08:50:47 ubuntu-1604 ntpd[4914]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -c /var/lib/ntp/ntp.conf.dhcp -u 108:112
Sep 28 08:50:47 ubuntu-1604 ntp[4907]:    ...done.
Sep 28 08:50:47 ubuntu-1604 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 08:50:47 ubuntu-1604 systemd[1]: Stopping Network Time Synchronization...
Sep 28 08:50:47 ubuntu-1604 ntpd[4917]: proto: precision = 0.043 usec (-24)
Sep 28 08:50:47 ubuntu-1604 ntpd[4917]: switching logging to file /var/log/ntp.log
Sep 28 08:50:47 ubuntu-1604 systemd[1]: Stopped Network Time Synchronization.
Sep 28 08:50:47 ubuntu-1604 dhclient[600]: bound to 192.168.11.25 -- renewal in 253 seconds.
Sep 28 08:50:49 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x36000265)
Sep 28 08:50:59 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x36000265)]
Sep 28 08:51:00 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 08:51:00 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 08:51:00 ubuntu-1604 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 08:51:00 ubuntu-1604 ntp[4972]:  * Stopping NTP server ntpd
Sep 28 08:51:00 ubuntu-1604 ntp[4972]:    ...done.
Sep 28 08:51:00 ubuntu-1604 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 08:51:00 ubuntu-1604 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 08:51:00 ubuntu-1604 ntp[4983]:  * Starting NTP server ntpd
Sep 28 08:51:00 ubuntu-1604 ntpd[4990]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 08:51:00 ubuntu-1604 ntpd[4990]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 08:51:00 ubuntu-1604 ntp[4983]:    ...done.
Sep 28 08:51:00 ubuntu-1604 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 08:51:00 ubuntu-1604 ntpd[4993]: proto: precision = 0.042 usec (-24)
Sep 28 08:51:00 ubuntu-1604 ntpd[4993]: switching logging to file /var/log/ntp.log
Sep 28 08:51:21 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xea45d07c)
Sep 28 08:51:31 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xea45d07c)]
Sep 28 08:51:32 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 08:51:32 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 08:51:40 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x697b6736)
Sep 28 08:51:50 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x697b6736)]
Sep 28 08:51:51 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 08:51:51 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 08:52:07 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9e1d9a0c)
Sep 28 08:52:17 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9e1d9a0c)]
Sep 28 08:52:18 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 08:52:18 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 08:52:26 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1612f21a)
Sep 28 08:52:36 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1612f21a)]
Sep 28 08:52:37 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 08:52:37 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 08:52:51 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xbd9f4768)
Sep 28 08:53:01 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xbd9f4768)]
Sep 28 08:53:02 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 08:53:02 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 08:53:21 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x18ffb32)
Sep 28 08:53:31 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x18ffb32)]
Sep 28 08:53:32 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 08:53:32 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 08:53:44 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x49168b65)
Sep 28 08:53:54 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x49168b65)]
Sep 28 08:53:55 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 08:53:55 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 08:54:11 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9e36d666)
Sep 28 08:54:21 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9e36d666)]
Sep 28 08:54:22 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 08:54:22 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 08:54:36 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x99699e60)
Sep 28 08:54:46 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x99699e60)]
Sep 28 08:54:47 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 08:54:47 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 08:55:01 ubuntu-1604 dhclient[600]: DHCPREQUEST of 192.168.11.25 on ens2 to 192.168.11.3 port 67 (xid=0x3415f07)
Sep 28 08:55:01 ubuntu-1604 dhclient[600]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 08:55:01 ubuntu-1604 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 08:55:01 ubuntu-1604 ntp[5097]:  * Stopping NTP server ntpd
Sep 28 08:55:01 ubuntu-1604 ntp[5097]:    ...done.
Sep 28 08:55:01 ubuntu-1604 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 08:55:01 ubuntu-1604 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 08:55:01 ubuntu-1604 ntp[5108]:  * Starting NTP server ntpd
Sep 28 08:55:01 ubuntu-1604 ntpd[5115]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 08:55:01 ubuntu-1604 ntpd[5115]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -c /var/lib/ntp/ntp.conf.dhcp -u 108:112
Sep 28 08:55:01 ubuntu-1604 ntp[5108]:    ...done.
Sep 28 08:55:01 ubuntu-1604 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 08:55:01 ubuntu-1604 ntpd[5118]: proto: precision = 0.042 usec (-24)
Sep 28 08:55:01 ubuntu-1604 ntpd[5118]: switching logging to file /var/log/ntp.log
Sep 28 08:55:01 ubuntu-1604 dhclient[600]: bound to 192.168.11.25 -- renewal in 235 seconds.
Sep 28 08:55:03 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4715b539)
Sep 28 08:55:13 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4715b539)]
Sep 28 08:55:14 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 08:55:14 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 08:55:14 ubuntu-1604 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 08:55:14 ubuntu-1604 ntp[5171]:  * Stopping NTP server ntpd
Sep 28 08:55:14 ubuntu-1604 ntp[5171]:    ...done.
Sep 28 08:55:14 ubuntu-1604 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 08:55:14 ubuntu-1604 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 08:55:14 ubuntu-1604 ntp[5182]:  * Starting NTP server ntpd
Sep 28 08:55:14 ubuntu-1604 ntpd[5189]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 08:55:14 ubuntu-1604 ntpd[5189]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 08:55:14 ubuntu-1604 ntp[5182]:    ...done.
Sep 28 08:55:14 ubuntu-1604 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 08:55:14 ubuntu-1604 ntpd[5192]: proto: precision = 0.042 usec (-24)
Sep 28 08:55:14 ubuntu-1604 ntpd[5192]: switching logging to file /var/log/ntp.log
Sep 28 08:55:34 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xaf7c6f47)
Sep 28 08:55:44 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xaf7c6f47)]
Sep 28 08:55:45 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 08:55:45 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 08:55:53 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb22033)
Sep 28 08:56:03 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb22033)]
Sep 28 08:56:04 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 08:56:04 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 08:56:23 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf456413e)
Sep 28 08:56:33 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf456413e)]
Sep 28 08:56:34 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 08:56:34 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 08:56:53 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2bf3d314)
Sep 28 08:57:03 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2bf3d314)]
Sep 28 08:57:04 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 08:57:04 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 08:57:15 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4497e30a)
Sep 28 08:57:25 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4497e30a)]
Sep 28 08:57:26 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 08:57:26 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 08:57:36 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9f5ae946)
Sep 28 08:57:42 ubuntu-1604 dhclient[627]: message repeated 6 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9f5ae946)]
Sep 28 08:57:43 ubuntu-1604 systemd[1]: Starting Cleanup of Temporary Directories...
Sep 28 08:57:43 ubuntu-1604 systemd-tmpfiles[5221]: [/usr/lib/tmpfiles.d/var.conf:14] Duplicate line for path "/var/log", ignoring.
Sep 28 08:57:43 ubuntu-1604 systemd[1]: Started Cleanup of Temporary Directories.
Sep 28 08:57:43 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9f5ae946)
Sep 28 08:57:46 ubuntu-1604 dhclient[627]: message repeated 3 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9f5ae946)]
Sep 28 08:57:47 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 08:57:47 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 08:58:08 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x540f2b1f)
Sep 28 08:58:18 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x540f2b1f)]
Sep 28 08:58:19 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 08:58:19 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 08:58:32 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x70dc925e)
Sep 28 08:58:42 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x70dc925e)]
Sep 28 08:58:43 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 08:58:43 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 08:58:57 ubuntu-1604 dhclient[600]: DHCPREQUEST of 192.168.11.25 on ens2 to 192.168.11.3 port 67 (xid=0x3415f07)
Sep 28 08:58:57 ubuntu-1604 dhclient[600]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 08:58:57 ubuntu-1604 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 08:58:57 ubuntu-1604 ntp[5293]:  * Stopping NTP server ntpd
Sep 28 08:58:57 ubuntu-1604 ntp[5293]:    ...done.
Sep 28 08:58:57 ubuntu-1604 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 08:58:57 ubuntu-1604 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 08:58:57 ubuntu-1604 ntp[5303]:  * Starting NTP server ntpd
Sep 28 08:58:57 ubuntu-1604 ntpd[5311]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 08:58:57 ubuntu-1604 ntpd[5311]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -c /var/lib/ntp/ntp.conf.dhcp -u 108:112
Sep 28 08:58:57 ubuntu-1604 ntp[5303]:    ...done.
Sep 28 08:58:57 ubuntu-1604 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 08:58:57 ubuntu-1604 ntpd[5314]: proto: precision = 0.044 usec (-24)
Sep 28 08:58:57 ubuntu-1604 ntpd[5314]: switching logging to file /var/log/ntp.log
Sep 28 08:58:57 ubuntu-1604 dhclient[600]: bound to 192.168.11.25 -- renewal in 238 seconds.
Sep 28 08:59:02 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa00a883e)
Sep 28 08:59:12 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa00a883e)]
Sep 28 08:59:13 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 08:59:13 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 08:59:13 ubuntu-1604 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 08:59:13 ubuntu-1604 ntp[5366]:  * Stopping NTP server ntpd
Sep 28 08:59:13 ubuntu-1604 ntp[5366]:    ...done.
Sep 28 08:59:13 ubuntu-1604 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 08:59:13 ubuntu-1604 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 08:59:13 ubuntu-1604 ntp[5377]:  * Starting NTP server ntpd
Sep 28 08:59:13 ubuntu-1604 ntpd[5384]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 08:59:13 ubuntu-1604 ntpd[5384]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 08:59:13 ubuntu-1604 ntp[5377]:    ...done.
Sep 28 08:59:13 ubuntu-1604 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 08:59:13 ubuntu-1604 ntpd[5387]: proto: precision = 0.042 usec (-24)
Sep 28 08:59:13 ubuntu-1604 ntpd[5387]: switching logging to file /var/log/ntp.log
Sep 28 08:59:28 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x25ecb839)
Sep 28 08:59:38 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x25ecb839)]
Sep 28 08:59:39 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 08:59:39 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 08:59:50 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf197013)
Sep 28 09:00:00 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf197013)]
Sep 28 09:00:01 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:00:01 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:00:13 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xedbbbb6e)
Sep 28 09:00:23 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xedbbbb6e)]
Sep 28 09:00:24 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:00:24 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:00:44 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x83c5c66e)
Sep 28 09:00:49 ubuntu-1604 dhclient[627]: message repeated 5 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x83c5c66e)]
Sep 28 09:00:49 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command state.apply with jid 20170928090049285450
Sep 28 09:00:49 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 5408
Sep 28 09:00:50 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x83c5c66e)
Sep 28 09:00:52 ubuntu-1604 dhclient[627]: message repeated 2 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x83c5c66e)]
Sep 28 09:00:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Loading fresh modules for state activity
Sep 28 09:00:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/init.sls'
Sep 28 09:00:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/system/init.sls'
Sep 28 09:00:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/map.jinja'
Sep 28 09:00:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/system/env.sls'
Sep 28 09:00:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/map.jinja'
Sep 28 09:00:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/system/profile.sls'
Sep 28 09:00:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/map.jinja'
Sep 28 09:00:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/system/repo.sls'
Sep 28 09:00:53 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/map.jinja'
Sep 28 09:00:53 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/system/package.sls'
Sep 28 09:00:53 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/map.jinja'
Sep 28 09:00:53 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/system/timezone.sls'
Sep 28 09:00:53 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/map.jinja'
Sep 28 09:00:53 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x83c5c66e)
Sep 28 09:00:53 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/system/kernel.sls'
Sep 28 09:00:53 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/map.jinja'
Sep 28 09:00:53 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/system/cpu.sls'
Sep 28 09:00:53 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/map.jinja'
Sep 28 09:00:53 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/system/sysfs.sls'
Sep 28 09:00:53 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/map.jinja'
Sep 28 09:00:53 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/system/locale.sls'
Sep 28 09:00:53 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/map.jinja'
Sep 28 09:00:53 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/system/user.sls'
Sep 28 09:00:53 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/map.jinja'
Sep 28 09:00:53 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/system/group.sls'
Sep 28 09:00:53 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/map.jinja'
Sep 28 09:00:53 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/system/limit.sls'
Sep 28 09:00:53 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/map.jinja'
Sep 28 09:00:53 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/system/systemd.sls'
Sep 28 09:00:53 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/map.jinja'
Sep 28 09:00:53 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/network/init.sls'
Sep 28 09:00:53 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/map.jinja'
Sep 28 09:00:53 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/network/hostname.sls'
Sep 28 09:00:54 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/map.jinja'
Sep 28 09:00:54 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/network/host.sls'
Sep 28 09:00:54 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/map.jinja'
Sep 28 09:00:54 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/network/interface.sls'
Sep 28 09:00:54 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x83c5c66e)
Sep 28 09:00:54 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/map.jinja'
Sep 28 09:00:54 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/network/proxy.sls'
Sep 28 09:00:54 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/map.jinja'
Sep 28 09:00:54 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/storage/init.sls'
Sep 28 09:00:54 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/map.jinja'
Sep 28 09:00:54 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'ntp/init.sls'
Sep 28 09:00:54 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'ntp/client.sls'
Sep 28 09:00:54 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'ntp/map.jinja'
Sep 28 09:00:54 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'ntp/server.sls'
Sep 28 09:00:54 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'ntp/map.jinja'
Sep 28 09:00:54 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [/etc/environment] at time 09:00:54.576021
Sep 28 09:00:54 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state file.blockreplace for /etc/environment
Sep 28 09:00:54 ubuntu-1604 salt-minion[1851]: [INFO    ] File changed:
Sep 28 09:00:54 ubuntu-1604 salt-minion[1851]: ---
Sep 28 09:00:54 ubuntu-1604 salt-minion[1851]: +++
Sep 28 09:00:54 ubuntu-1604 salt-minion[1851]: @@ -1,3 +1,4 @@
Sep 28 09:00:54 ubuntu-1604 salt-minion[1851]:  PATH="/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games"
Sep 28 09:00:54 ubuntu-1604 salt-minion[1851]:  # SALT MANAGED VARIABLES - DO NOT EDIT - START
Sep 28 09:00:54 ubuntu-1604 salt-minion[1851]: +#
Sep 28 09:00:54 ubuntu-1604 salt-minion[1851]:  # # SALT MANAGED VARIABLES - END
Sep 28 09:00:54 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [/etc/environment] at time 09:00:54.582667 duration_in_ms=6.646
Sep 28 09:00:54 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [/etc/profile.d] at time 09:00:54.582969
Sep 28 09:00:54 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state file.directory for /etc/profile.d
Sep 28 09:00:54 ubuntu-1604 salt-minion[1851]: [INFO    ] Directory /etc/profile.d is in the correct state
Sep 28 09:00:54 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [/etc/profile.d] at time 09:00:54.584434 duration_in_ms=1.465
Sep 28 09:00:54 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [linux_repo_prereq_pkgs] at time 09:00:54.845378
Sep 28 09:00:54 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state pkg.installed for linux_repo_prereq_pkgs
Sep 28 09:00:54 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 09:00:55 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:00:55 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:00:55 ubuntu-1604 salt-minion[1851]: [INFO    ] All specified packages are already installed
Sep 28 09:00:55 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [linux_repo_prereq_pkgs] at time 09:00:55.319089 duration_in_ms=473.711
Sep 28 09:00:55 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [/etc/apt/apt.conf.d/99proxies-salt-mirantis_openstack] at time 09:00:55.319443
Sep 28 09:00:55 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state file.absent for /etc/apt/apt.conf.d/99proxies-salt-mirantis_openstack
Sep 28 09:00:55 ubuntu-1604 salt-minion[1851]: [INFO    ] File /etc/apt/apt.conf.d/99proxies-salt-mirantis_openstack is not present
Sep 28 09:00:55 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [/etc/apt/apt.conf.d/99proxies-salt-mirantis_openstack] at time 09:00:55.320455 duration_in_ms=1.011
Sep 28 09:00:55 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [/etc/apt/preferences.d/mirantis_openstack] at time 09:00:55.320742
Sep 28 09:00:55 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state file.managed for /etc/apt/preferences.d/mirantis_openstack
Sep 28 09:00:55 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/files/preferences_repo'
Sep 28 09:00:55 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/map.jinja'
Sep 28 09:00:55 ubuntu-1604 salt-minion[1851]: [INFO    ] File /etc/apt/preferences.d/mirantis_openstack is in the correct state
Sep 28 09:00:55 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [/etc/apt/preferences.d/mirantis_openstack] at time 09:00:55.399850 duration_in_ms=79.107
Sep 28 09:00:55 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [deb http://mirror.fuel-infra.org/mcp-repos/ocata/xenial ocata main] at time 09:00:55.401725
Sep 28 09:00:55 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state pkgrepo.managed for deb http://mirror.fuel-infra.org/mcp-repos/ocata/xenial ocata main
Sep 28 09:00:59 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928090059378106
Sep 28 09:00:59 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 5473
Sep 28 09:00:59 ubuntu-1604 salt-minion[1851]: [INFO    ] Returning information for job: 20170928090059378106
Sep 28 09:01:09 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928090109525887
Sep 28 09:01:09 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 5478
Sep 28 09:01:09 ubuntu-1604 salt-minion[1851]: [INFO    ] Returning information for job: 20170928090109525887
Sep 28 09:01:09 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x26493f27)
Sep 28 09:01:14 ubuntu-1604 dhclient[627]: message repeated 5 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x26493f27)]
Sep 28 09:01:15 ubuntu-1604 salt-minion[1851]: [ERROR   ] Failed to configure repo 'deb http://mirror.fuel-infra.org/mcp-repos/ocata/xenial ocata main': Error: HTTP 599: Timeout reading http://mirror.fuel-infra.org/mcp-repos/ocata/xenial/archive-mcpocata.key
Sep 28 09:01:15 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [deb http://mirror.fuel-infra.org/mcp-repos/ocata/xenial ocata main] at time 09:01:15.458500 duration_in_ms=20056.772
Sep 28 09:01:15 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [/etc/apt/apt.conf.d/99proxies-salt-mirantis_openstack_updates] at time 09:01:15.469765
Sep 28 09:01:15 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state file.absent for /etc/apt/apt.conf.d/99proxies-salt-mirantis_openstack_updates
Sep 28 09:01:15 ubuntu-1604 salt-minion[1851]: [INFO    ] File /etc/apt/apt.conf.d/99proxies-salt-mirantis_openstack_updates is not present
Sep 28 09:01:15 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [/etc/apt/apt.conf.d/99proxies-salt-mirantis_openstack_updates] at time 09:01:15.470611 duration_in_ms=0.847
Sep 28 09:01:15 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [/etc/apt/preferences.d/mirantis_openstack_updates] at time 09:01:15.470793
Sep 28 09:01:15 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state file.managed for /etc/apt/preferences.d/mirantis_openstack_updates
Sep 28 09:01:15 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/files/preferences_repo'
Sep 28 09:01:15 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/map.jinja'
Sep 28 09:01:15 ubuntu-1604 salt-minion[1851]: [INFO    ] File /etc/apt/preferences.d/mirantis_openstack_updates is in the correct state
Sep 28 09:01:15 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [/etc/apt/preferences.d/mirantis_openstack_updates] at time 09:01:15.543812 duration_in_ms=73.018
Sep 28 09:01:15 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [deb http://mirror.fuel-infra.org/mcp-repos/ocata/xenial ocata-updates main] at time 09:01:15.544643
Sep 28 09:01:15 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state pkgrepo.managed for deb http://mirror.fuel-infra.org/mcp-repos/ocata/xenial ocata-updates main
Sep 28 09:01:15 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x26493f27)
Sep 28 09:01:18 ubuntu-1604 dhclient[627]: message repeated 3 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x26493f27)]
Sep 28 09:01:19 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928090119545249
Sep 28 09:01:19 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 5485
Sep 28 09:01:19 ubuntu-1604 salt-minion[1851]: [INFO    ] Returning information for job: 20170928090119545249
Sep 28 09:01:19 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x26493f27)
Sep 28 09:01:20 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:01:20 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:01:29 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928090129588065
Sep 28 09:01:29 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 5495
Sep 28 09:01:29 ubuntu-1604 salt-minion[1851]: [INFO    ] Returning information for job: 20170928090129588065
Sep 28 09:01:31 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7785b35a)
Sep 28 09:01:35 ubuntu-1604 dhclient[627]: message repeated 4 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7785b35a)]
Sep 28 09:01:35 ubuntu-1604 salt-minion[1851]: [ERROR   ] Failed to configure repo 'deb http://mirror.fuel-infra.org/mcp-repos/ocata/xenial ocata-updates main': Error: HTTP 599: Timeout reading http://mirror.fuel-infra.org/mcp-repos/ocata/xenial/archive-mcpocata.key
Sep 28 09:01:35 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [deb http://mirror.fuel-infra.org/mcp-repos/ocata/xenial ocata-updates main] at time 09:01:35.666449 duration_in_ms=20121.806
Sep 28 09:01:35 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [/etc/apt/apt.conf.d/99proxies-salt-mirantis_openstack_security] at time 09:01:35.679016
Sep 28 09:01:35 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state file.absent for /etc/apt/apt.conf.d/99proxies-salt-mirantis_openstack_security
Sep 28 09:01:35 ubuntu-1604 salt-minion[1851]: [INFO    ] File /etc/apt/apt.conf.d/99proxies-salt-mirantis_openstack_security is not present
Sep 28 09:01:35 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [/etc/apt/apt.conf.d/99proxies-salt-mirantis_openstack_security] at time 09:01:35.679674 duration_in_ms=0.658
Sep 28 09:01:35 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [/etc/apt/preferences.d/mirantis_openstack_security] at time 09:01:35.679828
Sep 28 09:01:35 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state file.managed for /etc/apt/preferences.d/mirantis_openstack_security
Sep 28 09:01:35 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/files/preferences_repo'
Sep 28 09:01:35 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/map.jinja'
Sep 28 09:01:35 ubuntu-1604 salt-minion[1851]: [INFO    ] File /etc/apt/preferences.d/mirantis_openstack_security is in the correct state
Sep 28 09:01:35 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [/etc/apt/preferences.d/mirantis_openstack_security] at time 09:01:35.750580 duration_in_ms=70.751
Sep 28 09:01:35 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [deb http://mirror.fuel-infra.org/mcp-repos/ocata/xenial ocata-security main] at time 09:01:35.751361
Sep 28 09:01:35 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state pkgrepo.managed for deb http://mirror.fuel-infra.org/mcp-repos/ocata/xenial ocata-security main
Sep 28 09:01:35 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['apt-key', 'add', '/var/cache/salt/minion/extrn_files/base/mirror.fuel-infra.org/mcp-repos/ocata/xenial/archive-mcpocata.key'] in directory '/root'
Sep 28 09:01:35 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['apt-get', '-q', 'update'] in directory '/root'
Sep 28 09:01:36 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7785b35a)
Sep 28 09:01:38 ubuntu-1604 dhclient[627]: message repeated 2 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7785b35a)]
Sep 28 09:01:38 ubuntu-1604 salt-minion[1851]: [INFO    ] {'repo': 'deb http://mirror.fuel-infra.org/mcp-repos/ocata/xenial ocata-security main'}
Sep 28 09:01:38 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [deb http://mirror.fuel-infra.org/mcp-repos/ocata/xenial ocata-security main] at time 09:01:38.043417 duration_in_ms=2292.054
Sep 28 09:01:38 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [/etc/apt/apt.conf.d/99proxies-salt-mk_openstack] at time 09:01:38.043795
Sep 28 09:01:38 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state file.absent for /etc/apt/apt.conf.d/99proxies-salt-mk_openstack
Sep 28 09:01:38 ubuntu-1604 salt-minion[1851]: [INFO    ] File /etc/apt/apt.conf.d/99proxies-salt-mk_openstack is not present
Sep 28 09:01:38 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [/etc/apt/apt.conf.d/99proxies-salt-mk_openstack] at time 09:01:38.044953 duration_in_ms=1.158
Sep 28 09:01:38 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [/etc/apt/preferences.d/mk_openstack] at time 09:01:38.045264
Sep 28 09:01:38 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state file.managed for /etc/apt/preferences.d/mk_openstack
Sep 28 09:01:38 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/files/preferences_repo'
Sep 28 09:01:38 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/map.jinja'
Sep 28 09:01:38 ubuntu-1604 salt-minion[1851]: [INFO    ] File /etc/apt/preferences.d/mk_openstack is in the correct state
Sep 28 09:01:38 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [/etc/apt/preferences.d/mk_openstack] at time 09:01:38.145329 duration_in_ms=100.064
Sep 28 09:01:38 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [deb [arch=amd64] http://apt-mk.mirantis.com/xenial/ nightly ocata] at time 09:01:38.146205
Sep 28 09:01:38 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state pkgrepo.managed for deb [arch=amd64] http://apt-mk.mirantis.com/xenial/ nightly ocata
Sep 28 09:01:38 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['apt-key', 'add', '/var/cache/salt/minion/extrn_files/base/apt-mk.mirantis.com/public.gpg'] in directory '/root'
Sep 28 09:01:38 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['apt-get', '-q', 'update'] in directory '/root'
Sep 28 09:01:39 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7785b35a)
Sep 28 09:01:39 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928090139627619
Sep 28 09:01:39 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 6370
Sep 28 09:01:39 ubuntu-1604 salt-minion[1851]: [INFO    ] Returning information for job: 20170928090139627619
Sep 28 09:01:40 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7785b35a)
Sep 28 09:01:40 ubuntu-1604 salt-minion[1851]: [INFO    ] Configured package repo 'deb [arch=amd64] http://apt-mk.mirantis.com/xenial/ nightly ocata'
Sep 28 09:01:40 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [deb [arch=amd64] http://apt-mk.mirantis.com/xenial/ nightly ocata] at time 09:01:40.875391 duration_in_ms=2729.184
Sep 28 09:01:40 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [/etc/apt/apt.conf.d/99proxies-salt-mcp_extra] at time 09:01:40.875850
Sep 28 09:01:40 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state file.absent for /etc/apt/apt.conf.d/99proxies-salt-mcp_extra
Sep 28 09:01:40 ubuntu-1604 salt-minion[1851]: [INFO    ] File /etc/apt/apt.conf.d/99proxies-salt-mcp_extra is not present
Sep 28 09:01:40 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [/etc/apt/apt.conf.d/99proxies-salt-mcp_extra] at time 09:01:40.877063 duration_in_ms=1.213
Sep 28 09:01:40 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [/etc/apt/preferences.d/mcp_extra] at time 09:01:40.877427
Sep 28 09:01:40 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state file.managed for /etc/apt/preferences.d/mcp_extra
Sep 28 09:01:40 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/files/preferences_repo'
Sep 28 09:01:40 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/map.jinja'
Sep 28 09:01:40 ubuntu-1604 salt-minion[1851]: [INFO    ] File /etc/apt/preferences.d/mcp_extra is in the correct state
Sep 28 09:01:40 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [/etc/apt/preferences.d/mcp_extra] at time 09:01:40.948968 duration_in_ms=71.541
Sep 28 09:01:40 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [deb [arch=amd64] http://apt-mk.mirantis.com/xenial/ nightly extra] at time 09:01:40.949836
Sep 28 09:01:40 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state pkgrepo.managed for deb [arch=amd64] http://apt-mk.mirantis.com/xenial/ nightly extra
Sep 28 09:01:40 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['apt-key', 'add', '/var/cache/salt/minion/extrn_files/base/apt-mk.mirantis.com/public.gpg'] in directory '/root'
Sep 28 09:01:41 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7785b35a)
Sep 28 09:01:41 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['apt-get', '-q', 'update'] in directory '/root'
Sep 28 09:01:42 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:01:42 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:01:49 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928090149658880
Sep 28 09:01:49 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 6758
Sep 28 09:01:49 ubuntu-1604 salt-minion[1851]: [INFO    ] Returning information for job: 20170928090149658880
Sep 28 09:01:50 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa240b877)
Sep 28 09:01:59 ubuntu-1604 dhclient[627]: message repeated 9 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa240b877)]
Sep 28 09:01:59 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928090159700281
Sep 28 09:01:59 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 6763
Sep 28 09:01:59 ubuntu-1604 salt-minion[1851]: [INFO    ] Returning information for job: 20170928090159700281
Sep 28 09:02:00 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa240b877)
Sep 28 09:02:01 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:02:01 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:02:09 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928090209915104
Sep 28 09:02:09 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 6773
Sep 28 09:02:09 ubuntu-1604 salt-minion[1851]: [INFO    ] Returning information for job: 20170928090209915104
Sep 28 09:02:14 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2d78863d)
Sep 28 09:02:19 ubuntu-1604 dhclient[627]: message repeated 5 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2d78863d)]
Sep 28 09:02:19 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928090219950261
Sep 28 09:02:19 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 6778
Sep 28 09:02:19 ubuntu-1604 salt-minion[1851]: [INFO    ] Returning information for job: 20170928090219950261
Sep 28 09:02:20 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2d78863d)
Sep 28 09:02:24 ubuntu-1604 dhclient[627]: message repeated 4 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2d78863d)]
Sep 28 09:02:25 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:02:25 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:02:29 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928090229991846
Sep 28 09:02:30 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 6788
Sep 28 09:02:30 ubuntu-1604 salt-minion[1851]: [INFO    ] Returning information for job: 20170928090229991846
Sep 28 09:02:34 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x95d61c5a)
Sep 28 09:02:39 ubuntu-1604 dhclient[627]: message repeated 5 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x95d61c5a)]
Sep 28 09:02:40 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928090240013001
Sep 28 09:02:40 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 6793
Sep 28 09:02:40 ubuntu-1604 salt-minion[1851]: [INFO    ] Returning information for job: 20170928090240013001
Sep 28 09:02:40 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x95d61c5a)
Sep 28 09:02:44 ubuntu-1604 dhclient[627]: message repeated 4 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x95d61c5a)]
Sep 28 09:02:45 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:02:45 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:02:50 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928090250059308
Sep 28 09:02:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 6803
Sep 28 09:02:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Returning information for job: 20170928090250059308
Sep 28 09:02:55 ubuntu-1604 dhclient[600]: DHCPREQUEST of 192.168.11.25 on ens2 to 192.168.11.3 port 67 (xid=0x3415f07)
Sep 28 09:02:55 ubuntu-1604 dhclient[600]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 09:02:55 ubuntu-1604 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 09:02:55 ubuntu-1604 ntp[6861]:  * Stopping NTP server ntpd
Sep 28 09:02:55 ubuntu-1604 ntp[6861]:    ...done.
Sep 28 09:02:55 ubuntu-1604 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 09:02:55 ubuntu-1604 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 09:02:55 ubuntu-1604 ntp[6873]:  * Starting NTP server ntpd
Sep 28 09:02:55 ubuntu-1604 ntpd[6880]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 09:02:55 ubuntu-1604 ntpd[6880]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -c /var/lib/ntp/ntp.conf.dhcp -u 108:112
Sep 28 09:02:55 ubuntu-1604 ntp[6873]:    ...done.
Sep 28 09:02:55 ubuntu-1604 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 09:02:55 ubuntu-1604 ntpd[6883]: proto: precision = 0.044 usec (-24)
Sep 28 09:02:55 ubuntu-1604 ntpd[6883]: switching logging to file /var/log/ntp.log
Sep 28 09:02:55 ubuntu-1604 dhclient[600]: bound to 192.168.11.25 -- renewal in 297 seconds.
Sep 28 09:03:00 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928090300095703
Sep 28 09:03:00 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 6892
Sep 28 09:03:00 ubuntu-1604 salt-minion[1851]: [INFO    ] Returning information for job: 20170928090300095703
Sep 28 09:03:04 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9bd6ec23)
Sep 28 09:03:09 ubuntu-1604 dhclient[627]: message repeated 5 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9bd6ec23)]
Sep 28 09:03:10 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928090310137551
Sep 28 09:03:10 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 6897
Sep 28 09:03:10 ubuntu-1604 salt-minion[1851]: [INFO    ] Returning information for job: 20170928090310137551
Sep 28 09:03:10 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9bd6ec23)
Sep 28 09:03:14 ubuntu-1604 dhclient[627]: message repeated 4 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9bd6ec23)]
Sep 28 09:03:15 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:03:15 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:03:15 ubuntu-1604 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 09:03:15 ubuntu-1604 ntp[6946]:  * Stopping NTP server ntpd
Sep 28 09:03:15 ubuntu-1604 ntp[6946]:    ...done.
Sep 28 09:03:15 ubuntu-1604 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 09:03:15 ubuntu-1604 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 09:03:15 ubuntu-1604 ntp[6957]:  * Starting NTP server ntpd
Sep 28 09:03:15 ubuntu-1604 ntpd[6964]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 09:03:15 ubuntu-1604 ntpd[6964]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 09:03:15 ubuntu-1604 ntp[6957]:    ...done.
Sep 28 09:03:15 ubuntu-1604 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 09:03:15 ubuntu-1604 ntpd[6967]: proto: precision = 0.046 usec (-24)
Sep 28 09:03:15 ubuntu-1604 ntpd[6967]: switching logging to file /var/log/ntp.log
Sep 28 09:03:20 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928090320190286
Sep 28 09:03:20 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 6974
Sep 28 09:03:20 ubuntu-1604 salt-minion[1851]: [INFO    ] Returning information for job: 20170928090320190286
Sep 28 09:03:30 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928090330237234
Sep 28 09:03:30 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 6979
Sep 28 09:03:30 ubuntu-1604 salt-minion[1851]: [INFO    ] Returning information for job: 20170928090330237234
Sep 28 09:03:33 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc86d5174)
Sep 28 09:03:39 ubuntu-1604 dhclient[627]: message repeated 6 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc86d5174)]
Sep 28 09:03:40 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928090340281114
Sep 28 09:03:40 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 6984
Sep 28 09:03:40 ubuntu-1604 salt-minion[1851]: [INFO    ] Returning information for job: 20170928090340281114
Sep 28 09:03:40 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc86d5174)
Sep 28 09:03:41 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc86d5174)
Sep 28 09:03:42 ubuntu-1604 salt-minion[1851]: [INFO    ] Configured package repo 'deb [arch=amd64] http://apt-mk.mirantis.com/xenial/ nightly extra'
Sep 28 09:03:42 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [deb [arch=amd64] http://apt-mk.mirantis.com/xenial/ nightly extra] at time 09:03:42.500487 duration_in_ms=121550.648
Sep 28 09:03:42 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [/etc/apt/apt.conf.d/99proxies-salt-mirantis_openstack_holdback] at time 09:03:42.500842
Sep 28 09:03:42 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state file.absent for /etc/apt/apt.conf.d/99proxies-salt-mirantis_openstack_holdback
Sep 28 09:03:42 ubuntu-1604 salt-minion[1851]: [INFO    ] File /etc/apt/apt.conf.d/99proxies-salt-mirantis_openstack_holdback is not present
Sep 28 09:03:42 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [/etc/apt/apt.conf.d/99proxies-salt-mirantis_openstack_holdback] at time 09:03:42.501825 duration_in_ms=0.982
Sep 28 09:03:42 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [/etc/apt/preferences.d/mirantis_openstack_holdback] at time 09:03:42.502102
Sep 28 09:03:42 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state file.managed for /etc/apt/preferences.d/mirantis_openstack_holdback
Sep 28 09:03:42 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/files/preferences_repo'
Sep 28 09:03:42 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/map.jinja'
Sep 28 09:03:42 ubuntu-1604 salt-minion[1851]: [INFO    ] File /etc/apt/preferences.d/mirantis_openstack_holdback is in the correct state
Sep 28 09:03:42 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [/etc/apt/preferences.d/mirantis_openstack_holdback] at time 09:03:42.569156 duration_in_ms=67.053
Sep 28 09:03:42 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [deb http://mirror.fuel-infra.org/mcp-repos/ocata/xenial ocata-holdback main] at time 09:03:42.569927
Sep 28 09:03:42 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state pkgrepo.managed for deb http://mirror.fuel-infra.org/mcp-repos/ocata/xenial ocata-holdback main
Sep 28 09:03:42 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['apt-key', 'add', '/var/cache/salt/minion/extrn_files/base/mirror.fuel-infra.org/mcp-repos/ocata/xenial/archive-mcpocata.key'] in directory '/root'
Sep 28 09:03:42 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc86d5174)
Sep 28 09:03:42 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['apt-get', '-q', 'update'] in directory '/root'
Sep 28 09:03:43 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc86d5174)
Sep 28 09:03:44 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:03:44 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:03:44 ubuntu-1604 salt-minion[1851]: [INFO    ] {'repo': 'deb http://mirror.fuel-infra.org/mcp-repos/ocata/xenial ocata-holdback main'}
Sep 28 09:03:44 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [deb http://mirror.fuel-infra.org/mcp-repos/ocata/xenial ocata-holdback main] at time 09:03:44.810872 duration_in_ms=2240.944
Sep 28 09:03:44 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [/etc/apt/apt.conf.d/99proxies-salt-mirantis_openstack_hotfix] at time 09:03:44.811081
Sep 28 09:03:44 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state file.absent for /etc/apt/apt.conf.d/99proxies-salt-mirantis_openstack_hotfix
Sep 28 09:03:44 ubuntu-1604 salt-minion[1851]: [INFO    ] File /etc/apt/apt.conf.d/99proxies-salt-mirantis_openstack_hotfix is not present
Sep 28 09:03:44 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [/etc/apt/apt.conf.d/99proxies-salt-mirantis_openstack_hotfix] at time 09:03:44.811676 duration_in_ms=0.595
Sep 28 09:03:44 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [/etc/apt/preferences.d/mirantis_openstack_hotfix] at time 09:03:44.811814
Sep 28 09:03:44 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state file.managed for /etc/apt/preferences.d/mirantis_openstack_hotfix
Sep 28 09:03:44 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/files/preferences_repo'
Sep 28 09:03:44 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/map.jinja'
Sep 28 09:03:44 ubuntu-1604 salt-minion[1851]: [INFO    ] File /etc/apt/preferences.d/mirantis_openstack_hotfix is in the correct state
Sep 28 09:03:44 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [/etc/apt/preferences.d/mirantis_openstack_hotfix] at time 09:03:44.879379 duration_in_ms=67.563
Sep 28 09:03:44 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [deb http://mirror.fuel-infra.org/mcp-repos/ocata/xenial ocata-hotfix main] at time 09:03:44.880133
Sep 28 09:03:44 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state pkgrepo.managed for deb http://mirror.fuel-infra.org/mcp-repos/ocata/xenial ocata-hotfix main
Sep 28 09:03:44 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['apt-key', 'add', '/var/cache/salt/minion/extrn_files/base/mirror.fuel-infra.org/mcp-repos/ocata/xenial/archive-mcpocata.key'] in directory '/root'
Sep 28 09:03:45 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['apt-get', '-q', 'update'] in directory '/root'
Sep 28 09:03:47 ubuntu-1604 salt-minion[1851]: [INFO    ] {'repo': 'deb http://mirror.fuel-infra.org/mcp-repos/ocata/xenial ocata-hotfix main'}
Sep 28 09:03:47 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [deb http://mirror.fuel-infra.org/mcp-repos/ocata/xenial ocata-hotfix main] at time 09:03:47.373237 duration_in_ms=2493.103
Sep 28 09:03:47 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [/etc/apt/apt.conf.d/99proxies-salt-salt] at time 09:03:47.373432
Sep 28 09:03:47 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state file.absent for /etc/apt/apt.conf.d/99proxies-salt-salt
Sep 28 09:03:47 ubuntu-1604 salt-minion[1851]: [INFO    ] File /etc/apt/apt.conf.d/99proxies-salt-salt is not present
Sep 28 09:03:47 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [/etc/apt/apt.conf.d/99proxies-salt-salt] at time 09:03:47.373992 duration_in_ms=0.559
Sep 28 09:03:47 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [/etc/apt/preferences.d/salt] at time 09:03:47.374130
Sep 28 09:03:47 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state file.absent for /etc/apt/preferences.d/salt
Sep 28 09:03:47 ubuntu-1604 salt-minion[1851]: [INFO    ] File /etc/apt/preferences.d/salt is not present
Sep 28 09:03:47 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [/etc/apt/preferences.d/salt] at time 09:03:47.374538 duration_in_ms=0.408
Sep 28 09:03:47 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [deb http://repo.saltstack.com/apt/ubuntu/16.04/amd64/2016.3 xenial main] at time 09:03:47.375172
Sep 28 09:03:47 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state pkgrepo.managed for deb http://repo.saltstack.com/apt/ubuntu/16.04/amd64/2016.3 xenial main
Sep 28 09:03:47 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['apt-key', 'add', '/var/cache/salt/minion/extrn_files/base/repo.saltstack.com/apt/ubuntu/16.04/amd64/2016.3/SALTSTACK-GPG-KEY.pub'] in directory '/root'
Sep 28 09:03:47 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['apt-get', '-q', 'update'] in directory '/root'
Sep 28 09:03:50 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928090350324286
Sep 28 09:03:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 8387
Sep 28 09:03:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Returning information for job: 20170928090350324286
Sep 28 09:04:00 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928090400428707
Sep 28 09:04:00 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 8392
Sep 28 09:04:00 ubuntu-1604 salt-minion[1851]: [INFO    ] Returning information for job: 20170928090400428707
Sep 28 09:04:04 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4e63020)
Sep 28 09:04:10 ubuntu-1604 dhclient[627]: message repeated 6 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4e63020)]
Sep 28 09:04:10 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928090410493462
Sep 28 09:04:10 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 8397
Sep 28 09:04:10 ubuntu-1604 salt-minion[1851]: [INFO    ] Returning information for job: 20170928090410493462
Sep 28 09:04:11 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4e63020)
Sep 28 09:04:14 ubuntu-1604 dhclient[627]: message repeated 3 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4e63020)]
Sep 28 09:04:15 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:04:15 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:04:20 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928090420567470
Sep 28 09:04:20 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 8407
Sep 28 09:04:20 ubuntu-1604 salt-minion[1851]: [INFO    ] Returning information for job: 20170928090420567470
Sep 28 09:04:30 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928090430626901
Sep 28 09:04:30 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 8412
Sep 28 09:04:30 ubuntu-1604 salt-minion[1851]: [INFO    ] Returning information for job: 20170928090430626901
Sep 28 09:04:33 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd7d95b67)
Sep 28 09:04:40 ubuntu-1604 dhclient[627]: message repeated 7 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd7d95b67)]
Sep 28 09:04:40 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928090440713595
Sep 28 09:04:40 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 8417
Sep 28 09:04:40 ubuntu-1604 salt-minion[1851]: [INFO    ] Returning information for job: 20170928090440713595
Sep 28 09:04:41 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd7d95b67)
Sep 28 09:04:43 ubuntu-1604 dhclient[627]: message repeated 2 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd7d95b67)]
Sep 28 09:04:44 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:04:44 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:04:50 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928090450780015
Sep 28 09:04:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 8427
Sep 28 09:04:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Returning information for job: 20170928090450780015
Sep 28 09:05:00 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x923c67)
Sep 28 09:05:00 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928090500849361
Sep 28 09:05:00 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 8432
Sep 28 09:05:00 ubuntu-1604 salt-minion[1851]: [INFO    ] Returning information for job: 20170928090500849361
Sep 28 09:05:01 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x923c67)
Sep 28 09:05:10 ubuntu-1604 dhclient[627]: message repeated 9 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x923c67)]
Sep 28 09:05:10 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928090510931183
Sep 28 09:05:10 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 8437
Sep 28 09:05:10 ubuntu-1604 salt-minion[1851]: [INFO    ] Returning information for job: 20170928090510931183
Sep 28 09:05:11 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:05:11 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:05:21 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928090521019664
Sep 28 09:05:21 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 8447
Sep 28 09:05:21 ubuntu-1604 salt-minion[1851]: [INFO    ] Returning information for job: 20170928090521019664
Sep 28 09:05:22 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x85881c77)
Sep 28 09:05:30 ubuntu-1604 dhclient[627]: message repeated 8 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x85881c77)]
Sep 28 09:05:31 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928090531110502
Sep 28 09:05:31 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 8452
Sep 28 09:05:31 ubuntu-1604 salt-minion[1851]: [INFO    ] Returning information for job: 20170928090531110502
Sep 28 09:05:31 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x85881c77)
Sep 28 09:05:32 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x85881c77)
Sep 28 09:05:33 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:05:33 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:05:41 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928090541202079
Sep 28 09:05:41 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 8462
Sep 28 09:05:41 ubuntu-1604 salt-minion[1851]: [INFO    ] Returning information for job: 20170928090541202079
Sep 28 09:05:45 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x68e89063)
Sep 28 09:05:49 ubuntu-1604 dhclient[627]: message repeated 4 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x68e89063)]
Sep 28 09:05:49 ubuntu-1604 salt-minion[1851]: [INFO    ] Configured package repo 'deb http://repo.saltstack.com/apt/ubuntu/16.04/amd64/2016.3 xenial main'
Sep 28 09:05:49 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [deb http://repo.saltstack.com/apt/ubuntu/16.04/amd64/2016.3 xenial main] at time 09:05:49.267356 duration_in_ms=121892.184
Sep 28 09:05:49 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [linux_extra_packages_purged] at time 09:05:49.267688
Sep 28 09:05:49 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state pkg.purged for linux_extra_packages_purged
Sep 28 09:05:49 ubuntu-1604 salt-minion[1851]: [INFO    ] All specified packages are already absent
Sep 28 09:05:49 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [linux_extra_packages_purged] at time 09:05:49.273479 duration_in_ms=5.792
Sep 28 09:05:49 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [linux_extra_packages_latest] at time 09:05:49.273748
Sep 28 09:05:49 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state pkg.latest for linux_extra_packages_latest
Sep 28 09:05:49 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['apt-get', '-q', 'update'] in directory '/root'
Sep 28 09:05:50 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x68e89063)
Sep 28 09:05:51 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x68e89063)
Sep 28 09:05:51 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928090551302108
Sep 28 09:05:51 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 8996
Sep 28 09:05:51 ubuntu-1604 salt-minion[1851]: [INFO    ] Returning information for job: 20170928090551302108
Sep 28 09:05:51 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['apt-cache', '-q', 'policy', 'python-msgpack'] in directory '/root'
Sep 28 09:05:51 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['apt-cache', '-q', 'policy', 'python-pymysql'] in directory '/root'
Sep 28 09:05:51 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['apt-cache', '-q', 'policy', 'mcelog'] in directory '/root'
Sep 28 09:05:51 ubuntu-1604 salt-minion[1851]: [INFO    ] All packages are up-to-date (mcelog, python-msgpack, python-pymysql).
Sep 28 09:05:51 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [linux_extra_packages_latest] at time 09:05:51.899092 duration_in_ms=2625.342
Sep 28 09:05:51 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [UTC] at time 09:05:51.899762
Sep 28 09:05:51 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state timezone.system for UTC
Sep 28 09:05:51 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['timedatectl'] in directory '/root'
Sep 28 09:05:51 ubuntu-1604 dbus[737]: [system] Activating via systemd: service name='org.freedesktop.timedate1' unit='dbus-org.freedesktop.timedate1.service'
Sep 28 09:05:51 ubuntu-1604 systemd[1]: Starting Time & Date Service...
Sep 28 09:05:51 ubuntu-1604 dbus[737]: [system] Successfully activated service 'org.freedesktop.timedate1'
Sep 28 09:05:51 ubuntu-1604 systemd[1]: Started Time & Date Service.
Sep 28 09:05:51 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['timedatectl'] in directory '/root'
Sep 28 09:05:51 ubuntu-1604 salt-minion[1851]: [INFO    ] Timezone UTC already set, UTC already set to UTC
Sep 28 09:05:51 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [UTC] at time 09:05:51.952303 duration_in_ms=52.539
Sep 28 09:05:51 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [nf_conntrack] at time 09:05:51.952973
Sep 28 09:05:51 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state kmod.present for nf_conntrack
Sep 28 09:05:51 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command 'lsmod' in directory '/root'
Sep 28 09:05:51 ubuntu-1604 salt-minion[1851]: [INFO    ] Kernel module nf_conntrack is already present
Sep 28 09:05:51 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [nf_conntrack] at time 09:05:51.963371 duration_in_ms=10.397
Sep 28 09:05:51 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [kernel.panic] at time 09:05:51.963959
Sep 28 09:05:51 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state sysctl.present for kernel.panic
Sep 28 09:05:51 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command 'sysctl -a' in directory '/root'
Sep 28 09:05:51 ubuntu-1604 salt-minion[1851]: [INFO    ] Sysctl value kernel.panic = 60 is already set
Sep 28 09:05:51 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [kernel.panic] at time 09:05:51.989663 duration_in_ms=25.703
Sep 28 09:05:51 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [net.ipv4.tcp_keepalive_probes] at time 09:05:51.990003
Sep 28 09:05:51 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state sysctl.present for net.ipv4.tcp_keepalive_probes
Sep 28 09:05:51 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command 'sysctl -a' in directory '/root'
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Sysctl value net.ipv4.tcp_keepalive_probes = 8 is already set
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [net.ipv4.tcp_keepalive_probes] at time 09:05:52.006659 duration_in_ms=16.654
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [fs.file-max] at time 09:05:52.007001
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state sysctl.present for fs.file-max
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command 'sysctl -a' in directory '/root'
Sep 28 09:05:52 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x68e89063)
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Sysctl value fs.file-max = 124165 is already set
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [fs.file-max] at time 09:05:52.023733 duration_in_ms=16.731
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [net.core.somaxconn] at time 09:05:52.024076
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state sysctl.present for net.core.somaxconn
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command 'sysctl -a' in directory '/root'
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Sysctl value net.core.somaxconn = 4096 is already set
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [net.core.somaxconn] at time 09:05:52.040700 duration_in_ms=16.621
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [net.ipv4.tcp_max_syn_backlog] at time 09:05:52.041045
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state sysctl.present for net.ipv4.tcp_max_syn_backlog
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command 'sysctl -a' in directory '/root'
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Sysctl value net.ipv4.tcp_max_syn_backlog = 8192 is already set
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [net.ipv4.tcp_max_syn_backlog] at time 09:05:52.059276 duration_in_ms=18.228
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [net.ipv4.tcp_tw_reuse] at time 09:05:52.059658
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state sysctl.present for net.ipv4.tcp_tw_reuse
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command 'sysctl -a' in directory '/root'
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Sysctl value net.ipv4.tcp_tw_reuse = 1 is already set
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [net.ipv4.tcp_tw_reuse] at time 09:05:52.077869 duration_in_ms=18.21
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [net.ipv4.tcp_retries2] at time 09:05:52.078204
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state sysctl.present for net.ipv4.tcp_retries2
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command 'sysctl -a' in directory '/root'
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Sysctl value net.ipv4.tcp_retries2 = 5 is already set
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [net.ipv4.tcp_retries2] at time 09:05:52.094737 duration_in_ms=16.53
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [vm.swappiness] at time 09:05:52.095094
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state sysctl.present for vm.swappiness
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command 'sysctl -a' in directory '/root'
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Sysctl value vm.swappiness = 10 is already set
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [vm.swappiness] at time 09:05:52.112165 duration_in_ms=17.069
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [net.ipv4.tcp_keepalive_intvl] at time 09:05:52.112532
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state sysctl.present for net.ipv4.tcp_keepalive_intvl
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command 'sysctl -a' in directory '/root'
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Sysctl value net.ipv4.tcp_keepalive_intvl = 3 is already set
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [net.ipv4.tcp_keepalive_intvl] at time 09:05:52.129761 duration_in_ms=17.227
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [net.ipv4.neigh.default.gc_thresh1] at time 09:05:52.130100
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state sysctl.present for net.ipv4.neigh.default.gc_thresh1
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command 'sysctl -a' in directory '/root'
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Sysctl value net.ipv4.neigh.default.gc_thresh1 = 4096 is already set
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [net.ipv4.neigh.default.gc_thresh1] at time 09:05:52.147037 duration_in_ms=16.935
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [net.ipv4.neigh.default.gc_thresh2] at time 09:05:52.147385
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state sysctl.present for net.ipv4.neigh.default.gc_thresh2
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command 'sysctl -a' in directory '/root'
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Sysctl value net.ipv4.neigh.default.gc_thresh2 = 8192 is already set
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [net.ipv4.neigh.default.gc_thresh2] at time 09:05:52.164698 duration_in_ms=17.311
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [net.ipv4.neigh.default.gc_thresh3] at time 09:05:52.165027
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state sysctl.present for net.ipv4.neigh.default.gc_thresh3
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command 'sysctl -a' in directory '/root'
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Sysctl value net.ipv4.neigh.default.gc_thresh3 = 16384 is already set
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [net.ipv4.neigh.default.gc_thresh3] at time 09:05:52.182263 duration_in_ms=17.234
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [net.core.netdev_max_backlog] at time 09:05:52.182601
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state sysctl.present for net.core.netdev_max_backlog
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command 'sysctl -a' in directory '/root'
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Sysctl value net.core.netdev_max_backlog = 261144 is already set
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [net.core.netdev_max_backlog] at time 09:05:52.199838 duration_in_ms=17.235
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [net.ipv4.tcp_keepalive_time] at time 09:05:52.200177
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state sysctl.present for net.ipv4.tcp_keepalive_time
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command 'sysctl -a' in directory '/root'
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Sysctl value net.ipv4.tcp_keepalive_time = 30 is already set
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [net.ipv4.tcp_keepalive_time] at time 09:05:52.216826 duration_in_ms=16.646
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [net.nf_conntrack_max] at time 09:05:52.217160
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state sysctl.present for net.nf_conntrack_max
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command 'sysctl -a' in directory '/root'
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Sysctl value net.nf_conntrack_max = 1048576 is already set
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [net.nf_conntrack_max] at time 09:05:52.233725 duration_in_ms=16.564
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [linux_sysfs_package] at time 09:05:52.234067
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state pkg.installed for linux_sysfs_package
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] All specified packages are already installed
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [linux_sysfs_package] at time 09:05:52.237565 duration_in_ms=3.498
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [/etc/sysfs.d] at time 09:05:52.238527
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state file.directory for /etc/sysfs.d
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Directory /etc/sysfs.d is in the correct state
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [/etc/sysfs.d] at time 09:05:52.239575 duration_in_ms=1.048
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [ondemand] at time 09:05:52.240136
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state service.dead for ondemand
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['systemctl', 'status', 'ondemand.service', '-n', '0'] in directory '/root'
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['systemctl', 'is-active', 'ondemand.service'] in directory '/root'
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['systemctl', 'is-enabled', 'ondemand.service'] in directory '/root'
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command 'runlevel' in directory '/root'
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] The service ondemand is already dead
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [ondemand] at time 09:05:52.288995 duration_in_ms=48.857
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [cs_CZ.UTF-8] at time 09:05:52.289673
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state locale.present for cs_CZ.UTF-8
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command 'locale -a' in directory '/root'
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Locale cs_CZ.UTF-8 is already present
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [cs_CZ.UTF-8] at time 09:05:52.299964 duration_in_ms=10.288
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [en_US.UTF-8] at time 09:05:52.300308
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state locale.present for en_US.UTF-8
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command 'locale -a' in directory '/root'
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Locale en_US.UTF-8 is already present
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [en_US.UTF-8] at time 09:05:52.310918 duration_in_ms=10.608
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [en_US.UTF-8] at time 09:05:52.311970
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state locale.system for en_US.UTF-8
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command 'localectl' in directory '/root'
Sep 28 09:05:52 ubuntu-1604 dbus[737]: [system] Activating via systemd: service name='org.freedesktop.locale1' unit='dbus-org.freedesktop.locale1.service'
Sep 28 09:05:52 ubuntu-1604 systemd[1]: Starting Locale Service...
Sep 28 09:05:52 ubuntu-1604 dbus[737]: [system] Successfully activated service 'org.freedesktop.locale1'
Sep 28 09:05:52 ubuntu-1604 systemd[1]: Started Locale Service.
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] System locale en_US.UTF-8 already set
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [en_US.UTF-8] at time 09:05:52.354340 duration_in_ms=42.368
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [root] at time 09:05:52.355279
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state user.present for root
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] User root is present and up to date
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [root] at time 09:05:52.356442 duration_in_ms=1.162
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [/root] at time 09:05:52.357187
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state file.directory for /root
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Directory /root is in the correct state
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [/root] at time 09:05:52.357926 duration_in_ms=0.739
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [/etc/sudoers.d/90-salt-user-root] at time 09:05:52.358058
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state file.absent for /etc/sudoers.d/90-salt-user-root
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] File /etc/sudoers.d/90-salt-user-root is not present
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [/etc/sudoers.d/90-salt-user-root] at time 09:05:52.358499 duration_in_ms=0.441
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [ubuntu] at time 09:05:52.358640
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state user.present for ubuntu
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] User ubuntu is present and up to date
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [ubuntu] at time 09:05:52.359446 duration_in_ms=0.806
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [/home/ubuntu] at time 09:05:52.360054
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state file.directory for /home/ubuntu
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Directory /home/ubuntu is in the correct state
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [/home/ubuntu] at time 09:05:52.360718 duration_in_ms=0.664
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [/etc/sudoers.d/90-salt-user-ubuntu] at time 09:05:52.361233
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state file.managed for /etc/sudoers.d/90-salt-user-ubuntu
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/files/sudoer'
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] File /etc/sudoers.d/90-salt-user-ubuntu is in the correct state
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [/etc/sudoers.d/90-salt-user-ubuntu] at time 09:05:52.404495 duration_in_ms=43.262
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [/etc/security/limits.d/90-salt-default.conf] at time 09:05:52.404641
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state file.managed for /etc/security/limits.d/90-salt-default.conf
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/files/limits.conf'
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/map.jinja'
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] File /etc/security/limits.d/90-salt-default.conf is in the correct state
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [/etc/security/limits.d/90-salt-default.conf] at time 09:05:52.477155 duration_in_ms=72.514
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [/etc/systemd/system.conf.d/90-salt.conf] at time 09:05:52.477318
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state file.managed for /etc/systemd/system.conf.d/90-salt.conf
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/files/systemd.conf'
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/map.jinja'
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] File /etc/systemd/system.conf.d/90-salt.conf is in the correct state
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [/etc/systemd/system.conf.d/90-salt.conf] at time 09:05:52.540061 duration_in_ms=62.742
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [service.systemctl_reload] at time 09:05:52.540951
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state module.wait for service.systemctl_reload
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] No changes made for service.systemctl_reload
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [service.systemctl_reload] at time 09:05:52.541383 duration_in_ms=0.432
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [/etc/hostname] at time 09:05:52.541508
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state file.managed for /etc/hostname
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'linux/files/hostname'
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] File /etc/hostname is in the correct state
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [/etc/hostname] at time 09:05:52.558149 duration_in_ms=16.64
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [hostname ctl02] at time 09:05:52.559027
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state cmd.wait for hostname ctl02
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] No changes made for hostname ctl02
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [hostname ctl02] at time 09:05:52.559460 duration_in_ms=0.434
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [mdb02.baremetal-mcp-ocata-ovs-ha.local] at time 09:05:52.559785
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for mdb02.baremetal-mcp-ocata-ovs-ha.local
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Host mdb02.baremetal-mcp-ocata-ovs-ha.local (10.167.4.77) already present
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [mdb02.baremetal-mcp-ocata-ovs-ha.local] at time 09:05:52.560367 duration_in_ms=0.582
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [mdb02] at time 09:05:52.560512
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for mdb02
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Host mdb02 (10.167.4.77) already present
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [mdb02] at time 09:05:52.561059 duration_in_ms=0.547
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [mdb03] at time 09:05:52.561204
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for mdb03
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Host mdb03 (10.167.4.78) already present
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [mdb03] at time 09:05:52.561790 duration_in_ms=0.587
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [mdb03.baremetal-mcp-ocata-ovs-ha.local] at time 09:05:52.561929
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for mdb03.baremetal-mcp-ocata-ovs-ha.local
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Host mdb03.baremetal-mcp-ocata-ovs-ha.local (10.167.4.78) already present
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [mdb03.baremetal-mcp-ocata-ovs-ha.local] at time 09:05:52.562445 duration_in_ms=0.517
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [mdb01.baremetal-mcp-ocata-ovs-ha.local] at time 09:05:52.562584
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for mdb01.baremetal-mcp-ocata-ovs-ha.local
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Host mdb01.baremetal-mcp-ocata-ovs-ha.local (10.167.4.76) already present
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [mdb01.baremetal-mcp-ocata-ovs-ha.local] at time 09:05:52.563099 duration_in_ms=0.516
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [mdb01] at time 09:05:52.563239
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for mdb01
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Host mdb01 (10.167.4.76) already present
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [mdb01] at time 09:05:52.563753 duration_in_ms=0.514
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [mdb] at time 09:05:52.563890
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for mdb
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Host mdb (10.167.4.75) already present
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [mdb] at time 09:05:52.564417 duration_in_ms=0.527
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [mdb.baremetal-mcp-ocata-ovs-ha.local] at time 09:05:52.564552
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for mdb.baremetal-mcp-ocata-ovs-ha.local
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Host mdb.baremetal-mcp-ocata-ovs-ha.local (10.167.4.75) already present
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [mdb.baremetal-mcp-ocata-ovs-ha.local] at time 09:05:52.565070 duration_in_ms=0.518
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [prx02] at time 09:05:52.565210
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for prx02
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Host prx02 (10.167.4.82) already present
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [prx02] at time 09:05:52.565765 duration_in_ms=0.555
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [prx02.baremetal-mcp-ocata-ovs-ha.local] at time 09:05:52.565900
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for prx02.baremetal-mcp-ocata-ovs-ha.local
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Host prx02.baremetal-mcp-ocata-ovs-ha.local (10.167.4.82) already present
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [prx02.baremetal-mcp-ocata-ovs-ha.local] at time 09:05:52.566415 duration_in_ms=0.515
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [prx01.baremetal-mcp-ocata-ovs-ha.local] at time 09:05:52.566552
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for prx01.baremetal-mcp-ocata-ovs-ha.local
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Host prx01.baremetal-mcp-ocata-ovs-ha.local (10.167.4.81) already present
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [prx01.baremetal-mcp-ocata-ovs-ha.local] at time 09:05:52.567073 duration_in_ms=0.52
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [prx01] at time 09:05:52.567211
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for prx01
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Host prx01 (10.167.4.81) already present
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [prx01] at time 09:05:52.567735 duration_in_ms=0.523
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [kvm01.baremetal-mcp-ocata-ovs-ha.local] at time 09:05:52.567872
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for kvm01.baremetal-mcp-ocata-ovs-ha.local
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Host kvm01.baremetal-mcp-ocata-ovs-ha.local (10.167.4.141) already present
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [kvm01.baremetal-mcp-ocata-ovs-ha.local] at time 09:05:52.568427 duration_in_ms=0.554
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [kvm01] at time 09:05:52.568568
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for kvm01
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Host kvm01 (10.167.4.141) already present
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [kvm01] at time 09:05:52.569104 duration_in_ms=0.535
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [kvm03.baremetal-mcp-ocata-ovs-ha.local] at time 09:05:52.569239
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for kvm03.baremetal-mcp-ocata-ovs-ha.local
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Host kvm03.baremetal-mcp-ocata-ovs-ha.local (10.167.4.143) already present
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [kvm03.baremetal-mcp-ocata-ovs-ha.local] at time 09:05:52.569795 duration_in_ms=0.556
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [kvm03] at time 09:05:52.569933
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for kvm03
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Host kvm03 (10.167.4.143) already present
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [kvm03] at time 09:05:52.570587 duration_in_ms=0.654
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [kvm02.baremetal-mcp-ocata-ovs-ha.local] at time 09:05:52.570727
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for kvm02.baremetal-mcp-ocata-ovs-ha.local
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Host kvm02.baremetal-mcp-ocata-ovs-ha.local (10.167.4.142) already present
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [kvm02.baremetal-mcp-ocata-ovs-ha.local] at time 09:05:52.571242 duration_in_ms=0.515
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [kvm02] at time 09:05:52.571379
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for kvm02
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Host kvm02 (10.167.4.142) already present
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [kvm02] at time 09:05:52.571906 duration_in_ms=0.527
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [dbs.baremetal-mcp-ocata-ovs-ha.local] at time 09:05:52.572053
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for dbs.baremetal-mcp-ocata-ovs-ha.local
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Host dbs.baremetal-mcp-ocata-ovs-ha.local (10.167.4.50) already present
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [dbs.baremetal-mcp-ocata-ovs-ha.local] at time 09:05:52.572578 duration_in_ms=0.524
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [dbs] at time 09:05:52.572721
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for dbs
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Host dbs (10.167.4.50) already present
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [dbs] at time 09:05:52.573229 duration_in_ms=0.508
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [prx.baremetal-mcp-ocata-ovs-ha.local] at time 09:05:52.573386
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for prx.baremetal-mcp-ocata-ovs-ha.local
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Host prx.baremetal-mcp-ocata-ovs-ha.local (10.167.4.80) already present
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [prx.baremetal-mcp-ocata-ovs-ha.local] at time 09:05:52.573914 duration_in_ms=0.528
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [prx] at time 09:05:52.574049
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for prx
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Host prx (10.167.4.80) already present
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [prx] at time 09:05:52.574559 duration_in_ms=0.509
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [gtw01] at time 09:05:52.574692
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for gtw01
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Host gtw01 (10.167.4.124) already present
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [gtw01] at time 09:05:52.575199 duration_in_ms=0.506
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [gtw01.baremetal-mcp-ocata-ovs-ha.local] at time 09:05:52.575337
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for gtw01.baremetal-mcp-ocata-ovs-ha.local
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Host gtw01.baremetal-mcp-ocata-ovs-ha.local (10.167.4.124) already present
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [gtw01.baremetal-mcp-ocata-ovs-ha.local] at time 09:05:52.575850 duration_in_ms=0.513
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [gtw02] at time 09:05:52.575984
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for gtw02
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Host gtw02 (10.167.4.125) already present
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [gtw02] at time 09:05:52.576504 duration_in_ms=0.519
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [gtw02.baremetal-mcp-ocata-ovs-ha.local] at time 09:05:52.576640
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for gtw02.baremetal-mcp-ocata-ovs-ha.local
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Host gtw02.baremetal-mcp-ocata-ovs-ha.local (10.167.4.125) already present
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [gtw02.baremetal-mcp-ocata-ovs-ha.local] at time 09:05:52.577151 duration_in_ms=0.511
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [msg02.baremetal-mcp-ocata-ovs-ha.local] at time 09:05:52.577307
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for msg02.baremetal-mcp-ocata-ovs-ha.local
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Host msg02.baremetal-mcp-ocata-ovs-ha.local (10.167.4.42) already present
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [msg02.baremetal-mcp-ocata-ovs-ha.local] at time 09:05:52.577838 duration_in_ms=0.531
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [msg02] at time 09:05:52.577975
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for msg02
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Host msg02 (10.167.4.42) already present
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [msg02] at time 09:05:52.578486 duration_in_ms=0.511
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [msg03] at time 09:05:52.578620
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for msg03
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Host msg03 (10.167.4.43) already present
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [msg03] at time 09:05:52.579126 duration_in_ms=0.506
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [msg03.baremetal-mcp-ocata-ovs-ha.local] at time 09:05:52.579262
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for msg03.baremetal-mcp-ocata-ovs-ha.local
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Host msg03.baremetal-mcp-ocata-ovs-ha.local (10.167.4.43) already present
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [msg03.baremetal-mcp-ocata-ovs-ha.local] at time 09:05:52.579772 duration_in_ms=0.511
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [msg01.baremetal-mcp-ocata-ovs-ha.local] at time 09:05:52.579909
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for msg01.baremetal-mcp-ocata-ovs-ha.local
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Host msg01.baremetal-mcp-ocata-ovs-ha.local (10.167.4.41) already present
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [msg01.baremetal-mcp-ocata-ovs-ha.local] at time 09:05:52.580433 duration_in_ms=0.524
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [msg01] at time 09:05:52.580567
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for msg01
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Host msg01 (10.167.4.41) already present
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [msg01] at time 09:05:52.581077 duration_in_ms=0.51
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [msg] at time 09:05:52.581214
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for msg
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Host msg (10.167.4.40) already present
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [msg] at time 09:05:52.581764 duration_in_ms=0.55
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [msg.baremetal-mcp-ocata-ovs-ha.local] at time 09:05:52.581900
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for msg.baremetal-mcp-ocata-ovs-ha.local
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Host msg.baremetal-mcp-ocata-ovs-ha.local (10.167.4.40) already present
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [msg.baremetal-mcp-ocata-ovs-ha.local] at time 09:05:52.582428 duration_in_ms=0.527
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [cfg01.baremetal-mcp-ocata-ovs-ha.local] at time 09:05:52.582577
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for cfg01.baremetal-mcp-ocata-ovs-ha.local
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Host cfg01.baremetal-mcp-ocata-ovs-ha.local (10.167.4.100) already present
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [cfg01.baremetal-mcp-ocata-ovs-ha.local] at time 09:05:52.583091 duration_in_ms=0.513
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [cfg01] at time 09:05:52.583227
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for cfg01
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Host cfg01 (10.167.4.100) already present
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [cfg01] at time 09:05:52.583741 duration_in_ms=0.515
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [cmp002] at time 09:05:52.583875
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for cmp002
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Host cmp002 (10.167.4.102) already present
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [cmp002] at time 09:05:52.584495 duration_in_ms=0.62
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [cmp002.baremetal-mcp-ocata-ovs-ha.local] at time 09:05:52.584633
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for cmp002.baremetal-mcp-ocata-ovs-ha.local
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Host cmp002.baremetal-mcp-ocata-ovs-ha.local (10.167.4.102) already present
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [cmp002.baremetal-mcp-ocata-ovs-ha.local] at time 09:05:52.585147 duration_in_ms=0.515
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [cmp001] at time 09:05:52.585304
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for cmp001
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Host cmp001 (10.167.4.101) already present
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [cmp001] at time 09:05:52.585835 duration_in_ms=0.531
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [cmp001.baremetal-mcp-ocata-ovs-ha.local] at time 09:05:52.585972
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for cmp001.baremetal-mcp-ocata-ovs-ha.local
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Host cmp001.baremetal-mcp-ocata-ovs-ha.local (10.167.4.101) already present
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [cmp001.baremetal-mcp-ocata-ovs-ha.local] at time 09:05:52.586481 duration_in_ms=0.509
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [dbs01] at time 09:05:52.586616
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for dbs01
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Host dbs01 (10.167.4.51) already present
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [dbs01] at time 09:05:52.587126 duration_in_ms=0.509
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [dbs01.baremetal-mcp-ocata-ovs-ha.local] at time 09:05:52.587259
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for dbs01.baremetal-mcp-ocata-ovs-ha.local
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Host dbs01.baremetal-mcp-ocata-ovs-ha.local (10.167.4.51) already present
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [dbs01.baremetal-mcp-ocata-ovs-ha.local] at time 09:05:52.587771 duration_in_ms=0.511
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [dbs02.baremetal-mcp-ocata-ovs-ha.local] at time 09:05:52.587907
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for dbs02.baremetal-mcp-ocata-ovs-ha.local
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Host dbs02.baremetal-mcp-ocata-ovs-ha.local (10.167.4.52) already present
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [dbs02.baremetal-mcp-ocata-ovs-ha.local] at time 09:05:52.588446 duration_in_ms=0.54
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [dbs02] at time 09:05:52.588582
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for dbs02
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Host dbs02 (10.167.4.52) already present
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [dbs02] at time 09:05:52.589098 duration_in_ms=0.515
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [dbs03.baremetal-mcp-ocata-ovs-ha.local] at time 09:05:52.589235
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for dbs03.baremetal-mcp-ocata-ovs-ha.local
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Host dbs03.baremetal-mcp-ocata-ovs-ha.local (10.167.4.53) already present
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [dbs03.baremetal-mcp-ocata-ovs-ha.local] at time 09:05:52.589787 duration_in_ms=0.552
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [dbs03] at time 09:05:52.589923
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for dbs03
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Host dbs03 (10.167.4.53) already present
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [dbs03] at time 09:05:52.590436 duration_in_ms=0.512
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [cfg01.baremetal-mcp-ocata-ovs-ha.local] at time 09:05:52.590569
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for cfg01.baremetal-mcp-ocata-ovs-ha.local
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Host cfg01.baremetal-mcp-ocata-ovs-ha.local (10.167.4.100) already present
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [cfg01.baremetal-mcp-ocata-ovs-ha.local] at time 09:05:52.591085 duration_in_ms=0.515
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [cfg01] at time 09:05:52.591220
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for cfg01
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Host cfg01 (10.167.4.100) already present
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [cfg01] at time 09:05:52.591732 duration_in_ms=0.511
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [mas01] at time 09:05:52.591866
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for mas01
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Host mas01 (10.167.4.3) already present
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [mas01] at time 09:05:52.592395 duration_in_ms=0.528
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [mas01.baremetal-mcp-ocata-ovs-ha.local] at time 09:05:52.592532
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for mas01.baremetal-mcp-ocata-ovs-ha.local
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Host mas01.baremetal-mcp-ocata-ovs-ha.local (10.167.4.3) already present
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [mas01.baremetal-mcp-ocata-ovs-ha.local] at time 09:05:52.593050 duration_in_ms=0.518
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [ctl02.baremetal-mcp-ocata-ovs-ha.local] at time 09:05:52.593188
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for ctl02.baremetal-mcp-ocata-ovs-ha.local
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Host ctl02.baremetal-mcp-ocata-ovs-ha.local (10.167.4.12) already present
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [ctl02.baremetal-mcp-ocata-ovs-ha.local] at time 09:05:52.593750 duration_in_ms=0.562
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [ctl02] at time 09:05:52.593887
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for ctl02
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Host ctl02 (10.167.4.12) already present
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [ctl02] at time 09:05:52.594428 duration_in_ms=0.541
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [file.replace] at time 09:05:52.595053
Sep 28 09:05:52 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state module.run for file.replace
Sep 28 09:05:53 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x68e89063)
Sep 28 09:05:53 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command 'grep -q "ctl02 ctl02.baremetal-mcp-ocata-ovs-ha.local" /etc/hosts' in directory '/root'
Sep 28 09:05:53 ubuntu-1604 salt-minion[1851]: [INFO    ] onlyif execution failed
Sep 28 09:05:53 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [file.replace] at time 09:05:53.109413 duration_in_ms=514.359
Sep 28 09:05:53 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [ctl03] at time 09:05:53.109672
Sep 28 09:05:53 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for ctl03
Sep 28 09:05:53 ubuntu-1604 salt-minion[1851]: [INFO    ] Host ctl03 (10.167.4.13) already present
Sep 28 09:05:53 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [ctl03] at time 09:05:53.110549 duration_in_ms=0.876
Sep 28 09:05:53 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [ctl03.baremetal-mcp-ocata-ovs-ha.local] at time 09:05:53.110718
Sep 28 09:05:53 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for ctl03.baremetal-mcp-ocata-ovs-ha.local
Sep 28 09:05:53 ubuntu-1604 salt-minion[1851]: [INFO    ] Host ctl03.baremetal-mcp-ocata-ovs-ha.local (10.167.4.13) already present
Sep 28 09:05:53 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [ctl03.baremetal-mcp-ocata-ovs-ha.local] at time 09:05:53.111328 duration_in_ms=0.609
Sep 28 09:05:53 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [ctl01.baremetal-mcp-ocata-ovs-ha.local] at time 09:05:53.111496
Sep 28 09:05:53 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for ctl01.baremetal-mcp-ocata-ovs-ha.local
Sep 28 09:05:53 ubuntu-1604 salt-minion[1851]: [INFO    ] Host ctl01.baremetal-mcp-ocata-ovs-ha.local (10.167.4.11) already present
Sep 28 09:05:53 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [ctl01.baremetal-mcp-ocata-ovs-ha.local] at time 09:05:53.112108 duration_in_ms=0.612
Sep 28 09:05:53 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [ctl01] at time 09:05:53.112301
Sep 28 09:05:53 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for ctl01
Sep 28 09:05:53 ubuntu-1604 salt-minion[1851]: [INFO    ] Host ctl01 (10.167.4.11) already present
Sep 28 09:05:53 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [ctl01] at time 09:05:53.112911 duration_in_ms=0.61
Sep 28 09:05:53 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [ctl] at time 09:05:53.113075
Sep 28 09:05:53 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for ctl
Sep 28 09:05:53 ubuntu-1604 salt-minion[1851]: [INFO    ] Host ctl (10.167.4.10) already present
Sep 28 09:05:53 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [ctl] at time 09:05:53.113671 duration_in_ms=0.596
Sep 28 09:05:53 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [ctl.baremetal-mcp-ocata-ovs-ha.local] at time 09:05:53.113826
Sep 28 09:05:53 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state host.present for ctl.baremetal-mcp-ocata-ovs-ha.local
Sep 28 09:05:53 ubuntu-1604 salt-minion[1851]: [INFO    ] Host ctl.baremetal-mcp-ocata-ovs-ha.local (10.167.4.10) already present
Sep 28 09:05:53 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [ctl.baremetal-mcp-ocata-ovs-ha.local] at time 09:05:53.114415 duration_in_ms=0.589
Sep 28 09:05:53 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [ens2] at time 09:05:53.114569
Sep 28 09:05:53 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state network.managed for ens2
Sep 28 09:05:53 ubuntu-1604 salt-minion[1851]: [INFO    ] Interface ens2 is up to date.
Sep 28 09:05:53 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [ens2] at time 09:05:53.578467 duration_in_ms=463.898
Sep 28 09:05:53 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [ens3] at time 09:05:53.578845
Sep 28 09:05:53 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state network.managed for ens3
Sep 28 09:05:54 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x68e89063)
Sep 28 09:05:54 ubuntu-1604 salt-minion[1851]: [INFO    ] Interface ens3 is up to date.
Sep 28 09:05:54 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [ens3] at time 09:05:54.034536 duration_in_ms=455.692
Sep 28 09:05:54 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [/etc/profile.d/proxy.sh] at time 09:05:54.034718
Sep 28 09:05:54 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state file.absent for /etc/profile.d/proxy.sh
Sep 28 09:05:54 ubuntu-1604 salt-minion[1851]: [INFO    ] File /etc/profile.d/proxy.sh is not present
Sep 28 09:05:54 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [/etc/profile.d/proxy.sh] at time 09:05:54.035295 duration_in_ms=0.576
Sep 28 09:05:54 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [/etc/apt/apt.conf.d/95proxies] at time 09:05:54.035434
Sep 28 09:05:54 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state file.absent for /etc/apt/apt.conf.d/95proxies
Sep 28 09:05:54 ubuntu-1604 salt-minion[1851]: [INFO    ] File /etc/apt/apt.conf.d/95proxies is not present
Sep 28 09:05:54 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [/etc/apt/apt.conf.d/95proxies] at time 09:05:54.035857 duration_in_ms=0.424
Sep 28 09:05:54 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [ntp] at time 09:05:54.035992
Sep 28 09:05:54 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state pkg.installed for ntp
Sep 28 09:05:54 ubuntu-1604 salt-minion[1851]: [INFO    ] Package ntp is already installed
Sep 28 09:05:54 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [ntp] at time 09:05:54.039199 duration_in_ms=3.206
Sep 28 09:05:54 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [/etc/ntp.conf] at time 09:05:54.039990
Sep 28 09:05:54 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state file.managed for /etc/ntp.conf
Sep 28 09:05:54 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'ntp/files/ntp.conf'
Sep 28 09:05:54 ubuntu-1604 salt-minion[1851]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'ntp/map.jinja'
Sep 28 09:05:54 ubuntu-1604 salt-minion[1851]: [INFO    ] File /etc/ntp.conf is in the correct state
Sep 28 09:05:54 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [/etc/ntp.conf] at time 09:05:54.093581 duration_in_ms=53.591
Sep 28 09:05:54 ubuntu-1604 salt-minion[1851]: [INFO    ] Running state [ntp] at time 09:05:54.094503
Sep 28 09:05:54 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing state service.running for ntp
Sep 28 09:05:54 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['systemctl', 'status', 'ntp.service', '-n', '0'] in directory '/root'
Sep 28 09:05:54 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['systemctl', 'is-active', 'ntp.service'] in directory '/root'
Sep 28 09:05:54 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['systemctl', 'is-enabled', 'ntp.service'] in directory '/root'
Sep 28 09:05:54 ubuntu-1604 salt-minion[1851]: [INFO    ] The service ntp is already running
Sep 28 09:05:54 ubuntu-1604 salt-minion[1851]: [INFO    ] Completed state [ntp] at time 09:05:54.136164 duration_in_ms=41.66
Sep 28 09:05:54 ubuntu-1604 salt-minion[1851]: [INFO    ] Returning information for job: 20170928090049285450
Sep 28 09:05:55 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x68e89063)
Sep 28 09:05:56 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:05:56 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:06:15 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x56c68175)
Sep 28 09:06:25 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x56c68175)]
Sep 28 09:06:26 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:06:26 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:06:44 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x79e3ed57)
Sep 28 09:06:54 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x79e3ed57)]
Sep 28 09:06:55 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:06:55 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:07:03 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9a81d73e)
Sep 28 09:07:13 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9a81d73e)]
Sep 28 09:07:14 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:07:14 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:07:29 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4a507945)
Sep 28 09:07:39 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4a507945)]
Sep 28 09:07:40 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:07:40 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:07:52 ubuntu-1604 dhclient[600]: DHCPREQUEST of 192.168.11.25 on ens2 to 192.168.11.3 port 67 (xid=0x3415f07)
Sep 28 09:07:52 ubuntu-1604 dhclient[600]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 09:07:52 ubuntu-1604 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 09:07:52 ubuntu-1604 ntp[9274]:  * Stopping NTP server ntpd
Sep 28 09:07:52 ubuntu-1604 ntp[9274]:    ...done.
Sep 28 09:07:52 ubuntu-1604 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 09:07:52 ubuntu-1604 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 09:07:52 ubuntu-1604 ntp[9285]:  * Starting NTP server ntpd
Sep 28 09:07:52 ubuntu-1604 ntpd[9292]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 09:07:52 ubuntu-1604 ntpd[9292]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -c /var/lib/ntp/ntp.conf.dhcp -u 108:112
Sep 28 09:07:52 ubuntu-1604 ntp[9285]:    ...done.
Sep 28 09:07:52 ubuntu-1604 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 09:07:52 ubuntu-1604 ntpd[9295]: proto: precision = 0.043 usec (-24)
Sep 28 09:07:52 ubuntu-1604 ntpd[9295]: switching logging to file /var/log/ntp.log
Sep 28 09:07:52 ubuntu-1604 dhclient[600]: bound to 192.168.11.25 -- renewal in 273 seconds.
Sep 28 09:07:56 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x11221d7c)
Sep 28 09:08:06 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x11221d7c)]
Sep 28 09:08:07 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:08:07 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:08:07 ubuntu-1604 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 09:08:07 ubuntu-1604 ntp[9348]:  * Stopping NTP server ntpd
Sep 28 09:08:07 ubuntu-1604 ntp[9348]:    ...done.
Sep 28 09:08:07 ubuntu-1604 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 09:08:07 ubuntu-1604 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 09:08:07 ubuntu-1604 ntp[9359]:  * Starting NTP server ntpd
Sep 28 09:08:07 ubuntu-1604 ntpd[9366]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 09:08:07 ubuntu-1604 ntpd[9366]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 09:08:07 ubuntu-1604 ntp[9359]:    ...done.
Sep 28 09:08:07 ubuntu-1604 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 09:08:07 ubuntu-1604 ntpd[9369]: proto: precision = 0.042 usec (-24)
Sep 28 09:08:07 ubuntu-1604 ntpd[9369]: switching logging to file /var/log/ntp.log
Sep 28 09:08:15 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc3c0b445)
Sep 28 09:08:25 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc3c0b445)]
Sep 28 09:08:26 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:08:26 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:08:35 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb57b0932)
Sep 28 09:08:45 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb57b0932)]
Sep 28 09:08:46 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:08:46 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:08:57 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x69262b49)
Sep 28 09:09:07 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x69262b49)]
Sep 28 09:09:08 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:09:08 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:09:21 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x698c7164)
Sep 28 09:09:31 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x698c7164)]
Sep 28 09:09:32 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:09:32 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:09:40 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xeafbd341)
Sep 28 09:09:50 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xeafbd341)]
Sep 28 09:09:51 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:09:51 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:10:01 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6ebf9310)
Sep 28 09:10:11 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6ebf9310)]
Sep 28 09:10:12 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:10:12 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:10:24 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd4d1611)
Sep 28 09:10:34 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd4d1611)]
Sep 28 09:10:35 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:10:35 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:10:57 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xba206a1f)
Sep 28 09:11:07 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xba206a1f)]
Sep 28 09:11:08 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:11:08 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:11:19 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb472374a)
Sep 28 09:11:29 ubuntu-1604 dhclient[627]: message repeated 9 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb472374a)]
Sep 28 09:11:30 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:11:30 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:11:49 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf5d73a20)
Sep 28 09:11:59 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf5d73a20)]
Sep 28 09:12:00 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:12:00 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:12:22 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4c5b3c5a)
Sep 28 09:12:25 ubuntu-1604 dhclient[627]: message repeated 3 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4c5b3c5a)]
Sep 28 09:12:25 ubuntu-1604 dhclient[600]: DHCPREQUEST of 192.168.11.25 on ens2 to 192.168.11.3 port 67 (xid=0x3415f07)
Sep 28 09:12:26 ubuntu-1604 dhclient[600]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 09:12:26 ubuntu-1604 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 09:12:26 ubuntu-1604 ntp[9479]:  * Stopping NTP server ntpd
Sep 28 09:12:26 ubuntu-1604 ntp[9479]:    ...done.
Sep 28 09:12:26 ubuntu-1604 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 09:12:26 ubuntu-1604 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 09:12:26 ubuntu-1604 ntp[9490]:  * Starting NTP server ntpd
Sep 28 09:12:26 ubuntu-1604 ntpd[9497]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 09:12:26 ubuntu-1604 ntpd[9497]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -c /var/lib/ntp/ntp.conf.dhcp -u 108:112
Sep 28 09:12:26 ubuntu-1604 ntp[9490]:    ...done.
Sep 28 09:12:26 ubuntu-1604 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 09:12:26 ubuntu-1604 ntpd[9500]: proto: precision = 0.043 usec (-24)
Sep 28 09:12:26 ubuntu-1604 ntpd[9500]: switching logging to file /var/log/ntp.log
Sep 28 09:12:26 ubuntu-1604 dhclient[600]: bound to 192.168.11.25 -- renewal in 290 seconds.
Sep 28 09:12:26 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4c5b3c5a)
Sep 28 09:12:32 ubuntu-1604 dhclient[627]: message repeated 6 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4c5b3c5a)]
Sep 28 09:12:33 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:12:33 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:12:33 ubuntu-1604 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 09:12:33 ubuntu-1604 ntp[9553]:  * Stopping NTP server ntpd
Sep 28 09:12:33 ubuntu-1604 ntp[9553]:    ...done.
Sep 28 09:12:33 ubuntu-1604 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 09:12:33 ubuntu-1604 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 09:12:33 ubuntu-1604 ntp[9564]:  * Starting NTP server ntpd
Sep 28 09:12:33 ubuntu-1604 ntpd[9571]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 09:12:33 ubuntu-1604 ntpd[9571]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 09:12:33 ubuntu-1604 ntp[9564]:    ...done.
Sep 28 09:12:33 ubuntu-1604 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 09:12:33 ubuntu-1604 ntpd[9574]: proto: precision = 0.042 usec (-24)
Sep 28 09:12:33 ubuntu-1604 ntpd[9574]: switching logging to file /var/log/ntp.log
Sep 28 09:12:50 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4fed4741)
Sep 28 09:13:00 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4fed4741)]
Sep 28 09:13:01 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:13:01 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:13:23 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x17f62b76)
Sep 28 09:13:33 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x17f62b76)]
Sep 28 09:13:34 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:13:34 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:13:48 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7d3a641b)
Sep 28 09:13:58 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7d3a641b)]
Sep 28 09:13:59 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:13:59 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:14:12 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb9d49517)
Sep 28 09:14:22 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb9d49517)]
Sep 28 09:14:23 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:14:23 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:14:44 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc7e6ab51)
Sep 28 09:14:54 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc7e6ab51)]
Sep 28 09:14:55 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:14:55 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:15:14 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x29d45751)
Sep 28 09:15:24 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x29d45751)]
Sep 28 09:15:25 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:15:25 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:15:42 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa7594030)
Sep 28 09:15:52 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa7594030)]
Sep 28 09:15:53 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:15:53 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:16:09 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x31992102)
Sep 28 09:16:19 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x31992102)]
Sep 28 09:16:20 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:16:20 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:16:29 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command ssh.set_auth_key with jid 20170928091629433194
Sep 28 09:16:29 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 9620
Sep 28 09:16:29 ubuntu-1604 salt-minion[1851]: [INFO    ] Returning information for job: 20170928091629433194
Sep 28 09:16:30 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command pkg.upgrade with jid 20170928091630471822
Sep 28 09:16:30 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 9625
Sep 28 09:16:30 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 09:16:30 ubuntu-1604 salt-minion[1851]: [INFO    ] Executing command ['systemd-run', '--scope', 'apt-get', '-q', '-y', '-o', 'DPkg::Options::=--force-confold', '-o', 'DPkg::Options::=--force-confdef', 'upgrade'] in directory '/root'
Sep 28 09:16:30 ubuntu-1604 systemd[1]: Started /usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold -o DPkg::Options::=--force-confdef upgrade.
Sep 28 09:16:32 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6460af0a)
Sep 28 09:16:39 ubuntu-1604 dhclient[627]: message repeated 7 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6460af0a)]
Sep 28 09:16:40 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928091640510027
Sep 28 09:16:40 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 9638
Sep 28 09:16:40 ubuntu-1604 salt-minion[1851]: [INFO    ] Returning information for job: 20170928091640510027
Sep 28 09:16:40 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6460af0a)
Sep 28 09:16:42 ubuntu-1604 dhclient[627]: message repeated 2 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6460af0a)]
Sep 28 09:16:43 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:16:43 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:16:50 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928091650543734
Sep 28 09:16:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 9672
Sep 28 09:16:50 ubuntu-1604 salt-minion[1851]: [INFO    ] Returning information for job: 20170928091650543734
Sep 28 09:16:52 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa7d41979)
Sep 28 09:17:00 ubuntu-1604 dhclient[627]: message repeated 8 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa7d41979)]
Sep 28 09:17:00 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928091700751835
Sep 28 09:17:00 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 9776
Sep 28 09:17:00 ubuntu-1604 salt-minion[1851]: [INFO    ] Returning information for job: 20170928091700751835
Sep 28 09:17:01 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa7d41979)
Sep 28 09:17:02 ubuntu-1604 CRON[9787]: (root) CMD (   cd / && run-parts --report /etc/cron.hourly)
Sep 28 09:17:02 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa7d41979)
Sep 28 09:17:03 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:17:03 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:17:10 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928091710770286
Sep 28 09:17:10 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 9835
Sep 28 09:17:10 ubuntu-1604 salt-minion[1851]: [INFO    ] Returning information for job: 20170928091710770286
Sep 28 09:17:16 ubuntu-1604 dhclient[600]: DHCPREQUEST of 192.168.11.25 on ens2 to 192.168.11.3 port 67 (xid=0x3415f07)
Sep 28 09:17:16 ubuntu-1604 dhclient[600]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 09:17:16 ubuntu-1604 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 09:17:16 ubuntu-1604 ntp[9893]:  * Stopping NTP server ntpd
Sep 28 09:17:16 ubuntu-1604 ntp[9893]:    ...done.
Sep 28 09:17:16 ubuntu-1604 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 09:17:16 ubuntu-1604 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 09:17:16 ubuntu-1604 ntp[9903]:  * Starting NTP server ntpd
Sep 28 09:17:17 ubuntu-1604 ntpd[9911]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 09:17:17 ubuntu-1604 ntpd[9911]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -c /var/lib/ntp/ntp.conf.dhcp -u 108:112
Sep 28 09:17:17 ubuntu-1604 ntp[9903]:    ...done.
Sep 28 09:17:17 ubuntu-1604 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 09:17:17 ubuntu-1604 ntpd[9914]: proto: precision = 0.042 usec (-24)
Sep 28 09:17:17 ubuntu-1604 ntpd[9914]: switching logging to file /var/log/ntp.log
Sep 28 09:17:18 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe0e49b0b)
Sep 28 09:17:19 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe0e49b0b)
Sep 28 09:17:19 ubuntu-1604 dhclient[600]: bound to 192.168.11.25 -- renewal in 277 seconds.
Sep 28 09:17:20 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe0e49b0b)
Sep 28 09:17:20 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928091720808243
Sep 28 09:17:20 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 9923
Sep 28 09:17:20 ubuntu-1604 salt-minion[1851]: [INFO    ] Returning information for job: 20170928091720808243
Sep 28 09:17:21 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe0e49b0b)
Sep 28 09:17:28 ubuntu-1604 dhclient[627]: message repeated 7 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe0e49b0b)]
Sep 28 09:17:29 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:17:29 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:17:29 ubuntu-1604 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 09:17:29 ubuntu-1604 ntp[9973]:  * Stopping NTP server ntpd
Sep 28 09:17:29 ubuntu-1604 ntp[9973]:    ...done.
Sep 28 09:17:29 ubuntu-1604 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 09:17:29 ubuntu-1604 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 09:17:29 ubuntu-1604 ntp[9984]:  * Starting NTP server ntpd
Sep 28 09:17:29 ubuntu-1604 ntpd[9991]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 09:17:29 ubuntu-1604 ntpd[9991]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 09:17:29 ubuntu-1604 ntp[9984]:    ...done.
Sep 28 09:17:29 ubuntu-1604 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 09:17:29 ubuntu-1604 ntpd[9994]: proto: precision = 0.043 usec (-24)
Sep 28 09:17:29 ubuntu-1604 ntpd[9994]: switching logging to file /var/log/ntp.log
Sep 28 09:17:31 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928091731035773
Sep 28 09:17:31 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 10001
Sep 28 09:17:31 ubuntu-1604 salt-minion[1851]: [INFO    ] Returning information for job: 20170928091731035773
Sep 28 09:17:41 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928091741252046
Sep 28 09:17:41 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 10006
Sep 28 09:17:41 ubuntu-1604 salt-minion[1851]: [INFO    ] Returning information for job: 20170928091741252046
Sep 28 09:17:47 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x73e6034e)
Sep 28 09:17:50 ubuntu-1604 dhclient[627]: message repeated 3 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x73e6034e)]
Sep 28 09:17:51 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928091751345548
Sep 28 09:17:51 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 10011
Sep 28 09:17:51 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x73e6034e)
Sep 28 09:17:51 ubuntu-1604 salt-minion[1851]: [INFO    ] Returning information for job: 20170928091751345548
Sep 28 09:17:52 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x73e6034e)
Sep 28 09:17:57 ubuntu-1604 dhclient[627]: message repeated 5 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x73e6034e)]
Sep 28 09:17:58 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:17:58 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:18:01 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928091801527285
Sep 28 09:18:01 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 10021
Sep 28 09:18:01 ubuntu-1604 salt-minion[1851]: [INFO    ] Returning information for job: 20170928091801527285
Sep 28 09:18:11 ubuntu-1604 salt-minion[1851]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928091811700581
Sep 28 09:18:11 ubuntu-1604 salt-minion[1851]: [INFO    ] Starting a new job with PID 10026
Sep 28 09:18:11 ubuntu-1604 salt-minion[1851]: [INFO    ] Returning information for job: 20170928091811700581
Sep 28 09:18:13 ubuntu-1604 systemd[1]: Reloading.
Sep 28 09:18:13 ubuntu-1604 systemd[1]: Stopping The Salt Minion...
Sep 28 09:18:13 ubuntu-1604 salt-minion[1851]: [WARNING ] Minion received a SIGTERM. Exiting.
Sep 28 09:18:13 ubuntu-1604 salt-minion[1851]: [INFO    ] The salt minion is shutting down..
Sep 28 09:18:13 ubuntu-1604 salt-minion[1851]: [INFO    ] The Salt Minion is shut down
Sep 28 09:18:13 ubuntu-1604 salt-minion[1851]: The salt minion is shutdown. Minion received a SIGTERM. Exited.
Sep 28 09:18:13 ubuntu-1604 systemd[1]: Stopped The Salt Minion.
Sep 28 09:18:15 ubuntu-1604 systemd[1]: Reloading.
Sep 28 09:18:15 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x82c3b66e)
Sep 28 09:18:25 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x82c3b66e)]
Sep 28 09:18:26 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:18:26 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:18:41 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd912c959)
Sep 28 09:18:51 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd912c959)]
Sep 28 09:18:52 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:18:52 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:19:06 ubuntu-1604 systemd[1]: Reloading.
Sep 28 09:19:06 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd31cdb5a)
Sep 28 09:19:16 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd31cdb5a)]
Sep 28 09:19:17 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:19:17 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:19:25 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd8e2a72d)
Sep 28 09:19:35 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd8e2a72d)]
Sep 28 09:19:36 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:19:36 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:19:40 ubuntu-1604 systemd[1]: Reloading.
Sep 28 09:19:40 ubuntu-1604 systemd[1]: Reloading.
Sep 28 09:19:40 ubuntu-1604 systemd[1]: Starting The Salt Minion...
Sep 28 09:19:40 ubuntu-1604 systemd[1]: Started The Salt Minion.
Sep 28 09:19:40 ubuntu-1604 salt-minion[14967]: [INFO    ] Setting up the Salt Minion "ctl02.baremetal-mcp-ocata-ovs-ha.local"
Sep 28 09:19:40 ubuntu-1604 salt-minion[14967]: [INFO    ] Creating minion process manager
Sep 28 09:19:40 ubuntu-1604 salt-minion[14967]: [WARNING ] IMPORTANT: Do not use md5 hashing algorithm! Please set "hash_type" to sha256 in Salt Minion config!
Sep 28 09:19:40 ubuntu-1604 salt-minion[14967]: [INFO    ] The Salt Minion is starting up
Sep 28 09:19:40 ubuntu-1604 salt-minion[14967]: [INFO    ] Minion is starting as user 'root'
Sep 28 09:19:40 ubuntu-1604 salt-minion[14967]: [INFO    ] Starting pull socket on /var/run/salt/minion/minion_event_37cabfca03_pull.ipc
Sep 28 09:19:41 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing command ['date', '+%z'] in directory '/root'
Sep 28 09:19:41 ubuntu-1604 salt-minion[14967]: [INFO    ] Updating job settings for scheduled job: __mine_interval
Sep 28 09:19:41 ubuntu-1604 salt-minion[14967]: [INFO    ] Added mine.update to scheduler
Sep 28 09:19:42 ubuntu-1604 salt-minion[14967]: [INFO    ] Minion is ready to receive requests!
Sep 28 09:19:42 ubuntu-1604 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928091942636520
Sep 28 09:19:42 ubuntu-1604 salt-minion[14967]: [INFO    ] Starting a new job with PID 15062
Sep 28 09:19:42 ubuntu-1604 salt-minion[14967]: [INFO    ] Returning information for job: 20170928091942636520
Sep 28 09:19:43 ubuntu-1604 salt-minion[14967]: [INFO    ] Running scheduled job: __mine_interval
Sep 28 09:19:52 ubuntu-1604 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928091952779360
Sep 28 09:19:52 ubuntu-1604 salt-minion[14967]: [INFO    ] Starting a new job with PID 15076
Sep 28 09:19:52 ubuntu-1604 salt-minion[14967]: [INFO    ] Returning information for job: 20170928091952779360
Sep 28 09:19:55 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2ba069)
Sep 28 09:20:02 ubuntu-1604 dhclient[627]: message repeated 7 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2ba069)]
Sep 28 09:20:02 ubuntu-1604 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928092002913321
Sep 28 09:20:02 ubuntu-1604 salt-minion[14967]: [INFO    ] Starting a new job with PID 15081
Sep 28 09:20:02 ubuntu-1604 salt-minion[14967]: [INFO    ] Returning information for job: 20170928092002913321
Sep 28 09:20:03 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2ba069)
Sep 28 09:20:05 ubuntu-1604 dhclient[627]: message repeated 2 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2ba069)]
Sep 28 09:20:06 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:20:06 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:20:13 ubuntu-1604 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928092013115458
Sep 28 09:20:13 ubuntu-1604 salt-minion[14967]: [INFO    ] Starting a new job with PID 15091
Sep 28 09:20:13 ubuntu-1604 salt-minion[14967]: [INFO    ] Returning information for job: 20170928092013115458
Sep 28 09:20:23 ubuntu-1604 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928092023274763
Sep 28 09:20:23 ubuntu-1604 salt-minion[14967]: [INFO    ] Starting a new job with PID 15096
Sep 28 09:20:23 ubuntu-1604 salt-minion[14967]: [INFO    ] Returning information for job: 20170928092023274763
Sep 28 09:20:24 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7a60de3d)
Sep 28 09:20:32 ubuntu-1604 dhclient[627]: message repeated 8 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7a60de3d)]
Sep 28 09:20:33 ubuntu-1604 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928092033338884
Sep 28 09:20:33 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7a60de3d)
Sep 28 09:20:33 ubuntu-1604 salt-minion[14967]: [INFO    ] Starting a new job with PID 15101
Sep 28 09:20:33 ubuntu-1604 salt-minion[14967]: [INFO    ] Returning information for job: 20170928092033338884
Sep 28 09:20:34 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7a60de3d)
Sep 28 09:20:35 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:20:35 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:20:43 ubuntu-1604 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928092043392247
Sep 28 09:20:43 ubuntu-1604 salt-minion[14967]: [INFO    ] Starting a new job with PID 15111
Sep 28 09:20:43 ubuntu-1604 salt-minion[14967]: [INFO    ] Returning information for job: 20170928092043392247
Sep 28 09:20:44 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa656e679)
Sep 28 09:20:53 ubuntu-1604 dhclient[627]: message repeated 9 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa656e679)]
Sep 28 09:20:53 ubuntu-1604 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928092053478106
Sep 28 09:20:53 ubuntu-1604 salt-minion[14967]: [INFO    ] Starting a new job with PID 15116
Sep 28 09:20:53 ubuntu-1604 salt-minion[14967]: [INFO    ] Returning information for job: 20170928092053478106
Sep 28 09:20:54 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa656e679)
Sep 28 09:20:55 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:20:55 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:21:03 ubuntu-1604 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928092103523156
Sep 28 09:21:03 ubuntu-1604 salt-minion[14967]: [INFO    ] Starting a new job with PID 15126
Sep 28 09:21:03 ubuntu-1604 salt-minion[14967]: [INFO    ] Returning information for job: 20170928092103523156
Sep 28 09:21:13 ubuntu-1604 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928092113693698
Sep 28 09:21:13 ubuntu-1604 salt-minion[14967]: [INFO    ] Starting a new job with PID 15131
Sep 28 09:21:13 ubuntu-1604 salt-minion[14967]: [INFO    ] Returning information for job: 20170928092113693698
Sep 28 09:21:14 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x281f8270)
Sep 28 09:21:22 ubuntu-1604 dhclient[627]: message repeated 8 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x281f8270)]
Sep 28 09:21:23 ubuntu-1604 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928092123920774
Sep 28 09:21:23 ubuntu-1604 salt-minion[14967]: [INFO    ] Starting a new job with PID 15136
Sep 28 09:21:23 ubuntu-1604 salt-minion[14967]: [INFO    ] Returning information for job: 20170928092123920774
Sep 28 09:21:23 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x281f8270)
Sep 28 09:21:24 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x281f8270)
Sep 28 09:21:25 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:21:25 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:21:34 ubuntu-1604 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928092133999687
Sep 28 09:21:34 ubuntu-1604 salt-minion[14967]: [INFO    ] Starting a new job with PID 15146
Sep 28 09:21:34 ubuntu-1604 salt-minion[14967]: [INFO    ] Returning information for job: 20170928092133999687
Sep 28 09:21:44 ubuntu-1604 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928092144108307
Sep 28 09:21:44 ubuntu-1604 salt-minion[14967]: [INFO    ] Starting a new job with PID 15151
Sep 28 09:21:44 ubuntu-1604 salt-minion[14967]: [INFO    ] Returning information for job: 20170928092144108307
Sep 28 09:21:45 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x525d1405)
Sep 28 09:21:53 ubuntu-1604 dhclient[627]: message repeated 8 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x525d1405)]
Sep 28 09:21:54 ubuntu-1604 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928092154317991
Sep 28 09:21:54 ubuntu-1604 salt-minion[14967]: [INFO    ] Starting a new job with PID 15156
Sep 28 09:21:54 ubuntu-1604 salt-minion[14967]: [INFO    ] Returning information for job: 20170928092154317991
Sep 28 09:21:54 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x525d1405)
Sep 28 09:21:55 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x525d1405)
Sep 28 09:21:56 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:21:56 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:21:57 ubuntu-1604 dhclient[600]: DHCPREQUEST of 192.168.11.25 on ens2 to 192.168.11.3 port 67 (xid=0x3415f07)
Sep 28 09:21:57 ubuntu-1604 dhclient[600]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 09:21:57 ubuntu-1604 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 09:21:57 ubuntu-1604 ntp[15219]:  * Stopping NTP server ntpd
Sep 28 09:21:57 ubuntu-1604 ntp[15219]:    ...done.
Sep 28 09:21:57 ubuntu-1604 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 09:21:57 ubuntu-1604 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 09:21:57 ubuntu-1604 ntp[15230]:  * Starting NTP server ntpd
Sep 28 09:21:57 ubuntu-1604 ntpd[15237]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 09:21:57 ubuntu-1604 ntpd[15237]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -c /var/lib/ntp/ntp.conf.dhcp -u 108:112
Sep 28 09:21:57 ubuntu-1604 ntp[15230]:    ...done.
Sep 28 09:21:57 ubuntu-1604 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 09:21:57 ubuntu-1604 ntpd[15240]: proto: precision = 0.042 usec (-24)
Sep 28 09:21:57 ubuntu-1604 ntpd[15240]: switching logging to file /var/log/ntp.log
Sep 28 09:21:58 ubuntu-1604 dhclient[600]: bound to 192.168.11.25 -- renewal in 246 seconds.
Sep 28 09:22:07 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5ddda014)
Sep 28 09:22:15 ubuntu-1604 dhclient[627]: message repeated 8 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5ddda014)]
Sep 28 09:22:15 ubuntu-1604 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command pkg.upgrade with jid 20170928092215210705
Sep 28 09:22:15 ubuntu-1604 salt-minion[14967]: [INFO    ] Starting a new job with PID 15248
Sep 28 09:22:15 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 09:22:15 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing command ['systemd-run', '--scope', 'apt-get', '-q', '-y', '-o', 'DPkg::Options::=--force-confold', '-o', 'DPkg::Options::=--force-confdef', 'upgrade'] in directory '/root'
Sep 28 09:22:15 ubuntu-1604 systemd[1]: Started /usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold -o DPkg::Options::=--force-confdef upgrade.
Sep 28 09:22:16 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5ddda014)
Sep 28 09:22:16 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 09:22:16 ubuntu-1604 salt-minion[14967]: [INFO    ] Returning information for job: 20170928092215210705
Sep 28 09:22:17 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5ddda014)
Sep 28 09:22:18 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:22:18 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:22:18 ubuntu-1604 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 09:22:18 ubuntu-1604 ntp[15306]:  * Stopping NTP server ntpd
Sep 28 09:22:18 ubuntu-1604 ntp[15306]:    ...done.
Sep 28 09:22:18 ubuntu-1604 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 09:22:18 ubuntu-1604 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 09:22:18 ubuntu-1604 ntp[15317]:  * Starting NTP server ntpd
Sep 28 09:22:18 ubuntu-1604 ntpd[15324]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 09:22:18 ubuntu-1604 ntpd[15324]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 09:22:18 ubuntu-1604 ntp[15317]:    ...done.
Sep 28 09:22:18 ubuntu-1604 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 09:22:18 ubuntu-1604 ntpd[15327]: proto: precision = 0.043 usec (-24)
Sep 28 09:22:18 ubuntu-1604 ntpd[15327]: switching logging to file /var/log/ntp.log
Sep 28 09:22:27 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf5d5ae23)
Sep 28 09:22:37 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf5d5ae23)]
Sep 28 09:22:38 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:22:38 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:22:46 ubuntu-1604 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command pkg.upgrade with jid 20170928092246198969
Sep 28 09:22:46 ubuntu-1604 salt-minion[14967]: [INFO    ] Starting a new job with PID 15338
Sep 28 09:22:46 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 09:22:46 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9c63ac1e)
Sep 28 09:22:46 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing command ['systemd-run', '--scope', 'apt-get', '-q', '-y', '-o', 'DPkg::Options::=--force-confold', '-o', 'DPkg::Options::=--force-confdef', 'upgrade'] in directory '/root'
Sep 28 09:22:46 ubuntu-1604 systemd[1]: Started /usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold -o DPkg::Options::=--force-confdef upgrade.
Sep 28 09:22:47 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 09:22:47 ubuntu-1604 salt-minion[14967]: [INFO    ] Returning information for job: 20170928092246198969
Sep 28 09:22:47 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9c63ac1e)
Sep 28 09:22:48 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9c63ac1e)
Sep 28 09:22:48 ubuntu-1604 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command test.ping with jid 20170928092248909918
Sep 28 09:22:48 ubuntu-1604 salt-minion[14967]: [INFO    ] Starting a new job with PID 15352
Sep 28 09:22:48 ubuntu-1604 salt-minion[14967]: [INFO    ] Returning information for job: 20170928092248909918
Sep 28 09:22:49 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9c63ac1e)
Sep 28 09:22:56 ubuntu-1604 dhclient[627]: message repeated 7 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9c63ac1e)]
Sep 28 09:22:57 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:22:57 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:23:17 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc3d49936)
Sep 28 09:23:27 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc3d49936)]
Sep 28 09:23:28 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:23:28 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:23:36 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5a4ac21f)
Sep 28 09:23:46 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5a4ac21f)]
Sep 28 09:23:47 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:23:47 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:23:59 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc7dc7600)
Sep 28 09:24:09 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc7dc7600)]
Sep 28 09:24:10 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:24:10 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:24:22 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd2471f28)
Sep 28 09:24:32 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd2471f28)]
Sep 28 09:24:33 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:24:33 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:24:49 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x472ef61e)
Sep 28 09:24:59 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x472ef61e)]
Sep 28 09:25:00 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:25:00 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:25:08 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x82f45418)
Sep 28 09:25:18 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x82f45418)]
Sep 28 09:25:19 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:25:19 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:25:39 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x21202c36)
Sep 28 09:25:49 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x21202c36)]
Sep 28 09:25:50 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:25:50 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:26:03 ubuntu-1604 dhclient[600]: DHCPREQUEST of 192.168.11.25 on ens2 to 192.168.11.3 port 67 (xid=0x3415f07)
Sep 28 09:26:03 ubuntu-1604 dhclient[600]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 09:26:03 ubuntu-1604 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 09:26:03 ubuntu-1604 ntp[15450]:  * Stopping NTP server ntpd
Sep 28 09:26:03 ubuntu-1604 ntp[15450]:    ...done.
Sep 28 09:26:03 ubuntu-1604 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 09:26:03 ubuntu-1604 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 09:26:03 ubuntu-1604 ntp[15461]:  * Starting NTP server ntpd
Sep 28 09:26:03 ubuntu-1604 ntpd[15468]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 09:26:03 ubuntu-1604 ntpd[15468]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -c /var/lib/ntp/ntp.conf.dhcp -u 108:112
Sep 28 09:26:03 ubuntu-1604 ntp[15461]:    ...done.
Sep 28 09:26:03 ubuntu-1604 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 09:26:03 ubuntu-1604 ntpd[15471]: proto: precision = 0.044 usec (-24)
Sep 28 09:26:03 ubuntu-1604 ntpd[15471]: switching logging to file /var/log/ntp.log
Sep 28 09:26:03 ubuntu-1604 dhclient[600]: bound to 192.168.11.25 -- renewal in 255 seconds.
Sep 28 09:26:10 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa3f26a3a)
Sep 28 09:26:20 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa3f26a3a)]
Sep 28 09:26:21 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:26:21 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:26:21 ubuntu-1604 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 09:26:21 ubuntu-1604 ntp[15524]:  * Stopping NTP server ntpd
Sep 28 09:26:21 ubuntu-1604 ntp[15524]:    ...done.
Sep 28 09:26:21 ubuntu-1604 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 09:26:21 ubuntu-1604 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 09:26:21 ubuntu-1604 ntp[15535]:  * Starting NTP server ntpd
Sep 28 09:26:21 ubuntu-1604 ntpd[15542]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 09:26:21 ubuntu-1604 ntpd[15542]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 09:26:21 ubuntu-1604 ntp[15535]:    ...done.
Sep 28 09:26:21 ubuntu-1604 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 09:26:22 ubuntu-1604 ntpd[15545]: proto: precision = 0.043 usec (-24)
Sep 28 09:26:22 ubuntu-1604 ntpd[15545]: switching logging to file /var/log/ntp.log
Sep 28 09:26:30 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6523c51e)
Sep 28 09:26:40 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6523c51e)]
Sep 28 09:26:41 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:26:41 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:26:55 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x338a4255)
Sep 28 09:27:05 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x338a4255)]
Sep 28 09:27:06 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:27:06 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:27:26 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xaa9bf464)
Sep 28 09:27:36 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xaa9bf464)]
Sep 28 09:27:37 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:27:37 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:27:50 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe27c5d39)
Sep 28 09:28:00 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe27c5d39)]
Sep 28 09:28:01 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:28:01 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:28:14 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x63f5c908)
Sep 28 09:28:24 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x63f5c908)]
Sep 28 09:28:25 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:28:25 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:28:45 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xad4f5863)
Sep 28 09:28:55 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xad4f5863)]
Sep 28 09:28:56 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:28:56 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:29:10 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2155fe77)
Sep 28 09:29:20 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2155fe77)]
Sep 28 09:29:21 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:29:21 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:29:30 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x509e5153)
Sep 28 09:29:40 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x509e5153)]
Sep 28 09:29:41 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:29:41 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:29:51 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8d33a574)
Sep 28 09:30:01 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8d33a574)]
Sep 28 09:30:02 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:30:02 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:30:16 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd9dba655)
Sep 28 09:30:18 ubuntu-1604 dhclient[627]: message repeated 2 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd9dba655)]
Sep 28 09:30:18 ubuntu-1604 dhclient[600]: DHCPREQUEST of 192.168.11.25 on ens2 to 192.168.11.3 port 67 (xid=0x3415f07)
Sep 28 09:30:18 ubuntu-1604 dhclient[600]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 09:30:18 ubuntu-1604 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 09:30:18 ubuntu-1604 ntp[15649]:  * Stopping NTP server ntpd
Sep 28 09:30:18 ubuntu-1604 ntp[15649]:    ...done.
Sep 28 09:30:18 ubuntu-1604 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 09:30:18 ubuntu-1604 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 09:30:18 ubuntu-1604 ntp[15660]:  * Starting NTP server ntpd
Sep 28 09:30:18 ubuntu-1604 ntpd[15667]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 09:30:18 ubuntu-1604 ntpd[15667]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -c /var/lib/ntp/ntp.conf.dhcp -u 108:112
Sep 28 09:30:18 ubuntu-1604 ntp[15660]:    ...done.
Sep 28 09:30:18 ubuntu-1604 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 09:30:18 ubuntu-1604 ntpd[15670]: proto: precision = 0.041 usec (-24)
Sep 28 09:30:18 ubuntu-1604 ntpd[15670]: switching logging to file /var/log/ntp.log
Sep 28 09:30:18 ubuntu-1604 dhclient[600]: bound to 192.168.11.25 -- renewal in 242 seconds.
Sep 28 09:30:19 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd9dba655)
Sep 28 09:30:26 ubuntu-1604 dhclient[627]: message repeated 7 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd9dba655)]
Sep 28 09:30:27 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:30:27 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:30:27 ubuntu-1604 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 09:30:27 ubuntu-1604 ntp[15723]:  * Stopping NTP server ntpd
Sep 28 09:30:27 ubuntu-1604 ntp[15723]:    ...done.
Sep 28 09:30:27 ubuntu-1604 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 09:30:27 ubuntu-1604 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 09:30:27 ubuntu-1604 ntp[15734]:  * Starting NTP server ntpd
Sep 28 09:30:27 ubuntu-1604 ntpd[15741]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 09:30:27 ubuntu-1604 ntpd[15741]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 09:30:27 ubuntu-1604 ntp[15734]:    ...done.
Sep 28 09:30:27 ubuntu-1604 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 09:30:27 ubuntu-1604 ntpd[15744]: proto: precision = 0.048 usec (-24)
Sep 28 09:30:27 ubuntu-1604 ntpd[15744]: switching logging to file /var/log/ntp.log
Sep 28 09:30:43 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd11a830d)
Sep 28 09:30:53 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd11a830d)]
Sep 28 09:30:54 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:30:54 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:31:08 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf6c17f73)
Sep 28 09:31:18 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf6c17f73)]
Sep 28 09:31:19 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:31:19 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:31:35 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x79ee8910)
Sep 28 09:31:45 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x79ee8910)]
Sep 28 09:31:46 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:31:46 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:31:59 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcdef1610)
Sep 28 09:32:09 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcdef1610)]
Sep 28 09:32:10 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:32:10 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:32:25 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5cd05947)
Sep 28 09:32:35 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5cd05947)]
Sep 28 09:32:36 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:32:36 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:32:51 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd91cab4f)
Sep 28 09:33:01 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd91cab4f)]
Sep 28 09:33:02 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:33:02 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:33:24 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9bcc782c)
Sep 28 09:33:34 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9bcc782c)]
Sep 28 09:33:35 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:33:35 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:33:47 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4ca0693b)
Sep 28 09:33:57 ubuntu-1604 dhclient[627]: message repeated 9 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4ca0693b)]
Sep 28 09:33:58 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:33:58 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:34:17 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb155cb4e)
Sep 28 09:34:20 ubuntu-1604 dhclient[627]: message repeated 3 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb155cb4e)]
Sep 28 09:34:20 ubuntu-1604 dhclient[600]: DHCPREQUEST of 192.168.11.25 on ens2 to 192.168.11.3 port 67 (xid=0x3415f07)
Sep 28 09:34:20 ubuntu-1604 dhclient[600]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 09:34:20 ubuntu-1604 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 09:34:20 ubuntu-1604 ntp[15843]:  * Stopping NTP server ntpd
Sep 28 09:34:20 ubuntu-1604 ntp[15843]:    ...done.
Sep 28 09:34:20 ubuntu-1604 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 09:34:20 ubuntu-1604 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 09:34:20 ubuntu-1604 ntp[15854]:  * Starting NTP server ntpd
Sep 28 09:34:20 ubuntu-1604 ntpd[15861]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 09:34:20 ubuntu-1604 ntpd[15861]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -c /var/lib/ntp/ntp.conf.dhcp -u 108:112
Sep 28 09:34:20 ubuntu-1604 ntp[15854]:    ...done.
Sep 28 09:34:20 ubuntu-1604 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 09:34:20 ubuntu-1604 ntpd[15864]: proto: precision = 0.043 usec (-24)
Sep 28 09:34:20 ubuntu-1604 ntpd[15864]: switching logging to file /var/log/ntp.log
Sep 28 09:34:20 ubuntu-1604 dhclient[600]: bound to 192.168.11.25 -- renewal in 301 seconds.
Sep 28 09:34:21 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb155cb4e)
Sep 28 09:34:27 ubuntu-1604 dhclient[627]: message repeated 6 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb155cb4e)]
Sep 28 09:34:28 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:34:28 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:34:28 ubuntu-1604 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 09:34:28 ubuntu-1604 ntp[15917]:  * Stopping NTP server ntpd
Sep 28 09:34:28 ubuntu-1604 ntp[15917]:    ...done.
Sep 28 09:34:28 ubuntu-1604 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 09:34:28 ubuntu-1604 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 09:34:28 ubuntu-1604 ntp[15928]:  * Starting NTP server ntpd
Sep 28 09:34:28 ubuntu-1604 ntpd[15935]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 09:34:28 ubuntu-1604 ntpd[15935]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 09:34:28 ubuntu-1604 ntp[15928]:    ...done.
Sep 28 09:34:28 ubuntu-1604 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 09:34:28 ubuntu-1604 ntpd[15938]: proto: precision = 0.042 usec (-24)
Sep 28 09:34:28 ubuntu-1604 ntpd[15938]: switching logging to file /var/log/ntp.log
Sep 28 09:34:49 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x43720f4a)
Sep 28 09:34:59 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x43720f4a)]
Sep 28 09:35:00 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:35:00 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:35:22 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4ab2e32d)
Sep 28 09:35:32 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4ab2e32d)]
Sep 28 09:35:33 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:35:33 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:35:55 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9a27512)
Sep 28 09:36:05 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9a27512)]
Sep 28 09:36:06 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:36:06 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:36:25 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x39a74704)
Sep 28 09:36:35 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x39a74704)]
Sep 28 09:36:36 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:36:36 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:36:46 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1f4d5041)
Sep 28 09:36:56 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1f4d5041)]
Sep 28 09:36:57 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:36:57 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:37:16 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x52d1e565)
Sep 28 09:37:26 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x52d1e565)]
Sep 28 09:37:27 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:37:27 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:37:48 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4f763732)
Sep 28 09:37:58 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4f763732)]
Sep 28 09:37:59 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:37:59 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:38:09 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x192acf6f)
Sep 28 09:38:19 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x192acf6f)]
Sep 28 09:38:20 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:38:20 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:38:32 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9cee2516)
Sep 28 09:38:42 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9cee2516)]
Sep 28 09:38:43 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:38:43 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:38:58 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6d246709)
Sep 28 09:39:08 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6d246709)]
Sep 28 09:39:09 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:39:09 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:39:17 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x193f5127)
Sep 28 09:39:21 ubuntu-1604 dhclient[627]: message repeated 4 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x193f5127)]
Sep 28 09:39:21 ubuntu-1604 dhclient[600]: DHCPREQUEST of 192.168.11.25 on ens2 to 192.168.11.3 port 67 (xid=0x3415f07)
Sep 28 09:39:21 ubuntu-1604 dhclient[600]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 09:39:22 ubuntu-1604 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 09:39:22 ubuntu-1604 ntp[16047]:  * Stopping NTP server ntpd
Sep 28 09:39:22 ubuntu-1604 ntp[16047]:    ...done.
Sep 28 09:39:22 ubuntu-1604 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 09:39:22 ubuntu-1604 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 09:39:22 ubuntu-1604 ntp[16058]:  * Starting NTP server ntpd
Sep 28 09:39:22 ubuntu-1604 ntpd[16065]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 09:39:22 ubuntu-1604 ntpd[16065]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -c /var/lib/ntp/ntp.conf.dhcp -u 108:112
Sep 28 09:39:22 ubuntu-1604 ntp[16058]:    ...done.
Sep 28 09:39:22 ubuntu-1604 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 09:39:22 ubuntu-1604 ntpd[16068]: proto: precision = 0.042 usec (-24)
Sep 28 09:39:22 ubuntu-1604 ntpd[16068]: switching logging to file /var/log/ntp.log
Sep 28 09:39:22 ubuntu-1604 dhclient[600]: bound to 192.168.11.25 -- renewal in 300 seconds.
Sep 28 09:39:22 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x193f5127)
Sep 28 09:39:27 ubuntu-1604 dhclient[627]: message repeated 5 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x193f5127)]
Sep 28 09:39:28 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:39:28 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:39:28 ubuntu-1604 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 09:39:28 ubuntu-1604 ntp[16120]:  * Stopping NTP server ntpd
Sep 28 09:39:28 ubuntu-1604 ntp[16120]:    ...done.
Sep 28 09:39:28 ubuntu-1604 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 09:39:28 ubuntu-1604 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 09:39:28 ubuntu-1604 ntp[16131]:  * Starting NTP server ntpd
Sep 28 09:39:28 ubuntu-1604 ntpd[16138]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 09:39:28 ubuntu-1604 ntpd[16138]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 09:39:28 ubuntu-1604 ntp[16131]:    ...done.
Sep 28 09:39:28 ubuntu-1604 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 09:39:28 ubuntu-1604 ntpd[16141]: proto: precision = 0.044 usec (-24)
Sep 28 09:39:28 ubuntu-1604 ntpd[16141]: switching logging to file /var/log/ntp.log
Sep 28 09:39:45 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x56417140)
Sep 28 09:39:55 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x56417140)]
Sep 28 09:39:56 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:39:56 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:40:05 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7d728f41)
Sep 28 09:40:12 ubuntu-1604 dhclient[627]: message repeated 7 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7d728f41)]
Sep 28 09:40:12 ubuntu-1604 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command state.sls with jid 20170928094012461501
Sep 28 09:40:12 ubuntu-1604 salt-minion[14967]: [INFO    ] Starting a new job with PID 16152
Sep 28 09:40:13 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7d728f41)
Sep 28 09:40:14 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7d728f41)
Sep 28 09:40:14 ubuntu-1604 salt-minion[14967]: [INFO    ] Loading fresh modules for state activity
Sep 28 09:40:14 ubuntu-1604 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'keepalived/init.sls'
Sep 28 09:40:14 ubuntu-1604 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'keepalived/cluster.sls'
Sep 28 09:40:14 ubuntu-1604 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'keepalived/map.jinja'
Sep 28 09:40:14 ubuntu-1604 salt-minion[14967]: [INFO    ] Running state [lsof] at time 09:40:14.730247
Sep 28 09:40:14 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing state pkg.installed for lsof
Sep 28 09:40:14 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 09:40:15 ubuntu-1604 salt-minion[14967]: [INFO    ] Package lsof is already installed
Sep 28 09:40:15 ubuntu-1604 salt-minion[14967]: [INFO    ] Completed state [lsof] at time 09:40:15.205504 duration_in_ms=475.257
Sep 28 09:40:15 ubuntu-1604 salt-minion[14967]: [INFO    ] Running state [keepalived] at time 09:40:15.205716
Sep 28 09:40:15 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing state pkg.installed for keepalived
Sep 28 09:40:15 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing command ['apt-get', '-q', 'update'] in directory '/root'
Sep 28 09:40:15 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7d728f41)
Sep 28 09:40:16 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:40:16 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:40:22 ubuntu-1604 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928094022502960
Sep 28 09:40:22 ubuntu-1604 salt-minion[14967]: [INFO    ] Starting a new job with PID 16440
Sep 28 09:40:22 ubuntu-1604 salt-minion[14967]: [INFO    ] Returning information for job: 20170928094022502960
Sep 28 09:40:32 ubuntu-1604 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928094032655093
Sep 28 09:40:32 ubuntu-1604 salt-minion[14967]: [INFO    ] Starting a new job with PID 16445
Sep 28 09:40:32 ubuntu-1604 salt-minion[14967]: [INFO    ] Returning information for job: 20170928094032655093
Sep 28 09:40:35 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xafc3e008)
Sep 28 09:40:42 ubuntu-1604 dhclient[627]: message repeated 7 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xafc3e008)]
Sep 28 09:40:42 ubuntu-1604 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928094042813827
Sep 28 09:40:42 ubuntu-1604 salt-minion[14967]: [INFO    ] Starting a new job with PID 16450
Sep 28 09:40:42 ubuntu-1604 salt-minion[14967]: [INFO    ] Returning information for job: 20170928094042813827
Sep 28 09:40:43 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xafc3e008)
Sep 28 09:40:45 ubuntu-1604 dhclient[627]: message repeated 2 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xafc3e008)]
Sep 28 09:40:46 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:40:46 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:40:52 ubuntu-1604 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928094052979963
Sep 28 09:40:53 ubuntu-1604 salt-minion[14967]: [INFO    ] Starting a new job with PID 16460
Sep 28 09:40:53 ubuntu-1604 salt-minion[14967]: [INFO    ] Returning information for job: 20170928094052979963
Sep 28 09:41:00 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd3bc22)
Sep 28 09:41:02 ubuntu-1604 dhclient[627]: message repeated 2 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd3bc22)]
Sep 28 09:41:03 ubuntu-1604 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928094103158299
Sep 28 09:41:03 ubuntu-1604 salt-minion[14967]: [INFO    ] Starting a new job with PID 16465
Sep 28 09:41:03 ubuntu-1604 salt-minion[14967]: [INFO    ] Returning information for job: 20170928094103158299
Sep 28 09:41:03 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd3bc22)
Sep 28 09:41:10 ubuntu-1604 dhclient[627]: message repeated 7 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd3bc22)]
Sep 28 09:41:11 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:41:11 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:41:13 ubuntu-1604 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928094113343124
Sep 28 09:41:13 ubuntu-1604 salt-minion[14967]: [INFO    ] Starting a new job with PID 16475
Sep 28 09:41:13 ubuntu-1604 salt-minion[14967]: [INFO    ] Returning information for job: 20170928094113343124
Sep 28 09:41:23 ubuntu-1604 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928094123532142
Sep 28 09:41:23 ubuntu-1604 salt-minion[14967]: [INFO    ] Starting a new job with PID 16480
Sep 28 09:41:23 ubuntu-1604 salt-minion[14967]: [INFO    ] Returning information for job: 20170928094123532142
Sep 28 09:41:26 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x67891d38)
Sep 28 09:41:33 ubuntu-1604 dhclient[627]: message repeated 7 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x67891d38)]
Sep 28 09:41:33 ubuntu-1604 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928094133726340
Sep 28 09:41:33 ubuntu-1604 salt-minion[14967]: [INFO    ] Starting a new job with PID 16485
Sep 28 09:41:33 ubuntu-1604 salt-minion[14967]: [INFO    ] Returning information for job: 20170928094133726340
Sep 28 09:41:34 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x67891d38)
Sep 28 09:41:36 ubuntu-1604 dhclient[627]: message repeated 2 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x67891d38)]
Sep 28 09:41:37 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:41:37 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:41:43 ubuntu-1604 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928094143932500
Sep 28 09:41:43 ubuntu-1604 salt-minion[14967]: [INFO    ] Starting a new job with PID 16495
Sep 28 09:41:43 ubuntu-1604 salt-minion[14967]: [INFO    ] Returning information for job: 20170928094143932500
Sep 28 09:41:46 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xae50b775)
Sep 28 09:41:53 ubuntu-1604 dhclient[627]: message repeated 7 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xae50b775)]
Sep 28 09:41:54 ubuntu-1604 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928094154144911
Sep 28 09:41:54 ubuntu-1604 salt-minion[14967]: [INFO    ] Starting a new job with PID 16500
Sep 28 09:41:54 ubuntu-1604 salt-minion[14967]: [INFO    ] Returning information for job: 20170928094154144911
Sep 28 09:41:54 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xae50b775)
Sep 28 09:41:56 ubuntu-1604 dhclient[627]: message repeated 2 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xae50b775)]
Sep 28 09:41:57 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:41:57 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:42:04 ubuntu-1604 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928094204374238
Sep 28 09:42:04 ubuntu-1604 salt-minion[14967]: [INFO    ] Starting a new job with PID 16510
Sep 28 09:42:04 ubuntu-1604 salt-minion[14967]: [INFO    ] Returning information for job: 20170928094204374238
Sep 28 09:42:07 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xbd30f82a)
Sep 28 09:42:13 ubuntu-1604 dhclient[627]: message repeated 6 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xbd30f82a)]
Sep 28 09:42:14 ubuntu-1604 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928094214597652
Sep 28 09:42:14 ubuntu-1604 salt-minion[14967]: [INFO    ] Starting a new job with PID 16515
Sep 28 09:42:14 ubuntu-1604 salt-minion[14967]: [INFO    ] Returning information for job: 20170928094214597652
Sep 28 09:42:14 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xbd30f82a)
Sep 28 09:42:16 ubuntu-1604 dhclient[627]: message repeated 2 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xbd30f82a)]
Sep 28 09:42:17 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing command ['systemd-run', '--scope', 'apt-get', '-q', '-y', '-o', 'DPkg::Options::=--force-confold', '-o', 'DPkg::Options::=--force-confdef', 'install', 'keepalived'] in directory '/root'
Sep 28 09:42:17 ubuntu-1604 systemd[1]: Started /usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold -o DPkg::Options::=--force-confdef install keepalived.
Sep 28 09:42:17 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xbd30f82a)
Sep 28 09:42:18 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:42:18 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:42:23 ubuntu-1604 systemd[1]: Reloading.
Sep 28 09:42:24 ubuntu-1604 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928094224616951
Sep 28 09:42:24 ubuntu-1604 salt-minion[14967]: [INFO    ] Starting a new job with PID 16772
Sep 28 09:42:24 ubuntu-1604 salt-minion[14967]: [INFO    ] Returning information for job: 20170928094224616951
Sep 28 09:42:25 ubuntu-1604 systemd[1]: Reloading.
Sep 28 09:42:26 ubuntu-1604 systemd[1]: message repeated 4 times: [ Reloading.]
Sep 28 09:42:26 ubuntu-1604 systemd[1]: Starting LSB: ipvsadm daemon...
Sep 28 09:42:26 ubuntu-1604 ipvsadm[16896]:  * ipvsadm is not configured to run. Please edit /etc/default/ipvsadm
Sep 28 09:42:26 ubuntu-1604 systemd[1]: Started LSB: ipvsadm daemon.
Sep 28 09:42:26 ubuntu-1604 systemd[1]: Reloading.
Sep 28 09:42:27 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 09:42:27 ubuntu-1604 salt-minion[14967]: [INFO    ] Made the following changes:
Sep 28 09:42:27 ubuntu-1604 salt-minion[14967]: 'libsnmp30' changed from 'absent' to '5.7.3+dfsg-1ubuntu4'
Sep 28 09:42:27 ubuntu-1604 salt-minion[14967]: 'libsnmp-base' changed from 'absent' to '5.7.3+dfsg-1ubuntu4'
Sep 28 09:42:27 ubuntu-1604 salt-minion[14967]: 'keepalived' changed from 'absent' to '1:1.2.19-1ubuntu0.2'
Sep 28 09:42:27 ubuntu-1604 salt-minion[14967]: 'ipvsadm' changed from 'absent' to '1:1.28-3'
Sep 28 09:42:27 ubuntu-1604 salt-minion[14967]: 'libsensors4' changed from 'absent' to '1:3.4.0-2'
Sep 28 09:42:27 ubuntu-1604 salt-minion[14967]: [INFO    ] Loading fresh modules for state activity
Sep 28 09:42:27 ubuntu-1604 salt-minion[14967]: [INFO    ] Completed state [keepalived] at time 09:42:27.728867 duration_in_ms=132523.151
Sep 28 09:42:27 ubuntu-1604 salt-minion[14967]: [INFO    ] Running state [/etc/keepalived/keepalived.conf] at time 09:42:27.731229
Sep 28 09:42:27 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing state file.managed for /etc/keepalived/keepalived.conf
Sep 28 09:42:27 ubuntu-1604 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'keepalived/files/keepalived.conf'
Sep 28 09:42:27 ubuntu-1604 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'keepalived/map.jinja'
Sep 28 09:42:27 ubuntu-1604 salt-minion[14967]: [INFO    ] File changed:
Sep 28 09:42:27 ubuntu-1604 salt-minion[14967]: New file
Sep 28 09:42:27 ubuntu-1604 salt-minion[14967]: [INFO    ] Completed state [/etc/keepalived/keepalived.conf] at time 09:42:27.803754 duration_in_ms=72.525
Sep 28 09:42:27 ubuntu-1604 salt-minion[14967]: [INFO    ] Running state [keepalived] at time 09:42:27.866683
Sep 28 09:42:27 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing state service.running for keepalived
Sep 28 09:42:27 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'status', 'keepalived.service', '-n', '0'] in directory '/root'
Sep 28 09:42:27 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-active', 'keepalived.service'] in directory '/root'
Sep 28 09:42:27 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-enabled', 'keepalived.service'] in directory '/root'
Sep 28 09:42:27 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-enabled', 'keepalived.service'] in directory '/root'
Sep 28 09:42:27 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing command ['systemd-run', '--scope', 'systemctl', 'start', 'keepalived.service'] in directory '/root'
Sep 28 09:42:27 ubuntu-1604 systemd[1]: Started /bin/systemctl start keepalived.service.
Sep 28 09:42:27 ubuntu-1604 systemd[1]: Starting Keepalive Daemon (LVS and VRRP)...
Sep 28 09:42:27 ubuntu-1604 Keepalived[16967]: Starting Keepalived v1.2.19 (03/13,2017)
Sep 28 09:42:27 ubuntu-1604 Keepalived[16968]: Starting Healthcheck child process, pid=16969
Sep 28 09:42:27 ubuntu-1604 Keepalived[16968]: Starting VRRP child process, pid=16970
Sep 28 09:42:27 ubuntu-1604 Keepalived_vrrp[16970]: Registering Kernel netlink reflector
Sep 28 09:42:27 ubuntu-1604 Keepalived_vrrp[16970]: Registering Kernel netlink command channel
Sep 28 09:42:27 ubuntu-1604 Keepalived_vrrp[16970]: Registering gratuitous ARP shared channel
Sep 28 09:42:27 ubuntu-1604 Keepalived_vrrp[16970]: Opening file '/etc/keepalived/keepalived.conf'.
Sep 28 09:42:27 ubuntu-1604 Keepalived_vrrp[16970]: Configuration is using : 63571 Bytes
Sep 28 09:42:27 ubuntu-1604 Keepalived_vrrp[16970]: Using LinkWatch kernel netlink reflector...
Sep 28 09:42:27 ubuntu-1604 Keepalived_vrrp[16970]: VRRP_Instance(VIP) Entering BACKUP STATE
Sep 28 09:42:27 ubuntu-1604 Keepalived_healthcheckers[16969]: Initializing ipvs 2.6
Sep 28 09:42:27 ubuntu-1604 systemd[1]: Started Keepalive Daemon (LVS and VRRP).
Sep 28 09:42:27 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-active', 'keepalived.service'] in directory '/root'
Sep 28 09:42:27 ubuntu-1604 Keepalived_healthcheckers[16969]: Registering Kernel netlink reflector
Sep 28 09:42:27 ubuntu-1604 Keepalived_healthcheckers[16969]: Registering Kernel netlink command channel
Sep 28 09:42:27 ubuntu-1604 Keepalived_healthcheckers[16969]: Opening file '/etc/keepalived/keepalived.conf'.
Sep 28 09:42:27 ubuntu-1604 Keepalived_healthcheckers[16969]: Configuration is using : 8435 Bytes
Sep 28 09:42:27 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-enabled', 'keepalived.service'] in directory '/root'
Sep 28 09:42:27 ubuntu-1604 kernel: [ 3586.463974] IPVS: Registered protocols (TCP, UDP, SCTP, AH, ESP)
Sep 28 09:42:27 ubuntu-1604 kernel: [ 3586.464187] IPVS: Connection hash table configured (size=4096, memory=64Kbytes)
Sep 28 09:42:27 ubuntu-1604 kernel: [ 3586.464223] IPVS: Creating netns size=2176 id=0
Sep 28 09:42:27 ubuntu-1604 kernel: [ 3586.464776] IPVS: ipvs loaded.
Sep 28 09:42:27 ubuntu-1604 Keepalived_healthcheckers[16969]: Using LinkWatch kernel netlink reflector...
Sep 28 09:42:27 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-enabled', 'keepalived.service'] in directory '/root'
Sep 28 09:42:27 ubuntu-1604 salt-minion[14967]: [INFO    ] {'keepalived': True}
Sep 28 09:42:27 ubuntu-1604 salt-minion[14967]: [INFO    ] Completed state [keepalived] at time 09:42:27.988253 duration_in_ms=121.569
Sep 28 09:42:27 ubuntu-1604 salt-minion[14967]: [INFO    ] Returning information for job: 20170928094012461501
Sep 28 09:42:34 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xad613309)
Sep 28 09:42:44 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xad613309)]
Sep 28 09:42:45 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:42:45 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:43:06 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3dd30223)
Sep 28 09:43:09 ubuntu-1604 dhclient[627]: message repeated 3 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3dd30223)]
Sep 28 09:43:09 ubuntu-1604 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command pillar.get with jid 20170928094309960988
Sep 28 09:43:09 ubuntu-1604 salt-minion[14967]: [INFO    ] Starting a new job with PID 16991
Sep 28 09:43:09 ubuntu-1604 salt-minion[14967]: [INFO    ] Returning information for job: 20170928094309960988
Sep 28 09:43:10 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3dd30223)
Sep 28 09:43:16 ubuntu-1604 dhclient[627]: message repeated 6 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3dd30223)]
Sep 28 09:43:17 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:43:17 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:43:25 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x78062676)
Sep 28 09:43:35 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x78062676)]
Sep 28 09:43:36 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:43:36 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:43:47 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xca9c916e)
Sep 28 09:43:57 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xca9c916e)]
Sep 28 09:43:58 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:43:58 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:44:17 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3568197f)
Sep 28 09:44:21 ubuntu-1604 dhclient[627]: message repeated 4 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3568197f)]
Sep 28 09:44:22 ubuntu-1604 dhclient[600]: DHCPREQUEST of 192.168.11.25 on ens2 to 192.168.11.3 port 67 (xid=0x3415f07)
Sep 28 09:44:22 ubuntu-1604 dhclient[600]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 09:44:22 ubuntu-1604 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 09:44:22 ubuntu-1604 ntp[17064]:  * Stopping NTP server ntpd
Sep 28 09:44:22 ubuntu-1604 ntp[17064]:    ...done.
Sep 28 09:44:22 ubuntu-1604 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 09:44:22 ubuntu-1604 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 09:44:22 ubuntu-1604 ntp[17075]:  * Starting NTP server ntpd
Sep 28 09:44:22 ubuntu-1604 ntpd[17082]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 09:44:22 ubuntu-1604 ntpd[17082]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -c /var/lib/ntp/ntp.conf.dhcp -u 108:112
Sep 28 09:44:22 ubuntu-1604 ntp[17075]:    ...done.
Sep 28 09:44:22 ubuntu-1604 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 09:44:22 ubuntu-1604 ntpd[17085]: proto: precision = 0.043 usec (-24)
Sep 28 09:44:22 ubuntu-1604 ntpd[17085]: switching logging to file /var/log/ntp.log
Sep 28 09:44:22 ubuntu-1604 dhclient[600]: bound to 192.168.11.25 -- renewal in 278 seconds.
Sep 28 09:44:22 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3568197f)
Sep 28 09:44:27 ubuntu-1604 dhclient[627]: message repeated 4 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3568197f)]
Sep 28 09:44:28 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:44:28 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:44:28 ubuntu-1604 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 09:44:28 ubuntu-1604 ntp[17138]:  * Stopping NTP server ntpd
Sep 28 09:44:28 ubuntu-1604 ntp[17138]:    ...done.
Sep 28 09:44:28 ubuntu-1604 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 09:44:28 ubuntu-1604 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 09:44:28 ubuntu-1604 ntp[17149]:  * Starting NTP server ntpd
Sep 28 09:44:28 ubuntu-1604 ntpd[17156]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 09:44:28 ubuntu-1604 ntpd[17156]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 09:44:28 ubuntu-1604 ntp[17149]:    ...done.
Sep 28 09:44:28 ubuntu-1604 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 09:44:28 ubuntu-1604 ntpd[17159]: proto: precision = 0.042 usec (-24)
Sep 28 09:44:28 ubuntu-1604 ntpd[17159]: switching logging to file /var/log/ntp.log
Sep 28 09:44:38 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xba0dcc3d)
Sep 28 09:44:48 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xba0dcc3d)]
Sep 28 09:44:49 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:44:49 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:45:10 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1132af52)
Sep 28 09:45:20 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1132af52)]
Sep 28 09:45:21 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:45:21 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:45:30 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfde5c732)
Sep 28 09:45:40 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfde5c732)]
Sep 28 09:45:41 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:45:41 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:45:51 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x81dc4312)
Sep 28 09:46:01 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x81dc4312)]
Sep 28 09:46:02 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:46:02 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:46:18 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x22591269)
Sep 28 09:46:28 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x22591269)]
Sep 28 09:46:29 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:46:29 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:46:41 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5eaa336f)
Sep 28 09:46:51 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5eaa336f)]
Sep 28 09:46:52 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:46:52 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:47:12 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdadcb353)
Sep 28 09:47:22 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdadcb353)]
Sep 28 09:47:23 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:47:23 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:47:44 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe83efc54)
Sep 28 09:47:54 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe83efc54)]
Sep 28 09:47:55 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:47:55 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:48:05 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x87ded004)
Sep 28 09:48:15 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x87ded004)]
Sep 28 09:48:16 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:48:16 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:48:32 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x21b83706)
Sep 28 09:48:42 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x21b83706)]
Sep 28 09:48:43 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:48:43 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:49:00 ubuntu-1604 dhclient[600]: DHCPREQUEST of 192.168.11.25 on ens2 to 192.168.11.3 port 67 (xid=0x3415f07)
Sep 28 09:49:01 ubuntu-1604 dhclient[600]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 09:49:01 ubuntu-1604 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 09:49:01 ubuntu-1604 ntp[17268]:  * Stopping NTP server ntpd
Sep 28 09:49:01 ubuntu-1604 ntp[17268]:    ...done.
Sep 28 09:49:01 ubuntu-1604 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 09:49:01 ubuntu-1604 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 09:49:01 ubuntu-1604 ntp[17279]:  * Starting NTP server ntpd
Sep 28 09:49:01 ubuntu-1604 ntpd[17286]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 09:49:01 ubuntu-1604 ntpd[17286]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -c /var/lib/ntp/ntp.conf.dhcp -u 108:112
Sep 28 09:49:01 ubuntu-1604 ntp[17279]:    ...done.
Sep 28 09:49:01 ubuntu-1604 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 09:49:01 ubuntu-1604 ntpd[17289]: proto: precision = 0.042 usec (-24)
Sep 28 09:49:01 ubuntu-1604 ntpd[17289]: switching logging to file /var/log/ntp.log
Sep 28 09:49:01 ubuntu-1604 dhclient[600]: bound to 192.168.11.25 -- renewal in 248 seconds.
Sep 28 09:49:01 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x87a12234)
Sep 28 09:49:11 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x87a12234)]
Sep 28 09:49:12 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:49:12 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:49:12 ubuntu-1604 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 09:49:12 ubuntu-1604 ntp[17341]:  * Stopping NTP server ntpd
Sep 28 09:49:12 ubuntu-1604 ntp[17341]:    ...done.
Sep 28 09:49:12 ubuntu-1604 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 09:49:12 ubuntu-1604 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 09:49:12 ubuntu-1604 ntp[17352]:  * Starting NTP server ntpd
Sep 28 09:49:12 ubuntu-1604 ntpd[17359]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 09:49:12 ubuntu-1604 ntpd[17359]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 09:49:12 ubuntu-1604 ntp[17352]:    ...done.
Sep 28 09:49:12 ubuntu-1604 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 09:49:13 ubuntu-1604 ntpd[17362]: proto: precision = 0.042 usec (-24)
Sep 28 09:49:13 ubuntu-1604 ntpd[17362]: switching logging to file /var/log/ntp.log
Sep 28 09:49:24 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x46ee2a54)
Sep 28 09:49:34 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x46ee2a54)]
Sep 28 09:49:35 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:49:35 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:49:47 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc56ddb10)
Sep 28 09:49:57 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc56ddb10)]
Sep 28 09:49:58 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:49:58 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:50:13 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x62b1cb57)
Sep 28 09:50:23 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x62b1cb57)]
Sep 28 09:50:24 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:50:24 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:50:32 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x37e2d601)
Sep 28 09:50:42 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x37e2d601)]
Sep 28 09:50:43 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:50:43 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:50:58 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5c135f20)
Sep 28 09:51:08 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5c135f20)]
Sep 28 09:51:09 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:51:09 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:51:17 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x322b9059)
Sep 28 09:51:27 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x322b9059)]
Sep 28 09:51:28 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:51:28 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:51:48 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8d96b32c)
Sep 28 09:51:58 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8d96b32c)]
Sep 28 09:51:59 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:51:59 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:52:12 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf5e38e18)
Sep 28 09:52:22 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf5e38e18)]
Sep 28 09:52:23 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:52:23 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:52:31 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xebdf4357)
Sep 28 09:52:41 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xebdf4357)]
Sep 28 09:52:42 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:52:42 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:53:02 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x97576262)
Sep 28 09:53:09 ubuntu-1604 dhclient[627]: message repeated 7 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x97576262)]
Sep 28 09:53:09 ubuntu-1604 dhclient[600]: DHCPREQUEST of 192.168.11.25 on ens2 to 192.168.11.3 port 67 (xid=0x3415f07)
Sep 28 09:53:09 ubuntu-1604 dhclient[600]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 09:53:09 ubuntu-1604 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 09:53:09 ubuntu-1604 ntp[17467]:  * Stopping NTP server ntpd
Sep 28 09:53:09 ubuntu-1604 ntp[17467]:    ...done.
Sep 28 09:53:09 ubuntu-1604 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 09:53:09 ubuntu-1604 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 09:53:09 ubuntu-1604 ntp[17478]:  * Starting NTP server ntpd
Sep 28 09:53:09 ubuntu-1604 ntpd[17485]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 09:53:09 ubuntu-1604 ntpd[17485]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -c /var/lib/ntp/ntp.conf.dhcp -u 108:112
Sep 28 09:53:09 ubuntu-1604 ntp[17478]:    ...done.
Sep 28 09:53:09 ubuntu-1604 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 09:53:09 ubuntu-1604 ntpd[17488]: proto: precision = 0.042 usec (-24)
Sep 28 09:53:09 ubuntu-1604 ntpd[17488]: switching logging to file /var/log/ntp.log
Sep 28 09:53:09 ubuntu-1604 dhclient[600]: bound to 192.168.11.25 -- renewal in 240 seconds.
Sep 28 09:53:10 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x97576262)
Sep 28 09:53:12 ubuntu-1604 dhclient[627]: message repeated 2 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x97576262)]
Sep 28 09:53:13 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:53:13 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:53:13 ubuntu-1604 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 09:53:13 ubuntu-1604 ntp[17540]:  * Stopping NTP server ntpd
Sep 28 09:53:13 ubuntu-1604 ntp[17540]:    ...done.
Sep 28 09:53:13 ubuntu-1604 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 09:53:13 ubuntu-1604 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 09:53:13 ubuntu-1604 ntp[17551]:  * Starting NTP server ntpd
Sep 28 09:53:13 ubuntu-1604 ntpd[17558]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 09:53:13 ubuntu-1604 ntpd[17558]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 09:53:13 ubuntu-1604 ntp[17551]:    ...done.
Sep 28 09:53:13 ubuntu-1604 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 09:53:13 ubuntu-1604 ntpd[17561]: proto: precision = 0.043 usec (-24)
Sep 28 09:53:13 ubuntu-1604 ntpd[17561]: switching logging to file /var/log/ntp.log
Sep 28 09:53:21 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x566dd466)
Sep 28 09:53:31 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x566dd466)]
Sep 28 09:53:32 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:53:32 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:53:47 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfa11ad55)
Sep 28 09:53:57 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfa11ad55)]
Sep 28 09:53:58 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:53:58 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:54:08 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xff105e05)
Sep 28 09:54:18 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xff105e05)]
Sep 28 09:54:19 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:54:19 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:54:27 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x686ac97a)
Sep 28 09:54:37 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x686ac97a)]
Sep 28 09:54:38 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:54:38 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:54:53 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfe0f0e08)
Sep 28 09:55:03 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfe0f0e08)]
Sep 28 09:55:04 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:55:04 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:55:23 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1b334815)
Sep 28 09:55:33 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1b334815)]
Sep 28 09:55:34 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:55:34 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:55:48 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfd1c7617)
Sep 28 09:55:58 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfd1c7617)]
Sep 28 09:55:59 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:55:59 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:56:16 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9cde7a50)
Sep 28 09:56:26 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9cde7a50)]
Sep 28 09:56:27 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:56:27 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:56:38 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x75618057)
Sep 28 09:56:48 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x75618057)]
Sep 28 09:56:49 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:56:49 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:57:03 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1a7e7c7c)
Sep 28 09:57:09 ubuntu-1604 dhclient[627]: message repeated 6 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1a7e7c7c)]
Sep 28 09:57:09 ubuntu-1604 dhclient[600]: DHCPREQUEST of 192.168.11.25 on ens2 to 192.168.11.3 port 67 (xid=0x3415f07)
Sep 28 09:57:10 ubuntu-1604 dhclient[600]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 09:57:10 ubuntu-1604 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 09:57:10 ubuntu-1604 ntp[17666]:  * Stopping NTP server ntpd
Sep 28 09:57:10 ubuntu-1604 ntp[17666]:    ...done.
Sep 28 09:57:10 ubuntu-1604 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 09:57:10 ubuntu-1604 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 09:57:10 ubuntu-1604 ntp[17677]:  * Starting NTP server ntpd
Sep 28 09:57:10 ubuntu-1604 ntpd[17684]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 09:57:10 ubuntu-1604 ntpd[17684]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -c /var/lib/ntp/ntp.conf.dhcp -u 108:112
Sep 28 09:57:10 ubuntu-1604 ntp[17677]:    ...done.
Sep 28 09:57:10 ubuntu-1604 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 09:57:10 ubuntu-1604 ntpd[17687]: proto: precision = 0.043 usec (-24)
Sep 28 09:57:10 ubuntu-1604 ntpd[17687]: switching logging to file /var/log/ntp.log
Sep 28 09:57:10 ubuntu-1604 dhclient[600]: bound to 192.168.11.25 -- renewal in 248 seconds.
Sep 28 09:57:10 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1a7e7c7c)
Sep 28 09:57:13 ubuntu-1604 dhclient[627]: message repeated 3 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1a7e7c7c)]
Sep 28 09:57:14 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:57:14 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:57:14 ubuntu-1604 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 09:57:14 ubuntu-1604 ntp[17740]:  * Stopping NTP server ntpd
Sep 28 09:57:14 ubuntu-1604 ntp[17740]:    ...done.
Sep 28 09:57:14 ubuntu-1604 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 09:57:14 ubuntu-1604 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 09:57:14 ubuntu-1604 ntp[17751]:  * Starting NTP server ntpd
Sep 28 09:57:14 ubuntu-1604 ntpd[17758]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 09:57:14 ubuntu-1604 ntpd[17758]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 09:57:14 ubuntu-1604 ntp[17751]:    ...done.
Sep 28 09:57:14 ubuntu-1604 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 09:57:14 ubuntu-1604 ntpd[17761]: proto: precision = 0.043 usec (-24)
Sep 28 09:57:14 ubuntu-1604 ntpd[17761]: switching logging to file /var/log/ntp.log
Sep 28 09:57:22 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb979cb1b)
Sep 28 09:57:32 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb979cb1b)]
Sep 28 09:57:33 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:57:33 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:57:52 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3b144714)
Sep 28 09:58:02 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3b144714)]
Sep 28 09:58:03 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:58:03 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:58:22 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1adf4f5f)
Sep 28 09:58:32 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1adf4f5f)]
Sep 28 09:58:33 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:58:33 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:58:44 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1011bd62)
Sep 28 09:58:54 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1011bd62)]
Sep 28 09:58:55 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:58:55 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:59:06 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcc359f15)
Sep 28 09:59:16 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcc359f15)]
Sep 28 09:59:17 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:59:17 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 09:59:32 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5fe0665e)
Sep 28 09:59:42 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5fe0665e)]
Sep 28 09:59:43 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 09:59:43 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:00:02 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1aed6a79)
Sep 28 10:00:12 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1aed6a79)]
Sep 28 10:00:13 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:00:13 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:00:22 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3c12f96c)
Sep 28 10:00:32 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3c12f96c)]
Sep 28 10:00:33 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:00:33 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:00:51 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6b002a1d)
Sep 28 10:01:01 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6b002a1d)]
Sep 28 10:01:02 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:01:02 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:01:17 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe021e679)
Sep 28 10:01:18 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe021e679)
Sep 28 10:01:18 ubuntu-1604 dhclient[600]: DHCPREQUEST of 192.168.11.25 on ens2 to 192.168.11.3 port 67 (xid=0x3415f07)
Sep 28 10:01:18 ubuntu-1604 dhclient[600]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 10:01:19 ubuntu-1604 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 10:01:19 ubuntu-1604 ntp[17865]:  * Stopping NTP server ntpd
Sep 28 10:01:19 ubuntu-1604 ntp[17865]:    ...done.
Sep 28 10:01:19 ubuntu-1604 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 10:01:19 ubuntu-1604 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 10:01:19 ubuntu-1604 ntp[17876]:  * Starting NTP server ntpd
Sep 28 10:01:19 ubuntu-1604 ntpd[17883]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 10:01:19 ubuntu-1604 ntpd[17883]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -c /var/lib/ntp/ntp.conf.dhcp -u 108:112
Sep 28 10:01:19 ubuntu-1604 ntp[17876]:    ...done.
Sep 28 10:01:19 ubuntu-1604 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 10:01:19 ubuntu-1604 ntpd[17886]: proto: precision = 0.043 usec (-24)
Sep 28 10:01:19 ubuntu-1604 ntpd[17886]: switching logging to file /var/log/ntp.log
Sep 28 10:01:19 ubuntu-1604 dhclient[600]: bound to 192.168.11.25 -- renewal in 276 seconds.
Sep 28 10:01:19 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe021e679)
Sep 28 10:01:27 ubuntu-1604 dhclient[627]: message repeated 8 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe021e679)]
Sep 28 10:01:28 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:01:28 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:01:28 ubuntu-1604 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 10:01:28 ubuntu-1604 ntp[17939]:  * Stopping NTP server ntpd
Sep 28 10:01:28 ubuntu-1604 ntp[17939]:    ...done.
Sep 28 10:01:28 ubuntu-1604 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 10:01:28 ubuntu-1604 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 10:01:28 ubuntu-1604 ntp[17950]:  * Starting NTP server ntpd
Sep 28 10:01:28 ubuntu-1604 ntpd[17957]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 10:01:28 ubuntu-1604 ntpd[17957]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 10:01:28 ubuntu-1604 ntp[17950]:    ...done.
Sep 28 10:01:28 ubuntu-1604 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 10:01:28 ubuntu-1604 ntpd[17960]: proto: precision = 0.042 usec (-24)
Sep 28 10:01:28 ubuntu-1604 ntpd[17960]: switching logging to file /var/log/ntp.log
Sep 28 10:01:50 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe3e3312f)
Sep 28 10:02:00 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe3e3312f)]
Sep 28 10:02:01 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:02:01 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:02:10 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3ce5484f)
Sep 28 10:02:20 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3ce5484f)]
Sep 28 10:02:21 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:02:21 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:02:30 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2795ef62)
Sep 28 10:02:40 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2795ef62)]
Sep 28 10:02:41 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:02:41 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:02:53 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf9a9f151)
Sep 28 10:03:03 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf9a9f151)]
Sep 28 10:03:04 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:03:04 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:03:21 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3e23594c)
Sep 28 10:03:31 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3e23594c)]
Sep 28 10:03:32 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:03:32 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:03:49 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x15b08011)
Sep 28 10:03:59 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x15b08011)]
Sep 28 10:04:00 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:04:00 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:04:11 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x31670015)
Sep 28 10:04:21 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x31670015)]
Sep 28 10:04:22 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:04:22 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:04:40 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe79c3319)
Sep 28 10:04:50 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe79c3319)]
Sep 28 10:04:51 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:04:51 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:05:07 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf9bc2f49)
Sep 28 10:05:17 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf9bc2f49)]
Sep 28 10:05:18 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:05:18 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:05:34 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6287c063)
Sep 28 10:05:44 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6287c063)]
Sep 28 10:05:45 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:05:45 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:05:55 ubuntu-1604 dhclient[600]: DHCPREQUEST of 192.168.11.25 on ens2 to 192.168.11.3 port 67 (xid=0x3415f07)
Sep 28 10:05:56 ubuntu-1604 dhclient[600]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 10:05:56 ubuntu-1604 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 10:05:56 ubuntu-1604 ntp[18070]:  * Stopping NTP server ntpd
Sep 28 10:05:56 ubuntu-1604 ntp[18070]:    ...done.
Sep 28 10:05:56 ubuntu-1604 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 10:05:56 ubuntu-1604 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 10:05:56 ubuntu-1604 ntp[18081]:  * Starting NTP server ntpd
Sep 28 10:05:56 ubuntu-1604 ntpd[18088]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 10:05:56 ubuntu-1604 ntpd[18088]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -c /var/lib/ntp/ntp.conf.dhcp -u 108:112
Sep 28 10:05:56 ubuntu-1604 ntp[18081]:    ...done.
Sep 28 10:05:56 ubuntu-1604 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 10:05:56 ubuntu-1604 ntpd[18091]: proto: precision = 0.044 usec (-24)
Sep 28 10:05:56 ubuntu-1604 ntpd[18091]: switching logging to file /var/log/ntp.log
Sep 28 10:05:56 ubuntu-1604 dhclient[600]: bound to 192.168.11.25 -- renewal in 247 seconds.
Sep 28 10:06:06 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcfea3276)
Sep 28 10:06:16 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcfea3276)]
Sep 28 10:06:17 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:06:17 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:06:17 ubuntu-1604 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 10:06:17 ubuntu-1604 ntp[18143]:  * Stopping NTP server ntpd
Sep 28 10:06:17 ubuntu-1604 ntp[18143]:    ...done.
Sep 28 10:06:17 ubuntu-1604 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 10:06:17 ubuntu-1604 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 10:06:17 ubuntu-1604 ntp[18154]:  * Starting NTP server ntpd
Sep 28 10:06:17 ubuntu-1604 ntpd[18161]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 10:06:17 ubuntu-1604 ntpd[18161]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 10:06:17 ubuntu-1604 ntp[18154]:    ...done.
Sep 28 10:06:17 ubuntu-1604 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 10:06:17 ubuntu-1604 ntpd[18164]: proto: precision = 0.042 usec (-24)
Sep 28 10:06:17 ubuntu-1604 ntpd[18164]: switching logging to file /var/log/ntp.log
Sep 28 10:06:25 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1c22b946)
Sep 28 10:06:35 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1c22b946)]
Sep 28 10:06:36 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:06:36 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:06:49 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xea6d8946)
Sep 28 10:06:59 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xea6d8946)]
Sep 28 10:07:00 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:07:00 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:07:19 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x80bfcb43)
Sep 28 10:07:29 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x80bfcb43)]
Sep 28 10:07:30 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:07:30 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:07:40 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x22f12e72)
Sep 28 10:07:50 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x22f12e72)]
Sep 28 10:07:51 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:07:51 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:08:04 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5754ec2a)
Sep 28 10:08:14 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5754ec2a)]
Sep 28 10:08:15 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:08:15 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:08:24 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4266b247)
Sep 28 10:08:34 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4266b247)]
Sep 28 10:08:35 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:08:35 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:08:50 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc7a08476)
Sep 28 10:09:00 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc7a08476)]
Sep 28 10:09:01 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:09:01 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:09:12 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x64ab3750)
Sep 28 10:09:22 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x64ab3750)]
Sep 28 10:09:23 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:09:23 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:09:41 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6be29709)
Sep 28 10:09:51 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6be29709)]
Sep 28 10:09:52 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:09:52 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:10:03 ubuntu-1604 dhclient[600]: DHCPREQUEST of 192.168.11.25 on ens2 to 192.168.11.3 port 67 (xid=0x3415f07)
Sep 28 10:10:03 ubuntu-1604 dhclient[600]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 10:10:03 ubuntu-1604 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 10:10:03 ubuntu-1604 ntp[18269]:  * Stopping NTP server ntpd
Sep 28 10:10:03 ubuntu-1604 ntp[18269]:    ...done.
Sep 28 10:10:03 ubuntu-1604 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 10:10:03 ubuntu-1604 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 10:10:03 ubuntu-1604 ntp[18280]:  * Starting NTP server ntpd
Sep 28 10:10:03 ubuntu-1604 ntpd[18287]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 10:10:03 ubuntu-1604 ntpd[18287]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -c /var/lib/ntp/ntp.conf.dhcp -u 108:112
Sep 28 10:10:03 ubuntu-1604 ntp[18280]:    ...done.
Sep 28 10:10:03 ubuntu-1604 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 10:10:03 ubuntu-1604 ntpd[18290]: proto: precision = 0.043 usec (-24)
Sep 28 10:10:03 ubuntu-1604 ntpd[18290]: switching logging to file /var/log/ntp.log
Sep 28 10:10:03 ubuntu-1604 dhclient[600]: bound to 192.168.11.25 -- renewal in 267 seconds.
Sep 28 10:10:14 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4780aa7d)
Sep 28 10:10:24 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4780aa7d)]
Sep 28 10:10:25 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:10:25 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:10:25 ubuntu-1604 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 10:10:25 ubuntu-1604 ntp[18343]:  * Stopping NTP server ntpd
Sep 28 10:10:25 ubuntu-1604 ntp[18343]:    ...done.
Sep 28 10:10:25 ubuntu-1604 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 10:10:25 ubuntu-1604 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 10:10:25 ubuntu-1604 ntp[18354]:  * Starting NTP server ntpd
Sep 28 10:10:25 ubuntu-1604 ntpd[18361]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 10:10:25 ubuntu-1604 ntpd[18361]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 10:10:25 ubuntu-1604 ntp[18354]:    ...done.
Sep 28 10:10:25 ubuntu-1604 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 10:10:25 ubuntu-1604 ntpd[18364]: proto: precision = 0.043 usec (-24)
Sep 28 10:10:25 ubuntu-1604 ntpd[18364]: switching logging to file /var/log/ntp.log
Sep 28 10:10:44 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x324c8f2f)
Sep 28 10:10:54 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x324c8f2f)]
Sep 28 10:10:55 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:10:55 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:11:16 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2e382624)
Sep 28 10:11:26 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2e382624)]
Sep 28 10:11:27 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:11:27 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:11:48 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xec83bf2b)
Sep 28 10:11:58 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xec83bf2b)]
Sep 28 10:11:59 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:11:59 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:12:21 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe38b7e0e)
Sep 28 10:12:31 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe38b7e0e)]
Sep 28 10:12:32 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:12:32 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:12:53 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc5be3635)
Sep 28 10:13:03 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc5be3635)]
Sep 28 10:13:04 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:13:04 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:13:19 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa5179627)
Sep 28 10:13:29 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa5179627)]
Sep 28 10:13:30 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:13:30 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:13:52 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xadb6904a)
Sep 28 10:14:02 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xadb6904a)]
Sep 28 10:14:03 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:14:03 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:14:20 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7d4c344)
Sep 28 10:14:30 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7d4c344)]
Sep 28 10:14:30 ubuntu-1604 dhclient[600]: DHCPREQUEST of 192.168.11.25 on ens2 to 192.168.11.3 port 67 (xid=0x3415f07)
Sep 28 10:14:30 ubuntu-1604 dhclient[600]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 10:14:31 ubuntu-1604 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 10:14:31 ubuntu-1604 ntp[18458]:  * Stopping NTP server ntpd
Sep 28 10:14:31 ubuntu-1604 ntp[18458]:    ...done.
Sep 28 10:14:31 ubuntu-1604 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 10:14:31 ubuntu-1604 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 10:14:31 ubuntu-1604 ntp[18469]:  * Starting NTP server ntpd
Sep 28 10:14:31 ubuntu-1604 ntpd[18476]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 10:14:31 ubuntu-1604 ntpd[18476]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -c /var/lib/ntp/ntp.conf.dhcp -u 108:112
Sep 28 10:14:31 ubuntu-1604 ntp[18469]:    ...done.
Sep 28 10:14:31 ubuntu-1604 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 10:14:31 ubuntu-1604 ntpd[18479]: proto: precision = 0.045 usec (-24)
Sep 28 10:14:31 ubuntu-1604 ntpd[18479]: switching logging to file /var/log/ntp.log
Sep 28 10:14:31 ubuntu-1604 dhclient[600]: bound to 192.168.11.25 -- renewal in 288 seconds.
Sep 28 10:14:31 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:14:31 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:14:31 ubuntu-1604 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 10:14:31 ubuntu-1604 ntp[18531]:  * Stopping NTP server ntpd
Sep 28 10:14:31 ubuntu-1604 ntp[18531]:    ...done.
Sep 28 10:14:31 ubuntu-1604 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 10:14:31 ubuntu-1604 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 10:14:31 ubuntu-1604 ntp[18542]:  * Starting NTP server ntpd
Sep 28 10:14:31 ubuntu-1604 ntpd[18549]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 10:14:31 ubuntu-1604 ntpd[18549]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 10:14:31 ubuntu-1604 ntp[18542]:    ...done.
Sep 28 10:14:31 ubuntu-1604 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 10:14:31 ubuntu-1604 ntpd[18552]: proto: precision = 0.042 usec (-24)
Sep 28 10:14:31 ubuntu-1604 ntpd[18552]: switching logging to file /var/log/ntp.log
Sep 28 10:14:41 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc7459072)
Sep 28 10:14:51 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc7459072)]
Sep 28 10:14:52 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:14:52 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:15:00 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3fe8342e)
Sep 28 10:15:10 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3fe8342e)]
Sep 28 10:15:11 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:15:11 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:15:19 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe1a7995f)
Sep 28 10:15:29 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe1a7995f)]
Sep 28 10:15:30 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:15:30 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:15:41 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa7708625)
Sep 28 10:15:51 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa7708625)]
Sep 28 10:15:52 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:15:52 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:16:10 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xeb002763)
Sep 28 10:16:20 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xeb002763)]
Sep 28 10:16:21 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:16:21 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:16:39 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xaddc9774)
Sep 28 10:16:49 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xaddc9774)]
Sep 28 10:16:50 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:16:50 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:17:01 ubuntu-1604 CRON[18588]: (root) CMD (   cd / && run-parts --report /etc/cron.hourly)
Sep 28 10:17:07 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd8d5c615)
Sep 28 10:17:17 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd8d5c615)]
Sep 28 10:17:18 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:17:18 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:17:26 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x69d7d12e)
Sep 28 10:17:36 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x69d7d12e)]
Sep 28 10:17:37 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:17:37 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:17:48 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x608fdd79)
Sep 28 10:17:58 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x608fdd79)]
Sep 28 10:17:59 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:17:59 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:18:12 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2d835857)
Sep 28 10:18:22 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2d835857)]
Sep 28 10:18:23 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:18:23 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:18:41 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x37144d1c)
Sep 28 10:18:51 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x37144d1c)]
Sep 28 10:18:52 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:18:52 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:19:00 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xbbaf784d)
Sep 28 10:19:10 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xbbaf784d)]
Sep 28 10:19:11 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:19:11 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:19:20 ubuntu-1604 dhclient[600]: DHCPREQUEST of 192.168.11.25 on ens2 to 192.168.11.3 port 67 (xid=0x3415f07)
Sep 28 10:19:20 ubuntu-1604 dhclient[600]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 10:19:20 ubuntu-1604 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 10:19:20 ubuntu-1604 ntp[18675]:  * Stopping NTP server ntpd
Sep 28 10:19:20 ubuntu-1604 ntp[18675]:    ...done.
Sep 28 10:19:20 ubuntu-1604 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 10:19:20 ubuntu-1604 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 10:19:20 ubuntu-1604 ntp[18686]:  * Starting NTP server ntpd
Sep 28 10:19:20 ubuntu-1604 ntpd[18693]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 10:19:20 ubuntu-1604 ntpd[18693]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -c /var/lib/ntp/ntp.conf.dhcp -u 108:112
Sep 28 10:19:20 ubuntu-1604 ntp[18686]:    ...done.
Sep 28 10:19:20 ubuntu-1604 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 10:19:20 ubuntu-1604 ntpd[18696]: proto: precision = 0.043 usec (-24)
Sep 28 10:19:20 ubuntu-1604 ntpd[18696]: switching logging to file /var/log/ntp.log
Sep 28 10:19:20 ubuntu-1604 dhclient[600]: bound to 192.168.11.25 -- renewal in 230 seconds.
Sep 28 10:19:31 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd51fba65)
Sep 28 10:19:41 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd51fba65)]
Sep 28 10:19:42 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:19:42 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:19:42 ubuntu-1604 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 10:19:42 ubuntu-1604 ntp[18749]:  * Stopping NTP server ntpd
Sep 28 10:19:42 ubuntu-1604 ntp[18749]:    ...done.
Sep 28 10:19:42 ubuntu-1604 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 10:19:42 ubuntu-1604 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 10:19:42 ubuntu-1604 ntp[18760]:  * Starting NTP server ntpd
Sep 28 10:19:42 ubuntu-1604 ntpd[18767]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 10:19:42 ubuntu-1604 ntpd[18767]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 10:19:42 ubuntu-1604 ntp[18760]:    ...done.
Sep 28 10:19:42 ubuntu-1604 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 10:19:42 ubuntu-1604 ntpd[18770]: proto: precision = 0.044 usec (-24)
Sep 28 10:19:42 ubuntu-1604 ntpd[18770]: switching logging to file /var/log/ntp.log
Sep 28 10:19:43 ubuntu-1604 salt-minion[14967]: [INFO    ] Running scheduled job: __mine_interval
Sep 28 10:19:51 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3fe5390e)
Sep 28 10:20:01 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3fe5390e)]
Sep 28 10:20:02 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:20:02 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:20:10 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x612aea63)
Sep 28 10:20:20 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x612aea63)]
Sep 28 10:20:21 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:20:21 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:20:41 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa0541e6a)
Sep 28 10:20:51 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa0541e6a)]
Sep 28 10:20:52 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:20:52 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:21:09 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x66199176)
Sep 28 10:21:19 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x66199176)]
Sep 28 10:21:20 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:21:20 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:21:30 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1cfc7f13)
Sep 28 10:21:40 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1cfc7f13)]
Sep 28 10:21:41 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:21:41 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:21:53 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa50c6b59)
Sep 28 10:22:03 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa50c6b59)]
Sep 28 10:22:04 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:22:04 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:22:17 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfd0c5334)
Sep 28 10:22:27 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfd0c5334)]
Sep 28 10:22:28 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:22:28 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:22:45 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7f787534)
Sep 28 10:22:55 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7f787534)]
Sep 28 10:22:56 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:22:56 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:23:09 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf11112d)
Sep 28 10:23:10 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf11112d)
Sep 28 10:23:10 ubuntu-1604 dhclient[600]: DHCPREQUEST of 192.168.11.25 on ens2 to 192.168.11.3 port 67 (xid=0x3415f07)
Sep 28 10:23:11 ubuntu-1604 dhclient[600]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 10:23:11 ubuntu-1604 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 10:23:11 ubuntu-1604 ntp[18879]:  * Stopping NTP server ntpd
Sep 28 10:23:11 ubuntu-1604 ntp[18879]:    ...done.
Sep 28 10:23:11 ubuntu-1604 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 10:23:11 ubuntu-1604 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 10:23:11 ubuntu-1604 ntp[18890]:  * Starting NTP server ntpd
Sep 28 10:23:11 ubuntu-1604 ntpd[18897]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 10:23:11 ubuntu-1604 ntpd[18897]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -c /var/lib/ntp/ntp.conf.dhcp -u 108:112
Sep 28 10:23:11 ubuntu-1604 ntp[18890]:    ...done.
Sep 28 10:23:11 ubuntu-1604 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 10:23:11 ubuntu-1604 ntpd[18900]: proto: precision = 0.042 usec (-24)
Sep 28 10:23:11 ubuntu-1604 ntpd[18900]: switching logging to file /var/log/ntp.log
Sep 28 10:23:11 ubuntu-1604 dhclient[600]: bound to 192.168.11.25 -- renewal in 301 seconds.
Sep 28 10:23:11 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf11112d)
Sep 28 10:23:19 ubuntu-1604 dhclient[627]: message repeated 8 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf11112d)]
Sep 28 10:23:20 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:23:20 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:23:20 ubuntu-1604 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 10:23:20 ubuntu-1604 ntp[18952]:  * Stopping NTP server ntpd
Sep 28 10:23:20 ubuntu-1604 ntp[18952]:    ...done.
Sep 28 10:23:20 ubuntu-1604 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 10:23:20 ubuntu-1604 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 10:23:20 ubuntu-1604 ntp[18963]:  * Starting NTP server ntpd
Sep 28 10:23:20 ubuntu-1604 ntpd[18970]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 10:23:20 ubuntu-1604 ntpd[18970]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 10:23:20 ubuntu-1604 ntp[18963]:    ...done.
Sep 28 10:23:20 ubuntu-1604 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 10:23:20 ubuntu-1604 ntpd[18973]: proto: precision = 0.043 usec (-24)
Sep 28 10:23:20 ubuntu-1604 ntpd[18973]: switching logging to file /var/log/ntp.log
Sep 28 10:23:41 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5bfb790a)
Sep 28 10:23:51 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5bfb790a)]
Sep 28 10:23:52 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:23:52 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:24:10 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe57d1f62)
Sep 28 10:24:20 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe57d1f62)]
Sep 28 10:24:21 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:24:21 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:24:37 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb44f6843)
Sep 28 10:24:47 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb44f6843)]
Sep 28 10:24:48 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:24:48 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:25:03 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa2cc7d6a)
Sep 28 10:25:13 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa2cc7d6a)]
Sep 28 10:25:14 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:25:14 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:25:29 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdadfbf38)
Sep 28 10:25:39 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdadfbf38)]
Sep 28 10:25:40 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:25:40 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:25:53 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb96ee40e)
Sep 28 10:26:03 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb96ee40e)]
Sep 28 10:26:04 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:26:04 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:26:25 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7a021d0d)
Sep 28 10:26:35 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7a021d0d)]
Sep 28 10:26:36 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:26:36 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:26:57 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc6b9057a)
Sep 28 10:27:07 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc6b9057a)]
Sep 28 10:27:08 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:27:08 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:27:29 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x95bc720b)
Sep 28 10:27:39 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x95bc720b)]
Sep 28 10:27:40 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:27:40 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:27:54 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x65dca737)
Sep 28 10:28:04 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x65dca737)]
Sep 28 10:28:05 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:28:05 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:28:12 ubuntu-1604 dhclient[600]: DHCPREQUEST of 192.168.11.25 on ens2 to 192.168.11.3 port 67 (xid=0x3415f07)
Sep 28 10:28:12 ubuntu-1604 dhclient[600]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 10:28:12 ubuntu-1604 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 10:28:12 ubuntu-1604 ntp[19082]:  * Stopping NTP server ntpd
Sep 28 10:28:12 ubuntu-1604 ntp[19082]:    ...done.
Sep 28 10:28:12 ubuntu-1604 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 10:28:12 ubuntu-1604 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 10:28:12 ubuntu-1604 ntp[19093]:  * Starting NTP server ntpd
Sep 28 10:28:12 ubuntu-1604 ntpd[19100]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 10:28:12 ubuntu-1604 ntpd[19100]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -c /var/lib/ntp/ntp.conf.dhcp -u 108:112
Sep 28 10:28:12 ubuntu-1604 ntp[19093]:    ...done.
Sep 28 10:28:12 ubuntu-1604 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 10:28:12 ubuntu-1604 ntpd[19103]: proto: precision = 0.042 usec (-24)
Sep 28 10:28:12 ubuntu-1604 ntpd[19103]: switching logging to file /var/log/ntp.log
Sep 28 10:28:12 ubuntu-1604 dhclient[600]: bound to 192.168.11.25 -- renewal in 299 seconds.
Sep 28 10:28:15 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9a81c433)
Sep 28 10:28:25 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9a81c433)]
Sep 28 10:28:26 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:28:26 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:28:26 ubuntu-1604 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 10:28:26 ubuntu-1604 ntp[19156]:  * Stopping NTP server ntpd
Sep 28 10:28:26 ubuntu-1604 ntp[19156]:    ...done.
Sep 28 10:28:26 ubuntu-1604 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 10:28:26 ubuntu-1604 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 10:28:26 ubuntu-1604 ntp[19167]:  * Starting NTP server ntpd
Sep 28 10:28:26 ubuntu-1604 ntpd[19174]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 10:28:26 ubuntu-1604 ntpd[19174]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 10:28:26 ubuntu-1604 ntp[19167]:    ...done.
Sep 28 10:28:26 ubuntu-1604 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 10:28:26 ubuntu-1604 ntpd[19177]: proto: precision = 0.044 usec (-24)
Sep 28 10:28:26 ubuntu-1604 ntpd[19177]: switching logging to file /var/log/ntp.log
Sep 28 10:28:43 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x120b402d)
Sep 28 10:28:53 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x120b402d)]
Sep 28 10:28:54 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:28:54 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:29:04 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe50c157a)
Sep 28 10:29:14 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe50c157a)]
Sep 28 10:29:15 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:29:15 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:29:35 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc0be7d0f)
Sep 28 10:29:45 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc0be7d0f)]
Sep 28 10:29:46 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:29:46 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:29:57 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd57e897e)
Sep 28 10:30:07 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd57e897e)]
Sep 28 10:30:08 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:30:08 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:30:28 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x20cf1b77)
Sep 28 10:30:38 ubuntu-1604 dhclient[627]: message repeated 9 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x20cf1b77)]
Sep 28 10:30:39 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:30:39 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:30:47 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfa003724)
Sep 28 10:30:57 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfa003724)]
Sep 28 10:30:58 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:30:58 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:31:14 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6e057936)
Sep 28 10:31:24 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6e057936)]
Sep 28 10:31:25 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:31:25 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:31:44 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x62ec9075)
Sep 28 10:31:54 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x62ec9075)]
Sep 28 10:31:55 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:31:55 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:32:09 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x182384e)
Sep 28 10:32:19 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x182384e)]
Sep 28 10:32:20 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:32:20 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:32:37 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcb762739)
Sep 28 10:32:47 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcb762739)]
Sep 28 10:32:48 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:32:48 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:32:59 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x11f3255f)
Sep 28 10:33:09 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x11f3255f)]
Sep 28 10:33:10 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:33:10 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:33:11 ubuntu-1604 dhclient[600]: DHCPREQUEST of 192.168.11.25 on ens2 to 192.168.11.3 port 67 (xid=0x3415f07)
Sep 28 10:33:11 ubuntu-1604 dhclient[600]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 10:33:11 ubuntu-1604 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 10:33:11 ubuntu-1604 ntp[19292]:  * Stopping NTP server ntpd
Sep 28 10:33:11 ubuntu-1604 ntp[19292]:    ...done.
Sep 28 10:33:11 ubuntu-1604 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 10:33:11 ubuntu-1604 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 10:33:11 ubuntu-1604 ntp[19303]:  * Starting NTP server ntpd
Sep 28 10:33:11 ubuntu-1604 ntpd[19310]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 10:33:11 ubuntu-1604 ntpd[19310]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -c /var/lib/ntp/ntp.conf.dhcp -u 108:112
Sep 28 10:33:11 ubuntu-1604 ntp[19303]:    ...done.
Sep 28 10:33:11 ubuntu-1604 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 10:33:11 ubuntu-1604 ntpd[19313]: proto: precision = 0.044 usec (-24)
Sep 28 10:33:11 ubuntu-1604 ntpd[19313]: switching logging to file /var/log/ntp.log
Sep 28 10:33:11 ubuntu-1604 dhclient[600]: bound to 192.168.11.25 -- renewal in 297 seconds.
Sep 28 10:33:18 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdc99f818)
Sep 28 10:33:28 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdc99f818)]
Sep 28 10:33:29 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:33:29 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:33:29 ubuntu-1604 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 10:33:29 ubuntu-1604 ntp[19365]:  * Stopping NTP server ntpd
Sep 28 10:33:29 ubuntu-1604 ntp[19365]:    ...done.
Sep 28 10:33:29 ubuntu-1604 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 10:33:29 ubuntu-1604 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 10:33:30 ubuntu-1604 ntp[19376]:  * Starting NTP server ntpd
Sep 28 10:33:30 ubuntu-1604 ntpd[19383]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 10:33:30 ubuntu-1604 ntpd[19383]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 10:33:30 ubuntu-1604 ntp[19376]:    ...done.
Sep 28 10:33:30 ubuntu-1604 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 10:33:30 ubuntu-1604 ntpd[19386]: proto: precision = 0.042 usec (-24)
Sep 28 10:33:30 ubuntu-1604 ntpd[19386]: switching logging to file /var/log/ntp.log
Sep 28 10:33:45 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xbce25472)
Sep 28 10:33:55 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xbce25472)]
Sep 28 10:33:56 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:33:56 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:34:10 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8d4d0847)
Sep 28 10:34:20 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8d4d0847)]
Sep 28 10:34:21 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:34:21 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:34:34 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xbbd06a02)
Sep 28 10:34:44 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xbbd06a02)]
Sep 28 10:34:45 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:34:45 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:34:55 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x44d03b2b)
Sep 28 10:35:05 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x44d03b2b)]
Sep 28 10:35:06 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:35:06 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:35:28 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3364c958)
Sep 28 10:35:38 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3364c958)]
Sep 28 10:35:39 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:35:39 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:35:51 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x73acc114)
Sep 28 10:36:01 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x73acc114)]
Sep 28 10:36:02 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:36:02 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:36:10 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfde35a61)
Sep 28 10:36:20 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfde35a61)]
Sep 28 10:36:21 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:36:21 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:36:35 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x804d0e18)
Sep 28 10:36:45 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x804d0e18)]
Sep 28 10:36:46 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:36:46 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:36:58 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6d2e2b2e)
Sep 28 10:37:08 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6d2e2b2e)]
Sep 28 10:37:09 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:37:09 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:37:31 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8a717064)
Sep 28 10:37:41 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8a717064)]
Sep 28 10:37:42 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:37:42 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:37:53 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8ba5e52a)
Sep 28 10:38:03 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8ba5e52a)]
Sep 28 10:38:04 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:38:04 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:38:08 ubuntu-1604 dhclient[600]: DHCPREQUEST of 192.168.11.25 on ens2 to 192.168.11.3 port 67 (xid=0x3415f07)
Sep 28 10:38:08 ubuntu-1604 dhclient[600]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 10:38:08 ubuntu-1604 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 10:38:08 ubuntu-1604 ntp[19500]:  * Stopping NTP server ntpd
Sep 28 10:38:08 ubuntu-1604 ntp[19500]:    ...done.
Sep 28 10:38:08 ubuntu-1604 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 10:38:08 ubuntu-1604 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 10:38:08 ubuntu-1604 ntp[19511]:  * Starting NTP server ntpd
Sep 28 10:38:08 ubuntu-1604 ntpd[19518]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 10:38:08 ubuntu-1604 ntpd[19518]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -c /var/lib/ntp/ntp.conf.dhcp -u 108:112
Sep 28 10:38:08 ubuntu-1604 ntp[19511]:    ...done.
Sep 28 10:38:08 ubuntu-1604 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 10:38:08 ubuntu-1604 ntpd[19521]: proto: precision = 0.042 usec (-24)
Sep 28 10:38:08 ubuntu-1604 ntpd[19521]: switching logging to file /var/log/ntp.log
Sep 28 10:38:08 ubuntu-1604 dhclient[600]: bound to 192.168.11.25 -- renewal in 275 seconds.
Sep 28 10:38:25 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb7b79772)
Sep 28 10:38:35 ubuntu-1604 dhclient[627]: message repeated 9 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb7b79772)]
Sep 28 10:38:36 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:38:36 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:38:36 ubuntu-1604 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 10:38:36 ubuntu-1604 ntp[19574]:  * Stopping NTP server ntpd
Sep 28 10:38:36 ubuntu-1604 ntp[19574]:    ...done.
Sep 28 10:38:36 ubuntu-1604 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 10:38:36 ubuntu-1604 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 10:38:36 ubuntu-1604 ntp[19585]:  * Starting NTP server ntpd
Sep 28 10:38:36 ubuntu-1604 ntpd[19592]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 10:38:36 ubuntu-1604 ntpd[19592]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 10:38:36 ubuntu-1604 ntp[19585]:    ...done.
Sep 28 10:38:36 ubuntu-1604 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 10:38:36 ubuntu-1604 ntpd[19595]: proto: precision = 0.043 usec (-24)
Sep 28 10:38:36 ubuntu-1604 ntpd[19595]: switching logging to file /var/log/ntp.log
Sep 28 10:38:44 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9abbc5a)
Sep 28 10:38:54 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9abbc5a)]
Sep 28 10:38:55 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:38:55 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:39:11 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x950a554b)
Sep 28 10:39:21 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x950a554b)]
Sep 28 10:39:22 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:39:22 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:39:40 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x43cf4c58)
Sep 28 10:39:50 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x43cf4c58)]
Sep 28 10:39:51 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:39:51 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:40:11 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x83a4cb56)
Sep 28 10:40:21 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x83a4cb56)]
Sep 28 10:40:22 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:40:22 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:40:41 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd701100a)
Sep 28 10:40:51 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd701100a)]
Sep 28 10:40:52 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:40:52 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:41:06 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2da00073)
Sep 28 10:41:16 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2da00073)]
Sep 28 10:41:17 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:41:17 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:41:33 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa7ffcc62)
Sep 28 10:41:43 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa7ffcc62)]
Sep 28 10:41:44 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:41:44 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:42:05 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x16aacc53)
Sep 28 10:42:15 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x16aacc53)]
Sep 28 10:42:16 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:42:16 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:42:28 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x60006466)
Sep 28 10:42:38 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x60006466)]
Sep 28 10:42:40 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:42:40 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:42:43 ubuntu-1604 dhclient[600]: DHCPREQUEST of 192.168.11.25 on ens2 to 192.168.11.3 port 67 (xid=0x3415f07)
Sep 28 10:42:43 ubuntu-1604 dhclient[600]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 10:42:44 ubuntu-1604 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 10:42:44 ubuntu-1604 ntp[19700]:  * Stopping NTP server ntpd
Sep 28 10:42:44 ubuntu-1604 ntp[19700]:    ...done.
Sep 28 10:42:44 ubuntu-1604 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 10:42:44 ubuntu-1604 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 10:42:44 ubuntu-1604 ntp[19711]:  * Starting NTP server ntpd
Sep 28 10:42:44 ubuntu-1604 ntpd[19718]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 10:42:44 ubuntu-1604 ntpd[19718]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -c /var/lib/ntp/ntp.conf.dhcp -u 108:112
Sep 28 10:42:44 ubuntu-1604 ntp[19711]:    ...done.
Sep 28 10:42:44 ubuntu-1604 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 10:42:44 ubuntu-1604 ntpd[19721]: proto: precision = 0.042 usec (-24)
Sep 28 10:42:44 ubuntu-1604 ntpd[19721]: switching logging to file /var/log/ntp.log
Sep 28 10:42:44 ubuntu-1604 dhclient[600]: bound to 192.168.11.25 -- renewal in 271 seconds.
Sep 28 10:42:52 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x265d254b)
Sep 28 10:43:02 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x265d254b)]
Sep 28 10:43:03 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:43:03 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:43:03 ubuntu-1604 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 10:43:03 ubuntu-1604 ntp[19774]:  * Stopping NTP server ntpd
Sep 28 10:43:03 ubuntu-1604 ntp[19774]:    ...done.
Sep 28 10:43:03 ubuntu-1604 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 10:43:03 ubuntu-1604 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 10:43:03 ubuntu-1604 ntp[19785]:  * Starting NTP server ntpd
Sep 28 10:43:03 ubuntu-1604 ntpd[19792]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 10:43:03 ubuntu-1604 ntpd[19792]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 10:43:03 ubuntu-1604 ntp[19785]:    ...done.
Sep 28 10:43:03 ubuntu-1604 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 10:43:03 ubuntu-1604 ntpd[19795]: proto: precision = 0.043 usec (-24)
Sep 28 10:43:03 ubuntu-1604 ntpd[19795]: switching logging to file /var/log/ntp.log
Sep 28 10:43:17 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x56f21839)
Sep 28 10:43:27 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x56f21839)]
Sep 28 10:43:28 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:43:28 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:43:49 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcd558f3a)
Sep 28 10:43:59 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcd558f3a)]
Sep 28 10:44:00 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:44:00 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:44:10 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x888f654e)
Sep 28 10:44:20 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x888f654e)]
Sep 28 10:44:21 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:44:21 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:44:38 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x63fd451)
Sep 28 10:44:48 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x63fd451)]
Sep 28 10:44:49 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:44:49 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:44:57 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd7ce032)
Sep 28 10:45:07 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd7ce032)]
Sep 28 10:45:08 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:45:08 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:45:16 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc44a6749)
Sep 28 10:45:26 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc44a6749)]
Sep 28 10:45:27 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:45:27 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:45:40 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8a05952a)
Sep 28 10:45:50 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8a05952a)]
Sep 28 10:45:51 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:45:51 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:46:04 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7d474941)
Sep 28 10:46:14 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7d474941)]
Sep 28 10:46:15 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:46:15 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:46:25 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdc314576)
Sep 28 10:46:35 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdc314576)]
Sep 28 10:46:36 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:46:36 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:46:52 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc192149)
Sep 28 10:47:02 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc192149)]
Sep 28 10:47:03 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:47:03 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:47:15 ubuntu-1604 dhclient[600]: DHCPREQUEST of 192.168.11.25 on ens2 to 192.168.11.3 port 67 (xid=0x3415f07)
Sep 28 10:47:15 ubuntu-1604 dhclient[600]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 10:47:15 ubuntu-1604 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 10:47:15 ubuntu-1604 ntp[19904]:  * Stopping NTP server ntpd
Sep 28 10:47:15 ubuntu-1604 ntp[19904]:    ...done.
Sep 28 10:47:15 ubuntu-1604 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 10:47:15 ubuntu-1604 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 10:47:15 ubuntu-1604 ntp[19915]:  * Starting NTP server ntpd
Sep 28 10:47:15 ubuntu-1604 ntpd[19922]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 10:47:15 ubuntu-1604 ntpd[19922]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -c /var/lib/ntp/ntp.conf.dhcp -u 108:112
Sep 28 10:47:15 ubuntu-1604 ntp[19915]:    ...done.
Sep 28 10:47:15 ubuntu-1604 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 10:47:15 ubuntu-1604 ntpd[19925]: proto: precision = 0.043 usec (-24)
Sep 28 10:47:15 ubuntu-1604 ntpd[19925]: switching logging to file /var/log/ntp.log
Sep 28 10:47:15 ubuntu-1604 dhclient[600]: bound to 192.168.11.25 -- renewal in 261 seconds.
Sep 28 10:47:21 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9aef4371)
Sep 28 10:47:31 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9aef4371)]
Sep 28 10:47:32 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:47:32 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:47:32 ubuntu-1604 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 10:47:32 ubuntu-1604 ntp[19978]:  * Stopping NTP server ntpd
Sep 28 10:47:32 ubuntu-1604 ntp[19978]:    ...done.
Sep 28 10:47:32 ubuntu-1604 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 10:47:32 ubuntu-1604 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 10:47:32 ubuntu-1604 ntp[19989]:  * Starting NTP server ntpd
Sep 28 10:47:32 ubuntu-1604 ntpd[19996]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 10:47:32 ubuntu-1604 ntpd[19996]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 10:47:32 ubuntu-1604 ntp[19989]:    ...done.
Sep 28 10:47:32 ubuntu-1604 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 10:47:32 ubuntu-1604 ntpd[19999]: proto: precision = 0.043 usec (-24)
Sep 28 10:47:32 ubuntu-1604 ntpd[19999]: switching logging to file /var/log/ntp.log
Sep 28 10:47:54 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7db58052)
Sep 28 10:48:04 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7db58052)]
Sep 28 10:48:05 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:48:05 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:48:17 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xda5e472e)
Sep 28 10:48:27 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xda5e472e)]
Sep 28 10:48:28 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:48:28 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:48:41 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa6e09c7b)
Sep 28 10:48:44 ubuntu-1604 dhclient[627]: message repeated 3 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa6e09c7b)]
Sep 28 10:48:44 ubuntu-1604 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command state.sls with jid 20170928104844753706
Sep 28 10:48:44 ubuntu-1604 salt-minion[14967]: [INFO    ] Starting a new job with PID 20015
Sep 28 10:48:45 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa6e09c7b)
Sep 28 10:48:46 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa6e09c7b)
Sep 28 10:48:47 ubuntu-1604 salt-minion[14967]: [INFO    ] Loading fresh modules for state activity
Sep 28 10:48:47 ubuntu-1604 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'memcached/init.sls'
Sep 28 10:48:47 ubuntu-1604 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'memcached/server.sls'
Sep 28 10:48:47 ubuntu-1604 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'memcached/map.jinja'
Sep 28 10:48:47 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa6e09c7b)
Sep 28 10:48:47 ubuntu-1604 salt-minion[14967]: [INFO    ] Running state [python-memcache] at time 10:48:47.760689
Sep 28 10:48:47 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing state pkg.installed for python-memcache
Sep 28 10:48:47 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 10:48:48 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing command ['apt-get', '-q', 'update'] in directory '/root'
Sep 28 10:48:48 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa6e09c7b)
Sep 28 10:48:50 ubuntu-1604 dhclient[627]: message repeated 2 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa6e09c7b)]
Sep 28 10:48:50 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing command ['systemd-run', '--scope', 'apt-get', '-q', '-y', '-o', 'DPkg::Options::=--force-confold', '-o', 'DPkg::Options::=--force-confdef', 'install', 'python-memcache'] in directory '/root'
Sep 28 10:48:50 ubuntu-1604 systemd[1]: Started /usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold -o DPkg::Options::=--force-confdef install python-memcache.
Sep 28 10:48:51 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa6e09c7b)
Sep 28 10:48:52 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:48:52 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:48:53 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 10:48:53 ubuntu-1604 salt-minion[14967]: [INFO    ] Made the following changes:
Sep 28 10:48:53 ubuntu-1604 salt-minion[14967]: 'python-memcache' changed from 'absent' to '1.57-1'
Sep 28 10:48:53 ubuntu-1604 salt-minion[14967]: [INFO    ] Loading fresh modules for state activity
Sep 28 10:48:53 ubuntu-1604 salt-minion[14967]: [INFO    ] Completed state [python-memcache] at time 10:48:53.337391 duration_in_ms=5576.701
Sep 28 10:48:53 ubuntu-1604 salt-minion[14967]: [INFO    ] Running state [memcached] at time 10:48:53.343890
Sep 28 10:48:53 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing state pkg.installed for memcached
Sep 28 10:48:53 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing command ['systemd-run', '--scope', 'apt-get', '-q', '-y', '-o', 'DPkg::Options::=--force-confold', '-o', 'DPkg::Options::=--force-confdef', 'install', 'memcached'] in directory '/root'
Sep 28 10:48:53 ubuntu-1604 systemd[1]: Started /usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold -o DPkg::Options::=--force-confdef install memcached.
Sep 28 10:48:54 ubuntu-1604 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928104854846002
Sep 28 10:48:54 ubuntu-1604 salt-minion[14967]: [INFO    ] Starting a new job with PID 20527
Sep 28 10:48:54 ubuntu-1604 salt-minion[14967]: [INFO    ] Returning information for job: 20170928104854846002
Sep 28 10:48:55 ubuntu-1604 systemd[1]: Reloading.
Sep 28 10:48:57 ubuntu-1604 systemd[1]: Reloading.
Sep 28 10:48:57 ubuntu-1604 systemd[1]: message repeated 2 times: [ Reloading.]
Sep 28 10:48:57 ubuntu-1604 systemd[1]: Started memcached daemon.
Sep 28 10:48:58 ubuntu-1604 systemd[1]: Reloading.
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]: [INFO    ] Made the following changes:
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]: 'memcached' changed from 'absent' to '1.4.25-2ubuntu1.2'
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]: [INFO    ] Loading fresh modules for state activity
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]: [INFO    ] Completed state [memcached] at time 10:48:59.044824 duration_in_ms=5700.934
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]: [INFO    ] Running state [/etc/memcached.conf] at time 10:48:59.099886
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing state file.managed for /etc/memcached.conf
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'memcached/files/memcached.conf'
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'memcached/map.jinja'
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]: [INFO    ] File changed:
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]: ---
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]: +++
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]: @@ -1,11 +1,10 @@
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]: +
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]:  # memcached default config file
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]:  # 2003 - Jay Bonci <jaybonci@debian.org>
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]: -# This configuration file is read by the start-memcached script provided as
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]: -# part of the Debian GNU/Linux distribution.
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]: +# This configuration file is read by the start-memcached script provided as part of the Debian GNU/Linux distribution.
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]:  
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]:  # Run memcached as a daemon. This command is implied, and is not needed for the
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]: -# daemon to run. See the README.Debian that comes with this package for more
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]: -# information.
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]: +# daemon to run. See the README.Debian that comes with this package for more information.
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]:  -d
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]:  
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]:  # Log memcached's output to /var/log/memcached
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]: @@ -18,13 +17,13 @@
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]:  # -vv
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]:  
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]:  # Start with a cap of 64 megs of memory. It's reasonable, and the daemon default
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]: -# Note that the daemon will grow to this size, but does not start out holding this much
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]: -# memory
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]: +# Note that the daemon will grow to this size, but does not start out holding this much memory
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]:  -m 64
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]:  
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]:  # Default connection port is 11211
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]:  -p 11211
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]:  
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]: +-U 11211
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]:  # Run the daemon as root. The start-memcached will default to running as root if no
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]:  # -u command is present in this config file
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]:  -u memcache
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]: @@ -32,10 +31,12 @@
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]:  # Specify which IP address to listen on. The default is to listen on all IP addresses
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]:  # This parameter is one of the only security measures that memcached has, so make sure
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]:  # it's listening on a firewalled interface.
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]: --l 127.0.0.1
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]: +-l 0.0.0.0
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]:  
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]:  # Limit the number of simultaneous incoming connections. The daemon default is 1024
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]:  # -c 1024
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]: +# Mirantis
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]: +-c 8192
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]:  
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]:  # Lock down all paged memory. Consult with the README and homepage before you do this
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]:  # -k
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]: @@ -45,3 +46,6 @@
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]:  
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]:  # Maximize core file limit
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]:  # -r
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]: +
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]: +# Number of threads to use to process incoming requests.
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]: +-t 1
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]: [INFO    ] Completed state [/etc/memcached.conf] at time 10:48:59.164509 duration_in_ms=64.624
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]: [INFO    ] Running state [memcached] at time 10:48:59.228109
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing state service.running for memcached
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'status', 'memcached.service', '-n', '0'] in directory '/root'
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-active', 'memcached.service'] in directory '/root'
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-enabled', 'memcached.service'] in directory '/root'
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]: [INFO    ] The service memcached is already running
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]: [INFO    ] Completed state [memcached] at time 10:48:59.258280 duration_in_ms=30.171
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]: [INFO    ] Running state [memcached] at time 10:48:59.258622
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing state service.mod_watch for memcached
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-active', 'memcached.service'] in directory '/root'
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-enabled', 'memcached.service'] in directory '/root'
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing command ['systemd-run', '--scope', 'systemctl', 'restart', 'memcached.service'] in directory '/root'
Sep 28 10:48:59 ubuntu-1604 systemd[1]: Started /bin/systemctl restart memcached.service.
Sep 28 10:48:59 ubuntu-1604 systemd[1]: Stopping memcached daemon...
Sep 28 10:48:59 ubuntu-1604 systemd-memcached-wrapper[20640]: Signal handled: Terminated.
Sep 28 10:48:59 ubuntu-1604 systemd[1]: Stopped memcached daemon.
Sep 28 10:48:59 ubuntu-1604 systemd[1]: Started memcached daemon.
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]: [INFO    ] {'memcached': True}
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]: [INFO    ] Completed state [memcached] at time 10:48:59.316640 duration_in_ms=58.017
Sep 28 10:48:59 ubuntu-1604 salt-minion[14967]: [INFO    ] Returning information for job: 20170928104844753706
Sep 28 10:49:05 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xccb5dd7b)
Sep 28 10:49:15 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xccb5dd7b)]
Sep 28 10:49:16 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:49:16 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:49:33 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7bd1dd28)
Sep 28 10:49:43 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7bd1dd28)]
Sep 28 10:49:44 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:49:44 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:50:05 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8a44ef26)
Sep 28 10:50:15 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8a44ef26)]
Sep 28 10:50:16 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:50:16 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:50:31 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x68632667)
Sep 28 10:50:41 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x68632667)]
Sep 28 10:50:42 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:50:42 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:50:59 ubuntu-1604 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command state.sls with jid 20170928105059226123
Sep 28 10:50:59 ubuntu-1604 salt-minion[14967]: [INFO    ] Starting a new job with PID 20742
Sep 28 10:51:01 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x30b2df46)
Sep 28 10:51:01 ubuntu-1604 salt-minion[14967]: [INFO    ] Loading fresh modules for state activity
Sep 28 10:51:01 ubuntu-1604 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'haproxy/init.sls'
Sep 28 10:51:01 ubuntu-1604 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'haproxy/proxy.sls'
Sep 28 10:51:01 ubuntu-1604 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'haproxy/map.jinja'
Sep 28 10:51:01 ubuntu-1604 salt-minion[14967]: [INFO    ] Running state [haproxy] at time 10:51:01.584341
Sep 28 10:51:01 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing state pkg.installed for haproxy
Sep 28 10:51:01 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 10:51:02 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing command ['apt-get', '-q', 'update'] in directory '/root'
Sep 28 10:51:02 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x30b2df46)
Sep 28 10:51:09 ubuntu-1604 dhclient[627]: message repeated 7 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x30b2df46)]
Sep 28 10:51:09 ubuntu-1604 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928105109313474
Sep 28 10:51:09 ubuntu-1604 salt-minion[14967]: [INFO    ] Starting a new job with PID 21025
Sep 28 10:51:09 ubuntu-1604 salt-minion[14967]: [INFO    ] Returning information for job: 20170928105109313474
Sep 28 10:51:10 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x30b2df46)
Sep 28 10:51:11 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x30b2df46)
Sep 28 10:51:12 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:51:12 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:51:19 ubuntu-1604 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928105119406826
Sep 28 10:51:19 ubuntu-1604 salt-minion[14967]: [INFO    ] Starting a new job with PID 21035
Sep 28 10:51:19 ubuntu-1604 salt-minion[14967]: [INFO    ] Returning information for job: 20170928105119406826
Sep 28 10:51:25 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xaa01c333)
Sep 28 10:51:28 ubuntu-1604 dhclient[627]: message repeated 3 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xaa01c333)]
Sep 28 10:51:29 ubuntu-1604 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928105129537835
Sep 28 10:51:29 ubuntu-1604 salt-minion[14967]: [INFO    ] Starting a new job with PID 21040
Sep 28 10:51:29 ubuntu-1604 salt-minion[14967]: [INFO    ] Returning information for job: 20170928105129537835
Sep 28 10:51:29 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xaa01c333)
Sep 28 10:51:35 ubuntu-1604 dhclient[627]: message repeated 6 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xaa01c333)]
Sep 28 10:51:36 ubuntu-1604 dhclient[600]: DHCPREQUEST of 192.168.11.25 on ens2 to 192.168.11.3 port 67 (xid=0x3415f07)
Sep 28 10:51:36 ubuntu-1604 dhclient[600]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 10:51:36 ubuntu-1604 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 10:51:36 ubuntu-1604 ntp[21098]:  * Stopping NTP server ntpd
Sep 28 10:51:36 ubuntu-1604 ntp[21098]:    ...done.
Sep 28 10:51:36 ubuntu-1604 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 10:51:36 ubuntu-1604 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 10:51:36 ubuntu-1604 ntp[21109]:  * Starting NTP server ntpd
Sep 28 10:51:36 ubuntu-1604 ntpd[21116]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 10:51:36 ubuntu-1604 ntpd[21116]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -c /var/lib/ntp/ntp.conf.dhcp -u 108:112
Sep 28 10:51:36 ubuntu-1604 ntp[21109]:    ...done.
Sep 28 10:51:36 ubuntu-1604 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 10:51:36 ubuntu-1604 ntpd[21119]: proto: precision = 0.042 usec (-24)
Sep 28 10:51:36 ubuntu-1604 ntpd[21119]: switching logging to file /var/log/ntp.log
Sep 28 10:51:36 ubuntu-1604 dhclient[600]: bound to 192.168.11.25 -- renewal in 253 seconds.
Sep 28 10:51:36 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:51:36 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:51:36 ubuntu-1604 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 10:51:36 ubuntu-1604 ntp[21171]:  * Stopping NTP server ntpd
Sep 28 10:51:36 ubuntu-1604 ntp[21171]:    ...done.
Sep 28 10:51:36 ubuntu-1604 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 10:51:36 ubuntu-1604 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 10:51:36 ubuntu-1604 ntp[21182]:  * Starting NTP server ntpd
Sep 28 10:51:36 ubuntu-1604 ntpd[21189]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 10:51:36 ubuntu-1604 ntpd[21189]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 10:51:36 ubuntu-1604 ntp[21182]:    ...done.
Sep 28 10:51:36 ubuntu-1604 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 10:51:36 ubuntu-1604 ntpd[21192]: proto: precision = 0.042 usec (-24)
Sep 28 10:51:36 ubuntu-1604 ntpd[21192]: switching logging to file /var/log/ntp.log
Sep 28 10:51:39 ubuntu-1604 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928105139556167
Sep 28 10:51:39 ubuntu-1604 salt-minion[14967]: [INFO    ] Starting a new job with PID 21198
Sep 28 10:51:39 ubuntu-1604 salt-minion[14967]: [INFO    ] Returning information for job: 20170928105139556167
Sep 28 10:51:49 ubuntu-1604 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928105149773478
Sep 28 10:51:49 ubuntu-1604 salt-minion[14967]: [INFO    ] Starting a new job with PID 21203
Sep 28 10:51:49 ubuntu-1604 salt-minion[14967]: [INFO    ] Returning information for job: 20170928105149773478
Sep 28 10:51:56 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x47c42f2a)
Sep 28 10:51:59 ubuntu-1604 dhclient[627]: message repeated 3 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x47c42f2a)]
Sep 28 10:51:59 ubuntu-1604 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928105159834173
Sep 28 10:51:59 ubuntu-1604 salt-minion[14967]: [INFO    ] Starting a new job with PID 21208
Sep 28 10:51:59 ubuntu-1604 salt-minion[14967]: [INFO    ] Returning information for job: 20170928105159834173
Sep 28 10:52:00 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x47c42f2a)
Sep 28 10:52:06 ubuntu-1604 dhclient[627]: message repeated 6 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x47c42f2a)]
Sep 28 10:52:07 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:52:07 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:52:10 ubuntu-1604 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928105210058480
Sep 28 10:52:10 ubuntu-1604 salt-minion[14967]: [INFO    ] Starting a new job with PID 21218
Sep 28 10:52:10 ubuntu-1604 salt-minion[14967]: [INFO    ] Returning information for job: 20170928105210058480
Sep 28 10:52:16 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe5b55f20)
Sep 28 10:52:19 ubuntu-1604 dhclient[627]: message repeated 3 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe5b55f20)]
Sep 28 10:52:20 ubuntu-1604 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928105220286647
Sep 28 10:52:20 ubuntu-1604 salt-minion[14967]: [INFO    ] Starting a new job with PID 21223
Sep 28 10:52:20 ubuntu-1604 salt-minion[14967]: [INFO    ] Returning information for job: 20170928105220286647
Sep 28 10:52:20 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe5b55f20)
Sep 28 10:52:26 ubuntu-1604 dhclient[627]: message repeated 6 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe5b55f20)]
Sep 28 10:52:27 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:52:27 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:52:30 ubuntu-1604 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928105230515986
Sep 28 10:52:30 ubuntu-1604 salt-minion[14967]: [INFO    ] Starting a new job with PID 21233
Sep 28 10:52:30 ubuntu-1604 salt-minion[14967]: [INFO    ] Returning information for job: 20170928105230515986
Sep 28 10:52:40 ubuntu-1604 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928105240742160
Sep 28 10:52:40 ubuntu-1604 salt-minion[14967]: [INFO    ] Starting a new job with PID 21238
Sep 28 10:52:40 ubuntu-1604 salt-minion[14967]: [INFO    ] Returning information for job: 20170928105240742160
Sep 28 10:52:44 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x748e4915)
Sep 28 10:52:49 ubuntu-1604 dhclient[627]: message repeated 5 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x748e4915)]
Sep 28 10:52:50 ubuntu-1604 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928105250789593
Sep 28 10:52:50 ubuntu-1604 salt-minion[14967]: [INFO    ] Starting a new job with PID 21243
Sep 28 10:52:50 ubuntu-1604 salt-minion[14967]: [INFO    ] Returning information for job: 20170928105250789593
Sep 28 10:52:50 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x748e4915)
Sep 28 10:52:54 ubuntu-1604 dhclient[627]: message repeated 4 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x748e4915)]
Sep 28 10:52:55 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:52:55 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:53:00 ubuntu-1604 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928105300834311
Sep 28 10:53:00 ubuntu-1604 salt-minion[14967]: [INFO    ] Starting a new job with PID 21253
Sep 28 10:53:00 ubuntu-1604 salt-minion[14967]: [INFO    ] Returning information for job: 20170928105300834311
Sep 28 10:53:03 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing command ['systemd-run', '--scope', 'apt-get', '-q', '-y', '-o', 'DPkg::Options::=--force-confold', '-o', 'DPkg::Options::=--force-confdef', 'install', 'haproxy'] in directory '/root'
Sep 28 10:53:03 ubuntu-1604 systemd[1]: Started /usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold -o DPkg::Options::=--force-confdef install haproxy.
Sep 28 10:53:07 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x44003115)
Sep 28 10:53:07 ubuntu-1604 systemd[1]: Reloading.
Sep 28 10:53:08 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x44003115)
Sep 28 10:53:09 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x44003115)
Sep 28 10:53:10 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x44003115)
Sep 28 10:53:10 ubuntu-1604 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928105310862199
Sep 28 10:53:10 ubuntu-1604 salt-minion[14967]: [INFO    ] Starting a new job with PID 21458
Sep 28 10:53:10 ubuntu-1604 salt-minion[14967]: [INFO    ] Returning information for job: 20170928105310862199
Sep 28 10:53:11 ubuntu-1604 systemd[1]: Reloading.
Sep 28 10:53:11 ubuntu-1604 systemd[1]: message repeated 2 times: [ Reloading.]
Sep 28 10:53:11 ubuntu-1604 systemd[1]: Starting HAProxy Load Balancer...
Sep 28 10:53:11 ubuntu-1604 systemd[1]: Started HAProxy Load Balancer.
Sep 28 10:53:11 ubuntu-1604 haproxy-systemd-wrapper[21531]: haproxy-systemd-wrapper: executing /usr/sbin/haproxy -f /etc/haproxy/haproxy.cfg -p /run/haproxy.pid -Ds
Sep 28 10:53:11 ubuntu-1604 systemd[1]: Reloading.
Sep 28 10:53:11 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x44003115)
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: [INFO    ] Made the following changes:
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: 'haproxy' changed from 'absent' to '1.6.3-1ubuntu0.1'
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: 'liblua5.3-0' changed from 'absent' to '5.3.1-1ubuntu2'
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: [INFO    ] Loading fresh modules for state activity
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: [INFO    ] Completed state [haproxy] at time 10:53:12.536476 duration_in_ms=130952.135
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: [INFO    ] Running state [/etc/default/haproxy] at time 10:53:12.538419
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing state file.managed for /etc/default/haproxy
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'haproxy/files/haproxy.default'
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: [INFO    ] File changed:
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: ---
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +++
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: @@ -1,10 +1,5 @@
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: -# Defaults file for HAProxy
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: -#
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: -# This is sourced by both, the initscript and the systemd unit file, so do not
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: -# treat it as a shell script fragment.
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]:  
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: -# Change the config file location if needed
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: -#CONFIG="/etc/haproxy/haproxy.cfg"
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: -
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: -# Add extra flags here, see haproxy(1) for a few options
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +# Set ENABLED to 1 if you want the init script to start haproxy.
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +ENABLED=1
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +# Add extra flags here.
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]:  #EXTRAOPTS="-de -m 16"
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: [INFO    ] Completed state [/etc/default/haproxy] at time 10:53:12.571553 duration_in_ms=33.133
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: [INFO    ] Running state [/etc/haproxy/haproxy.cfg] at time 10:53:12.572232
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing state file.managed for /etc/haproxy/haproxy.cfg
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'haproxy/files/haproxy.cfg'
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'haproxy/map.jinja'
Sep 28 10:53:12 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x44003115)
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: [INFO    ] File changed:
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: ---
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +++
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: @@ -1,35 +1,176 @@
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]:  global
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: -#011log /dev/log#011local0
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: -#011log /dev/log#011local1 notice
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: -#011chroot /var/lib/haproxy
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: -#011stats socket /run/haproxy/admin.sock mode 660 level admin
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: -#011stats timeout 30s
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: -#011user haproxy
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: -#011group haproxy
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: -#011daemon
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: -
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: -#011# Default SSL material locations
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: -#011ca-base /etc/ssl/certs
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: -#011crt-base /etc/ssl/private
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: -
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: -#011# Default ciphers to use on SSL-enabled listening sockets.
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: -#011# For more information, see ciphers(1SSL). This list is from:
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: -#011#  https://hynek.me/articles/hardening-your-web-servers-ssl-ciphers/
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: -#011ssl-default-bind-ciphers ECDH+AESGCM:DH+AESGCM:ECDH+AES256:DH+AES256:ECDH+AES128:DH+AES:ECDH+3DES:DH+3DES:RSA+AESGCM:RSA+AES:RSA+3DES:!aNULL:!MD5:!DSS
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: -#011ssl-default-bind-options no-sslv3
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  log /dev/log  local0
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  log /dev/log  local1 notice
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  chroot /var/lib/haproxy
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  stats  socket /run/haproxy/admin.sock mode 660 level admin
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  stats timeout 30s
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  user  haproxy
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  group haproxy
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  daemon
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  pidfile  /var/run/haproxy.pid
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  spread-checks 4
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  tune.maxrewrite 1024
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  tune.bufsize 32768
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  maxconn  16000
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  # SSL options
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  ca-base /etc/haproxy/ssl
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  crt-base /etc/haproxy/ssl
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  tune.ssl.default-dh-param 2048
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  ssl-default-bind-ciphers ECDHE-ECDSA-CHACHA20-POLY1305:ECDHE-RSA-CHACHA20-POLY1305:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-RSA-AES256-GCM-SHA384:DHE-RSA-AES128-GCM-SHA256:DHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA256:ECDHE-ECDSA-AES128-SHA:ECDHE-RSA-AES256-SHA384:ECDHE-RSA-AES128-SHA:ECDHE-ECDSA-AES256-SHA384:ECDHE-ECDSA-AES256-SHA:ECDHE-RSA-AES256-SHA:DHE-RSA-AES128-SHA256:DHE-RSA-AES128-SHA:DHE-RSA-AES256-SHA256:DHE-RSA-AES256-SHA:ECDHE-ECDSA-DES-CBC3-SHA:ECDHE-RSA-DES-CBC3-SHA:EDH-RSA-DES-CBC3-SHA:AES128-GCM-SHA256:AES256-GCM-SHA384:AES128-SHA256:AES256-SHA256:AES128-SHA:AES256-SHA:DES-CBC3-SHA:!DSS
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  ssl-default-bind-options no-sslv3 no-tls-tickets
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  ssl-default-server-ciphers ECDHE-ECDSA-CHACHA20-POLY1305:ECDHE-RSA-CHACHA20-POLY1305:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-RSA-AES256-GCM-SHA384:DHE-RSA-AES128-GCM-SHA256:DHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA256:ECDHE-ECDSA-AES128-SHA:ECDHE-RSA-AES256-SHA384:ECDHE-RSA-AES128-SHA:ECDHE-ECDSA-AES256-SHA384:ECDHE-ECDSA-AES256-SHA:ECDHE-RSA-AES256-SHA:DHE-RSA-AES128-SHA256:DHE-RSA-AES128-SHA:DHE-RSA-AES256-SHA256:DHE-RSA-AES256-SHA:ECDHE-ECDSA-DES-CBC3-SHA:ECDHE-RSA-DES-CBC3-SHA:EDH-RSA-DES-CBC3-SHA:AES128-GCM-SHA256:AES256-GCM-SHA384:AES128-SHA256:AES256-SHA256:AES128-SHA:AES256-SHA:DES-CBC3-SHA:!DSS
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  ssl-default-server-options no-sslv3 no-tls-tickets
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]:  
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]:  defaults
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: -#011log#011global
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: -#011mode#011http
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: -#011option#011httplog
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: -#011option#011dontlognull
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: -        timeout connect 5000
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: -        timeout client  50000
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: -        timeout server  50000
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: -#011errorfile 400 /etc/haproxy/errors/400.http
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: -#011errorfile 403 /etc/haproxy/errors/403.http
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: -#011errorfile 408 /etc/haproxy/errors/408.http
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: -#011errorfile 500 /etc/haproxy/errors/500.http
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: -#011errorfile 502 /etc/haproxy/errors/502.http
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: -#011errorfile 503 /etc/haproxy/errors/503.http
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: -#011errorfile 504 /etc/haproxy/errors/504.http
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  log  global
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  mode http
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  maxconn 8000
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  option  redispatch
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  retries  3
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  stats  enable
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  timeout http-request 10s
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  timeout queue 1m
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  timeout connect 10s
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  timeout client 1m
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  timeout server 1m
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  timeout check 10s
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +listen keystone_public_api
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  bind 10.167.4.10:5000
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  option  httpchk
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  option  httplog
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  option  httpclose
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  server ctl01 10.167.4.11:5000 check inter 10s fastinter 2s downinter 3s rise 3 fall 3
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  server ctl02 10.167.4.12:5000 check inter 10s fastinter 2s downinter 3s rise 3 fall 3
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  server ctl03 10.167.4.13:5000 check inter 10s fastinter 2s downinter 3s rise 3 fall 3
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +listen nova_api
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  bind 10.167.4.10:8774
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  option  httpchk
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  option  httplog
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  option  httpclose
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  server ctl01 10.167.4.11:8774 check inter 10s fastinter 2s downinter 3s rise 3 fall 3
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  server ctl02 10.167.4.12:8774 check inter 10s fastinter 2s downinter 3s rise 3 fall 3
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  server ctl03 10.167.4.13:8774 check inter 10s fastinter 2s downinter 3s rise 3 fall 3
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +listen glare
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  bind 10.167.4.10:9494
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  mode http
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  balance roundrobin
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  option  httplog
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  server ctl01 10.167.4.11:9494 check inter 10s fastinter 2s downinter 3s rise 3 fall 3
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  server ctl02 10.167.4.12:9494 check inter 10s fastinter 2s downinter 3s rise 3 fall 3
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  server ctl03 10.167.4.13:9494 check inter 10s fastinter 2s downinter 3s rise 3 fall 3
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +listen nova_novnc
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  bind 10.167.4.10:6080
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  mode http
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  balance roundrobin
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  option  httplog
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  server ctl01 10.167.4.11:6080 check
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  server ctl02 10.167.4.12:6080 check
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  server ctl03 10.167.4.13:6080 check
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +listen keystone_admin_api
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  bind 10.167.4.10:35357
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  option  httpchk
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  option  httplog
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  option  httpclose
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  server ctl01 10.167.4.11:35357 check inter 10s fastinter 2s downinter 3s rise 3 fall 3
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  server ctl02 10.167.4.12:35357 check inter 10s fastinter 2s downinter 3s rise 3 fall 3
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  server ctl03 10.167.4.13:35357 check inter 10s fastinter 2s downinter 3s rise 3 fall 3
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +listen glance_registry_api
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  bind 10.167.4.10:9191
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  mode http
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  balance roundrobin
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  option  httplog
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  server ctl01 10.167.4.11:9191 check
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  server ctl02 10.167.4.12:9191 check
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  server ctl03 10.167.4.13:9191 check
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +listen nova_placement_api
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  bind 10.167.4.10:8778
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  mode http
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  balance roundrobin
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  option httpclose
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  option httplog
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  option httpchk
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  http-check expect status 401
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  server ctl01 10.167.4.11:8778 check inter 10s fastinter 2s downinter 3s rise 3 fall 3
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  server ctl02 10.167.4.12:8778 check inter 10s fastinter 2s downinter 3s rise 3 fall 3
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  server ctl03 10.167.4.13:8778 check inter 10s fastinter 2s downinter 3s rise 3 fall 3
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +listen heat_cloudwatch_api
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  bind 10.167.4.10:8003
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  option  httpchk
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  option  httplog
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  option  httpclose
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  server ctl01 10.167.4.11:8003 check inter 10s fastinter 2s downinter 3s rise 3 fall 3
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  server ctl02 10.167.4.12:8003 check inter 10s fastinter 2s downinter 3s rise 3 fall 3
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  server ctl03 10.167.4.13:8003 check inter 10s fastinter 2s downinter 3s rise 3 fall 3
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +listen cinder_api
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  bind 10.167.4.10:8776
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  option  httpchk
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  option  httplog
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  option  httpclose
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  server ctl01 10.167.4.11:8776 check inter 10s fastinter 2s downinter 3s rise 3 fall 3
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  server ctl02 10.167.4.12:8776 check inter 10s fastinter 2s downinter 3s rise 3 fall 3
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  server ctl03 10.167.4.13:8776 check inter 10s fastinter 2s downinter 3s rise 3 fall 3
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +listen designate_api
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  bind 10.167.4.10:9001
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  option  httpchk
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  option  httplog
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  option  httpclose
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  server ctl01 10.167.4.11:9001 check inter 10s fastinter 2s downinter 3s rise 3 fall 3
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  server ctl02 10.167.4.12:9001 check inter 10s fastinter 2s downinter 3s rise 3 fall 3
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +listen glance_api
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  bind 10.167.4.10:9292
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  option  httpchk
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  option  httplog
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  option  httpclose
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  server ctl01 10.167.4.11:9292 check inter 10s fastinter 2s downinter 3s rise 3 fall 3
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  server ctl02 10.167.4.12:9292 check inter 10s fastinter 2s downinter 3s rise 3 fall 3
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  server ctl03 10.167.4.13:9292 check inter 10s fastinter 2s downinter 3s rise 3 fall 3
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +listen heat_api
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  bind 10.167.4.10:8004
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  option  httpchk
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  option  httplog
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  option  httpclose
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  server ctl01 10.167.4.11:8004 check inter 10s fastinter 2s downinter 3s rise 3 fall 3
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  server ctl02 10.167.4.12:8004 check inter 10s fastinter 2s downinter 3s rise 3 fall 3
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  server ctl03 10.167.4.13:8004 check inter 10s fastinter 2s downinter 3s rise 3 fall 3
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +listen heat_cfn_api
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  bind 10.167.4.10:8000
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  option  httpchk
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  option  httplog
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  option  httpclose
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  server ctl01 10.167.4.11:8000 check inter 10s fastinter 2s downinter 3s rise 3 fall 3
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  server ctl02 10.167.4.12:8000 check inter 10s fastinter 2s downinter 3s rise 3 fall 3
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  server ctl03 10.167.4.13:8000 check inter 10s fastinter 2s downinter 3s rise 3 fall 3
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +listen nova_metadata_api
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  bind 10.167.4.10:8775
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  option  httpchk
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  option  httplog
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  option  httpclose
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  server ctl01 10.167.4.11:8775 check inter 10s fastinter 2s downinter 3s rise 3 fall 3
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  server ctl02 10.167.4.12:8775 check inter 10s fastinter 2s downinter 3s rise 3 fall 3
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  server ctl03 10.167.4.13:8775 check inter 10s fastinter 2s downinter 3s rise 3 fall 3
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +listen neutron_api
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  bind 10.167.4.10:9696
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  option  httpchk
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  option  httplog
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  option  httpclose
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  server ctl01 10.167.4.11:9696 check inter 10s fastinter 2s downinter 3s rise 3 fall 3
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  server ctl02 10.167.4.12:9696 check inter 10s fastinter 2s downinter 3s rise 3 fall 3
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: +  server ctl03 10.167.4.13:9696 check inter 10s fastinter 2s downinter 3s rise 3 fall 3
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: [INFO    ] Completed state [/etc/haproxy/haproxy.cfg] at time 10:53:12.709293 duration_in_ms=137.06
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: [INFO    ] Running state [/etc/haproxy/ssl] at time 10:53:12.709851
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing state file.directory for /etc/haproxy/ssl
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: [INFO    ] {'/etc/haproxy/ssl': 'New Dir'}
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: [INFO    ] Completed state [/etc/haproxy/ssl] at time 10:53:12.712913 duration_in_ms=3.061
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: [INFO    ] Running state [haproxy_status_packages] at time 10:53:12.714206
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing state pkg.installed for haproxy_status_packages
Sep 28 10:53:12 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing command ['systemd-run', '--scope', 'apt-get', '-q', '-y', '-o', 'DPkg::Options::=--force-confold', '-o', 'DPkg::Options::=--force-confdef', 'install', 'socat'] in directory '/root'
Sep 28 10:53:12 ubuntu-1604 systemd[1]: Started /usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold -o DPkg::Options::=--force-confdef install socat.
Sep 28 10:53:13 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x44003115)
Sep 28 10:53:15 ubuntu-1604 dhclient[627]: message repeated 2 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x44003115)]
Sep 28 10:53:15 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 10:53:15 ubuntu-1604 salt-minion[14967]: [INFO    ] Made the following changes:
Sep 28 10:53:15 ubuntu-1604 salt-minion[14967]: 'socat' changed from 'absent' to '1.7.3.1-1'
Sep 28 10:53:15 ubuntu-1604 salt-minion[14967]: [INFO    ] Loading fresh modules for state activity
Sep 28 10:53:15 ubuntu-1604 salt-minion[14967]: [INFO    ] Completed state [haproxy_status_packages] at time 10:53:15.751158 duration_in_ms=3036.952
Sep 28 10:53:15 ubuntu-1604 salt-minion[14967]: [INFO    ] Running state [/usr/bin/haproxy-status.sh] at time 10:53:15.753022
Sep 28 10:53:15 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing state file.managed for /usr/bin/haproxy-status.sh
Sep 28 10:53:15 ubuntu-1604 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'haproxy/files/haproxy-status.sh'
Sep 28 10:53:15 ubuntu-1604 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'haproxy/map.jinja'
Sep 28 10:53:15 ubuntu-1604 salt-minion[14967]: [INFO    ] File changed:
Sep 28 10:53:15 ubuntu-1604 salt-minion[14967]: New file
Sep 28 10:53:15 ubuntu-1604 salt-minion[14967]: [INFO    ] Completed state [/usr/bin/haproxy-status.sh] at time 10:53:15.796297 duration_in_ms=43.274
Sep 28 10:53:15 ubuntu-1604 salt-minion[14967]: [INFO    ] Running state [net.ipv4.ip_nonlocal_bind] at time 10:53:15.797556
Sep 28 10:53:15 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing state sysctl.present for net.ipv4.ip_nonlocal_bind
Sep 28 10:53:15 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing command 'sysctl -a' in directory '/root'
Sep 28 10:53:15 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing command 'sysctl -w net.ipv4.ip_nonlocal_bind="1"' in directory '/root'
Sep 28 10:53:15 ubuntu-1604 salt-minion[14967]: [INFO    ] {'net.ipv4.ip_nonlocal_bind': 1}
Sep 28 10:53:15 ubuntu-1604 salt-minion[14967]: [INFO    ] Completed state [net.ipv4.ip_nonlocal_bind] at time 10:53:15.824191 duration_in_ms=26.633
Sep 28 10:53:15 ubuntu-1604 salt-minion[14967]: [INFO    ] Running state [haproxy] at time 10:53:15.887016
Sep 28 10:53:15 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing state service.running for haproxy
Sep 28 10:53:15 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'status', 'haproxy.service', '-n', '0'] in directory '/root'
Sep 28 10:53:15 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-active', 'haproxy.service'] in directory '/root'
Sep 28 10:53:15 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-enabled', 'haproxy.service'] in directory '/root'
Sep 28 10:53:15 ubuntu-1604 salt-minion[14967]: [INFO    ] The service haproxy is already running
Sep 28 10:53:15 ubuntu-1604 salt-minion[14967]: [INFO    ] Completed state [haproxy] at time 10:53:15.920873 duration_in_ms=33.856
Sep 28 10:53:15 ubuntu-1604 salt-minion[14967]: [INFO    ] Running state [haproxy] at time 10:53:15.921039
Sep 28 10:53:15 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing state service.mod_watch for haproxy
Sep 28 10:53:15 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-active', 'haproxy.service'] in directory '/root'
Sep 28 10:53:15 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-enabled', 'haproxy.service'] in directory '/root'
Sep 28 10:53:15 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing command ['systemd-run', '--scope', 'systemctl', 'restart', 'haproxy.service'] in directory '/root'
Sep 28 10:53:15 ubuntu-1604 systemd[1]: Started /bin/systemctl restart haproxy.service.
Sep 28 10:53:15 ubuntu-1604 systemd[1]: Stopping HAProxy Load Balancer...
Sep 28 10:53:15 ubuntu-1604 haproxy-systemd-wrapper[21531]: haproxy-systemd-wrapper: SIGINT -> 21534
Sep 28 10:53:15 ubuntu-1604 haproxy-systemd-wrapper[21531]: haproxy-systemd-wrapper: exit, haproxy RC=0
Sep 28 10:53:15 ubuntu-1604 systemd[1]: Stopped HAProxy Load Balancer.
Sep 28 10:53:15 ubuntu-1604 systemd[1]: Starting HAProxy Load Balancer...
Sep 28 10:53:15 ubuntu-1604 systemd[1]: Started HAProxy Load Balancer.
Sep 28 10:53:15 ubuntu-1604 salt-minion[14967]: [INFO    ] {'haproxy': True}
Sep 28 10:53:15 ubuntu-1604 salt-minion[14967]: [INFO    ] Completed state [haproxy] at time 10:53:15.980883 duration_in_ms=59.843
Sep 28 10:53:15 ubuntu-1604 salt-minion[14967]: [INFO    ] Returning information for job: 20170928105059226123
Sep 28 10:53:15 ubuntu-1604 haproxy-systemd-wrapper[21675]: haproxy-systemd-wrapper: executing /usr/sbin/haproxy -f /etc/haproxy/haproxy.cfg -p /run/haproxy.pid -Ds
Sep 28 10:53:15 ubuntu-1604 haproxy[21679]: Proxy keystone_public_api started.
Sep 28 10:53:15 ubuntu-1604 haproxy[21679]: Proxy keystone_public_api started.
Sep 28 10:53:15 ubuntu-1604 haproxy[21679]: Proxy nova_api started.
Sep 28 10:53:15 ubuntu-1604 haproxy[21679]: Proxy nova_api started.
Sep 28 10:53:15 ubuntu-1604 haproxy[21679]: Proxy glare started.
Sep 28 10:53:15 ubuntu-1604 haproxy[21679]: Proxy glare started.
Sep 28 10:53:15 ubuntu-1604 haproxy[21679]: Proxy nova_novnc started.
Sep 28 10:53:15 ubuntu-1604 haproxy[21679]: Proxy nova_novnc started.
Sep 28 10:53:15 ubuntu-1604 haproxy[21679]: Proxy keystone_admin_api started.
Sep 28 10:53:15 ubuntu-1604 haproxy[21679]: Proxy keystone_admin_api started.
Sep 28 10:53:15 ubuntu-1604 haproxy[21679]: Proxy glance_registry_api started.
Sep 28 10:53:15 ubuntu-1604 haproxy[21679]: Proxy glance_registry_api started.
Sep 28 10:53:15 ubuntu-1604 haproxy[21679]: Proxy nova_placement_api started.
Sep 28 10:53:15 ubuntu-1604 haproxy[21679]: Proxy nova_placement_api started.
Sep 28 10:53:15 ubuntu-1604 haproxy[21679]: Proxy heat_cloudwatch_api started.
Sep 28 10:53:15 ubuntu-1604 haproxy[21679]: Proxy heat_cloudwatch_api started.
Sep 28 10:53:15 ubuntu-1604 haproxy[21679]: Proxy cinder_api started.
Sep 28 10:53:15 ubuntu-1604 haproxy[21679]: Proxy cinder_api started.
Sep 28 10:53:15 ubuntu-1604 haproxy[21679]: Proxy designate_api started.
Sep 28 10:53:15 ubuntu-1604 haproxy[21679]: Proxy designate_api started.
Sep 28 10:53:15 ubuntu-1604 haproxy[21679]: Proxy glance_api started.
Sep 28 10:53:15 ubuntu-1604 haproxy[21679]: Proxy glance_api started.
Sep 28 10:53:15 ubuntu-1604 haproxy[21679]: Proxy heat_api started.
Sep 28 10:53:15 ubuntu-1604 haproxy[21679]: Proxy heat_api started.
Sep 28 10:53:15 ubuntu-1604 haproxy[21679]: Proxy heat_cfn_api started.
Sep 28 10:53:15 ubuntu-1604 haproxy[21679]: Proxy heat_cfn_api started.
Sep 28 10:53:15 ubuntu-1604 haproxy[21679]: Proxy nova_metadata_api started.
Sep 28 10:53:15 ubuntu-1604 haproxy[21679]: Proxy nova_metadata_api started.
Sep 28 10:53:15 ubuntu-1604 haproxy[21679]: Proxy neutron_api started.
Sep 28 10:53:15 ubuntu-1604 haproxy[21679]: Proxy neutron_api started.
Sep 28 10:53:16 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x44003115)
Sep 28 10:53:17 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x44003115)
Sep 28 10:53:18 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:53:18 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:53:32 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2d0fe35)
Sep 28 10:53:42 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2d0fe35)]
Sep 28 10:53:43 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:53:43 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:54:02 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xaf37e217)
Sep 28 10:54:12 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xaf37e217)]
Sep 28 10:54:13 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:54:13 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:54:26 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4012331c)
Sep 28 10:54:36 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4012331c)]
Sep 28 10:54:37 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:54:37 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:54:49 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdc6a576f)
Sep 28 10:54:59 ubuntu-1604 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdc6a576f)]
Sep 28 10:55:00 ubuntu-1604 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:55:00 ubuntu-1604 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:55:16 ubuntu-1604 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command service.status with jid 20170928105516545906
Sep 28 10:55:16 ubuntu-1604 salt-minion[14967]: [INFO    ] Starting a new job with PID 21709
Sep 28 10:55:16 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'status', 'haproxy.service', '-n', '0'] in directory '/root'
Sep 28 10:55:16 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-active', 'haproxy.service'] in directory '/root'
Sep 28 10:55:16 ubuntu-1604 salt-minion[14967]: [INFO    ] Returning information for job: 20170928105516545906
Sep 28 10:55:16 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xebf0cb7a)
Sep 28 10:55:17 ubuntu-1604 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command service.restart with jid 20170928105517632602
Sep 28 10:55:17 ubuntu-1604 salt-minion[14967]: [INFO    ] Starting a new job with PID 21717
Sep 28 10:55:17 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'status', 'rsyslog.service', '-n', '0'] in directory '/root'
Sep 28 10:55:17 ubuntu-1604 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xebf0cb7a)
Sep 28 10:55:17 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-enabled', 'rsyslog.service'] in directory '/root'
Sep 28 10:55:17 ubuntu-1604 salt-minion[14967]: [INFO    ] Executing command ['systemd-run', '--scope', 'systemctl', 'restart', 'rsyslog.service'] in directory '/root'
Sep 28 10:55:17 ubuntu-1604 systemd[1]: Started /bin/systemctl restart rsyslog.service.
Sep 28 10:55:17 ubuntu-1604 rsyslogd: [origin software="rsyslogd" swVersion="8.16.0" x-pid="733" x-info="http://www.rsyslog.com"] exiting on signal 15.
Sep 28 10:55:17 ctl02 rsyslogd: [origin software="rsyslogd" swVersion="8.16.0" x-pid="21724" x-info="http://www.rsyslog.com"] start
Sep 28 10:55:17 ctl02 rsyslogd-2222: command 'KLogPermitNonKernelFacility' is currently not permitted - did you already set it via a RainerScript command (v6+ config)? [v8.16.0 try http://www.rsyslog.com/e/2222 ]
Sep 28 10:55:17 ctl02 rsyslogd-2307: warning: ~ action is deprecated, consider using the 'stop' statement instead [v8.16.0 try http://www.rsyslog.com/e/2307 ]
Sep 28 10:55:17 ctl02 rsyslogd: rsyslogd's groupid changed to 108
Sep 28 10:55:17 ctl02 rsyslogd: rsyslogd's userid changed to 104
Sep 28 10:55:17 ctl02 systemd[1]: Stopping System Logging Service...
Sep 28 10:55:17 ctl02 systemd[1]: Stopped System Logging Service.
Sep 28 10:55:17 ctl02 systemd[1]: Starting System Logging Service...
Sep 28 10:55:17 ctl02 rsyslogd-2039: Could not open output pipe '/dev/xconsole':: No such file or directory [v8.16.0 try http://www.rsyslog.com/e/2039 ]
Sep 28 10:55:17 ctl02 rsyslogd-2007: action 'action 11' suspended, next retry is Thu Sep 28 10:55:47 2017 [v8.16.0 try http://www.rsyslog.com/e/2007 ]
Sep 28 10:55:17 ctl02 systemd[1]: Started System Logging Service.
Sep 28 10:55:17 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928105517632602
Sep 28 10:55:18 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xebf0cb7a)
Sep 28 10:55:19 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command test.ping with jid 20170928105519070221
Sep 28 10:55:19 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 21735
Sep 28 10:55:19 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928105519070221
Sep 28 10:55:19 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xebf0cb7a)
Sep 28 10:55:26 ctl02 dhclient[627]: message repeated 7 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xebf0cb7a)]
Sep 28 10:55:27 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:55:27 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:55:45 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x88f2de78)
Sep 28 10:55:49 ctl02 dhclient[627]: message repeated 4 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x88f2de78)]
Sep 28 10:55:49 ctl02 dhclient[600]: DHCPREQUEST of 192.168.11.25 on ens2 to 192.168.11.3 port 67 (xid=0x3415f07)
Sep 28 10:55:49 ctl02 dhclient[600]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 10:55:49 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 10:55:49 ctl02 ntp[21798]:  * Stopping NTP server ntpd
Sep 28 10:55:49 ctl02 ntp[21798]:    ...done.
Sep 28 10:55:49 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 10:55:49 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 10:55:49 ctl02 ntp[21809]:  * Starting NTP server ntpd
Sep 28 10:55:49 ctl02 ntpd[21816]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 10:55:49 ctl02 ntpd[21816]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -c /var/lib/ntp/ntp.conf.dhcp -u 108:112
Sep 28 10:55:49 ctl02 ntp[21809]:    ...done.
Sep 28 10:55:49 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 10:55:50 ctl02 ntpd[21819]: proto: precision = 0.043 usec (-24)
Sep 28 10:55:50 ctl02 ntpd[21819]: switching logging to file /var/log/ntp.log
Sep 28 10:55:50 ctl02 dhclient[600]: bound to 192.168.11.25 -- renewal in 262 seconds.
Sep 28 10:55:50 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x88f2de78)
Sep 28 10:55:55 ctl02 dhclient[627]: message repeated 5 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x88f2de78)]
Sep 28 10:55:56 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:55:56 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:55:56 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 10:55:56 ctl02 ntp[21871]:  * Stopping NTP server ntpd
Sep 28 10:55:56 ctl02 ntp[21871]:    ...done.
Sep 28 10:55:56 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 10:55:56 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 10:55:56 ctl02 ntp[21882]:  * Starting NTP server ntpd
Sep 28 10:55:56 ctl02 ntpd[21889]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 10:55:56 ctl02 ntpd[21889]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 10:55:56 ctl02 ntp[21882]:    ...done.
Sep 28 10:55:56 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 10:55:56 ctl02 ntpd[21892]: proto: precision = 0.043 usec (-24)
Sep 28 10:55:56 ctl02 ntpd[21892]: switching logging to file /var/log/ntp.log
Sep 28 10:56:18 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x64297537)
Sep 28 10:56:28 ctl02 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x64297537)]
Sep 28 10:56:29 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:56:29 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:56:46 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb6f22b12)
Sep 28 10:56:56 ctl02 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb6f22b12)]
Sep 28 10:56:57 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:56:57 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:57:06 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x18756242)
Sep 28 10:57:16 ctl02 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x18756242)]
Sep 28 10:57:17 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:57:17 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:57:35 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfd2d4a4b)
Sep 28 10:57:45 ctl02 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfd2d4a4b)]
Sep 28 10:57:46 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:57:46 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:58:08 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf134be27)
Sep 28 10:58:18 ctl02 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf134be27)]
Sep 28 10:58:19 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:58:19 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:58:27 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x391c8b58)
Sep 28 10:58:37 ctl02 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x391c8b58)]
Sep 28 10:58:38 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:58:38 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:58:58 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xbf979432)
Sep 28 10:59:08 ctl02 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xbf979432)]
Sep 28 10:59:09 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:59:09 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:59:30 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xed64c609)
Sep 28 10:59:40 ctl02 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xed64c609)]
Sep 28 10:59:41 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 10:59:41 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 10:59:56 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe2208e0e)
Sep 28 11:00:06 ctl02 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe2208e0e)]
Sep 28 11:00:07 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:00:07 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:00:11 ctl02 dhclient[600]: DHCPREQUEST of 192.168.11.25 on ens2 to 192.168.11.3 port 67 (xid=0x3415f07)
Sep 28 11:00:11 ctl02 dhclient[600]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 11:00:11 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 11:00:11 ctl02 ntp[21996]:  * Stopping NTP server ntpd
Sep 28 11:00:11 ctl02 ntp[21996]:    ...done.
Sep 28 11:00:11 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 11:00:11 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 11:00:11 ctl02 ntp[22007]:  * Starting NTP server ntpd
Sep 28 11:00:11 ctl02 ntpd[22014]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 11:00:11 ctl02 ntpd[22014]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -c /var/lib/ntp/ntp.conf.dhcp -u 108:112
Sep 28 11:00:11 ctl02 ntp[22007]:    ...done.
Sep 28 11:00:11 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 11:00:11 ctl02 ntpd[22017]: proto: precision = 0.043 usec (-24)
Sep 28 11:00:11 ctl02 ntpd[22017]: switching logging to file /var/log/ntp.log
Sep 28 11:00:11 ctl02 dhclient[600]: bound to 192.168.11.25 -- renewal in 276 seconds.
Sep 28 11:00:16 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4094fb55)
Sep 28 11:00:26 ctl02 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4094fb55)]
Sep 28 11:00:27 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:00:27 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:00:27 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 11:00:27 ctl02 ntp[22070]:  * Stopping NTP server ntpd
Sep 28 11:00:27 ctl02 ntp[22070]:    ...done.
Sep 28 11:00:27 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 11:00:27 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 11:00:27 ctl02 ntp[22081]:  * Starting NTP server ntpd
Sep 28 11:00:27 ctl02 ntpd[22088]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 11:00:27 ctl02 ntpd[22088]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 11:00:27 ctl02 ntp[22081]:    ...done.
Sep 28 11:00:27 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 11:00:27 ctl02 ntpd[22091]: proto: precision = 0.044 usec (-24)
Sep 28 11:00:27 ctl02 ntpd[22091]: switching logging to file /var/log/ntp.log
Sep 28 11:00:45 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x840b3164)
Sep 28 11:00:55 ctl02 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x840b3164)]
Sep 28 11:00:56 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:00:56 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:01:05 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x55e29e21)
Sep 28 11:01:15 ctl02 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x55e29e21)]
Sep 28 11:01:16 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:01:16 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:01:24 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x24dec53e)
Sep 28 11:01:34 ctl02 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x24dec53e)]
Sep 28 11:01:35 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:01:35 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:01:44 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6bce0106)
Sep 28 11:01:54 ctl02 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6bce0106)]
Sep 28 11:01:55 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:01:55 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:02:09 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4101a96f)
Sep 28 11:02:19 ctl02 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4101a96f)]
Sep 28 11:02:20 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:02:20 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:02:30 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x62044b0b)
Sep 28 11:02:40 ctl02 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x62044b0b)]
Sep 28 11:02:41 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:02:41 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:02:55 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3486857a)
Sep 28 11:03:05 ctl02 dhclient[627]: message repeated 9 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3486857a)]
Sep 28 11:03:06 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:03:06 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:03:22 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdfc2737e)
Sep 28 11:03:32 ctl02 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdfc2737e)]
Sep 28 11:03:33 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:03:33 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:03:54 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb9ec4216)
Sep 28 11:04:04 ctl02 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb9ec4216)]
Sep 28 11:04:05 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:04:05 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:04:18 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6b6c755f)
Sep 28 11:04:28 ctl02 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6b6c755f)]
Sep 28 11:04:29 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:04:29 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:04:44 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1ef67631)
Sep 28 11:04:46 ctl02 dhclient[627]: message repeated 2 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1ef67631)]
Sep 28 11:04:47 ctl02 dhclient[600]: DHCPREQUEST of 192.168.11.25 on ens2 to 192.168.11.3 port 67 (xid=0x3415f07)
Sep 28 11:04:47 ctl02 dhclient[600]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 11:04:47 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 11:04:47 ctl02 ntp[22200]:  * Stopping NTP server ntpd
Sep 28 11:04:47 ctl02 ntp[22200]:    ...done.
Sep 28 11:04:47 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 11:04:47 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 11:04:47 ctl02 ntp[22210]:  * Starting NTP server ntpd
Sep 28 11:04:47 ctl02 ntpd[22218]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 11:04:47 ctl02 ntpd[22218]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -c /var/lib/ntp/ntp.conf.dhcp -u 108:112
Sep 28 11:04:47 ctl02 ntp[22210]:    ...done.
Sep 28 11:04:47 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 11:04:47 ctl02 ntpd[22221]: proto: precision = 0.043 usec (-24)
Sep 28 11:04:47 ctl02 ntpd[22221]: switching logging to file /var/log/ntp.log
Sep 28 11:04:47 ctl02 dhclient[600]: bound to 192.168.11.25 -- renewal in 283 seconds.
Sep 28 11:04:47 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1ef67631)
Sep 28 11:04:54 ctl02 dhclient[627]: message repeated 7 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1ef67631)]
Sep 28 11:04:55 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:04:55 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:04:55 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 11:04:55 ctl02 ntp[22274]:  * Stopping NTP server ntpd
Sep 28 11:04:55 ctl02 ntp[22274]:    ...done.
Sep 28 11:04:55 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 11:04:55 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 11:04:55 ctl02 ntp[22285]:  * Starting NTP server ntpd
Sep 28 11:04:55 ctl02 ntpd[22292]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 11:04:55 ctl02 ntpd[22292]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 11:04:55 ctl02 ntp[22285]:    ...done.
Sep 28 11:04:55 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 11:04:55 ctl02 ntpd[22295]: proto: precision = 0.042 usec (-24)
Sep 28 11:04:55 ctl02 ntpd[22295]: switching logging to file /var/log/ntp.log
Sep 28 11:05:07 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4cde9b5b)
Sep 28 11:05:17 ctl02 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4cde9b5b)]
Sep 28 11:05:18 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:05:18 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:05:38 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x601f0a6d)
Sep 28 11:05:48 ctl02 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x601f0a6d)]
Sep 28 11:05:49 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:05:49 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:06:11 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3df93545)
Sep 28 11:06:21 ctl02 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3df93545)]
Sep 28 11:06:22 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:06:22 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:06:37 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x96ae6659)
Sep 28 11:06:47 ctl02 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x96ae6659)]
Sep 28 11:06:48 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:06:48 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:07:04 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x977cb35f)
Sep 28 11:07:14 ctl02 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x977cb35f)]
Sep 28 11:07:15 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:07:15 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:07:36 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf074ab38)
Sep 28 11:07:46 ctl02 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf074ab38)]
Sep 28 11:07:47 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:07:47 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:07:58 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe8e7312f)
Sep 28 11:08:08 ctl02 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe8e7312f)]
Sep 28 11:08:09 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:08:09 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:08:30 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf9011223)
Sep 28 11:08:40 ctl02 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf9011223)]
Sep 28 11:08:41 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:08:41 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:08:53 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9e544915)
Sep 28 11:09:03 ctl02 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9e544915)]
Sep 28 11:09:04 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:09:04 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:09:19 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdfac5171)
Sep 28 11:09:29 ctl02 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdfac5171)]
Sep 28 11:09:30 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:09:30 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:09:30 ctl02 dhclient[600]: DHCPREQUEST of 192.168.11.25 on ens2 to 192.168.11.3 port 67 (xid=0x3415f07)
Sep 28 11:09:30 ctl02 dhclient[600]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 11:09:31 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 11:09:31 ctl02 ntp[22404]:  * Stopping NTP server ntpd
Sep 28 11:09:31 ctl02 ntp[22404]:    ...done.
Sep 28 11:09:31 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 11:09:31 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 11:09:31 ctl02 ntp[22415]:  * Starting NTP server ntpd
Sep 28 11:09:31 ctl02 ntpd[22422]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 11:09:31 ctl02 ntpd[22422]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -c /var/lib/ntp/ntp.conf.dhcp -u 108:112
Sep 28 11:09:31 ctl02 ntp[22415]:    ...done.
Sep 28 11:09:31 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 11:09:31 ctl02 ntpd[22425]: proto: precision = 0.042 usec (-24)
Sep 28 11:09:31 ctl02 ntpd[22425]: switching logging to file /var/log/ntp.log
Sep 28 11:09:31 ctl02 dhclient[600]: bound to 192.168.11.25 -- renewal in 227 seconds.
Sep 28 11:09:46 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb573d441)
Sep 28 11:09:51 ctl02 dhclient[627]: message repeated 5 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb573d441)]
Sep 28 11:09:51 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command state.sls with jid 20170928110951991402
Sep 28 11:09:52 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 22433
Sep 28 11:09:52 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb573d441)
Sep 28 11:09:53 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb573d441)
Sep 28 11:09:53 ctl02 salt-minion[14967]: [INFO    ] Loading fresh modules for state activity
Sep 28 11:09:53 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'keystone/server.sls'
Sep 28 11:09:53 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'keystone/map.jinja'
Sep 28 11:09:53 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'apache/init.sls'
Sep 28 11:09:53 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'apache/server/init.sls'
Sep 28 11:09:53 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'apache/server/service/init.sls'
Sep 28 11:09:53 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'apache/map.jinja'
Sep 28 11:09:53 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'apache/server/service/modules.sls'
Sep 28 11:09:53 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'apache/map.jinja'
Sep 28 11:09:54 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'apache/server/service/mpm.sls'
Sep 28 11:09:54 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'apache/map.jinja'
Sep 28 11:09:54 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'apache/server/site.sls'
Sep 28 11:09:54 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'apache/map.jinja'
Sep 28 11:09:54 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'apache/server/users.sls'
Sep 28 11:09:54 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'apache/map.jinja'
Sep 28 11:09:54 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'apache/server/robots.sls'
Sep 28 11:09:54 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'apache/map.jinja'
Sep 28 11:09:54 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb573d441)
Sep 28 11:09:54 ctl02 salt-minion[14967]: [INFO    ] Running state [apache2] at time 11:09:54.534284
Sep 28 11:09:54 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for apache2
Sep 28 11:09:54 ctl02 salt-minion[14967]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 11:09:54 ctl02 salt-minion[14967]: [INFO    ] Executing command ['apt-get', '-q', 'update'] in directory '/root'
Sep 28 11:09:55 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb573d441)
Sep 28 11:09:56 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb573d441)
Sep 28 11:09:57 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:09:57 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:09:57 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 11:09:57 ctl02 ntp[22902]:  * Stopping NTP server ntpd
Sep 28 11:09:57 ctl02 ntp[22902]:    ...done.
Sep 28 11:09:57 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 11:09:57 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 11:09:57 ctl02 ntp[22913]:  * Starting NTP server ntpd
Sep 28 11:09:57 ctl02 ntpd[22920]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 11:09:57 ctl02 ntpd[22920]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 11:09:57 ctl02 ntp[22913]:    ...done.
Sep 28 11:09:57 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 11:09:57 ctl02 ntpd[22923]: proto: precision = 0.044 usec (-24)
Sep 28 11:09:57 ctl02 ntpd[22923]: switching logging to file /var/log/ntp.log
Sep 28 11:09:57 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemd-run', '--scope', 'apt-get', '-q', '-y', '-o', 'DPkg::Options::=--force-confold', '-o', 'DPkg::Options::=--force-confdef', 'install', 'apache2'] in directory '/root'
Sep 28 11:09:57 ctl02 systemd[1]: Started /usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold -o DPkg::Options::=--force-confdef install apache2.
Sep 28 11:10:02 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928111002031921
Sep 28 11:10:02 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 22982
Sep 28 11:10:02 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928111002031921
Sep 28 11:10:09 ctl02 systemd[1]: Reloading.
Sep 28 11:10:12 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928111012207429
Sep 28 11:10:12 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 23074
Sep 28 11:10:12 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928111012207429
Sep 28 11:10:12 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc057d104)
Sep 28 11:10:21 ctl02 dhclient[627]: message repeated 9 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc057d104)]
Sep 28 11:10:22 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928111022367155
Sep 28 11:10:22 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 23079
Sep 28 11:10:22 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928111022367155
Sep 28 11:10:22 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc057d104)
Sep 28 11:10:23 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:10:23 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:10:26 ctl02 systemd[1]: Reloading.
Sep 28 11:10:26 ctl02 systemd[1]: message repeated 2 times: [ Reloading.]
Sep 28 11:10:26 ctl02 systemd[1]: Starting LSB: Apache2 web server...
Sep 28 11:10:26 ctl02 apache2[23347]:  * Starting Apache httpd web server apache2
Sep 28 11:10:27 ctl02 apache2[23347]:  *
Sep 28 11:10:27 ctl02 systemd[1]: Started LSB: Apache2 web server.
Sep 28 11:10:28 ctl02 systemd[1]: Reloading.
Sep 28 11:10:29 ctl02 salt-minion[14967]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 11:10:29 ctl02 salt-minion[14967]: [INFO    ] Made the following changes:
Sep 28 11:10:29 ctl02 salt-minion[14967]: 'httpd' changed from 'absent' to '1'
Sep 28 11:10:29 ctl02 salt-minion[14967]: 'libaprutil1' changed from 'absent' to '1.5.4-1build1'
Sep 28 11:10:29 ctl02 salt-minion[14967]: 'apache2-utils' changed from 'absent' to '2.4.18-2ubuntu3.5'
Sep 28 11:10:29 ctl02 salt-minion[14967]: 'libaprutil1-ldap' changed from 'absent' to '1.5.4-1build1'
Sep 28 11:10:29 ctl02 salt-minion[14967]: 'apache2-api-20120211' changed from 'absent' to '1'
Sep 28 11:10:29 ctl02 salt-minion[14967]: 'libapr1' changed from 'absent' to '1.5.2-3'
Sep 28 11:10:29 ctl02 salt-minion[14967]: 'apache2-data' changed from 'absent' to '2.4.18-2ubuntu3.5'
Sep 28 11:10:29 ctl02 salt-minion[14967]: 'apache2' changed from 'absent' to '2.4.18-2ubuntu3.5'
Sep 28 11:10:29 ctl02 salt-minion[14967]: 'liblua5.1-0' changed from 'absent' to '5.1.5-8ubuntu1'
Sep 28 11:10:29 ctl02 salt-minion[14967]: 'libaprutil1-dbd-sqlite3' changed from 'absent' to '1.5.4-1build1'
Sep 28 11:10:29 ctl02 salt-minion[14967]: 'httpd-cgi' changed from 'absent' to '1'
Sep 28 11:10:29 ctl02 salt-minion[14967]: 'ssl-cert' changed from 'absent' to '1.0.37'
Sep 28 11:10:29 ctl02 salt-minion[14967]: 'apache2-bin' changed from 'absent' to '2.4.18-2ubuntu3.5'
Sep 28 11:10:29 ctl02 salt-minion[14967]: [INFO    ] Loading fresh modules for state activity
Sep 28 11:10:29 ctl02 salt-minion[14967]: [INFO    ] Completed state [apache2] at time 11:10:29.820623 duration_in_ms=35286.339
Sep 28 11:10:29 ctl02 salt-minion[14967]: [INFO    ] Running state [a2enmod ssl] at time 11:10:29.822155
Sep 28 11:10:29 ctl02 salt-minion[14967]: [INFO    ] Executing state cmd.run for a2enmod ssl
Sep 28 11:10:29 ctl02 salt-minion[14967]: [INFO    ] Executing command 'a2enmod ssl' in directory '/root'
Sep 28 11:10:29 ctl02 salt-minion[14967]: [INFO    ] {'pid': 23488, 'retcode': 0, 'stderr': '', 'stdout': 'Considering dependency setenvif for ssl:\nModule setenvif already enabled\nConsidering dependency mime for ssl:\nModule mime already enabled\nConsidering dependency socache_shmcb for ssl:\nEnabling module socache_shmcb.\nEnabling module ssl.\nSee /usr/share/doc/apache2/README.Debian.gz on how to configure SSL and create self-signed certificates.\nTo activate the new configuration, you need to run:\n  service apache2 restart'}
Sep 28 11:10:29 ctl02 salt-minion[14967]: [INFO    ] Completed state [a2enmod ssl] at time 11:10:29.861544 duration_in_ms=39.388
Sep 28 11:10:29 ctl02 salt-minion[14967]: [INFO    ] Running state [a2enmod rewrite] at time 11:10:29.862632
Sep 28 11:10:29 ctl02 salt-minion[14967]: [INFO    ] Executing state cmd.run for a2enmod rewrite
Sep 28 11:10:29 ctl02 salt-minion[14967]: [INFO    ] Executing command 'a2enmod rewrite' in directory '/root'
Sep 28 11:10:29 ctl02 salt-minion[14967]: [INFO    ] {'pid': 23510, 'retcode': 0, 'stderr': '', 'stdout': 'Enabling module rewrite.\nTo activate the new configuration, you need to run:\n  service apache2 restart'}
Sep 28 11:10:29 ctl02 salt-minion[14967]: [INFO    ] Completed state [a2enmod rewrite] at time 11:10:29.898091 duration_in_ms=35.459
Sep 28 11:10:29 ctl02 salt-minion[14967]: [INFO    ] Running state [libapache2-mod-wsgi] at time 11:10:29.904527
Sep 28 11:10:29 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for libapache2-mod-wsgi
Sep 28 11:10:30 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemd-run', '--scope', 'apt-get', '-q', '-y', '-o', 'DPkg::Options::=--force-confold', '-o', 'DPkg::Options::=--force-confdef', 'install', 'libapache2-mod-wsgi'] in directory '/root'
Sep 28 11:10:30 ctl02 systemd[1]: Started /usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold -o DPkg::Options::=--force-confdef install libapache2-mod-wsgi.
Sep 28 11:10:32 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8459232f)
Sep 28 11:10:32 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928111032556684
Sep 28 11:10:32 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 23568
Sep 28 11:10:32 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928111032556684
Sep 28 11:10:33 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8459232f)
Sep 28 11:10:34 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8459232f)
Sep 28 11:10:34 ctl02 libapache2-mod-wsgi: apache2_invoke: Enable module wsgi
Sep 28 11:10:34 ctl02 systemd[1]: Reloading.
Sep 28 11:10:34 ctl02 systemd[1]: Stopping LSB: Apache2 web server...
Sep 28 11:10:34 ctl02 apache2[23649]:  * Stopping Apache httpd web server apache2
Sep 28 11:10:35 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8459232f)
Sep 28 11:10:35 ctl02 apache2[23649]:  *
Sep 28 11:10:35 ctl02 systemd[1]: Stopped LSB: Apache2 web server.
Sep 28 11:10:35 ctl02 systemd[1]: Starting LSB: Apache2 web server...
Sep 28 11:10:35 ctl02 apache2[23672]:  * Starting Apache httpd web server apache2
Sep 28 11:10:36 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8459232f)
Sep 28 11:10:36 ctl02 apache2[23672]:  *
Sep 28 11:10:36 ctl02 systemd[1]: Started LSB: Apache2 web server.
Sep 28 11:10:37 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8459232f)
Sep 28 11:10:37 ctl02 salt-minion[14967]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 11:10:37 ctl02 salt-minion[14967]: [INFO    ] Made the following changes:
Sep 28 11:10:37 ctl02 salt-minion[14967]: 'libapache2-mod-wsgi' changed from 'absent' to '4.3.0-1.1build1'
Sep 28 11:10:37 ctl02 salt-minion[14967]: 'httpd-wsgi' changed from 'absent' to '1'
Sep 28 11:10:37 ctl02 salt-minion[14967]: 'libpython2.7' changed from 'absent' to '2.7.12-1ubuntu0~16.04.1'
Sep 28 11:10:37 ctl02 salt-minion[14967]: [INFO    ] Loading fresh modules for state activity
Sep 28 11:10:37 ctl02 salt-minion[14967]: [INFO    ] Completed state [libapache2-mod-wsgi] at time 11:10:37.795372 duration_in_ms=7890.845
Sep 28 11:10:37 ctl02 salt-minion[14967]: [INFO    ] Running state [a2enmod wsgi] at time 11:10:37.796887
Sep 28 11:10:37 ctl02 salt-minion[14967]: [INFO    ] Executing state cmd.run for a2enmod wsgi
Sep 28 11:10:37 ctl02 salt-minion[14967]: [INFO    ] /etc/apache2/mods-enabled/wsgi.load exists
Sep 28 11:10:37 ctl02 salt-minion[14967]: [INFO    ] Completed state [a2enmod wsgi] at time 11:10:37.797548 duration_in_ms=0.661
Sep 28 11:10:37 ctl02 salt-minion[14967]: [INFO    ] Running state [/etc/apache2/mods-enabled/mpm_prefork.load] at time 11:10:37.798839
Sep 28 11:10:37 ctl02 salt-minion[14967]: [INFO    ] Executing state file.absent for /etc/apache2/mods-enabled/mpm_prefork.load
Sep 28 11:10:37 ctl02 salt-minion[14967]: [INFO    ] File /etc/apache2/mods-enabled/mpm_prefork.load is not present
Sep 28 11:10:37 ctl02 salt-minion[14967]: [INFO    ] Completed state [/etc/apache2/mods-enabled/mpm_prefork.load] at time 11:10:37.799380 duration_in_ms=0.541
Sep 28 11:10:37 ctl02 salt-minion[14967]: [INFO    ] Running state [/etc/apache2/mods-enabled/mpm_prefork.conf] at time 11:10:37.799542
Sep 28 11:10:37 ctl02 salt-minion[14967]: [INFO    ] Executing state file.absent for /etc/apache2/mods-enabled/mpm_prefork.conf
Sep 28 11:10:37 ctl02 salt-minion[14967]: [INFO    ] File /etc/apache2/mods-enabled/mpm_prefork.conf is not present
Sep 28 11:10:37 ctl02 salt-minion[14967]: [INFO    ] Completed state [/etc/apache2/mods-enabled/mpm_prefork.conf] at time 11:10:37.800047 duration_in_ms=0.505
Sep 28 11:10:37 ctl02 salt-minion[14967]: [INFO    ] Running state [/etc/apache2/mods-enabled/mpm_worker.load] at time 11:10:37.800198
Sep 28 11:10:37 ctl02 salt-minion[14967]: [INFO    ] Executing state file.absent for /etc/apache2/mods-enabled/mpm_worker.load
Sep 28 11:10:37 ctl02 salt-minion[14967]: [INFO    ] File /etc/apache2/mods-enabled/mpm_worker.load is not present
Sep 28 11:10:37 ctl02 salt-minion[14967]: [INFO    ] Completed state [/etc/apache2/mods-enabled/mpm_worker.load] at time 11:10:37.800739 duration_in_ms=0.541
Sep 28 11:10:37 ctl02 salt-minion[14967]: [INFO    ] Running state [/etc/apache2/mods-enabled/mpm_worker.conf] at time 11:10:37.800896
Sep 28 11:10:37 ctl02 salt-minion[14967]: [INFO    ] Executing state file.absent for /etc/apache2/mods-enabled/mpm_worker.conf
Sep 28 11:10:37 ctl02 salt-minion[14967]: [INFO    ] File /etc/apache2/mods-enabled/mpm_worker.conf is not present
Sep 28 11:10:37 ctl02 salt-minion[14967]: [INFO    ] Completed state [/etc/apache2/mods-enabled/mpm_worker.conf] at time 11:10:37.801382 duration_in_ms=0.486
Sep 28 11:10:37 ctl02 salt-minion[14967]: [INFO    ] Running state [/etc/apache2/mods-available/mpm_event.conf] at time 11:10:37.802814
Sep 28 11:10:37 ctl02 salt-minion[14967]: [INFO    ] Executing state file.managed for /etc/apache2/mods-available/mpm_event.conf
Sep 28 11:10:37 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'apache/files/mpm/mpm_event.conf'
Sep 28 11:10:37 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'apache/map.jinja'
Sep 28 11:10:37 ctl02 salt-minion[14967]: [INFO    ] File changed:
Sep 28 11:10:37 ctl02 salt-minion[14967]: ---
Sep 28 11:10:37 ctl02 salt-minion[14967]: +++
Sep 28 11:10:37 ctl02 salt-minion[14967]: @@ -5,14 +5,15 @@
Sep 28 11:10:37 ctl02 salt-minion[14967]:  # ThreadsPerChild: constant number of worker threads in each server process
Sep 28 11:10:37 ctl02 salt-minion[14967]:  # MaxRequestWorkers: maximum number of worker threads
Sep 28 11:10:37 ctl02 salt-minion[14967]:  # MaxConnectionsPerChild: maximum number of requests a server process serves
Sep 28 11:10:37 ctl02 salt-minion[14967]: +
Sep 28 11:10:37 ctl02 salt-minion[14967]:  <IfModule mpm_event_module>
Sep 28 11:10:37 ctl02 salt-minion[14967]: -#011StartServers#011#011#011 2
Sep 28 11:10:37 ctl02 salt-minion[14967]: -#011MinSpareThreads#011#011 25
Sep 28 11:10:37 ctl02 salt-minion[14967]: -#011MaxSpareThreads#011#011 75
Sep 28 11:10:37 ctl02 salt-minion[14967]: -#011ThreadLimit#011#011#011 64
Sep 28 11:10:37 ctl02 salt-minion[14967]: -#011ThreadsPerChild#011#011 25
Sep 28 11:10:37 ctl02 salt-minion[14967]: -#011MaxRequestWorkers#011  150
Sep 28 11:10:37 ctl02 salt-minion[14967]: -#011MaxConnectionsPerChild   0
Sep 28 11:10:37 ctl02 salt-minion[14967]: +    StartServers            5
Sep 28 11:10:37 ctl02 salt-minion[14967]: +    MinSpareThreads         25
Sep 28 11:10:37 ctl02 salt-minion[14967]: +    MaxSpareThreads         75
Sep 28 11:10:37 ctl02 salt-minion[14967]: +    ThreadLimit             64
Sep 28 11:10:37 ctl02 salt-minion[14967]: +    ThreadsPerChild         25
Sep 28 11:10:37 ctl02 salt-minion[14967]: +    MaxRequestWorkers       150
Sep 28 11:10:37 ctl02 salt-minion[14967]: +    MaxConnectionsPerChild  0
Sep 28 11:10:37 ctl02 salt-minion[14967]:  </IfModule>
Sep 28 11:10:37 ctl02 salt-minion[14967]:  
Sep 28 11:10:37 ctl02 salt-minion[14967]: -# vim: syntax=apache ts=4 sw=4 sts=4 sr noet
Sep 28 11:10:37 ctl02 salt-minion[14967]: +# vim: syntax=apache ts=4 sw=4 sts=4 sr et
Sep 28 11:10:37 ctl02 salt-minion[14967]: [INFO    ] Completed state [/etc/apache2/mods-available/mpm_event.conf] at time 11:10:37.875738 duration_in_ms=72.923
Sep 28 11:10:37 ctl02 salt-minion[14967]: [INFO    ] Running state [a2enmod mpm_event] at time 11:10:37.876467
Sep 28 11:10:37 ctl02 salt-minion[14967]: [INFO    ] Executing state cmd.run for a2enmod mpm_event
Sep 28 11:10:37 ctl02 salt-minion[14967]: [INFO    ] /etc/apache2/mods-enabled/mpm_event.load exists
Sep 28 11:10:37 ctl02 salt-minion[14967]: [INFO    ] Completed state [a2enmod mpm_event] at time 11:10:37.877136 duration_in_ms=0.669
Sep 28 11:10:37 ctl02 salt-minion[14967]: [INFO    ] Running state [/etc/apache2/ports.conf] at time 11:10:37.877471
Sep 28 11:10:37 ctl02 salt-minion[14967]: [INFO    ] Executing state file.managed for /etc/apache2/ports.conf
Sep 28 11:10:37 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'apache/files/ports.conf'
Sep 28 11:10:37 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'apache/map.jinja'
Sep 28 11:10:37 ctl02 salt-minion[14967]: [INFO    ] File /etc/apache2/ports.conf is in the correct state
Sep 28 11:10:37 ctl02 salt-minion[14967]: [INFO    ] Completed state [/etc/apache2/ports.conf] at time 11:10:37.933795 duration_in_ms=56.324
Sep 28 11:10:37 ctl02 salt-minion[14967]: [INFO    ] Running state [/etc/apache2/conf-available/security.conf] at time 11:10:37.934198
Sep 28 11:10:37 ctl02 salt-minion[14967]: [INFO    ] Executing state file.managed for /etc/apache2/conf-available/security.conf
Sep 28 11:10:37 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'apache/files/security.conf'
Sep 28 11:10:37 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'apache/map.jinja'
Sep 28 11:10:37 ctl02 salt-minion[14967]: [INFO    ] File changed:
Sep 28 11:10:37 ctl02 salt-minion[14967]: ---
Sep 28 11:10:37 ctl02 salt-minion[14967]: +++
Sep 28 11:10:37 ctl02 salt-minion[14967]: @@ -1,73 +1,14 @@
Sep 28 11:10:37 ctl02 salt-minion[14967]: -#
Sep 28 11:10:37 ctl02 salt-minion[14967]: -# Disable access to the entire file system except for the directories that
Sep 28 11:10:37 ctl02 salt-minion[14967]: -# are explicitly allowed later.
Sep 28 11:10:37 ctl02 salt-minion[14967]: -#
Sep 28 11:10:37 ctl02 salt-minion[14967]: -# This currently breaks the configurations that come with some web application
Sep 28 11:10:37 ctl02 salt-minion[14967]: -# Debian packages.
Sep 28 11:10:37 ctl02 salt-minion[14967]: -#
Sep 28 11:10:37 ctl02 salt-minion[14967]: -#<Directory />
Sep 28 11:10:37 ctl02 salt-minion[14967]: -#   AllowOverride None
Sep 28 11:10:37 ctl02 salt-minion[14967]: -#   Require all denied
Sep 28 11:10:37 ctl02 salt-minion[14967]: -#</Directory>
Sep 28 11:10:37 ctl02 salt-minion[14967]: +ServerSignature Off
Sep 28 11:10:37 ctl02 salt-minion[14967]: +TraceEnable Off
Sep 28 11:10:37 ctl02 salt-minion[14967]: +ServerTokens Prod
Sep 28 11:10:37 ctl02 salt-minion[14967]: +<DirectoryMatch "/\.svn">
Sep 28 11:10:37 ctl02 salt-minion[14967]: +    Require all denied
Sep 28 11:10:37 ctl02 salt-minion[14967]: +</DirectoryMatch>
Sep 28 11:10:37 ctl02 salt-minion[14967]:  
Sep 28 11:10:37 ctl02 salt-minion[14967]: +<DirectoryMatch "/\.git">
Sep 28 11:10:37 ctl02 salt-minion[14967]: +    Require all denied
Sep 28 11:10:37 ctl02 salt-minion[14967]: +</DirectoryMatch>
Sep 28 11:10:37 ctl02 salt-minion[14967]:  
Sep 28 11:10:37 ctl02 salt-minion[14967]: -# Changing the following options will not really affect the security of the
Sep 28 11:10:37 ctl02 salt-minion[14967]: -# server, but might make attacks slightly more difficult in some cases.
Sep 28 11:10:37 ctl02 salt-minion[14967]: -
Sep 28 11:10:37 ctl02 salt-minion[14967]: -#
Sep 28 11:10:37 ctl02 salt-minion[14967]: -# ServerTokens
Sep 28 11:10:37 ctl02 salt-minion[14967]: -# This directive configures what you return as the Server HTTP response
Sep 28 11:10:37 ctl02 salt-minion[14967]: -# Header. The default is 'Full' which sends information about the OS-Type
Sep 28 11:10:37 ctl02 salt-minion[14967]: -# and compiled in modules.
Sep 28 11:10:37 ctl02 salt-minion[14967]: -# Set to one of:  Full | OS | Minimal | Minor | Major | Prod
Sep 28 11:10:37 ctl02 salt-minion[14967]: -# where Full conveys the most information, and Prod the least.
Sep 28 11:10:37 ctl02 salt-minion[14967]: -#ServerTokens Minimal
Sep 28 11:10:37 ctl02 salt-minion[14967]: -ServerTokens OS
Sep 28 11:10:37 ctl02 salt-minion[14967]: -#ServerTokens Full
Sep 28 11:10:37 ctl02 salt-minion[14967]: -
Sep 28 11:10:37 ctl02 salt-minion[14967]: -#
Sep 28 11:10:37 ctl02 salt-minion[14967]: -# Optionally add a line containing the server version and virtual host
Sep 28 11:10:37 ctl02 salt-minion[14967]: -# name to server-generated pages (internal error documents, FTP directory
Sep 28 11:10:37 ctl02 salt-minion[14967]: -# listings, mod_status and mod_info output etc., but not CGI generated
Sep 28 11:10:37 ctl02 salt-minion[14967]: -# documents or custom error documents).
Sep 28 11:10:37 ctl02 salt-minion[14967]: -# Set to "EMail" to also include a mailto: link to the ServerAdmin.
Sep 28 11:10:37 ctl02 salt-minion[14967]: -# Set to one of:  On | Off | EMail
Sep 28 11:10:37 ctl02 salt-minion[14967]: -#ServerSignature Off
Sep 28 11:10:37 ctl02 salt-minion[14967]: -ServerSignature On
Sep 28 11:10:37 ctl02 salt-minion[14967]: -
Sep 28 11:10:37 ctl02 salt-minion[14967]: -#
Sep 28 11:10:37 ctl02 salt-minion[14967]: -# Allow TRACE method
Sep 28 11:10:37 ctl02 salt-minion[14967]: -#
Sep 28 11:10:37 ctl02 salt-minion[14967]: -# Set to "extended" to also reflect the request body (only for testing and
Sep 28 11:10:37 ctl02 salt-minion[14967]: -# diagnostic purposes).
Sep 28 11:10:37 ctl02 salt-minion[14967]: -#
Sep 28 11:10:37 ctl02 salt-minion[14967]: -# Set to one of:  On | Off | extended
Sep 28 11:10:37 ctl02 salt-minion[14967]: -TraceEnable Off
Sep 28 11:10:37 ctl02 salt-minion[14967]: -#TraceEnable On
Sep 28 11:10:37 ctl02 salt-minion[14967]: -
Sep 28 11:10:37 ctl02 salt-minion[14967]: -#
Sep 28 11:10:37 ctl02 salt-minion[14967]: -# Forbid access to version control directories
Sep 28 11:10:37 ctl02 salt-minion[14967]: -#
Sep 28 11:10:37 ctl02 salt-minion[14967]: -# If you use version control systems in your document root, you should
Sep 28 11:10:37 ctl02 salt-minion[14967]: -# probably deny access to their directories. For example, for subversion:
Sep 28 11:10:37 ctl02 salt-minion[14967]: -#
Sep 28 11:10:37 ctl02 salt-minion[14967]: -#<DirectoryMatch "/\.svn">
Sep 28 11:10:37 ctl02 salt-minion[14967]: -#   Require all denied
Sep 28 11:10:37 ctl02 salt-minion[14967]: -#</DirectoryMatch>
Sep 28 11:10:37 ctl02 salt-minion[14967]: -
Sep 28 11:10:37 ctl02 salt-minion[14967]: -#
Sep 28 11:10:37 ctl02 salt-minion[14967]: -# Setting this header will prevent MSIE from interpreting files as something
Sep 28 11:10:37 ctl02 salt-minion[14967]: -# else than declared by the content type in the HTTP headers.
Sep 28 11:10:37 ctl02 salt-minion[14967]: -# Requires mod_headers to be enabled.
Sep 28 11:10:37 ctl02 salt-minion[14967]: -#
Sep 28 11:10:37 ctl02 salt-minion[14967]: -#Header set X-Content-Type-Options: "nosniff"
Sep 28 11:10:37 ctl02 salt-minion[14967]: -
Sep 28 11:10:37 ctl02 salt-minion[14967]: -#
Sep 28 11:10:37 ctl02 salt-minion[14967]: -# Setting this header will prevent other sites from embedding pages from this
Sep 28 11:10:37 ctl02 salt-minion[14967]: -# site as frames. This defends against clickjacking attacks.
Sep 28 11:10:37 ctl02 salt-minion[14967]: -# Requires mod_headers to be enabled.
Sep 28 11:10:37 ctl02 salt-minion[14967]: -#
Sep 28 11:10:37 ctl02 salt-minion[14967]: -#Header set X-Frame-Options: "sameorigin"
Sep 28 11:10:37 ctl02 salt-minion[14967]: -
Sep 28 11:10:37 ctl02 salt-minion[14967]: -
Sep 28 11:10:37 ctl02 salt-minion[14967]: -# vim: syntax=apache ts=4 sw=4 sts=4 sr noet
Sep 28 11:10:37 ctl02 salt-minion[14967]: +<DirectoryMatch "/\.hg">
Sep 28 11:10:37 ctl02 salt-minion[14967]: +    Require all denied
Sep 28 11:10:37 ctl02 salt-minion[14967]: +</DirectoryMatch>
Sep 28 11:10:37 ctl02 salt-minion[14967]: [INFO    ] Completed state [/etc/apache2/conf-available/security.conf] at time 11:10:37.993093 duration_in_ms=58.894
Sep 28 11:10:38 ctl02 salt-minion[14967]: [INFO    ] Running state [keystone] at time 11:10:38.072629
Sep 28 11:10:38 ctl02 salt-minion[14967]: [INFO    ] Executing state group.present for keystone
Sep 28 11:10:38 ctl02 salt-minion[14967]: [INFO    ] Executing command 'groupadd -g 301 -r keystone' in directory '/root'
Sep 28 11:10:38 ctl02 salt-minion[14967]: [INFO    ] {'passwd': 'x', 'gid': 301, 'name': 'keystone', 'members': []}
Sep 28 11:10:38 ctl02 salt-minion[14967]: [INFO    ] Completed state [keystone] at time 11:10:38.298062 duration_in_ms=225.432
Sep 28 11:10:38 ctl02 salt-minion[14967]: [INFO    ] Running state [keystone] at time 11:10:38.298745
Sep 28 11:10:38 ctl02 salt-minion[14967]: [INFO    ] Executing state user.present for keystone
Sep 28 11:10:38 ctl02 salt-minion[14967]: [INFO    ] Executing command ['useradd', '-s', '/bin/false', '-u', '301', '-g', '301', '-m', '-d', '/var/lib/keystone', '-r', 'keystone'] in directory '/root'
Sep 28 11:10:38 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8459232f)
Sep 28 11:10:38 ctl02 salt-minion[14967]: [INFO    ] {'shell': '/bin/false', 'workphone': '', 'uid': 301, 'passwd': 'x', 'roomnumber': '', 'groups': ['keystone'], 'home': '/var/lib/keystone', 'name': 'keystone', 'gid': 301, 'fullname': '', 'homephone': ''}
Sep 28 11:10:38 ctl02 salt-minion[14967]: [INFO    ] Completed state [keystone] at time 11:10:38.645227 duration_in_ms=346.479
Sep 28 11:10:38 ctl02 salt-minion[14967]: [INFO    ] Running state [mysql-client] at time 11:10:38.646114
Sep 28 11:10:38 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for mysql-client
Sep 28 11:10:38 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemd-run', '--scope', 'apt-get', '-q', '-y', '-o', 'DPkg::Options::=--force-confold', '-o', 'DPkg::Options::=--force-confdef', 'install', 'mysql-client'] in directory '/root'
Sep 28 11:10:38 ctl02 systemd[1]: Started /usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold -o DPkg::Options::=--force-confdef install mysql-client.
Sep 28 11:10:39 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8459232f)
Sep 28 11:10:42 ctl02 dhclient[627]: message repeated 3 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8459232f)]
Sep 28 11:10:42 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928111042729883
Sep 28 11:10:42 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 23840
Sep 28 11:10:42 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928111042729883
Sep 28 11:10:43 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:10:43 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:10:49 ctl02 salt-minion[14967]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 11:10:49 ctl02 salt-minion[14967]: [INFO    ] Made the following changes:
Sep 28 11:10:49 ctl02 salt-minion[14967]: 'mysql-client' changed from 'absent' to '5.7.19-0ubuntu0.16.04.1'
Sep 28 11:10:49 ctl02 salt-minion[14967]: 'libaio1' changed from 'absent' to '0.3.110-2'
Sep 28 11:10:49 ctl02 salt-minion[14967]: 'mysql-common-5.6' changed from 'absent' to '1'
Sep 28 11:10:49 ctl02 salt-minion[14967]: 'mysql-client-core-5.7' changed from 'absent' to '5.7.19-0ubuntu0.16.04.1'
Sep 28 11:10:49 ctl02 salt-minion[14967]: 'mysql-client-5.7' changed from 'absent' to '5.7.19-0ubuntu0.16.04.1'
Sep 28 11:10:49 ctl02 salt-minion[14967]: 'virtual-mysql-client-core' changed from 'absent' to '1'
Sep 28 11:10:49 ctl02 salt-minion[14967]: 'mysql-common' changed from 'absent' to '5.7.19-0ubuntu0.16.04.1'
Sep 28 11:10:49 ctl02 salt-minion[14967]: 'virtual-mysql-client' changed from 'absent' to '1'
Sep 28 11:10:49 ctl02 salt-minion[14967]: 'libnuma1' changed from 'absent' to '2.0.11-1ubuntu1'
Sep 28 11:10:49 ctl02 salt-minion[14967]: [INFO    ] Loading fresh modules for state activity
Sep 28 11:10:49 ctl02 salt-minion[14967]: [INFO    ] Completed state [mysql-client] at time 11:10:49.796773 duration_in_ms=11150.658
Sep 28 11:10:49 ctl02 salt-minion[14967]: [INFO    ] Running state [python-keystoneclient] at time 11:10:49.803434
Sep 28 11:10:49 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for python-keystoneclient
Sep 28 11:10:50 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemd-run', '--scope', 'apt-get', '-q', '-y', '-o', 'DPkg::Options::=--force-confold', '-o', 'DPkg::Options::=--force-confdef', 'install', 'python-keystoneclient'] in directory '/root'
Sep 28 11:10:50 ctl02 systemd[1]: Started /usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold -o DPkg::Options::=--force-confdef install python-keystoneclient.
Sep 28 11:10:52 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928111052939407
Sep 28 11:10:52 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 23949
Sep 28 11:10:52 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928111052939407
Sep 28 11:10:56 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x22510229)
Sep 28 11:11:02 ctl02 dhclient[627]: message repeated 6 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x22510229)]
Sep 28 11:11:03 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928111103129576
Sep 28 11:11:03 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 24090
Sep 28 11:11:03 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928111103129576
Sep 28 11:11:03 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x22510229)
Sep 28 11:11:06 ctl02 dhclient[627]: message repeated 3 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x22510229)]
Sep 28 11:11:07 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:11:07 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:11:13 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928111113175144
Sep 28 11:11:13 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 24255
Sep 28 11:11:13 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928111113175144
Sep 28 11:11:23 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x37b26c1e)
Sep 28 11:11:23 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928111123372298
Sep 28 11:11:23 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 24396
Sep 28 11:11:23 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928111123372298
Sep 28 11:11:24 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x37b26c1e)
Sep 28 11:11:33 ctl02 dhclient[627]: message repeated 9 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x37b26c1e)]
Sep 28 11:11:33 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928111133579768
Sep 28 11:11:33 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 24401
Sep 28 11:11:33 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928111133579768
Sep 28 11:11:34 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:11:34 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:11:42 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc4fb76e)
Sep 28 11:11:43 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc4fb76e)
Sep 28 11:11:43 ctl02 salt-minion[14967]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 11:11:43 ctl02 salt-minion[14967]: [INFO    ] Made the following changes:
Sep 28 11:11:43 ctl02 salt-minion[14967]: 'python2.7-netifaces' changed from 'absent' to '1'
Sep 28 11:11:43 ctl02 salt-minion[14967]: 'python-wrapt' changed from 'absent' to '1.8.0-5build2'
Sep 28 11:11:43 ctl02 salt-minion[14967]: 'python-tz' changed from 'absent' to '2014.10~dfsg1-0ubuntu2'
Sep 28 11:11:43 ctl02 salt-minion[14967]: 'liblcms2-2' changed from 'absent' to '2.6-3ubuntu2'
Sep 28 11:11:43 ctl02 salt-minion[14967]: 'libtiff5' changed from 'absent' to '4.0.6-1ubuntu0.2'
Sep 28 11:11:43 ctl02 salt-minion[14967]: 'libjpeg-turbo8' changed from 'absent' to '1.4.2-0ubuntu3'
Sep 28 11:11:43 ctl02 salt-minion[14967]: 'python-lxml' changed from 'absent' to '3.5.0-1build1'
Sep 28 11:11:43 ctl02 salt-minion[14967]: 'python-oslo.config' changed from 'absent' to '1:3.9.0-3'
Sep 28 11:11:43 ctl02 salt-minion[14967]: 'python-secretstorage' changed from 'absent' to '2.1.3-1'
Sep 28 11:11:43 ctl02 salt-minion[14967]: 'python-pygments' changed from 'absent' to '2.1+dfsg-1'
Sep 28 11:11:43 ctl02 salt-minion[14967]: 'libwebp5' changed from 'absent' to '0.4.4-1'
Sep 28 11:11:43 ctl02 salt-minion[14967]: 'libpaper1' changed from 'absent' to '1.1.24+nmu4ubuntu1'
Sep 28 11:11:43 ctl02 salt-minion[14967]: 'python2.7-gi' changed from 'absent' to '1'
Sep 28 11:11:43 ctl02 salt-minion[14967]: 'python-netifaces' changed from 'absent' to '0.10.4-0.1build2'
Sep 28 11:11:43 ctl02 salt-minion[14967]: 'docutils' changed from 'absent' to '1'
Sep 28 11:11:43 ctl02 salt-minion[14967]: 'ieee-data' changed from 'absent' to '20150531.1'
Sep 28 11:11:43 ctl02 salt-minion[14967]: 'python-debtcollector' changed from 'absent' to '1.3.0-2'
Sep 28 11:11:43 ctl02 salt-minion[14967]: 'python-gi' changed from 'absent' to '3.20.0-0ubuntu1'
Sep 28 11:11:43 ctl02 salt-minion[14967]: 'python-roman' changed from 'absent' to '2.0.0-2'
Sep 28 11:11:43 ctl02 salt-minion[14967]: 'libpaper-utils' changed from 'absent' to '1.1.24+nmu4ubuntu1'
Sep 28 11:11:43 ctl02 salt-minion[14967]: 'python-bs4' changed from 'absent' to '4.4.1-1'
Sep 28 11:11:43 ctl02 salt-minion[14967]: 'python-pillow' changed from 'absent' to '1'
Sep 28 11:11:43 ctl02 salt-minion[14967]: 'python2.7-lxml' changed from 'absent' to '1'
Sep 28 11:11:43 ctl02 salt-minion[14967]: 'python-oslo.serialization' changed from 'absent' to '2.4.0-2'
Sep 28 11:11:43 ctl02 salt-minion[14967]: 'python-oslo.utils' changed from 'absent' to '3.8.0-2'
Sep 28 11:11:43 ctl02 salt-minion[14967]: 'python-keystoneclient' changed from 'absent' to '1:2.3.1-2'
Sep 28 11:11:43 ctl02 salt-minion[14967]: 'python-funcsigs' changed from 'absent' to '0.4-2'
Sep 28 11:11:43 ctl02 salt-minion[14967]: 'python2.7-dbus' changed from 'absent' to '1'
Sep 28 11:11:43 ctl02 salt-minion[14967]: 'python-keystoneauth1' changed from 'absent' to '2.4.1-1ubuntu0.16.04.1'
Sep 28 11:11:43 ctl02 salt-minion[14967]: 'libjbig0' changed from 'absent' to '2.1-3.1'
Sep 28 11:11:43 ctl02 salt-minion[14967]: 'docutils-doc' changed from 'absent' to '0.12+dfsg-1'
Sep 28 11:11:43 ctl02 salt-minion[14967]: 'python-dbus' changed from 'absent' to '1.2.0-3'
Sep 28 11:11:43 ctl02 salt-minion[14967]: 'python2.7-iso8601' changed from 'absent' to '1'
Sep 28 11:11:43 ctl02 salt-minion[14967]: 'python-keyring' changed from 'absent' to '7.3-1ubuntu1'
Sep 28 11:11:43 ctl02 salt-minion[14967]: 'libxslt1.1' changed from 'absent' to '1.1.28-2.1ubuntu0.1'
Sep 28 11:11:43 ctl02 salt-minion[14967]: 'python-monotonic' changed from 'absent' to '0.6-2'
Sep 28 11:11:43 ctl02 salt-minion[14967]: 'python-docutils' changed from 'absent' to '0.12+dfsg-1'
Sep 28 11:11:43 ctl02 salt-minion[14967]: 'python2.7-pil' changed from 'absent' to '1'
Sep 28 11:11:43 ctl02 salt-minion[14967]: 'libpaperg' changed from 'absent' to '1'
Sep 28 11:11:43 ctl02 salt-minion[14967]: 'python-stevedore' changed from 'absent' to '1.12.0-1'
Sep 28 11:11:43 ctl02 salt-minion[14967]: 'python-babel-localedata' changed from 'absent' to '1.3+dfsg.1-6'
Sep 28 11:11:43 ctl02 salt-minion[14967]: 'python-positional' changed from 'absent' to '1.0.1-2'
Sep 28 11:11:43 ctl02 salt-minion[14967]: 'python-prettytable' changed from 'absent' to '0.7.2-3'
Sep 28 11:11:43 ctl02 salt-minion[14967]: 'python-pbr' changed from 'absent' to '1.8.0-4ubuntu1'
Sep 28 11:11:43 ctl02 salt-minion[14967]: 'python-netaddr' changed from 'absent' to '0.7.18-1'
Sep 28 11:11:43 ctl02 salt-minion[14967]: 'python-oslo.i18n' changed from 'absent' to '3.5.0-2'
Sep 28 11:11:43 ctl02 salt-minion[14967]: 'python-oslo-utils' changed from 'absent' to '1'
Sep 28 11:11:43 ctl02 salt-minion[14967]: 'python-babel' changed from 'absent' to '1.3+dfsg.1-6'
Sep 28 11:11:43 ctl02 salt-minion[14967]: 'python-html5lib' changed from 'absent' to '0.999-4'
Sep 28 11:11:43 ctl02 salt-minion[14967]: 'python-pil' changed from 'absent' to '3.1.2-0ubuntu1.1'
Sep 28 11:11:43 ctl02 salt-minion[14967]: 'libjpeg8' changed from 'absent' to '8c-2ubuntu8'
Sep 28 11:11:43 ctl02 salt-minion[14967]: 'docutils-common' changed from 'absent' to '0.12+dfsg-1'
Sep 28 11:11:43 ctl02 salt-minion[14967]: 'python-iso8601' changed from 'absent' to '0.1.11-1'
Sep 28 11:11:43 ctl02 salt-minion[14967]: 'libwebpmux1' changed from 'absent' to '0.4.4-1'
Sep 28 11:11:43 ctl02 salt-minion[14967]: [INFO    ] Loading fresh modules for state activity
Sep 28 11:11:43 ctl02 salt-minion[14967]: [INFO    ] Completed state [python-keystoneclient] at time 11:11:43.654720 duration_in_ms=53851.285
Sep 28 11:11:43 ctl02 salt-minion[14967]: [INFO    ] Running state [python-mysqldb] at time 11:11:43.662188
Sep 28 11:11:43 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for python-mysqldb
Sep 28 11:11:43 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928111143795953
Sep 28 11:11:43 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 24766
Sep 28 11:11:44 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928111143795953
Sep 28 11:11:44 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemd-run', '--scope', 'apt-get', '-q', '-y', '-o', 'DPkg::Options::=--force-confold', '-o', 'DPkg::Options::=--force-confdef', 'install', 'python-mysqldb'] in directory '/root'
Sep 28 11:11:44 ctl02 systemd[1]: Started /usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold -o DPkg::Options::=--force-confdef install python-mysqldb.
Sep 28 11:11:44 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc4fb76e)
Sep 28 11:11:47 ctl02 dhclient[627]: message repeated 3 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc4fb76e)]
Sep 28 11:11:47 ctl02 salt-minion[14967]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 11:11:47 ctl02 salt-minion[14967]: [INFO    ] Made the following changes:
Sep 28 11:11:47 ctl02 salt-minion[14967]: 'python2.7-mysqldb' changed from 'absent' to '1'
Sep 28 11:11:47 ctl02 salt-minion[14967]: 'libmysqlclient20' changed from 'absent' to '5.7.19-0ubuntu0.16.04.1'
Sep 28 11:11:47 ctl02 salt-minion[14967]: 'python-mysqldb' changed from 'absent' to '1.3.7-1build2'
Sep 28 11:11:47 ctl02 salt-minion[14967]: [INFO    ] Loading fresh modules for state activity
Sep 28 11:11:47 ctl02 salt-minion[14967]: [INFO    ] Completed state [python-mysqldb] at time 11:11:47.620534 duration_in_ms=3958.346
Sep 28 11:11:47 ctl02 salt-minion[14967]: [INFO    ] Running state [python-openstackclient] at time 11:11:47.626307
Sep 28 11:11:47 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for python-openstackclient
Sep 28 11:11:47 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemd-run', '--scope', 'apt-get', '-q', '-y', '-o', 'DPkg::Options::=--force-confold', '-o', 'DPkg::Options::=--force-confdef', 'install', 'python-openstackclient'] in directory '/root'
Sep 28 11:11:47 ctl02 systemd[1]: Started /usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold -o DPkg::Options::=--force-confdef install python-openstackclient.
Sep 28 11:11:48 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc4fb76e)
Sep 28 11:11:52 ctl02 dhclient[627]: message repeated 4 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc4fb76e)]
Sep 28 11:11:53 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:11:53 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:11:53 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928111153981081
Sep 28 11:11:54 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 24989
Sep 28 11:11:54 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928111153981081
Sep 28 11:12:01 ctl02 salt-minion[14967]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 11:12:01 ctl02 salt-minion[14967]: [INFO    ] Made the following changes:
Sep 28 11:12:01 ctl02 salt-minion[14967]: 'python-novaclient' changed from 'absent' to '2:3.3.1-2ubuntu1'
Sep 28 11:12:01 ctl02 salt-minion[14967]: 'python-mock' changed from 'absent' to '1.3.0-2.1ubuntu1'
Sep 28 11:12:01 ctl02 salt-minion[14967]: 'python-warlock' changed from 'absent' to '1.1.0-1'
Sep 28 11:12:01 ctl02 salt-minion[14967]: 'python-unicodecsv' changed from 'absent' to '0.14.1-1'
Sep 28 11:12:01 ctl02 salt-minion[14967]: 'python-simplejson' changed from 'absent' to '3.8.1-1ubuntu2'
Sep 28 11:12:01 ctl02 salt-minion[14967]: 'python2.7-pyparsing' changed from 'absent' to '1'
Sep 28 11:12:01 ctl02 salt-minion[14967]: 'python-jsonpatch' changed from 'absent' to '1.19-3'
Sep 28 11:12:01 ctl02 salt-minion[14967]: 'python-openstacksdk' changed from 'absent' to '0.8.1-2'
Sep 28 11:12:01 ctl02 salt-minion[14967]: 'python-appdirs' changed from 'absent' to '1.4.0-2'
Sep 28 11:12:01 ctl02 salt-minion[14967]: 'python-pyparsing' changed from 'absent' to '2.0.3+dfsg1-1ubuntu0.1'
Sep 28 11:12:01 ctl02 salt-minion[14967]: 'python-glanceclient' changed from 'absent' to '1:2.0.0-2ubuntu0.16.04.1'
Sep 28 11:12:01 ctl02 salt-minion[14967]: 'python-functools32' changed from 'absent' to '3.2.3.2-2'
Sep 28 11:12:01 ctl02 salt-minion[14967]: 'python-cmd2' changed from 'absent' to '0.6.8-1'
Sep 28 11:12:01 ctl02 salt-minion[14967]: 'python-cliff' changed from 'absent' to '1.15.0-2ubuntu2'
Sep 28 11:12:01 ctl02 salt-minion[14967]: 'python-openstackclient' changed from 'absent' to '2.3.1-0ubuntu1'
Sep 28 11:12:01 ctl02 salt-minion[14967]: 'python2.7-simplejson' changed from 'absent' to '1'
Sep 28 11:12:01 ctl02 salt-minion[14967]: 'python-os-client-config' changed from 'absent' to '1.16.0-0ubuntu1'
Sep 28 11:12:01 ctl02 salt-minion[14967]: 'python-cinderclient' changed from 'absent' to '1:1.6.0-2ubuntu1'
Sep 28 11:12:01 ctl02 salt-minion[14967]: 'python-requestsexceptions' changed from 'absent' to '1.1.2-0ubuntu1'
Sep 28 11:12:01 ctl02 salt-minion[14967]: 'python-neutronclient' changed from 'absent' to '1:4.1.1-2'
Sep 28 11:12:01 ctl02 salt-minion[14967]: 'python2.7-cmd2' changed from 'absent' to '1'
Sep 28 11:12:01 ctl02 salt-minion[14967]: 'python-jsonschema' changed from 'absent' to '2.5.1-4'
Sep 28 11:12:01 ctl02 salt-minion[14967]: 'python2.7-cinderclient' changed from 'absent' to '1'
Sep 28 11:12:01 ctl02 salt-minion[14967]: 'python-json-pointer' changed from 'absent' to '1.9-3'
Sep 28 11:12:01 ctl02 salt-minion[14967]: [INFO    ] Loading fresh modules for state activity
Sep 28 11:12:01 ctl02 salt-minion[14967]: [INFO    ] Completed state [python-openstackclient] at time 11:12:01.379391 duration_in_ms=13753.084
Sep 28 11:12:01 ctl02 salt-minion[14967]: [INFO    ] Running state [python-memcache] at time 11:12:01.384992
Sep 28 11:12:01 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for python-memcache
Sep 28 11:12:01 ctl02 salt-minion[14967]: [INFO    ] Package python-memcache is already installed
Sep 28 11:12:01 ctl02 salt-minion[14967]: [INFO    ] Completed state [python-memcache] at time 11:12:01.727820 duration_in_ms=342.827
Sep 28 11:12:01 ctl02 salt-minion[14967]: [INFO    ] Running state [python-pycadf] at time 11:12:01.728533
Sep 28 11:12:01 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for python-pycadf
Sep 28 11:12:01 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemd-run', '--scope', 'apt-get', '-q', '-y', '-o', 'DPkg::Options::=--force-confold', '-o', 'DPkg::Options::=--force-confdef', 'install', 'python-pycadf'] in directory '/root'
Sep 28 11:12:01 ctl02 systemd[1]: Started /usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold -o DPkg::Options::=--force-confdef install python-pycadf.
Sep 28 11:12:04 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928111204204936
Sep 28 11:12:04 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 25294
Sep 28 11:12:04 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928111204204936
Sep 28 11:12:04 ctl02 salt-minion[14967]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 11:12:04 ctl02 salt-minion[14967]: [INFO    ] Made the following changes:
Sep 28 11:12:04 ctl02 salt-minion[14967]: 'pycadf-common' changed from 'absent' to '2.2.0-1'
Sep 28 11:12:04 ctl02 salt-minion[14967]: 'python-pycadf' changed from 'absent' to '2.2.0-1'
Sep 28 11:12:04 ctl02 salt-minion[14967]: [INFO    ] Loading fresh modules for state activity
Sep 28 11:12:04 ctl02 salt-minion[14967]: [INFO    ] Completed state [python-pycadf] at time 11:12:04.341905 duration_in_ms=2613.372
Sep 28 11:12:04 ctl02 salt-minion[14967]: [INFO    ] Running state [python-six] at time 11:12:04.347046
Sep 28 11:12:04 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for python-six
Sep 28 11:12:04 ctl02 salt-minion[14967]: [INFO    ] Package python-six is already installed
Sep 28 11:12:04 ctl02 salt-minion[14967]: [INFO    ] Completed state [python-six] at time 11:12:04.559474 duration_in_ms=212.428
Sep 28 11:12:04 ctl02 salt-minion[14967]: [INFO    ] Running state [keystone] at time 11:12:04.560142
Sep 28 11:12:04 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for keystone
Sep 28 11:12:04 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemd-run', '--scope', 'apt-get', '-q', '-y', '-o', 'DPkg::Options::=--force-confold', '-o', 'DPkg::Options::=--force-confdef', 'install', 'keystone'] in directory '/root'
Sep 28 11:12:04 ctl02 systemd[1]: Started /usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold -o DPkg::Options::=--force-confdef install keystone.
Sep 28 11:12:08 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4a9a6002)
Sep 28 11:12:13 ctl02 dhclient[627]: message repeated 5 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4a9a6002)]
Sep 28 11:12:14 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928111214225507
Sep 28 11:12:14 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 25501
Sep 28 11:12:14 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928111214225507
Sep 28 11:12:14 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4a9a6002)
Sep 28 11:12:18 ctl02 dhclient[627]: message repeated 4 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4a9a6002)]
Sep 28 11:12:19 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:12:19 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:12:24 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928111224250592
Sep 28 11:12:24 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 25765
Sep 28 11:12:24 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928111224250592
Sep 28 11:12:32 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3a38c13)
Sep 28 11:12:33 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3a38c13)
Sep 28 11:12:34 ctl02 systemd[1]: Reloading.
Sep 28 11:12:34 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928111234285169
Sep 28 11:12:34 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 26004
Sep 28 11:12:34 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928111234285169
Sep 28 11:12:34 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3a38c13)
Sep 28 11:12:42 ctl02 dhclient[627]: message repeated 7 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3a38c13)]
Sep 28 11:12:43 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:12:43 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:12:44 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928111244535891
Sep 28 11:12:44 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 26327
Sep 28 11:12:44 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928111244535891
Sep 28 11:12:53 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd0d75d54)
Sep 28 11:12:54 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd0d75d54)
Sep 28 11:12:54 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928111254562555
Sep 28 11:12:54 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 26424
Sep 28 11:12:54 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928111254562555
Sep 28 11:12:55 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd0d75d54)
Sep 28 11:12:56 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd0d75d54)
Sep 28 11:12:57 ctl02 systemd[1]: Reloading.
Sep 28 11:12:57 ctl02 systemd[1]: message repeated 2 times: [ Reloading.]
Sep 28 11:12:57 ctl02 systemd[1]: Starting OpenStack Identity service...
Sep 28 11:12:57 ctl02 systemd[1]: Started OpenStack Identity service.
Sep 28 11:12:57 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd0d75d54)
Sep 28 11:12:57 ctl02 systemd[1]: Reloading.
Sep 28 11:12:57 ctl02 keystone[26510]: 2017-09-28 11:12:57.802 26510 WARNING keystone.assignment.core [-] Deprecated: Use of the identity driver config to automatically configure the same assignment driver has been deprecated, in the "O" release, the assignment driver will need to be expicitly configured if different than the default (SQL).
Sep 28 11:12:57 ctl02 keystone[26510]: 2017-09-28 11:12:57.895 26510 WARNING keystone.middleware.core [-] The admin_token_auth middleware presents a security risk and should be removed from the [pipeline:api_v3], [pipeline:admin_api], and [pipeline:public_api] sections of your paste ini file.
Sep 28 11:12:57 ctl02 keystone[26510]: 2017-09-28 11:12:57.924 26510 WARNING keystone.middleware.core [-] The admin_token_auth middleware presents a security risk and should be removed from the [pipeline:api_v3], [pipeline:admin_api], and [pipeline:public_api] sections of your paste ini file.
Sep 28 11:12:57 ctl02 keystone[26510]: 2017-09-28 11:12:57.957 26510 WARNING keystone.middleware.core [-] The admin_token_auth middleware presents a security risk and should be removed from the [pipeline:api_v3], [pipeline:admin_api], and [pipeline:public_api] sections of your paste ini file.
Sep 28 11:12:57 ctl02 keystone[26510]: 2017-09-28 11:12:57.986 26510 WARNING keystone.middleware.core [-] The admin_token_auth middleware presents a security risk and should be removed from the [pipeline:api_v3], [pipeline:admin_api], and [pipeline:public_api] sections of your paste ini file.
Sep 28 11:12:57 ctl02 keystone[26510]: 2017-09-28 11:12:57.998 26510 WARNING root [-] Running keystone via eventlet is deprecated as of Kilo in favor of running in a WSGI server (e.g. mod_wsgi). Support for keystone under eventlet will be removed in the "M"-Release.
Sep 28 11:12:58 ctl02 keystone[26510]: 2017-09-28 11:12:58.000 26510 ERROR keystone.common.environment.eventlet_server [-] Could not bind to 0.0.0.0:35357
Sep 28 11:12:58 ctl02 keystone[26510]: 2017-09-28 11:12:58.000 26510 ERROR root [-] Failed to start the admin server
Sep 28 11:12:58 ctl02 keystone[26510]: 2017-09-28 11:12:58.000 26510 ERROR root Traceback (most recent call last):
Sep 28 11:12:58 ctl02 keystone[26510]: 2017-09-28 11:12:58.000 26510 ERROR root   File "/usr/lib/python2.7/dist-packages/keystone/server/eventlet.py", line 88, in serve
Sep 28 11:12:58 ctl02 keystone[26510]: 2017-09-28 11:12:58.000 26510 ERROR root     server.launch_with(launcher)
Sep 28 11:12:58 ctl02 keystone[26510]: 2017-09-28 11:12:58.000 26510 ERROR root   File "/usr/lib/python2.7/dist-packages/keystone/server/eventlet.py", line 54, in launch_with
Sep 28 11:12:58 ctl02 keystone[26510]: 2017-09-28 11:12:58.000 26510 ERROR root     self.server.listen()
Sep 28 11:12:58 ctl02 keystone[26510]: 2017-09-28 11:12:58.000 26510 ERROR root   File "/usr/lib/python2.7/dist-packages/keystone/common/environment/eventlet_server.py", line 110, in listen
Sep 28 11:12:58 ctl02 keystone[26510]: 2017-09-28 11:12:58.000 26510 ERROR root     backlog=backlog)
Sep 28 11:12:58 ctl02 keystone[26510]: 2017-09-28 11:12:58.000 26510 ERROR root   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:12:58 ctl02 keystone[26510]: 2017-09-28 11:12:58.000 26510 ERROR root     sock.listen(backlog)
Sep 28 11:12:58 ctl02 keystone[26510]: 2017-09-28 11:12:58.000 26510 ERROR root   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:12:58 ctl02 keystone[26510]: 2017-09-28 11:12:58.000 26510 ERROR root     return getattr(self._sock,name)(*args)
Sep 28 11:12:58 ctl02 keystone[26510]: 2017-09-28 11:12:58.000 26510 ERROR root error: [Errno 98] Address already in use
Sep 28 11:12:58 ctl02 keystone[26510]: 2017-09-28 11:12:58.000 26510 ERROR root
Sep 28 11:12:58 ctl02 keystone[26510]: 2017-09-28 11:12:58.017 26510 CRITICAL keystone [-] error: [Errno 98] Address already in use
Sep 28 11:12:58 ctl02 keystone[26510]: 2017-09-28 11:12:58.017 26510 ERROR keystone Traceback (most recent call last):
Sep 28 11:12:58 ctl02 keystone[26510]: 2017-09-28 11:12:58.017 26510 ERROR keystone   File "/usr/bin/keystone-all", line 10, in <module>
Sep 28 11:12:58 ctl02 keystone[26510]: 2017-09-28 11:12:58.017 26510 ERROR keystone     sys.exit(main())
Sep 28 11:12:58 ctl02 keystone[26510]: 2017-09-28 11:12:58.017 26510 ERROR keystone   File "/usr/lib/python2.7/dist-packages/keystone/cmd/all.py", line 39, in main
Sep 28 11:12:58 ctl02 keystone[26510]: 2017-09-28 11:12:58.017 26510 ERROR keystone     eventlet_server.run(possible_topdir)
Sep 28 11:12:58 ctl02 keystone[26510]: 2017-09-28 11:12:58.017 26510 ERROR keystone   File "/usr/lib/python2.7/dist-packages/keystone/server/eventlet.py", line 156, in run
Sep 28 11:12:58 ctl02 keystone[26510]: 2017-09-28 11:12:58.017 26510 ERROR keystone     serve(*servers)
Sep 28 11:12:58 ctl02 keystone[26510]: 2017-09-28 11:12:58.017 26510 ERROR keystone   File "/usr/lib/python2.7/dist-packages/keystone/server/eventlet.py", line 88, in serve
Sep 28 11:12:58 ctl02 keystone[26510]: 2017-09-28 11:12:58.017 26510 ERROR keystone     server.launch_with(launcher)
Sep 28 11:12:58 ctl02 keystone[26510]: 2017-09-28 11:12:58.017 26510 ERROR keystone   File "/usr/lib/python2.7/dist-packages/keystone/server/eventlet.py", line 54, in launch_with
Sep 28 11:12:58 ctl02 keystone[26510]: 2017-09-28 11:12:58.017 26510 ERROR keystone     self.server.listen()
Sep 28 11:12:58 ctl02 keystone[26510]: 2017-09-28 11:12:58.017 26510 ERROR keystone   File "/usr/lib/python2.7/dist-packages/keystone/common/environment/eventlet_server.py", line 110, in listen
Sep 28 11:12:58 ctl02 keystone[26510]: 2017-09-28 11:12:58.017 26510 ERROR keystone     backlog=backlog)
Sep 28 11:12:58 ctl02 keystone[26510]: 2017-09-28 11:12:58.017 26510 ERROR keystone   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:12:58 ctl02 keystone[26510]: 2017-09-28 11:12:58.017 26510 ERROR keystone     sock.listen(backlog)
Sep 28 11:12:58 ctl02 keystone[26510]: 2017-09-28 11:12:58.017 26510 ERROR keystone   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:12:58 ctl02 keystone[26510]: 2017-09-28 11:12:58.017 26510 ERROR keystone     return getattr(self._sock,name)(*args)
Sep 28 11:12:58 ctl02 keystone[26510]: 2017-09-28 11:12:58.017 26510 ERROR keystone error: [Errno 98] Address already in use
Sep 28 11:12:58 ctl02 keystone[26510]: 2017-09-28 11:12:58.017 26510 ERROR keystone
Sep 28 11:12:58 ctl02 salt-minion[14967]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 11:12:58 ctl02 salt-minion[14967]: [INFO    ] Made the following changes:
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-routes' changed from 'absent' to '2.2-1ubuntu2'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-retrying' changed from 'absent' to '1.3.3-1'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-kombu' changed from 'absent' to '3.0.33-1ubuntu2'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-oslo.concurrency' changed from 'absent' to '3.7.1-0ubuntu1'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-oslo.service' changed from 'absent' to '1.8.0-1ubuntu1'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-sqlparse' changed from 'absent' to '0.1.18-1'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'xmlsec1' changed from 'absent' to '1.2.20-2ubuntu4'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-paste' changed from 'absent' to '1.7.5.1-6ubuntu3'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-formencode' changed from 'absent' to '1.3.0-0ubuntu5'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-futurist' changed from 'absent' to '0.13.0-2'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-fasteners' changed from 'absent' to '0.12.0-2ubuntu1'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-cachetools' changed from 'absent' to '1.1.5-1'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-linecache2' changed from 'absent' to '1.0.0-2'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-pastedeploy-tpl' changed from 'absent' to '1.5.2-1'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-oauthlib' changed from 'absent' to '1.0.3-1'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-oslo-db' changed from 'absent' to '1'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-blinker' changed from 'absent' to '1.3.dfsg2-1build1'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-pastescript' changed from 'absent' to '1.7.5-3build1'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-setuptools' changed from 'absent' to '20.7.0-1'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-pika-pool' changed from 'absent' to '0.1.3-1ubuntu1'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-webob' changed from 'absent' to '1.5.1-1'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-traceback2' changed from 'absent' to '1.4.0-3'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-testtools' changed from 'absent' to '1.8.1-0ubuntu1'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-anyjson' changed from 'absent' to '0.3.3-1build1'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-openid' changed from 'absent' to '2.2.5-6'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-pastedeploy' changed from 'absent' to '1.5.2-1'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-keystone' changed from 'absent' to '2:9.3.0-0ubuntu3'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-oslo.policy' changed from 'absent' to '1.6.0-2'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-contextlib2' changed from 'absent' to '0.5.1-1'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python2.7-zope.interface' changed from 'absent' to '1'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-dnspython' changed from 'absent' to '1.12.0-1'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'libxmlsec1-openssl' changed from 'absent' to '1.2.20-2ubuntu4'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-alembic' changed from 'absent' to '0.8.2-3ubuntu1'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-dogpile.core' changed from 'absent' to '0.4.1+dfsg1-3'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-pysaml2' changed from 'absent' to '3.0.0-3ubuntu1.16.04.1'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-oslo.db' changed from 'absent' to '4.7.0-2ubuntu1'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python2.7-sqlalchemy-ext' changed from 'absent' to '1'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-eventlet' changed from 'absent' to '0.18.4-1ubuntu1'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-unittest2' changed from 'absent' to '1.1.0-6.1'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-oslo.log' changed from 'absent' to '3.2.0-2'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-extras' changed from 'absent' to '0.0.3-3'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-pyinotify' changed from 'absent' to '0.9.6-0fakesync1'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-amqp' changed from 'absent' to '1.4.9-1'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-scgi' changed from 'absent' to '1.13-1.1build1'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-jwt' changed from 'absent' to '1.3.0-1ubuntu0.1'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-zope.interface' changed from 'absent' to '4.1.3-1build1'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-repoze.lru' changed from 'absent' to '0.6-6'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-posix-ipc' changed from 'absent' to '0.9.8-2build2'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'formencode-i18n' changed from 'absent' to '1.3.0-0ubuntu5'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python2.7-keystone' changed from 'absent' to '1'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python2.7-testtools' changed from 'absent' to '1'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-decorator' changed from 'absent' to '4.0.6-1'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-fixtures' changed from 'absent' to '1.3.1-2'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-oslo.messaging' changed from 'absent' to '4.6.1-2ubuntu2'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'keystone' changed from 'absent' to '2:9.3.0-0ubuntu3'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-tempita' changed from 'absent' to '0.5.2-1build1'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-oslo.middleware' changed from 'absent' to '3.8.0-2'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-dogpile.cache' changed from 'absent' to '0.5.7-1ubuntu1'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-pika' changed from 'absent' to '0.10.0-1'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-passlib' changed from 'absent' to '1.6.5-4'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-greenlet' changed from 'absent' to '0.4.9-2fakesync1'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-sqlalchemy-ext' changed from 'absent' to '1.0.11+ds1-1ubuntu2'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-oslo.context' changed from 'absent' to '2.2.0-2'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'libxmlsec1' changed from 'absent' to '1.2.20-2ubuntu4'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-oslo.cache' changed from 'absent' to '1.6.0-2'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-zopeinterface' changed from 'absent' to '1'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-defusedxml' changed from 'absent' to '0.4.1-2ubuntu0.16.04.1'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python2.7-pyinotify' changed from 'absent' to '1'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-migrate' changed from 'absent' to '0.10.0-3ubuntu2'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-sqlalchemy' changed from 'absent' to '1.0.11+ds1-1ubuntu2'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-mimeparse' changed from 'absent' to '0.1.4-1build1'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-keystonemiddleware' changed from 'absent' to '4.4.1-0ubuntu1'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-distribute' changed from 'absent' to '1'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-zope' changed from 'absent' to '1'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-oslo-log' changed from 'absent' to '1'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'python-oslo-context' changed from 'absent' to '1'
Sep 28 11:12:58 ctl02 salt-minion[14967]: 'alembic' changed from 'absent' to '0.8.2-3ubuntu1'
Sep 28 11:12:58 ctl02 salt-minion[14967]: [INFO    ] Loading fresh modules for state activity
Sep 28 11:12:58 ctl02 systemd[1]: keystone.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:12:58 ctl02 systemd[1]: keystone.service: Unit entered failed state.
Sep 28 11:12:58 ctl02 systemd[1]: keystone.service: Failed with result 'exit-code'.
Sep 28 11:12:58 ctl02 salt-minion[14967]: [INFO    ] Completed state [keystone] at time 11:12:58.108717 duration_in_ms=53548.574
Sep 28 11:12:58 ctl02 salt-minion[14967]: [INFO    ] Running state [gettext-base] at time 11:12:58.114457
Sep 28 11:12:58 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for gettext-base
Sep 28 11:12:58 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd0d75d54)
Sep 28 11:12:58 ctl02 salt-minion[14967]: [INFO    ] Package gettext-base is already installed
Sep 28 11:12:58 ctl02 salt-minion[14967]: [INFO    ] Completed state [gettext-base] at time 11:12:58.325191 duration_in_ms=210.734
Sep 28 11:12:58 ctl02 salt-minion[14967]: [INFO    ] Running state [python-psycopg2] at time 11:12:58.325788
Sep 28 11:12:58 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for python-psycopg2
Sep 28 11:12:58 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemd-run', '--scope', 'apt-get', '-q', '-y', '-o', 'DPkg::Options::=--force-confold', '-o', 'DPkg::Options::=--force-confdef', 'install', 'python-psycopg2'] in directory '/root'
Sep 28 11:12:58 ctl02 systemd[1]: keystone.service: Service hold-off time over, scheduling restart.
Sep 28 11:12:58 ctl02 systemd[1]: Stopped OpenStack Identity service.
Sep 28 11:12:58 ctl02 systemd[1]: Starting OpenStack Identity service...
Sep 28 11:12:58 ctl02 systemd[1]: Started OpenStack Identity service.
Sep 28 11:12:58 ctl02 systemd[1]: Started /usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold -o DPkg::Options::=--force-confdef install python-psycopg2.
Sep 28 11:12:58 ctl02 keystone[26588]: 2017-09-28 11:12:58.945 26588 WARNING keystone.assignment.core [-] Deprecated: Use of the identity driver config to automatically configure the same assignment driver has been deprecated, in the "O" release, the assignment driver will need to be expicitly configured if different than the default (SQL).
Sep 28 11:12:59 ctl02 keystone[26588]: 2017-09-28 11:12:59.032 26588 WARNING keystone.middleware.core [-] The admin_token_auth middleware presents a security risk and should be removed from the [pipeline:api_v3], [pipeline:admin_api], and [pipeline:public_api] sections of your paste ini file.
Sep 28 11:12:59 ctl02 keystone[26588]: 2017-09-28 11:12:59.060 26588 WARNING keystone.middleware.core [-] The admin_token_auth middleware presents a security risk and should be removed from the [pipeline:api_v3], [pipeline:admin_api], and [pipeline:public_api] sections of your paste ini file.
Sep 28 11:12:59 ctl02 keystone[26588]: 2017-09-28 11:12:59.091 26588 WARNING keystone.middleware.core [-] The admin_token_auth middleware presents a security risk and should be removed from the [pipeline:api_v3], [pipeline:admin_api], and [pipeline:public_api] sections of your paste ini file.
Sep 28 11:12:59 ctl02 keystone[26588]: 2017-09-28 11:12:59.126 26588 WARNING keystone.middleware.core [-] The admin_token_auth middleware presents a security risk and should be removed from the [pipeline:api_v3], [pipeline:admin_api], and [pipeline:public_api] sections of your paste ini file.
Sep 28 11:12:59 ctl02 keystone[26588]: 2017-09-28 11:12:59.140 26588 WARNING root [-] Running keystone via eventlet is deprecated as of Kilo in favor of running in a WSGI server (e.g. mod_wsgi). Support for keystone under eventlet will be removed in the "M"-Release.
Sep 28 11:12:59 ctl02 keystone[26588]: 2017-09-28 11:12:59.142 26588 ERROR keystone.common.environment.eventlet_server [-] Could not bind to 0.0.0.0:35357
Sep 28 11:12:59 ctl02 keystone[26588]: 2017-09-28 11:12:59.143 26588 ERROR root [-] Failed to start the admin server
Sep 28 11:12:59 ctl02 keystone[26588]: 2017-09-28 11:12:59.143 26588 ERROR root Traceback (most recent call last):
Sep 28 11:12:59 ctl02 keystone[26588]: 2017-09-28 11:12:59.143 26588 ERROR root   File "/usr/lib/python2.7/dist-packages/keystone/server/eventlet.py", line 88, in serve
Sep 28 11:12:59 ctl02 keystone[26588]: 2017-09-28 11:12:59.143 26588 ERROR root     server.launch_with(launcher)
Sep 28 11:12:59 ctl02 keystone[26588]: 2017-09-28 11:12:59.143 26588 ERROR root   File "/usr/lib/python2.7/dist-packages/keystone/server/eventlet.py", line 54, in launch_with
Sep 28 11:12:59 ctl02 keystone[26588]: 2017-09-28 11:12:59.143 26588 ERROR root     self.server.listen()
Sep 28 11:12:59 ctl02 keystone[26588]: 2017-09-28 11:12:59.143 26588 ERROR root   File "/usr/lib/python2.7/dist-packages/keystone/common/environment/eventlet_server.py", line 110, in listen
Sep 28 11:12:59 ctl02 keystone[26588]: 2017-09-28 11:12:59.143 26588 ERROR root     backlog=backlog)
Sep 28 11:12:59 ctl02 keystone[26588]: 2017-09-28 11:12:59.143 26588 ERROR root   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:12:59 ctl02 keystone[26588]: 2017-09-28 11:12:59.143 26588 ERROR root     sock.listen(backlog)
Sep 28 11:12:59 ctl02 keystone[26588]: 2017-09-28 11:12:59.143 26588 ERROR root   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:12:59 ctl02 keystone[26588]: 2017-09-28 11:12:59.143 26588 ERROR root     return getattr(self._sock,name)(*args)
Sep 28 11:12:59 ctl02 keystone[26588]: 2017-09-28 11:12:59.143 26588 ERROR root error: [Errno 98] Address already in use
Sep 28 11:12:59 ctl02 keystone[26588]: 2017-09-28 11:12:59.143 26588 ERROR root
Sep 28 11:12:59 ctl02 keystone[26588]: 2017-09-28 11:12:59.145 26588 CRITICAL keystone [-] error: [Errno 98] Address already in use
Sep 28 11:12:59 ctl02 keystone[26588]: 2017-09-28 11:12:59.145 26588 ERROR keystone Traceback (most recent call last):
Sep 28 11:12:59 ctl02 keystone[26588]: 2017-09-28 11:12:59.145 26588 ERROR keystone   File "/usr/bin/keystone-all", line 10, in <module>
Sep 28 11:12:59 ctl02 keystone[26588]: 2017-09-28 11:12:59.145 26588 ERROR keystone     sys.exit(main())
Sep 28 11:12:59 ctl02 keystone[26588]: 2017-09-28 11:12:59.145 26588 ERROR keystone   File "/usr/lib/python2.7/dist-packages/keystone/cmd/all.py", line 39, in main
Sep 28 11:12:59 ctl02 keystone[26588]: 2017-09-28 11:12:59.145 26588 ERROR keystone     eventlet_server.run(possible_topdir)
Sep 28 11:12:59 ctl02 keystone[26588]: 2017-09-28 11:12:59.145 26588 ERROR keystone   File "/usr/lib/python2.7/dist-packages/keystone/server/eventlet.py", line 156, in run
Sep 28 11:12:59 ctl02 keystone[26588]: 2017-09-28 11:12:59.145 26588 ERROR keystone     serve(*servers)
Sep 28 11:12:59 ctl02 keystone[26588]: 2017-09-28 11:12:59.145 26588 ERROR keystone   File "/usr/lib/python2.7/dist-packages/keystone/server/eventlet.py", line 88, in serve
Sep 28 11:12:59 ctl02 keystone[26588]: 2017-09-28 11:12:59.145 26588 ERROR keystone     server.launch_with(launcher)
Sep 28 11:12:59 ctl02 keystone[26588]: 2017-09-28 11:12:59.145 26588 ERROR keystone   File "/usr/lib/python2.7/dist-packages/keystone/server/eventlet.py", line 54, in launch_with
Sep 28 11:12:59 ctl02 keystone[26588]: 2017-09-28 11:12:59.145 26588 ERROR keystone     self.server.listen()
Sep 28 11:12:59 ctl02 keystone[26588]: 2017-09-28 11:12:59.145 26588 ERROR keystone   File "/usr/lib/python2.7/dist-packages/keystone/common/environment/eventlet_server.py", line 110, in listen
Sep 28 11:12:59 ctl02 keystone[26588]: 2017-09-28 11:12:59.145 26588 ERROR keystone     backlog=backlog)
Sep 28 11:12:59 ctl02 keystone[26588]: 2017-09-28 11:12:59.145 26588 ERROR keystone   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:12:59 ctl02 keystone[26588]: 2017-09-28 11:12:59.145 26588 ERROR keystone     sock.listen(backlog)
Sep 28 11:12:59 ctl02 keystone[26588]: 2017-09-28 11:12:59.145 26588 ERROR keystone   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:12:59 ctl02 keystone[26588]: 2017-09-28 11:12:59.145 26588 ERROR keystone     return getattr(self._sock,name)(*args)
Sep 28 11:12:59 ctl02 keystone[26588]: 2017-09-28 11:12:59.145 26588 ERROR keystone error: [Errno 98] Address already in use
Sep 28 11:12:59 ctl02 keystone[26588]: 2017-09-28 11:12:59.145 26588 ERROR keystone
Sep 28 11:12:59 ctl02 systemd[1]: keystone.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:12:59 ctl02 systemd[1]: keystone.service: Unit entered failed state.
Sep 28 11:12:59 ctl02 systemd[1]: keystone.service: Failed with result 'exit-code'.
Sep 28 11:12:59 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd0d75d54)
Sep 28 11:12:59 ctl02 systemd[1]: keystone.service: Service hold-off time over, scheduling restart.
Sep 28 11:12:59 ctl02 systemd[1]: Stopped OpenStack Identity service.
Sep 28 11:12:59 ctl02 systemd[1]: Starting OpenStack Identity service...
Sep 28 11:12:59 ctl02 systemd[1]: Started OpenStack Identity service.
Sep 28 11:12:59 ctl02 keystone[26619]: 2017-09-28 11:12:59.996 26619 WARNING keystone.assignment.core [-] Deprecated: Use of the identity driver config to automatically configure the same assignment driver has been deprecated, in the "O" release, the assignment driver will need to be expicitly configured if different than the default (SQL).
Sep 28 11:13:00 ctl02 keystone[26619]: 2017-09-28 11:13:00.081 26619 WARNING keystone.middleware.core [-] The admin_token_auth middleware presents a security risk and should be removed from the [pipeline:api_v3], [pipeline:admin_api], and [pipeline:public_api] sections of your paste ini file.
Sep 28 11:13:00 ctl02 keystone[26619]: 2017-09-28 11:13:00.109 26619 WARNING keystone.middleware.core [-] The admin_token_auth middleware presents a security risk and should be removed from the [pipeline:api_v3], [pipeline:admin_api], and [pipeline:public_api] sections of your paste ini file.
Sep 28 11:13:00 ctl02 keystone[26619]: 2017-09-28 11:13:00.140 26619 WARNING keystone.middleware.core [-] The admin_token_auth middleware presents a security risk and should be removed from the [pipeline:api_v3], [pipeline:admin_api], and [pipeline:public_api] sections of your paste ini file.
Sep 28 11:13:00 ctl02 keystone[26619]: 2017-09-28 11:13:00.168 26619 WARNING keystone.middleware.core [-] The admin_token_auth middleware presents a security risk and should be removed from the [pipeline:api_v3], [pipeline:admin_api], and [pipeline:public_api] sections of your paste ini file.
Sep 28 11:13:00 ctl02 keystone[26619]: 2017-09-28 11:13:00.181 26619 WARNING root [-] Running keystone via eventlet is deprecated as of Kilo in favor of running in a WSGI server (e.g. mod_wsgi). Support for keystone under eventlet will be removed in the "M"-Release.
Sep 28 11:13:00 ctl02 keystone[26619]: 2017-09-28 11:13:00.182 26619 ERROR keystone.common.environment.eventlet_server [-] Could not bind to 0.0.0.0:35357
Sep 28 11:13:00 ctl02 keystone[26619]: 2017-09-28 11:13:00.183 26619 ERROR root [-] Failed to start the admin server
Sep 28 11:13:00 ctl02 keystone[26619]: 2017-09-28 11:13:00.183 26619 ERROR root Traceback (most recent call last):
Sep 28 11:13:00 ctl02 keystone[26619]: 2017-09-28 11:13:00.183 26619 ERROR root   File "/usr/lib/python2.7/dist-packages/keystone/server/eventlet.py", line 88, in serve
Sep 28 11:13:00 ctl02 keystone[26619]: 2017-09-28 11:13:00.183 26619 ERROR root     server.launch_with(launcher)
Sep 28 11:13:00 ctl02 keystone[26619]: 2017-09-28 11:13:00.183 26619 ERROR root   File "/usr/lib/python2.7/dist-packages/keystone/server/eventlet.py", line 54, in launch_with
Sep 28 11:13:00 ctl02 keystone[26619]: 2017-09-28 11:13:00.183 26619 ERROR root     self.server.listen()
Sep 28 11:13:00 ctl02 keystone[26619]: 2017-09-28 11:13:00.183 26619 ERROR root   File "/usr/lib/python2.7/dist-packages/keystone/common/environment/eventlet_server.py", line 110, in listen
Sep 28 11:13:00 ctl02 keystone[26619]: 2017-09-28 11:13:00.183 26619 ERROR root     backlog=backlog)
Sep 28 11:13:00 ctl02 keystone[26619]: 2017-09-28 11:13:00.183 26619 ERROR root   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:13:00 ctl02 keystone[26619]: 2017-09-28 11:13:00.183 26619 ERROR root     sock.listen(backlog)
Sep 28 11:13:00 ctl02 keystone[26619]: 2017-09-28 11:13:00.183 26619 ERROR root   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:13:00 ctl02 keystone[26619]: 2017-09-28 11:13:00.183 26619 ERROR root     return getattr(self._sock,name)(*args)
Sep 28 11:13:00 ctl02 keystone[26619]: 2017-09-28 11:13:00.183 26619 ERROR root error: [Errno 98] Address already in use
Sep 28 11:13:00 ctl02 keystone[26619]: 2017-09-28 11:13:00.183 26619 ERROR root
Sep 28 11:13:00 ctl02 keystone[26619]: 2017-09-28 11:13:00.185 26619 CRITICAL keystone [-] error: [Errno 98] Address already in use
Sep 28 11:13:00 ctl02 keystone[26619]: 2017-09-28 11:13:00.185 26619 ERROR keystone Traceback (most recent call last):
Sep 28 11:13:00 ctl02 keystone[26619]: 2017-09-28 11:13:00.185 26619 ERROR keystone   File "/usr/bin/keystone-all", line 10, in <module>
Sep 28 11:13:00 ctl02 keystone[26619]: 2017-09-28 11:13:00.185 26619 ERROR keystone     sys.exit(main())
Sep 28 11:13:00 ctl02 keystone[26619]: 2017-09-28 11:13:00.185 26619 ERROR keystone   File "/usr/lib/python2.7/dist-packages/keystone/cmd/all.py", line 39, in main
Sep 28 11:13:00 ctl02 keystone[26619]: 2017-09-28 11:13:00.185 26619 ERROR keystone     eventlet_server.run(possible_topdir)
Sep 28 11:13:00 ctl02 keystone[26619]: 2017-09-28 11:13:00.185 26619 ERROR keystone   File "/usr/lib/python2.7/dist-packages/keystone/server/eventlet.py", line 156, in run
Sep 28 11:13:00 ctl02 keystone[26619]: 2017-09-28 11:13:00.185 26619 ERROR keystone     serve(*servers)
Sep 28 11:13:00 ctl02 keystone[26619]: 2017-09-28 11:13:00.185 26619 ERROR keystone   File "/usr/lib/python2.7/dist-packages/keystone/server/eventlet.py", line 88, in serve
Sep 28 11:13:00 ctl02 keystone[26619]: 2017-09-28 11:13:00.185 26619 ERROR keystone     server.launch_with(launcher)
Sep 28 11:13:00 ctl02 keystone[26619]: 2017-09-28 11:13:00.185 26619 ERROR keystone   File "/usr/lib/python2.7/dist-packages/keystone/server/eventlet.py", line 54, in launch_with
Sep 28 11:13:00 ctl02 keystone[26619]: 2017-09-28 11:13:00.185 26619 ERROR keystone     self.server.listen()
Sep 28 11:13:00 ctl02 keystone[26619]: 2017-09-28 11:13:00.185 26619 ERROR keystone   File "/usr/lib/python2.7/dist-packages/keystone/common/environment/eventlet_server.py", line 110, in listen
Sep 28 11:13:00 ctl02 keystone[26619]: 2017-09-28 11:13:00.185 26619 ERROR keystone     backlog=backlog)
Sep 28 11:13:00 ctl02 keystone[26619]: 2017-09-28 11:13:00.185 26619 ERROR keystone   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:13:00 ctl02 keystone[26619]: 2017-09-28 11:13:00.185 26619 ERROR keystone     sock.listen(backlog)
Sep 28 11:13:00 ctl02 keystone[26619]: 2017-09-28 11:13:00.185 26619 ERROR keystone   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:13:00 ctl02 keystone[26619]: 2017-09-28 11:13:00.185 26619 ERROR keystone     return getattr(self._sock,name)(*args)
Sep 28 11:13:00 ctl02 keystone[26619]: 2017-09-28 11:13:00.185 26619 ERROR keystone error: [Errno 98] Address already in use
Sep 28 11:13:00 ctl02 keystone[26619]: 2017-09-28 11:13:00.185 26619 ERROR keystone
Sep 28 11:13:00 ctl02 systemd[1]: keystone.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:13:00 ctl02 systemd[1]: keystone.service: Unit entered failed state.
Sep 28 11:13:00 ctl02 systemd[1]: keystone.service: Failed with result 'exit-code'.
Sep 28 11:13:00 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd0d75d54)
Sep 28 11:13:00 ctl02 systemd[1]: keystone.service: Service hold-off time over, scheduling restart.
Sep 28 11:13:00 ctl02 systemd[1]: Stopped OpenStack Identity service.
Sep 28 11:13:00 ctl02 systemd[1]: Starting OpenStack Identity service...
Sep 28 11:13:00 ctl02 systemd[1]: Started OpenStack Identity service.
Sep 28 11:13:00 ctl02 keystone[26661]: 2017-09-28 11:13:00.968 26661 WARNING keystone.assignment.core [-] Deprecated: Use of the identity driver config to automatically configure the same assignment driver has been deprecated, in the "O" release, the assignment driver will need to be expicitly configured if different than the default (SQL).
Sep 28 11:13:01 ctl02 keystone[26661]: 2017-09-28 11:13:01.053 26661 WARNING keystone.middleware.core [-] The admin_token_auth middleware presents a security risk and should be removed from the [pipeline:api_v3], [pipeline:admin_api], and [pipeline:public_api] sections of your paste ini file.
Sep 28 11:13:01 ctl02 keystone[26661]: 2017-09-28 11:13:01.081 26661 WARNING keystone.middleware.core [-] The admin_token_auth middleware presents a security risk and should be removed from the [pipeline:api_v3], [pipeline:admin_api], and [pipeline:public_api] sections of your paste ini file.
Sep 28 11:13:01 ctl02 keystone[26661]: 2017-09-28 11:13:01.113 26661 WARNING keystone.middleware.core [-] The admin_token_auth middleware presents a security risk and should be removed from the [pipeline:api_v3], [pipeline:admin_api], and [pipeline:public_api] sections of your paste ini file.
Sep 28 11:13:01 ctl02 keystone[26661]: 2017-09-28 11:13:01.141 26661 WARNING keystone.middleware.core [-] The admin_token_auth middleware presents a security risk and should be removed from the [pipeline:api_v3], [pipeline:admin_api], and [pipeline:public_api] sections of your paste ini file.
Sep 28 11:13:01 ctl02 keystone[26661]: 2017-09-28 11:13:01.154 26661 WARNING root [-] Running keystone via eventlet is deprecated as of Kilo in favor of running in a WSGI server (e.g. mod_wsgi). Support for keystone under eventlet will be removed in the "M"-Release.
Sep 28 11:13:01 ctl02 keystone[26661]: 2017-09-28 11:13:01.155 26661 ERROR keystone.common.environment.eventlet_server [-] Could not bind to 0.0.0.0:35357
Sep 28 11:13:01 ctl02 keystone[26661]: 2017-09-28 11:13:01.155 26661 ERROR root [-] Failed to start the admin server
Sep 28 11:13:01 ctl02 keystone[26661]: 2017-09-28 11:13:01.155 26661 ERROR root Traceback (most recent call last):
Sep 28 11:13:01 ctl02 keystone[26661]: 2017-09-28 11:13:01.155 26661 ERROR root   File "/usr/lib/python2.7/dist-packages/keystone/server/eventlet.py", line 88, in serve
Sep 28 11:13:01 ctl02 keystone[26661]: 2017-09-28 11:13:01.155 26661 ERROR root     server.launch_with(launcher)
Sep 28 11:13:01 ctl02 keystone[26661]: 2017-09-28 11:13:01.155 26661 ERROR root   File "/usr/lib/python2.7/dist-packages/keystone/server/eventlet.py", line 54, in launch_with
Sep 28 11:13:01 ctl02 keystone[26661]: 2017-09-28 11:13:01.155 26661 ERROR root     self.server.listen()
Sep 28 11:13:01 ctl02 keystone[26661]: 2017-09-28 11:13:01.155 26661 ERROR root   File "/usr/lib/python2.7/dist-packages/keystone/common/environment/eventlet_server.py", line 110, in listen
Sep 28 11:13:01 ctl02 keystone[26661]: 2017-09-28 11:13:01.155 26661 ERROR root     backlog=backlog)
Sep 28 11:13:01 ctl02 keystone[26661]: 2017-09-28 11:13:01.155 26661 ERROR root   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:13:01 ctl02 keystone[26661]: 2017-09-28 11:13:01.155 26661 ERROR root     sock.listen(backlog)
Sep 28 11:13:01 ctl02 keystone[26661]: 2017-09-28 11:13:01.155 26661 ERROR root   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:13:01 ctl02 keystone[26661]: 2017-09-28 11:13:01.155 26661 ERROR root     return getattr(self._sock,name)(*args)
Sep 28 11:13:01 ctl02 keystone[26661]: 2017-09-28 11:13:01.155 26661 ERROR root error: [Errno 98] Address already in use
Sep 28 11:13:01 ctl02 keystone[26661]: 2017-09-28 11:13:01.155 26661 ERROR root
Sep 28 11:13:01 ctl02 keystone[26661]: 2017-09-28 11:13:01.156 26661 CRITICAL keystone [-] error: [Errno 98] Address already in use
Sep 28 11:13:01 ctl02 keystone[26661]: 2017-09-28 11:13:01.156 26661 ERROR keystone Traceback (most recent call last):
Sep 28 11:13:01 ctl02 keystone[26661]: 2017-09-28 11:13:01.156 26661 ERROR keystone   File "/usr/bin/keystone-all", line 10, in <module>
Sep 28 11:13:01 ctl02 keystone[26661]: 2017-09-28 11:13:01.156 26661 ERROR keystone     sys.exit(main())
Sep 28 11:13:01 ctl02 keystone[26661]: 2017-09-28 11:13:01.156 26661 ERROR keystone   File "/usr/lib/python2.7/dist-packages/keystone/cmd/all.py", line 39, in main
Sep 28 11:13:01 ctl02 keystone[26661]: 2017-09-28 11:13:01.156 26661 ERROR keystone     eventlet_server.run(possible_topdir)
Sep 28 11:13:01 ctl02 keystone[26661]: 2017-09-28 11:13:01.156 26661 ERROR keystone   File "/usr/lib/python2.7/dist-packages/keystone/server/eventlet.py", line 156, in run
Sep 28 11:13:01 ctl02 keystone[26661]: 2017-09-28 11:13:01.156 26661 ERROR keystone     serve(*servers)
Sep 28 11:13:01 ctl02 keystone[26661]: 2017-09-28 11:13:01.156 26661 ERROR keystone   File "/usr/lib/python2.7/dist-packages/keystone/server/eventlet.py", line 88, in serve
Sep 28 11:13:01 ctl02 keystone[26661]: 2017-09-28 11:13:01.156 26661 ERROR keystone     server.launch_with(launcher)
Sep 28 11:13:01 ctl02 keystone[26661]: 2017-09-28 11:13:01.156 26661 ERROR keystone   File "/usr/lib/python2.7/dist-packages/keystone/server/eventlet.py", line 54, in launch_with
Sep 28 11:13:01 ctl02 keystone[26661]: 2017-09-28 11:13:01.156 26661 ERROR keystone     self.server.listen()
Sep 28 11:13:01 ctl02 keystone[26661]: 2017-09-28 11:13:01.156 26661 ERROR keystone   File "/usr/lib/python2.7/dist-packages/keystone/common/environment/eventlet_server.py", line 110, in listen
Sep 28 11:13:01 ctl02 keystone[26661]: 2017-09-28 11:13:01.156 26661 ERROR keystone     backlog=backlog)
Sep 28 11:13:01 ctl02 keystone[26661]: 2017-09-28 11:13:01.156 26661 ERROR keystone   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:13:01 ctl02 keystone[26661]: 2017-09-28 11:13:01.156 26661 ERROR keystone     sock.listen(backlog)
Sep 28 11:13:01 ctl02 keystone[26661]: 2017-09-28 11:13:01.156 26661 ERROR keystone   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:13:01 ctl02 keystone[26661]: 2017-09-28 11:13:01.156 26661 ERROR keystone     return getattr(self._sock,name)(*args)
Sep 28 11:13:01 ctl02 keystone[26661]: 2017-09-28 11:13:01.156 26661 ERROR keystone error: [Errno 98] Address already in use
Sep 28 11:13:01 ctl02 keystone[26661]: 2017-09-28 11:13:01.156 26661 ERROR keystone
Sep 28 11:13:01 ctl02 systemd[1]: keystone.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:13:01 ctl02 systemd[1]: keystone.service: Unit entered failed state.
Sep 28 11:13:01 ctl02 systemd[1]: keystone.service: Failed with result 'exit-code'.
Sep 28 11:13:01 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd0d75d54)
Sep 28 11:13:01 ctl02 systemd[1]: keystone.service: Service hold-off time over, scheduling restart.
Sep 28 11:13:01 ctl02 systemd[1]: Stopped OpenStack Identity service.
Sep 28 11:13:01 ctl02 systemd[1]: Starting OpenStack Identity service...
Sep 28 11:13:01 ctl02 systemd[1]: Started OpenStack Identity service.
Sep 28 11:13:02 ctl02 keystone[26692]: 2017-09-28 11:13:02.006 26692 WARNING keystone.assignment.core [-] Deprecated: Use of the identity driver config to automatically configure the same assignment driver has been deprecated, in the "O" release, the assignment driver will need to be expicitly configured if different than the default (SQL).
Sep 28 11:13:02 ctl02 keystone[26692]: 2017-09-28 11:13:02.093 26692 WARNING keystone.middleware.core [-] The admin_token_auth middleware presents a security risk and should be removed from the [pipeline:api_v3], [pipeline:admin_api], and [pipeline:public_api] sections of your paste ini file.
Sep 28 11:13:02 ctl02 keystone[26692]: 2017-09-28 11:13:02.121 26692 WARNING keystone.middleware.core [-] The admin_token_auth middleware presents a security risk and should be removed from the [pipeline:api_v3], [pipeline:admin_api], and [pipeline:public_api] sections of your paste ini file.
Sep 28 11:13:02 ctl02 keystone[26692]: 2017-09-28 11:13:02.152 26692 WARNING keystone.middleware.core [-] The admin_token_auth middleware presents a security risk and should be removed from the [pipeline:api_v3], [pipeline:admin_api], and [pipeline:public_api] sections of your paste ini file.
Sep 28 11:13:02 ctl02 keystone[26692]: 2017-09-28 11:13:02.180 26692 WARNING keystone.middleware.core [-] The admin_token_auth middleware presents a security risk and should be removed from the [pipeline:api_v3], [pipeline:admin_api], and [pipeline:public_api] sections of your paste ini file.
Sep 28 11:13:02 ctl02 keystone[26692]: 2017-09-28 11:13:02.192 26692 WARNING root [-] Running keystone via eventlet is deprecated as of Kilo in favor of running in a WSGI server (e.g. mod_wsgi). Support for keystone under eventlet will be removed in the "M"-Release.
Sep 28 11:13:02 ctl02 keystone[26692]: 2017-09-28 11:13:02.194 26692 ERROR keystone.common.environment.eventlet_server [-] Could not bind to 0.0.0.0:35357
Sep 28 11:13:02 ctl02 keystone[26692]: 2017-09-28 11:13:02.194 26692 ERROR root [-] Failed to start the admin server
Sep 28 11:13:02 ctl02 keystone[26692]: 2017-09-28 11:13:02.194 26692 ERROR root Traceback (most recent call last):
Sep 28 11:13:02 ctl02 keystone[26692]: 2017-09-28 11:13:02.194 26692 ERROR root   File "/usr/lib/python2.7/dist-packages/keystone/server/eventlet.py", line 88, in serve
Sep 28 11:13:02 ctl02 keystone[26692]: 2017-09-28 11:13:02.194 26692 ERROR root     server.launch_with(launcher)
Sep 28 11:13:02 ctl02 keystone[26692]: 2017-09-28 11:13:02.194 26692 ERROR root   File "/usr/lib/python2.7/dist-packages/keystone/server/eventlet.py", line 54, in launch_with
Sep 28 11:13:02 ctl02 keystone[26692]: 2017-09-28 11:13:02.194 26692 ERROR root     self.server.listen()
Sep 28 11:13:02 ctl02 keystone[26692]: 2017-09-28 11:13:02.194 26692 ERROR root   File "/usr/lib/python2.7/dist-packages/keystone/common/environment/eventlet_server.py", line 110, in listen
Sep 28 11:13:02 ctl02 keystone[26692]: 2017-09-28 11:13:02.194 26692 ERROR root     backlog=backlog)
Sep 28 11:13:02 ctl02 keystone[26692]: 2017-09-28 11:13:02.194 26692 ERROR root   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:13:02 ctl02 keystone[26692]: 2017-09-28 11:13:02.194 26692 ERROR root     sock.listen(backlog)
Sep 28 11:13:02 ctl02 keystone[26692]: 2017-09-28 11:13:02.194 26692 ERROR root   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:13:02 ctl02 keystone[26692]: 2017-09-28 11:13:02.194 26692 ERROR root     return getattr(self._sock,name)(*args)
Sep 28 11:13:02 ctl02 keystone[26692]: 2017-09-28 11:13:02.194 26692 ERROR root error: [Errno 98] Address already in use
Sep 28 11:13:02 ctl02 keystone[26692]: 2017-09-28 11:13:02.194 26692 ERROR root
Sep 28 11:13:02 ctl02 keystone[26692]: 2017-09-28 11:13:02.195 26692 CRITICAL keystone [-] error: [Errno 98] Address already in use
Sep 28 11:13:02 ctl02 keystone[26692]: 2017-09-28 11:13:02.195 26692 ERROR keystone Traceback (most recent call last):
Sep 28 11:13:02 ctl02 keystone[26692]: 2017-09-28 11:13:02.195 26692 ERROR keystone   File "/usr/bin/keystone-all", line 10, in <module>
Sep 28 11:13:02 ctl02 keystone[26692]: 2017-09-28 11:13:02.195 26692 ERROR keystone     sys.exit(main())
Sep 28 11:13:02 ctl02 keystone[26692]: 2017-09-28 11:13:02.195 26692 ERROR keystone   File "/usr/lib/python2.7/dist-packages/keystone/cmd/all.py", line 39, in main
Sep 28 11:13:02 ctl02 keystone[26692]: 2017-09-28 11:13:02.195 26692 ERROR keystone     eventlet_server.run(possible_topdir)
Sep 28 11:13:02 ctl02 keystone[26692]: 2017-09-28 11:13:02.195 26692 ERROR keystone   File "/usr/lib/python2.7/dist-packages/keystone/server/eventlet.py", line 156, in run
Sep 28 11:13:02 ctl02 keystone[26692]: 2017-09-28 11:13:02.195 26692 ERROR keystone     serve(*servers)
Sep 28 11:13:02 ctl02 keystone[26692]: 2017-09-28 11:13:02.195 26692 ERROR keystone   File "/usr/lib/python2.7/dist-packages/keystone/server/eventlet.py", line 88, in serve
Sep 28 11:13:02 ctl02 keystone[26692]: 2017-09-28 11:13:02.195 26692 ERROR keystone     server.launch_with(launcher)
Sep 28 11:13:02 ctl02 keystone[26692]: 2017-09-28 11:13:02.195 26692 ERROR keystone   File "/usr/lib/python2.7/dist-packages/keystone/server/eventlet.py", line 54, in launch_with
Sep 28 11:13:02 ctl02 keystone[26692]: 2017-09-28 11:13:02.195 26692 ERROR keystone     self.server.listen()
Sep 28 11:13:02 ctl02 keystone[26692]: 2017-09-28 11:13:02.195 26692 ERROR keystone   File "/usr/lib/python2.7/dist-packages/keystone/common/environment/eventlet_server.py", line 110, in listen
Sep 28 11:13:02 ctl02 keystone[26692]: 2017-09-28 11:13:02.195 26692 ERROR keystone     backlog=backlog)
Sep 28 11:13:02 ctl02 keystone[26692]: 2017-09-28 11:13:02.195 26692 ERROR keystone   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:13:02 ctl02 keystone[26692]: 2017-09-28 11:13:02.195 26692 ERROR keystone     sock.listen(backlog)
Sep 28 11:13:02 ctl02 keystone[26692]: 2017-09-28 11:13:02.195 26692 ERROR keystone   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:13:02 ctl02 keystone[26692]: 2017-09-28 11:13:02.195 26692 ERROR keystone     return getattr(self._sock,name)(*args)
Sep 28 11:13:02 ctl02 keystone[26692]: 2017-09-28 11:13:02.195 26692 ERROR keystone error: [Errno 98] Address already in use
Sep 28 11:13:02 ctl02 keystone[26692]: 2017-09-28 11:13:02.195 26692 ERROR keystone
Sep 28 11:13:02 ctl02 systemd[1]: keystone.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:13:02 ctl02 systemd[1]: keystone.service: Unit entered failed state.
Sep 28 11:13:02 ctl02 systemd[1]: keystone.service: Failed with result 'exit-code'.
Sep 28 11:13:02 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd0d75d54)
Sep 28 11:13:02 ctl02 systemd[1]: keystone.service: Service hold-off time over, scheduling restart.
Sep 28 11:13:02 ctl02 systemd[1]: Stopped OpenStack Identity service.
Sep 28 11:13:02 ctl02 systemd[1]: Starting OpenStack Identity service...
Sep 28 11:13:02 ctl02 systemd[1]: Started OpenStack Identity service.
Sep 28 11:13:02 ctl02 salt-minion[14967]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 11:13:02 ctl02 salt-minion[14967]: [INFO    ] Made the following changes:
Sep 28 11:13:02 ctl02 salt-minion[14967]: 'python-psycopg2' changed from 'absent' to '2.6.1-1build2'
Sep 28 11:13:02 ctl02 salt-minion[14967]: 'python-egenix-mxtools' changed from 'absent' to '3.2.9-1'
Sep 28 11:13:02 ctl02 salt-minion[14967]: 'python-egenix-mxdatetime' changed from 'absent' to '3.2.9-1'
Sep 28 11:13:02 ctl02 salt-minion[14967]: 'libpq5' changed from 'absent' to '9.5.8-0ubuntu0.16.04.1'
Sep 28 11:13:02 ctl02 salt-minion[14967]: [INFO    ] Loading fresh modules for state activity
Sep 28 11:13:02 ctl02 salt-minion[14967]: [INFO    ] Completed state [python-psycopg2] at time 11:13:02.740155 duration_in_ms=4414.367
Sep 28 11:13:02 ctl02 salt-minion[14967]: [INFO    ] Running state [python-keystone] at time 11:13:02.746933
Sep 28 11:13:02 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for python-keystone
Sep 28 11:13:02 ctl02 keystone[26736]: 2017-09-28 11:13:02.993 26736 WARNING keystone.assignment.core [-] Deprecated: Use of the identity driver config to automatically configure the same assignment driver has been deprecated, in the "O" release, the assignment driver will need to be expicitly configured if different than the default (SQL).
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Package python-keystone is already installed
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Completed state [python-keystone] at time 11:13:03.060103 duration_in_ms=313.168
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Running state [/etc/keystone/policy.json] at time 11:13:03.061182
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Executing state file.managed for /etc/keystone/policy.json
Sep 28 11:13:03 ctl02 salt-minion[14967]: [WARNING ] State for file: /etc/keystone/policy.json - Neither 'source' nor 'contents' nor 'contents_pillar' nor 'contents_grains' was defined, yet 'replace' was set to 'True'. As there is no source to replace the file with, 'replace' has been set to 'False' to avoid reading the file unnecessarily.
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] {'group': 'keystone', 'user': 'keystone'}
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Completed state [/etc/keystone/policy.json] at time 11:13:03.062348 duration_in_ms=1.166
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Running state [/etc/keystone/keystone-paste.ini] at time 11:13:03.062675
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Executing state file.managed for /etc/keystone/keystone-paste.ini
Sep 28 11:13:03 ctl02 keystone[26736]: 2017-09-28 11:13:03.079 26736 WARNING keystone.middleware.core [-] The admin_token_auth middleware presents a security risk and should be removed from the [pipeline:api_v3], [pipeline:admin_api], and [pipeline:public_api] sections of your paste ini file.
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'keystone/files/ocata/keystone-paste.ini.Debian'
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] File changed:
Sep 28 11:13:03 ctl02 salt-minion[14967]: ---
Sep 28 11:13:03 ctl02 salt-minion[14967]: +++
Sep 28 11:13:03 ctl02 salt-minion[14967]: @@ -24,6 +24,12 @@
Sep 28 11:13:03 ctl02 salt-minion[14967]:  use = egg:oslo.middleware#cors
Sep 28 11:13:03 ctl02 salt-minion[14967]:  oslo_config_project = keystone
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: +[filter:http_proxy_to_wsgi]
Sep 28 11:13:03 ctl02 salt-minion[14967]: +use = egg:oslo.middleware#http_proxy_to_wsgi
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +[filter:healthcheck]
Sep 28 11:13:03 ctl02 salt-minion[14967]: +use = egg:oslo.middleware#healthcheck
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]:  [filter:ec2_extension]
Sep 28 11:13:03 ctl02 salt-minion[14967]:  use = egg:keystone#ec2_extension
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: @@ -39,6 +45,9 @@
Sep 28 11:13:03 ctl02 salt-minion[14967]:  [filter:sizelimit]
Sep 28 11:13:03 ctl02 salt-minion[14967]:  use = egg:oslo.middleware#sizelimit
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: +[filter:osprofiler]
Sep 28 11:13:03 ctl02 salt-minion[14967]: +use = egg:osprofiler#osprofiler
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]:  [app:public_service]
Sep 28 11:13:03 ctl02 salt-minion[14967]:  use = egg:keystone#public_service
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: @@ -51,17 +60,17 @@
Sep 28 11:13:03 ctl02 salt-minion[14967]:  [pipeline:public_api]
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # The last item in this pipeline must be public_service or an equivalent
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # application. It cannot be a filter.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -pipeline = cors sizelimit url_normalize request_id admin_token_auth build_auth_context token_auth json_body ec2_extension public_service
Sep 28 11:13:03 ctl02 salt-minion[14967]: +pipeline = healthcheck cors sizelimit http_proxy_to_wsgi osprofiler url_normalize request_id admin_token_auth build_auth_context token_auth json_body ec2_extension public_service
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  [pipeline:admin_api]
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # The last item in this pipeline must be admin_service or an equivalent
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # application. It cannot be a filter.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -pipeline = cors sizelimit url_normalize request_id admin_token_auth build_auth_context token_auth json_body ec2_extension s3_extension admin_service
Sep 28 11:13:03 ctl02 salt-minion[14967]: +pipeline = healthcheck cors sizelimit http_proxy_to_wsgi osprofiler url_normalize request_id admin_token_auth build_auth_context token_auth json_body ec2_extension s3_extension admin_service
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  [pipeline:api_v3]
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # The last item in this pipeline must be service_v3 or an equivalent
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # application. It cannot be a filter.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -pipeline = cors sizelimit url_normalize request_id admin_token_auth build_auth_context token_auth json_body ec2_extension_v3 s3_extension service_v3
Sep 28 11:13:03 ctl02 salt-minion[14967]: +pipeline = healthcheck cors sizelimit http_proxy_to_wsgi osprofiler url_normalize request_id admin_token_auth build_auth_context token_auth json_body ec2_extension_v3 s3_extension service_v3
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  [app:public_version_service]
Sep 28 11:13:03 ctl02 salt-minion[14967]:  use = egg:keystone#public_version_service
Sep 28 11:13:03 ctl02 salt-minion[14967]: @@ -70,10 +79,10 @@
Sep 28 11:13:03 ctl02 salt-minion[14967]:  use = egg:keystone#admin_version_service
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  [pipeline:public_version_api]
Sep 28 11:13:03 ctl02 salt-minion[14967]: -pipeline = cors sizelimit url_normalize public_version_service
Sep 28 11:13:03 ctl02 salt-minion[14967]: +pipeline = healthcheck cors sizelimit osprofiler url_normalize public_version_service
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  [pipeline:admin_version_api]
Sep 28 11:13:03 ctl02 salt-minion[14967]: -pipeline = cors sizelimit url_normalize admin_version_service
Sep 28 11:13:03 ctl02 salt-minion[14967]: +pipeline = healthcheck cors sizelimit osprofiler url_normalize admin_version_service
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  [composite:main]
Sep 28 11:13:03 ctl02 salt-minion[14967]:  use = egg:Paste#urlmap
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Completed state [/etc/keystone/keystone-paste.ini] at time 11:13:03.098579 duration_in_ms=35.903
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Running state [/etc/apache2/sites-enabled/000-default.conf] at time 11:13:03.098771
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Executing state file.absent for /etc/apache2/sites-enabled/000-default.conf
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] {'removed': '/etc/apache2/sites-enabled/000-default.conf'}
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Completed state [/etc/apache2/sites-enabled/000-default.conf] at time 11:13:03.099363 duration_in_ms=0.592
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Running state [/etc/keystone/keystone.conf] at time 11:13:03.099761
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Executing state file.managed for /etc/keystone/keystone.conf
Sep 28 11:13:03 ctl02 keystone[26736]: 2017-09-28 11:13:03.107 26736 WARNING keystone.middleware.core [-] The admin_token_auth middleware presents a security risk and should be removed from the [pipeline:api_v3], [pipeline:admin_api], and [pipeline:public_api] sections of your paste ini file.
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'keystone/files/ocata/keystone.conf.Debian'
Sep 28 11:13:03 ctl02 keystone[26736]: 2017-09-28 11:13:03.152 26736 CRITICAL keystone [-] DistributionNotFound: The 'osprofiler' distribution was not found and is required by the application
Sep 28 11:13:03 ctl02 keystone[26736]: 2017-09-28 11:13:03.152 26736 ERROR keystone Traceback (most recent call last):
Sep 28 11:13:03 ctl02 keystone[26736]: 2017-09-28 11:13:03.152 26736 ERROR keystone   File "/usr/bin/keystone-all", line 10, in <module>
Sep 28 11:13:03 ctl02 keystone[26736]: 2017-09-28 11:13:03.152 26736 ERROR keystone     sys.exit(main())
Sep 28 11:13:03 ctl02 keystone[26736]: 2017-09-28 11:13:03.152 26736 ERROR keystone   File "/usr/lib/python2.7/dist-packages/keystone/cmd/all.py", line 39, in main
Sep 28 11:13:03 ctl02 keystone[26736]: 2017-09-28 11:13:03.152 26736 ERROR keystone     eventlet_server.run(possible_topdir)
Sep 28 11:13:03 ctl02 keystone[26736]: 2017-09-28 11:13:03.152 26736 ERROR keystone   File "/usr/lib/python2.7/dist-packages/keystone/server/eventlet.py", line 155, in run
Sep 28 11:13:03 ctl02 keystone[26736]: 2017-09-28 11:13:03.152 26736 ERROR keystone     startup_application_fn=create_servers)
Sep 28 11:13:03 ctl02 keystone[26736]: 2017-09-28 11:13:03.152 26736 ERROR keystone   File "/usr/lib/python2.7/dist-packages/keystone/server/common.py", line 51, in setup_backends
Sep 28 11:13:03 ctl02 keystone[26736]: 2017-09-28 11:13:03.152 26736 ERROR keystone     res = startup_application_fn()
Sep 28 11:13:03 ctl02 keystone[26736]: 2017-09-28 11:13:03.152 26736 ERROR keystone   File "/usr/lib/python2.7/dist-packages/keystone/server/eventlet.py", line 151, in create_servers
Sep 28 11:13:03 ctl02 keystone[26736]: 2017-09-28 11:13:03.152 26736 ERROR keystone     public_worker_count))
Sep 28 11:13:03 ctl02 keystone[26736]: 2017-09-28 11:13:03.152 26736 ERROR keystone   File "/usr/lib/python2.7/dist-packages/keystone/server/eventlet.py", line 64, in create_server
Sep 28 11:13:03 ctl02 keystone[26736]: 2017-09-28 11:13:03.152 26736 ERROR keystone     app = keystone_service.loadapp('config:%s' % conf, name)
Sep 28 11:13:03 ctl02 keystone[26736]: 2017-09-28 11:13:03.152 26736 ERROR keystone   File "/usr/lib/python2.7/dist-packages/keystone/version/service.py", line 53, in loadapp
Sep 28 11:13:03 ctl02 keystone[26736]: 2017-09-28 11:13:03.152 26736 ERROR keystone     controllers.latest_app = deploy.loadapp(conf, name=name)
Sep 28 11:13:03 ctl02 keystone[26736]: 2017-09-28 11:13:03.152 26736 ERROR keystone   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:13:03 ctl02 keystone[26736]: 2017-09-28 11:13:03.152 26736 ERROR keystone     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:13:03 ctl02 keystone[26736]: 2017-09-28 11:13:03.152 26736 ERROR keystone   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 272, in loadobj
Sep 28 11:13:03 ctl02 keystone[26736]: 2017-09-28 11:13:03.152 26736 ERROR keystone     return context.create()
Sep 28 11:13:03 ctl02 keystone[26736]: 2017-09-28 11:13:03.152 26736 ERROR keystone   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 710, in create
Sep 28 11:13:03 ctl02 keystone[26736]: 2017-09-28 11:13:03.152 26736 ERROR keystone     return self.object_type.invoke(self)
Sep 28 11:13:03 ctl02 keystone[26736]: 2017-09-28 11:13:03.152 26736 ERROR keystone   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 144, in invoke
Sep 28 11:13:03 ctl02 keystone[26736]: 2017-09-28 11:13:03.152 26736 ERROR keystone     **context.local_conf)
Sep 28 11:13:03 ctl02 keystone[26736]: 2017-09-28 11:13:03.152 26736 ERROR keystone   File "/usr/lib/python2.7/dist-packages/paste/deploy/util.py", line 55, in fix_call
Sep 28 11:13:03 ctl02 keystone[26736]: 2017-09-28 11:13:03.152 26736 ERROR keystone     val = callable(*args, **kw)
Sep 28 11:13:03 ctl02 keystone[26736]: 2017-09-28 11:13:03.152 26736 ERROR keystone   File "/usr/lib/python2.7/dist-packages/paste/urlmap.py", line 28, in urlmap_factory
Sep 28 11:13:03 ctl02 keystone[26736]: 2017-09-28 11:13:03.152 26736 ERROR keystone     app = loader.get_app(app_name, global_conf=global_conf)
Sep 28 11:13:03 ctl02 keystone[26736]: 2017-09-28 11:13:03.152 26736 ERROR keystone   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 350, in get_app
Sep 28 11:13:03 ctl02 keystone[26736]: 2017-09-28 11:13:03.152 26736 ERROR keystone     name=name, global_conf=global_conf).create()
Sep 28 11:13:03 ctl02 keystone[26736]: 2017-09-28 11:13:03.152 26736 ERROR keystone   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 362, in app_context
Sep 28 11:13:03 ctl02 keystone[26736]: 2017-09-28 11:13:03.152 26736 ERROR keystone     APP, name=name, global_conf=global_conf)
Sep 28 11:13:03 ctl02 keystone[26736]: 2017-09-28 11:13:03.152 26736 ERROR keystone   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 450, in get_context
Sep 28 11:13:03 ctl02 keystone[26736]: 2017-09-28 11:13:03.152 26736 ERROR keystone     global_additions=global_additions)
Sep 28 11:13:03 ctl02 keystone[26736]: 2017-09-28 11:13:03.152 26736 ERROR keystone   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 562, in _pipeline_app_context
Sep 28 11:13:03 ctl02 keystone[26736]: 2017-09-28 11:13:03.152 26736 ERROR keystone     for name in pipeline[:-1]]
Sep 28 11:13:03 ctl02 keystone[26736]: 2017-09-28 11:13:03.152 26736 ERROR keystone   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 454, in get_context
Sep 28 11:13:03 ctl02 keystone[26736]: 2017-09-28 11:13:03.152 26736 ERROR keystone     section)
Sep 28 11:13:03 ctl02 keystone[26736]: 2017-09-28 11:13:03.152 26736 ERROR keystone   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 476, in _context_from_use
Sep 28 11:13:03 ctl02 keystone[26736]: 2017-09-28 11:13:03.152 26736 ERROR keystone     object_type, name=use, global_conf=global_conf)
Sep 28 11:13:03 ctl02 keystone[26736]: 2017-09-28 11:13:03.152 26736 ERROR keystone   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 406, in get_context
Sep 28 11:13:03 ctl02 keystone[26736]: 2017-09-28 11:13:03.152 26736 ERROR keystone     global_conf=global_conf)
Sep 28 11:13:03 ctl02 keystone[26736]: 2017-09-28 11:13:03.152 26736 ERROR keystone   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:13:03 ctl02 keystone[26736]: 2017-09-28 11:13:03.152 26736 ERROR keystone     global_conf=global_conf)
Sep 28 11:13:03 ctl02 keystone[26736]: 2017-09-28 11:13:03.152 26736 ERROR keystone   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 328, in _loadegg
Sep 28 11:13:03 ctl02 keystone[26736]: 2017-09-28 11:13:03.152 26736 ERROR keystone     return loader.get_context(object_type, name, global_conf)
Sep 28 11:13:03 ctl02 keystone[26736]: 2017-09-28 11:13:03.152 26736 ERROR keystone   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 620, in get_context
Sep 28 11:13:03 ctl02 keystone[26736]: 2017-09-28 11:13:03.152 26736 ERROR keystone     object_type, name=name)
Sep 28 11:13:03 ctl02 keystone[26736]: 2017-09-28 11:13:03.152 26736 ERROR keystone   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 640, in find_egg_entry_point
Sep 28 11:13:03 ctl02 keystone[26736]: 2017-09-28 11:13:03.152 26736 ERROR keystone     pkg_resources.require(self.spec)
Sep 28 11:13:03 ctl02 keystone[26736]: 2017-09-28 11:13:03.152 26736 ERROR keystone   File "/usr/lib/python2.7/dist-packages/pkg_resources/__init__.py", line 943, in require
Sep 28 11:13:03 ctl02 keystone[26736]: 2017-09-28 11:13:03.152 26736 ERROR keystone     needed = self.resolve(parse_requirements(requirements))
Sep 28 11:13:03 ctl02 keystone[26736]: 2017-09-28 11:13:03.152 26736 ERROR keystone   File "/usr/lib/python2.7/dist-packages/pkg_resources/__init__.py", line 829, in resolve
Sep 28 11:13:03 ctl02 keystone[26736]: 2017-09-28 11:13:03.152 26736 ERROR keystone     raise DistributionNotFound(req, requirers)
Sep 28 11:13:03 ctl02 keystone[26736]: 2017-09-28 11:13:03.152 26736 ERROR keystone DistributionNotFound: The 'osprofiler' distribution was not found and is required by the application
Sep 28 11:13:03 ctl02 keystone[26736]: 2017-09-28 11:13:03.152 26736 ERROR keystone
Sep 28 11:13:03 ctl02 systemd[1]: keystone.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:13:03 ctl02 systemd[1]: keystone.service: Unit entered failed state.
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'keystone/map.jinja'
Sep 28 11:13:03 ctl02 systemd[1]: keystone.service: Failed with result 'exit-code'.
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] File changed:
Sep 28 11:13:03 ctl02 salt-minion[14967]: ---
Sep 28 11:13:03 ctl02 salt-minion[14967]: +++
Sep 28 11:13:03 ctl02 salt-minion[14967]: @@ -1,76 +1,90 @@
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]:  [DEFAULT]
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # From keystone
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# A "shared secret" that can be used to bootstrap Keystone. This "token" does
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# not represent a user, and carries no explicit authorization. If set to
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# `None`, the value is ignored and the `admin_token` log in mechanism is
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# effectively disabled. To completely disable `admin_token` in production
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# (highly recommended), remove AdminTokenAuthMiddleware from your paste
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# application pipelines (for example, in keystone-paste.ini). (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Using this feature is *NOT* recommended. Instead, use the `keystone-manage
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# bootstrap` command. The value of this option is treated as a "shared secret"
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# that can be used to bootstrap Keystone through the API. This "token" does not
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# represent a user (it has no identity), and carries no explicit authorization
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# (it effectively bypasses most authorization checks). If set to `None`, the
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# value is ignored and the `admin_token` middleware is effectively disabled.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# However, to completely disable `admin_token` in production (highly
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# recommended, as it presents a security risk), remove
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# `AdminTokenAuthMiddleware` (the `admin_token_auth` filter) from your paste
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# application pipelines (for example, in `keystone-paste.ini`). (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #admin_token = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]: +admin_token=opnfv_secret
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # The base public endpoint URL for Keystone that is advertised to clients
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # (NOTE: this does NOT affect how Keystone listens for connections). Defaults
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# to the base host URL of the request. E.g. a request to
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# http://server:5000/v3/users will default to http://server:5000. You should
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# only need to set this value if the base URL contains a path (e.g. /prefix/v3)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# or the endpoint should be found on a different server. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# to the base host URL of the request. For example, if keystone receives a
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# request to `http://server:5000/v3/users`, then this will option will be
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# automatically treated as `http://server:5000`. You should only need to set
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# option if either the value of the base URL contains a path that keystone does
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# not automatically infer (`/prefix/v3`), or if the endpoint should be found on
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# a different host. (uri value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #public_endpoint = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # The base admin endpoint URL for Keystone that is advertised to clients (NOTE:
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # this does NOT affect how Keystone listens for connections). Defaults to the
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# base host URL of the request. E.g. a request to http://server:35357/v3/users
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# will default to http://server:35357. You should only need to set this value
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# if the base URL contains a path (e.g. /prefix/v3) or the endpoint should be
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# found on a different server. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# base host URL of the request. For example, if keystone receives a request to
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# `http://server:35357/v3/users`, then this will option will be automatically
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# treated as `http://server:35357`. You should only need to set option if
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# either the value of the base URL contains a path that keystone does not
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# automatically infer (`/prefix/v3`), or if the endpoint should be found on a
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# different host. (uri value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #admin_endpoint = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Maximum depth of the project hierarchy, excluding the project acting as a
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# domain at the top of the hierarchy. WARNING: setting it to a large value may
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# adversely impact  performance. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# domain at the top of the hierarchy. WARNING: Setting it to a large value may
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# adversely impact performance. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #max_project_tree_depth = 5
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Limit the sizes of user & project ID/names. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #max_param_size = 64
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Similar to max_param_size, but provides an exception for token values.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#max_token_size = 8192
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Similar to the member_role_name option, this represents the default role ID
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# used to associate users with their default projects in the v2 API. This will
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# be used as the explicit role where one is not specified by the v2 API.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Similar to `[DEFAULT] max_param_size`, but provides an exception for token
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# values. With Fernet tokens, this can be set as low as 255. With UUID tokens,
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# this should be set to 32). (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#max_token_size = 255
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Similar to the `[DEFAULT] member_role_name` option, this represents the
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# default role ID used to associate users with their default projects in the v2
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# API. This will be used as the explicit role where one is not specified by the
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# v2 API. You do not need to set this value unless you want keystone to use an
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# existing role with a different ID, other than the arbitrarily defined
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# `_member_` role (in which case, you should set `[DEFAULT] member_role_name`
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# as well). (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #member_role_id = 9fe2ff9ee4384b1894a90878d3e92bab
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# This is the role name used in combination with the member_role_id option; see
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# that option for more detail. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# This is the role name used in combination with the `[DEFAULT] member_role_id`
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# option; see that option for more detail. You do not need to set this option
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# unless you want keystone to use an existing role (in which case, you should
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# set `[DEFAULT] member_role_id` as well). (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #member_role_name = _member_
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# The value passed as the keyword "rounds" to passlib's encrypt method.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The value passed as the keyword "rounds" to passlib's encrypt method. This
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# option represents a trade off between security and performance. Higher values
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# lead to slower performance, but higher security. Changing this option will
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# only affect newly created passwords as existing password hashes already have
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# a fixed number of rounds applied, so it is safe to tune this option in a
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# running cluster. For more information, see
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# https://pythonhosted.org/passlib/password_hash_api.html#choosing-the-right-
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# rounds-value (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Minimum value: 1000
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Maximum value: 100000
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #crypt_strength = 10000
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# The maximum number of entities that will be returned in a collection, with no
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# limit set by default. This global limit may be then overridden for a specific
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# driver, by specifying a list_limit in the appropriate section (e.g.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# [assignment]). (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The maximum number of entities that will be returned in a collection. This
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# global limit may be then overridden for a specific driver, by specifying a
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# list_limit in the appropriate section (for example, `[assignment]`). No limit
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# is set by default. In larger deployments, it is recommended that you set this
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# to a reasonable number to prevent operations like listing all users and
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# projects from placing an unnecessary load on the system. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #list_limit = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Set this to false if you want to enable the ability for user, group and
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# project entities to be moved between domains by updating their domain_id.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Allowing such movement is not recommended if the scope of a domain admin is
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# being restricted by use of an appropriate policy file (see
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# policy.v3cloudsample as an example). This ability is deprecated and will be
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# removed in a future release. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# This option is deprecated for removal.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Its value may be silently ignored in the future.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#domain_id_immutable = true
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # If set to true, strict password length checking is performed for password
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # manipulation. If a password exceeds the maximum length, the operation will
Sep 28 11:13:03 ctl02 salt-minion[14967]: @@ -78,36 +92,48 @@
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # automatically truncated to the maximum length. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #strict_password_check = false
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# The HTTP header used to determine the scheme for the original request, even
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# if it was removed by an SSL terminating proxy. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# DEPRECATED: The HTTP header used to determine the scheme for the original
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# request, even if it was removed by an SSL terminating proxy. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# This option is deprecated for removal since N.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Reason: This option has been deprecated in the N release and will be removed
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# in the P release. Use oslo.middleware.http_proxy_to_wsgi configuration
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# instead.
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #secure_proxy_ssl_header = HTTP_X_FORWARDED_PROTO
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd0d75d54)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# If set to true the server will return information in the response that may
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# allow an unauthenticated or authenticated user to get more information than
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# normal, such as why authentication failed. This may be useful for debugging
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# but is insecure. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +secure_proxy_ssl_header = "HTTP_X_FORWARDED_PROTO"
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# If set to true, then the server will return information in HTTP responses
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# that may allow an unauthenticated or authenticated user to get more
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# information than normal, such as additional details about why authentication
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# failed. This may be useful for debugging but is insecure. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #insecure_debug = false
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# From keystone.notifications
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Default publisher_id for outgoing notifications (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Default `publisher_id` for outgoing notifications. If left undefined,
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Keystone will default to using the server's host name. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #default_publisher_id = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Define the notification format for Identity Service events. A "basic"
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# notification has information about the resource being operated on. A "cadf"
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# notification has the same information, as well as information about the
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# initiator of the event. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Define the notification format for identity service events. A `basic`
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# notification only has information about the resource being operated on. A
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# `cadf` notification has the same information, as well as information about
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# the initiator of the event. The `cadf` option is entirely backwards
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# compatible with the `basic` option, but is fully CADF-compliant, and is
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# recommended for auditing use cases. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Allowed values: basic, cadf
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#notification_format = basic
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Define the notification options to opt-out from. The value expected is:
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# identity.<resource_type>.<operation>. This field can be set multiple times in
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# order to add more notifications to opt-out from. For example:
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#  notification_opt_out=identity.user.created
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#  notification_opt_out=identity.authenticate.success (multi valued)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#notification_opt_out =
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#notification_format = cadf
Sep 28 11:13:03 ctl02 salt-minion[14967]: +notification_format = basic
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# You can reduce the number of notifications keystone emits by explicitly
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# opting out. Keystone will not emit notifications that match the patterns
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# expressed in this list. Values are expected to be in the form of
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# `identity.<resource_type>.<operation>`. By default, all notifications related
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# to authentication are automatically suppressed. This field can be set
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# multiple times in order to opt-out of multiple notification topics. For
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# example, the following suppresses notifications describing user creation or
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# successful authentication events: notification_opt_out=identity.user.create
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# notification_opt_out=identity.authenticate.success (multi valued)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#notification_opt_out = identity.authenticate.success
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#notification_opt_out = identity.authenticate.pending
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#notification_opt_out = identity.authenticate.failed
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # From oslo.log
Sep 28 11:13:03 ctl02 salt-minion[14967]: @@ -115,13 +141,16 @@
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # If set to true, the logging level will be set to DEBUG instead of the default
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # INFO level. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Note: This option can be changed without restarting.
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #debug = false
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# If set to false, the logging level will be set to WARNING instead of the
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# default INFO level. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +debug = false
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# DEPRECATED: If set to false, the logging level will be set to WARNING instead
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# of the default INFO level. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # This option is deprecated for removal.
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Its value may be silently ignored in the future.
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #verbose = true
Sep 28 11:13:03 ctl02 salt-minion[14967]: +verbose = true
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # The name of a logging configuration file. This file is appended to any
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # existing logging configuration files. For details about logging configuration
Sep 28 11:13:03 ctl02 salt-minion[14967]: @@ -129,6 +158,7 @@
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # configuration files are used then all logging configuration is set in the
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # configuration file and other logging configuration options are ignored (for
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # example, logging_context_format_string). (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Note: This option can be changed without restarting.
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/log_config
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #log_config_append = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: @@ -167,7 +197,7 @@
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Log output to standard error. This option is ignored if log_config_append is
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # set. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#use_stderr = true
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#use_stderr = false
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Format string to use for log messages with context. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #logging_context_format_string = %(asctime)s.%(msecs)03d %(process)d %(levelname)s %(name)s [%(request_id)s %(user_identity)s] %(instance)s%(message)s
Sep 28 11:13:03 ctl02 salt-minion[14967]: @@ -202,6 +232,18 @@
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #instance_uuid_format = "[instance: %(uuid)s] "
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Interval, number of seconds, of log rate limiting. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#rate_limit_interval = 0
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Maximum number of logged messages per rate_limit_interval. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#rate_limit_burst = 0
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Log level name used by rate limiting: CRITICAL, ERROR, INFO, WARNING, DEBUG
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# or empty string. Logs with level greater or equal to rate_limit_except_level
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# are not filtered. An empty string means that all levels are filtered. (string
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#rate_limit_except_level = CRITICAL
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Enables or disables fatal status of deprecations. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #fatal_deprecations = false
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: @@ -213,62 +255,165 @@
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rpc_conn_pool_size
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #rpc_conn_pool_size = 30
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The pool size limit for connections expiration policy (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#conn_pool_min_size = 2
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The time-to-live in sec of idle connections in the pool (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#conn_pool_ttl = 1200
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # ZeroMQ bind address. Should be a wildcard (*), an ethernet interface, or IP.
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # The "host" option should point or resolve to this address. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_bind_address
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #rpc_zmq_bind_address = *
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # MatchMaker driver. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Allowed values: redis, dummy
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Allowed values: redis, sentinel, dummy
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_matchmaker
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #rpc_zmq_matchmaker = redis
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Type of concurrency used. Either "native" or "eventlet" (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#rpc_zmq_concurrency = eventlet
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Number of ZeroMQ contexts, defaults to 1. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_contexts
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #rpc_zmq_contexts = 1
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Maximum number of ingress messages to locally buffer per topic. Default is
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # unlimited. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_topic_backlog
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #rpc_zmq_topic_backlog = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Directory for holding IPC sockets. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_ipc_dir
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #rpc_zmq_ipc_dir = /var/run/openstack
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Name of this node. Must be a valid hostname, FQDN, or IP address. Must match
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # "host" option, if running Nova. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_host
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #rpc_zmq_host = localhost
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Seconds to wait before a cast expires (TTL). The default value of -1
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# specifies an infinite linger period. The value of 0 specifies no linger
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# period. Pending messages shall be discarded immediately when the socket is
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# closed. Only supported by impl_zmq. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#rpc_cast_timeout = -1
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Number of seconds to wait before all pending messages will be sent after
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# closing a socket. The default value of -1 specifies an infinite linger
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# period. The value of 0 specifies no linger period. Pending messages shall be
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# discarded immediately when the socket is closed. Positive values specify an
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# upper bound for the linger period. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_cast_timeout
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#zmq_linger = -1
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # The default number of seconds that poll should wait. Poll raises timeout
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # exception when timeout expired. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_poll_timeout
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #rpc_poll_timeout = 1
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Expiration timeout in seconds of a name service record about existing target
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # ( < 0 means no timeout). (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#zmq_target_expire = 120
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/zmq_target_expire
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#zmq_target_expire = 300
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Update period in seconds of a name service record about existing target.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/zmq_target_update
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#zmq_target_update = 180
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Use PUB/SUB pattern for fanout methods. PUB/SUB always uses proxy. (boolean
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#use_pub_sub = true
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/use_pub_sub
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#use_pub_sub = false
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Use ROUTER remote proxy. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/use_router_proxy
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#use_router_proxy = false
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# This option makes direct connections dynamic or static. It makes sense only
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# with use_router_proxy=False which means to use direct connections for direct
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# message types (ignored otherwise). (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#use_dynamic_connections = false
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# How many additional connections to a host will be made for failover reasons.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# This option is actual only in dynamic connections mode. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#zmq_failover_connections = 2
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Minimal port number for random ports range. (port value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Minimum value: 0
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Maximum value: 65535
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#rpc_zmq_min_port = 49152
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_min_port
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#rpc_zmq_min_port = 49153
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Maximal port number for random ports range. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Minimum value: 1
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Maximum value: 65536
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_max_port
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #rpc_zmq_max_port = 65536
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Number of retries to find free port number before fail with ZMQBindError.
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_bind_port_retries
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #rpc_zmq_bind_port_retries = 100
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Default serialization mechanism for serializing/deserializing
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# outgoing/incoming messages (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Allowed values: json, msgpack
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_serialization
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#rpc_zmq_serialization = json
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# This option configures round-robin mode in zmq socket. True means not keeping
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# a queue when server side disconnects. False means to keep queue and messages
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# even if server is disconnected, when the server appears we send all
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# accumulated messages to it. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#zmq_immediate = true
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Enable/disable TCP keepalive (KA) mechanism. The default value of -1 (or any
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# other negative value) means to skip any overrides and leave it to OS default;
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# 0 and 1 (or any other positive value) mean to disable and enable the option
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# respectively. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#zmq_tcp_keepalive = -1
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The duration between two keepalive transmissions in idle condition. The unit
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# is platform dependent, for example, seconds in Linux, milliseconds in Windows
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# etc. The default value of -1 (or any other negative value and 0) means to
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# skip any overrides and leave it to OS default. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#zmq_tcp_keepalive_idle = -1
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The number of retransmissions to be carried out before declaring that remote
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# end is not available. The default value of -1 (or any other negative value
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# and 0) means to skip any overrides and leave it to OS default. (integer
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#zmq_tcp_keepalive_cnt = -1
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The duration between two successive keepalive retransmissions, if
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# acknowledgement to the previous keepalive transmission is not received. The
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# unit is platform dependent, for example, seconds in Linux, milliseconds in
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Windows etc. The default value of -1 (or any other negative value and 0)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# means to skip any overrides and leave it to OS default. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#zmq_tcp_keepalive_intvl = -1
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Maximum number of (green) threads to work concurrently. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#rpc_thread_pool_size = 100
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Expiration timeout in seconds of a sent/received message after which it is
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# not tracked anymore by a client/server. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#rpc_message_ttl = 300
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Wait for message acknowledgements from receivers. This mechanism works only
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# via proxy without PUB/SUB. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#rpc_use_acks = false
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Number of seconds to wait for an ack from a cast/call. After each retry
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# attempt this timeout is multiplied by some specified multiplier. (integer
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#rpc_ack_timeout_base = 15
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Number to multiply base ack timeout by after each retry attempt. (integer
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#rpc_ack_timeout_multiplier = 2
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Default number of message sending attempts in case of any problems occurred:
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# positive value N means at most N retries, 0 means no retries, None or -1 (or
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# any other negative values) mean to retry forever. This option is used only if
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# acknowledgments are enabled. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#rpc_retry_attempts = 3
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# List of publisher hosts SubConsumer can subscribe on. This option has higher
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# priority then the default publishers list taken from the matchmaker. (list
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#subscribe_on =
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Size of executor thread pool. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rpc_thread_pool_size
Sep 28 11:13:03 ctl02 salt-minion[14967]: @@ -276,46 +421,21 @@
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Seconds to wait for a response from a call. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #rpc_response_timeout = 60
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# A URL representing the messaging driver to use and its full configuration. If
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# not set, we fall back to the rpc_backend option and driver specific
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# configuration. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#transport_url = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# The messaging driver to use, defaults to rabbit. Other drivers include amqp
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# and zmq. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# A URL representing the messaging driver to use and its full configuration.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#transport_url = rabbit://nova:3qVSI7a1m8AdaDQ7BpB0PJu4@192.168.0.4:5673/
Sep 28 11:13:03 ctl02 salt-minion[14967]: +transport_url = rabbit://openstack:opnfv_secret@10.167.4.41:5672,openstack:opnfv_secret@10.167.4.42:5672,openstack:opnfv_secret@10.167.4.43:5672//openstack
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# DEPRECATED: The messaging driver to use, defaults to rabbit. Other drivers
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# include amqp and zmq. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #rpc_backend = rabbit
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # The default exchange under which topics are scoped. May be overridden by an
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # exchange name specified in the transport_url option. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #control_exchange = keystone
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# From oslo.service.service
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Enable eventlet backdoor.  Acceptable values are 0, <port>, and
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# <start>:<end>, where 0 results in listening on a random tcp port number;
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# <port> results in listening on the specified port number (and not enabling
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# backdoor if that port is in use); and <start>:<end> results in listening on
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# the smallest unused port number within the specified range of port numbers.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# The chosen port is displayed in the service's log file. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#backdoor_port = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Enable eventlet backdoor, using the provided path as a unix socket that can
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# receive connections. This option is mutually exclusive with 'backdoor_port'
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# in that only one should be provided. If both are provided then the existence
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# of this option overrides the usage of that option. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#backdoor_socket = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Enables or disables logging values of all registered options when starting a
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# service (at DEBUG level). (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#log_options = true
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Specify a timeout after which a gracefully shutdown server will exit. Zero
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# value means endless wait. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#graceful_shutdown_timeout = 60
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  [assignment]
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: @@ -323,17 +443,16 @@
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # From keystone
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Entrypoint for the assignment backend driver in the keystone.assignment
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# namespace. Only an SQL driver is supplied. If an assignment driver is not
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# specified, the identity driver will choose the assignment driver (driver
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# selection based on `[identity]/driver` option is deprecated and will be
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# removed in the "O" release). (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#driver = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Entry point for the assignment backend driver (where role assignments are
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# stored) in the `keystone.assignment` namespace. Only a SQL driver is supplied
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# by keystone itself. Unless you are writing proprietary drivers for keystone,
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# you do not need to set this option. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#driver = sql
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # A list of role names which are prohibited from being an implied role. (list
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #prohibited_implied_role = admin
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: +driver = sql
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  [auth]
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: @@ -341,25 +460,47 @@
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # From keystone
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Allowed authentication methods. (list value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#methods = external,password,token,oauth1
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Entrypoint for the password auth plugin module in the keystone.auth.password
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# namespace. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Allowed authentication methods. Note: You should disable the `external` auth
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# method if you are currently using federation. External auth and federation
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# both use the REMOTE_USER variable. Since both the mapped and external plugin
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# are being invoked to validate attributes in the request environment, it can
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# cause conflicts. (list value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#methods = external,password,token,oauth1,mapped
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +methods = password,token
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Entry point for the password auth plugin module in the
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# `keystone.auth.password` namespace. You do not need to set this unless you
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# are overriding keystone's own password authentication plugin. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #password = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Entrypoint for the token auth plugin module in the keystone.auth.token
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# namespace. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Entry point for the token auth plugin module in the `keystone.auth.token`
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# namespace. You do not need to set this unless you are overriding keystone's
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# own token authentication plugin. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #token = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Entrypoint for the external (REMOTE_USER) auth plugin module in the
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# keystone.auth.external namespace. Supplied drivers are DefaultDomain and
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Domain. The default driver is DefaultDomain. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Entry point for the external (`REMOTE_USER`) auth plugin module in the
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# `keystone.auth.external` namespace. Supplied drivers are `DefaultDomain` and
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# `Domain`. The default driver is `DefaultDomain`, which assumes that all users
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# identified by the username specified to keystone in the `REMOTE_USER`
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# variable exist within the context of the default domain. The `Domain` option
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# expects an additional environment variable be presented to keystone,
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# `REMOTE_DOMAIN`, containing the domain name of the `REMOTE_USER` (if
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# `REMOTE_DOMAIN` is not set, then the default domain will be used instead).
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# You do not need to set this unless you are taking advantage of "external
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# authentication", where the application server (such as Apache) is handling
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# authentication instead of keystone. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #external = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Entrypoint for the oAuth1.0 auth plugin module in the keystone.auth.oauth1
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# namespace. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Entry point for the OAuth 1.0a auth plugin module in the
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# `keystone.auth.oauth1` namespace. You do not need to set this unless you are
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# overriding keystone's own `oauth1` authentication plugin. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #oauth1 = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Entry point for the mapped auth plugin module in the `keystone.auth.mapped`
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# namespace. You do not need to set this unless you are overriding keystone's
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# own `mapped` authentication plugin. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#mapped = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  [cache]
Sep 28 11:13:03 ctl02 salt-minion[14967]: @@ -378,11 +519,14 @@
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # expiration time defined for it. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #expiration_time = 600
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Dogpile.cache backend module. It is recommended that Memcache with pooling
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# (oslo_cache.memcache_pool) or Redis (dogpile.cache.redis) be used in
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# production deployments.  Small workloads (single process) like devstack can
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# use the dogpile.cache.memory backend. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Dogpile.cache backend module. It is recommended that Memcache or Redis
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# (dogpile.cache.redis) be used in production deployments. For eventlet-based
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# or highly threaded servers, Memcache with pooling (oslo_cache.memcache_pool)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# is recommended. For low thread servers, dogpile.cache.memcached is
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# recommended. Test environments with a single instance of the server can use
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# the dogpile.cache.memory backend. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #backend = dogpile.cache.null
Sep 28 11:13:03 ctl02 salt-minion[14967]: +backend = oslo_cache.memcache_pool
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Arguments supplied to the backend module. Specify this option once per
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # argument to be passed to the dogpile.cache backend. Example format:
Sep 28 11:13:03 ctl02 salt-minion[14967]: @@ -395,7 +539,8 @@
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #proxies =
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Global toggle for caching. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#enabled = false
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#enabled = true
Sep 28 11:13:03 ctl02 salt-minion[14967]: +enabled = true
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Extra debugging from the cache backend (cache keys, get/set/delete/etc
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # calls). This is only really useful if you need to see the specific cache-
Sep 28 11:13:03 ctl02 salt-minion[14967]: @@ -406,23 +551,28 @@
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Memcache servers in the format of "host:port". (dogpile.cache.memcache and
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # oslo_cache.memcache_pool backends only). (list value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #memcache_servers = localhost:11211
Sep 28 11:13:03 ctl02 salt-minion[14967]: +memcache_servers =10.167.4.11:11211,10.167.4.12:11211,10.167.4.13:11211
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Number of seconds memcached server is considered dead before it is tried
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # again. (dogpile.cache.memcache and oslo_cache.memcache_pool backends only).
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #memcache_dead_retry = 300
Sep 28 11:13:03 ctl02 salt-minion[14967]: +memcache_dead_retry = 300
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Timeout in seconds for every call to a server. (dogpile.cache.memcache and
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # oslo_cache.memcache_pool backends only). (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #memcache_socket_timeout = 3
Sep 28 11:13:03 ctl02 salt-minion[14967]: +memcache_socket_timeout = 1
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Max total number of open connections to every memcached server.
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # (oslo_cache.memcache_pool backend only). (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #memcache_pool_maxsize = 10
Sep 28 11:13:03 ctl02 salt-minion[14967]: +memcache_pool_maxsize = 100
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Number of seconds a connection to memcached is held unused in the pool before
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # it is closed. (oslo_cache.memcache_pool backend only). (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #memcache_pool_unused_timeout = 60
Sep 28 11:13:03 ctl02 salt-minion[14967]: +memcache_pool_unused_timeout = 60
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Number of seconds that an operation will wait to get a memcache client
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # connection. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: @@ -435,24 +585,33 @@
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # From keystone
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Catalog template file name for use with the template catalog backend. (string
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Absolute path to the file used for the templated catalog backend. This option
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# is only used if the `[catalog] driver` is set to `templated`. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #template_file = default_catalog.templates
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Entrypoint for the catalog backend driver in the keystone.catalog namespace.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Supplied drivers are kvs, sql, templated, and endpoint_filter.sql (string
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +template_file = default_catalog.templates
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Entry point for the catalog driver in the `keystone.catalog` namespace.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Keystone provides a `sql` option (which supports basic CRUD operations
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# through SQL), a `templated` option (which loads the catalog from a templated
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# catalog file on disk), and a `endpoint_filter.sql` option (which supports
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# arbitrary service catalogs per project). (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #driver = sql
Sep 28 11:13:03 ctl02 salt-minion[14967]: +driver = sql
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Toggle for catalog caching. This has no effect unless global caching is
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# enabled. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# enabled. In a typical deployment, there is no reason to disable this.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #caching = true
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Time to cache catalog data (in seconds). This has no effect unless global and
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# catalog caching are enabled. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# catalog caching are both enabled. Catalog data (services, endpoints, etc.)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# typically does not change frequently, and so a longer duration than the
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# global default may be desirable. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #cache_time = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Maximum number of entities that will be returned in a catalog collection.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# There is typically no reason to set this, as it would be unusual for a
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# deployment to have enough services or endpoints to exceed a reasonable limit.
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #list_limit = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: @@ -464,27 +623,35 @@
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Indicate whether this resource may be shared with the domain received in the
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# requests "origin" header. (list value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# requests "origin" header. Format: "<protocol>://<host>[:<port>]", no trailing
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# slash. Example: https://horizon.example.com (list value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #allowed_origin = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Indicate that the actual request can include user credentials (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #allow_credentials = true
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Indicate which headers are safe to expose to the API. Defaults to HTTP Simple
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Headers. (list value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #expose_headers = X-Auth-Token,X-Openstack-Request-Id,X-Subject-Token
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Maximum cache age of CORS preflight requests. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #max_age = 3600
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Indicate which methods can be used during the actual request. (list value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #allow_methods = GET,PUT,POST,DELETE,PATCH
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Indicate which header field names may be used during the actual request.
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # (list value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #allow_headers = X-Auth-Token,X-Openstack-Request-Id,X-Subject-Token,X-Project-Id,X-Project-Name,X-Project-Domain-Id,X-Project-Domain-Name,X-Domain-Id,X-Domain-Name
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]:  [cors.subdomain]
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #
Sep 28 11:13:03 ctl02 salt-minion[14967]: @@ -492,7 +659,8 @@
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Indicate whether this resource may be shared with the domain received in the
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# requests "origin" header. (list value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# requests "origin" header. Format: "<protocol>://<host>[:<port>]", no trailing
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# slash. Example: https://horizon.example.com (list value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #allowed_origin = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Indicate that the actual request can include user credentials (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: @@ -519,10 +687,25 @@
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # From keystone
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Entrypoint for the credential backend driver in the keystone.credential
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# namespace. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Entry point for the credential backend driver in the `keystone.credential`
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# namespace. Keystone only provides a `sql` driver, so there's no reason to
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# change this unless you are providing a custom entry point. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #driver = sql
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Entry point for credential encryption and decryption operations in the
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# `keystone.credential.provider` namespace. Keystone only provides a `fernet`
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# driver, so there's no reason to change this unless you are providing a custom
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# entry point to encrypt and decrypt credentials. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#provider = fernet
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Directory containing Fernet keys used to encrypt and decrypt credentials
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# stored in the credential backend. Fernet keys used to encrypt credentials
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# have no relationship to Fernet keys used to encrypt Fernet tokens. Both sets
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# of keys should be managed separately and require different rotation policies.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Do not share this repository with the repository used to manage keys for
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Fernet tokens. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +key_repository = /var/lib/keystone/credential-keys
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  [database]
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: @@ -530,8 +713,12 @@
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # From oslo.db
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# The file name to use with SQLite. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# DEPRECATED: The file name to use with SQLite. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/sqlite_db
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Reason: Should use config option connection or slave_connection to connect
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# the database.
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #sqlite_db = oslo.sqlite
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # If True, SQLite uses synchronous mode. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: @@ -548,7 +735,7 @@
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Deprecated group/name - [DATABASE]/sql_connection
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Deprecated group/name - [sql]/connection
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #connection = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]: -connection = sqlite:////var/lib/keystone/keystone.db
Sep 28 11:13:03 ctl02 salt-minion[14967]: +connection=mysql+pymysql://keystone:opnfv_secret@10.167.4.50/keystone
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # The SQLAlchemy connection string to use to connect to the slave database.
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: @@ -565,16 +752,21 @@
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Deprecated group/name - [DATABASE]/sql_idle_timeout
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Deprecated group/name - [sql]/idle_timeout
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #idle_timeout = 3600
Sep 28 11:13:03 ctl02 salt-minion[14967]: +idle_timeout = 3600
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Minimum number of SQL connections to keep open in a pool. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/sql_min_pool_size
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Deprecated group/name - [DATABASE]/sql_min_pool_size
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #min_pool_size = 1
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Maximum number of SQL connections to keep open in a pool. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Maximum number of SQL connections to keep open in a pool. Setting a value of
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# 0 indicates no limit. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/sql_max_pool_size
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Deprecated group/name - [DATABASE]/sql_max_pool_size
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#max_pool_size = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#max_pool_size = 5
Sep 28 11:13:03 ctl02 salt-minion[14967]: +max_pool_size=10
Sep 28 11:13:03 ctl02 salt-minion[14967]: +max_overflow=30
Sep 28 11:13:03 ctl02 salt-minion[14967]: +max_retries=-1
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Maximum number of database connection retries during startup. Set to -1 to
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # specify an infinite retry count. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: @@ -594,6 +786,8 @@
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Verbosity of SQL debugging information: 0=None, 100=Everything. (integer
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Maximum value: 100
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/sql_connection_debug
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #connection_debug = 0
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: @@ -631,16 +825,20 @@
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # From keystone
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Entrypoint for the domain config backend driver in the
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# keystone.resource.domain_config namespace. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Entry point for the domain-specific configuration driver in the
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# `keystone.resource.domain_config` namespace. Only a `sql` option is provided
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# by keystone, so there is no reason to set this unless you are providing a
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# custom entry point. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #driver = sql
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Toggle for domain config caching. This has no effect unless global caching is
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# enabled. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Toggle for caching of the domain-specific configuration backend. This has no
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# effect unless global caching is enabled. There is normally no reason to
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# disable this. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #caching = true
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# TTL (in seconds) to cache domain config data. This has no effect unless
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# domain config caching is enabled. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Time-to-live (TTL, in seconds) to cache domain-specific configuration data.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# This has no effect unless `[domain_config] caching` is enabled. (integer
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #cache_time = 300
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: @@ -650,11 +848,16 @@
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # From keystone
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Entrypoint for the endpoint filter backend driver in the
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# keystone.endpoint_filter namespace. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Entry point for the endpoint filter driver in the `keystone.endpoint_filter`
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# namespace. Only a `sql` option is provided by keystone, so there is no reason
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# to set this unless you are providing a custom entry point. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #driver = sql
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Toggle to return all active endpoints if no filter exists. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# This controls keystone's behavior if the configured endpoint filters do not
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# result in any endpoints for a user + project pair (and therefore a
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# potentially empty service catalog). If set to true, keystone will return the
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# entire service catalog. If set to false, keystone will return an empty
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# service catalog. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #return_all_endpoints_if_no_filter = true
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: @@ -664,16 +867,9 @@
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # From keystone
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Enable endpoint_policy functionality. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# This option is deprecated for removal.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Its value may be silently ignored in the future.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Reason: The option to enable the OS-ENDPOINT-POLICY extension has been
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# deprecated in the M release and will be removed in the O release. The OS-
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# ENDPOINT-POLICY extension will be enabled by default.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#enabled = true
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Entrypoint for the endpoint policy backend driver in the
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# keystone.endpoint_policy namespace. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Entry point for the endpoint policy driver in the `keystone.endpoint_policy`
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# namespace. Only a `sql` driver is provided by keystone, so there is no reason
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# to set this unless you are providing a custom entry point. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #driver = sql
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: @@ -683,218 +879,239 @@
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # From keystone
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# The number of worker processes to serve the public eventlet application.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Defaults to number of CPUs (minimum of 2). (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Deprecated group/name - [DEFAULT]/public_workers
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# This option is deprecated for removal.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Its value may be silently ignored in the future.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#public_workers = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# The number of worker processes to serve the admin eventlet application.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Defaults to number of CPUs (minimum of 2). (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Deprecated group/name - [DEFAULT]/admin_workers
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# This option is deprecated for removal.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Its value may be silently ignored in the future.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#admin_workers = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# The IP address of the network interface for the public service to listen on.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# DEPRECATED: The IP address of the network interface for the public service to
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# listen on. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/bind_host
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/public_bind_host
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# This option is deprecated for removal.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# This option is deprecated for removal since K.
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Its value may be silently ignored in the future.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Reason: Support for running keystone under eventlet has been removed in the
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Newton release. These options remain for backwards compatibility because they
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# are used for URL substitutions.
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #public_bind_host = 0.0.0.0
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# The port number which the public service listens on. (port value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +public_bind_host=10.167.4.12
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# DEPRECATED: The port number for the public service to listen on. (port value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Minimum value: 0
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Maximum value: 65535
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/public_port
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# This option is deprecated for removal.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# This option is deprecated for removal since K.
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Its value may be silently ignored in the future.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Reason: Support for running keystone under eventlet has been removed in the
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Newton release. These options remain for backwards compatibility because they
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# are used for URL substitutions.
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #public_port = 5000
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# The IP address of the network interface for the admin service to listen on.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +public_port = 5000
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# DEPRECATED: The IP address of the network interface for the admin service to
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# listen on. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/bind_host
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/admin_bind_host
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# This option is deprecated for removal.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# This option is deprecated for removal since K.
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Its value may be silently ignored in the future.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Reason: Support for running keystone under eventlet has been removed in the
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Newton release. These options remain for backwards compatibility because they
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# are used for URL substitutions.
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #admin_bind_host = 0.0.0.0
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# The port number which the admin service listens on. (port value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +admin_bind_host=10.167.4.12
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# DEPRECATED: The port number for the admin service to listen on. (port value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Minimum value: 0
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Maximum value: 65535
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/admin_port
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# This option is deprecated for removal since K.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Reason: Support for running keystone under eventlet has been removed in the
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Newton release. These options remain for backwards compatibility because they
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# are used for URL substitutions.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#admin_port = 35357
Sep 28 11:13:03 ctl02 salt-minion[14967]: +admin_port = 35357
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +[extra_headers]
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# From keystone
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Specifies the distribution of the keystone server. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#Distribution = Ubuntu
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +[federation]
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# From keystone
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Entry point for the federation backend driver in the `keystone.federation`
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# namespace. Keystone only provides a `sql` driver, so there is no reason to
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# set this option unless you are providing a custom entry point. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#driver = sql
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Prefix to use when filtering environment variable names for federated
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# assertions. Matched variables are passed into the federated mapping engine.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#assertion_prefix =
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Value to be used to obtain the entity ID of the Identity Provider from the
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# environment. For `mod_shib`, this would be `Shib-Identity-Provider`. For For
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# `mod_auth_openidc`, this could be `HTTP_OIDC_ISS`. For `mod_auth_mellon`,
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# this could be `MELLON_IDP`. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#remote_id_attribute = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# An arbitrary domain name that is reserved to allow federated ephemeral users
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# to have a domain concept. Note that an admin will not be able to create a
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# domain with this name or update an existing domain to this name. You are not
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# advised to change this value unless you really have to. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#federated_domain_name = Federated
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# A list of trusted dashboard hosts. Before accepting a Single Sign-On request
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# to return a token, the origin host must be a member of this list. This
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# configuration option may be repeated for multiple values. You must set this
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# in order to use web-based SSO flows. For example:
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# trusted_dashboard=https://acme.example.com/auth/websso
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# trusted_dashboard=https://beta.example.com/auth/websso (multi valued)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#trusted_dashboard =
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Absolute path to an HTML file used as a Single Sign-On callback handler. This
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# page is expected to redirect the user from keystone back to a trusted
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# dashboard host, by form encoding a token in a POST request. Keystone's
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# default value should be sufficient for most deployments. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#sso_callback_template = /etc/keystone/sso_callback_template.html
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Toggle for federation caching. This has no effect unless global caching is
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# enabled. There is typically no reason to disable this. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#caching = true
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +[fernet_tokens]
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# From keystone
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Directory containing Fernet token keys. This directory must exist before
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# using `keystone-manage fernet_setup` for the first time, must be writable by
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# the user running `keystone-manage fernet_setup` or `keystone-manage
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# fernet_rotate`, and of course must be readable by keystone's server process.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The repository may contain keys in one of three states: a single staged key
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# (always index 0) used for token validation, a single primary key (always the
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# highest index) used for token creation and validation, and any number of
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# secondary keys (all other index values) used for token validation. With
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# multiple keystone nodes, each node must share the same key repository
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# contents, with the exception of the staged key (index 0). It is safe to run
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# `keystone-manage fernet_rotate` once on any one node to promote a staged key
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# (index 0) to be the new primary (incremented from the previous highest
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# index), and produce a new staged key (a new key with index 0); the resulting
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# repository can then be atomically replicated to other nodes without any risk
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# of race conditions (for example, it is safe to run `keystone-manage
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# fernet_rotate` on host A, wait any amount of time, create a tarball of the
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# directory on host A, unpack it on host B to a temporary location, and
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# atomically move (`mv`) the directory into place on host B). Running
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# `keystone-manage fernet_rotate` *twice* on a key repository without syncing
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# other nodes will result in tokens that can not be validated by all nodes.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#key_repository = /etc/keystone/fernet-keys/
Sep 28 11:13:03 ctl02 salt-minion[14967]: +key_repository = /var/lib/keystone/fernet-keys
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# This controls how many keys are held in rotation by `keystone-manage
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# fernet_rotate` before they are discarded. The default value of 3 means that
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# keystone will maintain one staged key (always index 0), one primary key (the
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# highest numerical index), and one secondary key (every other index).
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Increasing this value means that additional secondary keys will be kept in
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# the rotation. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#max_active_keys = 3
Sep 28 11:13:03 ctl02 salt-minion[14967]: +max_active_keys=3
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +[healthcheck]
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# From oslo.middleware
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# DEPRECATED: The path to respond to healtcheck requests on. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # This option is deprecated for removal.
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Its value may be silently ignored in the future.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#admin_port = 35357
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# If set to false, disables keepalives on the server; all connections will be
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# closed after serving one request. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#wsgi_keep_alive = true
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Timeout for socket operations on a client connection. If an incoming
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# connection is idle for this number of seconds it will be closed. A value of
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# "0" means wait forever. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#client_socket_timeout = 900
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Set this to true if you want to enable TCP_KEEPALIVE on server sockets, i.e.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# sockets used by the Keystone wsgi server for client connections. (boolean
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Deprecated group/name - [DEFAULT]/tcp_keepalive
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# This option is deprecated for removal.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Its value may be silently ignored in the future.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#tcp_keepalive = false
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Sets the value of TCP_KEEPIDLE in seconds for each server socket. Only
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# applies if tcp_keepalive is true. Ignored if system does not support it.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Deprecated group/name - [DEFAULT]/tcp_keepidle
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# This option is deprecated for removal.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Its value may be silently ignored in the future.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#tcp_keepidle = 600
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -[eventlet_server_ssl]
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#path = /healthcheck
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Show more detailed information as part of the response (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#detailed = false
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Additional backends that can perform health checks and report that
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# information back as part of a request. (list value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#backends =
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Check the presence of a file to determine if an application is running on a
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# port. Used by DisableByFileHealthcheck plugin. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#disable_by_file_path = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Check the presence of a file based on a port to determine if an application
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# is running on a port. Expects a "port:path" list of strings. Used by
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# DisableByFilesPortsHealthcheck plugin. (list value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#disable_by_file_paths =
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +[identity]
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # From keystone
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Toggle for SSL support on the Keystone eventlet servers. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Deprecated group/name - [ssl]/enable
Sep 28 11:13:03 ctl02 systemd[1]: keystone.service: Service hold-off time over, scheduling restart.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# This option is deprecated for removal.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Its value may be silently ignored in the future.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#enable = false
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Path of the certfile for SSL. For non-production environments, you may be
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# interested in using `keystone-manage ssl_setup` to generate self-signed
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# certificates. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Deprecated group/name - [ssl]/certfile
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# This option is deprecated for removal.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Its value may be silently ignored in the future.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#certfile = /etc/keystone/ssl/certs/keystone.pem
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Path of the keyfile for SSL. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Deprecated group/name - [ssl]/keyfile
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# This option is deprecated for removal.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Its value may be silently ignored in the future.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#keyfile = /etc/keystone/ssl/private/keystonekey.pem
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Path of the CA cert file for SSL. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Deprecated group/name - [ssl]/ca_certs
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# This option is deprecated for removal.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Its value may be silently ignored in the future.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#ca_certs = /etc/keystone/ssl/certs/ca.pem
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Require client certificate. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Deprecated group/name - [ssl]/cert_required
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# This option is deprecated for removal.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Its value may be silently ignored in the future.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#cert_required = false
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -[federation]
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# From keystone
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Entrypoint for the federation backend driver in the keystone.federation
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# namespace. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#driver = sql
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Value to be used when filtering assertion parameters from the environment.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#assertion_prefix =
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Value to be used to obtain the entity ID of the Identity Provider from the
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# environment (e.g. if using the mod_shib plugin this value is `Shib-Identity-
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Provider`). (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#remote_id_attribute = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# A domain name that is reserved to allow federated ephemeral users to have a
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# domain concept. Note that an admin will not be able to create a domain with
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# this name or update an existing domain to this name. You are not advised to
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# change this value unless you really have to. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#federated_domain_name = Federated
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 systemd[1]: Stopped OpenStack Identity service.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# A list of trusted dashboard hosts. Before accepting a Single Sign-On request
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# to return a token, the origin host must be a member of the trusted_dashboard
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# list. This configuration option may be repeated for multiple values. For
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# example: trusted_dashboard=http://acme.com/auth/websso
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# trusted_dashboard=http://beta.com/auth/websso (multi valued)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#trusted_dashboard =
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Location of Single Sign-On callback handler, will return a token to a trusted
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# dashboard host. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#sso_callback_template = /etc/keystone/sso_callback_template.html
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -[fernet_tokens]
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# From keystone
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Directory containing Fernet token keys. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#key_repository = /etc/keystone/fernet-keys/
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# This controls how many keys are held in rotation by keystone-manage
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# fernet_rotate before they are discarded. The default value of 3 means that
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# keystone will maintain one staged key, one primary key, and one secondary
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# key. Increasing this value means that additional secondary keys will be kept
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# in the rotation. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#max_active_keys = 3
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -[identity]
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# From keystone
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # This references the domain to use for all Identity API v2 requests (which are
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# not aware of domains). A domain with this ID will be created for you by
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# keystone-manage db_sync in migration 008. The domain referenced by this ID
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# cannot be deleted on the v3 API, to prevent accidentally breaking the v2 API.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# There is nothing special about this domain, other than the fact that it must
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# exist to order to maintain support for your v2 clients. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# not aware of domains). A domain with this ID can optionally be created for
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# you by `keystone-manage bootstrap`. The domain referenced by this ID cannot
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# be deleted on the v3 API, to prevent accidentally breaking the v2 API. There
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# is nothing special about this domain, other than the fact that it must exist
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# to order to maintain support for your v2 clients. There is typically no
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# reason to change this value. (string value)
Sep 28 11:13:03 ctl02 systemd[1]: keystone.service: Start request repeated too quickly.
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #default_domain_id = default
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # A subset (or all) of domains can have their own identity driver, each with
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # their own partial configuration options, stored in either the resource
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # backend or in a file in a domain configuration directory (depending on the
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# setting of domain_configurations_from_database). Only values specific to the
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# domain need to be specified in this manner. This feature is disabled by
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# default; set to true to enable. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# setting of `[identity] domain_configurations_from_database`). Only values
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# specific to the domain need to be specified in this manner. This feature is
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# disabled by default, but may be enabled by default in a future release; set
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# to true to enable. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #domain_specific_drivers_enabled = false
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Extract the domain specific configuration options from the resource backend
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# where they have been stored with the domain data. This feature is disabled by
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# default (in which case the domain specific options will be loaded from files
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# in the domain configuration directory); set to true to enable. (boolean
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# By default, domain-specific configuration data is read from files in the
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# directory identified by `[identity] domain_config_dir`. Enabling this
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# configuration option allows you to instead manage domain-specific
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# configurations through the API, which are then persisted in the backend
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# (typically, a SQL database), rather than using configuration files on disk.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #domain_configurations_from_database = false
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Path for Keystone to locate the domain specific identity configuration files
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# if domain_specific_drivers_enabled is set to true. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Absolute path where keystone should locate domain-specific `[identity]`
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# configuration files. This option has no effect unless `[identity]
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# domain_specific_drivers_enabled` is set to true. There is typically no reason
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# to change this value. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #domain_config_dir = /etc/keystone/domains
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 systemd[1]: Failed to start OpenStack Identity service.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Entrypoint for the identity backend driver in the keystone.identity
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# namespace. Supplied drivers are ldap and sql. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Entry point for the identity backend driver in the `keystone.identity`
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# namespace. Keystone provides a `sql` and `ldap` driver. This option is also
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# used as the default driver selection (along with the other configuration
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# variables in this section) in the event that `[identity]
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# domain_specific_drivers_enabled` is enabled, but no applicable domain-
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# specific configuration is defined for the domain in question. Unless your
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# deployment primarily relies on `ldap` AND is not using domain-specific
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# configuration, you should typically leave this set to `sql`. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #driver = sql
Sep 28 11:13:03 ctl02 salt-minion[14967]: +driver = sql
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Toggle for identity caching. This has no effect unless global caching is
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# enabled. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# enabled. There is typically no reason to disable this. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #caching = true
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Time to cache identity data (in seconds). This has no effect unless global
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # and identity caching are enabled. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #cache_time = 600
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Maximum supported length for user passwords; decrease to improve performance.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Maximum allowed length for user passwords. Decrease this value to improve
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# performance. Changing this value does not effect existing passwords. (integer
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Maximum value: 4096
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #max_password_length = 4096
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: @@ -902,35 +1119,41 @@
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #list_limit = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]:  [identity_mapping]
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # From keystone
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Entrypoint for the identity mapping backend driver in the
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# keystone.identity.id_mapping namespace. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Entry point for the identity mapping backend driver in the
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# `keystone.identity.id_mapping` namespace. Keystone only provides a `sql`
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# driver, so there is no reason to change this unless you are providing a
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# custom entry point. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #driver = sql
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Entrypoint for the public ID generator for user and group entities in the
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# keystone.identity.id_generator namespace. The Keystone identity mapper only
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# supports generators that produce no more than 64 characters. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Entry point for the public ID generator for user and group entities in the
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# `keystone.identity.id_generator` namespace. The Keystone identity mapper only
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# supports generators that produce 64 bytes or less. Keystone only provides a
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# `sha256` entry point, so there is no reason to change this value unless
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# you're providing a custom entry point. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #generator = sha256
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # The format of user and group IDs changed in Juno for backends that do not
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# generate UUIDs (e.g. LDAP), with keystone providing a hash mapping to the
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# underlying attribute in LDAP. By default this mapping is disabled, which
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# generate UUIDs (for example, LDAP), with keystone providing a hash mapping to
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# the underlying attribute in LDAP. By default this mapping is disabled, which
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # ensures that existing IDs will not change. Even when the mapping is enabled
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# by using domain specific drivers, any users and groups from the default
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# by using domain-specific drivers (`[identity]
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# domain_specific_drivers_enabled`), any users and groups from the default
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # domain being handled by LDAP will still not be mapped to ensure their IDs
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# remain backward compatible. Setting this value to False will enable the
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# mapping for even the default LDAP driver. It is only safe to do this if you
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# do not already have assignments for users and groups from the default LDAP
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# domain, and it is acceptable for Keystone to provide the different IDs to
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# clients than it did previously. Typically this means that the only time you
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# can set this value to False is when configuring a fresh installation.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# remain backward compatible. Setting this value to false will enable the new
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# mapping for all backends, including the default LDAP driver. It is only
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# guaranteed to be safe to enable this option if you do not already have
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# assignments for users and groups from the default LDAP domain, and you
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# consider it to be acceptable for Keystone to provide the different IDs to
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# clients than it did previously (existing IDs in the API will suddenly
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# change). Typically this means that the only time you can set this value to
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# false is when configuring a fresh installation, although that is the
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# recommended value. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #backward_compatible_ids = true
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: @@ -940,23 +1163,49 @@
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # From keystone
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Extra dogpile.cache backend modules to register with the dogpile.cache
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# library. (list value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# DEPRECATED: Extra `dogpile.cache` backend modules to register with the
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# `dogpile.cache` library. It is not necessary to set this value unless you are
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# providing a custom KVS backend beyond what `dogpile.cache` already supports.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# (list value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# This option is deprecated for removal since O.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Reason: This option has been deprecated in the O release and will be removed
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# in the P release. Use SQL backends instead.
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #backends =
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Prefix for building the configuration dictionary for the KVS region. This
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# should not need to be changed unless there is another dogpile.cache region
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# with the same configuration name. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# DEPRECATED: Prefix for building the configuration dictionary for the KVS
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# region. This should not need to be changed unless there is another
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# `dogpile.cache` region with the same configuration name. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# This option is deprecated for removal since O.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Reason: This option has been deprecated in the O release and will be removed
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# in the P release. Use SQL backends instead.
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #config_prefix = keystone.kvs
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Toggle to disable using a key-mangling function to ensure fixed length keys.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# This is toggle-able for debugging purposes, it is highly recommended to
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# always leave this set to true. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# DEPRECATED: Set to false to disable using a key-mangling function, which
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# ensures fixed-length keys are used in the KVS store. This is configurable for
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# debugging purposes, and it is therefore highly recommended to always leave
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# this set to true. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# This option is deprecated for removal since O.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Reason: This option has been deprecated in the O release and will be removed
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# in the P release. Use SQL backends instead.
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #enable_key_mangler = true
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Default lock timeout (in seconds) for distributed locking. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# DEPRECATED: Number of seconds after acquiring a distributed lock that the
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# backend should consider the lock to be expired. This option should be tuned
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# relative to the longest amount of time that it takes to perform a successful
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# operation. If this value is set too low, then a cluster will end up
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# performing work redundantly. If this value is set too high, then a cluster
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# will not be able to efficiently recover and retry after a failed operation. A
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# non-zero value is recommended if the backend supports lock timeouts, as zero
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# prevents locks from expiring altogether. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# This option is deprecated for removal since O.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Reason: This option has been deprecated in the O release and will be removed
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# in the P release. Use SQL backends instead.
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #default_lock_timeout = 5
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  [ldap]
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: @@ -969,356 +1218,503 @@
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # the connection. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #url = ldap://localhost
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# User BindDN to query the LDAP server. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The user name of the administrator bind DN to use when querying the LDAP
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# server, if your LDAP server requires it. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #user = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Password for the BindDN to query the LDAP server. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The password of the administrator bind DN to use when querying the LDAP
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# server, if your LDAP server requires it. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #password = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# LDAP server suffix (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The default LDAP server suffix to use, if a DN is not defined via either
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# `[ldap] user_tree_dn` or `[ldap] group_tree_dn`. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #suffix = cn=example,cn=com
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# If true, will add a dummy member to groups. This is required if the
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# objectclass for groups requires the "member" attribute. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#use_dumb_member = false
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# DN of the "dummy member" to use when "use_dumb_member" is enabled. (string
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#dumb_member = cn=dumb,dc=nonexistent
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Delete subtrees using the subtree delete control. Only enable this option if
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# your LDAP server supports subtree deletion. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#allow_subtree_delete = false
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# The LDAP scope for queries, "one" represents oneLevel/singleLevel and "sub"
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# represents subtree/wholeSubtree options. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The search scope which defines how deep to search within the search base. A
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# value of `one` (representing `oneLevel` or `singleLevel`) indicates a search
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# of objects immediately below to the base object, but does not include the
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# base object itself. A value of `sub` (representing `subtree` or
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# `wholeSubtree`) indicates a search of both the base object itself and the
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# entire subtree below it. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Allowed values: one, sub
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #query_scope = one
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Maximum results per page; a value of zero ("0") disables paging. (integer
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Defines the maximum number of results per page that keystone should request
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# from the LDAP server when listing objects. A value of zero (`0`) disables
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# paging. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #page_size = 0
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# The LDAP dereferencing option for queries. The "default" option falls back to
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# using default dereferencing configured by your ldap.conf. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The LDAP dereferencing option to use for queries involving aliases. A value
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# of `default` falls back to using default dereferencing behavior configured by
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# your `ldap.conf`. A value of `never` prevents aliases from being dereferenced
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# at all. A value of `searching` dereferences aliases only after name
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# resolution. A value of `finding` dereferences aliases only during name
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# resolution. A value of `always` dereferences aliases in all cases. (string
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Allowed values: never, searching, always, finding, default
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #alias_dereferencing = default
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Sets the LDAP debugging level for LDAP calls. A value of 0 means that
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # debugging is not enabled. This value is a bitmask, consult your LDAP
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # documentation for possible values. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Minimum value: -1
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #debug_level = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Override the system's default referral chasing behavior for queries. (boolean
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Sets keystone's referral chasing behavior across directory partitions. If
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# left unset, the system's default behavior will be used. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #chase_referrals = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Search base for users. Defaults to the suffix value. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The search base to use for users. Defaults to the `[ldap] suffix` value.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #user_tree_dn = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# LDAP search filter for users. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The LDAP search filter to use for users. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #user_filter = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# LDAP objectclass for users. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The LDAP object class to use for users. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #user_objectclass = inetOrgPerson
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# LDAP attribute mapped to user id. WARNING: must not be a multivalued
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# attribute. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The LDAP attribute mapped to user IDs in keystone. This must NOT be a
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# multivalued attribute. User IDs are expected to be globally unique across
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# keystone domains and URL-safe. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #user_id_attribute = cn
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# LDAP attribute mapped to user name. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The LDAP attribute mapped to user names in keystone. User names are expected
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# to be unique only within a keystone domain and are not expected to be URL-
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# safe. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #user_name_attribute = sn
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# LDAP attribute mapped to user description. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The LDAP attribute mapped to user descriptions in keystone. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #user_description_attribute = description
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# LDAP attribute mapped to user email. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The LDAP attribute mapped to user emails in keystone. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #user_mail_attribute = mail
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# LDAP attribute mapped to password. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The LDAP attribute mapped to user passwords in keystone. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #user_pass_attribute = userPassword
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# LDAP attribute mapped to user enabled flag. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The LDAP attribute mapped to the user enabled attribute in keystone. If
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# setting this option to `userAccountControl`, then you may be interested in
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# setting `[ldap] user_enabled_mask` and `[ldap] user_enabled_default` as well.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #user_enabled_attribute = enabled
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Invert the meaning of the boolean enabled values. Some LDAP servers use a
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# boolean lock attribute where "true" means an account is disabled. Setting
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# "user_enabled_invert = true" will allow these lock attributes to be used.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# This setting will have no effect if "user_enabled_mask" or
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# "user_enabled_emulation" settings are in use. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Logically negate the boolean value of the enabled attribute obtained from the
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# LDAP server. Some LDAP servers use a boolean lock attribute where "true"
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# means an account is disabled. Setting `[ldap] user_enabled_invert = true`
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# will allow these lock attributes to be used. This option will have no effect
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# if either the `[ldap] user_enabled_mask` or `[ldap] user_enabled_emulation`
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# options are in use. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #user_enabled_invert = false
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Bitmask integer to indicate the bit that the enabled value is stored in if
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# the LDAP server represents "enabled" as a bit on an integer rather than a
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# boolean. A value of "0" indicates the mask is not used. If this is not set to
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# "0" the typical value is "2". This is typically used when
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# "user_enabled_attribute = userAccountControl". (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Bitmask integer to select which bit indicates the enabled value if the LDAP
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# server represents "enabled" as a bit on an integer rather than as a discrete
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# boolean. A value of `0` indicates that the mask is not used. If this is not
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# set to `0` the typical value is `2`. This is typically used when `[ldap]
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# user_enabled_attribute = userAccountControl`. Setting this option causes
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# keystone to ignore the value of `[ldap] user_enabled_invert`. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #user_enabled_mask = 0
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Default value to enable users. This should match an appropriate int value if
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# the LDAP server uses non-boolean (bitmask) values to indicate if a user is
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# enabled or disabled. If this is not set to "True" the typical value is "512".
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# This is typically used when "user_enabled_attribute = userAccountControl".
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The default value to enable users. This should match an appropriate integer
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# value if the LDAP server uses non-boolean (bitmask) values to indicate if a
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# user is enabled or disabled. If this is not set to `True`, then the typical
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# value is `512`. This is typically used when `[ldap] user_enabled_attribute =
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# userAccountControl`. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#user_enabled_default = True
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# List of user attributes to ignore on create and update, or whether a specific
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# user attribute should be filtered for list or show user. (list value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#user_attribute_ignore = default_project_id
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The LDAP attribute mapped to a user's default_project_id in keystone. This is
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# most commonly used when keystone has write access to LDAP. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#user_default_project_id_attribute = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# If enabled, keystone uses an alternative method to determine if a user is
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# enabled or not by checking if they are a member of the group defined by the
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# `[ldap] user_enabled_emulation_dn` option. Enabling this option causes
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# keystone to ignore the value of `[ldap] user_enabled_invert`. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#user_enabled_emulation = false
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# DN of the group entry to hold enabled users when using enabled emulation.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Setting this option has no effect unless `[ldap] user_enabled_emulation` is
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# also enabled. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#user_enabled_emulation_dn = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Use the `[ldap] group_member_attribute` and `[ldap] group_objectclass`
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# settings to determine membership in the emulated enabled group. Enabling this
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# option has no effect unless `[ldap] user_enabled_emulation` is also enabled.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#user_enabled_emulation_use_group_config = false
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# A list of LDAP attribute to keystone user attribute pairs used for mapping
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# additional attributes to users in keystone. The expected format is
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# `<ldap_attr>:<user_attr>`, where `ldap_attr` is the attribute in the LDAP
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# object and `user_attr` is the attribute which should appear in the identity
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# API. (list value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#user_additional_attribute_mapping =
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The search base to use for groups. Defaults to the `[ldap] suffix` value.
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#user_enabled_default = True
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# List of attributes stripped off the user on update. (list value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#user_attribute_ignore = default_project_id
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# LDAP attribute mapped to default_project_id for users. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#user_default_project_id_attribute = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Allow user creation in LDAP backend. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#group_tree_dn = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The LDAP search filter to use for groups. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#group_filter = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The LDAP object class to use for groups. If setting this option to
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# `posixGroup`, you may also be interested in enabling the `[ldap]
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# group_members_are_ids` option. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#group_objectclass = groupOfNames
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The LDAP attribute mapped to group IDs in keystone. This must NOT be a
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# multivalued attribute. Group IDs are expected to be globally unique across
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# keystone domains and URL-safe. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#group_id_attribute = cn
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The LDAP attribute mapped to group names in keystone. Group names are
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# expected to be unique only within a keystone domain and are not expected to
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# be URL-safe. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#group_name_attribute = ou
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The LDAP attribute used to indicate that a user is a member of the group.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#group_member_attribute = member
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Enable this option if the members of the group object class are keystone user
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# IDs rather than LDAP DNs. This is the case when using `posixGroup` as the
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# group object class in Open Directory. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#group_members_are_ids = false
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The LDAP attribute mapped to group descriptions in keystone. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#group_desc_attribute = description
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# List of group attributes to ignore on create and update. or whether a
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# specific group attribute should be filtered for list or show group. (list
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#group_attribute_ignore =
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# A list of LDAP attribute to keystone group attribute pairs used for mapping
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# additional attributes to groups in keystone. The expected format is
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# `<ldap_attr>:<group_attr>`, where `ldap_attr` is the attribute in the LDAP
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# object and `group_attr` is the attribute which should appear in the identity
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# API. (list value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#group_additional_attribute_mapping =
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# If enabled, group queries will use Active Directory specific filters for
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# nested groups. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#group_ad_nesting = false
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# An absolute path to a CA certificate file to use when communicating with LDAP
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# servers. This option will take precedence over `[ldap] tls_cacertdir`, so
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# there is no reason to set both. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#tls_cacertfile = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# An absolute path to a CA certificate directory to use when communicating with
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# LDAP servers. There is no reason to set this option if you've also set
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# `[ldap] tls_cacertfile`. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#tls_cacertdir = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Enable TLS when communicating with LDAP servers. You should also set the
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# `[ldap] tls_cacertfile` and `[ldap] tls_cacertdir` options when using this
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# option. Do not set this option if you are using LDAP over SSL (LDAPS) instead
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# of TLS. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#use_tls = false
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Specifies which checks to perform against client certificates on incoming TLS
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# sessions. If set to `demand`, then a certificate will always be requested and
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# required from the LDAP server. If set to `allow`, then a certificate will
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# always be requested but not required from the LDAP server. If set to `never`,
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# then a certificate will never be requested. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Allowed values: demand, never, allow
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#tls_req_cert = demand
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The connection timeout to use with the LDAP server. A value of `-1` means
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# that connections will never timeout. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Minimum value: -1
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#connection_timeout = -1
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Enable LDAP connection pooling for queries to the LDAP server. There is
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# typically no reason to disable this. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#use_pool = true
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The size of the LDAP connection pool. This option has no effect unless
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# `[ldap] use_pool` is also enabled. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#pool_size = 10
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The maximum number of times to attempt reconnecting to the LDAP server before
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# aborting. A value of zero prevents retries. This option has no effect unless
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# `[ldap] use_pool` is also enabled. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#pool_retry_max = 3
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The number of seconds to wait before attempting to reconnect to the LDAP
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# server. This option has no effect unless `[ldap] use_pool` is also enabled.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# (floating point value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#pool_retry_delay = 0.1
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The connection timeout to use when pooling LDAP connections. A value of `-1`
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# means that connections will never timeout. This option has no effect unless
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# `[ldap] use_pool` is also enabled. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Minimum value: -1
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#pool_connection_timeout = -1
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The maximum connection lifetime to the LDAP server in seconds. When this
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# lifetime is exceeded, the connection will be unbound and removed from the
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# connection pool. This option has no effect unless `[ldap] use_pool` is also
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# enabled. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#pool_connection_lifetime = 600
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Enable LDAP connection pooling for end user authentication. There is
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# typically no reason to disable this. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#use_auth_pool = true
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The size of the connection pool to use for end user authentication. This
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# option has no effect unless `[ldap] use_auth_pool` is also enabled. (integer
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#auth_pool_size = 100
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The maximum end user authentication connection lifetime to the LDAP server in
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# seconds. When this lifetime is exceeded, the connection will be unbound and
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# removed from the connection pool. This option has no effect unless `[ldap]
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# use_auth_pool` is also enabled. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#auth_pool_connection_lifetime = 60
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +[matchmaker_redis]
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# From oslo.messaging
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# DEPRECATED: Host to locate redis. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # This option is deprecated for removal.
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Its value may be silently ignored in the future.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Reason: Write support for Identity LDAP backends has been deprecated in the M
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# release and will be removed in the O release.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#user_allow_create = true
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Allow user updates in LDAP backend. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#host = 127.0.0.1
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# DEPRECATED: Use this port to connect to redis host. (port value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Maximum value: 65535
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # This option is deprecated for removal.
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Its value may be silently ignored in the future.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Reason: Write support for Identity LDAP backends has been deprecated in the M
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# release and will be removed in the O release.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#user_allow_update = true
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Allow user deletion in LDAP backend. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#port = 6379
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# DEPRECATED: Password for Redis server (optional). (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # This option is deprecated for removal.
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Its value may be silently ignored in the future.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Reason: Write support for Identity LDAP backends has been deprecated in the M
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# release and will be removed in the O release.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#user_allow_delete = true
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# If true, Keystone uses an alternative method to determine if a user is
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# enabled or not by checking if they are a member of the
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# "user_enabled_emulation_dn" group. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#user_enabled_emulation = false
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# DN of the group entry to hold enabled users when using enabled emulation.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#user_enabled_emulation_dn = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Use the "group_member_attribute" and "group_objectclass" settings to
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# determine membership in the emulated enabled group. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#user_enabled_emulation_use_group_config = false
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# List of additional LDAP attributes used for mapping additional attribute
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# mappings for users. Attribute mapping format is <ldap_attr>:<user_attr>,
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# where ldap_attr is the attribute in the LDAP entry and user_attr is the
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Identity API attribute. (list value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#user_additional_attribute_mapping =
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Search base for groups. Defaults to the suffix value. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#group_tree_dn = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# LDAP search filter for groups. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#group_filter = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# LDAP objectclass for groups. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#group_objectclass = groupOfNames
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# LDAP attribute mapped to group id. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#group_id_attribute = cn
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# LDAP attribute mapped to group name. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#group_name_attribute = ou
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# LDAP attribute mapped to show group membership. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#group_member_attribute = member
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# LDAP attribute mapped to group description. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#group_desc_attribute = description
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# List of attributes stripped off the group on update. (list value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#group_attribute_ignore =
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Allow group creation in LDAP backend. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#password =
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# DEPRECATED: List of Redis Sentinel hosts (fault tolerance mode), e.g.,
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# [host:port, host1:port ... ] (list value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # This option is deprecated for removal.
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Its value may be silently ignored in the future.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Reason: Write support for Identity LDAP backends has been deprecated in the M
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# release and will be removed in the O release.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#group_allow_create = true
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Allow group update in LDAP backend. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#sentinel_hosts =
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Redis replica set name. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#sentinel_group_name = oslo-messaging-zeromq
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Time in ms to wait between connection attempts. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#wait_timeout = 2000
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Time in ms to wait before the transaction is killed. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#check_timeout = 20000
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Timeout in ms on blocking socket operations. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#socket_timeout = 10000
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +[memcache]
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# From keystone
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# DEPRECATED: Comma-separated list of memcached servers in the format of
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# `host:port,host:port` that keystone should use for the `memcache` token
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# persistence provider and other memcache-backed KVS drivers. This
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# configuration value is NOT used for intermediary caching between keystone and
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# other backends, such as SQL and LDAP (for that, see the `[cache]` section).
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Multiple keystone servers in the same deployment should use the same set of
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# memcached servers to ensure that data (such as UUID tokens) created by one
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# node is available to the others. (list value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# This option is deprecated for removal since O.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Reason: This option has been deprecated in the O release and will be removed
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# in the P release. Use oslo.cache instead.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#servers = localhost:11211
Sep 28 11:13:03 ctl02 salt-minion[14967]: +servers =10.167.4.11:11211,10.167.4.12:11211,10.167.4.13:11211
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Number of seconds memcached server is considered dead before it is tried
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# again. This is used by the key value store system. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#dead_retry = 300
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Timeout in seconds for every call to a server. This is used by the key value
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# store system. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#socket_timeout = 3
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Max total number of open connections to every memcached server. This is used
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# by the key value store system. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#pool_maxsize = 10
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Number of seconds a connection to memcached is held unused in the pool before
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# it is closed. This is used by the key value store system. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#pool_unused_timeout = 60
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Number of seconds that an operation will wait to get a memcache client
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# connection. This is used by the key value store system. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#pool_connection_get_timeout = 10
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +[oauth1]
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# From keystone
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Entry point for the OAuth backend driver in the `keystone.oauth1` namespace.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Typically, there is no reason to set this option unless you are providing a
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# custom entry point. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#driver = sql
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Number of seconds for the OAuth Request Token to remain valid after being
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# created. This is the amount of time the user has to authorize the token.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Setting this option to zero means that request tokens will last forever.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#request_token_duration = 28800
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Number of seconds for the OAuth Access Token to remain valid after being
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# created. This is the amount of time the consumer has to interact with the
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# service provider (which is typically keystone). Setting this option to zero
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# means that access tokens will last forever. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#access_token_duration = 86400
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +[oslo_messaging_amqp]
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# From oslo.messaging
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Name for the AMQP container. must be globally unique. Defaults to a generated
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# UUID (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/container_name
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#container_name = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Timeout for inactive connections (in seconds) (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/idle_timeout
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#idle_timeout = 0
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Debug: dump AMQP frames to stdout (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/trace
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#trace = false
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# CA certificate PEM file used to verify the server's certificate (string
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/ssl_ca_file
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#ssl_ca_file =
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Self-identifying certificate PEM file for client authentication (string
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/ssl_cert_file
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#ssl_cert_file =
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Private key PEM file used to sign ssl_cert_file certificate (optional)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/ssl_key_file
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#ssl_key_file =
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Password for decrypting ssl_key_file (if encrypted) (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/ssl_key_password
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#ssl_key_password = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# DEPRECATED: Accept clients using either SSL or plain TCP (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/allow_insecure_clients
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # This option is deprecated for removal.
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Its value may be silently ignored in the future.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Reason: Write support for Identity LDAP backends has been deprecated in the M
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# release and will be removed in the O release.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#group_allow_update = true
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Allow group deletion in LDAP backend. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# This option is deprecated for removal.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Its value may be silently ignored in the future.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Reason: Write support for Identity LDAP backends has been deprecated in the M
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# release and will be removed in the O release.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#group_allow_delete = true
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Additional attribute mappings for groups. Attribute mapping format is
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# <ldap_attr>:<user_attr>, where ldap_attr is the attribute in the LDAP entry
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# and user_attr is the Identity API attribute. (list value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#group_additional_attribute_mapping =
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# CA certificate file path for communicating with LDAP servers. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#tls_cacertfile = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# CA certificate directory path for communicating with LDAP servers. (string
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#tls_cacertdir = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Enable TLS for communicating with LDAP servers. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#use_tls = false
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Specifies what checks to perform on client certificates in an incoming TLS
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# session. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Allowed values: demand, never, allow
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#tls_req_cert = demand
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Enable LDAP connection pooling. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#use_pool = true
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Connection pool size. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#pool_size = 10
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Maximum count of reconnect trials. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#pool_retry_max = 3
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Time span in seconds to wait between two reconnect trials. (floating point
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#pool_retry_delay = 0.1
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Connector timeout in seconds. Value -1 indicates indefinite wait for
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# response. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#pool_connection_timeout = -1
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Connection lifetime in seconds. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#pool_connection_lifetime = 600
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Enable LDAP connection pooling for end user authentication. If use_pool is
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# disabled, then this setting is meaningless and is not used at all. (boolean
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#use_auth_pool = true
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# End user auth connection pool size. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#auth_pool_size = 100
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# End user auth connection lifetime in seconds. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#auth_pool_connection_lifetime = 60
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# If the members of the group objectclass are user IDs rather than DNs, set
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# this to true. This is the case when using posixGroup as the group objectclass
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# and OpenDirectory. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#group_members_are_ids = false
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -[matchmaker_redis]
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# From oslo.messaging
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Host to locate redis. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#host = 127.0.0.1
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Use this port to connect to redis host. (port value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Reason: Not applicable - not a SSL server
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#allow_insecure_clients = false
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Space separated list of acceptable SASL mechanisms (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/sasl_mechanisms
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#sasl_mechanisms =
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Path to directory that contains the SASL configuration (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/sasl_config_dir
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#sasl_config_dir =
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Name of configuration file (without .conf suffix) (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/sasl_config_name
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#sasl_config_name =
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# User name for message broker authentication (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/username
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#username =
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Password for message broker authentication (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/password
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#password =
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Seconds to pause before attempting to re-connect. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#connection_retry_interval = 1
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Increase the connection_retry_interval by this many seconds after each
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# unsuccessful failover attempt. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Minimum value: 0
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Maximum value: 65535
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#port = 6379
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Password for Redis server (optional). (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#password =
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# List of Redis Sentinel hosts (fault tolerance mode) e.g.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# [host:port, host1:port ... ] (list value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#sentinel_hosts =
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Redis replica set name. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#sentinel_group_name = oslo-messaging-zeromq
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Time in ms to wait between connection attempts. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#wait_timeout = 500
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Time in ms to wait before the transaction is killed. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#check_timeout = 20000
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Timeout in ms on blocking socket operations (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#socket_timeout = 1000
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -[memcache]
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# From keystone
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Memcache servers in the format of "host:port". (list value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#servers = localhost:11211
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Number of seconds memcached server is considered dead before it is tried
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# again. This is used by the key value store system (e.g. token pooled
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# memcached persistence backend). (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#dead_retry = 300
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Timeout in seconds for every call to a server. This is used by the key value
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# store system (e.g. token pooled memcached persistence backend). (integer
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#socket_timeout = 3
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Max total number of open connections to every memcached server. This is used
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# by the key value store system (e.g. token pooled memcached persistence
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# backend). (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#pool_maxsize = 10
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Number of seconds a connection to memcached is held unused in the pool before
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# it is closed. This is used by the key value store system (e.g. token pooled
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# memcached persistence backend). (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#pool_unused_timeout = 60
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Number of seconds that an operation will wait to get a memcache client
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# connection. This is used by the key value store system (e.g. token pooled
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# memcached persistence backend). (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#pool_connection_get_timeout = 10
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -[oauth1]
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# From keystone
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Entrypoint for the OAuth backend driver in the keystone.oauth1 namespace.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#driver = sql
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Duration (in seconds) for the OAuth Request Token. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#request_token_duration = 28800
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Duration (in seconds) for the OAuth Access Token. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#access_token_duration = 86400
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -[os_inherit]
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# From keystone
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# role-assignment inheritance to projects from owning domain or from projects
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# higher in the hierarchy can be optionally disabled. In the future, this
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# option will be removed and the hierarchy will be always enabled. (boolean
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# This option is deprecated for removal.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Its value may be silently ignored in the future.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Reason: The option to enable the OS-INHERIT extension has been deprecated in
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# the M release and will be removed in the O release. The OS-INHERIT extension
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# will be enabled by default.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#enabled = true
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -[oslo_messaging_amqp]
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# From oslo.messaging
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#connection_retry_backoff = 2
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Maximum limit for connection_retry_interval + connection_retry_backoff
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#connection_retry_interval_max = 30
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Time to pause between re-connecting an AMQP 1.0 link that failed due to a
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# recoverable error. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#link_retry_delay = 10
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The maximum number of attempts to re-send a reply message which failed due to
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# a recoverable error. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Minimum value: -1
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#default_reply_retry = 0
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The deadline for an rpc reply message delivery. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Minimum value: 5
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#default_reply_timeout = 30
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The deadline for an rpc cast or call message delivery. Only used when caller
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# does not provide a timeout expiry. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Minimum value: 5
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#default_send_timeout = 30
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The deadline for a sent notification message delivery. Only used when caller
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# does not provide a timeout expiry. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Minimum value: 5
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#default_notify_timeout = 30
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The duration to schedule a purge of idle sender links. Detach link after
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# expiry. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#default_sender_link_timeout = 600
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Indicates the addressing mode used by the driver.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Permitted values:
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# 'legacy'   - use legacy non-routable addressing
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# 'routable' - use routable addresses
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# 'dynamic'  - use legacy addresses if the message bus does not support routing
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# otherwise use routable addressing (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#addressing_mode = dynamic
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # address prefix used when sending to a specific server (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Deprecated group/name - [amqp1]/server_request_prefix
Sep 28 11:13:03 ctl02 salt-minion[14967]: @@ -1332,57 +1728,113 @@
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Deprecated group/name - [amqp1]/group_request_prefix
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #group_request_prefix = unicast
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Name for the AMQP container (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/container_name
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#container_name = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Timeout for inactive connections (in seconds) (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/idle_timeout
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#idle_timeout = 0
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Debug: dump AMQP frames to stdout (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/trace
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#trace = false
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# CA certificate PEM file to verify server certificate (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/ssl_ca_file
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#ssl_ca_file =
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Identifying certificate PEM file to present to clients (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/ssl_cert_file
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#ssl_cert_file =
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Private key PEM file used to sign cert_file certificate (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/ssl_key_file
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#ssl_key_file =
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Password for decrypting ssl_key_file (if encrypted) (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/ssl_key_password
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#ssl_key_password = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Accept clients using either SSL or plain TCP (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/allow_insecure_clients
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#allow_insecure_clients = false
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Space separated list of acceptable SASL mechanisms (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/sasl_mechanisms
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#sasl_mechanisms =
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Path to directory that contains the SASL configuration (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/sasl_config_dir
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#sasl_config_dir =
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Name of configuration file (without .conf suffix) (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/sasl_config_name
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#sasl_config_name =
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# User name for message broker authentication (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/username
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#username =
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Password for message broker authentication (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/password
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#password =
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Address prefix for all generated RPC addresses (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#rpc_address_prefix = openstack.org/om/rpc
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Address prefix for all generated Notification addresses (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#notify_address_prefix = openstack.org/om/notify
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Appended to the address prefix when sending a fanout message. Used by the
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# message bus to identify fanout messages. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#multicast_address = multicast
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Appended to the address prefix when sending to a particular RPC/Notification
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# server. Used by the message bus to identify messages sent to a single
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# destination. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#unicast_address = unicast
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Appended to the address prefix when sending to a group of consumers. Used by
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# the message bus to identify messages that should be delivered in a round-
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# robin fashion across consumers. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#anycast_address = anycast
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Exchange name used in notification addresses.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Exchange name resolution precedence:
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Target.exchange if set
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# else default_notification_exchange if set
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# else control_exchange if set
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# else 'notify' (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#default_notification_exchange = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Exchange name used in RPC addresses.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Exchange name resolution precedence:
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Target.exchange if set
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# else default_rpc_exchange if set
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# else control_exchange if set
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# else 'rpc' (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#default_rpc_exchange = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Window size for incoming RPC Reply messages. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#reply_link_credit = 200
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Window size for incoming RPC Request messages (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#rpc_server_credit = 100
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Window size for incoming Notification messages (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#notify_server_credit = 100
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Send messages of this type pre-settled.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Pre-settled messages will not receive acknowledgement
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# from the peer. Note well: pre-settled messages may be
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# silently discarded if the delivery fails.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Permitted values:
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# 'rpc-call' - send RPC Calls pre-settled
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# 'rpc-reply'- send RPC Replies pre-settled
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# 'rpc-cast' - Send RPC Casts pre-settled
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# 'notify'   - Send Notifications pre-settled
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#  (multi valued)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#pre_settled = rpc-cast
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#pre_settled = rpc-reply
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +[oslo_messaging_kafka]
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# From oslo.messaging
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# DEPRECATED: Default Kafka broker Host (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#kafka_default_host = localhost
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# DEPRECATED: Default Kafka broker Port (port value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Maximum value: 65535
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#kafka_default_port = 9092
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Max fetch bytes of Kafka consumer (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#kafka_max_fetch_bytes = 1048576
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Default timeout(s) for Kafka consumers (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#kafka_consumer_timeout = 1.0
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Pool Size for Kafka Consumers (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#pool_size = 10
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The pool size limit for connections expiration policy (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#conn_pool_min_size = 2
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The time-to-live in sec of idle connections in the pool (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#conn_pool_ttl = 1200
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Group id for Kafka consumer. Consumers in one group will coordinate message
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# consumption (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#consumer_group = oslo_messaging_consumer
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Upper bound on the delay for KafkaProducer batching in seconds (floating
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# point value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#producer_batch_timeout = 0.0
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Size of batch for the producer async send (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#producer_batch_size = 16384
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  [oslo_messaging_notifications]
Sep 28 11:13:03 ctl02 salt-minion[14967]: @@ -1395,6 +1847,7 @@
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # messaging, messagingv2, routing, log, test, noop (multi valued)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/notification_driver
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #driver =
Sep 28 11:13:03 ctl02 salt-minion[14967]: +driver=messagingv2
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # A URL representing the messaging driver to use for notifications. If not set,
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # we fall back to the same configuration used for RPC. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: @@ -1446,12 +1899,12 @@
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #kombu_reconnect_delay = 1.0
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # EXPERIMENTAL: Possible values are: gzip, bz2. If not set compression will not
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# be used. This option may notbe available in future versions. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# be used. This option may not be available in future versions. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #kombu_compression = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# How long to wait a missing client beforce abandoning to send it its replies.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# How long to wait a missing client before abandoning to send it its replies.
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # This value should not be longer than rpc_response_timeout. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Deprecated group/name - [DEFAULT]/kombu_reconnect_timeout
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Deprecated group/name - [oslo_messaging_rabbit]/kombu_reconnect_timeout
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #kombu_missing_consumer_retry_timeout = 60
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Determines how the next RabbitMQ node is chosen in case the one we are
Sep 28 11:13:03 ctl02 salt-minion[14967]: @@ -1460,38 +1913,59 @@
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Allowed values: round-robin, shuffle
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #kombu_failover_strategy = round-robin
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# The RabbitMQ broker address where a single node is used. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# DEPRECATED: The RabbitMQ broker address where a single node is used. (string
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rabbit_host
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #rabbit_host = localhost
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# The RabbitMQ broker port where a single node is used. (port value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# DEPRECATED: The RabbitMQ broker port where a single node is used. (port
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Minimum value: 0
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Maximum value: 65535
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rabbit_port
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #rabbit_port = 5672
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# RabbitMQ HA cluster host:port pairs. (list value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# DEPRECATED: RabbitMQ HA cluster host:port pairs. (list value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rabbit_hosts
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #rabbit_hosts = $rabbit_host:$rabbit_port
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Connect over SSL for RabbitMQ. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rabbit_use_ssl
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #rabbit_use_ssl = false
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# The RabbitMQ userid. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# DEPRECATED: The RabbitMQ userid. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rabbit_userid
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #rabbit_userid = guest
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# The RabbitMQ password. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# DEPRECATED: The RabbitMQ password. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rabbit_password
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #rabbit_password = guest
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # The RabbitMQ login method. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Allowed values: PLAIN, AMQPLAIN, RABBIT-CR-DEMO
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rabbit_login_method
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #rabbit_login_method = AMQPLAIN
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# The RabbitMQ virtual host. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# DEPRECATED: The RabbitMQ virtual host. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rabbit_virtual_host
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #rabbit_virtual_host = /
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # How frequently to retry connecting with RabbitMQ. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: @@ -1506,15 +1980,17 @@
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #rabbit_interval_max = 30
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Maximum number of RabbitMQ connection retries. Default is 0 (infinite retry
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# count). (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# DEPRECATED: Maximum number of RabbitMQ connection retries. Default is 0
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# (infinite retry count). (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rabbit_max_retries
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #rabbit_max_retries = 0
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Try to use HA queues in RabbitMQ (x-ha-policy: all). If you change this
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # option, you must wipe the RabbitMQ database. In RabbitMQ 3.0, queue mirroring
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # is no longer controlled by the x-ha-policy argument when declaring a queue.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# If you just want to make sure that all queues (except  those with auto-
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# If you just want to make sure that all queues (except those with auto-
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # generated names) are mirrored across all nodes, run: "rabbitmqctl set_policy
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # HA '^(?!amq\.).*' '{"ha-mode": "all"}' " (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rabbit_ha_queues
Sep 28 11:13:03 ctl02 salt-minion[14967]: @@ -1534,10 +2010,12 @@
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # heartbeat's keep-alive fails (0 disable the heartbeat). EXPERIMENTAL (integer
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #heartbeat_timeout_threshold = 60
Sep 28 11:13:03 ctl02 salt-minion[14967]: +heartbeat_timeout_threshold = 0
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # How often times during the heartbeat_timeout_threshold we check the
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # heartbeat. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #heartbeat_rate = 2
Sep 28 11:13:03 ctl02 salt-minion[14967]: +heartbeat_rate = 2
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Deprecated, use rpc_backend=kombu+memory or rpc_backend=fake (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/fake_rabbit
Sep 28 11:13:03 ctl02 salt-minion[14967]: @@ -1550,7 +2028,7 @@
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #frame_max = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # How often to send heartbeats for consumer's connections (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#heartbeat_interval = 1
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#heartbeat_interval = 3
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Enable SSL (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #ssl = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]: @@ -1569,8 +2047,12 @@
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # point value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #host_connection_reconnect_delay = 0.25
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Connection factory implementation (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Allowed values: new, single, read_write
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#connection_factory = single
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Maximum number of connections to keep queued. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#pool_max_size = 10
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#pool_max_size = 30
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Maximum number of connections to create above `pool_max_size`. (integer
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: @@ -1589,10 +2071,15 @@
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #pool_stale = 60
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Default serialization mechanism for serializing/deserializing
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# outgoing/incoming messages (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Allowed values: json, msgpack
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#default_serializer_type = json
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Persist notification messages. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #notification_persistence = false
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Exchange name for for sending notifications (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Exchange name for sending notifications (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #default_notification_exchange = ${control_exchange}_notification
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Max number of not acknowledged message which RabbitMQ can send to
Sep 28 11:13:03 ctl02 salt-minion[14967]: @@ -1634,7 +2121,7 @@
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Reconnecting retry count in case of connectivity problem during sending RPC
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # message, -1 means infinite retry. If actual retry attempts in not 0 the rpc
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# request could be processed more then one time (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# request could be processed more than one time (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #default_rpc_retry_attempts = -1
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Reconnecting retry delay in case of connectivity problem during sending RPC
Sep 28 11:13:03 ctl02 salt-minion[14967]: @@ -1642,6 +2129,167 @@
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #rpc_retry_delay = 0.25
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: +[oslo_messaging_zmq]
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# From oslo.messaging
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# ZeroMQ bind address. Should be a wildcard (*), an ethernet interface, or IP.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The "host" option should point or resolve to this address. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_bind_address
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#rpc_zmq_bind_address = *
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# MatchMaker driver. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Allowed values: redis, sentinel, dummy
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_matchmaker
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#rpc_zmq_matchmaker = redis
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Number of ZeroMQ contexts, defaults to 1. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_contexts
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#rpc_zmq_contexts = 1
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Maximum number of ingress messages to locally buffer per topic. Default is
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# unlimited. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_topic_backlog
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#rpc_zmq_topic_backlog = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Directory for holding IPC sockets. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_ipc_dir
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#rpc_zmq_ipc_dir = /var/run/openstack
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Name of this node. Must be a valid hostname, FQDN, or IP address. Must match
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# "host" option, if running Nova. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_host
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#rpc_zmq_host = localhost
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Number of seconds to wait before all pending messages will be sent after
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# closing a socket. The default value of -1 specifies an infinite linger
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# period. The value of 0 specifies no linger period. Pending messages shall be
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# discarded immediately when the socket is closed. Positive values specify an
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# upper bound for the linger period. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_cast_timeout
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#zmq_linger = -1
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The default number of seconds that poll should wait. Poll raises timeout
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# exception when timeout expired. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_poll_timeout
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#rpc_poll_timeout = 1
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Expiration timeout in seconds of a name service record about existing target
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# ( < 0 means no timeout). (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/zmq_target_expire
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#zmq_target_expire = 300
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Update period in seconds of a name service record about existing target.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/zmq_target_update
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#zmq_target_update = 180
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Use PUB/SUB pattern for fanout methods. PUB/SUB always uses proxy. (boolean
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/use_pub_sub
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#use_pub_sub = false
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Use ROUTER remote proxy. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/use_router_proxy
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#use_router_proxy = false
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# This option makes direct connections dynamic or static. It makes sense only
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# with use_router_proxy=False which means to use direct connections for direct
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# message types (ignored otherwise). (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#use_dynamic_connections = false
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# How many additional connections to a host will be made for failover reasons.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# This option is actual only in dynamic connections mode. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#zmq_failover_connections = 2
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Minimal port number for random ports range. (port value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Maximum value: 65535
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_min_port
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#rpc_zmq_min_port = 49153
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Maximal port number for random ports range. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Maximum value: 65536
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_max_port
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#rpc_zmq_max_port = 65536
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Number of retries to find free port number before fail with ZMQBindError.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_bind_port_retries
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#rpc_zmq_bind_port_retries = 100
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Default serialization mechanism for serializing/deserializing
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# outgoing/incoming messages (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Allowed values: json, msgpack
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_serialization
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#rpc_zmq_serialization = json
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# This option configures round-robin mode in zmq socket. True means not keeping
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# a queue when server side disconnects. False means to keep queue and messages
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# even if server is disconnected, when the server appears we send all
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# accumulated messages to it. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#zmq_immediate = true
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Enable/disable TCP keepalive (KA) mechanism. The default value of -1 (or any
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# other negative value) means to skip any overrides and leave it to OS default;
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# 0 and 1 (or any other positive value) mean to disable and enable the option
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# respectively. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#zmq_tcp_keepalive = -1
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The duration between two keepalive transmissions in idle condition. The unit
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# is platform dependent, for example, seconds in Linux, milliseconds in Windows
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# etc. The default value of -1 (or any other negative value and 0) means to
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# skip any overrides and leave it to OS default. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#zmq_tcp_keepalive_idle = -1
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The number of retransmissions to be carried out before declaring that remote
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# end is not available. The default value of -1 (or any other negative value
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# and 0) means to skip any overrides and leave it to OS default. (integer
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#zmq_tcp_keepalive_cnt = -1
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The duration between two successive keepalive retransmissions, if
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# acknowledgement to the previous keepalive transmission is not received. The
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# unit is platform dependent, for example, seconds in Linux, milliseconds in
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Windows etc. The default value of -1 (or any other negative value and 0)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# means to skip any overrides and leave it to OS default. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#zmq_tcp_keepalive_intvl = -1
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Maximum number of (green) threads to work concurrently. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#rpc_thread_pool_size = 100
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Expiration timeout in seconds of a sent/received message after which it is
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# not tracked anymore by a client/server. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#rpc_message_ttl = 300
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Wait for message acknowledgements from receivers. This mechanism works only
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# via proxy without PUB/SUB. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#rpc_use_acks = false
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Number of seconds to wait for an ack from a cast/call. After each retry
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# attempt this timeout is multiplied by some specified multiplier. (integer
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#rpc_ack_timeout_base = 15
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Number to multiply base ack timeout by after each retry attempt. (integer
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#rpc_ack_timeout_multiplier = 2
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Default number of message sending attempts in case of any problems occurred:
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# positive value N means at most N retries, 0 means no retries, None or -1 (or
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# any other negative values) mean to retry forever. This option is used only if
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# acknowledgments are enabled. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#rpc_retry_attempts = 3
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# List of publisher hosts SubConsumer can subscribe on. This option has higher
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# priority then the default publishers list taken from the matchmaker. (list
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#subscribe_on =
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]:  [oslo_middleware]
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #
Sep 28 11:13:03 ctl02 salt-minion[14967]: @@ -1651,15 +2299,19 @@
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # The maximum body size for each  request, in bytes. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/osapi_max_request_body_size
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/max_request_body_size
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#max_request_body_size = 114688
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# The HTTP Header that will be used to determine what the original request
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# protocol scheme was, even if it was hidden by an SSL termination proxy.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +max_request_body_size= 114688
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# DEPRECATED: The HTTP Header that will be used to determine what the original
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# request protocol scheme was, even if it was hidden by a SSL termination
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# proxy. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # This option is deprecated for removal.
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Its value may be silently ignored in the future.
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #secure_proxy_ssl_header = X-Forwarded-Proto
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Whether the application is behind a proxy or not. This determines if the
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# middleware should parse the headers or not. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#enable_proxy_headers_parsing = false
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  [oslo_policy]
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: @@ -1667,7 +2319,7 @@
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # From oslo.policy
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# The JSON file that defines policies. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The file that defines policies. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/policy_file
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #policy_file = policy.json
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: @@ -1690,8 +2342,10 @@
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # From keystone
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Name of the paste configuration file that defines the available pipelines.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Name of (or absolute path to) the Paste Deploy configuration file that
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# composes middleware and the keystone application itself into actual WSGI
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# entry points. See http://pythonpaste.org/deploy/ for additional documentation
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# on the file's format. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #config_file = keystone-paste.ini
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: @@ -1701,33 +2355,134 @@
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # From keystone
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Entrypoint for the policy backend driver in the keystone.policy namespace.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Supplied drivers are rules and sql. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Entry point for the policy backend driver in the `keystone.policy` namespace.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Supplied drivers are `rules` (which does not support any CRUD operations for
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# the v3 policy API) and `sql`. Typically, there is no reason to set this
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# option unless you are providing a custom entry point. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #driver = sql
Sep 28 11:13:03 ctl02 salt-minion[14967]: +driver = keystone.policy.backends.sql.Policy
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Maximum number of entities that will be returned in a policy collection.
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #list_limit = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: +[profiler]
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# From osprofiler
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Enables the profiling for all services on this node. Default value is False
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# (fully disable the profiling feature).
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# * True: Enables the feature
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# * False: Disables the feature. The profiling cannot be started via this
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# project
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# operations. If the profiling is triggered by another project, this project
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# part
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# will be empty.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Deprecated group/name - [profiler]/profiler_enabled
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#enabled = false
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Enables SQL requests profiling in services. Default value is False (SQL
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# requests won't be traced).
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# * True: Enables SQL requests profiling. Each SQL query will be part of the
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# trace and can the be analyzed by how much time was spent for that.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# * False: Disables SQL requests profiling. The spent time is only shown on a
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# higher level of operations. Single SQL queries cannot be analyzed this
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# way.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#trace_sqlalchemy = false
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Secret key(s) to use for encrypting context data for performance profiling.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# This string value should have the following format:
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# <key1>[,<key2>,...<keyn>],
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# where each key is some random string. A user who triggers the profiling via
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# the REST API has to set one of these keys in the headers of the REST API call
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# to include profiling results of this node for this particular project.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Both "enabled" flag and "hmac_keys" config options should be set to enable
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# profiling. Also, to generate correct profiling information across all
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# services
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# at least one key needs to be consistent between OpenStack projects. This
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# ensures it can be used from client side to generate the trace, containing
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# information from all possible resources. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#hmac_keys = SECRET_KEY
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Connection string for a notifier backend. Default value is messaging:// which
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# sets the notifier to oslo_messaging.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Examples of possible values:
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# * messaging://: use oslo_messaging driver for sending notifications.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# * mongodb://127.0.0.1:27017 : use mongodb driver for sending notifications.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# * elasticsearch://127.0.0.1:9200 : use elasticsearch driver for sending
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# notifications.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#connection_string = messaging://
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Document type for notification indexing in elasticsearch.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#es_doc_type = notification
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# This parameter is a time value parameter (for example: es_scroll_time=2m),
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# indicating for how long the nodes that participate in the search will
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# maintain
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# relevant resources in order to continue and support it.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#es_scroll_time = 2m
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Elasticsearch splits large requests in batches. This parameter defines
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# maximum size of each batch (for example: es_scroll_size=10000).
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#es_scroll_size = 10000
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Redissentinel provides a timeout option on the connections.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# This parameter defines that timeout (for example: socket_timeout=0.1).
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#  (floating point value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#socket_timeout = 0.1
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Redissentinel uses a service name to identify a master redis service.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# This parameter defines the name (for example:
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# sentinal_service_name=mymaster).
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#sentinel_service_name = mymaster
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]:  [resource]
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # From keystone
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Entrypoint for the resource backend driver in the keystone.resource
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# namespace. Only an SQL driver is supplied. If a resource driver is not
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# specified, the assignment driver will choose the resource driver. (string
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#driver = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Entry point for the resource driver in the `keystone.resource` namespace.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Only a `sql` driver is supplied by keystone. Unless you are writing
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# proprietary drivers for keystone, you do not need to set this option. (string
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#driver = sql
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Toggle for resource caching. This has no effect unless global caching is
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # enabled. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Deprecated group/name - [assignment]/caching
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #caching = true
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# TTL (in seconds) to cache resource data. This has no effect unless global
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Time to cache resource data in seconds. This has no effect unless global
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # caching is enabled. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Deprecated group/name - [assignment]/cache_time
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #cache_time = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]: @@ -1737,28 +2492,34 @@
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Deprecated group/name - [assignment]/list_limit
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #list_limit = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Name of the domain that owns the `admin_project_name`. Defaults to None.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Name of the domain that owns the `admin_project_name`. If left unset, then
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# there is no admin project. `[resource] admin_project_name` must also be set
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# to use this option. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #admin_project_domain_name = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Special project for performing administrative operations on remote services.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Tokens scoped to this project will contain the key/value
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# `is_admin_project=true`. Defaults to None. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# This is a special project which represents cloud-level administrator
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# privileges across services. Tokens scoped to this project will contain a true
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# `is_admin_project` attribute to indicate to policy systems that the role
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# assignments on that specific project should apply equally across every
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# project. If left unset, then there is no admin project, and thus no explicit
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# means of cross-project role assignments. `[resource]
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# admin_project_domain_name` must also be set to use this option. (string
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #admin_project_name = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Whether the names of projects are restricted from containing url reserved
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# characters. If set to new, attempts to create or update a project with a url
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# unsafe name will return an error. In addition, if set to strict, attempts to
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# scope a token using an unsafe project name will return an error. (string
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# This controls whether the names of projects are restricted from containing
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# URL-reserved characters. If set to `new`, attempts to create or update a
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# project with a URL-unsafe name will fail. If set to `strict`, attempts to
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# scope a token with a URL-unsafe project name will fail, thereby forcing all
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# project names to be updated to be URL-safe. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Allowed values: off, new, strict
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #project_name_url_safe = off
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Whether the names of domains are restricted from containing url reserved
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# characters. If set to new, attempts to create or update a domain with a url
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# unsafe name will return an error. In addition, if set to strict, attempts to
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# scope a token using a domain name which is unsafe will return an error.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# This controls whether the names of domains are restricted from containing
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# URL-reserved characters. If set to `new`, attempts to create or update a
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# domain with a URL-unsafe name will fail. If set to `strict`, attempts to
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# scope a token with a URL-unsafe domain name will fail, thereby forcing all
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# domain names to be updated to be URL-safe. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Allowed values: off, new, strict
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #domain_name_url_safe = off
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: @@ -1769,13 +2530,14 @@
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # From keystone
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Entrypoint for an implementation of the backend for persisting revocation
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# events in the keystone.revoke namespace. Supplied drivers are kvs and sql.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Entry point for the token revocation backend driver in the `keystone.revoke`
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# namespace. Keystone only provides a `sql` driver, so there is no reason to
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# set this option unless you are providing a custom entry point. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #driver = sql
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# This value (calculated in seconds) is added to token expiration before a
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# revocation event may be removed from the backend. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The number of seconds after a token has expired before a corresponding
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# revocation event may be purged from the backend. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #expiration_buffer = 1800
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Toggle for revocation event caching. This has no effect unless global caching
Sep 28 11:13:03 ctl02 salt-minion[14967]: @@ -1783,8 +2545,8 @@
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #caching = true
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Time to cache the revocation list and the revocation events (in seconds).
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# This has no effect unless global and token caching are enabled. (integer
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# This has no effect unless global and `[revoke] caching` are both enabled.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Deprecated group/name - [token]/revocation_cache_time
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #cache_time = 3600
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: @@ -1795,302 +2557,441 @@
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # From keystone
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Entrypoint for the role backend driver in the keystone.role namespace.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Supplied drivers are ldap and sql. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Entry point for the role backend driver in the `keystone.role` namespace.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Keystone only provides a `sql` driver, so there's no reason to change this
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# unless you are providing a custom entry point. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #driver = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # Toggle for role caching. This has no effect unless global caching is enabled.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# In a typical deployment, there is no reason to disable this. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #caching = true
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# TTL (in seconds) to cache role data. This has no effect unless global caching
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# is enabled. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Time to cache role data, in seconds. This has no effect unless both global
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# caching and `[role] caching` are enabled. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #cache_time = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Maximum number of entities that will be returned in a role collection.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Maximum number of entities that will be returned in a role collection. This
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# may be useful to tune if you have a large number of discrete roles in your
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# deployment. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#list_limit = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +[saml]
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# From keystone
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Determines the lifetime for any SAML assertions generated by keystone, using
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# `NotOnOrAfter` attributes. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#assertion_expiration_time = 3600
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Name of, or absolute path to, the binary to be used for XML signing. Although
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# only the XML Security Library (`xmlsec1`) is supported, it may have a non-
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# standard name or path on your system. If keystone cannot find the binary
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# itself, you may need to install the appropriate package, use this option to
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# specify an absolute path, or adjust keystone's PATH environment variable.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#xmlsec1_binary = xmlsec1
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Absolute path to the public certificate file to use for SAML signing. The
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# value cannot contain a comma (`,`). (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#certfile = /etc/keystone/ssl/certs/signing_cert.pem
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Absolute path to the private key file to use for SAML signing. The value
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# cannot contain a comma (`,`). (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#keyfile = /etc/keystone/ssl/private/signing_key.pem
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# This is the unique entity identifier of the identity provider (keystone) to
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# use when generating SAML assertions. This value is required to generate
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# identity provider metadata and must be a URI (a URL is recommended). For
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# example: `https://keystone.example.com/v3/OS-FEDERATION/saml2/idp`. (uri
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#idp_entity_id = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# This is the single sign-on (SSO) service location of the identity provider
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# which accepts HTTP POST requests. A value is required to generate identity
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# provider metadata. For example: `https://keystone.example.com/v3/OS-
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# FEDERATION/saml2/sso`. (uri value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#idp_sso_endpoint = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# This is the language used by the identity provider's organization. (string
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#idp_lang = en
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# This is the name of the identity provider's organization. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#idp_organization_name = SAML Identity Provider
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# This is the name of the identity provider's organization to be displayed.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#idp_organization_display_name = OpenStack SAML Identity Provider
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# This is the URL of the identity provider's organization. The URL referenced
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# here should be useful to humans. (uri value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#idp_organization_url = https://example.com/
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# This is the company name of the identity provider's contact person. (string
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#idp_contact_company = Example, Inc.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# This is the given name of the identity provider's contact person. (string
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#idp_contact_name = SAML Identity Provider Support
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# This is the surname of the identity provider's contact person. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#idp_contact_surname = Support
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# This is the email address of the identity provider's contact person. (string
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#idp_contact_email = support@example.com
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# This is the telephone number of the identity provider's contact person.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#idp_contact_telephone = +1 800 555 0100
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# This is the type of contact that best describes the identity provider's
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# contact person. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Allowed values: technical, support, administrative, billing, other
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#idp_contact_type = other
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Absolute path to the identity provider metadata file. This file should be
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# generated with the `keystone-manage saml_idp_metadata` command. There is
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# typically no reason to change this value. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The prefix of the RelayState SAML attribute to use when generating enhanced
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# client and proxy (ECP) assertions. In a typical deployment, there is no
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# reason to change this value. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#relay_state_prefix = ss:mem:
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +[security_compliance]
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# From keystone
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The maximum number of days a user can go without authenticating before being
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# considered "inactive" and automatically disabled (locked). This feature is
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# disabled by default; set any value to enable it. This feature depends on the
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# `sql` backend for the `[identity] driver`. When a user exceeds this threshold
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# and is considered "inactive", the user's `enabled` attribute in the HTTP API
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# may not match the value of the user's `enabled` column in the user table.
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#list_limit = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -[saml]
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#disable_user_account_days_inactive = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The maximum number of times that a user can fail to authenticate before the
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# user account is locked for the number of seconds specified by
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# `[security_compliance] lockout_duration`. This feature is disabled by
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# default. If this feature is enabled and `[security_compliance]
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# lockout_duration` is not set, then users may be locked out indefinitely until
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# the user is explicitly enabled via the API. This feature depends on the `sql`
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# backend for the `[identity] driver`. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#lockout_failure_attempts = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The number of seconds a user account will be locked when the maximum number
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# of failed authentication attempts (as specified by `[security_compliance]
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# lockout_failure_attempts`) is exceeded. Setting this option will have no
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# effect unless you also set `[security_compliance] lockout_failure_attempts`
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# to a non-zero value. This feature depends on the `sql` backend for the
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# `[identity] driver`. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#lockout_duration = 1800
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The number of days for which a password will be considered valid before
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# requiring it to be changed. This feature is disabled by default. If enabled,
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# new password changes will have an expiration date, however existing passwords
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# would not be impacted. This feature depends on the `sql` backend for the
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# `[identity] driver`. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#password_expires_days = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# DEPRECATED: Comma separated list of user IDs to be ignored when checking if a
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# password is expired. Passwords for users in this list will not expire. This
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# feature will only be enabled if `[security_compliance] password_expires_days`
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# is set. (list value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# This option is deprecated for removal since O.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Reason: Functionality added as a per-user option "ignore_password_expiry" in
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Ocata. Each user that should ignore password expiry should have the value set
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# to "true" in the user's `options` attribute (e.g.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# `user['options']['ignore_password_expiry'] = True`) with an "update_user"
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# call. This avoids the need to restart keystone to adjust the users that
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# ignore password expiry. This option will be removed in the Pike release.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#password_expires_ignore_user_ids =
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# This controls the number of previous user password iterations to keep in
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# history, in order to enforce that newly created passwords are unique. Setting
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# the value to one (the default) disables this feature. Thus, to enable this
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# feature, values must be greater than 1. This feature depends on the `sql`
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# backend for the `[identity] driver`. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#unique_last_password_count = 1
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The number of days that a password must be used before the user can change
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# it. This prevents users from changing their passwords immediately in order to
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# wipe out their password history and reuse an old password. This feature does
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# not prevent administrators from manually resetting passwords. It is disabled
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# by default and allows for immediate password changes. This feature depends on
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# the `sql` backend for the `[identity] driver`. Note: If
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# `[security_compliance] password_expires_days` is set, then the value for this
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# option should be less than the `password_expires_days`. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#minimum_password_age = 0
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The regular expression used to validate password strength requirements. By
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# default, the regular expression will match any password. The following is an
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# example of a pattern which requires at least 1 letter, 1 digit, and have a
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# minimum length of 7 characters: ^(?=.*\d)(?=.*[a-zA-Z]).{7,}$ This feature
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# depends on the `sql` backend for the `[identity] driver`. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#password_regex = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Describe your password regular expression here in language for humans. If a
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# password fails to match the regular expression, the contents of this
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# configuration variable will be returned to users to explain why their
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# requested password was insufficient. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#password_regex_description = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Enabling this option requires users to change their password when the user is
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# created, or upon administrative reset. Before accessing any services,
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# affected users will have to change their password. To ignore this requirement
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# for specific users, such as service users, set the `options` attribute
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# `ignore_change_password_upon_first_use` to `True` for the desired user via
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# the update user API. This feature is disabled by default. This feature is
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# only applicable with the `sql` backend for the `[identity] driver`. (boolean
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#change_password_upon_first_use = false
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +[shadow_users]
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # From keystone
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Default TTL, in seconds, for any generated SAML assertion created by
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Keystone. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#assertion_expiration_time = 3600
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Binary to be called for XML signing. Install the appropriate package, specify
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# absolute path or adjust your PATH environment variable if the binary cannot
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# be found. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#xmlsec1_binary = xmlsec1
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Path of the certfile for SAML signing. For non-production environments, you
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# may be interested in using `keystone-manage pki_setup` to generate self-
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# signed certificates. Note, the path cannot contain a comma. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Entry point for the shadow users backend driver in the
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# `keystone.identity.shadow_users` namespace. This driver is used for
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# persisting local user references to externally-managed identities (via
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# federation, LDAP, etc). Keystone only provides a `sql` driver, so there is no
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# reason to change this option unless you are providing a custom entry point.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#driver = sql
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +[signing]
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# From keystone
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Absolute path to the public certificate file to use for signing responses to
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# revocation lists requests. Set this together with `[signing] keyfile`. For
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# non-production environments, you may be interested in using `keystone-manage
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# pki_setup` to generate self-signed certificates. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #certfile = /etc/keystone/ssl/certs/signing_cert.pem
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Path of the keyfile for SAML signing. Note, the path cannot contain a comma.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Absolute path to the private key file to use for signing responses to
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# revocation lists requests. Set this together with `[signing] certfile`.
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #keyfile = /etc/keystone/ssl/private/signing_key.pem
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Entity ID value for unique Identity Provider identification. Usually FQDN is
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# set with a suffix. A value is required to generate IDP Metadata. For example:
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# https://keystone.example.com/v3/OS-FEDERATION/saml2/idp (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#idp_entity_id = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Identity Provider Single-Sign-On service value, required in the Identity
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Provider's metadata. A value is required to generate IDP Metadata. For
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# example: https://keystone.example.com/v3/OS-FEDERATION/saml2/sso (string
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#idp_sso_endpoint = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Language used by the organization. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#idp_lang = en
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Organization name the installation belongs to. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#idp_organization_name = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Organization name to be displayed. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#idp_organization_display_name = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# URL of the organization. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#idp_organization_url = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Company of contact person. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#idp_contact_company = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Given name of contact person (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#idp_contact_name = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Surname of contact person. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#idp_contact_surname = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Email address of contact person. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#idp_contact_email = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Telephone number of contact person. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#idp_contact_telephone = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# The contact type describing the main point of contact for the identity
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# provider. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Allowed values: technical, support, administrative, billing, other
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#idp_contact_type = other
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Path to the Identity Provider Metadata file. This file should be generated
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# with the keystone-manage saml_idp_metadata command. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# The prefix to use for the RelayState SAML attribute, used when generating ECP
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# wrapped assertions. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#relay_state_prefix = ss:mem:
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -[shadow_users]
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Absolute path to the public certificate authority (CA) file to use when
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# creating self-signed certificates with `keystone-manage pki_setup`. Set this
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# together with `[signing] ca_key`. There is no reason to set this option
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# unless you are requesting revocation lists in a non-production environment.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Use a `[signing] certfile` issued from a trusted certificate authority
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# instead. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#ca_certs = /etc/keystone/ssl/certs/ca.pem
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Absolute path to the private certificate authority (CA) key file to use when
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# creating self-signed certificates with `keystone-manage pki_setup`. Set this
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# together with `[signing] ca_certs`. There is no reason to set this option
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# unless you are requesting revocation lists in a non-production environment.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Use a `[signing] certfile` issued from a trusted certificate authority
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# instead. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#ca_key = /etc/keystone/ssl/private/cakey.pem
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Key size (in bits) to use when generating a self-signed token signing
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# certificate. There is no reason to set this option unless you are requesting
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# revocation lists in a non-production environment. Use a `[signing] certfile`
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# issued from a trusted certificate authority instead. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Minimum value: 1024
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#key_size = 2048
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The validity period (in days) to use when generating a self-signed token
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# signing certificate. There is no reason to set this option unless you are
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# requesting revocation lists in a non-production environment. Use a `[signing]
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# certfile` issued from a trusted certificate authority instead. (integer
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#valid_days = 3650
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The certificate subject to use when generating a self-signed token signing
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# certificate. There is no reason to set this option unless you are requesting
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# revocation lists in a non-production environment. Use a `[signing] certfile`
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# issued from a trusted certificate authority instead. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#cert_subject = /C=US/ST=Unset/L=Unset/O=Unset/CN=www.example.com
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +[token]
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # From keystone
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Entrypoint for the shadow users backend driver in the
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# keystone.identity.shadow_users namespace. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# This is a list of external authentication mechanisms which should add token
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# binding metadata to tokens, such as `kerberos` or `x509`. Binding metadata is
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# enforced according to the `[token] enforce_token_bind` option. (list value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#bind =
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# This controls the token binding enforcement policy on tokens presented to
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# keystone with token binding metadata (as specified by the `[token] bind`
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# option). `disabled` completely bypasses token binding validation.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# `permissive` and `strict` do not require tokens to have binding metadata (but
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# will validate it if present), whereas `required` will always demand tokens to
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# having binding metadata. `permissive` will allow unsupported binding metadata
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# to pass through without validation (usually to be validated at another time
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# by another component), whereas `strict` and `required` will demand that the
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# included binding metadata be supported by keystone. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Allowed values: disabled, permissive, strict, required
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#enforce_token_bind = permissive
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The amount of time that a token should remain valid (in seconds). Drastically
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# reducing this value may break "long-running" operations that involve multiple
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# services to coordinate together, and will force users to authenticate with
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# keystone more frequently. Drastically increasing this value will increase
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# load on the `[token] driver`, as more tokens will be simultaneously valid.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Keystone tokens are also bearer tokens, so a shorter duration will also
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# reduce the potential security impact of a compromised token. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Maximum value: 9223372036854775807
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#expiration = 3600
Sep 28 11:13:03 ctl02 salt-minion[14967]: +expiration = 3600
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Entry point for the token provider in the `keystone.token.provider`
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# namespace. The token provider controls the token construction, validation,
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# and revocation operations. Keystone includes `fernet` and `uuid` token
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# providers. `uuid` tokens must be persisted (using the backend specified in
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# the `[token] driver` option), but do not require any extra configuration or
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# setup. `fernet` tokens do not need to be persisted at all, but require that
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# you run `keystone-manage fernet_setup` (also see the `keystone-manage
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# fernet_rotate` command). (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#provider = fernet
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +provider = keystone.token.providers.fernet.Provider
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Entry point for the token persistence backend driver in the
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# `keystone.token.persistence` namespace. Keystone provides `kvs` and `sql`
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# drivers. The `kvs` backend depends on the configuration in the `[kvs]`
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# section. The `sql` option (default) depends on the options in your
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# `[database]` section. If you're using the `fernet` `[token] provider`, this
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# backend will not be utilized to persist tokens at all. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #driver = sql
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -[signing]
Sep 28 11:13:03 ctl02 salt-minion[14967]: +driver = keystone.token.persistence.backends.memcache_pool.Token
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Toggle for caching token creation and validation data. This has no effect
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# unless global caching is enabled. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#caching = true
Sep 28 11:13:03 ctl02 salt-minion[14967]: +caching = false
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The number of seconds to cache token creation and validation data. This has
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# no effect unless both global and `[token] caching` are enabled. (integer
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Maximum value: 9223372036854775807
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#cache_time = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# This toggles support for revoking individual tokens by the token identifier
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# and thus various token enumeration operations (such as listing all tokens
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# issued to a specific user). These operations are used to determine the list
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# of tokens to consider revoked. Do not disable this option if you're using the
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# `kvs` `[revoke] driver`. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#revoke_by_id = true
Sep 28 11:13:03 ctl02 salt-minion[14967]: +revoke_by_id = False
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# This toggles whether scoped tokens may be be re-scoped to a new project or
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# domain, thereby preventing users from exchanging a scoped token (including
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# those with a default project scope) for any other token. This forces users to
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# either authenticate for unscoped tokens (and later exchange that unscoped
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# token for tokens with a more specific scope) or to provide their credentials
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# in every request for a scoped token to avoid re-scoping altogether. (boolean
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#allow_rescope_scoped_token = true
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# This controls whether roles should be included with tokens that are not
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# directly assigned to the token's scope, but are instead linked implicitly to
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# other role assignments. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#infer_roles = true
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Enable storing issued token data to token validation cache so that first
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# token validation doesn't actually cause full validation cycle. This option
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# has no effect unless global caching and token caching are enabled. (boolean
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#cache_on_issue = true
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# This controls the number of seconds that a token can be retrieved for beyond
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# the built-in expiry time. This allows long running operations to succeed.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Defaults to two days. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#allow_expired_window = 172800
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +hash_algorithm = sha256
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +[tokenless_auth]
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # From keystone
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Path of the certfile for token signing. For non-production environments, you
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# may be interested in using `keystone-manage pki_setup` to generate self-
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# signed certificates. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# This option is deprecated for removal.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Its value may be silently ignored in the future.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Reason: PKI token support has been deprecated in the M release and will be
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# removed in the O release. Fernet or UUID tokens are recommended.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#certfile = /etc/keystone/ssl/certs/signing_cert.pem
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Path of the keyfile for token signing. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# This option is deprecated for removal.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Its value may be silently ignored in the future.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Reason: PKI token support has been deprecated in the M release and will be
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# removed in the O release. Fernet or UUID tokens are recommended.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#keyfile = /etc/keystone/ssl/private/signing_key.pem
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Path of the CA for token signing. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# This option is deprecated for removal.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Its value may be silently ignored in the future.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Reason: PKI token support has been deprecated in the M release and will be
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# removed in the O release. Fernet or UUID tokens are recommended.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#ca_certs = /etc/keystone/ssl/certs/ca.pem
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Path of the CA key for token signing. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# This option is deprecated for removal.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Its value may be silently ignored in the future.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Reason: PKI token support has been deprecated in the M release and will be
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# removed in the O release. Fernet or UUID tokens are recommended.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#ca_key = /etc/keystone/ssl/private/cakey.pem
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Key size (in bits) for token signing cert (auto generated certificate).
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Minimum value: 1024
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# This option is deprecated for removal.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Its value may be silently ignored in the future.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Reason: PKI token support has been deprecated in the M release and will be
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# removed in the O release. Fernet or UUID tokens are recommended.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#key_size = 2048
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Days the token signing cert is valid for (auto generated certificate).
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# This option is deprecated for removal.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Its value may be silently ignored in the future.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Reason: PKI token support has been deprecated in the M release and will be
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# removed in the O release. Fernet or UUID tokens are recommended.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#valid_days = 3650
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Certificate subject (auto generated certificate) for token signing. (string
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# This option is deprecated for removal.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Its value may be silently ignored in the future.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Reason: PKI token support has been deprecated in the M release and will be
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# removed in the O release. Fernet or UUID tokens are recommended.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#cert_subject = /C=US/ST=Unset/L=Unset/O=Unset/CN=www.example.com
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -[ssl]
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The list of distinguished names which identify trusted issuers of client
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# certificates allowed to use X.509 tokenless authorization. If the option is
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# absent then no certificates will be allowed. The format for the values of a
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# distinguished name (DN) must be separated by a comma and contain no spaces.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Furthermore, because an individual DN may contain commas, this configuration
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# option may be repeated multiple times to represent multiple values. For
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# example, keystone.conf would include two consecutive lines in order to trust
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# two different DNs, such as `trusted_issuer = CN=john,OU=keystone,O=openstack`
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# and `trusted_issuer = CN=mary,OU=eng,O=abc`. (multi valued)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#trusted_issuer =
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The federated protocol ID used to represent X.509 tokenless authorization.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# This is used in combination with the value of `[tokenless_auth]
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# issuer_attribute` to find a corresponding federated mapping. In a typical
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# deployment, there is no reason to change this value. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#protocol = x509
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# The name of the WSGI environment variable used to pass the issuer of the
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# client certificate to keystone. This attribute is used as an identity
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# provider ID for the X.509 tokenless authorization along with the protocol to
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# look up its corresponding mapping. In a typical deployment, there is no
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# reason to change this value. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#issuer_attribute = SSL_CLIENT_I_DN
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +[trust]
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #
Sep 28 11:13:03 ctl02 salt-minion[14967]:  # From keystone
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #
Sep 28 11:13:03 ctl02 salt-minion[14967]:  
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Path of the CA key file for SSL. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#ca_key = /etc/keystone/ssl/private/cakey.pem
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# SSL key length (in bits) (auto generated certificate). (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Minimum value: 1024
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#key_size = 1024
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Days the certificate is valid for once signed (auto generated certificate).
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#valid_days = 3650
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# SSL certificate subject (auto generated certificate). (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#cert_subject = /C=US/ST=Unset/L=Unset/O=Unset/CN=localhost
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -[token]
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# From keystone
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# External auth mechanisms that should add bind information to token, e.g.,
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# kerberos,x509. (list value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#bind =
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Enforcement policy on tokens presented to Keystone with bind information. One
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# of disabled, permissive, strict, required or a specifically required bind
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# mode, e.g., kerberos or x509 to require binding to that authentication.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#enforce_token_bind = permissive
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Amount of time a token should remain valid (in seconds). (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#expiration = 3600
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Controls the token construction, validation, and revocation operations.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Entrypoint in the keystone.token.provider namespace. Core providers are
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# [fernet|pkiz|pki|uuid]. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#provider = uuid
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Entrypoint for the token persistence backend driver in the
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# keystone.token.persistence namespace. Supplied drivers are kvs, memcache,
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# memcache_pool, and sql. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Delegation and impersonation features using trusts can be optionally
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# disabled. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#enabled = true
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Allows authorization to be redelegated from one user to another, effectively
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# chaining trusts together. When disabled, the `remaining_uses` attribute of a
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# trust is constrained to be zero. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#allow_redelegation = false
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Maximum number of times that authorization can be redelegated from one user
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# to another in a chain of trusts. This number may be reduced further for a
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# specific trust. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: +#max_redelegation_count = 3
Sep 28 11:13:03 ctl02 salt-minion[14967]: +
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Entry point for the trust backend driver in the `keystone.trust` namespace.
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# Keystone only provides a `sql` driver, so there is no reason to change this
Sep 28 11:13:03 ctl02 salt-minion[14967]: +# unless you are providing a custom entry point. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]:  #driver = sql
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Toggle for token system caching. This has no effect unless global caching is
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# enabled. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#caching = true
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Time to cache tokens (in seconds). This has no effect unless global and token
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# caching are enabled. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#cache_time = <None>
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Revoke token by token identifier. Setting revoke_by_id to true enables
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# various forms of enumerating tokens, e.g. `list tokens for user`. These
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# enumerations are processed to determine the list of tokens to revoke. Only
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# disable if you are switching to using the Revoke extension with a backend
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# other than KVS, which stores events in memory. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#revoke_by_id = true
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Allow rescoping of scoped token. Setting allow_rescoped_scoped_token to false
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# prevents a user from exchanging a scoped token for any other token. (boolean
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#allow_rescope_scoped_token = true
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# The hash algorithm to use for PKI tokens. This can be set to any algorithm
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# that hashlib supports. WARNING: Before changing this value, the auth_token
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# middleware must be configured with the hash_algorithms, otherwise token
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# revocation will not be processed correctly. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# This option is deprecated for removal.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Its value may be silently ignored in the future.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Reason: PKI token support has been deprecated in the M release and will be
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# removed in the O release. Fernet or UUID tokens are recommended.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#hash_algorithm = md5
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Add roles to token that are not explicitly added, but that are linked
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# implicitly to other roles. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#infer_roles = true
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -[tokenless_auth]
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# From keystone
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# The list of trusted issuers to further filter the certificates that are
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# allowed to participate in the X.509 tokenless authorization. If the option is
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# absent then no certificates will be allowed. The naming format for the
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# attributes of a Distinguished Name(DN) must be separated by a comma and
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# contain no spaces. This configuration option may be repeated for multiple
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# values. For example: trusted_issuer=CN=john,OU=keystone,O=openstack
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# trusted_issuer=CN=mary,OU=eng,O=abc (multi valued)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#trusted_issuer =
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# The protocol name for the X.509 tokenless authorization along with the option
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# issuer_attribute below can look up its corresponding mapping. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#protocol = x509
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# The issuer attribute that is served as an IdP ID for the X.509 tokenless
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# authorization along with the protocol to look up its corresponding mapping.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# It is the environment variable in the WSGI environment that references to the
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# issuer of the client certificate. (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#issuer_attribute = SSL_CLIENT_I_DN
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -[trust]
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# From keystone
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Delegation and impersonation features can be optionally disabled. (boolean
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#enabled = true
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Enable redelegation feature. (boolean value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#allow_redelegation = false
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Maximum depth of trust redelegation. (integer value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#max_redelegation_count = 3
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# Entrypoint for the trust backend driver in the keystone.trust namespace.
Sep 28 11:13:03 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:13:03 ctl02 salt-minion[14967]: -#driver = sql
Sep 28 11:13:03 ctl02 salt-minion[14967]: -
Sep 28 11:13:03 ctl02 salt-minion[14967]:  [extra_headers]
Sep 28 11:13:03 ctl02 salt-minion[14967]:  Distribution = Ubuntu
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Completed state [/etc/keystone/keystone.conf] at time 11:13:03.267031 duration_in_ms=167.27
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Running state [/etc/apache2/sites-enabled/keystone.conf] at time 11:13:03.267212
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Executing state file.absent for /etc/apache2/sites-enabled/keystone.conf
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] File /etc/apache2/sites-enabled/keystone.conf is not present
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Completed state [/etc/apache2/sites-enabled/keystone.conf] at time 11:13:03.267746 duration_in_ms=0.534
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Running state [/etc/apache2/sites-enabled/wsgi-keystone.conf] at time 11:13:03.267890
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Executing state file.absent for /etc/apache2/sites-enabled/wsgi-keystone.conf
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] File /etc/apache2/sites-enabled/wsgi-keystone.conf is not present
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Completed state [/etc/apache2/sites-enabled/wsgi-keystone.conf] at time 11:13:03.268358 duration_in_ms=0.467
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Running state [/etc/apache2/sites-available/keystone_wsgi.conf] at time 11:13:03.268706
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Executing state file.managed for /etc/apache2/sites-available/keystone_wsgi.conf
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'keystone/files/apache.conf'
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'keystone/map.jinja'
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'keystone/files/ocata/wsgi-keystone.conf'
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'apache/files/_name.conf'
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'apache/map.jinja'
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'apache/files/_ssl.conf'
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'apache/files/_locations.conf'
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'apache/files/_log.conf'
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] File changed:
Sep 28 11:13:03 ctl02 salt-minion[14967]: New file
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Completed state [/etc/apache2/sites-available/keystone_wsgi.conf] at time 11:13:03.460112 duration_in_ms=191.406
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Running state [/etc/keystone/logging.conf] at time 11:13:03.460480
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Executing state file.managed for /etc/keystone/logging.conf
Sep 28 11:13:03 ctl02 salt-minion[14967]: [WARNING ] State for file: /etc/keystone/logging.conf - Neither 'source' nor 'contents' nor 'contents_pillar' nor 'contents_grains' was defined, yet 'replace' was set to 'True'. As there is no source to replace the file with, 'replace' has been set to 'False' to avoid reading the file unnecessarily.
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] {'group': 'keystone', 'user': 'keystone'}
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Completed state [/etc/keystone/logging.conf] at time 11:13:03.461452 duration_in_ms=0.972
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Running state [/etc/apache2/sites-enabled/keystone_wsgi.conf] at time 11:13:03.461750
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Executing state file.symlink for /etc/apache2/sites-enabled/keystone_wsgi.conf
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] {'new': '/etc/apache2/sites-enabled/keystone_wsgi.conf'}
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Completed state [/etc/apache2/sites-enabled/keystone_wsgi.conf] at time 11:13:03.462890 duration_in_ms=1.14
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Running state [apache2] at time 11:13:03.465555
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Executing state service.running for apache2
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'status', 'apache2.service', '-n', '0'] in directory '/root'
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-active', 'apache2.service'] in directory '/root'
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-enabled', 'apache2.service'] in directory '/root'
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] The service apache2 is already running
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Completed state [apache2] at time 11:13:03.505572 duration_in_ms=40.014
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Running state [apache2] at time 11:13:03.505757
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Executing state service.mod_watch for apache2
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-active', 'apache2.service'] in directory '/root'
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-enabled', 'apache2.service'] in directory '/root'
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemd-run', '--scope', 'systemctl', 'reload', 'apache2.service'] in directory '/root'
Sep 28 11:13:03 ctl02 systemd[1]: Started /bin/systemctl reload apache2.service.
Sep 28 11:13:03 ctl02 systemd[1]: Reloading LSB: Apache2 web server.
Sep 28 11:13:03 ctl02 apache2[26804]:  * Reloading Apache httpd web server apache2
Sep 28 11:13:03 ctl02 apache2[26804]:  *
Sep 28 11:13:03 ctl02 systemd[1]: Reloaded LSB: Apache2 web server.
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] {'apache2': True}
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Completed state [apache2] at time 11:13:03.644510 duration_in_ms=138.75
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Running state [/etc/apache2/conf-enabled/security.conf] at time 11:13:03.645646
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Executing state file.symlink for /etc/apache2/conf-enabled/security.conf
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] {'new': '/etc/apache2/conf-enabled/security.conf'}
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Completed state [/etc/apache2/conf-enabled/security.conf] at time 11:13:03.650442 duration_in_ms=4.796
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Running state [/etc/apache2/sites-enabled/keystone_wsgi] at time 11:13:03.650848
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Executing state file.absent for /etc/apache2/sites-enabled/keystone_wsgi
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] File /etc/apache2/sites-enabled/keystone_wsgi is not present
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Completed state [/etc/apache2/sites-enabled/keystone_wsgi] at time 11:13:03.651992 duration_in_ms=1.144
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Running state [keystone] at time 11:13:03.652764
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Executing state service.dead for keystone
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'status', 'keystone.service', '-n', '0'] in directory '/root'
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-active', 'keystone.service'] in directory '/root'
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-enabled', 'keystone.service'] in directory '/root'
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-enabled', 'keystone.service'] in directory '/root'
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemd-run', '--scope', 'systemctl', 'disable', 'keystone.service'] in directory '/root'
Sep 28 11:13:03 ctl02 systemd[1]: Started /bin/systemctl disable keystone.service.
Sep 28 11:13:03 ctl02 systemd[1]: Reloading.
Sep 28 11:13:03 ctl02 systemd[1]: message repeated 2 times: [ Reloading.]
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-enabled', 'keystone.service'] in directory '/root'
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] {'keystone': True}
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Completed state [keystone] at time 11:13:03.894166 duration_in_ms=241.402
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Running state [/root/keystonerc] at time 11:13:03.894757
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Executing state file.managed for /root/keystonerc
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'keystone/files/keystonerc'
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'keystone/map.jinja'
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] File changed:
Sep 28 11:13:03 ctl02 salt-minion[14967]: New file
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Completed state [/root/keystonerc] at time 11:13:03.954650 duration_in_ms=59.892
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Running state [/root/keystonercv3] at time 11:13:03.955051
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Executing state file.managed for /root/keystonercv3
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'keystone/files/keystonercv3'
Sep 28 11:13:03 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'keystone/map.jinja'
Sep 28 11:13:04 ctl02 salt-minion[14967]: [INFO    ] File changed:
Sep 28 11:13:04 ctl02 salt-minion[14967]: New file
Sep 28 11:13:04 ctl02 salt-minion[14967]: [INFO    ] Completed state [/root/keystonercv3] at time 11:13:04.000854 duration_in_ms=45.802
Sep 28 11:13:04 ctl02 salt-minion[14967]: [INFO    ] Running state [keystone-manage db_sync && sleep 1] at time 11:13:04.001642
Sep 28 11:13:04 ctl02 salt-minion[14967]: [INFO    ] Executing state cmd.run for keystone-manage db_sync && sleep 1
Sep 28 11:13:04 ctl02 salt-minion[14967]: [INFO    ] Executing command 'keystone-manage db_sync && sleep 1' in directory '/root'
Sep 28 11:13:04 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:13:04 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:13:04 ctl02 salt-minion[14967]: [ERROR   ] Command 'keystone-manage db_sync && sleep 1' failed with return code: 1
Sep 28 11:13:04 ctl02 salt-minion[14967]: [ERROR   ] stderr: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:13:04 ctl02 salt-minion[14967]: 2017-09-28 11:13:04.509 26966 CRITICAL keystone [-] KeyError: <VerNum(109)>
Sep 28 11:13:04 ctl02 salt-minion[14967]: 2017-09-28 11:13:04.509 26966 ERROR keystone Traceback (most recent call last):
Sep 28 11:13:04 ctl02 salt-minion[14967]: 2017-09-28 11:13:04.509 26966 ERROR keystone   File "/usr/bin/keystone-manage", line 10, in <module>
Sep 28 11:13:04 ctl02 salt-minion[14967]: 2017-09-28 11:13:04.509 26966 ERROR keystone     sys.exit(main())
Sep 28 11:13:04 ctl02 salt-minion[14967]: 2017-09-28 11:13:04.509 26966 ERROR keystone   File "/usr/lib/python2.7/dist-packages/keystone/cmd/manage.py", line 47, in main
Sep 28 11:13:04 ctl02 salt-minion[14967]: 2017-09-28 11:13:04.509 26966 ERROR keystone     cli.main(argv=sys.argv, config_files=config_files)
Sep 28 11:13:04 ctl02 salt-minion[14967]: 2017-09-28 11:13:04.509 26966 ERROR keystone   File "/usr/lib/python2.7/dist-packages/keystone/cmd/cli.py", line 1048, in main
Sep 28 11:13:04 ctl02 salt-minion[14967]: 2017-09-28 11:13:04.509 26966 ERROR keystone     CONF.command.cmd_class.main()
Sep 28 11:13:04 ctl02 salt-minion[14967]: 2017-09-28 11:13:04.509 26966 ERROR keystone   File "/usr/lib/python2.7/dist-packages/keystone/cmd/cli.py", line 403, in main
Sep 28 11:13:04 ctl02 salt-minion[14967]: 2017-09-28 11:13:04.509 26966 ERROR keystone     migration_helpers.sync_database_to_version(extension, version)
Sep 28 11:13:04 ctl02 salt-minion[14967]: 2017-09-28 11:13:04.509 26966 ERROR keystone   File "/usr/lib/python2.7/dist-packages/keystone/common/sql/migration_helpers.py", line 210, in sync_database_to_version
Sep 28 11:13:04 ctl02 salt-minion[14967]: 2017-09-28 11:13:04.509 26966 ERROR keystone     _sync_common_repo(version)
Sep 28 11:13:04 ctl02 salt-minion[14967]: 2017-09-28 11:13:04.509 26966 ERROR keystone   File "/usr/lib/python2.7/dist-packages/keystone/common/sql/migration_helpers.py", line 136, in _sync_common_repo
Sep 28 11:13:04 ctl02 salt-minion[14967]: 2017-09-28 11:13:04.509 26966 ERROR keystone     init_version=init_version, sanity_check=False)
Sep 28 11:13:04 ctl02 salt-minion[14967]: 2017-09-28 11:13:04.509 26966 ERROR keystone   File "/usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/migration.py", line 79, in db_sync
Sep 28 11:13:04 ctl02 salt-minion[14967]: 2017-09-28 11:13:04.509 26966 ERROR keystone     migration = versioning_api.upgrade(engine, repository, version)
Sep 28 11:13:04 ctl02 salt-minion[14967]: 2017-09-28 11:13:04.509 26966 ERROR keystone   File "/usr/lib/python2.7/dist-packages/migrate/versioning/api.py", line 186, in upgrade
Sep 28 11:13:04 ctl02 salt-minion[14967]: 2017-09-28 11:13:04.509 26966 ERROR keystone     return _migrate(url, repository, version, upgrade=True, err=err, **opts)
Sep 28 11:13:04 ctl02 salt-minion[14967]: 2017-09-28 11:13:04.509 26966 ERROR keystone   File "<decorator-gen-15>", line 2, in _migrate
Sep 28 11:13:04 ctl02 salt-minion[14967]: 2017-09-28 11:13:04.509 26966 ERROR keystone   File "/usr/lib/python2.7/dist-packages/migrate/versioning/util/__init__.py", line 160, in with_engine
Sep 28 11:13:04 ctl02 salt-minion[14967]: 2017-09-28 11:13:04.509 26966 ERROR keystone     return f(*a, **kw)
Sep 28 11:13:04 ctl02 salt-minion[14967]: 2017-09-28 11:13:04.509 26966 ERROR keystone   File "/usr/lib/python2.7/dist-packages/migrate/versioning/api.py", line 345, in _migrate
Sep 28 11:13:04 ctl02 salt-minion[14967]: 2017-09-28 11:13:04.509 26966 ERROR keystone     changeset = schema.changeset(version)
Sep 28 11:13:04 ctl02 salt-minion[14967]: 2017-09-28 11:13:04.509 26966 ERROR keystone   File "/usr/lib/python2.7/dist-packages/migrate/versioning/schema.py", line 82, in changeset
Sep 28 11:13:04 ctl02 salt-minion[14967]: 2017-09-28 11:13:04.509 26966 ERROR keystone     changeset = self.repository.changeset(database, start_ver, version)
Sep 28 11:13:04 ctl02 salt-minion[14967]: 2017-09-28 11:13:04.509 26966 ERROR keystone   File "/usr/lib/python2.7/dist-packages/migrate/versioning/repository.py", line 225, in changeset
Sep 28 11:13:04 ctl02 salt-minion[14967]: 2017-09-28 11:13:04.509 26966 ERROR keystone     changes = [self.version(v).script(database, op) for v in versions]
Sep 28 11:13:04 ctl02 salt-minion[14967]: 2017-09-28 11:13:04.509 26966 ERROR keystone   File "/usr/lib/python2.7/dist-packages/migrate/versioning/repository.py", line 189, in version
Sep 28 11:13:04 ctl02 salt-minion[14967]: 2017-09-28 11:13:04.509 26966 ERROR keystone     return self.versions.version(*p, **k)
Sep 28 11:13:04 ctl02 salt-minion[14967]: 2017-09-28 11:13:04.509 26966 ERROR keystone   File "/usr/lib/python2.7/dist-packages/migrate/versioning/version.py", line 163, in version
Sep 28 11:13:04 ctl02 salt-minion[14967]: 2017-09-28 11:13:04.509 26966 ERROR keystone     return self.versions[VerNum(vernum)]
Sep 28 11:13:04 ctl02 salt-minion[14967]: 2017-09-28 11:13:04.509 26966 ERROR keystone KeyError: <VerNum(109)>
Sep 28 11:13:04 ctl02 salt-minion[14967]: 2017-09-28 11:13:04.509 26966 ERROR keystone
Sep 28 11:13:04 ctl02 salt-minion[14967]: [ERROR   ] retcode: 1
Sep 28 11:13:04 ctl02 salt-minion[14967]: [ERROR   ] {'pid': 26964, 'retcode': 1, 'stderr': 'Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.\n2017-09-28 11:13:04.509 26966 CRITICAL keystone [-] KeyError: <VerNum(109)>\n2017-09-28 11:13:04.509 26966 ERROR keystone Traceback (most recent call last):\n2017-09-28 11:13:04.509 26966 ERROR keystone   File "/usr/bin/keystone-manage", line 10, in <module>\n2017-09-28 11:13:04.509 26966 ERROR keystone     sys.exit(main())\n2017-09-28 11:13:04.509 26966 ERROR keystone   File "/usr/lib/python2.7/dist-packages/keystone/cmd/manage.py", line 47, in main\n2017-09-28 11:13:04.509 26966 ERROR keystone     cli.main(argv=sys.argv, config_files=config_files)\n2017-09-28 11:13:04.509 26966 ERROR keystone   File "/usr/lib/python2.7/dist-packages/keystone/cmd/cli.py", line 1048, in main\n2017-09-28 11:13:04.509 26966 ERROR keystone     CONF.command.cmd_class.main()\n2017-09-28 11:13:04.509 26966 ERROR keystone   File "/usr/lib/python2.7/dist-packages/keystone/cmd/cli.py", line 403, in main\n2017-09-28 11:13:04.509 26966 ERROR keystone     migration_helpers.sync_database_to_version(extension, version)\n2017-09-28 11:13:04.509 26966 ERROR keystone   File "/usr/lib/python2.7/dist-packages/keystone/common/sql/migration_helpers.py", line 210, in sync_database_to_version\n2017-09-28 11:13:04.509 26966 ERROR keystone     _sync_common_repo(version)\n2017-09-28 11:13:04.509 26966 ERROR keystone   File "/usr/lib/python2.7/dist-packages/keystone/common/sql/migration_helpers.py", line 136, in _sync_common_repo\n2017-09-28 11:13:04.509 26966 ERROR keystone     init_version=init_version, sanity_check=False)\n2017-09-28 11:13:04.509 26966 ERROR keystone   File "/usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/migration.py", line 79, in db_sync\n2017-09-28 11:13:04.509 26966 ERROR keystone     migration = versioning_api.upgrade(engine, repository, version)\n2017-09-28 11:13:04.509 26966 ERROR keystone   File "/usr/lib/python2.7/dist-packages/migrate/versioning/api.py", line
Sep 28 11:13:04 ctl02 salt-minion[14967]:  186, in upgrade\n2017-09-28 11:13:04.509 26966 ERROR keystone     return _migrate(url, repository, version, upgrade=True, err=err, **opts)\n2017-09-28 11:13:04.509 26966 ERROR keystone   File "<decorator-gen-15>", line 2, in _migrate\n2017-09-28 11:13:04.509 26966 ERROR keystone   File "/usr/lib/python2.7/dist-packages/migrate/versioning/util/__init__.py", line 160, in with_engine\n2017-09-28 11:13:04.509 26966 ERROR keystone     return f(*a, **kw)\n2017-09-28 11:13:04.509 26966 ERROR keystone   File "/usr/lib/python2.7/dist-packages/migrate/versioning/api.py", line 345, in _migrate\n2017-09-28 11:13:04.509 26966 ERROR keystone     changeset = schema.changeset(version)\n2017-09-28 11:13:04.509 26966 ERROR keystone   File "/usr/lib/python2.7/dist-packages/migrate/versioning/schema.py", line 82, in changeset\n2017-09-28 11:13:04.509 26966 ERROR keystone     changeset = self.repository.changeset(database, start_ver, version)\n2017-09-28 11:13:04.509 26966 ERROR keystone   File "/usr/lib/python2.7/dist-packages/migrate/versioning/repository.py", line 225, in changeset\n2017-09-28 11:13:04.509 26966 ERROR keystone     changes = [self.version(v).script(database, op) for v in versions]\n2017-09-28 11:13:04.509 26966 ERROR keystone   File "/usr/lib/python2.7/dist-packages/migrate/versioning/repository.py", line 189, in version\n2017-09-28 11:13:04.509 26966 ERROR keystone     return self.versions.version(*p, **k)\n2017-09-28 11:13:04.509 26966 ERROR keystone   File "/usr/lib/python2.7/dist-packages/migrate/versioning/version.py", line 163, in version\n2017-09-28 11:13:04.509 26966 ERROR keystone     return self.versions[VerNum(vernum)]\n2017-09-28 11:13:04.509 26966 ERROR keystone KeyError: <VerNum(109)>\n2017-09-28 11:13:04.509 26966 ERROR keystone', 'stdout': ''}
Sep 28 11:13:04 ctl02 salt-minion[14967]: [INFO    ] Completed state [keystone-manage db_sync && sleep 1] at time 11:13:04.580292 duration_in_ms=578.648
Sep 28 11:13:04 ctl02 salt-minion[14967]: [INFO    ] Running state [/var/lib/keystone/fernet-keys] at time 11:13:04.580906
Sep 28 11:13:04 ctl02 salt-minion[14967]: [INFO    ] Executing state file.directory for /var/lib/keystone/fernet-keys
Sep 28 11:13:04 ctl02 salt-minion[14967]: [INFO    ] {'/var/lib/keystone/fernet-keys': 'New Dir'}
Sep 28 11:13:04 ctl02 salt-minion[14967]: [INFO    ] Completed state [/var/lib/keystone/fernet-keys] at time 11:13:04.582768 duration_in_ms=1.862
Sep 28 11:13:04 ctl02 salt-minion[14967]: [INFO    ] Running state [keystone-manage fernet_setup --keystone-user keystone --keystone-group keystone] at time 11:13:04.583486
Sep 28 11:13:04 ctl02 salt-minion[14967]: [INFO    ] Executing state cmd.run for keystone-manage fernet_setup --keystone-user keystone --keystone-group keystone
Sep 28 11:13:04 ctl02 salt-minion[14967]: [INFO    ] Executing command 'keystone-manage fernet_setup --keystone-user keystone --keystone-group keystone' in directory '/root'
Sep 28 11:13:04 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928111304603684
Sep 28 11:13:04 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 26982
Sep 28 11:13:04 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928111304603684
Sep 28 11:13:05 ctl02 salt-minion[14967]: [INFO    ] {'pid': 26976, 'retcode': 0, 'stderr': 'Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.\n2017-09-28 11:13:05.146 26977 INFO keystone.token.providers.fernet.utils [-] Created a new key: /var/lib/keystone/fernet-keys/0\n2017-09-28 11:13:05.147 26977 INFO keystone.token.providers.fernet.utils [-] Starting key rotation with 1 key files: [\'/var/lib/keystone/fernet-keys/0\']\n2017-09-28 11:13:05.147 26977 INFO keystone.token.providers.fernet.utils [-] Current primary key is: 0\n2017-09-28 11:13:05.147 26977 INFO keystone.token.providers.fernet.utils [-] Next primary key will be: 1\n2017-09-28 11:13:05.148 26977 INFO keystone.token.providers.fernet.utils [-] Promoted key 0 to be the primary: 1\n2017-09-28 11:13:05.148 26977 INFO keystone.token.providers.fernet.utils [-] Created a new key: /var/lib/keystone/fernet-keys/0', 'stdout': ''}
Sep 28 11:13:05 ctl02 salt-minion[14967]: [INFO    ] Completed state [keystone-manage fernet_setup --keystone-user keystone --keystone-group keystone] at time 11:13:05.202507 duration_in_ms=619.018
Sep 28 11:13:05 ctl02 salt-minion[14967]: [INFO    ] Running state [/var/lib/keystone/credential-keys] at time 11:13:05.203071
Sep 28 11:13:05 ctl02 salt-minion[14967]: [INFO    ] Executing state file.directory for /var/lib/keystone/credential-keys
Sep 28 11:13:05 ctl02 salt-minion[14967]: [INFO    ] {'/var/lib/keystone/credential-keys': 'New Dir'}
Sep 28 11:13:05 ctl02 salt-minion[14967]: [INFO    ] Completed state [/var/lib/keystone/credential-keys] at time 11:13:05.204670 duration_in_ms=1.599
Sep 28 11:13:05 ctl02 salt-minion[14967]: [INFO    ] Running state [keystone-manage credential_setup --keystone-user keystone --keystone-group keystone] at time 11:13:05.205347
Sep 28 11:13:05 ctl02 salt-minion[14967]: [INFO    ] Executing state cmd.run for keystone-manage credential_setup --keystone-user keystone --keystone-group keystone
Sep 28 11:13:05 ctl02 salt-minion[14967]: [INFO    ] Executing command 'keystone-manage credential_setup --keystone-user keystone --keystone-group keystone' in directory '/root'
Sep 28 11:13:05 ctl02 salt-minion[14967]: [ERROR   ] Command 'keystone-manage credential_setup --keystone-user keystone --keystone-group keystone' failed with return code: 2
Sep 28 11:13:05 ctl02 salt-minion[14967]: [ERROR   ] stderr: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:13:05 ctl02 salt-minion[14967]: usage: keystone-manage [bootstrap|db_sync|db_version|domain_config_upload|fernet_rotate|fernet_setup|mapping_purge|mapping_engine|pki_setup|saml_idp_metadata|ssl_setup|token_flush]
Sep 28 11:13:05 ctl02 salt-minion[14967]: keystone-manage: error: argument command: invalid choice: 'credential_setup' (choose from 'bootstrap', 'db_sync', 'db_version', 'domain_config_upload', 'fernet_rotate', 'fernet_setup', 'mapping_purge', 'mapping_engine', 'pki_setup', 'saml_idp_metadata', 'ssl_setup', 'token_flush')
Sep 28 11:13:05 ctl02 salt-minion[14967]: [ERROR   ] retcode: 2
Sep 28 11:13:05 ctl02 salt-minion[14967]: [ERROR   ] {'pid': 27071, 'retcode': 2, 'stderr': 'Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.\nusage: keystone-manage [bootstrap|db_sync|db_version|domain_config_upload|fernet_rotate|fernet_setup|mapping_purge|mapping_engine|pki_setup|saml_idp_metadata|ssl_setup|token_flush]\nkeystone-manage: error: argument command: invalid choice: \'credential_setup\' (choose from \'bootstrap\', \'db_sync\', \'db_version\', \'domain_config_upload\', \'fernet_rotate\', \'fernet_setup\', \'mapping_purge\', \'mapping_engine\', \'pki_setup\', \'saml_idp_metadata\', \'ssl_setup\', \'token_flush\')', 'stdout': ''}
Sep 28 11:13:05 ctl02 salt-minion[14967]: [INFO    ] Completed state [keystone-manage credential_setup --keystone-user keystone --keystone-group keystone] at time 11:13:05.729603 duration_in_ms=524.255
Sep 28 11:13:05 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928110951991402
Sep 28 11:13:06 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command service.restart with jid 20170928111306694883
Sep 28 11:13:06 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 27117
Sep 28 11:13:07 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'status', 'apache2.service', '-n', '0'] in directory '/root'
Sep 28 11:13:07 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-enabled', 'apache2.service'] in directory '/root'
Sep 28 11:13:07 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemd-run', '--scope', 'systemctl', 'restart', 'apache2.service'] in directory '/root'
Sep 28 11:13:07 ctl02 systemd[1]: Started /bin/systemctl restart apache2.service.
Sep 28 11:13:07 ctl02 systemd[1]: Stopping LSB: Apache2 web server...
Sep 28 11:13:07 ctl02 apache2[27128]:  * Stopping Apache httpd web server apache2
Sep 28 11:13:08 ctl02 apache2[27128]:  *
Sep 28 11:13:08 ctl02 systemd[1]: Stopped LSB: Apache2 web server.
Sep 28 11:13:08 ctl02 systemd[1]: Starting LSB: Apache2 web server...
Sep 28 11:13:08 ctl02 apache2[27158]:  * Starting Apache httpd web server apache2
Sep 28 11:13:08 ctl02 apache2[27158]:  *
Sep 28 11:13:08 ctl02 systemd[1]: Started LSB: Apache2 web server.
Sep 28 11:13:08 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928111306694883
Sep 28 11:13:18 ctl02 dhclient[600]: DHCPREQUEST of 192.168.11.25 on ens2 to 192.168.11.3 port 67 (xid=0x3415f07)
Sep 28 11:13:18 ctl02 dhclient[600]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 11:13:18 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 11:13:18 ctl02 ntp[27454]:  * Stopping NTP server ntpd
Sep 28 11:13:18 ctl02 ntp[27454]:    ...done.
Sep 28 11:13:18 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 11:13:18 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 11:13:18 ctl02 ntp[27465]:  * Starting NTP server ntpd
Sep 28 11:13:18 ctl02 ntpd[27472]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 11:13:18 ctl02 ntpd[27472]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -c /var/lib/ntp/ntp.conf.dhcp -u 108:112
Sep 28 11:13:18 ctl02 ntp[27465]:    ...done.
Sep 28 11:13:18 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 11:13:18 ctl02 ntpd[27475]: proto: precision = 0.043 usec (-24)
Sep 28 11:13:18 ctl02 ntpd[27475]: switching logging to file /var/log/ntp.log
Sep 28 11:13:18 ctl02 dhclient[600]: bound to 192.168.11.25 -- renewal in 254 seconds.
Sep 28 11:13:20 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command cmd.run with jid 20170928111320704981
Sep 28 11:13:20 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 27483
Sep 28 11:13:20 ctl02 salt-minion[14967]: [INFO    ] Executing command '. /root/keystonercv3; openstack service list' in directory '/root'
Sep 28 11:13:22 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928111320704981
Sep 28 11:13:23 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command test.ping with jid 20170928111323215169
Sep 28 11:13:23 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 27496
Sep 28 11:13:23 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928111323215169
Sep 28 11:13:26 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7c414009)
Sep 28 11:13:36 ctl02 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7c414009)]
Sep 28 11:13:37 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:13:37 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:13:38 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 11:13:38 ctl02 ntp[27545]:  * Stopping NTP server ntpd
Sep 28 11:13:38 ctl02 ntp[27545]:    ...done.
Sep 28 11:13:38 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 11:13:38 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 11:13:38 ctl02 ntp[27556]:  * Starting NTP server ntpd
Sep 28 11:13:38 ctl02 ntpd[27563]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 11:13:38 ctl02 ntpd[27563]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 11:13:38 ctl02 ntp[27556]:    ...done.
Sep 28 11:13:38 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 11:13:38 ctl02 ntpd[27566]: proto: precision = 0.043 usec (-24)
Sep 28 11:13:38 ctl02 ntpd[27566]: switching logging to file /var/log/ntp.log
Sep 28 11:13:52 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xac9da074)
Sep 28 11:14:02 ctl02 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xac9da074)]
Sep 28 11:14:03 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:14:03 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:14:24 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x96025609)
Sep 28 11:14:34 ctl02 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x96025609)]
Sep 28 11:14:35 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:14:35 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:14:49 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf388124f)
Sep 28 11:14:59 ctl02 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf388124f)]
Sep 28 11:15:00 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:15:00 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:15:19 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc9d10276)
Sep 28 11:15:29 ctl02 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc9d10276)]
Sep 28 11:15:30 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:15:30 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:15:43 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x550bf43e)
Sep 28 11:15:53 ctl02 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x550bf43e)]
Sep 28 11:15:54 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:15:54 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:16:02 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfbadd225)
Sep 28 11:16:12 ctl02 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfbadd225)]
Sep 28 11:16:13 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:16:13 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:16:28 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4b363e30)
Sep 28 11:16:38 ctl02 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4b363e30)]
Sep 28 11:16:39 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:16:39 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:16:53 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2db66402)
Sep 28 11:17:00 ctl02 dhclient[627]: message repeated 7 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2db66402)]
Sep 28 11:17:01 ctl02 CRON[27606]: (root) CMD (   cd / && run-parts --report /etc/cron.hourly)
Sep 28 11:17:01 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2db66402)
Sep 28 11:17:03 ctl02 dhclient[627]: message repeated 2 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2db66402)]
Sep 28 11:17:04 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:17:04 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:17:15 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6f35415c)
Sep 28 11:17:25 ctl02 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6f35415c)]
Sep 28 11:17:26 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:17:26 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:17:32 ctl02 dhclient[600]: DHCPREQUEST of 192.168.11.25 on ens2 to 192.168.11.3 port 67 (xid=0x3415f07)
Sep 28 11:17:32 ctl02 dhclient[600]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 11:17:32 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 11:17:32 ctl02 ntp[27674]:  * Stopping NTP server ntpd
Sep 28 11:17:32 ctl02 ntp[27674]:    ...done.
Sep 28 11:17:32 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 11:17:32 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 11:17:32 ctl02 ntp[27685]:  * Starting NTP server ntpd
Sep 28 11:17:32 ctl02 ntpd[27692]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 11:17:32 ctl02 ntpd[27692]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -c /var/lib/ntp/ntp.conf.dhcp -u 108:112
Sep 28 11:17:32 ctl02 ntp[27685]:    ...done.
Sep 28 11:17:32 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 11:17:32 ctl02 ntpd[27695]: proto: precision = 0.045 usec (-24)
Sep 28 11:17:32 ctl02 ntpd[27695]: switching logging to file /var/log/ntp.log
Sep 28 11:17:32 ctl02 dhclient[600]: bound to 192.168.11.25 -- renewal in 296 seconds.
Sep 28 11:17:34 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7427585f)
Sep 28 11:17:44 ctl02 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7427585f)]
Sep 28 11:17:45 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:17:45 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:17:45 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 11:17:45 ctl02 ntp[27748]:  * Stopping NTP server ntpd
Sep 28 11:17:45 ctl02 ntp[27748]:    ...done.
Sep 28 11:17:45 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 11:17:45 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 11:17:45 ctl02 ntp[27759]:  * Starting NTP server ntpd
Sep 28 11:17:45 ctl02 ntpd[27766]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 11:17:45 ctl02 ntpd[27766]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 11:17:45 ctl02 ntp[27759]:    ...done.
Sep 28 11:17:45 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 11:17:45 ctl02 ntpd[27769]: proto: precision = 0.042 usec (-24)
Sep 28 11:17:45 ctl02 ntpd[27769]: switching logging to file /var/log/ntp.log
Sep 28 11:18:00 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7ea2b54e)
Sep 28 11:18:10 ctl02 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7ea2b54e)]
Sep 28 11:18:11 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:18:11 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:18:21 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xedeb1954)
Sep 28 11:18:31 ctl02 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xedeb1954)]
Sep 28 11:18:32 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:18:32 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:18:54 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x96a0ae68)
Sep 28 11:19:04 ctl02 dhclient[627]: message repeated 9 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x96a0ae68)]
Sep 28 11:19:05 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:19:05 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:19:23 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4620648)
Sep 28 11:19:33 ctl02 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4620648)]
Sep 28 11:19:34 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:19:34 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:19:43 ctl02 salt-minion[14967]: [INFO    ] Running scheduled job: __mine_interval
Sep 28 11:19:44 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb7ca9310)
Sep 28 11:19:54 ctl02 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb7ca9310)]
Sep 28 11:19:55 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:19:55 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:20:05 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9c7b5f70)
Sep 28 11:20:15 ctl02 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9c7b5f70)]
Sep 28 11:20:16 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:20:16 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:20:24 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x43561410)
Sep 28 11:20:34 ctl02 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x43561410)]
Sep 28 11:20:35 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:20:35 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:20:43 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x454d8768)
Sep 28 11:20:53 ctl02 dhclient[627]: message repeated 10 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x454d8768)]
Sep 28 11:20:54 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:20:54 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:20:59 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command state.sls with jid 20170928112059075591
Sep 28 11:20:59 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 27825
Sep 28 11:21:00 ctl02 salt-minion[14967]: [INFO    ] Loading fresh modules for state activity
Sep 28 11:21:00 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'glance/init.sls'
Sep 28 11:21:00 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'glance/server.sls'
Sep 28 11:21:00 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'glance/map.jinja'
Sep 28 11:21:01 ctl02 salt-minion[14967]: [INFO    ] Running state [glance] at time 11:21:01.626584
Sep 28 11:21:01 ctl02 salt-minion[14967]: [INFO    ] Executing state group.present for glance
Sep 28 11:21:01 ctl02 salt-minion[14967]: [INFO    ] Executing command 'groupadd -g 302 -r glance' in directory '/root'
Sep 28 11:21:01 ctl02 salt-minion[14967]: [INFO    ] {'passwd': 'x', 'gid': 302, 'name': 'glance', 'members': []}
Sep 28 11:21:01 ctl02 salt-minion[14967]: [INFO    ] Completed state [glance] at time 11:21:01.748392 duration_in_ms=121.807
Sep 28 11:21:01 ctl02 salt-minion[14967]: [INFO    ] Running state [glance] at time 11:21:01.748779
Sep 28 11:21:01 ctl02 salt-minion[14967]: [INFO    ] Executing state user.present for glance
Sep 28 11:21:01 ctl02 salt-minion[14967]: [INFO    ] Executing command ['useradd', '-s', '/bin/false', '-u', '302', '-g', '302', '-m', '-d', '/var/lib/glance', '-r', 'glance'] in directory '/root'
Sep 28 11:21:01 ctl02 salt-minion[14967]: [INFO    ] {'shell': '/bin/false', 'workphone': '', 'uid': 302, 'passwd': 'x', 'roomnumber': '', 'groups': ['glance'], 'home': '/var/lib/glance', 'name': 'glance', 'gid': 302, 'fullname': '', 'homephone': ''}
Sep 28 11:21:01 ctl02 salt-minion[14967]: [INFO    ] Completed state [glance] at time 11:21:01.860329 duration_in_ms=111.547
Sep 28 11:21:01 ctl02 salt-minion[14967]: [INFO    ] Running state [glance-api] at time 11:21:01.860817
Sep 28 11:21:01 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for glance-api
Sep 28 11:21:01 ctl02 salt-minion[14967]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 11:21:02 ctl02 salt-minion[14967]: [INFO    ] Executing command ['apt-get', '-q', 'update'] in directory '/root'
Sep 28 11:21:04 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemd-run', '--scope', 'apt-get', '-q', '-y', '-o', 'DPkg::Options::=--force-confold', '-o', 'DPkg::Options::=--force-confdef', 'install', 'glance-api'] in directory '/root'
Sep 28 11:21:04 ctl02 systemd[1]: Started /usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold -o DPkg::Options::=--force-confdef install glance-api.
Sep 28 11:21:08 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x20347f35)
Sep 28 11:21:09 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928112109114757
Sep 28 11:21:09 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 28336
Sep 28 11:21:09 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928112109114757
Sep 28 11:21:09 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x20347f35)
Sep 28 11:21:16 ctl02 dhclient[627]: message repeated 7 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x20347f35)]
Sep 28 11:21:17 ctl02 systemd[1]: Reloading.
Sep 28 11:21:17 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x20347f35)
Sep 28 11:21:18 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x20347f35)
Sep 28 11:21:19 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928112119267086
Sep 28 11:21:19 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 28549
Sep 28 11:21:19 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928112119267086
Sep 28 11:21:19 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:21:19 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:21:23 ctl02 systemd[1]: Reloading.
Sep 28 11:21:23 ctl02 systemd[1]: message repeated 2 times: [ Reloading.]
Sep 28 11:21:23 ctl02 systemd[1]: Starting OpenStack Image Service API...
Sep 28 11:21:23 ctl02 systemd[1]: Started OpenStack Image Service API.
Sep 28 11:21:23 ctl02 systemd[1]: Reloading.
Sep 28 11:21:23 ctl02 glance-api[28692]: /usr/lib/python2.7/dist-packages/oslo_middleware/ssl.py:28: DeprecationWarning: The 'oslo_middleware.ssl' module usage is deprecated, please use oslo_middleware.http_proxy_to_wsgi instead
Sep 28 11:21:23 ctl02 glance-api[28692]:   "oslo_middleware.http_proxy_to_wsgi")
Sep 28 11:21:24 ctl02 glance-api[28692]: /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py:22: DeprecationWarning: Parameters to load are deprecated.  Call .resolve and .require separately.
Sep 28 11:21:24 ctl02 glance-api[28692]:   return pkg_resources.EntryPoint.parse("x=" + s).load(False)
Sep 28 11:21:24 ctl02 glance-api[28692]: /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py:22: DeprecationWarning: Parameters to load are deprecated.  Call .resolve and .require separately.
Sep 28 11:21:24 ctl02 glance-api[28692]:   return pkg_resources.EntryPoint.parse("x=" + s).load(False)
Sep 28 11:21:24 ctl02 glance-api[28692]: /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py:22: DeprecationWarning: Parameters to load are deprecated.  Call .resolve and .require separately.
Sep 28 11:21:24 ctl02 glance-api[28692]:   return pkg_resources.EntryPoint.parse("x=" + s).load(False)
Sep 28 11:21:24 ctl02 glance-api[28692]: /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py:22: DeprecationWarning: Parameters to load are deprecated.  Call .resolve and .require separately.
Sep 28 11:21:24 ctl02 glance-api[28692]:   return pkg_resources.EntryPoint.parse("x=" + s).load(False)
Sep 28 11:21:24 ctl02 glance-api[28692]: /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py:22: DeprecationWarning: Parameters to load are deprecated.  Call .resolve and .require separately.
Sep 28 11:21:24 ctl02 glance-api[28692]:   return pkg_resources.EntryPoint.parse("x=" + s).load(False)
Sep 28 11:21:24 ctl02 glance-api[28692]: /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py:22: DeprecationWarning: Parameters to load are deprecated.  Call .resolve and .require separately.
Sep 28 11:21:24 ctl02 glance-api[28692]:   return pkg_resources.EntryPoint.parse("x=" + s).load(False)
Sep 28 11:21:24 ctl02 glance-api[28692]: /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py:22: DeprecationWarning: Parameters to load are deprecated.  Call .resolve and .require separately.
Sep 28 11:21:24 ctl02 glance-api[28692]:   return pkg_resources.EntryPoint.parse("x=" + s).load(False)
Sep 28 11:21:24 ctl02 salt-minion[14967]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 11:21:24 ctl02 glance-api[28692]: /usr/lib/python2.7/dist-packages/cryptography/x509/__init__.py:32: PendingDeprecationWarning: CRLExtensionOID has been renamed to CRLEntryExtensionOID
Sep 28 11:21:24 ctl02 glance-api[28692]:   from cryptography.x509.oid import (
Sep 28 11:21:24 ctl02 salt-minion[14967]: [INFO    ] Made the following changes:
Sep 28 11:21:24 ctl02 salt-minion[14967]: 'python-numpy-dev' changed from 'absent' to '1'
Sep 28 11:21:24 ctl02 salt-minion[14967]: 'python-taskflow' changed from 'absent' to '1.30.0-1ubuntu1'
Sep 28 11:21:24 ctl02 salt-minion[14967]: 'libblas.so.3' changed from 'absent' to '1'
Sep 28 11:21:24 ctl02 salt-minion[14967]: 'python-numpy-api10' changed from 'absent' to '1'
Sep 28 11:21:24 ctl02 salt-minion[14967]: 'liblapack.so.3' changed from 'absent' to '1'
Sep 28 11:21:24 ctl02 salt-minion[14967]: 'python-automaton' changed from 'absent' to '1.2.0-1'
Sep 28 11:21:24 ctl02 salt-minion[14967]: 'python-numpy' changed from 'absent' to '1:1.11.0-1ubuntu1'
Sep 28 11:21:24 ctl02 salt-minion[14967]: 'libblas3' changed from 'absent' to '3.6.0-2ubuntu2'
Sep 28 11:21:24 ctl02 salt-minion[14967]: 'python-ipaddr' changed from 'absent' to '2.1.11-2'
Sep 28 11:21:24 ctl02 salt-minion[14967]: 'python-simplegeneric' changed from 'absent' to '0.8.1-1'
Sep 28 11:21:24 ctl02 salt-minion[14967]: 'python-glance' changed from 'absent' to '2:12.0.0-0ubuntu2'
Sep 28 11:21:24 ctl02 salt-minion[14967]: 'python-wsme' changed from 'absent' to '0.8.0-2ubuntu2'
Sep 28 11:21:24 ctl02 salt-minion[14967]: 'python2.7-numpy' changed from 'absent' to '1'
Sep 28 11:21:24 ctl02 salt-minion[14967]: 'glance-store-common' changed from 'absent' to '0.13.0-3ubuntu0.16.04.1'
Sep 28 11:21:24 ctl02 salt-minion[14967]: 'python-castellan' changed from 'absent' to '0.4.0-1'
Sep 28 11:21:24 ctl02 salt-minion[14967]: 'liblapack3' changed from 'absent' to '3.6.0-2ubuntu2'
Sep 28 11:21:24 ctl02 salt-minion[14967]: 'python-f2py' changed from 'absent' to '1'
Sep 28 11:21:24 ctl02 salt-minion[14967]: 'python2.7-glance' changed from 'absent' to '1'
Sep 28 11:21:24 ctl02 salt-minion[14967]: 'python-numpy-abi9' changed from 'absent' to '1'
Sep 28 11:21:24 ctl02 salt-minion[14967]: 'python-httplib2' changed from 'absent' to '0.9.1+dfsg-1'
Sep 28 11:21:24 ctl02 salt-minion[14967]: 'python-kazoo' changed from 'absent' to '2.2.1-1ubuntu1'
Sep 28 11:21:24 ctl02 salt-minion[14967]: 'python-osprofiler' changed from 'absent' to '1.2.0-1ubuntu1'
Sep 28 11:21:24 ctl02 salt-minion[14967]: 'python-networkx' changed from 'absent' to '1.11-1ubuntu1'
Sep 28 11:21:24 ctl02 salt-minion[14967]: 'python-semantic-version' changed from 'absent' to '2.3.1-1'
Sep 28 11:21:24 ctl02 salt-minion[14967]: 'libblas-common' changed from 'absent' to '3.6.0-2ubuntu2'
Sep 28 11:21:24 ctl02 salt-minion[14967]: 'libquadmath0' changed from 'absent' to '5.4.0-6ubuntu1~16.04.4'
Sep 28 11:21:24 ctl02 salt-minion[14967]: 'glance-common' changed from 'absent' to '2:12.0.0-0ubuntu2'
Sep 28 11:21:24 ctl02 salt-minion[14967]: 'python-glance-store' changed from 'absent' to '0.13.0-3ubuntu0.16.04.1'
Sep 28 11:21:24 ctl02 salt-minion[14967]: 'libgfortran3' changed from 'absent' to '5.4.0-6ubuntu1~16.04.4'
Sep 28 11:21:24 ctl02 salt-minion[14967]: 'glance-api' changed from 'absent' to '2:12.0.0-0ubuntu2'
Sep 28 11:21:24 ctl02 salt-minion[14967]: [INFO    ] Loading fresh modules for state activity
Sep 28 11:21:24 ctl02 salt-minion[14967]: [INFO    ] Completed state [glance-api] at time 11:21:24.406239 duration_in_ms=22545.42
Sep 28 11:21:24 ctl02 salt-minion[14967]: [INFO    ] Running state [python-memcache] at time 11:21:24.411883
Sep 28 11:21:24 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for python-memcache
Sep 28 11:21:24 ctl02 salt-minion[14967]: [INFO    ] Package python-memcache is already installed
Sep 28 11:21:24 ctl02 salt-minion[14967]: [INFO    ] Completed state [python-memcache] at time 11:21:24.645023 duration_in_ms=233.139
Sep 28 11:21:24 ctl02 salt-minion[14967]: [INFO    ] Running state [python-pycadf] at time 11:21:24.645374
Sep 28 11:21:24 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for python-pycadf
Sep 28 11:21:24 ctl02 salt-minion[14967]: [INFO    ] Package python-pycadf is already installed
Sep 28 11:21:24 ctl02 salt-minion[14967]: [INFO    ] Completed state [python-pycadf] at time 11:21:24.648500 duration_in_ms=3.125
Sep 28 11:21:24 ctl02 salt-minion[14967]: [INFO    ] Running state [glance-common] at time 11:21:24.648818
Sep 28 11:21:24 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for glance-common
Sep 28 11:21:24 ctl02 salt-minion[14967]: [INFO    ] Package glance-common is already installed
Sep 28 11:21:24 ctl02 salt-minion[14967]: [INFO    ] Completed state [glance-common] at time 11:21:24.651771 duration_in_ms=2.952
Sep 28 11:21:24 ctl02 salt-minion[14967]: [INFO    ] Running state [python-glance-store] at time 11:21:24.652088
Sep 28 11:21:24 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for python-glance-store
Sep 28 11:21:24 ctl02 salt-minion[14967]: [INFO    ] Package python-glance-store is already installed
Sep 28 11:21:24 ctl02 salt-minion[14967]: [INFO    ] Completed state [python-glance-store] at time 11:21:24.655129 duration_in_ms=3.041
Sep 28 11:21:24 ctl02 salt-minion[14967]: [INFO    ] Running state [python-glance] at time 11:21:24.655445
Sep 28 11:21:24 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for python-glance
Sep 28 11:21:24 ctl02 salt-minion[14967]: [INFO    ] Package python-glance is already installed
Sep 28 11:21:24 ctl02 salt-minion[14967]: [INFO    ] Completed state [python-glance] at time 11:21:24.658382 duration_in_ms=2.937
Sep 28 11:21:24 ctl02 salt-minion[14967]: [INFO    ] Running state [gettext-base] at time 11:21:24.658670
Sep 28 11:21:24 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for gettext-base
Sep 28 11:21:24 ctl02 salt-minion[14967]: [INFO    ] Package gettext-base is already installed
Sep 28 11:21:24 ctl02 salt-minion[14967]: [INFO    ] Completed state [gettext-base] at time 11:21:24.661557 duration_in_ms=2.887
Sep 28 11:21:24 ctl02 salt-minion[14967]: [INFO    ] Running state [glance] at time 11:21:24.661831
Sep 28 11:21:24 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for glance
Sep 28 11:21:24 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemd-run', '--scope', 'apt-get', '-q', '-y', '-o', 'DPkg::Options::=--force-confold', '-o', 'DPkg::Options::=--force-confdef', 'install', 'glance'] in directory '/root'
Sep 28 11:21:24 ctl02 systemd[1]: Started /usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold -o DPkg::Options::=--force-confdef install glance.
Sep 28 11:21:24 ctl02 glance-api[28692]: /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py:22: DeprecationWarning: Parameters to load are deprecated.  Call .resolve and .require separately.
Sep 28 11:21:24 ctl02 glance-api[28692]:   return pkg_resources.EntryPoint.parse("x=" + s).load(False)
Sep 28 11:21:24 ctl02 glance-api[28692]: /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py:22: DeprecationWarning: Parameters to load are deprecated.  Call .resolve and .require separately.
Sep 28 11:21:24 ctl02 glance-api[28692]:   return pkg_resources.EntryPoint.parse("x=" + s).load(False)
Sep 28 11:21:26 ctl02 systemd[1]: Reloading.
Sep 28 11:21:27 ctl02 systemd[1]: message repeated 3 times: [ Reloading.]
Sep 28 11:21:27 ctl02 systemd[1]: Starting OpenStack Image Service Registry...
Sep 28 11:21:27 ctl02 systemd[1]: Started OpenStack Image Service Registry.
Sep 28 11:21:27 ctl02 systemd[1]: Reloading.
Sep 28 11:21:28 ctl02 glance-registry[28886]: /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py:22: DeprecationWarning: Parameters to load are deprecated.  Call .resolve and .require separately.
Sep 28 11:21:28 ctl02 glance-registry[28886]:   return pkg_resources.EntryPoint.parse("x=" + s).load(False)
Sep 28 11:21:28 ctl02 glance-registry[28886]: /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py:22: DeprecationWarning: Parameters to load are deprecated.  Call .resolve and .require separately.
Sep 28 11:21:28 ctl02 glance-registry[28886]:   return pkg_resources.EntryPoint.parse("x=" + s).load(False)
Sep 28 11:21:28 ctl02 glance-registry[28886]: /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py:22: DeprecationWarning: Parameters to load are deprecated.  Call .resolve and .require separately.
Sep 28 11:21:28 ctl02 glance-registry[28886]:   return pkg_resources.EntryPoint.parse("x=" + s).load(False)
Sep 28 11:21:28 ctl02 glance-registry[28886]: /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py:22: DeprecationWarning: Parameters to load are deprecated.  Call .resolve and .require separately.
Sep 28 11:21:28 ctl02 glance-registry[28886]:   return pkg_resources.EntryPoint.parse("x=" + s).load(False)
Sep 28 11:21:28 ctl02 salt-minion[14967]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 11:21:28 ctl02 salt-minion[14967]: [INFO    ] Made the following changes:
Sep 28 11:21:28 ctl02 salt-minion[14967]: 'glance' changed from 'absent' to '2:12.0.0-0ubuntu2'
Sep 28 11:21:28 ctl02 salt-minion[14967]: 'glance-registry' changed from 'absent' to '2:12.0.0-0ubuntu2'
Sep 28 11:21:28 ctl02 salt-minion[14967]: [INFO    ] Loading fresh modules for state activity
Sep 28 11:21:28 ctl02 salt-minion[14967]: [INFO    ] Completed state [glance] at time 11:21:28.310580 duration_in_ms=3648.748
Sep 28 11:21:28 ctl02 salt-minion[14967]: [INFO    ] Running state [glance-registry] at time 11:21:28.317265
Sep 28 11:21:28 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for glance-registry
Sep 28 11:21:28 ctl02 salt-minion[14967]: [INFO    ] Package glance-registry is already installed
Sep 28 11:21:28 ctl02 salt-minion[14967]: [INFO    ] Completed state [glance-registry] at time 11:21:28.515505 duration_in_ms=198.239
Sep 28 11:21:28 ctl02 salt-minion[14967]: [INFO    ] Running state [python-glanceclient] at time 11:21:28.515843
Sep 28 11:21:28 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for python-glanceclient
Sep 28 11:21:28 ctl02 salt-minion[14967]: [INFO    ] Package python-glanceclient is already installed
Sep 28 11:21:28 ctl02 salt-minion[14967]: [INFO    ] Completed state [python-glanceclient] at time 11:21:28.518753 duration_in_ms=2.91
Sep 28 11:21:28 ctl02 salt-minion[14967]: [INFO    ] Running state [/etc/glance/glance-cache.conf] at time 11:21:28.519999
Sep 28 11:21:28 ctl02 salt-minion[14967]: [INFO    ] Executing state file.managed for /etc/glance/glance-cache.conf
Sep 28 11:21:28 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'glance/files/ocata/glance-cache.conf.Debian'
Sep 28 11:21:28 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'glance/map.jinja'
Sep 28 11:21:28 ctl02 salt-minion[14967]: [INFO    ] File changed:
Sep 28 11:21:28 ctl02 salt-minion[14967]: ---
Sep 28 11:21:28 ctl02 salt-minion[14967]: +++
Sep 28 11:21:28 ctl02 salt-minion[14967]: @@ -1,304 +1,2288 @@
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]:  [DEFAULT]
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # From glance.cache
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Whether to allow users to specify image properties beyond what the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# image schema provides (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Allow users to add additional/custom properties to images.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Glance defines a standard set of properties (in its schema) that
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# appear on every image. These properties are also known as
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``base properties``. In addition to these properties, Glance
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# allows users to add custom properties to images. These are known
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# as ``additional properties``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# By default, this configuration option is set to ``True`` and users
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# are allowed to add additional properties. The number of additional
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# properties that can be added to an image can be controlled via
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``image_property_quota`` configuration option.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * image_property_quota
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #allow_additional_image_properties = true
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Maximum number of image members per image. Negative values evaluate
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# to unlimited. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Maximum number of image members per image.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This limits the maximum of users an image can be shared with. Any negative
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# value is interpreted as unlimited.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #image_member_quota = 128
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Maximum number of properties allowed on an image. Negative values
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# evaluate to unlimited. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Maximum number of properties allowed on an image.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This enforces an upper limit on the number of additional properties an image
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# can have. Any negative value is interpreted as unlimited.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: This won't have any impact if additional properties are disabled. Please
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# refer to ``allow_additional_image_properties``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * ``allow_additional_image_properties``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #image_property_quota = 128
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Maximum number of tags allowed on an image. Negative values evaluate
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# to unlimited. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Maximum number of tags allowed on an image.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Any negative value is interpreted as unlimited.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #image_tag_quota = 128
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Maximum number of locations allowed on an image. Negative values
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# evaluate to unlimited. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Maximum number of locations allowed on an image.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Any negative value is interpreted as unlimited.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #image_location_quota = 10
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Python module path of data access API (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Python module path of data access API.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Specifies the path to the API to use for accessing the data model.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option determines how the image catalog data will be accessed.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * glance.db.sqlalchemy.api
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * glance.db.registry.api
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * glance.db.simple.api
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# If this option is set to ``glance.db.sqlalchemy.api`` then the image
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# catalog data is stored in and read from the database via the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# SQLAlchemy Core and ORM APIs.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Setting this option to ``glance.db.registry.api`` will force all
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# database access requests to be routed through the Registry service.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This avoids data access from the Glance API nodes for an added layer
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# of security, scalability and manageability.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: In v2 OpenStack Images API, the registry service is optional.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# In order to use the Registry API in v2, the option
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``enable_v2_registry`` must be set to ``True``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Finally, when this configuration option is set to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``glance.db.simple.api``, image catalog data is stored in and read
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# from an in-memory data structure. This is primarily used for testing.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * enable_v2_api
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * enable_v2_registry
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #data_api = glance.db.sqlalchemy.api
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Default value for the number of items returned by a request if not
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# specified explicitly in the request (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The default number of results to return for a request.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Responses to certain API requests, like list images, may return
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# multiple items. The number of results returned can be explicitly
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# controlled by specifying the ``limit`` parameter in the API request.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# However, if a ``limit`` parameter is not specified, this
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# configuration value will be used as the default number of results to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# be returned for any API request.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTES:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * The value of this configuration option may not be greater than
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       the value specified by ``api_limit_max``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Setting this to a very large value may slow down database
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       queries and increase response times. Setting this to a
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       very low value may result in poor user experience.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Any positive integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * api_limit_max
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #limit_param_default = 25
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Maximum permissible number of items that could be returned by a
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# request (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Maximum number of results that could be returned by a request.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# As described in the help text of ``limit_param_default``, some
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# requests may return multiple results. The number of results to be
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# returned are governed either by the ``limit`` parameter in the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# request or the ``limit_param_default`` configuration option.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The value in either case, can't be greater than the absolute maximum
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# defined by this configuration option. Anything greater than this
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# value is trimmed down to the maximum value defined here.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: Setting this to a very large value may slow down database
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       queries and increase response times. Setting this to a
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       very low value may result in poor user experience.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Any positive integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * limit_param_default
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #api_limit_max = 1000
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Whether to include the backend image storage location in image
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# properties. Revealing storage location can be a security risk, so
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# use this setting with caution! (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Show direct image location when returning an image.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This configuration option indicates whether to show the direct image
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# location when returning image details to the user. The direct image
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# location is where the image data is stored in backend storage. This
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# image location is shown under the image property ``direct_url``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When multiple image locations exist for an image, the best location
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# is displayed based on the location strategy indicated by the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# configuration option ``location_strategy``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTES:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Revealing image locations can present a GRAVE SECURITY RISK as
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       image locations can sometimes include credentials. Hence, this
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       is set to ``False`` by default. Set this to ``True`` with
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       EXTREME CAUTION and ONLY IF you know what you are doing!
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * If an operator wishes to avoid showing any image location(s)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       to the user, then both this option and
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       ``show_multiple_locations`` MUST be set to ``False``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * show_multiple_locations
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * location_strategy
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #show_image_direct_url = false
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Whether to include the backend image locations in image properties.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# For example, if using the file system store a URL of
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# "file:///path/to/image" will be returned to the user in the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# 'direct_url' meta-data field. Revealing storage location can be a
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# security risk, so use this setting with caution! Setting this to
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# true overrides the show_image_direct_url option. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEPRECATED:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Show all image locations when returning an image.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This configuration option indicates whether to show all the image
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# locations when returning image details to the user. When multiple
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# image locations exist for an image, the locations are ordered based
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# on the location strategy indicated by the configuration opt
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``location_strategy``. The image locations are shown under the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# image property ``locations``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTES:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Revealing image locations can present a GRAVE SECURITY RISK as
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       image locations can sometimes include credentials. Hence, this
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       is set to ``False`` by default. Set this to ``True`` with
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       EXTREME CAUTION and ONLY IF you know what you are doing!
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * If an operator wishes to avoid showing any image location(s)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       to the user, then both this option and
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       ``show_image_direct_url`` MUST be set to ``False``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * show_image_direct_url
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * location_strategy
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option is deprecated for removal since Newton.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reason: This option will be removed in the Ocata release because the same
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# functionality can be achieved with greater granularity by using policies.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Please see the Newton release notes for more information.
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #show_multiple_locations = false
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Maximum size of image a user can upload in bytes. Defaults to
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# 1099511627776 bytes (1 TB).WARNING: this value should only be
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# increased after careful consideration and must be set to a value
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# under 8 EB (9223372036854775808). (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Maximum size of image a user can upload in bytes.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# An image upload greater than the size mentioned here would result
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# in an image creation failure. This configuration option defaults to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# 1099511627776 bytes (1 TiB).
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTES:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * This value should only be increased after careful
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       consideration and must be set less than or equal to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       8 EiB (9223372036854775808).
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * This value must be set with careful consideration of the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       backend storage capacity. Setting this to a very low value
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       may result in a large number of image failures. And, setting
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       this to a very large value may result in faster consumption
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       of storage. Hence, this must be set according to the nature of
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       images created and storage capacity available.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Any positive number less than or equal to 9223372036854775808
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Maximum value: 9223372036854775808
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #image_size_cap = 1099511627776
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Set a system wide quota for every user. This value is the total
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# capacity that a user can use across all storage systems. A value of
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# 0 means unlimited.Optional unit can be specified for the value.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Accepted units are B, KB, MB, GB and TB representing Bytes,
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# KiloBytes, MegaBytes, GigaBytes and TeraBytes respectively. If no
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# unit is specified then Bytes is assumed. Note that there should not
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# be any space between value and unit and units are case sensitive.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Maximum amount of image storage per tenant.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This enforces an upper limit on the cumulative storage consumed by all images
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# of a tenant across all stores. This is a per-tenant limit.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The default unit for this configuration option is Bytes. However, storage
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# units can be specified using case-sensitive literals ``B``, ``KB``, ``MB``,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``GB`` and ``TB`` representing Bytes, KiloBytes, MegaBytes, GigaBytes and
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# TeraBytes respectively. Note that there should not be any space between the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# value and unit. Value ``0`` signifies no quota enforcement. Negative values
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# are invalid and result in errors.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A string that is a valid concatenation of a non-negative integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       representing the storage value and an optional string literal
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       representing storage units as mentioned above.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #user_storage_quota = 0
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Deploy the v1 OpenStack Images API. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deploy the v1 OpenStack Images API.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When this option is set to ``True``, Glance service will respond to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# requests on registered endpoints conforming to the v1 OpenStack
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Images API.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTES:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * If this option is enabled, then ``enable_v1_registry`` must
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       also be set to ``True`` to enable mandatory usage of Registry
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       service with v1 API.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * If this option is disabled, then the ``enable_v1_registry``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       option, which is enabled by default, is also recommended
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       to be disabled.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * This option is separate from ``enable_v2_api``, both v1 and v2
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       OpenStack Images API can be deployed independent of each
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       other.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * If deploying only the v2 Images API, this option, which is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       enabled by default, should be disabled.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * enable_v1_registry
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * enable_v2_api
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #enable_v1_api = true
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Deploy the v2 OpenStack Images API. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deploy the v2 OpenStack Images API.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When this option is set to ``True``, Glance service will respond
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# to requests on registered endpoints conforming to the v2 OpenStack
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Images API.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTES:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * If this option is disabled, then the ``enable_v2_registry``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       option, which is enabled by default, is also recommended
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       to be disabled.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * This option is separate from ``enable_v1_api``, both v1 and v2
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       OpenStack Images API can be deployed independent of each
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       other.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * If deploying only the v1 Images API, this option, which is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       enabled by default, should be disabled.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * enable_v2_registry
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * enable_v1_api
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #enable_v2_api = true
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Deploy the v1 OpenStack Registry API. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deploy the v1 API Registry service.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When this option is set to ``True``, the Registry service
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# will be enabled in Glance for v1 API requests.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTES:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Use of Registry is mandatory in v1 API, so this option must
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       be set to ``True`` if the ``enable_v1_api`` option is enabled.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * If deploying only the v2 OpenStack Images API, this option,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       which is enabled by default, should be disabled.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * enable_v1_api
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #enable_v1_registry = true
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Deploy the v2 OpenStack Registry API. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deploy the v2 API Registry service.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When this option is set to ``True``, the Registry service
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# will be enabled in Glance for v2 API requests.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTES:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Use of Registry is optional in v2 API, so this option
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       must only be enabled if both ``enable_v2_api`` is set to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       ``True`` and the ``data_api`` option is set to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       ``glance.db.registry.api``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * If deploying only the v1 OpenStack Images API, this option,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       which is enabled by default, should be disabled.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * enable_v2_api
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * data_api
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #enable_v2_registry = true
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The hostname/IP of the pydev process listening for debug connections
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#pydev_worker_debug_host = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The port on which a pydev process is listening for connections.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (port value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Host address of the pydev server.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a string value representing the hostname or IP of the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# pydev server to use for debugging. The pydev server listens for
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# debug connections on this address, facilitating remote debugging
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# in Glance.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Valid hostname
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Valid IP address
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#pydev_worker_debug_host = localhost
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Port number that the pydev server will listen on.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a port number to bind the pydev server to. The pydev
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# process accepts debug connections on this port and facilitates
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# remote debugging in Glance.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid port number
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (port value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Minimum value: 0
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Maximum value: 65535
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #pydev_worker_debug_port = 5678
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# AES key for encrypting store 'location' metadata. This includes, if
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# used, Swift or S3 credentials. Should be set to a random string of
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# length 16, 24 or 32 bytes (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# AES key for encrypting store location metadata.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a string value representing the AES cipher to use for
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# encrypting Glance store metadata.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: The AES key to use must be set to a random string of length
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# 16, 24 or 32 bytes.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * String value representing a valid AES key
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #metadata_encryption_key = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Digest algorithm which will be used for digital signature. Use the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# command "openssl list-message-digest-algorithms" to get the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# available algorithms supported by the version of OpenSSL on the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# platform. Examples are "sha1", "sha256", "sha512", etc. (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Digest algorithm to use for digital signature.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a string value representing the digest algorithm to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# use for generating digital signatures. By default, ``sha256``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# is used.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# To get a list of the available algorithms supported by the version
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# of OpenSSL on your platform, run the command:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``openssl list-message-digest-algorithms``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Examples are 'sha1', 'sha256', and 'sha512'.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: ``digest_algorithm`` is not related to Glance's image signing
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# and verification. It is only used to sign the universally unique
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# identifier (UUID) as a part of the certificate file and key file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# validation.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * An OpenSSL message digest algorithm identifier
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Relation options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #digest_algorithm = sha256
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The path to the sqlite file database that will be used for image
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# cache management. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The relative path to sqlite file database that will be used for image cache
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# management.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This is a relative path to the sqlite file database that tracks the age and
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# usage statistics of image cache. The path is relative to image cache base
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# directory, specified by the configuration option ``image_cache_dir``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This is a lightweight database with just one table.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid relative path to sqlite file database
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * ``image_cache_dir``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #image_cache_sqlite_db = cache.db
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The driver to use for image cache management. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The driver to use for image cache management.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This configuration option provides the flexibility to choose between the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# different image-cache drivers available. An image-cache driver is responsible
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# for providing the essential functions of image-cache like write images to/read
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# images from cache, track age and usage of cached images, provide a list of
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# cached images, fetch size of the cache, queue images for caching and clean up
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the cache, etc.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The essential functions of a driver are defined in the base class
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``glance.image_cache.drivers.base.Driver``. All image-cache drivers (existing
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# and prospective) must implement this interface. Currently available drivers
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# are ``sqlite`` and ``xattr``. These drivers primarily differ in the way they
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# store the information about cached images:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * The ``sqlite`` driver uses a sqlite database (which sits on every glance
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     node locally) to track the usage of cached images.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * The ``xattr`` driver uses the extended attributes of files to store this
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     information. It also requires a filesystem that sets ``atime`` on the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# files
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     when accessed.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * sqlite
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * xattr
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Allowed values: sqlite, xattr
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #image_cache_driver = sqlite
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The upper limit (the maximum size of accumulated cache in bytes)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# beyond which the cache pruner, if running, starts cleaning the image
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# cache. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The upper limit on cache size, in bytes, after which the cache-pruner cleans
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# up the image cache.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: This is just a threshold for cache-pruner to act upon. It is NOT a
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# hard limit beyond which the image cache would never grow. In fact, depending
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# on how often the cache-pruner runs and how quickly the cache fills, the image
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# cache can far exceed the size specified here very easily. Hence, care must be
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# taken to appropriately schedule the cache-pruner and in setting this limit.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Glance caches an image when it is downloaded. Consequently, the size of the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# image cache grows over time as the number of downloads increases. To keep the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# cache size from becoming unmanageable, it is recommended to run the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# cache-pruner as a periodic task. When the cache pruner is kicked off, it
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# compares the current size of image cache and triggers a cleanup if the image
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# cache grew beyond the size specified here. After the cleanup, the size of
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# cache is less than or equal to size specified here.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Any non-negative integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #image_cache_max_size = 10737418240
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The amount of time to let an incomplete image remain in the cache,
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# before the cache cleaner, if running, will remove the incomplete
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# image. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +image_cache_max_size = 189668314316
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +os_region_name = RegionOne
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The amount of time, in seconds, an incomplete image remains in the cache.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Incomplete images are images for which download is in progress. Please see the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# description of configuration option ``image_cache_dir`` for more detail.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Sometimes, due to various reasons, it is possible the download may hang and
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the incompletely downloaded image remains in the ``incomplete`` directory.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This configuration option sets a time limit on how long the incomplete images
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# should remain in the ``incomplete`` directory before they are cleaned up.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Once an incomplete image spends more time than is specified here, it'll be
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# removed by cache-cleaner on its next run.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# It is recommended to run cache-cleaner as a periodic task on the Glance API
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# nodes to keep the incomplete images from occupying disk space.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Any non-negative integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #image_cache_stall_time = 86400
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Base directory that the image cache uses. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +image_cache_stall_time = 86400
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Base directory for image cache.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This is the location where image data is cached and served out of. All cached
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# images are stored directly under this directory. This directory also contains
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# three subdirectories, namely, ``incomplete``, ``invalid`` and ``queue``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The ``incomplete`` subdirectory is the staging area for downloading images. An
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# image is first downloaded to this directory. When the image download is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# successful it is moved to the base directory. However, if the download fails,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the partially downloaded image file is moved to the ``invalid`` subdirectory.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The ``queue``subdirectory is used for queuing images for download. This is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# used primarily by the cache-prefetcher, which can be scheduled as a periodic
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# task like cache-pruner and cache-cleaner, to cache images ahead of their
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# usage.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Upon receiving the request to cache an image, Glance touches a file in the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``queue`` directory with the image id as the file name. The cache-prefetcher,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# when running, polls for the files in ``queue`` directory and starts
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# downloading them in the order they were created. When the download is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# successful, the zero-sized file is deleted from the ``queue`` directory.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# If the download fails, the zero-sized file remains and it'll be retried the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# next time cache-prefetcher runs.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid path
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * ``image_cache_sqlite_db``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #image_cache_dir = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Address to find the registry server. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +image_cache_dir = /var/lib/glance/image-cache/
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Address the registry server is hosted on.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid IP or hostname
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #registry_host = 0.0.0.0
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Port the registry server is listening on. (port value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +registry_host = 10.167.4.10
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Port the registry server is listening on.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid port number
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (port value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Minimum value: 0
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Maximum value: 65535
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #registry_port = 9191
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Whether to pass through the user token when making requests to the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# registry. To prevent failures with token expiration during big files
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# upload, it is recommended to set this parameter to False.If
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# "use_user_token" is not in effect, then admin credentials can be
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# specified. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +registry_port = 9191
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Protocol to use for communication with the registry server.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a string value representing the protocol to use for
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# communication with the registry server. By default, this option is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# set to ``http`` and the connection is not secure.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option can be set to ``https`` to establish a secure connection
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# to the registry server. In this case, provide a key to use for the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# SSL connection using the ``registry_client_key_file`` option. Also
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# include the CA file and cert file using the options
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``registry_client_ca_file`` and ``registry_client_cert_file``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# respectively.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * http
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * https
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * registry_client_key_file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * registry_client_cert_file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * registry_client_ca_file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Allowed values: http, https
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#registry_client_protocol = http
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Absolute path to the private key file.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a string value representing a valid absolute path to the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# private key file to use for establishing a secure connection to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the registry server.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: This option must be set if ``registry_client_protocol`` is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# set to ``https``. Alternatively, the GLANCE_CLIENT_KEY_FILE
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# environment variable may be set to a filepath of the key file.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * String value representing a valid absolute path to the key
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       file.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * registry_client_protocol
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#registry_client_key_file = /etc/ssl/key/key-file.pem
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Absolute path to the certificate file.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a string value representing a valid absolute path to the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# certificate file to use for establishing a secure connection to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the registry server.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: This option must be set if ``registry_client_protocol`` is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# set to ``https``. Alternatively, the GLANCE_CLIENT_CERT_FILE
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# environment variable may be set to a filepath of the certificate
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# file.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * String value representing a valid absolute path to the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       certificate file.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * registry_client_protocol
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#registry_client_cert_file = /etc/ssl/certs/file.crt
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Absolute path to the Certificate Authority file.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a string value representing a valid absolute path to the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# certificate authority file to use for establishing a secure
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# connection to the registry server.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: This option must be set if ``registry_client_protocol`` is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# set to ``https``. Alternatively, the GLANCE_CLIENT_CA_FILE
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# environment variable may be set to a filepath of the CA file.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option is ignored if the ``registry_client_insecure`` option
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# is set to ``True``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * String value representing a valid absolute path to the CA
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       file.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * registry_client_protocol
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * registry_client_insecure
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#registry_client_ca_file = /etc/ssl/cafile/file.ca
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Set verification of the registry server certificate.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a boolean value to determine whether or not to validate
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# SSL connections to the registry server. By default, this option
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# is set to ``False`` and the SSL connections are validated.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# If set to ``True``, the connection to the registry server is not
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# validated via a certifying authority and the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``registry_client_ca_file`` option is ignored. This is the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# registry's equivalent of specifying --insecure on the command line
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# using glanceclient for the API.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * registry_client_protocol
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * registry_client_ca_file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#registry_client_insecure = false
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Timeout value for registry requests.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide an integer value representing the period of time in seconds
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# that the API server will wait for a registry request to complete.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The default value is 600 seconds.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# A value of 0 implies that a request will never timeout.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Zero
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Positive integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#registry_client_timeout = 600
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEPRECATED: Whether to pass through the user token when making requests to the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# registry. To prevent failures with token expiration during big files upload,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# it is recommended to set this parameter to False.If "use_user_token" is not in
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# effect, then admin credentials can be specified. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # This option is deprecated for removal.
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Reason: This option was considered harmful and has been deprecated
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# in M release. It will be removed in O release. For more information
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# read OSSN-0060. Related functionality with uploading big images has
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# been implemented with Keystone trusts support.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reason: This option was considered harmful and has been deprecated in M
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# release. It will be removed in O release. For more information read OSSN-0060.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related functionality with uploading big images has been implemented with
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Keystone trusts support.
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #use_user_token = true
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The administrators user name. If "use_user_token" is not in effect,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEPRECATED: The administrators user name. If "use_user_token" is not in
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# effect, then admin credentials can be specified. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reason: This option was considered harmful and has been deprecated in M
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# release. It will be removed in O release. For more information read OSSN-0060.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related functionality with uploading big images has been implemented with
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Keystone trusts support.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#admin_user = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEPRECATED: The administrators password. If "use_user_token" is not in effect,
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # then admin credentials can be specified. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # This option is deprecated for removal.
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Reason: This option was considered harmful and has been deprecated
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# in M release. It will be removed in O release. For more information
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# read OSSN-0060. Related functionality with uploading big images has
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# been implemented with Keystone trusts support.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#admin_user = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The administrators password. If "use_user_token" is not in effect,
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# then admin credentials can be specified. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reason: This option was considered harmful and has been deprecated in M
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# release. It will be removed in O release. For more information read OSSN-0060.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related functionality with uploading big images has been implemented with
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Keystone trusts support.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#admin_password = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEPRECATED: The tenant name of the administrative user. If "use_user_token" is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# not in effect, then admin tenant name can be specified. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # This option is deprecated for removal.
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Reason: This option was considered harmful and has been deprecated
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# in M release. It will be removed in O release. For more information
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# read OSSN-0060. Related functionality with uploading big images has
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# been implemented with Keystone trusts support.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#admin_password = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The tenant name of the administrative user. If "use_user_token" is
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# not in effect, then admin tenant name can be specified. (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reason: This option was considered harmful and has been deprecated in M
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# release. It will be removed in O release. For more information read OSSN-0060.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related functionality with uploading big images has been implemented with
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Keystone trusts support.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#admin_tenant_name = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEPRECATED: The URL to the keystone service. If "use_user_token" is not in
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# effect and using keystone auth, then URL of keystone can be specified. (string
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # This option is deprecated for removal.
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Reason: This option was considered harmful and has been deprecated
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# in M release. It will be removed in O release. For more information
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# read OSSN-0060. Related functionality with uploading big images has
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# been implemented with Keystone trusts support.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#admin_tenant_name = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The URL to the keystone service. If "use_user_token" is not in
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# effect and using keystone auth, then URL of keystone can be
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# specified. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# This option is deprecated for removal.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Reason: This option was considered harmful and has been deprecated
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# in M release. It will be removed in O release. For more information
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# read OSSN-0060. Related functionality with uploading big images has
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# been implemented with Keystone trusts support.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reason: This option was considered harmful and has been deprecated in M
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# release. It will be removed in O release. For more information read OSSN-0060.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related functionality with uploading big images has been implemented with
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Keystone trusts support.
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #auth_url = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The strategy to use for authentication. If "use_user_token" is not
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEPRECATED: The strategy to use for authentication. If "use_user_token" is not
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # in effect, then auth strategy can be specified. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # This option is deprecated for removal.
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Reason: This option was considered harmful and has been deprecated
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# in M release. It will be removed in O release. For more information
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# read OSSN-0060. Related functionality with uploading big images has
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# been implemented with Keystone trusts support.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reason: This option was considered harmful and has been deprecated in M
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# release. It will be removed in O release. For more information read OSSN-0060.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related functionality with uploading big images has been implemented with
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Keystone trusts support.
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #auth_strategy = noauth
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The region for the authentication service. If "use_user_token" is
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# not in effect and using keystone auth, then region name can be
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# specified. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEPRECATED: The region for the authentication service. If "use_user_token" is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# not in effect and using keystone auth, then region name can be specified.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # This option is deprecated for removal.
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Reason: This option was considered harmful and has been deprecated
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# in M release. It will be removed in O release. For more information
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# read OSSN-0060. Related functionality with uploading big images has
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# been implemented with Keystone trusts support.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reason: This option was considered harmful and has been deprecated in M
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# release. It will be removed in O release. For more information read OSSN-0060.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related functionality with uploading big images has been implemented with
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Keystone trusts support.
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #auth_region = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # From oslo.log
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# If set to true, the logging level will be set to DEBUG instead of
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# the default INFO level. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# If set to true, the logging level will be set to DEBUG instead of the default
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# INFO level. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Note: This option can be changed without restarting.
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #debug = false
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# If set to false, the logging level will be set to WARNING instead of
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# the default INFO level. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEPRECATED: If set to false, the logging level will be set to WARNING instead
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# of the default INFO level. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # This option is deprecated for removal.
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #verbose = true
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The name of a logging configuration file. This file is appended to
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# any existing logging configuration files. For details about logging
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# configuration files, see the Python logging module documentation.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Note that when logging configuration files are used then all logging
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# configuration is set in the configuration file and other logging
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# configuration options are ignored (for example,
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# logging_context_format_string). (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The name of a logging configuration file. This file is appended to any
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# existing logging configuration files. For details about logging configuration
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# files, see the Python logging module documentation. Note that when logging
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# configuration files are used then all logging configuration is set in the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# configuration file and other logging configuration options are ignored (for
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# example, logging_context_format_string). (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Note: This option can be changed without restarting.
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/log_config
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #log_config_append = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Defines the format string for %%(asctime)s in log records. Default:
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# %(default)s . This option is ignored if log_config_append is set.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# %(default)s . This option is ignored if log_config_append is set. (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #log_date_format = %Y-%m-%d %H:%M:%S
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (Optional) Name of log file to send logging output to. If no default
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# is set, logging will go to stderr as defined by use_stderr. This
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# option is ignored if log_config_append is set. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# (Optional) Name of log file to send logging output to. If no default is set,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# logging will go to stderr as defined by use_stderr. This option is ignored if
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# log_config_append is set. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/logfile
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #log_file = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (Optional) The base directory used for relative log_file  paths.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# This option is ignored if log_config_append is set. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +log_file = /var/log/glance/image-cache.log
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# (Optional) The base directory used for relative log_file  paths. This option
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# is ignored if log_config_append is set. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/logdir
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #log_dir = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Uses logging handler designed to watch file system. When log file is
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# moved or removed this handler will open a new log file with
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# specified path instantaneously. It makes sense only if log_file
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# option is specified and Linux platform is used. This option is
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# ignored if log_config_append is set. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Uses logging handler designed to watch file system. When log file is moved or
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# removed this handler will open a new log file with specified path
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# instantaneously. It makes sense only if log_file option is specified and Linux
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# platform is used. This option is ignored if log_config_append is set. (boolean
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #watch_log_file = false
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Use syslog for logging. Existing syslog format is DEPRECATED and
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# will be changed later to honor RFC5424. This option is ignored if
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# log_config_append is set. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Use syslog for logging. Existing syslog format is DEPRECATED and will be
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# changed later to honor RFC5424. This option is ignored if log_config_append is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# set. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #use_syslog = false
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Syslog facility to receive log lines. This option is ignored if
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # log_config_append is set. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #syslog_log_facility = LOG_USER
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Log output to standard error. This option is ignored if
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# log_config_append is set. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Log output to standard error. This option is ignored if log_config_append is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# set. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #use_stderr = true
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Format string to use for log messages with context. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #logging_context_format_string = %(asctime)s.%(msecs)03d %(process)d %(levelname)s %(name)s [%(request_id)s %(user_identity)s] %(instance)s%(message)s
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Format string to use for log messages when context is undefined.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Format string to use for log messages when context is undefined. (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #logging_default_format_string = %(asctime)s.%(msecs)03d %(process)d %(levelname)s %(name)s [-] %(instance)s%(message)s
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Additional data to append to log message when logging level for the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# message is DEBUG. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Additional data to append to log message when logging level for the message is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEBUG. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #logging_debug_format_suffix = %(funcName)s %(pathname)s:%(lineno)d
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Prefix each line of exception output with this format. (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Prefix each line of exception output with this format. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #logging_exception_prefix = %(asctime)s.%(msecs)03d %(process)d ERROR %(name)s %(instance)s
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Defines the format string for %(user_identity)s that is used in
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # logging_context_format_string. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# List of package logging levels in logger=LEVEL pairs. This option is
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# ignored if log_config_append is set. (list value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# List of package logging levels in logger=LEVEL pairs. This option is ignored
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# if log_config_append is set. (list value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #default_log_levels = amqp=WARN,amqplib=WARN,boto=WARN,qpid=WARN,sqlalchemy=WARN,suds=INFO,oslo.messaging=INFO,iso8601=WARN,requests.packages.urllib3.connectionpool=WARN,urllib3.connectionpool=WARN,websocket=WARN,requests.packages.urllib3.util.retry=WARN,urllib3.util.retry=WARN,keystonemiddleware=WARN,routes.middleware=WARN,stevedore=WARN,taskflow=WARN,keystoneauth=WARN,oslo.cache=INFO,dogpile.core.dogpile=INFO
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Enables or disables publication of error events. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #publish_errors = false
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The format for an instance that is passed with the log message.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The format for an instance that is passed with the log message. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #instance_format = "[instance: %(uuid)s] "
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The format for an instance UUID that is passed with the log message.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The format for an instance UUID that is passed with the log message. (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #instance_uuid_format = "[instance: %(uuid)s] "
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Enables or disables fatal status of deprecations. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #fatal_deprecations = false
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +[glance_store]
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# From glance.store
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# List of enabled Glance stores.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Register the storage backends to use for storing disk images
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# as a comma separated list. The default stores enabled for
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# storing disk images with Glance are ``file`` and ``http``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A comma separated list that could include:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#         * file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#         * http
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#         * swift
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#         * rbd
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#         * sheepdog
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#         * cinder
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#         * vmware
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related Options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * default_store
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (list value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#stores = file,http
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The default scheme to use for storing images.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a string value representing the default scheme to use for
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# storing images. If not set, Glance uses ``file`` as the default
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# scheme to store images with the ``file`` store.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: The value given for this configuration option must be a valid
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# scheme for a store registered with the ``stores`` configuration
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# option.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * filesystem
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * http
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * https
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * swift
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * swift+http
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * swift+https
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * swift+config
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * rbd
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * sheepdog
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * vsphere
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related Options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * stores
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Allowed values: file, filesystem, http, https, swift, swift+http, swift+https, swift+config, rbd, sheepdog, cinder, vsphere
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#default_store = file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum interval in seconds to execute updating dynamic storage
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# capabilities based on current backend status.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide an integer value representing time in seconds to set the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# minimum interval before an update of dynamic storage capabilities
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# for a storage backend can be attempted. Setting
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``store_capabilities_update_min_interval`` does not mean updates
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# occur periodically based on the set interval. Rather, the update
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# is performed at the elapse of this interval set, if an operation
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# of the store is triggered.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# By default, this option is set to zero and is disabled. Provide an
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# integer value greater than zero to enable this option.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: For more information on store capabilities and their updates,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# please visit: https://specs.openstack.org/openstack/glance-specs/specs/kilo
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# /store-capabilities.html
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# For more information on setting up a particular store in your
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# deplyment and help with the usage of this feature, please contact
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the storage driver maintainers listed here:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# http://docs.openstack.org/developer/glance_store/drivers/index.html
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Zero
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Positive integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related Options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#store_capabilities_update_min_interval = 0
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Information to match when looking for cinder in the service catalog.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When the ``cinder_endpoint_template`` is not set and any of
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``cinder_store_auth_address``, ``cinder_store_user_name``,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``cinder_store_project_name``, ``cinder_store_password`` is not set,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# cinder store uses this information to lookup cinder endpoint from the service
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# catalog in the current context. ``cinder_os_region_name``, if set, is taken
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# into consideration to fetch the appropriate endpoint.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The service catalog can be listed by the ``openstack catalog list`` command.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A string of of the following form:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       ``<service_type>:<service_name>:<endpoint_type>``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       At least ``service_type`` and ``endpoint_type`` should be specified.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       ``service_name`` can be omitted.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_os_region_name
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_endpoint_template
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_store_auth_address
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_store_user_name
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_store_project_name
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_store_password
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#cinder_catalog_info = volumev2::publicURL
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Override service catalog lookup with template for cinder endpoint.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When this option is set, this value is used to generate cinder endpoint,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# instead of looking up from the service catalog.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This value is ignored if ``cinder_store_auth_address``,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``cinder_store_user_name``, ``cinder_store_project_name``, and
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``cinder_store_password`` are specified.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# If this configuration option is set, ``cinder_catalog_info`` will be ignored.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * URL template string for cinder endpoint, where ``%%(tenant)s`` is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       replaced with the current tenant (project) name.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       For example: ``http://cinder.openstack.example.org/v2/%%(tenant)s``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_store_auth_address
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_store_user_name
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_store_project_name
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_store_password
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_catalog_info
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#cinder_endpoint_template = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Region name to lookup cinder service from the service catalog.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This is used only when ``cinder_catalog_info`` is used for determining the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# endpoint. If set, the lookup for cinder endpoint by this node is filtered to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the specified region. It is useful when multiple regions are listed in the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# catalog. If this is not set, the endpoint is looked up from every region.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A string that is a valid region name.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_catalog_info
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [glance_store]/os_region_name
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#cinder_os_region_name = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Location of a CA certificates file used for cinder client requests.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The specified CA certificates file, if set, is used to verify cinder
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# connections via HTTPS endpoint. If the endpoint is HTTP, this value is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ignored.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``cinder_api_insecure`` must be set to ``True`` to enable the verification.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Path to a ca certificates file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_api_insecure
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#cinder_ca_certificates_file = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Number of cinderclient retries on failed http calls.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When a call failed by any errors, cinderclient will retry the call up to the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# specified times after sleeping a few seconds.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A positive integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#cinder_http_retries = 3
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Time period, in seconds, to wait for a cinder volume transition to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# complete.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When the cinder volume is created, deleted, or attached to the glance node to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# read/write the volume data, the volume's state is changed. For example, the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# newly created volume status changes from ``creating`` to ``available`` after
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the creation process is completed. This specifies the maximum time to wait for
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the status change. If a timeout occurs while waiting, or the status is changed
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# to an unexpected value (e.g. `error``), the image creation fails.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A positive integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#cinder_state_transition_timeout = 300
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Allow to perform insecure SSL requests to cinder.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# If this option is set to True, HTTPS endpoint connection is verified using the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# CA certificates file specified by ``cinder_ca_certificates_file`` option.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_ca_certificates_file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#cinder_api_insecure = false
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The address where the cinder authentication service is listening.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When all of ``cinder_store_auth_address``, ``cinder_store_user_name``,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``cinder_store_project_name``, and ``cinder_store_password`` options are
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# specified, the specified values are always used for the authentication.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This is useful to hide the image volumes from users by storing them in a
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# project/tenant specific to the image service. It also enables users to share
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the image volume among other projects under the control of glance's ACL.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# If either of these options are not set, the cinder endpoint is looked up
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# from the service catalog, and current context's user and project are used.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid authentication service address, for example:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       ``http://openstack.example.org/identity/v2.0``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_store_user_name
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_store_password
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_store_project_name
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#cinder_store_auth_address = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# User name to authenticate against cinder.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This must be used with all the following related options. If any of these are
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# not specified, the user of the current context is used.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid user name
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_store_auth_address
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_store_password
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_store_project_name
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#cinder_store_user_name = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Password for the user authenticating against cinder.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This must be used with all the following related options. If any of these are
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# not specified, the user of the current context is used.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid password for the user specified by ``cinder_store_user_name``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_store_auth_address
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_store_user_name
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_store_project_name
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#cinder_store_password = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Project name where the image volume is stored in cinder.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# If this configuration option is not set, the project in current context is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# used.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This must be used with all the following related options. If any of these are
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# not specified, the project of the current context is used.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid project name
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * ``cinder_store_auth_address``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * ``cinder_store_user_name``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * ``cinder_store_password``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#cinder_store_project_name = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Path to the rootwrap configuration file to use for running commands as root.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The cinder store requires root privileges to operate the image volumes (for
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# connecting to iSCSI/FC volumes and reading/writing the volume data, etc.).
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The configuration file should allow the required commands by cinder store and
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# os-brick library.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Path to the rootwrap config file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#rootwrap_config = /etc/glance/rootwrap.conf
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Directory to which the filesystem backend store writes images.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Upon start up, Glance creates the directory if it doesn't already
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# exist and verifies write access to the user under which
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``glance-api`` runs. If the write access isn't available, a
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``BadStoreConfiguration`` exception is raised and the filesystem
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# store may not be available for adding new images.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: This directory is used only when filesystem store is used as a
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# storage backend. Either ``filesystem_store_datadir`` or
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``filesystem_store_datadirs`` option must be specified in
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``glance-api.conf``. If both options are specified, a
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``BadStoreConfiguration`` will be raised and the filesystem store
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# may not be available for adding new images.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid path to a directory
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * ``filesystem_store_datadirs``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * ``filesystem_store_file_perm``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#filesystem_store_datadir = /var/lib/glance/images
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# List of directories and their priorities to which the filesystem
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# backend store writes images.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The filesystem store can be configured to store images in multiple
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# directories as opposed to using a single directory specified by the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``filesystem_store_datadir`` configuration option. When using
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# multiple directories, each directory can be given an optional
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# priority to specify the preference order in which they should
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# be used. Priority is an integer that is concatenated to the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# directory path with a colon where a higher value indicates higher
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# priority. When two directories have the same priority, the directory
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# with most free space is used. When no priority is specified, it
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# defaults to zero.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# More information on configuring filesystem store with multiple store
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# directories can be found at
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# http://docs.openstack.org/developer/glance/configuring.html
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: This directory is used only when filesystem store is used as a
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# storage backend. Either ``filesystem_store_datadir`` or
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``filesystem_store_datadirs`` option must be specified in
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``glance-api.conf``. If both options are specified, a
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``BadStoreConfiguration`` will be raised and the filesystem store
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# may not be available for adding new images.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * List of strings of the following form:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#         * ``<a valid directory path>:<optional integer priority>``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * ``filesystem_store_datadir``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * ``filesystem_store_file_perm``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (multi valued)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#filesystem_store_datadirs =
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Filesystem store metadata file.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The path to a file which contains the metadata to be returned with
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# any location associated with the filesystem store. The file must
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# contain a valid JSON object. The object should contain the keys
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``id`` and ``mountpoint``. The value for both keys should be a
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# string.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid path to the store metadata file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# File access permissions for the image files.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Set the intended file access permissions for image data. This provides
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# a way to enable other services, e.g. Nova, to consume images directly
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# from the filesystem store. The users running the services that are
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# intended to be given access to could be made a member of the group
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# that owns the files created. Assigning a value less then or equal to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# zero for this configuration option signifies that no changes be made
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# to the  default permissions. This value will be decoded as an octal
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# digit.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# For more information, please refer the documentation at
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# http://docs.openstack.org/developer/glance/configuring.html
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid file access permission
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Zero
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Any negative integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#filesystem_store_file_perm = 0
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Path to the CA bundle file.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This configuration option enables the operator to use a custom
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Certificate Authority file to verify the remote server certificate. If
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# this option is set, the ``https_insecure`` option will be ignored and
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the CA file specified will be used to authenticate the server
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# certificate and establish a secure connection to the server.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid path to a CA file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * https_insecure
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#https_ca_certificates_file = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Set verification of the remote server certificate.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This configuration option takes in a boolean value to determine
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# whether or not to verify the remote server certificate. If set to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# True, the remote server certificate is not verified. If the option is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# set to False, then the default CA truststore is used for verification.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option is ignored if ``https_ca_certificates_file`` is set.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The remote server certificate will then be verified using the file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# specified using the ``https_ca_certificates_file`` option.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * https_ca_certificates_file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#https_insecure = true
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The http/https proxy information to be used to connect to the remote
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# server.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This configuration option specifies the http/https proxy information
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# that should be used to connect to the remote server. The proxy
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# information should be a key value pair of the scheme and proxy, for
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# example, http:10.0.0.1:3128. You can also specify proxies for multiple
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# schemes by separating the key value pairs with a comma, for example,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# http:10.0.0.1:3128, https:10.0.0.1:1080.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A comma separated list of scheme:proxy pairs as described above
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (dict value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#http_proxy_information =
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Size, in megabytes, to chunk RADOS images into.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide an integer value representing the size in megabytes to chunk
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Glance images into. The default chunk size is 8 megabytes. For optimal
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# performance, the value should be a power of two.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When Ceph's RBD object storage system is used as the storage backend
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# for storing Glance images, the images are chunked into objects of the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# size set using this option. These chunked objects are then stored
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# across the distributed block data store to use for Glance.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible Values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Any positive integer value
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#rbd_store_chunk_size = 8
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# RADOS pool in which images are stored.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When RBD is used as the storage backend for storing Glance images, the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# images are stored by means of logical grouping of the objects (chunks
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# of images) into a ``pool``. Each pool is defined with the number of
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# placement groups it can contain. The default pool that is used is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# 'images'.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# More information on the RBD storage backend can be found here:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# http://ceph.com/planet/how-data-is-stored-in-ceph-cluster/
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible Values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid pool name
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#rbd_store_pool = images
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# RADOS user to authenticate as.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This configuration option takes in the RADOS user to authenticate as.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This is only needed when RADOS authentication is enabled and is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# applicable only if the user is using Cephx authentication. If the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# value for this option is not set by the user or is set to None, a
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# default value will be chosen, which will be based on the client.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# section in rbd_store_ceph_conf.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible Values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid RADOS user
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * rbd_store_ceph_conf
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#rbd_store_user = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Ceph configuration file path.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This configuration option takes in the path to the Ceph configuration
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# file to be used. If the value for this option is not set by the user
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# or is set to None, librados will locate the default configuration file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# which is located at /etc/ceph/ceph.conf. If using Cephx
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# authentication, this file should include a reference to the right
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# keyring in a client.<USER> section
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible Values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid path to a configuration file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * rbd_store_user
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#rbd_store_ceph_conf = /etc/ceph/ceph.conf
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Timeout value for connecting to Ceph cluster.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This configuration option takes in the timeout value in seconds used
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# when connecting to the Ceph cluster i.e. it sets the time to wait for
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# glance-api before closing the connection. This prevents glance-api
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# hangups during the connection to RBD. If the value for this option
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# is set to less than or equal to 0, no timeout is set and the default
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# librados value is used.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible Values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Any integer value
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#rados_connect_timeout = 0
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Chunk size for images to be stored in Sheepdog data store.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide an integer value representing the size in mebibyte
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# (1048576 bytes) to chunk Glance images into. The default
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# chunk size is 64 mebibytes.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When using Sheepdog distributed storage system, the images are
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# chunked into objects of this size and then stored across the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# distributed data store to use for Glance.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Chunk sizes, if a power of two, help avoid fragmentation and
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# enable improved performance.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Positive integer value representing size in mebibytes.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related Options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#sheepdog_store_chunk_size = 64
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Port number on which the sheep daemon will listen.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide an integer value representing a valid port number on
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# which you want the Sheepdog daemon to listen on. The default
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# port is 7000.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The Sheepdog daemon, also called 'sheep', manages the storage
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# in the distributed cluster by writing objects across the storage
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# network. It identifies and acts on the messages it receives on
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the port number set using ``sheepdog_store_port`` option to store
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# chunks of Glance images.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid port number (0 to 65535)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related Options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * sheepdog_store_address
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (port value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Maximum value: 65535
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#sheepdog_store_port = 7000
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Address to bind the Sheepdog daemon to.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a string value representing the address to bind the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Sheepdog daemon to. The default address set for the 'sheep'
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# is 127.0.0.1.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The Sheepdog daemon, also called 'sheep', manages the storage
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# in the distributed cluster by writing objects across the storage
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# network. It identifies and acts on the messages directed to the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# address set using ``sheepdog_store_address`` option to store
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# chunks of Glance images.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid IPv4 address
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid IPv6 address
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid hostname
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related Options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * sheepdog_store_port
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#sheepdog_store_address = 127.0.0.1
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Set verification of the server certificate.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This boolean determines whether or not to verify the server
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# certificate. If this option is set to True, swiftclient won't check
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# for a valid SSL certificate when authenticating. If the option is set
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# to False, then the default CA truststore is used for verification.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * swift_store_cacert
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#swift_store_auth_insecure = false
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Path to the CA bundle file.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This configuration option enables the operator to specify the path to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# a custom Certificate Authority file for SSL verification when
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# connecting to Swift.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid path to a CA file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * swift_store_auth_insecure
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#swift_store_cacert = /etc/ssl/certs/ca-certificates.crt
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The region of Swift endpoint to use by Glance.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a string value representing a Swift region where Glance
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# can connect to for image storage. By default, there is no region
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# set.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When Glance uses Swift as the storage backend to store images
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# for a specific tenant that has multiple endpoints, setting of a
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Swift region with ``swift_store_region`` allows Glance to connect
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# to Swift in the specified region as opposed to a single region
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# connectivity.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option can be configured for both single-tenant and
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# multi-tenant storage.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: Setting the region with ``swift_store_region`` is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# tenant-specific and is necessary ``only if`` the tenant has
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# multiple endpoints across different regions.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A string value representing a valid Swift region.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related Options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#swift_store_region = RegionTwo
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The URL endpoint to use for Swift backend storage.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a string value representing the URL endpoint to use for
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# storing Glance images in Swift store. By default, an endpoint
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# is not set and the storage URL returned by ``auth`` is used.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Setting an endpoint with ``swift_store_endpoint`` overrides the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# storage URL and is used for Glance image storage.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: The URL should include the path up to, but excluding the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# container. The location of an object is obtained by appending
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the container and object to the configured URL.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * String value representing a valid URL path up to a Swift container
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related Options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#swift_store_endpoint = https://swift.openstack.example.org/v1/path_not_including_container_name
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Endpoint Type of Swift service.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This string value indicates the endpoint type to use to fetch the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Swift endpoint. The endpoint type determines the actions the user will
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# be allowed to perform, for instance, reading and writing to the Store.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This setting is only used if swift_store_auth_version is greater than
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# 1.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * publicURL
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * adminURL
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * internalURL
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * swift_store_endpoint
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Allowed values: publicURL, adminURL, internalURL
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#swift_store_endpoint_type = publicURL
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Type of Swift service to use.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a string value representing the service type to use for
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# storing images while using Swift backend storage. The default
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# service type is set to ``object-store``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: If ``swift_store_auth_version`` is set to 2, the value for
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# this configuration option needs to be ``object-store``. If using
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# a higher version of Keystone or a different auth scheme, this
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# option may be modified.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A string representing a valid service type for Swift storage.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related Options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#swift_store_service_type = object-store
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Name of single container to store images/name prefix for multiple containers
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When a single container is being used to store images, this configuration
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# option indicates the container within the Glance account to be used for
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# storing all images. When multiple containers are used to store images, this
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# will be the name prefix for all containers. Usage of single/multiple
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# containers can be controlled using the configuration option
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``swift_store_multiple_containers_seed``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When using multiple containers, the containers will be named after the value
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# set for this configuration option with the first N chars of the image UUID
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# as the suffix delimited by an underscore (where N is specified by
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``swift_store_multiple_containers_seed``).
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Example: if the seed is set to 3 and swift_store_container = ``glance``, then
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# an image with UUID ``fdae39a1-bac5-4238-aba4-69bcc726e848`` would be placed in
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the container ``glance_fda``. All dashes in the UUID are included when
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# creating the container name but do not count toward the character limit, so
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# when N=10 the container name would be ``glance_fdae39a1-ba.``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * If using single container, this configuration option can be any string
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       that is a valid swift container name in Glance's Swift account
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * If using multiple containers, this configuration option can be any
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       string as long as it satisfies the container naming rules enforced by
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       Swift. The value of ``swift_store_multiple_containers_seed`` should be
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       taken into account as well.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * ``swift_store_multiple_containers_seed``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * ``swift_store_multi_tenant``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * ``swift_store_create_container_on_put``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#swift_store_container = glance
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The size threshold, in MB, after which Glance will start segmenting image
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# data.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Swift has an upper limit on the size of a single uploaded object. By default,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# this is 5GB. To upload objects bigger than this limit, objects are segmented
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# into multiple smaller objects that are tied together with a manifest file.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# For more detail, refer to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# http://docs.openstack.org/developer/swift/overview_large_objects.html
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This configuration option specifies the size threshold over which the Swift
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# driver will start segmenting image data into multiple smaller files.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Currently, the Swift driver only supports creating Dynamic Large Objects.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: This should be set by taking into account the large object limit
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# enforced by the Swift cluster in consideration.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A positive integer that is less than or equal to the large object limit
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       enforced by the Swift cluster in consideration.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * ``swift_store_large_object_chunk_size``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#swift_store_large_object_size = 5120
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The maximum size, in MB, of the segments when image data is segmented.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When image data is segmented to upload images that are larger than the limit
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# enforced by the Swift cluster, image data is broken into segments that are no
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# bigger than the size specified by this configuration option.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Refer to ``swift_store_large_object_size`` for more detail.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# For example: if ``swift_store_large_object_size`` is 5GB and
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``swift_store_large_object_chunk_size`` is 1GB, an image of size 6.2GB will be
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# segmented into 7 segments where the first six segments will be 1GB in size and
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the seventh segment will be 0.2GB.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A positive integer that is less than or equal to the large object limit
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       enforced by Swift cluster in consideration.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * ``swift_store_large_object_size``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#swift_store_large_object_chunk_size = 200
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Create container, if it doesn't already exist, when uploading image.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# At the time of uploading an image, if the corresponding container doesn't
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# exist, it will be created provided this configuration option is set to True.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# By default, it won't be created. This behavior is applicable for both single
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# and multiple containers mode.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#swift_store_create_container_on_put = false
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Store images in tenant's Swift account.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This enables multi-tenant storage mode which causes Glance images to be stored
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# in tenant specific Swift accounts. If this is disabled, Glance stores all
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# images in its own account. More details multi-tenant store can be found at
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# https://wiki.openstack.org/wiki/GlanceSwiftTenantSpecificStorage
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#swift_store_multi_tenant = false
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Seed indicating the number of containers to use for storing images.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When using a single-tenant store, images can be stored in one or more than one
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# containers. When set to 0, all images will be stored in one single container.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When set to an integer value between 1 and 32, multiple containers will be
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# used to store images. This configuration option will determine how many
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# containers are created. The total number of containers that will be used is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# equal to 16^N, so if this config option is set to 2, then 16^2=256 containers
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# will be used to store images.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Please refer to ``swift_store_container`` for more detail on the naming
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# convention. More detail about using multiple containers can be found at
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# https://specs.openstack.org/openstack/glance-specs/specs/kilo/swift-store-
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# multiple-containers.html
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: This is used only when swift_store_multi_tenant is disabled.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A non-negative integer less than or equal to 32
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * ``swift_store_container``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * ``swift_store_multi_tenant``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * ``swift_store_create_container_on_put``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Maximum value: 32
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#swift_store_multiple_containers_seed = 0
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# List of tenants that will be granted admin access.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This is a list of tenants that will be granted read/write access on
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# all Swift containers created by Glance in multi-tenant mode. The
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# default value is an empty list.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A comma separated list of strings representing UUIDs of Keystone
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       projects/tenants
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (list value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#swift_store_admin_tenants =
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# SSL layer compression for HTTPS Swift requests.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a boolean value to determine whether or not to compress
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# HTTPS Swift requests for images at the SSL layer. By default,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# compression is enabled.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When using Swift as the backend store for Glance image storage,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# SSL layer compression of HTTPS Swift requests can be set using
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# this option. If set to False, SSL layer compression of HTTPS
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Swift requests is disabled. Disabling this option may improve
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# performance for images which are already in a compressed format,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# for example, qcow2.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related Options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#swift_store_ssl_compression = true
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The number of times a Swift download will be retried before the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# request fails.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide an integer value representing the number of times an image
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# download must be retried before erroring out. The default value is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# zero (no retry on a failed image download). When set to a positive
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# integer value, ``swift_store_retry_get_count`` ensures that the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# download is attempted this many more times upon a download failure
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# before sending an error message.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Zero
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Positive integer value
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related Options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#swift_store_retry_get_count = 0
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Time in seconds defining the size of the window in which a new
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# token may be requested before the current token is due to expire.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Typically, the Swift storage driver fetches a new token upon the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# expiration of the current token to ensure continued access to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Swift. However, some Swift transactions (like uploading image
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# segments) may not recover well if the token expires on the fly.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Hence, by fetching a new token before the current token expiration,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# we make sure that the token does not expire or is close to expiry
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# before a transaction is attempted. By default, the Swift storage
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# driver requests for a new token 60 seconds or less before the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# current token expiration.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Zero
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Positive integer value
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related Options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#swift_store_expire_soon_interval = 60
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Use trusts for multi-tenant Swift store.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option instructs the Swift store to create a trust for each
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# add/get request when the multi-tenant store is in use. Using trusts
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# allows the Swift store to avoid problems that can be caused by an
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# authentication token expiring during the upload or download of data.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# By default, ``swift_store_use_trusts`` is set to ``True``(use of
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# trusts is enabled). If set to ``False``, a user token is used for
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the Swift connection instead, eliminating the overhead of trust
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# creation.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: This option is considered only when
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``swift_store_multi_tenant`` is set to ``True``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * swift_store_multi_tenant
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#swift_store_use_trusts = true
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reference to default Swift account/backing store parameters.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a string value representing a reference to the default set
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# of parameters required for using swift account/backing store for
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# image storage. The default reference value for this configuration
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# option is 'ref1'. This configuration option dereferences the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# parameters and facilitates image storage in Swift storage backend
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# every time a new image is added.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid string value
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#default_swift_reference = ref1
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEPRECATED: Version of the authentication service to use. Valid versions are 2
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# and 3 for keystone and 1 (deprecated) for swauth and rackspace. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reason:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The option 'auth_version' in the Swift back-end configuration file is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# used instead.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#swift_store_auth_version = 2
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEPRECATED: The address where the Swift authentication service is listening.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reason:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The option 'auth_address' in the Swift back-end configuration file is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# used instead.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#swift_store_auth_address = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEPRECATED: The user to authenticate against the Swift authentication service.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reason:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The option 'user' in the Swift back-end configuration file is set instead.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#swift_store_user = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEPRECATED: Auth key for the user authenticating against the Swift
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# authentication service. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reason:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The option 'key' in the Swift back-end configuration file is used
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# to set the authentication key instead.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#swift_store_key = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Absolute path to the file containing the swift account(s)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# configurations.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Include a string value representing the path to a configuration
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# file that has references for each of the configured Swift
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# account(s)/backing stores. By default, no file path is specified
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# and customized Swift referencing is disabled. Configuring this
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# option is highly recommended while using Swift storage backend for
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# image storage as it avoids storage of credentials in the database.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * String value representing an absolute path on the glance-api
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       node
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#swift_store_config_file = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Address of the ESX/ESXi or vCenter Server target system.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This configuration option sets the address of the ESX/ESXi or vCenter
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Server target system. This option is required when using the VMware
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# storage backend. The address can contain an IP address (127.0.0.1) or
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# a DNS name (www.my-domain.com).
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible Values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid IPv4 or IPv6 address
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid DNS name
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * vmware_server_username
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * vmware_server_password
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#vmware_server_host = 127.0.0.1
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Server username.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This configuration option takes the username for authenticating with
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the VMware ESX/ESXi or vCenter Server. This option is required when
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# using the VMware storage backend.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible Values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Any string that is the username for a user with appropriate
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       privileges
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * vmware_server_host
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * vmware_server_password
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#vmware_server_username = root
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Server password.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This configuration option takes the password for authenticating with
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the VMware ESX/ESXi or vCenter Server. This option is required when
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# using the VMware storage backend.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible Values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Any string that is a password corresponding to the username
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       specified using the "vmware_server_username" option
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * vmware_server_host
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * vmware_server_username
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#vmware_server_password = vmware
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The number of VMware API retries.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This configuration option specifies the number of times the VMware
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ESX/VC server API must be retried upon connection related issues or
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# server API call overload. It is not possible to specify 'retry
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# forever'.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible Values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Any positive integer value
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#vmware_api_retry_count = 10
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Interval in seconds used for polling remote tasks invoked on VMware
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ESX/VC server.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This configuration option takes in the sleep time in seconds for polling an
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# on-going async task as part of the VMWare ESX/VC server API call.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible Values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Any positive integer value
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#vmware_task_poll_interval = 5
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The directory where the glance images will be stored in the datastore.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This configuration option specifies the path to the directory where the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# glance images will be stored in the VMware datastore. If this option
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# is not set,  the default directory where the glance images are stored
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# is openstack_glance.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible Values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Any string that is a valid path to a directory
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#vmware_store_image_dir = /openstack_glance
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Set verification of the ESX/vCenter server certificate.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This configuration option takes a boolean value to determine
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# whether or not to verify the ESX/vCenter server certificate. If this
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# option is set to True, the ESX/vCenter server certificate is not
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# verified. If this option is set to False, then the default CA
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# truststore is used for verification.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option is ignored if the "vmware_ca_file" option is set. In that
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# case, the ESX/vCenter server certificate will then be verified using
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the file specified using the "vmware_ca_file" option .
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible Values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * vmware_ca_file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [glance_store]/vmware_api_insecure
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#vmware_insecure = false
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Absolute path to the CA bundle file.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This configuration option enables the operator to use a custom
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Cerificate Authority File to verify the ESX/vCenter certificate.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# If this option is set, the "vmware_insecure" option will be ignored
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# and the CA file specified will be used to authenticate the ESX/vCenter
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# server certificate and establish a secure connection to the server.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible Values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Any string that is a valid absolute path to a CA file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * vmware_insecure
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#vmware_ca_file = /etc/ssl/certs/ca-certificates.crt
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The datastores where the image can be stored.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This configuration option specifies the datastores where the image can
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# be stored in the VMWare store backend. This option may be specified
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# multiple times for specifying multiple datastores. The datastore name
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# should be specified after its datacenter path, separated by ":". An
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# optional weight may be given after the datastore name, separated again
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# by ":" to specify the priority. Thus, the required format becomes
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# <datacenter_path>:<datastore_name>:<optional_weight>.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When adding an image, the datastore with highest weight will be
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# selected, unless there is not enough free space available in cases
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# where the image size is already known. If no weight is given, it is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# assumed to be zero and the directory will be considered for selection
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# last. If multiple datastores have the same weight, then the one with
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the most free space available is selected.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible Values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Any string of the format:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       <datacenter_path>:<datastore_name>:<optional_weight>
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#    * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (multi valued)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#vmware_datastores =
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +os_region_name = RegionOne
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  [oslo_policy]
Sep 28 11:21:28 ctl02 salt-minion[14967]: @@ -311,15 +2295,14 @@
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/policy_file
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #policy_file = policy.json
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Default rule. Enforced when a requested rule is not found. (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Default rule. Enforced when a requested rule is not found. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/policy_default_rule
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #policy_default_rule = default
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Directories where policy configuration files are stored. They can be
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# relative to any directory in the search path defined by the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# config_dir option, or absolute paths. The file defined by
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# policy_file must exist for these directories to be searched.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Missing or empty directories are ignored. (multi valued)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Directories where policy configuration files are stored. They can be relative
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# to any directory in the search path defined by the config_dir option, or
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# absolute paths. The file defined by policy_file must exist for these
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# directories to be searched.  Missing or empty directories are ignored. (multi
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# valued)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/policy_dirs
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #policy_dirs = policy.d
Sep 28 11:21:28 ctl02 salt-minion[14967]: [INFO    ] Completed state [/etc/glance/glance-cache.conf] at time 11:21:28.608979 duration_in_ms=88.98
Sep 28 11:21:28 ctl02 salt-minion[14967]: [INFO    ] Running state [/etc/glance/glance-registry.conf] at time 11:21:28.609301
Sep 28 11:21:28 ctl02 salt-minion[14967]: [INFO    ] Executing state file.managed for /etc/glance/glance-registry.conf
Sep 28 11:21:28 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'glance/files/ocata/glance-registry.conf.Debian'
Sep 28 11:21:28 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'glance/map.jinja'
Sep 28 11:21:28 ctl02 salt-minion[14967]: [INFO    ] File changed:
Sep 28 11:21:28 ctl02 salt-minion[14967]: ---
Sep 28 11:21:28 ctl02 salt-minion[14967]: +++
Sep 28 11:21:28 ctl02 salt-minion[14967]: @@ -1,267 +1,892 @@
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]:  [DEFAULT]
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # From glance.registry
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# When true, this option sets the owner of an image to be the tenant.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Otherwise, the owner of the  image will be the authenticated user
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# issuing the request. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Set the image owner to tenant or the authenticated user.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Assign a boolean value to determine the owner of an image. When set to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# True, the owner of the image is the tenant. When set to False, the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# owner of the image will be the authenticated user issuing the request.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Setting it to False makes the image private to the associated user and
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# sharing with other users within the same tenant (or "project")
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# requires explicit image sharing via image membership.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #owner_is_tenant = true
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Role used to identify an authenticated user as administrator.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a string value representing a Keystone role to identify an
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# administrative user. Users with this role will be granted
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# administrative privileges. The default value for this option is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# 'admin'.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A string value which is a valid Keystone role
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #admin_role = admin
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Allow unauthenticated users to access the API with read-only
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# privileges. This only applies when using ContextMiddleware. (boolean
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Allow limited access to unauthenticated users.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Assign a boolean to determine API access for unathenticated
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# users. When set to False, the API cannot be accessed by
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# unauthenticated users. When set to True, unauthenticated users can
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# access the API with read-only privileges. This however only applies
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# when using ContextMiddleware.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #allow_anonymous_access = false
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Limits request ID length. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Limit the request ID length.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide  an integer value to limit the length of the request ID to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the specified length. The default value is 64. Users can change this
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# to any ineteger value between 0 and 16384 however keeping in mind that
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# a larger value may flood the logs.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Integer value between 0 and 16384
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #max_request_id_length = 64
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Whether to allow users to specify image properties beyond what the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# image schema provides (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Allow users to add additional/custom properties to images.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Glance defines a standard set of properties (in its schema) that
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# appear on every image. These properties are also known as
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``base properties``. In addition to these properties, Glance
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# allows users to add custom properties to images. These are known
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# as ``additional properties``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# By default, this configuration option is set to ``True`` and users
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# are allowed to add additional properties. The number of additional
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# properties that can be added to an image can be controlled via
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``image_property_quota`` configuration option.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * image_property_quota
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #allow_additional_image_properties = true
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Maximum number of image members per image. Negative values evaluate
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# to unlimited. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Maximum number of image members per image.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This limits the maximum of users an image can be shared with. Any negative
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# value is interpreted as unlimited.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #image_member_quota = 128
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Maximum number of properties allowed on an image. Negative values
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# evaluate to unlimited. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Maximum number of properties allowed on an image.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This enforces an upper limit on the number of additional properties an image
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# can have. Any negative value is interpreted as unlimited.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: This won't have any impact if additional properties are disabled. Please
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# refer to ``allow_additional_image_properties``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * ``allow_additional_image_properties``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #image_property_quota = 128
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Maximum number of tags allowed on an image. Negative values evaluate
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# to unlimited. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Maximum number of tags allowed on an image.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Any negative value is interpreted as unlimited.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #image_tag_quota = 128
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Maximum number of locations allowed on an image. Negative values
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# evaluate to unlimited. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Maximum number of locations allowed on an image.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Any negative value is interpreted as unlimited.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #image_location_quota = 10
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Python module path of data access API (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Python module path of data access API.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Specifies the path to the API to use for accessing the data model.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option determines how the image catalog data will be accessed.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * glance.db.sqlalchemy.api
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * glance.db.registry.api
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * glance.db.simple.api
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# If this option is set to ``glance.db.sqlalchemy.api`` then the image
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# catalog data is stored in and read from the database via the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# SQLAlchemy Core and ORM APIs.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Setting this option to ``glance.db.registry.api`` will force all
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# database access requests to be routed through the Registry service.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This avoids data access from the Glance API nodes for an added layer
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# of security, scalability and manageability.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: In v2 OpenStack Images API, the registry service is optional.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# In order to use the Registry API in v2, the option
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``enable_v2_registry`` must be set to ``True``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Finally, when this configuration option is set to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``glance.db.simple.api``, image catalog data is stored in and read
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# from an in-memory data structure. This is primarily used for testing.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * enable_v2_api
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * enable_v2_registry
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #data_api = glance.db.sqlalchemy.api
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Default value for the number of items returned by a request if not
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# specified explicitly in the request (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The default number of results to return for a request.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Responses to certain API requests, like list images, may return
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# multiple items. The number of results returned can be explicitly
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# controlled by specifying the ``limit`` parameter in the API request.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# However, if a ``limit`` parameter is not specified, this
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# configuration value will be used as the default number of results to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# be returned for any API request.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTES:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * The value of this configuration option may not be greater than
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       the value specified by ``api_limit_max``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Setting this to a very large value may slow down database
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       queries and increase response times. Setting this to a
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       very low value may result in poor user experience.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Any positive integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * api_limit_max
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #limit_param_default = 25
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Maximum permissible number of items that could be returned by a
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# request (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +limit_param_default = 25
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Maximum number of results that could be returned by a request.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# As described in the help text of ``limit_param_default``, some
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# requests may return multiple results. The number of results to be
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# returned are governed either by the ``limit`` parameter in the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# request or the ``limit_param_default`` configuration option.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The value in either case, can't be greater than the absolute maximum
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# defined by this configuration option. Anything greater than this
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# value is trimmed down to the maximum value defined here.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: Setting this to a very large value may slow down database
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       queries and increase response times. Setting this to a
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       very low value may result in poor user experience.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Any positive integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * limit_param_default
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #api_limit_max = 1000
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Whether to include the backend image storage location in image
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# properties. Revealing storage location can be a security risk, so
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# use this setting with caution! (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +api_limit_max = 1000
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Show direct image location when returning an image.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This configuration option indicates whether to show the direct image
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# location when returning image details to the user. The direct image
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# location is where the image data is stored in backend storage. This
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# image location is shown under the image property ``direct_url``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When multiple image locations exist for an image, the best location
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# is displayed based on the location strategy indicated by the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# configuration option ``location_strategy``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTES:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Revealing image locations can present a GRAVE SECURITY RISK as
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       image locations can sometimes include credentials. Hence, this
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       is set to ``False`` by default. Set this to ``True`` with
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       EXTREME CAUTION and ONLY IF you know what you are doing!
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * If an operator wishes to avoid showing any image location(s)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       to the user, then both this option and
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       ``show_multiple_locations`` MUST be set to ``False``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * show_multiple_locations
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * location_strategy
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #show_image_direct_url = false
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Whether to include the backend image locations in image properties.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# For example, if using the file system store a URL of
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# "file:///path/to/image" will be returned to the user in the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# 'direct_url' meta-data field. Revealing storage location can be a
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# security risk, so use this setting with caution! Setting this to
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# true overrides the show_image_direct_url option. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEPRECATED:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Show all image locations when returning an image.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This configuration option indicates whether to show all the image
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# locations when returning image details to the user. When multiple
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# image locations exist for an image, the locations are ordered based
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# on the location strategy indicated by the configuration opt
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``location_strategy``. The image locations are shown under the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# image property ``locations``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTES:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Revealing image locations can present a GRAVE SECURITY RISK as
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       image locations can sometimes include credentials. Hence, this
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       is set to ``False`` by default. Set this to ``True`` with
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       EXTREME CAUTION and ONLY IF you know what you are doing!
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * If an operator wishes to avoid showing any image location(s)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       to the user, then both this option and
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       ``show_image_direct_url`` MUST be set to ``False``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * show_image_direct_url
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * location_strategy
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option is deprecated for removal since Newton.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reason: This option will be removed in the Ocata release because the same
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# functionality can be achieved with greater granularity by using policies.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Please see the Newton release notes for more information.
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #show_multiple_locations = false
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Maximum size of image a user can upload in bytes. Defaults to
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# 1099511627776 bytes (1 TB).WARNING: this value should only be
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# increased after careful consideration and must be set to a value
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# under 8 EB (9223372036854775808). (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Maximum size of image a user can upload in bytes.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# An image upload greater than the size mentioned here would result
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# in an image creation failure. This configuration option defaults to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# 1099511627776 bytes (1 TiB).
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTES:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * This value should only be increased after careful
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       consideration and must be set less than or equal to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       8 EiB (9223372036854775808).
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * This value must be set with careful consideration of the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       backend storage capacity. Setting this to a very low value
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       may result in a large number of image failures. And, setting
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       this to a very large value may result in faster consumption
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       of storage. Hence, this must be set according to the nature of
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       images created and storage capacity available.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Any positive number less than or equal to 9223372036854775808
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Maximum value: 9223372036854775808
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #image_size_cap = 1099511627776
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Set a system wide quota for every user. This value is the total
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# capacity that a user can use across all storage systems. A value of
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# 0 means unlimited.Optional unit can be specified for the value.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Accepted units are B, KB, MB, GB and TB representing Bytes,
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# KiloBytes, MegaBytes, GigaBytes and TeraBytes respectively. If no
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# unit is specified then Bytes is assumed. Note that there should not
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# be any space between value and unit and units are case sensitive.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Maximum amount of image storage per tenant.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This enforces an upper limit on the cumulative storage consumed by all images
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# of a tenant across all stores. This is a per-tenant limit.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The default unit for this configuration option is Bytes. However, storage
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# units can be specified using case-sensitive literals ``B``, ``KB``, ``MB``,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``GB`` and ``TB`` representing Bytes, KiloBytes, MegaBytes, GigaBytes and
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# TeraBytes respectively. Note that there should not be any space between the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# value and unit. Value ``0`` signifies no quota enforcement. Negative values
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# are invalid and result in errors.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A string that is a valid concatenation of a non-negative integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       representing the storage value and an optional string literal
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       representing storage units as mentioned above.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #user_storage_quota = 0
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Deploy the v1 OpenStack Images API. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deploy the v1 OpenStack Images API.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When this option is set to ``True``, Glance service will respond to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# requests on registered endpoints conforming to the v1 OpenStack
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Images API.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTES:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * If this option is enabled, then ``enable_v1_registry`` must
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       also be set to ``True`` to enable mandatory usage of Registry
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       service with v1 API.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * If this option is disabled, then the ``enable_v1_registry``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       option, which is enabled by default, is also recommended
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       to be disabled.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * This option is separate from ``enable_v2_api``, both v1 and v2
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       OpenStack Images API can be deployed independent of each
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       other.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * If deploying only the v2 Images API, this option, which is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       enabled by default, should be disabled.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * enable_v1_registry
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * enable_v2_api
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #enable_v1_api = true
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Deploy the v2 OpenStack Images API. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deploy the v2 OpenStack Images API.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When this option is set to ``True``, Glance service will respond
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# to requests on registered endpoints conforming to the v2 OpenStack
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Images API.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTES:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * If this option is disabled, then the ``enable_v2_registry``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       option, which is enabled by default, is also recommended
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       to be disabled.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * This option is separate from ``enable_v1_api``, both v1 and v2
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       OpenStack Images API can be deployed independent of each
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       other.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * If deploying only the v1 Images API, this option, which is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       enabled by default, should be disabled.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * enable_v2_registry
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * enable_v1_api
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #enable_v2_api = true
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Deploy the v1 OpenStack Registry API. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deploy the v1 API Registry service.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When this option is set to ``True``, the Registry service
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# will be enabled in Glance for v1 API requests.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTES:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Use of Registry is mandatory in v1 API, so this option must
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       be set to ``True`` if the ``enable_v1_api`` option is enabled.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * If deploying only the v2 OpenStack Images API, this option,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       which is enabled by default, should be disabled.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * enable_v1_api
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #enable_v1_registry = true
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Deploy the v2 OpenStack Registry API. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deploy the v2 API Registry service.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When this option is set to ``True``, the Registry service
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# will be enabled in Glance for v2 API requests.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTES:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Use of Registry is optional in v2 API, so this option
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       must only be enabled if both ``enable_v2_api`` is set to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       ``True`` and the ``data_api`` option is set to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       ``glance.db.registry.api``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * If deploying only the v1 OpenStack Images API, this option,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       which is enabled by default, should be disabled.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * enable_v2_api
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * data_api
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #enable_v2_registry = true
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The hostname/IP of the pydev process listening for debug connections
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#pydev_worker_debug_host = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The port on which a pydev process is listening for connections.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (port value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Host address of the pydev server.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a string value representing the hostname or IP of the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# pydev server to use for debugging. The pydev server listens for
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# debug connections on this address, facilitating remote debugging
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# in Glance.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Valid hostname
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Valid IP address
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#pydev_worker_debug_host = localhost
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Port number that the pydev server will listen on.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a port number to bind the pydev server to. The pydev
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# process accepts debug connections on this port and facilitates
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# remote debugging in Glance.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid port number
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (port value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Minimum value: 0
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Maximum value: 65535
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #pydev_worker_debug_port = 5678
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# AES key for encrypting store 'location' metadata. This includes, if
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# used, Swift or S3 credentials. Should be set to a random string of
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# length 16, 24 or 32 bytes (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# AES key for encrypting store location metadata.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a string value representing the AES cipher to use for
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# encrypting Glance store metadata.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: The AES key to use must be set to a random string of length
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# 16, 24 or 32 bytes.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * String value representing a valid AES key
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #metadata_encryption_key = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Digest algorithm which will be used for digital signature. Use the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# command "openssl list-message-digest-algorithms" to get the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# available algorithms supported by the version of OpenSSL on the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# platform. Examples are "sha1", "sha256", "sha512", etc. (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Digest algorithm to use for digital signature.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a string value representing the digest algorithm to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# use for generating digital signatures. By default, ``sha256``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# is used.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# To get a list of the available algorithms supported by the version
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# of OpenSSL on your platform, run the command:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``openssl list-message-digest-algorithms``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Examples are 'sha1', 'sha256', and 'sha512'.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: ``digest_algorithm`` is not related to Glance's image signing
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# and verification. It is only used to sign the universally unique
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# identifier (UUID) as a part of the certificate file and key file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# validation.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * An OpenSSL message digest algorithm identifier
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Relation options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #digest_algorithm = sha256
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Address to bind the server.  Useful when selecting a particular
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# network interface. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# IP address to bind the glance servers to.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide an IP address to bind the glance server to. The default
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# value is ``0.0.0.0``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Edit this option to enable the server to listen on one particular
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# IP address on the network card. This facilitates selection of a
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# particular network interface for the server.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid IPv4 address
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid IPv6 address
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #bind_host = 0.0.0.0
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The port on which the server will listen. (port value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +bind_host = 10.167.4.12
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Port number on which the server will listen.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a valid port number to bind the server's socket to. This
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# port is then set to identify processes and forward network messages
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# that arrive at the server. The default bind_port value for the API
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# server is 9292 and for the registry server is 9191.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid port number (0 to 65535)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (port value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Minimum value: 0
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Maximum value: 65535
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #bind_port = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The backlog value that will be used when creating the TCP listener
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# socket. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +bind_port = 9191
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Set the number of incoming connection requests.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a positive integer value to limit the number of requests in
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the backlog queue. The default queue size is 4096.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# An incoming connection to a TCP listener socket is queued before a
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# connection can be established with the server. Setting the backlog
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# for a TCP socket ensures a limited queue size for incoming traffic.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Positive integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #backlog = 4096
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The value for the socket option TCP_KEEPIDLE.  This is the time in
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# seconds that the connection must be idle before TCP starts sending
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# keepalive probes. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Set the wait time before a connection recheck.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a positive integer value representing time in seconds which
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# is set as the idle wait time before a TCP keep alive packet can be
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# sent to the host. The default value is 600 seconds.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Setting ``tcp_keepidle`` helps verify at regular intervals that a
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# connection is intact and prevents frequent TCP connection
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# reestablishment.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Positive integer value representing time in seconds
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #tcp_keepidle = 600
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# CA certificate file to use to verify connecting clients. (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#ca_file = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Certificate file to use when starting API server securely. (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#cert_file = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Private key file to use when starting API server securely. (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#key_file = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The number of child process workers that will be created to service
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# requests. The default will be equal to the number of CPUs available.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Absolute path to the CA file.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a string value representing a valid absolute path to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the Certificate Authority file to use for client authentication.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# A CA file typically contains necessary trusted certificates to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# use for the client authentication. This is essential to ensure
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# that a secure connection is established to the server via the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# internet.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Valid absolute path to the CA file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#ca_file = /etc/ssl/cafile
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Absolute path to the certificate file.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a string value representing a valid absolute path to the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# certificate file which is required to start the API service
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# securely.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# A certificate file typically is a public key container and includes
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the server's public key, server name, server information and the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# signature which was a result of the verification process using the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# CA certificate. This is required for a secure connection
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# establishment.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Valid absolute path to the certificate file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#cert_file = /etc/ssl/certs
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Absolute path to a private key file.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a string value representing a valid absolute path to a
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# private key file which is required to establish the client-server
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# connection.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Absolute path to the private key file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#key_file = /etc/ssl/key/key-file.pem
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEPRECATED: The HTTP header used to determine the scheme for the original
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# request, even if it was removed by an SSL terminating proxy. Typical value is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# "HTTP_X_FORWARDED_PROTO". (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reason: Use the http_proxy_to_wsgi middleware instead.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#secure_proxy_ssl_header = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Number of Glance worker processes to start.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a non-negative integer value to set the number of child
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# process workers to service requests. By default, the number of CPUs
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# available is set as the value for ``workers``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Each worker process is made to listen on the port set in the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# configuration file and contains a greenthread pool of size 1000.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: Setting the number of workers to zero, triggers the creation
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# of a single API process with a greenthread pool of size 1000.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * 0
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Positive integer value (typically equal to the number of CPUs)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #workers = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Maximum line size of message headers to be accepted. max_header_line
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# may need to be increased when using large tokens (typically those
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# generated by the Keystone v3 API with big service catalogs (integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +workers = 8
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Maximum line size of message headers.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide an integer value representing a length to limit the size of
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# message headers. The default value is 16384.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: ``max_header_line`` may need to be increased when using large
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# tokens (typically those generated by the Keystone v3 API with big
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# service catalogs). However, it is to be kept in mind that larger
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# values for ``max_header_line`` would flood the logs.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Setting ``max_header_line`` to 0 sets no limit for the line size of
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# message headers.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * 0
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Positive integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #max_header_line = 16384
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# If False, server will return the header "Connection: close", If
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# True, server will return "Connection: Keep-Alive" in its responses.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# In order to close the client socket connection explicitly after the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# response is sent and read successfully by the client, you simply
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# have to set this option to False when you create a wsgi server.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Set keep alive option for HTTP over TCP.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a boolean value to determine sending of keep alive packets.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# If set to ``False``, the server returns the header
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# "Connection: close". If set to ``True``, the server returns a
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# "Connection: Keep-Alive" in its responses. This enables retention of
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the same TCP connection for HTTP conversations instead of opening a
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# new one with each new request.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option must be set to ``False`` if the client socket connection
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# needs to be closed explicitly after the response is received and
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# read successfully by the client.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #http_keepalive = true
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Timeout for client connections' socket operations. If an incoming
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# connection is idle for this number of seconds it will be closed. A
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value of '0' means wait forever. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Timeout for client connections' socket operations.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a valid integer value representing time in seconds to set
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the period of wait before an incoming connection can be closed. The
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# default value is 900 seconds.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The value zero implies wait forever.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Zero
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Positive integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #client_socket_timeout = 900
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # From oslo.log
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# If set to true, the logging level will be set to DEBUG instead of
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# the default INFO level. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# If set to true, the logging level will be set to DEBUG instead of the default
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# INFO level. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Note: This option can be changed without restarting.
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #debug = false
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# If set to false, the logging level will be set to WARNING instead of
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# the default INFO level. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +debug = false
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEPRECATED: If set to false, the logging level will be set to WARNING instead
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# of the default INFO level. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # This option is deprecated for removal.
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #verbose = true
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The name of a logging configuration file. This file is appended to
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# any existing logging configuration files. For details about logging
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# configuration files, see the Python logging module documentation.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Note that when logging configuration files are used then all logging
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# configuration is set in the configuration file and other logging
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# configuration options are ignored (for example,
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# logging_context_format_string). (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +verbose = true
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The name of a logging configuration file. This file is appended to any
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# existing logging configuration files. For details about logging configuration
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# files, see the Python logging module documentation. Note that when logging
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# configuration files are used then all logging configuration is set in the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# configuration file and other logging configuration options are ignored (for
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# example, logging_context_format_string). (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Note: This option can be changed without restarting.
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/log_config
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #log_config_append = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Defines the format string for %%(asctime)s in log records. Default:
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# %(default)s . This option is ignored if log_config_append is set.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# %(default)s . This option is ignored if log_config_append is set. (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #log_date_format = %Y-%m-%d %H:%M:%S
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (Optional) Name of log file to send logging output to. If no default
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# is set, logging will go to stderr as defined by use_stderr. This
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# option is ignored if log_config_append is set. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# (Optional) Name of log file to send logging output to. If no default is set,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# logging will go to stderr as defined by use_stderr. This option is ignored if
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# log_config_append is set. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/logfile
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #log_file = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (Optional) The base directory used for relative log_file  paths.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# This option is ignored if log_config_append is set. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +log_file = /var/log/glance/registry.log
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# (Optional) The base directory used for relative log_file  paths. This option
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# is ignored if log_config_append is set. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/logdir
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #log_dir = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Uses logging handler designed to watch file system. When log file is
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# moved or removed this handler will open a new log file with
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# specified path instantaneously. It makes sense only if log_file
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# option is specified and Linux platform is used. This option is
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# ignored if log_config_append is set. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Uses logging handler designed to watch file system. When log file is moved or
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# removed this handler will open a new log file with specified path
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# instantaneously. It makes sense only if log_file option is specified and Linux
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# platform is used. This option is ignored if log_config_append is set. (boolean
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #watch_log_file = false
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Use syslog for logging. Existing syslog format is DEPRECATED and
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# will be changed later to honor RFC5424. This option is ignored if
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# log_config_append is set. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Use syslog for logging. Existing syslog format is DEPRECATED and will be
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# changed later to honor RFC5424. This option is ignored if log_config_append is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# set. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #use_syslog = false
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Syslog facility to receive log lines. This option is ignored if
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # log_config_append is set. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #syslog_log_facility = LOG_USER
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Log output to standard error. This option is ignored if
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# log_config_append is set. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Log output to standard error. This option is ignored if log_config_append is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# set. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #use_stderr = true
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Format string to use for log messages with context. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #logging_context_format_string = %(asctime)s.%(msecs)03d %(process)d %(levelname)s %(name)s [%(request_id)s %(user_identity)s] %(instance)s%(message)s
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Format string to use for log messages when context is undefined.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Format string to use for log messages when context is undefined. (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #logging_default_format_string = %(asctime)s.%(msecs)03d %(process)d %(levelname)s %(name)s [-] %(instance)s%(message)s
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Additional data to append to log message when logging level for the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# message is DEBUG. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Additional data to append to log message when logging level for the message is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEBUG. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #logging_debug_format_suffix = %(funcName)s %(pathname)s:%(lineno)d
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Prefix each line of exception output with this format. (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Prefix each line of exception output with this format. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #logging_exception_prefix = %(asctime)s.%(msecs)03d %(process)d ERROR %(name)s %(instance)s
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Defines the format string for %(user_identity)s that is used in
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # logging_context_format_string. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# List of package logging levels in logger=LEVEL pairs. This option is
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# ignored if log_config_append is set. (list value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# List of package logging levels in logger=LEVEL pairs. This option is ignored
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# if log_config_append is set. (list value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #default_log_levels = amqp=WARN,amqplib=WARN,boto=WARN,qpid=WARN,sqlalchemy=WARN,suds=INFO,oslo.messaging=INFO,iso8601=WARN,requests.packages.urllib3.connectionpool=WARN,urllib3.connectionpool=WARN,websocket=WARN,requests.packages.urllib3.util.retry=WARN,urllib3.util.retry=WARN,keystonemiddleware=WARN,routes.middleware=WARN,stevedore=WARN,taskflow=WARN,keystoneauth=WARN,oslo.cache=INFO,dogpile.core.dogpile=INFO
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Enables or disables publication of error events. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #publish_errors = false
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The format for an instance that is passed with the log message.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The format for an instance that is passed with the log message. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #instance_format = "[instance: %(uuid)s] "
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The format for an instance UUID that is passed with the log message.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The format for an instance UUID that is passed with the log message. (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #instance_uuid_format = "[instance: %(uuid)s] "
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Enables or disables fatal status of deprecations. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: @@ -275,64 +900,99 @@
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rpc_conn_pool_size
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #rpc_conn_pool_size = 30
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# ZeroMQ bind address. Should be a wildcard (*), an ethernet
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# interface, or IP. The "host" option should point or resolve to this
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# address. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The pool size limit for connections expiration policy (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#conn_pool_min_size = 2
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The time-to-live in sec of idle connections in the pool (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#conn_pool_ttl = 1200
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ZeroMQ bind address. Should be a wildcard (*), an ethernet interface, or IP.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The "host" option should point or resolve to this address. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_bind_address
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #rpc_zmq_bind_address = *
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # MatchMaker driver. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Allowed values: redis, dummy
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_matchmaker
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #rpc_zmq_matchmaker = redis
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Type of concurrency used. Either "native" or "eventlet" (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Number of ZeroMQ contexts, defaults to 1. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_contexts
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#rpc_zmq_contexts = 1
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Maximum number of ingress messages to locally buffer per topic. Default is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# unlimited. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_topic_backlog
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#rpc_zmq_topic_backlog = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Directory for holding IPC sockets. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_ipc_dir
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#rpc_zmq_ipc_dir = /var/run/openstack
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Name of this node. Must be a valid hostname, FQDN, or IP address. Must match
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# "host" option, if running Nova. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_host
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#rpc_zmq_host = localhost
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Seconds to wait before a cast expires (TTL). The default value of -1 specifies
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# an infinite linger period. The value of 0 specifies no linger period. Pending
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# messages shall be discarded immediately when the socket is closed. Only
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# supported by impl_zmq. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_cast_timeout
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#rpc_cast_timeout = -1
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The default number of seconds that poll should wait. Poll raises timeout
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# exception when timeout expired. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_poll_timeout
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#rpc_poll_timeout = 1
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Expiration timeout in seconds of a name service record about existing target (
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# < 0 means no timeout). (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/zmq_target_expire
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#zmq_target_expire = 300
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Update period in seconds of a name service record about existing target.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/zmq_target_update
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#zmq_target_update = 180
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Use PUB/SUB pattern for fanout methods. PUB/SUB always uses proxy. (boolean
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#rpc_zmq_concurrency = eventlet
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Number of ZeroMQ contexts, defaults to 1. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#rpc_zmq_contexts = 1
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Maximum number of ingress messages to locally buffer per topic.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Default is unlimited. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#rpc_zmq_topic_backlog = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Directory for holding IPC sockets. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#rpc_zmq_ipc_dir = /var/run/openstack
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Name of this node. Must be a valid hostname, FQDN, or IP address.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Must match "host" option, if running Nova. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#rpc_zmq_host = localhost
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Seconds to wait before a cast expires (TTL). The default value of -1
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# specifies an infinite linger period. The value of 0 specifies no
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# linger period. Pending messages shall be discarded immediately when
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# the socket is closed. Only supported by impl_zmq. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#rpc_cast_timeout = -1
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The default number of seconds that poll should wait. Poll raises
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# timeout exception when timeout expired. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#rpc_poll_timeout = 1
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Expiration timeout in seconds of a name service record about
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# existing target ( < 0 means no timeout). (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#zmq_target_expire = 120
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Use PUB/SUB pattern for fanout methods. PUB/SUB always uses proxy.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/use_pub_sub
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #use_pub_sub = true
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Use ROUTER remote proxy. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/use_router_proxy
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#use_router_proxy = true
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Minimal port number for random ports range. (port value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Minimum value: 0
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Maximum value: 65535
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#rpc_zmq_min_port = 49152
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_min_port
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#rpc_zmq_min_port = 49153
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Maximal port number for random ports range. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Minimum value: 1
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Maximum value: 65536
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_max_port
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #rpc_zmq_max_port = 65536
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Number of retries to find free port number before fail with
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# ZMQBindError. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Number of retries to find free port number before fail with ZMQBindError.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_bind_port_retries
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #rpc_zmq_bind_port_retries = 100
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Default serialization mechanism for serializing/deserializing
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# outgoing/incoming messages (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Allowed values: json, msgpack
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_serialization
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#rpc_zmq_serialization = json
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option configures round-robin mode in zmq socket. True means not keeping
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# a queue when server side disconnects. False means to keep queue and messages
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# even if server is disconnected, when the server appears we send all
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# accumulated messages to it. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#zmq_immediate = false
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Size of executor thread pool. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rpc_thread_pool_size
Sep 28 11:21:28 ctl02 salt-minion[14967]: @@ -341,19 +1001,22 @@
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Seconds to wait for a response from a call. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #rpc_response_timeout = 60
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# A URL representing the messaging driver to use and its full
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# configuration. If not set, we fall back to the rpc_backend option
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# and driver specific configuration. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# A URL representing the messaging driver to use and its full configuration.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #transport_url = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The messaging driver to use, defaults to rabbit. Other drivers
Sep 28 11:21:28 ctl02 salt-minion[14967]: +transport_url = rabbit://openstack:opnfv_secret@10.167.4.41:5672,openstack:opnfv_secret@10.167.4.42:5672,openstack:opnfv_secret@10.167.4.43:5672//openstack
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEPRECATED: The messaging driver to use, defaults to rabbit. Other drivers
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # include amqp and zmq. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #rpc_backend = rabbit
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The default exchange under which topics are scoped. May be
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# overridden by an exchange name specified in the transport_url
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# option. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The default exchange under which topics are scoped. May be overridden by an
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# exchange name specified in the transport_url option. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #control_exchange = openstack
Sep 28 11:21:28 ctl02 salt-minion[14967]: +control_exchange = openstack
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  [database]
Sep 28 11:21:28 ctl02 salt-minion[14967]: @@ -362,10 +1025,13 @@
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # From oslo.db
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The file name to use with SQLite. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEPRECATED: The file name to use with SQLite. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/sqlite_db
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reason: Should use config option connection or slave_connection to connect the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# database.
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #sqlite_db = oslo.sqlite
Sep 28 11:21:28 ctl02 salt-minion[14967]: -sqlite_db = /var/lib/glance/glance.sqlite
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # If True, SQLite uses synchronous mode. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/sqlite_synchronous
Sep 28 11:21:28 ctl02 salt-minion[14967]: @@ -373,23 +1039,25 @@
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # The back end to use for the database. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/db_backend
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#backend = sqlalchemy
Sep 28 11:21:28 ctl02 salt-minion[14967]:  backend = sqlalchemy
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The SQLAlchemy connection string to use to connect to the database.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The SQLAlchemy connection string to use to connect to the database. (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/sql_connection
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DATABASE]/sql_connection
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [sql]/connection
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #connection = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The SQLAlchemy connection string to use to connect to the slave
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# database. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +connection = mysql+pymysql://glance:opnfv_secret@10.167.4.50/glance
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The SQLAlchemy connection string to use to connect to the slave database.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #slave_connection = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The SQL mode to be used for MySQL sessions. This option, including
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# the default, overrides any server-set SQL mode. To use whatever SQL
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# mode is set by the server configuration, set this to no value.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Example: mysql_sql_mode= (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The SQL mode to be used for MySQL sessions. This option, including the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# default, overrides any server-set SQL mode. To use whatever SQL mode is set by
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the server configuration, set this to no value. Example: mysql_sql_mode=
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #mysql_sql_mode = TRADITIONAL
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Timeout before idle SQL connections are reaped. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: @@ -397,39 +1065,42 @@
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DATABASE]/sql_idle_timeout
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [sql]/idle_timeout
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #idle_timeout = 3600
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Minimum number of SQL connections to keep open in a pool. (integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +idle_timeout = 3600
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum number of SQL connections to keep open in a pool. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/sql_min_pool_size
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DATABASE]/sql_min_pool_size
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #min_pool_size = 1
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Maximum number of SQL connections to keep open in a pool. (integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Maximum number of SQL connections to keep open in a pool. Setting a value of 0
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# indicates no limit. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/sql_max_pool_size
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DATABASE]/sql_max_pool_size
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#max_pool_size = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Maximum number of database connection retries during startup. Set to
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# -1 to specify an infinite retry count. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#max_pool_size = 5
Sep 28 11:21:28 ctl02 salt-minion[14967]: +max_pool_size = 10
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Maximum number of database connection retries during startup. Set to -1 to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# specify an infinite retry count. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/sql_max_retries
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DATABASE]/sql_max_retries
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #max_retries = 10
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Interval between retries of opening a SQL connection. (integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +max_retries = -1
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Interval between retries of opening a SQL connection. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/sql_retry_interval
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DATABASE]/reconnect_interval
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #retry_interval = 10
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# If set, use this value for max_overflow with SQLAlchemy. (integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# If set, use this value for max_overflow with SQLAlchemy. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/sql_max_overflow
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DATABASE]/sqlalchemy_max_overflow
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #max_overflow = 50
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Verbosity of SQL debugging information: 0=None, 100=Everything.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +max_overflow = 30
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Verbosity of SQL debugging information: 0=None, 100=Everything. (integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Maximum value: 100
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/sql_connection_debug
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #connection_debug = 0
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: @@ -437,224 +1108,44 @@
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/sql_connection_trace
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #connection_trace = false
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# If set, use this value for pool_timeout with SQLAlchemy. (integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# If set, use this value for pool_timeout with SQLAlchemy. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DATABASE]/sqlalchemy_pool_timeout
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #pool_timeout = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Enable the experimental use of database reconnect on connection
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# lost. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Enable the experimental use of database reconnect on connection lost. (boolean
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #use_db_reconnect = false
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Seconds between retries of a database transaction. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #db_retry_interval = 1
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# If True, increases the interval between retries of a database
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# operation up to db_max_retry_interval. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# If True, increases the interval between retries of a database operation up to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# db_max_retry_interval. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #db_inc_retry_interval = true
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# If db_inc_retry_interval is set, the maximum seconds between retries
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# of a database operation. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# If db_inc_retry_interval is set, the maximum seconds between retries of a
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# database operation. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #db_max_retry_interval = 10
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Maximum retries in case of connection error or deadlock error before
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# error is raised. Set to -1 to specify an infinite retry count.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Maximum retries in case of connection error or deadlock error before error is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# raised. Set to -1 to specify an infinite retry count. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #db_max_retries = 20
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # From oslo.db.concurrency
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Enable the experimental use of thread pooling for all DB API calls
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Enable the experimental use of thread pooling for all DB API calls (boolean
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/dbapi_use_tpool
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #use_tpool = false
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]:  [glance_store]
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# From glance.store
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# List of stores enabled. Valid stores are: cinder, file, http, rbd,
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# sheepdog, swift, s3, vsphere (list value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#stores = file,http
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Default scheme to use to store image data. The scheme must be
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# registered by one of the stores defined by the 'stores' config
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# option. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#default_store = file
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Minimum interval seconds to execute updating dynamic storage
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# capabilities based on backend status then. It's not a periodic
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# routine, the update logic will be executed only when interval
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# seconds elapsed and an operation of store has triggered. The feature
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# will be enabled only when the option value greater then zero.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#store_capabilities_update_min_interval = 0
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Specify the path to the CA bundle file to use in verifying the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# remote server certificate. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#https_ca_certificates_file = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# If true, the remote server certificate is not verified. If false,
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# then the default CA truststore is used for verification. This option
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# is ignored if "https_ca_certificates_file" is set. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#https_insecure = true
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Specify the http/https proxy information that should be used to
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# connect to the remote server. The proxy information should be a key
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value pair of the scheme and proxy. e.g. http:10.0.0.1:3128. You can
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# specify proxies for multiple schemes by seperating the key value
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# pairs with a comma.e.g. http:10.0.0.1:3128, https:10.0.0.1:1080.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (dict value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#http_proxy_information =
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# If True, swiftclient won't check for a valid SSL certificate when
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# authenticating. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#swift_store_auth_insecure = false
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# A string giving the CA certificate file to use in SSL connections
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# for verifying certs. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#swift_store_cacert = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The region of the swift endpoint to be used for single tenant. This
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# setting is only necessary if the tenant has multiple swift
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# endpoints. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#swift_store_region = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# If set, the configured endpoint will be used. If None, the storage
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# url from the auth response will be used. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#swift_store_endpoint = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# A string giving the endpoint type of the swift service to use
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (publicURL, adminURL or internalURL). This setting is only used if
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# swift_store_auth_version is 2. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#swift_store_endpoint_type = publicURL
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# A string giving the service type of the swift service to use. This
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# setting is only used if swift_store_auth_version is 2. (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#swift_store_service_type = object-store
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Container within the account that the account should use for storing
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# images in Swift when using single container mode. In multiple
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# container mode, this will be the prefix for all containers. (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#swift_store_container = glance
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The size, in MB, that Glance will start chunking image files and do
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# a large object manifest in Swift. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#swift_store_large_object_size = 5120
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The amount of data written to a temporary disk buffer during the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# process of chunking the image file. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#swift_store_large_object_chunk_size = 200
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# A boolean value that determines if we create the container if it
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# does not exist. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#swift_store_create_container_on_put = false
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# If set to True, enables multi-tenant storage mode which causes
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Glance images to be stored in tenant specific Swift accounts.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#swift_store_multi_tenant = false
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# When set to 0, a single-tenant store will only use one container to
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# store all images. When set to an integer value between 1 and 32, a
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# single-tenant store will use multiple containers to store images,
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# and this value will determine how many containers are created.Used
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# only when swift_store_multi_tenant is disabled. The total number of
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# containers that will be used is equal to 16^N, so if this config
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# option is set to 2, then 16^2=256 containers will be used to store
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# images. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#swift_store_multiple_containers_seed = 0
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# A list of tenants that will be granted read/write access on all
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Swift containers created by Glance in multi-tenant mode. (list
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#swift_store_admin_tenants =
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# If set to False, disables SSL layer compression of https swift
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# requests. Setting to False may improve performance for images which
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# are already in a compressed format, eg qcow2. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#swift_store_ssl_compression = true
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The number of times a Swift download will be retried before the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# request fails. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#swift_store_retry_get_count = 0
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The period of time (in seconds) before token expirationwhen
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# glance_store will try to reques new user token. Default value 60 sec
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# means that if token is going to expire in 1 min then glance_store
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# request new user token. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#swift_store_expire_soon_interval = 60
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# If set to True create a trust for each add/get request to Multi-
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# tenant store in order to prevent authentication token to be expired
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# during uploading/downloading data. If set to False then user token
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# is used for Swift connection (so no overhead on trust creation).
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Please note that this option is considered only and only if
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# swift_store_multi_tenant=True (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#swift_store_use_trusts = true
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The reference to the default swift account/backing store parameters
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# to use for adding new images. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#default_swift_reference = ref1
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Version of the authentication service to use. Valid versions are 2
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# and 3 for keystone and 1 (deprecated) for swauth and rackspace.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (deprecated - use "auth_version" in swift_store_config_file) (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#swift_store_auth_version = 2
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The address where the Swift authentication service is listening.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (deprecated - use "auth_address" in swift_store_config_file) (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#swift_store_auth_address = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The user to authenticate against the Swift authentication service
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (deprecated - use "user" in swift_store_config_file) (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#swift_store_user = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Auth key for the user authenticating against the Swift
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# authentication service. (deprecated - use "key" in
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# swift_store_config_file) (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#swift_store_key = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The config file that has the swift account(s)configs. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#swift_store_config_file = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# RADOS images will be chunked into objects of this size (in
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# megabytes). For best performance, this should be a power of two.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#rbd_store_chunk_size = 8
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# RADOS pool in which images are stored. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#rbd_store_pool = images
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# RADOS user to authenticate as (only applicable if using Cephx. If
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# <None>, a default will be chosen based on the client. section in
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# rbd_store_ceph_conf) (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#rbd_store_user = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Ceph configuration file path. If <None>, librados will locate the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# default config. If using cephx authentication, this file should
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# include a reference to the right keyring in a client.<USER> section
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#rbd_store_ceph_conf = /etc/ceph/ceph.conf
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Timeout value (in seconds) used when connecting to ceph cluster. If
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value <= 0, no timeout is set and default librados value is used.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#rados_connect_timeout = 0
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Info to match when looking for cinder in the service catalog. Format
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# is : separated values of the form:
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# <service_type>:<service_name>:<endpoint_type> (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#cinder_catalog_info = volumev2::publicURL
Sep 28 11:21:28 ctl02 salt-minion[14967]: +filesystem_store_datadir = /var/lib/glance/images/
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +swift_store_endpoint_type = internalURL
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +cinder_catalog_info = volumev2::internalURL
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Override service catalog lookup with template for cinder endpoint
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # e.g. http://localhost:8776/v2/%(tenant)s (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: @@ -665,173 +1156,7 @@
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/os_region_name
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #cinder_os_region_name = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Location of ca certicates file to use for cinder client requests.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#cinder_ca_certificates_file = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Number of cinderclient retries on failed http calls (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#cinder_http_retries = 3
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Time period of time in seconds to wait for a cinder volume
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# transition to complete. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#cinder_state_transition_timeout = 300
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Allow to perform insecure SSL requests to cinder (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#cinder_api_insecure = false
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The address where the Cinder authentication service is listening. If
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# <None>, the cinder endpoint in the service catalog is used. (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#cinder_store_auth_address = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# User name to authenticate against Cinder. If <None>, the user of
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# current context is used. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#cinder_store_user_name = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Password for the user authenticating against Cinder. If <None>, the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# current context auth token is used. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#cinder_store_password = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Project name where the image is stored in Cinder. If <None>, the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# project in current context is used. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#cinder_store_project_name = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Path to the rootwrap configuration file to use for running commands
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# as root. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#rootwrap_config = /etc/glance/rootwrap.conf
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The host where the S3 server is listening. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#s3_store_host = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The S3 query token access key. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#s3_store_access_key = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The S3 query token secret key. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#s3_store_secret_key = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The S3 bucket to be used to store the Glance data. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#s3_store_bucket = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The local directory where uploads will be staged before they are
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# transferred into S3. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#s3_store_object_buffer_dir = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# A boolean to determine if the S3 bucket should be created on upload
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# if it does not exist or if an error should be returned to the user.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#s3_store_create_bucket_on_put = false
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The S3 calling format used to determine the bucket. Either subdomain
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# or path can be used. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#s3_store_bucket_url_format = subdomain
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# What size, in MB, should S3 start chunking image files and do a
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# multipart upload in S3. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#s3_store_large_object_size = 100
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# What multipart upload part size, in MB, should S3 use when uploading
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# parts. The size must be greater than or equal to 5M. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#s3_store_large_object_chunk_size = 10
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The number of thread pools to perform a multipart upload in S3.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#s3_store_thread_pools = 10
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Enable the use of a proxy. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#s3_store_enable_proxy = false
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Address or hostname for the proxy server. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#s3_store_proxy_host = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The port to use when connecting over a proxy. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#s3_store_proxy_port = 8080
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The username to connect to the proxy. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#s3_store_proxy_user = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The password to use when connecting over a proxy. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#s3_store_proxy_password = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Images will be chunked into objects of this size (in megabytes). For
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# best performance, this should be a power of two. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#sheepdog_store_chunk_size = 64
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Port of sheep daemon. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#sheepdog_store_port = 7000
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# IP address of sheep daemon. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#sheepdog_store_address = localhost
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Directory to which the Filesystem backend store writes images.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#filesystem_store_datadir = /var/lib/glance/images
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# List of directories and its priorities to which the Filesystem
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# backend store writes images. (multi valued)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#filesystem_store_datadirs =
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The path to a file which contains the metadata to be returned with
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# any location associated with this store.  The file must contain a
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# valid JSON object. The object should contain the keys 'id' and
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# 'mountpoint'. The value for both keys should be 'string'. (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#filesystem_store_metadata_file = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The required permission for created image file. In this way the user
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# other service used, e.g. Nova, who consumes the image could be the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# exclusive member of the group that owns the files created. Assigning
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# it less then or equal to zero means don't change the default
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# permission of the file. This value will be decoded as an octal
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# digit. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#filesystem_store_file_perm = 0
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# ESX/ESXi or vCenter Server target system. The server value can be an
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# IP address or a DNS name. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#vmware_server_host = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Username for authenticating with VMware ESX/VC server. (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#vmware_server_username = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Password for authenticating with VMware ESX/VC server. (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#vmware_server_password = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Number of times VMware ESX/VC server API must be retried upon
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# connection related issues. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#vmware_api_retry_count = 10
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The interval used for polling remote tasks invoked on VMware ESX/VC
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# server. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#vmware_task_poll_interval = 5
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The name of the directory where the glance images will be stored in
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# the VMware datastore. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#vmware_store_image_dir = /openstack_glance
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# If true, the ESX/vCenter server certificate is not verified. If
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# false, then the default CA truststore is used for verification. This
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# option is ignored if "vmware_ca_file" is set. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Deprecated group/name - [DEFAULT]/vmware_api_insecure
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#vmware_insecure = false
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Specify a CA bundle file to use in verifying the ESX/vCenter server
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# certificate. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#vmware_ca_file = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# A list of datastores where the image can be stored. This option may
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# be specified multiple times for specifying multiple datastores. The
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# datastore name should be specified after its datacenter path,
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# seperated by ":". An optional weight may be given after the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# datastore name, seperated again by ":". Thus, the required format
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# becomes <datacenter_path>:<datastore_name>:<optional_weight>. When
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# adding an image, the datastore with highest weight will be selected,
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# unless there is not enough free space available in cases where the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# image size is already known. If no weight is given, it is assumed to
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# be zero and the directory will be considered for selection last. If
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# multiple datastores have the same weight, then the one with the most
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# free space available is selected. (multi valued)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#vmware_datastores =
Sep 28 11:21:28 ctl02 salt-minion[14967]: +cinder_os_region_name = RegionOne
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  [keystone_authtoken]
Sep 28 11:21:28 ctl02 salt-minion[14967]: @@ -839,39 +1164,54 @@
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # From keystonemiddleware.auth_token
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Complete public Identity API endpoint. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +revocation_cache_time = 10
Sep 28 11:21:28 ctl02 salt-minion[14967]: +auth_type = password
Sep 28 11:21:28 ctl02 salt-minion[14967]: +user_domain_id = default
Sep 28 11:21:28 ctl02 salt-minion[14967]: +project_domain_id = default
Sep 28 11:21:28 ctl02 salt-minion[14967]: +project_name = service
Sep 28 11:21:28 ctl02 salt-minion[14967]: +username = glance
Sep 28 11:21:28 ctl02 salt-minion[14967]: +password = opnfv_secret
Sep 28 11:21:28 ctl02 salt-minion[14967]: +auth_uri=http://10.167.4.10:5000
Sep 28 11:21:28 ctl02 salt-minion[14967]: +auth_url=http://10.167.4.10:35357
Sep 28 11:21:28 ctl02 salt-minion[14967]: +memcached_servers=10.167.4.11:11211,10.167.4.12:11211,10.167.4.13:11211
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Complete "public" Identity API endpoint. This endpoint should not be an
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# "admin" endpoint, as it should be accessible by all end users. Unauthenticated
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# clients are redirected to this endpoint to authenticate. Although this
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# endpoint should  ideally be unversioned, client support in the wild varies.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# If you're using a versioned v2 endpoint here, then this  should *not* be the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# same endpoint the service user utilizes  for validating tokens, because normal
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# end users may not be  able to reach that endpoint. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #auth_uri = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # API version of the admin Identity API endpoint. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #auth_version = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Do not handle authorization requests within the middleware, but
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# delegate the authorization decision to downstream WSGI components.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Do not handle authorization requests within the middleware, but delegate the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# authorization decision to downstream WSGI components. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #delay_auth_decision = false
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Request timeout value for communicating with Identity API server.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Request timeout value for communicating with Identity API server. (integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #http_connect_timeout = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# How many times are we trying to reconnect when communicating with
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Identity API Server. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# How many times are we trying to reconnect when communicating with Identity API
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Server. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #http_request_max_retries = 3
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Env key for the swift cache. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Request environment key where the Swift cache object is stored. When
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# auth_token middleware is deployed with a Swift cache, use this option to have
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the middleware share a caching backend with swift. Otherwise, use the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``memcached_servers`` option instead. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #cache = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Required if identity server requires client certificate (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Required if identity server requires client certificate (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #certfile = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Required if identity server requires client certificate (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Required if identity server requires client certificate (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #keyfile = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# A PEM encoded Certificate Authority to use when verifying HTTPs
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# connections. Defaults to system CAs. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# A PEM encoded Certificate Authority to use when verifying HTTPs connections.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Defaults to system CAs. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #cafile = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Verify HTTPS connections. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: @@ -883,98 +1223,91 @@
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Directory used to cache files related to PKI tokens. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #signing_dir = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Optionally specify a list of memcached server(s) to use for caching.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# If left undefined, tokens will instead be cached in-process. (list
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Deprecated group/name - [DEFAULT]/memcache_servers
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Optionally specify a list of memcached server(s) to use for caching. If left
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# undefined, tokens will instead be cached in-process. (list value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [keystone_authtoken]/memcache_servers
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #memcached_servers = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# In order to prevent excessive effort spent validating tokens, the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# middleware caches previously-seen tokens for a configurable duration
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (in seconds). Set to -1 to disable caching completely. (integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# In order to prevent excessive effort spent validating tokens, the middleware
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# caches previously-seen tokens for a configurable duration (in seconds). Set to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# -1 to disable caching completely. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #token_cache_time = 300
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Determines the frequency at which the list of revoked tokens is
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# retrieved from the Identity service (in seconds). A high number of
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# revocation events combined with a low cache duration may
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# significantly reduce performance. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Determines the frequency at which the list of revoked tokens is retrieved from
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the Identity service (in seconds). A high number of revocation events combined
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# with a low cache duration may significantly reduce performance. Only valid for
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# PKI tokens. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #revocation_cache_time = 10
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (Optional) If defined, indicate whether token data should be
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# authenticated or authenticated and encrypted. If MAC, token data is
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# authenticated (with HMAC) in the cache. If ENCRYPT, token data is
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# encrypted and authenticated in the cache. If the value is not one of
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# these options or empty, auth_token will raise an exception on
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# initialization. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# (Optional) If defined, indicate whether token data should be authenticated or
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# authenticated and encrypted. If MAC, token data is authenticated (with HMAC)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# in the cache. If ENCRYPT, token data is encrypted and authenticated in the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# cache. If the value is not one of these options or empty, auth_token will
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# raise an exception on initialization. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Allowed values: None, MAC, ENCRYPT
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #memcache_security_strategy = None
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (Optional, mandatory if memcache_security_strategy is defined) This
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# string is used for key derivation. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# (Optional, mandatory if memcache_security_strategy is defined) This string is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# used for key derivation. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #memcache_secret_key = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (Optional) Number of seconds memcached server is considered dead
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# before it is tried again. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# (Optional) Number of seconds memcached server is considered dead before it is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# tried again. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #memcache_pool_dead_retry = 300
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (Optional) Maximum total number of open connections to every
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# memcached server. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# (Optional) Maximum total number of open connections to every memcached server.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #memcache_pool_maxsize = 10
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (Optional) Socket timeout in seconds for communicating with a
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# memcached server. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# (Optional) Socket timeout in seconds for communicating with a memcached
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# server. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #memcache_pool_socket_timeout = 3
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (Optional) Number of seconds a connection to memcached is held
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# unused in the pool before it is closed. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# (Optional) Number of seconds a connection to memcached is held unused in the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# pool before it is closed. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #memcache_pool_unused_timeout = 60
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (Optional) Number of seconds that an operation will wait to get a
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# memcached client connection from the pool. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# (Optional) Number of seconds that an operation will wait to get a memcached
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# client connection from the pool. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #memcache_pool_conn_get_timeout = 10
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (Optional) Use the advanced (eventlet safe) memcached client pool.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The advanced pool will only work under python 2.x. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# (Optional) Use the advanced (eventlet safe) memcached client pool. The
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# advanced pool will only work under python 2.x. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #memcache_use_advanced_pool = false
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (Optional) Indicate whether to set the X-Service-Catalog header. If
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# False, middleware will not ask for service catalog on token
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# validation and will not set the X-Service-Catalog header. (boolean
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# (Optional) Indicate whether to set the X-Service-Catalog header. If False,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# middleware will not ask for service catalog on token validation and will not
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# set the X-Service-Catalog header. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#include_service_catalog = true
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Used to control the use and type of token binding. Can be set to: "disabled"
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# to not check token binding. "permissive" (default) to validate binding
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# information if the bind type is of a form known to the server and ignore it if
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# not. "strict" like "permissive" but if the bind type is unknown the token will
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# be rejected. "required" any form of token binding is needed to be allowed.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Finally the name of a binding method that must be present in tokens. (string
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#include_service_catalog = true
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Used to control the use and type of token binding. Can be set to:
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# "disabled" to not check token binding. "permissive" (default) to
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# validate binding information if the bind type is of a form known to
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# the server and ignore it if not. "strict" like "permissive" but if
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# the bind type is unknown the token will be rejected. "required" any
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# form of token binding is needed to be allowed. Finally the name of a
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# binding method that must be present in tokens. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #enforce_token_bind = permissive
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# If true, the revocation list will be checked for cached tokens. This
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# requires that PKI tokens are configured on the identity server.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# If true, the revocation list will be checked for cached tokens. This requires
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# that PKI tokens are configured on the identity server. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #check_revocations_for_cached = false
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Hash algorithms to use for hashing PKI tokens. This may be a single
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# algorithm or multiple. The algorithms are those supported by Python
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# standard hashlib.new(). The hashes will be tried in the order given,
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# so put the preferred one first for performance. The result of the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# first hash will be stored in the cache. This will typically be set
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# to multiple values only while migrating from a less secure algorithm
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# to a more secure one. Once all the old tokens are expired this
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# option should be set to a single value for better performance. (list
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Hash algorithms to use for hashing PKI tokens. This may be a single algorithm
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# or multiple. The algorithms are those supported by Python standard
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# hashlib.new(). The hashes will be tried in the order given, so put the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# preferred one first for performance. The result of the first hash will be
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# stored in the cache. This will typically be set to multiple values only while
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# migrating from a less secure algorithm to a more secure one. Once all the old
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# tokens are expired this option should be set to a single value for better
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# performance. (list value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #hash_algorithms = md5
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Authentication type to load (unknown value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Deprecated group/name - [DEFAULT]/auth_plugin
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Authentication type to load (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [keystone_authtoken]/auth_plugin
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #auth_type = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Config Section from which to load plugin specific options (unknown
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Config Section from which to load plugin specific options (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #auth_section = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: @@ -984,32 +1317,44 @@
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # From oslo.messaging
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Host to locate redis. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEPRECATED: Host to locate redis. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #host = 127.0.0.1
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Use this port to connect to redis host. (port value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEPRECATED: Use this port to connect to redis host. (port value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Minimum value: 0
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Maximum value: 65535
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #port = 6379
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Password for Redis server (optional). (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEPRECATED: Password for Redis server (optional). (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #password =
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# List of Redis Sentinel hosts (fault tolerance mode) e.g.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEPRECATED: List of Redis Sentinel hosts (fault tolerance mode) e.g.
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # [host:port, host1:port ... ] (list value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #sentinel_hosts =
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Redis replica set name. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #sentinel_group_name = oslo-messaging-zeromq
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Time in ms to wait between connection attempts. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#wait_timeout = 500
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#wait_timeout = 2000
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Time in ms to wait before the transaction is killed. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #check_timeout = 20000
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Timeout in ms on blocking socket operations (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#socket_timeout = 1000
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#socket_timeout = 10000
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  [oslo_messaging_amqp]
Sep 28 11:21:28 ctl02 salt-minion[14967]: @@ -1017,6 +1362,101 @@
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # From oslo.messaging
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Name for the AMQP container. must be globally unique. Defaults to a generated
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# UUID (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/container_name
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#container_name = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Timeout for inactive connections (in seconds) (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/idle_timeout
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#idle_timeout = 0
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Debug: dump AMQP frames to stdout (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/trace
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#trace = false
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# CA certificate PEM file to verify server certificate (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/ssl_ca_file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#ssl_ca_file =
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Identifying certificate PEM file to present to clients (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/ssl_cert_file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#ssl_cert_file =
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Private key PEM file used to sign cert_file certificate (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/ssl_key_file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#ssl_key_file =
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Password for decrypting ssl_key_file (if encrypted) (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/ssl_key_password
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#ssl_key_password = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Accept clients using either SSL or plain TCP (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/allow_insecure_clients
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#allow_insecure_clients = false
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Space separated list of acceptable SASL mechanisms (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/sasl_mechanisms
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#sasl_mechanisms =
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Path to directory that contains the SASL configuration (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/sasl_config_dir
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#sasl_config_dir =
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Name of configuration file (without .conf suffix) (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/sasl_config_name
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#sasl_config_name =
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# User name for message broker authentication (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/username
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#username =
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Password for message broker authentication (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/password
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#password =
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Seconds to pause before attempting to re-connect. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#connection_retry_interval = 1
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Increase the connection_retry_interval by this many seconds after each
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# unsuccessful failover attempt. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#connection_retry_backoff = 2
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Maximum limit for connection_retry_interval + connection_retry_backoff
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#connection_retry_interval_max = 30
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Time to pause between re-connecting an AMQP 1.0 link that failed due to a
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# recoverable error. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#link_retry_delay = 10
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The deadline for an rpc reply message delivery. Only used when caller does not
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# provide a timeout expiry. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 5
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#default_reply_timeout = 30
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The deadline for an rpc cast or call message delivery. Only used when caller
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# does not provide a timeout expiry. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 5
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#default_send_timeout = 30
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The deadline for a sent notification message delivery. Only used when caller
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# does not provide a timeout expiry. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 5
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#default_notify_timeout = 30
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Indicates the addressing mode used by the driver.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Permitted values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# 'legacy'   - use legacy non-routable addressing
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# 'routable' - use routable addresses
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# 'dynamic'  - use legacy addresses if the message bus does not support routing
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# otherwise use routable addressing (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#addressing_mode = dynamic
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # address prefix used when sending to a specific server (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [amqp1]/server_request_prefix
Sep 28 11:21:28 ctl02 salt-minion[14967]: @@ -1030,60 +1470,54 @@
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [amqp1]/group_request_prefix
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #group_request_prefix = unicast
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Name for the AMQP container (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/container_name
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#container_name = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Timeout for inactive connections (in seconds) (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/idle_timeout
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#idle_timeout = 0
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Debug: dump AMQP frames to stdout (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/trace
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#trace = false
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# CA certificate PEM file to verify server certificate (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/ssl_ca_file
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#ssl_ca_file =
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Identifying certificate PEM file to present to clients (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/ssl_cert_file
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#ssl_cert_file =
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Private key PEM file used to sign cert_file certificate (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/ssl_key_file
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#ssl_key_file =
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Password for decrypting ssl_key_file (if encrypted) (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/ssl_key_password
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#ssl_key_password = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Accept clients using either SSL or plain TCP (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/allow_insecure_clients
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#allow_insecure_clients = false
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Space separated list of acceptable SASL mechanisms (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/sasl_mechanisms
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#sasl_mechanisms =
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Path to directory that contains the SASL configuration (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/sasl_config_dir
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#sasl_config_dir =
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Name of configuration file (without .conf suffix) (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/sasl_config_name
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#sasl_config_name =
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# User name for message broker authentication (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/username
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#username =
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Password for message broker authentication (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/password
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#password =
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Address prefix for all generated RPC addresses (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#rpc_address_prefix = openstack.org/om/rpc
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Address prefix for all generated Notification addresses (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#notify_address_prefix = openstack.org/om/notify
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Appended to the address prefix when sending a fanout message. Used by the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# message bus to identify fanout messages. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#multicast_address = multicast
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Appended to the address prefix when sending to a particular RPC/Notification
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# server. Used by the message bus to identify messages sent to a single
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# destination. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#unicast_address = unicast
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Appended to the address prefix when sending to a group of consumers. Used by
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the message bus to identify messages that should be delivered in a round-robin
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# fashion across consumers. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#anycast_address = anycast
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Exchange name used in notification addresses.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Exchange name resolution precedence:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Target.exchange if set
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# else default_notification_exchange if set
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# else control_exchange if set
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# else 'notify' (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#default_notification_exchange = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: +default_notification_exchange = glance
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Exchange name used in RPC addresses.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Exchange name resolution precedence:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Target.exchange if set
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# else default_rpc_exchange if set
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# else control_exchange if set
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# else 'rpc' (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#default_rpc_exchange = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Window size for incoming RPC Reply messages. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#reply_link_credit = 200
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Window size for incoming RPC Request messages (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#rpc_server_credit = 100
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Window size for incoming Notification messages (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#notify_server_credit = 100
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  [oslo_messaging_notifications]
Sep 28 11:21:28 ctl02 salt-minion[14967]: @@ -1092,14 +1526,13 @@
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # From oslo.messaging
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The Drivers(s) to handle sending notifications. Possible values are
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# messaging, messagingv2, routing, log, test, noop (multi valued)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The Drivers(s) to handle sending notifications. Possible values are messaging,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# messagingv2, routing, log, test, noop (multi valued)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/notification_driver
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #driver =
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# A URL representing the messaging driver to use for notifications. If
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# not set, we fall back to the same configuration used for RPC.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +driver = messagingv2
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# A URL representing the messaging driver to use for notifications. If not set,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# we fall back to the same configuration used for RPC. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/notification_transport_url
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #transport_url = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: @@ -1124,9 +1557,9 @@
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/amqp_auto_delete
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #amqp_auto_delete = false
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# SSL version to use (valid only if SSL enabled). Valid values are
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# TLSv1 and SSLv23. SSLv2, SSLv3, TLSv1_1, and TLSv1_2 may be
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# available on some distributions. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# SSL version to use (valid only if SSL enabled). Valid values are TLSv1 and
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# SSLv23. SSLv2, SSLv3, TLSv1_1, and TLSv1_2 may be available on some
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# distributions. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/kombu_ssl_version
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #kombu_ssl_version =
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: @@ -1138,117 +1571,131 @@
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/kombu_ssl_certfile
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #kombu_ssl_certfile =
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# SSL certification authority file (valid only if SSL enabled).
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# SSL certification authority file (valid only if SSL enabled). (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/kombu_ssl_ca_certs
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #kombu_ssl_ca_certs =
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# How long to wait before reconnecting in response to an AMQP consumer
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# cancel notification. (floating point value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# How long to wait before reconnecting in response to an AMQP consumer cancel
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# notification. (floating point value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/kombu_reconnect_delay
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #kombu_reconnect_delay = 1.0
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# EXPERIMENTAL: Possible values are: gzip, bz2. If not set compression
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# will not be used. This option may notbe available in future
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# versions. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# EXPERIMENTAL: Possible values are: gzip, bz2. If not set compression will not
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# be used. This option may not be available in future versions. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #kombu_compression = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# How long to wait a missing client beforce abandoning to send it its
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# replies. This value should not be longer than rpc_response_timeout.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Deprecated group/name - [DEFAULT]/kombu_reconnect_timeout
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# How long to wait a missing client before abandoning to send it its replies.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This value should not be longer than rpc_response_timeout. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [oslo_messaging_rabbit]/kombu_reconnect_timeout
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #kombu_missing_consumer_retry_timeout = 60
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Determines how the next RabbitMQ node is chosen in case the one we
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# are currently connected to becomes unavailable. Takes effect only if
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# more than one RabbitMQ node is provided in config. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Determines how the next RabbitMQ node is chosen in case the one we are
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# currently connected to becomes unavailable. Takes effect only if more than one
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# RabbitMQ node is provided in config. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Allowed values: round-robin, shuffle
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #kombu_failover_strategy = round-robin
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The RabbitMQ broker address where a single node is used. (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEPRECATED: The RabbitMQ broker address where a single node is used. (string
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rabbit_host
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #rabbit_host = localhost
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The RabbitMQ broker port where a single node is used. (port value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEPRECATED: The RabbitMQ broker port where a single node is used. (port value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Minimum value: 0
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Maximum value: 65535
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rabbit_port
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #rabbit_port = 5672
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# RabbitMQ HA cluster host:port pairs. (list value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEPRECATED: RabbitMQ HA cluster host:port pairs. (list value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rabbit_hosts
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #rabbit_hosts = $rabbit_host:$rabbit_port
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Connect over SSL for RabbitMQ. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rabbit_use_ssl
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #rabbit_use_ssl = false
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The RabbitMQ userid. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEPRECATED: The RabbitMQ userid. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rabbit_userid
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #rabbit_userid = guest
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The RabbitMQ password. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEPRECATED: The RabbitMQ password. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rabbit_password
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #rabbit_password = guest
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # The RabbitMQ login method. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rabbit_login_method
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #rabbit_login_method = AMQPLAIN
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The RabbitMQ virtual host. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEPRECATED: The RabbitMQ virtual host. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rabbit_virtual_host
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #rabbit_virtual_host = /
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # How frequently to retry connecting with RabbitMQ. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #rabbit_retry_interval = 1
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# How long to backoff for between retries when connecting to RabbitMQ.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# How long to backoff for between retries when connecting to RabbitMQ. (integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rabbit_retry_backoff
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #rabbit_retry_backoff = 2
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Maximum interval of RabbitMQ connection retries. Default is 30
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# seconds. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Maximum interval of RabbitMQ connection retries. Default is 30 seconds.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #rabbit_interval_max = 30
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Maximum number of RabbitMQ connection retries. Default is 0
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEPRECATED: Maximum number of RabbitMQ connection retries. Default is 0
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # (infinite retry count). (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rabbit_max_retries
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #rabbit_max_retries = 0
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Try to use HA queues in RabbitMQ (x-ha-policy: all). If you change
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# this option, you must wipe the RabbitMQ database. In RabbitMQ 3.0,
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# queue mirroring is no longer controlled by the x-ha-policy argument
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# when declaring a queue. If you just want to make sure that all
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# queues (except  those with auto-generated names) are mirrored across
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# all nodes, run: "rabbitmqctl set_policy HA '^(?!amq\.).*' '{"ha-
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# mode": "all"}' " (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Try to use HA queues in RabbitMQ (x-ha-policy: all). If you change this
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# option, you must wipe the RabbitMQ database. In RabbitMQ 3.0, queue mirroring
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# is no longer controlled by the x-ha-policy argument when declaring a queue. If
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# you just want to make sure that all queues (except  those with auto-generated
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# names) are mirrored across all nodes, run: "rabbitmqctl set_policy HA
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# '^(?!amq\.).*' '{"ha-mode": "all"}' " (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rabbit_ha_queues
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #rabbit_ha_queues = false
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Positive integer representing duration in seconds for queue TTL
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (x-expires). Queues which are unused for the duration of the TTL are
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# automatically deleted. The parameter affects only reply and fanout
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# queues. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Positive integer representing duration in seconds for queue TTL (x-expires).
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Queues which are unused for the duration of the TTL are automatically deleted.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The parameter affects only reply and fanout queues. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Minimum value: 1
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#rabbit_transient_queues_ttl = 600
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Specifies the number of messages to prefetch. Setting to zero allows
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# unlimited messages. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#rabbit_transient_queues_ttl = 1800
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Specifies the number of messages to prefetch. Setting to zero allows unlimited
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# messages. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #rabbit_qos_prefetch_count = 0
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Number of seconds after which the Rabbit broker is considered down
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# if heartbeat's keep-alive fails (0 disable the heartbeat).
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# EXPERIMENTAL (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Number of seconds after which the Rabbit broker is considered down if
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# heartbeat's keep-alive fails (0 disable the heartbeat). EXPERIMENTAL (integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #heartbeat_timeout_threshold = 60
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# How often times during the heartbeat_timeout_threshold we check the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# heartbeat. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# How often times during the heartbeat_timeout_threshold we check the heartbeat.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #heartbeat_rate = 2
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Deprecated, use rpc_backend=kombu+memory or rpc_backend=fake
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated, use rpc_backend=kombu+memory or rpc_backend=fake (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/fake_rabbit
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #fake_rabbit = false
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: @@ -1258,9 +1705,8 @@
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # The maximum byte size for an AMQP frame (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #frame_max = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# How often to send heartbeats for consumer's connections (integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#heartbeat_interval = 1
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# How often to send heartbeats for consumer's connections (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#heartbeat_interval = 3
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Enable SSL (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #ssl = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: @@ -1268,59 +1714,58 @@
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Arguments passed to ssl.wrap_socket (dict value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #ssl_options = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Set socket timeout in seconds for connection's socket (floating
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Set socket timeout in seconds for connection's socket (floating point value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#socket_timeout = 0.25
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Set TCP_USER_TIMEOUT in seconds for connection's socket (floating point value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#tcp_user_timeout = 0.25
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Set delay for reconnection to some host which has connection error (floating
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # point value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#socket_timeout = 0.25
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Set TCP_USER_TIMEOUT in seconds for connection's socket (floating
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# point value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#tcp_user_timeout = 0.25
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Set delay for reconnection to some host which has connection error
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (floating point value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #host_connection_reconnect_delay = 0.25
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Connection factory implementation (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Allowed values: new, single, read_write
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#connection_factory = single
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Maximum number of connections to keep queued. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#pool_max_size = 10
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Maximum number of connections to create above `pool_max_size`.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#pool_max_size = 30
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Maximum number of connections to create above `pool_max_size`. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#pool_max_overflow = 0
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Default number of seconds to wait for a connections to available (integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#pool_timeout = 30
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Lifetime of a connection (since creation) in seconds or None for no recycling.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Expired connections are closed on acquire. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#pool_recycle = 600
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Threshold at which inactive (since release) connections are considered stale
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# in seconds or None for no staleness. Stale connections are closed on acquire.
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#pool_max_overflow = 0
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Default number of seconds to wait for a connections to available
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#pool_timeout = 30
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Lifetime of a connection (since creation) in seconds or None for no
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# recycling. Expired connections are closed on acquire. (integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#pool_recycle = 600
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Threshold at which inactive (since release) connections are
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# considered stale in seconds or None for no staleness. Stale
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# connections are closed on acquire. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #pool_stale = 60
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Persist notification messages. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #notification_persistence = false
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Exchange name for for sending notifications (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Exchange name for sending notifications (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #default_notification_exchange = ${control_exchange}_notification
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Max number of not acknowledged message which RabbitMQ can send to
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# notification listener. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Max number of not acknowledged message which RabbitMQ can send to notification
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# listener. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #notification_listener_prefetch_count = 100
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Reconnecting retry count in case of connectivity problem during
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# sending notification, -1 means infinite retry. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reconnecting retry count in case of connectivity problem during sending
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# notification, -1 means infinite retry. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #default_notification_retry_attempts = -1
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Reconnecting retry delay in case of connectivity problem during
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# sending notification message (floating point value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reconnecting retry delay in case of connectivity problem during sending
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# notification message (floating point value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #notification_retry_delay = 0.25
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Time to live for rpc queues without consumers in seconds. (integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Time to live for rpc queues without consumers in seconds. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #rpc_queue_expiration = 60
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Exchange name for sending RPC messages (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: @@ -1329,32 +1774,125 @@
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Exchange name for receiving RPC replies (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #rpc_reply_exchange = ${control_exchange}_rpc_reply
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Max number of not acknowledged message which RabbitMQ can send to
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# rpc listener. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Max number of not acknowledged message which RabbitMQ can send to rpc
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# listener. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #rpc_listener_prefetch_count = 100
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Max number of not acknowledged message which RabbitMQ can send to
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# rpc reply listener. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Max number of not acknowledged message which RabbitMQ can send to rpc reply
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# listener. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #rpc_reply_listener_prefetch_count = 100
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Reconnecting retry count in case of connectivity problem during
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# sending reply. -1 means infinite retry during rpc_timeout (integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reconnecting retry count in case of connectivity problem during sending reply.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# -1 means infinite retry during rpc_timeout (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#rpc_reply_retry_attempts = -1
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reconnecting retry delay in case of connectivity problem during sending reply.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# (floating point value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#rpc_reply_retry_delay = 0.25
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reconnecting retry count in case of connectivity problem during sending RPC
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# message, -1 means infinite retry. If actual retry attempts in not 0 the rpc
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# request could be processed more then one time (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#default_rpc_retry_attempts = -1
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reconnecting retry delay in case of connectivity problem during sending RPC
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# message (floating point value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#rpc_retry_delay = 0.25
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +[oslo_messaging_zmq]
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# From oslo.messaging
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ZeroMQ bind address. Should be a wildcard (*), an ethernet interface, or IP.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The "host" option should point or resolve to this address. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_bind_address
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#rpc_zmq_bind_address = *
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# MatchMaker driver. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Allowed values: redis, dummy
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_matchmaker
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#rpc_zmq_matchmaker = redis
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Number of ZeroMQ contexts, defaults to 1. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_contexts
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#rpc_zmq_contexts = 1
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Maximum number of ingress messages to locally buffer per topic. Default is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# unlimited. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_topic_backlog
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#rpc_zmq_topic_backlog = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Directory for holding IPC sockets. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_ipc_dir
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#rpc_zmq_ipc_dir = /var/run/openstack
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Name of this node. Must be a valid hostname, FQDN, or IP address. Must match
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# "host" option, if running Nova. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_host
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#rpc_zmq_host = localhost
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Seconds to wait before a cast expires (TTL). The default value of -1 specifies
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# an infinite linger period. The value of 0 specifies no linger period. Pending
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# messages shall be discarded immediately when the socket is closed. Only
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# supported by impl_zmq. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_cast_timeout
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#rpc_cast_timeout = -1
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The default number of seconds that poll should wait. Poll raises timeout
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# exception when timeout expired. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_poll_timeout
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#rpc_poll_timeout = 1
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Expiration timeout in seconds of a name service record about existing target (
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# < 0 means no timeout). (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/zmq_target_expire
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#zmq_target_expire = 300
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Update period in seconds of a name service record about existing target.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/zmq_target_update
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#zmq_target_update = 180
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Use PUB/SUB pattern for fanout methods. PUB/SUB always uses proxy. (boolean
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#rpc_reply_retry_attempts = -1
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Reconnecting retry delay in case of connectivity problem during
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# sending reply. (floating point value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#rpc_reply_retry_delay = 0.25
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Reconnecting retry count in case of connectivity problem during
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# sending RPC message, -1 means infinite retry. If actual retry
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# attempts in not 0 the rpc request could be processed more then one
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# time (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#default_rpc_retry_attempts = -1
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Reconnecting retry delay in case of connectivity problem during
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# sending RPC message (floating point value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#rpc_retry_delay = 0.25
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/use_pub_sub
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#use_pub_sub = true
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Use ROUTER remote proxy. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/use_router_proxy
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#use_router_proxy = true
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimal port number for random ports range. (port value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Maximum value: 65535
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_min_port
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#rpc_zmq_min_port = 49153
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Maximal port number for random ports range. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Maximum value: 65536
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_max_port
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#rpc_zmq_max_port = 65536
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Number of retries to find free port number before fail with ZMQBindError.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_bind_port_retries
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#rpc_zmq_bind_port_retries = 100
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Default serialization mechanism for serializing/deserializing
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# outgoing/incoming messages (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Allowed values: json, msgpack
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_serialization
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#rpc_zmq_serialization = json
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option configures round-robin mode in zmq socket. True means not keeping
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# a queue when server side disconnects. False means to keep queue and messages
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# even if server is disconnected, when the server appears we send all
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# accumulated messages to it. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#zmq_immediate = false
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  [oslo_policy]
Sep 28 11:21:28 ctl02 salt-minion[14967]: @@ -1366,17 +1904,17 @@
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # The JSON file that defines policies. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/policy_file
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #policy_file = policy.json
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Default rule. Enforced when a requested rule is not found. (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +policy_file = /etc/glance/policy.json
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Default rule. Enforced when a requested rule is not found. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/policy_default_rule
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #policy_default_rule = default
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Directories where policy configuration files are stored. They can be
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# relative to any directory in the search path defined by the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# config_dir option, or absolute paths. The file defined by
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# policy_file must exist for these directories to be searched.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Missing or empty directories are ignored. (multi valued)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Directories where policy configuration files are stored. They can be relative
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# to any directory in the search path defined by the config_dir option, or
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# absolute paths. The file defined by policy_file must exist for these
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# directories to be searched.  Missing or empty directories are ignored. (multi
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# valued)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/policy_dirs
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #policy_dirs = policy.d
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: @@ -1387,14 +1925,59 @@
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # From glance.registry
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Partial name of a pipeline in your paste configuration file with the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# service name removed. For example, if your paste section name is
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# [pipeline:glance-api-keystone] use the value "keystone" (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#flavor = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Name of the paste configuration file. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#config_file = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deployment flavor to use in the server application pipeline.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a string value representing the appropriate deployment
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# flavor used in the server application pipleline. This is typically
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the partial name of a pipeline in the paste configuration file with
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the service name removed.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# For example, if your paste section name in the paste configuration
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# file is [pipeline:glance-api-keystone], set ``flavor`` to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``keystone``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * String value representing a partial pipeline name.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related Options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * config_file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#flavor = keystone
Sep 28 11:21:28 ctl02 salt-minion[14967]: +flavor = keystone
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Name of the paste configuration file.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a string value representing the name of the paste
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# configuration file to use for configuring piplelines for
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# server application deployments.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTES:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Provide the name or the path relative to the glance directory
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       for the paste configuration file and not the absolute path.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * The sample paste configuration file shipped with Glance need
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       not be edited in most cases as it comes with ready-made
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       pipelines for all common deployment flavors.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# If no value is specified for this option, the ``paste.ini`` file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# with the prefix of the corresponding Glance service's configuration
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# file name will be searched for in the known configuration
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# directories. (For example, if this option is missing from or has no
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# value set in ``glance-api.conf``, the service will look for a file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# named ``glance-api-paste.ini``.) If the paste configuration file is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# not found, the service will not start.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A string value representing the name of the paste configuration
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       file.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related Options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * flavor
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#config_file = glance-api-paste.ini
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  [profiler]
Sep 28 11:21:28 ctl02 salt-minion[14967]: @@ -1403,12 +1986,56 @@
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # From glance.registry
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# If False fully disable profiling feature. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Enables the profiling for all services on this node. Default value is False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# (fully disable the profiling feature).
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# * True: Enables the feature
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# * False: Disables the feature. The profiling cannot be started via this
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# project
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# operations. If the profiling is triggered by another project, this project
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# part
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# will be empty.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [profiler]/profiler_enabled
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #enabled = false
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# If False doesn't trace SQL requests. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Enables SQL requests profiling in services. Default value is False (SQL
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# requests won't be traced).
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# * True: Enables SQL requests profiling. Each SQL query will be part of the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# trace and can the be analyzed by how much time was spent for that.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# * False: Disables SQL requests profiling. The spent time is only shown on a
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# higher level of operations. Single SQL queries cannot be analyzed this
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# way.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #trace_sqlalchemy = false
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Secret key to use to sign Glance API and Glance Registry services
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# tracing messages. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Secret key(s) to use for encrypting context data for performance profiling.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This string value should have the following format: <key1>[,<key2>,...<keyn>],
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# where each key is some random string. A user who triggers the profiling via
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the REST API has to set one of these keys in the headers of the REST API call
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# to include profiling results of this node for this particular project.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Both "enabled" flag and "hmac_keys" config options should be set to enable
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# profiling. Also, to generate correct profiling information across all services
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# at least one key needs to be consistent between OpenStack projects. This
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ensures it can be used from client side to generate the trace, containing
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# information from all possible resources. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #hmac_keys = SECRET_KEY
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Connection string for a notifier backend. Default value is messaging:// which
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# sets the notifier to oslo_messaging.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Examples of possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# * messaging://: use oslo_messaging driver for sending notifications.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#connection_string = messaging://
Sep 28 11:21:28 ctl02 salt-minion[14967]: [INFO    ] Completed state [/etc/glance/glance-registry.conf] at time 11:21:28.697297 duration_in_ms=87.995
Sep 28 11:21:28 ctl02 salt-minion[14967]: [INFO    ] Running state [/etc/glance/glance-scrubber.conf] at time 11:21:28.697590
Sep 28 11:21:28 ctl02 salt-minion[14967]: [INFO    ] Executing state file.managed for /etc/glance/glance-scrubber.conf
Sep 28 11:21:28 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'glance/files/ocata/glance-scrubber.conf.Debian'
Sep 28 11:21:28 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'glance/map.jinja'
Sep 28 11:21:28 ctl02 salt-minion[14967]: [INFO    ] File changed:
Sep 28 11:21:28 ctl02 salt-minion[14967]: ---
Sep 28 11:21:28 ctl02 salt-minion[14967]: +++
Sep 28 11:21:28 ctl02 salt-minion[14967]: @@ -1,348 +1,984 @@
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]:  [DEFAULT]
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # From glance.scrubber
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Whether to allow users to specify image properties beyond what the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# image schema provides (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Allow users to add additional/custom properties to images.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Glance defines a standard set of properties (in its schema) that
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# appear on every image. These properties are also known as
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``base properties``. In addition to these properties, Glance
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# allows users to add custom properties to images. These are known
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# as ``additional properties``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# By default, this configuration option is set to ``True`` and users
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# are allowed to add additional properties. The number of additional
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# properties that can be added to an image can be controlled via
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``image_property_quota`` configuration option.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * image_property_quota
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #allow_additional_image_properties = true
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Maximum number of image members per image. Negative values evaluate
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# to unlimited. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Maximum number of image members per image.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This limits the maximum of users an image can be shared with. Any negative
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# value is interpreted as unlimited.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #image_member_quota = 128
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Maximum number of properties allowed on an image. Negative values
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# evaluate to unlimited. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Maximum number of properties allowed on an image.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This enforces an upper limit on the number of additional properties an image
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# can have. Any negative value is interpreted as unlimited.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: This won't have any impact if additional properties are disabled. Please
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# refer to ``allow_additional_image_properties``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * ``allow_additional_image_properties``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #image_property_quota = 128
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Maximum number of tags allowed on an image. Negative values evaluate
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# to unlimited. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Maximum number of tags allowed on an image.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Any negative value is interpreted as unlimited.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #image_tag_quota = 128
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Maximum number of locations allowed on an image. Negative values
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# evaluate to unlimited. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Maximum number of locations allowed on an image.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Any negative value is interpreted as unlimited.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #image_location_quota = 10
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Python module path of data access API (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Python module path of data access API.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Specifies the path to the API to use for accessing the data model.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option determines how the image catalog data will be accessed.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * glance.db.sqlalchemy.api
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * glance.db.registry.api
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * glance.db.simple.api
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# If this option is set to ``glance.db.sqlalchemy.api`` then the image
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# catalog data is stored in and read from the database via the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# SQLAlchemy Core and ORM APIs.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Setting this option to ``glance.db.registry.api`` will force all
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# database access requests to be routed through the Registry service.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This avoids data access from the Glance API nodes for an added layer
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# of security, scalability and manageability.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: In v2 OpenStack Images API, the registry service is optional.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# In order to use the Registry API in v2, the option
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``enable_v2_registry`` must be set to ``True``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Finally, when this configuration option is set to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``glance.db.simple.api``, image catalog data is stored in and read
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# from an in-memory data structure. This is primarily used for testing.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * enable_v2_api
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * enable_v2_registry
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #data_api = glance.db.sqlalchemy.api
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Default value for the number of items returned by a request if not
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# specified explicitly in the request (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The default number of results to return for a request.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Responses to certain API requests, like list images, may return
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# multiple items. The number of results returned can be explicitly
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# controlled by specifying the ``limit`` parameter in the API request.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# However, if a ``limit`` parameter is not specified, this
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# configuration value will be used as the default number of results to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# be returned for any API request.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTES:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * The value of this configuration option may not be greater than
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       the value specified by ``api_limit_max``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Setting this to a very large value may slow down database
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       queries and increase response times. Setting this to a
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       very low value may result in poor user experience.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Any positive integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * api_limit_max
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #limit_param_default = 25
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Maximum permissible number of items that could be returned by a
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# request (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Maximum number of results that could be returned by a request.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# As described in the help text of ``limit_param_default``, some
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# requests may return multiple results. The number of results to be
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# returned are governed either by the ``limit`` parameter in the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# request or the ``limit_param_default`` configuration option.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The value in either case, can't be greater than the absolute maximum
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# defined by this configuration option. Anything greater than this
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# value is trimmed down to the maximum value defined here.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: Setting this to a very large value may slow down database
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       queries and increase response times. Setting this to a
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       very low value may result in poor user experience.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Any positive integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * limit_param_default
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #api_limit_max = 1000
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Whether to include the backend image storage location in image
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# properties. Revealing storage location can be a security risk, so
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# use this setting with caution! (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Show direct image location when returning an image.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This configuration option indicates whether to show the direct image
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# location when returning image details to the user. The direct image
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# location is where the image data is stored in backend storage. This
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# image location is shown under the image property ``direct_url``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When multiple image locations exist for an image, the best location
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# is displayed based on the location strategy indicated by the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# configuration option ``location_strategy``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTES:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Revealing image locations can present a GRAVE SECURITY RISK as
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       image locations can sometimes include credentials. Hence, this
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       is set to ``False`` by default. Set this to ``True`` with
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       EXTREME CAUTION and ONLY IF you know what you are doing!
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * If an operator wishes to avoid showing any image location(s)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       to the user, then both this option and
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       ``show_multiple_locations`` MUST be set to ``False``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * show_multiple_locations
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * location_strategy
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #show_image_direct_url = false
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Whether to include the backend image locations in image properties.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# For example, if using the file system store a URL of
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# "file:///path/to/image" will be returned to the user in the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# 'direct_url' meta-data field. Revealing storage location can be a
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# security risk, so use this setting with caution! Setting this to
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# true overrides the show_image_direct_url option. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEPRECATED:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Show all image locations when returning an image.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This configuration option indicates whether to show all the image
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# locations when returning image details to the user. When multiple
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# image locations exist for an image, the locations are ordered based
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# on the location strategy indicated by the configuration opt
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``location_strategy``. The image locations are shown under the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# image property ``locations``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTES:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Revealing image locations can present a GRAVE SECURITY RISK as
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       image locations can sometimes include credentials. Hence, this
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       is set to ``False`` by default. Set this to ``True`` with
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       EXTREME CAUTION and ONLY IF you know what you are doing!
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * If an operator wishes to avoid showing any image location(s)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       to the user, then both this option and
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       ``show_image_direct_url`` MUST be set to ``False``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * show_image_direct_url
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * location_strategy
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option is deprecated for removal since Newton.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reason: This option will be removed in the Ocata release because the same
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# functionality can be achieved with greater granularity by using policies.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Please see the Newton release notes for more information.
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #show_multiple_locations = false
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Maximum size of image a user can upload in bytes. Defaults to
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# 1099511627776 bytes (1 TB).WARNING: this value should only be
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# increased after careful consideration and must be set to a value
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# under 8 EB (9223372036854775808). (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Maximum size of image a user can upload in bytes.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# An image upload greater than the size mentioned here would result
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# in an image creation failure. This configuration option defaults to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# 1099511627776 bytes (1 TiB).
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTES:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * This value should only be increased after careful
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       consideration and must be set less than or equal to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       8 EiB (9223372036854775808).
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * This value must be set with careful consideration of the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       backend storage capacity. Setting this to a very low value
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       may result in a large number of image failures. And, setting
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       this to a very large value may result in faster consumption
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       of storage. Hence, this must be set according to the nature of
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       images created and storage capacity available.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Any positive number less than or equal to 9223372036854775808
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Maximum value: 9223372036854775808
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #image_size_cap = 1099511627776
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Set a system wide quota for every user. This value is the total
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# capacity that a user can use across all storage systems. A value of
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# 0 means unlimited.Optional unit can be specified for the value.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Accepted units are B, KB, MB, GB and TB representing Bytes,
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# KiloBytes, MegaBytes, GigaBytes and TeraBytes respectively. If no
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# unit is specified then Bytes is assumed. Note that there should not
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# be any space between value and unit and units are case sensitive.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Maximum amount of image storage per tenant.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This enforces an upper limit on the cumulative storage consumed by all images
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# of a tenant across all stores. This is a per-tenant limit.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The default unit for this configuration option is Bytes. However, storage
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# units can be specified using case-sensitive literals ``B``, ``KB``, ``MB``,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``GB`` and ``TB`` representing Bytes, KiloBytes, MegaBytes, GigaBytes and
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# TeraBytes respectively. Note that there should not be any space between the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# value and unit. Value ``0`` signifies no quota enforcement. Negative values
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# are invalid and result in errors.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A string that is a valid concatenation of a non-negative integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       representing the storage value and an optional string literal
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       representing storage units as mentioned above.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #user_storage_quota = 0
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Deploy the v1 OpenStack Images API. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deploy the v1 OpenStack Images API.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When this option is set to ``True``, Glance service will respond to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# requests on registered endpoints conforming to the v1 OpenStack
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Images API.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTES:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * If this option is enabled, then ``enable_v1_registry`` must
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       also be set to ``True`` to enable mandatory usage of Registry
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       service with v1 API.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * If this option is disabled, then the ``enable_v1_registry``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       option, which is enabled by default, is also recommended
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       to be disabled.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * This option is separate from ``enable_v2_api``, both v1 and v2
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       OpenStack Images API can be deployed independent of each
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       other.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * If deploying only the v2 Images API, this option, which is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       enabled by default, should be disabled.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * enable_v1_registry
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * enable_v2_api
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #enable_v1_api = true
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Deploy the v2 OpenStack Images API. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deploy the v2 OpenStack Images API.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When this option is set to ``True``, Glance service will respond
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# to requests on registered endpoints conforming to the v2 OpenStack
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Images API.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTES:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * If this option is disabled, then the ``enable_v2_registry``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       option, which is enabled by default, is also recommended
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       to be disabled.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * This option is separate from ``enable_v1_api``, both v1 and v2
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       OpenStack Images API can be deployed independent of each
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       other.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * If deploying only the v1 Images API, this option, which is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       enabled by default, should be disabled.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * enable_v2_registry
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * enable_v1_api
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #enable_v2_api = true
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Deploy the v1 OpenStack Registry API. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deploy the v1 API Registry service.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When this option is set to ``True``, the Registry service
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# will be enabled in Glance for v1 API requests.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTES:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Use of Registry is mandatory in v1 API, so this option must
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       be set to ``True`` if the ``enable_v1_api`` option is enabled.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * If deploying only the v2 OpenStack Images API, this option,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       which is enabled by default, should be disabled.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * enable_v1_api
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #enable_v1_registry = true
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Deploy the v2 OpenStack Registry API. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deploy the v2 API Registry service.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When this option is set to ``True``, the Registry service
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# will be enabled in Glance for v2 API requests.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTES:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Use of Registry is optional in v2 API, so this option
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       must only be enabled if both ``enable_v2_api`` is set to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       ``True`` and the ``data_api`` option is set to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       ``glance.db.registry.api``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * If deploying only the v1 OpenStack Images API, this option,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       which is enabled by default, should be disabled.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * enable_v2_api
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * data_api
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #enable_v2_registry = true
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The hostname/IP of the pydev process listening for debug connections
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#pydev_worker_debug_host = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The port on which a pydev process is listening for connections.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (port value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Host address of the pydev server.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a string value representing the hostname or IP of the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# pydev server to use for debugging. The pydev server listens for
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# debug connections on this address, facilitating remote debugging
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# in Glance.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Valid hostname
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Valid IP address
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#pydev_worker_debug_host = localhost
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Port number that the pydev server will listen on.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a port number to bind the pydev server to. The pydev
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# process accepts debug connections on this port and facilitates
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# remote debugging in Glance.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid port number
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (port value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Minimum value: 0
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Maximum value: 65535
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #pydev_worker_debug_port = 5678
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# AES key for encrypting store 'location' metadata. This includes, if
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# used, Swift or S3 credentials. Should be set to a random string of
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# length 16, 24 or 32 bytes (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# AES key for encrypting store location metadata.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a string value representing the AES cipher to use for
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# encrypting Glance store metadata.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: The AES key to use must be set to a random string of length
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# 16, 24 or 32 bytes.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * String value representing a valid AES key
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #metadata_encryption_key = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Digest algorithm which will be used for digital signature. Use the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# command "openssl list-message-digest-algorithms" to get the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# available algorithms supported by the version of OpenSSL on the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# platform. Examples are "sha1", "sha256", "sha512", etc. (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Digest algorithm to use for digital signature.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a string value representing the digest algorithm to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# use for generating digital signatures. By default, ``sha256``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# is used.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# To get a list of the available algorithms supported by the version
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# of OpenSSL on your platform, run the command:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``openssl list-message-digest-algorithms``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Examples are 'sha1', 'sha256', and 'sha512'.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: ``digest_algorithm`` is not related to Glance's image signing
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# and verification. It is only used to sign the universally unique
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# identifier (UUID) as a part of the certificate file and key file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# validation.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * An OpenSSL message digest algorithm identifier
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Relation options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #digest_algorithm = sha256
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The amount of time in seconds to delay before performing a delete.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The amount of time, in seconds, to delay image scrubbing.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When delayed delete is turned on, an image is put into ``pending_delete``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# state upon deletion until the scrubber deletes its image data. Typically, soon
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# after the image is put into ``pending_delete`` state, it is available for
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# scrubbing. However, scrubbing can be delayed until a later point using this
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# configuration option. This option denotes the time period an image spends in
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``pending_delete`` state before it is available for scrubbing.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# It is important to realize that this has storage implications. The larger the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``scrub_time``, the longer the time to reclaim backend storage from deleted
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# images.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Any non-negative integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * ``delayed_delete``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #scrub_time = 0
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The size of thread pool to be used for scrubbing images. The default
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# is one, which signifies serial scrubbing. Any value above one
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# indicates the max number of images that may be scrubbed in parallel.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The size of thread pool to be used for scrubbing images.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When there are a large number of images to scrub, it is beneficial to scrub
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# images in parallel so that the scrub queue stays in control and the backend
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# storage is reclaimed in a timely fashion. This configuration option denotes
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the maximum number of images to be scrubbed in parallel. The default value is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# one, which signifies serial scrubbing. Any value above one indicates parallel
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# scrubbing.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Any non-zero positive integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * ``delayed_delete``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #scrub_pool_size = 1
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Turn on/off delayed delete. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Turn on/off delayed delete.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Typically when an image is deleted, the ``glance-api`` service puts the image
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# into ``deleted`` state and deletes its data at the same time. Delayed delete
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# is a feature in Glance that delays the actual deletion of image data until a
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# later point in time (as determined by the configuration option
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``scrub_time``).
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When delayed delete is turned on, the ``glance-api`` service puts the image
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# into ``pending_delete`` state upon deletion and leaves the image data in the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# storage backend for the image scrubber to delete at a later time. The image
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# scrubber will move the image into ``deleted`` state upon successful deletion
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# of image data.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: When delayed delete is turned on, image scrubber MUST be running as a
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# periodic task to prevent the backend storage from filling up with undesired
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# usage.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * ``scrub_time``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * ``wakeup_time``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * ``scrub_pool_size``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #delayed_delete = false
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Role used to identify an authenticated user as administrator.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a string value representing a Keystone role to identify an
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# administrative user. Users with this role will be granted
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# administrative privileges. The default value for this option is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# 'admin'.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A string value which is a valid Keystone role
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #admin_role = admin
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Whether to pass through headers containing user and tenant
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# information when making requests to the registry. This allows the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# registry to use the context middleware without keystonemiddleware's
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# auth_token middleware, removing calls to the keystone auth service.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# It is recommended that when using this option, secure communication
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# between glance api and glance registry is ensured by means other
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# than auth_token middleware. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Send headers received from identity when making requests to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# registry.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Typically, Glance registry can be deployed in multiple flavors,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# which may or may not include authentication. For example,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``trusted-auth`` is a flavor that does not require the registry
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# service to authenticate the requests it receives. However, the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# registry service may still need a user context to be populated to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# serve the requests. This can be achieved by the caller
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# (the Glance API usually) passing through the headers it received
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# from authenticating with identity for the same request. The typical
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# headers sent are ``X-User-Id``, ``X-Tenant-Id``, ``X-Roles``,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``X-Identity-Status`` and ``X-Service-Catalog``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a boolean value to determine whether to send the identity
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# headers to provide tenant and user information along with the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# requests to registry service. By default, this option is set to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``False``, which means that user and tenant information is not
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# available readily. It must be obtained by authenticating. Hence, if
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# this is set to ``False``, ``flavor`` must be set to value that
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# either includes authentication or authenticated user context.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * flavor
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #send_identity_headers = false
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Loop time between checking for new items to schedule for delete.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Time interval, in seconds, between scrubber runs in daemon mode.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Scrubber can be run either as a cron job or daemon. When run as a daemon, this
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# configuration time specifies the time period between two runs. When the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# scrubber wakes up, it fetches and scrubs all ``pending_delete`` images that
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# are available for scrubbing after taking ``scrub_time`` into consideration.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# If the wakeup time is set to a large number, there may be a large number of
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# images to be scrubbed for each run. Also, this impacts how quickly the backend
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# storage is reclaimed.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Any non-negative integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * ``daemon``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * ``delayed_delete``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #wakeup_time = 300
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Run as a long-running process. When not specified (the default) run
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# the scrub operation once and then exits. When specified do not exit
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# and run scrub on wakeup_time interval as specified in the config.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +wakeup_time = 300
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Run scrubber as a daemon.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This boolean configuration option indicates whether scrubber should
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# run as a long-running process that wakes up at regular intervals to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# scrub images. The wake up interval can be specified using the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# configuration option ``wakeup_time``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# If this configuration option is set to ``False``, which is the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# default value, scrubber runs once to scrub images and exits. In this
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# case, if the operator wishes to implement continuous scrubbing of
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# images, scrubber needs to be scheduled as a cron job.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * ``wakeup_time``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #daemon = false
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The protocol to use for communication with the registry server.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Either http or https. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +daemon = false
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Protocol to use for communication with the registry server.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a string value representing the protocol to use for
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# communication with the registry server. By default, this option is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# set to ``http`` and the connection is not secure.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option can be set to ``https`` to establish a secure connection
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# to the registry server. In this case, provide a key to use for the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# SSL connection using the ``registry_client_key_file`` option. Also
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# include the CA file and cert file using the options
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``registry_client_ca_file`` and ``registry_client_cert_file``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# respectively.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * http
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * https
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * registry_client_key_file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * registry_client_cert_file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * registry_client_ca_file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Allowed values: http, https
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #registry_client_protocol = http
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The path to the key file to use in SSL connections to the registry
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# server, if any. Alternately, you may set the GLANCE_CLIENT_KEY_FILE
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# environment variable to a filepath of the key file (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#registry_client_key_file = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The path to the cert file to use in SSL connections to the registry
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# server, if any. Alternately, you may set the GLANCE_CLIENT_CERT_FILE
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# environment variable to a filepath of the CA cert file (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#registry_client_cert_file = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The path to the certifying authority cert file to use in SSL
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# connections to the registry server, if any. Alternately, you may set
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# the GLANCE_CLIENT_CA_FILE environment variable to a filepath of the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# CA cert file. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#registry_client_ca_file = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# When using SSL in connections to the registry server, do not require
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# validation via a certifying authority. This is the registry's
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# equivalent of specifying --insecure on the command line using
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# glanceclient for the API. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Absolute path to the private key file.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a string value representing a valid absolute path to the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# private key file to use for establishing a secure connection to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the registry server.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: This option must be set if ``registry_client_protocol`` is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# set to ``https``. Alternatively, the GLANCE_CLIENT_KEY_FILE
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# environment variable may be set to a filepath of the key file.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * String value representing a valid absolute path to the key
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       file.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * registry_client_protocol
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#registry_client_key_file = /etc/ssl/key/key-file.pem
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Absolute path to the certificate file.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a string value representing a valid absolute path to the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# certificate file to use for establishing a secure connection to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the registry server.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: This option must be set if ``registry_client_protocol`` is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# set to ``https``. Alternatively, the GLANCE_CLIENT_CERT_FILE
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# environment variable may be set to a filepath of the certificate
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# file.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * String value representing a valid absolute path to the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       certificate file.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * registry_client_protocol
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#registry_client_cert_file = /etc/ssl/certs/file.crt
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Absolute path to the Certificate Authority file.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a string value representing a valid absolute path to the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# certificate authority file to use for establishing a secure
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# connection to the registry server.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: This option must be set if ``registry_client_protocol`` is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# set to ``https``. Alternatively, the GLANCE_CLIENT_CA_FILE
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# environment variable may be set to a filepath of the CA file.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option is ignored if the ``registry_client_insecure`` option
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# is set to ``True``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * String value representing a valid absolute path to the CA
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       file.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * registry_client_protocol
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * registry_client_insecure
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#registry_client_ca_file = /etc/ssl/cafile/file.ca
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Set verification of the registry server certificate.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a boolean value to determine whether or not to validate
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# SSL connections to the registry server. By default, this option
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# is set to ``False`` and the SSL connections are validated.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# If set to ``True``, the connection to the registry server is not
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# validated via a certifying authority and the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``registry_client_ca_file`` option is ignored. This is the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# registry's equivalent of specifying --insecure on the command line
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# using glanceclient for the API.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * registry_client_protocol
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * registry_client_ca_file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #registry_client_insecure = false
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The period of time, in seconds, that the API server will wait for a
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# registry request to complete. A value of 0 implies no timeout.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Timeout value for registry requests.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide an integer value representing the period of time in seconds
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# that the API server will wait for a registry request to complete.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The default value is 600 seconds.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# A value of 0 implies that a request will never timeout.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Zero
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Positive integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #registry_client_timeout = 600
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Whether to pass through the user token when making requests to the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# registry. To prevent failures with token expiration during big files
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# upload, it is recommended to set this parameter to False.If
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# "use_user_token" is not in effect, then admin credentials can be
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# specified. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEPRECATED: Whether to pass through the user token when making requests to the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# registry. To prevent failures with token expiration during big files upload,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# it is recommended to set this parameter to False.If "use_user_token" is not in
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# effect, then admin credentials can be specified. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # This option is deprecated for removal.
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Reason: This option was considered harmful and has been deprecated
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# in M release. It will be removed in O release. For more information
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# read OSSN-0060. Related functionality with uploading big images has
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# been implemented with Keystone trusts support.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reason: This option was considered harmful and has been deprecated in M
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# release. It will be removed in O release. For more information read OSSN-0060.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related functionality with uploading big images has been implemented with
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Keystone trusts support.
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #use_user_token = true
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The administrators user name. If "use_user_token" is not in effect,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEPRECATED: The administrators user name. If "use_user_token" is not in
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# effect, then admin credentials can be specified. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reason: This option was considered harmful and has been deprecated in M
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# release. It will be removed in O release. For more information read OSSN-0060.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related functionality with uploading big images has been implemented with
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Keystone trusts support.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#admin_user = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEPRECATED: The administrators password. If "use_user_token" is not in effect,
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # then admin credentials can be specified. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # This option is deprecated for removal.
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Reason: This option was considered harmful and has been deprecated
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# in M release. It will be removed in O release. For more information
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# read OSSN-0060. Related functionality with uploading big images has
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# been implemented with Keystone trusts support.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#admin_user = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The administrators password. If "use_user_token" is not in effect,
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# then admin credentials can be specified. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reason: This option was considered harmful and has been deprecated in M
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# release. It will be removed in O release. For more information read OSSN-0060.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related functionality with uploading big images has been implemented with
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Keystone trusts support.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#admin_password = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEPRECATED: The tenant name of the administrative user. If "use_user_token" is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# not in effect, then admin tenant name can be specified. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # This option is deprecated for removal.
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Reason: This option was considered harmful and has been deprecated
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# in M release. It will be removed in O release. For more information
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# read OSSN-0060. Related functionality with uploading big images has
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# been implemented with Keystone trusts support.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#admin_password = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The tenant name of the administrative user. If "use_user_token" is
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# not in effect, then admin tenant name can be specified. (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reason: This option was considered harmful and has been deprecated in M
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# release. It will be removed in O release. For more information read OSSN-0060.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related functionality with uploading big images has been implemented with
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Keystone trusts support.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#admin_tenant_name = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEPRECATED: The URL to the keystone service. If "use_user_token" is not in
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# effect and using keystone auth, then URL of keystone can be specified. (string
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # This option is deprecated for removal.
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Reason: This option was considered harmful and has been deprecated
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# in M release. It will be removed in O release. For more information
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# read OSSN-0060. Related functionality with uploading big images has
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# been implemented with Keystone trusts support.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#admin_tenant_name = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The URL to the keystone service. If "use_user_token" is not in
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# effect and using keystone auth, then URL of keystone can be
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# specified. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# This option is deprecated for removal.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Reason: This option was considered harmful and has been deprecated
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# in M release. It will be removed in O release. For more information
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# read OSSN-0060. Related functionality with uploading big images has
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# been implemented with Keystone trusts support.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reason: This option was considered harmful and has been deprecated in M
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# release. It will be removed in O release. For more information read OSSN-0060.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related functionality with uploading big images has been implemented with
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Keystone trusts support.
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #auth_url = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The strategy to use for authentication. If "use_user_token" is not
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEPRECATED: The strategy to use for authentication. If "use_user_token" is not
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # in effect, then auth strategy can be specified. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # This option is deprecated for removal.
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Reason: This option was considered harmful and has been deprecated
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# in M release. It will be removed in O release. For more information
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# read OSSN-0060. Related functionality with uploading big images has
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# been implemented with Keystone trusts support.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reason: This option was considered harmful and has been deprecated in M
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# release. It will be removed in O release. For more information read OSSN-0060.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related functionality with uploading big images has been implemented with
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Keystone trusts support.
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #auth_strategy = noauth
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The region for the authentication service. If "use_user_token" is
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# not in effect and using keystone auth, then region name can be
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# specified. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEPRECATED: The region for the authentication service. If "use_user_token" is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# not in effect and using keystone auth, then region name can be specified.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # This option is deprecated for removal.
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Reason: This option was considered harmful and has been deprecated
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# in M release. It will be removed in O release. For more information
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# read OSSN-0060. Related functionality with uploading big images has
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# been implemented with Keystone trusts support.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reason: This option was considered harmful and has been deprecated in M
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# release. It will be removed in O release. For more information read OSSN-0060.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related functionality with uploading big images has been implemented with
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Keystone trusts support.
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #auth_region = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Address to find the registry server. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Address the registry server is hosted on.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid IP or hostname
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #registry_host = 0.0.0.0
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Port the registry server is listening on. (port value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +registry_host = 10.167.4.10
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Port the registry server is listening on.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid port number
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (port value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Minimum value: 0
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Maximum value: 65535
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #registry_port = 9191
Sep 28 11:21:28 ctl02 salt-minion[14967]: +registry_port = 9191
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # From oslo.log
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# If set to true, the logging level will be set to DEBUG instead of
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# the default INFO level. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# If set to true, the logging level will be set to DEBUG instead of the default
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# INFO level. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Note: This option can be changed without restarting.
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #debug = false
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# If set to false, the logging level will be set to WARNING instead of
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# the default INFO level. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEPRECATED: If set to false, the logging level will be set to WARNING instead
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# of the default INFO level. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # This option is deprecated for removal.
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #verbose = true
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The name of a logging configuration file. This file is appended to
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# any existing logging configuration files. For details about logging
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# configuration files, see the Python logging module documentation.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Note that when logging configuration files are used then all logging
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# configuration is set in the configuration file and other logging
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# configuration options are ignored (for example,
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# logging_context_format_string). (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The name of a logging configuration file. This file is appended to any
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# existing logging configuration files. For details about logging configuration
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# files, see the Python logging module documentation. Note that when logging
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# configuration files are used then all logging configuration is set in the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# configuration file and other logging configuration options are ignored (for
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# example, logging_context_format_string). (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Note: This option can be changed without restarting.
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/log_config
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #log_config_append = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Defines the format string for %%(asctime)s in log records. Default:
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# %(default)s . This option is ignored if log_config_append is set.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# %(default)s . This option is ignored if log_config_append is set. (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #log_date_format = %Y-%m-%d %H:%M:%S
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (Optional) Name of log file to send logging output to. If no default
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# is set, logging will go to stderr as defined by use_stderr. This
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# option is ignored if log_config_append is set. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# (Optional) Name of log file to send logging output to. If no default is set,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# logging will go to stderr as defined by use_stderr. This option is ignored if
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# log_config_append is set. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/logfile
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #log_file = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (Optional) The base directory used for relative log_file  paths.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# This option is ignored if log_config_append is set. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +log_file = /var/log/glance/scrubber.log
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# (Optional) The base directory used for relative log_file  paths. This option
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# is ignored if log_config_append is set. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/logdir
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #log_dir = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Uses logging handler designed to watch file system. When log file is
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# moved or removed this handler will open a new log file with
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# specified path instantaneously. It makes sense only if log_file
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# option is specified and Linux platform is used. This option is
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# ignored if log_config_append is set. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Uses logging handler designed to watch file system. When log file is moved or
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# removed this handler will open a new log file with specified path
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# instantaneously. It makes sense only if log_file option is specified and Linux
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# platform is used. This option is ignored if log_config_append is set. (boolean
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #watch_log_file = false
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Use syslog for logging. Existing syslog format is DEPRECATED and
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# will be changed later to honor RFC5424. This option is ignored if
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# log_config_append is set. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Use syslog for logging. Existing syslog format is DEPRECATED and will be
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# changed later to honor RFC5424. This option is ignored if log_config_append is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# set. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #use_syslog = false
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Syslog facility to receive log lines. This option is ignored if
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # log_config_append is set. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #syslog_log_facility = LOG_USER
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Log output to standard error. This option is ignored if
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# log_config_append is set. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Log output to standard error. This option is ignored if log_config_append is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# set. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #use_stderr = true
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Format string to use for log messages with context. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #logging_context_format_string = %(asctime)s.%(msecs)03d %(process)d %(levelname)s %(name)s [%(request_id)s %(user_identity)s] %(instance)s%(message)s
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Format string to use for log messages when context is undefined.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Format string to use for log messages when context is undefined. (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #logging_default_format_string = %(asctime)s.%(msecs)03d %(process)d %(levelname)s %(name)s [-] %(instance)s%(message)s
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Additional data to append to log message when logging level for the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# message is DEBUG. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Additional data to append to log message when logging level for the message is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEBUG. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #logging_debug_format_suffix = %(funcName)s %(pathname)s:%(lineno)d
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Prefix each line of exception output with this format. (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Prefix each line of exception output with this format. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #logging_exception_prefix = %(asctime)s.%(msecs)03d %(process)d ERROR %(name)s %(instance)s
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Defines the format string for %(user_identity)s that is used in
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # logging_context_format_string. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# List of package logging levels in logger=LEVEL pairs. This option is
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# ignored if log_config_append is set. (list value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# List of package logging levels in logger=LEVEL pairs. This option is ignored
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# if log_config_append is set. (list value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #default_log_levels = amqp=WARN,amqplib=WARN,boto=WARN,qpid=WARN,sqlalchemy=WARN,suds=INFO,oslo.messaging=INFO,iso8601=WARN,requests.packages.urllib3.connectionpool=WARN,urllib3.connectionpool=WARN,websocket=WARN,requests.packages.urllib3.util.retry=WARN,urllib3.util.retry=WARN,keystonemiddleware=WARN,routes.middleware=WARN,stevedore=WARN,taskflow=WARN,keystoneauth=WARN,oslo.cache=INFO,dogpile.core.dogpile=INFO
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Enables or disables publication of error events. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #publish_errors = false
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The format for an instance that is passed with the log message.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The format for an instance that is passed with the log message. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #instance_format = "[instance: %(uuid)s] "
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The format for an instance UUID that is passed with the log message.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The format for an instance UUID that is passed with the log message. (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #instance_uuid_format = "[instance: %(uuid)s] "
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Enables or disables fatal status of deprecations. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: @@ -355,8 +991,12 @@
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # From oslo.db
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The file name to use with SQLite. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEPRECATED: The file name to use with SQLite. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/sqlite_db
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reason: Should use config option connection or slave_connection to connect the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# database.
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #sqlite_db = oslo.sqlite
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # If True, SQLite uses synchronous mode. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: @@ -367,21 +1007,21 @@
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/db_backend
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #backend = sqlalchemy
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The SQLAlchemy connection string to use to connect to the database.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The SQLAlchemy connection string to use to connect to the database. (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/sql_connection
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DATABASE]/sql_connection
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [sql]/connection
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #connection = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The SQLAlchemy connection string to use to connect to the slave
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# database. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The SQLAlchemy connection string to use to connect to the slave database.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #slave_connection = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The SQL mode to be used for MySQL sessions. This option, including
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# the default, overrides any server-set SQL mode. To use whatever SQL
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# mode is set by the server configuration, set this to no value.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Example: mysql_sql_mode= (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The SQL mode to be used for MySQL sessions. This option, including the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# default, overrides any server-set SQL mode. To use whatever SQL mode is set by
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the server configuration, set this to no value. Example: mysql_sql_mode=
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #mysql_sql_mode = TRADITIONAL
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Timeout before idle SQL connections are reaped. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: @@ -390,38 +1030,37 @@
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [sql]/idle_timeout
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #idle_timeout = 3600
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Minimum number of SQL connections to keep open in a pool. (integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum number of SQL connections to keep open in a pool. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/sql_min_pool_size
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DATABASE]/sql_min_pool_size
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #min_pool_size = 1
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Maximum number of SQL connections to keep open in a pool. (integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Maximum number of SQL connections to keep open in a pool. Setting a value of 0
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# indicates no limit. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/sql_max_pool_size
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DATABASE]/sql_max_pool_size
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#max_pool_size = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Maximum number of database connection retries during startup. Set to
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# -1 to specify an infinite retry count. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#max_pool_size = 5
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Maximum number of database connection retries during startup. Set to -1 to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# specify an infinite retry count. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/sql_max_retries
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DATABASE]/sql_max_retries
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #max_retries = 10
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Interval between retries of opening a SQL connection. (integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Interval between retries of opening a SQL connection. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/sql_retry_interval
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DATABASE]/reconnect_interval
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #retry_interval = 10
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# If set, use this value for max_overflow with SQLAlchemy. (integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# If set, use this value for max_overflow with SQLAlchemy. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/sql_max_overflow
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DATABASE]/sqlalchemy_max_overflow
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #max_overflow = 50
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Verbosity of SQL debugging information: 0=None, 100=Everything.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Verbosity of SQL debugging information: 0=None, 100=Everything. (integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Maximum value: 100
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/sql_connection_debug
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #connection_debug = 0
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: @@ -429,39 +1068,1362 @@
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/sql_connection_trace
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #connection_trace = false
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# If set, use this value for pool_timeout with SQLAlchemy. (integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# If set, use this value for pool_timeout with SQLAlchemy. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DATABASE]/sqlalchemy_pool_timeout
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #pool_timeout = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Enable the experimental use of database reconnect on connection
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# lost. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Enable the experimental use of database reconnect on connection lost. (boolean
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #use_db_reconnect = false
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Seconds between retries of a database transaction. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #db_retry_interval = 1
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# If True, increases the interval between retries of a database
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# operation up to db_max_retry_interval. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# If True, increases the interval between retries of a database operation up to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# db_max_retry_interval. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #db_inc_retry_interval = true
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# If db_inc_retry_interval is set, the maximum seconds between retries
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# of a database operation. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# If db_inc_retry_interval is set, the maximum seconds between retries of a
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# database operation. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #db_max_retry_interval = 10
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Maximum retries in case of connection error or deadlock error before
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# error is raised. Set to -1 to specify an infinite retry count.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Maximum retries in case of connection error or deadlock error before error is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# raised. Set to -1 to specify an infinite retry count. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #db_max_retries = 20
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # From oslo.db.concurrency
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Enable the experimental use of thread pooling for all DB API calls
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Enable the experimental use of thread pooling for all DB API calls (boolean
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/dbapi_use_tpool
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #use_tpool = false
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +[glance_store]
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# From glance.store
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# List of enabled Glance stores.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Register the storage backends to use for storing disk images
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# as a comma separated list. The default stores enabled for
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# storing disk images with Glance are ``file`` and ``http``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A comma separated list that could include:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#         * file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#         * http
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#         * swift
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#         * rbd
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#         * sheepdog
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#         * cinder
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#         * vmware
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related Options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * default_store
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (list value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#stores = file,http
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The default scheme to use for storing images.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a string value representing the default scheme to use for
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# storing images. If not set, Glance uses ``file`` as the default
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# scheme to store images with the ``file`` store.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: The value given for this configuration option must be a valid
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# scheme for a store registered with the ``stores`` configuration
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# option.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * filesystem
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * http
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * https
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * swift
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * swift+http
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * swift+https
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * swift+config
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * rbd
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * sheepdog
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * vsphere
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related Options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * stores
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Allowed values: file, filesystem, http, https, swift, swift+http, swift+https, swift+config, rbd, sheepdog, cinder, vsphere
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#default_store = file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum interval in seconds to execute updating dynamic storage
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# capabilities based on current backend status.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide an integer value representing time in seconds to set the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# minimum interval before an update of dynamic storage capabilities
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# for a storage backend can be attempted. Setting
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``store_capabilities_update_min_interval`` does not mean updates
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# occur periodically based on the set interval. Rather, the update
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# is performed at the elapse of this interval set, if an operation
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# of the store is triggered.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# By default, this option is set to zero and is disabled. Provide an
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# integer value greater than zero to enable this option.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: For more information on store capabilities and their updates,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# please visit: https://specs.openstack.org/openstack/glance-specs/specs/kilo
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# /store-capabilities.html
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# For more information on setting up a particular store in your
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# deplyment and help with the usage of this feature, please contact
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the storage driver maintainers listed here:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# http://docs.openstack.org/developer/glance_store/drivers/index.html
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Zero
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Positive integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related Options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#store_capabilities_update_min_interval = 0
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Information to match when looking for cinder in the service catalog.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When the ``cinder_endpoint_template`` is not set and any of
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``cinder_store_auth_address``, ``cinder_store_user_name``,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``cinder_store_project_name``, ``cinder_store_password`` is not set,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# cinder store uses this information to lookup cinder endpoint from the service
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# catalog in the current context. ``cinder_os_region_name``, if set, is taken
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# into consideration to fetch the appropriate endpoint.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The service catalog can be listed by the ``openstack catalog list`` command.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A string of of the following form:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       ``<service_type>:<service_name>:<endpoint_type>``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       At least ``service_type`` and ``endpoint_type`` should be specified.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       ``service_name`` can be omitted.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_os_region_name
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_endpoint_template
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_store_auth_address
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_store_user_name
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_store_project_name
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_store_password
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#cinder_catalog_info = volumev2::publicURL
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Override service catalog lookup with template for cinder endpoint.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When this option is set, this value is used to generate cinder endpoint,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# instead of looking up from the service catalog.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This value is ignored if ``cinder_store_auth_address``,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``cinder_store_user_name``, ``cinder_store_project_name``, and
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``cinder_store_password`` are specified.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# If this configuration option is set, ``cinder_catalog_info`` will be ignored.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * URL template string for cinder endpoint, where ``%%(tenant)s`` is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       replaced with the current tenant (project) name.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       For example: ``http://cinder.openstack.example.org/v2/%%(tenant)s``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_store_auth_address
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_store_user_name
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_store_project_name
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_store_password
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_catalog_info
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#cinder_endpoint_template = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Region name to lookup cinder service from the service catalog.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This is used only when ``cinder_catalog_info`` is used for determining the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# endpoint. If set, the lookup for cinder endpoint by this node is filtered to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the specified region. It is useful when multiple regions are listed in the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# catalog. If this is not set, the endpoint is looked up from every region.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A string that is a valid region name.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_catalog_info
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [glance_store]/os_region_name
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#cinder_os_region_name = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Location of a CA certificates file used for cinder client requests.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The specified CA certificates file, if set, is used to verify cinder
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# connections via HTTPS endpoint. If the endpoint is HTTP, this value is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ignored.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``cinder_api_insecure`` must be set to ``True`` to enable the verification.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Path to a ca certificates file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_api_insecure
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#cinder_ca_certificates_file = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Number of cinderclient retries on failed http calls.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When a call failed by any errors, cinderclient will retry the call up to the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# specified times after sleeping a few seconds.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A positive integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#cinder_http_retries = 3
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Time period, in seconds, to wait for a cinder volume transition to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# complete.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When the cinder volume is created, deleted, or attached to the glance node to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# read/write the volume data, the volume's state is changed. For example, the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# newly created volume status changes from ``creating`` to ``available`` after
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the creation process is completed. This specifies the maximum time to wait for
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the status change. If a timeout occurs while waiting, or the status is changed
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# to an unexpected value (e.g. `error``), the image creation fails.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A positive integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#cinder_state_transition_timeout = 300
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Allow to perform insecure SSL requests to cinder.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# If this option is set to True, HTTPS endpoint connection is verified using the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# CA certificates file specified by ``cinder_ca_certificates_file`` option.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_ca_certificates_file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#cinder_api_insecure = false
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The address where the cinder authentication service is listening.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When all of ``cinder_store_auth_address``, ``cinder_store_user_name``,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``cinder_store_project_name``, and ``cinder_store_password`` options are
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# specified, the specified values are always used for the authentication.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This is useful to hide the image volumes from users by storing them in a
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# project/tenant specific to the image service. It also enables users to share
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the image volume among other projects under the control of glance's ACL.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# If either of these options are not set, the cinder endpoint is looked up
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# from the service catalog, and current context's user and project are used.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid authentication service address, for example:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       ``http://openstack.example.org/identity/v2.0``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_store_user_name
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_store_password
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_store_project_name
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#cinder_store_auth_address = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# User name to authenticate against cinder.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This must be used with all the following related options. If any of these are
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# not specified, the user of the current context is used.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid user name
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_store_auth_address
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_store_password
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_store_project_name
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#cinder_store_user_name = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Password for the user authenticating against cinder.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This must be used with all the following related options. If any of these are
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# not specified, the user of the current context is used.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid password for the user specified by ``cinder_store_user_name``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_store_auth_address
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_store_user_name
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_store_project_name
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#cinder_store_password = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Project name where the image volume is stored in cinder.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# If this configuration option is not set, the project in current context is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# used.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This must be used with all the following related options. If any of these are
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# not specified, the project of the current context is used.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid project name
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * ``cinder_store_auth_address``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * ``cinder_store_user_name``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * ``cinder_store_password``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#cinder_store_project_name = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Path to the rootwrap configuration file to use for running commands as root.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The cinder store requires root privileges to operate the image volumes (for
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# connecting to iSCSI/FC volumes and reading/writing the volume data, etc.).
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The configuration file should allow the required commands by cinder store and
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# os-brick library.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Path to the rootwrap config file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#rootwrap_config = /etc/glance/rootwrap.conf
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Directory to which the filesystem backend store writes images.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Upon start up, Glance creates the directory if it doesn't already
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# exist and verifies write access to the user under which
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``glance-api`` runs. If the write access isn't available, a
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``BadStoreConfiguration`` exception is raised and the filesystem
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# store may not be available for adding new images.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: This directory is used only when filesystem store is used as a
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# storage backend. Either ``filesystem_store_datadir`` or
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``filesystem_store_datadirs`` option must be specified in
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``glance-api.conf``. If both options are specified, a
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``BadStoreConfiguration`` will be raised and the filesystem store
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# may not be available for adding new images.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid path to a directory
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * ``filesystem_store_datadirs``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * ``filesystem_store_file_perm``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#filesystem_store_datadir = /var/lib/glance/images
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# List of directories and their priorities to which the filesystem
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# backend store writes images.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The filesystem store can be configured to store images in multiple
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# directories as opposed to using a single directory specified by the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``filesystem_store_datadir`` configuration option. When using
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# multiple directories, each directory can be given an optional
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# priority to specify the preference order in which they should
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# be used. Priority is an integer that is concatenated to the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# directory path with a colon where a higher value indicates higher
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# priority. When two directories have the same priority, the directory
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# with most free space is used. When no priority is specified, it
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# defaults to zero.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# More information on configuring filesystem store with multiple store
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# directories can be found at
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# http://docs.openstack.org/developer/glance/configuring.html
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: This directory is used only when filesystem store is used as a
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# storage backend. Either ``filesystem_store_datadir`` or
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``filesystem_store_datadirs`` option must be specified in
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``glance-api.conf``. If both options are specified, a
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``BadStoreConfiguration`` will be raised and the filesystem store
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# may not be available for adding new images.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * List of strings of the following form:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#         * ``<a valid directory path>:<optional integer priority>``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * ``filesystem_store_datadir``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * ``filesystem_store_file_perm``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (multi valued)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#filesystem_store_datadirs =
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Filesystem store metadata file.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The path to a file which contains the metadata to be returned with
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# any location associated with the filesystem store. The file must
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# contain a valid JSON object. The object should contain the keys
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``id`` and ``mountpoint``. The value for both keys should be a
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# string.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid path to the store metadata file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# File access permissions for the image files.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Set the intended file access permissions for image data. This provides
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# a way to enable other services, e.g. Nova, to consume images directly
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# from the filesystem store. The users running the services that are
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# intended to be given access to could be made a member of the group
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# that owns the files created. Assigning a value less then or equal to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# zero for this configuration option signifies that no changes be made
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# to the  default permissions. This value will be decoded as an octal
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# digit.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# For more information, please refer the documentation at
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# http://docs.openstack.org/developer/glance/configuring.html
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid file access permission
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Zero
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Any negative integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#filesystem_store_file_perm = 0
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Path to the CA bundle file.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This configuration option enables the operator to use a custom
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Certificate Authority file to verify the remote server certificate. If
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# this option is set, the ``https_insecure`` option will be ignored and
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the CA file specified will be used to authenticate the server
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# certificate and establish a secure connection to the server.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid path to a CA file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * https_insecure
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#https_ca_certificates_file = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Set verification of the remote server certificate.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This configuration option takes in a boolean value to determine
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# whether or not to verify the remote server certificate. If set to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# True, the remote server certificate is not verified. If the option is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# set to False, then the default CA truststore is used for verification.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option is ignored if ``https_ca_certificates_file`` is set.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The remote server certificate will then be verified using the file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# specified using the ``https_ca_certificates_file`` option.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * https_ca_certificates_file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#https_insecure = true
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The http/https proxy information to be used to connect to the remote
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# server.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This configuration option specifies the http/https proxy information
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# that should be used to connect to the remote server. The proxy
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# information should be a key value pair of the scheme and proxy, for
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# example, http:10.0.0.1:3128. You can also specify proxies for multiple
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# schemes by separating the key value pairs with a comma, for example,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# http:10.0.0.1:3128, https:10.0.0.1:1080.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A comma separated list of scheme:proxy pairs as described above
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (dict value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#http_proxy_information =
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Size, in megabytes, to chunk RADOS images into.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide an integer value representing the size in megabytes to chunk
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Glance images into. The default chunk size is 8 megabytes. For optimal
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# performance, the value should be a power of two.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When Ceph's RBD object storage system is used as the storage backend
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# for storing Glance images, the images are chunked into objects of the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# size set using this option. These chunked objects are then stored
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# across the distributed block data store to use for Glance.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible Values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Any positive integer value
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#rbd_store_chunk_size = 8
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# RADOS pool in which images are stored.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When RBD is used as the storage backend for storing Glance images, the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# images are stored by means of logical grouping of the objects (chunks
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# of images) into a ``pool``. Each pool is defined with the number of
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# placement groups it can contain. The default pool that is used is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# 'images'.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# More information on the RBD storage backend can be found here:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# http://ceph.com/planet/how-data-is-stored-in-ceph-cluster/
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible Values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid pool name
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#rbd_store_pool = images
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# RADOS user to authenticate as.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This configuration option takes in the RADOS user to authenticate as.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This is only needed when RADOS authentication is enabled and is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# applicable only if the user is using Cephx authentication. If the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# value for this option is not set by the user or is set to None, a
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# default value will be chosen, which will be based on the client.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# section in rbd_store_ceph_conf.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible Values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid RADOS user
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * rbd_store_ceph_conf
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#rbd_store_user = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Ceph configuration file path.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This configuration option takes in the path to the Ceph configuration
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# file to be used. If the value for this option is not set by the user
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# or is set to None, librados will locate the default configuration file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# which is located at /etc/ceph/ceph.conf. If using Cephx
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# authentication, this file should include a reference to the right
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# keyring in a client.<USER> section
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible Values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid path to a configuration file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * rbd_store_user
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#rbd_store_ceph_conf = /etc/ceph/ceph.conf
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Timeout value for connecting to Ceph cluster.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This configuration option takes in the timeout value in seconds used
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# when connecting to the Ceph cluster i.e. it sets the time to wait for
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# glance-api before closing the connection. This prevents glance-api
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# hangups during the connection to RBD. If the value for this option
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# is set to less than or equal to 0, no timeout is set and the default
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# librados value is used.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible Values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Any integer value
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#rados_connect_timeout = 0
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Chunk size for images to be stored in Sheepdog data store.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide an integer value representing the size in mebibyte
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# (1048576 bytes) to chunk Glance images into. The default
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# chunk size is 64 mebibytes.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When using Sheepdog distributed storage system, the images are
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# chunked into objects of this size and then stored across the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# distributed data store to use for Glance.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Chunk sizes, if a power of two, help avoid fragmentation and
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# enable improved performance.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Positive integer value representing size in mebibytes.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related Options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#sheepdog_store_chunk_size = 64
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Port number on which the sheep daemon will listen.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide an integer value representing a valid port number on
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# which you want the Sheepdog daemon to listen on. The default
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# port is 7000.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The Sheepdog daemon, also called 'sheep', manages the storage
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# in the distributed cluster by writing objects across the storage
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# network. It identifies and acts on the messages it receives on
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the port number set using ``sheepdog_store_port`` option to store
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# chunks of Glance images.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid port number (0 to 65535)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related Options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * sheepdog_store_address
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (port value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Maximum value: 65535
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#sheepdog_store_port = 7000
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Address to bind the Sheepdog daemon to.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a string value representing the address to bind the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Sheepdog daemon to. The default address set for the 'sheep'
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# is 127.0.0.1.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The Sheepdog daemon, also called 'sheep', manages the storage
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# in the distributed cluster by writing objects across the storage
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# network. It identifies and acts on the messages directed to the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# address set using ``sheepdog_store_address`` option to store
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# chunks of Glance images.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid IPv4 address
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid IPv6 address
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid hostname
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related Options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * sheepdog_store_port
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#sheepdog_store_address = 127.0.0.1
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Set verification of the server certificate.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This boolean determines whether or not to verify the server
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# certificate. If this option is set to True, swiftclient won't check
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# for a valid SSL certificate when authenticating. If the option is set
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# to False, then the default CA truststore is used for verification.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * swift_store_cacert
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#swift_store_auth_insecure = false
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Path to the CA bundle file.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This configuration option enables the operator to specify the path to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# a custom Certificate Authority file for SSL verification when
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# connecting to Swift.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid path to a CA file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * swift_store_auth_insecure
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#swift_store_cacert = /etc/ssl/certs/ca-certificates.crt
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The region of Swift endpoint to use by Glance.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a string value representing a Swift region where Glance
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# can connect to for image storage. By default, there is no region
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# set.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When Glance uses Swift as the storage backend to store images
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# for a specific tenant that has multiple endpoints, setting of a
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Swift region with ``swift_store_region`` allows Glance to connect
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# to Swift in the specified region as opposed to a single region
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# connectivity.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option can be configured for both single-tenant and
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# multi-tenant storage.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: Setting the region with ``swift_store_region`` is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# tenant-specific and is necessary ``only if`` the tenant has
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# multiple endpoints across different regions.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A string value representing a valid Swift region.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related Options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#swift_store_region = RegionTwo
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The URL endpoint to use for Swift backend storage.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a string value representing the URL endpoint to use for
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# storing Glance images in Swift store. By default, an endpoint
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# is not set and the storage URL returned by ``auth`` is used.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Setting an endpoint with ``swift_store_endpoint`` overrides the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# storage URL and is used for Glance image storage.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: The URL should include the path up to, but excluding the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# container. The location of an object is obtained by appending
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the container and object to the configured URL.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * String value representing a valid URL path up to a Swift container
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related Options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#swift_store_endpoint = https://swift.openstack.example.org/v1/path_not_including_container_name
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Endpoint Type of Swift service.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This string value indicates the endpoint type to use to fetch the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Swift endpoint. The endpoint type determines the actions the user will
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# be allowed to perform, for instance, reading and writing to the Store.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This setting is only used if swift_store_auth_version is greater than
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# 1.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * publicURL
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * adminURL
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * internalURL
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * swift_store_endpoint
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Allowed values: publicURL, adminURL, internalURL
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#swift_store_endpoint_type = publicURL
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Type of Swift service to use.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a string value representing the service type to use for
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# storing images while using Swift backend storage. The default
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# service type is set to ``object-store``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: If ``swift_store_auth_version`` is set to 2, the value for
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# this configuration option needs to be ``object-store``. If using
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# a higher version of Keystone or a different auth scheme, this
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# option may be modified.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A string representing a valid service type for Swift storage.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related Options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#swift_store_service_type = object-store
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Name of single container to store images/name prefix for multiple containers
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When a single container is being used to store images, this configuration
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# option indicates the container within the Glance account to be used for
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# storing all images. When multiple containers are used to store images, this
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# will be the name prefix for all containers. Usage of single/multiple
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# containers can be controlled using the configuration option
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``swift_store_multiple_containers_seed``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When using multiple containers, the containers will be named after the value
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# set for this configuration option with the first N chars of the image UUID
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# as the suffix delimited by an underscore (where N is specified by
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``swift_store_multiple_containers_seed``).
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Example: if the seed is set to 3 and swift_store_container = ``glance``, then
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# an image with UUID ``fdae39a1-bac5-4238-aba4-69bcc726e848`` would be placed in
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the container ``glance_fda``. All dashes in the UUID are included when
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# creating the container name but do not count toward the character limit, so
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# when N=10 the container name would be ``glance_fdae39a1-ba.``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * If using single container, this configuration option can be any string
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       that is a valid swift container name in Glance's Swift account
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * If using multiple containers, this configuration option can be any
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       string as long as it satisfies the container naming rules enforced by
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       Swift. The value of ``swift_store_multiple_containers_seed`` should be
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       taken into account as well.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * ``swift_store_multiple_containers_seed``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * ``swift_store_multi_tenant``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * ``swift_store_create_container_on_put``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#swift_store_container = glance
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The size threshold, in MB, after which Glance will start segmenting image
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# data.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Swift has an upper limit on the size of a single uploaded object. By default,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# this is 5GB. To upload objects bigger than this limit, objects are segmented
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# into multiple smaller objects that are tied together with a manifest file.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# For more detail, refer to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# http://docs.openstack.org/developer/swift/overview_large_objects.html
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This configuration option specifies the size threshold over which the Swift
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# driver will start segmenting image data into multiple smaller files.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Currently, the Swift driver only supports creating Dynamic Large Objects.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: This should be set by taking into account the large object limit
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# enforced by the Swift cluster in consideration.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A positive integer that is less than or equal to the large object limit
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       enforced by the Swift cluster in consideration.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * ``swift_store_large_object_chunk_size``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#swift_store_large_object_size = 5120
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The maximum size, in MB, of the segments when image data is segmented.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When image data is segmented to upload images that are larger than the limit
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# enforced by the Swift cluster, image data is broken into segments that are no
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# bigger than the size specified by this configuration option.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Refer to ``swift_store_large_object_size`` for more detail.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# For example: if ``swift_store_large_object_size`` is 5GB and
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``swift_store_large_object_chunk_size`` is 1GB, an image of size 6.2GB will be
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# segmented into 7 segments where the first six segments will be 1GB in size and
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the seventh segment will be 0.2GB.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A positive integer that is less than or equal to the large object limit
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       enforced by Swift cluster in consideration.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * ``swift_store_large_object_size``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#swift_store_large_object_chunk_size = 200
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Create container, if it doesn't already exist, when uploading image.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# At the time of uploading an image, if the corresponding container doesn't
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# exist, it will be created provided this configuration option is set to True.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# By default, it won't be created. This behavior is applicable for both single
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# and multiple containers mode.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#swift_store_create_container_on_put = false
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Store images in tenant's Swift account.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This enables multi-tenant storage mode which causes Glance images to be stored
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# in tenant specific Swift accounts. If this is disabled, Glance stores all
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# images in its own account. More details multi-tenant store can be found at
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# https://wiki.openstack.org/wiki/GlanceSwiftTenantSpecificStorage
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#swift_store_multi_tenant = false
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Seed indicating the number of containers to use for storing images.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When using a single-tenant store, images can be stored in one or more than one
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# containers. When set to 0, all images will be stored in one single container.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When set to an integer value between 1 and 32, multiple containers will be
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# used to store images. This configuration option will determine how many
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# containers are created. The total number of containers that will be used is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# equal to 16^N, so if this config option is set to 2, then 16^2=256 containers
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# will be used to store images.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Please refer to ``swift_store_container`` for more detail on the naming
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# convention. More detail about using multiple containers can be found at
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# https://specs.openstack.org/openstack/glance-specs/specs/kilo/swift-store-
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# multiple-containers.html
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: This is used only when swift_store_multi_tenant is disabled.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A non-negative integer less than or equal to 32
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * ``swift_store_container``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * ``swift_store_multi_tenant``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * ``swift_store_create_container_on_put``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Maximum value: 32
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#swift_store_multiple_containers_seed = 0
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# List of tenants that will be granted admin access.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This is a list of tenants that will be granted read/write access on
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# all Swift containers created by Glance in multi-tenant mode. The
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# default value is an empty list.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A comma separated list of strings representing UUIDs of Keystone
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       projects/tenants
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (list value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#swift_store_admin_tenants =
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# SSL layer compression for HTTPS Swift requests.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a boolean value to determine whether or not to compress
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# HTTPS Swift requests for images at the SSL layer. By default,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# compression is enabled.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When using Swift as the backend store for Glance image storage,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# SSL layer compression of HTTPS Swift requests can be set using
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# this option. If set to False, SSL layer compression of HTTPS
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Swift requests is disabled. Disabling this option may improve
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# performance for images which are already in a compressed format,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# for example, qcow2.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related Options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#swift_store_ssl_compression = true
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The number of times a Swift download will be retried before the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# request fails.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide an integer value representing the number of times an image
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# download must be retried before erroring out. The default value is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# zero (no retry on a failed image download). When set to a positive
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# integer value, ``swift_store_retry_get_count`` ensures that the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# download is attempted this many more times upon a download failure
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# before sending an error message.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Zero
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Positive integer value
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related Options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#swift_store_retry_get_count = 0
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Time in seconds defining the size of the window in which a new
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# token may be requested before the current token is due to expire.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Typically, the Swift storage driver fetches a new token upon the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# expiration of the current token to ensure continued access to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Swift. However, some Swift transactions (like uploading image
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# segments) may not recover well if the token expires on the fly.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Hence, by fetching a new token before the current token expiration,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# we make sure that the token does not expire or is close to expiry
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# before a transaction is attempted. By default, the Swift storage
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# driver requests for a new token 60 seconds or less before the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# current token expiration.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Zero
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Positive integer value
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related Options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#swift_store_expire_soon_interval = 60
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Use trusts for multi-tenant Swift store.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option instructs the Swift store to create a trust for each
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# add/get request when the multi-tenant store is in use. Using trusts
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# allows the Swift store to avoid problems that can be caused by an
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# authentication token expiring during the upload or download of data.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# By default, ``swift_store_use_trusts`` is set to ``True``(use of
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# trusts is enabled). If set to ``False``, a user token is used for
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the Swift connection instead, eliminating the overhead of trust
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# creation.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: This option is considered only when
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``swift_store_multi_tenant`` is set to ``True``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * swift_store_multi_tenant
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#swift_store_use_trusts = true
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reference to default Swift account/backing store parameters.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a string value representing a reference to the default set
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# of parameters required for using swift account/backing store for
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# image storage. The default reference value for this configuration
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# option is 'ref1'. This configuration option dereferences the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# parameters and facilitates image storage in Swift storage backend
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# every time a new image is added.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid string value
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#default_swift_reference = ref1
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEPRECATED: Version of the authentication service to use. Valid versions are 2
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# and 3 for keystone and 1 (deprecated) for swauth and rackspace. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reason:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The option 'auth_version' in the Swift back-end configuration file is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# used instead.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#swift_store_auth_version = 2
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEPRECATED: The address where the Swift authentication service is listening.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reason:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The option 'auth_address' in the Swift back-end configuration file is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# used instead.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#swift_store_auth_address = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEPRECATED: The user to authenticate against the Swift authentication service.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reason:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The option 'user' in the Swift back-end configuration file is set instead.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#swift_store_user = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEPRECATED: Auth key for the user authenticating against the Swift
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# authentication service. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reason:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The option 'key' in the Swift back-end configuration file is used
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# to set the authentication key instead.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#swift_store_key = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Absolute path to the file containing the swift account(s)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# configurations.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Include a string value representing the path to a configuration
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# file that has references for each of the configured Swift
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# account(s)/backing stores. By default, no file path is specified
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# and customized Swift referencing is disabled. Configuring this
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# option is highly recommended while using Swift storage backend for
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# image storage as it avoids storage of credentials in the database.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * String value representing an absolute path on the glance-api
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       node
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#swift_store_config_file = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Address of the ESX/ESXi or vCenter Server target system.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This configuration option sets the address of the ESX/ESXi or vCenter
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Server target system. This option is required when using the VMware
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# storage backend. The address can contain an IP address (127.0.0.1) or
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# a DNS name (www.my-domain.com).
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible Values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid IPv4 or IPv6 address
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid DNS name
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * vmware_server_username
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * vmware_server_password
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#vmware_server_host = 127.0.0.1
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Server username.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This configuration option takes the username for authenticating with
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the VMware ESX/ESXi or vCenter Server. This option is required when
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# using the VMware storage backend.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible Values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Any string that is the username for a user with appropriate
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       privileges
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * vmware_server_host
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * vmware_server_password
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#vmware_server_username = root
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Server password.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This configuration option takes the password for authenticating with
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the VMware ESX/ESXi or vCenter Server. This option is required when
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# using the VMware storage backend.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible Values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Any string that is a password corresponding to the username
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       specified using the "vmware_server_username" option
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * vmware_server_host
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * vmware_server_username
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#vmware_server_password = vmware
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The number of VMware API retries.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This configuration option specifies the number of times the VMware
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ESX/VC server API must be retried upon connection related issues or
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# server API call overload. It is not possible to specify 'retry
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# forever'.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible Values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Any positive integer value
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#vmware_api_retry_count = 10
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Interval in seconds used for polling remote tasks invoked on VMware
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ESX/VC server.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This configuration option takes in the sleep time in seconds for polling an
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# on-going async task as part of the VMWare ESX/VC server API call.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible Values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Any positive integer value
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#vmware_task_poll_interval = 5
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The directory where the glance images will be stored in the datastore.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This configuration option specifies the path to the directory where the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# glance images will be stored in the VMware datastore. If this option
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# is not set,  the default directory where the glance images are stored
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# is openstack_glance.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible Values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Any string that is a valid path to a directory
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#vmware_store_image_dir = /openstack_glance
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Set verification of the ESX/vCenter server certificate.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This configuration option takes a boolean value to determine
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# whether or not to verify the ESX/vCenter server certificate. If this
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# option is set to True, the ESX/vCenter server certificate is not
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# verified. If this option is set to False, then the default CA
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# truststore is used for verification.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option is ignored if the "vmware_ca_file" option is set. In that
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# case, the ESX/vCenter server certificate will then be verified using
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the file specified using the "vmware_ca_file" option .
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible Values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * vmware_ca_file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [glance_store]/vmware_api_insecure
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#vmware_insecure = false
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Absolute path to the CA bundle file.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This configuration option enables the operator to use a custom
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Cerificate Authority File to verify the ESX/vCenter certificate.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# If this option is set, the "vmware_insecure" option will be ignored
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# and the CA file specified will be used to authenticate the ESX/vCenter
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# server certificate and establish a secure connection to the server.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible Values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Any string that is a valid absolute path to a CA file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * vmware_insecure
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#vmware_ca_file = /etc/ssl/certs/ca-certificates.crt
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The datastores where the image can be stored.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This configuration option specifies the datastores where the image can
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# be stored in the VMWare store backend. This option may be specified
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# multiple times for specifying multiple datastores. The datastore name
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# should be specified after its datacenter path, separated by ":". An
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# optional weight may be given after the datastore name, separated again
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# by ":" to specify the priority. Thus, the required format becomes
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# <datacenter_path>:<datastore_name>:<optional_weight>.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When adding an image, the datastore with highest weight will be
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# selected, unless there is not enough free space available in cases
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# where the image size is already known. If no weight is given, it is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# assumed to be zero and the directory will be considered for selection
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# last. If multiple datastores have the same weight, then the one with
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the most free space available is selected.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible Values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Any string of the format:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       <datacenter_path>:<datastore_name>:<optional_weight>
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#    * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (multi valued)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#vmware_datastores =
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  [oslo_concurrency]
Sep 28 11:21:28 ctl02 salt-minion[14967]: @@ -474,10 +2436,10 @@
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/disable_process_locking
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #disable_process_locking = false
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Directory to use for lock files.  For security, the specified
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# directory should only be writable by the user running the processes
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# that need locking. Defaults to environment variable OSLO_LOCK_PATH.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# If external locks are used, a lock path must be set. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Directory to use for lock files.  For security, the specified directory should
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# only be writable by the user running the processes that need locking. Defaults
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# to environment variable OSLO_LOCK_PATH. If external locks are used, a lock
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# path must be set. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/lock_path
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #lock_path = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: @@ -492,15 +2454,14 @@
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/policy_file
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #policy_file = policy.json
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Default rule. Enforced when a requested rule is not found. (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Default rule. Enforced when a requested rule is not found. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/policy_default_rule
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #policy_default_rule = default
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Directories where policy configuration files are stored. They can be
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# relative to any directory in the search path defined by the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# config_dir option, or absolute paths. The file defined by
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# policy_file must exist for these directories to be searched.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Missing or empty directories are ignored. (multi valued)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Directories where policy configuration files are stored. They can be relative
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# to any directory in the search path defined by the config_dir option, or
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# absolute paths. The file defined by policy_file must exist for these
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# directories to be searched.  Missing or empty directories are ignored. (multi
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# valued)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/policy_dirs
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #policy_dirs = policy.d
Sep 28 11:21:28 ctl02 salt-minion[14967]: [INFO    ] Completed state [/etc/glance/glance-scrubber.conf] at time 11:21:28.763308 duration_in_ms=65.718
Sep 28 11:21:28 ctl02 salt-minion[14967]: [INFO    ] Running state [/etc/glance/glance-api.conf] at time 11:21:28.763576
Sep 28 11:21:28 ctl02 salt-minion[14967]: [INFO    ] Executing state file.managed for /etc/glance/glance-api.conf
Sep 28 11:21:28 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'glance/files/ocata/glance-api.conf.Debian'
Sep 28 11:21:28 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'glance/map.jinja'
Sep 28 11:21:28 ctl02 salt-minion[14967]: [INFO    ] File changed:
Sep 28 11:21:28 ctl02 salt-minion[14967]: ---
Sep 28 11:21:28 ctl02 salt-minion[14967]: +++
Sep 28 11:21:28 ctl02 salt-minion[14967]: @@ -1,467 +1,1572 @@
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]:  [DEFAULT]
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # From glance.api
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# When true, this option sets the owner of an image to be the tenant.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Otherwise, the owner of the  image will be the authenticated user
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# issuing the request. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Set the image owner to tenant or the authenticated user.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Assign a boolean value to determine the owner of an image. When set to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# True, the owner of the image is the tenant. When set to False, the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# owner of the image will be the authenticated user issuing the request.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Setting it to False makes the image private to the associated user and
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# sharing with other users within the same tenant (or "project")
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# requires explicit image sharing via image membership.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #owner_is_tenant = true
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Role used to identify an authenticated user as administrator.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a string value representing a Keystone role to identify an
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# administrative user. Users with this role will be granted
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# administrative privileges. The default value for this option is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# 'admin'.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A string value which is a valid Keystone role
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #admin_role = admin
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Allow unauthenticated users to access the API with read-only
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# privileges. This only applies when using ContextMiddleware. (boolean
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Allow limited access to unauthenticated users.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Assign a boolean to determine API access for unathenticated
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# users. When set to False, the API cannot be accessed by
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# unauthenticated users. When set to True, unauthenticated users can
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# access the API with read-only privileges. This however only applies
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# when using ContextMiddleware.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #allow_anonymous_access = false
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Limits request ID length. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Limit the request ID length.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide  an integer value to limit the length of the request ID to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the specified length. The default value is 64. Users can change this
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# to any ineteger value between 0 and 16384 however keeping in mind that
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# a larger value may flood the logs.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Integer value between 0 and 16384
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #max_request_id_length = 64
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Public url to use for versions endpoint. The default is None, which
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# will use the request's host_url attribute to populate the URL base.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# If Glance is operating behind a proxy, you will want to change this
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# to represent the proxy's URL. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Public url endpoint to use for Glance/Glare versions response.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This is the public url endpoint that will appear in the Glance/Glare
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# "versions" response. If no value is specified, the endpoint that is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# displayed in the version's response is that of the host running the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# API service. Change the endpoint to represent the proxy URL if the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# API service is running behind a proxy. If the service is running
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# behind a load balancer, add the load balancer's URL for this value.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Proxy URL
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Load balancer URL
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #public_endpoint = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Whether to allow users to specify image properties beyond what the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# image schema provides (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Allow users to add additional/custom properties to images.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Glance defines a standard set of properties (in its schema) that
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# appear on every image. These properties are also known as
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``base properties``. In addition to these properties, Glance
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# allows users to add custom properties to images. These are known
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# as ``additional properties``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# By default, this configuration option is set to ``True`` and users
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# are allowed to add additional properties. The number of additional
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# properties that can be added to an image can be controlled via
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``image_property_quota`` configuration option.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * image_property_quota
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #allow_additional_image_properties = true
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Maximum number of image members per image. Negative values evaluate
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# to unlimited. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Maximum number of image members per image.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This limits the maximum of users an image can be shared with. Any negative
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# value is interpreted as unlimited.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #image_member_quota = 128
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Maximum number of properties allowed on an image. Negative values
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# evaluate to unlimited. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Maximum number of properties allowed on an image.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This enforces an upper limit on the number of additional properties an image
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# can have. Any negative value is interpreted as unlimited.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: This won't have any impact if additional properties are disabled. Please
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# refer to ``allow_additional_image_properties``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * ``allow_additional_image_properties``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #image_property_quota = 128
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Maximum number of tags allowed on an image. Negative values evaluate
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# to unlimited. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Maximum number of tags allowed on an image.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Any negative value is interpreted as unlimited.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #image_tag_quota = 128
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Maximum number of locations allowed on an image. Negative values
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# evaluate to unlimited. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Maximum number of locations allowed on an image.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Any negative value is interpreted as unlimited.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #image_location_quota = 10
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Python module path of data access API (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Python module path of data access API.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Specifies the path to the API to use for accessing the data model.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option determines how the image catalog data will be accessed.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * glance.db.sqlalchemy.api
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * glance.db.registry.api
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * glance.db.simple.api
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# If this option is set to ``glance.db.sqlalchemy.api`` then the image
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# catalog data is stored in and read from the database via the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# SQLAlchemy Core and ORM APIs.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Setting this option to ``glance.db.registry.api`` will force all
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# database access requests to be routed through the Registry service.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This avoids data access from the Glance API nodes for an added layer
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# of security, scalability and manageability.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: In v2 OpenStack Images API, the registry service is optional.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# In order to use the Registry API in v2, the option
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``enable_v2_registry`` must be set to ``True``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Finally, when this configuration option is set to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``glance.db.simple.api``, image catalog data is stored in and read
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# from an in-memory data structure. This is primarily used for testing.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * enable_v2_api
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * enable_v2_registry
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #data_api = glance.db.sqlalchemy.api
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Default value for the number of items returned by a request if not
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# specified explicitly in the request (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The default number of results to return for a request.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Responses to certain API requests, like list images, may return
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# multiple items. The number of results returned can be explicitly
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# controlled by specifying the ``limit`` parameter in the API request.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# However, if a ``limit`` parameter is not specified, this
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# configuration value will be used as the default number of results to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# be returned for any API request.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTES:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * The value of this configuration option may not be greater than
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       the value specified by ``api_limit_max``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Setting this to a very large value may slow down database
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       queries and increase response times. Setting this to a
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       very low value may result in poor user experience.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Any positive integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * api_limit_max
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #limit_param_default = 25
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Maximum permissible number of items that could be returned by a
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# request (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +limit_param_default = 25
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Maximum number of results that could be returned by a request.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# As described in the help text of ``limit_param_default``, some
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# requests may return multiple results. The number of results to be
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# returned are governed either by the ``limit`` parameter in the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# request or the ``limit_param_default`` configuration option.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The value in either case, can't be greater than the absolute maximum
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# defined by this configuration option. Anything greater than this
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# value is trimmed down to the maximum value defined here.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: Setting this to a very large value may slow down database
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       queries and increase response times. Setting this to a
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       very low value may result in poor user experience.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Any positive integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * limit_param_default
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #api_limit_max = 1000
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Whether to include the backend image storage location in image
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# properties. Revealing storage location can be a security risk, so
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# use this setting with caution! (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +api_limit_max = 1000
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Show direct image location when returning an image.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This configuration option indicates whether to show the direct image
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# location when returning image details to the user. The direct image
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# location is where the image data is stored in backend storage. This
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# image location is shown under the image property ``direct_url``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When multiple image locations exist for an image, the best location
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# is displayed based on the location strategy indicated by the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# configuration option ``location_strategy``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTES:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Revealing image locations can present a GRAVE SECURITY RISK as
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       image locations can sometimes include credentials. Hence, this
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       is set to ``False`` by default. Set this to ``True`` with
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       EXTREME CAUTION and ONLY IF you know what you are doing!
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * If an operator wishes to avoid showing any image location(s)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       to the user, then both this option and
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       ``show_multiple_locations`` MUST be set to ``False``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * show_multiple_locations
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * location_strategy
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #show_image_direct_url = false
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Whether to include the backend image locations in image properties.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# For example, if using the file system store a URL of
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# "file:///path/to/image" will be returned to the user in the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# 'direct_url' meta-data field. Revealing storage location can be a
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# security risk, so use this setting with caution! Setting this to
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# true overrides the show_image_direct_url option. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +show_image_direct_url = true
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEPRECATED:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Show all image locations when returning an image.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This configuration option indicates whether to show all the image
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# locations when returning image details to the user. When multiple
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# image locations exist for an image, the locations are ordered based
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# on the location strategy indicated by the configuration opt
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``location_strategy``. The image locations are shown under the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# image property ``locations``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTES:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Revealing image locations can present a GRAVE SECURITY RISK as
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       image locations can sometimes include credentials. Hence, this
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       is set to ``False`` by default. Set this to ``True`` with
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       EXTREME CAUTION and ONLY IF you know what you are doing!
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * If an operator wishes to avoid showing any image location(s)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       to the user, then both this option and
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       ``show_image_direct_url`` MUST be set to ``False``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * show_image_direct_url
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * location_strategy
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option is deprecated for removal since Newton.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reason: This option will be removed in the Ocata release because the same
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# functionality can be achieved with greater granularity by using policies.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Please see the Newton release notes for more information.
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #show_multiple_locations = false
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Maximum size of image a user can upload in bytes. Defaults to
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# 1099511627776 bytes (1 TB).WARNING: this value should only be
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# increased after careful consideration and must be set to a value
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# under 8 EB (9223372036854775808). (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +show_multiple_locations = true
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Maximum size of image a user can upload in bytes.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# An image upload greater than the size mentioned here would result
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# in an image creation failure. This configuration option defaults to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# 1099511627776 bytes (1 TiB).
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTES:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * This value should only be increased after careful
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       consideration and must be set less than or equal to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       8 EiB (9223372036854775808).
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * This value must be set with careful consideration of the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       backend storage capacity. Setting this to a very low value
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       may result in a large number of image failures. And, setting
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       this to a very large value may result in faster consumption
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       of storage. Hence, this must be set according to the nature of
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       images created and storage capacity available.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Any positive number less than or equal to 9223372036854775808
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Maximum value: 9223372036854775808
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #image_size_cap = 1099511627776
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Set a system wide quota for every user. This value is the total
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# capacity that a user can use across all storage systems. A value of
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# 0 means unlimited.Optional unit can be specified for the value.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Accepted units are B, KB, MB, GB and TB representing Bytes,
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# KiloBytes, MegaBytes, GigaBytes and TeraBytes respectively. If no
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# unit is specified then Bytes is assumed. Note that there should not
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# be any space between value and unit and units are case sensitive.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Maximum amount of image storage per tenant.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This enforces an upper limit on the cumulative storage consumed by all images
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# of a tenant across all stores. This is a per-tenant limit.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The default unit for this configuration option is Bytes. However, storage
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# units can be specified using case-sensitive literals ``B``, ``KB``, ``MB``,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``GB`` and ``TB`` representing Bytes, KiloBytes, MegaBytes, GigaBytes and
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# TeraBytes respectively. Note that there should not be any space between the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# value and unit. Value ``0`` signifies no quota enforcement. Negative values
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# are invalid and result in errors.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A string that is a valid concatenation of a non-negative integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       representing the storage value and an optional string literal
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       representing storage units as mentioned above.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #user_storage_quota = 0
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Deploy the v1 OpenStack Images API. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deploy the v1 OpenStack Images API.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When this option is set to ``True``, Glance service will respond to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# requests on registered endpoints conforming to the v1 OpenStack
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Images API.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTES:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * If this option is enabled, then ``enable_v1_registry`` must
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       also be set to ``True`` to enable mandatory usage of Registry
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       service with v1 API.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * If this option is disabled, then the ``enable_v1_registry``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       option, which is enabled by default, is also recommended
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       to be disabled.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * This option is separate from ``enable_v2_api``, both v1 and v2
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       OpenStack Images API can be deployed independent of each
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       other.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * If deploying only the v2 Images API, this option, which is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       enabled by default, should be disabled.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * enable_v1_registry
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * enable_v2_api
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #enable_v1_api = true
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Deploy the v2 OpenStack Images API. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +enable_v1_api=False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deploy the v2 OpenStack Images API.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When this option is set to ``True``, Glance service will respond
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# to requests on registered endpoints conforming to the v2 OpenStack
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Images API.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTES:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * If this option is disabled, then the ``enable_v2_registry``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       option, which is enabled by default, is also recommended
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       to be disabled.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * This option is separate from ``enable_v1_api``, both v1 and v2
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       OpenStack Images API can be deployed independent of each
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       other.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * If deploying only the v1 Images API, this option, which is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       enabled by default, should be disabled.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * enable_v2_registry
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * enable_v1_api
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #enable_v2_api = true
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Deploy the v1 OpenStack Registry API. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +enable_v2_api=True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deploy the v1 API Registry service.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When this option is set to ``True``, the Registry service
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# will be enabled in Glance for v1 API requests.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTES:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Use of Registry is mandatory in v1 API, so this option must
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       be set to ``True`` if the ``enable_v1_api`` option is enabled.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * If deploying only the v2 OpenStack Images API, this option,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       which is enabled by default, should be disabled.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * enable_v1_api
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #enable_v1_registry = true
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Deploy the v2 OpenStack Registry API. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deploy the v2 API Registry service.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When this option is set to ``True``, the Registry service
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# will be enabled in Glance for v2 API requests.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTES:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Use of Registry is optional in v2 API, so this option
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       must only be enabled if both ``enable_v2_api`` is set to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       ``True`` and the ``data_api`` option is set to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       ``glance.db.registry.api``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * If deploying only the v1 OpenStack Images API, this option,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       which is enabled by default, should be disabled.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * enable_v2_api
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * data_api
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #enable_v2_registry = true
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The hostname/IP of the pydev process listening for debug connections
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#pydev_worker_debug_host = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The port on which a pydev process is listening for connections.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (port value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Host address of the pydev server.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a string value representing the hostname or IP of the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# pydev server to use for debugging. The pydev server listens for
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# debug connections on this address, facilitating remote debugging
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# in Glance.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Valid hostname
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Valid IP address
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#pydev_worker_debug_host = localhost
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Port number that the pydev server will listen on.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a port number to bind the pydev server to. The pydev
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# process accepts debug connections on this port and facilitates
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# remote debugging in Glance.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid port number
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (port value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Minimum value: 0
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Maximum value: 65535
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #pydev_worker_debug_port = 5678
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# AES key for encrypting store 'location' metadata. This includes, if
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# used, Swift or S3 credentials. Should be set to a random string of
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# length 16, 24 or 32 bytes (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# AES key for encrypting store location metadata.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a string value representing the AES cipher to use for
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# encrypting Glance store metadata.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: The AES key to use must be set to a random string of length
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# 16, 24 or 32 bytes.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * String value representing a valid AES key
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #metadata_encryption_key = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Digest algorithm which will be used for digital signature. Use the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# command "openssl list-message-digest-algorithms" to get the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# available algorithms supported by the version of OpenSSL on the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# platform. Examples are "sha1", "sha256", "sha512", etc. (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Digest algorithm to use for digital signature.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a string value representing the digest algorithm to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# use for generating digital signatures. By default, ``sha256``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# is used.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# To get a list of the available algorithms supported by the version
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# of OpenSSL on your platform, run the command:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``openssl list-message-digest-algorithms``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Examples are 'sha1', 'sha256', and 'sha512'.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: ``digest_algorithm`` is not related to Glance's image signing
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# and verification. It is only used to sign the universally unique
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# identifier (UUID) as a part of the certificate file and key file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# validation.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * An OpenSSL message digest algorithm identifier
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Relation options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #digest_algorithm = sha256
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# This value sets what strategy will be used to determine the image
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# location order. Currently two strategies are packaged with Glance
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# 'location_order' and 'store_type'. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Strategy to determine the preference order of image locations.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This configuration option indicates the strategy to determine
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the order in which an image's locations must be accessed to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# serve the image's data. Glance then retrieves the image data
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# from the first responsive active location it finds in this list.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option takes one of two possible values ``location_order``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# and ``store_type``. The default value is ``location_order``,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# which suggests that image data be served by using locations in
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the order they are stored in Glance. The ``store_type`` value
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# sets the image location preference based on the order in which
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the storage backends are listed as a comma separated list for
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the configuration option ``store_type_preference``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * location_order
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * store_type
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * store_type_preference
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Allowed values: location_order, store_type
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #location_strategy = location_order
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The location of the property protection file.This file contains the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# rules for property protections and the roles/policies associated
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# with it. If this config value is not specified, by default, property
Sep 28 11:21:28 ctl02 salt-minion[14967]: +location_strategy = location_order
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The location of the property protection file.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a valid path to the property protection file which contains
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the rules for property protections and the roles/policies associated
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# with them.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# A property protection file, when set, restricts the Glance image
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# properties to be created, read, updated and/or deleted by a specific
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# set of users that are identified by either roles or policies.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# If this configuration option is not set, by default, property
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # protections won't be enforced. If a value is specified and the file
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# is not found, then the glance-api service will not start. (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# is not found, the glance-api service will fail to start.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# More information on property protections can be found at:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# http://docs.openstack.org/developer/glance/property-protections.html
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Empty string
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Valid path to the property protection configuration file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * property_protection_rule_format
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #property_protection_file = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# This config value indicates whether "roles" or "policies" are used
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# in the property protection file. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Rule format for property protection.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide the desired way to set property protection on Glance
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# image properties. The two permissible values are ``roles``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# and ``policies``. The default value is ``roles``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# If the value is ``roles``, the property protection file must
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# contain a comma separated list of user roles indicating
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# permissions for each of the CRUD operations on each property
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# being protected. If set to ``policies``, a policy defined in
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# policy.json is used to express property protections for each
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# of the CRUD operations. Examples of how property protections
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# are enforced based on ``roles`` or ``policies`` can be found at:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# http://docs.openstack.org/developer/glance/property-protections.html#examples
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * roles
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * policies
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * property_protection_file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Allowed values: roles, policies
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #property_protection_rule_format = roles
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Modules of exceptions that are permitted to be recreated upon
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# receiving exception data from an rpc call. (list value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# List of allowed exception modules to handle RPC exceptions.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a comma separated list of modules whose exceptions are
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# permitted to be recreated upon receiving exception data via an RPC
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# call made to Glance. The default list includes
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``glance.common.exception``, ``builtins``, and ``exceptions``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The RPC protocol permits interaction with Glance via calls across a
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# network or within the same system. Including a list of exception
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# namespaces with this option enables RPC to propagate the exceptions
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# back to the users.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A comma separated list of valid exception modules
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (list value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #allowed_rpc_exception_modules = glance.common.exception,builtins,exceptions
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Address to bind the server.  Useful when selecting a particular
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# network interface. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# IP address to bind the glance servers to.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide an IP address to bind the glance server to. The default
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# value is ``0.0.0.0``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Edit this option to enable the server to listen on one particular
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# IP address on the network card. This facilitates selection of a
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# particular network interface for the server.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid IPv4 address
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid IPv6 address
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #bind_host = 0.0.0.0
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The port on which the server will listen. (port value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +bind_host = 10.167.4.12
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Port number on which the server will listen.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a valid port number to bind the server's socket to. This
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# port is then set to identify processes and forward network messages
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# that arrive at the server. The default bind_port value for the API
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# server is 9292 and for the registry server is 9191.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid port number (0 to 65535)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (port value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Minimum value: 0
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Maximum value: 65535
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #bind_port = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The number of child process workers that will be created to service
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# requests. The default will be equal to the number of CPUs available.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +bind_port = 9292
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Number of Glance worker processes to start.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a non-negative integer value to set the number of child
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# process workers to service requests. By default, the number of CPUs
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# available is set as the value for ``workers``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Each worker process is made to listen on the port set in the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# configuration file and contains a greenthread pool of size 1000.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: Setting the number of workers to zero, triggers the creation
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# of a single API process with a greenthread pool of size 1000.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * 0
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Positive integer value (typically equal to the number of CPUs)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #workers = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Maximum line size of message headers to be accepted. max_header_line
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# may need to be increased when using large tokens (typically those
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# generated by the Keystone v3 API with big service catalogs (integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +workers = 8
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Maximum line size of message headers.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide an integer value representing a length to limit the size of
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# message headers. The default value is 16384.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: ``max_header_line`` may need to be increased when using large
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# tokens (typically those generated by the Keystone v3 API with big
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# service catalogs). However, it is to be kept in mind that larger
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# values for ``max_header_line`` would flood the logs.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Setting ``max_header_line`` to 0 sets no limit for the line size of
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# message headers.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * 0
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Positive integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #max_header_line = 16384
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# If False, server will return the header "Connection: close", If
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# True, server will return "Connection: Keep-Alive" in its responses.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# In order to close the client socket connection explicitly after the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# response is sent and read successfully by the client, you simply
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# have to set this option to False when you create a wsgi server.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Set keep alive option for HTTP over TCP.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a boolean value to determine sending of keep alive packets.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# If set to ``False``, the server returns the header
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# "Connection: close". If set to ``True``, the server returns a
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# "Connection: Keep-Alive" in its responses. This enables retention of
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the same TCP connection for HTTP conversations instead of opening a
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# new one with each new request.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option must be set to ``False`` if the client socket connection
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# needs to be closed explicitly after the response is received and
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# read successfully by the client.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #http_keepalive = true
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Timeout for client connections' socket operations. If an incoming
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# connection is idle for this number of seconds it will be closed. A
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value of '0' means wait forever. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Timeout for client connections' socket operations.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a valid integer value representing time in seconds to set
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the period of wait before an incoming connection can be closed. The
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# default value is 900 seconds.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The value zero implies wait forever.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Zero
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Positive integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #client_socket_timeout = 900
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The backlog value that will be used when creating the TCP listener
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# socket. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Set the number of incoming connection requests.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a positive integer value to limit the number of requests in
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the backlog queue. The default queue size is 4096.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# An incoming connection to a TCP listener socket is queued before a
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# connection can be established with the server. Setting the backlog
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# for a TCP socket ensures a limited queue size for incoming traffic.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Positive integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #backlog = 4096
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The value for the socket option TCP_KEEPIDLE.  This is the time in
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# seconds that the connection must be idle before TCP starts sending
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# keepalive probes. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Set the wait time before a connection recheck.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a positive integer value representing time in seconds which
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# is set as the idle wait time before a TCP keep alive packet can be
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# sent to the host. The default value is 600 seconds.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Setting ``tcp_keepidle`` helps verify at regular intervals that a
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# connection is intact and prevents frequent TCP connection
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# reestablishment.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Positive integer value representing time in seconds
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #tcp_keepidle = 600
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# CA certificate file to use to verify connecting clients. (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#ca_file = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Certificate file to use when starting API server securely. (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#cert_file = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Private key file to use when starting API server securely. (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#key_file = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The path to the sqlite file database that will be used for image
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# cache management. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Absolute path to the CA file.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a string value representing a valid absolute path to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the Certificate Authority file to use for client authentication.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# A CA file typically contains necessary trusted certificates to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# use for the client authentication. This is essential to ensure
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# that a secure connection is established to the server via the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# internet.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Valid absolute path to the CA file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#ca_file = /etc/ssl/cafile
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Absolute path to the certificate file.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a string value representing a valid absolute path to the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# certificate file which is required to start the API service
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# securely.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# A certificate file typically is a public key container and includes
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the server's public key, server name, server information and the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# signature which was a result of the verification process using the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# CA certificate. This is required for a secure connection
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# establishment.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Valid absolute path to the certificate file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#cert_file = /etc/ssl/certs
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Absolute path to a private key file.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a string value representing a valid absolute path to a
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# private key file which is required to establish the client-server
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# connection.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Absolute path to the private key file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#key_file = /etc/ssl/key/key-file.pem
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEPRECATED: The HTTP header used to determine the scheme for the original
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# request, even if it was removed by an SSL terminating proxy. Typical value is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# "HTTP_X_FORWARDED_PROTO". (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reason: Use the http_proxy_to_wsgi middleware instead.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#secure_proxy_ssl_header = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The relative path to sqlite file database that will be used for image cache
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# management.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This is a relative path to the sqlite file database that tracks the age and
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# usage statistics of image cache. The path is relative to image cache base
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# directory, specified by the configuration option ``image_cache_dir``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This is a lightweight database with just one table.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid relative path to sqlite file database
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * ``image_cache_dir``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #image_cache_sqlite_db = cache.db
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The driver to use for image cache management. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The driver to use for image cache management.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This configuration option provides the flexibility to choose between the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# different image-cache drivers available. An image-cache driver is responsible
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# for providing the essential functions of image-cache like write images to/read
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# images from cache, track age and usage of cached images, provide a list of
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# cached images, fetch size of the cache, queue images for caching and clean up
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the cache, etc.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The essential functions of a driver are defined in the base class
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``glance.image_cache.drivers.base.Driver``. All image-cache drivers (existing
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# and prospective) must implement this interface. Currently available drivers
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# are ``sqlite`` and ``xattr``. These drivers primarily differ in the way they
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# store the information about cached images:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * The ``sqlite`` driver uses a sqlite database (which sits on every glance
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     node locally) to track the usage of cached images.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * The ``xattr`` driver uses the extended attributes of files to store this
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     information. It also requires a filesystem that sets ``atime`` on the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# files
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     when accessed.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * sqlite
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * xattr
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Allowed values: sqlite, xattr
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #image_cache_driver = sqlite
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The upper limit (the maximum size of accumulated cache in bytes)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# beyond which the cache pruner, if running, starts cleaning the image
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# cache. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The upper limit on cache size, in bytes, after which the cache-pruner cleans
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# up the image cache.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: This is just a threshold for cache-pruner to act upon. It is NOT a
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# hard limit beyond which the image cache would never grow. In fact, depending
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# on how often the cache-pruner runs and how quickly the cache fills, the image
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# cache can far exceed the size specified here very easily. Hence, care must be
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# taken to appropriately schedule the cache-pruner and in setting this limit.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Glance caches an image when it is downloaded. Consequently, the size of the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# image cache grows over time as the number of downloads increases. To keep the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# cache size from becoming unmanageable, it is recommended to run the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# cache-pruner as a periodic task. When the cache pruner is kicked off, it
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# compares the current size of image cache and triggers a cleanup if the image
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# cache grew beyond the size specified here. After the cleanup, the size of
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# cache is less than or equal to size specified here.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Any non-negative integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #image_cache_max_size = 10737418240
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The amount of time to let an incomplete image remain in the cache,
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# before the cache cleaner, if running, will remove the incomplete
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# image. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The amount of time, in seconds, an incomplete image remains in the cache.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Incomplete images are images for which download is in progress. Please see the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# description of configuration option ``image_cache_dir`` for more detail.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Sometimes, due to various reasons, it is possible the download may hang and
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the incompletely downloaded image remains in the ``incomplete`` directory.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This configuration option sets a time limit on how long the incomplete images
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# should remain in the ``incomplete`` directory before they are cleaned up.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Once an incomplete image spends more time than is specified here, it'll be
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# removed by cache-cleaner on its next run.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# It is recommended to run cache-cleaner as a periodic task on the Glance API
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# nodes to keep the incomplete images from occupying disk space.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Any non-negative integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #image_cache_stall_time = 86400
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Base directory that the image cache uses. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Base directory for image cache.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This is the location where image data is cached and served out of. All cached
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# images are stored directly under this directory. This directory also contains
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# three subdirectories, namely, ``incomplete``, ``invalid`` and ``queue``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The ``incomplete`` subdirectory is the staging area for downloading images. An
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# image is first downloaded to this directory. When the image download is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# successful it is moved to the base directory. However, if the download fails,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the partially downloaded image file is moved to the ``invalid`` subdirectory.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The ``queue``subdirectory is used for queuing images for download. This is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# used primarily by the cache-prefetcher, which can be scheduled as a periodic
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# task like cache-pruner and cache-cleaner, to cache images ahead of their
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# usage.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Upon receiving the request to cache an image, Glance touches a file in the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``queue`` directory with the image id as the file name. The cache-prefetcher,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# when running, polls for the files in ``queue`` directory and starts
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# downloading them in the order they were created. When the download is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# successful, the zero-sized file is deleted from the ``queue`` directory.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# If the download fails, the zero-sized file remains and it'll be retried the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# next time cache-prefetcher runs.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid path
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * ``image_cache_sqlite_db``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #image_cache_dir = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Default publisher_id for outgoing notifications. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Default publisher_id for outgoing Glance notifications.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This is the value that the notification driver will use to identify
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# messages for events originating from the Glance service. Typically,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# this is the hostname of the instance that generated the message.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Any reasonable instance identifier, for example: image.host1
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #default_publisher_id = image.localhost
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# List of disabled notifications. A notification can be given either
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# as a notification type to disable a single event, or as a
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# notification group prefix to disable all events within a group.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Example: if this config option is set to ["image.create",
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# "metadef_namespace"], then "image.create" notification will not be
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# sent after image is created and none of the notifications for
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# metadefinition namespaces will be sent. (list value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# List of notifications to be disabled.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Specify a list of notifications that should not be emitted.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# A notification can be given either as a notification type to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# disable a single event notification, or as a notification group
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# prefix to disable all event notifications within a group.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     A comma-separated list of individual notification types or
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     notification groups to be disabled. Currently supported groups:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#         * image
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#         * image.member
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#         * task
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#         * metadef_namespace
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#         * metadef_object
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#         * metadef_property
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#         * metadef_resource_type
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#         * metadef_tag
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     For a complete listing and description of each event refer to:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     http://docs.openstack.org/developer/glance/notifications.html
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     The values must be specified as: <group_name>.<event_name>
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     For example: image.create,task.success,metadef_tag
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (list value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #disabled_notifications =
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Address to find the registry server. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Address the registry server is hosted on.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid IP or hostname
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #registry_host = 0.0.0.0
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Port the registry server is listening on. (port value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +registry_host = 10.167.4.10
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Port the registry server is listening on.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid port number
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (port value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Minimum value: 0
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Maximum value: 65535
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #registry_port = 9191
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Whether to pass through the user token when making requests to the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# registry. To prevent failures with token expiration during big files
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# upload, it is recommended to set this parameter to False.If
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# "use_user_token" is not in effect, then admin credentials can be
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# specified. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +registry_port = 9191
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEPRECATED: Whether to pass through the user token when making requests to the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# registry. To prevent failures with token expiration during big files upload,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# it is recommended to set this parameter to False.If "use_user_token" is not in
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# effect, then admin credentials can be specified. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # This option is deprecated for removal.
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Reason: This option was considered harmful and has been deprecated
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# in M release. It will be removed in O release. For more information
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# read OSSN-0060. Related functionality with uploading big images has
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# been implemented with Keystone trusts support.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reason: This option was considered harmful and has been deprecated in M
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# release. It will be removed in O release. For more information read OSSN-0060.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related functionality with uploading big images has been implemented with
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Keystone trusts support.
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #use_user_token = true
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The administrators user name. If "use_user_token" is not in effect,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEPRECATED: The administrators user name. If "use_user_token" is not in
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# effect, then admin credentials can be specified. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reason: This option was considered harmful and has been deprecated in M
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# release. It will be removed in O release. For more information read OSSN-0060.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related functionality with uploading big images has been implemented with
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Keystone trusts support.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#admin_user = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEPRECATED: The administrators password. If "use_user_token" is not in effect,
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # then admin credentials can be specified. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # This option is deprecated for removal.
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Reason: This option was considered harmful and has been deprecated
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# in M release. It will be removed in O release. For more information
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# read OSSN-0060. Related functionality with uploading big images has
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# been implemented with Keystone trusts support.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#admin_user = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The administrators password. If "use_user_token" is not in effect,
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# then admin credentials can be specified. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reason: This option was considered harmful and has been deprecated in M
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# release. It will be removed in O release. For more information read OSSN-0060.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related functionality with uploading big images has been implemented with
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Keystone trusts support.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#admin_password = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEPRECATED: The tenant name of the administrative user. If "use_user_token" is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# not in effect, then admin tenant name can be specified. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # This option is deprecated for removal.
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Reason: This option was considered harmful and has been deprecated
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# in M release. It will be removed in O release. For more information
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# read OSSN-0060. Related functionality with uploading big images has
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# been implemented with Keystone trusts support.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#admin_password = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The tenant name of the administrative user. If "use_user_token" is
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# not in effect, then admin tenant name can be specified. (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reason: This option was considered harmful and has been deprecated in M
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# release. It will be removed in O release. For more information read OSSN-0060.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related functionality with uploading big images has been implemented with
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Keystone trusts support.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#admin_tenant_name = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEPRECATED: The URL to the keystone service. If "use_user_token" is not in
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# effect and using keystone auth, then URL of keystone can be specified. (string
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # This option is deprecated for removal.
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Reason: This option was considered harmful and has been deprecated
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# in M release. It will be removed in O release. For more information
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# read OSSN-0060. Related functionality with uploading big images has
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# been implemented with Keystone trusts support.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#admin_tenant_name = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The URL to the keystone service. If "use_user_token" is not in
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# effect and using keystone auth, then URL of keystone can be
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# specified. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# This option is deprecated for removal.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Reason: This option was considered harmful and has been deprecated
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# in M release. It will be removed in O release. For more information
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# read OSSN-0060. Related functionality with uploading big images has
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# been implemented with Keystone trusts support.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reason: This option was considered harmful and has been deprecated in M
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# release. It will be removed in O release. For more information read OSSN-0060.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related functionality with uploading big images has been implemented with
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Keystone trusts support.
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #auth_url = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The strategy to use for authentication. If "use_user_token" is not
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEPRECATED: The strategy to use for authentication. If "use_user_token" is not
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # in effect, then auth strategy can be specified. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # This option is deprecated for removal.
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Reason: This option was considered harmful and has been deprecated
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# in M release. It will be removed in O release. For more information
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# read OSSN-0060. Related functionality with uploading big images has
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# been implemented with Keystone trusts support.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reason: This option was considered harmful and has been deprecated in M
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# release. It will be removed in O release. For more information read OSSN-0060.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related functionality with uploading big images has been implemented with
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Keystone trusts support.
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #auth_strategy = noauth
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The region for the authentication service. If "use_user_token" is
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# not in effect and using keystone auth, then region name can be
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# specified. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEPRECATED: The region for the authentication service. If "use_user_token" is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# not in effect and using keystone auth, then region name can be specified.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # This option is deprecated for removal.
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Reason: This option was considered harmful and has been deprecated
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# in M release. It will be removed in O release. For more information
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# read OSSN-0060. Related functionality with uploading big images has
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# been implemented with Keystone trusts support.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reason: This option was considered harmful and has been deprecated in M
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# release. It will be removed in O release. For more information read OSSN-0060.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related functionality with uploading big images has been implemented with
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Keystone trusts support.
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #auth_region = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The protocol to use for communication with the registry server.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Either http or https. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +auth_region = RegionOne
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Protocol to use for communication with the registry server.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a string value representing the protocol to use for
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# communication with the registry server. By default, this option is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# set to ``http`` and the connection is not secure.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option can be set to ``https`` to establish a secure connection
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# to the registry server. In this case, provide a key to use for the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# SSL connection using the ``registry_client_key_file`` option. Also
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# include the CA file and cert file using the options
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``registry_client_ca_file`` and ``registry_client_cert_file``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# respectively.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * http
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * https
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * registry_client_key_file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * registry_client_cert_file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * registry_client_ca_file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Allowed values: http, https
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #registry_client_protocol = http
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The path to the key file to use in SSL connections to the registry
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# server, if any. Alternately, you may set the GLANCE_CLIENT_KEY_FILE
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# environment variable to a filepath of the key file (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#registry_client_key_file = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The path to the cert file to use in SSL connections to the registry
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# server, if any. Alternately, you may set the GLANCE_CLIENT_CERT_FILE
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# environment variable to a filepath of the CA cert file (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#registry_client_cert_file = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The path to the certifying authority cert file to use in SSL
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# connections to the registry server, if any. Alternately, you may set
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# the GLANCE_CLIENT_CA_FILE environment variable to a filepath of the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# CA cert file. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#registry_client_ca_file = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# When using SSL in connections to the registry server, do not require
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# validation via a certifying authority. This is the registry's
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# equivalent of specifying --insecure on the command line using
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# glanceclient for the API. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +registry_client_protocol = http
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Absolute path to the private key file.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a string value representing a valid absolute path to the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# private key file to use for establishing a secure connection to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the registry server.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: This option must be set if ``registry_client_protocol`` is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# set to ``https``. Alternatively, the GLANCE_CLIENT_KEY_FILE
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# environment variable may be set to a filepath of the key file.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * String value representing a valid absolute path to the key
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       file.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * registry_client_protocol
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#registry_client_key_file = /etc/ssl/key/key-file.pem
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Absolute path to the certificate file.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a string value representing a valid absolute path to the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# certificate file to use for establishing a secure connection to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the registry server.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: This option must be set if ``registry_client_protocol`` is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# set to ``https``. Alternatively, the GLANCE_CLIENT_CERT_FILE
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# environment variable may be set to a filepath of the certificate
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# file.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * String value representing a valid absolute path to the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       certificate file.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * registry_client_protocol
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#registry_client_cert_file = /etc/ssl/certs/file.crt
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Absolute path to the Certificate Authority file.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a string value representing a valid absolute path to the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# certificate authority file to use for establishing a secure
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# connection to the registry server.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: This option must be set if ``registry_client_protocol`` is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# set to ``https``. Alternatively, the GLANCE_CLIENT_CA_FILE
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# environment variable may be set to a filepath of the CA file.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option is ignored if the ``registry_client_insecure`` option
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# is set to ``True``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * String value representing a valid absolute path to the CA
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       file.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * registry_client_protocol
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * registry_client_insecure
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#registry_client_ca_file = /etc/ssl/cafile/file.ca
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Set verification of the registry server certificate.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a boolean value to determine whether or not to validate
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# SSL connections to the registry server. By default, this option
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# is set to ``False`` and the SSL connections are validated.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# If set to ``True``, the connection to the registry server is not
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# validated via a certifying authority and the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``registry_client_ca_file`` option is ignored. This is the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# registry's equivalent of specifying --insecure on the command line
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# using glanceclient for the API.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * registry_client_protocol
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * registry_client_ca_file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #registry_client_insecure = false
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The period of time, in seconds, that the API server will wait for a
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# registry request to complete. A value of 0 implies no timeout.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Timeout value for registry requests.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide an integer value representing the period of time in seconds
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# that the API server will wait for a registry request to complete.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The default value is 600 seconds.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# A value of 0 implies that a request will never timeout.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Zero
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Positive integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #registry_client_timeout = 600
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Whether to pass through headers containing user and tenant
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# information when making requests to the registry. This allows the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# registry to use the context middleware without keystonemiddleware's
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# auth_token middleware, removing calls to the keystone auth service.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# It is recommended that when using this option, secure communication
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# between glance api and glance registry is ensured by means other
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# than auth_token middleware. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Send headers received from identity when making requests to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# registry.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Typically, Glance registry can be deployed in multiple flavors,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# which may or may not include authentication. For example,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``trusted-auth`` is a flavor that does not require the registry
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# service to authenticate the requests it receives. However, the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# registry service may still need a user context to be populated to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# serve the requests. This can be achieved by the caller
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# (the Glance API usually) passing through the headers it received
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# from authenticating with identity for the same request. The typical
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# headers sent are ``X-User-Id``, ``X-Tenant-Id``, ``X-Roles``,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``X-Identity-Status`` and ``X-Service-Catalog``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a boolean value to determine whether to send the identity
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# headers to provide tenant and user information along with the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# requests to registry service. By default, this option is set to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``False``, which means that user and tenant information is not
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# available readily. It must be obtained by authenticating. Hence, if
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# this is set to ``False``, ``flavor`` must be set to value that
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# either includes authentication or authenticated user context.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * flavor
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #send_identity_headers = false
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The amount of time in seconds to delay before performing a delete.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The amount of time, in seconds, to delay image scrubbing.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When delayed delete is turned on, an image is put into ``pending_delete``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# state upon deletion until the scrubber deletes its image data. Typically, soon
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# after the image is put into ``pending_delete`` state, it is available for
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# scrubbing. However, scrubbing can be delayed until a later point using this
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# configuration option. This option denotes the time period an image spends in
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``pending_delete`` state before it is available for scrubbing.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# It is important to realize that this has storage implications. The larger the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``scrub_time``, the longer the time to reclaim backend storage from deleted
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# images.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Any non-negative integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * ``delayed_delete``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #scrub_time = 0
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The size of thread pool to be used for scrubbing images. The default
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# is one, which signifies serial scrubbing. Any value above one
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# indicates the max number of images that may be scrubbed in parallel.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The size of thread pool to be used for scrubbing images.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When there are a large number of images to scrub, it is beneficial to scrub
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# images in parallel so that the scrub queue stays in control and the backend
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# storage is reclaimed in a timely fashion. This configuration option denotes
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the maximum number of images to be scrubbed in parallel. The default value is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# one, which signifies serial scrubbing. Any value above one indicates parallel
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# scrubbing.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Any non-zero positive integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * ``delayed_delete``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #scrub_pool_size = 1
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Turn on/off delayed delete. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Turn on/off delayed delete.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Typically when an image is deleted, the ``glance-api`` service puts the image
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# into ``deleted`` state and deletes its data at the same time. Delayed delete
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# is a feature in Glance that delays the actual deletion of image data until a
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# later point in time (as determined by the configuration option
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``scrub_time``).
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When delayed delete is turned on, the ``glance-api`` service puts the image
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# into ``pending_delete`` state upon deletion and leaves the image data in the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# storage backend for the image scrubber to delete at a later time. The image
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# scrubber will move the image into ``deleted`` state upon successful deletion
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# of image data.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: When delayed delete is turned on, image scrubber MUST be running as a
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# periodic task to prevent the backend storage from filling up with undesired
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# usage.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * ``scrub_time``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * ``wakeup_time``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * ``scrub_pool_size``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #delayed_delete = false
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # From oslo.log
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# If set to true, the logging level will be set to DEBUG instead of
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# the default INFO level. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# If set to true, the logging level will be set to DEBUG instead of the default
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# INFO level. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Note: This option can be changed without restarting.
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #debug = false
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# If set to false, the logging level will be set to WARNING instead of
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# the default INFO level. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +debug = false
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEPRECATED: If set to false, the logging level will be set to WARNING instead
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# of the default INFO level. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # This option is deprecated for removal.
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #verbose = true
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The name of a logging configuration file. This file is appended to
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# any existing logging configuration files. For details about logging
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# configuration files, see the Python logging module documentation.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Note that when logging configuration files are used then all logging
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# configuration is set in the configuration file and other logging
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# configuration options are ignored (for example,
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# logging_context_format_string). (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +verbose = true
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The name of a logging configuration file. This file is appended to any
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# existing logging configuration files. For details about logging configuration
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# files, see the Python logging module documentation. Note that when logging
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# configuration files are used then all logging configuration is set in the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# configuration file and other logging configuration options are ignored (for
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# example, logging_context_format_string). (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Note: This option can be changed without restarting.
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/log_config
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #log_config_append = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Defines the format string for %%(asctime)s in log records. Default:
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# %(default)s . This option is ignored if log_config_append is set.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# %(default)s . This option is ignored if log_config_append is set. (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #log_date_format = %Y-%m-%d %H:%M:%S
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (Optional) Name of log file to send logging output to. If no default
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# is set, logging will go to stderr as defined by use_stderr. This
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# option is ignored if log_config_append is set. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# (Optional) Name of log file to send logging output to. If no default is set,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# logging will go to stderr as defined by use_stderr. This option is ignored if
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# log_config_append is set. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/logfile
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #log_file = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (Optional) The base directory used for relative log_file  paths.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# This option is ignored if log_config_append is set. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +log_file = /var/log/glance/api.log
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# (Optional) The base directory used for relative log_file  paths. This option
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# is ignored if log_config_append is set. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/logdir
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #log_dir = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Uses logging handler designed to watch file system. When log file is
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# moved or removed this handler will open a new log file with
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# specified path instantaneously. It makes sense only if log_file
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# option is specified and Linux platform is used. This option is
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# ignored if log_config_append is set. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Uses logging handler designed to watch file system. When log file is moved or
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# removed this handler will open a new log file with specified path
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# instantaneously. It makes sense only if log_file option is specified and Linux
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# platform is used. This option is ignored if log_config_append is set. (boolean
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #watch_log_file = false
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Use syslog for logging. Existing syslog format is DEPRECATED and
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# will be changed later to honor RFC5424. This option is ignored if
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# log_config_append is set. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Use syslog for logging. Existing syslog format is DEPRECATED and will be
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# changed later to honor RFC5424. This option is ignored if log_config_append is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# set. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #use_syslog = false
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Syslog facility to receive log lines. This option is ignored if
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # log_config_append is set. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #syslog_log_facility = LOG_USER
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Log output to standard error. This option is ignored if
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# log_config_append is set. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#use_stderr = true
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Log output to standard error. This option is ignored if log_config_append is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# set. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#use_stderr = false
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Format string to use for log messages with context. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #logging_context_format_string = %(asctime)s.%(msecs)03d %(process)d %(levelname)s %(name)s [%(request_id)s %(user_identity)s] %(instance)s%(message)s
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Format string to use for log messages when context is undefined.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Format string to use for log messages when context is undefined. (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #logging_default_format_string = %(asctime)s.%(msecs)03d %(process)d %(levelname)s %(name)s [-] %(instance)s%(message)s
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Additional data to append to log message when logging level for the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# message is DEBUG. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Additional data to append to log message when logging level for the message is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEBUG. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #logging_debug_format_suffix = %(funcName)s %(pathname)s:%(lineno)d
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Prefix each line of exception output with this format. (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Prefix each line of exception output with this format. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #logging_exception_prefix = %(asctime)s.%(msecs)03d %(process)d ERROR %(name)s %(instance)s
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Defines the format string for %(user_identity)s that is used in
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # logging_context_format_string. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# List of package logging levels in logger=LEVEL pairs. This option is
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# ignored if log_config_append is set. (list value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# List of package logging levels in logger=LEVEL pairs. This option is ignored
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# if log_config_append is set. (list value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #default_log_levels = amqp=WARN,amqplib=WARN,boto=WARN,qpid=WARN,sqlalchemy=WARN,suds=INFO,oslo.messaging=INFO,iso8601=WARN,requests.packages.urllib3.connectionpool=WARN,urllib3.connectionpool=WARN,websocket=WARN,requests.packages.urllib3.util.retry=WARN,urllib3.util.retry=WARN,keystonemiddleware=WARN,routes.middleware=WARN,stevedore=WARN,taskflow=WARN,keystoneauth=WARN,oslo.cache=INFO,dogpile.core.dogpile=INFO
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Enables or disables publication of error events. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #publish_errors = false
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The format for an instance that is passed with the log message.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The format for an instance that is passed with the log message. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #instance_format = "[instance: %(uuid)s] "
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The format for an instance UUID that is passed with the log message.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The format for an instance UUID that is passed with the log message. (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #instance_uuid_format = "[instance: %(uuid)s] "
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Interval, number of seconds, of log rate limiting. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#rate_limit_interval = 0
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Maximum number of logged messages per rate_limit_interval. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#rate_limit_burst = 0
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Log level name used by rate limiting: CRITICAL, ERROR, INFO, WARNING, DEBUG or
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# empty string. Logs with level greater or equal to rate_limit_except_level are
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# not filtered. An empty string means that all levels are filtered. (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#rate_limit_except_level = CRITICAL
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Enables or disables fatal status of deprecations. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #fatal_deprecations = false
Sep 28 11:21:28 ctl02 salt-minion[14967]: @@ -474,64 +1579,154 @@
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rpc_conn_pool_size
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #rpc_conn_pool_size = 30
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# ZeroMQ bind address. Should be a wildcard (*), an ethernet
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# interface, or IP. The "host" option should point or resolve to this
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# address. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The pool size limit for connections expiration policy (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#conn_pool_min_size = 2
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The time-to-live in sec of idle connections in the pool (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#conn_pool_ttl = 1200
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ZeroMQ bind address. Should be a wildcard (*), an ethernet interface, or IP.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The "host" option should point or resolve to this address. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_bind_address
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #rpc_zmq_bind_address = *
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # MatchMaker driver. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Allowed values: redis, dummy
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_matchmaker
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #rpc_zmq_matchmaker = redis
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Type of concurrency used. Either "native" or "eventlet" (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Number of ZeroMQ contexts, defaults to 1. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_contexts
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#rpc_zmq_contexts = 1
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Maximum number of ingress messages to locally buffer per topic. Default is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# unlimited. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_topic_backlog
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#rpc_zmq_topic_backlog = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Directory for holding IPC sockets. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_ipc_dir
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#rpc_zmq_ipc_dir = /var/run/openstack
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Name of this node. Must be a valid hostname, FQDN, or IP address. Must match
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# "host" option, if running Nova. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_host
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#rpc_zmq_host = localhost
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Number of seconds to wait before all pending messages will be sent after
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# closing a socket. The default value of -1 specifies an infinite linger period.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The value of 0 specifies no linger period. Pending messages shall be discarded
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# immediately when the socket is closed. Positive values specify an upper bound
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# for the linger period. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_cast_timeout
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#zmq_linger = -1
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The default number of seconds that poll should wait. Poll raises timeout
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# exception when timeout expired. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_poll_timeout
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#rpc_poll_timeout = 1
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Expiration timeout in seconds of a name service record about existing target (
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# < 0 means no timeout). (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/zmq_target_expire
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#zmq_target_expire = 300
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Update period in seconds of a name service record about existing target.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/zmq_target_update
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#zmq_target_update = 180
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Use PUB/SUB pattern for fanout methods. PUB/SUB always uses proxy. (boolean
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#rpc_zmq_concurrency = eventlet
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Number of ZeroMQ contexts, defaults to 1. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#rpc_zmq_contexts = 1
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Maximum number of ingress messages to locally buffer per topic.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Default is unlimited. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#rpc_zmq_topic_backlog = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Directory for holding IPC sockets. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#rpc_zmq_ipc_dir = /var/run/openstack
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Name of this node. Must be a valid hostname, FQDN, or IP address.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Must match "host" option, if running Nova. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#rpc_zmq_host = localhost
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Seconds to wait before a cast expires (TTL). The default value of -1
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# specifies an infinite linger period. The value of 0 specifies no
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# linger period. Pending messages shall be discarded immediately when
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# the socket is closed. Only supported by impl_zmq. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#rpc_cast_timeout = -1
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The default number of seconds that poll should wait. Poll raises
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# timeout exception when timeout expired. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#rpc_poll_timeout = 1
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Expiration timeout in seconds of a name service record about
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# existing target ( < 0 means no timeout). (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#zmq_target_expire = 120
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Use PUB/SUB pattern for fanout methods. PUB/SUB always uses proxy.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#use_pub_sub = true
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/use_pub_sub
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#use_pub_sub = false
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Use ROUTER remote proxy. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/use_router_proxy
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#use_router_proxy = false
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Minimal port number for random ports range. (port value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Minimum value: 0
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Maximum value: 65535
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#rpc_zmq_min_port = 49152
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_min_port
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#rpc_zmq_min_port = 49153
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Maximal port number for random ports range. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Minimum value: 1
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Maximum value: 65536
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_max_port
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #rpc_zmq_max_port = 65536
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Number of retries to find free port number before fail with
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# ZMQBindError. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Number of retries to find free port number before fail with ZMQBindError.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_bind_port_retries
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #rpc_zmq_bind_port_retries = 100
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Default serialization mechanism for serializing/deserializing
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# outgoing/incoming messages (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Allowed values: json, msgpack
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_serialization
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#rpc_zmq_serialization = json
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option configures round-robin mode in zmq socket. True means not keeping
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# a queue when server side disconnects. False means to keep queue and messages
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# even if server is disconnected, when the server appears we send all
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# accumulated messages to it. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#zmq_immediate = false
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Enable/disable TCP keepalive (KA) mechanism. The default value of -1 (or any
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# other negative value) means to skip any overrides and leave it to OS default;
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# 0 and 1 (or any other positive value) mean to disable and enable the option
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# respectively. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#zmq_tcp_keepalive = -1
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The duration between two keepalive transmissions in idle condition. The unit
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# is platform dependent, for example, seconds in Linux, milliseconds in Windows
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# etc. The default value of -1 (or any other negative value and 0) means to skip
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# any overrides and leave it to OS default. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#zmq_tcp_keepalive_idle = -1
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The number of retransmissions to be carried out before declaring that remote
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# end is not available. The default value of -1 (or any other negative value and
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# 0) means to skip any overrides and leave it to OS default. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#zmq_tcp_keepalive_cnt = -1
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The duration between two successive keepalive retransmissions, if
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# acknowledgement to the previous keepalive transmission is not received. The
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# unit is platform dependent, for example, seconds in Linux, milliseconds in
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Windows etc. The default value of -1 (or any other negative value and 0) means
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# to skip any overrides and leave it to OS default. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#zmq_tcp_keepalive_intvl = -1
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Maximum number of (green) threads to work concurrently. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#rpc_thread_pool_size = 100
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Expiration timeout in seconds of a sent/received message after which it is not
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# tracked anymore by a client/server. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#rpc_message_ttl = 300
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Wait for message acknowledgements from receivers. This mechanism works only
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# via proxy without PUB/SUB. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#rpc_use_acks = false
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Number of seconds to wait for an ack from a cast/call. After each retry
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# attempt this timeout is multiplied by some specified multiplier. (integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#rpc_ack_timeout_base = 15
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Number to multiply base ack timeout by after each retry attempt. (integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#rpc_ack_timeout_multiplier = 2
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Default number of message sending attempts in case of any problems occurred:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# positive value N means at most N retries, 0 means no retries, None or -1 (or
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# any other negative values) mean to retry forever. This option is used only if
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# acknowledgments are enabled. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#rpc_retry_attempts = 3
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# List of publisher hosts SubConsumer can subscribe on. This option has higher
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# priority then the default publishers list taken from the matchmaker. (list
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#subscribe_on =
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Size of executor thread pool. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rpc_thread_pool_size
Sep 28 11:21:28 ctl02 salt-minion[14967]: @@ -540,19 +1735,23 @@
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Seconds to wait for a response from a call. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #rpc_response_timeout = 60
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# A URL representing the messaging driver to use and its full
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# configuration. If not set, we fall back to the rpc_backend option
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# and driver specific configuration. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# A URL representing the messaging driver to use and its full configuration.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #transport_url = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The messaging driver to use, defaults to rabbit. Other drivers
Sep 28 11:21:28 ctl02 salt-minion[14967]: +transport_url = rabbit://openstack:opnfv_secret@10.167.4.41:5672,openstack:opnfv_secret@10.167.4.42:5672,openstack:opnfv_secret@10.167.4.43:5672//openstack
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEPRECATED: The messaging driver to use, defaults to rabbit. Other drivers
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # include amqp and zmq. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #rpc_backend = rabbit
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The default exchange under which topics are scoped. May be
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# overridden by an exchange name specified in the transport_url
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# option. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The default exchange under which topics are scoped. May be overridden by an
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# exchange name specified in the transport_url option. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #control_exchange = openstack
Sep 28 11:21:28 ctl02 salt-minion[14967]: +control_exchange = openstack
Sep 28 11:21:28 ctl02 salt-minion[14967]: +scrubber_datadir=/var/lib/glance/scrubber
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  [cors]
Sep 28 11:21:28 ctl02 salt-minion[14967]: @@ -561,27 +1760,26 @@
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # From oslo.middleware.cors
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Indicate whether this resource may be shared with the domain
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# received in the requests "origin" header. (list value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Indicate whether this resource may be shared with the domain received in the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# requests "origin" header. Format: "<protocol>://<host>[:<port>]", no trailing
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# slash. Example: https://horizon.example.com (list value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #allowed_origin = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Indicate that the actual request can include user credentials
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Indicate that the actual request can include user credentials (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #allow_credentials = true
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Indicate which headers are safe to expose to the API. Defaults to
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# HTTP Simple Headers. (list value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Indicate which headers are safe to expose to the API. Defaults to HTTP Simple
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Headers. (list value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #expose_headers = X-Image-Meta-Checksum,X-Auth-Token,X-Subject-Token,X-Service-Token,X-OpenStack-Request-ID
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Maximum cache age of CORS preflight requests. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #max_age = 3600
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Indicate which methods can be used during the actual request. (list
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Indicate which methods can be used during the actual request. (list value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#allow_methods = GET,PUT,POST,DELETE,PATCH
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Indicate which header field names may be used during the actual request. (list
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#allow_methods = GET,PUT,POST,DELETE,PATCH
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Indicate which header field names may be used during the actual
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# request. (list value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #allow_headers = Content-MD5,X-Image-Meta-Checksum,X-Storage-Token,Accept-Encoding,X-Auth-Token,X-Identity-Status,X-Roles,X-Service-Catalog,X-User-Id,X-Tenant-Id,X-OpenStack-Request-ID
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: @@ -591,27 +1789,26 @@
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # From oslo.middleware.cors
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Indicate whether this resource may be shared with the domain
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# received in the requests "origin" header. (list value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Indicate whether this resource may be shared with the domain received in the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# requests "origin" header. Format: "<protocol>://<host>[:<port>]", no trailing
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# slash. Example: https://horizon.example.com (list value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #allowed_origin = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Indicate that the actual request can include user credentials
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Indicate that the actual request can include user credentials (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #allow_credentials = true
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Indicate which headers are safe to expose to the API. Defaults to
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# HTTP Simple Headers. (list value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Indicate which headers are safe to expose to the API. Defaults to HTTP Simple
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Headers. (list value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #expose_headers = X-Image-Meta-Checksum,X-Auth-Token,X-Subject-Token,X-Service-Token,X-OpenStack-Request-ID
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Maximum cache age of CORS preflight requests. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #max_age = 3600
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Indicate which methods can be used during the actual request. (list
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Indicate which methods can be used during the actual request. (list value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#allow_methods = GET,PUT,POST,DELETE,PATCH
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Indicate which header field names may be used during the actual request. (list
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#allow_methods = GET,PUT,POST,DELETE,PATCH
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Indicate which header field names may be used during the actual
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# request. (list value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #allow_headers = Content-MD5,X-Image-Meta-Checksum,X-Storage-Token,Accept-Encoding,X-Auth-Token,X-Identity-Status,X-Roles,X-Service-Catalog,X-User-Id,X-Tenant-Id,X-OpenStack-Request-ID
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: @@ -621,9 +1818,13 @@
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # From oslo.db
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The file name to use with SQLite. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEPRECATED: The file name to use with SQLite. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/sqlite_db
Sep 28 11:21:28 ctl02 salt-minion[14967]: -sqlite_db = /var/lib/glance/glance.sqlite
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reason: Should use config option connection or slave_connection to connect the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# database.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#sqlite_db = oslo.sqlite
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # If True, SQLite uses synchronous mode. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/sqlite_synchronous
Sep 28 11:21:28 ctl02 salt-minion[14967]: @@ -631,23 +1832,25 @@
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # The back end to use for the database. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/db_backend
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#backend = sqlalchemy
Sep 28 11:21:28 ctl02 salt-minion[14967]:  backend = sqlalchemy
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The SQLAlchemy connection string to use to connect to the database.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The SQLAlchemy connection string to use to connect to the database. (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/sql_connection
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DATABASE]/sql_connection
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [sql]/connection
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #connection = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The SQLAlchemy connection string to use to connect to the slave
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# database. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +connection = mysql+pymysql://glance:opnfv_secret@10.167.4.50/glance
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The SQLAlchemy connection string to use to connect to the slave database.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #slave_connection = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The SQL mode to be used for MySQL sessions. This option, including
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# the default, overrides any server-set SQL mode. To use whatever SQL
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# mode is set by the server configuration, set this to no value.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Example: mysql_sql_mode= (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The SQL mode to be used for MySQL sessions. This option, including the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# default, overrides any server-set SQL mode. To use whatever SQL mode is set by
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the server configuration, set this to no value. Example: mysql_sql_mode=
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #mysql_sql_mode = TRADITIONAL
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Timeout before idle SQL connections are reaped. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: @@ -655,39 +1858,41 @@
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DATABASE]/sql_idle_timeout
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [sql]/idle_timeout
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #idle_timeout = 3600
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Minimum number of SQL connections to keep open in a pool. (integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +idle_timeout = 3600
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum number of SQL connections to keep open in a pool. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/sql_min_pool_size
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DATABASE]/sql_min_pool_size
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #min_pool_size = 1
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Maximum number of SQL connections to keep open in a pool. (integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Maximum number of SQL connections to keep open in a pool. Setting a value of 0
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# indicates no limit. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/sql_max_pool_size
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DATABASE]/sql_max_pool_size
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#max_pool_size = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Maximum number of database connection retries during startup. Set to
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# -1 to specify an infinite retry count. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#max_pool_size = 5
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Maximum number of database connection retries during startup. Set to -1 to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# specify an infinite retry count. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/sql_max_retries
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DATABASE]/sql_max_retries
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #max_retries = 10
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Interval between retries of opening a SQL connection. (integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +max_retries = -1
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Interval between retries of opening a SQL connection. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/sql_retry_interval
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DATABASE]/reconnect_interval
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #retry_interval = 10
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# If set, use this value for max_overflow with SQLAlchemy. (integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# If set, use this value for max_overflow with SQLAlchemy. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/sql_max_overflow
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DATABASE]/sqlalchemy_max_overflow
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #max_overflow = 50
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Verbosity of SQL debugging information: 0=None, 100=Everything.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +max_overflow = 30
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Verbosity of SQL debugging information: 0=None, 100=Everything. (integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Maximum value: 100
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/sql_connection_debug
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #connection_debug = 0
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: @@ -695,37 +1900,35 @@
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/sql_connection_trace
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #connection_trace = false
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# If set, use this value for pool_timeout with SQLAlchemy. (integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# If set, use this value for pool_timeout with SQLAlchemy. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DATABASE]/sqlalchemy_pool_timeout
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #pool_timeout = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Enable the experimental use of database reconnect on connection
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# lost. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Enable the experimental use of database reconnect on connection lost. (boolean
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #use_db_reconnect = false
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Seconds between retries of a database transaction. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #db_retry_interval = 1
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# If True, increases the interval between retries of a database
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# operation up to db_max_retry_interval. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# If True, increases the interval between retries of a database operation up to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# db_max_retry_interval. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #db_inc_retry_interval = true
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# If db_inc_retry_interval is set, the maximum seconds between retries
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# of a database operation. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# If db_inc_retry_interval is set, the maximum seconds between retries of a
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# database operation. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #db_max_retry_interval = 10
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Maximum retries in case of connection error or deadlock error before
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# error is raised. Set to -1 to specify an infinite retry count.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Maximum retries in case of connection error or deadlock error before error is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# raised. Set to -1 to specify an infinite retry count. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #db_max_retries = 20
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # From oslo.db.concurrency
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Enable the experimental use of thread pooling for all DB API calls
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Enable the experimental use of thread pooling for all DB API calls (boolean
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/dbapi_use_tpool
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #use_tpool = false
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: @@ -736,359 +1939,772 @@
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # From glance.store
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# List of stores enabled. Valid stores are: cinder, file, http, rbd,
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# sheepdog, swift, s3, vsphere (list value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# List of enabled Glance stores.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Register the storage backends to use for storing disk images
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# as a comma separated list. The default stores enabled for
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# storing disk images with Glance are ``file`` and ``http``.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A comma separated list that could include:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#         * file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#         * http
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#         * swift
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#         * rbd
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#         * sheepdog
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#         * cinder
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#         * vmware
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related Options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * default_store
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (list value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #stores = file,http
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Default scheme to use to store image data. The scheme must be
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# registered by one of the stores defined by the 'stores' config
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# option. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +default_store = file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +stores = file,http
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The default scheme to use for storing images.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a string value representing the default scheme to use for
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# storing images. If not set, Glance uses ``file`` as the default
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# scheme to store images with the ``file`` store.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: The value given for this configuration option must be a valid
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# scheme for a store registered with the ``stores`` configuration
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# option.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * filesystem
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * http
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * https
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * swift
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * swift+http
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * swift+https
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * swift+config
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * rbd
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * sheepdog
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * vsphere
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related Options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * stores
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Allowed values: file, filesystem, http, https, swift, swift+http, swift+https, swift+config, rbd, sheepdog, cinder, vsphere
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #default_store = file
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Minimum interval seconds to execute updating dynamic storage
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# capabilities based on backend status then. It's not a periodic
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# routine, the update logic will be executed only when interval
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# seconds elapsed and an operation of store has triggered. The feature
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# will be enabled only when the option value greater then zero.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum interval in seconds to execute updating dynamic storage
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# capabilities based on current backend status.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide an integer value representing time in seconds to set the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# minimum interval before an update of dynamic storage capabilities
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# for a storage backend can be attempted. Setting
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``store_capabilities_update_min_interval`` does not mean updates
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# occur periodically based on the set interval. Rather, the update
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# is performed at the elapse of this interval set, if an operation
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# of the store is triggered.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# By default, this option is set to zero and is disabled. Provide an
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# integer value greater than zero to enable this option.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: For more information on store capabilities and their updates,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# please visit: https://specs.openstack.org/openstack/glance-specs/specs/kilo
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# /store-capabilities.html
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# For more information on setting up a particular store in your
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# deplyment and help with the usage of this feature, please contact
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the storage driver maintainers listed here:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# http://docs.openstack.org/developer/glance_store/drivers/index.html
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Zero
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Positive integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related Options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #store_capabilities_update_min_interval = 0
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Specify the path to the CA bundle file to use in verifying the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# remote server certificate. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Information to match when looking for cinder in the service catalog.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When the ``cinder_endpoint_template`` is not set and any of
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``cinder_store_auth_address``, ``cinder_store_user_name``,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``cinder_store_project_name``, ``cinder_store_password`` is not set,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# cinder store uses this information to lookup cinder endpoint from the service
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# catalog in the current context. ``cinder_os_region_name``, if set, is taken
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# into consideration to fetch the appropriate endpoint.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The service catalog can be listed by the ``openstack catalog list`` command.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A string of of the following form:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       ``<service_type>:<service_name>:<endpoint_type>``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       At least ``service_type`` and ``endpoint_type`` should be specified.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       ``service_name`` can be omitted.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_os_region_name
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_endpoint_template
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_store_auth_address
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_store_user_name
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_store_project_name
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_store_password
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#cinder_catalog_info = volumev2::publicURL
Sep 28 11:21:28 ctl02 salt-minion[14967]: +cinder_catalog_info = volumev2::internalURL
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Override service catalog lookup with template for cinder endpoint.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When this option is set, this value is used to generate cinder endpoint,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# instead of looking up from the service catalog.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This value is ignored if ``cinder_store_auth_address``,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``cinder_store_user_name``, ``cinder_store_project_name``, and
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``cinder_store_password`` are specified.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# If this configuration option is set, ``cinder_catalog_info`` will be ignored.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * URL template string for cinder endpoint, where ``%%(tenant)s`` is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       replaced with the current tenant (project) name.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       For example: ``http://cinder.openstack.example.org/v2/%%(tenant)s``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_store_auth_address
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_store_user_name
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_store_project_name
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_store_password
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_catalog_info
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#cinder_endpoint_template = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Region name to lookup cinder service from the service catalog.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This is used only when ``cinder_catalog_info`` is used for determining the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# endpoint. If set, the lookup for cinder endpoint by this node is filtered to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the specified region. It is useful when multiple regions are listed in the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# catalog. If this is not set, the endpoint is looked up from every region.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A string that is a valid region name.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_catalog_info
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [glance_store]/os_region_name
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#cinder_os_region_name = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +cinder_os_region_name = RegionOne
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Location of a CA certificates file used for cinder client requests.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The specified CA certificates file, if set, is used to verify cinder
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# connections via HTTPS endpoint. If the endpoint is HTTP, this value is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ignored.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``cinder_api_insecure`` must be set to ``True`` to enable the verification.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Path to a ca certificates file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_api_insecure
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#cinder_ca_certificates_file = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Number of cinderclient retries on failed http calls.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When a call failed by any errors, cinderclient will retry the call up to the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# specified times after sleeping a few seconds.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A positive integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#cinder_http_retries = 3
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Time period, in seconds, to wait for a cinder volume transition to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# complete.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When the cinder volume is created, deleted, or attached to the glance node to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# read/write the volume data, the volume's state is changed. For example, the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# newly created volume status changes from ``creating`` to ``available`` after
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the creation process is completed. This specifies the maximum time to wait for
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the status change. If a timeout occurs while waiting, or the status is changed
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# to an unexpected value (e.g. `error``), the image creation fails.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A positive integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#cinder_state_transition_timeout = 300
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Allow to perform insecure SSL requests to cinder.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# If this option is set to True, HTTPS endpoint connection is verified using the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# CA certificates file specified by ``cinder_ca_certificates_file`` option.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_ca_certificates_file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#cinder_api_insecure = false
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The address where the cinder authentication service is listening.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When all of ``cinder_store_auth_address``, ``cinder_store_user_name``,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``cinder_store_project_name``, and ``cinder_store_password`` options are
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# specified, the specified values are always used for the authentication.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This is useful to hide the image volumes from users by storing them in a
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# project/tenant specific to the image service. It also enables users to share
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the image volume among other projects under the control of glance's ACL.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# If either of these options are not set, the cinder endpoint is looked up
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# from the service catalog, and current context's user and project are used.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid authentication service address, for example:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       ``http://openstack.example.org/identity/v2.0``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_store_user_name
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_store_password
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_store_project_name
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#cinder_store_auth_address = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# User name to authenticate against cinder.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This must be used with all the following related options. If any of these are
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# not specified, the user of the current context is used.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid user name
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_store_auth_address
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_store_password
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_store_project_name
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#cinder_store_user_name = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Password for the user authenticating against cinder.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This must be used with all the following related options. If any of these are
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# not specified, the user of the current context is used.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid password for the user specified by ``cinder_store_user_name``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_store_auth_address
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_store_user_name
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * cinder_store_project_name
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#cinder_store_password = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Project name where the image volume is stored in cinder.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# If this configuration option is not set, the project in current context is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# used.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This must be used with all the following related options. If any of these are
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# not specified, the project of the current context is used.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid project name
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * ``cinder_store_auth_address``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * ``cinder_store_user_name``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * ``cinder_store_password``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#cinder_store_project_name = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Path to the rootwrap configuration file to use for running commands as root.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The cinder store requires root privileges to operate the image volumes (for
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# connecting to iSCSI/FC volumes and reading/writing the volume data, etc.).
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The configuration file should allow the required commands by cinder store and
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# os-brick library.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Path to the rootwrap config file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#rootwrap_config = /etc/glance/rootwrap.conf
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Directory to which the filesystem backend store writes images.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Upon start up, Glance creates the directory if it doesn't already
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# exist and verifies write access to the user under which
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``glance-api`` runs. If the write access isn't available, a
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``BadStoreConfiguration`` exception is raised and the filesystem
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# store may not be available for adding new images.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: This directory is used only when filesystem store is used as a
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# storage backend. Either ``filesystem_store_datadir`` or
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``filesystem_store_datadirs`` option must be specified in
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``glance-api.conf``. If both options are specified, a
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``BadStoreConfiguration`` will be raised and the filesystem store
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# may not be available for adding new images.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid path to a directory
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * ``filesystem_store_datadirs``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * ``filesystem_store_file_perm``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#filesystem_store_datadir = /var/lib/glance/images
Sep 28 11:21:28 ctl02 salt-minion[14967]: +filesystem_store_datadir = /var/lib/glance/images/
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# List of directories and their priorities to which the filesystem
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# backend store writes images.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The filesystem store can be configured to store images in multiple
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# directories as opposed to using a single directory specified by the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``filesystem_store_datadir`` configuration option. When using
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# multiple directories, each directory can be given an optional
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# priority to specify the preference order in which they should
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# be used. Priority is an integer that is concatenated to the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# directory path with a colon where a higher value indicates higher
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# priority. When two directories have the same priority, the directory
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# with most free space is used. When no priority is specified, it
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# defaults to zero.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# More information on configuring filesystem store with multiple store
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# directories can be found at
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# http://docs.openstack.org/developer/glance/configuring.html
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# NOTE: This directory is used only when filesystem store is used as a
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# storage backend. Either ``filesystem_store_datadir`` or
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``filesystem_store_datadirs`` option must be specified in
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``glance-api.conf``. If both options are specified, a
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``BadStoreConfiguration`` will be raised and the filesystem store
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# may not be available for adding new images.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * List of strings of the following form:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#         * ``<a valid directory path>:<optional integer priority>``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * ``filesystem_store_datadir``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * ``filesystem_store_file_perm``
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (multi valued)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#filesystem_store_datadirs =
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Filesystem store metadata file.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The path to a file which contains the metadata to be returned with
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# any location associated with the filesystem store. The file must
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# contain a valid JSON object. The object should contain the keys
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``id`` and ``mountpoint``. The value for both keys should be a
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# string.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid path to the store metadata file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# File access permissions for the image files.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Set the intended file access permissions for image data. This provides
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# a way to enable other services, e.g. Nova, to consume images directly
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# from the filesystem store. The users running the services that are
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# intended to be given access to could be made a member of the group
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# that owns the files created. Assigning a value less then or equal to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# zero for this configuration option signifies that no changes be made
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# to the  default permissions. This value will be decoded as an octal
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# digit.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# For more information, please refer the documentation at
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# http://docs.openstack.org/developer/glance/configuring.html
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid file access permission
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Zero
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Any negative integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#filesystem_store_file_perm = 0
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Path to the CA bundle file.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This configuration option enables the operator to use a custom
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Certificate Authority file to verify the remote server certificate. If
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# this option is set, the ``https_insecure`` option will be ignored and
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the CA file specified will be used to authenticate the server
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# certificate and establish a secure connection to the server.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid path to a CA file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * https_insecure
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #https_ca_certificates_file = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# If true, the remote server certificate is not verified. If false,
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# then the default CA truststore is used for verification. This option
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# is ignored if "https_ca_certificates_file" is set. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Set verification of the remote server certificate.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This configuration option takes in a boolean value to determine
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# whether or not to verify the remote server certificate. If set to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# True, the remote server certificate is not verified. If the option is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# set to False, then the default CA truststore is used for verification.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option is ignored if ``https_ca_certificates_file`` is set.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The remote server certificate will then be verified using the file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# specified using the ``https_ca_certificates_file`` option.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * https_ca_certificates_file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #https_insecure = true
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Specify the http/https proxy information that should be used to
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# connect to the remote server. The proxy information should be a key
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value pair of the scheme and proxy. e.g. http:10.0.0.1:3128. You can
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# specify proxies for multiple schemes by seperating the key value
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# pairs with a comma.e.g. http:10.0.0.1:3128, https:10.0.0.1:1080.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (dict value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The http/https proxy information to be used to connect to the remote
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# server.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This configuration option specifies the http/https proxy information
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# that should be used to connect to the remote server. The proxy
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# information should be a key value pair of the scheme and proxy, for
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# example, http:10.0.0.1:3128. You can also specify proxies for multiple
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# schemes by separating the key value pairs with a comma, for example,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# http:10.0.0.1:3128, https:10.0.0.1:1080.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A comma separated list of scheme:proxy pairs as described above
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (dict value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #http_proxy_information =
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# If True, swiftclient won't check for a valid SSL certificate when
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# authenticating. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#swift_store_auth_insecure = false
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# A string giving the CA certificate file to use in SSL connections
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# for verifying certs. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#swift_store_cacert = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The region of the swift endpoint to be used for single tenant. This
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# setting is only necessary if the tenant has multiple swift
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# endpoints. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#swift_store_region = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# If set, the configured endpoint will be used. If None, the storage
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# url from the auth response will be used. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#swift_store_endpoint = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# A string giving the endpoint type of the swift service to use
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (publicURL, adminURL or internalURL). This setting is only used if
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# swift_store_auth_version is 2. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#swift_store_endpoint_type = publicURL
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# A string giving the service type of the swift service to use. This
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# setting is only used if swift_store_auth_version is 2. (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#swift_store_service_type = object-store
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Container within the account that the account should use for storing
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# images in Swift when using single container mode. In multiple
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# container mode, this will be the prefix for all containers. (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#swift_store_container = glance
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The size, in MB, that Glance will start chunking image files and do
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# a large object manifest in Swift. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#swift_store_large_object_size = 5120
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The amount of data written to a temporary disk buffer during the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# process of chunking the image file. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#swift_store_large_object_chunk_size = 200
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# A boolean value that determines if we create the container if it
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# does not exist. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#swift_store_create_container_on_put = false
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# If set to True, enables multi-tenant storage mode which causes
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Glance images to be stored in tenant specific Swift accounts.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#swift_store_multi_tenant = false
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# When set to 0, a single-tenant store will only use one container to
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# store all images. When set to an integer value between 1 and 32, a
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# single-tenant store will use multiple containers to store images,
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# and this value will determine how many containers are created.Used
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# only when swift_store_multi_tenant is disabled. The total number of
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# containers that will be used is equal to 16^N, so if this config
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# option is set to 2, then 16^2=256 containers will be used to store
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# images. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#swift_store_multiple_containers_seed = 0
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# A list of tenants that will be granted read/write access on all
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Swift containers created by Glance in multi-tenant mode. (list
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#swift_store_admin_tenants =
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# If set to False, disables SSL layer compression of https swift
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# requests. Setting to False may improve performance for images which
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# are already in a compressed format, eg qcow2. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#swift_store_ssl_compression = true
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The number of times a Swift download will be retried before the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# request fails. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#swift_store_retry_get_count = 0
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The period of time (in seconds) before token expirationwhen
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# glance_store will try to reques new user token. Default value 60 sec
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# means that if token is going to expire in 1 min then glance_store
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# request new user token. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#swift_store_expire_soon_interval = 60
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# If set to True create a trust for each add/get request to Multi-
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# tenant store in order to prevent authentication token to be expired
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# during uploading/downloading data. If set to False then user token
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# is used for Swift connection (so no overhead on trust creation).
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Please note that this option is considered only and only if
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# swift_store_multi_tenant=True (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#swift_store_use_trusts = true
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The reference to the default swift account/backing store parameters
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# to use for adding new images. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#default_swift_reference = ref1
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Version of the authentication service to use. Valid versions are 2
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# and 3 for keystone and 1 (deprecated) for swauth and rackspace.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (deprecated - use "auth_version" in swift_store_config_file) (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#swift_store_auth_version = 2
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The address where the Swift authentication service is listening.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (deprecated - use "auth_address" in swift_store_config_file) (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#swift_store_auth_address = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The user to authenticate against the Swift authentication service
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (deprecated - use "user" in swift_store_config_file) (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#swift_store_user = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Auth key for the user authenticating against the Swift
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# authentication service. (deprecated - use "key" in
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# swift_store_config_file) (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#swift_store_key = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The config file that has the swift account(s)configs. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#swift_store_config_file = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# RADOS images will be chunked into objects of this size (in
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# megabytes). For best performance, this should be a power of two.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#rbd_store_chunk_size = 8
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# RADOS pool in which images are stored. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#rbd_store_pool = images
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# RADOS user to authenticate as (only applicable if using Cephx. If
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# <None>, a default will be chosen based on the client. section in
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# rbd_store_ceph_conf) (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#rbd_store_user = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Ceph configuration file path. If <None>, librados will locate the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# default config. If using cephx authentication, this file should
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# include a reference to the right keyring in a client.<USER> section
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#rbd_store_ceph_conf = /etc/ceph/ceph.conf
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Timeout value (in seconds) used when connecting to ceph cluster. If
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value <= 0, no timeout is set and default librados value is used.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#rados_connect_timeout = 0
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Info to match when looking for cinder in the service catalog. Format
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# is : separated values of the form:
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# <service_type>:<service_name>:<endpoint_type> (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#cinder_catalog_info = volumev2::publicURL
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Override service catalog lookup with template for cinder endpoint
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# e.g. http://localhost:8776/v2/%(tenant)s (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#cinder_endpoint_template = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Region name of this node. If specified, it will be used to locate
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# OpenStack services for stores. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Deprecated group/name - [DEFAULT]/os_region_name
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#cinder_os_region_name = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Location of ca certicates file to use for cinder client requests.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#cinder_ca_certificates_file = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Number of cinderclient retries on failed http calls (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#cinder_http_retries = 3
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Time period of time in seconds to wait for a cinder volume
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# transition to complete. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#cinder_state_transition_timeout = 300
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Allow to perform insecure SSL requests to cinder (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#cinder_api_insecure = false
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The address where the Cinder authentication service is listening. If
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# <None>, the cinder endpoint in the service catalog is used. (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#cinder_store_auth_address = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# User name to authenticate against Cinder. If <None>, the user of
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# current context is used. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#cinder_store_user_name = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Password for the user authenticating against Cinder. If <None>, the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# current context auth token is used. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#cinder_store_password = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Project name where the image is stored in Cinder. If <None>, the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# project in current context is used. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#cinder_store_project_name = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Path to the rootwrap configuration file to use for running commands
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# as root. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#rootwrap_config = /etc/glance/rootwrap.conf
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The host where the S3 server is listening. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#s3_store_host = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The S3 query token access key. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#s3_store_access_key = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The S3 query token secret key. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#s3_store_secret_key = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The S3 bucket to be used to store the Glance data. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#s3_store_bucket = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The local directory where uploads will be staged before they are
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# transferred into S3. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#s3_store_object_buffer_dir = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# A boolean to determine if the S3 bucket should be created on upload
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# if it does not exist or if an error should be returned to the user.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#s3_store_create_bucket_on_put = false
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The S3 calling format used to determine the bucket. Either subdomain
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# or path can be used. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#s3_store_bucket_url_format = subdomain
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# What size, in MB, should S3 start chunking image files and do a
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# multipart upload in S3. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#s3_store_large_object_size = 100
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# What multipart upload part size, in MB, should S3 use when uploading
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# parts. The size must be greater than or equal to 5M. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#s3_store_large_object_chunk_size = 10
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The number of thread pools to perform a multipart upload in S3.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#s3_store_thread_pools = 10
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Enable the use of a proxy. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#s3_store_enable_proxy = false
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Address or hostname for the proxy server. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#s3_store_proxy_host = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The port to use when connecting over a proxy. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#s3_store_proxy_port = 8080
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The username to connect to the proxy. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#s3_store_proxy_user = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The password to use when connecting over a proxy. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#s3_store_proxy_password = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Images will be chunked into objects of this size (in megabytes). For
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# best performance, this should be a power of two. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Chunk size for images to be stored in Sheepdog data store.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide an integer value representing the size in mebibyte
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# (1048576 bytes) to chunk Glance images into. The default
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# chunk size is 64 mebibytes.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When using Sheepdog distributed storage system, the images are
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# chunked into objects of this size and then stored across the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# distributed data store to use for Glance.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Chunk sizes, if a power of two, help avoid fragmentation and
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# enable improved performance.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Positive integer value representing size in mebibytes.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related Options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #sheepdog_store_chunk_size = 64
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Port of sheep daemon. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Port number on which the sheep daemon will listen.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide an integer value representing a valid port number on
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# which you want the Sheepdog daemon to listen on. The default
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# port is 7000.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The Sheepdog daemon, also called 'sheep', manages the storage
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# in the distributed cluster by writing objects across the storage
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# network. It identifies and acts on the messages it receives on
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the port number set using ``sheepdog_store_port`` option to store
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# chunks of Glance images.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid port number (0 to 65535)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related Options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * sheepdog_store_address
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (port value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Maximum value: 65535
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #sheepdog_store_port = 7000
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# IP address of sheep daemon. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#sheepdog_store_address = localhost
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Directory to which the Filesystem backend store writes images.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#filesystem_store_datadir = /var/lib/glance/images
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# List of directories and its priorities to which the Filesystem
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# backend store writes images. (multi valued)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#filesystem_store_datadirs =
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The path to a file which contains the metadata to be returned with
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# any location associated with this store.  The file must contain a
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# valid JSON object. The object should contain the keys 'id' and
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# 'mountpoint'. The value for both keys should be 'string'. (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#filesystem_store_metadata_file = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The required permission for created image file. In this way the user
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# other service used, e.g. Nova, who consumes the image could be the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# exclusive member of the group that owns the files created. Assigning
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# it less then or equal to zero means don't change the default
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# permission of the file. This value will be decoded as an octal
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# digit. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#filesystem_store_file_perm = 0
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# ESX/ESXi or vCenter Server target system. The server value can be an
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# IP address or a DNS name. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#vmware_server_host = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Username for authenticating with VMware ESX/VC server. (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#vmware_server_username = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Password for authenticating with VMware ESX/VC server. (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#vmware_server_password = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Number of times VMware ESX/VC server API must be retried upon
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# connection related issues. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Address to bind the Sheepdog daemon to.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Provide a string value representing the address to bind the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Sheepdog daemon to. The default address set for the 'sheep'
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# is 127.0.0.1.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The Sheepdog daemon, also called 'sheep', manages the storage
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# in the distributed cluster by writing objects across the storage
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# network. It identifies and acts on the messages directed to the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# address set using ``sheepdog_store_address`` option to store
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# chunks of Glance images.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid IPv4 address
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid IPv6 address
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid hostname
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related Options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * sheepdog_store_port
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#sheepdog_store_address = 127.0.0.1
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Set verification of the server certificate.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This boolean determines whether or not to verify the server
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# certificate. If this option is set to True, swiftclient won't check
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# for a valid SSL certificate when authenticating. If the option is set
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# to False, then the default CA truststore is used for verification.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * swift_store_cacert
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Address of the ESX/ESXi or vCenter Server target system.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This configuration option sets the address of the ESX/ESXi or vCenter
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Server target system. This option is required when using the VMware
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# storage backend. The address can contain an IP address (127.0.0.1) or
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# a DNS name (www.my-domain.com).
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible Values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid IPv4 or IPv6 address
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * A valid DNS name
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * vmware_server_username
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * vmware_server_password
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#vmware_server_host = 127.0.0.1
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Server username.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This configuration option takes the username for authenticating with
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the VMware ESX/ESXi or vCenter Server. This option is required when
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# using the VMware storage backend.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible Values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Any string that is the username for a user with appropriate
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       privileges
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * vmware_server_host
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * vmware_server_password
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#vmware_server_username = root
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Server password.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This configuration option takes the password for authenticating with
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the VMware ESX/ESXi or vCenter Server. This option is required when
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# using the VMware storage backend.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible Values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Any string that is a password corresponding to the username
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       specified using the "vmware_server_username" option
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * vmware_server_host
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * vmware_server_username
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#vmware_server_password = vmware
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The number of VMware API retries.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This configuration option specifies the number of times the VMware
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ESX/VC server API must be retried upon connection related issues or
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# server API call overload. It is not possible to specify 'retry
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# forever'.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible Values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Any positive integer value
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #vmware_api_retry_count = 10
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The interval used for polling remote tasks invoked on VMware ESX/VC
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# server. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Interval in seconds used for polling remote tasks invoked on VMware
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ESX/VC server.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This configuration option takes in the sleep time in seconds for polling an
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# on-going async task as part of the VMWare ESX/VC server API call.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible Values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Any positive integer value
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #vmware_task_poll_interval = 5
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The name of the directory where the glance images will be stored in
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# the VMware datastore. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The directory where the glance images will be stored in the datastore.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This configuration option specifies the path to the directory where the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# glance images will be stored in the VMware datastore. If this option
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# is not set,  the default directory where the glance images are stored
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# is openstack_glance.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible Values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Any string that is a valid path to a directory
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #vmware_store_image_dir = /openstack_glance
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# If true, the ESX/vCenter server certificate is not verified. If
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# false, then the default CA truststore is used for verification. This
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# option is ignored if "vmware_ca_file" is set. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Deprecated group/name - [DEFAULT]/vmware_api_insecure
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Set verification of the ESX/vCenter server certificate.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This configuration option takes a boolean value to determine
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# whether or not to verify the ESX/vCenter server certificate. If this
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# option is set to True, the ESX/vCenter server certificate is not
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# verified. If this option is set to False, then the default CA
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# truststore is used for verification.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option is ignored if the "vmware_ca_file" option is set. In that
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# case, the ESX/vCenter server certificate will then be verified using
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the file specified using the "vmware_ca_file" option .
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible Values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * vmware_ca_file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [glance_store]/vmware_api_insecure
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #vmware_insecure = false
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Specify a CA bundle file to use in verifying the ESX/vCenter server
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# certificate. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#vmware_ca_file = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# A list of datastores where the image can be stored. This option may
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# be specified multiple times for specifying multiple datastores. The
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# datastore name should be specified after its datacenter path,
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# seperated by ":". An optional weight may be given after the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# datastore name, seperated again by ":". Thus, the required format
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# becomes <datacenter_path>:<datastore_name>:<optional_weight>. When
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# adding an image, the datastore with highest weight will be selected,
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# unless there is not enough free space available in cases where the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# image size is already known. If no weight is given, it is assumed to
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# be zero and the directory will be considered for selection last. If
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# multiple datastores have the same weight, then the one with the most
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# free space available is selected. (multi valued)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Absolute path to the CA bundle file.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This configuration option enables the operator to use a custom
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Cerificate Authority File to verify the ESX/vCenter certificate.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# If this option is set, the "vmware_insecure" option will be ignored
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# and the CA file specified will be used to authenticate the ESX/vCenter
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# server certificate and establish a secure connection to the server.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible Values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Any string that is a valid absolute path to a CA file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * vmware_insecure
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#vmware_ca_file = /etc/ssl/certs/ca-certificates.crt
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The datastores where the image can be stored.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This configuration option specifies the datastores where the image can
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# be stored in the VMWare store backend. This option may be specified
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# multiple times for specifying multiple datastores. The datastore name
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# should be specified after its datacenter path, separated by ":". An
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# optional weight may be given after the datastore name, separated again
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# by ":" to specify the priority. Thus, the required format becomes
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# <datacenter_path>:<datastore_name>:<optional_weight>.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# When adding an image, the datastore with highest weight will be
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# selected, unless there is not enough free space available in cases
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# where the image size is already known. If no weight is given, it is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# assumed to be zero and the directory will be considered for selection
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# last. If multiple datastores have the same weight, then the one with
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the most free space available is selected.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Possible Values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#     * Any string of the format:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#       <datacenter_path>:<datastore_name>:<optional_weight>
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#    * None
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#  (multi valued)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #vmware_datastores =
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: @@ -1098,54 +2714,69 @@
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # From glance.api
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Supported values for the 'container_format' image attribute (list
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Supported values for the 'container_format' image attribute (list value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/container_formats
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #container_formats = ami,ari,aki,bare,ovf,ova,docker
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Supported values for the 'disk_format' image attribute (list value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/disk_formats
Sep 28 11:21:28 ctl02 salt-minion[14967]: -disk_formats = ami,ari,aki,vhd,vmdk,raw,qcow2,vdi,iso,root-tar
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#disk_formats = ami,ari,aki,vhd,vhdx,vmdk,raw,qcow2,vdi,iso
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  [keystone_authtoken]
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: +revocation_cache_time = 10
Sep 28 11:21:28 ctl02 salt-minion[14967]: +auth_type = password
Sep 28 11:21:28 ctl02 salt-minion[14967]: +user_domain_id = default
Sep 28 11:21:28 ctl02 salt-minion[14967]: +project_domain_id = default
Sep 28 11:21:28 ctl02 salt-minion[14967]: +project_name = service
Sep 28 11:21:28 ctl02 salt-minion[14967]: +username = glance
Sep 28 11:21:28 ctl02 salt-minion[14967]: +password = opnfv_secret
Sep 28 11:21:28 ctl02 salt-minion[14967]: +auth_uri=http://10.167.4.10:5000
Sep 28 11:21:28 ctl02 salt-minion[14967]: +auth_url=http://10.167.4.10:35357
Sep 28 11:21:28 ctl02 salt-minion[14967]: +token_cache_time = -1
Sep 28 11:21:28 ctl02 salt-minion[14967]: +memcached_servers=10.167.4.11:11211,10.167.4.12:11211,10.167.4.13:11211
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # From keystonemiddleware.auth_token
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Complete public Identity API endpoint. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Complete "public" Identity API endpoint. This endpoint should not be an
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# "admin" endpoint, as it should be accessible by all end users. Unauthenticated
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# clients are redirected to this endpoint to authenticate. Although this
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# endpoint should  ideally be unversioned, client support in the wild varies.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# If you're using a versioned v2 endpoint here, then this  should *not* be the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# same endpoint the service user utilizes  for validating tokens, because normal
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# end users may not be  able to reach that endpoint. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #auth_uri = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # API version of the admin Identity API endpoint. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #auth_version = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Do not handle authorization requests within the middleware, but
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# delegate the authorization decision to downstream WSGI components.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Do not handle authorization requests within the middleware, but delegate the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# authorization decision to downstream WSGI components. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #delay_auth_decision = false
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Request timeout value for communicating with Identity API server.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Request timeout value for communicating with Identity API server. (integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #http_connect_timeout = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# How many times are we trying to reconnect when communicating with
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Identity API Server. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# How many times are we trying to reconnect when communicating with Identity API
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Server. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #http_request_max_retries = 3
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Env key for the swift cache. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Request environment key where the Swift cache object is stored. When
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# auth_token middleware is deployed with a Swift cache, use this option to have
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the middleware share a caching backend with swift. Otherwise, use the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# ``memcached_servers`` option instead. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #cache = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Required if identity server requires client certificate (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Required if identity server requires client certificate (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #certfile = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Required if identity server requires client certificate (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Required if identity server requires client certificate (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #keyfile = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# A PEM encoded Certificate Authority to use when verifying HTTPs
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# connections. Defaults to system CAs. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# A PEM encoded Certificate Authority to use when verifying HTTPs connections.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Defaults to system CAs. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #cafile = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Verify HTTPS connections. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: @@ -1157,98 +2788,91 @@
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Directory used to cache files related to PKI tokens. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #signing_dir = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Optionally specify a list of memcached server(s) to use for caching.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# If left undefined, tokens will instead be cached in-process. (list
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Deprecated group/name - [DEFAULT]/memcache_servers
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Optionally specify a list of memcached server(s) to use for caching. If left
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# undefined, tokens will instead be cached in-process. (list value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [keystone_authtoken]/memcache_servers
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #memcached_servers = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# In order to prevent excessive effort spent validating tokens, the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# middleware caches previously-seen tokens for a configurable duration
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (in seconds). Set to -1 to disable caching completely. (integer
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# In order to prevent excessive effort spent validating tokens, the middleware
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# caches previously-seen tokens for a configurable duration (in seconds). Set to
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# -1 to disable caching completely. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #token_cache_time = 300
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Determines the frequency at which the list of revoked tokens is
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# retrieved from the Identity service (in seconds). A high number of
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# revocation events combined with a low cache duration may
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# significantly reduce performance. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Determines the frequency at which the list of revoked tokens is retrieved from
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# the Identity service (in seconds). A high number of revocation events combined
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# with a low cache duration may significantly reduce performance. Only valid for
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# PKI tokens. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #revocation_cache_time = 10
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (Optional) If defined, indicate whether token data should be
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# authenticated or authenticated and encrypted. If MAC, token data is
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# authenticated (with HMAC) in the cache. If ENCRYPT, token data is
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# encrypted and authenticated in the cache. If the value is not one of
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# these options or empty, auth_token will raise an exception on
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# initialization. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# (Optional) If defined, indicate whether token data should be authenticated or
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# authenticated and encrypted. If MAC, token data is authenticated (with HMAC)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# in the cache. If ENCRYPT, token data is encrypted and authenticated in the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# cache. If the value is not one of these options or empty, auth_token will
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# raise an exception on initialization. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Allowed values: None, MAC, ENCRYPT
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #memcache_security_strategy = None
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (Optional, mandatory if memcache_security_strategy is defined) This
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# string is used for key derivation. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# (Optional, mandatory if memcache_security_strategy is defined) This string is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# used for key derivation. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #memcache_secret_key = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (Optional) Number of seconds memcached server is considered dead
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# before it is tried again. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# (Optional) Number of seconds memcached server is considered dead before it is
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# tried again. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #memcache_pool_dead_retry = 300
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (Optional) Maximum total number of open connections to every
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# memcached server. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# (Optional) Maximum total number of open connections to every memcached server.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #memcache_pool_maxsize = 10
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (Optional) Socket timeout in seconds for communicating with a
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# memcached server. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# (Optional) Socket timeout in seconds for communicating with a memcached
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# server. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #memcache_pool_socket_timeout = 3
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (Optional) Number of seconds a connection to memcached is held
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# unused in the pool before it is closed. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# (Optional) Number of seconds a connection to memcached is held unused in the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# pool before it is closed. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #memcache_pool_unused_timeout = 60
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (Optional) Number of seconds that an operation will wait to get a
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# memcached client connection from the pool. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# (Optional) Number of seconds that an operation will wait to get a memcached
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# client connection from the pool. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #memcache_pool_conn_get_timeout = 10
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (Optional) Use the advanced (eventlet safe) memcached client pool.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# The advanced pool will only work under python 2.x. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# (Optional) Use the advanced (eventlet safe) memcached client pool. The
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# advanced pool will only work under python 2.x. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #memcache_use_advanced_pool = false
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (Optional) Indicate whether to set the X-Service-Catalog header. If
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# False, middleware will not ask for service catalog on token
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# validation and will not set the X-Service-Catalog header. (boolean
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# (Optional) Indicate whether to set the X-Service-Catalog header. If False,
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# middleware will not ask for service catalog on token validation and will not
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# set the X-Service-Catalog header. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#include_service_catalog = true
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Used to control the use and type of token binding. Can be set to: "disabled"
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# to not check token binding. "permissive" (default) to validate binding
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# information if the bind type is of a form known to the server and ignore it if
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# not. "strict" like "permissive" but if the bind type is unknown the token will
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# be rejected. "required" any form of token binding is needed to be allowed.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Finally the name of a binding method that must be present in tokens. (string
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#include_service_catalog = true
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Used to control the use and type of token binding. Can be set to:
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# "disabled" to not check token binding. "permissive" (default) to
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# validate binding information if the bind type is of a form known to
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# the server and ignore it if not. "strict" like "permissive" but if
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# the bind type is unknown the token will be rejected. "required" any
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# form of token binding is needed to be allowed. Finally the name of a
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# binding method that must be present in tokens. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #enforce_token_bind = permissive
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# If true, the revocation list will be checked for cached tokens. This
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# requires that PKI tokens are configured on the identity server.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# If true, the revocation list will be checked for cached tokens. This requires
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# that PKI tokens are configured on the identity server. (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #check_revocations_for_cached = false
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Hash algorithms to use for hashing PKI tokens. This may be a single
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# algorithm or multiple. The algorithms are those supported by Python
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# standard hashlib.new(). The hashes will be tried in the order given,
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# so put the preferred one first for performance. The result of the
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# first hash will be stored in the cache. This will typically be set
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# to multiple values only while migrating from a less secure algorithm
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# to a more secure one. Once all the old tokens are expired this
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# option should be set to a single value for better performance. (list
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Hash algorithms to use for hashing PKI tokens. This may be a single algorithm
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# or multiple. The algorithms are those supported by Python standard
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# hashlib.new(). The hashes will be tried in the order given, so put the
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# preferred one first for performance. The result of the first hash will be
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# stored in the cache. This will typically be set to multiple values only while
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# migrating from a less secure algorithm to a more secure one. Once all the old
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# tokens are expired this option should be set to a single value for better
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# performance. (list value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #hash_algorithms = md5
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Authentication type to load (unknown value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Deprecated group/name - [DEFAULT]/auth_plugin
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Authentication type to load (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [keystone_authtoken]/auth_plugin
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #auth_type = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Config Section from which to load plugin specific options (unknown
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Config Section from which to load plugin specific options (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #auth_section = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: @@ -1258,32 +2882,44 @@
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # From oslo.messaging
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Host to locate redis. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEPRECATED: Host to locate redis. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #host = 127.0.0.1
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Use this port to connect to redis host. (port value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEPRECATED: Use this port to connect to redis host. (port value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Minimum value: 0
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Maximum value: 65535
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #port = 6379
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Password for Redis server (optional). (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEPRECATED: Password for Redis server (optional). (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #password =
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# List of Redis Sentinel hosts (fault tolerance mode) e.g.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# DEPRECATED: List of Redis Sentinel hosts (fault tolerance mode) e.g.
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # [host:port, host1:port ... ] (list value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #sentinel_hosts =
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Redis replica set name. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #sentinel_group_name = oslo-messaging-zeromq
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Time in ms to wait between connection attempts. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#wait_timeout = 500
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#wait_timeout = 2000
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Time in ms to wait before the transaction is killed. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #check_timeout = 20000
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Timeout in ms on blocking socket operations (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#socket_timeout = 1000
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#socket_timeout = 10000
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  [oslo_concurrency]
Sep 28 11:21:28 ctl02 salt-minion[14967]: @@ -1296,10 +2932,10 @@
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/disable_process_locking
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #disable_process_locking = false
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Directory to use for lock files.  For security, the specified
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# directory should only be writable by the user running the processes
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# that need locking. Defaults to environment variable OSLO_LOCK_PATH.
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# If external locks are used, a lock path must be set. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Directory to use for lock files.  For security, the specified directory should
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# only be writable by the user running the processes that need locking. Defaults
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# to environment variable OSLO_LOCK_PATH. If external locks are used, a lock
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# path must be set. (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/lock_path
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #lock_path = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: @@ -1309,6 +2945,101 @@
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # From oslo.messaging
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Name for the AMQP container. must be globally unique. Defaults to a generated
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# UUID (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/container_name
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#container_name = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Timeout for inactive connections (in seconds) (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/idle_timeout
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#idle_timeout = 0
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Debug: dump AMQP frames to stdout (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/trace
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#trace = false
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# CA certificate PEM file to verify server certificate (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/ssl_ca_file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#ssl_ca_file =
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Identifying certificate PEM file to present to clients (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/ssl_cert_file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#ssl_cert_file =
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Private key PEM file used to sign cert_file certificate (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/ssl_key_file
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#ssl_key_file =
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Password for decrypting ssl_key_file (if encrypted) (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/ssl_key_password
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#ssl_key_password = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Accept clients using either SSL or plain TCP (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/allow_insecure_clients
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#allow_insecure_clients = false
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Space separated list of acceptable SASL mechanisms (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/sasl_mechanisms
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#sasl_mechanisms =
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Path to directory that contains the SASL configuration (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/sasl_config_dir
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#sasl_config_dir =
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Name of configuration file (without .conf suffix) (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/sasl_config_name
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#sasl_config_name =
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# User name for message broker authentication (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/username
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#username =
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Password for message broker authentication (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/password
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#password =
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Seconds to pause before attempting to re-connect. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#connection_retry_interval = 1
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Increase the connection_retry_interval by this many seconds after each
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# unsuccessful failover attempt. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#connection_retry_backoff = 2
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Maximum limit for connection_retry_interval + connection_retry_backoff
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#connection_retry_interval_max = 30
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Time to pause between re-connecting an AMQP 1.0 link that failed due to a
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# recoverable error. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#link_retry_delay = 10
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The deadline for an rpc reply message delivery. Only used when caller does not
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# provide a timeout expiry. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 5
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#default_reply_timeout = 30
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The deadline for an rpc cast or call message delivery. Only used when caller
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# does not provide a timeout expiry. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 5
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#default_send_timeout = 30
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# The deadline for a sent notification message delivery. Only used when caller
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# does not provide a timeout expiry. (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Minimum value: 5
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#default_notify_timeout = 30
Sep 28 11:21:28 ctl02 salt-minion[14967]: +
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Indicates the addressing mode used by the driver.
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# Permitted values:
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# 'legacy'   - use legacy non-routable addressing
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# 'routable' - use routable addresses
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# 'dynamic'  - use legacy addresses if the message bus does not support routing
Sep 28 11:21:28 ctl02 salt-minion[14967]: +# otherwise use routable addressing (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: +#addressing_mode = dynamic
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # address prefix used when sending to a specific server (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [amqp1]/server_request_prefix
Sep 28 11:21:28 ctl02 salt-minion[14967]: @@ -1322,60 +3053,54 @@
Sep 28 11:21:28 ctl02 salt-minion[14967]:  # Deprecated group/name - [amqp1]/group_request_prefix
Sep 28 11:21:28 ctl02 salt-minion[14967]:  #group_request_prefix = unicast
Sep 28 11:21:28 ctl02 salt-minion[14967]:  
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Name for the AMQP container (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/container_name
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#container_name = <None>
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Timeout for inactive connections (in seconds) (integer value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/idle_timeout
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#idle_timeout = 0
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Debug: dump AMQP frames to stdout (boolean value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/trace
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#trace = false
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# CA certificate PEM file to verify server certificate (string value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/ssl_ca_file
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#ssl_ca_file =
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Identifying certificate PEM file to present to clients (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/ssl_cert_file
Sep 28 11:21:28 ctl02 salt-minion[14967]: -#ssl_cert_file =
Sep 28 11:21:28 ctl02 salt-minion[14967]: -
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Private key PEM file used to sign cert_file certificate (string
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:28 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/ssl_key_file
Sep 28 11:21:29 ctl02 salt-minion[14967]: -#ssl_key_file =
Sep 28 11:21:29 ctl02 salt-minion[14967]: -
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# Password for decrypting ssl_key_file (if encrypted) (string value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/ssl_key_password
Sep 28 11:21:29 ctl02 salt-minion[14967]: -#ssl_key_password = <None>
Sep 28 11:21:29 ctl02 salt-minion[14967]: -
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# Accept clients using either SSL or plain TCP (boolean value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/allow_insecure_clients
Sep 28 11:21:29 ctl02 salt-minion[14967]: -#allow_insecure_clients = false
Sep 28 11:21:29 ctl02 salt-minion[14967]: -
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# Space separated list of acceptable SASL mechanisms (string value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/sasl_mechanisms
Sep 28 11:21:29 ctl02 salt-minion[14967]: -#sasl_mechanisms =
Sep 28 11:21:29 ctl02 salt-minion[14967]: -
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# Path to directory that contains the SASL configuration (string
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/sasl_config_dir
Sep 28 11:21:29 ctl02 salt-minion[14967]: -#sasl_config_dir =
Sep 28 11:21:29 ctl02 salt-minion[14967]: -
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# Name of configuration file (without .conf suffix) (string value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/sasl_config_name
Sep 28 11:21:29 ctl02 salt-minion[14967]: -#sasl_config_name =
Sep 28 11:21:29 ctl02 salt-minion[14967]: -
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# User name for message broker authentication (string value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/username
Sep 28 11:21:29 ctl02 salt-minion[14967]: -#username =
Sep 28 11:21:29 ctl02 salt-minion[14967]: -
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# Password for message broker authentication (string value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/password
Sep 28 11:21:29 ctl02 salt-minion[14967]: -#password =
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Address prefix for all generated RPC addresses (string value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#rpc_address_prefix = openstack.org/om/rpc
Sep 28 11:21:29 ctl02 salt-minion[14967]: +
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Address prefix for all generated Notification addresses (string value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#notify_address_prefix = openstack.org/om/notify
Sep 28 11:21:29 ctl02 salt-minion[14967]: +
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Appended to the address prefix when sending a fanout message. Used by the
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# message bus to identify fanout messages. (string value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#multicast_address = multicast
Sep 28 11:21:29 ctl02 salt-minion[14967]: +
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Appended to the address prefix when sending to a particular RPC/Notification
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# server. Used by the message bus to identify messages sent to a single
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# destination. (string value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#unicast_address = unicast
Sep 28 11:21:29 ctl02 salt-minion[14967]: +
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Appended to the address prefix when sending to a group of consumers. Used by
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# the message bus to identify messages that should be delivered in a round-robin
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# fashion across consumers. (string value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#anycast_address = anycast
Sep 28 11:21:29 ctl02 salt-minion[14967]: +
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Exchange name used in notification addresses.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Exchange name resolution precedence:
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Target.exchange if set
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# else default_notification_exchange if set
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# else control_exchange if set
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# else 'notify' (string value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#default_notification_exchange = <None>
Sep 28 11:21:29 ctl02 salt-minion[14967]: +default_notification_exchange = glance
Sep 28 11:21:29 ctl02 salt-minion[14967]: +
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Exchange name used in RPC addresses.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Exchange name resolution precedence:
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Target.exchange if set
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# else default_rpc_exchange if set
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# else control_exchange if set
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# else 'rpc' (string value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#default_rpc_exchange = <None>
Sep 28 11:21:29 ctl02 salt-minion[14967]: +
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Window size for incoming RPC Reply messages. (integer value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#reply_link_credit = 200
Sep 28 11:21:29 ctl02 salt-minion[14967]: +
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Window size for incoming RPC Request messages (integer value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#rpc_server_credit = 100
Sep 28 11:21:29 ctl02 salt-minion[14967]: +
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Window size for incoming Notification messages (integer value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#notify_server_credit = 100
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]:  [oslo_messaging_notifications]
Sep 28 11:21:29 ctl02 salt-minion[14967]: @@ -1384,14 +3109,14 @@
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # From oslo.messaging
Sep 28 11:21:29 ctl02 salt-minion[14967]:  #
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# The Drivers(s) to handle sending notifications. Possible values are
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# messaging, messagingv2, routing, log, test, noop (multi valued)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# The Drivers(s) to handle sending notifications. Possible values are messaging,
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# messagingv2, routing, log, test, noop (multi valued)
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/notification_driver
Sep 28 11:21:29 ctl02 salt-minion[14967]:  #driver =
Sep 28 11:21:29 ctl02 salt-minion[14967]: -
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# A URL representing the messaging driver to use for notifications. If
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# not set, we fall back to the same configuration used for RPC.
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +driver = messagingv2
Sep 28 11:21:29 ctl02 salt-minion[14967]: +
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# A URL representing the messaging driver to use for notifications. If not set,
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# we fall back to the same configuration used for RPC. (string value)
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/notification_transport_url
Sep 28 11:21:29 ctl02 salt-minion[14967]:  #transport_url = <None>
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]: @@ -1416,9 +3141,9 @@
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/amqp_auto_delete
Sep 28 11:21:29 ctl02 salt-minion[14967]:  #amqp_auto_delete = false
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# SSL version to use (valid only if SSL enabled). Valid values are
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# TLSv1 and SSLv23. SSLv2, SSLv3, TLSv1_1, and TLSv1_2 may be
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# available on some distributions. (string value)
Sep 28 11:21:29 ctl02 systemd[1]: Started /usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold -o DPkg::Options::=--force-confdef install glance-glare.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# SSL version to use (valid only if SSL enabled). Valid values are TLSv1 and
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# SSLv23. SSLv2, SSLv3, TLSv1_1, and TLSv1_2 may be available on some
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# distributions. (string value)
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/kombu_ssl_version
Sep 28 11:21:29 ctl02 salt-minion[14967]:  #kombu_ssl_version =
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]: @@ -1430,117 +3155,131 @@
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/kombu_ssl_certfile
Sep 28 11:21:29 ctl02 salt-minion[14967]:  #kombu_ssl_certfile =
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# SSL certification authority file (valid only if SSL enabled).
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# SSL certification authority file (valid only if SSL enabled). (string value)
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/kombu_ssl_ca_certs
Sep 28 11:21:29 ctl02 salt-minion[14967]:  #kombu_ssl_ca_certs =
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# How long to wait before reconnecting in response to an AMQP consumer
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# cancel notification. (floating point value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# How long to wait before reconnecting in response to an AMQP consumer cancel
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# notification. (floating point value)
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/kombu_reconnect_delay
Sep 28 11:21:29 ctl02 salt-minion[14967]:  #kombu_reconnect_delay = 1.0
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# EXPERIMENTAL: Possible values are: gzip, bz2. If not set compression
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# will not be used. This option may notbe available in future
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# versions. (string value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# EXPERIMENTAL: Possible values are: gzip, bz2. If not set compression will not
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# be used. This option may not be available in future versions. (string value)
Sep 28 11:21:29 ctl02 salt-minion[14967]:  #kombu_compression = <None>
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# How long to wait a missing client beforce abandoning to send it its
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# replies. This value should not be longer than rpc_response_timeout.
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# (integer value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# Deprecated group/name - [DEFAULT]/kombu_reconnect_timeout
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# How long to wait a missing client before abandoning to send it its replies.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# This value should not be longer than rpc_response_timeout. (integer value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Deprecated group/name - [oslo_messaging_rabbit]/kombu_reconnect_timeout
Sep 28 11:21:29 ctl02 salt-minion[14967]:  #kombu_missing_consumer_retry_timeout = 60
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# Determines how the next RabbitMQ node is chosen in case the one we
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# are currently connected to becomes unavailable. Takes effect only if
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# more than one RabbitMQ node is provided in config. (string value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Determines how the next RabbitMQ node is chosen in case the one we are
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# currently connected to becomes unavailable. Takes effect only if more than one
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# RabbitMQ node is provided in config. (string value)
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # Allowed values: round-robin, shuffle
Sep 28 11:21:29 ctl02 salt-minion[14967]:  #kombu_failover_strategy = round-robin
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# The RabbitMQ broker address where a single node is used. (string
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# DEPRECATED: The RabbitMQ broker address where a single node is used. (string
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # value)
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rabbit_host
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 11:21:29 ctl02 salt-minion[14967]:  #rabbit_host = localhost
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# The RabbitMQ broker port where a single node is used. (port value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# DEPRECATED: The RabbitMQ broker port where a single node is used. (port value)
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # Minimum value: 0
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # Maximum value: 65535
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rabbit_port
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 11:21:29 ctl02 salt-minion[14967]:  #rabbit_port = 5672
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# RabbitMQ HA cluster host:port pairs. (list value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# DEPRECATED: RabbitMQ HA cluster host:port pairs. (list value)
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rabbit_hosts
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 11:21:29 ctl02 salt-minion[14967]:  #rabbit_hosts = $rabbit_host:$rabbit_port
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # Connect over SSL for RabbitMQ. (boolean value)
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rabbit_use_ssl
Sep 28 11:21:29 ctl02 salt-minion[14967]:  #rabbit_use_ssl = false
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# The RabbitMQ userid. (string value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# DEPRECATED: The RabbitMQ userid. (string value)
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rabbit_userid
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 11:21:29 ctl02 salt-minion[14967]:  #rabbit_userid = guest
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# The RabbitMQ password. (string value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# DEPRECATED: The RabbitMQ password. (string value)
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rabbit_password
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 11:21:29 ctl02 salt-minion[14967]:  #rabbit_password = guest
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # The RabbitMQ login method. (string value)
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rabbit_login_method
Sep 28 11:21:29 ctl02 salt-minion[14967]:  #rabbit_login_method = AMQPLAIN
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# The RabbitMQ virtual host. (string value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# DEPRECATED: The RabbitMQ virtual host. (string value)
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rabbit_virtual_host
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 11:21:29 ctl02 salt-minion[14967]:  #rabbit_virtual_host = /
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # How frequently to retry connecting with RabbitMQ. (integer value)
Sep 28 11:21:29 ctl02 salt-minion[14967]:  #rabbit_retry_interval = 1
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# How long to backoff for between retries when connecting to RabbitMQ.
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# (integer value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# How long to backoff for between retries when connecting to RabbitMQ. (integer
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# value)
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rabbit_retry_backoff
Sep 28 11:21:29 ctl02 salt-minion[14967]:  #rabbit_retry_backoff = 2
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# Maximum interval of RabbitMQ connection retries. Default is 30
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# seconds. (integer value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Maximum interval of RabbitMQ connection retries. Default is 30 seconds.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# (integer value)
Sep 28 11:21:29 ctl02 salt-minion[14967]:  #rabbit_interval_max = 30
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# Maximum number of RabbitMQ connection retries. Default is 0
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# DEPRECATED: Maximum number of RabbitMQ connection retries. Default is 0
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # (infinite retry count). (integer value)
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rabbit_max_retries
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:21:29 ctl02 salt-minion[14967]:  #rabbit_max_retries = 0
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# Try to use HA queues in RabbitMQ (x-ha-policy: all). If you change
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# this option, you must wipe the RabbitMQ database. In RabbitMQ 3.0,
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# queue mirroring is no longer controlled by the x-ha-policy argument
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# when declaring a queue. If you just want to make sure that all
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# queues (except  those with auto-generated names) are mirrored across
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# all nodes, run: "rabbitmqctl set_policy HA '^(?!amq\.).*' '{"ha-
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# mode": "all"}' " (boolean value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Try to use HA queues in RabbitMQ (x-ha-policy: all). If you change this
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# option, you must wipe the RabbitMQ database. In RabbitMQ 3.0, queue mirroring
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# is no longer controlled by the x-ha-policy argument when declaring a queue. If
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# you just want to make sure that all queues (except  those with auto-generated
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# names) are mirrored across all nodes, run: "rabbitmqctl set_policy HA
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# '^(?!amq\.).*' '{"ha-mode": "all"}' " (boolean value)
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rabbit_ha_queues
Sep 28 11:21:29 ctl02 salt-minion[14967]:  #rabbit_ha_queues = false
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# Positive integer representing duration in seconds for queue TTL
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# (x-expires). Queues which are unused for the duration of the TTL are
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# automatically deleted. The parameter affects only reply and fanout
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# queues. (integer value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Positive integer representing duration in seconds for queue TTL (x-expires).
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Queues which are unused for the duration of the TTL are automatically deleted.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# The parameter affects only reply and fanout queues. (integer value)
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # Minimum value: 1
Sep 28 11:21:29 ctl02 salt-minion[14967]: -#rabbit_transient_queues_ttl = 600
Sep 28 11:21:29 ctl02 salt-minion[14967]: -
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# Specifies the number of messages to prefetch. Setting to zero allows
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# unlimited messages. (integer value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#rabbit_transient_queues_ttl = 1800
Sep 28 11:21:29 ctl02 salt-minion[14967]: +
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Specifies the number of messages to prefetch. Setting to zero allows unlimited
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# messages. (integer value)
Sep 28 11:21:29 ctl02 salt-minion[14967]:  #rabbit_qos_prefetch_count = 0
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# Number of seconds after which the Rabbit broker is considered down
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# if heartbeat's keep-alive fails (0 disable the heartbeat).
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# EXPERIMENTAL (integer value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Number of seconds after which the Rabbit broker is considered down if
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# heartbeat's keep-alive fails (0 disable the heartbeat). EXPERIMENTAL (integer
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# value)
Sep 28 11:21:29 ctl02 salt-minion[14967]:  #heartbeat_timeout_threshold = 60
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# How often times during the heartbeat_timeout_threshold we check the
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# heartbeat. (integer value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# How often times during the heartbeat_timeout_threshold we check the heartbeat.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# (integer value)
Sep 28 11:21:29 ctl02 salt-minion[14967]:  #heartbeat_rate = 2
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# Deprecated, use rpc_backend=kombu+memory or rpc_backend=fake
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# (boolean value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Deprecated, use rpc_backend=kombu+memory or rpc_backend=fake (boolean value)
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/fake_rabbit
Sep 28 11:21:29 ctl02 salt-minion[14967]:  #fake_rabbit = false
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]: @@ -1550,9 +3289,8 @@
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # The maximum byte size for an AMQP frame (integer value)
Sep 28 11:21:29 ctl02 salt-minion[14967]:  #frame_max = <None>
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# How often to send heartbeats for consumer's connections (integer
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: -#heartbeat_interval = 1
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# How often to send heartbeats for consumer's connections (integer value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#heartbeat_interval = 3
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # Enable SSL (boolean value)
Sep 28 11:21:29 ctl02 salt-minion[14967]:  #ssl = <None>
Sep 28 11:21:29 ctl02 salt-minion[14967]: @@ -1560,59 +3298,58 @@
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # Arguments passed to ssl.wrap_socket (dict value)
Sep 28 11:21:29 ctl02 salt-minion[14967]:  #ssl_options = <None>
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# Set socket timeout in seconds for connection's socket (floating
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Set socket timeout in seconds for connection's socket (floating point value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#socket_timeout = 0.25
Sep 28 11:21:29 ctl02 salt-minion[14967]: +
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Set TCP_USER_TIMEOUT in seconds for connection's socket (floating point value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#tcp_user_timeout = 0.25
Sep 28 11:21:29 ctl02 salt-minion[14967]: +
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Set delay for reconnection to some host which has connection error (floating
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # point value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: -#socket_timeout = 0.25
Sep 28 11:21:29 ctl02 salt-minion[14967]: -
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# Set TCP_USER_TIMEOUT in seconds for connection's socket (floating
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# point value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: -#tcp_user_timeout = 0.25
Sep 28 11:21:29 ctl02 salt-minion[14967]: -
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# Set delay for reconnection to some host which has connection error
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# (floating point value)
Sep 28 11:21:29 ctl02 salt-minion[14967]:  #host_connection_reconnect_delay = 0.25
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Connection factory implementation (string value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Allowed values: new, single, read_write
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#connection_factory = single
Sep 28 11:21:29 ctl02 salt-minion[14967]: +
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # Maximum number of connections to keep queued. (integer value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: -#pool_max_size = 10
Sep 28 11:21:29 ctl02 salt-minion[14967]: -
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# Maximum number of connections to create above `pool_max_size`.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#pool_max_size = 30
Sep 28 11:21:29 ctl02 salt-minion[14967]: +
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Maximum number of connections to create above `pool_max_size`. (integer value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#pool_max_overflow = 0
Sep 28 11:21:29 ctl02 salt-minion[14967]: +
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Default number of seconds to wait for a connections to available (integer
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#pool_timeout = 30
Sep 28 11:21:29 ctl02 salt-minion[14967]: +
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Lifetime of a connection (since creation) in seconds or None for no recycling.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Expired connections are closed on acquire. (integer value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#pool_recycle = 600
Sep 28 11:21:29 ctl02 salt-minion[14967]: +
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Threshold at which inactive (since release) connections are considered stale
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# in seconds or None for no staleness. Stale connections are closed on acquire.
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # (integer value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: -#pool_max_overflow = 0
Sep 28 11:21:29 ctl02 salt-minion[14967]: -
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# Default number of seconds to wait for a connections to available
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# (integer value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: -#pool_timeout = 30
Sep 28 11:21:29 ctl02 salt-minion[14967]: -
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# Lifetime of a connection (since creation) in seconds or None for no
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# recycling. Expired connections are closed on acquire. (integer
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: -#pool_recycle = 600
Sep 28 11:21:29 ctl02 salt-minion[14967]: -
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# Threshold at which inactive (since release) connections are
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# considered stale in seconds or None for no staleness. Stale
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# connections are closed on acquire. (integer value)
Sep 28 11:21:29 ctl02 salt-minion[14967]:  #pool_stale = 60
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # Persist notification messages. (boolean value)
Sep 28 11:21:29 ctl02 salt-minion[14967]:  #notification_persistence = false
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# Exchange name for for sending notifications (string value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Exchange name for sending notifications (string value)
Sep 28 11:21:29 ctl02 salt-minion[14967]:  #default_notification_exchange = ${control_exchange}_notification
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# Max number of not acknowledged message which RabbitMQ can send to
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# notification listener. (integer value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Max number of not acknowledged message which RabbitMQ can send to notification
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# listener. (integer value)
Sep 28 11:21:29 ctl02 salt-minion[14967]:  #notification_listener_prefetch_count = 100
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# Reconnecting retry count in case of connectivity problem during
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# sending notification, -1 means infinite retry. (integer value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Reconnecting retry count in case of connectivity problem during sending
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# notification, -1 means infinite retry. (integer value)
Sep 28 11:21:29 ctl02 salt-minion[14967]:  #default_notification_retry_attempts = -1
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# Reconnecting retry delay in case of connectivity problem during
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# sending notification message (floating point value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Reconnecting retry delay in case of connectivity problem during sending
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# notification message (floating point value)
Sep 28 11:21:29 ctl02 salt-minion[14967]:  #notification_retry_delay = 0.25
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# Time to live for rpc queues without consumers in seconds. (integer
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Time to live for rpc queues without consumers in seconds. (integer value)
Sep 28 11:21:29 ctl02 salt-minion[14967]:  #rpc_queue_expiration = 60
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # Exchange name for sending RPC messages (string value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: @@ -1621,32 +3358,136 @@
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # Exchange name for receiving RPC replies (string value)
Sep 28 11:21:29 ctl02 salt-minion[14967]:  #rpc_reply_exchange = ${control_exchange}_rpc_reply
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# Max number of not acknowledged message which RabbitMQ can send to
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# rpc listener. (integer value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Max number of not acknowledged message which RabbitMQ can send to rpc
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# listener. (integer value)
Sep 28 11:21:29 ctl02 salt-minion[14967]:  #rpc_listener_prefetch_count = 100
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# Max number of not acknowledged message which RabbitMQ can send to
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# rpc reply listener. (integer value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Max number of not acknowledged message which RabbitMQ can send to rpc reply
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# listener. (integer value)
Sep 28 11:21:29 ctl02 salt-minion[14967]:  #rpc_reply_listener_prefetch_count = 100
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# Reconnecting retry count in case of connectivity problem during
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# sending reply. -1 means infinite retry during rpc_timeout (integer
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Reconnecting retry count in case of connectivity problem during sending reply.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# -1 means infinite retry during rpc_timeout (integer value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#rpc_reply_retry_attempts = -1
Sep 28 11:21:29 ctl02 salt-minion[14967]: +
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Reconnecting retry delay in case of connectivity problem during sending reply.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# (floating point value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#rpc_reply_retry_delay = 0.25
Sep 28 11:21:29 ctl02 salt-minion[14967]: +
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Reconnecting retry count in case of connectivity problem during sending RPC
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# message, -1 means infinite retry. If actual retry attempts in not 0 the rpc
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# request could be processed more then one time (integer value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#default_rpc_retry_attempts = -1
Sep 28 11:21:29 ctl02 salt-minion[14967]: +
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Reconnecting retry delay in case of connectivity problem during sending RPC
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# message (floating point value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#rpc_retry_delay = 0.25
Sep 28 11:21:29 ctl02 salt-minion[14967]: +
Sep 28 11:21:29 ctl02 salt-minion[14967]: +
Sep 28 11:21:29 ctl02 salt-minion[14967]: +[oslo_messaging_zmq]
Sep 28 11:21:29 ctl02 salt-minion[14967]: +
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# From oslo.messaging
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# ZeroMQ bind address. Should be a wildcard (*), an ethernet interface, or IP.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# The "host" option should point or resolve to this address. (string value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_bind_address
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#rpc_zmq_bind_address = *
Sep 28 11:21:29 ctl02 salt-minion[14967]: +
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# MatchMaker driver. (string value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Allowed values: redis, dummy
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_matchmaker
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#rpc_zmq_matchmaker = redis
Sep 28 11:21:29 ctl02 salt-minion[14967]: +
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Number of ZeroMQ contexts, defaults to 1. (integer value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_contexts
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#rpc_zmq_contexts = 1
Sep 28 11:21:29 ctl02 salt-minion[14967]: +
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Maximum number of ingress messages to locally buffer per topic. Default is
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# unlimited. (integer value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_topic_backlog
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#rpc_zmq_topic_backlog = <None>
Sep 28 11:21:29 ctl02 salt-minion[14967]: +
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Directory for holding IPC sockets. (string value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_ipc_dir
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#rpc_zmq_ipc_dir = /var/run/openstack
Sep 28 11:21:29 ctl02 salt-minion[14967]: +
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Name of this node. Must be a valid hostname, FQDN, or IP address. Must match
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# "host" option, if running Nova. (string value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_host
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#rpc_zmq_host = localhost
Sep 28 11:21:29 ctl02 salt-minion[14967]: +
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Seconds to wait before a cast expires (TTL). The default value of -1 specifies
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# an infinite linger period. The value of 0 specifies no linger period. Pending
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# messages shall be discarded immediately when the socket is closed. Only
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# supported by impl_zmq. (integer value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_cast_timeout
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#rpc_cast_timeout = -1
Sep 28 11:21:29 ctl02 salt-minion[14967]: +
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# The default number of seconds that poll should wait. Poll raises timeout
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# exception when timeout expired. (integer value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_poll_timeout
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#rpc_poll_timeout = 1
Sep 28 11:21:29 ctl02 salt-minion[14967]: +
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Expiration timeout in seconds of a name service record about existing target (
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# < 0 means no timeout). (integer value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/zmq_target_expire
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#zmq_target_expire = 300
Sep 28 11:21:29 ctl02 salt-minion[14967]: +
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Update period in seconds of a name service record about existing target.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# (integer value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/zmq_target_update
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#zmq_target_update = 180
Sep 28 11:21:29 ctl02 salt-minion[14967]: +
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Use PUB/SUB pattern for fanout methods. PUB/SUB always uses proxy. (boolean
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: -#rpc_reply_retry_attempts = -1
Sep 28 11:21:29 ctl02 salt-minion[14967]: -
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# Reconnecting retry delay in case of connectivity problem during
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# sending reply. (floating point value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: -#rpc_reply_retry_delay = 0.25
Sep 28 11:21:29 ctl02 salt-minion[14967]: -
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# Reconnecting retry count in case of connectivity problem during
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# sending RPC message, -1 means infinite retry. If actual retry
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# attempts in not 0 the rpc request could be processed more then one
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# time (integer value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: -#default_rpc_retry_attempts = -1
Sep 28 11:21:29 ctl02 salt-minion[14967]: -
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# Reconnecting retry delay in case of connectivity problem during
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# sending RPC message (floating point value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: -#rpc_retry_delay = 0.25
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/use_pub_sub
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#use_pub_sub = true
Sep 28 11:21:29 ctl02 salt-minion[14967]: +
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Use ROUTER remote proxy. (boolean value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/use_router_proxy
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#use_router_proxy = true
Sep 28 11:21:29 ctl02 salt-minion[14967]: +
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Minimal port number for random ports range. (port value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Maximum value: 65535
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_min_port
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#rpc_zmq_min_port = 49153
Sep 28 11:21:29 ctl02 salt-minion[14967]: +
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Maximal port number for random ports range. (integer value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Maximum value: 65536
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_max_port
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#rpc_zmq_max_port = 65536
Sep 28 11:21:29 ctl02 salt-minion[14967]: +
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Number of retries to find free port number before fail with ZMQBindError.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# (integer value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_bind_port_retries
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#rpc_zmq_bind_port_retries = 100
Sep 28 11:21:29 ctl02 salt-minion[14967]: +
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Default serialization mechanism for serializing/deserializing
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# outgoing/incoming messages (string value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Allowed values: json, msgpack
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_serialization
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#rpc_zmq_serialization = json
Sep 28 11:21:29 ctl02 salt-minion[14967]: +
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# This option configures round-robin mode in zmq socket. True means not keeping
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# a queue when server side disconnects. False means to keep queue and messages
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# even if server is disconnected, when the server appears we send all
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# accumulated messages to it. (boolean value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#zmq_immediate = false
Sep 28 11:21:29 ctl02 salt-minion[14967]: +
Sep 28 11:21:29 ctl02 salt-minion[14967]: +
Sep 28 11:21:29 ctl02 salt-minion[14967]: +[oslo_middleware]
Sep 28 11:21:29 ctl02 salt-minion[14967]: +
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# From oslo.middleware.http_proxy_to_wsgi
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Whether the application is behind a proxy or not. This determines if the
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# middleware should parse the headers or not. (boolean value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#enable_proxy_headers_parsing = false
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]:  [oslo_policy]
Sep 28 11:21:29 ctl02 salt-minion[14967]: @@ -1658,17 +3499,17 @@
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # The JSON file that defines policies. (string value)
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/policy_file
Sep 28 11:21:29 ctl02 salt-minion[14967]:  #policy_file = policy.json
Sep 28 11:21:29 ctl02 salt-minion[14967]: -
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# Default rule. Enforced when a requested rule is not found. (string
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +policy_file = /etc/glance/policy.json
Sep 28 11:21:29 ctl02 salt-minion[14967]: +
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Default rule. Enforced when a requested rule is not found. (string value)
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/policy_default_rule
Sep 28 11:21:29 ctl02 salt-minion[14967]:  #policy_default_rule = default
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# Directories where policy configuration files are stored. They can be
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# relative to any directory in the search path defined by the
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# config_dir option, or absolute paths. The file defined by
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# policy_file must exist for these directories to be searched.
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# Missing or empty directories are ignored. (multi valued)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Directories where policy configuration files are stored. They can be relative
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# to any directory in the search path defined by the config_dir option, or
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# absolute paths. The file defined by policy_file must exist for these
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# directories to be searched.  Missing or empty directories are ignored. (multi
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# valued)
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/policy_dirs
Sep 28 11:21:29 ctl02 salt-minion[14967]:  #policy_dirs = policy.d
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]: @@ -1679,14 +3520,61 @@
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # From glance.api
Sep 28 11:21:29 ctl02 salt-minion[14967]:  #
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# Partial name of a pipeline in your paste configuration file with the
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# service name removed. For example, if your paste section name is
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# [pipeline:glance-api-keystone] use the value "keystone" (string
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: -#flavor = <None>
Sep 28 11:21:29 ctl02 salt-minion[14967]: -
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# Name of the paste configuration file. (string value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: -#config_file = <None>
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Deployment flavor to use in the server application pipeline.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Provide a string value representing the appropriate deployment
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# flavor used in the server application pipleline. This is typically
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# the partial name of a pipeline in the paste configuration file with
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# the service name removed.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# For example, if your paste section name in the paste configuration
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# file is [pipeline:glance-api-keystone], set ``flavor`` to
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# ``keystone``.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#     * String value representing a partial pipeline name.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Related Options:
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#     * config_file
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#flavor = keystone
Sep 28 11:21:29 ctl02 salt-minion[14967]: +
Sep 28 11:21:29 ctl02 salt-minion[14967]: +flavor=keystone
Sep 28 11:21:29 ctl02 salt-minion[14967]: +
Sep 28 11:21:29 ctl02 salt-minion[14967]: +
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Name of the paste configuration file.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Provide a string value representing the name of the paste
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# configuration file to use for configuring piplelines for
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# server application deployments.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# NOTES:
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#     * Provide the name or the path relative to the glance directory
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#       for the paste configuration file and not the absolute path.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#     * The sample paste configuration file shipped with Glance need
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#       not be edited in most cases as it comes with ready-made
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#       pipelines for all common deployment flavors.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# If no value is specified for this option, the ``paste.ini`` file
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# with the prefix of the corresponding Glance service's configuration
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# file name will be searched for in the known configuration
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# directories. (For example, if this option is missing from or has no
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# value set in ``glance-api.conf``, the service will look for a file
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# named ``glance-api-paste.ini``.) If the paste configuration file is
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# not found, the service will not start.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#     * A string value representing the name of the paste configuration
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#       file.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Related Options:
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#     * flavor
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#config_file = glance-api-paste.ini
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]:  [profiler]
Sep 28 11:21:29 ctl02 salt-minion[14967]: @@ -1695,16 +3583,60 @@
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # From glance.api
Sep 28 11:21:29 ctl02 salt-minion[14967]:  #
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# If False fully disable profiling feature. (boolean value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Enables the profiling for all services on this node. Default value is False
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# (fully disable the profiling feature).
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# * True: Enables the feature
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# * False: Disables the feature. The profiling cannot be started via this
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# project
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# operations. If the profiling is triggered by another project, this project
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# part
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# will be empty.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Deprecated group/name - [profiler]/profiler_enabled
Sep 28 11:21:29 ctl02 salt-minion[14967]:  #enabled = false
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# If False doesn't trace SQL requests. (boolean value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Enables SQL requests profiling in services. Default value is False (SQL
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# requests won't be traced).
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# * True: Enables SQL requests profiling. Each SQL query will be part of the
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# trace and can the be analyzed by how much time was spent for that.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# * False: Disables SQL requests profiling. The spent time is only shown on a
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# higher level of operations. Single SQL queries cannot be analyzed this
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# way.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:29 ctl02 salt-minion[14967]:  #trace_sqlalchemy = false
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# Secret key to use to sign Glance API and Glance Registry services
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# tracing messages. (string value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Secret key(s) to use for encrypting context data for performance profiling.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# This string value should have the following format: <key1>[,<key2>,...<keyn>],
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# where each key is some random string. A user who triggers the profiling via
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# the REST API has to set one of these keys in the headers of the REST API call
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# to include profiling results of this node for this particular project.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Both "enabled" flag and "hmac_keys" config options should be set to enable
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# profiling. Also, to generate correct profiling information across all services
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# at least one key needs to be consistent between OpenStack projects. This
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# ensures it can be used from client side to generate the trace, containing
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# information from all possible resources. (string value)
Sep 28 11:21:29 ctl02 salt-minion[14967]:  #hmac_keys = SECRET_KEY
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Connection string for a notifier backend. Default value is messaging:// which
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# sets the notifier to oslo_messaging.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Examples of possible values:
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# * messaging://: use oslo_messaging driver for sending notifications.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#connection_string = messaging://
Sep 28 11:21:29 ctl02 salt-minion[14967]: +
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]:  [store_type_location_strategy]
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]: @@ -1712,44 +3644,100 @@
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # From glance.api
Sep 28 11:21:29 ctl02 salt-minion[14967]:  #
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# The store names to use to get store preference order. The name must
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# be registered by one of the stores defined by the 'stores' config
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# option. This option will be applied when you using 'store_type'
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# option as image location strategy defined by the 'location_strategy'
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# config option. (list value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Preference order of storage backends.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Provide a comma separated list of store names in the order in
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# which images should be retrieved from storage backends.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# These store names must be registered with the ``stores``
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# configuration option.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# NOTE: The ``store_type_preference`` configuration option is applied
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# only if ``store_type`` is chosen as a value for the
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# ``location_strategy`` configuration option. An empty list will not
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# change the location order.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#     * Empty list
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#     * Comma separated list of registered store names. Legal values are:
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#         * file
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#         * http
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#         * rbd
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#         * swift
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#         * sheepdog
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#         * cinder
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#         * vmware
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#     * location_strategy
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#     * stores
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#  (list value)
Sep 28 11:21:29 ctl02 salt-minion[14967]:  #store_type_preference =
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]: +
Sep 28 11:21:29 ctl02 salt-minion[14967]:  [task]
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]:  #
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # From glance.api
Sep 28 11:21:29 ctl02 salt-minion[14967]:  #
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# Time in hours for which a task lives after, either succeeding or
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# failing (integer value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Time in hours for which a task lives after, either succeeding or failing
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# (integer value)
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/task_time_to_live
Sep 28 11:21:29 ctl02 salt-minion[14967]:  #task_time_to_live = 48
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# Specifies which task executor to be used to run the task scripts.
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Task executor to be used to run task scripts.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Provide a string value representing the executor to use for task
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# executions. By default, ``TaskFlow`` executor is used.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# ``TaskFlow`` helps make task executions easy, consistent, scalable
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# and reliable. It also enables creation of lightweight task objects
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# and/or functions that are combined together into flows in a
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# declarative manner.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#     * taskflow
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Related Options:
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:29 ctl02 salt-minion[14967]:  #task_executor = taskflow
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# Work dir for asynchronous task operations. The directory set here
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# will be used to operate over images - normally before they are
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# imported in the destination store. When providing work dir, make
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# sure enough space is provided for concurrent tasks to run
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# efficiently without running out of space. A rough estimation can be
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# done by multiplying the number of `max_workers` - or the N of
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# workers running - by an average image size (e.g 500MB). The image
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Absolute path to the work directory to use for asynchronous
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# task operations.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# The directory set here will be used to operate over images -
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# normally before they are imported in the destination store.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# NOTE: When providing a value for ``work_dir``, please make sure
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# that enough space is provided for concurrent tasks to run
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# efficiently without running out of space.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# A rough estimation can be done by multiplying the number of
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# ``max_workers`` with an average image size (e.g 500MB). The image
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # size estimation should be done based on the average size in your
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# deployment. Note that depending on the tasks running you may need to
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# multiply this number by some factor depending on what the task does.
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# For example, you may want to double the available size if image
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# conversion is enabled. All this being said, remember these are just
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# estimations and you should do them based on the worst case scenario
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# and be prepared to act in case they were wrong. (string value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: -#work_dir = <None>
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# deployment. Note that depending on the tasks running you may need
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# to multiply this number by some factor depending on what the task
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# does. For example, you may want to double the available size if
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# image conversion is enabled. All this being said, remember these
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# are just estimations and you should do them based on the worst
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# case scenario and be prepared to act in case they were wrong.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#     * String value representing the absolute path to the working
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#       directory
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Related Options:
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#work_dir = /work_dir
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]:  [taskflow_executor]
Sep 28 11:21:29 ctl02 salt-minion[14967]: @@ -1758,13 +3746,77 @@
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # From glance.api
Sep 28 11:21:29 ctl02 salt-minion[14967]:  #
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# The mode in which the engine will run. Can be 'serial' or
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# 'parallel'. (string value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Set the taskflow engine mode.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Provide a string type value to set the mode in which the taskflow
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# engine would schedule tasks to the workers on the hosts. Based on
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# this mode, the engine executes tasks either in single or multiple
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# threads. The possible values for this configuration option are:
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# ``serial`` and ``parallel``. When set to ``serial``, the engine runs
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# all the tasks in a single thread which results in serial execution
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# of tasks. Setting this to ``parallel`` makes the engine run tasks in
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# multiple threads. This results in parallel execution of tasks.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#     * serial
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#     * parallel
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#     * max_workers
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # Allowed values: serial, parallel
Sep 28 11:21:29 ctl02 salt-minion[14967]:  #engine_mode = parallel
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# The number of parallel activities executed at the same time by the
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# engine. The value can be greater than one when the engine mode is
Sep 28 11:21:29 ctl02 salt-minion[14967]: -# 'parallel'. (integer value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Set the number of engine executable tasks.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Provide an integer value to limit the number of workers that can be
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# instantiated on the hosts. In other words, this number defines the
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# number of parallel tasks that can be executed at the same time by
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# the taskflow engine. This value can be greater than one when the
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# engine mode is set to parallel.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#     * Integer value greater than or equal to 1
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#     * engine_mode
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # Deprecated group/name - [task]/eventlet_executor_pool_size
Sep 28 11:21:29 ctl02 salt-minion[14967]:  #max_workers = 10
Sep 28 11:21:29 ctl02 salt-minion[14967]: +
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Set the desired image conversion format.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Provide a valid image format to which you want images to be
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# converted before they are stored for consumption by Glance.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Appropriate image format conversions are desirable for specific
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# storage backends in order to facilitate efficient handling of
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# bandwidth and usage of the storage infrastructure.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# By default, ``conversion_format`` is not set and must be set
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# explicitly in the configuration file.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# The allowed values for this option are ``raw``, ``qcow2`` and
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# ``vmdk``. The  ``raw`` format is the unstructured disk format and
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# should be chosen when RBD or Ceph storage backends are used for
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# image storage. ``qcow2`` is supported by the QEMU emulator that
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# expands dynamically and supports Copy on Write. The ``vmdk`` is
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# another common disk format supported by many common virtual machine
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# monitors like VMWare Workstation.
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#     * qcow2
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#     * raw
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#     * vmdk
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#     * disk_formats
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:29 ctl02 salt-minion[14967]: +# Allowed values: qcow2, raw, vmdk
Sep 28 11:21:29 ctl02 salt-minion[14967]: +#conversion_format = raw
Sep 28 11:21:29 ctl02 salt-minion[14967]: [INFO    ] Completed state [/etc/glance/glance-api.conf] at time 11:21:28.914229 duration_in_ms=150.652
Sep 28 11:21:29 ctl02 salt-minion[14967]: [INFO    ] Running state [/etc/glance/glance-api-paste.ini] at time 11:21:28.914531
Sep 28 11:21:29 ctl02 salt-minion[14967]: [INFO    ] Executing state file.managed for /etc/glance/glance-api-paste.ini
Sep 28 11:21:29 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'glance/files/ocata/glance-api-paste.ini'
Sep 28 11:21:29 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'glance/map.jinja'
Sep 28 11:21:29 ctl02 salt-minion[14967]: [INFO    ] File changed:
Sep 28 11:21:29 ctl02 salt-minion[14967]: ---
Sep 28 11:21:29 ctl02 salt-minion[14967]: +++
Sep 28 11:21:29 ctl02 salt-minion[14967]: @@ -1,38 +1,39 @@
Sep 28 11:21:29 ctl02 salt-minion[14967]: +
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # Use this pipeline for no auth or image caching - DEFAULT
Sep 28 11:21:29 ctl02 salt-minion[14967]:  [pipeline:glance-api]
Sep 28 11:21:29 ctl02 salt-minion[14967]: -pipeline = cors healthcheck versionnegotiation osprofiler unauthenticated-context rootapp
Sep 28 11:21:29 ctl02 salt-minion[14967]: +pipeline = cors healthcheck http_proxy_to_wsgi versionnegotiation osprofiler unauthenticated-context rootapp
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # Use this pipeline for image caching and no auth
Sep 28 11:21:29 ctl02 salt-minion[14967]:  [pipeline:glance-api-caching]
Sep 28 11:21:29 ctl02 salt-minion[14967]: -pipeline = cors healthcheck versionnegotiation osprofiler unauthenticated-context cache rootapp
Sep 28 11:21:29 ctl02 salt-minion[14967]: +pipeline = cors healthcheck http_proxy_to_wsgi versionnegotiation osprofiler unauthenticated-context cache rootapp
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # Use this pipeline for caching w/ management interface but no auth
Sep 28 11:21:29 ctl02 salt-minion[14967]:  [pipeline:glance-api-cachemanagement]
Sep 28 11:21:29 ctl02 salt-minion[14967]: -pipeline = cors healthcheck versionnegotiation osprofiler unauthenticated-context cache cachemanage rootapp
Sep 28 11:21:29 ctl02 salt-minion[14967]: +pipeline = cors healthcheck http_proxy_to_wsgi versionnegotiation osprofiler unauthenticated-context cache cachemanage rootapp
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # Use this pipeline for keystone auth
Sep 28 11:21:29 ctl02 salt-minion[14967]:  [pipeline:glance-api-keystone]
Sep 28 11:21:29 ctl02 salt-minion[14967]: -pipeline = cors healthcheck versionnegotiation osprofiler authtoken context  rootapp
Sep 28 11:21:29 ctl02 salt-minion[14967]: +pipeline = cors healthcheck http_proxy_to_wsgi versionnegotiation osprofiler authtoken context rootapp
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # Use this pipeline for keystone auth with image caching
Sep 28 11:21:29 ctl02 salt-minion[14967]:  [pipeline:glance-api-keystone+caching]
Sep 28 11:21:29 ctl02 salt-minion[14967]: -pipeline = cors healthcheck versionnegotiation osprofiler authtoken context cache rootapp
Sep 28 11:21:29 ctl02 salt-minion[14967]: +pipeline = cors healthcheck http_proxy_to_wsgi versionnegotiation osprofiler authtoken context cache rootapp
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # Use this pipeline for keystone auth with caching and cache management
Sep 28 11:21:29 ctl02 salt-minion[14967]:  [pipeline:glance-api-keystone+cachemanagement]
Sep 28 11:21:29 ctl02 salt-minion[14967]: -pipeline = cors healthcheck versionnegotiation osprofiler authtoken context cache cachemanage rootapp
Sep 28 11:21:29 ctl02 salt-minion[14967]: +pipeline = cors healthcheck http_proxy_to_wsgi versionnegotiation osprofiler authtoken context cache cachemanage rootapp
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # Use this pipeline for authZ only. This means that the registry will treat a
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # user as authenticated without making requests to keystone to reauthenticate
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # the user.
Sep 28 11:21:29 ctl02 salt-minion[14967]:  [pipeline:glance-api-trusted-auth]
Sep 28 11:21:29 ctl02 salt-minion[14967]: -pipeline = cors healthcheck versionnegotiation osprofiler context rootapp
Sep 28 11:21:29 ctl02 salt-minion[14967]: +pipeline = cors healthcheck http_proxy_to_wsgi versionnegotiation osprofiler context rootapp
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # Use this pipeline for authZ only. This means that the registry will treat a
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # user as authenticated without making requests to keystone to reauthenticate
Sep 28 11:21:29 ctl02 salt-minion[14967]:  # the user and uses cache management
Sep 28 11:21:29 ctl02 salt-minion[14967]:  [pipeline:glance-api-trusted-auth+cachemanagement]
Sep 28 11:21:29 ctl02 salt-minion[14967]: -pipeline = cors healthcheck versionnegotiation osprofiler context cache cachemanage rootapp
Sep 28 11:21:29 ctl02 salt-minion[14967]: +pipeline = cors healthcheck http_proxy_to_wsgi versionnegotiation osprofiler context cache cachemanage rootapp
Sep 28 11:21:29 ctl02 salt-minion[14967]:  
Sep 28 11:21:29 ctl02 salt-minion[14967]:  [composite:rootapp]
Sep 28 11:21:29 ctl02 salt-minion[14967]:  paste.composite_factory = glance.api:root_app_factory
Sep 28 11:21:29 ctl02 salt-minion[14967]: @@ -85,3 +86,6 @@
Sep 28 11:21:29 ctl02 salt-minion[14967]:  paste.filter_factory =  oslo_middleware.cors:filter_factory
Sep 28 11:21:29 ctl02 salt-minion[14967]:  oslo_config_project = glance
Sep 28 11:21:29 ctl02 salt-minion[14967]:  oslo_config_program = glance-api
Sep 28 11:21:29 ctl02 salt-minion[14967]: +
Sep 28 11:21:29 ctl02 salt-minion[14967]: +[filter:http_proxy_to_wsgi]
Sep 28 11:21:29 ctl02 salt-minion[14967]: +paste.filter_factory = oslo_middleware:HTTPProxyToWSGI.factory
Sep 28 11:21:29 ctl02 salt-minion[14967]: [INFO    ] Completed state [/etc/glance/glance-api-paste.ini] at time 11:21:28.958010 duration_in_ms=43.478
Sep 28 11:21:29 ctl02 salt-minion[14967]: [INFO    ] Running state [glance-glare] at time 11:21:28.958163
Sep 28 11:21:29 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for glance-glare
Sep 28 11:21:29 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemd-run', '--scope', 'apt-get', '-q', '-y', '-o', 'DPkg::Options::=--force-confold', '-o', 'DPkg::Options::=--force-confdef', 'install', 'glance-glare'] in directory '/root'
Sep 28 11:21:29 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928112129429352
Sep 28 11:21:29 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 28969
Sep 28 11:21:29 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928112129429352
Sep 28 11:21:30 ctl02 systemd[1]: Reloading.
Sep 28 11:21:31 ctl02 systemd[1]: message repeated 3 times: [ Reloading.]
Sep 28 11:21:31 ctl02 systemd[1]: Starting OpenStack Glance Artifact Repository API...
Sep 28 11:21:31 ctl02 systemd[1]: Started OpenStack Glance Artifact Repository API.
Sep 28 11:21:31 ctl02 systemd[1]: Reloading.
Sep 28 11:21:31 ctl02 glance-glare[29083]: /usr/lib/python2.7/dist-packages/oslo_middleware/ssl.py:28: DeprecationWarning: The 'oslo_middleware.ssl' module usage is deprecated, please use oslo_middleware.http_proxy_to_wsgi instead
Sep 28 11:21:31 ctl02 glance-glare[29083]:   "oslo_middleware.http_proxy_to_wsgi")
Sep 28 11:21:31 ctl02 glance-glare[29083]: /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py:22: DeprecationWarning: Parameters to load are deprecated.  Call .resolve and .require separately.
Sep 28 11:21:31 ctl02 glance-glare[29083]:   return pkg_resources.EntryPoint.parse("x=" + s).load(False)
Sep 28 11:21:31 ctl02 glance-glare[29083]: /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py:22: DeprecationWarning: Parameters to load are deprecated.  Call .resolve and .require separately.
Sep 28 11:21:31 ctl02 glance-glare[29083]:   return pkg_resources.EntryPoint.parse("x=" + s).load(False)
Sep 28 11:21:31 ctl02 glance-glare[29083]: /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py:22: DeprecationWarning: Parameters to load are deprecated.  Call .resolve and .require separately.
Sep 28 11:21:31 ctl02 glance-glare[29083]:   return pkg_resources.EntryPoint.parse("x=" + s).load(False)
Sep 28 11:21:31 ctl02 glance-glare[29083]: /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py:22: DeprecationWarning: Parameters to load are deprecated.  Call .resolve and .require separately.
Sep 28 11:21:31 ctl02 glance-glare[29083]:   return pkg_resources.EntryPoint.parse("x=" + s).load(False)
Sep 28 11:21:31 ctl02 glance-glare[29083]: /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py:22: DeprecationWarning: Parameters to load are deprecated.  Call .resolve and .require separately.
Sep 28 11:21:31 ctl02 glance-glare[29083]:   return pkg_resources.EntryPoint.parse("x=" + s).load(False)
Sep 28 11:21:31 ctl02 glance-glare[29083]: /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py:22: DeprecationWarning: Parameters to load are deprecated.  Call .resolve and .require separately.
Sep 28 11:21:31 ctl02 glance-glare[29083]:   return pkg_resources.EntryPoint.parse("x=" + s).load(False)
Sep 28 11:21:31 ctl02 glance-glare[29083]: /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py:22: DeprecationWarning: Parameters to load are deprecated.  Call .resolve and .require separately.
Sep 28 11:21:31 ctl02 glance-glare[29083]:   return pkg_resources.EntryPoint.parse("x=" + s).load(False)
Sep 28 11:21:31 ctl02 salt-minion[14967]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 11:21:31 ctl02 glance-glare[29083]: 2017-09-28 11:21:31.793 29083 INFO glance.common.glare.loader [-] Artifact MyArtifact has been successfully loaded
Sep 28 11:21:31 ctl02 salt-minion[14967]: [INFO    ] Made the following changes:
Sep 28 11:21:31 ctl02 salt-minion[14967]: 'glance-glare' changed from 'absent' to '2:12.0.0-0ubuntu2'
Sep 28 11:21:31 ctl02 salt-minion[14967]: [INFO    ] Loading fresh modules for state activity
Sep 28 11:21:31 ctl02 salt-minion[14967]: [INFO    ] Completed state [glance-glare] at time 11:21:31.902955 duration_in_ms=2944.791
Sep 28 11:21:31 ctl02 glance-glare[29083]: /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py:22: DeprecationWarning: Parameters to load are deprecated.  Call .resolve and .require separately.
Sep 28 11:21:31 ctl02 glance-glare[29083]:   return pkg_resources.EntryPoint.parse("x=" + s).load(False)
Sep 28 11:21:31 ctl02 salt-minion[14967]: [INFO    ] Running state [/etc/glance/glance-glare-paste.ini] at time 11:21:31.904846
Sep 28 11:21:31 ctl02 salt-minion[14967]: [INFO    ] Executing state file.managed for /etc/glance/glance-glare-paste.ini
Sep 28 11:21:31 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'glance/files/ocata/glance-glare-paste.ini'
Sep 28 11:21:31 ctl02 salt-minion[14967]: [INFO    ] File /etc/glance/glance-glare-paste.ini is in the correct state
Sep 28 11:21:31 ctl02 salt-minion[14967]: [INFO    ] Completed state [/etc/glance/glance-glare-paste.ini] at time 11:21:31.932529 duration_in_ms=27.682
Sep 28 11:21:31 ctl02 salt-minion[14967]: [INFO    ] Running state [/etc/glance/glance-glare.conf] at time 11:21:31.933152
Sep 28 11:21:31 ctl02 salt-minion[14967]: [INFO    ] Executing state file.managed for /etc/glance/glance-glare.conf
Sep 28 11:21:31 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'glance/files/ocata/glance-glare.conf.Debian'
Sep 28 11:21:32 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'glance/map.jinja'
Sep 28 11:21:32 ctl02 salt-minion[14967]: [INFO    ] File changed:
Sep 28 11:21:32 ctl02 salt-minion[14967]: ---
Sep 28 11:21:32 ctl02 salt-minion[14967]: +++
Sep 28 11:21:32 ctl02 salt-minion[14967]: @@ -1,200 +1,480 @@
Sep 28 11:21:32 ctl02 salt-minion[14967]: +
Sep 28 11:21:32 ctl02 salt-minion[14967]: +
Sep 28 11:21:32 ctl02 salt-minion[14967]:  [DEFAULT]
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #
Sep 28 11:21:32 ctl02 salt-minion[14967]:  # From glance.glare
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# When true, this option sets the owner of an image to be the tenant.
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Otherwise, the owner of the  image will be the authenticated user
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# issuing the request. (boolean value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Set the image owner to tenant or the authenticated user.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Assign a boolean value to determine the owner of an image. When set to
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# True, the owner of the image is the tenant. When set to False, the
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# owner of the image will be the authenticated user issuing the request.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Setting it to False makes the image private to the associated user and
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# sharing with other users within the same tenant (or "project")
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# requires explicit image sharing via image membership.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #owner_is_tenant = true
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]:  # Role used to identify an authenticated user as administrator.
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Provide a string value representing a Keystone role to identify an
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# administrative user. Users with this role will be granted
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# administrative privileges. The default value for this option is
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# 'admin'.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * A string value which is a valid Keystone role
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #admin_role = admin
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Allow unauthenticated users to access the API with read-only
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# privileges. This only applies when using ContextMiddleware. (boolean
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Allow limited access to unauthenticated users.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Assign a boolean to determine API access for unathenticated
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# users. When set to False, the API cannot be accessed by
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# unauthenticated users. When set to True, unauthenticated users can
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# access the API with read-only privileges. This however only applies
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# when using ContextMiddleware.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #allow_anonymous_access = false
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Limits request ID length. (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Limit the request ID length.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Provide  an integer value to limit the length of the request ID to
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# the specified length. The default value is 64. Users can change this
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# to any ineteger value between 0 and 16384 however keeping in mind that
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# a larger value may flood the logs.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * Integer value between 0 and 16384
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #max_request_id_length = 64
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Public url to use for versions endpoint. The default is None, which
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# will use the request's host_url attribute to populate the URL base.
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# If Glance is operating behind a proxy, you will want to change this
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# to represent the proxy's URL. (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Public url endpoint to use for Glance/Glare versions response.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# This is the public url endpoint that will appear in the Glance/Glare
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# "versions" response. If no value is specified, the endpoint that is
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# displayed in the version's response is that of the host running the
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# API service. Change the endpoint to represent the proxy URL if the
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# API service is running behind a proxy. If the service is running
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# behind a load balancer, add the load balancer's URL for this value.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * Proxy URL
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * Load balancer URL
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #public_endpoint = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Address to bind the server.  Useful when selecting a particular
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# network interface. (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# IP address to bind the glance servers to.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Provide an IP address to bind the glance server to. The default
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# value is ``0.0.0.0``.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Edit this option to enable the server to listen on one particular
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# IP address on the network card. This facilitates selection of a
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# particular network interface for the server.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * A valid IPv4 address
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * A valid IPv6 address
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #bind_host = 0.0.0.0
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# The port on which the server will listen. (port value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +bind_host = 10.167.4.12
Sep 28 11:21:32 ctl02 salt-minion[14967]: +
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Port number on which the server will listen.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Provide a valid port number to bind the server's socket to. This
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# port is then set to identify processes and forward network messages
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# that arrive at the server. The default bind_port value for the API
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# server is 9292 and for the registry server is 9191.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * A valid port number (0 to 65535)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#  (port value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  # Minimum value: 0
Sep 28 11:21:32 ctl02 salt-minion[14967]:  # Maximum value: 65535
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #bind_port = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# The number of child process workers that will be created to service
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# requests. The default will be equal to the number of CPUs available.
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +bind_port = 9494
Sep 28 11:21:32 ctl02 salt-minion[14967]: +
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Number of Glance worker processes to start.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Provide a non-negative integer value to set the number of child
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# process workers to service requests. By default, the number of CPUs
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# available is set as the value for ``workers``.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Each worker process is made to listen on the port set in the
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# configuration file and contains a greenthread pool of size 1000.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# NOTE: Setting the number of workers to zero, triggers the creation
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# of a single API process with a greenthread pool of size 1000.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * 0
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * Positive integer value (typically equal to the number of CPUs)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #workers = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Maximum line size of message headers to be accepted. max_header_line
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# may need to be increased when using large tokens (typically those
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# generated by the Keystone v3 API with big service catalogs (integer
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +workers = 8
Sep 28 11:21:32 ctl02 salt-minion[14967]: +
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Maximum line size of message headers.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Provide an integer value representing a length to limit the size of
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# message headers. The default value is 16384.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# NOTE: ``max_header_line`` may need to be increased when using large
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# tokens (typically those generated by the Keystone v3 API with big
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# service catalogs). However, it is to be kept in mind that larger
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# values for ``max_header_line`` would flood the logs.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Setting ``max_header_line`` to 0 sets no limit for the line size of
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# message headers.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * 0
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * Positive integer
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #max_header_line = 16384
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# If False, server will return the header "Connection: close", If
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# True, server will return "Connection: Keep-Alive" in its responses.
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# In order to close the client socket connection explicitly after the
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# response is sent and read successfully by the client, you simply
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# have to set this option to False when you create a wsgi server.
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# (boolean value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Set keep alive option for HTTP over TCP.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Provide a boolean value to determine sending of keep alive packets.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# If set to ``False``, the server returns the header
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# "Connection: close". If set to ``True``, the server returns a
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# "Connection: Keep-Alive" in its responses. This enables retention of
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# the same TCP connection for HTTP conversations instead of opening a
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# new one with each new request.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# This option must be set to ``False`` if the client socket connection
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# needs to be closed explicitly after the response is received and
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# read successfully by the client.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #http_keepalive = true
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Timeout for client connections' socket operations. If an incoming
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# connection is idle for this number of seconds it will be closed. A
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# value of '0' means wait forever. (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Timeout for client connections' socket operations.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Provide a valid integer value representing time in seconds to set
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# the period of wait before an incoming connection can be closed. The
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# default value is 900 seconds.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# The value zero implies wait forever.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * Zero
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * Positive integer
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #client_socket_timeout = 900
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# The backlog value that will be used when creating the TCP listener
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# socket. (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Set the number of incoming connection requests.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Provide a positive integer value to limit the number of requests in
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# the backlog queue. The default queue size is 4096.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# An incoming connection to a TCP listener socket is queued before a
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# connection can be established with the server. Setting the backlog
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# for a TCP socket ensures a limited queue size for incoming traffic.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * Positive integer
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #backlog = 4096
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# The value for the socket option TCP_KEEPIDLE.  This is the time in
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# seconds that the connection must be idle before TCP starts sending
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# keepalive probes. (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Set the wait time before a connection recheck.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Provide a positive integer value representing time in seconds which
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# is set as the idle wait time before a TCP keep alive packet can be
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# sent to the host. The default value is 600 seconds.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Setting ``tcp_keepidle`` helps verify at regular intervals that a
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# connection is intact and prevents frequent TCP connection
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# reestablishment.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * Positive integer value representing time in seconds
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #tcp_keepidle = 600
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# CA certificate file to use to verify connecting clients. (string
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#ca_file = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Certificate file to use when starting API server securely. (string
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#cert_file = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Private key file to use when starting API server securely. (string
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#key_file = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# If False fully disable profiling feature. (boolean value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#enabled = false
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# If False doesn't trace SQL requests. (boolean value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#trace_sqlalchemy = false
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Secret key to use to sign Glance API and Glance Registry services
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# tracing messages. (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#hmac_keys = SECRET_KEY
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Default publisher_id for outgoing notifications. (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Absolute path to the CA file.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Provide a string value representing a valid absolute path to
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# the Certificate Authority file to use for client authentication.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# A CA file typically contains necessary trusted certificates to
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# use for the client authentication. This is essential to ensure
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# that a secure connection is established to the server via the
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# internet.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * Valid absolute path to the CA file
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#ca_file = /etc/ssl/cafile
Sep 28 11:21:32 ctl02 salt-minion[14967]: +
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Absolute path to the certificate file.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Provide a string value representing a valid absolute path to the
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# certificate file which is required to start the API service
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# securely.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# A certificate file typically is a public key container and includes
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# the server's public key, server name, server information and the
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# signature which was a result of the verification process using the
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# CA certificate. This is required for a secure connection
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# establishment.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * Valid absolute path to the certificate file
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#cert_file = /etc/ssl/certs
Sep 28 11:21:32 ctl02 salt-minion[14967]: +
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Absolute path to a private key file.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Provide a string value representing a valid absolute path to a
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# private key file which is required to establish the client-server
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# connection.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * Absolute path to the private key file
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#key_file = /etc/ssl/key/key-file.pem
Sep 28 11:21:32 ctl02 salt-minion[14967]: +
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Default publisher_id for outgoing Glance notifications.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# This is the value that the notification driver will use to identify
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# messages for events originating from the Glance service. Typically,
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# this is the hostname of the instance that generated the message.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * Any reasonable instance identifier, for example: image.host1
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #default_publisher_id = image.localhost
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# List of disabled notifications. A notification can be given either
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# as a notification type to disable a single event, or as a
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# notification group prefix to disable all events within a group.
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Example: if this config option is set to ["image.create",
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# "metadef_namespace"], then "image.create" notification will not be
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# sent after image is created and none of the notifications for
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# metadefinition namespaces will be sent. (list value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# List of notifications to be disabled.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Specify a list of notifications that should not be emitted.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# A notification can be given either as a notification type to
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# disable a single event notification, or as a notification group
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# prefix to disable all event notifications within a group.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     A comma-separated list of individual notification types or
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     notification groups to be disabled. Currently supported groups:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#         * image
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#         * image.member
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#         * task
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#         * metadef_namespace
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#         * metadef_object
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#         * metadef_property
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#         * metadef_resource_type
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#         * metadef_tag
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     For a complete listing and description of each event refer to:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     http://docs.openstack.org/developer/glance/notifications.html
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     The values must be specified as: <group_name>.<event_name>
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     For example: image.create,task.success,metadef_tag
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#  (list value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #disabled_notifications =
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #
Sep 28 11:21:32 ctl02 salt-minion[14967]:  # From oslo.log
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# If set to true, the logging level will be set to DEBUG instead of
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# the default INFO level. (boolean value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# If set to true, the logging level will be set to DEBUG instead of the default
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# INFO level. (boolean value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Note: This option can be changed without restarting.
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #debug = false
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# If set to false, the logging level will be set to WARNING instead of
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# the default INFO level. (boolean value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# DEPRECATED: If set to false, the logging level will be set to WARNING instead
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# of the default INFO level. (boolean value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  # This option is deprecated for removal.
Sep 28 11:21:32 ctl02 salt-minion[14967]:  # Its value may be silently ignored in the future.
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #verbose = true
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# The name of a logging configuration file. This file is appended to
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# any existing logging configuration files. For details about logging
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# configuration files, see the Python logging module documentation.
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Note that when logging configuration files are used then all logging
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# configuration is set in the configuration file and other logging
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# configuration options are ignored (for example,
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# logging_context_format_string). (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# The name of a logging configuration file. This file is appended to any
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# existing logging configuration files. For details about logging configuration
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# files, see the Python logging module documentation. Note that when logging
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# configuration files are used then all logging configuration is set in the
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# configuration file and other logging configuration options are ignored (for
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# example, logging_context_format_string). (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Note: This option can be changed without restarting.
Sep 28 11:21:32 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/log_config
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #log_config_append = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]:  # Defines the format string for %%(asctime)s in log records. Default:
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# %(default)s . This option is ignored if log_config_append is set.
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# %(default)s . This option is ignored if log_config_append is set. (string
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #log_date_format = %Y-%m-%d %H:%M:%S
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# (Optional) Name of log file to send logging output to. If no default
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# is set, logging will go to stderr as defined by use_stderr. This
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# option is ignored if log_config_append is set. (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# (Optional) Name of log file to send logging output to. If no default is set,
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# logging will go to stderr as defined by use_stderr. This option is ignored if
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# log_config_append is set. (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/logfile
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #log_file = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# (Optional) The base directory used for relative log_file  paths.
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# This option is ignored if log_config_append is set. (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +log_file = /var/log/glance/glare.log
Sep 28 11:21:32 ctl02 salt-minion[14967]: +
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# (Optional) The base directory used for relative log_file  paths. This option
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# is ignored if log_config_append is set. (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/logdir
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #log_dir = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Uses logging handler designed to watch file system. When log file is
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# moved or removed this handler will open a new log file with
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# specified path instantaneously. It makes sense only if log_file
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# option is specified and Linux platform is used. This option is
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# ignored if log_config_append is set. (boolean value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +log_dir = /var/log/glance
Sep 28 11:21:32 ctl02 salt-minion[14967]: +
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Uses logging handler designed to watch file system. When log file is moved or
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# removed this handler will open a new log file with specified path
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# instantaneously. It makes sense only if log_file option is specified and Linux
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# platform is used. This option is ignored if log_config_append is set. (boolean
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #watch_log_file = false
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Use syslog for logging. Existing syslog format is DEPRECATED and
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# will be changed later to honor RFC5424. This option is ignored if
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# log_config_append is set. (boolean value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Use syslog for logging. Existing syslog format is DEPRECATED and will be
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# changed later to honor RFC5424. This option is ignored if log_config_append is
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# set. (boolean value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #use_syslog = false
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]:  # Syslog facility to receive log lines. This option is ignored if
Sep 28 11:21:32 ctl02 salt-minion[14967]:  # log_config_append is set. (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #syslog_log_facility = LOG_USER
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Log output to standard error. This option is ignored if
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# log_config_append is set. (boolean value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Log output to standard error. This option is ignored if log_config_append is
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# set. (boolean value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #use_stderr = true
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]:  # Format string to use for log messages with context. (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #logging_context_format_string = %(asctime)s.%(msecs)03d %(process)d %(levelname)s %(name)s [%(request_id)s %(user_identity)s] %(instance)s%(message)s
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Format string to use for log messages when context is undefined.
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Format string to use for log messages when context is undefined. (string
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #logging_default_format_string = %(asctime)s.%(msecs)03d %(process)d %(levelname)s %(name)s [-] %(instance)s%(message)s
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Additional data to append to log message when logging level for the
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# message is DEBUG. (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Additional data to append to log message when logging level for the message is
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# DEBUG. (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #logging_debug_format_suffix = %(funcName)s %(pathname)s:%(lineno)d
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Prefix each line of exception output with this format. (string
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Prefix each line of exception output with this format. (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #logging_exception_prefix = %(asctime)s.%(msecs)03d %(process)d ERROR %(name)s %(instance)s
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]:  # Defines the format string for %(user_identity)s that is used in
Sep 28 11:21:32 ctl02 salt-minion[14967]:  # logging_context_format_string. (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# List of package logging levels in logger=LEVEL pairs. This option is
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# ignored if log_config_append is set. (list value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# List of package logging levels in logger=LEVEL pairs. This option is ignored
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# if log_config_append is set. (list value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #default_log_levels = amqp=WARN,amqplib=WARN,boto=WARN,qpid=WARN,sqlalchemy=WARN,suds=INFO,oslo.messaging=INFO,iso8601=WARN,requests.packages.urllib3.connectionpool=WARN,urllib3.connectionpool=WARN,websocket=WARN,requests.packages.urllib3.util.retry=WARN,urllib3.util.retry=WARN,keystonemiddleware=WARN,routes.middleware=WARN,stevedore=WARN,taskflow=WARN,keystoneauth=WARN,oslo.cache=INFO,dogpile.core.dogpile=INFO
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]:  # Enables or disables publication of error events. (boolean value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #publish_errors = false
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# The format for an instance that is passed with the log message.
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# The format for an instance that is passed with the log message. (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #instance_format = "[instance: %(uuid)s] "
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# The format for an instance UUID that is passed with the log message.
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# The format for an instance UUID that is passed with the log message. (string
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #instance_uuid_format = "[instance: %(uuid)s] "
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]:  # Enables or disables fatal status of deprecations. (boolean value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: @@ -207,28 +487,27 @@
Sep 28 11:21:32 ctl02 salt-minion[14967]:  # From oslo.middleware.cors
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Indicate whether this resource may be shared with the domain
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# received in the requests "origin" header. (list value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Indicate whether this resource may be shared with the domain received in the
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# requests "origin" header. Format: "<protocol>://<host>[:<port>]", no trailing
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# slash. Example: https://horizon.example.com (list value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #allowed_origin = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Indicate that the actual request can include user credentials
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# (boolean value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Indicate that the actual request can include user credentials (boolean value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #allow_credentials = true
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Indicate which headers are safe to expose to the API. Defaults to
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# HTTP Simple Headers. (list value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#expose_headers = X-Image-Meta-Checksum,X-Auth-Token,X-Subject-Token,X-Service-Token,X-OpenStack-Request-ID
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Indicate which headers are safe to expose to the API. Defaults to HTTP Simple
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Headers. (list value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#expose_headers =
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]:  # Maximum cache age of CORS preflight requests. (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #max_age = 3600
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Indicate which methods can be used during the actual request. (list
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Indicate which methods can be used during the actual request. (list value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#allow_methods = OPTIONS,GET,HEAD,POST,PUT,DELETE,TRACE,PATCH
Sep 28 11:21:32 ctl02 salt-minion[14967]: +
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Indicate which header field names may be used during the actual request. (list
Sep 28 11:21:32 ctl02 salt-minion[14967]:  # value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#allow_methods = GET,PUT,POST,DELETE,PATCH
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Indicate which header field names may be used during the actual
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# request. (list value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#allow_headers = Content-MD5,X-Image-Meta-Checksum,X-Storage-Token,Accept-Encoding,X-Auth-Token,X-Identity-Status,X-Roles,X-Service-Catalog,X-User-Id,X-Tenant-Id,X-OpenStack-Request-ID
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#allow_headers =
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]:  [cors.subdomain]
Sep 28 11:21:32 ctl02 salt-minion[14967]: @@ -237,28 +516,27 @@
Sep 28 11:21:32 ctl02 salt-minion[14967]:  # From oslo.middleware.cors
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Indicate whether this resource may be shared with the domain
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# received in the requests "origin" header. (list value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Indicate whether this resource may be shared with the domain received in the
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# requests "origin" header. Format: "<protocol>://<host>[:<port>]", no trailing
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# slash. Example: https://horizon.example.com (list value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #allowed_origin = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Indicate that the actual request can include user credentials
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# (boolean value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Indicate that the actual request can include user credentials (boolean value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #allow_credentials = true
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Indicate which headers are safe to expose to the API. Defaults to
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# HTTP Simple Headers. (list value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#expose_headers = X-Image-Meta-Checksum,X-Auth-Token,X-Subject-Token,X-Service-Token,X-OpenStack-Request-ID
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Indicate which headers are safe to expose to the API. Defaults to HTTP Simple
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Headers. (list value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#expose_headers =
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]:  # Maximum cache age of CORS preflight requests. (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #max_age = 3600
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Indicate which methods can be used during the actual request. (list
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Indicate which methods can be used during the actual request. (list value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#allow_methods = OPTIONS,GET,HEAD,POST,PUT,DELETE,TRACE,PATCH
Sep 28 11:21:32 ctl02 salt-minion[14967]: +
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Indicate which header field names may be used during the actual request. (list
Sep 28 11:21:32 ctl02 salt-minion[14967]:  # value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#allow_methods = GET,PUT,POST,DELETE,PATCH
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Indicate which header field names may be used during the actual
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# request. (list value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#allow_headers = Content-MD5,X-Image-Meta-Checksum,X-Storage-Token,Accept-Encoding,X-Auth-Token,X-Identity-Status,X-Roles,X-Service-Catalog,X-User-Id,X-Tenant-Id,X-OpenStack-Request-ID
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#allow_headers =
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]:  [database]
Sep 28 11:21:32 ctl02 salt-minion[14967]: @@ -267,8 +545,12 @@
Sep 28 11:21:32 ctl02 salt-minion[14967]:  # From oslo.db
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# The file name to use with SQLite. (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# DEPRECATED: The file name to use with SQLite. (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/sqlite_db
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Reason: Should use config option connection or slave_connection to connect the
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# database.
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #sqlite_db = oslo.sqlite
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]:  # If True, SQLite uses synchronous mode. (boolean value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: @@ -279,21 +561,22 @@
Sep 28 11:21:32 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/db_backend
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #backend = sqlalchemy
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# The SQLAlchemy connection string to use to connect to the database.
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# The SQLAlchemy connection string to use to connect to the database. (string
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/sql_connection
Sep 28 11:21:32 ctl02 salt-minion[14967]:  # Deprecated group/name - [DATABASE]/sql_connection
Sep 28 11:21:32 ctl02 salt-minion[14967]:  # Deprecated group/name - [sql]/connection
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #connection = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# The SQLAlchemy connection string to use to connect to the slave
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# database. (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +connection = mysql+pymysql://glance:opnfv_secret@10.167.4.50/glance?charset=utf8&read_timeout=60
Sep 28 11:21:32 ctl02 salt-minion[14967]: +
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# The SQLAlchemy connection string to use to connect to the slave database.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #slave_connection = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# The SQL mode to be used for MySQL sessions. This option, including
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# the default, overrides any server-set SQL mode. To use whatever SQL
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# mode is set by the server configuration, set this to no value.
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Example: mysql_sql_mode= (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# The SQL mode to be used for MySQL sessions. This option, including the
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# default, overrides any server-set SQL mode. To use whatever SQL mode is set by
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# the server configuration, set this to no value. Example: mysql_sql_mode=
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #mysql_sql_mode = TRADITIONAL
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]:  # Timeout before idle SQL connections are reaped. (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: @@ -301,39 +584,42 @@
Sep 28 11:21:32 ctl02 salt-minion[14967]:  # Deprecated group/name - [DATABASE]/sql_idle_timeout
Sep 28 11:21:32 ctl02 salt-minion[14967]:  # Deprecated group/name - [sql]/idle_timeout
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #idle_timeout = 3600
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Minimum number of SQL connections to keep open in a pool. (integer
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +idle_timeout = 3600
Sep 28 11:21:32 ctl02 salt-minion[14967]: +
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Minimum number of SQL connections to keep open in a pool. (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/sql_min_pool_size
Sep 28 11:21:32 ctl02 salt-minion[14967]:  # Deprecated group/name - [DATABASE]/sql_min_pool_size
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #min_pool_size = 1
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Maximum number of SQL connections to keep open in a pool. (integer
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Maximum number of SQL connections to keep open in a pool. Setting a value of 0
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# indicates no limit. (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/sql_max_pool_size
Sep 28 11:21:32 ctl02 salt-minion[14967]:  # Deprecated group/name - [DATABASE]/sql_max_pool_size
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#max_pool_size = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Maximum number of database connection retries during startup. Set to
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# -1 to specify an infinite retry count. (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#max_pool_size = 5
Sep 28 11:21:32 ctl02 salt-minion[14967]: +max_pool_size = 30
Sep 28 11:21:32 ctl02 salt-minion[14967]: +
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Maximum number of database connection retries during startup. Set to -1 to
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# specify an infinite retry count. (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/sql_max_retries
Sep 28 11:21:32 ctl02 salt-minion[14967]:  # Deprecated group/name - [DATABASE]/sql_max_retries
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #max_retries = 10
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Interval between retries of opening a SQL connection. (integer
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +max_retries = -1
Sep 28 11:21:32 ctl02 salt-minion[14967]: +
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Interval between retries of opening a SQL connection. (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/sql_retry_interval
Sep 28 11:21:32 ctl02 salt-minion[14967]:  # Deprecated group/name - [DATABASE]/reconnect_interval
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #retry_interval = 10
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# If set, use this value for max_overflow with SQLAlchemy. (integer
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# If set, use this value for max_overflow with SQLAlchemy. (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/sql_max_overflow
Sep 28 11:21:32 ctl02 salt-minion[14967]:  # Deprecated group/name - [DATABASE]/sqlalchemy_max_overflow
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #max_overflow = 50
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Verbosity of SQL debugging information: 0=None, 100=Everything.
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +max_overflow = 60
Sep 28 11:21:32 ctl02 salt-minion[14967]: +
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Verbosity of SQL debugging information: 0=None, 100=Everything. (integer
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Maximum value: 100
Sep 28 11:21:32 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/sql_connection_debug
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #connection_debug = 0
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: @@ -341,37 +627,35 @@
Sep 28 11:21:32 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/sql_connection_trace
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #connection_trace = false
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# If set, use this value for pool_timeout with SQLAlchemy. (integer
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# If set, use this value for pool_timeout with SQLAlchemy. (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  # Deprecated group/name - [DATABASE]/sqlalchemy_pool_timeout
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #pool_timeout = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Enable the experimental use of database reconnect on connection
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# lost. (boolean value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Enable the experimental use of database reconnect on connection lost. (boolean
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #use_db_reconnect = false
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]:  # Seconds between retries of a database transaction. (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #db_retry_interval = 1
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# If True, increases the interval between retries of a database
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# operation up to db_max_retry_interval. (boolean value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# If True, increases the interval between retries of a database operation up to
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# db_max_retry_interval. (boolean value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #db_inc_retry_interval = true
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# If db_inc_retry_interval is set, the maximum seconds between retries
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# of a database operation. (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# If db_inc_retry_interval is set, the maximum seconds between retries of a
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# database operation. (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #db_max_retry_interval = 10
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Maximum retries in case of connection error or deadlock error before
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# error is raised. Set to -1 to specify an infinite retry count.
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Maximum retries in case of connection error or deadlock error before error is
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# raised. Set to -1 to specify an infinite retry count. (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #db_max_retries = 20
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #
Sep 28 11:21:32 ctl02 salt-minion[14967]:  # From oslo.db.concurrency
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Enable the experimental use of thread pooling for all DB API calls
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# (boolean value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Enable the experimental use of thread pooling for all DB API calls (boolean
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/dbapi_use_tpool
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #use_tpool = false
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: @@ -382,400 +666,817 @@
Sep 28 11:21:32 ctl02 salt-minion[14967]:  # From glance.store
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# List of stores enabled. Valid stores are: cinder, file, http, rbd,
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# sheepdog, swift, s3, vsphere (list value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# List of enabled Glance stores.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Register the storage backends to use for storing disk images
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# as a comma separated list. The default stores enabled for
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# storing disk images with Glance are ``file`` and ``http``.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * A comma separated list that could include:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#         * file
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#         * http
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#         * swift
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#         * rbd
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#         * sheepdog
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#         * cinder
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#         * vmware
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Related Options:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * default_store
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#  (list value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #stores = file,http
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Default scheme to use to store image data. The scheme must be
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# registered by one of the stores defined by the 'stores' config
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# option. (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +default_store = file
Sep 28 11:21:32 ctl02 salt-minion[14967]: +stores = file,http
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# The default scheme to use for storing images.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Provide a string value representing the default scheme to use for
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# storing images. If not set, Glance uses ``file`` as the default
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# scheme to store images with the ``file`` store.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +
Sep 28 11:21:32 ctl02 salt-minion[14967]: +os_region_name=RegionOne
Sep 28 11:21:32 ctl02 salt-minion[14967]: +
Sep 28 11:21:32 ctl02 salt-minion[14967]: +
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# NOTE: The value given for this configuration option must be a valid
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# scheme for a store registered with the ``stores`` configuration
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# option.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * file
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * filesystem
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * http
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * https
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * swift
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * swift+http
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * swift+https
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * swift+config
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * rbd
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * sheepdog
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * cinder
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * vsphere
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Related Options:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * stores
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Allowed values: file, filesystem, http, https, swift, swift+http, swift+https, swift+config, rbd, sheepdog, cinder, vsphere
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #default_store = file
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Minimum interval seconds to execute updating dynamic storage
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# capabilities based on backend status then. It's not a periodic
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# routine, the update logic will be executed only when interval
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# seconds elapsed and an operation of store has triggered. The feature
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# will be enabled only when the option value greater then zero.
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Minimum interval in seconds to execute updating dynamic storage
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# capabilities based on current backend status.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Provide an integer value representing time in seconds to set the
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# minimum interval before an update of dynamic storage capabilities
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# for a storage backend can be attempted. Setting
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# ``store_capabilities_update_min_interval`` does not mean updates
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# occur periodically based on the set interval. Rather, the update
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# is performed at the elapse of this interval set, if an operation
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# of the store is triggered.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# By default, this option is set to zero and is disabled. Provide an
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# integer value greater than zero to enable this option.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# NOTE: For more information on store capabilities and their updates,
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# please visit: https://specs.openstack.org/openstack/glance-specs/specs/kilo
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# /store-capabilities.html
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# For more information on setting up a particular store in your
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# deplyment and help with the usage of this feature, please contact
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# the storage driver maintainers listed here:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# http://docs.openstack.org/developer/glance_store/drivers/index.html
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * Zero
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * Positive integer
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Related Options:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #store_capabilities_update_min_interval = 0
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Specify the path to the CA bundle file to use in verifying the
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# remote server certificate. (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Information to match when looking for cinder in the service catalog.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# When the ``cinder_endpoint_template`` is not set and any of
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# ``cinder_store_auth_address``, ``cinder_store_user_name``,
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# ``cinder_store_project_name``, ``cinder_store_password`` is not set,
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# cinder store uses this information to lookup cinder endpoint from the service
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# catalog in the current context. ``cinder_os_region_name``, if set, is taken
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# into consideration to fetch the appropriate endpoint.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# The service catalog can be listed by the ``openstack catalog list`` command.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * A string of of the following form:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#       ``<service_type>:<service_name>:<endpoint_type>``
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#       At least ``service_type`` and ``endpoint_type`` should be specified.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#       ``service_name`` can be omitted.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * cinder_os_region_name
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * cinder_endpoint_template
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * cinder_store_auth_address
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * cinder_store_user_name
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * cinder_store_project_name
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * cinder_store_password
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#cinder_catalog_info = volumev2::publicURL
Sep 28 11:21:32 ctl02 salt-minion[14967]: +cinder_catalog_info = volumev2::internalURL
Sep 28 11:21:32 ctl02 salt-minion[14967]: +
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Override service catalog lookup with template for cinder endpoint.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# When this option is set, this value is used to generate cinder endpoint,
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# instead of looking up from the service catalog.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# This value is ignored if ``cinder_store_auth_address``,
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# ``cinder_store_user_name``, ``cinder_store_project_name``, and
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# ``cinder_store_password`` are specified.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# If this configuration option is set, ``cinder_catalog_info`` will be ignored.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * URL template string for cinder endpoint, where ``%%(tenant)s`` is
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#       replaced with the current tenant (project) name.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#       For example: ``http://cinder.openstack.example.org/v2/%%(tenant)s``
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * cinder_store_auth_address
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * cinder_store_user_name
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * cinder_store_project_name
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * cinder_store_password
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * cinder_catalog_info
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#cinder_endpoint_template = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]: +
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Region name to lookup cinder service from the service catalog.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# This is used only when ``cinder_catalog_info`` is used for determining the
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# endpoint. If set, the lookup for cinder endpoint by this node is filtered to
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# the specified region. It is useful when multiple regions are listed in the
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# catalog. If this is not set, the endpoint is looked up from every region.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * A string that is a valid region name.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * cinder_catalog_info
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Deprecated group/name - [glance_store]/os_region_name
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#cinder_os_region_name = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]: +
Sep 28 11:21:32 ctl02 salt-minion[14967]: +cinder_os_region_name = RegionOne
Sep 28 11:21:32 ctl02 salt-minion[14967]: +
Sep 28 11:21:32 ctl02 salt-minion[14967]: +
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Location of a CA certificates file used for cinder client requests.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# The specified CA certificates file, if set, is used to verify cinder
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# connections via HTTPS endpoint. If the endpoint is HTTP, this value is
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# ignored.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# ``cinder_api_insecure`` must be set to ``True`` to enable the verification.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * Path to a ca certificates file
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * cinder_api_insecure
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#cinder_ca_certificates_file = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]: +
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Number of cinderclient retries on failed http calls.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# When a call failed by any errors, cinderclient will retry the call up to the
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# specified times after sleeping a few seconds.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * A positive integer
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#cinder_http_retries = 3
Sep 28 11:21:32 ctl02 salt-minion[14967]: +
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Time period, in seconds, to wait for a cinder volume transition to
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# complete.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# When the cinder volume is created, deleted, or attached to the glance node to
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# read/write the volume data, the volume's state is changed. For example, the
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# newly created volume status changes from ``creating`` to ``available`` after
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# the creation process is completed. This specifies the maximum time to wait for
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# the status change. If a timeout occurs while waiting, or the status is changed
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# to an unexpected value (e.g. `error``), the image creation fails.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * A positive integer
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#cinder_state_transition_timeout = 300
Sep 28 11:21:32 ctl02 salt-minion[14967]: +
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Allow to perform insecure SSL requests to cinder.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# If this option is set to True, HTTPS endpoint connection is verified using the
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# CA certificates file specified by ``cinder_ca_certificates_file`` option.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * cinder_ca_certificates_file
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#cinder_api_insecure = false
Sep 28 11:21:32 ctl02 salt-minion[14967]: +
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# The address where the cinder authentication service is listening.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# When all of ``cinder_store_auth_address``, ``cinder_store_user_name``,
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# ``cinder_store_project_name``, and ``cinder_store_password`` options are
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# specified, the specified values are always used for the authentication.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# This is useful to hide the image volumes from users by storing them in a
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# project/tenant specific to the image service. It also enables users to share
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# the image volume among other projects under the control of glance's ACL.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# If either of these options are not set, the cinder endpoint is looked up
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# from the service catalog, and current context's user and project are used.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * A valid authentication service address, for example:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#       ``http://openstack.example.org/identity/v2.0``
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * cinder_store_user_name
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * cinder_store_password
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * cinder_store_project_name
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#cinder_store_auth_address = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]: +
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# User name to authenticate against cinder.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# This must be used with all the following related options. If any of these are
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# not specified, the user of the current context is used.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * A valid user name
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * cinder_store_auth_address
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * cinder_store_password
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * cinder_store_project_name
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#cinder_store_user_name = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]: +
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Password for the user authenticating against cinder.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# This must be used with all the following related options. If any of these are
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# not specified, the user of the current context is used.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * A valid password for the user specified by ``cinder_store_user_name``
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * cinder_store_auth_address
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * cinder_store_user_name
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * cinder_store_project_name
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#cinder_store_password = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]: +
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Project name where the image volume is stored in cinder.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# If this configuration option is not set, the project in current context is
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# used.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# This must be used with all the following related options. If any of these are
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# not specified, the project of the current context is used.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * A valid project name
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * ``cinder_store_auth_address``
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * ``cinder_store_user_name``
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * ``cinder_store_password``
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#cinder_store_project_name = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]: +
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Path to the rootwrap configuration file to use for running commands as root.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# The cinder store requires root privileges to operate the image volumes (for
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# connecting to iSCSI/FC volumes and reading/writing the volume data, etc.).
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# The configuration file should allow the required commands by cinder store and
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# os-brick library.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * Path to the rootwrap config file
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#rootwrap_config = /etc/glance/rootwrap.conf
Sep 28 11:21:32 ctl02 salt-minion[14967]: +
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Directory to which the filesystem backend store writes images.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Upon start up, Glance creates the directory if it doesn't already
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# exist and verifies write access to the user under which
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# ``glance-api`` runs. If the write access isn't available, a
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# ``BadStoreConfiguration`` exception is raised and the filesystem
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# store may not be available for adding new images.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# NOTE: This directory is used only when filesystem store is used as a
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# storage backend. Either ``filesystem_store_datadir`` or
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# ``filesystem_store_datadirs`` option must be specified in
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# ``glance-api.conf``. If both options are specified, a
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# ``BadStoreConfiguration`` will be raised and the filesystem store
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# may not be available for adding new images.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * A valid path to a directory
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * ``filesystem_store_datadirs``
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * ``filesystem_store_file_perm``
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#filesystem_store_datadir = /var/lib/glance/images
Sep 28 11:21:32 ctl02 salt-minion[14967]: +filesystem_store_datadir = /var/lib/glance/images/
Sep 28 11:21:32 ctl02 salt-minion[14967]: +
Sep 28 11:21:32 ctl02 salt-minion[14967]: +
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# List of directories and their priorities to which the filesystem
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# backend store writes images.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# The filesystem store can be configured to store images in multiple
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# directories as opposed to using a single directory specified by the
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# ``filesystem_store_datadir`` configuration option. When using
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# multiple directories, each directory can be given an optional
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# priority to specify the preference order in which they should
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# be used. Priority is an integer that is concatenated to the
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# directory path with a colon where a higher value indicates higher
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# priority. When two directories have the same priority, the directory
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# with most free space is used. When no priority is specified, it
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# defaults to zero.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# More information on configuring filesystem store with multiple store
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# directories can be found at
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# http://docs.openstack.org/developer/glance/configuring.html
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# NOTE: This directory is used only when filesystem store is used as a
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# storage backend. Either ``filesystem_store_datadir`` or
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# ``filesystem_store_datadirs`` option must be specified in
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# ``glance-api.conf``. If both options are specified, a
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# ``BadStoreConfiguration`` will be raised and the filesystem store
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# may not be available for adding new images.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * List of strings of the following form:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#         * ``<a valid directory path>:<optional integer priority>``
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * ``filesystem_store_datadir``
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * ``filesystem_store_file_perm``
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#  (multi valued)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#filesystem_store_datadirs =
Sep 28 11:21:32 ctl02 salt-minion[14967]: +
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Filesystem store metadata file.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# The path to a file which contains the metadata to be returned with
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# any location associated with the filesystem store. The file must
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# contain a valid JSON object. The object should contain the keys
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# ``id`` and ``mountpoint``. The value for both keys should be a
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# string.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * A valid path to the store metadata file
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# File access permissions for the image files.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Set the intended file access permissions for image data. This provides
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# a way to enable other services, e.g. Nova, to consume images directly
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# from the filesystem store. The users running the services that are
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# intended to be given access to could be made a member of the group
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# that owns the files created. Assigning a value less then or equal to
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# zero for this configuration option signifies that no changes be made
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# to the  default permissions. This value will be decoded as an octal
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# digit.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# For more information, please refer the documentation at
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# http://docs.openstack.org/developer/glance/configuring.html
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * A valid file access permission
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * Zero
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * Any negative integer
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#filesystem_store_file_perm = 0
Sep 28 11:21:32 ctl02 salt-minion[14967]: +
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Path to the CA bundle file.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# This configuration option enables the operator to use a custom
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Certificate Authority file to verify the remote server certificate. If
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# this option is set, the ``https_insecure`` option will be ignored and
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# the CA file specified will be used to authenticate the server
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# certificate and establish a secure connection to the server.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * A valid path to a CA file
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * https_insecure
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #https_ca_certificates_file = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# If true, the remote server certificate is not verified. If false,
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# then the default CA truststore is used for verification. This option
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# is ignored if "https_ca_certificates_file" is set. (boolean value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Set verification of the remote server certificate.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# This configuration option takes in a boolean value to determine
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# whether or not to verify the remote server certificate. If set to
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# True, the remote server certificate is not verified. If the option is
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# set to False, then the default CA truststore is used for verification.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# This option is ignored if ``https_ca_certificates_file`` is set.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# The remote server certificate will then be verified using the file
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# specified using the ``https_ca_certificates_file`` option.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * https_ca_certificates_file
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #https_insecure = true
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Specify the http/https proxy information that should be used to
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# connect to the remote server. The proxy information should be a key
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# value pair of the scheme and proxy. e.g. http:10.0.0.1:3128. You can
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# specify proxies for multiple schemes by seperating the key value
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# pairs with a comma.e.g. http:10.0.0.1:3128, https:10.0.0.1:1080.
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# (dict value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# The http/https proxy information to be used to connect to the remote
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# server.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# This configuration option specifies the http/https proxy information
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# that should be used to connect to the remote server. The proxy
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# information should be a key value pair of the scheme and proxy, for
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# example, http:10.0.0.1:3128. You can also specify proxies for multiple
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# schemes by separating the key value pairs with a comma, for example,
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# http:10.0.0.1:3128, https:10.0.0.1:1080.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * A comma separated list of scheme:proxy pairs as described above
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#  (dict value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #http_proxy_information =
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# If True, swiftclient won't check for a valid SSL certificate when
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# authenticating. (boolean value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#swift_store_auth_insecure = false
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# A string giving the CA certificate file to use in SSL connections
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# for verifying certs. (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#swift_store_cacert = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# The region of the swift endpoint to be used for single tenant. This
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# setting is only necessary if the tenant has multiple swift
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# endpoints. (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#swift_store_region = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# If set, the configured endpoint will be used. If None, the storage
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# url from the auth response will be used. (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#swift_store_endpoint = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# A string giving the endpoint type of the swift service to use
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# (publicURL, adminURL or internalURL). This setting is only used if
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# swift_store_auth_version is 2. (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#swift_store_endpoint_type = publicURL
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# A string giving the service type of the swift service to use. This
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# setting is only used if swift_store_auth_version is 2. (string
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#swift_store_service_type = object-store
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Container within the account that the account should use for storing
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# images in Swift when using single container mode. In multiple
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# container mode, this will be the prefix for all containers. (string
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#swift_store_container = glance
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# The size, in MB, that Glance will start chunking image files and do
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# a large object manifest in Swift. (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#swift_store_large_object_size = 5120
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# The amount of data written to a temporary disk buffer during the
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# process of chunking the image file. (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#swift_store_large_object_chunk_size = 200
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# A boolean value that determines if we create the container if it
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# does not exist. (boolean value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#swift_store_create_container_on_put = false
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# If set to True, enables multi-tenant storage mode which causes
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Glance images to be stored in tenant specific Swift accounts.
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# (boolean value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#swift_store_multi_tenant = false
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# When set to 0, a single-tenant store will only use one container to
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# store all images. When set to an integer value between 1 and 32, a
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# single-tenant store will use multiple containers to store images,
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# and this value will determine how many containers are created.Used
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# only when swift_store_multi_tenant is disabled. The total number of
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# containers that will be used is equal to 16^N, so if this config
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# option is set to 2, then 16^2=256 containers will be used to store
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# images. (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#swift_store_multiple_containers_seed = 0
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# A list of tenants that will be granted read/write access on all
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Swift containers created by Glance in multi-tenant mode. (list
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#swift_store_admin_tenants =
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# If set to False, disables SSL layer compression of https swift
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# requests. Setting to False may improve performance for images which
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# are already in a compressed format, eg qcow2. (boolean value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#swift_store_ssl_compression = true
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# The number of times a Swift download will be retried before the
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# request fails. (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#swift_store_retry_get_count = 0
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# The period of time (in seconds) before token expirationwhen
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# glance_store will try to reques new user token. Default value 60 sec
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# means that if token is going to expire in 1 min then glance_store
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# request new user token. (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#swift_store_expire_soon_interval = 60
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# If set to True create a trust for each add/get request to Multi-
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# tenant store in order to prevent authentication token to be expired
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# during uploading/downloading data. If set to False then user token
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# is used for Swift connection (so no overhead on trust creation).
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Please note that this option is considered only and only if
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# swift_store_multi_tenant=True (boolean value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#swift_store_use_trusts = true
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# The reference to the default swift account/backing store parameters
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# to use for adding new images. (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#default_swift_reference = ref1
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Version of the authentication service to use. Valid versions are 2
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# and 3 for keystone and 1 (deprecated) for swauth and rackspace.
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# (deprecated - use "auth_version" in swift_store_config_file) (string
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#swift_store_auth_version = 2
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# The address where the Swift authentication service is listening.
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# (deprecated - use "auth_address" in swift_store_config_file) (string
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#swift_store_auth_address = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# The user to authenticate against the Swift authentication service
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# (deprecated - use "user" in swift_store_config_file) (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#swift_store_user = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Auth key for the user authenticating against the Swift
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# authentication service. (deprecated - use "key" in
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# swift_store_config_file) (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#swift_store_key = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# The config file that has the swift account(s)configs. (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#swift_store_config_file = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# RADOS images will be chunked into objects of this size (in
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# megabytes). For best performance, this should be a power of two.
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#rbd_store_chunk_size = 8
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# RADOS pool in which images are stored. (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#rbd_store_pool = images
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# RADOS user to authenticate as (only applicable if using Cephx. If
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# <None>, a default will be chosen based on the client. section in
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# rbd_store_ceph_conf) (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#rbd_store_user = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Ceph configuration file path. If <None>, librados will locate the
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# default config. If using cephx authentication, this file should
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# include a reference to the right keyring in a client.<USER> section
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#rbd_store_ceph_conf = /etc/ceph/ceph.conf
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Timeout value (in seconds) used when connecting to ceph cluster. If
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# value <= 0, no timeout is set and default librados value is used.
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#rados_connect_timeout = 0
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Info to match when looking for cinder in the service catalog. Format
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# is : separated values of the form:
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# <service_type>:<service_name>:<endpoint_type> (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#cinder_catalog_info = volumev2::publicURL
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Override service catalog lookup with template for cinder endpoint
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# e.g. http://localhost:8776/v2/%(tenant)s (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#cinder_endpoint_template = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Region name of this node. If specified, it will be used to locate
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# OpenStack services for stores. (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Deprecated group/name - [DEFAULT]/os_region_name
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#cinder_os_region_name = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Location of ca certicates file to use for cinder client requests.
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#cinder_ca_certificates_file = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Number of cinderclient retries on failed http calls (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#cinder_http_retries = 3
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Time period of time in seconds to wait for a cinder volume
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# transition to complete. (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#cinder_state_transition_timeout = 300
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Allow to perform insecure SSL requests to cinder (boolean value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#cinder_api_insecure = false
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# The address where the Cinder authentication service is listening. If
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# <None>, the cinder endpoint in the service catalog is used. (string
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#cinder_store_auth_address = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# User name to authenticate against Cinder. If <None>, the user of
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# current context is used. (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#cinder_store_user_name = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Password for the user authenticating against Cinder. If <None>, the
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# current context auth token is used. (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#cinder_store_password = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Project name where the image is stored in Cinder. If <None>, the
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# project in current context is used. (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#cinder_store_project_name = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Path to the rootwrap configuration file to use for running commands
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# as root. (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#rootwrap_config = /etc/glance/rootwrap.conf
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# The host where the S3 server is listening. (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#s3_store_host = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# The S3 query token access key. (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#s3_store_access_key = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# The S3 query token secret key. (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#s3_store_secret_key = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# The S3 bucket to be used to store the Glance data. (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#s3_store_bucket = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# The local directory where uploads will be staged before they are
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# transferred into S3. (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#s3_store_object_buffer_dir = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# A boolean to determine if the S3 bucket should be created on upload
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# if it does not exist or if an error should be returned to the user.
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# (boolean value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#s3_store_create_bucket_on_put = false
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# The S3 calling format used to determine the bucket. Either subdomain
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# or path can be used. (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#s3_store_bucket_url_format = subdomain
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# What size, in MB, should S3 start chunking image files and do a
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# multipart upload in S3. (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#s3_store_large_object_size = 100
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# What multipart upload part size, in MB, should S3 use when uploading
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# parts. The size must be greater than or equal to 5M. (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#s3_store_large_object_chunk_size = 10
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# The number of thread pools to perform a multipart upload in S3.
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#s3_store_thread_pools = 10
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Enable the use of a proxy. (boolean value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#s3_store_enable_proxy = false
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Address or hostname for the proxy server. (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#s3_store_proxy_host = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# The port to use when connecting over a proxy. (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#s3_store_proxy_port = 8080
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# The username to connect to the proxy. (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#s3_store_proxy_user = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# The password to use when connecting over a proxy. (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#s3_store_proxy_password = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Images will be chunked into objects of this size (in megabytes). For
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# best performance, this should be a power of two. (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Chunk size for images to be stored in Sheepdog data store.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Provide an integer value representing the size in mebibyte
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# (1048576 bytes) to chunk Glance images into. The default
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# chunk size is 64 mebibytes.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# When using Sheepdog distributed storage system, the images are
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# chunked into objects of this size and then stored across the
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# distributed data store to use for Glance.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Chunk sizes, if a power of two, help avoid fragmentation and
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# enable improved performance.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * Positive integer value representing size in mebibytes.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Related Options:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #sheepdog_store_chunk_size = 64
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Port of sheep daemon. (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Port number on which the sheep daemon will listen.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Provide an integer value representing a valid port number on
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# which you want the Sheepdog daemon to listen on. The default
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# port is 7000.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# The Sheepdog daemon, also called 'sheep', manages the storage
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# in the distributed cluster by writing objects across the storage
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# network. It identifies and acts on the messages it receives on
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# the port number set using ``sheepdog_store_port`` option to store
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# chunks of Glance images.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * A valid port number (0 to 65535)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Related Options:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * sheepdog_store_address
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#  (port value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Maximum value: 65535
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #sheepdog_store_port = 7000
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# IP address of sheep daemon. (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#sheepdog_store_address = localhost
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Directory to which the Filesystem backend store writes images.
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#filesystem_store_datadir = /var/lib/glance/images
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# List of directories and its priorities to which the Filesystem
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# backend store writes images. (multi valued)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#filesystem_store_datadirs =
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# The path to a file which contains the metadata to be returned with
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# any location associated with this store.  The file must contain a
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# valid JSON object. The object should contain the keys 'id' and
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# 'mountpoint'. The value for both keys should be 'string'. (string
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#filesystem_store_metadata_file = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# The required permission for created image file. In this way the user
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# other service used, e.g. Nova, who consumes the image could be the
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# exclusive member of the group that owns the files created. Assigning
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# it less then or equal to zero means don't change the default
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# permission of the file. This value will be decoded as an octal
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# digit. (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#filesystem_store_file_perm = 0
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# ESX/ESXi or vCenter Server target system. The server value can be an
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# IP address or a DNS name. (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#vmware_server_host = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Username for authenticating with VMware ESX/VC server. (string
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#vmware_server_username = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Password for authenticating with VMware ESX/VC server. (string
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#vmware_server_password = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Number of times VMware ESX/VC server API must be retried upon
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# connection related issues. (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Address to bind the Sheepdog daemon to.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Provide a string value representing the address to bind the
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Sheepdog daemon to. The default address set for the 'sheep'
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# is 127.0.0.1.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# The Sheepdog daemon, also called 'sheep', manages the storage
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# in the distributed cluster by writing objects across the storage
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# network. It identifies and acts on the messages directed to the
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# address set using ``sheepdog_store_address`` option to store
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# chunks of Glance images.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * A valid IPv4 address
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * A valid IPv6 address
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * A valid hostname
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Related Options:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * sheepdog_store_port
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#sheepdog_store_address = 127.0.0.1
Sep 28 11:21:32 ctl02 salt-minion[14967]: +
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Address of the ESX/ESXi or vCenter Server target system.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# This configuration option sets the address of the ESX/ESXi or vCenter
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Server target system. This option is required when using the VMware
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# storage backend. The address can contain an IP address (127.0.0.1) or
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# a DNS name (www.my-domain.com).
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Possible Values:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * A valid IPv4 or IPv6 address
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * A valid DNS name
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * vmware_server_username
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * vmware_server_password
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#vmware_server_host = 127.0.0.1
Sep 28 11:21:32 ctl02 salt-minion[14967]: +
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Server username.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# This configuration option takes the username for authenticating with
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# the VMware ESX/ESXi or vCenter Server. This option is required when
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# using the VMware storage backend.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Possible Values:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * Any string that is the username for a user with appropriate
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#       privileges
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * vmware_server_host
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * vmware_server_password
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#vmware_server_username = root
Sep 28 11:21:32 ctl02 salt-minion[14967]: +
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Server password.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# This configuration option takes the password for authenticating with
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# the VMware ESX/ESXi or vCenter Server. This option is required when
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# using the VMware storage backend.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Possible Values:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * Any string that is a password corresponding to the username
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#       specified using the "vmware_server_username" option
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * vmware_server_host
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * vmware_server_username
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#vmware_server_password = vmware
Sep 28 11:21:32 ctl02 salt-minion[14967]: +
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# The number of VMware API retries.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# This configuration option specifies the number of times the VMware
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# ESX/VC server API must be retried upon connection related issues or
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# server API call overload. It is not possible to specify 'retry
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# forever'.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Possible Values:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * Any positive integer value
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #vmware_api_retry_count = 10
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# The interval used for polling remote tasks invoked on VMware ESX/VC
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# server. (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Interval in seconds used for polling remote tasks invoked on VMware
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# ESX/VC server.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# This configuration option takes in the sleep time in seconds for polling an
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# on-going async task as part of the VMWare ESX/VC server API call.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Possible Values:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * Any positive integer value
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #vmware_task_poll_interval = 5
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# The name of the directory where the glance images will be stored in
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# the VMware datastore. (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# The directory where the glance images will be stored in the datastore.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# This configuration option specifies the path to the directory where the
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# glance images will be stored in the VMware datastore. If this option
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# is not set,  the default directory where the glance images are stored
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# is openstack_glance.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Possible Values:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * Any string that is a valid path to a directory
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * None
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #vmware_store_image_dir = /openstack_glance
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# If true, the ESX/vCenter server certificate is not verified. If
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# false, then the default CA truststore is used for verification. This
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# option is ignored if "vmware_ca_file" is set. (boolean value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Deprecated group/name - [DEFAULT]/vmware_api_insecure
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Set verification of the ESX/vCenter server certificate.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# This configuration option takes a boolean value to determine
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# whether or not to verify the ESX/vCenter server certificate. If this
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# option is set to True, the ESX/vCenter server certificate is not
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# verified. If this option is set to False, then the default CA
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# truststore is used for verification.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# This option is ignored if the "vmware_ca_file" option is set. In that
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# case, the ESX/vCenter server certificate will then be verified using
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# the file specified using the "vmware_ca_file" option .
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Possible Values:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * True
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * False
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * vmware_ca_file
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Deprecated group/name - [glance_store]/vmware_api_insecure
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #vmware_insecure = false
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Specify a CA bundle file to use in verifying the ESX/vCenter server
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# certificate. (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#vmware_ca_file = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# A list of datastores where the image can be stored. This option may
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# be specified multiple times for specifying multiple datastores. The
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# datastore name should be specified after its datacenter path,
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# seperated by ":". An optional weight may be given after the
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# datastore name, seperated again by ":". Thus, the required format
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# becomes <datacenter_path>:<datastore_name>:<optional_weight>. When
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# adding an image, the datastore with highest weight will be selected,
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# unless there is not enough free space available in cases where the
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# image size is already known. If no weight is given, it is assumed to
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# be zero and the directory will be considered for selection last. If
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# multiple datastores have the same weight, then the one with the most
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# free space available is selected. (multi valued)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Absolute path to the CA bundle file.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# This configuration option enables the operator to use a custom
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Cerificate Authority File to verify the ESX/vCenter certificate.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# If this option is set, the "vmware_insecure" option will be ignored
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# and the CA file specified will be used to authenticate the ESX/vCenter
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# server certificate and establish a secure connection to the server.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Possible Values:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * Any string that is a valid absolute path to a CA file
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * vmware_insecure
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#vmware_ca_file = /etc/ssl/certs/ca-certificates.crt
Sep 28 11:21:32 ctl02 salt-minion[14967]: +
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# The datastores where the image can be stored.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# This configuration option specifies the datastores where the image can
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# be stored in the VMWare store backend. This option may be specified
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# multiple times for specifying multiple datastores. The datastore name
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# should be specified after its datacenter path, separated by ":". An
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# optional weight may be given after the datastore name, separated again
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# by ":" to specify the priority. Thus, the required format becomes
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# <datacenter_path>:<datastore_name>:<optional_weight>.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# When adding an image, the datastore with highest weight will be
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# selected, unless there is not enough free space available in cases
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# where the image size is already known. If no weight is given, it is
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# assumed to be zero and the directory will be considered for selection
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# last. If multiple datastores have the same weight, then the one with
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# the most free space available is selected.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Possible Values:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * Any string of the format:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#       <datacenter_path>:<datastore_name>:<optional_weight>
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Related options:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#    * None
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#  (multi valued)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #vmware_datastores =
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]:  [keystone_authtoken]
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: +revocation_cache_time = 10
Sep 28 11:21:32 ctl02 salt-minion[14967]: +auth_type = password
Sep 28 11:21:32 ctl02 salt-minion[14967]: +user_domain_id = default
Sep 28 11:21:32 ctl02 salt-minion[14967]: +project_domain_id = default
Sep 28 11:21:32 ctl02 salt-minion[14967]: +project_name = service
Sep 28 11:21:32 ctl02 salt-minion[14967]: +username = glance
Sep 28 11:21:32 ctl02 salt-minion[14967]: +password = opnfv_secret
Sep 28 11:21:32 ctl02 salt-minion[14967]: +auth_uri=http://10.167.4.10:5000
Sep 28 11:21:32 ctl02 salt-minion[14967]: +auth_url=http://10.167.4.10:35357
Sep 28 11:21:32 ctl02 salt-minion[14967]: +token_cache_time = -1
Sep 28 11:21:32 ctl02 salt-minion[14967]: +memcached_servers=10.167.4.11:11211,10.167.4.12:11211,10.167.4.13:11211
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #
Sep 28 11:21:32 ctl02 salt-minion[14967]:  # From keystonemiddleware.auth_token
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Complete public Identity API endpoint. (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Complete "public" Identity API endpoint. This endpoint should not be an
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# "admin" endpoint, as it should be accessible by all end users. Unauthenticated
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# clients are redirected to this endpoint to authenticate. Although this
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# endpoint should  ideally be unversioned, client support in the wild varies.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# If you're using a versioned v2 endpoint here, then this  should *not* be the
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# same endpoint the service user utilizes  for validating tokens, because normal
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# end users may not be  able to reach that endpoint. (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #auth_uri = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]:  # API version of the admin Identity API endpoint. (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #auth_version = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Do not handle authorization requests within the middleware, but
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# delegate the authorization decision to downstream WSGI components.
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# (boolean value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Do not handle authorization requests within the middleware, but delegate the
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# authorization decision to downstream WSGI components. (boolean value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #delay_auth_decision = false
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Request timeout value for communicating with Identity API server.
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Request timeout value for communicating with Identity API server. (integer
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #http_connect_timeout = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# How many times are we trying to reconnect when communicating with
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Identity API Server. (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# How many times are we trying to reconnect when communicating with Identity API
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Server. (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #http_request_max_retries = 3
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Env key for the swift cache. (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Request environment key where the Swift cache object is stored. When
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# auth_token middleware is deployed with a Swift cache, use this option to have
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# the middleware share a caching backend with swift. Otherwise, use the
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# ``memcached_servers`` option instead. (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #cache = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Required if identity server requires client certificate (string
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Required if identity server requires client certificate (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #certfile = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Required if identity server requires client certificate (string
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Required if identity server requires client certificate (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #keyfile = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# A PEM encoded Certificate Authority to use when verifying HTTPs
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# connections. Defaults to system CAs. (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# A PEM encoded Certificate Authority to use when verifying HTTPs connections.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Defaults to system CAs. (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #cafile = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]:  # Verify HTTPS connections. (boolean value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: @@ -787,98 +1488,91 @@
Sep 28 11:21:32 ctl02 salt-minion[14967]:  # Directory used to cache files related to PKI tokens. (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #signing_dir = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Optionally specify a list of memcached server(s) to use for caching.
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# If left undefined, tokens will instead be cached in-process. (list
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Deprecated group/name - [DEFAULT]/memcache_servers
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Optionally specify a list of memcached server(s) to use for caching. If left
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# undefined, tokens will instead be cached in-process. (list value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Deprecated group/name - [keystone_authtoken]/memcache_servers
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #memcached_servers = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# In order to prevent excessive effort spent validating tokens, the
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# middleware caches previously-seen tokens for a configurable duration
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# (in seconds). Set to -1 to disable caching completely. (integer
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# In order to prevent excessive effort spent validating tokens, the middleware
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# caches previously-seen tokens for a configurable duration (in seconds). Set to
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# -1 to disable caching completely. (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #token_cache_time = 300
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Determines the frequency at which the list of revoked tokens is
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# retrieved from the Identity service (in seconds). A high number of
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# revocation events combined with a low cache duration may
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# significantly reduce performance. (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Determines the frequency at which the list of revoked tokens is retrieved from
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# the Identity service (in seconds). A high number of revocation events combined
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# with a low cache duration may significantly reduce performance. Only valid for
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# PKI tokens. (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #revocation_cache_time = 10
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# (Optional) If defined, indicate whether token data should be
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# authenticated or authenticated and encrypted. If MAC, token data is
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# authenticated (with HMAC) in the cache. If ENCRYPT, token data is
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# encrypted and authenticated in the cache. If the value is not one of
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# these options or empty, auth_token will raise an exception on
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# initialization. (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# (Optional) If defined, indicate whether token data should be authenticated or
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# authenticated and encrypted. If MAC, token data is authenticated (with HMAC)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# in the cache. If ENCRYPT, token data is encrypted and authenticated in the
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# cache. If the value is not one of these options or empty, auth_token will
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# raise an exception on initialization. (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  # Allowed values: None, MAC, ENCRYPT
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #memcache_security_strategy = None
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# (Optional, mandatory if memcache_security_strategy is defined) This
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# string is used for key derivation. (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# (Optional, mandatory if memcache_security_strategy is defined) This string is
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# used for key derivation. (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #memcache_secret_key = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# (Optional) Number of seconds memcached server is considered dead
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# before it is tried again. (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# (Optional) Number of seconds memcached server is considered dead before it is
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# tried again. (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #memcache_pool_dead_retry = 300
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# (Optional) Maximum total number of open connections to every
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# memcached server. (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# (Optional) Maximum total number of open connections to every memcached server.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #memcache_pool_maxsize = 10
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# (Optional) Socket timeout in seconds for communicating with a
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# memcached server. (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# (Optional) Socket timeout in seconds for communicating with a memcached
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# server. (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #memcache_pool_socket_timeout = 3
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# (Optional) Number of seconds a connection to memcached is held
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# unused in the pool before it is closed. (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# (Optional) Number of seconds a connection to memcached is held unused in the
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# pool before it is closed. (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #memcache_pool_unused_timeout = 60
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# (Optional) Number of seconds that an operation will wait to get a
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# memcached client connection from the pool. (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# (Optional) Number of seconds that an operation will wait to get a memcached
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# client connection from the pool. (integer value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #memcache_pool_conn_get_timeout = 10
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# (Optional) Use the advanced (eventlet safe) memcached client pool.
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# The advanced pool will only work under python 2.x. (boolean value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# (Optional) Use the advanced (eventlet safe) memcached client pool. The
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# advanced pool will only work under python 2.x. (boolean value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #memcache_use_advanced_pool = false
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# (Optional) Indicate whether to set the X-Service-Catalog header. If
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# False, middleware will not ask for service catalog on token
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# validation and will not set the X-Service-Catalog header. (boolean
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# (Optional) Indicate whether to set the X-Service-Catalog header. If False,
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# middleware will not ask for service catalog on token validation and will not
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# set the X-Service-Catalog header. (boolean value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#include_service_catalog = true
Sep 28 11:21:32 ctl02 salt-minion[14967]: +
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Used to control the use and type of token binding. Can be set to: "disabled"
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# to not check token binding. "permissive" (default) to validate binding
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# information if the bind type is of a form known to the server and ignore it if
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# not. "strict" like "permissive" but if the bind type is unknown the token will
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# be rejected. "required" any form of token binding is needed to be allowed.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Finally the name of a binding method that must be present in tokens. (string
Sep 28 11:21:32 ctl02 salt-minion[14967]:  # value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#include_service_catalog = true
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Used to control the use and type of token binding. Can be set to:
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# "disabled" to not check token binding. "permissive" (default) to
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# validate binding information if the bind type is of a form known to
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# the server and ignore it if not. "strict" like "permissive" but if
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# the bind type is unknown the token will be rejected. "required" any
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# form of token binding is needed to be allowed. Finally the name of a
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# binding method that must be present in tokens. (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #enforce_token_bind = permissive
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# If true, the revocation list will be checked for cached tokens. This
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# requires that PKI tokens are configured on the identity server.
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# (boolean value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# If true, the revocation list will be checked for cached tokens. This requires
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# that PKI tokens are configured on the identity server. (boolean value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #check_revocations_for_cached = false
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Hash algorithms to use for hashing PKI tokens. This may be a single
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# algorithm or multiple. The algorithms are those supported by Python
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# standard hashlib.new(). The hashes will be tried in the order given,
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# so put the preferred one first for performance. The result of the
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# first hash will be stored in the cache. This will typically be set
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# to multiple values only while migrating from a less secure algorithm
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# to a more secure one. Once all the old tokens are expired this
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# option should be set to a single value for better performance. (list
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Hash algorithms to use for hashing PKI tokens. This may be a single algorithm
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# or multiple. The algorithms are those supported by Python standard
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# hashlib.new(). The hashes will be tried in the order given, so put the
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# preferred one first for performance. The result of the first hash will be
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# stored in the cache. This will typically be set to multiple values only while
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# migrating from a less secure algorithm to a more secure one. Once all the old
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# tokens are expired this option should be set to a single value for better
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# performance. (list value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #hash_algorithms = md5
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Authentication type to load (unknown value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Deprecated group/name - [DEFAULT]/auth_plugin
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Authentication type to load (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Deprecated group/name - [keystone_authtoken]/auth_plugin
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #auth_type = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Config Section from which to load plugin specific options (unknown
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Config Section from which to load plugin specific options (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #auth_section = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: @@ -888,11 +1582,117 @@
Sep 28 11:21:32 ctl02 salt-minion[14967]:  # From glance.glare
Sep 28 11:21:32 ctl02 salt-minion[14967]:  #
Sep 28 11:21:32 ctl02 salt-minion[14967]:  
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Partial name of a pipeline in your paste configuration file with the
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# service name removed. For example, if your paste section name is
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# [pipeline:glance-api-keystone] use the value "keystone" (string
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#flavor = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]: -
Sep 28 11:21:32 ctl02 salt-minion[14967]: -# Name of the paste configuration file. (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: -#config_file = <None>
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Deployment flavor to use in the server application pipeline.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Provide a string value representing the appropriate deployment
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# flavor used in the server application pipleline. This is typically
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# the partial name of a pipeline in the paste configuration file with
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# the service name removed.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# For example, if your paste section name in the paste configuration
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# file is [pipeline:glance-api-keystone], set ``flavor`` to
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# ``keystone``.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * String value representing a partial pipeline name.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Related Options:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * config_file
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#flavor = keystone
Sep 28 11:21:32 ctl02 salt-minion[14967]: +flavor = keystone
Sep 28 11:21:32 ctl02 salt-minion[14967]: +
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Name of the paste configuration file.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Provide a string value representing the name of the paste
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# configuration file to use for configuring piplelines for
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# server application deployments.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# NOTES:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * Provide the name or the path relative to the glance directory
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#       for the paste configuration file and not the absolute path.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * The sample paste configuration file shipped with Glance need
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#       not be edited in most cases as it comes with ready-made
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#       pipelines for all common deployment flavors.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# If no value is specified for this option, the ``paste.ini`` file
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# with the prefix of the corresponding Glance service's configuration
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# file name will be searched for in the known configuration
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# directories. (For example, if this option is missing from or has no
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# value set in ``glance-api.conf``, the service will look for a file
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# named ``glance-api-paste.ini``.) If the paste configuration file is
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# not found, the service will not start.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * A string value representing the name of the paste configuration
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#       file.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Related Options:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#     * flavor
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#config_file = glance-api-paste.ini
Sep 28 11:21:32 ctl02 salt-minion[14967]: +
Sep 28 11:21:32 ctl02 salt-minion[14967]: +
Sep 28 11:21:32 ctl02 salt-minion[14967]: +[profiler]
Sep 28 11:21:32 ctl02 salt-minion[14967]: +
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# From glance.glare
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Enables the profiling for all services on this node. Default value is False
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# (fully disable the profiling feature).
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# * True: Enables the feature
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# * False: Disables the feature. The profiling cannot be started via this
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# project
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# operations. If the profiling is triggered by another project, this project
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# part
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# will be empty.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Deprecated group/name - [profiler]/profiler_enabled
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#enabled = false
Sep 28 11:21:32 ctl02 salt-minion[14967]: +
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Enables SQL requests profiling in services. Default value is False (SQL
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# requests won't be traced).
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# * True: Enables SQL requests profiling. Each SQL query will be part of the
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# trace and can the be analyzed by how much time was spent for that.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# * False: Disables SQL requests profiling. The spent time is only shown on a
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# higher level of operations. Single SQL queries cannot be analyzed this
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# way.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#trace_sqlalchemy = false
Sep 28 11:21:32 ctl02 salt-minion[14967]: +
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Secret key(s) to use for encrypting context data for performance profiling.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# This string value should have the following format: <key1>[,<key2>,...<keyn>],
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# where each key is some random string. A user who triggers the profiling via
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# the REST API has to set one of these keys in the headers of the REST API call
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# to include profiling results of this node for this particular project.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Both "enabled" flag and "hmac_keys" config options should be set to enable
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# profiling. Also, to generate correct profiling information across all services
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# at least one key needs to be consistent between OpenStack projects. This
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# ensures it can be used from client side to generate the trace, containing
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# information from all possible resources. (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#hmac_keys = SECRET_KEY
Sep 28 11:21:32 ctl02 salt-minion[14967]: +
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Connection string for a notifier backend. Default value is messaging:// which
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# sets the notifier to oslo_messaging.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# Examples of possible values:
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#
Sep 28 11:21:32 ctl02 salt-minion[14967]: +# * messaging://: use oslo_messaging driver for sending notifications.
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 11:21:32 ctl02 salt-minion[14967]: +#connection_string = messaging://
Sep 28 11:21:32 ctl02 salt-minion[14967]: [INFO    ] Completed state [/etc/glance/glance-glare.conf] at time 11:21:32.040618 duration_in_ms=107.465
Sep 28 11:21:32 ctl02 salt-minion[14967]: [INFO    ] Running state [glance-glare] at time 11:21:32.104450
Sep 28 11:21:32 ctl02 salt-minion[14967]: [INFO    ] Executing state service.running for glance-glare
Sep 28 11:21:32 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'status', 'glance-glare.service', '-n', '0'] in directory '/root'
Sep 28 11:21:32 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-active', 'glance-glare.service'] in directory '/root'
Sep 28 11:21:32 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-enabled', 'glance-glare.service'] in directory '/root'
Sep 28 11:21:32 ctl02 salt-minion[14967]: [INFO    ] The service glance-glare is already running
Sep 28 11:21:32 ctl02 salt-minion[14967]: [INFO    ] Completed state [glance-glare] at time 11:21:32.144557 duration_in_ms=40.107
Sep 28 11:21:32 ctl02 salt-minion[14967]: [INFO    ] Running state [glance-glare] at time 11:21:32.144721
Sep 28 11:21:32 ctl02 salt-minion[14967]: [INFO    ] Executing state service.mod_watch for glance-glare
Sep 28 11:21:32 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-active', 'glance-glare.service'] in directory '/root'
Sep 28 11:21:32 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-enabled', 'glance-glare.service'] in directory '/root'
Sep 28 11:21:32 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemd-run', '--scope', 'systemctl', 'restart', 'glance-glare.service'] in directory '/root'
Sep 28 11:21:32 ctl02 systemd[1]: Started /bin/systemctl restart glance-glare.service.
Sep 28 11:21:32 ctl02 systemd[1]: Stopping OpenStack Glance Artifact Repository API...
Sep 28 11:21:32 ctl02 systemd[1]: Stopped OpenStack Glance Artifact Repository API.
Sep 28 11:21:32 ctl02 systemd[1]: Starting OpenStack Glance Artifact Repository API...
Sep 28 11:21:32 ctl02 systemd[1]: Started OpenStack Glance Artifact Repository API.
Sep 28 11:21:32 ctl02 salt-minion[14967]: [INFO    ] {'glance-glare': True}
Sep 28 11:21:32 ctl02 salt-minion[14967]: [INFO    ] Completed state [glance-glare] at time 11:21:32.209706 duration_in_ms=64.984
Sep 28 11:21:32 ctl02 salt-minion[14967]: [INFO    ] Running state [glance-api] at time 11:21:32.210787
Sep 28 11:21:32 ctl02 salt-minion[14967]: [INFO    ] Executing state service.running for glance-api
Sep 28 11:21:32 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'status', 'glance-api.service', '-n', '0'] in directory '/root'
Sep 28 11:21:32 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-active', 'glance-api.service'] in directory '/root'
Sep 28 11:21:32 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-enabled', 'glance-api.service'] in directory '/root'
Sep 28 11:21:32 ctl02 salt-minion[14967]: [INFO    ] The service glance-api is already running
Sep 28 11:21:32 ctl02 salt-minion[14967]: [INFO    ] Completed state [glance-api] at time 11:21:32.242229 duration_in_ms=31.44
Sep 28 11:21:32 ctl02 salt-minion[14967]: [INFO    ] Running state [glance-api] at time 11:21:32.242399
Sep 28 11:21:32 ctl02 salt-minion[14967]: [INFO    ] Executing state service.mod_watch for glance-api
Sep 28 11:21:32 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-active', 'glance-api.service'] in directory '/root'
Sep 28 11:21:32 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-enabled', 'glance-api.service'] in directory '/root'
Sep 28 11:21:32 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemd-run', '--scope', 'systemctl', 'restart', 'glance-api.service'] in directory '/root'
Sep 28 11:21:32 ctl02 systemd[1]: Started /bin/systemctl restart glance-api.service.
Sep 28 11:21:32 ctl02 systemd[1]: Stopping OpenStack Image Service API...
Sep 28 11:21:32 ctl02 systemd[1]: Stopped OpenStack Image Service API.
Sep 28 11:21:32 ctl02 systemd[1]: Starting OpenStack Image Service API...
Sep 28 11:21:32 ctl02 systemd[1]: Started OpenStack Image Service API.
Sep 28 11:21:32 ctl02 salt-minion[14967]: [INFO    ] {'glance-api': True}
Sep 28 11:21:32 ctl02 salt-minion[14967]: [INFO    ] Completed state [glance-api] at time 11:21:32.297543 duration_in_ms=55.143
Sep 28 11:21:32 ctl02 salt-minion[14967]: [INFO    ] Running state [glance-registry] at time 11:21:32.298134
Sep 28 11:21:32 ctl02 salt-minion[14967]: [INFO    ] Executing state service.running for glance-registry
Sep 28 11:21:32 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'status', 'glance-registry.service', '-n', '0'] in directory '/root'
Sep 28 11:21:32 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-active', 'glance-registry.service'] in directory '/root'
Sep 28 11:21:32 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-enabled', 'glance-registry.service'] in directory '/root'
Sep 28 11:21:32 ctl02 salt-minion[14967]: [INFO    ] The service glance-registry is already running
Sep 28 11:21:32 ctl02 salt-minion[14967]: [INFO    ] Completed state [glance-registry] at time 11:21:32.331509 duration_in_ms=33.373
Sep 28 11:21:32 ctl02 salt-minion[14967]: [INFO    ] Running state [glance-registry] at time 11:21:32.331681
Sep 28 11:21:32 ctl02 salt-minion[14967]: [INFO    ] Executing state service.mod_watch for glance-registry
Sep 28 11:21:32 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-active', 'glance-registry.service'] in directory '/root'
Sep 28 11:21:32 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-enabled', 'glance-registry.service'] in directory '/root'
Sep 28 11:21:32 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemd-run', '--scope', 'systemctl', 'restart', 'glance-registry.service'] in directory '/root'
Sep 28 11:21:32 ctl02 systemd[1]: Started /bin/systemctl restart glance-registry.service.
Sep 28 11:21:32 ctl02 systemd[1]: Stopping OpenStack Image Service Registry...
Sep 28 11:21:32 ctl02 systemd[1]: Stopped OpenStack Image Service Registry.
Sep 28 11:21:32 ctl02 systemd[1]: Starting OpenStack Image Service Registry...
Sep 28 11:21:32 ctl02 systemd[1]: Started OpenStack Image Service Registry.
Sep 28 11:21:32 ctl02 salt-minion[14967]: [INFO    ] {'glance-registry': True}
Sep 28 11:21:32 ctl02 salt-minion[14967]: [INFO    ] Completed state [glance-registry] at time 11:21:32.396502 duration_in_ms=64.82
Sep 28 11:21:32 ctl02 salt-minion[14967]: [INFO    ] Running state [glance-manage db_sync] at time 11:21:32.398258
Sep 28 11:21:32 ctl02 salt-minion[14967]: [INFO    ] Executing state cmd.run for glance-manage db_sync
Sep 28 11:21:32 ctl02 salt-minion[14967]: [INFO    ] Executing command 'glance-manage db_sync' in directory '/root'
Sep 28 11:21:32 ctl02 glance-glare[29163]: /usr/lib/python2.7/dist-packages/oslo_middleware/ssl.py:28: DeprecationWarning: The 'oslo_middleware.ssl' module usage is deprecated, please use oslo_middleware.http_proxy_to_wsgi instead
Sep 28 11:21:32 ctl02 glance-glare[29163]:   "oslo_middleware.http_proxy_to_wsgi")
Sep 28 11:21:32 ctl02 glance-api[29183]: /usr/lib/python2.7/dist-packages/oslo_middleware/ssl.py:28: DeprecationWarning: The 'oslo_middleware.ssl' module usage is deprecated, please use oslo_middleware.http_proxy_to_wsgi instead
Sep 28 11:21:32 ctl02 glance-api[29183]:   "oslo_middleware.http_proxy_to_wsgi")
Sep 28 11:21:32 ctl02 glance-api[29183]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:21:32 ctl02 glance-registry[29202]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:21:32 ctl02 glance-glare[29163]: /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py:22: DeprecationWarning: Parameters to load are deprecated.  Call .resolve and .require separately.
Sep 28 11:21:32 ctl02 glance-glare[29163]:   return pkg_resources.EntryPoint.parse("x=" + s).load(False)
Sep 28 11:21:32 ctl02 glance-glare[29163]: /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py:22: DeprecationWarning: Parameters to load are deprecated.  Call .resolve and .require separately.
Sep 28 11:21:32 ctl02 glance-glare[29163]:   return pkg_resources.EntryPoint.parse("x=" + s).load(False)
Sep 28 11:21:32 ctl02 glance-glare[29163]: /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py:22: DeprecationWarning: Parameters to load are deprecated.  Call .resolve and .require separately.
Sep 28 11:21:32 ctl02 glance-glare[29163]:   return pkg_resources.EntryPoint.parse("x=" + s).load(False)
Sep 28 11:21:32 ctl02 glance-glare[29163]: /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py:22: DeprecationWarning: Parameters to load are deprecated.  Call .resolve and .require separately.
Sep 28 11:21:32 ctl02 glance-glare[29163]:   return pkg_resources.EntryPoint.parse("x=" + s).load(False)
Sep 28 11:21:32 ctl02 glance-glare[29163]: /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py:22: DeprecationWarning: Parameters to load are deprecated.  Call .resolve and .require separately.
Sep 28 11:21:32 ctl02 glance-glare[29163]:   return pkg_resources.EntryPoint.parse("x=" + s).load(False)
Sep 28 11:21:32 ctl02 glance-glare[29163]: /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py:22: DeprecationWarning: Parameters to load are deprecated.  Call .resolve and .require separately.
Sep 28 11:21:32 ctl02 glance-glare[29163]:   return pkg_resources.EntryPoint.parse("x=" + s).load(False)
Sep 28 11:21:32 ctl02 glance-api[29183]: /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py:22: DeprecationWarning: Parameters to load are deprecated.  Call .resolve and .require separately.
Sep 28 11:21:32 ctl02 glance-api[29183]:   return pkg_resources.EntryPoint.parse("x=" + s).load(False)
Sep 28 11:21:32 ctl02 glance-api[29183]: /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py:22: DeprecationWarning: Parameters to load are deprecated.  Call .resolve and .require separately.
Sep 28 11:21:32 ctl02 glance-api[29183]:   return pkg_resources.EntryPoint.parse("x=" + s).load(False)
Sep 28 11:21:32 ctl02 glance-api[29183]: /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py:22: DeprecationWarning: Parameters to load are deprecated.  Call .resolve and .require separately.
Sep 28 11:21:32 ctl02 glance-api[29183]:   return pkg_resources.EntryPoint.parse("x=" + s).load(False)
Sep 28 11:21:32 ctl02 glance-api[29183]: /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py:22: DeprecationWarning: Parameters to load are deprecated.  Call .resolve and .require separately.
Sep 28 11:21:32 ctl02 glance-api[29183]:   return pkg_resources.EntryPoint.parse("x=" + s).load(False)
Sep 28 11:21:32 ctl02 glance-api[29183]: /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py:22: DeprecationWarning: Parameters to load are deprecated.  Call .resolve and .require separately.
Sep 28 11:21:32 ctl02 glance-api[29183]:   return pkg_resources.EntryPoint.parse("x=" + s).load(False)
Sep 28 11:21:32 ctl02 glance-api[29183]: /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py:22: DeprecationWarning: Parameters to load are deprecated.  Call .resolve and .require separately.
Sep 28 11:21:32 ctl02 glance-api[29183]:   return pkg_resources.EntryPoint.parse("x=" + s).load(False)
Sep 28 11:21:32 ctl02 glance-api[29183]: /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py:22: DeprecationWarning: Parameters to load are deprecated.  Call .resolve and .require separately.
Sep 28 11:21:32 ctl02 glance-api[29183]:   return pkg_resources.EntryPoint.parse("x=" + s).load(False)
Sep 28 11:21:32 ctl02 glance-glare[29163]: /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py:22: DeprecationWarning: Parameters to load are deprecated.  Call .resolve and .require separately.
Sep 28 11:21:32 ctl02 glance-glare[29163]:   return pkg_resources.EntryPoint.parse("x=" + s).load(False)
Sep 28 11:21:32 ctl02 glance-glare[29163]: /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py:22: DeprecationWarning: Parameters to load are deprecated.  Call .resolve and .require separately.
Sep 28 11:21:32 ctl02 glance-glare[29163]:   return pkg_resources.EntryPoint.parse("x=" + s).load(False)
Sep 28 11:21:32 ctl02 glance-glare[29163]: 2017-09-28 11:21:32.893 29163 INFO glance.common.glare.loader [-] Artifact MyArtifact has been successfully loaded
Sep 28 11:21:32 ctl02 glance-api[29183]: /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py:22: DeprecationWarning: Parameters to load are deprecated.  Call .resolve and .require separately.
Sep 28 11:21:32 ctl02 glance-api[29183]:   return pkg_resources.EntryPoint.parse("x=" + s).load(False)
Sep 28 11:21:32 ctl02 glance-api[29183]: /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py:22: DeprecationWarning: Parameters to load are deprecated.  Call .resolve and .require separately.
Sep 28 11:21:32 ctl02 glance-api[29183]:   return pkg_resources.EntryPoint.parse("x=" + s).load(False)
Sep 28 11:21:32 ctl02 glance-registry[29202]: /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py:22: DeprecationWarning: Parameters to load are deprecated.  Call .resolve and .require separately.
Sep 28 11:21:32 ctl02 glance-registry[29202]:   return pkg_resources.EntryPoint.parse("x=" + s).load(False)
Sep 28 11:21:32 ctl02 glance-registry[29202]: /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py:22: DeprecationWarning: Parameters to load are deprecated.  Call .resolve and .require separately.
Sep 28 11:21:32 ctl02 glance-registry[29202]:   return pkg_resources.EntryPoint.parse("x=" + s).load(False)
Sep 28 11:21:32 ctl02 glance-registry[29202]: /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py:22: DeprecationWarning: Parameters to load are deprecated.  Call .resolve and .require separately.
Sep 28 11:21:32 ctl02 glance-registry[29202]:   return pkg_resources.EntryPoint.parse("x=" + s).load(False)
Sep 28 11:21:32 ctl02 glance-registry[29202]: /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py:22: DeprecationWarning: Parameters to load are deprecated.  Call .resolve and .require separately.
Sep 28 11:21:32 ctl02 glance-registry[29202]:   return pkg_resources.EntryPoint.parse("x=" + s).load(False)
Sep 28 11:21:33 ctl02 glance-glare[29163]: /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py:22: DeprecationWarning: Parameters to load are deprecated.  Call .resolve and .require separately.
Sep 28 11:21:33 ctl02 glance-glare[29163]:   return pkg_resources.EntryPoint.parse("x=" + s).load(False)
Sep 28 11:21:33 ctl02 glance-glare[29163]: 2017-09-28 11:21:33.032 29163 INFO glance.common.wsgi [-] Starting 8 workers
Sep 28 11:21:33 ctl02 glance-glare[29163]: 2017-09-28 11:21:33.035 29163 INFO glance.common.wsgi [-] Started child 29233
Sep 28 11:21:33 ctl02 glance-glare[29163]: 2017-09-28 11:21:33.039 29163 INFO glance.common.wsgi [-] Started child 29234
Sep 28 11:21:33 ctl02 glance-registry[29202]: /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py:22: DeprecationWarning: Parameters to load are deprecated.  Call .resolve and .require separately.
Sep 28 11:21:33 ctl02 glance-registry[29202]:   return pkg_resources.EntryPoint.parse("x=" + s).load(False)
Sep 28 11:21:33 ctl02 glance-glare[29163]: 2017-09-28 11:21:33.043 29163 INFO glance.common.wsgi [-] Started child 29235
Sep 28 11:21:33 ctl02 glance-glare[29163]: 2017-09-28 11:21:33.046 29163 INFO glance.common.wsgi [-] Started child 29236
Sep 28 11:21:33 ctl02 glance-glare[29163]: 2017-09-28 11:21:33.049 29233 INFO eventlet.wsgi.server [-] (29233) wsgi starting up on http://10.167.4.12:9494
Sep 28 11:21:33 ctl02 glance-api[29183]: /usr/lib/python2.7/dist-packages/cryptography/x509/__init__.py:32: PendingDeprecationWarning: CRLExtensionOID has been renamed to CRLEntryExtensionOID
Sep 28 11:21:33 ctl02 glance-api[29183]:   from cryptography.x509.oid import (
Sep 28 11:21:33 ctl02 glance-glare[29163]: 2017-09-28 11:21:33.051 29234 INFO eventlet.wsgi.server [-] (29234) wsgi starting up on http://10.167.4.12:9494
Sep 28 11:21:33 ctl02 glance-glare[29163]: 2017-09-28 11:21:33.053 29235 INFO eventlet.wsgi.server [-] (29235) wsgi starting up on http://10.167.4.12:9494
Sep 28 11:21:33 ctl02 glance-glare[29163]: 2017-09-28 11:21:33.055 29236 INFO eventlet.wsgi.server [-] (29236) wsgi starting up on http://10.167.4.12:9494
Sep 28 11:21:33 ctl02 glance-glare[29163]: 2017-09-28 11:21:33.058 29163 INFO glance.common.wsgi [-] Started child 29237
Sep 28 11:21:33 ctl02 glance-glare[29163]: 2017-09-28 11:21:33.062 29163 INFO glance.common.wsgi [-] Started child 29238
Sep 28 11:21:33 ctl02 glance-glare[29163]: 2017-09-28 11:21:33.065 29237 INFO eventlet.wsgi.server [-] (29237) wsgi starting up on http://10.167.4.12:9494
Sep 28 11:21:33 ctl02 glance-glare[29163]: 2017-09-28 11:21:33.068 29163 INFO glance.common.wsgi [-] Started child 29239
Sep 28 11:21:33 ctl02 glance-glare[29163]: 2017-09-28 11:21:33.072 29163 INFO glance.common.wsgi [-] Started child 29240
Sep 28 11:21:33 ctl02 glance-glare[29163]: 2017-09-28 11:21:33.075 29238 INFO eventlet.wsgi.server [-] (29238) wsgi starting up on http://10.167.4.12:9494
Sep 28 11:21:33 ctl02 glance-glare[29163]: 2017-09-28 11:21:33.077 29239 INFO eventlet.wsgi.server [-] (29239) wsgi starting up on http://10.167.4.12:9494
Sep 28 11:21:33 ctl02 glance-glare[29163]: 2017-09-28 11:21:33.078 29240 INFO eventlet.wsgi.server [-] (29240) wsgi starting up on http://10.167.4.12:9494
Sep 28 11:21:33 ctl02 glance-registry[29202]: 2017-09-28 11:21:33.166 29202 INFO glance.common.wsgi [-] Starting 8 workers
Sep 28 11:21:33 ctl02 glance-registry[29202]: 2017-09-28 11:21:33.170 29202 INFO glance.common.wsgi [-] Started child 29241
Sep 28 11:21:33 ctl02 glance-registry[29202]: 2017-09-28 11:21:33.170 29241 INFO eventlet.wsgi.server [-] (29241) wsgi starting up on http://10.167.4.12:9191
Sep 28 11:21:33 ctl02 glance-registry[29202]: 2017-09-28 11:21:33.174 29202 INFO glance.common.wsgi [-] Started child 29242
Sep 28 11:21:33 ctl02 glance-registry[29202]: 2017-09-28 11:21:33.175 29242 INFO eventlet.wsgi.server [-] (29242) wsgi starting up on http://10.167.4.12:9191
Sep 28 11:21:33 ctl02 glance-registry[29202]: 2017-09-28 11:21:33.178 29243 INFO eventlet.wsgi.server [-] (29243) wsgi starting up on http://10.167.4.12:9191
Sep 28 11:21:33 ctl02 glance-registry[29202]: 2017-09-28 11:21:33.178 29202 INFO glance.common.wsgi [-] Started child 29243
Sep 28 11:21:33 ctl02 glance-registry[29202]: 2017-09-28 11:21:33.183 29244 INFO eventlet.wsgi.server [-] (29244) wsgi starting up on http://10.167.4.12:9191
Sep 28 11:21:33 ctl02 glance-registry[29202]: 2017-09-28 11:21:33.182 29202 INFO glance.common.wsgi [-] Started child 29244
Sep 28 11:21:33 ctl02 glance-registry[29202]: 2017-09-28 11:21:33.187 29245 INFO eventlet.wsgi.server [-] (29245) wsgi starting up on http://10.167.4.12:9191
Sep 28 11:21:33 ctl02 glance-registry[29202]: 2017-09-28 11:21:33.187 29202 INFO glance.common.wsgi [-] Started child 29245
Sep 28 11:21:33 ctl02 glance-registry[29202]: 2017-09-28 11:21:33.191 29202 INFO glance.common.wsgi [-] Started child 29246
Sep 28 11:21:33 ctl02 glance-registry[29202]: 2017-09-28 11:21:33.192 29246 INFO eventlet.wsgi.server [-] (29246) wsgi starting up on http://10.167.4.12:9191
Sep 28 11:21:33 ctl02 glance-registry[29202]: 2017-09-28 11:21:33.196 29247 INFO eventlet.wsgi.server [-] (29247) wsgi starting up on http://10.167.4.12:9191
Sep 28 11:21:33 ctl02 glance-registry[29202]: 2017-09-28 11:21:33.196 29202 INFO glance.common.wsgi [-] Started child 29247
Sep 28 11:21:33 ctl02 glance-registry[29202]: 2017-09-28 11:21:33.201 29202 INFO glance.common.wsgi [-] Started child 29248
Sep 28 11:21:33 ctl02 glance-registry[29202]: 2017-09-28 11:21:33.201 29248 INFO eventlet.wsgi.server [-] (29248) wsgi starting up on http://10.167.4.12:9191
Sep 28 11:21:33 ctl02 salt-minion[14967]: [INFO    ] {'pid': 29211, 'retcode': 0, 'stderr': 'Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.\n/usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/enginefacade.py:1056: OsloDBDeprecationWarning: EngineFacade is deprecated; please use oslo_db.sqlalchemy.enginefacade\n  expire_on_commit=expire_on_commit, _conf=conf)', 'stdout': ''}
Sep 28 11:21:33 ctl02 salt-minion[14967]: [INFO    ] Completed state [glance-manage db_sync] at time 11:21:33.245136 duration_in_ms=846.877
Sep 28 11:21:33 ctl02 salt-minion[14967]: [INFO    ] Running state [glance-manage db_load_metadefs] at time 11:21:33.245875
Sep 28 11:21:33 ctl02 salt-minion[14967]: [INFO    ] Executing state cmd.run for glance-manage db_load_metadefs
Sep 28 11:21:33 ctl02 salt-minion[14967]: [INFO    ] Executing command 'glance-manage db_load_metadefs' in directory '/root'
Sep 28 11:21:33 ctl02 glance-api[29183]: /usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py:22: DeprecationWarning: Parameters to load are deprecated.  Call .resolve and .require separately.
Sep 28 11:21:33 ctl02 glance-api[29183]:   return pkg_resources.EntryPoint.parse("x=" + s).load(False)
Sep 28 11:21:33 ctl02 glance-api[29183]: 2017-09-28 11:21:33.332 29183 INFO glance.common.wsgi [-] Starting 8 workers
Sep 28 11:21:33 ctl02 glance-api[29183]: 2017-09-28 11:21:33.336 29183 INFO glance.common.wsgi [-] Started child 29251
Sep 28 11:21:33 ctl02 glance-api[29183]: 2017-09-28 11:21:33.337 29251 INFO eventlet.wsgi.server [-] (29251) wsgi starting up on http://10.167.4.12:9292
Sep 28 11:21:33 ctl02 glance-api[29183]: 2017-09-28 11:21:33.340 29183 INFO glance.common.wsgi [-] Started child 29252
Sep 28 11:21:33 ctl02 glance-api[29183]: 2017-09-28 11:21:33.341 29252 INFO eventlet.wsgi.server [-] (29252) wsgi starting up on http://10.167.4.12:9292
Sep 28 11:21:33 ctl02 glance-api[29183]: 2017-09-28 11:21:33.344 29183 INFO glance.common.wsgi [-] Started child 29253
Sep 28 11:21:33 ctl02 glance-api[29183]: 2017-09-28 11:21:33.344 29253 INFO eventlet.wsgi.server [-] (29253) wsgi starting up on http://10.167.4.12:9292
Sep 28 11:21:33 ctl02 glance-api[29183]: 2017-09-28 11:21:33.347 29183 INFO glance.common.wsgi [-] Started child 29254
Sep 28 11:21:33 ctl02 glance-api[29183]: 2017-09-28 11:21:33.348 29254 INFO eventlet.wsgi.server [-] (29254) wsgi starting up on http://10.167.4.12:9292
Sep 28 11:21:33 ctl02 glance-api[29183]: 2017-09-28 11:21:33.351 29183 INFO glance.common.wsgi [-] Started child 29255
Sep 28 11:21:33 ctl02 glance-api[29183]: 2017-09-28 11:21:33.352 29255 INFO eventlet.wsgi.server [-] (29255) wsgi starting up on http://10.167.4.12:9292
Sep 28 11:21:33 ctl02 glance-api[29183]: 2017-09-28 11:21:33.355 29183 INFO glance.common.wsgi [-] Started child 29256
Sep 28 11:21:33 ctl02 glance-api[29183]: 2017-09-28 11:21:33.356 29256 INFO eventlet.wsgi.server [-] (29256) wsgi starting up on http://10.167.4.12:9292
Sep 28 11:21:33 ctl02 glance-api[29183]: 2017-09-28 11:21:33.360 29257 INFO eventlet.wsgi.server [-] (29257) wsgi starting up on http://10.167.4.12:9292
Sep 28 11:21:33 ctl02 glance-api[29183]: 2017-09-28 11:21:33.360 29183 INFO glance.common.wsgi [-] Started child 29257
Sep 28 11:21:33 ctl02 glance-api[29183]: 2017-09-28 11:21:33.364 29183 INFO glance.common.wsgi [-] Started child 29258
Sep 28 11:21:33 ctl02 glance-api[29183]: 2017-09-28 11:21:33.364 29258 INFO eventlet.wsgi.server [-] (29258) wsgi starting up on http://10.167.4.12:9292
Sep 28 11:21:34 ctl02 salt-minion[14967]: [INFO    ] {'pid': 29249, 'retcode': 0, 'stderr': 'Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.\n/usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/enginefacade.py:1056: OsloDBDeprecationWarning: EngineFacade is deprecated; please use oslo_db.sqlalchemy.enginefacade\n  expire_on_commit=expire_on_commit, _conf=conf)\n2017-09-28 11:21:34.034 29250 INFO glance.db.sqlalchemy.metadata [-] Skipping namespace OS::Compute::AggregateDiskFilter. It already exists in the database.\n2017-09-28 11:21:34.038 29250 INFO glance.db.sqlalchemy.metadata [-] Skipping namespace OS::Software::Runtimes. It already exists in the database.\n2017-09-28 11:21:34.041 29250 INFO glance.db.sqlalchemy.metadata [-] Skipping namespace OS::Compute::Libvirt. It already exists in the database.\n2017-09-28 11:21:34.044 29250 INFO glance.db.sqlalchemy.metadata [-] Skipping namespace OS::Compute::AggregateIoOpsFilter. It already exists in the database.\n2017-09-28 11:21:34.048 29250 INFO glance.db.sqlalchemy.metadata [-] Skipping namespace OS::Compute::GuestShutdownBehavior. It already exists in the database.\n2017-09-28 11:21:34.052 29250 INFO glance.db.sqlalchemy.metadata [-] Skipping namespace OS::Compute::GuestMemoryBacking. It already exists in the database.\n2017-09-28 11:21:34.055 29250 INFO glance.db.sqlalchemy.metadata [-] Skipping namespace OS::Compute::LibvirtImage. It already exists in the database.\n2017-09-28 11:21:34.058 29250 INFO glance.db.sqlalchemy.metadata [-] Skipping namespace OS::Compute::CPUPinning. It already exists in the database.\n2017-09-28 11:21:34.061 29250 INFO glance.db.sqlalchemy.metadata [-] Skipping namespace OS::Compute::RandomNumberGenerator. It already exists in the database.\n2017-09-28 11:21:34.064 29250 INFO glance.db.sqlalchemy.metadata [-] Skipping namespace OS::Compute::Trust. It already exists in the database.\n2017-09-28 11:21:34.066 29250 INFO glance.db.sqlalchemy.metadata [-] Skipping namespace OS::Software::DBMS. It already exists i
Sep 28 11:21:34 ctl02 salt-minion[14967]: n the database.\n2017-09-28 11:21:34.069 29250 INFO glance.db.sqlalchemy.metadata [-] Skipping namespace OS::Compute::XenAPI. It already exists in the database.\n2017-09-28 11:21:34.072 29250 INFO glance.db.sqlalchemy.metadata [-] Skipping namespace CIM::ProcessorAllocationSettingData. It already exists in the database.\n2017-09-28 11:21:34.075 29250 INFO glance.db.sqlalchemy.metadata [-] Skipping namespace OS::Compute::HostCapabilities. It already exists in the database.\n2017-09-28 11:21:34.078 29250 INFO glance.db.sqlalchemy.metadata [-] Skipping namespace OS::Compute::VMwareQuotaFlavor. It already exists in the database.\n2017-09-28 11:21:34.081 29250 INFO glance.db.sqlalchemy.metadata [-] Skipping namespace CIM::ResourceAllocationSettingData. It already exists in the database.\n2017-09-28 11:21:34.083 29250 INFO glance.db.sqlalchemy.metadata [-] Skipping namespace OS::Compute::VirtCPUTopology. It already exists in the database.\n2017-09-28 11:21:34.086 29250 INFO glance.db.sqlalchemy.metadata [-] Skipping namespace OS::Compute::Watchdog. It already exists in the database.\n2017-09-28 11:21:34.089 29250 INFO glance.db.sqlalchemy.metadata [-] Skipping namespace OS::Compute::AggregateNumInstancesFilter. It already exists in the database.\n2017-09-28 11:21:34.092 29250 INFO glance.db.sqlalchemy.metadata [-] Skipping namespace OS::Compute::Quota. It already exists in the database.\n2017-09-28 11:21:34.095 29250 INFO glance.db.sqlalchemy.metadata [-] Skipping namespace CIM::StorageAllocationSettingData. It already exists in the database.\n2017-09-28 11:21:34.099 29250 INFO glance.db.sqlalchemy.metadata [-] Skipping namespace OS::Compute::VMwareFlavor. It already exists in the database.\n2017-09-28 11:21:34.102 29250 INFO glance.db.sqlalchemy.metadata [-] Skipping namespace OS::Cinder::Volumetype. It already exists in the database.\n2017-09-28 11:21:34.105 29250 INFO glance.db.sqlalchemy.metadata [-] Skipping namespace OS::OperatingSystem. It already exists in the database.\n2017-09-28 11:21:34.109 29250 INFO glanc
Sep 28 11:21:34 ctl02 salt-minion[14967]: e.db.sqlalchemy.metadata [-] Skipping namespace OS::Compute::VMware. It already exists in the database.\n2017-09-28 11:21:34.112 29250 INFO glance.db.sqlalchemy.metadata [-] Skipping namespace OS::Software::WebServers. It already exists in the database.\n2017-09-28 11:21:34.115 29250 INFO glance.db.sqlalchemy.metadata [-] Skipping namespace OS::Compute::Hypervisor. It already exists in the database.\n2017-09-28 11:21:34.118 29250 INFO glance.db.sqlalchemy.metadata [-] Skipping namespace OS::Compute::InstanceData. It already exists in the database.\n2017-09-28 11:21:34.121 29250 INFO glance.db.sqlalchemy.metadata [-] Skipping namespace OS::Glance::CommonImageProperties. It already exists in the database.\n2017-09-28 11:21:34.124 29250 INFO glance.db.sqlalchemy.metadata [-] Skipping namespace CIM::VirtualSystemSettingData. It already exists in the database.\n2017-09-28 11:21:34.125 29250 INFO glance.db.sqlalchemy.metadata [-] Metadata loading finished', 'stdout': ''}
Sep 28 11:21:34 ctl02 salt-minion[14967]: [INFO    ] Completed state [glance-manage db_load_metadefs] at time 11:21:34.185022 duration_in_ms=939.145
Sep 28 11:21:34 ctl02 salt-minion[14967]: [INFO    ] Running state [/var/lib/glance/images] at time 11:21:34.185486
Sep 28 11:21:34 ctl02 salt-minion[14967]: [INFO    ] Executing state file.directory for /var/lib/glance/images
Sep 28 11:21:34 ctl02 salt-minion[14967]: [INFO    ] Directory /var/lib/glance/images is in the correct state
Sep 28 11:21:34 ctl02 salt-minion[14967]: [INFO    ] Completed state [/var/lib/glance/images] at time 11:21:34.186795 duration_in_ms=1.309
Sep 28 11:21:34 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928112059075591
Sep 28 11:21:35 ctl02 glance-api[29183]: 2017-09-28 11:21:35.121 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:21:35] "OPTIONS / HTTP/1.0" 200 134 0.002716
Sep 28 11:21:35 ctl02 glance-api[29183]: 2017-09-28 11:21:35.229 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:21:35] "OPTIONS / HTTP/1.0" 200 134 0.000525
Sep 28 11:21:35 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command state.sls with jid 20170928112135305585
Sep 28 11:21:35 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 29267
Sep 28 11:21:35 ctl02 glance-api[29183]: 2017-09-28 11:21:35.474 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:21:35] "OPTIONS / HTTP/1.0" 200 134 0.000816
Sep 28 11:21:37 ctl02 glance-api[29183]: 2017-09-28 11:21:37.107 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:21:37] "OPTIONS / HTTP/1.0" 200 134 0.000811
Sep 28 11:21:37 ctl02 glance-api[29183]: 2017-09-28 11:21:37.199 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:21:37] "OPTIONS / HTTP/1.0" 200 134 0.000627
Sep 28 11:21:37 ctl02 glance-api[29183]: 2017-09-28 11:21:37.467 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:21:37] "OPTIONS / HTTP/1.0" 200 134 0.000749
Sep 28 11:21:37 ctl02 salt-minion[14967]: [INFO    ] Loading fresh modules for state activity
Sep 28 11:21:37 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'glusterfs/client.sls'
Sep 28 11:21:37 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'glusterfs/map.jinja'
Sep 28 11:21:37 ctl02 salt-minion[14967]: [WARNING ] /usr/lib/python2.7/dist-packages/salt/utils/templates.py:73: DeprecationWarning: Starting in 2015.5, cmd.run uses python_shell=False by default, which doesn't support shellisms (pipes, env variables, etc). cmd.run is currently aliased to cmd.shell to prevent breakage. Please switch to cmd.shell or set python_shell=True to avoid breakage in the future, when this aliasing is removed.
Sep 28 11:21:37 ctl02 salt-minion[14967]: [INFO    ] Executing command 'systemd-escape -p --suffix=mount /var/lib/glance/images' in directory '/root'
Sep 28 11:21:37 ctl02 salt-minion[14967]: [INFO    ] Executing command 'systemd-escape -p --suffix=mount /var/lib/keystone/fernet-keys' in directory '/root'
Sep 28 11:21:37 ctl02 salt-minion[14967]: [INFO    ] Executing command 'systemd-escape -p --suffix=mount /var/lib/keystone/credential-keys' in directory '/root'
Sep 28 11:21:38 ctl02 salt-minion[14967]: [INFO    ] Running state [glusterfs-client] at time 11:21:38.673846
Sep 28 11:21:38 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for glusterfs-client
Sep 28 11:21:38 ctl02 salt-minion[14967]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 11:21:39 ctl02 salt-minion[14967]: [INFO    ] Executing command ['apt-get', '-q', 'update'] in directory '/root'
Sep 28 11:21:39 ctl02 glance-api[29183]: 2017-09-28 11:21:39.166 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:21:39] "OPTIONS / HTTP/1.0" 200 134 0.000627
Sep 28 11:21:39 ctl02 glance-api[29183]: 2017-09-28 11:21:39.234 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:21:39] "OPTIONS / HTTP/1.0" 200 134 0.002237
Sep 28 11:21:39 ctl02 glance-api[29183]: 2017-09-28 11:21:39.395 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:21:39] "OPTIONS / HTTP/1.0" 200 134 0.000589
Sep 28 11:21:39 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd4e7e23b)
Sep 28 11:21:40 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd4e7e23b)
Sep 28 11:21:41 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemd-run', '--scope', 'apt-get', '-q', '-y', '-o', 'DPkg::Options::=--force-confold', '-o', 'DPkg::Options::=--force-confdef', 'install', 'glusterfs-client'] in directory '/root'
Sep 28 11:21:41 ctl02 systemd[1]: Started /usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold -o DPkg::Options::=--force-confdef install glusterfs-client.
Sep 28 11:21:41 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd4e7e23b)
Sep 28 11:21:44 ctl02 dhclient[627]: message repeated 3 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd4e7e23b)]
Sep 28 11:21:45 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928112145398238
Sep 28 11:21:45 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 29740
Sep 28 11:21:45 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928112145398238
Sep 28 11:21:45 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd4e7e23b)
Sep 28 11:21:48 ctl02 dhclient[627]: message repeated 3 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd4e7e23b)]
Sep 28 11:21:48 ctl02 glance-api[29183]: 2017-09-28 11:21:48.860 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:21:48] "OPTIONS / HTTP/1.0" 200 134 0.000740
Sep 28 11:21:49 ctl02 glance-api[29183]: 2017-09-28 11:21:49.468 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:21:49] "OPTIONS / HTTP/1.0" 200 134 0.002654
Sep 28 11:21:49 ctl02 glance-api[29183]: 2017-09-28 11:21:49.505 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:21:49] "OPTIONS / HTTP/1.0" 200 134 0.000695
Sep 28 11:21:49 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd4e7e23b)
Sep 28 11:21:50 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:21:50 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:21:55 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928112155602261
Sep 28 11:21:55 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 29907
Sep 28 11:21:55 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928112155602261
Sep 28 11:21:58 ctl02 glance-api[29183]: 2017-09-28 11:21:58.745 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:21:58] "OPTIONS / HTTP/1.0" 200 134 0.003507
Sep 28 11:21:59 ctl02 glance-api[29183]: 2017-09-28 11:21:59.639 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:21:59] "OPTIONS / HTTP/1.0" 200 134 0.000598
Sep 28 11:21:59 ctl02 glance-api[29183]: 2017-09-28 11:21:59.761 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:21:59] "OPTIONS / HTTP/1.0" 200 134 0.000578
Sep 28 11:22:04 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x440d7442)
Sep 28 11:22:04 ctl02 salt-minion[14967]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 11:22:04 ctl02 salt-minion[14967]: [INFO    ] Made the following changes:
Sep 28 11:22:04 ctl02 salt-minion[14967]: 'liblvm2app2.2' changed from 'absent' to '2.02.133-1ubuntu10'
Sep 28 11:22:04 ctl02 salt-minion[14967]: 'glusterfs-common' changed from 'absent' to '3.7.6-1ubuntu1'
Sep 28 11:22:04 ctl02 salt-minion[14967]: 'libibverbs1' changed from 'absent' to '1.1.8-1.1ubuntu2'
Sep 28 11:22:04 ctl02 salt-minion[14967]: 'libdevmapper-event1.02.1' changed from 'absent' to '2:1.02.110-1ubuntu10'
Sep 28 11:22:04 ctl02 salt-minion[14967]: 'libattr1-dev' changed from 'absent' to '1:2.4.47-2'
Sep 28 11:22:04 ctl02 salt-minion[14967]: 'libc6-dev' changed from 'absent' to '2.23-0ubuntu9'
Sep 28 11:22:04 ctl02 salt-minion[14967]: 'fuse' changed from 'absent' to '2.9.4-1ubuntu3.1'
Sep 28 11:22:04 ctl02 salt-minion[14967]: 'manpages' changed from 'absent' to '4.04-2'
Sep 28 11:22:04 ctl02 salt-minion[14967]: 'linux-libc-dev' changed from 'absent' to '4.4.0-96.119'
Sep 28 11:22:04 ctl02 salt-minion[14967]: 'acl-dev' changed from 'absent' to '1'
Sep 28 11:22:04 ctl02 salt-minion[14967]: 'libacl1-dev' changed from 'absent' to '2.2.52-3'
Sep 28 11:22:04 ctl02 salt-minion[14967]: 'glusterfs-client' changed from 'absent' to '3.7.6-1ubuntu1'
Sep 28 11:22:04 ctl02 salt-minion[14967]: 'manpages-dev' changed from 'absent' to '4.04-2'
Sep 28 11:22:04 ctl02 salt-minion[14967]: 'psmisc' changed from 'absent' to '22.21-2.1build1'
Sep 28 11:22:04 ctl02 salt-minion[14967]: 'liburcu4' changed from 'absent' to '0.9.1-3'
Sep 28 11:22:04 ctl02 salt-minion[14967]: 'linux-kernel-headers' changed from 'absent' to '1'
Sep 28 11:22:04 ctl02 salt-minion[14967]: 'librdmacm1' changed from 'absent' to '1.0.21-1'
Sep 28 11:22:04 ctl02 salt-minion[14967]: 'attr-dev' changed from 'absent' to '1'
Sep 28 11:22:04 ctl02 salt-minion[14967]: 'libc-dev' changed from 'absent' to '1'
Sep 28 11:22:04 ctl02 salt-minion[14967]: 'libc-dev-bin' changed from 'absent' to '2.23-0ubuntu9'
Sep 28 11:22:04 ctl02 salt-minion[14967]: [INFO    ] Loading fresh modules for state activity
Sep 28 11:22:04 ctl02 salt-minion[14967]: [INFO    ] Completed state [glusterfs-client] at time 11:22:04.300120 duration_in_ms=25626.275
Sep 28 11:22:04 ctl02 salt-minion[14967]: [INFO    ] Running state [attr] at time 11:22:04.305395
Sep 28 11:22:04 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for attr
Sep 28 11:22:04 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemd-run', '--scope', 'apt-get', '-q', '-y', '-o', 'DPkg::Options::=--force-confold', '-o', 'DPkg::Options::=--force-confdef', 'install', 'attr'] in directory '/root'
Sep 28 11:22:04 ctl02 systemd[1]: Started /usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold -o DPkg::Options::=--force-confdef install attr.
Sep 28 11:22:05 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x440d7442)
Sep 28 11:22:05 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928112205736330
Sep 28 11:22:05 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 2305
Sep 28 11:22:05 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928112205736330
Sep 28 11:22:06 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x440d7442)
Sep 28 11:22:06 ctl02 salt-minion[14967]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 11:22:06 ctl02 salt-minion[14967]: [INFO    ] Made the following changes:
Sep 28 11:22:06 ctl02 salt-minion[14967]: 'attr' changed from 'absent' to '1:2.4.47-2'
Sep 28 11:22:06 ctl02 salt-minion[14967]: [INFO    ] Loading fresh modules for state activity
Sep 28 11:22:06 ctl02 salt-minion[14967]: [INFO    ] Completed state [attr] at time 11:22:06.436563 duration_in_ms=2131.168
Sep 28 11:22:06 ctl02 salt-minion[14967]: [INFO    ] Running state [/etc/systemd/system/var-lib-glance-images.mount] at time 11:22:06.438588
Sep 28 11:22:06 ctl02 salt-minion[14967]: [INFO    ] Executing state file.managed for /etc/systemd/system/var-lib-glance-images.mount
Sep 28 11:22:06 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'glusterfs/files/glusterfs-client.mount'
Sep 28 11:22:06 ctl02 salt-minion[14967]: [INFO    ] File changed:
Sep 28 11:22:06 ctl02 salt-minion[14967]: New file
Sep 28 11:22:06 ctl02 salt-minion[14967]: [INFO    ] Completed state [/etc/systemd/system/var-lib-glance-images.mount] at time 11:22:06.469233 duration_in_ms=30.645
Sep 28 11:22:06 ctl02 salt-minion[14967]: [INFO    ] Running state [var-lib-glance-images.mount] at time 11:22:06.545255
Sep 28 11:22:06 ctl02 salt-minion[14967]: [INFO    ] Executing state service.running for var-lib-glance-images.mount
Sep 28 11:22:06 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'status', 'var-lib-glance-images.mount', '-n', '0'] in directory '/root'
Sep 28 11:22:06 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-active', 'var-lib-glance-images.mount'] in directory '/root'
Sep 28 11:22:06 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-enabled', 'var-lib-glance-images.mount'] in directory '/root'
Sep 28 11:22:06 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-enabled', 'var-lib-glance-images.mount'] in directory '/root'
Sep 28 11:22:06 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemd-run', '--scope', 'systemctl', 'start', 'var-lib-glance-images.mount'] in directory '/root'
Sep 28 11:22:06 ctl02 systemd[1]: Started /bin/systemctl start var-lib-glance-images.mount.
Sep 28 11:22:06 ctl02 systemd[1]: Mounting GlusterFS File System (10.167.4.140:/glance)...
Sep 28 11:22:06 ctl02 systemd[1]: Mounted GlusterFS File System (10.167.4.140:/glance).
Sep 28 11:22:06 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-active', 'var-lib-glance-images.mount'] in directory '/root'
Sep 28 11:22:06 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-enabled', 'var-lib-glance-images.mount'] in directory '/root'
Sep 28 11:22:06 ctl02 salt-minion[14967]: message repeated 2 times: [ [INFO    ] Executing command ['systemctl', 'is-enabled', 'var-lib-glance-images.mount'] in directory '/root']
Sep 28 11:22:06 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemd-run', '--scope', 'systemctl', 'enable', 'var-lib-glance-images.mount'] in directory '/root'
Sep 28 11:22:06 ctl02 systemd[1]: Started /bin/systemctl enable var-lib-glance-images.mount.
Sep 28 11:22:06 ctl02 systemd[1]: Reloading.
Sep 28 11:22:06 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-enabled', 'var-lib-glance-images.mount'] in directory '/root'
Sep 28 11:22:06 ctl02 salt-minion[14967]: [INFO    ] {'var-lib-glance-images.mount': True}
Sep 28 11:22:06 ctl02 salt-minion[14967]: [INFO    ] Completed state [var-lib-glance-images.mount] at time 11:22:06.789485 duration_in_ms=244.23
Sep 28 11:22:06 ctl02 salt-minion[14967]: [INFO    ] Running state [/var/lib/glance/images] at time 11:22:06.790100
Sep 28 11:22:06 ctl02 salt-minion[14967]: [INFO    ] Executing state file.directory for /var/lib/glance/images
Sep 28 11:22:06 ctl02 salt-minion[14967]: [INFO    ] Directory /var/lib/glance/images is in the correct state
Sep 28 11:22:06 ctl02 salt-minion[14967]: [INFO    ] Completed state [/var/lib/glance/images] at time 11:22:06.791412 duration_in_ms=1.312
Sep 28 11:22:06 ctl02 salt-minion[14967]: [INFO    ] Running state [/etc/systemd/system/var-lib-keystone-fernet\x2dkeys.mount] at time 11:22:06.791603
Sep 28 11:22:06 ctl02 salt-minion[14967]: [INFO    ] Executing state file.managed for /etc/systemd/system/var-lib-keystone-fernet\x2dkeys.mount
Sep 28 11:22:06 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'glusterfs/files/glusterfs-client.mount'
Sep 28 11:22:06 ctl02 salt-minion[14967]: [INFO    ] File changed:
Sep 28 11:22:06 ctl02 salt-minion[14967]: New file
Sep 28 11:22:06 ctl02 salt-minion[14967]: [INFO    ] Completed state [/etc/systemd/system/var-lib-keystone-fernet\x2dkeys.mount] at time 11:22:06.816008 duration_in_ms=24.405
Sep 28 11:22:06 ctl02 salt-minion[14967]: [INFO    ] Running state [var-lib-keystone-fernet\x2dkeys.mount] at time 11:22:06.816519
Sep 28 11:22:06 ctl02 salt-minion[14967]: [INFO    ] Executing state service.running for var-lib-keystone-fernet\x2dkeys.mount
Sep 28 11:22:06 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'status', 'var-lib-keystone-fernet\\x2dkeys.mount', '-n', '0'] in directory '/root'
Sep 28 11:22:06 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-active', 'var-lib-keystone-fernet\\x2dkeys.mount'] in directory '/root'
Sep 28 11:22:06 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-enabled', 'var-lib-keystone-fernet\\x2dkeys.mount'] in directory '/root'
Sep 28 11:22:06 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-enabled', 'var-lib-keystone-fernet\\x2dkeys.mount'] in directory '/root'
Sep 28 11:22:06 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemd-run', '--scope', 'systemctl', 'start', 'var-lib-keystone-fernet\\x2dkeys.mount'] in directory '/root'
Sep 28 11:22:06 ctl02 systemd[1]: Started /bin/systemctl start var-lib-keystone-fernet\x2dkeys.mount.
Sep 28 11:22:06 ctl02 systemd[1]: var-lib-keystone-fernet\x2dkeys.mount: Directory /var/lib/keystone/fernet-keys to mount over is not empty, mounting anyway.
Sep 28 11:22:06 ctl02 systemd[1]: Mounting GlusterFS File System (10.167.4.140:/keystone-keys)...
Sep 28 11:22:06 ctl02 systemd[1]: Mounted GlusterFS File System (10.167.4.140:/keystone-keys).
Sep 28 11:22:06 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-active', 'var-lib-keystone-fernet\\x2dkeys.mount'] in directory '/root'
Sep 28 11:22:06 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-enabled', 'var-lib-keystone-fernet\\x2dkeys.mount'] in directory '/root'
Sep 28 11:22:06 ctl02 salt-minion[14967]: message repeated 2 times: [ [INFO    ] Executing command ['systemctl', 'is-enabled', 'var-lib-keystone-fernet\\x2dkeys.mount'] in directory '/root']
Sep 28 11:22:06 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemd-run', '--scope', 'systemctl', 'enable', 'var-lib-keystone-fernet\\x2dkeys.mount'] in directory '/root'
Sep 28 11:22:06 ctl02 systemd[1]: Started /bin/systemctl enable var-lib-keystone-fernet\x2dkeys.mount.
Sep 28 11:22:06 ctl02 systemd[1]: Reloading.
Sep 28 11:22:07 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-enabled', 'var-lib-keystone-fernet\\x2dkeys.mount'] in directory '/root'
Sep 28 11:22:07 ctl02 salt-minion[14967]: [INFO    ] {'var-lib-keystone-fernet\\x2dkeys.mount': True}
Sep 28 11:22:07 ctl02 salt-minion[14967]: [INFO    ] Completed state [var-lib-keystone-fernet\x2dkeys.mount] at time 11:22:07.035114 duration_in_ms=218.594
Sep 28 11:22:07 ctl02 salt-minion[14967]: [INFO    ] Running state [/var/lib/keystone/fernet-keys] at time 11:22:07.035665
Sep 28 11:22:07 ctl02 salt-minion[14967]: [INFO    ] Executing state file.directory for /var/lib/keystone/fernet-keys
Sep 28 11:22:07 ctl02 salt-minion[14967]: [INFO    ] Directory /var/lib/keystone/fernet-keys is in the correct state
Sep 28 11:22:07 ctl02 salt-minion[14967]: [INFO    ] Completed state [/var/lib/keystone/fernet-keys] at time 11:22:07.036828 duration_in_ms=1.162
Sep 28 11:22:07 ctl02 salt-minion[14967]: [INFO    ] Running state [/etc/systemd/system/var-lib-keystone-credential\x2dkeys.mount] at time 11:22:07.036996
Sep 28 11:22:07 ctl02 salt-minion[14967]: [INFO    ] Executing state file.managed for /etc/systemd/system/var-lib-keystone-credential\x2dkeys.mount
Sep 28 11:22:07 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'glusterfs/files/glusterfs-client.mount'
Sep 28 11:22:07 ctl02 salt-minion[14967]: [INFO    ] File changed:
Sep 28 11:22:07 ctl02 salt-minion[14967]: New file
Sep 28 11:22:07 ctl02 salt-minion[14967]: [INFO    ] Completed state [/etc/systemd/system/var-lib-keystone-credential\x2dkeys.mount] at time 11:22:07.060759 duration_in_ms=23.762
Sep 28 11:22:07 ctl02 salt-minion[14967]: [INFO    ] Running state [var-lib-keystone-credential\x2dkeys.mount] at time 11:22:07.061179
Sep 28 11:22:07 ctl02 salt-minion[14967]: [INFO    ] Executing state service.running for var-lib-keystone-credential\x2dkeys.mount
Sep 28 11:22:07 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'status', 'var-lib-keystone-credential\\x2dkeys.mount', '-n', '0'] in directory '/root'
Sep 28 11:22:07 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-active', 'var-lib-keystone-credential\\x2dkeys.mount'] in directory '/root'
Sep 28 11:22:07 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-enabled', 'var-lib-keystone-credential\\x2dkeys.mount'] in directory '/root'
Sep 28 11:22:07 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-enabled', 'var-lib-keystone-credential\\x2dkeys.mount'] in directory '/root'
Sep 28 11:22:07 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemd-run', '--scope', 'systemctl', 'start', 'var-lib-keystone-credential\\x2dkeys.mount'] in directory '/root'
Sep 28 11:22:07 ctl02 systemd[1]: Started /bin/systemctl start var-lib-keystone-credential\x2dkeys.mount.
Sep 28 11:22:07 ctl02 systemd[1]: Mounting GlusterFS File System (10.167.4.140:/keystone-credential-keys)...
Sep 28 11:22:07 ctl02 systemd[1]: Mounted GlusterFS File System (10.167.4.140:/keystone-credential-keys).
Sep 28 11:22:07 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-active', 'var-lib-keystone-credential\\x2dkeys.mount'] in directory '/root'
Sep 28 11:22:07 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-enabled', 'var-lib-keystone-credential\\x2dkeys.mount'] in directory '/root'
Sep 28 11:22:07 ctl02 salt-minion[14967]: message repeated 2 times: [ [INFO    ] Executing command ['systemctl', 'is-enabled', 'var-lib-keystone-credential\\x2dkeys.mount'] in directory '/root']
Sep 28 11:22:07 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemd-run', '--scope', 'systemctl', 'enable', 'var-lib-keystone-credential\\x2dkeys.mount'] in directory '/root'
Sep 28 11:22:07 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x440d7442)
Sep 28 11:22:07 ctl02 systemd[1]: Started /bin/systemctl enable var-lib-keystone-credential\x2dkeys.mount.
Sep 28 11:22:07 ctl02 systemd[1]: Reloading.
Sep 28 11:22:07 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-enabled', 'var-lib-keystone-credential\\x2dkeys.mount'] in directory '/root'
Sep 28 11:22:07 ctl02 salt-minion[14967]: [INFO    ] {'var-lib-keystone-credential\\x2dkeys.mount': True}
Sep 28 11:22:07 ctl02 salt-minion[14967]: [INFO    ] Completed state [var-lib-keystone-credential\x2dkeys.mount] at time 11:22:07.282812 duration_in_ms=221.63
Sep 28 11:22:07 ctl02 salt-minion[14967]: [INFO    ] Running state [/var/lib/keystone/credential-keys] at time 11:22:07.283416
Sep 28 11:22:07 ctl02 salt-minion[14967]: [INFO    ] Executing state file.directory for /var/lib/keystone/credential-keys
Sep 28 11:22:07 ctl02 salt-minion[14967]: [INFO    ] Directory /var/lib/keystone/credential-keys is in the correct state
Sep 28 11:22:07 ctl02 salt-minion[14967]: [INFO    ] Completed state [/var/lib/keystone/credential-keys] at time 11:22:07.284586 duration_in_ms=1.169
Sep 28 11:22:07 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928112135305585
Sep 28 11:22:08 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x440d7442)
Sep 28 11:22:08 ctl02 glance-api[29183]: 2017-09-28 11:22:08.828 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:22:08] "OPTIONS / HTTP/1.0" 200 134 0.000933
Sep 28 11:22:09 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x440d7442)
Sep 28 11:22:09 ctl02 glance-api[29183]: 2017-09-28 11:22:09.773 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:22:09] "OPTIONS / HTTP/1.0" 200 134 0.000749
Sep 28 11:22:09 ctl02 glance-api[29183]: 2017-09-28 11:22:09.875 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:22:09] "OPTIONS / HTTP/1.0" 200 134 0.000539
Sep 28 11:22:10 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x440d7442)
Sep 28 11:22:14 ctl02 dhclient[627]: message repeated 4 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x440d7442)]
Sep 28 11:22:15 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:22:15 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:22:18 ctl02 glance-api[29183]: 2017-09-28 11:22:18.530 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:22:18] "OPTIONS / HTTP/1.0" 200 134 0.000865
Sep 28 11:22:19 ctl02 glance-api[29183]: 2017-09-28 11:22:19.477 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:22:19] "OPTIONS / HTTP/1.0" 200 134 0.000742
Sep 28 11:22:19 ctl02 glance-api[29183]: 2017-09-28 11:22:19.488 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:22:19] "OPTIONS / HTTP/1.0" 200 134 0.000540
Sep 28 11:22:26 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb50c4b07)
Sep 28 11:22:28 ctl02 dhclient[627]: message repeated 2 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb50c4b07)]
Sep 28 11:22:28 ctl02 glance-api[29183]: 2017-09-28 11:22:28.295 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:22:28] "OPTIONS / HTTP/1.0" 200 134 0.000793
Sep 28 11:22:28 ctl02 dhclient[600]: DHCPREQUEST of 192.168.11.25 on ens2 to 192.168.11.3 port 67 (xid=0x3415f07)
Sep 28 11:22:28 ctl02 dhclient[600]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 11:22:28 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 11:22:28 ctl02 ntp[2721]:  * Stopping NTP server ntpd
Sep 28 11:22:28 ctl02 ntp[2721]:    ...done.
Sep 28 11:22:28 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 11:22:28 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 11:22:28 ctl02 ntp[2732]:  * Starting NTP server ntpd
Sep 28 11:22:28 ctl02 ntpd[2739]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 11:22:28 ctl02 ntpd[2739]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -c /var/lib/ntp/ntp.conf.dhcp -u 108:112
Sep 28 11:22:28 ctl02 ntp[2732]:    ...done.
Sep 28 11:22:28 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 11:22:28 ctl02 ntpd[2742]: proto: precision = 0.043 usec (-24)
Sep 28 11:22:28 ctl02 ntpd[2742]: switching logging to file /var/log/ntp.log
Sep 28 11:22:28 ctl02 dhclient[600]: bound to 192.168.11.25 -- renewal in 238 seconds.
Sep 28 11:22:29 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb50c4b07)
Sep 28 11:22:29 ctl02 glance-api[29183]: 2017-09-28 11:22:29.613 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:22:29] "OPTIONS / HTTP/1.0" 200 134 0.000799
Sep 28 11:22:29 ctl02 glance-api[29183]: 2017-09-28 11:22:29.740 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:22:29] "OPTIONS / HTTP/1.0" 200 134 0.000800
Sep 28 11:22:30 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb50c4b07)
Sep 28 11:22:36 ctl02 dhclient[627]: message repeated 6 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb50c4b07)]
Sep 28 11:22:37 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:22:37 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:22:37 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 11:22:37 ctl02 ntp[2794]:  * Stopping NTP server ntpd
Sep 28 11:22:37 ctl02 ntp[2794]:    ...done.
Sep 28 11:22:37 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 11:22:37 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 11:22:37 ctl02 ntp[2805]:  * Starting NTP server ntpd
Sep 28 11:22:37 ctl02 ntpd[2812]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 11:22:37 ctl02 ntpd[2812]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 11:22:37 ctl02 ntp[2805]:    ...done.
Sep 28 11:22:37 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 11:22:37 ctl02 ntpd[2815]: proto: precision = 0.042 usec (-24)
Sep 28 11:22:37 ctl02 ntpd[2815]: switching logging to file /var/log/ntp.log
Sep 28 11:22:38 ctl02 glance-api[29183]: 2017-09-28 11:22:38.686 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:22:38] "OPTIONS / HTTP/1.0" 200 134 0.000704
Sep 28 11:22:39 ctl02 glance-api[29183]: 2017-09-28 11:22:39.816 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:22:39] "OPTIONS / HTTP/1.0" 200 134 0.000661
Sep 28 11:22:39 ctl02 glance-api[29183]: 2017-09-28 11:22:39.872 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:22:39] "OPTIONS / HTTP/1.0" 200 134 0.000561
Sep 28 11:22:46 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4b1a9e30)
Sep 28 11:22:48 ctl02 dhclient[627]: message repeated 2 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4b1a9e30)]
Sep 28 11:22:48 ctl02 glance-api[29183]: 2017-09-28 11:22:48.852 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:22:48] "OPTIONS / HTTP/1.0" 200 134 0.000822
Sep 28 11:22:49 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4b1a9e30)
Sep 28 11:22:49 ctl02 glance-api[29183]: 2017-09-28 11:22:49.735 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:22:49] "OPTIONS / HTTP/1.0" 200 134 0.000789
Sep 28 11:22:50 ctl02 glance-api[29183]: 2017-09-28 11:22:50.126 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:22:50] "OPTIONS / HTTP/1.0" 200 134 0.000489
Sep 28 11:22:50 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4b1a9e30)
Sep 28 11:22:56 ctl02 dhclient[627]: message repeated 6 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4b1a9e30)]
Sep 28 11:22:57 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:22:57 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:22:58 ctl02 glance-api[29183]: 2017-09-28 11:22:58.473 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:22:58] "OPTIONS / HTTP/1.0" 200 134 0.000852
Sep 28 11:22:59 ctl02 glance-api[29183]: 2017-09-28 11:22:59.760 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:22:59] "OPTIONS / HTTP/1.0" 200 134 0.000753
Sep 28 11:22:59 ctl02 glance-api[29183]: 2017-09-28 11:22:59.882 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:22:59] "OPTIONS / HTTP/1.0" 200 134 0.000546
Sep 28 11:23:08 ctl02 glance-api[29183]: 2017-09-28 11:23:08.812 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:23:08] "OPTIONS / HTTP/1.0" 200 134 0.003007
Sep 28 11:23:09 ctl02 glance-api[29183]: 2017-09-28 11:23:09.441 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:23:09] "OPTIONS / HTTP/1.0" 200 134 0.000762
Sep 28 11:23:09 ctl02 glance-api[29183]: 2017-09-28 11:23:09.826 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:23:09] "OPTIONS / HTTP/1.0" 200 134 0.000536
Sep 28 11:23:12 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd132426)
Sep 28 11:23:18 ctl02 dhclient[627]: message repeated 6 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd132426)]
Sep 28 11:23:19 ctl02 glance-api[29183]: 2017-09-28 11:23:19.049 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:23:19] "OPTIONS / HTTP/1.0" 200 134 0.000811
Sep 28 11:23:19 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd132426)
Sep 28 11:23:19 ctl02 glance-api[29183]: 2017-09-28 11:23:19.373 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:23:19] "OPTIONS / HTTP/1.0" 200 134 0.000497
Sep 28 11:23:20 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd132426)
Sep 28 11:23:20 ctl02 glance-api[29183]: 2017-09-28 11:23:20.175 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:23:20] "OPTIONS / HTTP/1.0" 200 134 0.000791
Sep 28 11:23:21 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd132426)
Sep 28 11:23:22 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd132426)
Sep 28 11:23:23 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:23:23 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:23:29 ctl02 glance-api[29183]: 2017-09-28 11:23:29.247 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:23:29] "OPTIONS / HTTP/1.0" 200 134 0.002754
Sep 28 11:23:29 ctl02 glance-api[29183]: 2017-09-28 11:23:29.516 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:23:29] "OPTIONS / HTTP/1.0" 200 134 0.000723
Sep 28 11:23:30 ctl02 glance-api[29183]: 2017-09-28 11:23:30.064 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:23:30] "OPTIONS / HTTP/1.0" 200 134 0.000654
Sep 28 11:23:39 ctl02 glance-api[29183]: 2017-09-28 11:23:39.470 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:23:39] "OPTIONS / HTTP/1.0" 200 134 0.000823
Sep 28 11:23:39 ctl02 glance-api[29183]: 2017-09-28 11:23:39.591 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:23:39] "OPTIONS / HTTP/1.0" 200 134 0.000495
Sep 28 11:23:40 ctl02 glance-api[29183]: 2017-09-28 11:23:40.203 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:23:40] "OPTIONS / HTTP/1.0" 200 134 0.000627
Sep 28 11:23:43 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x922dcf47)
Sep 28 11:23:49 ctl02 dhclient[627]: message repeated 6 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x922dcf47)]
Sep 28 11:23:49 ctl02 glance-api[29183]: 2017-09-28 11:23:49.419 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:23:49] "OPTIONS / HTTP/1.0" 200 134 0.000821
Sep 28 11:23:49 ctl02 glance-api[29183]: 2017-09-28 11:23:49.656 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:23:49] "OPTIONS / HTTP/1.0" 200 134 0.000720
Sep 28 11:23:50 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x922dcf47)
Sep 28 11:23:50 ctl02 glance-api[29183]: 2017-09-28 11:23:50.535 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:23:50] "OPTIONS / HTTP/1.0" 200 134 0.000691
Sep 28 11:23:51 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x922dcf47)
Sep 28 11:23:53 ctl02 dhclient[627]: message repeated 2 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x922dcf47)]
Sep 28 11:23:54 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:23:54 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:23:59 ctl02 glance-api[29183]: 2017-09-28 11:23:59.311 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:23:59] "OPTIONS / HTTP/1.0" 200 134 0.000728
Sep 28 11:23:59 ctl02 glance-api[29183]: 2017-09-28 11:23:59.689 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:23:59] "OPTIONS / HTTP/1.0" 200 134 0.000519
Sep 28 11:24:00 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command state.sls with jid 20170928112400041286
Sep 28 11:24:00 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 2837
Sep 28 11:24:00 ctl02 glance-api[29183]: 2017-09-28 11:24:00.193 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:24:00] "OPTIONS / HTTP/1.0" 200 134 0.002432
Sep 28 11:24:02 ctl02 salt-minion[14967]: [INFO    ] Loading fresh modules for state activity
Sep 28 11:24:02 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'keystone/server.sls'
Sep 28 11:24:02 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'keystone/map.jinja'
Sep 28 11:24:02 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'apache/init.sls'
Sep 28 11:24:02 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'apache/server/init.sls'
Sep 28 11:24:02 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'apache/server/service/init.sls'
Sep 28 11:24:02 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'apache/map.jinja'
Sep 28 11:24:02 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'apache/server/service/modules.sls'
Sep 28 11:24:02 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'apache/map.jinja'
Sep 28 11:24:03 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'apache/server/service/mpm.sls'
Sep 28 11:24:03 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'apache/map.jinja'
Sep 28 11:24:03 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'apache/server/site.sls'
Sep 28 11:24:03 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'apache/map.jinja'
Sep 28 11:24:03 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'apache/server/users.sls'
Sep 28 11:24:03 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'apache/map.jinja'
Sep 28 11:24:03 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'apache/server/robots.sls'
Sep 28 11:24:03 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'apache/map.jinja'
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Running state [apache2] at time 11:24:04.007065
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for apache2
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Package apache2 is already installed
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Completed state [apache2] at time 11:24:04.419384 duration_in_ms=412.318
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Running state [a2enmod ssl] at time 11:24:04.420012
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Executing state cmd.run for a2enmod ssl
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] /etc/apache2/mods-enabled/ssl.load exists
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Completed state [a2enmod ssl] at time 11:24:04.421138 duration_in_ms=1.126
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Running state [a2enmod rewrite] at time 11:24:04.421627
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Executing state cmd.run for a2enmod rewrite
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] /etc/apache2/mods-enabled/rewrite.load exists
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Completed state [a2enmod rewrite] at time 11:24:04.422642 duration_in_ms=1.016
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Running state [libapache2-mod-wsgi] at time 11:24:04.423103
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for libapache2-mod-wsgi
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Package libapache2-mod-wsgi is already installed
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Completed state [libapache2-mod-wsgi] at time 11:24:04.426505 duration_in_ms=3.402
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Running state [a2enmod wsgi] at time 11:24:04.426978
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Executing state cmd.run for a2enmod wsgi
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] /etc/apache2/mods-enabled/wsgi.load exists
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Completed state [a2enmod wsgi] at time 11:24:04.427985 duration_in_ms=1.007
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Running state [/etc/apache2/mods-enabled/mpm_prefork.load] at time 11:24:04.429525
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Executing state file.absent for /etc/apache2/mods-enabled/mpm_prefork.load
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] File /etc/apache2/mods-enabled/mpm_prefork.load is not present
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Completed state [/etc/apache2/mods-enabled/mpm_prefork.load] at time 11:24:04.430694 duration_in_ms=1.169
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Running state [/etc/apache2/mods-enabled/mpm_prefork.conf] at time 11:24:04.431058
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Executing state file.absent for /etc/apache2/mods-enabled/mpm_prefork.conf
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] File /etc/apache2/mods-enabled/mpm_prefork.conf is not present
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Completed state [/etc/apache2/mods-enabled/mpm_prefork.conf] at time 11:24:04.432227 duration_in_ms=1.169
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Running state [/etc/apache2/mods-enabled/mpm_worker.load] at time 11:24:04.432592
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Executing state file.absent for /etc/apache2/mods-enabled/mpm_worker.load
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] File /etc/apache2/mods-enabled/mpm_worker.load is not present
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Completed state [/etc/apache2/mods-enabled/mpm_worker.load] at time 11:24:04.433764 duration_in_ms=1.172
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Running state [/etc/apache2/mods-enabled/mpm_worker.conf] at time 11:24:04.434112
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Executing state file.absent for /etc/apache2/mods-enabled/mpm_worker.conf
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] File /etc/apache2/mods-enabled/mpm_worker.conf is not present
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Completed state [/etc/apache2/mods-enabled/mpm_worker.conf] at time 11:24:04.435246 duration_in_ms=1.133
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Running state [/etc/apache2/mods-available/mpm_event.conf] at time 11:24:04.436750
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Executing state file.managed for /etc/apache2/mods-available/mpm_event.conf
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'apache/files/mpm/mpm_event.conf'
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'apache/map.jinja'
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] File /etc/apache2/mods-available/mpm_event.conf is in the correct state
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Completed state [/etc/apache2/mods-available/mpm_event.conf] at time 11:24:04.500789 duration_in_ms=64.038
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Running state [a2enmod mpm_event] at time 11:24:04.501634
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Executing state cmd.run for a2enmod mpm_event
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] /etc/apache2/mods-enabled/mpm_event.load exists
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Completed state [a2enmod mpm_event] at time 11:24:04.502957 duration_in_ms=1.323
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Running state [/etc/apache2/ports.conf] at time 11:24:04.503492
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Executing state file.managed for /etc/apache2/ports.conf
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'apache/files/ports.conf'
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'apache/map.jinja'
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] File /etc/apache2/ports.conf is in the correct state
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Completed state [/etc/apache2/ports.conf] at time 11:24:04.552610 duration_in_ms=49.118
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Running state [/etc/apache2/conf-available/security.conf] at time 11:24:04.553095
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Executing state file.managed for /etc/apache2/conf-available/security.conf
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'apache/files/security.conf'
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'apache/map.jinja'
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] File /etc/apache2/conf-available/security.conf is in the correct state
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Completed state [/etc/apache2/conf-available/security.conf] at time 11:24:04.608213 duration_in_ms=55.118
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Running state [mysql-client] at time 11:24:04.615566
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for mysql-client
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Package mysql-client is already installed
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Completed state [mysql-client] at time 11:24:04.619059 duration_in_ms=3.493
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Running state [python-keystoneclient] at time 11:24:04.619380
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for python-keystoneclient
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Package python-keystoneclient is already installed
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Completed state [python-keystoneclient] at time 11:24:04.622758 duration_in_ms=3.377
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Running state [python-mysqldb] at time 11:24:04.623088
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for python-mysqldb
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Package python-mysqldb is already installed
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Completed state [python-mysqldb] at time 11:24:04.626655 duration_in_ms=3.567
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Running state [python-openstackclient] at time 11:24:04.626974
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for python-openstackclient
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Package python-openstackclient is already installed
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Completed state [python-openstackclient] at time 11:24:04.630333 duration_in_ms=3.359
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Running state [python-memcache] at time 11:24:04.630653
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for python-memcache
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Package python-memcache is already installed
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Completed state [python-memcache] at time 11:24:04.634032 duration_in_ms=3.379
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Running state [python-pycadf] at time 11:24:04.634362
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for python-pycadf
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Package python-pycadf is already installed
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Completed state [python-pycadf] at time 11:24:04.637724 duration_in_ms=3.361
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Running state [python-six] at time 11:24:04.638041
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for python-six
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Package python-six is already installed
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Completed state [python-six] at time 11:24:04.641435 duration_in_ms=3.394
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Running state [keystone] at time 11:24:04.641756
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for keystone
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Package keystone is already installed
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Completed state [keystone] at time 11:24:04.645085 duration_in_ms=3.329
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Running state [gettext-base] at time 11:24:04.645439
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for gettext-base
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Package gettext-base is already installed
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Completed state [gettext-base] at time 11:24:04.648810 duration_in_ms=3.371
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Running state [python-psycopg2] at time 11:24:04.649126
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for python-psycopg2
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Package python-psycopg2 is already installed
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Completed state [python-psycopg2] at time 11:24:04.652423 duration_in_ms=3.297
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Running state [python-keystone] at time 11:24:04.652721
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for python-keystone
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Package python-keystone is already installed
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Completed state [python-keystone] at time 11:24:04.655995 duration_in_ms=3.275
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Running state [/etc/keystone/policy.json] at time 11:24:04.656459
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Executing state file.managed for /etc/keystone/policy.json
Sep 28 11:24:04 ctl02 salt-minion[14967]: [WARNING ] State for file: /etc/keystone/policy.json - Neither 'source' nor 'contents' nor 'contents_pillar' nor 'contents_grains' was defined, yet 'replace' was set to 'True'. As there is no source to replace the file with, 'replace' has been set to 'False' to avoid reading the file unnecessarily.
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] File /etc/keystone/policy.json exists with proper permissions. No changes made.
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Completed state [/etc/keystone/policy.json] at time 11:24:04.658002 duration_in_ms=1.543
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Running state [/etc/keystone/keystone-paste.ini] at time 11:24:04.658451
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Executing state file.managed for /etc/keystone/keystone-paste.ini
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'keystone/files/ocata/keystone-paste.ini.Debian'
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] File /etc/keystone/keystone-paste.ini is in the correct state
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Completed state [/etc/keystone/keystone-paste.ini] at time 11:24:04.677681 duration_in_ms=19.229
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Running state [/etc/apache2/sites-enabled/000-default.conf] at time 11:24:04.678009
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Executing state file.absent for /etc/apache2/sites-enabled/000-default.conf
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] File /etc/apache2/sites-enabled/000-default.conf is not present
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Completed state [/etc/apache2/sites-enabled/000-default.conf] at time 11:24:04.679013 duration_in_ms=1.003
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Running state [/etc/keystone/keystone.conf] at time 11:24:04.679491
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Executing state file.managed for /etc/keystone/keystone.conf
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'keystone/files/ocata/keystone.conf.Debian'
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'keystone/map.jinja'
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] File /etc/keystone/keystone.conf is in the correct state
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Completed state [/etc/keystone/keystone.conf] at time 11:24:04.795746 duration_in_ms=116.255
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Running state [/etc/apache2/sites-enabled/keystone.conf] at time 11:24:04.796067
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Executing state file.absent for /etc/apache2/sites-enabled/keystone.conf
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] File /etc/apache2/sites-enabled/keystone.conf is not present
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Completed state [/etc/apache2/sites-enabled/keystone.conf] at time 11:24:04.797079 duration_in_ms=1.011
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Running state [/etc/apache2/sites-enabled/wsgi-keystone.conf] at time 11:24:04.797401
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Executing state file.absent for /etc/apache2/sites-enabled/wsgi-keystone.conf
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] File /etc/apache2/sites-enabled/wsgi-keystone.conf is not present
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Completed state [/etc/apache2/sites-enabled/wsgi-keystone.conf] at time 11:24:04.798363 duration_in_ms=0.962
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Running state [/etc/apache2/sites-available/keystone_wsgi.conf] at time 11:24:04.798829
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Executing state file.managed for /etc/apache2/sites-available/keystone_wsgi.conf
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'keystone/files/apache.conf'
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'keystone/map.jinja'
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'keystone/files/ocata/wsgi-keystone.conf'
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'apache/files/_name.conf'
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'apache/map.jinja'
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'apache/files/_ssl.conf'
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'apache/files/_locations.conf'
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'apache/files/_log.conf'
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] File /etc/apache2/sites-available/keystone_wsgi.conf is in the correct state
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Completed state [/etc/apache2/sites-available/keystone_wsgi.conf] at time 11:24:04.996228 duration_in_ms=197.399
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Running state [/etc/keystone/logging.conf] at time 11:24:04.996763
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Executing state file.managed for /etc/keystone/logging.conf
Sep 28 11:24:04 ctl02 salt-minion[14967]: [WARNING ] State for file: /etc/keystone/logging.conf - Neither 'source' nor 'contents' nor 'contents_pillar' nor 'contents_grains' was defined, yet 'replace' was set to 'True'. As there is no source to replace the file with, 'replace' has been set to 'False' to avoid reading the file unnecessarily.
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] File /etc/keystone/logging.conf exists with proper permissions. No changes made.
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Completed state [/etc/keystone/logging.conf] at time 11:24:04.998453 duration_in_ms=1.689
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Running state [/etc/apache2/sites-enabled/keystone_wsgi.conf] at time 11:24:04.998935
Sep 28 11:24:04 ctl02 salt-minion[14967]: [INFO    ] Executing state file.symlink for /etc/apache2/sites-enabled/keystone_wsgi.conf
Sep 28 11:24:05 ctl02 salt-minion[14967]: [INFO    ] Symlink /etc/apache2/sites-enabled/keystone_wsgi.conf is present and owned by root:root
Sep 28 11:24:05 ctl02 salt-minion[14967]: [INFO    ] Completed state [/etc/apache2/sites-enabled/keystone_wsgi.conf] at time 11:24:05.000818 duration_in_ms=1.884
Sep 28 11:24:05 ctl02 salt-minion[14967]: [INFO    ] Running state [apache2] at time 11:24:05.003160
Sep 28 11:24:05 ctl02 salt-minion[14967]: [INFO    ] Executing state service.running for apache2
Sep 28 11:24:05 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'status', 'apache2.service', '-n', '0'] in directory '/root'
Sep 28 11:24:05 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-active', 'apache2.service'] in directory '/root'
Sep 28 11:24:05 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-enabled', 'apache2.service'] in directory '/root'
Sep 28 11:24:05 ctl02 salt-minion[14967]: [INFO    ] The service apache2 is already running
Sep 28 11:24:05 ctl02 salt-minion[14967]: [INFO    ] Completed state [apache2] at time 11:24:05.041949 duration_in_ms=38.788
Sep 28 11:24:05 ctl02 salt-minion[14967]: [INFO    ] Running state [/etc/apache2/conf-enabled/security.conf] at time 11:24:05.042519
Sep 28 11:24:05 ctl02 salt-minion[14967]: [INFO    ] Executing state file.symlink for /etc/apache2/conf-enabled/security.conf
Sep 28 11:24:05 ctl02 salt-minion[14967]: [INFO    ] Symlink /etc/apache2/conf-enabled/security.conf is present and owned by root:root
Sep 28 11:24:05 ctl02 salt-minion[14967]: [INFO    ] Completed state [/etc/apache2/conf-enabled/security.conf] at time 11:24:05.044081 duration_in_ms=1.562
Sep 28 11:24:05 ctl02 salt-minion[14967]: [INFO    ] Running state [/etc/apache2/sites-enabled/keystone_wsgi] at time 11:24:05.044319
Sep 28 11:24:05 ctl02 salt-minion[14967]: [INFO    ] Executing state file.absent for /etc/apache2/sites-enabled/keystone_wsgi
Sep 28 11:24:05 ctl02 salt-minion[14967]: [INFO    ] File /etc/apache2/sites-enabled/keystone_wsgi is not present
Sep 28 11:24:05 ctl02 salt-minion[14967]: [INFO    ] Completed state [/etc/apache2/sites-enabled/keystone_wsgi] at time 11:24:05.044890 duration_in_ms=0.571
Sep 28 11:24:05 ctl02 salt-minion[14967]: [INFO    ] Running state [keystone] at time 11:24:05.045263
Sep 28 11:24:05 ctl02 salt-minion[14967]: [INFO    ] Executing state service.dead for keystone
Sep 28 11:24:05 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'status', 'keystone.service', '-n', '0'] in directory '/root'
Sep 28 11:24:05 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-active', 'keystone.service'] in directory '/root'
Sep 28 11:24:05 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-enabled', 'keystone.service'] in directory '/root'
Sep 28 11:24:05 ctl02 salt-minion[14967]: [INFO    ] The service keystone is already dead
Sep 28 11:24:05 ctl02 salt-minion[14967]: [INFO    ] Completed state [keystone] at time 11:24:05.075308 duration_in_ms=30.044
Sep 28 11:24:05 ctl02 salt-minion[14967]: [INFO    ] Running state [/root/keystonerc] at time 11:24:05.075750
Sep 28 11:24:05 ctl02 salt-minion[14967]: [INFO    ] Executing state file.managed for /root/keystonerc
Sep 28 11:24:05 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'keystone/files/keystonerc'
Sep 28 11:24:05 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'keystone/map.jinja'
Sep 28 11:24:05 ctl02 salt-minion[14967]: [INFO    ] File /root/keystonerc is in the correct state
Sep 28 11:24:05 ctl02 salt-minion[14967]: [INFO    ] Completed state [/root/keystonerc] at time 11:24:05.145417 duration_in_ms=69.667
Sep 28 11:24:05 ctl02 salt-minion[14967]: [INFO    ] Running state [/root/keystonercv3] at time 11:24:05.145833
Sep 28 11:24:05 ctl02 salt-minion[14967]: [INFO    ] Executing state file.managed for /root/keystonercv3
Sep 28 11:24:05 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'keystone/files/keystonercv3'
Sep 28 11:24:05 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'keystone/map.jinja'
Sep 28 11:24:05 ctl02 salt-minion[14967]: [INFO    ] File /root/keystonercv3 is in the correct state
Sep 28 11:24:05 ctl02 salt-minion[14967]: [INFO    ] Completed state [/root/keystonercv3] at time 11:24:05.192616 duration_in_ms=46.783
Sep 28 11:24:05 ctl02 salt-minion[14967]: [INFO    ] Running state [keystone-manage db_sync && sleep 1] at time 11:24:05.192943
Sep 28 11:24:05 ctl02 salt-minion[14967]: [INFO    ] Executing state cmd.run for keystone-manage db_sync && sleep 1
Sep 28 11:24:05 ctl02 salt-minion[14967]: [INFO    ] Executing command 'keystone-manage db_sync && sleep 1' in directory '/root'
Sep 28 11:24:05 ctl02 salt-minion[14967]: [ERROR   ] Command 'keystone-manage db_sync && sleep 1' failed with return code: 1
Sep 28 11:24:05 ctl02 salt-minion[14967]: [ERROR   ] stderr: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:24:05 ctl02 salt-minion[14967]: 2017-09-28 11:24:05.699 2891 CRITICAL keystone [-] KeyError: <VerNum(109)>
Sep 28 11:24:05 ctl02 salt-minion[14967]: 2017-09-28 11:24:05.699 2891 ERROR keystone Traceback (most recent call last):
Sep 28 11:24:05 ctl02 salt-minion[14967]: 2017-09-28 11:24:05.699 2891 ERROR keystone   File "/usr/bin/keystone-manage", line 10, in <module>
Sep 28 11:24:05 ctl02 salt-minion[14967]: 2017-09-28 11:24:05.699 2891 ERROR keystone     sys.exit(main())
Sep 28 11:24:05 ctl02 salt-minion[14967]: 2017-09-28 11:24:05.699 2891 ERROR keystone   File "/usr/lib/python2.7/dist-packages/keystone/cmd/manage.py", line 47, in main
Sep 28 11:24:05 ctl02 salt-minion[14967]: 2017-09-28 11:24:05.699 2891 ERROR keystone     cli.main(argv=sys.argv, config_files=config_files)
Sep 28 11:24:05 ctl02 salt-minion[14967]: 2017-09-28 11:24:05.699 2891 ERROR keystone   File "/usr/lib/python2.7/dist-packages/keystone/cmd/cli.py", line 1048, in main
Sep 28 11:24:05 ctl02 salt-minion[14967]: 2017-09-28 11:24:05.699 2891 ERROR keystone     CONF.command.cmd_class.main()
Sep 28 11:24:05 ctl02 salt-minion[14967]: 2017-09-28 11:24:05.699 2891 ERROR keystone   File "/usr/lib/python2.7/dist-packages/keystone/cmd/cli.py", line 403, in main
Sep 28 11:24:05 ctl02 salt-minion[14967]: 2017-09-28 11:24:05.699 2891 ERROR keystone     migration_helpers.sync_database_to_version(extension, version)
Sep 28 11:24:05 ctl02 salt-minion[14967]: 2017-09-28 11:24:05.699 2891 ERROR keystone   File "/usr/lib/python2.7/dist-packages/keystone/common/sql/migration_helpers.py", line 210, in sync_database_to_version
Sep 28 11:24:05 ctl02 salt-minion[14967]: 2017-09-28 11:24:05.699 2891 ERROR keystone     _sync_common_repo(version)
Sep 28 11:24:05 ctl02 salt-minion[14967]: 2017-09-28 11:24:05.699 2891 ERROR keystone   File "/usr/lib/python2.7/dist-packages/keystone/common/sql/migration_helpers.py", line 136, in _sync_common_repo
Sep 28 11:24:05 ctl02 salt-minion[14967]: 2017-09-28 11:24:05.699 2891 ERROR keystone     init_version=init_version, sanity_check=False)
Sep 28 11:24:05 ctl02 salt-minion[14967]: 2017-09-28 11:24:05.699 2891 ERROR keystone   File "/usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/migration.py", line 79, in db_sync
Sep 28 11:24:05 ctl02 salt-minion[14967]: 2017-09-28 11:24:05.699 2891 ERROR keystone     migration = versioning_api.upgrade(engine, repository, version)
Sep 28 11:24:05 ctl02 salt-minion[14967]: 2017-09-28 11:24:05.699 2891 ERROR keystone   File "/usr/lib/python2.7/dist-packages/migrate/versioning/api.py", line 186, in upgrade
Sep 28 11:24:05 ctl02 salt-minion[14967]: 2017-09-28 11:24:05.699 2891 ERROR keystone     return _migrate(url, repository, version, upgrade=True, err=err, **opts)
Sep 28 11:24:05 ctl02 salt-minion[14967]: 2017-09-28 11:24:05.699 2891 ERROR keystone   File "<decorator-gen-15>", line 2, in _migrate
Sep 28 11:24:05 ctl02 salt-minion[14967]: 2017-09-28 11:24:05.699 2891 ERROR keystone   File "/usr/lib/python2.7/dist-packages/migrate/versioning/util/__init__.py", line 160, in with_engine
Sep 28 11:24:05 ctl02 salt-minion[14967]: 2017-09-28 11:24:05.699 2891 ERROR keystone     return f(*a, **kw)
Sep 28 11:24:05 ctl02 salt-minion[14967]: 2017-09-28 11:24:05.699 2891 ERROR keystone   File "/usr/lib/python2.7/dist-packages/migrate/versioning/api.py", line 345, in _migrate
Sep 28 11:24:05 ctl02 salt-minion[14967]: 2017-09-28 11:24:05.699 2891 ERROR keystone     changeset = schema.changeset(version)
Sep 28 11:24:05 ctl02 salt-minion[14967]: 2017-09-28 11:24:05.699 2891 ERROR keystone   File "/usr/lib/python2.7/dist-packages/migrate/versioning/schema.py", line 82, in changeset
Sep 28 11:24:05 ctl02 salt-minion[14967]: 2017-09-28 11:24:05.699 2891 ERROR keystone     changeset = self.repository.changeset(database, start_ver, version)
Sep 28 11:24:05 ctl02 salt-minion[14967]: 2017-09-28 11:24:05.699 2891 ERROR keystone   File "/usr/lib/python2.7/dist-packages/migrate/versioning/repository.py", line 225, in changeset
Sep 28 11:24:05 ctl02 salt-minion[14967]: 2017-09-28 11:24:05.699 2891 ERROR keystone     changes = [self.version(v).script(database, op) for v in versions]
Sep 28 11:24:05 ctl02 salt-minion[14967]: 2017-09-28 11:24:05.699 2891 ERROR keystone   File "/usr/lib/python2.7/dist-packages/migrate/versioning/repository.py", line 189, in version
Sep 28 11:24:05 ctl02 salt-minion[14967]: 2017-09-28 11:24:05.699 2891 ERROR keystone     return self.versions.version(*p, **k)
Sep 28 11:24:05 ctl02 salt-minion[14967]: 2017-09-28 11:24:05.699 2891 ERROR keystone   File "/usr/lib/python2.7/dist-packages/migrate/versioning/version.py", line 163, in version
Sep 28 11:24:05 ctl02 salt-minion[14967]: 2017-09-28 11:24:05.699 2891 ERROR keystone     return self.versions[VerNum(vernum)]
Sep 28 11:24:05 ctl02 salt-minion[14967]: 2017-09-28 11:24:05.699 2891 ERROR keystone KeyError: <VerNum(109)>
Sep 28 11:24:05 ctl02 salt-minion[14967]: 2017-09-28 11:24:05.699 2891 ERROR keystone
Sep 28 11:24:05 ctl02 salt-minion[14967]: [ERROR   ] retcode: 1
Sep 28 11:24:05 ctl02 salt-minion[14967]: [ERROR   ] {'pid': 2889, 'retcode': 1, 'stderr': 'Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.\n2017-09-28 11:24:05.699 2891 CRITICAL keystone [-] KeyError: <VerNum(109)>\n2017-09-28 11:24:05.699 2891 ERROR keystone Traceback (most recent call last):\n2017-09-28 11:24:05.699 2891 ERROR keystone   File "/usr/bin/keystone-manage", line 10, in <module>\n2017-09-28 11:24:05.699 2891 ERROR keystone     sys.exit(main())\n2017-09-28 11:24:05.699 2891 ERROR keystone   File "/usr/lib/python2.7/dist-packages/keystone/cmd/manage.py", line 47, in main\n2017-09-28 11:24:05.699 2891 ERROR keystone     cli.main(argv=sys.argv, config_files=config_files)\n2017-09-28 11:24:05.699 2891 ERROR keystone   File "/usr/lib/python2.7/dist-packages/keystone/cmd/cli.py", line 1048, in main\n2017-09-28 11:24:05.699 2891 ERROR keystone     CONF.command.cmd_class.main()\n2017-09-28 11:24:05.699 2891 ERROR keystone   File "/usr/lib/python2.7/dist-packages/keystone/cmd/cli.py", line 403, in main\n2017-09-28 11:24:05.699 2891 ERROR keystone     migration_helpers.sync_database_to_version(extension, version)\n2017-09-28 11:24:05.699 2891 ERROR keystone   File "/usr/lib/python2.7/dist-packages/keystone/common/sql/migration_helpers.py", line 210, in sync_database_to_version\n2017-09-28 11:24:05.699 2891 ERROR keystone     _sync_common_repo(version)\n2017-09-28 11:24:05.699 2891 ERROR keystone   File "/usr/lib/python2.7/dist-packages/keystone/common/sql/migration_helpers.py", line 136, in _sync_common_repo\n2017-09-28 11:24:05.699 2891 ERROR keystone     init_version=init_version, sanity_check=False)\n2017-09-28 11:24:05.699 2891 ERROR keystone   File "/usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/migration.py", line 79, in db_sync\n2017-09-28 11:24:05.699 2891 ERROR keystone     migration = versioning_api.upgrade(engine, repository, version)\n2017-09-28 11:24:05.699 2891 ERROR keystone   File "/usr/lib/python2.7/dist-packages/migrate/versioning/api.py", line 186, in upgrade\n
Sep 28 11:24:05 ctl02 salt-minion[14967]: 2017-09-28 11:24:05.699 2891 ERROR keystone     return _migrate(url, repository, version, upgrade=True, err=err, **opts)\n2017-09-28 11:24:05.699 2891 ERROR keystone   File "<decorator-gen-15>", line 2, in _migrate\n2017-09-28 11:24:05.699 2891 ERROR keystone   File "/usr/lib/python2.7/dist-packages/migrate/versioning/util/__init__.py", line 160, in with_engine\n2017-09-28 11:24:05.699 2891 ERROR keystone     return f(*a, **kw)\n2017-09-28 11:24:05.699 2891 ERROR keystone   File "/usr/lib/python2.7/dist-packages/migrate/versioning/api.py", line 345, in _migrate\n2017-09-28 11:24:05.699 2891 ERROR keystone     changeset = schema.changeset(version)\n2017-09-28 11:24:05.699 2891 ERROR keystone   File "/usr/lib/python2.7/dist-packages/migrate/versioning/schema.py", line 82, in changeset\n2017-09-28 11:24:05.699 2891 ERROR keystone     changeset = self.repository.changeset(database, start_ver, version)\n2017-09-28 11:24:05.699 2891 ERROR keystone   File "/usr/lib/python2.7/dist-packages/migrate/versioning/repository.py", line 225, in changeset\n2017-09-28 11:24:05.699 2891 ERROR keystone     changes = [self.version(v).script(database, op) for v in versions]\n2017-09-28 11:24:05.699 2891 ERROR keystone   File "/usr/lib/python2.7/dist-packages/migrate/versioning/repository.py", line 189, in version\n2017-09-28 11:24:05.699 2891 ERROR keystone     return self.versions.version(*p, **k)\n2017-09-28 11:24:05.699 2891 ERROR keystone   File "/usr/lib/python2.7/dist-packages/migrate/versioning/version.py", line 163, in version\n2017-09-28 11:24:05.699 2891 ERROR keystone     return self.versions[VerNum(vernum)]\n2017-09-28 11:24:05.699 2891 ERROR keystone KeyError: <VerNum(109)>\n2017-09-28 11:24:05.699 2891 ERROR keystone', 'stdout': ''}
Sep 28 11:24:05 ctl02 salt-minion[14967]: [INFO    ] Completed state [keystone-manage db_sync && sleep 1] at time 11:24:05.769576 duration_in_ms=576.631
Sep 28 11:24:05 ctl02 salt-minion[14967]: [INFO    ] Running state [/var/lib/keystone/fernet-keys] at time 11:24:05.770182
Sep 28 11:24:05 ctl02 salt-minion[14967]: [INFO    ] Executing state file.directory for /var/lib/keystone/fernet-keys
Sep 28 11:24:05 ctl02 salt-minion[14967]: [INFO    ] Directory /var/lib/keystone/fernet-keys is in the correct state
Sep 28 11:24:05 ctl02 salt-minion[14967]: [INFO    ] Completed state [/var/lib/keystone/fernet-keys] at time 11:24:05.772339 duration_in_ms=2.158
Sep 28 11:24:05 ctl02 salt-minion[14967]: [INFO    ] Running state [keystone-manage fernet_setup --keystone-user keystone --keystone-group keystone] at time 11:24:05.773055
Sep 28 11:24:05 ctl02 salt-minion[14967]: [INFO    ] Executing state cmd.run for keystone-manage fernet_setup --keystone-user keystone --keystone-group keystone
Sep 28 11:24:05 ctl02 salt-minion[14967]: [INFO    ] Executing command 'keystone-manage fernet_setup --keystone-user keystone --keystone-group keystone' in directory '/root'
Sep 28 11:24:06 ctl02 salt-minion[14967]: [INFO    ] {'pid': 2896, 'retcode': 0, 'stderr': 'Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.\n2017-09-28 11:24:06.250 2897 INFO keystone.token.providers.fernet.utils [-] Key repository is already initialized; aborting.', 'stdout': ''}
Sep 28 11:24:06 ctl02 salt-minion[14967]: [INFO    ] Completed state [keystone-manage fernet_setup --keystone-user keystone --keystone-group keystone] at time 11:24:06.308934 duration_in_ms=535.876
Sep 28 11:24:06 ctl02 salt-minion[14967]: [INFO    ] Running state [/var/lib/keystone/credential-keys] at time 11:24:06.309506
Sep 28 11:24:06 ctl02 salt-minion[14967]: [INFO    ] Executing state file.directory for /var/lib/keystone/credential-keys
Sep 28 11:24:06 ctl02 salt-minion[14967]: [INFO    ] Directory /var/lib/keystone/credential-keys is in the correct state
Sep 28 11:24:06 ctl02 salt-minion[14967]: [INFO    ] Completed state [/var/lib/keystone/credential-keys] at time 11:24:06.311991 duration_in_ms=2.485
Sep 28 11:24:06 ctl02 salt-minion[14967]: [INFO    ] Running state [keystone-manage credential_setup --keystone-user keystone --keystone-group keystone] at time 11:24:06.312835
Sep 28 11:24:06 ctl02 salt-minion[14967]: [INFO    ] Executing state cmd.run for keystone-manage credential_setup --keystone-user keystone --keystone-group keystone
Sep 28 11:24:06 ctl02 salt-minion[14967]: [INFO    ] Executing command 'keystone-manage credential_setup --keystone-user keystone --keystone-group keystone' in directory '/root'
Sep 28 11:24:06 ctl02 salt-minion[14967]: [ERROR   ] Command 'keystone-manage credential_setup --keystone-user keystone --keystone-group keystone' failed with return code: 2
Sep 28 11:24:06 ctl02 salt-minion[14967]: [ERROR   ] stderr: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:24:06 ctl02 salt-minion[14967]: usage: keystone-manage [bootstrap|db_sync|db_version|domain_config_upload|fernet_rotate|fernet_setup|mapping_purge|mapping_engine|pki_setup|saml_idp_metadata|ssl_setup|token_flush]
Sep 28 11:24:06 ctl02 salt-minion[14967]: keystone-manage: error: argument command: invalid choice: 'credential_setup' (choose from 'bootstrap', 'db_sync', 'db_version', 'domain_config_upload', 'fernet_rotate', 'fernet_setup', 'mapping_purge', 'mapping_engine', 'pki_setup', 'saml_idp_metadata', 'ssl_setup', 'token_flush')
Sep 28 11:24:06 ctl02 salt-minion[14967]: [ERROR   ] retcode: 2
Sep 28 11:24:06 ctl02 salt-minion[14967]: [ERROR   ] {'pid': 2902, 'retcode': 2, 'stderr': 'Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.\nusage: keystone-manage [bootstrap|db_sync|db_version|domain_config_upload|fernet_rotate|fernet_setup|mapping_purge|mapping_engine|pki_setup|saml_idp_metadata|ssl_setup|token_flush]\nkeystone-manage: error: argument command: invalid choice: \'credential_setup\' (choose from \'bootstrap\', \'db_sync\', \'db_version\', \'domain_config_upload\', \'fernet_rotate\', \'fernet_setup\', \'mapping_purge\', \'mapping_engine\', \'pki_setup\', \'saml_idp_metadata\', \'ssl_setup\', \'token_flush\')', 'stdout': ''}
Sep 28 11:24:06 ctl02 salt-minion[14967]: [INFO    ] Completed state [keystone-manage credential_setup --keystone-user keystone --keystone-group keystone] at time 11:24:06.786115 duration_in_ms=473.279
Sep 28 11:24:06 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928112400041286
Sep 28 11:24:09 ctl02 glance-api[29183]: 2017-09-28 11:24:09.056 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:24:09] "OPTIONS / HTTP/1.0" 200 134 0.000803
Sep 28 11:24:09 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command test.ping with jid 20170928112409173528
Sep 28 11:24:09 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 2912
Sep 28 11:24:09 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928112409173528
Sep 28 11:24:09 ctl02 glance-api[29183]: 2017-09-28 11:24:09.635 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:24:09] "OPTIONS / HTTP/1.0" 200 134 0.000691
Sep 28 11:24:09 ctl02 glance-api[29183]: 2017-09-28 11:24:09.964 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:24:09] "OPTIONS / HTTP/1.0" 200 134 0.000624
Sep 28 11:24:14 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xbe412100)
Sep 28 11:24:18 ctl02 dhclient[627]: message repeated 4 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xbe412100)]
Sep 28 11:24:19 ctl02 glance-api[29183]: 2017-09-28 11:24:19.415 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:24:19] "OPTIONS / HTTP/1.0" 200 134 0.000750
Sep 28 11:24:19 ctl02 glance-api[29183]: 2017-09-28 11:24:19.429 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:24:19] "OPTIONS / HTTP/1.0" 200 134 0.000580
Sep 28 11:24:19 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xbe412100)
Sep 28 11:24:19 ctl02 glance-api[29183]: 2017-09-28 11:24:19.956 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:24:19] "OPTIONS / HTTP/1.0" 200 134 0.000775
Sep 28 11:24:20 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xbe412100)
Sep 28 11:24:24 ctl02 dhclient[627]: message repeated 4 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xbe412100)]
Sep 28 11:24:25 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:24:25 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:24:29 ctl02 glance-api[29183]: 2017-09-28 11:24:29.064 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:24:29] "OPTIONS / HTTP/1.0" 200 134 0.000833
Sep 28 11:24:29 ctl02 glance-api[29183]: 2017-09-28 11:24:29.285 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:24:29] "OPTIONS / HTTP/1.0" 200 134 0.000660
Sep 28 11:24:29 ctl02 glance-api[29183]: 2017-09-28 11:24:29.767 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:24:29] "OPTIONS / HTTP/1.0" 200 134 0.000594
Sep 28 11:24:38 ctl02 glance-api[29183]: 2017-09-28 11:24:38.964 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:24:38] "OPTIONS / HTTP/1.0" 200 134 0.002749
Sep 28 11:24:39 ctl02 glance-api[29183]: 2017-09-28 11:24:39.386 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:24:39] "OPTIONS / HTTP/1.0" 200 134 0.000562
Sep 28 11:24:40 ctl02 glance-api[29183]: 2017-09-28 11:24:40.136 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:24:40] "OPTIONS / HTTP/1.0" 200 134 0.000817
Sep 28 11:24:43 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2d325d3a)
Sep 28 11:24:47 ctl02 dhclient[627]: message repeated 4 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2d325d3a)]
Sep 28 11:24:48 ctl02 glance-api[29183]: 2017-09-28 11:24:48.622 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:24:48] "OPTIONS / HTTP/1.0" 200 134 0.000754
Sep 28 11:24:48 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2d325d3a)
Sep 28 11:24:49 ctl02 glance-api[29183]: 2017-09-28 11:24:49.353 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:24:49] "OPTIONS / HTTP/1.0" 200 134 0.000516
Sep 28 11:24:49 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2d325d3a)
Sep 28 11:24:50 ctl02 glance-api[29183]: 2017-09-28 11:24:50.221 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:24:50] "OPTIONS / HTTP/1.0" 200 134 0.000731
Sep 28 11:24:50 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2d325d3a)
Sep 28 11:24:53 ctl02 dhclient[627]: message repeated 3 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2d325d3a)]
Sep 28 11:24:54 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:24:54 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:24:58 ctl02 glance-api[29183]: 2017-09-28 11:24:58.271 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:24:58] "OPTIONS / HTTP/1.0" 200 134 0.000814
Sep 28 11:24:59 ctl02 glance-api[29183]: 2017-09-28 11:24:59.503 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:24:59] "OPTIONS / HTTP/1.0" 200 134 0.000835
Sep 28 11:25:00 ctl02 glance-api[29183]: 2017-09-28 11:25:00.411 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:25:00] "OPTIONS / HTTP/1.0" 200 134 0.000780
Sep 28 11:25:03 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x567eff0e)
Sep 28 11:25:07 ctl02 dhclient[627]: message repeated 4 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x567eff0e)]
Sep 28 11:25:08 ctl02 glance-api[29183]: 2017-09-28 11:25:08.116 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:25:08] "OPTIONS / HTTP/1.0" 200 134 0.000863
Sep 28 11:25:08 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x567eff0e)
Sep 28 11:25:09 ctl02 glance-api[29183]: 2017-09-28 11:25:09.554 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:25:09] "OPTIONS / HTTP/1.0" 200 134 0.000778
Sep 28 11:25:09 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x567eff0e)
Sep 28 11:25:10 ctl02 glance-api[29183]: 2017-09-28 11:25:10.049 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:25:10] "OPTIONS / HTTP/1.0" 200 134 0.000790
Sep 28 11:25:10 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x567eff0e)
Sep 28 11:25:13 ctl02 dhclient[627]: message repeated 3 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x567eff0e)]
Sep 28 11:25:14 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:25:14 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:25:17 ctl02 glance-api[29183]: 2017-09-28 11:25:17.966 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:25:17] "OPTIONS / HTTP/1.0" 200 134 0.000835
Sep 28 11:25:19 ctl02 glance-api[29183]: 2017-09-28 11:25:19.681 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:25:19] "OPTIONS / HTTP/1.0" 200 134 0.000800
Sep 28 11:25:19 ctl02 glance-api[29183]: 2017-09-28 11:25:19.991 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:25:19] "OPTIONS / HTTP/1.0" 200 134 0.000764
Sep 28 11:25:27 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3ce0a72d)
Sep 28 11:25:28 ctl02 glance-api[29183]: 2017-09-28 11:25:28.274 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:25:28] "OPTIONS / HTTP/1.0" 200 134 0.000778
Sep 28 11:25:28 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3ce0a72d)
Sep 28 11:25:29 ctl02 glance-api[29183]: 2017-09-28 11:25:29.629 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:25:29] "OPTIONS / HTTP/1.0" 200 134 0.000748
Sep 28 11:25:29 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3ce0a72d)
Sep 28 11:25:30 ctl02 glance-api[29183]: 2017-09-28 11:25:30.341 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:25:30] "OPTIONS / HTTP/1.0" 200 134 0.000964
Sep 28 11:25:30 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3ce0a72d)
Sep 28 11:25:37 ctl02 dhclient[627]: message repeated 7 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3ce0a72d)]
Sep 28 11:25:38 ctl02 glance-api[29183]: 2017-09-28 11:25:38.039 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:25:38] "OPTIONS / HTTP/1.0" 200 134 0.000747
Sep 28 11:25:38 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:25:38 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:25:39 ctl02 glance-api[29183]: 2017-09-28 11:25:39.749 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:25:39] "OPTIONS / HTTP/1.0" 200 134 0.000822
Sep 28 11:25:40 ctl02 glance-api[29183]: 2017-09-28 11:25:40.532 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:25:40] "OPTIONS / HTTP/1.0" 200 134 0.000892
Sep 28 11:25:47 ctl02 glance-api[29183]: 2017-09-28 11:25:47.715 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:25:47] "OPTIONS / HTTP/1.0" 200 134 0.000786
Sep 28 11:25:49 ctl02 glance-api[29183]: 2017-09-28 11:25:49.376 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:25:49] "OPTIONS / HTTP/1.0" 200 134 0.000726
Sep 28 11:25:50 ctl02 glance-api[29183]: 2017-09-28 11:25:50.532 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:25:50] "OPTIONS / HTTP/1.0" 200 134 0.000891
Sep 28 11:25:54 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc116a462)
Sep 28 11:25:57 ctl02 dhclient[627]: message repeated 3 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc116a462)]
Sep 28 11:25:58 ctl02 glance-api[29183]: 2017-09-28 11:25:58.064 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:25:58] "OPTIONS / HTTP/1.0" 200 134 0.000791
Sep 28 11:25:58 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc116a462)
Sep 28 11:25:59 ctl02 glance-api[29183]: 2017-09-28 11:25:59.261 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:25:59] "OPTIONS / HTTP/1.0" 200 134 0.000823
Sep 28 11:25:59 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc116a462)
Sep 28 11:26:00 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc116a462)
Sep 28 11:26:00 ctl02 glance-api[29183]: 2017-09-28 11:26:00.731 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:26:00] "OPTIONS / HTTP/1.0" 200 134 0.000822
Sep 28 11:26:01 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc116a462)
Sep 28 11:26:04 ctl02 dhclient[627]: message repeated 3 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc116a462)]
Sep 28 11:26:05 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:26:05 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:26:07 ctl02 glance-api[29183]: 2017-09-28 11:26:07.834 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:26:07] "OPTIONS / HTTP/1.0" 200 134 0.000787
Sep 28 11:26:09 ctl02 glance-api[29183]: 2017-09-28 11:26:09.039 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:26:09] "OPTIONS / HTTP/1.0" 200 134 0.000748
Sep 28 11:26:10 ctl02 glance-api[29183]: 2017-09-28 11:26:10.640 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:26:10] "OPTIONS / HTTP/1.0" 200 134 0.000923
Sep 28 11:26:17 ctl02 glance-api[29183]: 2017-09-28 11:26:17.941 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:26:17] "OPTIONS / HTTP/1.0" 200 134 0.000788
Sep 28 11:26:18 ctl02 glance-api[29183]: 2017-09-28 11:26:18.877 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:26:18] "OPTIONS / HTTP/1.0" 200 134 0.000650
Sep 28 11:26:19 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc1a71833)
Sep 28 11:26:20 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc1a71833)
Sep 28 11:26:20 ctl02 glance-api[29183]: 2017-09-28 11:26:20.391 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:26:20] "OPTIONS / HTTP/1.0" 200 134 0.000814
Sep 28 11:26:21 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc1a71833)
Sep 28 11:26:26 ctl02 dhclient[627]: message repeated 5 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc1a71833)]
Sep 28 11:26:27 ctl02 dhclient[600]: DHCPREQUEST of 192.168.11.25 on ens2 to 192.168.11.3 port 67 (xid=0x3415f07)
Sep 28 11:26:27 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc1a71833)
Sep 28 11:26:27 ctl02 dhclient[600]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 11:26:27 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 11:26:27 ctl02 ntp[2995]:  * Stopping NTP server ntpd
Sep 28 11:26:27 ctl02 ntp[2995]:    ...done.
Sep 28 11:26:27 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 11:26:27 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 11:26:27 ctl02 ntp[3006]:  * Starting NTP server ntpd
Sep 28 11:26:27 ctl02 ntpd[3013]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 11:26:27 ctl02 ntpd[3013]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -c /var/lib/ntp/ntp.conf.dhcp -u 108:112
Sep 28 11:26:27 ctl02 ntp[3006]:    ...done.
Sep 28 11:26:27 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 11:26:27 ctl02 ntpd[3016]: proto: precision = 0.042 usec (-24)
Sep 28 11:26:27 ctl02 ntpd[3016]: switching logging to file /var/log/ntp.log
Sep 28 11:26:27 ctl02 dhclient[600]: bound to 192.168.11.25 -- renewal in 294 seconds.
Sep 28 11:26:27 ctl02 glance-api[29183]: 2017-09-28 11:26:27.938 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:26:27] "OPTIONS / HTTP/1.0" 200 134 0.000818
Sep 28 11:26:28 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc1a71833)
Sep 28 11:26:29 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc1a71833)
Sep 28 11:26:29 ctl02 glance-api[29183]: 2017-09-28 11:26:29.151 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:26:29] "OPTIONS / HTTP/1.0" 200 134 0.000825
Sep 28 11:26:30 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:26:30 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:26:30 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 11:26:30 ctl02 ntp[3069]:  * Stopping NTP server ntpd
Sep 28 11:26:30 ctl02 ntp[3069]:    ...done.
Sep 28 11:26:30 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 11:26:30 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 11:26:30 ctl02 ntp[3080]:  * Starting NTP server ntpd
Sep 28 11:26:30 ctl02 ntpd[3087]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 11:26:30 ctl02 ntpd[3087]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 11:26:30 ctl02 ntp[3080]:    ...done.
Sep 28 11:26:30 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 11:26:30 ctl02 ntpd[3090]: proto: precision = 0.047 usec (-24)
Sep 28 11:26:30 ctl02 ntpd[3090]: switching logging to file /var/log/ntp.log
Sep 28 11:26:30 ctl02 glance-api[29183]: 2017-09-28 11:26:30.555 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:26:30] "OPTIONS / HTTP/1.0" 200 134 0.000849
Sep 28 11:26:37 ctl02 glance-api[29183]: 2017-09-28 11:26:37.655 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:26:37] "OPTIONS / HTTP/1.0" 200 134 0.000846
Sep 28 11:26:39 ctl02 glance-api[29183]: 2017-09-28 11:26:39.496 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:26:39] "OPTIONS / HTTP/1.0" 200 134 0.000785
Sep 28 11:26:40 ctl02 glance-api[29183]: 2017-09-28 11:26:40.350 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:26:40] "OPTIONS / HTTP/1.0" 200 134 0.000637
Sep 28 11:26:41 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x87c2c163)
Sep 28 11:26:47 ctl02 dhclient[627]: message repeated 6 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x87c2c163)]
Sep 28 11:26:47 ctl02 glance-api[29183]: 2017-09-28 11:26:47.401 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:26:47] "OPTIONS / HTTP/1.0" 200 134 0.000932
Sep 28 11:26:48 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x87c2c163)
Sep 28 11:26:49 ctl02 glance-api[29183]: 2017-09-28 11:26:49.103 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:26:49] "OPTIONS / HTTP/1.0" 200 134 0.000834
Sep 28 11:26:49 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x87c2c163)
Sep 28 11:26:50 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x87c2c163)
Sep 28 11:26:50 ctl02 glance-api[29183]: 2017-09-28 11:26:50.669 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:26:50] "OPTIONS / HTTP/1.0" 200 134 0.000836
Sep 28 11:26:51 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x87c2c163)
Sep 28 11:26:52 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:26:52 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:26:57 ctl02 glance-api[29183]: 2017-09-28 11:26:57.730 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:26:57] "OPTIONS / HTTP/1.0" 200 134 0.000824
Sep 28 11:26:59 ctl02 glance-api[29183]: 2017-09-28 11:26:59.153 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:26:59] "OPTIONS / HTTP/1.0" 200 134 0.000853
Sep 28 11:27:00 ctl02 glance-api[29183]: 2017-09-28 11:27:00.583 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:27:00] "OPTIONS / HTTP/1.0" 200 134 0.000897
Sep 28 11:27:03 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6120d771)
Sep 28 11:27:06 ctl02 dhclient[627]: message repeated 3 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6120d771)]
Sep 28 11:27:07 ctl02 glance-api[29183]: 2017-09-28 11:27:07.488 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:27:07] "OPTIONS / HTTP/1.0" 200 134 0.000840
Sep 28 11:27:07 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6120d771)
Sep 28 11:27:08 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6120d771)
Sep 28 11:27:09 ctl02 glance-api[29183]: 2017-09-28 11:27:09.094 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:27:09] "OPTIONS / HTTP/1.0" 200 134 0.000812
Sep 28 11:27:09 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6120d771)
Sep 28 11:27:10 ctl02 glance-api[29183]: 2017-09-28 11:27:10.429 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:27:10] "OPTIONS / HTTP/1.0" 200 134 0.000853
Sep 28 11:27:10 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6120d771)
Sep 28 11:27:13 ctl02 dhclient[627]: message repeated 3 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6120d771)]
Sep 28 11:27:14 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:27:14 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:27:17 ctl02 glance-api[29183]: 2017-09-28 11:27:17.193 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:27:17] "OPTIONS / HTTP/1.0" 200 134 0.000894
Sep 28 11:27:19 ctl02 glance-api[29183]: 2017-09-28 11:27:19.383 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:27:19] "OPTIONS / HTTP/1.0" 200 134 0.000793
Sep 28 11:27:20 ctl02 glance-api[29183]: 2017-09-28 11:27:20.794 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:27:20] "OPTIONS / HTTP/1.0" 200 134 0.000779
Sep 28 11:27:27 ctl02 glance-api[29183]: 2017-09-28 11:27:27.275 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:27:27] "OPTIONS / HTTP/1.0" 200 134 0.000843
Sep 28 11:27:29 ctl02 glance-api[29183]: 2017-09-28 11:27:29.512 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:27:29] "OPTIONS / HTTP/1.0" 200 134 0.000837
Sep 28 11:27:30 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf3bd386a)
Sep 28 11:27:30 ctl02 glance-api[29183]: 2017-09-28 11:27:30.748 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:27:30] "OPTIONS / HTTP/1.0" 200 134 0.000873
Sep 28 11:27:31 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf3bd386a)
Sep 28 11:27:37 ctl02 dhclient[627]: message repeated 6 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf3bd386a)]
Sep 28 11:27:37 ctl02 glance-api[29183]: 2017-09-28 11:27:37.409 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:27:37] "OPTIONS / HTTP/1.0" 200 134 0.000814
Sep 28 11:27:38 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf3bd386a)
Sep 28 11:27:39 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf3bd386a)
Sep 28 11:27:39 ctl02 glance-api[29183]: 2017-09-28 11:27:39.278 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:27:39] "OPTIONS / HTTP/1.0" 200 134 0.000783
Sep 28 11:27:40 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf3bd386a)
Sep 28 11:27:40 ctl02 glance-api[29183]: 2017-09-28 11:27:40.486 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:27:40] "OPTIONS / HTTP/1.0" 200 134 0.000811
Sep 28 11:27:41 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:27:41 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:27:47 ctl02 glance-api[29183]: 2017-09-28 11:27:47.305 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:27:47] "OPTIONS / HTTP/1.0" 200 134 0.000733
Sep 28 11:27:49 ctl02 glance-api[29183]: 2017-09-28 11:27:49.249 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:27:49] "OPTIONS / HTTP/1.0" 200 134 0.000813
Sep 28 11:27:50 ctl02 glance-api[29183]: 2017-09-28 11:27:50.197 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:27:50] "OPTIONS / HTTP/1.0" 200 134 0.000882
Sep 28 11:27:57 ctl02 glance-api[29183]: 2017-09-28 11:27:57.630 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:27:57] "OPTIONS / HTTP/1.0" 200 134 0.000833
Sep 28 11:27:59 ctl02 glance-api[29183]: 2017-09-28 11:27:59.488 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:27:59] "OPTIONS / HTTP/1.0" 200 134 0.000898
Sep 28 11:28:00 ctl02 glance-api[29183]: 2017-09-28 11:28:00.036 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:28:00] "OPTIONS / HTTP/1.0" 200 134 0.000765
Sep 28 11:28:02 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd8933912)
Sep 28 11:28:07 ctl02 dhclient[627]: message repeated 5 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd8933912)]
Sep 28 11:28:07 ctl02 glance-api[29183]: 2017-09-28 11:28:07.735 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:28:07] "OPTIONS / HTTP/1.0" 200 134 0.000879
Sep 28 11:28:08 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd8933912)
Sep 28 11:28:09 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd8933912)
Sep 28 11:28:09 ctl02 glance-api[29183]: 2017-09-28 11:28:09.815 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:28:09] "OPTIONS / HTTP/1.0" 200 134 0.000775
Sep 28 11:28:10 ctl02 glance-api[29183]: 2017-09-28 11:28:10.059 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:28:10] "OPTIONS / HTTP/1.0" 200 134 0.000735
Sep 28 11:28:10 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd8933912)
Sep 28 11:28:12 ctl02 dhclient[627]: message repeated 2 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd8933912)]
Sep 28 11:28:13 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:28:13 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:28:17 ctl02 glance-api[29183]: 2017-09-28 11:28:17.658 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:28:17] "OPTIONS / HTTP/1.0" 200 134 0.000843
Sep 28 11:28:19 ctl02 glance-api[29183]: 2017-09-28 11:28:19.429 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:28:19] "OPTIONS / HTTP/1.0" 200 134 0.000682
Sep 28 11:28:19 ctl02 glance-api[29183]: 2017-09-28 11:28:19.814 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:28:19] "OPTIONS / HTTP/1.0" 200 134 0.000600
Sep 28 11:28:28 ctl02 glance-api[29183]: 2017-09-28 11:28:28.048 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:28:28] "OPTIONS / HTTP/1.0" 200 134 0.000898
Sep 28 11:28:29 ctl02 glance-api[29183]: 2017-09-28 11:28:29.226 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:28:29] "OPTIONS / HTTP/1.0" 200 134 0.000789
Sep 28 11:28:29 ctl02 glance-api[29183]: 2017-09-28 11:28:29.624 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:28:29] "OPTIONS / HTTP/1.0" 200 134 0.000670
Sep 28 11:28:34 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x11b9d424)
Sep 28 11:28:37 ctl02 dhclient[627]: message repeated 3 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x11b9d424)]
Sep 28 11:28:37 ctl02 glance-api[29183]: 2017-09-28 11:28:37.945 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:28:37] "OPTIONS / HTTP/1.0" 200 134 0.000823
Sep 28 11:28:38 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x11b9d424)
Sep 28 11:28:39 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x11b9d424)
Sep 28 11:28:39 ctl02 glance-api[29183]: 2017-09-28 11:28:39.453 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:28:39] "OPTIONS / HTTP/1.0" 200 134 0.000913
Sep 28 11:28:39 ctl02 glance-api[29183]: 2017-09-28 11:28:39.792 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:28:39] "OPTIONS / HTTP/1.0" 200 134 0.000810
Sep 28 11:28:40 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x11b9d424)
Sep 28 11:28:44 ctl02 dhclient[627]: message repeated 4 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x11b9d424)]
Sep 28 11:28:45 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:28:45 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:28:48 ctl02 glance-api[29183]: 2017-09-28 11:28:48.280 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:28:48] "OPTIONS / HTTP/1.0" 200 134 0.000912
Sep 28 11:28:49 ctl02 glance-api[29183]: 2017-09-28 11:28:49.479 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:28:49] "OPTIONS / HTTP/1.0" 200 134 0.000831
Sep 28 11:28:49 ctl02 glance-api[29183]: 2017-09-28 11:28:49.602 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:28:49] "OPTIONS / HTTP/1.0" 200 134 0.000709
Sep 28 11:28:57 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd82ced39)
Sep 28 11:28:58 ctl02 glance-api[29183]: 2017-09-28 11:28:58.406 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:28:58] "OPTIONS / HTTP/1.0" 200 134 0.000790
Sep 28 11:28:58 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd82ced39)
Sep 28 11:28:59 ctl02 glance-api[29183]: 2017-09-28 11:28:59.270 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:28:59] "OPTIONS / HTTP/1.0" 200 134 0.000624
Sep 28 11:28:59 ctl02 glance-api[29183]: 2017-09-28 11:28:59.703 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:28:59] "OPTIONS / HTTP/1.0" 200 134 0.000790
Sep 28 11:28:59 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd82ced39)
Sep 28 11:29:07 ctl02 dhclient[627]: message repeated 8 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd82ced39)]
Sep 28 11:29:08 ctl02 glance-api[29183]: 2017-09-28 11:29:08.574 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:29:08] "OPTIONS / HTTP/1.0" 200 134 0.000833
Sep 28 11:29:08 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:29:08 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:29:09 ctl02 glance-api[29183]: 2017-09-28 11:29:09.387 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:29:09] "OPTIONS / HTTP/1.0" 200 134 0.000802
Sep 28 11:29:09 ctl02 glance-api[29183]: 2017-09-28 11:29:09.565 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:29:09] "OPTIONS / HTTP/1.0" 200 134 0.000821
Sep 28 11:29:18 ctl02 glance-api[29183]: 2017-09-28 11:29:18.497 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:29:18] "OPTIONS / HTTP/1.0" 200 134 0.001137
Sep 28 11:29:19 ctl02 glance-api[29183]: 2017-09-28 11:29:19.099 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:29:19] "OPTIONS / HTTP/1.0" 200 134 0.000792
Sep 28 11:29:19 ctl02 glance-api[29183]: 2017-09-28 11:29:19.462 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:29:19] "OPTIONS / HTTP/1.0" 200 134 0.000754
Sep 28 11:29:28 ctl02 glance-api[29183]: 2017-09-28 11:29:28.461 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:29:28] "OPTIONS / HTTP/1.0" 200 134 0.000792
Sep 28 11:29:28 ctl02 glance-api[29183]: 2017-09-28 11:29:28.780 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:29:28] "OPTIONS / HTTP/1.0" 200 134 0.000711
Sep 28 11:29:29 ctl02 glance-api[29183]: 2017-09-28 11:29:29.261 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:29:29] "OPTIONS / HTTP/1.0" 200 134 0.000754
Sep 28 11:29:30 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x533b7523)
Sep 28 11:29:37 ctl02 dhclient[627]: message repeated 7 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x533b7523)]
Sep 28 11:29:38 ctl02 glance-api[29183]: 2017-09-28 11:29:38.225 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:29:38] "OPTIONS / HTTP/1.0" 200 134 0.000852
Sep 28 11:29:38 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x533b7523)
Sep 28 11:29:38 ctl02 glance-api[29183]: 2017-09-28 11:29:38.983 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:29:38] "OPTIONS / HTTP/1.0" 200 134 0.000661
Sep 28 11:29:39 ctl02 glance-api[29183]: 2017-09-28 11:29:39.109 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:29:39] "OPTIONS / HTTP/1.0" 200 134 0.000540
Sep 28 11:29:39 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x533b7523)
Sep 28 11:29:40 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x533b7523)
Sep 28 11:29:41 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:29:41 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:29:48 ctl02 glance-api[29183]: 2017-09-28 11:29:48.415 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:29:48] "OPTIONS / HTTP/1.0" 200 134 0.000828
Sep 28 11:29:48 ctl02 glance-api[29183]: 2017-09-28 11:29:48.826 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:29:48] "OPTIONS / HTTP/1.0" 200 134 0.000651
Sep 28 11:29:49 ctl02 glance-api[29183]: 2017-09-28 11:29:49.031 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:29:49] "OPTIONS / HTTP/1.0" 200 134 0.000504
Sep 28 11:29:58 ctl02 glance-api[29183]: 2017-09-28 11:29:58.235 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:29:58] "OPTIONS / HTTP/1.0" 200 134 0.000853
Sep 28 11:29:58 ctl02 glance-api[29183]: 2017-09-28 11:29:58.664 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:29:58] "OPTIONS / HTTP/1.0" 200 134 0.000590
Sep 28 11:29:58 ctl02 glance-api[29183]: 2017-09-28 11:29:58.727 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:29:58] "OPTIONS / HTTP/1.0" 200 134 0.000504
Sep 28 11:30:02 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x36140117)
Sep 28 11:30:07 ctl02 dhclient[627]: message repeated 5 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x36140117)]
Sep 28 11:30:08 ctl02 glance-api[29183]: 2017-09-28 11:30:08.305 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:30:08] "OPTIONS / HTTP/1.0" 200 134 0.001290
Sep 28 11:30:08 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x36140117)
Sep 28 11:30:08 ctl02 glance-api[29183]: 2017-09-28 11:30:08.809 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:30:08] "OPTIONS / HTTP/1.0" 200 134 0.000809
Sep 28 11:30:08 ctl02 glance-api[29183]: 2017-09-28 11:30:08.963 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:30:08] "OPTIONS / HTTP/1.0" 200 134 0.000711
Sep 28 11:30:09 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x36140117)
Sep 28 11:30:12 ctl02 dhclient[627]: message repeated 3 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x36140117)]
Sep 28 11:30:13 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:30:13 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:30:18 ctl02 glance-api[29183]: 2017-09-28 11:30:18.386 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:30:18] "OPTIONS / HTTP/1.0" 200 134 0.000819
Sep 28 11:30:18 ctl02 glance-api[29183]: 2017-09-28 11:30:18.580 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:30:18] "OPTIONS / HTTP/1.0" 200 134 0.000535
Sep 28 11:30:18 ctl02 glance-api[29183]: 2017-09-28 11:30:18.830 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:30:18] "OPTIONS / HTTP/1.0" 200 134 0.000815
Sep 28 11:30:25 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x24324e1b)
Sep 28 11:30:27 ctl02 dhclient[627]: message repeated 2 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x24324e1b)]
Sep 28 11:30:28 ctl02 glance-api[29183]: 2017-09-28 11:30:28.432 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:30:28] "OPTIONS / HTTP/1.0" 200 134 0.000902
Sep 28 11:30:28 ctl02 glance-api[29183]: 2017-09-28 11:30:28.589 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:30:28] "OPTIONS / HTTP/1.0" 200 134 0.000697
Sep 28 11:30:28 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x24324e1b)
Sep 28 11:30:28 ctl02 glance-api[29183]: 2017-09-28 11:30:28.902 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:30:28] "OPTIONS / HTTP/1.0" 200 134 0.001051
Sep 28 11:30:29 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x24324e1b)
Sep 28 11:30:35 ctl02 dhclient[627]: message repeated 6 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x24324e1b)]
Sep 28 11:30:36 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:30:36 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:30:38 ctl02 glance-api[29183]: 2017-09-28 11:30:38.137 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:30:38] "OPTIONS / HTTP/1.0" 200 134 0.000754
Sep 28 11:30:38 ctl02 glance-api[29183]: 2017-09-28 11:30:38.388 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:30:38] "OPTIONS / HTTP/1.0" 200 134 0.000844
Sep 28 11:30:38 ctl02 glance-api[29183]: 2017-09-28 11:30:38.980 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:30:38] "OPTIONS / HTTP/1.0" 200 134 0.000618
Sep 28 11:30:48 ctl02 glance-api[29183]: 2017-09-28 11:30:48.120 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:30:48] "OPTIONS / HTTP/1.0" 200 134 0.000821
Sep 28 11:30:48 ctl02 glance-api[29183]: 2017-09-28 11:30:48.370 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:30:48] "OPTIONS / HTTP/1.0" 200 134 0.000539
Sep 28 11:30:48 ctl02 glance-api[29183]: 2017-09-28 11:30:48.803 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:30:48] "OPTIONS / HTTP/1.0" 200 134 0.000678
Sep 28 11:30:54 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x58142e26)
Sep 28 11:30:57 ctl02 dhclient[627]: message repeated 3 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x58142e26)]
Sep 28 11:30:58 ctl02 glance-api[29183]: 2017-09-28 11:30:58.127 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:30:58] "OPTIONS / HTTP/1.0" 200 134 0.000820
Sep 28 11:30:58 ctl02 glance-api[29183]: 2017-09-28 11:30:58.177 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:30:58] "OPTIONS / HTTP/1.0" 200 134 0.000678
Sep 28 11:30:58 ctl02 glance-api[29183]: 2017-09-28 11:30:58.783 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:30:58] "OPTIONS / HTTP/1.0" 200 134 0.000681
Sep 28 11:30:58 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x58142e26)
Sep 28 11:31:04 ctl02 dhclient[627]: message repeated 6 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x58142e26)]
Sep 28 11:31:05 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:31:05 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:31:07 ctl02 glance-api[29183]: 2017-09-28 11:31:07.909 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:31:07] "OPTIONS / HTTP/1.0" 200 134 0.000880
Sep 28 11:31:07 ctl02 glance-api[29183]: 2017-09-28 11:31:07.947 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:31:07] "OPTIONS / HTTP/1.0" 200 134 0.000511
Sep 28 11:31:08 ctl02 glance-api[29183]: 2017-09-28 11:31:08.845 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:31:08] "OPTIONS / HTTP/1.0" 200 134 0.000796
Sep 28 11:31:13 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xae65dc47)
Sep 28 11:31:17 ctl02 dhclient[627]: message repeated 4 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xae65dc47)]
Sep 28 11:31:18 ctl02 glance-api[29183]: 2017-09-28 11:31:18.231 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:31:18] "OPTIONS / HTTP/1.0" 200 134 0.000761
Sep 28 11:31:18 ctl02 glance-api[29183]: 2017-09-28 11:31:18.251 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:31:18] "OPTIONS / HTTP/1.0" 200 134 0.000490
Sep 28 11:31:18 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xae65dc47)
Sep 28 11:31:18 ctl02 glance-api[29183]: 2017-09-28 11:31:18.500 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:31:18] "OPTIONS / HTTP/1.0" 200 134 0.000456
Sep 28 11:31:19 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xae65dc47)
Sep 28 11:31:21 ctl02 dhclient[627]: message repeated 2 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xae65dc47)]
Sep 28 11:31:21 ctl02 dhclient[600]: DHCPREQUEST of 192.168.11.25 on ens2 to 192.168.11.3 port 67 (xid=0x3415f07)
Sep 28 11:31:22 ctl02 dhclient[600]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 11:31:22 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 11:31:22 ctl02 ntp[3200]:  * Stopping NTP server ntpd
Sep 28 11:31:22 ctl02 ntp[3200]:    ...done.
Sep 28 11:31:22 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 11:31:22 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 11:31:22 ctl02 ntp[3211]:  * Starting NTP server ntpd
Sep 28 11:31:22 ctl02 ntpd[3218]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 11:31:22 ctl02 ntpd[3218]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -c /var/lib/ntp/ntp.conf.dhcp -u 108:112
Sep 28 11:31:22 ctl02 ntp[3211]:    ...done.
Sep 28 11:31:22 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 11:31:22 ctl02 ntpd[3221]: proto: precision = 0.042 usec (-24)
Sep 28 11:31:22 ctl02 ntpd[3221]: switching logging to file /var/log/ntp.log
Sep 28 11:31:22 ctl02 dhclient[600]: bound to 192.168.11.25 -- renewal in 260 seconds.
Sep 28 11:31:22 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xae65dc47)
Sep 28 11:31:23 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xae65dc47)
Sep 28 11:31:24 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:31:24 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:31:24 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 11:31:24 ctl02 ntp[3273]:  * Stopping NTP server ntpd
Sep 28 11:31:24 ctl02 ntp[3273]:    ...done.
Sep 28 11:31:24 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 11:31:24 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 11:31:24 ctl02 ntp[3283]:  * Starting NTP server ntpd
Sep 28 11:31:24 ctl02 ntpd[3291]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 11:31:24 ctl02 ntpd[3291]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 11:31:24 ctl02 ntp[3283]:    ...done.
Sep 28 11:31:24 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 11:31:24 ctl02 ntpd[3294]: proto: precision = 0.042 usec (-24)
Sep 28 11:31:24 ctl02 ntpd[3294]: switching logging to file /var/log/ntp.log
Sep 28 11:31:27 ctl02 glance-api[29183]: 2017-09-28 11:31:27.847 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:31:27] "OPTIONS / HTTP/1.0" 200 134 0.000809
Sep 28 11:31:28 ctl02 glance-api[29183]: 2017-09-28 11:31:28.214 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:31:28] "OPTIONS / HTTP/1.0" 200 134 0.000801
Sep 28 11:31:28 ctl02 glance-api[29183]: 2017-09-28 11:31:28.776 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:31:28] "OPTIONS / HTTP/1.0" 200 134 0.000793
Sep 28 11:31:33 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4a6a2109)
Sep 28 11:31:36 ctl02 dhclient[627]: message repeated 3 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4a6a2109)]
Sep 28 11:31:37 ctl02 glance-api[29183]: 2017-09-28 11:31:37.830 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:31:37] "OPTIONS / HTTP/1.0" 200 134 0.000745
Sep 28 11:31:37 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4a6a2109)
Sep 28 11:31:38 ctl02 glance-api[29183]: 2017-09-28 11:31:38.436 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:31:38] "OPTIONS / HTTP/1.0" 200 134 0.000780
Sep 28 11:31:38 ctl02 glance-api[29183]: 2017-09-28 11:31:38.728 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:31:38] "OPTIONS / HTTP/1.0" 200 134 0.000719
Sep 28 11:31:38 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4a6a2109)
Sep 28 11:31:43 ctl02 dhclient[627]: message repeated 5 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4a6a2109)]
Sep 28 11:31:44 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:31:44 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:31:47 ctl02 glance-api[29183]: 2017-09-28 11:31:47.994 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:31:47] "OPTIONS / HTTP/1.0" 200 134 0.000754
Sep 28 11:31:48 ctl02 glance-api[29183]: 2017-09-28 11:31:48.083 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:31:48] "OPTIONS / HTTP/1.0" 200 134 0.000760
Sep 28 11:31:48 ctl02 glance-api[29183]: 2017-09-28 11:31:48.943 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:31:48] "OPTIONS / HTTP/1.0" 200 134 0.000690
Sep 28 11:31:57 ctl02 glance-api[29183]: 2017-09-28 11:31:57.762 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:31:57] "OPTIONS / HTTP/1.0" 200 134 0.000836
Sep 28 11:31:58 ctl02 glance-api[29183]: 2017-09-28 11:31:58.096 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:31:58] "OPTIONS / HTTP/1.0" 200 134 0.000713
Sep 28 11:31:58 ctl02 glance-api[29183]: 2017-09-28 11:31:58.552 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:31:58] "OPTIONS / HTTP/1.0" 200 134 0.000802
Sep 28 11:32:02 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x59351f52)
Sep 28 11:32:07 ctl02 dhclient[627]: message repeated 5 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x59351f52)]
Sep 28 11:32:08 ctl02 glance-api[29183]: 2017-09-28 11:32:08.012 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:32:08] "OPTIONS / HTTP/1.0" 200 134 0.000876
Sep 28 11:32:08 ctl02 glance-api[29183]: 2017-09-28 11:32:08.065 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:32:08] "OPTIONS / HTTP/1.0" 200 134 0.000732
Sep 28 11:32:08 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x59351f52)
Sep 28 11:32:08 ctl02 glance-api[29183]: 2017-09-28 11:32:08.913 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:32:08] "OPTIONS / HTTP/1.0" 200 134 0.000729
Sep 28 11:32:09 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x59351f52)
Sep 28 11:32:12 ctl02 dhclient[627]: message repeated 3 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x59351f52)]
Sep 28 11:32:13 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:32:13 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:32:17 ctl02 glance-api[29183]: 2017-09-28 11:32:17.670 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:32:17] "OPTIONS / HTTP/1.0" 200 134 0.000829
Sep 28 11:32:17 ctl02 glance-api[29183]: 2017-09-28 11:32:17.832 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:32:17] "OPTIONS / HTTP/1.0" 200 134 0.000782
Sep 28 11:32:19 ctl02 glance-api[29183]: 2017-09-28 11:32:19.126 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:32:19] "OPTIONS / HTTP/1.0" 200 134 0.000733
Sep 28 11:32:28 ctl02 glance-api[29183]: 2017-09-28 11:32:28.036 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:32:28] "OPTIONS / HTTP/1.0" 200 134 0.000873
Sep 28 11:32:28 ctl02 glance-api[29183]: 2017-09-28 11:32:28.176 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:32:28] "OPTIONS / HTTP/1.0" 200 134 0.000725
Sep 28 11:32:28 ctl02 glance-api[29183]: 2017-09-28 11:32:28.949 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:32:28] "OPTIONS / HTTP/1.0" 200 134 0.000609
Sep 28 11:32:30 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x82963f53)
Sep 28 11:32:37 ctl02 dhclient[627]: message repeated 7 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x82963f53)]
Sep 28 11:32:37 ctl02 glance-api[29183]: 2017-09-28 11:32:37.845 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:32:37] "OPTIONS / HTTP/1.0" 200 134 0.000919
Sep 28 11:32:37 ctl02 glance-api[29183]: 2017-09-28 11:32:37.927 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:32:37] "OPTIONS / HTTP/1.0" 200 134 0.000739
Sep 28 11:32:38 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x82963f53)
Sep 28 11:32:39 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x82963f53)
Sep 28 11:32:39 ctl02 glance-api[29183]: 2017-09-28 11:32:39.340 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:32:39] "OPTIONS / HTTP/1.0" 200 134 0.000854
Sep 28 11:32:40 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x82963f53)
Sep 28 11:32:41 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:32:41 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:32:47 ctl02 glance-api[29183]: 2017-09-28 11:32:47.608 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:32:47] "OPTIONS / HTTP/1.0" 200 134 0.000829
Sep 28 11:32:47 ctl02 glance-api[29183]: 2017-09-28 11:32:47.675 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:32:47] "OPTIONS / HTTP/1.0" 200 134 0.000539
Sep 28 11:32:49 ctl02 glance-api[29183]: 2017-09-28 11:32:49.537 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:32:49] "OPTIONS / HTTP/1.0" 200 134 0.000814
Sep 28 11:32:57 ctl02 glance-api[29183]: 2017-09-28 11:32:57.798 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:32:57] "OPTIONS / HTTP/1.0" 200 134 0.000841
Sep 28 11:32:57 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd9fb00e)
Sep 28 11:32:57 ctl02 glance-api[29183]: 2017-09-28 11:32:57.876 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:32:57] "OPTIONS / HTTP/1.0" 200 134 0.000764
Sep 28 11:32:58 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd9fb00e)
Sep 28 11:32:59 ctl02 glance-api[29183]: 2017-09-28 11:32:59.839 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:32:59] "OPTIONS / HTTP/1.0" 200 134 0.000788
Sep 28 11:32:59 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd9fb00e)
Sep 28 11:33:06 ctl02 dhclient[627]: message repeated 7 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd9fb00e)]
Sep 28 11:33:07 ctl02 glance-api[29183]: 2017-09-28 11:33:07.525 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:33:07] "OPTIONS / HTTP/1.0" 200 134 0.000778
Sep 28 11:33:07 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd9fb00e)
Sep 28 11:33:07 ctl02 glance-api[29183]: 2017-09-28 11:33:07.977 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:33:07] "OPTIONS / HTTP/1.0" 200 134 0.000661
Sep 28 11:33:08 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:33:08 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:33:09 ctl02 glance-api[29183]: 2017-09-28 11:33:09.446 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:33:09] "OPTIONS / HTTP/1.0" 200 134 0.000671
Sep 28 11:33:17 ctl02 glance-api[29183]: 2017-09-28 11:33:17.461 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:33:17] "OPTIONS / HTTP/1.0" 200 134 0.000725
Sep 28 11:33:17 ctl02 glance-api[29183]: 2017-09-28 11:33:17.826 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:33:17] "OPTIONS / HTTP/1.0" 200 134 0.000721
Sep 28 11:33:19 ctl02 glance-api[29183]: 2017-09-28 11:33:19.416 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:33:19] "OPTIONS / HTTP/1.0" 200 134 0.000850
Sep 28 11:33:27 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4d039412)
Sep 28 11:33:27 ctl02 glance-api[29183]: 2017-09-28 11:33:27.528 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:33:27] "OPTIONS / HTTP/1.0" 200 134 0.000803
Sep 28 11:33:27 ctl02 glance-api[29183]: 2017-09-28 11:33:27.551 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:33:27] "OPTIONS / HTTP/1.0" 200 134 0.000716
Sep 28 11:33:28 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4d039412)
Sep 28 11:33:29 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4d039412)
Sep 28 11:33:29 ctl02 glance-api[29183]: 2017-09-28 11:33:29.369 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:33:29] "OPTIONS / HTTP/1.0" 200 134 0.000821
Sep 28 11:33:30 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4d039412)
Sep 28 11:33:37 ctl02 dhclient[627]: message repeated 7 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4d039412)]
Sep 28 11:33:37 ctl02 glance-api[29183]: 2017-09-28 11:33:37.462 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:33:37] "OPTIONS / HTTP/1.0" 200 134 0.000796
Sep 28 11:33:37 ctl02 glance-api[29183]: 2017-09-28 11:33:37.641 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:33:37] "OPTIONS / HTTP/1.0" 200 134 0.000751
Sep 28 11:33:38 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:33:38 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:33:38 ctl02 glance-api[29183]: 2017-09-28 11:33:38.990 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:33:38] "OPTIONS / HTTP/1.0" 200 134 0.000811
Sep 28 11:33:47 ctl02 glance-api[29183]: 2017-09-28 11:33:47.352 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:33:47] "OPTIONS / HTTP/1.0" 200 134 0.000813
Sep 28 11:33:47 ctl02 glance-api[29183]: 2017-09-28 11:33:47.794 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:33:47] "OPTIONS / HTTP/1.0" 200 134 0.000510
Sep 28 11:33:49 ctl02 glance-api[29183]: 2017-09-28 11:33:49.093 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:33:49] "OPTIONS / HTTP/1.0" 200 134 0.000676
Sep 28 11:33:53 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3d78d4c)
Sep 28 11:33:56 ctl02 dhclient[627]: message repeated 3 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3d78d4c)]
Sep 28 11:33:57 ctl02 glance-api[29183]: 2017-09-28 11:33:57.038 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:33:57] "OPTIONS / HTTP/1.0" 200 134 0.000749
Sep 28 11:33:57 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3d78d4c)
Sep 28 11:33:57 ctl02 glance-api[29183]: 2017-09-28 11:33:57.897 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:33:57] "OPTIONS / HTTP/1.0" 200 134 0.000806
Sep 28 11:33:58 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3d78d4c)
Sep 28 11:33:59 ctl02 glance-api[29183]: 2017-09-28 11:33:59.285 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:33:59] "OPTIONS / HTTP/1.0" 200 134 0.000768
Sep 28 11:33:59 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3d78d4c)
Sep 28 11:34:03 ctl02 dhclient[627]: message repeated 4 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3d78d4c)]
Sep 28 11:34:04 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:34:04 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:34:06 ctl02 glance-api[29183]: 2017-09-28 11:34:06.948 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:34:06] "OPTIONS / HTTP/1.0" 200 134 0.000839
Sep 28 11:34:07 ctl02 glance-api[29183]: 2017-09-28 11:34:07.504 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:34:07] "OPTIONS / HTTP/1.0" 200 134 0.000876
Sep 28 11:34:09 ctl02 glance-api[29183]: 2017-09-28 11:34:09.077 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:34:09] "OPTIONS / HTTP/1.0" 200 134 0.000773
Sep 28 11:34:16 ctl02 glance-api[29183]: 2017-09-28 11:34:16.778 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:34:16] "OPTIONS / HTTP/1.0" 200 134 0.000787
Sep 28 11:34:17 ctl02 glance-api[29183]: 2017-09-28 11:34:17.229 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:34:17] "OPTIONS / HTTP/1.0" 200 134 0.000577
Sep 28 11:34:19 ctl02 glance-api[29183]: 2017-09-28 11:34:19.077 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:34:19] "OPTIONS / HTTP/1.0" 200 134 0.000691
Sep 28 11:34:24 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdc1aa31d)
Sep 28 11:34:26 ctl02 dhclient[627]: message repeated 2 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdc1aa31d)]
Sep 28 11:34:26 ctl02 glance-api[29183]: 2017-09-28 11:34:26.663 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:34:26] "OPTIONS / HTTP/1.0" 200 134 0.000808
Sep 28 11:34:27 ctl02 glance-api[29183]: 2017-09-28 11:34:27.089 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:34:27] "OPTIONS / HTTP/1.0" 200 134 0.000776
Sep 28 11:34:27 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdc1aa31d)
Sep 28 11:34:28 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdc1aa31d)
Sep 28 11:34:29 ctl02 glance-api[29183]: 2017-09-28 11:34:29.073 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:34:29] "OPTIONS / HTTP/1.0" 200 134 0.000731
Sep 28 11:34:29 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdc1aa31d)
Sep 28 11:34:34 ctl02 dhclient[627]: message repeated 5 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdc1aa31d)]
Sep 28 11:34:35 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:34:35 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:34:36 ctl02 glance-api[29183]: 2017-09-28 11:34:36.742 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:34:36] "OPTIONS / HTTP/1.0" 200 134 0.000788
Sep 28 11:34:37 ctl02 glance-api[29183]: 2017-09-28 11:34:37.133 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:34:37] "OPTIONS / HTTP/1.0" 200 134 0.000746
Sep 28 11:34:39 ctl02 glance-api[29183]: 2017-09-28 11:34:39.185 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:34:39] "OPTIONS / HTTP/1.0" 200 134 0.000825
Sep 28 11:34:46 ctl02 glance-api[29183]: 2017-09-28 11:34:46.571 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:34:46] "OPTIONS / HTTP/1.0" 200 134 0.000766
Sep 28 11:34:47 ctl02 glance-api[29183]: 2017-09-28 11:34:47.321 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:34:47] "OPTIONS / HTTP/1.0" 200 134 0.000680
Sep 28 11:34:48 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x55335b34)
Sep 28 11:34:49 ctl02 glance-api[29183]: 2017-09-28 11:34:49.003 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:34:49] "OPTIONS / HTTP/1.0" 200 134 0.000783
Sep 28 11:34:49 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x55335b34)
Sep 28 11:34:55 ctl02 dhclient[627]: message repeated 6 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x55335b34)]
Sep 28 11:34:56 ctl02 glance-api[29183]: 2017-09-28 11:34:56.183 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:34:56] "OPTIONS / HTTP/1.0" 200 134 0.000755
Sep 28 11:34:56 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x55335b34)
Sep 28 11:34:57 ctl02 glance-api[29183]: 2017-09-28 11:34:57.165 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:34:57] "OPTIONS / HTTP/1.0" 200 134 0.000761
Sep 28 11:34:57 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x55335b34)
Sep 28 11:34:58 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x55335b34)
Sep 28 11:34:59 ctl02 glance-api[29183]: 2017-09-28 11:34:59.225 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:34:59] "OPTIONS / HTTP/1.0" 200 134 0.000740
Sep 28 11:34:59 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:34:59 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:35:06 ctl02 glance-api[29183]: 2017-09-28 11:35:06.092 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:35:06] "OPTIONS / HTTP/1.0" 200 134 0.000837
Sep 28 11:35:06 ctl02 glance-api[29183]: 2017-09-28 11:35:06.855 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:35:06] "OPTIONS / HTTP/1.0" 200 134 0.000794
Sep 28 11:35:08 ctl02 glance-api[29183]: 2017-09-28 11:35:08.985 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:35:08] "OPTIONS / HTTP/1.0" 200 134 0.000843
Sep 28 11:35:09 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc6a7b505)
Sep 28 11:35:15 ctl02 dhclient[627]: message repeated 6 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc6a7b505)]
Sep 28 11:35:16 ctl02 glance-api[29183]: 2017-09-28 11:35:16.218 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:35:16] "OPTIONS / HTTP/1.0" 200 134 0.000830
Sep 28 11:35:16 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc6a7b505)
Sep 28 11:35:17 ctl02 glance-api[29183]: 2017-09-28 11:35:17.084 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:35:17] "OPTIONS / HTTP/1.0" 200 134 0.000850
Sep 28 11:35:17 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc6a7b505)
Sep 28 11:35:18 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc6a7b505)
Sep 28 11:35:19 ctl02 glance-api[29183]: 2017-09-28 11:35:19.016 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:35:19] "OPTIONS / HTTP/1.0" 200 134 0.000743
Sep 28 11:35:19 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc6a7b505)
Sep 28 11:35:20 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:35:20 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:35:26 ctl02 glance-api[29183]: 2017-09-28 11:35:26.176 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:35:26] "OPTIONS / HTTP/1.0" 200 134 0.000801
Sep 28 11:35:27 ctl02 glance-api[29183]: 2017-09-28 11:35:27.168 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:35:27] "OPTIONS / HTTP/1.0" 200 134 0.000795
Sep 28 11:35:28 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x66e4d02d)
Sep 28 11:35:28 ctl02 glance-api[29183]: 2017-09-28 11:35:28.725 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:35:28] "OPTIONS / HTTP/1.0" 200 134 0.000831
Sep 28 11:35:29 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x66e4d02d)
Sep 28 11:35:35 ctl02 dhclient[627]: message repeated 6 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x66e4d02d)]
Sep 28 11:35:35 ctl02 glance-api[29183]: 2017-09-28 11:35:35.962 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:35:35] "OPTIONS / HTTP/1.0" 200 134 0.000885
Sep 28 11:35:36 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x66e4d02d)
Sep 28 11:35:36 ctl02 glance-api[29183]: 2017-09-28 11:35:36.960 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:35:36] "OPTIONS / HTTP/1.0" 200 134 0.000897
Sep 28 11:35:37 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x66e4d02d)
Sep 28 11:35:38 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x66e4d02d)
Sep 28 11:35:39 ctl02 glance-api[29183]: 2017-09-28 11:35:39.083 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:35:39] "OPTIONS / HTTP/1.0" 200 134 0.000778
Sep 28 11:35:39 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:35:39 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:35:42 ctl02 dhclient[600]: DHCPREQUEST of 192.168.11.25 on ens2 to 192.168.11.3 port 67 (xid=0x3415f07)
Sep 28 11:35:42 ctl02 dhclient[600]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 11:35:42 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 11:35:42 ctl02 ntp[3404]:  * Stopping NTP server ntpd
Sep 28 11:35:42 ctl02 ntp[3404]:    ...done.
Sep 28 11:35:42 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 11:35:42 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 11:35:42 ctl02 ntp[3415]:  * Starting NTP server ntpd
Sep 28 11:35:42 ctl02 ntpd[3422]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 11:35:42 ctl02 ntpd[3422]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -c /var/lib/ntp/ntp.conf.dhcp -u 108:112
Sep 28 11:35:42 ctl02 ntp[3415]:    ...done.
Sep 28 11:35:42 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 11:35:42 ctl02 ntpd[3425]: proto: precision = 0.043 usec (-24)
Sep 28 11:35:42 ctl02 ntpd[3425]: switching logging to file /var/log/ntp.log
Sep 28 11:35:42 ctl02 dhclient[600]: bound to 192.168.11.25 -- renewal in 272 seconds.
Sep 28 11:35:46 ctl02 glance-api[29183]: 2017-09-28 11:35:46.339 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:35:46] "OPTIONS / HTTP/1.0" 200 134 0.000715
Sep 28 11:35:46 ctl02 glance-api[29183]: 2017-09-28 11:35:46.966 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:35:46] "OPTIONS / HTTP/1.0" 200 134 0.000868
Sep 28 11:35:49 ctl02 glance-api[29183]: 2017-09-28 11:35:49.368 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:35:49] "OPTIONS / HTTP/1.0" 200 134 0.000782
Sep 28 11:35:56 ctl02 glance-api[29183]: 2017-09-28 11:35:56.030 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:35:56] "OPTIONS / HTTP/1.0" 200 134 0.000814
Sep 28 11:35:56 ctl02 glance-api[29183]: 2017-09-28 11:35:56.683 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:35:56] "OPTIONS / HTTP/1.0" 200 134 0.000769
Sep 28 11:35:57 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x86c75b55)
Sep 28 11:35:58 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x86c75b55)
Sep 28 11:35:59 ctl02 glance-api[29183]: 2017-09-28 11:35:59.592 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:35:59] "OPTIONS / HTTP/1.0" 200 134 0.000828
Sep 28 11:35:59 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x86c75b55)
Sep 28 11:36:05 ctl02 dhclient[627]: message repeated 6 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x86c75b55)]
Sep 28 11:36:05 ctl02 glance-api[29183]: 2017-09-28 11:36:05.884 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:36:05] "OPTIONS / HTTP/1.0" 200 134 0.000855
Sep 28 11:36:06 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x86c75b55)
Sep 28 11:36:07 ctl02 glance-api[29183]: 2017-09-28 11:36:07.085 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:36:07] "OPTIONS / HTTP/1.0" 200 134 0.000757
Sep 28 11:36:07 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x86c75b55)
Sep 28 11:36:08 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:36:08 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:36:08 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 11:36:08 ctl02 ntp[3478]:  * Stopping NTP server ntpd
Sep 28 11:36:08 ctl02 ntp[3478]:    ...done.
Sep 28 11:36:08 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 11:36:08 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 11:36:08 ctl02 ntp[3489]:  * Starting NTP server ntpd
Sep 28 11:36:08 ctl02 ntpd[3496]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 11:36:08 ctl02 ntpd[3496]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 11:36:08 ctl02 ntp[3489]:    ...done.
Sep 28 11:36:08 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 11:36:08 ctl02 ntpd[3499]: proto: precision = 0.043 usec (-24)
Sep 28 11:36:08 ctl02 ntpd[3499]: switching logging to file /var/log/ntp.log
Sep 28 11:36:09 ctl02 glance-api[29183]: 2017-09-28 11:36:09.250 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:36:09] "OPTIONS / HTTP/1.0" 200 134 0.000821
Sep 28 11:36:16 ctl02 glance-api[29183]: 2017-09-28 11:36:16.054 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:36:16] "OPTIONS / HTTP/1.0" 200 134 0.000787
Sep 28 11:36:17 ctl02 glance-api[29183]: 2017-09-28 11:36:17.102 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:36:17] "OPTIONS / HTTP/1.0" 200 134 0.000743
Sep 28 11:36:18 ctl02 glance-api[29183]: 2017-09-28 11:36:18.867 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:36:18] "OPTIONS / HTTP/1.0" 200 134 0.000727
Sep 28 11:36:21 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3baac018)
Sep 28 11:36:25 ctl02 dhclient[627]: message repeated 4 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3baac018)]
Sep 28 11:36:26 ctl02 glance-api[29183]: 2017-09-28 11:36:26.010 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:36:26] "OPTIONS / HTTP/1.0" 200 134 0.000822
Sep 28 11:36:26 ctl02 glance-api[29183]: 2017-09-28 11:36:26.778 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:36:26] "OPTIONS / HTTP/1.0" 200 134 0.000829
Sep 28 11:36:26 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3baac018)
Sep 28 11:36:27 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3baac018)
Sep 28 11:36:28 ctl02 glance-api[29183]: 2017-09-28 11:36:28.576 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:36:28] "OPTIONS / HTTP/1.0" 200 134 0.000755
Sep 28 11:36:28 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3baac018)
Sep 28 11:36:31 ctl02 dhclient[627]: message repeated 3 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3baac018)]
Sep 28 11:36:32 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:36:32 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:36:36 ctl02 glance-api[29183]: 2017-09-28 11:36:36.218 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:36:36] "OPTIONS / HTTP/1.0" 200 134 0.000748
Sep 28 11:36:36 ctl02 glance-api[29183]: 2017-09-28 11:36:36.409 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:36:36] "OPTIONS / HTTP/1.0" 200 134 0.001086
Sep 28 11:36:38 ctl02 glance-api[29183]: 2017-09-28 11:36:38.948 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:36:38] "OPTIONS / HTTP/1.0" 200 134 0.000802
Sep 28 11:36:44 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfbe5c35d)
Sep 28 11:36:45 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfbe5c35d)
Sep 28 11:36:46 ctl02 glance-api[29183]: 2017-09-28 11:36:46.133 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:36:46] "OPTIONS / HTTP/1.0" 200 134 0.000847
Sep 28 11:36:46 ctl02 glance-api[29183]: 2017-09-28 11:36:46.337 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:36:46] "OPTIONS / HTTP/1.0" 200 134 0.000646
Sep 28 11:36:46 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfbe5c35d)
Sep 28 11:36:48 ctl02 dhclient[627]: message repeated 2 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfbe5c35d)]
Sep 28 11:36:49 ctl02 glance-api[29183]: 2017-09-28 11:36:49.283 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:36:49] "OPTIONS / HTTP/1.0" 200 134 0.000715
Sep 28 11:36:49 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfbe5c35d)
Sep 28 11:36:54 ctl02 dhclient[627]: message repeated 5 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfbe5c35d)]
Sep 28 11:36:55 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:36:55 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:36:55 ctl02 glance-api[29183]: 2017-09-28 11:36:55.953 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:36:55] "OPTIONS / HTTP/1.0" 200 134 0.000853
Sep 28 11:36:56 ctl02 glance-api[29183]: 2017-09-28 11:36:56.122 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:36:56] "OPTIONS / HTTP/1.0" 200 134 0.000503
Sep 28 11:36:59 ctl02 glance-api[29183]: 2017-09-28 11:36:59.234 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:36:59] "OPTIONS / HTTP/1.0" 200 134 0.000783
Sep 28 11:37:05 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2bdf0d75)
Sep 28 11:37:06 ctl02 glance-api[29183]: 2017-09-28 11:37:06.056 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:37:06] "OPTIONS / HTTP/1.0" 200 134 0.000851
Sep 28 11:37:06 ctl02 glance-api[29183]: 2017-09-28 11:37:06.231 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:37:06] "OPTIONS / HTTP/1.0" 200 134 0.000673
Sep 28 11:37:06 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2bdf0d75)
Sep 28 11:37:09 ctl02 dhclient[627]: message repeated 3 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2bdf0d75)]
Sep 28 11:37:09 ctl02 glance-api[29183]: 2017-09-28 11:37:09.304 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:37:09] "OPTIONS / HTTP/1.0" 200 134 0.000871
Sep 28 11:37:10 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2bdf0d75)
Sep 28 11:37:15 ctl02 dhclient[627]: message repeated 5 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2bdf0d75)]
Sep 28 11:37:15 ctl02 glance-api[29183]: 2017-09-28 11:37:15.776 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:37:15] "OPTIONS / HTTP/1.0" 200 134 0.000819
Sep 28 11:37:15 ctl02 glance-api[29183]: 2017-09-28 11:37:15.932 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:37:15] "OPTIONS / HTTP/1.0" 200 134 0.000530
Sep 28 11:37:16 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:37:16 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:37:18 ctl02 glance-api[29183]: 2017-09-28 11:37:18.993 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:37:18] "OPTIONS / HTTP/1.0" 200 134 0.000791
Sep 28 11:37:25 ctl02 glance-api[29183]: 2017-09-28 11:37:25.776 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:37:25] "OPTIONS / HTTP/1.0" 200 134 0.000765
Sep 28 11:37:26 ctl02 glance-api[29183]: 2017-09-28 11:37:26.179 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:37:26] "OPTIONS / HTTP/1.0" 200 134 0.000603
Sep 28 11:37:28 ctl02 glance-api[29183]: 2017-09-28 11:37:28.613 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:37:28] "OPTIONS / HTTP/1.0" 200 134 0.000726
Sep 28 11:37:35 ctl02 glance-api[29183]: 2017-09-28 11:37:35.952 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:37:35] "OPTIONS / HTTP/1.0" 200 134 0.000825
Sep 28 11:37:36 ctl02 glance-api[29183]: 2017-09-28 11:37:36.091 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:37:36] "OPTIONS / HTTP/1.0" 200 134 0.000667
Sep 28 11:37:38 ctl02 glance-api[29183]: 2017-09-28 11:37:38.277 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:37:38] "OPTIONS / HTTP/1.0" 200 134 0.000703
Sep 28 11:37:38 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xbc5b6810)
Sep 28 11:37:45 ctl02 dhclient[627]: message repeated 7 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xbc5b6810)]
Sep 28 11:37:45 ctl02 glance-api[29183]: 2017-09-28 11:37:45.982 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:37:45] "OPTIONS / HTTP/1.0" 200 134 0.000824
Sep 28 11:37:46 ctl02 glance-api[29183]: 2017-09-28 11:37:46.127 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:37:46] "OPTIONS / HTTP/1.0" 200 134 0.000496
Sep 28 11:37:46 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xbc5b6810)
Sep 28 11:37:47 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xbc5b6810)
Sep 28 11:37:48 ctl02 glance-api[29183]: 2017-09-28 11:37:48.426 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:37:48] "OPTIONS / HTTP/1.0" 200 134 0.000749
Sep 28 11:37:48 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xbc5b6810)
Sep 28 11:37:49 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:37:49 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:37:55 ctl02 glance-api[29183]: 2017-09-28 11:37:55.744 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:37:55] "OPTIONS / HTTP/1.0" 200 134 0.000815
Sep 28 11:37:56 ctl02 glance-api[29183]: 2017-09-28 11:37:56.124 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:37:56] "OPTIONS / HTTP/1.0" 200 134 0.000762
Sep 28 11:37:58 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x65e6db29)
Sep 28 11:37:58 ctl02 glance-api[29183]: 2017-09-28 11:37:58.424 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:37:58] "OPTIONS / HTTP/1.0" 200 134 0.000776
Sep 28 11:37:59 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x65e6db29)
Sep 28 11:38:05 ctl02 dhclient[627]: message repeated 6 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x65e6db29)]
Sep 28 11:38:05 ctl02 glance-api[29183]: 2017-09-28 11:38:05.845 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:38:05] "OPTIONS / HTTP/1.0" 200 134 0.000798
Sep 28 11:38:06 ctl02 glance-api[29183]: 2017-09-28 11:38:06.319 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:38:06] "OPTIONS / HTTP/1.0" 200 134 0.000786
Sep 28 11:38:06 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x65e6db29)
Sep 28 11:38:07 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x65e6db29)
Sep 28 11:38:08 ctl02 glance-api[29183]: 2017-09-28 11:38:08.411 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:38:08] "OPTIONS / HTTP/1.0" 200 134 0.000855
Sep 28 11:38:08 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x65e6db29)
Sep 28 11:38:09 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:38:09 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:38:15 ctl02 glance-api[29183]: 2017-09-28 11:38:15.477 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:38:15] "OPTIONS / HTTP/1.0" 200 134 0.000927
Sep 28 11:38:16 ctl02 glance-api[29183]: 2017-09-28 11:38:16.196 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:38:16] "OPTIONS / HTTP/1.0" 200 134 0.000703
Sep 28 11:38:18 ctl02 glance-api[29183]: 2017-09-28 11:38:18.185 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:38:18] "OPTIONS / HTTP/1.0" 200 134 0.000756
Sep 28 11:38:22 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x20f7c803)
Sep 28 11:38:24 ctl02 dhclient[627]: message repeated 2 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x20f7c803)]
Sep 28 11:38:25 ctl02 glance-api[29183]: 2017-09-28 11:38:25.376 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:38:25] "OPTIONS / HTTP/1.0" 200 134 0.000801
Sep 28 11:38:25 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x20f7c803)
Sep 28 11:38:26 ctl02 glance-api[29183]: 2017-09-28 11:38:26.149 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:38:26] "OPTIONS / HTTP/1.0" 200 134 0.000784
Sep 28 11:38:26 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x20f7c803)
Sep 28 11:38:27 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x20f7c803)
Sep 28 11:38:28 ctl02 glance-api[29183]: 2017-09-28 11:38:28.192 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:38:28] "OPTIONS / HTTP/1.0" 200 134 0.000794
Sep 28 11:38:28 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x20f7c803)
Sep 28 11:38:32 ctl02 dhclient[627]: message repeated 4 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x20f7c803)]
Sep 28 11:38:33 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:38:33 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:38:35 ctl02 glance-api[29183]: 2017-09-28 11:38:35.657 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:38:35] "OPTIONS / HTTP/1.0" 200 134 0.000749
Sep 28 11:38:36 ctl02 glance-api[29183]: 2017-09-28 11:38:36.004 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:38:36] "OPTIONS / HTTP/1.0" 200 134 0.000715
Sep 28 11:38:38 ctl02 glance-api[29183]: 2017-09-28 11:38:38.171 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:38:38] "OPTIONS / HTTP/1.0" 200 134 0.000663
Sep 28 11:38:45 ctl02 glance-api[29183]: 2017-09-28 11:38:45.987 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:38:45] "OPTIONS / HTTP/1.0" 200 134 0.000740
Sep 28 11:38:46 ctl02 glance-api[29183]: 2017-09-28 11:38:46.218 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:38:46] "OPTIONS / HTTP/1.0" 200 134 0.000506
Sep 28 11:38:47 ctl02 glance-api[29183]: 2017-09-28 11:38:47.903 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:38:47] "OPTIONS / HTTP/1.0" 200 134 0.000801
Sep 28 11:38:53 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x87d024)
Sep 28 11:38:55 ctl02 dhclient[627]: message repeated 2 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x87d024)]
Sep 28 11:38:55 ctl02 glance-api[29183]: 2017-09-28 11:38:55.850 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:38:55] "OPTIONS / HTTP/1.0" 200 134 0.000758
Sep 28 11:38:56 ctl02 glance-api[29183]: 2017-09-28 11:38:56.096 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:38:56] "OPTIONS / HTTP/1.0" 200 134 0.000706
Sep 28 11:38:56 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x87d024)
Sep 28 11:38:57 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x87d024)
Sep 28 11:38:58 ctl02 glance-api[29183]: 2017-09-28 11:38:58.125 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:38:58] "OPTIONS / HTTP/1.0" 200 134 0.000799
Sep 28 11:38:58 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x87d024)
Sep 28 11:39:03 ctl02 dhclient[627]: message repeated 5 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x87d024)]
Sep 28 11:39:04 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:39:04 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:39:05 ctl02 glance-api[29183]: 2017-09-28 11:39:05.996 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:39:05] "OPTIONS / HTTP/1.0" 200 134 0.000813
Sep 28 11:39:06 ctl02 glance-api[29183]: 2017-09-28 11:39:06.179 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:39:06] "OPTIONS / HTTP/1.0" 200 134 0.000765
Sep 28 11:39:08 ctl02 glance-api[29183]: 2017-09-28 11:39:08.488 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:39:08] "OPTIONS / HTTP/1.0" 200 134 0.000727
Sep 28 11:39:15 ctl02 glance-api[29183]: 2017-09-28 11:39:15.864 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:39:15] "OPTIONS / HTTP/1.0" 200 134 0.000863
Sep 28 11:39:16 ctl02 glance-api[29183]: 2017-09-28 11:39:16.033 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:39:16] "OPTIONS / HTTP/1.0" 200 134 0.000683
Sep 28 11:39:18 ctl02 glance-api[29183]: 2017-09-28 11:39:18.126 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:39:18] "OPTIONS / HTTP/1.0" 200 134 0.000687
Sep 28 11:39:21 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb972531c)
Sep 28 11:39:25 ctl02 dhclient[627]: message repeated 4 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb972531c)]
Sep 28 11:39:25 ctl02 glance-api[29183]: 2017-09-28 11:39:25.655 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:39:25] "OPTIONS / HTTP/1.0" 200 134 0.000725
Sep 28 11:39:25 ctl02 glance-api[29183]: 2017-09-28 11:39:25.859 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:39:25] "OPTIONS / HTTP/1.0" 200 134 0.000743
Sep 28 11:39:26 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb972531c)
Sep 28 11:39:27 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb972531c)
Sep 28 11:39:27 ctl02 glance-api[29183]: 2017-09-28 11:39:27.820 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:39:27] "OPTIONS / HTTP/1.0" 200 134 0.000829
Sep 28 11:39:28 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb972531c)
Sep 28 11:39:31 ctl02 dhclient[627]: message repeated 3 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb972531c)]
Sep 28 11:39:32 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:39:32 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:39:35 ctl02 glance-api[29183]: 2017-09-28 11:39:35.468 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:39:35] "OPTIONS / HTTP/1.0" 200 134 0.000848
Sep 28 11:39:35 ctl02 glance-api[29183]: 2017-09-28 11:39:35.585 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:39:35] "OPTIONS / HTTP/1.0" 200 134 0.000672
Sep 28 11:39:37 ctl02 glance-api[29183]: 2017-09-28 11:39:37.594 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:39:37] "OPTIONS / HTTP/1.0" 200 134 0.000685
Sep 28 11:39:45 ctl02 glance-api[29183]: 2017-09-28 11:39:45.107 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:39:45] "OPTIONS / HTTP/1.0" 200 134 0.000816
Sep 28 11:39:45 ctl02 glance-api[29183]: 2017-09-28 11:39:45.873 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:39:45] "OPTIONS / HTTP/1.0" 200 134 0.001135
Sep 28 11:39:47 ctl02 glance-api[29183]: 2017-09-28 11:39:47.968 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:39:47] "OPTIONS / HTTP/1.0" 200 134 0.000812
Sep 28 11:39:53 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4986a01a)
Sep 28 11:39:54 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4986a01a)
Sep 28 11:39:55 ctl02 glance-api[29183]: 2017-09-28 11:39:55.411 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:39:55] "OPTIONS / HTTP/1.0" 200 134 0.000771
Sep 28 11:39:55 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4986a01a)
Sep 28 11:39:56 ctl02 glance-api[29183]: 2017-09-28 11:39:56.187 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:39:56] "OPTIONS / HTTP/1.0" 200 134 0.000712
Sep 28 11:39:56 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4986a01a)
Sep 28 11:39:57 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4986a01a)
Sep 28 11:39:57 ctl02 glance-api[29183]: 2017-09-28 11:39:57.938 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:39:57] "OPTIONS / HTTP/1.0" 200 134 0.000774
Sep 28 11:39:58 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4986a01a)
Sep 28 11:40:03 ctl02 dhclient[627]: message repeated 5 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4986a01a)]
Sep 28 11:40:04 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:40:04 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:40:05 ctl02 glance-api[29183]: 2017-09-28 11:40:05.648 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:40:05] "OPTIONS / HTTP/1.0" 200 134 0.000837
Sep 28 11:40:06 ctl02 glance-api[29183]: 2017-09-28 11:40:06.246 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:40:06] "OPTIONS / HTTP/1.0" 200 134 0.000549
Sep 28 11:40:08 ctl02 glance-api[29183]: 2017-09-28 11:40:08.254 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:40:08] "OPTIONS / HTTP/1.0" 200 134 0.000746
Sep 28 11:40:14 ctl02 dhclient[600]: DHCPREQUEST of 192.168.11.25 on ens2 to 192.168.11.3 port 67 (xid=0x3415f07)
Sep 28 11:40:14 ctl02 dhclient[600]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 11:40:14 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 11:40:14 ctl02 ntp[3603]:  * Stopping NTP server ntpd
Sep 28 11:40:14 ctl02 ntp[3603]:    ...done.
Sep 28 11:40:14 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 11:40:14 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 11:40:14 ctl02 ntp[3614]:  * Starting NTP server ntpd
Sep 28 11:40:14 ctl02 ntpd[3621]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 11:40:14 ctl02 ntpd[3621]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -c /var/lib/ntp/ntp.conf.dhcp -u 108:112
Sep 28 11:40:14 ctl02 ntp[3614]:    ...done.
Sep 28 11:40:14 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 11:40:14 ctl02 ntpd[3624]: proto: precision = 0.044 usec (-24)
Sep 28 11:40:14 ctl02 ntpd[3624]: switching logging to file /var/log/ntp.log
Sep 28 11:40:14 ctl02 dhclient[600]: bound to 192.168.11.25 -- renewal in 275 seconds.
Sep 28 11:40:15 ctl02 glance-api[29183]: 2017-09-28 11:40:15.521 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:40:15] "OPTIONS / HTTP/1.0" 200 134 0.000848
Sep 28 11:40:15 ctl02 glance-api[29183]: 2017-09-28 11:40:15.986 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:40:15] "OPTIONS / HTTP/1.0" 200 134 0.000489
Sep 28 11:40:18 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x167e2f00)
Sep 28 11:40:18 ctl02 glance-api[29183]: 2017-09-28 11:40:18.646 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:40:18] "OPTIONS / HTTP/1.0" 200 134 0.000759
Sep 28 11:40:19 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x167e2f00)
Sep 28 11:40:25 ctl02 dhclient[627]: message repeated 6 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x167e2f00)]
Sep 28 11:40:25 ctl02 glance-api[29183]: 2017-09-28 11:40:25.285 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:40:25] "OPTIONS / HTTP/1.0" 200 134 0.000634
Sep 28 11:40:26 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x167e2f00)
Sep 28 11:40:26 ctl02 glance-api[29183]: 2017-09-28 11:40:26.104 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:40:26] "OPTIONS / HTTP/1.0" 200 134 0.000750
Sep 28 11:40:27 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x167e2f00)
Sep 28 11:40:28 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x167e2f00)
Sep 28 11:40:28 ctl02 glance-api[29183]: 2017-09-28 11:40:28.764 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:40:28] "OPTIONS / HTTP/1.0" 200 134 0.000751
Sep 28 11:40:29 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:40:29 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:40:29 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 11:40:29 ctl02 ntp[3677]:  * Stopping NTP server ntpd
Sep 28 11:40:29 ctl02 ntp[3677]:    ...done.
Sep 28 11:40:29 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 11:40:29 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 11:40:29 ctl02 ntp[3688]:  * Starting NTP server ntpd
Sep 28 11:40:29 ctl02 ntpd[3695]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 11:40:29 ctl02 ntpd[3695]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 11:40:29 ctl02 ntp[3688]:    ...done.
Sep 28 11:40:29 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 11:40:29 ctl02 ntpd[3698]: proto: precision = 0.043 usec (-24)
Sep 28 11:40:29 ctl02 ntpd[3698]: switching logging to file /var/log/ntp.log
Sep 28 11:40:35 ctl02 glance-api[29183]: 2017-09-28 11:40:35.407 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:40:35] "OPTIONS / HTTP/1.0" 200 134 0.000834
Sep 28 11:40:35 ctl02 glance-api[29183]: 2017-09-28 11:40:35.760 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:40:35] "OPTIONS / HTTP/1.0" 200 134 0.000690
Sep 28 11:40:38 ctl02 glance-api[29183]: 2017-09-28 11:40:38.503 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:40:38] "OPTIONS / HTTP/1.0" 200 134 0.000772
Sep 28 11:40:45 ctl02 glance-api[29183]: 2017-09-28 11:40:45.508 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:40:45] "OPTIONS / HTTP/1.0" 200 134 0.000919
Sep 28 11:40:45 ctl02 glance-api[29183]: 2017-09-28 11:40:45.552 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:40:45] "OPTIONS / HTTP/1.0" 200 134 0.000775
Sep 28 11:40:45 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x87de8c77)
Sep 28 11:40:47 ctl02 dhclient[627]: message repeated 2 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x87de8c77)]
Sep 28 11:40:48 ctl02 glance-api[29183]: 2017-09-28 11:40:48.890 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:40:48] "OPTIONS / HTTP/1.0" 200 134 0.000819
Sep 28 11:40:48 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x87de8c77)
Sep 28 11:40:54 ctl02 dhclient[627]: message repeated 6 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x87de8c77)]
Sep 28 11:40:55 ctl02 glance-api[29183]: 2017-09-28 11:40:55.247 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:40:55] "OPTIONS / HTTP/1.0" 200 134 0.000786
Sep 28 11:40:55 ctl02 glance-api[29183]: 2017-09-28 11:40:55.480 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:40:55] "OPTIONS / HTTP/1.0" 200 134 0.000727
Sep 28 11:40:55 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x87de8c77)
Sep 28 11:40:56 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:40:56 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:40:58 ctl02 glance-api[29183]: 2017-09-28 11:40:58.517 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:40:58] "OPTIONS / HTTP/1.0" 200 134 0.000863
Sep 28 11:41:04 ctl02 glance-api[29183]: 2017-09-28 11:41:04.859 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:41:04] "OPTIONS / HTTP/1.0" 200 134 0.000781
Sep 28 11:41:05 ctl02 glance-api[29183]: 2017-09-28 11:41:05.388 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:41:05] "OPTIONS / HTTP/1.0" 200 134 0.000743
Sep 28 11:41:08 ctl02 glance-api[29183]: 2017-09-28 11:41:08.783 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:41:08] "OPTIONS / HTTP/1.0" 200 134 0.000721
Sep 28 11:41:14 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x54a383c)
Sep 28 11:41:15 ctl02 glance-api[29183]: 2017-09-28 11:41:15.053 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:41:15] "OPTIONS / HTTP/1.0" 200 134 0.000834
Sep 28 11:41:15 ctl02 glance-api[29183]: 2017-09-28 11:41:15.561 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:41:15] "OPTIONS / HTTP/1.0" 200 134 0.000769
Sep 28 11:41:15 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x54a383c)
Sep 28 11:41:17 ctl02 dhclient[627]: message repeated 2 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x54a383c)]
Sep 28 11:41:18 ctl02 glance-api[29183]: 2017-09-28 11:41:18.663 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:41:18] "OPTIONS / HTTP/1.0" 200 134 0.000726
Sep 28 11:41:18 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x54a383c)
Sep 28 11:41:24 ctl02 dhclient[627]: message repeated 6 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x54a383c)]
Sep 28 11:41:25 ctl02 glance-api[29183]: 2017-09-28 11:41:25.314 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:41:25] "OPTIONS / HTTP/1.0" 200 134 0.000808
Sep 28 11:41:25 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:41:25 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:41:25 ctl02 glance-api[29183]: 2017-09-28 11:41:25.889 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:41:25] "OPTIONS / HTTP/1.0" 200 134 0.000758
Sep 28 11:41:28 ctl02 glance-api[29183]: 2017-09-28 11:41:28.759 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:41:28] "OPTIONS / HTTP/1.0" 200 134 0.000795
Sep 28 11:41:35 ctl02 glance-api[29183]: 2017-09-28 11:41:35.467 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:41:35] "OPTIONS / HTTP/1.0" 200 134 0.000758
Sep 28 11:41:35 ctl02 glance-api[29183]: 2017-09-28 11:41:35.947 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:41:35] "OPTIONS / HTTP/1.0" 200 134 0.000733
Sep 28 11:41:39 ctl02 glance-api[29183]: 2017-09-28 11:41:39.103 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:41:39] "OPTIONS / HTTP/1.0" 200 134 0.000635
Sep 28 11:41:45 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2e39bc74)
Sep 28 11:41:45 ctl02 glance-api[29183]: 2017-09-28 11:41:45.362 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:41:45] "OPTIONS / HTTP/1.0" 200 134 0.000773
Sep 28 11:41:45 ctl02 glance-api[29183]: 2017-09-28 11:41:45.584 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:41:45] "OPTIONS / HTTP/1.0" 200 134 0.000536
Sep 28 11:41:46 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2e39bc74)
Sep 28 11:41:48 ctl02 dhclient[627]: message repeated 2 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2e39bc74)]
Sep 28 11:41:49 ctl02 glance-api[29183]: 2017-09-28 11:41:49.193 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:41:49] "OPTIONS / HTTP/1.0" 200 134 0.000629
Sep 28 11:41:49 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2e39bc74)
Sep 28 11:41:54 ctl02 dhclient[627]: message repeated 5 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2e39bc74)]
Sep 28 11:41:55 ctl02 glance-api[29183]: 2017-09-28 11:41:55.316 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:41:55] "OPTIONS / HTTP/1.0" 200 134 0.000660
Sep 28 11:41:55 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2e39bc74)
Sep 28 11:41:55 ctl02 glance-api[29183]: 2017-09-28 11:41:55.468 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:41:55] "OPTIONS / HTTP/1.0" 200 134 0.000707
Sep 28 11:41:56 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:41:56 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:41:59 ctl02 glance-api[29183]: 2017-09-28 11:41:59.522 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:41:59] "OPTIONS / HTTP/1.0" 200 134 0.000757
Sep 28 11:42:05 ctl02 glance-api[29183]: 2017-09-28 11:42:05.120 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:42:05] "OPTIONS / HTTP/1.0" 200 134 0.000875
Sep 28 11:42:05 ctl02 glance-api[29183]: 2017-09-28 11:42:05.667 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:42:05] "OPTIONS / HTTP/1.0" 200 134 0.000708
Sep 28 11:42:06 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7a679a14)
Sep 28 11:42:08 ctl02 dhclient[627]: message repeated 2 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7a679a14)]
Sep 28 11:42:09 ctl02 glance-api[29183]: 2017-09-28 11:42:09.486 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:42:09] "OPTIONS / HTTP/1.0" 200 134 0.000598
Sep 28 11:42:09 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7a679a14)
Sep 28 11:42:14 ctl02 dhclient[627]: message repeated 5 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7a679a14)]
Sep 28 11:42:15 ctl02 glance-api[29183]: 2017-09-28 11:42:15.144 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:42:15] "OPTIONS / HTTP/1.0" 200 134 0.000814
Sep 28 11:42:15 ctl02 glance-api[29183]: 2017-09-28 11:42:15.531 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:42:15] "OPTIONS / HTTP/1.0" 200 134 0.000649
Sep 28 11:42:15 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7a679a14)
Sep 28 11:42:16 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7a679a14)
Sep 28 11:42:17 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:42:17 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:42:19 ctl02 glance-api[29183]: 2017-09-28 11:42:19.489 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:42:19] "OPTIONS / HTTP/1.0" 200 134 0.000740
Sep 28 11:42:25 ctl02 glance-api[29183]: 2017-09-28 11:42:25.400 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:42:25] "OPTIONS / HTTP/1.0" 200 134 0.000826
Sep 28 11:42:25 ctl02 glance-api[29183]: 2017-09-28 11:42:25.442 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:42:25] "OPTIONS / HTTP/1.0" 200 134 0.000586
Sep 28 11:42:29 ctl02 glance-api[29183]: 2017-09-28 11:42:29.168 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:42:29] "OPTIONS / HTTP/1.0" 200 134 0.000865
Sep 28 11:42:35 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x71358e35)
Sep 28 11:42:35 ctl02 glance-api[29183]: 2017-09-28 11:42:35.622 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:42:35] "OPTIONS / HTTP/1.0" 200 134 0.000842
Sep 28 11:42:35 ctl02 glance-api[29183]: 2017-09-28 11:42:35.725 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:42:35] "OPTIONS / HTTP/1.0" 200 134 0.000489
Sep 28 11:42:36 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x71358e35)
Sep 28 11:42:39 ctl02 dhclient[627]: message repeated 3 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x71358e35)]
Sep 28 11:42:39 ctl02 glance-api[29183]: 2017-09-28 11:42:39.209 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:42:39] "OPTIONS / HTTP/1.0" 200 134 0.000820
Sep 28 11:42:40 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x71358e35)
Sep 28 11:42:45 ctl02 dhclient[627]: message repeated 5 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x71358e35)]
Sep 28 11:42:45 ctl02 glance-api[29183]: 2017-09-28 11:42:45.556 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:42:45] "OPTIONS / HTTP/1.0" 200 134 0.000873
Sep 28 11:42:46 ctl02 glance-api[29183]: 2017-09-28 11:42:46.021 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:42:46] "OPTIONS / HTTP/1.0" 200 134 0.000535
Sep 28 11:42:46 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:42:46 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:42:48 ctl02 glance-api[29183]: 2017-09-28 11:42:48.986 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:42:48] "OPTIONS / HTTP/1.0" 200 134 0.000850
Sep 28 11:42:55 ctl02 glance-api[29183]: 2017-09-28 11:42:55.417 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:42:55] "OPTIONS / HTTP/1.0" 200 134 0.000790
Sep 28 11:42:56 ctl02 glance-api[29183]: 2017-09-28 11:42:56.271 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:42:56] "OPTIONS / HTTP/1.0" 200 134 0.000720
Sep 28 11:42:59 ctl02 glance-api[29183]: 2017-09-28 11:42:59.278 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:42:59] "OPTIONS / HTTP/1.0" 200 134 0.000820
Sep 28 11:43:05 ctl02 glance-api[29183]: 2017-09-28 11:43:05.365 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:43:05] "OPTIONS / HTTP/1.0" 200 134 0.000768
Sep 28 11:43:06 ctl02 glance-api[29183]: 2017-09-28 11:43:06.476 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:43:06] "OPTIONS / HTTP/1.0" 200 134 0.000776
Sep 28 11:43:07 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x14e33279)
Sep 28 11:43:09 ctl02 dhclient[627]: message repeated 2 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x14e33279)]
Sep 28 11:43:09 ctl02 glance-api[29183]: 2017-09-28 11:43:09.282 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:43:09] "OPTIONS / HTTP/1.0" 200 134 0.000769
Sep 28 11:43:10 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x14e33279)
Sep 28 11:43:14 ctl02 dhclient[627]: message repeated 4 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x14e33279)]
Sep 28 11:43:15 ctl02 glance-api[29183]: 2017-09-28 11:43:15.045 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:43:15] "OPTIONS / HTTP/1.0" 200 134 0.000884
Sep 28 11:43:15 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x14e33279)
Sep 28 11:43:16 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x14e33279)
Sep 28 11:43:16 ctl02 glance-api[29183]: 2017-09-28 11:43:16.435 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:43:16] "OPTIONS / HTTP/1.0" 200 134 0.000774
Sep 28 11:43:17 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x14e33279)
Sep 28 11:43:18 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:43:18 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:43:19 ctl02 glance-api[29183]: 2017-09-28 11:43:19.583 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:43:19] "OPTIONS / HTTP/1.0" 200 134 0.000758
Sep 28 11:43:25 ctl02 glance-api[29183]: 2017-09-28 11:43:25.317 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:43:25] "OPTIONS / HTTP/1.0" 200 134 0.000785
Sep 28 11:43:26 ctl02 glance-api[29183]: 2017-09-28 11:43:26.382 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:43:26] "OPTIONS / HTTP/1.0" 200 134 0.000723
Sep 28 11:43:29 ctl02 glance-api[29183]: 2017-09-28 11:43:29.341 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:43:29] "OPTIONS / HTTP/1.0" 200 134 0.000842
Sep 28 11:43:33 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb0294034)
Sep 28 11:43:35 ctl02 dhclient[627]: message repeated 2 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb0294034)]
Sep 28 11:43:35 ctl02 glance-api[29183]: 2017-09-28 11:43:35.203 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:43:35] "OPTIONS / HTTP/1.0" 200 134 0.000850
Sep 28 11:43:36 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb0294034)
Sep 28 11:43:36 ctl02 glance-api[29183]: 2017-09-28 11:43:36.617 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:43:36] "OPTIONS / HTTP/1.0" 200 134 0.000790
Sep 28 11:43:37 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb0294034)
Sep 28 11:43:39 ctl02 dhclient[627]: message repeated 2 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb0294034)]
Sep 28 11:43:39 ctl02 glance-api[29183]: 2017-09-28 11:43:39.319 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:43:39] "OPTIONS / HTTP/1.0" 200 134 0.000750
Sep 28 11:43:40 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb0294034)
Sep 28 11:43:43 ctl02 dhclient[627]: message repeated 3 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb0294034)]
Sep 28 11:43:44 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:43:44 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:43:44 ctl02 glance-api[29183]: 2017-09-28 11:43:44.923 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:43:44] "OPTIONS / HTTP/1.0" 200 134 0.000771
Sep 28 11:43:46 ctl02 glance-api[29183]: 2017-09-28 11:43:46.434 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:43:46] "OPTIONS / HTTP/1.0" 200 134 0.000826
Sep 28 11:43:49 ctl02 glance-api[29183]: 2017-09-28 11:43:49.462 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:43:49] "OPTIONS / HTTP/1.0" 200 134 0.000743
Sep 28 11:43:54 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xca0ae92b)
Sep 28 11:43:54 ctl02 glance-api[29183]: 2017-09-28 11:43:54.665 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:43:54] "OPTIONS / HTTP/1.0" 200 134 0.000647
Sep 28 11:43:55 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xca0ae92b)
Sep 28 11:43:56 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xca0ae92b)
Sep 28 11:43:56 ctl02 glance-api[29183]: 2017-09-28 11:43:56.394 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:43:56] "OPTIONS / HTTP/1.0" 200 134 0.000703
Sep 28 11:43:57 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xca0ae92b)
Sep 28 11:43:59 ctl02 dhclient[627]: message repeated 2 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xca0ae92b)]
Sep 28 11:43:59 ctl02 glance-api[29183]: 2017-09-28 11:43:59.396 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:43:59] "OPTIONS / HTTP/1.0" 200 134 0.000830
Sep 28 11:44:00 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xca0ae92b)
Sep 28 11:44:04 ctl02 dhclient[627]: message repeated 4 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xca0ae92b)]
Sep 28 11:44:04 ctl02 glance-api[29183]: 2017-09-28 11:44:04.365 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:44:04] "OPTIONS / HTTP/1.0" 200 134 0.000857
Sep 28 11:44:05 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:44:05 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:44:06 ctl02 glance-api[29183]: 2017-09-28 11:44:06.739 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:44:06] "OPTIONS / HTTP/1.0" 200 134 0.000836
Sep 28 11:44:09 ctl02 glance-api[29183]: 2017-09-28 11:44:09.279 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:44:09] "OPTIONS / HTTP/1.0" 200 134 0.000820
Sep 28 11:44:14 ctl02 glance-api[29183]: 2017-09-28 11:44:14.332 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:44:14] "OPTIONS / HTTP/1.0" 200 134 0.000797
Sep 28 11:44:17 ctl02 glance-api[29183]: 2017-09-28 11:44:17.061 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:44:17] "OPTIONS / HTTP/1.0" 200 134 0.000873
Sep 28 11:44:19 ctl02 glance-api[29183]: 2017-09-28 11:44:19.481 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:44:19] "OPTIONS / HTTP/1.0" 200 134 0.000808
Sep 28 11:44:22 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x44288c56)
Sep 28 11:44:23 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x44288c56)
Sep 28 11:44:24 ctl02 glance-api[29183]: 2017-09-28 11:44:24.367 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:44:24] "OPTIONS / HTTP/1.0" 200 134 0.000837
Sep 28 11:44:24 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x44288c56)
Sep 28 11:44:26 ctl02 dhclient[627]: message repeated 2 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x44288c56)]
Sep 28 11:44:27 ctl02 glance-api[29183]: 2017-09-28 11:44:27.057 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:44:27] "OPTIONS / HTTP/1.0" 200 134 0.000841
Sep 28 11:44:27 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x44288c56)
Sep 28 11:44:29 ctl02 dhclient[627]: message repeated 2 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x44288c56)]
Sep 28 11:44:29 ctl02 glance-api[29183]: 2017-09-28 11:44:29.707 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:44:29] "OPTIONS / HTTP/1.0" 200 134 0.000763
Sep 28 11:44:30 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x44288c56)
Sep 28 11:44:32 ctl02 dhclient[627]: message repeated 2 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x44288c56)]
Sep 28 11:44:33 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:44:33 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:44:34 ctl02 glance-api[29183]: 2017-09-28 11:44:34.366 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:44:34] "OPTIONS / HTTP/1.0" 200 134 0.000765
Sep 28 11:44:36 ctl02 glance-api[29183]: 2017-09-28 11:44:36.905 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:44:36] "OPTIONS / HTTP/1.0" 200 134 0.000940
Sep 28 11:44:39 ctl02 glance-api[29183]: 2017-09-28 11:44:39.969 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:44:39] "OPTIONS / HTTP/1.0" 200 134 0.001318
Sep 28 11:44:44 ctl02 glance-api[29183]: 2017-09-28 11:44:44.166 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:44:44] "OPTIONS / HTTP/1.0" 200 134 0.000735
Sep 28 11:44:44 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3a29c041)
Sep 28 11:44:46 ctl02 dhclient[627]: message repeated 2 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3a29c041)]
Sep 28 11:44:46 ctl02 glance-api[29183]: 2017-09-28 11:44:46.913 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:44:46] "OPTIONS / HTTP/1.0" 200 134 0.000802
Sep 28 11:44:47 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3a29c041)
Sep 28 11:44:48 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3a29c041)
Sep 28 11:44:49 ctl02 dhclient[600]: DHCPREQUEST of 192.168.11.25 on ens2 to 192.168.11.3 port 67 (xid=0x3415f07)
Sep 28 11:44:49 ctl02 dhclient[600]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 11:44:49 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 11:44:49 ctl02 ntp[3804]:  * Stopping NTP server ntpd
Sep 28 11:44:49 ctl02 ntp[3804]:    ...done.
Sep 28 11:44:49 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 11:44:49 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 11:44:49 ctl02 ntp[3815]:  * Starting NTP server ntpd
Sep 28 11:44:49 ctl02 ntpd[3822]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 11:44:49 ctl02 ntpd[3822]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -c /var/lib/ntp/ntp.conf.dhcp -u 108:112
Sep 28 11:44:49 ctl02 ntp[3815]:    ...done.
Sep 28 11:44:49 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 11:44:49 ctl02 ntpd[3825]: proto: precision = 0.042 usec (-24)
Sep 28 11:44:49 ctl02 ntpd[3825]: switching logging to file /var/log/ntp.log
Sep 28 11:44:49 ctl02 dhclient[600]: bound to 192.168.11.25 -- renewal in 258 seconds.
Sep 28 11:44:49 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3a29c041)
Sep 28 11:44:50 ctl02 glance-api[29183]: 2017-09-28 11:44:50.128 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:44:50] "OPTIONS / HTTP/1.0" 200 134 0.000854
Sep 28 11:44:50 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3a29c041)
Sep 28 11:44:53 ctl02 dhclient[627]: message repeated 3 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3a29c041)]
Sep 28 11:44:53 ctl02 glance-api[29183]: 2017-09-28 11:44:53.867 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:44:53] "OPTIONS / HTTP/1.0" 200 134 0.000545
Sep 28 11:44:54 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3a29c041)
Sep 28 11:44:55 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:44:55 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:44:55 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 11:44:55 ctl02 ntp[3878]:  * Stopping NTP server ntpd
Sep 28 11:44:55 ctl02 ntp[3878]:    ...done.
Sep 28 11:44:55 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 11:44:55 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 11:44:55 ctl02 ntp[3889]:  * Starting NTP server ntpd
Sep 28 11:44:55 ctl02 ntpd[3896]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 11:44:55 ctl02 ntpd[3896]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 11:44:55 ctl02 ntp[3889]:    ...done.
Sep 28 11:44:55 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 11:44:55 ctl02 ntpd[3899]: proto: precision = 0.042 usec (-24)
Sep 28 11:44:55 ctl02 ntpd[3899]: switching logging to file /var/log/ntp.log
Sep 28 11:44:57 ctl02 glance-api[29183]: 2017-09-28 11:44:57.075 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:44:57] "OPTIONS / HTTP/1.0" 200 134 0.000756
Sep 28 11:45:00 ctl02 glance-api[29183]: 2017-09-28 11:45:00.034 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:45:00] "OPTIONS / HTTP/1.0" 200 134 0.000717
Sep 28 11:45:04 ctl02 glance-api[29183]: 2017-09-28 11:45:04.078 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:45:04] "OPTIONS / HTTP/1.0" 200 134 0.000859
Sep 28 11:45:07 ctl02 glance-api[29183]: 2017-09-28 11:45:07.262 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:45:07] "OPTIONS / HTTP/1.0" 200 134 0.000833
Sep 28 11:45:08 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x46863a0d)
Sep 28 11:45:09 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x46863a0d)
Sep 28 11:45:10 ctl02 glance-api[29183]: 2017-09-28 11:45:10.036 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:45:10] "OPTIONS / HTTP/1.0" 200 134 0.000678
Sep 28 11:45:10 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x46863a0d)
Sep 28 11:45:13 ctl02 dhclient[627]: message repeated 3 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x46863a0d)]
Sep 28 11:45:14 ctl02 glance-api[29183]: 2017-09-28 11:45:14.002 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:45:14] "OPTIONS / HTTP/1.0" 200 134 0.000791
Sep 28 11:45:14 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x46863a0d)
Sep 28 11:45:16 ctl02 dhclient[627]: message repeated 2 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x46863a0d)]
Sep 28 11:45:17 ctl02 glance-api[29183]: 2017-09-28 11:45:17.464 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:45:17] "OPTIONS / HTTP/1.0" 200 134 0.000858
Sep 28 11:45:17 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x46863a0d)
Sep 28 11:45:18 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x46863a0d)
Sep 28 11:45:19 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:45:19 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:45:20 ctl02 glance-api[29183]: 2017-09-28 11:45:20.135 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:45:20] "OPTIONS / HTTP/1.0" 200 134 0.000760
Sep 28 11:45:24 ctl02 glance-api[29183]: 2017-09-28 11:45:24.341 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:45:24] "OPTIONS / HTTP/1.0" 200 134 0.000868
Sep 28 11:45:27 ctl02 glance-api[29183]: 2017-09-28 11:45:27.743 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:45:27] "OPTIONS / HTTP/1.0" 200 134 0.000714
Sep 28 11:45:30 ctl02 glance-api[29183]: 2017-09-28 11:45:30.512 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:45:30] "OPTIONS / HTTP/1.0" 200 134 0.000735
Sep 28 11:45:32 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xab667140)
Sep 28 11:45:33 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xab667140)
Sep 28 11:45:34 ctl02 glance-api[29183]: 2017-09-28 11:45:34.070 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:45:34] "OPTIONS / HTTP/1.0" 200 134 0.000704
Sep 28 11:45:34 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xab667140)
Sep 28 11:45:37 ctl02 dhclient[627]: message repeated 3 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xab667140)]
Sep 28 11:45:37 ctl02 glance-api[29183]: 2017-09-28 11:45:37.400 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:45:37] "OPTIONS / HTTP/1.0" 200 134 0.000834
Sep 28 11:45:38 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xab667140)
Sep 28 11:45:40 ctl02 dhclient[627]: message repeated 2 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xab667140)]
Sep 28 11:45:40 ctl02 glance-api[29183]: 2017-09-28 11:45:40.333 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:45:40] "OPTIONS / HTTP/1.0" 200 134 0.000790
Sep 28 11:45:41 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xab667140)
Sep 28 11:45:42 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xab667140)
Sep 28 11:45:43 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:45:43 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:45:44 ctl02 glance-api[29183]: 2017-09-28 11:45:44.316 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:45:44] "OPTIONS / HTTP/1.0" 200 134 0.000668
Sep 28 11:45:47 ctl02 glance-api[29183]: 2017-09-28 11:45:47.091 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:45:47] "OPTIONS / HTTP/1.0" 200 134 0.000976
Sep 28 11:45:50 ctl02 glance-api[29183]: 2017-09-28 11:45:50.064 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:45:50] "OPTIONS / HTTP/1.0" 200 134 0.000746
Sep 28 11:45:53 ctl02 glance-api[29183]: 2017-09-28 11:45:53.966 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:45:53] "OPTIONS / HTTP/1.0" 200 134 0.000606
Sep 28 11:45:55 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6908e255)
Sep 28 11:45:56 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6908e255)
Sep 28 11:45:57 ctl02 glance-api[29183]: 2017-09-28 11:45:57.370 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:45:57] "OPTIONS / HTTP/1.0" 200 134 0.000640
Sep 28 11:45:57 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6908e255)
Sep 28 11:45:59 ctl02 dhclient[627]: message repeated 2 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6908e255)]
Sep 28 11:46:00 ctl02 glance-api[29183]: 2017-09-28 11:46:00.119 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:46:00] "OPTIONS / HTTP/1.0" 200 134 0.000798
Sep 28 11:46:00 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6908e255)
Sep 28 11:46:02 ctl02 dhclient[627]: message repeated 2 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6908e255)]
Sep 28 11:46:03 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command state.sls with jid 20170928114603376748
Sep 28 11:46:03 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 3916
Sep 28 11:46:03 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6908e255)
Sep 28 11:46:03 ctl02 glance-api[29183]: 2017-09-28 11:46:03.970 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:46:03] "OPTIONS / HTTP/1.0" 200 134 0.000782
Sep 28 11:46:04 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6908e255)
Sep 28 11:46:05 ctl02 salt-minion[14967]: [INFO    ] Loading fresh modules for state activity
Sep 28 11:46:05 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'nova/init.sls'
Sep 28 11:46:05 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'nova/controller.sls'
Sep 28 11:46:05 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'nova/map.jinja'
Sep 28 11:46:05 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6908e255)
Sep 28 11:46:06 ctl02 salt-minion[14967]: [INFO    ] Running state [debconf-utils] at time 11:46:06.027059
Sep 28 11:46:06 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for debconf-utils
Sep 28 11:46:06 ctl02 salt-minion[14967]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 11:46:06 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:46:06 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:46:06 ctl02 salt-minion[14967]: [INFO    ] Package debconf-utils is already installed
Sep 28 11:46:06 ctl02 salt-minion[14967]: [INFO    ] Completed state [debconf-utils] at time 11:46:06.487549 duration_in_ms=460.489
Sep 28 11:46:06 ctl02 salt-minion[14967]: [INFO    ] Running state [nova-consoleproxy] at time 11:46:06.488654
Sep 28 11:46:06 ctl02 salt-minion[14967]: [INFO    ] Executing state debconf.set for nova-consoleproxy
Sep 28 11:46:06 ctl02 salt-minion[14967]: [INFO    ] Executing command 'debconf-get-selections' in directory '/root'
Sep 28 11:46:06 ctl02 salt-minion[14967]: [INFO    ] Executing command 'debconf-set-selections /tmp/salt-OFiJHL' in directory '/root'
Sep 28 11:46:06 ctl02 salt-minion[14967]: [INFO    ] {'nova-consoleproxy/daemon_type': 'novnc'}
Sep 28 11:46:06 ctl02 salt-minion[14967]: [INFO    ] Completed state [nova-consoleproxy] at time 11:46:06.800366 duration_in_ms=311.71
Sep 28 11:46:06 ctl02 salt-minion[14967]: [INFO    ] Running state [nova] at time 11:46:06.803549
Sep 28 11:46:06 ctl02 salt-minion[14967]: [INFO    ] Executing state group.present for nova
Sep 28 11:46:06 ctl02 salt-minion[14967]: [INFO    ] Executing command 'groupadd -g 303 -r nova' in directory '/root'
Sep 28 11:46:06 ctl02 salt-minion[14967]: [INFO    ] {'passwd': 'x', 'gid': 303, 'name': 'nova', 'members': []}
Sep 28 11:46:06 ctl02 salt-minion[14967]: [INFO    ] Completed state [nova] at time 11:46:06.887538 duration_in_ms=83.987
Sep 28 11:46:06 ctl02 salt-minion[14967]: [INFO    ] Running state [nova] at time 11:46:06.887984
Sep 28 11:46:06 ctl02 salt-minion[14967]: [INFO    ] Executing state user.present for nova
Sep 28 11:46:06 ctl02 salt-minion[14967]: [INFO    ] Executing command ['useradd', '-s', '/bin/false', '-u', '303', '-g', '303', '-m', '-d', '/var/lib/nova', '-r', 'nova'] in directory '/root'
Sep 28 11:46:07 ctl02 glance-api[29183]: 2017-09-28 11:46:07.023 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:46:07] "OPTIONS / HTTP/1.0" 200 134 0.000586
Sep 28 11:46:07 ctl02 salt-minion[14967]: [INFO    ] {'shell': '/bin/false', 'workphone': '', 'uid': 303, 'passwd': 'x', 'roomnumber': '', 'groups': ['nova'], 'home': '/var/lib/nova', 'name': 'nova', 'gid': 303, 'fullname': '', 'homephone': ''}
Sep 28 11:46:07 ctl02 salt-minion[14967]: [INFO    ] Completed state [nova] at time 11:46:07.043915 duration_in_ms=155.929
Sep 28 11:46:07 ctl02 salt-minion[14967]: [INFO    ] Running state [python-novaclient] at time 11:46:07.044439
Sep 28 11:46:07 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for python-novaclient
Sep 28 11:46:07 ctl02 salt-minion[14967]: [INFO    ] Package python-novaclient is already installed
Sep 28 11:46:07 ctl02 salt-minion[14967]: [INFO    ] Completed state [python-novaclient] at time 11:46:07.047865 duration_in_ms=3.425
Sep 28 11:46:07 ctl02 salt-minion[14967]: [INFO    ] Running state [nova-doc] at time 11:46:07.048306
Sep 28 11:46:07 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for nova-doc
Sep 28 11:46:07 ctl02 salt-minion[14967]: [INFO    ] Executing command ['apt-get', '-q', 'update'] in directory '/root'
Sep 28 11:46:10 ctl02 glance-api[29183]: 2017-09-28 11:46:10.167 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:46:10] "OPTIONS / HTTP/1.0" 200 134 0.000764
Sep 28 11:46:13 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928114613420247
Sep 28 11:46:13 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 4221
Sep 28 11:46:13 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928114613420247
Sep 28 11:46:14 ctl02 glance-api[29183]: 2017-09-28 11:46:14.024 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:46:14] "OPTIONS / HTTP/1.0" 200 134 0.000777
Sep 28 11:46:16 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x89215506)
Sep 28 11:46:16 ctl02 glance-api[29183]: 2017-09-28 11:46:16.950 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:46:16] "OPTIONS / HTTP/1.0" 200 134 0.000767
Sep 28 11:46:17 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x89215506)
Sep 28 11:46:19 ctl02 dhclient[627]: message repeated 2 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x89215506)]
Sep 28 11:46:20 ctl02 glance-api[29183]: 2017-09-28 11:46:20.040 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:46:20] "OPTIONS / HTTP/1.0" 200 134 0.000930
Sep 28 11:46:20 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x89215506)
Sep 28 11:46:22 ctl02 dhclient[627]: message repeated 2 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x89215506)]
Sep 28 11:46:23 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928114623582914
Sep 28 11:46:23 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 4226
Sep 28 11:46:23 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928114623582914
Sep 28 11:46:23 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x89215506)
Sep 28 11:46:24 ctl02 glance-api[29183]: 2017-09-28 11:46:24.294 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:46:24] "OPTIONS / HTTP/1.0" 200 134 0.000786
Sep 28 11:46:24 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x89215506)
Sep 28 11:46:25 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x89215506)
Sep 28 11:46:26 ctl02 glance-api[29183]: 2017-09-28 11:46:26.866 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:46:26] "OPTIONS / HTTP/1.0" 200 134 0.001113
Sep 28 11:46:26 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x89215506)
Sep 28 11:46:27 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:46:27 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:46:30 ctl02 glance-api[29183]: 2017-09-28 11:46:30.316 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:46:30] "OPTIONS / HTTP/1.0" 200 134 0.000801
Sep 28 11:46:33 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928114633749387
Sep 28 11:46:33 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 4236
Sep 28 11:46:33 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928114633749387
Sep 28 11:46:34 ctl02 glance-api[29183]: 2017-09-28 11:46:34.421 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:46:34] "OPTIONS / HTTP/1.0" 200 134 0.000776
Sep 28 11:46:37 ctl02 glance-api[29183]: 2017-09-28 11:46:37.086 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:46:37] "OPTIONS / HTTP/1.0" 200 134 0.001176
Sep 28 11:46:40 ctl02 glance-api[29183]: 2017-09-28 11:46:40.258 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:46:40] "OPTIONS / HTTP/1.0" 200 134 0.000751
Sep 28 11:46:41 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf5d8ec2f)
Sep 28 11:46:43 ctl02 dhclient[627]: message repeated 2 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf5d8ec2f)]
Sep 28 11:46:43 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928114643926282
Sep 28 11:46:43 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 4241
Sep 28 11:46:43 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928114643926282
Sep 28 11:46:44 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf5d8ec2f)
Sep 28 11:46:44 ctl02 glance-api[29183]: 2017-09-28 11:46:44.317 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:46:44] "OPTIONS / HTTP/1.0" 200 134 0.000843
Sep 28 11:46:45 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf5d8ec2f)
Sep 28 11:46:46 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf5d8ec2f)
Sep 28 11:46:46 ctl02 glance-api[29183]: 2017-09-28 11:46:46.778 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:46:46] "OPTIONS / HTTP/1.0" 200 134 0.000800
Sep 28 11:46:47 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf5d8ec2f)
Sep 28 11:46:50 ctl02 dhclient[627]: message repeated 3 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf5d8ec2f)]
Sep 28 11:46:50 ctl02 glance-api[29183]: 2017-09-28 11:46:50.479 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:46:50] "OPTIONS / HTTP/1.0" 200 134 0.000830
Sep 28 11:46:51 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf5d8ec2f)
Sep 28 11:46:52 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:46:52 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:46:54 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928114654116049
Sep 28 11:46:54 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 4251
Sep 28 11:46:54 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928114654116049
Sep 28 11:46:54 ctl02 glance-api[29183]: 2017-09-28 11:46:54.472 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:46:54] "OPTIONS / HTTP/1.0" 200 134 0.000824
Sep 28 11:46:56 ctl02 glance-api[29183]: 2017-09-28 11:46:56.951 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:46:56] "OPTIONS / HTTP/1.0" 200 134 0.000949
Sep 28 11:47:00 ctl02 glance-api[29183]: 2017-09-28 11:47:00.282 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:47:00] "OPTIONS / HTTP/1.0" 200 134 0.000689
Sep 28 11:47:02 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2df7e86d)
Sep 28 11:47:03 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2df7e86d)
Sep 28 11:47:04 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928114704319828
Sep 28 11:47:04 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 4256
Sep 28 11:47:04 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928114704319828
Sep 28 11:47:04 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2df7e86d)
Sep 28 11:47:04 ctl02 glance-api[29183]: 2017-09-28 11:47:04.491 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:47:04] "OPTIONS / HTTP/1.0" 200 134 0.000836
Sep 28 11:47:05 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2df7e86d)
Sep 28 11:47:06 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2df7e86d)
Sep 28 11:47:06 ctl02 glance-api[29183]: 2017-09-28 11:47:06.697 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:47:06] "OPTIONS / HTTP/1.0" 200 134 0.000767
Sep 28 11:47:07 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2df7e86d)
Sep 28 11:47:09 ctl02 dhclient[627]: message repeated 2 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2df7e86d)]
Sep 28 11:47:10 ctl02 glance-api[29183]: 2017-09-28 11:47:10.019 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:47:10] "OPTIONS / HTTP/1.0" 200 134 0.000789
Sep 28 11:47:10 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2df7e86d)
Sep 28 11:47:12 ctl02 dhclient[627]: message repeated 2 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2df7e86d)]
Sep 28 11:47:13 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:47:13 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:47:14 ctl02 glance-api[29183]: 2017-09-28 11:47:14.464 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:47:14] "OPTIONS / HTTP/1.0" 200 134 0.000795
Sep 28 11:47:14 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928114714526215
Sep 28 11:47:14 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 4266
Sep 28 11:47:14 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928114714526215
Sep 28 11:47:16 ctl02 glance-api[29183]: 2017-09-28 11:47:16.378 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:47:16] "OPTIONS / HTTP/1.0" 200 134 0.000816
Sep 28 11:47:20 ctl02 glance-api[29183]: 2017-09-28 11:47:20.282 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:47:20] "OPTIONS / HTTP/1.0" 200 134 0.000797
Sep 28 11:47:24 ctl02 glance-api[29183]: 2017-09-28 11:47:24.575 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:47:24] "OPTIONS / HTTP/1.0" 200 134 0.000756
Sep 28 11:47:24 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928114724737916
Sep 28 11:47:24 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 4271
Sep 28 11:47:24 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928114724737916
Sep 28 11:47:26 ctl02 glance-api[29183]: 2017-09-28 11:47:26.587 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:47:26] "OPTIONS / HTTP/1.0" 200 134 0.000783
Sep 28 11:47:27 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xac718b0a)
Sep 28 11:47:29 ctl02 dhclient[627]: message repeated 2 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xac718b0a)]
Sep 28 11:47:30 ctl02 glance-api[29183]: 2017-09-28 11:47:30.476 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:47:30] "OPTIONS / HTTP/1.0" 200 134 0.000836
Sep 28 11:47:30 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xac718b0a)
Sep 28 11:47:33 ctl02 dhclient[627]: message repeated 3 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xac718b0a)]
Sep 28 11:47:34 ctl02 glance-api[29183]: 2017-09-28 11:47:34.770 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:47:34] "OPTIONS / HTTP/1.0" 200 134 0.000754
Sep 28 11:47:34 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xac718b0a)
Sep 28 11:47:34 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928114734959569
Sep 28 11:47:34 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 4276
Sep 28 11:47:34 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928114734959569
Sep 28 11:47:35 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xac718b0a)
Sep 28 11:47:36 ctl02 glance-api[29183]: 2017-09-28 11:47:36.571 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:47:36] "OPTIONS / HTTP/1.0" 200 134 0.000850
Sep 28 11:47:36 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xac718b0a)
Sep 28 11:47:37 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xac718b0a)
Sep 28 11:47:38 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:47:38 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:47:40 ctl02 glance-api[29183]: 2017-09-28 11:47:40.178 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:47:40] "OPTIONS / HTTP/1.0" 200 134 0.000796
Sep 28 11:47:44 ctl02 glance-api[29183]: 2017-09-28 11:47:44.697 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:47:44] "OPTIONS / HTTP/1.0" 200 134 0.000838
Sep 28 11:47:45 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928114745188859
Sep 28 11:47:45 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 4286
Sep 28 11:47:45 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928114745188859
Sep 28 11:47:46 ctl02 glance-api[29183]: 2017-09-28 11:47:46.301 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:47:46] "OPTIONS / HTTP/1.0" 200 134 0.000893
Sep 28 11:47:49 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd1c48825)
Sep 28 11:47:50 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd1c48825)
Sep 28 11:47:50 ctl02 glance-api[29183]: 2017-09-28 11:47:50.352 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:47:50] "OPTIONS / HTTP/1.0" 200 134 0.000869
Sep 28 11:47:51 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd1c48825)
Sep 28 11:47:54 ctl02 dhclient[627]: message repeated 3 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd1c48825)]
Sep 28 11:47:54 ctl02 glance-api[29183]: 2017-09-28 11:47:54.320 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:47:54] "OPTIONS / HTTP/1.0" 200 134 0.000871
Sep 28 11:47:55 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd1c48825)
Sep 28 11:47:55 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928114755218324
Sep 28 11:47:55 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 4291
Sep 28 11:47:55 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928114755218324
Sep 28 11:47:56 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd1c48825)
Sep 28 11:47:56 ctl02 glance-api[29183]: 2017-09-28 11:47:56.624 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:47:56] "OPTIONS / HTTP/1.0" 200 134 0.000843
Sep 28 11:47:57 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd1c48825)
Sep 28 11:47:59 ctl02 dhclient[627]: message repeated 2 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd1c48825)]
Sep 28 11:47:59 ctl02 glance-api[29183]: 2017-09-28 11:47:59.971 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:47:59] "OPTIONS / HTTP/1.0" 200 134 0.000846
Sep 28 11:48:00 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:48:00 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:48:04 ctl02 glance-api[29183]: 2017-09-28 11:48:04.691 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:48:04] "OPTIONS / HTTP/1.0" 200 134 0.000804
Sep 28 11:48:05 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928114805257320
Sep 28 11:48:05 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 4301
Sep 28 11:48:05 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928114805257320
Sep 28 11:48:07 ctl02 glance-api[29183]: 2017-09-28 11:48:07.023 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:48:07] "OPTIONS / HTTP/1.0" 200 134 0.000836
Sep 28 11:48:09 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemd-run', '--scope', 'apt-get', '-q', '-y', '-o', 'DPkg::Options::=--force-confold', '-o', 'DPkg::Options::=--force-confdef', 'install', 'nova-doc'] in directory '/root'
Sep 28 11:48:09 ctl02 systemd[1]: Started /usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold -o DPkg::Options::=--force-confdef install nova-doc.
Sep 28 11:48:09 ctl02 glance-api[29183]: 2017-09-28 11:48:09.745 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:48:09] "OPTIONS / HTTP/1.0" 200 134 0.000727
Sep 28 11:48:12 ctl02 salt-minion[14967]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 11:48:12 ctl02 salt-minion[14967]: [INFO    ] Made the following changes:
Sep 28 11:48:12 ctl02 salt-minion[14967]: 'nova-doc' changed from 'absent' to '2:13.1.4-0ubuntu3'
Sep 28 11:48:12 ctl02 salt-minion[14967]: [INFO    ] Loading fresh modules for state activity
Sep 28 11:48:12 ctl02 salt-minion[14967]: [INFO    ] Completed state [nova-doc] at time 11:48:12.770868 duration_in_ms=125722.561
Sep 28 11:48:12 ctl02 salt-minion[14967]: [INFO    ] Running state [nova-cert] at time 11:48:12.776338
Sep 28 11:48:12 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for nova-cert
Sep 28 11:48:12 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemd-run', '--scope', 'apt-get', '-q', '-y', '-o', 'DPkg::Options::=--force-confold', '-o', 'DPkg::Options::=--force-confdef', 'install', 'nova-cert'] in directory '/root'
Sep 28 11:48:13 ctl02 systemd[1]: Started /usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold -o DPkg::Options::=--force-confdef install nova-cert.
Sep 28 11:48:14 ctl02 glance-api[29183]: 2017-09-28 11:48:14.848 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:48:14] "OPTIONS / HTTP/1.0" 200 134 0.000800
Sep 28 11:48:15 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928114815303676
Sep 28 11:48:15 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 4525
Sep 28 11:48:15 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928114815303676
Sep 28 11:48:17 ctl02 glance-api[29183]: 2017-09-28 11:48:17.146 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:48:17] "OPTIONS / HTTP/1.0" 200 134 0.000860
Sep 28 11:48:19 ctl02 glance-api[29183]: 2017-09-28 11:48:19.708 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:48:19] "OPTIONS / HTTP/1.0" 200 134 0.000828
Sep 28 11:48:22 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc0cd112f)
Sep 28 11:48:23 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc0cd112f)
Sep 28 11:48:23 ctl02 systemd[1]: Reloading.
Sep 28 11:48:24 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc0cd112f)
Sep 28 11:48:25 ctl02 glance-api[29183]: 2017-09-28 11:48:25.017 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:48:25] "OPTIONS / HTTP/1.0" 200 134 0.000880
Sep 28 11:48:25 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928114825357610
Sep 28 11:48:25 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 4702
Sep 28 11:48:25 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928114825357610
Sep 28 11:48:25 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc0cd112f)
Sep 28 11:48:26 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc0cd112f)
Sep 28 11:48:27 ctl02 glance-api[29183]: 2017-09-28 11:48:27.185 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:48:27] "OPTIONS / HTTP/1.0" 200 134 0.000660
Sep 28 11:48:27 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc0cd112f)
Sep 28 11:48:28 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc0cd112f)
Sep 28 11:48:29 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc0cd112f)
Sep 28 11:48:29 ctl02 glance-api[29183]: 2017-09-28 11:48:29.693 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:48:29] "OPTIONS / HTTP/1.0" 200 134 0.000613
Sep 28 11:48:30 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc0cd112f)
Sep 28 11:48:32 ctl02 dhclient[627]: message repeated 2 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc0cd112f)]
Sep 28 11:48:33 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:48:33 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:48:34 ctl02 glance-api[29183]: 2017-09-28 11:48:34.914 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:48:34] "OPTIONS / HTTP/1.0" 200 134 0.000746
Sep 28 11:48:35 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928114835413446
Sep 28 11:48:35 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 4769
Sep 28 11:48:35 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928114835413446
Sep 28 11:48:37 ctl02 glance-api[29183]: 2017-09-28 11:48:37.038 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:48:37] "OPTIONS / HTTP/1.0" 200 134 0.000554
Sep 28 11:48:39 ctl02 glance-api[29183]: 2017-09-28 11:48:39.323 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:48:39] "OPTIONS / HTTP/1.0" 200 134 0.000535
Sep 28 11:48:43 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcd55d34f)
Sep 28 11:48:44 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcd55d34f)
Sep 28 11:48:44 ctl02 glance-api[29183]: 2017-09-28 11:48:44.574 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:48:44] "OPTIONS / HTTP/1.0" 200 134 0.000816
Sep 28 11:48:45 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcd55d34f)
Sep 28 11:48:45 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928114845468983
Sep 28 11:48:45 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 4774
Sep 28 11:48:45 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928114845468983
Sep 28 11:48:46 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcd55d34f)
Sep 28 11:48:46 ctl02 glance-api[29183]: 2017-09-28 11:48:46.777 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:48:46] "OPTIONS / HTTP/1.0" 200 134 0.000684
Sep 28 11:48:47 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcd55d34f)
Sep 28 11:48:49 ctl02 dhclient[627]: message repeated 2 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcd55d34f)]
Sep 28 11:48:49 ctl02 glance-api[29183]: 2017-09-28 11:48:49.152 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:48:49] "OPTIONS / HTTP/1.0" 200 134 0.000562
Sep 28 11:48:50 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcd55d34f)
Sep 28 11:48:53 ctl02 dhclient[627]: message repeated 3 times: [ DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcd55d34f)]
Sep 28 11:48:54 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:48:54 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:48:54 ctl02 glance-api[29183]: 2017-09-28 11:48:54.534 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:48:54] "OPTIONS / HTTP/1.0" 200 134 0.000600
Sep 28 11:48:55 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928114855553917
Sep 28 11:48:55 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 4784
Sep 28 11:48:55 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928114855553917
Sep 28 11:48:56 ctl02 glance-api[29183]: 2017-09-28 11:48:56.670 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:48:56] "OPTIONS / HTTP/1.0" 200 134 0.000739
Sep 28 11:48:58 ctl02 glance-api[29183]: 2017-09-28 11:48:58.847 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:48:58] "OPTIONS / HTTP/1.0" 200 134 0.000899
Sep 28 11:49:03 ctl02 systemd[1]: Reloading.
Sep 28 11:49:03 ctl02 systemd[1]: message repeated 2 times: [ Reloading.]
Sep 28 11:49:03 ctl02 systemd[1]: Starting OpenStack Compute Cert...
Sep 28 11:49:03 ctl02 systemd[1]: Started OpenStack Compute Cert.
Sep 28 11:49:03 ctl02 systemd[1]: Reloading.
Sep 28 11:49:04 ctl02 glance-api[29183]: 2017-09-28 11:49:04.308 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:49:04] "OPTIONS / HTTP/1.0" 200 134 0.000661
Sep 28 11:49:04 ctl02 salt-minion[14967]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 11:49:04 ctl02 salt-minion[14967]: [INFO    ] Made the following changes:
Sep 28 11:49:04 ctl02 salt-minion[14967]: 'python-oslo.versionedobjects' changed from 'absent' to '1.8.0-1'
Sep 28 11:49:04 ctl02 salt-minion[14967]: 'python-os-brick' changed from 'absent' to '1.2.0-2ubuntu0.3'
Sep 28 11:49:04 ctl02 salt-minion[14967]: 'python-os-win' changed from 'absent' to '0.4.1-2'
Sep 28 11:49:04 ctl02 salt-minion[14967]: 'nova-common' changed from 'absent' to '2:13.1.4-0ubuntu3'
Sep 28 11:49:04 ctl02 salt-minion[14967]: 'python-oslo.rootwrap' changed from 'absent' to '4.1.0-2'
Sep 28 11:49:04 ctl02 salt-minion[14967]: 'python2.7-paramiko' changed from 'absent' to '1'
Sep 28 11:49:04 ctl02 salt-minion[14967]: 'python-rfc3986' changed from 'absent' to '0.2.2-0ubuntu0.16.04.1'
Sep 28 11:49:04 ctl02 salt-minion[14967]: 'python-nova' changed from 'absent' to '2:13.1.4-0ubuntu3'
Sep 28 11:49:04 ctl02 salt-minion[14967]: 'python2.7-nova' changed from 'absent' to '1'
Sep 28 11:49:04 ctl02 salt-minion[14967]: 'python-boto' changed from 'absent' to '2.38.0-1ubuntu1'
Sep 28 11:49:04 ctl02 salt-minion[14967]: 'python-paramiko' changed from 'absent' to '1.16.0-1'
Sep 28 11:49:04 ctl02 salt-minion[14967]: 'python-ecdsa' changed from 'absent' to '0.13-2'
Sep 28 11:49:04 ctl02 salt-minion[14967]: 'os-brick-common' changed from 'absent' to '1.2.0-2ubuntu0.3'
Sep 28 11:49:04 ctl02 salt-minion[14967]: 'nova-cert' changed from 'absent' to '2:13.1.4-0ubuntu3'
Sep 28 11:49:04 ctl02 salt-minion[14967]: 'python-oslo.reports' changed from 'absent' to '1.7.0-2'
Sep 28 11:49:04 ctl02 salt-minion[14967]: 'python-oslo-rootwrap' changed from 'absent' to '1'
Sep 28 11:49:04 ctl02 salt-minion[14967]: 'python2.7-boto' changed from 'absent' to '1'
Sep 28 11:49:04 ctl02 salt-minion[14967]: [INFO    ] Loading fresh modules for state activity
Sep 28 11:49:04 ctl02 salt-minion[14967]: [INFO    ] Completed state [nova-cert] at time 11:49:04.472478 duration_in_ms=51696.14
Sep 28 11:49:04 ctl02 salt-minion[14967]: [INFO    ] Running state [nova-conductor] at time 11:49:04.478310
Sep 28 11:49:04 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for nova-conductor
Sep 28 11:49:04 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemd-run', '--scope', 'apt-get', '-q', '-y', '-o', 'DPkg::Options::=--force-confold', '-o', 'DPkg::Options::=--force-confdef', 'install', 'nova-conductor'] in directory '/root'
Sep 28 11:49:04 ctl02 systemd[1]: Started /usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold -o DPkg::Options::=--force-confdef install nova-conductor.
Sep 28 11:49:05 ctl02 nova-cert[4860]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:49:05 ctl02 nova-cert[4860]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:49:05 ctl02 nova-cert[4860]: 2017-09-28 11:49:05.439 4860 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:49:05 ctl02 nova-cert[4860]: 2017-09-28 11:49:05.496 4860 WARNING oslo_config.cfg [req-033debc0-27df-45ac-aede-d801a54405fd - - - - -] Option "lock_path" from group "DEFAULT" is deprecated. Use option "lock_path" from group "oslo_concurrency".
Sep 28 11:49:05 ctl02 nova-cert[4860]: 2017-09-28 11:49:05.497 4860 INFO nova.service [-] Starting cert node (version 13.1.4)
Sep 28 11:49:05 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928114905645804
Sep 28 11:49:05 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 4951
Sep 28 11:49:05 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928114905645804
Sep 28 11:49:05 ctl02 nova-cert[4860]: 2017-09-28 11:49:05.836 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.
Sep 28 11:49:06 ctl02 systemd[1]: Reloading.
Sep 28 11:49:06 ctl02 glance-api[29183]: 2017-09-28 11:49:06.419 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:49:06] "OPTIONS / HTTP/1.0" 200 134 0.000687
Sep 28 11:49:06 ctl02 systemd[1]: Reloading.
Sep 28 11:49:06 ctl02 nova-cert[4860]: 2017-09-28 11:49:06.842 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
Sep 28 11:49:06 ctl02 systemd[1]: Reloading.
Sep 28 11:49:06 ctl02 systemd[1]: Reloading.
Sep 28 11:49:07 ctl02 systemd[1]: Starting OpenStack Compute Conductor...
Sep 28 11:49:07 ctl02 systemd[1]: Started OpenStack Compute Conductor.
Sep 28 11:49:07 ctl02 systemd[1]: Reloading.
Sep 28 11:49:07 ctl02 salt-minion[14967]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 11:49:07 ctl02 salt-minion[14967]: [INFO    ] Made the following changes:
Sep 28 11:49:07 ctl02 salt-minion[14967]: 'nova-conductor' changed from 'absent' to '2:13.1.4-0ubuntu3'
Sep 28 11:49:07 ctl02 salt-minion[14967]: [INFO    ] Loading fresh modules for state activity
Sep 28 11:49:07 ctl02 salt-minion[14967]: [INFO    ] Completed state [nova-conductor] at time 11:49:07.664692 duration_in_ms=3186.381
Sep 28 11:49:07 ctl02 salt-minion[14967]: [INFO    ] Running state [novnc] at time 11:49:07.670507
Sep 28 11:49:07 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for novnc
Sep 28 11:49:07 ctl02 dhclient[600]: DHCPREQUEST of 192.168.11.25 on ens2 to 192.168.11.3 port 67 (xid=0x3415f07)
Sep 28 11:49:07 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemd-run', '--scope', 'apt-get', '-q', '-y', '-o', 'DPkg::Options::=--force-confold', '-o', 'DPkg::Options::=--force-confdef', 'install', 'novnc'] in directory '/root'
Sep 28 11:49:07 ctl02 dhclient[600]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 11:49:07 ctl02 systemd[1]: Started /usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold -o DPkg::Options::=--force-confdef install novnc.
Sep 28 11:49:07 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 11:49:08 ctl02 ntp[5180]:  * Stopping NTP server ntpd
Sep 28 11:49:08 ctl02 ntp[5180]:    ...done.
Sep 28 11:49:08 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 11:49:08 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 11:49:08 ctl02 ntp[5190]:  * Starting NTP server ntpd
Sep 28 11:49:08 ctl02 ntpd[5198]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 11:49:08 ctl02 ntpd[5198]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -c /var/lib/ntp/ntp.conf.dhcp -u 108:112
Sep 28 11:49:08 ctl02 ntp[5190]:    ...done.
Sep 28 11:49:08 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 11:49:08 ctl02 ntpd[5201]: proto: precision = 0.042 usec (-24)
Sep 28 11:49:08 ctl02 ntpd[5201]: switching logging to file /var/log/ntp.log
Sep 28 11:49:08 ctl02 dhclient[600]: bound to 192.168.11.25 -- renewal in 279 seconds.
Sep 28 11:49:08 ctl02 nova-conductor[5056]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:49:08 ctl02 nova-conductor[5056]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:49:08 ctl02 nova-conductor[5056]: 2017-09-28 11:49:08.715 5056 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:49:08 ctl02 nova-conductor[5056]: 2017-09-28 11:49:08.751 5056 INFO oslo_service.service [req-f7e6ba38-5cba-4dee-b9a2-fcc450e2a714 - - - - -] Starting 4 workers
Sep 28 11:49:08 ctl02 nova-conductor[5056]: 2017-09-28 11:49:08.757 5212 INFO nova.service [-] Starting conductor node (version 13.1.4)
Sep 28 11:49:08 ctl02 nova-conductor[5056]: 2017-09-28 11:49:08.759 5214 INFO nova.service [-] Starting conductor node (version 13.1.4)
Sep 28 11:49:08 ctl02 nova-conductor[5056]: 2017-09-28 11:49:08.760 5215 INFO nova.service [-] Starting conductor node (version 13.1.4)
Sep 28 11:49:08 ctl02 nova-conductor[5056]: 2017-09-28 11:49:08.766 5056 WARNING oslo_config.cfg [req-f7e6ba38-5cba-4dee-b9a2-fcc450e2a714 - - - - -] Option "lock_path" from group "DEFAULT" is deprecated. Use option "lock_path" from group "oslo_concurrency".
Sep 28 11:49:08 ctl02 nova-conductor[5056]: 2017-09-28 11:49:08.767 5213 INFO nova.service [-] Starting conductor node (version 13.1.4)
Sep 28 11:49:08 ctl02 nova-cert[4860]: 2017-09-28 11:49:08.848 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 4 seconds.
Sep 28 11:49:08 ctl02 nova-conductor[5056]: 2017-09-28 11:49:08.999 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.
Sep 28 11:49:09 ctl02 nova-conductor[5056]: 2017-09-28 11:49:09.016 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.
Sep 28 11:49:09 ctl02 nova-conductor[5056]: 2017-09-28 11:49:09.022 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.
Sep 28 11:49:09 ctl02 nova-conductor[5056]: 2017-09-28 11:49:09.022 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.
Sep 28 11:49:09 ctl02 glance-api[29183]: 2017-09-28 11:49:09.232 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:49:09] "OPTIONS / HTTP/1.0" 200 134 0.000610
Sep 28 11:49:10 ctl02 nova-conductor[5056]: 2017-09-28 11:49:10.004 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
Sep 28 11:49:10 ctl02 nova-conductor[5056]: 2017-09-28 11:49:10.021 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
Sep 28 11:49:10 ctl02 nova-conductor[5056]: 2017-09-28 11:49:10.027 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
Sep 28 11:49:10 ctl02 nova-conductor[5056]: 2017-09-28 11:49:10.027 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
Sep 28 11:49:11 ctl02 salt-minion[14967]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 11:49:11 ctl02 salt-minion[14967]: [INFO    ] Made the following changes:
Sep 28 11:49:11 ctl02 salt-minion[14967]: 'novnc' changed from 'absent' to '1:0.4+dfsg+1+20131010+gitf68af8af3d-4'
Sep 28 11:49:11 ctl02 salt-minion[14967]: 'websockify' changed from 'absent' to '0.6.1+dfsg1-1'
Sep 28 11:49:11 ctl02 salt-minion[14967]: 'libjs-swfobject' changed from 'absent' to '2.2+dfsg-1'
Sep 28 11:49:11 ctl02 salt-minion[14967]: 'python-novnc' changed from 'absent' to '1:0.4+dfsg+1+20131010+gitf68af8af3d-4'
Sep 28 11:49:11 ctl02 salt-minion[14967]: [INFO    ] Loading fresh modules for state activity
Sep 28 11:49:11 ctl02 salt-minion[14967]: [INFO    ] Completed state [novnc] at time 11:49:11.431399 duration_in_ms=3760.891
Sep 28 11:49:11 ctl02 salt-minion[14967]: [INFO    ] Running state [nova-common] at time 11:49:11.436475
Sep 28 11:49:11 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for nova-common
Sep 28 11:49:11 ctl02 salt-minion[14967]: [INFO    ] Package nova-common is already installed
Sep 28 11:49:11 ctl02 salt-minion[14967]: [INFO    ] Completed state [nova-common] at time 11:49:11.721823 duration_in_ms=285.348
Sep 28 11:49:11 ctl02 salt-minion[14967]: [INFO    ] Running state [nova-consoleauth] at time 11:49:11.722221
Sep 28 11:49:11 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for nova-consoleauth
Sep 28 11:49:11 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemd-run', '--scope', 'apt-get', '-q', '-y', '-o', 'DPkg::Options::=--force-confold', '-o', 'DPkg::Options::=--force-confdef', 'install', 'nova-consoleauth'] in directory '/root'
Sep 28 11:49:11 ctl02 systemd[1]: Started /usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold -o DPkg::Options::=--force-confdef install nova-consoleauth.
Sep 28 11:49:12 ctl02 nova-conductor[5056]: 2017-09-28 11:49:12.009 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 4 seconds.
Sep 28 11:49:12 ctl02 nova-conductor[5056]: 2017-09-28 11:49:12.026 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 4 seconds.
Sep 28 11:49:12 ctl02 nova-conductor[5056]: 2017-09-28 11:49:12.043 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 4 seconds.
Sep 28 11:49:12 ctl02 nova-conductor[5056]: 2017-09-28 11:49:12.043 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 4 seconds.
Sep 28 11:49:12 ctl02 nova-cert[4860]: 2017-09-28 11:49:12.856 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 6 seconds.
Sep 28 11:49:13 ctl02 systemd[1]: Reloading.
Sep 28 11:49:13 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xbb613328)
Sep 28 11:49:13 ctl02 systemd[1]: Reloading.
Sep 28 11:49:13 ctl02 systemd[1]: message repeated 2 times: [ Reloading.]
Sep 28 11:49:13 ctl02 systemd[1]: Starting OpenStack Compute Console...
Sep 28 11:49:13 ctl02 systemd[1]: Started OpenStack Compute Console.
Sep 28 11:49:13 ctl02 systemd[1]: Reloading.
Sep 28 11:49:14 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xbb613328)
Sep 28 11:49:14 ctl02 glance-api[29183]: 2017-09-28 11:49:14.385 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:49:14] "OPTIONS / HTTP/1.0" 200 134 0.000634
Sep 28 11:49:14 ctl02 salt-minion[14967]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 11:49:14 ctl02 salt-minion[14967]: [INFO    ] Made the following changes:
Sep 28 11:49:14 ctl02 salt-minion[14967]: 'nova-consoleauth' changed from 'absent' to '2:13.1.4-0ubuntu3'
Sep 28 11:49:14 ctl02 salt-minion[14967]: [INFO    ] Loading fresh modules for state activity
Sep 28 11:49:14 ctl02 salt-minion[14967]: [INFO    ] Completed state [nova-consoleauth] at time 11:49:14.487590 duration_in_ms=2765.368
Sep 28 11:49:14 ctl02 salt-minion[14967]: [INFO    ] Running state [python-pycadf] at time 11:49:14.493020
Sep 28 11:49:14 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for python-pycadf
Sep 28 11:49:14 ctl02 salt-minion[14967]: [INFO    ] Package python-pycadf is already installed
Sep 28 11:49:14 ctl02 salt-minion[14967]: [INFO    ] Completed state [python-pycadf] at time 11:49:14.716369 duration_in_ms=223.347
Sep 28 11:49:14 ctl02 salt-minion[14967]: [INFO    ] Running state [python-memcache] at time 11:49:14.716942
Sep 28 11:49:14 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for python-memcache
Sep 28 11:49:14 ctl02 salt-minion[14967]: [INFO    ] Package python-memcache is already installed
Sep 28 11:49:14 ctl02 salt-minion[14967]: [INFO    ] Completed state [python-memcache] at time 11:49:14.720374 duration_in_ms=3.432
Sep 28 11:49:14 ctl02 salt-minion[14967]: [INFO    ] Running state [nova-scheduler] at time 11:49:14.720894
Sep 28 11:49:14 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for nova-scheduler
Sep 28 11:49:14 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemd-run', '--scope', 'apt-get', '-q', '-y', '-o', 'DPkg::Options::=--force-confold', '-o', 'DPkg::Options::=--force-confdef', 'install', 'nova-scheduler'] in directory '/root'
Sep 28 11:49:14 ctl02 systemd[1]: Started /usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold -o DPkg::Options::=--force-confdef install nova-scheduler.
Sep 28 11:49:15 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xbb613328)
Sep 28 11:49:15 ctl02 nova-consoleauth[5433]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:49:15 ctl02 nova-consoleauth[5433]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:49:15 ctl02 nova-consoleauth[5433]: 2017-09-28 11:49:15.505 5433 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:49:15 ctl02 nova-consoleauth[5433]: 2017-09-28 11:49:15.548 5433 WARNING oslo_config.cfg [req-8e6b9eb7-3717-46c9-b50f-42de39ba9a53 - - - - -] Option "lock_path" from group "DEFAULT" is deprecated. Use option "lock_path" from group "oslo_concurrency".
Sep 28 11:49:15 ctl02 nova-consoleauth[5433]: 2017-09-28 11:49:15.550 5433 INFO nova.service [-] Starting consoleauth node (version 13.1.4)
Sep 28 11:49:15 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928114915748277
Sep 28 11:49:15 ctl02 nova-consoleauth[5433]: 2017-09-28 11:49:15.744 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.
Sep 28 11:49:15 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 5523
Sep 28 11:49:15 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928114915748277
Sep 28 11:49:16 ctl02 nova-conductor[5056]: 2017-09-28 11:49:16.015 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 6 seconds.
Sep 28 11:49:16 ctl02 nova-conductor[5056]: 2017-09-28 11:49:16.032 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 6 seconds.
Sep 28 11:49:16 ctl02 nova-conductor[5056]: 2017-09-28 11:49:16.048 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 6 seconds.
Sep 28 11:49:16 ctl02 nova-conductor[5056]: 2017-09-28 11:49:16.048 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 6 seconds.
Sep 28 11:49:16 ctl02 systemd[1]: Reloading.
Sep 28 11:49:16 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xbb613328)
Sep 28 11:49:16 ctl02 glance-api[29183]: 2017-09-28 11:49:16.657 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:49:16] "OPTIONS / HTTP/1.0" 200 134 0.000665
Sep 28 11:49:16 ctl02 systemd[1]: Reloading.
Sep 28 11:49:16 ctl02 systemd[1]: Reloading.
Sep 28 11:49:16 ctl02 nova-consoleauth[5433]: 2017-09-28 11:49:16.750 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
Sep 28 11:49:16 ctl02 systemd[1]: Reloading.
Sep 28 11:49:16 ctl02 systemd[1]: Starting OpenStack Compute Scheduler...
Sep 28 11:49:16 ctl02 systemd[1]: Started OpenStack Compute Scheduler.
Sep 28 11:49:16 ctl02 systemd[1]: Reloading.
Sep 28 11:49:17 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xbb613328)
Sep 28 11:49:17 ctl02 salt-minion[14967]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 11:49:17 ctl02 salt-minion[14967]: [INFO    ] Made the following changes:
Sep 28 11:49:17 ctl02 salt-minion[14967]: 'nova-scheduler' changed from 'absent' to '2:13.1.4-0ubuntu3'
Sep 28 11:49:17 ctl02 salt-minion[14967]: [INFO    ] Loading fresh modules for state activity
Sep 28 11:49:17 ctl02 salt-minion[14967]: [INFO    ] Completed state [nova-scheduler] at time 11:49:17.444940 duration_in_ms=2724.044
Sep 28 11:49:17 ctl02 salt-minion[14967]: [INFO    ] Running state [nova-api] at time 11:49:17.450188
Sep 28 11:49:17 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for nova-api
Sep 28 11:49:17 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemd-run', '--scope', 'apt-get', '-q', '-y', '-o', 'DPkg::Options::=--force-confold', '-o', 'DPkg::Options::=--force-confdef', 'install', 'nova-api'] in directory '/root'
Sep 28 11:49:17 ctl02 systemd[1]: Started /usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold -o DPkg::Options::=--force-confdef install nova-api.
Sep 28 11:49:18 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xbb613328)
Sep 28 11:49:18 ctl02 nova-scheduler[5620]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:49:18 ctl02 nova-scheduler[5620]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:49:18 ctl02 nova-scheduler[5620]: 2017-09-28 11:49:18.483 5620 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:49:18 ctl02 nova-scheduler[5620]: 2017-09-28 11:49:18.620 5620 WARNING oslo_config.cfg [req-2a2aa0a5-16a2-4204-ad6f-e4120f0faebe - - - - -] Option "lock_path" from group "DEFAULT" is deprecated. Use option "lock_path" from group "oslo_concurrency".
Sep 28 11:49:18 ctl02 nova-scheduler[5620]: 2017-09-28 11:49:18.633 5620 INFO nova.service [-] Starting scheduler node (version 13.1.4)
Sep 28 11:49:18 ctl02 nova-consoleauth[5433]: 2017-09-28 11:49:18.756 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 4 seconds.
Sep 28 11:49:18 ctl02 nova-scheduler[5620]: 2017-09-28 11:49:18.762 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.
Sep 28 11:49:18 ctl02 nova-cert[4860]: 2017-09-28 11:49:18.866 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 8 seconds.
Sep 28 11:49:19 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xbb613328)
Sep 28 11:49:19 ctl02 glance-api[29183]: 2017-09-28 11:49:19.318 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:49:19] "OPTIONS / HTTP/1.0" 200 134 0.000916
Sep 28 11:49:19 ctl02 nova-scheduler[5620]: 2017-09-28 11:49:19.769 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
Sep 28 11:49:20 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xbb613328)
Sep 28 11:49:20 ctl02 systemd[1]: Reloading.
Sep 28 11:49:21 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xbb613328)
Sep 28 11:49:21 ctl02 systemd[1]: Reloading.
Sep 28 11:49:21 ctl02 systemd[1]: message repeated 2 times: [ Reloading.]
Sep 28 11:49:21 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:49:21 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:49:21 ctl02 systemd[1]: Reloading.
Sep 28 11:49:21 ctl02 nova-scheduler[5620]: 2017-09-28 11:49:21.776 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 4 seconds.
Sep 28 11:49:22 ctl02 nova-conductor[5056]: 2017-09-28 11:49:22.022 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 8 seconds.
Sep 28 11:49:22 ctl02 nova-conductor[5056]: 2017-09-28 11:49:22.037 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 8 seconds.
Sep 28 11:49:22 ctl02 nova-conductor[5056]: 2017-09-28 11:49:22.054 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 8 seconds.
Sep 28 11:49:22 ctl02 nova-conductor[5056]: 2017-09-28 11:49:22.054 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 8 seconds.
Sep 28 11:49:22 ctl02 salt-minion[14967]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 11:49:22 ctl02 salt-minion[14967]: [INFO    ] Made the following changes:
Sep 28 11:49:22 ctl02 salt-minion[14967]: 'iptables' changed from 'absent' to '1.6.0-2ubuntu3'
Sep 28 11:49:22 ctl02 salt-minion[14967]: 'nova-api' changed from 'absent' to '2:13.1.4-0ubuntu3'
Sep 28 11:49:22 ctl02 salt-minion[14967]: 'libnfnetlink0' changed from 'absent' to '1.0.1-3'
Sep 28 11:49:22 ctl02 salt-minion[14967]: [INFO    ] Loading fresh modules for state activity
Sep 28 11:49:22 ctl02 salt-minion[14967]: [INFO    ] Completed state [nova-api] at time 11:49:22.243070 duration_in_ms=4792.88
Sep 28 11:49:22 ctl02 salt-minion[14967]: [INFO    ] Running state [gettext-base] at time 11:49:22.252133
Sep 28 11:49:22 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for gettext-base
Sep 28 11:49:22 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xbb613328)
Sep 28 11:49:22 ctl02 salt-minion[14967]: [INFO    ] Package gettext-base is already installed
Sep 28 11:49:22 ctl02 salt-minion[14967]: [INFO    ] Completed state [gettext-base] at time 11:49:22.516933 duration_in_ms=264.8
Sep 28 11:49:22 ctl02 salt-minion[14967]: [INFO    ] Running state [nova-consoleproxy] at time 11:49:22.517356
Sep 28 11:49:22 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for nova-consoleproxy
Sep 28 11:49:22 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemd-run', '--scope', 'apt-get', '-q', '-y', '-o', 'DPkg::Options::=--force-confold', '-o', 'DPkg::Options::=--force-confdef', 'install', 'nova-consoleproxy'] in directory '/root'
Sep 28 11:49:22 ctl02 systemd[1]: Started /usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold -o DPkg::Options::=--force-confdef install nova-consoleproxy.
Sep 28 11:49:22 ctl02 nova-consoleauth[5433]: 2017-09-28 11:49:22.764 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 6 seconds.
Sep 28 11:49:22 ctl02 salt-minion[14967]: [ERROR   ] Command '['systemd-run', '--scope', 'apt-get', '-q', '-y', '-o', 'DPkg::Options::=--force-confold', '-o', 'DPkg::Options::=--force-confdef', 'install', 'nova-consoleproxy']' failed with return code: 100
Sep 28 11:49:22 ctl02 salt-minion[14967]: [ERROR   ] stdout: Reading package lists...
Sep 28 11:49:22 ctl02 salt-minion[14967]: Building dependency tree...
Sep 28 11:49:22 ctl02 salt-minion[14967]: Reading state information...
Sep 28 11:49:22 ctl02 salt-minion[14967]: [ERROR   ] stderr: Running scope as unit run-r4eae6fed1f1d4847ac09eef45b456b24.scope.
Sep 28 11:49:22 ctl02 salt-minion[14967]: E: Unable to locate package nova-consoleproxy
Sep 28 11:49:22 ctl02 salt-minion[14967]: [ERROR   ] retcode: 100
Sep 28 11:49:22 ctl02 salt-minion[14967]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 11:49:22 ctl02 salt-minion[14967]: [ERROR   ] Problem encountered installing package(s). Additional info follows:
Sep 28 11:49:22 ctl02 salt-minion[14967]: errors:
Sep 28 11:49:22 ctl02 salt-minion[14967]:     - Running scope as unit run-r4eae6fed1f1d4847ac09eef45b456b24.scope.
Sep 28 11:49:22 ctl02 salt-minion[14967]:       E: Unable to locate package nova-consoleproxy
Sep 28 11:49:22 ctl02 salt-minion[14967]: [INFO    ] Completed state [nova-consoleproxy] at time 11:49:22.868463 duration_in_ms=351.107
Sep 28 11:49:22 ctl02 salt-minion[14967]: [INFO    ] Running state [nova-manage cell_v2 map_cell0] at time 11:49:22.872578
Sep 28 11:49:22 ctl02 salt-minion[14967]: [INFO    ] Executing state cmd.run for nova-manage cell_v2 map_cell0
Sep 28 11:49:22 ctl02 salt-minion[14967]: [INFO    ] Executing command 'nova-manage cell_v2 map_cell0' in directory '/root'
Sep 28 11:49:23 ctl02 nova-api[5827]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:49:23 ctl02 nova-api[5827]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:49:23 ctl02 nova-api[5827]: 2017-09-28 11:49:23.250 5827 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:49:23 ctl02 nova-api[5827]: 2017-09-28 11:49:23.252 5827 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:49:23 ctl02 nova-api[5827]: 2017-09-28 11:49:23.252 5827 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:49:23 ctl02 nova-api[5827]: 2017-09-28 11:49:23.252 5827 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:49:23 ctl02 nova-api[5827]: 2017-09-28 11:49:23.252 5827 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:49:23 ctl02 nova-api[5827]: 2017-09-28 11:49:23.252 5827 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:49:23 ctl02 nova-api[5827]: 2017-09-28 11:49:23.252 5827 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:49:23 ctl02 nova-api[5827]: 2017-09-28 11:49:23.252 5827 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:49:23 ctl02 nova-api[5827]: 2017-09-28 11:49:23.252 5827 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:49:23 ctl02 nova-api[5827]: 2017-09-28 11:49:23.252 5827 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:49:23 ctl02 nova-api[5827]: 2017-09-28 11:49:23.252 5827 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:49:23 ctl02 nova-api[5827]: 2017-09-28 11:49:23.252 5827 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:49:23 ctl02 nova-api[5827]: 2017-09-28 11:49:23.252 5827 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:49:23 ctl02 nova-api[5827]: 2017-09-28 11:49:23.252 5827 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:49:23 ctl02 nova-api[5827]: 2017-09-28 11:49:23.252 5827 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:49:23 ctl02 nova-api[5827]: 2017-09-28 11:49:23.252 5827 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:49:23 ctl02 nova-api[5827]: 2017-09-28 11:49:23.252 5827 ERROR nova.wsgi     self.filename))
Sep 28 11:49:23 ctl02 nova-api[5827]: 2017-09-28 11:49:23.252 5827 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:49:23 ctl02 nova-api[5827]: 2017-09-28 11:49:23.252 5827 ERROR nova.wsgi
Sep 28 11:49:23 ctl02 nova-api[5827]: 2017-09-28 11:49:23.254 5827 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:49:23 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xbb613328)
Sep 28 11:49:23 ctl02 nova-api[5827]: 2017-09-28 11:49:23.388 5827 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:49:23 ctl02 nova-api[5827]: 2017-09-28 11:49:23.616 5827 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:49:23 ctl02 nova-api[5827]: 2017-09-28 11:49:23.618 5827 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:49:23 ctl02 nova-api[5827]: 2017-09-28 11:49:23.619 5827 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:49:23 ctl02 nova-api[5827]: 2017-09-28 11:49:23.619 5827 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:49:23 ctl02 nova-api[5827]: 2017-09-28 11:49:23.750 5827 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:49:23 ctl02 nova-api[5827]: 2017-09-28 11:49:23.752 5827 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:49:23 ctl02 nova-api[5827]: 2017-09-28 11:49:23.753 5827 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:49:23 ctl02 nova-api[5827]: 2017-09-28 11:49:23.753 5827 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:49:23 ctl02 nova-api[5827]: 2017-09-28 11:49:23.757 5827 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:49:23 ctl02 nova-api[5827]: 2017-09-28 11:49:23.757 5827 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:49:23 ctl02 nova-api[5827]: 2017-09-28 11:49:23.757 5827 ERROR nova Traceback (most recent call last):
Sep 28 11:49:23 ctl02 nova-api[5827]: 2017-09-28 11:49:23.757 5827 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:49:23 ctl02 nova-api[5827]: 2017-09-28 11:49:23.757 5827 ERROR nova     sys.exit(main())
Sep 28 11:49:23 ctl02 nova-api[5827]: 2017-09-28 11:49:23.757 5827 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:49:23 ctl02 nova-api[5827]: 2017-09-28 11:49:23.757 5827 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:49:23 ctl02 nova-api[5827]: 2017-09-28 11:49:23.757 5827 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:49:23 ctl02 nova-api[5827]: 2017-09-28 11:49:23.757 5827 ERROR nova     max_url_len=max_url_len)
Sep 28 11:49:23 ctl02 nova-api[5827]: 2017-09-28 11:49:23.757 5827 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:49:23 ctl02 nova-api[5827]: 2017-09-28 11:49:23.757 5827 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:49:23 ctl02 nova-api[5827]: 2017-09-28 11:49:23.757 5827 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:49:23 ctl02 nova-api[5827]: 2017-09-28 11:49:23.757 5827 ERROR nova     sock.listen(backlog)
Sep 28 11:49:23 ctl02 nova-api[5827]: 2017-09-28 11:49:23.757 5827 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:49:23 ctl02 nova-api[5827]: 2017-09-28 11:49:23.757 5827 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:49:23 ctl02 nova-api[5827]: 2017-09-28 11:49:23.757 5827 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:49:23 ctl02 nova-api[5827]: 2017-09-28 11:49:23.757 5827 ERROR nova
Sep 28 11:49:23 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:49:23 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:49:23 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:49:24 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:49:24 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:49:24 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:49:24 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:49:24 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:49:24 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:49:24 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 11:49:24 ctl02 ntp[5970]:  * Stopping NTP server ntpd
Sep 28 11:49:24 ctl02 ntp[5970]:    ...done.
Sep 28 11:49:24 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 11:49:24 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 11:49:24 ctl02 ntp[5981]:  * Starting NTP server ntpd
Sep 28 11:49:24 ctl02 ntpd[5988]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 11:49:24 ctl02 ntpd[5988]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 11:49:24 ctl02 ntp[5981]:    ...done.
Sep 28 11:49:24 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 11:49:24 ctl02 ntpd[5991]: proto: precision = 0.042 usec (-24)
Sep 28 11:49:24 ctl02 ntpd[5991]: switching logging to file /var/log/ntp.log
Sep 28 11:49:24 ctl02 glance-api[29183]: 2017-09-28 11:49:24.481 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:49:24] "OPTIONS / HTTP/1.0" 200 134 0.000634
Sep 28 11:49:24 ctl02 salt-minion[14967]: [ERROR   ] Command 'nova-manage cell_v2 map_cell0' failed with return code: 2
Sep 28 11:49:24 ctl02 salt-minion[14967]: [ERROR   ] stderr: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:49:24 ctl02 salt-minion[14967]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:49:24 ctl02 salt-minion[14967]: usage: nova-manage cell_v2 [-h] {map_cell_and_hosts,map_instances} ...
Sep 28 11:49:24 ctl02 salt-minion[14967]: nova-manage cell_v2: error: argument action: invalid choice: 'map_cell0' (choose from 'map_cell_and_hosts', 'map_instances')
Sep 28 11:49:24 ctl02 salt-minion[14967]: [ERROR   ] retcode: 2
Sep 28 11:49:24 ctl02 salt-minion[14967]: [ERROR   ] {'pid': 5900, 'retcode': 2, 'stderr': 'Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".\nOption "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.\nusage: nova-manage cell_v2 [-h] {map_cell_and_hosts,map_instances} ...\nnova-manage cell_v2: error: argument action: invalid choice: \'map_cell0\' (choose from \'map_cell_and_hosts\', \'map_instances\')', 'stdout': ''}
Sep 28 11:49:24 ctl02 salt-minion[14967]: [INFO    ] Completed state [nova-manage cell_v2 map_cell0] at time 11:49:24.563312 duration_in_ms=1690.732
Sep 28 11:49:24 ctl02 salt-minion[14967]: [INFO    ] Running state [nova-manage cell_v2 create_cell --name=cell1] at time 11:49:24.563555
Sep 28 11:49:24 ctl02 salt-minion[14967]: [INFO    ] Executing state cmd.run for nova-manage cell_v2 create_cell --name=cell1
Sep 28 11:49:24 ctl02 salt-minion[14967]: [INFO    ] Executing command 'nova-manage cell_v2 list_cells | grep cell1' in directory '/root'
Sep 28 11:49:25 ctl02 nova-api[5913]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:49:25 ctl02 nova-api[5913]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:49:25 ctl02 nova-scheduler[5620]: 2017-09-28 11:49:25.784 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 6 seconds.
Sep 28 11:49:25 ctl02 nova-api[5913]: 2017-09-28 11:49:25.789 5913 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:49:25 ctl02 nova-api[5913]: 2017-09-28 11:49:25.791 5913 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:49:25 ctl02 nova-api[5913]: 2017-09-28 11:49:25.791 5913 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:49:25 ctl02 nova-api[5913]: 2017-09-28 11:49:25.791 5913 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:49:25 ctl02 nova-api[5913]: 2017-09-28 11:49:25.791 5913 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:49:25 ctl02 nova-api[5913]: 2017-09-28 11:49:25.791 5913 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:49:25 ctl02 nova-api[5913]: 2017-09-28 11:49:25.791 5913 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:49:25 ctl02 nova-api[5913]: 2017-09-28 11:49:25.791 5913 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:49:25 ctl02 nova-api[5913]: 2017-09-28 11:49:25.791 5913 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:49:25 ctl02 nova-api[5913]: 2017-09-28 11:49:25.791 5913 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:49:25 ctl02 nova-api[5913]: 2017-09-28 11:49:25.791 5913 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:49:25 ctl02 nova-api[5913]: 2017-09-28 11:49:25.791 5913 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:49:25 ctl02 nova-api[5913]: 2017-09-28 11:49:25.791 5913 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:49:25 ctl02 nova-api[5913]: 2017-09-28 11:49:25.791 5913 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:49:25 ctl02 nova-api[5913]: 2017-09-28 11:49:25.791 5913 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:49:25 ctl02 nova-api[5913]: 2017-09-28 11:49:25.791 5913 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:49:25 ctl02 nova-api[5913]: 2017-09-28 11:49:25.791 5913 ERROR nova.wsgi     self.filename))
Sep 28 11:49:25 ctl02 nova-api[5913]: 2017-09-28 11:49:25.791 5913 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:49:25 ctl02 nova-api[5913]: 2017-09-28 11:49:25.791 5913 ERROR nova.wsgi
Sep 28 11:49:25 ctl02 nova-api[5913]: 2017-09-28 11:49:25.793 5913 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:49:25 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928114925851872
Sep 28 11:49:25 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 6006
Sep 28 11:49:25 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928114925851872
Sep 28 11:49:25 ctl02 nova-api[5913]: 2017-09-28 11:49:25.921 5913 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:49:26 ctl02 nova-api[5913]: 2017-09-28 11:49:26.153 5913 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:49:26 ctl02 nova-api[5913]: 2017-09-28 11:49:26.155 5913 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:49:26 ctl02 nova-api[5913]: 2017-09-28 11:49:26.156 5913 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:49:26 ctl02 nova-api[5913]: 2017-09-28 11:49:26.156 5913 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:49:26 ctl02 salt-minion[14967]: [INFO    ] Executing command 'nova-manage cell_v2 create_cell --name=cell1' in directory '/root'
Sep 28 11:49:26 ctl02 nova-api[5913]: 2017-09-28 11:49:26.285 5913 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:49:26 ctl02 nova-api[5913]: 2017-09-28 11:49:26.287 5913 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:49:26 ctl02 nova-api[5913]: 2017-09-28 11:49:26.287 5913 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:49:26 ctl02 nova-api[5913]: 2017-09-28 11:49:26.287 5913 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:49:26 ctl02 nova-api[5913]: 2017-09-28 11:49:26.291 5913 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:49:26 ctl02 nova-api[5913]: 2017-09-28 11:49:26.291 5913 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:49:26 ctl02 nova-api[5913]: 2017-09-28 11:49:26.291 5913 ERROR nova Traceback (most recent call last):
Sep 28 11:49:26 ctl02 nova-api[5913]: 2017-09-28 11:49:26.291 5913 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:49:26 ctl02 nova-api[5913]: 2017-09-28 11:49:26.291 5913 ERROR nova     sys.exit(main())
Sep 28 11:49:26 ctl02 nova-api[5913]: 2017-09-28 11:49:26.291 5913 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:49:26 ctl02 nova-api[5913]: 2017-09-28 11:49:26.291 5913 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:49:26 ctl02 nova-api[5913]: 2017-09-28 11:49:26.291 5913 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:49:26 ctl02 nova-api[5913]: 2017-09-28 11:49:26.291 5913 ERROR nova     max_url_len=max_url_len)
Sep 28 11:49:26 ctl02 nova-api[5913]: 2017-09-28 11:49:26.291 5913 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:49:26 ctl02 nova-api[5913]: 2017-09-28 11:49:26.291 5913 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:49:26 ctl02 nova-api[5913]: 2017-09-28 11:49:26.291 5913 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:49:26 ctl02 nova-api[5913]: 2017-09-28 11:49:26.291 5913 ERROR nova     sock.listen(backlog)
Sep 28 11:49:26 ctl02 nova-api[5913]: 2017-09-28 11:49:26.291 5913 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:49:26 ctl02 nova-api[5913]: 2017-09-28 11:49:26.291 5913 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:49:26 ctl02 nova-api[5913]: 2017-09-28 11:49:26.291 5913 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:49:26 ctl02 nova-api[5913]: 2017-09-28 11:49:26.291 5913 ERROR nova
Sep 28 11:49:26 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:49:26 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:49:26 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:49:26 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:49:26 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:49:26 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:49:26 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:49:26 ctl02 nova-cert[4860]: 2017-09-28 11:49:26.879 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 10 seconds.
Sep 28 11:49:26 ctl02 glance-api[29183]: 2017-09-28 11:49:26.939 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:49:26] "OPTIONS / HTTP/1.0" 200 134 0.000625
Sep 28 11:49:27 ctl02 salt-minion[14967]: [ERROR   ] Command 'nova-manage cell_v2 create_cell --name=cell1' failed with return code: 2
Sep 28 11:49:27 ctl02 salt-minion[14967]: [ERROR   ] stderr: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:49:27 ctl02 salt-minion[14967]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:49:27 ctl02 salt-minion[14967]: usage: nova-manage cell_v2 [-h] {map_cell_and_hosts,map_instances} ...
Sep 28 11:49:27 ctl02 salt-minion[14967]: nova-manage cell_v2: error: argument action: invalid choice: 'create_cell' (choose from 'map_cell_and_hosts', 'map_instances')
Sep 28 11:49:27 ctl02 salt-minion[14967]: [ERROR   ] retcode: 2
Sep 28 11:49:27 ctl02 salt-minion[14967]: [ERROR   ] {'pid': 6009, 'retcode': 2, 'stderr': 'Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".\nOption "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.\nusage: nova-manage cell_v2 [-h] {map_cell_and_hosts,map_instances} ...\nnova-manage cell_v2: error: argument action: invalid choice: \'create_cell\' (choose from \'map_cell_and_hosts\', \'map_instances\')', 'stdout': ''}
Sep 28 11:49:27 ctl02 salt-minion[14967]: [INFO    ] Completed state [nova-manage cell_v2 create_cell --name=cell1] at time 11:49:27.921074 duration_in_ms=3357.517
Sep 28 11:49:27 ctl02 salt-minion[14967]: [INFO    ] Running state [/etc/systemd/system/nova-placement-api.service] at time 11:49:27.921309
Sep 28 11:49:27 ctl02 salt-minion[14967]: [INFO    ] Executing state file.symlink for /etc/systemd/system/nova-placement-api.service
Sep 28 11:49:27 ctl02 salt-minion[14967]: [INFO    ] {'new': '/etc/systemd/system/nova-placement-api.service'}
Sep 28 11:49:27 ctl02 salt-minion[14967]: [INFO    ] Completed state [/etc/systemd/system/nova-placement-api.service] at time 11:49:27.922791 duration_in_ms=1.482
Sep 28 11:49:27 ctl02 salt-minion[14967]: [INFO    ] Running state [nova-placement-api] at time 11:49:27.923349
Sep 28 11:49:27 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for nova-placement-api
Sep 28 11:49:27 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemd-run', '--scope', 'apt-get', '-q', '-y', '-o', 'DPkg::Options::=--force-confold', '-o', 'DPkg::Options::=--force-confdef', 'install', 'nova-placement-api'] in directory '/root'
Sep 28 11:49:27 ctl02 systemd[1]: Started /usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold -o DPkg::Options::=--force-confdef install nova-placement-api.
Sep 28 11:49:28 ctl02 nova-api[6022]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:49:28 ctl02 nova-api[6022]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:49:28 ctl02 salt-minion[14967]: [ERROR   ] Command '['systemd-run', '--scope', 'apt-get', '-q', '-y', '-o', 'DPkg::Options::=--force-confold', '-o', 'DPkg::Options::=--force-confdef', 'install', 'nova-placement-api']' failed with return code: 100
Sep 28 11:49:28 ctl02 salt-minion[14967]: [ERROR   ] stdout: Reading package lists...
Sep 28 11:49:28 ctl02 salt-minion[14967]: Building dependency tree...
Sep 28 11:49:28 ctl02 salt-minion[14967]: Reading state information...
Sep 28 11:49:28 ctl02 salt-minion[14967]: [ERROR   ] stderr: Running scope as unit run-rebfebcefad7c4201a1d1446dfad21a4d.scope.
Sep 28 11:49:28 ctl02 salt-minion[14967]: E: Unable to locate package nova-placement-api
Sep 28 11:49:28 ctl02 salt-minion[14967]: [ERROR   ] retcode: 100
Sep 28 11:49:28 ctl02 salt-minion[14967]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 11:49:28 ctl02 salt-minion[14967]: [ERROR   ] Problem encountered installing package(s). Additional info follows:
Sep 28 11:49:28 ctl02 salt-minion[14967]: errors:
Sep 28 11:49:28 ctl02 salt-minion[14967]:     - Running scope as unit run-rebfebcefad7c4201a1d1446dfad21a4d.scope.
Sep 28 11:49:28 ctl02 salt-minion[14967]:       E: Unable to locate package nova-placement-api
Sep 28 11:49:28 ctl02 salt-minion[14967]: [INFO    ] Completed state [nova-placement-api] at time 11:49:28.261839 duration_in_ms=338.489
Sep 28 11:49:28 ctl02 salt-minion[14967]: [INFO    ] Running state [/etc/apache2/sites-enabled/nova-placement-api.conf] at time 11:49:28.262605
Sep 28 11:49:28 ctl02 salt-minion[14967]: [INFO    ] Executing state file.symlink for /etc/apache2/sites-enabled/nova-placement-api.conf
Sep 28 11:49:28 ctl02 salt-minion[14967]: [INFO    ] {'new': '/etc/apache2/sites-enabled/nova-placement-api.conf'}
Sep 28 11:49:28 ctl02 salt-minion[14967]: [INFO    ] Completed state [/etc/apache2/sites-enabled/nova-placement-api.conf] at time 11:49:28.264004 duration_in_ms=1.399
Sep 28 11:49:28 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928114603376748
Sep 28 11:49:28 ctl02 nova-api[6022]: 2017-09-28 11:49:28.310 6022 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:49:28 ctl02 nova-api[6022]: 2017-09-28 11:49:28.312 6022 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:49:28 ctl02 nova-api[6022]: 2017-09-28 11:49:28.312 6022 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:49:28 ctl02 nova-api[6022]: 2017-09-28 11:49:28.312 6022 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:49:28 ctl02 nova-api[6022]: 2017-09-28 11:49:28.312 6022 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:49:28 ctl02 nova-api[6022]: 2017-09-28 11:49:28.312 6022 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:49:28 ctl02 nova-api[6022]: 2017-09-28 11:49:28.312 6022 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:49:28 ctl02 nova-api[6022]: 2017-09-28 11:49:28.312 6022 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:49:28 ctl02 nova-api[6022]: 2017-09-28 11:49:28.312 6022 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:49:28 ctl02 nova-api[6022]: 2017-09-28 11:49:28.312 6022 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:49:28 ctl02 nova-api[6022]: 2017-09-28 11:49:28.312 6022 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:49:28 ctl02 nova-api[6022]: 2017-09-28 11:49:28.312 6022 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:49:28 ctl02 nova-api[6022]: 2017-09-28 11:49:28.312 6022 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:49:28 ctl02 nova-api[6022]: 2017-09-28 11:49:28.312 6022 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:49:28 ctl02 nova-api[6022]: 2017-09-28 11:49:28.312 6022 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:49:28 ctl02 nova-api[6022]: 2017-09-28 11:49:28.312 6022 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:49:28 ctl02 nova-api[6022]: 2017-09-28 11:49:28.312 6022 ERROR nova.wsgi     self.filename))
Sep 28 11:49:28 ctl02 nova-api[6022]: 2017-09-28 11:49:28.312 6022 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:49:28 ctl02 nova-api[6022]: 2017-09-28 11:49:28.312 6022 ERROR nova.wsgi
Sep 28 11:49:28 ctl02 nova-api[6022]: 2017-09-28 11:49:28.313 6022 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:49:28 ctl02 nova-api[6022]: 2017-09-28 11:49:28.444 6022 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:49:28 ctl02 nova-api[6022]: 2017-09-28 11:49:28.691 6022 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:49:28 ctl02 nova-api[6022]: 2017-09-28 11:49:28.694 6022 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:49:28 ctl02 nova-api[6022]: 2017-09-28 11:49:28.694 6022 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:49:28 ctl02 nova-api[6022]: 2017-09-28 11:49:28.694 6022 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:49:28 ctl02 nova-consoleauth[5433]: 2017-09-28 11:49:28.772 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 8 seconds.
Sep 28 11:49:28 ctl02 nova-api[6022]: 2017-09-28 11:49:28.825 6022 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:49:28 ctl02 nova-api[6022]: 2017-09-28 11:49:28.827 6022 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:49:28 ctl02 nova-api[6022]: 2017-09-28 11:49:28.827 6022 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:49:28 ctl02 nova-api[6022]: 2017-09-28 11:49:28.827 6022 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:49:28 ctl02 nova-api[6022]: 2017-09-28 11:49:28.831 6022 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:49:28 ctl02 nova-api[6022]: 2017-09-28 11:49:28.831 6022 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:49:28 ctl02 nova-api[6022]: 2017-09-28 11:49:28.831 6022 ERROR nova Traceback (most recent call last):
Sep 28 11:49:28 ctl02 nova-api[6022]: 2017-09-28 11:49:28.831 6022 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:49:28 ctl02 nova-api[6022]: 2017-09-28 11:49:28.831 6022 ERROR nova     sys.exit(main())
Sep 28 11:49:28 ctl02 nova-api[6022]: 2017-09-28 11:49:28.831 6022 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:49:28 ctl02 nova-api[6022]: 2017-09-28 11:49:28.831 6022 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:49:28 ctl02 nova-api[6022]: 2017-09-28 11:49:28.831 6022 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:49:28 ctl02 nova-api[6022]: 2017-09-28 11:49:28.831 6022 ERROR nova     max_url_len=max_url_len)
Sep 28 11:49:28 ctl02 nova-api[6022]: 2017-09-28 11:49:28.831 6022 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:49:28 ctl02 nova-api[6022]: 2017-09-28 11:49:28.831 6022 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:49:28 ctl02 nova-api[6022]: 2017-09-28 11:49:28.831 6022 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:49:28 ctl02 nova-api[6022]: 2017-09-28 11:49:28.831 6022 ERROR nova     sock.listen(backlog)
Sep 28 11:49:28 ctl02 nova-api[6022]: 2017-09-28 11:49:28.831 6022 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:49:28 ctl02 nova-api[6022]: 2017-09-28 11:49:28.831 6022 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:49:28 ctl02 nova-api[6022]: 2017-09-28 11:49:28.831 6022 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:49:28 ctl02 nova-api[6022]: 2017-09-28 11:49:28.831 6022 ERROR nova
Sep 28 11:49:29 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:49:29 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:49:29 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:49:29 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:49:29 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:49:29 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:49:29 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:49:29 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command test.ping with jid 20170928114929365531
Sep 28 11:49:29 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 6058
Sep 28 11:49:29 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928114929365531
Sep 28 11:49:29 ctl02 glance-api[29183]: 2017-09-28 11:49:29.548 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:49:29] "OPTIONS / HTTP/1.0" 200 134 0.000799
Sep 28 11:49:30 ctl02 nova-conductor[5056]: 2017-09-28 11:49:30.027 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 10 seconds.
Sep 28 11:49:30 ctl02 nova-conductor[5056]: 2017-09-28 11:49:30.043 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 10 seconds.
Sep 28 11:49:30 ctl02 nova-conductor[5056]: 2017-09-28 11:49:30.060 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 10 seconds.
Sep 28 11:49:30 ctl02 nova-conductor[5056]: 2017-09-28 11:49:30.060 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 10 seconds.
Sep 28 11:49:30 ctl02 nova-api[6047]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:49:30 ctl02 nova-api[6047]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:49:30 ctl02 nova-api[6047]: 2017-09-28 11:49:30.812 6047 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:49:30 ctl02 nova-api[6047]: 2017-09-28 11:49:30.813 6047 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:49:30 ctl02 nova-api[6047]: 2017-09-28 11:49:30.813 6047 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:49:30 ctl02 nova-api[6047]: 2017-09-28 11:49:30.813 6047 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:49:30 ctl02 nova-api[6047]: 2017-09-28 11:49:30.813 6047 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:49:30 ctl02 nova-api[6047]: 2017-09-28 11:49:30.813 6047 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:49:30 ctl02 nova-api[6047]: 2017-09-28 11:49:30.813 6047 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:49:30 ctl02 nova-api[6047]: 2017-09-28 11:49:30.813 6047 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:49:30 ctl02 nova-api[6047]: 2017-09-28 11:49:30.813 6047 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:49:30 ctl02 nova-api[6047]: 2017-09-28 11:49:30.813 6047 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:49:30 ctl02 nova-api[6047]: 2017-09-28 11:49:30.813 6047 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:49:30 ctl02 nova-api[6047]: 2017-09-28 11:49:30.813 6047 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:49:30 ctl02 nova-api[6047]: 2017-09-28 11:49:30.813 6047 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:49:30 ctl02 nova-api[6047]: 2017-09-28 11:49:30.813 6047 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:49:30 ctl02 nova-api[6047]: 2017-09-28 11:49:30.813 6047 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:49:30 ctl02 nova-api[6047]: 2017-09-28 11:49:30.813 6047 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:49:30 ctl02 nova-api[6047]: 2017-09-28 11:49:30.813 6047 ERROR nova.wsgi     self.filename))
Sep 28 11:49:30 ctl02 nova-api[6047]: 2017-09-28 11:49:30.813 6047 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:49:30 ctl02 nova-api[6047]: 2017-09-28 11:49:30.813 6047 ERROR nova.wsgi
Sep 28 11:49:30 ctl02 nova-api[6047]: 2017-09-28 11:49:30.814 6047 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:49:30 ctl02 nova-api[6047]: 2017-09-28 11:49:30.940 6047 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:49:31 ctl02 nova-api[6047]: 2017-09-28 11:49:31.157 6047 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:49:31 ctl02 nova-api[6047]: 2017-09-28 11:49:31.159 6047 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:49:31 ctl02 nova-api[6047]: 2017-09-28 11:49:31.159 6047 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:49:31 ctl02 nova-api[6047]: 2017-09-28 11:49:31.159 6047 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:49:31 ctl02 nova-api[6047]: 2017-09-28 11:49:31.286 6047 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:49:31 ctl02 nova-api[6047]: 2017-09-28 11:49:31.288 6047 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:49:31 ctl02 nova-api[6047]: 2017-09-28 11:49:31.288 6047 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:49:31 ctl02 nova-api[6047]: 2017-09-28 11:49:31.289 6047 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:49:31 ctl02 nova-api[6047]: 2017-09-28 11:49:31.292 6047 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:49:31 ctl02 nova-api[6047]: 2017-09-28 11:49:31.292 6047 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:49:31 ctl02 nova-api[6047]: 2017-09-28 11:49:31.292 6047 ERROR nova Traceback (most recent call last):
Sep 28 11:49:31 ctl02 nova-api[6047]: 2017-09-28 11:49:31.292 6047 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:49:31 ctl02 nova-api[6047]: 2017-09-28 11:49:31.292 6047 ERROR nova     sys.exit(main())
Sep 28 11:49:31 ctl02 nova-api[6047]: 2017-09-28 11:49:31.292 6047 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:49:31 ctl02 nova-api[6047]: 2017-09-28 11:49:31.292 6047 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:49:31 ctl02 nova-api[6047]: 2017-09-28 11:49:31.292 6047 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:49:31 ctl02 nova-api[6047]: 2017-09-28 11:49:31.292 6047 ERROR nova     max_url_len=max_url_len)
Sep 28 11:49:31 ctl02 nova-api[6047]: 2017-09-28 11:49:31.292 6047 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:49:31 ctl02 nova-api[6047]: 2017-09-28 11:49:31.292 6047 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:49:31 ctl02 nova-api[6047]: 2017-09-28 11:49:31.292 6047 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:49:31 ctl02 nova-api[6047]: 2017-09-28 11:49:31.292 6047 ERROR nova     sock.listen(backlog)
Sep 28 11:49:31 ctl02 nova-api[6047]: 2017-09-28 11:49:31.292 6047 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:49:31 ctl02 nova-api[6047]: 2017-09-28 11:49:31.292 6047 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:49:31 ctl02 nova-api[6047]: 2017-09-28 11:49:31.292 6047 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:49:31 ctl02 nova-api[6047]: 2017-09-28 11:49:31.292 6047 ERROR nova
Sep 28 11:49:31 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:49:31 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:49:31 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:49:31 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:49:31 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:49:31 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:49:31 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:49:31 ctl02 nova-scheduler[5620]: 2017-09-28 11:49:31.793 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 8 seconds.
Sep 28 11:49:33 ctl02 nova-api[6070]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:49:33 ctl02 nova-api[6070]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:49:33 ctl02 nova-api[6070]: 2017-09-28 11:49:33.384 6070 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:49:33 ctl02 nova-api[6070]: 2017-09-28 11:49:33.386 6070 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:49:33 ctl02 nova-api[6070]: 2017-09-28 11:49:33.386 6070 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:49:33 ctl02 nova-api[6070]: 2017-09-28 11:49:33.386 6070 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:49:33 ctl02 nova-api[6070]: 2017-09-28 11:49:33.386 6070 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:49:33 ctl02 nova-api[6070]: 2017-09-28 11:49:33.386 6070 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:49:33 ctl02 nova-api[6070]: 2017-09-28 11:49:33.386 6070 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:49:33 ctl02 nova-api[6070]: 2017-09-28 11:49:33.386 6070 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:49:33 ctl02 nova-api[6070]: 2017-09-28 11:49:33.386 6070 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:49:33 ctl02 nova-api[6070]: 2017-09-28 11:49:33.386 6070 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:49:33 ctl02 nova-api[6070]: 2017-09-28 11:49:33.386 6070 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:49:33 ctl02 nova-api[6070]: 2017-09-28 11:49:33.386 6070 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:49:33 ctl02 nova-api[6070]: 2017-09-28 11:49:33.386 6070 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:49:33 ctl02 nova-api[6070]: 2017-09-28 11:49:33.386 6070 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:49:33 ctl02 nova-api[6070]: 2017-09-28 11:49:33.386 6070 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:49:33 ctl02 nova-api[6070]: 2017-09-28 11:49:33.386 6070 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:49:33 ctl02 nova-api[6070]: 2017-09-28 11:49:33.386 6070 ERROR nova.wsgi     self.filename))
Sep 28 11:49:33 ctl02 nova-api[6070]: 2017-09-28 11:49:33.386 6070 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:49:33 ctl02 nova-api[6070]: 2017-09-28 11:49:33.386 6070 ERROR nova.wsgi
Sep 28 11:49:33 ctl02 nova-api[6070]: 2017-09-28 11:49:33.388 6070 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:49:33 ctl02 nova-api[6070]: 2017-09-28 11:49:33.519 6070 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:49:33 ctl02 nova-api[6070]: 2017-09-28 11:49:33.760 6070 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:49:33 ctl02 nova-api[6070]: 2017-09-28 11:49:33.762 6070 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:49:33 ctl02 nova-api[6070]: 2017-09-28 11:49:33.763 6070 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:49:33 ctl02 nova-api[6070]: 2017-09-28 11:49:33.763 6070 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:49:33 ctl02 nova-api[6070]: 2017-09-28 11:49:33.901 6070 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:49:33 ctl02 nova-api[6070]: 2017-09-28 11:49:33.903 6070 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:49:33 ctl02 nova-api[6070]: 2017-09-28 11:49:33.903 6070 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:49:33 ctl02 nova-api[6070]: 2017-09-28 11:49:33.903 6070 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:49:33 ctl02 nova-api[6070]: 2017-09-28 11:49:33.907 6070 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:49:33 ctl02 nova-api[6070]: 2017-09-28 11:49:33.907 6070 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:49:33 ctl02 nova-api[6070]: 2017-09-28 11:49:33.907 6070 ERROR nova Traceback (most recent call last):
Sep 28 11:49:33 ctl02 nova-api[6070]: 2017-09-28 11:49:33.907 6070 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:49:33 ctl02 nova-api[6070]: 2017-09-28 11:49:33.907 6070 ERROR nova     sys.exit(main())
Sep 28 11:49:33 ctl02 nova-api[6070]: 2017-09-28 11:49:33.907 6070 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:49:33 ctl02 nova-api[6070]: 2017-09-28 11:49:33.907 6070 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:49:33 ctl02 nova-api[6070]: 2017-09-28 11:49:33.907 6070 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:49:33 ctl02 nova-api[6070]: 2017-09-28 11:49:33.907 6070 ERROR nova     max_url_len=max_url_len)
Sep 28 11:49:33 ctl02 nova-api[6070]: 2017-09-28 11:49:33.907 6070 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:49:33 ctl02 nova-api[6070]: 2017-09-28 11:49:33.907 6070 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:49:33 ctl02 nova-api[6070]: 2017-09-28 11:49:33.907 6070 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:49:33 ctl02 nova-api[6070]: 2017-09-28 11:49:33.907 6070 ERROR nova     sock.listen(backlog)
Sep 28 11:49:33 ctl02 nova-api[6070]: 2017-09-28 11:49:33.907 6070 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:49:33 ctl02 nova-api[6070]: 2017-09-28 11:49:33.907 6070 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:49:33 ctl02 nova-api[6070]: 2017-09-28 11:49:33.907 6070 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:49:33 ctl02 nova-api[6070]: 2017-09-28 11:49:33.907 6070 ERROR nova
Sep 28 11:49:34 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:49:34 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:49:34 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:49:34 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:49:34 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:49:34 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:49:34 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:49:34 ctl02 glance-api[29183]: 2017-09-28 11:49:34.656 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:49:34] "OPTIONS / HTTP/1.0" 200 134 0.000918
Sep 28 11:49:35 ctl02 nova-api[6088]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:49:35 ctl02 nova-api[6088]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:49:36 ctl02 nova-api[6088]: 2017-09-28 11:49:36.125 6088 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:49:36 ctl02 nova-api[6088]: 2017-09-28 11:49:36.127 6088 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:49:36 ctl02 nova-api[6088]: 2017-09-28 11:49:36.127 6088 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:49:36 ctl02 nova-api[6088]: 2017-09-28 11:49:36.127 6088 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:49:36 ctl02 nova-api[6088]: 2017-09-28 11:49:36.127 6088 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:49:36 ctl02 nova-api[6088]: 2017-09-28 11:49:36.127 6088 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:49:36 ctl02 nova-api[6088]: 2017-09-28 11:49:36.127 6088 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:49:36 ctl02 nova-api[6088]: 2017-09-28 11:49:36.127 6088 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:49:36 ctl02 nova-api[6088]: 2017-09-28 11:49:36.127 6088 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:49:36 ctl02 nova-api[6088]: 2017-09-28 11:49:36.127 6088 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:49:36 ctl02 nova-api[6088]: 2017-09-28 11:49:36.127 6088 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:49:36 ctl02 nova-api[6088]: 2017-09-28 11:49:36.127 6088 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:49:36 ctl02 nova-api[6088]: 2017-09-28 11:49:36.127 6088 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:49:36 ctl02 nova-api[6088]: 2017-09-28 11:49:36.127 6088 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:49:36 ctl02 nova-api[6088]: 2017-09-28 11:49:36.127 6088 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:49:36 ctl02 nova-api[6088]: 2017-09-28 11:49:36.127 6088 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:49:36 ctl02 nova-api[6088]: 2017-09-28 11:49:36.127 6088 ERROR nova.wsgi     self.filename))
Sep 28 11:49:36 ctl02 nova-api[6088]: 2017-09-28 11:49:36.127 6088 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:49:36 ctl02 nova-api[6088]: 2017-09-28 11:49:36.127 6088 ERROR nova.wsgi
Sep 28 11:49:36 ctl02 nova-api[6088]: 2017-09-28 11:49:36.128 6088 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:49:36 ctl02 nova-api[6088]: 2017-09-28 11:49:36.261 6088 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:49:36 ctl02 nova-api[6088]: 2017-09-28 11:49:36.496 6088 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:49:36 ctl02 nova-api[6088]: 2017-09-28 11:49:36.499 6088 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:49:36 ctl02 nova-api[6088]: 2017-09-28 11:49:36.499 6088 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:49:36 ctl02 nova-api[6088]: 2017-09-28 11:49:36.499 6088 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:49:36 ctl02 nova-api[6088]: 2017-09-28 11:49:36.634 6088 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:49:36 ctl02 nova-api[6088]: 2017-09-28 11:49:36.635 6088 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:49:36 ctl02 nova-api[6088]: 2017-09-28 11:49:36.636 6088 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:49:36 ctl02 nova-api[6088]: 2017-09-28 11:49:36.636 6088 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:49:36 ctl02 nova-api[6088]: 2017-09-28 11:49:36.639 6088 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:49:36 ctl02 nova-api[6088]: 2017-09-28 11:49:36.640 6088 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:49:36 ctl02 nova-api[6088]: 2017-09-28 11:49:36.640 6088 ERROR nova Traceback (most recent call last):
Sep 28 11:49:36 ctl02 nova-api[6088]: 2017-09-28 11:49:36.640 6088 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:49:36 ctl02 nova-api[6088]: 2017-09-28 11:49:36.640 6088 ERROR nova     sys.exit(main())
Sep 28 11:49:36 ctl02 nova-api[6088]: 2017-09-28 11:49:36.640 6088 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:49:36 ctl02 nova-api[6088]: 2017-09-28 11:49:36.640 6088 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:49:36 ctl02 nova-api[6088]: 2017-09-28 11:49:36.640 6088 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:49:36 ctl02 nova-api[6088]: 2017-09-28 11:49:36.640 6088 ERROR nova     max_url_len=max_url_len)
Sep 28 11:49:36 ctl02 nova-api[6088]: 2017-09-28 11:49:36.640 6088 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:49:36 ctl02 nova-api[6088]: 2017-09-28 11:49:36.640 6088 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:49:36 ctl02 nova-api[6088]: 2017-09-28 11:49:36.640 6088 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:49:36 ctl02 nova-api[6088]: 2017-09-28 11:49:36.640 6088 ERROR nova     sock.listen(backlog)
Sep 28 11:49:36 ctl02 nova-api[6088]: 2017-09-28 11:49:36.640 6088 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:49:36 ctl02 nova-api[6088]: 2017-09-28 11:49:36.640 6088 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:49:36 ctl02 nova-api[6088]: 2017-09-28 11:49:36.640 6088 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:49:36 ctl02 nova-api[6088]: 2017-09-28 11:49:36.640 6088 ERROR nova
Sep 28 11:49:36 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:49:36 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:49:36 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:49:36 ctl02 nova-consoleauth[5433]: 2017-09-28 11:49:36.785 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 10 seconds.
Sep 28 11:49:36 ctl02 nova-cert[4860]: 2017-09-28 11:49:36.893 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 12 seconds.
Sep 28 11:49:37 ctl02 glance-api[29183]: 2017-09-28 11:49:37.021 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:49:37] "OPTIONS / HTTP/1.0" 200 134 0.001162
Sep 28 11:49:37 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:49:37 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:49:37 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:49:37 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:49:38 ctl02 nova-api[6106]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:49:38 ctl02 nova-api[6106]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:49:38 ctl02 nova-api[6106]: 2017-09-28 11:49:38.846 6106 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:49:38 ctl02 nova-api[6106]: 2017-09-28 11:49:38.847 6106 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:49:38 ctl02 nova-api[6106]: 2017-09-28 11:49:38.847 6106 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:49:38 ctl02 nova-api[6106]: 2017-09-28 11:49:38.847 6106 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:49:38 ctl02 nova-api[6106]: 2017-09-28 11:49:38.847 6106 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:49:38 ctl02 nova-api[6106]: 2017-09-28 11:49:38.847 6106 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:49:38 ctl02 nova-api[6106]: 2017-09-28 11:49:38.847 6106 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:49:38 ctl02 nova-api[6106]: 2017-09-28 11:49:38.847 6106 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:49:38 ctl02 nova-api[6106]: 2017-09-28 11:49:38.847 6106 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:49:38 ctl02 nova-api[6106]: 2017-09-28 11:49:38.847 6106 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:49:38 ctl02 nova-api[6106]: 2017-09-28 11:49:38.847 6106 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:49:38 ctl02 nova-api[6106]: 2017-09-28 11:49:38.847 6106 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:49:38 ctl02 nova-api[6106]: 2017-09-28 11:49:38.847 6106 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:49:38 ctl02 nova-api[6106]: 2017-09-28 11:49:38.847 6106 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:49:38 ctl02 nova-api[6106]: 2017-09-28 11:49:38.847 6106 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:49:38 ctl02 nova-api[6106]: 2017-09-28 11:49:38.847 6106 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:49:38 ctl02 nova-api[6106]: 2017-09-28 11:49:38.847 6106 ERROR nova.wsgi     self.filename))
Sep 28 11:49:38 ctl02 nova-api[6106]: 2017-09-28 11:49:38.847 6106 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:49:38 ctl02 nova-api[6106]: 2017-09-28 11:49:38.847 6106 ERROR nova.wsgi
Sep 28 11:49:38 ctl02 nova-api[6106]: 2017-09-28 11:49:38.848 6106 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:49:38 ctl02 nova-api[6106]: 2017-09-28 11:49:38.981 6106 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:49:39 ctl02 nova-api[6106]: 2017-09-28 11:49:39.219 6106 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:49:39 ctl02 nova-api[6106]: 2017-09-28 11:49:39.222 6106 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:49:39 ctl02 nova-api[6106]: 2017-09-28 11:49:39.222 6106 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:49:39 ctl02 nova-api[6106]: 2017-09-28 11:49:39.222 6106 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:49:39 ctl02 nova-api[6106]: 2017-09-28 11:49:39.352 6106 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:49:39 ctl02 nova-api[6106]: 2017-09-28 11:49:39.354 6106 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:49:39 ctl02 nova-api[6106]: 2017-09-28 11:49:39.354 6106 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:49:39 ctl02 nova-api[6106]: 2017-09-28 11:49:39.355 6106 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:49:39 ctl02 nova-api[6106]: 2017-09-28 11:49:39.358 6106 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:49:39 ctl02 nova-api[6106]: 2017-09-28 11:49:39.358 6106 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:49:39 ctl02 nova-api[6106]: 2017-09-28 11:49:39.358 6106 ERROR nova Traceback (most recent call last):
Sep 28 11:49:39 ctl02 nova-api[6106]: 2017-09-28 11:49:39.358 6106 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:49:39 ctl02 nova-api[6106]: 2017-09-28 11:49:39.358 6106 ERROR nova     sys.exit(main())
Sep 28 11:49:39 ctl02 nova-api[6106]: 2017-09-28 11:49:39.358 6106 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:49:39 ctl02 nova-api[6106]: 2017-09-28 11:49:39.358 6106 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:49:39 ctl02 nova-api[6106]: 2017-09-28 11:49:39.358 6106 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:49:39 ctl02 nova-api[6106]: 2017-09-28 11:49:39.358 6106 ERROR nova     max_url_len=max_url_len)
Sep 28 11:49:39 ctl02 nova-api[6106]: 2017-09-28 11:49:39.358 6106 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:49:39 ctl02 nova-api[6106]: 2017-09-28 11:49:39.358 6106 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:49:39 ctl02 nova-api[6106]: 2017-09-28 11:49:39.358 6106 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:49:39 ctl02 nova-api[6106]: 2017-09-28 11:49:39.358 6106 ERROR nova     sock.listen(backlog)
Sep 28 11:49:39 ctl02 nova-api[6106]: 2017-09-28 11:49:39.358 6106 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:49:39 ctl02 nova-api[6106]: 2017-09-28 11:49:39.358 6106 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:49:39 ctl02 nova-api[6106]: 2017-09-28 11:49:39.358 6106 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:49:39 ctl02 nova-api[6106]: 2017-09-28 11:49:39.358 6106 ERROR nova
Sep 28 11:49:39 ctl02 glance-api[29183]: 2017-09-28 11:49:39.377 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:49:39] "OPTIONS / HTTP/1.0" 200 134 0.000839
Sep 28 11:49:39 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:49:39 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:49:39 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:49:39 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:49:39 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:49:39 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:49:39 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:49:39 ctl02 nova-scheduler[5620]: 2017-09-28 11:49:39.807 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 10 seconds.
Sep 28 11:49:40 ctl02 nova-conductor[5056]: 2017-09-28 11:49:40.035 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 12 seconds.
Sep 28 11:49:40 ctl02 nova-conductor[5056]: 2017-09-28 11:49:40.049 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 12 seconds.
Sep 28 11:49:40 ctl02 nova-conductor[5056]: 2017-09-28 11:49:40.065 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 12 seconds.
Sep 28 11:49:40 ctl02 nova-conductor[5056]: 2017-09-28 11:49:40.066 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 12 seconds.
Sep 28 11:49:40 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa40f3410)
Sep 28 11:49:41 ctl02 nova-api[6124]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:49:41 ctl02 nova-api[6124]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:49:41 ctl02 nova-api[6124]: 2017-09-28 11:49:41.330 6124 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:49:41 ctl02 nova-api[6124]: 2017-09-28 11:49:41.332 6124 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:49:41 ctl02 nova-api[6124]: 2017-09-28 11:49:41.332 6124 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:49:41 ctl02 nova-api[6124]: 2017-09-28 11:49:41.332 6124 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:49:41 ctl02 nova-api[6124]: 2017-09-28 11:49:41.332 6124 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:49:41 ctl02 nova-api[6124]: 2017-09-28 11:49:41.332 6124 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:49:41 ctl02 nova-api[6124]: 2017-09-28 11:49:41.332 6124 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:49:41 ctl02 nova-api[6124]: 2017-09-28 11:49:41.332 6124 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:49:41 ctl02 nova-api[6124]: 2017-09-28 11:49:41.332 6124 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:49:41 ctl02 nova-api[6124]: 2017-09-28 11:49:41.332 6124 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:49:41 ctl02 nova-api[6124]: 2017-09-28 11:49:41.332 6124 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:49:41 ctl02 nova-api[6124]: 2017-09-28 11:49:41.332 6124 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:49:41 ctl02 nova-api[6124]: 2017-09-28 11:49:41.332 6124 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:49:41 ctl02 nova-api[6124]: 2017-09-28 11:49:41.332 6124 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:49:41 ctl02 nova-api[6124]: 2017-09-28 11:49:41.332 6124 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:49:41 ctl02 nova-api[6124]: 2017-09-28 11:49:41.332 6124 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:49:41 ctl02 nova-api[6124]: 2017-09-28 11:49:41.332 6124 ERROR nova.wsgi     self.filename))
Sep 28 11:49:41 ctl02 nova-api[6124]: 2017-09-28 11:49:41.332 6124 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:49:41 ctl02 nova-api[6124]: 2017-09-28 11:49:41.332 6124 ERROR nova.wsgi
Sep 28 11:49:41 ctl02 nova-api[6124]: 2017-09-28 11:49:41.334 6124 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:49:41 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa40f3410)
Sep 28 11:49:41 ctl02 nova-api[6124]: 2017-09-28 11:49:41.467 6124 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:49:41 ctl02 nova-api[6124]: 2017-09-28 11:49:41.710 6124 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:49:41 ctl02 nova-api[6124]: 2017-09-28 11:49:41.714 6124 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:49:41 ctl02 nova-api[6124]: 2017-09-28 11:49:41.714 6124 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:49:41 ctl02 nova-api[6124]: 2017-09-28 11:49:41.715 6124 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:49:41 ctl02 nova-api[6124]: 2017-09-28 11:49:41.846 6124 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:49:41 ctl02 nova-api[6124]: 2017-09-28 11:49:41.849 6124 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:49:41 ctl02 nova-api[6124]: 2017-09-28 11:49:41.849 6124 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:49:41 ctl02 nova-api[6124]: 2017-09-28 11:49:41.850 6124 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:49:41 ctl02 nova-api[6124]: 2017-09-28 11:49:41.854 6124 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:49:41 ctl02 nova-api[6124]: 2017-09-28 11:49:41.855 6124 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:49:41 ctl02 nova-api[6124]: 2017-09-28 11:49:41.855 6124 ERROR nova Traceback (most recent call last):
Sep 28 11:49:41 ctl02 nova-api[6124]: 2017-09-28 11:49:41.855 6124 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:49:41 ctl02 nova-api[6124]: 2017-09-28 11:49:41.855 6124 ERROR nova     sys.exit(main())
Sep 28 11:49:41 ctl02 nova-api[6124]: 2017-09-28 11:49:41.855 6124 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:49:41 ctl02 nova-api[6124]: 2017-09-28 11:49:41.855 6124 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:49:41 ctl02 nova-api[6124]: 2017-09-28 11:49:41.855 6124 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:49:41 ctl02 nova-api[6124]: 2017-09-28 11:49:41.855 6124 ERROR nova     max_url_len=max_url_len)
Sep 28 11:49:41 ctl02 nova-api[6124]: 2017-09-28 11:49:41.855 6124 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:49:41 ctl02 nova-api[6124]: 2017-09-28 11:49:41.855 6124 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:49:41 ctl02 nova-api[6124]: 2017-09-28 11:49:41.855 6124 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:49:41 ctl02 nova-api[6124]: 2017-09-28 11:49:41.855 6124 ERROR nova     sock.listen(backlog)
Sep 28 11:49:41 ctl02 nova-api[6124]: 2017-09-28 11:49:41.855 6124 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:49:41 ctl02 nova-api[6124]: 2017-09-28 11:49:41.855 6124 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:49:41 ctl02 nova-api[6124]: 2017-09-28 11:49:41.855 6124 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:49:41 ctl02 nova-api[6124]: 2017-09-28 11:49:41.855 6124 ERROR nova
Sep 28 11:49:42 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:49:42 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:49:42 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:49:42 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:49:42 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:49:42 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:49:42 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:49:42 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa40f3410)
Sep 28 11:49:43 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa40f3410)
Sep 28 11:49:43 ctl02 nova-api[6142]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:49:43 ctl02 nova-api[6142]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:49:43 ctl02 nova-api[6142]: 2017-09-28 11:49:43.797 6142 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:49:43 ctl02 nova-api[6142]: 2017-09-28 11:49:43.798 6142 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:49:43 ctl02 nova-api[6142]: 2017-09-28 11:49:43.798 6142 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:49:43 ctl02 nova-api[6142]: 2017-09-28 11:49:43.798 6142 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:49:43 ctl02 nova-api[6142]: 2017-09-28 11:49:43.798 6142 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:49:43 ctl02 nova-api[6142]: 2017-09-28 11:49:43.798 6142 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:49:43 ctl02 nova-api[6142]: 2017-09-28 11:49:43.798 6142 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:49:43 ctl02 nova-api[6142]: 2017-09-28 11:49:43.798 6142 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:49:43 ctl02 nova-api[6142]: 2017-09-28 11:49:43.798 6142 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:49:43 ctl02 nova-api[6142]: 2017-09-28 11:49:43.798 6142 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:49:43 ctl02 nova-api[6142]: 2017-09-28 11:49:43.798 6142 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:49:43 ctl02 nova-api[6142]: 2017-09-28 11:49:43.798 6142 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:49:43 ctl02 nova-api[6142]: 2017-09-28 11:49:43.798 6142 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:49:43 ctl02 nova-api[6142]: 2017-09-28 11:49:43.798 6142 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:49:43 ctl02 nova-api[6142]: 2017-09-28 11:49:43.798 6142 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:49:43 ctl02 nova-api[6142]: 2017-09-28 11:49:43.798 6142 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:49:43 ctl02 nova-api[6142]: 2017-09-28 11:49:43.798 6142 ERROR nova.wsgi     self.filename))
Sep 28 11:49:43 ctl02 nova-api[6142]: 2017-09-28 11:49:43.798 6142 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:49:43 ctl02 nova-api[6142]: 2017-09-28 11:49:43.798 6142 ERROR nova.wsgi
Sep 28 11:49:43 ctl02 nova-api[6142]: 2017-09-28 11:49:43.799 6142 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:49:43 ctl02 nova-api[6142]: 2017-09-28 11:49:43.927 6142 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:49:44 ctl02 nova-api[6142]: 2017-09-28 11:49:44.165 6142 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:49:44 ctl02 nova-api[6142]: 2017-09-28 11:49:44.167 6142 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:49:44 ctl02 nova-api[6142]: 2017-09-28 11:49:44.167 6142 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:49:44 ctl02 nova-api[6142]: 2017-09-28 11:49:44.167 6142 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:49:44 ctl02 nova-api[6142]: 2017-09-28 11:49:44.295 6142 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:49:44 ctl02 nova-api[6142]: 2017-09-28 11:49:44.297 6142 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:49:44 ctl02 nova-api[6142]: 2017-09-28 11:49:44.297 6142 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:49:44 ctl02 nova-api[6142]: 2017-09-28 11:49:44.297 6142 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:49:44 ctl02 nova-api[6142]: 2017-09-28 11:49:44.300 6142 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:49:44 ctl02 nova-api[6142]: 2017-09-28 11:49:44.301 6142 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:49:44 ctl02 nova-api[6142]: 2017-09-28 11:49:44.301 6142 ERROR nova Traceback (most recent call last):
Sep 28 11:49:44 ctl02 nova-api[6142]: 2017-09-28 11:49:44.301 6142 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:49:44 ctl02 nova-api[6142]: 2017-09-28 11:49:44.301 6142 ERROR nova     sys.exit(main())
Sep 28 11:49:44 ctl02 nova-api[6142]: 2017-09-28 11:49:44.301 6142 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:49:44 ctl02 nova-api[6142]: 2017-09-28 11:49:44.301 6142 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:49:44 ctl02 nova-api[6142]: 2017-09-28 11:49:44.301 6142 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:49:44 ctl02 nova-api[6142]: 2017-09-28 11:49:44.301 6142 ERROR nova     max_url_len=max_url_len)
Sep 28 11:49:44 ctl02 nova-api[6142]: 2017-09-28 11:49:44.301 6142 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:49:44 ctl02 nova-api[6142]: 2017-09-28 11:49:44.301 6142 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:49:44 ctl02 nova-api[6142]: 2017-09-28 11:49:44.301 6142 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:49:44 ctl02 nova-api[6142]: 2017-09-28 11:49:44.301 6142 ERROR nova     sock.listen(backlog)
Sep 28 11:49:44 ctl02 nova-api[6142]: 2017-09-28 11:49:44.301 6142 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:49:44 ctl02 nova-api[6142]: 2017-09-28 11:49:44.301 6142 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:49:44 ctl02 nova-api[6142]: 2017-09-28 11:49:44.301 6142 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:49:44 ctl02 nova-api[6142]: 2017-09-28 11:49:44.301 6142 ERROR nova
Sep 28 11:49:44 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa40f3410)
Sep 28 11:49:44 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:49:44 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:49:44 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:49:44 ctl02 glance-api[29183]: 2017-09-28 11:49:44.522 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:49:44] "OPTIONS / HTTP/1.0" 200 134 0.000727
Sep 28 11:49:44 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:49:44 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:49:44 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:49:44 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:49:45 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa40f3410)
Sep 28 11:49:46 ctl02 nova-api[6160]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:49:46 ctl02 nova-api[6160]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:49:46 ctl02 nova-api[6160]: 2017-09-28 11:49:46.305 6160 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:49:46 ctl02 nova-api[6160]: 2017-09-28 11:49:46.307 6160 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:49:46 ctl02 nova-api[6160]: 2017-09-28 11:49:46.307 6160 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:49:46 ctl02 nova-api[6160]: 2017-09-28 11:49:46.307 6160 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:49:46 ctl02 nova-api[6160]: 2017-09-28 11:49:46.307 6160 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:49:46 ctl02 nova-api[6160]: 2017-09-28 11:49:46.307 6160 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:49:46 ctl02 nova-api[6160]: 2017-09-28 11:49:46.307 6160 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:49:46 ctl02 nova-api[6160]: 2017-09-28 11:49:46.307 6160 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:49:46 ctl02 nova-api[6160]: 2017-09-28 11:49:46.307 6160 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:49:46 ctl02 nova-api[6160]: 2017-09-28 11:49:46.307 6160 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:49:46 ctl02 nova-api[6160]: 2017-09-28 11:49:46.307 6160 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:49:46 ctl02 nova-api[6160]: 2017-09-28 11:49:46.307 6160 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:49:46 ctl02 nova-api[6160]: 2017-09-28 11:49:46.307 6160 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:49:46 ctl02 nova-api[6160]: 2017-09-28 11:49:46.307 6160 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:49:46 ctl02 nova-api[6160]: 2017-09-28 11:49:46.307 6160 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:49:46 ctl02 nova-api[6160]: 2017-09-28 11:49:46.307 6160 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:49:46 ctl02 nova-api[6160]: 2017-09-28 11:49:46.307 6160 ERROR nova.wsgi     self.filename))
Sep 28 11:49:46 ctl02 nova-api[6160]: 2017-09-28 11:49:46.307 6160 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:49:46 ctl02 nova-api[6160]: 2017-09-28 11:49:46.307 6160 ERROR nova.wsgi
Sep 28 11:49:46 ctl02 nova-api[6160]: 2017-09-28 11:49:46.308 6160 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:49:46 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa40f3410)
Sep 28 11:49:46 ctl02 nova-api[6160]: 2017-09-28 11:49:46.437 6160 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:49:46 ctl02 nova-api[6160]: 2017-09-28 11:49:46.667 6160 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:49:46 ctl02 nova-api[6160]: 2017-09-28 11:49:46.669 6160 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:49:46 ctl02 nova-api[6160]: 2017-09-28 11:49:46.670 6160 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:49:46 ctl02 nova-api[6160]: 2017-09-28 11:49:46.670 6160 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:49:46 ctl02 nova-consoleauth[5433]: 2017-09-28 11:49:46.800 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 12 seconds.
Sep 28 11:49:46 ctl02 nova-api[6160]: 2017-09-28 11:49:46.801 6160 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:49:46 ctl02 nova-api[6160]: 2017-09-28 11:49:46.803 6160 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:49:46 ctl02 nova-api[6160]: 2017-09-28 11:49:46.803 6160 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:49:46 ctl02 nova-api[6160]: 2017-09-28 11:49:46.804 6160 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:49:46 ctl02 nova-api[6160]: 2017-09-28 11:49:46.807 6160 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:49:46 ctl02 nova-api[6160]: 2017-09-28 11:49:46.807 6160 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:49:46 ctl02 nova-api[6160]: 2017-09-28 11:49:46.807 6160 ERROR nova Traceback (most recent call last):
Sep 28 11:49:46 ctl02 nova-api[6160]: 2017-09-28 11:49:46.807 6160 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:49:46 ctl02 nova-api[6160]: 2017-09-28 11:49:46.807 6160 ERROR nova     sys.exit(main())
Sep 28 11:49:46 ctl02 nova-api[6160]: 2017-09-28 11:49:46.807 6160 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:49:46 ctl02 nova-api[6160]: 2017-09-28 11:49:46.807 6160 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:49:46 ctl02 nova-api[6160]: 2017-09-28 11:49:46.807 6160 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:49:46 ctl02 nova-api[6160]: 2017-09-28 11:49:46.807 6160 ERROR nova     max_url_len=max_url_len)
Sep 28 11:49:46 ctl02 nova-api[6160]: 2017-09-28 11:49:46.807 6160 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:49:46 ctl02 nova-api[6160]: 2017-09-28 11:49:46.807 6160 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:49:46 ctl02 nova-api[6160]: 2017-09-28 11:49:46.807 6160 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:49:46 ctl02 nova-api[6160]: 2017-09-28 11:49:46.807 6160 ERROR nova     sock.listen(backlog)
Sep 28 11:49:46 ctl02 nova-api[6160]: 2017-09-28 11:49:46.807 6160 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:49:46 ctl02 nova-api[6160]: 2017-09-28 11:49:46.807 6160 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:49:46 ctl02 nova-api[6160]: 2017-09-28 11:49:46.807 6160 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:49:46 ctl02 nova-api[6160]: 2017-09-28 11:49:46.807 6160 ERROR nova
Sep 28 11:49:46 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:49:46 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:49:46 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:49:46 ctl02 glance-api[29183]: 2017-09-28 11:49:46.996 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:49:46] "OPTIONS / HTTP/1.0" 200 134 0.000648
Sep 28 11:49:47 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:49:47 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:49:47 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:49:47 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:49:47 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa40f3410)
Sep 28 11:49:48 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa40f3410)
Sep 28 11:49:48 ctl02 nova-api[6178]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:49:48 ctl02 nova-api[6178]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:49:48 ctl02 nova-api[6178]: 2017-09-28 11:49:48.805 6178 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:49:48 ctl02 nova-api[6178]: 2017-09-28 11:49:48.806 6178 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:49:48 ctl02 nova-api[6178]: 2017-09-28 11:49:48.806 6178 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:49:48 ctl02 nova-api[6178]: 2017-09-28 11:49:48.806 6178 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:49:48 ctl02 nova-api[6178]: 2017-09-28 11:49:48.806 6178 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:49:48 ctl02 nova-api[6178]: 2017-09-28 11:49:48.806 6178 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:49:48 ctl02 nova-api[6178]: 2017-09-28 11:49:48.806 6178 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:49:48 ctl02 nova-api[6178]: 2017-09-28 11:49:48.806 6178 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:49:48 ctl02 nova-api[6178]: 2017-09-28 11:49:48.806 6178 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:49:48 ctl02 nova-api[6178]: 2017-09-28 11:49:48.806 6178 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:49:48 ctl02 nova-api[6178]: 2017-09-28 11:49:48.806 6178 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:49:48 ctl02 nova-api[6178]: 2017-09-28 11:49:48.806 6178 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:49:48 ctl02 nova-api[6178]: 2017-09-28 11:49:48.806 6178 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:49:48 ctl02 nova-api[6178]: 2017-09-28 11:49:48.806 6178 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:49:48 ctl02 nova-api[6178]: 2017-09-28 11:49:48.806 6178 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:49:48 ctl02 nova-api[6178]: 2017-09-28 11:49:48.806 6178 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:49:48 ctl02 nova-api[6178]: 2017-09-28 11:49:48.806 6178 ERROR nova.wsgi     self.filename))
Sep 28 11:49:48 ctl02 nova-api[6178]: 2017-09-28 11:49:48.806 6178 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:49:48 ctl02 nova-api[6178]: 2017-09-28 11:49:48.806 6178 ERROR nova.wsgi
Sep 28 11:49:48 ctl02 nova-api[6178]: 2017-09-28 11:49:48.807 6178 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:49:48 ctl02 nova-cert[4860]: 2017-09-28 11:49:48.910 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 14 seconds.
Sep 28 11:49:48 ctl02 nova-api[6178]: 2017-09-28 11:49:48.939 6178 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:49:49 ctl02 glance-api[29183]: 2017-09-28 11:49:49.151 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:49:49] "OPTIONS / HTTP/1.0" 200 134 0.000765
Sep 28 11:49:49 ctl02 nova-api[6178]: 2017-09-28 11:49:49.175 6178 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:49:49 ctl02 nova-api[6178]: 2017-09-28 11:49:49.177 6178 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:49:49 ctl02 nova-api[6178]: 2017-09-28 11:49:49.177 6178 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:49:49 ctl02 nova-api[6178]: 2017-09-28 11:49:49.177 6178 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:49:49 ctl02 nova-api[6178]: 2017-09-28 11:49:49.307 6178 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:49:49 ctl02 nova-api[6178]: 2017-09-28 11:49:49.309 6178 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:49:49 ctl02 nova-api[6178]: 2017-09-28 11:49:49.309 6178 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:49:49 ctl02 nova-api[6178]: 2017-09-28 11:49:49.309 6178 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:49:49 ctl02 nova-api[6178]: 2017-09-28 11:49:49.313 6178 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:49:49 ctl02 nova-api[6178]: 2017-09-28 11:49:49.313 6178 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:49:49 ctl02 nova-api[6178]: 2017-09-28 11:49:49.313 6178 ERROR nova Traceback (most recent call last):
Sep 28 11:49:49 ctl02 nova-api[6178]: 2017-09-28 11:49:49.313 6178 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:49:49 ctl02 nova-api[6178]: 2017-09-28 11:49:49.313 6178 ERROR nova     sys.exit(main())
Sep 28 11:49:49 ctl02 nova-api[6178]: 2017-09-28 11:49:49.313 6178 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:49:49 ctl02 nova-api[6178]: 2017-09-28 11:49:49.313 6178 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:49:49 ctl02 nova-api[6178]: 2017-09-28 11:49:49.313 6178 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:49:49 ctl02 nova-api[6178]: 2017-09-28 11:49:49.313 6178 ERROR nova     max_url_len=max_url_len)
Sep 28 11:49:49 ctl02 nova-api[6178]: 2017-09-28 11:49:49.313 6178 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:49:49 ctl02 nova-api[6178]: 2017-09-28 11:49:49.313 6178 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:49:49 ctl02 nova-api[6178]: 2017-09-28 11:49:49.313 6178 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:49:49 ctl02 nova-api[6178]: 2017-09-28 11:49:49.313 6178 ERROR nova     sock.listen(backlog)
Sep 28 11:49:49 ctl02 nova-api[6178]: 2017-09-28 11:49:49.313 6178 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:49:49 ctl02 nova-api[6178]: 2017-09-28 11:49:49.313 6178 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:49:49 ctl02 nova-api[6178]: 2017-09-28 11:49:49.313 6178 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:49:49 ctl02 nova-api[6178]: 2017-09-28 11:49:49.313 6178 ERROR nova
Sep 28 11:49:49 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa40f3410)
Sep 28 11:49:49 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:49:49 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:49:49 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:49:49 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:49:49 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:49:49 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:49:49 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:49:49 ctl02 nova-scheduler[5620]: 2017-09-28 11:49:49.820 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 12 seconds.
Sep 28 11:49:50 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa40f3410)
Sep 28 11:49:51 ctl02 nova-api[6196]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:49:51 ctl02 nova-api[6196]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:49:51 ctl02 nova-api[6196]: 2017-09-28 11:49:51.309 6196 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:49:51 ctl02 nova-api[6196]: 2017-09-28 11:49:51.310 6196 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:49:51 ctl02 nova-api[6196]: 2017-09-28 11:49:51.310 6196 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:49:51 ctl02 nova-api[6196]: 2017-09-28 11:49:51.310 6196 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:49:51 ctl02 nova-api[6196]: 2017-09-28 11:49:51.310 6196 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:49:51 ctl02 nova-api[6196]: 2017-09-28 11:49:51.310 6196 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:49:51 ctl02 nova-api[6196]: 2017-09-28 11:49:51.310 6196 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:49:51 ctl02 nova-api[6196]: 2017-09-28 11:49:51.310 6196 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:49:51 ctl02 nova-api[6196]: 2017-09-28 11:49:51.310 6196 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:49:51 ctl02 nova-api[6196]: 2017-09-28 11:49:51.310 6196 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:49:51 ctl02 nova-api[6196]: 2017-09-28 11:49:51.310 6196 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:49:51 ctl02 nova-api[6196]: 2017-09-28 11:49:51.310 6196 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:49:51 ctl02 nova-api[6196]: 2017-09-28 11:49:51.310 6196 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:49:51 ctl02 nova-api[6196]: 2017-09-28 11:49:51.310 6196 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:49:51 ctl02 nova-api[6196]: 2017-09-28 11:49:51.310 6196 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:49:51 ctl02 nova-api[6196]: 2017-09-28 11:49:51.310 6196 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:49:51 ctl02 nova-api[6196]: 2017-09-28 11:49:51.310 6196 ERROR nova.wsgi     self.filename))
Sep 28 11:49:51 ctl02 nova-api[6196]: 2017-09-28 11:49:51.310 6196 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:49:51 ctl02 nova-api[6196]: 2017-09-28 11:49:51.310 6196 ERROR nova.wsgi
Sep 28 11:49:51 ctl02 nova-api[6196]: 2017-09-28 11:49:51.311 6196 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:49:51 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:49:51 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:49:51 ctl02 nova-api[6196]: 2017-09-28 11:49:51.437 6196 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:49:51 ctl02 nova-api[6196]: 2017-09-28 11:49:51.670 6196 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:49:51 ctl02 nova-api[6196]: 2017-09-28 11:49:51.672 6196 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:49:51 ctl02 nova-api[6196]: 2017-09-28 11:49:51.672 6196 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:49:51 ctl02 nova-api[6196]: 2017-09-28 11:49:51.672 6196 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:49:51 ctl02 nova-api[6196]: 2017-09-28 11:49:51.801 6196 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:49:51 ctl02 nova-api[6196]: 2017-09-28 11:49:51.802 6196 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:49:51 ctl02 nova-api[6196]: 2017-09-28 11:49:51.803 6196 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:49:51 ctl02 nova-api[6196]: 2017-09-28 11:49:51.803 6196 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:49:51 ctl02 nova-api[6196]: 2017-09-28 11:49:51.806 6196 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:49:51 ctl02 nova-api[6196]: 2017-09-28 11:49:51.806 6196 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:49:51 ctl02 nova-api[6196]: 2017-09-28 11:49:51.806 6196 ERROR nova Traceback (most recent call last):
Sep 28 11:49:51 ctl02 nova-api[6196]: 2017-09-28 11:49:51.806 6196 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:49:51 ctl02 nova-api[6196]: 2017-09-28 11:49:51.806 6196 ERROR nova     sys.exit(main())
Sep 28 11:49:51 ctl02 nova-api[6196]: 2017-09-28 11:49:51.806 6196 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:49:51 ctl02 nova-api[6196]: 2017-09-28 11:49:51.806 6196 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:49:51 ctl02 nova-api[6196]: 2017-09-28 11:49:51.806 6196 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:49:51 ctl02 nova-api[6196]: 2017-09-28 11:49:51.806 6196 ERROR nova     max_url_len=max_url_len)
Sep 28 11:49:51 ctl02 nova-api[6196]: 2017-09-28 11:49:51.806 6196 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:49:51 ctl02 nova-api[6196]: 2017-09-28 11:49:51.806 6196 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:49:51 ctl02 nova-api[6196]: 2017-09-28 11:49:51.806 6196 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:49:51 ctl02 nova-api[6196]: 2017-09-28 11:49:51.806 6196 ERROR nova     sock.listen(backlog)
Sep 28 11:49:51 ctl02 nova-api[6196]: 2017-09-28 11:49:51.806 6196 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:49:51 ctl02 nova-api[6196]: 2017-09-28 11:49:51.806 6196 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:49:51 ctl02 nova-api[6196]: 2017-09-28 11:49:51.806 6196 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:49:51 ctl02 nova-api[6196]: 2017-09-28 11:49:51.806 6196 ERROR nova
Sep 28 11:49:51 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:49:51 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:49:51 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:49:52 ctl02 nova-conductor[5056]: 2017-09-28 11:49:52.041 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 14 seconds.
Sep 28 11:49:52 ctl02 nova-conductor[5056]: 2017-09-28 11:49:52.055 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 14 seconds.
Sep 28 11:49:52 ctl02 nova-conductor[5056]: 2017-09-28 11:49:52.072 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 14 seconds.
Sep 28 11:49:52 ctl02 nova-conductor[5056]: 2017-09-28 11:49:52.072 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 14 seconds.
Sep 28 11:49:52 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:49:52 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:49:52 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:49:52 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:49:53 ctl02 nova-api[6219]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:49:53 ctl02 nova-api[6219]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:49:53 ctl02 nova-api[6219]: 2017-09-28 11:49:53.828 6219 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:49:53 ctl02 nova-api[6219]: 2017-09-28 11:49:53.878 6219 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:49:53 ctl02 nova-api[6219]: 2017-09-28 11:49:53.878 6219 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:49:53 ctl02 nova-api[6219]: 2017-09-28 11:49:53.878 6219 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:49:53 ctl02 nova-api[6219]: 2017-09-28 11:49:53.878 6219 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:49:53 ctl02 nova-api[6219]: 2017-09-28 11:49:53.878 6219 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:49:53 ctl02 nova-api[6219]: 2017-09-28 11:49:53.878 6219 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:49:53 ctl02 nova-api[6219]: 2017-09-28 11:49:53.878 6219 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:49:53 ctl02 nova-api[6219]: 2017-09-28 11:49:53.878 6219 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:49:53 ctl02 nova-api[6219]: 2017-09-28 11:49:53.878 6219 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:49:53 ctl02 nova-api[6219]: 2017-09-28 11:49:53.878 6219 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:49:53 ctl02 nova-api[6219]: 2017-09-28 11:49:53.878 6219 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:49:53 ctl02 nova-api[6219]: 2017-09-28 11:49:53.878 6219 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:49:53 ctl02 nova-api[6219]: 2017-09-28 11:49:53.878 6219 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:49:53 ctl02 nova-api[6219]: 2017-09-28 11:49:53.878 6219 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:49:53 ctl02 nova-api[6219]: 2017-09-28 11:49:53.878 6219 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:49:53 ctl02 nova-api[6219]: 2017-09-28 11:49:53.878 6219 ERROR nova.wsgi     self.filename))
Sep 28 11:49:53 ctl02 nova-api[6219]: 2017-09-28 11:49:53.878 6219 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:49:53 ctl02 nova-api[6219]: 2017-09-28 11:49:53.878 6219 ERROR nova.wsgi
Sep 28 11:49:53 ctl02 nova-api[6219]: 2017-09-28 11:49:53.879 6219 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:49:54 ctl02 nova-api[6219]: 2017-09-28 11:49:54.008 6219 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:49:54 ctl02 glance-api[29183]: 2017-09-28 11:49:54.245 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:49:54] "OPTIONS / HTTP/1.0" 200 134 0.001051
Sep 28 11:49:54 ctl02 nova-api[6219]: 2017-09-28 11:49:54.246 6219 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:49:54 ctl02 nova-api[6219]: 2017-09-28 11:49:54.249 6219 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:49:54 ctl02 nova-api[6219]: 2017-09-28 11:49:54.249 6219 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:49:54 ctl02 nova-api[6219]: 2017-09-28 11:49:54.250 6219 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:49:54 ctl02 nova-api[6219]: 2017-09-28 11:49:54.389 6219 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:49:54 ctl02 nova-api[6219]: 2017-09-28 11:49:54.391 6219 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:49:54 ctl02 nova-api[6219]: 2017-09-28 11:49:54.391 6219 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:49:54 ctl02 nova-api[6219]: 2017-09-28 11:49:54.391 6219 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:49:54 ctl02 nova-api[6219]: 2017-09-28 11:49:54.394 6219 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:49:54 ctl02 nova-api[6219]: 2017-09-28 11:49:54.395 6219 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:49:54 ctl02 nova-api[6219]: 2017-09-28 11:49:54.395 6219 ERROR nova Traceback (most recent call last):
Sep 28 11:49:54 ctl02 nova-api[6219]: 2017-09-28 11:49:54.395 6219 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:49:54 ctl02 nova-api[6219]: 2017-09-28 11:49:54.395 6219 ERROR nova     sys.exit(main())
Sep 28 11:49:54 ctl02 nova-api[6219]: 2017-09-28 11:49:54.395 6219 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:49:54 ctl02 nova-api[6219]: 2017-09-28 11:49:54.395 6219 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:49:54 ctl02 nova-api[6219]: 2017-09-28 11:49:54.395 6219 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:49:54 ctl02 nova-api[6219]: 2017-09-28 11:49:54.395 6219 ERROR nova     max_url_len=max_url_len)
Sep 28 11:49:54 ctl02 nova-api[6219]: 2017-09-28 11:49:54.395 6219 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:49:54 ctl02 nova-api[6219]: 2017-09-28 11:49:54.395 6219 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:49:54 ctl02 nova-api[6219]: 2017-09-28 11:49:54.395 6219 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:49:54 ctl02 nova-api[6219]: 2017-09-28 11:49:54.395 6219 ERROR nova     sock.listen(backlog)
Sep 28 11:49:54 ctl02 nova-api[6219]: 2017-09-28 11:49:54.395 6219 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:49:54 ctl02 nova-api[6219]: 2017-09-28 11:49:54.395 6219 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:49:54 ctl02 nova-api[6219]: 2017-09-28 11:49:54.395 6219 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:49:54 ctl02 nova-api[6219]: 2017-09-28 11:49:54.395 6219 ERROR nova
Sep 28 11:49:54 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:49:54 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:49:54 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:49:54 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:49:54 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:49:54 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:49:54 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:49:56 ctl02 nova-api[6237]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:49:56 ctl02 nova-api[6237]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:49:56 ctl02 nova-api[6237]: 2017-09-28 11:49:56.546 6237 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:49:56 ctl02 nova-api[6237]: 2017-09-28 11:49:56.547 6237 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:49:56 ctl02 nova-api[6237]: 2017-09-28 11:49:56.547 6237 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:49:56 ctl02 nova-api[6237]: 2017-09-28 11:49:56.547 6237 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:49:56 ctl02 nova-api[6237]: 2017-09-28 11:49:56.547 6237 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:49:56 ctl02 nova-api[6237]: 2017-09-28 11:49:56.547 6237 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:49:56 ctl02 nova-api[6237]: 2017-09-28 11:49:56.547 6237 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:49:56 ctl02 nova-api[6237]: 2017-09-28 11:49:56.547 6237 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:49:56 ctl02 nova-api[6237]: 2017-09-28 11:49:56.547 6237 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:49:56 ctl02 nova-api[6237]: 2017-09-28 11:49:56.547 6237 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:49:56 ctl02 nova-api[6237]: 2017-09-28 11:49:56.547 6237 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:49:56 ctl02 nova-api[6237]: 2017-09-28 11:49:56.547 6237 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:49:56 ctl02 nova-api[6237]: 2017-09-28 11:49:56.547 6237 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:49:56 ctl02 nova-api[6237]: 2017-09-28 11:49:56.547 6237 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:49:56 ctl02 nova-api[6237]: 2017-09-28 11:49:56.547 6237 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:49:56 ctl02 nova-api[6237]: 2017-09-28 11:49:56.547 6237 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:49:56 ctl02 nova-api[6237]: 2017-09-28 11:49:56.547 6237 ERROR nova.wsgi     self.filename))
Sep 28 11:49:56 ctl02 nova-api[6237]: 2017-09-28 11:49:56.547 6237 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:49:56 ctl02 nova-api[6237]: 2017-09-28 11:49:56.547 6237 ERROR nova.wsgi
Sep 28 11:49:56 ctl02 nova-api[6237]: 2017-09-28 11:49:56.548 6237 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:49:56 ctl02 nova-api[6237]: 2017-09-28 11:49:56.675 6237 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:49:56 ctl02 nova-api[6237]: 2017-09-28 11:49:56.905 6237 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:49:56 ctl02 nova-api[6237]: 2017-09-28 11:49:56.907 6237 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:49:56 ctl02 nova-api[6237]: 2017-09-28 11:49:56.907 6237 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:49:56 ctl02 nova-api[6237]: 2017-09-28 11:49:56.908 6237 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:49:57 ctl02 nova-api[6237]: 2017-09-28 11:49:57.036 6237 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:49:57 ctl02 nova-api[6237]: 2017-09-28 11:49:57.038 6237 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:49:57 ctl02 nova-api[6237]: 2017-09-28 11:49:57.038 6237 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:49:57 ctl02 nova-api[6237]: 2017-09-28 11:49:57.039 6237 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:49:57 ctl02 nova-api[6237]: 2017-09-28 11:49:57.043 6237 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:49:57 ctl02 nova-api[6237]: 2017-09-28 11:49:57.043 6237 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:49:57 ctl02 nova-api[6237]: 2017-09-28 11:49:57.043 6237 ERROR nova Traceback (most recent call last):
Sep 28 11:49:57 ctl02 nova-api[6237]: 2017-09-28 11:49:57.043 6237 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:49:57 ctl02 nova-api[6237]: 2017-09-28 11:49:57.043 6237 ERROR nova     sys.exit(main())
Sep 28 11:49:57 ctl02 nova-api[6237]: 2017-09-28 11:49:57.043 6237 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:49:57 ctl02 nova-api[6237]: 2017-09-28 11:49:57.043 6237 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:49:57 ctl02 nova-api[6237]: 2017-09-28 11:49:57.043 6237 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:49:57 ctl02 nova-api[6237]: 2017-09-28 11:49:57.043 6237 ERROR nova     max_url_len=max_url_len)
Sep 28 11:49:57 ctl02 nova-api[6237]: 2017-09-28 11:49:57.043 6237 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:49:57 ctl02 nova-api[6237]: 2017-09-28 11:49:57.043 6237 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:49:57 ctl02 nova-api[6237]: 2017-09-28 11:49:57.043 6237 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:49:57 ctl02 nova-api[6237]: 2017-09-28 11:49:57.043 6237 ERROR nova     sock.listen(backlog)
Sep 28 11:49:57 ctl02 nova-api[6237]: 2017-09-28 11:49:57.043 6237 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:49:57 ctl02 nova-api[6237]: 2017-09-28 11:49:57.043 6237 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:49:57 ctl02 nova-api[6237]: 2017-09-28 11:49:57.043 6237 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:49:57 ctl02 nova-api[6237]: 2017-09-28 11:49:57.043 6237 ERROR nova
Sep 28 11:49:57 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:49:57 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:49:57 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:49:57 ctl02 glance-api[29183]: 2017-09-28 11:49:57.228 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:49:57] "OPTIONS / HTTP/1.0" 200 134 0.001010
Sep 28 11:49:57 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:49:57 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:49:57 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:49:57 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:49:58 ctl02 nova-consoleauth[5433]: 2017-09-28 11:49:58.816 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 14 seconds.
Sep 28 11:49:58 ctl02 nova-api[6255]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:49:58 ctl02 nova-api[6255]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:49:59 ctl02 nova-api[6255]: 2017-09-28 11:49:59.095 6255 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:49:59 ctl02 nova-api[6255]: 2017-09-28 11:49:59.097 6255 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:49:59 ctl02 nova-api[6255]: 2017-09-28 11:49:59.097 6255 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:49:59 ctl02 nova-api[6255]: 2017-09-28 11:49:59.097 6255 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:49:59 ctl02 nova-api[6255]: 2017-09-28 11:49:59.097 6255 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:49:59 ctl02 nova-api[6255]: 2017-09-28 11:49:59.097 6255 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:49:59 ctl02 nova-api[6255]: 2017-09-28 11:49:59.097 6255 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:49:59 ctl02 nova-api[6255]: 2017-09-28 11:49:59.097 6255 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:49:59 ctl02 nova-api[6255]: 2017-09-28 11:49:59.097 6255 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:49:59 ctl02 nova-api[6255]: 2017-09-28 11:49:59.097 6255 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:49:59 ctl02 nova-api[6255]: 2017-09-28 11:49:59.097 6255 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:49:59 ctl02 nova-api[6255]: 2017-09-28 11:49:59.097 6255 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:49:59 ctl02 nova-api[6255]: 2017-09-28 11:49:59.097 6255 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:49:59 ctl02 nova-api[6255]: 2017-09-28 11:49:59.097 6255 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:49:59 ctl02 nova-api[6255]: 2017-09-28 11:49:59.097 6255 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:49:59 ctl02 nova-api[6255]: 2017-09-28 11:49:59.097 6255 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:49:59 ctl02 nova-api[6255]: 2017-09-28 11:49:59.097 6255 ERROR nova.wsgi     self.filename))
Sep 28 11:49:59 ctl02 nova-api[6255]: 2017-09-28 11:49:59.097 6255 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:49:59 ctl02 nova-api[6255]: 2017-09-28 11:49:59.097 6255 ERROR nova.wsgi
Sep 28 11:49:59 ctl02 nova-api[6255]: 2017-09-28 11:49:59.098 6255 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:49:59 ctl02 nova-api[6255]: 2017-09-28 11:49:59.227 6255 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:49:59 ctl02 glance-api[29183]: 2017-09-28 11:49:59.332 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:49:59] "OPTIONS / HTTP/1.0" 200 134 0.000738
Sep 28 11:49:59 ctl02 nova-api[6255]: 2017-09-28 11:49:59.461 6255 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:49:59 ctl02 nova-api[6255]: 2017-09-28 11:49:59.463 6255 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:49:59 ctl02 nova-api[6255]: 2017-09-28 11:49:59.463 6255 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:49:59 ctl02 nova-api[6255]: 2017-09-28 11:49:59.463 6255 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:49:59 ctl02 nova-api[6255]: 2017-09-28 11:49:59.595 6255 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:49:59 ctl02 nova-api[6255]: 2017-09-28 11:49:59.597 6255 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:49:59 ctl02 nova-api[6255]: 2017-09-28 11:49:59.597 6255 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:49:59 ctl02 nova-api[6255]: 2017-09-28 11:49:59.598 6255 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:49:59 ctl02 nova-api[6255]: 2017-09-28 11:49:59.601 6255 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:49:59 ctl02 nova-api[6255]: 2017-09-28 11:49:59.601 6255 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:49:59 ctl02 nova-api[6255]: 2017-09-28 11:49:59.601 6255 ERROR nova Traceback (most recent call last):
Sep 28 11:49:59 ctl02 nova-api[6255]: 2017-09-28 11:49:59.601 6255 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:49:59 ctl02 nova-api[6255]: 2017-09-28 11:49:59.601 6255 ERROR nova     sys.exit(main())
Sep 28 11:49:59 ctl02 nova-api[6255]: 2017-09-28 11:49:59.601 6255 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:49:59 ctl02 nova-api[6255]: 2017-09-28 11:49:59.601 6255 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:49:59 ctl02 nova-api[6255]: 2017-09-28 11:49:59.601 6255 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:49:59 ctl02 nova-api[6255]: 2017-09-28 11:49:59.601 6255 ERROR nova     max_url_len=max_url_len)
Sep 28 11:49:59 ctl02 nova-api[6255]: 2017-09-28 11:49:59.601 6255 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:49:59 ctl02 nova-api[6255]: 2017-09-28 11:49:59.601 6255 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:49:59 ctl02 nova-api[6255]: 2017-09-28 11:49:59.601 6255 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:49:59 ctl02 nova-api[6255]: 2017-09-28 11:49:59.601 6255 ERROR nova     sock.listen(backlog)
Sep 28 11:49:59 ctl02 nova-api[6255]: 2017-09-28 11:49:59.601 6255 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:49:59 ctl02 nova-api[6255]: 2017-09-28 11:49:59.601 6255 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:49:59 ctl02 nova-api[6255]: 2017-09-28 11:49:59.601 6255 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:49:59 ctl02 nova-api[6255]: 2017-09-28 11:49:59.601 6255 ERROR nova
Sep 28 11:49:59 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:49:59 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:49:59 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:49:59 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:49:59 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:49:59 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:49:59 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:50:00 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb035c964)
Sep 28 11:50:01 ctl02 nova-api[6273]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:50:01 ctl02 nova-api[6273]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:50:01 ctl02 nova-api[6273]: 2017-09-28 11:50:01.599 6273 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:50:01 ctl02 nova-api[6273]: 2017-09-28 11:50:01.601 6273 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:50:01 ctl02 nova-api[6273]: 2017-09-28 11:50:01.601 6273 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:50:01 ctl02 nova-api[6273]: 2017-09-28 11:50:01.601 6273 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:50:01 ctl02 nova-api[6273]: 2017-09-28 11:50:01.601 6273 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:50:01 ctl02 nova-api[6273]: 2017-09-28 11:50:01.601 6273 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:50:01 ctl02 nova-api[6273]: 2017-09-28 11:50:01.601 6273 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:50:01 ctl02 nova-api[6273]: 2017-09-28 11:50:01.601 6273 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:50:01 ctl02 nova-api[6273]: 2017-09-28 11:50:01.601 6273 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:50:01 ctl02 nova-api[6273]: 2017-09-28 11:50:01.601 6273 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:50:01 ctl02 nova-api[6273]: 2017-09-28 11:50:01.601 6273 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:50:01 ctl02 nova-api[6273]: 2017-09-28 11:50:01.601 6273 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:50:01 ctl02 nova-api[6273]: 2017-09-28 11:50:01.601 6273 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:50:01 ctl02 nova-api[6273]: 2017-09-28 11:50:01.601 6273 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:50:01 ctl02 nova-api[6273]: 2017-09-28 11:50:01.601 6273 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:50:01 ctl02 nova-api[6273]: 2017-09-28 11:50:01.601 6273 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:50:01 ctl02 nova-api[6273]: 2017-09-28 11:50:01.601 6273 ERROR nova.wsgi     self.filename))
Sep 28 11:50:01 ctl02 nova-api[6273]: 2017-09-28 11:50:01.601 6273 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:50:01 ctl02 nova-api[6273]: 2017-09-28 11:50:01.601 6273 ERROR nova.wsgi
Sep 28 11:50:01 ctl02 nova-api[6273]: 2017-09-28 11:50:01.601 6273 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:50:01 ctl02 nova-api[6273]: 2017-09-28 11:50:01.729 6273 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:50:01 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb035c964)
Sep 28 11:50:01 ctl02 nova-scheduler[5620]: 2017-09-28 11:50:01.837 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 14 seconds.
Sep 28 11:50:01 ctl02 nova-api[6273]: 2017-09-28 11:50:01.967 6273 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:50:01 ctl02 nova-api[6273]: 2017-09-28 11:50:01.969 6273 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:50:01 ctl02 nova-api[6273]: 2017-09-28 11:50:01.970 6273 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:50:01 ctl02 nova-api[6273]: 2017-09-28 11:50:01.970 6273 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:50:02 ctl02 nova-api[6273]: 2017-09-28 11:50:02.098 6273 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:50:02 ctl02 nova-api[6273]: 2017-09-28 11:50:02.100 6273 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:50:02 ctl02 nova-api[6273]: 2017-09-28 11:50:02.100 6273 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:50:02 ctl02 nova-api[6273]: 2017-09-28 11:50:02.101 6273 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:50:02 ctl02 nova-api[6273]: 2017-09-28 11:50:02.104 6273 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:50:02 ctl02 nova-api[6273]: 2017-09-28 11:50:02.104 6273 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:50:02 ctl02 nova-api[6273]: 2017-09-28 11:50:02.104 6273 ERROR nova Traceback (most recent call last):
Sep 28 11:50:02 ctl02 nova-api[6273]: 2017-09-28 11:50:02.104 6273 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:50:02 ctl02 nova-api[6273]: 2017-09-28 11:50:02.104 6273 ERROR nova     sys.exit(main())
Sep 28 11:50:02 ctl02 nova-api[6273]: 2017-09-28 11:50:02.104 6273 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:50:02 ctl02 nova-api[6273]: 2017-09-28 11:50:02.104 6273 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:50:02 ctl02 nova-api[6273]: 2017-09-28 11:50:02.104 6273 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:50:02 ctl02 nova-api[6273]: 2017-09-28 11:50:02.104 6273 ERROR nova     max_url_len=max_url_len)
Sep 28 11:50:02 ctl02 nova-api[6273]: 2017-09-28 11:50:02.104 6273 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:50:02 ctl02 nova-api[6273]: 2017-09-28 11:50:02.104 6273 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:50:02 ctl02 nova-api[6273]: 2017-09-28 11:50:02.104 6273 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:50:02 ctl02 nova-api[6273]: 2017-09-28 11:50:02.104 6273 ERROR nova     sock.listen(backlog)
Sep 28 11:50:02 ctl02 nova-api[6273]: 2017-09-28 11:50:02.104 6273 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:50:02 ctl02 nova-api[6273]: 2017-09-28 11:50:02.104 6273 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:50:02 ctl02 nova-api[6273]: 2017-09-28 11:50:02.104 6273 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:50:02 ctl02 nova-api[6273]: 2017-09-28 11:50:02.104 6273 ERROR nova
Sep 28 11:50:02 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:50:02 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:50:02 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:50:02 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:50:02 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:50:02 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:50:02 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:50:02 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb035c964)
Sep 28 11:50:02 ctl02 nova-cert[4860]: 2017-09-28 11:50:02.929 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 16 seconds.
Sep 28 11:50:03 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb035c964)
Sep 28 11:50:03 ctl02 nova-api[6290]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:50:03 ctl02 nova-api[6290]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:50:03 ctl02 glance-api[29183]: 2017-09-28 11:50:03.907 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:50:03] "OPTIONS / HTTP/1.0" 200 134 0.000959
Sep 28 11:50:04 ctl02 nova-api[6290]: 2017-09-28 11:50:04.065 6290 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:50:04 ctl02 nova-api[6290]: 2017-09-28 11:50:04.066 6290 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:50:04 ctl02 nova-api[6290]: 2017-09-28 11:50:04.066 6290 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:50:04 ctl02 nova-api[6290]: 2017-09-28 11:50:04.066 6290 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:50:04 ctl02 nova-api[6290]: 2017-09-28 11:50:04.066 6290 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:50:04 ctl02 nova-api[6290]: 2017-09-28 11:50:04.066 6290 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:50:04 ctl02 nova-api[6290]: 2017-09-28 11:50:04.066 6290 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:50:04 ctl02 nova-api[6290]: 2017-09-28 11:50:04.066 6290 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:50:04 ctl02 nova-api[6290]: 2017-09-28 11:50:04.066 6290 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:50:04 ctl02 nova-api[6290]: 2017-09-28 11:50:04.066 6290 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:50:04 ctl02 nova-api[6290]: 2017-09-28 11:50:04.066 6290 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:50:04 ctl02 nova-api[6290]: 2017-09-28 11:50:04.066 6290 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:50:04 ctl02 nova-api[6290]: 2017-09-28 11:50:04.066 6290 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:50:04 ctl02 nova-api[6290]: 2017-09-28 11:50:04.066 6290 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:50:04 ctl02 nova-api[6290]: 2017-09-28 11:50:04.066 6290 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:50:04 ctl02 nova-api[6290]: 2017-09-28 11:50:04.066 6290 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:50:04 ctl02 nova-api[6290]: 2017-09-28 11:50:04.066 6290 ERROR nova.wsgi     self.filename))
Sep 28 11:50:04 ctl02 nova-api[6290]: 2017-09-28 11:50:04.066 6290 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:50:04 ctl02 nova-api[6290]: 2017-09-28 11:50:04.066 6290 ERROR nova.wsgi
Sep 28 11:50:04 ctl02 nova-api[6290]: 2017-09-28 11:50:04.081 6290 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:50:04 ctl02 nova-api[6290]: 2017-09-28 11:50:04.212 6290 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:50:04 ctl02 nova-api[6290]: 2017-09-28 11:50:04.442 6290 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:50:04 ctl02 nova-api[6290]: 2017-09-28 11:50:04.444 6290 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:50:04 ctl02 nova-api[6290]: 2017-09-28 11:50:04.445 6290 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:50:04 ctl02 nova-api[6290]: 2017-09-28 11:50:04.445 6290 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:50:04 ctl02 nova-api[6290]: 2017-09-28 11:50:04.577 6290 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:50:04 ctl02 nova-api[6290]: 2017-09-28 11:50:04.579 6290 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:50:04 ctl02 nova-api[6290]: 2017-09-28 11:50:04.580 6290 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:50:04 ctl02 nova-api[6290]: 2017-09-28 11:50:04.580 6290 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:50:04 ctl02 nova-api[6290]: 2017-09-28 11:50:04.583 6290 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:50:04 ctl02 nova-api[6290]: 2017-09-28 11:50:04.584 6290 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:50:04 ctl02 nova-api[6290]: 2017-09-28 11:50:04.584 6290 ERROR nova Traceback (most recent call last):
Sep 28 11:50:04 ctl02 nova-api[6290]: 2017-09-28 11:50:04.584 6290 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:50:04 ctl02 nova-api[6290]: 2017-09-28 11:50:04.584 6290 ERROR nova     sys.exit(main())
Sep 28 11:50:04 ctl02 nova-api[6290]: 2017-09-28 11:50:04.584 6290 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:50:04 ctl02 nova-api[6290]: 2017-09-28 11:50:04.584 6290 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:50:04 ctl02 nova-api[6290]: 2017-09-28 11:50:04.584 6290 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:50:04 ctl02 nova-api[6290]: 2017-09-28 11:50:04.584 6290 ERROR nova     max_url_len=max_url_len)
Sep 28 11:50:04 ctl02 nova-api[6290]: 2017-09-28 11:50:04.584 6290 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:50:04 ctl02 nova-api[6290]: 2017-09-28 11:50:04.584 6290 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:50:04 ctl02 nova-api[6290]: 2017-09-28 11:50:04.584 6290 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:50:04 ctl02 nova-api[6290]: 2017-09-28 11:50:04.584 6290 ERROR nova     sock.listen(backlog)
Sep 28 11:50:04 ctl02 nova-api[6290]: 2017-09-28 11:50:04.584 6290 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:50:04 ctl02 nova-api[6290]: 2017-09-28 11:50:04.584 6290 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:50:04 ctl02 nova-api[6290]: 2017-09-28 11:50:04.584 6290 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:50:04 ctl02 nova-api[6290]: 2017-09-28 11:50:04.584 6290 ERROR nova
Sep 28 11:50:04 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:50:04 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:50:04 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:50:04 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb035c964)
Sep 28 11:50:04 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:50:04 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:50:04 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:50:04 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:50:05 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb035c964)
Sep 28 11:50:06 ctl02 nova-conductor[5056]: 2017-09-28 11:50:06.047 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 16 seconds.
Sep 28 11:50:06 ctl02 nova-conductor[5056]: 2017-09-28 11:50:06.061 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 16 seconds.
Sep 28 11:50:06 ctl02 nova-conductor[5056]: 2017-09-28 11:50:06.078 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 16 seconds.
Sep 28 11:50:06 ctl02 nova-conductor[5056]: 2017-09-28 11:50:06.079 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 16 seconds.
Sep 28 11:50:06 ctl02 nova-api[6309]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:50:06 ctl02 nova-api[6309]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:50:06 ctl02 nova-api[6309]: 2017-09-28 11:50:06.587 6309 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:50:06 ctl02 nova-api[6309]: 2017-09-28 11:50:06.589 6309 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:50:06 ctl02 nova-api[6309]: 2017-09-28 11:50:06.589 6309 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:50:06 ctl02 nova-api[6309]: 2017-09-28 11:50:06.589 6309 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:50:06 ctl02 nova-api[6309]: 2017-09-28 11:50:06.589 6309 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:50:06 ctl02 nova-api[6309]: 2017-09-28 11:50:06.589 6309 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:50:06 ctl02 nova-api[6309]: 2017-09-28 11:50:06.589 6309 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:50:06 ctl02 nova-api[6309]: 2017-09-28 11:50:06.589 6309 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:50:06 ctl02 nova-api[6309]: 2017-09-28 11:50:06.589 6309 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:50:06 ctl02 nova-api[6309]: 2017-09-28 11:50:06.589 6309 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:50:06 ctl02 nova-api[6309]: 2017-09-28 11:50:06.589 6309 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:50:06 ctl02 nova-api[6309]: 2017-09-28 11:50:06.589 6309 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:50:06 ctl02 nova-api[6309]: 2017-09-28 11:50:06.589 6309 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:50:06 ctl02 nova-api[6309]: 2017-09-28 11:50:06.589 6309 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:50:06 ctl02 nova-api[6309]: 2017-09-28 11:50:06.589 6309 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:50:06 ctl02 nova-api[6309]: 2017-09-28 11:50:06.589 6309 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:50:06 ctl02 nova-api[6309]: 2017-09-28 11:50:06.589 6309 ERROR nova.wsgi     self.filename))
Sep 28 11:50:06 ctl02 nova-api[6309]: 2017-09-28 11:50:06.589 6309 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:50:06 ctl02 nova-api[6309]: 2017-09-28 11:50:06.589 6309 ERROR nova.wsgi
Sep 28 11:50:06 ctl02 nova-api[6309]: 2017-09-28 11:50:06.592 6309 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:50:06 ctl02 nova-api[6309]: 2017-09-28 11:50:06.738 6309 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:50:06 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb035c964)
Sep 28 11:50:06 ctl02 nova-api[6309]: 2017-09-28 11:50:06.974 6309 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:50:06 ctl02 nova-api[6309]: 2017-09-28 11:50:06.977 6309 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:50:06 ctl02 nova-api[6309]: 2017-09-28 11:50:06.977 6309 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:50:06 ctl02 nova-api[6309]: 2017-09-28 11:50:06.977 6309 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:50:07 ctl02 nova-api[6309]: 2017-09-28 11:50:07.107 6309 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:50:07 ctl02 nova-api[6309]: 2017-09-28 11:50:07.109 6309 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:50:07 ctl02 nova-api[6309]: 2017-09-28 11:50:07.109 6309 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:50:07 ctl02 nova-api[6309]: 2017-09-28 11:50:07.110 6309 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:50:07 ctl02 nova-api[6309]: 2017-09-28 11:50:07.113 6309 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:50:07 ctl02 nova-api[6309]: 2017-09-28 11:50:07.113 6309 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:50:07 ctl02 nova-api[6309]: 2017-09-28 11:50:07.113 6309 ERROR nova Traceback (most recent call last):
Sep 28 11:50:07 ctl02 nova-api[6309]: 2017-09-28 11:50:07.113 6309 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:50:07 ctl02 nova-api[6309]: 2017-09-28 11:50:07.113 6309 ERROR nova     sys.exit(main())
Sep 28 11:50:07 ctl02 nova-api[6309]: 2017-09-28 11:50:07.113 6309 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:50:07 ctl02 nova-api[6309]: 2017-09-28 11:50:07.113 6309 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:50:07 ctl02 nova-api[6309]: 2017-09-28 11:50:07.113 6309 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:50:07 ctl02 nova-api[6309]: 2017-09-28 11:50:07.113 6309 ERROR nova     max_url_len=max_url_len)
Sep 28 11:50:07 ctl02 nova-api[6309]: 2017-09-28 11:50:07.113 6309 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:50:07 ctl02 nova-api[6309]: 2017-09-28 11:50:07.113 6309 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:50:07 ctl02 nova-api[6309]: 2017-09-28 11:50:07.113 6309 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:50:07 ctl02 nova-api[6309]: 2017-09-28 11:50:07.113 6309 ERROR nova     sock.listen(backlog)
Sep 28 11:50:07 ctl02 nova-api[6309]: 2017-09-28 11:50:07.113 6309 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:50:07 ctl02 nova-api[6309]: 2017-09-28 11:50:07.113 6309 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:50:07 ctl02 nova-api[6309]: 2017-09-28 11:50:07.113 6309 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:50:07 ctl02 nova-api[6309]: 2017-09-28 11:50:07.113 6309 ERROR nova
Sep 28 11:50:07 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:50:07 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:50:07 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:50:07 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:50:07 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:50:07 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:50:07 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:50:07 ctl02 glance-api[29183]: 2017-09-28 11:50:07.529 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:50:07] "OPTIONS / HTTP/1.0" 200 134 0.001063
Sep 28 11:50:07 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb035c964)
Sep 28 11:50:08 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb035c964)
Sep 28 11:50:08 ctl02 nova-api[6327]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:50:08 ctl02 nova-api[6327]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:50:09 ctl02 nova-api[6327]: 2017-09-28 11:50:09.077 6327 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:50:09 ctl02 nova-api[6327]: 2017-09-28 11:50:09.078 6327 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:50:09 ctl02 nova-api[6327]: 2017-09-28 11:50:09.078 6327 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:50:09 ctl02 nova-api[6327]: 2017-09-28 11:50:09.078 6327 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:50:09 ctl02 nova-api[6327]: 2017-09-28 11:50:09.078 6327 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:50:09 ctl02 nova-api[6327]: 2017-09-28 11:50:09.078 6327 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:50:09 ctl02 nova-api[6327]: 2017-09-28 11:50:09.078 6327 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:50:09 ctl02 nova-api[6327]: 2017-09-28 11:50:09.078 6327 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:50:09 ctl02 nova-api[6327]: 2017-09-28 11:50:09.078 6327 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:50:09 ctl02 nova-api[6327]: 2017-09-28 11:50:09.078 6327 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:50:09 ctl02 nova-api[6327]: 2017-09-28 11:50:09.078 6327 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:50:09 ctl02 nova-api[6327]: 2017-09-28 11:50:09.078 6327 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:50:09 ctl02 nova-api[6327]: 2017-09-28 11:50:09.078 6327 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:50:09 ctl02 nova-api[6327]: 2017-09-28 11:50:09.078 6327 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:50:09 ctl02 nova-api[6327]: 2017-09-28 11:50:09.078 6327 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:50:09 ctl02 nova-api[6327]: 2017-09-28 11:50:09.078 6327 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:50:09 ctl02 nova-api[6327]: 2017-09-28 11:50:09.078 6327 ERROR nova.wsgi     self.filename))
Sep 28 11:50:09 ctl02 nova-api[6327]: 2017-09-28 11:50:09.078 6327 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:50:09 ctl02 nova-api[6327]: 2017-09-28 11:50:09.078 6327 ERROR nova.wsgi
Sep 28 11:50:09 ctl02 nova-api[6327]: 2017-09-28 11:50:09.094 6327 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:50:09 ctl02 nova-api[6327]: 2017-09-28 11:50:09.222 6327 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:50:09 ctl02 glance-api[29183]: 2017-09-28 11:50:09.394 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:50:09] "OPTIONS / HTTP/1.0" 200 134 0.000554
Sep 28 11:50:09 ctl02 nova-api[6327]: 2017-09-28 11:50:09.450 6327 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:50:09 ctl02 nova-api[6327]: 2017-09-28 11:50:09.453 6327 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:50:09 ctl02 nova-api[6327]: 2017-09-28 11:50:09.453 6327 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:50:09 ctl02 nova-api[6327]: 2017-09-28 11:50:09.454 6327 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:50:09 ctl02 nova-api[6327]: 2017-09-28 11:50:09.581 6327 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:50:09 ctl02 nova-api[6327]: 2017-09-28 11:50:09.584 6327 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:50:09 ctl02 nova-api[6327]: 2017-09-28 11:50:09.584 6327 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:50:09 ctl02 nova-api[6327]: 2017-09-28 11:50:09.585 6327 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:50:09 ctl02 nova-api[6327]: 2017-09-28 11:50:09.588 6327 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:50:09 ctl02 nova-api[6327]: 2017-09-28 11:50:09.588 6327 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:50:09 ctl02 nova-api[6327]: 2017-09-28 11:50:09.588 6327 ERROR nova Traceback (most recent call last):
Sep 28 11:50:09 ctl02 nova-api[6327]: 2017-09-28 11:50:09.588 6327 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:50:09 ctl02 nova-api[6327]: 2017-09-28 11:50:09.588 6327 ERROR nova     sys.exit(main())
Sep 28 11:50:09 ctl02 nova-api[6327]: 2017-09-28 11:50:09.588 6327 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:50:09 ctl02 nova-api[6327]: 2017-09-28 11:50:09.588 6327 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:50:09 ctl02 nova-api[6327]: 2017-09-28 11:50:09.588 6327 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:50:09 ctl02 nova-api[6327]: 2017-09-28 11:50:09.588 6327 ERROR nova     max_url_len=max_url_len)
Sep 28 11:50:09 ctl02 nova-api[6327]: 2017-09-28 11:50:09.588 6327 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:50:09 ctl02 nova-api[6327]: 2017-09-28 11:50:09.588 6327 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:50:09 ctl02 nova-api[6327]: 2017-09-28 11:50:09.588 6327 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:50:09 ctl02 nova-api[6327]: 2017-09-28 11:50:09.588 6327 ERROR nova     sock.listen(backlog)
Sep 28 11:50:09 ctl02 nova-api[6327]: 2017-09-28 11:50:09.588 6327 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:50:09 ctl02 nova-api[6327]: 2017-09-28 11:50:09.588 6327 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:50:09 ctl02 nova-api[6327]: 2017-09-28 11:50:09.588 6327 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:50:09 ctl02 nova-api[6327]: 2017-09-28 11:50:09.588 6327 ERROR nova
Sep 28 11:50:09 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:50:09 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:50:09 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:50:09 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb035c964)
Sep 28 11:50:09 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:50:09 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:50:09 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:50:09 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:50:10 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb035c964)
Sep 28 11:50:11 ctl02 nova-api[6345]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:50:11 ctl02 nova-api[6345]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:50:11 ctl02 nova-api[6345]: 2017-09-28 11:50:11.567 6345 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:50:11 ctl02 nova-api[6345]: 2017-09-28 11:50:11.568 6345 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:50:11 ctl02 nova-api[6345]: 2017-09-28 11:50:11.568 6345 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:50:11 ctl02 nova-api[6345]: 2017-09-28 11:50:11.568 6345 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:50:11 ctl02 nova-api[6345]: 2017-09-28 11:50:11.568 6345 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:50:11 ctl02 nova-api[6345]: 2017-09-28 11:50:11.568 6345 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:50:11 ctl02 nova-api[6345]: 2017-09-28 11:50:11.568 6345 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:50:11 ctl02 nova-api[6345]: 2017-09-28 11:50:11.568 6345 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:50:11 ctl02 nova-api[6345]: 2017-09-28 11:50:11.568 6345 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:50:11 ctl02 nova-api[6345]: 2017-09-28 11:50:11.568 6345 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:50:11 ctl02 nova-api[6345]: 2017-09-28 11:50:11.568 6345 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:50:11 ctl02 nova-api[6345]: 2017-09-28 11:50:11.568 6345 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:50:11 ctl02 nova-api[6345]: 2017-09-28 11:50:11.568 6345 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:50:11 ctl02 nova-api[6345]: 2017-09-28 11:50:11.568 6345 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:50:11 ctl02 nova-api[6345]: 2017-09-28 11:50:11.568 6345 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:50:11 ctl02 nova-api[6345]: 2017-09-28 11:50:11.568 6345 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:50:11 ctl02 nova-api[6345]: 2017-09-28 11:50:11.568 6345 ERROR nova.wsgi     self.filename))
Sep 28 11:50:11 ctl02 nova-api[6345]: 2017-09-28 11:50:11.568 6345 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:50:11 ctl02 nova-api[6345]: 2017-09-28 11:50:11.568 6345 ERROR nova.wsgi
Sep 28 11:50:11 ctl02 nova-api[6345]: 2017-09-28 11:50:11.569 6345 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:50:11 ctl02 nova-api[6345]: 2017-09-28 11:50:11.695 6345 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:50:11 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:50:11 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:50:11 ctl02 nova-api[6345]: 2017-09-28 11:50:11.928 6345 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:50:11 ctl02 nova-api[6345]: 2017-09-28 11:50:11.930 6345 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:50:11 ctl02 nova-api[6345]: 2017-09-28 11:50:11.930 6345 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:50:11 ctl02 nova-api[6345]: 2017-09-28 11:50:11.931 6345 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:50:12 ctl02 nova-api[6345]: 2017-09-28 11:50:12.062 6345 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:50:12 ctl02 nova-api[6345]: 2017-09-28 11:50:12.064 6345 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:50:12 ctl02 nova-api[6345]: 2017-09-28 11:50:12.064 6345 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:50:12 ctl02 nova-api[6345]: 2017-09-28 11:50:12.064 6345 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:50:12 ctl02 nova-api[6345]: 2017-09-28 11:50:12.067 6345 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:50:12 ctl02 nova-api[6345]: 2017-09-28 11:50:12.067 6345 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:50:12 ctl02 nova-api[6345]: 2017-09-28 11:50:12.067 6345 ERROR nova Traceback (most recent call last):
Sep 28 11:50:12 ctl02 nova-api[6345]: 2017-09-28 11:50:12.067 6345 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:50:12 ctl02 nova-api[6345]: 2017-09-28 11:50:12.067 6345 ERROR nova     sys.exit(main())
Sep 28 11:50:12 ctl02 nova-api[6345]: 2017-09-28 11:50:12.067 6345 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:50:12 ctl02 nova-api[6345]: 2017-09-28 11:50:12.067 6345 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:50:12 ctl02 nova-api[6345]: 2017-09-28 11:50:12.067 6345 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:50:12 ctl02 nova-api[6345]: 2017-09-28 11:50:12.067 6345 ERROR nova     max_url_len=max_url_len)
Sep 28 11:50:12 ctl02 nova-api[6345]: 2017-09-28 11:50:12.067 6345 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:50:12 ctl02 nova-api[6345]: 2017-09-28 11:50:12.067 6345 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:50:12 ctl02 nova-api[6345]: 2017-09-28 11:50:12.067 6345 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:50:12 ctl02 nova-api[6345]: 2017-09-28 11:50:12.067 6345 ERROR nova     sock.listen(backlog)
Sep 28 11:50:12 ctl02 nova-api[6345]: 2017-09-28 11:50:12.067 6345 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:50:12 ctl02 nova-api[6345]: 2017-09-28 11:50:12.067 6345 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:50:12 ctl02 nova-api[6345]: 2017-09-28 11:50:12.067 6345 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:50:12 ctl02 nova-api[6345]: 2017-09-28 11:50:12.067 6345 ERROR nova
Sep 28 11:50:12 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:50:12 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:50:12 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:50:12 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:50:12 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:50:12 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:50:12 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:50:12 ctl02 nova-consoleauth[5433]: 2017-09-28 11:50:12.835 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 16 seconds.
Sep 28 11:50:13 ctl02 glance-api[29183]: 2017-09-28 11:50:13.734 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:50:13] "OPTIONS / HTTP/1.0" 200 134 0.000540
Sep 28 11:50:13 ctl02 nova-api[6368]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:50:13 ctl02 nova-api[6368]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:50:14 ctl02 nova-api[6368]: 2017-09-28 11:50:14.122 6368 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:50:14 ctl02 nova-api[6368]: 2017-09-28 11:50:14.123 6368 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:50:14 ctl02 nova-api[6368]: 2017-09-28 11:50:14.123 6368 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:50:14 ctl02 nova-api[6368]: 2017-09-28 11:50:14.123 6368 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:50:14 ctl02 nova-api[6368]: 2017-09-28 11:50:14.123 6368 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:50:14 ctl02 nova-api[6368]: 2017-09-28 11:50:14.123 6368 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:50:14 ctl02 nova-api[6368]: 2017-09-28 11:50:14.123 6368 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:50:14 ctl02 nova-api[6368]: 2017-09-28 11:50:14.123 6368 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:50:14 ctl02 nova-api[6368]: 2017-09-28 11:50:14.123 6368 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:50:14 ctl02 nova-api[6368]: 2017-09-28 11:50:14.123 6368 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:50:14 ctl02 nova-api[6368]: 2017-09-28 11:50:14.123 6368 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:50:14 ctl02 nova-api[6368]: 2017-09-28 11:50:14.123 6368 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:50:14 ctl02 nova-api[6368]: 2017-09-28 11:50:14.123 6368 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:50:14 ctl02 nova-api[6368]: 2017-09-28 11:50:14.123 6368 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:50:14 ctl02 nova-api[6368]: 2017-09-28 11:50:14.123 6368 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:50:14 ctl02 nova-api[6368]: 2017-09-28 11:50:14.123 6368 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:50:14 ctl02 nova-api[6368]: 2017-09-28 11:50:14.123 6368 ERROR nova.wsgi     self.filename))
Sep 28 11:50:14 ctl02 nova-api[6368]: 2017-09-28 11:50:14.123 6368 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:50:14 ctl02 nova-api[6368]: 2017-09-28 11:50:14.123 6368 ERROR nova.wsgi
Sep 28 11:50:14 ctl02 nova-api[6368]: 2017-09-28 11:50:14.130 6368 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:50:14 ctl02 nova-api[6368]: 2017-09-28 11:50:14.274 6368 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:50:14 ctl02 nova-api[6368]: 2017-09-28 11:50:14.511 6368 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:50:14 ctl02 nova-api[6368]: 2017-09-28 11:50:14.513 6368 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:50:14 ctl02 nova-api[6368]: 2017-09-28 11:50:14.513 6368 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:50:14 ctl02 nova-api[6368]: 2017-09-28 11:50:14.514 6368 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:50:14 ctl02 nova-api[6368]: 2017-09-28 11:50:14.644 6368 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:50:14 ctl02 nova-api[6368]: 2017-09-28 11:50:14.646 6368 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:50:14 ctl02 nova-api[6368]: 2017-09-28 11:50:14.646 6368 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:50:14 ctl02 nova-api[6368]: 2017-09-28 11:50:14.646 6368 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:50:14 ctl02 nova-api[6368]: 2017-09-28 11:50:14.650 6368 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:50:14 ctl02 nova-api[6368]: 2017-09-28 11:50:14.650 6368 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:50:14 ctl02 nova-api[6368]: 2017-09-28 11:50:14.650 6368 ERROR nova Traceback (most recent call last):
Sep 28 11:50:14 ctl02 nova-api[6368]: 2017-09-28 11:50:14.650 6368 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:50:14 ctl02 nova-api[6368]: 2017-09-28 11:50:14.650 6368 ERROR nova     sys.exit(main())
Sep 28 11:50:14 ctl02 nova-api[6368]: 2017-09-28 11:50:14.650 6368 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:50:14 ctl02 nova-api[6368]: 2017-09-28 11:50:14.650 6368 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:50:14 ctl02 nova-api[6368]: 2017-09-28 11:50:14.650 6368 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:50:14 ctl02 nova-api[6368]: 2017-09-28 11:50:14.650 6368 ERROR nova     max_url_len=max_url_len)
Sep 28 11:50:14 ctl02 nova-api[6368]: 2017-09-28 11:50:14.650 6368 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:50:14 ctl02 nova-api[6368]: 2017-09-28 11:50:14.650 6368 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:50:14 ctl02 nova-api[6368]: 2017-09-28 11:50:14.650 6368 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:50:14 ctl02 nova-api[6368]: 2017-09-28 11:50:14.650 6368 ERROR nova     sock.listen(backlog)
Sep 28 11:50:14 ctl02 nova-api[6368]: 2017-09-28 11:50:14.650 6368 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:50:14 ctl02 nova-api[6368]: 2017-09-28 11:50:14.650 6368 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:50:14 ctl02 nova-api[6368]: 2017-09-28 11:50:14.650 6368 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:50:14 ctl02 nova-api[6368]: 2017-09-28 11:50:14.650 6368 ERROR nova
Sep 28 11:50:14 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:50:14 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:50:14 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:50:15 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:50:15 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:50:15 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:50:15 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:50:15 ctl02 nova-scheduler[5620]: 2017-09-28 11:50:15.856 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 16 seconds.
Sep 28 11:50:16 ctl02 nova-api[6386]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:50:16 ctl02 nova-api[6386]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:50:16 ctl02 nova-api[6386]: 2017-09-28 11:50:16.863 6386 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:50:16 ctl02 nova-api[6386]: 2017-09-28 11:50:16.864 6386 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:50:16 ctl02 nova-api[6386]: 2017-09-28 11:50:16.864 6386 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:50:16 ctl02 nova-api[6386]: 2017-09-28 11:50:16.864 6386 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:50:16 ctl02 nova-api[6386]: 2017-09-28 11:50:16.864 6386 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:50:16 ctl02 nova-api[6386]: 2017-09-28 11:50:16.864 6386 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:50:16 ctl02 nova-api[6386]: 2017-09-28 11:50:16.864 6386 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:50:16 ctl02 nova-api[6386]: 2017-09-28 11:50:16.864 6386 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:50:16 ctl02 nova-api[6386]: 2017-09-28 11:50:16.864 6386 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:50:16 ctl02 nova-api[6386]: 2017-09-28 11:50:16.864 6386 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:50:16 ctl02 nova-api[6386]: 2017-09-28 11:50:16.864 6386 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:50:16 ctl02 nova-api[6386]: 2017-09-28 11:50:16.864 6386 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:50:16 ctl02 nova-api[6386]: 2017-09-28 11:50:16.864 6386 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:50:16 ctl02 nova-api[6386]: 2017-09-28 11:50:16.864 6386 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:50:16 ctl02 nova-api[6386]: 2017-09-28 11:50:16.864 6386 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:50:16 ctl02 nova-api[6386]: 2017-09-28 11:50:16.864 6386 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:50:16 ctl02 nova-api[6386]: 2017-09-28 11:50:16.864 6386 ERROR nova.wsgi     self.filename))
Sep 28 11:50:16 ctl02 nova-api[6386]: 2017-09-28 11:50:16.864 6386 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:50:16 ctl02 nova-api[6386]: 2017-09-28 11:50:16.864 6386 ERROR nova.wsgi
Sep 28 11:50:16 ctl02 nova-api[6386]: 2017-09-28 11:50:16.865 6386 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:50:16 ctl02 nova-api[6386]: 2017-09-28 11:50:16.993 6386 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:50:17 ctl02 nova-api[6386]: 2017-09-28 11:50:17.223 6386 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:50:17 ctl02 nova-api[6386]: 2017-09-28 11:50:17.225 6386 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:50:17 ctl02 nova-api[6386]: 2017-09-28 11:50:17.225 6386 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:50:17 ctl02 nova-api[6386]: 2017-09-28 11:50:17.225 6386 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:50:17 ctl02 nova-api[6386]: 2017-09-28 11:50:17.354 6386 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:50:17 ctl02 nova-api[6386]: 2017-09-28 11:50:17.355 6386 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:50:17 ctl02 nova-api[6386]: 2017-09-28 11:50:17.356 6386 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:50:17 ctl02 nova-api[6386]: 2017-09-28 11:50:17.356 6386 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:50:17 ctl02 nova-api[6386]: 2017-09-28 11:50:17.359 6386 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:50:17 ctl02 nova-api[6386]: 2017-09-28 11:50:17.359 6386 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:50:17 ctl02 nova-api[6386]: 2017-09-28 11:50:17.359 6386 ERROR nova Traceback (most recent call last):
Sep 28 11:50:17 ctl02 nova-api[6386]: 2017-09-28 11:50:17.359 6386 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:50:17 ctl02 nova-api[6386]: 2017-09-28 11:50:17.359 6386 ERROR nova     sys.exit(main())
Sep 28 11:50:17 ctl02 nova-api[6386]: 2017-09-28 11:50:17.359 6386 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:50:17 ctl02 nova-api[6386]: 2017-09-28 11:50:17.359 6386 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:50:17 ctl02 nova-api[6386]: 2017-09-28 11:50:17.359 6386 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:50:17 ctl02 nova-api[6386]: 2017-09-28 11:50:17.359 6386 ERROR nova     max_url_len=max_url_len)
Sep 28 11:50:17 ctl02 nova-api[6386]: 2017-09-28 11:50:17.359 6386 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:50:17 ctl02 nova-api[6386]: 2017-09-28 11:50:17.359 6386 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:50:17 ctl02 nova-api[6386]: 2017-09-28 11:50:17.359 6386 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:50:17 ctl02 nova-api[6386]: 2017-09-28 11:50:17.359 6386 ERROR nova     sock.listen(backlog)
Sep 28 11:50:17 ctl02 nova-api[6386]: 2017-09-28 11:50:17.359 6386 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:50:17 ctl02 nova-api[6386]: 2017-09-28 11:50:17.359 6386 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:50:17 ctl02 nova-api[6386]: 2017-09-28 11:50:17.359 6386 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:50:17 ctl02 nova-api[6386]: 2017-09-28 11:50:17.359 6386 ERROR nova
Sep 28 11:50:17 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:50:17 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:50:17 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:50:17 ctl02 glance-api[29183]: 2017-09-28 11:50:17.566 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:50:17] "OPTIONS / HTTP/1.0" 200 134 0.000671
Sep 28 11:50:17 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:50:17 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:50:17 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:50:17 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:50:18 ctl02 nova-cert[4860]: 2017-09-28 11:50:18.948 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 18 seconds.
Sep 28 11:50:19 ctl02 nova-api[6404]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:50:19 ctl02 nova-api[6404]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:50:19 ctl02 nova-api[6404]: 2017-09-28 11:50:19.310 6404 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:50:19 ctl02 nova-api[6404]: 2017-09-28 11:50:19.311 6404 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:50:19 ctl02 nova-api[6404]: 2017-09-28 11:50:19.311 6404 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:50:19 ctl02 nova-api[6404]: 2017-09-28 11:50:19.311 6404 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:50:19 ctl02 nova-api[6404]: 2017-09-28 11:50:19.311 6404 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:50:19 ctl02 nova-api[6404]: 2017-09-28 11:50:19.311 6404 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:50:19 ctl02 nova-api[6404]: 2017-09-28 11:50:19.311 6404 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:50:19 ctl02 nova-api[6404]: 2017-09-28 11:50:19.311 6404 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:50:19 ctl02 nova-api[6404]: 2017-09-28 11:50:19.311 6404 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:50:19 ctl02 nova-api[6404]: 2017-09-28 11:50:19.311 6404 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:50:19 ctl02 nova-api[6404]: 2017-09-28 11:50:19.311 6404 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:50:19 ctl02 nova-api[6404]: 2017-09-28 11:50:19.311 6404 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:50:19 ctl02 nova-api[6404]: 2017-09-28 11:50:19.311 6404 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:50:19 ctl02 nova-api[6404]: 2017-09-28 11:50:19.311 6404 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:50:19 ctl02 nova-api[6404]: 2017-09-28 11:50:19.311 6404 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:50:19 ctl02 nova-api[6404]: 2017-09-28 11:50:19.311 6404 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:50:19 ctl02 nova-api[6404]: 2017-09-28 11:50:19.311 6404 ERROR nova.wsgi     self.filename))
Sep 28 11:50:19 ctl02 nova-api[6404]: 2017-09-28 11:50:19.311 6404 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:50:19 ctl02 nova-api[6404]: 2017-09-28 11:50:19.311 6404 ERROR nova.wsgi
Sep 28 11:50:19 ctl02 nova-api[6404]: 2017-09-28 11:50:19.312 6404 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:50:19 ctl02 nova-api[6404]: 2017-09-28 11:50:19.439 6404 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:50:19 ctl02 glance-api[29183]: 2017-09-28 11:50:19.629 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:50:19] "OPTIONS / HTTP/1.0" 200 134 0.000752
Sep 28 11:50:19 ctl02 nova-api[6404]: 2017-09-28 11:50:19.677 6404 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:50:19 ctl02 nova-api[6404]: 2017-09-28 11:50:19.680 6404 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:50:19 ctl02 nova-api[6404]: 2017-09-28 11:50:19.680 6404 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:50:19 ctl02 nova-api[6404]: 2017-09-28 11:50:19.680 6404 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:50:19 ctl02 nova-api[6404]: 2017-09-28 11:50:19.812 6404 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:50:19 ctl02 nova-api[6404]: 2017-09-28 11:50:19.814 6404 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:50:19 ctl02 nova-api[6404]: 2017-09-28 11:50:19.815 6404 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:50:19 ctl02 nova-api[6404]: 2017-09-28 11:50:19.815 6404 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:50:19 ctl02 nova-api[6404]: 2017-09-28 11:50:19.818 6404 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:50:19 ctl02 nova-api[6404]: 2017-09-28 11:50:19.819 6404 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:50:19 ctl02 nova-api[6404]: 2017-09-28 11:50:19.819 6404 ERROR nova Traceback (most recent call last):
Sep 28 11:50:19 ctl02 nova-api[6404]: 2017-09-28 11:50:19.819 6404 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:50:19 ctl02 nova-api[6404]: 2017-09-28 11:50:19.819 6404 ERROR nova     sys.exit(main())
Sep 28 11:50:19 ctl02 nova-api[6404]: 2017-09-28 11:50:19.819 6404 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:50:19 ctl02 nova-api[6404]: 2017-09-28 11:50:19.819 6404 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:50:19 ctl02 nova-api[6404]: 2017-09-28 11:50:19.819 6404 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:50:19 ctl02 nova-api[6404]: 2017-09-28 11:50:19.819 6404 ERROR nova     max_url_len=max_url_len)
Sep 28 11:50:19 ctl02 nova-api[6404]: 2017-09-28 11:50:19.819 6404 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:50:19 ctl02 nova-api[6404]: 2017-09-28 11:50:19.819 6404 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:50:19 ctl02 nova-api[6404]: 2017-09-28 11:50:19.819 6404 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:50:19 ctl02 nova-api[6404]: 2017-09-28 11:50:19.819 6404 ERROR nova     sock.listen(backlog)
Sep 28 11:50:19 ctl02 nova-api[6404]: 2017-09-28 11:50:19.819 6404 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:50:19 ctl02 nova-api[6404]: 2017-09-28 11:50:19.819 6404 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:50:19 ctl02 nova-api[6404]: 2017-09-28 11:50:19.819 6404 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:50:19 ctl02 nova-api[6404]: 2017-09-28 11:50:19.819 6404 ERROR nova
Sep 28 11:50:19 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:50:19 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:50:19 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:50:20 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:50:20 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:50:20 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:50:20 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:50:21 ctl02 nova-api[6421]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:50:21 ctl02 nova-api[6421]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:50:21 ctl02 nova-api[6421]: 2017-09-28 11:50:21.840 6421 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:50:21 ctl02 nova-api[6421]: 2017-09-28 11:50:21.842 6421 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:50:21 ctl02 nova-api[6421]: 2017-09-28 11:50:21.842 6421 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:50:21 ctl02 nova-api[6421]: 2017-09-28 11:50:21.842 6421 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:50:21 ctl02 nova-api[6421]: 2017-09-28 11:50:21.842 6421 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:50:21 ctl02 nova-api[6421]: 2017-09-28 11:50:21.842 6421 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:50:21 ctl02 nova-api[6421]: 2017-09-28 11:50:21.842 6421 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:50:21 ctl02 nova-api[6421]: 2017-09-28 11:50:21.842 6421 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:50:21 ctl02 nova-api[6421]: 2017-09-28 11:50:21.842 6421 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:50:21 ctl02 nova-api[6421]: 2017-09-28 11:50:21.842 6421 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:50:21 ctl02 nova-api[6421]: 2017-09-28 11:50:21.842 6421 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:50:21 ctl02 nova-api[6421]: 2017-09-28 11:50:21.842 6421 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:50:21 ctl02 nova-api[6421]: 2017-09-28 11:50:21.842 6421 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:50:21 ctl02 nova-api[6421]: 2017-09-28 11:50:21.842 6421 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:50:21 ctl02 nova-api[6421]: 2017-09-28 11:50:21.842 6421 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:50:21 ctl02 nova-api[6421]: 2017-09-28 11:50:21.842 6421 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:50:21 ctl02 nova-api[6421]: 2017-09-28 11:50:21.842 6421 ERROR nova.wsgi     self.filename))
Sep 28 11:50:21 ctl02 nova-api[6421]: 2017-09-28 11:50:21.842 6421 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:50:21 ctl02 nova-api[6421]: 2017-09-28 11:50:21.842 6421 ERROR nova.wsgi
Sep 28 11:50:21 ctl02 nova-api[6421]: 2017-09-28 11:50:21.846 6421 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:50:21 ctl02 nova-api[6421]: 2017-09-28 11:50:21.989 6421 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:50:22 ctl02 nova-conductor[5056]: 2017-09-28 11:50:22.055 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 18 seconds.
Sep 28 11:50:22 ctl02 nova-conductor[5056]: 2017-09-28 11:50:22.068 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 18 seconds.
Sep 28 11:50:22 ctl02 nova-conductor[5056]: 2017-09-28 11:50:22.085 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 18 seconds.
Sep 28 11:50:22 ctl02 nova-conductor[5056]: 2017-09-28 11:50:22.085 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 18 seconds.
Sep 28 11:50:22 ctl02 nova-api[6421]: 2017-09-28 11:50:22.230 6421 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:50:22 ctl02 nova-api[6421]: 2017-09-28 11:50:22.232 6421 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:50:22 ctl02 nova-api[6421]: 2017-09-28 11:50:22.232 6421 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:50:22 ctl02 nova-api[6421]: 2017-09-28 11:50:22.232 6421 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:50:22 ctl02 nova-api[6421]: 2017-09-28 11:50:22.362 6421 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:50:22 ctl02 nova-api[6421]: 2017-09-28 11:50:22.364 6421 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:50:22 ctl02 nova-api[6421]: 2017-09-28 11:50:22.364 6421 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:50:22 ctl02 nova-api[6421]: 2017-09-28 11:50:22.365 6421 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:50:22 ctl02 nova-api[6421]: 2017-09-28 11:50:22.368 6421 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:50:22 ctl02 nova-api[6421]: 2017-09-28 11:50:22.368 6421 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:50:22 ctl02 nova-api[6421]: 2017-09-28 11:50:22.368 6421 ERROR nova Traceback (most recent call last):
Sep 28 11:50:22 ctl02 nova-api[6421]: 2017-09-28 11:50:22.368 6421 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:50:22 ctl02 nova-api[6421]: 2017-09-28 11:50:22.368 6421 ERROR nova     sys.exit(main())
Sep 28 11:50:22 ctl02 nova-api[6421]: 2017-09-28 11:50:22.368 6421 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:50:22 ctl02 nova-api[6421]: 2017-09-28 11:50:22.368 6421 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:50:22 ctl02 nova-api[6421]: 2017-09-28 11:50:22.368 6421 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:50:22 ctl02 nova-api[6421]: 2017-09-28 11:50:22.368 6421 ERROR nova     max_url_len=max_url_len)
Sep 28 11:50:22 ctl02 nova-api[6421]: 2017-09-28 11:50:22.368 6421 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:50:22 ctl02 nova-api[6421]: 2017-09-28 11:50:22.368 6421 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:50:22 ctl02 nova-api[6421]: 2017-09-28 11:50:22.368 6421 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:50:22 ctl02 nova-api[6421]: 2017-09-28 11:50:22.368 6421 ERROR nova     sock.listen(backlog)
Sep 28 11:50:22 ctl02 nova-api[6421]: 2017-09-28 11:50:22.368 6421 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:50:22 ctl02 nova-api[6421]: 2017-09-28 11:50:22.368 6421 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:50:22 ctl02 nova-api[6421]: 2017-09-28 11:50:22.368 6421 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:50:22 ctl02 nova-api[6421]: 2017-09-28 11:50:22.368 6421 ERROR nova
Sep 28 11:50:22 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:50:22 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:50:22 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:50:22 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:50:22 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:50:22 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:50:22 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:50:23 ctl02 glance-api[29183]: 2017-09-28 11:50:23.493 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:50:23] "OPTIONS / HTTP/1.0" 200 134 0.000656
Sep 28 11:50:24 ctl02 nova-api[6440]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:50:24 ctl02 nova-api[6440]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:50:24 ctl02 nova-api[6440]: 2017-09-28 11:50:24.328 6440 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:50:24 ctl02 nova-api[6440]: 2017-09-28 11:50:24.332 6440 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:50:24 ctl02 nova-api[6440]: 2017-09-28 11:50:24.332 6440 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:50:24 ctl02 nova-api[6440]: 2017-09-28 11:50:24.332 6440 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:50:24 ctl02 nova-api[6440]: 2017-09-28 11:50:24.332 6440 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:50:24 ctl02 nova-api[6440]: 2017-09-28 11:50:24.332 6440 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:50:24 ctl02 nova-api[6440]: 2017-09-28 11:50:24.332 6440 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:50:24 ctl02 nova-api[6440]: 2017-09-28 11:50:24.332 6440 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:50:24 ctl02 nova-api[6440]: 2017-09-28 11:50:24.332 6440 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:50:24 ctl02 nova-api[6440]: 2017-09-28 11:50:24.332 6440 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:50:24 ctl02 nova-api[6440]: 2017-09-28 11:50:24.332 6440 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:50:24 ctl02 nova-api[6440]: 2017-09-28 11:50:24.332 6440 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:50:24 ctl02 nova-api[6440]: 2017-09-28 11:50:24.332 6440 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:50:24 ctl02 nova-api[6440]: 2017-09-28 11:50:24.332 6440 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:50:24 ctl02 nova-api[6440]: 2017-09-28 11:50:24.332 6440 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:50:24 ctl02 nova-api[6440]: 2017-09-28 11:50:24.332 6440 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:50:24 ctl02 nova-api[6440]: 2017-09-28 11:50:24.332 6440 ERROR nova.wsgi     self.filename))
Sep 28 11:50:24 ctl02 nova-api[6440]: 2017-09-28 11:50:24.332 6440 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:50:24 ctl02 nova-api[6440]: 2017-09-28 11:50:24.332 6440 ERROR nova.wsgi
Sep 28 11:50:24 ctl02 nova-api[6440]: 2017-09-28 11:50:24.333 6440 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:50:24 ctl02 nova-api[6440]: 2017-09-28 11:50:24.465 6440 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:50:24 ctl02 nova-api[6440]: 2017-09-28 11:50:24.696 6440 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:50:24 ctl02 nova-api[6440]: 2017-09-28 11:50:24.698 6440 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:50:24 ctl02 nova-api[6440]: 2017-09-28 11:50:24.698 6440 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:50:24 ctl02 nova-api[6440]: 2017-09-28 11:50:24.699 6440 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:50:24 ctl02 nova-api[6440]: 2017-09-28 11:50:24.828 6440 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:50:24 ctl02 nova-api[6440]: 2017-09-28 11:50:24.830 6440 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:50:24 ctl02 nova-api[6440]: 2017-09-28 11:50:24.830 6440 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:50:24 ctl02 nova-api[6440]: 2017-09-28 11:50:24.831 6440 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:50:24 ctl02 nova-api[6440]: 2017-09-28 11:50:24.834 6440 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:50:24 ctl02 nova-api[6440]: 2017-09-28 11:50:24.834 6440 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:50:24 ctl02 nova-api[6440]: 2017-09-28 11:50:24.834 6440 ERROR nova Traceback (most recent call last):
Sep 28 11:50:24 ctl02 nova-api[6440]: 2017-09-28 11:50:24.834 6440 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:50:24 ctl02 nova-api[6440]: 2017-09-28 11:50:24.834 6440 ERROR nova     sys.exit(main())
Sep 28 11:50:24 ctl02 nova-api[6440]: 2017-09-28 11:50:24.834 6440 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:50:24 ctl02 nova-api[6440]: 2017-09-28 11:50:24.834 6440 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:50:24 ctl02 nova-api[6440]: 2017-09-28 11:50:24.834 6440 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:50:24 ctl02 nova-api[6440]: 2017-09-28 11:50:24.834 6440 ERROR nova     max_url_len=max_url_len)
Sep 28 11:50:24 ctl02 nova-api[6440]: 2017-09-28 11:50:24.834 6440 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:50:24 ctl02 nova-api[6440]: 2017-09-28 11:50:24.834 6440 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:50:24 ctl02 nova-api[6440]: 2017-09-28 11:50:24.834 6440 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:50:24 ctl02 nova-api[6440]: 2017-09-28 11:50:24.834 6440 ERROR nova     sock.listen(backlog)
Sep 28 11:50:24 ctl02 nova-api[6440]: 2017-09-28 11:50:24.834 6440 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:50:24 ctl02 nova-api[6440]: 2017-09-28 11:50:24.834 6440 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:50:24 ctl02 nova-api[6440]: 2017-09-28 11:50:24.834 6440 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:50:24 ctl02 nova-api[6440]: 2017-09-28 11:50:24.834 6440 ERROR nova
Sep 28 11:50:24 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:50:24 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:50:24 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:50:25 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:50:25 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:50:25 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:50:25 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:50:26 ctl02 nova-api[6458]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:50:26 ctl02 nova-api[6458]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:50:26 ctl02 nova-api[6458]: 2017-09-28 11:50:26.885 6458 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:50:26 ctl02 nova-api[6458]: 2017-09-28 11:50:26.886 6458 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:50:26 ctl02 nova-api[6458]: 2017-09-28 11:50:26.886 6458 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:50:26 ctl02 nova-api[6458]: 2017-09-28 11:50:26.886 6458 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:50:26 ctl02 nova-api[6458]: 2017-09-28 11:50:26.886 6458 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:50:26 ctl02 nova-api[6458]: 2017-09-28 11:50:26.886 6458 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:50:26 ctl02 nova-api[6458]: 2017-09-28 11:50:26.886 6458 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:50:26 ctl02 nova-api[6458]: 2017-09-28 11:50:26.886 6458 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:50:26 ctl02 nova-api[6458]: 2017-09-28 11:50:26.886 6458 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:50:26 ctl02 nova-api[6458]: 2017-09-28 11:50:26.886 6458 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:50:26 ctl02 nova-api[6458]: 2017-09-28 11:50:26.886 6458 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:50:26 ctl02 nova-api[6458]: 2017-09-28 11:50:26.886 6458 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:50:26 ctl02 nova-api[6458]: 2017-09-28 11:50:26.886 6458 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:50:26 ctl02 nova-api[6458]: 2017-09-28 11:50:26.886 6458 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:50:26 ctl02 nova-api[6458]: 2017-09-28 11:50:26.886 6458 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:50:26 ctl02 nova-api[6458]: 2017-09-28 11:50:26.886 6458 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:50:26 ctl02 nova-api[6458]: 2017-09-28 11:50:26.886 6458 ERROR nova.wsgi     self.filename))
Sep 28 11:50:26 ctl02 nova-api[6458]: 2017-09-28 11:50:26.886 6458 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:50:26 ctl02 nova-api[6458]: 2017-09-28 11:50:26.886 6458 ERROR nova.wsgi
Sep 28 11:50:26 ctl02 nova-api[6458]: 2017-09-28 11:50:26.887 6458 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:50:27 ctl02 nova-api[6458]: 2017-09-28 11:50:27.021 6458 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:50:27 ctl02 nova-api[6458]: 2017-09-28 11:50:27.266 6458 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:50:27 ctl02 nova-api[6458]: 2017-09-28 11:50:27.269 6458 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:50:27 ctl02 nova-api[6458]: 2017-09-28 11:50:27.269 6458 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:50:27 ctl02 nova-api[6458]: 2017-09-28 11:50:27.269 6458 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:50:27 ctl02 nova-api[6458]: 2017-09-28 11:50:27.401 6458 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:50:27 ctl02 nova-api[6458]: 2017-09-28 11:50:27.403 6458 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:50:27 ctl02 nova-api[6458]: 2017-09-28 11:50:27.403 6458 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:50:27 ctl02 nova-api[6458]: 2017-09-28 11:50:27.403 6458 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:50:27 ctl02 nova-api[6458]: 2017-09-28 11:50:27.407 6458 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:50:27 ctl02 nova-api[6458]: 2017-09-28 11:50:27.407 6458 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:50:27 ctl02 nova-api[6458]: 2017-09-28 11:50:27.407 6458 ERROR nova Traceback (most recent call last):
Sep 28 11:50:27 ctl02 nova-api[6458]: 2017-09-28 11:50:27.407 6458 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:50:27 ctl02 nova-api[6458]: 2017-09-28 11:50:27.407 6458 ERROR nova     sys.exit(main())
Sep 28 11:50:27 ctl02 nova-api[6458]: 2017-09-28 11:50:27.407 6458 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:50:27 ctl02 nova-api[6458]: 2017-09-28 11:50:27.407 6458 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:50:27 ctl02 nova-api[6458]: 2017-09-28 11:50:27.407 6458 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:50:27 ctl02 nova-api[6458]: 2017-09-28 11:50:27.407 6458 ERROR nova     max_url_len=max_url_len)
Sep 28 11:50:27 ctl02 nova-api[6458]: 2017-09-28 11:50:27.407 6458 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:50:27 ctl02 nova-api[6458]: 2017-09-28 11:50:27.407 6458 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:50:27 ctl02 nova-api[6458]: 2017-09-28 11:50:27.407 6458 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:50:27 ctl02 nova-api[6458]: 2017-09-28 11:50:27.407 6458 ERROR nova     sock.listen(backlog)
Sep 28 11:50:27 ctl02 nova-api[6458]: 2017-09-28 11:50:27.407 6458 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:50:27 ctl02 nova-api[6458]: 2017-09-28 11:50:27.407 6458 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:50:27 ctl02 nova-api[6458]: 2017-09-28 11:50:27.407 6458 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:50:27 ctl02 nova-api[6458]: 2017-09-28 11:50:27.407 6458 ERROR nova
Sep 28 11:50:27 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:50:27 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:50:27 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:50:27 ctl02 glance-api[29183]: 2017-09-28 11:50:27.713 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:50:27] "OPTIONS / HTTP/1.0" 200 134 0.000744
Sep 28 11:50:27 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4f406611)
Sep 28 11:50:27 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:50:27 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:50:27 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:50:27 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:50:28 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4f406611)
Sep 28 11:50:28 ctl02 nova-consoleauth[5433]: 2017-09-28 11:50:28.857 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 18 seconds.
Sep 28 11:50:29 ctl02 nova-api[6476]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:50:29 ctl02 nova-api[6476]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:50:29 ctl02 glance-api[29183]: 2017-09-28 11:50:29.509 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:50:29] "OPTIONS / HTTP/1.0" 200 134 0.000610
Sep 28 11:50:29 ctl02 nova-api[6476]: 2017-09-28 11:50:29.560 6476 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:50:29 ctl02 nova-api[6476]: 2017-09-28 11:50:29.561 6476 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:50:29 ctl02 nova-api[6476]: 2017-09-28 11:50:29.561 6476 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:50:29 ctl02 nova-api[6476]: 2017-09-28 11:50:29.561 6476 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:50:29 ctl02 nova-api[6476]: 2017-09-28 11:50:29.561 6476 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:50:29 ctl02 nova-api[6476]: 2017-09-28 11:50:29.561 6476 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:50:29 ctl02 nova-api[6476]: 2017-09-28 11:50:29.561 6476 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:50:29 ctl02 nova-api[6476]: 2017-09-28 11:50:29.561 6476 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:50:29 ctl02 nova-api[6476]: 2017-09-28 11:50:29.561 6476 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:50:29 ctl02 nova-api[6476]: 2017-09-28 11:50:29.561 6476 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:50:29 ctl02 nova-api[6476]: 2017-09-28 11:50:29.561 6476 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:50:29 ctl02 nova-api[6476]: 2017-09-28 11:50:29.561 6476 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:50:29 ctl02 nova-api[6476]: 2017-09-28 11:50:29.561 6476 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:50:29 ctl02 nova-api[6476]: 2017-09-28 11:50:29.561 6476 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:50:29 ctl02 nova-api[6476]: 2017-09-28 11:50:29.561 6476 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:50:29 ctl02 nova-api[6476]: 2017-09-28 11:50:29.561 6476 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:50:29 ctl02 nova-api[6476]: 2017-09-28 11:50:29.561 6476 ERROR nova.wsgi     self.filename))
Sep 28 11:50:29 ctl02 nova-api[6476]: 2017-09-28 11:50:29.561 6476 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:50:29 ctl02 nova-api[6476]: 2017-09-28 11:50:29.561 6476 ERROR nova.wsgi
Sep 28 11:50:29 ctl02 nova-api[6476]: 2017-09-28 11:50:29.562 6476 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:50:29 ctl02 nova-api[6476]: 2017-09-28 11:50:29.688 6476 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:50:29 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4f406611)
Sep 28 11:50:29 ctl02 nova-api[6476]: 2017-09-28 11:50:29.916 6476 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:50:29 ctl02 nova-api[6476]: 2017-09-28 11:50:29.918 6476 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:50:29 ctl02 nova-api[6476]: 2017-09-28 11:50:29.918 6476 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:50:29 ctl02 nova-api[6476]: 2017-09-28 11:50:29.919 6476 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:50:30 ctl02 nova-api[6476]: 2017-09-28 11:50:30.046 6476 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:50:30 ctl02 nova-api[6476]: 2017-09-28 11:50:30.048 6476 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:50:30 ctl02 nova-api[6476]: 2017-09-28 11:50:30.048 6476 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:50:30 ctl02 nova-api[6476]: 2017-09-28 11:50:30.049 6476 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:50:30 ctl02 nova-api[6476]: 2017-09-28 11:50:30.052 6476 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:50:30 ctl02 nova-api[6476]: 2017-09-28 11:50:30.052 6476 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:50:30 ctl02 nova-api[6476]: 2017-09-28 11:50:30.052 6476 ERROR nova Traceback (most recent call last):
Sep 28 11:50:30 ctl02 nova-api[6476]: 2017-09-28 11:50:30.052 6476 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:50:30 ctl02 nova-api[6476]: 2017-09-28 11:50:30.052 6476 ERROR nova     sys.exit(main())
Sep 28 11:50:30 ctl02 nova-api[6476]: 2017-09-28 11:50:30.052 6476 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:50:30 ctl02 nova-api[6476]: 2017-09-28 11:50:30.052 6476 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:50:30 ctl02 nova-api[6476]: 2017-09-28 11:50:30.052 6476 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:50:30 ctl02 nova-api[6476]: 2017-09-28 11:50:30.052 6476 ERROR nova     max_url_len=max_url_len)
Sep 28 11:50:30 ctl02 nova-api[6476]: 2017-09-28 11:50:30.052 6476 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:50:30 ctl02 nova-api[6476]: 2017-09-28 11:50:30.052 6476 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:50:30 ctl02 nova-api[6476]: 2017-09-28 11:50:30.052 6476 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:50:30 ctl02 nova-api[6476]: 2017-09-28 11:50:30.052 6476 ERROR nova     sock.listen(backlog)
Sep 28 11:50:30 ctl02 nova-api[6476]: 2017-09-28 11:50:30.052 6476 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:50:30 ctl02 nova-api[6476]: 2017-09-28 11:50:30.052 6476 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:50:30 ctl02 nova-api[6476]: 2017-09-28 11:50:30.052 6476 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:50:30 ctl02 nova-api[6476]: 2017-09-28 11:50:30.052 6476 ERROR nova
Sep 28 11:50:30 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:50:30 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:50:30 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:50:30 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:50:30 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:50:30 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:50:30 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:50:30 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4f406611)
Sep 28 11:50:31 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4f406611)
Sep 28 11:50:31 ctl02 nova-scheduler[5620]: 2017-09-28 11:50:31.877 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 18 seconds.
Sep 28 11:50:31 ctl02 nova-api[6494]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:50:31 ctl02 nova-api[6494]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:50:32 ctl02 nova-api[6494]: 2017-09-28 11:50:32.076 6494 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:50:32 ctl02 nova-api[6494]: 2017-09-28 11:50:32.078 6494 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:50:32 ctl02 nova-api[6494]: 2017-09-28 11:50:32.078 6494 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:50:32 ctl02 nova-api[6494]: 2017-09-28 11:50:32.078 6494 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:50:32 ctl02 nova-api[6494]: 2017-09-28 11:50:32.078 6494 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:50:32 ctl02 nova-api[6494]: 2017-09-28 11:50:32.078 6494 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:50:32 ctl02 nova-api[6494]: 2017-09-28 11:50:32.078 6494 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:50:32 ctl02 nova-api[6494]: 2017-09-28 11:50:32.078 6494 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:50:32 ctl02 nova-api[6494]: 2017-09-28 11:50:32.078 6494 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:50:32 ctl02 nova-api[6494]: 2017-09-28 11:50:32.078 6494 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:50:32 ctl02 nova-api[6494]: 2017-09-28 11:50:32.078 6494 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:50:32 ctl02 nova-api[6494]: 2017-09-28 11:50:32.078 6494 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:50:32 ctl02 nova-api[6494]: 2017-09-28 11:50:32.078 6494 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:50:32 ctl02 nova-api[6494]: 2017-09-28 11:50:32.078 6494 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:50:32 ctl02 nova-api[6494]: 2017-09-28 11:50:32.078 6494 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:50:32 ctl02 nova-api[6494]: 2017-09-28 11:50:32.078 6494 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:50:32 ctl02 nova-api[6494]: 2017-09-28 11:50:32.078 6494 ERROR nova.wsgi     self.filename))
Sep 28 11:50:32 ctl02 nova-api[6494]: 2017-09-28 11:50:32.078 6494 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:50:32 ctl02 nova-api[6494]: 2017-09-28 11:50:32.078 6494 ERROR nova.wsgi
Sep 28 11:50:32 ctl02 nova-api[6494]: 2017-09-28 11:50:32.080 6494 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:50:32 ctl02 nova-api[6494]: 2017-09-28 11:50:32.211 6494 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:50:32 ctl02 nova-api[6494]: 2017-09-28 11:50:32.442 6494 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:50:32 ctl02 nova-api[6494]: 2017-09-28 11:50:32.444 6494 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:50:32 ctl02 nova-api[6494]: 2017-09-28 11:50:32.444 6494 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:50:32 ctl02 nova-api[6494]: 2017-09-28 11:50:32.445 6494 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:50:32 ctl02 nova-api[6494]: 2017-09-28 11:50:32.575 6494 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:50:32 ctl02 nova-api[6494]: 2017-09-28 11:50:32.577 6494 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:50:32 ctl02 nova-api[6494]: 2017-09-28 11:50:32.578 6494 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:50:32 ctl02 nova-api[6494]: 2017-09-28 11:50:32.578 6494 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:50:32 ctl02 nova-api[6494]: 2017-09-28 11:50:32.581 6494 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:50:32 ctl02 nova-api[6494]: 2017-09-28 11:50:32.582 6494 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:50:32 ctl02 nova-api[6494]: 2017-09-28 11:50:32.582 6494 ERROR nova Traceback (most recent call last):
Sep 28 11:50:32 ctl02 nova-api[6494]: 2017-09-28 11:50:32.582 6494 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:50:32 ctl02 nova-api[6494]: 2017-09-28 11:50:32.582 6494 ERROR nova     sys.exit(main())
Sep 28 11:50:32 ctl02 nova-api[6494]: 2017-09-28 11:50:32.582 6494 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:50:32 ctl02 nova-api[6494]: 2017-09-28 11:50:32.582 6494 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:50:32 ctl02 nova-api[6494]: 2017-09-28 11:50:32.582 6494 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:50:32 ctl02 nova-api[6494]: 2017-09-28 11:50:32.582 6494 ERROR nova     max_url_len=max_url_len)
Sep 28 11:50:32 ctl02 nova-api[6494]: 2017-09-28 11:50:32.582 6494 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:50:32 ctl02 nova-api[6494]: 2017-09-28 11:50:32.582 6494 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:50:32 ctl02 nova-api[6494]: 2017-09-28 11:50:32.582 6494 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:50:32 ctl02 nova-api[6494]: 2017-09-28 11:50:32.582 6494 ERROR nova     sock.listen(backlog)
Sep 28 11:50:32 ctl02 nova-api[6494]: 2017-09-28 11:50:32.582 6494 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:50:32 ctl02 nova-api[6494]: 2017-09-28 11:50:32.582 6494 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:50:32 ctl02 nova-api[6494]: 2017-09-28 11:50:32.582 6494 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:50:32 ctl02 nova-api[6494]: 2017-09-28 11:50:32.582 6494 ERROR nova
Sep 28 11:50:32 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4f406611)
Sep 28 11:50:32 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:50:32 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:50:32 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:50:32 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:50:32 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:50:32 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:50:32 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:50:33 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4f406611)
Sep 28 11:50:33 ctl02 glance-api[29183]: 2017-09-28 11:50:33.796 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:50:33] "OPTIONS / HTTP/1.0" 200 134 0.000646
Sep 28 11:50:34 ctl02 nova-api[6512]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:50:34 ctl02 nova-api[6512]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:50:34 ctl02 nova-api[6512]: 2017-09-28 11:50:34.577 6512 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:50:34 ctl02 nova-api[6512]: 2017-09-28 11:50:34.579 6512 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:50:34 ctl02 nova-api[6512]: 2017-09-28 11:50:34.579 6512 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:50:34 ctl02 nova-api[6512]: 2017-09-28 11:50:34.579 6512 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:50:34 ctl02 nova-api[6512]: 2017-09-28 11:50:34.579 6512 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:50:34 ctl02 nova-api[6512]: 2017-09-28 11:50:34.579 6512 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:50:34 ctl02 nova-api[6512]: 2017-09-28 11:50:34.579 6512 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:50:34 ctl02 nova-api[6512]: 2017-09-28 11:50:34.579 6512 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:50:34 ctl02 nova-api[6512]: 2017-09-28 11:50:34.579 6512 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:50:34 ctl02 nova-api[6512]: 2017-09-28 11:50:34.579 6512 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:50:34 ctl02 nova-api[6512]: 2017-09-28 11:50:34.579 6512 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:50:34 ctl02 nova-api[6512]: 2017-09-28 11:50:34.579 6512 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:50:34 ctl02 nova-api[6512]: 2017-09-28 11:50:34.579 6512 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:50:34 ctl02 nova-api[6512]: 2017-09-28 11:50:34.579 6512 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:50:34 ctl02 nova-api[6512]: 2017-09-28 11:50:34.579 6512 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:50:34 ctl02 nova-api[6512]: 2017-09-28 11:50:34.579 6512 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:50:34 ctl02 nova-api[6512]: 2017-09-28 11:50:34.579 6512 ERROR nova.wsgi     self.filename))
Sep 28 11:50:34 ctl02 nova-api[6512]: 2017-09-28 11:50:34.579 6512 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:50:34 ctl02 nova-api[6512]: 2017-09-28 11:50:34.579 6512 ERROR nova.wsgi
Sep 28 11:50:34 ctl02 nova-api[6512]: 2017-09-28 11:50:34.580 6512 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:50:34 ctl02 nova-api[6512]: 2017-09-28 11:50:34.711 6512 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:50:34 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4f406611)
Sep 28 11:50:34 ctl02 nova-api[6512]: 2017-09-28 11:50:34.948 6512 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:50:34 ctl02 nova-api[6512]: 2017-09-28 11:50:34.950 6512 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:50:34 ctl02 nova-api[6512]: 2017-09-28 11:50:34.950 6512 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:50:34 ctl02 nova-api[6512]: 2017-09-28 11:50:34.951 6512 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:50:35 ctl02 nova-api[6512]: 2017-09-28 11:50:35.080 6512 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:50:35 ctl02 nova-api[6512]: 2017-09-28 11:50:35.082 6512 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:50:35 ctl02 nova-api[6512]: 2017-09-28 11:50:35.082 6512 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:50:35 ctl02 nova-api[6512]: 2017-09-28 11:50:35.083 6512 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:50:35 ctl02 nova-api[6512]: 2017-09-28 11:50:35.086 6512 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:50:35 ctl02 nova-api[6512]: 2017-09-28 11:50:35.086 6512 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:50:35 ctl02 nova-api[6512]: 2017-09-28 11:50:35.086 6512 ERROR nova Traceback (most recent call last):
Sep 28 11:50:35 ctl02 nova-api[6512]: 2017-09-28 11:50:35.086 6512 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:50:35 ctl02 nova-api[6512]: 2017-09-28 11:50:35.086 6512 ERROR nova     sys.exit(main())
Sep 28 11:50:35 ctl02 nova-api[6512]: 2017-09-28 11:50:35.086 6512 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:50:35 ctl02 nova-api[6512]: 2017-09-28 11:50:35.086 6512 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:50:35 ctl02 nova-api[6512]: 2017-09-28 11:50:35.086 6512 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:50:35 ctl02 nova-api[6512]: 2017-09-28 11:50:35.086 6512 ERROR nova     max_url_len=max_url_len)
Sep 28 11:50:35 ctl02 nova-api[6512]: 2017-09-28 11:50:35.086 6512 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:50:35 ctl02 nova-api[6512]: 2017-09-28 11:50:35.086 6512 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:50:35 ctl02 nova-api[6512]: 2017-09-28 11:50:35.086 6512 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:50:35 ctl02 nova-api[6512]: 2017-09-28 11:50:35.086 6512 ERROR nova     sock.listen(backlog)
Sep 28 11:50:35 ctl02 nova-api[6512]: 2017-09-28 11:50:35.086 6512 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:50:35 ctl02 nova-api[6512]: 2017-09-28 11:50:35.086 6512 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:50:35 ctl02 nova-api[6512]: 2017-09-28 11:50:35.086 6512 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:50:35 ctl02 nova-api[6512]: 2017-09-28 11:50:35.086 6512 ERROR nova
Sep 28 11:50:35 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:50:35 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:50:35 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:50:35 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:50:35 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:50:35 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:50:35 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:50:35 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4f406611)
Sep 28 11:50:36 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4f406611)
Sep 28 11:50:36 ctl02 nova-api[6530]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:50:36 ctl02 nova-api[6530]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:50:36 ctl02 nova-cert[4860]: 2017-09-28 11:50:36.972 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 20 seconds.
Sep 28 11:50:37 ctl02 nova-api[6530]: 2017-09-28 11:50:37.065 6530 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:50:37 ctl02 nova-api[6530]: 2017-09-28 11:50:37.066 6530 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:50:37 ctl02 nova-api[6530]: 2017-09-28 11:50:37.066 6530 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:50:37 ctl02 nova-api[6530]: 2017-09-28 11:50:37.066 6530 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:50:37 ctl02 nova-api[6530]: 2017-09-28 11:50:37.066 6530 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:50:37 ctl02 nova-api[6530]: 2017-09-28 11:50:37.066 6530 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:50:37 ctl02 nova-api[6530]: 2017-09-28 11:50:37.066 6530 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:50:37 ctl02 nova-api[6530]: 2017-09-28 11:50:37.066 6530 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:50:37 ctl02 nova-api[6530]: 2017-09-28 11:50:37.066 6530 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:50:37 ctl02 nova-api[6530]: 2017-09-28 11:50:37.066 6530 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:50:37 ctl02 nova-api[6530]: 2017-09-28 11:50:37.066 6530 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:50:37 ctl02 nova-api[6530]: 2017-09-28 11:50:37.066 6530 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:50:37 ctl02 nova-api[6530]: 2017-09-28 11:50:37.066 6530 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:50:37 ctl02 nova-api[6530]: 2017-09-28 11:50:37.066 6530 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:50:37 ctl02 nova-api[6530]: 2017-09-28 11:50:37.066 6530 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:50:37 ctl02 nova-api[6530]: 2017-09-28 11:50:37.066 6530 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:50:37 ctl02 nova-api[6530]: 2017-09-28 11:50:37.066 6530 ERROR nova.wsgi     self.filename))
Sep 28 11:50:37 ctl02 nova-api[6530]: 2017-09-28 11:50:37.066 6530 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:50:37 ctl02 nova-api[6530]: 2017-09-28 11:50:37.066 6530 ERROR nova.wsgi
Sep 28 11:50:37 ctl02 nova-api[6530]: 2017-09-28 11:50:37.067 6530 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:50:37 ctl02 nova-api[6530]: 2017-09-28 11:50:37.198 6530 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:50:37 ctl02 nova-api[6530]: 2017-09-28 11:50:37.425 6530 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:50:37 ctl02 nova-api[6530]: 2017-09-28 11:50:37.427 6530 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:50:37 ctl02 nova-api[6530]: 2017-09-28 11:50:37.427 6530 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:50:37 ctl02 nova-api[6530]: 2017-09-28 11:50:37.427 6530 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:50:37 ctl02 nova-api[6530]: 2017-09-28 11:50:37.558 6530 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:50:37 ctl02 nova-api[6530]: 2017-09-28 11:50:37.560 6530 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:50:37 ctl02 nova-api[6530]: 2017-09-28 11:50:37.560 6530 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:50:37 ctl02 nova-api[6530]: 2017-09-28 11:50:37.560 6530 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:50:37 ctl02 nova-api[6530]: 2017-09-28 11:50:37.563 6530 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:50:37 ctl02 nova-api[6530]: 2017-09-28 11:50:37.564 6530 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:50:37 ctl02 nova-api[6530]: 2017-09-28 11:50:37.564 6530 ERROR nova Traceback (most recent call last):
Sep 28 11:50:37 ctl02 nova-api[6530]: 2017-09-28 11:50:37.564 6530 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:50:37 ctl02 nova-api[6530]: 2017-09-28 11:50:37.564 6530 ERROR nova     sys.exit(main())
Sep 28 11:50:37 ctl02 nova-api[6530]: 2017-09-28 11:50:37.564 6530 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:50:37 ctl02 nova-api[6530]: 2017-09-28 11:50:37.564 6530 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:50:37 ctl02 nova-api[6530]: 2017-09-28 11:50:37.564 6530 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:50:37 ctl02 nova-api[6530]: 2017-09-28 11:50:37.564 6530 ERROR nova     max_url_len=max_url_len)
Sep 28 11:50:37 ctl02 nova-api[6530]: 2017-09-28 11:50:37.564 6530 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:50:37 ctl02 nova-api[6530]: 2017-09-28 11:50:37.564 6530 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:50:37 ctl02 nova-api[6530]: 2017-09-28 11:50:37.564 6530 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:50:37 ctl02 nova-api[6530]: 2017-09-28 11:50:37.564 6530 ERROR nova     sock.listen(backlog)
Sep 28 11:50:37 ctl02 nova-api[6530]: 2017-09-28 11:50:37.564 6530 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:50:37 ctl02 nova-api[6530]: 2017-09-28 11:50:37.564 6530 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:50:37 ctl02 nova-api[6530]: 2017-09-28 11:50:37.564 6530 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:50:37 ctl02 nova-api[6530]: 2017-09-28 11:50:37.564 6530 ERROR nova
Sep 28 11:50:37 ctl02 glance-api[29183]: 2017-09-28 11:50:37.633 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:50:37] "OPTIONS / HTTP/1.0" 200 134 0.000680
Sep 28 11:50:37 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:50:37 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:50:37 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:50:37 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4f406611)
Sep 28 11:50:37 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:50:37 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:50:37 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:50:37 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:50:38 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:50:38 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:50:39 ctl02 glance-api[29183]: 2017-09-28 11:50:39.366 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:50:39] "OPTIONS / HTTP/1.0" 200 134 0.000568
Sep 28 11:50:39 ctl02 nova-api[6548]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:50:39 ctl02 nova-api[6548]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:50:39 ctl02 nova-api[6548]: 2017-09-28 11:50:39.589 6548 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:50:39 ctl02 nova-api[6548]: 2017-09-28 11:50:39.596 6548 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:50:39 ctl02 nova-api[6548]: 2017-09-28 11:50:39.596 6548 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:50:39 ctl02 nova-api[6548]: 2017-09-28 11:50:39.596 6548 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:50:39 ctl02 nova-api[6548]: 2017-09-28 11:50:39.596 6548 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:50:39 ctl02 nova-api[6548]: 2017-09-28 11:50:39.596 6548 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:50:39 ctl02 nova-api[6548]: 2017-09-28 11:50:39.596 6548 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:50:39 ctl02 nova-api[6548]: 2017-09-28 11:50:39.596 6548 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:50:39 ctl02 nova-api[6548]: 2017-09-28 11:50:39.596 6548 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:50:39 ctl02 nova-api[6548]: 2017-09-28 11:50:39.596 6548 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:50:39 ctl02 nova-api[6548]: 2017-09-28 11:50:39.596 6548 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:50:39 ctl02 nova-api[6548]: 2017-09-28 11:50:39.596 6548 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:50:39 ctl02 nova-api[6548]: 2017-09-28 11:50:39.596 6548 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:50:39 ctl02 nova-api[6548]: 2017-09-28 11:50:39.596 6548 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:50:39 ctl02 nova-api[6548]: 2017-09-28 11:50:39.596 6548 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:50:39 ctl02 nova-api[6548]: 2017-09-28 11:50:39.596 6548 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:50:39 ctl02 nova-api[6548]: 2017-09-28 11:50:39.596 6548 ERROR nova.wsgi     self.filename))
Sep 28 11:50:39 ctl02 nova-api[6548]: 2017-09-28 11:50:39.596 6548 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:50:39 ctl02 nova-api[6548]: 2017-09-28 11:50:39.596 6548 ERROR nova.wsgi
Sep 28 11:50:39 ctl02 nova-api[6548]: 2017-09-28 11:50:39.597 6548 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:50:39 ctl02 nova-api[6548]: 2017-09-28 11:50:39.729 6548 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:50:39 ctl02 nova-api[6548]: 2017-09-28 11:50:39.968 6548 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:50:39 ctl02 nova-api[6548]: 2017-09-28 11:50:39.970 6548 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:50:39 ctl02 nova-api[6548]: 2017-09-28 11:50:39.970 6548 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:50:39 ctl02 nova-api[6548]: 2017-09-28 11:50:39.970 6548 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:50:40 ctl02 nova-conductor[5056]: 2017-09-28 11:50:40.062 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 20 seconds.
Sep 28 11:50:40 ctl02 nova-conductor[5056]: 2017-09-28 11:50:40.076 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 20 seconds.
Sep 28 11:50:40 ctl02 nova-conductor[5056]: 2017-09-28 11:50:40.092 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 20 seconds.
Sep 28 11:50:40 ctl02 nova-conductor[5056]: 2017-09-28 11:50:40.094 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 20 seconds.
Sep 28 11:50:40 ctl02 nova-api[6548]: 2017-09-28 11:50:40.117 6548 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:50:40 ctl02 nova-api[6548]: 2017-09-28 11:50:40.120 6548 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:50:40 ctl02 nova-api[6548]: 2017-09-28 11:50:40.120 6548 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:50:40 ctl02 nova-api[6548]: 2017-09-28 11:50:40.121 6548 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:50:40 ctl02 nova-api[6548]: 2017-09-28 11:50:40.124 6548 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:50:40 ctl02 nova-api[6548]: 2017-09-28 11:50:40.125 6548 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:50:40 ctl02 nova-api[6548]: 2017-09-28 11:50:40.125 6548 ERROR nova Traceback (most recent call last):
Sep 28 11:50:40 ctl02 nova-api[6548]: 2017-09-28 11:50:40.125 6548 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:50:40 ctl02 nova-api[6548]: 2017-09-28 11:50:40.125 6548 ERROR nova     sys.exit(main())
Sep 28 11:50:40 ctl02 nova-api[6548]: 2017-09-28 11:50:40.125 6548 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:50:40 ctl02 nova-api[6548]: 2017-09-28 11:50:40.125 6548 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:50:40 ctl02 nova-api[6548]: 2017-09-28 11:50:40.125 6548 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:50:40 ctl02 nova-api[6548]: 2017-09-28 11:50:40.125 6548 ERROR nova     max_url_len=max_url_len)
Sep 28 11:50:40 ctl02 nova-api[6548]: 2017-09-28 11:50:40.125 6548 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:50:40 ctl02 nova-api[6548]: 2017-09-28 11:50:40.125 6548 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:50:40 ctl02 nova-api[6548]: 2017-09-28 11:50:40.125 6548 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:50:40 ctl02 nova-api[6548]: 2017-09-28 11:50:40.125 6548 ERROR nova     sock.listen(backlog)
Sep 28 11:50:40 ctl02 nova-api[6548]: 2017-09-28 11:50:40.125 6548 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:50:40 ctl02 nova-api[6548]: 2017-09-28 11:50:40.125 6548 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:50:40 ctl02 nova-api[6548]: 2017-09-28 11:50:40.125 6548 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:50:40 ctl02 nova-api[6548]: 2017-09-28 11:50:40.125 6548 ERROR nova
Sep 28 11:50:40 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:50:40 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:50:40 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:50:40 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:50:40 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:50:40 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:50:40 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:50:42 ctl02 nova-api[6570]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:50:42 ctl02 nova-api[6570]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:50:42 ctl02 nova-api[6570]: 2017-09-28 11:50:42.308 6570 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:50:42 ctl02 nova-api[6570]: 2017-09-28 11:50:42.310 6570 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:50:42 ctl02 nova-api[6570]: 2017-09-28 11:50:42.310 6570 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:50:42 ctl02 nova-api[6570]: 2017-09-28 11:50:42.310 6570 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:50:42 ctl02 nova-api[6570]: 2017-09-28 11:50:42.310 6570 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:50:42 ctl02 nova-api[6570]: 2017-09-28 11:50:42.310 6570 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:50:42 ctl02 nova-api[6570]: 2017-09-28 11:50:42.310 6570 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:50:42 ctl02 nova-api[6570]: 2017-09-28 11:50:42.310 6570 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:50:42 ctl02 nova-api[6570]: 2017-09-28 11:50:42.310 6570 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:50:42 ctl02 nova-api[6570]: 2017-09-28 11:50:42.310 6570 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:50:42 ctl02 nova-api[6570]: 2017-09-28 11:50:42.310 6570 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:50:42 ctl02 nova-api[6570]: 2017-09-28 11:50:42.310 6570 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:50:42 ctl02 nova-api[6570]: 2017-09-28 11:50:42.310 6570 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:50:42 ctl02 nova-api[6570]: 2017-09-28 11:50:42.310 6570 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:50:42 ctl02 nova-api[6570]: 2017-09-28 11:50:42.310 6570 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:50:42 ctl02 nova-api[6570]: 2017-09-28 11:50:42.310 6570 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:50:42 ctl02 nova-api[6570]: 2017-09-28 11:50:42.310 6570 ERROR nova.wsgi     self.filename))
Sep 28 11:50:42 ctl02 nova-api[6570]: 2017-09-28 11:50:42.310 6570 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:50:42 ctl02 nova-api[6570]: 2017-09-28 11:50:42.310 6570 ERROR nova.wsgi
Sep 28 11:50:42 ctl02 nova-api[6570]: 2017-09-28 11:50:42.311 6570 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:50:42 ctl02 nova-api[6570]: 2017-09-28 11:50:42.438 6570 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:50:42 ctl02 nova-api[6570]: 2017-09-28 11:50:42.668 6570 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:50:42 ctl02 nova-api[6570]: 2017-09-28 11:50:42.670 6570 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:50:42 ctl02 nova-api[6570]: 2017-09-28 11:50:42.671 6570 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:50:42 ctl02 nova-api[6570]: 2017-09-28 11:50:42.671 6570 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:50:42 ctl02 nova-api[6570]: 2017-09-28 11:50:42.800 6570 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:50:42 ctl02 nova-api[6570]: 2017-09-28 11:50:42.802 6570 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:50:42 ctl02 nova-api[6570]: 2017-09-28 11:50:42.802 6570 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:50:42 ctl02 nova-api[6570]: 2017-09-28 11:50:42.803 6570 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:50:42 ctl02 nova-api[6570]: 2017-09-28 11:50:42.806 6570 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:50:42 ctl02 nova-api[6570]: 2017-09-28 11:50:42.806 6570 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:50:42 ctl02 nova-api[6570]: 2017-09-28 11:50:42.806 6570 ERROR nova Traceback (most recent call last):
Sep 28 11:50:42 ctl02 nova-api[6570]: 2017-09-28 11:50:42.806 6570 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:50:42 ctl02 nova-api[6570]: 2017-09-28 11:50:42.806 6570 ERROR nova     sys.exit(main())
Sep 28 11:50:42 ctl02 nova-api[6570]: 2017-09-28 11:50:42.806 6570 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:50:42 ctl02 nova-api[6570]: 2017-09-28 11:50:42.806 6570 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:50:42 ctl02 nova-api[6570]: 2017-09-28 11:50:42.806 6570 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:50:42 ctl02 nova-api[6570]: 2017-09-28 11:50:42.806 6570 ERROR nova     max_url_len=max_url_len)
Sep 28 11:50:42 ctl02 nova-api[6570]: 2017-09-28 11:50:42.806 6570 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:50:42 ctl02 nova-api[6570]: 2017-09-28 11:50:42.806 6570 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:50:42 ctl02 nova-api[6570]: 2017-09-28 11:50:42.806 6570 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:50:42 ctl02 nova-api[6570]: 2017-09-28 11:50:42.806 6570 ERROR nova     sock.listen(backlog)
Sep 28 11:50:42 ctl02 nova-api[6570]: 2017-09-28 11:50:42.806 6570 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:50:42 ctl02 nova-api[6570]: 2017-09-28 11:50:42.806 6570 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:50:42 ctl02 nova-api[6570]: 2017-09-28 11:50:42.806 6570 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:50:42 ctl02 nova-api[6570]: 2017-09-28 11:50:42.806 6570 ERROR nova
Sep 28 11:50:42 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:50:42 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:50:42 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:50:43 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:50:43 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:50:43 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:50:43 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:50:43 ctl02 glance-api[29183]: 2017-09-28 11:50:43.409 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:50:43] "OPTIONS / HTTP/1.0" 200 134 0.000642
Sep 28 11:50:44 ctl02 nova-api[6589]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:50:44 ctl02 nova-api[6589]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:50:44 ctl02 nova-api[6589]: 2017-09-28 11:50:44.850 6589 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:50:44 ctl02 nova-api[6589]: 2017-09-28 11:50:44.851 6589 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:50:44 ctl02 nova-api[6589]: 2017-09-28 11:50:44.851 6589 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:50:44 ctl02 nova-api[6589]: 2017-09-28 11:50:44.851 6589 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:50:44 ctl02 nova-api[6589]: 2017-09-28 11:50:44.851 6589 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:50:44 ctl02 nova-api[6589]: 2017-09-28 11:50:44.851 6589 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:50:44 ctl02 nova-api[6589]: 2017-09-28 11:50:44.851 6589 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:50:44 ctl02 nova-api[6589]: 2017-09-28 11:50:44.851 6589 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:50:44 ctl02 nova-api[6589]: 2017-09-28 11:50:44.851 6589 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:50:44 ctl02 nova-api[6589]: 2017-09-28 11:50:44.851 6589 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:50:44 ctl02 nova-api[6589]: 2017-09-28 11:50:44.851 6589 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:50:44 ctl02 nova-api[6589]: 2017-09-28 11:50:44.851 6589 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:50:44 ctl02 nova-api[6589]: 2017-09-28 11:50:44.851 6589 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:50:44 ctl02 nova-api[6589]: 2017-09-28 11:50:44.851 6589 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:50:44 ctl02 nova-api[6589]: 2017-09-28 11:50:44.851 6589 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:50:44 ctl02 nova-api[6589]: 2017-09-28 11:50:44.851 6589 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:50:44 ctl02 nova-api[6589]: 2017-09-28 11:50:44.851 6589 ERROR nova.wsgi     self.filename))
Sep 28 11:50:44 ctl02 nova-api[6589]: 2017-09-28 11:50:44.851 6589 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:50:44 ctl02 nova-api[6589]: 2017-09-28 11:50:44.851 6589 ERROR nova.wsgi
Sep 28 11:50:44 ctl02 nova-api[6589]: 2017-09-28 11:50:44.852 6589 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:50:44 ctl02 nova-api[6589]: 2017-09-28 11:50:44.982 6589 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:50:45 ctl02 nova-api[6589]: 2017-09-28 11:50:45.223 6589 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:50:45 ctl02 nova-api[6589]: 2017-09-28 11:50:45.226 6589 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:50:45 ctl02 nova-api[6589]: 2017-09-28 11:50:45.226 6589 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:50:45 ctl02 nova-api[6589]: 2017-09-28 11:50:45.226 6589 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:50:45 ctl02 nova-api[6589]: 2017-09-28 11:50:45.356 6589 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:50:45 ctl02 nova-api[6589]: 2017-09-28 11:50:45.358 6589 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:50:45 ctl02 nova-api[6589]: 2017-09-28 11:50:45.358 6589 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:50:45 ctl02 nova-api[6589]: 2017-09-28 11:50:45.358 6589 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:50:45 ctl02 nova-api[6589]: 2017-09-28 11:50:45.362 6589 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:50:45 ctl02 nova-api[6589]: 2017-09-28 11:50:45.362 6589 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:50:45 ctl02 nova-api[6589]: 2017-09-28 11:50:45.362 6589 ERROR nova Traceback (most recent call last):
Sep 28 11:50:45 ctl02 nova-api[6589]: 2017-09-28 11:50:45.362 6589 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:50:45 ctl02 nova-api[6589]: 2017-09-28 11:50:45.362 6589 ERROR nova     sys.exit(main())
Sep 28 11:50:45 ctl02 nova-api[6589]: 2017-09-28 11:50:45.362 6589 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:50:45 ctl02 nova-api[6589]: 2017-09-28 11:50:45.362 6589 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:50:45 ctl02 nova-api[6589]: 2017-09-28 11:50:45.362 6589 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:50:45 ctl02 nova-api[6589]: 2017-09-28 11:50:45.362 6589 ERROR nova     max_url_len=max_url_len)
Sep 28 11:50:45 ctl02 nova-api[6589]: 2017-09-28 11:50:45.362 6589 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:50:45 ctl02 nova-api[6589]: 2017-09-28 11:50:45.362 6589 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:50:45 ctl02 nova-api[6589]: 2017-09-28 11:50:45.362 6589 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:50:45 ctl02 nova-api[6589]: 2017-09-28 11:50:45.362 6589 ERROR nova     sock.listen(backlog)
Sep 28 11:50:45 ctl02 nova-api[6589]: 2017-09-28 11:50:45.362 6589 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:50:45 ctl02 nova-api[6589]: 2017-09-28 11:50:45.362 6589 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:50:45 ctl02 nova-api[6589]: 2017-09-28 11:50:45.362 6589 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:50:45 ctl02 nova-api[6589]: 2017-09-28 11:50:45.362 6589 ERROR nova
Sep 28 11:50:45 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:50:45 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:50:45 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:50:45 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:50:45 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:50:45 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:50:45 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:50:46 ctl02 nova-consoleauth[5433]: 2017-09-28 11:50:46.880 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 20 seconds.
Sep 28 11:50:47 ctl02 nova-api[6607]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:50:47 ctl02 nova-api[6607]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:50:47 ctl02 nova-api[6607]: 2017-09-28 11:50:47.300 6607 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:50:47 ctl02 nova-api[6607]: 2017-09-28 11:50:47.301 6607 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:50:47 ctl02 nova-api[6607]: 2017-09-28 11:50:47.301 6607 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:50:47 ctl02 nova-api[6607]: 2017-09-28 11:50:47.301 6607 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:50:47 ctl02 nova-api[6607]: 2017-09-28 11:50:47.301 6607 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:50:47 ctl02 nova-api[6607]: 2017-09-28 11:50:47.301 6607 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:50:47 ctl02 nova-api[6607]: 2017-09-28 11:50:47.301 6607 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:50:47 ctl02 nova-api[6607]: 2017-09-28 11:50:47.301 6607 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:50:47 ctl02 nova-api[6607]: 2017-09-28 11:50:47.301 6607 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:50:47 ctl02 nova-api[6607]: 2017-09-28 11:50:47.301 6607 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:50:47 ctl02 nova-api[6607]: 2017-09-28 11:50:47.301 6607 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:50:47 ctl02 nova-api[6607]: 2017-09-28 11:50:47.301 6607 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:50:47 ctl02 nova-api[6607]: 2017-09-28 11:50:47.301 6607 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:50:47 ctl02 nova-api[6607]: 2017-09-28 11:50:47.301 6607 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:50:47 ctl02 nova-api[6607]: 2017-09-28 11:50:47.301 6607 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:50:47 ctl02 nova-api[6607]: 2017-09-28 11:50:47.301 6607 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:50:47 ctl02 nova-api[6607]: 2017-09-28 11:50:47.301 6607 ERROR nova.wsgi     self.filename))
Sep 28 11:50:47 ctl02 nova-api[6607]: 2017-09-28 11:50:47.301 6607 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:50:47 ctl02 nova-api[6607]: 2017-09-28 11:50:47.301 6607 ERROR nova.wsgi
Sep 28 11:50:47 ctl02 nova-api[6607]: 2017-09-28 11:50:47.302 6607 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:50:47 ctl02 nova-api[6607]: 2017-09-28 11:50:47.429 6607 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:50:47 ctl02 nova-api[6607]: 2017-09-28 11:50:47.658 6607 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:50:47 ctl02 nova-api[6607]: 2017-09-28 11:50:47.660 6607 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:50:47 ctl02 nova-api[6607]: 2017-09-28 11:50:47.660 6607 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:50:47 ctl02 nova-api[6607]: 2017-09-28 11:50:47.660 6607 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:50:47 ctl02 nova-api[6607]: 2017-09-28 11:50:47.788 6607 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:50:47 ctl02 nova-api[6607]: 2017-09-28 11:50:47.790 6607 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:50:47 ctl02 nova-api[6607]: 2017-09-28 11:50:47.790 6607 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:50:47 ctl02 nova-api[6607]: 2017-09-28 11:50:47.790 6607 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:50:47 ctl02 nova-api[6607]: 2017-09-28 11:50:47.793 6607 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:50:47 ctl02 nova-api[6607]: 2017-09-28 11:50:47.794 6607 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:50:47 ctl02 nova-api[6607]: 2017-09-28 11:50:47.794 6607 ERROR nova Traceback (most recent call last):
Sep 28 11:50:47 ctl02 nova-api[6607]: 2017-09-28 11:50:47.794 6607 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:50:47 ctl02 nova-api[6607]: 2017-09-28 11:50:47.794 6607 ERROR nova     sys.exit(main())
Sep 28 11:50:47 ctl02 nova-api[6607]: 2017-09-28 11:50:47.794 6607 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:50:47 ctl02 nova-api[6607]: 2017-09-28 11:50:47.794 6607 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:50:47 ctl02 nova-api[6607]: 2017-09-28 11:50:47.794 6607 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:50:47 ctl02 nova-api[6607]: 2017-09-28 11:50:47.794 6607 ERROR nova     max_url_len=max_url_len)
Sep 28 11:50:47 ctl02 nova-api[6607]: 2017-09-28 11:50:47.794 6607 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:50:47 ctl02 nova-api[6607]: 2017-09-28 11:50:47.794 6607 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:50:47 ctl02 nova-api[6607]: 2017-09-28 11:50:47.794 6607 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:50:47 ctl02 nova-api[6607]: 2017-09-28 11:50:47.794 6607 ERROR nova     sock.listen(backlog)
Sep 28 11:50:47 ctl02 nova-api[6607]: 2017-09-28 11:50:47.794 6607 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:50:47 ctl02 nova-api[6607]: 2017-09-28 11:50:47.794 6607 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:50:47 ctl02 nova-api[6607]: 2017-09-28 11:50:47.794 6607 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:50:47 ctl02 nova-api[6607]: 2017-09-28 11:50:47.794 6607 ERROR nova
Sep 28 11:50:47 ctl02 glance-api[29183]: 2017-09-28 11:50:47.837 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:50:47] "OPTIONS / HTTP/1.0" 200 134 0.000842
Sep 28 11:50:47 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:50:47 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:50:47 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:50:48 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:50:48 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:50:48 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:50:48 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:50:49 ctl02 glance-api[29183]: 2017-09-28 11:50:49.263 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:50:49] "OPTIONS / HTTP/1.0" 200 134 0.000672
Sep 28 11:50:49 ctl02 nova-api[6625]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:50:49 ctl02 nova-api[6625]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:50:49 ctl02 nova-api[6625]: 2017-09-28 11:50:49.835 6625 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:50:49 ctl02 nova-api[6625]: 2017-09-28 11:50:49.837 6625 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:50:49 ctl02 nova-api[6625]: 2017-09-28 11:50:49.837 6625 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:50:49 ctl02 nova-api[6625]: 2017-09-28 11:50:49.837 6625 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:50:49 ctl02 nova-api[6625]: 2017-09-28 11:50:49.837 6625 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:50:49 ctl02 nova-api[6625]: 2017-09-28 11:50:49.837 6625 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:50:49 ctl02 nova-api[6625]: 2017-09-28 11:50:49.837 6625 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:50:49 ctl02 nova-api[6625]: 2017-09-28 11:50:49.837 6625 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:50:49 ctl02 nova-api[6625]: 2017-09-28 11:50:49.837 6625 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:50:49 ctl02 nova-api[6625]: 2017-09-28 11:50:49.837 6625 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:50:49 ctl02 nova-api[6625]: 2017-09-28 11:50:49.837 6625 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:50:49 ctl02 nova-api[6625]: 2017-09-28 11:50:49.837 6625 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:50:49 ctl02 nova-api[6625]: 2017-09-28 11:50:49.837 6625 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:50:49 ctl02 nova-api[6625]: 2017-09-28 11:50:49.837 6625 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:50:49 ctl02 nova-api[6625]: 2017-09-28 11:50:49.837 6625 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:50:49 ctl02 nova-api[6625]: 2017-09-28 11:50:49.837 6625 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:50:49 ctl02 nova-api[6625]: 2017-09-28 11:50:49.837 6625 ERROR nova.wsgi     self.filename))
Sep 28 11:50:49 ctl02 nova-api[6625]: 2017-09-28 11:50:49.837 6625 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:50:49 ctl02 nova-api[6625]: 2017-09-28 11:50:49.837 6625 ERROR nova.wsgi
Sep 28 11:50:49 ctl02 nova-api[6625]: 2017-09-28 11:50:49.838 6625 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:50:49 ctl02 nova-scheduler[5620]: 2017-09-28 11:50:49.898 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 20 seconds.
Sep 28 11:50:49 ctl02 nova-api[6625]: 2017-09-28 11:50:49.971 6625 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:50:50 ctl02 nova-api[6625]: 2017-09-28 11:50:50.218 6625 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:50:50 ctl02 nova-api[6625]: 2017-09-28 11:50:50.221 6625 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:50:50 ctl02 nova-api[6625]: 2017-09-28 11:50:50.221 6625 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:50:50 ctl02 nova-api[6625]: 2017-09-28 11:50:50.221 6625 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:50:50 ctl02 nova-api[6625]: 2017-09-28 11:50:50.350 6625 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:50:50 ctl02 nova-api[6625]: 2017-09-28 11:50:50.352 6625 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:50:50 ctl02 nova-api[6625]: 2017-09-28 11:50:50.352 6625 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:50:50 ctl02 nova-api[6625]: 2017-09-28 11:50:50.353 6625 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:50:50 ctl02 nova-api[6625]: 2017-09-28 11:50:50.356 6625 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:50:50 ctl02 nova-api[6625]: 2017-09-28 11:50:50.356 6625 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:50:50 ctl02 nova-api[6625]: 2017-09-28 11:50:50.356 6625 ERROR nova Traceback (most recent call last):
Sep 28 11:50:50 ctl02 nova-api[6625]: 2017-09-28 11:50:50.356 6625 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:50:50 ctl02 nova-api[6625]: 2017-09-28 11:50:50.356 6625 ERROR nova     sys.exit(main())
Sep 28 11:50:50 ctl02 nova-api[6625]: 2017-09-28 11:50:50.356 6625 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:50:50 ctl02 nova-api[6625]: 2017-09-28 11:50:50.356 6625 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:50:50 ctl02 nova-api[6625]: 2017-09-28 11:50:50.356 6625 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:50:50 ctl02 nova-api[6625]: 2017-09-28 11:50:50.356 6625 ERROR nova     max_url_len=max_url_len)
Sep 28 11:50:50 ctl02 nova-api[6625]: 2017-09-28 11:50:50.356 6625 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:50:50 ctl02 nova-api[6625]: 2017-09-28 11:50:50.356 6625 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:50:50 ctl02 nova-api[6625]: 2017-09-28 11:50:50.356 6625 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:50:50 ctl02 nova-api[6625]: 2017-09-28 11:50:50.356 6625 ERROR nova     sock.listen(backlog)
Sep 28 11:50:50 ctl02 nova-api[6625]: 2017-09-28 11:50:50.356 6625 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:50:50 ctl02 nova-api[6625]: 2017-09-28 11:50:50.356 6625 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:50:50 ctl02 nova-api[6625]: 2017-09-28 11:50:50.356 6625 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:50:50 ctl02 nova-api[6625]: 2017-09-28 11:50:50.356 6625 ERROR nova
Sep 28 11:50:50 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:50:50 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:50:50 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:50:50 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:50:50 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:50:50 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:50:50 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:50:52 ctl02 nova-api[6643]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:50:52 ctl02 nova-api[6643]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:50:52 ctl02 nova-api[6643]: 2017-09-28 11:50:52.362 6643 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:50:52 ctl02 nova-api[6643]: 2017-09-28 11:50:52.364 6643 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:50:52 ctl02 nova-api[6643]: 2017-09-28 11:50:52.364 6643 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:50:52 ctl02 nova-api[6643]: 2017-09-28 11:50:52.364 6643 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:50:52 ctl02 nova-api[6643]: 2017-09-28 11:50:52.364 6643 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:50:52 ctl02 nova-api[6643]: 2017-09-28 11:50:52.364 6643 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:50:52 ctl02 nova-api[6643]: 2017-09-28 11:50:52.364 6643 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:50:52 ctl02 nova-api[6643]: 2017-09-28 11:50:52.364 6643 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:50:52 ctl02 nova-api[6643]: 2017-09-28 11:50:52.364 6643 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:50:52 ctl02 nova-api[6643]: 2017-09-28 11:50:52.364 6643 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:50:52 ctl02 nova-api[6643]: 2017-09-28 11:50:52.364 6643 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:50:52 ctl02 nova-api[6643]: 2017-09-28 11:50:52.364 6643 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:50:52 ctl02 nova-api[6643]: 2017-09-28 11:50:52.364 6643 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:50:52 ctl02 nova-api[6643]: 2017-09-28 11:50:52.364 6643 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:50:52 ctl02 nova-api[6643]: 2017-09-28 11:50:52.364 6643 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:50:52 ctl02 nova-api[6643]: 2017-09-28 11:50:52.364 6643 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:50:52 ctl02 nova-api[6643]: 2017-09-28 11:50:52.364 6643 ERROR nova.wsgi     self.filename))
Sep 28 11:50:52 ctl02 nova-api[6643]: 2017-09-28 11:50:52.364 6643 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:50:52 ctl02 nova-api[6643]: 2017-09-28 11:50:52.364 6643 ERROR nova.wsgi
Sep 28 11:50:52 ctl02 nova-api[6643]: 2017-09-28 11:50:52.366 6643 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:50:52 ctl02 nova-api[6643]: 2017-09-28 11:50:52.499 6643 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:50:52 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x41871220)
Sep 28 11:50:52 ctl02 nova-api[6643]: 2017-09-28 11:50:52.741 6643 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:50:52 ctl02 nova-api[6643]: 2017-09-28 11:50:52.744 6643 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:50:52 ctl02 nova-api[6643]: 2017-09-28 11:50:52.744 6643 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:50:52 ctl02 nova-api[6643]: 2017-09-28 11:50:52.744 6643 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:50:52 ctl02 nova-api[6643]: 2017-09-28 11:50:52.875 6643 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:50:52 ctl02 nova-api[6643]: 2017-09-28 11:50:52.877 6643 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:50:52 ctl02 nova-api[6643]: 2017-09-28 11:50:52.878 6643 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:50:52 ctl02 nova-api[6643]: 2017-09-28 11:50:52.878 6643 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:50:52 ctl02 nova-api[6643]: 2017-09-28 11:50:52.881 6643 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:50:52 ctl02 nova-api[6643]: 2017-09-28 11:50:52.882 6643 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:50:52 ctl02 nova-api[6643]: 2017-09-28 11:50:52.882 6643 ERROR nova Traceback (most recent call last):
Sep 28 11:50:52 ctl02 nova-api[6643]: 2017-09-28 11:50:52.882 6643 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:50:52 ctl02 nova-api[6643]: 2017-09-28 11:50:52.882 6643 ERROR nova     sys.exit(main())
Sep 28 11:50:52 ctl02 nova-api[6643]: 2017-09-28 11:50:52.882 6643 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:50:52 ctl02 nova-api[6643]: 2017-09-28 11:50:52.882 6643 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:50:52 ctl02 nova-api[6643]: 2017-09-28 11:50:52.882 6643 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:50:52 ctl02 nova-api[6643]: 2017-09-28 11:50:52.882 6643 ERROR nova     max_url_len=max_url_len)
Sep 28 11:50:52 ctl02 nova-api[6643]: 2017-09-28 11:50:52.882 6643 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:50:52 ctl02 nova-api[6643]: 2017-09-28 11:50:52.882 6643 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:50:52 ctl02 nova-api[6643]: 2017-09-28 11:50:52.882 6643 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:50:52 ctl02 nova-api[6643]: 2017-09-28 11:50:52.882 6643 ERROR nova     sock.listen(backlog)
Sep 28 11:50:52 ctl02 nova-api[6643]: 2017-09-28 11:50:52.882 6643 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:50:52 ctl02 nova-api[6643]: 2017-09-28 11:50:52.882 6643 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:50:52 ctl02 nova-api[6643]: 2017-09-28 11:50:52.882 6643 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:50:52 ctl02 nova-api[6643]: 2017-09-28 11:50:52.882 6643 ERROR nova
Sep 28 11:50:53 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:50:53 ctl02 glance-api[29183]: 2017-09-28 11:50:53.040 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:50:53] "OPTIONS / HTTP/1.0" 200 134 0.000715
Sep 28 11:50:53 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:50:53 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:50:53 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:50:53 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:50:53 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:50:53 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:50:53 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x41871220)
Sep 28 11:50:54 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x41871220)
Sep 28 11:50:54 ctl02 nova-api[6663]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:50:54 ctl02 nova-api[6663]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:50:55 ctl02 nova-api[6663]: 2017-09-28 11:50:55.078 6663 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:50:55 ctl02 nova-api[6663]: 2017-09-28 11:50:55.080 6663 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:50:55 ctl02 nova-api[6663]: 2017-09-28 11:50:55.080 6663 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:50:55 ctl02 nova-api[6663]: 2017-09-28 11:50:55.080 6663 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:50:55 ctl02 nova-api[6663]: 2017-09-28 11:50:55.080 6663 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:50:55 ctl02 nova-api[6663]: 2017-09-28 11:50:55.080 6663 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:50:55 ctl02 nova-api[6663]: 2017-09-28 11:50:55.080 6663 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:50:55 ctl02 nova-api[6663]: 2017-09-28 11:50:55.080 6663 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:50:55 ctl02 nova-api[6663]: 2017-09-28 11:50:55.080 6663 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:50:55 ctl02 nova-api[6663]: 2017-09-28 11:50:55.080 6663 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:50:55 ctl02 nova-api[6663]: 2017-09-28 11:50:55.080 6663 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:50:55 ctl02 nova-api[6663]: 2017-09-28 11:50:55.080 6663 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:50:55 ctl02 nova-api[6663]: 2017-09-28 11:50:55.080 6663 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:50:55 ctl02 nova-api[6663]: 2017-09-28 11:50:55.080 6663 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:50:55 ctl02 nova-api[6663]: 2017-09-28 11:50:55.080 6663 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:50:55 ctl02 nova-api[6663]: 2017-09-28 11:50:55.080 6663 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:50:55 ctl02 nova-api[6663]: 2017-09-28 11:50:55.080 6663 ERROR nova.wsgi     self.filename))
Sep 28 11:50:55 ctl02 nova-api[6663]: 2017-09-28 11:50:55.080 6663 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:50:55 ctl02 nova-api[6663]: 2017-09-28 11:50:55.080 6663 ERROR nova.wsgi
Sep 28 11:50:55 ctl02 nova-api[6663]: 2017-09-28 11:50:55.081 6663 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:50:55 ctl02 nova-api[6663]: 2017-09-28 11:50:55.207 6663 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:50:55 ctl02 nova-api[6663]: 2017-09-28 11:50:55.432 6663 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:50:55 ctl02 nova-api[6663]: 2017-09-28 11:50:55.435 6663 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:50:55 ctl02 nova-api[6663]: 2017-09-28 11:50:55.435 6663 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:50:55 ctl02 nova-api[6663]: 2017-09-28 11:50:55.435 6663 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:50:55 ctl02 nova-api[6663]: 2017-09-28 11:50:55.563 6663 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:50:55 ctl02 nova-api[6663]: 2017-09-28 11:50:55.565 6663 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:50:55 ctl02 nova-api[6663]: 2017-09-28 11:50:55.565 6663 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:50:55 ctl02 nova-api[6663]: 2017-09-28 11:50:55.565 6663 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:50:55 ctl02 nova-api[6663]: 2017-09-28 11:50:55.569 6663 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:50:55 ctl02 nova-api[6663]: 2017-09-28 11:50:55.569 6663 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:50:55 ctl02 nova-api[6663]: 2017-09-28 11:50:55.569 6663 ERROR nova Traceback (most recent call last):
Sep 28 11:50:55 ctl02 nova-api[6663]: 2017-09-28 11:50:55.569 6663 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:50:55 ctl02 nova-api[6663]: 2017-09-28 11:50:55.569 6663 ERROR nova     sys.exit(main())
Sep 28 11:50:55 ctl02 nova-api[6663]: 2017-09-28 11:50:55.569 6663 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:50:55 ctl02 nova-api[6663]: 2017-09-28 11:50:55.569 6663 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:50:55 ctl02 nova-api[6663]: 2017-09-28 11:50:55.569 6663 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:50:55 ctl02 nova-api[6663]: 2017-09-28 11:50:55.569 6663 ERROR nova     max_url_len=max_url_len)
Sep 28 11:50:55 ctl02 nova-api[6663]: 2017-09-28 11:50:55.569 6663 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:50:55 ctl02 nova-api[6663]: 2017-09-28 11:50:55.569 6663 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:50:55 ctl02 nova-api[6663]: 2017-09-28 11:50:55.569 6663 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:50:55 ctl02 nova-api[6663]: 2017-09-28 11:50:55.569 6663 ERROR nova     sock.listen(backlog)
Sep 28 11:50:55 ctl02 nova-api[6663]: 2017-09-28 11:50:55.569 6663 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:50:55 ctl02 nova-api[6663]: 2017-09-28 11:50:55.569 6663 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:50:55 ctl02 nova-api[6663]: 2017-09-28 11:50:55.569 6663 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:50:55 ctl02 nova-api[6663]: 2017-09-28 11:50:55.569 6663 ERROR nova
Sep 28 11:50:55 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x41871220)
Sep 28 11:50:55 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:50:55 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:50:55 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:50:55 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:50:55 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:50:55 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:50:55 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:50:56 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x41871220)
Sep 28 11:50:56 ctl02 nova-cert[4860]: 2017-09-28 11:50:56.998 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 22 seconds.
Sep 28 11:50:57 ctl02 nova-api[6681]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:50:57 ctl02 nova-api[6681]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:50:57 ctl02 nova-api[6681]: 2017-09-28 11:50:57.557 6681 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:50:57 ctl02 nova-api[6681]: 2017-09-28 11:50:57.558 6681 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:50:57 ctl02 nova-api[6681]: 2017-09-28 11:50:57.558 6681 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:50:57 ctl02 nova-api[6681]: 2017-09-28 11:50:57.558 6681 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:50:57 ctl02 nova-api[6681]: 2017-09-28 11:50:57.558 6681 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:50:57 ctl02 nova-api[6681]: 2017-09-28 11:50:57.558 6681 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:50:57 ctl02 nova-api[6681]: 2017-09-28 11:50:57.558 6681 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:50:57 ctl02 nova-api[6681]: 2017-09-28 11:50:57.558 6681 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:50:57 ctl02 nova-api[6681]: 2017-09-28 11:50:57.558 6681 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:50:57 ctl02 nova-api[6681]: 2017-09-28 11:50:57.558 6681 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:50:57 ctl02 nova-api[6681]: 2017-09-28 11:50:57.558 6681 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:50:57 ctl02 nova-api[6681]: 2017-09-28 11:50:57.558 6681 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:50:57 ctl02 nova-api[6681]: 2017-09-28 11:50:57.558 6681 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:50:57 ctl02 nova-api[6681]: 2017-09-28 11:50:57.558 6681 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:50:57 ctl02 nova-api[6681]: 2017-09-28 11:50:57.558 6681 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:50:57 ctl02 nova-api[6681]: 2017-09-28 11:50:57.558 6681 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:50:57 ctl02 nova-api[6681]: 2017-09-28 11:50:57.558 6681 ERROR nova.wsgi     self.filename))
Sep 28 11:50:57 ctl02 nova-api[6681]: 2017-09-28 11:50:57.558 6681 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:50:57 ctl02 nova-api[6681]: 2017-09-28 11:50:57.558 6681 ERROR nova.wsgi
Sep 28 11:50:57 ctl02 nova-api[6681]: 2017-09-28 11:50:57.559 6681 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:50:57 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x41871220)
Sep 28 11:50:57 ctl02 nova-api[6681]: 2017-09-28 11:50:57.689 6681 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:50:57 ctl02 nova-api[6681]: 2017-09-28 11:50:57.919 6681 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:50:57 ctl02 nova-api[6681]: 2017-09-28 11:50:57.921 6681 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:50:57 ctl02 nova-api[6681]: 2017-09-28 11:50:57.922 6681 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:50:57 ctl02 nova-api[6681]: 2017-09-28 11:50:57.922 6681 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:50:58 ctl02 glance-api[29183]: 2017-09-28 11:50:58.045 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:50:58] "OPTIONS / HTTP/1.0" 200 134 0.000578
Sep 28 11:50:58 ctl02 nova-api[6681]: 2017-09-28 11:50:58.054 6681 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:50:58 ctl02 nova-api[6681]: 2017-09-28 11:50:58.056 6681 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:50:58 ctl02 nova-api[6681]: 2017-09-28 11:50:58.056 6681 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:50:58 ctl02 nova-api[6681]: 2017-09-28 11:50:58.056 6681 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:50:58 ctl02 nova-api[6681]: 2017-09-28 11:50:58.059 6681 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:50:58 ctl02 nova-api[6681]: 2017-09-28 11:50:58.060 6681 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:50:58 ctl02 nova-api[6681]: 2017-09-28 11:50:58.060 6681 ERROR nova Traceback (most recent call last):
Sep 28 11:50:58 ctl02 nova-api[6681]: 2017-09-28 11:50:58.060 6681 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:50:58 ctl02 nova-api[6681]: 2017-09-28 11:50:58.060 6681 ERROR nova     sys.exit(main())
Sep 28 11:50:58 ctl02 nova-api[6681]: 2017-09-28 11:50:58.060 6681 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:50:58 ctl02 nova-api[6681]: 2017-09-28 11:50:58.060 6681 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:50:58 ctl02 nova-api[6681]: 2017-09-28 11:50:58.060 6681 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:50:58 ctl02 nova-api[6681]: 2017-09-28 11:50:58.060 6681 ERROR nova     max_url_len=max_url_len)
Sep 28 11:50:58 ctl02 nova-api[6681]: 2017-09-28 11:50:58.060 6681 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:50:58 ctl02 nova-api[6681]: 2017-09-28 11:50:58.060 6681 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:50:58 ctl02 nova-api[6681]: 2017-09-28 11:50:58.060 6681 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:50:58 ctl02 nova-api[6681]: 2017-09-28 11:50:58.060 6681 ERROR nova     sock.listen(backlog)
Sep 28 11:50:58 ctl02 nova-api[6681]: 2017-09-28 11:50:58.060 6681 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:50:58 ctl02 nova-api[6681]: 2017-09-28 11:50:58.060 6681 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:50:58 ctl02 nova-api[6681]: 2017-09-28 11:50:58.060 6681 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:50:58 ctl02 nova-api[6681]: 2017-09-28 11:50:58.060 6681 ERROR nova
Sep 28 11:50:58 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:50:58 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:50:58 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:50:58 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:50:58 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:50:58 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:50:58 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:50:58 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x41871220)
Sep 28 11:50:59 ctl02 glance-api[29183]: 2017-09-28 11:50:59.247 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:50:59] "OPTIONS / HTTP/1.0" 200 134 0.000592
Sep 28 11:50:59 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x41871220)
Sep 28 11:50:59 ctl02 nova-api[6699]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:50:59 ctl02 nova-api[6699]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:51:00 ctl02 nova-conductor[5056]: 2017-09-28 11:51:00.070 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 22 seconds.
Sep 28 11:51:00 ctl02 nova-conductor[5056]: 2017-09-28 11:51:00.083 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 22 seconds.
Sep 28 11:51:00 ctl02 nova-api[6699]: 2017-09-28 11:51:00.092 6699 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:51:00 ctl02 nova-api[6699]: 2017-09-28 11:51:00.093 6699 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:51:00 ctl02 nova-api[6699]: 2017-09-28 11:51:00.093 6699 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:51:00 ctl02 nova-api[6699]: 2017-09-28 11:51:00.093 6699 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:51:00 ctl02 nova-api[6699]: 2017-09-28 11:51:00.093 6699 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:51:00 ctl02 nova-api[6699]: 2017-09-28 11:51:00.093 6699 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:51:00 ctl02 nova-api[6699]: 2017-09-28 11:51:00.093 6699 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:51:00 ctl02 nova-api[6699]: 2017-09-28 11:51:00.093 6699 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:51:00 ctl02 nova-api[6699]: 2017-09-28 11:51:00.093 6699 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:51:00 ctl02 nova-api[6699]: 2017-09-28 11:51:00.093 6699 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:51:00 ctl02 nova-api[6699]: 2017-09-28 11:51:00.093 6699 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:51:00 ctl02 nova-api[6699]: 2017-09-28 11:51:00.093 6699 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:51:00 ctl02 nova-api[6699]: 2017-09-28 11:51:00.093 6699 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:51:00 ctl02 nova-api[6699]: 2017-09-28 11:51:00.093 6699 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:51:00 ctl02 nova-api[6699]: 2017-09-28 11:51:00.093 6699 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:51:00 ctl02 nova-api[6699]: 2017-09-28 11:51:00.093 6699 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:51:00 ctl02 nova-api[6699]: 2017-09-28 11:51:00.093 6699 ERROR nova.wsgi     self.filename))
Sep 28 11:51:00 ctl02 nova-api[6699]: 2017-09-28 11:51:00.093 6699 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:51:00 ctl02 nova-api[6699]: 2017-09-28 11:51:00.093 6699 ERROR nova.wsgi
Sep 28 11:51:00 ctl02 nova-api[6699]: 2017-09-28 11:51:00.094 6699 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:51:00 ctl02 nova-conductor[5056]: 2017-09-28 11:51:00.100 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 22 seconds.
Sep 28 11:51:00 ctl02 nova-conductor[5056]: 2017-09-28 11:51:00.101 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 22 seconds.
Sep 28 11:51:00 ctl02 nova-api[6699]: 2017-09-28 11:51:00.238 6699 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:51:00 ctl02 nova-api[6699]: 2017-09-28 11:51:00.478 6699 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:51:00 ctl02 nova-api[6699]: 2017-09-28 11:51:00.481 6699 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:51:00 ctl02 nova-api[6699]: 2017-09-28 11:51:00.481 6699 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:51:00 ctl02 nova-api[6699]: 2017-09-28 11:51:00.481 6699 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:51:00 ctl02 nova-api[6699]: 2017-09-28 11:51:00.612 6699 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:51:00 ctl02 nova-api[6699]: 2017-09-28 11:51:00.613 6699 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:51:00 ctl02 nova-api[6699]: 2017-09-28 11:51:00.614 6699 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:51:00 ctl02 nova-api[6699]: 2017-09-28 11:51:00.614 6699 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:51:00 ctl02 nova-api[6699]: 2017-09-28 11:51:00.617 6699 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:51:00 ctl02 nova-api[6699]: 2017-09-28 11:51:00.618 6699 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:51:00 ctl02 nova-api[6699]: 2017-09-28 11:51:00.618 6699 ERROR nova Traceback (most recent call last):
Sep 28 11:51:00 ctl02 nova-api[6699]: 2017-09-28 11:51:00.618 6699 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:51:00 ctl02 nova-api[6699]: 2017-09-28 11:51:00.618 6699 ERROR nova     sys.exit(main())
Sep 28 11:51:00 ctl02 nova-api[6699]: 2017-09-28 11:51:00.618 6699 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:51:00 ctl02 nova-api[6699]: 2017-09-28 11:51:00.618 6699 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:51:00 ctl02 nova-api[6699]: 2017-09-28 11:51:00.618 6699 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:51:00 ctl02 nova-api[6699]: 2017-09-28 11:51:00.618 6699 ERROR nova     max_url_len=max_url_len)
Sep 28 11:51:00 ctl02 nova-api[6699]: 2017-09-28 11:51:00.618 6699 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:51:00 ctl02 nova-api[6699]: 2017-09-28 11:51:00.618 6699 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:51:00 ctl02 nova-api[6699]: 2017-09-28 11:51:00.618 6699 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:51:00 ctl02 nova-api[6699]: 2017-09-28 11:51:00.618 6699 ERROR nova     sock.listen(backlog)
Sep 28 11:51:00 ctl02 nova-api[6699]: 2017-09-28 11:51:00.618 6699 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:51:00 ctl02 nova-api[6699]: 2017-09-28 11:51:00.618 6699 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:51:00 ctl02 nova-api[6699]: 2017-09-28 11:51:00.618 6699 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:51:00 ctl02 nova-api[6699]: 2017-09-28 11:51:00.618 6699 ERROR nova
Sep 28 11:51:00 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x41871220)
Sep 28 11:51:00 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:51:00 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:51:00 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:51:00 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:51:00 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:51:00 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:51:00 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:51:01 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x41871220)
Sep 28 11:51:02 ctl02 nova-api[6717]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:51:02 ctl02 nova-api[6717]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:51:02 ctl02 nova-api[6717]: 2017-09-28 11:51:02.553 6717 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:51:02 ctl02 nova-api[6717]: 2017-09-28 11:51:02.555 6717 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:51:02 ctl02 nova-api[6717]: 2017-09-28 11:51:02.555 6717 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:51:02 ctl02 nova-api[6717]: 2017-09-28 11:51:02.555 6717 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:51:02 ctl02 nova-api[6717]: 2017-09-28 11:51:02.555 6717 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:51:02 ctl02 nova-api[6717]: 2017-09-28 11:51:02.555 6717 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:51:02 ctl02 nova-api[6717]: 2017-09-28 11:51:02.555 6717 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:51:02 ctl02 nova-api[6717]: 2017-09-28 11:51:02.555 6717 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:51:02 ctl02 nova-api[6717]: 2017-09-28 11:51:02.555 6717 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:51:02 ctl02 nova-api[6717]: 2017-09-28 11:51:02.555 6717 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:51:02 ctl02 nova-api[6717]: 2017-09-28 11:51:02.555 6717 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:51:02 ctl02 nova-api[6717]: 2017-09-28 11:51:02.555 6717 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:51:02 ctl02 nova-api[6717]: 2017-09-28 11:51:02.555 6717 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:51:02 ctl02 nova-api[6717]: 2017-09-28 11:51:02.555 6717 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:51:02 ctl02 nova-api[6717]: 2017-09-28 11:51:02.555 6717 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:51:02 ctl02 nova-api[6717]: 2017-09-28 11:51:02.555 6717 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:51:02 ctl02 nova-api[6717]: 2017-09-28 11:51:02.555 6717 ERROR nova.wsgi     self.filename))
Sep 28 11:51:02 ctl02 nova-api[6717]: 2017-09-28 11:51:02.555 6717 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:51:02 ctl02 nova-api[6717]: 2017-09-28 11:51:02.555 6717 ERROR nova.wsgi
Sep 28 11:51:02 ctl02 nova-api[6717]: 2017-09-28 11:51:02.557 6717 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:51:02 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x41871220)
Sep 28 11:51:02 ctl02 nova-api[6717]: 2017-09-28 11:51:02.685 6717 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:51:02 ctl02 nova-api[6717]: 2017-09-28 11:51:02.916 6717 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:51:02 ctl02 nova-api[6717]: 2017-09-28 11:51:02.918 6717 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:51:02 ctl02 nova-api[6717]: 2017-09-28 11:51:02.919 6717 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:51:02 ctl02 nova-api[6717]: 2017-09-28 11:51:02.919 6717 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:51:03 ctl02 glance-api[29183]: 2017-09-28 11:51:03.004 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:51:03] "OPTIONS / HTTP/1.0" 200 134 0.000672
Sep 28 11:51:03 ctl02 nova-api[6717]: 2017-09-28 11:51:03.050 6717 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:51:03 ctl02 nova-api[6717]: 2017-09-28 11:51:03.053 6717 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:51:03 ctl02 nova-api[6717]: 2017-09-28 11:51:03.053 6717 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:51:03 ctl02 nova-api[6717]: 2017-09-28 11:51:03.053 6717 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:51:03 ctl02 nova-api[6717]: 2017-09-28 11:51:03.057 6717 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:51:03 ctl02 nova-api[6717]: 2017-09-28 11:51:03.057 6717 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:51:03 ctl02 nova-api[6717]: 2017-09-28 11:51:03.057 6717 ERROR nova Traceback (most recent call last):
Sep 28 11:51:03 ctl02 nova-api[6717]: 2017-09-28 11:51:03.057 6717 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:51:03 ctl02 nova-api[6717]: 2017-09-28 11:51:03.057 6717 ERROR nova     sys.exit(main())
Sep 28 11:51:03 ctl02 nova-api[6717]: 2017-09-28 11:51:03.057 6717 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:51:03 ctl02 nova-api[6717]: 2017-09-28 11:51:03.057 6717 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:51:03 ctl02 nova-api[6717]: 2017-09-28 11:51:03.057 6717 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:51:03 ctl02 nova-api[6717]: 2017-09-28 11:51:03.057 6717 ERROR nova     max_url_len=max_url_len)
Sep 28 11:51:03 ctl02 nova-api[6717]: 2017-09-28 11:51:03.057 6717 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:51:03 ctl02 nova-api[6717]: 2017-09-28 11:51:03.057 6717 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:51:03 ctl02 nova-api[6717]: 2017-09-28 11:51:03.057 6717 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:51:03 ctl02 nova-api[6717]: 2017-09-28 11:51:03.057 6717 ERROR nova     sock.listen(backlog)
Sep 28 11:51:03 ctl02 nova-api[6717]: 2017-09-28 11:51:03.057 6717 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:51:03 ctl02 nova-api[6717]: 2017-09-28 11:51:03.057 6717 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:51:03 ctl02 nova-api[6717]: 2017-09-28 11:51:03.057 6717 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:51:03 ctl02 nova-api[6717]: 2017-09-28 11:51:03.057 6717 ERROR nova
Sep 28 11:51:03 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:51:03 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:51:03 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:51:03 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:51:03 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:51:03 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:51:03 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:51:03 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:51:03 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:51:04 ctl02 nova-api[6735]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:51:04 ctl02 nova-api[6735]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:51:05 ctl02 nova-api[6735]: 2017-09-28 11:51:05.064 6735 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:51:05 ctl02 nova-api[6735]: 2017-09-28 11:51:05.082 6735 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:51:05 ctl02 nova-api[6735]: 2017-09-28 11:51:05.082 6735 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:51:05 ctl02 nova-api[6735]: 2017-09-28 11:51:05.082 6735 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:51:05 ctl02 nova-api[6735]: 2017-09-28 11:51:05.082 6735 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:51:05 ctl02 nova-api[6735]: 2017-09-28 11:51:05.082 6735 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:51:05 ctl02 nova-api[6735]: 2017-09-28 11:51:05.082 6735 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:51:05 ctl02 nova-api[6735]: 2017-09-28 11:51:05.082 6735 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:51:05 ctl02 nova-api[6735]: 2017-09-28 11:51:05.082 6735 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:51:05 ctl02 nova-api[6735]: 2017-09-28 11:51:05.082 6735 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:51:05 ctl02 nova-api[6735]: 2017-09-28 11:51:05.082 6735 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:51:05 ctl02 nova-api[6735]: 2017-09-28 11:51:05.082 6735 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:51:05 ctl02 nova-api[6735]: 2017-09-28 11:51:05.082 6735 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:51:05 ctl02 nova-api[6735]: 2017-09-28 11:51:05.082 6735 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:51:05 ctl02 nova-api[6735]: 2017-09-28 11:51:05.082 6735 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:51:05 ctl02 nova-api[6735]: 2017-09-28 11:51:05.082 6735 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:51:05 ctl02 nova-api[6735]: 2017-09-28 11:51:05.082 6735 ERROR nova.wsgi     self.filename))
Sep 28 11:51:05 ctl02 nova-api[6735]: 2017-09-28 11:51:05.082 6735 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:51:05 ctl02 nova-api[6735]: 2017-09-28 11:51:05.082 6735 ERROR nova.wsgi
Sep 28 11:51:05 ctl02 nova-api[6735]: 2017-09-28 11:51:05.083 6735 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:51:05 ctl02 nova-api[6735]: 2017-09-28 11:51:05.214 6735 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:51:05 ctl02 nova-api[6735]: 2017-09-28 11:51:05.445 6735 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:51:05 ctl02 nova-api[6735]: 2017-09-28 11:51:05.447 6735 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:51:05 ctl02 nova-api[6735]: 2017-09-28 11:51:05.447 6735 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:51:05 ctl02 nova-api[6735]: 2017-09-28 11:51:05.447 6735 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:51:05 ctl02 nova-api[6735]: 2017-09-28 11:51:05.578 6735 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:51:05 ctl02 nova-api[6735]: 2017-09-28 11:51:05.580 6735 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:51:05 ctl02 nova-api[6735]: 2017-09-28 11:51:05.580 6735 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:51:05 ctl02 nova-api[6735]: 2017-09-28 11:51:05.581 6735 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:51:05 ctl02 nova-api[6735]: 2017-09-28 11:51:05.584 6735 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:51:05 ctl02 nova-api[6735]: 2017-09-28 11:51:05.584 6735 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:51:05 ctl02 nova-api[6735]: 2017-09-28 11:51:05.584 6735 ERROR nova Traceback (most recent call last):
Sep 28 11:51:05 ctl02 nova-api[6735]: 2017-09-28 11:51:05.584 6735 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:51:05 ctl02 nova-api[6735]: 2017-09-28 11:51:05.584 6735 ERROR nova     sys.exit(main())
Sep 28 11:51:05 ctl02 nova-api[6735]: 2017-09-28 11:51:05.584 6735 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:51:05 ctl02 nova-api[6735]: 2017-09-28 11:51:05.584 6735 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:51:05 ctl02 nova-api[6735]: 2017-09-28 11:51:05.584 6735 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:51:05 ctl02 nova-api[6735]: 2017-09-28 11:51:05.584 6735 ERROR nova     max_url_len=max_url_len)
Sep 28 11:51:05 ctl02 nova-api[6735]: 2017-09-28 11:51:05.584 6735 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:51:05 ctl02 nova-api[6735]: 2017-09-28 11:51:05.584 6735 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:51:05 ctl02 nova-api[6735]: 2017-09-28 11:51:05.584 6735 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:51:05 ctl02 nova-api[6735]: 2017-09-28 11:51:05.584 6735 ERROR nova     sock.listen(backlog)
Sep 28 11:51:05 ctl02 nova-api[6735]: 2017-09-28 11:51:05.584 6735 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:51:05 ctl02 nova-api[6735]: 2017-09-28 11:51:05.584 6735 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:51:05 ctl02 nova-api[6735]: 2017-09-28 11:51:05.584 6735 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:51:05 ctl02 nova-api[6735]: 2017-09-28 11:51:05.584 6735 ERROR nova
Sep 28 11:51:05 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:51:05 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:51:05 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:51:05 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:51:05 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:51:05 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:51:05 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:51:06 ctl02 nova-consoleauth[5433]: 2017-09-28 11:51:06.904 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 22 seconds.
Sep 28 11:51:07 ctl02 nova-api[6758]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:51:07 ctl02 nova-api[6758]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:51:07 ctl02 nova-api[6758]: 2017-09-28 11:51:07.556 6758 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:51:07 ctl02 nova-api[6758]: 2017-09-28 11:51:07.558 6758 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:51:07 ctl02 nova-api[6758]: 2017-09-28 11:51:07.558 6758 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:51:07 ctl02 nova-api[6758]: 2017-09-28 11:51:07.558 6758 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:51:07 ctl02 nova-api[6758]: 2017-09-28 11:51:07.558 6758 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:51:07 ctl02 nova-api[6758]: 2017-09-28 11:51:07.558 6758 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:51:07 ctl02 nova-api[6758]: 2017-09-28 11:51:07.558 6758 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:51:07 ctl02 nova-api[6758]: 2017-09-28 11:51:07.558 6758 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:51:07 ctl02 nova-api[6758]: 2017-09-28 11:51:07.558 6758 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:51:07 ctl02 nova-api[6758]: 2017-09-28 11:51:07.558 6758 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:51:07 ctl02 nova-api[6758]: 2017-09-28 11:51:07.558 6758 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:51:07 ctl02 nova-api[6758]: 2017-09-28 11:51:07.558 6758 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:51:07 ctl02 nova-api[6758]: 2017-09-28 11:51:07.558 6758 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:51:07 ctl02 nova-api[6758]: 2017-09-28 11:51:07.558 6758 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:51:07 ctl02 nova-api[6758]: 2017-09-28 11:51:07.558 6758 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:51:07 ctl02 nova-api[6758]: 2017-09-28 11:51:07.558 6758 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:51:07 ctl02 nova-api[6758]: 2017-09-28 11:51:07.558 6758 ERROR nova.wsgi     self.filename))
Sep 28 11:51:07 ctl02 nova-api[6758]: 2017-09-28 11:51:07.558 6758 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:51:07 ctl02 nova-api[6758]: 2017-09-28 11:51:07.558 6758 ERROR nova.wsgi
Sep 28 11:51:07 ctl02 nova-api[6758]: 2017-09-28 11:51:07.560 6758 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:51:07 ctl02 nova-api[6758]: 2017-09-28 11:51:07.702 6758 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:51:07 ctl02 nova-api[6758]: 2017-09-28 11:51:07.941 6758 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:51:07 ctl02 nova-api[6758]: 2017-09-28 11:51:07.944 6758 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:51:07 ctl02 nova-api[6758]: 2017-09-28 11:51:07.944 6758 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:51:07 ctl02 nova-api[6758]: 2017-09-28 11:51:07.945 6758 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:51:07 ctl02 glance-api[29183]: 2017-09-28 11:51:07.985 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:51:07] "OPTIONS / HTTP/1.0" 200 134 0.000781
Sep 28 11:51:08 ctl02 nova-api[6758]: 2017-09-28 11:51:08.075 6758 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:51:08 ctl02 nova-api[6758]: 2017-09-28 11:51:08.076 6758 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:51:08 ctl02 nova-api[6758]: 2017-09-28 11:51:08.077 6758 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:51:08 ctl02 nova-api[6758]: 2017-09-28 11:51:08.077 6758 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:51:08 ctl02 nova-api[6758]: 2017-09-28 11:51:08.080 6758 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:51:08 ctl02 nova-api[6758]: 2017-09-28 11:51:08.080 6758 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:51:08 ctl02 nova-api[6758]: 2017-09-28 11:51:08.080 6758 ERROR nova Traceback (most recent call last):
Sep 28 11:51:08 ctl02 nova-api[6758]: 2017-09-28 11:51:08.080 6758 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:51:08 ctl02 nova-api[6758]: 2017-09-28 11:51:08.080 6758 ERROR nova     sys.exit(main())
Sep 28 11:51:08 ctl02 nova-api[6758]: 2017-09-28 11:51:08.080 6758 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:51:08 ctl02 nova-api[6758]: 2017-09-28 11:51:08.080 6758 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:51:08 ctl02 nova-api[6758]: 2017-09-28 11:51:08.080 6758 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:51:08 ctl02 nova-api[6758]: 2017-09-28 11:51:08.080 6758 ERROR nova     max_url_len=max_url_len)
Sep 28 11:51:08 ctl02 nova-api[6758]: 2017-09-28 11:51:08.080 6758 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:51:08 ctl02 nova-api[6758]: 2017-09-28 11:51:08.080 6758 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:51:08 ctl02 nova-api[6758]: 2017-09-28 11:51:08.080 6758 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:51:08 ctl02 nova-api[6758]: 2017-09-28 11:51:08.080 6758 ERROR nova     sock.listen(backlog)
Sep 28 11:51:08 ctl02 nova-api[6758]: 2017-09-28 11:51:08.080 6758 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:51:08 ctl02 nova-api[6758]: 2017-09-28 11:51:08.080 6758 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:51:08 ctl02 nova-api[6758]: 2017-09-28 11:51:08.080 6758 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:51:08 ctl02 nova-api[6758]: 2017-09-28 11:51:08.080 6758 ERROR nova
Sep 28 11:51:08 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:51:08 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:51:08 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:51:08 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:51:08 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:51:08 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:51:08 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:51:09 ctl02 glance-api[29183]: 2017-09-28 11:51:09.226 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:51:09] "OPTIONS / HTTP/1.0" 200 134 0.000583
Sep 28 11:51:09 ctl02 nova-scheduler[5620]: 2017-09-28 11:51:09.923 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 22 seconds.
Sep 28 11:51:09 ctl02 nova-api[6775]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:51:09 ctl02 nova-api[6775]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:51:10 ctl02 nova-api[6775]: 2017-09-28 11:51:10.143 6775 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:51:10 ctl02 nova-api[6775]: 2017-09-28 11:51:10.144 6775 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:51:10 ctl02 nova-api[6775]: 2017-09-28 11:51:10.144 6775 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:51:10 ctl02 nova-api[6775]: 2017-09-28 11:51:10.144 6775 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:51:10 ctl02 nova-api[6775]: 2017-09-28 11:51:10.144 6775 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:51:10 ctl02 nova-api[6775]: 2017-09-28 11:51:10.144 6775 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:51:10 ctl02 nova-api[6775]: 2017-09-28 11:51:10.144 6775 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:51:10 ctl02 nova-api[6775]: 2017-09-28 11:51:10.144 6775 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:51:10 ctl02 nova-api[6775]: 2017-09-28 11:51:10.144 6775 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:51:10 ctl02 nova-api[6775]: 2017-09-28 11:51:10.144 6775 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:51:10 ctl02 nova-api[6775]: 2017-09-28 11:51:10.144 6775 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:51:10 ctl02 nova-api[6775]: 2017-09-28 11:51:10.144 6775 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:51:10 ctl02 nova-api[6775]: 2017-09-28 11:51:10.144 6775 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:51:10 ctl02 nova-api[6775]: 2017-09-28 11:51:10.144 6775 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:51:10 ctl02 nova-api[6775]: 2017-09-28 11:51:10.144 6775 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:51:10 ctl02 nova-api[6775]: 2017-09-28 11:51:10.144 6775 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:51:10 ctl02 nova-api[6775]: 2017-09-28 11:51:10.144 6775 ERROR nova.wsgi     self.filename))
Sep 28 11:51:10 ctl02 nova-api[6775]: 2017-09-28 11:51:10.144 6775 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:51:10 ctl02 nova-api[6775]: 2017-09-28 11:51:10.144 6775 ERROR nova.wsgi
Sep 28 11:51:10 ctl02 nova-api[6775]: 2017-09-28 11:51:10.151 6775 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:51:10 ctl02 nova-api[6775]: 2017-09-28 11:51:10.282 6775 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:51:10 ctl02 nova-api[6775]: 2017-09-28 11:51:10.525 6775 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:51:10 ctl02 nova-api[6775]: 2017-09-28 11:51:10.527 6775 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:51:10 ctl02 nova-api[6775]: 2017-09-28 11:51:10.527 6775 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:51:10 ctl02 nova-api[6775]: 2017-09-28 11:51:10.527 6775 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:51:10 ctl02 nova-api[6775]: 2017-09-28 11:51:10.658 6775 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:51:10 ctl02 nova-api[6775]: 2017-09-28 11:51:10.660 6775 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:51:10 ctl02 nova-api[6775]: 2017-09-28 11:51:10.660 6775 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:51:10 ctl02 nova-api[6775]: 2017-09-28 11:51:10.660 6775 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:51:10 ctl02 nova-api[6775]: 2017-09-28 11:51:10.664 6775 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:51:10 ctl02 nova-api[6775]: 2017-09-28 11:51:10.664 6775 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:51:10 ctl02 nova-api[6775]: 2017-09-28 11:51:10.664 6775 ERROR nova Traceback (most recent call last):
Sep 28 11:51:10 ctl02 nova-api[6775]: 2017-09-28 11:51:10.664 6775 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:51:10 ctl02 nova-api[6775]: 2017-09-28 11:51:10.664 6775 ERROR nova     sys.exit(main())
Sep 28 11:51:10 ctl02 nova-api[6775]: 2017-09-28 11:51:10.664 6775 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:51:10 ctl02 nova-api[6775]: 2017-09-28 11:51:10.664 6775 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:51:10 ctl02 nova-api[6775]: 2017-09-28 11:51:10.664 6775 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:51:10 ctl02 nova-api[6775]: 2017-09-28 11:51:10.664 6775 ERROR nova     max_url_len=max_url_len)
Sep 28 11:51:10 ctl02 nova-api[6775]: 2017-09-28 11:51:10.664 6775 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:51:10 ctl02 nova-api[6775]: 2017-09-28 11:51:10.664 6775 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:51:10 ctl02 nova-api[6775]: 2017-09-28 11:51:10.664 6775 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:51:10 ctl02 nova-api[6775]: 2017-09-28 11:51:10.664 6775 ERROR nova     sock.listen(backlog)
Sep 28 11:51:10 ctl02 nova-api[6775]: 2017-09-28 11:51:10.664 6775 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:51:10 ctl02 nova-api[6775]: 2017-09-28 11:51:10.664 6775 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:51:10 ctl02 nova-api[6775]: 2017-09-28 11:51:10.664 6775 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:51:10 ctl02 nova-api[6775]: 2017-09-28 11:51:10.664 6775 ERROR nova
Sep 28 11:51:10 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:51:10 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:51:10 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:51:11 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:51:11 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:51:11 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:51:11 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:51:12 ctl02 nova-api[6793]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:51:12 ctl02 nova-api[6793]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:51:12 ctl02 nova-api[6793]: 2017-09-28 11:51:12.806 6793 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:51:12 ctl02 nova-api[6793]: 2017-09-28 11:51:12.808 6793 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:51:12 ctl02 nova-api[6793]: 2017-09-28 11:51:12.808 6793 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:51:12 ctl02 nova-api[6793]: 2017-09-28 11:51:12.808 6793 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:51:12 ctl02 nova-api[6793]: 2017-09-28 11:51:12.808 6793 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:51:12 ctl02 nova-api[6793]: 2017-09-28 11:51:12.808 6793 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:51:12 ctl02 nova-api[6793]: 2017-09-28 11:51:12.808 6793 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:51:12 ctl02 nova-api[6793]: 2017-09-28 11:51:12.808 6793 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:51:12 ctl02 nova-api[6793]: 2017-09-28 11:51:12.808 6793 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:51:12 ctl02 nova-api[6793]: 2017-09-28 11:51:12.808 6793 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:51:12 ctl02 nova-api[6793]: 2017-09-28 11:51:12.808 6793 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:51:12 ctl02 nova-api[6793]: 2017-09-28 11:51:12.808 6793 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:51:12 ctl02 nova-api[6793]: 2017-09-28 11:51:12.808 6793 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:51:12 ctl02 nova-api[6793]: 2017-09-28 11:51:12.808 6793 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:51:12 ctl02 nova-api[6793]: 2017-09-28 11:51:12.808 6793 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:51:12 ctl02 nova-api[6793]: 2017-09-28 11:51:12.808 6793 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:51:12 ctl02 nova-api[6793]: 2017-09-28 11:51:12.808 6793 ERROR nova.wsgi     self.filename))
Sep 28 11:51:12 ctl02 nova-api[6793]: 2017-09-28 11:51:12.808 6793 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:51:12 ctl02 nova-api[6793]: 2017-09-28 11:51:12.808 6793 ERROR nova.wsgi
Sep 28 11:51:12 ctl02 nova-api[6793]: 2017-09-28 11:51:12.810 6793 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:51:12 ctl02 nova-api[6793]: 2017-09-28 11:51:12.938 6793 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:51:13 ctl02 nova-api[6793]: 2017-09-28 11:51:13.173 6793 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:51:13 ctl02 nova-api[6793]: 2017-09-28 11:51:13.176 6793 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:51:13 ctl02 nova-api[6793]: 2017-09-28 11:51:13.176 6793 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:51:13 ctl02 nova-api[6793]: 2017-09-28 11:51:13.177 6793 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:51:13 ctl02 glance-api[29183]: 2017-09-28 11:51:13.193 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:51:13] "OPTIONS / HTTP/1.0" 200 134 0.000545
Sep 28 11:51:13 ctl02 nova-api[6793]: 2017-09-28 11:51:13.308 6793 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:51:13 ctl02 nova-api[6793]: 2017-09-28 11:51:13.311 6793 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:51:13 ctl02 nova-api[6793]: 2017-09-28 11:51:13.311 6793 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:51:13 ctl02 nova-api[6793]: 2017-09-28 11:51:13.312 6793 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:51:13 ctl02 nova-api[6793]: 2017-09-28 11:51:13.315 6793 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:51:13 ctl02 nova-api[6793]: 2017-09-28 11:51:13.315 6793 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:51:13 ctl02 nova-api[6793]: 2017-09-28 11:51:13.315 6793 ERROR nova Traceback (most recent call last):
Sep 28 11:51:13 ctl02 nova-api[6793]: 2017-09-28 11:51:13.315 6793 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:51:13 ctl02 nova-api[6793]: 2017-09-28 11:51:13.315 6793 ERROR nova     sys.exit(main())
Sep 28 11:51:13 ctl02 nova-api[6793]: 2017-09-28 11:51:13.315 6793 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:51:13 ctl02 nova-api[6793]: 2017-09-28 11:51:13.315 6793 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:51:13 ctl02 nova-api[6793]: 2017-09-28 11:51:13.315 6793 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:51:13 ctl02 nova-api[6793]: 2017-09-28 11:51:13.315 6793 ERROR nova     max_url_len=max_url_len)
Sep 28 11:51:13 ctl02 nova-api[6793]: 2017-09-28 11:51:13.315 6793 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:51:13 ctl02 nova-api[6793]: 2017-09-28 11:51:13.315 6793 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:51:13 ctl02 nova-api[6793]: 2017-09-28 11:51:13.315 6793 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:51:13 ctl02 nova-api[6793]: 2017-09-28 11:51:13.315 6793 ERROR nova     sock.listen(backlog)
Sep 28 11:51:13 ctl02 nova-api[6793]: 2017-09-28 11:51:13.315 6793 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:51:13 ctl02 nova-api[6793]: 2017-09-28 11:51:13.315 6793 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:51:13 ctl02 nova-api[6793]: 2017-09-28 11:51:13.315 6793 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:51:13 ctl02 nova-api[6793]: 2017-09-28 11:51:13.315 6793 ERROR nova
Sep 28 11:51:13 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:51:13 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:51:13 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:51:13 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:51:13 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:51:13 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:51:13 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:51:15 ctl02 nova-api[6812]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:51:15 ctl02 nova-api[6812]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:51:15 ctl02 nova-api[6812]: 2017-09-28 11:51:15.304 6812 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:51:15 ctl02 nova-api[6812]: 2017-09-28 11:51:15.305 6812 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:51:15 ctl02 nova-api[6812]: 2017-09-28 11:51:15.305 6812 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:51:15 ctl02 nova-api[6812]: 2017-09-28 11:51:15.305 6812 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:51:15 ctl02 nova-api[6812]: 2017-09-28 11:51:15.305 6812 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:51:15 ctl02 nova-api[6812]: 2017-09-28 11:51:15.305 6812 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:51:15 ctl02 nova-api[6812]: 2017-09-28 11:51:15.305 6812 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:51:15 ctl02 nova-api[6812]: 2017-09-28 11:51:15.305 6812 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:51:15 ctl02 nova-api[6812]: 2017-09-28 11:51:15.305 6812 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:51:15 ctl02 nova-api[6812]: 2017-09-28 11:51:15.305 6812 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:51:15 ctl02 nova-api[6812]: 2017-09-28 11:51:15.305 6812 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:51:15 ctl02 nova-api[6812]: 2017-09-28 11:51:15.305 6812 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:51:15 ctl02 nova-api[6812]: 2017-09-28 11:51:15.305 6812 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:51:15 ctl02 nova-api[6812]: 2017-09-28 11:51:15.305 6812 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:51:15 ctl02 nova-api[6812]: 2017-09-28 11:51:15.305 6812 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:51:15 ctl02 nova-api[6812]: 2017-09-28 11:51:15.305 6812 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:51:15 ctl02 nova-api[6812]: 2017-09-28 11:51:15.305 6812 ERROR nova.wsgi     self.filename))
Sep 28 11:51:15 ctl02 nova-api[6812]: 2017-09-28 11:51:15.305 6812 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:51:15 ctl02 nova-api[6812]: 2017-09-28 11:51:15.305 6812 ERROR nova.wsgi
Sep 28 11:51:15 ctl02 nova-api[6812]: 2017-09-28 11:51:15.320 6812 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:51:15 ctl02 nova-api[6812]: 2017-09-28 11:51:15.453 6812 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:51:15 ctl02 nova-api[6812]: 2017-09-28 11:51:15.692 6812 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:51:15 ctl02 nova-api[6812]: 2017-09-28 11:51:15.694 6812 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:51:15 ctl02 nova-api[6812]: 2017-09-28 11:51:15.694 6812 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:51:15 ctl02 nova-api[6812]: 2017-09-28 11:51:15.694 6812 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:51:15 ctl02 nova-api[6812]: 2017-09-28 11:51:15.825 6812 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:51:15 ctl02 nova-api[6812]: 2017-09-28 11:51:15.826 6812 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:51:15 ctl02 nova-api[6812]: 2017-09-28 11:51:15.827 6812 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:51:15 ctl02 nova-api[6812]: 2017-09-28 11:51:15.827 6812 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:51:15 ctl02 nova-api[6812]: 2017-09-28 11:51:15.830 6812 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:51:15 ctl02 nova-api[6812]: 2017-09-28 11:51:15.831 6812 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:51:15 ctl02 nova-api[6812]: 2017-09-28 11:51:15.831 6812 ERROR nova Traceback (most recent call last):
Sep 28 11:51:15 ctl02 nova-api[6812]: 2017-09-28 11:51:15.831 6812 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:51:15 ctl02 nova-api[6812]: 2017-09-28 11:51:15.831 6812 ERROR nova     sys.exit(main())
Sep 28 11:51:15 ctl02 nova-api[6812]: 2017-09-28 11:51:15.831 6812 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:51:15 ctl02 nova-api[6812]: 2017-09-28 11:51:15.831 6812 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:51:15 ctl02 nova-api[6812]: 2017-09-28 11:51:15.831 6812 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:51:15 ctl02 nova-api[6812]: 2017-09-28 11:51:15.831 6812 ERROR nova     max_url_len=max_url_len)
Sep 28 11:51:15 ctl02 nova-api[6812]: 2017-09-28 11:51:15.831 6812 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:51:15 ctl02 nova-api[6812]: 2017-09-28 11:51:15.831 6812 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:51:15 ctl02 nova-api[6812]: 2017-09-28 11:51:15.831 6812 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:51:15 ctl02 nova-api[6812]: 2017-09-28 11:51:15.831 6812 ERROR nova     sock.listen(backlog)
Sep 28 11:51:15 ctl02 nova-api[6812]: 2017-09-28 11:51:15.831 6812 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:51:15 ctl02 nova-api[6812]: 2017-09-28 11:51:15.831 6812 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:51:15 ctl02 nova-api[6812]: 2017-09-28 11:51:15.831 6812 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:51:15 ctl02 nova-api[6812]: 2017-09-28 11:51:15.831 6812 ERROR nova
Sep 28 11:51:15 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:51:15 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:51:15 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:51:16 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:51:16 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:51:16 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:51:16 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:51:17 ctl02 nova-api[6829]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:51:17 ctl02 nova-api[6829]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:51:17 ctl02 nova-api[6829]: 2017-09-28 11:51:17.823 6829 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:51:17 ctl02 nova-api[6829]: 2017-09-28 11:51:17.825 6829 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:51:17 ctl02 nova-api[6829]: 2017-09-28 11:51:17.825 6829 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:51:17 ctl02 nova-api[6829]: 2017-09-28 11:51:17.825 6829 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:51:17 ctl02 nova-api[6829]: 2017-09-28 11:51:17.825 6829 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:51:17 ctl02 nova-api[6829]: 2017-09-28 11:51:17.825 6829 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:51:17 ctl02 nova-api[6829]: 2017-09-28 11:51:17.825 6829 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:51:17 ctl02 nova-api[6829]: 2017-09-28 11:51:17.825 6829 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:51:17 ctl02 nova-api[6829]: 2017-09-28 11:51:17.825 6829 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:51:17 ctl02 nova-api[6829]: 2017-09-28 11:51:17.825 6829 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:51:17 ctl02 nova-api[6829]: 2017-09-28 11:51:17.825 6829 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:51:17 ctl02 nova-api[6829]: 2017-09-28 11:51:17.825 6829 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:51:17 ctl02 nova-api[6829]: 2017-09-28 11:51:17.825 6829 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:51:17 ctl02 nova-api[6829]: 2017-09-28 11:51:17.825 6829 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:51:17 ctl02 nova-api[6829]: 2017-09-28 11:51:17.825 6829 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:51:17 ctl02 nova-api[6829]: 2017-09-28 11:51:17.825 6829 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:51:17 ctl02 nova-api[6829]: 2017-09-28 11:51:17.825 6829 ERROR nova.wsgi     self.filename))
Sep 28 11:51:17 ctl02 nova-api[6829]: 2017-09-28 11:51:17.825 6829 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:51:17 ctl02 nova-api[6829]: 2017-09-28 11:51:17.825 6829 ERROR nova.wsgi
Sep 28 11:51:17 ctl02 nova-api[6829]: 2017-09-28 11:51:17.826 6829 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:51:17 ctl02 nova-api[6829]: 2017-09-28 11:51:17.958 6829 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:51:18 ctl02 glance-api[29183]: 2017-09-28 11:51:18.119 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:51:18] "OPTIONS / HTTP/1.0" 200 134 0.001024
Sep 28 11:51:18 ctl02 nova-api[6829]: 2017-09-28 11:51:18.203 6829 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:51:18 ctl02 nova-api[6829]: 2017-09-28 11:51:18.206 6829 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:51:18 ctl02 nova-api[6829]: 2017-09-28 11:51:18.206 6829 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:51:18 ctl02 nova-api[6829]: 2017-09-28 11:51:18.206 6829 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:51:18 ctl02 nova-api[6829]: 2017-09-28 11:51:18.337 6829 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:51:18 ctl02 nova-api[6829]: 2017-09-28 11:51:18.339 6829 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:51:18 ctl02 nova-api[6829]: 2017-09-28 11:51:18.339 6829 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:51:18 ctl02 nova-api[6829]: 2017-09-28 11:51:18.340 6829 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:51:18 ctl02 nova-api[6829]: 2017-09-28 11:51:18.343 6829 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:51:18 ctl02 nova-api[6829]: 2017-09-28 11:51:18.343 6829 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:51:18 ctl02 nova-api[6829]: 2017-09-28 11:51:18.343 6829 ERROR nova Traceback (most recent call last):
Sep 28 11:51:18 ctl02 nova-api[6829]: 2017-09-28 11:51:18.343 6829 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:51:18 ctl02 nova-api[6829]: 2017-09-28 11:51:18.343 6829 ERROR nova     sys.exit(main())
Sep 28 11:51:18 ctl02 nova-api[6829]: 2017-09-28 11:51:18.343 6829 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:51:18 ctl02 nova-api[6829]: 2017-09-28 11:51:18.343 6829 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:51:18 ctl02 nova-api[6829]: 2017-09-28 11:51:18.343 6829 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:51:18 ctl02 nova-api[6829]: 2017-09-28 11:51:18.343 6829 ERROR nova     max_url_len=max_url_len)
Sep 28 11:51:18 ctl02 nova-api[6829]: 2017-09-28 11:51:18.343 6829 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:51:18 ctl02 nova-api[6829]: 2017-09-28 11:51:18.343 6829 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:51:18 ctl02 nova-api[6829]: 2017-09-28 11:51:18.343 6829 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:51:18 ctl02 nova-api[6829]: 2017-09-28 11:51:18.343 6829 ERROR nova     sock.listen(backlog)
Sep 28 11:51:18 ctl02 nova-api[6829]: 2017-09-28 11:51:18.343 6829 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:51:18 ctl02 nova-api[6829]: 2017-09-28 11:51:18.343 6829 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:51:18 ctl02 nova-api[6829]: 2017-09-28 11:51:18.343 6829 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:51:18 ctl02 nova-api[6829]: 2017-09-28 11:51:18.343 6829 ERROR nova
Sep 28 11:51:18 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:51:18 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:51:18 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:51:18 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:51:18 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:51:18 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:51:18 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:51:19 ctl02 nova-cert[4860]: 2017-09-28 11:51:19.027 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 24 seconds.
Sep 28 11:51:19 ctl02 glance-api[29183]: 2017-09-28 11:51:19.183 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:51:19] "OPTIONS / HTTP/1.0" 200 134 0.000616
Sep 28 11:51:20 ctl02 nova-api[6847]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:51:20 ctl02 nova-api[6847]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:51:20 ctl02 nova-api[6847]: 2017-09-28 11:51:20.361 6847 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:51:20 ctl02 nova-api[6847]: 2017-09-28 11:51:20.363 6847 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:51:20 ctl02 nova-api[6847]: 2017-09-28 11:51:20.363 6847 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:51:20 ctl02 nova-api[6847]: 2017-09-28 11:51:20.363 6847 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:51:20 ctl02 nova-api[6847]: 2017-09-28 11:51:20.363 6847 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:51:20 ctl02 nova-api[6847]: 2017-09-28 11:51:20.363 6847 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:51:20 ctl02 nova-api[6847]: 2017-09-28 11:51:20.363 6847 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:51:20 ctl02 nova-api[6847]: 2017-09-28 11:51:20.363 6847 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:51:20 ctl02 nova-api[6847]: 2017-09-28 11:51:20.363 6847 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:51:20 ctl02 nova-api[6847]: 2017-09-28 11:51:20.363 6847 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:51:20 ctl02 nova-api[6847]: 2017-09-28 11:51:20.363 6847 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:51:20 ctl02 nova-api[6847]: 2017-09-28 11:51:20.363 6847 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:51:20 ctl02 nova-api[6847]: 2017-09-28 11:51:20.363 6847 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:51:20 ctl02 nova-api[6847]: 2017-09-28 11:51:20.363 6847 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:51:20 ctl02 nova-api[6847]: 2017-09-28 11:51:20.363 6847 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:51:20 ctl02 nova-api[6847]: 2017-09-28 11:51:20.363 6847 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:51:20 ctl02 nova-api[6847]: 2017-09-28 11:51:20.363 6847 ERROR nova.wsgi     self.filename))
Sep 28 11:51:20 ctl02 nova-api[6847]: 2017-09-28 11:51:20.363 6847 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:51:20 ctl02 nova-api[6847]: 2017-09-28 11:51:20.363 6847 ERROR nova.wsgi
Sep 28 11:51:20 ctl02 nova-api[6847]: 2017-09-28 11:51:20.366 6847 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:51:20 ctl02 nova-api[6847]: 2017-09-28 11:51:20.497 6847 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:51:20 ctl02 nova-api[6847]: 2017-09-28 11:51:20.729 6847 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:51:20 ctl02 nova-api[6847]: 2017-09-28 11:51:20.732 6847 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:51:20 ctl02 nova-api[6847]: 2017-09-28 11:51:20.733 6847 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:51:20 ctl02 nova-api[6847]: 2017-09-28 11:51:20.733 6847 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:51:20 ctl02 nova-api[6847]: 2017-09-28 11:51:20.864 6847 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:51:20 ctl02 nova-api[6847]: 2017-09-28 11:51:20.867 6847 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:51:20 ctl02 nova-api[6847]: 2017-09-28 11:51:20.867 6847 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:51:20 ctl02 nova-api[6847]: 2017-09-28 11:51:20.867 6847 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:51:20 ctl02 nova-api[6847]: 2017-09-28 11:51:20.871 6847 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:51:20 ctl02 nova-api[6847]: 2017-09-28 11:51:20.871 6847 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:51:20 ctl02 nova-api[6847]: 2017-09-28 11:51:20.871 6847 ERROR nova Traceback (most recent call last):
Sep 28 11:51:20 ctl02 nova-api[6847]: 2017-09-28 11:51:20.871 6847 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:51:20 ctl02 nova-api[6847]: 2017-09-28 11:51:20.871 6847 ERROR nova     sys.exit(main())
Sep 28 11:51:20 ctl02 nova-api[6847]: 2017-09-28 11:51:20.871 6847 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:51:20 ctl02 nova-api[6847]: 2017-09-28 11:51:20.871 6847 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:51:20 ctl02 nova-api[6847]: 2017-09-28 11:51:20.871 6847 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:51:20 ctl02 nova-api[6847]: 2017-09-28 11:51:20.871 6847 ERROR nova     max_url_len=max_url_len)
Sep 28 11:51:20 ctl02 nova-api[6847]: 2017-09-28 11:51:20.871 6847 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:51:20 ctl02 nova-api[6847]: 2017-09-28 11:51:20.871 6847 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:51:20 ctl02 nova-api[6847]: 2017-09-28 11:51:20.871 6847 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:51:20 ctl02 nova-api[6847]: 2017-09-28 11:51:20.871 6847 ERROR nova     sock.listen(backlog)
Sep 28 11:51:20 ctl02 nova-api[6847]: 2017-09-28 11:51:20.871 6847 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:51:20 ctl02 nova-api[6847]: 2017-09-28 11:51:20.871 6847 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:51:20 ctl02 nova-api[6847]: 2017-09-28 11:51:20.871 6847 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:51:20 ctl02 nova-api[6847]: 2017-09-28 11:51:20.871 6847 ERROR nova
Sep 28 11:51:21 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:51:21 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:51:21 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:51:21 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:51:21 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:51:21 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:51:21 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:51:22 ctl02 nova-conductor[5056]: 2017-09-28 11:51:22.077 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 24 seconds.
Sep 28 11:51:22 ctl02 nova-conductor[5056]: 2017-09-28 11:51:22.091 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 24 seconds.
Sep 28 11:51:22 ctl02 nova-conductor[5056]: 2017-09-28 11:51:22.108 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 24 seconds.
Sep 28 11:51:22 ctl02 nova-conductor[5056]: 2017-09-28 11:51:22.108 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 24 seconds.
Sep 28 11:51:22 ctl02 nova-api[6865]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:51:22 ctl02 nova-api[6865]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:51:22 ctl02 nova-api[6865]: 2017-09-28 11:51:22.855 6865 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:51:22 ctl02 nova-api[6865]: 2017-09-28 11:51:22.856 6865 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:51:22 ctl02 nova-api[6865]: 2017-09-28 11:51:22.856 6865 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:51:22 ctl02 nova-api[6865]: 2017-09-28 11:51:22.856 6865 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:51:22 ctl02 nova-api[6865]: 2017-09-28 11:51:22.856 6865 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:51:22 ctl02 nova-api[6865]: 2017-09-28 11:51:22.856 6865 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:51:22 ctl02 nova-api[6865]: 2017-09-28 11:51:22.856 6865 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:51:22 ctl02 nova-api[6865]: 2017-09-28 11:51:22.856 6865 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:51:22 ctl02 nova-api[6865]: 2017-09-28 11:51:22.856 6865 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:51:22 ctl02 nova-api[6865]: 2017-09-28 11:51:22.856 6865 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:51:22 ctl02 nova-api[6865]: 2017-09-28 11:51:22.856 6865 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:51:22 ctl02 nova-api[6865]: 2017-09-28 11:51:22.856 6865 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:51:22 ctl02 nova-api[6865]: 2017-09-28 11:51:22.856 6865 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:51:22 ctl02 nova-api[6865]: 2017-09-28 11:51:22.856 6865 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:51:22 ctl02 nova-api[6865]: 2017-09-28 11:51:22.856 6865 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:51:22 ctl02 nova-api[6865]: 2017-09-28 11:51:22.856 6865 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:51:22 ctl02 nova-api[6865]: 2017-09-28 11:51:22.856 6865 ERROR nova.wsgi     self.filename))
Sep 28 11:51:22 ctl02 nova-api[6865]: 2017-09-28 11:51:22.856 6865 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:51:22 ctl02 nova-api[6865]: 2017-09-28 11:51:22.856 6865 ERROR nova.wsgi
Sep 28 11:51:22 ctl02 nova-api[6865]: 2017-09-28 11:51:22.859 6865 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:51:22 ctl02 nova-api[6865]: 2017-09-28 11:51:22.987 6865 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:51:23 ctl02 nova-api[6865]: 2017-09-28 11:51:23.217 6865 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:51:23 ctl02 nova-api[6865]: 2017-09-28 11:51:23.220 6865 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:51:23 ctl02 nova-api[6865]: 2017-09-28 11:51:23.220 6865 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:51:23 ctl02 nova-api[6865]: 2017-09-28 11:51:23.220 6865 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:51:23 ctl02 nova-api[6865]: 2017-09-28 11:51:23.349 6865 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:51:23 ctl02 nova-api[6865]: 2017-09-28 11:51:23.351 6865 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:51:23 ctl02 nova-api[6865]: 2017-09-28 11:51:23.351 6865 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:51:23 ctl02 nova-api[6865]: 2017-09-28 11:51:23.352 6865 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:51:23 ctl02 nova-api[6865]: 2017-09-28 11:51:23.355 6865 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:51:23 ctl02 nova-api[6865]: 2017-09-28 11:51:23.356 6865 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:51:23 ctl02 nova-api[6865]: 2017-09-28 11:51:23.356 6865 ERROR nova Traceback (most recent call last):
Sep 28 11:51:23 ctl02 nova-api[6865]: 2017-09-28 11:51:23.356 6865 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:51:23 ctl02 nova-api[6865]: 2017-09-28 11:51:23.356 6865 ERROR nova     sys.exit(main())
Sep 28 11:51:23 ctl02 nova-api[6865]: 2017-09-28 11:51:23.356 6865 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:51:23 ctl02 nova-api[6865]: 2017-09-28 11:51:23.356 6865 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:51:23 ctl02 nova-api[6865]: 2017-09-28 11:51:23.356 6865 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:51:23 ctl02 nova-api[6865]: 2017-09-28 11:51:23.356 6865 ERROR nova     max_url_len=max_url_len)
Sep 28 11:51:23 ctl02 nova-api[6865]: 2017-09-28 11:51:23.356 6865 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:51:23 ctl02 nova-api[6865]: 2017-09-28 11:51:23.356 6865 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:51:23 ctl02 nova-api[6865]: 2017-09-28 11:51:23.356 6865 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:51:23 ctl02 nova-api[6865]: 2017-09-28 11:51:23.356 6865 ERROR nova     sock.listen(backlog)
Sep 28 11:51:23 ctl02 nova-api[6865]: 2017-09-28 11:51:23.356 6865 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:51:23 ctl02 nova-api[6865]: 2017-09-28 11:51:23.356 6865 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:51:23 ctl02 nova-api[6865]: 2017-09-28 11:51:23.356 6865 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:51:23 ctl02 nova-api[6865]: 2017-09-28 11:51:23.356 6865 ERROR nova
Sep 28 11:51:23 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:51:23 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:51:23 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:51:23 ctl02 glance-api[29183]: 2017-09-28 11:51:23.522 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:51:23] "OPTIONS / HTTP/1.0" 200 134 0.000579
Sep 28 11:51:23 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:51:23 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:51:23 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x18c4035f)
Sep 28 11:51:23 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:51:23 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:51:24 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x18c4035f)
Sep 28 11:51:25 ctl02 nova-api[6883]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:51:25 ctl02 nova-api[6883]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:51:25 ctl02 nova-api[6883]: 2017-09-28 11:51:25.305 6883 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:51:25 ctl02 nova-api[6883]: 2017-09-28 11:51:25.306 6883 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:51:25 ctl02 nova-api[6883]: 2017-09-28 11:51:25.306 6883 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:51:25 ctl02 nova-api[6883]: 2017-09-28 11:51:25.306 6883 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:51:25 ctl02 nova-api[6883]: 2017-09-28 11:51:25.306 6883 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:51:25 ctl02 nova-api[6883]: 2017-09-28 11:51:25.306 6883 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:51:25 ctl02 nova-api[6883]: 2017-09-28 11:51:25.306 6883 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:51:25 ctl02 nova-api[6883]: 2017-09-28 11:51:25.306 6883 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:51:25 ctl02 nova-api[6883]: 2017-09-28 11:51:25.306 6883 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:51:25 ctl02 nova-api[6883]: 2017-09-28 11:51:25.306 6883 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:51:25 ctl02 nova-api[6883]: 2017-09-28 11:51:25.306 6883 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:51:25 ctl02 nova-api[6883]: 2017-09-28 11:51:25.306 6883 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:51:25 ctl02 nova-api[6883]: 2017-09-28 11:51:25.306 6883 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:51:25 ctl02 nova-api[6883]: 2017-09-28 11:51:25.306 6883 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:51:25 ctl02 nova-api[6883]: 2017-09-28 11:51:25.306 6883 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:51:25 ctl02 nova-api[6883]: 2017-09-28 11:51:25.306 6883 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:51:25 ctl02 nova-api[6883]: 2017-09-28 11:51:25.306 6883 ERROR nova.wsgi     self.filename))
Sep 28 11:51:25 ctl02 nova-api[6883]: 2017-09-28 11:51:25.306 6883 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:51:25 ctl02 nova-api[6883]: 2017-09-28 11:51:25.306 6883 ERROR nova.wsgi
Sep 28 11:51:25 ctl02 nova-api[6883]: 2017-09-28 11:51:25.307 6883 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:51:25 ctl02 nova-api[6883]: 2017-09-28 11:51:25.434 6883 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:51:25 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x18c4035f)
Sep 28 11:51:25 ctl02 nova-api[6883]: 2017-09-28 11:51:25.683 6883 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:51:25 ctl02 nova-api[6883]: 2017-09-28 11:51:25.686 6883 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:51:25 ctl02 nova-api[6883]: 2017-09-28 11:51:25.686 6883 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:51:25 ctl02 nova-api[6883]: 2017-09-28 11:51:25.686 6883 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:51:25 ctl02 nova-api[6883]: 2017-09-28 11:51:25.817 6883 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:51:25 ctl02 nova-api[6883]: 2017-09-28 11:51:25.819 6883 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:51:25 ctl02 nova-api[6883]: 2017-09-28 11:51:25.819 6883 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:51:25 ctl02 nova-api[6883]: 2017-09-28 11:51:25.820 6883 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:51:25 ctl02 nova-api[6883]: 2017-09-28 11:51:25.823 6883 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:51:25 ctl02 nova-api[6883]: 2017-09-28 11:51:25.823 6883 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:51:25 ctl02 nova-api[6883]: 2017-09-28 11:51:25.823 6883 ERROR nova Traceback (most recent call last):
Sep 28 11:51:25 ctl02 nova-api[6883]: 2017-09-28 11:51:25.823 6883 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:51:25 ctl02 nova-api[6883]: 2017-09-28 11:51:25.823 6883 ERROR nova     sys.exit(main())
Sep 28 11:51:25 ctl02 nova-api[6883]: 2017-09-28 11:51:25.823 6883 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:51:25 ctl02 nova-api[6883]: 2017-09-28 11:51:25.823 6883 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:51:25 ctl02 nova-api[6883]: 2017-09-28 11:51:25.823 6883 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:51:25 ctl02 nova-api[6883]: 2017-09-28 11:51:25.823 6883 ERROR nova     max_url_len=max_url_len)
Sep 28 11:51:25 ctl02 nova-api[6883]: 2017-09-28 11:51:25.823 6883 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:51:25 ctl02 nova-api[6883]: 2017-09-28 11:51:25.823 6883 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:51:25 ctl02 nova-api[6883]: 2017-09-28 11:51:25.823 6883 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:51:25 ctl02 nova-api[6883]: 2017-09-28 11:51:25.823 6883 ERROR nova     sock.listen(backlog)
Sep 28 11:51:25 ctl02 nova-api[6883]: 2017-09-28 11:51:25.823 6883 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:51:25 ctl02 nova-api[6883]: 2017-09-28 11:51:25.823 6883 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:51:25 ctl02 nova-api[6883]: 2017-09-28 11:51:25.823 6883 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:51:25 ctl02 nova-api[6883]: 2017-09-28 11:51:25.823 6883 ERROR nova
Sep 28 11:51:25 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:51:25 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:51:25 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:51:26 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:51:26 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:51:26 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:51:26 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:51:26 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x18c4035f)
Sep 28 11:51:27 ctl02 nova-api[6902]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:51:27 ctl02 nova-api[6902]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:51:27 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x18c4035f)
Sep 28 11:51:27 ctl02 nova-api[6902]: 2017-09-28 11:51:27.782 6902 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:51:27 ctl02 nova-api[6902]: 2017-09-28 11:51:27.784 6902 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:51:27 ctl02 nova-api[6902]: 2017-09-28 11:51:27.784 6902 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:51:27 ctl02 nova-api[6902]: 2017-09-28 11:51:27.784 6902 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:51:27 ctl02 nova-api[6902]: 2017-09-28 11:51:27.784 6902 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:51:27 ctl02 nova-api[6902]: 2017-09-28 11:51:27.784 6902 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:51:27 ctl02 nova-api[6902]: 2017-09-28 11:51:27.784 6902 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:51:27 ctl02 nova-api[6902]: 2017-09-28 11:51:27.784 6902 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:51:27 ctl02 nova-api[6902]: 2017-09-28 11:51:27.784 6902 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:51:27 ctl02 nova-api[6902]: 2017-09-28 11:51:27.784 6902 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:51:27 ctl02 nova-api[6902]: 2017-09-28 11:51:27.784 6902 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:51:27 ctl02 nova-api[6902]: 2017-09-28 11:51:27.784 6902 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:51:27 ctl02 nova-api[6902]: 2017-09-28 11:51:27.784 6902 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:51:27 ctl02 nova-api[6902]: 2017-09-28 11:51:27.784 6902 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:51:27 ctl02 nova-api[6902]: 2017-09-28 11:51:27.784 6902 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:51:27 ctl02 nova-api[6902]: 2017-09-28 11:51:27.784 6902 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:51:27 ctl02 nova-api[6902]: 2017-09-28 11:51:27.784 6902 ERROR nova.wsgi     self.filename))
Sep 28 11:51:27 ctl02 nova-api[6902]: 2017-09-28 11:51:27.784 6902 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:51:27 ctl02 nova-api[6902]: 2017-09-28 11:51:27.784 6902 ERROR nova.wsgi
Sep 28 11:51:27 ctl02 nova-api[6902]: 2017-09-28 11:51:27.784 6902 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:51:27 ctl02 nova-api[6902]: 2017-09-28 11:51:27.909 6902 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:51:28 ctl02 nova-api[6902]: 2017-09-28 11:51:28.139 6902 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:51:28 ctl02 nova-api[6902]: 2017-09-28 11:51:28.141 6902 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:51:28 ctl02 nova-api[6902]: 2017-09-28 11:51:28.141 6902 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:51:28 ctl02 nova-api[6902]: 2017-09-28 11:51:28.141 6902 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:51:28 ctl02 nova-api[6902]: 2017-09-28 11:51:28.270 6902 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:51:28 ctl02 nova-api[6902]: 2017-09-28 11:51:28.272 6902 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:51:28 ctl02 nova-api[6902]: 2017-09-28 11:51:28.272 6902 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:51:28 ctl02 nova-api[6902]: 2017-09-28 11:51:28.272 6902 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:51:28 ctl02 nova-api[6902]: 2017-09-28 11:51:28.275 6902 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:51:28 ctl02 nova-api[6902]: 2017-09-28 11:51:28.276 6902 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:51:28 ctl02 nova-api[6902]: 2017-09-28 11:51:28.276 6902 ERROR nova Traceback (most recent call last):
Sep 28 11:51:28 ctl02 nova-api[6902]: 2017-09-28 11:51:28.276 6902 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:51:28 ctl02 nova-api[6902]: 2017-09-28 11:51:28.276 6902 ERROR nova     sys.exit(main())
Sep 28 11:51:28 ctl02 nova-api[6902]: 2017-09-28 11:51:28.276 6902 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:51:28 ctl02 nova-api[6902]: 2017-09-28 11:51:28.276 6902 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:51:28 ctl02 nova-api[6902]: 2017-09-28 11:51:28.276 6902 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:51:28 ctl02 nova-api[6902]: 2017-09-28 11:51:28.276 6902 ERROR nova     max_url_len=max_url_len)
Sep 28 11:51:28 ctl02 nova-api[6902]: 2017-09-28 11:51:28.276 6902 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:51:28 ctl02 nova-api[6902]: 2017-09-28 11:51:28.276 6902 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:51:28 ctl02 nova-api[6902]: 2017-09-28 11:51:28.276 6902 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:51:28 ctl02 nova-api[6902]: 2017-09-28 11:51:28.276 6902 ERROR nova     sock.listen(backlog)
Sep 28 11:51:28 ctl02 nova-api[6902]: 2017-09-28 11:51:28.276 6902 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:51:28 ctl02 nova-api[6902]: 2017-09-28 11:51:28.276 6902 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:51:28 ctl02 nova-api[6902]: 2017-09-28 11:51:28.276 6902 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:51:28 ctl02 nova-api[6902]: 2017-09-28 11:51:28.276 6902 ERROR nova
Sep 28 11:51:28 ctl02 glance-api[29183]: 2017-09-28 11:51:28.355 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:51:28] "OPTIONS / HTTP/1.0" 200 134 0.000595
Sep 28 11:51:28 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:51:28 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:51:28 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:51:28 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:51:28 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:51:28 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:51:28 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x18c4035f)
Sep 28 11:51:28 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:51:28 ctl02 nova-consoleauth[5433]: 2017-09-28 11:51:28.929 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 24 seconds.
Sep 28 11:51:29 ctl02 glance-api[29183]: 2017-09-28 11:51:29.157 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:51:29] "OPTIONS / HTTP/1.0" 200 134 0.000604
Sep 28 11:51:29 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x18c4035f)
Sep 28 11:51:30 ctl02 nova-api[6920]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:51:30 ctl02 nova-api[6920]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:51:30 ctl02 nova-api[6920]: 2017-09-28 11:51:30.349 6920 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:51:30 ctl02 nova-api[6920]: 2017-09-28 11:51:30.351 6920 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:51:30 ctl02 nova-api[6920]: 2017-09-28 11:51:30.351 6920 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:51:30 ctl02 nova-api[6920]: 2017-09-28 11:51:30.351 6920 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:51:30 ctl02 nova-api[6920]: 2017-09-28 11:51:30.351 6920 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:51:30 ctl02 nova-api[6920]: 2017-09-28 11:51:30.351 6920 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:51:30 ctl02 nova-api[6920]: 2017-09-28 11:51:30.351 6920 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:51:30 ctl02 nova-api[6920]: 2017-09-28 11:51:30.351 6920 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:51:30 ctl02 nova-api[6920]: 2017-09-28 11:51:30.351 6920 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:51:30 ctl02 nova-api[6920]: 2017-09-28 11:51:30.351 6920 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:51:30 ctl02 nova-api[6920]: 2017-09-28 11:51:30.351 6920 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:51:30 ctl02 nova-api[6920]: 2017-09-28 11:51:30.351 6920 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:51:30 ctl02 nova-api[6920]: 2017-09-28 11:51:30.351 6920 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:51:30 ctl02 nova-api[6920]: 2017-09-28 11:51:30.351 6920 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:51:30 ctl02 nova-api[6920]: 2017-09-28 11:51:30.351 6920 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:51:30 ctl02 nova-api[6920]: 2017-09-28 11:51:30.351 6920 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:51:30 ctl02 nova-api[6920]: 2017-09-28 11:51:30.351 6920 ERROR nova.wsgi     self.filename))
Sep 28 11:51:30 ctl02 nova-api[6920]: 2017-09-28 11:51:30.351 6920 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:51:30 ctl02 nova-api[6920]: 2017-09-28 11:51:30.351 6920 ERROR nova.wsgi
Sep 28 11:51:30 ctl02 nova-api[6920]: 2017-09-28 11:51:30.353 6920 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:51:30 ctl02 nova-api[6920]: 2017-09-28 11:51:30.483 6920 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:51:30 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x18c4035f)
Sep 28 11:51:30 ctl02 nova-api[6920]: 2017-09-28 11:51:30.719 6920 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:51:30 ctl02 nova-api[6920]: 2017-09-28 11:51:30.722 6920 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:51:30 ctl02 nova-api[6920]: 2017-09-28 11:51:30.722 6920 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:51:30 ctl02 nova-api[6920]: 2017-09-28 11:51:30.723 6920 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:51:30 ctl02 nova-api[6920]: 2017-09-28 11:51:30.856 6920 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:51:30 ctl02 nova-api[6920]: 2017-09-28 11:51:30.858 6920 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:51:30 ctl02 nova-api[6920]: 2017-09-28 11:51:30.859 6920 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:51:30 ctl02 nova-api[6920]: 2017-09-28 11:51:30.859 6920 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:51:30 ctl02 nova-api[6920]: 2017-09-28 11:51:30.862 6920 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:51:30 ctl02 nova-api[6920]: 2017-09-28 11:51:30.863 6920 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:51:30 ctl02 nova-api[6920]: 2017-09-28 11:51:30.863 6920 ERROR nova Traceback (most recent call last):
Sep 28 11:51:30 ctl02 nova-api[6920]: 2017-09-28 11:51:30.863 6920 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:51:30 ctl02 nova-api[6920]: 2017-09-28 11:51:30.863 6920 ERROR nova     sys.exit(main())
Sep 28 11:51:30 ctl02 nova-api[6920]: 2017-09-28 11:51:30.863 6920 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:51:30 ctl02 nova-api[6920]: 2017-09-28 11:51:30.863 6920 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:51:30 ctl02 nova-api[6920]: 2017-09-28 11:51:30.863 6920 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:51:30 ctl02 nova-api[6920]: 2017-09-28 11:51:30.863 6920 ERROR nova     max_url_len=max_url_len)
Sep 28 11:51:30 ctl02 nova-api[6920]: 2017-09-28 11:51:30.863 6920 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:51:30 ctl02 nova-api[6920]: 2017-09-28 11:51:30.863 6920 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:51:30 ctl02 nova-api[6920]: 2017-09-28 11:51:30.863 6920 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:51:30 ctl02 nova-api[6920]: 2017-09-28 11:51:30.863 6920 ERROR nova     sock.listen(backlog)
Sep 28 11:51:30 ctl02 nova-api[6920]: 2017-09-28 11:51:30.863 6920 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:51:30 ctl02 nova-api[6920]: 2017-09-28 11:51:30.863 6920 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:51:30 ctl02 nova-api[6920]: 2017-09-28 11:51:30.863 6920 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:51:30 ctl02 nova-api[6920]: 2017-09-28 11:51:30.863 6920 ERROR nova
Sep 28 11:51:31 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:51:31 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:51:31 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:51:31 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:51:31 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:51:31 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:51:31 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:51:31 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x18c4035f)
Sep 28 11:51:31 ctl02 nova-scheduler[5620]: 2017-09-28 11:51:31.949 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 24 seconds.
Sep 28 11:51:32 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x18c4035f)
Sep 28 11:51:32 ctl02 nova-api[6938]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:51:32 ctl02 nova-api[6938]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:51:32 ctl02 nova-api[6938]: 2017-09-28 11:51:32.835 6938 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:51:32 ctl02 nova-api[6938]: 2017-09-28 11:51:32.836 6938 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:51:32 ctl02 nova-api[6938]: 2017-09-28 11:51:32.836 6938 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:51:32 ctl02 nova-api[6938]: 2017-09-28 11:51:32.836 6938 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:51:32 ctl02 nova-api[6938]: 2017-09-28 11:51:32.836 6938 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:51:32 ctl02 nova-api[6938]: 2017-09-28 11:51:32.836 6938 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:51:32 ctl02 nova-api[6938]: 2017-09-28 11:51:32.836 6938 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:51:32 ctl02 nova-api[6938]: 2017-09-28 11:51:32.836 6938 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:51:32 ctl02 nova-api[6938]: 2017-09-28 11:51:32.836 6938 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:51:32 ctl02 nova-api[6938]: 2017-09-28 11:51:32.836 6938 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:51:32 ctl02 nova-api[6938]: 2017-09-28 11:51:32.836 6938 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:51:32 ctl02 nova-api[6938]: 2017-09-28 11:51:32.836 6938 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:51:32 ctl02 nova-api[6938]: 2017-09-28 11:51:32.836 6938 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:51:32 ctl02 nova-api[6938]: 2017-09-28 11:51:32.836 6938 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:51:32 ctl02 nova-api[6938]: 2017-09-28 11:51:32.836 6938 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:51:32 ctl02 nova-api[6938]: 2017-09-28 11:51:32.836 6938 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:51:32 ctl02 nova-api[6938]: 2017-09-28 11:51:32.836 6938 ERROR nova.wsgi     self.filename))
Sep 28 11:51:32 ctl02 nova-api[6938]: 2017-09-28 11:51:32.836 6938 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:51:32 ctl02 nova-api[6938]: 2017-09-28 11:51:32.836 6938 ERROR nova.wsgi
Sep 28 11:51:32 ctl02 nova-api[6938]: 2017-09-28 11:51:32.837 6938 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:51:32 ctl02 nova-api[6938]: 2017-09-28 11:51:32.969 6938 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:51:33 ctl02 glance-api[29183]: 2017-09-28 11:51:33.178 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:51:33] "OPTIONS / HTTP/1.0" 200 134 0.000640
Sep 28 11:51:33 ctl02 nova-api[6938]: 2017-09-28 11:51:33.212 6938 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:51:33 ctl02 nova-api[6938]: 2017-09-28 11:51:33.214 6938 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:51:33 ctl02 nova-api[6938]: 2017-09-28 11:51:33.214 6938 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:51:33 ctl02 nova-api[6938]: 2017-09-28 11:51:33.215 6938 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:51:33 ctl02 nova-api[6938]: 2017-09-28 11:51:33.346 6938 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:51:33 ctl02 nova-api[6938]: 2017-09-28 11:51:33.348 6938 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:51:33 ctl02 nova-api[6938]: 2017-09-28 11:51:33.348 6938 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:51:33 ctl02 nova-api[6938]: 2017-09-28 11:51:33.348 6938 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:51:33 ctl02 nova-api[6938]: 2017-09-28 11:51:33.352 6938 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:51:33 ctl02 nova-api[6938]: 2017-09-28 11:51:33.352 6938 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:51:33 ctl02 nova-api[6938]: 2017-09-28 11:51:33.352 6938 ERROR nova Traceback (most recent call last):
Sep 28 11:51:33 ctl02 nova-api[6938]: 2017-09-28 11:51:33.352 6938 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:51:33 ctl02 nova-api[6938]: 2017-09-28 11:51:33.352 6938 ERROR nova     sys.exit(main())
Sep 28 11:51:33 ctl02 nova-api[6938]: 2017-09-28 11:51:33.352 6938 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:51:33 ctl02 nova-api[6938]: 2017-09-28 11:51:33.352 6938 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:51:33 ctl02 nova-api[6938]: 2017-09-28 11:51:33.352 6938 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:51:33 ctl02 nova-api[6938]: 2017-09-28 11:51:33.352 6938 ERROR nova     max_url_len=max_url_len)
Sep 28 11:51:33 ctl02 nova-api[6938]: 2017-09-28 11:51:33.352 6938 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:51:33 ctl02 nova-api[6938]: 2017-09-28 11:51:33.352 6938 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:51:33 ctl02 nova-api[6938]: 2017-09-28 11:51:33.352 6938 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:51:33 ctl02 nova-api[6938]: 2017-09-28 11:51:33.352 6938 ERROR nova     sock.listen(backlog)
Sep 28 11:51:33 ctl02 nova-api[6938]: 2017-09-28 11:51:33.352 6938 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:51:33 ctl02 nova-api[6938]: 2017-09-28 11:51:33.352 6938 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:51:33 ctl02 nova-api[6938]: 2017-09-28 11:51:33.352 6938 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:51:33 ctl02 nova-api[6938]: 2017-09-28 11:51:33.352 6938 ERROR nova
Sep 28 11:51:33 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:51:33 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:51:33 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:51:33 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:51:33 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:51:33 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x18c4035f)
Sep 28 11:51:33 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:51:33 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:51:34 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:51:34 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:51:35 ctl02 nova-api[6956]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:51:35 ctl02 nova-api[6956]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:51:35 ctl02 nova-api[6956]: 2017-09-28 11:51:35.338 6956 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:51:35 ctl02 nova-api[6956]: 2017-09-28 11:51:35.340 6956 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:51:35 ctl02 nova-api[6956]: 2017-09-28 11:51:35.340 6956 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:51:35 ctl02 nova-api[6956]: 2017-09-28 11:51:35.340 6956 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:51:35 ctl02 nova-api[6956]: 2017-09-28 11:51:35.340 6956 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:51:35 ctl02 nova-api[6956]: 2017-09-28 11:51:35.340 6956 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:51:35 ctl02 nova-api[6956]: 2017-09-28 11:51:35.340 6956 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:51:35 ctl02 nova-api[6956]: 2017-09-28 11:51:35.340 6956 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:51:35 ctl02 nova-api[6956]: 2017-09-28 11:51:35.340 6956 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:51:35 ctl02 nova-api[6956]: 2017-09-28 11:51:35.340 6956 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:51:35 ctl02 nova-api[6956]: 2017-09-28 11:51:35.340 6956 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:51:35 ctl02 nova-api[6956]: 2017-09-28 11:51:35.340 6956 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:51:35 ctl02 nova-api[6956]: 2017-09-28 11:51:35.340 6956 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:51:35 ctl02 nova-api[6956]: 2017-09-28 11:51:35.340 6956 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:51:35 ctl02 nova-api[6956]: 2017-09-28 11:51:35.340 6956 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:51:35 ctl02 nova-api[6956]: 2017-09-28 11:51:35.340 6956 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:51:35 ctl02 nova-api[6956]: 2017-09-28 11:51:35.340 6956 ERROR nova.wsgi     self.filename))
Sep 28 11:51:35 ctl02 nova-api[6956]: 2017-09-28 11:51:35.340 6956 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:51:35 ctl02 nova-api[6956]: 2017-09-28 11:51:35.340 6956 ERROR nova.wsgi
Sep 28 11:51:35 ctl02 nova-api[6956]: 2017-09-28 11:51:35.341 6956 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:51:35 ctl02 nova-api[6956]: 2017-09-28 11:51:35.472 6956 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:51:35 ctl02 nova-api[6956]: 2017-09-28 11:51:35.714 6956 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:51:35 ctl02 nova-api[6956]: 2017-09-28 11:51:35.716 6956 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:51:35 ctl02 nova-api[6956]: 2017-09-28 11:51:35.717 6956 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:51:35 ctl02 nova-api[6956]: 2017-09-28 11:51:35.717 6956 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:51:35 ctl02 nova-api[6956]: 2017-09-28 11:51:35.847 6956 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:51:35 ctl02 nova-api[6956]: 2017-09-28 11:51:35.849 6956 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:51:35 ctl02 nova-api[6956]: 2017-09-28 11:51:35.850 6956 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:51:35 ctl02 nova-api[6956]: 2017-09-28 11:51:35.850 6956 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:51:35 ctl02 nova-api[6956]: 2017-09-28 11:51:35.853 6956 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:51:35 ctl02 nova-api[6956]: 2017-09-28 11:51:35.854 6956 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:51:35 ctl02 nova-api[6956]: 2017-09-28 11:51:35.854 6956 ERROR nova Traceback (most recent call last):
Sep 28 11:51:35 ctl02 nova-api[6956]: 2017-09-28 11:51:35.854 6956 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:51:35 ctl02 nova-api[6956]: 2017-09-28 11:51:35.854 6956 ERROR nova     sys.exit(main())
Sep 28 11:51:35 ctl02 nova-api[6956]: 2017-09-28 11:51:35.854 6956 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:51:35 ctl02 nova-api[6956]: 2017-09-28 11:51:35.854 6956 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:51:35 ctl02 nova-api[6956]: 2017-09-28 11:51:35.854 6956 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:51:35 ctl02 nova-api[6956]: 2017-09-28 11:51:35.854 6956 ERROR nova     max_url_len=max_url_len)
Sep 28 11:51:35 ctl02 nova-api[6956]: 2017-09-28 11:51:35.854 6956 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:51:35 ctl02 nova-api[6956]: 2017-09-28 11:51:35.854 6956 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:51:35 ctl02 nova-api[6956]: 2017-09-28 11:51:35.854 6956 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:51:35 ctl02 nova-api[6956]: 2017-09-28 11:51:35.854 6956 ERROR nova     sock.listen(backlog)
Sep 28 11:51:35 ctl02 nova-api[6956]: 2017-09-28 11:51:35.854 6956 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:51:35 ctl02 nova-api[6956]: 2017-09-28 11:51:35.854 6956 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:51:35 ctl02 nova-api[6956]: 2017-09-28 11:51:35.854 6956 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:51:35 ctl02 nova-api[6956]: 2017-09-28 11:51:35.854 6956 ERROR nova
Sep 28 11:51:36 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:51:36 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:51:36 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:51:36 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:51:36 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:51:36 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:51:36 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:51:37 ctl02 nova-api[6979]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:51:37 ctl02 nova-api[6979]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:51:37 ctl02 nova-api[6979]: 2017-09-28 11:51:37.806 6979 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:51:37 ctl02 nova-api[6979]: 2017-09-28 11:51:37.807 6979 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:51:37 ctl02 nova-api[6979]: 2017-09-28 11:51:37.807 6979 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:51:37 ctl02 nova-api[6979]: 2017-09-28 11:51:37.807 6979 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:51:37 ctl02 nova-api[6979]: 2017-09-28 11:51:37.807 6979 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:51:37 ctl02 nova-api[6979]: 2017-09-28 11:51:37.807 6979 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:51:37 ctl02 nova-api[6979]: 2017-09-28 11:51:37.807 6979 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:51:37 ctl02 nova-api[6979]: 2017-09-28 11:51:37.807 6979 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:51:37 ctl02 nova-api[6979]: 2017-09-28 11:51:37.807 6979 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:51:37 ctl02 nova-api[6979]: 2017-09-28 11:51:37.807 6979 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:51:37 ctl02 nova-api[6979]: 2017-09-28 11:51:37.807 6979 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:51:37 ctl02 nova-api[6979]: 2017-09-28 11:51:37.807 6979 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:51:37 ctl02 nova-api[6979]: 2017-09-28 11:51:37.807 6979 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:51:37 ctl02 nova-api[6979]: 2017-09-28 11:51:37.807 6979 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:51:37 ctl02 nova-api[6979]: 2017-09-28 11:51:37.807 6979 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:51:37 ctl02 nova-api[6979]: 2017-09-28 11:51:37.807 6979 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:51:37 ctl02 nova-api[6979]: 2017-09-28 11:51:37.807 6979 ERROR nova.wsgi     self.filename))
Sep 28 11:51:37 ctl02 nova-api[6979]: 2017-09-28 11:51:37.807 6979 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:51:37 ctl02 nova-api[6979]: 2017-09-28 11:51:37.807 6979 ERROR nova.wsgi
Sep 28 11:51:37 ctl02 nova-api[6979]: 2017-09-28 11:51:37.808 6979 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:51:37 ctl02 nova-api[6979]: 2017-09-28 11:51:37.938 6979 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:51:38 ctl02 nova-api[6979]: 2017-09-28 11:51:38.176 6979 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:51:38 ctl02 nova-api[6979]: 2017-09-28 11:51:38.178 6979 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:51:38 ctl02 nova-api[6979]: 2017-09-28 11:51:38.179 6979 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:51:38 ctl02 nova-api[6979]: 2017-09-28 11:51:38.179 6979 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:51:38 ctl02 nova-api[6979]: 2017-09-28 11:51:38.309 6979 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:51:38 ctl02 nova-api[6979]: 2017-09-28 11:51:38.311 6979 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:51:38 ctl02 nova-api[6979]: 2017-09-28 11:51:38.311 6979 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:51:38 ctl02 nova-api[6979]: 2017-09-28 11:51:38.312 6979 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:51:38 ctl02 glance-api[29183]: 2017-09-28 11:51:38.313 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:51:38] "OPTIONS / HTTP/1.0" 200 134 0.000626
Sep 28 11:51:38 ctl02 nova-api[6979]: 2017-09-28 11:51:38.315 6979 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:51:38 ctl02 nova-api[6979]: 2017-09-28 11:51:38.316 6979 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:51:38 ctl02 nova-api[6979]: 2017-09-28 11:51:38.316 6979 ERROR nova Traceback (most recent call last):
Sep 28 11:51:38 ctl02 nova-api[6979]: 2017-09-28 11:51:38.316 6979 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:51:38 ctl02 nova-api[6979]: 2017-09-28 11:51:38.316 6979 ERROR nova     sys.exit(main())
Sep 28 11:51:38 ctl02 nova-api[6979]: 2017-09-28 11:51:38.316 6979 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:51:38 ctl02 nova-api[6979]: 2017-09-28 11:51:38.316 6979 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:51:38 ctl02 nova-api[6979]: 2017-09-28 11:51:38.316 6979 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:51:38 ctl02 nova-api[6979]: 2017-09-28 11:51:38.316 6979 ERROR nova     max_url_len=max_url_len)
Sep 28 11:51:38 ctl02 nova-api[6979]: 2017-09-28 11:51:38.316 6979 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:51:38 ctl02 nova-api[6979]: 2017-09-28 11:51:38.316 6979 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:51:38 ctl02 nova-api[6979]: 2017-09-28 11:51:38.316 6979 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:51:38 ctl02 nova-api[6979]: 2017-09-28 11:51:38.316 6979 ERROR nova     sock.listen(backlog)
Sep 28 11:51:38 ctl02 nova-api[6979]: 2017-09-28 11:51:38.316 6979 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:51:38 ctl02 nova-api[6979]: 2017-09-28 11:51:38.316 6979 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:51:38 ctl02 nova-api[6979]: 2017-09-28 11:51:38.316 6979 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:51:38 ctl02 nova-api[6979]: 2017-09-28 11:51:38.316 6979 ERROR nova
Sep 28 11:51:38 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:51:38 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:51:38 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:51:38 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:51:38 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:51:38 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:51:38 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:51:38 ctl02 glance-api[29183]: 2017-09-28 11:51:38.786 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:51:38] "OPTIONS / HTTP/1.0" 200 134 0.000563
Sep 28 11:51:40 ctl02 nova-api[6996]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:51:40 ctl02 nova-api[6996]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:51:40 ctl02 nova-api[6996]: 2017-09-28 11:51:40.313 6996 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:51:40 ctl02 nova-api[6996]: 2017-09-28 11:51:40.314 6996 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:51:40 ctl02 nova-api[6996]: 2017-09-28 11:51:40.314 6996 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:51:40 ctl02 nova-api[6996]: 2017-09-28 11:51:40.314 6996 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:51:40 ctl02 nova-api[6996]: 2017-09-28 11:51:40.314 6996 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:51:40 ctl02 nova-api[6996]: 2017-09-28 11:51:40.314 6996 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:51:40 ctl02 nova-api[6996]: 2017-09-28 11:51:40.314 6996 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:51:40 ctl02 nova-api[6996]: 2017-09-28 11:51:40.314 6996 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:51:40 ctl02 nova-api[6996]: 2017-09-28 11:51:40.314 6996 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:51:40 ctl02 nova-api[6996]: 2017-09-28 11:51:40.314 6996 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:51:40 ctl02 nova-api[6996]: 2017-09-28 11:51:40.314 6996 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:51:40 ctl02 nova-api[6996]: 2017-09-28 11:51:40.314 6996 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:51:40 ctl02 nova-api[6996]: 2017-09-28 11:51:40.314 6996 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:51:40 ctl02 nova-api[6996]: 2017-09-28 11:51:40.314 6996 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:51:40 ctl02 nova-api[6996]: 2017-09-28 11:51:40.314 6996 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:51:40 ctl02 nova-api[6996]: 2017-09-28 11:51:40.314 6996 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:51:40 ctl02 nova-api[6996]: 2017-09-28 11:51:40.314 6996 ERROR nova.wsgi     self.filename))
Sep 28 11:51:40 ctl02 nova-api[6996]: 2017-09-28 11:51:40.314 6996 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:51:40 ctl02 nova-api[6996]: 2017-09-28 11:51:40.314 6996 ERROR nova.wsgi
Sep 28 11:51:40 ctl02 nova-api[6996]: 2017-09-28 11:51:40.315 6996 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:51:40 ctl02 nova-api[6996]: 2017-09-28 11:51:40.441 6996 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:51:40 ctl02 nova-api[6996]: 2017-09-28 11:51:40.670 6996 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:51:40 ctl02 nova-api[6996]: 2017-09-28 11:51:40.672 6996 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:51:40 ctl02 nova-api[6996]: 2017-09-28 11:51:40.672 6996 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:51:40 ctl02 nova-api[6996]: 2017-09-28 11:51:40.672 6996 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:51:40 ctl02 nova-api[6996]: 2017-09-28 11:51:40.800 6996 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:51:40 ctl02 nova-api[6996]: 2017-09-28 11:51:40.802 6996 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:51:40 ctl02 nova-api[6996]: 2017-09-28 11:51:40.810 6996 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:51:40 ctl02 nova-api[6996]: 2017-09-28 11:51:40.810 6996 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:51:40 ctl02 nova-api[6996]: 2017-09-28 11:51:40.814 6996 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:51:40 ctl02 nova-api[6996]: 2017-09-28 11:51:40.814 6996 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:51:40 ctl02 nova-api[6996]: 2017-09-28 11:51:40.814 6996 ERROR nova Traceback (most recent call last):
Sep 28 11:51:40 ctl02 nova-api[6996]: 2017-09-28 11:51:40.814 6996 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:51:40 ctl02 nova-api[6996]: 2017-09-28 11:51:40.814 6996 ERROR nova     sys.exit(main())
Sep 28 11:51:40 ctl02 nova-api[6996]: 2017-09-28 11:51:40.814 6996 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:51:40 ctl02 nova-api[6996]: 2017-09-28 11:51:40.814 6996 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:51:40 ctl02 nova-api[6996]: 2017-09-28 11:51:40.814 6996 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:51:40 ctl02 nova-api[6996]: 2017-09-28 11:51:40.814 6996 ERROR nova     max_url_len=max_url_len)
Sep 28 11:51:40 ctl02 nova-api[6996]: 2017-09-28 11:51:40.814 6996 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:51:40 ctl02 nova-api[6996]: 2017-09-28 11:51:40.814 6996 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:51:40 ctl02 nova-api[6996]: 2017-09-28 11:51:40.814 6996 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:51:40 ctl02 nova-api[6996]: 2017-09-28 11:51:40.814 6996 ERROR nova     sock.listen(backlog)
Sep 28 11:51:40 ctl02 nova-api[6996]: 2017-09-28 11:51:40.814 6996 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:51:40 ctl02 nova-api[6996]: 2017-09-28 11:51:40.814 6996 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:51:40 ctl02 nova-api[6996]: 2017-09-28 11:51:40.814 6996 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:51:40 ctl02 nova-api[6996]: 2017-09-28 11:51:40.814 6996 ERROR nova
Sep 28 11:51:40 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:51:40 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:51:40 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:51:41 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:51:41 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:51:41 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:51:41 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:51:42 ctl02 nova-api[7014]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:51:42 ctl02 nova-api[7014]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:51:42 ctl02 nova-api[7014]: 2017-09-28 11:51:42.832 7014 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:51:42 ctl02 nova-api[7014]: 2017-09-28 11:51:42.834 7014 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:51:42 ctl02 nova-api[7014]: 2017-09-28 11:51:42.834 7014 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:51:42 ctl02 nova-api[7014]: 2017-09-28 11:51:42.834 7014 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:51:42 ctl02 nova-api[7014]: 2017-09-28 11:51:42.834 7014 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:51:42 ctl02 nova-api[7014]: 2017-09-28 11:51:42.834 7014 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:51:42 ctl02 nova-api[7014]: 2017-09-28 11:51:42.834 7014 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:51:42 ctl02 nova-api[7014]: 2017-09-28 11:51:42.834 7014 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:51:42 ctl02 nova-api[7014]: 2017-09-28 11:51:42.834 7014 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:51:42 ctl02 nova-api[7014]: 2017-09-28 11:51:42.834 7014 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:51:42 ctl02 nova-api[7014]: 2017-09-28 11:51:42.834 7014 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:51:42 ctl02 nova-api[7014]: 2017-09-28 11:51:42.834 7014 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:51:42 ctl02 nova-api[7014]: 2017-09-28 11:51:42.834 7014 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:51:42 ctl02 nova-api[7014]: 2017-09-28 11:51:42.834 7014 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:51:42 ctl02 nova-api[7014]: 2017-09-28 11:51:42.834 7014 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:51:42 ctl02 nova-api[7014]: 2017-09-28 11:51:42.834 7014 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:51:42 ctl02 nova-api[7014]: 2017-09-28 11:51:42.834 7014 ERROR nova.wsgi     self.filename))
Sep 28 11:51:42 ctl02 nova-api[7014]: 2017-09-28 11:51:42.834 7014 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:51:42 ctl02 nova-api[7014]: 2017-09-28 11:51:42.834 7014 ERROR nova.wsgi
Sep 28 11:51:42 ctl02 nova-api[7014]: 2017-09-28 11:51:42.835 7014 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:51:42 ctl02 nova-api[7014]: 2017-09-28 11:51:42.966 7014 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:51:43 ctl02 nova-cert[4860]: 2017-09-28 11:51:43.056 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 26 seconds.
Sep 28 11:51:43 ctl02 nova-api[7014]: 2017-09-28 11:51:43.202 7014 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:51:43 ctl02 nova-api[7014]: 2017-09-28 11:51:43.204 7014 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:51:43 ctl02 nova-api[7014]: 2017-09-28 11:51:43.204 7014 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:51:43 ctl02 nova-api[7014]: 2017-09-28 11:51:43.204 7014 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:51:43 ctl02 glance-api[29183]: 2017-09-28 11:51:43.276 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:51:43] "OPTIONS / HTTP/1.0" 200 134 0.000617
Sep 28 11:51:43 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x85962567)
Sep 28 11:51:43 ctl02 nova-api[7014]: 2017-09-28 11:51:43.334 7014 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:51:43 ctl02 nova-api[7014]: 2017-09-28 11:51:43.336 7014 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:51:43 ctl02 nova-api[7014]: 2017-09-28 11:51:43.337 7014 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:51:43 ctl02 nova-api[7014]: 2017-09-28 11:51:43.337 7014 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:51:43 ctl02 nova-api[7014]: 2017-09-28 11:51:43.340 7014 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:51:43 ctl02 nova-api[7014]: 2017-09-28 11:51:43.340 7014 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:51:43 ctl02 nova-api[7014]: 2017-09-28 11:51:43.340 7014 ERROR nova Traceback (most recent call last):
Sep 28 11:51:43 ctl02 nova-api[7014]: 2017-09-28 11:51:43.340 7014 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:51:43 ctl02 nova-api[7014]: 2017-09-28 11:51:43.340 7014 ERROR nova     sys.exit(main())
Sep 28 11:51:43 ctl02 nova-api[7014]: 2017-09-28 11:51:43.340 7014 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:51:43 ctl02 nova-api[7014]: 2017-09-28 11:51:43.340 7014 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:51:43 ctl02 nova-api[7014]: 2017-09-28 11:51:43.340 7014 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:51:43 ctl02 nova-api[7014]: 2017-09-28 11:51:43.340 7014 ERROR nova     max_url_len=max_url_len)
Sep 28 11:51:43 ctl02 nova-api[7014]: 2017-09-28 11:51:43.340 7014 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:51:43 ctl02 nova-api[7014]: 2017-09-28 11:51:43.340 7014 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:51:43 ctl02 nova-api[7014]: 2017-09-28 11:51:43.340 7014 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:51:43 ctl02 nova-api[7014]: 2017-09-28 11:51:43.340 7014 ERROR nova     sock.listen(backlog)
Sep 28 11:51:43 ctl02 nova-api[7014]: 2017-09-28 11:51:43.340 7014 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:51:43 ctl02 nova-api[7014]: 2017-09-28 11:51:43.340 7014 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:51:43 ctl02 nova-api[7014]: 2017-09-28 11:51:43.340 7014 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:51:43 ctl02 nova-api[7014]: 2017-09-28 11:51:43.340 7014 ERROR nova
Sep 28 11:51:43 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:51:43 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:51:43 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:51:43 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:51:43 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:51:43 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:51:43 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:51:44 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x85962567)
Sep 28 11:51:45 ctl02 nova-api[7032]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:51:45 ctl02 nova-api[7032]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:51:45 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x85962567)
Sep 28 11:51:45 ctl02 nova-api[7032]: 2017-09-28 11:51:45.371 7032 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:51:45 ctl02 nova-api[7032]: 2017-09-28 11:51:45.372 7032 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:51:45 ctl02 nova-api[7032]: 2017-09-28 11:51:45.372 7032 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:51:45 ctl02 nova-api[7032]: 2017-09-28 11:51:45.372 7032 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:51:45 ctl02 nova-api[7032]: 2017-09-28 11:51:45.372 7032 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:51:45 ctl02 nova-api[7032]: 2017-09-28 11:51:45.372 7032 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:51:45 ctl02 nova-api[7032]: 2017-09-28 11:51:45.372 7032 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:51:45 ctl02 nova-api[7032]: 2017-09-28 11:51:45.372 7032 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:51:45 ctl02 nova-api[7032]: 2017-09-28 11:51:45.372 7032 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:51:45 ctl02 nova-api[7032]: 2017-09-28 11:51:45.372 7032 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:51:45 ctl02 nova-api[7032]: 2017-09-28 11:51:45.372 7032 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:51:45 ctl02 nova-api[7032]: 2017-09-28 11:51:45.372 7032 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:51:45 ctl02 nova-api[7032]: 2017-09-28 11:51:45.372 7032 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:51:45 ctl02 nova-api[7032]: 2017-09-28 11:51:45.372 7032 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:51:45 ctl02 nova-api[7032]: 2017-09-28 11:51:45.372 7032 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:51:45 ctl02 nova-api[7032]: 2017-09-28 11:51:45.372 7032 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:51:45 ctl02 nova-api[7032]: 2017-09-28 11:51:45.372 7032 ERROR nova.wsgi     self.filename))
Sep 28 11:51:45 ctl02 nova-api[7032]: 2017-09-28 11:51:45.372 7032 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:51:45 ctl02 nova-api[7032]: 2017-09-28 11:51:45.372 7032 ERROR nova.wsgi
Sep 28 11:51:45 ctl02 nova-api[7032]: 2017-09-28 11:51:45.373 7032 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:51:45 ctl02 nova-api[7032]: 2017-09-28 11:51:45.503 7032 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:51:45 ctl02 nova-api[7032]: 2017-09-28 11:51:45.745 7032 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:51:45 ctl02 nova-api[7032]: 2017-09-28 11:51:45.747 7032 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:51:45 ctl02 nova-api[7032]: 2017-09-28 11:51:45.748 7032 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:51:45 ctl02 nova-api[7032]: 2017-09-28 11:51:45.748 7032 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:51:45 ctl02 nova-api[7032]: 2017-09-28 11:51:45.879 7032 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:51:45 ctl02 nova-api[7032]: 2017-09-28 11:51:45.881 7032 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:51:45 ctl02 nova-api[7032]: 2017-09-28 11:51:45.895 7032 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:51:45 ctl02 nova-api[7032]: 2017-09-28 11:51:45.896 7032 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:51:45 ctl02 nova-api[7032]: 2017-09-28 11:51:45.899 7032 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:51:45 ctl02 nova-api[7032]: 2017-09-28 11:51:45.899 7032 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:51:45 ctl02 nova-api[7032]: 2017-09-28 11:51:45.899 7032 ERROR nova Traceback (most recent call last):
Sep 28 11:51:45 ctl02 nova-api[7032]: 2017-09-28 11:51:45.899 7032 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:51:45 ctl02 nova-api[7032]: 2017-09-28 11:51:45.899 7032 ERROR nova     sys.exit(main())
Sep 28 11:51:45 ctl02 nova-api[7032]: 2017-09-28 11:51:45.899 7032 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:51:45 ctl02 nova-api[7032]: 2017-09-28 11:51:45.899 7032 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:51:45 ctl02 nova-api[7032]: 2017-09-28 11:51:45.899 7032 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:51:45 ctl02 nova-api[7032]: 2017-09-28 11:51:45.899 7032 ERROR nova     max_url_len=max_url_len)
Sep 28 11:51:45 ctl02 nova-api[7032]: 2017-09-28 11:51:45.899 7032 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:51:45 ctl02 nova-api[7032]: 2017-09-28 11:51:45.899 7032 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:51:45 ctl02 nova-api[7032]: 2017-09-28 11:51:45.899 7032 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:51:45 ctl02 nova-api[7032]: 2017-09-28 11:51:45.899 7032 ERROR nova     sock.listen(backlog)
Sep 28 11:51:45 ctl02 nova-api[7032]: 2017-09-28 11:51:45.899 7032 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:51:45 ctl02 nova-api[7032]: 2017-09-28 11:51:45.899 7032 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:51:45 ctl02 nova-api[7032]: 2017-09-28 11:51:45.899 7032 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:51:45 ctl02 nova-api[7032]: 2017-09-28 11:51:45.899 7032 ERROR nova
Sep 28 11:51:46 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:51:46 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:51:46 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:51:46 ctl02 nova-conductor[5056]: 2017-09-28 11:51:46.084 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 26 seconds.
Sep 28 11:51:46 ctl02 nova-conductor[5056]: 2017-09-28 11:51:46.099 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 26 seconds.
Sep 28 11:51:46 ctl02 nova-conductor[5056]: 2017-09-28 11:51:46.116 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 26 seconds.
Sep 28 11:51:46 ctl02 nova-conductor[5056]: 2017-09-28 11:51:46.116 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 26 seconds.
Sep 28 11:51:46 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x85962567)
Sep 28 11:51:46 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:51:46 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:51:46 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:51:46 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:51:47 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x85962567)
Sep 28 11:51:47 ctl02 nova-api[7051]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:51:47 ctl02 nova-api[7051]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:51:48 ctl02 nova-api[7051]: 2017-09-28 11:51:48.114 7051 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:51:48 ctl02 nova-api[7051]: 2017-09-28 11:51:48.116 7051 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:51:48 ctl02 nova-api[7051]: 2017-09-28 11:51:48.116 7051 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:51:48 ctl02 nova-api[7051]: 2017-09-28 11:51:48.116 7051 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:51:48 ctl02 nova-api[7051]: 2017-09-28 11:51:48.116 7051 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:51:48 ctl02 nova-api[7051]: 2017-09-28 11:51:48.116 7051 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:51:48 ctl02 nova-api[7051]: 2017-09-28 11:51:48.116 7051 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:51:48 ctl02 nova-api[7051]: 2017-09-28 11:51:48.116 7051 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:51:48 ctl02 nova-api[7051]: 2017-09-28 11:51:48.116 7051 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:51:48 ctl02 nova-api[7051]: 2017-09-28 11:51:48.116 7051 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:51:48 ctl02 nova-api[7051]: 2017-09-28 11:51:48.116 7051 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:51:48 ctl02 nova-api[7051]: 2017-09-28 11:51:48.116 7051 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:51:48 ctl02 nova-api[7051]: 2017-09-28 11:51:48.116 7051 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:51:48 ctl02 nova-api[7051]: 2017-09-28 11:51:48.116 7051 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:51:48 ctl02 nova-api[7051]: 2017-09-28 11:51:48.116 7051 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:51:48 ctl02 nova-api[7051]: 2017-09-28 11:51:48.116 7051 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:51:48 ctl02 nova-api[7051]: 2017-09-28 11:51:48.116 7051 ERROR nova.wsgi     self.filename))
Sep 28 11:51:48 ctl02 nova-api[7051]: 2017-09-28 11:51:48.116 7051 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:51:48 ctl02 nova-api[7051]: 2017-09-28 11:51:48.116 7051 ERROR nova.wsgi
Sep 28 11:51:48 ctl02 nova-api[7051]: 2017-09-28 11:51:48.119 7051 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:51:48 ctl02 nova-api[7051]: 2017-09-28 11:51:48.251 7051 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:51:48 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x85962567)
Sep 28 11:51:48 ctl02 glance-api[29183]: 2017-09-28 11:51:48.432 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:51:48] "OPTIONS / HTTP/1.0" 200 134 0.000611
Sep 28 11:51:48 ctl02 nova-api[7051]: 2017-09-28 11:51:48.492 7051 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:51:48 ctl02 nova-api[7051]: 2017-09-28 11:51:48.495 7051 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:51:48 ctl02 nova-api[7051]: 2017-09-28 11:51:48.495 7051 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:51:48 ctl02 nova-api[7051]: 2017-09-28 11:51:48.495 7051 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:51:48 ctl02 nova-api[7051]: 2017-09-28 11:51:48.627 7051 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:51:48 ctl02 nova-api[7051]: 2017-09-28 11:51:48.629 7051 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:51:48 ctl02 nova-api[7051]: 2017-09-28 11:51:48.630 7051 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:51:48 ctl02 nova-api[7051]: 2017-09-28 11:51:48.630 7051 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:51:48 ctl02 nova-api[7051]: 2017-09-28 11:51:48.633 7051 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:51:48 ctl02 nova-api[7051]: 2017-09-28 11:51:48.633 7051 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:51:48 ctl02 nova-api[7051]: 2017-09-28 11:51:48.633 7051 ERROR nova Traceback (most recent call last):
Sep 28 11:51:48 ctl02 nova-api[7051]: 2017-09-28 11:51:48.633 7051 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:51:48 ctl02 nova-api[7051]: 2017-09-28 11:51:48.633 7051 ERROR nova     sys.exit(main())
Sep 28 11:51:48 ctl02 nova-api[7051]: 2017-09-28 11:51:48.633 7051 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:51:48 ctl02 nova-api[7051]: 2017-09-28 11:51:48.633 7051 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:51:48 ctl02 nova-api[7051]: 2017-09-28 11:51:48.633 7051 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:51:48 ctl02 nova-api[7051]: 2017-09-28 11:51:48.633 7051 ERROR nova     max_url_len=max_url_len)
Sep 28 11:51:48 ctl02 nova-api[7051]: 2017-09-28 11:51:48.633 7051 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:51:48 ctl02 nova-api[7051]: 2017-09-28 11:51:48.633 7051 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:51:48 ctl02 nova-api[7051]: 2017-09-28 11:51:48.633 7051 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:51:48 ctl02 nova-api[7051]: 2017-09-28 11:51:48.633 7051 ERROR nova     sock.listen(backlog)
Sep 28 11:51:48 ctl02 nova-api[7051]: 2017-09-28 11:51:48.633 7051 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:51:48 ctl02 nova-api[7051]: 2017-09-28 11:51:48.633 7051 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:51:48 ctl02 nova-api[7051]: 2017-09-28 11:51:48.633 7051 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:51:48 ctl02 nova-api[7051]: 2017-09-28 11:51:48.633 7051 ERROR nova
Sep 28 11:51:48 ctl02 glance-api[29183]: 2017-09-28 11:51:48.682 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:51:48] "OPTIONS / HTTP/1.0" 200 134 0.000515
Sep 28 11:51:48 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:51:48 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:51:48 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:51:49 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:51:49 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:51:49 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:51:49 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:51:49 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x85962567)
Sep 28 11:51:50 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x85962567)
Sep 28 11:51:50 ctl02 nova-api[7069]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:51:50 ctl02 nova-api[7069]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:51:50 ctl02 nova-api[7069]: 2017-09-28 11:51:50.838 7069 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:51:50 ctl02 nova-api[7069]: 2017-09-28 11:51:50.839 7069 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:51:50 ctl02 nova-api[7069]: 2017-09-28 11:51:50.839 7069 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:51:50 ctl02 nova-api[7069]: 2017-09-28 11:51:50.839 7069 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:51:50 ctl02 nova-api[7069]: 2017-09-28 11:51:50.839 7069 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:51:50 ctl02 nova-api[7069]: 2017-09-28 11:51:50.839 7069 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:51:50 ctl02 nova-api[7069]: 2017-09-28 11:51:50.839 7069 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:51:50 ctl02 nova-api[7069]: 2017-09-28 11:51:50.839 7069 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:51:50 ctl02 nova-api[7069]: 2017-09-28 11:51:50.839 7069 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:51:50 ctl02 nova-api[7069]: 2017-09-28 11:51:50.839 7069 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:51:50 ctl02 nova-api[7069]: 2017-09-28 11:51:50.839 7069 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:51:50 ctl02 nova-api[7069]: 2017-09-28 11:51:50.839 7069 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:51:50 ctl02 nova-api[7069]: 2017-09-28 11:51:50.839 7069 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:51:50 ctl02 nova-api[7069]: 2017-09-28 11:51:50.839 7069 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:51:50 ctl02 nova-api[7069]: 2017-09-28 11:51:50.839 7069 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:51:50 ctl02 nova-api[7069]: 2017-09-28 11:51:50.839 7069 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:51:50 ctl02 nova-api[7069]: 2017-09-28 11:51:50.839 7069 ERROR nova.wsgi     self.filename))
Sep 28 11:51:50 ctl02 nova-api[7069]: 2017-09-28 11:51:50.839 7069 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:51:50 ctl02 nova-api[7069]: 2017-09-28 11:51:50.839 7069 ERROR nova.wsgi
Sep 28 11:51:50 ctl02 nova-api[7069]: 2017-09-28 11:51:50.840 7069 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:51:50 ctl02 nova-api[7069]: 2017-09-28 11:51:50.973 7069 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:51:51 ctl02 nova-api[7069]: 2017-09-28 11:51:51.206 7069 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:51:51 ctl02 nova-api[7069]: 2017-09-28 11:51:51.208 7069 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:51:51 ctl02 nova-api[7069]: 2017-09-28 11:51:51.209 7069 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:51:51 ctl02 nova-api[7069]: 2017-09-28 11:51:51.209 7069 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:51:51 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x85962567)
Sep 28 11:51:51 ctl02 nova-api[7069]: 2017-09-28 11:51:51.340 7069 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:51:51 ctl02 nova-api[7069]: 2017-09-28 11:51:51.342 7069 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:51:51 ctl02 nova-api[7069]: 2017-09-28 11:51:51.343 7069 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:51:51 ctl02 nova-api[7069]: 2017-09-28 11:51:51.343 7069 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:51:51 ctl02 nova-api[7069]: 2017-09-28 11:51:51.346 7069 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:51:51 ctl02 nova-api[7069]: 2017-09-28 11:51:51.346 7069 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:51:51 ctl02 nova-api[7069]: 2017-09-28 11:51:51.346 7069 ERROR nova Traceback (most recent call last):
Sep 28 11:51:51 ctl02 nova-api[7069]: 2017-09-28 11:51:51.346 7069 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:51:51 ctl02 nova-api[7069]: 2017-09-28 11:51:51.346 7069 ERROR nova     sys.exit(main())
Sep 28 11:51:51 ctl02 nova-api[7069]: 2017-09-28 11:51:51.346 7069 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:51:51 ctl02 nova-api[7069]: 2017-09-28 11:51:51.346 7069 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:51:51 ctl02 nova-api[7069]: 2017-09-28 11:51:51.346 7069 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:51:51 ctl02 nova-api[7069]: 2017-09-28 11:51:51.346 7069 ERROR nova     max_url_len=max_url_len)
Sep 28 11:51:51 ctl02 nova-api[7069]: 2017-09-28 11:51:51.346 7069 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:51:51 ctl02 nova-api[7069]: 2017-09-28 11:51:51.346 7069 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:51:51 ctl02 nova-api[7069]: 2017-09-28 11:51:51.346 7069 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:51:51 ctl02 nova-api[7069]: 2017-09-28 11:51:51.346 7069 ERROR nova     sock.listen(backlog)
Sep 28 11:51:51 ctl02 nova-api[7069]: 2017-09-28 11:51:51.346 7069 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:51:51 ctl02 nova-api[7069]: 2017-09-28 11:51:51.346 7069 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:51:51 ctl02 nova-api[7069]: 2017-09-28 11:51:51.346 7069 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:51:51 ctl02 nova-api[7069]: 2017-09-28 11:51:51.346 7069 ERROR nova
Sep 28 11:51:51 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:51:51 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:51:51 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:51:51 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:51:51 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:51:51 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:51:51 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:51:52 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x85962567)
Sep 28 11:51:52 ctl02 nova-consoleauth[5433]: 2017-09-28 11:51:52.957 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 26 seconds.
Sep 28 11:51:53 ctl02 nova-api[7087]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:51:53 ctl02 nova-api[7087]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:51:53 ctl02 glance-api[29183]: 2017-09-28 11:51:53.192 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:51:53] "OPTIONS / HTTP/1.0" 200 134 0.001085
Sep 28 11:51:53 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x85962567)
Sep 28 11:51:53 ctl02 nova-api[7087]: 2017-09-28 11:51:53.355 7087 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:51:53 ctl02 nova-api[7087]: 2017-09-28 11:51:53.357 7087 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:51:53 ctl02 nova-api[7087]: 2017-09-28 11:51:53.357 7087 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:51:53 ctl02 nova-api[7087]: 2017-09-28 11:51:53.357 7087 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:51:53 ctl02 nova-api[7087]: 2017-09-28 11:51:53.357 7087 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:51:53 ctl02 nova-api[7087]: 2017-09-28 11:51:53.357 7087 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:51:53 ctl02 nova-api[7087]: 2017-09-28 11:51:53.357 7087 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:51:53 ctl02 nova-api[7087]: 2017-09-28 11:51:53.357 7087 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:51:53 ctl02 nova-api[7087]: 2017-09-28 11:51:53.357 7087 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:51:53 ctl02 nova-api[7087]: 2017-09-28 11:51:53.357 7087 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:51:53 ctl02 nova-api[7087]: 2017-09-28 11:51:53.357 7087 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:51:53 ctl02 nova-api[7087]: 2017-09-28 11:51:53.357 7087 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:51:53 ctl02 nova-api[7087]: 2017-09-28 11:51:53.357 7087 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:51:53 ctl02 nova-api[7087]: 2017-09-28 11:51:53.357 7087 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:51:53 ctl02 nova-api[7087]: 2017-09-28 11:51:53.357 7087 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:51:53 ctl02 nova-api[7087]: 2017-09-28 11:51:53.357 7087 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:51:53 ctl02 nova-api[7087]: 2017-09-28 11:51:53.357 7087 ERROR nova.wsgi     self.filename))
Sep 28 11:51:53 ctl02 nova-api[7087]: 2017-09-28 11:51:53.357 7087 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:51:53 ctl02 nova-api[7087]: 2017-09-28 11:51:53.357 7087 ERROR nova.wsgi
Sep 28 11:51:53 ctl02 nova-api[7087]: 2017-09-28 11:51:53.358 7087 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:51:53 ctl02 nova-api[7087]: 2017-09-28 11:51:53.490 7087 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:51:53 ctl02 nova-api[7087]: 2017-09-28 11:51:53.732 7087 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:51:53 ctl02 nova-api[7087]: 2017-09-28 11:51:53.734 7087 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:51:53 ctl02 nova-api[7087]: 2017-09-28 11:51:53.734 7087 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:51:53 ctl02 nova-api[7087]: 2017-09-28 11:51:53.735 7087 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:51:53 ctl02 nova-api[7087]: 2017-09-28 11:51:53.866 7087 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:51:53 ctl02 nova-api[7087]: 2017-09-28 11:51:53.868 7087 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:51:53 ctl02 nova-api[7087]: 2017-09-28 11:51:53.868 7087 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:51:53 ctl02 nova-api[7087]: 2017-09-28 11:51:53.868 7087 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:51:53 ctl02 nova-api[7087]: 2017-09-28 11:51:53.872 7087 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:51:53 ctl02 nova-api[7087]: 2017-09-28 11:51:53.872 7087 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:51:53 ctl02 nova-api[7087]: 2017-09-28 11:51:53.872 7087 ERROR nova Traceback (most recent call last):
Sep 28 11:51:53 ctl02 nova-api[7087]: 2017-09-28 11:51:53.872 7087 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:51:53 ctl02 nova-api[7087]: 2017-09-28 11:51:53.872 7087 ERROR nova     sys.exit(main())
Sep 28 11:51:53 ctl02 nova-api[7087]: 2017-09-28 11:51:53.872 7087 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:51:53 ctl02 nova-api[7087]: 2017-09-28 11:51:53.872 7087 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:51:53 ctl02 nova-api[7087]: 2017-09-28 11:51:53.872 7087 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:51:53 ctl02 nova-api[7087]: 2017-09-28 11:51:53.872 7087 ERROR nova     max_url_len=max_url_len)
Sep 28 11:51:53 ctl02 nova-api[7087]: 2017-09-28 11:51:53.872 7087 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:51:53 ctl02 nova-api[7087]: 2017-09-28 11:51:53.872 7087 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:51:53 ctl02 nova-api[7087]: 2017-09-28 11:51:53.872 7087 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:51:53 ctl02 nova-api[7087]: 2017-09-28 11:51:53.872 7087 ERROR nova     sock.listen(backlog)
Sep 28 11:51:53 ctl02 nova-api[7087]: 2017-09-28 11:51:53.872 7087 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:51:53 ctl02 nova-api[7087]: 2017-09-28 11:51:53.872 7087 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:51:53 ctl02 nova-api[7087]: 2017-09-28 11:51:53.872 7087 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:51:53 ctl02 nova-api[7087]: 2017-09-28 11:51:53.872 7087 ERROR nova
Sep 28 11:51:54 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:51:54 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:51:54 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:51:54 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:51:54 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:51:54 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:51:54 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:51:54 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:51:54 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:51:55 ctl02 nova-api[7110]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:51:55 ctl02 nova-api[7110]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:51:55 ctl02 nova-scheduler[5620]: 2017-09-28 11:51:55.979 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 26 seconds.
Sep 28 11:51:56 ctl02 nova-api[7110]: 2017-09-28 11:51:56.104 7110 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:51:56 ctl02 nova-api[7110]: 2017-09-28 11:51:56.105 7110 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:51:56 ctl02 nova-api[7110]: 2017-09-28 11:51:56.105 7110 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:51:56 ctl02 nova-api[7110]: 2017-09-28 11:51:56.105 7110 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:51:56 ctl02 nova-api[7110]: 2017-09-28 11:51:56.105 7110 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:51:56 ctl02 nova-api[7110]: 2017-09-28 11:51:56.105 7110 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:51:56 ctl02 nova-api[7110]: 2017-09-28 11:51:56.105 7110 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:51:56 ctl02 nova-api[7110]: 2017-09-28 11:51:56.105 7110 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:51:56 ctl02 nova-api[7110]: 2017-09-28 11:51:56.105 7110 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:51:56 ctl02 nova-api[7110]: 2017-09-28 11:51:56.105 7110 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:51:56 ctl02 nova-api[7110]: 2017-09-28 11:51:56.105 7110 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:51:56 ctl02 nova-api[7110]: 2017-09-28 11:51:56.105 7110 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:51:56 ctl02 nova-api[7110]: 2017-09-28 11:51:56.105 7110 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:51:56 ctl02 nova-api[7110]: 2017-09-28 11:51:56.105 7110 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:51:56 ctl02 nova-api[7110]: 2017-09-28 11:51:56.105 7110 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:51:56 ctl02 nova-api[7110]: 2017-09-28 11:51:56.105 7110 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:51:56 ctl02 nova-api[7110]: 2017-09-28 11:51:56.105 7110 ERROR nova.wsgi     self.filename))
Sep 28 11:51:56 ctl02 nova-api[7110]: 2017-09-28 11:51:56.105 7110 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:51:56 ctl02 nova-api[7110]: 2017-09-28 11:51:56.105 7110 ERROR nova.wsgi
Sep 28 11:51:56 ctl02 nova-api[7110]: 2017-09-28 11:51:56.106 7110 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:51:56 ctl02 nova-api[7110]: 2017-09-28 11:51:56.237 7110 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:51:56 ctl02 nova-api[7110]: 2017-09-28 11:51:56.472 7110 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:51:56 ctl02 nova-api[7110]: 2017-09-28 11:51:56.474 7110 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:51:56 ctl02 nova-api[7110]: 2017-09-28 11:51:56.474 7110 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:51:56 ctl02 nova-api[7110]: 2017-09-28 11:51:56.475 7110 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:51:56 ctl02 nova-api[7110]: 2017-09-28 11:51:56.607 7110 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:51:56 ctl02 nova-api[7110]: 2017-09-28 11:51:56.609 7110 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:51:56 ctl02 nova-api[7110]: 2017-09-28 11:51:56.609 7110 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:51:56 ctl02 nova-api[7110]: 2017-09-28 11:51:56.610 7110 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:51:56 ctl02 nova-api[7110]: 2017-09-28 11:51:56.613 7110 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:51:56 ctl02 nova-api[7110]: 2017-09-28 11:51:56.613 7110 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:51:56 ctl02 nova-api[7110]: 2017-09-28 11:51:56.613 7110 ERROR nova Traceback (most recent call last):
Sep 28 11:51:56 ctl02 nova-api[7110]: 2017-09-28 11:51:56.613 7110 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:51:56 ctl02 nova-api[7110]: 2017-09-28 11:51:56.613 7110 ERROR nova     sys.exit(main())
Sep 28 11:51:56 ctl02 nova-api[7110]: 2017-09-28 11:51:56.613 7110 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:51:56 ctl02 nova-api[7110]: 2017-09-28 11:51:56.613 7110 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:51:56 ctl02 nova-api[7110]: 2017-09-28 11:51:56.613 7110 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:51:56 ctl02 nova-api[7110]: 2017-09-28 11:51:56.613 7110 ERROR nova     max_url_len=max_url_len)
Sep 28 11:51:56 ctl02 nova-api[7110]: 2017-09-28 11:51:56.613 7110 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:51:56 ctl02 nova-api[7110]: 2017-09-28 11:51:56.613 7110 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:51:56 ctl02 nova-api[7110]: 2017-09-28 11:51:56.613 7110 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:51:56 ctl02 nova-api[7110]: 2017-09-28 11:51:56.613 7110 ERROR nova     sock.listen(backlog)
Sep 28 11:51:56 ctl02 nova-api[7110]: 2017-09-28 11:51:56.613 7110 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:51:56 ctl02 nova-api[7110]: 2017-09-28 11:51:56.613 7110 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:51:56 ctl02 nova-api[7110]: 2017-09-28 11:51:56.613 7110 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:51:56 ctl02 nova-api[7110]: 2017-09-28 11:51:56.613 7110 ERROR nova
Sep 28 11:51:56 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:51:56 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:51:56 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:51:56 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:51:56 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:51:56 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:51:56 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:51:58 ctl02 glance-api[29183]: 2017-09-28 11:51:58.136 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:51:58] "OPTIONS / HTTP/1.0" 200 134 0.000594
Sep 28 11:51:58 ctl02 nova-api[7128]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:51:58 ctl02 nova-api[7128]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:51:58 ctl02 nova-api[7128]: 2017-09-28 11:51:58.608 7128 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:51:58 ctl02 nova-api[7128]: 2017-09-28 11:51:58.609 7128 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:51:58 ctl02 nova-api[7128]: 2017-09-28 11:51:58.609 7128 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:51:58 ctl02 nova-api[7128]: 2017-09-28 11:51:58.609 7128 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:51:58 ctl02 nova-api[7128]: 2017-09-28 11:51:58.609 7128 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:51:58 ctl02 nova-api[7128]: 2017-09-28 11:51:58.609 7128 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:51:58 ctl02 nova-api[7128]: 2017-09-28 11:51:58.609 7128 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:51:58 ctl02 nova-api[7128]: 2017-09-28 11:51:58.609 7128 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:51:58 ctl02 nova-api[7128]: 2017-09-28 11:51:58.609 7128 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:51:58 ctl02 nova-api[7128]: 2017-09-28 11:51:58.609 7128 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:51:58 ctl02 nova-api[7128]: 2017-09-28 11:51:58.609 7128 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:51:58 ctl02 nova-api[7128]: 2017-09-28 11:51:58.609 7128 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:51:58 ctl02 nova-api[7128]: 2017-09-28 11:51:58.609 7128 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:51:58 ctl02 nova-api[7128]: 2017-09-28 11:51:58.609 7128 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:51:58 ctl02 nova-api[7128]: 2017-09-28 11:51:58.609 7128 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:51:58 ctl02 nova-api[7128]: 2017-09-28 11:51:58.609 7128 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:51:58 ctl02 nova-api[7128]: 2017-09-28 11:51:58.609 7128 ERROR nova.wsgi     self.filename))
Sep 28 11:51:58 ctl02 nova-api[7128]: 2017-09-28 11:51:58.609 7128 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:51:58 ctl02 nova-api[7128]: 2017-09-28 11:51:58.609 7128 ERROR nova.wsgi
Sep 28 11:51:58 ctl02 nova-api[7128]: 2017-09-28 11:51:58.610 7128 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:51:58 ctl02 nova-api[7128]: 2017-09-28 11:51:58.740 7128 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:51:58 ctl02 nova-api[7128]: 2017-09-28 11:51:58.977 7128 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:51:58 ctl02 nova-api[7128]: 2017-09-28 11:51:58.979 7128 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:51:58 ctl02 nova-api[7128]: 2017-09-28 11:51:58.979 7128 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:51:58 ctl02 nova-api[7128]: 2017-09-28 11:51:58.979 7128 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:51:58 ctl02 glance-api[29183]: 2017-09-28 11:51:58.991 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:51:58] "OPTIONS / HTTP/1.0" 200 134 0.000564
Sep 28 11:51:59 ctl02 nova-api[7128]: 2017-09-28 11:51:59.110 7128 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:51:59 ctl02 nova-api[7128]: 2017-09-28 11:51:59.112 7128 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:51:59 ctl02 nova-api[7128]: 2017-09-28 11:51:59.112 7128 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:51:59 ctl02 nova-api[7128]: 2017-09-28 11:51:59.112 7128 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:51:59 ctl02 nova-api[7128]: 2017-09-28 11:51:59.116 7128 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:51:59 ctl02 nova-api[7128]: 2017-09-28 11:51:59.116 7128 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:51:59 ctl02 nova-api[7128]: 2017-09-28 11:51:59.116 7128 ERROR nova Traceback (most recent call last):
Sep 28 11:51:59 ctl02 nova-api[7128]: 2017-09-28 11:51:59.116 7128 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:51:59 ctl02 nova-api[7128]: 2017-09-28 11:51:59.116 7128 ERROR nova     sys.exit(main())
Sep 28 11:51:59 ctl02 nova-api[7128]: 2017-09-28 11:51:59.116 7128 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:51:59 ctl02 nova-api[7128]: 2017-09-28 11:51:59.116 7128 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:51:59 ctl02 nova-api[7128]: 2017-09-28 11:51:59.116 7128 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:51:59 ctl02 nova-api[7128]: 2017-09-28 11:51:59.116 7128 ERROR nova     max_url_len=max_url_len)
Sep 28 11:51:59 ctl02 nova-api[7128]: 2017-09-28 11:51:59.116 7128 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:51:59 ctl02 nova-api[7128]: 2017-09-28 11:51:59.116 7128 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:51:59 ctl02 nova-api[7128]: 2017-09-28 11:51:59.116 7128 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:51:59 ctl02 nova-api[7128]: 2017-09-28 11:51:59.116 7128 ERROR nova     sock.listen(backlog)
Sep 28 11:51:59 ctl02 nova-api[7128]: 2017-09-28 11:51:59.116 7128 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:51:59 ctl02 nova-api[7128]: 2017-09-28 11:51:59.116 7128 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:51:59 ctl02 nova-api[7128]: 2017-09-28 11:51:59.116 7128 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:51:59 ctl02 nova-api[7128]: 2017-09-28 11:51:59.116 7128 ERROR nova
Sep 28 11:51:59 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:51:59 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:51:59 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:51:59 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:51:59 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:51:59 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:51:59 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:52:00 ctl02 nova-api[7146]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:52:00 ctl02 nova-api[7146]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:52:01 ctl02 nova-api[7146]: 2017-09-28 11:52:01.079 7146 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:52:01 ctl02 nova-api[7146]: 2017-09-28 11:52:01.081 7146 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:52:01 ctl02 nova-api[7146]: 2017-09-28 11:52:01.081 7146 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:52:01 ctl02 nova-api[7146]: 2017-09-28 11:52:01.081 7146 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:52:01 ctl02 nova-api[7146]: 2017-09-28 11:52:01.081 7146 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:52:01 ctl02 nova-api[7146]: 2017-09-28 11:52:01.081 7146 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:52:01 ctl02 nova-api[7146]: 2017-09-28 11:52:01.081 7146 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:52:01 ctl02 nova-api[7146]: 2017-09-28 11:52:01.081 7146 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:52:01 ctl02 nova-api[7146]: 2017-09-28 11:52:01.081 7146 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:52:01 ctl02 nova-api[7146]: 2017-09-28 11:52:01.081 7146 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:52:01 ctl02 nova-api[7146]: 2017-09-28 11:52:01.081 7146 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:52:01 ctl02 nova-api[7146]: 2017-09-28 11:52:01.081 7146 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:52:01 ctl02 nova-api[7146]: 2017-09-28 11:52:01.081 7146 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:52:01 ctl02 nova-api[7146]: 2017-09-28 11:52:01.081 7146 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:52:01 ctl02 nova-api[7146]: 2017-09-28 11:52:01.081 7146 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:52:01 ctl02 nova-api[7146]: 2017-09-28 11:52:01.081 7146 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:52:01 ctl02 nova-api[7146]: 2017-09-28 11:52:01.081 7146 ERROR nova.wsgi     self.filename))
Sep 28 11:52:01 ctl02 nova-api[7146]: 2017-09-28 11:52:01.081 7146 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:52:01 ctl02 nova-api[7146]: 2017-09-28 11:52:01.081 7146 ERROR nova.wsgi
Sep 28 11:52:01 ctl02 nova-api[7146]: 2017-09-28 11:52:01.095 7146 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:52:01 ctl02 nova-api[7146]: 2017-09-28 11:52:01.240 7146 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:52:01 ctl02 nova-api[7146]: 2017-09-28 11:52:01.470 7146 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:52:01 ctl02 nova-api[7146]: 2017-09-28 11:52:01.472 7146 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:52:01 ctl02 nova-api[7146]: 2017-09-28 11:52:01.473 7146 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:52:01 ctl02 nova-api[7146]: 2017-09-28 11:52:01.473 7146 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:52:01 ctl02 nova-api[7146]: 2017-09-28 11:52:01.604 7146 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:52:01 ctl02 nova-api[7146]: 2017-09-28 11:52:01.606 7146 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:52:01 ctl02 nova-api[7146]: 2017-09-28 11:52:01.606 7146 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:52:01 ctl02 nova-api[7146]: 2017-09-28 11:52:01.606 7146 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:52:01 ctl02 nova-api[7146]: 2017-09-28 11:52:01.610 7146 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:52:01 ctl02 nova-api[7146]: 2017-09-28 11:52:01.610 7146 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:52:01 ctl02 nova-api[7146]: 2017-09-28 11:52:01.610 7146 ERROR nova Traceback (most recent call last):
Sep 28 11:52:01 ctl02 nova-api[7146]: 2017-09-28 11:52:01.610 7146 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:52:01 ctl02 nova-api[7146]: 2017-09-28 11:52:01.610 7146 ERROR nova     sys.exit(main())
Sep 28 11:52:01 ctl02 nova-api[7146]: 2017-09-28 11:52:01.610 7146 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:52:01 ctl02 nova-api[7146]: 2017-09-28 11:52:01.610 7146 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:52:01 ctl02 nova-api[7146]: 2017-09-28 11:52:01.610 7146 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:52:01 ctl02 nova-api[7146]: 2017-09-28 11:52:01.610 7146 ERROR nova     max_url_len=max_url_len)
Sep 28 11:52:01 ctl02 nova-api[7146]: 2017-09-28 11:52:01.610 7146 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:52:01 ctl02 nova-api[7146]: 2017-09-28 11:52:01.610 7146 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:52:01 ctl02 nova-api[7146]: 2017-09-28 11:52:01.610 7146 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:52:01 ctl02 nova-api[7146]: 2017-09-28 11:52:01.610 7146 ERROR nova     sock.listen(backlog)
Sep 28 11:52:01 ctl02 nova-api[7146]: 2017-09-28 11:52:01.610 7146 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:52:01 ctl02 nova-api[7146]: 2017-09-28 11:52:01.610 7146 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:52:01 ctl02 nova-api[7146]: 2017-09-28 11:52:01.610 7146 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:52:01 ctl02 nova-api[7146]: 2017-09-28 11:52:01.610 7146 ERROR nova
Sep 28 11:52:01 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:52:01 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:52:01 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:52:01 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:52:01 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:52:01 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:52:01 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:52:02 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc78de100)
Sep 28 11:52:03 ctl02 glance-api[29183]: 2017-09-28 11:52:03.312 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:52:03] "OPTIONS / HTTP/1.0" 200 134 0.000634
Sep 28 11:52:03 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc78de100)
Sep 28 11:52:03 ctl02 nova-api[7163]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:52:03 ctl02 nova-api[7163]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:52:03 ctl02 nova-api[7163]: 2017-09-28 11:52:03.554 7163 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:52:03 ctl02 nova-api[7163]: 2017-09-28 11:52:03.556 7163 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:52:03 ctl02 nova-api[7163]: 2017-09-28 11:52:03.556 7163 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:52:03 ctl02 nova-api[7163]: 2017-09-28 11:52:03.556 7163 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:52:03 ctl02 nova-api[7163]: 2017-09-28 11:52:03.556 7163 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:52:03 ctl02 nova-api[7163]: 2017-09-28 11:52:03.556 7163 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:52:03 ctl02 nova-api[7163]: 2017-09-28 11:52:03.556 7163 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:52:03 ctl02 nova-api[7163]: 2017-09-28 11:52:03.556 7163 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:52:03 ctl02 nova-api[7163]: 2017-09-28 11:52:03.556 7163 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:52:03 ctl02 nova-api[7163]: 2017-09-28 11:52:03.556 7163 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:52:03 ctl02 nova-api[7163]: 2017-09-28 11:52:03.556 7163 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:52:03 ctl02 nova-api[7163]: 2017-09-28 11:52:03.556 7163 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:52:03 ctl02 nova-api[7163]: 2017-09-28 11:52:03.556 7163 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:52:03 ctl02 nova-api[7163]: 2017-09-28 11:52:03.556 7163 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:52:03 ctl02 nova-api[7163]: 2017-09-28 11:52:03.556 7163 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:52:03 ctl02 nova-api[7163]: 2017-09-28 11:52:03.556 7163 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:52:03 ctl02 nova-api[7163]: 2017-09-28 11:52:03.556 7163 ERROR nova.wsgi     self.filename))
Sep 28 11:52:03 ctl02 nova-api[7163]: 2017-09-28 11:52:03.556 7163 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:52:03 ctl02 nova-api[7163]: 2017-09-28 11:52:03.556 7163 ERROR nova.wsgi
Sep 28 11:52:03 ctl02 nova-api[7163]: 2017-09-28 11:52:03.557 7163 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:52:03 ctl02 nova-api[7163]: 2017-09-28 11:52:03.684 7163 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:52:03 ctl02 nova-api[7163]: 2017-09-28 11:52:03.914 7163 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:52:03 ctl02 nova-api[7163]: 2017-09-28 11:52:03.916 7163 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:52:03 ctl02 nova-api[7163]: 2017-09-28 11:52:03.916 7163 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:52:03 ctl02 nova-api[7163]: 2017-09-28 11:52:03.917 7163 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:52:04 ctl02 nova-api[7163]: 2017-09-28 11:52:04.046 7163 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:52:04 ctl02 nova-api[7163]: 2017-09-28 11:52:04.047 7163 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:52:04 ctl02 nova-api[7163]: 2017-09-28 11:52:04.048 7163 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:52:04 ctl02 nova-api[7163]: 2017-09-28 11:52:04.048 7163 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:52:04 ctl02 nova-api[7163]: 2017-09-28 11:52:04.051 7163 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:52:04 ctl02 nova-api[7163]: 2017-09-28 11:52:04.051 7163 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:52:04 ctl02 nova-api[7163]: 2017-09-28 11:52:04.051 7163 ERROR nova Traceback (most recent call last):
Sep 28 11:52:04 ctl02 nova-api[7163]: 2017-09-28 11:52:04.051 7163 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:52:04 ctl02 nova-api[7163]: 2017-09-28 11:52:04.051 7163 ERROR nova     sys.exit(main())
Sep 28 11:52:04 ctl02 nova-api[7163]: 2017-09-28 11:52:04.051 7163 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:52:04 ctl02 nova-api[7163]: 2017-09-28 11:52:04.051 7163 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:52:04 ctl02 nova-api[7163]: 2017-09-28 11:52:04.051 7163 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:52:04 ctl02 nova-api[7163]: 2017-09-28 11:52:04.051 7163 ERROR nova     max_url_len=max_url_len)
Sep 28 11:52:04 ctl02 nova-api[7163]: 2017-09-28 11:52:04.051 7163 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:52:04 ctl02 nova-api[7163]: 2017-09-28 11:52:04.051 7163 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:52:04 ctl02 nova-api[7163]: 2017-09-28 11:52:04.051 7163 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:52:04 ctl02 nova-api[7163]: 2017-09-28 11:52:04.051 7163 ERROR nova     sock.listen(backlog)
Sep 28 11:52:04 ctl02 nova-api[7163]: 2017-09-28 11:52:04.051 7163 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:52:04 ctl02 nova-api[7163]: 2017-09-28 11:52:04.051 7163 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:52:04 ctl02 nova-api[7163]: 2017-09-28 11:52:04.051 7163 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:52:04 ctl02 nova-api[7163]: 2017-09-28 11:52:04.051 7163 ERROR nova
Sep 28 11:52:04 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:52:04 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:52:04 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:52:04 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc78de100)
Sep 28 11:52:04 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:52:04 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:52:04 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:52:04 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:52:05 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc78de100)
Sep 28 11:52:05 ctl02 nova-api[7181]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:52:05 ctl02 nova-api[7181]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:52:06 ctl02 nova-api[7181]: 2017-09-28 11:52:06.083 7181 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:52:06 ctl02 nova-api[7181]: 2017-09-28 11:52:06.084 7181 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:52:06 ctl02 nova-api[7181]: 2017-09-28 11:52:06.084 7181 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:52:06 ctl02 nova-api[7181]: 2017-09-28 11:52:06.084 7181 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:52:06 ctl02 nova-api[7181]: 2017-09-28 11:52:06.084 7181 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:52:06 ctl02 nova-api[7181]: 2017-09-28 11:52:06.084 7181 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:52:06 ctl02 nova-api[7181]: 2017-09-28 11:52:06.084 7181 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:52:06 ctl02 nova-api[7181]: 2017-09-28 11:52:06.084 7181 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:52:06 ctl02 nova-api[7181]: 2017-09-28 11:52:06.084 7181 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:52:06 ctl02 nova-api[7181]: 2017-09-28 11:52:06.084 7181 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:52:06 ctl02 nova-api[7181]: 2017-09-28 11:52:06.084 7181 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:52:06 ctl02 nova-api[7181]: 2017-09-28 11:52:06.084 7181 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:52:06 ctl02 nova-api[7181]: 2017-09-28 11:52:06.084 7181 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:52:06 ctl02 nova-api[7181]: 2017-09-28 11:52:06.084 7181 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:52:06 ctl02 nova-api[7181]: 2017-09-28 11:52:06.084 7181 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:52:06 ctl02 nova-api[7181]: 2017-09-28 11:52:06.084 7181 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:52:06 ctl02 nova-api[7181]: 2017-09-28 11:52:06.084 7181 ERROR nova.wsgi     self.filename))
Sep 28 11:52:06 ctl02 nova-api[7181]: 2017-09-28 11:52:06.084 7181 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:52:06 ctl02 nova-api[7181]: 2017-09-28 11:52:06.084 7181 ERROR nova.wsgi
Sep 28 11:52:06 ctl02 nova-api[7181]: 2017-09-28 11:52:06.091 7181 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:52:06 ctl02 nova-api[7181]: 2017-09-28 11:52:06.225 7181 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:52:06 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc78de100)
Sep 28 11:52:06 ctl02 nova-api[7181]: 2017-09-28 11:52:06.480 7181 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:52:06 ctl02 nova-api[7181]: 2017-09-28 11:52:06.483 7181 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:52:06 ctl02 nova-api[7181]: 2017-09-28 11:52:06.483 7181 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:52:06 ctl02 nova-api[7181]: 2017-09-28 11:52:06.483 7181 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:52:06 ctl02 nova-api[7181]: 2017-09-28 11:52:06.615 7181 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:52:06 ctl02 nova-api[7181]: 2017-09-28 11:52:06.617 7181 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:52:06 ctl02 nova-api[7181]: 2017-09-28 11:52:06.617 7181 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:52:06 ctl02 nova-api[7181]: 2017-09-28 11:52:06.618 7181 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:52:06 ctl02 nova-api[7181]: 2017-09-28 11:52:06.621 7181 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:52:06 ctl02 nova-api[7181]: 2017-09-28 11:52:06.621 7181 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:52:06 ctl02 nova-api[7181]: 2017-09-28 11:52:06.621 7181 ERROR nova Traceback (most recent call last):
Sep 28 11:52:06 ctl02 nova-api[7181]: 2017-09-28 11:52:06.621 7181 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:52:06 ctl02 nova-api[7181]: 2017-09-28 11:52:06.621 7181 ERROR nova     sys.exit(main())
Sep 28 11:52:06 ctl02 nova-api[7181]: 2017-09-28 11:52:06.621 7181 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:52:06 ctl02 nova-api[7181]: 2017-09-28 11:52:06.621 7181 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:52:06 ctl02 nova-api[7181]: 2017-09-28 11:52:06.621 7181 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:52:06 ctl02 nova-api[7181]: 2017-09-28 11:52:06.621 7181 ERROR nova     max_url_len=max_url_len)
Sep 28 11:52:06 ctl02 nova-api[7181]: 2017-09-28 11:52:06.621 7181 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:52:06 ctl02 nova-api[7181]: 2017-09-28 11:52:06.621 7181 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:52:06 ctl02 nova-api[7181]: 2017-09-28 11:52:06.621 7181 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:52:06 ctl02 nova-api[7181]: 2017-09-28 11:52:06.621 7181 ERROR nova     sock.listen(backlog)
Sep 28 11:52:06 ctl02 nova-api[7181]: 2017-09-28 11:52:06.621 7181 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:52:06 ctl02 nova-api[7181]: 2017-09-28 11:52:06.621 7181 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:52:06 ctl02 nova-api[7181]: 2017-09-28 11:52:06.621 7181 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:52:06 ctl02 nova-api[7181]: 2017-09-28 11:52:06.621 7181 ERROR nova
Sep 28 11:52:06 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:52:06 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:52:06 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:52:07 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:52:07 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:52:07 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:52:07 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:52:07 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc78de100)
Sep 28 11:52:08 ctl02 glance-api[29183]: 2017-09-28 11:52:08.068 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:52:08] "OPTIONS / HTTP/1.0" 200 134 0.000572
Sep 28 11:52:08 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc78de100)
Sep 28 11:52:08 ctl02 nova-api[7200]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:52:08 ctl02 nova-api[7200]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:52:08 ctl02 nova-api[7200]: 2017-09-28 11:52:08.841 7200 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:52:08 ctl02 nova-api[7200]: 2017-09-28 11:52:08.843 7200 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:52:08 ctl02 nova-api[7200]: 2017-09-28 11:52:08.843 7200 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:52:08 ctl02 nova-api[7200]: 2017-09-28 11:52:08.843 7200 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:52:08 ctl02 nova-api[7200]: 2017-09-28 11:52:08.843 7200 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:52:08 ctl02 nova-api[7200]: 2017-09-28 11:52:08.843 7200 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:52:08 ctl02 nova-api[7200]: 2017-09-28 11:52:08.843 7200 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:52:08 ctl02 nova-api[7200]: 2017-09-28 11:52:08.843 7200 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:52:08 ctl02 nova-api[7200]: 2017-09-28 11:52:08.843 7200 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:52:08 ctl02 nova-api[7200]: 2017-09-28 11:52:08.843 7200 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:52:08 ctl02 nova-api[7200]: 2017-09-28 11:52:08.843 7200 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:52:08 ctl02 nova-api[7200]: 2017-09-28 11:52:08.843 7200 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:52:08 ctl02 nova-api[7200]: 2017-09-28 11:52:08.843 7200 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:52:08 ctl02 nova-api[7200]: 2017-09-28 11:52:08.843 7200 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:52:08 ctl02 nova-api[7200]: 2017-09-28 11:52:08.843 7200 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:52:08 ctl02 nova-api[7200]: 2017-09-28 11:52:08.843 7200 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:52:08 ctl02 nova-api[7200]: 2017-09-28 11:52:08.843 7200 ERROR nova.wsgi     self.filename))
Sep 28 11:52:08 ctl02 nova-api[7200]: 2017-09-28 11:52:08.843 7200 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:52:08 ctl02 nova-api[7200]: 2017-09-28 11:52:08.843 7200 ERROR nova.wsgi
Sep 28 11:52:08 ctl02 nova-api[7200]: 2017-09-28 11:52:08.845 7200 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:52:08 ctl02 nova-api[7200]: 2017-09-28 11:52:08.971 7200 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:52:09 ctl02 nova-cert[4860]: 2017-09-28 11:52:09.087 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 28 seconds.
Sep 28 11:52:09 ctl02 glance-api[29183]: 2017-09-28 11:52:09.121 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:52:09] "OPTIONS / HTTP/1.0" 200 134 0.000567
Sep 28 11:52:09 ctl02 nova-api[7200]: 2017-09-28 11:52:09.202 7200 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:52:09 ctl02 nova-api[7200]: 2017-09-28 11:52:09.204 7200 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:52:09 ctl02 nova-api[7200]: 2017-09-28 11:52:09.205 7200 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:52:09 ctl02 nova-api[7200]: 2017-09-28 11:52:09.205 7200 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:52:09 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc78de100)
Sep 28 11:52:09 ctl02 nova-api[7200]: 2017-09-28 11:52:09.334 7200 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:52:09 ctl02 nova-api[7200]: 2017-09-28 11:52:09.335 7200 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:52:09 ctl02 nova-api[7200]: 2017-09-28 11:52:09.336 7200 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:52:09 ctl02 nova-api[7200]: 2017-09-28 11:52:09.336 7200 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:52:09 ctl02 nova-api[7200]: 2017-09-28 11:52:09.339 7200 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:52:09 ctl02 nova-api[7200]: 2017-09-28 11:52:09.339 7200 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:52:09 ctl02 nova-api[7200]: 2017-09-28 11:52:09.339 7200 ERROR nova Traceback (most recent call last):
Sep 28 11:52:09 ctl02 nova-api[7200]: 2017-09-28 11:52:09.339 7200 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:52:09 ctl02 nova-api[7200]: 2017-09-28 11:52:09.339 7200 ERROR nova     sys.exit(main())
Sep 28 11:52:09 ctl02 nova-api[7200]: 2017-09-28 11:52:09.339 7200 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:52:09 ctl02 nova-api[7200]: 2017-09-28 11:52:09.339 7200 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:52:09 ctl02 nova-api[7200]: 2017-09-28 11:52:09.339 7200 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:52:09 ctl02 nova-api[7200]: 2017-09-28 11:52:09.339 7200 ERROR nova     max_url_len=max_url_len)
Sep 28 11:52:09 ctl02 nova-api[7200]: 2017-09-28 11:52:09.339 7200 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:52:09 ctl02 nova-api[7200]: 2017-09-28 11:52:09.339 7200 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:52:09 ctl02 nova-api[7200]: 2017-09-28 11:52:09.339 7200 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:52:09 ctl02 nova-api[7200]: 2017-09-28 11:52:09.339 7200 ERROR nova     sock.listen(backlog)
Sep 28 11:52:09 ctl02 nova-api[7200]: 2017-09-28 11:52:09.339 7200 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:52:09 ctl02 nova-api[7200]: 2017-09-28 11:52:09.339 7200 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:52:09 ctl02 nova-api[7200]: 2017-09-28 11:52:09.339 7200 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:52:09 ctl02 nova-api[7200]: 2017-09-28 11:52:09.339 7200 ERROR nova
Sep 28 11:52:09 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:52:09 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:52:09 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:52:09 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:52:09 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:52:09 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:52:09 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:52:10 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc78de100)
Sep 28 11:52:11 ctl02 nova-api[7218]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:52:11 ctl02 nova-api[7218]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:52:11 ctl02 nova-api[7218]: 2017-09-28 11:52:11.332 7218 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:52:11 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc78de100)
Sep 28 11:52:11 ctl02 nova-api[7218]: 2017-09-28 11:52:11.334 7218 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:52:11 ctl02 nova-api[7218]: 2017-09-28 11:52:11.334 7218 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:52:11 ctl02 nova-api[7218]: 2017-09-28 11:52:11.334 7218 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:52:11 ctl02 nova-api[7218]: 2017-09-28 11:52:11.334 7218 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:52:11 ctl02 nova-api[7218]: 2017-09-28 11:52:11.334 7218 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:52:11 ctl02 nova-api[7218]: 2017-09-28 11:52:11.334 7218 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:52:11 ctl02 nova-api[7218]: 2017-09-28 11:52:11.334 7218 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:52:11 ctl02 nova-api[7218]: 2017-09-28 11:52:11.334 7218 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:52:11 ctl02 nova-api[7218]: 2017-09-28 11:52:11.334 7218 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:52:11 ctl02 nova-api[7218]: 2017-09-28 11:52:11.334 7218 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:52:11 ctl02 nova-api[7218]: 2017-09-28 11:52:11.334 7218 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:52:11 ctl02 nova-api[7218]: 2017-09-28 11:52:11.334 7218 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:52:11 ctl02 nova-api[7218]: 2017-09-28 11:52:11.334 7218 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:52:11 ctl02 nova-api[7218]: 2017-09-28 11:52:11.334 7218 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:52:11 ctl02 nova-api[7218]: 2017-09-28 11:52:11.334 7218 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:52:11 ctl02 nova-api[7218]: 2017-09-28 11:52:11.334 7218 ERROR nova.wsgi     self.filename))
Sep 28 11:52:11 ctl02 nova-api[7218]: 2017-09-28 11:52:11.334 7218 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:52:11 ctl02 nova-api[7218]: 2017-09-28 11:52:11.334 7218 ERROR nova.wsgi
Sep 28 11:52:11 ctl02 nova-api[7218]: 2017-09-28 11:52:11.337 7218 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:52:11 ctl02 nova-api[7218]: 2017-09-28 11:52:11.469 7218 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:52:11 ctl02 nova-api[7218]: 2017-09-28 11:52:11.703 7218 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:52:11 ctl02 nova-api[7218]: 2017-09-28 11:52:11.706 7218 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:52:11 ctl02 nova-api[7218]: 2017-09-28 11:52:11.706 7218 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:52:11 ctl02 nova-api[7218]: 2017-09-28 11:52:11.707 7218 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:52:11 ctl02 nova-api[7218]: 2017-09-28 11:52:11.839 7218 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:52:11 ctl02 nova-api[7218]: 2017-09-28 11:52:11.842 7218 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:52:11 ctl02 nova-api[7218]: 2017-09-28 11:52:11.842 7218 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:52:11 ctl02 nova-api[7218]: 2017-09-28 11:52:11.842 7218 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:52:11 ctl02 nova-api[7218]: 2017-09-28 11:52:11.846 7218 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:52:11 ctl02 nova-api[7218]: 2017-09-28 11:52:11.846 7218 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:52:11 ctl02 nova-api[7218]: 2017-09-28 11:52:11.846 7218 ERROR nova Traceback (most recent call last):
Sep 28 11:52:11 ctl02 nova-api[7218]: 2017-09-28 11:52:11.846 7218 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:52:11 ctl02 nova-api[7218]: 2017-09-28 11:52:11.846 7218 ERROR nova     sys.exit(main())
Sep 28 11:52:11 ctl02 nova-api[7218]: 2017-09-28 11:52:11.846 7218 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:52:11 ctl02 nova-api[7218]: 2017-09-28 11:52:11.846 7218 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:52:11 ctl02 nova-api[7218]: 2017-09-28 11:52:11.846 7218 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:52:11 ctl02 nova-api[7218]: 2017-09-28 11:52:11.846 7218 ERROR nova     max_url_len=max_url_len)
Sep 28 11:52:11 ctl02 nova-api[7218]: 2017-09-28 11:52:11.846 7218 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:52:11 ctl02 nova-api[7218]: 2017-09-28 11:52:11.846 7218 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:52:11 ctl02 nova-api[7218]: 2017-09-28 11:52:11.846 7218 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:52:11 ctl02 nova-api[7218]: 2017-09-28 11:52:11.846 7218 ERROR nova     sock.listen(backlog)
Sep 28 11:52:11 ctl02 nova-api[7218]: 2017-09-28 11:52:11.846 7218 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:52:11 ctl02 nova-api[7218]: 2017-09-28 11:52:11.846 7218 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:52:11 ctl02 nova-api[7218]: 2017-09-28 11:52:11.846 7218 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:52:11 ctl02 nova-api[7218]: 2017-09-28 11:52:11.846 7218 ERROR nova
Sep 28 11:52:11 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:52:11 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:52:11 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:52:12 ctl02 nova-conductor[5056]: 2017-09-28 11:52:12.093 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 28 seconds.
Sep 28 11:52:12 ctl02 nova-conductor[5056]: 2017-09-28 11:52:12.108 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 28 seconds.
Sep 28 11:52:12 ctl02 nova-conductor[5056]: 2017-09-28 11:52:12.123 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 28 seconds.
Sep 28 11:52:12 ctl02 nova-conductor[5056]: 2017-09-28 11:52:12.124 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 28 seconds.
Sep 28 11:52:12 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:52:12 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:52:12 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:52:12 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:52:12 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc78de100)
Sep 28 11:52:12 ctl02 glance-api[29183]: 2017-09-28 11:52:12.985 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:52:12] "OPTIONS / HTTP/1.0" 200 134 0.000631
Sep 28 11:52:13 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:52:13 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:52:13 ctl02 nova-api[7236]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:52:13 ctl02 nova-api[7236]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:52:13 ctl02 nova-api[7236]: 2017-09-28 11:52:13.760 7236 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:52:13 ctl02 nova-api[7236]: 2017-09-28 11:52:13.761 7236 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:52:13 ctl02 nova-api[7236]: 2017-09-28 11:52:13.761 7236 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:52:13 ctl02 nova-api[7236]: 2017-09-28 11:52:13.761 7236 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:52:13 ctl02 nova-api[7236]: 2017-09-28 11:52:13.761 7236 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:52:13 ctl02 nova-api[7236]: 2017-09-28 11:52:13.761 7236 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:52:13 ctl02 nova-api[7236]: 2017-09-28 11:52:13.761 7236 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:52:13 ctl02 nova-api[7236]: 2017-09-28 11:52:13.761 7236 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:52:13 ctl02 nova-api[7236]: 2017-09-28 11:52:13.761 7236 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:52:13 ctl02 nova-api[7236]: 2017-09-28 11:52:13.761 7236 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:52:13 ctl02 nova-api[7236]: 2017-09-28 11:52:13.761 7236 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:52:13 ctl02 nova-api[7236]: 2017-09-28 11:52:13.761 7236 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:52:13 ctl02 nova-api[7236]: 2017-09-28 11:52:13.761 7236 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:52:13 ctl02 nova-api[7236]: 2017-09-28 11:52:13.761 7236 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:52:13 ctl02 nova-api[7236]: 2017-09-28 11:52:13.761 7236 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:52:13 ctl02 nova-api[7236]: 2017-09-28 11:52:13.761 7236 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:52:13 ctl02 nova-api[7236]: 2017-09-28 11:52:13.761 7236 ERROR nova.wsgi     self.filename))
Sep 28 11:52:13 ctl02 nova-api[7236]: 2017-09-28 11:52:13.761 7236 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:52:13 ctl02 nova-api[7236]: 2017-09-28 11:52:13.761 7236 ERROR nova.wsgi
Sep 28 11:52:13 ctl02 nova-api[7236]: 2017-09-28 11:52:13.762 7236 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:52:13 ctl02 nova-api[7236]: 2017-09-28 11:52:13.887 7236 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:52:14 ctl02 nova-api[7236]: 2017-09-28 11:52:14.105 7236 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:52:14 ctl02 nova-api[7236]: 2017-09-28 11:52:14.107 7236 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:52:14 ctl02 nova-api[7236]: 2017-09-28 11:52:14.107 7236 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:52:14 ctl02 nova-api[7236]: 2017-09-28 11:52:14.107 7236 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:52:14 ctl02 nova-api[7236]: 2017-09-28 11:52:14.237 7236 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:52:14 ctl02 nova-api[7236]: 2017-09-28 11:52:14.240 7236 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:52:14 ctl02 nova-api[7236]: 2017-09-28 11:52:14.240 7236 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:52:14 ctl02 nova-api[7236]: 2017-09-28 11:52:14.240 7236 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:52:14 ctl02 nova-api[7236]: 2017-09-28 11:52:14.244 7236 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:52:14 ctl02 nova-api[7236]: 2017-09-28 11:52:14.244 7236 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:52:14 ctl02 nova-api[7236]: 2017-09-28 11:52:14.244 7236 ERROR nova Traceback (most recent call last):
Sep 28 11:52:14 ctl02 nova-api[7236]: 2017-09-28 11:52:14.244 7236 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:52:14 ctl02 nova-api[7236]: 2017-09-28 11:52:14.244 7236 ERROR nova     sys.exit(main())
Sep 28 11:52:14 ctl02 nova-api[7236]: 2017-09-28 11:52:14.244 7236 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:52:14 ctl02 nova-api[7236]: 2017-09-28 11:52:14.244 7236 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:52:14 ctl02 nova-api[7236]: 2017-09-28 11:52:14.244 7236 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:52:14 ctl02 nova-api[7236]: 2017-09-28 11:52:14.244 7236 ERROR nova     max_url_len=max_url_len)
Sep 28 11:52:14 ctl02 nova-api[7236]: 2017-09-28 11:52:14.244 7236 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:52:14 ctl02 nova-api[7236]: 2017-09-28 11:52:14.244 7236 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:52:14 ctl02 nova-api[7236]: 2017-09-28 11:52:14.244 7236 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:52:14 ctl02 nova-api[7236]: 2017-09-28 11:52:14.244 7236 ERROR nova     sock.listen(backlog)
Sep 28 11:52:14 ctl02 nova-api[7236]: 2017-09-28 11:52:14.244 7236 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:52:14 ctl02 nova-api[7236]: 2017-09-28 11:52:14.244 7236 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:52:14 ctl02 nova-api[7236]: 2017-09-28 11:52:14.244 7236 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:52:14 ctl02 nova-api[7236]: 2017-09-28 11:52:14.244 7236 ERROR nova
Sep 28 11:52:14 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:52:14 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:52:14 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:52:14 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:52:14 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:52:14 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:52:14 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:52:16 ctl02 nova-api[7259]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:52:16 ctl02 nova-api[7259]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:52:16 ctl02 nova-api[7259]: 2017-09-28 11:52:16.362 7259 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:52:16 ctl02 nova-api[7259]: 2017-09-28 11:52:16.364 7259 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:52:16 ctl02 nova-api[7259]: 2017-09-28 11:52:16.364 7259 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:52:16 ctl02 nova-api[7259]: 2017-09-28 11:52:16.364 7259 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:52:16 ctl02 nova-api[7259]: 2017-09-28 11:52:16.364 7259 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:52:16 ctl02 nova-api[7259]: 2017-09-28 11:52:16.364 7259 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:52:16 ctl02 nova-api[7259]: 2017-09-28 11:52:16.364 7259 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:52:16 ctl02 nova-api[7259]: 2017-09-28 11:52:16.364 7259 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:52:16 ctl02 nova-api[7259]: 2017-09-28 11:52:16.364 7259 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:52:16 ctl02 nova-api[7259]: 2017-09-28 11:52:16.364 7259 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:52:16 ctl02 nova-api[7259]: 2017-09-28 11:52:16.364 7259 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:52:16 ctl02 nova-api[7259]: 2017-09-28 11:52:16.364 7259 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:52:16 ctl02 nova-api[7259]: 2017-09-28 11:52:16.364 7259 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:52:16 ctl02 nova-api[7259]: 2017-09-28 11:52:16.364 7259 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:52:16 ctl02 nova-api[7259]: 2017-09-28 11:52:16.364 7259 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:52:16 ctl02 nova-api[7259]: 2017-09-28 11:52:16.364 7259 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:52:16 ctl02 nova-api[7259]: 2017-09-28 11:52:16.364 7259 ERROR nova.wsgi     self.filename))
Sep 28 11:52:16 ctl02 nova-api[7259]: 2017-09-28 11:52:16.364 7259 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:52:16 ctl02 nova-api[7259]: 2017-09-28 11:52:16.364 7259 ERROR nova.wsgi
Sep 28 11:52:16 ctl02 nova-api[7259]: 2017-09-28 11:52:16.366 7259 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:52:16 ctl02 nova-api[7259]: 2017-09-28 11:52:16.500 7259 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:52:16 ctl02 nova-api[7259]: 2017-09-28 11:52:16.741 7259 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:52:16 ctl02 nova-api[7259]: 2017-09-28 11:52:16.744 7259 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:52:16 ctl02 nova-api[7259]: 2017-09-28 11:52:16.745 7259 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:52:16 ctl02 nova-api[7259]: 2017-09-28 11:52:16.745 7259 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:52:16 ctl02 nova-api[7259]: 2017-09-28 11:52:16.875 7259 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:52:16 ctl02 nova-api[7259]: 2017-09-28 11:52:16.877 7259 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:52:16 ctl02 nova-api[7259]: 2017-09-28 11:52:16.878 7259 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:52:16 ctl02 nova-api[7259]: 2017-09-28 11:52:16.878 7259 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:52:16 ctl02 nova-api[7259]: 2017-09-28 11:52:16.881 7259 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:52:16 ctl02 nova-api[7259]: 2017-09-28 11:52:16.882 7259 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:52:16 ctl02 nova-api[7259]: 2017-09-28 11:52:16.882 7259 ERROR nova Traceback (most recent call last):
Sep 28 11:52:16 ctl02 nova-api[7259]: 2017-09-28 11:52:16.882 7259 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:52:16 ctl02 nova-api[7259]: 2017-09-28 11:52:16.882 7259 ERROR nova     sys.exit(main())
Sep 28 11:52:16 ctl02 nova-api[7259]: 2017-09-28 11:52:16.882 7259 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:52:16 ctl02 nova-api[7259]: 2017-09-28 11:52:16.882 7259 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:52:16 ctl02 nova-api[7259]: 2017-09-28 11:52:16.882 7259 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:52:16 ctl02 nova-api[7259]: 2017-09-28 11:52:16.882 7259 ERROR nova     max_url_len=max_url_len)
Sep 28 11:52:16 ctl02 nova-api[7259]: 2017-09-28 11:52:16.882 7259 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:52:16 ctl02 nova-api[7259]: 2017-09-28 11:52:16.882 7259 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:52:16 ctl02 nova-api[7259]: 2017-09-28 11:52:16.882 7259 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:52:16 ctl02 nova-api[7259]: 2017-09-28 11:52:16.882 7259 ERROR nova     sock.listen(backlog)
Sep 28 11:52:16 ctl02 nova-api[7259]: 2017-09-28 11:52:16.882 7259 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:52:16 ctl02 nova-api[7259]: 2017-09-28 11:52:16.882 7259 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:52:16 ctl02 nova-api[7259]: 2017-09-28 11:52:16.882 7259 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:52:16 ctl02 nova-api[7259]: 2017-09-28 11:52:16.882 7259 ERROR nova
Sep 28 11:52:17 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:52:17 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:52:17 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:52:17 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:52:17 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:52:17 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:52:17 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:52:17 ctl02 glance-api[29183]: 2017-09-28 11:52:17.843 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:52:17] "OPTIONS / HTTP/1.0" 200 134 0.000569
Sep 28 11:52:18 ctl02 glance-api[29183]: 2017-09-28 11:52:18.802 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:52:18] "OPTIONS / HTTP/1.0" 200 134 0.000604
Sep 28 11:52:18 ctl02 nova-api[7277]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:52:18 ctl02 nova-api[7277]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:52:18 ctl02 nova-consoleauth[5433]: 2017-09-28 11:52:18.988 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 28 seconds.
Sep 28 11:52:19 ctl02 nova-api[7277]: 2017-09-28 11:52:19.077 7277 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:52:19 ctl02 nova-api[7277]: 2017-09-28 11:52:19.078 7277 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:52:19 ctl02 nova-api[7277]: 2017-09-28 11:52:19.078 7277 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:52:19 ctl02 nova-api[7277]: 2017-09-28 11:52:19.078 7277 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:52:19 ctl02 nova-api[7277]: 2017-09-28 11:52:19.078 7277 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:52:19 ctl02 nova-api[7277]: 2017-09-28 11:52:19.078 7277 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:52:19 ctl02 nova-api[7277]: 2017-09-28 11:52:19.078 7277 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:52:19 ctl02 nova-api[7277]: 2017-09-28 11:52:19.078 7277 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:52:19 ctl02 nova-api[7277]: 2017-09-28 11:52:19.078 7277 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:52:19 ctl02 nova-api[7277]: 2017-09-28 11:52:19.078 7277 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:52:19 ctl02 nova-api[7277]: 2017-09-28 11:52:19.078 7277 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:52:19 ctl02 nova-api[7277]: 2017-09-28 11:52:19.078 7277 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:52:19 ctl02 nova-api[7277]: 2017-09-28 11:52:19.078 7277 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:52:19 ctl02 nova-api[7277]: 2017-09-28 11:52:19.078 7277 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:52:19 ctl02 nova-api[7277]: 2017-09-28 11:52:19.078 7277 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:52:19 ctl02 nova-api[7277]: 2017-09-28 11:52:19.078 7277 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:52:19 ctl02 nova-api[7277]: 2017-09-28 11:52:19.078 7277 ERROR nova.wsgi     self.filename))
Sep 28 11:52:19 ctl02 nova-api[7277]: 2017-09-28 11:52:19.078 7277 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:52:19 ctl02 nova-api[7277]: 2017-09-28 11:52:19.078 7277 ERROR nova.wsgi
Sep 28 11:52:19 ctl02 nova-api[7277]: 2017-09-28 11:52:19.079 7277 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:52:19 ctl02 nova-api[7277]: 2017-09-28 11:52:19.212 7277 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:52:19 ctl02 nova-api[7277]: 2017-09-28 11:52:19.453 7277 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:52:19 ctl02 nova-api[7277]: 2017-09-28 11:52:19.456 7277 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:52:19 ctl02 nova-api[7277]: 2017-09-28 11:52:19.456 7277 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:52:19 ctl02 nova-api[7277]: 2017-09-28 11:52:19.456 7277 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:52:19 ctl02 nova-api[7277]: 2017-09-28 11:52:19.587 7277 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:52:19 ctl02 nova-api[7277]: 2017-09-28 11:52:19.589 7277 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:52:19 ctl02 nova-api[7277]: 2017-09-28 11:52:19.589 7277 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:52:19 ctl02 nova-api[7277]: 2017-09-28 11:52:19.589 7277 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:52:19 ctl02 nova-api[7277]: 2017-09-28 11:52:19.592 7277 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:52:19 ctl02 nova-api[7277]: 2017-09-28 11:52:19.593 7277 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:52:19 ctl02 nova-api[7277]: 2017-09-28 11:52:19.593 7277 ERROR nova Traceback (most recent call last):
Sep 28 11:52:19 ctl02 nova-api[7277]: 2017-09-28 11:52:19.593 7277 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:52:19 ctl02 nova-api[7277]: 2017-09-28 11:52:19.593 7277 ERROR nova     sys.exit(main())
Sep 28 11:52:19 ctl02 nova-api[7277]: 2017-09-28 11:52:19.593 7277 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:52:19 ctl02 nova-api[7277]: 2017-09-28 11:52:19.593 7277 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:52:19 ctl02 nova-api[7277]: 2017-09-28 11:52:19.593 7277 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:52:19 ctl02 nova-api[7277]: 2017-09-28 11:52:19.593 7277 ERROR nova     max_url_len=max_url_len)
Sep 28 11:52:19 ctl02 nova-api[7277]: 2017-09-28 11:52:19.593 7277 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:52:19 ctl02 nova-api[7277]: 2017-09-28 11:52:19.593 7277 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:52:19 ctl02 nova-api[7277]: 2017-09-28 11:52:19.593 7277 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:52:19 ctl02 nova-api[7277]: 2017-09-28 11:52:19.593 7277 ERROR nova     sock.listen(backlog)
Sep 28 11:52:19 ctl02 nova-api[7277]: 2017-09-28 11:52:19.593 7277 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:52:19 ctl02 nova-api[7277]: 2017-09-28 11:52:19.593 7277 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:52:19 ctl02 nova-api[7277]: 2017-09-28 11:52:19.593 7277 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:52:19 ctl02 nova-api[7277]: 2017-09-28 11:52:19.593 7277 ERROR nova
Sep 28 11:52:19 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:52:19 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:52:19 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:52:19 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:52:19 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:52:19 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:52:19 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:52:21 ctl02 nova-api[7295]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:52:21 ctl02 nova-api[7295]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:52:21 ctl02 nova-api[7295]: 2017-09-28 11:52:21.579 7295 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:52:21 ctl02 nova-api[7295]: 2017-09-28 11:52:21.580 7295 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:52:21 ctl02 nova-api[7295]: 2017-09-28 11:52:21.580 7295 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:52:21 ctl02 nova-api[7295]: 2017-09-28 11:52:21.580 7295 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:52:21 ctl02 nova-api[7295]: 2017-09-28 11:52:21.580 7295 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:52:21 ctl02 nova-api[7295]: 2017-09-28 11:52:21.580 7295 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:52:21 ctl02 nova-api[7295]: 2017-09-28 11:52:21.580 7295 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:52:21 ctl02 nova-api[7295]: 2017-09-28 11:52:21.580 7295 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:52:21 ctl02 nova-api[7295]: 2017-09-28 11:52:21.580 7295 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:52:21 ctl02 nova-api[7295]: 2017-09-28 11:52:21.580 7295 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:52:21 ctl02 nova-api[7295]: 2017-09-28 11:52:21.580 7295 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:52:21 ctl02 nova-api[7295]: 2017-09-28 11:52:21.580 7295 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:52:21 ctl02 nova-api[7295]: 2017-09-28 11:52:21.580 7295 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:52:21 ctl02 nova-api[7295]: 2017-09-28 11:52:21.580 7295 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:52:21 ctl02 nova-api[7295]: 2017-09-28 11:52:21.580 7295 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:52:21 ctl02 nova-api[7295]: 2017-09-28 11:52:21.580 7295 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:52:21 ctl02 nova-api[7295]: 2017-09-28 11:52:21.580 7295 ERROR nova.wsgi     self.filename))
Sep 28 11:52:21 ctl02 nova-api[7295]: 2017-09-28 11:52:21.580 7295 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:52:21 ctl02 nova-api[7295]: 2017-09-28 11:52:21.580 7295 ERROR nova.wsgi
Sep 28 11:52:21 ctl02 nova-api[7295]: 2017-09-28 11:52:21.582 7295 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:52:21 ctl02 nova-api[7295]: 2017-09-28 11:52:21.709 7295 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:52:21 ctl02 nova-api[7295]: 2017-09-28 11:52:21.932 7295 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:52:21 ctl02 nova-api[7295]: 2017-09-28 11:52:21.935 7295 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:52:21 ctl02 nova-api[7295]: 2017-09-28 11:52:21.936 7295 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:52:21 ctl02 nova-api[7295]: 2017-09-28 11:52:21.936 7295 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:52:22 ctl02 nova-scheduler[5620]: 2017-09-28 11:52:22.009 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 28 seconds.
Sep 28 11:52:22 ctl02 nova-api[7295]: 2017-09-28 11:52:22.065 7295 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:52:22 ctl02 nova-api[7295]: 2017-09-28 11:52:22.067 7295 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:52:22 ctl02 nova-api[7295]: 2017-09-28 11:52:22.068 7295 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:52:22 ctl02 nova-api[7295]: 2017-09-28 11:52:22.068 7295 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:52:22 ctl02 nova-api[7295]: 2017-09-28 11:52:22.071 7295 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:52:22 ctl02 nova-api[7295]: 2017-09-28 11:52:22.072 7295 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:52:22 ctl02 nova-api[7295]: 2017-09-28 11:52:22.072 7295 ERROR nova Traceback (most recent call last):
Sep 28 11:52:22 ctl02 nova-api[7295]: 2017-09-28 11:52:22.072 7295 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:52:22 ctl02 nova-api[7295]: 2017-09-28 11:52:22.072 7295 ERROR nova     sys.exit(main())
Sep 28 11:52:22 ctl02 nova-api[7295]: 2017-09-28 11:52:22.072 7295 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:52:22 ctl02 nova-api[7295]: 2017-09-28 11:52:22.072 7295 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:52:22 ctl02 nova-api[7295]: 2017-09-28 11:52:22.072 7295 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:52:22 ctl02 nova-api[7295]: 2017-09-28 11:52:22.072 7295 ERROR nova     max_url_len=max_url_len)
Sep 28 11:52:22 ctl02 nova-api[7295]: 2017-09-28 11:52:22.072 7295 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:52:22 ctl02 nova-api[7295]: 2017-09-28 11:52:22.072 7295 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:52:22 ctl02 nova-api[7295]: 2017-09-28 11:52:22.072 7295 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:52:22 ctl02 nova-api[7295]: 2017-09-28 11:52:22.072 7295 ERROR nova     sock.listen(backlog)
Sep 28 11:52:22 ctl02 nova-api[7295]: 2017-09-28 11:52:22.072 7295 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:52:22 ctl02 nova-api[7295]: 2017-09-28 11:52:22.072 7295 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:52:22 ctl02 nova-api[7295]: 2017-09-28 11:52:22.072 7295 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:52:22 ctl02 nova-api[7295]: 2017-09-28 11:52:22.072 7295 ERROR nova
Sep 28 11:52:22 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:52:22 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:52:22 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:52:22 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:52:22 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:52:22 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:52:22 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:52:23 ctl02 glance-api[29183]: 2017-09-28 11:52:23.157 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:52:23] "OPTIONS / HTTP/1.0" 200 134 0.000561
Sep 28 11:52:23 ctl02 nova-api[7313]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:52:23 ctl02 nova-api[7313]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:52:24 ctl02 nova-api[7313]: 2017-09-28 11:52:24.102 7313 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:52:24 ctl02 nova-api[7313]: 2017-09-28 11:52:24.103 7313 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:52:24 ctl02 nova-api[7313]: 2017-09-28 11:52:24.103 7313 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:52:24 ctl02 nova-api[7313]: 2017-09-28 11:52:24.103 7313 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:52:24 ctl02 nova-api[7313]: 2017-09-28 11:52:24.103 7313 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:52:24 ctl02 nova-api[7313]: 2017-09-28 11:52:24.103 7313 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:52:24 ctl02 nova-api[7313]: 2017-09-28 11:52:24.103 7313 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:52:24 ctl02 nova-api[7313]: 2017-09-28 11:52:24.103 7313 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:52:24 ctl02 nova-api[7313]: 2017-09-28 11:52:24.103 7313 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:52:24 ctl02 nova-api[7313]: 2017-09-28 11:52:24.103 7313 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:52:24 ctl02 nova-api[7313]: 2017-09-28 11:52:24.103 7313 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:52:24 ctl02 nova-api[7313]: 2017-09-28 11:52:24.103 7313 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:52:24 ctl02 nova-api[7313]: 2017-09-28 11:52:24.103 7313 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:52:24 ctl02 nova-api[7313]: 2017-09-28 11:52:24.103 7313 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:52:24 ctl02 nova-api[7313]: 2017-09-28 11:52:24.103 7313 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:52:24 ctl02 nova-api[7313]: 2017-09-28 11:52:24.103 7313 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:52:24 ctl02 nova-api[7313]: 2017-09-28 11:52:24.103 7313 ERROR nova.wsgi     self.filename))
Sep 28 11:52:24 ctl02 nova-api[7313]: 2017-09-28 11:52:24.103 7313 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:52:24 ctl02 nova-api[7313]: 2017-09-28 11:52:24.103 7313 ERROR nova.wsgi
Sep 28 11:52:24 ctl02 nova-api[7313]: 2017-09-28 11:52:24.104 7313 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:52:24 ctl02 nova-api[7313]: 2017-09-28 11:52:24.236 7313 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:52:24 ctl02 nova-api[7313]: 2017-09-28 11:52:24.468 7313 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:52:24 ctl02 nova-api[7313]: 2017-09-28 11:52:24.470 7313 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:52:24 ctl02 nova-api[7313]: 2017-09-28 11:52:24.470 7313 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:52:24 ctl02 nova-api[7313]: 2017-09-28 11:52:24.471 7313 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:52:24 ctl02 nova-api[7313]: 2017-09-28 11:52:24.604 7313 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:52:24 ctl02 nova-api[7313]: 2017-09-28 11:52:24.605 7313 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:52:24 ctl02 nova-api[7313]: 2017-09-28 11:52:24.606 7313 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:52:24 ctl02 nova-api[7313]: 2017-09-28 11:52:24.606 7313 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:52:24 ctl02 nova-api[7313]: 2017-09-28 11:52:24.609 7313 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:52:24 ctl02 nova-api[7313]: 2017-09-28 11:52:24.609 7313 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:52:24 ctl02 nova-api[7313]: 2017-09-28 11:52:24.609 7313 ERROR nova Traceback (most recent call last):
Sep 28 11:52:24 ctl02 nova-api[7313]: 2017-09-28 11:52:24.609 7313 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:52:24 ctl02 nova-api[7313]: 2017-09-28 11:52:24.609 7313 ERROR nova     sys.exit(main())
Sep 28 11:52:24 ctl02 nova-api[7313]: 2017-09-28 11:52:24.609 7313 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:52:24 ctl02 nova-api[7313]: 2017-09-28 11:52:24.609 7313 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:52:24 ctl02 nova-api[7313]: 2017-09-28 11:52:24.609 7313 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:52:24 ctl02 nova-api[7313]: 2017-09-28 11:52:24.609 7313 ERROR nova     max_url_len=max_url_len)
Sep 28 11:52:24 ctl02 nova-api[7313]: 2017-09-28 11:52:24.609 7313 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:52:24 ctl02 nova-api[7313]: 2017-09-28 11:52:24.609 7313 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:52:24 ctl02 nova-api[7313]: 2017-09-28 11:52:24.609 7313 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:52:24 ctl02 nova-api[7313]: 2017-09-28 11:52:24.609 7313 ERROR nova     sock.listen(backlog)
Sep 28 11:52:24 ctl02 nova-api[7313]: 2017-09-28 11:52:24.609 7313 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:52:24 ctl02 nova-api[7313]: 2017-09-28 11:52:24.609 7313 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:52:24 ctl02 nova-api[7313]: 2017-09-28 11:52:24.609 7313 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:52:24 ctl02 nova-api[7313]: 2017-09-28 11:52:24.609 7313 ERROR nova
Sep 28 11:52:24 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:52:24 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:52:24 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:52:24 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:52:24 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:52:24 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:52:24 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:52:26 ctl02 nova-api[7330]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:52:26 ctl02 nova-api[7330]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:52:26 ctl02 nova-api[7330]: 2017-09-28 11:52:26.541 7330 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:52:26 ctl02 nova-api[7330]: 2017-09-28 11:52:26.554 7330 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:52:26 ctl02 nova-api[7330]: 2017-09-28 11:52:26.554 7330 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:52:26 ctl02 nova-api[7330]: 2017-09-28 11:52:26.554 7330 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:52:26 ctl02 nova-api[7330]: 2017-09-28 11:52:26.554 7330 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:52:26 ctl02 nova-api[7330]: 2017-09-28 11:52:26.554 7330 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:52:26 ctl02 nova-api[7330]: 2017-09-28 11:52:26.554 7330 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:52:26 ctl02 nova-api[7330]: 2017-09-28 11:52:26.554 7330 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:52:26 ctl02 nova-api[7330]: 2017-09-28 11:52:26.554 7330 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:52:26 ctl02 nova-api[7330]: 2017-09-28 11:52:26.554 7330 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:52:26 ctl02 nova-api[7330]: 2017-09-28 11:52:26.554 7330 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:52:26 ctl02 nova-api[7330]: 2017-09-28 11:52:26.554 7330 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:52:26 ctl02 nova-api[7330]: 2017-09-28 11:52:26.554 7330 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:52:26 ctl02 nova-api[7330]: 2017-09-28 11:52:26.554 7330 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:52:26 ctl02 nova-api[7330]: 2017-09-28 11:52:26.554 7330 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:52:26 ctl02 nova-api[7330]: 2017-09-28 11:52:26.554 7330 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:52:26 ctl02 nova-api[7330]: 2017-09-28 11:52:26.554 7330 ERROR nova.wsgi     self.filename))
Sep 28 11:52:26 ctl02 nova-api[7330]: 2017-09-28 11:52:26.554 7330 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:52:26 ctl02 nova-api[7330]: 2017-09-28 11:52:26.554 7330 ERROR nova.wsgi
Sep 28 11:52:26 ctl02 nova-api[7330]: 2017-09-28 11:52:26.555 7330 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:52:26 ctl02 nova-api[7330]: 2017-09-28 11:52:26.681 7330 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:52:26 ctl02 nova-api[7330]: 2017-09-28 11:52:26.910 7330 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:52:26 ctl02 nova-api[7330]: 2017-09-28 11:52:26.913 7330 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:52:26 ctl02 nova-api[7330]: 2017-09-28 11:52:26.913 7330 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:52:26 ctl02 nova-api[7330]: 2017-09-28 11:52:26.913 7330 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:52:27 ctl02 nova-api[7330]: 2017-09-28 11:52:27.041 7330 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:52:27 ctl02 nova-api[7330]: 2017-09-28 11:52:27.043 7330 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:52:27 ctl02 nova-api[7330]: 2017-09-28 11:52:27.043 7330 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:52:27 ctl02 nova-api[7330]: 2017-09-28 11:52:27.043 7330 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:52:27 ctl02 nova-api[7330]: 2017-09-28 11:52:27.047 7330 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:52:27 ctl02 nova-api[7330]: 2017-09-28 11:52:27.047 7330 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:52:27 ctl02 nova-api[7330]: 2017-09-28 11:52:27.047 7330 ERROR nova Traceback (most recent call last):
Sep 28 11:52:27 ctl02 nova-api[7330]: 2017-09-28 11:52:27.047 7330 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:52:27 ctl02 nova-api[7330]: 2017-09-28 11:52:27.047 7330 ERROR nova     sys.exit(main())
Sep 28 11:52:27 ctl02 nova-api[7330]: 2017-09-28 11:52:27.047 7330 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:52:27 ctl02 nova-api[7330]: 2017-09-28 11:52:27.047 7330 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:52:27 ctl02 nova-api[7330]: 2017-09-28 11:52:27.047 7330 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:52:27 ctl02 nova-api[7330]: 2017-09-28 11:52:27.047 7330 ERROR nova     max_url_len=max_url_len)
Sep 28 11:52:27 ctl02 nova-api[7330]: 2017-09-28 11:52:27.047 7330 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:52:27 ctl02 nova-api[7330]: 2017-09-28 11:52:27.047 7330 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:52:27 ctl02 nova-api[7330]: 2017-09-28 11:52:27.047 7330 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:52:27 ctl02 nova-api[7330]: 2017-09-28 11:52:27.047 7330 ERROR nova     sock.listen(backlog)
Sep 28 11:52:27 ctl02 nova-api[7330]: 2017-09-28 11:52:27.047 7330 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:52:27 ctl02 nova-api[7330]: 2017-09-28 11:52:27.047 7330 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:52:27 ctl02 nova-api[7330]: 2017-09-28 11:52:27.047 7330 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:52:27 ctl02 nova-api[7330]: 2017-09-28 11:52:27.047 7330 ERROR nova
Sep 28 11:52:27 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:52:27 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:52:27 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:52:27 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:52:27 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:52:27 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:52:27 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:52:27 ctl02 glance-api[29183]: 2017-09-28 11:52:27.751 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:52:27] "OPTIONS / HTTP/1.0" 200 134 0.000651
Sep 28 11:52:28 ctl02 glance-api[29183]: 2017-09-28 11:52:28.450 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:52:28] "OPTIONS / HTTP/1.0" 200 134 0.000721
Sep 28 11:52:28 ctl02 nova-api[7348]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:52:28 ctl02 nova-api[7348]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:52:29 ctl02 nova-api[7348]: 2017-09-28 11:52:29.113 7348 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:52:29 ctl02 nova-api[7348]: 2017-09-28 11:52:29.115 7348 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:52:29 ctl02 nova-api[7348]: 2017-09-28 11:52:29.115 7348 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:52:29 ctl02 nova-api[7348]: 2017-09-28 11:52:29.115 7348 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:52:29 ctl02 nova-api[7348]: 2017-09-28 11:52:29.115 7348 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:52:29 ctl02 nova-api[7348]: 2017-09-28 11:52:29.115 7348 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:52:29 ctl02 nova-api[7348]: 2017-09-28 11:52:29.115 7348 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:52:29 ctl02 nova-api[7348]: 2017-09-28 11:52:29.115 7348 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:52:29 ctl02 nova-api[7348]: 2017-09-28 11:52:29.115 7348 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:52:29 ctl02 nova-api[7348]: 2017-09-28 11:52:29.115 7348 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:52:29 ctl02 nova-api[7348]: 2017-09-28 11:52:29.115 7348 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:52:29 ctl02 nova-api[7348]: 2017-09-28 11:52:29.115 7348 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:52:29 ctl02 nova-api[7348]: 2017-09-28 11:52:29.115 7348 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:52:29 ctl02 nova-api[7348]: 2017-09-28 11:52:29.115 7348 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:52:29 ctl02 nova-api[7348]: 2017-09-28 11:52:29.115 7348 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:52:29 ctl02 nova-api[7348]: 2017-09-28 11:52:29.115 7348 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:52:29 ctl02 nova-api[7348]: 2017-09-28 11:52:29.115 7348 ERROR nova.wsgi     self.filename))
Sep 28 11:52:29 ctl02 nova-api[7348]: 2017-09-28 11:52:29.115 7348 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:52:29 ctl02 nova-api[7348]: 2017-09-28 11:52:29.115 7348 ERROR nova.wsgi
Sep 28 11:52:29 ctl02 nova-api[7348]: 2017-09-28 11:52:29.117 7348 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:52:29 ctl02 nova-api[7348]: 2017-09-28 11:52:29.249 7348 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:52:29 ctl02 nova-api[7348]: 2017-09-28 11:52:29.489 7348 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:52:29 ctl02 nova-api[7348]: 2017-09-28 11:52:29.492 7348 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:52:29 ctl02 nova-api[7348]: 2017-09-28 11:52:29.492 7348 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:52:29 ctl02 nova-api[7348]: 2017-09-28 11:52:29.493 7348 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:52:29 ctl02 nova-api[7348]: 2017-09-28 11:52:29.622 7348 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:52:29 ctl02 nova-api[7348]: 2017-09-28 11:52:29.624 7348 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:52:29 ctl02 nova-api[7348]: 2017-09-28 11:52:29.625 7348 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:52:29 ctl02 nova-api[7348]: 2017-09-28 11:52:29.625 7348 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:52:29 ctl02 nova-api[7348]: 2017-09-28 11:52:29.629 7348 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:52:29 ctl02 nova-api[7348]: 2017-09-28 11:52:29.629 7348 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:52:29 ctl02 nova-api[7348]: 2017-09-28 11:52:29.629 7348 ERROR nova Traceback (most recent call last):
Sep 28 11:52:29 ctl02 nova-api[7348]: 2017-09-28 11:52:29.629 7348 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:52:29 ctl02 nova-api[7348]: 2017-09-28 11:52:29.629 7348 ERROR nova     sys.exit(main())
Sep 28 11:52:29 ctl02 nova-api[7348]: 2017-09-28 11:52:29.629 7348 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:52:29 ctl02 nova-api[7348]: 2017-09-28 11:52:29.629 7348 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:52:29 ctl02 nova-api[7348]: 2017-09-28 11:52:29.629 7348 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:52:29 ctl02 nova-api[7348]: 2017-09-28 11:52:29.629 7348 ERROR nova     max_url_len=max_url_len)
Sep 28 11:52:29 ctl02 nova-api[7348]: 2017-09-28 11:52:29.629 7348 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:52:29 ctl02 nova-api[7348]: 2017-09-28 11:52:29.629 7348 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:52:29 ctl02 nova-api[7348]: 2017-09-28 11:52:29.629 7348 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:52:29 ctl02 nova-api[7348]: 2017-09-28 11:52:29.629 7348 ERROR nova     sock.listen(backlog)
Sep 28 11:52:29 ctl02 nova-api[7348]: 2017-09-28 11:52:29.629 7348 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:52:29 ctl02 nova-api[7348]: 2017-09-28 11:52:29.629 7348 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:52:29 ctl02 nova-api[7348]: 2017-09-28 11:52:29.629 7348 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:52:29 ctl02 nova-api[7348]: 2017-09-28 11:52:29.629 7348 ERROR nova
Sep 28 11:52:29 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:52:29 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:52:29 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:52:30 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:52:30 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:52:30 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:52:30 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:52:31 ctl02 nova-api[7367]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:52:31 ctl02 nova-api[7367]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:52:31 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x55bdd140)
Sep 28 11:52:31 ctl02 nova-api[7367]: 2017-09-28 11:52:31.848 7367 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:52:31 ctl02 nova-api[7367]: 2017-09-28 11:52:31.849 7367 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:52:31 ctl02 nova-api[7367]: 2017-09-28 11:52:31.849 7367 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:52:31 ctl02 nova-api[7367]: 2017-09-28 11:52:31.849 7367 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:52:31 ctl02 nova-api[7367]: 2017-09-28 11:52:31.849 7367 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:52:31 ctl02 nova-api[7367]: 2017-09-28 11:52:31.849 7367 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:52:31 ctl02 nova-api[7367]: 2017-09-28 11:52:31.849 7367 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:52:31 ctl02 nova-api[7367]: 2017-09-28 11:52:31.849 7367 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:52:31 ctl02 nova-api[7367]: 2017-09-28 11:52:31.849 7367 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:52:31 ctl02 nova-api[7367]: 2017-09-28 11:52:31.849 7367 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:52:31 ctl02 nova-api[7367]: 2017-09-28 11:52:31.849 7367 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:52:31 ctl02 nova-api[7367]: 2017-09-28 11:52:31.849 7367 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:52:31 ctl02 nova-api[7367]: 2017-09-28 11:52:31.849 7367 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:52:31 ctl02 nova-api[7367]: 2017-09-28 11:52:31.849 7367 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:52:31 ctl02 nova-api[7367]: 2017-09-28 11:52:31.849 7367 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:52:31 ctl02 nova-api[7367]: 2017-09-28 11:52:31.849 7367 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:52:31 ctl02 nova-api[7367]: 2017-09-28 11:52:31.849 7367 ERROR nova.wsgi     self.filename))
Sep 28 11:52:31 ctl02 nova-api[7367]: 2017-09-28 11:52:31.849 7367 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:52:31 ctl02 nova-api[7367]: 2017-09-28 11:52:31.849 7367 ERROR nova.wsgi
Sep 28 11:52:31 ctl02 nova-api[7367]: 2017-09-28 11:52:31.850 7367 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:52:31 ctl02 nova-api[7367]: 2017-09-28 11:52:31.982 7367 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:52:32 ctl02 nova-api[7367]: 2017-09-28 11:52:32.224 7367 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:52:32 ctl02 nova-api[7367]: 2017-09-28 11:52:32.227 7367 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:52:32 ctl02 nova-api[7367]: 2017-09-28 11:52:32.227 7367 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:52:32 ctl02 nova-api[7367]: 2017-09-28 11:52:32.227 7367 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:52:32 ctl02 nova-api[7367]: 2017-09-28 11:52:32.359 7367 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:52:32 ctl02 nova-api[7367]: 2017-09-28 11:52:32.360 7367 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:52:32 ctl02 nova-api[7367]: 2017-09-28 11:52:32.361 7367 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:52:32 ctl02 nova-api[7367]: 2017-09-28 11:52:32.361 7367 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:52:32 ctl02 nova-api[7367]: 2017-09-28 11:52:32.364 7367 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:52:32 ctl02 nova-api[7367]: 2017-09-28 11:52:32.365 7367 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:52:32 ctl02 nova-api[7367]: 2017-09-28 11:52:32.365 7367 ERROR nova Traceback (most recent call last):
Sep 28 11:52:32 ctl02 nova-api[7367]: 2017-09-28 11:52:32.365 7367 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:52:32 ctl02 nova-api[7367]: 2017-09-28 11:52:32.365 7367 ERROR nova     sys.exit(main())
Sep 28 11:52:32 ctl02 nova-api[7367]: 2017-09-28 11:52:32.365 7367 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:52:32 ctl02 nova-api[7367]: 2017-09-28 11:52:32.365 7367 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:52:32 ctl02 nova-api[7367]: 2017-09-28 11:52:32.365 7367 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:52:32 ctl02 nova-api[7367]: 2017-09-28 11:52:32.365 7367 ERROR nova     max_url_len=max_url_len)
Sep 28 11:52:32 ctl02 nova-api[7367]: 2017-09-28 11:52:32.365 7367 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:52:32 ctl02 nova-api[7367]: 2017-09-28 11:52:32.365 7367 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:52:32 ctl02 nova-api[7367]: 2017-09-28 11:52:32.365 7367 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:52:32 ctl02 nova-api[7367]: 2017-09-28 11:52:32.365 7367 ERROR nova     sock.listen(backlog)
Sep 28 11:52:32 ctl02 nova-api[7367]: 2017-09-28 11:52:32.365 7367 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:52:32 ctl02 nova-api[7367]: 2017-09-28 11:52:32.365 7367 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:52:32 ctl02 nova-api[7367]: 2017-09-28 11:52:32.365 7367 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:52:32 ctl02 nova-api[7367]: 2017-09-28 11:52:32.365 7367 ERROR nova
Sep 28 11:52:32 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:52:32 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:52:32 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:52:32 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:52:32 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:52:32 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:52:32 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:52:32 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x55bdd140)
Sep 28 11:52:33 ctl02 glance-api[29183]: 2017-09-28 11:52:33.524 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:52:33] "OPTIONS / HTTP/1.0" 200 134 0.001105
Sep 28 11:52:33 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x55bdd140)
Sep 28 11:52:34 ctl02 nova-api[7385]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:52:34 ctl02 nova-api[7385]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:52:34 ctl02 nova-api[7385]: 2017-09-28 11:52:34.334 7385 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:52:34 ctl02 nova-api[7385]: 2017-09-28 11:52:34.336 7385 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:52:34 ctl02 nova-api[7385]: 2017-09-28 11:52:34.336 7385 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:52:34 ctl02 nova-api[7385]: 2017-09-28 11:52:34.336 7385 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:52:34 ctl02 nova-api[7385]: 2017-09-28 11:52:34.336 7385 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:52:34 ctl02 nova-api[7385]: 2017-09-28 11:52:34.336 7385 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:52:34 ctl02 nova-api[7385]: 2017-09-28 11:52:34.336 7385 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:52:34 ctl02 nova-api[7385]: 2017-09-28 11:52:34.336 7385 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:52:34 ctl02 nova-api[7385]: 2017-09-28 11:52:34.336 7385 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:52:34 ctl02 nova-api[7385]: 2017-09-28 11:52:34.336 7385 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:52:34 ctl02 nova-api[7385]: 2017-09-28 11:52:34.336 7385 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:52:34 ctl02 nova-api[7385]: 2017-09-28 11:52:34.336 7385 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:52:34 ctl02 nova-api[7385]: 2017-09-28 11:52:34.336 7385 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:52:34 ctl02 nova-api[7385]: 2017-09-28 11:52:34.336 7385 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:52:34 ctl02 nova-api[7385]: 2017-09-28 11:52:34.336 7385 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:52:34 ctl02 nova-api[7385]: 2017-09-28 11:52:34.336 7385 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:52:34 ctl02 nova-api[7385]: 2017-09-28 11:52:34.336 7385 ERROR nova.wsgi     self.filename))
Sep 28 11:52:34 ctl02 nova-api[7385]: 2017-09-28 11:52:34.336 7385 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:52:34 ctl02 nova-api[7385]: 2017-09-28 11:52:34.336 7385 ERROR nova.wsgi
Sep 28 11:52:34 ctl02 nova-api[7385]: 2017-09-28 11:52:34.337 7385 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:52:34 ctl02 nova-api[7385]: 2017-09-28 11:52:34.468 7385 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:52:34 ctl02 nova-api[7385]: 2017-09-28 11:52:34.709 7385 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:52:34 ctl02 nova-api[7385]: 2017-09-28 11:52:34.711 7385 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:52:34 ctl02 nova-api[7385]: 2017-09-28 11:52:34.711 7385 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:52:34 ctl02 nova-api[7385]: 2017-09-28 11:52:34.711 7385 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:52:34 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x55bdd140)
Sep 28 11:52:34 ctl02 nova-api[7385]: 2017-09-28 11:52:34.842 7385 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:52:34 ctl02 nova-api[7385]: 2017-09-28 11:52:34.844 7385 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:52:34 ctl02 nova-api[7385]: 2017-09-28 11:52:34.844 7385 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:52:34 ctl02 nova-api[7385]: 2017-09-28 11:52:34.844 7385 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:52:34 ctl02 nova-api[7385]: 2017-09-28 11:52:34.847 7385 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:52:34 ctl02 nova-api[7385]: 2017-09-28 11:52:34.848 7385 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:52:34 ctl02 nova-api[7385]: 2017-09-28 11:52:34.848 7385 ERROR nova Traceback (most recent call last):
Sep 28 11:52:34 ctl02 nova-api[7385]: 2017-09-28 11:52:34.848 7385 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:52:34 ctl02 nova-api[7385]: 2017-09-28 11:52:34.848 7385 ERROR nova     sys.exit(main())
Sep 28 11:52:34 ctl02 nova-api[7385]: 2017-09-28 11:52:34.848 7385 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:52:34 ctl02 nova-api[7385]: 2017-09-28 11:52:34.848 7385 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:52:34 ctl02 nova-api[7385]: 2017-09-28 11:52:34.848 7385 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:52:34 ctl02 nova-api[7385]: 2017-09-28 11:52:34.848 7385 ERROR nova     max_url_len=max_url_len)
Sep 28 11:52:34 ctl02 nova-api[7385]: 2017-09-28 11:52:34.848 7385 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:52:34 ctl02 nova-api[7385]: 2017-09-28 11:52:34.848 7385 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:52:34 ctl02 nova-api[7385]: 2017-09-28 11:52:34.848 7385 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:52:34 ctl02 nova-api[7385]: 2017-09-28 11:52:34.848 7385 ERROR nova     sock.listen(backlog)
Sep 28 11:52:34 ctl02 nova-api[7385]: 2017-09-28 11:52:34.848 7385 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:52:34 ctl02 nova-api[7385]: 2017-09-28 11:52:34.848 7385 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:52:34 ctl02 nova-api[7385]: 2017-09-28 11:52:34.848 7385 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:52:34 ctl02 nova-api[7385]: 2017-09-28 11:52:34.848 7385 ERROR nova
Sep 28 11:52:35 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:52:35 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:52:35 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:52:35 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:52:35 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:52:35 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:52:35 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:52:35 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x55bdd140)
Sep 28 11:52:36 ctl02 nova-api[7403]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:52:36 ctl02 nova-api[7403]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:52:36 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x55bdd140)
Sep 28 11:52:36 ctl02 nova-api[7403]: 2017-09-28 11:52:36.852 7403 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:52:36 ctl02 nova-api[7403]: 2017-09-28 11:52:36.854 7403 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:52:36 ctl02 nova-api[7403]: 2017-09-28 11:52:36.854 7403 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:52:36 ctl02 nova-api[7403]: 2017-09-28 11:52:36.854 7403 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:52:36 ctl02 nova-api[7403]: 2017-09-28 11:52:36.854 7403 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:52:36 ctl02 nova-api[7403]: 2017-09-28 11:52:36.854 7403 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:52:36 ctl02 nova-api[7403]: 2017-09-28 11:52:36.854 7403 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:52:36 ctl02 nova-api[7403]: 2017-09-28 11:52:36.854 7403 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:52:36 ctl02 nova-api[7403]: 2017-09-28 11:52:36.854 7403 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:52:36 ctl02 nova-api[7403]: 2017-09-28 11:52:36.854 7403 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:52:36 ctl02 nova-api[7403]: 2017-09-28 11:52:36.854 7403 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:52:36 ctl02 nova-api[7403]: 2017-09-28 11:52:36.854 7403 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:52:36 ctl02 nova-api[7403]: 2017-09-28 11:52:36.854 7403 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:52:36 ctl02 nova-api[7403]: 2017-09-28 11:52:36.854 7403 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:52:36 ctl02 nova-api[7403]: 2017-09-28 11:52:36.854 7403 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:52:36 ctl02 nova-api[7403]: 2017-09-28 11:52:36.854 7403 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:52:36 ctl02 nova-api[7403]: 2017-09-28 11:52:36.854 7403 ERROR nova.wsgi     self.filename))
Sep 28 11:52:36 ctl02 nova-api[7403]: 2017-09-28 11:52:36.854 7403 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:52:36 ctl02 nova-api[7403]: 2017-09-28 11:52:36.854 7403 ERROR nova.wsgi
Sep 28 11:52:36 ctl02 nova-api[7403]: 2017-09-28 11:52:36.855 7403 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:52:36 ctl02 nova-api[7403]: 2017-09-28 11:52:36.989 7403 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:52:37 ctl02 nova-cert[4860]: 2017-09-28 11:52:37.121 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 30 seconds.
Sep 28 11:52:37 ctl02 nova-api[7403]: 2017-09-28 11:52:37.230 7403 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:52:37 ctl02 nova-api[7403]: 2017-09-28 11:52:37.233 7403 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:52:37 ctl02 nova-api[7403]: 2017-09-28 11:52:37.233 7403 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:52:37 ctl02 nova-api[7403]: 2017-09-28 11:52:37.233 7403 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:52:37 ctl02 nova-api[7403]: 2017-09-28 11:52:37.364 7403 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:52:37 ctl02 nova-api[7403]: 2017-09-28 11:52:37.367 7403 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:52:37 ctl02 nova-api[7403]: 2017-09-28 11:52:37.367 7403 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:52:37 ctl02 nova-api[7403]: 2017-09-28 11:52:37.368 7403 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:52:37 ctl02 nova-api[7403]: 2017-09-28 11:52:37.371 7403 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:52:37 ctl02 nova-api[7403]: 2017-09-28 11:52:37.371 7403 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:52:37 ctl02 nova-api[7403]: 2017-09-28 11:52:37.371 7403 ERROR nova Traceback (most recent call last):
Sep 28 11:52:37 ctl02 nova-api[7403]: 2017-09-28 11:52:37.371 7403 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:52:37 ctl02 nova-api[7403]: 2017-09-28 11:52:37.371 7403 ERROR nova     sys.exit(main())
Sep 28 11:52:37 ctl02 nova-api[7403]: 2017-09-28 11:52:37.371 7403 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:52:37 ctl02 nova-api[7403]: 2017-09-28 11:52:37.371 7403 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:52:37 ctl02 nova-api[7403]: 2017-09-28 11:52:37.371 7403 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:52:37 ctl02 nova-api[7403]: 2017-09-28 11:52:37.371 7403 ERROR nova     max_url_len=max_url_len)
Sep 28 11:52:37 ctl02 nova-api[7403]: 2017-09-28 11:52:37.371 7403 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:52:37 ctl02 nova-api[7403]: 2017-09-28 11:52:37.371 7403 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:52:37 ctl02 nova-api[7403]: 2017-09-28 11:52:37.371 7403 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:52:37 ctl02 nova-api[7403]: 2017-09-28 11:52:37.371 7403 ERROR nova     sock.listen(backlog)
Sep 28 11:52:37 ctl02 nova-api[7403]: 2017-09-28 11:52:37.371 7403 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:52:37 ctl02 nova-api[7403]: 2017-09-28 11:52:37.371 7403 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:52:37 ctl02 nova-api[7403]: 2017-09-28 11:52:37.371 7403 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:52:37 ctl02 nova-api[7403]: 2017-09-28 11:52:37.371 7403 ERROR nova
Sep 28 11:52:37 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:52:37 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:52:37 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:52:37 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x55bdd140)
Sep 28 11:52:37 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:52:37 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:52:37 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:52:37 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:52:38 ctl02 glance-api[29183]: 2017-09-28 11:52:38.058 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:52:38] "OPTIONS / HTTP/1.0" 200 134 0.001029
Sep 28 11:52:38 ctl02 glance-api[29183]: 2017-09-28 11:52:38.198 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:52:38] "OPTIONS / HTTP/1.0" 200 134 0.000579
Sep 28 11:52:38 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x55bdd140)
Sep 28 11:52:39 ctl02 nova-api[7421]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:52:39 ctl02 nova-api[7421]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:52:39 ctl02 nova-api[7421]: 2017-09-28 11:52:39.589 7421 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:52:39 ctl02 nova-api[7421]: 2017-09-28 11:52:39.591 7421 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:52:39 ctl02 nova-api[7421]: 2017-09-28 11:52:39.591 7421 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:52:39 ctl02 nova-api[7421]: 2017-09-28 11:52:39.591 7421 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:52:39 ctl02 nova-api[7421]: 2017-09-28 11:52:39.591 7421 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:52:39 ctl02 nova-api[7421]: 2017-09-28 11:52:39.591 7421 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:52:39 ctl02 nova-api[7421]: 2017-09-28 11:52:39.591 7421 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:52:39 ctl02 nova-api[7421]: 2017-09-28 11:52:39.591 7421 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:52:39 ctl02 nova-api[7421]: 2017-09-28 11:52:39.591 7421 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:52:39 ctl02 nova-api[7421]: 2017-09-28 11:52:39.591 7421 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:52:39 ctl02 nova-api[7421]: 2017-09-28 11:52:39.591 7421 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:52:39 ctl02 nova-api[7421]: 2017-09-28 11:52:39.591 7421 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:52:39 ctl02 nova-api[7421]: 2017-09-28 11:52:39.591 7421 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:52:39 ctl02 nova-api[7421]: 2017-09-28 11:52:39.591 7421 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:52:39 ctl02 nova-api[7421]: 2017-09-28 11:52:39.591 7421 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:52:39 ctl02 nova-api[7421]: 2017-09-28 11:52:39.591 7421 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:52:39 ctl02 nova-api[7421]: 2017-09-28 11:52:39.591 7421 ERROR nova.wsgi     self.filename))
Sep 28 11:52:39 ctl02 nova-api[7421]: 2017-09-28 11:52:39.591 7421 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:52:39 ctl02 nova-api[7421]: 2017-09-28 11:52:39.591 7421 ERROR nova.wsgi
Sep 28 11:52:39 ctl02 nova-api[7421]: 2017-09-28 11:52:39.593 7421 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:52:39 ctl02 nova-api[7421]: 2017-09-28 11:52:39.727 7421 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:52:39 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x55bdd140)
Sep 28 11:52:39 ctl02 nova-api[7421]: 2017-09-28 11:52:39.970 7421 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:52:39 ctl02 nova-api[7421]: 2017-09-28 11:52:39.973 7421 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:52:39 ctl02 nova-api[7421]: 2017-09-28 11:52:39.973 7421 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:52:39 ctl02 nova-api[7421]: 2017-09-28 11:52:39.974 7421 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:52:40 ctl02 nova-conductor[5056]: 2017-09-28 11:52:40.101 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 30 seconds.
Sep 28 11:52:40 ctl02 nova-api[7421]: 2017-09-28 11:52:40.107 7421 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:52:40 ctl02 nova-api[7421]: 2017-09-28 11:52:40.110 7421 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:52:40 ctl02 nova-api[7421]: 2017-09-28 11:52:40.110 7421 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:52:40 ctl02 nova-api[7421]: 2017-09-28 11:52:40.111 7421 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:52:40 ctl02 nova-api[7421]: 2017-09-28 11:52:40.115 7421 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:52:40 ctl02 nova-api[7421]: 2017-09-28 11:52:40.115 7421 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:52:40 ctl02 nova-api[7421]: 2017-09-28 11:52:40.115 7421 ERROR nova Traceback (most recent call last):
Sep 28 11:52:40 ctl02 nova-api[7421]: 2017-09-28 11:52:40.115 7421 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:52:40 ctl02 nova-api[7421]: 2017-09-28 11:52:40.115 7421 ERROR nova     sys.exit(main())
Sep 28 11:52:40 ctl02 nova-api[7421]: 2017-09-28 11:52:40.115 7421 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:52:40 ctl02 nova-api[7421]: 2017-09-28 11:52:40.115 7421 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:52:40 ctl02 nova-api[7421]: 2017-09-28 11:52:40.115 7421 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:52:40 ctl02 nova-api[7421]: 2017-09-28 11:52:40.115 7421 ERROR nova     max_url_len=max_url_len)
Sep 28 11:52:40 ctl02 nova-api[7421]: 2017-09-28 11:52:40.115 7421 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:52:40 ctl02 nova-api[7421]: 2017-09-28 11:52:40.115 7421 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:52:40 ctl02 nova-api[7421]: 2017-09-28 11:52:40.115 7421 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:52:40 ctl02 nova-api[7421]: 2017-09-28 11:52:40.115 7421 ERROR nova     sock.listen(backlog)
Sep 28 11:52:40 ctl02 nova-api[7421]: 2017-09-28 11:52:40.115 7421 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:52:40 ctl02 nova-api[7421]: 2017-09-28 11:52:40.115 7421 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:52:40 ctl02 nova-api[7421]: 2017-09-28 11:52:40.115 7421 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:52:40 ctl02 nova-api[7421]: 2017-09-28 11:52:40.115 7421 ERROR nova
Sep 28 11:52:40 ctl02 nova-conductor[5056]: 2017-09-28 11:52:40.116 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 30 seconds.
Sep 28 11:52:40 ctl02 nova-conductor[5056]: 2017-09-28 11:52:40.132 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 30 seconds.
Sep 28 11:52:40 ctl02 nova-conductor[5056]: 2017-09-28 11:52:40.133 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 30 seconds.
Sep 28 11:52:40 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:52:40 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:52:40 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:52:40 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:52:40 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:52:40 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:52:40 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:52:40 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x55bdd140)
Sep 28 11:52:41 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x55bdd140)
Sep 28 11:52:42 ctl02 nova-api[7439]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:52:42 ctl02 nova-api[7439]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:52:42 ctl02 nova-api[7439]: 2017-09-28 11:52:42.384 7439 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:52:42 ctl02 nova-api[7439]: 2017-09-28 11:52:42.386 7439 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:52:42 ctl02 nova-api[7439]: 2017-09-28 11:52:42.386 7439 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:52:42 ctl02 nova-api[7439]: 2017-09-28 11:52:42.386 7439 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:52:42 ctl02 nova-api[7439]: 2017-09-28 11:52:42.386 7439 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:52:42 ctl02 nova-api[7439]: 2017-09-28 11:52:42.386 7439 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:52:42 ctl02 nova-api[7439]: 2017-09-28 11:52:42.386 7439 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:52:42 ctl02 nova-api[7439]: 2017-09-28 11:52:42.386 7439 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:52:42 ctl02 nova-api[7439]: 2017-09-28 11:52:42.386 7439 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:52:42 ctl02 nova-api[7439]: 2017-09-28 11:52:42.386 7439 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:52:42 ctl02 nova-api[7439]: 2017-09-28 11:52:42.386 7439 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:52:42 ctl02 nova-api[7439]: 2017-09-28 11:52:42.386 7439 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:52:42 ctl02 nova-api[7439]: 2017-09-28 11:52:42.386 7439 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:52:42 ctl02 nova-api[7439]: 2017-09-28 11:52:42.386 7439 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:52:42 ctl02 nova-api[7439]: 2017-09-28 11:52:42.386 7439 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:52:42 ctl02 nova-api[7439]: 2017-09-28 11:52:42.386 7439 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:52:42 ctl02 nova-api[7439]: 2017-09-28 11:52:42.386 7439 ERROR nova.wsgi     self.filename))
Sep 28 11:52:42 ctl02 nova-api[7439]: 2017-09-28 11:52:42.386 7439 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:52:42 ctl02 nova-api[7439]: 2017-09-28 11:52:42.386 7439 ERROR nova.wsgi
Sep 28 11:52:42 ctl02 nova-api[7439]: 2017-09-28 11:52:42.388 7439 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:52:42 ctl02 nova-api[7439]: 2017-09-28 11:52:42.522 7439 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:52:42 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:52:42 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:52:42 ctl02 nova-api[7439]: 2017-09-28 11:52:42.764 7439 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:52:42 ctl02 nova-api[7439]: 2017-09-28 11:52:42.766 7439 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:52:42 ctl02 nova-api[7439]: 2017-09-28 11:52:42.767 7439 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:52:42 ctl02 nova-api[7439]: 2017-09-28 11:52:42.767 7439 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:52:42 ctl02 nova-api[7439]: 2017-09-28 11:52:42.897 7439 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:52:42 ctl02 nova-api[7439]: 2017-09-28 11:52:42.899 7439 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:52:42 ctl02 nova-api[7439]: 2017-09-28 11:52:42.899 7439 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:52:42 ctl02 nova-api[7439]: 2017-09-28 11:52:42.900 7439 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:52:42 ctl02 nova-api[7439]: 2017-09-28 11:52:42.903 7439 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:52:42 ctl02 nova-api[7439]: 2017-09-28 11:52:42.903 7439 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:52:42 ctl02 nova-api[7439]: 2017-09-28 11:52:42.903 7439 ERROR nova Traceback (most recent call last):
Sep 28 11:52:42 ctl02 nova-api[7439]: 2017-09-28 11:52:42.903 7439 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:52:42 ctl02 nova-api[7439]: 2017-09-28 11:52:42.903 7439 ERROR nova     sys.exit(main())
Sep 28 11:52:42 ctl02 nova-api[7439]: 2017-09-28 11:52:42.903 7439 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:52:42 ctl02 nova-api[7439]: 2017-09-28 11:52:42.903 7439 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:52:42 ctl02 nova-api[7439]: 2017-09-28 11:52:42.903 7439 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:52:42 ctl02 nova-api[7439]: 2017-09-28 11:52:42.903 7439 ERROR nova     max_url_len=max_url_len)
Sep 28 11:52:42 ctl02 nova-api[7439]: 2017-09-28 11:52:42.903 7439 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:52:42 ctl02 nova-api[7439]: 2017-09-28 11:52:42.903 7439 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:52:42 ctl02 nova-api[7439]: 2017-09-28 11:52:42.903 7439 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:52:42 ctl02 nova-api[7439]: 2017-09-28 11:52:42.903 7439 ERROR nova     sock.listen(backlog)
Sep 28 11:52:42 ctl02 nova-api[7439]: 2017-09-28 11:52:42.903 7439 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:52:42 ctl02 nova-api[7439]: 2017-09-28 11:52:42.903 7439 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:52:42 ctl02 nova-api[7439]: 2017-09-28 11:52:42.903 7439 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:52:42 ctl02 nova-api[7439]: 2017-09-28 11:52:42.903 7439 ERROR nova
Sep 28 11:52:43 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:52:43 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:52:43 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:52:43 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:52:43 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:52:43 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:52:43 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:52:43 ctl02 glance-api[29183]: 2017-09-28 11:52:43.683 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:52:43] "OPTIONS / HTTP/1.0" 200 134 0.000759
Sep 28 11:52:44 ctl02 nova-api[7462]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:52:44 ctl02 nova-api[7462]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:52:45 ctl02 nova-api[7462]: 2017-09-28 11:52:45.095 7462 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:52:45 ctl02 nova-api[7462]: 2017-09-28 11:52:45.096 7462 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:52:45 ctl02 nova-api[7462]: 2017-09-28 11:52:45.096 7462 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:52:45 ctl02 nova-api[7462]: 2017-09-28 11:52:45.096 7462 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:52:45 ctl02 nova-api[7462]: 2017-09-28 11:52:45.096 7462 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:52:45 ctl02 nova-api[7462]: 2017-09-28 11:52:45.096 7462 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:52:45 ctl02 nova-api[7462]: 2017-09-28 11:52:45.096 7462 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:52:45 ctl02 nova-api[7462]: 2017-09-28 11:52:45.096 7462 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:52:45 ctl02 nova-api[7462]: 2017-09-28 11:52:45.096 7462 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:52:45 ctl02 nova-api[7462]: 2017-09-28 11:52:45.096 7462 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:52:45 ctl02 nova-api[7462]: 2017-09-28 11:52:45.096 7462 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:52:45 ctl02 nova-api[7462]: 2017-09-28 11:52:45.096 7462 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:52:45 ctl02 nova-api[7462]: 2017-09-28 11:52:45.096 7462 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:52:45 ctl02 nova-api[7462]: 2017-09-28 11:52:45.096 7462 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:52:45 ctl02 nova-api[7462]: 2017-09-28 11:52:45.096 7462 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:52:45 ctl02 nova-api[7462]: 2017-09-28 11:52:45.096 7462 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:52:45 ctl02 nova-api[7462]: 2017-09-28 11:52:45.096 7462 ERROR nova.wsgi     self.filename))
Sep 28 11:52:45 ctl02 nova-api[7462]: 2017-09-28 11:52:45.096 7462 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:52:45 ctl02 nova-api[7462]: 2017-09-28 11:52:45.096 7462 ERROR nova.wsgi
Sep 28 11:52:45 ctl02 nova-api[7462]: 2017-09-28 11:52:45.097 7462 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:52:45 ctl02 nova-api[7462]: 2017-09-28 11:52:45.229 7462 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:52:45 ctl02 nova-api[7462]: 2017-09-28 11:52:45.472 7462 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:52:45 ctl02 nova-api[7462]: 2017-09-28 11:52:45.474 7462 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:52:45 ctl02 nova-api[7462]: 2017-09-28 11:52:45.474 7462 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:52:45 ctl02 nova-api[7462]: 2017-09-28 11:52:45.474 7462 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:52:45 ctl02 nova-api[7462]: 2017-09-28 11:52:45.606 7462 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:52:45 ctl02 nova-api[7462]: 2017-09-28 11:52:45.608 7462 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:52:45 ctl02 nova-api[7462]: 2017-09-28 11:52:45.608 7462 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:52:45 ctl02 nova-api[7462]: 2017-09-28 11:52:45.608 7462 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:52:45 ctl02 nova-api[7462]: 2017-09-28 11:52:45.611 7462 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:52:45 ctl02 nova-api[7462]: 2017-09-28 11:52:45.612 7462 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:52:45 ctl02 nova-api[7462]: 2017-09-28 11:52:45.612 7462 ERROR nova Traceback (most recent call last):
Sep 28 11:52:45 ctl02 nova-api[7462]: 2017-09-28 11:52:45.612 7462 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:52:45 ctl02 nova-api[7462]: 2017-09-28 11:52:45.612 7462 ERROR nova     sys.exit(main())
Sep 28 11:52:45 ctl02 nova-api[7462]: 2017-09-28 11:52:45.612 7462 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:52:45 ctl02 nova-api[7462]: 2017-09-28 11:52:45.612 7462 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:52:45 ctl02 nova-api[7462]: 2017-09-28 11:52:45.612 7462 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:52:45 ctl02 nova-api[7462]: 2017-09-28 11:52:45.612 7462 ERROR nova     max_url_len=max_url_len)
Sep 28 11:52:45 ctl02 nova-api[7462]: 2017-09-28 11:52:45.612 7462 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:52:45 ctl02 nova-api[7462]: 2017-09-28 11:52:45.612 7462 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:52:45 ctl02 nova-api[7462]: 2017-09-28 11:52:45.612 7462 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:52:45 ctl02 nova-api[7462]: 2017-09-28 11:52:45.612 7462 ERROR nova     sock.listen(backlog)
Sep 28 11:52:45 ctl02 nova-api[7462]: 2017-09-28 11:52:45.612 7462 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:52:45 ctl02 nova-api[7462]: 2017-09-28 11:52:45.612 7462 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:52:45 ctl02 nova-api[7462]: 2017-09-28 11:52:45.612 7462 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:52:45 ctl02 nova-api[7462]: 2017-09-28 11:52:45.612 7462 ERROR nova
Sep 28 11:52:45 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:52:45 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:52:45 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:52:45 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:52:45 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:52:45 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:52:45 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:52:47 ctl02 nova-consoleauth[5433]: 2017-09-28 11:52:47.019 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 30 seconds.
Sep 28 11:52:47 ctl02 nova-api[7480]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:52:47 ctl02 nova-api[7480]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:52:47 ctl02 nova-api[7480]: 2017-09-28 11:52:47.587 7480 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:52:47 ctl02 nova-api[7480]: 2017-09-28 11:52:47.588 7480 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:52:47 ctl02 nova-api[7480]: 2017-09-28 11:52:47.588 7480 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:52:47 ctl02 nova-api[7480]: 2017-09-28 11:52:47.588 7480 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:52:47 ctl02 nova-api[7480]: 2017-09-28 11:52:47.588 7480 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:52:47 ctl02 nova-api[7480]: 2017-09-28 11:52:47.588 7480 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:52:47 ctl02 nova-api[7480]: 2017-09-28 11:52:47.588 7480 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:52:47 ctl02 nova-api[7480]: 2017-09-28 11:52:47.588 7480 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:52:47 ctl02 nova-api[7480]: 2017-09-28 11:52:47.588 7480 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:52:47 ctl02 nova-api[7480]: 2017-09-28 11:52:47.588 7480 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:52:47 ctl02 nova-api[7480]: 2017-09-28 11:52:47.588 7480 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:52:47 ctl02 nova-api[7480]: 2017-09-28 11:52:47.588 7480 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:52:47 ctl02 nova-api[7480]: 2017-09-28 11:52:47.588 7480 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:52:47 ctl02 nova-api[7480]: 2017-09-28 11:52:47.588 7480 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:52:47 ctl02 nova-api[7480]: 2017-09-28 11:52:47.588 7480 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:52:47 ctl02 nova-api[7480]: 2017-09-28 11:52:47.588 7480 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:52:47 ctl02 nova-api[7480]: 2017-09-28 11:52:47.588 7480 ERROR nova.wsgi     self.filename))
Sep 28 11:52:47 ctl02 nova-api[7480]: 2017-09-28 11:52:47.588 7480 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:52:47 ctl02 nova-api[7480]: 2017-09-28 11:52:47.588 7480 ERROR nova.wsgi
Sep 28 11:52:47 ctl02 nova-api[7480]: 2017-09-28 11:52:47.589 7480 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:52:47 ctl02 nova-api[7480]: 2017-09-28 11:52:47.721 7480 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:52:47 ctl02 glance-api[29183]: 2017-09-28 11:52:47.892 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:52:47] "OPTIONS / HTTP/1.0" 200 134 0.000597
Sep 28 11:52:47 ctl02 glance-api[29183]: 2017-09-28 11:52:47.936 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:52:47] "OPTIONS / HTTP/1.0" 200 134 0.000408
Sep 28 11:52:47 ctl02 nova-api[7480]: 2017-09-28 11:52:47.966 7480 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:52:47 ctl02 nova-api[7480]: 2017-09-28 11:52:47.969 7480 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:52:47 ctl02 nova-api[7480]: 2017-09-28 11:52:47.969 7480 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:52:47 ctl02 nova-api[7480]: 2017-09-28 11:52:47.969 7480 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:52:48 ctl02 nova-api[7480]: 2017-09-28 11:52:48.101 7480 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:52:48 ctl02 nova-api[7480]: 2017-09-28 11:52:48.103 7480 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:52:48 ctl02 nova-api[7480]: 2017-09-28 11:52:48.103 7480 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:52:48 ctl02 nova-api[7480]: 2017-09-28 11:52:48.104 7480 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:52:48 ctl02 nova-api[7480]: 2017-09-28 11:52:48.107 7480 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:52:48 ctl02 nova-api[7480]: 2017-09-28 11:52:48.107 7480 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:52:48 ctl02 nova-api[7480]: 2017-09-28 11:52:48.107 7480 ERROR nova Traceback (most recent call last):
Sep 28 11:52:48 ctl02 nova-api[7480]: 2017-09-28 11:52:48.107 7480 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:52:48 ctl02 nova-api[7480]: 2017-09-28 11:52:48.107 7480 ERROR nova     sys.exit(main())
Sep 28 11:52:48 ctl02 nova-api[7480]: 2017-09-28 11:52:48.107 7480 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:52:48 ctl02 nova-api[7480]: 2017-09-28 11:52:48.107 7480 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:52:48 ctl02 nova-api[7480]: 2017-09-28 11:52:48.107 7480 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:52:48 ctl02 nova-api[7480]: 2017-09-28 11:52:48.107 7480 ERROR nova     max_url_len=max_url_len)
Sep 28 11:52:48 ctl02 nova-api[7480]: 2017-09-28 11:52:48.107 7480 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:52:48 ctl02 nova-api[7480]: 2017-09-28 11:52:48.107 7480 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:52:48 ctl02 nova-api[7480]: 2017-09-28 11:52:48.107 7480 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:52:48 ctl02 nova-api[7480]: 2017-09-28 11:52:48.107 7480 ERROR nova     sock.listen(backlog)
Sep 28 11:52:48 ctl02 nova-api[7480]: 2017-09-28 11:52:48.107 7480 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:52:48 ctl02 nova-api[7480]: 2017-09-28 11:52:48.107 7480 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:52:48 ctl02 nova-api[7480]: 2017-09-28 11:52:48.107 7480 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:52:48 ctl02 nova-api[7480]: 2017-09-28 11:52:48.107 7480 ERROR nova
Sep 28 11:52:48 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:52:48 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:52:48 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:52:48 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:52:48 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:52:48 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:52:48 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:52:49 ctl02 nova-api[7498]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:52:49 ctl02 nova-api[7498]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:52:50 ctl02 nova-scheduler[5620]: 2017-09-28 11:52:50.043 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 30 seconds.
Sep 28 11:52:50 ctl02 nova-api[7498]: 2017-09-28 11:52:50.113 7498 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:52:50 ctl02 nova-api[7498]: 2017-09-28 11:52:50.114 7498 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:52:50 ctl02 nova-api[7498]: 2017-09-28 11:52:50.114 7498 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:52:50 ctl02 nova-api[7498]: 2017-09-28 11:52:50.114 7498 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:52:50 ctl02 nova-api[7498]: 2017-09-28 11:52:50.114 7498 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:52:50 ctl02 nova-api[7498]: 2017-09-28 11:52:50.114 7498 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:52:50 ctl02 nova-api[7498]: 2017-09-28 11:52:50.114 7498 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:52:50 ctl02 nova-api[7498]: 2017-09-28 11:52:50.114 7498 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:52:50 ctl02 nova-api[7498]: 2017-09-28 11:52:50.114 7498 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:52:50 ctl02 nova-api[7498]: 2017-09-28 11:52:50.114 7498 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:52:50 ctl02 nova-api[7498]: 2017-09-28 11:52:50.114 7498 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:52:50 ctl02 nova-api[7498]: 2017-09-28 11:52:50.114 7498 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:52:50 ctl02 nova-api[7498]: 2017-09-28 11:52:50.114 7498 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:52:50 ctl02 nova-api[7498]: 2017-09-28 11:52:50.114 7498 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:52:50 ctl02 nova-api[7498]: 2017-09-28 11:52:50.114 7498 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:52:50 ctl02 nova-api[7498]: 2017-09-28 11:52:50.114 7498 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:52:50 ctl02 nova-api[7498]: 2017-09-28 11:52:50.114 7498 ERROR nova.wsgi     self.filename))
Sep 28 11:52:50 ctl02 nova-api[7498]: 2017-09-28 11:52:50.114 7498 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:52:50 ctl02 nova-api[7498]: 2017-09-28 11:52:50.114 7498 ERROR nova.wsgi
Sep 28 11:52:50 ctl02 nova-api[7498]: 2017-09-28 11:52:50.115 7498 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:52:50 ctl02 nova-api[7498]: 2017-09-28 11:52:50.246 7498 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:52:50 ctl02 nova-api[7498]: 2017-09-28 11:52:50.486 7498 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:52:50 ctl02 nova-api[7498]: 2017-09-28 11:52:50.488 7498 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:52:50 ctl02 nova-api[7498]: 2017-09-28 11:52:50.488 7498 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:52:50 ctl02 nova-api[7498]: 2017-09-28 11:52:50.489 7498 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:52:50 ctl02 nova-api[7498]: 2017-09-28 11:52:50.617 7498 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:52:50 ctl02 nova-api[7498]: 2017-09-28 11:52:50.619 7498 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:52:50 ctl02 nova-api[7498]: 2017-09-28 11:52:50.619 7498 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:52:50 ctl02 nova-api[7498]: 2017-09-28 11:52:50.620 7498 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:52:50 ctl02 nova-api[7498]: 2017-09-28 11:52:50.623 7498 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:52:50 ctl02 nova-api[7498]: 2017-09-28 11:52:50.623 7498 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:52:50 ctl02 nova-api[7498]: 2017-09-28 11:52:50.623 7498 ERROR nova Traceback (most recent call last):
Sep 28 11:52:50 ctl02 nova-api[7498]: 2017-09-28 11:52:50.623 7498 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:52:50 ctl02 nova-api[7498]: 2017-09-28 11:52:50.623 7498 ERROR nova     sys.exit(main())
Sep 28 11:52:50 ctl02 nova-api[7498]: 2017-09-28 11:52:50.623 7498 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:52:50 ctl02 nova-api[7498]: 2017-09-28 11:52:50.623 7498 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:52:50 ctl02 nova-api[7498]: 2017-09-28 11:52:50.623 7498 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:52:50 ctl02 nova-api[7498]: 2017-09-28 11:52:50.623 7498 ERROR nova     max_url_len=max_url_len)
Sep 28 11:52:50 ctl02 nova-api[7498]: 2017-09-28 11:52:50.623 7498 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:52:50 ctl02 nova-api[7498]: 2017-09-28 11:52:50.623 7498 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:52:50 ctl02 nova-api[7498]: 2017-09-28 11:52:50.623 7498 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:52:50 ctl02 nova-api[7498]: 2017-09-28 11:52:50.623 7498 ERROR nova     sock.listen(backlog)
Sep 28 11:52:50 ctl02 nova-api[7498]: 2017-09-28 11:52:50.623 7498 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:52:50 ctl02 nova-api[7498]: 2017-09-28 11:52:50.623 7498 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:52:50 ctl02 nova-api[7498]: 2017-09-28 11:52:50.623 7498 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:52:50 ctl02 nova-api[7498]: 2017-09-28 11:52:50.623 7498 ERROR nova
Sep 28 11:52:50 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:52:50 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:52:50 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:52:51 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:52:51 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:52:51 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:52:51 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:52:52 ctl02 nova-api[7516]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:52:52 ctl02 nova-api[7516]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:52:52 ctl02 nova-api[7516]: 2017-09-28 11:52:52.863 7516 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:52:52 ctl02 nova-api[7516]: 2017-09-28 11:52:52.865 7516 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:52:52 ctl02 nova-api[7516]: 2017-09-28 11:52:52.865 7516 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:52:52 ctl02 nova-api[7516]: 2017-09-28 11:52:52.865 7516 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:52:52 ctl02 nova-api[7516]: 2017-09-28 11:52:52.865 7516 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:52:52 ctl02 nova-api[7516]: 2017-09-28 11:52:52.865 7516 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:52:52 ctl02 nova-api[7516]: 2017-09-28 11:52:52.865 7516 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:52:52 ctl02 nova-api[7516]: 2017-09-28 11:52:52.865 7516 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:52:52 ctl02 nova-api[7516]: 2017-09-28 11:52:52.865 7516 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:52:52 ctl02 nova-api[7516]: 2017-09-28 11:52:52.865 7516 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:52:52 ctl02 nova-api[7516]: 2017-09-28 11:52:52.865 7516 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:52:52 ctl02 nova-api[7516]: 2017-09-28 11:52:52.865 7516 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:52:52 ctl02 nova-api[7516]: 2017-09-28 11:52:52.865 7516 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:52:52 ctl02 nova-api[7516]: 2017-09-28 11:52:52.865 7516 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:52:52 ctl02 nova-api[7516]: 2017-09-28 11:52:52.865 7516 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:52:52 ctl02 nova-api[7516]: 2017-09-28 11:52:52.865 7516 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:52:52 ctl02 nova-api[7516]: 2017-09-28 11:52:52.865 7516 ERROR nova.wsgi     self.filename))
Sep 28 11:52:52 ctl02 nova-api[7516]: 2017-09-28 11:52:52.865 7516 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:52:52 ctl02 nova-api[7516]: 2017-09-28 11:52:52.865 7516 ERROR nova.wsgi
Sep 28 11:52:52 ctl02 nova-api[7516]: 2017-09-28 11:52:52.866 7516 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:52:53 ctl02 nova-api[7516]: 2017-09-28 11:52:53.000 7516 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:52:53 ctl02 nova-api[7516]: 2017-09-28 11:52:53.240 7516 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:52:53 ctl02 nova-api[7516]: 2017-09-28 11:52:53.242 7516 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:52:53 ctl02 nova-api[7516]: 2017-09-28 11:52:53.242 7516 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:52:53 ctl02 nova-api[7516]: 2017-09-28 11:52:53.242 7516 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:52:53 ctl02 nova-api[7516]: 2017-09-28 11:52:53.375 7516 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:52:53 ctl02 nova-api[7516]: 2017-09-28 11:52:53.377 7516 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:52:53 ctl02 nova-api[7516]: 2017-09-28 11:52:53.377 7516 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:52:53 ctl02 nova-api[7516]: 2017-09-28 11:52:53.378 7516 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:52:53 ctl02 nova-api[7516]: 2017-09-28 11:52:53.381 7516 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:52:53 ctl02 nova-api[7516]: 2017-09-28 11:52:53.381 7516 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:52:53 ctl02 nova-api[7516]: 2017-09-28 11:52:53.381 7516 ERROR nova Traceback (most recent call last):
Sep 28 11:52:53 ctl02 nova-api[7516]: 2017-09-28 11:52:53.381 7516 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:52:53 ctl02 nova-api[7516]: 2017-09-28 11:52:53.381 7516 ERROR nova     sys.exit(main())
Sep 28 11:52:53 ctl02 nova-api[7516]: 2017-09-28 11:52:53.381 7516 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:52:53 ctl02 nova-api[7516]: 2017-09-28 11:52:53.381 7516 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:52:53 ctl02 nova-api[7516]: 2017-09-28 11:52:53.381 7516 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:52:53 ctl02 nova-api[7516]: 2017-09-28 11:52:53.381 7516 ERROR nova     max_url_len=max_url_len)
Sep 28 11:52:53 ctl02 nova-api[7516]: 2017-09-28 11:52:53.381 7516 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:52:53 ctl02 nova-api[7516]: 2017-09-28 11:52:53.381 7516 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:52:53 ctl02 nova-api[7516]: 2017-09-28 11:52:53.381 7516 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:52:53 ctl02 nova-api[7516]: 2017-09-28 11:52:53.381 7516 ERROR nova     sock.listen(backlog)
Sep 28 11:52:53 ctl02 nova-api[7516]: 2017-09-28 11:52:53.381 7516 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:52:53 ctl02 nova-api[7516]: 2017-09-28 11:52:53.381 7516 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:52:53 ctl02 nova-api[7516]: 2017-09-28 11:52:53.381 7516 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:52:53 ctl02 nova-api[7516]: 2017-09-28 11:52:53.381 7516 ERROR nova
Sep 28 11:52:53 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:52:53 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:52:53 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:52:53 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:52:53 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:52:53 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:52:53 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:52:53 ctl02 glance-api[29183]: 2017-09-28 11:52:53.951 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:52:53] "OPTIONS / HTTP/1.0" 200 134 0.000761
Sep 28 11:52:55 ctl02 nova-api[7534]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:52:55 ctl02 nova-api[7534]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:52:55 ctl02 nova-api[7534]: 2017-09-28 11:52:55.617 7534 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:52:55 ctl02 nova-api[7534]: 2017-09-28 11:52:55.618 7534 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:52:55 ctl02 nova-api[7534]: 2017-09-28 11:52:55.618 7534 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:52:55 ctl02 nova-api[7534]: 2017-09-28 11:52:55.618 7534 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:52:55 ctl02 nova-api[7534]: 2017-09-28 11:52:55.618 7534 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:52:55 ctl02 nova-api[7534]: 2017-09-28 11:52:55.618 7534 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:52:55 ctl02 nova-api[7534]: 2017-09-28 11:52:55.618 7534 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:52:55 ctl02 nova-api[7534]: 2017-09-28 11:52:55.618 7534 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:52:55 ctl02 nova-api[7534]: 2017-09-28 11:52:55.618 7534 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:52:55 ctl02 nova-api[7534]: 2017-09-28 11:52:55.618 7534 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:52:55 ctl02 nova-api[7534]: 2017-09-28 11:52:55.618 7534 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:52:55 ctl02 nova-api[7534]: 2017-09-28 11:52:55.618 7534 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:52:55 ctl02 nova-api[7534]: 2017-09-28 11:52:55.618 7534 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:52:55 ctl02 nova-api[7534]: 2017-09-28 11:52:55.618 7534 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:52:55 ctl02 nova-api[7534]: 2017-09-28 11:52:55.618 7534 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:52:55 ctl02 nova-api[7534]: 2017-09-28 11:52:55.618 7534 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:52:55 ctl02 nova-api[7534]: 2017-09-28 11:52:55.618 7534 ERROR nova.wsgi     self.filename))
Sep 28 11:52:55 ctl02 nova-api[7534]: 2017-09-28 11:52:55.618 7534 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:52:55 ctl02 nova-api[7534]: 2017-09-28 11:52:55.618 7534 ERROR nova.wsgi
Sep 28 11:52:55 ctl02 nova-api[7534]: 2017-09-28 11:52:55.619 7534 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:52:55 ctl02 nova-api[7534]: 2017-09-28 11:52:55.750 7534 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:52:55 ctl02 nova-api[7534]: 2017-09-28 11:52:55.982 7534 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:52:55 ctl02 nova-api[7534]: 2017-09-28 11:52:55.985 7534 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:52:55 ctl02 nova-api[7534]: 2017-09-28 11:52:55.985 7534 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:52:55 ctl02 nova-api[7534]: 2017-09-28 11:52:55.985 7534 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:52:56 ctl02 nova-api[7534]: 2017-09-28 11:52:56.115 7534 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:52:56 ctl02 nova-api[7534]: 2017-09-28 11:52:56.117 7534 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:52:56 ctl02 nova-api[7534]: 2017-09-28 11:52:56.117 7534 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:52:56 ctl02 nova-api[7534]: 2017-09-28 11:52:56.117 7534 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:52:56 ctl02 nova-api[7534]: 2017-09-28 11:52:56.121 7534 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:52:56 ctl02 nova-api[7534]: 2017-09-28 11:52:56.121 7534 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:52:56 ctl02 nova-api[7534]: 2017-09-28 11:52:56.121 7534 ERROR nova Traceback (most recent call last):
Sep 28 11:52:56 ctl02 nova-api[7534]: 2017-09-28 11:52:56.121 7534 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:52:56 ctl02 nova-api[7534]: 2017-09-28 11:52:56.121 7534 ERROR nova     sys.exit(main())
Sep 28 11:52:56 ctl02 nova-api[7534]: 2017-09-28 11:52:56.121 7534 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:52:56 ctl02 nova-api[7534]: 2017-09-28 11:52:56.121 7534 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:52:56 ctl02 nova-api[7534]: 2017-09-28 11:52:56.121 7534 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:52:56 ctl02 nova-api[7534]: 2017-09-28 11:52:56.121 7534 ERROR nova     max_url_len=max_url_len)
Sep 28 11:52:56 ctl02 nova-api[7534]: 2017-09-28 11:52:56.121 7534 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:52:56 ctl02 nova-api[7534]: 2017-09-28 11:52:56.121 7534 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:52:56 ctl02 nova-api[7534]: 2017-09-28 11:52:56.121 7534 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:52:56 ctl02 nova-api[7534]: 2017-09-28 11:52:56.121 7534 ERROR nova     sock.listen(backlog)
Sep 28 11:52:56 ctl02 nova-api[7534]: 2017-09-28 11:52:56.121 7534 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:52:56 ctl02 nova-api[7534]: 2017-09-28 11:52:56.121 7534 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:52:56 ctl02 nova-api[7534]: 2017-09-28 11:52:56.121 7534 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:52:56 ctl02 nova-api[7534]: 2017-09-28 11:52:56.121 7534 ERROR nova
Sep 28 11:52:56 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:52:56 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:52:56 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:52:56 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:52:56 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:52:56 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:52:56 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:52:56 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd06d9328)
Sep 28 11:52:57 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd06d9328)
Sep 28 11:52:57 ctl02 glance-api[29183]: 2017-09-28 11:52:57.686 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:52:57] "OPTIONS / HTTP/1.0" 200 134 0.001055
Sep 28 11:52:57 ctl02 nova-api[7552]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:52:57 ctl02 nova-api[7552]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:52:58 ctl02 nova-api[7552]: 2017-09-28 11:52:58.109 7552 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:52:58 ctl02 nova-api[7552]: 2017-09-28 11:52:58.111 7552 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:52:58 ctl02 nova-api[7552]: 2017-09-28 11:52:58.111 7552 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:52:58 ctl02 nova-api[7552]: 2017-09-28 11:52:58.111 7552 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:52:58 ctl02 nova-api[7552]: 2017-09-28 11:52:58.111 7552 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:52:58 ctl02 nova-api[7552]: 2017-09-28 11:52:58.111 7552 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:52:58 ctl02 nova-api[7552]: 2017-09-28 11:52:58.111 7552 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:52:58 ctl02 nova-api[7552]: 2017-09-28 11:52:58.111 7552 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:52:58 ctl02 nova-api[7552]: 2017-09-28 11:52:58.111 7552 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:52:58 ctl02 nova-api[7552]: 2017-09-28 11:52:58.111 7552 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:52:58 ctl02 nova-api[7552]: 2017-09-28 11:52:58.111 7552 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:52:58 ctl02 nova-api[7552]: 2017-09-28 11:52:58.111 7552 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:52:58 ctl02 nova-api[7552]: 2017-09-28 11:52:58.111 7552 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:52:58 ctl02 nova-api[7552]: 2017-09-28 11:52:58.111 7552 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:52:58 ctl02 nova-api[7552]: 2017-09-28 11:52:58.111 7552 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:52:58 ctl02 nova-api[7552]: 2017-09-28 11:52:58.111 7552 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:52:58 ctl02 nova-api[7552]: 2017-09-28 11:52:58.111 7552 ERROR nova.wsgi     self.filename))
Sep 28 11:52:58 ctl02 nova-api[7552]: 2017-09-28 11:52:58.111 7552 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:52:58 ctl02 nova-api[7552]: 2017-09-28 11:52:58.111 7552 ERROR nova.wsgi
Sep 28 11:52:58 ctl02 nova-api[7552]: 2017-09-28 11:52:58.112 7552 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:52:58 ctl02 glance-api[29183]: 2017-09-28 11:52:58.118 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:52:58] "OPTIONS / HTTP/1.0" 200 134 0.001002
Sep 28 11:52:58 ctl02 nova-api[7552]: 2017-09-28 11:52:58.261 7552 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:52:58 ctl02 nova-api[7552]: 2017-09-28 11:52:58.502 7552 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:52:58 ctl02 nova-api[7552]: 2017-09-28 11:52:58.504 7552 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:52:58 ctl02 nova-api[7552]: 2017-09-28 11:52:58.504 7552 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:52:58 ctl02 nova-api[7552]: 2017-09-28 11:52:58.504 7552 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:52:58 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd06d9328)
Sep 28 11:52:58 ctl02 nova-api[7552]: 2017-09-28 11:52:58.636 7552 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:52:58 ctl02 nova-api[7552]: 2017-09-28 11:52:58.638 7552 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:52:58 ctl02 nova-api[7552]: 2017-09-28 11:52:58.638 7552 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:52:58 ctl02 nova-api[7552]: 2017-09-28 11:52:58.638 7552 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:52:58 ctl02 nova-api[7552]: 2017-09-28 11:52:58.641 7552 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:52:58 ctl02 nova-api[7552]: 2017-09-28 11:52:58.642 7552 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:52:58 ctl02 nova-api[7552]: 2017-09-28 11:52:58.642 7552 ERROR nova Traceback (most recent call last):
Sep 28 11:52:58 ctl02 nova-api[7552]: 2017-09-28 11:52:58.642 7552 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:52:58 ctl02 nova-api[7552]: 2017-09-28 11:52:58.642 7552 ERROR nova     sys.exit(main())
Sep 28 11:52:58 ctl02 nova-api[7552]: 2017-09-28 11:52:58.642 7552 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:52:58 ctl02 nova-api[7552]: 2017-09-28 11:52:58.642 7552 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:52:58 ctl02 nova-api[7552]: 2017-09-28 11:52:58.642 7552 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:52:58 ctl02 nova-api[7552]: 2017-09-28 11:52:58.642 7552 ERROR nova     max_url_len=max_url_len)
Sep 28 11:52:58 ctl02 nova-api[7552]: 2017-09-28 11:52:58.642 7552 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:52:58 ctl02 nova-api[7552]: 2017-09-28 11:52:58.642 7552 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:52:58 ctl02 nova-api[7552]: 2017-09-28 11:52:58.642 7552 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:52:58 ctl02 nova-api[7552]: 2017-09-28 11:52:58.642 7552 ERROR nova     sock.listen(backlog)
Sep 28 11:52:58 ctl02 nova-api[7552]: 2017-09-28 11:52:58.642 7552 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:52:58 ctl02 nova-api[7552]: 2017-09-28 11:52:58.642 7552 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:52:58 ctl02 nova-api[7552]: 2017-09-28 11:52:58.642 7552 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:52:58 ctl02 nova-api[7552]: 2017-09-28 11:52:58.642 7552 ERROR nova
Sep 28 11:52:58 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:52:58 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:52:58 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:52:59 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:52:59 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:52:59 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:52:59 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:52:59 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd06d9328)
Sep 28 11:53:00 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd06d9328)
Sep 28 11:53:00 ctl02 nova-api[7570]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:53:00 ctl02 nova-api[7570]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:53:00 ctl02 nova-api[7570]: 2017-09-28 11:53:00.838 7570 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:53:00 ctl02 nova-api[7570]: 2017-09-28 11:53:00.839 7570 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:53:00 ctl02 nova-api[7570]: 2017-09-28 11:53:00.839 7570 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:53:00 ctl02 nova-api[7570]: 2017-09-28 11:53:00.839 7570 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:53:00 ctl02 nova-api[7570]: 2017-09-28 11:53:00.839 7570 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:53:00 ctl02 nova-api[7570]: 2017-09-28 11:53:00.839 7570 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:53:00 ctl02 nova-api[7570]: 2017-09-28 11:53:00.839 7570 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:53:00 ctl02 nova-api[7570]: 2017-09-28 11:53:00.839 7570 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:53:00 ctl02 nova-api[7570]: 2017-09-28 11:53:00.839 7570 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:53:00 ctl02 nova-api[7570]: 2017-09-28 11:53:00.839 7570 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:53:00 ctl02 nova-api[7570]: 2017-09-28 11:53:00.839 7570 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:53:00 ctl02 nova-api[7570]: 2017-09-28 11:53:00.839 7570 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:53:00 ctl02 nova-api[7570]: 2017-09-28 11:53:00.839 7570 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:53:00 ctl02 nova-api[7570]: 2017-09-28 11:53:00.839 7570 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:53:00 ctl02 nova-api[7570]: 2017-09-28 11:53:00.839 7570 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:53:00 ctl02 nova-api[7570]: 2017-09-28 11:53:00.839 7570 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:53:00 ctl02 nova-api[7570]: 2017-09-28 11:53:00.839 7570 ERROR nova.wsgi     self.filename))
Sep 28 11:53:00 ctl02 nova-api[7570]: 2017-09-28 11:53:00.839 7570 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:53:00 ctl02 nova-api[7570]: 2017-09-28 11:53:00.839 7570 ERROR nova.wsgi
Sep 28 11:53:00 ctl02 nova-api[7570]: 2017-09-28 11:53:00.840 7570 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:53:00 ctl02 nova-api[7570]: 2017-09-28 11:53:00.971 7570 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:53:01 ctl02 nova-api[7570]: 2017-09-28 11:53:01.214 7570 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:53:01 ctl02 nova-api[7570]: 2017-09-28 11:53:01.216 7570 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:53:01 ctl02 nova-api[7570]: 2017-09-28 11:53:01.216 7570 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:53:01 ctl02 nova-api[7570]: 2017-09-28 11:53:01.217 7570 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:53:01 ctl02 nova-api[7570]: 2017-09-28 11:53:01.350 7570 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:53:01 ctl02 nova-api[7570]: 2017-09-28 11:53:01.353 7570 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:53:01 ctl02 nova-api[7570]: 2017-09-28 11:53:01.353 7570 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:53:01 ctl02 nova-api[7570]: 2017-09-28 11:53:01.353 7570 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:53:01 ctl02 nova-api[7570]: 2017-09-28 11:53:01.356 7570 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:53:01 ctl02 nova-api[7570]: 2017-09-28 11:53:01.357 7570 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:53:01 ctl02 nova-api[7570]: 2017-09-28 11:53:01.357 7570 ERROR nova Traceback (most recent call last):
Sep 28 11:53:01 ctl02 nova-api[7570]: 2017-09-28 11:53:01.357 7570 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:53:01 ctl02 nova-api[7570]: 2017-09-28 11:53:01.357 7570 ERROR nova     sys.exit(main())
Sep 28 11:53:01 ctl02 nova-api[7570]: 2017-09-28 11:53:01.357 7570 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:53:01 ctl02 nova-api[7570]: 2017-09-28 11:53:01.357 7570 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:53:01 ctl02 nova-api[7570]: 2017-09-28 11:53:01.357 7570 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:53:01 ctl02 nova-api[7570]: 2017-09-28 11:53:01.357 7570 ERROR nova     max_url_len=max_url_len)
Sep 28 11:53:01 ctl02 nova-api[7570]: 2017-09-28 11:53:01.357 7570 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:53:01 ctl02 nova-api[7570]: 2017-09-28 11:53:01.357 7570 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:53:01 ctl02 nova-api[7570]: 2017-09-28 11:53:01.357 7570 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:53:01 ctl02 nova-api[7570]: 2017-09-28 11:53:01.357 7570 ERROR nova     sock.listen(backlog)
Sep 28 11:53:01 ctl02 nova-api[7570]: 2017-09-28 11:53:01.357 7570 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:53:01 ctl02 nova-api[7570]: 2017-09-28 11:53:01.357 7570 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:53:01 ctl02 nova-api[7570]: 2017-09-28 11:53:01.357 7570 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:53:01 ctl02 nova-api[7570]: 2017-09-28 11:53:01.357 7570 ERROR nova
Sep 28 11:53:01 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:53:01 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:53:01 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:53:01 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd06d9328)
Sep 28 11:53:01 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:53:01 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:53:01 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:53:01 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:53:02 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd06d9328)
Sep 28 11:53:03 ctl02 nova-api[7587]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:53:03 ctl02 nova-api[7587]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:53:03 ctl02 nova-api[7587]: 2017-09-28 11:53:03.350 7587 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:53:03 ctl02 nova-api[7587]: 2017-09-28 11:53:03.351 7587 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:53:03 ctl02 nova-api[7587]: 2017-09-28 11:53:03.351 7587 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:53:03 ctl02 nova-api[7587]: 2017-09-28 11:53:03.351 7587 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:53:03 ctl02 nova-api[7587]: 2017-09-28 11:53:03.351 7587 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:53:03 ctl02 nova-api[7587]: 2017-09-28 11:53:03.351 7587 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:53:03 ctl02 nova-api[7587]: 2017-09-28 11:53:03.351 7587 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:53:03 ctl02 nova-api[7587]: 2017-09-28 11:53:03.351 7587 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:53:03 ctl02 nova-api[7587]: 2017-09-28 11:53:03.351 7587 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:53:03 ctl02 nova-api[7587]: 2017-09-28 11:53:03.351 7587 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:53:03 ctl02 nova-api[7587]: 2017-09-28 11:53:03.351 7587 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:53:03 ctl02 nova-api[7587]: 2017-09-28 11:53:03.351 7587 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:53:03 ctl02 nova-api[7587]: 2017-09-28 11:53:03.351 7587 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:53:03 ctl02 nova-api[7587]: 2017-09-28 11:53:03.351 7587 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:53:03 ctl02 nova-api[7587]: 2017-09-28 11:53:03.351 7587 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:53:03 ctl02 nova-api[7587]: 2017-09-28 11:53:03.351 7587 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:53:03 ctl02 nova-api[7587]: 2017-09-28 11:53:03.351 7587 ERROR nova.wsgi     self.filename))
Sep 28 11:53:03 ctl02 nova-api[7587]: 2017-09-28 11:53:03.351 7587 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:53:03 ctl02 nova-api[7587]: 2017-09-28 11:53:03.351 7587 ERROR nova.wsgi
Sep 28 11:53:03 ctl02 nova-api[7587]: 2017-09-28 11:53:03.353 7587 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:53:03 ctl02 nova-api[7587]: 2017-09-28 11:53:03.486 7587 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:53:03 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd06d9328)
Sep 28 11:53:03 ctl02 glance-api[29183]: 2017-09-28 11:53:03.657 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:53:03] "OPTIONS / HTTP/1.0" 200 134 0.000661
Sep 28 11:53:03 ctl02 nova-api[7587]: 2017-09-28 11:53:03.727 7587 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:53:03 ctl02 nova-api[7587]: 2017-09-28 11:53:03.729 7587 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:53:03 ctl02 nova-api[7587]: 2017-09-28 11:53:03.729 7587 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:53:03 ctl02 nova-api[7587]: 2017-09-28 11:53:03.730 7587 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:53:03 ctl02 nova-api[7587]: 2017-09-28 11:53:03.859 7587 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:53:03 ctl02 nova-api[7587]: 2017-09-28 11:53:03.861 7587 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:53:03 ctl02 nova-api[7587]: 2017-09-28 11:53:03.861 7587 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:53:03 ctl02 nova-api[7587]: 2017-09-28 11:53:03.861 7587 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:53:03 ctl02 nova-api[7587]: 2017-09-28 11:53:03.865 7587 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:53:03 ctl02 nova-api[7587]: 2017-09-28 11:53:03.865 7587 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:53:03 ctl02 nova-api[7587]: 2017-09-28 11:53:03.865 7587 ERROR nova Traceback (most recent call last):
Sep 28 11:53:03 ctl02 nova-api[7587]: 2017-09-28 11:53:03.865 7587 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:53:03 ctl02 nova-api[7587]: 2017-09-28 11:53:03.865 7587 ERROR nova     sys.exit(main())
Sep 28 11:53:03 ctl02 nova-api[7587]: 2017-09-28 11:53:03.865 7587 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:53:03 ctl02 nova-api[7587]: 2017-09-28 11:53:03.865 7587 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:53:03 ctl02 nova-api[7587]: 2017-09-28 11:53:03.865 7587 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:53:03 ctl02 nova-api[7587]: 2017-09-28 11:53:03.865 7587 ERROR nova     max_url_len=max_url_len)
Sep 28 11:53:03 ctl02 nova-api[7587]: 2017-09-28 11:53:03.865 7587 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:53:03 ctl02 nova-api[7587]: 2017-09-28 11:53:03.865 7587 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:53:03 ctl02 nova-api[7587]: 2017-09-28 11:53:03.865 7587 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:53:03 ctl02 nova-api[7587]: 2017-09-28 11:53:03.865 7587 ERROR nova     sock.listen(backlog)
Sep 28 11:53:03 ctl02 nova-api[7587]: 2017-09-28 11:53:03.865 7587 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:53:03 ctl02 nova-api[7587]: 2017-09-28 11:53:03.865 7587 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:53:03 ctl02 nova-api[7587]: 2017-09-28 11:53:03.865 7587 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:53:03 ctl02 nova-api[7587]: 2017-09-28 11:53:03.865 7587 ERROR nova
Sep 28 11:53:04 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:53:04 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:53:04 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:53:04 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:53:04 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:53:04 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:53:04 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:53:04 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd06d9328)
Sep 28 11:53:05 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd06d9328)
Sep 28 11:53:05 ctl02 nova-api[7605]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:53:05 ctl02 nova-api[7605]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:53:05 ctl02 nova-api[7605]: 2017-09-28 11:53:05.826 7605 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:53:05 ctl02 nova-api[7605]: 2017-09-28 11:53:05.827 7605 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:53:05 ctl02 nova-api[7605]: 2017-09-28 11:53:05.827 7605 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:53:05 ctl02 nova-api[7605]: 2017-09-28 11:53:05.827 7605 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:53:05 ctl02 nova-api[7605]: 2017-09-28 11:53:05.827 7605 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:53:05 ctl02 nova-api[7605]: 2017-09-28 11:53:05.827 7605 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:53:05 ctl02 nova-api[7605]: 2017-09-28 11:53:05.827 7605 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:53:05 ctl02 nova-api[7605]: 2017-09-28 11:53:05.827 7605 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:53:05 ctl02 nova-api[7605]: 2017-09-28 11:53:05.827 7605 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:53:05 ctl02 nova-api[7605]: 2017-09-28 11:53:05.827 7605 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:53:05 ctl02 nova-api[7605]: 2017-09-28 11:53:05.827 7605 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:53:05 ctl02 nova-api[7605]: 2017-09-28 11:53:05.827 7605 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:53:05 ctl02 nova-api[7605]: 2017-09-28 11:53:05.827 7605 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:53:05 ctl02 nova-api[7605]: 2017-09-28 11:53:05.827 7605 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:53:05 ctl02 nova-api[7605]: 2017-09-28 11:53:05.827 7605 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:53:05 ctl02 nova-api[7605]: 2017-09-28 11:53:05.827 7605 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:53:05 ctl02 nova-api[7605]: 2017-09-28 11:53:05.827 7605 ERROR nova.wsgi     self.filename))
Sep 28 11:53:05 ctl02 nova-api[7605]: 2017-09-28 11:53:05.827 7605 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:53:05 ctl02 nova-api[7605]: 2017-09-28 11:53:05.827 7605 ERROR nova.wsgi
Sep 28 11:53:05 ctl02 nova-api[7605]: 2017-09-28 11:53:05.828 7605 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:53:05 ctl02 nova-api[7605]: 2017-09-28 11:53:05.961 7605 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:53:06 ctl02 nova-api[7605]: 2017-09-28 11:53:06.198 7605 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:53:06 ctl02 nova-api[7605]: 2017-09-28 11:53:06.200 7605 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:53:06 ctl02 nova-api[7605]: 2017-09-28 11:53:06.201 7605 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:53:06 ctl02 nova-api[7605]: 2017-09-28 11:53:06.201 7605 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:53:06 ctl02 nova-api[7605]: 2017-09-28 11:53:06.333 7605 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:53:06 ctl02 nova-api[7605]: 2017-09-28 11:53:06.335 7605 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:53:06 ctl02 nova-api[7605]: 2017-09-28 11:53:06.335 7605 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:53:06 ctl02 nova-api[7605]: 2017-09-28 11:53:06.335 7605 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:53:06 ctl02 nova-api[7605]: 2017-09-28 11:53:06.338 7605 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:53:06 ctl02 nova-api[7605]: 2017-09-28 11:53:06.339 7605 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:53:06 ctl02 nova-api[7605]: 2017-09-28 11:53:06.339 7605 ERROR nova Traceback (most recent call last):
Sep 28 11:53:06 ctl02 nova-api[7605]: 2017-09-28 11:53:06.339 7605 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:53:06 ctl02 nova-api[7605]: 2017-09-28 11:53:06.339 7605 ERROR nova     sys.exit(main())
Sep 28 11:53:06 ctl02 nova-api[7605]: 2017-09-28 11:53:06.339 7605 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:53:06 ctl02 nova-api[7605]: 2017-09-28 11:53:06.339 7605 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:53:06 ctl02 nova-api[7605]: 2017-09-28 11:53:06.339 7605 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:53:06 ctl02 nova-api[7605]: 2017-09-28 11:53:06.339 7605 ERROR nova     max_url_len=max_url_len)
Sep 28 11:53:06 ctl02 nova-api[7605]: 2017-09-28 11:53:06.339 7605 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:53:06 ctl02 nova-api[7605]: 2017-09-28 11:53:06.339 7605 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:53:06 ctl02 nova-api[7605]: 2017-09-28 11:53:06.339 7605 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:53:06 ctl02 nova-api[7605]: 2017-09-28 11:53:06.339 7605 ERROR nova     sock.listen(backlog)
Sep 28 11:53:06 ctl02 nova-api[7605]: 2017-09-28 11:53:06.339 7605 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:53:06 ctl02 nova-api[7605]: 2017-09-28 11:53:06.339 7605 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:53:06 ctl02 nova-api[7605]: 2017-09-28 11:53:06.339 7605 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:53:06 ctl02 nova-api[7605]: 2017-09-28 11:53:06.339 7605 ERROR nova
Sep 28 11:53:06 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:53:06 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:53:06 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:53:06 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:53:06 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:53:06 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd06d9328)
Sep 28 11:53:06 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:53:06 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:53:07 ctl02 nova-cert[4860]: 2017-09-28 11:53:07.156 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:53:07 ctl02 glance-api[29183]: 2017-09-28 11:53:07.459 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:53:07] "OPTIONS / HTTP/1.0" 200 134 0.000555
Sep 28 11:53:07 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:53:07 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:53:08 ctl02 nova-api[7624]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:53:08 ctl02 nova-api[7624]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:53:08 ctl02 nova-api[7624]: 2017-09-28 11:53:08.311 7624 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:53:08 ctl02 nova-api[7624]: 2017-09-28 11:53:08.312 7624 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:53:08 ctl02 nova-api[7624]: 2017-09-28 11:53:08.312 7624 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:53:08 ctl02 nova-api[7624]: 2017-09-28 11:53:08.312 7624 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:53:08 ctl02 nova-api[7624]: 2017-09-28 11:53:08.312 7624 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:53:08 ctl02 nova-api[7624]: 2017-09-28 11:53:08.312 7624 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:53:08 ctl02 nova-api[7624]: 2017-09-28 11:53:08.312 7624 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:53:08 ctl02 nova-api[7624]: 2017-09-28 11:53:08.312 7624 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:53:08 ctl02 nova-api[7624]: 2017-09-28 11:53:08.312 7624 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:53:08 ctl02 nova-api[7624]: 2017-09-28 11:53:08.312 7624 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:53:08 ctl02 nova-api[7624]: 2017-09-28 11:53:08.312 7624 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:53:08 ctl02 nova-api[7624]: 2017-09-28 11:53:08.312 7624 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:53:08 ctl02 nova-api[7624]: 2017-09-28 11:53:08.312 7624 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:53:08 ctl02 nova-api[7624]: 2017-09-28 11:53:08.312 7624 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:53:08 ctl02 nova-api[7624]: 2017-09-28 11:53:08.312 7624 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:53:08 ctl02 nova-api[7624]: 2017-09-28 11:53:08.312 7624 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:53:08 ctl02 nova-api[7624]: 2017-09-28 11:53:08.312 7624 ERROR nova.wsgi     self.filename))
Sep 28 11:53:08 ctl02 nova-api[7624]: 2017-09-28 11:53:08.312 7624 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:53:08 ctl02 nova-api[7624]: 2017-09-28 11:53:08.312 7624 ERROR nova.wsgi
Sep 28 11:53:08 ctl02 nova-api[7624]: 2017-09-28 11:53:08.313 7624 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:53:08 ctl02 nova-api[7624]: 2017-09-28 11:53:08.444 7624 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:53:08 ctl02 glance-api[29183]: 2017-09-28 11:53:08.469 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:53:08] "OPTIONS / HTTP/1.0" 200 134 0.000565
Sep 28 11:53:08 ctl02 nova-api[7624]: 2017-09-28 11:53:08.679 7624 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:53:08 ctl02 nova-api[7624]: 2017-09-28 11:53:08.681 7624 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:53:08 ctl02 nova-api[7624]: 2017-09-28 11:53:08.682 7624 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:53:08 ctl02 nova-api[7624]: 2017-09-28 11:53:08.682 7624 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:53:08 ctl02 nova-api[7624]: 2017-09-28 11:53:08.812 7624 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:53:08 ctl02 nova-api[7624]: 2017-09-28 11:53:08.814 7624 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:53:08 ctl02 nova-api[7624]: 2017-09-28 11:53:08.814 7624 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:53:08 ctl02 nova-api[7624]: 2017-09-28 11:53:08.814 7624 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:53:08 ctl02 nova-api[7624]: 2017-09-28 11:53:08.818 7624 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:53:08 ctl02 nova-api[7624]: 2017-09-28 11:53:08.818 7624 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:53:08 ctl02 nova-api[7624]: 2017-09-28 11:53:08.818 7624 ERROR nova Traceback (most recent call last):
Sep 28 11:53:08 ctl02 nova-api[7624]: 2017-09-28 11:53:08.818 7624 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:53:08 ctl02 nova-api[7624]: 2017-09-28 11:53:08.818 7624 ERROR nova     sys.exit(main())
Sep 28 11:53:08 ctl02 nova-api[7624]: 2017-09-28 11:53:08.818 7624 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:53:08 ctl02 nova-api[7624]: 2017-09-28 11:53:08.818 7624 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:53:08 ctl02 nova-api[7624]: 2017-09-28 11:53:08.818 7624 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:53:08 ctl02 nova-api[7624]: 2017-09-28 11:53:08.818 7624 ERROR nova     max_url_len=max_url_len)
Sep 28 11:53:08 ctl02 nova-api[7624]: 2017-09-28 11:53:08.818 7624 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:53:08 ctl02 nova-api[7624]: 2017-09-28 11:53:08.818 7624 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:53:08 ctl02 nova-api[7624]: 2017-09-28 11:53:08.818 7624 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:53:08 ctl02 nova-api[7624]: 2017-09-28 11:53:08.818 7624 ERROR nova     sock.listen(backlog)
Sep 28 11:53:08 ctl02 nova-api[7624]: 2017-09-28 11:53:08.818 7624 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:53:08 ctl02 nova-api[7624]: 2017-09-28 11:53:08.818 7624 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:53:08 ctl02 nova-api[7624]: 2017-09-28 11:53:08.818 7624 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:53:08 ctl02 nova-api[7624]: 2017-09-28 11:53:08.818 7624 ERROR nova
Sep 28 11:53:08 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:53:08 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:53:08 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:53:09 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:53:09 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:53:09 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:53:09 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:53:10 ctl02 nova-conductor[5056]: 2017-09-28 11:53:10.110 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:53:10 ctl02 nova-conductor[5056]: 2017-09-28 11:53:10.124 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:53:10 ctl02 nova-conductor[5056]: 2017-09-28 11:53:10.140 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:53:10 ctl02 nova-conductor[5056]: 2017-09-28 11:53:10.141 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:53:10 ctl02 nova-api[7646]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:53:10 ctl02 nova-api[7646]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:53:10 ctl02 nova-api[7646]: 2017-09-28 11:53:10.863 7646 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:53:10 ctl02 nova-api[7646]: 2017-09-28 11:53:10.864 7646 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:53:10 ctl02 nova-api[7646]: 2017-09-28 11:53:10.864 7646 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:53:10 ctl02 nova-api[7646]: 2017-09-28 11:53:10.864 7646 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:53:10 ctl02 nova-api[7646]: 2017-09-28 11:53:10.864 7646 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:53:10 ctl02 nova-api[7646]: 2017-09-28 11:53:10.864 7646 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:53:10 ctl02 nova-api[7646]: 2017-09-28 11:53:10.864 7646 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:53:10 ctl02 nova-api[7646]: 2017-09-28 11:53:10.864 7646 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:53:10 ctl02 nova-api[7646]: 2017-09-28 11:53:10.864 7646 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:53:10 ctl02 nova-api[7646]: 2017-09-28 11:53:10.864 7646 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:53:10 ctl02 nova-api[7646]: 2017-09-28 11:53:10.864 7646 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:53:10 ctl02 nova-api[7646]: 2017-09-28 11:53:10.864 7646 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:53:10 ctl02 nova-api[7646]: 2017-09-28 11:53:10.864 7646 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:53:10 ctl02 nova-api[7646]: 2017-09-28 11:53:10.864 7646 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:53:10 ctl02 nova-api[7646]: 2017-09-28 11:53:10.864 7646 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:53:10 ctl02 nova-api[7646]: 2017-09-28 11:53:10.864 7646 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:53:10 ctl02 nova-api[7646]: 2017-09-28 11:53:10.864 7646 ERROR nova.wsgi     self.filename))
Sep 28 11:53:10 ctl02 nova-api[7646]: 2017-09-28 11:53:10.864 7646 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:53:10 ctl02 nova-api[7646]: 2017-09-28 11:53:10.864 7646 ERROR nova.wsgi
Sep 28 11:53:10 ctl02 nova-api[7646]: 2017-09-28 11:53:10.865 7646 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:53:10 ctl02 nova-api[7646]: 2017-09-28 11:53:10.997 7646 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:53:11 ctl02 nova-api[7646]: 2017-09-28 11:53:11.237 7646 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:53:11 ctl02 nova-api[7646]: 2017-09-28 11:53:11.239 7646 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:53:11 ctl02 nova-api[7646]: 2017-09-28 11:53:11.239 7646 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:53:11 ctl02 nova-api[7646]: 2017-09-28 11:53:11.240 7646 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:53:11 ctl02 nova-api[7646]: 2017-09-28 11:53:11.369 7646 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:53:11 ctl02 nova-api[7646]: 2017-09-28 11:53:11.371 7646 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:53:11 ctl02 nova-api[7646]: 2017-09-28 11:53:11.371 7646 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:53:11 ctl02 nova-api[7646]: 2017-09-28 11:53:11.371 7646 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:53:11 ctl02 nova-api[7646]: 2017-09-28 11:53:11.375 7646 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:53:11 ctl02 nova-api[7646]: 2017-09-28 11:53:11.375 7646 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:53:11 ctl02 nova-api[7646]: 2017-09-28 11:53:11.375 7646 ERROR nova Traceback (most recent call last):
Sep 28 11:53:11 ctl02 nova-api[7646]: 2017-09-28 11:53:11.375 7646 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:53:11 ctl02 nova-api[7646]: 2017-09-28 11:53:11.375 7646 ERROR nova     sys.exit(main())
Sep 28 11:53:11 ctl02 nova-api[7646]: 2017-09-28 11:53:11.375 7646 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:53:11 ctl02 nova-api[7646]: 2017-09-28 11:53:11.375 7646 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:53:11 ctl02 nova-api[7646]: 2017-09-28 11:53:11.375 7646 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:53:11 ctl02 nova-api[7646]: 2017-09-28 11:53:11.375 7646 ERROR nova     max_url_len=max_url_len)
Sep 28 11:53:11 ctl02 nova-api[7646]: 2017-09-28 11:53:11.375 7646 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:53:11 ctl02 nova-api[7646]: 2017-09-28 11:53:11.375 7646 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:53:11 ctl02 nova-api[7646]: 2017-09-28 11:53:11.375 7646 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:53:11 ctl02 nova-api[7646]: 2017-09-28 11:53:11.375 7646 ERROR nova     sock.listen(backlog)
Sep 28 11:53:11 ctl02 nova-api[7646]: 2017-09-28 11:53:11.375 7646 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:53:11 ctl02 nova-api[7646]: 2017-09-28 11:53:11.375 7646 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:53:11 ctl02 nova-api[7646]: 2017-09-28 11:53:11.375 7646 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:53:11 ctl02 nova-api[7646]: 2017-09-28 11:53:11.375 7646 ERROR nova
Sep 28 11:53:11 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:53:11 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:53:11 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:53:11 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:53:11 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:53:11 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:53:11 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:53:13 ctl02 nova-api[7664]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:53:13 ctl02 nova-api[7664]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:53:13 ctl02 nova-api[7664]: 2017-09-28 11:53:13.329 7664 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:53:13 ctl02 nova-api[7664]: 2017-09-28 11:53:13.330 7664 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:53:13 ctl02 nova-api[7664]: 2017-09-28 11:53:13.330 7664 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:53:13 ctl02 nova-api[7664]: 2017-09-28 11:53:13.330 7664 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:53:13 ctl02 nova-api[7664]: 2017-09-28 11:53:13.330 7664 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:53:13 ctl02 nova-api[7664]: 2017-09-28 11:53:13.330 7664 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:53:13 ctl02 nova-api[7664]: 2017-09-28 11:53:13.330 7664 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:53:13 ctl02 nova-api[7664]: 2017-09-28 11:53:13.330 7664 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:53:13 ctl02 nova-api[7664]: 2017-09-28 11:53:13.330 7664 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:53:13 ctl02 nova-api[7664]: 2017-09-28 11:53:13.330 7664 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:53:13 ctl02 nova-api[7664]: 2017-09-28 11:53:13.330 7664 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:53:13 ctl02 nova-api[7664]: 2017-09-28 11:53:13.330 7664 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:53:13 ctl02 nova-api[7664]: 2017-09-28 11:53:13.330 7664 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:53:13 ctl02 nova-api[7664]: 2017-09-28 11:53:13.330 7664 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:53:13 ctl02 nova-api[7664]: 2017-09-28 11:53:13.330 7664 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:53:13 ctl02 nova-api[7664]: 2017-09-28 11:53:13.330 7664 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:53:13 ctl02 nova-api[7664]: 2017-09-28 11:53:13.330 7664 ERROR nova.wsgi     self.filename))
Sep 28 11:53:13 ctl02 nova-api[7664]: 2017-09-28 11:53:13.330 7664 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:53:13 ctl02 nova-api[7664]: 2017-09-28 11:53:13.330 7664 ERROR nova.wsgi
Sep 28 11:53:13 ctl02 nova-api[7664]: 2017-09-28 11:53:13.331 7664 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:53:13 ctl02 nova-api[7664]: 2017-09-28 11:53:13.462 7664 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:53:13 ctl02 glance-api[29183]: 2017-09-28 11:53:13.610 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:53:13] "OPTIONS / HTTP/1.0" 200 134 0.000672
Sep 28 11:53:13 ctl02 nova-api[7664]: 2017-09-28 11:53:13.704 7664 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:53:13 ctl02 nova-api[7664]: 2017-09-28 11:53:13.706 7664 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:53:13 ctl02 nova-api[7664]: 2017-09-28 11:53:13.707 7664 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:53:13 ctl02 nova-api[7664]: 2017-09-28 11:53:13.707 7664 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:53:13 ctl02 nova-api[7664]: 2017-09-28 11:53:13.837 7664 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:53:13 ctl02 nova-api[7664]: 2017-09-28 11:53:13.839 7664 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:53:13 ctl02 nova-api[7664]: 2017-09-28 11:53:13.839 7664 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:53:13 ctl02 nova-api[7664]: 2017-09-28 11:53:13.839 7664 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:53:13 ctl02 nova-api[7664]: 2017-09-28 11:53:13.842 7664 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:53:13 ctl02 nova-api[7664]: 2017-09-28 11:53:13.843 7664 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:53:13 ctl02 nova-api[7664]: 2017-09-28 11:53:13.843 7664 ERROR nova Traceback (most recent call last):
Sep 28 11:53:13 ctl02 nova-api[7664]: 2017-09-28 11:53:13.843 7664 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:53:13 ctl02 nova-api[7664]: 2017-09-28 11:53:13.843 7664 ERROR nova     sys.exit(main())
Sep 28 11:53:13 ctl02 nova-api[7664]: 2017-09-28 11:53:13.843 7664 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:53:13 ctl02 nova-api[7664]: 2017-09-28 11:53:13.843 7664 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:53:13 ctl02 nova-api[7664]: 2017-09-28 11:53:13.843 7664 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:53:13 ctl02 nova-api[7664]: 2017-09-28 11:53:13.843 7664 ERROR nova     max_url_len=max_url_len)
Sep 28 11:53:13 ctl02 nova-api[7664]: 2017-09-28 11:53:13.843 7664 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:53:13 ctl02 nova-api[7664]: 2017-09-28 11:53:13.843 7664 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:53:13 ctl02 nova-api[7664]: 2017-09-28 11:53:13.843 7664 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:53:13 ctl02 nova-api[7664]: 2017-09-28 11:53:13.843 7664 ERROR nova     sock.listen(backlog)
Sep 28 11:53:13 ctl02 nova-api[7664]: 2017-09-28 11:53:13.843 7664 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:53:13 ctl02 nova-api[7664]: 2017-09-28 11:53:13.843 7664 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:53:13 ctl02 nova-api[7664]: 2017-09-28 11:53:13.843 7664 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:53:13 ctl02 nova-api[7664]: 2017-09-28 11:53:13.843 7664 ERROR nova
Sep 28 11:53:13 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:53:13 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:53:13 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:53:14 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:53:14 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:53:14 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:53:14 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:53:15 ctl02 nova-api[7683]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:53:15 ctl02 nova-api[7683]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:53:15 ctl02 nova-api[7683]: 2017-09-28 11:53:15.822 7683 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:53:15 ctl02 nova-api[7683]: 2017-09-28 11:53:15.824 7683 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:53:15 ctl02 nova-api[7683]: 2017-09-28 11:53:15.824 7683 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:53:15 ctl02 nova-api[7683]: 2017-09-28 11:53:15.824 7683 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:53:15 ctl02 nova-api[7683]: 2017-09-28 11:53:15.824 7683 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:53:15 ctl02 nova-api[7683]: 2017-09-28 11:53:15.824 7683 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:53:15 ctl02 nova-api[7683]: 2017-09-28 11:53:15.824 7683 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:53:15 ctl02 nova-api[7683]: 2017-09-28 11:53:15.824 7683 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:53:15 ctl02 nova-api[7683]: 2017-09-28 11:53:15.824 7683 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:53:15 ctl02 nova-api[7683]: 2017-09-28 11:53:15.824 7683 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:53:15 ctl02 nova-api[7683]: 2017-09-28 11:53:15.824 7683 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:53:15 ctl02 nova-api[7683]: 2017-09-28 11:53:15.824 7683 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:53:15 ctl02 nova-api[7683]: 2017-09-28 11:53:15.824 7683 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:53:15 ctl02 nova-api[7683]: 2017-09-28 11:53:15.824 7683 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:53:15 ctl02 nova-api[7683]: 2017-09-28 11:53:15.824 7683 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:53:15 ctl02 nova-api[7683]: 2017-09-28 11:53:15.824 7683 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:53:15 ctl02 nova-api[7683]: 2017-09-28 11:53:15.824 7683 ERROR nova.wsgi     self.filename))
Sep 28 11:53:15 ctl02 nova-api[7683]: 2017-09-28 11:53:15.824 7683 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:53:15 ctl02 nova-api[7683]: 2017-09-28 11:53:15.824 7683 ERROR nova.wsgi
Sep 28 11:53:15 ctl02 nova-api[7683]: 2017-09-28 11:53:15.825 7683 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:53:15 ctl02 nova-api[7683]: 2017-09-28 11:53:15.957 7683 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:53:16 ctl02 nova-api[7683]: 2017-09-28 11:53:16.200 7683 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:53:16 ctl02 nova-api[7683]: 2017-09-28 11:53:16.202 7683 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:53:16 ctl02 nova-api[7683]: 2017-09-28 11:53:16.203 7683 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:53:16 ctl02 nova-api[7683]: 2017-09-28 11:53:16.203 7683 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:53:16 ctl02 nova-api[7683]: 2017-09-28 11:53:16.335 7683 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:53:16 ctl02 nova-api[7683]: 2017-09-28 11:53:16.337 7683 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:53:16 ctl02 nova-api[7683]: 2017-09-28 11:53:16.337 7683 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:53:16 ctl02 nova-api[7683]: 2017-09-28 11:53:16.338 7683 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:53:16 ctl02 nova-api[7683]: 2017-09-28 11:53:16.341 7683 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:53:16 ctl02 nova-api[7683]: 2017-09-28 11:53:16.341 7683 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:53:16 ctl02 nova-api[7683]: 2017-09-28 11:53:16.341 7683 ERROR nova Traceback (most recent call last):
Sep 28 11:53:16 ctl02 nova-api[7683]: 2017-09-28 11:53:16.341 7683 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:53:16 ctl02 nova-api[7683]: 2017-09-28 11:53:16.341 7683 ERROR nova     sys.exit(main())
Sep 28 11:53:16 ctl02 nova-api[7683]: 2017-09-28 11:53:16.341 7683 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:53:16 ctl02 nova-api[7683]: 2017-09-28 11:53:16.341 7683 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:53:16 ctl02 nova-api[7683]: 2017-09-28 11:53:16.341 7683 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:53:16 ctl02 nova-api[7683]: 2017-09-28 11:53:16.341 7683 ERROR nova     max_url_len=max_url_len)
Sep 28 11:53:16 ctl02 nova-api[7683]: 2017-09-28 11:53:16.341 7683 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:53:16 ctl02 nova-api[7683]: 2017-09-28 11:53:16.341 7683 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:53:16 ctl02 nova-api[7683]: 2017-09-28 11:53:16.341 7683 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:53:16 ctl02 nova-api[7683]: 2017-09-28 11:53:16.341 7683 ERROR nova     sock.listen(backlog)
Sep 28 11:53:16 ctl02 nova-api[7683]: 2017-09-28 11:53:16.341 7683 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:53:16 ctl02 nova-api[7683]: 2017-09-28 11:53:16.341 7683 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:53:16 ctl02 nova-api[7683]: 2017-09-28 11:53:16.341 7683 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:53:16 ctl02 nova-api[7683]: 2017-09-28 11:53:16.341 7683 ERROR nova
Sep 28 11:53:16 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:53:16 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:53:16 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:53:16 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:53:16 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:53:16 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:53:16 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:53:17 ctl02 nova-consoleauth[5433]: 2017-09-28 11:53:17.056 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:53:17 ctl02 glance-api[29183]: 2017-09-28 11:53:17.455 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:53:17] "OPTIONS / HTTP/1.0" 200 134 0.000605
Sep 28 11:53:18 ctl02 nova-api[7701]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:53:18 ctl02 nova-api[7701]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:53:18 ctl02 glance-api[29183]: 2017-09-28 11:53:18.211 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:53:18] "OPTIONS / HTTP/1.0" 200 134 0.001063
Sep 28 11:53:18 ctl02 nova-api[7701]: 2017-09-28 11:53:18.394 7701 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:53:18 ctl02 nova-api[7701]: 2017-09-28 11:53:18.396 7701 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:53:18 ctl02 nova-api[7701]: 2017-09-28 11:53:18.396 7701 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:53:18 ctl02 nova-api[7701]: 2017-09-28 11:53:18.396 7701 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:53:18 ctl02 nova-api[7701]: 2017-09-28 11:53:18.396 7701 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:53:18 ctl02 nova-api[7701]: 2017-09-28 11:53:18.396 7701 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:53:18 ctl02 nova-api[7701]: 2017-09-28 11:53:18.396 7701 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:53:18 ctl02 nova-api[7701]: 2017-09-28 11:53:18.396 7701 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:53:18 ctl02 nova-api[7701]: 2017-09-28 11:53:18.396 7701 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:53:18 ctl02 nova-api[7701]: 2017-09-28 11:53:18.396 7701 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:53:18 ctl02 nova-api[7701]: 2017-09-28 11:53:18.396 7701 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:53:18 ctl02 nova-api[7701]: 2017-09-28 11:53:18.396 7701 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:53:18 ctl02 nova-api[7701]: 2017-09-28 11:53:18.396 7701 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:53:18 ctl02 nova-api[7701]: 2017-09-28 11:53:18.396 7701 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:53:18 ctl02 nova-api[7701]: 2017-09-28 11:53:18.396 7701 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:53:18 ctl02 nova-api[7701]: 2017-09-28 11:53:18.396 7701 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:53:18 ctl02 nova-api[7701]: 2017-09-28 11:53:18.396 7701 ERROR nova.wsgi     self.filename))
Sep 28 11:53:18 ctl02 nova-api[7701]: 2017-09-28 11:53:18.396 7701 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:53:18 ctl02 nova-api[7701]: 2017-09-28 11:53:18.396 7701 ERROR nova.wsgi
Sep 28 11:53:18 ctl02 nova-api[7701]: 2017-09-28 11:53:18.398 7701 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:53:18 ctl02 nova-api[7701]: 2017-09-28 11:53:18.533 7701 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:53:18 ctl02 nova-api[7701]: 2017-09-28 11:53:18.779 7701 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:53:18 ctl02 nova-api[7701]: 2017-09-28 11:53:18.783 7701 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:53:18 ctl02 nova-api[7701]: 2017-09-28 11:53:18.783 7701 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:53:18 ctl02 nova-api[7701]: 2017-09-28 11:53:18.783 7701 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:53:18 ctl02 nova-api[7701]: 2017-09-28 11:53:18.917 7701 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:53:18 ctl02 nova-api[7701]: 2017-09-28 11:53:18.920 7701 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:53:18 ctl02 nova-api[7701]: 2017-09-28 11:53:18.920 7701 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:53:18 ctl02 nova-api[7701]: 2017-09-28 11:53:18.920 7701 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:53:18 ctl02 nova-api[7701]: 2017-09-28 11:53:18.924 7701 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:53:18 ctl02 nova-api[7701]: 2017-09-28 11:53:18.924 7701 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:53:18 ctl02 nova-api[7701]: 2017-09-28 11:53:18.924 7701 ERROR nova Traceback (most recent call last):
Sep 28 11:53:18 ctl02 nova-api[7701]: 2017-09-28 11:53:18.924 7701 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:53:18 ctl02 nova-api[7701]: 2017-09-28 11:53:18.924 7701 ERROR nova     sys.exit(main())
Sep 28 11:53:18 ctl02 nova-api[7701]: 2017-09-28 11:53:18.924 7701 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:53:18 ctl02 nova-api[7701]: 2017-09-28 11:53:18.924 7701 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:53:18 ctl02 nova-api[7701]: 2017-09-28 11:53:18.924 7701 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:53:18 ctl02 nova-api[7701]: 2017-09-28 11:53:18.924 7701 ERROR nova     max_url_len=max_url_len)
Sep 28 11:53:18 ctl02 nova-api[7701]: 2017-09-28 11:53:18.924 7701 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:53:18 ctl02 nova-api[7701]: 2017-09-28 11:53:18.924 7701 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:53:18 ctl02 nova-api[7701]: 2017-09-28 11:53:18.924 7701 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:53:18 ctl02 nova-api[7701]: 2017-09-28 11:53:18.924 7701 ERROR nova     sock.listen(backlog)
Sep 28 11:53:18 ctl02 nova-api[7701]: 2017-09-28 11:53:18.924 7701 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:53:18 ctl02 nova-api[7701]: 2017-09-28 11:53:18.924 7701 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:53:18 ctl02 nova-api[7701]: 2017-09-28 11:53:18.924 7701 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:53:18 ctl02 nova-api[7701]: 2017-09-28 11:53:18.924 7701 ERROR nova
Sep 28 11:53:19 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:53:19 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:53:19 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:53:19 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:53:19 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:53:19 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:53:19 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:53:20 ctl02 nova-scheduler[5620]: 2017-09-28 11:53:20.078 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:53:20 ctl02 nova-api[7719]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:53:20 ctl02 nova-api[7719]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:53:21 ctl02 nova-api[7719]: 2017-09-28 11:53:21.120 7719 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:53:21 ctl02 nova-api[7719]: 2017-09-28 11:53:21.122 7719 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:53:21 ctl02 nova-api[7719]: 2017-09-28 11:53:21.122 7719 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:53:21 ctl02 nova-api[7719]: 2017-09-28 11:53:21.122 7719 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:53:21 ctl02 nova-api[7719]: 2017-09-28 11:53:21.122 7719 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:53:21 ctl02 nova-api[7719]: 2017-09-28 11:53:21.122 7719 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:53:21 ctl02 nova-api[7719]: 2017-09-28 11:53:21.122 7719 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:53:21 ctl02 nova-api[7719]: 2017-09-28 11:53:21.122 7719 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:53:21 ctl02 nova-api[7719]: 2017-09-28 11:53:21.122 7719 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:53:21 ctl02 nova-api[7719]: 2017-09-28 11:53:21.122 7719 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:53:21 ctl02 nova-api[7719]: 2017-09-28 11:53:21.122 7719 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:53:21 ctl02 nova-api[7719]: 2017-09-28 11:53:21.122 7719 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:53:21 ctl02 nova-api[7719]: 2017-09-28 11:53:21.122 7719 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:53:21 ctl02 nova-api[7719]: 2017-09-28 11:53:21.122 7719 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:53:21 ctl02 nova-api[7719]: 2017-09-28 11:53:21.122 7719 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:53:21 ctl02 nova-api[7719]: 2017-09-28 11:53:21.122 7719 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:53:21 ctl02 nova-api[7719]: 2017-09-28 11:53:21.122 7719 ERROR nova.wsgi     self.filename))
Sep 28 11:53:21 ctl02 nova-api[7719]: 2017-09-28 11:53:21.122 7719 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:53:21 ctl02 nova-api[7719]: 2017-09-28 11:53:21.122 7719 ERROR nova.wsgi
Sep 28 11:53:21 ctl02 nova-api[7719]: 2017-09-28 11:53:21.124 7719 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:53:21 ctl02 nova-api[7719]: 2017-09-28 11:53:21.258 7719 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:53:21 ctl02 nova-api[7719]: 2017-09-28 11:53:21.495 7719 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:53:21 ctl02 nova-api[7719]: 2017-09-28 11:53:21.498 7719 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:53:21 ctl02 nova-api[7719]: 2017-09-28 11:53:21.498 7719 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:53:21 ctl02 nova-api[7719]: 2017-09-28 11:53:21.499 7719 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:53:21 ctl02 nova-api[7719]: 2017-09-28 11:53:21.627 7719 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:53:21 ctl02 nova-api[7719]: 2017-09-28 11:53:21.630 7719 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:53:21 ctl02 nova-api[7719]: 2017-09-28 11:53:21.630 7719 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:53:21 ctl02 nova-api[7719]: 2017-09-28 11:53:21.631 7719 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:53:21 ctl02 nova-api[7719]: 2017-09-28 11:53:21.634 7719 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:53:21 ctl02 nova-api[7719]: 2017-09-28 11:53:21.635 7719 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:53:21 ctl02 nova-api[7719]: 2017-09-28 11:53:21.635 7719 ERROR nova Traceback (most recent call last):
Sep 28 11:53:21 ctl02 nova-api[7719]: 2017-09-28 11:53:21.635 7719 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:53:21 ctl02 nova-api[7719]: 2017-09-28 11:53:21.635 7719 ERROR nova     sys.exit(main())
Sep 28 11:53:21 ctl02 nova-api[7719]: 2017-09-28 11:53:21.635 7719 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:53:21 ctl02 nova-api[7719]: 2017-09-28 11:53:21.635 7719 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:53:21 ctl02 nova-api[7719]: 2017-09-28 11:53:21.635 7719 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:53:21 ctl02 nova-api[7719]: 2017-09-28 11:53:21.635 7719 ERROR nova     max_url_len=max_url_len)
Sep 28 11:53:21 ctl02 nova-api[7719]: 2017-09-28 11:53:21.635 7719 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:53:21 ctl02 nova-api[7719]: 2017-09-28 11:53:21.635 7719 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:53:21 ctl02 nova-api[7719]: 2017-09-28 11:53:21.635 7719 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:53:21 ctl02 nova-api[7719]: 2017-09-28 11:53:21.635 7719 ERROR nova     sock.listen(backlog)
Sep 28 11:53:21 ctl02 nova-api[7719]: 2017-09-28 11:53:21.635 7719 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:53:21 ctl02 nova-api[7719]: 2017-09-28 11:53:21.635 7719 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:53:21 ctl02 nova-api[7719]: 2017-09-28 11:53:21.635 7719 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:53:21 ctl02 nova-api[7719]: 2017-09-28 11:53:21.635 7719 ERROR nova
Sep 28 11:53:21 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:53:21 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:53:21 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:53:22 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:53:22 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:53:22 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:53:22 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:53:23 ctl02 glance-api[29183]: 2017-09-28 11:53:23.592 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:53:23] "OPTIONS / HTTP/1.0" 200 134 0.000731
Sep 28 11:53:23 ctl02 nova-api[7737]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:53:23 ctl02 nova-api[7737]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:53:23 ctl02 nova-api[7737]: 2017-09-28 11:53:23.835 7737 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:53:23 ctl02 nova-api[7737]: 2017-09-28 11:53:23.836 7737 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:53:23 ctl02 nova-api[7737]: 2017-09-28 11:53:23.836 7737 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:53:23 ctl02 nova-api[7737]: 2017-09-28 11:53:23.836 7737 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:53:23 ctl02 nova-api[7737]: 2017-09-28 11:53:23.836 7737 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:53:23 ctl02 nova-api[7737]: 2017-09-28 11:53:23.836 7737 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:53:23 ctl02 nova-api[7737]: 2017-09-28 11:53:23.836 7737 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:53:23 ctl02 nova-api[7737]: 2017-09-28 11:53:23.836 7737 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:53:23 ctl02 nova-api[7737]: 2017-09-28 11:53:23.836 7737 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:53:23 ctl02 nova-api[7737]: 2017-09-28 11:53:23.836 7737 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:53:23 ctl02 nova-api[7737]: 2017-09-28 11:53:23.836 7737 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:53:23 ctl02 nova-api[7737]: 2017-09-28 11:53:23.836 7737 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:53:23 ctl02 nova-api[7737]: 2017-09-28 11:53:23.836 7737 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:53:23 ctl02 nova-api[7737]: 2017-09-28 11:53:23.836 7737 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:53:23 ctl02 nova-api[7737]: 2017-09-28 11:53:23.836 7737 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:53:23 ctl02 nova-api[7737]: 2017-09-28 11:53:23.836 7737 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:53:23 ctl02 nova-api[7737]: 2017-09-28 11:53:23.836 7737 ERROR nova.wsgi     self.filename))
Sep 28 11:53:23 ctl02 nova-api[7737]: 2017-09-28 11:53:23.836 7737 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:53:23 ctl02 nova-api[7737]: 2017-09-28 11:53:23.836 7737 ERROR nova.wsgi
Sep 28 11:53:23 ctl02 nova-api[7737]: 2017-09-28 11:53:23.837 7737 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:53:23 ctl02 nova-api[7737]: 2017-09-28 11:53:23.969 7737 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:53:24 ctl02 nova-api[7737]: 2017-09-28 11:53:24.211 7737 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:53:24 ctl02 nova-api[7737]: 2017-09-28 11:53:24.213 7737 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:53:24 ctl02 nova-api[7737]: 2017-09-28 11:53:24.213 7737 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:53:24 ctl02 nova-api[7737]: 2017-09-28 11:53:24.214 7737 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:53:24 ctl02 nova-api[7737]: 2017-09-28 11:53:24.347 7737 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:53:24 ctl02 nova-api[7737]: 2017-09-28 11:53:24.349 7737 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:53:24 ctl02 nova-api[7737]: 2017-09-28 11:53:24.349 7737 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:53:24 ctl02 nova-api[7737]: 2017-09-28 11:53:24.349 7737 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:53:24 ctl02 nova-api[7737]: 2017-09-28 11:53:24.352 7737 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:53:24 ctl02 nova-api[7737]: 2017-09-28 11:53:24.353 7737 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:53:24 ctl02 nova-api[7737]: 2017-09-28 11:53:24.353 7737 ERROR nova Traceback (most recent call last):
Sep 28 11:53:24 ctl02 nova-api[7737]: 2017-09-28 11:53:24.353 7737 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:53:24 ctl02 nova-api[7737]: 2017-09-28 11:53:24.353 7737 ERROR nova     sys.exit(main())
Sep 28 11:53:24 ctl02 nova-api[7737]: 2017-09-28 11:53:24.353 7737 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:53:24 ctl02 nova-api[7737]: 2017-09-28 11:53:24.353 7737 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:53:24 ctl02 nova-api[7737]: 2017-09-28 11:53:24.353 7737 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:53:24 ctl02 nova-api[7737]: 2017-09-28 11:53:24.353 7737 ERROR nova     max_url_len=max_url_len)
Sep 28 11:53:24 ctl02 nova-api[7737]: 2017-09-28 11:53:24.353 7737 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:53:24 ctl02 nova-api[7737]: 2017-09-28 11:53:24.353 7737 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:53:24 ctl02 nova-api[7737]: 2017-09-28 11:53:24.353 7737 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:53:24 ctl02 nova-api[7737]: 2017-09-28 11:53:24.353 7737 ERROR nova     sock.listen(backlog)
Sep 28 11:53:24 ctl02 nova-api[7737]: 2017-09-28 11:53:24.353 7737 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:53:24 ctl02 nova-api[7737]: 2017-09-28 11:53:24.353 7737 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:53:24 ctl02 nova-api[7737]: 2017-09-28 11:53:24.353 7737 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:53:24 ctl02 nova-api[7737]: 2017-09-28 11:53:24.353 7737 ERROR nova
Sep 28 11:53:24 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:53:24 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:53:24 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:53:24 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:53:24 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:53:24 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:53:24 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:53:26 ctl02 nova-api[7755]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:53:26 ctl02 nova-api[7755]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:53:26 ctl02 nova-api[7755]: 2017-09-28 11:53:26.326 7755 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:53:26 ctl02 nova-api[7755]: 2017-09-28 11:53:26.327 7755 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:53:26 ctl02 nova-api[7755]: 2017-09-28 11:53:26.327 7755 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:53:26 ctl02 nova-api[7755]: 2017-09-28 11:53:26.327 7755 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:53:26 ctl02 nova-api[7755]: 2017-09-28 11:53:26.327 7755 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:53:26 ctl02 nova-api[7755]: 2017-09-28 11:53:26.327 7755 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:53:26 ctl02 nova-api[7755]: 2017-09-28 11:53:26.327 7755 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:53:26 ctl02 nova-api[7755]: 2017-09-28 11:53:26.327 7755 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:53:26 ctl02 nova-api[7755]: 2017-09-28 11:53:26.327 7755 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:53:26 ctl02 nova-api[7755]: 2017-09-28 11:53:26.327 7755 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:53:26 ctl02 nova-api[7755]: 2017-09-28 11:53:26.327 7755 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:53:26 ctl02 nova-api[7755]: 2017-09-28 11:53:26.327 7755 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:53:26 ctl02 nova-api[7755]: 2017-09-28 11:53:26.327 7755 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:53:26 ctl02 nova-api[7755]: 2017-09-28 11:53:26.327 7755 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:53:26 ctl02 nova-api[7755]: 2017-09-28 11:53:26.327 7755 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:53:26 ctl02 nova-api[7755]: 2017-09-28 11:53:26.327 7755 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:53:26 ctl02 nova-api[7755]: 2017-09-28 11:53:26.327 7755 ERROR nova.wsgi     self.filename))
Sep 28 11:53:26 ctl02 nova-api[7755]: 2017-09-28 11:53:26.327 7755 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:53:26 ctl02 nova-api[7755]: 2017-09-28 11:53:26.327 7755 ERROR nova.wsgi
Sep 28 11:53:26 ctl02 nova-api[7755]: 2017-09-28 11:53:26.328 7755 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:53:26 ctl02 nova-api[7755]: 2017-09-28 11:53:26.459 7755 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:53:26 ctl02 nova-api[7755]: 2017-09-28 11:53:26.708 7755 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:53:26 ctl02 nova-api[7755]: 2017-09-28 11:53:26.711 7755 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:53:26 ctl02 nova-api[7755]: 2017-09-28 11:53:26.711 7755 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:53:26 ctl02 nova-api[7755]: 2017-09-28 11:53:26.711 7755 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:53:26 ctl02 nova-api[7755]: 2017-09-28 11:53:26.843 7755 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:53:26 ctl02 nova-api[7755]: 2017-09-28 11:53:26.845 7755 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:53:26 ctl02 nova-api[7755]: 2017-09-28 11:53:26.845 7755 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:53:26 ctl02 nova-api[7755]: 2017-09-28 11:53:26.846 7755 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:53:26 ctl02 nova-api[7755]: 2017-09-28 11:53:26.849 7755 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:53:26 ctl02 nova-api[7755]: 2017-09-28 11:53:26.849 7755 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:53:26 ctl02 nova-api[7755]: 2017-09-28 11:53:26.849 7755 ERROR nova Traceback (most recent call last):
Sep 28 11:53:26 ctl02 nova-api[7755]: 2017-09-28 11:53:26.849 7755 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:53:26 ctl02 nova-api[7755]: 2017-09-28 11:53:26.849 7755 ERROR nova     sys.exit(main())
Sep 28 11:53:26 ctl02 nova-api[7755]: 2017-09-28 11:53:26.849 7755 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:53:26 ctl02 nova-api[7755]: 2017-09-28 11:53:26.849 7755 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:53:26 ctl02 nova-api[7755]: 2017-09-28 11:53:26.849 7755 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:53:26 ctl02 nova-api[7755]: 2017-09-28 11:53:26.849 7755 ERROR nova     max_url_len=max_url_len)
Sep 28 11:53:26 ctl02 nova-api[7755]: 2017-09-28 11:53:26.849 7755 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:53:26 ctl02 nova-api[7755]: 2017-09-28 11:53:26.849 7755 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:53:26 ctl02 nova-api[7755]: 2017-09-28 11:53:26.849 7755 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:53:26 ctl02 nova-api[7755]: 2017-09-28 11:53:26.849 7755 ERROR nova     sock.listen(backlog)
Sep 28 11:53:26 ctl02 nova-api[7755]: 2017-09-28 11:53:26.849 7755 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:53:26 ctl02 nova-api[7755]: 2017-09-28 11:53:26.849 7755 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:53:26 ctl02 nova-api[7755]: 2017-09-28 11:53:26.849 7755 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:53:26 ctl02 nova-api[7755]: 2017-09-28 11:53:26.849 7755 ERROR nova
Sep 28 11:53:27 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:53:27 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:53:27 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:53:27 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:53:27 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:53:27 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:53:27 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:53:27 ctl02 glance-api[29183]: 2017-09-28 11:53:27.254 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:53:27] "OPTIONS / HTTP/1.0" 200 134 0.000647
Sep 28 11:53:28 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8f533248)
Sep 28 11:53:28 ctl02 glance-api[29183]: 2017-09-28 11:53:28.196 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:53:28] "OPTIONS / HTTP/1.0" 200 134 0.001172
Sep 28 11:53:28 ctl02 nova-api[7773]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:53:28 ctl02 nova-api[7773]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:53:28 ctl02 nova-api[7773]: 2017-09-28 11:53:28.844 7773 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:53:28 ctl02 nova-api[7773]: 2017-09-28 11:53:28.845 7773 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:53:28 ctl02 nova-api[7773]: 2017-09-28 11:53:28.845 7773 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:53:28 ctl02 nova-api[7773]: 2017-09-28 11:53:28.845 7773 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:53:28 ctl02 nova-api[7773]: 2017-09-28 11:53:28.845 7773 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:53:28 ctl02 nova-api[7773]: 2017-09-28 11:53:28.845 7773 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:53:28 ctl02 nova-api[7773]: 2017-09-28 11:53:28.845 7773 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:53:28 ctl02 nova-api[7773]: 2017-09-28 11:53:28.845 7773 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:53:28 ctl02 nova-api[7773]: 2017-09-28 11:53:28.845 7773 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:53:28 ctl02 nova-api[7773]: 2017-09-28 11:53:28.845 7773 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:53:28 ctl02 nova-api[7773]: 2017-09-28 11:53:28.845 7773 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:53:28 ctl02 nova-api[7773]: 2017-09-28 11:53:28.845 7773 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:53:28 ctl02 nova-api[7773]: 2017-09-28 11:53:28.845 7773 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:53:28 ctl02 nova-api[7773]: 2017-09-28 11:53:28.845 7773 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:53:28 ctl02 nova-api[7773]: 2017-09-28 11:53:28.845 7773 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:53:28 ctl02 nova-api[7773]: 2017-09-28 11:53:28.845 7773 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:53:28 ctl02 nova-api[7773]: 2017-09-28 11:53:28.845 7773 ERROR nova.wsgi     self.filename))
Sep 28 11:53:28 ctl02 nova-api[7773]: 2017-09-28 11:53:28.845 7773 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:53:28 ctl02 nova-api[7773]: 2017-09-28 11:53:28.845 7773 ERROR nova.wsgi
Sep 28 11:53:28 ctl02 nova-api[7773]: 2017-09-28 11:53:28.846 7773 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:53:28 ctl02 nova-api[7773]: 2017-09-28 11:53:28.978 7773 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:53:29 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8f533248)
Sep 28 11:53:29 ctl02 nova-api[7773]: 2017-09-28 11:53:29.222 7773 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:53:29 ctl02 nova-api[7773]: 2017-09-28 11:53:29.224 7773 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:53:29 ctl02 nova-api[7773]: 2017-09-28 11:53:29.224 7773 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:53:29 ctl02 nova-api[7773]: 2017-09-28 11:53:29.224 7773 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:53:29 ctl02 nova-api[7773]: 2017-09-28 11:53:29.355 7773 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:53:29 ctl02 nova-api[7773]: 2017-09-28 11:53:29.357 7773 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:53:29 ctl02 nova-api[7773]: 2017-09-28 11:53:29.357 7773 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:53:29 ctl02 nova-api[7773]: 2017-09-28 11:53:29.357 7773 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:53:29 ctl02 nova-api[7773]: 2017-09-28 11:53:29.361 7773 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:53:29 ctl02 nova-api[7773]: 2017-09-28 11:53:29.361 7773 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:53:29 ctl02 nova-api[7773]: 2017-09-28 11:53:29.361 7773 ERROR nova Traceback (most recent call last):
Sep 28 11:53:29 ctl02 nova-api[7773]: 2017-09-28 11:53:29.361 7773 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:53:29 ctl02 nova-api[7773]: 2017-09-28 11:53:29.361 7773 ERROR nova     sys.exit(main())
Sep 28 11:53:29 ctl02 nova-api[7773]: 2017-09-28 11:53:29.361 7773 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:53:29 ctl02 nova-api[7773]: 2017-09-28 11:53:29.361 7773 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:53:29 ctl02 nova-api[7773]: 2017-09-28 11:53:29.361 7773 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:53:29 ctl02 nova-api[7773]: 2017-09-28 11:53:29.361 7773 ERROR nova     max_url_len=max_url_len)
Sep 28 11:53:29 ctl02 nova-api[7773]: 2017-09-28 11:53:29.361 7773 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:53:29 ctl02 nova-api[7773]: 2017-09-28 11:53:29.361 7773 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:53:29 ctl02 nova-api[7773]: 2017-09-28 11:53:29.361 7773 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:53:29 ctl02 nova-api[7773]: 2017-09-28 11:53:29.361 7773 ERROR nova     sock.listen(backlog)
Sep 28 11:53:29 ctl02 nova-api[7773]: 2017-09-28 11:53:29.361 7773 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:53:29 ctl02 nova-api[7773]: 2017-09-28 11:53:29.361 7773 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:53:29 ctl02 nova-api[7773]: 2017-09-28 11:53:29.361 7773 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:53:29 ctl02 nova-api[7773]: 2017-09-28 11:53:29.361 7773 ERROR nova
Sep 28 11:53:29 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:53:29 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:53:29 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:53:29 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:53:29 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:53:29 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:53:29 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:53:30 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8f533248)
Sep 28 11:53:31 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8f533248)
Sep 28 11:53:31 ctl02 nova-api[7791]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:53:31 ctl02 nova-api[7791]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:53:31 ctl02 nova-api[7791]: 2017-09-28 11:53:31.346 7791 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:53:31 ctl02 nova-api[7791]: 2017-09-28 11:53:31.347 7791 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:53:31 ctl02 nova-api[7791]: 2017-09-28 11:53:31.347 7791 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:53:31 ctl02 nova-api[7791]: 2017-09-28 11:53:31.347 7791 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:53:31 ctl02 nova-api[7791]: 2017-09-28 11:53:31.347 7791 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:53:31 ctl02 nova-api[7791]: 2017-09-28 11:53:31.347 7791 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:53:31 ctl02 nova-api[7791]: 2017-09-28 11:53:31.347 7791 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:53:31 ctl02 nova-api[7791]: 2017-09-28 11:53:31.347 7791 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:53:31 ctl02 nova-api[7791]: 2017-09-28 11:53:31.347 7791 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:53:31 ctl02 nova-api[7791]: 2017-09-28 11:53:31.347 7791 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:53:31 ctl02 nova-api[7791]: 2017-09-28 11:53:31.347 7791 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:53:31 ctl02 nova-api[7791]: 2017-09-28 11:53:31.347 7791 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:53:31 ctl02 nova-api[7791]: 2017-09-28 11:53:31.347 7791 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:53:31 ctl02 nova-api[7791]: 2017-09-28 11:53:31.347 7791 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:53:31 ctl02 nova-api[7791]: 2017-09-28 11:53:31.347 7791 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:53:31 ctl02 nova-api[7791]: 2017-09-28 11:53:31.347 7791 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:53:31 ctl02 nova-api[7791]: 2017-09-28 11:53:31.347 7791 ERROR nova.wsgi     self.filename))
Sep 28 11:53:31 ctl02 nova-api[7791]: 2017-09-28 11:53:31.347 7791 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:53:31 ctl02 nova-api[7791]: 2017-09-28 11:53:31.347 7791 ERROR nova.wsgi
Sep 28 11:53:31 ctl02 nova-api[7791]: 2017-09-28 11:53:31.348 7791 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:53:31 ctl02 nova-api[7791]: 2017-09-28 11:53:31.480 7791 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:53:31 ctl02 nova-api[7791]: 2017-09-28 11:53:31.721 7791 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:53:31 ctl02 nova-api[7791]: 2017-09-28 11:53:31.723 7791 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:53:31 ctl02 nova-api[7791]: 2017-09-28 11:53:31.723 7791 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:53:31 ctl02 nova-api[7791]: 2017-09-28 11:53:31.724 7791 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:53:31 ctl02 nova-api[7791]: 2017-09-28 11:53:31.854 7791 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:53:31 ctl02 nova-api[7791]: 2017-09-28 11:53:31.856 7791 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:53:31 ctl02 nova-api[7791]: 2017-09-28 11:53:31.856 7791 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:53:31 ctl02 nova-api[7791]: 2017-09-28 11:53:31.856 7791 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:53:31 ctl02 nova-api[7791]: 2017-09-28 11:53:31.860 7791 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:53:31 ctl02 nova-api[7791]: 2017-09-28 11:53:31.860 7791 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:53:31 ctl02 nova-api[7791]: 2017-09-28 11:53:31.860 7791 ERROR nova Traceback (most recent call last):
Sep 28 11:53:31 ctl02 nova-api[7791]: 2017-09-28 11:53:31.860 7791 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:53:31 ctl02 nova-api[7791]: 2017-09-28 11:53:31.860 7791 ERROR nova     sys.exit(main())
Sep 28 11:53:31 ctl02 nova-api[7791]: 2017-09-28 11:53:31.860 7791 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:53:31 ctl02 nova-api[7791]: 2017-09-28 11:53:31.860 7791 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:53:31 ctl02 nova-api[7791]: 2017-09-28 11:53:31.860 7791 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:53:31 ctl02 nova-api[7791]: 2017-09-28 11:53:31.860 7791 ERROR nova     max_url_len=max_url_len)
Sep 28 11:53:31 ctl02 nova-api[7791]: 2017-09-28 11:53:31.860 7791 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:53:31 ctl02 nova-api[7791]: 2017-09-28 11:53:31.860 7791 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:53:31 ctl02 nova-api[7791]: 2017-09-28 11:53:31.860 7791 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:53:31 ctl02 nova-api[7791]: 2017-09-28 11:53:31.860 7791 ERROR nova     sock.listen(backlog)
Sep 28 11:53:31 ctl02 nova-api[7791]: 2017-09-28 11:53:31.860 7791 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:53:31 ctl02 nova-api[7791]: 2017-09-28 11:53:31.860 7791 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:53:31 ctl02 nova-api[7791]: 2017-09-28 11:53:31.860 7791 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:53:31 ctl02 nova-api[7791]: 2017-09-28 11:53:31.860 7791 ERROR nova
Sep 28 11:53:32 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:53:32 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:53:32 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:53:32 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:53:32 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:53:32 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8f533248)
Sep 28 11:53:32 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:53:32 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:53:33 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8f533248)
Sep 28 11:53:33 ctl02 glance-api[29183]: 2017-09-28 11:53:33.376 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:53:33] "OPTIONS / HTTP/1.0" 200 134 0.001061
Sep 28 11:53:33 ctl02 nova-api[7809]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:53:33 ctl02 nova-api[7809]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:53:33 ctl02 nova-api[7809]: 2017-09-28 11:53:33.864 7809 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:53:33 ctl02 nova-api[7809]: 2017-09-28 11:53:33.866 7809 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:53:33 ctl02 nova-api[7809]: 2017-09-28 11:53:33.866 7809 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:53:33 ctl02 nova-api[7809]: 2017-09-28 11:53:33.866 7809 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:53:33 ctl02 nova-api[7809]: 2017-09-28 11:53:33.866 7809 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:53:33 ctl02 nova-api[7809]: 2017-09-28 11:53:33.866 7809 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:53:33 ctl02 nova-api[7809]: 2017-09-28 11:53:33.866 7809 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:53:33 ctl02 nova-api[7809]: 2017-09-28 11:53:33.866 7809 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:53:33 ctl02 nova-api[7809]: 2017-09-28 11:53:33.866 7809 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:53:33 ctl02 nova-api[7809]: 2017-09-28 11:53:33.866 7809 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:53:33 ctl02 nova-api[7809]: 2017-09-28 11:53:33.866 7809 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:53:33 ctl02 nova-api[7809]: 2017-09-28 11:53:33.866 7809 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:53:33 ctl02 nova-api[7809]: 2017-09-28 11:53:33.866 7809 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:53:33 ctl02 nova-api[7809]: 2017-09-28 11:53:33.866 7809 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:53:33 ctl02 nova-api[7809]: 2017-09-28 11:53:33.866 7809 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:53:33 ctl02 nova-api[7809]: 2017-09-28 11:53:33.866 7809 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:53:33 ctl02 nova-api[7809]: 2017-09-28 11:53:33.866 7809 ERROR nova.wsgi     self.filename))
Sep 28 11:53:33 ctl02 nova-api[7809]: 2017-09-28 11:53:33.866 7809 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:53:33 ctl02 nova-api[7809]: 2017-09-28 11:53:33.866 7809 ERROR nova.wsgi
Sep 28 11:53:33 ctl02 nova-api[7809]: 2017-09-28 11:53:33.868 7809 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:53:33 ctl02 nova-api[7809]: 2017-09-28 11:53:33.998 7809 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:53:34 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8f533248)
Sep 28 11:53:34 ctl02 nova-api[7809]: 2017-09-28 11:53:34.240 7809 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:53:34 ctl02 nova-api[7809]: 2017-09-28 11:53:34.243 7809 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:53:34 ctl02 nova-api[7809]: 2017-09-28 11:53:34.243 7809 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:53:34 ctl02 nova-api[7809]: 2017-09-28 11:53:34.243 7809 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:53:34 ctl02 nova-api[7809]: 2017-09-28 11:53:34.374 7809 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:53:34 ctl02 nova-api[7809]: 2017-09-28 11:53:34.376 7809 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:53:34 ctl02 nova-api[7809]: 2017-09-28 11:53:34.376 7809 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:53:34 ctl02 nova-api[7809]: 2017-09-28 11:53:34.376 7809 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:53:34 ctl02 nova-api[7809]: 2017-09-28 11:53:34.379 7809 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:53:34 ctl02 nova-api[7809]: 2017-09-28 11:53:34.380 7809 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:53:34 ctl02 nova-api[7809]: 2017-09-28 11:53:34.380 7809 ERROR nova Traceback (most recent call last):
Sep 28 11:53:34 ctl02 nova-api[7809]: 2017-09-28 11:53:34.380 7809 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:53:34 ctl02 nova-api[7809]: 2017-09-28 11:53:34.380 7809 ERROR nova     sys.exit(main())
Sep 28 11:53:34 ctl02 nova-api[7809]: 2017-09-28 11:53:34.380 7809 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:53:34 ctl02 nova-api[7809]: 2017-09-28 11:53:34.380 7809 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:53:34 ctl02 nova-api[7809]: 2017-09-28 11:53:34.380 7809 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:53:34 ctl02 nova-api[7809]: 2017-09-28 11:53:34.380 7809 ERROR nova     max_url_len=max_url_len)
Sep 28 11:53:34 ctl02 nova-api[7809]: 2017-09-28 11:53:34.380 7809 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:53:34 ctl02 nova-api[7809]: 2017-09-28 11:53:34.380 7809 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:53:34 ctl02 nova-api[7809]: 2017-09-28 11:53:34.380 7809 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:53:34 ctl02 nova-api[7809]: 2017-09-28 11:53:34.380 7809 ERROR nova     sock.listen(backlog)
Sep 28 11:53:34 ctl02 nova-api[7809]: 2017-09-28 11:53:34.380 7809 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:53:34 ctl02 nova-api[7809]: 2017-09-28 11:53:34.380 7809 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:53:34 ctl02 nova-api[7809]: 2017-09-28 11:53:34.380 7809 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:53:34 ctl02 nova-api[7809]: 2017-09-28 11:53:34.380 7809 ERROR nova
Sep 28 11:53:34 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:53:34 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:53:34 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:53:34 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:53:34 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:53:34 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:53:34 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:53:35 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8f533248)
Sep 28 11:53:36 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8f533248)
Sep 28 11:53:36 ctl02 nova-api[7827]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:53:36 ctl02 nova-api[7827]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:53:36 ctl02 nova-api[7827]: 2017-09-28 11:53:36.597 7827 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:53:36 ctl02 nova-api[7827]: 2017-09-28 11:53:36.599 7827 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:53:36 ctl02 nova-api[7827]: 2017-09-28 11:53:36.599 7827 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:53:36 ctl02 nova-api[7827]: 2017-09-28 11:53:36.599 7827 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:53:36 ctl02 nova-api[7827]: 2017-09-28 11:53:36.599 7827 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:53:36 ctl02 nova-api[7827]: 2017-09-28 11:53:36.599 7827 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:53:36 ctl02 nova-api[7827]: 2017-09-28 11:53:36.599 7827 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:53:36 ctl02 nova-api[7827]: 2017-09-28 11:53:36.599 7827 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:53:36 ctl02 nova-api[7827]: 2017-09-28 11:53:36.599 7827 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:53:36 ctl02 nova-api[7827]: 2017-09-28 11:53:36.599 7827 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:53:36 ctl02 nova-api[7827]: 2017-09-28 11:53:36.599 7827 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:53:36 ctl02 nova-api[7827]: 2017-09-28 11:53:36.599 7827 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:53:36 ctl02 nova-api[7827]: 2017-09-28 11:53:36.599 7827 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:53:36 ctl02 nova-api[7827]: 2017-09-28 11:53:36.599 7827 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:53:36 ctl02 nova-api[7827]: 2017-09-28 11:53:36.599 7827 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:53:36 ctl02 nova-api[7827]: 2017-09-28 11:53:36.599 7827 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:53:36 ctl02 nova-api[7827]: 2017-09-28 11:53:36.599 7827 ERROR nova.wsgi     self.filename))
Sep 28 11:53:36 ctl02 nova-api[7827]: 2017-09-28 11:53:36.599 7827 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:53:36 ctl02 nova-api[7827]: 2017-09-28 11:53:36.599 7827 ERROR nova.wsgi
Sep 28 11:53:36 ctl02 nova-api[7827]: 2017-09-28 11:53:36.601 7827 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:53:36 ctl02 nova-api[7827]: 2017-09-28 11:53:36.734 7827 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:53:36 ctl02 nova-api[7827]: 2017-09-28 11:53:36.975 7827 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:53:36 ctl02 nova-api[7827]: 2017-09-28 11:53:36.977 7827 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:53:36 ctl02 nova-api[7827]: 2017-09-28 11:53:36.978 7827 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:53:36 ctl02 nova-api[7827]: 2017-09-28 11:53:36.978 7827 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:53:37 ctl02 nova-api[7827]: 2017-09-28 11:53:37.109 7827 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:53:37 ctl02 nova-api[7827]: 2017-09-28 11:53:37.111 7827 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:53:37 ctl02 nova-api[7827]: 2017-09-28 11:53:37.112 7827 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:53:37 ctl02 nova-api[7827]: 2017-09-28 11:53:37.112 7827 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:53:37 ctl02 nova-api[7827]: 2017-09-28 11:53:37.116 7827 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:53:37 ctl02 nova-api[7827]: 2017-09-28 11:53:37.116 7827 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:53:37 ctl02 nova-api[7827]: 2017-09-28 11:53:37.116 7827 ERROR nova Traceback (most recent call last):
Sep 28 11:53:37 ctl02 nova-api[7827]: 2017-09-28 11:53:37.116 7827 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:53:37 ctl02 nova-api[7827]: 2017-09-28 11:53:37.116 7827 ERROR nova     sys.exit(main())
Sep 28 11:53:37 ctl02 nova-api[7827]: 2017-09-28 11:53:37.116 7827 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:53:37 ctl02 nova-api[7827]: 2017-09-28 11:53:37.116 7827 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:53:37 ctl02 nova-api[7827]: 2017-09-28 11:53:37.116 7827 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:53:37 ctl02 nova-api[7827]: 2017-09-28 11:53:37.116 7827 ERROR nova     max_url_len=max_url_len)
Sep 28 11:53:37 ctl02 nova-api[7827]: 2017-09-28 11:53:37.116 7827 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:53:37 ctl02 nova-api[7827]: 2017-09-28 11:53:37.116 7827 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:53:37 ctl02 nova-api[7827]: 2017-09-28 11:53:37.116 7827 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:53:37 ctl02 nova-api[7827]: 2017-09-28 11:53:37.116 7827 ERROR nova     sock.listen(backlog)
Sep 28 11:53:37 ctl02 nova-api[7827]: 2017-09-28 11:53:37.116 7827 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:53:37 ctl02 nova-api[7827]: 2017-09-28 11:53:37.116 7827 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:53:37 ctl02 nova-api[7827]: 2017-09-28 11:53:37.116 7827 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:53:37 ctl02 nova-api[7827]: 2017-09-28 11:53:37.116 7827 ERROR nova
Sep 28 11:53:37 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8f533248)
Sep 28 11:53:37 ctl02 glance-api[29183]: 2017-09-28 11:53:37.203 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:53:37] "OPTIONS / HTTP/1.0" 200 134 0.000725
Sep 28 11:53:37 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:53:37 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:53:37 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:53:37 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:53:37 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:53:37 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:53:37 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:53:37 ctl02 glance-api[29183]: 2017-09-28 11:53:37.842 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:53:37] "OPTIONS / HTTP/1.0" 200 134 0.000656
Sep 28 11:53:38 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8f533248)
Sep 28 11:53:39 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:53:39 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:53:39 ctl02 nova-api[7846]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:53:39 ctl02 nova-api[7846]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:53:39 ctl02 nova-cert[4860]: 2017-09-28 11:53:39.192 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:53:39 ctl02 nova-api[7846]: 2017-09-28 11:53:39.361 7846 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:53:39 ctl02 nova-api[7846]: 2017-09-28 11:53:39.362 7846 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:53:39 ctl02 nova-api[7846]: 2017-09-28 11:53:39.362 7846 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:53:39 ctl02 nova-api[7846]: 2017-09-28 11:53:39.362 7846 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:53:39 ctl02 nova-api[7846]: 2017-09-28 11:53:39.362 7846 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:53:39 ctl02 nova-api[7846]: 2017-09-28 11:53:39.362 7846 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:53:39 ctl02 nova-api[7846]: 2017-09-28 11:53:39.362 7846 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:53:39 ctl02 nova-api[7846]: 2017-09-28 11:53:39.362 7846 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:53:39 ctl02 nova-api[7846]: 2017-09-28 11:53:39.362 7846 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:53:39 ctl02 nova-api[7846]: 2017-09-28 11:53:39.362 7846 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:53:39 ctl02 nova-api[7846]: 2017-09-28 11:53:39.362 7846 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:53:39 ctl02 nova-api[7846]: 2017-09-28 11:53:39.362 7846 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:53:39 ctl02 nova-api[7846]: 2017-09-28 11:53:39.362 7846 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:53:39 ctl02 nova-api[7846]: 2017-09-28 11:53:39.362 7846 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:53:39 ctl02 nova-api[7846]: 2017-09-28 11:53:39.362 7846 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:53:39 ctl02 nova-api[7846]: 2017-09-28 11:53:39.362 7846 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:53:39 ctl02 nova-api[7846]: 2017-09-28 11:53:39.362 7846 ERROR nova.wsgi     self.filename))
Sep 28 11:53:39 ctl02 nova-api[7846]: 2017-09-28 11:53:39.362 7846 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:53:39 ctl02 nova-api[7846]: 2017-09-28 11:53:39.362 7846 ERROR nova.wsgi
Sep 28 11:53:39 ctl02 nova-api[7846]: 2017-09-28 11:53:39.363 7846 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:53:39 ctl02 nova-api[7846]: 2017-09-28 11:53:39.497 7846 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:53:39 ctl02 nova-api[7846]: 2017-09-28 11:53:39.742 7846 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:53:39 ctl02 nova-api[7846]: 2017-09-28 11:53:39.744 7846 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:53:39 ctl02 nova-api[7846]: 2017-09-28 11:53:39.744 7846 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:53:39 ctl02 nova-api[7846]: 2017-09-28 11:53:39.744 7846 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:53:39 ctl02 nova-api[7846]: 2017-09-28 11:53:39.880 7846 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:53:39 ctl02 nova-api[7846]: 2017-09-28 11:53:39.882 7846 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:53:39 ctl02 nova-api[7846]: 2017-09-28 11:53:39.882 7846 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:53:39 ctl02 nova-api[7846]: 2017-09-28 11:53:39.883 7846 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:53:39 ctl02 nova-api[7846]: 2017-09-28 11:53:39.887 7846 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:53:39 ctl02 nova-api[7846]: 2017-09-28 11:53:39.887 7846 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:53:39 ctl02 nova-api[7846]: 2017-09-28 11:53:39.887 7846 ERROR nova Traceback (most recent call last):
Sep 28 11:53:39 ctl02 nova-api[7846]: 2017-09-28 11:53:39.887 7846 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:53:39 ctl02 nova-api[7846]: 2017-09-28 11:53:39.887 7846 ERROR nova     sys.exit(main())
Sep 28 11:53:39 ctl02 nova-api[7846]: 2017-09-28 11:53:39.887 7846 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:53:39 ctl02 nova-api[7846]: 2017-09-28 11:53:39.887 7846 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:53:39 ctl02 nova-api[7846]: 2017-09-28 11:53:39.887 7846 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:53:39 ctl02 nova-api[7846]: 2017-09-28 11:53:39.887 7846 ERROR nova     max_url_len=max_url_len)
Sep 28 11:53:39 ctl02 nova-api[7846]: 2017-09-28 11:53:39.887 7846 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:53:39 ctl02 nova-api[7846]: 2017-09-28 11:53:39.887 7846 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:53:39 ctl02 nova-api[7846]: 2017-09-28 11:53:39.887 7846 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:53:39 ctl02 nova-api[7846]: 2017-09-28 11:53:39.887 7846 ERROR nova     sock.listen(backlog)
Sep 28 11:53:39 ctl02 nova-api[7846]: 2017-09-28 11:53:39.887 7846 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:53:39 ctl02 nova-api[7846]: 2017-09-28 11:53:39.887 7846 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:53:39 ctl02 nova-api[7846]: 2017-09-28 11:53:39.887 7846 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:53:39 ctl02 nova-api[7846]: 2017-09-28 11:53:39.887 7846 ERROR nova
Sep 28 11:53:40 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:53:40 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:53:40 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:53:40 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:53:40 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:53:40 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:53:40 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:53:41 ctl02 nova-api[7869]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:53:41 ctl02 nova-api[7869]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:53:42 ctl02 nova-api[7869]: 2017-09-28 11:53:42.075 7869 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:53:42 ctl02 nova-api[7869]: 2017-09-28 11:53:42.076 7869 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:53:42 ctl02 nova-api[7869]: 2017-09-28 11:53:42.076 7869 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:53:42 ctl02 nova-api[7869]: 2017-09-28 11:53:42.076 7869 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:53:42 ctl02 nova-api[7869]: 2017-09-28 11:53:42.076 7869 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:53:42 ctl02 nova-api[7869]: 2017-09-28 11:53:42.076 7869 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:53:42 ctl02 nova-api[7869]: 2017-09-28 11:53:42.076 7869 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:53:42 ctl02 nova-api[7869]: 2017-09-28 11:53:42.076 7869 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:53:42 ctl02 nova-api[7869]: 2017-09-28 11:53:42.076 7869 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:53:42 ctl02 nova-api[7869]: 2017-09-28 11:53:42.076 7869 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:53:42 ctl02 nova-api[7869]: 2017-09-28 11:53:42.076 7869 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:53:42 ctl02 nova-api[7869]: 2017-09-28 11:53:42.076 7869 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:53:42 ctl02 nova-api[7869]: 2017-09-28 11:53:42.076 7869 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:53:42 ctl02 nova-api[7869]: 2017-09-28 11:53:42.076 7869 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:53:42 ctl02 nova-api[7869]: 2017-09-28 11:53:42.076 7869 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:53:42 ctl02 nova-api[7869]: 2017-09-28 11:53:42.076 7869 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:53:42 ctl02 nova-api[7869]: 2017-09-28 11:53:42.076 7869 ERROR nova.wsgi     self.filename))
Sep 28 11:53:42 ctl02 nova-api[7869]: 2017-09-28 11:53:42.076 7869 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:53:42 ctl02 nova-api[7869]: 2017-09-28 11:53:42.076 7869 ERROR nova.wsgi
Sep 28 11:53:42 ctl02 nova-api[7869]: 2017-09-28 11:53:42.077 7869 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:53:42 ctl02 nova-conductor[5056]: 2017-09-28 11:53:42.119 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:53:42 ctl02 nova-conductor[5056]: 2017-09-28 11:53:42.133 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:53:42 ctl02 nova-conductor[5056]: 2017-09-28 11:53:42.150 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:53:42 ctl02 nova-conductor[5056]: 2017-09-28 11:53:42.153 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:53:42 ctl02 nova-api[7869]: 2017-09-28 11:53:42.210 7869 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:53:42 ctl02 nova-api[7869]: 2017-09-28 11:53:42.438 7869 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:53:42 ctl02 nova-api[7869]: 2017-09-28 11:53:42.440 7869 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:53:42 ctl02 nova-api[7869]: 2017-09-28 11:53:42.440 7869 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:53:42 ctl02 nova-api[7869]: 2017-09-28 11:53:42.441 7869 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:53:42 ctl02 nova-api[7869]: 2017-09-28 11:53:42.569 7869 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:53:42 ctl02 nova-api[7869]: 2017-09-28 11:53:42.571 7869 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:53:42 ctl02 nova-api[7869]: 2017-09-28 11:53:42.571 7869 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:53:42 ctl02 nova-api[7869]: 2017-09-28 11:53:42.571 7869 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:53:42 ctl02 nova-api[7869]: 2017-09-28 11:53:42.574 7869 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:53:42 ctl02 nova-api[7869]: 2017-09-28 11:53:42.575 7869 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:53:42 ctl02 nova-api[7869]: 2017-09-28 11:53:42.575 7869 ERROR nova Traceback (most recent call last):
Sep 28 11:53:42 ctl02 nova-api[7869]: 2017-09-28 11:53:42.575 7869 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:53:42 ctl02 nova-api[7869]: 2017-09-28 11:53:42.575 7869 ERROR nova     sys.exit(main())
Sep 28 11:53:42 ctl02 nova-api[7869]: 2017-09-28 11:53:42.575 7869 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:53:42 ctl02 nova-api[7869]: 2017-09-28 11:53:42.575 7869 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:53:42 ctl02 nova-api[7869]: 2017-09-28 11:53:42.575 7869 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:53:42 ctl02 nova-api[7869]: 2017-09-28 11:53:42.575 7869 ERROR nova     max_url_len=max_url_len)
Sep 28 11:53:42 ctl02 nova-api[7869]: 2017-09-28 11:53:42.575 7869 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:53:42 ctl02 nova-api[7869]: 2017-09-28 11:53:42.575 7869 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:53:42 ctl02 nova-api[7869]: 2017-09-28 11:53:42.575 7869 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:53:42 ctl02 nova-api[7869]: 2017-09-28 11:53:42.575 7869 ERROR nova     sock.listen(backlog)
Sep 28 11:53:42 ctl02 nova-api[7869]: 2017-09-28 11:53:42.575 7869 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:53:42 ctl02 nova-api[7869]: 2017-09-28 11:53:42.575 7869 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:53:42 ctl02 nova-api[7869]: 2017-09-28 11:53:42.575 7869 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:53:42 ctl02 nova-api[7869]: 2017-09-28 11:53:42.575 7869 ERROR nova
Sep 28 11:53:42 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:53:42 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:53:42 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:53:42 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:53:42 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:53:42 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:53:42 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:53:43 ctl02 glance-api[29183]: 2017-09-28 11:53:43.031 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:53:43] "OPTIONS / HTTP/1.0" 200 134 0.000688
Sep 28 11:53:44 ctl02 nova-api[7885]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:53:44 ctl02 nova-api[7885]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:53:44 ctl02 nova-api[7885]: 2017-09-28 11:53:44.582 7885 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:53:44 ctl02 nova-api[7885]: 2017-09-28 11:53:44.583 7885 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:53:44 ctl02 nova-api[7885]: 2017-09-28 11:53:44.583 7885 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:53:44 ctl02 nova-api[7885]: 2017-09-28 11:53:44.583 7885 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:53:44 ctl02 nova-api[7885]: 2017-09-28 11:53:44.583 7885 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:53:44 ctl02 nova-api[7885]: 2017-09-28 11:53:44.583 7885 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:53:44 ctl02 nova-api[7885]: 2017-09-28 11:53:44.583 7885 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:53:44 ctl02 nova-api[7885]: 2017-09-28 11:53:44.583 7885 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:53:44 ctl02 nova-api[7885]: 2017-09-28 11:53:44.583 7885 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:53:44 ctl02 nova-api[7885]: 2017-09-28 11:53:44.583 7885 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:53:44 ctl02 nova-api[7885]: 2017-09-28 11:53:44.583 7885 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:53:44 ctl02 nova-api[7885]: 2017-09-28 11:53:44.583 7885 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:53:44 ctl02 nova-api[7885]: 2017-09-28 11:53:44.583 7885 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:53:44 ctl02 nova-api[7885]: 2017-09-28 11:53:44.583 7885 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:53:44 ctl02 nova-api[7885]: 2017-09-28 11:53:44.583 7885 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:53:44 ctl02 nova-api[7885]: 2017-09-28 11:53:44.583 7885 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:53:44 ctl02 nova-api[7885]: 2017-09-28 11:53:44.583 7885 ERROR nova.wsgi     self.filename))
Sep 28 11:53:44 ctl02 nova-api[7885]: 2017-09-28 11:53:44.583 7885 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:53:44 ctl02 nova-api[7885]: 2017-09-28 11:53:44.583 7885 ERROR nova.wsgi
Sep 28 11:53:44 ctl02 nova-api[7885]: 2017-09-28 11:53:44.585 7885 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:53:44 ctl02 nova-api[7885]: 2017-09-28 11:53:44.718 7885 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:53:44 ctl02 nova-api[7885]: 2017-09-28 11:53:44.963 7885 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:53:44 ctl02 nova-api[7885]: 2017-09-28 11:53:44.966 7885 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:53:44 ctl02 nova-api[7885]: 2017-09-28 11:53:44.966 7885 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:53:44 ctl02 nova-api[7885]: 2017-09-28 11:53:44.967 7885 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:53:45 ctl02 nova-api[7885]: 2017-09-28 11:53:45.099 7885 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:53:45 ctl02 nova-api[7885]: 2017-09-28 11:53:45.101 7885 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:53:45 ctl02 nova-api[7885]: 2017-09-28 11:53:45.102 7885 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:53:45 ctl02 nova-api[7885]: 2017-09-28 11:53:45.102 7885 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:53:45 ctl02 nova-api[7885]: 2017-09-28 11:53:45.106 7885 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:53:45 ctl02 nova-api[7885]: 2017-09-28 11:53:45.106 7885 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:53:45 ctl02 nova-api[7885]: 2017-09-28 11:53:45.106 7885 ERROR nova Traceback (most recent call last):
Sep 28 11:53:45 ctl02 nova-api[7885]: 2017-09-28 11:53:45.106 7885 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:53:45 ctl02 nova-api[7885]: 2017-09-28 11:53:45.106 7885 ERROR nova     sys.exit(main())
Sep 28 11:53:45 ctl02 nova-api[7885]: 2017-09-28 11:53:45.106 7885 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:53:45 ctl02 nova-api[7885]: 2017-09-28 11:53:45.106 7885 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:53:45 ctl02 nova-api[7885]: 2017-09-28 11:53:45.106 7885 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:53:45 ctl02 nova-api[7885]: 2017-09-28 11:53:45.106 7885 ERROR nova     max_url_len=max_url_len)
Sep 28 11:53:45 ctl02 nova-api[7885]: 2017-09-28 11:53:45.106 7885 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:53:45 ctl02 nova-api[7885]: 2017-09-28 11:53:45.106 7885 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:53:45 ctl02 nova-api[7885]: 2017-09-28 11:53:45.106 7885 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:53:45 ctl02 nova-api[7885]: 2017-09-28 11:53:45.106 7885 ERROR nova     sock.listen(backlog)
Sep 28 11:53:45 ctl02 nova-api[7885]: 2017-09-28 11:53:45.106 7885 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:53:45 ctl02 nova-api[7885]: 2017-09-28 11:53:45.106 7885 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:53:45 ctl02 nova-api[7885]: 2017-09-28 11:53:45.106 7885 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:53:45 ctl02 nova-api[7885]: 2017-09-28 11:53:45.106 7885 ERROR nova
Sep 28 11:53:45 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:53:45 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:53:45 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:53:45 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:53:45 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:53:45 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:53:45 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:53:46 ctl02 nova-api[7905]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:53:46 ctl02 nova-api[7905]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:53:47 ctl02 nova-api[7905]: 2017-09-28 11:53:47.080 7905 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:53:47 ctl02 nova-api[7905]: 2017-09-28 11:53:47.082 7905 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:53:47 ctl02 nova-api[7905]: 2017-09-28 11:53:47.082 7905 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:53:47 ctl02 nova-api[7905]: 2017-09-28 11:53:47.082 7905 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:53:47 ctl02 nova-api[7905]: 2017-09-28 11:53:47.082 7905 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:53:47 ctl02 nova-api[7905]: 2017-09-28 11:53:47.082 7905 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:53:47 ctl02 nova-api[7905]: 2017-09-28 11:53:47.082 7905 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:53:47 ctl02 nova-api[7905]: 2017-09-28 11:53:47.082 7905 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:53:47 ctl02 nova-api[7905]: 2017-09-28 11:53:47.082 7905 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:53:47 ctl02 nova-api[7905]: 2017-09-28 11:53:47.082 7905 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:53:47 ctl02 nova-api[7905]: 2017-09-28 11:53:47.082 7905 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:53:47 ctl02 nova-api[7905]: 2017-09-28 11:53:47.082 7905 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:53:47 ctl02 nova-api[7905]: 2017-09-28 11:53:47.082 7905 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:53:47 ctl02 nova-api[7905]: 2017-09-28 11:53:47.082 7905 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:53:47 ctl02 nova-api[7905]: 2017-09-28 11:53:47.082 7905 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:53:47 ctl02 nova-api[7905]: 2017-09-28 11:53:47.082 7905 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:53:47 ctl02 nova-api[7905]: 2017-09-28 11:53:47.082 7905 ERROR nova.wsgi     self.filename))
Sep 28 11:53:47 ctl02 nova-api[7905]: 2017-09-28 11:53:47.082 7905 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:53:47 ctl02 nova-api[7905]: 2017-09-28 11:53:47.082 7905 ERROR nova.wsgi
Sep 28 11:53:47 ctl02 nova-api[7905]: 2017-09-28 11:53:47.084 7905 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:53:47 ctl02 nova-api[7905]: 2017-09-28 11:53:47.217 7905 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:53:47 ctl02 glance-api[29183]: 2017-09-28 11:53:47.326 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:53:47] "OPTIONS / HTTP/1.0" 200 134 0.000639
Sep 28 11:53:47 ctl02 glance-api[29183]: 2017-09-28 11:53:47.463 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:53:47] "OPTIONS / HTTP/1.0" 200 134 0.000998
Sep 28 11:53:47 ctl02 nova-api[7905]: 2017-09-28 11:53:47.465 7905 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:53:47 ctl02 nova-api[7905]: 2017-09-28 11:53:47.467 7905 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:53:47 ctl02 nova-api[7905]: 2017-09-28 11:53:47.468 7905 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:53:47 ctl02 nova-api[7905]: 2017-09-28 11:53:47.468 7905 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:53:47 ctl02 dhclient[600]: DHCPREQUEST of 192.168.11.25 on ens2 to 192.168.11.3 port 67 (xid=0x3415f07)
Sep 28 11:53:47 ctl02 nova-api[7905]: 2017-09-28 11:53:47.607 7905 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:53:47 ctl02 nova-api[7905]: 2017-09-28 11:53:47.609 7905 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:53:47 ctl02 nova-api[7905]: 2017-09-28 11:53:47.609 7905 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:53:47 ctl02 nova-api[7905]: 2017-09-28 11:53:47.609 7905 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:53:47 ctl02 dhclient[600]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 11:53:47 ctl02 nova-api[7905]: 2017-09-28 11:53:47.613 7905 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:53:47 ctl02 nova-api[7905]: 2017-09-28 11:53:47.613 7905 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:53:47 ctl02 nova-api[7905]: 2017-09-28 11:53:47.613 7905 ERROR nova Traceback (most recent call last):
Sep 28 11:53:47 ctl02 nova-api[7905]: 2017-09-28 11:53:47.613 7905 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:53:47 ctl02 nova-api[7905]: 2017-09-28 11:53:47.613 7905 ERROR nova     sys.exit(main())
Sep 28 11:53:47 ctl02 nova-api[7905]: 2017-09-28 11:53:47.613 7905 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:53:47 ctl02 nova-api[7905]: 2017-09-28 11:53:47.613 7905 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:53:47 ctl02 nova-api[7905]: 2017-09-28 11:53:47.613 7905 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:53:47 ctl02 nova-api[7905]: 2017-09-28 11:53:47.613 7905 ERROR nova     max_url_len=max_url_len)
Sep 28 11:53:47 ctl02 nova-api[7905]: 2017-09-28 11:53:47.613 7905 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:53:47 ctl02 nova-api[7905]: 2017-09-28 11:53:47.613 7905 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:53:47 ctl02 nova-api[7905]: 2017-09-28 11:53:47.613 7905 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:53:47 ctl02 nova-api[7905]: 2017-09-28 11:53:47.613 7905 ERROR nova     sock.listen(backlog)
Sep 28 11:53:47 ctl02 nova-api[7905]: 2017-09-28 11:53:47.613 7905 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:53:47 ctl02 nova-api[7905]: 2017-09-28 11:53:47.613 7905 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:53:47 ctl02 nova-api[7905]: 2017-09-28 11:53:47.613 7905 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:53:47 ctl02 nova-api[7905]: 2017-09-28 11:53:47.613 7905 ERROR nova
Sep 28 11:53:47 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 11:53:47 ctl02 ntp[7971]:  * Stopping NTP server ntpd
Sep 28 11:53:47 ctl02 ntp[7971]:    ...done.
Sep 28 11:53:47 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 11:53:47 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 11:53:47 ctl02 ntp[7981]:  * Starting NTP server ntpd
Sep 28 11:53:47 ctl02 ntpd[7989]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 11:53:47 ctl02 ntpd[7989]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -c /var/lib/ntp/ntp.conf.dhcp -u 108:112
Sep 28 11:53:47 ctl02 ntp[7981]:    ...done.
Sep 28 11:53:47 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 11:53:47 ctl02 ntpd[7992]: proto: precision = 0.043 usec (-24)
Sep 28 11:53:47 ctl02 ntpd[7992]: switching logging to file /var/log/ntp.log
Sep 28 11:53:47 ctl02 dhclient[600]: bound to 192.168.11.25 -- renewal in 295 seconds.
Sep 28 11:53:47 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:53:47 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:53:47 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:53:47 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:53:47 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:53:47 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:53:47 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:53:49 ctl02 nova-consoleauth[5433]: 2017-09-28 11:53:49.093 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:53:49 ctl02 nova-api[8005]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:53:49 ctl02 nova-api[8005]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:53:49 ctl02 nova-api[8005]: 2017-09-28 11:53:49.593 8005 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:53:49 ctl02 nova-api[8005]: 2017-09-28 11:53:49.595 8005 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:53:49 ctl02 nova-api[8005]: 2017-09-28 11:53:49.595 8005 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:53:49 ctl02 nova-api[8005]: 2017-09-28 11:53:49.595 8005 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:53:49 ctl02 nova-api[8005]: 2017-09-28 11:53:49.595 8005 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:53:49 ctl02 nova-api[8005]: 2017-09-28 11:53:49.595 8005 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:53:49 ctl02 nova-api[8005]: 2017-09-28 11:53:49.595 8005 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:53:49 ctl02 nova-api[8005]: 2017-09-28 11:53:49.595 8005 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:53:49 ctl02 nova-api[8005]: 2017-09-28 11:53:49.595 8005 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:53:49 ctl02 nova-api[8005]: 2017-09-28 11:53:49.595 8005 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:53:49 ctl02 nova-api[8005]: 2017-09-28 11:53:49.595 8005 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:53:49 ctl02 nova-api[8005]: 2017-09-28 11:53:49.595 8005 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:53:49 ctl02 nova-api[8005]: 2017-09-28 11:53:49.595 8005 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:53:49 ctl02 nova-api[8005]: 2017-09-28 11:53:49.595 8005 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:53:49 ctl02 nova-api[8005]: 2017-09-28 11:53:49.595 8005 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:53:49 ctl02 nova-api[8005]: 2017-09-28 11:53:49.595 8005 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:53:49 ctl02 nova-api[8005]: 2017-09-28 11:53:49.595 8005 ERROR nova.wsgi     self.filename))
Sep 28 11:53:49 ctl02 nova-api[8005]: 2017-09-28 11:53:49.595 8005 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:53:49 ctl02 nova-api[8005]: 2017-09-28 11:53:49.595 8005 ERROR nova.wsgi
Sep 28 11:53:49 ctl02 nova-api[8005]: 2017-09-28 11:53:49.596 8005 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:53:49 ctl02 nova-api[8005]: 2017-09-28 11:53:49.727 8005 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:53:49 ctl02 nova-api[8005]: 2017-09-28 11:53:49.966 8005 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:53:49 ctl02 nova-api[8005]: 2017-09-28 11:53:49.969 8005 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:53:49 ctl02 nova-api[8005]: 2017-09-28 11:53:49.969 8005 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:53:49 ctl02 nova-api[8005]: 2017-09-28 11:53:49.969 8005 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:53:50 ctl02 nova-api[8005]: 2017-09-28 11:53:50.099 8005 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:53:50 ctl02 nova-api[8005]: 2017-09-28 11:53:50.101 8005 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:53:50 ctl02 nova-api[8005]: 2017-09-28 11:53:50.101 8005 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:53:50 ctl02 nova-api[8005]: 2017-09-28 11:53:50.102 8005 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:53:50 ctl02 nova-api[8005]: 2017-09-28 11:53:50.105 8005 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:53:50 ctl02 nova-api[8005]: 2017-09-28 11:53:50.105 8005 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:53:50 ctl02 nova-api[8005]: 2017-09-28 11:53:50.105 8005 ERROR nova Traceback (most recent call last):
Sep 28 11:53:50 ctl02 nova-api[8005]: 2017-09-28 11:53:50.105 8005 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:53:50 ctl02 nova-api[8005]: 2017-09-28 11:53:50.105 8005 ERROR nova     sys.exit(main())
Sep 28 11:53:50 ctl02 nova-api[8005]: 2017-09-28 11:53:50.105 8005 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:53:50 ctl02 nova-api[8005]: 2017-09-28 11:53:50.105 8005 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:53:50 ctl02 nova-api[8005]: 2017-09-28 11:53:50.105 8005 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:53:50 ctl02 nova-api[8005]: 2017-09-28 11:53:50.105 8005 ERROR nova     max_url_len=max_url_len)
Sep 28 11:53:50 ctl02 nova-api[8005]: 2017-09-28 11:53:50.105 8005 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:53:50 ctl02 nova-api[8005]: 2017-09-28 11:53:50.105 8005 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:53:50 ctl02 nova-api[8005]: 2017-09-28 11:53:50.105 8005 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:53:50 ctl02 nova-api[8005]: 2017-09-28 11:53:50.105 8005 ERROR nova     sock.listen(backlog)
Sep 28 11:53:50 ctl02 nova-api[8005]: 2017-09-28 11:53:50.105 8005 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:53:50 ctl02 nova-api[8005]: 2017-09-28 11:53:50.105 8005 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:53:50 ctl02 nova-api[8005]: 2017-09-28 11:53:50.105 8005 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:53:50 ctl02 nova-api[8005]: 2017-09-28 11:53:50.105 8005 ERROR nova
Sep 28 11:53:50 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:53:50 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:53:50 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:53:50 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:53:50 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:53:50 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:53:50 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:53:51 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x52603d5a)
Sep 28 11:53:51 ctl02 nova-api[8023]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:53:51 ctl02 nova-api[8023]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:53:52 ctl02 nova-api[8023]: 2017-09-28 11:53:52.082 8023 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:53:52 ctl02 nova-api[8023]: 2017-09-28 11:53:52.084 8023 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:53:52 ctl02 nova-api[8023]: 2017-09-28 11:53:52.084 8023 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:53:52 ctl02 nova-api[8023]: 2017-09-28 11:53:52.084 8023 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:53:52 ctl02 nova-api[8023]: 2017-09-28 11:53:52.084 8023 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:53:52 ctl02 nova-api[8023]: 2017-09-28 11:53:52.084 8023 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:53:52 ctl02 nova-api[8023]: 2017-09-28 11:53:52.084 8023 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:53:52 ctl02 nova-api[8023]: 2017-09-28 11:53:52.084 8023 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:53:52 ctl02 nova-api[8023]: 2017-09-28 11:53:52.084 8023 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:53:52 ctl02 nova-api[8023]: 2017-09-28 11:53:52.084 8023 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:53:52 ctl02 nova-api[8023]: 2017-09-28 11:53:52.084 8023 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:53:52 ctl02 nova-api[8023]: 2017-09-28 11:53:52.084 8023 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:53:52 ctl02 nova-api[8023]: 2017-09-28 11:53:52.084 8023 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:53:52 ctl02 nova-api[8023]: 2017-09-28 11:53:52.084 8023 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:53:52 ctl02 nova-api[8023]: 2017-09-28 11:53:52.084 8023 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:53:52 ctl02 nova-api[8023]: 2017-09-28 11:53:52.084 8023 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:53:52 ctl02 nova-api[8023]: 2017-09-28 11:53:52.084 8023 ERROR nova.wsgi     self.filename))
Sep 28 11:53:52 ctl02 nova-api[8023]: 2017-09-28 11:53:52.084 8023 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:53:52 ctl02 nova-api[8023]: 2017-09-28 11:53:52.084 8023 ERROR nova.wsgi
Sep 28 11:53:52 ctl02 nova-api[8023]: 2017-09-28 11:53:52.085 8023 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:53:52 ctl02 nova-scheduler[5620]: 2017-09-28 11:53:52.117 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:53:52 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x52603d5a)
Sep 28 11:53:52 ctl02 nova-api[8023]: 2017-09-28 11:53:52.218 8023 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:53:52 ctl02 nova-api[8023]: 2017-09-28 11:53:52.446 8023 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:53:52 ctl02 nova-api[8023]: 2017-09-28 11:53:52.448 8023 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:53:52 ctl02 nova-api[8023]: 2017-09-28 11:53:52.448 8023 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:53:52 ctl02 nova-api[8023]: 2017-09-28 11:53:52.448 8023 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:53:52 ctl02 nova-api[8023]: 2017-09-28 11:53:52.578 8023 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:53:52 ctl02 nova-api[8023]: 2017-09-28 11:53:52.580 8023 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:53:52 ctl02 nova-api[8023]: 2017-09-28 11:53:52.580 8023 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:53:52 ctl02 nova-api[8023]: 2017-09-28 11:53:52.580 8023 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:53:52 ctl02 nova-api[8023]: 2017-09-28 11:53:52.584 8023 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:53:52 ctl02 nova-api[8023]: 2017-09-28 11:53:52.584 8023 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:53:52 ctl02 nova-api[8023]: 2017-09-28 11:53:52.584 8023 ERROR nova Traceback (most recent call last):
Sep 28 11:53:52 ctl02 nova-api[8023]: 2017-09-28 11:53:52.584 8023 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:53:52 ctl02 nova-api[8023]: 2017-09-28 11:53:52.584 8023 ERROR nova     sys.exit(main())
Sep 28 11:53:52 ctl02 nova-api[8023]: 2017-09-28 11:53:52.584 8023 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:53:52 ctl02 nova-api[8023]: 2017-09-28 11:53:52.584 8023 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:53:52 ctl02 nova-api[8023]: 2017-09-28 11:53:52.584 8023 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:53:52 ctl02 nova-api[8023]: 2017-09-28 11:53:52.584 8023 ERROR nova     max_url_len=max_url_len)
Sep 28 11:53:52 ctl02 nova-api[8023]: 2017-09-28 11:53:52.584 8023 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:53:52 ctl02 nova-api[8023]: 2017-09-28 11:53:52.584 8023 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:53:52 ctl02 nova-api[8023]: 2017-09-28 11:53:52.584 8023 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:53:52 ctl02 nova-api[8023]: 2017-09-28 11:53:52.584 8023 ERROR nova     sock.listen(backlog)
Sep 28 11:53:52 ctl02 nova-api[8023]: 2017-09-28 11:53:52.584 8023 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:53:52 ctl02 nova-api[8023]: 2017-09-28 11:53:52.584 8023 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:53:52 ctl02 nova-api[8023]: 2017-09-28 11:53:52.584 8023 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:53:52 ctl02 nova-api[8023]: 2017-09-28 11:53:52.584 8023 ERROR nova
Sep 28 11:53:52 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:53:52 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:53:52 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:53:52 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:53:52 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:53:52 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:53:52 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:53:53 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x52603d5a)
Sep 28 11:53:53 ctl02 glance-api[29183]: 2017-09-28 11:53:53.270 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:53:53] "OPTIONS / HTTP/1.0" 200 134 0.001103
Sep 28 11:53:54 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x52603d5a)
Sep 28 11:53:54 ctl02 nova-api[8041]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:53:54 ctl02 nova-api[8041]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:53:54 ctl02 nova-api[8041]: 2017-09-28 11:53:54.612 8041 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:53:54 ctl02 nova-api[8041]: 2017-09-28 11:53:54.614 8041 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:53:54 ctl02 nova-api[8041]: 2017-09-28 11:53:54.614 8041 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:53:54 ctl02 nova-api[8041]: 2017-09-28 11:53:54.614 8041 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:53:54 ctl02 nova-api[8041]: 2017-09-28 11:53:54.614 8041 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:53:54 ctl02 nova-api[8041]: 2017-09-28 11:53:54.614 8041 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:53:54 ctl02 nova-api[8041]: 2017-09-28 11:53:54.614 8041 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:53:54 ctl02 nova-api[8041]: 2017-09-28 11:53:54.614 8041 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:53:54 ctl02 nova-api[8041]: 2017-09-28 11:53:54.614 8041 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:53:54 ctl02 nova-api[8041]: 2017-09-28 11:53:54.614 8041 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:53:54 ctl02 nova-api[8041]: 2017-09-28 11:53:54.614 8041 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:53:54 ctl02 nova-api[8041]: 2017-09-28 11:53:54.614 8041 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:53:54 ctl02 nova-api[8041]: 2017-09-28 11:53:54.614 8041 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:53:54 ctl02 nova-api[8041]: 2017-09-28 11:53:54.614 8041 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:53:54 ctl02 nova-api[8041]: 2017-09-28 11:53:54.614 8041 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:53:54 ctl02 nova-api[8041]: 2017-09-28 11:53:54.614 8041 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:53:54 ctl02 nova-api[8041]: 2017-09-28 11:53:54.614 8041 ERROR nova.wsgi     self.filename))
Sep 28 11:53:54 ctl02 nova-api[8041]: 2017-09-28 11:53:54.614 8041 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:53:54 ctl02 nova-api[8041]: 2017-09-28 11:53:54.614 8041 ERROR nova.wsgi
Sep 28 11:53:54 ctl02 nova-api[8041]: 2017-09-28 11:53:54.616 8041 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:53:54 ctl02 nova-api[8041]: 2017-09-28 11:53:54.748 8041 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:53:54 ctl02 nova-api[8041]: 2017-09-28 11:53:54.990 8041 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:53:54 ctl02 nova-api[8041]: 2017-09-28 11:53:54.993 8041 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:53:54 ctl02 nova-api[8041]: 2017-09-28 11:53:54.993 8041 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:53:54 ctl02 nova-api[8041]: 2017-09-28 11:53:54.994 8041 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:53:55 ctl02 nova-api[8041]: 2017-09-28 11:53:55.125 8041 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:53:55 ctl02 nova-api[8041]: 2017-09-28 11:53:55.127 8041 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:53:55 ctl02 nova-api[8041]: 2017-09-28 11:53:55.128 8041 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:53:55 ctl02 nova-api[8041]: 2017-09-28 11:53:55.128 8041 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:53:55 ctl02 nova-api[8041]: 2017-09-28 11:53:55.132 8041 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:53:55 ctl02 nova-api[8041]: 2017-09-28 11:53:55.132 8041 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:53:55 ctl02 nova-api[8041]: 2017-09-28 11:53:55.132 8041 ERROR nova Traceback (most recent call last):
Sep 28 11:53:55 ctl02 nova-api[8041]: 2017-09-28 11:53:55.132 8041 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:53:55 ctl02 nova-api[8041]: 2017-09-28 11:53:55.132 8041 ERROR nova     sys.exit(main())
Sep 28 11:53:55 ctl02 nova-api[8041]: 2017-09-28 11:53:55.132 8041 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:53:55 ctl02 nova-api[8041]: 2017-09-28 11:53:55.132 8041 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:53:55 ctl02 nova-api[8041]: 2017-09-28 11:53:55.132 8041 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:53:55 ctl02 nova-api[8041]: 2017-09-28 11:53:55.132 8041 ERROR nova     max_url_len=max_url_len)
Sep 28 11:53:55 ctl02 nova-api[8041]: 2017-09-28 11:53:55.132 8041 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:53:55 ctl02 nova-api[8041]: 2017-09-28 11:53:55.132 8041 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:53:55 ctl02 nova-api[8041]: 2017-09-28 11:53:55.132 8041 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:53:55 ctl02 nova-api[8041]: 2017-09-28 11:53:55.132 8041 ERROR nova     sock.listen(backlog)
Sep 28 11:53:55 ctl02 nova-api[8041]: 2017-09-28 11:53:55.132 8041 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:53:55 ctl02 nova-api[8041]: 2017-09-28 11:53:55.132 8041 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:53:55 ctl02 nova-api[8041]: 2017-09-28 11:53:55.132 8041 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:53:55 ctl02 nova-api[8041]: 2017-09-28 11:53:55.132 8041 ERROR nova
Sep 28 11:53:55 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x52603d5a)
Sep 28 11:53:55 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:53:55 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:53:55 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:53:55 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:53:55 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:53:55 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:53:55 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:53:56 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x52603d5a)
Sep 28 11:53:57 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x52603d5a)
Sep 28 11:53:57 ctl02 nova-api[8059]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:53:57 ctl02 nova-api[8059]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:53:57 ctl02 nova-api[8059]: 2017-09-28 11:53:57.353 8059 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:53:57 ctl02 nova-api[8059]: 2017-09-28 11:53:57.354 8059 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:53:57 ctl02 nova-api[8059]: 2017-09-28 11:53:57.354 8059 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:53:57 ctl02 nova-api[8059]: 2017-09-28 11:53:57.354 8059 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:53:57 ctl02 nova-api[8059]: 2017-09-28 11:53:57.354 8059 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:53:57 ctl02 nova-api[8059]: 2017-09-28 11:53:57.354 8059 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:53:57 ctl02 nova-api[8059]: 2017-09-28 11:53:57.354 8059 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:53:57 ctl02 nova-api[8059]: 2017-09-28 11:53:57.354 8059 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:53:57 ctl02 nova-api[8059]: 2017-09-28 11:53:57.354 8059 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:53:57 ctl02 nova-api[8059]: 2017-09-28 11:53:57.354 8059 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:53:57 ctl02 nova-api[8059]: 2017-09-28 11:53:57.354 8059 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:53:57 ctl02 nova-api[8059]: 2017-09-28 11:53:57.354 8059 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:53:57 ctl02 nova-api[8059]: 2017-09-28 11:53:57.354 8059 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:53:57 ctl02 nova-api[8059]: 2017-09-28 11:53:57.354 8059 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:53:57 ctl02 nova-api[8059]: 2017-09-28 11:53:57.354 8059 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:53:57 ctl02 nova-api[8059]: 2017-09-28 11:53:57.354 8059 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:53:57 ctl02 nova-api[8059]: 2017-09-28 11:53:57.354 8059 ERROR nova.wsgi     self.filename))
Sep 28 11:53:57 ctl02 nova-api[8059]: 2017-09-28 11:53:57.354 8059 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:53:57 ctl02 nova-api[8059]: 2017-09-28 11:53:57.354 8059 ERROR nova.wsgi
Sep 28 11:53:57 ctl02 nova-api[8059]: 2017-09-28 11:53:57.356 8059 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:53:57 ctl02 glance-api[29183]: 2017-09-28 11:53:57.412 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:53:57] "OPTIONS / HTTP/1.0" 200 134 0.000800
Sep 28 11:53:57 ctl02 glance-api[29183]: 2017-09-28 11:53:57.469 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:53:57] "OPTIONS / HTTP/1.0" 200 134 0.000569
Sep 28 11:53:57 ctl02 nova-api[8059]: 2017-09-28 11:53:57.493 8059 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:53:57 ctl02 nova-api[8059]: 2017-09-28 11:53:57.735 8059 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:53:57 ctl02 nova-api[8059]: 2017-09-28 11:53:57.737 8059 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:53:57 ctl02 nova-api[8059]: 2017-09-28 11:53:57.738 8059 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:53:57 ctl02 nova-api[8059]: 2017-09-28 11:53:57.738 8059 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:53:57 ctl02 nova-api[8059]: 2017-09-28 11:53:57.869 8059 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:53:57 ctl02 nova-api[8059]: 2017-09-28 11:53:57.871 8059 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:53:57 ctl02 nova-api[8059]: 2017-09-28 11:53:57.871 8059 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:53:57 ctl02 nova-api[8059]: 2017-09-28 11:53:57.871 8059 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:53:57 ctl02 nova-api[8059]: 2017-09-28 11:53:57.875 8059 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:53:57 ctl02 nova-api[8059]: 2017-09-28 11:53:57.875 8059 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:53:57 ctl02 nova-api[8059]: 2017-09-28 11:53:57.875 8059 ERROR nova Traceback (most recent call last):
Sep 28 11:53:57 ctl02 nova-api[8059]: 2017-09-28 11:53:57.875 8059 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:53:57 ctl02 nova-api[8059]: 2017-09-28 11:53:57.875 8059 ERROR nova     sys.exit(main())
Sep 28 11:53:57 ctl02 nova-api[8059]: 2017-09-28 11:53:57.875 8059 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:53:57 ctl02 nova-api[8059]: 2017-09-28 11:53:57.875 8059 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:53:57 ctl02 nova-api[8059]: 2017-09-28 11:53:57.875 8059 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:53:57 ctl02 nova-api[8059]: 2017-09-28 11:53:57.875 8059 ERROR nova     max_url_len=max_url_len)
Sep 28 11:53:57 ctl02 nova-api[8059]: 2017-09-28 11:53:57.875 8059 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:53:57 ctl02 nova-api[8059]: 2017-09-28 11:53:57.875 8059 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:53:57 ctl02 nova-api[8059]: 2017-09-28 11:53:57.875 8059 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:53:57 ctl02 nova-api[8059]: 2017-09-28 11:53:57.875 8059 ERROR nova     sock.listen(backlog)
Sep 28 11:53:57 ctl02 nova-api[8059]: 2017-09-28 11:53:57.875 8059 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:53:57 ctl02 nova-api[8059]: 2017-09-28 11:53:57.875 8059 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:53:57 ctl02 nova-api[8059]: 2017-09-28 11:53:57.875 8059 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:53:57 ctl02 nova-api[8059]: 2017-09-28 11:53:57.875 8059 ERROR nova
Sep 28 11:53:58 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:53:58 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:53:58 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:53:58 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x52603d5a)
Sep 28 11:53:58 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:53:58 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:53:58 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:53:58 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:53:59 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x52603d5a)
Sep 28 11:53:59 ctl02 nova-api[8076]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:53:59 ctl02 nova-api[8076]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:54:00 ctl02 nova-api[8076]: 2017-09-28 11:54:00.072 8076 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:54:00 ctl02 nova-api[8076]: 2017-09-28 11:54:00.073 8076 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:54:00 ctl02 nova-api[8076]: 2017-09-28 11:54:00.073 8076 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:54:00 ctl02 nova-api[8076]: 2017-09-28 11:54:00.073 8076 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:54:00 ctl02 nova-api[8076]: 2017-09-28 11:54:00.073 8076 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:54:00 ctl02 nova-api[8076]: 2017-09-28 11:54:00.073 8076 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:54:00 ctl02 nova-api[8076]: 2017-09-28 11:54:00.073 8076 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:54:00 ctl02 nova-api[8076]: 2017-09-28 11:54:00.073 8076 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:54:00 ctl02 nova-api[8076]: 2017-09-28 11:54:00.073 8076 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:54:00 ctl02 nova-api[8076]: 2017-09-28 11:54:00.073 8076 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:54:00 ctl02 nova-api[8076]: 2017-09-28 11:54:00.073 8076 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:54:00 ctl02 nova-api[8076]: 2017-09-28 11:54:00.073 8076 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:54:00 ctl02 nova-api[8076]: 2017-09-28 11:54:00.073 8076 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:54:00 ctl02 nova-api[8076]: 2017-09-28 11:54:00.073 8076 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:54:00 ctl02 nova-api[8076]: 2017-09-28 11:54:00.073 8076 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:54:00 ctl02 nova-api[8076]: 2017-09-28 11:54:00.073 8076 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:54:00 ctl02 nova-api[8076]: 2017-09-28 11:54:00.073 8076 ERROR nova.wsgi     self.filename))
Sep 28 11:54:00 ctl02 nova-api[8076]: 2017-09-28 11:54:00.073 8076 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:54:00 ctl02 nova-api[8076]: 2017-09-28 11:54:00.073 8076 ERROR nova.wsgi
Sep 28 11:54:00 ctl02 nova-api[8076]: 2017-09-28 11:54:00.075 8076 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:54:00 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x52603d5a)
Sep 28 11:54:00 ctl02 nova-api[8076]: 2017-09-28 11:54:00.207 8076 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:54:00 ctl02 nova-api[8076]: 2017-09-28 11:54:00.450 8076 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:54:00 ctl02 nova-api[8076]: 2017-09-28 11:54:00.453 8076 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:54:00 ctl02 nova-api[8076]: 2017-09-28 11:54:00.453 8076 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:54:00 ctl02 nova-api[8076]: 2017-09-28 11:54:00.453 8076 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:54:00 ctl02 nova-api[8076]: 2017-09-28 11:54:00.584 8076 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:54:00 ctl02 nova-api[8076]: 2017-09-28 11:54:00.587 8076 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:54:00 ctl02 nova-api[8076]: 2017-09-28 11:54:00.587 8076 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:54:00 ctl02 nova-api[8076]: 2017-09-28 11:54:00.588 8076 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:54:00 ctl02 nova-api[8076]: 2017-09-28 11:54:00.591 8076 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:54:00 ctl02 nova-api[8076]: 2017-09-28 11:54:00.591 8076 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:54:00 ctl02 nova-api[8076]: 2017-09-28 11:54:00.591 8076 ERROR nova Traceback (most recent call last):
Sep 28 11:54:00 ctl02 nova-api[8076]: 2017-09-28 11:54:00.591 8076 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:54:00 ctl02 nova-api[8076]: 2017-09-28 11:54:00.591 8076 ERROR nova     sys.exit(main())
Sep 28 11:54:00 ctl02 nova-api[8076]: 2017-09-28 11:54:00.591 8076 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:54:00 ctl02 nova-api[8076]: 2017-09-28 11:54:00.591 8076 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:54:00 ctl02 nova-api[8076]: 2017-09-28 11:54:00.591 8076 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:54:00 ctl02 nova-api[8076]: 2017-09-28 11:54:00.591 8076 ERROR nova     max_url_len=max_url_len)
Sep 28 11:54:00 ctl02 nova-api[8076]: 2017-09-28 11:54:00.591 8076 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:54:00 ctl02 nova-api[8076]: 2017-09-28 11:54:00.591 8076 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:54:00 ctl02 nova-api[8076]: 2017-09-28 11:54:00.591 8076 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:54:00 ctl02 nova-api[8076]: 2017-09-28 11:54:00.591 8076 ERROR nova     sock.listen(backlog)
Sep 28 11:54:00 ctl02 nova-api[8076]: 2017-09-28 11:54:00.591 8076 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:54:00 ctl02 nova-api[8076]: 2017-09-28 11:54:00.591 8076 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:54:00 ctl02 nova-api[8076]: 2017-09-28 11:54:00.591 8076 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:54:00 ctl02 nova-api[8076]: 2017-09-28 11:54:00.591 8076 ERROR nova
Sep 28 11:54:00 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:54:00 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:54:00 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:54:00 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:54:00 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:54:00 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:54:00 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:54:01 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x52603d5a)
Sep 28 11:54:02 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:54:02 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:54:02 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 11:54:02 ctl02 ntp[8150]:  * Stopping NTP server ntpd
Sep 28 11:54:02 ctl02 ntp[8150]:    ...done.
Sep 28 11:54:02 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 11:54:02 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 11:54:02 ctl02 ntp[8161]:  * Starting NTP server ntpd
Sep 28 11:54:02 ctl02 ntpd[8168]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 11:54:02 ctl02 ntpd[8168]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 11:54:02 ctl02 ntp[8161]:    ...done.
Sep 28 11:54:02 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 11:54:02 ctl02 ntpd[8171]: proto: precision = 0.042 usec (-24)
Sep 28 11:54:02 ctl02 ntpd[8171]: switching logging to file /var/log/ntp.log
Sep 28 11:54:02 ctl02 nova-api[8095]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:54:02 ctl02 nova-api[8095]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:54:02 ctl02 nova-api[8095]: 2017-09-28 11:54:02.608 8095 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:54:02 ctl02 nova-api[8095]: 2017-09-28 11:54:02.610 8095 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:54:02 ctl02 nova-api[8095]: 2017-09-28 11:54:02.610 8095 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:54:02 ctl02 nova-api[8095]: 2017-09-28 11:54:02.610 8095 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:54:02 ctl02 nova-api[8095]: 2017-09-28 11:54:02.610 8095 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:54:02 ctl02 nova-api[8095]: 2017-09-28 11:54:02.610 8095 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:54:02 ctl02 nova-api[8095]: 2017-09-28 11:54:02.610 8095 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:54:02 ctl02 nova-api[8095]: 2017-09-28 11:54:02.610 8095 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:54:02 ctl02 nova-api[8095]: 2017-09-28 11:54:02.610 8095 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:54:02 ctl02 nova-api[8095]: 2017-09-28 11:54:02.610 8095 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:54:02 ctl02 nova-api[8095]: 2017-09-28 11:54:02.610 8095 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:54:02 ctl02 nova-api[8095]: 2017-09-28 11:54:02.610 8095 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:54:02 ctl02 nova-api[8095]: 2017-09-28 11:54:02.610 8095 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:54:02 ctl02 nova-api[8095]: 2017-09-28 11:54:02.610 8095 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:54:02 ctl02 nova-api[8095]: 2017-09-28 11:54:02.610 8095 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:54:02 ctl02 nova-api[8095]: 2017-09-28 11:54:02.610 8095 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:54:02 ctl02 nova-api[8095]: 2017-09-28 11:54:02.610 8095 ERROR nova.wsgi     self.filename))
Sep 28 11:54:02 ctl02 nova-api[8095]: 2017-09-28 11:54:02.610 8095 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:54:02 ctl02 nova-api[8095]: 2017-09-28 11:54:02.610 8095 ERROR nova.wsgi
Sep 28 11:54:02 ctl02 nova-api[8095]: 2017-09-28 11:54:02.611 8095 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:54:02 ctl02 nova-api[8095]: 2017-09-28 11:54:02.740 8095 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:54:02 ctl02 nova-api[8095]: 2017-09-28 11:54:02.976 8095 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:54:02 ctl02 nova-api[8095]: 2017-09-28 11:54:02.978 8095 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:54:02 ctl02 nova-api[8095]: 2017-09-28 11:54:02.988 8095 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:54:02 ctl02 nova-api[8095]: 2017-09-28 11:54:02.988 8095 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:54:03 ctl02 nova-api[8095]: 2017-09-28 11:54:03.127 8095 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:54:03 ctl02 nova-api[8095]: 2017-09-28 11:54:03.129 8095 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:54:03 ctl02 nova-api[8095]: 2017-09-28 11:54:03.129 8095 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:54:03 ctl02 nova-api[8095]: 2017-09-28 11:54:03.129 8095 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:54:03 ctl02 nova-api[8095]: 2017-09-28 11:54:03.132 8095 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:54:03 ctl02 nova-api[8095]: 2017-09-28 11:54:03.133 8095 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:54:03 ctl02 nova-api[8095]: 2017-09-28 11:54:03.133 8095 ERROR nova Traceback (most recent call last):
Sep 28 11:54:03 ctl02 nova-api[8095]: 2017-09-28 11:54:03.133 8095 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:54:03 ctl02 nova-api[8095]: 2017-09-28 11:54:03.133 8095 ERROR nova     sys.exit(main())
Sep 28 11:54:03 ctl02 nova-api[8095]: 2017-09-28 11:54:03.133 8095 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:54:03 ctl02 nova-api[8095]: 2017-09-28 11:54:03.133 8095 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:54:03 ctl02 nova-api[8095]: 2017-09-28 11:54:03.133 8095 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:54:03 ctl02 nova-api[8095]: 2017-09-28 11:54:03.133 8095 ERROR nova     max_url_len=max_url_len)
Sep 28 11:54:03 ctl02 nova-api[8095]: 2017-09-28 11:54:03.133 8095 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:54:03 ctl02 nova-api[8095]: 2017-09-28 11:54:03.133 8095 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:54:03 ctl02 nova-api[8095]: 2017-09-28 11:54:03.133 8095 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:54:03 ctl02 nova-api[8095]: 2017-09-28 11:54:03.133 8095 ERROR nova     sock.listen(backlog)
Sep 28 11:54:03 ctl02 nova-api[8095]: 2017-09-28 11:54:03.133 8095 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:54:03 ctl02 nova-api[8095]: 2017-09-28 11:54:03.133 8095 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:54:03 ctl02 nova-api[8095]: 2017-09-28 11:54:03.133 8095 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:54:03 ctl02 nova-api[8095]: 2017-09-28 11:54:03.133 8095 ERROR nova
Sep 28 11:54:03 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:54:03 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:54:03 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:54:03 ctl02 glance-api[29183]: 2017-09-28 11:54:03.420 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:54:03] "OPTIONS / HTTP/1.0" 200 134 0.000800
Sep 28 11:54:03 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:54:03 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:54:03 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:54:03 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:54:05 ctl02 nova-api[8184]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:54:05 ctl02 nova-api[8184]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:54:05 ctl02 nova-api[8184]: 2017-09-28 11:54:05.368 8184 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:54:05 ctl02 nova-api[8184]: 2017-09-28 11:54:05.370 8184 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:54:05 ctl02 nova-api[8184]: 2017-09-28 11:54:05.370 8184 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:54:05 ctl02 nova-api[8184]: 2017-09-28 11:54:05.370 8184 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:54:05 ctl02 nova-api[8184]: 2017-09-28 11:54:05.370 8184 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:54:05 ctl02 nova-api[8184]: 2017-09-28 11:54:05.370 8184 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:54:05 ctl02 nova-api[8184]: 2017-09-28 11:54:05.370 8184 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:54:05 ctl02 nova-api[8184]: 2017-09-28 11:54:05.370 8184 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:54:05 ctl02 nova-api[8184]: 2017-09-28 11:54:05.370 8184 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:54:05 ctl02 nova-api[8184]: 2017-09-28 11:54:05.370 8184 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:54:05 ctl02 nova-api[8184]: 2017-09-28 11:54:05.370 8184 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:54:05 ctl02 nova-api[8184]: 2017-09-28 11:54:05.370 8184 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:54:05 ctl02 nova-api[8184]: 2017-09-28 11:54:05.370 8184 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:54:05 ctl02 nova-api[8184]: 2017-09-28 11:54:05.370 8184 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:54:05 ctl02 nova-api[8184]: 2017-09-28 11:54:05.370 8184 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:54:05 ctl02 nova-api[8184]: 2017-09-28 11:54:05.370 8184 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:54:05 ctl02 nova-api[8184]: 2017-09-28 11:54:05.370 8184 ERROR nova.wsgi     self.filename))
Sep 28 11:54:05 ctl02 nova-api[8184]: 2017-09-28 11:54:05.370 8184 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:54:05 ctl02 nova-api[8184]: 2017-09-28 11:54:05.370 8184 ERROR nova.wsgi
Sep 28 11:54:05 ctl02 nova-api[8184]: 2017-09-28 11:54:05.371 8184 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:54:05 ctl02 nova-api[8184]: 2017-09-28 11:54:05.504 8184 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:54:05 ctl02 nova-api[8184]: 2017-09-28 11:54:05.738 8184 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:54:05 ctl02 nova-api[8184]: 2017-09-28 11:54:05.740 8184 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:54:05 ctl02 nova-api[8184]: 2017-09-28 11:54:05.740 8184 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:54:05 ctl02 nova-api[8184]: 2017-09-28 11:54:05.741 8184 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:54:05 ctl02 nova-api[8184]: 2017-09-28 11:54:05.871 8184 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:54:05 ctl02 nova-api[8184]: 2017-09-28 11:54:05.873 8184 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:54:05 ctl02 nova-api[8184]: 2017-09-28 11:54:05.873 8184 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:54:05 ctl02 nova-api[8184]: 2017-09-28 11:54:05.874 8184 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:54:05 ctl02 nova-api[8184]: 2017-09-28 11:54:05.877 8184 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:54:05 ctl02 nova-api[8184]: 2017-09-28 11:54:05.877 8184 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:54:05 ctl02 nova-api[8184]: 2017-09-28 11:54:05.877 8184 ERROR nova Traceback (most recent call last):
Sep 28 11:54:05 ctl02 nova-api[8184]: 2017-09-28 11:54:05.877 8184 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:54:05 ctl02 nova-api[8184]: 2017-09-28 11:54:05.877 8184 ERROR nova     sys.exit(main())
Sep 28 11:54:05 ctl02 nova-api[8184]: 2017-09-28 11:54:05.877 8184 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:54:05 ctl02 nova-api[8184]: 2017-09-28 11:54:05.877 8184 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:54:05 ctl02 nova-api[8184]: 2017-09-28 11:54:05.877 8184 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:54:05 ctl02 nova-api[8184]: 2017-09-28 11:54:05.877 8184 ERROR nova     max_url_len=max_url_len)
Sep 28 11:54:05 ctl02 nova-api[8184]: 2017-09-28 11:54:05.877 8184 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:54:05 ctl02 nova-api[8184]: 2017-09-28 11:54:05.877 8184 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:54:05 ctl02 nova-api[8184]: 2017-09-28 11:54:05.877 8184 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:54:05 ctl02 nova-api[8184]: 2017-09-28 11:54:05.877 8184 ERROR nova     sock.listen(backlog)
Sep 28 11:54:05 ctl02 nova-api[8184]: 2017-09-28 11:54:05.877 8184 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:54:05 ctl02 nova-api[8184]: 2017-09-28 11:54:05.877 8184 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:54:05 ctl02 nova-api[8184]: 2017-09-28 11:54:05.877 8184 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:54:05 ctl02 nova-api[8184]: 2017-09-28 11:54:05.877 8184 ERROR nova
Sep 28 11:54:06 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:54:06 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:54:06 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:54:06 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:54:06 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:54:06 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:54:06 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:54:07 ctl02 glance-api[29183]: 2017-09-28 11:54:07.613 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:54:07] "OPTIONS / HTTP/1.0" 200 134 0.000554
Sep 28 11:54:07 ctl02 glance-api[29183]: 2017-09-28 11:54:07.617 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:54:07] "OPTIONS / HTTP/1.0" 200 134 0.000957
Sep 28 11:54:07 ctl02 nova-api[8202]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:54:07 ctl02 nova-api[8202]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:54:07 ctl02 nova-api[8202]: 2017-09-28 11:54:07.863 8202 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:54:07 ctl02 nova-api[8202]: 2017-09-28 11:54:07.864 8202 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:54:07 ctl02 nova-api[8202]: 2017-09-28 11:54:07.864 8202 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:54:07 ctl02 nova-api[8202]: 2017-09-28 11:54:07.864 8202 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:54:07 ctl02 nova-api[8202]: 2017-09-28 11:54:07.864 8202 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:54:07 ctl02 nova-api[8202]: 2017-09-28 11:54:07.864 8202 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:54:07 ctl02 nova-api[8202]: 2017-09-28 11:54:07.864 8202 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:54:07 ctl02 nova-api[8202]: 2017-09-28 11:54:07.864 8202 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:54:07 ctl02 nova-api[8202]: 2017-09-28 11:54:07.864 8202 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:54:07 ctl02 nova-api[8202]: 2017-09-28 11:54:07.864 8202 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:54:07 ctl02 nova-api[8202]: 2017-09-28 11:54:07.864 8202 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:54:07 ctl02 nova-api[8202]: 2017-09-28 11:54:07.864 8202 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:54:07 ctl02 nova-api[8202]: 2017-09-28 11:54:07.864 8202 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:54:07 ctl02 nova-api[8202]: 2017-09-28 11:54:07.864 8202 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:54:07 ctl02 nova-api[8202]: 2017-09-28 11:54:07.864 8202 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:54:07 ctl02 nova-api[8202]: 2017-09-28 11:54:07.864 8202 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:54:07 ctl02 nova-api[8202]: 2017-09-28 11:54:07.864 8202 ERROR nova.wsgi     self.filename))
Sep 28 11:54:07 ctl02 nova-api[8202]: 2017-09-28 11:54:07.864 8202 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:54:07 ctl02 nova-api[8202]: 2017-09-28 11:54:07.864 8202 ERROR nova.wsgi
Sep 28 11:54:07 ctl02 nova-api[8202]: 2017-09-28 11:54:07.867 8202 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:54:07 ctl02 nova-api[8202]: 2017-09-28 11:54:07.999 8202 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:54:08 ctl02 nova-api[8202]: 2017-09-28 11:54:08.243 8202 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:54:08 ctl02 nova-api[8202]: 2017-09-28 11:54:08.246 8202 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:54:08 ctl02 nova-api[8202]: 2017-09-28 11:54:08.247 8202 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:54:08 ctl02 nova-api[8202]: 2017-09-28 11:54:08.247 8202 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:54:08 ctl02 nova-api[8202]: 2017-09-28 11:54:08.379 8202 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:54:08 ctl02 nova-api[8202]: 2017-09-28 11:54:08.381 8202 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:54:08 ctl02 nova-api[8202]: 2017-09-28 11:54:08.382 8202 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:54:08 ctl02 nova-api[8202]: 2017-09-28 11:54:08.382 8202 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:54:08 ctl02 nova-api[8202]: 2017-09-28 11:54:08.385 8202 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:54:08 ctl02 nova-api[8202]: 2017-09-28 11:54:08.386 8202 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:54:08 ctl02 nova-api[8202]: 2017-09-28 11:54:08.386 8202 ERROR nova Traceback (most recent call last):
Sep 28 11:54:08 ctl02 nova-api[8202]: 2017-09-28 11:54:08.386 8202 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:54:08 ctl02 nova-api[8202]: 2017-09-28 11:54:08.386 8202 ERROR nova     sys.exit(main())
Sep 28 11:54:08 ctl02 nova-api[8202]: 2017-09-28 11:54:08.386 8202 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:54:08 ctl02 nova-api[8202]: 2017-09-28 11:54:08.386 8202 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:54:08 ctl02 nova-api[8202]: 2017-09-28 11:54:08.386 8202 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:54:08 ctl02 nova-api[8202]: 2017-09-28 11:54:08.386 8202 ERROR nova     max_url_len=max_url_len)
Sep 28 11:54:08 ctl02 nova-api[8202]: 2017-09-28 11:54:08.386 8202 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:54:08 ctl02 nova-api[8202]: 2017-09-28 11:54:08.386 8202 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:54:08 ctl02 nova-api[8202]: 2017-09-28 11:54:08.386 8202 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:54:08 ctl02 nova-api[8202]: 2017-09-28 11:54:08.386 8202 ERROR nova     sock.listen(backlog)
Sep 28 11:54:08 ctl02 nova-api[8202]: 2017-09-28 11:54:08.386 8202 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:54:08 ctl02 nova-api[8202]: 2017-09-28 11:54:08.386 8202 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:54:08 ctl02 nova-api[8202]: 2017-09-28 11:54:08.386 8202 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:54:08 ctl02 nova-api[8202]: 2017-09-28 11:54:08.386 8202 ERROR nova
Sep 28 11:54:08 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:54:08 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:54:08 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:54:08 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:54:08 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:54:08 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:54:08 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:54:10 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x57b4a931)
Sep 28 11:54:10 ctl02 nova-api[8220]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:54:10 ctl02 nova-api[8220]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:54:10 ctl02 nova-api[8220]: 2017-09-28 11:54:10.640 8220 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:54:10 ctl02 nova-api[8220]: 2017-09-28 11:54:10.641 8220 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:54:10 ctl02 nova-api[8220]: 2017-09-28 11:54:10.641 8220 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:54:10 ctl02 nova-api[8220]: 2017-09-28 11:54:10.641 8220 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:54:10 ctl02 nova-api[8220]: 2017-09-28 11:54:10.641 8220 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:54:10 ctl02 nova-api[8220]: 2017-09-28 11:54:10.641 8220 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:54:10 ctl02 nova-api[8220]: 2017-09-28 11:54:10.641 8220 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:54:10 ctl02 nova-api[8220]: 2017-09-28 11:54:10.641 8220 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:54:10 ctl02 nova-api[8220]: 2017-09-28 11:54:10.641 8220 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:54:10 ctl02 nova-api[8220]: 2017-09-28 11:54:10.641 8220 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:54:10 ctl02 nova-api[8220]: 2017-09-28 11:54:10.641 8220 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:54:10 ctl02 nova-api[8220]: 2017-09-28 11:54:10.641 8220 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:54:10 ctl02 nova-api[8220]: 2017-09-28 11:54:10.641 8220 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:54:10 ctl02 nova-api[8220]: 2017-09-28 11:54:10.641 8220 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:54:10 ctl02 nova-api[8220]: 2017-09-28 11:54:10.641 8220 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:54:10 ctl02 nova-api[8220]: 2017-09-28 11:54:10.641 8220 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:54:10 ctl02 nova-api[8220]: 2017-09-28 11:54:10.641 8220 ERROR nova.wsgi     self.filename))
Sep 28 11:54:10 ctl02 nova-api[8220]: 2017-09-28 11:54:10.641 8220 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:54:10 ctl02 nova-api[8220]: 2017-09-28 11:54:10.641 8220 ERROR nova.wsgi
Sep 28 11:54:10 ctl02 nova-api[8220]: 2017-09-28 11:54:10.642 8220 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:54:10 ctl02 nova-api[8220]: 2017-09-28 11:54:10.778 8220 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:54:11 ctl02 nova-api[8220]: 2017-09-28 11:54:11.027 8220 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:54:11 ctl02 nova-api[8220]: 2017-09-28 11:54:11.029 8220 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:54:11 ctl02 nova-api[8220]: 2017-09-28 11:54:11.029 8220 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:54:11 ctl02 nova-api[8220]: 2017-09-28 11:54:11.029 8220 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:54:11 ctl02 nova-api[8220]: 2017-09-28 11:54:11.165 8220 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:54:11 ctl02 nova-api[8220]: 2017-09-28 11:54:11.167 8220 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:54:11 ctl02 nova-api[8220]: 2017-09-28 11:54:11.168 8220 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:54:11 ctl02 nova-api[8220]: 2017-09-28 11:54:11.168 8220 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:54:11 ctl02 nova-api[8220]: 2017-09-28 11:54:11.171 8220 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:54:11 ctl02 nova-api[8220]: 2017-09-28 11:54:11.172 8220 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:54:11 ctl02 nova-api[8220]: 2017-09-28 11:54:11.172 8220 ERROR nova Traceback (most recent call last):
Sep 28 11:54:11 ctl02 nova-api[8220]: 2017-09-28 11:54:11.172 8220 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:54:11 ctl02 nova-api[8220]: 2017-09-28 11:54:11.172 8220 ERROR nova     sys.exit(main())
Sep 28 11:54:11 ctl02 nova-api[8220]: 2017-09-28 11:54:11.172 8220 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:54:11 ctl02 nova-api[8220]: 2017-09-28 11:54:11.172 8220 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:54:11 ctl02 nova-api[8220]: 2017-09-28 11:54:11.172 8220 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:54:11 ctl02 nova-api[8220]: 2017-09-28 11:54:11.172 8220 ERROR nova     max_url_len=max_url_len)
Sep 28 11:54:11 ctl02 nova-api[8220]: 2017-09-28 11:54:11.172 8220 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:54:11 ctl02 nova-api[8220]: 2017-09-28 11:54:11.172 8220 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:54:11 ctl02 nova-api[8220]: 2017-09-28 11:54:11.172 8220 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:54:11 ctl02 nova-api[8220]: 2017-09-28 11:54:11.172 8220 ERROR nova     sock.listen(backlog)
Sep 28 11:54:11 ctl02 nova-api[8220]: 2017-09-28 11:54:11.172 8220 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:54:11 ctl02 nova-api[8220]: 2017-09-28 11:54:11.172 8220 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:54:11 ctl02 nova-api[8220]: 2017-09-28 11:54:11.172 8220 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:54:11 ctl02 nova-api[8220]: 2017-09-28 11:54:11.172 8220 ERROR nova
Sep 28 11:54:11 ctl02 nova-cert[4860]: 2017-09-28 11:54:11.230 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:54:11 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:54:11 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:54:11 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:54:11 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x57b4a931)
Sep 28 11:54:11 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:54:11 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:54:11 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:54:11 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:54:12 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x57b4a931)
Sep 28 11:54:13 ctl02 nova-api[8238]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:54:13 ctl02 nova-api[8238]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:54:13 ctl02 nova-api[8238]: 2017-09-28 11:54:13.307 8238 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:54:13 ctl02 nova-api[8238]: 2017-09-28 11:54:13.309 8238 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:54:13 ctl02 nova-api[8238]: 2017-09-28 11:54:13.309 8238 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:54:13 ctl02 nova-api[8238]: 2017-09-28 11:54:13.309 8238 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:54:13 ctl02 nova-api[8238]: 2017-09-28 11:54:13.309 8238 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:54:13 ctl02 nova-api[8238]: 2017-09-28 11:54:13.309 8238 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:54:13 ctl02 nova-api[8238]: 2017-09-28 11:54:13.309 8238 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:54:13 ctl02 nova-api[8238]: 2017-09-28 11:54:13.309 8238 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:54:13 ctl02 nova-api[8238]: 2017-09-28 11:54:13.309 8238 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:54:13 ctl02 nova-api[8238]: 2017-09-28 11:54:13.309 8238 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:54:13 ctl02 nova-api[8238]: 2017-09-28 11:54:13.309 8238 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:54:13 ctl02 nova-api[8238]: 2017-09-28 11:54:13.309 8238 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:54:13 ctl02 nova-api[8238]: 2017-09-28 11:54:13.309 8238 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:54:13 ctl02 nova-api[8238]: 2017-09-28 11:54:13.309 8238 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:54:13 ctl02 nova-api[8238]: 2017-09-28 11:54:13.309 8238 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:54:13 ctl02 nova-api[8238]: 2017-09-28 11:54:13.309 8238 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:54:13 ctl02 nova-api[8238]: 2017-09-28 11:54:13.309 8238 ERROR nova.wsgi     self.filename))
Sep 28 11:54:13 ctl02 nova-api[8238]: 2017-09-28 11:54:13.309 8238 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:54:13 ctl02 nova-api[8238]: 2017-09-28 11:54:13.309 8238 ERROR nova.wsgi
Sep 28 11:54:13 ctl02 nova-api[8238]: 2017-09-28 11:54:13.310 8238 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:54:13 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x57b4a931)
Sep 28 11:54:13 ctl02 nova-api[8238]: 2017-09-28 11:54:13.442 8238 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:54:13 ctl02 glance-api[29183]: 2017-09-28 11:54:13.531 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:54:13] "OPTIONS / HTTP/1.0" 200 134 0.000604
Sep 28 11:54:13 ctl02 nova-api[8238]: 2017-09-28 11:54:13.687 8238 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:54:13 ctl02 nova-api[8238]: 2017-09-28 11:54:13.689 8238 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:54:13 ctl02 nova-api[8238]: 2017-09-28 11:54:13.689 8238 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:54:13 ctl02 nova-api[8238]: 2017-09-28 11:54:13.689 8238 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:54:13 ctl02 nova-api[8238]: 2017-09-28 11:54:13.820 8238 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:54:13 ctl02 nova-api[8238]: 2017-09-28 11:54:13.822 8238 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:54:13 ctl02 nova-api[8238]: 2017-09-28 11:54:13.822 8238 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:54:13 ctl02 nova-api[8238]: 2017-09-28 11:54:13.822 8238 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:54:13 ctl02 nova-api[8238]: 2017-09-28 11:54:13.825 8238 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:54:13 ctl02 nova-api[8238]: 2017-09-28 11:54:13.826 8238 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:54:13 ctl02 nova-api[8238]: 2017-09-28 11:54:13.826 8238 ERROR nova Traceback (most recent call last):
Sep 28 11:54:13 ctl02 nova-api[8238]: 2017-09-28 11:54:13.826 8238 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:54:13 ctl02 nova-api[8238]: 2017-09-28 11:54:13.826 8238 ERROR nova     sys.exit(main())
Sep 28 11:54:13 ctl02 nova-api[8238]: 2017-09-28 11:54:13.826 8238 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:54:13 ctl02 nova-api[8238]: 2017-09-28 11:54:13.826 8238 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:54:13 ctl02 nova-api[8238]: 2017-09-28 11:54:13.826 8238 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:54:13 ctl02 nova-api[8238]: 2017-09-28 11:54:13.826 8238 ERROR nova     max_url_len=max_url_len)
Sep 28 11:54:13 ctl02 nova-api[8238]: 2017-09-28 11:54:13.826 8238 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:54:13 ctl02 nova-api[8238]: 2017-09-28 11:54:13.826 8238 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:54:13 ctl02 nova-api[8238]: 2017-09-28 11:54:13.826 8238 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:54:13 ctl02 nova-api[8238]: 2017-09-28 11:54:13.826 8238 ERROR nova     sock.listen(backlog)
Sep 28 11:54:13 ctl02 nova-api[8238]: 2017-09-28 11:54:13.826 8238 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:54:13 ctl02 nova-api[8238]: 2017-09-28 11:54:13.826 8238 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:54:13 ctl02 nova-api[8238]: 2017-09-28 11:54:13.826 8238 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:54:13 ctl02 nova-api[8238]: 2017-09-28 11:54:13.826 8238 ERROR nova
Sep 28 11:54:13 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:54:13 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:54:13 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:54:14 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:54:14 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:54:14 ctl02 nova-conductor[5056]: 2017-09-28 11:54:14.128 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:54:14 ctl02 nova-conductor[5056]: 2017-09-28 11:54:14.143 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:54:14 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:54:14 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:54:14 ctl02 nova-conductor[5056]: 2017-09-28 11:54:14.159 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:54:14 ctl02 nova-conductor[5056]: 2017-09-28 11:54:14.162 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:54:14 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x57b4a931)
Sep 28 11:54:15 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x57b4a931)
Sep 28 11:54:15 ctl02 nova-api[8255]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:54:15 ctl02 nova-api[8255]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:54:15 ctl02 nova-api[8255]: 2017-09-28 11:54:15.814 8255 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:54:15 ctl02 nova-api[8255]: 2017-09-28 11:54:15.816 8255 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:54:15 ctl02 nova-api[8255]: 2017-09-28 11:54:15.816 8255 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:54:15 ctl02 nova-api[8255]: 2017-09-28 11:54:15.816 8255 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:54:15 ctl02 nova-api[8255]: 2017-09-28 11:54:15.816 8255 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:54:15 ctl02 nova-api[8255]: 2017-09-28 11:54:15.816 8255 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:54:15 ctl02 nova-api[8255]: 2017-09-28 11:54:15.816 8255 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:54:15 ctl02 nova-api[8255]: 2017-09-28 11:54:15.816 8255 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:54:15 ctl02 nova-api[8255]: 2017-09-28 11:54:15.816 8255 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:54:15 ctl02 nova-api[8255]: 2017-09-28 11:54:15.816 8255 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:54:15 ctl02 nova-api[8255]: 2017-09-28 11:54:15.816 8255 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:54:15 ctl02 nova-api[8255]: 2017-09-28 11:54:15.816 8255 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:54:15 ctl02 nova-api[8255]: 2017-09-28 11:54:15.816 8255 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:54:15 ctl02 nova-api[8255]: 2017-09-28 11:54:15.816 8255 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:54:15 ctl02 nova-api[8255]: 2017-09-28 11:54:15.816 8255 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:54:15 ctl02 nova-api[8255]: 2017-09-28 11:54:15.816 8255 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:54:15 ctl02 nova-api[8255]: 2017-09-28 11:54:15.816 8255 ERROR nova.wsgi     self.filename))
Sep 28 11:54:15 ctl02 nova-api[8255]: 2017-09-28 11:54:15.816 8255 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:54:15 ctl02 nova-api[8255]: 2017-09-28 11:54:15.816 8255 ERROR nova.wsgi
Sep 28 11:54:15 ctl02 nova-api[8255]: 2017-09-28 11:54:15.817 8255 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:54:15 ctl02 nova-api[8255]: 2017-09-28 11:54:15.948 8255 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:54:16 ctl02 nova-api[8255]: 2017-09-28 11:54:16.189 8255 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:54:16 ctl02 nova-api[8255]: 2017-09-28 11:54:16.192 8255 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:54:16 ctl02 nova-api[8255]: 2017-09-28 11:54:16.192 8255 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:54:16 ctl02 nova-api[8255]: 2017-09-28 11:54:16.192 8255 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:54:16 ctl02 nova-api[8255]: 2017-09-28 11:54:16.322 8255 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:54:16 ctl02 nova-api[8255]: 2017-09-28 11:54:16.324 8255 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:54:16 ctl02 nova-api[8255]: 2017-09-28 11:54:16.324 8255 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:54:16 ctl02 nova-api[8255]: 2017-09-28 11:54:16.324 8255 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:54:16 ctl02 nova-api[8255]: 2017-09-28 11:54:16.328 8255 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:54:16 ctl02 nova-api[8255]: 2017-09-28 11:54:16.328 8255 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:54:16 ctl02 nova-api[8255]: 2017-09-28 11:54:16.328 8255 ERROR nova Traceback (most recent call last):
Sep 28 11:54:16 ctl02 nova-api[8255]: 2017-09-28 11:54:16.328 8255 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:54:16 ctl02 nova-api[8255]: 2017-09-28 11:54:16.328 8255 ERROR nova     sys.exit(main())
Sep 28 11:54:16 ctl02 nova-api[8255]: 2017-09-28 11:54:16.328 8255 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:54:16 ctl02 nova-api[8255]: 2017-09-28 11:54:16.328 8255 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:54:16 ctl02 nova-api[8255]: 2017-09-28 11:54:16.328 8255 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:54:16 ctl02 nova-api[8255]: 2017-09-28 11:54:16.328 8255 ERROR nova     max_url_len=max_url_len)
Sep 28 11:54:16 ctl02 nova-api[8255]: 2017-09-28 11:54:16.328 8255 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:54:16 ctl02 nova-api[8255]: 2017-09-28 11:54:16.328 8255 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:54:16 ctl02 nova-api[8255]: 2017-09-28 11:54:16.328 8255 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:54:16 ctl02 nova-api[8255]: 2017-09-28 11:54:16.328 8255 ERROR nova     sock.listen(backlog)
Sep 28 11:54:16 ctl02 nova-api[8255]: 2017-09-28 11:54:16.328 8255 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:54:16 ctl02 nova-api[8255]: 2017-09-28 11:54:16.328 8255 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:54:16 ctl02 nova-api[8255]: 2017-09-28 11:54:16.328 8255 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:54:16 ctl02 nova-api[8255]: 2017-09-28 11:54:16.328 8255 ERROR nova
Sep 28 11:54:16 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x57b4a931)
Sep 28 11:54:16 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:54:16 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:54:16 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:54:16 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:54:16 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:54:16 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:54:16 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:54:17 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x57b4a931)
Sep 28 11:54:17 ctl02 glance-api[29183]: 2017-09-28 11:54:17.801 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:54:17] "OPTIONS / HTTP/1.0" 200 134 0.000810
Sep 28 11:54:17 ctl02 glance-api[29183]: 2017-09-28 11:54:17.851 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:54:17] "OPTIONS / HTTP/1.0" 200 134 0.000745
Sep 28 11:54:18 ctl02 nova-api[8275]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:54:18 ctl02 nova-api[8275]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:54:18 ctl02 nova-api[8275]: 2017-09-28 11:54:18.324 8275 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:54:18 ctl02 nova-api[8275]: 2017-09-28 11:54:18.326 8275 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:54:18 ctl02 nova-api[8275]: 2017-09-28 11:54:18.326 8275 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:54:18 ctl02 nova-api[8275]: 2017-09-28 11:54:18.326 8275 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:54:18 ctl02 nova-api[8275]: 2017-09-28 11:54:18.326 8275 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:54:18 ctl02 nova-api[8275]: 2017-09-28 11:54:18.326 8275 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:54:18 ctl02 nova-api[8275]: 2017-09-28 11:54:18.326 8275 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:54:18 ctl02 nova-api[8275]: 2017-09-28 11:54:18.326 8275 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:54:18 ctl02 nova-api[8275]: 2017-09-28 11:54:18.326 8275 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:54:18 ctl02 nova-api[8275]: 2017-09-28 11:54:18.326 8275 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:54:18 ctl02 nova-api[8275]: 2017-09-28 11:54:18.326 8275 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:54:18 ctl02 nova-api[8275]: 2017-09-28 11:54:18.326 8275 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:54:18 ctl02 nova-api[8275]: 2017-09-28 11:54:18.326 8275 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:54:18 ctl02 nova-api[8275]: 2017-09-28 11:54:18.326 8275 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:54:18 ctl02 nova-api[8275]: 2017-09-28 11:54:18.326 8275 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:54:18 ctl02 nova-api[8275]: 2017-09-28 11:54:18.326 8275 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:54:18 ctl02 nova-api[8275]: 2017-09-28 11:54:18.326 8275 ERROR nova.wsgi     self.filename))
Sep 28 11:54:18 ctl02 nova-api[8275]: 2017-09-28 11:54:18.326 8275 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:54:18 ctl02 nova-api[8275]: 2017-09-28 11:54:18.326 8275 ERROR nova.wsgi
Sep 28 11:54:18 ctl02 nova-api[8275]: 2017-09-28 11:54:18.327 8275 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:54:18 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x57b4a931)
Sep 28 11:54:18 ctl02 nova-api[8275]: 2017-09-28 11:54:18.457 8275 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:54:18 ctl02 nova-api[8275]: 2017-09-28 11:54:18.689 8275 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:54:18 ctl02 nova-api[8275]: 2017-09-28 11:54:18.691 8275 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:54:18 ctl02 nova-api[8275]: 2017-09-28 11:54:18.691 8275 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:54:18 ctl02 nova-api[8275]: 2017-09-28 11:54:18.692 8275 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:54:18 ctl02 nova-api[8275]: 2017-09-28 11:54:18.821 8275 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:54:18 ctl02 nova-api[8275]: 2017-09-28 11:54:18.822 8275 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:54:18 ctl02 nova-api[8275]: 2017-09-28 11:54:18.822 8275 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:54:18 ctl02 nova-api[8275]: 2017-09-28 11:54:18.823 8275 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:54:18 ctl02 nova-api[8275]: 2017-09-28 11:54:18.826 8275 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:54:18 ctl02 nova-api[8275]: 2017-09-28 11:54:18.826 8275 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:54:18 ctl02 nova-api[8275]: 2017-09-28 11:54:18.826 8275 ERROR nova Traceback (most recent call last):
Sep 28 11:54:18 ctl02 nova-api[8275]: 2017-09-28 11:54:18.826 8275 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:54:18 ctl02 nova-api[8275]: 2017-09-28 11:54:18.826 8275 ERROR nova     sys.exit(main())
Sep 28 11:54:18 ctl02 nova-api[8275]: 2017-09-28 11:54:18.826 8275 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:54:18 ctl02 nova-api[8275]: 2017-09-28 11:54:18.826 8275 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:54:18 ctl02 nova-api[8275]: 2017-09-28 11:54:18.826 8275 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:54:18 ctl02 nova-api[8275]: 2017-09-28 11:54:18.826 8275 ERROR nova     max_url_len=max_url_len)
Sep 28 11:54:18 ctl02 nova-api[8275]: 2017-09-28 11:54:18.826 8275 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:54:18 ctl02 nova-api[8275]: 2017-09-28 11:54:18.826 8275 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:54:18 ctl02 nova-api[8275]: 2017-09-28 11:54:18.826 8275 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:54:18 ctl02 nova-api[8275]: 2017-09-28 11:54:18.826 8275 ERROR nova     sock.listen(backlog)
Sep 28 11:54:18 ctl02 nova-api[8275]: 2017-09-28 11:54:18.826 8275 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:54:18 ctl02 nova-api[8275]: 2017-09-28 11:54:18.826 8275 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:54:18 ctl02 nova-api[8275]: 2017-09-28 11:54:18.826 8275 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:54:18 ctl02 nova-api[8275]: 2017-09-28 11:54:18.826 8275 ERROR nova
Sep 28 11:54:18 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:54:18 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:54:18 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:54:19 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:54:19 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:54:19 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:54:19 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:54:19 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x57b4a931)
Sep 28 11:54:20 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x57b4a931)
Sep 28 11:54:20 ctl02 nova-api[8293]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:54:20 ctl02 nova-api[8293]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:54:20 ctl02 nova-api[8293]: 2017-09-28 11:54:20.870 8293 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:54:20 ctl02 nova-api[8293]: 2017-09-28 11:54:20.872 8293 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:54:20 ctl02 nova-api[8293]: 2017-09-28 11:54:20.872 8293 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:54:20 ctl02 nova-api[8293]: 2017-09-28 11:54:20.872 8293 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:54:20 ctl02 nova-api[8293]: 2017-09-28 11:54:20.872 8293 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:54:20 ctl02 nova-api[8293]: 2017-09-28 11:54:20.872 8293 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:54:20 ctl02 nova-api[8293]: 2017-09-28 11:54:20.872 8293 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:54:20 ctl02 nova-api[8293]: 2017-09-28 11:54:20.872 8293 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:54:20 ctl02 nova-api[8293]: 2017-09-28 11:54:20.872 8293 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:54:20 ctl02 nova-api[8293]: 2017-09-28 11:54:20.872 8293 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:54:20 ctl02 nova-api[8293]: 2017-09-28 11:54:20.872 8293 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:54:20 ctl02 nova-api[8293]: 2017-09-28 11:54:20.872 8293 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:54:20 ctl02 nova-api[8293]: 2017-09-28 11:54:20.872 8293 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:54:20 ctl02 nova-api[8293]: 2017-09-28 11:54:20.872 8293 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:54:20 ctl02 nova-api[8293]: 2017-09-28 11:54:20.872 8293 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:54:20 ctl02 nova-api[8293]: 2017-09-28 11:54:20.872 8293 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:54:20 ctl02 nova-api[8293]: 2017-09-28 11:54:20.872 8293 ERROR nova.wsgi     self.filename))
Sep 28 11:54:20 ctl02 nova-api[8293]: 2017-09-28 11:54:20.872 8293 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:54:20 ctl02 nova-api[8293]: 2017-09-28 11:54:20.872 8293 ERROR nova.wsgi
Sep 28 11:54:20 ctl02 nova-api[8293]: 2017-09-28 11:54:20.873 8293 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:54:21 ctl02 nova-api[8293]: 2017-09-28 11:54:21.005 8293 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:54:21 ctl02 nova-consoleauth[5433]: 2017-09-28 11:54:21.129 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:54:21 ctl02 nova-api[8293]: 2017-09-28 11:54:21.245 8293 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:54:21 ctl02 nova-api[8293]: 2017-09-28 11:54:21.247 8293 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:54:21 ctl02 nova-api[8293]: 2017-09-28 11:54:21.247 8293 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:54:21 ctl02 nova-api[8293]: 2017-09-28 11:54:21.248 8293 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:54:21 ctl02 nova-api[8293]: 2017-09-28 11:54:21.379 8293 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:54:21 ctl02 nova-api[8293]: 2017-09-28 11:54:21.381 8293 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:54:21 ctl02 nova-api[8293]: 2017-09-28 11:54:21.382 8293 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:54:21 ctl02 nova-api[8293]: 2017-09-28 11:54:21.382 8293 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:54:21 ctl02 nova-api[8293]: 2017-09-28 11:54:21.385 8293 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:54:21 ctl02 nova-api[8293]: 2017-09-28 11:54:21.386 8293 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:54:21 ctl02 nova-api[8293]: 2017-09-28 11:54:21.386 8293 ERROR nova Traceback (most recent call last):
Sep 28 11:54:21 ctl02 nova-api[8293]: 2017-09-28 11:54:21.386 8293 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:54:21 ctl02 nova-api[8293]: 2017-09-28 11:54:21.386 8293 ERROR nova     sys.exit(main())
Sep 28 11:54:21 ctl02 nova-api[8293]: 2017-09-28 11:54:21.386 8293 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:54:21 ctl02 nova-api[8293]: 2017-09-28 11:54:21.386 8293 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:54:21 ctl02 nova-api[8293]: 2017-09-28 11:54:21.386 8293 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:54:21 ctl02 nova-api[8293]: 2017-09-28 11:54:21.386 8293 ERROR nova     max_url_len=max_url_len)
Sep 28 11:54:21 ctl02 nova-api[8293]: 2017-09-28 11:54:21.386 8293 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:54:21 ctl02 nova-api[8293]: 2017-09-28 11:54:21.386 8293 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:54:21 ctl02 nova-api[8293]: 2017-09-28 11:54:21.386 8293 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:54:21 ctl02 nova-api[8293]: 2017-09-28 11:54:21.386 8293 ERROR nova     sock.listen(backlog)
Sep 28 11:54:21 ctl02 nova-api[8293]: 2017-09-28 11:54:21.386 8293 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:54:21 ctl02 nova-api[8293]: 2017-09-28 11:54:21.386 8293 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:54:21 ctl02 nova-api[8293]: 2017-09-28 11:54:21.386 8293 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:54:21 ctl02 nova-api[8293]: 2017-09-28 11:54:21.386 8293 ERROR nova
Sep 28 11:54:21 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:54:21 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:54:21 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:54:21 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:54:21 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:54:21 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:54:21 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:54:21 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:54:21 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:54:23 ctl02 nova-api[8317]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:54:23 ctl02 nova-api[8317]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:54:23 ctl02 nova-api[8317]: 2017-09-28 11:54:23.619 8317 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:54:23 ctl02 nova-api[8317]: 2017-09-28 11:54:23.620 8317 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:54:23 ctl02 nova-api[8317]: 2017-09-28 11:54:23.620 8317 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:54:23 ctl02 nova-api[8317]: 2017-09-28 11:54:23.620 8317 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:54:23 ctl02 nova-api[8317]: 2017-09-28 11:54:23.620 8317 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:54:23 ctl02 nova-api[8317]: 2017-09-28 11:54:23.620 8317 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:54:23 ctl02 nova-api[8317]: 2017-09-28 11:54:23.620 8317 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:54:23 ctl02 nova-api[8317]: 2017-09-28 11:54:23.620 8317 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:54:23 ctl02 nova-api[8317]: 2017-09-28 11:54:23.620 8317 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:54:23 ctl02 nova-api[8317]: 2017-09-28 11:54:23.620 8317 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:54:23 ctl02 nova-api[8317]: 2017-09-28 11:54:23.620 8317 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:54:23 ctl02 nova-api[8317]: 2017-09-28 11:54:23.620 8317 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:54:23 ctl02 nova-api[8317]: 2017-09-28 11:54:23.620 8317 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:54:23 ctl02 nova-api[8317]: 2017-09-28 11:54:23.620 8317 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:54:23 ctl02 nova-api[8317]: 2017-09-28 11:54:23.620 8317 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:54:23 ctl02 nova-api[8317]: 2017-09-28 11:54:23.620 8317 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:54:23 ctl02 nova-api[8317]: 2017-09-28 11:54:23.620 8317 ERROR nova.wsgi     self.filename))
Sep 28 11:54:23 ctl02 nova-api[8317]: 2017-09-28 11:54:23.620 8317 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:54:23 ctl02 nova-api[8317]: 2017-09-28 11:54:23.620 8317 ERROR nova.wsgi
Sep 28 11:54:23 ctl02 nova-api[8317]: 2017-09-28 11:54:23.622 8317 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:54:23 ctl02 nova-api[8317]: 2017-09-28 11:54:23.755 8317 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:54:23 ctl02 glance-api[29183]: 2017-09-28 11:54:23.844 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:54:23] "OPTIONS / HTTP/1.0" 200 134 0.000683
Sep 28 11:54:23 ctl02 nova-api[8317]: 2017-09-28 11:54:23.998 8317 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:54:24 ctl02 nova-api[8317]: 2017-09-28 11:54:24.001 8317 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:54:24 ctl02 nova-api[8317]: 2017-09-28 11:54:24.001 8317 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:54:24 ctl02 nova-api[8317]: 2017-09-28 11:54:24.002 8317 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:54:24 ctl02 nova-api[8317]: 2017-09-28 11:54:24.134 8317 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:54:24 ctl02 nova-api[8317]: 2017-09-28 11:54:24.136 8317 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:54:24 ctl02 nova-api[8317]: 2017-09-28 11:54:24.137 8317 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:54:24 ctl02 nova-api[8317]: 2017-09-28 11:54:24.137 8317 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:54:24 ctl02 nova-api[8317]: 2017-09-28 11:54:24.141 8317 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:54:24 ctl02 nova-api[8317]: 2017-09-28 11:54:24.141 8317 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:54:24 ctl02 nova-api[8317]: 2017-09-28 11:54:24.141 8317 ERROR nova Traceback (most recent call last):
Sep 28 11:54:24 ctl02 nova-api[8317]: 2017-09-28 11:54:24.141 8317 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:54:24 ctl02 nova-api[8317]: 2017-09-28 11:54:24.141 8317 ERROR nova     sys.exit(main())
Sep 28 11:54:24 ctl02 nova-api[8317]: 2017-09-28 11:54:24.141 8317 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:54:24 ctl02 nova-api[8317]: 2017-09-28 11:54:24.141 8317 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:54:24 ctl02 nova-api[8317]: 2017-09-28 11:54:24.141 8317 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:54:24 ctl02 nova-api[8317]: 2017-09-28 11:54:24.141 8317 ERROR nova     max_url_len=max_url_len)
Sep 28 11:54:24 ctl02 nova-api[8317]: 2017-09-28 11:54:24.141 8317 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:54:24 ctl02 nova-api[8317]: 2017-09-28 11:54:24.141 8317 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:54:24 ctl02 nova-api[8317]: 2017-09-28 11:54:24.141 8317 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:54:24 ctl02 nova-api[8317]: 2017-09-28 11:54:24.141 8317 ERROR nova     sock.listen(backlog)
Sep 28 11:54:24 ctl02 nova-api[8317]: 2017-09-28 11:54:24.141 8317 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:54:24 ctl02 nova-api[8317]: 2017-09-28 11:54:24.141 8317 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:54:24 ctl02 nova-api[8317]: 2017-09-28 11:54:24.141 8317 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:54:24 ctl02 nova-api[8317]: 2017-09-28 11:54:24.141 8317 ERROR nova
Sep 28 11:54:24 ctl02 nova-scheduler[5620]: 2017-09-28 11:54:24.152 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:54:24 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:54:24 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:54:24 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:54:24 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:54:24 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:54:24 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:54:24 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:54:26 ctl02 nova-api[8335]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:54:26 ctl02 nova-api[8335]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:54:26 ctl02 nova-api[8335]: 2017-09-28 11:54:26.356 8335 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:54:26 ctl02 nova-api[8335]: 2017-09-28 11:54:26.358 8335 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:54:26 ctl02 nova-api[8335]: 2017-09-28 11:54:26.358 8335 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:54:26 ctl02 nova-api[8335]: 2017-09-28 11:54:26.358 8335 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:54:26 ctl02 nova-api[8335]: 2017-09-28 11:54:26.358 8335 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:54:26 ctl02 nova-api[8335]: 2017-09-28 11:54:26.358 8335 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:54:26 ctl02 nova-api[8335]: 2017-09-28 11:54:26.358 8335 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:54:26 ctl02 nova-api[8335]: 2017-09-28 11:54:26.358 8335 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:54:26 ctl02 nova-api[8335]: 2017-09-28 11:54:26.358 8335 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:54:26 ctl02 nova-api[8335]: 2017-09-28 11:54:26.358 8335 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:54:26 ctl02 nova-api[8335]: 2017-09-28 11:54:26.358 8335 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:54:26 ctl02 nova-api[8335]: 2017-09-28 11:54:26.358 8335 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:54:26 ctl02 nova-api[8335]: 2017-09-28 11:54:26.358 8335 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:54:26 ctl02 nova-api[8335]: 2017-09-28 11:54:26.358 8335 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:54:26 ctl02 nova-api[8335]: 2017-09-28 11:54:26.358 8335 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:54:26 ctl02 nova-api[8335]: 2017-09-28 11:54:26.358 8335 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:54:26 ctl02 nova-api[8335]: 2017-09-28 11:54:26.358 8335 ERROR nova.wsgi     self.filename))
Sep 28 11:54:26 ctl02 nova-api[8335]: 2017-09-28 11:54:26.358 8335 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:54:26 ctl02 nova-api[8335]: 2017-09-28 11:54:26.358 8335 ERROR nova.wsgi
Sep 28 11:54:26 ctl02 nova-api[8335]: 2017-09-28 11:54:26.359 8335 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:54:26 ctl02 nova-api[8335]: 2017-09-28 11:54:26.491 8335 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:54:26 ctl02 nova-api[8335]: 2017-09-28 11:54:26.734 8335 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:54:26 ctl02 nova-api[8335]: 2017-09-28 11:54:26.737 8335 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:54:26 ctl02 nova-api[8335]: 2017-09-28 11:54:26.737 8335 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:54:26 ctl02 nova-api[8335]: 2017-09-28 11:54:26.737 8335 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:54:26 ctl02 nova-api[8335]: 2017-09-28 11:54:26.868 8335 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:54:26 ctl02 nova-api[8335]: 2017-09-28 11:54:26.870 8335 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:54:26 ctl02 nova-api[8335]: 2017-09-28 11:54:26.870 8335 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:54:26 ctl02 nova-api[8335]: 2017-09-28 11:54:26.870 8335 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:54:26 ctl02 nova-api[8335]: 2017-09-28 11:54:26.873 8335 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:54:26 ctl02 nova-api[8335]: 2017-09-28 11:54:26.874 8335 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:54:26 ctl02 nova-api[8335]: 2017-09-28 11:54:26.874 8335 ERROR nova Traceback (most recent call last):
Sep 28 11:54:26 ctl02 nova-api[8335]: 2017-09-28 11:54:26.874 8335 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:54:26 ctl02 nova-api[8335]: 2017-09-28 11:54:26.874 8335 ERROR nova     sys.exit(main())
Sep 28 11:54:26 ctl02 nova-api[8335]: 2017-09-28 11:54:26.874 8335 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:54:26 ctl02 nova-api[8335]: 2017-09-28 11:54:26.874 8335 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:54:26 ctl02 nova-api[8335]: 2017-09-28 11:54:26.874 8335 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:54:26 ctl02 nova-api[8335]: 2017-09-28 11:54:26.874 8335 ERROR nova     max_url_len=max_url_len)
Sep 28 11:54:26 ctl02 nova-api[8335]: 2017-09-28 11:54:26.874 8335 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:54:26 ctl02 nova-api[8335]: 2017-09-28 11:54:26.874 8335 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:54:26 ctl02 nova-api[8335]: 2017-09-28 11:54:26.874 8335 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:54:26 ctl02 nova-api[8335]: 2017-09-28 11:54:26.874 8335 ERROR nova     sock.listen(backlog)
Sep 28 11:54:26 ctl02 nova-api[8335]: 2017-09-28 11:54:26.874 8335 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:54:26 ctl02 nova-api[8335]: 2017-09-28 11:54:26.874 8335 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:54:26 ctl02 nova-api[8335]: 2017-09-28 11:54:26.874 8335 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:54:26 ctl02 nova-api[8335]: 2017-09-28 11:54:26.874 8335 ERROR nova
Sep 28 11:54:27 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:54:27 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:54:27 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:54:27 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:54:27 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:54:27 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:54:27 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:54:27 ctl02 glance-api[29183]: 2017-09-28 11:54:27.933 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:54:27] "OPTIONS / HTTP/1.0" 200 134 0.000600
Sep 28 11:54:28 ctl02 glance-api[29183]: 2017-09-28 11:54:28.032 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:54:28] "OPTIONS / HTTP/1.0" 200 134 0.000540
Sep 28 11:54:28 ctl02 nova-api[8352]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:54:28 ctl02 nova-api[8352]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:54:28 ctl02 nova-api[8352]: 2017-09-28 11:54:28.848 8352 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:54:28 ctl02 nova-api[8352]: 2017-09-28 11:54:28.850 8352 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:54:28 ctl02 nova-api[8352]: 2017-09-28 11:54:28.850 8352 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:54:28 ctl02 nova-api[8352]: 2017-09-28 11:54:28.850 8352 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:54:28 ctl02 nova-api[8352]: 2017-09-28 11:54:28.850 8352 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:54:28 ctl02 nova-api[8352]: 2017-09-28 11:54:28.850 8352 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:54:28 ctl02 nova-api[8352]: 2017-09-28 11:54:28.850 8352 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:54:28 ctl02 nova-api[8352]: 2017-09-28 11:54:28.850 8352 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:54:28 ctl02 nova-api[8352]: 2017-09-28 11:54:28.850 8352 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:54:28 ctl02 nova-api[8352]: 2017-09-28 11:54:28.850 8352 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:54:28 ctl02 nova-api[8352]: 2017-09-28 11:54:28.850 8352 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:54:28 ctl02 nova-api[8352]: 2017-09-28 11:54:28.850 8352 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:54:28 ctl02 nova-api[8352]: 2017-09-28 11:54:28.850 8352 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:54:28 ctl02 nova-api[8352]: 2017-09-28 11:54:28.850 8352 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:54:28 ctl02 nova-api[8352]: 2017-09-28 11:54:28.850 8352 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:54:28 ctl02 nova-api[8352]: 2017-09-28 11:54:28.850 8352 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:54:28 ctl02 nova-api[8352]: 2017-09-28 11:54:28.850 8352 ERROR nova.wsgi     self.filename))
Sep 28 11:54:28 ctl02 nova-api[8352]: 2017-09-28 11:54:28.850 8352 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:54:28 ctl02 nova-api[8352]: 2017-09-28 11:54:28.850 8352 ERROR nova.wsgi
Sep 28 11:54:28 ctl02 nova-api[8352]: 2017-09-28 11:54:28.851 8352 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:54:28 ctl02 nova-api[8352]: 2017-09-28 11:54:28.980 8352 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:54:29 ctl02 nova-api[8352]: 2017-09-28 11:54:29.213 8352 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:54:29 ctl02 nova-api[8352]: 2017-09-28 11:54:29.215 8352 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:54:29 ctl02 nova-api[8352]: 2017-09-28 11:54:29.215 8352 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:54:29 ctl02 nova-api[8352]: 2017-09-28 11:54:29.215 8352 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:54:29 ctl02 nova-api[8352]: 2017-09-28 11:54:29.347 8352 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:54:29 ctl02 nova-api[8352]: 2017-09-28 11:54:29.349 8352 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:54:29 ctl02 nova-api[8352]: 2017-09-28 11:54:29.349 8352 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:54:29 ctl02 nova-api[8352]: 2017-09-28 11:54:29.350 8352 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:54:29 ctl02 nova-api[8352]: 2017-09-28 11:54:29.353 8352 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:54:29 ctl02 nova-api[8352]: 2017-09-28 11:54:29.353 8352 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:54:29 ctl02 nova-api[8352]: 2017-09-28 11:54:29.353 8352 ERROR nova Traceback (most recent call last):
Sep 28 11:54:29 ctl02 nova-api[8352]: 2017-09-28 11:54:29.353 8352 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:54:29 ctl02 nova-api[8352]: 2017-09-28 11:54:29.353 8352 ERROR nova     sys.exit(main())
Sep 28 11:54:29 ctl02 nova-api[8352]: 2017-09-28 11:54:29.353 8352 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:54:29 ctl02 nova-api[8352]: 2017-09-28 11:54:29.353 8352 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:54:29 ctl02 nova-api[8352]: 2017-09-28 11:54:29.353 8352 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:54:29 ctl02 nova-api[8352]: 2017-09-28 11:54:29.353 8352 ERROR nova     max_url_len=max_url_len)
Sep 28 11:54:29 ctl02 nova-api[8352]: 2017-09-28 11:54:29.353 8352 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:54:29 ctl02 nova-api[8352]: 2017-09-28 11:54:29.353 8352 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:54:29 ctl02 nova-api[8352]: 2017-09-28 11:54:29.353 8352 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:54:29 ctl02 nova-api[8352]: 2017-09-28 11:54:29.353 8352 ERROR nova     sock.listen(backlog)
Sep 28 11:54:29 ctl02 nova-api[8352]: 2017-09-28 11:54:29.353 8352 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:54:29 ctl02 nova-api[8352]: 2017-09-28 11:54:29.353 8352 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:54:29 ctl02 nova-api[8352]: 2017-09-28 11:54:29.353 8352 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:54:29 ctl02 nova-api[8352]: 2017-09-28 11:54:29.353 8352 ERROR nova
Sep 28 11:54:29 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:54:29 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:54:29 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:54:29 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:54:29 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:54:29 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:54:29 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:54:30 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xeaf36071)
Sep 28 11:54:31 ctl02 nova-api[8371]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:54:31 ctl02 nova-api[8371]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:54:31 ctl02 nova-api[8371]: 2017-09-28 11:54:31.340 8371 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:54:31 ctl02 nova-api[8371]: 2017-09-28 11:54:31.342 8371 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:54:31 ctl02 nova-api[8371]: 2017-09-28 11:54:31.342 8371 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:54:31 ctl02 nova-api[8371]: 2017-09-28 11:54:31.342 8371 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:54:31 ctl02 nova-api[8371]: 2017-09-28 11:54:31.342 8371 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:54:31 ctl02 nova-api[8371]: 2017-09-28 11:54:31.342 8371 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:54:31 ctl02 nova-api[8371]: 2017-09-28 11:54:31.342 8371 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:54:31 ctl02 nova-api[8371]: 2017-09-28 11:54:31.342 8371 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:54:31 ctl02 nova-api[8371]: 2017-09-28 11:54:31.342 8371 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:54:31 ctl02 nova-api[8371]: 2017-09-28 11:54:31.342 8371 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:54:31 ctl02 nova-api[8371]: 2017-09-28 11:54:31.342 8371 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:54:31 ctl02 nova-api[8371]: 2017-09-28 11:54:31.342 8371 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:54:31 ctl02 nova-api[8371]: 2017-09-28 11:54:31.342 8371 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:54:31 ctl02 nova-api[8371]: 2017-09-28 11:54:31.342 8371 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:54:31 ctl02 nova-api[8371]: 2017-09-28 11:54:31.342 8371 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:54:31 ctl02 nova-api[8371]: 2017-09-28 11:54:31.342 8371 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:54:31 ctl02 nova-api[8371]: 2017-09-28 11:54:31.342 8371 ERROR nova.wsgi     self.filename))
Sep 28 11:54:31 ctl02 nova-api[8371]: 2017-09-28 11:54:31.342 8371 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:54:31 ctl02 nova-api[8371]: 2017-09-28 11:54:31.342 8371 ERROR nova.wsgi
Sep 28 11:54:31 ctl02 nova-api[8371]: 2017-09-28 11:54:31.343 8371 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:54:31 ctl02 nova-api[8371]: 2017-09-28 11:54:31.484 8371 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:54:31 ctl02 nova-api[8371]: 2017-09-28 11:54:31.721 8371 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:54:31 ctl02 nova-api[8371]: 2017-09-28 11:54:31.723 8371 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:54:31 ctl02 nova-api[8371]: 2017-09-28 11:54:31.723 8371 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:54:31 ctl02 nova-api[8371]: 2017-09-28 11:54:31.724 8371 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:54:31 ctl02 nova-api[8371]: 2017-09-28 11:54:31.854 8371 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:54:31 ctl02 nova-api[8371]: 2017-09-28 11:54:31.855 8371 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:54:31 ctl02 nova-api[8371]: 2017-09-28 11:54:31.856 8371 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:54:31 ctl02 nova-api[8371]: 2017-09-28 11:54:31.856 8371 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:54:31 ctl02 nova-api[8371]: 2017-09-28 11:54:31.859 8371 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:54:31 ctl02 nova-api[8371]: 2017-09-28 11:54:31.859 8371 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:54:31 ctl02 nova-api[8371]: 2017-09-28 11:54:31.859 8371 ERROR nova Traceback (most recent call last):
Sep 28 11:54:31 ctl02 nova-api[8371]: 2017-09-28 11:54:31.859 8371 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:54:31 ctl02 nova-api[8371]: 2017-09-28 11:54:31.859 8371 ERROR nova     sys.exit(main())
Sep 28 11:54:31 ctl02 nova-api[8371]: 2017-09-28 11:54:31.859 8371 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:54:31 ctl02 nova-api[8371]: 2017-09-28 11:54:31.859 8371 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:54:31 ctl02 nova-api[8371]: 2017-09-28 11:54:31.859 8371 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:54:31 ctl02 nova-api[8371]: 2017-09-28 11:54:31.859 8371 ERROR nova     max_url_len=max_url_len)
Sep 28 11:54:31 ctl02 nova-api[8371]: 2017-09-28 11:54:31.859 8371 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:54:31 ctl02 nova-api[8371]: 2017-09-28 11:54:31.859 8371 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:54:31 ctl02 nova-api[8371]: 2017-09-28 11:54:31.859 8371 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:54:31 ctl02 nova-api[8371]: 2017-09-28 11:54:31.859 8371 ERROR nova     sock.listen(backlog)
Sep 28 11:54:31 ctl02 nova-api[8371]: 2017-09-28 11:54:31.859 8371 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:54:31 ctl02 nova-api[8371]: 2017-09-28 11:54:31.859 8371 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:54:31 ctl02 nova-api[8371]: 2017-09-28 11:54:31.859 8371 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:54:31 ctl02 nova-api[8371]: 2017-09-28 11:54:31.859 8371 ERROR nova
Sep 28 11:54:31 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xeaf36071)
Sep 28 11:54:31 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:54:31 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:54:31 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:54:32 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:54:32 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:54:32 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:54:32 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:54:32 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xeaf36071)
Sep 28 11:54:33 ctl02 glance-api[29183]: 2017-09-28 11:54:33.547 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:54:33] "OPTIONS / HTTP/1.0" 200 134 0.000568
Sep 28 11:54:33 ctl02 nova-api[8388]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:54:33 ctl02 nova-api[8388]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:54:33 ctl02 nova-api[8388]: 2017-09-28 11:54:33.827 8388 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:54:33 ctl02 nova-api[8388]: 2017-09-28 11:54:33.831 8388 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:54:33 ctl02 nova-api[8388]: 2017-09-28 11:54:33.831 8388 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:54:33 ctl02 nova-api[8388]: 2017-09-28 11:54:33.831 8388 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:54:33 ctl02 nova-api[8388]: 2017-09-28 11:54:33.831 8388 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:54:33 ctl02 nova-api[8388]: 2017-09-28 11:54:33.831 8388 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:54:33 ctl02 nova-api[8388]: 2017-09-28 11:54:33.831 8388 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:54:33 ctl02 nova-api[8388]: 2017-09-28 11:54:33.831 8388 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:54:33 ctl02 nova-api[8388]: 2017-09-28 11:54:33.831 8388 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:54:33 ctl02 nova-api[8388]: 2017-09-28 11:54:33.831 8388 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:54:33 ctl02 nova-api[8388]: 2017-09-28 11:54:33.831 8388 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:54:33 ctl02 nova-api[8388]: 2017-09-28 11:54:33.831 8388 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:54:33 ctl02 nova-api[8388]: 2017-09-28 11:54:33.831 8388 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:54:33 ctl02 nova-api[8388]: 2017-09-28 11:54:33.831 8388 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:54:33 ctl02 nova-api[8388]: 2017-09-28 11:54:33.831 8388 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:54:33 ctl02 nova-api[8388]: 2017-09-28 11:54:33.831 8388 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:54:33 ctl02 nova-api[8388]: 2017-09-28 11:54:33.831 8388 ERROR nova.wsgi     self.filename))
Sep 28 11:54:33 ctl02 nova-api[8388]: 2017-09-28 11:54:33.831 8388 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:54:33 ctl02 nova-api[8388]: 2017-09-28 11:54:33.831 8388 ERROR nova.wsgi
Sep 28 11:54:33 ctl02 nova-api[8388]: 2017-09-28 11:54:33.833 8388 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:54:33 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xeaf36071)
Sep 28 11:54:33 ctl02 nova-api[8388]: 2017-09-28 11:54:33.968 8388 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:54:34 ctl02 nova-api[8388]: 2017-09-28 11:54:34.216 8388 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:54:34 ctl02 nova-api[8388]: 2017-09-28 11:54:34.219 8388 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:54:34 ctl02 nova-api[8388]: 2017-09-28 11:54:34.219 8388 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:54:34 ctl02 nova-api[8388]: 2017-09-28 11:54:34.220 8388 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:54:34 ctl02 nova-api[8388]: 2017-09-28 11:54:34.353 8388 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:54:34 ctl02 nova-api[8388]: 2017-09-28 11:54:34.355 8388 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:54:34 ctl02 nova-api[8388]: 2017-09-28 11:54:34.356 8388 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:54:34 ctl02 nova-api[8388]: 2017-09-28 11:54:34.356 8388 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:54:34 ctl02 nova-api[8388]: 2017-09-28 11:54:34.360 8388 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:54:34 ctl02 nova-api[8388]: 2017-09-28 11:54:34.360 8388 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:54:34 ctl02 nova-api[8388]: 2017-09-28 11:54:34.360 8388 ERROR nova Traceback (most recent call last):
Sep 28 11:54:34 ctl02 nova-api[8388]: 2017-09-28 11:54:34.360 8388 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:54:34 ctl02 nova-api[8388]: 2017-09-28 11:54:34.360 8388 ERROR nova     sys.exit(main())
Sep 28 11:54:34 ctl02 nova-api[8388]: 2017-09-28 11:54:34.360 8388 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:54:34 ctl02 nova-api[8388]: 2017-09-28 11:54:34.360 8388 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:54:34 ctl02 nova-api[8388]: 2017-09-28 11:54:34.360 8388 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:54:34 ctl02 nova-api[8388]: 2017-09-28 11:54:34.360 8388 ERROR nova     max_url_len=max_url_len)
Sep 28 11:54:34 ctl02 nova-api[8388]: 2017-09-28 11:54:34.360 8388 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:54:34 ctl02 nova-api[8388]: 2017-09-28 11:54:34.360 8388 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:54:34 ctl02 nova-api[8388]: 2017-09-28 11:54:34.360 8388 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:54:34 ctl02 nova-api[8388]: 2017-09-28 11:54:34.360 8388 ERROR nova     sock.listen(backlog)
Sep 28 11:54:34 ctl02 nova-api[8388]: 2017-09-28 11:54:34.360 8388 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:54:34 ctl02 nova-api[8388]: 2017-09-28 11:54:34.360 8388 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:54:34 ctl02 nova-api[8388]: 2017-09-28 11:54:34.360 8388 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:54:34 ctl02 nova-api[8388]: 2017-09-28 11:54:34.360 8388 ERROR nova
Sep 28 11:54:34 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:54:34 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:54:34 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:54:34 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:54:34 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:54:34 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:54:34 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:54:34 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xeaf36071)
Sep 28 11:54:35 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xeaf36071)
Sep 28 11:54:36 ctl02 nova-api[8407]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:54:36 ctl02 nova-api[8407]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:54:36 ctl02 nova-api[8407]: 2017-09-28 11:54:36.354 8407 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:54:36 ctl02 nova-api[8407]: 2017-09-28 11:54:36.356 8407 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:54:36 ctl02 nova-api[8407]: 2017-09-28 11:54:36.356 8407 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:54:36 ctl02 nova-api[8407]: 2017-09-28 11:54:36.356 8407 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:54:36 ctl02 nova-api[8407]: 2017-09-28 11:54:36.356 8407 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:54:36 ctl02 nova-api[8407]: 2017-09-28 11:54:36.356 8407 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:54:36 ctl02 nova-api[8407]: 2017-09-28 11:54:36.356 8407 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:54:36 ctl02 nova-api[8407]: 2017-09-28 11:54:36.356 8407 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:54:36 ctl02 nova-api[8407]: 2017-09-28 11:54:36.356 8407 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:54:36 ctl02 nova-api[8407]: 2017-09-28 11:54:36.356 8407 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:54:36 ctl02 nova-api[8407]: 2017-09-28 11:54:36.356 8407 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:54:36 ctl02 nova-api[8407]: 2017-09-28 11:54:36.356 8407 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:54:36 ctl02 nova-api[8407]: 2017-09-28 11:54:36.356 8407 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:54:36 ctl02 nova-api[8407]: 2017-09-28 11:54:36.356 8407 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:54:36 ctl02 nova-api[8407]: 2017-09-28 11:54:36.356 8407 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:54:36 ctl02 nova-api[8407]: 2017-09-28 11:54:36.356 8407 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:54:36 ctl02 nova-api[8407]: 2017-09-28 11:54:36.356 8407 ERROR nova.wsgi     self.filename))
Sep 28 11:54:36 ctl02 nova-api[8407]: 2017-09-28 11:54:36.356 8407 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:54:36 ctl02 nova-api[8407]: 2017-09-28 11:54:36.356 8407 ERROR nova.wsgi
Sep 28 11:54:36 ctl02 nova-api[8407]: 2017-09-28 11:54:36.357 8407 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:54:36 ctl02 nova-api[8407]: 2017-09-28 11:54:36.490 8407 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:54:36 ctl02 nova-api[8407]: 2017-09-28 11:54:36.727 8407 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:54:36 ctl02 nova-api[8407]: 2017-09-28 11:54:36.729 8407 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:54:36 ctl02 nova-api[8407]: 2017-09-28 11:54:36.730 8407 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:54:36 ctl02 nova-api[8407]: 2017-09-28 11:54:36.730 8407 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:54:36 ctl02 nova-api[8407]: 2017-09-28 11:54:36.862 8407 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:54:36 ctl02 nova-api[8407]: 2017-09-28 11:54:36.864 8407 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:54:36 ctl02 nova-api[8407]: 2017-09-28 11:54:36.864 8407 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:54:36 ctl02 nova-api[8407]: 2017-09-28 11:54:36.865 8407 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:54:36 ctl02 nova-api[8407]: 2017-09-28 11:54:36.868 8407 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:54:36 ctl02 nova-api[8407]: 2017-09-28 11:54:36.868 8407 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:54:36 ctl02 nova-api[8407]: 2017-09-28 11:54:36.868 8407 ERROR nova Traceback (most recent call last):
Sep 28 11:54:36 ctl02 nova-api[8407]: 2017-09-28 11:54:36.868 8407 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:54:36 ctl02 nova-api[8407]: 2017-09-28 11:54:36.868 8407 ERROR nova     sys.exit(main())
Sep 28 11:54:36 ctl02 nova-api[8407]: 2017-09-28 11:54:36.868 8407 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:54:36 ctl02 nova-api[8407]: 2017-09-28 11:54:36.868 8407 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:54:36 ctl02 nova-api[8407]: 2017-09-28 11:54:36.868 8407 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:54:36 ctl02 nova-api[8407]: 2017-09-28 11:54:36.868 8407 ERROR nova     max_url_len=max_url_len)
Sep 28 11:54:36 ctl02 nova-api[8407]: 2017-09-28 11:54:36.868 8407 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:54:36 ctl02 nova-api[8407]: 2017-09-28 11:54:36.868 8407 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:54:36 ctl02 nova-api[8407]: 2017-09-28 11:54:36.868 8407 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:54:36 ctl02 nova-api[8407]: 2017-09-28 11:54:36.868 8407 ERROR nova     sock.listen(backlog)
Sep 28 11:54:36 ctl02 nova-api[8407]: 2017-09-28 11:54:36.868 8407 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:54:36 ctl02 nova-api[8407]: 2017-09-28 11:54:36.868 8407 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:54:36 ctl02 nova-api[8407]: 2017-09-28 11:54:36.868 8407 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:54:36 ctl02 nova-api[8407]: 2017-09-28 11:54:36.868 8407 ERROR nova
Sep 28 11:54:36 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xeaf36071)
Sep 28 11:54:37 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:54:37 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:54:37 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:54:37 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:54:37 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:54:37 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:54:37 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:54:37 ctl02 glance-api[29183]: 2017-09-28 11:54:37.675 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:54:37] "OPTIONS / HTTP/1.0" 200 134 0.001148
Sep 28 11:54:37 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xeaf36071)
Sep 28 11:54:37 ctl02 glance-api[29183]: 2017-09-28 11:54:37.915 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:54:37] "OPTIONS / HTTP/1.0" 200 134 0.000548
Sep 28 11:54:38 ctl02 nova-api[8424]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:54:38 ctl02 nova-api[8424]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:54:38 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xeaf36071)
Sep 28 11:54:38 ctl02 nova-api[8424]: 2017-09-28 11:54:38.884 8424 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:54:38 ctl02 nova-api[8424]: 2017-09-28 11:54:38.897 8424 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:54:38 ctl02 nova-api[8424]: 2017-09-28 11:54:38.897 8424 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:54:38 ctl02 nova-api[8424]: 2017-09-28 11:54:38.897 8424 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:54:38 ctl02 nova-api[8424]: 2017-09-28 11:54:38.897 8424 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:54:38 ctl02 nova-api[8424]: 2017-09-28 11:54:38.897 8424 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:54:38 ctl02 nova-api[8424]: 2017-09-28 11:54:38.897 8424 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:54:38 ctl02 nova-api[8424]: 2017-09-28 11:54:38.897 8424 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:54:38 ctl02 nova-api[8424]: 2017-09-28 11:54:38.897 8424 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:54:38 ctl02 nova-api[8424]: 2017-09-28 11:54:38.897 8424 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:54:38 ctl02 nova-api[8424]: 2017-09-28 11:54:38.897 8424 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:54:38 ctl02 nova-api[8424]: 2017-09-28 11:54:38.897 8424 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:54:38 ctl02 nova-api[8424]: 2017-09-28 11:54:38.897 8424 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:54:38 ctl02 nova-api[8424]: 2017-09-28 11:54:38.897 8424 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:54:38 ctl02 nova-api[8424]: 2017-09-28 11:54:38.897 8424 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:54:38 ctl02 nova-api[8424]: 2017-09-28 11:54:38.897 8424 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:54:38 ctl02 nova-api[8424]: 2017-09-28 11:54:38.897 8424 ERROR nova.wsgi     self.filename))
Sep 28 11:54:38 ctl02 nova-api[8424]: 2017-09-28 11:54:38.897 8424 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:54:38 ctl02 nova-api[8424]: 2017-09-28 11:54:38.897 8424 ERROR nova.wsgi
Sep 28 11:54:38 ctl02 nova-api[8424]: 2017-09-28 11:54:38.899 8424 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:54:39 ctl02 nova-api[8424]: 2017-09-28 11:54:39.046 8424 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:54:39 ctl02 nova-api[8424]: 2017-09-28 11:54:39.287 8424 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:54:39 ctl02 nova-api[8424]: 2017-09-28 11:54:39.290 8424 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:54:39 ctl02 nova-api[8424]: 2017-09-28 11:54:39.290 8424 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:54:39 ctl02 nova-api[8424]: 2017-09-28 11:54:39.290 8424 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:54:39 ctl02 nova-api[8424]: 2017-09-28 11:54:39.421 8424 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:54:39 ctl02 nova-api[8424]: 2017-09-28 11:54:39.423 8424 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:54:39 ctl02 nova-api[8424]: 2017-09-28 11:54:39.423 8424 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:54:39 ctl02 nova-api[8424]: 2017-09-28 11:54:39.424 8424 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:54:39 ctl02 nova-api[8424]: 2017-09-28 11:54:39.427 8424 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:54:39 ctl02 nova-api[8424]: 2017-09-28 11:54:39.427 8424 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:54:39 ctl02 nova-api[8424]: 2017-09-28 11:54:39.427 8424 ERROR nova Traceback (most recent call last):
Sep 28 11:54:39 ctl02 nova-api[8424]: 2017-09-28 11:54:39.427 8424 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:54:39 ctl02 nova-api[8424]: 2017-09-28 11:54:39.427 8424 ERROR nova     sys.exit(main())
Sep 28 11:54:39 ctl02 nova-api[8424]: 2017-09-28 11:54:39.427 8424 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:54:39 ctl02 nova-api[8424]: 2017-09-28 11:54:39.427 8424 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:54:39 ctl02 nova-api[8424]: 2017-09-28 11:54:39.427 8424 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:54:39 ctl02 nova-api[8424]: 2017-09-28 11:54:39.427 8424 ERROR nova     max_url_len=max_url_len)
Sep 28 11:54:39 ctl02 nova-api[8424]: 2017-09-28 11:54:39.427 8424 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:54:39 ctl02 nova-api[8424]: 2017-09-28 11:54:39.427 8424 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:54:39 ctl02 nova-api[8424]: 2017-09-28 11:54:39.427 8424 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:54:39 ctl02 nova-api[8424]: 2017-09-28 11:54:39.427 8424 ERROR nova     sock.listen(backlog)
Sep 28 11:54:39 ctl02 nova-api[8424]: 2017-09-28 11:54:39.427 8424 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:54:39 ctl02 nova-api[8424]: 2017-09-28 11:54:39.427 8424 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:54:39 ctl02 nova-api[8424]: 2017-09-28 11:54:39.427 8424 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:54:39 ctl02 nova-api[8424]: 2017-09-28 11:54:39.427 8424 ERROR nova
Sep 28 11:54:39 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:54:39 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:54:39 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:54:39 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:54:39 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:54:39 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xeaf36071)
Sep 28 11:54:39 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:54:39 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:54:40 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xeaf36071)
Sep 28 11:54:41 ctl02 nova-api[8442]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:54:41 ctl02 nova-api[8442]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:54:41 ctl02 nova-api[8442]: 2017-09-28 11:54:41.567 8442 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:54:41 ctl02 nova-api[8442]: 2017-09-28 11:54:41.569 8442 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:54:41 ctl02 nova-api[8442]: 2017-09-28 11:54:41.569 8442 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:54:41 ctl02 nova-api[8442]: 2017-09-28 11:54:41.569 8442 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:54:41 ctl02 nova-api[8442]: 2017-09-28 11:54:41.569 8442 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:54:41 ctl02 nova-api[8442]: 2017-09-28 11:54:41.569 8442 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:54:41 ctl02 nova-api[8442]: 2017-09-28 11:54:41.569 8442 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:54:41 ctl02 nova-api[8442]: 2017-09-28 11:54:41.569 8442 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:54:41 ctl02 nova-api[8442]: 2017-09-28 11:54:41.569 8442 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:54:41 ctl02 nova-api[8442]: 2017-09-28 11:54:41.569 8442 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:54:41 ctl02 nova-api[8442]: 2017-09-28 11:54:41.569 8442 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:54:41 ctl02 nova-api[8442]: 2017-09-28 11:54:41.569 8442 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:54:41 ctl02 nova-api[8442]: 2017-09-28 11:54:41.569 8442 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:54:41 ctl02 nova-api[8442]: 2017-09-28 11:54:41.569 8442 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:54:41 ctl02 nova-api[8442]: 2017-09-28 11:54:41.569 8442 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:54:41 ctl02 nova-api[8442]: 2017-09-28 11:54:41.569 8442 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:54:41 ctl02 nova-api[8442]: 2017-09-28 11:54:41.569 8442 ERROR nova.wsgi     self.filename))
Sep 28 11:54:41 ctl02 nova-api[8442]: 2017-09-28 11:54:41.569 8442 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:54:41 ctl02 nova-api[8442]: 2017-09-28 11:54:41.569 8442 ERROR nova.wsgi
Sep 28 11:54:41 ctl02 nova-api[8442]: 2017-09-28 11:54:41.570 8442 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:54:41 ctl02 nova-api[8442]: 2017-09-28 11:54:41.701 8442 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:54:41 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:54:41 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:54:41 ctl02 nova-api[8442]: 2017-09-28 11:54:41.934 8442 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:54:41 ctl02 nova-api[8442]: 2017-09-28 11:54:41.936 8442 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:54:41 ctl02 nova-api[8442]: 2017-09-28 11:54:41.936 8442 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:54:41 ctl02 nova-api[8442]: 2017-09-28 11:54:41.936 8442 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:54:42 ctl02 nova-api[8442]: 2017-09-28 11:54:42.067 8442 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:54:42 ctl02 nova-api[8442]: 2017-09-28 11:54:42.069 8442 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:54:42 ctl02 nova-api[8442]: 2017-09-28 11:54:42.069 8442 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:54:42 ctl02 nova-api[8442]: 2017-09-28 11:54:42.070 8442 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:54:42 ctl02 nova-api[8442]: 2017-09-28 11:54:42.073 8442 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:54:42 ctl02 nova-api[8442]: 2017-09-28 11:54:42.073 8442 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:54:42 ctl02 nova-api[8442]: 2017-09-28 11:54:42.073 8442 ERROR nova Traceback (most recent call last):
Sep 28 11:54:42 ctl02 nova-api[8442]: 2017-09-28 11:54:42.073 8442 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:54:42 ctl02 nova-api[8442]: 2017-09-28 11:54:42.073 8442 ERROR nova     sys.exit(main())
Sep 28 11:54:42 ctl02 nova-api[8442]: 2017-09-28 11:54:42.073 8442 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:54:42 ctl02 nova-api[8442]: 2017-09-28 11:54:42.073 8442 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:54:42 ctl02 nova-api[8442]: 2017-09-28 11:54:42.073 8442 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:54:42 ctl02 nova-api[8442]: 2017-09-28 11:54:42.073 8442 ERROR nova     max_url_len=max_url_len)
Sep 28 11:54:42 ctl02 nova-api[8442]: 2017-09-28 11:54:42.073 8442 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:54:42 ctl02 nova-api[8442]: 2017-09-28 11:54:42.073 8442 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:54:42 ctl02 nova-api[8442]: 2017-09-28 11:54:42.073 8442 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:54:42 ctl02 nova-api[8442]: 2017-09-28 11:54:42.073 8442 ERROR nova     sock.listen(backlog)
Sep 28 11:54:42 ctl02 nova-api[8442]: 2017-09-28 11:54:42.073 8442 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:54:42 ctl02 nova-api[8442]: 2017-09-28 11:54:42.073 8442 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:54:42 ctl02 nova-api[8442]: 2017-09-28 11:54:42.073 8442 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:54:42 ctl02 nova-api[8442]: 2017-09-28 11:54:42.073 8442 ERROR nova
Sep 28 11:54:42 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:54:42 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:54:42 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:54:42 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:54:42 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:54:42 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:54:42 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:54:43 ctl02 nova-cert[4860]: 2017-09-28 11:54:43.269 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:54:43 ctl02 glance-api[29183]: 2017-09-28 11:54:43.650 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:54:43] "OPTIONS / HTTP/1.0" 200 134 0.000618
Sep 28 11:54:43 ctl02 nova-api[8466]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:54:43 ctl02 nova-api[8466]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:54:44 ctl02 nova-api[8466]: 2017-09-28 11:54:44.099 8466 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:54:44 ctl02 nova-api[8466]: 2017-09-28 11:54:44.101 8466 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:54:44 ctl02 nova-api[8466]: 2017-09-28 11:54:44.101 8466 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:54:44 ctl02 nova-api[8466]: 2017-09-28 11:54:44.101 8466 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:54:44 ctl02 nova-api[8466]: 2017-09-28 11:54:44.101 8466 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:54:44 ctl02 nova-api[8466]: 2017-09-28 11:54:44.101 8466 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:54:44 ctl02 nova-api[8466]: 2017-09-28 11:54:44.101 8466 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:54:44 ctl02 nova-api[8466]: 2017-09-28 11:54:44.101 8466 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:54:44 ctl02 nova-api[8466]: 2017-09-28 11:54:44.101 8466 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:54:44 ctl02 nova-api[8466]: 2017-09-28 11:54:44.101 8466 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:54:44 ctl02 nova-api[8466]: 2017-09-28 11:54:44.101 8466 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:54:44 ctl02 nova-api[8466]: 2017-09-28 11:54:44.101 8466 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:54:44 ctl02 nova-api[8466]: 2017-09-28 11:54:44.101 8466 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:54:44 ctl02 nova-api[8466]: 2017-09-28 11:54:44.101 8466 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:54:44 ctl02 nova-api[8466]: 2017-09-28 11:54:44.101 8466 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:54:44 ctl02 nova-api[8466]: 2017-09-28 11:54:44.101 8466 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:54:44 ctl02 nova-api[8466]: 2017-09-28 11:54:44.101 8466 ERROR nova.wsgi     self.filename))
Sep 28 11:54:44 ctl02 nova-api[8466]: 2017-09-28 11:54:44.101 8466 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:54:44 ctl02 nova-api[8466]: 2017-09-28 11:54:44.101 8466 ERROR nova.wsgi
Sep 28 11:54:44 ctl02 nova-api[8466]: 2017-09-28 11:54:44.102 8466 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:54:44 ctl02 nova-api[8466]: 2017-09-28 11:54:44.231 8466 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:54:44 ctl02 nova-api[8466]: 2017-09-28 11:54:44.462 8466 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:54:44 ctl02 nova-api[8466]: 2017-09-28 11:54:44.464 8466 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:54:44 ctl02 nova-api[8466]: 2017-09-28 11:54:44.464 8466 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:54:44 ctl02 nova-api[8466]: 2017-09-28 11:54:44.464 8466 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:54:44 ctl02 nova-api[8466]: 2017-09-28 11:54:44.595 8466 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:54:44 ctl02 nova-api[8466]: 2017-09-28 11:54:44.597 8466 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:54:44 ctl02 nova-api[8466]: 2017-09-28 11:54:44.597 8466 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:54:44 ctl02 nova-api[8466]: 2017-09-28 11:54:44.597 8466 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:54:44 ctl02 nova-api[8466]: 2017-09-28 11:54:44.600 8466 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:54:44 ctl02 nova-api[8466]: 2017-09-28 11:54:44.601 8466 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:54:44 ctl02 nova-api[8466]: 2017-09-28 11:54:44.601 8466 ERROR nova Traceback (most recent call last):
Sep 28 11:54:44 ctl02 nova-api[8466]: 2017-09-28 11:54:44.601 8466 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:54:44 ctl02 nova-api[8466]: 2017-09-28 11:54:44.601 8466 ERROR nova     sys.exit(main())
Sep 28 11:54:44 ctl02 nova-api[8466]: 2017-09-28 11:54:44.601 8466 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:54:44 ctl02 nova-api[8466]: 2017-09-28 11:54:44.601 8466 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:54:44 ctl02 nova-api[8466]: 2017-09-28 11:54:44.601 8466 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:54:44 ctl02 nova-api[8466]: 2017-09-28 11:54:44.601 8466 ERROR nova     max_url_len=max_url_len)
Sep 28 11:54:44 ctl02 nova-api[8466]: 2017-09-28 11:54:44.601 8466 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:54:44 ctl02 nova-api[8466]: 2017-09-28 11:54:44.601 8466 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:54:44 ctl02 nova-api[8466]: 2017-09-28 11:54:44.601 8466 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:54:44 ctl02 nova-api[8466]: 2017-09-28 11:54:44.601 8466 ERROR nova     sock.listen(backlog)
Sep 28 11:54:44 ctl02 nova-api[8466]: 2017-09-28 11:54:44.601 8466 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:54:44 ctl02 nova-api[8466]: 2017-09-28 11:54:44.601 8466 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:54:44 ctl02 nova-api[8466]: 2017-09-28 11:54:44.601 8466 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:54:44 ctl02 nova-api[8466]: 2017-09-28 11:54:44.601 8466 ERROR nova
Sep 28 11:54:44 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:54:44 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:54:44 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:54:44 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:54:44 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:54:44 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:54:44 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:54:46 ctl02 nova-conductor[5056]: 2017-09-28 11:54:46.137 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:54:46 ctl02 nova-conductor[5056]: 2017-09-28 11:54:46.153 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:54:46 ctl02 nova-conductor[5056]: 2017-09-28 11:54:46.168 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:54:46 ctl02 nova-conductor[5056]: 2017-09-28 11:54:46.170 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:54:46 ctl02 nova-api[8484]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:54:46 ctl02 nova-api[8484]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:54:46 ctl02 nova-api[8484]: 2017-09-28 11:54:46.623 8484 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:54:46 ctl02 nova-api[8484]: 2017-09-28 11:54:46.624 8484 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:54:46 ctl02 nova-api[8484]: 2017-09-28 11:54:46.624 8484 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:54:46 ctl02 nova-api[8484]: 2017-09-28 11:54:46.624 8484 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:54:46 ctl02 nova-api[8484]: 2017-09-28 11:54:46.624 8484 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:54:46 ctl02 nova-api[8484]: 2017-09-28 11:54:46.624 8484 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:54:46 ctl02 nova-api[8484]: 2017-09-28 11:54:46.624 8484 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:54:46 ctl02 nova-api[8484]: 2017-09-28 11:54:46.624 8484 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:54:46 ctl02 nova-api[8484]: 2017-09-28 11:54:46.624 8484 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:54:46 ctl02 nova-api[8484]: 2017-09-28 11:54:46.624 8484 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:54:46 ctl02 nova-api[8484]: 2017-09-28 11:54:46.624 8484 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:54:46 ctl02 nova-api[8484]: 2017-09-28 11:54:46.624 8484 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:54:46 ctl02 nova-api[8484]: 2017-09-28 11:54:46.624 8484 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:54:46 ctl02 nova-api[8484]: 2017-09-28 11:54:46.624 8484 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:54:46 ctl02 nova-api[8484]: 2017-09-28 11:54:46.624 8484 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:54:46 ctl02 nova-api[8484]: 2017-09-28 11:54:46.624 8484 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:54:46 ctl02 nova-api[8484]: 2017-09-28 11:54:46.624 8484 ERROR nova.wsgi     self.filename))
Sep 28 11:54:46 ctl02 nova-api[8484]: 2017-09-28 11:54:46.624 8484 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:54:46 ctl02 nova-api[8484]: 2017-09-28 11:54:46.624 8484 ERROR nova.wsgi
Sep 28 11:54:46 ctl02 nova-api[8484]: 2017-09-28 11:54:46.625 8484 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:54:46 ctl02 nova-api[8484]: 2017-09-28 11:54:46.759 8484 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:54:47 ctl02 nova-api[8484]: 2017-09-28 11:54:47.000 8484 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:54:47 ctl02 nova-api[8484]: 2017-09-28 11:54:47.002 8484 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:54:47 ctl02 nova-api[8484]: 2017-09-28 11:54:47.002 8484 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:54:47 ctl02 nova-api[8484]: 2017-09-28 11:54:47.003 8484 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:54:47 ctl02 nova-api[8484]: 2017-09-28 11:54:47.134 8484 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:54:47 ctl02 nova-api[8484]: 2017-09-28 11:54:47.136 8484 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:54:47 ctl02 nova-api[8484]: 2017-09-28 11:54:47.136 8484 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:54:47 ctl02 nova-api[8484]: 2017-09-28 11:54:47.136 8484 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:54:47 ctl02 nova-api[8484]: 2017-09-28 11:54:47.140 8484 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:54:47 ctl02 nova-api[8484]: 2017-09-28 11:54:47.140 8484 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:54:47 ctl02 nova-api[8484]: 2017-09-28 11:54:47.140 8484 ERROR nova Traceback (most recent call last):
Sep 28 11:54:47 ctl02 nova-api[8484]: 2017-09-28 11:54:47.140 8484 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:54:47 ctl02 nova-api[8484]: 2017-09-28 11:54:47.140 8484 ERROR nova     sys.exit(main())
Sep 28 11:54:47 ctl02 nova-api[8484]: 2017-09-28 11:54:47.140 8484 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:54:47 ctl02 nova-api[8484]: 2017-09-28 11:54:47.140 8484 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:54:47 ctl02 nova-api[8484]: 2017-09-28 11:54:47.140 8484 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:54:47 ctl02 nova-api[8484]: 2017-09-28 11:54:47.140 8484 ERROR nova     max_url_len=max_url_len)
Sep 28 11:54:47 ctl02 nova-api[8484]: 2017-09-28 11:54:47.140 8484 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:54:47 ctl02 nova-api[8484]: 2017-09-28 11:54:47.140 8484 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:54:47 ctl02 nova-api[8484]: 2017-09-28 11:54:47.140 8484 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:54:47 ctl02 nova-api[8484]: 2017-09-28 11:54:47.140 8484 ERROR nova     sock.listen(backlog)
Sep 28 11:54:47 ctl02 nova-api[8484]: 2017-09-28 11:54:47.140 8484 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:54:47 ctl02 nova-api[8484]: 2017-09-28 11:54:47.140 8484 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:54:47 ctl02 nova-api[8484]: 2017-09-28 11:54:47.140 8484 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:54:47 ctl02 nova-api[8484]: 2017-09-28 11:54:47.140 8484 ERROR nova
Sep 28 11:54:47 ctl02 glance-api[29183]: 2017-09-28 11:54:47.291 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:54:47] "OPTIONS / HTTP/1.0" 200 134 0.001076
Sep 28 11:54:47 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:54:47 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:54:47 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:54:47 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:54:47 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:54:47 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:54:47 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:54:47 ctl02 glance-api[29183]: 2017-09-28 11:54:47.780 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:54:47] "OPTIONS / HTTP/1.0" 200 134 0.001002
Sep 28 11:54:49 ctl02 nova-api[8502]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:54:49 ctl02 nova-api[8502]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:54:49 ctl02 nova-api[8502]: 2017-09-28 11:54:49.386 8502 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:54:49 ctl02 nova-api[8502]: 2017-09-28 11:54:49.388 8502 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:54:49 ctl02 nova-api[8502]: 2017-09-28 11:54:49.388 8502 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:54:49 ctl02 nova-api[8502]: 2017-09-28 11:54:49.388 8502 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:54:49 ctl02 nova-api[8502]: 2017-09-28 11:54:49.388 8502 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:54:49 ctl02 nova-api[8502]: 2017-09-28 11:54:49.388 8502 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:54:49 ctl02 nova-api[8502]: 2017-09-28 11:54:49.388 8502 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:54:49 ctl02 nova-api[8502]: 2017-09-28 11:54:49.388 8502 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:54:49 ctl02 nova-api[8502]: 2017-09-28 11:54:49.388 8502 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:54:49 ctl02 nova-api[8502]: 2017-09-28 11:54:49.388 8502 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:54:49 ctl02 nova-api[8502]: 2017-09-28 11:54:49.388 8502 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:54:49 ctl02 nova-api[8502]: 2017-09-28 11:54:49.388 8502 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:54:49 ctl02 nova-api[8502]: 2017-09-28 11:54:49.388 8502 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:54:49 ctl02 nova-api[8502]: 2017-09-28 11:54:49.388 8502 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:54:49 ctl02 nova-api[8502]: 2017-09-28 11:54:49.388 8502 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:54:49 ctl02 nova-api[8502]: 2017-09-28 11:54:49.388 8502 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:54:49 ctl02 nova-api[8502]: 2017-09-28 11:54:49.388 8502 ERROR nova.wsgi     self.filename))
Sep 28 11:54:49 ctl02 nova-api[8502]: 2017-09-28 11:54:49.388 8502 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:54:49 ctl02 nova-api[8502]: 2017-09-28 11:54:49.388 8502 ERROR nova.wsgi
Sep 28 11:54:49 ctl02 nova-api[8502]: 2017-09-28 11:54:49.389 8502 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:54:49 ctl02 nova-api[8502]: 2017-09-28 11:54:49.523 8502 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:54:49 ctl02 nova-api[8502]: 2017-09-28 11:54:49.771 8502 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:54:49 ctl02 nova-api[8502]: 2017-09-28 11:54:49.773 8502 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:54:49 ctl02 nova-api[8502]: 2017-09-28 11:54:49.773 8502 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:54:49 ctl02 nova-api[8502]: 2017-09-28 11:54:49.774 8502 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:54:49 ctl02 nova-api[8502]: 2017-09-28 11:54:49.908 8502 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:54:49 ctl02 nova-api[8502]: 2017-09-28 11:54:49.910 8502 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:54:49 ctl02 nova-api[8502]: 2017-09-28 11:54:49.910 8502 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:54:49 ctl02 nova-api[8502]: 2017-09-28 11:54:49.910 8502 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:54:49 ctl02 nova-api[8502]: 2017-09-28 11:54:49.914 8502 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:54:49 ctl02 nova-api[8502]: 2017-09-28 11:54:49.914 8502 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:54:49 ctl02 nova-api[8502]: 2017-09-28 11:54:49.914 8502 ERROR nova Traceback (most recent call last):
Sep 28 11:54:49 ctl02 nova-api[8502]: 2017-09-28 11:54:49.914 8502 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:54:49 ctl02 nova-api[8502]: 2017-09-28 11:54:49.914 8502 ERROR nova     sys.exit(main())
Sep 28 11:54:49 ctl02 nova-api[8502]: 2017-09-28 11:54:49.914 8502 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:54:49 ctl02 nova-api[8502]: 2017-09-28 11:54:49.914 8502 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:54:49 ctl02 nova-api[8502]: 2017-09-28 11:54:49.914 8502 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:54:49 ctl02 nova-api[8502]: 2017-09-28 11:54:49.914 8502 ERROR nova     max_url_len=max_url_len)
Sep 28 11:54:49 ctl02 nova-api[8502]: 2017-09-28 11:54:49.914 8502 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:54:49 ctl02 nova-api[8502]: 2017-09-28 11:54:49.914 8502 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:54:49 ctl02 nova-api[8502]: 2017-09-28 11:54:49.914 8502 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:54:49 ctl02 nova-api[8502]: 2017-09-28 11:54:49.914 8502 ERROR nova     sock.listen(backlog)
Sep 28 11:54:49 ctl02 nova-api[8502]: 2017-09-28 11:54:49.914 8502 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:54:49 ctl02 nova-api[8502]: 2017-09-28 11:54:49.914 8502 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:54:49 ctl02 nova-api[8502]: 2017-09-28 11:54:49.914 8502 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:54:49 ctl02 nova-api[8502]: 2017-09-28 11:54:49.914 8502 ERROR nova
Sep 28 11:54:50 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:54:50 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:54:50 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:54:50 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:54:50 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:54:50 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:54:50 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:54:51 ctl02 nova-api[8520]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:54:51 ctl02 nova-api[8520]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:54:52 ctl02 nova-api[8520]: 2017-09-28 11:54:52.092 8520 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:54:52 ctl02 nova-api[8520]: 2017-09-28 11:54:52.093 8520 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:54:52 ctl02 nova-api[8520]: 2017-09-28 11:54:52.093 8520 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:54:52 ctl02 nova-api[8520]: 2017-09-28 11:54:52.093 8520 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:54:52 ctl02 nova-api[8520]: 2017-09-28 11:54:52.093 8520 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:54:52 ctl02 nova-api[8520]: 2017-09-28 11:54:52.093 8520 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:54:52 ctl02 nova-api[8520]: 2017-09-28 11:54:52.093 8520 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:54:52 ctl02 nova-api[8520]: 2017-09-28 11:54:52.093 8520 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:54:52 ctl02 nova-api[8520]: 2017-09-28 11:54:52.093 8520 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:54:52 ctl02 nova-api[8520]: 2017-09-28 11:54:52.093 8520 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:54:52 ctl02 nova-api[8520]: 2017-09-28 11:54:52.093 8520 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:54:52 ctl02 nova-api[8520]: 2017-09-28 11:54:52.093 8520 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:54:52 ctl02 nova-api[8520]: 2017-09-28 11:54:52.093 8520 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:54:52 ctl02 nova-api[8520]: 2017-09-28 11:54:52.093 8520 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:54:52 ctl02 nova-api[8520]: 2017-09-28 11:54:52.093 8520 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:54:52 ctl02 nova-api[8520]: 2017-09-28 11:54:52.093 8520 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:54:52 ctl02 nova-api[8520]: 2017-09-28 11:54:52.093 8520 ERROR nova.wsgi     self.filename))
Sep 28 11:54:52 ctl02 nova-api[8520]: 2017-09-28 11:54:52.093 8520 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:54:52 ctl02 nova-api[8520]: 2017-09-28 11:54:52.093 8520 ERROR nova.wsgi
Sep 28 11:54:52 ctl02 nova-api[8520]: 2017-09-28 11:54:52.094 8520 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:54:52 ctl02 nova-api[8520]: 2017-09-28 11:54:52.226 8520 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:54:52 ctl02 nova-api[8520]: 2017-09-28 11:54:52.459 8520 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:54:52 ctl02 nova-api[8520]: 2017-09-28 11:54:52.461 8520 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:54:52 ctl02 nova-api[8520]: 2017-09-28 11:54:52.461 8520 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:54:52 ctl02 nova-api[8520]: 2017-09-28 11:54:52.461 8520 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:54:52 ctl02 nova-api[8520]: 2017-09-28 11:54:52.593 8520 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:54:52 ctl02 nova-api[8520]: 2017-09-28 11:54:52.595 8520 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:54:52 ctl02 nova-api[8520]: 2017-09-28 11:54:52.595 8520 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:54:52 ctl02 nova-api[8520]: 2017-09-28 11:54:52.596 8520 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:54:52 ctl02 nova-api[8520]: 2017-09-28 11:54:52.599 8520 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:54:52 ctl02 nova-api[8520]: 2017-09-28 11:54:52.599 8520 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:54:52 ctl02 nova-api[8520]: 2017-09-28 11:54:52.599 8520 ERROR nova Traceback (most recent call last):
Sep 28 11:54:52 ctl02 nova-api[8520]: 2017-09-28 11:54:52.599 8520 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:54:52 ctl02 nova-api[8520]: 2017-09-28 11:54:52.599 8520 ERROR nova     sys.exit(main())
Sep 28 11:54:52 ctl02 nova-api[8520]: 2017-09-28 11:54:52.599 8520 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:54:52 ctl02 nova-api[8520]: 2017-09-28 11:54:52.599 8520 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:54:52 ctl02 nova-api[8520]: 2017-09-28 11:54:52.599 8520 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:54:52 ctl02 nova-api[8520]: 2017-09-28 11:54:52.599 8520 ERROR nova     max_url_len=max_url_len)
Sep 28 11:54:52 ctl02 nova-api[8520]: 2017-09-28 11:54:52.599 8520 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:54:52 ctl02 nova-api[8520]: 2017-09-28 11:54:52.599 8520 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:54:52 ctl02 nova-api[8520]: 2017-09-28 11:54:52.599 8520 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:54:52 ctl02 nova-api[8520]: 2017-09-28 11:54:52.599 8520 ERROR nova     sock.listen(backlog)
Sep 28 11:54:52 ctl02 nova-api[8520]: 2017-09-28 11:54:52.599 8520 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:54:52 ctl02 nova-api[8520]: 2017-09-28 11:54:52.599 8520 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:54:52 ctl02 nova-api[8520]: 2017-09-28 11:54:52.599 8520 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:54:52 ctl02 nova-api[8520]: 2017-09-28 11:54:52.599 8520 ERROR nova
Sep 28 11:54:52 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:54:52 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:54:52 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:54:52 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:54:52 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:54:52 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:54:52 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:54:53 ctl02 nova-consoleauth[5433]: 2017-09-28 11:54:53.167 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:54:53 ctl02 glance-api[29183]: 2017-09-28 11:54:53.357 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:54:53] "OPTIONS / HTTP/1.0" 200 134 0.001011
Sep 28 11:54:54 ctl02 nova-api[8538]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:54:54 ctl02 nova-api[8538]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:54:54 ctl02 nova-api[8538]: 2017-09-28 11:54:54.598 8538 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:54:54 ctl02 nova-api[8538]: 2017-09-28 11:54:54.600 8538 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:54:54 ctl02 nova-api[8538]: 2017-09-28 11:54:54.600 8538 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:54:54 ctl02 nova-api[8538]: 2017-09-28 11:54:54.600 8538 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:54:54 ctl02 nova-api[8538]: 2017-09-28 11:54:54.600 8538 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:54:54 ctl02 nova-api[8538]: 2017-09-28 11:54:54.600 8538 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:54:54 ctl02 nova-api[8538]: 2017-09-28 11:54:54.600 8538 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:54:54 ctl02 nova-api[8538]: 2017-09-28 11:54:54.600 8538 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:54:54 ctl02 nova-api[8538]: 2017-09-28 11:54:54.600 8538 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:54:54 ctl02 nova-api[8538]: 2017-09-28 11:54:54.600 8538 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:54:54 ctl02 nova-api[8538]: 2017-09-28 11:54:54.600 8538 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:54:54 ctl02 nova-api[8538]: 2017-09-28 11:54:54.600 8538 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:54:54 ctl02 nova-api[8538]: 2017-09-28 11:54:54.600 8538 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:54:54 ctl02 nova-api[8538]: 2017-09-28 11:54:54.600 8538 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:54:54 ctl02 nova-api[8538]: 2017-09-28 11:54:54.600 8538 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:54:54 ctl02 nova-api[8538]: 2017-09-28 11:54:54.600 8538 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:54:54 ctl02 nova-api[8538]: 2017-09-28 11:54:54.600 8538 ERROR nova.wsgi     self.filename))
Sep 28 11:54:54 ctl02 nova-api[8538]: 2017-09-28 11:54:54.600 8538 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:54:54 ctl02 nova-api[8538]: 2017-09-28 11:54:54.600 8538 ERROR nova.wsgi
Sep 28 11:54:54 ctl02 nova-api[8538]: 2017-09-28 11:54:54.601 8538 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:54:54 ctl02 nova-api[8538]: 2017-09-28 11:54:54.736 8538 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:54:54 ctl02 nova-api[8538]: 2017-09-28 11:54:54.979 8538 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:54:54 ctl02 nova-api[8538]: 2017-09-28 11:54:54.981 8538 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:54:54 ctl02 nova-api[8538]: 2017-09-28 11:54:54.982 8538 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:54:54 ctl02 nova-api[8538]: 2017-09-28 11:54:54.982 8538 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:54:55 ctl02 nova-api[8538]: 2017-09-28 11:54:55.113 8538 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:54:55 ctl02 nova-api[8538]: 2017-09-28 11:54:55.115 8538 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:54:55 ctl02 nova-api[8538]: 2017-09-28 11:54:55.115 8538 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:54:55 ctl02 nova-api[8538]: 2017-09-28 11:54:55.116 8538 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:54:55 ctl02 nova-api[8538]: 2017-09-28 11:54:55.119 8538 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:54:55 ctl02 nova-api[8538]: 2017-09-28 11:54:55.120 8538 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:54:55 ctl02 nova-api[8538]: 2017-09-28 11:54:55.120 8538 ERROR nova Traceback (most recent call last):
Sep 28 11:54:55 ctl02 nova-api[8538]: 2017-09-28 11:54:55.120 8538 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:54:55 ctl02 nova-api[8538]: 2017-09-28 11:54:55.120 8538 ERROR nova     sys.exit(main())
Sep 28 11:54:55 ctl02 nova-api[8538]: 2017-09-28 11:54:55.120 8538 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:54:55 ctl02 nova-api[8538]: 2017-09-28 11:54:55.120 8538 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:54:55 ctl02 nova-api[8538]: 2017-09-28 11:54:55.120 8538 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:54:55 ctl02 nova-api[8538]: 2017-09-28 11:54:55.120 8538 ERROR nova     max_url_len=max_url_len)
Sep 28 11:54:55 ctl02 nova-api[8538]: 2017-09-28 11:54:55.120 8538 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:54:55 ctl02 nova-api[8538]: 2017-09-28 11:54:55.120 8538 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:54:55 ctl02 nova-api[8538]: 2017-09-28 11:54:55.120 8538 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:54:55 ctl02 nova-api[8538]: 2017-09-28 11:54:55.120 8538 ERROR nova     sock.listen(backlog)
Sep 28 11:54:55 ctl02 nova-api[8538]: 2017-09-28 11:54:55.120 8538 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:54:55 ctl02 nova-api[8538]: 2017-09-28 11:54:55.120 8538 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:54:55 ctl02 nova-api[8538]: 2017-09-28 11:54:55.120 8538 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:54:55 ctl02 nova-api[8538]: 2017-09-28 11:54:55.120 8538 ERROR nova
Sep 28 11:54:55 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:54:55 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:54:55 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:54:55 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:54:55 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:54:55 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:54:55 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:54:56 ctl02 nova-scheduler[5620]: 2017-09-28 11:54:56.190 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:54:56 ctl02 nova-api[8556]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:54:56 ctl02 nova-api[8556]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:54:57 ctl02 nova-api[8556]: 2017-09-28 11:54:57.099 8556 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:54:57 ctl02 nova-api[8556]: 2017-09-28 11:54:57.100 8556 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:54:57 ctl02 nova-api[8556]: 2017-09-28 11:54:57.100 8556 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:54:57 ctl02 nova-api[8556]: 2017-09-28 11:54:57.100 8556 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:54:57 ctl02 nova-api[8556]: 2017-09-28 11:54:57.100 8556 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:54:57 ctl02 nova-api[8556]: 2017-09-28 11:54:57.100 8556 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:54:57 ctl02 nova-api[8556]: 2017-09-28 11:54:57.100 8556 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:54:57 ctl02 nova-api[8556]: 2017-09-28 11:54:57.100 8556 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:54:57 ctl02 nova-api[8556]: 2017-09-28 11:54:57.100 8556 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:54:57 ctl02 nova-api[8556]: 2017-09-28 11:54:57.100 8556 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:54:57 ctl02 nova-api[8556]: 2017-09-28 11:54:57.100 8556 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:54:57 ctl02 nova-api[8556]: 2017-09-28 11:54:57.100 8556 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:54:57 ctl02 nova-api[8556]: 2017-09-28 11:54:57.100 8556 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:54:57 ctl02 nova-api[8556]: 2017-09-28 11:54:57.100 8556 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:54:57 ctl02 nova-api[8556]: 2017-09-28 11:54:57.100 8556 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:54:57 ctl02 nova-api[8556]: 2017-09-28 11:54:57.100 8556 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:54:57 ctl02 nova-api[8556]: 2017-09-28 11:54:57.100 8556 ERROR nova.wsgi     self.filename))
Sep 28 11:54:57 ctl02 nova-api[8556]: 2017-09-28 11:54:57.100 8556 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:54:57 ctl02 nova-api[8556]: 2017-09-28 11:54:57.100 8556 ERROR nova.wsgi
Sep 28 11:54:57 ctl02 nova-api[8556]: 2017-09-28 11:54:57.101 8556 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:54:57 ctl02 nova-api[8556]: 2017-09-28 11:54:57.234 8556 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:54:57 ctl02 glance-api[29183]: 2017-09-28 11:54:57.282 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:54:57] "OPTIONS / HTTP/1.0" 200 134 0.000637
Sep 28 11:54:57 ctl02 nova-api[8556]: 2017-09-28 11:54:57.475 8556 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:54:57 ctl02 nova-api[8556]: 2017-09-28 11:54:57.477 8556 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:54:57 ctl02 nova-api[8556]: 2017-09-28 11:54:57.478 8556 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:54:57 ctl02 nova-api[8556]: 2017-09-28 11:54:57.478 8556 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:54:57 ctl02 nova-api[8556]: 2017-09-28 11:54:57.607 8556 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:54:57 ctl02 nova-api[8556]: 2017-09-28 11:54:57.610 8556 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:54:57 ctl02 nova-api[8556]: 2017-09-28 11:54:57.610 8556 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:54:57 ctl02 nova-api[8556]: 2017-09-28 11:54:57.610 8556 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:54:57 ctl02 nova-api[8556]: 2017-09-28 11:54:57.613 8556 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:54:57 ctl02 nova-api[8556]: 2017-09-28 11:54:57.614 8556 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:54:57 ctl02 nova-api[8556]: 2017-09-28 11:54:57.614 8556 ERROR nova Traceback (most recent call last):
Sep 28 11:54:57 ctl02 nova-api[8556]: 2017-09-28 11:54:57.614 8556 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:54:57 ctl02 nova-api[8556]: 2017-09-28 11:54:57.614 8556 ERROR nova     sys.exit(main())
Sep 28 11:54:57 ctl02 nova-api[8556]: 2017-09-28 11:54:57.614 8556 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:54:57 ctl02 nova-api[8556]: 2017-09-28 11:54:57.614 8556 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:54:57 ctl02 nova-api[8556]: 2017-09-28 11:54:57.614 8556 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:54:57 ctl02 nova-api[8556]: 2017-09-28 11:54:57.614 8556 ERROR nova     max_url_len=max_url_len)
Sep 28 11:54:57 ctl02 nova-api[8556]: 2017-09-28 11:54:57.614 8556 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:54:57 ctl02 nova-api[8556]: 2017-09-28 11:54:57.614 8556 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:54:57 ctl02 nova-api[8556]: 2017-09-28 11:54:57.614 8556 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:54:57 ctl02 nova-api[8556]: 2017-09-28 11:54:57.614 8556 ERROR nova     sock.listen(backlog)
Sep 28 11:54:57 ctl02 nova-api[8556]: 2017-09-28 11:54:57.614 8556 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:54:57 ctl02 nova-api[8556]: 2017-09-28 11:54:57.614 8556 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:54:57 ctl02 nova-api[8556]: 2017-09-28 11:54:57.614 8556 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:54:57 ctl02 nova-api[8556]: 2017-09-28 11:54:57.614 8556 ERROR nova
Sep 28 11:54:57 ctl02 glance-api[29183]: 2017-09-28 11:54:57.655 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:54:57] "OPTIONS / HTTP/1.0" 200 134 0.000660
Sep 28 11:54:57 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:54:57 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:54:57 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:54:57 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:54:57 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:54:57 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:54:57 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:54:59 ctl02 nova-api[8574]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:54:59 ctl02 nova-api[8574]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:54:59 ctl02 nova-api[8574]: 2017-09-28 11:54:59.589 8574 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:54:59 ctl02 nova-api[8574]: 2017-09-28 11:54:59.598 8574 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:54:59 ctl02 nova-api[8574]: 2017-09-28 11:54:59.598 8574 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:54:59 ctl02 nova-api[8574]: 2017-09-28 11:54:59.598 8574 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:54:59 ctl02 nova-api[8574]: 2017-09-28 11:54:59.598 8574 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:54:59 ctl02 nova-api[8574]: 2017-09-28 11:54:59.598 8574 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:54:59 ctl02 nova-api[8574]: 2017-09-28 11:54:59.598 8574 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:54:59 ctl02 nova-api[8574]: 2017-09-28 11:54:59.598 8574 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:54:59 ctl02 nova-api[8574]: 2017-09-28 11:54:59.598 8574 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:54:59 ctl02 nova-api[8574]: 2017-09-28 11:54:59.598 8574 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:54:59 ctl02 nova-api[8574]: 2017-09-28 11:54:59.598 8574 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:54:59 ctl02 nova-api[8574]: 2017-09-28 11:54:59.598 8574 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:54:59 ctl02 nova-api[8574]: 2017-09-28 11:54:59.598 8574 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:54:59 ctl02 nova-api[8574]: 2017-09-28 11:54:59.598 8574 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:54:59 ctl02 nova-api[8574]: 2017-09-28 11:54:59.598 8574 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:54:59 ctl02 nova-api[8574]: 2017-09-28 11:54:59.598 8574 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:54:59 ctl02 nova-api[8574]: 2017-09-28 11:54:59.598 8574 ERROR nova.wsgi     self.filename))
Sep 28 11:54:59 ctl02 nova-api[8574]: 2017-09-28 11:54:59.598 8574 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:54:59 ctl02 nova-api[8574]: 2017-09-28 11:54:59.598 8574 ERROR nova.wsgi
Sep 28 11:54:59 ctl02 nova-api[8574]: 2017-09-28 11:54:59.599 8574 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:54:59 ctl02 nova-api[8574]: 2017-09-28 11:54:59.730 8574 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:54:59 ctl02 nova-api[8574]: 2017-09-28 11:54:59.968 8574 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:54:59 ctl02 nova-api[8574]: 2017-09-28 11:54:59.970 8574 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:54:59 ctl02 nova-api[8574]: 2017-09-28 11:54:59.971 8574 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:54:59 ctl02 nova-api[8574]: 2017-09-28 11:54:59.971 8574 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:55:00 ctl02 nova-api[8574]: 2017-09-28 11:55:00.104 8574 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:55:00 ctl02 nova-api[8574]: 2017-09-28 11:55:00.106 8574 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:55:00 ctl02 nova-api[8574]: 2017-09-28 11:55:00.106 8574 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:55:00 ctl02 nova-api[8574]: 2017-09-28 11:55:00.107 8574 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:55:00 ctl02 nova-api[8574]: 2017-09-28 11:55:00.110 8574 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:55:00 ctl02 nova-api[8574]: 2017-09-28 11:55:00.110 8574 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:55:00 ctl02 nova-api[8574]: 2017-09-28 11:55:00.110 8574 ERROR nova Traceback (most recent call last):
Sep 28 11:55:00 ctl02 nova-api[8574]: 2017-09-28 11:55:00.110 8574 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:55:00 ctl02 nova-api[8574]: 2017-09-28 11:55:00.110 8574 ERROR nova     sys.exit(main())
Sep 28 11:55:00 ctl02 nova-api[8574]: 2017-09-28 11:55:00.110 8574 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:55:00 ctl02 nova-api[8574]: 2017-09-28 11:55:00.110 8574 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:55:00 ctl02 nova-api[8574]: 2017-09-28 11:55:00.110 8574 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:55:00 ctl02 nova-api[8574]: 2017-09-28 11:55:00.110 8574 ERROR nova     max_url_len=max_url_len)
Sep 28 11:55:00 ctl02 nova-api[8574]: 2017-09-28 11:55:00.110 8574 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:55:00 ctl02 nova-api[8574]: 2017-09-28 11:55:00.110 8574 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:55:00 ctl02 nova-api[8574]: 2017-09-28 11:55:00.110 8574 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:55:00 ctl02 nova-api[8574]: 2017-09-28 11:55:00.110 8574 ERROR nova     sock.listen(backlog)
Sep 28 11:55:00 ctl02 nova-api[8574]: 2017-09-28 11:55:00.110 8574 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:55:00 ctl02 nova-api[8574]: 2017-09-28 11:55:00.110 8574 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:55:00 ctl02 nova-api[8574]: 2017-09-28 11:55:00.110 8574 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:55:00 ctl02 nova-api[8574]: 2017-09-28 11:55:00.110 8574 ERROR nova
Sep 28 11:55:00 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:55:00 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:55:00 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:55:00 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:55:00 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:55:00 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:55:00 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:55:01 ctl02 nova-api[8592]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:55:01 ctl02 nova-api[8592]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:55:02 ctl02 nova-api[8592]: 2017-09-28 11:55:02.090 8592 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:55:02 ctl02 nova-api[8592]: 2017-09-28 11:55:02.091 8592 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:55:02 ctl02 nova-api[8592]: 2017-09-28 11:55:02.091 8592 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:55:02 ctl02 nova-api[8592]: 2017-09-28 11:55:02.091 8592 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:55:02 ctl02 nova-api[8592]: 2017-09-28 11:55:02.091 8592 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:55:02 ctl02 nova-api[8592]: 2017-09-28 11:55:02.091 8592 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:55:02 ctl02 nova-api[8592]: 2017-09-28 11:55:02.091 8592 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:55:02 ctl02 nova-api[8592]: 2017-09-28 11:55:02.091 8592 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:55:02 ctl02 nova-api[8592]: 2017-09-28 11:55:02.091 8592 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:55:02 ctl02 nova-api[8592]: 2017-09-28 11:55:02.091 8592 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:55:02 ctl02 nova-api[8592]: 2017-09-28 11:55:02.091 8592 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:55:02 ctl02 nova-api[8592]: 2017-09-28 11:55:02.091 8592 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:55:02 ctl02 nova-api[8592]: 2017-09-28 11:55:02.091 8592 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:55:02 ctl02 nova-api[8592]: 2017-09-28 11:55:02.091 8592 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:55:02 ctl02 nova-api[8592]: 2017-09-28 11:55:02.091 8592 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:55:02 ctl02 nova-api[8592]: 2017-09-28 11:55:02.091 8592 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:55:02 ctl02 nova-api[8592]: 2017-09-28 11:55:02.091 8592 ERROR nova.wsgi     self.filename))
Sep 28 11:55:02 ctl02 nova-api[8592]: 2017-09-28 11:55:02.091 8592 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:55:02 ctl02 nova-api[8592]: 2017-09-28 11:55:02.091 8592 ERROR nova.wsgi
Sep 28 11:55:02 ctl02 nova-api[8592]: 2017-09-28 11:55:02.092 8592 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:55:02 ctl02 nova-api[8592]: 2017-09-28 11:55:02.223 8592 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:55:02 ctl02 nova-api[8592]: 2017-09-28 11:55:02.467 8592 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:55:02 ctl02 nova-api[8592]: 2017-09-28 11:55:02.469 8592 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:55:02 ctl02 nova-api[8592]: 2017-09-28 11:55:02.469 8592 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:55:02 ctl02 nova-api[8592]: 2017-09-28 11:55:02.470 8592 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:55:02 ctl02 nova-api[8592]: 2017-09-28 11:55:02.600 8592 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:55:02 ctl02 nova-api[8592]: 2017-09-28 11:55:02.601 8592 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:55:02 ctl02 nova-api[8592]: 2017-09-28 11:55:02.602 8592 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:55:02 ctl02 nova-api[8592]: 2017-09-28 11:55:02.602 8592 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:55:02 ctl02 nova-api[8592]: 2017-09-28 11:55:02.605 8592 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:55:02 ctl02 nova-api[8592]: 2017-09-28 11:55:02.606 8592 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:55:02 ctl02 nova-api[8592]: 2017-09-28 11:55:02.606 8592 ERROR nova Traceback (most recent call last):
Sep 28 11:55:02 ctl02 nova-api[8592]: 2017-09-28 11:55:02.606 8592 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:55:02 ctl02 nova-api[8592]: 2017-09-28 11:55:02.606 8592 ERROR nova     sys.exit(main())
Sep 28 11:55:02 ctl02 nova-api[8592]: 2017-09-28 11:55:02.606 8592 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:55:02 ctl02 nova-api[8592]: 2017-09-28 11:55:02.606 8592 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:55:02 ctl02 nova-api[8592]: 2017-09-28 11:55:02.606 8592 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:55:02 ctl02 nova-api[8592]: 2017-09-28 11:55:02.606 8592 ERROR nova     max_url_len=max_url_len)
Sep 28 11:55:02 ctl02 nova-api[8592]: 2017-09-28 11:55:02.606 8592 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:55:02 ctl02 nova-api[8592]: 2017-09-28 11:55:02.606 8592 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:55:02 ctl02 nova-api[8592]: 2017-09-28 11:55:02.606 8592 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:55:02 ctl02 nova-api[8592]: 2017-09-28 11:55:02.606 8592 ERROR nova     sock.listen(backlog)
Sep 28 11:55:02 ctl02 nova-api[8592]: 2017-09-28 11:55:02.606 8592 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:55:02 ctl02 nova-api[8592]: 2017-09-28 11:55:02.606 8592 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:55:02 ctl02 nova-api[8592]: 2017-09-28 11:55:02.606 8592 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:55:02 ctl02 nova-api[8592]: 2017-09-28 11:55:02.606 8592 ERROR nova
Sep 28 11:55:02 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:55:02 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:55:02 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:55:02 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:55:02 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:55:02 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:55:02 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:55:03 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9fcf2221)
Sep 28 11:55:03 ctl02 glance-api[29183]: 2017-09-28 11:55:03.655 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:55:03] "OPTIONS / HTTP/1.0" 200 134 0.000726
Sep 28 11:55:04 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9fcf2221)
Sep 28 11:55:04 ctl02 nova-api[8609]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:55:04 ctl02 nova-api[8609]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:55:04 ctl02 nova-api[8609]: 2017-09-28 11:55:04.577 8609 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:55:04 ctl02 nova-api[8609]: 2017-09-28 11:55:04.578 8609 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:55:04 ctl02 nova-api[8609]: 2017-09-28 11:55:04.578 8609 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:55:04 ctl02 nova-api[8609]: 2017-09-28 11:55:04.578 8609 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:55:04 ctl02 nova-api[8609]: 2017-09-28 11:55:04.578 8609 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:55:04 ctl02 nova-api[8609]: 2017-09-28 11:55:04.578 8609 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:55:04 ctl02 nova-api[8609]: 2017-09-28 11:55:04.578 8609 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:55:04 ctl02 nova-api[8609]: 2017-09-28 11:55:04.578 8609 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:55:04 ctl02 nova-api[8609]: 2017-09-28 11:55:04.578 8609 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:55:04 ctl02 nova-api[8609]: 2017-09-28 11:55:04.578 8609 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:55:04 ctl02 nova-api[8609]: 2017-09-28 11:55:04.578 8609 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:55:04 ctl02 nova-api[8609]: 2017-09-28 11:55:04.578 8609 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:55:04 ctl02 nova-api[8609]: 2017-09-28 11:55:04.578 8609 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:55:04 ctl02 nova-api[8609]: 2017-09-28 11:55:04.578 8609 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:55:04 ctl02 nova-api[8609]: 2017-09-28 11:55:04.578 8609 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:55:04 ctl02 nova-api[8609]: 2017-09-28 11:55:04.578 8609 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:55:04 ctl02 nova-api[8609]: 2017-09-28 11:55:04.578 8609 ERROR nova.wsgi     self.filename))
Sep 28 11:55:04 ctl02 nova-api[8609]: 2017-09-28 11:55:04.578 8609 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:55:04 ctl02 nova-api[8609]: 2017-09-28 11:55:04.578 8609 ERROR nova.wsgi
Sep 28 11:55:04 ctl02 nova-api[8609]: 2017-09-28 11:55:04.579 8609 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:55:04 ctl02 nova-api[8609]: 2017-09-28 11:55:04.708 8609 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:55:04 ctl02 nova-api[8609]: 2017-09-28 11:55:04.947 8609 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:55:04 ctl02 nova-api[8609]: 2017-09-28 11:55:04.949 8609 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:55:04 ctl02 nova-api[8609]: 2017-09-28 11:55:04.949 8609 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:55:04 ctl02 nova-api[8609]: 2017-09-28 11:55:04.950 8609 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:55:05 ctl02 nova-api[8609]: 2017-09-28 11:55:05.079 8609 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:55:05 ctl02 nova-api[8609]: 2017-09-28 11:55:05.081 8609 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:55:05 ctl02 nova-api[8609]: 2017-09-28 11:55:05.081 8609 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:55:05 ctl02 nova-api[8609]: 2017-09-28 11:55:05.081 8609 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:55:05 ctl02 nova-api[8609]: 2017-09-28 11:55:05.084 8609 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:55:05 ctl02 nova-api[8609]: 2017-09-28 11:55:05.085 8609 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:55:05 ctl02 nova-api[8609]: 2017-09-28 11:55:05.085 8609 ERROR nova Traceback (most recent call last):
Sep 28 11:55:05 ctl02 nova-api[8609]: 2017-09-28 11:55:05.085 8609 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:55:05 ctl02 nova-api[8609]: 2017-09-28 11:55:05.085 8609 ERROR nova     sys.exit(main())
Sep 28 11:55:05 ctl02 nova-api[8609]: 2017-09-28 11:55:05.085 8609 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:55:05 ctl02 nova-api[8609]: 2017-09-28 11:55:05.085 8609 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:55:05 ctl02 nova-api[8609]: 2017-09-28 11:55:05.085 8609 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:55:05 ctl02 nova-api[8609]: 2017-09-28 11:55:05.085 8609 ERROR nova     max_url_len=max_url_len)
Sep 28 11:55:05 ctl02 nova-api[8609]: 2017-09-28 11:55:05.085 8609 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:55:05 ctl02 nova-api[8609]: 2017-09-28 11:55:05.085 8609 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:55:05 ctl02 nova-api[8609]: 2017-09-28 11:55:05.085 8609 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:55:05 ctl02 nova-api[8609]: 2017-09-28 11:55:05.085 8609 ERROR nova     sock.listen(backlog)
Sep 28 11:55:05 ctl02 nova-api[8609]: 2017-09-28 11:55:05.085 8609 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:55:05 ctl02 nova-api[8609]: 2017-09-28 11:55:05.085 8609 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:55:05 ctl02 nova-api[8609]: 2017-09-28 11:55:05.085 8609 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:55:05 ctl02 nova-api[8609]: 2017-09-28 11:55:05.085 8609 ERROR nova
Sep 28 11:55:05 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9fcf2221)
Sep 28 11:55:05 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:55:05 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:55:05 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:55:05 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:55:05 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:55:05 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:55:05 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:55:06 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9fcf2221)
Sep 28 11:55:06 ctl02 nova-api[8627]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:55:06 ctl02 nova-api[8627]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:55:07 ctl02 nova-api[8627]: 2017-09-28 11:55:07.119 8627 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:55:07 ctl02 nova-api[8627]: 2017-09-28 11:55:07.121 8627 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:55:07 ctl02 nova-api[8627]: 2017-09-28 11:55:07.121 8627 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:55:07 ctl02 nova-api[8627]: 2017-09-28 11:55:07.121 8627 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:55:07 ctl02 nova-api[8627]: 2017-09-28 11:55:07.121 8627 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:55:07 ctl02 nova-api[8627]: 2017-09-28 11:55:07.121 8627 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:55:07 ctl02 nova-api[8627]: 2017-09-28 11:55:07.121 8627 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:55:07 ctl02 nova-api[8627]: 2017-09-28 11:55:07.121 8627 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:55:07 ctl02 nova-api[8627]: 2017-09-28 11:55:07.121 8627 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:55:07 ctl02 nova-api[8627]: 2017-09-28 11:55:07.121 8627 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:55:07 ctl02 nova-api[8627]: 2017-09-28 11:55:07.121 8627 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:55:07 ctl02 nova-api[8627]: 2017-09-28 11:55:07.121 8627 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:55:07 ctl02 nova-api[8627]: 2017-09-28 11:55:07.121 8627 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:55:07 ctl02 nova-api[8627]: 2017-09-28 11:55:07.121 8627 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:55:07 ctl02 nova-api[8627]: 2017-09-28 11:55:07.121 8627 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:55:07 ctl02 nova-api[8627]: 2017-09-28 11:55:07.121 8627 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:55:07 ctl02 nova-api[8627]: 2017-09-28 11:55:07.121 8627 ERROR nova.wsgi     self.filename))
Sep 28 11:55:07 ctl02 nova-api[8627]: 2017-09-28 11:55:07.121 8627 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:55:07 ctl02 nova-api[8627]: 2017-09-28 11:55:07.121 8627 ERROR nova.wsgi
Sep 28 11:55:07 ctl02 nova-api[8627]: 2017-09-28 11:55:07.123 8627 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:55:07 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9fcf2221)
Sep 28 11:55:07 ctl02 nova-api[8627]: 2017-09-28 11:55:07.257 8627 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:55:07 ctl02 glance-api[29183]: 2017-09-28 11:55:07.384 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:55:07] "OPTIONS / HTTP/1.0" 200 134 0.000575
Sep 28 11:55:07 ctl02 nova-api[8627]: 2017-09-28 11:55:07.508 8627 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:55:07 ctl02 nova-api[8627]: 2017-09-28 11:55:07.510 8627 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:55:07 ctl02 nova-api[8627]: 2017-09-28 11:55:07.510 8627 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:55:07 ctl02 nova-api[8627]: 2017-09-28 11:55:07.511 8627 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:55:07 ctl02 nova-api[8627]: 2017-09-28 11:55:07.642 8627 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:55:07 ctl02 nova-api[8627]: 2017-09-28 11:55:07.644 8627 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:55:07 ctl02 nova-api[8627]: 2017-09-28 11:55:07.644 8627 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:55:07 ctl02 nova-api[8627]: 2017-09-28 11:55:07.644 8627 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:55:07 ctl02 nova-api[8627]: 2017-09-28 11:55:07.648 8627 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:55:07 ctl02 nova-api[8627]: 2017-09-28 11:55:07.648 8627 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:55:07 ctl02 nova-api[8627]: 2017-09-28 11:55:07.648 8627 ERROR nova Traceback (most recent call last):
Sep 28 11:55:07 ctl02 nova-api[8627]: 2017-09-28 11:55:07.648 8627 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:55:07 ctl02 nova-api[8627]: 2017-09-28 11:55:07.648 8627 ERROR nova     sys.exit(main())
Sep 28 11:55:07 ctl02 nova-api[8627]: 2017-09-28 11:55:07.648 8627 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:55:07 ctl02 nova-api[8627]: 2017-09-28 11:55:07.648 8627 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:55:07 ctl02 nova-api[8627]: 2017-09-28 11:55:07.648 8627 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:55:07 ctl02 nova-api[8627]: 2017-09-28 11:55:07.648 8627 ERROR nova     max_url_len=max_url_len)
Sep 28 11:55:07 ctl02 nova-api[8627]: 2017-09-28 11:55:07.648 8627 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:55:07 ctl02 nova-api[8627]: 2017-09-28 11:55:07.648 8627 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:55:07 ctl02 nova-api[8627]: 2017-09-28 11:55:07.648 8627 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:55:07 ctl02 nova-api[8627]: 2017-09-28 11:55:07.648 8627 ERROR nova     sock.listen(backlog)
Sep 28 11:55:07 ctl02 nova-api[8627]: 2017-09-28 11:55:07.648 8627 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:55:07 ctl02 nova-api[8627]: 2017-09-28 11:55:07.648 8627 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:55:07 ctl02 nova-api[8627]: 2017-09-28 11:55:07.648 8627 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:55:07 ctl02 nova-api[8627]: 2017-09-28 11:55:07.648 8627 ERROR nova
Sep 28 11:55:07 ctl02 glance-api[29183]: 2017-09-28 11:55:07.775 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:55:07] "OPTIONS / HTTP/1.0" 200 134 0.000799
Sep 28 11:55:07 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:55:07 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:55:07 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:55:08 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:55:08 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:55:08 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:55:08 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:55:08 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9fcf2221)
Sep 28 11:55:09 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9fcf2221)
Sep 28 11:55:09 ctl02 nova-api[8646]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:55:09 ctl02 nova-api[8646]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:55:09 ctl02 nova-api[8646]: 2017-09-28 11:55:09.848 8646 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:55:09 ctl02 nova-api[8646]: 2017-09-28 11:55:09.850 8646 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:55:09 ctl02 nova-api[8646]: 2017-09-28 11:55:09.850 8646 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:55:09 ctl02 nova-api[8646]: 2017-09-28 11:55:09.850 8646 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:55:09 ctl02 nova-api[8646]: 2017-09-28 11:55:09.850 8646 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:55:09 ctl02 nova-api[8646]: 2017-09-28 11:55:09.850 8646 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:55:09 ctl02 nova-api[8646]: 2017-09-28 11:55:09.850 8646 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:55:09 ctl02 nova-api[8646]: 2017-09-28 11:55:09.850 8646 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:55:09 ctl02 nova-api[8646]: 2017-09-28 11:55:09.850 8646 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:55:09 ctl02 nova-api[8646]: 2017-09-28 11:55:09.850 8646 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:55:09 ctl02 nova-api[8646]: 2017-09-28 11:55:09.850 8646 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:55:09 ctl02 nova-api[8646]: 2017-09-28 11:55:09.850 8646 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:55:09 ctl02 nova-api[8646]: 2017-09-28 11:55:09.850 8646 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:55:09 ctl02 nova-api[8646]: 2017-09-28 11:55:09.850 8646 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:55:09 ctl02 nova-api[8646]: 2017-09-28 11:55:09.850 8646 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:55:09 ctl02 nova-api[8646]: 2017-09-28 11:55:09.850 8646 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:55:09 ctl02 nova-api[8646]: 2017-09-28 11:55:09.850 8646 ERROR nova.wsgi     self.filename))
Sep 28 11:55:09 ctl02 nova-api[8646]: 2017-09-28 11:55:09.850 8646 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:55:09 ctl02 nova-api[8646]: 2017-09-28 11:55:09.850 8646 ERROR nova.wsgi
Sep 28 11:55:09 ctl02 nova-api[8646]: 2017-09-28 11:55:09.851 8646 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:55:09 ctl02 nova-api[8646]: 2017-09-28 11:55:09.983 8646 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:55:10 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9fcf2221)
Sep 28 11:55:10 ctl02 nova-api[8646]: 2017-09-28 11:55:10.225 8646 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:55:10 ctl02 nova-api[8646]: 2017-09-28 11:55:10.228 8646 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:55:10 ctl02 nova-api[8646]: 2017-09-28 11:55:10.228 8646 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:55:10 ctl02 nova-api[8646]: 2017-09-28 11:55:10.229 8646 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:55:10 ctl02 nova-api[8646]: 2017-09-28 11:55:10.360 8646 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:55:10 ctl02 nova-api[8646]: 2017-09-28 11:55:10.362 8646 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:55:10 ctl02 nova-api[8646]: 2017-09-28 11:55:10.363 8646 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:55:10 ctl02 nova-api[8646]: 2017-09-28 11:55:10.363 8646 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:55:10 ctl02 nova-api[8646]: 2017-09-28 11:55:10.367 8646 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:55:10 ctl02 nova-api[8646]: 2017-09-28 11:55:10.367 8646 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:55:10 ctl02 nova-api[8646]: 2017-09-28 11:55:10.367 8646 ERROR nova Traceback (most recent call last):
Sep 28 11:55:10 ctl02 nova-api[8646]: 2017-09-28 11:55:10.367 8646 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:55:10 ctl02 nova-api[8646]: 2017-09-28 11:55:10.367 8646 ERROR nova     sys.exit(main())
Sep 28 11:55:10 ctl02 nova-api[8646]: 2017-09-28 11:55:10.367 8646 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:55:10 ctl02 nova-api[8646]: 2017-09-28 11:55:10.367 8646 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:55:10 ctl02 nova-api[8646]: 2017-09-28 11:55:10.367 8646 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:55:10 ctl02 nova-api[8646]: 2017-09-28 11:55:10.367 8646 ERROR nova     max_url_len=max_url_len)
Sep 28 11:55:10 ctl02 nova-api[8646]: 2017-09-28 11:55:10.367 8646 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:55:10 ctl02 nova-api[8646]: 2017-09-28 11:55:10.367 8646 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:55:10 ctl02 nova-api[8646]: 2017-09-28 11:55:10.367 8646 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:55:10 ctl02 nova-api[8646]: 2017-09-28 11:55:10.367 8646 ERROR nova     sock.listen(backlog)
Sep 28 11:55:10 ctl02 nova-api[8646]: 2017-09-28 11:55:10.367 8646 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:55:10 ctl02 nova-api[8646]: 2017-09-28 11:55:10.367 8646 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:55:10 ctl02 nova-api[8646]: 2017-09-28 11:55:10.367 8646 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:55:10 ctl02 nova-api[8646]: 2017-09-28 11:55:10.367 8646 ERROR nova
Sep 28 11:55:10 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:55:10 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:55:10 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:55:10 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:55:10 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:55:10 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:55:10 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:55:11 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9fcf2221)
Sep 28 11:55:12 ctl02 nova-api[8663]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:55:12 ctl02 nova-api[8663]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:55:12 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9fcf2221)
Sep 28 11:55:12 ctl02 nova-api[8663]: 2017-09-28 11:55:12.350 8663 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:55:12 ctl02 nova-api[8663]: 2017-09-28 11:55:12.352 8663 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:55:12 ctl02 nova-api[8663]: 2017-09-28 11:55:12.352 8663 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:55:12 ctl02 nova-api[8663]: 2017-09-28 11:55:12.352 8663 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:55:12 ctl02 nova-api[8663]: 2017-09-28 11:55:12.352 8663 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:55:12 ctl02 nova-api[8663]: 2017-09-28 11:55:12.352 8663 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:55:12 ctl02 nova-api[8663]: 2017-09-28 11:55:12.352 8663 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:55:12 ctl02 nova-api[8663]: 2017-09-28 11:55:12.352 8663 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:55:12 ctl02 nova-api[8663]: 2017-09-28 11:55:12.352 8663 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:55:12 ctl02 nova-api[8663]: 2017-09-28 11:55:12.352 8663 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:55:12 ctl02 nova-api[8663]: 2017-09-28 11:55:12.352 8663 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:55:12 ctl02 nova-api[8663]: 2017-09-28 11:55:12.352 8663 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:55:12 ctl02 nova-api[8663]: 2017-09-28 11:55:12.352 8663 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:55:12 ctl02 nova-api[8663]: 2017-09-28 11:55:12.352 8663 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:55:12 ctl02 nova-api[8663]: 2017-09-28 11:55:12.352 8663 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:55:12 ctl02 nova-api[8663]: 2017-09-28 11:55:12.352 8663 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:55:12 ctl02 nova-api[8663]: 2017-09-28 11:55:12.352 8663 ERROR nova.wsgi     self.filename))
Sep 28 11:55:12 ctl02 nova-api[8663]: 2017-09-28 11:55:12.352 8663 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:55:12 ctl02 nova-api[8663]: 2017-09-28 11:55:12.352 8663 ERROR nova.wsgi
Sep 28 11:55:12 ctl02 nova-api[8663]: 2017-09-28 11:55:12.353 8663 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:55:12 ctl02 nova-api[8663]: 2017-09-28 11:55:12.488 8663 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:55:12 ctl02 nova-api[8663]: 2017-09-28 11:55:12.732 8663 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:55:12 ctl02 nova-api[8663]: 2017-09-28 11:55:12.734 8663 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:55:12 ctl02 nova-api[8663]: 2017-09-28 11:55:12.734 8663 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:55:12 ctl02 nova-api[8663]: 2017-09-28 11:55:12.734 8663 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:55:12 ctl02 nova-api[8663]: 2017-09-28 11:55:12.867 8663 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:55:12 ctl02 nova-api[8663]: 2017-09-28 11:55:12.869 8663 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:55:12 ctl02 nova-api[8663]: 2017-09-28 11:55:12.869 8663 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:55:12 ctl02 nova-api[8663]: 2017-09-28 11:55:12.869 8663 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:55:12 ctl02 nova-api[8663]: 2017-09-28 11:55:12.873 8663 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:55:12 ctl02 nova-api[8663]: 2017-09-28 11:55:12.873 8663 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:55:12 ctl02 nova-api[8663]: 2017-09-28 11:55:12.873 8663 ERROR nova Traceback (most recent call last):
Sep 28 11:55:12 ctl02 nova-api[8663]: 2017-09-28 11:55:12.873 8663 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:55:12 ctl02 nova-api[8663]: 2017-09-28 11:55:12.873 8663 ERROR nova     sys.exit(main())
Sep 28 11:55:12 ctl02 nova-api[8663]: 2017-09-28 11:55:12.873 8663 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:55:12 ctl02 nova-api[8663]: 2017-09-28 11:55:12.873 8663 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:55:12 ctl02 nova-api[8663]: 2017-09-28 11:55:12.873 8663 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:55:12 ctl02 nova-api[8663]: 2017-09-28 11:55:12.873 8663 ERROR nova     max_url_len=max_url_len)
Sep 28 11:55:12 ctl02 nova-api[8663]: 2017-09-28 11:55:12.873 8663 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:55:12 ctl02 nova-api[8663]: 2017-09-28 11:55:12.873 8663 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:55:12 ctl02 nova-api[8663]: 2017-09-28 11:55:12.873 8663 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:55:12 ctl02 nova-api[8663]: 2017-09-28 11:55:12.873 8663 ERROR nova     sock.listen(backlog)
Sep 28 11:55:12 ctl02 nova-api[8663]: 2017-09-28 11:55:12.873 8663 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:55:12 ctl02 nova-api[8663]: 2017-09-28 11:55:12.873 8663 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:55:12 ctl02 nova-api[8663]: 2017-09-28 11:55:12.873 8663 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:55:12 ctl02 nova-api[8663]: 2017-09-28 11:55:12.873 8663 ERROR nova
Sep 28 11:55:13 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:55:13 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:55:13 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:55:13 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9fcf2221)
Sep 28 11:55:13 ctl02 glance-api[29183]: 2017-09-28 11:55:13.376 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:55:13] "OPTIONS / HTTP/1.0" 200 134 0.000871
Sep 28 11:55:13 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:55:13 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:55:13 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:55:13 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:55:14 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:55:14 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:55:14 ctl02 nova-api[8682]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:55:14 ctl02 nova-api[8682]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:55:15 ctl02 nova-api[8682]: 2017-09-28 11:55:15.114 8682 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:55:15 ctl02 nova-api[8682]: 2017-09-28 11:55:15.115 8682 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:55:15 ctl02 nova-api[8682]: 2017-09-28 11:55:15.115 8682 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:55:15 ctl02 nova-api[8682]: 2017-09-28 11:55:15.115 8682 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:55:15 ctl02 nova-api[8682]: 2017-09-28 11:55:15.115 8682 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:55:15 ctl02 nova-api[8682]: 2017-09-28 11:55:15.115 8682 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:55:15 ctl02 nova-api[8682]: 2017-09-28 11:55:15.115 8682 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:55:15 ctl02 nova-api[8682]: 2017-09-28 11:55:15.115 8682 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:55:15 ctl02 nova-api[8682]: 2017-09-28 11:55:15.115 8682 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:55:15 ctl02 nova-api[8682]: 2017-09-28 11:55:15.115 8682 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:55:15 ctl02 nova-api[8682]: 2017-09-28 11:55:15.115 8682 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:55:15 ctl02 nova-api[8682]: 2017-09-28 11:55:15.115 8682 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:55:15 ctl02 nova-api[8682]: 2017-09-28 11:55:15.115 8682 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:55:15 ctl02 nova-api[8682]: 2017-09-28 11:55:15.115 8682 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:55:15 ctl02 nova-api[8682]: 2017-09-28 11:55:15.115 8682 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:55:15 ctl02 nova-api[8682]: 2017-09-28 11:55:15.115 8682 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:55:15 ctl02 nova-api[8682]: 2017-09-28 11:55:15.115 8682 ERROR nova.wsgi     self.filename))
Sep 28 11:55:15 ctl02 nova-api[8682]: 2017-09-28 11:55:15.115 8682 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:55:15 ctl02 nova-api[8682]: 2017-09-28 11:55:15.115 8682 ERROR nova.wsgi
Sep 28 11:55:15 ctl02 nova-api[8682]: 2017-09-28 11:55:15.116 8682 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:55:15 ctl02 nova-api[8682]: 2017-09-28 11:55:15.250 8682 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:55:15 ctl02 nova-cert[4860]: 2017-09-28 11:55:15.307 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:55:15 ctl02 nova-api[8682]: 2017-09-28 11:55:15.493 8682 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:55:15 ctl02 nova-api[8682]: 2017-09-28 11:55:15.495 8682 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:55:15 ctl02 nova-api[8682]: 2017-09-28 11:55:15.495 8682 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:55:15 ctl02 nova-api[8682]: 2017-09-28 11:55:15.496 8682 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:55:15 ctl02 nova-api[8682]: 2017-09-28 11:55:15.627 8682 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:55:15 ctl02 nova-api[8682]: 2017-09-28 11:55:15.629 8682 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:55:15 ctl02 nova-api[8682]: 2017-09-28 11:55:15.629 8682 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:55:15 ctl02 nova-api[8682]: 2017-09-28 11:55:15.630 8682 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:55:15 ctl02 nova-api[8682]: 2017-09-28 11:55:15.633 8682 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:55:15 ctl02 nova-api[8682]: 2017-09-28 11:55:15.633 8682 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:55:15 ctl02 nova-api[8682]: 2017-09-28 11:55:15.633 8682 ERROR nova Traceback (most recent call last):
Sep 28 11:55:15 ctl02 nova-api[8682]: 2017-09-28 11:55:15.633 8682 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:55:15 ctl02 nova-api[8682]: 2017-09-28 11:55:15.633 8682 ERROR nova     sys.exit(main())
Sep 28 11:55:15 ctl02 nova-api[8682]: 2017-09-28 11:55:15.633 8682 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:55:15 ctl02 nova-api[8682]: 2017-09-28 11:55:15.633 8682 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:55:15 ctl02 nova-api[8682]: 2017-09-28 11:55:15.633 8682 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:55:15 ctl02 nova-api[8682]: 2017-09-28 11:55:15.633 8682 ERROR nova     max_url_len=max_url_len)
Sep 28 11:55:15 ctl02 nova-api[8682]: 2017-09-28 11:55:15.633 8682 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:55:15 ctl02 nova-api[8682]: 2017-09-28 11:55:15.633 8682 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:55:15 ctl02 nova-api[8682]: 2017-09-28 11:55:15.633 8682 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:55:15 ctl02 nova-api[8682]: 2017-09-28 11:55:15.633 8682 ERROR nova     sock.listen(backlog)
Sep 28 11:55:15 ctl02 nova-api[8682]: 2017-09-28 11:55:15.633 8682 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:55:15 ctl02 nova-api[8682]: 2017-09-28 11:55:15.633 8682 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:55:15 ctl02 nova-api[8682]: 2017-09-28 11:55:15.633 8682 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:55:15 ctl02 nova-api[8682]: 2017-09-28 11:55:15.633 8682 ERROR nova
Sep 28 11:55:15 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:55:15 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:55:15 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:55:16 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:55:16 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:55:16 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:55:16 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:55:17 ctl02 glance-api[29183]: 2017-09-28 11:55:17.170 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:55:17] "OPTIONS / HTTP/1.0" 200 134 0.000631
Sep 28 11:55:17 ctl02 glance-api[29183]: 2017-09-28 11:55:17.623 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:55:17] "OPTIONS / HTTP/1.0" 200 134 0.000641
Sep 28 11:55:17 ctl02 nova-api[8705]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:55:17 ctl02 nova-api[8705]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:55:17 ctl02 nova-api[8705]: 2017-09-28 11:55:17.843 8705 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:55:17 ctl02 nova-api[8705]: 2017-09-28 11:55:17.844 8705 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:55:17 ctl02 nova-api[8705]: 2017-09-28 11:55:17.844 8705 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:55:17 ctl02 nova-api[8705]: 2017-09-28 11:55:17.844 8705 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:55:17 ctl02 nova-api[8705]: 2017-09-28 11:55:17.844 8705 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:55:17 ctl02 nova-api[8705]: 2017-09-28 11:55:17.844 8705 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:55:17 ctl02 nova-api[8705]: 2017-09-28 11:55:17.844 8705 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:55:17 ctl02 nova-api[8705]: 2017-09-28 11:55:17.844 8705 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:55:17 ctl02 nova-api[8705]: 2017-09-28 11:55:17.844 8705 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:55:17 ctl02 nova-api[8705]: 2017-09-28 11:55:17.844 8705 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:55:17 ctl02 nova-api[8705]: 2017-09-28 11:55:17.844 8705 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:55:17 ctl02 nova-api[8705]: 2017-09-28 11:55:17.844 8705 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:55:17 ctl02 nova-api[8705]: 2017-09-28 11:55:17.844 8705 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:55:17 ctl02 nova-api[8705]: 2017-09-28 11:55:17.844 8705 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:55:17 ctl02 nova-api[8705]: 2017-09-28 11:55:17.844 8705 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:55:17 ctl02 nova-api[8705]: 2017-09-28 11:55:17.844 8705 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:55:17 ctl02 nova-api[8705]: 2017-09-28 11:55:17.844 8705 ERROR nova.wsgi     self.filename))
Sep 28 11:55:17 ctl02 nova-api[8705]: 2017-09-28 11:55:17.844 8705 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:55:17 ctl02 nova-api[8705]: 2017-09-28 11:55:17.844 8705 ERROR nova.wsgi
Sep 28 11:55:17 ctl02 nova-api[8705]: 2017-09-28 11:55:17.846 8705 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:55:17 ctl02 nova-api[8705]: 2017-09-28 11:55:17.979 8705 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:55:18 ctl02 nova-conductor[5056]: 2017-09-28 11:55:18.145 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:55:18 ctl02 nova-conductor[5056]: 2017-09-28 11:55:18.161 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:55:18 ctl02 nova-conductor[5056]: 2017-09-28 11:55:18.177 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:55:18 ctl02 nova-conductor[5056]: 2017-09-28 11:55:18.179 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:55:18 ctl02 nova-api[8705]: 2017-09-28 11:55:18.225 8705 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:55:18 ctl02 nova-api[8705]: 2017-09-28 11:55:18.227 8705 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:55:18 ctl02 nova-api[8705]: 2017-09-28 11:55:18.227 8705 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:55:18 ctl02 nova-api[8705]: 2017-09-28 11:55:18.228 8705 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:55:18 ctl02 nova-api[8705]: 2017-09-28 11:55:18.358 8705 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:55:18 ctl02 nova-api[8705]: 2017-09-28 11:55:18.360 8705 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:55:18 ctl02 nova-api[8705]: 2017-09-28 11:55:18.360 8705 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:55:18 ctl02 nova-api[8705]: 2017-09-28 11:55:18.361 8705 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:55:18 ctl02 nova-api[8705]: 2017-09-28 11:55:18.364 8705 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:55:18 ctl02 nova-api[8705]: 2017-09-28 11:55:18.365 8705 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:55:18 ctl02 nova-api[8705]: 2017-09-28 11:55:18.365 8705 ERROR nova Traceback (most recent call last):
Sep 28 11:55:18 ctl02 nova-api[8705]: 2017-09-28 11:55:18.365 8705 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:55:18 ctl02 nova-api[8705]: 2017-09-28 11:55:18.365 8705 ERROR nova     sys.exit(main())
Sep 28 11:55:18 ctl02 nova-api[8705]: 2017-09-28 11:55:18.365 8705 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:55:18 ctl02 nova-api[8705]: 2017-09-28 11:55:18.365 8705 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:55:18 ctl02 nova-api[8705]: 2017-09-28 11:55:18.365 8705 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:55:18 ctl02 nova-api[8705]: 2017-09-28 11:55:18.365 8705 ERROR nova     max_url_len=max_url_len)
Sep 28 11:55:18 ctl02 nova-api[8705]: 2017-09-28 11:55:18.365 8705 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:55:18 ctl02 nova-api[8705]: 2017-09-28 11:55:18.365 8705 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:55:18 ctl02 nova-api[8705]: 2017-09-28 11:55:18.365 8705 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:55:18 ctl02 nova-api[8705]: 2017-09-28 11:55:18.365 8705 ERROR nova     sock.listen(backlog)
Sep 28 11:55:18 ctl02 nova-api[8705]: 2017-09-28 11:55:18.365 8705 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:55:18 ctl02 nova-api[8705]: 2017-09-28 11:55:18.365 8705 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:55:18 ctl02 nova-api[8705]: 2017-09-28 11:55:18.365 8705 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:55:18 ctl02 nova-api[8705]: 2017-09-28 11:55:18.365 8705 ERROR nova
Sep 28 11:55:18 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:55:18 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:55:18 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:55:18 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:55:18 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:55:18 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:55:18 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:55:20 ctl02 nova-api[8722]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:55:20 ctl02 nova-api[8722]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:55:20 ctl02 nova-api[8722]: 2017-09-28 11:55:20.586 8722 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:55:20 ctl02 nova-api[8722]: 2017-09-28 11:55:20.587 8722 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:55:20 ctl02 nova-api[8722]: 2017-09-28 11:55:20.587 8722 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:55:20 ctl02 nova-api[8722]: 2017-09-28 11:55:20.587 8722 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:55:20 ctl02 nova-api[8722]: 2017-09-28 11:55:20.587 8722 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:55:20 ctl02 nova-api[8722]: 2017-09-28 11:55:20.587 8722 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:55:20 ctl02 nova-api[8722]: 2017-09-28 11:55:20.587 8722 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:55:20 ctl02 nova-api[8722]: 2017-09-28 11:55:20.587 8722 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:55:20 ctl02 nova-api[8722]: 2017-09-28 11:55:20.587 8722 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:55:20 ctl02 nova-api[8722]: 2017-09-28 11:55:20.587 8722 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:55:20 ctl02 nova-api[8722]: 2017-09-28 11:55:20.587 8722 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:55:20 ctl02 nova-api[8722]: 2017-09-28 11:55:20.587 8722 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:55:20 ctl02 nova-api[8722]: 2017-09-28 11:55:20.587 8722 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:55:20 ctl02 nova-api[8722]: 2017-09-28 11:55:20.587 8722 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:55:20 ctl02 nova-api[8722]: 2017-09-28 11:55:20.587 8722 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:55:20 ctl02 nova-api[8722]: 2017-09-28 11:55:20.587 8722 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:55:20 ctl02 nova-api[8722]: 2017-09-28 11:55:20.587 8722 ERROR nova.wsgi     self.filename))
Sep 28 11:55:20 ctl02 nova-api[8722]: 2017-09-28 11:55:20.587 8722 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:55:20 ctl02 nova-api[8722]: 2017-09-28 11:55:20.587 8722 ERROR nova.wsgi
Sep 28 11:55:20 ctl02 nova-api[8722]: 2017-09-28 11:55:20.588 8722 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:55:20 ctl02 nova-api[8722]: 2017-09-28 11:55:20.720 8722 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:55:20 ctl02 nova-api[8722]: 2017-09-28 11:55:20.960 8722 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:55:20 ctl02 nova-api[8722]: 2017-09-28 11:55:20.962 8722 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:55:20 ctl02 nova-api[8722]: 2017-09-28 11:55:20.963 8722 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:55:20 ctl02 nova-api[8722]: 2017-09-28 11:55:20.963 8722 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:55:21 ctl02 nova-api[8722]: 2017-09-28 11:55:21.093 8722 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:55:21 ctl02 nova-api[8722]: 2017-09-28 11:55:21.095 8722 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:55:21 ctl02 nova-api[8722]: 2017-09-28 11:55:21.095 8722 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:55:21 ctl02 nova-api[8722]: 2017-09-28 11:55:21.095 8722 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:55:21 ctl02 nova-api[8722]: 2017-09-28 11:55:21.098 8722 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:55:21 ctl02 nova-api[8722]: 2017-09-28 11:55:21.099 8722 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:55:21 ctl02 nova-api[8722]: 2017-09-28 11:55:21.099 8722 ERROR nova Traceback (most recent call last):
Sep 28 11:55:21 ctl02 nova-api[8722]: 2017-09-28 11:55:21.099 8722 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:55:21 ctl02 nova-api[8722]: 2017-09-28 11:55:21.099 8722 ERROR nova     sys.exit(main())
Sep 28 11:55:21 ctl02 nova-api[8722]: 2017-09-28 11:55:21.099 8722 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:55:21 ctl02 nova-api[8722]: 2017-09-28 11:55:21.099 8722 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:55:21 ctl02 nova-api[8722]: 2017-09-28 11:55:21.099 8722 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:55:21 ctl02 nova-api[8722]: 2017-09-28 11:55:21.099 8722 ERROR nova     max_url_len=max_url_len)
Sep 28 11:55:21 ctl02 nova-api[8722]: 2017-09-28 11:55:21.099 8722 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:55:21 ctl02 nova-api[8722]: 2017-09-28 11:55:21.099 8722 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:55:21 ctl02 nova-api[8722]: 2017-09-28 11:55:21.099 8722 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:55:21 ctl02 nova-api[8722]: 2017-09-28 11:55:21.099 8722 ERROR nova     sock.listen(backlog)
Sep 28 11:55:21 ctl02 nova-api[8722]: 2017-09-28 11:55:21.099 8722 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:55:21 ctl02 nova-api[8722]: 2017-09-28 11:55:21.099 8722 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:55:21 ctl02 nova-api[8722]: 2017-09-28 11:55:21.099 8722 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:55:21 ctl02 nova-api[8722]: 2017-09-28 11:55:21.099 8722 ERROR nova
Sep 28 11:55:21 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:55:21 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:55:21 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:55:21 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:55:21 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:55:21 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:55:21 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:55:22 ctl02 nova-api[8741]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:55:22 ctl02 nova-api[8741]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:55:23 ctl02 glance-api[29183]: 2017-09-28 11:55:23.092 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:55:23] "OPTIONS / HTTP/1.0" 200 134 0.000559
Sep 28 11:55:23 ctl02 nova-api[8741]: 2017-09-28 11:55:23.096 8741 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:55:23 ctl02 nova-api[8741]: 2017-09-28 11:55:23.098 8741 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:55:23 ctl02 nova-api[8741]: 2017-09-28 11:55:23.098 8741 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:55:23 ctl02 nova-api[8741]: 2017-09-28 11:55:23.098 8741 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:55:23 ctl02 nova-api[8741]: 2017-09-28 11:55:23.098 8741 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:55:23 ctl02 nova-api[8741]: 2017-09-28 11:55:23.098 8741 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:55:23 ctl02 nova-api[8741]: 2017-09-28 11:55:23.098 8741 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:55:23 ctl02 nova-api[8741]: 2017-09-28 11:55:23.098 8741 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:55:23 ctl02 nova-api[8741]: 2017-09-28 11:55:23.098 8741 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:55:23 ctl02 nova-api[8741]: 2017-09-28 11:55:23.098 8741 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:55:23 ctl02 nova-api[8741]: 2017-09-28 11:55:23.098 8741 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:55:23 ctl02 nova-api[8741]: 2017-09-28 11:55:23.098 8741 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:55:23 ctl02 nova-api[8741]: 2017-09-28 11:55:23.098 8741 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:55:23 ctl02 nova-api[8741]: 2017-09-28 11:55:23.098 8741 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:55:23 ctl02 nova-api[8741]: 2017-09-28 11:55:23.098 8741 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:55:23 ctl02 nova-api[8741]: 2017-09-28 11:55:23.098 8741 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:55:23 ctl02 nova-api[8741]: 2017-09-28 11:55:23.098 8741 ERROR nova.wsgi     self.filename))
Sep 28 11:55:23 ctl02 nova-api[8741]: 2017-09-28 11:55:23.098 8741 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:55:23 ctl02 nova-api[8741]: 2017-09-28 11:55:23.098 8741 ERROR nova.wsgi
Sep 28 11:55:23 ctl02 nova-api[8741]: 2017-09-28 11:55:23.100 8741 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:55:23 ctl02 nova-api[8741]: 2017-09-28 11:55:23.231 8741 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:55:23 ctl02 nova-api[8741]: 2017-09-28 11:55:23.466 8741 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:55:23 ctl02 nova-api[8741]: 2017-09-28 11:55:23.469 8741 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:55:23 ctl02 nova-api[8741]: 2017-09-28 11:55:23.469 8741 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:55:23 ctl02 nova-api[8741]: 2017-09-28 11:55:23.470 8741 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:55:23 ctl02 nova-api[8741]: 2017-09-28 11:55:23.602 8741 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:55:23 ctl02 nova-api[8741]: 2017-09-28 11:55:23.604 8741 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:55:23 ctl02 nova-api[8741]: 2017-09-28 11:55:23.605 8741 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:55:23 ctl02 nova-api[8741]: 2017-09-28 11:55:23.605 8741 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:55:23 ctl02 nova-api[8741]: 2017-09-28 11:55:23.608 8741 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:55:23 ctl02 nova-api[8741]: 2017-09-28 11:55:23.609 8741 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:55:23 ctl02 nova-api[8741]: 2017-09-28 11:55:23.609 8741 ERROR nova Traceback (most recent call last):
Sep 28 11:55:23 ctl02 nova-api[8741]: 2017-09-28 11:55:23.609 8741 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:55:23 ctl02 nova-api[8741]: 2017-09-28 11:55:23.609 8741 ERROR nova     sys.exit(main())
Sep 28 11:55:23 ctl02 nova-api[8741]: 2017-09-28 11:55:23.609 8741 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:55:23 ctl02 nova-api[8741]: 2017-09-28 11:55:23.609 8741 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:55:23 ctl02 nova-api[8741]: 2017-09-28 11:55:23.609 8741 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:55:23 ctl02 nova-api[8741]: 2017-09-28 11:55:23.609 8741 ERROR nova     max_url_len=max_url_len)
Sep 28 11:55:23 ctl02 nova-api[8741]: 2017-09-28 11:55:23.609 8741 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:55:23 ctl02 nova-api[8741]: 2017-09-28 11:55:23.609 8741 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:55:23 ctl02 nova-api[8741]: 2017-09-28 11:55:23.609 8741 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:55:23 ctl02 nova-api[8741]: 2017-09-28 11:55:23.609 8741 ERROR nova     sock.listen(backlog)
Sep 28 11:55:23 ctl02 nova-api[8741]: 2017-09-28 11:55:23.609 8741 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:55:23 ctl02 nova-api[8741]: 2017-09-28 11:55:23.609 8741 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:55:23 ctl02 nova-api[8741]: 2017-09-28 11:55:23.609 8741 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:55:23 ctl02 nova-api[8741]: 2017-09-28 11:55:23.609 8741 ERROR nova
Sep 28 11:55:23 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:55:23 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:55:23 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:55:23 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:55:23 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:55:23 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:55:23 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:55:24 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x17c42874)
Sep 28 11:55:25 ctl02 nova-consoleauth[5433]: 2017-09-28 11:55:25.206 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:55:25 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x17c42874)
Sep 28 11:55:25 ctl02 nova-api[8759]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:55:25 ctl02 nova-api[8759]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:55:25 ctl02 nova-api[8759]: 2017-09-28 11:55:25.611 8759 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:55:25 ctl02 nova-api[8759]: 2017-09-28 11:55:25.613 8759 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:55:25 ctl02 nova-api[8759]: 2017-09-28 11:55:25.613 8759 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:55:25 ctl02 nova-api[8759]: 2017-09-28 11:55:25.613 8759 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:55:25 ctl02 nova-api[8759]: 2017-09-28 11:55:25.613 8759 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:55:25 ctl02 nova-api[8759]: 2017-09-28 11:55:25.613 8759 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:55:25 ctl02 nova-api[8759]: 2017-09-28 11:55:25.613 8759 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:55:25 ctl02 nova-api[8759]: 2017-09-28 11:55:25.613 8759 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:55:25 ctl02 nova-api[8759]: 2017-09-28 11:55:25.613 8759 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:55:25 ctl02 nova-api[8759]: 2017-09-28 11:55:25.613 8759 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:55:25 ctl02 nova-api[8759]: 2017-09-28 11:55:25.613 8759 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:55:25 ctl02 nova-api[8759]: 2017-09-28 11:55:25.613 8759 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:55:25 ctl02 nova-api[8759]: 2017-09-28 11:55:25.613 8759 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:55:25 ctl02 nova-api[8759]: 2017-09-28 11:55:25.613 8759 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:55:25 ctl02 nova-api[8759]: 2017-09-28 11:55:25.613 8759 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:55:25 ctl02 nova-api[8759]: 2017-09-28 11:55:25.613 8759 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:55:25 ctl02 nova-api[8759]: 2017-09-28 11:55:25.613 8759 ERROR nova.wsgi     self.filename))
Sep 28 11:55:25 ctl02 nova-api[8759]: 2017-09-28 11:55:25.613 8759 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:55:25 ctl02 nova-api[8759]: 2017-09-28 11:55:25.613 8759 ERROR nova.wsgi
Sep 28 11:55:25 ctl02 nova-api[8759]: 2017-09-28 11:55:25.614 8759 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:55:25 ctl02 nova-api[8759]: 2017-09-28 11:55:25.741 8759 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:55:25 ctl02 nova-api[8759]: 2017-09-28 11:55:25.971 8759 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:55:25 ctl02 nova-api[8759]: 2017-09-28 11:55:25.973 8759 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:55:25 ctl02 nova-api[8759]: 2017-09-28 11:55:25.974 8759 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:55:25 ctl02 nova-api[8759]: 2017-09-28 11:55:25.974 8759 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:55:26 ctl02 nova-api[8759]: 2017-09-28 11:55:26.102 8759 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:55:26 ctl02 nova-api[8759]: 2017-09-28 11:55:26.104 8759 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:55:26 ctl02 nova-api[8759]: 2017-09-28 11:55:26.104 8759 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:55:26 ctl02 nova-api[8759]: 2017-09-28 11:55:26.105 8759 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:55:26 ctl02 nova-api[8759]: 2017-09-28 11:55:26.108 8759 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:55:26 ctl02 nova-api[8759]: 2017-09-28 11:55:26.108 8759 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:55:26 ctl02 nova-api[8759]: 2017-09-28 11:55:26.108 8759 ERROR nova Traceback (most recent call last):
Sep 28 11:55:26 ctl02 nova-api[8759]: 2017-09-28 11:55:26.108 8759 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:55:26 ctl02 nova-api[8759]: 2017-09-28 11:55:26.108 8759 ERROR nova     sys.exit(main())
Sep 28 11:55:26 ctl02 nova-api[8759]: 2017-09-28 11:55:26.108 8759 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:55:26 ctl02 nova-api[8759]: 2017-09-28 11:55:26.108 8759 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:55:26 ctl02 nova-api[8759]: 2017-09-28 11:55:26.108 8759 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:55:26 ctl02 nova-api[8759]: 2017-09-28 11:55:26.108 8759 ERROR nova     max_url_len=max_url_len)
Sep 28 11:55:26 ctl02 nova-api[8759]: 2017-09-28 11:55:26.108 8759 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:55:26 ctl02 nova-api[8759]: 2017-09-28 11:55:26.108 8759 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:55:26 ctl02 nova-api[8759]: 2017-09-28 11:55:26.108 8759 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:55:26 ctl02 nova-api[8759]: 2017-09-28 11:55:26.108 8759 ERROR nova     sock.listen(backlog)
Sep 28 11:55:26 ctl02 nova-api[8759]: 2017-09-28 11:55:26.108 8759 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:55:26 ctl02 nova-api[8759]: 2017-09-28 11:55:26.108 8759 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:55:26 ctl02 nova-api[8759]: 2017-09-28 11:55:26.108 8759 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:55:26 ctl02 nova-api[8759]: 2017-09-28 11:55:26.108 8759 ERROR nova
Sep 28 11:55:26 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:55:26 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:55:26 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:55:26 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x17c42874)
Sep 28 11:55:26 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:55:26 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:55:26 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:55:26 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:55:27 ctl02 glance-api[29183]: 2017-09-28 11:55:27.022 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:55:27] "OPTIONS / HTTP/1.0" 200 134 0.000666
Sep 28 11:55:27 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x17c42874)
Sep 28 11:55:27 ctl02 nova-api[8777]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:55:27 ctl02 nova-api[8777]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:55:28 ctl02 glance-api[29183]: 2017-09-28 11:55:28.022 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:55:28] "OPTIONS / HTTP/1.0" 200 134 0.000819
Sep 28 11:55:28 ctl02 nova-api[8777]: 2017-09-28 11:55:28.076 8777 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:55:28 ctl02 nova-api[8777]: 2017-09-28 11:55:28.078 8777 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:55:28 ctl02 nova-api[8777]: 2017-09-28 11:55:28.078 8777 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:55:28 ctl02 nova-api[8777]: 2017-09-28 11:55:28.078 8777 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:55:28 ctl02 nova-api[8777]: 2017-09-28 11:55:28.078 8777 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:55:28 ctl02 nova-api[8777]: 2017-09-28 11:55:28.078 8777 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:55:28 ctl02 nova-api[8777]: 2017-09-28 11:55:28.078 8777 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:55:28 ctl02 nova-api[8777]: 2017-09-28 11:55:28.078 8777 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:55:28 ctl02 nova-api[8777]: 2017-09-28 11:55:28.078 8777 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:55:28 ctl02 nova-api[8777]: 2017-09-28 11:55:28.078 8777 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:55:28 ctl02 nova-api[8777]: 2017-09-28 11:55:28.078 8777 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:55:28 ctl02 nova-api[8777]: 2017-09-28 11:55:28.078 8777 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:55:28 ctl02 nova-api[8777]: 2017-09-28 11:55:28.078 8777 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:55:28 ctl02 nova-api[8777]: 2017-09-28 11:55:28.078 8777 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:55:28 ctl02 nova-api[8777]: 2017-09-28 11:55:28.078 8777 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:55:28 ctl02 nova-api[8777]: 2017-09-28 11:55:28.078 8777 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:55:28 ctl02 nova-api[8777]: 2017-09-28 11:55:28.078 8777 ERROR nova.wsgi     self.filename))
Sep 28 11:55:28 ctl02 nova-api[8777]: 2017-09-28 11:55:28.078 8777 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:55:28 ctl02 nova-api[8777]: 2017-09-28 11:55:28.078 8777 ERROR nova.wsgi
Sep 28 11:55:28 ctl02 nova-api[8777]: 2017-09-28 11:55:28.079 8777 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:55:28 ctl02 nova-api[8777]: 2017-09-28 11:55:28.211 8777 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:55:28 ctl02 nova-scheduler[5620]: 2017-09-28 11:55:28.228 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:55:28 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x17c42874)
Sep 28 11:55:28 ctl02 nova-api[8777]: 2017-09-28 11:55:28.449 8777 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:55:28 ctl02 nova-api[8777]: 2017-09-28 11:55:28.451 8777 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:55:28 ctl02 nova-api[8777]: 2017-09-28 11:55:28.451 8777 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:55:28 ctl02 nova-api[8777]: 2017-09-28 11:55:28.451 8777 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:55:28 ctl02 nova-api[8777]: 2017-09-28 11:55:28.583 8777 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:55:28 ctl02 nova-api[8777]: 2017-09-28 11:55:28.585 8777 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:55:28 ctl02 nova-api[8777]: 2017-09-28 11:55:28.585 8777 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:55:28 ctl02 nova-api[8777]: 2017-09-28 11:55:28.585 8777 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:55:28 ctl02 nova-api[8777]: 2017-09-28 11:55:28.589 8777 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:55:28 ctl02 nova-api[8777]: 2017-09-28 11:55:28.589 8777 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:55:28 ctl02 nova-api[8777]: 2017-09-28 11:55:28.589 8777 ERROR nova Traceback (most recent call last):
Sep 28 11:55:28 ctl02 nova-api[8777]: 2017-09-28 11:55:28.589 8777 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:55:28 ctl02 nova-api[8777]: 2017-09-28 11:55:28.589 8777 ERROR nova     sys.exit(main())
Sep 28 11:55:28 ctl02 nova-api[8777]: 2017-09-28 11:55:28.589 8777 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:55:28 ctl02 nova-api[8777]: 2017-09-28 11:55:28.589 8777 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:55:28 ctl02 nova-api[8777]: 2017-09-28 11:55:28.589 8777 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:55:28 ctl02 nova-api[8777]: 2017-09-28 11:55:28.589 8777 ERROR nova     max_url_len=max_url_len)
Sep 28 11:55:28 ctl02 nova-api[8777]: 2017-09-28 11:55:28.589 8777 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:55:28 ctl02 nova-api[8777]: 2017-09-28 11:55:28.589 8777 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:55:28 ctl02 nova-api[8777]: 2017-09-28 11:55:28.589 8777 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:55:28 ctl02 nova-api[8777]: 2017-09-28 11:55:28.589 8777 ERROR nova     sock.listen(backlog)
Sep 28 11:55:28 ctl02 nova-api[8777]: 2017-09-28 11:55:28.589 8777 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:55:28 ctl02 nova-api[8777]: 2017-09-28 11:55:28.589 8777 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:55:28 ctl02 nova-api[8777]: 2017-09-28 11:55:28.589 8777 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:55:28 ctl02 nova-api[8777]: 2017-09-28 11:55:28.589 8777 ERROR nova
Sep 28 11:55:28 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:55:28 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:55:28 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:55:28 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:55:28 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:55:28 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:55:28 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:55:29 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x17c42874)
Sep 28 11:55:30 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x17c42874)
Sep 28 11:55:30 ctl02 nova-api[8795]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:55:30 ctl02 nova-api[8795]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:55:30 ctl02 nova-api[8795]: 2017-09-28 11:55:30.601 8795 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:55:30 ctl02 nova-api[8795]: 2017-09-28 11:55:30.603 8795 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:55:30 ctl02 nova-api[8795]: 2017-09-28 11:55:30.603 8795 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:55:30 ctl02 nova-api[8795]: 2017-09-28 11:55:30.603 8795 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:55:30 ctl02 nova-api[8795]: 2017-09-28 11:55:30.603 8795 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:55:30 ctl02 nova-api[8795]: 2017-09-28 11:55:30.603 8795 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:55:30 ctl02 nova-api[8795]: 2017-09-28 11:55:30.603 8795 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:55:30 ctl02 nova-api[8795]: 2017-09-28 11:55:30.603 8795 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:55:30 ctl02 nova-api[8795]: 2017-09-28 11:55:30.603 8795 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:55:30 ctl02 nova-api[8795]: 2017-09-28 11:55:30.603 8795 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:55:30 ctl02 nova-api[8795]: 2017-09-28 11:55:30.603 8795 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:55:30 ctl02 nova-api[8795]: 2017-09-28 11:55:30.603 8795 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:55:30 ctl02 nova-api[8795]: 2017-09-28 11:55:30.603 8795 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:55:30 ctl02 nova-api[8795]: 2017-09-28 11:55:30.603 8795 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:55:30 ctl02 nova-api[8795]: 2017-09-28 11:55:30.603 8795 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:55:30 ctl02 nova-api[8795]: 2017-09-28 11:55:30.603 8795 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:55:30 ctl02 nova-api[8795]: 2017-09-28 11:55:30.603 8795 ERROR nova.wsgi     self.filename))
Sep 28 11:55:30 ctl02 nova-api[8795]: 2017-09-28 11:55:30.603 8795 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:55:30 ctl02 nova-api[8795]: 2017-09-28 11:55:30.603 8795 ERROR nova.wsgi
Sep 28 11:55:30 ctl02 nova-api[8795]: 2017-09-28 11:55:30.614 8795 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:55:30 ctl02 nova-api[8795]: 2017-09-28 11:55:30.745 8795 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:55:30 ctl02 nova-api[8795]: 2017-09-28 11:55:30.971 8795 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:55:30 ctl02 nova-api[8795]: 2017-09-28 11:55:30.974 8795 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:55:30 ctl02 nova-api[8795]: 2017-09-28 11:55:30.974 8795 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:55:30 ctl02 nova-api[8795]: 2017-09-28 11:55:30.974 8795 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:55:31 ctl02 nova-api[8795]: 2017-09-28 11:55:31.102 8795 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:55:31 ctl02 nova-api[8795]: 2017-09-28 11:55:31.104 8795 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:55:31 ctl02 nova-api[8795]: 2017-09-28 11:55:31.104 8795 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:55:31 ctl02 nova-api[8795]: 2017-09-28 11:55:31.105 8795 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:55:31 ctl02 nova-api[8795]: 2017-09-28 11:55:31.108 8795 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:55:31 ctl02 nova-api[8795]: 2017-09-28 11:55:31.108 8795 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:55:31 ctl02 nova-api[8795]: 2017-09-28 11:55:31.108 8795 ERROR nova Traceback (most recent call last):
Sep 28 11:55:31 ctl02 nova-api[8795]: 2017-09-28 11:55:31.108 8795 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:55:31 ctl02 nova-api[8795]: 2017-09-28 11:55:31.108 8795 ERROR nova     sys.exit(main())
Sep 28 11:55:31 ctl02 nova-api[8795]: 2017-09-28 11:55:31.108 8795 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:55:31 ctl02 nova-api[8795]: 2017-09-28 11:55:31.108 8795 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:55:31 ctl02 nova-api[8795]: 2017-09-28 11:55:31.108 8795 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:55:31 ctl02 nova-api[8795]: 2017-09-28 11:55:31.108 8795 ERROR nova     max_url_len=max_url_len)
Sep 28 11:55:31 ctl02 nova-api[8795]: 2017-09-28 11:55:31.108 8795 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:55:31 ctl02 nova-api[8795]: 2017-09-28 11:55:31.108 8795 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:55:31 ctl02 nova-api[8795]: 2017-09-28 11:55:31.108 8795 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:55:31 ctl02 nova-api[8795]: 2017-09-28 11:55:31.108 8795 ERROR nova     sock.listen(backlog)
Sep 28 11:55:31 ctl02 nova-api[8795]: 2017-09-28 11:55:31.108 8795 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:55:31 ctl02 nova-api[8795]: 2017-09-28 11:55:31.108 8795 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:55:31 ctl02 nova-api[8795]: 2017-09-28 11:55:31.108 8795 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:55:31 ctl02 nova-api[8795]: 2017-09-28 11:55:31.108 8795 ERROR nova
Sep 28 11:55:31 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:55:31 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:55:31 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:55:31 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x17c42874)
Sep 28 11:55:31 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:55:31 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:55:31 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:55:31 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:55:32 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x17c42874)
Sep 28 11:55:32 ctl02 glance-api[29183]: 2017-09-28 11:55:32.869 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:55:32] "OPTIONS / HTTP/1.0" 200 134 0.000731
Sep 28 11:55:32 ctl02 nova-api[8813]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:55:32 ctl02 nova-api[8813]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:55:33 ctl02 nova-api[8813]: 2017-09-28 11:55:33.082 8813 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:55:33 ctl02 nova-api[8813]: 2017-09-28 11:55:33.084 8813 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:55:33 ctl02 nova-api[8813]: 2017-09-28 11:55:33.084 8813 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:55:33 ctl02 nova-api[8813]: 2017-09-28 11:55:33.084 8813 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:55:33 ctl02 nova-api[8813]: 2017-09-28 11:55:33.084 8813 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:55:33 ctl02 nova-api[8813]: 2017-09-28 11:55:33.084 8813 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:55:33 ctl02 nova-api[8813]: 2017-09-28 11:55:33.084 8813 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:55:33 ctl02 nova-api[8813]: 2017-09-28 11:55:33.084 8813 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:55:33 ctl02 nova-api[8813]: 2017-09-28 11:55:33.084 8813 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:55:33 ctl02 nova-api[8813]: 2017-09-28 11:55:33.084 8813 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:55:33 ctl02 nova-api[8813]: 2017-09-28 11:55:33.084 8813 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:55:33 ctl02 nova-api[8813]: 2017-09-28 11:55:33.084 8813 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:55:33 ctl02 nova-api[8813]: 2017-09-28 11:55:33.084 8813 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:55:33 ctl02 nova-api[8813]: 2017-09-28 11:55:33.084 8813 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:55:33 ctl02 nova-api[8813]: 2017-09-28 11:55:33.084 8813 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:55:33 ctl02 nova-api[8813]: 2017-09-28 11:55:33.084 8813 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:55:33 ctl02 nova-api[8813]: 2017-09-28 11:55:33.084 8813 ERROR nova.wsgi     self.filename))
Sep 28 11:55:33 ctl02 nova-api[8813]: 2017-09-28 11:55:33.084 8813 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:55:33 ctl02 nova-api[8813]: 2017-09-28 11:55:33.084 8813 ERROR nova.wsgi
Sep 28 11:55:33 ctl02 nova-api[8813]: 2017-09-28 11:55:33.086 8813 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:55:33 ctl02 nova-api[8813]: 2017-09-28 11:55:33.217 8813 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:55:33 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x17c42874)
Sep 28 11:55:33 ctl02 nova-api[8813]: 2017-09-28 11:55:33.458 8813 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:55:33 ctl02 nova-api[8813]: 2017-09-28 11:55:33.460 8813 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:55:33 ctl02 nova-api[8813]: 2017-09-28 11:55:33.461 8813 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:55:33 ctl02 nova-api[8813]: 2017-09-28 11:55:33.461 8813 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:55:33 ctl02 nova-api[8813]: 2017-09-28 11:55:33.591 8813 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:55:33 ctl02 nova-api[8813]: 2017-09-28 11:55:33.593 8813 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:55:33 ctl02 nova-api[8813]: 2017-09-28 11:55:33.593 8813 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:55:33 ctl02 nova-api[8813]: 2017-09-28 11:55:33.593 8813 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:55:33 ctl02 nova-api[8813]: 2017-09-28 11:55:33.597 8813 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:55:33 ctl02 nova-api[8813]: 2017-09-28 11:55:33.597 8813 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:55:33 ctl02 nova-api[8813]: 2017-09-28 11:55:33.597 8813 ERROR nova Traceback (most recent call last):
Sep 28 11:55:33 ctl02 nova-api[8813]: 2017-09-28 11:55:33.597 8813 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:55:33 ctl02 nova-api[8813]: 2017-09-28 11:55:33.597 8813 ERROR nova     sys.exit(main())
Sep 28 11:55:33 ctl02 nova-api[8813]: 2017-09-28 11:55:33.597 8813 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:55:33 ctl02 nova-api[8813]: 2017-09-28 11:55:33.597 8813 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:55:33 ctl02 nova-api[8813]: 2017-09-28 11:55:33.597 8813 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:55:33 ctl02 nova-api[8813]: 2017-09-28 11:55:33.597 8813 ERROR nova     max_url_len=max_url_len)
Sep 28 11:55:33 ctl02 nova-api[8813]: 2017-09-28 11:55:33.597 8813 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:55:33 ctl02 nova-api[8813]: 2017-09-28 11:55:33.597 8813 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:55:33 ctl02 nova-api[8813]: 2017-09-28 11:55:33.597 8813 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:55:33 ctl02 nova-api[8813]: 2017-09-28 11:55:33.597 8813 ERROR nova     sock.listen(backlog)
Sep 28 11:55:33 ctl02 nova-api[8813]: 2017-09-28 11:55:33.597 8813 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:55:33 ctl02 nova-api[8813]: 2017-09-28 11:55:33.597 8813 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:55:33 ctl02 nova-api[8813]: 2017-09-28 11:55:33.597 8813 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:55:33 ctl02 nova-api[8813]: 2017-09-28 11:55:33.597 8813 ERROR nova
Sep 28 11:55:33 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:55:33 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:55:33 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:55:33 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:55:33 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:55:33 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:55:33 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:55:34 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x17c42874)
Sep 28 11:55:35 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:55:35 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:55:35 ctl02 nova-api[8831]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:55:35 ctl02 nova-api[8831]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:55:35 ctl02 nova-api[8831]: 2017-09-28 11:55:35.640 8831 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:55:35 ctl02 nova-api[8831]: 2017-09-28 11:55:35.651 8831 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:55:35 ctl02 nova-api[8831]: 2017-09-28 11:55:35.651 8831 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:55:35 ctl02 nova-api[8831]: 2017-09-28 11:55:35.651 8831 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:55:35 ctl02 nova-api[8831]: 2017-09-28 11:55:35.651 8831 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:55:35 ctl02 nova-api[8831]: 2017-09-28 11:55:35.651 8831 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:55:35 ctl02 nova-api[8831]: 2017-09-28 11:55:35.651 8831 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:55:35 ctl02 nova-api[8831]: 2017-09-28 11:55:35.651 8831 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:55:35 ctl02 nova-api[8831]: 2017-09-28 11:55:35.651 8831 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:55:35 ctl02 nova-api[8831]: 2017-09-28 11:55:35.651 8831 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:55:35 ctl02 nova-api[8831]: 2017-09-28 11:55:35.651 8831 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:55:35 ctl02 nova-api[8831]: 2017-09-28 11:55:35.651 8831 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:55:35 ctl02 nova-api[8831]: 2017-09-28 11:55:35.651 8831 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:55:35 ctl02 nova-api[8831]: 2017-09-28 11:55:35.651 8831 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:55:35 ctl02 nova-api[8831]: 2017-09-28 11:55:35.651 8831 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:55:35 ctl02 nova-api[8831]: 2017-09-28 11:55:35.651 8831 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:55:35 ctl02 nova-api[8831]: 2017-09-28 11:55:35.651 8831 ERROR nova.wsgi     self.filename))
Sep 28 11:55:35 ctl02 nova-api[8831]: 2017-09-28 11:55:35.651 8831 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:55:35 ctl02 nova-api[8831]: 2017-09-28 11:55:35.651 8831 ERROR nova.wsgi
Sep 28 11:55:35 ctl02 nova-api[8831]: 2017-09-28 11:55:35.654 8831 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:55:35 ctl02 nova-api[8831]: 2017-09-28 11:55:35.802 8831 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:55:36 ctl02 nova-api[8831]: 2017-09-28 11:55:36.047 8831 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:55:36 ctl02 nova-api[8831]: 2017-09-28 11:55:36.050 8831 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:55:36 ctl02 nova-api[8831]: 2017-09-28 11:55:36.050 8831 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:55:36 ctl02 nova-api[8831]: 2017-09-28 11:55:36.050 8831 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:55:36 ctl02 nova-api[8831]: 2017-09-28 11:55:36.183 8831 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:55:36 ctl02 nova-api[8831]: 2017-09-28 11:55:36.186 8831 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:55:36 ctl02 nova-api[8831]: 2017-09-28 11:55:36.186 8831 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:55:36 ctl02 nova-api[8831]: 2017-09-28 11:55:36.187 8831 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:55:36 ctl02 nova-api[8831]: 2017-09-28 11:55:36.190 8831 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:55:36 ctl02 nova-api[8831]: 2017-09-28 11:55:36.191 8831 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:55:36 ctl02 nova-api[8831]: 2017-09-28 11:55:36.191 8831 ERROR nova Traceback (most recent call last):
Sep 28 11:55:36 ctl02 nova-api[8831]: 2017-09-28 11:55:36.191 8831 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:55:36 ctl02 nova-api[8831]: 2017-09-28 11:55:36.191 8831 ERROR nova     sys.exit(main())
Sep 28 11:55:36 ctl02 nova-api[8831]: 2017-09-28 11:55:36.191 8831 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:55:36 ctl02 nova-api[8831]: 2017-09-28 11:55:36.191 8831 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:55:36 ctl02 nova-api[8831]: 2017-09-28 11:55:36.191 8831 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:55:36 ctl02 nova-api[8831]: 2017-09-28 11:55:36.191 8831 ERROR nova     max_url_len=max_url_len)
Sep 28 11:55:36 ctl02 nova-api[8831]: 2017-09-28 11:55:36.191 8831 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:55:36 ctl02 nova-api[8831]: 2017-09-28 11:55:36.191 8831 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:55:36 ctl02 nova-api[8831]: 2017-09-28 11:55:36.191 8831 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:55:36 ctl02 nova-api[8831]: 2017-09-28 11:55:36.191 8831 ERROR nova     sock.listen(backlog)
Sep 28 11:55:36 ctl02 nova-api[8831]: 2017-09-28 11:55:36.191 8831 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:55:36 ctl02 nova-api[8831]: 2017-09-28 11:55:36.191 8831 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:55:36 ctl02 nova-api[8831]: 2017-09-28 11:55:36.191 8831 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:55:36 ctl02 nova-api[8831]: 2017-09-28 11:55:36.191 8831 ERROR nova
Sep 28 11:55:36 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:55:36 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:55:36 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:55:36 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:55:36 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:55:36 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:55:36 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:55:36 ctl02 glance-api[29183]: 2017-09-28 11:55:36.990 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:55:36] "OPTIONS / HTTP/1.0" 200 134 0.000633
Sep 28 11:55:37 ctl02 glance-api[29183]: 2017-09-28 11:55:37.677 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:55:37] "OPTIONS / HTTP/1.0" 200 134 0.000590
Sep 28 11:55:38 ctl02 nova-api[8854]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:55:38 ctl02 nova-api[8854]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:55:38 ctl02 nova-api[8854]: 2017-09-28 11:55:38.346 8854 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:55:38 ctl02 nova-api[8854]: 2017-09-28 11:55:38.347 8854 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:55:38 ctl02 nova-api[8854]: 2017-09-28 11:55:38.347 8854 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:55:38 ctl02 nova-api[8854]: 2017-09-28 11:55:38.347 8854 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:55:38 ctl02 nova-api[8854]: 2017-09-28 11:55:38.347 8854 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:55:38 ctl02 nova-api[8854]: 2017-09-28 11:55:38.347 8854 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:55:38 ctl02 nova-api[8854]: 2017-09-28 11:55:38.347 8854 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:55:38 ctl02 nova-api[8854]: 2017-09-28 11:55:38.347 8854 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:55:38 ctl02 nova-api[8854]: 2017-09-28 11:55:38.347 8854 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:55:38 ctl02 nova-api[8854]: 2017-09-28 11:55:38.347 8854 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:55:38 ctl02 nova-api[8854]: 2017-09-28 11:55:38.347 8854 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:55:38 ctl02 nova-api[8854]: 2017-09-28 11:55:38.347 8854 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:55:38 ctl02 nova-api[8854]: 2017-09-28 11:55:38.347 8854 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:55:38 ctl02 nova-api[8854]: 2017-09-28 11:55:38.347 8854 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:55:38 ctl02 nova-api[8854]: 2017-09-28 11:55:38.347 8854 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:55:38 ctl02 nova-api[8854]: 2017-09-28 11:55:38.347 8854 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:55:38 ctl02 nova-api[8854]: 2017-09-28 11:55:38.347 8854 ERROR nova.wsgi     self.filename))
Sep 28 11:55:38 ctl02 nova-api[8854]: 2017-09-28 11:55:38.347 8854 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:55:38 ctl02 nova-api[8854]: 2017-09-28 11:55:38.347 8854 ERROR nova.wsgi
Sep 28 11:55:38 ctl02 nova-api[8854]: 2017-09-28 11:55:38.348 8854 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:55:38 ctl02 nova-api[8854]: 2017-09-28 11:55:38.476 8854 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:55:38 ctl02 nova-api[8854]: 2017-09-28 11:55:38.699 8854 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:55:38 ctl02 nova-api[8854]: 2017-09-28 11:55:38.701 8854 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:55:38 ctl02 nova-api[8854]: 2017-09-28 11:55:38.701 8854 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:55:38 ctl02 nova-api[8854]: 2017-09-28 11:55:38.702 8854 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:55:38 ctl02 nova-api[8854]: 2017-09-28 11:55:38.830 8854 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:55:38 ctl02 nova-api[8854]: 2017-09-28 11:55:38.832 8854 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:55:38 ctl02 nova-api[8854]: 2017-09-28 11:55:38.832 8854 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:55:38 ctl02 nova-api[8854]: 2017-09-28 11:55:38.832 8854 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:55:38 ctl02 nova-api[8854]: 2017-09-28 11:55:38.835 8854 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:55:38 ctl02 nova-api[8854]: 2017-09-28 11:55:38.836 8854 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:55:38 ctl02 nova-api[8854]: 2017-09-28 11:55:38.836 8854 ERROR nova Traceback (most recent call last):
Sep 28 11:55:38 ctl02 nova-api[8854]: 2017-09-28 11:55:38.836 8854 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:55:38 ctl02 nova-api[8854]: 2017-09-28 11:55:38.836 8854 ERROR nova     sys.exit(main())
Sep 28 11:55:38 ctl02 nova-api[8854]: 2017-09-28 11:55:38.836 8854 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:55:38 ctl02 nova-api[8854]: 2017-09-28 11:55:38.836 8854 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:55:38 ctl02 nova-api[8854]: 2017-09-28 11:55:38.836 8854 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:55:38 ctl02 nova-api[8854]: 2017-09-28 11:55:38.836 8854 ERROR nova     max_url_len=max_url_len)
Sep 28 11:55:38 ctl02 nova-api[8854]: 2017-09-28 11:55:38.836 8854 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:55:38 ctl02 nova-api[8854]: 2017-09-28 11:55:38.836 8854 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:55:38 ctl02 nova-api[8854]: 2017-09-28 11:55:38.836 8854 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:55:38 ctl02 nova-api[8854]: 2017-09-28 11:55:38.836 8854 ERROR nova     sock.listen(backlog)
Sep 28 11:55:38 ctl02 nova-api[8854]: 2017-09-28 11:55:38.836 8854 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:55:38 ctl02 nova-api[8854]: 2017-09-28 11:55:38.836 8854 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:55:38 ctl02 nova-api[8854]: 2017-09-28 11:55:38.836 8854 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:55:38 ctl02 nova-api[8854]: 2017-09-28 11:55:38.836 8854 ERROR nova
Sep 28 11:55:38 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:55:38 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:55:38 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:55:39 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:55:39 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:55:39 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:55:39 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:55:40 ctl02 nova-api[8871]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:55:40 ctl02 nova-api[8871]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:55:40 ctl02 nova-api[8871]: 2017-09-28 11:55:40.817 8871 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:55:40 ctl02 nova-api[8871]: 2017-09-28 11:55:40.819 8871 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:55:40 ctl02 nova-api[8871]: 2017-09-28 11:55:40.819 8871 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:55:40 ctl02 nova-api[8871]: 2017-09-28 11:55:40.819 8871 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:55:40 ctl02 nova-api[8871]: 2017-09-28 11:55:40.819 8871 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:55:40 ctl02 nova-api[8871]: 2017-09-28 11:55:40.819 8871 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:55:40 ctl02 nova-api[8871]: 2017-09-28 11:55:40.819 8871 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:55:40 ctl02 nova-api[8871]: 2017-09-28 11:55:40.819 8871 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:55:40 ctl02 nova-api[8871]: 2017-09-28 11:55:40.819 8871 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:55:40 ctl02 nova-api[8871]: 2017-09-28 11:55:40.819 8871 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:55:40 ctl02 nova-api[8871]: 2017-09-28 11:55:40.819 8871 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:55:40 ctl02 nova-api[8871]: 2017-09-28 11:55:40.819 8871 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:55:40 ctl02 nova-api[8871]: 2017-09-28 11:55:40.819 8871 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:55:40 ctl02 nova-api[8871]: 2017-09-28 11:55:40.819 8871 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:55:40 ctl02 nova-api[8871]: 2017-09-28 11:55:40.819 8871 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:55:40 ctl02 nova-api[8871]: 2017-09-28 11:55:40.819 8871 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:55:40 ctl02 nova-api[8871]: 2017-09-28 11:55:40.819 8871 ERROR nova.wsgi     self.filename))
Sep 28 11:55:40 ctl02 nova-api[8871]: 2017-09-28 11:55:40.819 8871 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:55:40 ctl02 nova-api[8871]: 2017-09-28 11:55:40.819 8871 ERROR nova.wsgi
Sep 28 11:55:40 ctl02 nova-api[8871]: 2017-09-28 11:55:40.819 8871 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:55:40 ctl02 nova-api[8871]: 2017-09-28 11:55:40.951 8871 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:55:41 ctl02 nova-api[8871]: 2017-09-28 11:55:41.188 8871 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:55:41 ctl02 nova-api[8871]: 2017-09-28 11:55:41.191 8871 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:55:41 ctl02 nova-api[8871]: 2017-09-28 11:55:41.191 8871 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:55:41 ctl02 nova-api[8871]: 2017-09-28 11:55:41.191 8871 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:55:41 ctl02 nova-api[8871]: 2017-09-28 11:55:41.325 8871 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:55:41 ctl02 nova-api[8871]: 2017-09-28 11:55:41.327 8871 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:55:41 ctl02 nova-api[8871]: 2017-09-28 11:55:41.327 8871 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:55:41 ctl02 nova-api[8871]: 2017-09-28 11:55:41.327 8871 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:55:41 ctl02 nova-api[8871]: 2017-09-28 11:55:41.330 8871 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:55:41 ctl02 nova-api[8871]: 2017-09-28 11:55:41.331 8871 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:55:41 ctl02 nova-api[8871]: 2017-09-28 11:55:41.331 8871 ERROR nova Traceback (most recent call last):
Sep 28 11:55:41 ctl02 nova-api[8871]: 2017-09-28 11:55:41.331 8871 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:55:41 ctl02 nova-api[8871]: 2017-09-28 11:55:41.331 8871 ERROR nova     sys.exit(main())
Sep 28 11:55:41 ctl02 nova-api[8871]: 2017-09-28 11:55:41.331 8871 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:55:41 ctl02 nova-api[8871]: 2017-09-28 11:55:41.331 8871 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:55:41 ctl02 nova-api[8871]: 2017-09-28 11:55:41.331 8871 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:55:41 ctl02 nova-api[8871]: 2017-09-28 11:55:41.331 8871 ERROR nova     max_url_len=max_url_len)
Sep 28 11:55:41 ctl02 nova-api[8871]: 2017-09-28 11:55:41.331 8871 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:55:41 ctl02 nova-api[8871]: 2017-09-28 11:55:41.331 8871 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:55:41 ctl02 nova-api[8871]: 2017-09-28 11:55:41.331 8871 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:55:41 ctl02 nova-api[8871]: 2017-09-28 11:55:41.331 8871 ERROR nova     sock.listen(backlog)
Sep 28 11:55:41 ctl02 nova-api[8871]: 2017-09-28 11:55:41.331 8871 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:55:41 ctl02 nova-api[8871]: 2017-09-28 11:55:41.331 8871 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:55:41 ctl02 nova-api[8871]: 2017-09-28 11:55:41.331 8871 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:55:41 ctl02 nova-api[8871]: 2017-09-28 11:55:41.331 8871 ERROR nova
Sep 28 11:55:41 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:55:41 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:55:41 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:55:41 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:55:41 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:55:41 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:55:41 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:55:42 ctl02 glance-api[29183]: 2017-09-28 11:55:42.731 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:55:42] "OPTIONS / HTTP/1.0" 200 134 0.000648
Sep 28 11:55:43 ctl02 nova-api[8890]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:55:43 ctl02 nova-api[8890]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:55:43 ctl02 nova-api[8890]: 2017-09-28 11:55:43.337 8890 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:55:43 ctl02 nova-api[8890]: 2017-09-28 11:55:43.339 8890 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:55:43 ctl02 nova-api[8890]: 2017-09-28 11:55:43.339 8890 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:55:43 ctl02 nova-api[8890]: 2017-09-28 11:55:43.339 8890 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:55:43 ctl02 nova-api[8890]: 2017-09-28 11:55:43.339 8890 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:55:43 ctl02 nova-api[8890]: 2017-09-28 11:55:43.339 8890 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:55:43 ctl02 nova-api[8890]: 2017-09-28 11:55:43.339 8890 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:55:43 ctl02 nova-api[8890]: 2017-09-28 11:55:43.339 8890 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:55:43 ctl02 nova-api[8890]: 2017-09-28 11:55:43.339 8890 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:55:43 ctl02 nova-api[8890]: 2017-09-28 11:55:43.339 8890 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:55:43 ctl02 nova-api[8890]: 2017-09-28 11:55:43.339 8890 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:55:43 ctl02 nova-api[8890]: 2017-09-28 11:55:43.339 8890 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:55:43 ctl02 nova-api[8890]: 2017-09-28 11:55:43.339 8890 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:55:43 ctl02 nova-api[8890]: 2017-09-28 11:55:43.339 8890 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:55:43 ctl02 nova-api[8890]: 2017-09-28 11:55:43.339 8890 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:55:43 ctl02 nova-api[8890]: 2017-09-28 11:55:43.339 8890 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:55:43 ctl02 nova-api[8890]: 2017-09-28 11:55:43.339 8890 ERROR nova.wsgi     self.filename))
Sep 28 11:55:43 ctl02 nova-api[8890]: 2017-09-28 11:55:43.339 8890 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:55:43 ctl02 nova-api[8890]: 2017-09-28 11:55:43.339 8890 ERROR nova.wsgi
Sep 28 11:55:43 ctl02 nova-api[8890]: 2017-09-28 11:55:43.340 8890 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:55:43 ctl02 nova-api[8890]: 2017-09-28 11:55:43.472 8890 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:55:43 ctl02 nova-api[8890]: 2017-09-28 11:55:43.713 8890 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:55:43 ctl02 nova-api[8890]: 2017-09-28 11:55:43.716 8890 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:55:43 ctl02 nova-api[8890]: 2017-09-28 11:55:43.716 8890 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:55:43 ctl02 nova-api[8890]: 2017-09-28 11:55:43.716 8890 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:55:43 ctl02 nova-api[8890]: 2017-09-28 11:55:43.846 8890 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:55:43 ctl02 nova-api[8890]: 2017-09-28 11:55:43.848 8890 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:55:43 ctl02 nova-api[8890]: 2017-09-28 11:55:43.848 8890 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:55:43 ctl02 nova-api[8890]: 2017-09-28 11:55:43.848 8890 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:55:43 ctl02 nova-api[8890]: 2017-09-28 11:55:43.852 8890 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:55:43 ctl02 nova-api[8890]: 2017-09-28 11:55:43.852 8890 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:55:43 ctl02 nova-api[8890]: 2017-09-28 11:55:43.852 8890 ERROR nova Traceback (most recent call last):
Sep 28 11:55:43 ctl02 nova-api[8890]: 2017-09-28 11:55:43.852 8890 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:55:43 ctl02 nova-api[8890]: 2017-09-28 11:55:43.852 8890 ERROR nova     sys.exit(main())
Sep 28 11:55:43 ctl02 nova-api[8890]: 2017-09-28 11:55:43.852 8890 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:55:43 ctl02 nova-api[8890]: 2017-09-28 11:55:43.852 8890 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:55:43 ctl02 nova-api[8890]: 2017-09-28 11:55:43.852 8890 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:55:43 ctl02 nova-api[8890]: 2017-09-28 11:55:43.852 8890 ERROR nova     max_url_len=max_url_len)
Sep 28 11:55:43 ctl02 nova-api[8890]: 2017-09-28 11:55:43.852 8890 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:55:43 ctl02 nova-api[8890]: 2017-09-28 11:55:43.852 8890 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:55:43 ctl02 nova-api[8890]: 2017-09-28 11:55:43.852 8890 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:55:43 ctl02 nova-api[8890]: 2017-09-28 11:55:43.852 8890 ERROR nova     sock.listen(backlog)
Sep 28 11:55:43 ctl02 nova-api[8890]: 2017-09-28 11:55:43.852 8890 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:55:43 ctl02 nova-api[8890]: 2017-09-28 11:55:43.852 8890 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:55:43 ctl02 nova-api[8890]: 2017-09-28 11:55:43.852 8890 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:55:43 ctl02 nova-api[8890]: 2017-09-28 11:55:43.852 8890 ERROR nova
Sep 28 11:55:44 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:55:44 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:55:44 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:55:44 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:55:44 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:55:44 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:55:44 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:55:45 ctl02 nova-api[8908]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:55:45 ctl02 nova-api[8908]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:55:45 ctl02 nova-api[8908]: 2017-09-28 11:55:45.836 8908 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:55:45 ctl02 nova-api[8908]: 2017-09-28 11:55:45.837 8908 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:55:45 ctl02 nova-api[8908]: 2017-09-28 11:55:45.837 8908 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:55:45 ctl02 nova-api[8908]: 2017-09-28 11:55:45.837 8908 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:55:45 ctl02 nova-api[8908]: 2017-09-28 11:55:45.837 8908 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:55:45 ctl02 nova-api[8908]: 2017-09-28 11:55:45.837 8908 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:55:45 ctl02 nova-api[8908]: 2017-09-28 11:55:45.837 8908 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:55:45 ctl02 nova-api[8908]: 2017-09-28 11:55:45.837 8908 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:55:45 ctl02 nova-api[8908]: 2017-09-28 11:55:45.837 8908 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:55:45 ctl02 nova-api[8908]: 2017-09-28 11:55:45.837 8908 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:55:45 ctl02 nova-api[8908]: 2017-09-28 11:55:45.837 8908 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:55:45 ctl02 nova-api[8908]: 2017-09-28 11:55:45.837 8908 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:55:45 ctl02 nova-api[8908]: 2017-09-28 11:55:45.837 8908 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:55:45 ctl02 nova-api[8908]: 2017-09-28 11:55:45.837 8908 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:55:45 ctl02 nova-api[8908]: 2017-09-28 11:55:45.837 8908 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:55:45 ctl02 nova-api[8908]: 2017-09-28 11:55:45.837 8908 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:55:45 ctl02 nova-api[8908]: 2017-09-28 11:55:45.837 8908 ERROR nova.wsgi     self.filename))
Sep 28 11:55:45 ctl02 nova-api[8908]: 2017-09-28 11:55:45.837 8908 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:55:45 ctl02 nova-api[8908]: 2017-09-28 11:55:45.837 8908 ERROR nova.wsgi
Sep 28 11:55:45 ctl02 nova-api[8908]: 2017-09-28 11:55:45.838 8908 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:55:45 ctl02 nova-api[8908]: 2017-09-28 11:55:45.968 8908 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:55:46 ctl02 nova-api[8908]: 2017-09-28 11:55:46.210 8908 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:55:46 ctl02 nova-api[8908]: 2017-09-28 11:55:46.212 8908 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:55:46 ctl02 nova-api[8908]: 2017-09-28 11:55:46.213 8908 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:55:46 ctl02 nova-api[8908]: 2017-09-28 11:55:46.213 8908 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:55:46 ctl02 nova-api[8908]: 2017-09-28 11:55:46.344 8908 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:55:46 ctl02 nova-api[8908]: 2017-09-28 11:55:46.346 8908 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:55:46 ctl02 nova-api[8908]: 2017-09-28 11:55:46.346 8908 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:55:46 ctl02 nova-api[8908]: 2017-09-28 11:55:46.347 8908 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:55:46 ctl02 nova-api[8908]: 2017-09-28 11:55:46.350 8908 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:55:46 ctl02 nova-api[8908]: 2017-09-28 11:55:46.350 8908 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:55:46 ctl02 nova-api[8908]: 2017-09-28 11:55:46.350 8908 ERROR nova Traceback (most recent call last):
Sep 28 11:55:46 ctl02 nova-api[8908]: 2017-09-28 11:55:46.350 8908 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:55:46 ctl02 nova-api[8908]: 2017-09-28 11:55:46.350 8908 ERROR nova     sys.exit(main())
Sep 28 11:55:46 ctl02 nova-api[8908]: 2017-09-28 11:55:46.350 8908 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:55:46 ctl02 nova-api[8908]: 2017-09-28 11:55:46.350 8908 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:55:46 ctl02 nova-api[8908]: 2017-09-28 11:55:46.350 8908 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:55:46 ctl02 nova-api[8908]: 2017-09-28 11:55:46.350 8908 ERROR nova     max_url_len=max_url_len)
Sep 28 11:55:46 ctl02 nova-api[8908]: 2017-09-28 11:55:46.350 8908 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:55:46 ctl02 nova-api[8908]: 2017-09-28 11:55:46.350 8908 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:55:46 ctl02 nova-api[8908]: 2017-09-28 11:55:46.350 8908 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:55:46 ctl02 nova-api[8908]: 2017-09-28 11:55:46.350 8908 ERROR nova     sock.listen(backlog)
Sep 28 11:55:46 ctl02 nova-api[8908]: 2017-09-28 11:55:46.350 8908 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:55:46 ctl02 nova-api[8908]: 2017-09-28 11:55:46.350 8908 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:55:46 ctl02 nova-api[8908]: 2017-09-28 11:55:46.350 8908 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:55:46 ctl02 nova-api[8908]: 2017-09-28 11:55:46.350 8908 ERROR nova
Sep 28 11:55:46 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:55:46 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:55:46 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:55:46 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:55:46 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:55:46 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:55:46 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:55:46 ctl02 glance-api[29183]: 2017-09-28 11:55:46.671 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:55:46] "OPTIONS / HTTP/1.0" 200 134 0.001072
Sep 28 11:55:47 ctl02 nova-cert[4860]: 2017-09-28 11:55:47.342 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:55:47 ctl02 glance-api[29183]: 2017-09-28 11:55:47.678 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:55:47] "OPTIONS / HTTP/1.0" 200 134 0.000654
Sep 28 11:55:48 ctl02 nova-api[8926]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:55:48 ctl02 nova-api[8926]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:55:48 ctl02 nova-api[8926]: 2017-09-28 11:55:48.360 8926 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:55:48 ctl02 nova-api[8926]: 2017-09-28 11:55:48.361 8926 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:55:48 ctl02 nova-api[8926]: 2017-09-28 11:55:48.361 8926 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:55:48 ctl02 nova-api[8926]: 2017-09-28 11:55:48.361 8926 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:55:48 ctl02 nova-api[8926]: 2017-09-28 11:55:48.361 8926 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:55:48 ctl02 nova-api[8926]: 2017-09-28 11:55:48.361 8926 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:55:48 ctl02 nova-api[8926]: 2017-09-28 11:55:48.361 8926 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:55:48 ctl02 nova-api[8926]: 2017-09-28 11:55:48.361 8926 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:55:48 ctl02 nova-api[8926]: 2017-09-28 11:55:48.361 8926 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:55:48 ctl02 nova-api[8926]: 2017-09-28 11:55:48.361 8926 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:55:48 ctl02 nova-api[8926]: 2017-09-28 11:55:48.361 8926 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:55:48 ctl02 nova-api[8926]: 2017-09-28 11:55:48.361 8926 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:55:48 ctl02 nova-api[8926]: 2017-09-28 11:55:48.361 8926 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:55:48 ctl02 nova-api[8926]: 2017-09-28 11:55:48.361 8926 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:55:48 ctl02 nova-api[8926]: 2017-09-28 11:55:48.361 8926 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:55:48 ctl02 nova-api[8926]: 2017-09-28 11:55:48.361 8926 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:55:48 ctl02 nova-api[8926]: 2017-09-28 11:55:48.361 8926 ERROR nova.wsgi     self.filename))
Sep 28 11:55:48 ctl02 nova-api[8926]: 2017-09-28 11:55:48.361 8926 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:55:48 ctl02 nova-api[8926]: 2017-09-28 11:55:48.361 8926 ERROR nova.wsgi
Sep 28 11:55:48 ctl02 nova-api[8926]: 2017-09-28 11:55:48.362 8926 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:55:48 ctl02 nova-api[8926]: 2017-09-28 11:55:48.495 8926 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:55:48 ctl02 nova-api[8926]: 2017-09-28 11:55:48.735 8926 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:55:48 ctl02 nova-api[8926]: 2017-09-28 11:55:48.737 8926 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:55:48 ctl02 nova-api[8926]: 2017-09-28 11:55:48.737 8926 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:55:48 ctl02 nova-api[8926]: 2017-09-28 11:55:48.737 8926 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:55:48 ctl02 nova-api[8926]: 2017-09-28 11:55:48.866 8926 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:55:48 ctl02 nova-api[8926]: 2017-09-28 11:55:48.868 8926 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:55:48 ctl02 nova-api[8926]: 2017-09-28 11:55:48.868 8926 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:55:48 ctl02 nova-api[8926]: 2017-09-28 11:55:48.869 8926 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:55:48 ctl02 nova-api[8926]: 2017-09-28 11:55:48.872 8926 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:55:48 ctl02 nova-api[8926]: 2017-09-28 11:55:48.872 8926 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:55:48 ctl02 nova-api[8926]: 2017-09-28 11:55:48.872 8926 ERROR nova Traceback (most recent call last):
Sep 28 11:55:48 ctl02 nova-api[8926]: 2017-09-28 11:55:48.872 8926 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:55:48 ctl02 nova-api[8926]: 2017-09-28 11:55:48.872 8926 ERROR nova     sys.exit(main())
Sep 28 11:55:48 ctl02 nova-api[8926]: 2017-09-28 11:55:48.872 8926 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:55:48 ctl02 nova-api[8926]: 2017-09-28 11:55:48.872 8926 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:55:48 ctl02 nova-api[8926]: 2017-09-28 11:55:48.872 8926 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:55:48 ctl02 nova-api[8926]: 2017-09-28 11:55:48.872 8926 ERROR nova     max_url_len=max_url_len)
Sep 28 11:55:48 ctl02 nova-api[8926]: 2017-09-28 11:55:48.872 8926 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:55:48 ctl02 nova-api[8926]: 2017-09-28 11:55:48.872 8926 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:55:48 ctl02 nova-api[8926]: 2017-09-28 11:55:48.872 8926 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:55:48 ctl02 nova-api[8926]: 2017-09-28 11:55:48.872 8926 ERROR nova     sock.listen(backlog)
Sep 28 11:55:48 ctl02 nova-api[8926]: 2017-09-28 11:55:48.872 8926 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:55:48 ctl02 nova-api[8926]: 2017-09-28 11:55:48.872 8926 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:55:48 ctl02 nova-api[8926]: 2017-09-28 11:55:48.872 8926 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:55:48 ctl02 nova-api[8926]: 2017-09-28 11:55:48.872 8926 ERROR nova
Sep 28 11:55:49 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:55:49 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:55:49 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:55:49 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:55:49 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:55:49 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:55:49 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:55:50 ctl02 nova-conductor[5056]: 2017-09-28 11:55:50.154 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:55:50 ctl02 nova-conductor[5056]: 2017-09-28 11:55:50.169 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:55:50 ctl02 nova-conductor[5056]: 2017-09-28 11:55:50.185 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:55:50 ctl02 nova-conductor[5056]: 2017-09-28 11:55:50.188 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:55:50 ctl02 nova-api[8944]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:55:50 ctl02 nova-api[8944]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:55:51 ctl02 nova-api[8944]: 2017-09-28 11:55:51.124 8944 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:55:51 ctl02 nova-api[8944]: 2017-09-28 11:55:51.126 8944 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:55:51 ctl02 nova-api[8944]: 2017-09-28 11:55:51.126 8944 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:55:51 ctl02 nova-api[8944]: 2017-09-28 11:55:51.126 8944 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:55:51 ctl02 nova-api[8944]: 2017-09-28 11:55:51.126 8944 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:55:51 ctl02 nova-api[8944]: 2017-09-28 11:55:51.126 8944 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:55:51 ctl02 nova-api[8944]: 2017-09-28 11:55:51.126 8944 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:55:51 ctl02 nova-api[8944]: 2017-09-28 11:55:51.126 8944 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:55:51 ctl02 nova-api[8944]: 2017-09-28 11:55:51.126 8944 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:55:51 ctl02 nova-api[8944]: 2017-09-28 11:55:51.126 8944 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:55:51 ctl02 nova-api[8944]: 2017-09-28 11:55:51.126 8944 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:55:51 ctl02 nova-api[8944]: 2017-09-28 11:55:51.126 8944 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:55:51 ctl02 nova-api[8944]: 2017-09-28 11:55:51.126 8944 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:55:51 ctl02 nova-api[8944]: 2017-09-28 11:55:51.126 8944 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:55:51 ctl02 nova-api[8944]: 2017-09-28 11:55:51.126 8944 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:55:51 ctl02 nova-api[8944]: 2017-09-28 11:55:51.126 8944 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:55:51 ctl02 nova-api[8944]: 2017-09-28 11:55:51.126 8944 ERROR nova.wsgi     self.filename))
Sep 28 11:55:51 ctl02 nova-api[8944]: 2017-09-28 11:55:51.126 8944 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:55:51 ctl02 nova-api[8944]: 2017-09-28 11:55:51.126 8944 ERROR nova.wsgi
Sep 28 11:55:51 ctl02 nova-api[8944]: 2017-09-28 11:55:51.127 8944 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:55:51 ctl02 nova-api[8944]: 2017-09-28 11:55:51.263 8944 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:55:51 ctl02 nova-api[8944]: 2017-09-28 11:55:51.510 8944 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:55:51 ctl02 nova-api[8944]: 2017-09-28 11:55:51.513 8944 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:55:51 ctl02 nova-api[8944]: 2017-09-28 11:55:51.513 8944 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:55:51 ctl02 nova-api[8944]: 2017-09-28 11:55:51.513 8944 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:55:51 ctl02 nova-api[8944]: 2017-09-28 11:55:51.646 8944 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:55:51 ctl02 nova-api[8944]: 2017-09-28 11:55:51.648 8944 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:55:51 ctl02 nova-api[8944]: 2017-09-28 11:55:51.649 8944 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:55:51 ctl02 nova-api[8944]: 2017-09-28 11:55:51.649 8944 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:55:51 ctl02 nova-api[8944]: 2017-09-28 11:55:51.652 8944 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:55:51 ctl02 nova-api[8944]: 2017-09-28 11:55:51.653 8944 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:55:51 ctl02 nova-api[8944]: 2017-09-28 11:55:51.653 8944 ERROR nova Traceback (most recent call last):
Sep 28 11:55:51 ctl02 nova-api[8944]: 2017-09-28 11:55:51.653 8944 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:55:51 ctl02 nova-api[8944]: 2017-09-28 11:55:51.653 8944 ERROR nova     sys.exit(main())
Sep 28 11:55:51 ctl02 nova-api[8944]: 2017-09-28 11:55:51.653 8944 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:55:51 ctl02 nova-api[8944]: 2017-09-28 11:55:51.653 8944 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:55:51 ctl02 nova-api[8944]: 2017-09-28 11:55:51.653 8944 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:55:51 ctl02 nova-api[8944]: 2017-09-28 11:55:51.653 8944 ERROR nova     max_url_len=max_url_len)
Sep 28 11:55:51 ctl02 nova-api[8944]: 2017-09-28 11:55:51.653 8944 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:55:51 ctl02 nova-api[8944]: 2017-09-28 11:55:51.653 8944 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:55:51 ctl02 nova-api[8944]: 2017-09-28 11:55:51.653 8944 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:55:51 ctl02 nova-api[8944]: 2017-09-28 11:55:51.653 8944 ERROR nova     sock.listen(backlog)
Sep 28 11:55:51 ctl02 nova-api[8944]: 2017-09-28 11:55:51.653 8944 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:55:51 ctl02 nova-api[8944]: 2017-09-28 11:55:51.653 8944 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:55:51 ctl02 nova-api[8944]: 2017-09-28 11:55:51.653 8944 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:55:51 ctl02 nova-api[8944]: 2017-09-28 11:55:51.653 8944 ERROR nova
Sep 28 11:55:51 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:55:51 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:55:51 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:55:52 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:55:52 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:55:52 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:55:52 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:55:52 ctl02 glance-api[29183]: 2017-09-28 11:55:52.911 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:55:52] "OPTIONS / HTTP/1.0" 200 134 0.000617
Sep 28 11:55:53 ctl02 nova-api[8961]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:55:53 ctl02 nova-api[8961]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:55:53 ctl02 nova-api[8961]: 2017-09-28 11:55:53.842 8961 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:55:53 ctl02 nova-api[8961]: 2017-09-28 11:55:53.843 8961 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:55:53 ctl02 nova-api[8961]: 2017-09-28 11:55:53.843 8961 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:55:53 ctl02 nova-api[8961]: 2017-09-28 11:55:53.843 8961 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:55:53 ctl02 nova-api[8961]: 2017-09-28 11:55:53.843 8961 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:55:53 ctl02 nova-api[8961]: 2017-09-28 11:55:53.843 8961 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:55:53 ctl02 nova-api[8961]: 2017-09-28 11:55:53.843 8961 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:55:53 ctl02 nova-api[8961]: 2017-09-28 11:55:53.843 8961 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:55:53 ctl02 nova-api[8961]: 2017-09-28 11:55:53.843 8961 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:55:53 ctl02 nova-api[8961]: 2017-09-28 11:55:53.843 8961 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:55:53 ctl02 nova-api[8961]: 2017-09-28 11:55:53.843 8961 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:55:53 ctl02 nova-api[8961]: 2017-09-28 11:55:53.843 8961 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:55:53 ctl02 nova-api[8961]: 2017-09-28 11:55:53.843 8961 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:55:53 ctl02 nova-api[8961]: 2017-09-28 11:55:53.843 8961 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:55:53 ctl02 nova-api[8961]: 2017-09-28 11:55:53.843 8961 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:55:53 ctl02 nova-api[8961]: 2017-09-28 11:55:53.843 8961 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:55:53 ctl02 nova-api[8961]: 2017-09-28 11:55:53.843 8961 ERROR nova.wsgi     self.filename))
Sep 28 11:55:53 ctl02 nova-api[8961]: 2017-09-28 11:55:53.843 8961 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:55:53 ctl02 nova-api[8961]: 2017-09-28 11:55:53.843 8961 ERROR nova.wsgi
Sep 28 11:55:53 ctl02 nova-api[8961]: 2017-09-28 11:55:53.844 8961 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:55:53 ctl02 nova-api[8961]: 2017-09-28 11:55:53.976 8961 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:55:54 ctl02 nova-api[8961]: 2017-09-28 11:55:54.212 8961 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:55:54 ctl02 nova-api[8961]: 2017-09-28 11:55:54.214 8961 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:55:54 ctl02 nova-api[8961]: 2017-09-28 11:55:54.214 8961 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:55:54 ctl02 nova-api[8961]: 2017-09-28 11:55:54.215 8961 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:55:54 ctl02 nova-api[8961]: 2017-09-28 11:55:54.346 8961 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:55:54 ctl02 nova-api[8961]: 2017-09-28 11:55:54.349 8961 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:55:54 ctl02 nova-api[8961]: 2017-09-28 11:55:54.349 8961 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:55:54 ctl02 nova-api[8961]: 2017-09-28 11:55:54.350 8961 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:55:54 ctl02 nova-api[8961]: 2017-09-28 11:55:54.353 8961 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:55:54 ctl02 nova-api[8961]: 2017-09-28 11:55:54.354 8961 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:55:54 ctl02 nova-api[8961]: 2017-09-28 11:55:54.354 8961 ERROR nova Traceback (most recent call last):
Sep 28 11:55:54 ctl02 nova-api[8961]: 2017-09-28 11:55:54.354 8961 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:55:54 ctl02 nova-api[8961]: 2017-09-28 11:55:54.354 8961 ERROR nova     sys.exit(main())
Sep 28 11:55:54 ctl02 nova-api[8961]: 2017-09-28 11:55:54.354 8961 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:55:54 ctl02 nova-api[8961]: 2017-09-28 11:55:54.354 8961 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:55:54 ctl02 nova-api[8961]: 2017-09-28 11:55:54.354 8961 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:55:54 ctl02 nova-api[8961]: 2017-09-28 11:55:54.354 8961 ERROR nova     max_url_len=max_url_len)
Sep 28 11:55:54 ctl02 nova-api[8961]: 2017-09-28 11:55:54.354 8961 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:55:54 ctl02 nova-api[8961]: 2017-09-28 11:55:54.354 8961 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:55:54 ctl02 nova-api[8961]: 2017-09-28 11:55:54.354 8961 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:55:54 ctl02 nova-api[8961]: 2017-09-28 11:55:54.354 8961 ERROR nova     sock.listen(backlog)
Sep 28 11:55:54 ctl02 nova-api[8961]: 2017-09-28 11:55:54.354 8961 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:55:54 ctl02 nova-api[8961]: 2017-09-28 11:55:54.354 8961 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:55:54 ctl02 nova-api[8961]: 2017-09-28 11:55:54.354 8961 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:55:54 ctl02 nova-api[8961]: 2017-09-28 11:55:54.354 8961 ERROR nova
Sep 28 11:55:54 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:55:54 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:55:54 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:55:54 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:55:54 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:55:54 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:55:54 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:55:56 ctl02 nova-api[8980]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:55:56 ctl02 nova-api[8980]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:55:56 ctl02 nova-api[8980]: 2017-09-28 11:55:56.365 8980 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:55:56 ctl02 nova-api[8980]: 2017-09-28 11:55:56.366 8980 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:55:56 ctl02 nova-api[8980]: 2017-09-28 11:55:56.366 8980 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:55:56 ctl02 nova-api[8980]: 2017-09-28 11:55:56.366 8980 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:55:56 ctl02 nova-api[8980]: 2017-09-28 11:55:56.366 8980 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:55:56 ctl02 nova-api[8980]: 2017-09-28 11:55:56.366 8980 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:55:56 ctl02 nova-api[8980]: 2017-09-28 11:55:56.366 8980 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:55:56 ctl02 nova-api[8980]: 2017-09-28 11:55:56.366 8980 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:55:56 ctl02 nova-api[8980]: 2017-09-28 11:55:56.366 8980 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:55:56 ctl02 nova-api[8980]: 2017-09-28 11:55:56.366 8980 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:55:56 ctl02 nova-api[8980]: 2017-09-28 11:55:56.366 8980 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:55:56 ctl02 nova-api[8980]: 2017-09-28 11:55:56.366 8980 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:55:56 ctl02 nova-api[8980]: 2017-09-28 11:55:56.366 8980 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:55:56 ctl02 nova-api[8980]: 2017-09-28 11:55:56.366 8980 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:55:56 ctl02 nova-api[8980]: 2017-09-28 11:55:56.366 8980 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:55:56 ctl02 nova-api[8980]: 2017-09-28 11:55:56.366 8980 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:55:56 ctl02 nova-api[8980]: 2017-09-28 11:55:56.366 8980 ERROR nova.wsgi     self.filename))
Sep 28 11:55:56 ctl02 nova-api[8980]: 2017-09-28 11:55:56.366 8980 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:55:56 ctl02 nova-api[8980]: 2017-09-28 11:55:56.366 8980 ERROR nova.wsgi
Sep 28 11:55:56 ctl02 nova-api[8980]: 2017-09-28 11:55:56.369 8980 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:55:56 ctl02 nova-api[8980]: 2017-09-28 11:55:56.518 8980 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:55:56 ctl02 glance-api[29183]: 2017-09-28 11:55:56.742 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:55:56] "OPTIONS / HTTP/1.0" 200 134 0.001149
Sep 28 11:55:56 ctl02 nova-api[8980]: 2017-09-28 11:55:56.762 8980 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:55:56 ctl02 nova-api[8980]: 2017-09-28 11:55:56.765 8980 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:55:56 ctl02 nova-api[8980]: 2017-09-28 11:55:56.765 8980 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:55:56 ctl02 nova-api[8980]: 2017-09-28 11:55:56.765 8980 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:55:56 ctl02 nova-api[8980]: 2017-09-28 11:55:56.896 8980 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:55:56 ctl02 nova-api[8980]: 2017-09-28 11:55:56.898 8980 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:55:56 ctl02 nova-api[8980]: 2017-09-28 11:55:56.898 8980 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:55:56 ctl02 nova-api[8980]: 2017-09-28 11:55:56.898 8980 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:55:56 ctl02 nova-api[8980]: 2017-09-28 11:55:56.902 8980 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:55:56 ctl02 nova-api[8980]: 2017-09-28 11:55:56.902 8980 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:55:56 ctl02 nova-api[8980]: 2017-09-28 11:55:56.902 8980 ERROR nova Traceback (most recent call last):
Sep 28 11:55:56 ctl02 nova-api[8980]: 2017-09-28 11:55:56.902 8980 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:55:56 ctl02 nova-api[8980]: 2017-09-28 11:55:56.902 8980 ERROR nova     sys.exit(main())
Sep 28 11:55:56 ctl02 nova-api[8980]: 2017-09-28 11:55:56.902 8980 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:55:56 ctl02 nova-api[8980]: 2017-09-28 11:55:56.902 8980 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:55:56 ctl02 nova-api[8980]: 2017-09-28 11:55:56.902 8980 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:55:56 ctl02 nova-api[8980]: 2017-09-28 11:55:56.902 8980 ERROR nova     max_url_len=max_url_len)
Sep 28 11:55:56 ctl02 nova-api[8980]: 2017-09-28 11:55:56.902 8980 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:55:56 ctl02 nova-api[8980]: 2017-09-28 11:55:56.902 8980 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:55:56 ctl02 nova-api[8980]: 2017-09-28 11:55:56.902 8980 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:55:56 ctl02 nova-api[8980]: 2017-09-28 11:55:56.902 8980 ERROR nova     sock.listen(backlog)
Sep 28 11:55:56 ctl02 nova-api[8980]: 2017-09-28 11:55:56.902 8980 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:55:56 ctl02 nova-api[8980]: 2017-09-28 11:55:56.902 8980 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:55:56 ctl02 nova-api[8980]: 2017-09-28 11:55:56.902 8980 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:55:56 ctl02 nova-api[8980]: 2017-09-28 11:55:56.902 8980 ERROR nova
Sep 28 11:55:57 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:55:57 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:55:57 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:55:57 ctl02 nova-consoleauth[5433]: 2017-09-28 11:55:57.242 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:55:57 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:55:57 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:55:57 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:55:57 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:55:57 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc7e9b83c)
Sep 28 11:55:57 ctl02 glance-api[29183]: 2017-09-28 11:55:57.963 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:55:57] "OPTIONS / HTTP/1.0" 200 134 0.000714
Sep 28 11:55:58 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc7e9b83c)
Sep 28 11:55:58 ctl02 nova-api[8998]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:55:58 ctl02 nova-api[8998]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:55:59 ctl02 nova-api[8998]: 2017-09-28 11:55:59.092 8998 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:55:59 ctl02 nova-api[8998]: 2017-09-28 11:55:59.094 8998 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:55:59 ctl02 nova-api[8998]: 2017-09-28 11:55:59.094 8998 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:55:59 ctl02 nova-api[8998]: 2017-09-28 11:55:59.094 8998 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:55:59 ctl02 nova-api[8998]: 2017-09-28 11:55:59.094 8998 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:55:59 ctl02 nova-api[8998]: 2017-09-28 11:55:59.094 8998 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:55:59 ctl02 nova-api[8998]: 2017-09-28 11:55:59.094 8998 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:55:59 ctl02 nova-api[8998]: 2017-09-28 11:55:59.094 8998 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:55:59 ctl02 nova-api[8998]: 2017-09-28 11:55:59.094 8998 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:55:59 ctl02 nova-api[8998]: 2017-09-28 11:55:59.094 8998 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:55:59 ctl02 nova-api[8998]: 2017-09-28 11:55:59.094 8998 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:55:59 ctl02 nova-api[8998]: 2017-09-28 11:55:59.094 8998 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:55:59 ctl02 nova-api[8998]: 2017-09-28 11:55:59.094 8998 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:55:59 ctl02 nova-api[8998]: 2017-09-28 11:55:59.094 8998 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:55:59 ctl02 nova-api[8998]: 2017-09-28 11:55:59.094 8998 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:55:59 ctl02 nova-api[8998]: 2017-09-28 11:55:59.094 8998 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:55:59 ctl02 nova-api[8998]: 2017-09-28 11:55:59.094 8998 ERROR nova.wsgi     self.filename))
Sep 28 11:55:59 ctl02 nova-api[8998]: 2017-09-28 11:55:59.094 8998 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:55:59 ctl02 nova-api[8998]: 2017-09-28 11:55:59.094 8998 ERROR nova.wsgi
Sep 28 11:55:59 ctl02 nova-api[8998]: 2017-09-28 11:55:59.095 8998 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:55:59 ctl02 nova-api[8998]: 2017-09-28 11:55:59.229 8998 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:55:59 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc7e9b83c)
Sep 28 11:55:59 ctl02 nova-api[8998]: 2017-09-28 11:55:59.474 8998 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:55:59 ctl02 nova-api[8998]: 2017-09-28 11:55:59.476 8998 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:55:59 ctl02 nova-api[8998]: 2017-09-28 11:55:59.477 8998 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:55:59 ctl02 nova-api[8998]: 2017-09-28 11:55:59.477 8998 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:55:59 ctl02 nova-api[8998]: 2017-09-28 11:55:59.608 8998 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:55:59 ctl02 nova-api[8998]: 2017-09-28 11:55:59.610 8998 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:55:59 ctl02 nova-api[8998]: 2017-09-28 11:55:59.610 8998 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:55:59 ctl02 nova-api[8998]: 2017-09-28 11:55:59.611 8998 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:55:59 ctl02 nova-api[8998]: 2017-09-28 11:55:59.614 8998 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:55:59 ctl02 nova-api[8998]: 2017-09-28 11:55:59.614 8998 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:55:59 ctl02 nova-api[8998]: 2017-09-28 11:55:59.614 8998 ERROR nova Traceback (most recent call last):
Sep 28 11:55:59 ctl02 nova-api[8998]: 2017-09-28 11:55:59.614 8998 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:55:59 ctl02 nova-api[8998]: 2017-09-28 11:55:59.614 8998 ERROR nova     sys.exit(main())
Sep 28 11:55:59 ctl02 nova-api[8998]: 2017-09-28 11:55:59.614 8998 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:55:59 ctl02 nova-api[8998]: 2017-09-28 11:55:59.614 8998 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:55:59 ctl02 nova-api[8998]: 2017-09-28 11:55:59.614 8998 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:55:59 ctl02 nova-api[8998]: 2017-09-28 11:55:59.614 8998 ERROR nova     max_url_len=max_url_len)
Sep 28 11:55:59 ctl02 nova-api[8998]: 2017-09-28 11:55:59.614 8998 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:55:59 ctl02 nova-api[8998]: 2017-09-28 11:55:59.614 8998 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:55:59 ctl02 nova-api[8998]: 2017-09-28 11:55:59.614 8998 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:55:59 ctl02 nova-api[8998]: 2017-09-28 11:55:59.614 8998 ERROR nova     sock.listen(backlog)
Sep 28 11:55:59 ctl02 nova-api[8998]: 2017-09-28 11:55:59.614 8998 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:55:59 ctl02 nova-api[8998]: 2017-09-28 11:55:59.614 8998 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:55:59 ctl02 nova-api[8998]: 2017-09-28 11:55:59.614 8998 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:55:59 ctl02 nova-api[8998]: 2017-09-28 11:55:59.614 8998 ERROR nova
Sep 28 11:55:59 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:55:59 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:55:59 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:55:59 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:55:59 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:55:59 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:55:59 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:56:00 ctl02 nova-scheduler[5620]: 2017-09-28 11:56:00.264 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:56:00 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc7e9b83c)
Sep 28 11:56:01 ctl02 nova-api[9016]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:56:01 ctl02 nova-api[9016]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:56:01 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc7e9b83c)
Sep 28 11:56:01 ctl02 nova-api[9016]: 2017-09-28 11:56:01.586 9016 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:56:01 ctl02 nova-api[9016]: 2017-09-28 11:56:01.588 9016 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:56:01 ctl02 nova-api[9016]: 2017-09-28 11:56:01.588 9016 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:56:01 ctl02 nova-api[9016]: 2017-09-28 11:56:01.588 9016 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:56:01 ctl02 nova-api[9016]: 2017-09-28 11:56:01.588 9016 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:56:01 ctl02 nova-api[9016]: 2017-09-28 11:56:01.588 9016 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:56:01 ctl02 nova-api[9016]: 2017-09-28 11:56:01.588 9016 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:56:01 ctl02 nova-api[9016]: 2017-09-28 11:56:01.588 9016 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:56:01 ctl02 nova-api[9016]: 2017-09-28 11:56:01.588 9016 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:56:01 ctl02 nova-api[9016]: 2017-09-28 11:56:01.588 9016 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:56:01 ctl02 nova-api[9016]: 2017-09-28 11:56:01.588 9016 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:56:01 ctl02 nova-api[9016]: 2017-09-28 11:56:01.588 9016 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:56:01 ctl02 nova-api[9016]: 2017-09-28 11:56:01.588 9016 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:56:01 ctl02 nova-api[9016]: 2017-09-28 11:56:01.588 9016 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:56:01 ctl02 nova-api[9016]: 2017-09-28 11:56:01.588 9016 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:56:01 ctl02 nova-api[9016]: 2017-09-28 11:56:01.588 9016 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:56:01 ctl02 nova-api[9016]: 2017-09-28 11:56:01.588 9016 ERROR nova.wsgi     self.filename))
Sep 28 11:56:01 ctl02 nova-api[9016]: 2017-09-28 11:56:01.588 9016 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:56:01 ctl02 nova-api[9016]: 2017-09-28 11:56:01.588 9016 ERROR nova.wsgi
Sep 28 11:56:01 ctl02 nova-api[9016]: 2017-09-28 11:56:01.589 9016 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:56:01 ctl02 nova-api[9016]: 2017-09-28 11:56:01.719 9016 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:56:01 ctl02 nova-api[9016]: 2017-09-28 11:56:01.957 9016 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:56:01 ctl02 nova-api[9016]: 2017-09-28 11:56:01.959 9016 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:56:01 ctl02 nova-api[9016]: 2017-09-28 11:56:01.959 9016 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:56:01 ctl02 nova-api[9016]: 2017-09-28 11:56:01.959 9016 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:56:02 ctl02 nova-api[9016]: 2017-09-28 11:56:02.088 9016 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:56:02 ctl02 nova-api[9016]: 2017-09-28 11:56:02.090 9016 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:56:02 ctl02 nova-api[9016]: 2017-09-28 11:56:02.090 9016 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:56:02 ctl02 nova-api[9016]: 2017-09-28 11:56:02.090 9016 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:56:02 ctl02 nova-api[9016]: 2017-09-28 11:56:02.094 9016 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:56:02 ctl02 nova-api[9016]: 2017-09-28 11:56:02.094 9016 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:56:02 ctl02 nova-api[9016]: 2017-09-28 11:56:02.094 9016 ERROR nova Traceback (most recent call last):
Sep 28 11:56:02 ctl02 nova-api[9016]: 2017-09-28 11:56:02.094 9016 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:56:02 ctl02 nova-api[9016]: 2017-09-28 11:56:02.094 9016 ERROR nova     sys.exit(main())
Sep 28 11:56:02 ctl02 nova-api[9016]: 2017-09-28 11:56:02.094 9016 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:56:02 ctl02 nova-api[9016]: 2017-09-28 11:56:02.094 9016 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:56:02 ctl02 nova-api[9016]: 2017-09-28 11:56:02.094 9016 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:56:02 ctl02 nova-api[9016]: 2017-09-28 11:56:02.094 9016 ERROR nova     max_url_len=max_url_len)
Sep 28 11:56:02 ctl02 nova-api[9016]: 2017-09-28 11:56:02.094 9016 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:56:02 ctl02 nova-api[9016]: 2017-09-28 11:56:02.094 9016 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:56:02 ctl02 nova-api[9016]: 2017-09-28 11:56:02.094 9016 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:56:02 ctl02 nova-api[9016]: 2017-09-28 11:56:02.094 9016 ERROR nova     sock.listen(backlog)
Sep 28 11:56:02 ctl02 nova-api[9016]: 2017-09-28 11:56:02.094 9016 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:56:02 ctl02 nova-api[9016]: 2017-09-28 11:56:02.094 9016 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:56:02 ctl02 nova-api[9016]: 2017-09-28 11:56:02.094 9016 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:56:02 ctl02 nova-api[9016]: 2017-09-28 11:56:02.094 9016 ERROR nova
Sep 28 11:56:02 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:56:02 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:56:02 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:56:02 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:56:02 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:56:02 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:56:02 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:56:02 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc7e9b83c)
Sep 28 11:56:03 ctl02 glance-api[29183]: 2017-09-28 11:56:03.008 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:56:03] "OPTIONS / HTTP/1.0" 200 134 0.000761
Sep 28 11:56:03 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc7e9b83c)
Sep 28 11:56:03 ctl02 nova-api[9034]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:56:03 ctl02 nova-api[9034]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:56:04 ctl02 nova-api[9034]: 2017-09-28 11:56:04.100 9034 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:56:04 ctl02 nova-api[9034]: 2017-09-28 11:56:04.102 9034 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:56:04 ctl02 nova-api[9034]: 2017-09-28 11:56:04.102 9034 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:56:04 ctl02 nova-api[9034]: 2017-09-28 11:56:04.102 9034 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:56:04 ctl02 nova-api[9034]: 2017-09-28 11:56:04.102 9034 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:56:04 ctl02 nova-api[9034]: 2017-09-28 11:56:04.102 9034 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:56:04 ctl02 nova-api[9034]: 2017-09-28 11:56:04.102 9034 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:56:04 ctl02 nova-api[9034]: 2017-09-28 11:56:04.102 9034 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:56:04 ctl02 nova-api[9034]: 2017-09-28 11:56:04.102 9034 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:56:04 ctl02 nova-api[9034]: 2017-09-28 11:56:04.102 9034 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:56:04 ctl02 nova-api[9034]: 2017-09-28 11:56:04.102 9034 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:56:04 ctl02 nova-api[9034]: 2017-09-28 11:56:04.102 9034 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:56:04 ctl02 nova-api[9034]: 2017-09-28 11:56:04.102 9034 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:56:04 ctl02 nova-api[9034]: 2017-09-28 11:56:04.102 9034 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:56:04 ctl02 nova-api[9034]: 2017-09-28 11:56:04.102 9034 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:56:04 ctl02 nova-api[9034]: 2017-09-28 11:56:04.102 9034 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:56:04 ctl02 nova-api[9034]: 2017-09-28 11:56:04.102 9034 ERROR nova.wsgi     self.filename))
Sep 28 11:56:04 ctl02 nova-api[9034]: 2017-09-28 11:56:04.102 9034 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:56:04 ctl02 nova-api[9034]: 2017-09-28 11:56:04.102 9034 ERROR nova.wsgi
Sep 28 11:56:04 ctl02 nova-api[9034]: 2017-09-28 11:56:04.103 9034 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:56:04 ctl02 nova-api[9034]: 2017-09-28 11:56:04.237 9034 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:56:04 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc7e9b83c)
Sep 28 11:56:04 ctl02 nova-api[9034]: 2017-09-28 11:56:04.482 9034 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:56:04 ctl02 nova-api[9034]: 2017-09-28 11:56:04.484 9034 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:56:04 ctl02 nova-api[9034]: 2017-09-28 11:56:04.484 9034 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:56:04 ctl02 nova-api[9034]: 2017-09-28 11:56:04.485 9034 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:56:04 ctl02 nova-api[9034]: 2017-09-28 11:56:04.616 9034 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:56:04 ctl02 nova-api[9034]: 2017-09-28 11:56:04.618 9034 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:56:04 ctl02 nova-api[9034]: 2017-09-28 11:56:04.618 9034 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:56:04 ctl02 nova-api[9034]: 2017-09-28 11:56:04.618 9034 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:56:04 ctl02 nova-api[9034]: 2017-09-28 11:56:04.622 9034 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:56:04 ctl02 nova-api[9034]: 2017-09-28 11:56:04.622 9034 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:56:04 ctl02 nova-api[9034]: 2017-09-28 11:56:04.622 9034 ERROR nova Traceback (most recent call last):
Sep 28 11:56:04 ctl02 nova-api[9034]: 2017-09-28 11:56:04.622 9034 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:56:04 ctl02 nova-api[9034]: 2017-09-28 11:56:04.622 9034 ERROR nova     sys.exit(main())
Sep 28 11:56:04 ctl02 nova-api[9034]: 2017-09-28 11:56:04.622 9034 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:56:04 ctl02 nova-api[9034]: 2017-09-28 11:56:04.622 9034 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:56:04 ctl02 nova-api[9034]: 2017-09-28 11:56:04.622 9034 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:56:04 ctl02 nova-api[9034]: 2017-09-28 11:56:04.622 9034 ERROR nova     max_url_len=max_url_len)
Sep 28 11:56:04 ctl02 nova-api[9034]: 2017-09-28 11:56:04.622 9034 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:56:04 ctl02 nova-api[9034]: 2017-09-28 11:56:04.622 9034 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:56:04 ctl02 nova-api[9034]: 2017-09-28 11:56:04.622 9034 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:56:04 ctl02 nova-api[9034]: 2017-09-28 11:56:04.622 9034 ERROR nova     sock.listen(backlog)
Sep 28 11:56:04 ctl02 nova-api[9034]: 2017-09-28 11:56:04.622 9034 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:56:04 ctl02 nova-api[9034]: 2017-09-28 11:56:04.622 9034 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:56:04 ctl02 nova-api[9034]: 2017-09-28 11:56:04.622 9034 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:56:04 ctl02 nova-api[9034]: 2017-09-28 11:56:04.622 9034 ERROR nova
Sep 28 11:56:04 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:56:04 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:56:04 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:56:05 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:56:05 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:56:05 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:56:05 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:56:05 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc7e9b83c)
Sep 28 11:56:06 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc7e9b83c)
Sep 28 11:56:06 ctl02 nova-api[9052]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:56:06 ctl02 nova-api[9052]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:56:06 ctl02 glance-api[29183]: 2017-09-28 11:56:06.876 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:56:06] "OPTIONS / HTTP/1.0" 200 134 0.000643
Sep 28 11:56:06 ctl02 nova-api[9052]: 2017-09-28 11:56:06.912 9052 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:56:06 ctl02 nova-api[9052]: 2017-09-28 11:56:06.913 9052 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:56:06 ctl02 nova-api[9052]: 2017-09-28 11:56:06.913 9052 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:56:06 ctl02 nova-api[9052]: 2017-09-28 11:56:06.913 9052 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:56:06 ctl02 nova-api[9052]: 2017-09-28 11:56:06.913 9052 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:56:06 ctl02 nova-api[9052]: 2017-09-28 11:56:06.913 9052 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:56:06 ctl02 nova-api[9052]: 2017-09-28 11:56:06.913 9052 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:56:06 ctl02 nova-api[9052]: 2017-09-28 11:56:06.913 9052 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:56:06 ctl02 nova-api[9052]: 2017-09-28 11:56:06.913 9052 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:56:06 ctl02 nova-api[9052]: 2017-09-28 11:56:06.913 9052 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:56:06 ctl02 nova-api[9052]: 2017-09-28 11:56:06.913 9052 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:56:06 ctl02 nova-api[9052]: 2017-09-28 11:56:06.913 9052 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:56:06 ctl02 nova-api[9052]: 2017-09-28 11:56:06.913 9052 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:56:06 ctl02 nova-api[9052]: 2017-09-28 11:56:06.913 9052 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:56:06 ctl02 nova-api[9052]: 2017-09-28 11:56:06.913 9052 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:56:06 ctl02 nova-api[9052]: 2017-09-28 11:56:06.913 9052 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:56:06 ctl02 nova-api[9052]: 2017-09-28 11:56:06.913 9052 ERROR nova.wsgi     self.filename))
Sep 28 11:56:06 ctl02 nova-api[9052]: 2017-09-28 11:56:06.913 9052 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:56:06 ctl02 nova-api[9052]: 2017-09-28 11:56:06.913 9052 ERROR nova.wsgi
Sep 28 11:56:06 ctl02 nova-api[9052]: 2017-09-28 11:56:06.916 9052 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:56:07 ctl02 nova-api[9052]: 2017-09-28 11:56:07.047 9052 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:56:07 ctl02 nova-api[9052]: 2017-09-28 11:56:07.284 9052 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:56:07 ctl02 nova-api[9052]: 2017-09-28 11:56:07.287 9052 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:56:07 ctl02 nova-api[9052]: 2017-09-28 11:56:07.288 9052 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:56:07 ctl02 nova-api[9052]: 2017-09-28 11:56:07.288 9052 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:56:07 ctl02 nova-api[9052]: 2017-09-28 11:56:07.422 9052 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:56:07 ctl02 nova-api[9052]: 2017-09-28 11:56:07.424 9052 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:56:07 ctl02 nova-api[9052]: 2017-09-28 11:56:07.425 9052 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:56:07 ctl02 nova-api[9052]: 2017-09-28 11:56:07.425 9052 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:56:07 ctl02 nova-api[9052]: 2017-09-28 11:56:07.428 9052 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:56:07 ctl02 nova-api[9052]: 2017-09-28 11:56:07.429 9052 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:56:07 ctl02 nova-api[9052]: 2017-09-28 11:56:07.429 9052 ERROR nova Traceback (most recent call last):
Sep 28 11:56:07 ctl02 nova-api[9052]: 2017-09-28 11:56:07.429 9052 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:56:07 ctl02 nova-api[9052]: 2017-09-28 11:56:07.429 9052 ERROR nova     sys.exit(main())
Sep 28 11:56:07 ctl02 nova-api[9052]: 2017-09-28 11:56:07.429 9052 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:56:07 ctl02 nova-api[9052]: 2017-09-28 11:56:07.429 9052 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:56:07 ctl02 nova-api[9052]: 2017-09-28 11:56:07.429 9052 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:56:07 ctl02 nova-api[9052]: 2017-09-28 11:56:07.429 9052 ERROR nova     max_url_len=max_url_len)
Sep 28 11:56:07 ctl02 nova-api[9052]: 2017-09-28 11:56:07.429 9052 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:56:07 ctl02 nova-api[9052]: 2017-09-28 11:56:07.429 9052 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:56:07 ctl02 nova-api[9052]: 2017-09-28 11:56:07.429 9052 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:56:07 ctl02 nova-api[9052]: 2017-09-28 11:56:07.429 9052 ERROR nova     sock.listen(backlog)
Sep 28 11:56:07 ctl02 nova-api[9052]: 2017-09-28 11:56:07.429 9052 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:56:07 ctl02 nova-api[9052]: 2017-09-28 11:56:07.429 9052 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:56:07 ctl02 nova-api[9052]: 2017-09-28 11:56:07.429 9052 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:56:07 ctl02 nova-api[9052]: 2017-09-28 11:56:07.429 9052 ERROR nova
Sep 28 11:56:07 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc7e9b83c)
Sep 28 11:56:07 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:56:07 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:56:07 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:56:07 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:56:07 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:56:07 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:56:07 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:56:08 ctl02 glance-api[29183]: 2017-09-28 11:56:08.340 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:56:08] "OPTIONS / HTTP/1.0" 200 134 0.000768
Sep 28 11:56:08 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:56:08 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:56:09 ctl02 nova-api[9071]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:56:09 ctl02 nova-api[9071]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:56:09 ctl02 nova-api[9071]: 2017-09-28 11:56:09.608 9071 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:56:09 ctl02 nova-api[9071]: 2017-09-28 11:56:09.609 9071 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:56:09 ctl02 nova-api[9071]: 2017-09-28 11:56:09.609 9071 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:56:09 ctl02 nova-api[9071]: 2017-09-28 11:56:09.609 9071 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:56:09 ctl02 nova-api[9071]: 2017-09-28 11:56:09.609 9071 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:56:09 ctl02 nova-api[9071]: 2017-09-28 11:56:09.609 9071 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:56:09 ctl02 nova-api[9071]: 2017-09-28 11:56:09.609 9071 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:56:09 ctl02 nova-api[9071]: 2017-09-28 11:56:09.609 9071 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:56:09 ctl02 nova-api[9071]: 2017-09-28 11:56:09.609 9071 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:56:09 ctl02 nova-api[9071]: 2017-09-28 11:56:09.609 9071 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:56:09 ctl02 nova-api[9071]: 2017-09-28 11:56:09.609 9071 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:56:09 ctl02 nova-api[9071]: 2017-09-28 11:56:09.609 9071 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:56:09 ctl02 nova-api[9071]: 2017-09-28 11:56:09.609 9071 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:56:09 ctl02 nova-api[9071]: 2017-09-28 11:56:09.609 9071 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:56:09 ctl02 nova-api[9071]: 2017-09-28 11:56:09.609 9071 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:56:09 ctl02 nova-api[9071]: 2017-09-28 11:56:09.609 9071 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:56:09 ctl02 nova-api[9071]: 2017-09-28 11:56:09.609 9071 ERROR nova.wsgi     self.filename))
Sep 28 11:56:09 ctl02 nova-api[9071]: 2017-09-28 11:56:09.609 9071 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:56:09 ctl02 nova-api[9071]: 2017-09-28 11:56:09.609 9071 ERROR nova.wsgi
Sep 28 11:56:09 ctl02 nova-api[9071]: 2017-09-28 11:56:09.611 9071 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:56:09 ctl02 nova-api[9071]: 2017-09-28 11:56:09.743 9071 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:56:09 ctl02 nova-api[9071]: 2017-09-28 11:56:09.984 9071 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:56:09 ctl02 nova-api[9071]: 2017-09-28 11:56:09.987 9071 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:56:09 ctl02 nova-api[9071]: 2017-09-28 11:56:09.987 9071 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:56:09 ctl02 nova-api[9071]: 2017-09-28 11:56:09.988 9071 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:56:10 ctl02 nova-api[9071]: 2017-09-28 11:56:10.119 9071 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:56:10 ctl02 nova-api[9071]: 2017-09-28 11:56:10.122 9071 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:56:10 ctl02 nova-api[9071]: 2017-09-28 11:56:10.122 9071 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:56:10 ctl02 nova-api[9071]: 2017-09-28 11:56:10.123 9071 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:56:10 ctl02 nova-api[9071]: 2017-09-28 11:56:10.126 9071 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:56:10 ctl02 nova-api[9071]: 2017-09-28 11:56:10.126 9071 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:56:10 ctl02 nova-api[9071]: 2017-09-28 11:56:10.126 9071 ERROR nova Traceback (most recent call last):
Sep 28 11:56:10 ctl02 nova-api[9071]: 2017-09-28 11:56:10.126 9071 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:56:10 ctl02 nova-api[9071]: 2017-09-28 11:56:10.126 9071 ERROR nova     sys.exit(main())
Sep 28 11:56:10 ctl02 nova-api[9071]: 2017-09-28 11:56:10.126 9071 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:56:10 ctl02 nova-api[9071]: 2017-09-28 11:56:10.126 9071 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:56:10 ctl02 nova-api[9071]: 2017-09-28 11:56:10.126 9071 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:56:10 ctl02 nova-api[9071]: 2017-09-28 11:56:10.126 9071 ERROR nova     max_url_len=max_url_len)
Sep 28 11:56:10 ctl02 nova-api[9071]: 2017-09-28 11:56:10.126 9071 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:56:10 ctl02 nova-api[9071]: 2017-09-28 11:56:10.126 9071 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:56:10 ctl02 nova-api[9071]: 2017-09-28 11:56:10.126 9071 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:56:10 ctl02 nova-api[9071]: 2017-09-28 11:56:10.126 9071 ERROR nova     sock.listen(backlog)
Sep 28 11:56:10 ctl02 nova-api[9071]: 2017-09-28 11:56:10.126 9071 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:56:10 ctl02 nova-api[9071]: 2017-09-28 11:56:10.126 9071 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:56:10 ctl02 nova-api[9071]: 2017-09-28 11:56:10.126 9071 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:56:10 ctl02 nova-api[9071]: 2017-09-28 11:56:10.126 9071 ERROR nova
Sep 28 11:56:10 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:56:10 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:56:10 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:56:10 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:56:10 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:56:10 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:56:10 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:56:12 ctl02 nova-api[9094]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:56:12 ctl02 nova-api[9094]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:56:12 ctl02 nova-api[9094]: 2017-09-28 11:56:12.373 9094 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:56:12 ctl02 nova-api[9094]: 2017-09-28 11:56:12.374 9094 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:56:12 ctl02 nova-api[9094]: 2017-09-28 11:56:12.374 9094 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:56:12 ctl02 nova-api[9094]: 2017-09-28 11:56:12.374 9094 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:56:12 ctl02 nova-api[9094]: 2017-09-28 11:56:12.374 9094 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:56:12 ctl02 nova-api[9094]: 2017-09-28 11:56:12.374 9094 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:56:12 ctl02 nova-api[9094]: 2017-09-28 11:56:12.374 9094 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:56:12 ctl02 nova-api[9094]: 2017-09-28 11:56:12.374 9094 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:56:12 ctl02 nova-api[9094]: 2017-09-28 11:56:12.374 9094 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:56:12 ctl02 nova-api[9094]: 2017-09-28 11:56:12.374 9094 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:56:12 ctl02 nova-api[9094]: 2017-09-28 11:56:12.374 9094 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:56:12 ctl02 nova-api[9094]: 2017-09-28 11:56:12.374 9094 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:56:12 ctl02 nova-api[9094]: 2017-09-28 11:56:12.374 9094 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:56:12 ctl02 nova-api[9094]: 2017-09-28 11:56:12.374 9094 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:56:12 ctl02 nova-api[9094]: 2017-09-28 11:56:12.374 9094 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:56:12 ctl02 nova-api[9094]: 2017-09-28 11:56:12.374 9094 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:56:12 ctl02 nova-api[9094]: 2017-09-28 11:56:12.374 9094 ERROR nova.wsgi     self.filename))
Sep 28 11:56:12 ctl02 nova-api[9094]: 2017-09-28 11:56:12.374 9094 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:56:12 ctl02 nova-api[9094]: 2017-09-28 11:56:12.374 9094 ERROR nova.wsgi
Sep 28 11:56:12 ctl02 nova-api[9094]: 2017-09-28 11:56:12.377 9094 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:56:12 ctl02 nova-api[9094]: 2017-09-28 11:56:12.512 9094 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:56:12 ctl02 nova-api[9094]: 2017-09-28 11:56:12.756 9094 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:56:12 ctl02 nova-api[9094]: 2017-09-28 11:56:12.759 9094 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:56:12 ctl02 nova-api[9094]: 2017-09-28 11:56:12.759 9094 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:56:12 ctl02 nova-api[9094]: 2017-09-28 11:56:12.760 9094 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:56:12 ctl02 nova-api[9094]: 2017-09-28 11:56:12.891 9094 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:56:12 ctl02 nova-api[9094]: 2017-09-28 11:56:12.893 9094 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:56:12 ctl02 nova-api[9094]: 2017-09-28 11:56:12.894 9094 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:56:12 ctl02 nova-api[9094]: 2017-09-28 11:56:12.894 9094 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:56:12 ctl02 nova-api[9094]: 2017-09-28 11:56:12.898 9094 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:56:12 ctl02 nova-api[9094]: 2017-09-28 11:56:12.898 9094 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:56:12 ctl02 nova-api[9094]: 2017-09-28 11:56:12.898 9094 ERROR nova Traceback (most recent call last):
Sep 28 11:56:12 ctl02 nova-api[9094]: 2017-09-28 11:56:12.898 9094 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:56:12 ctl02 nova-api[9094]: 2017-09-28 11:56:12.898 9094 ERROR nova     sys.exit(main())
Sep 28 11:56:12 ctl02 nova-api[9094]: 2017-09-28 11:56:12.898 9094 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:56:12 ctl02 nova-api[9094]: 2017-09-28 11:56:12.898 9094 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:56:12 ctl02 nova-api[9094]: 2017-09-28 11:56:12.898 9094 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:56:12 ctl02 nova-api[9094]: 2017-09-28 11:56:12.898 9094 ERROR nova     max_url_len=max_url_len)
Sep 28 11:56:12 ctl02 nova-api[9094]: 2017-09-28 11:56:12.898 9094 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:56:12 ctl02 nova-api[9094]: 2017-09-28 11:56:12.898 9094 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:56:12 ctl02 nova-api[9094]: 2017-09-28 11:56:12.898 9094 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:56:12 ctl02 nova-api[9094]: 2017-09-28 11:56:12.898 9094 ERROR nova     sock.listen(backlog)
Sep 28 11:56:12 ctl02 nova-api[9094]: 2017-09-28 11:56:12.898 9094 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:56:12 ctl02 nova-api[9094]: 2017-09-28 11:56:12.898 9094 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:56:12 ctl02 nova-api[9094]: 2017-09-28 11:56:12.898 9094 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:56:12 ctl02 nova-api[9094]: 2017-09-28 11:56:12.898 9094 ERROR nova
Sep 28 11:56:13 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:56:13 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:56:13 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:56:13 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:56:13 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:56:13 ctl02 glance-api[29183]: 2017-09-28 11:56:13.390 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:56:13] "OPTIONS / HTTP/1.0" 200 134 0.001195
Sep 28 11:56:13 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:56:13 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:56:14 ctl02 nova-api[9112]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:56:14 ctl02 nova-api[9112]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:56:15 ctl02 nova-api[9112]: 2017-09-28 11:56:15.113 9112 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:56:15 ctl02 nova-api[9112]: 2017-09-28 11:56:15.114 9112 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:56:15 ctl02 nova-api[9112]: 2017-09-28 11:56:15.114 9112 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:56:15 ctl02 nova-api[9112]: 2017-09-28 11:56:15.114 9112 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:56:15 ctl02 nova-api[9112]: 2017-09-28 11:56:15.114 9112 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:56:15 ctl02 nova-api[9112]: 2017-09-28 11:56:15.114 9112 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:56:15 ctl02 nova-api[9112]: 2017-09-28 11:56:15.114 9112 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:56:15 ctl02 nova-api[9112]: 2017-09-28 11:56:15.114 9112 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:56:15 ctl02 nova-api[9112]: 2017-09-28 11:56:15.114 9112 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:56:15 ctl02 nova-api[9112]: 2017-09-28 11:56:15.114 9112 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:56:15 ctl02 nova-api[9112]: 2017-09-28 11:56:15.114 9112 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:56:15 ctl02 nova-api[9112]: 2017-09-28 11:56:15.114 9112 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:56:15 ctl02 nova-api[9112]: 2017-09-28 11:56:15.114 9112 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:56:15 ctl02 nova-api[9112]: 2017-09-28 11:56:15.114 9112 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:56:15 ctl02 nova-api[9112]: 2017-09-28 11:56:15.114 9112 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:56:15 ctl02 nova-api[9112]: 2017-09-28 11:56:15.114 9112 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:56:15 ctl02 nova-api[9112]: 2017-09-28 11:56:15.114 9112 ERROR nova.wsgi     self.filename))
Sep 28 11:56:15 ctl02 nova-api[9112]: 2017-09-28 11:56:15.114 9112 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:56:15 ctl02 nova-api[9112]: 2017-09-28 11:56:15.114 9112 ERROR nova.wsgi
Sep 28 11:56:15 ctl02 nova-api[9112]: 2017-09-28 11:56:15.115 9112 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:56:15 ctl02 nova-api[9112]: 2017-09-28 11:56:15.249 9112 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:56:15 ctl02 nova-api[9112]: 2017-09-28 11:56:15.494 9112 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:56:15 ctl02 nova-api[9112]: 2017-09-28 11:56:15.497 9112 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:56:15 ctl02 nova-api[9112]: 2017-09-28 11:56:15.497 9112 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:56:15 ctl02 nova-api[9112]: 2017-09-28 11:56:15.497 9112 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:56:15 ctl02 nova-api[9112]: 2017-09-28 11:56:15.631 9112 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:56:15 ctl02 nova-api[9112]: 2017-09-28 11:56:15.633 9112 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:56:15 ctl02 nova-api[9112]: 2017-09-28 11:56:15.633 9112 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:56:15 ctl02 nova-api[9112]: 2017-09-28 11:56:15.634 9112 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:56:15 ctl02 nova-api[9112]: 2017-09-28 11:56:15.637 9112 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:56:15 ctl02 nova-api[9112]: 2017-09-28 11:56:15.638 9112 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:56:15 ctl02 nova-api[9112]: 2017-09-28 11:56:15.638 9112 ERROR nova Traceback (most recent call last):
Sep 28 11:56:15 ctl02 nova-api[9112]: 2017-09-28 11:56:15.638 9112 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:56:15 ctl02 nova-api[9112]: 2017-09-28 11:56:15.638 9112 ERROR nova     sys.exit(main())
Sep 28 11:56:15 ctl02 nova-api[9112]: 2017-09-28 11:56:15.638 9112 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:56:15 ctl02 nova-api[9112]: 2017-09-28 11:56:15.638 9112 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:56:15 ctl02 nova-api[9112]: 2017-09-28 11:56:15.638 9112 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:56:15 ctl02 nova-api[9112]: 2017-09-28 11:56:15.638 9112 ERROR nova     max_url_len=max_url_len)
Sep 28 11:56:15 ctl02 nova-api[9112]: 2017-09-28 11:56:15.638 9112 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:56:15 ctl02 nova-api[9112]: 2017-09-28 11:56:15.638 9112 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:56:15 ctl02 nova-api[9112]: 2017-09-28 11:56:15.638 9112 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:56:15 ctl02 nova-api[9112]: 2017-09-28 11:56:15.638 9112 ERROR nova     sock.listen(backlog)
Sep 28 11:56:15 ctl02 nova-api[9112]: 2017-09-28 11:56:15.638 9112 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:56:15 ctl02 nova-api[9112]: 2017-09-28 11:56:15.638 9112 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:56:15 ctl02 nova-api[9112]: 2017-09-28 11:56:15.638 9112 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:56:15 ctl02 nova-api[9112]: 2017-09-28 11:56:15.638 9112 ERROR nova
Sep 28 11:56:15 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:56:15 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:56:15 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:56:16 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:56:16 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:56:16 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:56:16 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:56:16 ctl02 glance-api[29183]: 2017-09-28 11:56:16.644 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:56:16] "OPTIONS / HTTP/1.0" 200 134 0.001219
Sep 28 11:56:17 ctl02 nova-api[9130]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:56:17 ctl02 nova-api[9130]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:56:17 ctl02 nova-api[9130]: 2017-09-28 11:56:17.912 9130 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:56:17 ctl02 nova-api[9130]: 2017-09-28 11:56:17.914 9130 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:56:17 ctl02 nova-api[9130]: 2017-09-28 11:56:17.914 9130 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:56:17 ctl02 nova-api[9130]: 2017-09-28 11:56:17.914 9130 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:56:17 ctl02 nova-api[9130]: 2017-09-28 11:56:17.914 9130 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:56:17 ctl02 nova-api[9130]: 2017-09-28 11:56:17.914 9130 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:56:17 ctl02 nova-api[9130]: 2017-09-28 11:56:17.914 9130 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:56:17 ctl02 nova-api[9130]: 2017-09-28 11:56:17.914 9130 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:56:17 ctl02 nova-api[9130]: 2017-09-28 11:56:17.914 9130 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:56:17 ctl02 nova-api[9130]: 2017-09-28 11:56:17.914 9130 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:56:17 ctl02 nova-api[9130]: 2017-09-28 11:56:17.914 9130 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:56:17 ctl02 nova-api[9130]: 2017-09-28 11:56:17.914 9130 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:56:17 ctl02 nova-api[9130]: 2017-09-28 11:56:17.914 9130 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:56:17 ctl02 nova-api[9130]: 2017-09-28 11:56:17.914 9130 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:56:17 ctl02 nova-api[9130]: 2017-09-28 11:56:17.914 9130 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:56:17 ctl02 nova-api[9130]: 2017-09-28 11:56:17.914 9130 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:56:17 ctl02 nova-api[9130]: 2017-09-28 11:56:17.914 9130 ERROR nova.wsgi     self.filename))
Sep 28 11:56:17 ctl02 nova-api[9130]: 2017-09-28 11:56:17.914 9130 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:56:17 ctl02 nova-api[9130]: 2017-09-28 11:56:17.914 9130 ERROR nova.wsgi
Sep 28 11:56:17 ctl02 nova-api[9130]: 2017-09-28 11:56:17.916 9130 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:56:18 ctl02 nova-api[9130]: 2017-09-28 11:56:18.049 9130 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:56:18 ctl02 glance-api[29183]: 2017-09-28 11:56:18.157 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:56:18] "OPTIONS / HTTP/1.0" 200 134 0.000690
Sep 28 11:56:18 ctl02 nova-api[9130]: 2017-09-28 11:56:18.296 9130 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:56:18 ctl02 nova-api[9130]: 2017-09-28 11:56:18.299 9130 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:56:18 ctl02 nova-api[9130]: 2017-09-28 11:56:18.299 9130 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:56:18 ctl02 nova-api[9130]: 2017-09-28 11:56:18.300 9130 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:56:18 ctl02 nova-api[9130]: 2017-09-28 11:56:18.431 9130 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:56:18 ctl02 nova-api[9130]: 2017-09-28 11:56:18.433 9130 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:56:18 ctl02 nova-api[9130]: 2017-09-28 11:56:18.434 9130 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:56:18 ctl02 nova-api[9130]: 2017-09-28 11:56:18.434 9130 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:56:18 ctl02 nova-api[9130]: 2017-09-28 11:56:18.438 9130 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:56:18 ctl02 nova-api[9130]: 2017-09-28 11:56:18.438 9130 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:56:18 ctl02 nova-api[9130]: 2017-09-28 11:56:18.438 9130 ERROR nova Traceback (most recent call last):
Sep 28 11:56:18 ctl02 nova-api[9130]: 2017-09-28 11:56:18.438 9130 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:56:18 ctl02 nova-api[9130]: 2017-09-28 11:56:18.438 9130 ERROR nova     sys.exit(main())
Sep 28 11:56:18 ctl02 nova-api[9130]: 2017-09-28 11:56:18.438 9130 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:56:18 ctl02 nova-api[9130]: 2017-09-28 11:56:18.438 9130 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:56:18 ctl02 nova-api[9130]: 2017-09-28 11:56:18.438 9130 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:56:18 ctl02 nova-api[9130]: 2017-09-28 11:56:18.438 9130 ERROR nova     max_url_len=max_url_len)
Sep 28 11:56:18 ctl02 nova-api[9130]: 2017-09-28 11:56:18.438 9130 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:56:18 ctl02 nova-api[9130]: 2017-09-28 11:56:18.438 9130 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:56:18 ctl02 nova-api[9130]: 2017-09-28 11:56:18.438 9130 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:56:18 ctl02 nova-api[9130]: 2017-09-28 11:56:18.438 9130 ERROR nova     sock.listen(backlog)
Sep 28 11:56:18 ctl02 nova-api[9130]: 2017-09-28 11:56:18.438 9130 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:56:18 ctl02 nova-api[9130]: 2017-09-28 11:56:18.438 9130 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:56:18 ctl02 nova-api[9130]: 2017-09-28 11:56:18.438 9130 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:56:18 ctl02 nova-api[9130]: 2017-09-28 11:56:18.438 9130 ERROR nova
Sep 28 11:56:18 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:56:18 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:56:18 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:56:18 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:56:18 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:56:18 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:56:18 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:56:19 ctl02 nova-cert[4860]: 2017-09-28 11:56:19.385 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:56:20 ctl02 nova-api[9148]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:56:20 ctl02 nova-api[9148]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:56:20 ctl02 nova-api[9148]: 2017-09-28 11:56:20.626 9148 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:56:20 ctl02 nova-api[9148]: 2017-09-28 11:56:20.627 9148 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:56:20 ctl02 nova-api[9148]: 2017-09-28 11:56:20.627 9148 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:56:20 ctl02 nova-api[9148]: 2017-09-28 11:56:20.627 9148 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:56:20 ctl02 nova-api[9148]: 2017-09-28 11:56:20.627 9148 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:56:20 ctl02 nova-api[9148]: 2017-09-28 11:56:20.627 9148 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:56:20 ctl02 nova-api[9148]: 2017-09-28 11:56:20.627 9148 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:56:20 ctl02 nova-api[9148]: 2017-09-28 11:56:20.627 9148 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:56:20 ctl02 nova-api[9148]: 2017-09-28 11:56:20.627 9148 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:56:20 ctl02 nova-api[9148]: 2017-09-28 11:56:20.627 9148 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:56:20 ctl02 nova-api[9148]: 2017-09-28 11:56:20.627 9148 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:56:20 ctl02 nova-api[9148]: 2017-09-28 11:56:20.627 9148 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:56:20 ctl02 nova-api[9148]: 2017-09-28 11:56:20.627 9148 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:56:20 ctl02 nova-api[9148]: 2017-09-28 11:56:20.627 9148 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:56:20 ctl02 nova-api[9148]: 2017-09-28 11:56:20.627 9148 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:56:20 ctl02 nova-api[9148]: 2017-09-28 11:56:20.627 9148 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:56:20 ctl02 nova-api[9148]: 2017-09-28 11:56:20.627 9148 ERROR nova.wsgi     self.filename))
Sep 28 11:56:20 ctl02 nova-api[9148]: 2017-09-28 11:56:20.627 9148 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:56:20 ctl02 nova-api[9148]: 2017-09-28 11:56:20.627 9148 ERROR nova.wsgi
Sep 28 11:56:20 ctl02 nova-api[9148]: 2017-09-28 11:56:20.628 9148 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:56:20 ctl02 nova-api[9148]: 2017-09-28 11:56:20.761 9148 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:56:21 ctl02 nova-api[9148]: 2017-09-28 11:56:20.999 9148 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:56:21 ctl02 nova-api[9148]: 2017-09-28 11:56:21.001 9148 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:56:21 ctl02 nova-api[9148]: 2017-09-28 11:56:21.001 9148 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:56:21 ctl02 nova-api[9148]: 2017-09-28 11:56:21.002 9148 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:56:21 ctl02 nova-api[9148]: 2017-09-28 11:56:21.136 9148 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:56:21 ctl02 nova-api[9148]: 2017-09-28 11:56:21.138 9148 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:56:21 ctl02 nova-api[9148]: 2017-09-28 11:56:21.138 9148 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:56:21 ctl02 nova-api[9148]: 2017-09-28 11:56:21.138 9148 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:56:21 ctl02 nova-api[9148]: 2017-09-28 11:56:21.141 9148 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:56:21 ctl02 nova-api[9148]: 2017-09-28 11:56:21.142 9148 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:56:21 ctl02 nova-api[9148]: 2017-09-28 11:56:21.142 9148 ERROR nova Traceback (most recent call last):
Sep 28 11:56:21 ctl02 nova-api[9148]: 2017-09-28 11:56:21.142 9148 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:56:21 ctl02 nova-api[9148]: 2017-09-28 11:56:21.142 9148 ERROR nova     sys.exit(main())
Sep 28 11:56:21 ctl02 nova-api[9148]: 2017-09-28 11:56:21.142 9148 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:56:21 ctl02 nova-api[9148]: 2017-09-28 11:56:21.142 9148 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:56:21 ctl02 nova-api[9148]: 2017-09-28 11:56:21.142 9148 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:56:21 ctl02 nova-api[9148]: 2017-09-28 11:56:21.142 9148 ERROR nova     max_url_len=max_url_len)
Sep 28 11:56:21 ctl02 nova-api[9148]: 2017-09-28 11:56:21.142 9148 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:56:21 ctl02 nova-api[9148]: 2017-09-28 11:56:21.142 9148 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:56:21 ctl02 nova-api[9148]: 2017-09-28 11:56:21.142 9148 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:56:21 ctl02 nova-api[9148]: 2017-09-28 11:56:21.142 9148 ERROR nova     sock.listen(backlog)
Sep 28 11:56:21 ctl02 nova-api[9148]: 2017-09-28 11:56:21.142 9148 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:56:21 ctl02 nova-api[9148]: 2017-09-28 11:56:21.142 9148 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:56:21 ctl02 nova-api[9148]: 2017-09-28 11:56:21.142 9148 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:56:21 ctl02 nova-api[9148]: 2017-09-28 11:56:21.142 9148 ERROR nova
Sep 28 11:56:21 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:56:21 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:56:21 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:56:21 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:56:21 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:56:21 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:56:21 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:56:22 ctl02 nova-conductor[5056]: 2017-09-28 11:56:22.162 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:56:22 ctl02 nova-conductor[5056]: 2017-09-28 11:56:22.177 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:56:22 ctl02 nova-conductor[5056]: 2017-09-28 11:56:22.193 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:56:22 ctl02 nova-conductor[5056]: 2017-09-28 11:56:22.198 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:56:23 ctl02 nova-api[9166]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:56:23 ctl02 nova-api[9166]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:56:23 ctl02 nova-api[9166]: 2017-09-28 11:56:23.361 9166 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:56:23 ctl02 nova-api[9166]: 2017-09-28 11:56:23.363 9166 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:56:23 ctl02 nova-api[9166]: 2017-09-28 11:56:23.363 9166 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:56:23 ctl02 nova-api[9166]: 2017-09-28 11:56:23.363 9166 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:56:23 ctl02 nova-api[9166]: 2017-09-28 11:56:23.363 9166 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:56:23 ctl02 nova-api[9166]: 2017-09-28 11:56:23.363 9166 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:56:23 ctl02 nova-api[9166]: 2017-09-28 11:56:23.363 9166 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:56:23 ctl02 nova-api[9166]: 2017-09-28 11:56:23.363 9166 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:56:23 ctl02 nova-api[9166]: 2017-09-28 11:56:23.363 9166 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:56:23 ctl02 nova-api[9166]: 2017-09-28 11:56:23.363 9166 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:56:23 ctl02 nova-api[9166]: 2017-09-28 11:56:23.363 9166 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:56:23 ctl02 nova-api[9166]: 2017-09-28 11:56:23.363 9166 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:56:23 ctl02 nova-api[9166]: 2017-09-28 11:56:23.363 9166 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:56:23 ctl02 nova-api[9166]: 2017-09-28 11:56:23.363 9166 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:56:23 ctl02 nova-api[9166]: 2017-09-28 11:56:23.363 9166 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:56:23 ctl02 nova-api[9166]: 2017-09-28 11:56:23.363 9166 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:56:23 ctl02 nova-api[9166]: 2017-09-28 11:56:23.363 9166 ERROR nova.wsgi     self.filename))
Sep 28 11:56:23 ctl02 nova-api[9166]: 2017-09-28 11:56:23.363 9166 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:56:23 ctl02 nova-api[9166]: 2017-09-28 11:56:23.363 9166 ERROR nova.wsgi
Sep 28 11:56:23 ctl02 nova-api[9166]: 2017-09-28 11:56:23.364 9166 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:56:23 ctl02 nova-api[9166]: 2017-09-28 11:56:23.497 9166 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:56:23 ctl02 nova-api[9166]: 2017-09-28 11:56:23.739 9166 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:56:23 ctl02 nova-api[9166]: 2017-09-28 11:56:23.742 9166 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:56:23 ctl02 nova-api[9166]: 2017-09-28 11:56:23.742 9166 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:56:23 ctl02 nova-api[9166]: 2017-09-28 11:56:23.742 9166 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:56:23 ctl02 glance-api[29183]: 2017-09-28 11:56:23.752 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:56:23] "OPTIONS / HTTP/1.0" 200 134 0.000607
Sep 28 11:56:23 ctl02 nova-api[9166]: 2017-09-28 11:56:23.886 9166 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:56:23 ctl02 nova-api[9166]: 2017-09-28 11:56:23.888 9166 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:56:23 ctl02 nova-api[9166]: 2017-09-28 11:56:23.888 9166 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:56:23 ctl02 nova-api[9166]: 2017-09-28 11:56:23.888 9166 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:56:23 ctl02 nova-api[9166]: 2017-09-28 11:56:23.892 9166 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:56:23 ctl02 nova-api[9166]: 2017-09-28 11:56:23.892 9166 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:56:23 ctl02 nova-api[9166]: 2017-09-28 11:56:23.892 9166 ERROR nova Traceback (most recent call last):
Sep 28 11:56:23 ctl02 nova-api[9166]: 2017-09-28 11:56:23.892 9166 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:56:23 ctl02 nova-api[9166]: 2017-09-28 11:56:23.892 9166 ERROR nova     sys.exit(main())
Sep 28 11:56:23 ctl02 nova-api[9166]: 2017-09-28 11:56:23.892 9166 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:56:23 ctl02 nova-api[9166]: 2017-09-28 11:56:23.892 9166 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:56:23 ctl02 nova-api[9166]: 2017-09-28 11:56:23.892 9166 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:56:23 ctl02 nova-api[9166]: 2017-09-28 11:56:23.892 9166 ERROR nova     max_url_len=max_url_len)
Sep 28 11:56:23 ctl02 nova-api[9166]: 2017-09-28 11:56:23.892 9166 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:56:23 ctl02 nova-api[9166]: 2017-09-28 11:56:23.892 9166 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:56:23 ctl02 nova-api[9166]: 2017-09-28 11:56:23.892 9166 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:56:23 ctl02 nova-api[9166]: 2017-09-28 11:56:23.892 9166 ERROR nova     sock.listen(backlog)
Sep 28 11:56:23 ctl02 nova-api[9166]: 2017-09-28 11:56:23.892 9166 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:56:23 ctl02 nova-api[9166]: 2017-09-28 11:56:23.892 9166 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:56:23 ctl02 nova-api[9166]: 2017-09-28 11:56:23.892 9166 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:56:23 ctl02 nova-api[9166]: 2017-09-28 11:56:23.892 9166 ERROR nova
Sep 28 11:56:24 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:56:24 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:56:24 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:56:24 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:56:24 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:56:24 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:56:24 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:56:25 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe5958e33)
Sep 28 11:56:25 ctl02 nova-api[9184]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:56:25 ctl02 nova-api[9184]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:56:26 ctl02 nova-api[9184]: 2017-09-28 11:56:26.103 9184 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:56:26 ctl02 nova-api[9184]: 2017-09-28 11:56:26.105 9184 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:56:26 ctl02 nova-api[9184]: 2017-09-28 11:56:26.105 9184 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:56:26 ctl02 nova-api[9184]: 2017-09-28 11:56:26.105 9184 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:56:26 ctl02 nova-api[9184]: 2017-09-28 11:56:26.105 9184 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:56:26 ctl02 nova-api[9184]: 2017-09-28 11:56:26.105 9184 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:56:26 ctl02 nova-api[9184]: 2017-09-28 11:56:26.105 9184 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:56:26 ctl02 nova-api[9184]: 2017-09-28 11:56:26.105 9184 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:56:26 ctl02 nova-api[9184]: 2017-09-28 11:56:26.105 9184 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:56:26 ctl02 nova-api[9184]: 2017-09-28 11:56:26.105 9184 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:56:26 ctl02 nova-api[9184]: 2017-09-28 11:56:26.105 9184 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:56:26 ctl02 nova-api[9184]: 2017-09-28 11:56:26.105 9184 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:56:26 ctl02 nova-api[9184]: 2017-09-28 11:56:26.105 9184 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:56:26 ctl02 nova-api[9184]: 2017-09-28 11:56:26.105 9184 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:56:26 ctl02 nova-api[9184]: 2017-09-28 11:56:26.105 9184 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:56:26 ctl02 nova-api[9184]: 2017-09-28 11:56:26.105 9184 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:56:26 ctl02 nova-api[9184]: 2017-09-28 11:56:26.105 9184 ERROR nova.wsgi     self.filename))
Sep 28 11:56:26 ctl02 nova-api[9184]: 2017-09-28 11:56:26.105 9184 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:56:26 ctl02 nova-api[9184]: 2017-09-28 11:56:26.105 9184 ERROR nova.wsgi
Sep 28 11:56:26 ctl02 nova-api[9184]: 2017-09-28 11:56:26.107 9184 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:56:26 ctl02 nova-api[9184]: 2017-09-28 11:56:26.239 9184 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:56:26 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe5958e33)
Sep 28 11:56:26 ctl02 nova-api[9184]: 2017-09-28 11:56:26.483 9184 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:56:26 ctl02 nova-api[9184]: 2017-09-28 11:56:26.486 9184 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:56:26 ctl02 nova-api[9184]: 2017-09-28 11:56:26.487 9184 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:56:26 ctl02 nova-api[9184]: 2017-09-28 11:56:26.487 9184 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:56:26 ctl02 nova-api[9184]: 2017-09-28 11:56:26.619 9184 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:56:26 ctl02 nova-api[9184]: 2017-09-28 11:56:26.622 9184 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:56:26 ctl02 nova-api[9184]: 2017-09-28 11:56:26.622 9184 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:56:26 ctl02 nova-api[9184]: 2017-09-28 11:56:26.623 9184 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:56:26 ctl02 nova-api[9184]: 2017-09-28 11:56:26.626 9184 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:56:26 ctl02 nova-api[9184]: 2017-09-28 11:56:26.627 9184 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:56:26 ctl02 nova-api[9184]: 2017-09-28 11:56:26.627 9184 ERROR nova Traceback (most recent call last):
Sep 28 11:56:26 ctl02 nova-api[9184]: 2017-09-28 11:56:26.627 9184 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:56:26 ctl02 nova-api[9184]: 2017-09-28 11:56:26.627 9184 ERROR nova     sys.exit(main())
Sep 28 11:56:26 ctl02 nova-api[9184]: 2017-09-28 11:56:26.627 9184 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:56:26 ctl02 nova-api[9184]: 2017-09-28 11:56:26.627 9184 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:56:26 ctl02 nova-api[9184]: 2017-09-28 11:56:26.627 9184 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:56:26 ctl02 nova-api[9184]: 2017-09-28 11:56:26.627 9184 ERROR nova     max_url_len=max_url_len)
Sep 28 11:56:26 ctl02 nova-api[9184]: 2017-09-28 11:56:26.627 9184 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:56:26 ctl02 nova-api[9184]: 2017-09-28 11:56:26.627 9184 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:56:26 ctl02 nova-api[9184]: 2017-09-28 11:56:26.627 9184 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:56:26 ctl02 nova-api[9184]: 2017-09-28 11:56:26.627 9184 ERROR nova     sock.listen(backlog)
Sep 28 11:56:26 ctl02 nova-api[9184]: 2017-09-28 11:56:26.627 9184 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:56:26 ctl02 nova-api[9184]: 2017-09-28 11:56:26.627 9184 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:56:26 ctl02 nova-api[9184]: 2017-09-28 11:56:26.627 9184 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:56:26 ctl02 nova-api[9184]: 2017-09-28 11:56:26.627 9184 ERROR nova
Sep 28 11:56:26 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:56:26 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:56:26 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:56:26 ctl02 glance-api[29183]: 2017-09-28 11:56:26.998 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:56:26] "OPTIONS / HTTP/1.0" 200 134 0.000791
Sep 28 11:56:27 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:56:27 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:56:27 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:56:27 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:56:27 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe5958e33)
Sep 28 11:56:28 ctl02 glance-api[29183]: 2017-09-28 11:56:28.163 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:56:28] "OPTIONS / HTTP/1.0" 200 134 0.000612
Sep 28 11:56:28 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe5958e33)
Sep 28 11:56:28 ctl02 nova-api[9202]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:56:28 ctl02 nova-api[9202]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:56:28 ctl02 nova-api[9202]: 2017-09-28 11:56:28.865 9202 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:56:28 ctl02 nova-api[9202]: 2017-09-28 11:56:28.867 9202 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:56:28 ctl02 nova-api[9202]: 2017-09-28 11:56:28.867 9202 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:56:28 ctl02 nova-api[9202]: 2017-09-28 11:56:28.867 9202 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:56:28 ctl02 nova-api[9202]: 2017-09-28 11:56:28.867 9202 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:56:28 ctl02 nova-api[9202]: 2017-09-28 11:56:28.867 9202 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:56:28 ctl02 nova-api[9202]: 2017-09-28 11:56:28.867 9202 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:56:28 ctl02 nova-api[9202]: 2017-09-28 11:56:28.867 9202 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:56:28 ctl02 nova-api[9202]: 2017-09-28 11:56:28.867 9202 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:56:28 ctl02 nova-api[9202]: 2017-09-28 11:56:28.867 9202 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:56:28 ctl02 nova-api[9202]: 2017-09-28 11:56:28.867 9202 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:56:28 ctl02 nova-api[9202]: 2017-09-28 11:56:28.867 9202 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:56:28 ctl02 nova-api[9202]: 2017-09-28 11:56:28.867 9202 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:56:28 ctl02 nova-api[9202]: 2017-09-28 11:56:28.867 9202 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:56:28 ctl02 nova-api[9202]: 2017-09-28 11:56:28.867 9202 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:56:28 ctl02 nova-api[9202]: 2017-09-28 11:56:28.867 9202 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:56:28 ctl02 nova-api[9202]: 2017-09-28 11:56:28.867 9202 ERROR nova.wsgi     self.filename))
Sep 28 11:56:28 ctl02 nova-api[9202]: 2017-09-28 11:56:28.867 9202 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:56:28 ctl02 nova-api[9202]: 2017-09-28 11:56:28.867 9202 ERROR nova.wsgi
Sep 28 11:56:28 ctl02 nova-api[9202]: 2017-09-28 11:56:28.869 9202 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:56:28 ctl02 nova-api[9202]: 2017-09-28 11:56:28.999 9202 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:56:29 ctl02 nova-api[9202]: 2017-09-28 11:56:29.239 9202 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:56:29 ctl02 nova-api[9202]: 2017-09-28 11:56:29.242 9202 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:56:29 ctl02 nova-api[9202]: 2017-09-28 11:56:29.242 9202 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:56:29 ctl02 nova-api[9202]: 2017-09-28 11:56:29.243 9202 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:56:29 ctl02 nova-consoleauth[5433]: 2017-09-28 11:56:29.277 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:56:29 ctl02 nova-api[9202]: 2017-09-28 11:56:29.374 9202 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:56:29 ctl02 nova-api[9202]: 2017-09-28 11:56:29.376 9202 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:56:29 ctl02 nova-api[9202]: 2017-09-28 11:56:29.377 9202 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:56:29 ctl02 nova-api[9202]: 2017-09-28 11:56:29.377 9202 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:56:29 ctl02 nova-api[9202]: 2017-09-28 11:56:29.380 9202 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:56:29 ctl02 nova-api[9202]: 2017-09-28 11:56:29.381 9202 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:56:29 ctl02 nova-api[9202]: 2017-09-28 11:56:29.381 9202 ERROR nova Traceback (most recent call last):
Sep 28 11:56:29 ctl02 nova-api[9202]: 2017-09-28 11:56:29.381 9202 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:56:29 ctl02 nova-api[9202]: 2017-09-28 11:56:29.381 9202 ERROR nova     sys.exit(main())
Sep 28 11:56:29 ctl02 nova-api[9202]: 2017-09-28 11:56:29.381 9202 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:56:29 ctl02 nova-api[9202]: 2017-09-28 11:56:29.381 9202 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:56:29 ctl02 nova-api[9202]: 2017-09-28 11:56:29.381 9202 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:56:29 ctl02 nova-api[9202]: 2017-09-28 11:56:29.381 9202 ERROR nova     max_url_len=max_url_len)
Sep 28 11:56:29 ctl02 nova-api[9202]: 2017-09-28 11:56:29.381 9202 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:56:29 ctl02 nova-api[9202]: 2017-09-28 11:56:29.381 9202 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:56:29 ctl02 nova-api[9202]: 2017-09-28 11:56:29.381 9202 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:56:29 ctl02 nova-api[9202]: 2017-09-28 11:56:29.381 9202 ERROR nova     sock.listen(backlog)
Sep 28 11:56:29 ctl02 nova-api[9202]: 2017-09-28 11:56:29.381 9202 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:56:29 ctl02 nova-api[9202]: 2017-09-28 11:56:29.381 9202 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:56:29 ctl02 nova-api[9202]: 2017-09-28 11:56:29.381 9202 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:56:29 ctl02 nova-api[9202]: 2017-09-28 11:56:29.381 9202 ERROR nova
Sep 28 11:56:29 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe5958e33)
Sep 28 11:56:29 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:56:29 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:56:29 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:56:29 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:56:29 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:56:29 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:56:29 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:56:30 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe5958e33)
Sep 28 11:56:31 ctl02 nova-api[9220]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:56:31 ctl02 nova-api[9220]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:56:31 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe5958e33)
Sep 28 11:56:31 ctl02 nova-api[9220]: 2017-09-28 11:56:31.604 9220 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:56:31 ctl02 nova-api[9220]: 2017-09-28 11:56:31.606 9220 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:56:31 ctl02 nova-api[9220]: 2017-09-28 11:56:31.606 9220 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:56:31 ctl02 nova-api[9220]: 2017-09-28 11:56:31.606 9220 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:56:31 ctl02 nova-api[9220]: 2017-09-28 11:56:31.606 9220 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:56:31 ctl02 nova-api[9220]: 2017-09-28 11:56:31.606 9220 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:56:31 ctl02 nova-api[9220]: 2017-09-28 11:56:31.606 9220 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:56:31 ctl02 nova-api[9220]: 2017-09-28 11:56:31.606 9220 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:56:31 ctl02 nova-api[9220]: 2017-09-28 11:56:31.606 9220 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:56:31 ctl02 nova-api[9220]: 2017-09-28 11:56:31.606 9220 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:56:31 ctl02 nova-api[9220]: 2017-09-28 11:56:31.606 9220 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:56:31 ctl02 nova-api[9220]: 2017-09-28 11:56:31.606 9220 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:56:31 ctl02 nova-api[9220]: 2017-09-28 11:56:31.606 9220 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:56:31 ctl02 nova-api[9220]: 2017-09-28 11:56:31.606 9220 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:56:31 ctl02 nova-api[9220]: 2017-09-28 11:56:31.606 9220 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:56:31 ctl02 nova-api[9220]: 2017-09-28 11:56:31.606 9220 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:56:31 ctl02 nova-api[9220]: 2017-09-28 11:56:31.606 9220 ERROR nova.wsgi     self.filename))
Sep 28 11:56:31 ctl02 nova-api[9220]: 2017-09-28 11:56:31.606 9220 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:56:31 ctl02 nova-api[9220]: 2017-09-28 11:56:31.606 9220 ERROR nova.wsgi
Sep 28 11:56:31 ctl02 nova-api[9220]: 2017-09-28 11:56:31.607 9220 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:56:31 ctl02 nova-api[9220]: 2017-09-28 11:56:31.739 9220 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:56:31 ctl02 nova-api[9220]: 2017-09-28 11:56:31.979 9220 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:56:31 ctl02 nova-api[9220]: 2017-09-28 11:56:31.981 9220 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:56:31 ctl02 nova-api[9220]: 2017-09-28 11:56:31.981 9220 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:56:31 ctl02 nova-api[9220]: 2017-09-28 11:56:31.982 9220 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:56:32 ctl02 nova-api[9220]: 2017-09-28 11:56:32.113 9220 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:56:32 ctl02 nova-api[9220]: 2017-09-28 11:56:32.114 9220 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:56:32 ctl02 nova-api[9220]: 2017-09-28 11:56:32.115 9220 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:56:32 ctl02 nova-api[9220]: 2017-09-28 11:56:32.115 9220 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:56:32 ctl02 nova-api[9220]: 2017-09-28 11:56:32.118 9220 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:56:32 ctl02 nova-api[9220]: 2017-09-28 11:56:32.118 9220 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:56:32 ctl02 nova-api[9220]: 2017-09-28 11:56:32.118 9220 ERROR nova Traceback (most recent call last):
Sep 28 11:56:32 ctl02 nova-api[9220]: 2017-09-28 11:56:32.118 9220 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:56:32 ctl02 nova-api[9220]: 2017-09-28 11:56:32.118 9220 ERROR nova     sys.exit(main())
Sep 28 11:56:32 ctl02 nova-api[9220]: 2017-09-28 11:56:32.118 9220 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:56:32 ctl02 nova-api[9220]: 2017-09-28 11:56:32.118 9220 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:56:32 ctl02 nova-api[9220]: 2017-09-28 11:56:32.118 9220 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:56:32 ctl02 nova-api[9220]: 2017-09-28 11:56:32.118 9220 ERROR nova     max_url_len=max_url_len)
Sep 28 11:56:32 ctl02 nova-api[9220]: 2017-09-28 11:56:32.118 9220 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:56:32 ctl02 nova-api[9220]: 2017-09-28 11:56:32.118 9220 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:56:32 ctl02 nova-api[9220]: 2017-09-28 11:56:32.118 9220 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:56:32 ctl02 nova-api[9220]: 2017-09-28 11:56:32.118 9220 ERROR nova     sock.listen(backlog)
Sep 28 11:56:32 ctl02 nova-api[9220]: 2017-09-28 11:56:32.118 9220 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:56:32 ctl02 nova-api[9220]: 2017-09-28 11:56:32.118 9220 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:56:32 ctl02 nova-api[9220]: 2017-09-28 11:56:32.118 9220 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:56:32 ctl02 nova-api[9220]: 2017-09-28 11:56:32.118 9220 ERROR nova
Sep 28 11:56:32 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:56:32 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:56:32 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:56:32 ctl02 nova-scheduler[5620]: 2017-09-28 11:56:32.301 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:56:32 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe5958e33)
Sep 28 11:56:32 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:56:32 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:56:32 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:56:32 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:56:33 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe5958e33)
Sep 28 11:56:33 ctl02 glance-api[29183]: 2017-09-28 11:56:33.954 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:56:33] "OPTIONS / HTTP/1.0" 200 134 0.000600
Sep 28 11:56:34 ctl02 nova-api[9238]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:56:34 ctl02 nova-api[9238]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:56:34 ctl02 nova-api[9238]: 2017-09-28 11:56:34.353 9238 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:56:34 ctl02 nova-api[9238]: 2017-09-28 11:56:34.354 9238 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:56:34 ctl02 nova-api[9238]: 2017-09-28 11:56:34.354 9238 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:56:34 ctl02 nova-api[9238]: 2017-09-28 11:56:34.354 9238 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:56:34 ctl02 nova-api[9238]: 2017-09-28 11:56:34.354 9238 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:56:34 ctl02 nova-api[9238]: 2017-09-28 11:56:34.354 9238 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:56:34 ctl02 nova-api[9238]: 2017-09-28 11:56:34.354 9238 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:56:34 ctl02 nova-api[9238]: 2017-09-28 11:56:34.354 9238 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:56:34 ctl02 nova-api[9238]: 2017-09-28 11:56:34.354 9238 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:56:34 ctl02 nova-api[9238]: 2017-09-28 11:56:34.354 9238 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:56:34 ctl02 nova-api[9238]: 2017-09-28 11:56:34.354 9238 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:56:34 ctl02 nova-api[9238]: 2017-09-28 11:56:34.354 9238 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:56:34 ctl02 nova-api[9238]: 2017-09-28 11:56:34.354 9238 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:56:34 ctl02 nova-api[9238]: 2017-09-28 11:56:34.354 9238 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:56:34 ctl02 nova-api[9238]: 2017-09-28 11:56:34.354 9238 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:56:34 ctl02 nova-api[9238]: 2017-09-28 11:56:34.354 9238 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:56:34 ctl02 nova-api[9238]: 2017-09-28 11:56:34.354 9238 ERROR nova.wsgi     self.filename))
Sep 28 11:56:34 ctl02 nova-api[9238]: 2017-09-28 11:56:34.354 9238 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:56:34 ctl02 nova-api[9238]: 2017-09-28 11:56:34.354 9238 ERROR nova.wsgi
Sep 28 11:56:34 ctl02 nova-api[9238]: 2017-09-28 11:56:34.355 9238 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:56:34 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe5958e33)
Sep 28 11:56:34 ctl02 nova-api[9238]: 2017-09-28 11:56:34.490 9238 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:56:34 ctl02 nova-api[9238]: 2017-09-28 11:56:34.731 9238 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:56:34 ctl02 nova-api[9238]: 2017-09-28 11:56:34.734 9238 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:56:34 ctl02 nova-api[9238]: 2017-09-28 11:56:34.734 9238 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:56:34 ctl02 nova-api[9238]: 2017-09-28 11:56:34.734 9238 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:56:34 ctl02 nova-api[9238]: 2017-09-28 11:56:34.866 9238 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:56:34 ctl02 nova-api[9238]: 2017-09-28 11:56:34.868 9238 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:56:34 ctl02 nova-api[9238]: 2017-09-28 11:56:34.868 9238 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:56:34 ctl02 nova-api[9238]: 2017-09-28 11:56:34.868 9238 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:56:34 ctl02 nova-api[9238]: 2017-09-28 11:56:34.871 9238 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:56:34 ctl02 nova-api[9238]: 2017-09-28 11:56:34.872 9238 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:56:34 ctl02 nova-api[9238]: 2017-09-28 11:56:34.872 9238 ERROR nova Traceback (most recent call last):
Sep 28 11:56:34 ctl02 nova-api[9238]: 2017-09-28 11:56:34.872 9238 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:56:34 ctl02 nova-api[9238]: 2017-09-28 11:56:34.872 9238 ERROR nova     sys.exit(main())
Sep 28 11:56:34 ctl02 nova-api[9238]: 2017-09-28 11:56:34.872 9238 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:56:34 ctl02 nova-api[9238]: 2017-09-28 11:56:34.872 9238 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:56:34 ctl02 nova-api[9238]: 2017-09-28 11:56:34.872 9238 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:56:34 ctl02 nova-api[9238]: 2017-09-28 11:56:34.872 9238 ERROR nova     max_url_len=max_url_len)
Sep 28 11:56:34 ctl02 nova-api[9238]: 2017-09-28 11:56:34.872 9238 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:56:34 ctl02 nova-api[9238]: 2017-09-28 11:56:34.872 9238 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:56:34 ctl02 nova-api[9238]: 2017-09-28 11:56:34.872 9238 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:56:34 ctl02 nova-api[9238]: 2017-09-28 11:56:34.872 9238 ERROR nova     sock.listen(backlog)
Sep 28 11:56:34 ctl02 nova-api[9238]: 2017-09-28 11:56:34.872 9238 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:56:34 ctl02 nova-api[9238]: 2017-09-28 11:56:34.872 9238 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:56:34 ctl02 nova-api[9238]: 2017-09-28 11:56:34.872 9238 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:56:34 ctl02 nova-api[9238]: 2017-09-28 11:56:34.872 9238 ERROR nova
Sep 28 11:56:35 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:56:35 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:56:35 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:56:35 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:56:35 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:56:35 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:56:35 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:56:35 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe5958e33)
Sep 28 11:56:36 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:56:36 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:56:36 ctl02 glance-api[29183]: 2017-09-28 11:56:36.788 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:56:36] "OPTIONS / HTTP/1.0" 200 134 0.001190
Sep 28 11:56:36 ctl02 nova-api[9256]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:56:36 ctl02 nova-api[9256]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:56:37 ctl02 nova-api[9256]: 2017-09-28 11:56:37.131 9256 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:56:37 ctl02 nova-api[9256]: 2017-09-28 11:56:37.132 9256 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:56:37 ctl02 nova-api[9256]: 2017-09-28 11:56:37.132 9256 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:56:37 ctl02 nova-api[9256]: 2017-09-28 11:56:37.132 9256 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:56:37 ctl02 nova-api[9256]: 2017-09-28 11:56:37.132 9256 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:56:37 ctl02 nova-api[9256]: 2017-09-28 11:56:37.132 9256 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:56:37 ctl02 nova-api[9256]: 2017-09-28 11:56:37.132 9256 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:56:37 ctl02 nova-api[9256]: 2017-09-28 11:56:37.132 9256 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:56:37 ctl02 nova-api[9256]: 2017-09-28 11:56:37.132 9256 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:56:37 ctl02 nova-api[9256]: 2017-09-28 11:56:37.132 9256 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:56:37 ctl02 nova-api[9256]: 2017-09-28 11:56:37.132 9256 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:56:37 ctl02 nova-api[9256]: 2017-09-28 11:56:37.132 9256 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:56:37 ctl02 nova-api[9256]: 2017-09-28 11:56:37.132 9256 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:56:37 ctl02 nova-api[9256]: 2017-09-28 11:56:37.132 9256 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:56:37 ctl02 nova-api[9256]: 2017-09-28 11:56:37.132 9256 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:56:37 ctl02 nova-api[9256]: 2017-09-28 11:56:37.132 9256 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:56:37 ctl02 nova-api[9256]: 2017-09-28 11:56:37.132 9256 ERROR nova.wsgi     self.filename))
Sep 28 11:56:37 ctl02 nova-api[9256]: 2017-09-28 11:56:37.132 9256 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:56:37 ctl02 nova-api[9256]: 2017-09-28 11:56:37.132 9256 ERROR nova.wsgi
Sep 28 11:56:37 ctl02 nova-api[9256]: 2017-09-28 11:56:37.133 9256 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:56:37 ctl02 nova-api[9256]: 2017-09-28 11:56:37.269 9256 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:56:37 ctl02 nova-api[9256]: 2017-09-28 11:56:37.513 9256 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:56:37 ctl02 nova-api[9256]: 2017-09-28 11:56:37.515 9256 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:56:37 ctl02 nova-api[9256]: 2017-09-28 11:56:37.515 9256 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:56:37 ctl02 nova-api[9256]: 2017-09-28 11:56:37.515 9256 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:56:37 ctl02 nova-api[9256]: 2017-09-28 11:56:37.647 9256 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:56:37 ctl02 nova-api[9256]: 2017-09-28 11:56:37.649 9256 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:56:37 ctl02 nova-api[9256]: 2017-09-28 11:56:37.650 9256 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:56:37 ctl02 nova-api[9256]: 2017-09-28 11:56:37.650 9256 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:56:37 ctl02 nova-api[9256]: 2017-09-28 11:56:37.653 9256 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:56:37 ctl02 nova-api[9256]: 2017-09-28 11:56:37.654 9256 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:56:37 ctl02 nova-api[9256]: 2017-09-28 11:56:37.654 9256 ERROR nova Traceback (most recent call last):
Sep 28 11:56:37 ctl02 nova-api[9256]: 2017-09-28 11:56:37.654 9256 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:56:37 ctl02 nova-api[9256]: 2017-09-28 11:56:37.654 9256 ERROR nova     sys.exit(main())
Sep 28 11:56:37 ctl02 nova-api[9256]: 2017-09-28 11:56:37.654 9256 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:56:37 ctl02 nova-api[9256]: 2017-09-28 11:56:37.654 9256 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:56:37 ctl02 nova-api[9256]: 2017-09-28 11:56:37.654 9256 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:56:37 ctl02 nova-api[9256]: 2017-09-28 11:56:37.654 9256 ERROR nova     max_url_len=max_url_len)
Sep 28 11:56:37 ctl02 nova-api[9256]: 2017-09-28 11:56:37.654 9256 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:56:37 ctl02 nova-api[9256]: 2017-09-28 11:56:37.654 9256 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:56:37 ctl02 nova-api[9256]: 2017-09-28 11:56:37.654 9256 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:56:37 ctl02 nova-api[9256]: 2017-09-28 11:56:37.654 9256 ERROR nova     sock.listen(backlog)
Sep 28 11:56:37 ctl02 nova-api[9256]: 2017-09-28 11:56:37.654 9256 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:56:37 ctl02 nova-api[9256]: 2017-09-28 11:56:37.654 9256 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:56:37 ctl02 nova-api[9256]: 2017-09-28 11:56:37.654 9256 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:56:37 ctl02 nova-api[9256]: 2017-09-28 11:56:37.654 9256 ERROR nova
Sep 28 11:56:37 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:56:37 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:56:37 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:56:38 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:56:38 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:56:38 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:56:38 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:56:38 ctl02 glance-api[29183]: 2017-09-28 11:56:38.200 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:56:38] "OPTIONS / HTTP/1.0" 200 134 0.001136
Sep 28 11:56:39 ctl02 nova-api[9278]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:56:39 ctl02 nova-api[9278]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:56:39 ctl02 nova-api[9278]: 2017-09-28 11:56:39.881 9278 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:56:39 ctl02 nova-api[9278]: 2017-09-28 11:56:39.882 9278 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:56:39 ctl02 nova-api[9278]: 2017-09-28 11:56:39.882 9278 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:56:39 ctl02 nova-api[9278]: 2017-09-28 11:56:39.882 9278 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:56:39 ctl02 nova-api[9278]: 2017-09-28 11:56:39.882 9278 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:56:39 ctl02 nova-api[9278]: 2017-09-28 11:56:39.882 9278 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:56:39 ctl02 nova-api[9278]: 2017-09-28 11:56:39.882 9278 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:56:39 ctl02 nova-api[9278]: 2017-09-28 11:56:39.882 9278 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:56:39 ctl02 nova-api[9278]: 2017-09-28 11:56:39.882 9278 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:56:39 ctl02 nova-api[9278]: 2017-09-28 11:56:39.882 9278 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:56:39 ctl02 nova-api[9278]: 2017-09-28 11:56:39.882 9278 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:56:39 ctl02 nova-api[9278]: 2017-09-28 11:56:39.882 9278 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:56:39 ctl02 nova-api[9278]: 2017-09-28 11:56:39.882 9278 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:56:39 ctl02 nova-api[9278]: 2017-09-28 11:56:39.882 9278 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:56:39 ctl02 nova-api[9278]: 2017-09-28 11:56:39.882 9278 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:56:39 ctl02 nova-api[9278]: 2017-09-28 11:56:39.882 9278 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:56:39 ctl02 nova-api[9278]: 2017-09-28 11:56:39.882 9278 ERROR nova.wsgi     self.filename))
Sep 28 11:56:39 ctl02 nova-api[9278]: 2017-09-28 11:56:39.882 9278 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:56:39 ctl02 nova-api[9278]: 2017-09-28 11:56:39.882 9278 ERROR nova.wsgi
Sep 28 11:56:39 ctl02 nova-api[9278]: 2017-09-28 11:56:39.885 9278 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:56:40 ctl02 nova-api[9278]: 2017-09-28 11:56:40.019 9278 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:56:40 ctl02 nova-api[9278]: 2017-09-28 11:56:40.262 9278 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:56:40 ctl02 nova-api[9278]: 2017-09-28 11:56:40.265 9278 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:56:40 ctl02 nova-api[9278]: 2017-09-28 11:56:40.265 9278 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:56:40 ctl02 nova-api[9278]: 2017-09-28 11:56:40.265 9278 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:56:40 ctl02 nova-api[9278]: 2017-09-28 11:56:40.397 9278 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:56:40 ctl02 nova-api[9278]: 2017-09-28 11:56:40.400 9278 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:56:40 ctl02 nova-api[9278]: 2017-09-28 11:56:40.400 9278 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:56:40 ctl02 nova-api[9278]: 2017-09-28 11:56:40.400 9278 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:56:40 ctl02 nova-api[9278]: 2017-09-28 11:56:40.403 9278 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:56:40 ctl02 nova-api[9278]: 2017-09-28 11:56:40.404 9278 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:56:40 ctl02 nova-api[9278]: 2017-09-28 11:56:40.404 9278 ERROR nova Traceback (most recent call last):
Sep 28 11:56:40 ctl02 nova-api[9278]: 2017-09-28 11:56:40.404 9278 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:56:40 ctl02 nova-api[9278]: 2017-09-28 11:56:40.404 9278 ERROR nova     sys.exit(main())
Sep 28 11:56:40 ctl02 nova-api[9278]: 2017-09-28 11:56:40.404 9278 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:56:40 ctl02 nova-api[9278]: 2017-09-28 11:56:40.404 9278 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:56:40 ctl02 nova-api[9278]: 2017-09-28 11:56:40.404 9278 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:56:40 ctl02 nova-api[9278]: 2017-09-28 11:56:40.404 9278 ERROR nova     max_url_len=max_url_len)
Sep 28 11:56:40 ctl02 nova-api[9278]: 2017-09-28 11:56:40.404 9278 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:56:40 ctl02 nova-api[9278]: 2017-09-28 11:56:40.404 9278 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:56:40 ctl02 nova-api[9278]: 2017-09-28 11:56:40.404 9278 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:56:40 ctl02 nova-api[9278]: 2017-09-28 11:56:40.404 9278 ERROR nova     sock.listen(backlog)
Sep 28 11:56:40 ctl02 nova-api[9278]: 2017-09-28 11:56:40.404 9278 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:56:40 ctl02 nova-api[9278]: 2017-09-28 11:56:40.404 9278 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:56:40 ctl02 nova-api[9278]: 2017-09-28 11:56:40.404 9278 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:56:40 ctl02 nova-api[9278]: 2017-09-28 11:56:40.404 9278 ERROR nova
Sep 28 11:56:40 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:56:40 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:56:40 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:56:40 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:56:40 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:56:40 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:56:40 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:56:42 ctl02 nova-api[9297]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:56:42 ctl02 nova-api[9297]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:56:42 ctl02 nova-api[9297]: 2017-09-28 11:56:42.611 9297 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:56:42 ctl02 nova-api[9297]: 2017-09-28 11:56:42.612 9297 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:56:42 ctl02 nova-api[9297]: 2017-09-28 11:56:42.612 9297 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:56:42 ctl02 nova-api[9297]: 2017-09-28 11:56:42.612 9297 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:56:42 ctl02 nova-api[9297]: 2017-09-28 11:56:42.612 9297 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:56:42 ctl02 nova-api[9297]: 2017-09-28 11:56:42.612 9297 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:56:42 ctl02 nova-api[9297]: 2017-09-28 11:56:42.612 9297 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:56:42 ctl02 nova-api[9297]: 2017-09-28 11:56:42.612 9297 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:56:42 ctl02 nova-api[9297]: 2017-09-28 11:56:42.612 9297 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:56:42 ctl02 nova-api[9297]: 2017-09-28 11:56:42.612 9297 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:56:42 ctl02 nova-api[9297]: 2017-09-28 11:56:42.612 9297 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:56:42 ctl02 nova-api[9297]: 2017-09-28 11:56:42.612 9297 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:56:42 ctl02 nova-api[9297]: 2017-09-28 11:56:42.612 9297 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:56:42 ctl02 nova-api[9297]: 2017-09-28 11:56:42.612 9297 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:56:42 ctl02 nova-api[9297]: 2017-09-28 11:56:42.612 9297 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:56:42 ctl02 nova-api[9297]: 2017-09-28 11:56:42.612 9297 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:56:42 ctl02 nova-api[9297]: 2017-09-28 11:56:42.612 9297 ERROR nova.wsgi     self.filename))
Sep 28 11:56:42 ctl02 nova-api[9297]: 2017-09-28 11:56:42.612 9297 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:56:42 ctl02 nova-api[9297]: 2017-09-28 11:56:42.612 9297 ERROR nova.wsgi
Sep 28 11:56:42 ctl02 nova-api[9297]: 2017-09-28 11:56:42.613 9297 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:56:42 ctl02 nova-api[9297]: 2017-09-28 11:56:42.750 9297 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:56:42 ctl02 nova-api[9297]: 2017-09-28 11:56:42.998 9297 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:56:43 ctl02 nova-api[9297]: 2017-09-28 11:56:43.000 9297 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:56:43 ctl02 nova-api[9297]: 2017-09-28 11:56:43.000 9297 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:56:43 ctl02 nova-api[9297]: 2017-09-28 11:56:43.001 9297 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:56:43 ctl02 nova-api[9297]: 2017-09-28 11:56:43.130 9297 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:56:43 ctl02 nova-api[9297]: 2017-09-28 11:56:43.132 9297 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:56:43 ctl02 nova-api[9297]: 2017-09-28 11:56:43.132 9297 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:56:43 ctl02 nova-api[9297]: 2017-09-28 11:56:43.132 9297 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:56:43 ctl02 nova-api[9297]: 2017-09-28 11:56:43.135 9297 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:56:43 ctl02 nova-api[9297]: 2017-09-28 11:56:43.136 9297 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:56:43 ctl02 nova-api[9297]: 2017-09-28 11:56:43.136 9297 ERROR nova Traceback (most recent call last):
Sep 28 11:56:43 ctl02 nova-api[9297]: 2017-09-28 11:56:43.136 9297 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:56:43 ctl02 nova-api[9297]: 2017-09-28 11:56:43.136 9297 ERROR nova     sys.exit(main())
Sep 28 11:56:43 ctl02 nova-api[9297]: 2017-09-28 11:56:43.136 9297 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:56:43 ctl02 nova-api[9297]: 2017-09-28 11:56:43.136 9297 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:56:43 ctl02 nova-api[9297]: 2017-09-28 11:56:43.136 9297 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:56:43 ctl02 nova-api[9297]: 2017-09-28 11:56:43.136 9297 ERROR nova     max_url_len=max_url_len)
Sep 28 11:56:43 ctl02 nova-api[9297]: 2017-09-28 11:56:43.136 9297 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:56:43 ctl02 nova-api[9297]: 2017-09-28 11:56:43.136 9297 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:56:43 ctl02 nova-api[9297]: 2017-09-28 11:56:43.136 9297 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:56:43 ctl02 nova-api[9297]: 2017-09-28 11:56:43.136 9297 ERROR nova     sock.listen(backlog)
Sep 28 11:56:43 ctl02 nova-api[9297]: 2017-09-28 11:56:43.136 9297 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:56:43 ctl02 nova-api[9297]: 2017-09-28 11:56:43.136 9297 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:56:43 ctl02 nova-api[9297]: 2017-09-28 11:56:43.136 9297 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:56:43 ctl02 nova-api[9297]: 2017-09-28 11:56:43.136 9297 ERROR nova
Sep 28 11:56:43 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:56:43 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:56:43 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:56:43 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:56:43 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:56:43 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:56:43 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:56:43 ctl02 glance-api[29183]: 2017-09-28 11:56:43.740 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:56:43] "OPTIONS / HTTP/1.0" 200 134 0.000710
Sep 28 11:56:45 ctl02 nova-api[9315]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:56:45 ctl02 nova-api[9315]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:56:45 ctl02 nova-api[9315]: 2017-09-28 11:56:45.374 9315 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:56:45 ctl02 nova-api[9315]: 2017-09-28 11:56:45.376 9315 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:56:45 ctl02 nova-api[9315]: 2017-09-28 11:56:45.376 9315 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:56:45 ctl02 nova-api[9315]: 2017-09-28 11:56:45.376 9315 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:56:45 ctl02 nova-api[9315]: 2017-09-28 11:56:45.376 9315 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:56:45 ctl02 nova-api[9315]: 2017-09-28 11:56:45.376 9315 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:56:45 ctl02 nova-api[9315]: 2017-09-28 11:56:45.376 9315 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:56:45 ctl02 nova-api[9315]: 2017-09-28 11:56:45.376 9315 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:56:45 ctl02 nova-api[9315]: 2017-09-28 11:56:45.376 9315 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:56:45 ctl02 nova-api[9315]: 2017-09-28 11:56:45.376 9315 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:56:45 ctl02 nova-api[9315]: 2017-09-28 11:56:45.376 9315 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:56:45 ctl02 nova-api[9315]: 2017-09-28 11:56:45.376 9315 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:56:45 ctl02 nova-api[9315]: 2017-09-28 11:56:45.376 9315 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:56:45 ctl02 nova-api[9315]: 2017-09-28 11:56:45.376 9315 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:56:45 ctl02 nova-api[9315]: 2017-09-28 11:56:45.376 9315 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:56:45 ctl02 nova-api[9315]: 2017-09-28 11:56:45.376 9315 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:56:45 ctl02 nova-api[9315]: 2017-09-28 11:56:45.376 9315 ERROR nova.wsgi     self.filename))
Sep 28 11:56:45 ctl02 nova-api[9315]: 2017-09-28 11:56:45.376 9315 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:56:45 ctl02 nova-api[9315]: 2017-09-28 11:56:45.376 9315 ERROR nova.wsgi
Sep 28 11:56:45 ctl02 nova-api[9315]: 2017-09-28 11:56:45.377 9315 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:56:45 ctl02 nova-api[9315]: 2017-09-28 11:56:45.511 9315 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:56:45 ctl02 nova-api[9315]: 2017-09-28 11:56:45.752 9315 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:56:45 ctl02 nova-api[9315]: 2017-09-28 11:56:45.755 9315 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:56:45 ctl02 nova-api[9315]: 2017-09-28 11:56:45.755 9315 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:56:45 ctl02 nova-api[9315]: 2017-09-28 11:56:45.755 9315 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:56:45 ctl02 nova-api[9315]: 2017-09-28 11:56:45.887 9315 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:56:45 ctl02 nova-api[9315]: 2017-09-28 11:56:45.889 9315 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:56:45 ctl02 nova-api[9315]: 2017-09-28 11:56:45.890 9315 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:56:45 ctl02 nova-api[9315]: 2017-09-28 11:56:45.890 9315 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:56:45 ctl02 nova-api[9315]: 2017-09-28 11:56:45.893 9315 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:56:45 ctl02 nova-api[9315]: 2017-09-28 11:56:45.893 9315 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:56:45 ctl02 nova-api[9315]: 2017-09-28 11:56:45.893 9315 ERROR nova Traceback (most recent call last):
Sep 28 11:56:45 ctl02 nova-api[9315]: 2017-09-28 11:56:45.893 9315 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:56:45 ctl02 nova-api[9315]: 2017-09-28 11:56:45.893 9315 ERROR nova     sys.exit(main())
Sep 28 11:56:45 ctl02 nova-api[9315]: 2017-09-28 11:56:45.893 9315 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:56:45 ctl02 nova-api[9315]: 2017-09-28 11:56:45.893 9315 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:56:45 ctl02 nova-api[9315]: 2017-09-28 11:56:45.893 9315 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:56:45 ctl02 nova-api[9315]: 2017-09-28 11:56:45.893 9315 ERROR nova     max_url_len=max_url_len)
Sep 28 11:56:45 ctl02 nova-api[9315]: 2017-09-28 11:56:45.893 9315 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:56:45 ctl02 nova-api[9315]: 2017-09-28 11:56:45.893 9315 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:56:45 ctl02 nova-api[9315]: 2017-09-28 11:56:45.893 9315 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:56:45 ctl02 nova-api[9315]: 2017-09-28 11:56:45.893 9315 ERROR nova     sock.listen(backlog)
Sep 28 11:56:45 ctl02 nova-api[9315]: 2017-09-28 11:56:45.893 9315 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:56:45 ctl02 nova-api[9315]: 2017-09-28 11:56:45.893 9315 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:56:45 ctl02 nova-api[9315]: 2017-09-28 11:56:45.893 9315 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:56:45 ctl02 nova-api[9315]: 2017-09-28 11:56:45.893 9315 ERROR nova
Sep 28 11:56:46 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:56:46 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:56:46 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:56:46 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:56:46 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:56:46 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:56:46 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:56:46 ctl02 glance-api[29183]: 2017-09-28 11:56:46.568 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:56:46] "OPTIONS / HTTP/1.0" 200 134 0.000705
Sep 28 11:56:47 ctl02 nova-api[9333]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:56:47 ctl02 nova-api[9333]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:56:47 ctl02 glance-api[29183]: 2017-09-28 11:56:47.962 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:56:47] "OPTIONS / HTTP/1.0" 200 134 0.000640
Sep 28 11:56:48 ctl02 nova-api[9333]: 2017-09-28 11:56:48.099 9333 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:56:48 ctl02 nova-api[9333]: 2017-09-28 11:56:48.100 9333 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:56:48 ctl02 nova-api[9333]: 2017-09-28 11:56:48.100 9333 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:56:48 ctl02 nova-api[9333]: 2017-09-28 11:56:48.100 9333 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:56:48 ctl02 nova-api[9333]: 2017-09-28 11:56:48.100 9333 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:56:48 ctl02 nova-api[9333]: 2017-09-28 11:56:48.100 9333 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:56:48 ctl02 nova-api[9333]: 2017-09-28 11:56:48.100 9333 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:56:48 ctl02 nova-api[9333]: 2017-09-28 11:56:48.100 9333 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:56:48 ctl02 nova-api[9333]: 2017-09-28 11:56:48.100 9333 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:56:48 ctl02 nova-api[9333]: 2017-09-28 11:56:48.100 9333 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:56:48 ctl02 nova-api[9333]: 2017-09-28 11:56:48.100 9333 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:56:48 ctl02 nova-api[9333]: 2017-09-28 11:56:48.100 9333 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:56:48 ctl02 nova-api[9333]: 2017-09-28 11:56:48.100 9333 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:56:48 ctl02 nova-api[9333]: 2017-09-28 11:56:48.100 9333 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:56:48 ctl02 nova-api[9333]: 2017-09-28 11:56:48.100 9333 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:56:48 ctl02 nova-api[9333]: 2017-09-28 11:56:48.100 9333 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:56:48 ctl02 nova-api[9333]: 2017-09-28 11:56:48.100 9333 ERROR nova.wsgi     self.filename))
Sep 28 11:56:48 ctl02 nova-api[9333]: 2017-09-28 11:56:48.100 9333 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:56:48 ctl02 nova-api[9333]: 2017-09-28 11:56:48.100 9333 ERROR nova.wsgi
Sep 28 11:56:48 ctl02 nova-api[9333]: 2017-09-28 11:56:48.101 9333 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:56:48 ctl02 nova-api[9333]: 2017-09-28 11:56:48.232 9333 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:56:48 ctl02 nova-api[9333]: 2017-09-28 11:56:48.472 9333 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:56:48 ctl02 nova-api[9333]: 2017-09-28 11:56:48.474 9333 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:56:48 ctl02 nova-api[9333]: 2017-09-28 11:56:48.474 9333 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:56:48 ctl02 nova-api[9333]: 2017-09-28 11:56:48.474 9333 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:56:48 ctl02 nova-api[9333]: 2017-09-28 11:56:48.603 9333 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:56:48 ctl02 nova-api[9333]: 2017-09-28 11:56:48.605 9333 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:56:48 ctl02 nova-api[9333]: 2017-09-28 11:56:48.605 9333 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:56:48 ctl02 nova-api[9333]: 2017-09-28 11:56:48.605 9333 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:56:48 ctl02 nova-api[9333]: 2017-09-28 11:56:48.609 9333 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:56:48 ctl02 nova-api[9333]: 2017-09-28 11:56:48.609 9333 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:56:48 ctl02 nova-api[9333]: 2017-09-28 11:56:48.609 9333 ERROR nova Traceback (most recent call last):
Sep 28 11:56:48 ctl02 nova-api[9333]: 2017-09-28 11:56:48.609 9333 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:56:48 ctl02 nova-api[9333]: 2017-09-28 11:56:48.609 9333 ERROR nova     sys.exit(main())
Sep 28 11:56:48 ctl02 nova-api[9333]: 2017-09-28 11:56:48.609 9333 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:56:48 ctl02 nova-api[9333]: 2017-09-28 11:56:48.609 9333 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:56:48 ctl02 nova-api[9333]: 2017-09-28 11:56:48.609 9333 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:56:48 ctl02 nova-api[9333]: 2017-09-28 11:56:48.609 9333 ERROR nova     max_url_len=max_url_len)
Sep 28 11:56:48 ctl02 nova-api[9333]: 2017-09-28 11:56:48.609 9333 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:56:48 ctl02 nova-api[9333]: 2017-09-28 11:56:48.609 9333 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:56:48 ctl02 nova-api[9333]: 2017-09-28 11:56:48.609 9333 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:56:48 ctl02 nova-api[9333]: 2017-09-28 11:56:48.609 9333 ERROR nova     sock.listen(backlog)
Sep 28 11:56:48 ctl02 nova-api[9333]: 2017-09-28 11:56:48.609 9333 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:56:48 ctl02 nova-api[9333]: 2017-09-28 11:56:48.609 9333 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:56:48 ctl02 nova-api[9333]: 2017-09-28 11:56:48.609 9333 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:56:48 ctl02 nova-api[9333]: 2017-09-28 11:56:48.609 9333 ERROR nova
Sep 28 11:56:48 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:56:48 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:56:48 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:56:48 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:56:48 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:56:48 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:56:48 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:56:50 ctl02 nova-api[9351]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:56:50 ctl02 nova-api[9351]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:56:50 ctl02 nova-api[9351]: 2017-09-28 11:56:50.603 9351 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:56:50 ctl02 nova-api[9351]: 2017-09-28 11:56:50.605 9351 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:56:50 ctl02 nova-api[9351]: 2017-09-28 11:56:50.605 9351 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:56:50 ctl02 nova-api[9351]: 2017-09-28 11:56:50.605 9351 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:56:50 ctl02 nova-api[9351]: 2017-09-28 11:56:50.605 9351 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:56:50 ctl02 nova-api[9351]: 2017-09-28 11:56:50.605 9351 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:56:50 ctl02 nova-api[9351]: 2017-09-28 11:56:50.605 9351 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:56:50 ctl02 nova-api[9351]: 2017-09-28 11:56:50.605 9351 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:56:50 ctl02 nova-api[9351]: 2017-09-28 11:56:50.605 9351 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:56:50 ctl02 nova-api[9351]: 2017-09-28 11:56:50.605 9351 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:56:50 ctl02 nova-api[9351]: 2017-09-28 11:56:50.605 9351 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:56:50 ctl02 nova-api[9351]: 2017-09-28 11:56:50.605 9351 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:56:50 ctl02 nova-api[9351]: 2017-09-28 11:56:50.605 9351 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:56:50 ctl02 nova-api[9351]: 2017-09-28 11:56:50.605 9351 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:56:50 ctl02 nova-api[9351]: 2017-09-28 11:56:50.605 9351 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:56:50 ctl02 nova-api[9351]: 2017-09-28 11:56:50.605 9351 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:56:50 ctl02 nova-api[9351]: 2017-09-28 11:56:50.605 9351 ERROR nova.wsgi     self.filename))
Sep 28 11:56:50 ctl02 nova-api[9351]: 2017-09-28 11:56:50.605 9351 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:56:50 ctl02 nova-api[9351]: 2017-09-28 11:56:50.605 9351 ERROR nova.wsgi
Sep 28 11:56:50 ctl02 nova-api[9351]: 2017-09-28 11:56:50.606 9351 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:56:50 ctl02 nova-api[9351]: 2017-09-28 11:56:50.738 9351 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:56:50 ctl02 nova-api[9351]: 2017-09-28 11:56:50.978 9351 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:56:50 ctl02 nova-api[9351]: 2017-09-28 11:56:50.980 9351 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:56:50 ctl02 nova-api[9351]: 2017-09-28 11:56:50.981 9351 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:56:50 ctl02 nova-api[9351]: 2017-09-28 11:56:50.981 9351 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:56:51 ctl02 nova-api[9351]: 2017-09-28 11:56:51.111 9351 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:56:51 ctl02 nova-api[9351]: 2017-09-28 11:56:51.113 9351 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:56:51 ctl02 nova-api[9351]: 2017-09-28 11:56:51.113 9351 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:56:51 ctl02 nova-api[9351]: 2017-09-28 11:56:51.114 9351 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:56:51 ctl02 nova-api[9351]: 2017-09-28 11:56:51.117 9351 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:56:51 ctl02 nova-api[9351]: 2017-09-28 11:56:51.117 9351 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:56:51 ctl02 nova-api[9351]: 2017-09-28 11:56:51.117 9351 ERROR nova Traceback (most recent call last):
Sep 28 11:56:51 ctl02 nova-api[9351]: 2017-09-28 11:56:51.117 9351 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:56:51 ctl02 nova-api[9351]: 2017-09-28 11:56:51.117 9351 ERROR nova     sys.exit(main())
Sep 28 11:56:51 ctl02 nova-api[9351]: 2017-09-28 11:56:51.117 9351 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:56:51 ctl02 nova-api[9351]: 2017-09-28 11:56:51.117 9351 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:56:51 ctl02 nova-api[9351]: 2017-09-28 11:56:51.117 9351 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:56:51 ctl02 nova-api[9351]: 2017-09-28 11:56:51.117 9351 ERROR nova     max_url_len=max_url_len)
Sep 28 11:56:51 ctl02 nova-api[9351]: 2017-09-28 11:56:51.117 9351 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:56:51 ctl02 nova-api[9351]: 2017-09-28 11:56:51.117 9351 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:56:51 ctl02 nova-api[9351]: 2017-09-28 11:56:51.117 9351 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:56:51 ctl02 nova-api[9351]: 2017-09-28 11:56:51.117 9351 ERROR nova     sock.listen(backlog)
Sep 28 11:56:51 ctl02 nova-api[9351]: 2017-09-28 11:56:51.117 9351 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:56:51 ctl02 nova-api[9351]: 2017-09-28 11:56:51.117 9351 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:56:51 ctl02 nova-api[9351]: 2017-09-28 11:56:51.117 9351 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:56:51 ctl02 nova-api[9351]: 2017-09-28 11:56:51.117 9351 ERROR nova
Sep 28 11:56:51 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:56:51 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:56:51 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:56:51 ctl02 nova-cert[4860]: 2017-09-28 11:56:51.423 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:56:51 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:56:51 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:56:51 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:56:51 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:56:53 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1b50300c)
Sep 28 11:56:53 ctl02 nova-api[9369]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:56:53 ctl02 nova-api[9369]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:56:53 ctl02 nova-api[9369]: 2017-09-28 11:56:53.349 9369 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:56:53 ctl02 nova-api[9369]: 2017-09-28 11:56:53.350 9369 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:56:53 ctl02 nova-api[9369]: 2017-09-28 11:56:53.350 9369 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:56:53 ctl02 nova-api[9369]: 2017-09-28 11:56:53.350 9369 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:56:53 ctl02 nova-api[9369]: 2017-09-28 11:56:53.350 9369 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:56:53 ctl02 nova-api[9369]: 2017-09-28 11:56:53.350 9369 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:56:53 ctl02 nova-api[9369]: 2017-09-28 11:56:53.350 9369 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:56:53 ctl02 nova-api[9369]: 2017-09-28 11:56:53.350 9369 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:56:53 ctl02 nova-api[9369]: 2017-09-28 11:56:53.350 9369 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:56:53 ctl02 nova-api[9369]: 2017-09-28 11:56:53.350 9369 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:56:53 ctl02 nova-api[9369]: 2017-09-28 11:56:53.350 9369 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:56:53 ctl02 nova-api[9369]: 2017-09-28 11:56:53.350 9369 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:56:53 ctl02 nova-api[9369]: 2017-09-28 11:56:53.350 9369 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:56:53 ctl02 nova-api[9369]: 2017-09-28 11:56:53.350 9369 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:56:53 ctl02 nova-api[9369]: 2017-09-28 11:56:53.350 9369 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:56:53 ctl02 nova-api[9369]: 2017-09-28 11:56:53.350 9369 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:56:53 ctl02 nova-api[9369]: 2017-09-28 11:56:53.350 9369 ERROR nova.wsgi     self.filename))
Sep 28 11:56:53 ctl02 nova-api[9369]: 2017-09-28 11:56:53.350 9369 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:56:53 ctl02 nova-api[9369]: 2017-09-28 11:56:53.350 9369 ERROR nova.wsgi
Sep 28 11:56:53 ctl02 nova-api[9369]: 2017-09-28 11:56:53.351 9369 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:56:53 ctl02 nova-api[9369]: 2017-09-28 11:56:53.483 9369 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:56:53 ctl02 nova-api[9369]: 2017-09-28 11:56:53.716 9369 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:56:53 ctl02 nova-api[9369]: 2017-09-28 11:56:53.719 9369 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:56:53 ctl02 nova-api[9369]: 2017-09-28 11:56:53.719 9369 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:56:53 ctl02 nova-api[9369]: 2017-09-28 11:56:53.719 9369 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:56:53 ctl02 nova-api[9369]: 2017-09-28 11:56:53.850 9369 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:56:53 ctl02 nova-api[9369]: 2017-09-28 11:56:53.852 9369 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:56:53 ctl02 nova-api[9369]: 2017-09-28 11:56:53.852 9369 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:56:53 ctl02 nova-api[9369]: 2017-09-28 11:56:53.852 9369 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:56:53 ctl02 nova-api[9369]: 2017-09-28 11:56:53.855 9369 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:56:53 ctl02 nova-api[9369]: 2017-09-28 11:56:53.856 9369 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:56:53 ctl02 nova-api[9369]: 2017-09-28 11:56:53.856 9369 ERROR nova Traceback (most recent call last):
Sep 28 11:56:53 ctl02 nova-api[9369]: 2017-09-28 11:56:53.856 9369 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:56:53 ctl02 nova-api[9369]: 2017-09-28 11:56:53.856 9369 ERROR nova     sys.exit(main())
Sep 28 11:56:53 ctl02 nova-api[9369]: 2017-09-28 11:56:53.856 9369 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:56:53 ctl02 nova-api[9369]: 2017-09-28 11:56:53.856 9369 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:56:53 ctl02 nova-api[9369]: 2017-09-28 11:56:53.856 9369 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:56:53 ctl02 nova-api[9369]: 2017-09-28 11:56:53.856 9369 ERROR nova     max_url_len=max_url_len)
Sep 28 11:56:53 ctl02 nova-api[9369]: 2017-09-28 11:56:53.856 9369 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:56:53 ctl02 nova-api[9369]: 2017-09-28 11:56:53.856 9369 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:56:53 ctl02 nova-api[9369]: 2017-09-28 11:56:53.856 9369 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:56:53 ctl02 nova-api[9369]: 2017-09-28 11:56:53.856 9369 ERROR nova     sock.listen(backlog)
Sep 28 11:56:53 ctl02 nova-api[9369]: 2017-09-28 11:56:53.856 9369 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:56:53 ctl02 nova-api[9369]: 2017-09-28 11:56:53.856 9369 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:56:53 ctl02 nova-api[9369]: 2017-09-28 11:56:53.856 9369 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:56:53 ctl02 nova-api[9369]: 2017-09-28 11:56:53.856 9369 ERROR nova
Sep 28 11:56:53 ctl02 glance-api[29183]: 2017-09-28 11:56:53.975 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:56:53] "OPTIONS / HTTP/1.0" 200 134 0.000691
Sep 28 11:56:53 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:56:54 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:56:54 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:56:54 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1b50300c)
Sep 28 11:56:54 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:56:54 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:56:54 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:56:54 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:56:54 ctl02 nova-conductor[5056]: 2017-09-28 11:56:54.172 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:56:54 ctl02 nova-conductor[5056]: 2017-09-28 11:56:54.187 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:56:54 ctl02 nova-conductor[5056]: 2017-09-28 11:56:54.203 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:56:54 ctl02 nova-conductor[5056]: 2017-09-28 11:56:54.211 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:56:55 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1b50300c)
Sep 28 11:56:55 ctl02 nova-api[9386]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:56:55 ctl02 nova-api[9386]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:56:55 ctl02 nova-api[9386]: 2017-09-28 11:56:55.872 9386 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:56:55 ctl02 nova-api[9386]: 2017-09-28 11:56:55.874 9386 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:56:55 ctl02 nova-api[9386]: 2017-09-28 11:56:55.874 9386 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:56:55 ctl02 nova-api[9386]: 2017-09-28 11:56:55.874 9386 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:56:55 ctl02 nova-api[9386]: 2017-09-28 11:56:55.874 9386 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:56:55 ctl02 nova-api[9386]: 2017-09-28 11:56:55.874 9386 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:56:55 ctl02 nova-api[9386]: 2017-09-28 11:56:55.874 9386 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:56:55 ctl02 nova-api[9386]: 2017-09-28 11:56:55.874 9386 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:56:55 ctl02 nova-api[9386]: 2017-09-28 11:56:55.874 9386 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:56:55 ctl02 nova-api[9386]: 2017-09-28 11:56:55.874 9386 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:56:55 ctl02 nova-api[9386]: 2017-09-28 11:56:55.874 9386 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:56:55 ctl02 nova-api[9386]: 2017-09-28 11:56:55.874 9386 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:56:55 ctl02 nova-api[9386]: 2017-09-28 11:56:55.874 9386 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:56:55 ctl02 nova-api[9386]: 2017-09-28 11:56:55.874 9386 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:56:55 ctl02 nova-api[9386]: 2017-09-28 11:56:55.874 9386 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:56:55 ctl02 nova-api[9386]: 2017-09-28 11:56:55.874 9386 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:56:55 ctl02 nova-api[9386]: 2017-09-28 11:56:55.874 9386 ERROR nova.wsgi     self.filename))
Sep 28 11:56:55 ctl02 nova-api[9386]: 2017-09-28 11:56:55.874 9386 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:56:55 ctl02 nova-api[9386]: 2017-09-28 11:56:55.874 9386 ERROR nova.wsgi
Sep 28 11:56:55 ctl02 nova-api[9386]: 2017-09-28 11:56:55.876 9386 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:56:56 ctl02 nova-api[9386]: 2017-09-28 11:56:56.010 9386 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:56:56 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1b50300c)
Sep 28 11:56:56 ctl02 nova-api[9386]: 2017-09-28 11:56:56.249 9386 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:56:56 ctl02 nova-api[9386]: 2017-09-28 11:56:56.251 9386 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:56:56 ctl02 nova-api[9386]: 2017-09-28 11:56:56.252 9386 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:56:56 ctl02 nova-api[9386]: 2017-09-28 11:56:56.252 9386 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:56:56 ctl02 nova-api[9386]: 2017-09-28 11:56:56.383 9386 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:56:56 ctl02 nova-api[9386]: 2017-09-28 11:56:56.386 9386 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:56:56 ctl02 nova-api[9386]: 2017-09-28 11:56:56.387 9386 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:56:56 ctl02 nova-api[9386]: 2017-09-28 11:56:56.387 9386 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:56:56 ctl02 nova-api[9386]: 2017-09-28 11:56:56.390 9386 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:56:56 ctl02 nova-api[9386]: 2017-09-28 11:56:56.391 9386 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:56:56 ctl02 nova-api[9386]: 2017-09-28 11:56:56.391 9386 ERROR nova Traceback (most recent call last):
Sep 28 11:56:56 ctl02 nova-api[9386]: 2017-09-28 11:56:56.391 9386 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:56:56 ctl02 nova-api[9386]: 2017-09-28 11:56:56.391 9386 ERROR nova     sys.exit(main())
Sep 28 11:56:56 ctl02 nova-api[9386]: 2017-09-28 11:56:56.391 9386 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:56:56 ctl02 nova-api[9386]: 2017-09-28 11:56:56.391 9386 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:56:56 ctl02 nova-api[9386]: 2017-09-28 11:56:56.391 9386 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:56:56 ctl02 nova-api[9386]: 2017-09-28 11:56:56.391 9386 ERROR nova     max_url_len=max_url_len)
Sep 28 11:56:56 ctl02 nova-api[9386]: 2017-09-28 11:56:56.391 9386 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:56:56 ctl02 nova-api[9386]: 2017-09-28 11:56:56.391 9386 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:56:56 ctl02 nova-api[9386]: 2017-09-28 11:56:56.391 9386 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:56:56 ctl02 nova-api[9386]: 2017-09-28 11:56:56.391 9386 ERROR nova     sock.listen(backlog)
Sep 28 11:56:56 ctl02 nova-api[9386]: 2017-09-28 11:56:56.391 9386 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:56:56 ctl02 nova-api[9386]: 2017-09-28 11:56:56.391 9386 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:56:56 ctl02 nova-api[9386]: 2017-09-28 11:56:56.391 9386 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:56:56 ctl02 nova-api[9386]: 2017-09-28 11:56:56.391 9386 ERROR nova
Sep 28 11:56:56 ctl02 glance-api[29183]: 2017-09-28 11:56:56.424 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:56:56] "OPTIONS / HTTP/1.0" 200 134 0.001138
Sep 28 11:56:56 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:56:56 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:56:56 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:56:56 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:56:56 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:56:56 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:56:56 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:56:57 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1b50300c)
Sep 28 11:56:57 ctl02 glance-api[29183]: 2017-09-28 11:56:57.748 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:56:57] "OPTIONS / HTTP/1.0" 200 134 0.001044
Sep 28 11:56:58 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1b50300c)
Sep 28 11:56:58 ctl02 nova-api[9405]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:56:58 ctl02 nova-api[9405]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:56:58 ctl02 nova-api[9405]: 2017-09-28 11:56:58.583 9405 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:56:58 ctl02 nova-api[9405]: 2017-09-28 11:56:58.585 9405 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:56:58 ctl02 nova-api[9405]: 2017-09-28 11:56:58.585 9405 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:56:58 ctl02 nova-api[9405]: 2017-09-28 11:56:58.585 9405 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:56:58 ctl02 nova-api[9405]: 2017-09-28 11:56:58.585 9405 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:56:58 ctl02 nova-api[9405]: 2017-09-28 11:56:58.585 9405 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:56:58 ctl02 nova-api[9405]: 2017-09-28 11:56:58.585 9405 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:56:58 ctl02 nova-api[9405]: 2017-09-28 11:56:58.585 9405 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:56:58 ctl02 nova-api[9405]: 2017-09-28 11:56:58.585 9405 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:56:58 ctl02 nova-api[9405]: 2017-09-28 11:56:58.585 9405 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:56:58 ctl02 nova-api[9405]: 2017-09-28 11:56:58.585 9405 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:56:58 ctl02 nova-api[9405]: 2017-09-28 11:56:58.585 9405 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:56:58 ctl02 nova-api[9405]: 2017-09-28 11:56:58.585 9405 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:56:58 ctl02 nova-api[9405]: 2017-09-28 11:56:58.585 9405 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:56:58 ctl02 nova-api[9405]: 2017-09-28 11:56:58.585 9405 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:56:58 ctl02 nova-api[9405]: 2017-09-28 11:56:58.585 9405 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:56:58 ctl02 nova-api[9405]: 2017-09-28 11:56:58.585 9405 ERROR nova.wsgi     self.filename))
Sep 28 11:56:58 ctl02 nova-api[9405]: 2017-09-28 11:56:58.585 9405 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:56:58 ctl02 nova-api[9405]: 2017-09-28 11:56:58.585 9405 ERROR nova.wsgi
Sep 28 11:56:58 ctl02 nova-api[9405]: 2017-09-28 11:56:58.586 9405 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:56:58 ctl02 nova-api[9405]: 2017-09-28 11:56:58.717 9405 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:56:58 ctl02 nova-api[9405]: 2017-09-28 11:56:58.953 9405 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:56:58 ctl02 nova-api[9405]: 2017-09-28 11:56:58.955 9405 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:56:58 ctl02 nova-api[9405]: 2017-09-28 11:56:58.955 9405 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:56:58 ctl02 nova-api[9405]: 2017-09-28 11:56:58.956 9405 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:56:59 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1b50300c)
Sep 28 11:56:59 ctl02 nova-api[9405]: 2017-09-28 11:56:59.086 9405 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:56:59 ctl02 nova-api[9405]: 2017-09-28 11:56:59.088 9405 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:56:59 ctl02 nova-api[9405]: 2017-09-28 11:56:59.088 9405 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:56:59 ctl02 nova-api[9405]: 2017-09-28 11:56:59.088 9405 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:56:59 ctl02 nova-api[9405]: 2017-09-28 11:56:59.092 9405 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:56:59 ctl02 nova-api[9405]: 2017-09-28 11:56:59.092 9405 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:56:59 ctl02 nova-api[9405]: 2017-09-28 11:56:59.092 9405 ERROR nova Traceback (most recent call last):
Sep 28 11:56:59 ctl02 nova-api[9405]: 2017-09-28 11:56:59.092 9405 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:56:59 ctl02 nova-api[9405]: 2017-09-28 11:56:59.092 9405 ERROR nova     sys.exit(main())
Sep 28 11:56:59 ctl02 nova-api[9405]: 2017-09-28 11:56:59.092 9405 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:56:59 ctl02 nova-api[9405]: 2017-09-28 11:56:59.092 9405 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:56:59 ctl02 nova-api[9405]: 2017-09-28 11:56:59.092 9405 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:56:59 ctl02 nova-api[9405]: 2017-09-28 11:56:59.092 9405 ERROR nova     max_url_len=max_url_len)
Sep 28 11:56:59 ctl02 nova-api[9405]: 2017-09-28 11:56:59.092 9405 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:56:59 ctl02 nova-api[9405]: 2017-09-28 11:56:59.092 9405 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:56:59 ctl02 nova-api[9405]: 2017-09-28 11:56:59.092 9405 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:56:59 ctl02 nova-api[9405]: 2017-09-28 11:56:59.092 9405 ERROR nova     sock.listen(backlog)
Sep 28 11:56:59 ctl02 nova-api[9405]: 2017-09-28 11:56:59.092 9405 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:56:59 ctl02 nova-api[9405]: 2017-09-28 11:56:59.092 9405 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:56:59 ctl02 nova-api[9405]: 2017-09-28 11:56:59.092 9405 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:56:59 ctl02 nova-api[9405]: 2017-09-28 11:56:59.092 9405 ERROR nova
Sep 28 11:56:59 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:56:59 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:56:59 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:56:59 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:56:59 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:56:59 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:56:59 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:57:00 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1b50300c)
Sep 28 11:57:00 ctl02 nova-api[9423]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:57:00 ctl02 nova-api[9423]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:57:01 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1b50300c)
Sep 28 11:57:01 ctl02 nova-api[9423]: 2017-09-28 11:57:01.092 9423 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:57:01 ctl02 nova-api[9423]: 2017-09-28 11:57:01.094 9423 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:57:01 ctl02 nova-api[9423]: 2017-09-28 11:57:01.094 9423 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:57:01 ctl02 nova-api[9423]: 2017-09-28 11:57:01.094 9423 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:57:01 ctl02 nova-api[9423]: 2017-09-28 11:57:01.094 9423 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:57:01 ctl02 nova-api[9423]: 2017-09-28 11:57:01.094 9423 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:57:01 ctl02 nova-api[9423]: 2017-09-28 11:57:01.094 9423 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:57:01 ctl02 nova-api[9423]: 2017-09-28 11:57:01.094 9423 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:57:01 ctl02 nova-api[9423]: 2017-09-28 11:57:01.094 9423 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:57:01 ctl02 nova-api[9423]: 2017-09-28 11:57:01.094 9423 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:57:01 ctl02 nova-api[9423]: 2017-09-28 11:57:01.094 9423 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:57:01 ctl02 nova-api[9423]: 2017-09-28 11:57:01.094 9423 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:57:01 ctl02 nova-api[9423]: 2017-09-28 11:57:01.094 9423 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:57:01 ctl02 nova-api[9423]: 2017-09-28 11:57:01.094 9423 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:57:01 ctl02 nova-api[9423]: 2017-09-28 11:57:01.094 9423 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:57:01 ctl02 nova-api[9423]: 2017-09-28 11:57:01.094 9423 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:57:01 ctl02 nova-api[9423]: 2017-09-28 11:57:01.094 9423 ERROR nova.wsgi     self.filename))
Sep 28 11:57:01 ctl02 nova-api[9423]: 2017-09-28 11:57:01.094 9423 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:57:01 ctl02 nova-api[9423]: 2017-09-28 11:57:01.094 9423 ERROR nova.wsgi
Sep 28 11:57:01 ctl02 nova-api[9423]: 2017-09-28 11:57:01.095 9423 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:57:01 ctl02 nova-api[9423]: 2017-09-28 11:57:01.227 9423 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:57:01 ctl02 nova-consoleauth[5433]: 2017-09-28 11:57:01.312 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:57:01 ctl02 nova-api[9423]: 2017-09-28 11:57:01.470 9423 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:57:01 ctl02 nova-api[9423]: 2017-09-28 11:57:01.473 9423 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:57:01 ctl02 nova-api[9423]: 2017-09-28 11:57:01.473 9423 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:57:01 ctl02 nova-api[9423]: 2017-09-28 11:57:01.473 9423 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:57:01 ctl02 nova-api[9423]: 2017-09-28 11:57:01.603 9423 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:57:01 ctl02 nova-api[9423]: 2017-09-28 11:57:01.605 9423 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:57:01 ctl02 nova-api[9423]: 2017-09-28 11:57:01.606 9423 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:57:01 ctl02 nova-api[9423]: 2017-09-28 11:57:01.606 9423 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:57:01 ctl02 nova-api[9423]: 2017-09-28 11:57:01.609 9423 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:57:01 ctl02 nova-api[9423]: 2017-09-28 11:57:01.609 9423 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:57:01 ctl02 nova-api[9423]: 2017-09-28 11:57:01.609 9423 ERROR nova Traceback (most recent call last):
Sep 28 11:57:01 ctl02 nova-api[9423]: 2017-09-28 11:57:01.609 9423 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:57:01 ctl02 nova-api[9423]: 2017-09-28 11:57:01.609 9423 ERROR nova     sys.exit(main())
Sep 28 11:57:01 ctl02 nova-api[9423]: 2017-09-28 11:57:01.609 9423 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:57:01 ctl02 nova-api[9423]: 2017-09-28 11:57:01.609 9423 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:57:01 ctl02 nova-api[9423]: 2017-09-28 11:57:01.609 9423 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:57:01 ctl02 nova-api[9423]: 2017-09-28 11:57:01.609 9423 ERROR nova     max_url_len=max_url_len)
Sep 28 11:57:01 ctl02 nova-api[9423]: 2017-09-28 11:57:01.609 9423 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:57:01 ctl02 nova-api[9423]: 2017-09-28 11:57:01.609 9423 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:57:01 ctl02 nova-api[9423]: 2017-09-28 11:57:01.609 9423 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:57:01 ctl02 nova-api[9423]: 2017-09-28 11:57:01.609 9423 ERROR nova     sock.listen(backlog)
Sep 28 11:57:01 ctl02 nova-api[9423]: 2017-09-28 11:57:01.609 9423 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:57:01 ctl02 nova-api[9423]: 2017-09-28 11:57:01.609 9423 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:57:01 ctl02 nova-api[9423]: 2017-09-28 11:57:01.609 9423 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:57:01 ctl02 nova-api[9423]: 2017-09-28 11:57:01.609 9423 ERROR nova
Sep 28 11:57:01 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:57:01 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:57:01 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:57:01 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:57:01 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:57:01 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:57:01 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:57:02 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1b50300c)
Sep 28 11:57:03 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1b50300c)
Sep 28 11:57:03 ctl02 nova-api[9441]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:57:03 ctl02 nova-api[9441]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:57:03 ctl02 nova-api[9441]: 2017-09-28 11:57:03.579 9441 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:57:03 ctl02 nova-api[9441]: 2017-09-28 11:57:03.580 9441 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:57:03 ctl02 nova-api[9441]: 2017-09-28 11:57:03.580 9441 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:57:03 ctl02 nova-api[9441]: 2017-09-28 11:57:03.580 9441 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:57:03 ctl02 nova-api[9441]: 2017-09-28 11:57:03.580 9441 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:57:03 ctl02 nova-api[9441]: 2017-09-28 11:57:03.580 9441 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:57:03 ctl02 nova-api[9441]: 2017-09-28 11:57:03.580 9441 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:57:03 ctl02 nova-api[9441]: 2017-09-28 11:57:03.580 9441 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:57:03 ctl02 nova-api[9441]: 2017-09-28 11:57:03.580 9441 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:57:03 ctl02 nova-api[9441]: 2017-09-28 11:57:03.580 9441 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:57:03 ctl02 nova-api[9441]: 2017-09-28 11:57:03.580 9441 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:57:03 ctl02 nova-api[9441]: 2017-09-28 11:57:03.580 9441 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:57:03 ctl02 nova-api[9441]: 2017-09-28 11:57:03.580 9441 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:57:03 ctl02 nova-api[9441]: 2017-09-28 11:57:03.580 9441 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:57:03 ctl02 nova-api[9441]: 2017-09-28 11:57:03.580 9441 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:57:03 ctl02 nova-api[9441]: 2017-09-28 11:57:03.580 9441 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:57:03 ctl02 nova-api[9441]: 2017-09-28 11:57:03.580 9441 ERROR nova.wsgi     self.filename))
Sep 28 11:57:03 ctl02 nova-api[9441]: 2017-09-28 11:57:03.580 9441 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:57:03 ctl02 nova-api[9441]: 2017-09-28 11:57:03.580 9441 ERROR nova.wsgi
Sep 28 11:57:03 ctl02 nova-api[9441]: 2017-09-28 11:57:03.581 9441 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:57:03 ctl02 nova-api[9441]: 2017-09-28 11:57:03.714 9441 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:57:03 ctl02 glance-api[29183]: 2017-09-28 11:57:03.915 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:57:03] "OPTIONS / HTTP/1.0" 200 134 0.000630
Sep 28 11:57:03 ctl02 nova-api[9441]: 2017-09-28 11:57:03.951 9441 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:57:03 ctl02 nova-api[9441]: 2017-09-28 11:57:03.953 9441 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:57:03 ctl02 nova-api[9441]: 2017-09-28 11:57:03.953 9441 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:57:03 ctl02 nova-api[9441]: 2017-09-28 11:57:03.954 9441 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:57:04 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:57:04 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:57:04 ctl02 nova-api[9441]: 2017-09-28 11:57:04.083 9441 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:57:04 ctl02 nova-api[9441]: 2017-09-28 11:57:04.085 9441 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:57:04 ctl02 nova-api[9441]: 2017-09-28 11:57:04.085 9441 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:57:04 ctl02 nova-api[9441]: 2017-09-28 11:57:04.086 9441 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:57:04 ctl02 nova-api[9441]: 2017-09-28 11:57:04.089 9441 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:57:04 ctl02 nova-api[9441]: 2017-09-28 11:57:04.090 9441 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:57:04 ctl02 nova-api[9441]: 2017-09-28 11:57:04.090 9441 ERROR nova Traceback (most recent call last):
Sep 28 11:57:04 ctl02 nova-api[9441]: 2017-09-28 11:57:04.090 9441 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:57:04 ctl02 nova-api[9441]: 2017-09-28 11:57:04.090 9441 ERROR nova     sys.exit(main())
Sep 28 11:57:04 ctl02 nova-api[9441]: 2017-09-28 11:57:04.090 9441 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:57:04 ctl02 nova-api[9441]: 2017-09-28 11:57:04.090 9441 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:57:04 ctl02 nova-api[9441]: 2017-09-28 11:57:04.090 9441 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:57:04 ctl02 nova-api[9441]: 2017-09-28 11:57:04.090 9441 ERROR nova     max_url_len=max_url_len)
Sep 28 11:57:04 ctl02 nova-api[9441]: 2017-09-28 11:57:04.090 9441 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:57:04 ctl02 nova-api[9441]: 2017-09-28 11:57:04.090 9441 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:57:04 ctl02 nova-api[9441]: 2017-09-28 11:57:04.090 9441 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:57:04 ctl02 nova-api[9441]: 2017-09-28 11:57:04.090 9441 ERROR nova     sock.listen(backlog)
Sep 28 11:57:04 ctl02 nova-api[9441]: 2017-09-28 11:57:04.090 9441 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:57:04 ctl02 nova-api[9441]: 2017-09-28 11:57:04.090 9441 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:57:04 ctl02 nova-api[9441]: 2017-09-28 11:57:04.090 9441 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:57:04 ctl02 nova-api[9441]: 2017-09-28 11:57:04.090 9441 ERROR nova
Sep 28 11:57:04 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:57:04 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:57:04 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:57:04 ctl02 nova-scheduler[5620]: 2017-09-28 11:57:04.338 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:57:04 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:57:04 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:57:04 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:57:04 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:57:05 ctl02 nova-api[9464]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:57:05 ctl02 nova-api[9464]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:57:06 ctl02 nova-api[9464]: 2017-09-28 11:57:06.086 9464 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:57:06 ctl02 nova-api[9464]: 2017-09-28 11:57:06.087 9464 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:57:06 ctl02 nova-api[9464]: 2017-09-28 11:57:06.087 9464 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:57:06 ctl02 nova-api[9464]: 2017-09-28 11:57:06.087 9464 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:57:06 ctl02 nova-api[9464]: 2017-09-28 11:57:06.087 9464 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:57:06 ctl02 nova-api[9464]: 2017-09-28 11:57:06.087 9464 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:57:06 ctl02 nova-api[9464]: 2017-09-28 11:57:06.087 9464 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:57:06 ctl02 nova-api[9464]: 2017-09-28 11:57:06.087 9464 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:57:06 ctl02 nova-api[9464]: 2017-09-28 11:57:06.087 9464 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:57:06 ctl02 nova-api[9464]: 2017-09-28 11:57:06.087 9464 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:57:06 ctl02 nova-api[9464]: 2017-09-28 11:57:06.087 9464 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:57:06 ctl02 nova-api[9464]: 2017-09-28 11:57:06.087 9464 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:57:06 ctl02 nova-api[9464]: 2017-09-28 11:57:06.087 9464 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:57:06 ctl02 nova-api[9464]: 2017-09-28 11:57:06.087 9464 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:57:06 ctl02 nova-api[9464]: 2017-09-28 11:57:06.087 9464 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:57:06 ctl02 nova-api[9464]: 2017-09-28 11:57:06.087 9464 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:57:06 ctl02 nova-api[9464]: 2017-09-28 11:57:06.087 9464 ERROR nova.wsgi     self.filename))
Sep 28 11:57:06 ctl02 nova-api[9464]: 2017-09-28 11:57:06.087 9464 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:57:06 ctl02 nova-api[9464]: 2017-09-28 11:57:06.087 9464 ERROR nova.wsgi
Sep 28 11:57:06 ctl02 nova-api[9464]: 2017-09-28 11:57:06.090 9464 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:57:06 ctl02 nova-api[9464]: 2017-09-28 11:57:06.223 9464 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:57:06 ctl02 nova-api[9464]: 2017-09-28 11:57:06.466 9464 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:57:06 ctl02 nova-api[9464]: 2017-09-28 11:57:06.469 9464 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:57:06 ctl02 nova-api[9464]: 2017-09-28 11:57:06.469 9464 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:57:06 ctl02 nova-api[9464]: 2017-09-28 11:57:06.470 9464 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:57:06 ctl02 glance-api[29183]: 2017-09-28 11:57:06.573 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:57:06] "OPTIONS / HTTP/1.0" 200 134 0.000730
Sep 28 11:57:06 ctl02 nova-api[9464]: 2017-09-28 11:57:06.601 9464 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:57:06 ctl02 nova-api[9464]: 2017-09-28 11:57:06.603 9464 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:57:06 ctl02 nova-api[9464]: 2017-09-28 11:57:06.603 9464 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:57:06 ctl02 nova-api[9464]: 2017-09-28 11:57:06.604 9464 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:57:06 ctl02 nova-api[9464]: 2017-09-28 11:57:06.607 9464 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:57:06 ctl02 nova-api[9464]: 2017-09-28 11:57:06.607 9464 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:57:06 ctl02 nova-api[9464]: 2017-09-28 11:57:06.607 9464 ERROR nova Traceback (most recent call last):
Sep 28 11:57:06 ctl02 nova-api[9464]: 2017-09-28 11:57:06.607 9464 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:57:06 ctl02 nova-api[9464]: 2017-09-28 11:57:06.607 9464 ERROR nova     sys.exit(main())
Sep 28 11:57:06 ctl02 nova-api[9464]: 2017-09-28 11:57:06.607 9464 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:57:06 ctl02 nova-api[9464]: 2017-09-28 11:57:06.607 9464 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:57:06 ctl02 nova-api[9464]: 2017-09-28 11:57:06.607 9464 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:57:06 ctl02 nova-api[9464]: 2017-09-28 11:57:06.607 9464 ERROR nova     max_url_len=max_url_len)
Sep 28 11:57:06 ctl02 nova-api[9464]: 2017-09-28 11:57:06.607 9464 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:57:06 ctl02 nova-api[9464]: 2017-09-28 11:57:06.607 9464 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:57:06 ctl02 nova-api[9464]: 2017-09-28 11:57:06.607 9464 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:57:06 ctl02 nova-api[9464]: 2017-09-28 11:57:06.607 9464 ERROR nova     sock.listen(backlog)
Sep 28 11:57:06 ctl02 nova-api[9464]: 2017-09-28 11:57:06.607 9464 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:57:06 ctl02 nova-api[9464]: 2017-09-28 11:57:06.607 9464 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:57:06 ctl02 nova-api[9464]: 2017-09-28 11:57:06.607 9464 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:57:06 ctl02 nova-api[9464]: 2017-09-28 11:57:06.607 9464 ERROR nova
Sep 28 11:57:06 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:57:06 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:57:06 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:57:06 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:57:06 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:57:06 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:57:06 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:57:07 ctl02 glance-api[29183]: 2017-09-28 11:57:07.420 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:57:07] "OPTIONS / HTTP/1.0" 200 134 0.000645
Sep 28 11:57:08 ctl02 nova-api[9482]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:57:08 ctl02 nova-api[9482]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:57:08 ctl02 nova-api[9482]: 2017-09-28 11:57:08.607 9482 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:57:08 ctl02 nova-api[9482]: 2017-09-28 11:57:08.609 9482 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:57:08 ctl02 nova-api[9482]: 2017-09-28 11:57:08.609 9482 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:57:08 ctl02 nova-api[9482]: 2017-09-28 11:57:08.609 9482 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:57:08 ctl02 nova-api[9482]: 2017-09-28 11:57:08.609 9482 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:57:08 ctl02 nova-api[9482]: 2017-09-28 11:57:08.609 9482 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:57:08 ctl02 nova-api[9482]: 2017-09-28 11:57:08.609 9482 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:57:08 ctl02 nova-api[9482]: 2017-09-28 11:57:08.609 9482 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:57:08 ctl02 nova-api[9482]: 2017-09-28 11:57:08.609 9482 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:57:08 ctl02 nova-api[9482]: 2017-09-28 11:57:08.609 9482 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:57:08 ctl02 nova-api[9482]: 2017-09-28 11:57:08.609 9482 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:57:08 ctl02 nova-api[9482]: 2017-09-28 11:57:08.609 9482 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:57:08 ctl02 nova-api[9482]: 2017-09-28 11:57:08.609 9482 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:57:08 ctl02 nova-api[9482]: 2017-09-28 11:57:08.609 9482 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:57:08 ctl02 nova-api[9482]: 2017-09-28 11:57:08.609 9482 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:57:08 ctl02 nova-api[9482]: 2017-09-28 11:57:08.609 9482 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:57:08 ctl02 nova-api[9482]: 2017-09-28 11:57:08.609 9482 ERROR nova.wsgi     self.filename))
Sep 28 11:57:08 ctl02 nova-api[9482]: 2017-09-28 11:57:08.609 9482 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:57:08 ctl02 nova-api[9482]: 2017-09-28 11:57:08.609 9482 ERROR nova.wsgi
Sep 28 11:57:08 ctl02 nova-api[9482]: 2017-09-28 11:57:08.611 9482 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:57:08 ctl02 nova-api[9482]: 2017-09-28 11:57:08.743 9482 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:57:08 ctl02 nova-api[9482]: 2017-09-28 11:57:08.981 9482 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:57:08 ctl02 nova-api[9482]: 2017-09-28 11:57:08.984 9482 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:57:08 ctl02 nova-api[9482]: 2017-09-28 11:57:08.984 9482 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:57:08 ctl02 nova-api[9482]: 2017-09-28 11:57:08.985 9482 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:57:09 ctl02 nova-api[9482]: 2017-09-28 11:57:09.114 9482 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:57:09 ctl02 nova-api[9482]: 2017-09-28 11:57:09.117 9482 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:57:09 ctl02 nova-api[9482]: 2017-09-28 11:57:09.117 9482 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:57:09 ctl02 nova-api[9482]: 2017-09-28 11:57:09.118 9482 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:57:09 ctl02 nova-api[9482]: 2017-09-28 11:57:09.121 9482 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:57:09 ctl02 nova-api[9482]: 2017-09-28 11:57:09.122 9482 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:57:09 ctl02 nova-api[9482]: 2017-09-28 11:57:09.122 9482 ERROR nova Traceback (most recent call last):
Sep 28 11:57:09 ctl02 nova-api[9482]: 2017-09-28 11:57:09.122 9482 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:57:09 ctl02 nova-api[9482]: 2017-09-28 11:57:09.122 9482 ERROR nova     sys.exit(main())
Sep 28 11:57:09 ctl02 nova-api[9482]: 2017-09-28 11:57:09.122 9482 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:57:09 ctl02 nova-api[9482]: 2017-09-28 11:57:09.122 9482 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:57:09 ctl02 nova-api[9482]: 2017-09-28 11:57:09.122 9482 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:57:09 ctl02 nova-api[9482]: 2017-09-28 11:57:09.122 9482 ERROR nova     max_url_len=max_url_len)
Sep 28 11:57:09 ctl02 nova-api[9482]: 2017-09-28 11:57:09.122 9482 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:57:09 ctl02 nova-api[9482]: 2017-09-28 11:57:09.122 9482 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:57:09 ctl02 nova-api[9482]: 2017-09-28 11:57:09.122 9482 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:57:09 ctl02 nova-api[9482]: 2017-09-28 11:57:09.122 9482 ERROR nova     sock.listen(backlog)
Sep 28 11:57:09 ctl02 nova-api[9482]: 2017-09-28 11:57:09.122 9482 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:57:09 ctl02 nova-api[9482]: 2017-09-28 11:57:09.122 9482 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:57:09 ctl02 nova-api[9482]: 2017-09-28 11:57:09.122 9482 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:57:09 ctl02 nova-api[9482]: 2017-09-28 11:57:09.122 9482 ERROR nova
Sep 28 11:57:09 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:57:09 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:57:09 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:57:09 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:57:09 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:57:09 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:57:09 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:57:11 ctl02 nova-api[9500]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:57:11 ctl02 nova-api[9500]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:57:11 ctl02 nova-api[9500]: 2017-09-28 11:57:11.349 9500 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:57:11 ctl02 nova-api[9500]: 2017-09-28 11:57:11.350 9500 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:57:11 ctl02 nova-api[9500]: 2017-09-28 11:57:11.350 9500 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:57:11 ctl02 nova-api[9500]: 2017-09-28 11:57:11.350 9500 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:57:11 ctl02 nova-api[9500]: 2017-09-28 11:57:11.350 9500 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:57:11 ctl02 nova-api[9500]: 2017-09-28 11:57:11.350 9500 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:57:11 ctl02 nova-api[9500]: 2017-09-28 11:57:11.350 9500 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:57:11 ctl02 nova-api[9500]: 2017-09-28 11:57:11.350 9500 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:57:11 ctl02 nova-api[9500]: 2017-09-28 11:57:11.350 9500 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:57:11 ctl02 nova-api[9500]: 2017-09-28 11:57:11.350 9500 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:57:11 ctl02 nova-api[9500]: 2017-09-28 11:57:11.350 9500 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:57:11 ctl02 nova-api[9500]: 2017-09-28 11:57:11.350 9500 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:57:11 ctl02 nova-api[9500]: 2017-09-28 11:57:11.350 9500 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:57:11 ctl02 nova-api[9500]: 2017-09-28 11:57:11.350 9500 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:57:11 ctl02 nova-api[9500]: 2017-09-28 11:57:11.350 9500 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:57:11 ctl02 nova-api[9500]: 2017-09-28 11:57:11.350 9500 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:57:11 ctl02 nova-api[9500]: 2017-09-28 11:57:11.350 9500 ERROR nova.wsgi     self.filename))
Sep 28 11:57:11 ctl02 nova-api[9500]: 2017-09-28 11:57:11.350 9500 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:57:11 ctl02 nova-api[9500]: 2017-09-28 11:57:11.350 9500 ERROR nova.wsgi
Sep 28 11:57:11 ctl02 nova-api[9500]: 2017-09-28 11:57:11.352 9500 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:57:11 ctl02 nova-api[9500]: 2017-09-28 11:57:11.485 9500 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:57:11 ctl02 nova-api[9500]: 2017-09-28 11:57:11.726 9500 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:57:11 ctl02 nova-api[9500]: 2017-09-28 11:57:11.729 9500 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:57:11 ctl02 nova-api[9500]: 2017-09-28 11:57:11.729 9500 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:57:11 ctl02 nova-api[9500]: 2017-09-28 11:57:11.729 9500 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:57:11 ctl02 nova-api[9500]: 2017-09-28 11:57:11.860 9500 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:57:11 ctl02 nova-api[9500]: 2017-09-28 11:57:11.862 9500 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:57:11 ctl02 nova-api[9500]: 2017-09-28 11:57:11.862 9500 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:57:11 ctl02 nova-api[9500]: 2017-09-28 11:57:11.862 9500 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:57:11 ctl02 nova-api[9500]: 2017-09-28 11:57:11.865 9500 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:57:11 ctl02 nova-api[9500]: 2017-09-28 11:57:11.866 9500 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:57:11 ctl02 nova-api[9500]: 2017-09-28 11:57:11.866 9500 ERROR nova Traceback (most recent call last):
Sep 28 11:57:11 ctl02 nova-api[9500]: 2017-09-28 11:57:11.866 9500 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:57:11 ctl02 nova-api[9500]: 2017-09-28 11:57:11.866 9500 ERROR nova     sys.exit(main())
Sep 28 11:57:11 ctl02 nova-api[9500]: 2017-09-28 11:57:11.866 9500 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:57:11 ctl02 nova-api[9500]: 2017-09-28 11:57:11.866 9500 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:57:11 ctl02 nova-api[9500]: 2017-09-28 11:57:11.866 9500 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:57:11 ctl02 nova-api[9500]: 2017-09-28 11:57:11.866 9500 ERROR nova     max_url_len=max_url_len)
Sep 28 11:57:11 ctl02 nova-api[9500]: 2017-09-28 11:57:11.866 9500 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:57:11 ctl02 nova-api[9500]: 2017-09-28 11:57:11.866 9500 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:57:11 ctl02 nova-api[9500]: 2017-09-28 11:57:11.866 9500 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:57:11 ctl02 nova-api[9500]: 2017-09-28 11:57:11.866 9500 ERROR nova     sock.listen(backlog)
Sep 28 11:57:11 ctl02 nova-api[9500]: 2017-09-28 11:57:11.866 9500 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:57:11 ctl02 nova-api[9500]: 2017-09-28 11:57:11.866 9500 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:57:11 ctl02 nova-api[9500]: 2017-09-28 11:57:11.866 9500 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:57:11 ctl02 nova-api[9500]: 2017-09-28 11:57:11.866 9500 ERROR nova
Sep 28 11:57:12 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:57:12 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:57:12 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:57:12 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:57:12 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:57:12 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:57:12 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:57:12 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x87bc3e56)
Sep 28 11:57:13 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x87bc3e56)
Sep 28 11:57:13 ctl02 nova-api[9518]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:57:13 ctl02 nova-api[9518]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:57:13 ctl02 nova-api[9518]: 2017-09-28 11:57:13.863 9518 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:57:13 ctl02 nova-api[9518]: 2017-09-28 11:57:13.865 9518 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:57:13 ctl02 nova-api[9518]: 2017-09-28 11:57:13.865 9518 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:57:13 ctl02 nova-api[9518]: 2017-09-28 11:57:13.865 9518 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:57:13 ctl02 nova-api[9518]: 2017-09-28 11:57:13.865 9518 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:57:13 ctl02 nova-api[9518]: 2017-09-28 11:57:13.865 9518 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:57:13 ctl02 nova-api[9518]: 2017-09-28 11:57:13.865 9518 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:57:13 ctl02 nova-api[9518]: 2017-09-28 11:57:13.865 9518 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:57:13 ctl02 nova-api[9518]: 2017-09-28 11:57:13.865 9518 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:57:13 ctl02 nova-api[9518]: 2017-09-28 11:57:13.865 9518 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:57:13 ctl02 nova-api[9518]: 2017-09-28 11:57:13.865 9518 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:57:13 ctl02 nova-api[9518]: 2017-09-28 11:57:13.865 9518 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:57:13 ctl02 nova-api[9518]: 2017-09-28 11:57:13.865 9518 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:57:13 ctl02 nova-api[9518]: 2017-09-28 11:57:13.865 9518 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:57:13 ctl02 nova-api[9518]: 2017-09-28 11:57:13.865 9518 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:57:13 ctl02 nova-api[9518]: 2017-09-28 11:57:13.865 9518 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:57:13 ctl02 nova-api[9518]: 2017-09-28 11:57:13.865 9518 ERROR nova.wsgi     self.filename))
Sep 28 11:57:13 ctl02 nova-api[9518]: 2017-09-28 11:57:13.865 9518 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:57:13 ctl02 nova-api[9518]: 2017-09-28 11:57:13.865 9518 ERROR nova.wsgi
Sep 28 11:57:13 ctl02 nova-api[9518]: 2017-09-28 11:57:13.866 9518 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:57:13 ctl02 glance-api[29183]: 2017-09-28 11:57:13.968 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:57:13] "OPTIONS / HTTP/1.0" 200 134 0.000695
Sep 28 11:57:14 ctl02 nova-api[9518]: 2017-09-28 11:57:14.001 9518 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:57:14 ctl02 nova-api[9518]: 2017-09-28 11:57:14.245 9518 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:57:14 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x87bc3e56)
Sep 28 11:57:14 ctl02 nova-api[9518]: 2017-09-28 11:57:14.247 9518 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:57:14 ctl02 nova-api[9518]: 2017-09-28 11:57:14.248 9518 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:57:14 ctl02 nova-api[9518]: 2017-09-28 11:57:14.248 9518 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:57:14 ctl02 nova-api[9518]: 2017-09-28 11:57:14.385 9518 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:57:14 ctl02 nova-api[9518]: 2017-09-28 11:57:14.387 9518 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:57:14 ctl02 nova-api[9518]: 2017-09-28 11:57:14.387 9518 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:57:14 ctl02 nova-api[9518]: 2017-09-28 11:57:14.387 9518 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:57:14 ctl02 nova-api[9518]: 2017-09-28 11:57:14.391 9518 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:57:14 ctl02 nova-api[9518]: 2017-09-28 11:57:14.391 9518 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:57:14 ctl02 nova-api[9518]: 2017-09-28 11:57:14.391 9518 ERROR nova Traceback (most recent call last):
Sep 28 11:57:14 ctl02 nova-api[9518]: 2017-09-28 11:57:14.391 9518 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:57:14 ctl02 nova-api[9518]: 2017-09-28 11:57:14.391 9518 ERROR nova     sys.exit(main())
Sep 28 11:57:14 ctl02 nova-api[9518]: 2017-09-28 11:57:14.391 9518 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:57:14 ctl02 nova-api[9518]: 2017-09-28 11:57:14.391 9518 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:57:14 ctl02 nova-api[9518]: 2017-09-28 11:57:14.391 9518 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:57:14 ctl02 nova-api[9518]: 2017-09-28 11:57:14.391 9518 ERROR nova     max_url_len=max_url_len)
Sep 28 11:57:14 ctl02 nova-api[9518]: 2017-09-28 11:57:14.391 9518 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:57:14 ctl02 nova-api[9518]: 2017-09-28 11:57:14.391 9518 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:57:14 ctl02 nova-api[9518]: 2017-09-28 11:57:14.391 9518 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:57:14 ctl02 nova-api[9518]: 2017-09-28 11:57:14.391 9518 ERROR nova     sock.listen(backlog)
Sep 28 11:57:14 ctl02 nova-api[9518]: 2017-09-28 11:57:14.391 9518 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:57:14 ctl02 nova-api[9518]: 2017-09-28 11:57:14.391 9518 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:57:14 ctl02 nova-api[9518]: 2017-09-28 11:57:14.391 9518 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:57:14 ctl02 nova-api[9518]: 2017-09-28 11:57:14.391 9518 ERROR nova
Sep 28 11:57:14 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:57:14 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:57:14 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:57:14 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:57:14 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:57:14 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:57:14 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:57:15 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x87bc3e56)
Sep 28 11:57:16 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x87bc3e56)
Sep 28 11:57:16 ctl02 glance-api[29183]: 2017-09-28 11:57:16.314 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:57:16] "OPTIONS / HTTP/1.0" 200 134 0.000667
Sep 28 11:57:16 ctl02 nova-api[9536]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:57:16 ctl02 nova-api[9536]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:57:16 ctl02 nova-api[9536]: 2017-09-28 11:57:16.617 9536 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:57:16 ctl02 nova-api[9536]: 2017-09-28 11:57:16.618 9536 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:57:16 ctl02 nova-api[9536]: 2017-09-28 11:57:16.618 9536 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:57:16 ctl02 nova-api[9536]: 2017-09-28 11:57:16.618 9536 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:57:16 ctl02 nova-api[9536]: 2017-09-28 11:57:16.618 9536 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:57:16 ctl02 nova-api[9536]: 2017-09-28 11:57:16.618 9536 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:57:16 ctl02 nova-api[9536]: 2017-09-28 11:57:16.618 9536 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:57:16 ctl02 nova-api[9536]: 2017-09-28 11:57:16.618 9536 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:57:16 ctl02 nova-api[9536]: 2017-09-28 11:57:16.618 9536 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:57:16 ctl02 nova-api[9536]: 2017-09-28 11:57:16.618 9536 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:57:16 ctl02 nova-api[9536]: 2017-09-28 11:57:16.618 9536 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:57:16 ctl02 nova-api[9536]: 2017-09-28 11:57:16.618 9536 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:57:16 ctl02 nova-api[9536]: 2017-09-28 11:57:16.618 9536 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:57:16 ctl02 nova-api[9536]: 2017-09-28 11:57:16.618 9536 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:57:16 ctl02 nova-api[9536]: 2017-09-28 11:57:16.618 9536 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:57:16 ctl02 nova-api[9536]: 2017-09-28 11:57:16.618 9536 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:57:16 ctl02 nova-api[9536]: 2017-09-28 11:57:16.618 9536 ERROR nova.wsgi     self.filename))
Sep 28 11:57:16 ctl02 nova-api[9536]: 2017-09-28 11:57:16.618 9536 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:57:16 ctl02 nova-api[9536]: 2017-09-28 11:57:16.618 9536 ERROR nova.wsgi
Sep 28 11:57:16 ctl02 nova-api[9536]: 2017-09-28 11:57:16.619 9536 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:57:16 ctl02 nova-api[9536]: 2017-09-28 11:57:16.752 9536 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:57:16 ctl02 nova-api[9536]: 2017-09-28 11:57:16.994 9536 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:57:16 ctl02 nova-api[9536]: 2017-09-28 11:57:16.996 9536 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:57:16 ctl02 nova-api[9536]: 2017-09-28 11:57:16.996 9536 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:57:16 ctl02 nova-api[9536]: 2017-09-28 11:57:16.997 9536 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:57:17 ctl02 nova-api[9536]: 2017-09-28 11:57:17.127 9536 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:57:17 ctl02 nova-api[9536]: 2017-09-28 11:57:17.130 9536 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:57:17 ctl02 nova-api[9536]: 2017-09-28 11:57:17.130 9536 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:57:17 ctl02 nova-api[9536]: 2017-09-28 11:57:17.130 9536 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:57:17 ctl02 nova-api[9536]: 2017-09-28 11:57:17.133 9536 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:57:17 ctl02 nova-api[9536]: 2017-09-28 11:57:17.134 9536 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:57:17 ctl02 nova-api[9536]: 2017-09-28 11:57:17.134 9536 ERROR nova Traceback (most recent call last):
Sep 28 11:57:17 ctl02 nova-api[9536]: 2017-09-28 11:57:17.134 9536 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:57:17 ctl02 nova-api[9536]: 2017-09-28 11:57:17.134 9536 ERROR nova     sys.exit(main())
Sep 28 11:57:17 ctl02 nova-api[9536]: 2017-09-28 11:57:17.134 9536 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:57:17 ctl02 nova-api[9536]: 2017-09-28 11:57:17.134 9536 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:57:17 ctl02 nova-api[9536]: 2017-09-28 11:57:17.134 9536 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:57:17 ctl02 nova-api[9536]: 2017-09-28 11:57:17.134 9536 ERROR nova     max_url_len=max_url_len)
Sep 28 11:57:17 ctl02 nova-api[9536]: 2017-09-28 11:57:17.134 9536 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:57:17 ctl02 nova-api[9536]: 2017-09-28 11:57:17.134 9536 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:57:17 ctl02 nova-api[9536]: 2017-09-28 11:57:17.134 9536 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:57:17 ctl02 nova-api[9536]: 2017-09-28 11:57:17.134 9536 ERROR nova     sock.listen(backlog)
Sep 28 11:57:17 ctl02 nova-api[9536]: 2017-09-28 11:57:17.134 9536 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:57:17 ctl02 nova-api[9536]: 2017-09-28 11:57:17.134 9536 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:57:17 ctl02 nova-api[9536]: 2017-09-28 11:57:17.134 9536 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:57:17 ctl02 nova-api[9536]: 2017-09-28 11:57:17.134 9536 ERROR nova
Sep 28 11:57:17 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x87bc3e56)
Sep 28 11:57:17 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:57:17 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:57:17 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:57:17 ctl02 glance-api[29183]: 2017-09-28 11:57:17.624 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:57:17] "OPTIONS / HTTP/1.0" 200 134 0.000663
Sep 28 11:57:17 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:57:17 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:57:17 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:57:17 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:57:18 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x87bc3e56)
Sep 28 11:57:19 ctl02 nova-api[9553]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:57:19 ctl02 nova-api[9553]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:57:19 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x87bc3e56)
Sep 28 11:57:19 ctl02 nova-api[9553]: 2017-09-28 11:57:19.333 9553 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:57:19 ctl02 nova-api[9553]: 2017-09-28 11:57:19.335 9553 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:57:19 ctl02 nova-api[9553]: 2017-09-28 11:57:19.335 9553 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:57:19 ctl02 nova-api[9553]: 2017-09-28 11:57:19.335 9553 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:57:19 ctl02 nova-api[9553]: 2017-09-28 11:57:19.335 9553 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:57:19 ctl02 nova-api[9553]: 2017-09-28 11:57:19.335 9553 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:57:19 ctl02 nova-api[9553]: 2017-09-28 11:57:19.335 9553 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:57:19 ctl02 nova-api[9553]: 2017-09-28 11:57:19.335 9553 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:57:19 ctl02 nova-api[9553]: 2017-09-28 11:57:19.335 9553 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:57:19 ctl02 nova-api[9553]: 2017-09-28 11:57:19.335 9553 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:57:19 ctl02 nova-api[9553]: 2017-09-28 11:57:19.335 9553 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:57:19 ctl02 nova-api[9553]: 2017-09-28 11:57:19.335 9553 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:57:19 ctl02 nova-api[9553]: 2017-09-28 11:57:19.335 9553 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:57:19 ctl02 nova-api[9553]: 2017-09-28 11:57:19.335 9553 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:57:19 ctl02 nova-api[9553]: 2017-09-28 11:57:19.335 9553 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:57:19 ctl02 nova-api[9553]: 2017-09-28 11:57:19.335 9553 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:57:19 ctl02 nova-api[9553]: 2017-09-28 11:57:19.335 9553 ERROR nova.wsgi     self.filename))
Sep 28 11:57:19 ctl02 nova-api[9553]: 2017-09-28 11:57:19.335 9553 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:57:19 ctl02 nova-api[9553]: 2017-09-28 11:57:19.335 9553 ERROR nova.wsgi
Sep 28 11:57:19 ctl02 nova-api[9553]: 2017-09-28 11:57:19.336 9553 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:57:19 ctl02 nova-api[9553]: 2017-09-28 11:57:19.467 9553 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:57:19 ctl02 nova-api[9553]: 2017-09-28 11:57:19.707 9553 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:57:19 ctl02 nova-api[9553]: 2017-09-28 11:57:19.709 9553 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:57:19 ctl02 nova-api[9553]: 2017-09-28 11:57:19.709 9553 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:57:19 ctl02 nova-api[9553]: 2017-09-28 11:57:19.709 9553 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:57:19 ctl02 nova-api[9553]: 2017-09-28 11:57:19.839 9553 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:57:19 ctl02 nova-api[9553]: 2017-09-28 11:57:19.841 9553 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:57:19 ctl02 nova-api[9553]: 2017-09-28 11:57:19.841 9553 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:57:19 ctl02 nova-api[9553]: 2017-09-28 11:57:19.842 9553 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:57:19 ctl02 nova-api[9553]: 2017-09-28 11:57:19.845 9553 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:57:19 ctl02 nova-api[9553]: 2017-09-28 11:57:19.845 9553 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:57:19 ctl02 nova-api[9553]: 2017-09-28 11:57:19.845 9553 ERROR nova Traceback (most recent call last):
Sep 28 11:57:19 ctl02 nova-api[9553]: 2017-09-28 11:57:19.845 9553 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:57:19 ctl02 nova-api[9553]: 2017-09-28 11:57:19.845 9553 ERROR nova     sys.exit(main())
Sep 28 11:57:19 ctl02 nova-api[9553]: 2017-09-28 11:57:19.845 9553 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:57:19 ctl02 nova-api[9553]: 2017-09-28 11:57:19.845 9553 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:57:19 ctl02 nova-api[9553]: 2017-09-28 11:57:19.845 9553 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:57:19 ctl02 nova-api[9553]: 2017-09-28 11:57:19.845 9553 ERROR nova     max_url_len=max_url_len)
Sep 28 11:57:19 ctl02 nova-api[9553]: 2017-09-28 11:57:19.845 9553 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:57:19 ctl02 nova-api[9553]: 2017-09-28 11:57:19.845 9553 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:57:19 ctl02 nova-api[9553]: 2017-09-28 11:57:19.845 9553 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:57:19 ctl02 nova-api[9553]: 2017-09-28 11:57:19.845 9553 ERROR nova     sock.listen(backlog)
Sep 28 11:57:19 ctl02 nova-api[9553]: 2017-09-28 11:57:19.845 9553 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:57:19 ctl02 nova-api[9553]: 2017-09-28 11:57:19.845 9553 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:57:19 ctl02 nova-api[9553]: 2017-09-28 11:57:19.845 9553 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:57:19 ctl02 nova-api[9553]: 2017-09-28 11:57:19.845 9553 ERROR nova
Sep 28 11:57:20 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:57:20 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:57:20 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:57:20 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:57:20 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:57:20 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:57:20 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:57:20 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x87bc3e56)
Sep 28 11:57:21 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x87bc3e56)
Sep 28 11:57:21 ctl02 nova-api[9571]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:57:21 ctl02 nova-api[9571]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:57:21 ctl02 nova-api[9571]: 2017-09-28 11:57:21.825 9571 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:57:21 ctl02 nova-api[9571]: 2017-09-28 11:57:21.826 9571 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:57:21 ctl02 nova-api[9571]: 2017-09-28 11:57:21.826 9571 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:57:21 ctl02 nova-api[9571]: 2017-09-28 11:57:21.826 9571 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:57:21 ctl02 nova-api[9571]: 2017-09-28 11:57:21.826 9571 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:57:21 ctl02 nova-api[9571]: 2017-09-28 11:57:21.826 9571 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:57:21 ctl02 nova-api[9571]: 2017-09-28 11:57:21.826 9571 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:57:21 ctl02 nova-api[9571]: 2017-09-28 11:57:21.826 9571 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:57:21 ctl02 nova-api[9571]: 2017-09-28 11:57:21.826 9571 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:57:21 ctl02 nova-api[9571]: 2017-09-28 11:57:21.826 9571 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:57:21 ctl02 nova-api[9571]: 2017-09-28 11:57:21.826 9571 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:57:21 ctl02 nova-api[9571]: 2017-09-28 11:57:21.826 9571 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:57:21 ctl02 nova-api[9571]: 2017-09-28 11:57:21.826 9571 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:57:21 ctl02 nova-api[9571]: 2017-09-28 11:57:21.826 9571 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:57:21 ctl02 nova-api[9571]: 2017-09-28 11:57:21.826 9571 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:57:21 ctl02 nova-api[9571]: 2017-09-28 11:57:21.826 9571 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:57:21 ctl02 nova-api[9571]: 2017-09-28 11:57:21.826 9571 ERROR nova.wsgi     self.filename))
Sep 28 11:57:21 ctl02 nova-api[9571]: 2017-09-28 11:57:21.826 9571 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:57:21 ctl02 nova-api[9571]: 2017-09-28 11:57:21.826 9571 ERROR nova.wsgi
Sep 28 11:57:21 ctl02 nova-api[9571]: 2017-09-28 11:57:21.827 9571 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:57:21 ctl02 nova-api[9571]: 2017-09-28 11:57:21.960 9571 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:57:22 ctl02 nova-api[9571]: 2017-09-28 11:57:22.202 9571 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:57:22 ctl02 nova-api[9571]: 2017-09-28 11:57:22.205 9571 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:57:22 ctl02 nova-api[9571]: 2017-09-28 11:57:22.205 9571 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:57:22 ctl02 nova-api[9571]: 2017-09-28 11:57:22.205 9571 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:57:22 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x87bc3e56)
Sep 28 11:57:22 ctl02 nova-api[9571]: 2017-09-28 11:57:22.337 9571 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:57:22 ctl02 nova-api[9571]: 2017-09-28 11:57:22.339 9571 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:57:22 ctl02 nova-api[9571]: 2017-09-28 11:57:22.339 9571 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:57:22 ctl02 nova-api[9571]: 2017-09-28 11:57:22.340 9571 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:57:22 ctl02 nova-api[9571]: 2017-09-28 11:57:22.343 9571 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:57:22 ctl02 nova-api[9571]: 2017-09-28 11:57:22.343 9571 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:57:22 ctl02 nova-api[9571]: 2017-09-28 11:57:22.343 9571 ERROR nova Traceback (most recent call last):
Sep 28 11:57:22 ctl02 nova-api[9571]: 2017-09-28 11:57:22.343 9571 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:57:22 ctl02 nova-api[9571]: 2017-09-28 11:57:22.343 9571 ERROR nova     sys.exit(main())
Sep 28 11:57:22 ctl02 nova-api[9571]: 2017-09-28 11:57:22.343 9571 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:57:22 ctl02 nova-api[9571]: 2017-09-28 11:57:22.343 9571 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:57:22 ctl02 nova-api[9571]: 2017-09-28 11:57:22.343 9571 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:57:22 ctl02 nova-api[9571]: 2017-09-28 11:57:22.343 9571 ERROR nova     max_url_len=max_url_len)
Sep 28 11:57:22 ctl02 nova-api[9571]: 2017-09-28 11:57:22.343 9571 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:57:22 ctl02 nova-api[9571]: 2017-09-28 11:57:22.343 9571 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:57:22 ctl02 nova-api[9571]: 2017-09-28 11:57:22.343 9571 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:57:22 ctl02 nova-api[9571]: 2017-09-28 11:57:22.343 9571 ERROR nova     sock.listen(backlog)
Sep 28 11:57:22 ctl02 nova-api[9571]: 2017-09-28 11:57:22.343 9571 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:57:22 ctl02 nova-api[9571]: 2017-09-28 11:57:22.343 9571 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:57:22 ctl02 nova-api[9571]: 2017-09-28 11:57:22.343 9571 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:57:22 ctl02 nova-api[9571]: 2017-09-28 11:57:22.343 9571 ERROR nova
Sep 28 11:57:22 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:57:22 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:57:22 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:57:22 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:57:22 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:57:22 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:57:22 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:57:23 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:57:23 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:57:23 ctl02 nova-cert[4860]: 2017-09-28 11:57:23.460 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:57:24 ctl02 glance-api[29183]: 2017-09-28 11:57:24.146 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:57:24] "OPTIONS / HTTP/1.0" 200 134 0.000634
Sep 28 11:57:24 ctl02 nova-api[9589]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:57:24 ctl02 nova-api[9589]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:57:24 ctl02 nova-api[9589]: 2017-09-28 11:57:24.372 9589 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:57:24 ctl02 nova-api[9589]: 2017-09-28 11:57:24.373 9589 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:57:24 ctl02 nova-api[9589]: 2017-09-28 11:57:24.373 9589 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:57:24 ctl02 nova-api[9589]: 2017-09-28 11:57:24.373 9589 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:57:24 ctl02 nova-api[9589]: 2017-09-28 11:57:24.373 9589 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:57:24 ctl02 nova-api[9589]: 2017-09-28 11:57:24.373 9589 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:57:24 ctl02 nova-api[9589]: 2017-09-28 11:57:24.373 9589 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:57:24 ctl02 nova-api[9589]: 2017-09-28 11:57:24.373 9589 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:57:24 ctl02 nova-api[9589]: 2017-09-28 11:57:24.373 9589 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:57:24 ctl02 nova-api[9589]: 2017-09-28 11:57:24.373 9589 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:57:24 ctl02 nova-api[9589]: 2017-09-28 11:57:24.373 9589 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:57:24 ctl02 nova-api[9589]: 2017-09-28 11:57:24.373 9589 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:57:24 ctl02 nova-api[9589]: 2017-09-28 11:57:24.373 9589 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:57:24 ctl02 nova-api[9589]: 2017-09-28 11:57:24.373 9589 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:57:24 ctl02 nova-api[9589]: 2017-09-28 11:57:24.373 9589 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:57:24 ctl02 nova-api[9589]: 2017-09-28 11:57:24.373 9589 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:57:24 ctl02 nova-api[9589]: 2017-09-28 11:57:24.373 9589 ERROR nova.wsgi     self.filename))
Sep 28 11:57:24 ctl02 nova-api[9589]: 2017-09-28 11:57:24.373 9589 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:57:24 ctl02 nova-api[9589]: 2017-09-28 11:57:24.373 9589 ERROR nova.wsgi
Sep 28 11:57:24 ctl02 nova-api[9589]: 2017-09-28 11:57:24.374 9589 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:57:24 ctl02 nova-api[9589]: 2017-09-28 11:57:24.508 9589 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:57:24 ctl02 nova-api[9589]: 2017-09-28 11:57:24.750 9589 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:57:24 ctl02 nova-api[9589]: 2017-09-28 11:57:24.752 9589 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:57:24 ctl02 nova-api[9589]: 2017-09-28 11:57:24.752 9589 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:57:24 ctl02 nova-api[9589]: 2017-09-28 11:57:24.753 9589 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:57:24 ctl02 nova-api[9589]: 2017-09-28 11:57:24.885 9589 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:57:24 ctl02 nova-api[9589]: 2017-09-28 11:57:24.887 9589 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:57:24 ctl02 nova-api[9589]: 2017-09-28 11:57:24.887 9589 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:57:24 ctl02 nova-api[9589]: 2017-09-28 11:57:24.887 9589 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:57:24 ctl02 nova-api[9589]: 2017-09-28 11:57:24.891 9589 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:57:24 ctl02 nova-api[9589]: 2017-09-28 11:57:24.891 9589 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:57:24 ctl02 nova-api[9589]: 2017-09-28 11:57:24.891 9589 ERROR nova Traceback (most recent call last):
Sep 28 11:57:24 ctl02 nova-api[9589]: 2017-09-28 11:57:24.891 9589 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:57:24 ctl02 nova-api[9589]: 2017-09-28 11:57:24.891 9589 ERROR nova     sys.exit(main())
Sep 28 11:57:24 ctl02 nova-api[9589]: 2017-09-28 11:57:24.891 9589 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:57:24 ctl02 nova-api[9589]: 2017-09-28 11:57:24.891 9589 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:57:24 ctl02 nova-api[9589]: 2017-09-28 11:57:24.891 9589 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:57:24 ctl02 nova-api[9589]: 2017-09-28 11:57:24.891 9589 ERROR nova     max_url_len=max_url_len)
Sep 28 11:57:24 ctl02 nova-api[9589]: 2017-09-28 11:57:24.891 9589 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:57:24 ctl02 nova-api[9589]: 2017-09-28 11:57:24.891 9589 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:57:24 ctl02 nova-api[9589]: 2017-09-28 11:57:24.891 9589 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:57:24 ctl02 nova-api[9589]: 2017-09-28 11:57:24.891 9589 ERROR nova     sock.listen(backlog)
Sep 28 11:57:24 ctl02 nova-api[9589]: 2017-09-28 11:57:24.891 9589 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:57:24 ctl02 nova-api[9589]: 2017-09-28 11:57:24.891 9589 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:57:24 ctl02 nova-api[9589]: 2017-09-28 11:57:24.891 9589 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:57:24 ctl02 nova-api[9589]: 2017-09-28 11:57:24.891 9589 ERROR nova
Sep 28 11:57:25 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:57:25 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:57:25 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:57:25 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:57:25 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:57:25 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:57:25 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:57:26 ctl02 glance-api[29183]: 2017-09-28 11:57:26.019 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:57:26] "OPTIONS / HTTP/1.0" 200 134 0.000616
Sep 28 11:57:26 ctl02 nova-conductor[5056]: 2017-09-28 11:57:26.181 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:57:26 ctl02 nova-conductor[5056]: 2017-09-28 11:57:26.196 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:57:26 ctl02 nova-conductor[5056]: 2017-09-28 11:57:26.210 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:57:26 ctl02 nova-conductor[5056]: 2017-09-28 11:57:26.219 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:57:26 ctl02 nova-api[9613]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:57:26 ctl02 nova-api[9613]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:57:27 ctl02 nova-api[9613]: 2017-09-28 11:57:27.138 9613 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:57:27 ctl02 nova-api[9613]: 2017-09-28 11:57:27.139 9613 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:57:27 ctl02 nova-api[9613]: 2017-09-28 11:57:27.139 9613 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:57:27 ctl02 nova-api[9613]: 2017-09-28 11:57:27.139 9613 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:57:27 ctl02 nova-api[9613]: 2017-09-28 11:57:27.139 9613 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:57:27 ctl02 nova-api[9613]: 2017-09-28 11:57:27.139 9613 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:57:27 ctl02 nova-api[9613]: 2017-09-28 11:57:27.139 9613 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:57:27 ctl02 nova-api[9613]: 2017-09-28 11:57:27.139 9613 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:57:27 ctl02 nova-api[9613]: 2017-09-28 11:57:27.139 9613 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:57:27 ctl02 nova-api[9613]: 2017-09-28 11:57:27.139 9613 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:57:27 ctl02 nova-api[9613]: 2017-09-28 11:57:27.139 9613 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:57:27 ctl02 nova-api[9613]: 2017-09-28 11:57:27.139 9613 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:57:27 ctl02 nova-api[9613]: 2017-09-28 11:57:27.139 9613 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:57:27 ctl02 nova-api[9613]: 2017-09-28 11:57:27.139 9613 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:57:27 ctl02 nova-api[9613]: 2017-09-28 11:57:27.139 9613 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:57:27 ctl02 nova-api[9613]: 2017-09-28 11:57:27.139 9613 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:57:27 ctl02 nova-api[9613]: 2017-09-28 11:57:27.139 9613 ERROR nova.wsgi     self.filename))
Sep 28 11:57:27 ctl02 nova-api[9613]: 2017-09-28 11:57:27.139 9613 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:57:27 ctl02 nova-api[9613]: 2017-09-28 11:57:27.139 9613 ERROR nova.wsgi
Sep 28 11:57:27 ctl02 nova-api[9613]: 2017-09-28 11:57:27.142 9613 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:57:27 ctl02 nova-api[9613]: 2017-09-28 11:57:27.277 9613 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:57:27 ctl02 nova-api[9613]: 2017-09-28 11:57:27.520 9613 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:57:27 ctl02 nova-api[9613]: 2017-09-28 11:57:27.523 9613 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:57:27 ctl02 nova-api[9613]: 2017-09-28 11:57:27.524 9613 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:57:27 ctl02 nova-api[9613]: 2017-09-28 11:57:27.524 9613 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:57:27 ctl02 nova-api[9613]: 2017-09-28 11:57:27.657 9613 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:57:27 ctl02 nova-api[9613]: 2017-09-28 11:57:27.660 9613 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:57:27 ctl02 nova-api[9613]: 2017-09-28 11:57:27.660 9613 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:57:27 ctl02 nova-api[9613]: 2017-09-28 11:57:27.661 9613 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:57:27 ctl02 nova-api[9613]: 2017-09-28 11:57:27.664 9613 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:57:27 ctl02 nova-api[9613]: 2017-09-28 11:57:27.665 9613 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:57:27 ctl02 nova-api[9613]: 2017-09-28 11:57:27.665 9613 ERROR nova Traceback (most recent call last):
Sep 28 11:57:27 ctl02 nova-api[9613]: 2017-09-28 11:57:27.665 9613 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:57:27 ctl02 nova-api[9613]: 2017-09-28 11:57:27.665 9613 ERROR nova     sys.exit(main())
Sep 28 11:57:27 ctl02 nova-api[9613]: 2017-09-28 11:57:27.665 9613 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:57:27 ctl02 nova-api[9613]: 2017-09-28 11:57:27.665 9613 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:57:27 ctl02 nova-api[9613]: 2017-09-28 11:57:27.665 9613 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:57:27 ctl02 nova-api[9613]: 2017-09-28 11:57:27.665 9613 ERROR nova     max_url_len=max_url_len)
Sep 28 11:57:27 ctl02 nova-api[9613]: 2017-09-28 11:57:27.665 9613 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:57:27 ctl02 nova-api[9613]: 2017-09-28 11:57:27.665 9613 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:57:27 ctl02 nova-api[9613]: 2017-09-28 11:57:27.665 9613 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:57:27 ctl02 nova-api[9613]: 2017-09-28 11:57:27.665 9613 ERROR nova     sock.listen(backlog)
Sep 28 11:57:27 ctl02 nova-api[9613]: 2017-09-28 11:57:27.665 9613 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:57:27 ctl02 nova-api[9613]: 2017-09-28 11:57:27.665 9613 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:57:27 ctl02 nova-api[9613]: 2017-09-28 11:57:27.665 9613 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:57:27 ctl02 nova-api[9613]: 2017-09-28 11:57:27.665 9613 ERROR nova
Sep 28 11:57:27 ctl02 glance-api[29183]: 2017-09-28 11:57:27.701 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:57:27] "OPTIONS / HTTP/1.0" 200 134 0.000640
Sep 28 11:57:27 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:57:27 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:57:27 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:57:28 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:57:28 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:57:28 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:57:28 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:57:29 ctl02 nova-api[9631]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:57:29 ctl02 nova-api[9631]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:57:29 ctl02 nova-api[9631]: 2017-09-28 11:57:29.849 9631 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:57:29 ctl02 nova-api[9631]: 2017-09-28 11:57:29.851 9631 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:57:29 ctl02 nova-api[9631]: 2017-09-28 11:57:29.851 9631 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:57:29 ctl02 nova-api[9631]: 2017-09-28 11:57:29.851 9631 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:57:29 ctl02 nova-api[9631]: 2017-09-28 11:57:29.851 9631 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:57:29 ctl02 nova-api[9631]: 2017-09-28 11:57:29.851 9631 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:57:29 ctl02 nova-api[9631]: 2017-09-28 11:57:29.851 9631 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:57:29 ctl02 nova-api[9631]: 2017-09-28 11:57:29.851 9631 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:57:29 ctl02 nova-api[9631]: 2017-09-28 11:57:29.851 9631 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:57:29 ctl02 nova-api[9631]: 2017-09-28 11:57:29.851 9631 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:57:29 ctl02 nova-api[9631]: 2017-09-28 11:57:29.851 9631 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:57:29 ctl02 nova-api[9631]: 2017-09-28 11:57:29.851 9631 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:57:29 ctl02 nova-api[9631]: 2017-09-28 11:57:29.851 9631 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:57:29 ctl02 nova-api[9631]: 2017-09-28 11:57:29.851 9631 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:57:29 ctl02 nova-api[9631]: 2017-09-28 11:57:29.851 9631 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:57:29 ctl02 nova-api[9631]: 2017-09-28 11:57:29.851 9631 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:57:29 ctl02 nova-api[9631]: 2017-09-28 11:57:29.851 9631 ERROR nova.wsgi     self.filename))
Sep 28 11:57:29 ctl02 nova-api[9631]: 2017-09-28 11:57:29.851 9631 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:57:29 ctl02 nova-api[9631]: 2017-09-28 11:57:29.851 9631 ERROR nova.wsgi
Sep 28 11:57:29 ctl02 nova-api[9631]: 2017-09-28 11:57:29.852 9631 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:57:29 ctl02 nova-api[9631]: 2017-09-28 11:57:29.984 9631 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:57:30 ctl02 nova-api[9631]: 2017-09-28 11:57:30.227 9631 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:57:30 ctl02 nova-api[9631]: 2017-09-28 11:57:30.229 9631 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:57:30 ctl02 nova-api[9631]: 2017-09-28 11:57:30.229 9631 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:57:30 ctl02 nova-api[9631]: 2017-09-28 11:57:30.230 9631 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:57:30 ctl02 nova-api[9631]: 2017-09-28 11:57:30.360 9631 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:57:30 ctl02 nova-api[9631]: 2017-09-28 11:57:30.362 9631 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:57:30 ctl02 nova-api[9631]: 2017-09-28 11:57:30.362 9631 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:57:30 ctl02 nova-api[9631]: 2017-09-28 11:57:30.363 9631 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:57:30 ctl02 nova-api[9631]: 2017-09-28 11:57:30.366 9631 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:57:30 ctl02 nova-api[9631]: 2017-09-28 11:57:30.366 9631 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:57:30 ctl02 nova-api[9631]: 2017-09-28 11:57:30.366 9631 ERROR nova Traceback (most recent call last):
Sep 28 11:57:30 ctl02 nova-api[9631]: 2017-09-28 11:57:30.366 9631 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:57:30 ctl02 nova-api[9631]: 2017-09-28 11:57:30.366 9631 ERROR nova     sys.exit(main())
Sep 28 11:57:30 ctl02 nova-api[9631]: 2017-09-28 11:57:30.366 9631 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:57:30 ctl02 nova-api[9631]: 2017-09-28 11:57:30.366 9631 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:57:30 ctl02 nova-api[9631]: 2017-09-28 11:57:30.366 9631 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:57:30 ctl02 nova-api[9631]: 2017-09-28 11:57:30.366 9631 ERROR nova     max_url_len=max_url_len)
Sep 28 11:57:30 ctl02 nova-api[9631]: 2017-09-28 11:57:30.366 9631 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:57:30 ctl02 nova-api[9631]: 2017-09-28 11:57:30.366 9631 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:57:30 ctl02 nova-api[9631]: 2017-09-28 11:57:30.366 9631 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:57:30 ctl02 nova-api[9631]: 2017-09-28 11:57:30.366 9631 ERROR nova     sock.listen(backlog)
Sep 28 11:57:30 ctl02 nova-api[9631]: 2017-09-28 11:57:30.366 9631 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:57:30 ctl02 nova-api[9631]: 2017-09-28 11:57:30.366 9631 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:57:30 ctl02 nova-api[9631]: 2017-09-28 11:57:30.366 9631 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:57:30 ctl02 nova-api[9631]: 2017-09-28 11:57:30.366 9631 ERROR nova
Sep 28 11:57:30 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:57:30 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:57:30 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:57:30 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:57:30 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:57:30 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:57:30 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:57:32 ctl02 nova-api[9649]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:57:32 ctl02 nova-api[9649]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:57:32 ctl02 nova-api[9649]: 2017-09-28 11:57:32.338 9649 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:57:32 ctl02 nova-api[9649]: 2017-09-28 11:57:32.340 9649 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:57:32 ctl02 nova-api[9649]: 2017-09-28 11:57:32.340 9649 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:57:32 ctl02 nova-api[9649]: 2017-09-28 11:57:32.340 9649 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:57:32 ctl02 nova-api[9649]: 2017-09-28 11:57:32.340 9649 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:57:32 ctl02 nova-api[9649]: 2017-09-28 11:57:32.340 9649 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:57:32 ctl02 nova-api[9649]: 2017-09-28 11:57:32.340 9649 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:57:32 ctl02 nova-api[9649]: 2017-09-28 11:57:32.340 9649 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:57:32 ctl02 nova-api[9649]: 2017-09-28 11:57:32.340 9649 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:57:32 ctl02 nova-api[9649]: 2017-09-28 11:57:32.340 9649 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:57:32 ctl02 nova-api[9649]: 2017-09-28 11:57:32.340 9649 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:57:32 ctl02 nova-api[9649]: 2017-09-28 11:57:32.340 9649 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:57:32 ctl02 nova-api[9649]: 2017-09-28 11:57:32.340 9649 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:57:32 ctl02 nova-api[9649]: 2017-09-28 11:57:32.340 9649 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:57:32 ctl02 nova-api[9649]: 2017-09-28 11:57:32.340 9649 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:57:32 ctl02 nova-api[9649]: 2017-09-28 11:57:32.340 9649 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:57:32 ctl02 nova-api[9649]: 2017-09-28 11:57:32.340 9649 ERROR nova.wsgi     self.filename))
Sep 28 11:57:32 ctl02 nova-api[9649]: 2017-09-28 11:57:32.340 9649 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:57:32 ctl02 nova-api[9649]: 2017-09-28 11:57:32.340 9649 ERROR nova.wsgi
Sep 28 11:57:32 ctl02 nova-api[9649]: 2017-09-28 11:57:32.341 9649 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:57:32 ctl02 nova-api[9649]: 2017-09-28 11:57:32.474 9649 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:57:32 ctl02 nova-api[9649]: 2017-09-28 11:57:32.711 9649 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:57:32 ctl02 nova-api[9649]: 2017-09-28 11:57:32.713 9649 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:57:32 ctl02 nova-api[9649]: 2017-09-28 11:57:32.713 9649 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:57:32 ctl02 nova-api[9649]: 2017-09-28 11:57:32.713 9649 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:57:32 ctl02 nova-api[9649]: 2017-09-28 11:57:32.842 9649 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:57:32 ctl02 nova-api[9649]: 2017-09-28 11:57:32.844 9649 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:57:32 ctl02 nova-api[9649]: 2017-09-28 11:57:32.844 9649 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:57:32 ctl02 nova-api[9649]: 2017-09-28 11:57:32.845 9649 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:57:32 ctl02 nova-api[9649]: 2017-09-28 11:57:32.848 9649 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:57:32 ctl02 nova-api[9649]: 2017-09-28 11:57:32.848 9649 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:57:32 ctl02 nova-api[9649]: 2017-09-28 11:57:32.848 9649 ERROR nova Traceback (most recent call last):
Sep 28 11:57:32 ctl02 nova-api[9649]: 2017-09-28 11:57:32.848 9649 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:57:32 ctl02 nova-api[9649]: 2017-09-28 11:57:32.848 9649 ERROR nova     sys.exit(main())
Sep 28 11:57:32 ctl02 nova-api[9649]: 2017-09-28 11:57:32.848 9649 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:57:32 ctl02 nova-api[9649]: 2017-09-28 11:57:32.848 9649 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:57:32 ctl02 nova-api[9649]: 2017-09-28 11:57:32.848 9649 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:57:32 ctl02 nova-api[9649]: 2017-09-28 11:57:32.848 9649 ERROR nova     max_url_len=max_url_len)
Sep 28 11:57:32 ctl02 nova-api[9649]: 2017-09-28 11:57:32.848 9649 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:57:32 ctl02 nova-api[9649]: 2017-09-28 11:57:32.848 9649 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:57:32 ctl02 nova-api[9649]: 2017-09-28 11:57:32.848 9649 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:57:32 ctl02 nova-api[9649]: 2017-09-28 11:57:32.848 9649 ERROR nova     sock.listen(backlog)
Sep 28 11:57:32 ctl02 nova-api[9649]: 2017-09-28 11:57:32.848 9649 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:57:32 ctl02 nova-api[9649]: 2017-09-28 11:57:32.848 9649 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:57:32 ctl02 nova-api[9649]: 2017-09-28 11:57:32.848 9649 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:57:32 ctl02 nova-api[9649]: 2017-09-28 11:57:32.848 9649 ERROR nova
Sep 28 11:57:33 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:57:33 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:57:33 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:57:33 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:57:33 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:57:33 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:57:33 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:57:33 ctl02 nova-consoleauth[5433]: 2017-09-28 11:57:33.349 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:57:34 ctl02 glance-api[29183]: 2017-09-28 11:57:34.139 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:57:34] "OPTIONS / HTTP/1.0" 200 134 0.000706
Sep 28 11:57:34 ctl02 nova-api[9667]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:57:34 ctl02 nova-api[9667]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:57:34 ctl02 nova-api[9667]: 2017-09-28 11:57:34.831 9667 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:57:34 ctl02 nova-api[9667]: 2017-09-28 11:57:34.832 9667 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:57:34 ctl02 nova-api[9667]: 2017-09-28 11:57:34.832 9667 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:57:34 ctl02 nova-api[9667]: 2017-09-28 11:57:34.832 9667 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:57:34 ctl02 nova-api[9667]: 2017-09-28 11:57:34.832 9667 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:57:34 ctl02 nova-api[9667]: 2017-09-28 11:57:34.832 9667 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:57:34 ctl02 nova-api[9667]: 2017-09-28 11:57:34.832 9667 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:57:34 ctl02 nova-api[9667]: 2017-09-28 11:57:34.832 9667 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:57:34 ctl02 nova-api[9667]: 2017-09-28 11:57:34.832 9667 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:57:34 ctl02 nova-api[9667]: 2017-09-28 11:57:34.832 9667 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:57:34 ctl02 nova-api[9667]: 2017-09-28 11:57:34.832 9667 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:57:34 ctl02 nova-api[9667]: 2017-09-28 11:57:34.832 9667 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:57:34 ctl02 nova-api[9667]: 2017-09-28 11:57:34.832 9667 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:57:34 ctl02 nova-api[9667]: 2017-09-28 11:57:34.832 9667 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:57:34 ctl02 nova-api[9667]: 2017-09-28 11:57:34.832 9667 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:57:34 ctl02 nova-api[9667]: 2017-09-28 11:57:34.832 9667 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:57:34 ctl02 nova-api[9667]: 2017-09-28 11:57:34.832 9667 ERROR nova.wsgi     self.filename))
Sep 28 11:57:34 ctl02 nova-api[9667]: 2017-09-28 11:57:34.832 9667 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:57:34 ctl02 nova-api[9667]: 2017-09-28 11:57:34.832 9667 ERROR nova.wsgi
Sep 28 11:57:34 ctl02 nova-api[9667]: 2017-09-28 11:57:34.833 9667 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:57:34 ctl02 nova-api[9667]: 2017-09-28 11:57:34.966 9667 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:57:35 ctl02 nova-api[9667]: 2017-09-28 11:57:35.206 9667 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:57:35 ctl02 nova-api[9667]: 2017-09-28 11:57:35.208 9667 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:57:35 ctl02 nova-api[9667]: 2017-09-28 11:57:35.208 9667 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:57:35 ctl02 nova-api[9667]: 2017-09-28 11:57:35.208 9667 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:57:35 ctl02 nova-api[9667]: 2017-09-28 11:57:35.339 9667 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:57:35 ctl02 nova-api[9667]: 2017-09-28 11:57:35.341 9667 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:57:35 ctl02 nova-api[9667]: 2017-09-28 11:57:35.341 9667 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:57:35 ctl02 nova-api[9667]: 2017-09-28 11:57:35.341 9667 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:57:35 ctl02 nova-api[9667]: 2017-09-28 11:57:35.345 9667 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:57:35 ctl02 nova-api[9667]: 2017-09-28 11:57:35.345 9667 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:57:35 ctl02 nova-api[9667]: 2017-09-28 11:57:35.345 9667 ERROR nova Traceback (most recent call last):
Sep 28 11:57:35 ctl02 nova-api[9667]: 2017-09-28 11:57:35.345 9667 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:57:35 ctl02 nova-api[9667]: 2017-09-28 11:57:35.345 9667 ERROR nova     sys.exit(main())
Sep 28 11:57:35 ctl02 nova-api[9667]: 2017-09-28 11:57:35.345 9667 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:57:35 ctl02 nova-api[9667]: 2017-09-28 11:57:35.345 9667 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:57:35 ctl02 nova-api[9667]: 2017-09-28 11:57:35.345 9667 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:57:35 ctl02 nova-api[9667]: 2017-09-28 11:57:35.345 9667 ERROR nova     max_url_len=max_url_len)
Sep 28 11:57:35 ctl02 nova-api[9667]: 2017-09-28 11:57:35.345 9667 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:57:35 ctl02 nova-api[9667]: 2017-09-28 11:57:35.345 9667 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:57:35 ctl02 nova-api[9667]: 2017-09-28 11:57:35.345 9667 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:57:35 ctl02 nova-api[9667]: 2017-09-28 11:57:35.345 9667 ERROR nova     sock.listen(backlog)
Sep 28 11:57:35 ctl02 nova-api[9667]: 2017-09-28 11:57:35.345 9667 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:57:35 ctl02 nova-api[9667]: 2017-09-28 11:57:35.345 9667 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:57:35 ctl02 nova-api[9667]: 2017-09-28 11:57:35.345 9667 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:57:35 ctl02 nova-api[9667]: 2017-09-28 11:57:35.345 9667 ERROR nova
Sep 28 11:57:35 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:57:35 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:57:35 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:57:35 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:57:35 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:57:35 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:57:35 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:57:35 ctl02 glance-api[29183]: 2017-09-28 11:57:35.918 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:57:35] "OPTIONS / HTTP/1.0" 200 134 0.000665
Sep 28 11:57:36 ctl02 nova-scheduler[5620]: 2017-09-28 11:57:36.377 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:57:37 ctl02 nova-api[9684]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:57:37 ctl02 nova-api[9684]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:57:37 ctl02 nova-api[9684]: 2017-09-28 11:57:37.351 9684 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:57:37 ctl02 nova-api[9684]: 2017-09-28 11:57:37.353 9684 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:57:37 ctl02 nova-api[9684]: 2017-09-28 11:57:37.353 9684 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:57:37 ctl02 nova-api[9684]: 2017-09-28 11:57:37.353 9684 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:57:37 ctl02 nova-api[9684]: 2017-09-28 11:57:37.353 9684 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:57:37 ctl02 nova-api[9684]: 2017-09-28 11:57:37.353 9684 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:57:37 ctl02 nova-api[9684]: 2017-09-28 11:57:37.353 9684 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:57:37 ctl02 nova-api[9684]: 2017-09-28 11:57:37.353 9684 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:57:37 ctl02 nova-api[9684]: 2017-09-28 11:57:37.353 9684 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:57:37 ctl02 nova-api[9684]: 2017-09-28 11:57:37.353 9684 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:57:37 ctl02 nova-api[9684]: 2017-09-28 11:57:37.353 9684 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:57:37 ctl02 nova-api[9684]: 2017-09-28 11:57:37.353 9684 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:57:37 ctl02 nova-api[9684]: 2017-09-28 11:57:37.353 9684 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:57:37 ctl02 nova-api[9684]: 2017-09-28 11:57:37.353 9684 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:57:37 ctl02 nova-api[9684]: 2017-09-28 11:57:37.353 9684 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:57:37 ctl02 nova-api[9684]: 2017-09-28 11:57:37.353 9684 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:57:37 ctl02 nova-api[9684]: 2017-09-28 11:57:37.353 9684 ERROR nova.wsgi     self.filename))
Sep 28 11:57:37 ctl02 nova-api[9684]: 2017-09-28 11:57:37.353 9684 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:57:37 ctl02 nova-api[9684]: 2017-09-28 11:57:37.353 9684 ERROR nova.wsgi
Sep 28 11:57:37 ctl02 nova-api[9684]: 2017-09-28 11:57:37.354 9684 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:57:37 ctl02 nova-api[9684]: 2017-09-28 11:57:37.487 9684 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:57:37 ctl02 glance-api[29183]: 2017-09-28 11:57:37.670 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:57:37] "OPTIONS / HTTP/1.0" 200 134 0.000673
Sep 28 11:57:37 ctl02 nova-api[9684]: 2017-09-28 11:57:37.730 9684 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:57:37 ctl02 nova-api[9684]: 2017-09-28 11:57:37.732 9684 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:57:37 ctl02 nova-api[9684]: 2017-09-28 11:57:37.732 9684 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:57:37 ctl02 nova-api[9684]: 2017-09-28 11:57:37.733 9684 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:57:37 ctl02 nova-api[9684]: 2017-09-28 11:57:37.866 9684 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:57:37 ctl02 nova-api[9684]: 2017-09-28 11:57:37.868 9684 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:57:37 ctl02 nova-api[9684]: 2017-09-28 11:57:37.868 9684 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:57:37 ctl02 nova-api[9684]: 2017-09-28 11:57:37.868 9684 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:57:37 ctl02 nova-api[9684]: 2017-09-28 11:57:37.871 9684 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:57:37 ctl02 nova-api[9684]: 2017-09-28 11:57:37.872 9684 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:57:37 ctl02 nova-api[9684]: 2017-09-28 11:57:37.872 9684 ERROR nova Traceback (most recent call last):
Sep 28 11:57:37 ctl02 nova-api[9684]: 2017-09-28 11:57:37.872 9684 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:57:37 ctl02 nova-api[9684]: 2017-09-28 11:57:37.872 9684 ERROR nova     sys.exit(main())
Sep 28 11:57:37 ctl02 nova-api[9684]: 2017-09-28 11:57:37.872 9684 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:57:37 ctl02 nova-api[9684]: 2017-09-28 11:57:37.872 9684 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:57:37 ctl02 nova-api[9684]: 2017-09-28 11:57:37.872 9684 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:57:37 ctl02 nova-api[9684]: 2017-09-28 11:57:37.872 9684 ERROR nova     max_url_len=max_url_len)
Sep 28 11:57:37 ctl02 nova-api[9684]: 2017-09-28 11:57:37.872 9684 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:57:37 ctl02 nova-api[9684]: 2017-09-28 11:57:37.872 9684 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:57:37 ctl02 nova-api[9684]: 2017-09-28 11:57:37.872 9684 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:57:37 ctl02 nova-api[9684]: 2017-09-28 11:57:37.872 9684 ERROR nova     sock.listen(backlog)
Sep 28 11:57:37 ctl02 nova-api[9684]: 2017-09-28 11:57:37.872 9684 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:57:37 ctl02 nova-api[9684]: 2017-09-28 11:57:37.872 9684 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:57:37 ctl02 nova-api[9684]: 2017-09-28 11:57:37.872 9684 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:57:37 ctl02 nova-api[9684]: 2017-09-28 11:57:37.872 9684 ERROR nova
Sep 28 11:57:38 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:57:38 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:57:38 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:57:38 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:57:38 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:57:38 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:57:38 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:57:38 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5a362006)
Sep 28 11:57:39 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5a362006)
Sep 28 11:57:39 ctl02 nova-api[9703]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:57:39 ctl02 nova-api[9703]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:57:39 ctl02 nova-api[9703]: 2017-09-28 11:57:39.821 9703 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:57:39 ctl02 nova-api[9703]: 2017-09-28 11:57:39.823 9703 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:57:39 ctl02 nova-api[9703]: 2017-09-28 11:57:39.823 9703 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:57:39 ctl02 nova-api[9703]: 2017-09-28 11:57:39.823 9703 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:57:39 ctl02 nova-api[9703]: 2017-09-28 11:57:39.823 9703 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:57:39 ctl02 nova-api[9703]: 2017-09-28 11:57:39.823 9703 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:57:39 ctl02 nova-api[9703]: 2017-09-28 11:57:39.823 9703 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:57:39 ctl02 nova-api[9703]: 2017-09-28 11:57:39.823 9703 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:57:39 ctl02 nova-api[9703]: 2017-09-28 11:57:39.823 9703 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:57:39 ctl02 nova-api[9703]: 2017-09-28 11:57:39.823 9703 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:57:39 ctl02 nova-api[9703]: 2017-09-28 11:57:39.823 9703 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:57:39 ctl02 nova-api[9703]: 2017-09-28 11:57:39.823 9703 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:57:39 ctl02 nova-api[9703]: 2017-09-28 11:57:39.823 9703 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:57:39 ctl02 nova-api[9703]: 2017-09-28 11:57:39.823 9703 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:57:39 ctl02 nova-api[9703]: 2017-09-28 11:57:39.823 9703 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:57:39 ctl02 nova-api[9703]: 2017-09-28 11:57:39.823 9703 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:57:39 ctl02 nova-api[9703]: 2017-09-28 11:57:39.823 9703 ERROR nova.wsgi     self.filename))
Sep 28 11:57:39 ctl02 nova-api[9703]: 2017-09-28 11:57:39.823 9703 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:57:39 ctl02 nova-api[9703]: 2017-09-28 11:57:39.823 9703 ERROR nova.wsgi
Sep 28 11:57:39 ctl02 nova-api[9703]: 2017-09-28 11:57:39.824 9703 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:57:39 ctl02 nova-api[9703]: 2017-09-28 11:57:39.957 9703 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:57:40 ctl02 nova-api[9703]: 2017-09-28 11:57:40.198 9703 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:57:40 ctl02 nova-api[9703]: 2017-09-28 11:57:40.201 9703 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:57:40 ctl02 nova-api[9703]: 2017-09-28 11:57:40.201 9703 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:57:40 ctl02 nova-api[9703]: 2017-09-28 11:57:40.202 9703 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:57:40 ctl02 nova-api[9703]: 2017-09-28 11:57:40.334 9703 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:57:40 ctl02 nova-api[9703]: 2017-09-28 11:57:40.336 9703 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:57:40 ctl02 nova-api[9703]: 2017-09-28 11:57:40.336 9703 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:57:40 ctl02 nova-api[9703]: 2017-09-28 11:57:40.337 9703 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:57:40 ctl02 nova-api[9703]: 2017-09-28 11:57:40.340 9703 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:57:40 ctl02 nova-api[9703]: 2017-09-28 11:57:40.341 9703 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:57:40 ctl02 nova-api[9703]: 2017-09-28 11:57:40.341 9703 ERROR nova Traceback (most recent call last):
Sep 28 11:57:40 ctl02 nova-api[9703]: 2017-09-28 11:57:40.341 9703 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:57:40 ctl02 nova-api[9703]: 2017-09-28 11:57:40.341 9703 ERROR nova     sys.exit(main())
Sep 28 11:57:40 ctl02 nova-api[9703]: 2017-09-28 11:57:40.341 9703 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:57:40 ctl02 nova-api[9703]: 2017-09-28 11:57:40.341 9703 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:57:40 ctl02 nova-api[9703]: 2017-09-28 11:57:40.341 9703 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:57:40 ctl02 nova-api[9703]: 2017-09-28 11:57:40.341 9703 ERROR nova     max_url_len=max_url_len)
Sep 28 11:57:40 ctl02 nova-api[9703]: 2017-09-28 11:57:40.341 9703 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:57:40 ctl02 nova-api[9703]: 2017-09-28 11:57:40.341 9703 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:57:40 ctl02 nova-api[9703]: 2017-09-28 11:57:40.341 9703 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:57:40 ctl02 nova-api[9703]: 2017-09-28 11:57:40.341 9703 ERROR nova     sock.listen(backlog)
Sep 28 11:57:40 ctl02 nova-api[9703]: 2017-09-28 11:57:40.341 9703 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:57:40 ctl02 nova-api[9703]: 2017-09-28 11:57:40.341 9703 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:57:40 ctl02 nova-api[9703]: 2017-09-28 11:57:40.341 9703 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:57:40 ctl02 nova-api[9703]: 2017-09-28 11:57:40.341 9703 ERROR nova
Sep 28 11:57:40 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:57:40 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:57:40 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:57:40 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5a362006)
Sep 28 11:57:40 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:57:40 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:57:40 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:57:40 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:57:41 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5a362006)
Sep 28 11:57:42 ctl02 nova-api[9721]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:57:42 ctl02 nova-api[9721]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:57:42 ctl02 nova-api[9721]: 2017-09-28 11:57:42.357 9721 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:57:42 ctl02 nova-api[9721]: 2017-09-28 11:57:42.359 9721 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:57:42 ctl02 nova-api[9721]: 2017-09-28 11:57:42.359 9721 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:57:42 ctl02 nova-api[9721]: 2017-09-28 11:57:42.359 9721 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:57:42 ctl02 nova-api[9721]: 2017-09-28 11:57:42.359 9721 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:57:42 ctl02 nova-api[9721]: 2017-09-28 11:57:42.359 9721 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:57:42 ctl02 nova-api[9721]: 2017-09-28 11:57:42.359 9721 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:57:42 ctl02 nova-api[9721]: 2017-09-28 11:57:42.359 9721 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:57:42 ctl02 nova-api[9721]: 2017-09-28 11:57:42.359 9721 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:57:42 ctl02 nova-api[9721]: 2017-09-28 11:57:42.359 9721 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:57:42 ctl02 nova-api[9721]: 2017-09-28 11:57:42.359 9721 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:57:42 ctl02 nova-api[9721]: 2017-09-28 11:57:42.359 9721 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:57:42 ctl02 nova-api[9721]: 2017-09-28 11:57:42.359 9721 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:57:42 ctl02 nova-api[9721]: 2017-09-28 11:57:42.359 9721 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:57:42 ctl02 nova-api[9721]: 2017-09-28 11:57:42.359 9721 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:57:42 ctl02 nova-api[9721]: 2017-09-28 11:57:42.359 9721 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:57:42 ctl02 nova-api[9721]: 2017-09-28 11:57:42.359 9721 ERROR nova.wsgi     self.filename))
Sep 28 11:57:42 ctl02 nova-api[9721]: 2017-09-28 11:57:42.359 9721 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:57:42 ctl02 nova-api[9721]: 2017-09-28 11:57:42.359 9721 ERROR nova.wsgi
Sep 28 11:57:42 ctl02 nova-api[9721]: 2017-09-28 11:57:42.361 9721 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:57:42 ctl02 nova-api[9721]: 2017-09-28 11:57:42.493 9721 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:57:42 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5a362006)
Sep 28 11:57:42 ctl02 nova-api[9721]: 2017-09-28 11:57:42.733 9721 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:57:42 ctl02 nova-api[9721]: 2017-09-28 11:57:42.736 9721 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:57:42 ctl02 nova-api[9721]: 2017-09-28 11:57:42.736 9721 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:57:42 ctl02 nova-api[9721]: 2017-09-28 11:57:42.736 9721 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:57:42 ctl02 nova-api[9721]: 2017-09-28 11:57:42.866 9721 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:57:42 ctl02 nova-api[9721]: 2017-09-28 11:57:42.868 9721 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:57:42 ctl02 nova-api[9721]: 2017-09-28 11:57:42.869 9721 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:57:42 ctl02 nova-api[9721]: 2017-09-28 11:57:42.869 9721 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:57:42 ctl02 nova-api[9721]: 2017-09-28 11:57:42.872 9721 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:57:42 ctl02 nova-api[9721]: 2017-09-28 11:57:42.873 9721 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:57:42 ctl02 nova-api[9721]: 2017-09-28 11:57:42.873 9721 ERROR nova Traceback (most recent call last):
Sep 28 11:57:42 ctl02 nova-api[9721]: 2017-09-28 11:57:42.873 9721 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:57:42 ctl02 nova-api[9721]: 2017-09-28 11:57:42.873 9721 ERROR nova     sys.exit(main())
Sep 28 11:57:42 ctl02 nova-api[9721]: 2017-09-28 11:57:42.873 9721 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:57:42 ctl02 nova-api[9721]: 2017-09-28 11:57:42.873 9721 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:57:42 ctl02 nova-api[9721]: 2017-09-28 11:57:42.873 9721 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:57:42 ctl02 nova-api[9721]: 2017-09-28 11:57:42.873 9721 ERROR nova     max_url_len=max_url_len)
Sep 28 11:57:42 ctl02 nova-api[9721]: 2017-09-28 11:57:42.873 9721 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:57:42 ctl02 nova-api[9721]: 2017-09-28 11:57:42.873 9721 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:57:42 ctl02 nova-api[9721]: 2017-09-28 11:57:42.873 9721 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:57:42 ctl02 nova-api[9721]: 2017-09-28 11:57:42.873 9721 ERROR nova     sock.listen(backlog)
Sep 28 11:57:42 ctl02 nova-api[9721]: 2017-09-28 11:57:42.873 9721 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:57:42 ctl02 nova-api[9721]: 2017-09-28 11:57:42.873 9721 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:57:42 ctl02 nova-api[9721]: 2017-09-28 11:57:42.873 9721 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:57:42 ctl02 nova-api[9721]: 2017-09-28 11:57:42.873 9721 ERROR nova
Sep 28 11:57:43 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:57:43 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:57:43 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:57:43 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:57:43 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:57:43 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:57:43 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:57:43 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5a362006)
Sep 28 11:57:44 ctl02 glance-api[29183]: 2017-09-28 11:57:44.034 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:57:44] "OPTIONS / HTTP/1.0" 200 134 0.000649
Sep 28 11:57:44 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5a362006)
Sep 28 11:57:44 ctl02 nova-api[9739]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:57:44 ctl02 nova-api[9739]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:57:45 ctl02 nova-api[9739]: 2017-09-28 11:57:45.110 9739 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:57:45 ctl02 nova-api[9739]: 2017-09-28 11:57:45.111 9739 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:57:45 ctl02 nova-api[9739]: 2017-09-28 11:57:45.111 9739 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:57:45 ctl02 nova-api[9739]: 2017-09-28 11:57:45.111 9739 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:57:45 ctl02 nova-api[9739]: 2017-09-28 11:57:45.111 9739 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:57:45 ctl02 nova-api[9739]: 2017-09-28 11:57:45.111 9739 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:57:45 ctl02 nova-api[9739]: 2017-09-28 11:57:45.111 9739 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:57:45 ctl02 nova-api[9739]: 2017-09-28 11:57:45.111 9739 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:57:45 ctl02 nova-api[9739]: 2017-09-28 11:57:45.111 9739 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:57:45 ctl02 nova-api[9739]: 2017-09-28 11:57:45.111 9739 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:57:45 ctl02 nova-api[9739]: 2017-09-28 11:57:45.111 9739 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:57:45 ctl02 nova-api[9739]: 2017-09-28 11:57:45.111 9739 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:57:45 ctl02 nova-api[9739]: 2017-09-28 11:57:45.111 9739 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:57:45 ctl02 nova-api[9739]: 2017-09-28 11:57:45.111 9739 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:57:45 ctl02 nova-api[9739]: 2017-09-28 11:57:45.111 9739 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:57:45 ctl02 nova-api[9739]: 2017-09-28 11:57:45.111 9739 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:57:45 ctl02 nova-api[9739]: 2017-09-28 11:57:45.111 9739 ERROR nova.wsgi     self.filename))
Sep 28 11:57:45 ctl02 nova-api[9739]: 2017-09-28 11:57:45.111 9739 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:57:45 ctl02 nova-api[9739]: 2017-09-28 11:57:45.111 9739 ERROR nova.wsgi
Sep 28 11:57:45 ctl02 nova-api[9739]: 2017-09-28 11:57:45.112 9739 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:57:45 ctl02 nova-api[9739]: 2017-09-28 11:57:45.247 9739 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:57:45 ctl02 nova-api[9739]: 2017-09-28 11:57:45.485 9739 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:57:45 ctl02 nova-api[9739]: 2017-09-28 11:57:45.487 9739 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:57:45 ctl02 nova-api[9739]: 2017-09-28 11:57:45.487 9739 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:57:45 ctl02 nova-api[9739]: 2017-09-28 11:57:45.488 9739 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:57:45 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5a362006)
Sep 28 11:57:45 ctl02 nova-api[9739]: 2017-09-28 11:57:45.619 9739 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:57:45 ctl02 nova-api[9739]: 2017-09-28 11:57:45.621 9739 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:57:45 ctl02 nova-api[9739]: 2017-09-28 11:57:45.621 9739 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:57:45 ctl02 nova-api[9739]: 2017-09-28 11:57:45.622 9739 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:57:45 ctl02 nova-api[9739]: 2017-09-28 11:57:45.625 9739 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:57:45 ctl02 nova-api[9739]: 2017-09-28 11:57:45.626 9739 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:57:45 ctl02 nova-api[9739]: 2017-09-28 11:57:45.626 9739 ERROR nova Traceback (most recent call last):
Sep 28 11:57:45 ctl02 nova-api[9739]: 2017-09-28 11:57:45.626 9739 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:57:45 ctl02 nova-api[9739]: 2017-09-28 11:57:45.626 9739 ERROR nova     sys.exit(main())
Sep 28 11:57:45 ctl02 nova-api[9739]: 2017-09-28 11:57:45.626 9739 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:57:45 ctl02 nova-api[9739]: 2017-09-28 11:57:45.626 9739 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:57:45 ctl02 nova-api[9739]: 2017-09-28 11:57:45.626 9739 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:57:45 ctl02 nova-api[9739]: 2017-09-28 11:57:45.626 9739 ERROR nova     max_url_len=max_url_len)
Sep 28 11:57:45 ctl02 nova-api[9739]: 2017-09-28 11:57:45.626 9739 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:57:45 ctl02 nova-api[9739]: 2017-09-28 11:57:45.626 9739 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:57:45 ctl02 nova-api[9739]: 2017-09-28 11:57:45.626 9739 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:57:45 ctl02 nova-api[9739]: 2017-09-28 11:57:45.626 9739 ERROR nova     sock.listen(backlog)
Sep 28 11:57:45 ctl02 nova-api[9739]: 2017-09-28 11:57:45.626 9739 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:57:45 ctl02 nova-api[9739]: 2017-09-28 11:57:45.626 9739 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:57:45 ctl02 nova-api[9739]: 2017-09-28 11:57:45.626 9739 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:57:45 ctl02 nova-api[9739]: 2017-09-28 11:57:45.626 9739 ERROR nova
Sep 28 11:57:45 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:57:45 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:57:45 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:57:45 ctl02 glance-api[29183]: 2017-09-28 11:57:45.954 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:57:45] "OPTIONS / HTTP/1.0" 200 134 0.000766
Sep 28 11:57:46 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:57:46 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:57:46 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:57:46 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:57:46 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5a362006)
Sep 28 11:57:47 ctl02 glance-api[29183]: 2017-09-28 11:57:47.554 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:57:47] "OPTIONS / HTTP/1.0" 200 134 0.001054
Sep 28 11:57:47 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5a362006)
Sep 28 11:57:47 ctl02 nova-api[9756]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:57:47 ctl02 nova-api[9756]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:57:47 ctl02 nova-api[9756]: 2017-09-28 11:57:47.854 9756 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:57:47 ctl02 nova-api[9756]: 2017-09-28 11:57:47.856 9756 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:57:47 ctl02 nova-api[9756]: 2017-09-28 11:57:47.856 9756 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:57:47 ctl02 nova-api[9756]: 2017-09-28 11:57:47.856 9756 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:57:47 ctl02 nova-api[9756]: 2017-09-28 11:57:47.856 9756 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:57:47 ctl02 nova-api[9756]: 2017-09-28 11:57:47.856 9756 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:57:47 ctl02 nova-api[9756]: 2017-09-28 11:57:47.856 9756 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:57:47 ctl02 nova-api[9756]: 2017-09-28 11:57:47.856 9756 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:57:47 ctl02 nova-api[9756]: 2017-09-28 11:57:47.856 9756 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:57:47 ctl02 nova-api[9756]: 2017-09-28 11:57:47.856 9756 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:57:47 ctl02 nova-api[9756]: 2017-09-28 11:57:47.856 9756 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:57:47 ctl02 nova-api[9756]: 2017-09-28 11:57:47.856 9756 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:57:47 ctl02 nova-api[9756]: 2017-09-28 11:57:47.856 9756 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:57:47 ctl02 nova-api[9756]: 2017-09-28 11:57:47.856 9756 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:57:47 ctl02 nova-api[9756]: 2017-09-28 11:57:47.856 9756 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:57:47 ctl02 nova-api[9756]: 2017-09-28 11:57:47.856 9756 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:57:47 ctl02 nova-api[9756]: 2017-09-28 11:57:47.856 9756 ERROR nova.wsgi     self.filename))
Sep 28 11:57:47 ctl02 nova-api[9756]: 2017-09-28 11:57:47.856 9756 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:57:47 ctl02 nova-api[9756]: 2017-09-28 11:57:47.856 9756 ERROR nova.wsgi
Sep 28 11:57:47 ctl02 nova-api[9756]: 2017-09-28 11:57:47.857 9756 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:57:47 ctl02 nova-api[9756]: 2017-09-28 11:57:47.990 9756 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:57:48 ctl02 nova-api[9756]: 2017-09-28 11:57:48.230 9756 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:57:48 ctl02 nova-api[9756]: 2017-09-28 11:57:48.233 9756 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:57:48 ctl02 nova-api[9756]: 2017-09-28 11:57:48.233 9756 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:57:48 ctl02 nova-api[9756]: 2017-09-28 11:57:48.233 9756 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:57:48 ctl02 nova-api[9756]: 2017-09-28 11:57:48.364 9756 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:57:48 ctl02 nova-api[9756]: 2017-09-28 11:57:48.366 9756 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:57:48 ctl02 nova-api[9756]: 2017-09-28 11:57:48.366 9756 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:57:48 ctl02 nova-api[9756]: 2017-09-28 11:57:48.366 9756 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:57:48 ctl02 nova-api[9756]: 2017-09-28 11:57:48.369 9756 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:57:48 ctl02 nova-api[9756]: 2017-09-28 11:57:48.370 9756 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:57:48 ctl02 nova-api[9756]: 2017-09-28 11:57:48.370 9756 ERROR nova Traceback (most recent call last):
Sep 28 11:57:48 ctl02 nova-api[9756]: 2017-09-28 11:57:48.370 9756 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:57:48 ctl02 nova-api[9756]: 2017-09-28 11:57:48.370 9756 ERROR nova     sys.exit(main())
Sep 28 11:57:48 ctl02 nova-api[9756]: 2017-09-28 11:57:48.370 9756 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:57:48 ctl02 nova-api[9756]: 2017-09-28 11:57:48.370 9756 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:57:48 ctl02 nova-api[9756]: 2017-09-28 11:57:48.370 9756 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:57:48 ctl02 nova-api[9756]: 2017-09-28 11:57:48.370 9756 ERROR nova     max_url_len=max_url_len)
Sep 28 11:57:48 ctl02 nova-api[9756]: 2017-09-28 11:57:48.370 9756 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:57:48 ctl02 nova-api[9756]: 2017-09-28 11:57:48.370 9756 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:57:48 ctl02 nova-api[9756]: 2017-09-28 11:57:48.370 9756 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:57:48 ctl02 nova-api[9756]: 2017-09-28 11:57:48.370 9756 ERROR nova     sock.listen(backlog)
Sep 28 11:57:48 ctl02 nova-api[9756]: 2017-09-28 11:57:48.370 9756 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:57:48 ctl02 nova-api[9756]: 2017-09-28 11:57:48.370 9756 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:57:48 ctl02 nova-api[9756]: 2017-09-28 11:57:48.370 9756 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:57:48 ctl02 nova-api[9756]: 2017-09-28 11:57:48.370 9756 ERROR nova
Sep 28 11:57:48 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:57:48 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:57:48 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:57:48 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5a362006)
Sep 28 11:57:48 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:57:48 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:57:48 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:57:48 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:57:49 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:57:49 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:57:50 ctl02 nova-api[9774]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:57:50 ctl02 nova-api[9774]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:57:50 ctl02 nova-api[9774]: 2017-09-28 11:57:50.331 9774 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:57:50 ctl02 nova-api[9774]: 2017-09-28 11:57:50.333 9774 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:57:50 ctl02 nova-api[9774]: 2017-09-28 11:57:50.333 9774 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:57:50 ctl02 nova-api[9774]: 2017-09-28 11:57:50.333 9774 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:57:50 ctl02 nova-api[9774]: 2017-09-28 11:57:50.333 9774 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:57:50 ctl02 nova-api[9774]: 2017-09-28 11:57:50.333 9774 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:57:50 ctl02 nova-api[9774]: 2017-09-28 11:57:50.333 9774 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:57:50 ctl02 nova-api[9774]: 2017-09-28 11:57:50.333 9774 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:57:50 ctl02 nova-api[9774]: 2017-09-28 11:57:50.333 9774 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:57:50 ctl02 nova-api[9774]: 2017-09-28 11:57:50.333 9774 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:57:50 ctl02 nova-api[9774]: 2017-09-28 11:57:50.333 9774 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:57:50 ctl02 nova-api[9774]: 2017-09-28 11:57:50.333 9774 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:57:50 ctl02 nova-api[9774]: 2017-09-28 11:57:50.333 9774 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:57:50 ctl02 nova-api[9774]: 2017-09-28 11:57:50.333 9774 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:57:50 ctl02 nova-api[9774]: 2017-09-28 11:57:50.333 9774 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:57:50 ctl02 nova-api[9774]: 2017-09-28 11:57:50.333 9774 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:57:50 ctl02 nova-api[9774]: 2017-09-28 11:57:50.333 9774 ERROR nova.wsgi     self.filename))
Sep 28 11:57:50 ctl02 nova-api[9774]: 2017-09-28 11:57:50.333 9774 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:57:50 ctl02 nova-api[9774]: 2017-09-28 11:57:50.333 9774 ERROR nova.wsgi
Sep 28 11:57:50 ctl02 nova-api[9774]: 2017-09-28 11:57:50.335 9774 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:57:50 ctl02 nova-api[9774]: 2017-09-28 11:57:50.469 9774 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:57:50 ctl02 nova-api[9774]: 2017-09-28 11:57:50.708 9774 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:57:50 ctl02 nova-api[9774]: 2017-09-28 11:57:50.711 9774 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:57:50 ctl02 nova-api[9774]: 2017-09-28 11:57:50.712 9774 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:57:50 ctl02 nova-api[9774]: 2017-09-28 11:57:50.712 9774 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:57:50 ctl02 nova-api[9774]: 2017-09-28 11:57:50.842 9774 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:57:50 ctl02 nova-api[9774]: 2017-09-28 11:57:50.845 9774 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:57:50 ctl02 nova-api[9774]: 2017-09-28 11:57:50.845 9774 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:57:50 ctl02 nova-api[9774]: 2017-09-28 11:57:50.846 9774 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:57:50 ctl02 nova-api[9774]: 2017-09-28 11:57:50.849 9774 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:57:50 ctl02 nova-api[9774]: 2017-09-28 11:57:50.850 9774 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:57:50 ctl02 nova-api[9774]: 2017-09-28 11:57:50.850 9774 ERROR nova Traceback (most recent call last):
Sep 28 11:57:50 ctl02 nova-api[9774]: 2017-09-28 11:57:50.850 9774 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:57:50 ctl02 nova-api[9774]: 2017-09-28 11:57:50.850 9774 ERROR nova     sys.exit(main())
Sep 28 11:57:50 ctl02 nova-api[9774]: 2017-09-28 11:57:50.850 9774 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:57:50 ctl02 nova-api[9774]: 2017-09-28 11:57:50.850 9774 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:57:50 ctl02 nova-api[9774]: 2017-09-28 11:57:50.850 9774 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:57:50 ctl02 nova-api[9774]: 2017-09-28 11:57:50.850 9774 ERROR nova     max_url_len=max_url_len)
Sep 28 11:57:50 ctl02 nova-api[9774]: 2017-09-28 11:57:50.850 9774 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:57:50 ctl02 nova-api[9774]: 2017-09-28 11:57:50.850 9774 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:57:50 ctl02 nova-api[9774]: 2017-09-28 11:57:50.850 9774 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:57:50 ctl02 nova-api[9774]: 2017-09-28 11:57:50.850 9774 ERROR nova     sock.listen(backlog)
Sep 28 11:57:50 ctl02 nova-api[9774]: 2017-09-28 11:57:50.850 9774 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:57:50 ctl02 nova-api[9774]: 2017-09-28 11:57:50.850 9774 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:57:50 ctl02 nova-api[9774]: 2017-09-28 11:57:50.850 9774 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:57:50 ctl02 nova-api[9774]: 2017-09-28 11:57:50.850 9774 ERROR nova
Sep 28 11:57:51 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:57:51 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:57:51 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:57:51 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:57:51 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:57:51 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:57:51 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:57:52 ctl02 nova-api[9798]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:57:52 ctl02 nova-api[9798]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:57:52 ctl02 nova-api[9798]: 2017-09-28 11:57:52.806 9798 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:57:52 ctl02 nova-api[9798]: 2017-09-28 11:57:52.808 9798 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:57:52 ctl02 nova-api[9798]: 2017-09-28 11:57:52.808 9798 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:57:52 ctl02 nova-api[9798]: 2017-09-28 11:57:52.808 9798 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:57:52 ctl02 nova-api[9798]: 2017-09-28 11:57:52.808 9798 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:57:52 ctl02 nova-api[9798]: 2017-09-28 11:57:52.808 9798 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:57:52 ctl02 nova-api[9798]: 2017-09-28 11:57:52.808 9798 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:57:52 ctl02 nova-api[9798]: 2017-09-28 11:57:52.808 9798 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:57:52 ctl02 nova-api[9798]: 2017-09-28 11:57:52.808 9798 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:57:52 ctl02 nova-api[9798]: 2017-09-28 11:57:52.808 9798 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:57:52 ctl02 nova-api[9798]: 2017-09-28 11:57:52.808 9798 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:57:52 ctl02 nova-api[9798]: 2017-09-28 11:57:52.808 9798 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:57:52 ctl02 nova-api[9798]: 2017-09-28 11:57:52.808 9798 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:57:52 ctl02 nova-api[9798]: 2017-09-28 11:57:52.808 9798 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:57:52 ctl02 nova-api[9798]: 2017-09-28 11:57:52.808 9798 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:57:52 ctl02 nova-api[9798]: 2017-09-28 11:57:52.808 9798 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:57:52 ctl02 nova-api[9798]: 2017-09-28 11:57:52.808 9798 ERROR nova.wsgi     self.filename))
Sep 28 11:57:52 ctl02 nova-api[9798]: 2017-09-28 11:57:52.808 9798 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:57:52 ctl02 nova-api[9798]: 2017-09-28 11:57:52.808 9798 ERROR nova.wsgi
Sep 28 11:57:52 ctl02 nova-api[9798]: 2017-09-28 11:57:52.810 9798 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:57:52 ctl02 nova-api[9798]: 2017-09-28 11:57:52.937 9798 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:57:53 ctl02 nova-api[9798]: 2017-09-28 11:57:53.172 9798 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:57:53 ctl02 nova-api[9798]: 2017-09-28 11:57:53.175 9798 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:57:53 ctl02 nova-api[9798]: 2017-09-28 11:57:53.175 9798 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:57:53 ctl02 nova-api[9798]: 2017-09-28 11:57:53.175 9798 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:57:53 ctl02 nova-api[9798]: 2017-09-28 11:57:53.305 9798 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:57:53 ctl02 nova-api[9798]: 2017-09-28 11:57:53.308 9798 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:57:53 ctl02 nova-api[9798]: 2017-09-28 11:57:53.308 9798 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:57:53 ctl02 nova-api[9798]: 2017-09-28 11:57:53.309 9798 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:57:53 ctl02 nova-api[9798]: 2017-09-28 11:57:53.312 9798 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:57:53 ctl02 nova-api[9798]: 2017-09-28 11:57:53.312 9798 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:57:53 ctl02 nova-api[9798]: 2017-09-28 11:57:53.312 9798 ERROR nova Traceback (most recent call last):
Sep 28 11:57:53 ctl02 nova-api[9798]: 2017-09-28 11:57:53.312 9798 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:57:53 ctl02 nova-api[9798]: 2017-09-28 11:57:53.312 9798 ERROR nova     sys.exit(main())
Sep 28 11:57:53 ctl02 nova-api[9798]: 2017-09-28 11:57:53.312 9798 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:57:53 ctl02 nova-api[9798]: 2017-09-28 11:57:53.312 9798 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:57:53 ctl02 nova-api[9798]: 2017-09-28 11:57:53.312 9798 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:57:53 ctl02 nova-api[9798]: 2017-09-28 11:57:53.312 9798 ERROR nova     max_url_len=max_url_len)
Sep 28 11:57:53 ctl02 nova-api[9798]: 2017-09-28 11:57:53.312 9798 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:57:53 ctl02 nova-api[9798]: 2017-09-28 11:57:53.312 9798 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:57:53 ctl02 nova-api[9798]: 2017-09-28 11:57:53.312 9798 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:57:53 ctl02 nova-api[9798]: 2017-09-28 11:57:53.312 9798 ERROR nova     sock.listen(backlog)
Sep 28 11:57:53 ctl02 nova-api[9798]: 2017-09-28 11:57:53.312 9798 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:57:53 ctl02 nova-api[9798]: 2017-09-28 11:57:53.312 9798 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:57:53 ctl02 nova-api[9798]: 2017-09-28 11:57:53.312 9798 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:57:53 ctl02 nova-api[9798]: 2017-09-28 11:57:53.312 9798 ERROR nova
Sep 28 11:57:53 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:57:53 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:57:53 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:57:53 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:57:53 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:57:53 ctl02 glance-api[29183]: 2017-09-28 11:57:53.637 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:57:53] "OPTIONS / HTTP/1.0" 200 134 0.000777
Sep 28 11:57:53 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:57:53 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:57:55 ctl02 nova-api[9816]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:57:55 ctl02 nova-api[9816]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:57:55 ctl02 nova-api[9816]: 2017-09-28 11:57:55.411 9816 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:57:55 ctl02 nova-api[9816]: 2017-09-28 11:57:55.413 9816 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:57:55 ctl02 nova-api[9816]: 2017-09-28 11:57:55.413 9816 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:57:55 ctl02 nova-api[9816]: 2017-09-28 11:57:55.413 9816 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:57:55 ctl02 nova-api[9816]: 2017-09-28 11:57:55.413 9816 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:57:55 ctl02 nova-api[9816]: 2017-09-28 11:57:55.413 9816 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:57:55 ctl02 nova-api[9816]: 2017-09-28 11:57:55.413 9816 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:57:55 ctl02 nova-api[9816]: 2017-09-28 11:57:55.413 9816 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:57:55 ctl02 nova-api[9816]: 2017-09-28 11:57:55.413 9816 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:57:55 ctl02 nova-api[9816]: 2017-09-28 11:57:55.413 9816 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:57:55 ctl02 nova-api[9816]: 2017-09-28 11:57:55.413 9816 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:57:55 ctl02 nova-api[9816]: 2017-09-28 11:57:55.413 9816 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:57:55 ctl02 nova-api[9816]: 2017-09-28 11:57:55.413 9816 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:57:55 ctl02 nova-api[9816]: 2017-09-28 11:57:55.413 9816 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:57:55 ctl02 nova-api[9816]: 2017-09-28 11:57:55.413 9816 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:57:55 ctl02 nova-api[9816]: 2017-09-28 11:57:55.413 9816 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:57:55 ctl02 nova-api[9816]: 2017-09-28 11:57:55.413 9816 ERROR nova.wsgi     self.filename))
Sep 28 11:57:55 ctl02 nova-api[9816]: 2017-09-28 11:57:55.413 9816 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:57:55 ctl02 nova-api[9816]: 2017-09-28 11:57:55.413 9816 ERROR nova.wsgi
Sep 28 11:57:55 ctl02 nova-api[9816]: 2017-09-28 11:57:55.413 9816 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:57:55 ctl02 nova-cert[4860]: 2017-09-28 11:57:55.503 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:57:55 ctl02 nova-api[9816]: 2017-09-28 11:57:55.551 9816 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:57:55 ctl02 nova-api[9816]: 2017-09-28 11:57:55.795 9816 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:57:55 ctl02 nova-api[9816]: 2017-09-28 11:57:55.797 9816 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:57:55 ctl02 nova-api[9816]: 2017-09-28 11:57:55.797 9816 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:57:55 ctl02 nova-api[9816]: 2017-09-28 11:57:55.797 9816 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:57:55 ctl02 nova-api[9816]: 2017-09-28 11:57:55.930 9816 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:57:55 ctl02 nova-api[9816]: 2017-09-28 11:57:55.932 9816 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:57:55 ctl02 nova-api[9816]: 2017-09-28 11:57:55.933 9816 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:57:55 ctl02 nova-api[9816]: 2017-09-28 11:57:55.933 9816 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:57:55 ctl02 nova-api[9816]: 2017-09-28 11:57:55.936 9816 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:57:55 ctl02 nova-api[9816]: 2017-09-28 11:57:55.937 9816 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:57:55 ctl02 nova-api[9816]: 2017-09-28 11:57:55.937 9816 ERROR nova Traceback (most recent call last):
Sep 28 11:57:55 ctl02 nova-api[9816]: 2017-09-28 11:57:55.937 9816 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:57:55 ctl02 nova-api[9816]: 2017-09-28 11:57:55.937 9816 ERROR nova     sys.exit(main())
Sep 28 11:57:55 ctl02 nova-api[9816]: 2017-09-28 11:57:55.937 9816 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:57:55 ctl02 nova-api[9816]: 2017-09-28 11:57:55.937 9816 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:57:55 ctl02 nova-api[9816]: 2017-09-28 11:57:55.937 9816 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:57:55 ctl02 nova-api[9816]: 2017-09-28 11:57:55.937 9816 ERROR nova     max_url_len=max_url_len)
Sep 28 11:57:55 ctl02 nova-api[9816]: 2017-09-28 11:57:55.937 9816 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:57:55 ctl02 nova-api[9816]: 2017-09-28 11:57:55.937 9816 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:57:55 ctl02 nova-api[9816]: 2017-09-28 11:57:55.937 9816 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:57:55 ctl02 nova-api[9816]: 2017-09-28 11:57:55.937 9816 ERROR nova     sock.listen(backlog)
Sep 28 11:57:55 ctl02 nova-api[9816]: 2017-09-28 11:57:55.937 9816 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:57:55 ctl02 nova-api[9816]: 2017-09-28 11:57:55.937 9816 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:57:55 ctl02 nova-api[9816]: 2017-09-28 11:57:55.937 9816 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:57:55 ctl02 nova-api[9816]: 2017-09-28 11:57:55.937 9816 ERROR nova
Sep 28 11:57:56 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:57:56 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:57:56 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:57:56 ctl02 glance-api[29183]: 2017-09-28 11:57:56.259 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:57:56] "OPTIONS / HTTP/1.0" 200 134 0.000758
Sep 28 11:57:56 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:57:56 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:57:56 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:57:56 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:57:57 ctl02 glance-api[29183]: 2017-09-28 11:57:57.819 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:57:57] "OPTIONS / HTTP/1.0" 200 134 0.001017
Sep 28 11:57:57 ctl02 nova-api[9834]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:57:57 ctl02 nova-api[9834]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:57:58 ctl02 nova-api[9834]: 2017-09-28 11:57:58.087 9834 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:57:58 ctl02 nova-api[9834]: 2017-09-28 11:57:58.088 9834 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:57:58 ctl02 nova-api[9834]: 2017-09-28 11:57:58.088 9834 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:57:58 ctl02 nova-api[9834]: 2017-09-28 11:57:58.088 9834 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:57:58 ctl02 nova-api[9834]: 2017-09-28 11:57:58.088 9834 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:57:58 ctl02 nova-api[9834]: 2017-09-28 11:57:58.088 9834 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:57:58 ctl02 nova-api[9834]: 2017-09-28 11:57:58.088 9834 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:57:58 ctl02 nova-api[9834]: 2017-09-28 11:57:58.088 9834 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:57:58 ctl02 nova-api[9834]: 2017-09-28 11:57:58.088 9834 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:57:58 ctl02 nova-api[9834]: 2017-09-28 11:57:58.088 9834 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:57:58 ctl02 nova-api[9834]: 2017-09-28 11:57:58.088 9834 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:57:58 ctl02 nova-api[9834]: 2017-09-28 11:57:58.088 9834 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:57:58 ctl02 nova-api[9834]: 2017-09-28 11:57:58.088 9834 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:57:58 ctl02 nova-api[9834]: 2017-09-28 11:57:58.088 9834 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:57:58 ctl02 nova-api[9834]: 2017-09-28 11:57:58.088 9834 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:57:58 ctl02 nova-api[9834]: 2017-09-28 11:57:58.088 9834 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:57:58 ctl02 nova-api[9834]: 2017-09-28 11:57:58.088 9834 ERROR nova.wsgi     self.filename))
Sep 28 11:57:58 ctl02 nova-api[9834]: 2017-09-28 11:57:58.088 9834 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:57:58 ctl02 nova-api[9834]: 2017-09-28 11:57:58.088 9834 ERROR nova.wsgi
Sep 28 11:57:58 ctl02 nova-api[9834]: 2017-09-28 11:57:58.089 9834 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:57:58 ctl02 nova-conductor[5056]: 2017-09-28 11:57:58.189 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:57:58 ctl02 nova-conductor[5056]: 2017-09-28 11:57:58.204 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:57:58 ctl02 nova-conductor[5056]: 2017-09-28 11:57:58.220 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:57:58 ctl02 nova-api[9834]: 2017-09-28 11:57:58.224 9834 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:57:58 ctl02 nova-conductor[5056]: 2017-09-28 11:57:58.228 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:57:58 ctl02 nova-api[9834]: 2017-09-28 11:57:58.458 9834 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:57:58 ctl02 nova-api[9834]: 2017-09-28 11:57:58.461 9834 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:57:58 ctl02 nova-api[9834]: 2017-09-28 11:57:58.461 9834 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:57:58 ctl02 nova-api[9834]: 2017-09-28 11:57:58.462 9834 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:57:58 ctl02 nova-api[9834]: 2017-09-28 11:57:58.594 9834 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:57:58 ctl02 nova-api[9834]: 2017-09-28 11:57:58.596 9834 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:57:58 ctl02 nova-api[9834]: 2017-09-28 11:57:58.596 9834 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:57:58 ctl02 nova-api[9834]: 2017-09-28 11:57:58.597 9834 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:57:58 ctl02 nova-api[9834]: 2017-09-28 11:57:58.600 9834 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:57:58 ctl02 nova-api[9834]: 2017-09-28 11:57:58.601 9834 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:57:58 ctl02 nova-api[9834]: 2017-09-28 11:57:58.601 9834 ERROR nova Traceback (most recent call last):
Sep 28 11:57:58 ctl02 nova-api[9834]: 2017-09-28 11:57:58.601 9834 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:57:58 ctl02 nova-api[9834]: 2017-09-28 11:57:58.601 9834 ERROR nova     sys.exit(main())
Sep 28 11:57:58 ctl02 nova-api[9834]: 2017-09-28 11:57:58.601 9834 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:57:58 ctl02 nova-api[9834]: 2017-09-28 11:57:58.601 9834 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:57:58 ctl02 nova-api[9834]: 2017-09-28 11:57:58.601 9834 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:57:58 ctl02 nova-api[9834]: 2017-09-28 11:57:58.601 9834 ERROR nova     max_url_len=max_url_len)
Sep 28 11:57:58 ctl02 nova-api[9834]: 2017-09-28 11:57:58.601 9834 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:57:58 ctl02 nova-api[9834]: 2017-09-28 11:57:58.601 9834 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:57:58 ctl02 nova-api[9834]: 2017-09-28 11:57:58.601 9834 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:57:58 ctl02 nova-api[9834]: 2017-09-28 11:57:58.601 9834 ERROR nova     sock.listen(backlog)
Sep 28 11:57:58 ctl02 nova-api[9834]: 2017-09-28 11:57:58.601 9834 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:57:58 ctl02 nova-api[9834]: 2017-09-28 11:57:58.601 9834 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:57:58 ctl02 nova-api[9834]: 2017-09-28 11:57:58.601 9834 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:57:58 ctl02 nova-api[9834]: 2017-09-28 11:57:58.601 9834 ERROR nova
Sep 28 11:57:58 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:57:58 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:57:58 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:57:58 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:57:58 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:57:58 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:57:58 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:58:00 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd07eb761)
Sep 28 11:58:00 ctl02 nova-api[9852]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:58:00 ctl02 nova-api[9852]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:58:00 ctl02 nova-api[9852]: 2017-09-28 11:58:00.577 9852 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:58:00 ctl02 nova-api[9852]: 2017-09-28 11:58:00.578 9852 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:58:00 ctl02 nova-api[9852]: 2017-09-28 11:58:00.578 9852 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:58:00 ctl02 nova-api[9852]: 2017-09-28 11:58:00.578 9852 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:58:00 ctl02 nova-api[9852]: 2017-09-28 11:58:00.578 9852 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:58:00 ctl02 nova-api[9852]: 2017-09-28 11:58:00.578 9852 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:58:00 ctl02 nova-api[9852]: 2017-09-28 11:58:00.578 9852 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:58:00 ctl02 nova-api[9852]: 2017-09-28 11:58:00.578 9852 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:58:00 ctl02 nova-api[9852]: 2017-09-28 11:58:00.578 9852 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:58:00 ctl02 nova-api[9852]: 2017-09-28 11:58:00.578 9852 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:58:00 ctl02 nova-api[9852]: 2017-09-28 11:58:00.578 9852 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:58:00 ctl02 nova-api[9852]: 2017-09-28 11:58:00.578 9852 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:58:00 ctl02 nova-api[9852]: 2017-09-28 11:58:00.578 9852 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:58:00 ctl02 nova-api[9852]: 2017-09-28 11:58:00.578 9852 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:58:00 ctl02 nova-api[9852]: 2017-09-28 11:58:00.578 9852 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:58:00 ctl02 nova-api[9852]: 2017-09-28 11:58:00.578 9852 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:58:00 ctl02 nova-api[9852]: 2017-09-28 11:58:00.578 9852 ERROR nova.wsgi     self.filename))
Sep 28 11:58:00 ctl02 nova-api[9852]: 2017-09-28 11:58:00.578 9852 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:58:00 ctl02 nova-api[9852]: 2017-09-28 11:58:00.578 9852 ERROR nova.wsgi
Sep 28 11:58:00 ctl02 nova-api[9852]: 2017-09-28 11:58:00.579 9852 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:58:00 ctl02 nova-api[9852]: 2017-09-28 11:58:00.709 9852 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:58:00 ctl02 nova-api[9852]: 2017-09-28 11:58:00.938 9852 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:58:00 ctl02 nova-api[9852]: 2017-09-28 11:58:00.940 9852 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:58:00 ctl02 nova-api[9852]: 2017-09-28 11:58:00.940 9852 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:58:00 ctl02 nova-api[9852]: 2017-09-28 11:58:00.940 9852 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:58:01 ctl02 nova-api[9852]: 2017-09-28 11:58:01.070 9852 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:58:01 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd07eb761)
Sep 28 11:58:01 ctl02 nova-api[9852]: 2017-09-28 11:58:01.072 9852 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:58:01 ctl02 nova-api[9852]: 2017-09-28 11:58:01.072 9852 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:58:01 ctl02 nova-api[9852]: 2017-09-28 11:58:01.072 9852 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:58:01 ctl02 nova-api[9852]: 2017-09-28 11:58:01.075 9852 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:58:01 ctl02 nova-api[9852]: 2017-09-28 11:58:01.076 9852 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:58:01 ctl02 nova-api[9852]: 2017-09-28 11:58:01.076 9852 ERROR nova Traceback (most recent call last):
Sep 28 11:58:01 ctl02 nova-api[9852]: 2017-09-28 11:58:01.076 9852 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:58:01 ctl02 nova-api[9852]: 2017-09-28 11:58:01.076 9852 ERROR nova     sys.exit(main())
Sep 28 11:58:01 ctl02 nova-api[9852]: 2017-09-28 11:58:01.076 9852 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:58:01 ctl02 nova-api[9852]: 2017-09-28 11:58:01.076 9852 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:58:01 ctl02 nova-api[9852]: 2017-09-28 11:58:01.076 9852 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:58:01 ctl02 nova-api[9852]: 2017-09-28 11:58:01.076 9852 ERROR nova     max_url_len=max_url_len)
Sep 28 11:58:01 ctl02 nova-api[9852]: 2017-09-28 11:58:01.076 9852 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:58:01 ctl02 nova-api[9852]: 2017-09-28 11:58:01.076 9852 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:58:01 ctl02 nova-api[9852]: 2017-09-28 11:58:01.076 9852 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:58:01 ctl02 nova-api[9852]: 2017-09-28 11:58:01.076 9852 ERROR nova     sock.listen(backlog)
Sep 28 11:58:01 ctl02 nova-api[9852]: 2017-09-28 11:58:01.076 9852 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:58:01 ctl02 nova-api[9852]: 2017-09-28 11:58:01.076 9852 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:58:01 ctl02 nova-api[9852]: 2017-09-28 11:58:01.076 9852 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:58:01 ctl02 nova-api[9852]: 2017-09-28 11:58:01.076 9852 ERROR nova
Sep 28 11:58:01 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:58:01 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:58:01 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:58:01 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:58:01 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:58:01 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:58:01 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:58:02 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd07eb761)
Sep 28 11:58:02 ctl02 nova-api[9869]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:58:02 ctl02 nova-api[9869]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:58:03 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd07eb761)
Sep 28 11:58:03 ctl02 nova-api[9869]: 2017-09-28 11:58:03.099 9869 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:58:03 ctl02 nova-api[9869]: 2017-09-28 11:58:03.100 9869 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:58:03 ctl02 nova-api[9869]: 2017-09-28 11:58:03.100 9869 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:58:03 ctl02 nova-api[9869]: 2017-09-28 11:58:03.100 9869 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:58:03 ctl02 nova-api[9869]: 2017-09-28 11:58:03.100 9869 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:58:03 ctl02 nova-api[9869]: 2017-09-28 11:58:03.100 9869 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:58:03 ctl02 nova-api[9869]: 2017-09-28 11:58:03.100 9869 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:58:03 ctl02 nova-api[9869]: 2017-09-28 11:58:03.100 9869 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:58:03 ctl02 nova-api[9869]: 2017-09-28 11:58:03.100 9869 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:58:03 ctl02 nova-api[9869]: 2017-09-28 11:58:03.100 9869 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:58:03 ctl02 nova-api[9869]: 2017-09-28 11:58:03.100 9869 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:58:03 ctl02 nova-api[9869]: 2017-09-28 11:58:03.100 9869 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:58:03 ctl02 nova-api[9869]: 2017-09-28 11:58:03.100 9869 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:58:03 ctl02 nova-api[9869]: 2017-09-28 11:58:03.100 9869 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:58:03 ctl02 nova-api[9869]: 2017-09-28 11:58:03.100 9869 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:58:03 ctl02 nova-api[9869]: 2017-09-28 11:58:03.100 9869 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:58:03 ctl02 nova-api[9869]: 2017-09-28 11:58:03.100 9869 ERROR nova.wsgi     self.filename))
Sep 28 11:58:03 ctl02 nova-api[9869]: 2017-09-28 11:58:03.100 9869 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:58:03 ctl02 nova-api[9869]: 2017-09-28 11:58:03.100 9869 ERROR nova.wsgi
Sep 28 11:58:03 ctl02 nova-api[9869]: 2017-09-28 11:58:03.101 9869 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:58:03 ctl02 nova-api[9869]: 2017-09-28 11:58:03.232 9869 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:58:03 ctl02 glance-api[29183]: 2017-09-28 11:58:03.382 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:58:03] "OPTIONS / HTTP/1.0" 200 134 0.000670
Sep 28 11:58:03 ctl02 nova-api[9869]: 2017-09-28 11:58:03.472 9869 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:58:03 ctl02 nova-api[9869]: 2017-09-28 11:58:03.474 9869 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:58:03 ctl02 nova-api[9869]: 2017-09-28 11:58:03.474 9869 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:58:03 ctl02 nova-api[9869]: 2017-09-28 11:58:03.474 9869 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:58:03 ctl02 nova-api[9869]: 2017-09-28 11:58:03.606 9869 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:58:03 ctl02 nova-api[9869]: 2017-09-28 11:58:03.608 9869 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:58:03 ctl02 nova-api[9869]: 2017-09-28 11:58:03.608 9869 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:58:03 ctl02 nova-api[9869]: 2017-09-28 11:58:03.608 9869 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:58:03 ctl02 nova-api[9869]: 2017-09-28 11:58:03.612 9869 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:58:03 ctl02 nova-api[9869]: 2017-09-28 11:58:03.612 9869 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:58:03 ctl02 nova-api[9869]: 2017-09-28 11:58:03.612 9869 ERROR nova Traceback (most recent call last):
Sep 28 11:58:03 ctl02 nova-api[9869]: 2017-09-28 11:58:03.612 9869 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:58:03 ctl02 nova-api[9869]: 2017-09-28 11:58:03.612 9869 ERROR nova     sys.exit(main())
Sep 28 11:58:03 ctl02 nova-api[9869]: 2017-09-28 11:58:03.612 9869 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:58:03 ctl02 nova-api[9869]: 2017-09-28 11:58:03.612 9869 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:58:03 ctl02 nova-api[9869]: 2017-09-28 11:58:03.612 9869 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:58:03 ctl02 nova-api[9869]: 2017-09-28 11:58:03.612 9869 ERROR nova     max_url_len=max_url_len)
Sep 28 11:58:03 ctl02 nova-api[9869]: 2017-09-28 11:58:03.612 9869 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:58:03 ctl02 nova-api[9869]: 2017-09-28 11:58:03.612 9869 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:58:03 ctl02 nova-api[9869]: 2017-09-28 11:58:03.612 9869 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:58:03 ctl02 nova-api[9869]: 2017-09-28 11:58:03.612 9869 ERROR nova     sock.listen(backlog)
Sep 28 11:58:03 ctl02 nova-api[9869]: 2017-09-28 11:58:03.612 9869 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:58:03 ctl02 nova-api[9869]: 2017-09-28 11:58:03.612 9869 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:58:03 ctl02 nova-api[9869]: 2017-09-28 11:58:03.612 9869 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:58:03 ctl02 nova-api[9869]: 2017-09-28 11:58:03.612 9869 ERROR nova
Sep 28 11:58:03 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:58:03 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:58:03 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:58:03 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:58:03 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:58:03 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:58:03 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:58:04 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd07eb761)
Sep 28 11:58:05 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd07eb761)
Sep 28 11:58:05 ctl02 nova-consoleauth[5433]: 2017-09-28 11:58:05.384 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:58:05 ctl02 nova-api[9888]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:58:05 ctl02 nova-api[9888]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:58:05 ctl02 nova-api[9888]: 2017-09-28 11:58:05.566 9888 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:58:05 ctl02 nova-api[9888]: 2017-09-28 11:58:05.568 9888 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:58:05 ctl02 nova-api[9888]: 2017-09-28 11:58:05.568 9888 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:58:05 ctl02 nova-api[9888]: 2017-09-28 11:58:05.568 9888 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:58:05 ctl02 nova-api[9888]: 2017-09-28 11:58:05.568 9888 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:58:05 ctl02 nova-api[9888]: 2017-09-28 11:58:05.568 9888 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:58:05 ctl02 nova-api[9888]: 2017-09-28 11:58:05.568 9888 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:58:05 ctl02 nova-api[9888]: 2017-09-28 11:58:05.568 9888 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:58:05 ctl02 nova-api[9888]: 2017-09-28 11:58:05.568 9888 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:58:05 ctl02 nova-api[9888]: 2017-09-28 11:58:05.568 9888 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:58:05 ctl02 nova-api[9888]: 2017-09-28 11:58:05.568 9888 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:58:05 ctl02 nova-api[9888]: 2017-09-28 11:58:05.568 9888 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:58:05 ctl02 nova-api[9888]: 2017-09-28 11:58:05.568 9888 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:58:05 ctl02 nova-api[9888]: 2017-09-28 11:58:05.568 9888 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:58:05 ctl02 nova-api[9888]: 2017-09-28 11:58:05.568 9888 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:58:05 ctl02 nova-api[9888]: 2017-09-28 11:58:05.568 9888 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:58:05 ctl02 nova-api[9888]: 2017-09-28 11:58:05.568 9888 ERROR nova.wsgi     self.filename))
Sep 28 11:58:05 ctl02 nova-api[9888]: 2017-09-28 11:58:05.568 9888 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:58:05 ctl02 nova-api[9888]: 2017-09-28 11:58:05.568 9888 ERROR nova.wsgi
Sep 28 11:58:05 ctl02 nova-api[9888]: 2017-09-28 11:58:05.571 9888 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:58:05 ctl02 nova-api[9888]: 2017-09-28 11:58:05.703 9888 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:58:05 ctl02 nova-api[9888]: 2017-09-28 11:58:05.939 9888 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:58:05 ctl02 nova-api[9888]: 2017-09-28 11:58:05.941 9888 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:58:05 ctl02 nova-api[9888]: 2017-09-28 11:58:05.942 9888 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:58:05 ctl02 nova-api[9888]: 2017-09-28 11:58:05.942 9888 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:58:06 ctl02 nova-api[9888]: 2017-09-28 11:58:06.075 9888 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:58:06 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd07eb761)
Sep 28 11:58:06 ctl02 nova-api[9888]: 2017-09-28 11:58:06.077 9888 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:58:06 ctl02 nova-api[9888]: 2017-09-28 11:58:06.078 9888 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:58:06 ctl02 nova-api[9888]: 2017-09-28 11:58:06.078 9888 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:58:06 ctl02 nova-api[9888]: 2017-09-28 11:58:06.082 9888 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:58:06 ctl02 nova-api[9888]: 2017-09-28 11:58:06.082 9888 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:58:06 ctl02 nova-api[9888]: 2017-09-28 11:58:06.082 9888 ERROR nova Traceback (most recent call last):
Sep 28 11:58:06 ctl02 nova-api[9888]: 2017-09-28 11:58:06.082 9888 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:58:06 ctl02 nova-api[9888]: 2017-09-28 11:58:06.082 9888 ERROR nova     sys.exit(main())
Sep 28 11:58:06 ctl02 nova-api[9888]: 2017-09-28 11:58:06.082 9888 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:58:06 ctl02 nova-api[9888]: 2017-09-28 11:58:06.082 9888 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:58:06 ctl02 nova-api[9888]: 2017-09-28 11:58:06.082 9888 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:58:06 ctl02 nova-api[9888]: 2017-09-28 11:58:06.082 9888 ERROR nova     max_url_len=max_url_len)
Sep 28 11:58:06 ctl02 nova-api[9888]: 2017-09-28 11:58:06.082 9888 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:58:06 ctl02 nova-api[9888]: 2017-09-28 11:58:06.082 9888 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:58:06 ctl02 nova-api[9888]: 2017-09-28 11:58:06.082 9888 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:58:06 ctl02 nova-api[9888]: 2017-09-28 11:58:06.082 9888 ERROR nova     sock.listen(backlog)
Sep 28 11:58:06 ctl02 nova-api[9888]: 2017-09-28 11:58:06.082 9888 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:58:06 ctl02 nova-api[9888]: 2017-09-28 11:58:06.082 9888 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:58:06 ctl02 nova-api[9888]: 2017-09-28 11:58:06.082 9888 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:58:06 ctl02 nova-api[9888]: 2017-09-28 11:58:06.082 9888 ERROR nova
Sep 28 11:58:06 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:58:06 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:58:06 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:58:06 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:58:06 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:58:06 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:58:06 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:58:06 ctl02 glance-api[29183]: 2017-09-28 11:58:06.566 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:58:06] "OPTIONS / HTTP/1.0" 200 134 0.001162
Sep 28 11:58:07 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd07eb761)
Sep 28 11:58:07 ctl02 glance-api[29183]: 2017-09-28 11:58:07.666 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:58:07] "OPTIONS / HTTP/1.0" 200 134 0.000633
Sep 28 11:58:07 ctl02 nova-api[9906]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:58:07 ctl02 nova-api[9906]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:58:08 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd07eb761)
Sep 28 11:58:08 ctl02 nova-api[9906]: 2017-09-28 11:58:08.106 9906 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:58:08 ctl02 nova-api[9906]: 2017-09-28 11:58:08.107 9906 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:58:08 ctl02 nova-api[9906]: 2017-09-28 11:58:08.107 9906 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:58:08 ctl02 nova-api[9906]: 2017-09-28 11:58:08.107 9906 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:58:08 ctl02 nova-api[9906]: 2017-09-28 11:58:08.107 9906 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:58:08 ctl02 nova-api[9906]: 2017-09-28 11:58:08.107 9906 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:58:08 ctl02 nova-api[9906]: 2017-09-28 11:58:08.107 9906 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:58:08 ctl02 nova-api[9906]: 2017-09-28 11:58:08.107 9906 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:58:08 ctl02 nova-api[9906]: 2017-09-28 11:58:08.107 9906 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:58:08 ctl02 nova-api[9906]: 2017-09-28 11:58:08.107 9906 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:58:08 ctl02 nova-api[9906]: 2017-09-28 11:58:08.107 9906 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:58:08 ctl02 nova-api[9906]: 2017-09-28 11:58:08.107 9906 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:58:08 ctl02 nova-api[9906]: 2017-09-28 11:58:08.107 9906 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:58:08 ctl02 nova-api[9906]: 2017-09-28 11:58:08.107 9906 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:58:08 ctl02 nova-api[9906]: 2017-09-28 11:58:08.107 9906 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:58:08 ctl02 nova-api[9906]: 2017-09-28 11:58:08.107 9906 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:58:08 ctl02 nova-api[9906]: 2017-09-28 11:58:08.107 9906 ERROR nova.wsgi     self.filename))
Sep 28 11:58:08 ctl02 nova-api[9906]: 2017-09-28 11:58:08.107 9906 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:58:08 ctl02 nova-api[9906]: 2017-09-28 11:58:08.107 9906 ERROR nova.wsgi
Sep 28 11:58:08 ctl02 nova-api[9906]: 2017-09-28 11:58:08.108 9906 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:58:08 ctl02 nova-api[9906]: 2017-09-28 11:58:08.241 9906 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:58:08 ctl02 nova-scheduler[5620]: 2017-09-28 11:58:08.414 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:58:08 ctl02 nova-api[9906]: 2017-09-28 11:58:08.479 9906 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:58:08 ctl02 nova-api[9906]: 2017-09-28 11:58:08.482 9906 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:58:08 ctl02 nova-api[9906]: 2017-09-28 11:58:08.482 9906 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:58:08 ctl02 nova-api[9906]: 2017-09-28 11:58:08.482 9906 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:58:08 ctl02 nova-api[9906]: 2017-09-28 11:58:08.613 9906 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:58:08 ctl02 nova-api[9906]: 2017-09-28 11:58:08.615 9906 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:58:08 ctl02 nova-api[9906]: 2017-09-28 11:58:08.615 9906 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:58:08 ctl02 nova-api[9906]: 2017-09-28 11:58:08.616 9906 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:58:08 ctl02 nova-api[9906]: 2017-09-28 11:58:08.619 9906 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:58:08 ctl02 nova-api[9906]: 2017-09-28 11:58:08.619 9906 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:58:08 ctl02 nova-api[9906]: 2017-09-28 11:58:08.619 9906 ERROR nova Traceback (most recent call last):
Sep 28 11:58:08 ctl02 nova-api[9906]: 2017-09-28 11:58:08.619 9906 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:58:08 ctl02 nova-api[9906]: 2017-09-28 11:58:08.619 9906 ERROR nova     sys.exit(main())
Sep 28 11:58:08 ctl02 nova-api[9906]: 2017-09-28 11:58:08.619 9906 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:58:08 ctl02 nova-api[9906]: 2017-09-28 11:58:08.619 9906 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:58:08 ctl02 nova-api[9906]: 2017-09-28 11:58:08.619 9906 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:58:08 ctl02 nova-api[9906]: 2017-09-28 11:58:08.619 9906 ERROR nova     max_url_len=max_url_len)
Sep 28 11:58:08 ctl02 nova-api[9906]: 2017-09-28 11:58:08.619 9906 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:58:08 ctl02 nova-api[9906]: 2017-09-28 11:58:08.619 9906 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:58:08 ctl02 nova-api[9906]: 2017-09-28 11:58:08.619 9906 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:58:08 ctl02 nova-api[9906]: 2017-09-28 11:58:08.619 9906 ERROR nova     sock.listen(backlog)
Sep 28 11:58:08 ctl02 nova-api[9906]: 2017-09-28 11:58:08.619 9906 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:58:08 ctl02 nova-api[9906]: 2017-09-28 11:58:08.619 9906 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:58:08 ctl02 nova-api[9906]: 2017-09-28 11:58:08.619 9906 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:58:08 ctl02 nova-api[9906]: 2017-09-28 11:58:08.619 9906 ERROR nova
Sep 28 11:58:08 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:58:08 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:58:08 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:58:08 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:58:08 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:58:08 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:58:08 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:58:09 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd07eb761)
Sep 28 11:58:10 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd07eb761)
Sep 28 11:58:10 ctl02 nova-api[9923]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:58:10 ctl02 nova-api[9923]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:58:10 ctl02 nova-api[9923]: 2017-09-28 11:58:10.579 9923 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:58:10 ctl02 nova-api[9923]: 2017-09-28 11:58:10.581 9923 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:58:10 ctl02 nova-api[9923]: 2017-09-28 11:58:10.581 9923 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:58:10 ctl02 nova-api[9923]: 2017-09-28 11:58:10.581 9923 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:58:10 ctl02 nova-api[9923]: 2017-09-28 11:58:10.581 9923 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:58:10 ctl02 nova-api[9923]: 2017-09-28 11:58:10.581 9923 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:58:10 ctl02 nova-api[9923]: 2017-09-28 11:58:10.581 9923 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:58:10 ctl02 nova-api[9923]: 2017-09-28 11:58:10.581 9923 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:58:10 ctl02 nova-api[9923]: 2017-09-28 11:58:10.581 9923 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:58:10 ctl02 nova-api[9923]: 2017-09-28 11:58:10.581 9923 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:58:10 ctl02 nova-api[9923]: 2017-09-28 11:58:10.581 9923 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:58:10 ctl02 nova-api[9923]: 2017-09-28 11:58:10.581 9923 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:58:10 ctl02 nova-api[9923]: 2017-09-28 11:58:10.581 9923 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:58:10 ctl02 nova-api[9923]: 2017-09-28 11:58:10.581 9923 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:58:10 ctl02 nova-api[9923]: 2017-09-28 11:58:10.581 9923 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:58:10 ctl02 nova-api[9923]: 2017-09-28 11:58:10.581 9923 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:58:10 ctl02 nova-api[9923]: 2017-09-28 11:58:10.581 9923 ERROR nova.wsgi     self.filename))
Sep 28 11:58:10 ctl02 nova-api[9923]: 2017-09-28 11:58:10.581 9923 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:58:10 ctl02 nova-api[9923]: 2017-09-28 11:58:10.581 9923 ERROR nova.wsgi
Sep 28 11:58:10 ctl02 nova-api[9923]: 2017-09-28 11:58:10.582 9923 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:58:10 ctl02 nova-api[9923]: 2017-09-28 11:58:10.713 9923 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:58:10 ctl02 nova-api[9923]: 2017-09-28 11:58:10.955 9923 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:58:10 ctl02 nova-api[9923]: 2017-09-28 11:58:10.957 9923 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:58:10 ctl02 nova-api[9923]: 2017-09-28 11:58:10.957 9923 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:58:10 ctl02 nova-api[9923]: 2017-09-28 11:58:10.958 9923 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:58:11 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:58:11 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:58:11 ctl02 nova-api[9923]: 2017-09-28 11:58:11.088 9923 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:58:11 ctl02 nova-api[9923]: 2017-09-28 11:58:11.090 9923 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:58:11 ctl02 nova-api[9923]: 2017-09-28 11:58:11.090 9923 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:58:11 ctl02 nova-api[9923]: 2017-09-28 11:58:11.090 9923 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:58:11 ctl02 nova-api[9923]: 2017-09-28 11:58:11.094 9923 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:58:11 ctl02 nova-api[9923]: 2017-09-28 11:58:11.094 9923 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:58:11 ctl02 nova-api[9923]: 2017-09-28 11:58:11.094 9923 ERROR nova Traceback (most recent call last):
Sep 28 11:58:11 ctl02 nova-api[9923]: 2017-09-28 11:58:11.094 9923 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:58:11 ctl02 nova-api[9923]: 2017-09-28 11:58:11.094 9923 ERROR nova     sys.exit(main())
Sep 28 11:58:11 ctl02 nova-api[9923]: 2017-09-28 11:58:11.094 9923 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:58:11 ctl02 nova-api[9923]: 2017-09-28 11:58:11.094 9923 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:58:11 ctl02 nova-api[9923]: 2017-09-28 11:58:11.094 9923 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:58:11 ctl02 nova-api[9923]: 2017-09-28 11:58:11.094 9923 ERROR nova     max_url_len=max_url_len)
Sep 28 11:58:11 ctl02 nova-api[9923]: 2017-09-28 11:58:11.094 9923 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:58:11 ctl02 nova-api[9923]: 2017-09-28 11:58:11.094 9923 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:58:11 ctl02 nova-api[9923]: 2017-09-28 11:58:11.094 9923 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:58:11 ctl02 nova-api[9923]: 2017-09-28 11:58:11.094 9923 ERROR nova     sock.listen(backlog)
Sep 28 11:58:11 ctl02 nova-api[9923]: 2017-09-28 11:58:11.094 9923 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:58:11 ctl02 nova-api[9923]: 2017-09-28 11:58:11.094 9923 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:58:11 ctl02 nova-api[9923]: 2017-09-28 11:58:11.094 9923 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:58:11 ctl02 nova-api[9923]: 2017-09-28 11:58:11.094 9923 ERROR nova
Sep 28 11:58:11 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:58:11 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:58:11 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:58:11 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:58:11 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:58:11 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:58:11 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:58:12 ctl02 nova-api[9947]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:58:12 ctl02 nova-api[9947]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:58:13 ctl02 nova-api[9947]: 2017-09-28 11:58:13.114 9947 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:58:13 ctl02 nova-api[9947]: 2017-09-28 11:58:13.136 9947 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:58:13 ctl02 nova-api[9947]: 2017-09-28 11:58:13.136 9947 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:58:13 ctl02 nova-api[9947]: 2017-09-28 11:58:13.136 9947 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:58:13 ctl02 nova-api[9947]: 2017-09-28 11:58:13.136 9947 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:58:13 ctl02 nova-api[9947]: 2017-09-28 11:58:13.136 9947 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:58:13 ctl02 nova-api[9947]: 2017-09-28 11:58:13.136 9947 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:58:13 ctl02 nova-api[9947]: 2017-09-28 11:58:13.136 9947 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:58:13 ctl02 nova-api[9947]: 2017-09-28 11:58:13.136 9947 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:58:13 ctl02 nova-api[9947]: 2017-09-28 11:58:13.136 9947 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:58:13 ctl02 nova-api[9947]: 2017-09-28 11:58:13.136 9947 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:58:13 ctl02 nova-api[9947]: 2017-09-28 11:58:13.136 9947 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:58:13 ctl02 nova-api[9947]: 2017-09-28 11:58:13.136 9947 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:58:13 ctl02 nova-api[9947]: 2017-09-28 11:58:13.136 9947 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:58:13 ctl02 nova-api[9947]: 2017-09-28 11:58:13.136 9947 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:58:13 ctl02 nova-api[9947]: 2017-09-28 11:58:13.136 9947 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:58:13 ctl02 nova-api[9947]: 2017-09-28 11:58:13.136 9947 ERROR nova.wsgi     self.filename))
Sep 28 11:58:13 ctl02 nova-api[9947]: 2017-09-28 11:58:13.136 9947 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:58:13 ctl02 nova-api[9947]: 2017-09-28 11:58:13.136 9947 ERROR nova.wsgi
Sep 28 11:58:13 ctl02 nova-api[9947]: 2017-09-28 11:58:13.138 9947 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:58:13 ctl02 nova-api[9947]: 2017-09-28 11:58:13.275 9947 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:58:13 ctl02 nova-api[9947]: 2017-09-28 11:58:13.518 9947 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:58:13 ctl02 nova-api[9947]: 2017-09-28 11:58:13.521 9947 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:58:13 ctl02 nova-api[9947]: 2017-09-28 11:58:13.522 9947 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:58:13 ctl02 nova-api[9947]: 2017-09-28 11:58:13.522 9947 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:58:13 ctl02 nova-api[9947]: 2017-09-28 11:58:13.654 9947 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:58:13 ctl02 nova-api[9947]: 2017-09-28 11:58:13.656 9947 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:58:13 ctl02 nova-api[9947]: 2017-09-28 11:58:13.657 9947 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:58:13 ctl02 nova-api[9947]: 2017-09-28 11:58:13.657 9947 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:58:13 ctl02 nova-api[9947]: 2017-09-28 11:58:13.660 9947 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:58:13 ctl02 nova-api[9947]: 2017-09-28 11:58:13.661 9947 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:58:13 ctl02 nova-api[9947]: 2017-09-28 11:58:13.661 9947 ERROR nova Traceback (most recent call last):
Sep 28 11:58:13 ctl02 nova-api[9947]: 2017-09-28 11:58:13.661 9947 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:58:13 ctl02 nova-api[9947]: 2017-09-28 11:58:13.661 9947 ERROR nova     sys.exit(main())
Sep 28 11:58:13 ctl02 nova-api[9947]: 2017-09-28 11:58:13.661 9947 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:58:13 ctl02 nova-api[9947]: 2017-09-28 11:58:13.661 9947 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:58:13 ctl02 nova-api[9947]: 2017-09-28 11:58:13.661 9947 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:58:13 ctl02 nova-api[9947]: 2017-09-28 11:58:13.661 9947 ERROR nova     max_url_len=max_url_len)
Sep 28 11:58:13 ctl02 nova-api[9947]: 2017-09-28 11:58:13.661 9947 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:58:13 ctl02 nova-api[9947]: 2017-09-28 11:58:13.661 9947 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:58:13 ctl02 nova-api[9947]: 2017-09-28 11:58:13.661 9947 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:58:13 ctl02 nova-api[9947]: 2017-09-28 11:58:13.661 9947 ERROR nova     sock.listen(backlog)
Sep 28 11:58:13 ctl02 nova-api[9947]: 2017-09-28 11:58:13.661 9947 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:58:13 ctl02 nova-api[9947]: 2017-09-28 11:58:13.661 9947 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:58:13 ctl02 nova-api[9947]: 2017-09-28 11:58:13.661 9947 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:58:13 ctl02 nova-api[9947]: 2017-09-28 11:58:13.661 9947 ERROR nova
Sep 28 11:58:13 ctl02 glance-api[29183]: 2017-09-28 11:58:13.696 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:58:13] "OPTIONS / HTTP/1.0" 200 134 0.000985
Sep 28 11:58:13 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:58:13 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:58:13 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:58:14 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:58:14 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:58:14 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:58:14 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:58:15 ctl02 nova-api[9965]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:58:15 ctl02 nova-api[9965]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:58:15 ctl02 nova-api[9965]: 2017-09-28 11:58:15.875 9965 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:58:15 ctl02 nova-api[9965]: 2017-09-28 11:58:15.877 9965 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:58:15 ctl02 nova-api[9965]: 2017-09-28 11:58:15.877 9965 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:58:15 ctl02 nova-api[9965]: 2017-09-28 11:58:15.877 9965 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:58:15 ctl02 nova-api[9965]: 2017-09-28 11:58:15.877 9965 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:58:15 ctl02 nova-api[9965]: 2017-09-28 11:58:15.877 9965 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:58:15 ctl02 nova-api[9965]: 2017-09-28 11:58:15.877 9965 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:58:15 ctl02 nova-api[9965]: 2017-09-28 11:58:15.877 9965 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:58:15 ctl02 nova-api[9965]: 2017-09-28 11:58:15.877 9965 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:58:15 ctl02 nova-api[9965]: 2017-09-28 11:58:15.877 9965 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:58:15 ctl02 nova-api[9965]: 2017-09-28 11:58:15.877 9965 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:58:15 ctl02 nova-api[9965]: 2017-09-28 11:58:15.877 9965 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:58:15 ctl02 nova-api[9965]: 2017-09-28 11:58:15.877 9965 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:58:15 ctl02 nova-api[9965]: 2017-09-28 11:58:15.877 9965 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:58:15 ctl02 nova-api[9965]: 2017-09-28 11:58:15.877 9965 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:58:15 ctl02 nova-api[9965]: 2017-09-28 11:58:15.877 9965 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:58:15 ctl02 nova-api[9965]: 2017-09-28 11:58:15.877 9965 ERROR nova.wsgi     self.filename))
Sep 28 11:58:15 ctl02 nova-api[9965]: 2017-09-28 11:58:15.877 9965 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:58:15 ctl02 nova-api[9965]: 2017-09-28 11:58:15.877 9965 ERROR nova.wsgi
Sep 28 11:58:15 ctl02 nova-api[9965]: 2017-09-28 11:58:15.878 9965 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:58:16 ctl02 nova-api[9965]: 2017-09-28 11:58:16.013 9965 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:58:16 ctl02 nova-api[9965]: 2017-09-28 11:58:16.259 9965 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:58:16 ctl02 nova-api[9965]: 2017-09-28 11:58:16.261 9965 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:58:16 ctl02 nova-api[9965]: 2017-09-28 11:58:16.262 9965 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:58:16 ctl02 nova-api[9965]: 2017-09-28 11:58:16.262 9965 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:58:16 ctl02 glance-api[29183]: 2017-09-28 11:58:16.298 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:58:16] "OPTIONS / HTTP/1.0" 200 134 0.000678
Sep 28 11:58:16 ctl02 nova-api[9965]: 2017-09-28 11:58:16.401 9965 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:58:16 ctl02 nova-api[9965]: 2017-09-28 11:58:16.403 9965 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:58:16 ctl02 nova-api[9965]: 2017-09-28 11:58:16.403 9965 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:58:16 ctl02 nova-api[9965]: 2017-09-28 11:58:16.403 9965 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:58:16 ctl02 nova-api[9965]: 2017-09-28 11:58:16.407 9965 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:58:16 ctl02 nova-api[9965]: 2017-09-28 11:58:16.407 9965 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:58:16 ctl02 nova-api[9965]: 2017-09-28 11:58:16.407 9965 ERROR nova Traceback (most recent call last):
Sep 28 11:58:16 ctl02 nova-api[9965]: 2017-09-28 11:58:16.407 9965 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:58:16 ctl02 nova-api[9965]: 2017-09-28 11:58:16.407 9965 ERROR nova     sys.exit(main())
Sep 28 11:58:16 ctl02 nova-api[9965]: 2017-09-28 11:58:16.407 9965 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:58:16 ctl02 nova-api[9965]: 2017-09-28 11:58:16.407 9965 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:58:16 ctl02 nova-api[9965]: 2017-09-28 11:58:16.407 9965 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:58:16 ctl02 nova-api[9965]: 2017-09-28 11:58:16.407 9965 ERROR nova     max_url_len=max_url_len)
Sep 28 11:58:16 ctl02 nova-api[9965]: 2017-09-28 11:58:16.407 9965 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:58:16 ctl02 nova-api[9965]: 2017-09-28 11:58:16.407 9965 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:58:16 ctl02 nova-api[9965]: 2017-09-28 11:58:16.407 9965 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:58:16 ctl02 nova-api[9965]: 2017-09-28 11:58:16.407 9965 ERROR nova     sock.listen(backlog)
Sep 28 11:58:16 ctl02 nova-api[9965]: 2017-09-28 11:58:16.407 9965 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:58:16 ctl02 nova-api[9965]: 2017-09-28 11:58:16.407 9965 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:58:16 ctl02 nova-api[9965]: 2017-09-28 11:58:16.407 9965 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:58:16 ctl02 nova-api[9965]: 2017-09-28 11:58:16.407 9965 ERROR nova
Sep 28 11:58:16 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:58:16 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:58:16 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:58:16 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:58:16 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:58:16 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:58:16 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:58:17 ctl02 glance-api[29183]: 2017-09-28 11:58:17.696 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:58:17] "OPTIONS / HTTP/1.0" 200 134 0.000711
Sep 28 11:58:18 ctl02 nova-api[9982]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:58:18 ctl02 nova-api[9982]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:58:18 ctl02 nova-api[9982]: 2017-09-28 11:58:18.596 9982 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:58:18 ctl02 nova-api[9982]: 2017-09-28 11:58:18.597 9982 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:58:18 ctl02 nova-api[9982]: 2017-09-28 11:58:18.597 9982 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:58:18 ctl02 nova-api[9982]: 2017-09-28 11:58:18.597 9982 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:58:18 ctl02 nova-api[9982]: 2017-09-28 11:58:18.597 9982 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:58:18 ctl02 nova-api[9982]: 2017-09-28 11:58:18.597 9982 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:58:18 ctl02 nova-api[9982]: 2017-09-28 11:58:18.597 9982 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:58:18 ctl02 nova-api[9982]: 2017-09-28 11:58:18.597 9982 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:58:18 ctl02 nova-api[9982]: 2017-09-28 11:58:18.597 9982 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:58:18 ctl02 nova-api[9982]: 2017-09-28 11:58:18.597 9982 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:58:18 ctl02 nova-api[9982]: 2017-09-28 11:58:18.597 9982 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:58:18 ctl02 nova-api[9982]: 2017-09-28 11:58:18.597 9982 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:58:18 ctl02 nova-api[9982]: 2017-09-28 11:58:18.597 9982 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:58:18 ctl02 nova-api[9982]: 2017-09-28 11:58:18.597 9982 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:58:18 ctl02 nova-api[9982]: 2017-09-28 11:58:18.597 9982 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:58:18 ctl02 nova-api[9982]: 2017-09-28 11:58:18.597 9982 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:58:18 ctl02 nova-api[9982]: 2017-09-28 11:58:18.597 9982 ERROR nova.wsgi     self.filename))
Sep 28 11:58:18 ctl02 nova-api[9982]: 2017-09-28 11:58:18.597 9982 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:58:18 ctl02 nova-api[9982]: 2017-09-28 11:58:18.597 9982 ERROR nova.wsgi
Sep 28 11:58:18 ctl02 nova-api[9982]: 2017-09-28 11:58:18.598 9982 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:58:18 ctl02 nova-api[9982]: 2017-09-28 11:58:18.731 9982 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:58:18 ctl02 nova-api[9982]: 2017-09-28 11:58:18.970 9982 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:58:18 ctl02 nova-api[9982]: 2017-09-28 11:58:18.973 9982 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:58:18 ctl02 nova-api[9982]: 2017-09-28 11:58:18.973 9982 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:58:18 ctl02 nova-api[9982]: 2017-09-28 11:58:18.973 9982 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:58:19 ctl02 nova-api[9982]: 2017-09-28 11:58:19.104 9982 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:58:19 ctl02 nova-api[9982]: 2017-09-28 11:58:19.106 9982 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:58:19 ctl02 nova-api[9982]: 2017-09-28 11:58:19.106 9982 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:58:19 ctl02 nova-api[9982]: 2017-09-28 11:58:19.106 9982 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:58:19 ctl02 nova-api[9982]: 2017-09-28 11:58:19.110 9982 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:58:19 ctl02 nova-api[9982]: 2017-09-28 11:58:19.110 9982 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:58:19 ctl02 nova-api[9982]: 2017-09-28 11:58:19.110 9982 ERROR nova Traceback (most recent call last):
Sep 28 11:58:19 ctl02 nova-api[9982]: 2017-09-28 11:58:19.110 9982 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:58:19 ctl02 nova-api[9982]: 2017-09-28 11:58:19.110 9982 ERROR nova     sys.exit(main())
Sep 28 11:58:19 ctl02 nova-api[9982]: 2017-09-28 11:58:19.110 9982 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:58:19 ctl02 nova-api[9982]: 2017-09-28 11:58:19.110 9982 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:58:19 ctl02 nova-api[9982]: 2017-09-28 11:58:19.110 9982 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:58:19 ctl02 nova-api[9982]: 2017-09-28 11:58:19.110 9982 ERROR nova     max_url_len=max_url_len)
Sep 28 11:58:19 ctl02 nova-api[9982]: 2017-09-28 11:58:19.110 9982 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:58:19 ctl02 nova-api[9982]: 2017-09-28 11:58:19.110 9982 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:58:19 ctl02 nova-api[9982]: 2017-09-28 11:58:19.110 9982 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:58:19 ctl02 nova-api[9982]: 2017-09-28 11:58:19.110 9982 ERROR nova     sock.listen(backlog)
Sep 28 11:58:19 ctl02 nova-api[9982]: 2017-09-28 11:58:19.110 9982 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:58:19 ctl02 nova-api[9982]: 2017-09-28 11:58:19.110 9982 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:58:19 ctl02 nova-api[9982]: 2017-09-28 11:58:19.110 9982 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:58:19 ctl02 nova-api[9982]: 2017-09-28 11:58:19.110 9982 ERROR nova
Sep 28 11:58:19 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:58:19 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:58:19 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:58:19 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:58:19 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:58:19 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:58:19 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:58:20 ctl02 nova-api[10001]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:58:20 ctl02 nova-api[10001]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:58:21 ctl02 nova-api[10001]: 2017-09-28 11:58:21.108 10001 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:58:21 ctl02 nova-api[10001]: 2017-09-28 11:58:21.109 10001 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:58:21 ctl02 nova-api[10001]: 2017-09-28 11:58:21.109 10001 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:58:21 ctl02 nova-api[10001]: 2017-09-28 11:58:21.109 10001 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:58:21 ctl02 nova-api[10001]: 2017-09-28 11:58:21.109 10001 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:58:21 ctl02 nova-api[10001]: 2017-09-28 11:58:21.109 10001 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:58:21 ctl02 nova-api[10001]: 2017-09-28 11:58:21.109 10001 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:58:21 ctl02 nova-api[10001]: 2017-09-28 11:58:21.109 10001 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:58:21 ctl02 nova-api[10001]: 2017-09-28 11:58:21.109 10001 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:58:21 ctl02 nova-api[10001]: 2017-09-28 11:58:21.109 10001 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:58:21 ctl02 nova-api[10001]: 2017-09-28 11:58:21.109 10001 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:58:21 ctl02 nova-api[10001]: 2017-09-28 11:58:21.109 10001 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:58:21 ctl02 nova-api[10001]: 2017-09-28 11:58:21.109 10001 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:58:21 ctl02 nova-api[10001]: 2017-09-28 11:58:21.109 10001 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:58:21 ctl02 nova-api[10001]: 2017-09-28 11:58:21.109 10001 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:58:21 ctl02 nova-api[10001]: 2017-09-28 11:58:21.109 10001 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:58:21 ctl02 nova-api[10001]: 2017-09-28 11:58:21.109 10001 ERROR nova.wsgi     self.filename))
Sep 28 11:58:21 ctl02 nova-api[10001]: 2017-09-28 11:58:21.109 10001 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:58:21 ctl02 nova-api[10001]: 2017-09-28 11:58:21.109 10001 ERROR nova.wsgi
Sep 28 11:58:21 ctl02 nova-api[10001]: 2017-09-28 11:58:21.110 10001 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:58:21 ctl02 nova-api[10001]: 2017-09-28 11:58:21.242 10001 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:58:21 ctl02 nova-api[10001]: 2017-09-28 11:58:21.489 10001 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:58:21 ctl02 nova-api[10001]: 2017-09-28 11:58:21.491 10001 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:58:21 ctl02 nova-api[10001]: 2017-09-28 11:58:21.491 10001 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:58:21 ctl02 nova-api[10001]: 2017-09-28 11:58:21.492 10001 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:58:21 ctl02 nova-api[10001]: 2017-09-28 11:58:21.623 10001 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:58:21 ctl02 nova-api[10001]: 2017-09-28 11:58:21.625 10001 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:58:21 ctl02 nova-api[10001]: 2017-09-28 11:58:21.625 10001 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:58:21 ctl02 nova-api[10001]: 2017-09-28 11:58:21.626 10001 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:58:21 ctl02 nova-api[10001]: 2017-09-28 11:58:21.629 10001 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:58:21 ctl02 nova-api[10001]: 2017-09-28 11:58:21.629 10001 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:58:21 ctl02 nova-api[10001]: 2017-09-28 11:58:21.629 10001 ERROR nova Traceback (most recent call last):
Sep 28 11:58:21 ctl02 nova-api[10001]: 2017-09-28 11:58:21.629 10001 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:58:21 ctl02 nova-api[10001]: 2017-09-28 11:58:21.629 10001 ERROR nova     sys.exit(main())
Sep 28 11:58:21 ctl02 nova-api[10001]: 2017-09-28 11:58:21.629 10001 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:58:21 ctl02 nova-api[10001]: 2017-09-28 11:58:21.629 10001 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:58:21 ctl02 nova-api[10001]: 2017-09-28 11:58:21.629 10001 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:58:21 ctl02 nova-api[10001]: 2017-09-28 11:58:21.629 10001 ERROR nova     max_url_len=max_url_len)
Sep 28 11:58:21 ctl02 nova-api[10001]: 2017-09-28 11:58:21.629 10001 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:58:21 ctl02 nova-api[10001]: 2017-09-28 11:58:21.629 10001 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:58:21 ctl02 nova-api[10001]: 2017-09-28 11:58:21.629 10001 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:58:21 ctl02 nova-api[10001]: 2017-09-28 11:58:21.629 10001 ERROR nova     sock.listen(backlog)
Sep 28 11:58:21 ctl02 nova-api[10001]: 2017-09-28 11:58:21.629 10001 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:58:21 ctl02 nova-api[10001]: 2017-09-28 11:58:21.629 10001 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:58:21 ctl02 nova-api[10001]: 2017-09-28 11:58:21.629 10001 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:58:21 ctl02 nova-api[10001]: 2017-09-28 11:58:21.629 10001 ERROR nova
Sep 28 11:58:21 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:58:21 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:58:21 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:58:22 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:58:22 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:58:22 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:58:22 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:58:23 ctl02 glance-api[29183]: 2017-09-28 11:58:23.567 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:58:23] "OPTIONS / HTTP/1.0" 200 134 0.000760
Sep 28 11:58:23 ctl02 nova-api[10019]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:58:23 ctl02 nova-api[10019]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:58:23 ctl02 nova-api[10019]: 2017-09-28 11:58:23.822 10019 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:58:23 ctl02 nova-api[10019]: 2017-09-28 11:58:23.823 10019 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:58:23 ctl02 nova-api[10019]: 2017-09-28 11:58:23.823 10019 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:58:23 ctl02 nova-api[10019]: 2017-09-28 11:58:23.823 10019 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:58:23 ctl02 nova-api[10019]: 2017-09-28 11:58:23.823 10019 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:58:23 ctl02 nova-api[10019]: 2017-09-28 11:58:23.823 10019 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:58:23 ctl02 nova-api[10019]: 2017-09-28 11:58:23.823 10019 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:58:23 ctl02 nova-api[10019]: 2017-09-28 11:58:23.823 10019 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:58:23 ctl02 nova-api[10019]: 2017-09-28 11:58:23.823 10019 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:58:23 ctl02 nova-api[10019]: 2017-09-28 11:58:23.823 10019 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:58:23 ctl02 nova-api[10019]: 2017-09-28 11:58:23.823 10019 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:58:23 ctl02 nova-api[10019]: 2017-09-28 11:58:23.823 10019 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:58:23 ctl02 nova-api[10019]: 2017-09-28 11:58:23.823 10019 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:58:23 ctl02 nova-api[10019]: 2017-09-28 11:58:23.823 10019 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:58:23 ctl02 nova-api[10019]: 2017-09-28 11:58:23.823 10019 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:58:23 ctl02 nova-api[10019]: 2017-09-28 11:58:23.823 10019 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:58:23 ctl02 nova-api[10019]: 2017-09-28 11:58:23.823 10019 ERROR nova.wsgi     self.filename))
Sep 28 11:58:23 ctl02 nova-api[10019]: 2017-09-28 11:58:23.823 10019 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:58:23 ctl02 nova-api[10019]: 2017-09-28 11:58:23.823 10019 ERROR nova.wsgi
Sep 28 11:58:23 ctl02 nova-api[10019]: 2017-09-28 11:58:23.824 10019 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:58:23 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfc3acf5b)
Sep 28 11:58:23 ctl02 nova-api[10019]: 2017-09-28 11:58:23.954 10019 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:58:24 ctl02 nova-api[10019]: 2017-09-28 11:58:24.187 10019 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:58:24 ctl02 nova-api[10019]: 2017-09-28 11:58:24.189 10019 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:58:24 ctl02 nova-api[10019]: 2017-09-28 11:58:24.189 10019 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:58:24 ctl02 nova-api[10019]: 2017-09-28 11:58:24.190 10019 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:58:24 ctl02 nova-api[10019]: 2017-09-28 11:58:24.320 10019 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:58:24 ctl02 nova-api[10019]: 2017-09-28 11:58:24.322 10019 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:58:24 ctl02 nova-api[10019]: 2017-09-28 11:58:24.322 10019 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:58:24 ctl02 nova-api[10019]: 2017-09-28 11:58:24.322 10019 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:58:24 ctl02 nova-api[10019]: 2017-09-28 11:58:24.325 10019 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:58:24 ctl02 nova-api[10019]: 2017-09-28 11:58:24.326 10019 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:58:24 ctl02 nova-api[10019]: 2017-09-28 11:58:24.326 10019 ERROR nova Traceback (most recent call last):
Sep 28 11:58:24 ctl02 nova-api[10019]: 2017-09-28 11:58:24.326 10019 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:58:24 ctl02 nova-api[10019]: 2017-09-28 11:58:24.326 10019 ERROR nova     sys.exit(main())
Sep 28 11:58:24 ctl02 nova-api[10019]: 2017-09-28 11:58:24.326 10019 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:58:24 ctl02 nova-api[10019]: 2017-09-28 11:58:24.326 10019 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:58:24 ctl02 nova-api[10019]: 2017-09-28 11:58:24.326 10019 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:58:24 ctl02 nova-api[10019]: 2017-09-28 11:58:24.326 10019 ERROR nova     max_url_len=max_url_len)
Sep 28 11:58:24 ctl02 nova-api[10019]: 2017-09-28 11:58:24.326 10019 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:58:24 ctl02 nova-api[10019]: 2017-09-28 11:58:24.326 10019 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:58:24 ctl02 nova-api[10019]: 2017-09-28 11:58:24.326 10019 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:58:24 ctl02 nova-api[10019]: 2017-09-28 11:58:24.326 10019 ERROR nova     sock.listen(backlog)
Sep 28 11:58:24 ctl02 nova-api[10019]: 2017-09-28 11:58:24.326 10019 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:58:24 ctl02 nova-api[10019]: 2017-09-28 11:58:24.326 10019 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:58:24 ctl02 nova-api[10019]: 2017-09-28 11:58:24.326 10019 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:58:24 ctl02 nova-api[10019]: 2017-09-28 11:58:24.326 10019 ERROR nova
Sep 28 11:58:24 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:58:24 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:58:24 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:58:24 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:58:24 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:58:24 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:58:24 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:58:24 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfc3acf5b)
Sep 28 11:58:25 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfc3acf5b)
Sep 28 11:58:26 ctl02 glance-api[29183]: 2017-09-28 11:58:26.172 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:58:26] "OPTIONS / HTTP/1.0" 200 134 0.000602
Sep 28 11:58:26 ctl02 nova-api[10037]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:58:26 ctl02 nova-api[10037]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:58:26 ctl02 nova-api[10037]: 2017-09-28 11:58:26.385 10037 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:58:26 ctl02 nova-api[10037]: 2017-09-28 11:58:26.386 10037 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:58:26 ctl02 nova-api[10037]: 2017-09-28 11:58:26.386 10037 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:58:26 ctl02 nova-api[10037]: 2017-09-28 11:58:26.386 10037 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:58:26 ctl02 nova-api[10037]: 2017-09-28 11:58:26.386 10037 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:58:26 ctl02 nova-api[10037]: 2017-09-28 11:58:26.386 10037 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:58:26 ctl02 nova-api[10037]: 2017-09-28 11:58:26.386 10037 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:58:26 ctl02 nova-api[10037]: 2017-09-28 11:58:26.386 10037 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:58:26 ctl02 nova-api[10037]: 2017-09-28 11:58:26.386 10037 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:58:26 ctl02 nova-api[10037]: 2017-09-28 11:58:26.386 10037 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:58:26 ctl02 nova-api[10037]: 2017-09-28 11:58:26.386 10037 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:58:26 ctl02 nova-api[10037]: 2017-09-28 11:58:26.386 10037 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:58:26 ctl02 nova-api[10037]: 2017-09-28 11:58:26.386 10037 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:58:26 ctl02 nova-api[10037]: 2017-09-28 11:58:26.386 10037 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:58:26 ctl02 nova-api[10037]: 2017-09-28 11:58:26.386 10037 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:58:26 ctl02 nova-api[10037]: 2017-09-28 11:58:26.386 10037 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:58:26 ctl02 nova-api[10037]: 2017-09-28 11:58:26.386 10037 ERROR nova.wsgi     self.filename))
Sep 28 11:58:26 ctl02 nova-api[10037]: 2017-09-28 11:58:26.386 10037 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:58:26 ctl02 nova-api[10037]: 2017-09-28 11:58:26.386 10037 ERROR nova.wsgi
Sep 28 11:58:26 ctl02 nova-api[10037]: 2017-09-28 11:58:26.387 10037 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:58:26 ctl02 nova-api[10037]: 2017-09-28 11:58:26.517 10037 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:58:26 ctl02 nova-api[10037]: 2017-09-28 11:58:26.754 10037 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:58:26 ctl02 nova-api[10037]: 2017-09-28 11:58:26.756 10037 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:58:26 ctl02 nova-api[10037]: 2017-09-28 11:58:26.756 10037 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:58:26 ctl02 nova-api[10037]: 2017-09-28 11:58:26.757 10037 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:58:26 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfc3acf5b)
Sep 28 11:58:26 ctl02 nova-api[10037]: 2017-09-28 11:58:26.885 10037 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:58:26 ctl02 nova-api[10037]: 2017-09-28 11:58:26.887 10037 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:58:26 ctl02 nova-api[10037]: 2017-09-28 11:58:26.888 10037 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:58:26 ctl02 nova-api[10037]: 2017-09-28 11:58:26.888 10037 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:58:26 ctl02 nova-api[10037]: 2017-09-28 11:58:26.891 10037 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:58:26 ctl02 nova-api[10037]: 2017-09-28 11:58:26.892 10037 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:58:26 ctl02 nova-api[10037]: 2017-09-28 11:58:26.892 10037 ERROR nova Traceback (most recent call last):
Sep 28 11:58:26 ctl02 nova-api[10037]: 2017-09-28 11:58:26.892 10037 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:58:26 ctl02 nova-api[10037]: 2017-09-28 11:58:26.892 10037 ERROR nova     sys.exit(main())
Sep 28 11:58:26 ctl02 nova-api[10037]: 2017-09-28 11:58:26.892 10037 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:58:26 ctl02 nova-api[10037]: 2017-09-28 11:58:26.892 10037 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:58:26 ctl02 nova-api[10037]: 2017-09-28 11:58:26.892 10037 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:58:26 ctl02 nova-api[10037]: 2017-09-28 11:58:26.892 10037 ERROR nova     max_url_len=max_url_len)
Sep 28 11:58:26 ctl02 nova-api[10037]: 2017-09-28 11:58:26.892 10037 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:58:26 ctl02 nova-api[10037]: 2017-09-28 11:58:26.892 10037 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:58:26 ctl02 nova-api[10037]: 2017-09-28 11:58:26.892 10037 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:58:26 ctl02 nova-api[10037]: 2017-09-28 11:58:26.892 10037 ERROR nova     sock.listen(backlog)
Sep 28 11:58:26 ctl02 nova-api[10037]: 2017-09-28 11:58:26.892 10037 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:58:26 ctl02 nova-api[10037]: 2017-09-28 11:58:26.892 10037 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:58:26 ctl02 nova-api[10037]: 2017-09-28 11:58:26.892 10037 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:58:26 ctl02 nova-api[10037]: 2017-09-28 11:58:26.892 10037 ERROR nova
Sep 28 11:58:27 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:58:27 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:58:27 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:58:27 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:58:27 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:58:27 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:58:27 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:58:27 ctl02 nova-cert[4860]: 2017-09-28 11:58:27.543 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:58:27 ctl02 glance-api[29183]: 2017-09-28 11:58:27.794 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:58:27] "OPTIONS / HTTP/1.0" 200 134 0.000651
Sep 28 11:58:27 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfc3acf5b)
Sep 28 11:58:28 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfc3acf5b)
Sep 28 11:58:28 ctl02 nova-api[10055]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:58:28 ctl02 nova-api[10055]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:58:29 ctl02 nova-api[10055]: 2017-09-28 11:58:29.058 10055 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:58:29 ctl02 nova-api[10055]: 2017-09-28 11:58:29.060 10055 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:58:29 ctl02 nova-api[10055]: 2017-09-28 11:58:29.060 10055 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:58:29 ctl02 nova-api[10055]: 2017-09-28 11:58:29.060 10055 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:58:29 ctl02 nova-api[10055]: 2017-09-28 11:58:29.060 10055 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:58:29 ctl02 nova-api[10055]: 2017-09-28 11:58:29.060 10055 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:58:29 ctl02 nova-api[10055]: 2017-09-28 11:58:29.060 10055 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:58:29 ctl02 nova-api[10055]: 2017-09-28 11:58:29.060 10055 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:58:29 ctl02 nova-api[10055]: 2017-09-28 11:58:29.060 10055 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:58:29 ctl02 nova-api[10055]: 2017-09-28 11:58:29.060 10055 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:58:29 ctl02 nova-api[10055]: 2017-09-28 11:58:29.060 10055 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:58:29 ctl02 nova-api[10055]: 2017-09-28 11:58:29.060 10055 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:58:29 ctl02 nova-api[10055]: 2017-09-28 11:58:29.060 10055 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:58:29 ctl02 nova-api[10055]: 2017-09-28 11:58:29.060 10055 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:58:29 ctl02 nova-api[10055]: 2017-09-28 11:58:29.060 10055 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:58:29 ctl02 nova-api[10055]: 2017-09-28 11:58:29.060 10055 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:58:29 ctl02 nova-api[10055]: 2017-09-28 11:58:29.060 10055 ERROR nova.wsgi     self.filename))
Sep 28 11:58:29 ctl02 nova-api[10055]: 2017-09-28 11:58:29.060 10055 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:58:29 ctl02 nova-api[10055]: 2017-09-28 11:58:29.060 10055 ERROR nova.wsgi
Sep 28 11:58:29 ctl02 nova-api[10055]: 2017-09-28 11:58:29.061 10055 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:58:29 ctl02 nova-api[10055]: 2017-09-28 11:58:29.189 10055 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:58:29 ctl02 nova-api[10055]: 2017-09-28 11:58:29.423 10055 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:58:29 ctl02 nova-api[10055]: 2017-09-28 11:58:29.425 10055 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:58:29 ctl02 nova-api[10055]: 2017-09-28 11:58:29.425 10055 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:58:29 ctl02 nova-api[10055]: 2017-09-28 11:58:29.425 10055 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:58:29 ctl02 nova-api[10055]: 2017-09-28 11:58:29.554 10055 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:58:29 ctl02 nova-api[10055]: 2017-09-28 11:58:29.556 10055 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:58:29 ctl02 nova-api[10055]: 2017-09-28 11:58:29.556 10055 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:58:29 ctl02 nova-api[10055]: 2017-09-28 11:58:29.557 10055 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:58:29 ctl02 nova-api[10055]: 2017-09-28 11:58:29.560 10055 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:58:29 ctl02 nova-api[10055]: 2017-09-28 11:58:29.560 10055 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:58:29 ctl02 nova-api[10055]: 2017-09-28 11:58:29.560 10055 ERROR nova Traceback (most recent call last):
Sep 28 11:58:29 ctl02 nova-api[10055]: 2017-09-28 11:58:29.560 10055 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:58:29 ctl02 nova-api[10055]: 2017-09-28 11:58:29.560 10055 ERROR nova     sys.exit(main())
Sep 28 11:58:29 ctl02 nova-api[10055]: 2017-09-28 11:58:29.560 10055 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:58:29 ctl02 nova-api[10055]: 2017-09-28 11:58:29.560 10055 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:58:29 ctl02 nova-api[10055]: 2017-09-28 11:58:29.560 10055 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:58:29 ctl02 nova-api[10055]: 2017-09-28 11:58:29.560 10055 ERROR nova     max_url_len=max_url_len)
Sep 28 11:58:29 ctl02 nova-api[10055]: 2017-09-28 11:58:29.560 10055 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:58:29 ctl02 nova-api[10055]: 2017-09-28 11:58:29.560 10055 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:58:29 ctl02 nova-api[10055]: 2017-09-28 11:58:29.560 10055 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:58:29 ctl02 nova-api[10055]: 2017-09-28 11:58:29.560 10055 ERROR nova     sock.listen(backlog)
Sep 28 11:58:29 ctl02 nova-api[10055]: 2017-09-28 11:58:29.560 10055 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:58:29 ctl02 nova-api[10055]: 2017-09-28 11:58:29.560 10055 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:58:29 ctl02 nova-api[10055]: 2017-09-28 11:58:29.560 10055 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:58:29 ctl02 nova-api[10055]: 2017-09-28 11:58:29.560 10055 ERROR nova
Sep 28 11:58:29 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:58:29 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:58:29 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:58:29 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfc3acf5b)
Sep 28 11:58:29 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:58:29 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:58:29 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:58:29 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:58:30 ctl02 nova-conductor[5056]: 2017-09-28 11:58:30.198 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:58:30 ctl02 nova-conductor[5056]: 2017-09-28 11:58:30.213 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:58:30 ctl02 nova-conductor[5056]: 2017-09-28 11:58:30.228 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:58:30 ctl02 nova-conductor[5056]: 2017-09-28 11:58:30.236 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:58:30 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfc3acf5b)
Sep 28 11:58:31 ctl02 nova-api[10073]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:58:31 ctl02 nova-api[10073]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:58:31 ctl02 nova-api[10073]: 2017-09-28 11:58:31.615 10073 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:58:31 ctl02 nova-api[10073]: 2017-09-28 11:58:31.616 10073 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:58:31 ctl02 nova-api[10073]: 2017-09-28 11:58:31.616 10073 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:58:31 ctl02 nova-api[10073]: 2017-09-28 11:58:31.616 10073 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:58:31 ctl02 nova-api[10073]: 2017-09-28 11:58:31.616 10073 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:58:31 ctl02 nova-api[10073]: 2017-09-28 11:58:31.616 10073 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:58:31 ctl02 nova-api[10073]: 2017-09-28 11:58:31.616 10073 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:58:31 ctl02 nova-api[10073]: 2017-09-28 11:58:31.616 10073 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:58:31 ctl02 nova-api[10073]: 2017-09-28 11:58:31.616 10073 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:58:31 ctl02 nova-api[10073]: 2017-09-28 11:58:31.616 10073 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:58:31 ctl02 nova-api[10073]: 2017-09-28 11:58:31.616 10073 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:58:31 ctl02 nova-api[10073]: 2017-09-28 11:58:31.616 10073 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:58:31 ctl02 nova-api[10073]: 2017-09-28 11:58:31.616 10073 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:58:31 ctl02 nova-api[10073]: 2017-09-28 11:58:31.616 10073 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:58:31 ctl02 nova-api[10073]: 2017-09-28 11:58:31.616 10073 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:58:31 ctl02 nova-api[10073]: 2017-09-28 11:58:31.616 10073 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:58:31 ctl02 nova-api[10073]: 2017-09-28 11:58:31.616 10073 ERROR nova.wsgi     self.filename))
Sep 28 11:58:31 ctl02 nova-api[10073]: 2017-09-28 11:58:31.616 10073 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:58:31 ctl02 nova-api[10073]: 2017-09-28 11:58:31.616 10073 ERROR nova.wsgi
Sep 28 11:58:31 ctl02 nova-api[10073]: 2017-09-28 11:58:31.617 10073 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:58:31 ctl02 nova-api[10073]: 2017-09-28 11:58:31.749 10073 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:58:31 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfc3acf5b)
Sep 28 11:58:31 ctl02 nova-api[10073]: 2017-09-28 11:58:31.992 10073 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:58:31 ctl02 nova-api[10073]: 2017-09-28 11:58:31.994 10073 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:58:31 ctl02 nova-api[10073]: 2017-09-28 11:58:31.994 10073 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:58:31 ctl02 nova-api[10073]: 2017-09-28 11:58:31.995 10073 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:58:32 ctl02 nova-api[10073]: 2017-09-28 11:58:32.125 10073 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:58:32 ctl02 nova-api[10073]: 2017-09-28 11:58:32.127 10073 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:58:32 ctl02 nova-api[10073]: 2017-09-28 11:58:32.127 10073 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:58:32 ctl02 nova-api[10073]: 2017-09-28 11:58:32.127 10073 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:58:32 ctl02 nova-api[10073]: 2017-09-28 11:58:32.131 10073 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:58:32 ctl02 nova-api[10073]: 2017-09-28 11:58:32.131 10073 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:58:32 ctl02 nova-api[10073]: 2017-09-28 11:58:32.131 10073 ERROR nova Traceback (most recent call last):
Sep 28 11:58:32 ctl02 nova-api[10073]: 2017-09-28 11:58:32.131 10073 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:58:32 ctl02 nova-api[10073]: 2017-09-28 11:58:32.131 10073 ERROR nova     sys.exit(main())
Sep 28 11:58:32 ctl02 nova-api[10073]: 2017-09-28 11:58:32.131 10073 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:58:32 ctl02 nova-api[10073]: 2017-09-28 11:58:32.131 10073 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:58:32 ctl02 nova-api[10073]: 2017-09-28 11:58:32.131 10073 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:58:32 ctl02 nova-api[10073]: 2017-09-28 11:58:32.131 10073 ERROR nova     max_url_len=max_url_len)
Sep 28 11:58:32 ctl02 nova-api[10073]: 2017-09-28 11:58:32.131 10073 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:58:32 ctl02 nova-api[10073]: 2017-09-28 11:58:32.131 10073 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:58:32 ctl02 nova-api[10073]: 2017-09-28 11:58:32.131 10073 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:58:32 ctl02 nova-api[10073]: 2017-09-28 11:58:32.131 10073 ERROR nova     sock.listen(backlog)
Sep 28 11:58:32 ctl02 nova-api[10073]: 2017-09-28 11:58:32.131 10073 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:58:32 ctl02 nova-api[10073]: 2017-09-28 11:58:32.131 10073 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:58:32 ctl02 nova-api[10073]: 2017-09-28 11:58:32.131 10073 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:58:32 ctl02 nova-api[10073]: 2017-09-28 11:58:32.131 10073 ERROR nova
Sep 28 11:58:32 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:58:32 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:58:32 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:58:32 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:58:32 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:58:32 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:58:32 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:58:32 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfc3acf5b)
Sep 28 11:58:33 ctl02 glance-api[29183]: 2017-09-28 11:58:33.597 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:58:33] "OPTIONS / HTTP/1.0" 200 134 0.000656
Sep 28 11:58:33 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfc3acf5b)
Sep 28 11:58:34 ctl02 nova-api[10091]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:58:34 ctl02 nova-api[10091]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:58:34 ctl02 nova-api[10091]: 2017-09-28 11:58:34.333 10091 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:58:34 ctl02 nova-api[10091]: 2017-09-28 11:58:34.334 10091 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:58:34 ctl02 nova-api[10091]: 2017-09-28 11:58:34.334 10091 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:58:34 ctl02 nova-api[10091]: 2017-09-28 11:58:34.334 10091 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:58:34 ctl02 nova-api[10091]: 2017-09-28 11:58:34.334 10091 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:58:34 ctl02 nova-api[10091]: 2017-09-28 11:58:34.334 10091 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:58:34 ctl02 nova-api[10091]: 2017-09-28 11:58:34.334 10091 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:58:34 ctl02 nova-api[10091]: 2017-09-28 11:58:34.334 10091 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:58:34 ctl02 nova-api[10091]: 2017-09-28 11:58:34.334 10091 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:58:34 ctl02 nova-api[10091]: 2017-09-28 11:58:34.334 10091 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:58:34 ctl02 nova-api[10091]: 2017-09-28 11:58:34.334 10091 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:58:34 ctl02 nova-api[10091]: 2017-09-28 11:58:34.334 10091 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:58:34 ctl02 nova-api[10091]: 2017-09-28 11:58:34.334 10091 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:58:34 ctl02 nova-api[10091]: 2017-09-28 11:58:34.334 10091 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:58:34 ctl02 nova-api[10091]: 2017-09-28 11:58:34.334 10091 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:58:34 ctl02 nova-api[10091]: 2017-09-28 11:58:34.334 10091 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:58:34 ctl02 nova-api[10091]: 2017-09-28 11:58:34.334 10091 ERROR nova.wsgi     self.filename))
Sep 28 11:58:34 ctl02 nova-api[10091]: 2017-09-28 11:58:34.334 10091 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:58:34 ctl02 nova-api[10091]: 2017-09-28 11:58:34.334 10091 ERROR nova.wsgi
Sep 28 11:58:34 ctl02 nova-api[10091]: 2017-09-28 11:58:34.335 10091 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:58:34 ctl02 nova-api[10091]: 2017-09-28 11:58:34.468 10091 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:58:34 ctl02 nova-api[10091]: 2017-09-28 11:58:34.707 10091 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:58:34 ctl02 nova-api[10091]: 2017-09-28 11:58:34.709 10091 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:58:34 ctl02 nova-api[10091]: 2017-09-28 11:58:34.710 10091 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:58:34 ctl02 nova-api[10091]: 2017-09-28 11:58:34.710 10091 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:58:34 ctl02 nova-api[10091]: 2017-09-28 11:58:34.840 10091 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:58:34 ctl02 nova-api[10091]: 2017-09-28 11:58:34.842 10091 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:58:34 ctl02 nova-api[10091]: 2017-09-28 11:58:34.842 10091 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:58:34 ctl02 nova-api[10091]: 2017-09-28 11:58:34.842 10091 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:58:34 ctl02 nova-api[10091]: 2017-09-28 11:58:34.846 10091 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:58:34 ctl02 nova-api[10091]: 2017-09-28 11:58:34.846 10091 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:58:34 ctl02 nova-api[10091]: 2017-09-28 11:58:34.846 10091 ERROR nova Traceback (most recent call last):
Sep 28 11:58:34 ctl02 nova-api[10091]: 2017-09-28 11:58:34.846 10091 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:58:34 ctl02 nova-api[10091]: 2017-09-28 11:58:34.846 10091 ERROR nova     sys.exit(main())
Sep 28 11:58:34 ctl02 nova-api[10091]: 2017-09-28 11:58:34.846 10091 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:58:34 ctl02 nova-api[10091]: 2017-09-28 11:58:34.846 10091 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:58:34 ctl02 nova-api[10091]: 2017-09-28 11:58:34.846 10091 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:58:34 ctl02 nova-api[10091]: 2017-09-28 11:58:34.846 10091 ERROR nova     max_url_len=max_url_len)
Sep 28 11:58:34 ctl02 nova-api[10091]: 2017-09-28 11:58:34.846 10091 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:58:34 ctl02 nova-api[10091]: 2017-09-28 11:58:34.846 10091 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:58:34 ctl02 nova-api[10091]: 2017-09-28 11:58:34.846 10091 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:58:34 ctl02 nova-api[10091]: 2017-09-28 11:58:34.846 10091 ERROR nova     sock.listen(backlog)
Sep 28 11:58:34 ctl02 nova-api[10091]: 2017-09-28 11:58:34.846 10091 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:58:34 ctl02 nova-api[10091]: 2017-09-28 11:58:34.846 10091 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:58:34 ctl02 nova-api[10091]: 2017-09-28 11:58:34.846 10091 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:58:34 ctl02 nova-api[10091]: 2017-09-28 11:58:34.846 10091 ERROR nova
Sep 28 11:58:34 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:58:34 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:58:34 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:58:34 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:58:34 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:58:35 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:58:35 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:58:35 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:58:35 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:58:36 ctl02 glance-api[29183]: 2017-09-28 11:58:36.320 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:58:36] "OPTIONS / HTTP/1.0" 200 134 0.000804
Sep 28 11:58:36 ctl02 nova-api[10114]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:58:36 ctl02 nova-api[10114]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:58:36 ctl02 nova-api[10114]: 2017-09-28 11:58:36.872 10114 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:58:36 ctl02 nova-api[10114]: 2017-09-28 11:58:36.873 10114 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:58:36 ctl02 nova-api[10114]: 2017-09-28 11:58:36.873 10114 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:58:36 ctl02 nova-api[10114]: 2017-09-28 11:58:36.873 10114 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:58:36 ctl02 nova-api[10114]: 2017-09-28 11:58:36.873 10114 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:58:36 ctl02 nova-api[10114]: 2017-09-28 11:58:36.873 10114 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:58:36 ctl02 nova-api[10114]: 2017-09-28 11:58:36.873 10114 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:58:36 ctl02 nova-api[10114]: 2017-09-28 11:58:36.873 10114 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:58:36 ctl02 nova-api[10114]: 2017-09-28 11:58:36.873 10114 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:58:36 ctl02 nova-api[10114]: 2017-09-28 11:58:36.873 10114 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:58:36 ctl02 nova-api[10114]: 2017-09-28 11:58:36.873 10114 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:58:36 ctl02 nova-api[10114]: 2017-09-28 11:58:36.873 10114 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:58:36 ctl02 nova-api[10114]: 2017-09-28 11:58:36.873 10114 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:58:36 ctl02 nova-api[10114]: 2017-09-28 11:58:36.873 10114 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:58:36 ctl02 nova-api[10114]: 2017-09-28 11:58:36.873 10114 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:58:36 ctl02 nova-api[10114]: 2017-09-28 11:58:36.873 10114 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:58:36 ctl02 nova-api[10114]: 2017-09-28 11:58:36.873 10114 ERROR nova.wsgi     self.filename))
Sep 28 11:58:36 ctl02 nova-api[10114]: 2017-09-28 11:58:36.873 10114 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:58:36 ctl02 nova-api[10114]: 2017-09-28 11:58:36.873 10114 ERROR nova.wsgi
Sep 28 11:58:36 ctl02 nova-api[10114]: 2017-09-28 11:58:36.874 10114 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:58:37 ctl02 nova-api[10114]: 2017-09-28 11:58:37.008 10114 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:58:37 ctl02 nova-api[10114]: 2017-09-28 11:58:37.250 10114 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:58:37 ctl02 nova-api[10114]: 2017-09-28 11:58:37.253 10114 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:58:37 ctl02 nova-api[10114]: 2017-09-28 11:58:37.253 10114 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:58:37 ctl02 nova-api[10114]: 2017-09-28 11:58:37.253 10114 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:58:37 ctl02 nova-api[10114]: 2017-09-28 11:58:37.386 10114 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:58:37 ctl02 nova-api[10114]: 2017-09-28 11:58:37.388 10114 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:58:37 ctl02 nova-api[10114]: 2017-09-28 11:58:37.388 10114 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:58:37 ctl02 nova-api[10114]: 2017-09-28 11:58:37.388 10114 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:58:37 ctl02 nova-api[10114]: 2017-09-28 11:58:37.392 10114 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:58:37 ctl02 nova-api[10114]: 2017-09-28 11:58:37.392 10114 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:58:37 ctl02 nova-api[10114]: 2017-09-28 11:58:37.392 10114 ERROR nova Traceback (most recent call last):
Sep 28 11:58:37 ctl02 nova-api[10114]: 2017-09-28 11:58:37.392 10114 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:58:37 ctl02 nova-api[10114]: 2017-09-28 11:58:37.392 10114 ERROR nova     sys.exit(main())
Sep 28 11:58:37 ctl02 nova-api[10114]: 2017-09-28 11:58:37.392 10114 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:58:37 ctl02 nova-api[10114]: 2017-09-28 11:58:37.392 10114 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:58:37 ctl02 nova-api[10114]: 2017-09-28 11:58:37.392 10114 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:58:37 ctl02 nova-api[10114]: 2017-09-28 11:58:37.392 10114 ERROR nova     max_url_len=max_url_len)
Sep 28 11:58:37 ctl02 nova-api[10114]: 2017-09-28 11:58:37.392 10114 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:58:37 ctl02 nova-api[10114]: 2017-09-28 11:58:37.392 10114 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:58:37 ctl02 nova-api[10114]: 2017-09-28 11:58:37.392 10114 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:58:37 ctl02 nova-api[10114]: 2017-09-28 11:58:37.392 10114 ERROR nova     sock.listen(backlog)
Sep 28 11:58:37 ctl02 nova-api[10114]: 2017-09-28 11:58:37.392 10114 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:58:37 ctl02 nova-api[10114]: 2017-09-28 11:58:37.392 10114 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:58:37 ctl02 nova-api[10114]: 2017-09-28 11:58:37.392 10114 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:58:37 ctl02 nova-api[10114]: 2017-09-28 11:58:37.392 10114 ERROR nova
Sep 28 11:58:37 ctl02 nova-consoleauth[5433]: 2017-09-28 11:58:37.423 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:58:37 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:58:37 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:58:37 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:58:37 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:58:37 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:58:37 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:58:37 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:58:38 ctl02 glance-api[29183]: 2017-09-28 11:58:38.063 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:58:38] "OPTIONS / HTTP/1.0" 200 134 0.001097
Sep 28 11:58:39 ctl02 nova-api[10132]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:58:39 ctl02 nova-api[10132]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:58:39 ctl02 nova-api[10132]: 2017-09-28 11:58:39.602 10132 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:58:39 ctl02 nova-api[10132]: 2017-09-28 11:58:39.604 10132 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:58:39 ctl02 nova-api[10132]: 2017-09-28 11:58:39.604 10132 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:58:39 ctl02 nova-api[10132]: 2017-09-28 11:58:39.604 10132 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:58:39 ctl02 nova-api[10132]: 2017-09-28 11:58:39.604 10132 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:58:39 ctl02 nova-api[10132]: 2017-09-28 11:58:39.604 10132 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:58:39 ctl02 nova-api[10132]: 2017-09-28 11:58:39.604 10132 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:58:39 ctl02 nova-api[10132]: 2017-09-28 11:58:39.604 10132 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:58:39 ctl02 nova-api[10132]: 2017-09-28 11:58:39.604 10132 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:58:39 ctl02 nova-api[10132]: 2017-09-28 11:58:39.604 10132 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:58:39 ctl02 nova-api[10132]: 2017-09-28 11:58:39.604 10132 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:58:39 ctl02 nova-api[10132]: 2017-09-28 11:58:39.604 10132 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:58:39 ctl02 nova-api[10132]: 2017-09-28 11:58:39.604 10132 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:58:39 ctl02 nova-api[10132]: 2017-09-28 11:58:39.604 10132 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:58:39 ctl02 nova-api[10132]: 2017-09-28 11:58:39.604 10132 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:58:39 ctl02 nova-api[10132]: 2017-09-28 11:58:39.604 10132 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:58:39 ctl02 nova-api[10132]: 2017-09-28 11:58:39.604 10132 ERROR nova.wsgi     self.filename))
Sep 28 11:58:39 ctl02 nova-api[10132]: 2017-09-28 11:58:39.604 10132 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:58:39 ctl02 nova-api[10132]: 2017-09-28 11:58:39.604 10132 ERROR nova.wsgi
Sep 28 11:58:39 ctl02 nova-api[10132]: 2017-09-28 11:58:39.606 10132 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:58:39 ctl02 nova-api[10132]: 2017-09-28 11:58:39.734 10132 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:58:39 ctl02 nova-api[10132]: 2017-09-28 11:58:39.969 10132 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:58:39 ctl02 nova-api[10132]: 2017-09-28 11:58:39.972 10132 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:58:39 ctl02 nova-api[10132]: 2017-09-28 11:58:39.972 10132 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:58:39 ctl02 nova-api[10132]: 2017-09-28 11:58:39.973 10132 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:58:40 ctl02 nova-api[10132]: 2017-09-28 11:58:40.104 10132 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:58:40 ctl02 nova-api[10132]: 2017-09-28 11:58:40.106 10132 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:58:40 ctl02 nova-api[10132]: 2017-09-28 11:58:40.107 10132 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:58:40 ctl02 nova-api[10132]: 2017-09-28 11:58:40.107 10132 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:58:40 ctl02 nova-api[10132]: 2017-09-28 11:58:40.111 10132 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:58:40 ctl02 nova-api[10132]: 2017-09-28 11:58:40.111 10132 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:58:40 ctl02 nova-api[10132]: 2017-09-28 11:58:40.111 10132 ERROR nova Traceback (most recent call last):
Sep 28 11:58:40 ctl02 nova-api[10132]: 2017-09-28 11:58:40.111 10132 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:58:40 ctl02 nova-api[10132]: 2017-09-28 11:58:40.111 10132 ERROR nova     sys.exit(main())
Sep 28 11:58:40 ctl02 nova-api[10132]: 2017-09-28 11:58:40.111 10132 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:58:40 ctl02 nova-api[10132]: 2017-09-28 11:58:40.111 10132 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:58:40 ctl02 nova-api[10132]: 2017-09-28 11:58:40.111 10132 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:58:40 ctl02 nova-api[10132]: 2017-09-28 11:58:40.111 10132 ERROR nova     max_url_len=max_url_len)
Sep 28 11:58:40 ctl02 nova-api[10132]: 2017-09-28 11:58:40.111 10132 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:58:40 ctl02 nova-api[10132]: 2017-09-28 11:58:40.111 10132 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:58:40 ctl02 nova-api[10132]: 2017-09-28 11:58:40.111 10132 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:58:40 ctl02 nova-api[10132]: 2017-09-28 11:58:40.111 10132 ERROR nova     sock.listen(backlog)
Sep 28 11:58:40 ctl02 nova-api[10132]: 2017-09-28 11:58:40.111 10132 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:58:40 ctl02 nova-api[10132]: 2017-09-28 11:58:40.111 10132 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:58:40 ctl02 nova-api[10132]: 2017-09-28 11:58:40.111 10132 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:58:40 ctl02 nova-api[10132]: 2017-09-28 11:58:40.111 10132 ERROR nova
Sep 28 11:58:40 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:58:40 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:58:40 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:58:40 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:58:40 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:58:40 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:58:40 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:58:40 ctl02 nova-scheduler[5620]: 2017-09-28 11:58:40.451 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:58:41 ctl02 nova-api[10150]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:58:41 ctl02 nova-api[10150]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:58:42 ctl02 nova-api[10150]: 2017-09-28 11:58:42.067 10150 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:58:42 ctl02 nova-api[10150]: 2017-09-28 11:58:42.068 10150 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:58:42 ctl02 nova-api[10150]: 2017-09-28 11:58:42.068 10150 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:58:42 ctl02 nova-api[10150]: 2017-09-28 11:58:42.068 10150 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:58:42 ctl02 nova-api[10150]: 2017-09-28 11:58:42.068 10150 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:58:42 ctl02 nova-api[10150]: 2017-09-28 11:58:42.068 10150 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:58:42 ctl02 nova-api[10150]: 2017-09-28 11:58:42.068 10150 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:58:42 ctl02 nova-api[10150]: 2017-09-28 11:58:42.068 10150 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:58:42 ctl02 nova-api[10150]: 2017-09-28 11:58:42.068 10150 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:58:42 ctl02 nova-api[10150]: 2017-09-28 11:58:42.068 10150 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:58:42 ctl02 nova-api[10150]: 2017-09-28 11:58:42.068 10150 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:58:42 ctl02 nova-api[10150]: 2017-09-28 11:58:42.068 10150 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:58:42 ctl02 nova-api[10150]: 2017-09-28 11:58:42.068 10150 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:58:42 ctl02 nova-api[10150]: 2017-09-28 11:58:42.068 10150 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:58:42 ctl02 nova-api[10150]: 2017-09-28 11:58:42.068 10150 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:58:42 ctl02 nova-api[10150]: 2017-09-28 11:58:42.068 10150 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:58:42 ctl02 nova-api[10150]: 2017-09-28 11:58:42.068 10150 ERROR nova.wsgi     self.filename))
Sep 28 11:58:42 ctl02 nova-api[10150]: 2017-09-28 11:58:42.068 10150 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:58:42 ctl02 nova-api[10150]: 2017-09-28 11:58:42.068 10150 ERROR nova.wsgi
Sep 28 11:58:42 ctl02 nova-api[10150]: 2017-09-28 11:58:42.069 10150 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:58:42 ctl02 nova-api[10150]: 2017-09-28 11:58:42.197 10150 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:58:42 ctl02 dhclient[600]: DHCPREQUEST of 192.168.11.25 on ens2 to 192.168.11.3 port 67 (xid=0x3415f07)
Sep 28 11:58:42 ctl02 dhclient[600]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 11:58:42 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 11:58:42 ctl02 ntp[10216]:  * Stopping NTP server ntpd
Sep 28 11:58:42 ctl02 ntp[10216]:    ...done.
Sep 28 11:58:42 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 11:58:42 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 11:58:42 ctl02 ntp[10227]:  * Starting NTP server ntpd
Sep 28 11:58:42 ctl02 ntpd[10234]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 11:58:42 ctl02 ntpd[10234]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -c /var/lib/ntp/ntp.conf.dhcp -u 108:112
Sep 28 11:58:42 ctl02 ntp[10227]:    ...done.
Sep 28 11:58:42 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 11:58:42 ctl02 nova-api[10150]: 2017-09-28 11:58:42.448 10150 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:58:42 ctl02 nova-api[10150]: 2017-09-28 11:58:42.451 10150 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:58:42 ctl02 nova-api[10150]: 2017-09-28 11:58:42.451 10150 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:58:42 ctl02 nova-api[10150]: 2017-09-28 11:58:42.451 10150 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:58:42 ctl02 ntpd[10237]: proto: precision = 0.043 usec (-24)
Sep 28 11:58:42 ctl02 ntpd[10237]: switching logging to file /var/log/ntp.log
Sep 28 11:58:42 ctl02 dhclient[600]: bound to 192.168.11.25 -- renewal in 273 seconds.
Sep 28 11:58:42 ctl02 nova-api[10150]: 2017-09-28 11:58:42.584 10150 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:58:42 ctl02 nova-api[10150]: 2017-09-28 11:58:42.586 10150 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:58:42 ctl02 nova-api[10150]: 2017-09-28 11:58:42.586 10150 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:58:42 ctl02 nova-api[10150]: 2017-09-28 11:58:42.586 10150 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:58:42 ctl02 nova-api[10150]: 2017-09-28 11:58:42.590 10150 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:58:42 ctl02 nova-api[10150]: 2017-09-28 11:58:42.590 10150 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:58:42 ctl02 nova-api[10150]: 2017-09-28 11:58:42.590 10150 ERROR nova Traceback (most recent call last):
Sep 28 11:58:42 ctl02 nova-api[10150]: 2017-09-28 11:58:42.590 10150 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:58:42 ctl02 nova-api[10150]: 2017-09-28 11:58:42.590 10150 ERROR nova     sys.exit(main())
Sep 28 11:58:42 ctl02 nova-api[10150]: 2017-09-28 11:58:42.590 10150 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:58:42 ctl02 nova-api[10150]: 2017-09-28 11:58:42.590 10150 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:58:42 ctl02 nova-api[10150]: 2017-09-28 11:58:42.590 10150 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:58:42 ctl02 nova-api[10150]: 2017-09-28 11:58:42.590 10150 ERROR nova     max_url_len=max_url_len)
Sep 28 11:58:42 ctl02 nova-api[10150]: 2017-09-28 11:58:42.590 10150 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:58:42 ctl02 nova-api[10150]: 2017-09-28 11:58:42.590 10150 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:58:42 ctl02 nova-api[10150]: 2017-09-28 11:58:42.590 10150 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:58:42 ctl02 nova-api[10150]: 2017-09-28 11:58:42.590 10150 ERROR nova     sock.listen(backlog)
Sep 28 11:58:42 ctl02 nova-api[10150]: 2017-09-28 11:58:42.590 10150 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:58:42 ctl02 nova-api[10150]: 2017-09-28 11:58:42.590 10150 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:58:42 ctl02 nova-api[10150]: 2017-09-28 11:58:42.590 10150 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:58:42 ctl02 nova-api[10150]: 2017-09-28 11:58:42.590 10150 ERROR nova
Sep 28 11:58:42 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:58:42 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:58:42 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:58:42 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:58:42 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:58:42 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:58:42 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:58:43 ctl02 glance-api[29183]: 2017-09-28 11:58:43.542 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:58:43] "OPTIONS / HTTP/1.0" 200 134 0.000641
Sep 28 11:58:44 ctl02 nova-api[10250]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:58:44 ctl02 nova-api[10250]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:58:44 ctl02 nova-api[10250]: 2017-09-28 11:58:44.561 10250 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:58:44 ctl02 nova-api[10250]: 2017-09-28 11:58:44.563 10250 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:58:44 ctl02 nova-api[10250]: 2017-09-28 11:58:44.563 10250 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:58:44 ctl02 nova-api[10250]: 2017-09-28 11:58:44.563 10250 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:58:44 ctl02 nova-api[10250]: 2017-09-28 11:58:44.563 10250 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:58:44 ctl02 nova-api[10250]: 2017-09-28 11:58:44.563 10250 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:58:44 ctl02 nova-api[10250]: 2017-09-28 11:58:44.563 10250 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:58:44 ctl02 nova-api[10250]: 2017-09-28 11:58:44.563 10250 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:58:44 ctl02 nova-api[10250]: 2017-09-28 11:58:44.563 10250 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:58:44 ctl02 nova-api[10250]: 2017-09-28 11:58:44.563 10250 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:58:44 ctl02 nova-api[10250]: 2017-09-28 11:58:44.563 10250 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:58:44 ctl02 nova-api[10250]: 2017-09-28 11:58:44.563 10250 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:58:44 ctl02 nova-api[10250]: 2017-09-28 11:58:44.563 10250 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:58:44 ctl02 nova-api[10250]: 2017-09-28 11:58:44.563 10250 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:58:44 ctl02 nova-api[10250]: 2017-09-28 11:58:44.563 10250 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:58:44 ctl02 nova-api[10250]: 2017-09-28 11:58:44.563 10250 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:58:44 ctl02 nova-api[10250]: 2017-09-28 11:58:44.563 10250 ERROR nova.wsgi     self.filename))
Sep 28 11:58:44 ctl02 nova-api[10250]: 2017-09-28 11:58:44.563 10250 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:58:44 ctl02 nova-api[10250]: 2017-09-28 11:58:44.563 10250 ERROR nova.wsgi
Sep 28 11:58:44 ctl02 nova-api[10250]: 2017-09-28 11:58:44.563 10250 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:58:44 ctl02 nova-api[10250]: 2017-09-28 11:58:44.692 10250 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:58:44 ctl02 nova-api[10250]: 2017-09-28 11:58:44.926 10250 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:58:44 ctl02 nova-api[10250]: 2017-09-28 11:58:44.928 10250 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:58:44 ctl02 nova-api[10250]: 2017-09-28 11:58:44.929 10250 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:58:44 ctl02 nova-api[10250]: 2017-09-28 11:58:44.929 10250 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:58:45 ctl02 nova-api[10250]: 2017-09-28 11:58:45.058 10250 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:58:45 ctl02 nova-api[10250]: 2017-09-28 11:58:45.060 10250 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:58:45 ctl02 nova-api[10250]: 2017-09-28 11:58:45.060 10250 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:58:45 ctl02 nova-api[10250]: 2017-09-28 11:58:45.061 10250 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:58:45 ctl02 nova-api[10250]: 2017-09-28 11:58:45.064 10250 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:58:45 ctl02 nova-api[10250]: 2017-09-28 11:58:45.064 10250 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:58:45 ctl02 nova-api[10250]: 2017-09-28 11:58:45.064 10250 ERROR nova Traceback (most recent call last):
Sep 28 11:58:45 ctl02 nova-api[10250]: 2017-09-28 11:58:45.064 10250 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:58:45 ctl02 nova-api[10250]: 2017-09-28 11:58:45.064 10250 ERROR nova     sys.exit(main())
Sep 28 11:58:45 ctl02 nova-api[10250]: 2017-09-28 11:58:45.064 10250 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:58:45 ctl02 nova-api[10250]: 2017-09-28 11:58:45.064 10250 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:58:45 ctl02 nova-api[10250]: 2017-09-28 11:58:45.064 10250 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:58:45 ctl02 nova-api[10250]: 2017-09-28 11:58:45.064 10250 ERROR nova     max_url_len=max_url_len)
Sep 28 11:58:45 ctl02 nova-api[10250]: 2017-09-28 11:58:45.064 10250 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:58:45 ctl02 nova-api[10250]: 2017-09-28 11:58:45.064 10250 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:58:45 ctl02 nova-api[10250]: 2017-09-28 11:58:45.064 10250 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:58:45 ctl02 nova-api[10250]: 2017-09-28 11:58:45.064 10250 ERROR nova     sock.listen(backlog)
Sep 28 11:58:45 ctl02 nova-api[10250]: 2017-09-28 11:58:45.064 10250 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:58:45 ctl02 nova-api[10250]: 2017-09-28 11:58:45.064 10250 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:58:45 ctl02 nova-api[10250]: 2017-09-28 11:58:45.064 10250 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:58:45 ctl02 nova-api[10250]: 2017-09-28 11:58:45.064 10250 ERROR nova
Sep 28 11:58:45 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:58:45 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:58:45 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:58:45 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:58:45 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:58:45 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:58:45 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:58:46 ctl02 glance-api[29183]: 2017-09-28 11:58:46.636 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:58:46] "OPTIONS / HTTP/1.0" 200 134 0.000698
Sep 28 11:58:46 ctl02 nova-api[10268]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:58:46 ctl02 nova-api[10268]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:58:47 ctl02 nova-api[10268]: 2017-09-28 11:58:47.088 10268 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:58:47 ctl02 nova-api[10268]: 2017-09-28 11:58:47.090 10268 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:58:47 ctl02 nova-api[10268]: 2017-09-28 11:58:47.090 10268 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:58:47 ctl02 nova-api[10268]: 2017-09-28 11:58:47.090 10268 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:58:47 ctl02 nova-api[10268]: 2017-09-28 11:58:47.090 10268 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:58:47 ctl02 nova-api[10268]: 2017-09-28 11:58:47.090 10268 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:58:47 ctl02 nova-api[10268]: 2017-09-28 11:58:47.090 10268 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:58:47 ctl02 nova-api[10268]: 2017-09-28 11:58:47.090 10268 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:58:47 ctl02 nova-api[10268]: 2017-09-28 11:58:47.090 10268 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:58:47 ctl02 nova-api[10268]: 2017-09-28 11:58:47.090 10268 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:58:47 ctl02 nova-api[10268]: 2017-09-28 11:58:47.090 10268 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:58:47 ctl02 nova-api[10268]: 2017-09-28 11:58:47.090 10268 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:58:47 ctl02 nova-api[10268]: 2017-09-28 11:58:47.090 10268 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:58:47 ctl02 nova-api[10268]: 2017-09-28 11:58:47.090 10268 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:58:47 ctl02 nova-api[10268]: 2017-09-28 11:58:47.090 10268 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:58:47 ctl02 nova-api[10268]: 2017-09-28 11:58:47.090 10268 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:58:47 ctl02 nova-api[10268]: 2017-09-28 11:58:47.090 10268 ERROR nova.wsgi     self.filename))
Sep 28 11:58:47 ctl02 nova-api[10268]: 2017-09-28 11:58:47.090 10268 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:58:47 ctl02 nova-api[10268]: 2017-09-28 11:58:47.090 10268 ERROR nova.wsgi
Sep 28 11:58:47 ctl02 nova-api[10268]: 2017-09-28 11:58:47.090 10268 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:58:47 ctl02 nova-api[10268]: 2017-09-28 11:58:47.222 10268 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:58:47 ctl02 nova-api[10268]: 2017-09-28 11:58:47.462 10268 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:58:47 ctl02 nova-api[10268]: 2017-09-28 11:58:47.464 10268 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:58:47 ctl02 nova-api[10268]: 2017-09-28 11:58:47.464 10268 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:58:47 ctl02 nova-api[10268]: 2017-09-28 11:58:47.481 10268 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:58:47 ctl02 nova-api[10268]: 2017-09-28 11:58:47.616 10268 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:58:47 ctl02 nova-api[10268]: 2017-09-28 11:58:47.619 10268 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:58:47 ctl02 nova-api[10268]: 2017-09-28 11:58:47.619 10268 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:58:47 ctl02 nova-api[10268]: 2017-09-28 11:58:47.619 10268 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:58:47 ctl02 nova-api[10268]: 2017-09-28 11:58:47.623 10268 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:58:47 ctl02 nova-api[10268]: 2017-09-28 11:58:47.623 10268 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:58:47 ctl02 nova-api[10268]: 2017-09-28 11:58:47.623 10268 ERROR nova Traceback (most recent call last):
Sep 28 11:58:47 ctl02 nova-api[10268]: 2017-09-28 11:58:47.623 10268 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:58:47 ctl02 nova-api[10268]: 2017-09-28 11:58:47.623 10268 ERROR nova     sys.exit(main())
Sep 28 11:58:47 ctl02 nova-api[10268]: 2017-09-28 11:58:47.623 10268 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:58:47 ctl02 nova-api[10268]: 2017-09-28 11:58:47.623 10268 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:58:47 ctl02 nova-api[10268]: 2017-09-28 11:58:47.623 10268 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:58:47 ctl02 nova-api[10268]: 2017-09-28 11:58:47.623 10268 ERROR nova     max_url_len=max_url_len)
Sep 28 11:58:47 ctl02 nova-api[10268]: 2017-09-28 11:58:47.623 10268 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:58:47 ctl02 nova-api[10268]: 2017-09-28 11:58:47.623 10268 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:58:47 ctl02 nova-api[10268]: 2017-09-28 11:58:47.623 10268 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:58:47 ctl02 nova-api[10268]: 2017-09-28 11:58:47.623 10268 ERROR nova     sock.listen(backlog)
Sep 28 11:58:47 ctl02 nova-api[10268]: 2017-09-28 11:58:47.623 10268 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:58:47 ctl02 nova-api[10268]: 2017-09-28 11:58:47.623 10268 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:58:47 ctl02 nova-api[10268]: 2017-09-28 11:58:47.623 10268 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:58:47 ctl02 nova-api[10268]: 2017-09-28 11:58:47.623 10268 ERROR nova
Sep 28 11:58:47 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:58:47 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:58:47 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:58:48 ctl02 glance-api[29183]: 2017-09-28 11:58:48.005 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:58:48] "OPTIONS / HTTP/1.0" 200 134 0.000811
Sep 28 11:58:48 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:58:48 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:58:48 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:58:48 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:58:48 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3a3c8d44)
Sep 28 11:58:49 ctl02 nova-api[10286]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:58:49 ctl02 nova-api[10286]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:58:49 ctl02 nova-api[10286]: 2017-09-28 11:58:49.879 10286 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:58:49 ctl02 nova-api[10286]: 2017-09-28 11:58:49.880 10286 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:58:49 ctl02 nova-api[10286]: 2017-09-28 11:58:49.880 10286 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:58:49 ctl02 nova-api[10286]: 2017-09-28 11:58:49.880 10286 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:58:49 ctl02 nova-api[10286]: 2017-09-28 11:58:49.880 10286 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:58:49 ctl02 nova-api[10286]: 2017-09-28 11:58:49.880 10286 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:58:49 ctl02 nova-api[10286]: 2017-09-28 11:58:49.880 10286 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:58:49 ctl02 nova-api[10286]: 2017-09-28 11:58:49.880 10286 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:58:49 ctl02 nova-api[10286]: 2017-09-28 11:58:49.880 10286 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:58:49 ctl02 nova-api[10286]: 2017-09-28 11:58:49.880 10286 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:58:49 ctl02 nova-api[10286]: 2017-09-28 11:58:49.880 10286 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:58:49 ctl02 nova-api[10286]: 2017-09-28 11:58:49.880 10286 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:58:49 ctl02 nova-api[10286]: 2017-09-28 11:58:49.880 10286 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:58:49 ctl02 nova-api[10286]: 2017-09-28 11:58:49.880 10286 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:58:49 ctl02 nova-api[10286]: 2017-09-28 11:58:49.880 10286 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:58:49 ctl02 nova-api[10286]: 2017-09-28 11:58:49.880 10286 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:58:49 ctl02 nova-api[10286]: 2017-09-28 11:58:49.880 10286 ERROR nova.wsgi     self.filename))
Sep 28 11:58:49 ctl02 nova-api[10286]: 2017-09-28 11:58:49.880 10286 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:58:49 ctl02 nova-api[10286]: 2017-09-28 11:58:49.880 10286 ERROR nova.wsgi
Sep 28 11:58:49 ctl02 nova-api[10286]: 2017-09-28 11:58:49.881 10286 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:58:49 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3a3c8d44)
Sep 28 11:58:50 ctl02 nova-api[10286]: 2017-09-28 11:58:50.017 10286 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:58:50 ctl02 nova-api[10286]: 2017-09-28 11:58:50.261 10286 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:58:50 ctl02 nova-api[10286]: 2017-09-28 11:58:50.264 10286 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:58:50 ctl02 nova-api[10286]: 2017-09-28 11:58:50.264 10286 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:58:50 ctl02 nova-api[10286]: 2017-09-28 11:58:50.264 10286 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:58:50 ctl02 nova-api[10286]: 2017-09-28 11:58:50.398 10286 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:58:50 ctl02 nova-api[10286]: 2017-09-28 11:58:50.400 10286 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:58:50 ctl02 nova-api[10286]: 2017-09-28 11:58:50.400 10286 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:58:50 ctl02 nova-api[10286]: 2017-09-28 11:58:50.400 10286 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:58:50 ctl02 nova-api[10286]: 2017-09-28 11:58:50.403 10286 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:58:50 ctl02 nova-api[10286]: 2017-09-28 11:58:50.404 10286 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:58:50 ctl02 nova-api[10286]: 2017-09-28 11:58:50.404 10286 ERROR nova Traceback (most recent call last):
Sep 28 11:58:50 ctl02 nova-api[10286]: 2017-09-28 11:58:50.404 10286 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:58:50 ctl02 nova-api[10286]: 2017-09-28 11:58:50.404 10286 ERROR nova     sys.exit(main())
Sep 28 11:58:50 ctl02 nova-api[10286]: 2017-09-28 11:58:50.404 10286 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:58:50 ctl02 nova-api[10286]: 2017-09-28 11:58:50.404 10286 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:58:50 ctl02 nova-api[10286]: 2017-09-28 11:58:50.404 10286 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:58:50 ctl02 nova-api[10286]: 2017-09-28 11:58:50.404 10286 ERROR nova     max_url_len=max_url_len)
Sep 28 11:58:50 ctl02 nova-api[10286]: 2017-09-28 11:58:50.404 10286 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:58:50 ctl02 nova-api[10286]: 2017-09-28 11:58:50.404 10286 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:58:50 ctl02 nova-api[10286]: 2017-09-28 11:58:50.404 10286 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:58:50 ctl02 nova-api[10286]: 2017-09-28 11:58:50.404 10286 ERROR nova     sock.listen(backlog)
Sep 28 11:58:50 ctl02 nova-api[10286]: 2017-09-28 11:58:50.404 10286 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:58:50 ctl02 nova-api[10286]: 2017-09-28 11:58:50.404 10286 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:58:50 ctl02 nova-api[10286]: 2017-09-28 11:58:50.404 10286 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:58:50 ctl02 nova-api[10286]: 2017-09-28 11:58:50.404 10286 ERROR nova
Sep 28 11:58:50 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:58:50 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:58:50 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:58:50 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:58:50 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:58:50 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:58:50 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:58:50 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3a3c8d44)
Sep 28 11:58:51 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3a3c8d44)
Sep 28 11:58:52 ctl02 nova-api[10303]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:58:52 ctl02 nova-api[10303]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:58:52 ctl02 nova-api[10303]: 2017-09-28 11:58:52.586 10303 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:58:52 ctl02 nova-api[10303]: 2017-09-28 11:58:52.588 10303 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:58:52 ctl02 nova-api[10303]: 2017-09-28 11:58:52.588 10303 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:58:52 ctl02 nova-api[10303]: 2017-09-28 11:58:52.588 10303 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:58:52 ctl02 nova-api[10303]: 2017-09-28 11:58:52.588 10303 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:58:52 ctl02 nova-api[10303]: 2017-09-28 11:58:52.588 10303 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:58:52 ctl02 nova-api[10303]: 2017-09-28 11:58:52.588 10303 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:58:52 ctl02 nova-api[10303]: 2017-09-28 11:58:52.588 10303 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:58:52 ctl02 nova-api[10303]: 2017-09-28 11:58:52.588 10303 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:58:52 ctl02 nova-api[10303]: 2017-09-28 11:58:52.588 10303 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:58:52 ctl02 nova-api[10303]: 2017-09-28 11:58:52.588 10303 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:58:52 ctl02 nova-api[10303]: 2017-09-28 11:58:52.588 10303 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:58:52 ctl02 nova-api[10303]: 2017-09-28 11:58:52.588 10303 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:58:52 ctl02 nova-api[10303]: 2017-09-28 11:58:52.588 10303 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:58:52 ctl02 nova-api[10303]: 2017-09-28 11:58:52.588 10303 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:58:52 ctl02 nova-api[10303]: 2017-09-28 11:58:52.588 10303 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:58:52 ctl02 nova-api[10303]: 2017-09-28 11:58:52.588 10303 ERROR nova.wsgi     self.filename))
Sep 28 11:58:52 ctl02 nova-api[10303]: 2017-09-28 11:58:52.588 10303 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:58:52 ctl02 nova-api[10303]: 2017-09-28 11:58:52.588 10303 ERROR nova.wsgi
Sep 28 11:58:52 ctl02 nova-api[10303]: 2017-09-28 11:58:52.604 10303 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:58:52 ctl02 nova-api[10303]: 2017-09-28 11:58:52.733 10303 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:58:52 ctl02 nova-api[10303]: 2017-09-28 11:58:52.967 10303 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:58:52 ctl02 nova-api[10303]: 2017-09-28 11:58:52.970 10303 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:58:52 ctl02 nova-api[10303]: 2017-09-28 11:58:52.970 10303 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:58:52 ctl02 nova-api[10303]: 2017-09-28 11:58:52.970 10303 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:58:52 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3a3c8d44)
Sep 28 11:58:53 ctl02 nova-api[10303]: 2017-09-28 11:58:53.100 10303 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:58:53 ctl02 nova-api[10303]: 2017-09-28 11:58:53.102 10303 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:58:53 ctl02 nova-api[10303]: 2017-09-28 11:58:53.102 10303 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:58:53 ctl02 nova-api[10303]: 2017-09-28 11:58:53.103 10303 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:58:53 ctl02 nova-api[10303]: 2017-09-28 11:58:53.106 10303 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:58:53 ctl02 nova-api[10303]: 2017-09-28 11:58:53.106 10303 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:58:53 ctl02 nova-api[10303]: 2017-09-28 11:58:53.106 10303 ERROR nova Traceback (most recent call last):
Sep 28 11:58:53 ctl02 nova-api[10303]: 2017-09-28 11:58:53.106 10303 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:58:53 ctl02 nova-api[10303]: 2017-09-28 11:58:53.106 10303 ERROR nova     sys.exit(main())
Sep 28 11:58:53 ctl02 nova-api[10303]: 2017-09-28 11:58:53.106 10303 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:58:53 ctl02 nova-api[10303]: 2017-09-28 11:58:53.106 10303 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:58:53 ctl02 nova-api[10303]: 2017-09-28 11:58:53.106 10303 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:58:53 ctl02 nova-api[10303]: 2017-09-28 11:58:53.106 10303 ERROR nova     max_url_len=max_url_len)
Sep 28 11:58:53 ctl02 nova-api[10303]: 2017-09-28 11:58:53.106 10303 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:58:53 ctl02 nova-api[10303]: 2017-09-28 11:58:53.106 10303 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:58:53 ctl02 nova-api[10303]: 2017-09-28 11:58:53.106 10303 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:58:53 ctl02 nova-api[10303]: 2017-09-28 11:58:53.106 10303 ERROR nova     sock.listen(backlog)
Sep 28 11:58:53 ctl02 nova-api[10303]: 2017-09-28 11:58:53.106 10303 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:58:53 ctl02 nova-api[10303]: 2017-09-28 11:58:53.106 10303 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:58:53 ctl02 nova-api[10303]: 2017-09-28 11:58:53.106 10303 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:58:53 ctl02 nova-api[10303]: 2017-09-28 11:58:53.106 10303 ERROR nova
Sep 28 11:58:53 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:58:53 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:58:53 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:58:53 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:58:53 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:58:53 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:58:53 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:58:53 ctl02 glance-api[29183]: 2017-09-28 11:58:53.744 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:58:53] "OPTIONS / HTTP/1.0" 200 134 0.000637
Sep 28 11:58:53 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3a3c8d44)
Sep 28 11:58:54 ctl02 nova-api[10322]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:58:54 ctl02 nova-api[10322]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:58:54 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3a3c8d44)
Sep 28 11:58:55 ctl02 nova-api[10322]: 2017-09-28 11:58:55.097 10322 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:58:55 ctl02 nova-api[10322]: 2017-09-28 11:58:55.099 10322 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:58:55 ctl02 nova-api[10322]: 2017-09-28 11:58:55.099 10322 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:58:55 ctl02 nova-api[10322]: 2017-09-28 11:58:55.099 10322 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:58:55 ctl02 nova-api[10322]: 2017-09-28 11:58:55.099 10322 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:58:55 ctl02 nova-api[10322]: 2017-09-28 11:58:55.099 10322 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:58:55 ctl02 nova-api[10322]: 2017-09-28 11:58:55.099 10322 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:58:55 ctl02 nova-api[10322]: 2017-09-28 11:58:55.099 10322 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:58:55 ctl02 nova-api[10322]: 2017-09-28 11:58:55.099 10322 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:58:55 ctl02 nova-api[10322]: 2017-09-28 11:58:55.099 10322 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:58:55 ctl02 nova-api[10322]: 2017-09-28 11:58:55.099 10322 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:58:55 ctl02 nova-api[10322]: 2017-09-28 11:58:55.099 10322 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:58:55 ctl02 nova-api[10322]: 2017-09-28 11:58:55.099 10322 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:58:55 ctl02 nova-api[10322]: 2017-09-28 11:58:55.099 10322 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:58:55 ctl02 nova-api[10322]: 2017-09-28 11:58:55.099 10322 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:58:55 ctl02 nova-api[10322]: 2017-09-28 11:58:55.099 10322 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:58:55 ctl02 nova-api[10322]: 2017-09-28 11:58:55.099 10322 ERROR nova.wsgi     self.filename))
Sep 28 11:58:55 ctl02 nova-api[10322]: 2017-09-28 11:58:55.099 10322 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:58:55 ctl02 nova-api[10322]: 2017-09-28 11:58:55.099 10322 ERROR nova.wsgi
Sep 28 11:58:55 ctl02 nova-api[10322]: 2017-09-28 11:58:55.100 10322 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:58:55 ctl02 nova-api[10322]: 2017-09-28 11:58:55.232 10322 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:58:55 ctl02 nova-api[10322]: 2017-09-28 11:58:55.474 10322 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:58:55 ctl02 nova-api[10322]: 2017-09-28 11:58:55.476 10322 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:58:55 ctl02 nova-api[10322]: 2017-09-28 11:58:55.477 10322 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:58:55 ctl02 nova-api[10322]: 2017-09-28 11:58:55.477 10322 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:58:55 ctl02 nova-api[10322]: 2017-09-28 11:58:55.608 10322 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:58:55 ctl02 nova-api[10322]: 2017-09-28 11:58:55.610 10322 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:58:55 ctl02 nova-api[10322]: 2017-09-28 11:58:55.610 10322 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:58:55 ctl02 nova-api[10322]: 2017-09-28 11:58:55.610 10322 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:58:55 ctl02 nova-api[10322]: 2017-09-28 11:58:55.614 10322 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:58:55 ctl02 nova-api[10322]: 2017-09-28 11:58:55.614 10322 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:58:55 ctl02 nova-api[10322]: 2017-09-28 11:58:55.614 10322 ERROR nova Traceback (most recent call last):
Sep 28 11:58:55 ctl02 nova-api[10322]: 2017-09-28 11:58:55.614 10322 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:58:55 ctl02 nova-api[10322]: 2017-09-28 11:58:55.614 10322 ERROR nova     sys.exit(main())
Sep 28 11:58:55 ctl02 nova-api[10322]: 2017-09-28 11:58:55.614 10322 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:58:55 ctl02 nova-api[10322]: 2017-09-28 11:58:55.614 10322 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:58:55 ctl02 nova-api[10322]: 2017-09-28 11:58:55.614 10322 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:58:55 ctl02 nova-api[10322]: 2017-09-28 11:58:55.614 10322 ERROR nova     max_url_len=max_url_len)
Sep 28 11:58:55 ctl02 nova-api[10322]: 2017-09-28 11:58:55.614 10322 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:58:55 ctl02 nova-api[10322]: 2017-09-28 11:58:55.614 10322 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:58:55 ctl02 nova-api[10322]: 2017-09-28 11:58:55.614 10322 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:58:55 ctl02 nova-api[10322]: 2017-09-28 11:58:55.614 10322 ERROR nova     sock.listen(backlog)
Sep 28 11:58:55 ctl02 nova-api[10322]: 2017-09-28 11:58:55.614 10322 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:58:55 ctl02 nova-api[10322]: 2017-09-28 11:58:55.614 10322 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:58:55 ctl02 nova-api[10322]: 2017-09-28 11:58:55.614 10322 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:58:55 ctl02 nova-api[10322]: 2017-09-28 11:58:55.614 10322 ERROR nova
Sep 28 11:58:55 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:58:55 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:58:55 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:58:55 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:58:55 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:58:55 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:58:55 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:58:55 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3a3c8d44)
Sep 28 11:58:56 ctl02 glance-api[29183]: 2017-09-28 11:58:56.876 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:58:56] "OPTIONS / HTTP/1.0" 200 134 0.000693
Sep 28 11:58:56 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3a3c8d44)
Sep 28 11:58:57 ctl02 nova-api[10340]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:58:57 ctl02 nova-api[10340]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:58:57 ctl02 nova-api[10340]: 2017-09-28 11:58:57.594 10340 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:58:57 ctl02 nova-api[10340]: 2017-09-28 11:58:57.596 10340 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:58:57 ctl02 nova-api[10340]: 2017-09-28 11:58:57.596 10340 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:58:57 ctl02 nova-api[10340]: 2017-09-28 11:58:57.596 10340 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:58:57 ctl02 nova-api[10340]: 2017-09-28 11:58:57.596 10340 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:58:57 ctl02 nova-api[10340]: 2017-09-28 11:58:57.596 10340 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:58:57 ctl02 nova-api[10340]: 2017-09-28 11:58:57.596 10340 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:58:57 ctl02 nova-api[10340]: 2017-09-28 11:58:57.596 10340 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:58:57 ctl02 nova-api[10340]: 2017-09-28 11:58:57.596 10340 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:58:57 ctl02 nova-api[10340]: 2017-09-28 11:58:57.596 10340 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:58:57 ctl02 nova-api[10340]: 2017-09-28 11:58:57.596 10340 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:58:57 ctl02 nova-api[10340]: 2017-09-28 11:58:57.596 10340 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:58:57 ctl02 nova-api[10340]: 2017-09-28 11:58:57.596 10340 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:58:57 ctl02 nova-api[10340]: 2017-09-28 11:58:57.596 10340 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:58:57 ctl02 nova-api[10340]: 2017-09-28 11:58:57.596 10340 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:58:57 ctl02 nova-api[10340]: 2017-09-28 11:58:57.596 10340 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:58:57 ctl02 nova-api[10340]: 2017-09-28 11:58:57.596 10340 ERROR nova.wsgi     self.filename))
Sep 28 11:58:57 ctl02 nova-api[10340]: 2017-09-28 11:58:57.596 10340 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:58:57 ctl02 nova-api[10340]: 2017-09-28 11:58:57.596 10340 ERROR nova.wsgi
Sep 28 11:58:57 ctl02 nova-api[10340]: 2017-09-28 11:58:57.612 10340 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:58:57 ctl02 nova-api[10340]: 2017-09-28 11:58:57.745 10340 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:58:57 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3a3c8d44)
Sep 28 11:58:57 ctl02 nova-api[10340]: 2017-09-28 11:58:57.984 10340 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:58:57 ctl02 nova-api[10340]: 2017-09-28 11:58:57.987 10340 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:58:57 ctl02 nova-api[10340]: 2017-09-28 11:58:57.987 10340 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:58:57 ctl02 nova-api[10340]: 2017-09-28 11:58:57.987 10340 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:58:58 ctl02 nova-api[10340]: 2017-09-28 11:58:58.116 10340 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:58:58 ctl02 nova-api[10340]: 2017-09-28 11:58:58.118 10340 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:58:58 ctl02 nova-api[10340]: 2017-09-28 11:58:58.119 10340 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:58:58 ctl02 nova-api[10340]: 2017-09-28 11:58:58.119 10340 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:58:58 ctl02 nova-api[10340]: 2017-09-28 11:58:58.122 10340 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:58:58 ctl02 nova-api[10340]: 2017-09-28 11:58:58.122 10340 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:58:58 ctl02 nova-api[10340]: 2017-09-28 11:58:58.122 10340 ERROR nova Traceback (most recent call last):
Sep 28 11:58:58 ctl02 nova-api[10340]: 2017-09-28 11:58:58.122 10340 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:58:58 ctl02 nova-api[10340]: 2017-09-28 11:58:58.122 10340 ERROR nova     sys.exit(main())
Sep 28 11:58:58 ctl02 nova-api[10340]: 2017-09-28 11:58:58.122 10340 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:58:58 ctl02 nova-api[10340]: 2017-09-28 11:58:58.122 10340 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:58:58 ctl02 nova-api[10340]: 2017-09-28 11:58:58.122 10340 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:58:58 ctl02 nova-api[10340]: 2017-09-28 11:58:58.122 10340 ERROR nova     max_url_len=max_url_len)
Sep 28 11:58:58 ctl02 nova-api[10340]: 2017-09-28 11:58:58.122 10340 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:58:58 ctl02 nova-api[10340]: 2017-09-28 11:58:58.122 10340 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:58:58 ctl02 nova-api[10340]: 2017-09-28 11:58:58.122 10340 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:58:58 ctl02 nova-api[10340]: 2017-09-28 11:58:58.122 10340 ERROR nova     sock.listen(backlog)
Sep 28 11:58:58 ctl02 nova-api[10340]: 2017-09-28 11:58:58.122 10340 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:58:58 ctl02 nova-api[10340]: 2017-09-28 11:58:58.122 10340 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:58:58 ctl02 nova-api[10340]: 2017-09-28 11:58:58.122 10340 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:58:58 ctl02 nova-api[10340]: 2017-09-28 11:58:58.122 10340 ERROR nova
Sep 28 11:58:58 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:58:58 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:58:58 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:58:58 ctl02 glance-api[29183]: 2017-09-28 11:58:58.346 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:58:58] "OPTIONS / HTTP/1.0" 200 134 0.000645
Sep 28 11:58:58 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:58:58 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:58:58 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:58:58 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:58:58 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3a3c8d44)
Sep 28 11:58:59 ctl02 nova-cert[4860]: 2017-09-28 11:58:59.577 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:58:59 ctl02 nova-api[10358]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:58:59 ctl02 nova-api[10358]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:58:59 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:58:59 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:59:00 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 11:59:00 ctl02 ntp[10415]:  * Stopping NTP server ntpd
Sep 28 11:59:00 ctl02 ntp[10415]:    ...done.
Sep 28 11:59:00 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 11:59:00 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 11:59:00 ctl02 ntp[10426]:  * Starting NTP server ntpd
Sep 28 11:59:00 ctl02 ntpd[10433]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 11:59:00 ctl02 ntpd[10433]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 11:59:00 ctl02 ntp[10426]:    ...done.
Sep 28 11:59:00 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 11:59:00 ctl02 ntpd[10436]: proto: precision = 0.042 usec (-24)
Sep 28 11:59:00 ctl02 ntpd[10436]: switching logging to file /var/log/ntp.log
Sep 28 11:59:00 ctl02 nova-api[10358]: 2017-09-28 11:59:00.088 10358 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:59:00 ctl02 nova-api[10358]: 2017-09-28 11:59:00.090 10358 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:59:00 ctl02 nova-api[10358]: 2017-09-28 11:59:00.090 10358 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:59:00 ctl02 nova-api[10358]: 2017-09-28 11:59:00.090 10358 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:59:00 ctl02 nova-api[10358]: 2017-09-28 11:59:00.090 10358 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:59:00 ctl02 nova-api[10358]: 2017-09-28 11:59:00.090 10358 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:59:00 ctl02 nova-api[10358]: 2017-09-28 11:59:00.090 10358 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:59:00 ctl02 nova-api[10358]: 2017-09-28 11:59:00.090 10358 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:59:00 ctl02 nova-api[10358]: 2017-09-28 11:59:00.090 10358 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:59:00 ctl02 nova-api[10358]: 2017-09-28 11:59:00.090 10358 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:59:00 ctl02 nova-api[10358]: 2017-09-28 11:59:00.090 10358 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:59:00 ctl02 nova-api[10358]: 2017-09-28 11:59:00.090 10358 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:59:00 ctl02 nova-api[10358]: 2017-09-28 11:59:00.090 10358 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:59:00 ctl02 nova-api[10358]: 2017-09-28 11:59:00.090 10358 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:59:00 ctl02 nova-api[10358]: 2017-09-28 11:59:00.090 10358 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:59:00 ctl02 nova-api[10358]: 2017-09-28 11:59:00.090 10358 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:59:00 ctl02 nova-api[10358]: 2017-09-28 11:59:00.090 10358 ERROR nova.wsgi     self.filename))
Sep 28 11:59:00 ctl02 nova-api[10358]: 2017-09-28 11:59:00.090 10358 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:59:00 ctl02 nova-api[10358]: 2017-09-28 11:59:00.090 10358 ERROR nova.wsgi
Sep 28 11:59:00 ctl02 nova-api[10358]: 2017-09-28 11:59:00.090 10358 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:59:00 ctl02 nova-api[10358]: 2017-09-28 11:59:00.221 10358 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:59:00 ctl02 nova-api[10358]: 2017-09-28 11:59:00.461 10358 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:59:00 ctl02 nova-api[10358]: 2017-09-28 11:59:00.463 10358 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:59:00 ctl02 nova-api[10358]: 2017-09-28 11:59:00.464 10358 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:59:00 ctl02 nova-api[10358]: 2017-09-28 11:59:00.464 10358 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:59:00 ctl02 nova-api[10358]: 2017-09-28 11:59:00.594 10358 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:59:00 ctl02 nova-api[10358]: 2017-09-28 11:59:00.596 10358 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:59:00 ctl02 nova-api[10358]: 2017-09-28 11:59:00.596 10358 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:59:00 ctl02 nova-api[10358]: 2017-09-28 11:59:00.596 10358 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:59:00 ctl02 nova-api[10358]: 2017-09-28 11:59:00.600 10358 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:59:00 ctl02 nova-api[10358]: 2017-09-28 11:59:00.600 10358 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:59:00 ctl02 nova-api[10358]: 2017-09-28 11:59:00.600 10358 ERROR nova Traceback (most recent call last):
Sep 28 11:59:00 ctl02 nova-api[10358]: 2017-09-28 11:59:00.600 10358 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:59:00 ctl02 nova-api[10358]: 2017-09-28 11:59:00.600 10358 ERROR nova     sys.exit(main())
Sep 28 11:59:00 ctl02 nova-api[10358]: 2017-09-28 11:59:00.600 10358 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:59:00 ctl02 nova-api[10358]: 2017-09-28 11:59:00.600 10358 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:59:00 ctl02 nova-api[10358]: 2017-09-28 11:59:00.600 10358 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:59:00 ctl02 nova-api[10358]: 2017-09-28 11:59:00.600 10358 ERROR nova     max_url_len=max_url_len)
Sep 28 11:59:00 ctl02 nova-api[10358]: 2017-09-28 11:59:00.600 10358 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:59:00 ctl02 nova-api[10358]: 2017-09-28 11:59:00.600 10358 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:59:00 ctl02 nova-api[10358]: 2017-09-28 11:59:00.600 10358 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:59:00 ctl02 nova-api[10358]: 2017-09-28 11:59:00.600 10358 ERROR nova     sock.listen(backlog)
Sep 28 11:59:00 ctl02 nova-api[10358]: 2017-09-28 11:59:00.600 10358 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:59:00 ctl02 nova-api[10358]: 2017-09-28 11:59:00.600 10358 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:59:00 ctl02 nova-api[10358]: 2017-09-28 11:59:00.600 10358 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:59:00 ctl02 nova-api[10358]: 2017-09-28 11:59:00.600 10358 ERROR nova
Sep 28 11:59:00 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:59:00 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:59:00 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:59:00 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:59:00 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:59:00 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:59:00 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:59:02 ctl02 nova-conductor[5056]: 2017-09-28 11:59:02.207 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:59:02 ctl02 nova-conductor[5056]: 2017-09-28 11:59:02.222 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:59:02 ctl02 nova-conductor[5056]: 2017-09-28 11:59:02.236 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:59:02 ctl02 nova-conductor[5056]: 2017-09-28 11:59:02.245 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:59:02 ctl02 nova-api[10447]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:59:02 ctl02 nova-api[10447]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:59:02 ctl02 nova-api[10447]: 2017-09-28 11:59:02.592 10447 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:59:02 ctl02 nova-api[10447]: 2017-09-28 11:59:02.610 10447 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:59:02 ctl02 nova-api[10447]: 2017-09-28 11:59:02.610 10447 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:59:02 ctl02 nova-api[10447]: 2017-09-28 11:59:02.610 10447 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:59:02 ctl02 nova-api[10447]: 2017-09-28 11:59:02.610 10447 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:59:02 ctl02 nova-api[10447]: 2017-09-28 11:59:02.610 10447 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:59:02 ctl02 nova-api[10447]: 2017-09-28 11:59:02.610 10447 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:59:02 ctl02 nova-api[10447]: 2017-09-28 11:59:02.610 10447 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:59:02 ctl02 nova-api[10447]: 2017-09-28 11:59:02.610 10447 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:59:02 ctl02 nova-api[10447]: 2017-09-28 11:59:02.610 10447 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:59:02 ctl02 nova-api[10447]: 2017-09-28 11:59:02.610 10447 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:59:02 ctl02 nova-api[10447]: 2017-09-28 11:59:02.610 10447 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:59:02 ctl02 nova-api[10447]: 2017-09-28 11:59:02.610 10447 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:59:02 ctl02 nova-api[10447]: 2017-09-28 11:59:02.610 10447 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:59:02 ctl02 nova-api[10447]: 2017-09-28 11:59:02.610 10447 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:59:02 ctl02 nova-api[10447]: 2017-09-28 11:59:02.610 10447 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:59:02 ctl02 nova-api[10447]: 2017-09-28 11:59:02.610 10447 ERROR nova.wsgi     self.filename))
Sep 28 11:59:02 ctl02 nova-api[10447]: 2017-09-28 11:59:02.610 10447 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:59:02 ctl02 nova-api[10447]: 2017-09-28 11:59:02.610 10447 ERROR nova.wsgi
Sep 28 11:59:02 ctl02 nova-api[10447]: 2017-09-28 11:59:02.612 10447 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:59:02 ctl02 nova-api[10447]: 2017-09-28 11:59:02.761 10447 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:59:03 ctl02 nova-api[10447]: 2017-09-28 11:59:03.001 10447 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:59:03 ctl02 nova-api[10447]: 2017-09-28 11:59:03.003 10447 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:59:03 ctl02 nova-api[10447]: 2017-09-28 11:59:03.003 10447 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:59:03 ctl02 nova-api[10447]: 2017-09-28 11:59:03.004 10447 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:59:03 ctl02 nova-api[10447]: 2017-09-28 11:59:03.136 10447 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:59:03 ctl02 nova-api[10447]: 2017-09-28 11:59:03.138 10447 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:59:03 ctl02 nova-api[10447]: 2017-09-28 11:59:03.138 10447 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:59:03 ctl02 nova-api[10447]: 2017-09-28 11:59:03.138 10447 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:59:03 ctl02 nova-api[10447]: 2017-09-28 11:59:03.142 10447 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:59:03 ctl02 nova-api[10447]: 2017-09-28 11:59:03.142 10447 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:59:03 ctl02 nova-api[10447]: 2017-09-28 11:59:03.142 10447 ERROR nova Traceback (most recent call last):
Sep 28 11:59:03 ctl02 nova-api[10447]: 2017-09-28 11:59:03.142 10447 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:59:03 ctl02 nova-api[10447]: 2017-09-28 11:59:03.142 10447 ERROR nova     sys.exit(main())
Sep 28 11:59:03 ctl02 nova-api[10447]: 2017-09-28 11:59:03.142 10447 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:59:03 ctl02 nova-api[10447]: 2017-09-28 11:59:03.142 10447 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:59:03 ctl02 nova-api[10447]: 2017-09-28 11:59:03.142 10447 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:59:03 ctl02 nova-api[10447]: 2017-09-28 11:59:03.142 10447 ERROR nova     max_url_len=max_url_len)
Sep 28 11:59:03 ctl02 nova-api[10447]: 2017-09-28 11:59:03.142 10447 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:59:03 ctl02 nova-api[10447]: 2017-09-28 11:59:03.142 10447 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:59:03 ctl02 nova-api[10447]: 2017-09-28 11:59:03.142 10447 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:59:03 ctl02 nova-api[10447]: 2017-09-28 11:59:03.142 10447 ERROR nova     sock.listen(backlog)
Sep 28 11:59:03 ctl02 nova-api[10447]: 2017-09-28 11:59:03.142 10447 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:59:03 ctl02 nova-api[10447]: 2017-09-28 11:59:03.142 10447 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:59:03 ctl02 nova-api[10447]: 2017-09-28 11:59:03.142 10447 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:59:03 ctl02 nova-api[10447]: 2017-09-28 11:59:03.142 10447 ERROR nova
Sep 28 11:59:03 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:59:03 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:59:03 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:59:03 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:59:03 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:59:03 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:59:03 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:59:03 ctl02 glance-api[29183]: 2017-09-28 11:59:03.908 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:59:03] "OPTIONS / HTTP/1.0" 200 134 0.000635
Sep 28 11:59:05 ctl02 nova-api[10465]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:59:05 ctl02 nova-api[10465]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:59:05 ctl02 nova-api[10465]: 2017-09-28 11:59:05.303 10465 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:59:05 ctl02 nova-api[10465]: 2017-09-28 11:59:05.304 10465 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:59:05 ctl02 nova-api[10465]: 2017-09-28 11:59:05.304 10465 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:59:05 ctl02 nova-api[10465]: 2017-09-28 11:59:05.304 10465 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:59:05 ctl02 nova-api[10465]: 2017-09-28 11:59:05.304 10465 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:59:05 ctl02 nova-api[10465]: 2017-09-28 11:59:05.304 10465 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:59:05 ctl02 nova-api[10465]: 2017-09-28 11:59:05.304 10465 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:59:05 ctl02 nova-api[10465]: 2017-09-28 11:59:05.304 10465 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:59:05 ctl02 nova-api[10465]: 2017-09-28 11:59:05.304 10465 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:59:05 ctl02 nova-api[10465]: 2017-09-28 11:59:05.304 10465 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:59:05 ctl02 nova-api[10465]: 2017-09-28 11:59:05.304 10465 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:59:05 ctl02 nova-api[10465]: 2017-09-28 11:59:05.304 10465 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:59:05 ctl02 nova-api[10465]: 2017-09-28 11:59:05.304 10465 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:59:05 ctl02 nova-api[10465]: 2017-09-28 11:59:05.304 10465 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:59:05 ctl02 nova-api[10465]: 2017-09-28 11:59:05.304 10465 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:59:05 ctl02 nova-api[10465]: 2017-09-28 11:59:05.304 10465 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:59:05 ctl02 nova-api[10465]: 2017-09-28 11:59:05.304 10465 ERROR nova.wsgi     self.filename))
Sep 28 11:59:05 ctl02 nova-api[10465]: 2017-09-28 11:59:05.304 10465 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:59:05 ctl02 nova-api[10465]: 2017-09-28 11:59:05.304 10465 ERROR nova.wsgi
Sep 28 11:59:05 ctl02 nova-api[10465]: 2017-09-28 11:59:05.306 10465 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:59:05 ctl02 nova-api[10465]: 2017-09-28 11:59:05.436 10465 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:59:05 ctl02 nova-api[10465]: 2017-09-28 11:59:05.670 10465 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:59:05 ctl02 nova-api[10465]: 2017-09-28 11:59:05.673 10465 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:59:05 ctl02 nova-api[10465]: 2017-09-28 11:59:05.674 10465 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:59:05 ctl02 nova-api[10465]: 2017-09-28 11:59:05.674 10465 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:59:05 ctl02 nova-api[10465]: 2017-09-28 11:59:05.804 10465 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:59:05 ctl02 nova-api[10465]: 2017-09-28 11:59:05.806 10465 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:59:05 ctl02 nova-api[10465]: 2017-09-28 11:59:05.807 10465 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:59:05 ctl02 nova-api[10465]: 2017-09-28 11:59:05.807 10465 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:59:05 ctl02 nova-api[10465]: 2017-09-28 11:59:05.810 10465 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:59:05 ctl02 nova-api[10465]: 2017-09-28 11:59:05.811 10465 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:59:05 ctl02 nova-api[10465]: 2017-09-28 11:59:05.811 10465 ERROR nova Traceback (most recent call last):
Sep 28 11:59:05 ctl02 nova-api[10465]: 2017-09-28 11:59:05.811 10465 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:59:05 ctl02 nova-api[10465]: 2017-09-28 11:59:05.811 10465 ERROR nova     sys.exit(main())
Sep 28 11:59:05 ctl02 nova-api[10465]: 2017-09-28 11:59:05.811 10465 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:59:05 ctl02 nova-api[10465]: 2017-09-28 11:59:05.811 10465 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:59:05 ctl02 nova-api[10465]: 2017-09-28 11:59:05.811 10465 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:59:05 ctl02 nova-api[10465]: 2017-09-28 11:59:05.811 10465 ERROR nova     max_url_len=max_url_len)
Sep 28 11:59:05 ctl02 nova-api[10465]: 2017-09-28 11:59:05.811 10465 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:59:05 ctl02 nova-api[10465]: 2017-09-28 11:59:05.811 10465 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:59:05 ctl02 nova-api[10465]: 2017-09-28 11:59:05.811 10465 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:59:05 ctl02 nova-api[10465]: 2017-09-28 11:59:05.811 10465 ERROR nova     sock.listen(backlog)
Sep 28 11:59:05 ctl02 nova-api[10465]: 2017-09-28 11:59:05.811 10465 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:59:05 ctl02 nova-api[10465]: 2017-09-28 11:59:05.811 10465 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:59:05 ctl02 nova-api[10465]: 2017-09-28 11:59:05.811 10465 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:59:05 ctl02 nova-api[10465]: 2017-09-28 11:59:05.811 10465 ERROR nova
Sep 28 11:59:05 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:59:05 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:59:05 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:59:06 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:59:06 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:59:06 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:59:06 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:59:07 ctl02 glance-api[29183]: 2017-09-28 11:59:07.084 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:59:07] "OPTIONS / HTTP/1.0" 200 134 0.000552
Sep 28 11:59:07 ctl02 nova-api[10482]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:59:07 ctl02 nova-api[10482]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:59:07 ctl02 nova-api[10482]: 2017-09-28 11:59:07.860 10482 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:59:07 ctl02 nova-api[10482]: 2017-09-28 11:59:07.862 10482 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:59:07 ctl02 nova-api[10482]: 2017-09-28 11:59:07.862 10482 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:59:07 ctl02 nova-api[10482]: 2017-09-28 11:59:07.862 10482 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:59:07 ctl02 nova-api[10482]: 2017-09-28 11:59:07.862 10482 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:59:07 ctl02 nova-api[10482]: 2017-09-28 11:59:07.862 10482 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:59:07 ctl02 nova-api[10482]: 2017-09-28 11:59:07.862 10482 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:59:07 ctl02 nova-api[10482]: 2017-09-28 11:59:07.862 10482 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:59:07 ctl02 nova-api[10482]: 2017-09-28 11:59:07.862 10482 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:59:07 ctl02 nova-api[10482]: 2017-09-28 11:59:07.862 10482 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:59:07 ctl02 nova-api[10482]: 2017-09-28 11:59:07.862 10482 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:59:07 ctl02 nova-api[10482]: 2017-09-28 11:59:07.862 10482 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:59:07 ctl02 nova-api[10482]: 2017-09-28 11:59:07.862 10482 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:59:07 ctl02 nova-api[10482]: 2017-09-28 11:59:07.862 10482 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:59:07 ctl02 nova-api[10482]: 2017-09-28 11:59:07.862 10482 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:59:07 ctl02 nova-api[10482]: 2017-09-28 11:59:07.862 10482 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:59:07 ctl02 nova-api[10482]: 2017-09-28 11:59:07.862 10482 ERROR nova.wsgi     self.filename))
Sep 28 11:59:07 ctl02 nova-api[10482]: 2017-09-28 11:59:07.862 10482 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:59:07 ctl02 nova-api[10482]: 2017-09-28 11:59:07.862 10482 ERROR nova.wsgi
Sep 28 11:59:07 ctl02 nova-api[10482]: 2017-09-28 11:59:07.863 10482 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:59:07 ctl02 nova-api[10482]: 2017-09-28 11:59:07.997 10482 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:59:08 ctl02 nova-api[10482]: 2017-09-28 11:59:08.240 10482 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:59:08 ctl02 nova-api[10482]: 2017-09-28 11:59:08.242 10482 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:59:08 ctl02 nova-api[10482]: 2017-09-28 11:59:08.242 10482 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:59:08 ctl02 nova-api[10482]: 2017-09-28 11:59:08.243 10482 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:59:08 ctl02 nova-api[10482]: 2017-09-28 11:59:08.375 10482 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:59:08 ctl02 nova-api[10482]: 2017-09-28 11:59:08.377 10482 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:59:08 ctl02 nova-api[10482]: 2017-09-28 11:59:08.377 10482 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:59:08 ctl02 nova-api[10482]: 2017-09-28 11:59:08.377 10482 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:59:08 ctl02 nova-api[10482]: 2017-09-28 11:59:08.381 10482 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:59:08 ctl02 nova-api[10482]: 2017-09-28 11:59:08.381 10482 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:59:08 ctl02 nova-api[10482]: 2017-09-28 11:59:08.381 10482 ERROR nova Traceback (most recent call last):
Sep 28 11:59:08 ctl02 nova-api[10482]: 2017-09-28 11:59:08.381 10482 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:59:08 ctl02 nova-api[10482]: 2017-09-28 11:59:08.381 10482 ERROR nova     sys.exit(main())
Sep 28 11:59:08 ctl02 nova-api[10482]: 2017-09-28 11:59:08.381 10482 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:59:08 ctl02 nova-api[10482]: 2017-09-28 11:59:08.381 10482 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:59:08 ctl02 nova-api[10482]: 2017-09-28 11:59:08.381 10482 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:59:08 ctl02 nova-api[10482]: 2017-09-28 11:59:08.381 10482 ERROR nova     max_url_len=max_url_len)
Sep 28 11:59:08 ctl02 nova-api[10482]: 2017-09-28 11:59:08.381 10482 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:59:08 ctl02 nova-api[10482]: 2017-09-28 11:59:08.381 10482 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:59:08 ctl02 nova-api[10482]: 2017-09-28 11:59:08.381 10482 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:59:08 ctl02 nova-api[10482]: 2017-09-28 11:59:08.381 10482 ERROR nova     sock.listen(backlog)
Sep 28 11:59:08 ctl02 nova-api[10482]: 2017-09-28 11:59:08.381 10482 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:59:08 ctl02 nova-api[10482]: 2017-09-28 11:59:08.381 10482 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:59:08 ctl02 nova-api[10482]: 2017-09-28 11:59:08.381 10482 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:59:08 ctl02 nova-api[10482]: 2017-09-28 11:59:08.381 10482 ERROR nova
Sep 28 11:59:08 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:59:08 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:59:08 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:59:08 ctl02 glance-api[29183]: 2017-09-28 11:59:08.657 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:59:08] "OPTIONS / HTTP/1.0" 200 134 0.000665
Sep 28 11:59:08 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:59:08 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:59:08 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:59:08 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:59:09 ctl02 nova-consoleauth[5433]: 2017-09-28 11:59:09.460 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:59:09 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command state.sls with jid 20170928115909631205
Sep 28 11:59:09 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 10512
Sep 28 11:59:10 ctl02 nova-api[10501]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:59:10 ctl02 nova-api[10501]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:59:10 ctl02 nova-api[10501]: 2017-09-28 11:59:10.616 10501 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:59:10 ctl02 nova-api[10501]: 2017-09-28 11:59:10.618 10501 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:59:10 ctl02 nova-api[10501]: 2017-09-28 11:59:10.618 10501 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:59:10 ctl02 nova-api[10501]: 2017-09-28 11:59:10.618 10501 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:59:10 ctl02 nova-api[10501]: 2017-09-28 11:59:10.618 10501 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:59:10 ctl02 nova-api[10501]: 2017-09-28 11:59:10.618 10501 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:59:10 ctl02 nova-api[10501]: 2017-09-28 11:59:10.618 10501 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:59:10 ctl02 nova-api[10501]: 2017-09-28 11:59:10.618 10501 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:59:10 ctl02 nova-api[10501]: 2017-09-28 11:59:10.618 10501 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:59:10 ctl02 nova-api[10501]: 2017-09-28 11:59:10.618 10501 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:59:10 ctl02 nova-api[10501]: 2017-09-28 11:59:10.618 10501 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:59:10 ctl02 nova-api[10501]: 2017-09-28 11:59:10.618 10501 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:59:10 ctl02 nova-api[10501]: 2017-09-28 11:59:10.618 10501 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:59:10 ctl02 nova-api[10501]: 2017-09-28 11:59:10.618 10501 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:59:10 ctl02 nova-api[10501]: 2017-09-28 11:59:10.618 10501 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:59:10 ctl02 nova-api[10501]: 2017-09-28 11:59:10.618 10501 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:59:10 ctl02 nova-api[10501]: 2017-09-28 11:59:10.618 10501 ERROR nova.wsgi     self.filename))
Sep 28 11:59:10 ctl02 nova-api[10501]: 2017-09-28 11:59:10.618 10501 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:59:10 ctl02 nova-api[10501]: 2017-09-28 11:59:10.618 10501 ERROR nova.wsgi
Sep 28 11:59:10 ctl02 nova-api[10501]: 2017-09-28 11:59:10.620 10501 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:59:10 ctl02 nova-api[10501]: 2017-09-28 11:59:10.748 10501 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:59:10 ctl02 nova-api[10501]: 2017-09-28 11:59:10.973 10501 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:59:10 ctl02 nova-api[10501]: 2017-09-28 11:59:10.976 10501 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:59:10 ctl02 nova-api[10501]: 2017-09-28 11:59:10.976 10501 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:59:10 ctl02 nova-api[10501]: 2017-09-28 11:59:10.976 10501 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:59:11 ctl02 nova-api[10501]: 2017-09-28 11:59:11.107 10501 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:59:11 ctl02 nova-api[10501]: 2017-09-28 11:59:11.110 10501 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:59:11 ctl02 nova-api[10501]: 2017-09-28 11:59:11.110 10501 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:59:11 ctl02 nova-api[10501]: 2017-09-28 11:59:11.110 10501 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:59:11 ctl02 nova-api[10501]: 2017-09-28 11:59:11.114 10501 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:59:11 ctl02 nova-api[10501]: 2017-09-28 11:59:11.114 10501 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:59:11 ctl02 nova-api[10501]: 2017-09-28 11:59:11.114 10501 ERROR nova Traceback (most recent call last):
Sep 28 11:59:11 ctl02 nova-api[10501]: 2017-09-28 11:59:11.114 10501 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:59:11 ctl02 nova-api[10501]: 2017-09-28 11:59:11.114 10501 ERROR nova     sys.exit(main())
Sep 28 11:59:11 ctl02 nova-api[10501]: 2017-09-28 11:59:11.114 10501 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:59:11 ctl02 nova-api[10501]: 2017-09-28 11:59:11.114 10501 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:59:11 ctl02 nova-api[10501]: 2017-09-28 11:59:11.114 10501 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:59:11 ctl02 nova-api[10501]: 2017-09-28 11:59:11.114 10501 ERROR nova     max_url_len=max_url_len)
Sep 28 11:59:11 ctl02 nova-api[10501]: 2017-09-28 11:59:11.114 10501 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:59:11 ctl02 nova-api[10501]: 2017-09-28 11:59:11.114 10501 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:59:11 ctl02 nova-api[10501]: 2017-09-28 11:59:11.114 10501 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:59:11 ctl02 nova-api[10501]: 2017-09-28 11:59:11.114 10501 ERROR nova     sock.listen(backlog)
Sep 28 11:59:11 ctl02 nova-api[10501]: 2017-09-28 11:59:11.114 10501 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:59:11 ctl02 nova-api[10501]: 2017-09-28 11:59:11.114 10501 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:59:11 ctl02 nova-api[10501]: 2017-09-28 11:59:11.114 10501 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:59:11 ctl02 nova-api[10501]: 2017-09-28 11:59:11.114 10501 ERROR nova
Sep 28 11:59:11 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:59:11 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:59:11 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:59:11 ctl02 salt-minion[14967]: [INFO    ] Loading fresh modules for state activity
Sep 28 11:59:11 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'heat/init.sls'
Sep 28 11:59:11 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'heat/server.sls'
Sep 28 11:59:11 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'heat/map.jinja'
Sep 28 11:59:11 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:59:11 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:59:11 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:59:11 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:59:12 ctl02 salt-minion[14967]: [INFO    ] Running state [heat-api-cloudwatch] at time 11:59:12.178704
Sep 28 11:59:12 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for heat-api-cloudwatch
Sep 28 11:59:12 ctl02 salt-minion[14967]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 11:59:12 ctl02 nova-scheduler[5620]: 2017-09-28 11:59:12.488 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:59:12 ctl02 salt-minion[14967]: [INFO    ] Executing command ['apt-get', '-q', 'update'] in directory '/root'
Sep 28 11:59:13 ctl02 nova-api[10527]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:59:13 ctl02 nova-api[10527]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:59:13 ctl02 nova-api[10527]: 2017-09-28 11:59:13.337 10527 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:59:13 ctl02 nova-api[10527]: 2017-09-28 11:59:13.339 10527 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:59:13 ctl02 nova-api[10527]: 2017-09-28 11:59:13.339 10527 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:59:13 ctl02 nova-api[10527]: 2017-09-28 11:59:13.339 10527 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:59:13 ctl02 nova-api[10527]: 2017-09-28 11:59:13.339 10527 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:59:13 ctl02 nova-api[10527]: 2017-09-28 11:59:13.339 10527 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:59:13 ctl02 nova-api[10527]: 2017-09-28 11:59:13.339 10527 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:59:13 ctl02 nova-api[10527]: 2017-09-28 11:59:13.339 10527 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:59:13 ctl02 nova-api[10527]: 2017-09-28 11:59:13.339 10527 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:59:13 ctl02 nova-api[10527]: 2017-09-28 11:59:13.339 10527 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:59:13 ctl02 nova-api[10527]: 2017-09-28 11:59:13.339 10527 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:59:13 ctl02 nova-api[10527]: 2017-09-28 11:59:13.339 10527 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:59:13 ctl02 nova-api[10527]: 2017-09-28 11:59:13.339 10527 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:59:13 ctl02 nova-api[10527]: 2017-09-28 11:59:13.339 10527 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:59:13 ctl02 nova-api[10527]: 2017-09-28 11:59:13.339 10527 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:59:13 ctl02 nova-api[10527]: 2017-09-28 11:59:13.339 10527 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:59:13 ctl02 nova-api[10527]: 2017-09-28 11:59:13.339 10527 ERROR nova.wsgi     self.filename))
Sep 28 11:59:13 ctl02 nova-api[10527]: 2017-09-28 11:59:13.339 10527 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:59:13 ctl02 nova-api[10527]: 2017-09-28 11:59:13.339 10527 ERROR nova.wsgi
Sep 28 11:59:13 ctl02 nova-api[10527]: 2017-09-28 11:59:13.340 10527 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:59:13 ctl02 nova-api[10527]: 2017-09-28 11:59:13.472 10527 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:59:13 ctl02 nova-api[10527]: 2017-09-28 11:59:13.718 10527 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:59:13 ctl02 nova-api[10527]: 2017-09-28 11:59:13.720 10527 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:59:13 ctl02 nova-api[10527]: 2017-09-28 11:59:13.720 10527 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:59:13 ctl02 nova-api[10527]: 2017-09-28 11:59:13.720 10527 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:59:13 ctl02 nova-api[10527]: 2017-09-28 11:59:13.853 10527 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:59:13 ctl02 nova-api[10527]: 2017-09-28 11:59:13.855 10527 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:59:13 ctl02 nova-api[10527]: 2017-09-28 11:59:13.855 10527 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:59:13 ctl02 nova-api[10527]: 2017-09-28 11:59:13.856 10527 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:59:13 ctl02 nova-api[10527]: 2017-09-28 11:59:13.859 10527 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:59:13 ctl02 nova-api[10527]: 2017-09-28 11:59:13.859 10527 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:59:13 ctl02 nova-api[10527]: 2017-09-28 11:59:13.859 10527 ERROR nova Traceback (most recent call last):
Sep 28 11:59:13 ctl02 nova-api[10527]: 2017-09-28 11:59:13.859 10527 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:59:13 ctl02 nova-api[10527]: 2017-09-28 11:59:13.859 10527 ERROR nova     sys.exit(main())
Sep 28 11:59:13 ctl02 nova-api[10527]: 2017-09-28 11:59:13.859 10527 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:59:13 ctl02 nova-api[10527]: 2017-09-28 11:59:13.859 10527 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:59:13 ctl02 nova-api[10527]: 2017-09-28 11:59:13.859 10527 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:59:13 ctl02 nova-api[10527]: 2017-09-28 11:59:13.859 10527 ERROR nova     max_url_len=max_url_len)
Sep 28 11:59:13 ctl02 nova-api[10527]: 2017-09-28 11:59:13.859 10527 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:59:13 ctl02 nova-api[10527]: 2017-09-28 11:59:13.859 10527 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:59:13 ctl02 nova-api[10527]: 2017-09-28 11:59:13.859 10527 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:59:13 ctl02 nova-api[10527]: 2017-09-28 11:59:13.859 10527 ERROR nova     sock.listen(backlog)
Sep 28 11:59:13 ctl02 nova-api[10527]: 2017-09-28 11:59:13.859 10527 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:59:13 ctl02 nova-api[10527]: 2017-09-28 11:59:13.859 10527 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:59:13 ctl02 nova-api[10527]: 2017-09-28 11:59:13.859 10527 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:59:13 ctl02 nova-api[10527]: 2017-09-28 11:59:13.859 10527 ERROR nova
Sep 28 11:59:14 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:59:14 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:59:14 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:59:14 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:59:14 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:59:14 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:59:14 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:59:14 ctl02 glance-api[29183]: 2017-09-28 11:59:14.277 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:59:14] "OPTIONS / HTTP/1.0" 200 134 0.000557
Sep 28 11:59:14 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7ab76e56)
Sep 28 11:59:15 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7ab76e56)
Sep 28 11:59:15 ctl02 nova-api[10822]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:59:15 ctl02 nova-api[10822]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:59:15 ctl02 nova-api[10822]: 2017-09-28 11:59:15.836 10822 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:59:15 ctl02 nova-api[10822]: 2017-09-28 11:59:15.837 10822 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:59:15 ctl02 nova-api[10822]: 2017-09-28 11:59:15.837 10822 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:59:15 ctl02 nova-api[10822]: 2017-09-28 11:59:15.837 10822 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:59:15 ctl02 nova-api[10822]: 2017-09-28 11:59:15.837 10822 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:59:15 ctl02 nova-api[10822]: 2017-09-28 11:59:15.837 10822 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:59:15 ctl02 nova-api[10822]: 2017-09-28 11:59:15.837 10822 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:59:15 ctl02 nova-api[10822]: 2017-09-28 11:59:15.837 10822 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:59:15 ctl02 nova-api[10822]: 2017-09-28 11:59:15.837 10822 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:59:15 ctl02 nova-api[10822]: 2017-09-28 11:59:15.837 10822 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:59:15 ctl02 nova-api[10822]: 2017-09-28 11:59:15.837 10822 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:59:15 ctl02 nova-api[10822]: 2017-09-28 11:59:15.837 10822 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:59:15 ctl02 nova-api[10822]: 2017-09-28 11:59:15.837 10822 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:59:15 ctl02 nova-api[10822]: 2017-09-28 11:59:15.837 10822 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:59:15 ctl02 nova-api[10822]: 2017-09-28 11:59:15.837 10822 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:59:15 ctl02 nova-api[10822]: 2017-09-28 11:59:15.837 10822 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:59:15 ctl02 nova-api[10822]: 2017-09-28 11:59:15.837 10822 ERROR nova.wsgi     self.filename))
Sep 28 11:59:15 ctl02 nova-api[10822]: 2017-09-28 11:59:15.837 10822 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:59:15 ctl02 nova-api[10822]: 2017-09-28 11:59:15.837 10822 ERROR nova.wsgi
Sep 28 11:59:15 ctl02 nova-api[10822]: 2017-09-28 11:59:15.838 10822 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:59:15 ctl02 nova-api[10822]: 2017-09-28 11:59:15.971 10822 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:59:16 ctl02 nova-api[10822]: 2017-09-28 11:59:16.220 10822 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:59:16 ctl02 nova-api[10822]: 2017-09-28 11:59:16.222 10822 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:59:16 ctl02 nova-api[10822]: 2017-09-28 11:59:16.222 10822 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:59:16 ctl02 nova-api[10822]: 2017-09-28 11:59:16.222 10822 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:59:16 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7ab76e56)
Sep 28 11:59:16 ctl02 nova-api[10822]: 2017-09-28 11:59:16.354 10822 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:59:16 ctl02 nova-api[10822]: 2017-09-28 11:59:16.356 10822 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:59:16 ctl02 nova-api[10822]: 2017-09-28 11:59:16.356 10822 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:59:16 ctl02 nova-api[10822]: 2017-09-28 11:59:16.357 10822 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:59:16 ctl02 nova-api[10822]: 2017-09-28 11:59:16.360 10822 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:59:16 ctl02 nova-api[10822]: 2017-09-28 11:59:16.361 10822 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:59:16 ctl02 nova-api[10822]: 2017-09-28 11:59:16.361 10822 ERROR nova Traceback (most recent call last):
Sep 28 11:59:16 ctl02 nova-api[10822]: 2017-09-28 11:59:16.361 10822 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:59:16 ctl02 nova-api[10822]: 2017-09-28 11:59:16.361 10822 ERROR nova     sys.exit(main())
Sep 28 11:59:16 ctl02 nova-api[10822]: 2017-09-28 11:59:16.361 10822 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:59:16 ctl02 nova-api[10822]: 2017-09-28 11:59:16.361 10822 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:59:16 ctl02 nova-api[10822]: 2017-09-28 11:59:16.361 10822 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:59:16 ctl02 nova-api[10822]: 2017-09-28 11:59:16.361 10822 ERROR nova     max_url_len=max_url_len)
Sep 28 11:59:16 ctl02 nova-api[10822]: 2017-09-28 11:59:16.361 10822 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:59:16 ctl02 nova-api[10822]: 2017-09-28 11:59:16.361 10822 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:59:16 ctl02 nova-api[10822]: 2017-09-28 11:59:16.361 10822 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:59:16 ctl02 nova-api[10822]: 2017-09-28 11:59:16.361 10822 ERROR nova     sock.listen(backlog)
Sep 28 11:59:16 ctl02 nova-api[10822]: 2017-09-28 11:59:16.361 10822 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:59:16 ctl02 nova-api[10822]: 2017-09-28 11:59:16.361 10822 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:59:16 ctl02 nova-api[10822]: 2017-09-28 11:59:16.361 10822 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:59:16 ctl02 nova-api[10822]: 2017-09-28 11:59:16.361 10822 ERROR nova
Sep 28 11:59:16 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:59:16 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:59:16 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:59:16 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:59:16 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:59:16 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:59:16 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:59:17 ctl02 glance-api[29183]: 2017-09-28 11:59:17.013 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:59:17] "OPTIONS / HTTP/1.0" 200 134 0.000950
Sep 28 11:59:17 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7ab76e56)
Sep 28 11:59:18 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7ab76e56)
Sep 28 11:59:18 ctl02 nova-api[10841]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:59:18 ctl02 nova-api[10841]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:59:18 ctl02 glance-api[29183]: 2017-09-28 11:59:18.409 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:59:18] "OPTIONS / HTTP/1.0" 200 134 0.000596
Sep 28 11:59:18 ctl02 nova-api[10841]: 2017-09-28 11:59:18.572 10841 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:59:18 ctl02 nova-api[10841]: 2017-09-28 11:59:18.573 10841 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:59:18 ctl02 nova-api[10841]: 2017-09-28 11:59:18.573 10841 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:59:18 ctl02 nova-api[10841]: 2017-09-28 11:59:18.573 10841 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:59:18 ctl02 nova-api[10841]: 2017-09-28 11:59:18.573 10841 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:59:18 ctl02 nova-api[10841]: 2017-09-28 11:59:18.573 10841 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:59:18 ctl02 nova-api[10841]: 2017-09-28 11:59:18.573 10841 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:59:18 ctl02 nova-api[10841]: 2017-09-28 11:59:18.573 10841 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:59:18 ctl02 nova-api[10841]: 2017-09-28 11:59:18.573 10841 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:59:18 ctl02 nova-api[10841]: 2017-09-28 11:59:18.573 10841 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:59:18 ctl02 nova-api[10841]: 2017-09-28 11:59:18.573 10841 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:59:18 ctl02 nova-api[10841]: 2017-09-28 11:59:18.573 10841 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:59:18 ctl02 nova-api[10841]: 2017-09-28 11:59:18.573 10841 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:59:18 ctl02 nova-api[10841]: 2017-09-28 11:59:18.573 10841 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:59:18 ctl02 nova-api[10841]: 2017-09-28 11:59:18.573 10841 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:59:18 ctl02 nova-api[10841]: 2017-09-28 11:59:18.573 10841 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:59:18 ctl02 nova-api[10841]: 2017-09-28 11:59:18.573 10841 ERROR nova.wsgi     self.filename))
Sep 28 11:59:18 ctl02 nova-api[10841]: 2017-09-28 11:59:18.573 10841 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:59:18 ctl02 nova-api[10841]: 2017-09-28 11:59:18.573 10841 ERROR nova.wsgi
Sep 28 11:59:18 ctl02 nova-api[10841]: 2017-09-28 11:59:18.574 10841 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:59:18 ctl02 nova-api[10841]: 2017-09-28 11:59:18.702 10841 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:59:18 ctl02 nova-api[10841]: 2017-09-28 11:59:18.936 10841 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:59:18 ctl02 nova-api[10841]: 2017-09-28 11:59:18.938 10841 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:59:18 ctl02 nova-api[10841]: 2017-09-28 11:59:18.938 10841 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:59:18 ctl02 nova-api[10841]: 2017-09-28 11:59:18.938 10841 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:59:19 ctl02 nova-api[10841]: 2017-09-28 11:59:19.066 10841 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:59:19 ctl02 nova-api[10841]: 2017-09-28 11:59:19.068 10841 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:59:19 ctl02 nova-api[10841]: 2017-09-28 11:59:19.069 10841 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:59:19 ctl02 nova-api[10841]: 2017-09-28 11:59:19.069 10841 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:59:19 ctl02 nova-api[10841]: 2017-09-28 11:59:19.072 10841 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:59:19 ctl02 nova-api[10841]: 2017-09-28 11:59:19.072 10841 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:59:19 ctl02 nova-api[10841]: 2017-09-28 11:59:19.072 10841 ERROR nova Traceback (most recent call last):
Sep 28 11:59:19 ctl02 nova-api[10841]: 2017-09-28 11:59:19.072 10841 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:59:19 ctl02 nova-api[10841]: 2017-09-28 11:59:19.072 10841 ERROR nova     sys.exit(main())
Sep 28 11:59:19 ctl02 nova-api[10841]: 2017-09-28 11:59:19.072 10841 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:59:19 ctl02 nova-api[10841]: 2017-09-28 11:59:19.072 10841 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:59:19 ctl02 nova-api[10841]: 2017-09-28 11:59:19.072 10841 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:59:19 ctl02 nova-api[10841]: 2017-09-28 11:59:19.072 10841 ERROR nova     max_url_len=max_url_len)
Sep 28 11:59:19 ctl02 nova-api[10841]: 2017-09-28 11:59:19.072 10841 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:59:19 ctl02 nova-api[10841]: 2017-09-28 11:59:19.072 10841 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:59:19 ctl02 nova-api[10841]: 2017-09-28 11:59:19.072 10841 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:59:19 ctl02 nova-api[10841]: 2017-09-28 11:59:19.072 10841 ERROR nova     sock.listen(backlog)
Sep 28 11:59:19 ctl02 nova-api[10841]: 2017-09-28 11:59:19.072 10841 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:59:19 ctl02 nova-api[10841]: 2017-09-28 11:59:19.072 10841 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:59:19 ctl02 nova-api[10841]: 2017-09-28 11:59:19.072 10841 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:59:19 ctl02 nova-api[10841]: 2017-09-28 11:59:19.072 10841 ERROR nova
Sep 28 11:59:19 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:59:19 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:59:19 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:59:19 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7ab76e56)
Sep 28 11:59:19 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:59:19 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:59:19 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:59:19 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:59:19 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928115919671462
Sep 28 11:59:19 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 10870
Sep 28 11:59:19 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928115919671462
Sep 28 11:59:20 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7ab76e56)
Sep 28 11:59:20 ctl02 nova-api[10859]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:59:20 ctl02 nova-api[10859]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:59:21 ctl02 nova-api[10859]: 2017-09-28 11:59:21.059 10859 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:59:21 ctl02 nova-api[10859]: 2017-09-28 11:59:21.060 10859 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:59:21 ctl02 nova-api[10859]: 2017-09-28 11:59:21.060 10859 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:59:21 ctl02 nova-api[10859]: 2017-09-28 11:59:21.060 10859 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:59:21 ctl02 nova-api[10859]: 2017-09-28 11:59:21.060 10859 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:59:21 ctl02 nova-api[10859]: 2017-09-28 11:59:21.060 10859 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:59:21 ctl02 nova-api[10859]: 2017-09-28 11:59:21.060 10859 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:59:21 ctl02 nova-api[10859]: 2017-09-28 11:59:21.060 10859 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:59:21 ctl02 nova-api[10859]: 2017-09-28 11:59:21.060 10859 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:59:21 ctl02 nova-api[10859]: 2017-09-28 11:59:21.060 10859 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:59:21 ctl02 nova-api[10859]: 2017-09-28 11:59:21.060 10859 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:59:21 ctl02 nova-api[10859]: 2017-09-28 11:59:21.060 10859 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:59:21 ctl02 nova-api[10859]: 2017-09-28 11:59:21.060 10859 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:59:21 ctl02 nova-api[10859]: 2017-09-28 11:59:21.060 10859 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:59:21 ctl02 nova-api[10859]: 2017-09-28 11:59:21.060 10859 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:59:21 ctl02 nova-api[10859]: 2017-09-28 11:59:21.060 10859 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:59:21 ctl02 nova-api[10859]: 2017-09-28 11:59:21.060 10859 ERROR nova.wsgi     self.filename))
Sep 28 11:59:21 ctl02 nova-api[10859]: 2017-09-28 11:59:21.060 10859 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:59:21 ctl02 nova-api[10859]: 2017-09-28 11:59:21.060 10859 ERROR nova.wsgi
Sep 28 11:59:21 ctl02 nova-api[10859]: 2017-09-28 11:59:21.063 10859 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:59:21 ctl02 nova-api[10859]: 2017-09-28 11:59:21.194 10859 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:59:21 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7ab76e56)
Sep 28 11:59:21 ctl02 nova-api[10859]: 2017-09-28 11:59:21.431 10859 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:59:21 ctl02 nova-api[10859]: 2017-09-28 11:59:21.434 10859 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:59:21 ctl02 nova-api[10859]: 2017-09-28 11:59:21.435 10859 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:59:21 ctl02 nova-api[10859]: 2017-09-28 11:59:21.435 10859 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:59:21 ctl02 nova-api[10859]: 2017-09-28 11:59:21.563 10859 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:59:21 ctl02 nova-api[10859]: 2017-09-28 11:59:21.566 10859 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:59:21 ctl02 nova-api[10859]: 2017-09-28 11:59:21.567 10859 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:59:21 ctl02 nova-api[10859]: 2017-09-28 11:59:21.567 10859 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:59:21 ctl02 nova-api[10859]: 2017-09-28 11:59:21.571 10859 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:59:21 ctl02 nova-api[10859]: 2017-09-28 11:59:21.571 10859 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:59:21 ctl02 nova-api[10859]: 2017-09-28 11:59:21.571 10859 ERROR nova Traceback (most recent call last):
Sep 28 11:59:21 ctl02 nova-api[10859]: 2017-09-28 11:59:21.571 10859 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:59:21 ctl02 nova-api[10859]: 2017-09-28 11:59:21.571 10859 ERROR nova     sys.exit(main())
Sep 28 11:59:21 ctl02 nova-api[10859]: 2017-09-28 11:59:21.571 10859 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:59:21 ctl02 nova-api[10859]: 2017-09-28 11:59:21.571 10859 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:59:21 ctl02 nova-api[10859]: 2017-09-28 11:59:21.571 10859 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:59:21 ctl02 nova-api[10859]: 2017-09-28 11:59:21.571 10859 ERROR nova     max_url_len=max_url_len)
Sep 28 11:59:21 ctl02 nova-api[10859]: 2017-09-28 11:59:21.571 10859 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:59:21 ctl02 nova-api[10859]: 2017-09-28 11:59:21.571 10859 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:59:21 ctl02 nova-api[10859]: 2017-09-28 11:59:21.571 10859 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:59:21 ctl02 nova-api[10859]: 2017-09-28 11:59:21.571 10859 ERROR nova     sock.listen(backlog)
Sep 28 11:59:21 ctl02 nova-api[10859]: 2017-09-28 11:59:21.571 10859 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:59:21 ctl02 nova-api[10859]: 2017-09-28 11:59:21.571 10859 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:59:21 ctl02 nova-api[10859]: 2017-09-28 11:59:21.571 10859 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:59:21 ctl02 nova-api[10859]: 2017-09-28 11:59:21.571 10859 ERROR nova
Sep 28 11:59:21 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:59:21 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:59:21 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:59:21 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:59:21 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:59:21 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:59:21 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:59:22 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7ab76e56)
Sep 28 11:59:23 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7ab76e56)
Sep 28 11:59:23 ctl02 nova-api[10881]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:59:23 ctl02 nova-api[10881]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:59:23 ctl02 nova-api[10881]: 2017-09-28 11:59:23.577 10881 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:59:23 ctl02 nova-api[10881]: 2017-09-28 11:59:23.578 10881 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:59:23 ctl02 nova-api[10881]: 2017-09-28 11:59:23.578 10881 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:59:23 ctl02 nova-api[10881]: 2017-09-28 11:59:23.578 10881 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:59:23 ctl02 nova-api[10881]: 2017-09-28 11:59:23.578 10881 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:59:23 ctl02 nova-api[10881]: 2017-09-28 11:59:23.578 10881 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:59:23 ctl02 nova-api[10881]: 2017-09-28 11:59:23.578 10881 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:59:23 ctl02 nova-api[10881]: 2017-09-28 11:59:23.578 10881 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:59:23 ctl02 nova-api[10881]: 2017-09-28 11:59:23.578 10881 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:59:23 ctl02 nova-api[10881]: 2017-09-28 11:59:23.578 10881 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:59:23 ctl02 nova-api[10881]: 2017-09-28 11:59:23.578 10881 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:59:23 ctl02 nova-api[10881]: 2017-09-28 11:59:23.578 10881 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:59:23 ctl02 nova-api[10881]: 2017-09-28 11:59:23.578 10881 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:59:23 ctl02 nova-api[10881]: 2017-09-28 11:59:23.578 10881 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:59:23 ctl02 nova-api[10881]: 2017-09-28 11:59:23.578 10881 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:59:23 ctl02 nova-api[10881]: 2017-09-28 11:59:23.578 10881 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:59:23 ctl02 nova-api[10881]: 2017-09-28 11:59:23.578 10881 ERROR nova.wsgi     self.filename))
Sep 28 11:59:23 ctl02 nova-api[10881]: 2017-09-28 11:59:23.578 10881 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:59:23 ctl02 nova-api[10881]: 2017-09-28 11:59:23.578 10881 ERROR nova.wsgi
Sep 28 11:59:23 ctl02 nova-api[10881]: 2017-09-28 11:59:23.579 10881 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:59:23 ctl02 nova-api[10881]: 2017-09-28 11:59:23.711 10881 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:59:23 ctl02 glance-api[29183]: 2017-09-28 11:59:23.897 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:59:23] "OPTIONS / HTTP/1.0" 200 134 0.000651
Sep 28 11:59:23 ctl02 nova-api[10881]: 2017-09-28 11:59:23.949 10881 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:59:23 ctl02 nova-api[10881]: 2017-09-28 11:59:23.951 10881 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:59:23 ctl02 nova-api[10881]: 2017-09-28 11:59:23.951 10881 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:59:23 ctl02 nova-api[10881]: 2017-09-28 11:59:23.952 10881 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:59:24 ctl02 nova-api[10881]: 2017-09-28 11:59:24.080 10881 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:59:24 ctl02 nova-api[10881]: 2017-09-28 11:59:24.082 10881 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:59:24 ctl02 nova-api[10881]: 2017-09-28 11:59:24.082 10881 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:59:24 ctl02 nova-api[10881]: 2017-09-28 11:59:24.082 10881 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:59:24 ctl02 nova-api[10881]: 2017-09-28 11:59:24.085 10881 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:59:24 ctl02 nova-api[10881]: 2017-09-28 11:59:24.086 10881 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:59:24 ctl02 nova-api[10881]: 2017-09-28 11:59:24.086 10881 ERROR nova Traceback (most recent call last):
Sep 28 11:59:24 ctl02 nova-api[10881]: 2017-09-28 11:59:24.086 10881 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:59:24 ctl02 nova-api[10881]: 2017-09-28 11:59:24.086 10881 ERROR nova     sys.exit(main())
Sep 28 11:59:24 ctl02 nova-api[10881]: 2017-09-28 11:59:24.086 10881 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:59:24 ctl02 nova-api[10881]: 2017-09-28 11:59:24.086 10881 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:59:24 ctl02 nova-api[10881]: 2017-09-28 11:59:24.086 10881 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:59:24 ctl02 nova-api[10881]: 2017-09-28 11:59:24.086 10881 ERROR nova     max_url_len=max_url_len)
Sep 28 11:59:24 ctl02 nova-api[10881]: 2017-09-28 11:59:24.086 10881 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:59:24 ctl02 nova-api[10881]: 2017-09-28 11:59:24.086 10881 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:59:24 ctl02 nova-api[10881]: 2017-09-28 11:59:24.086 10881 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:59:24 ctl02 nova-api[10881]: 2017-09-28 11:59:24.086 10881 ERROR nova     sock.listen(backlog)
Sep 28 11:59:24 ctl02 nova-api[10881]: 2017-09-28 11:59:24.086 10881 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:59:24 ctl02 nova-api[10881]: 2017-09-28 11:59:24.086 10881 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:59:24 ctl02 nova-api[10881]: 2017-09-28 11:59:24.086 10881 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:59:24 ctl02 nova-api[10881]: 2017-09-28 11:59:24.086 10881 ERROR nova
Sep 28 11:59:24 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:59:24 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:59:24 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:59:24 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7ab76e56)
Sep 28 11:59:24 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:59:24 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:59:24 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:59:24 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:59:25 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:59:25 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:59:25 ctl02 nova-api[10900]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:59:25 ctl02 nova-api[10900]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:59:26 ctl02 nova-api[10900]: 2017-09-28 11:59:26.052 10900 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:59:26 ctl02 nova-api[10900]: 2017-09-28 11:59:26.053 10900 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:59:26 ctl02 nova-api[10900]: 2017-09-28 11:59:26.053 10900 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:59:26 ctl02 nova-api[10900]: 2017-09-28 11:59:26.053 10900 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:59:26 ctl02 nova-api[10900]: 2017-09-28 11:59:26.053 10900 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:59:26 ctl02 nova-api[10900]: 2017-09-28 11:59:26.053 10900 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:59:26 ctl02 nova-api[10900]: 2017-09-28 11:59:26.053 10900 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:59:26 ctl02 nova-api[10900]: 2017-09-28 11:59:26.053 10900 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:59:26 ctl02 nova-api[10900]: 2017-09-28 11:59:26.053 10900 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:59:26 ctl02 nova-api[10900]: 2017-09-28 11:59:26.053 10900 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:59:26 ctl02 nova-api[10900]: 2017-09-28 11:59:26.053 10900 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:59:26 ctl02 nova-api[10900]: 2017-09-28 11:59:26.053 10900 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:59:26 ctl02 nova-api[10900]: 2017-09-28 11:59:26.053 10900 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:59:26 ctl02 nova-api[10900]: 2017-09-28 11:59:26.053 10900 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:59:26 ctl02 nova-api[10900]: 2017-09-28 11:59:26.053 10900 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:59:26 ctl02 nova-api[10900]: 2017-09-28 11:59:26.053 10900 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:59:26 ctl02 nova-api[10900]: 2017-09-28 11:59:26.053 10900 ERROR nova.wsgi     self.filename))
Sep 28 11:59:26 ctl02 nova-api[10900]: 2017-09-28 11:59:26.053 10900 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:59:26 ctl02 nova-api[10900]: 2017-09-28 11:59:26.053 10900 ERROR nova.wsgi
Sep 28 11:59:26 ctl02 nova-api[10900]: 2017-09-28 11:59:26.054 10900 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:59:26 ctl02 nova-api[10900]: 2017-09-28 11:59:26.182 10900 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:59:26 ctl02 nova-api[10900]: 2017-09-28 11:59:26.420 10900 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:59:26 ctl02 nova-api[10900]: 2017-09-28 11:59:26.422 10900 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:59:26 ctl02 nova-api[10900]: 2017-09-28 11:59:26.423 10900 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:59:26 ctl02 nova-api[10900]: 2017-09-28 11:59:26.423 10900 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:59:26 ctl02 nova-api[10900]: 2017-09-28 11:59:26.552 10900 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:59:26 ctl02 nova-api[10900]: 2017-09-28 11:59:26.554 10900 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:59:26 ctl02 nova-api[10900]: 2017-09-28 11:59:26.554 10900 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:59:26 ctl02 nova-api[10900]: 2017-09-28 11:59:26.554 10900 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:59:26 ctl02 nova-api[10900]: 2017-09-28 11:59:26.558 10900 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:59:26 ctl02 nova-api[10900]: 2017-09-28 11:59:26.558 10900 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:59:26 ctl02 nova-api[10900]: 2017-09-28 11:59:26.558 10900 ERROR nova Traceback (most recent call last):
Sep 28 11:59:26 ctl02 nova-api[10900]: 2017-09-28 11:59:26.558 10900 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:59:26 ctl02 nova-api[10900]: 2017-09-28 11:59:26.558 10900 ERROR nova     sys.exit(main())
Sep 28 11:59:26 ctl02 nova-api[10900]: 2017-09-28 11:59:26.558 10900 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:59:26 ctl02 nova-api[10900]: 2017-09-28 11:59:26.558 10900 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:59:26 ctl02 nova-api[10900]: 2017-09-28 11:59:26.558 10900 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:59:26 ctl02 nova-api[10900]: 2017-09-28 11:59:26.558 10900 ERROR nova     max_url_len=max_url_len)
Sep 28 11:59:26 ctl02 nova-api[10900]: 2017-09-28 11:59:26.558 10900 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:59:26 ctl02 nova-api[10900]: 2017-09-28 11:59:26.558 10900 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:59:26 ctl02 nova-api[10900]: 2017-09-28 11:59:26.558 10900 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:59:26 ctl02 nova-api[10900]: 2017-09-28 11:59:26.558 10900 ERROR nova     sock.listen(backlog)
Sep 28 11:59:26 ctl02 nova-api[10900]: 2017-09-28 11:59:26.558 10900 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:59:26 ctl02 nova-api[10900]: 2017-09-28 11:59:26.558 10900 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:59:26 ctl02 nova-api[10900]: 2017-09-28 11:59:26.558 10900 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:59:26 ctl02 nova-api[10900]: 2017-09-28 11:59:26.558 10900 ERROR nova
Sep 28 11:59:26 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:59:26 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:59:26 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:59:26 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:59:26 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:59:26 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:59:26 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:59:27 ctl02 glance-api[29183]: 2017-09-28 11:59:27.199 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:59:27] "OPTIONS / HTTP/1.0" 200 134 0.000834
Sep 28 11:59:28 ctl02 nova-api[10924]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:59:28 ctl02 nova-api[10924]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:59:28 ctl02 glance-api[29183]: 2017-09-28 11:59:28.535 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:59:28] "OPTIONS / HTTP/1.0" 200 134 0.000686
Sep 28 11:59:28 ctl02 nova-api[10924]: 2017-09-28 11:59:28.547 10924 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:59:28 ctl02 nova-api[10924]: 2017-09-28 11:59:28.549 10924 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:59:28 ctl02 nova-api[10924]: 2017-09-28 11:59:28.549 10924 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:59:28 ctl02 nova-api[10924]: 2017-09-28 11:59:28.549 10924 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:59:28 ctl02 nova-api[10924]: 2017-09-28 11:59:28.549 10924 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:59:28 ctl02 nova-api[10924]: 2017-09-28 11:59:28.549 10924 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:59:28 ctl02 nova-api[10924]: 2017-09-28 11:59:28.549 10924 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:59:28 ctl02 nova-api[10924]: 2017-09-28 11:59:28.549 10924 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:59:28 ctl02 nova-api[10924]: 2017-09-28 11:59:28.549 10924 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:59:28 ctl02 nova-api[10924]: 2017-09-28 11:59:28.549 10924 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:59:28 ctl02 nova-api[10924]: 2017-09-28 11:59:28.549 10924 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:59:28 ctl02 nova-api[10924]: 2017-09-28 11:59:28.549 10924 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:59:28 ctl02 nova-api[10924]: 2017-09-28 11:59:28.549 10924 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:59:28 ctl02 nova-api[10924]: 2017-09-28 11:59:28.549 10924 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:59:28 ctl02 nova-api[10924]: 2017-09-28 11:59:28.549 10924 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:59:28 ctl02 nova-api[10924]: 2017-09-28 11:59:28.549 10924 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:59:28 ctl02 nova-api[10924]: 2017-09-28 11:59:28.549 10924 ERROR nova.wsgi     self.filename))
Sep 28 11:59:28 ctl02 nova-api[10924]: 2017-09-28 11:59:28.549 10924 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:59:28 ctl02 nova-api[10924]: 2017-09-28 11:59:28.549 10924 ERROR nova.wsgi
Sep 28 11:59:28 ctl02 nova-api[10924]: 2017-09-28 11:59:28.550 10924 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:59:28 ctl02 nova-api[10924]: 2017-09-28 11:59:28.680 10924 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:59:28 ctl02 nova-api[10924]: 2017-09-28 11:59:28.917 10924 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:59:28 ctl02 nova-api[10924]: 2017-09-28 11:59:28.920 10924 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:59:28 ctl02 nova-api[10924]: 2017-09-28 11:59:28.920 10924 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:59:28 ctl02 nova-api[10924]: 2017-09-28 11:59:28.920 10924 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:59:29 ctl02 nova-api[10924]: 2017-09-28 11:59:29.050 10924 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:59:29 ctl02 nova-api[10924]: 2017-09-28 11:59:29.052 10924 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:59:29 ctl02 nova-api[10924]: 2017-09-28 11:59:29.052 10924 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:59:29 ctl02 nova-api[10924]: 2017-09-28 11:59:29.052 10924 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:59:29 ctl02 nova-api[10924]: 2017-09-28 11:59:29.056 10924 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:59:29 ctl02 nova-api[10924]: 2017-09-28 11:59:29.056 10924 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:59:29 ctl02 nova-api[10924]: 2017-09-28 11:59:29.056 10924 ERROR nova Traceback (most recent call last):
Sep 28 11:59:29 ctl02 nova-api[10924]: 2017-09-28 11:59:29.056 10924 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:59:29 ctl02 nova-api[10924]: 2017-09-28 11:59:29.056 10924 ERROR nova     sys.exit(main())
Sep 28 11:59:29 ctl02 nova-api[10924]: 2017-09-28 11:59:29.056 10924 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:59:29 ctl02 nova-api[10924]: 2017-09-28 11:59:29.056 10924 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:59:29 ctl02 nova-api[10924]: 2017-09-28 11:59:29.056 10924 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:59:29 ctl02 nova-api[10924]: 2017-09-28 11:59:29.056 10924 ERROR nova     max_url_len=max_url_len)
Sep 28 11:59:29 ctl02 nova-api[10924]: 2017-09-28 11:59:29.056 10924 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:59:29 ctl02 nova-api[10924]: 2017-09-28 11:59:29.056 10924 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:59:29 ctl02 nova-api[10924]: 2017-09-28 11:59:29.056 10924 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:59:29 ctl02 nova-api[10924]: 2017-09-28 11:59:29.056 10924 ERROR nova     sock.listen(backlog)
Sep 28 11:59:29 ctl02 nova-api[10924]: 2017-09-28 11:59:29.056 10924 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:59:29 ctl02 nova-api[10924]: 2017-09-28 11:59:29.056 10924 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:59:29 ctl02 nova-api[10924]: 2017-09-28 11:59:29.056 10924 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:59:29 ctl02 nova-api[10924]: 2017-09-28 11:59:29.056 10924 ERROR nova
Sep 28 11:59:29 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:59:29 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:59:29 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:59:29 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:59:29 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:59:29 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:59:29 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:59:29 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928115929813194
Sep 28 11:59:29 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 10954
Sep 28 11:59:29 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928115929813194
Sep 28 11:59:30 ctl02 nova-api[10943]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:59:30 ctl02 nova-api[10943]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:59:31 ctl02 nova-api[10943]: 2017-09-28 11:59:31.113 10943 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:59:31 ctl02 nova-api[10943]: 2017-09-28 11:59:31.115 10943 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:59:31 ctl02 nova-api[10943]: 2017-09-28 11:59:31.115 10943 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:59:31 ctl02 nova-api[10943]: 2017-09-28 11:59:31.115 10943 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:59:31 ctl02 nova-api[10943]: 2017-09-28 11:59:31.115 10943 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:59:31 ctl02 nova-api[10943]: 2017-09-28 11:59:31.115 10943 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:59:31 ctl02 nova-api[10943]: 2017-09-28 11:59:31.115 10943 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:59:31 ctl02 nova-api[10943]: 2017-09-28 11:59:31.115 10943 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:59:31 ctl02 nova-api[10943]: 2017-09-28 11:59:31.115 10943 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:59:31 ctl02 nova-api[10943]: 2017-09-28 11:59:31.115 10943 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:59:31 ctl02 nova-api[10943]: 2017-09-28 11:59:31.115 10943 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:59:31 ctl02 nova-api[10943]: 2017-09-28 11:59:31.115 10943 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:59:31 ctl02 nova-api[10943]: 2017-09-28 11:59:31.115 10943 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:59:31 ctl02 nova-api[10943]: 2017-09-28 11:59:31.115 10943 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:59:31 ctl02 nova-api[10943]: 2017-09-28 11:59:31.115 10943 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:59:31 ctl02 nova-api[10943]: 2017-09-28 11:59:31.115 10943 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:59:31 ctl02 nova-api[10943]: 2017-09-28 11:59:31.115 10943 ERROR nova.wsgi     self.filename))
Sep 28 11:59:31 ctl02 nova-api[10943]: 2017-09-28 11:59:31.115 10943 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:59:31 ctl02 nova-api[10943]: 2017-09-28 11:59:31.115 10943 ERROR nova.wsgi
Sep 28 11:59:31 ctl02 nova-api[10943]: 2017-09-28 11:59:31.117 10943 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:59:31 ctl02 nova-api[10943]: 2017-09-28 11:59:31.251 10943 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:59:31 ctl02 nova-api[10943]: 2017-09-28 11:59:31.498 10943 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:59:31 ctl02 nova-api[10943]: 2017-09-28 11:59:31.501 10943 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:59:31 ctl02 nova-api[10943]: 2017-09-28 11:59:31.501 10943 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:59:31 ctl02 nova-api[10943]: 2017-09-28 11:59:31.501 10943 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:59:31 ctl02 nova-cert[4860]: 2017-09-28 11:59:31.614 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:59:31 ctl02 nova-api[10943]: 2017-09-28 11:59:31.631 10943 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:59:31 ctl02 nova-api[10943]: 2017-09-28 11:59:31.633 10943 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:59:31 ctl02 nova-api[10943]: 2017-09-28 11:59:31.633 10943 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:59:31 ctl02 nova-api[10943]: 2017-09-28 11:59:31.634 10943 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:59:31 ctl02 nova-api[10943]: 2017-09-28 11:59:31.637 10943 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:59:31 ctl02 nova-api[10943]: 2017-09-28 11:59:31.637 10943 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:59:31 ctl02 nova-api[10943]: 2017-09-28 11:59:31.637 10943 ERROR nova Traceback (most recent call last):
Sep 28 11:59:31 ctl02 nova-api[10943]: 2017-09-28 11:59:31.637 10943 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:59:31 ctl02 nova-api[10943]: 2017-09-28 11:59:31.637 10943 ERROR nova     sys.exit(main())
Sep 28 11:59:31 ctl02 nova-api[10943]: 2017-09-28 11:59:31.637 10943 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:59:31 ctl02 nova-api[10943]: 2017-09-28 11:59:31.637 10943 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:59:31 ctl02 nova-api[10943]: 2017-09-28 11:59:31.637 10943 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:59:31 ctl02 nova-api[10943]: 2017-09-28 11:59:31.637 10943 ERROR nova     max_url_len=max_url_len)
Sep 28 11:59:31 ctl02 nova-api[10943]: 2017-09-28 11:59:31.637 10943 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:59:31 ctl02 nova-api[10943]: 2017-09-28 11:59:31.637 10943 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:59:31 ctl02 nova-api[10943]: 2017-09-28 11:59:31.637 10943 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:59:31 ctl02 nova-api[10943]: 2017-09-28 11:59:31.637 10943 ERROR nova     sock.listen(backlog)
Sep 28 11:59:31 ctl02 nova-api[10943]: 2017-09-28 11:59:31.637 10943 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:59:31 ctl02 nova-api[10943]: 2017-09-28 11:59:31.637 10943 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:59:31 ctl02 nova-api[10943]: 2017-09-28 11:59:31.637 10943 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:59:31 ctl02 nova-api[10943]: 2017-09-28 11:59:31.637 10943 ERROR nova
Sep 28 11:59:31 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:59:31 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:59:31 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:59:32 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:59:32 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:59:32 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:59:32 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:59:33 ctl02 glance-api[29183]: 2017-09-28 11:59:33.549 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:59:33] "OPTIONS / HTTP/1.0" 200 134 0.000647
Sep 28 11:59:33 ctl02 nova-api[10965]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:59:33 ctl02 nova-api[10965]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:59:33 ctl02 nova-api[10965]: 2017-09-28 11:59:33.851 10965 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:59:33 ctl02 nova-api[10965]: 2017-09-28 11:59:33.853 10965 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:59:33 ctl02 nova-api[10965]: 2017-09-28 11:59:33.853 10965 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:59:33 ctl02 nova-api[10965]: 2017-09-28 11:59:33.853 10965 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:59:33 ctl02 nova-api[10965]: 2017-09-28 11:59:33.853 10965 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:59:33 ctl02 nova-api[10965]: 2017-09-28 11:59:33.853 10965 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:59:33 ctl02 nova-api[10965]: 2017-09-28 11:59:33.853 10965 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:59:33 ctl02 nova-api[10965]: 2017-09-28 11:59:33.853 10965 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:59:33 ctl02 nova-api[10965]: 2017-09-28 11:59:33.853 10965 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:59:33 ctl02 nova-api[10965]: 2017-09-28 11:59:33.853 10965 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:59:33 ctl02 nova-api[10965]: 2017-09-28 11:59:33.853 10965 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:59:33 ctl02 nova-api[10965]: 2017-09-28 11:59:33.853 10965 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:59:33 ctl02 nova-api[10965]: 2017-09-28 11:59:33.853 10965 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:59:33 ctl02 nova-api[10965]: 2017-09-28 11:59:33.853 10965 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:59:33 ctl02 nova-api[10965]: 2017-09-28 11:59:33.853 10965 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:59:33 ctl02 nova-api[10965]: 2017-09-28 11:59:33.853 10965 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:59:33 ctl02 nova-api[10965]: 2017-09-28 11:59:33.853 10965 ERROR nova.wsgi     self.filename))
Sep 28 11:59:33 ctl02 nova-api[10965]: 2017-09-28 11:59:33.853 10965 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:59:33 ctl02 nova-api[10965]: 2017-09-28 11:59:33.853 10965 ERROR nova.wsgi
Sep 28 11:59:33 ctl02 nova-api[10965]: 2017-09-28 11:59:33.855 10965 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:59:33 ctl02 nova-api[10965]: 2017-09-28 11:59:33.981 10965 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:59:34 ctl02 nova-conductor[5056]: 2017-09-28 11:59:34.215 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:59:34 ctl02 nova-api[10965]: 2017-09-28 11:59:34.220 10965 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:59:34 ctl02 nova-api[10965]: 2017-09-28 11:59:34.222 10965 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:59:34 ctl02 nova-api[10965]: 2017-09-28 11:59:34.223 10965 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:59:34 ctl02 nova-api[10965]: 2017-09-28 11:59:34.223 10965 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:59:34 ctl02 nova-conductor[5056]: 2017-09-28 11:59:34.229 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:59:34 ctl02 nova-conductor[5056]: 2017-09-28 11:59:34.245 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:59:34 ctl02 nova-conductor[5056]: 2017-09-28 11:59:34.254 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:59:34 ctl02 nova-api[10965]: 2017-09-28 11:59:34.356 10965 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:59:34 ctl02 nova-api[10965]: 2017-09-28 11:59:34.358 10965 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:59:34 ctl02 nova-api[10965]: 2017-09-28 11:59:34.359 10965 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:59:34 ctl02 nova-api[10965]: 2017-09-28 11:59:34.359 10965 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:59:34 ctl02 nova-api[10965]: 2017-09-28 11:59:34.363 10965 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:59:34 ctl02 nova-api[10965]: 2017-09-28 11:59:34.363 10965 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:59:34 ctl02 nova-api[10965]: 2017-09-28 11:59:34.363 10965 ERROR nova Traceback (most recent call last):
Sep 28 11:59:34 ctl02 nova-api[10965]: 2017-09-28 11:59:34.363 10965 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:59:34 ctl02 nova-api[10965]: 2017-09-28 11:59:34.363 10965 ERROR nova     sys.exit(main())
Sep 28 11:59:34 ctl02 nova-api[10965]: 2017-09-28 11:59:34.363 10965 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:59:34 ctl02 nova-api[10965]: 2017-09-28 11:59:34.363 10965 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:59:34 ctl02 nova-api[10965]: 2017-09-28 11:59:34.363 10965 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:59:34 ctl02 nova-api[10965]: 2017-09-28 11:59:34.363 10965 ERROR nova     max_url_len=max_url_len)
Sep 28 11:59:34 ctl02 nova-api[10965]: 2017-09-28 11:59:34.363 10965 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:59:34 ctl02 nova-api[10965]: 2017-09-28 11:59:34.363 10965 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:59:34 ctl02 nova-api[10965]: 2017-09-28 11:59:34.363 10965 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:59:34 ctl02 nova-api[10965]: 2017-09-28 11:59:34.363 10965 ERROR nova     sock.listen(backlog)
Sep 28 11:59:34 ctl02 nova-api[10965]: 2017-09-28 11:59:34.363 10965 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:59:34 ctl02 nova-api[10965]: 2017-09-28 11:59:34.363 10965 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:59:34 ctl02 nova-api[10965]: 2017-09-28 11:59:34.363 10965 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:59:34 ctl02 nova-api[10965]: 2017-09-28 11:59:34.363 10965 ERROR nova
Sep 28 11:59:34 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:59:34 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:59:34 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:59:34 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:59:34 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:59:34 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:59:34 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:59:36 ctl02 nova-api[10984]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:59:36 ctl02 nova-api[10984]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:59:36 ctl02 nova-api[10984]: 2017-09-28 11:59:36.278 10984 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:59:36 ctl02 nova-api[10984]: 2017-09-28 11:59:36.280 10984 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:59:36 ctl02 nova-api[10984]: 2017-09-28 11:59:36.280 10984 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:59:36 ctl02 nova-api[10984]: 2017-09-28 11:59:36.280 10984 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:59:36 ctl02 nova-api[10984]: 2017-09-28 11:59:36.280 10984 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:59:36 ctl02 nova-api[10984]: 2017-09-28 11:59:36.280 10984 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:59:36 ctl02 nova-api[10984]: 2017-09-28 11:59:36.280 10984 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:59:36 ctl02 nova-api[10984]: 2017-09-28 11:59:36.280 10984 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:59:36 ctl02 nova-api[10984]: 2017-09-28 11:59:36.280 10984 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:59:36 ctl02 nova-api[10984]: 2017-09-28 11:59:36.280 10984 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:59:36 ctl02 nova-api[10984]: 2017-09-28 11:59:36.280 10984 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:59:36 ctl02 nova-api[10984]: 2017-09-28 11:59:36.280 10984 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:59:36 ctl02 nova-api[10984]: 2017-09-28 11:59:36.280 10984 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:59:36 ctl02 nova-api[10984]: 2017-09-28 11:59:36.280 10984 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:59:36 ctl02 nova-api[10984]: 2017-09-28 11:59:36.280 10984 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:59:36 ctl02 nova-api[10984]: 2017-09-28 11:59:36.280 10984 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:59:36 ctl02 nova-api[10984]: 2017-09-28 11:59:36.280 10984 ERROR nova.wsgi     self.filename))
Sep 28 11:59:36 ctl02 nova-api[10984]: 2017-09-28 11:59:36.280 10984 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:59:36 ctl02 nova-api[10984]: 2017-09-28 11:59:36.280 10984 ERROR nova.wsgi
Sep 28 11:59:36 ctl02 nova-api[10984]: 2017-09-28 11:59:36.282 10984 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:59:36 ctl02 nova-api[10984]: 2017-09-28 11:59:36.408 10984 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:59:36 ctl02 nova-api[10984]: 2017-09-28 11:59:36.642 10984 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:59:36 ctl02 nova-api[10984]: 2017-09-28 11:59:36.645 10984 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:59:36 ctl02 nova-api[10984]: 2017-09-28 11:59:36.645 10984 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:59:36 ctl02 nova-api[10984]: 2017-09-28 11:59:36.645 10984 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:59:36 ctl02 nova-api[10984]: 2017-09-28 11:59:36.776 10984 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:59:36 ctl02 nova-api[10984]: 2017-09-28 11:59:36.778 10984 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:59:36 ctl02 nova-api[10984]: 2017-09-28 11:59:36.779 10984 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:59:36 ctl02 nova-api[10984]: 2017-09-28 11:59:36.779 10984 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:59:36 ctl02 nova-api[10984]: 2017-09-28 11:59:36.782 10984 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:59:36 ctl02 nova-api[10984]: 2017-09-28 11:59:36.783 10984 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:59:36 ctl02 nova-api[10984]: 2017-09-28 11:59:36.783 10984 ERROR nova Traceback (most recent call last):
Sep 28 11:59:36 ctl02 nova-api[10984]: 2017-09-28 11:59:36.783 10984 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:59:36 ctl02 nova-api[10984]: 2017-09-28 11:59:36.783 10984 ERROR nova     sys.exit(main())
Sep 28 11:59:36 ctl02 nova-api[10984]: 2017-09-28 11:59:36.783 10984 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:59:36 ctl02 nova-api[10984]: 2017-09-28 11:59:36.783 10984 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:59:36 ctl02 nova-api[10984]: 2017-09-28 11:59:36.783 10984 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:59:36 ctl02 nova-api[10984]: 2017-09-28 11:59:36.783 10984 ERROR nova     max_url_len=max_url_len)
Sep 28 11:59:36 ctl02 nova-api[10984]: 2017-09-28 11:59:36.783 10984 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:59:36 ctl02 nova-api[10984]: 2017-09-28 11:59:36.783 10984 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:59:36 ctl02 nova-api[10984]: 2017-09-28 11:59:36.783 10984 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:59:36 ctl02 nova-api[10984]: 2017-09-28 11:59:36.783 10984 ERROR nova     sock.listen(backlog)
Sep 28 11:59:36 ctl02 nova-api[10984]: 2017-09-28 11:59:36.783 10984 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:59:36 ctl02 nova-api[10984]: 2017-09-28 11:59:36.783 10984 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:59:36 ctl02 nova-api[10984]: 2017-09-28 11:59:36.783 10984 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:59:36 ctl02 nova-api[10984]: 2017-09-28 11:59:36.783 10984 ERROR nova
Sep 28 11:59:36 ctl02 glance-api[29183]: 2017-09-28 11:59:36.818 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:59:36] "OPTIONS / HTTP/1.0" 200 134 0.000546
Sep 28 11:59:36 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:59:36 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:59:36 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:59:37 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:59:37 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:59:37 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:59:37 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:59:38 ctl02 nova-api[11002]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:59:38 ctl02 nova-api[11002]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:59:38 ctl02 nova-api[11002]: 2017-09-28 11:59:38.827 11002 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:59:38 ctl02 nova-api[11002]: 2017-09-28 11:59:38.829 11002 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:59:38 ctl02 nova-api[11002]: 2017-09-28 11:59:38.829 11002 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:59:38 ctl02 nova-api[11002]: 2017-09-28 11:59:38.829 11002 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:59:38 ctl02 nova-api[11002]: 2017-09-28 11:59:38.829 11002 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:59:38 ctl02 nova-api[11002]: 2017-09-28 11:59:38.829 11002 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:59:38 ctl02 nova-api[11002]: 2017-09-28 11:59:38.829 11002 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:59:38 ctl02 nova-api[11002]: 2017-09-28 11:59:38.829 11002 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:59:38 ctl02 nova-api[11002]: 2017-09-28 11:59:38.829 11002 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:59:38 ctl02 nova-api[11002]: 2017-09-28 11:59:38.829 11002 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:59:38 ctl02 nova-api[11002]: 2017-09-28 11:59:38.829 11002 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:59:38 ctl02 nova-api[11002]: 2017-09-28 11:59:38.829 11002 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:59:38 ctl02 nova-api[11002]: 2017-09-28 11:59:38.829 11002 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:59:38 ctl02 nova-api[11002]: 2017-09-28 11:59:38.829 11002 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:59:38 ctl02 nova-api[11002]: 2017-09-28 11:59:38.829 11002 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:59:38 ctl02 nova-api[11002]: 2017-09-28 11:59:38.829 11002 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:59:38 ctl02 nova-api[11002]: 2017-09-28 11:59:38.829 11002 ERROR nova.wsgi     self.filename))
Sep 28 11:59:38 ctl02 nova-api[11002]: 2017-09-28 11:59:38.829 11002 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:59:38 ctl02 nova-api[11002]: 2017-09-28 11:59:38.829 11002 ERROR nova.wsgi
Sep 28 11:59:38 ctl02 nova-api[11002]: 2017-09-28 11:59:38.831 11002 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:59:38 ctl02 glance-api[29183]: 2017-09-28 11:59:38.913 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:59:38] "OPTIONS / HTTP/1.0" 200 134 0.000795
Sep 28 11:59:38 ctl02 nova-api[11002]: 2017-09-28 11:59:38.959 11002 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:59:39 ctl02 nova-api[11002]: 2017-09-28 11:59:39.194 11002 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:59:39 ctl02 nova-api[11002]: 2017-09-28 11:59:39.197 11002 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:59:39 ctl02 nova-api[11002]: 2017-09-28 11:59:39.198 11002 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:59:39 ctl02 nova-api[11002]: 2017-09-28 11:59:39.198 11002 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:59:39 ctl02 nova-api[11002]: 2017-09-28 11:59:39.328 11002 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:59:39 ctl02 nova-api[11002]: 2017-09-28 11:59:39.331 11002 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:59:39 ctl02 nova-api[11002]: 2017-09-28 11:59:39.331 11002 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:59:39 ctl02 nova-api[11002]: 2017-09-28 11:59:39.332 11002 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:59:39 ctl02 nova-api[11002]: 2017-09-28 11:59:39.335 11002 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:59:39 ctl02 nova-api[11002]: 2017-09-28 11:59:39.335 11002 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:59:39 ctl02 nova-api[11002]: 2017-09-28 11:59:39.335 11002 ERROR nova Traceback (most recent call last):
Sep 28 11:59:39 ctl02 nova-api[11002]: 2017-09-28 11:59:39.335 11002 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:59:39 ctl02 nova-api[11002]: 2017-09-28 11:59:39.335 11002 ERROR nova     sys.exit(main())
Sep 28 11:59:39 ctl02 nova-api[11002]: 2017-09-28 11:59:39.335 11002 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:59:39 ctl02 nova-api[11002]: 2017-09-28 11:59:39.335 11002 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:59:39 ctl02 nova-api[11002]: 2017-09-28 11:59:39.335 11002 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:59:39 ctl02 nova-api[11002]: 2017-09-28 11:59:39.335 11002 ERROR nova     max_url_len=max_url_len)
Sep 28 11:59:39 ctl02 nova-api[11002]: 2017-09-28 11:59:39.335 11002 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:59:39 ctl02 nova-api[11002]: 2017-09-28 11:59:39.335 11002 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:59:39 ctl02 nova-api[11002]: 2017-09-28 11:59:39.335 11002 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:59:39 ctl02 nova-api[11002]: 2017-09-28 11:59:39.335 11002 ERROR nova     sock.listen(backlog)
Sep 28 11:59:39 ctl02 nova-api[11002]: 2017-09-28 11:59:39.335 11002 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:59:39 ctl02 nova-api[11002]: 2017-09-28 11:59:39.335 11002 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:59:39 ctl02 nova-api[11002]: 2017-09-28 11:59:39.335 11002 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:59:39 ctl02 nova-api[11002]: 2017-09-28 11:59:39.335 11002 ERROR nova
Sep 28 11:59:39 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:59:39 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:59:39 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:59:39 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:59:39 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:59:39 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:59:39 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:59:39 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928115939961531
Sep 28 11:59:39 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 11031
Sep 28 11:59:39 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928115939961531
Sep 28 11:59:41 ctl02 nova-api[11020]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:59:41 ctl02 nova-api[11020]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:59:41 ctl02 nova-api[11020]: 2017-09-28 11:59:41.335 11020 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:59:41 ctl02 nova-api[11020]: 2017-09-28 11:59:41.337 11020 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:59:41 ctl02 nova-api[11020]: 2017-09-28 11:59:41.337 11020 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:59:41 ctl02 nova-api[11020]: 2017-09-28 11:59:41.337 11020 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:59:41 ctl02 nova-api[11020]: 2017-09-28 11:59:41.337 11020 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:59:41 ctl02 nova-api[11020]: 2017-09-28 11:59:41.337 11020 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:59:41 ctl02 nova-api[11020]: 2017-09-28 11:59:41.337 11020 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:59:41 ctl02 nova-api[11020]: 2017-09-28 11:59:41.337 11020 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:59:41 ctl02 nova-api[11020]: 2017-09-28 11:59:41.337 11020 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:59:41 ctl02 nova-api[11020]: 2017-09-28 11:59:41.337 11020 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:59:41 ctl02 nova-api[11020]: 2017-09-28 11:59:41.337 11020 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:59:41 ctl02 nova-api[11020]: 2017-09-28 11:59:41.337 11020 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:59:41 ctl02 nova-api[11020]: 2017-09-28 11:59:41.337 11020 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:59:41 ctl02 nova-api[11020]: 2017-09-28 11:59:41.337 11020 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:59:41 ctl02 nova-api[11020]: 2017-09-28 11:59:41.337 11020 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:59:41 ctl02 nova-api[11020]: 2017-09-28 11:59:41.337 11020 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:59:41 ctl02 nova-api[11020]: 2017-09-28 11:59:41.337 11020 ERROR nova.wsgi     self.filename))
Sep 28 11:59:41 ctl02 nova-api[11020]: 2017-09-28 11:59:41.337 11020 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:59:41 ctl02 nova-api[11020]: 2017-09-28 11:59:41.337 11020 ERROR nova.wsgi
Sep 28 11:59:41 ctl02 nova-api[11020]: 2017-09-28 11:59:41.339 11020 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:59:41 ctl02 nova-api[11020]: 2017-09-28 11:59:41.467 11020 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:59:41 ctl02 nova-consoleauth[5433]: 2017-09-28 11:59:41.502 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:59:41 ctl02 nova-api[11020]: 2017-09-28 11:59:41.705 11020 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:59:41 ctl02 nova-api[11020]: 2017-09-28 11:59:41.708 11020 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:59:41 ctl02 nova-api[11020]: 2017-09-28 11:59:41.708 11020 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:59:41 ctl02 nova-api[11020]: 2017-09-28 11:59:41.709 11020 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:59:41 ctl02 nova-api[11020]: 2017-09-28 11:59:41.838 11020 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:59:41 ctl02 nova-api[11020]: 2017-09-28 11:59:41.841 11020 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:59:41 ctl02 nova-api[11020]: 2017-09-28 11:59:41.841 11020 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:59:41 ctl02 nova-api[11020]: 2017-09-28 11:59:41.841 11020 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:59:41 ctl02 nova-api[11020]: 2017-09-28 11:59:41.845 11020 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:59:41 ctl02 nova-api[11020]: 2017-09-28 11:59:41.845 11020 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:59:41 ctl02 nova-api[11020]: 2017-09-28 11:59:41.845 11020 ERROR nova Traceback (most recent call last):
Sep 28 11:59:41 ctl02 nova-api[11020]: 2017-09-28 11:59:41.845 11020 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:59:41 ctl02 nova-api[11020]: 2017-09-28 11:59:41.845 11020 ERROR nova     sys.exit(main())
Sep 28 11:59:41 ctl02 nova-api[11020]: 2017-09-28 11:59:41.845 11020 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:59:41 ctl02 nova-api[11020]: 2017-09-28 11:59:41.845 11020 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:59:41 ctl02 nova-api[11020]: 2017-09-28 11:59:41.845 11020 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:59:41 ctl02 nova-api[11020]: 2017-09-28 11:59:41.845 11020 ERROR nova     max_url_len=max_url_len)
Sep 28 11:59:41 ctl02 nova-api[11020]: 2017-09-28 11:59:41.845 11020 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:59:41 ctl02 nova-api[11020]: 2017-09-28 11:59:41.845 11020 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:59:41 ctl02 nova-api[11020]: 2017-09-28 11:59:41.845 11020 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:59:41 ctl02 nova-api[11020]: 2017-09-28 11:59:41.845 11020 ERROR nova     sock.listen(backlog)
Sep 28 11:59:41 ctl02 nova-api[11020]: 2017-09-28 11:59:41.845 11020 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:59:41 ctl02 nova-api[11020]: 2017-09-28 11:59:41.845 11020 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:59:41 ctl02 nova-api[11020]: 2017-09-28 11:59:41.845 11020 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:59:41 ctl02 nova-api[11020]: 2017-09-28 11:59:41.845 11020 ERROR nova
Sep 28 11:59:41 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:59:41 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:59:41 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:59:42 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:59:42 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:59:42 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:59:42 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:59:43 ctl02 glance-api[29183]: 2017-09-28 11:59:43.217 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:59:43] "OPTIONS / HTTP/1.0" 200 134 0.000615
Sep 28 11:59:43 ctl02 nova-api[11043]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:59:43 ctl02 nova-api[11043]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:59:43 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc772c665)
Sep 28 11:59:43 ctl02 nova-api[11043]: 2017-09-28 11:59:43.833 11043 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:59:43 ctl02 nova-api[11043]: 2017-09-28 11:59:43.834 11043 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:59:43 ctl02 nova-api[11043]: 2017-09-28 11:59:43.834 11043 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:59:43 ctl02 nova-api[11043]: 2017-09-28 11:59:43.834 11043 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:59:43 ctl02 nova-api[11043]: 2017-09-28 11:59:43.834 11043 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:59:43 ctl02 nova-api[11043]: 2017-09-28 11:59:43.834 11043 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:59:43 ctl02 nova-api[11043]: 2017-09-28 11:59:43.834 11043 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:59:43 ctl02 nova-api[11043]: 2017-09-28 11:59:43.834 11043 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:59:43 ctl02 nova-api[11043]: 2017-09-28 11:59:43.834 11043 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:59:43 ctl02 nova-api[11043]: 2017-09-28 11:59:43.834 11043 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:59:43 ctl02 nova-api[11043]: 2017-09-28 11:59:43.834 11043 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:59:43 ctl02 nova-api[11043]: 2017-09-28 11:59:43.834 11043 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:59:43 ctl02 nova-api[11043]: 2017-09-28 11:59:43.834 11043 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:59:43 ctl02 nova-api[11043]: 2017-09-28 11:59:43.834 11043 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:59:43 ctl02 nova-api[11043]: 2017-09-28 11:59:43.834 11043 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:59:43 ctl02 nova-api[11043]: 2017-09-28 11:59:43.834 11043 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:59:43 ctl02 nova-api[11043]: 2017-09-28 11:59:43.834 11043 ERROR nova.wsgi     self.filename))
Sep 28 11:59:43 ctl02 nova-api[11043]: 2017-09-28 11:59:43.834 11043 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:59:43 ctl02 nova-api[11043]: 2017-09-28 11:59:43.834 11043 ERROR nova.wsgi
Sep 28 11:59:43 ctl02 nova-api[11043]: 2017-09-28 11:59:43.835 11043 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:59:43 ctl02 nova-api[11043]: 2017-09-28 11:59:43.968 11043 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:59:44 ctl02 nova-api[11043]: 2017-09-28 11:59:44.215 11043 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:59:44 ctl02 nova-api[11043]: 2017-09-28 11:59:44.218 11043 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:59:44 ctl02 nova-api[11043]: 2017-09-28 11:59:44.218 11043 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:59:44 ctl02 nova-api[11043]: 2017-09-28 11:59:44.218 11043 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:59:44 ctl02 nova-api[11043]: 2017-09-28 11:59:44.349 11043 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:59:44 ctl02 nova-api[11043]: 2017-09-28 11:59:44.351 11043 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:59:44 ctl02 nova-api[11043]: 2017-09-28 11:59:44.351 11043 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:59:44 ctl02 nova-api[11043]: 2017-09-28 11:59:44.352 11043 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:59:44 ctl02 nova-api[11043]: 2017-09-28 11:59:44.355 11043 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:59:44 ctl02 nova-api[11043]: 2017-09-28 11:59:44.355 11043 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:59:44 ctl02 nova-api[11043]: 2017-09-28 11:59:44.355 11043 ERROR nova Traceback (most recent call last):
Sep 28 11:59:44 ctl02 nova-api[11043]: 2017-09-28 11:59:44.355 11043 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:59:44 ctl02 nova-api[11043]: 2017-09-28 11:59:44.355 11043 ERROR nova     sys.exit(main())
Sep 28 11:59:44 ctl02 nova-api[11043]: 2017-09-28 11:59:44.355 11043 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:59:44 ctl02 nova-api[11043]: 2017-09-28 11:59:44.355 11043 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:59:44 ctl02 nova-api[11043]: 2017-09-28 11:59:44.355 11043 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:59:44 ctl02 nova-api[11043]: 2017-09-28 11:59:44.355 11043 ERROR nova     max_url_len=max_url_len)
Sep 28 11:59:44 ctl02 nova-api[11043]: 2017-09-28 11:59:44.355 11043 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:59:44 ctl02 nova-api[11043]: 2017-09-28 11:59:44.355 11043 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:59:44 ctl02 nova-api[11043]: 2017-09-28 11:59:44.355 11043 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:59:44 ctl02 nova-api[11043]: 2017-09-28 11:59:44.355 11043 ERROR nova     sock.listen(backlog)
Sep 28 11:59:44 ctl02 nova-api[11043]: 2017-09-28 11:59:44.355 11043 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:59:44 ctl02 nova-api[11043]: 2017-09-28 11:59:44.355 11043 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:59:44 ctl02 nova-api[11043]: 2017-09-28 11:59:44.355 11043 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:59:44 ctl02 nova-api[11043]: 2017-09-28 11:59:44.355 11043 ERROR nova
Sep 28 11:59:44 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:59:44 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:59:44 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:59:44 ctl02 nova-scheduler[5620]: 2017-09-28 11:59:44.526 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 11:59:44 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:59:44 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:59:44 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:59:44 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:59:44 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc772c665)
Sep 28 11:59:45 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc772c665)
Sep 28 11:59:46 ctl02 nova-api[11060]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:59:46 ctl02 nova-api[11060]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:59:46 ctl02 nova-api[11060]: 2017-09-28 11:59:46.314 11060 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:59:46 ctl02 nova-api[11060]: 2017-09-28 11:59:46.315 11060 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:59:46 ctl02 nova-api[11060]: 2017-09-28 11:59:46.315 11060 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:59:46 ctl02 nova-api[11060]: 2017-09-28 11:59:46.315 11060 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:59:46 ctl02 nova-api[11060]: 2017-09-28 11:59:46.315 11060 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:59:46 ctl02 nova-api[11060]: 2017-09-28 11:59:46.315 11060 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:59:46 ctl02 nova-api[11060]: 2017-09-28 11:59:46.315 11060 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:59:46 ctl02 nova-api[11060]: 2017-09-28 11:59:46.315 11060 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:59:46 ctl02 nova-api[11060]: 2017-09-28 11:59:46.315 11060 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:59:46 ctl02 nova-api[11060]: 2017-09-28 11:59:46.315 11060 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:59:46 ctl02 nova-api[11060]: 2017-09-28 11:59:46.315 11060 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:59:46 ctl02 nova-api[11060]: 2017-09-28 11:59:46.315 11060 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:59:46 ctl02 nova-api[11060]: 2017-09-28 11:59:46.315 11060 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:59:46 ctl02 nova-api[11060]: 2017-09-28 11:59:46.315 11060 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:59:46 ctl02 nova-api[11060]: 2017-09-28 11:59:46.315 11060 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:59:46 ctl02 nova-api[11060]: 2017-09-28 11:59:46.315 11060 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:59:46 ctl02 nova-api[11060]: 2017-09-28 11:59:46.315 11060 ERROR nova.wsgi     self.filename))
Sep 28 11:59:46 ctl02 nova-api[11060]: 2017-09-28 11:59:46.315 11060 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:59:46 ctl02 nova-api[11060]: 2017-09-28 11:59:46.315 11060 ERROR nova.wsgi
Sep 28 11:59:46 ctl02 nova-api[11060]: 2017-09-28 11:59:46.316 11060 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:59:46 ctl02 nova-api[11060]: 2017-09-28 11:59:46.450 11060 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:59:46 ctl02 nova-api[11060]: 2017-09-28 11:59:46.684 11060 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:59:46 ctl02 nova-api[11060]: 2017-09-28 11:59:46.686 11060 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:59:46 ctl02 nova-api[11060]: 2017-09-28 11:59:46.686 11060 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:59:46 ctl02 nova-api[11060]: 2017-09-28 11:59:46.686 11060 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:59:46 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc772c665)
Sep 28 11:59:46 ctl02 nova-api[11060]: 2017-09-28 11:59:46.817 11060 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:59:46 ctl02 nova-api[11060]: 2017-09-28 11:59:46.819 11060 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:59:46 ctl02 nova-api[11060]: 2017-09-28 11:59:46.819 11060 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:59:46 ctl02 nova-api[11060]: 2017-09-28 11:59:46.820 11060 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:59:46 ctl02 nova-api[11060]: 2017-09-28 11:59:46.823 11060 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:59:46 ctl02 nova-api[11060]: 2017-09-28 11:59:46.823 11060 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:59:46 ctl02 nova-api[11060]: 2017-09-28 11:59:46.823 11060 ERROR nova Traceback (most recent call last):
Sep 28 11:59:46 ctl02 nova-api[11060]: 2017-09-28 11:59:46.823 11060 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:59:46 ctl02 nova-api[11060]: 2017-09-28 11:59:46.823 11060 ERROR nova     sys.exit(main())
Sep 28 11:59:46 ctl02 nova-api[11060]: 2017-09-28 11:59:46.823 11060 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:59:46 ctl02 nova-api[11060]: 2017-09-28 11:59:46.823 11060 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:59:46 ctl02 nova-api[11060]: 2017-09-28 11:59:46.823 11060 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:59:46 ctl02 nova-api[11060]: 2017-09-28 11:59:46.823 11060 ERROR nova     max_url_len=max_url_len)
Sep 28 11:59:46 ctl02 nova-api[11060]: 2017-09-28 11:59:46.823 11060 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:59:46 ctl02 nova-api[11060]: 2017-09-28 11:59:46.823 11060 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:59:46 ctl02 nova-api[11060]: 2017-09-28 11:59:46.823 11060 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:59:46 ctl02 nova-api[11060]: 2017-09-28 11:59:46.823 11060 ERROR nova     sock.listen(backlog)
Sep 28 11:59:46 ctl02 nova-api[11060]: 2017-09-28 11:59:46.823 11060 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:59:46 ctl02 nova-api[11060]: 2017-09-28 11:59:46.823 11060 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:59:46 ctl02 nova-api[11060]: 2017-09-28 11:59:46.823 11060 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:59:46 ctl02 nova-api[11060]: 2017-09-28 11:59:46.823 11060 ERROR nova
Sep 28 11:59:46 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:59:46 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:59:46 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:59:47 ctl02 glance-api[29183]: 2017-09-28 11:59:47.092 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:59:47] "OPTIONS / HTTP/1.0" 200 134 0.000759
Sep 28 11:59:47 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:59:47 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:59:47 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:59:47 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:59:47 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc772c665)
Sep 28 11:59:48 ctl02 nova-api[11079]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:59:48 ctl02 nova-api[11079]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:59:48 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc772c665)
Sep 28 11:59:48 ctl02 glance-api[29183]: 2017-09-28 11:59:48.880 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:59:48] "OPTIONS / HTTP/1.0" 200 134 0.000703
Sep 28 11:59:48 ctl02 nova-api[11079]: 2017-09-28 11:59:48.887 11079 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:59:48 ctl02 nova-api[11079]: 2017-09-28 11:59:48.889 11079 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:59:48 ctl02 nova-api[11079]: 2017-09-28 11:59:48.889 11079 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:59:48 ctl02 nova-api[11079]: 2017-09-28 11:59:48.889 11079 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:59:48 ctl02 nova-api[11079]: 2017-09-28 11:59:48.889 11079 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:59:48 ctl02 nova-api[11079]: 2017-09-28 11:59:48.889 11079 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:59:48 ctl02 nova-api[11079]: 2017-09-28 11:59:48.889 11079 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:59:48 ctl02 nova-api[11079]: 2017-09-28 11:59:48.889 11079 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:59:48 ctl02 nova-api[11079]: 2017-09-28 11:59:48.889 11079 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:59:48 ctl02 nova-api[11079]: 2017-09-28 11:59:48.889 11079 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:59:48 ctl02 nova-api[11079]: 2017-09-28 11:59:48.889 11079 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:59:48 ctl02 nova-api[11079]: 2017-09-28 11:59:48.889 11079 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:59:48 ctl02 nova-api[11079]: 2017-09-28 11:59:48.889 11079 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:59:48 ctl02 nova-api[11079]: 2017-09-28 11:59:48.889 11079 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:59:48 ctl02 nova-api[11079]: 2017-09-28 11:59:48.889 11079 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:59:48 ctl02 nova-api[11079]: 2017-09-28 11:59:48.889 11079 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:59:48 ctl02 nova-api[11079]: 2017-09-28 11:59:48.889 11079 ERROR nova.wsgi     self.filename))
Sep 28 11:59:48 ctl02 nova-api[11079]: 2017-09-28 11:59:48.889 11079 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:59:48 ctl02 nova-api[11079]: 2017-09-28 11:59:48.889 11079 ERROR nova.wsgi
Sep 28 11:59:48 ctl02 nova-api[11079]: 2017-09-28 11:59:48.890 11079 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:59:49 ctl02 nova-api[11079]: 2017-09-28 11:59:49.022 11079 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:59:49 ctl02 nova-api[11079]: 2017-09-28 11:59:49.265 11079 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:59:49 ctl02 nova-api[11079]: 2017-09-28 11:59:49.268 11079 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:59:49 ctl02 nova-api[11079]: 2017-09-28 11:59:49.268 11079 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:59:49 ctl02 nova-api[11079]: 2017-09-28 11:59:49.268 11079 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:59:49 ctl02 nova-api[11079]: 2017-09-28 11:59:49.398 11079 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:59:49 ctl02 nova-api[11079]: 2017-09-28 11:59:49.400 11079 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:59:49 ctl02 nova-api[11079]: 2017-09-28 11:59:49.400 11079 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:59:49 ctl02 nova-api[11079]: 2017-09-28 11:59:49.400 11079 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:59:49 ctl02 nova-api[11079]: 2017-09-28 11:59:49.404 11079 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:59:49 ctl02 nova-api[11079]: 2017-09-28 11:59:49.404 11079 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:59:49 ctl02 nova-api[11079]: 2017-09-28 11:59:49.404 11079 ERROR nova Traceback (most recent call last):
Sep 28 11:59:49 ctl02 nova-api[11079]: 2017-09-28 11:59:49.404 11079 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:59:49 ctl02 nova-api[11079]: 2017-09-28 11:59:49.404 11079 ERROR nova     sys.exit(main())
Sep 28 11:59:49 ctl02 nova-api[11079]: 2017-09-28 11:59:49.404 11079 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:59:49 ctl02 nova-api[11079]: 2017-09-28 11:59:49.404 11079 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:59:49 ctl02 nova-api[11079]: 2017-09-28 11:59:49.404 11079 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:59:49 ctl02 nova-api[11079]: 2017-09-28 11:59:49.404 11079 ERROR nova     max_url_len=max_url_len)
Sep 28 11:59:49 ctl02 nova-api[11079]: 2017-09-28 11:59:49.404 11079 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:59:49 ctl02 nova-api[11079]: 2017-09-28 11:59:49.404 11079 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:59:49 ctl02 nova-api[11079]: 2017-09-28 11:59:49.404 11079 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:59:49 ctl02 nova-api[11079]: 2017-09-28 11:59:49.404 11079 ERROR nova     sock.listen(backlog)
Sep 28 11:59:49 ctl02 nova-api[11079]: 2017-09-28 11:59:49.404 11079 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:59:49 ctl02 nova-api[11079]: 2017-09-28 11:59:49.404 11079 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:59:49 ctl02 nova-api[11079]: 2017-09-28 11:59:49.404 11079 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:59:49 ctl02 nova-api[11079]: 2017-09-28 11:59:49.404 11079 ERROR nova
Sep 28 11:59:49 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:59:49 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:59:49 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:59:49 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc772c665)
Sep 28 11:59:49 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:59:49 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:59:49 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:59:49 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:59:50 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928115950114531
Sep 28 11:59:50 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 11108
Sep 28 11:59:50 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928115950114531
Sep 28 11:59:50 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc772c665)
Sep 28 11:59:51 ctl02 nova-api[11097]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:59:51 ctl02 nova-api[11097]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:59:51 ctl02 nova-api[11097]: 2017-09-28 11:59:51.552 11097 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:59:51 ctl02 nova-api[11097]: 2017-09-28 11:59:51.553 11097 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:59:51 ctl02 nova-api[11097]: 2017-09-28 11:59:51.553 11097 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:59:51 ctl02 nova-api[11097]: 2017-09-28 11:59:51.553 11097 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:59:51 ctl02 nova-api[11097]: 2017-09-28 11:59:51.553 11097 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:59:51 ctl02 nova-api[11097]: 2017-09-28 11:59:51.553 11097 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:59:51 ctl02 nova-api[11097]: 2017-09-28 11:59:51.553 11097 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:59:51 ctl02 nova-api[11097]: 2017-09-28 11:59:51.553 11097 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:59:51 ctl02 nova-api[11097]: 2017-09-28 11:59:51.553 11097 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:59:51 ctl02 nova-api[11097]: 2017-09-28 11:59:51.553 11097 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:59:51 ctl02 nova-api[11097]: 2017-09-28 11:59:51.553 11097 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:59:51 ctl02 nova-api[11097]: 2017-09-28 11:59:51.553 11097 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:59:51 ctl02 nova-api[11097]: 2017-09-28 11:59:51.553 11097 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:59:51 ctl02 nova-api[11097]: 2017-09-28 11:59:51.553 11097 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:59:51 ctl02 nova-api[11097]: 2017-09-28 11:59:51.553 11097 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:59:51 ctl02 nova-api[11097]: 2017-09-28 11:59:51.553 11097 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:59:51 ctl02 nova-api[11097]: 2017-09-28 11:59:51.553 11097 ERROR nova.wsgi     self.filename))
Sep 28 11:59:51 ctl02 nova-api[11097]: 2017-09-28 11:59:51.553 11097 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:59:51 ctl02 nova-api[11097]: 2017-09-28 11:59:51.553 11097 ERROR nova.wsgi
Sep 28 11:59:51 ctl02 nova-api[11097]: 2017-09-28 11:59:51.554 11097 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:59:51 ctl02 nova-api[11097]: 2017-09-28 11:59:51.680 11097 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:59:51 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc772c665)
Sep 28 11:59:51 ctl02 nova-api[11097]: 2017-09-28 11:59:51.912 11097 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:59:51 ctl02 nova-api[11097]: 2017-09-28 11:59:51.914 11097 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:59:51 ctl02 nova-api[11097]: 2017-09-28 11:59:51.914 11097 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:59:51 ctl02 nova-api[11097]: 2017-09-28 11:59:51.915 11097 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:59:52 ctl02 nova-api[11097]: 2017-09-28 11:59:52.043 11097 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:59:52 ctl02 nova-api[11097]: 2017-09-28 11:59:52.045 11097 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:59:52 ctl02 nova-api[11097]: 2017-09-28 11:59:52.045 11097 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:59:52 ctl02 nova-api[11097]: 2017-09-28 11:59:52.045 11097 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:59:52 ctl02 nova-api[11097]: 2017-09-28 11:59:52.049 11097 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:59:52 ctl02 nova-api[11097]: 2017-09-28 11:59:52.049 11097 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:59:52 ctl02 nova-api[11097]: 2017-09-28 11:59:52.049 11097 ERROR nova Traceback (most recent call last):
Sep 28 11:59:52 ctl02 nova-api[11097]: 2017-09-28 11:59:52.049 11097 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:59:52 ctl02 nova-api[11097]: 2017-09-28 11:59:52.049 11097 ERROR nova     sys.exit(main())
Sep 28 11:59:52 ctl02 nova-api[11097]: 2017-09-28 11:59:52.049 11097 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:59:52 ctl02 nova-api[11097]: 2017-09-28 11:59:52.049 11097 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:59:52 ctl02 nova-api[11097]: 2017-09-28 11:59:52.049 11097 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:59:52 ctl02 nova-api[11097]: 2017-09-28 11:59:52.049 11097 ERROR nova     max_url_len=max_url_len)
Sep 28 11:59:52 ctl02 nova-api[11097]: 2017-09-28 11:59:52.049 11097 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:59:52 ctl02 nova-api[11097]: 2017-09-28 11:59:52.049 11097 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:59:52 ctl02 nova-api[11097]: 2017-09-28 11:59:52.049 11097 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:59:52 ctl02 nova-api[11097]: 2017-09-28 11:59:52.049 11097 ERROR nova     sock.listen(backlog)
Sep 28 11:59:52 ctl02 nova-api[11097]: 2017-09-28 11:59:52.049 11097 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:59:52 ctl02 nova-api[11097]: 2017-09-28 11:59:52.049 11097 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:59:52 ctl02 nova-api[11097]: 2017-09-28 11:59:52.049 11097 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:59:52 ctl02 nova-api[11097]: 2017-09-28 11:59:52.049 11097 ERROR nova
Sep 28 11:59:52 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:59:52 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:59:52 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:59:52 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:59:52 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:59:52 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:59:52 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:59:52 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc772c665)
Sep 28 11:59:53 ctl02 glance-api[29183]: 2017-09-28 11:59:53.212 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 11:59:53] "OPTIONS / HTTP/1.0" 200 134 0.000640
Sep 28 11:59:53 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc772c665)
Sep 28 11:59:53 ctl02 nova-api[11119]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:59:53 ctl02 nova-api[11119]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:59:54 ctl02 nova-api[11119]: 2017-09-28 11:59:54.069 11119 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:59:54 ctl02 nova-api[11119]: 2017-09-28 11:59:54.070 11119 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:59:54 ctl02 nova-api[11119]: 2017-09-28 11:59:54.070 11119 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:59:54 ctl02 nova-api[11119]: 2017-09-28 11:59:54.070 11119 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:59:54 ctl02 nova-api[11119]: 2017-09-28 11:59:54.070 11119 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:59:54 ctl02 nova-api[11119]: 2017-09-28 11:59:54.070 11119 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:59:54 ctl02 nova-api[11119]: 2017-09-28 11:59:54.070 11119 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:59:54 ctl02 nova-api[11119]: 2017-09-28 11:59:54.070 11119 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:59:54 ctl02 nova-api[11119]: 2017-09-28 11:59:54.070 11119 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:59:54 ctl02 nova-api[11119]: 2017-09-28 11:59:54.070 11119 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:59:54 ctl02 nova-api[11119]: 2017-09-28 11:59:54.070 11119 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:59:54 ctl02 nova-api[11119]: 2017-09-28 11:59:54.070 11119 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:59:54 ctl02 nova-api[11119]: 2017-09-28 11:59:54.070 11119 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:59:54 ctl02 nova-api[11119]: 2017-09-28 11:59:54.070 11119 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:59:54 ctl02 nova-api[11119]: 2017-09-28 11:59:54.070 11119 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:59:54 ctl02 nova-api[11119]: 2017-09-28 11:59:54.070 11119 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:59:54 ctl02 nova-api[11119]: 2017-09-28 11:59:54.070 11119 ERROR nova.wsgi     self.filename))
Sep 28 11:59:54 ctl02 nova-api[11119]: 2017-09-28 11:59:54.070 11119 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:59:54 ctl02 nova-api[11119]: 2017-09-28 11:59:54.070 11119 ERROR nova.wsgi
Sep 28 11:59:54 ctl02 nova-api[11119]: 2017-09-28 11:59:54.072 11119 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:59:54 ctl02 nova-api[11119]: 2017-09-28 11:59:54.200 11119 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:59:54 ctl02 nova-api[11119]: 2017-09-28 11:59:54.435 11119 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:59:54 ctl02 nova-api[11119]: 2017-09-28 11:59:54.437 11119 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:59:54 ctl02 nova-api[11119]: 2017-09-28 11:59:54.438 11119 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:59:54 ctl02 nova-api[11119]: 2017-09-28 11:59:54.438 11119 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:59:54 ctl02 nova-api[11119]: 2017-09-28 11:59:54.567 11119 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:59:54 ctl02 nova-api[11119]: 2017-09-28 11:59:54.569 11119 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:59:54 ctl02 nova-api[11119]: 2017-09-28 11:59:54.569 11119 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:59:54 ctl02 nova-api[11119]: 2017-09-28 11:59:54.570 11119 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:59:54 ctl02 nova-api[11119]: 2017-09-28 11:59:54.573 11119 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:59:54 ctl02 nova-api[11119]: 2017-09-28 11:59:54.573 11119 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:59:54 ctl02 nova-api[11119]: 2017-09-28 11:59:54.573 11119 ERROR nova Traceback (most recent call last):
Sep 28 11:59:54 ctl02 nova-api[11119]: 2017-09-28 11:59:54.573 11119 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:59:54 ctl02 nova-api[11119]: 2017-09-28 11:59:54.573 11119 ERROR nova     sys.exit(main())
Sep 28 11:59:54 ctl02 nova-api[11119]: 2017-09-28 11:59:54.573 11119 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:59:54 ctl02 nova-api[11119]: 2017-09-28 11:59:54.573 11119 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:59:54 ctl02 nova-api[11119]: 2017-09-28 11:59:54.573 11119 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:59:54 ctl02 nova-api[11119]: 2017-09-28 11:59:54.573 11119 ERROR nova     max_url_len=max_url_len)
Sep 28 11:59:54 ctl02 nova-api[11119]: 2017-09-28 11:59:54.573 11119 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:59:54 ctl02 nova-api[11119]: 2017-09-28 11:59:54.573 11119 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:59:54 ctl02 nova-api[11119]: 2017-09-28 11:59:54.573 11119 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:59:54 ctl02 nova-api[11119]: 2017-09-28 11:59:54.573 11119 ERROR nova     sock.listen(backlog)
Sep 28 11:59:54 ctl02 nova-api[11119]: 2017-09-28 11:59:54.573 11119 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:59:54 ctl02 nova-api[11119]: 2017-09-28 11:59:54.573 11119 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:59:54 ctl02 nova-api[11119]: 2017-09-28 11:59:54.573 11119 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:59:54 ctl02 nova-api[11119]: 2017-09-28 11:59:54.573 11119 ERROR nova
Sep 28 11:59:54 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:59:54 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:59:54 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:59:54 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 11:59:54 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 11:59:54 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:59:54 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:59:54 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:59:54 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:59:56 ctl02 nova-api[11142]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:59:56 ctl02 nova-api[11142]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:59:56 ctl02 nova-api[11142]: 2017-09-28 11:59:56.601 11142 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:59:56 ctl02 nova-api[11142]: 2017-09-28 11:59:56.603 11142 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:59:56 ctl02 nova-api[11142]: 2017-09-28 11:59:56.603 11142 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:59:56 ctl02 nova-api[11142]: 2017-09-28 11:59:56.603 11142 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:59:56 ctl02 nova-api[11142]: 2017-09-28 11:59:56.603 11142 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:59:56 ctl02 nova-api[11142]: 2017-09-28 11:59:56.603 11142 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:59:56 ctl02 nova-api[11142]: 2017-09-28 11:59:56.603 11142 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:59:56 ctl02 nova-api[11142]: 2017-09-28 11:59:56.603 11142 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:59:56 ctl02 nova-api[11142]: 2017-09-28 11:59:56.603 11142 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:59:56 ctl02 nova-api[11142]: 2017-09-28 11:59:56.603 11142 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:59:56 ctl02 nova-api[11142]: 2017-09-28 11:59:56.603 11142 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:59:56 ctl02 nova-api[11142]: 2017-09-28 11:59:56.603 11142 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:59:56 ctl02 nova-api[11142]: 2017-09-28 11:59:56.603 11142 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:59:56 ctl02 nova-api[11142]: 2017-09-28 11:59:56.603 11142 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:59:56 ctl02 nova-api[11142]: 2017-09-28 11:59:56.603 11142 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:59:56 ctl02 nova-api[11142]: 2017-09-28 11:59:56.603 11142 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:59:56 ctl02 nova-api[11142]: 2017-09-28 11:59:56.603 11142 ERROR nova.wsgi     self.filename))
Sep 28 11:59:56 ctl02 nova-api[11142]: 2017-09-28 11:59:56.603 11142 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:59:56 ctl02 nova-api[11142]: 2017-09-28 11:59:56.603 11142 ERROR nova.wsgi
Sep 28 11:59:56 ctl02 nova-api[11142]: 2017-09-28 11:59:56.605 11142 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:59:56 ctl02 nova-api[11142]: 2017-09-28 11:59:56.738 11142 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:59:56 ctl02 glance-api[29183]: 2017-09-28 11:59:56.847 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 11:59:56] "OPTIONS / HTTP/1.0" 200 134 0.001208
Sep 28 11:59:56 ctl02 nova-api[11142]: 2017-09-28 11:59:56.994 11142 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:59:56 ctl02 nova-api[11142]: 2017-09-28 11:59:56.997 11142 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:59:56 ctl02 nova-api[11142]: 2017-09-28 11:59:56.997 11142 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:59:56 ctl02 nova-api[11142]: 2017-09-28 11:59:56.997 11142 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:59:57 ctl02 nova-api[11142]: 2017-09-28 11:59:57.131 11142 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:59:57 ctl02 nova-api[11142]: 2017-09-28 11:59:57.133 11142 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:59:57 ctl02 nova-api[11142]: 2017-09-28 11:59:57.134 11142 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:59:57 ctl02 nova-api[11142]: 2017-09-28 11:59:57.134 11142 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:59:57 ctl02 nova-api[11142]: 2017-09-28 11:59:57.138 11142 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:59:57 ctl02 nova-api[11142]: 2017-09-28 11:59:57.138 11142 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:59:57 ctl02 nova-api[11142]: 2017-09-28 11:59:57.138 11142 ERROR nova Traceback (most recent call last):
Sep 28 11:59:57 ctl02 nova-api[11142]: 2017-09-28 11:59:57.138 11142 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:59:57 ctl02 nova-api[11142]: 2017-09-28 11:59:57.138 11142 ERROR nova     sys.exit(main())
Sep 28 11:59:57 ctl02 nova-api[11142]: 2017-09-28 11:59:57.138 11142 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:59:57 ctl02 nova-api[11142]: 2017-09-28 11:59:57.138 11142 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:59:57 ctl02 nova-api[11142]: 2017-09-28 11:59:57.138 11142 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:59:57 ctl02 nova-api[11142]: 2017-09-28 11:59:57.138 11142 ERROR nova     max_url_len=max_url_len)
Sep 28 11:59:57 ctl02 nova-api[11142]: 2017-09-28 11:59:57.138 11142 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:59:57 ctl02 nova-api[11142]: 2017-09-28 11:59:57.138 11142 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:59:57 ctl02 nova-api[11142]: 2017-09-28 11:59:57.138 11142 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:59:57 ctl02 nova-api[11142]: 2017-09-28 11:59:57.138 11142 ERROR nova     sock.listen(backlog)
Sep 28 11:59:57 ctl02 nova-api[11142]: 2017-09-28 11:59:57.138 11142 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:59:57 ctl02 nova-api[11142]: 2017-09-28 11:59:57.138 11142 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:59:57 ctl02 nova-api[11142]: 2017-09-28 11:59:57.138 11142 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:59:57 ctl02 nova-api[11142]: 2017-09-28 11:59:57.138 11142 ERROR nova
Sep 28 11:59:57 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 11:59:57 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 11:59:57 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 11:59:57 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 11:59:57 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 11:59:57 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 11:59:57 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 11:59:58 ctl02 glance-api[29183]: 2017-09-28 11:59:58.865 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 11:59:58] "OPTIONS / HTTP/1.0" 200 134 0.000593
Sep 28 11:59:59 ctl02 nova-api[11161]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 11:59:59 ctl02 nova-api[11161]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 11:59:59 ctl02 nova-api[11161]: 2017-09-28 11:59:59.369 11161 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 11:59:59 ctl02 nova-api[11161]: 2017-09-28 11:59:59.371 11161 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 11:59:59 ctl02 nova-api[11161]: 2017-09-28 11:59:59.371 11161 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 11:59:59 ctl02 nova-api[11161]: 2017-09-28 11:59:59.371 11161 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 11:59:59 ctl02 nova-api[11161]: 2017-09-28 11:59:59.371 11161 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 11:59:59 ctl02 nova-api[11161]: 2017-09-28 11:59:59.371 11161 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 11:59:59 ctl02 nova-api[11161]: 2017-09-28 11:59:59.371 11161 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 11:59:59 ctl02 nova-api[11161]: 2017-09-28 11:59:59.371 11161 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 11:59:59 ctl02 nova-api[11161]: 2017-09-28 11:59:59.371 11161 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:59:59 ctl02 nova-api[11161]: 2017-09-28 11:59:59.371 11161 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 11:59:59 ctl02 nova-api[11161]: 2017-09-28 11:59:59.371 11161 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 11:59:59 ctl02 nova-api[11161]: 2017-09-28 11:59:59.371 11161 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 11:59:59 ctl02 nova-api[11161]: 2017-09-28 11:59:59.371 11161 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 11:59:59 ctl02 nova-api[11161]: 2017-09-28 11:59:59.371 11161 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 11:59:59 ctl02 nova-api[11161]: 2017-09-28 11:59:59.371 11161 ERROR nova.wsgi     object_type, name=name)
Sep 28 11:59:59 ctl02 nova-api[11161]: 2017-09-28 11:59:59.371 11161 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 11:59:59 ctl02 nova-api[11161]: 2017-09-28 11:59:59.371 11161 ERROR nova.wsgi     self.filename))
Sep 28 11:59:59 ctl02 nova-api[11161]: 2017-09-28 11:59:59.371 11161 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 11:59:59 ctl02 nova-api[11161]: 2017-09-28 11:59:59.371 11161 ERROR nova.wsgi
Sep 28 11:59:59 ctl02 nova-api[11161]: 2017-09-28 11:59:59.373 11161 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 11:59:59 ctl02 nova-api[11161]: 2017-09-28 11:59:59.511 11161 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 11:59:59 ctl02 nova-api[11161]: 2017-09-28 11:59:59.757 11161 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:59:59 ctl02 nova-api[11161]: 2017-09-28 11:59:59.760 11161 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:59:59 ctl02 nova-api[11161]: 2017-09-28 11:59:59.761 11161 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:59:59 ctl02 nova-api[11161]: 2017-09-28 11:59:59.761 11161 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:59:59 ctl02 nova-api[11161]: 2017-09-28 11:59:59.899 11161 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 11:59:59 ctl02 nova-api[11161]: 2017-09-28 11:59:59.901 11161 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 11:59:59 ctl02 nova-api[11161]: 2017-09-28 11:59:59.902 11161 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 11:59:59 ctl02 nova-api[11161]: 2017-09-28 11:59:59.902 11161 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 11:59:59 ctl02 nova-api[11161]: 2017-09-28 11:59:59.906 11161 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 11:59:59 ctl02 nova-api[11161]: 2017-09-28 11:59:59.906 11161 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 11:59:59 ctl02 nova-api[11161]: 2017-09-28 11:59:59.906 11161 ERROR nova Traceback (most recent call last):
Sep 28 11:59:59 ctl02 nova-api[11161]: 2017-09-28 11:59:59.906 11161 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 11:59:59 ctl02 nova-api[11161]: 2017-09-28 11:59:59.906 11161 ERROR nova     sys.exit(main())
Sep 28 11:59:59 ctl02 nova-api[11161]: 2017-09-28 11:59:59.906 11161 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 11:59:59 ctl02 nova-api[11161]: 2017-09-28 11:59:59.906 11161 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 11:59:59 ctl02 nova-api[11161]: 2017-09-28 11:59:59.906 11161 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 11:59:59 ctl02 nova-api[11161]: 2017-09-28 11:59:59.906 11161 ERROR nova     max_url_len=max_url_len)
Sep 28 11:59:59 ctl02 nova-api[11161]: 2017-09-28 11:59:59.906 11161 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 11:59:59 ctl02 nova-api[11161]: 2017-09-28 11:59:59.906 11161 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 11:59:59 ctl02 nova-api[11161]: 2017-09-28 11:59:59.906 11161 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 11:59:59 ctl02 nova-api[11161]: 2017-09-28 11:59:59.906 11161 ERROR nova     sock.listen(backlog)
Sep 28 11:59:59 ctl02 nova-api[11161]: 2017-09-28 11:59:59.906 11161 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 11:59:59 ctl02 nova-api[11161]: 2017-09-28 11:59:59.906 11161 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 11:59:59 ctl02 nova-api[11161]: 2017-09-28 11:59:59.906 11161 ERROR nova error: [Errno 98] Address already in use
Sep 28 11:59:59 ctl02 nova-api[11161]: 2017-09-28 11:59:59.906 11161 ERROR nova
Sep 28 12:00:00 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:00:00 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:00:00 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:00:00 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928120000274194
Sep 28 12:00:00 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 11175
Sep 28 12:00:00 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:00:00 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928120000274194
Sep 28 12:00:00 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:00:00 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:00:00 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:00:01 ctl02 nova-api[11184]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:00:01 ctl02 nova-api[11184]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:00:02 ctl02 nova-api[11184]: 2017-09-28 12:00:02.013 11184 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:00:02 ctl02 nova-api[11184]: 2017-09-28 12:00:02.015 11184 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:00:02 ctl02 nova-api[11184]: 2017-09-28 12:00:02.015 11184 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:00:02 ctl02 nova-api[11184]: 2017-09-28 12:00:02.015 11184 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:00:02 ctl02 nova-api[11184]: 2017-09-28 12:00:02.015 11184 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:00:02 ctl02 nova-api[11184]: 2017-09-28 12:00:02.015 11184 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:00:02 ctl02 nova-api[11184]: 2017-09-28 12:00:02.015 11184 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:00:02 ctl02 nova-api[11184]: 2017-09-28 12:00:02.015 11184 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:00:02 ctl02 nova-api[11184]: 2017-09-28 12:00:02.015 11184 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:00:02 ctl02 nova-api[11184]: 2017-09-28 12:00:02.015 11184 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:00:02 ctl02 nova-api[11184]: 2017-09-28 12:00:02.015 11184 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:00:02 ctl02 nova-api[11184]: 2017-09-28 12:00:02.015 11184 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:00:02 ctl02 nova-api[11184]: 2017-09-28 12:00:02.015 11184 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:00:02 ctl02 nova-api[11184]: 2017-09-28 12:00:02.015 11184 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:00:02 ctl02 nova-api[11184]: 2017-09-28 12:00:02.015 11184 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:00:02 ctl02 nova-api[11184]: 2017-09-28 12:00:02.015 11184 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:00:02 ctl02 nova-api[11184]: 2017-09-28 12:00:02.015 11184 ERROR nova.wsgi     self.filename))
Sep 28 12:00:02 ctl02 nova-api[11184]: 2017-09-28 12:00:02.015 11184 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:00:02 ctl02 nova-api[11184]: 2017-09-28 12:00:02.015 11184 ERROR nova.wsgi
Sep 28 12:00:02 ctl02 nova-api[11184]: 2017-09-28 12:00:02.017 11184 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:00:02 ctl02 nova-api[11184]: 2017-09-28 12:00:02.145 11184 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:00:02 ctl02 nova-api[11184]: 2017-09-28 12:00:02.377 11184 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:00:02 ctl02 nova-api[11184]: 2017-09-28 12:00:02.379 11184 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:00:02 ctl02 nova-api[11184]: 2017-09-28 12:00:02.379 11184 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:00:02 ctl02 nova-api[11184]: 2017-09-28 12:00:02.380 11184 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:00:02 ctl02 nova-api[11184]: 2017-09-28 12:00:02.508 11184 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:00:02 ctl02 nova-api[11184]: 2017-09-28 12:00:02.510 11184 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:00:02 ctl02 nova-api[11184]: 2017-09-28 12:00:02.510 11184 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:00:02 ctl02 nova-api[11184]: 2017-09-28 12:00:02.510 11184 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:00:02 ctl02 nova-api[11184]: 2017-09-28 12:00:02.514 11184 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:00:02 ctl02 nova-api[11184]: 2017-09-28 12:00:02.514 11184 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:00:02 ctl02 nova-api[11184]: 2017-09-28 12:00:02.514 11184 ERROR nova Traceback (most recent call last):
Sep 28 12:00:02 ctl02 nova-api[11184]: 2017-09-28 12:00:02.514 11184 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:00:02 ctl02 nova-api[11184]: 2017-09-28 12:00:02.514 11184 ERROR nova     sys.exit(main())
Sep 28 12:00:02 ctl02 nova-api[11184]: 2017-09-28 12:00:02.514 11184 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:00:02 ctl02 nova-api[11184]: 2017-09-28 12:00:02.514 11184 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:00:02 ctl02 nova-api[11184]: 2017-09-28 12:00:02.514 11184 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:00:02 ctl02 nova-api[11184]: 2017-09-28 12:00:02.514 11184 ERROR nova     max_url_len=max_url_len)
Sep 28 12:00:02 ctl02 nova-api[11184]: 2017-09-28 12:00:02.514 11184 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:00:02 ctl02 nova-api[11184]: 2017-09-28 12:00:02.514 11184 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:00:02 ctl02 nova-api[11184]: 2017-09-28 12:00:02.514 11184 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:00:02 ctl02 nova-api[11184]: 2017-09-28 12:00:02.514 11184 ERROR nova     sock.listen(backlog)
Sep 28 12:00:02 ctl02 nova-api[11184]: 2017-09-28 12:00:02.514 11184 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:00:02 ctl02 nova-api[11184]: 2017-09-28 12:00:02.514 11184 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:00:02 ctl02 nova-api[11184]: 2017-09-28 12:00:02.514 11184 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:00:02 ctl02 nova-api[11184]: 2017-09-28 12:00:02.514 11184 ERROR nova
Sep 28 12:00:02 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:00:02 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:00:02 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:00:02 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:00:02 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:00:02 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:00:02 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:00:03 ctl02 glance-api[29183]: 2017-09-28 12:00:03.085 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:00:03] "OPTIONS / HTTP/1.0" 200 134 0.000754
Sep 28 12:00:03 ctl02 nova-cert[4860]: 2017-09-28 12:00:03.652 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:00:04 ctl02 nova-api[11202]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:00:04 ctl02 nova-api[11202]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:00:04 ctl02 nova-api[11202]: 2017-09-28 12:00:04.609 11202 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:00:04 ctl02 nova-api[11202]: 2017-09-28 12:00:04.610 11202 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:00:04 ctl02 nova-api[11202]: 2017-09-28 12:00:04.610 11202 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:00:04 ctl02 nova-api[11202]: 2017-09-28 12:00:04.610 11202 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:00:04 ctl02 nova-api[11202]: 2017-09-28 12:00:04.610 11202 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:00:04 ctl02 nova-api[11202]: 2017-09-28 12:00:04.610 11202 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:00:04 ctl02 nova-api[11202]: 2017-09-28 12:00:04.610 11202 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:00:04 ctl02 nova-api[11202]: 2017-09-28 12:00:04.610 11202 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:00:04 ctl02 nova-api[11202]: 2017-09-28 12:00:04.610 11202 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:00:04 ctl02 nova-api[11202]: 2017-09-28 12:00:04.610 11202 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:00:04 ctl02 nova-api[11202]: 2017-09-28 12:00:04.610 11202 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:00:04 ctl02 nova-api[11202]: 2017-09-28 12:00:04.610 11202 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:00:04 ctl02 nova-api[11202]: 2017-09-28 12:00:04.610 11202 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:00:04 ctl02 nova-api[11202]: 2017-09-28 12:00:04.610 11202 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:00:04 ctl02 nova-api[11202]: 2017-09-28 12:00:04.610 11202 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:00:04 ctl02 nova-api[11202]: 2017-09-28 12:00:04.610 11202 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:00:04 ctl02 nova-api[11202]: 2017-09-28 12:00:04.610 11202 ERROR nova.wsgi     self.filename))
Sep 28 12:00:04 ctl02 nova-api[11202]: 2017-09-28 12:00:04.610 11202 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:00:04 ctl02 nova-api[11202]: 2017-09-28 12:00:04.610 11202 ERROR nova.wsgi
Sep 28 12:00:04 ctl02 nova-api[11202]: 2017-09-28 12:00:04.611 11202 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:00:04 ctl02 nova-api[11202]: 2017-09-28 12:00:04.740 11202 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:00:04 ctl02 nova-api[11202]: 2017-09-28 12:00:04.975 11202 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:00:04 ctl02 nova-api[11202]: 2017-09-28 12:00:04.977 11202 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:00:04 ctl02 nova-api[11202]: 2017-09-28 12:00:04.978 11202 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:00:04 ctl02 nova-api[11202]: 2017-09-28 12:00:04.978 11202 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:00:05 ctl02 nova-api[11202]: 2017-09-28 12:00:05.108 11202 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:00:05 ctl02 nova-api[11202]: 2017-09-28 12:00:05.110 11202 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:00:05 ctl02 nova-api[11202]: 2017-09-28 12:00:05.110 11202 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:00:05 ctl02 nova-api[11202]: 2017-09-28 12:00:05.110 11202 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:00:05 ctl02 nova-api[11202]: 2017-09-28 12:00:05.113 11202 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:00:05 ctl02 nova-api[11202]: 2017-09-28 12:00:05.114 11202 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:00:05 ctl02 nova-api[11202]: 2017-09-28 12:00:05.114 11202 ERROR nova Traceback (most recent call last):
Sep 28 12:00:05 ctl02 nova-api[11202]: 2017-09-28 12:00:05.114 11202 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:00:05 ctl02 nova-api[11202]: 2017-09-28 12:00:05.114 11202 ERROR nova     sys.exit(main())
Sep 28 12:00:05 ctl02 nova-api[11202]: 2017-09-28 12:00:05.114 11202 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:00:05 ctl02 nova-api[11202]: 2017-09-28 12:00:05.114 11202 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:00:05 ctl02 nova-api[11202]: 2017-09-28 12:00:05.114 11202 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:00:05 ctl02 nova-api[11202]: 2017-09-28 12:00:05.114 11202 ERROR nova     max_url_len=max_url_len)
Sep 28 12:00:05 ctl02 nova-api[11202]: 2017-09-28 12:00:05.114 11202 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:00:05 ctl02 nova-api[11202]: 2017-09-28 12:00:05.114 11202 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:00:05 ctl02 nova-api[11202]: 2017-09-28 12:00:05.114 11202 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:00:05 ctl02 nova-api[11202]: 2017-09-28 12:00:05.114 11202 ERROR nova     sock.listen(backlog)
Sep 28 12:00:05 ctl02 nova-api[11202]: 2017-09-28 12:00:05.114 11202 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:00:05 ctl02 nova-api[11202]: 2017-09-28 12:00:05.114 11202 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:00:05 ctl02 nova-api[11202]: 2017-09-28 12:00:05.114 11202 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:00:05 ctl02 nova-api[11202]: 2017-09-28 12:00:05.114 11202 ERROR nova
Sep 28 12:00:05 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:00:05 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:00:05 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:00:05 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:00:05 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:00:05 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:00:05 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:00:06 ctl02 nova-conductor[5056]: 2017-09-28 12:00:06.224 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:00:06 ctl02 nova-conductor[5056]: 2017-09-28 12:00:06.239 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:00:06 ctl02 nova-conductor[5056]: 2017-09-28 12:00:06.254 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:00:06 ctl02 nova-conductor[5056]: 2017-09-28 12:00:06.262 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:00:06 ctl02 glance-api[29183]: 2017-09-28 12:00:06.817 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:00:06] "OPTIONS / HTTP/1.0" 200 134 0.000647
Sep 28 12:00:06 ctl02 nova-api[11220]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:00:06 ctl02 nova-api[11220]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:00:07 ctl02 nova-api[11220]: 2017-09-28 12:00:07.083 11220 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:00:07 ctl02 nova-api[11220]: 2017-09-28 12:00:07.085 11220 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:00:07 ctl02 nova-api[11220]: 2017-09-28 12:00:07.085 11220 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:00:07 ctl02 nova-api[11220]: 2017-09-28 12:00:07.085 11220 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:00:07 ctl02 nova-api[11220]: 2017-09-28 12:00:07.085 11220 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:00:07 ctl02 nova-api[11220]: 2017-09-28 12:00:07.085 11220 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:00:07 ctl02 nova-api[11220]: 2017-09-28 12:00:07.085 11220 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:00:07 ctl02 nova-api[11220]: 2017-09-28 12:00:07.085 11220 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:00:07 ctl02 nova-api[11220]: 2017-09-28 12:00:07.085 11220 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:00:07 ctl02 nova-api[11220]: 2017-09-28 12:00:07.085 11220 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:00:07 ctl02 nova-api[11220]: 2017-09-28 12:00:07.085 11220 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:00:07 ctl02 nova-api[11220]: 2017-09-28 12:00:07.085 11220 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:00:07 ctl02 nova-api[11220]: 2017-09-28 12:00:07.085 11220 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:00:07 ctl02 nova-api[11220]: 2017-09-28 12:00:07.085 11220 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:00:07 ctl02 nova-api[11220]: 2017-09-28 12:00:07.085 11220 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:00:07 ctl02 nova-api[11220]: 2017-09-28 12:00:07.085 11220 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:00:07 ctl02 nova-api[11220]: 2017-09-28 12:00:07.085 11220 ERROR nova.wsgi     self.filename))
Sep 28 12:00:07 ctl02 nova-api[11220]: 2017-09-28 12:00:07.085 11220 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:00:07 ctl02 nova-api[11220]: 2017-09-28 12:00:07.085 11220 ERROR nova.wsgi
Sep 28 12:00:07 ctl02 nova-api[11220]: 2017-09-28 12:00:07.086 11220 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:00:07 ctl02 nova-api[11220]: 2017-09-28 12:00:07.218 11220 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:00:07 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb12fe665)
Sep 28 12:00:07 ctl02 nova-api[11220]: 2017-09-28 12:00:07.460 11220 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:00:07 ctl02 nova-api[11220]: 2017-09-28 12:00:07.463 11220 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:00:07 ctl02 nova-api[11220]: 2017-09-28 12:00:07.464 11220 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:00:07 ctl02 nova-api[11220]: 2017-09-28 12:00:07.464 11220 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:00:07 ctl02 nova-api[11220]: 2017-09-28 12:00:07.598 11220 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:00:07 ctl02 nova-api[11220]: 2017-09-28 12:00:07.601 11220 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:00:07 ctl02 nova-api[11220]: 2017-09-28 12:00:07.601 11220 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:00:07 ctl02 nova-api[11220]: 2017-09-28 12:00:07.602 11220 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:00:07 ctl02 nova-api[11220]: 2017-09-28 12:00:07.605 11220 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:00:07 ctl02 nova-api[11220]: 2017-09-28 12:00:07.606 11220 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:00:07 ctl02 nova-api[11220]: 2017-09-28 12:00:07.606 11220 ERROR nova Traceback (most recent call last):
Sep 28 12:00:07 ctl02 nova-api[11220]: 2017-09-28 12:00:07.606 11220 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:00:07 ctl02 nova-api[11220]: 2017-09-28 12:00:07.606 11220 ERROR nova     sys.exit(main())
Sep 28 12:00:07 ctl02 nova-api[11220]: 2017-09-28 12:00:07.606 11220 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:00:07 ctl02 nova-api[11220]: 2017-09-28 12:00:07.606 11220 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:00:07 ctl02 nova-api[11220]: 2017-09-28 12:00:07.606 11220 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:00:07 ctl02 nova-api[11220]: 2017-09-28 12:00:07.606 11220 ERROR nova     max_url_len=max_url_len)
Sep 28 12:00:07 ctl02 nova-api[11220]: 2017-09-28 12:00:07.606 11220 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:00:07 ctl02 nova-api[11220]: 2017-09-28 12:00:07.606 11220 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:00:07 ctl02 nova-api[11220]: 2017-09-28 12:00:07.606 11220 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:00:07 ctl02 nova-api[11220]: 2017-09-28 12:00:07.606 11220 ERROR nova     sock.listen(backlog)
Sep 28 12:00:07 ctl02 nova-api[11220]: 2017-09-28 12:00:07.606 11220 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:00:07 ctl02 nova-api[11220]: 2017-09-28 12:00:07.606 11220 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:00:07 ctl02 nova-api[11220]: 2017-09-28 12:00:07.606 11220 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:00:07 ctl02 nova-api[11220]: 2017-09-28 12:00:07.606 11220 ERROR nova
Sep 28 12:00:07 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:00:07 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:00:07 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:00:07 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:00:07 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:00:07 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:00:07 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:00:08 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb12fe665)
Sep 28 12:00:09 ctl02 glance-api[29183]: 2017-09-28 12:00:09.169 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:00:09] "OPTIONS / HTTP/1.0" 200 134 0.000637
Sep 28 12:00:09 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb12fe665)
Sep 28 12:00:09 ctl02 nova-api[11238]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:00:09 ctl02 nova-api[11238]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:00:09 ctl02 nova-api[11238]: 2017-09-28 12:00:09.570 11238 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:00:09 ctl02 nova-api[11238]: 2017-09-28 12:00:09.572 11238 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:00:09 ctl02 nova-api[11238]: 2017-09-28 12:00:09.572 11238 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:00:09 ctl02 nova-api[11238]: 2017-09-28 12:00:09.572 11238 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:00:09 ctl02 nova-api[11238]: 2017-09-28 12:00:09.572 11238 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:00:09 ctl02 nova-api[11238]: 2017-09-28 12:00:09.572 11238 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:00:09 ctl02 nova-api[11238]: 2017-09-28 12:00:09.572 11238 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:00:09 ctl02 nova-api[11238]: 2017-09-28 12:00:09.572 11238 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:00:09 ctl02 nova-api[11238]: 2017-09-28 12:00:09.572 11238 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:00:09 ctl02 nova-api[11238]: 2017-09-28 12:00:09.572 11238 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:00:09 ctl02 nova-api[11238]: 2017-09-28 12:00:09.572 11238 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:00:09 ctl02 nova-api[11238]: 2017-09-28 12:00:09.572 11238 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:00:09 ctl02 nova-api[11238]: 2017-09-28 12:00:09.572 11238 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:00:09 ctl02 nova-api[11238]: 2017-09-28 12:00:09.572 11238 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:00:09 ctl02 nova-api[11238]: 2017-09-28 12:00:09.572 11238 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:00:09 ctl02 nova-api[11238]: 2017-09-28 12:00:09.572 11238 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:00:09 ctl02 nova-api[11238]: 2017-09-28 12:00:09.572 11238 ERROR nova.wsgi     self.filename))
Sep 28 12:00:09 ctl02 nova-api[11238]: 2017-09-28 12:00:09.572 11238 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:00:09 ctl02 nova-api[11238]: 2017-09-28 12:00:09.572 11238 ERROR nova.wsgi
Sep 28 12:00:09 ctl02 nova-api[11238]: 2017-09-28 12:00:09.574 11238 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:00:09 ctl02 nova-api[11238]: 2017-09-28 12:00:09.705 11238 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:00:09 ctl02 nova-api[11238]: 2017-09-28 12:00:09.976 11238 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:00:09 ctl02 nova-api[11238]: 2017-09-28 12:00:09.978 11238 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:00:09 ctl02 nova-api[11238]: 2017-09-28 12:00:09.978 11238 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:00:09 ctl02 nova-api[11238]: 2017-09-28 12:00:09.979 11238 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:00:10 ctl02 nova-api[11238]: 2017-09-28 12:00:10.109 11238 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:00:10 ctl02 nova-api[11238]: 2017-09-28 12:00:10.111 11238 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:00:10 ctl02 nova-api[11238]: 2017-09-28 12:00:10.111 11238 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:00:10 ctl02 nova-api[11238]: 2017-09-28 12:00:10.112 11238 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:00:10 ctl02 nova-api[11238]: 2017-09-28 12:00:10.115 11238 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:00:10 ctl02 nova-api[11238]: 2017-09-28 12:00:10.116 11238 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:00:10 ctl02 nova-api[11238]: 2017-09-28 12:00:10.116 11238 ERROR nova Traceback (most recent call last):
Sep 28 12:00:10 ctl02 nova-api[11238]: 2017-09-28 12:00:10.116 11238 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:00:10 ctl02 nova-api[11238]: 2017-09-28 12:00:10.116 11238 ERROR nova     sys.exit(main())
Sep 28 12:00:10 ctl02 nova-api[11238]: 2017-09-28 12:00:10.116 11238 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:00:10 ctl02 nova-api[11238]: 2017-09-28 12:00:10.116 11238 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:00:10 ctl02 nova-api[11238]: 2017-09-28 12:00:10.116 11238 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:00:10 ctl02 nova-api[11238]: 2017-09-28 12:00:10.116 11238 ERROR nova     max_url_len=max_url_len)
Sep 28 12:00:10 ctl02 nova-api[11238]: 2017-09-28 12:00:10.116 11238 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:00:10 ctl02 nova-api[11238]: 2017-09-28 12:00:10.116 11238 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:00:10 ctl02 nova-api[11238]: 2017-09-28 12:00:10.116 11238 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:00:10 ctl02 nova-api[11238]: 2017-09-28 12:00:10.116 11238 ERROR nova     sock.listen(backlog)
Sep 28 12:00:10 ctl02 nova-api[11238]: 2017-09-28 12:00:10.116 11238 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:00:10 ctl02 nova-api[11238]: 2017-09-28 12:00:10.116 11238 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:00:10 ctl02 nova-api[11238]: 2017-09-28 12:00:10.116 11238 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:00:10 ctl02 nova-api[11238]: 2017-09-28 12:00:10.116 11238 ERROR nova
Sep 28 12:00:10 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:00:10 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:00:10 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:00:10 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb12fe665)
Sep 28 12:00:10 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:00:10 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:00:10 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:00:10 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:00:10 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928120010440823
Sep 28 12:00:10 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 11263
Sep 28 12:00:10 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928120010440823
Sep 28 12:00:11 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb12fe665)
Sep 28 12:00:11 ctl02 nova-api[11256]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:00:11 ctl02 nova-api[11256]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:00:12 ctl02 nova-api[11256]: 2017-09-28 12:00:12.093 11256 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:00:12 ctl02 nova-api[11256]: 2017-09-28 12:00:12.095 11256 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:00:12 ctl02 nova-api[11256]: 2017-09-28 12:00:12.095 11256 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:00:12 ctl02 nova-api[11256]: 2017-09-28 12:00:12.095 11256 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:00:12 ctl02 nova-api[11256]: 2017-09-28 12:00:12.095 11256 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:00:12 ctl02 nova-api[11256]: 2017-09-28 12:00:12.095 11256 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:00:12 ctl02 nova-api[11256]: 2017-09-28 12:00:12.095 11256 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:00:12 ctl02 nova-api[11256]: 2017-09-28 12:00:12.095 11256 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:00:12 ctl02 nova-api[11256]: 2017-09-28 12:00:12.095 11256 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:00:12 ctl02 nova-api[11256]: 2017-09-28 12:00:12.095 11256 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:00:12 ctl02 nova-api[11256]: 2017-09-28 12:00:12.095 11256 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:00:12 ctl02 nova-api[11256]: 2017-09-28 12:00:12.095 11256 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:00:12 ctl02 nova-api[11256]: 2017-09-28 12:00:12.095 11256 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:00:12 ctl02 nova-api[11256]: 2017-09-28 12:00:12.095 11256 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:00:12 ctl02 nova-api[11256]: 2017-09-28 12:00:12.095 11256 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:00:12 ctl02 nova-api[11256]: 2017-09-28 12:00:12.095 11256 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:00:12 ctl02 nova-api[11256]: 2017-09-28 12:00:12.095 11256 ERROR nova.wsgi     self.filename))
Sep 28 12:00:12 ctl02 nova-api[11256]: 2017-09-28 12:00:12.095 11256 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:00:12 ctl02 nova-api[11256]: 2017-09-28 12:00:12.095 11256 ERROR nova.wsgi
Sep 28 12:00:12 ctl02 nova-api[11256]: 2017-09-28 12:00:12.097 11256 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:00:12 ctl02 nova-api[11256]: 2017-09-28 12:00:12.231 11256 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:00:12 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb12fe665)
Sep 28 12:00:12 ctl02 nova-api[11256]: 2017-09-28 12:00:12.472 11256 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:00:12 ctl02 nova-api[11256]: 2017-09-28 12:00:12.474 11256 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:00:12 ctl02 nova-api[11256]: 2017-09-28 12:00:12.474 11256 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:00:12 ctl02 nova-api[11256]: 2017-09-28 12:00:12.474 11256 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:00:12 ctl02 nova-api[11256]: 2017-09-28 12:00:12.607 11256 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:00:12 ctl02 nova-api[11256]: 2017-09-28 12:00:12.609 11256 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:00:12 ctl02 nova-api[11256]: 2017-09-28 12:00:12.609 11256 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:00:12 ctl02 nova-api[11256]: 2017-09-28 12:00:12.610 11256 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:00:12 ctl02 nova-api[11256]: 2017-09-28 12:00:12.613 11256 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:00:12 ctl02 nova-api[11256]: 2017-09-28 12:00:12.613 11256 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:00:12 ctl02 nova-api[11256]: 2017-09-28 12:00:12.613 11256 ERROR nova Traceback (most recent call last):
Sep 28 12:00:12 ctl02 nova-api[11256]: 2017-09-28 12:00:12.613 11256 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:00:12 ctl02 nova-api[11256]: 2017-09-28 12:00:12.613 11256 ERROR nova     sys.exit(main())
Sep 28 12:00:12 ctl02 nova-api[11256]: 2017-09-28 12:00:12.613 11256 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:00:12 ctl02 nova-api[11256]: 2017-09-28 12:00:12.613 11256 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:00:12 ctl02 nova-api[11256]: 2017-09-28 12:00:12.613 11256 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:00:12 ctl02 nova-api[11256]: 2017-09-28 12:00:12.613 11256 ERROR nova     max_url_len=max_url_len)
Sep 28 12:00:12 ctl02 nova-api[11256]: 2017-09-28 12:00:12.613 11256 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:00:12 ctl02 nova-api[11256]: 2017-09-28 12:00:12.613 11256 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:00:12 ctl02 nova-api[11256]: 2017-09-28 12:00:12.613 11256 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:00:12 ctl02 nova-api[11256]: 2017-09-28 12:00:12.613 11256 ERROR nova     sock.listen(backlog)
Sep 28 12:00:12 ctl02 nova-api[11256]: 2017-09-28 12:00:12.613 11256 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:00:12 ctl02 nova-api[11256]: 2017-09-28 12:00:12.613 11256 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:00:12 ctl02 nova-api[11256]: 2017-09-28 12:00:12.613 11256 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:00:12 ctl02 nova-api[11256]: 2017-09-28 12:00:12.613 11256 ERROR nova
Sep 28 12:00:12 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:00:12 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:00:12 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:00:12 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:00:12 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:00:12 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:00:12 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:00:13 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb12fe665)
Sep 28 12:00:13 ctl02 glance-api[29183]: 2017-09-28 12:00:13.404 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:00:13] "OPTIONS / HTTP/1.0" 200 134 0.000688
Sep 28 12:00:13 ctl02 nova-consoleauth[5433]: 2017-09-28 12:00:13.538 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:00:14 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb12fe665)
Sep 28 12:00:14 ctl02 nova-api[11279]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:00:14 ctl02 nova-api[11279]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:00:14 ctl02 nova-api[11279]: 2017-09-28 12:00:14.588 11279 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:00:14 ctl02 nova-api[11279]: 2017-09-28 12:00:14.589 11279 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:00:14 ctl02 nova-api[11279]: 2017-09-28 12:00:14.589 11279 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:00:14 ctl02 nova-api[11279]: 2017-09-28 12:00:14.589 11279 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:00:14 ctl02 nova-api[11279]: 2017-09-28 12:00:14.589 11279 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:00:14 ctl02 nova-api[11279]: 2017-09-28 12:00:14.589 11279 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:00:14 ctl02 nova-api[11279]: 2017-09-28 12:00:14.589 11279 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:00:14 ctl02 nova-api[11279]: 2017-09-28 12:00:14.589 11279 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:00:14 ctl02 nova-api[11279]: 2017-09-28 12:00:14.589 11279 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:00:14 ctl02 nova-api[11279]: 2017-09-28 12:00:14.589 11279 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:00:14 ctl02 nova-api[11279]: 2017-09-28 12:00:14.589 11279 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:00:14 ctl02 nova-api[11279]: 2017-09-28 12:00:14.589 11279 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:00:14 ctl02 nova-api[11279]: 2017-09-28 12:00:14.589 11279 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:00:14 ctl02 nova-api[11279]: 2017-09-28 12:00:14.589 11279 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:00:14 ctl02 nova-api[11279]: 2017-09-28 12:00:14.589 11279 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:00:14 ctl02 nova-api[11279]: 2017-09-28 12:00:14.589 11279 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:00:14 ctl02 nova-api[11279]: 2017-09-28 12:00:14.589 11279 ERROR nova.wsgi     self.filename))
Sep 28 12:00:14 ctl02 nova-api[11279]: 2017-09-28 12:00:14.589 11279 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:00:14 ctl02 nova-api[11279]: 2017-09-28 12:00:14.589 11279 ERROR nova.wsgi
Sep 28 12:00:14 ctl02 nova-api[11279]: 2017-09-28 12:00:14.590 11279 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:00:14 ctl02 nova-api[11279]: 2017-09-28 12:00:14.720 11279 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:00:14 ctl02 nova-api[11279]: 2017-09-28 12:00:14.955 11279 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:00:14 ctl02 nova-api[11279]: 2017-09-28 12:00:14.958 11279 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:00:14 ctl02 nova-api[11279]: 2017-09-28 12:00:14.958 11279 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:00:14 ctl02 nova-api[11279]: 2017-09-28 12:00:14.958 11279 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:00:15 ctl02 nova-api[11279]: 2017-09-28 12:00:15.088 11279 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:00:15 ctl02 nova-api[11279]: 2017-09-28 12:00:15.090 11279 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:00:15 ctl02 nova-api[11279]: 2017-09-28 12:00:15.091 11279 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:00:15 ctl02 nova-api[11279]: 2017-09-28 12:00:15.091 11279 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:00:15 ctl02 nova-api[11279]: 2017-09-28 12:00:15.094 11279 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:00:15 ctl02 nova-api[11279]: 2017-09-28 12:00:15.094 11279 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:00:15 ctl02 nova-api[11279]: 2017-09-28 12:00:15.094 11279 ERROR nova Traceback (most recent call last):
Sep 28 12:00:15 ctl02 nova-api[11279]: 2017-09-28 12:00:15.094 11279 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:00:15 ctl02 nova-api[11279]: 2017-09-28 12:00:15.094 11279 ERROR nova     sys.exit(main())
Sep 28 12:00:15 ctl02 nova-api[11279]: 2017-09-28 12:00:15.094 11279 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:00:15 ctl02 nova-api[11279]: 2017-09-28 12:00:15.094 11279 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:00:15 ctl02 nova-api[11279]: 2017-09-28 12:00:15.094 11279 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:00:15 ctl02 nova-api[11279]: 2017-09-28 12:00:15.094 11279 ERROR nova     max_url_len=max_url_len)
Sep 28 12:00:15 ctl02 nova-api[11279]: 2017-09-28 12:00:15.094 11279 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:00:15 ctl02 nova-api[11279]: 2017-09-28 12:00:15.094 11279 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:00:15 ctl02 nova-api[11279]: 2017-09-28 12:00:15.094 11279 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:00:15 ctl02 nova-api[11279]: 2017-09-28 12:00:15.094 11279 ERROR nova     sock.listen(backlog)
Sep 28 12:00:15 ctl02 nova-api[11279]: 2017-09-28 12:00:15.094 11279 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:00:15 ctl02 nova-api[11279]: 2017-09-28 12:00:15.094 11279 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:00:15 ctl02 nova-api[11279]: 2017-09-28 12:00:15.094 11279 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:00:15 ctl02 nova-api[11279]: 2017-09-28 12:00:15.094 11279 ERROR nova
Sep 28 12:00:15 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:00:15 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:00:15 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:00:15 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb12fe665)
Sep 28 12:00:15 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:00:15 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:00:15 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:00:15 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:00:16 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb12fe665)
Sep 28 12:00:16 ctl02 glance-api[29183]: 2017-09-28 12:00:16.428 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:00:16] "OPTIONS / HTTP/1.0" 200 134 0.000694
Sep 28 12:00:16 ctl02 nova-scheduler[5620]: 2017-09-28 12:00:16.563 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:00:16 ctl02 nova-api[11297]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:00:16 ctl02 nova-api[11297]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:00:17 ctl02 nova-api[11297]: 2017-09-28 12:00:17.075 11297 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:00:17 ctl02 nova-api[11297]: 2017-09-28 12:00:17.077 11297 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:00:17 ctl02 nova-api[11297]: 2017-09-28 12:00:17.077 11297 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:00:17 ctl02 nova-api[11297]: 2017-09-28 12:00:17.077 11297 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:00:17 ctl02 nova-api[11297]: 2017-09-28 12:00:17.077 11297 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:00:17 ctl02 nova-api[11297]: 2017-09-28 12:00:17.077 11297 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:00:17 ctl02 nova-api[11297]: 2017-09-28 12:00:17.077 11297 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:00:17 ctl02 nova-api[11297]: 2017-09-28 12:00:17.077 11297 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:00:17 ctl02 nova-api[11297]: 2017-09-28 12:00:17.077 11297 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:00:17 ctl02 nova-api[11297]: 2017-09-28 12:00:17.077 11297 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:00:17 ctl02 nova-api[11297]: 2017-09-28 12:00:17.077 11297 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:00:17 ctl02 nova-api[11297]: 2017-09-28 12:00:17.077 11297 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:00:17 ctl02 nova-api[11297]: 2017-09-28 12:00:17.077 11297 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:00:17 ctl02 nova-api[11297]: 2017-09-28 12:00:17.077 11297 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:00:17 ctl02 nova-api[11297]: 2017-09-28 12:00:17.077 11297 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:00:17 ctl02 nova-api[11297]: 2017-09-28 12:00:17.077 11297 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:00:17 ctl02 nova-api[11297]: 2017-09-28 12:00:17.077 11297 ERROR nova.wsgi     self.filename))
Sep 28 12:00:17 ctl02 nova-api[11297]: 2017-09-28 12:00:17.077 11297 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:00:17 ctl02 nova-api[11297]: 2017-09-28 12:00:17.077 11297 ERROR nova.wsgi
Sep 28 12:00:17 ctl02 nova-api[11297]: 2017-09-28 12:00:17.079 11297 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:00:17 ctl02 nova-api[11297]: 2017-09-28 12:00:17.216 11297 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:00:17 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb12fe665)
Sep 28 12:00:17 ctl02 nova-api[11297]: 2017-09-28 12:00:17.456 11297 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:00:17 ctl02 nova-api[11297]: 2017-09-28 12:00:17.460 11297 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:00:17 ctl02 nova-api[11297]: 2017-09-28 12:00:17.460 11297 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:00:17 ctl02 nova-api[11297]: 2017-09-28 12:00:17.461 11297 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:00:17 ctl02 nova-api[11297]: 2017-09-28 12:00:17.592 11297 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:00:17 ctl02 nova-api[11297]: 2017-09-28 12:00:17.595 11297 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:00:17 ctl02 nova-api[11297]: 2017-09-28 12:00:17.595 11297 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:00:17 ctl02 nova-api[11297]: 2017-09-28 12:00:17.595 11297 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:00:17 ctl02 nova-api[11297]: 2017-09-28 12:00:17.599 11297 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:00:17 ctl02 nova-api[11297]: 2017-09-28 12:00:17.599 11297 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:00:17 ctl02 nova-api[11297]: 2017-09-28 12:00:17.599 11297 ERROR nova Traceback (most recent call last):
Sep 28 12:00:17 ctl02 nova-api[11297]: 2017-09-28 12:00:17.599 11297 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:00:17 ctl02 nova-api[11297]: 2017-09-28 12:00:17.599 11297 ERROR nova     sys.exit(main())
Sep 28 12:00:17 ctl02 nova-api[11297]: 2017-09-28 12:00:17.599 11297 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:00:17 ctl02 nova-api[11297]: 2017-09-28 12:00:17.599 11297 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:00:17 ctl02 nova-api[11297]: 2017-09-28 12:00:17.599 11297 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:00:17 ctl02 nova-api[11297]: 2017-09-28 12:00:17.599 11297 ERROR nova     max_url_len=max_url_len)
Sep 28 12:00:17 ctl02 nova-api[11297]: 2017-09-28 12:00:17.599 11297 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:00:17 ctl02 nova-api[11297]: 2017-09-28 12:00:17.599 11297 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:00:17 ctl02 nova-api[11297]: 2017-09-28 12:00:17.599 11297 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:00:17 ctl02 nova-api[11297]: 2017-09-28 12:00:17.599 11297 ERROR nova     sock.listen(backlog)
Sep 28 12:00:17 ctl02 nova-api[11297]: 2017-09-28 12:00:17.599 11297 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:00:17 ctl02 nova-api[11297]: 2017-09-28 12:00:17.599 11297 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:00:17 ctl02 nova-api[11297]: 2017-09-28 12:00:17.599 11297 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:00:17 ctl02 nova-api[11297]: 2017-09-28 12:00:17.599 11297 ERROR nova
Sep 28 12:00:17 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:00:17 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:00:17 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:00:17 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:00:17 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:00:17 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:00:17 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:00:18 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:00:18 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:00:19 ctl02 nova-api[11315]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:00:19 ctl02 nova-api[11315]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:00:19 ctl02 glance-api[29183]: 2017-09-28 12:00:19.445 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:00:19] "OPTIONS / HTTP/1.0" 200 134 0.000700
Sep 28 12:00:19 ctl02 nova-api[11315]: 2017-09-28 12:00:19.579 11315 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:00:19 ctl02 nova-api[11315]: 2017-09-28 12:00:19.581 11315 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:00:19 ctl02 nova-api[11315]: 2017-09-28 12:00:19.581 11315 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:00:19 ctl02 nova-api[11315]: 2017-09-28 12:00:19.581 11315 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:00:19 ctl02 nova-api[11315]: 2017-09-28 12:00:19.581 11315 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:00:19 ctl02 nova-api[11315]: 2017-09-28 12:00:19.581 11315 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:00:19 ctl02 nova-api[11315]: 2017-09-28 12:00:19.581 11315 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:00:19 ctl02 nova-api[11315]: 2017-09-28 12:00:19.581 11315 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:00:19 ctl02 nova-api[11315]: 2017-09-28 12:00:19.581 11315 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:00:19 ctl02 nova-api[11315]: 2017-09-28 12:00:19.581 11315 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:00:19 ctl02 nova-api[11315]: 2017-09-28 12:00:19.581 11315 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:00:19 ctl02 nova-api[11315]: 2017-09-28 12:00:19.581 11315 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:00:19 ctl02 nova-api[11315]: 2017-09-28 12:00:19.581 11315 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:00:19 ctl02 nova-api[11315]: 2017-09-28 12:00:19.581 11315 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:00:19 ctl02 nova-api[11315]: 2017-09-28 12:00:19.581 11315 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:00:19 ctl02 nova-api[11315]: 2017-09-28 12:00:19.581 11315 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:00:19 ctl02 nova-api[11315]: 2017-09-28 12:00:19.581 11315 ERROR nova.wsgi     self.filename))
Sep 28 12:00:19 ctl02 nova-api[11315]: 2017-09-28 12:00:19.581 11315 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:00:19 ctl02 nova-api[11315]: 2017-09-28 12:00:19.581 11315 ERROR nova.wsgi
Sep 28 12:00:19 ctl02 nova-api[11315]: 2017-09-28 12:00:19.582 11315 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:00:19 ctl02 nova-api[11315]: 2017-09-28 12:00:19.713 11315 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:00:19 ctl02 nova-api[11315]: 2017-09-28 12:00:19.948 11315 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:00:19 ctl02 nova-api[11315]: 2017-09-28 12:00:19.950 11315 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:00:19 ctl02 nova-api[11315]: 2017-09-28 12:00:19.960 11315 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:00:19 ctl02 nova-api[11315]: 2017-09-28 12:00:19.960 11315 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:00:20 ctl02 nova-api[11315]: 2017-09-28 12:00:20.091 11315 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:00:20 ctl02 nova-api[11315]: 2017-09-28 12:00:20.093 11315 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:00:20 ctl02 nova-api[11315]: 2017-09-28 12:00:20.093 11315 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:00:20 ctl02 nova-api[11315]: 2017-09-28 12:00:20.093 11315 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:00:20 ctl02 nova-api[11315]: 2017-09-28 12:00:20.097 11315 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:00:20 ctl02 nova-api[11315]: 2017-09-28 12:00:20.097 11315 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:00:20 ctl02 nova-api[11315]: 2017-09-28 12:00:20.097 11315 ERROR nova Traceback (most recent call last):
Sep 28 12:00:20 ctl02 nova-api[11315]: 2017-09-28 12:00:20.097 11315 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:00:20 ctl02 nova-api[11315]: 2017-09-28 12:00:20.097 11315 ERROR nova     sys.exit(main())
Sep 28 12:00:20 ctl02 nova-api[11315]: 2017-09-28 12:00:20.097 11315 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:00:20 ctl02 nova-api[11315]: 2017-09-28 12:00:20.097 11315 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:00:20 ctl02 nova-api[11315]: 2017-09-28 12:00:20.097 11315 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:00:20 ctl02 nova-api[11315]: 2017-09-28 12:00:20.097 11315 ERROR nova     max_url_len=max_url_len)
Sep 28 12:00:20 ctl02 nova-api[11315]: 2017-09-28 12:00:20.097 11315 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:00:20 ctl02 nova-api[11315]: 2017-09-28 12:00:20.097 11315 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:00:20 ctl02 nova-api[11315]: 2017-09-28 12:00:20.097 11315 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:00:20 ctl02 nova-api[11315]: 2017-09-28 12:00:20.097 11315 ERROR nova     sock.listen(backlog)
Sep 28 12:00:20 ctl02 nova-api[11315]: 2017-09-28 12:00:20.097 11315 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:00:20 ctl02 nova-api[11315]: 2017-09-28 12:00:20.097 11315 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:00:20 ctl02 nova-api[11315]: 2017-09-28 12:00:20.097 11315 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:00:20 ctl02 nova-api[11315]: 2017-09-28 12:00:20.097 11315 ERROR nova
Sep 28 12:00:20 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:00:20 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:00:20 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:00:20 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:00:20 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:00:20 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:00:20 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:00:20 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928120020609221
Sep 28 12:00:20 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 11349
Sep 28 12:00:20 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928120020609221
Sep 28 12:00:21 ctl02 nova-api[11338]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:00:21 ctl02 nova-api[11338]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:00:22 ctl02 nova-api[11338]: 2017-09-28 12:00:22.100 11338 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:00:22 ctl02 nova-api[11338]: 2017-09-28 12:00:22.101 11338 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:00:22 ctl02 nova-api[11338]: 2017-09-28 12:00:22.101 11338 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:00:22 ctl02 nova-api[11338]: 2017-09-28 12:00:22.101 11338 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:00:22 ctl02 nova-api[11338]: 2017-09-28 12:00:22.101 11338 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:00:22 ctl02 nova-api[11338]: 2017-09-28 12:00:22.101 11338 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:00:22 ctl02 nova-api[11338]: 2017-09-28 12:00:22.101 11338 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:00:22 ctl02 nova-api[11338]: 2017-09-28 12:00:22.101 11338 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:00:22 ctl02 nova-api[11338]: 2017-09-28 12:00:22.101 11338 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:00:22 ctl02 nova-api[11338]: 2017-09-28 12:00:22.101 11338 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:00:22 ctl02 nova-api[11338]: 2017-09-28 12:00:22.101 11338 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:00:22 ctl02 nova-api[11338]: 2017-09-28 12:00:22.101 11338 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:00:22 ctl02 nova-api[11338]: 2017-09-28 12:00:22.101 11338 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:00:22 ctl02 nova-api[11338]: 2017-09-28 12:00:22.101 11338 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:00:22 ctl02 nova-api[11338]: 2017-09-28 12:00:22.101 11338 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:00:22 ctl02 nova-api[11338]: 2017-09-28 12:00:22.101 11338 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:00:22 ctl02 nova-api[11338]: 2017-09-28 12:00:22.101 11338 ERROR nova.wsgi     self.filename))
Sep 28 12:00:22 ctl02 nova-api[11338]: 2017-09-28 12:00:22.101 11338 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:00:22 ctl02 nova-api[11338]: 2017-09-28 12:00:22.101 11338 ERROR nova.wsgi
Sep 28 12:00:22 ctl02 nova-api[11338]: 2017-09-28 12:00:22.104 11338 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:00:22 ctl02 nova-api[11338]: 2017-09-28 12:00:22.235 11338 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:00:22 ctl02 nova-api[11338]: 2017-09-28 12:00:22.472 11338 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:00:22 ctl02 nova-api[11338]: 2017-09-28 12:00:22.475 11338 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:00:22 ctl02 nova-api[11338]: 2017-09-28 12:00:22.475 11338 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:00:22 ctl02 nova-api[11338]: 2017-09-28 12:00:22.476 11338 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:00:22 ctl02 nova-api[11338]: 2017-09-28 12:00:22.606 11338 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:00:22 ctl02 nova-api[11338]: 2017-09-28 12:00:22.609 11338 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:00:22 ctl02 nova-api[11338]: 2017-09-28 12:00:22.609 11338 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:00:22 ctl02 nova-api[11338]: 2017-09-28 12:00:22.609 11338 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:00:22 ctl02 nova-api[11338]: 2017-09-28 12:00:22.613 11338 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:00:22 ctl02 nova-api[11338]: 2017-09-28 12:00:22.613 11338 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:00:22 ctl02 nova-api[11338]: 2017-09-28 12:00:22.613 11338 ERROR nova Traceback (most recent call last):
Sep 28 12:00:22 ctl02 nova-api[11338]: 2017-09-28 12:00:22.613 11338 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:00:22 ctl02 nova-api[11338]: 2017-09-28 12:00:22.613 11338 ERROR nova     sys.exit(main())
Sep 28 12:00:22 ctl02 nova-api[11338]: 2017-09-28 12:00:22.613 11338 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:00:22 ctl02 nova-api[11338]: 2017-09-28 12:00:22.613 11338 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:00:22 ctl02 nova-api[11338]: 2017-09-28 12:00:22.613 11338 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:00:22 ctl02 nova-api[11338]: 2017-09-28 12:00:22.613 11338 ERROR nova     max_url_len=max_url_len)
Sep 28 12:00:22 ctl02 nova-api[11338]: 2017-09-28 12:00:22.613 11338 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:00:22 ctl02 nova-api[11338]: 2017-09-28 12:00:22.613 11338 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:00:22 ctl02 nova-api[11338]: 2017-09-28 12:00:22.613 11338 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:00:22 ctl02 nova-api[11338]: 2017-09-28 12:00:22.613 11338 ERROR nova     sock.listen(backlog)
Sep 28 12:00:22 ctl02 nova-api[11338]: 2017-09-28 12:00:22.613 11338 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:00:22 ctl02 nova-api[11338]: 2017-09-28 12:00:22.613 11338 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:00:22 ctl02 nova-api[11338]: 2017-09-28 12:00:22.613 11338 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:00:22 ctl02 nova-api[11338]: 2017-09-28 12:00:22.613 11338 ERROR nova
Sep 28 12:00:22 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:00:22 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:00:22 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:00:22 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:00:22 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:00:22 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:00:22 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:00:23 ctl02 glance-api[29183]: 2017-09-28 12:00:23.116 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:00:23] "OPTIONS / HTTP/1.0" 200 134 0.000672
Sep 28 12:00:24 ctl02 nova-api[11361]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:00:24 ctl02 nova-api[11361]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:00:24 ctl02 nova-api[11361]: 2017-09-28 12:00:24.563 11361 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:00:24 ctl02 nova-api[11361]: 2017-09-28 12:00:24.565 11361 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:00:24 ctl02 nova-api[11361]: 2017-09-28 12:00:24.565 11361 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:00:24 ctl02 nova-api[11361]: 2017-09-28 12:00:24.565 11361 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:00:24 ctl02 nova-api[11361]: 2017-09-28 12:00:24.565 11361 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:00:24 ctl02 nova-api[11361]: 2017-09-28 12:00:24.565 11361 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:00:24 ctl02 nova-api[11361]: 2017-09-28 12:00:24.565 11361 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:00:24 ctl02 nova-api[11361]: 2017-09-28 12:00:24.565 11361 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:00:24 ctl02 nova-api[11361]: 2017-09-28 12:00:24.565 11361 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:00:24 ctl02 nova-api[11361]: 2017-09-28 12:00:24.565 11361 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:00:24 ctl02 nova-api[11361]: 2017-09-28 12:00:24.565 11361 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:00:24 ctl02 nova-api[11361]: 2017-09-28 12:00:24.565 11361 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:00:24 ctl02 nova-api[11361]: 2017-09-28 12:00:24.565 11361 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:00:24 ctl02 nova-api[11361]: 2017-09-28 12:00:24.565 11361 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:00:24 ctl02 nova-api[11361]: 2017-09-28 12:00:24.565 11361 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:00:24 ctl02 nova-api[11361]: 2017-09-28 12:00:24.565 11361 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:00:24 ctl02 nova-api[11361]: 2017-09-28 12:00:24.565 11361 ERROR nova.wsgi     self.filename))
Sep 28 12:00:24 ctl02 nova-api[11361]: 2017-09-28 12:00:24.565 11361 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:00:24 ctl02 nova-api[11361]: 2017-09-28 12:00:24.565 11361 ERROR nova.wsgi
Sep 28 12:00:24 ctl02 nova-api[11361]: 2017-09-28 12:00:24.567 11361 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:00:24 ctl02 nova-api[11361]: 2017-09-28 12:00:24.696 11361 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:00:24 ctl02 nova-api[11361]: 2017-09-28 12:00:24.931 11361 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:00:24 ctl02 nova-api[11361]: 2017-09-28 12:00:24.934 11361 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:00:24 ctl02 nova-api[11361]: 2017-09-28 12:00:24.934 11361 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:00:24 ctl02 nova-api[11361]: 2017-09-28 12:00:24.935 11361 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:00:25 ctl02 nova-api[11361]: 2017-09-28 12:00:25.064 11361 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:00:25 ctl02 nova-api[11361]: 2017-09-28 12:00:25.067 11361 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:00:25 ctl02 nova-api[11361]: 2017-09-28 12:00:25.070 11361 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:00:25 ctl02 nova-api[11361]: 2017-09-28 12:00:25.070 11361 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:00:25 ctl02 nova-api[11361]: 2017-09-28 12:00:25.074 11361 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:00:25 ctl02 nova-api[11361]: 2017-09-28 12:00:25.074 11361 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:00:25 ctl02 nova-api[11361]: 2017-09-28 12:00:25.074 11361 ERROR nova Traceback (most recent call last):
Sep 28 12:00:25 ctl02 nova-api[11361]: 2017-09-28 12:00:25.074 11361 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:00:25 ctl02 nova-api[11361]: 2017-09-28 12:00:25.074 11361 ERROR nova     sys.exit(main())
Sep 28 12:00:25 ctl02 nova-api[11361]: 2017-09-28 12:00:25.074 11361 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:00:25 ctl02 nova-api[11361]: 2017-09-28 12:00:25.074 11361 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:00:25 ctl02 nova-api[11361]: 2017-09-28 12:00:25.074 11361 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:00:25 ctl02 nova-api[11361]: 2017-09-28 12:00:25.074 11361 ERROR nova     max_url_len=max_url_len)
Sep 28 12:00:25 ctl02 nova-api[11361]: 2017-09-28 12:00:25.074 11361 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:00:25 ctl02 nova-api[11361]: 2017-09-28 12:00:25.074 11361 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:00:25 ctl02 nova-api[11361]: 2017-09-28 12:00:25.074 11361 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:00:25 ctl02 nova-api[11361]: 2017-09-28 12:00:25.074 11361 ERROR nova     sock.listen(backlog)
Sep 28 12:00:25 ctl02 nova-api[11361]: 2017-09-28 12:00:25.074 11361 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:00:25 ctl02 nova-api[11361]: 2017-09-28 12:00:25.074 11361 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:00:25 ctl02 nova-api[11361]: 2017-09-28 12:00:25.074 11361 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:00:25 ctl02 nova-api[11361]: 2017-09-28 12:00:25.074 11361 ERROR nova
Sep 28 12:00:25 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:00:25 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:00:25 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:00:25 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:00:25 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:00:25 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:00:25 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:00:26 ctl02 glance-api[29183]: 2017-09-28 12:00:26.577 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:00:26] "OPTIONS / HTTP/1.0" 200 134 0.000679
Sep 28 12:00:26 ctl02 nova-api[11379]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:00:26 ctl02 nova-api[11379]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:00:27 ctl02 nova-api[11379]: 2017-09-28 12:00:27.091 11379 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:00:27 ctl02 nova-api[11379]: 2017-09-28 12:00:27.093 11379 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:00:27 ctl02 nova-api[11379]: 2017-09-28 12:00:27.093 11379 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:00:27 ctl02 nova-api[11379]: 2017-09-28 12:00:27.093 11379 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:00:27 ctl02 nova-api[11379]: 2017-09-28 12:00:27.093 11379 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:00:27 ctl02 nova-api[11379]: 2017-09-28 12:00:27.093 11379 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:00:27 ctl02 nova-api[11379]: 2017-09-28 12:00:27.093 11379 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:00:27 ctl02 nova-api[11379]: 2017-09-28 12:00:27.093 11379 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:00:27 ctl02 nova-api[11379]: 2017-09-28 12:00:27.093 11379 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:00:27 ctl02 nova-api[11379]: 2017-09-28 12:00:27.093 11379 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:00:27 ctl02 nova-api[11379]: 2017-09-28 12:00:27.093 11379 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:00:27 ctl02 nova-api[11379]: 2017-09-28 12:00:27.093 11379 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:00:27 ctl02 nova-api[11379]: 2017-09-28 12:00:27.093 11379 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:00:27 ctl02 nova-api[11379]: 2017-09-28 12:00:27.093 11379 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:00:27 ctl02 nova-api[11379]: 2017-09-28 12:00:27.093 11379 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:00:27 ctl02 nova-api[11379]: 2017-09-28 12:00:27.093 11379 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:00:27 ctl02 nova-api[11379]: 2017-09-28 12:00:27.093 11379 ERROR nova.wsgi     self.filename))
Sep 28 12:00:27 ctl02 nova-api[11379]: 2017-09-28 12:00:27.093 11379 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:00:27 ctl02 nova-api[11379]: 2017-09-28 12:00:27.093 11379 ERROR nova.wsgi
Sep 28 12:00:27 ctl02 nova-api[11379]: 2017-09-28 12:00:27.094 11379 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:00:27 ctl02 nova-api[11379]: 2017-09-28 12:00:27.229 11379 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:00:27 ctl02 nova-api[11379]: 2017-09-28 12:00:27.466 11379 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:00:27 ctl02 nova-api[11379]: 2017-09-28 12:00:27.468 11379 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:00:27 ctl02 nova-api[11379]: 2017-09-28 12:00:27.468 11379 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:00:27 ctl02 nova-api[11379]: 2017-09-28 12:00:27.468 11379 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:00:27 ctl02 nova-api[11379]: 2017-09-28 12:00:27.599 11379 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:00:27 ctl02 nova-api[11379]: 2017-09-28 12:00:27.601 11379 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:00:27 ctl02 nova-api[11379]: 2017-09-28 12:00:27.602 11379 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:00:27 ctl02 nova-api[11379]: 2017-09-28 12:00:27.602 11379 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:00:27 ctl02 nova-api[11379]: 2017-09-28 12:00:27.605 11379 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:00:27 ctl02 nova-api[11379]: 2017-09-28 12:00:27.605 11379 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:00:27 ctl02 nova-api[11379]: 2017-09-28 12:00:27.605 11379 ERROR nova Traceback (most recent call last):
Sep 28 12:00:27 ctl02 nova-api[11379]: 2017-09-28 12:00:27.605 11379 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:00:27 ctl02 nova-api[11379]: 2017-09-28 12:00:27.605 11379 ERROR nova     sys.exit(main())
Sep 28 12:00:27 ctl02 nova-api[11379]: 2017-09-28 12:00:27.605 11379 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:00:27 ctl02 nova-api[11379]: 2017-09-28 12:00:27.605 11379 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:00:27 ctl02 nova-api[11379]: 2017-09-28 12:00:27.605 11379 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:00:27 ctl02 nova-api[11379]: 2017-09-28 12:00:27.605 11379 ERROR nova     max_url_len=max_url_len)
Sep 28 12:00:27 ctl02 nova-api[11379]: 2017-09-28 12:00:27.605 11379 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:00:27 ctl02 nova-api[11379]: 2017-09-28 12:00:27.605 11379 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:00:27 ctl02 nova-api[11379]: 2017-09-28 12:00:27.605 11379 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:00:27 ctl02 nova-api[11379]: 2017-09-28 12:00:27.605 11379 ERROR nova     sock.listen(backlog)
Sep 28 12:00:27 ctl02 nova-api[11379]: 2017-09-28 12:00:27.605 11379 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:00:27 ctl02 nova-api[11379]: 2017-09-28 12:00:27.605 11379 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:00:27 ctl02 nova-api[11379]: 2017-09-28 12:00:27.605 11379 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:00:27 ctl02 nova-api[11379]: 2017-09-28 12:00:27.605 11379 ERROR nova
Sep 28 12:00:27 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:00:27 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:00:27 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:00:27 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:00:27 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:00:27 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:00:27 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:00:29 ctl02 glance-api[29183]: 2017-09-28 12:00:29.338 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:00:29] "OPTIONS / HTTP/1.0" 200 134 0.001018
Sep 28 12:00:29 ctl02 nova-api[11396]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:00:29 ctl02 nova-api[11396]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:00:29 ctl02 nova-api[11396]: 2017-09-28 12:00:29.580 11396 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:00:29 ctl02 nova-api[11396]: 2017-09-28 12:00:29.581 11396 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:00:29 ctl02 nova-api[11396]: 2017-09-28 12:00:29.581 11396 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:00:29 ctl02 nova-api[11396]: 2017-09-28 12:00:29.581 11396 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:00:29 ctl02 nova-api[11396]: 2017-09-28 12:00:29.581 11396 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:00:29 ctl02 nova-api[11396]: 2017-09-28 12:00:29.581 11396 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:00:29 ctl02 nova-api[11396]: 2017-09-28 12:00:29.581 11396 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:00:29 ctl02 nova-api[11396]: 2017-09-28 12:00:29.581 11396 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:00:29 ctl02 nova-api[11396]: 2017-09-28 12:00:29.581 11396 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:00:29 ctl02 nova-api[11396]: 2017-09-28 12:00:29.581 11396 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:00:29 ctl02 nova-api[11396]: 2017-09-28 12:00:29.581 11396 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:00:29 ctl02 nova-api[11396]: 2017-09-28 12:00:29.581 11396 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:00:29 ctl02 nova-api[11396]: 2017-09-28 12:00:29.581 11396 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:00:29 ctl02 nova-api[11396]: 2017-09-28 12:00:29.581 11396 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:00:29 ctl02 nova-api[11396]: 2017-09-28 12:00:29.581 11396 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:00:29 ctl02 nova-api[11396]: 2017-09-28 12:00:29.581 11396 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:00:29 ctl02 nova-api[11396]: 2017-09-28 12:00:29.581 11396 ERROR nova.wsgi     self.filename))
Sep 28 12:00:29 ctl02 nova-api[11396]: 2017-09-28 12:00:29.581 11396 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:00:29 ctl02 nova-api[11396]: 2017-09-28 12:00:29.581 11396 ERROR nova.wsgi
Sep 28 12:00:29 ctl02 nova-api[11396]: 2017-09-28 12:00:29.582 11396 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:00:29 ctl02 nova-api[11396]: 2017-09-28 12:00:29.713 11396 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:00:29 ctl02 nova-api[11396]: 2017-09-28 12:00:29.951 11396 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:00:29 ctl02 nova-api[11396]: 2017-09-28 12:00:29.953 11396 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:00:29 ctl02 nova-api[11396]: 2017-09-28 12:00:29.954 11396 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:00:29 ctl02 nova-api[11396]: 2017-09-28 12:00:29.954 11396 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:00:30 ctl02 nova-api[11396]: 2017-09-28 12:00:30.084 11396 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:00:30 ctl02 nova-api[11396]: 2017-09-28 12:00:30.094 11396 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:00:30 ctl02 nova-api[11396]: 2017-09-28 12:00:30.095 11396 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:00:30 ctl02 nova-api[11396]: 2017-09-28 12:00:30.095 11396 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:00:30 ctl02 nova-api[11396]: 2017-09-28 12:00:30.099 11396 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:00:30 ctl02 nova-api[11396]: 2017-09-28 12:00:30.099 11396 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:00:30 ctl02 nova-api[11396]: 2017-09-28 12:00:30.099 11396 ERROR nova Traceback (most recent call last):
Sep 28 12:00:30 ctl02 nova-api[11396]: 2017-09-28 12:00:30.099 11396 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:00:30 ctl02 nova-api[11396]: 2017-09-28 12:00:30.099 11396 ERROR nova     sys.exit(main())
Sep 28 12:00:30 ctl02 nova-api[11396]: 2017-09-28 12:00:30.099 11396 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:00:30 ctl02 nova-api[11396]: 2017-09-28 12:00:30.099 11396 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:00:30 ctl02 nova-api[11396]: 2017-09-28 12:00:30.099 11396 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:00:30 ctl02 nova-api[11396]: 2017-09-28 12:00:30.099 11396 ERROR nova     max_url_len=max_url_len)
Sep 28 12:00:30 ctl02 nova-api[11396]: 2017-09-28 12:00:30.099 11396 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:00:30 ctl02 nova-api[11396]: 2017-09-28 12:00:30.099 11396 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:00:30 ctl02 nova-api[11396]: 2017-09-28 12:00:30.099 11396 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:00:30 ctl02 nova-api[11396]: 2017-09-28 12:00:30.099 11396 ERROR nova     sock.listen(backlog)
Sep 28 12:00:30 ctl02 nova-api[11396]: 2017-09-28 12:00:30.099 11396 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:00:30 ctl02 nova-api[11396]: 2017-09-28 12:00:30.099 11396 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:00:30 ctl02 nova-api[11396]: 2017-09-28 12:00:30.099 11396 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:00:30 ctl02 nova-api[11396]: 2017-09-28 12:00:30.099 11396 ERROR nova
Sep 28 12:00:30 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:00:30 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:00:30 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:00:30 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:00:30 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:00:30 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:00:30 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:00:30 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928120030780708
Sep 28 12:00:30 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 11426
Sep 28 12:00:30 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928120030780708
Sep 28 12:00:31 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x487e405a)
Sep 28 12:00:31 ctl02 nova-api[11414]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:00:31 ctl02 nova-api[11414]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:00:32 ctl02 nova-api[11414]: 2017-09-28 12:00:32.058 11414 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:00:32 ctl02 nova-api[11414]: 2017-09-28 12:00:32.060 11414 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:00:32 ctl02 nova-api[11414]: 2017-09-28 12:00:32.060 11414 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:00:32 ctl02 nova-api[11414]: 2017-09-28 12:00:32.060 11414 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:00:32 ctl02 nova-api[11414]: 2017-09-28 12:00:32.060 11414 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:00:32 ctl02 nova-api[11414]: 2017-09-28 12:00:32.060 11414 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:00:32 ctl02 nova-api[11414]: 2017-09-28 12:00:32.060 11414 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:00:32 ctl02 nova-api[11414]: 2017-09-28 12:00:32.060 11414 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:00:32 ctl02 nova-api[11414]: 2017-09-28 12:00:32.060 11414 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:00:32 ctl02 nova-api[11414]: 2017-09-28 12:00:32.060 11414 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:00:32 ctl02 nova-api[11414]: 2017-09-28 12:00:32.060 11414 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:00:32 ctl02 nova-api[11414]: 2017-09-28 12:00:32.060 11414 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:00:32 ctl02 nova-api[11414]: 2017-09-28 12:00:32.060 11414 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:00:32 ctl02 nova-api[11414]: 2017-09-28 12:00:32.060 11414 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:00:32 ctl02 nova-api[11414]: 2017-09-28 12:00:32.060 11414 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:00:32 ctl02 nova-api[11414]: 2017-09-28 12:00:32.060 11414 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:00:32 ctl02 nova-api[11414]: 2017-09-28 12:00:32.060 11414 ERROR nova.wsgi     self.filename))
Sep 28 12:00:32 ctl02 nova-api[11414]: 2017-09-28 12:00:32.060 11414 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:00:32 ctl02 nova-api[11414]: 2017-09-28 12:00:32.060 11414 ERROR nova.wsgi
Sep 28 12:00:32 ctl02 nova-api[11414]: 2017-09-28 12:00:32.062 11414 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:00:32 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x487e405a)
Sep 28 12:00:32 ctl02 nova-api[11414]: 2017-09-28 12:00:32.197 11414 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:00:32 ctl02 nova-api[11414]: 2017-09-28 12:00:32.437 11414 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:00:32 ctl02 nova-api[11414]: 2017-09-28 12:00:32.439 11414 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:00:32 ctl02 nova-api[11414]: 2017-09-28 12:00:32.440 11414 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:00:32 ctl02 nova-api[11414]: 2017-09-28 12:00:32.440 11414 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:00:32 ctl02 nova-api[11414]: 2017-09-28 12:00:32.573 11414 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:00:32 ctl02 nova-api[11414]: 2017-09-28 12:00:32.575 11414 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:00:32 ctl02 nova-api[11414]: 2017-09-28 12:00:32.575 11414 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:00:32 ctl02 nova-api[11414]: 2017-09-28 12:00:32.575 11414 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:00:32 ctl02 nova-api[11414]: 2017-09-28 12:00:32.579 11414 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:00:32 ctl02 nova-api[11414]: 2017-09-28 12:00:32.579 11414 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:00:32 ctl02 nova-api[11414]: 2017-09-28 12:00:32.579 11414 ERROR nova Traceback (most recent call last):
Sep 28 12:00:32 ctl02 nova-api[11414]: 2017-09-28 12:00:32.579 11414 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:00:32 ctl02 nova-api[11414]: 2017-09-28 12:00:32.579 11414 ERROR nova     sys.exit(main())
Sep 28 12:00:32 ctl02 nova-api[11414]: 2017-09-28 12:00:32.579 11414 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:00:32 ctl02 nova-api[11414]: 2017-09-28 12:00:32.579 11414 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:00:32 ctl02 nova-api[11414]: 2017-09-28 12:00:32.579 11414 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:00:32 ctl02 nova-api[11414]: 2017-09-28 12:00:32.579 11414 ERROR nova     max_url_len=max_url_len)
Sep 28 12:00:32 ctl02 nova-api[11414]: 2017-09-28 12:00:32.579 11414 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:00:32 ctl02 nova-api[11414]: 2017-09-28 12:00:32.579 11414 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:00:32 ctl02 nova-api[11414]: 2017-09-28 12:00:32.579 11414 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:00:32 ctl02 nova-api[11414]: 2017-09-28 12:00:32.579 11414 ERROR nova     sock.listen(backlog)
Sep 28 12:00:32 ctl02 nova-api[11414]: 2017-09-28 12:00:32.579 11414 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:00:32 ctl02 nova-api[11414]: 2017-09-28 12:00:32.579 11414 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:00:32 ctl02 nova-api[11414]: 2017-09-28 12:00:32.579 11414 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:00:32 ctl02 nova-api[11414]: 2017-09-28 12:00:32.579 11414 ERROR nova
Sep 28 12:00:32 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:00:32 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:00:32 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:00:32 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:00:32 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:00:32 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:00:32 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:00:33 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x487e405a)
Sep 28 12:00:33 ctl02 glance-api[29183]: 2017-09-28 12:00:33.303 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:00:33] "OPTIONS / HTTP/1.0" 200 134 0.001082
Sep 28 12:00:34 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x487e405a)
Sep 28 12:00:34 ctl02 nova-api[11438]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:00:34 ctl02 nova-api[11438]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:00:34 ctl02 nova-api[11438]: 2017-09-28 12:00:34.560 11438 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:00:34 ctl02 nova-api[11438]: 2017-09-28 12:00:34.561 11438 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:00:34 ctl02 nova-api[11438]: 2017-09-28 12:00:34.561 11438 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:00:34 ctl02 nova-api[11438]: 2017-09-28 12:00:34.561 11438 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:00:34 ctl02 nova-api[11438]: 2017-09-28 12:00:34.561 11438 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:00:34 ctl02 nova-api[11438]: 2017-09-28 12:00:34.561 11438 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:00:34 ctl02 nova-api[11438]: 2017-09-28 12:00:34.561 11438 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:00:34 ctl02 nova-api[11438]: 2017-09-28 12:00:34.561 11438 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:00:34 ctl02 nova-api[11438]: 2017-09-28 12:00:34.561 11438 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:00:34 ctl02 nova-api[11438]: 2017-09-28 12:00:34.561 11438 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:00:34 ctl02 nova-api[11438]: 2017-09-28 12:00:34.561 11438 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:00:34 ctl02 nova-api[11438]: 2017-09-28 12:00:34.561 11438 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:00:34 ctl02 nova-api[11438]: 2017-09-28 12:00:34.561 11438 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:00:34 ctl02 nova-api[11438]: 2017-09-28 12:00:34.561 11438 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:00:34 ctl02 nova-api[11438]: 2017-09-28 12:00:34.561 11438 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:00:34 ctl02 nova-api[11438]: 2017-09-28 12:00:34.561 11438 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:00:34 ctl02 nova-api[11438]: 2017-09-28 12:00:34.561 11438 ERROR nova.wsgi     self.filename))
Sep 28 12:00:34 ctl02 nova-api[11438]: 2017-09-28 12:00:34.561 11438 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:00:34 ctl02 nova-api[11438]: 2017-09-28 12:00:34.561 11438 ERROR nova.wsgi
Sep 28 12:00:34 ctl02 nova-api[11438]: 2017-09-28 12:00:34.562 11438 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:00:34 ctl02 nova-api[11438]: 2017-09-28 12:00:34.695 11438 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:00:34 ctl02 nova-api[11438]: 2017-09-28 12:00:34.928 11438 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:00:34 ctl02 nova-api[11438]: 2017-09-28 12:00:34.931 11438 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:00:34 ctl02 nova-api[11438]: 2017-09-28 12:00:34.931 11438 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:00:34 ctl02 nova-api[11438]: 2017-09-28 12:00:34.931 11438 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:00:35 ctl02 nova-api[11438]: 2017-09-28 12:00:35.060 11438 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:00:35 ctl02 nova-api[11438]: 2017-09-28 12:00:35.062 11438 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:00:35 ctl02 nova-api[11438]: 2017-09-28 12:00:35.062 11438 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:00:35 ctl02 nova-api[11438]: 2017-09-28 12:00:35.063 11438 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:00:35 ctl02 nova-api[11438]: 2017-09-28 12:00:35.066 11438 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:00:35 ctl02 nova-api[11438]: 2017-09-28 12:00:35.066 11438 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:00:35 ctl02 nova-api[11438]: 2017-09-28 12:00:35.066 11438 ERROR nova Traceback (most recent call last):
Sep 28 12:00:35 ctl02 nova-api[11438]: 2017-09-28 12:00:35.066 11438 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:00:35 ctl02 nova-api[11438]: 2017-09-28 12:00:35.066 11438 ERROR nova     sys.exit(main())
Sep 28 12:00:35 ctl02 nova-api[11438]: 2017-09-28 12:00:35.066 11438 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:00:35 ctl02 nova-api[11438]: 2017-09-28 12:00:35.066 11438 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:00:35 ctl02 nova-api[11438]: 2017-09-28 12:00:35.066 11438 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:00:35 ctl02 nova-api[11438]: 2017-09-28 12:00:35.066 11438 ERROR nova     max_url_len=max_url_len)
Sep 28 12:00:35 ctl02 nova-api[11438]: 2017-09-28 12:00:35.066 11438 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:00:35 ctl02 nova-api[11438]: 2017-09-28 12:00:35.066 11438 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:00:35 ctl02 nova-api[11438]: 2017-09-28 12:00:35.066 11438 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:00:35 ctl02 nova-api[11438]: 2017-09-28 12:00:35.066 11438 ERROR nova     sock.listen(backlog)
Sep 28 12:00:35 ctl02 nova-api[11438]: 2017-09-28 12:00:35.066 11438 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:00:35 ctl02 nova-api[11438]: 2017-09-28 12:00:35.066 11438 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:00:35 ctl02 nova-api[11438]: 2017-09-28 12:00:35.066 11438 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:00:35 ctl02 nova-api[11438]: 2017-09-28 12:00:35.066 11438 ERROR nova
Sep 28 12:00:35 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x487e405a)
Sep 28 12:00:35 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:00:35 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:00:35 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:00:35 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:00:35 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:00:35 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:00:35 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:00:35 ctl02 nova-cert[4860]: 2017-09-28 12:00:35.689 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:00:36 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x487e405a)
Sep 28 12:00:36 ctl02 glance-api[29183]: 2017-09-28 12:00:36.718 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:00:36] "OPTIONS / HTTP/1.0" 200 134 0.000577
Sep 28 12:00:36 ctl02 nova-api[11456]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:00:36 ctl02 nova-api[11456]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:00:37 ctl02 nova-api[11456]: 2017-09-28 12:00:37.084 11456 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:00:37 ctl02 nova-api[11456]: 2017-09-28 12:00:37.086 11456 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:00:37 ctl02 nova-api[11456]: 2017-09-28 12:00:37.086 11456 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:00:37 ctl02 nova-api[11456]: 2017-09-28 12:00:37.086 11456 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:00:37 ctl02 nova-api[11456]: 2017-09-28 12:00:37.086 11456 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:00:37 ctl02 nova-api[11456]: 2017-09-28 12:00:37.086 11456 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:00:37 ctl02 nova-api[11456]: 2017-09-28 12:00:37.086 11456 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:00:37 ctl02 nova-api[11456]: 2017-09-28 12:00:37.086 11456 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:00:37 ctl02 nova-api[11456]: 2017-09-28 12:00:37.086 11456 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:00:37 ctl02 nova-api[11456]: 2017-09-28 12:00:37.086 11456 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:00:37 ctl02 nova-api[11456]: 2017-09-28 12:00:37.086 11456 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:00:37 ctl02 nova-api[11456]: 2017-09-28 12:00:37.086 11456 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:00:37 ctl02 nova-api[11456]: 2017-09-28 12:00:37.086 11456 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:00:37 ctl02 nova-api[11456]: 2017-09-28 12:00:37.086 11456 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:00:37 ctl02 nova-api[11456]: 2017-09-28 12:00:37.086 11456 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:00:37 ctl02 nova-api[11456]: 2017-09-28 12:00:37.086 11456 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:00:37 ctl02 nova-api[11456]: 2017-09-28 12:00:37.086 11456 ERROR nova.wsgi     self.filename))
Sep 28 12:00:37 ctl02 nova-api[11456]: 2017-09-28 12:00:37.086 11456 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:00:37 ctl02 nova-api[11456]: 2017-09-28 12:00:37.086 11456 ERROR nova.wsgi
Sep 28 12:00:37 ctl02 nova-api[11456]: 2017-09-28 12:00:37.087 11456 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:00:37 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x487e405a)
Sep 28 12:00:37 ctl02 nova-api[11456]: 2017-09-28 12:00:37.214 11456 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:00:37 ctl02 nova-api[11456]: 2017-09-28 12:00:37.450 11456 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:00:37 ctl02 nova-api[11456]: 2017-09-28 12:00:37.452 11456 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:00:37 ctl02 nova-api[11456]: 2017-09-28 12:00:37.453 11456 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:00:37 ctl02 nova-api[11456]: 2017-09-28 12:00:37.453 11456 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:00:37 ctl02 nova-api[11456]: 2017-09-28 12:00:37.583 11456 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:00:37 ctl02 nova-api[11456]: 2017-09-28 12:00:37.585 11456 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:00:37 ctl02 nova-api[11456]: 2017-09-28 12:00:37.585 11456 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:00:37 ctl02 nova-api[11456]: 2017-09-28 12:00:37.586 11456 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:00:37 ctl02 nova-api[11456]: 2017-09-28 12:00:37.589 11456 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:00:37 ctl02 nova-api[11456]: 2017-09-28 12:00:37.589 11456 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:00:37 ctl02 nova-api[11456]: 2017-09-28 12:00:37.589 11456 ERROR nova Traceback (most recent call last):
Sep 28 12:00:37 ctl02 nova-api[11456]: 2017-09-28 12:00:37.589 11456 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:00:37 ctl02 nova-api[11456]: 2017-09-28 12:00:37.589 11456 ERROR nova     sys.exit(main())
Sep 28 12:00:37 ctl02 nova-api[11456]: 2017-09-28 12:00:37.589 11456 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:00:37 ctl02 nova-api[11456]: 2017-09-28 12:00:37.589 11456 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:00:37 ctl02 nova-api[11456]: 2017-09-28 12:00:37.589 11456 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:00:37 ctl02 nova-api[11456]: 2017-09-28 12:00:37.589 11456 ERROR nova     max_url_len=max_url_len)
Sep 28 12:00:37 ctl02 nova-api[11456]: 2017-09-28 12:00:37.589 11456 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:00:37 ctl02 nova-api[11456]: 2017-09-28 12:00:37.589 11456 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:00:37 ctl02 nova-api[11456]: 2017-09-28 12:00:37.589 11456 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:00:37 ctl02 nova-api[11456]: 2017-09-28 12:00:37.589 11456 ERROR nova     sock.listen(backlog)
Sep 28 12:00:37 ctl02 nova-api[11456]: 2017-09-28 12:00:37.589 11456 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:00:37 ctl02 nova-api[11456]: 2017-09-28 12:00:37.589 11456 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:00:37 ctl02 nova-api[11456]: 2017-09-28 12:00:37.589 11456 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:00:37 ctl02 nova-api[11456]: 2017-09-28 12:00:37.589 11456 ERROR nova
Sep 28 12:00:37 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:00:37 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:00:37 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:00:37 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:00:37 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:00:37 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:00:37 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:00:38 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x487e405a)
Sep 28 12:00:38 ctl02 nova-conductor[5056]: 2017-09-28 12:00:38.233 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:00:38 ctl02 nova-conductor[5056]: 2017-09-28 12:00:38.251 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:00:38 ctl02 nova-conductor[5056]: 2017-09-28 12:00:38.262 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:00:38 ctl02 nova-conductor[5056]: 2017-09-28 12:00:38.270 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:00:39 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x487e405a)
Sep 28 12:00:39 ctl02 nova-api[11474]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:00:39 ctl02 nova-api[11474]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:00:39 ctl02 nova-api[11474]: 2017-09-28 12:00:39.548 11474 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:00:39 ctl02 nova-api[11474]: 2017-09-28 12:00:39.550 11474 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:00:39 ctl02 nova-api[11474]: 2017-09-28 12:00:39.550 11474 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:00:39 ctl02 nova-api[11474]: 2017-09-28 12:00:39.550 11474 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:00:39 ctl02 nova-api[11474]: 2017-09-28 12:00:39.550 11474 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:00:39 ctl02 nova-api[11474]: 2017-09-28 12:00:39.550 11474 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:00:39 ctl02 nova-api[11474]: 2017-09-28 12:00:39.550 11474 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:00:39 ctl02 nova-api[11474]: 2017-09-28 12:00:39.550 11474 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:00:39 ctl02 nova-api[11474]: 2017-09-28 12:00:39.550 11474 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:00:39 ctl02 nova-api[11474]: 2017-09-28 12:00:39.550 11474 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:00:39 ctl02 nova-api[11474]: 2017-09-28 12:00:39.550 11474 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:00:39 ctl02 nova-api[11474]: 2017-09-28 12:00:39.550 11474 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:00:39 ctl02 nova-api[11474]: 2017-09-28 12:00:39.550 11474 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:00:39 ctl02 nova-api[11474]: 2017-09-28 12:00:39.550 11474 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:00:39 ctl02 nova-api[11474]: 2017-09-28 12:00:39.550 11474 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:00:39 ctl02 nova-api[11474]: 2017-09-28 12:00:39.550 11474 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:00:39 ctl02 nova-api[11474]: 2017-09-28 12:00:39.550 11474 ERROR nova.wsgi     self.filename))
Sep 28 12:00:39 ctl02 nova-api[11474]: 2017-09-28 12:00:39.550 11474 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:00:39 ctl02 nova-api[11474]: 2017-09-28 12:00:39.550 11474 ERROR nova.wsgi
Sep 28 12:00:39 ctl02 nova-api[11474]: 2017-09-28 12:00:39.551 11474 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:00:39 ctl02 glance-api[29183]: 2017-09-28 12:00:39.581 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:00:39] "OPTIONS / HTTP/1.0" 200 134 0.000571
Sep 28 12:00:39 ctl02 nova-api[11474]: 2017-09-28 12:00:39.681 11474 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:00:39 ctl02 nova-api[11474]: 2017-09-28 12:00:39.913 11474 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:00:39 ctl02 nova-api[11474]: 2017-09-28 12:00:39.915 11474 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:00:39 ctl02 nova-api[11474]: 2017-09-28 12:00:39.916 11474 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:00:39 ctl02 nova-api[11474]: 2017-09-28 12:00:39.916 11474 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:00:40 ctl02 nova-api[11474]: 2017-09-28 12:00:40.045 11474 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:00:40 ctl02 nova-api[11474]: 2017-09-28 12:00:40.047 11474 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:00:40 ctl02 nova-api[11474]: 2017-09-28 12:00:40.047 11474 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:00:40 ctl02 nova-api[11474]: 2017-09-28 12:00:40.048 11474 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:00:40 ctl02 nova-api[11474]: 2017-09-28 12:00:40.051 11474 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:00:40 ctl02 nova-api[11474]: 2017-09-28 12:00:40.052 11474 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:00:40 ctl02 nova-api[11474]: 2017-09-28 12:00:40.052 11474 ERROR nova Traceback (most recent call last):
Sep 28 12:00:40 ctl02 nova-api[11474]: 2017-09-28 12:00:40.052 11474 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:00:40 ctl02 nova-api[11474]: 2017-09-28 12:00:40.052 11474 ERROR nova     sys.exit(main())
Sep 28 12:00:40 ctl02 nova-api[11474]: 2017-09-28 12:00:40.052 11474 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:00:40 ctl02 nova-api[11474]: 2017-09-28 12:00:40.052 11474 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:00:40 ctl02 nova-api[11474]: 2017-09-28 12:00:40.052 11474 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:00:40 ctl02 nova-api[11474]: 2017-09-28 12:00:40.052 11474 ERROR nova     max_url_len=max_url_len)
Sep 28 12:00:40 ctl02 nova-api[11474]: 2017-09-28 12:00:40.052 11474 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:00:40 ctl02 nova-api[11474]: 2017-09-28 12:00:40.052 11474 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:00:40 ctl02 nova-api[11474]: 2017-09-28 12:00:40.052 11474 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:00:40 ctl02 nova-api[11474]: 2017-09-28 12:00:40.052 11474 ERROR nova     sock.listen(backlog)
Sep 28 12:00:40 ctl02 nova-api[11474]: 2017-09-28 12:00:40.052 11474 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:00:40 ctl02 nova-api[11474]: 2017-09-28 12:00:40.052 11474 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:00:40 ctl02 nova-api[11474]: 2017-09-28 12:00:40.052 11474 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:00:40 ctl02 nova-api[11474]: 2017-09-28 12:00:40.052 11474 ERROR nova
Sep 28 12:00:40 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x487e405a)
Sep 28 12:00:40 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:00:40 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:00:40 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:00:40 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:00:40 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:00:40 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:00:40 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:00:40 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928120040959173
Sep 28 12:00:40 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 11503
Sep 28 12:00:40 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928120040959173
Sep 28 12:00:41 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x487e405a)
Sep 28 12:00:41 ctl02 nova-api[11492]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:00:41 ctl02 nova-api[11492]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:00:42 ctl02 nova-api[11492]: 2017-09-28 12:00:42.102 11492 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:00:42 ctl02 nova-api[11492]: 2017-09-28 12:00:42.104 11492 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:00:42 ctl02 nova-api[11492]: 2017-09-28 12:00:42.104 11492 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:00:42 ctl02 nova-api[11492]: 2017-09-28 12:00:42.104 11492 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:00:42 ctl02 nova-api[11492]: 2017-09-28 12:00:42.104 11492 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:00:42 ctl02 nova-api[11492]: 2017-09-28 12:00:42.104 11492 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:00:42 ctl02 nova-api[11492]: 2017-09-28 12:00:42.104 11492 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:00:42 ctl02 nova-api[11492]: 2017-09-28 12:00:42.104 11492 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:00:42 ctl02 nova-api[11492]: 2017-09-28 12:00:42.104 11492 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:00:42 ctl02 nova-api[11492]: 2017-09-28 12:00:42.104 11492 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:00:42 ctl02 nova-api[11492]: 2017-09-28 12:00:42.104 11492 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:00:42 ctl02 nova-api[11492]: 2017-09-28 12:00:42.104 11492 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:00:42 ctl02 nova-api[11492]: 2017-09-28 12:00:42.104 11492 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:00:42 ctl02 nova-api[11492]: 2017-09-28 12:00:42.104 11492 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:00:42 ctl02 nova-api[11492]: 2017-09-28 12:00:42.104 11492 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:00:42 ctl02 nova-api[11492]: 2017-09-28 12:00:42.104 11492 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:00:42 ctl02 nova-api[11492]: 2017-09-28 12:00:42.104 11492 ERROR nova.wsgi     self.filename))
Sep 28 12:00:42 ctl02 nova-api[11492]: 2017-09-28 12:00:42.104 11492 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:00:42 ctl02 nova-api[11492]: 2017-09-28 12:00:42.104 11492 ERROR nova.wsgi
Sep 28 12:00:42 ctl02 nova-api[11492]: 2017-09-28 12:00:42.106 11492 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:00:42 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:00:42 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:00:42 ctl02 nova-api[11492]: 2017-09-28 12:00:42.236 11492 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:00:42 ctl02 nova-api[11492]: 2017-09-28 12:00:42.469 11492 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:00:42 ctl02 nova-api[11492]: 2017-09-28 12:00:42.472 11492 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:00:42 ctl02 nova-api[11492]: 2017-09-28 12:00:42.472 11492 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:00:42 ctl02 nova-api[11492]: 2017-09-28 12:00:42.472 11492 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:00:42 ctl02 nova-api[11492]: 2017-09-28 12:00:42.602 11492 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:00:42 ctl02 nova-api[11492]: 2017-09-28 12:00:42.605 11492 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:00:42 ctl02 nova-api[11492]: 2017-09-28 12:00:42.605 11492 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:00:42 ctl02 nova-api[11492]: 2017-09-28 12:00:42.605 11492 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:00:42 ctl02 nova-api[11492]: 2017-09-28 12:00:42.609 11492 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:00:42 ctl02 nova-api[11492]: 2017-09-28 12:00:42.609 11492 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:00:42 ctl02 nova-api[11492]: 2017-09-28 12:00:42.609 11492 ERROR nova Traceback (most recent call last):
Sep 28 12:00:42 ctl02 nova-api[11492]: 2017-09-28 12:00:42.609 11492 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:00:42 ctl02 nova-api[11492]: 2017-09-28 12:00:42.609 11492 ERROR nova     sys.exit(main())
Sep 28 12:00:42 ctl02 nova-api[11492]: 2017-09-28 12:00:42.609 11492 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:00:42 ctl02 nova-api[11492]: 2017-09-28 12:00:42.609 11492 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:00:42 ctl02 nova-api[11492]: 2017-09-28 12:00:42.609 11492 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:00:42 ctl02 nova-api[11492]: 2017-09-28 12:00:42.609 11492 ERROR nova     max_url_len=max_url_len)
Sep 28 12:00:42 ctl02 nova-api[11492]: 2017-09-28 12:00:42.609 11492 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:00:42 ctl02 nova-api[11492]: 2017-09-28 12:00:42.609 11492 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:00:42 ctl02 nova-api[11492]: 2017-09-28 12:00:42.609 11492 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:00:42 ctl02 nova-api[11492]: 2017-09-28 12:00:42.609 11492 ERROR nova     sock.listen(backlog)
Sep 28 12:00:42 ctl02 nova-api[11492]: 2017-09-28 12:00:42.609 11492 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:00:42 ctl02 nova-api[11492]: 2017-09-28 12:00:42.609 11492 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:00:42 ctl02 nova-api[11492]: 2017-09-28 12:00:42.609 11492 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:00:42 ctl02 nova-api[11492]: 2017-09-28 12:00:42.609 11492 ERROR nova
Sep 28 12:00:42 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:00:42 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:00:42 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:00:42 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:00:42 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:00:42 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:00:42 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:00:43 ctl02 glance-api[29183]: 2017-09-28 12:00:43.559 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:00:43] "OPTIONS / HTTP/1.0" 200 134 0.000985
Sep 28 12:00:44 ctl02 nova-api[11520]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:00:44 ctl02 nova-api[11520]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:00:44 ctl02 nova-api[11520]: 2017-09-28 12:00:44.597 11520 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:00:44 ctl02 nova-api[11520]: 2017-09-28 12:00:44.599 11520 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:00:44 ctl02 nova-api[11520]: 2017-09-28 12:00:44.599 11520 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:00:44 ctl02 nova-api[11520]: 2017-09-28 12:00:44.599 11520 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:00:44 ctl02 nova-api[11520]: 2017-09-28 12:00:44.599 11520 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:00:44 ctl02 nova-api[11520]: 2017-09-28 12:00:44.599 11520 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:00:44 ctl02 nova-api[11520]: 2017-09-28 12:00:44.599 11520 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:00:44 ctl02 nova-api[11520]: 2017-09-28 12:00:44.599 11520 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:00:44 ctl02 nova-api[11520]: 2017-09-28 12:00:44.599 11520 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:00:44 ctl02 nova-api[11520]: 2017-09-28 12:00:44.599 11520 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:00:44 ctl02 nova-api[11520]: 2017-09-28 12:00:44.599 11520 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:00:44 ctl02 nova-api[11520]: 2017-09-28 12:00:44.599 11520 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:00:44 ctl02 nova-api[11520]: 2017-09-28 12:00:44.599 11520 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:00:44 ctl02 nova-api[11520]: 2017-09-28 12:00:44.599 11520 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:00:44 ctl02 nova-api[11520]: 2017-09-28 12:00:44.599 11520 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:00:44 ctl02 nova-api[11520]: 2017-09-28 12:00:44.599 11520 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:00:44 ctl02 nova-api[11520]: 2017-09-28 12:00:44.599 11520 ERROR nova.wsgi     self.filename))
Sep 28 12:00:44 ctl02 nova-api[11520]: 2017-09-28 12:00:44.599 11520 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:00:44 ctl02 nova-api[11520]: 2017-09-28 12:00:44.599 11520 ERROR nova.wsgi
Sep 28 12:00:44 ctl02 nova-api[11520]: 2017-09-28 12:00:44.600 11520 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:00:44 ctl02 nova-api[11520]: 2017-09-28 12:00:44.730 11520 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:00:44 ctl02 nova-api[11520]: 2017-09-28 12:00:44.966 11520 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:00:44 ctl02 nova-api[11520]: 2017-09-28 12:00:44.968 11520 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:00:44 ctl02 nova-api[11520]: 2017-09-28 12:00:44.968 11520 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:00:44 ctl02 nova-api[11520]: 2017-09-28 12:00:44.969 11520 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:00:45 ctl02 nova-api[11520]: 2017-09-28 12:00:45.099 11520 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:00:45 ctl02 nova-api[11520]: 2017-09-28 12:00:45.101 11520 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:00:45 ctl02 nova-api[11520]: 2017-09-28 12:00:45.101 11520 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:00:45 ctl02 nova-api[11520]: 2017-09-28 12:00:45.102 11520 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:00:45 ctl02 nova-api[11520]: 2017-09-28 12:00:45.105 11520 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:00:45 ctl02 nova-api[11520]: 2017-09-28 12:00:45.105 11520 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:00:45 ctl02 nova-api[11520]: 2017-09-28 12:00:45.105 11520 ERROR nova Traceback (most recent call last):
Sep 28 12:00:45 ctl02 nova-api[11520]: 2017-09-28 12:00:45.105 11520 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:00:45 ctl02 nova-api[11520]: 2017-09-28 12:00:45.105 11520 ERROR nova     sys.exit(main())
Sep 28 12:00:45 ctl02 nova-api[11520]: 2017-09-28 12:00:45.105 11520 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:00:45 ctl02 nova-api[11520]: 2017-09-28 12:00:45.105 11520 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:00:45 ctl02 nova-api[11520]: 2017-09-28 12:00:45.105 11520 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:00:45 ctl02 nova-api[11520]: 2017-09-28 12:00:45.105 11520 ERROR nova     max_url_len=max_url_len)
Sep 28 12:00:45 ctl02 nova-api[11520]: 2017-09-28 12:00:45.105 11520 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:00:45 ctl02 nova-api[11520]: 2017-09-28 12:00:45.105 11520 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:00:45 ctl02 nova-api[11520]: 2017-09-28 12:00:45.105 11520 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:00:45 ctl02 nova-api[11520]: 2017-09-28 12:00:45.105 11520 ERROR nova     sock.listen(backlog)
Sep 28 12:00:45 ctl02 nova-api[11520]: 2017-09-28 12:00:45.105 11520 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:00:45 ctl02 nova-api[11520]: 2017-09-28 12:00:45.105 11520 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:00:45 ctl02 nova-api[11520]: 2017-09-28 12:00:45.105 11520 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:00:45 ctl02 nova-api[11520]: 2017-09-28 12:00:45.105 11520 ERROR nova
Sep 28 12:00:45 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:00:45 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:00:45 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:00:45 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:00:45 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:00:45 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:00:45 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:00:45 ctl02 nova-consoleauth[5433]: 2017-09-28 12:00:45.576 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:00:46 ctl02 glance-api[29183]: 2017-09-28 12:00:46.774 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:00:46] "OPTIONS / HTTP/1.0" 200 134 0.000649
Sep 28 12:00:46 ctl02 nova-api[11538]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:00:46 ctl02 nova-api[11538]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:00:47 ctl02 nova-api[11538]: 2017-09-28 12:00:47.073 11538 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:00:47 ctl02 nova-api[11538]: 2017-09-28 12:00:47.075 11538 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:00:47 ctl02 nova-api[11538]: 2017-09-28 12:00:47.075 11538 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:00:47 ctl02 nova-api[11538]: 2017-09-28 12:00:47.075 11538 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:00:47 ctl02 nova-api[11538]: 2017-09-28 12:00:47.075 11538 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:00:47 ctl02 nova-api[11538]: 2017-09-28 12:00:47.075 11538 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:00:47 ctl02 nova-api[11538]: 2017-09-28 12:00:47.075 11538 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:00:47 ctl02 nova-api[11538]: 2017-09-28 12:00:47.075 11538 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:00:47 ctl02 nova-api[11538]: 2017-09-28 12:00:47.075 11538 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:00:47 ctl02 nova-api[11538]: 2017-09-28 12:00:47.075 11538 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:00:47 ctl02 nova-api[11538]: 2017-09-28 12:00:47.075 11538 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:00:47 ctl02 nova-api[11538]: 2017-09-28 12:00:47.075 11538 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:00:47 ctl02 nova-api[11538]: 2017-09-28 12:00:47.075 11538 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:00:47 ctl02 nova-api[11538]: 2017-09-28 12:00:47.075 11538 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:00:47 ctl02 nova-api[11538]: 2017-09-28 12:00:47.075 11538 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:00:47 ctl02 nova-api[11538]: 2017-09-28 12:00:47.075 11538 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:00:47 ctl02 nova-api[11538]: 2017-09-28 12:00:47.075 11538 ERROR nova.wsgi     self.filename))
Sep 28 12:00:47 ctl02 nova-api[11538]: 2017-09-28 12:00:47.075 11538 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:00:47 ctl02 nova-api[11538]: 2017-09-28 12:00:47.075 11538 ERROR nova.wsgi
Sep 28 12:00:47 ctl02 nova-api[11538]: 2017-09-28 12:00:47.076 11538 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:00:47 ctl02 nova-api[11538]: 2017-09-28 12:00:47.207 11538 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:00:47 ctl02 nova-api[11538]: 2017-09-28 12:00:47.445 11538 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:00:47 ctl02 nova-api[11538]: 2017-09-28 12:00:47.447 11538 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:00:47 ctl02 nova-api[11538]: 2017-09-28 12:00:47.447 11538 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:00:47 ctl02 nova-api[11538]: 2017-09-28 12:00:47.448 11538 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:00:47 ctl02 nova-api[11538]: 2017-09-28 12:00:47.578 11538 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:00:47 ctl02 nova-api[11538]: 2017-09-28 12:00:47.580 11538 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:00:47 ctl02 nova-api[11538]: 2017-09-28 12:00:47.580 11538 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:00:47 ctl02 nova-api[11538]: 2017-09-28 12:00:47.581 11538 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:00:47 ctl02 nova-api[11538]: 2017-09-28 12:00:47.584 11538 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:00:47 ctl02 nova-api[11538]: 2017-09-28 12:00:47.584 11538 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:00:47 ctl02 nova-api[11538]: 2017-09-28 12:00:47.584 11538 ERROR nova Traceback (most recent call last):
Sep 28 12:00:47 ctl02 nova-api[11538]: 2017-09-28 12:00:47.584 11538 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:00:47 ctl02 nova-api[11538]: 2017-09-28 12:00:47.584 11538 ERROR nova     sys.exit(main())
Sep 28 12:00:47 ctl02 nova-api[11538]: 2017-09-28 12:00:47.584 11538 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:00:47 ctl02 nova-api[11538]: 2017-09-28 12:00:47.584 11538 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:00:47 ctl02 nova-api[11538]: 2017-09-28 12:00:47.584 11538 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:00:47 ctl02 nova-api[11538]: 2017-09-28 12:00:47.584 11538 ERROR nova     max_url_len=max_url_len)
Sep 28 12:00:47 ctl02 nova-api[11538]: 2017-09-28 12:00:47.584 11538 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:00:47 ctl02 nova-api[11538]: 2017-09-28 12:00:47.584 11538 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:00:47 ctl02 nova-api[11538]: 2017-09-28 12:00:47.584 11538 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:00:47 ctl02 nova-api[11538]: 2017-09-28 12:00:47.584 11538 ERROR nova     sock.listen(backlog)
Sep 28 12:00:47 ctl02 nova-api[11538]: 2017-09-28 12:00:47.584 11538 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:00:47 ctl02 nova-api[11538]: 2017-09-28 12:00:47.584 11538 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:00:47 ctl02 nova-api[11538]: 2017-09-28 12:00:47.584 11538 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:00:47 ctl02 nova-api[11538]: 2017-09-28 12:00:47.584 11538 ERROR nova
Sep 28 12:00:47 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:00:47 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:00:47 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:00:47 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:00:47 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:00:47 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:00:47 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:00:48 ctl02 nova-scheduler[5620]: 2017-09-28 12:00:48.600 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:00:49 ctl02 glance-api[29183]: 2017-09-28 12:00:49.286 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:00:49] "OPTIONS / HTTP/1.0" 200 134 0.001069
Sep 28 12:00:49 ctl02 nova-api[11556]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:00:49 ctl02 nova-api[11556]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:00:49 ctl02 nova-api[11556]: 2017-09-28 12:00:49.620 11556 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:00:49 ctl02 nova-api[11556]: 2017-09-28 12:00:49.622 11556 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:00:49 ctl02 nova-api[11556]: 2017-09-28 12:00:49.622 11556 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:00:49 ctl02 nova-api[11556]: 2017-09-28 12:00:49.622 11556 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:00:49 ctl02 nova-api[11556]: 2017-09-28 12:00:49.622 11556 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:00:49 ctl02 nova-api[11556]: 2017-09-28 12:00:49.622 11556 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:00:49 ctl02 nova-api[11556]: 2017-09-28 12:00:49.622 11556 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:00:49 ctl02 nova-api[11556]: 2017-09-28 12:00:49.622 11556 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:00:49 ctl02 nova-api[11556]: 2017-09-28 12:00:49.622 11556 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:00:49 ctl02 nova-api[11556]: 2017-09-28 12:00:49.622 11556 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:00:49 ctl02 nova-api[11556]: 2017-09-28 12:00:49.622 11556 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:00:49 ctl02 nova-api[11556]: 2017-09-28 12:00:49.622 11556 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:00:49 ctl02 nova-api[11556]: 2017-09-28 12:00:49.622 11556 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:00:49 ctl02 nova-api[11556]: 2017-09-28 12:00:49.622 11556 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:00:49 ctl02 nova-api[11556]: 2017-09-28 12:00:49.622 11556 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:00:49 ctl02 nova-api[11556]: 2017-09-28 12:00:49.622 11556 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:00:49 ctl02 nova-api[11556]: 2017-09-28 12:00:49.622 11556 ERROR nova.wsgi     self.filename))
Sep 28 12:00:49 ctl02 nova-api[11556]: 2017-09-28 12:00:49.622 11556 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:00:49 ctl02 nova-api[11556]: 2017-09-28 12:00:49.622 11556 ERROR nova.wsgi
Sep 28 12:00:49 ctl02 nova-api[11556]: 2017-09-28 12:00:49.623 11556 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:00:49 ctl02 nova-api[11556]: 2017-09-28 12:00:49.754 11556 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:00:49 ctl02 nova-api[11556]: 2017-09-28 12:00:49.994 11556 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:00:49 ctl02 nova-api[11556]: 2017-09-28 12:00:49.996 11556 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:00:49 ctl02 nova-api[11556]: 2017-09-28 12:00:49.997 11556 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:00:49 ctl02 nova-api[11556]: 2017-09-28 12:00:49.997 11556 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:00:50 ctl02 nova-api[11556]: 2017-09-28 12:00:50.130 11556 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:00:50 ctl02 nova-api[11556]: 2017-09-28 12:00:50.132 11556 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:00:50 ctl02 nova-api[11556]: 2017-09-28 12:00:50.132 11556 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:00:50 ctl02 nova-api[11556]: 2017-09-28 12:00:50.132 11556 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:00:50 ctl02 nova-api[11556]: 2017-09-28 12:00:50.136 11556 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:00:50 ctl02 nova-api[11556]: 2017-09-28 12:00:50.136 11556 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:00:50 ctl02 nova-api[11556]: 2017-09-28 12:00:50.136 11556 ERROR nova Traceback (most recent call last):
Sep 28 12:00:50 ctl02 nova-api[11556]: 2017-09-28 12:00:50.136 11556 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:00:50 ctl02 nova-api[11556]: 2017-09-28 12:00:50.136 11556 ERROR nova     sys.exit(main())
Sep 28 12:00:50 ctl02 nova-api[11556]: 2017-09-28 12:00:50.136 11556 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:00:50 ctl02 nova-api[11556]: 2017-09-28 12:00:50.136 11556 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:00:50 ctl02 nova-api[11556]: 2017-09-28 12:00:50.136 11556 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:00:50 ctl02 nova-api[11556]: 2017-09-28 12:00:50.136 11556 ERROR nova     max_url_len=max_url_len)
Sep 28 12:00:50 ctl02 nova-api[11556]: 2017-09-28 12:00:50.136 11556 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:00:50 ctl02 nova-api[11556]: 2017-09-28 12:00:50.136 11556 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:00:50 ctl02 nova-api[11556]: 2017-09-28 12:00:50.136 11556 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:00:50 ctl02 nova-api[11556]: 2017-09-28 12:00:50.136 11556 ERROR nova     sock.listen(backlog)
Sep 28 12:00:50 ctl02 nova-api[11556]: 2017-09-28 12:00:50.136 11556 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:00:50 ctl02 nova-api[11556]: 2017-09-28 12:00:50.136 11556 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:00:50 ctl02 nova-api[11556]: 2017-09-28 12:00:50.136 11556 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:00:50 ctl02 nova-api[11556]: 2017-09-28 12:00:50.136 11556 ERROR nova
Sep 28 12:00:50 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:00:50 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:00:50 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:00:50 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:00:50 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:00:50 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:00:50 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:00:51 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928120051138586
Sep 28 12:00:51 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 11585
Sep 28 12:00:51 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928120051138586
Sep 28 12:00:52 ctl02 nova-api[11573]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:00:52 ctl02 nova-api[11573]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:00:52 ctl02 nova-api[11573]: 2017-09-28 12:00:52.321 11573 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:00:52 ctl02 nova-api[11573]: 2017-09-28 12:00:52.322 11573 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:00:52 ctl02 nova-api[11573]: 2017-09-28 12:00:52.322 11573 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:00:52 ctl02 nova-api[11573]: 2017-09-28 12:00:52.322 11573 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:00:52 ctl02 nova-api[11573]: 2017-09-28 12:00:52.322 11573 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:00:52 ctl02 nova-api[11573]: 2017-09-28 12:00:52.322 11573 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:00:52 ctl02 nova-api[11573]: 2017-09-28 12:00:52.322 11573 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:00:52 ctl02 nova-api[11573]: 2017-09-28 12:00:52.322 11573 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:00:52 ctl02 nova-api[11573]: 2017-09-28 12:00:52.322 11573 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:00:52 ctl02 nova-api[11573]: 2017-09-28 12:00:52.322 11573 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:00:52 ctl02 nova-api[11573]: 2017-09-28 12:00:52.322 11573 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:00:52 ctl02 nova-api[11573]: 2017-09-28 12:00:52.322 11573 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:00:52 ctl02 nova-api[11573]: 2017-09-28 12:00:52.322 11573 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:00:52 ctl02 nova-api[11573]: 2017-09-28 12:00:52.322 11573 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:00:52 ctl02 nova-api[11573]: 2017-09-28 12:00:52.322 11573 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:00:52 ctl02 nova-api[11573]: 2017-09-28 12:00:52.322 11573 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:00:52 ctl02 nova-api[11573]: 2017-09-28 12:00:52.322 11573 ERROR nova.wsgi     self.filename))
Sep 28 12:00:52 ctl02 nova-api[11573]: 2017-09-28 12:00:52.322 11573 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:00:52 ctl02 nova-api[11573]: 2017-09-28 12:00:52.322 11573 ERROR nova.wsgi
Sep 28 12:00:52 ctl02 nova-api[11573]: 2017-09-28 12:00:52.323 11573 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:00:52 ctl02 nova-api[11573]: 2017-09-28 12:00:52.455 11573 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:00:52 ctl02 nova-api[11573]: 2017-09-28 12:00:52.695 11573 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:00:52 ctl02 nova-api[11573]: 2017-09-28 12:00:52.698 11573 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:00:52 ctl02 nova-api[11573]: 2017-09-28 12:00:52.698 11573 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:00:52 ctl02 nova-api[11573]: 2017-09-28 12:00:52.698 11573 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:00:52 ctl02 nova-api[11573]: 2017-09-28 12:00:52.830 11573 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:00:52 ctl02 nova-api[11573]: 2017-09-28 12:00:52.832 11573 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:00:52 ctl02 nova-api[11573]: 2017-09-28 12:00:52.832 11573 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:00:52 ctl02 nova-api[11573]: 2017-09-28 12:00:52.832 11573 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:00:52 ctl02 nova-api[11573]: 2017-09-28 12:00:52.836 11573 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:00:52 ctl02 nova-api[11573]: 2017-09-28 12:00:52.836 11573 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:00:52 ctl02 nova-api[11573]: 2017-09-28 12:00:52.836 11573 ERROR nova Traceback (most recent call last):
Sep 28 12:00:52 ctl02 nova-api[11573]: 2017-09-28 12:00:52.836 11573 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:00:52 ctl02 nova-api[11573]: 2017-09-28 12:00:52.836 11573 ERROR nova     sys.exit(main())
Sep 28 12:00:52 ctl02 nova-api[11573]: 2017-09-28 12:00:52.836 11573 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:00:52 ctl02 nova-api[11573]: 2017-09-28 12:00:52.836 11573 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:00:52 ctl02 nova-api[11573]: 2017-09-28 12:00:52.836 11573 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:00:52 ctl02 nova-api[11573]: 2017-09-28 12:00:52.836 11573 ERROR nova     max_url_len=max_url_len)
Sep 28 12:00:52 ctl02 nova-api[11573]: 2017-09-28 12:00:52.836 11573 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:00:52 ctl02 nova-api[11573]: 2017-09-28 12:00:52.836 11573 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:00:52 ctl02 nova-api[11573]: 2017-09-28 12:00:52.836 11573 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:00:52 ctl02 nova-api[11573]: 2017-09-28 12:00:52.836 11573 ERROR nova     sock.listen(backlog)
Sep 28 12:00:52 ctl02 nova-api[11573]: 2017-09-28 12:00:52.836 11573 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:00:52 ctl02 nova-api[11573]: 2017-09-28 12:00:52.836 11573 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:00:52 ctl02 nova-api[11573]: 2017-09-28 12:00:52.836 11573 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:00:52 ctl02 nova-api[11573]: 2017-09-28 12:00:52.836 11573 ERROR nova
Sep 28 12:00:52 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:00:52 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:00:52 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:00:53 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:00:53 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:00:53 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:00:53 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:00:53 ctl02 glance-api[29183]: 2017-09-28 12:00:53.474 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:00:53] "OPTIONS / HTTP/1.0" 200 134 0.000645
Sep 28 12:00:54 ctl02 nova-api[11597]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:00:54 ctl02 nova-api[11597]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:00:54 ctl02 nova-api[11597]: 2017-09-28 12:00:54.810 11597 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:00:54 ctl02 nova-api[11597]: 2017-09-28 12:00:54.812 11597 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:00:54 ctl02 nova-api[11597]: 2017-09-28 12:00:54.812 11597 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:00:54 ctl02 nova-api[11597]: 2017-09-28 12:00:54.812 11597 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:00:54 ctl02 nova-api[11597]: 2017-09-28 12:00:54.812 11597 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:00:54 ctl02 nova-api[11597]: 2017-09-28 12:00:54.812 11597 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:00:54 ctl02 nova-api[11597]: 2017-09-28 12:00:54.812 11597 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:00:54 ctl02 nova-api[11597]: 2017-09-28 12:00:54.812 11597 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:00:54 ctl02 nova-api[11597]: 2017-09-28 12:00:54.812 11597 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:00:54 ctl02 nova-api[11597]: 2017-09-28 12:00:54.812 11597 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:00:54 ctl02 nova-api[11597]: 2017-09-28 12:00:54.812 11597 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:00:54 ctl02 nova-api[11597]: 2017-09-28 12:00:54.812 11597 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:00:54 ctl02 nova-api[11597]: 2017-09-28 12:00:54.812 11597 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:00:54 ctl02 nova-api[11597]: 2017-09-28 12:00:54.812 11597 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:00:54 ctl02 nova-api[11597]: 2017-09-28 12:00:54.812 11597 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:00:54 ctl02 nova-api[11597]: 2017-09-28 12:00:54.812 11597 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:00:54 ctl02 nova-api[11597]: 2017-09-28 12:00:54.812 11597 ERROR nova.wsgi     self.filename))
Sep 28 12:00:54 ctl02 nova-api[11597]: 2017-09-28 12:00:54.812 11597 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:00:54 ctl02 nova-api[11597]: 2017-09-28 12:00:54.812 11597 ERROR nova.wsgi
Sep 28 12:00:54 ctl02 nova-api[11597]: 2017-09-28 12:00:54.814 11597 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:00:54 ctl02 nova-api[11597]: 2017-09-28 12:00:54.945 11597 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:00:55 ctl02 nova-api[11597]: 2017-09-28 12:00:55.180 11597 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:00:55 ctl02 nova-api[11597]: 2017-09-28 12:00:55.183 11597 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:00:55 ctl02 nova-api[11597]: 2017-09-28 12:00:55.183 11597 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:00:55 ctl02 nova-api[11597]: 2017-09-28 12:00:55.184 11597 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:00:55 ctl02 nova-api[11597]: 2017-09-28 12:00:55.313 11597 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:00:55 ctl02 nova-api[11597]: 2017-09-28 12:00:55.315 11597 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:00:55 ctl02 nova-api[11597]: 2017-09-28 12:00:55.346 11597 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:00:55 ctl02 nova-api[11597]: 2017-09-28 12:00:55.346 11597 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:00:55 ctl02 nova-api[11597]: 2017-09-28 12:00:55.350 11597 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:00:55 ctl02 nova-api[11597]: 2017-09-28 12:00:55.350 11597 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:00:55 ctl02 nova-api[11597]: 2017-09-28 12:00:55.350 11597 ERROR nova Traceback (most recent call last):
Sep 28 12:00:55 ctl02 nova-api[11597]: 2017-09-28 12:00:55.350 11597 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:00:55 ctl02 nova-api[11597]: 2017-09-28 12:00:55.350 11597 ERROR nova     sys.exit(main())
Sep 28 12:00:55 ctl02 nova-api[11597]: 2017-09-28 12:00:55.350 11597 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:00:55 ctl02 nova-api[11597]: 2017-09-28 12:00:55.350 11597 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:00:55 ctl02 nova-api[11597]: 2017-09-28 12:00:55.350 11597 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:00:55 ctl02 nova-api[11597]: 2017-09-28 12:00:55.350 11597 ERROR nova     max_url_len=max_url_len)
Sep 28 12:00:55 ctl02 nova-api[11597]: 2017-09-28 12:00:55.350 11597 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:00:55 ctl02 nova-api[11597]: 2017-09-28 12:00:55.350 11597 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:00:55 ctl02 nova-api[11597]: 2017-09-28 12:00:55.350 11597 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:00:55 ctl02 nova-api[11597]: 2017-09-28 12:00:55.350 11597 ERROR nova     sock.listen(backlog)
Sep 28 12:00:55 ctl02 nova-api[11597]: 2017-09-28 12:00:55.350 11597 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:00:55 ctl02 nova-api[11597]: 2017-09-28 12:00:55.350 11597 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:00:55 ctl02 nova-api[11597]: 2017-09-28 12:00:55.350 11597 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:00:55 ctl02 nova-api[11597]: 2017-09-28 12:00:55.350 11597 ERROR nova
Sep 28 12:00:55 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:00:55 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:00:55 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:00:55 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:00:55 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:00:55 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:00:55 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:00:55 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x29c9a031)
Sep 28 12:00:56 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x29c9a031)
Sep 28 12:00:56 ctl02 glance-api[29183]: 2017-09-28 12:00:56.967 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:00:56] "OPTIONS / HTTP/1.0" 200 134 0.000630
Sep 28 12:00:57 ctl02 nova-api[11615]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:00:57 ctl02 nova-api[11615]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:00:57 ctl02 nova-api[11615]: 2017-09-28 12:00:57.320 11615 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:00:57 ctl02 nova-api[11615]: 2017-09-28 12:00:57.322 11615 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:00:57 ctl02 nova-api[11615]: 2017-09-28 12:00:57.322 11615 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:00:57 ctl02 nova-api[11615]: 2017-09-28 12:00:57.322 11615 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:00:57 ctl02 nova-api[11615]: 2017-09-28 12:00:57.322 11615 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:00:57 ctl02 nova-api[11615]: 2017-09-28 12:00:57.322 11615 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:00:57 ctl02 nova-api[11615]: 2017-09-28 12:00:57.322 11615 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:00:57 ctl02 nova-api[11615]: 2017-09-28 12:00:57.322 11615 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:00:57 ctl02 nova-api[11615]: 2017-09-28 12:00:57.322 11615 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:00:57 ctl02 nova-api[11615]: 2017-09-28 12:00:57.322 11615 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:00:57 ctl02 nova-api[11615]: 2017-09-28 12:00:57.322 11615 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:00:57 ctl02 nova-api[11615]: 2017-09-28 12:00:57.322 11615 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:00:57 ctl02 nova-api[11615]: 2017-09-28 12:00:57.322 11615 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:00:57 ctl02 nova-api[11615]: 2017-09-28 12:00:57.322 11615 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:00:57 ctl02 nova-api[11615]: 2017-09-28 12:00:57.322 11615 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:00:57 ctl02 nova-api[11615]: 2017-09-28 12:00:57.322 11615 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:00:57 ctl02 nova-api[11615]: 2017-09-28 12:00:57.322 11615 ERROR nova.wsgi     self.filename))
Sep 28 12:00:57 ctl02 nova-api[11615]: 2017-09-28 12:00:57.322 11615 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:00:57 ctl02 nova-api[11615]: 2017-09-28 12:00:57.322 11615 ERROR nova.wsgi
Sep 28 12:00:57 ctl02 nova-api[11615]: 2017-09-28 12:00:57.324 11615 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:00:57 ctl02 nova-api[11615]: 2017-09-28 12:00:57.457 11615 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:00:57 ctl02 nova-api[11615]: 2017-09-28 12:00:57.697 11615 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:00:57 ctl02 nova-api[11615]: 2017-09-28 12:00:57.699 11615 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:00:57 ctl02 nova-api[11615]: 2017-09-28 12:00:57.699 11615 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:00:57 ctl02 nova-api[11615]: 2017-09-28 12:00:57.700 11615 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:00:57 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x29c9a031)
Sep 28 12:00:57 ctl02 nova-api[11615]: 2017-09-28 12:00:57.832 11615 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:00:57 ctl02 nova-api[11615]: 2017-09-28 12:00:57.834 11615 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:00:57 ctl02 nova-api[11615]: 2017-09-28 12:00:57.834 11615 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:00:57 ctl02 nova-api[11615]: 2017-09-28 12:00:57.834 11615 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:00:57 ctl02 nova-api[11615]: 2017-09-28 12:00:57.837 11615 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:00:57 ctl02 nova-api[11615]: 2017-09-28 12:00:57.838 11615 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:00:57 ctl02 nova-api[11615]: 2017-09-28 12:00:57.838 11615 ERROR nova Traceback (most recent call last):
Sep 28 12:00:57 ctl02 nova-api[11615]: 2017-09-28 12:00:57.838 11615 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:00:57 ctl02 nova-api[11615]: 2017-09-28 12:00:57.838 11615 ERROR nova     sys.exit(main())
Sep 28 12:00:57 ctl02 nova-api[11615]: 2017-09-28 12:00:57.838 11615 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:00:57 ctl02 nova-api[11615]: 2017-09-28 12:00:57.838 11615 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:00:57 ctl02 nova-api[11615]: 2017-09-28 12:00:57.838 11615 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:00:57 ctl02 nova-api[11615]: 2017-09-28 12:00:57.838 11615 ERROR nova     max_url_len=max_url_len)
Sep 28 12:00:57 ctl02 nova-api[11615]: 2017-09-28 12:00:57.838 11615 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:00:57 ctl02 nova-api[11615]: 2017-09-28 12:00:57.838 11615 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:00:57 ctl02 nova-api[11615]: 2017-09-28 12:00:57.838 11615 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:00:57 ctl02 nova-api[11615]: 2017-09-28 12:00:57.838 11615 ERROR nova     sock.listen(backlog)
Sep 28 12:00:57 ctl02 nova-api[11615]: 2017-09-28 12:00:57.838 11615 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:00:57 ctl02 nova-api[11615]: 2017-09-28 12:00:57.838 11615 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:00:57 ctl02 nova-api[11615]: 2017-09-28 12:00:57.838 11615 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:00:57 ctl02 nova-api[11615]: 2017-09-28 12:00:57.838 11615 ERROR nova
Sep 28 12:00:57 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:00:57 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:00:57 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:00:58 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:00:58 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:00:58 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:00:58 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:00:58 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x29c9a031)
Sep 28 12:00:59 ctl02 nova-api[11632]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:00:59 ctl02 nova-api[11632]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:00:59 ctl02 glance-api[29183]: 2017-09-28 12:00:59.670 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:00:59] "OPTIONS / HTTP/1.0" 200 134 0.000981
Sep 28 12:00:59 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x29c9a031)
Sep 28 12:00:59 ctl02 nova-api[11632]: 2017-09-28 12:00:59.829 11632 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:00:59 ctl02 nova-api[11632]: 2017-09-28 12:00:59.831 11632 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:00:59 ctl02 nova-api[11632]: 2017-09-28 12:00:59.831 11632 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:00:59 ctl02 nova-api[11632]: 2017-09-28 12:00:59.831 11632 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:00:59 ctl02 nova-api[11632]: 2017-09-28 12:00:59.831 11632 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:00:59 ctl02 nova-api[11632]: 2017-09-28 12:00:59.831 11632 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:00:59 ctl02 nova-api[11632]: 2017-09-28 12:00:59.831 11632 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:00:59 ctl02 nova-api[11632]: 2017-09-28 12:00:59.831 11632 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:00:59 ctl02 nova-api[11632]: 2017-09-28 12:00:59.831 11632 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:00:59 ctl02 nova-api[11632]: 2017-09-28 12:00:59.831 11632 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:00:59 ctl02 nova-api[11632]: 2017-09-28 12:00:59.831 11632 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:00:59 ctl02 nova-api[11632]: 2017-09-28 12:00:59.831 11632 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:00:59 ctl02 nova-api[11632]: 2017-09-28 12:00:59.831 11632 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:00:59 ctl02 nova-api[11632]: 2017-09-28 12:00:59.831 11632 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:00:59 ctl02 nova-api[11632]: 2017-09-28 12:00:59.831 11632 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:00:59 ctl02 nova-api[11632]: 2017-09-28 12:00:59.831 11632 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:00:59 ctl02 nova-api[11632]: 2017-09-28 12:00:59.831 11632 ERROR nova.wsgi     self.filename))
Sep 28 12:00:59 ctl02 nova-api[11632]: 2017-09-28 12:00:59.831 11632 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:00:59 ctl02 nova-api[11632]: 2017-09-28 12:00:59.831 11632 ERROR nova.wsgi
Sep 28 12:00:59 ctl02 nova-api[11632]: 2017-09-28 12:00:59.833 11632 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:00:59 ctl02 nova-api[11632]: 2017-09-28 12:00:59.963 11632 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:01:00 ctl02 nova-api[11632]: 2017-09-28 12:01:00.196 11632 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:01:00 ctl02 nova-api[11632]: 2017-09-28 12:01:00.199 11632 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:01:00 ctl02 nova-api[11632]: 2017-09-28 12:01:00.200 11632 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:01:00 ctl02 nova-api[11632]: 2017-09-28 12:01:00.200 11632 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:01:00 ctl02 nova-api[11632]: 2017-09-28 12:01:00.330 11632 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:01:00 ctl02 nova-api[11632]: 2017-09-28 12:01:00.333 11632 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:01:00 ctl02 nova-api[11632]: 2017-09-28 12:01:00.338 11632 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:01:00 ctl02 nova-api[11632]: 2017-09-28 12:01:00.338 11632 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:01:00 ctl02 nova-api[11632]: 2017-09-28 12:01:00.342 11632 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:01:00 ctl02 nova-api[11632]: 2017-09-28 12:01:00.342 11632 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:01:00 ctl02 nova-api[11632]: 2017-09-28 12:01:00.342 11632 ERROR nova Traceback (most recent call last):
Sep 28 12:01:00 ctl02 nova-api[11632]: 2017-09-28 12:01:00.342 11632 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:01:00 ctl02 nova-api[11632]: 2017-09-28 12:01:00.342 11632 ERROR nova     sys.exit(main())
Sep 28 12:01:00 ctl02 nova-api[11632]: 2017-09-28 12:01:00.342 11632 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:01:00 ctl02 nova-api[11632]: 2017-09-28 12:01:00.342 11632 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:01:00 ctl02 nova-api[11632]: 2017-09-28 12:01:00.342 11632 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:01:00 ctl02 nova-api[11632]: 2017-09-28 12:01:00.342 11632 ERROR nova     max_url_len=max_url_len)
Sep 28 12:01:00 ctl02 nova-api[11632]: 2017-09-28 12:01:00.342 11632 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:01:00 ctl02 nova-api[11632]: 2017-09-28 12:01:00.342 11632 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:01:00 ctl02 nova-api[11632]: 2017-09-28 12:01:00.342 11632 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:01:00 ctl02 nova-api[11632]: 2017-09-28 12:01:00.342 11632 ERROR nova     sock.listen(backlog)
Sep 28 12:01:00 ctl02 nova-api[11632]: 2017-09-28 12:01:00.342 11632 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:01:00 ctl02 nova-api[11632]: 2017-09-28 12:01:00.342 11632 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:01:00 ctl02 nova-api[11632]: 2017-09-28 12:01:00.342 11632 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:01:00 ctl02 nova-api[11632]: 2017-09-28 12:01:00.342 11632 ERROR nova
Sep 28 12:01:00 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:01:00 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:01:00 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:01:00 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:01:00 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:01:00 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:01:00 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:01:00 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x29c9a031)
Sep 28 12:01:01 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928120101325599
Sep 28 12:01:01 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 11662
Sep 28 12:01:01 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928120101325599
Sep 28 12:01:01 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x29c9a031)
Sep 28 12:01:02 ctl02 nova-api[11651]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:01:02 ctl02 nova-api[11651]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:01:02 ctl02 nova-api[11651]: 2017-09-28 12:01:02.311 11651 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:01:02 ctl02 nova-api[11651]: 2017-09-28 12:01:02.313 11651 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:01:02 ctl02 nova-api[11651]: 2017-09-28 12:01:02.313 11651 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:01:02 ctl02 nova-api[11651]: 2017-09-28 12:01:02.313 11651 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:01:02 ctl02 nova-api[11651]: 2017-09-28 12:01:02.313 11651 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:01:02 ctl02 nova-api[11651]: 2017-09-28 12:01:02.313 11651 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:01:02 ctl02 nova-api[11651]: 2017-09-28 12:01:02.313 11651 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:01:02 ctl02 nova-api[11651]: 2017-09-28 12:01:02.313 11651 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:01:02 ctl02 nova-api[11651]: 2017-09-28 12:01:02.313 11651 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:01:02 ctl02 nova-api[11651]: 2017-09-28 12:01:02.313 11651 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:01:02 ctl02 nova-api[11651]: 2017-09-28 12:01:02.313 11651 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:01:02 ctl02 nova-api[11651]: 2017-09-28 12:01:02.313 11651 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:01:02 ctl02 nova-api[11651]: 2017-09-28 12:01:02.313 11651 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:01:02 ctl02 nova-api[11651]: 2017-09-28 12:01:02.313 11651 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:01:02 ctl02 nova-api[11651]: 2017-09-28 12:01:02.313 11651 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:01:02 ctl02 nova-api[11651]: 2017-09-28 12:01:02.313 11651 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:01:02 ctl02 nova-api[11651]: 2017-09-28 12:01:02.313 11651 ERROR nova.wsgi     self.filename))
Sep 28 12:01:02 ctl02 nova-api[11651]: 2017-09-28 12:01:02.313 11651 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:01:02 ctl02 nova-api[11651]: 2017-09-28 12:01:02.313 11651 ERROR nova.wsgi
Sep 28 12:01:02 ctl02 nova-api[11651]: 2017-09-28 12:01:02.315 11651 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:01:02 ctl02 nova-api[11651]: 2017-09-28 12:01:02.446 11651 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:01:02 ctl02 nova-api[11651]: 2017-09-28 12:01:02.682 11651 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:01:02 ctl02 nova-api[11651]: 2017-09-28 12:01:02.685 11651 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:01:02 ctl02 nova-api[11651]: 2017-09-28 12:01:02.686 11651 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:01:02 ctl02 nova-api[11651]: 2017-09-28 12:01:02.686 11651 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:01:02 ctl02 nova-api[11651]: 2017-09-28 12:01:02.815 11651 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:01:02 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x29c9a031)
Sep 28 12:01:02 ctl02 nova-api[11651]: 2017-09-28 12:01:02.818 11651 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:01:02 ctl02 nova-api[11651]: 2017-09-28 12:01:02.819 11651 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:01:02 ctl02 nova-api[11651]: 2017-09-28 12:01:02.819 11651 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:01:02 ctl02 nova-api[11651]: 2017-09-28 12:01:02.823 11651 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:01:02 ctl02 nova-api[11651]: 2017-09-28 12:01:02.823 11651 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:01:02 ctl02 nova-api[11651]: 2017-09-28 12:01:02.823 11651 ERROR nova Traceback (most recent call last):
Sep 28 12:01:02 ctl02 nova-api[11651]: 2017-09-28 12:01:02.823 11651 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:01:02 ctl02 nova-api[11651]: 2017-09-28 12:01:02.823 11651 ERROR nova     sys.exit(main())
Sep 28 12:01:02 ctl02 nova-api[11651]: 2017-09-28 12:01:02.823 11651 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:01:02 ctl02 nova-api[11651]: 2017-09-28 12:01:02.823 11651 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:01:02 ctl02 nova-api[11651]: 2017-09-28 12:01:02.823 11651 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:01:02 ctl02 nova-api[11651]: 2017-09-28 12:01:02.823 11651 ERROR nova     max_url_len=max_url_len)
Sep 28 12:01:02 ctl02 nova-api[11651]: 2017-09-28 12:01:02.823 11651 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:01:02 ctl02 nova-api[11651]: 2017-09-28 12:01:02.823 11651 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:01:02 ctl02 nova-api[11651]: 2017-09-28 12:01:02.823 11651 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:01:02 ctl02 nova-api[11651]: 2017-09-28 12:01:02.823 11651 ERROR nova     sock.listen(backlog)
Sep 28 12:01:02 ctl02 nova-api[11651]: 2017-09-28 12:01:02.823 11651 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:01:02 ctl02 nova-api[11651]: 2017-09-28 12:01:02.823 11651 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:01:02 ctl02 nova-api[11651]: 2017-09-28 12:01:02.823 11651 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:01:02 ctl02 nova-api[11651]: 2017-09-28 12:01:02.823 11651 ERROR nova
Sep 28 12:01:02 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:01:02 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:01:02 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:01:03 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:01:03 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:01:03 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:01:03 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:01:03 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x29c9a031)
Sep 28 12:01:03 ctl02 glance-api[29183]: 2017-09-28 12:01:03.829 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:01:03] "OPTIONS / HTTP/1.0" 200 134 0.000639
Sep 28 12:01:04 ctl02 nova-api[11673]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:01:04 ctl02 nova-api[11673]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:01:04 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x29c9a031)
Sep 28 12:01:04 ctl02 nova-api[11673]: 2017-09-28 12:01:04.831 11673 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:01:04 ctl02 nova-api[11673]: 2017-09-28 12:01:04.832 11673 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:01:04 ctl02 nova-api[11673]: 2017-09-28 12:01:04.832 11673 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:01:04 ctl02 nova-api[11673]: 2017-09-28 12:01:04.832 11673 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:01:04 ctl02 nova-api[11673]: 2017-09-28 12:01:04.832 11673 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:01:04 ctl02 nova-api[11673]: 2017-09-28 12:01:04.832 11673 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:01:04 ctl02 nova-api[11673]: 2017-09-28 12:01:04.832 11673 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:01:04 ctl02 nova-api[11673]: 2017-09-28 12:01:04.832 11673 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:01:04 ctl02 nova-api[11673]: 2017-09-28 12:01:04.832 11673 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:01:04 ctl02 nova-api[11673]: 2017-09-28 12:01:04.832 11673 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:01:04 ctl02 nova-api[11673]: 2017-09-28 12:01:04.832 11673 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:01:04 ctl02 nova-api[11673]: 2017-09-28 12:01:04.832 11673 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:01:04 ctl02 nova-api[11673]: 2017-09-28 12:01:04.832 11673 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:01:04 ctl02 nova-api[11673]: 2017-09-28 12:01:04.832 11673 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:01:04 ctl02 nova-api[11673]: 2017-09-28 12:01:04.832 11673 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:01:04 ctl02 nova-api[11673]: 2017-09-28 12:01:04.832 11673 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:01:04 ctl02 nova-api[11673]: 2017-09-28 12:01:04.832 11673 ERROR nova.wsgi     self.filename))
Sep 28 12:01:04 ctl02 nova-api[11673]: 2017-09-28 12:01:04.832 11673 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:01:04 ctl02 nova-api[11673]: 2017-09-28 12:01:04.832 11673 ERROR nova.wsgi
Sep 28 12:01:04 ctl02 nova-api[11673]: 2017-09-28 12:01:04.833 11673 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:01:04 ctl02 nova-api[11673]: 2017-09-28 12:01:04.966 11673 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:01:05 ctl02 nova-api[11673]: 2017-09-28 12:01:05.201 11673 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:01:05 ctl02 nova-api[11673]: 2017-09-28 12:01:05.203 11673 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:01:05 ctl02 nova-api[11673]: 2017-09-28 12:01:05.203 11673 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:01:05 ctl02 nova-api[11673]: 2017-09-28 12:01:05.204 11673 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:01:05 ctl02 nova-api[11673]: 2017-09-28 12:01:05.336 11673 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:01:05 ctl02 nova-api[11673]: 2017-09-28 12:01:05.338 11673 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:01:05 ctl02 nova-api[11673]: 2017-09-28 12:01:05.345 11673 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:01:05 ctl02 nova-api[11673]: 2017-09-28 12:01:05.346 11673 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:01:05 ctl02 nova-api[11673]: 2017-09-28 12:01:05.350 11673 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:01:05 ctl02 nova-api[11673]: 2017-09-28 12:01:05.351 11673 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:01:05 ctl02 nova-api[11673]: 2017-09-28 12:01:05.351 11673 ERROR nova Traceback (most recent call last):
Sep 28 12:01:05 ctl02 nova-api[11673]: 2017-09-28 12:01:05.351 11673 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:01:05 ctl02 nova-api[11673]: 2017-09-28 12:01:05.351 11673 ERROR nova     sys.exit(main())
Sep 28 12:01:05 ctl02 nova-api[11673]: 2017-09-28 12:01:05.351 11673 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:01:05 ctl02 nova-api[11673]: 2017-09-28 12:01:05.351 11673 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:01:05 ctl02 nova-api[11673]: 2017-09-28 12:01:05.351 11673 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:01:05 ctl02 nova-api[11673]: 2017-09-28 12:01:05.351 11673 ERROR nova     max_url_len=max_url_len)
Sep 28 12:01:05 ctl02 nova-api[11673]: 2017-09-28 12:01:05.351 11673 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:01:05 ctl02 nova-api[11673]: 2017-09-28 12:01:05.351 11673 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:01:05 ctl02 nova-api[11673]: 2017-09-28 12:01:05.351 11673 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:01:05 ctl02 nova-api[11673]: 2017-09-28 12:01:05.351 11673 ERROR nova     sock.listen(backlog)
Sep 28 12:01:05 ctl02 nova-api[11673]: 2017-09-28 12:01:05.351 11673 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:01:05 ctl02 nova-api[11673]: 2017-09-28 12:01:05.351 11673 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:01:05 ctl02 nova-api[11673]: 2017-09-28 12:01:05.351 11673 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:01:05 ctl02 nova-api[11673]: 2017-09-28 12:01:05.351 11673 ERROR nova
Sep 28 12:01:05 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:01:05 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:01:05 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:01:05 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:01:05 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:01:05 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:01:05 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:01:05 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x29c9a031)
Sep 28 12:01:06 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:01:06 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:01:07 ctl02 nova-api[11692]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:01:07 ctl02 nova-api[11692]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:01:07 ctl02 glance-api[29183]: 2017-09-28 12:01:07.126 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:01:07] "OPTIONS / HTTP/1.0" 200 134 0.000699
Sep 28 12:01:07 ctl02 nova-api[11692]: 2017-09-28 12:01:07.299 11692 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:01:07 ctl02 nova-api[11692]: 2017-09-28 12:01:07.300 11692 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:01:07 ctl02 nova-api[11692]: 2017-09-28 12:01:07.300 11692 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:01:07 ctl02 nova-api[11692]: 2017-09-28 12:01:07.300 11692 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:01:07 ctl02 nova-api[11692]: 2017-09-28 12:01:07.300 11692 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:01:07 ctl02 nova-api[11692]: 2017-09-28 12:01:07.300 11692 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:01:07 ctl02 nova-api[11692]: 2017-09-28 12:01:07.300 11692 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:01:07 ctl02 nova-api[11692]: 2017-09-28 12:01:07.300 11692 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:01:07 ctl02 nova-api[11692]: 2017-09-28 12:01:07.300 11692 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:01:07 ctl02 nova-api[11692]: 2017-09-28 12:01:07.300 11692 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:01:07 ctl02 nova-api[11692]: 2017-09-28 12:01:07.300 11692 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:01:07 ctl02 nova-api[11692]: 2017-09-28 12:01:07.300 11692 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:01:07 ctl02 nova-api[11692]: 2017-09-28 12:01:07.300 11692 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:01:07 ctl02 nova-api[11692]: 2017-09-28 12:01:07.300 11692 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:01:07 ctl02 nova-api[11692]: 2017-09-28 12:01:07.300 11692 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:01:07 ctl02 nova-api[11692]: 2017-09-28 12:01:07.300 11692 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:01:07 ctl02 nova-api[11692]: 2017-09-28 12:01:07.300 11692 ERROR nova.wsgi     self.filename))
Sep 28 12:01:07 ctl02 nova-api[11692]: 2017-09-28 12:01:07.300 11692 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:01:07 ctl02 nova-api[11692]: 2017-09-28 12:01:07.300 11692 ERROR nova.wsgi
Sep 28 12:01:07 ctl02 nova-api[11692]: 2017-09-28 12:01:07.301 11692 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:01:07 ctl02 nova-api[11692]: 2017-09-28 12:01:07.428 11692 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:01:07 ctl02 nova-api[11692]: 2017-09-28 12:01:07.660 11692 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:01:07 ctl02 nova-api[11692]: 2017-09-28 12:01:07.662 11692 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:01:07 ctl02 nova-api[11692]: 2017-09-28 12:01:07.662 11692 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:01:07 ctl02 nova-api[11692]: 2017-09-28 12:01:07.663 11692 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:01:07 ctl02 nova-cert[4860]: 2017-09-28 12:01:07.725 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:01:07 ctl02 nova-api[11692]: 2017-09-28 12:01:07.809 11692 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:01:07 ctl02 nova-api[11692]: 2017-09-28 12:01:07.811 11692 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:01:07 ctl02 nova-api[11692]: 2017-09-28 12:01:07.811 11692 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:01:07 ctl02 nova-api[11692]: 2017-09-28 12:01:07.811 11692 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:01:07 ctl02 nova-api[11692]: 2017-09-28 12:01:07.815 11692 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:01:07 ctl02 nova-api[11692]: 2017-09-28 12:01:07.815 11692 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:01:07 ctl02 nova-api[11692]: 2017-09-28 12:01:07.815 11692 ERROR nova Traceback (most recent call last):
Sep 28 12:01:07 ctl02 nova-api[11692]: 2017-09-28 12:01:07.815 11692 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:01:07 ctl02 nova-api[11692]: 2017-09-28 12:01:07.815 11692 ERROR nova     sys.exit(main())
Sep 28 12:01:07 ctl02 nova-api[11692]: 2017-09-28 12:01:07.815 11692 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:01:07 ctl02 nova-api[11692]: 2017-09-28 12:01:07.815 11692 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:01:07 ctl02 nova-api[11692]: 2017-09-28 12:01:07.815 11692 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:01:07 ctl02 nova-api[11692]: 2017-09-28 12:01:07.815 11692 ERROR nova     max_url_len=max_url_len)
Sep 28 12:01:07 ctl02 nova-api[11692]: 2017-09-28 12:01:07.815 11692 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:01:07 ctl02 nova-api[11692]: 2017-09-28 12:01:07.815 11692 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:01:07 ctl02 nova-api[11692]: 2017-09-28 12:01:07.815 11692 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:01:07 ctl02 nova-api[11692]: 2017-09-28 12:01:07.815 11692 ERROR nova     sock.listen(backlog)
Sep 28 12:01:07 ctl02 nova-api[11692]: 2017-09-28 12:01:07.815 11692 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:01:07 ctl02 nova-api[11692]: 2017-09-28 12:01:07.815 11692 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:01:07 ctl02 nova-api[11692]: 2017-09-28 12:01:07.815 11692 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:01:07 ctl02 nova-api[11692]: 2017-09-28 12:01:07.815 11692 ERROR nova
Sep 28 12:01:07 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:01:07 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:01:07 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:01:08 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:01:08 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:01:08 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:01:08 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:01:09 ctl02 nova-api[11715]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:01:09 ctl02 nova-api[11715]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:01:09 ctl02 glance-api[29183]: 2017-09-28 12:01:09.764 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:01:09] "OPTIONS / HTTP/1.0" 200 134 0.000650
Sep 28 12:01:09 ctl02 nova-api[11715]: 2017-09-28 12:01:09.860 11715 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:01:09 ctl02 nova-api[11715]: 2017-09-28 12:01:09.862 11715 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:01:09 ctl02 nova-api[11715]: 2017-09-28 12:01:09.862 11715 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:01:09 ctl02 nova-api[11715]: 2017-09-28 12:01:09.862 11715 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:01:09 ctl02 nova-api[11715]: 2017-09-28 12:01:09.862 11715 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:01:09 ctl02 nova-api[11715]: 2017-09-28 12:01:09.862 11715 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:01:09 ctl02 nova-api[11715]: 2017-09-28 12:01:09.862 11715 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:01:09 ctl02 nova-api[11715]: 2017-09-28 12:01:09.862 11715 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:01:09 ctl02 nova-api[11715]: 2017-09-28 12:01:09.862 11715 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:01:09 ctl02 nova-api[11715]: 2017-09-28 12:01:09.862 11715 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:01:09 ctl02 nova-api[11715]: 2017-09-28 12:01:09.862 11715 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:01:09 ctl02 nova-api[11715]: 2017-09-28 12:01:09.862 11715 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:01:09 ctl02 nova-api[11715]: 2017-09-28 12:01:09.862 11715 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:01:09 ctl02 nova-api[11715]: 2017-09-28 12:01:09.862 11715 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:01:09 ctl02 nova-api[11715]: 2017-09-28 12:01:09.862 11715 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:01:09 ctl02 nova-api[11715]: 2017-09-28 12:01:09.862 11715 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:01:09 ctl02 nova-api[11715]: 2017-09-28 12:01:09.862 11715 ERROR nova.wsgi     self.filename))
Sep 28 12:01:09 ctl02 nova-api[11715]: 2017-09-28 12:01:09.862 11715 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:01:09 ctl02 nova-api[11715]: 2017-09-28 12:01:09.862 11715 ERROR nova.wsgi
Sep 28 12:01:09 ctl02 nova-api[11715]: 2017-09-28 12:01:09.864 11715 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:01:09 ctl02 nova-api[11715]: 2017-09-28 12:01:09.995 11715 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:01:10 ctl02 nova-api[11715]: 2017-09-28 12:01:10.229 11715 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:01:10 ctl02 nova-api[11715]: 2017-09-28 12:01:10.232 11715 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:01:10 ctl02 nova-api[11715]: 2017-09-28 12:01:10.233 11715 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:01:10 ctl02 nova-api[11715]: 2017-09-28 12:01:10.233 11715 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:01:10 ctl02 nova-conductor[5056]: 2017-09-28 12:01:10.242 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:01:10 ctl02 nova-conductor[5056]: 2017-09-28 12:01:10.259 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:01:10 ctl02 nova-conductor[5056]: 2017-09-28 12:01:10.271 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:01:10 ctl02 nova-conductor[5056]: 2017-09-28 12:01:10.278 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:01:10 ctl02 nova-api[11715]: 2017-09-28 12:01:10.389 11715 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:01:10 ctl02 nova-api[11715]: 2017-09-28 12:01:10.391 11715 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:01:10 ctl02 nova-api[11715]: 2017-09-28 12:01:10.405 11715 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:01:10 ctl02 nova-api[11715]: 2017-09-28 12:01:10.405 11715 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:01:10 ctl02 nova-api[11715]: 2017-09-28 12:01:10.409 11715 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:01:10 ctl02 nova-api[11715]: 2017-09-28 12:01:10.409 11715 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:01:10 ctl02 nova-api[11715]: 2017-09-28 12:01:10.409 11715 ERROR nova Traceback (most recent call last):
Sep 28 12:01:10 ctl02 nova-api[11715]: 2017-09-28 12:01:10.409 11715 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:01:10 ctl02 nova-api[11715]: 2017-09-28 12:01:10.409 11715 ERROR nova     sys.exit(main())
Sep 28 12:01:10 ctl02 nova-api[11715]: 2017-09-28 12:01:10.409 11715 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:01:10 ctl02 nova-api[11715]: 2017-09-28 12:01:10.409 11715 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:01:10 ctl02 nova-api[11715]: 2017-09-28 12:01:10.409 11715 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:01:10 ctl02 nova-api[11715]: 2017-09-28 12:01:10.409 11715 ERROR nova     max_url_len=max_url_len)
Sep 28 12:01:10 ctl02 nova-api[11715]: 2017-09-28 12:01:10.409 11715 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:01:10 ctl02 nova-api[11715]: 2017-09-28 12:01:10.409 11715 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:01:10 ctl02 nova-api[11715]: 2017-09-28 12:01:10.409 11715 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:01:10 ctl02 nova-api[11715]: 2017-09-28 12:01:10.409 11715 ERROR nova     sock.listen(backlog)
Sep 28 12:01:10 ctl02 nova-api[11715]: 2017-09-28 12:01:10.409 11715 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:01:10 ctl02 nova-api[11715]: 2017-09-28 12:01:10.409 11715 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:01:10 ctl02 nova-api[11715]: 2017-09-28 12:01:10.409 11715 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:01:10 ctl02 nova-api[11715]: 2017-09-28 12:01:10.409 11715 ERROR nova
Sep 28 12:01:10 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:01:10 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:01:10 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:01:10 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:01:10 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:01:10 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:01:10 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:01:11 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928120111518938
Sep 28 12:01:11 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 11744
Sep 28 12:01:11 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928120111518938
Sep 28 12:01:12 ctl02 nova-api[11733]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:01:12 ctl02 nova-api[11733]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:01:12 ctl02 nova-api[11733]: 2017-09-28 12:01:12.580 11733 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:01:12 ctl02 nova-api[11733]: 2017-09-28 12:01:12.581 11733 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:01:12 ctl02 nova-api[11733]: 2017-09-28 12:01:12.581 11733 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:01:12 ctl02 nova-api[11733]: 2017-09-28 12:01:12.581 11733 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:01:12 ctl02 nova-api[11733]: 2017-09-28 12:01:12.581 11733 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:01:12 ctl02 nova-api[11733]: 2017-09-28 12:01:12.581 11733 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:01:12 ctl02 nova-api[11733]: 2017-09-28 12:01:12.581 11733 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:01:12 ctl02 nova-api[11733]: 2017-09-28 12:01:12.581 11733 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:01:12 ctl02 nova-api[11733]: 2017-09-28 12:01:12.581 11733 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:01:12 ctl02 nova-api[11733]: 2017-09-28 12:01:12.581 11733 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:01:12 ctl02 nova-api[11733]: 2017-09-28 12:01:12.581 11733 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:01:12 ctl02 nova-api[11733]: 2017-09-28 12:01:12.581 11733 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:01:12 ctl02 nova-api[11733]: 2017-09-28 12:01:12.581 11733 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:01:12 ctl02 nova-api[11733]: 2017-09-28 12:01:12.581 11733 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:01:12 ctl02 nova-api[11733]: 2017-09-28 12:01:12.581 11733 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:01:12 ctl02 nova-api[11733]: 2017-09-28 12:01:12.581 11733 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:01:12 ctl02 nova-api[11733]: 2017-09-28 12:01:12.581 11733 ERROR nova.wsgi     self.filename))
Sep 28 12:01:12 ctl02 nova-api[11733]: 2017-09-28 12:01:12.581 11733 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:01:12 ctl02 nova-api[11733]: 2017-09-28 12:01:12.581 11733 ERROR nova.wsgi
Sep 28 12:01:12 ctl02 nova-api[11733]: 2017-09-28 12:01:12.582 11733 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:01:12 ctl02 nova-api[11733]: 2017-09-28 12:01:12.713 11733 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:01:12 ctl02 nova-api[11733]: 2017-09-28 12:01:12.955 11733 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:01:12 ctl02 nova-api[11733]: 2017-09-28 12:01:12.958 11733 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:01:12 ctl02 nova-api[11733]: 2017-09-28 12:01:12.958 11733 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:01:12 ctl02 nova-api[11733]: 2017-09-28 12:01:12.959 11733 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:01:13 ctl02 nova-api[11733]: 2017-09-28 12:01:13.087 11733 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:01:13 ctl02 nova-api[11733]: 2017-09-28 12:01:13.089 11733 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:01:13 ctl02 nova-api[11733]: 2017-09-28 12:01:13.089 11733 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:01:13 ctl02 nova-api[11733]: 2017-09-28 12:01:13.089 11733 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:01:13 ctl02 nova-api[11733]: 2017-09-28 12:01:13.092 11733 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:01:13 ctl02 nova-api[11733]: 2017-09-28 12:01:13.093 11733 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:01:13 ctl02 nova-api[11733]: 2017-09-28 12:01:13.093 11733 ERROR nova Traceback (most recent call last):
Sep 28 12:01:13 ctl02 nova-api[11733]: 2017-09-28 12:01:13.093 11733 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:01:13 ctl02 nova-api[11733]: 2017-09-28 12:01:13.093 11733 ERROR nova     sys.exit(main())
Sep 28 12:01:13 ctl02 nova-api[11733]: 2017-09-28 12:01:13.093 11733 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:01:13 ctl02 nova-api[11733]: 2017-09-28 12:01:13.093 11733 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:01:13 ctl02 nova-api[11733]: 2017-09-28 12:01:13.093 11733 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:01:13 ctl02 nova-api[11733]: 2017-09-28 12:01:13.093 11733 ERROR nova     max_url_len=max_url_len)
Sep 28 12:01:13 ctl02 nova-api[11733]: 2017-09-28 12:01:13.093 11733 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:01:13 ctl02 nova-api[11733]: 2017-09-28 12:01:13.093 11733 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:01:13 ctl02 nova-api[11733]: 2017-09-28 12:01:13.093 11733 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:01:13 ctl02 nova-api[11733]: 2017-09-28 12:01:13.093 11733 ERROR nova     sock.listen(backlog)
Sep 28 12:01:13 ctl02 nova-api[11733]: 2017-09-28 12:01:13.093 11733 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:01:13 ctl02 nova-api[11733]: 2017-09-28 12:01:13.093 11733 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:01:13 ctl02 nova-api[11733]: 2017-09-28 12:01:13.093 11733 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:01:13 ctl02 nova-api[11733]: 2017-09-28 12:01:13.093 11733 ERROR nova
Sep 28 12:01:13 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:01:13 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:01:13 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:01:13 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:01:13 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:01:13 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:01:13 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:01:13 ctl02 glance-api[29183]: 2017-09-28 12:01:13.918 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:01:13] "OPTIONS / HTTP/1.0" 200 134 0.000754
Sep 28 12:01:14 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemd-run', '--scope', 'apt-get', '-q', '-y', '-o', 'DPkg::Options::=--force-confold', '-o', 'DPkg::Options::=--force-confdef', 'install', 'heat-api-cloudwatch'] in directory '/root'
Sep 28 12:01:14 ctl02 systemd[1]: Started /usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold -o DPkg::Options::=--force-confdef install heat-api-cloudwatch.
Sep 28 12:01:14 ctl02 nova-api[11885]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:01:14 ctl02 nova-api[11885]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:01:15 ctl02 nova-api[11885]: 2017-09-28 12:01:15.085 11885 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:01:15 ctl02 nova-api[11885]: 2017-09-28 12:01:15.086 11885 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:01:15 ctl02 nova-api[11885]: 2017-09-28 12:01:15.086 11885 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:01:15 ctl02 nova-api[11885]: 2017-09-28 12:01:15.086 11885 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:01:15 ctl02 nova-api[11885]: 2017-09-28 12:01:15.086 11885 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:01:15 ctl02 nova-api[11885]: 2017-09-28 12:01:15.086 11885 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:01:15 ctl02 nova-api[11885]: 2017-09-28 12:01:15.086 11885 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:01:15 ctl02 nova-api[11885]: 2017-09-28 12:01:15.086 11885 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:01:15 ctl02 nova-api[11885]: 2017-09-28 12:01:15.086 11885 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:01:15 ctl02 nova-api[11885]: 2017-09-28 12:01:15.086 11885 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:01:15 ctl02 nova-api[11885]: 2017-09-28 12:01:15.086 11885 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:01:15 ctl02 nova-api[11885]: 2017-09-28 12:01:15.086 11885 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:01:15 ctl02 nova-api[11885]: 2017-09-28 12:01:15.086 11885 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:01:15 ctl02 nova-api[11885]: 2017-09-28 12:01:15.086 11885 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:01:15 ctl02 nova-api[11885]: 2017-09-28 12:01:15.086 11885 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:01:15 ctl02 nova-api[11885]: 2017-09-28 12:01:15.086 11885 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:01:15 ctl02 nova-api[11885]: 2017-09-28 12:01:15.086 11885 ERROR nova.wsgi     self.filename))
Sep 28 12:01:15 ctl02 nova-api[11885]: 2017-09-28 12:01:15.086 11885 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:01:15 ctl02 nova-api[11885]: 2017-09-28 12:01:15.086 11885 ERROR nova.wsgi
Sep 28 12:01:15 ctl02 nova-api[11885]: 2017-09-28 12:01:15.087 11885 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:01:15 ctl02 nova-api[11885]: 2017-09-28 12:01:15.217 11885 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:01:15 ctl02 nova-api[11885]: 2017-09-28 12:01:15.454 11885 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:01:15 ctl02 nova-api[11885]: 2017-09-28 12:01:15.456 11885 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:01:15 ctl02 nova-api[11885]: 2017-09-28 12:01:15.471 11885 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:01:15 ctl02 nova-api[11885]: 2017-09-28 12:01:15.472 11885 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:01:15 ctl02 nova-api[11885]: 2017-09-28 12:01:15.616 11885 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:01:15 ctl02 nova-api[11885]: 2017-09-28 12:01:15.618 11885 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:01:15 ctl02 nova-api[11885]: 2017-09-28 12:01:15.618 11885 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:01:15 ctl02 nova-api[11885]: 2017-09-28 12:01:15.619 11885 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:01:15 ctl02 nova-api[11885]: 2017-09-28 12:01:15.622 11885 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:01:15 ctl02 nova-api[11885]: 2017-09-28 12:01:15.622 11885 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:01:15 ctl02 nova-api[11885]: 2017-09-28 12:01:15.622 11885 ERROR nova Traceback (most recent call last):
Sep 28 12:01:15 ctl02 nova-api[11885]: 2017-09-28 12:01:15.622 11885 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:01:15 ctl02 nova-api[11885]: 2017-09-28 12:01:15.622 11885 ERROR nova     sys.exit(main())
Sep 28 12:01:15 ctl02 nova-api[11885]: 2017-09-28 12:01:15.622 11885 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:01:15 ctl02 nova-api[11885]: 2017-09-28 12:01:15.622 11885 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:01:15 ctl02 nova-api[11885]: 2017-09-28 12:01:15.622 11885 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:01:15 ctl02 nova-api[11885]: 2017-09-28 12:01:15.622 11885 ERROR nova     max_url_len=max_url_len)
Sep 28 12:01:15 ctl02 nova-api[11885]: 2017-09-28 12:01:15.622 11885 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:01:15 ctl02 nova-api[11885]: 2017-09-28 12:01:15.622 11885 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:01:15 ctl02 nova-api[11885]: 2017-09-28 12:01:15.622 11885 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:01:15 ctl02 nova-api[11885]: 2017-09-28 12:01:15.622 11885 ERROR nova     sock.listen(backlog)
Sep 28 12:01:15 ctl02 nova-api[11885]: 2017-09-28 12:01:15.622 11885 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:01:15 ctl02 nova-api[11885]: 2017-09-28 12:01:15.622 11885 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:01:15 ctl02 nova-api[11885]: 2017-09-28 12:01:15.622 11885 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:01:15 ctl02 nova-api[11885]: 2017-09-28 12:01:15.622 11885 ERROR nova
Sep 28 12:01:15 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:01:15 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:01:15 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:01:15 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:01:15 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:01:15 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:01:15 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:01:16 ctl02 glance-api[29183]: 2017-09-28 12:01:16.741 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:01:16] "OPTIONS / HTTP/1.0" 200 134 0.000623
Sep 28 12:01:17 ctl02 nova-api[11910]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:01:17 ctl02 nova-api[11910]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:01:17 ctl02 nova-api[11910]: 2017-09-28 12:01:17.558 11910 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:01:17 ctl02 nova-api[11910]: 2017-09-28 12:01:17.560 11910 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:01:17 ctl02 nova-api[11910]: 2017-09-28 12:01:17.560 11910 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:01:17 ctl02 nova-api[11910]: 2017-09-28 12:01:17.560 11910 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:01:17 ctl02 nova-api[11910]: 2017-09-28 12:01:17.560 11910 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:01:17 ctl02 nova-api[11910]: 2017-09-28 12:01:17.560 11910 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:01:17 ctl02 nova-api[11910]: 2017-09-28 12:01:17.560 11910 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:01:17 ctl02 nova-api[11910]: 2017-09-28 12:01:17.560 11910 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:01:17 ctl02 nova-api[11910]: 2017-09-28 12:01:17.560 11910 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:01:17 ctl02 nova-api[11910]: 2017-09-28 12:01:17.560 11910 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:01:17 ctl02 nova-api[11910]: 2017-09-28 12:01:17.560 11910 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:01:17 ctl02 nova-api[11910]: 2017-09-28 12:01:17.560 11910 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:01:17 ctl02 nova-api[11910]: 2017-09-28 12:01:17.560 11910 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:01:17 ctl02 nova-api[11910]: 2017-09-28 12:01:17.560 11910 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:01:17 ctl02 nova-api[11910]: 2017-09-28 12:01:17.560 11910 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:01:17 ctl02 nova-api[11910]: 2017-09-28 12:01:17.560 11910 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:01:17 ctl02 nova-api[11910]: 2017-09-28 12:01:17.560 11910 ERROR nova.wsgi     self.filename))
Sep 28 12:01:17 ctl02 nova-api[11910]: 2017-09-28 12:01:17.560 11910 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:01:17 ctl02 nova-api[11910]: 2017-09-28 12:01:17.560 11910 ERROR nova.wsgi
Sep 28 12:01:17 ctl02 nova-api[11910]: 2017-09-28 12:01:17.562 11910 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:01:17 ctl02 nova-consoleauth[5433]: 2017-09-28 12:01:17.613 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:01:17 ctl02 nova-api[11910]: 2017-09-28 12:01:17.695 11910 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:01:17 ctl02 nova-api[11910]: 2017-09-28 12:01:17.927 11910 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:01:17 ctl02 nova-api[11910]: 2017-09-28 12:01:17.930 11910 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:01:17 ctl02 nova-api[11910]: 2017-09-28 12:01:17.931 11910 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:01:17 ctl02 nova-api[11910]: 2017-09-28 12:01:17.931 11910 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:01:18 ctl02 nova-api[11910]: 2017-09-28 12:01:18.063 11910 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:01:18 ctl02 nova-api[11910]: 2017-09-28 12:01:18.065 11910 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:01:18 ctl02 nova-api[11910]: 2017-09-28 12:01:18.066 11910 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:01:18 ctl02 nova-api[11910]: 2017-09-28 12:01:18.066 11910 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:01:18 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x32808c18)
Sep 28 12:01:18 ctl02 nova-api[11910]: 2017-09-28 12:01:18.069 11910 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:01:18 ctl02 nova-api[11910]: 2017-09-28 12:01:18.079 11910 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:01:18 ctl02 nova-api[11910]: 2017-09-28 12:01:18.079 11910 ERROR nova Traceback (most recent call last):
Sep 28 12:01:18 ctl02 nova-api[11910]: 2017-09-28 12:01:18.079 11910 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:01:18 ctl02 nova-api[11910]: 2017-09-28 12:01:18.079 11910 ERROR nova     sys.exit(main())
Sep 28 12:01:18 ctl02 nova-api[11910]: 2017-09-28 12:01:18.079 11910 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:01:18 ctl02 nova-api[11910]: 2017-09-28 12:01:18.079 11910 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:01:18 ctl02 nova-api[11910]: 2017-09-28 12:01:18.079 11910 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:01:18 ctl02 nova-api[11910]: 2017-09-28 12:01:18.079 11910 ERROR nova     max_url_len=max_url_len)
Sep 28 12:01:18 ctl02 nova-api[11910]: 2017-09-28 12:01:18.079 11910 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:01:18 ctl02 nova-api[11910]: 2017-09-28 12:01:18.079 11910 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:01:18 ctl02 nova-api[11910]: 2017-09-28 12:01:18.079 11910 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:01:18 ctl02 nova-api[11910]: 2017-09-28 12:01:18.079 11910 ERROR nova     sock.listen(backlog)
Sep 28 12:01:18 ctl02 nova-api[11910]: 2017-09-28 12:01:18.079 11910 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:01:18 ctl02 nova-api[11910]: 2017-09-28 12:01:18.079 11910 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:01:18 ctl02 nova-api[11910]: 2017-09-28 12:01:18.079 11910 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:01:18 ctl02 nova-api[11910]: 2017-09-28 12:01:18.079 11910 ERROR nova
Sep 28 12:01:18 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:01:18 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:01:18 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:01:18 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:01:18 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:01:18 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:01:18 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:01:19 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x32808c18)
Sep 28 12:01:19 ctl02 glance-api[29183]: 2017-09-28 12:01:19.403 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:01:19] "OPTIONS / HTTP/1.0" 200 134 0.000627
Sep 28 12:01:19 ctl02 nova-api[11982]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:01:19 ctl02 nova-api[11982]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:01:20 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x32808c18)
Sep 28 12:01:20 ctl02 nova-api[11982]: 2017-09-28 12:01:20.122 11982 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:01:20 ctl02 nova-api[11982]: 2017-09-28 12:01:20.123 11982 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:01:20 ctl02 nova-api[11982]: 2017-09-28 12:01:20.123 11982 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:01:20 ctl02 nova-api[11982]: 2017-09-28 12:01:20.123 11982 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:01:20 ctl02 nova-api[11982]: 2017-09-28 12:01:20.123 11982 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:01:20 ctl02 nova-api[11982]: 2017-09-28 12:01:20.123 11982 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:01:20 ctl02 nova-api[11982]: 2017-09-28 12:01:20.123 11982 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:01:20 ctl02 nova-api[11982]: 2017-09-28 12:01:20.123 11982 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:01:20 ctl02 nova-api[11982]: 2017-09-28 12:01:20.123 11982 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:01:20 ctl02 nova-api[11982]: 2017-09-28 12:01:20.123 11982 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:01:20 ctl02 nova-api[11982]: 2017-09-28 12:01:20.123 11982 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:01:20 ctl02 nova-api[11982]: 2017-09-28 12:01:20.123 11982 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:01:20 ctl02 nova-api[11982]: 2017-09-28 12:01:20.123 11982 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:01:20 ctl02 nova-api[11982]: 2017-09-28 12:01:20.123 11982 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:01:20 ctl02 nova-api[11982]: 2017-09-28 12:01:20.123 11982 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:01:20 ctl02 nova-api[11982]: 2017-09-28 12:01:20.123 11982 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:01:20 ctl02 nova-api[11982]: 2017-09-28 12:01:20.123 11982 ERROR nova.wsgi     self.filename))
Sep 28 12:01:20 ctl02 nova-api[11982]: 2017-09-28 12:01:20.123 11982 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:01:20 ctl02 nova-api[11982]: 2017-09-28 12:01:20.123 11982 ERROR nova.wsgi
Sep 28 12:01:20 ctl02 nova-api[11982]: 2017-09-28 12:01:20.125 11982 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:01:20 ctl02 nova-api[11982]: 2017-09-28 12:01:20.256 11982 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:01:20 ctl02 nova-api[11982]: 2017-09-28 12:01:20.487 11982 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:01:20 ctl02 nova-api[11982]: 2017-09-28 12:01:20.490 11982 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:01:20 ctl02 nova-api[11982]: 2017-09-28 12:01:20.490 11982 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:01:20 ctl02 nova-api[11982]: 2017-09-28 12:01:20.490 11982 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:01:20 ctl02 nova-api[11982]: 2017-09-28 12:01:20.622 11982 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:01:20 ctl02 nova-api[11982]: 2017-09-28 12:01:20.625 11982 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:01:20 ctl02 nova-api[11982]: 2017-09-28 12:01:20.626 11982 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:01:20 ctl02 nova-api[11982]: 2017-09-28 12:01:20.627 11982 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:01:20 ctl02 nova-api[11982]: 2017-09-28 12:01:20.630 11982 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:01:20 ctl02 nova-api[11982]: 2017-09-28 12:01:20.631 11982 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:01:20 ctl02 nova-api[11982]: 2017-09-28 12:01:20.631 11982 ERROR nova Traceback (most recent call last):
Sep 28 12:01:20 ctl02 nova-api[11982]: 2017-09-28 12:01:20.631 11982 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:01:20 ctl02 nova-api[11982]: 2017-09-28 12:01:20.631 11982 ERROR nova     sys.exit(main())
Sep 28 12:01:20 ctl02 nova-api[11982]: 2017-09-28 12:01:20.631 11982 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:01:20 ctl02 nova-api[11982]: 2017-09-28 12:01:20.631 11982 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:01:20 ctl02 nova-api[11982]: 2017-09-28 12:01:20.631 11982 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:01:20 ctl02 nova-api[11982]: 2017-09-28 12:01:20.631 11982 ERROR nova     max_url_len=max_url_len)
Sep 28 12:01:20 ctl02 nova-api[11982]: 2017-09-28 12:01:20.631 11982 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:01:20 ctl02 nova-api[11982]: 2017-09-28 12:01:20.631 11982 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:01:20 ctl02 nova-api[11982]: 2017-09-28 12:01:20.631 11982 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:01:20 ctl02 nova-api[11982]: 2017-09-28 12:01:20.631 11982 ERROR nova     sock.listen(backlog)
Sep 28 12:01:20 ctl02 nova-api[11982]: 2017-09-28 12:01:20.631 11982 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:01:20 ctl02 nova-api[11982]: 2017-09-28 12:01:20.631 11982 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:01:20 ctl02 nova-api[11982]: 2017-09-28 12:01:20.631 11982 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:01:20 ctl02 nova-api[11982]: 2017-09-28 12:01:20.631 11982 ERROR nova
Sep 28 12:01:20 ctl02 nova-scheduler[5620]: 2017-09-28 12:01:20.637 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:01:20 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:01:20 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:01:20 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:01:21 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x32808c18)
Sep 28 12:01:21 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:01:21 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:01:21 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:01:21 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:01:21 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928120121717690
Sep 28 12:01:21 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 12083
Sep 28 12:01:21 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928120121717690
Sep 28 12:01:22 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x32808c18)
Sep 28 12:01:22 ctl02 nova-api[12063]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:01:22 ctl02 nova-api[12063]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:01:22 ctl02 nova-api[12063]: 2017-09-28 12:01:22.905 12063 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:01:22 ctl02 nova-api[12063]: 2017-09-28 12:01:22.907 12063 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:01:22 ctl02 nova-api[12063]: 2017-09-28 12:01:22.907 12063 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:01:22 ctl02 nova-api[12063]: 2017-09-28 12:01:22.907 12063 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:01:22 ctl02 nova-api[12063]: 2017-09-28 12:01:22.907 12063 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:01:22 ctl02 nova-api[12063]: 2017-09-28 12:01:22.907 12063 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:01:22 ctl02 nova-api[12063]: 2017-09-28 12:01:22.907 12063 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:01:22 ctl02 nova-api[12063]: 2017-09-28 12:01:22.907 12063 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:01:22 ctl02 nova-api[12063]: 2017-09-28 12:01:22.907 12063 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:01:22 ctl02 nova-api[12063]: 2017-09-28 12:01:22.907 12063 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:01:22 ctl02 nova-api[12063]: 2017-09-28 12:01:22.907 12063 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:01:22 ctl02 nova-api[12063]: 2017-09-28 12:01:22.907 12063 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:01:22 ctl02 nova-api[12063]: 2017-09-28 12:01:22.907 12063 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:01:22 ctl02 nova-api[12063]: 2017-09-28 12:01:22.907 12063 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:01:22 ctl02 nova-api[12063]: 2017-09-28 12:01:22.907 12063 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:01:22 ctl02 nova-api[12063]: 2017-09-28 12:01:22.907 12063 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:01:22 ctl02 nova-api[12063]: 2017-09-28 12:01:22.907 12063 ERROR nova.wsgi     self.filename))
Sep 28 12:01:22 ctl02 nova-api[12063]: 2017-09-28 12:01:22.907 12063 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:01:22 ctl02 nova-api[12063]: 2017-09-28 12:01:22.907 12063 ERROR nova.wsgi
Sep 28 12:01:22 ctl02 nova-api[12063]: 2017-09-28 12:01:22.908 12063 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:01:23 ctl02 nova-api[12063]: 2017-09-28 12:01:23.036 12063 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:01:23 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x32808c18)
Sep 28 12:01:23 ctl02 nova-api[12063]: 2017-09-28 12:01:23.273 12063 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:01:23 ctl02 nova-api[12063]: 2017-09-28 12:01:23.276 12063 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:01:23 ctl02 nova-api[12063]: 2017-09-28 12:01:23.276 12063 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:01:23 ctl02 nova-api[12063]: 2017-09-28 12:01:23.276 12063 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:01:23 ctl02 nova-api[12063]: 2017-09-28 12:01:23.405 12063 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:01:23 ctl02 nova-api[12063]: 2017-09-28 12:01:23.407 12063 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:01:23 ctl02 nova-api[12063]: 2017-09-28 12:01:23.408 12063 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:01:23 ctl02 nova-api[12063]: 2017-09-28 12:01:23.408 12063 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:01:23 ctl02 nova-api[12063]: 2017-09-28 12:01:23.411 12063 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:01:23 ctl02 nova-api[12063]: 2017-09-28 12:01:23.411 12063 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:01:23 ctl02 nova-api[12063]: 2017-09-28 12:01:23.411 12063 ERROR nova Traceback (most recent call last):
Sep 28 12:01:23 ctl02 nova-api[12063]: 2017-09-28 12:01:23.411 12063 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:01:23 ctl02 nova-api[12063]: 2017-09-28 12:01:23.411 12063 ERROR nova     sys.exit(main())
Sep 28 12:01:23 ctl02 nova-api[12063]: 2017-09-28 12:01:23.411 12063 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:01:23 ctl02 nova-api[12063]: 2017-09-28 12:01:23.411 12063 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:01:23 ctl02 nova-api[12063]: 2017-09-28 12:01:23.411 12063 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:01:23 ctl02 nova-api[12063]: 2017-09-28 12:01:23.411 12063 ERROR nova     max_url_len=max_url_len)
Sep 28 12:01:23 ctl02 nova-api[12063]: 2017-09-28 12:01:23.411 12063 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:01:23 ctl02 nova-api[12063]: 2017-09-28 12:01:23.411 12063 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:01:23 ctl02 nova-api[12063]: 2017-09-28 12:01:23.411 12063 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:01:23 ctl02 nova-api[12063]: 2017-09-28 12:01:23.411 12063 ERROR nova     sock.listen(backlog)
Sep 28 12:01:23 ctl02 nova-api[12063]: 2017-09-28 12:01:23.411 12063 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:01:23 ctl02 nova-api[12063]: 2017-09-28 12:01:23.411 12063 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:01:23 ctl02 nova-api[12063]: 2017-09-28 12:01:23.411 12063 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:01:23 ctl02 nova-api[12063]: 2017-09-28 12:01:23.411 12063 ERROR nova
Sep 28 12:01:23 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:01:23 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:01:23 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:01:23 ctl02 glance-api[29183]: 2017-09-28 12:01:23.854 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:01:23] "OPTIONS / HTTP/1.0" 200 134 0.000638
Sep 28 12:01:23 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:01:23 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:01:23 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:01:23 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:01:24 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x32808c18)
Sep 28 12:01:24 ctl02 systemd[1]: Reloading.
Sep 28 12:01:25 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x32808c18)
Sep 28 12:01:25 ctl02 nova-api[12117]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:01:25 ctl02 nova-api[12117]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:01:25 ctl02 nova-api[12117]: 2017-09-28 12:01:25.696 12117 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:01:25 ctl02 nova-api[12117]: 2017-09-28 12:01:25.698 12117 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:01:25 ctl02 nova-api[12117]: 2017-09-28 12:01:25.698 12117 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:01:25 ctl02 nova-api[12117]: 2017-09-28 12:01:25.698 12117 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:01:25 ctl02 nova-api[12117]: 2017-09-28 12:01:25.698 12117 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:01:25 ctl02 nova-api[12117]: 2017-09-28 12:01:25.698 12117 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:01:25 ctl02 nova-api[12117]: 2017-09-28 12:01:25.698 12117 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:01:25 ctl02 nova-api[12117]: 2017-09-28 12:01:25.698 12117 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:01:25 ctl02 nova-api[12117]: 2017-09-28 12:01:25.698 12117 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:01:25 ctl02 nova-api[12117]: 2017-09-28 12:01:25.698 12117 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:01:25 ctl02 nova-api[12117]: 2017-09-28 12:01:25.698 12117 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:01:25 ctl02 nova-api[12117]: 2017-09-28 12:01:25.698 12117 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:01:25 ctl02 nova-api[12117]: 2017-09-28 12:01:25.698 12117 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:01:25 ctl02 nova-api[12117]: 2017-09-28 12:01:25.698 12117 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:01:25 ctl02 nova-api[12117]: 2017-09-28 12:01:25.698 12117 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:01:25 ctl02 nova-api[12117]: 2017-09-28 12:01:25.698 12117 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:01:25 ctl02 nova-api[12117]: 2017-09-28 12:01:25.698 12117 ERROR nova.wsgi     self.filename))
Sep 28 12:01:25 ctl02 nova-api[12117]: 2017-09-28 12:01:25.698 12117 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:01:25 ctl02 nova-api[12117]: 2017-09-28 12:01:25.698 12117 ERROR nova.wsgi
Sep 28 12:01:25 ctl02 nova-api[12117]: 2017-09-28 12:01:25.699 12117 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:01:25 ctl02 nova-api[12117]: 2017-09-28 12:01:25.831 12117 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:01:26 ctl02 nova-api[12117]: 2017-09-28 12:01:26.063 12117 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:01:26 ctl02 nova-api[12117]: 2017-09-28 12:01:26.065 12117 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:01:26 ctl02 nova-api[12117]: 2017-09-28 12:01:26.066 12117 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:01:26 ctl02 nova-api[12117]: 2017-09-28 12:01:26.066 12117 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:01:26 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x32808c18)
Sep 28 12:01:26 ctl02 nova-api[12117]: 2017-09-28 12:01:26.198 12117 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:01:26 ctl02 nova-api[12117]: 2017-09-28 12:01:26.200 12117 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:01:26 ctl02 nova-api[12117]: 2017-09-28 12:01:26.200 12117 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:01:26 ctl02 nova-api[12117]: 2017-09-28 12:01:26.200 12117 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:01:26 ctl02 nova-api[12117]: 2017-09-28 12:01:26.203 12117 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:01:26 ctl02 nova-api[12117]: 2017-09-28 12:01:26.204 12117 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:01:26 ctl02 nova-api[12117]: 2017-09-28 12:01:26.204 12117 ERROR nova Traceback (most recent call last):
Sep 28 12:01:26 ctl02 nova-api[12117]: 2017-09-28 12:01:26.204 12117 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:01:26 ctl02 nova-api[12117]: 2017-09-28 12:01:26.204 12117 ERROR nova     sys.exit(main())
Sep 28 12:01:26 ctl02 nova-api[12117]: 2017-09-28 12:01:26.204 12117 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:01:26 ctl02 nova-api[12117]: 2017-09-28 12:01:26.204 12117 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:01:26 ctl02 nova-api[12117]: 2017-09-28 12:01:26.204 12117 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:01:26 ctl02 nova-api[12117]: 2017-09-28 12:01:26.204 12117 ERROR nova     max_url_len=max_url_len)
Sep 28 12:01:26 ctl02 nova-api[12117]: 2017-09-28 12:01:26.204 12117 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:01:26 ctl02 nova-api[12117]: 2017-09-28 12:01:26.204 12117 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:01:26 ctl02 nova-api[12117]: 2017-09-28 12:01:26.204 12117 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:01:26 ctl02 nova-api[12117]: 2017-09-28 12:01:26.204 12117 ERROR nova     sock.listen(backlog)
Sep 28 12:01:26 ctl02 nova-api[12117]: 2017-09-28 12:01:26.204 12117 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:01:26 ctl02 nova-api[12117]: 2017-09-28 12:01:26.204 12117 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:01:26 ctl02 nova-api[12117]: 2017-09-28 12:01:26.204 12117 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:01:26 ctl02 nova-api[12117]: 2017-09-28 12:01:26.204 12117 ERROR nova
Sep 28 12:01:26 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:01:26 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:01:26 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:01:26 ctl02 glance-api[29183]: 2017-09-28 12:01:26.482 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:01:26] "OPTIONS / HTTP/1.0" 200 134 0.000625
Sep 28 12:01:26 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:01:26 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:01:26 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:01:26 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:01:27 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x32808c18)
Sep 28 12:01:28 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x32808c18)
Sep 28 12:01:28 ctl02 nova-api[12246]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:01:28 ctl02 nova-api[12246]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:01:28 ctl02 nova-api[12246]: 2017-09-28 12:01:28.448 12246 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:01:28 ctl02 nova-api[12246]: 2017-09-28 12:01:28.450 12246 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:01:28 ctl02 nova-api[12246]: 2017-09-28 12:01:28.450 12246 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:01:28 ctl02 nova-api[12246]: 2017-09-28 12:01:28.450 12246 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:01:28 ctl02 nova-api[12246]: 2017-09-28 12:01:28.450 12246 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:01:28 ctl02 nova-api[12246]: 2017-09-28 12:01:28.450 12246 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:01:28 ctl02 nova-api[12246]: 2017-09-28 12:01:28.450 12246 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:01:28 ctl02 nova-api[12246]: 2017-09-28 12:01:28.450 12246 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:01:28 ctl02 nova-api[12246]: 2017-09-28 12:01:28.450 12246 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:01:28 ctl02 nova-api[12246]: 2017-09-28 12:01:28.450 12246 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:01:28 ctl02 nova-api[12246]: 2017-09-28 12:01:28.450 12246 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:01:28 ctl02 nova-api[12246]: 2017-09-28 12:01:28.450 12246 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:01:28 ctl02 nova-api[12246]: 2017-09-28 12:01:28.450 12246 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:01:28 ctl02 nova-api[12246]: 2017-09-28 12:01:28.450 12246 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:01:28 ctl02 nova-api[12246]: 2017-09-28 12:01:28.450 12246 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:01:28 ctl02 nova-api[12246]: 2017-09-28 12:01:28.450 12246 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:01:28 ctl02 nova-api[12246]: 2017-09-28 12:01:28.450 12246 ERROR nova.wsgi     self.filename))
Sep 28 12:01:28 ctl02 nova-api[12246]: 2017-09-28 12:01:28.450 12246 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:01:28 ctl02 nova-api[12246]: 2017-09-28 12:01:28.450 12246 ERROR nova.wsgi
Sep 28 12:01:28 ctl02 nova-api[12246]: 2017-09-28 12:01:28.451 12246 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:01:28 ctl02 nova-api[12246]: 2017-09-28 12:01:28.585 12246 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:01:28 ctl02 nova-api[12246]: 2017-09-28 12:01:28.823 12246 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:01:28 ctl02 nova-api[12246]: 2017-09-28 12:01:28.825 12246 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:01:28 ctl02 nova-api[12246]: 2017-09-28 12:01:28.826 12246 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:01:28 ctl02 nova-api[12246]: 2017-09-28 12:01:28.826 12246 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:01:28 ctl02 systemd[1]: Reloading.
Sep 28 12:01:28 ctl02 systemd[1]: Reloading.
Sep 28 12:01:28 ctl02 nova-api[12246]: 2017-09-28 12:01:28.962 12246 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:01:28 ctl02 nova-api[12246]: 2017-09-28 12:01:28.964 12246 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:01:28 ctl02 nova-api[12246]: 2017-09-28 12:01:28.964 12246 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:01:28 ctl02 nova-api[12246]: 2017-09-28 12:01:28.965 12246 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:01:28 ctl02 nova-api[12246]: 2017-09-28 12:01:28.968 12246 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:01:28 ctl02 nova-api[12246]: 2017-09-28 12:01:28.968 12246 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:01:28 ctl02 nova-api[12246]: 2017-09-28 12:01:28.968 12246 ERROR nova Traceback (most recent call last):
Sep 28 12:01:28 ctl02 nova-api[12246]: 2017-09-28 12:01:28.968 12246 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:01:28 ctl02 nova-api[12246]: 2017-09-28 12:01:28.968 12246 ERROR nova     sys.exit(main())
Sep 28 12:01:28 ctl02 nova-api[12246]: 2017-09-28 12:01:28.968 12246 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:01:28 ctl02 nova-api[12246]: 2017-09-28 12:01:28.968 12246 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:01:28 ctl02 nova-api[12246]: 2017-09-28 12:01:28.968 12246 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:01:28 ctl02 nova-api[12246]: 2017-09-28 12:01:28.968 12246 ERROR nova     max_url_len=max_url_len)
Sep 28 12:01:28 ctl02 nova-api[12246]: 2017-09-28 12:01:28.968 12246 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:01:28 ctl02 nova-api[12246]: 2017-09-28 12:01:28.968 12246 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:01:28 ctl02 nova-api[12246]: 2017-09-28 12:01:28.968 12246 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:01:28 ctl02 nova-api[12246]: 2017-09-28 12:01:28.968 12246 ERROR nova     sock.listen(backlog)
Sep 28 12:01:28 ctl02 nova-api[12246]: 2017-09-28 12:01:28.968 12246 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:01:28 ctl02 nova-api[12246]: 2017-09-28 12:01:28.968 12246 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:01:28 ctl02 nova-api[12246]: 2017-09-28 12:01:28.968 12246 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:01:28 ctl02 nova-api[12246]: 2017-09-28 12:01:28.968 12246 ERROR nova
Sep 28 12:01:28 ctl02 systemd[1]: Reloading.
Sep 28 12:01:29 ctl02 systemd[1]: Starting Heat API...
Sep 28 12:01:29 ctl02 systemd[1]: Started Heat API.
Sep 28 12:01:29 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:01:29 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:01:29 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:01:29 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:01:29 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:01:29 ctl02 systemd[1]: Reloading.
Sep 28 12:01:29 ctl02 glance-api[29183]: 2017-09-28 12:01:29.183 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:01:29] "OPTIONS / HTTP/1.0" 200 134 0.000575
Sep 28 12:01:29 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:01:29 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:01:29 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:01:29 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:01:29 ctl02 salt-minion[14967]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 12:01:29 ctl02 salt-minion[14967]: [INFO    ] Made the following changes:
Sep 28 12:01:29 ctl02 salt-minion[14967]: 'python-magnumclient' changed from 'absent' to '2.0.0-1'
Sep 28 12:01:29 ctl02 salt-minion[14967]: 'python-ceilometerclient' changed from 'absent' to '2.4.0-2'
Sep 28 12:01:29 ctl02 salt-minion[14967]: 'python-manilaclient' changed from 'absent' to '1.8.1-2'
Sep 28 12:01:29 ctl02 salt-minion[14967]: 'python-heatclient' changed from 'absent' to '1.1.0-2'
Sep 28 12:01:29 ctl02 salt-minion[14967]: 'python-zaqarclient' changed from 'absent' to '1.0.0-3'
Sep 28 12:01:29 ctl02 salt-minion[14967]: 'python-senlinclient' changed from 'absent' to '0.4.0-2'
Sep 28 12:01:29 ctl02 salt-minion[14967]: 'python-barbicanclient' changed from 'absent' to '4.0.1-2'
Sep 28 12:01:29 ctl02 salt-minion[14967]: 'heat-api-cloudwatch' changed from 'absent' to '1:6.1.2-0ubuntu1'
Sep 28 12:01:29 ctl02 salt-minion[14967]: 'python-croniter' changed from 'absent' to '0.3.8-1'
Sep 28 12:01:29 ctl02 salt-minion[14967]: 'python-mistralclient' changed from 'absent' to '1:2.0.0-3'
Sep 28 12:01:29 ctl02 salt-minion[14967]: 'heat-common' changed from 'absent' to '1:6.1.2-0ubuntu1'
Sep 28 12:01:29 ctl02 salt-minion[14967]: 'python-designateclient' changed from 'absent' to '2.1.0-2'
Sep 28 12:01:29 ctl02 salt-minion[14967]: 'python-troveclient' changed from 'absent' to '1:2.1.1-2'
Sep 28 12:01:29 ctl02 salt-minion[14967]: 'python-heat' changed from 'absent' to '1:6.1.2-0ubuntu1'
Sep 28 12:01:29 ctl02 salt-minion[14967]: 'python-saharaclient' changed from 'absent' to '0.14.0-2'
Sep 28 12:01:29 ctl02 salt-minion[14967]: 'python-swiftclient' changed from 'absent' to '1:3.0.0-0ubuntu1'
Sep 28 12:01:29 ctl02 salt-minion[14967]: [INFO    ] Loading fresh modules for state activity
Sep 28 12:01:29 ctl02 salt-minion[14967]: [INFO    ] Completed state [heat-api-cloudwatch] at time 12:01:29.668627 duration_in_ms=137489.918
Sep 28 12:01:29 ctl02 salt-minion[14967]: [INFO    ] Running state [heat-api-cfn] at time 12:01:29.674139
Sep 28 12:01:29 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for heat-api-cfn
Sep 28 12:01:29 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemd-run', '--scope', 'apt-get', '-q', '-y', '-o', 'DPkg::Options::=--force-confold', '-o', 'DPkg::Options::=--force-confdef', 'install', 'heat-api-cfn'] in directory '/root'
Sep 28 12:01:29 ctl02 systemd[1]: Started /usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold -o DPkg::Options::=--force-confdef install heat-api-cfn.
Sep 28 12:01:29 ctl02 heat-api-cloudwatch[12377]: 2017-09-28 12:01:29.992 12377 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:01:29 ctl02 heat-api-cloudwatch[12377]: 2017-09-28 12:01:29.992 12377 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:01:29 ctl02 heat-api-cloudwatch[12377]: 2017-09-28 12:01:29.993 12377 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:01:29 ctl02 heat-api-cloudwatch[12377]: 2017-09-28 12:01:29.996 12377 INFO heat.api.cloudwatch [-] Starting Heat CloudWatch API on 0.0.0.0:8003
Sep 28 12:01:29 ctl02 heat-api-cloudwatch[12377]: 2017-09-28 12:01:29.996 12377 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:01:31 ctl02 nova-api[12418]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:01:31 ctl02 nova-api[12418]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:01:31 ctl02 nova-api[12418]: 2017-09-28 12:01:31.190 12418 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:01:31 ctl02 nova-api[12418]: 2017-09-28 12:01:31.192 12418 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:01:31 ctl02 nova-api[12418]: 2017-09-28 12:01:31.192 12418 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:01:31 ctl02 nova-api[12418]: 2017-09-28 12:01:31.192 12418 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:01:31 ctl02 nova-api[12418]: 2017-09-28 12:01:31.192 12418 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:01:31 ctl02 nova-api[12418]: 2017-09-28 12:01:31.192 12418 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:01:31 ctl02 nova-api[12418]: 2017-09-28 12:01:31.192 12418 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:01:31 ctl02 nova-api[12418]: 2017-09-28 12:01:31.192 12418 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:01:31 ctl02 nova-api[12418]: 2017-09-28 12:01:31.192 12418 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:01:31 ctl02 nova-api[12418]: 2017-09-28 12:01:31.192 12418 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:01:31 ctl02 nova-api[12418]: 2017-09-28 12:01:31.192 12418 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:01:31 ctl02 nova-api[12418]: 2017-09-28 12:01:31.192 12418 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:01:31 ctl02 nova-api[12418]: 2017-09-28 12:01:31.192 12418 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:01:31 ctl02 nova-api[12418]: 2017-09-28 12:01:31.192 12418 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:01:31 ctl02 nova-api[12418]: 2017-09-28 12:01:31.192 12418 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:01:31 ctl02 nova-api[12418]: 2017-09-28 12:01:31.192 12418 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:01:31 ctl02 nova-api[12418]: 2017-09-28 12:01:31.192 12418 ERROR nova.wsgi     self.filename))
Sep 28 12:01:31 ctl02 nova-api[12418]: 2017-09-28 12:01:31.192 12418 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:01:31 ctl02 nova-api[12418]: 2017-09-28 12:01:31.192 12418 ERROR nova.wsgi
Sep 28 12:01:31 ctl02 nova-api[12418]: 2017-09-28 12:01:31.193 12418 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:01:31 ctl02 systemd[1]: Reloading.
Sep 28 12:01:31 ctl02 nova-api[12418]: 2017-09-28 12:01:31.328 12418 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:01:31 ctl02 nova-api[12418]: 2017-09-28 12:01:31.557 12418 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:01:31 ctl02 nova-api[12418]: 2017-09-28 12:01:31.560 12418 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:01:31 ctl02 nova-api[12418]: 2017-09-28 12:01:31.561 12418 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:01:31 ctl02 nova-api[12418]: 2017-09-28 12:01:31.561 12418 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:01:31 ctl02 nova-api[12418]: 2017-09-28 12:01:31.693 12418 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:01:31 ctl02 nova-api[12418]: 2017-09-28 12:01:31.695 12418 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:01:31 ctl02 nova-api[12418]: 2017-09-28 12:01:31.700 12418 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:01:31 ctl02 nova-api[12418]: 2017-09-28 12:01:31.700 12418 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:01:31 ctl02 nova-api[12418]: 2017-09-28 12:01:31.704 12418 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:01:31 ctl02 nova-api[12418]: 2017-09-28 12:01:31.704 12418 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:01:31 ctl02 nova-api[12418]: 2017-09-28 12:01:31.704 12418 ERROR nova Traceback (most recent call last):
Sep 28 12:01:31 ctl02 nova-api[12418]: 2017-09-28 12:01:31.704 12418 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:01:31 ctl02 nova-api[12418]: 2017-09-28 12:01:31.704 12418 ERROR nova     sys.exit(main())
Sep 28 12:01:31 ctl02 nova-api[12418]: 2017-09-28 12:01:31.704 12418 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:01:31 ctl02 nova-api[12418]: 2017-09-28 12:01:31.704 12418 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:01:31 ctl02 nova-api[12418]: 2017-09-28 12:01:31.704 12418 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:01:31 ctl02 nova-api[12418]: 2017-09-28 12:01:31.704 12418 ERROR nova     max_url_len=max_url_len)
Sep 28 12:01:31 ctl02 nova-api[12418]: 2017-09-28 12:01:31.704 12418 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:01:31 ctl02 nova-api[12418]: 2017-09-28 12:01:31.704 12418 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:01:31 ctl02 nova-api[12418]: 2017-09-28 12:01:31.704 12418 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:01:31 ctl02 nova-api[12418]: 2017-09-28 12:01:31.704 12418 ERROR nova     sock.listen(backlog)
Sep 28 12:01:31 ctl02 nova-api[12418]: 2017-09-28 12:01:31.704 12418 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:01:31 ctl02 nova-api[12418]: 2017-09-28 12:01:31.704 12418 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:01:31 ctl02 nova-api[12418]: 2017-09-28 12:01:31.704 12418 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:01:31 ctl02 nova-api[12418]: 2017-09-28 12:01:31.704 12418 ERROR nova
Sep 28 12:01:31 ctl02 systemd[1]: Reloading.
Sep 28 12:01:31 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:01:31 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:01:31 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:01:31 ctl02 systemd[1]: Reloading.
Sep 28 12:01:31 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928120131924402
Sep 28 12:01:31 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 12552
Sep 28 12:01:31 ctl02 systemd[1]: Reloading.
Sep 28 12:01:31 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928120131924402
Sep 28 12:01:31 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:01:32 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:01:32 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:01:32 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:01:32 ctl02 systemd[1]: Starting Heat API...
Sep 28 12:01:32 ctl02 systemd[1]: Started Heat API.
Sep 28 12:01:32 ctl02 systemd[1]: Reloading.
Sep 28 12:01:32 ctl02 salt-minion[14967]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 12:01:32 ctl02 salt-minion[14967]: [INFO    ] Made the following changes:
Sep 28 12:01:32 ctl02 salt-minion[14967]: 'heat-api-cfn' changed from 'absent' to '1:6.1.2-0ubuntu1'
Sep 28 12:01:32 ctl02 salt-minion[14967]: [INFO    ] Loading fresh modules for state activity
Sep 28 12:01:32 ctl02 salt-minion[14967]: [INFO    ] Completed state [heat-api-cfn] at time 12:01:32.691120 duration_in_ms=3016.98
Sep 28 12:01:32 ctl02 salt-minion[14967]: [INFO    ] Running state [python-heatclient] at time 12:01:32.695642
Sep 28 12:01:32 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for python-heatclient
Sep 28 12:01:32 ctl02 salt-minion[14967]: [INFO    ] Package python-heatclient is already installed
Sep 28 12:01:32 ctl02 salt-minion[14967]: [INFO    ] Completed state [python-heatclient] at time 12:01:32.905266 duration_in_ms=209.624
Sep 28 12:01:32 ctl02 salt-minion[14967]: [INFO    ] Running state [heat-common] at time 12:01:32.905443
Sep 28 12:01:32 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for heat-common
Sep 28 12:01:32 ctl02 salt-minion[14967]: [INFO    ] Package heat-common is already installed
Sep 28 12:01:32 ctl02 salt-minion[14967]: [INFO    ] Completed state [heat-common] at time 12:01:32.908469 duration_in_ms=3.025
Sep 28 12:01:32 ctl02 salt-minion[14967]: [INFO    ] Running state [gettext-base] at time 12:01:32.908625
Sep 28 12:01:32 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for gettext-base
Sep 28 12:01:32 ctl02 salt-minion[14967]: [INFO    ] Package gettext-base is already installed
Sep 28 12:01:32 ctl02 salt-minion[14967]: [INFO    ] Completed state [gettext-base] at time 12:01:32.911628 duration_in_ms=3.003
Sep 28 12:01:32 ctl02 salt-minion[14967]: [INFO    ] Running state [heat-engine] at time 12:01:32.911785
Sep 28 12:01:32 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for heat-engine
Sep 28 12:01:32 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemd-run', '--scope', 'apt-get', '-q', '-y', '-o', 'DPkg::Options::=--force-confold', '-o', 'DPkg::Options::=--force-confdef', 'install', 'heat-engine'] in directory '/root'
Sep 28 12:01:32 ctl02 systemd[1]: Started /usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold -o DPkg::Options::=--force-confdef install heat-engine.
Sep 28 12:01:32 ctl02 heat-api-cfn[12599]: 2017-09-28 12:01:32.976 12599 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:01:32 ctl02 heat-api-cfn[12599]: 2017-09-28 12:01:32.977 12599 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:01:32 ctl02 heat-api-cfn[12599]: 2017-09-28 12:01:32.978 12599 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:01:32 ctl02 heat-api-cfn[12599]: 2017-09-28 12:01:32.981 12599 INFO heat.api.cfn [-] Starting Heat API on 0.0.0.0:8000
Sep 28 12:01:32 ctl02 heat-api-cfn[12599]: 2017-09-28 12:01:32.981 12599 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:01:33 ctl02 nova-api[12584]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:01:33 ctl02 nova-api[12584]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:01:33 ctl02 glance-api[29183]: 2017-09-28 12:01:33.763 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:01:33] "OPTIONS / HTTP/1.0" 200 134 0.000571
Sep 28 12:01:33 ctl02 nova-api[12584]: 2017-09-28 12:01:33.808 12584 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:01:33 ctl02 nova-api[12584]: 2017-09-28 12:01:33.809 12584 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:01:33 ctl02 nova-api[12584]: 2017-09-28 12:01:33.809 12584 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:01:33 ctl02 nova-api[12584]: 2017-09-28 12:01:33.809 12584 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:01:33 ctl02 nova-api[12584]: 2017-09-28 12:01:33.809 12584 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:01:33 ctl02 nova-api[12584]: 2017-09-28 12:01:33.809 12584 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:01:33 ctl02 nova-api[12584]: 2017-09-28 12:01:33.809 12584 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:01:33 ctl02 nova-api[12584]: 2017-09-28 12:01:33.809 12584 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:01:33 ctl02 nova-api[12584]: 2017-09-28 12:01:33.809 12584 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:01:33 ctl02 nova-api[12584]: 2017-09-28 12:01:33.809 12584 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:01:33 ctl02 nova-api[12584]: 2017-09-28 12:01:33.809 12584 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:01:33 ctl02 nova-api[12584]: 2017-09-28 12:01:33.809 12584 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:01:33 ctl02 nova-api[12584]: 2017-09-28 12:01:33.809 12584 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:01:33 ctl02 nova-api[12584]: 2017-09-28 12:01:33.809 12584 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:01:33 ctl02 nova-api[12584]: 2017-09-28 12:01:33.809 12584 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:01:33 ctl02 nova-api[12584]: 2017-09-28 12:01:33.809 12584 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:01:33 ctl02 nova-api[12584]: 2017-09-28 12:01:33.809 12584 ERROR nova.wsgi     self.filename))
Sep 28 12:01:33 ctl02 nova-api[12584]: 2017-09-28 12:01:33.809 12584 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:01:33 ctl02 nova-api[12584]: 2017-09-28 12:01:33.809 12584 ERROR nova.wsgi
Sep 28 12:01:33 ctl02 nova-api[12584]: 2017-09-28 12:01:33.810 12584 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:01:33 ctl02 nova-api[12584]: 2017-09-28 12:01:33.936 12584 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:01:34 ctl02 nova-api[12584]: 2017-09-28 12:01:34.166 12584 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:01:34 ctl02 nova-api[12584]: 2017-09-28 12:01:34.168 12584 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:01:34 ctl02 nova-api[12584]: 2017-09-28 12:01:34.172 12584 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:01:34 ctl02 nova-api[12584]: 2017-09-28 12:01:34.172 12584 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:01:34 ctl02 systemd[1]: Reloading.
Sep 28 12:01:34 ctl02 nova-api[12584]: 2017-09-28 12:01:34.325 12584 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:01:34 ctl02 nova-api[12584]: 2017-09-28 12:01:34.326 12584 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:01:34 ctl02 nova-api[12584]: 2017-09-28 12:01:34.327 12584 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:01:34 ctl02 nova-api[12584]: 2017-09-28 12:01:34.327 12584 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:01:34 ctl02 nova-api[12584]: 2017-09-28 12:01:34.330 12584 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:01:34 ctl02 nova-api[12584]: 2017-09-28 12:01:34.331 12584 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:01:34 ctl02 nova-api[12584]: 2017-09-28 12:01:34.331 12584 ERROR nova Traceback (most recent call last):
Sep 28 12:01:34 ctl02 nova-api[12584]: 2017-09-28 12:01:34.331 12584 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:01:34 ctl02 nova-api[12584]: 2017-09-28 12:01:34.331 12584 ERROR nova     sys.exit(main())
Sep 28 12:01:34 ctl02 nova-api[12584]: 2017-09-28 12:01:34.331 12584 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:01:34 ctl02 nova-api[12584]: 2017-09-28 12:01:34.331 12584 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:01:34 ctl02 nova-api[12584]: 2017-09-28 12:01:34.331 12584 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:01:34 ctl02 nova-api[12584]: 2017-09-28 12:01:34.331 12584 ERROR nova     max_url_len=max_url_len)
Sep 28 12:01:34 ctl02 nova-api[12584]: 2017-09-28 12:01:34.331 12584 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:01:34 ctl02 nova-api[12584]: 2017-09-28 12:01:34.331 12584 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:01:34 ctl02 nova-api[12584]: 2017-09-28 12:01:34.331 12584 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:01:34 ctl02 nova-api[12584]: 2017-09-28 12:01:34.331 12584 ERROR nova     sock.listen(backlog)
Sep 28 12:01:34 ctl02 nova-api[12584]: 2017-09-28 12:01:34.331 12584 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:01:34 ctl02 nova-api[12584]: 2017-09-28 12:01:34.331 12584 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:01:34 ctl02 nova-api[12584]: 2017-09-28 12:01:34.331 12584 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:01:34 ctl02 nova-api[12584]: 2017-09-28 12:01:34.331 12584 ERROR nova
Sep 28 12:01:34 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:01:34 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:01:34 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:01:34 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:01:34 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:01:34 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:01:34 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:01:34 ctl02 systemd[1]: Reloading.
Sep 28 12:01:34 ctl02 systemd[1]: message repeated 2 times: [ Reloading.]
Sep 28 12:01:35 ctl02 systemd[1]: Starting Heat Engine...
Sep 28 12:01:35 ctl02 systemd[1]: Started Heat Engine.
Sep 28 12:01:35 ctl02 systemd[1]: Reloading.
Sep 28 12:01:35 ctl02 salt-minion[14967]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 12:01:35 ctl02 salt-minion[14967]: [INFO    ] Made the following changes:
Sep 28 12:01:35 ctl02 salt-minion[14967]: 'heat-engine' changed from 'absent' to '1:6.1.2-0ubuntu1'
Sep 28 12:01:35 ctl02 salt-minion[14967]: [INFO    ] Loading fresh modules for state activity
Sep 28 12:01:35 ctl02 salt-minion[14967]: [INFO    ] Completed state [heat-engine] at time 12:01:35.636509 duration_in_ms=2724.724
Sep 28 12:01:35 ctl02 salt-minion[14967]: [INFO    ] Running state [heat-api] at time 12:01:35.641363
Sep 28 12:01:35 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for heat-api
Sep 28 12:01:35 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemd-run', '--scope', 'apt-get', '-q', '-y', '-o', 'DPkg::Options::=--force-confold', '-o', 'DPkg::Options::=--force-confdef', 'install', 'heat-api'] in directory '/root'
Sep 28 12:01:35 ctl02 systemd[1]: Started /usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold -o DPkg::Options::=--force-confdef install heat-api.
Sep 28 12:01:35 ctl02 heat-engine[12803]: 2017-09-28 12:01:35.936 12803 WARNING heat.common.config [-] stack_user_domain_id or stack_user_domain_name not set in heat.conf falling back to using default
Sep 28 12:01:35 ctl02 heat-engine[12803]: 2017-09-28 12:01:35.956 12803 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.179 12803 WARNING heat.engine.environment [-] OS::Heat::HARestarter is DEPRECATED. The HARestarter resource type is deprecated and will be removed in a future release of Heat, once it has support for auto-healing any type of resource. Note that HARestarter does *not* actually restart servers - it deletes and then recreates them. It also does the same to all dependent resources, and may therefore exhibit unexpected and undesirable behaviour. Avoid.
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.180 12803 WARNING heat.engine.environment [-] OS::Heat::SoftwareDeployments is DEPRECATED. Use of this resource is discouraged. Please use OS::Heat::SoftwareDeploymentGroup instead.
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.180 12803 WARNING heat.engine.environment [-] OS::Heat::StructuredDeployments is DEPRECATED. Use of this resource is discouraged. Please use OS::Heat::StructuredDeploymentGroup instead.
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.181 12803 WARNING heat.engine.environment [-] OS::Neutron::ExtraRoute is UNSUPPORTED. Use this resource at your own risk.
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.181 12803 WARNING heat.engine.environment [-] OS::Neutron::RouterGateway is HIDDEN. Use the `external_gateway_info` property in the router resource to set up the gateway.
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.182 12803 INFO heat.engine.environment [-] Loading /etc/heat/environment.d/default.yaml
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.183 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) AWS::EC2::Instance -> <class 'heat.engine.resources.aws.ec2.instance.Instance'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.183 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Heat::AccessPolicy -> <class 'heat.engine.resources.openstack.heat.access_policy.AccessPolicy'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.184 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Heat::ScalingPolicy -> <class 'heat.engine.resources.openstack.heat.scaling_policy.AutoScalingPolicy'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.184 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) AWS::CloudFormation::Stack -> <class 'heat.engine.resources.aws.cfn.stack.NestedStack'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.184 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Keystone::Group -> <class 'heat.engine.resources.openstack.keystone.group.KeystoneGroup'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.184 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Glance::Image -> <class 'heat.engine.resources.openstack.glance.image.GlanceImage'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.185 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) AWS::EC2::Volume -> <class 'heat.engine.resources.aws.ec2.volume.Volume'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.185 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Keystone::UserRoleAssignment -> <class 'heat.engine.resources.openstack.keystone.role_assignments.KeystoneUserRoleAssignment'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.185 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Neutron::IPsecPolicy -> <class 'heat.engine.resources.openstack.neutron.vpnservice.IPsecPolicy'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.185 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Senlin::Policy -> <class 'heat.engine.resources.openstack.senlin.policy.Policy'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.186 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Heat::SoftwareDeployment -> <class 'heat.engine.resources.openstack.heat.software_deployment.SoftwareDeployment'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.186 12803 INFO heat.engine.environment [-] Registered: [Wildcard Mapping](User:False) OS::Quantum* -> OS::Neutron*
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.186 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Barbican::Order -> <class 'heat.engine.resources.openstack.barbican.order.Order'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.186 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Heat::SwiftSignal -> <class 'heat.engine.resources.openstack.heat.swiftsignal.SwiftSignal'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.187 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) AWS::AutoScaling::ScalingPolicy -> <class 'heat.engine.resources.aws.autoscaling.scaling_policy.AWSScalingPolicy'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.187 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Neutron::QoSPolicy -> <class 'heat.engine.resources.openstack.neutron.qos.QoSPolicy'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.187 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Neutron::HealthMonitor -> <class 'heat.engine.resources.openstack.neutron.loadbalancer.HealthMonitor'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.187 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Ceilometer::GnocchiAggregationByResourcesAlarm -> <class 'heat.engine.resources.openstack.ceilometer.gnocchi.alarm.CeilometerGnocchiAggregationByResourcesAlarm'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.188 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Ceilometer::GnocchiAggregationByMetricsAlarm -> <class 'heat.engine.resources.openstack.ceilometer.gnocchi.alarm.CeilometerGnocchiAggregationByMetricsAlarm'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.188 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Neutron::LoadBalancer -> <class 'heat.engine.resources.openstack.neutron.loadbalancer.LoadBalancer'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.188 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) AWS::EC2::InternetGateway -> <class 'heat.engine.resources.aws.ec2.internet_gateway.InternetGateway'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.188 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Neutron::FloatingIPAssociation -> <class 'heat.engine.resources.openstack.neutron.floatingip.FloatingIPAssociation'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.189 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Neutron::FloatingIP -> <class 'heat.engine.resources.openstack.neutron.floatingip.FloatingIP'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.189 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Neutron::Router -> <class 'heat.engine.resources.openstack.neutron.router.Router'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.189 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Heat::SoftwareDeployments -> <class 'heat.engine.resources.openstack.heat.software_deployment.SoftwareDeployments'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.189 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Neutron::RouterGateway -> <class 'heat.engine.resources.openstack.neutron.router.RouterGateway'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.190 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) AWS::EC2::SubnetRouteTableAssociation -> <class 'heat.engine.resources.aws.ec2.route_table.SubnetRouteTableAssociation'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.190 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) AWS::EC2::VolumeAttachment -> <class 'heat.engine.resources.aws.ec2.volume.VolumeAttachment'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.190 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) AWS::CloudFormation::WaitConditionHandle -> <class 'heat.engine.resources.aws.cfn.wait_condition_handle.WaitConditionHandle'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.190 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Cinder::VolumeAttachment -> <class 'heat.engine.resources.openstack.cinder.volume.CinderVolumeAttachment'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.191 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Neutron::FirewallRule -> <class 'heat.engine.resources.openstack.neutron.firewall.FirewallRule'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.191 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Cinder::EncryptedVolumeType -> <class 'heat.engine.resources.openstack.cinder.encrypted_volume_type.CinderEncryptedVolumeType'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.191 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Heat::AutoScalingGroup -> <class 'heat.engine.resources.openstack.heat.autoscaling_group.AutoScalingResourceGroup'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.191 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Nova::FloatingIP -> <class 'heat.engine.resources.openstack.nova.floatingip.NovaFloatingIp'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.192 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Neutron::SubnetPool -> <class 'heat.engine.resources.openstack.neutron.subnetpool.SubnetPool'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.192 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Heat::HARestarter -> <class 'heat.engine.resources.openstack.heat.ha_restarter.Restarter'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.192 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Keystone::Project -> <class 'heat.engine.resources.openstack.keystone.project.KeystoneProject'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.193 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Keystone::Endpoint -> <class 'heat.engine.resources.openstack.keystone.endpoint.KeystoneEndpoint'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.193 12803 INFO heat.engine.environment [-] Registered: [Mapping](User:False) OS::Metering::Alarm -> OS::Ceilometer::Alarm
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.193 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Neutron::MeteringLabel -> <class 'heat.engine.resources.openstack.neutron.metering.MeteringLabel'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.193 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Magnum::Bay -> <class 'heat.engine.resources.openstack.magnum.bay.Bay'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.194 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Neutron::LBaaS::Listener -> <class 'heat.engine.resources.openstack.neutron.lbaas.listener.Listener'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.194 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Neutron::SecurityGroup -> <class 'heat.engine.resources.openstack.neutron.security_group.SecurityGroup'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.194 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Heat::InstanceGroup -> <class 'heat.engine.resources.openstack.heat.instance_group.InstanceGroup'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.194 12803 INFO heat.engine.environment [-] Registered: [Template](User:False) AWS::CloudWatch::Alarm -> file:///etc/heat/templates/AWS_CloudWatch_Alarm.yaml
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.195 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) AWS::AutoScaling::AutoScalingGroup -> <class 'heat.engine.resources.aws.autoscaling.autoscaling_group.AutoScalingGroup'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.195 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Heat::None -> <class 'heat.engine.resources.openstack.heat.none_resource.NoneResource'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.195 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Heat::CloudConfig -> <class 'heat.engine.resources.openstack.heat.cloud_config.CloudConfig'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.195 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Neutron::ExtraRoute -> <class 'heat.engine.resources.openstack.neutron.extraroute.ExtraRoute'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.196 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Neutron::PoolMember -> <class 'heat.engine.resources.openstack.neutron.loadbalancer.PoolMember'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.196 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Sahara::Cluster -> <class 'heat.engine.resources.openstack.sahara.cluster.SaharaCluster'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.196 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Sahara::DataSource -> <class 'heat.engine.resources.openstack.sahara.data_source.DataSource'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.196 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Heat::ResourceChain -> <class 'heat.engine.resources.openstack.heat.resource_chain.ResourceChain'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.197 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Heat::SoftwareComponent -> <class 'heat.engine.resources.openstack.heat.software_component.SoftwareComponent'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.197 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Sahara::NodeGroupTemplate -> <class 'heat.engine.resources.openstack.sahara.templates.SaharaNodeGroupTemplate'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.197 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Ceilometer::Alarm -> <class 'heat.engine.resources.openstack.ceilometer.alarm.CeilometerAlarm'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.197 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Neutron::LBaaS::PoolMember -> <class 'heat.engine.resources.openstack.neutron.lbaas.pool_member.PoolMember'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.198 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Manila::ShareNetwork -> <class 'heat.engine.resources.openstack.manila.share_network.ManilaShareNetwork'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.198 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Neutron::IKEPolicy -> <class 'heat.engine.resources.openstack.neutron.vpnservice.IKEPolicy'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.198 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) AWS::EC2::VPC -> <class 'heat.engine.resources.aws.ec2.vpc.VPC'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.198 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Barbican::GenericContainer -> <class 'heat.engine.resources.openstack.barbican.container.GenericContainer'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.199 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Cinder::Volume -> <class 'heat.engine.resources.openstack.cinder.volume.CinderVolume'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.199 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Keystone::Service -> <class 'heat.engine.resources.openstack.keystone.service.KeystoneService'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.199 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Heat::WaitConditionHandle -> <class 'heat.engine.resources.openstack.heat.wait_condition_handle.HeatWaitConditionHandle'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.199 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Sahara::ClusterTemplate -> <class 'heat.engine.resources.openstack.sahara.templates.SaharaClusterTemplate'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.200 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Heat::SoftwareConfig -> <class 'heat.engine.resources.openstack.heat.software_config.SoftwareConfig'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.200 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Heat::TestResource -> <class 'heat.engine.resources.openstack.heat.test_resource.TestResource'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.200 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) AWS::EC2::VPCGatewayAttachment -> <class 'heat.engine.resources.aws.ec2.internet_gateway.VPCGatewayAttachment'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.200 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) AWS::CloudFormation::WaitCondition -> <class 'heat.engine.resources.aws.cfn.wait_condition.WaitCondition'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.201 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Manila::ShareType -> <class 'heat.engine.resources.openstack.manila.share_type.ManilaShareType'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.201 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) AWS::S3::Bucket -> <class 'heat.engine.resources.aws.s3.s3.S3Bucket'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.201 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Designate::Record -> <class 'heat.engine.resources.openstack.designate.record.DesignateRecord'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.201 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Neutron::FirewallPolicy -> <class 'heat.engine.resources.openstack.neutron.firewall.FirewallPolicy'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.202 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) AWS::EC2::RouteTable -> <class 'heat.engine.resources.aws.ec2.route_table.RouteTable'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.202 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Heat::StructuredDeploymentGroup -> <class 'heat.engine.resources.openstack.heat.structured_config.StructuredDeploymentGroup'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.202 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Heat::SwiftSignalHandle -> <class 'heat.engine.resources.openstack.heat.swiftsignal.SwiftSignalHandle'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.202 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Neutron::Port -> <class 'heat.engine.resources.openstack.neutron.port.Port'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.203 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Heat::RandomString -> <class 'heat.engine.resources.openstack.heat.random_string.RandomString'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.203 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Heat::SoftwareDeploymentGroup -> <class 'heat.engine.resources.openstack.heat.software_deployment.SoftwareDeploymentGroup'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.203 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Trove::Cluster -> <class 'heat.engine.resources.openstack.trove.cluster.TroveCluster'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.203 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) AWS::EC2::Subnet -> <class 'heat.engine.resources.aws.ec2.subnet.Subnet'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.204 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Trove::Instance -> <class 'heat.engine.resources.openstack.trove.os_database.OSDBInstance'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.204 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Nova::KeyPair -> <class 'heat.engine.resources.openstack.nova.keypair.KeyPair'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.204 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Neutron::ProviderNet -> <class 'heat.engine.resources.openstack.neutron.provider_net.ProviderNet'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.204 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Heat::MultipartMime -> <class 'heat.engine.resources.openstack.heat.multi_part.MultipartMime'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.205 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Heat::UpdateWaitConditionHandle -> <class 'heat.engine.resources.openstack.heat.wait_condition_handle.UpdateWaitConditionHandle'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.205 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Nova::Server -> <class 'heat.engine.resources.openstack.nova.server.Server'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.205 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Magnum::BayModel -> <class 'heat.engine.resources.openstack.magnum.baymodel.BayModel'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.205 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Barbican::Secret -> <class 'heat.engine.resources.openstack.barbican.secret.Secret'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.206 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) AWS::IAM::AccessKey -> <class 'heat.engine.resources.aws.iam.user.AccessKey'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.206 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Ceilometer::CombinationAlarm -> <class 'heat.engine.resources.openstack.ceilometer.alarm.CombinationAlarm'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.206 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) AWS::EC2::SecurityGroup -> <class 'heat.engine.resources.aws.ec2.security_group.SecurityGroup'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.206 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Neutron::Net -> <class 'heat.engine.resources.openstack.neutron.net.Net'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.207 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Manila::Share -> <class 'heat.engine.resources.openstack.manila.share.ManilaShare'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.207 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Neutron::LBaaS::LoadBalancer -> <class 'heat.engine.resources.openstack.neutron.lbaas.loadbalancer.LoadBalancer'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.207 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) AWS::EC2::EIPAssociation -> <class 'heat.engine.resources.aws.ec2.eip.ElasticIpAssociation'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.207 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Neutron::NetworkGateway -> <class 'heat.engine.resources.openstack.neutron.network_gateway.NetworkGateway'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.208 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Senlin::Node -> <class 'heat.engine.resources.openstack.senlin.node.Node'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.208 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Neutron::Firewall -> <class 'heat.engine.resources.openstack.neutron.firewall.Firewall'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.208 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) AWS::EC2::EIP -> <class 'heat.engine.resources.aws.ec2.eip.ElasticIp'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.208 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Neutron::LBaaS::Pool -> <class 'heat.engine.resources.openstack.neutron.lbaas.pool.Pool'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.209 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Neutron::LBaaS::HealthMonitor -> <class 'heat.engine.resources.openstack.neutron.lbaas.health_monitor.HealthMonitor'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.209 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) AWS::EC2::NetworkInterface -> <class 'heat.engine.resources.aws.ec2.network_interface.NetworkInterface'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.209 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) AWS::IAM::User -> <class 'heat.engine.resources.aws.iam.user.User'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.209 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Keystone::Region -> <class 'heat.engine.resources.openstack.keystone.region.KeystoneRegion'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.210 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Heat::WaitCondition -> <class 'heat.engine.resources.openstack.heat.wait_condition.HeatWaitCondition'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.210 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Heat::StructuredDeployment -> <class 'heat.engine.resources.openstack.heat.structured_config.StructuredDeployment'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.210 12803 INFO heat.engine.environment [-] Registered: [Template](User:False) AWS::RDS::DBInstance -> file:///etc/heat/templates/AWS_RDS_DBInstance.yaml
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.210 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Neutron::MeteringRule -> <class 'heat.engine.resources.openstack.neutron.metering.MeteringRule'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.211 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Barbican::RSAContainer -> <class 'heat.engine.resources.openstack.barbican.container.RSAContainer'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.211 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Swift::Container -> <class 'heat.engine.resources.openstack.swift.swift.SwiftContainer'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.211 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Manila::SecurityService -> <class 'heat.engine.resources.openstack.manila.security_service.SecurityService'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.212 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) AWS::AutoScaling::LaunchConfiguration -> <class 'heat.engine.resources.aws.autoscaling.launch_config.LaunchConfiguration'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.212 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Zaqar::Queue -> <class 'heat.engine.resources.openstack.zaqar.queue.ZaqarQueue'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.212 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Neutron::RouterInterface -> <class 'heat.engine.resources.openstack.neutron.router.RouterInterface'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.212 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Mistral::Workflow -> <class 'heat.engine.resources.openstack.mistral.workflow.Workflow'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.213 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Heat::Stack -> <class 'heat.engine.resources.openstack.heat.remote_stack.RemoteStack'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.213 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Nova::FloatingIPAssociation -> <class 'heat.engine.resources.openstack.nova.floatingip.NovaFloatingIpAssociation'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.213 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Heat::ResourceGroup -> <class 'heat.engine.resources.openstack.heat.resource_group.ResourceGroup'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.213 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Heat::StructuredConfig -> <class 'heat.engine.resources.openstack.heat.structured_config.StructuredConfig'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.214 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Neutron::RBACPolicy -> <class 'heat.engine.resources.openstack.neutron.rbac_policy.RBACPolicy'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.214 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Neutron::VPNService -> <class 'heat.engine.resources.openstack.neutron.vpnservice.VPNService'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.214 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Senlin::Cluster -> <class 'heat.engine.resources.openstack.senlin.cluster.Cluster'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.214 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Sahara::ImageRegistry -> <class 'heat.engine.resources.openstack.sahara.image.SaharaImageRegistry'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.215 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Designate::Domain -> <class 'heat.engine.resources.openstack.designate.domain.DesignateDomain'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.215 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Barbican::CertificateContainer -> <class 'heat.engine.resources.openstack.barbican.container.CertificateContainer'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.215 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Senlin::Receiver -> <class 'heat.engine.resources.openstack.senlin.receiver.Receiver'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.215 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Nova::ServerGroup -> <class 'heat.engine.resources.openstack.nova.server_group.ServerGroup'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.216 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Heat::StructuredDeployments -> <class 'heat.engine.resources.openstack.heat.structured_config.StructuredDeployments'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.216 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Mistral::CronTrigger -> <class 'heat.engine.resources.openstack.mistral.cron_trigger.CronTrigger'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.216 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Neutron::IPsecSiteConnection -> <class 'heat.engine.resources.openstack.neutron.vpnservice.IPsecSiteConnection'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.216 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Ceilometer::GnocchiResourcesAlarm -> <class 'heat.engine.resources.openstack.ceilometer.gnocchi.alarm.CeilometerGnocchiResourcesAlarm'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.217 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Nova::HostAggregate -> <class 'heat.engine.resources.openstack.nova.host_aggregate.HostAggregate'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.217 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Neutron::Subnet -> <class 'heat.engine.resources.openstack.neutron.subnet.Subnet'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.217 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Senlin::Profile -> <class 'heat.engine.resources.openstack.senlin.profile.Profile'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.217 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Neutron::QoSBandwidthLimitRule -> <class 'heat.engine.resources.openstack.neutron.qos.QoSBandwidthLimitRule'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.218 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Keystone::Role -> <class 'heat.engine.resources.openstack.keystone.role.KeystoneRole'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.218 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Neutron::AddressScope -> <class 'heat.engine.resources.openstack.neutron.address_scope.AddressScope'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.218 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Keystone::User -> <class 'heat.engine.resources.openstack.keystone.user.KeystoneUser'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.218 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) AWS::ElasticLoadBalancing::LoadBalancer -> <class 'heat.engine.resources.aws.lb.loadbalancer.LoadBalancer'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.219 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Nova::Flavor -> <class 'heat.engine.resources.openstack.nova.flavor.NovaFlavor'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.219 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Neutron::Pool -> <class 'heat.engine.resources.openstack.neutron.loadbalancer.Pool'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.219 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Keystone::GroupRoleAssignment -> <class 'heat.engine.resources.openstack.keystone.role_assignments.KeystoneGroupRoleAssignment'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.219 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Cinder::VolumeType -> <class 'heat.engine.resources.openstack.cinder.volume_type.CinderVolumeType'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.220 12803 INFO heat.engine.environment [-] Registered: [Plugin](User:False) OS::Sahara::JobBinary -> <class 'heat.engine.resources.openstack.sahara.job_binary.JobBinary'>
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.220 12803 INFO oslo_service.service [-] Starting 4 workers
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.268 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.301 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.304 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.
Sep 28 12:01:36 ctl02 heat-engine[12803]: 2017-09-28 12:01:36.304 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.
Sep 28 12:01:36 ctl02 nova-api[12723]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:01:36 ctl02 nova-api[12723]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:01:36 ctl02 nova-api[12723]: 2017-09-28 12:01:36.490 12723 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:01:36 ctl02 nova-api[12723]: 2017-09-28 12:01:36.492 12723 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:01:36 ctl02 nova-api[12723]: 2017-09-28 12:01:36.492 12723 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:01:36 ctl02 nova-api[12723]: 2017-09-28 12:01:36.492 12723 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:01:36 ctl02 nova-api[12723]: 2017-09-28 12:01:36.492 12723 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:01:36 ctl02 nova-api[12723]: 2017-09-28 12:01:36.492 12723 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:01:36 ctl02 nova-api[12723]: 2017-09-28 12:01:36.492 12723 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:01:36 ctl02 nova-api[12723]: 2017-09-28 12:01:36.492 12723 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:01:36 ctl02 nova-api[12723]: 2017-09-28 12:01:36.492 12723 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:01:36 ctl02 nova-api[12723]: 2017-09-28 12:01:36.492 12723 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:01:36 ctl02 nova-api[12723]: 2017-09-28 12:01:36.492 12723 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:01:36 ctl02 nova-api[12723]: 2017-09-28 12:01:36.492 12723 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:01:36 ctl02 nova-api[12723]: 2017-09-28 12:01:36.492 12723 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:01:36 ctl02 nova-api[12723]: 2017-09-28 12:01:36.492 12723 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:01:36 ctl02 nova-api[12723]: 2017-09-28 12:01:36.492 12723 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:01:36 ctl02 nova-api[12723]: 2017-09-28 12:01:36.492 12723 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:01:36 ctl02 nova-api[12723]: 2017-09-28 12:01:36.492 12723 ERROR nova.wsgi     self.filename))
Sep 28 12:01:36 ctl02 nova-api[12723]: 2017-09-28 12:01:36.492 12723 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:01:36 ctl02 nova-api[12723]: 2017-09-28 12:01:36.492 12723 ERROR nova.wsgi
Sep 28 12:01:36 ctl02 nova-api[12723]: 2017-09-28 12:01:36.494 12723 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:01:36 ctl02 nova-api[12723]: 2017-09-28 12:01:36.627 12723 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:01:36 ctl02 glance-api[29183]: 2017-09-28 12:01:36.698 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:01:36] "OPTIONS / HTTP/1.0" 200 134 0.000553
Sep 28 12:01:36 ctl02 nova-api[12723]: 2017-09-28 12:01:36.861 12723 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:01:36 ctl02 nova-api[12723]: 2017-09-28 12:01:36.864 12723 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:01:36 ctl02 nova-api[12723]: 2017-09-28 12:01:36.865 12723 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:01:36 ctl02 nova-api[12723]: 2017-09-28 12:01:36.865 12723 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:01:37 ctl02 nova-api[12723]: 2017-09-28 12:01:36.999 12723 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:01:37 ctl02 nova-api[12723]: 2017-09-28 12:01:37.003 12723 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:01:37 ctl02 nova-api[12723]: 2017-09-28 12:01:37.003 12723 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:01:37 ctl02 nova-api[12723]: 2017-09-28 12:01:37.003 12723 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:01:37 ctl02 nova-api[12723]: 2017-09-28 12:01:37.006 12723 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:01:37 ctl02 nova-api[12723]: 2017-09-28 12:01:37.007 12723 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:01:37 ctl02 nova-api[12723]: 2017-09-28 12:01:37.007 12723 ERROR nova Traceback (most recent call last):
Sep 28 12:01:37 ctl02 nova-api[12723]: 2017-09-28 12:01:37.007 12723 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:01:37 ctl02 nova-api[12723]: 2017-09-28 12:01:37.007 12723 ERROR nova     sys.exit(main())
Sep 28 12:01:37 ctl02 nova-api[12723]: 2017-09-28 12:01:37.007 12723 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:01:37 ctl02 nova-api[12723]: 2017-09-28 12:01:37.007 12723 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:01:37 ctl02 nova-api[12723]: 2017-09-28 12:01:37.007 12723 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:01:37 ctl02 nova-api[12723]: 2017-09-28 12:01:37.007 12723 ERROR nova     max_url_len=max_url_len)
Sep 28 12:01:37 ctl02 nova-api[12723]: 2017-09-28 12:01:37.007 12723 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:01:37 ctl02 nova-api[12723]: 2017-09-28 12:01:37.007 12723 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:01:37 ctl02 nova-api[12723]: 2017-09-28 12:01:37.007 12723 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:01:37 ctl02 nova-api[12723]: 2017-09-28 12:01:37.007 12723 ERROR nova     sock.listen(backlog)
Sep 28 12:01:37 ctl02 nova-api[12723]: 2017-09-28 12:01:37.007 12723 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:01:37 ctl02 nova-api[12723]: 2017-09-28 12:01:37.007 12723 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:01:37 ctl02 nova-api[12723]: 2017-09-28 12:01:37.007 12723 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:01:37 ctl02 nova-api[12723]: 2017-09-28 12:01:37.007 12723 ERROR nova
Sep 28 12:01:37 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:01:37 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:01:37 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:01:37 ctl02 systemd[1]: Reloading.
Sep 28 12:01:37 ctl02 heat-engine[12803]: 2017-09-28 12:01:37.274 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
Sep 28 12:01:37 ctl02 heat-engine[12803]: 2017-09-28 12:01:37.309 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
Sep 28 12:01:37 ctl02 heat-engine[12803]: 2017-09-28 12:01:37.309 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
Sep 28 12:01:37 ctl02 heat-engine[12803]: 2017-09-28 12:01:37.312 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
Sep 28 12:01:37 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:01:37 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:01:37 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:01:37 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:01:37 ctl02 systemd[1]: Reloading.
Sep 28 12:01:37 ctl02 systemd[1]: message repeated 2 times: [ Reloading.]
Sep 28 12:01:37 ctl02 systemd[1]: Starting Heat API...
Sep 28 12:01:37 ctl02 systemd[1]: Started Heat API.
Sep 28 12:01:38 ctl02 systemd[1]: Reloading.
Sep 28 12:01:38 ctl02 salt-minion[14967]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 12:01:38 ctl02 salt-minion[14967]: [INFO    ] Made the following changes:
Sep 28 12:01:38 ctl02 salt-minion[14967]: 'heat-api' changed from 'absent' to '1:6.1.2-0ubuntu1'
Sep 28 12:01:38 ctl02 salt-minion[14967]: [INFO    ] Loading fresh modules for state activity
Sep 28 12:01:38 ctl02 salt-minion[14967]: [INFO    ] Completed state [heat-api] at time 12:01:38.566581 duration_in_ms=2925.218
Sep 28 12:01:38 ctl02 salt-minion[14967]: [INFO    ] Running state [/etc/heat/heat.conf] at time 12:01:38.568771
Sep 28 12:01:38 ctl02 salt-minion[14967]: [INFO    ] Executing state file.managed for /etc/heat/heat.conf
Sep 28 12:01:38 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'heat/files/ocata/heat.conf.Debian'
Sep 28 12:01:38 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'heat/map.jinja'
Sep 28 12:01:38 ctl02 salt-minion[14967]: [INFO    ] File changed:
Sep 28 12:01:38 ctl02 salt-minion[14967]: ---
Sep 28 12:01:38 ctl02 salt-minion[14967]: +++
Sep 28 12:01:38 ctl02 salt-minion[14967]: @@ -1,4 +1,272 @@
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]:  [DEFAULT]
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# From heat.api.middleware.ssl
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +region_name_for_services=RegionOne
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# The HTTP Header that will be used to determine what the original request
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# protocol scheme was, even if it was removed by an SSL terminator proxy.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/secure_proxy_ssl_header
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#secure_proxy_ssl_header = X-Forwarded-Proto
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# From heat.common.config
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Name of the engine node. This can be an opaque identifier. It is not
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# necessarily a hostname, FQDN, or IP address. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#host = lgw01-02
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# List of directories to search for plug-ins. (list value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#plugin_dirs = /usr/lib64/heat,/usr/lib/heat,/usr/local/lib/heat,/usr/local/lib64/heat
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# The directory to search for environment files. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#environment_dir = /etc/heat/environment.d
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# The directory to search for template files. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#template_dir = /etc/heat/templates
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Select deferred auth method, stored password or trusts. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Allowed values: password, trusts
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#deferred_auth_method = trusts
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Allow reauthentication on token expiry, such that long-running tasks may
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# complete. Note this defeats the expiry of any provided user tokens. (string
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Allowed values: '', trusts
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#reauthentication_auth_method =
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Gap, in seconds, to determine whether the given token is about to expire.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#stale_token_duration = 30
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Subset of trustor roles to be delegated to heat. If left unset, all roles of
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# a user will be delegated to heat when creating a stack. (list value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#trusts_delegated_roles =
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Maximum resources allowed per top-level stack. -1 stands for unlimited.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#max_resources_per_stack = 1000
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Maximum number of stacks any one tenant may have active at one time. (integer
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#max_stacks_per_tenant = 100
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Number of times to retry to bring a resource to a non-error state. Set to 0
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# to disable retries. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#action_retry_limit = 5
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Number of times to retry when a client encounters an expected intermittent
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# error. Set to 0 to disable retries. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#client_retry_limit = 2
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Maximum length of a server name to be used in nova. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Maximum value: 53
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#max_server_name_length = 53
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Number of times to check whether an interface has been attached or detached.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#max_interface_check_attempts = 10
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Controls how many events will be pruned whenever a stack's events are purged.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Set this lower to keep more events at the expense of more frequent purges.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#event_purge_batch_size = 200
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Rough number of maximum events that will be available per stack. Actual
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# number of events can be a bit higher since purge checks take place randomly
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# 200/event_purge_batch_size percent of the time. Older events are deleted when
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# events are purged. Set to 0 for unlimited events per stack. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#max_events_per_stack = 1000
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Timeout in seconds for stack action (ie. create or update). (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#stack_action_timeout = 3600
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# The amount of time in seconds after an error has occurred that tasks may
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# continue to run before being cancelled. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#error_wait_time = 240
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# RPC timeout for the engine liveness check that is used for stack locking.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#engine_life_check_timeout = 2
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Enable the legacy OS::Heat::CWLiteAlarm resource. (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#enable_cloud_watch_lite = false
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Enable the preview Stack Abandon feature. (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#enable_stack_abandon = false
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Enable the preview Stack Adopt feature. (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#enable_stack_adopt = false
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Enables engine with convergence architecture. All stacks with this option
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# will be created using convergence engine. (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#convergence_engine = true
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# On update, enables heat to collect existing resource properties from reality
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# and converge to updated template. (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#observe_on_update = false
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Template default for how the server should receive the metadata required for
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# software configuration. POLL_SERVER_CFN will allow calls to the cfn API
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# action DescribeStackResource authenticated with the provided keypair
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# (requires enabled heat-api-cfn). POLL_SERVER_HEAT will allow calls to the
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Heat API resource-show using the provided keystone credentials (requires
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# keystone v3 API, and configured stack_user_* config options). POLL_TEMP_URL
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# will create and populate a Swift TempURL with metadata for polling (requires
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# object-store endpoint which supports TempURL).ZAQAR_MESSAGE will create a
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# dedicated zaqar queue and post the metadata for polling. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Allowed values: POLL_SERVER_CFN, POLL_SERVER_HEAT, POLL_TEMP_URL, ZAQAR_MESSAGE
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#default_software_config_transport = POLL_SERVER_CFN
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Template default for how the server should signal to heat with the deployment
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# output values. CFN_SIGNAL will allow an HTTP POST to a CFN keypair signed URL
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# (requires enabled heat-api-cfn). TEMP_URL_SIGNAL will create a Swift TempURL
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# to be signaled via HTTP PUT (requires object-store endpoint which supports
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# TempURL). HEAT_SIGNAL will allow calls to the Heat API resource-signal using
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# the provided keystone credentials. ZAQAR_SIGNAL will create a dedicated zaqar
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# queue to be signaled using the provided keystone credentials. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Allowed values: CFN_SIGNAL, TEMP_URL_SIGNAL, HEAT_SIGNAL, ZAQAR_SIGNAL
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#default_deployment_signal_transport = CFN_SIGNAL
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Template default for how the user_data should be formatted for the server.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# For HEAT_CFNTOOLS, the user_data is bundled as part of the heat-cfntools
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# cloud-init boot configuration data. For RAW the user_data is passed to Nova
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# unmodified. For SOFTWARE_CONFIG user_data is bundled as part of the software
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# config data, and metadata is derived from any associated SoftwareDeployment
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# resources. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Allowed values: HEAT_CFNTOOLS, RAW, SOFTWARE_CONFIG
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#default_user_data_format = HEAT_CFNTOOLS
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Stacks containing these tag names will be hidden. Multiple tags should be
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# given in a comma-delimited list (eg. hidden_stack_tags=hide_me,me_too). (list
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#hidden_stack_tags = data-processing-cluster
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#onready = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# When this feature is enabled, scheduler hints identifying the heat stack
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# context of a server or volume resource are passed to the configured
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# schedulers in nova and cinder, for creates done using heat resource types
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# OS::Cinder::Volume, OS::Nova::Server, and AWS::EC2::Instance.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# heat_root_stack_id will be set to the id of the root stack of the resource,
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# heat_stack_id will be set to the id of the resource's parent stack,
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# heat_stack_name will be set to the name of the resource's parent stack,
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# heat_path_in_stack will be set to a list of comma delimited strings of
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# stackresourcename and stackname with list[0] being 'rootstackname',
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# heat_resource_name will be set to the resource's name, and heat_resource_uuid
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# will be set to the resource's orchestration id. (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#stack_scheduler_hints = false
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Encrypt template parameters that were marked as hidden and also all the
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# resource properties before storing them in database. (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#encrypt_parameters_and_properties = false
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Seconds between running periodic tasks. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#periodic_interval = 60
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# URL of the Heat metadata server. NOTE: Setting this is only needed if you
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# require instances to use a different endpoint than in the keystone catalog
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#heat_metadata_server_url = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +heat_metadata_server_url=https://10.167.4.80:8000
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# URL of the Heat waitcondition server. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#heat_waitcondition_server_url = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +heat_waitcondition_server_url=https://10.167.4.80:8000/v1/waitcondition
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# URL of the Heat CloudWatch server. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#heat_watch_server_url =
Sep 28 12:01:38 ctl02 salt-minion[14967]: +heat_watch_server_url=https://10.167.4.80:8003
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Instance connection to CFN/CW API via https. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#instance_connection_is_secure = 0
Sep 28 12:01:38 ctl02 salt-minion[14967]: +instance_connection_is_secure=0
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Instance connection to CFN/CW API validate certs if SSL is used. (string
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#instance_connection_https_validate_certificates = 1
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Default region name used to get services endpoints. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#region_name_for_services = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Keystone role for heat template-defined users. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#heat_stack_user_role = heat_stack_user
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Keystone domain ID which contains heat template-defined users. If this option
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# is set, stack_user_domain_name option will be ignored. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/stack_user_domain
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#stack_user_domain_id = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Keystone domain name which contains heat template-defined users. If
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# `stack_user_domain_id` option is set, this option is ignored. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#stack_user_domain_name = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Keystone username, a user with roles sufficient to manage
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# users and projects in the stack_user_domain. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +stack_domain_admin = heat_domain_admin
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Keystone password for stack_domain_admin user. (string
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +stack_domain_admin_password=opnfv_secret
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +stack_user_domain_name = heat_user_domain
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Maximum raw byte size of any template. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#max_template_size = 524288
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Maximum depth allowed when using nested stacks. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#max_nested_stack_depth = 5
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Number of heat-engine processes to fork and run. Will default to either to 4
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# or number of CPUs on the host, whichever is greater. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#num_engine_workers = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# From heat.common.crypt
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Key used to encrypt authentication info in the database. Length of this key
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# must be 32 characters. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#auth_encryption_key = notgood but just long enough i t
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# From heat.common.wsgi
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Maximum raw byte size of JSON request body. Should be larger than
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# max_template_size. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#max_json_body_size = 1048576
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# From heat.engine.clients
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Fully qualified class name to use as a client backend. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#cloud_backend = heat.engine.clients.OpenStackClients
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# From heat.engine.notification
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Default notification level for outgoingnotifications. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#default_notification_level = INFO
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Default publisher_id for outgoing notifications. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#default_publisher_id = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# From heat.engine.resources
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Custom template for the built-in loadbalancer nested stack. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#loadbalancer_template = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # From oslo.log
Sep 28 12:01:38 ctl02 salt-minion[14967]: @@ -6,13 +274,15 @@
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # If set to true, the logging level will be set to DEBUG instead of the default
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # INFO level. (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Note: This option can be changed without restarting.
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #debug = false
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# If set to false, the logging level will be set to WARNING instead of the
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# default INFO level. (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# DEPRECATED: If set to false, the logging level will be set to WARNING instead
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# of the default INFO level. (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # This option is deprecated for removal.
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Its value may be silently ignored in the future.
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #verbose = true
Sep 28 12:01:38 ctl02 salt-minion[14967]: +verbose = true
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # The name of a logging configuration file. This file is appended to any
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # existing logging configuration files. For details about logging configuration
Sep 28 12:01:38 ctl02 salt-minion[14967]: @@ -20,6 +290,7 @@
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # configuration files are used then all logging configuration is set in the
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # configuration file and other logging configuration options are ignored (for
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # example, logging_context_format_string). (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Note: This option can be changed without restarting.
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/log_config
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #log_config_append = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]: @@ -33,6 +304,7 @@
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # log_config_append is set. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/logfile
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #log_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +log_file=/var/log/heat/heat.log
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # (Optional) The base directory used for relative log_file  paths. This option
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # is ignored if log_config_append is set. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: @@ -57,7 +329,7 @@
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Log output to standard error. This option is ignored if log_config_append is
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # set. (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: -#use_stderr = true
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#use_stderr = false
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Format string to use for log messages with context. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #logging_context_format_string = %(asctime)s.%(msecs)03d %(process)d %(levelname)s %(name)s [%(request_id)s %(user_identity)s] %(instance)s%(message)s
Sep 28 12:01:38 ctl02 salt-minion[14967]: @@ -92,6 +364,18 @@
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # value)
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #instance_uuid_format = "[instance: %(uuid)s] "
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Interval, number of seconds, of log rate limiting. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#rate_limit_interval = 0
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Maximum number of logged messages per rate_limit_interval. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#rate_limit_burst = 0
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Log level name used by rate limiting: CRITICAL, ERROR, INFO, WARNING, DEBUG
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# or empty string. Logs with level greater or equal to rate_limit_except_level
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# are not filtered. An empty string means that all levels are filtered. (string
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#rate_limit_except_level = CRITICAL
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Enables or disables fatal status of deprecations. (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #fatal_deprecations = false
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]: @@ -103,62 +387,165 @@
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rpc_conn_pool_size
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #rpc_conn_pool_size = 30
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# The pool size limit for connections expiration policy (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#conn_pool_min_size = 2
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# The time-to-live in sec of idle connections in the pool (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#conn_pool_ttl = 1200
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # ZeroMQ bind address. Should be a wildcard (*), an ethernet interface, or IP.
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # The "host" option should point or resolve to this address. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_bind_address
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #rpc_zmq_bind_address = *
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # MatchMaker driver. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# Allowed values: redis, dummy
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Allowed values: redis, sentinel, dummy
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_matchmaker
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #rpc_zmq_matchmaker = redis
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# Type of concurrency used. Either "native" or "eventlet" (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: -#rpc_zmq_concurrency = eventlet
Sep 28 12:01:38 ctl02 salt-minion[14967]: -
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Number of ZeroMQ contexts, defaults to 1. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_contexts
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #rpc_zmq_contexts = 1
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Maximum number of ingress messages to locally buffer per topic. Default is
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # unlimited. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_topic_backlog
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #rpc_zmq_topic_backlog = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Directory for holding IPC sockets. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_ipc_dir
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #rpc_zmq_ipc_dir = /var/run/openstack
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Name of this node. Must be a valid hostname, FQDN, or IP address. Must match
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # "host" option, if running Nova. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_host
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #rpc_zmq_host = localhost
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# Seconds to wait before a cast expires (TTL). The default value of -1
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# specifies an infinite linger period. The value of 0 specifies no linger
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# period. Pending messages shall be discarded immediately when the socket is
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# closed. Only supported by impl_zmq. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: -#rpc_cast_timeout = -1
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Number of seconds to wait before all pending messages will be sent after
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# closing a socket. The default value of -1 specifies an infinite linger
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# period. The value of 0 specifies no linger period. Pending messages shall be
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# discarded immediately when the socket is closed. Positive values specify an
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# upper bound for the linger period. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_cast_timeout
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#zmq_linger = -1
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # The default number of seconds that poll should wait. Poll raises timeout
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # exception when timeout expired. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_poll_timeout
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #rpc_poll_timeout = 1
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Expiration timeout in seconds of a name service record about existing target
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # ( < 0 means no timeout). (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: -#zmq_target_expire = 120
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/zmq_target_expire
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#zmq_target_expire = 300
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Update period in seconds of a name service record about existing target.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/zmq_target_update
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#zmq_target_update = 180
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Use PUB/SUB pattern for fanout methods. PUB/SUB always uses proxy. (boolean
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: -#use_pub_sub = true
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/use_pub_sub
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#use_pub_sub = false
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Use ROUTER remote proxy. (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/use_router_proxy
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#use_router_proxy = false
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# This option makes direct connections dynamic or static. It makes sense only
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# with use_router_proxy=False which means to use direct connections for direct
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# message types (ignored otherwise). (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#use_dynamic_connections = false
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# How many additional connections to a host will be made for failover reasons.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# This option is actual only in dynamic connections mode. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#zmq_failover_connections = 2
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Minimal port number for random ports range. (port value)
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Minimum value: 0
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Maximum value: 65535
Sep 28 12:01:38 ctl02 salt-minion[14967]: -#rpc_zmq_min_port = 49152
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_min_port
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#rpc_zmq_min_port = 49153
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Maximal port number for random ports range. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Minimum value: 1
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Maximum value: 65536
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_max_port
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #rpc_zmq_max_port = 65536
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Number of retries to find free port number before fail with ZMQBindError.
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_bind_port_retries
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #rpc_zmq_bind_port_retries = 100
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Default serialization mechanism for serializing/deserializing
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# outgoing/incoming messages (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Allowed values: json, msgpack
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_serialization
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#rpc_zmq_serialization = json
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# This option configures round-robin mode in zmq socket. True means not keeping
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# a queue when server side disconnects. False means to keep queue and messages
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# even if server is disconnected, when the server appears we send all
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# accumulated messages to it. (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#zmq_immediate = true
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Enable/disable TCP keepalive (KA) mechanism. The default value of -1 (or any
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# other negative value) means to skip any overrides and leave it to OS default;
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# 0 and 1 (or any other positive value) mean to disable and enable the option
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# respectively. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#zmq_tcp_keepalive = -1
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# The duration between two keepalive transmissions in idle condition. The unit
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# is platform dependent, for example, seconds in Linux, milliseconds in Windows
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# etc. The default value of -1 (or any other negative value and 0) means to
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# skip any overrides and leave it to OS default. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#zmq_tcp_keepalive_idle = -1
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# The number of retransmissions to be carried out before declaring that remote
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# end is not available. The default value of -1 (or any other negative value
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# and 0) means to skip any overrides and leave it to OS default. (integer
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#zmq_tcp_keepalive_cnt = -1
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# The duration between two successive keepalive retransmissions, if
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# acknowledgement to the previous keepalive transmission is not received. The
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# unit is platform dependent, for example, seconds in Linux, milliseconds in
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Windows etc. The default value of -1 (or any other negative value and 0)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# means to skip any overrides and leave it to OS default. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#zmq_tcp_keepalive_intvl = -1
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Maximum number of (green) threads to work concurrently. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#rpc_thread_pool_size = 100
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Expiration timeout in seconds of a sent/received message after which it is
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# not tracked anymore by a client/server. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#rpc_message_ttl = 300
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Wait for message acknowledgements from receivers. This mechanism works only
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# via proxy without PUB/SUB. (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#rpc_use_acks = false
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Number of seconds to wait for an ack from a cast/call. After each retry
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# attempt this timeout is multiplied by some specified multiplier. (integer
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#rpc_ack_timeout_base = 15
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Number to multiply base ack timeout by after each retry attempt. (integer
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#rpc_ack_timeout_multiplier = 2
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Default number of message sending attempts in case of any problems occurred:
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# positive value N means at most N retries, 0 means no retries, None or -1 (or
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# any other negative values) mean to retry forever. This option is used only if
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# acknowledgments are enabled. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#rpc_retry_attempts = 3
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# List of publisher hosts SubConsumer can subscribe on. This option has higher
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# priority then the default publishers list taken from the matchmaker. (list
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#subscribe_on =
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Size of executor thread pool. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rpc_thread_pool_size
Sep 28 12:01:38 ctl02 salt-minion[14967]: @@ -166,14 +553,17 @@
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Seconds to wait for a response from a call. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #rpc_response_timeout = 60
Sep 28 12:01:38 ctl02 salt-minion[14967]: -
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# A URL representing the messaging driver to use and its full configuration. If
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# not set, we fall back to the rpc_backend option and driver specific
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# configuration. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +rpc_response_timeout = 600
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# A URL representing the messaging driver to use and its full configuration.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #transport_url = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: -
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# The messaging driver to use, defaults to rabbit. Other drivers include amqp
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# and zmq. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +transport_url = rabbit://openstack:opnfv_secret@10.167.4.41:5672,openstack:opnfv_secret@10.167.4.42:5672,openstack:opnfv_secret@10.167.4.43:5672//openstack
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# DEPRECATED: The messaging driver to use, defaults to rabbit. Other drivers
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# include amqp and zmq. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #rpc_backend = rabbit
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # The default exchange under which topics are scoped. May be overridden by an
Sep 28 12:01:38 ctl02 salt-minion[14967]: @@ -213,6 +603,495 @@
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Specify a timeout after which a gracefully shutdown server will exit. Zero
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # value means endless wait. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #graceful_shutdown_timeout = 60
Sep 28 12:01:38 ctl02 salt-minion[14967]: +max_resources_per_stack=20000
Sep 28 12:01:38 ctl02 salt-minion[14967]: +max_json_body_size=10880000
Sep 28 12:01:38 ctl02 salt-minion[14967]: +max_template_size=5440000
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +[auth_password]
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# From heat.common.config
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Allow orchestration of multiple clouds. (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#multi_cloud = false
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Allowed keystone endpoints for auth_uri when multi_cloud is enabled. At least
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# one endpoint needs to be specified. (list value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#allowed_auth_uris =
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +[clients]
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# From heat.common.config
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Type of endpoint in Identity service catalog to use for communication with
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# the OpenStack service. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#endpoint_type = publicURL
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional CA cert file to use in SSL connections. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#ca_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional PEM-formatted certificate chain file. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#cert_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional PEM-formatted file that contains the private key. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#key_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# If set, then the server's certificate will not be verified. (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#insecure = false
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +[clients_aodh]
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# From heat.common.config
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Type of endpoint in Identity service catalog to use for communication with
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# the OpenStack service. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#endpoint_type = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional CA cert file to use in SSL connections. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#ca_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional PEM-formatted certificate chain file. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#cert_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional PEM-formatted file that contains the private key. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#key_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# If set, then the server's certificate will not be verified. (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#insecure = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +[clients_barbican]
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# From heat.common.config
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Type of endpoint in Identity service catalog to use for communication with
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# the OpenStack service. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#endpoint_type = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional CA cert file to use in SSL connections. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#ca_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional PEM-formatted certificate chain file. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#cert_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional PEM-formatted file that contains the private key. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#key_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# If set, then the server's certificate will not be verified. (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#insecure = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +[clients_ceilometer]
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# From heat.common.config
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Type of endpoint in Identity service catalog to use for communication with
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# the OpenStack service. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#endpoint_type = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional CA cert file to use in SSL connections. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#ca_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional PEM-formatted certificate chain file. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#cert_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional PEM-formatted file that contains the private key. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#key_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# If set, then the server's certificate will not be verified. (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#insecure = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +[clients_cinder]
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# From heat.common.config
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Type of endpoint in Identity service catalog to use for communication with
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# the OpenStack service. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#endpoint_type = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional CA cert file to use in SSL connections. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#ca_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional PEM-formatted certificate chain file. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#cert_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional PEM-formatted file that contains the private key. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#key_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# If set, then the server's certificate will not be verified. (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#insecure = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Allow client's debug log output. (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#http_log_debug = false
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +[clients_designate]
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# From heat.common.config
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Type of endpoint in Identity service catalog to use for communication with
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# the OpenStack service. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#endpoint_type = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional CA cert file to use in SSL connections. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#ca_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional PEM-formatted certificate chain file. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#cert_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional PEM-formatted file that contains the private key. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#key_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# If set, then the server's certificate will not be verified. (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#insecure = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +[clients_glance]
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# From heat.common.config
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Type of endpoint in Identity service catalog to use for communication with
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# the OpenStack service. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#endpoint_type = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional CA cert file to use in SSL connections. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#ca_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional PEM-formatted certificate chain file. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#cert_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional PEM-formatted file that contains the private key. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#key_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# If set, then the server's certificate will not be verified. (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#insecure = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +[clients_heat]
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# From heat.common.config
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Type of endpoint in Identity service catalog to use for communication with
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# the OpenStack service. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#endpoint_type = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional CA cert file to use in SSL connections. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#ca_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional PEM-formatted certificate chain file. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#cert_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional PEM-formatted file that contains the private key. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#key_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# If set, then the server's certificate will not be verified. (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#insecure = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional heat url in format like http://0.0.0.0:8004/v1/%(tenant_id)s.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#url =
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +[clients_keystone]
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# From heat.common.config
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Type of endpoint in Identity service catalog to use for communication with
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# the OpenStack service. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#endpoint_type = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional CA cert file to use in SSL connections. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#ca_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional PEM-formatted certificate chain file. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#cert_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional PEM-formatted file that contains the private key. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#key_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# If set, then the server's certificate will not be verified. (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#insecure = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Unversioned keystone url in format like http://0.0.0.0:5000. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#auth_uri =
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +[clients_magnum]
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# From heat.common.config
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Type of endpoint in Identity service catalog to use for communication with
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# the OpenStack service. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#endpoint_type = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional CA cert file to use in SSL connections. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#ca_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional PEM-formatted certificate chain file. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#cert_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional PEM-formatted file that contains the private key. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#key_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# If set, then the server's certificate will not be verified. (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#insecure = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +[clients_manila]
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# From heat.common.config
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Type of endpoint in Identity service catalog to use for communication with
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# the OpenStack service. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#endpoint_type = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional CA cert file to use in SSL connections. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#ca_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional PEM-formatted certificate chain file. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#cert_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional PEM-formatted file that contains the private key. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#key_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# If set, then the server's certificate will not be verified. (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#insecure = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +[clients_mistral]
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# From heat.common.config
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Type of endpoint in Identity service catalog to use for communication with
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# the OpenStack service. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#endpoint_type = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional CA cert file to use in SSL connections. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#ca_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional PEM-formatted certificate chain file. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#cert_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional PEM-formatted file that contains the private key. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#key_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# If set, then the server's certificate will not be verified. (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#insecure = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +[clients_monasca]
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# From heat.common.config
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Type of endpoint in Identity service catalog to use for communication with
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# the OpenStack service. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#endpoint_type = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional CA cert file to use in SSL connections. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#ca_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional PEM-formatted certificate chain file. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#cert_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional PEM-formatted file that contains the private key. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#key_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# If set, then the server's certificate will not be verified. (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#insecure = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +[clients_neutron]
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# From heat.common.config
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Type of endpoint in Identity service catalog to use for communication with
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# the OpenStack service. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#endpoint_type = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional CA cert file to use in SSL connections. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#ca_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional PEM-formatted certificate chain file. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#cert_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional PEM-formatted file that contains the private key. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#key_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# If set, then the server's certificate will not be verified. (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#insecure = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +[clients_nova]
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# From heat.common.config
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Type of endpoint in Identity service catalog to use for communication with
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# the OpenStack service. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#endpoint_type = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional CA cert file to use in SSL connections. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#ca_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional PEM-formatted certificate chain file. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#cert_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional PEM-formatted file that contains the private key. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#key_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# If set, then the server's certificate will not be verified. (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#insecure = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Allow client's debug log output. (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#http_log_debug = false
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +[clients_sahara]
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# From heat.common.config
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Type of endpoint in Identity service catalog to use for communication with
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# the OpenStack service. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#endpoint_type = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional CA cert file to use in SSL connections. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#ca_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional PEM-formatted certificate chain file. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#cert_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional PEM-formatted file that contains the private key. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#key_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# If set, then the server's certificate will not be verified. (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#insecure = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +[clients_senlin]
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# From heat.common.config
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Type of endpoint in Identity service catalog to use for communication with
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# the OpenStack service. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#endpoint_type = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional CA cert file to use in SSL connections. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#ca_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional PEM-formatted certificate chain file. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#cert_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional PEM-formatted file that contains the private key. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#key_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# If set, then the server's certificate will not be verified. (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#insecure = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +[clients_swift]
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# From heat.common.config
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Type of endpoint in Identity service catalog to use for communication with
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# the OpenStack service. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#endpoint_type = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional CA cert file to use in SSL connections. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#ca_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional PEM-formatted certificate chain file. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#cert_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional PEM-formatted file that contains the private key. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#key_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# If set, then the server's certificate will not be verified. (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#insecure = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +[clients_trove]
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# From heat.common.config
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Type of endpoint in Identity service catalog to use for communication with
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# the OpenStack service. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#endpoint_type = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional CA cert file to use in SSL connections. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#ca_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional PEM-formatted certificate chain file. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#cert_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional PEM-formatted file that contains the private key. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#key_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# If set, then the server's certificate will not be verified. (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#insecure = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +[clients_zaqar]
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# From heat.common.config
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Type of endpoint in Identity service catalog to use for communication with
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# the OpenStack service. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#endpoint_type = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional CA cert file to use in SSL connections. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#ca_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional PEM-formatted certificate chain file. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#cert_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional PEM-formatted file that contains the private key. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#key_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# If set, then the server's certificate will not be verified. (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#insecure = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  [cors]
Sep 28 12:01:38 ctl02 salt-minion[14967]: @@ -222,7 +1101,8 @@
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Indicate whether this resource may be shared with the domain received in the
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# requests "origin" header. (list value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# requests "origin" header. Format: "<protocol>://<host>[:<port>]", no trailing
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# slash. Example: https://horizon.example.com (list value)
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #allowed_origin = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Indicate that the actual request can include user credentials (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: @@ -230,17 +1110,18 @@
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Indicate which headers are safe to expose to the API. Defaults to HTTP Simple
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Headers. (list value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: -#expose_headers = Content-Type,Cache-Control,Content-Language,Expires,Last-Modified,Pragma
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#expose_headers = X-Auth-Token,X-Subject-Token,X-Service-Token,X-OpenStack-Request-ID
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Maximum cache age of CORS preflight requests. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #max_age = 3600
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Indicate which methods can be used during the actual request. (list value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: -#allow_methods = GET,POST,PUT,DELETE,OPTIONS
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#allow_methods = GET,PUT,POST,DELETE,PATCH
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Indicate which header field names may be used during the actual request.
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # (list value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: -#allow_headers = Content-Type,Cache-Control,Content-Language,Expires,Last-Modified,Pragma
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#allow_headers = X-Auth-Token,X-Identity-Status,X-Roles,X-Service-Catalog,X-User-Id,X-Tenant-Id,X-OpenStack-Request-ID
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  [cors.subdomain]
Sep 28 12:01:38 ctl02 salt-minion[14967]: @@ -250,7 +1131,8 @@
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Indicate whether this resource may be shared with the domain received in the
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# requests "origin" header. (list value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# requests "origin" header. Format: "<protocol>://<host>[:<port>]", no trailing
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# slash. Example: https://horizon.example.com (list value)
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #allowed_origin = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Indicate that the actual request can include user credentials (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: @@ -258,17 +1140,17 @@
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Indicate which headers are safe to expose to the API. Defaults to HTTP Simple
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Headers. (list value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: -#expose_headers = Content-Type,Cache-Control,Content-Language,Expires,Last-Modified,Pragma
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#expose_headers = X-Auth-Token,X-Subject-Token,X-Service-Token,X-OpenStack-Request-ID
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Maximum cache age of CORS preflight requests. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #max_age = 3600
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Indicate which methods can be used during the actual request. (list value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: -#allow_methods = GET,POST,PUT,DELETE,OPTIONS
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#allow_methods = GET,PUT,POST,DELETE,PATCH
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Indicate which header field names may be used during the actual request.
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # (list value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: -#allow_headers = Content-Type,Cache-Control,Content-Language,Expires,Last-Modified,Pragma
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#allow_headers = X-Auth-Token,X-Identity-Status,X-Roles,X-Service-Catalog,X-User-Id,X-Tenant-Id,X-OpenStack-Request-ID
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  [database]
Sep 28 12:01:38 ctl02 salt-minion[14967]: @@ -277,8 +1159,12 @@
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # From oslo.db
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# The file name to use with SQLite. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# DEPRECATED: The file name to use with SQLite. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/sqlite_db
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Reason: Should use config option connection or slave_connection to connect
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# the database.
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #sqlite_db = oslo.sqlite
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # If True, SQLite uses synchronous mode. (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: @@ -295,6 +1181,7 @@
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Deprecated group/name - [DATABASE]/sql_connection
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Deprecated group/name - [sql]/connection
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #connection = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +connection = mysql+pymysql://heat:opnfv_secret@10.167.4.50/heat?charset=utf8
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # The SQLAlchemy connection string to use to connect to the slave database.
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: @@ -317,16 +1204,19 @@
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Deprecated group/name - [DATABASE]/sql_min_pool_size
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #min_pool_size = 1
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# Maximum number of SQL connections to keep open in a pool. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Maximum number of SQL connections to keep open in a pool. Setting a value of
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# 0 indicates no limit. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/sql_max_pool_size
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Deprecated group/name - [DATABASE]/sql_max_pool_size
Sep 28 12:01:38 ctl02 salt-minion[14967]: -#max_pool_size = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#max_pool_size = 5
Sep 28 12:01:38 ctl02 salt-minion[14967]: +max_pool_size = 30
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Maximum number of database connection retries during startup. Set to -1 to
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # specify an infinite retry count. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/sql_max_retries
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Deprecated group/name - [DATABASE]/sql_max_retries
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #max_retries = 10
Sep 28 12:01:38 ctl02 salt-minion[14967]: +max_retries = -1
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Interval between retries of opening a SQL connection. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/sql_retry_interval
Sep 28 12:01:38 ctl02 salt-minion[14967]: @@ -337,9 +1227,12 @@
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/sql_max_overflow
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Deprecated group/name - [DATABASE]/sqlalchemy_max_overflow
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #max_overflow = 50
Sep 28 12:01:38 ctl02 salt-minion[14967]: +max_overflow = 60
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Verbosity of SQL debugging information: 0=None, 100=Everything. (integer
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Maximum value: 100
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/sql_connection_debug
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #connection_debug = 0
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]: @@ -371,13 +1264,231 @@
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #db_max_retries = 20
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]: +[ec2authtoken]
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Options defined in heat.api.aws.ec2token
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Authentication Endpoint URI. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +auth_uri=http://10.167.4.10:5000/v2.0
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Allow orchestration of multiple clouds. (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#multi_cloud=false
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Allowed keystone endpoints for auth_uri when multi_cloud is
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# enabled. At least one endpoint needs to be specified. (list
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#allowed_auth_uris=
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +keystone_ec2_uri=http://10.167.4.10:5000/v2.0/ec2tokens
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +[clients]
Sep 28 12:01:38 ctl02 salt-minion[14967]: +endpoint_type = internalURL
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +[clients_heat]
Sep 28 12:01:38 ctl02 salt-minion[14967]: +endpoint_type = publicURL
Sep 28 12:01:38 ctl02 salt-minion[14967]: +[clients_keystone]
Sep 28 12:01:38 ctl02 salt-minion[14967]: +auth_uri=http://10.167.4.10:35357
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +[eventlet_opts]
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# From heat.common.wsgi
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# If False, closes the client socket connection explicitly. (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#wsgi_keep_alive = true
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Timeout for client connections' socket operations. If an incoming connection
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# is idle for this number of seconds it will be closed. A value of '0' means
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# wait forever. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#client_socket_timeout = 900
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +[healthcheck]
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# From oslo.middleware
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# DEPRECATED: The path to respond to healtcheck requests on. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#path = /healthcheck
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Show more detailed information as part of the response (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#detailed = false
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Additional backends that can perform health checks and report that
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# information back as part of a request. (list value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#backends =
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Check the presence of a file to determine if an application is running on a
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# port. Used by DisableByFileHealthcheck plugin. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#disable_by_file_path = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Check the presence of a file based on a port to determine if an application
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# is running on a port. Expects a "port:path" list of strings. Used by
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# DisableByFilesPortsHealthcheck plugin. (list value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#disable_by_file_paths =
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +[heat_api]
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# From heat.common.wsgi
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Address to bind the server. Useful when selecting a particular network
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# interface. (IP address value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/bind_host
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#bind_host = 0.0.0.0
Sep 28 12:01:38 ctl02 salt-minion[14967]: +bind_host = 10.167.4.12
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# The port on which the server will listen. (port value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Maximum value: 65535
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/bind_port
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#bind_port = 8004
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Number of backlog requests to configure the socket with. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/backlog
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#backlog = 4096
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Location of the SSL certificate file to use for SSL mode. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/cert_file
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#cert_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Location of the SSL key file to use for enabling SSL mode. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/key_file
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#key_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Number of workers for Heat service. Default value 0 means, that service will
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# start number of workers equal number of cores on server. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/workers
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#workers = 0
Sep 28 12:01:38 ctl02 salt-minion[14967]: +workers=4
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Maximum line size of message headers to be accepted. max_header_line may need
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# to be increased when using large tokens (typically those generated by the
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Keystone v3 API with big service catalogs). (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#max_header_line = 16384
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# The value for the socket option TCP_KEEPIDLE.  This is the time in seconds
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# that the connection must be idle before TCP starts sending keepalive probes.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#tcp_keepidle = 600
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +[heat_api_cfn]
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# From heat.common.wsgi
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Address to bind the server. Useful when selecting a particular network
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# interface. (IP address value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/bind_host
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#bind_host = 0.0.0.0
Sep 28 12:01:38 ctl02 salt-minion[14967]: +bind_host = 10.167.4.12
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# The port on which the server will listen. (port value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Maximum value: 65535
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/bind_port
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#bind_port = 8000
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Number of backlog requests to configure the socket with. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/backlog
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#backlog = 4096
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Location of the SSL certificate file to use for SSL mode. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/cert_file
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#cert_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Location of the SSL key file to use for enabling SSL mode. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/key_file
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#key_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Number of workers for Heat service. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/workers
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#workers = 1
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Maximum line size of message headers to be accepted. max_header_line may need
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# to be increased when using large tokens (typically those generated by the
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Keystone v3 API with big service catalogs). (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#max_header_line = 16384
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# The value for the socket option TCP_KEEPIDLE.  This is the time in seconds
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# that the connection must be idle before TCP starts sending keepalive probes.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#tcp_keepidle = 600
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +[heat_api_cloudwatch]
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# From heat.common.wsgi
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Address to bind the server. Useful when selecting a particular network
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# interface. (IP address value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/bind_host
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#bind_host = 0.0.0.0
Sep 28 12:01:38 ctl02 salt-minion[14967]: +bind_host = 10.167.4.12
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# The port on which the server will listen. (port value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Maximum value: 65535
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/bind_port
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#bind_port = 8003
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Number of backlog requests to configure the socket with. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/backlog
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#backlog = 4096
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Location of the SSL certificate file to use for SSL mode. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/cert_file
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#cert_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Location of the SSL key file to use for enabling SSL mode. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/key_file
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#key_file = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Number of workers for Heat service. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/workers
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#workers = 1
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Maximum line size of message headers to be accepted. max_header_line may need
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# to be increased when using large tokens (typically those generated by the
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Keystone v3 API with big service catalogs.) (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#max_header_line = 16384
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# The value for the socket option TCP_KEEPIDLE.  This is the time in seconds
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# that the connection must be idle before TCP starts sending keepalive probes.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#tcp_keepidle = 600
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]:  [keystone_authtoken]
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # From keystonemiddleware.auth_token
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# Complete public Identity API endpoint. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Complete "public" Identity API endpoint. This endpoint should not be an
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# "admin" endpoint, as it should be accessible by all end users.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Unauthenticated clients are redirected to this endpoint to authenticate.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Although this endpoint should  ideally be unversioned, client support in the
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# wild varies.  If you're using a versioned v2 endpoint here, then this  should
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# *not* be the same endpoint the service user utilizes  for validating tokens,
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# because normal end users may not be  able to reach that endpoint. (string
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# value)
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #auth_uri = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # API version of the admin Identity API endpoint. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: @@ -395,7 +1506,10 @@
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # API Server. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #http_request_max_retries = 3
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# Env key for the swift cache. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Request environment key where the Swift cache object is stored. When
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# auth_token middleware is deployed with a Swift cache, use this option to have
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# the middleware share a caching backend with swift. Otherwise, use the
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# ``memcached_servers`` option instead. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #cache = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Required if identity server requires client certificate (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: @@ -414,12 +1528,17 @@
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # The region in which the identity server can be found. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #region_name = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# Directory used to cache files related to PKI tokens. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# DEPRECATED: Directory used to cache files related to PKI tokens. This option
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# has been deprecated in the Ocata release and will be removed in the P
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# release. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# This option is deprecated for removal since Ocata.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Reason: PKI token format is no longer supported.
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #signing_dir = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Optionally specify a list of memcached server(s) to use for caching. If left
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # undefined, tokens will instead be cached in-process. (list value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# Deprecated group/name - [DEFAULT]/memcache_servers
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [keystone_authtoken]/memcache_servers
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #memcached_servers = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # In order to prevent excessive effort spent validating tokens, the middleware
Sep 28 12:01:38 ctl02 salt-minion[14967]: @@ -427,10 +1546,14 @@
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # to -1 to disable caching completely. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #token_cache_time = 300
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# Determines the frequency at which the list of revoked tokens is retrieved
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# from the Identity service (in seconds). A high number of revocation events
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# combined with a low cache duration may significantly reduce performance.
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# DEPRECATED: Determines the frequency at which the list of revoked tokens is
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# retrieved from the Identity service (in seconds). A high number of revocation
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# events combined with a low cache duration may significantly reduce
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# performance. Only valid for PKI tokens. This option has been deprecated in
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# the Ocata release and will be removed in the P release. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# This option is deprecated for removal since Ocata.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Reason: PKI token format is no longer supported.
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #revocation_cache_time = 10
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # (Optional) If defined, indicate whether token data should be authenticated or
Sep 28 12:01:38 ctl02 salt-minion[14967]: @@ -483,19 +1606,40 @@
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #enforce_token_bind = permissive
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# If true, the revocation list will be checked for cached tokens. This requires
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# that PKI tokens are configured on the identity server. (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# DEPRECATED: If true, the revocation list will be checked for cached tokens.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# This requires that PKI tokens are configured on the identity server. (boolean
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# This option is deprecated for removal since Ocata.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Reason: PKI token format is no longer supported.
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #check_revocations_for_cached = false
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# Hash algorithms to use for hashing PKI tokens. This may be a single algorithm
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# or multiple. The algorithms are those supported by Python standard
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# hashlib.new(). The hashes will be tried in the order given, so put the
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# preferred one first for performance. The result of the first hash will be
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# DEPRECATED: Hash algorithms to use for hashing PKI tokens. This may be a
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# single algorithm or multiple. The algorithms are those supported by Python
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# standard hashlib.new(). The hashes will be tried in the order given, so put
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# the preferred one first for performance. The result of the first hash will be
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # stored in the cache. This will typically be set to multiple values only while
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # migrating from a less secure algorithm to a more secure one. Once all the old
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # tokens are expired this option should be set to a single value for better
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # performance. (list value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# This option is deprecated for removal since Ocata.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Reason: PKI token format is no longer supported.
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #hash_algorithms = md5
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# A choice of roles that must be present in a service token. Service tokens are
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# allowed to request that an expired token can be used and so this check should
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# tightly control that only actual services should be sending this token. Roles
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# here are applied as an ANY check so any role in this list must be present.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# For backwards compatibility reasons this currently only affects the
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# allow_expired check. (list value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#service_token_roles = service
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# For backwards compatibility reasons we must let valid service tokens pass
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# that don't pass the service_token_roles check as valid. Setting this true
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# will become the default in a future release and should be enabled if
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# possible. (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#service_token_roles_required = false
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Prefix to prepend at the beginning of the path. Deprecated, use identity_uri.
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: @@ -534,13 +1678,24 @@
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Service tenant name. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #admin_tenant_name = admin
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# Authentication type to load (unknown value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# Deprecated group/name - [DEFAULT]/auth_plugin
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Authentication type to load (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [keystone_authtoken]/auth_plugin
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #auth_type = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# Config Section from which to load plugin specific options (unknown value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Config Section from which to load plugin specific options (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #auth_section = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: -
Sep 28 12:01:38 ctl02 salt-minion[14967]: +auth_type = password
Sep 28 12:01:38 ctl02 salt-minion[14967]: +auth_uri=http://10.167.4.10:5000/v2.0
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#identity_uri=http://10.167.4.10:35357
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#admin_user=heat
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#admin_password=opnfv_secret
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#admin_tenant_name=service
Sep 28 12:01:38 ctl02 salt-minion[14967]: +auth_url=http://10.167.4.10:35357
Sep 28 12:01:38 ctl02 salt-minion[14967]: +username = heat
Sep 28 12:01:38 ctl02 salt-minion[14967]: +password = opnfv_secret
Sep 28 12:01:38 ctl02 salt-minion[14967]: +project_name = service
Sep 28 12:01:38 ctl02 salt-minion[14967]: +project_domain_name = Default
Sep 28 12:01:38 ctl02 salt-minion[14967]: +user_domain_name = Default
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  [matchmaker_redis]
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]: @@ -548,32 +1703,44 @@
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # From oslo.messaging
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# Host to locate redis. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# DEPRECATED: Host to locate redis. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #host = 127.0.0.1
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# Use this port to connect to redis host. (port value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# DEPRECATED: Use this port to connect to redis host. (port value)
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Minimum value: 0
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Maximum value: 65535
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #port = 6379
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# Password for Redis server (optional). (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# DEPRECATED: Password for Redis server (optional). (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #password =
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# List of Redis Sentinel hosts (fault tolerance mode) e.g.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# DEPRECATED: List of Redis Sentinel hosts (fault tolerance mode), e.g.,
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # [host:port, host1:port ... ] (list value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #sentinel_hosts =
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Redis replica set name. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #sentinel_group_name = oslo-messaging-zeromq
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Time in ms to wait between connection attempts. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: -#wait_timeout = 500
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#wait_timeout = 2000
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Time in ms to wait before the transaction is killed. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #check_timeout = 20000
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# Timeout in ms on blocking socket operations (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: -#socket_timeout = 1000
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Timeout in ms on blocking socket operations. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#socket_timeout = 10000
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  [oslo_messaging_amqp]
Sep 28 12:01:38 ctl02 salt-minion[14967]: @@ -581,6 +1748,116 @@
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # From oslo.messaging
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Name for the AMQP container. must be globally unique. Defaults to a generated
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# UUID (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/container_name
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#container_name = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Timeout for inactive connections (in seconds) (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/idle_timeout
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#idle_timeout = 0
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Debug: dump AMQP frames to stdout (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/trace
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#trace = false
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# CA certificate PEM file used to verify the server's certificate (string
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/ssl_ca_file
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#ssl_ca_file =
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Self-identifying certificate PEM file for client authentication (string
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/ssl_cert_file
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#ssl_cert_file =
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Private key PEM file used to sign ssl_cert_file certificate (optional)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/ssl_key_file
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#ssl_key_file =
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Password for decrypting ssl_key_file (if encrypted) (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/ssl_key_password
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#ssl_key_password = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# DEPRECATED: Accept clients using either SSL or plain TCP (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/allow_insecure_clients
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Reason: Not applicable - not a SSL server
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#allow_insecure_clients = false
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Space separated list of acceptable SASL mechanisms (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/sasl_mechanisms
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#sasl_mechanisms =
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Path to directory that contains the SASL configuration (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/sasl_config_dir
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#sasl_config_dir =
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Name of configuration file (without .conf suffix) (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/sasl_config_name
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#sasl_config_name =
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# User name for message broker authentication (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/username
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#username =
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Password for message broker authentication (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/password
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#password =
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Seconds to pause before attempting to re-connect. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#connection_retry_interval = 1
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Increase the connection_retry_interval by this many seconds after each
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# unsuccessful failover attempt. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#connection_retry_backoff = 2
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Maximum limit for connection_retry_interval + connection_retry_backoff
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#connection_retry_interval_max = 30
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Time to pause between re-connecting an AMQP 1.0 link that failed due to a
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# recoverable error. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#link_retry_delay = 10
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# The maximum number of attempts to re-send a reply message which failed due to
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# a recoverable error. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Minimum value: -1
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#default_reply_retry = 0
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# The deadline for an rpc reply message delivery. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Minimum value: 5
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#default_reply_timeout = 30
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# The deadline for an rpc cast or call message delivery. Only used when caller
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# does not provide a timeout expiry. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Minimum value: 5
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#default_send_timeout = 30
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# The deadline for a sent notification message delivery. Only used when caller
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# does not provide a timeout expiry. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Minimum value: 5
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#default_notify_timeout = 30
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# The duration to schedule a purge of idle sender links. Detach link after
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# expiry. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#default_sender_link_timeout = 600
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Indicates the addressing mode used by the driver.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Permitted values:
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# 'legacy'   - use legacy non-routable addressing
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# 'routable' - use routable addresses
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# 'dynamic'  - use legacy addresses if the message bus does not support routing
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# otherwise use routable addressing (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#addressing_mode = dynamic
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # address prefix used when sending to a specific server (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Deprecated group/name - [amqp1]/server_request_prefix
Sep 28 12:01:38 ctl02 salt-minion[14967]: @@ -594,57 +1871,113 @@
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Deprecated group/name - [amqp1]/group_request_prefix
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #group_request_prefix = unicast
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# Name for the AMQP container (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/container_name
Sep 28 12:01:38 ctl02 salt-minion[14967]: -#container_name = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: -
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# Timeout for inactive connections (in seconds) (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/idle_timeout
Sep 28 12:01:38 ctl02 salt-minion[14967]: -#idle_timeout = 0
Sep 28 12:01:38 ctl02 salt-minion[14967]: -
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# Debug: dump AMQP frames to stdout (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/trace
Sep 28 12:01:38 ctl02 salt-minion[14967]: -#trace = false
Sep 28 12:01:38 ctl02 salt-minion[14967]: -
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# CA certificate PEM file to verify server certificate (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/ssl_ca_file
Sep 28 12:01:38 ctl02 salt-minion[14967]: -#ssl_ca_file =
Sep 28 12:01:38 ctl02 salt-minion[14967]: -
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# Identifying certificate PEM file to present to clients (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/ssl_cert_file
Sep 28 12:01:38 ctl02 salt-minion[14967]: -#ssl_cert_file =
Sep 28 12:01:38 ctl02 salt-minion[14967]: -
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# Private key PEM file used to sign cert_file certificate (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/ssl_key_file
Sep 28 12:01:38 ctl02 salt-minion[14967]: -#ssl_key_file =
Sep 28 12:01:38 ctl02 salt-minion[14967]: -
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# Password for decrypting ssl_key_file (if encrypted) (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/ssl_key_password
Sep 28 12:01:38 ctl02 salt-minion[14967]: -#ssl_key_password = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: -
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# Accept clients using either SSL or plain TCP (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/allow_insecure_clients
Sep 28 12:01:38 ctl02 salt-minion[14967]: -#allow_insecure_clients = false
Sep 28 12:01:38 ctl02 salt-minion[14967]: -
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# Space separated list of acceptable SASL mechanisms (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/sasl_mechanisms
Sep 28 12:01:38 ctl02 salt-minion[14967]: -#sasl_mechanisms =
Sep 28 12:01:38 ctl02 salt-minion[14967]: -
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# Path to directory that contains the SASL configuration (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/sasl_config_dir
Sep 28 12:01:38 ctl02 salt-minion[14967]: -#sasl_config_dir =
Sep 28 12:01:38 ctl02 salt-minion[14967]: -
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# Name of configuration file (without .conf suffix) (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/sasl_config_name
Sep 28 12:01:38 ctl02 salt-minion[14967]: -#sasl_config_name =
Sep 28 12:01:38 ctl02 salt-minion[14967]: -
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# User name for message broker authentication (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/username
Sep 28 12:01:38 ctl02 salt-minion[14967]: -#username =
Sep 28 12:01:38 ctl02 salt-minion[14967]: -
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# Password for message broker authentication (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/password
Sep 28 12:01:38 ctl02 salt-minion[14967]: -#password =
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Address prefix for all generated RPC addresses (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#rpc_address_prefix = openstack.org/om/rpc
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Address prefix for all generated Notification addresses (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#notify_address_prefix = openstack.org/om/notify
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Appended to the address prefix when sending a fanout message. Used by the
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# message bus to identify fanout messages. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#multicast_address = multicast
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Appended to the address prefix when sending to a particular RPC/Notification
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# server. Used by the message bus to identify messages sent to a single
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# destination. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#unicast_address = unicast
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Appended to the address prefix when sending to a group of consumers. Used by
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# the message bus to identify messages that should be delivered in a round-
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# robin fashion across consumers. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#anycast_address = anycast
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Exchange name used in notification addresses.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Exchange name resolution precedence:
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Target.exchange if set
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# else default_notification_exchange if set
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# else control_exchange if set
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# else 'notify' (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#default_notification_exchange = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Exchange name used in RPC addresses.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Exchange name resolution precedence:
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Target.exchange if set
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# else default_rpc_exchange if set
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# else control_exchange if set
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# else 'rpc' (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#default_rpc_exchange = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Window size for incoming RPC Reply messages. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#reply_link_credit = 200
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Window size for incoming RPC Request messages (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#rpc_server_credit = 100
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Window size for incoming Notification messages (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#notify_server_credit = 100
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Send messages of this type pre-settled.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Pre-settled messages will not receive acknowledgement
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# from the peer. Note well: pre-settled messages may be
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# silently discarded if the delivery fails.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Permitted values:
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# 'rpc-call' - send RPC Calls pre-settled
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# 'rpc-reply'- send RPC Replies pre-settled
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# 'rpc-cast' - Send RPC Casts pre-settled
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# 'notify'   - Send Notifications pre-settled
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#  (multi valued)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#pre_settled = rpc-cast
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#pre_settled = rpc-reply
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +[oslo_messaging_kafka]
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# From oslo.messaging
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# DEPRECATED: Default Kafka broker Host (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#kafka_default_host = localhost
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# DEPRECATED: Default Kafka broker Port (port value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Maximum value: 65535
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#kafka_default_port = 9092
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Max fetch bytes of Kafka consumer (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#kafka_max_fetch_bytes = 1048576
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Default timeout(s) for Kafka consumers (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#kafka_consumer_timeout = 1.0
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Pool Size for Kafka Consumers (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#pool_size = 10
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# The pool size limit for connections expiration policy (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#conn_pool_min_size = 2
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# The time-to-live in sec of idle connections in the pool (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#conn_pool_ttl = 1200
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Group id for Kafka consumer. Consumers in one group will coordinate message
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# consumption (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#consumer_group = oslo_messaging_consumer
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Upper bound on the delay for KafkaProducer batching in seconds (floating
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# point value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#producer_batch_timeout = 0.0
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Size of batch for the producer async send (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#producer_batch_size = 16384
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  [oslo_messaging_notifications]
Sep 28 12:01:38 ctl02 salt-minion[14967]: @@ -657,6 +1990,7 @@
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # messaging, messagingv2, routing, log, test, noop (multi valued)
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/notification_driver
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #driver =
Sep 28 12:01:38 ctl02 salt-minion[14967]: +driver = messagingv2
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # A URL representing the messaging driver to use for notifications. If not set,
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # we fall back to the same configuration used for RPC. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: @@ -708,12 +2042,12 @@
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #kombu_reconnect_delay = 1.0
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # EXPERIMENTAL: Possible values are: gzip, bz2. If not set compression will not
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# be used. This option may notbe available in future versions. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# be used. This option may not be available in future versions. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #kombu_compression = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# How long to wait a missing client beforce abandoning to send it its replies.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# How long to wait a missing client before abandoning to send it its replies.
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # This value should not be longer than rpc_response_timeout. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# Deprecated group/name - [DEFAULT]/kombu_reconnect_timeout
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [oslo_messaging_rabbit]/kombu_reconnect_timeout
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #kombu_missing_consumer_retry_timeout = 60
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Determines how the next RabbitMQ node is chosen in case the one we are
Sep 28 12:01:38 ctl02 salt-minion[14967]: @@ -722,38 +2056,59 @@
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Allowed values: round-robin, shuffle
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #kombu_failover_strategy = round-robin
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# The RabbitMQ broker address where a single node is used. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# DEPRECATED: The RabbitMQ broker address where a single node is used. (string
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# value)
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rabbit_host
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #rabbit_host = localhost
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# The RabbitMQ broker port where a single node is used. (port value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# DEPRECATED: The RabbitMQ broker port where a single node is used. (port
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# value)
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Minimum value: 0
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Maximum value: 65535
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rabbit_port
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #rabbit_port = 5672
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# RabbitMQ HA cluster host:port pairs. (list value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# DEPRECATED: RabbitMQ HA cluster host:port pairs. (list value)
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rabbit_hosts
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #rabbit_hosts = $rabbit_host:$rabbit_port
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Connect over SSL for RabbitMQ. (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rabbit_use_ssl
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #rabbit_use_ssl = false
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# The RabbitMQ userid. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# DEPRECATED: The RabbitMQ userid. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rabbit_userid
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #rabbit_userid = guest
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# The RabbitMQ password. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# DEPRECATED: The RabbitMQ password. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rabbit_password
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #rabbit_password = guest
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # The RabbitMQ login method. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Allowed values: PLAIN, AMQPLAIN, RABBIT-CR-DEMO
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rabbit_login_method
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #rabbit_login_method = AMQPLAIN
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# The RabbitMQ virtual host. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# DEPRECATED: The RabbitMQ virtual host. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rabbit_virtual_host
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #rabbit_virtual_host = /
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # How frequently to retry connecting with RabbitMQ. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: @@ -768,15 +2123,17 @@
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #rabbit_interval_max = 30
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# Maximum number of RabbitMQ connection retries. Default is 0 (infinite retry
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# count). (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# DEPRECATED: Maximum number of RabbitMQ connection retries. Default is 0
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# (infinite retry count). (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rabbit_max_retries
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #rabbit_max_retries = 0
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Try to use HA queues in RabbitMQ (x-ha-policy: all). If you change this
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # option, you must wipe the RabbitMQ database. In RabbitMQ 3.0, queue mirroring
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # is no longer controlled by the x-ha-policy argument when declaring a queue.
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# If you just want to make sure that all queues (except  those with auto-
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# If you just want to make sure that all queues (except those with auto-
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # generated names) are mirrored across all nodes, run: "rabbitmqctl set_policy
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # HA '^(?!amq\.).*' '{"ha-mode": "all"}' " (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rabbit_ha_queues
Sep 28 12:01:38 ctl02 salt-minion[14967]: @@ -812,7 +2169,7 @@
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #frame_max = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # How often to send heartbeats for consumer's connections (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: -#heartbeat_interval = 1
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#heartbeat_interval = 3
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Enable SSL (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #ssl = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: @@ -831,8 +2188,12 @@
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # point value)
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #host_connection_reconnect_delay = 0.25
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Connection factory implementation (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Allowed values: new, single, read_write
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#connection_factory = single
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Maximum number of connections to keep queued. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: -#pool_max_size = 10
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#pool_max_size = 30
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Maximum number of connections to create above `pool_max_size`. (integer
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: @@ -851,10 +2212,15 @@
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #pool_stale = 60
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Default serialization mechanism for serializing/deserializing
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# outgoing/incoming messages (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Allowed values: json, msgpack
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#default_serializer_type = json
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Persist notification messages. (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #notification_persistence = false
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# Exchange name for for sending notifications (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Exchange name for sending notifications (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #default_notification_exchange = ${control_exchange}_notification
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Max number of not acknowledged message which RabbitMQ can send to
Sep 28 12:01:38 ctl02 salt-minion[14967]: @@ -896,7 +2262,7 @@
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Reconnecting retry count in case of connectivity problem during sending RPC
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # message, -1 means infinite retry. If actual retry attempts in not 0 the rpc
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# request could be processed more then one time (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# request could be processed more than one time (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #default_rpc_retry_attempts = -1
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Reconnecting retry delay in case of connectivity problem during sending RPC
Sep 28 12:01:38 ctl02 salt-minion[14967]: @@ -904,24 +2270,190 @@
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #rpc_retry_delay = 0.25
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]: +[oslo_messaging_zmq]
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# From oslo.messaging
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# ZeroMQ bind address. Should be a wildcard (*), an ethernet interface, or IP.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# The "host" option should point or resolve to this address. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_bind_address
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#rpc_zmq_bind_address = *
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# MatchMaker driver. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Allowed values: redis, sentinel, dummy
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_matchmaker
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#rpc_zmq_matchmaker = redis
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Number of ZeroMQ contexts, defaults to 1. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_contexts
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#rpc_zmq_contexts = 1
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Maximum number of ingress messages to locally buffer per topic. Default is
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# unlimited. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_topic_backlog
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#rpc_zmq_topic_backlog = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Directory for holding IPC sockets. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_ipc_dir
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#rpc_zmq_ipc_dir = /var/run/openstack
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Name of this node. Must be a valid hostname, FQDN, or IP address. Must match
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# "host" option, if running Nova. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_host
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#rpc_zmq_host = localhost
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Number of seconds to wait before all pending messages will be sent after
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# closing a socket. The default value of -1 specifies an infinite linger
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# period. The value of 0 specifies no linger period. Pending messages shall be
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# discarded immediately when the socket is closed. Positive values specify an
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# upper bound for the linger period. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_cast_timeout
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#zmq_linger = -1
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# The default number of seconds that poll should wait. Poll raises timeout
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# exception when timeout expired. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_poll_timeout
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#rpc_poll_timeout = 1
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Expiration timeout in seconds of a name service record about existing target
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# ( < 0 means no timeout). (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/zmq_target_expire
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#zmq_target_expire = 300
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Update period in seconds of a name service record about existing target.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/zmq_target_update
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#zmq_target_update = 180
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Use PUB/SUB pattern for fanout methods. PUB/SUB always uses proxy. (boolean
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/use_pub_sub
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#use_pub_sub = false
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Use ROUTER remote proxy. (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/use_router_proxy
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#use_router_proxy = false
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# This option makes direct connections dynamic or static. It makes sense only
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# with use_router_proxy=False which means to use direct connections for direct
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# message types (ignored otherwise). (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#use_dynamic_connections = false
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# How many additional connections to a host will be made for failover reasons.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# This option is actual only in dynamic connections mode. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#zmq_failover_connections = 2
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Minimal port number for random ports range. (port value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Maximum value: 65535
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_min_port
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#rpc_zmq_min_port = 49153
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Maximal port number for random ports range. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Maximum value: 65536
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_max_port
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#rpc_zmq_max_port = 65536
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Number of retries to find free port number before fail with ZMQBindError.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_bind_port_retries
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#rpc_zmq_bind_port_retries = 100
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Default serialization mechanism for serializing/deserializing
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# outgoing/incoming messages (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Allowed values: json, msgpack
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_serialization
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#rpc_zmq_serialization = json
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# This option configures round-robin mode in zmq socket. True means not keeping
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# a queue when server side disconnects. False means to keep queue and messages
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# even if server is disconnected, when the server appears we send all
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# accumulated messages to it. (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#zmq_immediate = true
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Enable/disable TCP keepalive (KA) mechanism. The default value of -1 (or any
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# other negative value) means to skip any overrides and leave it to OS default;
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# 0 and 1 (or any other positive value) mean to disable and enable the option
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# respectively. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#zmq_tcp_keepalive = -1
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# The duration between two keepalive transmissions in idle condition. The unit
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# is platform dependent, for example, seconds in Linux, milliseconds in Windows
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# etc. The default value of -1 (or any other negative value and 0) means to
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# skip any overrides and leave it to OS default. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#zmq_tcp_keepalive_idle = -1
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# The number of retransmissions to be carried out before declaring that remote
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# end is not available. The default value of -1 (or any other negative value
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# and 0) means to skip any overrides and leave it to OS default. (integer
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#zmq_tcp_keepalive_cnt = -1
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# The duration between two successive keepalive retransmissions, if
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# acknowledgement to the previous keepalive transmission is not received. The
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# unit is platform dependent, for example, seconds in Linux, milliseconds in
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Windows etc. The default value of -1 (or any other negative value and 0)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# means to skip any overrides and leave it to OS default. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#zmq_tcp_keepalive_intvl = -1
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Maximum number of (green) threads to work concurrently. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#rpc_thread_pool_size = 100
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Expiration timeout in seconds of a sent/received message after which it is
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# not tracked anymore by a client/server. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#rpc_message_ttl = 300
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Wait for message acknowledgements from receivers. This mechanism works only
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# via proxy without PUB/SUB. (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#rpc_use_acks = false
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Number of seconds to wait for an ack from a cast/call. After each retry
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# attempt this timeout is multiplied by some specified multiplier. (integer
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#rpc_ack_timeout_base = 15
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Number to multiply base ack timeout by after each retry attempt. (integer
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#rpc_ack_timeout_multiplier = 2
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Default number of message sending attempts in case of any problems occurred:
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# positive value N means at most N retries, 0 means no retries, None or -1 (or
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# any other negative values) mean to retry forever. This option is used only if
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# acknowledgments are enabled. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#rpc_retry_attempts = 3
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# List of publisher hosts SubConsumer can subscribe on. This option has higher
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# priority then the default publishers list taken from the matchmaker. (list
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#subscribe_on =
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]:  [oslo_middleware]
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # From oslo.middleware
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #
Sep 28 12:01:38 ctl02 salt-minion[14967]: +enable_proxy_headers_parsing = True
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # The maximum body size for each  request, in bytes. (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/osapi_max_request_body_size
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/max_request_body_size
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #max_request_body_size = 114688
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# The HTTP Header that will be used to determine what the original request
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# protocol scheme was, even if it was hidden by an SSL termination proxy.
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# DEPRECATED: The HTTP Header that will be used to determine what the original
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# request protocol scheme was, even if it was hidden by a SSL termination
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# proxy. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # This option is deprecated for removal.
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Its value may be silently ignored in the future.
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #secure_proxy_ssl_header = X-Forwarded-Proto
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Whether the application is behind a proxy or not. This determines if the
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# middleware should parse the headers or not. (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#enable_proxy_headers_parsing = false
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  [oslo_policy]
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]: @@ -929,7 +2461,7 @@
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # From oslo.policy
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]: -# The JSON file that defines policies. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# The file that defines policies. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/policy_file
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #policy_file = policy.json
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]: @@ -946,6 +2478,129 @@
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #policy_dirs = policy.d
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]: +[paste_deploy]
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# From heat.common.config
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# The flavor to use. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#flavor = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# The API paste config file to use. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#api_paste_config = api-paste.ini
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +[profiler]
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# From heat.common.config
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Enables the profiling for all services on this node. Default value is False
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# (fully disable the profiling feature).
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# * True: Enables the feature
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# * False: Disables the feature. The profiling cannot be started via this
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# project
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# operations. If the profiling is triggered by another project, this project
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# part
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# will be empty.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [profiler]/profiler_enabled
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#enabled = false
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Enables SQL requests profiling in services. Default value is False (SQL
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# requests won't be traced).
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Possible values:
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# * True: Enables SQL requests profiling. Each SQL query will be part of the
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# trace and can the be analyzed by how much time was spent for that.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# * False: Disables SQL requests profiling. The spent time is only shown on a
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# higher level of operations. Single SQL queries cannot be analyzed this
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# way.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#  (boolean value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#trace_sqlalchemy = false
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Secret key(s) to use for encrypting context data for performance profiling.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# This string value should have the following format:
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# <key1>[,<key2>,...<keyn>],
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# where each key is some random string. A user who triggers the profiling via
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# the REST API has to set one of these keys in the headers of the REST API call
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# to include profiling results of this node for this particular project.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Both "enabled" flag and "hmac_keys" config options should be set to enable
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# profiling. Also, to generate correct profiling information across all
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# services
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# at least one key needs to be consistent between OpenStack projects. This
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# ensures it can be used from client side to generate the trace, containing
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# information from all possible resources. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#hmac_keys = SECRET_KEY
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Connection string for a notifier backend. Default value is messaging:// which
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# sets the notifier to oslo_messaging.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Examples of possible values:
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# * messaging://: use oslo_messaging driver for sending notifications.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# * mongodb://127.0.0.1:27017 : use mongodb driver for sending notifications.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# * elasticsearch://127.0.0.1:9200 : use elasticsearch driver for sending
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# notifications.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#connection_string = messaging://
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Document type for notification indexing in elasticsearch.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#es_doc_type = notification
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# This parameter is a time value parameter (for example: es_scroll_time=2m),
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# indicating for how long the nodes that participate in the search will
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# maintain
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# relevant resources in order to continue and support it.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#es_scroll_time = 2m
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Elasticsearch splits large requests in batches. This parameter defines
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# maximum size of each batch (for example: es_scroll_size=10000).
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#  (integer value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#es_scroll_size = 10000
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Redissentinel provides a timeout option on the connections.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# This parameter defines that timeout (for example: socket_timeout=0.1).
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#  (floating point value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#socket_timeout = 0.1
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Redissentinel uses a service name to identify a master redis service.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# This parameter defines the name (for example:
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# sentinal_service_name=mymaster).
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#  (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#sentinel_service_name = mymaster
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +[revision]
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# From heat.common.config
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Heat build revision. If you would prefer to manage your build revision
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# separately, you can move this section to a different file and add it as
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# another config option. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#heat_revision = unknown
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]:  [ssl]
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #
Sep 28 12:01:38 ctl02 salt-minion[14967]: @@ -972,3 +2627,87 @@
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Sets the list of available ciphers. value should be a string in the OpenSSL
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # cipher list format. (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]:  #ciphers = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +[trustee]
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# From heat.common.context
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +auth_plugin = password
Sep 28 12:01:38 ctl02 salt-minion[14967]: +auth_url = http://10.167.4.10:35357
Sep 28 12:01:38 ctl02 salt-minion[14967]: +username = heat
Sep 28 12:01:38 ctl02 salt-minion[14967]: +password = opnfv_secret
Sep 28 12:01:38 ctl02 salt-minion[14967]: +user_domain_name = default
Sep 28 12:01:38 ctl02 salt-minion[14967]: +project_domain_id = default
Sep 28 12:01:38 ctl02 salt-minion[14967]: +user_domain_id = default
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Authentication type to load (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [trustee]/auth_plugin
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#auth_type = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Config Section from which to load plugin specific options (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#auth_section = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Authentication URL (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#auth_url = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Domain ID to scope to (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#domain_id = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Domain name to scope to (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#domain_name = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Project ID to scope to (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [trustee]/tenant-id
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#project_id = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Project name to scope to (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [trustee]/tenant-name
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#project_name = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Domain ID containing project (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#project_domain_id = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Domain name containing project (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#project_domain_name = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Trust ID (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#trust_id = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional domain ID to use with v3 and v2 parameters. It will be used for both
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# the user and project domain in v3 and ignored in v2 authentication. (string
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#default_domain_id = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Optional domain name to use with v3 API and v2 parameters. It will be used
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# for both the user and project domain in v3 and ignored in v2 authentication.
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#default_domain_name = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# User id (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#user_id = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Username (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Deprecated group/name - [trustee]/user-name
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#username = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# User's domain id (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#user_domain_id = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# User's domain name (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#user_domain_name = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# User's password (string value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#password = <None>
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +[volumes]
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# From heat.common.config
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Indicate if cinder-backup service is enabled. This is a temporary workaround
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# until cinder-backup service becomes discoverable, see LP#1334856. (boolean
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# value)
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#backups_enabled = true
Sep 28 12:01:38 ctl02 salt-minion[14967]: [INFO    ] Completed state [/etc/heat/heat.conf] at time 12:01:38.776779 duration_in_ms=208.007
Sep 28 12:01:38 ctl02 salt-minion[14967]: [INFO    ] Running state [/etc/heat/api-paste.ini] at time 12:01:38.777063
Sep 28 12:01:38 ctl02 salt-minion[14967]: [INFO    ] Executing state file.managed for /etc/heat/api-paste.ini
Sep 28 12:01:38 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'heat/files/ocata/api-paste.ini'
Sep 28 12:01:38 ctl02 salt-minion[14967]: [INFO    ] File changed:
Sep 28 12:01:38 ctl02 salt-minion[14967]: ---
Sep 28 12:01:38 ctl02 salt-minion[14967]: +++
Sep 28 12:01:38 ctl02 salt-minion[14967]: @@ -22,14 +22,21 @@
Sep 28 12:01:38 ctl02 salt-minion[14967]:  [pipeline:heat-api-custombackend]
Sep 28 12:01:38 ctl02 salt-minion[14967]:  pipeline = cors request_id faultwrap versionnegotiation context custombackendauth apiv1app
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# To enable, in heat.conf:
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#   [paste_deploy]
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#   flavor = noauth
Sep 28 12:01:38 ctl02 salt-minion[14967]: +#
Sep 28 12:01:38 ctl02 salt-minion[14967]: +[pipeline:heat-api-noauth]
Sep 28 12:01:38 ctl02 salt-minion[14967]: +pipeline = cors request_id faultwrap http_proxy_to_wsgi versionnegotiation noauth context apiv1app
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # heat-api-cfn pipeline
Sep 28 12:01:38 ctl02 salt-minion[14967]:  [pipeline:heat-api-cfn]
Sep 28 12:01:38 ctl02 salt-minion[14967]: -pipeline = cors cfnversionnegotiation osprofiler ec2authtoken authtoken context apicfnv1app
Sep 28 12:01:38 ctl02 salt-minion[14967]: +pipeline = cors http_proxy_to_wsgi cfnversionnegotiation osprofiler ec2authtoken authtoken context apicfnv1app
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # heat-api-cfn pipeline for standalone heat
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # relies exclusively on authenticating with ec2 signed requests
Sep 28 12:01:38 ctl02 salt-minion[14967]:  [pipeline:heat-api-cfn-standalone]
Sep 28 12:01:38 ctl02 salt-minion[14967]: -pipeline = cors cfnversionnegotiation ec2authtoken context apicfnv1app
Sep 28 12:01:38 ctl02 salt-minion[14967]: +pipeline = cors http_proxy_to_wsgi cfnversionnegotiation ec2authtoken context apicfnv1app
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # heat-api-cloudwatch pipeline
Sep 28 12:01:38 ctl02 salt-minion[14967]:  [pipeline:heat-api-cloudwatch]
Sep 28 12:01:38 ctl02 salt-minion[14967]: @@ -97,6 +104,10 @@
Sep 28 12:01:38 ctl02 salt-minion[14967]:  [filter:custombackendauth]
Sep 28 12:01:38 ctl02 salt-minion[14967]:  paste.filter_factory = heat.common.custom_backend_auth:filter_factory
Sep 28 12:01:38 ctl02 salt-minion[14967]:  
Sep 28 12:01:38 ctl02 salt-minion[14967]: +# Auth middleware that accepts any auth
Sep 28 12:01:38 ctl02 salt-minion[14967]: +[filter:noauth]
Sep 28 12:01:38 ctl02 salt-minion[14967]: +paste.filter_factory = heat.common.noauth:filter_factory
Sep 28 12:01:38 ctl02 salt-minion[14967]: +
Sep 28 12:01:38 ctl02 salt-minion[14967]:  # Middleware to set x-openstack-request-id in http response header
Sep 28 12:01:38 ctl02 salt-minion[14967]:  [filter:request_id]
Sep 28 12:01:38 ctl02 salt-minion[14967]:  paste.filter_factory = oslo_middleware.request_id:RequestId.factory
Sep 28 12:01:38 ctl02 salt-minion[14967]: [INFO    ] Completed state [/etc/heat/api-paste.ini] at time 12:01:38.804563 duration_in_ms=27.501
Sep 28 12:01:38 ctl02 salt-minion[14967]: [INFO    ] Running state [source /root/keystonercv3; heat-keystone-setup-domain --stack-user-domain-name heat_user_domain --stack-domain-admin heat_domain_admin --stack-domain-admin-password opnfv_secret] at time 12:01:38.805501
Sep 28 12:01:38 ctl02 salt-minion[14967]: [INFO    ] Executing state cmd.run for source /root/keystonercv3; heat-keystone-setup-domain --stack-user-domain-name heat_user_domain --stack-domain-admin heat_domain_admin --stack-domain-admin-password opnfv_secret
Sep 28 12:01:38 ctl02 salt-minion[14967]: [INFO    ] Executing command 'source /root/keystonercv3; heat-keystone-setup-domain --stack-user-domain-name heat_user_domain --stack-domain-admin heat_domain_admin --stack-domain-admin-password opnfv_secret' in directory '/root'
Sep 28 12:01:38 ctl02 heat-api[13008]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:01:39 ctl02 heat-api[13008]: 2017-09-28 12:01:39.035 13008 INFO heat.api [-] Starting Heat REST API on 10.167.4.12:8004
Sep 28 12:01:39 ctl02 heat-api[13008]: 2017-09-28 12:01:39.036 13008 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:01:39 ctl02 heat-api[13008]: 2017-09-28 12:01:39.037 13008 INFO heat.common.wsgi [-] Starting 4 workers
Sep 28 12:01:39 ctl02 heat-api[13008]: 2017-09-28 12:01:39.040 13008 INFO heat.common.wsgi [-] Started child 13084
Sep 28 12:01:39 ctl02 heat-api[13008]: 2017-09-28 12:01:39.041 13084 INFO eventlet.wsgi.server [-] (13084) wsgi starting up on http://10.167.4.12:8004
Sep 28 12:01:39 ctl02 heat-api[13008]: 2017-09-28 12:01:39.044 13008 INFO heat.common.wsgi [-] Started child 13085
Sep 28 12:01:39 ctl02 heat-api[13008]: 2017-09-28 12:01:39.046 13085 INFO eventlet.wsgi.server [-] (13085) wsgi starting up on http://10.167.4.12:8004
Sep 28 12:01:39 ctl02 heat-api[13008]: 2017-09-28 12:01:39.048 13008 INFO heat.common.wsgi [-] Started child 13086
Sep 28 12:01:39 ctl02 heat-api[13008]: 2017-09-28 12:01:39.049 13086 INFO eventlet.wsgi.server [-] (13086) wsgi starting up on http://10.167.4.12:8004
Sep 28 12:01:39 ctl02 heat-api[13008]: 2017-09-28 12:01:39.051 13008 INFO heat.common.wsgi [-] Started child 13087
Sep 28 12:01:39 ctl02 heat-api[13008]: 2017-09-28 12:01:39.053 13087 INFO eventlet.wsgi.server [-] (13087) wsgi starting up on http://10.167.4.12:8004
Sep 28 12:01:39 ctl02 nova-api[12927]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:01:39 ctl02 nova-api[12927]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:01:39 ctl02 glance-api[29183]: 2017-09-28 12:01:39.155 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:01:39] "OPTIONS / HTTP/1.0" 200 134 0.000586
Sep 28 12:01:39 ctl02 nova-api[12927]: 2017-09-28 12:01:39.233 12927 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:01:39 ctl02 nova-api[12927]: 2017-09-28 12:01:39.234 12927 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:01:39 ctl02 nova-api[12927]: 2017-09-28 12:01:39.234 12927 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:01:39 ctl02 nova-api[12927]: 2017-09-28 12:01:39.234 12927 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:01:39 ctl02 nova-api[12927]: 2017-09-28 12:01:39.234 12927 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:01:39 ctl02 nova-api[12927]: 2017-09-28 12:01:39.234 12927 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:01:39 ctl02 nova-api[12927]: 2017-09-28 12:01:39.234 12927 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:01:39 ctl02 nova-api[12927]: 2017-09-28 12:01:39.234 12927 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:01:39 ctl02 nova-api[12927]: 2017-09-28 12:01:39.234 12927 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:01:39 ctl02 nova-api[12927]: 2017-09-28 12:01:39.234 12927 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:01:39 ctl02 nova-api[12927]: 2017-09-28 12:01:39.234 12927 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:01:39 ctl02 nova-api[12927]: 2017-09-28 12:01:39.234 12927 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:01:39 ctl02 nova-api[12927]: 2017-09-28 12:01:39.234 12927 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:01:39 ctl02 nova-api[12927]: 2017-09-28 12:01:39.234 12927 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:01:39 ctl02 nova-api[12927]: 2017-09-28 12:01:39.234 12927 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:01:39 ctl02 nova-api[12927]: 2017-09-28 12:01:39.234 12927 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:01:39 ctl02 nova-api[12927]: 2017-09-28 12:01:39.234 12927 ERROR nova.wsgi     self.filename))
Sep 28 12:01:39 ctl02 nova-api[12927]: 2017-09-28 12:01:39.234 12927 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:01:39 ctl02 nova-api[12927]: 2017-09-28 12:01:39.234 12927 ERROR nova.wsgi
Sep 28 12:01:39 ctl02 nova-api[12927]: 2017-09-28 12:01:39.235 12927 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:01:39 ctl02 heat-engine[12803]: 2017-09-28 12:01:39.279 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 4 seconds.
Sep 28 12:01:39 ctl02 heat-engine[12803]: 2017-09-28 12:01:39.314 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 4 seconds.
Sep 28 12:01:39 ctl02 heat-engine[12803]: 2017-09-28 12:01:39.316 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 4 seconds.
Sep 28 12:01:39 ctl02 heat-engine[12803]: 2017-09-28 12:01:39.319 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 4 seconds.
Sep 28 12:01:39 ctl02 nova-api[12927]: 2017-09-28 12:01:39.369 12927 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:01:39 ctl02 nova-api[12927]: 2017-09-28 12:01:39.588 12927 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:01:39 ctl02 nova-api[12927]: 2017-09-28 12:01:39.591 12927 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:01:39 ctl02 nova-api[12927]: 2017-09-28 12:01:39.591 12927 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:01:39 ctl02 nova-api[12927]: 2017-09-28 12:01:39.592 12927 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:01:39 ctl02 nova-api[12927]: 2017-09-28 12:01:39.724 12927 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:01:39 ctl02 nova-api[12927]: 2017-09-28 12:01:39.727 12927 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:01:39 ctl02 nova-api[12927]: 2017-09-28 12:01:39.727 12927 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:01:39 ctl02 nova-api[12927]: 2017-09-28 12:01:39.728 12927 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:01:39 ctl02 nova-api[12927]: 2017-09-28 12:01:39.731 12927 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:01:39 ctl02 nova-api[12927]: 2017-09-28 12:01:39.731 12927 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:01:39 ctl02 nova-api[12927]: 2017-09-28 12:01:39.731 12927 ERROR nova Traceback (most recent call last):
Sep 28 12:01:39 ctl02 nova-api[12927]: 2017-09-28 12:01:39.731 12927 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:01:39 ctl02 nova-api[12927]: 2017-09-28 12:01:39.731 12927 ERROR nova     sys.exit(main())
Sep 28 12:01:39 ctl02 nova-api[12927]: 2017-09-28 12:01:39.731 12927 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:01:39 ctl02 nova-api[12927]: 2017-09-28 12:01:39.731 12927 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:01:39 ctl02 nova-api[12927]: 2017-09-28 12:01:39.731 12927 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:01:39 ctl02 nova-api[12927]: 2017-09-28 12:01:39.731 12927 ERROR nova     max_url_len=max_url_len)
Sep 28 12:01:39 ctl02 nova-api[12927]: 2017-09-28 12:01:39.731 12927 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:01:39 ctl02 nova-api[12927]: 2017-09-28 12:01:39.731 12927 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:01:39 ctl02 nova-api[12927]: 2017-09-28 12:01:39.731 12927 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:01:39 ctl02 nova-api[12927]: 2017-09-28 12:01:39.731 12927 ERROR nova     sock.listen(backlog)
Sep 28 12:01:39 ctl02 nova-api[12927]: 2017-09-28 12:01:39.731 12927 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:01:39 ctl02 nova-api[12927]: 2017-09-28 12:01:39.731 12927 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:01:39 ctl02 nova-api[12927]: 2017-09-28 12:01:39.731 12927 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:01:39 ctl02 nova-api[12927]: 2017-09-28 12:01:39.731 12927 ERROR nova
Sep 28 12:01:39 ctl02 nova-cert[4860]: 2017-09-28 12:01:39.760 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:01:39 ctl02 salt-minion[14967]: [INFO    ] {'pid': 13077, 'retcode': 0, 'stderr': '2017-09-28 12:01:39.481 13078 WARNING oslo_config.cfg [-] Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.\n2017-09-28 12:01:39.675 13078 INFO __main__ [-] Creating domain heat_user_domain\n2017-09-28 12:01:39.694 13078 WARNING __main__ [-] Domain heat_user_domain already exists\n2017-09-28 12:01:39.740 13078 WARNING __main__ [-] User heat_domain_admin already exists', 'stdout': '\nPlease update your heat.conf with the following in [DEFAULT]\n\nstack_user_domain_id=30ff54e253c5446c8ddae768de19bb64\nstack_domain_admin=heat_domain_admin\nstack_domain_admin_password=opnfv_secret'}
Sep 28 12:01:39 ctl02 salt-minion[14967]: [INFO    ] Completed state [source /root/keystonercv3; heat-keystone-setup-domain --stack-user-domain-name heat_user_domain --stack-domain-admin heat_domain_admin --stack-domain-admin-password opnfv_secret] at time 12:01:39.841420 duration_in_ms=1035.917
Sep 28 12:01:39 ctl02 salt-minion[14967]: [INFO    ] Running state [heat-manage db_sync] at time 12:01:39.842252
Sep 28 12:01:39 ctl02 salt-minion[14967]: [INFO    ] Executing state cmd.run for heat-manage db_sync
Sep 28 12:01:39 ctl02 salt-minion[14967]: [INFO    ] Executing command 'heat-manage db_sync' in directory '/root'
Sep 28 12:01:39 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:01:39 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:01:39 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:01:40 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:01:40 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:01:40 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:01:40 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:01:40 ctl02 salt-minion[14967]: [ERROR   ] Command 'heat-manage db_sync' failed with return code: 1
Sep 28 12:01:40 ctl02 salt-minion[14967]: [ERROR   ] stderr: 2017-09-28 12:01:40.655 13093 WARNING oslo_config.cfg [-] Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:01:40 ctl02 salt-minion[14967]: ERROR: <VerNum(79)>
Sep 28 12:01:40 ctl02 salt-minion[14967]: [ERROR   ] retcode: 1
Sep 28 12:01:40 ctl02 salt-minion[14967]: [ERROR   ] {'pid': 13092, 'retcode': 1, 'stderr': '2017-09-28 12:01:40.655 13093 WARNING oslo_config.cfg [-] Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.\nERROR: <VerNum(79)>', 'stdout': ''}
Sep 28 12:01:40 ctl02 salt-minion[14967]: [INFO    ] Completed state [heat-manage db_sync] at time 12:01:40.741098 duration_in_ms=898.844
Sep 28 12:01:40 ctl02 salt-minion[14967]: [INFO    ] Running state [chown heat:heat /var/log/heat/ -R] at time 12:01:40.741891
Sep 28 12:01:40 ctl02 salt-minion[14967]: [INFO    ] Executing state cmd.run for chown heat:heat /var/log/heat/ -R
Sep 28 12:01:40 ctl02 salt-minion[14967]: [INFO    ] Executing command 'chown heat:heat /var/log/heat/ -R' in directory '/root'
Sep 28 12:01:40 ctl02 salt-minion[14967]: [INFO    ] {'pid': 13116, 'retcode': 0, 'stderr': '', 'stdout': ''}
Sep 28 12:01:40 ctl02 salt-minion[14967]: [INFO    ] Completed state [chown heat:heat /var/log/heat/ -R] at time 12:01:40.755184 duration_in_ms=13.292
Sep 28 12:01:40 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928115909631205
Sep 28 12:01:40 ctl02 heat-api[13008]: 2017-09-28 12:01:40.898 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:01:40] "OPTIONS / HTTP/1.0" 200 134 0.001467
Sep 28 12:01:41 ctl02 heat-api[13008]: 2017-09-28 12:01:41.132 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:01:41] "OPTIONS / HTTP/1.0" 200 134 0.001533
Sep 28 12:01:41 ctl02 heat-api[13008]: 2017-09-28 12:01:41.191 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:01:41] "OPTIONS / HTTP/1.0" 200 134 0.001454
Sep 28 12:01:41 ctl02 nova-api[13107]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:01:41 ctl02 nova-api[13107]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:01:41 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command test.ping with jid 20170928120141911888
Sep 28 12:01:41 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 13125
Sep 28 12:01:41 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928120141911888
Sep 28 12:01:41 ctl02 nova-api[13107]: 2017-09-28 12:01:41.971 13107 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:01:41 ctl02 nova-api[13107]: 2017-09-28 12:01:41.972 13107 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:01:41 ctl02 nova-api[13107]: 2017-09-28 12:01:41.972 13107 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:01:41 ctl02 nova-api[13107]: 2017-09-28 12:01:41.972 13107 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:01:41 ctl02 nova-api[13107]: 2017-09-28 12:01:41.972 13107 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:01:41 ctl02 nova-api[13107]: 2017-09-28 12:01:41.972 13107 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:01:41 ctl02 nova-api[13107]: 2017-09-28 12:01:41.972 13107 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:01:41 ctl02 nova-api[13107]: 2017-09-28 12:01:41.972 13107 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:01:41 ctl02 nova-api[13107]: 2017-09-28 12:01:41.972 13107 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:01:41 ctl02 nova-api[13107]: 2017-09-28 12:01:41.972 13107 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:01:41 ctl02 nova-api[13107]: 2017-09-28 12:01:41.972 13107 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:01:41 ctl02 nova-api[13107]: 2017-09-28 12:01:41.972 13107 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:01:41 ctl02 nova-api[13107]: 2017-09-28 12:01:41.972 13107 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:01:41 ctl02 nova-api[13107]: 2017-09-28 12:01:41.972 13107 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:01:41 ctl02 nova-api[13107]: 2017-09-28 12:01:41.972 13107 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:01:41 ctl02 nova-api[13107]: 2017-09-28 12:01:41.972 13107 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:01:41 ctl02 nova-api[13107]: 2017-09-28 12:01:41.972 13107 ERROR nova.wsgi     self.filename))
Sep 28 12:01:41 ctl02 nova-api[13107]: 2017-09-28 12:01:41.972 13107 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:01:41 ctl02 nova-api[13107]: 2017-09-28 12:01:41.972 13107 ERROR nova.wsgi
Sep 28 12:01:41 ctl02 nova-api[13107]: 2017-09-28 12:01:41.973 13107 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:01:42 ctl02 nova-api[13107]: 2017-09-28 12:01:42.099 13107 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:01:42 ctl02 nova-conductor[5056]: 2017-09-28 12:01:42.250 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:01:42 ctl02 nova-conductor[5056]: 2017-09-28 12:01:42.270 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:01:42 ctl02 nova-conductor[5056]: 2017-09-28 12:01:42.281 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:01:42 ctl02 nova-conductor[5056]: 2017-09-28 12:01:42.286 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:01:42 ctl02 nova-api[13107]: 2017-09-28 12:01:42.339 13107 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:01:42 ctl02 nova-api[13107]: 2017-09-28 12:01:42.342 13107 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:01:42 ctl02 nova-api[13107]: 2017-09-28 12:01:42.342 13107 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:01:42 ctl02 nova-api[13107]: 2017-09-28 12:01:42.343 13107 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:01:42 ctl02 nova-api[13107]: 2017-09-28 12:01:42.475 13107 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:01:42 ctl02 nova-api[13107]: 2017-09-28 12:01:42.477 13107 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:01:42 ctl02 nova-api[13107]: 2017-09-28 12:01:42.477 13107 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:01:42 ctl02 nova-api[13107]: 2017-09-28 12:01:42.478 13107 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:01:42 ctl02 nova-api[13107]: 2017-09-28 12:01:42.481 13107 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:01:42 ctl02 nova-api[13107]: 2017-09-28 12:01:42.481 13107 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:01:42 ctl02 nova-api[13107]: 2017-09-28 12:01:42.481 13107 ERROR nova Traceback (most recent call last):
Sep 28 12:01:42 ctl02 nova-api[13107]: 2017-09-28 12:01:42.481 13107 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:01:42 ctl02 nova-api[13107]: 2017-09-28 12:01:42.481 13107 ERROR nova     sys.exit(main())
Sep 28 12:01:42 ctl02 nova-api[13107]: 2017-09-28 12:01:42.481 13107 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:01:42 ctl02 nova-api[13107]: 2017-09-28 12:01:42.481 13107 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:01:42 ctl02 nova-api[13107]: 2017-09-28 12:01:42.481 13107 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:01:42 ctl02 nova-api[13107]: 2017-09-28 12:01:42.481 13107 ERROR nova     max_url_len=max_url_len)
Sep 28 12:01:42 ctl02 nova-api[13107]: 2017-09-28 12:01:42.481 13107 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:01:42 ctl02 nova-api[13107]: 2017-09-28 12:01:42.481 13107 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:01:42 ctl02 nova-api[13107]: 2017-09-28 12:01:42.481 13107 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:01:42 ctl02 nova-api[13107]: 2017-09-28 12:01:42.481 13107 ERROR nova     sock.listen(backlog)
Sep 28 12:01:42 ctl02 nova-api[13107]: 2017-09-28 12:01:42.481 13107 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:01:42 ctl02 nova-api[13107]: 2017-09-28 12:01:42.481 13107 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:01:42 ctl02 nova-api[13107]: 2017-09-28 12:01:42.481 13107 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:01:42 ctl02 nova-api[13107]: 2017-09-28 12:01:42.481 13107 ERROR nova
Sep 28 12:01:42 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:01:42 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:01:42 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:01:42 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:01:42 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:01:42 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:01:42 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:01:42 ctl02 heat-api[13008]: 2017-09-28 12:01:42.927 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:01:42] "OPTIONS / HTTP/1.0" 200 134 0.000733
Sep 28 12:01:43 ctl02 heat-api[13008]: 2017-09-28 12:01:43.099 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:01:43] "OPTIONS / HTTP/1.0" 200 134 0.000563
Sep 28 12:01:43 ctl02 heat-api[13008]: 2017-09-28 12:01:43.222 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:01:43] "OPTIONS / HTTP/1.0" 200 134 0.000654
Sep 28 12:01:43 ctl02 heat-engine[12803]: 2017-09-28 12:01:43.284 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 6 seconds.
Sep 28 12:01:43 ctl02 heat-engine[12803]: 2017-09-28 12:01:43.320 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 6 seconds.
Sep 28 12:01:43 ctl02 heat-engine[12803]: 2017-09-28 12:01:43.322 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 6 seconds.
Sep 28 12:01:43 ctl02 heat-engine[12803]: 2017-09-28 12:01:43.326 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 6 seconds.
Sep 28 12:01:43 ctl02 glance-api[29183]: 2017-09-28 12:01:43.941 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:01:43] "OPTIONS / HTTP/1.0" 200 134 0.000582
Sep 28 12:01:44 ctl02 nova-api[13135]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:01:44 ctl02 nova-api[13135]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:01:44 ctl02 nova-api[13135]: 2017-09-28 12:01:44.676 13135 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:01:44 ctl02 nova-api[13135]: 2017-09-28 12:01:44.678 13135 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:01:44 ctl02 nova-api[13135]: 2017-09-28 12:01:44.678 13135 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:01:44 ctl02 nova-api[13135]: 2017-09-28 12:01:44.678 13135 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:01:44 ctl02 nova-api[13135]: 2017-09-28 12:01:44.678 13135 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:01:44 ctl02 nova-api[13135]: 2017-09-28 12:01:44.678 13135 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:01:44 ctl02 nova-api[13135]: 2017-09-28 12:01:44.678 13135 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:01:44 ctl02 nova-api[13135]: 2017-09-28 12:01:44.678 13135 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:01:44 ctl02 nova-api[13135]: 2017-09-28 12:01:44.678 13135 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:01:44 ctl02 nova-api[13135]: 2017-09-28 12:01:44.678 13135 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:01:44 ctl02 nova-api[13135]: 2017-09-28 12:01:44.678 13135 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:01:44 ctl02 nova-api[13135]: 2017-09-28 12:01:44.678 13135 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:01:44 ctl02 nova-api[13135]: 2017-09-28 12:01:44.678 13135 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:01:44 ctl02 nova-api[13135]: 2017-09-28 12:01:44.678 13135 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:01:44 ctl02 nova-api[13135]: 2017-09-28 12:01:44.678 13135 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:01:44 ctl02 nova-api[13135]: 2017-09-28 12:01:44.678 13135 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:01:44 ctl02 nova-api[13135]: 2017-09-28 12:01:44.678 13135 ERROR nova.wsgi     self.filename))
Sep 28 12:01:44 ctl02 nova-api[13135]: 2017-09-28 12:01:44.678 13135 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:01:44 ctl02 nova-api[13135]: 2017-09-28 12:01:44.678 13135 ERROR nova.wsgi
Sep 28 12:01:44 ctl02 nova-api[13135]: 2017-09-28 12:01:44.679 13135 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:01:44 ctl02 nova-api[13135]: 2017-09-28 12:01:44.805 13135 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:01:44 ctl02 heat-api[13008]: 2017-09-28 12:01:44.947 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:01:44] "OPTIONS / HTTP/1.0" 200 134 0.000611
Sep 28 12:01:45 ctl02 nova-api[13135]: 2017-09-28 12:01:45.038 13135 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:01:45 ctl02 nova-api[13135]: 2017-09-28 12:01:45.040 13135 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:01:45 ctl02 nova-api[13135]: 2017-09-28 12:01:45.040 13135 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:01:45 ctl02 nova-api[13135]: 2017-09-28 12:01:45.040 13135 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:01:45 ctl02 heat-api[13008]: 2017-09-28 12:01:45.047 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:01:45] "OPTIONS / HTTP/1.0" 200 134 0.000605
Sep 28 12:01:45 ctl02 nova-api[13135]: 2017-09-28 12:01:45.172 13135 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:01:45 ctl02 nova-api[13135]: 2017-09-28 12:01:45.174 13135 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:01:45 ctl02 nova-api[13135]: 2017-09-28 12:01:45.174 13135 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:01:45 ctl02 nova-api[13135]: 2017-09-28 12:01:45.174 13135 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:01:45 ctl02 nova-api[13135]: 2017-09-28 12:01:45.177 13135 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:01:45 ctl02 nova-api[13135]: 2017-09-28 12:01:45.178 13135 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:01:45 ctl02 nova-api[13135]: 2017-09-28 12:01:45.178 13135 ERROR nova Traceback (most recent call last):
Sep 28 12:01:45 ctl02 nova-api[13135]: 2017-09-28 12:01:45.178 13135 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:01:45 ctl02 nova-api[13135]: 2017-09-28 12:01:45.178 13135 ERROR nova     sys.exit(main())
Sep 28 12:01:45 ctl02 nova-api[13135]: 2017-09-28 12:01:45.178 13135 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:01:45 ctl02 nova-api[13135]: 2017-09-28 12:01:45.178 13135 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:01:45 ctl02 nova-api[13135]: 2017-09-28 12:01:45.178 13135 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:01:45 ctl02 nova-api[13135]: 2017-09-28 12:01:45.178 13135 ERROR nova     max_url_len=max_url_len)
Sep 28 12:01:45 ctl02 nova-api[13135]: 2017-09-28 12:01:45.178 13135 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:01:45 ctl02 nova-api[13135]: 2017-09-28 12:01:45.178 13135 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:01:45 ctl02 nova-api[13135]: 2017-09-28 12:01:45.178 13135 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:01:45 ctl02 nova-api[13135]: 2017-09-28 12:01:45.178 13135 ERROR nova     sock.listen(backlog)
Sep 28 12:01:45 ctl02 nova-api[13135]: 2017-09-28 12:01:45.178 13135 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:01:45 ctl02 nova-api[13135]: 2017-09-28 12:01:45.178 13135 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:01:45 ctl02 nova-api[13135]: 2017-09-28 12:01:45.178 13135 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:01:45 ctl02 nova-api[13135]: 2017-09-28 12:01:45.178 13135 ERROR nova
Sep 28 12:01:45 ctl02 heat-api[13008]: 2017-09-28 12:01:45.232 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:01:45] "OPTIONS / HTTP/1.0" 200 134 0.000637
Sep 28 12:01:45 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:01:45 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:01:45 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:01:45 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb476bb03)
Sep 28 12:01:45 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:01:45 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:01:45 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:01:45 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:01:46 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb476bb03)
Sep 28 12:01:47 ctl02 glance-api[29183]: 2017-09-28 12:01:47.084 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:01:47] "OPTIONS / HTTP/1.0" 200 134 0.000591
Sep 28 12:01:47 ctl02 nova-api[13153]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:01:47 ctl02 nova-api[13153]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:01:47 ctl02 nova-api[13153]: 2017-09-28 12:01:47.441 13153 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:01:47 ctl02 nova-api[13153]: 2017-09-28 12:01:47.442 13153 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:01:47 ctl02 nova-api[13153]: 2017-09-28 12:01:47.442 13153 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:01:47 ctl02 nova-api[13153]: 2017-09-28 12:01:47.442 13153 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:01:47 ctl02 nova-api[13153]: 2017-09-28 12:01:47.442 13153 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:01:47 ctl02 nova-api[13153]: 2017-09-28 12:01:47.442 13153 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:01:47 ctl02 nova-api[13153]: 2017-09-28 12:01:47.442 13153 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:01:47 ctl02 nova-api[13153]: 2017-09-28 12:01:47.442 13153 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:01:47 ctl02 nova-api[13153]: 2017-09-28 12:01:47.442 13153 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:01:47 ctl02 nova-api[13153]: 2017-09-28 12:01:47.442 13153 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:01:47 ctl02 nova-api[13153]: 2017-09-28 12:01:47.442 13153 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:01:47 ctl02 nova-api[13153]: 2017-09-28 12:01:47.442 13153 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:01:47 ctl02 nova-api[13153]: 2017-09-28 12:01:47.442 13153 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:01:47 ctl02 nova-api[13153]: 2017-09-28 12:01:47.442 13153 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:01:47 ctl02 nova-api[13153]: 2017-09-28 12:01:47.442 13153 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:01:47 ctl02 nova-api[13153]: 2017-09-28 12:01:47.442 13153 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:01:47 ctl02 nova-api[13153]: 2017-09-28 12:01:47.442 13153 ERROR nova.wsgi     self.filename))
Sep 28 12:01:47 ctl02 nova-api[13153]: 2017-09-28 12:01:47.442 13153 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:01:47 ctl02 nova-api[13153]: 2017-09-28 12:01:47.442 13153 ERROR nova.wsgi
Sep 28 12:01:47 ctl02 nova-api[13153]: 2017-09-28 12:01:47.443 13153 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:01:47 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb476bb03)
Sep 28 12:01:47 ctl02 nova-api[13153]: 2017-09-28 12:01:47.571 13153 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:01:47 ctl02 nova-api[13153]: 2017-09-28 12:01:47.806 13153 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:01:47 ctl02 nova-api[13153]: 2017-09-28 12:01:47.809 13153 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:01:47 ctl02 nova-api[13153]: 2017-09-28 12:01:47.809 13153 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:01:47 ctl02 nova-api[13153]: 2017-09-28 12:01:47.809 13153 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:01:47 ctl02 nova-api[13153]: 2017-09-28 12:01:47.939 13153 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:01:47 ctl02 nova-api[13153]: 2017-09-28 12:01:47.941 13153 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:01:47 ctl02 nova-api[13153]: 2017-09-28 12:01:47.941 13153 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:01:47 ctl02 nova-api[13153]: 2017-09-28 12:01:47.942 13153 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:01:47 ctl02 nova-api[13153]: 2017-09-28 12:01:47.945 13153 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:01:47 ctl02 nova-api[13153]: 2017-09-28 12:01:47.945 13153 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:01:47 ctl02 nova-api[13153]: 2017-09-28 12:01:47.945 13153 ERROR nova Traceback (most recent call last):
Sep 28 12:01:47 ctl02 nova-api[13153]: 2017-09-28 12:01:47.945 13153 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:01:47 ctl02 nova-api[13153]: 2017-09-28 12:01:47.945 13153 ERROR nova     sys.exit(main())
Sep 28 12:01:47 ctl02 nova-api[13153]: 2017-09-28 12:01:47.945 13153 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:01:47 ctl02 nova-api[13153]: 2017-09-28 12:01:47.945 13153 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:01:47 ctl02 nova-api[13153]: 2017-09-28 12:01:47.945 13153 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:01:47 ctl02 nova-api[13153]: 2017-09-28 12:01:47.945 13153 ERROR nova     max_url_len=max_url_len)
Sep 28 12:01:47 ctl02 nova-api[13153]: 2017-09-28 12:01:47.945 13153 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:01:47 ctl02 nova-api[13153]: 2017-09-28 12:01:47.945 13153 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:01:47 ctl02 nova-api[13153]: 2017-09-28 12:01:47.945 13153 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:01:47 ctl02 nova-api[13153]: 2017-09-28 12:01:47.945 13153 ERROR nova     sock.listen(backlog)
Sep 28 12:01:47 ctl02 nova-api[13153]: 2017-09-28 12:01:47.945 13153 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:01:47 ctl02 nova-api[13153]: 2017-09-28 12:01:47.945 13153 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:01:47 ctl02 nova-api[13153]: 2017-09-28 12:01:47.945 13153 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:01:47 ctl02 nova-api[13153]: 2017-09-28 12:01:47.945 13153 ERROR nova
Sep 28 12:01:48 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:01:48 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:01:48 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:01:48 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:01:48 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:01:48 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:01:48 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:01:48 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb476bb03)
Sep 28 12:01:49 ctl02 glance-api[29183]: 2017-09-28 12:01:49.035 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:01:49] "OPTIONS / HTTP/1.0" 200 134 0.000600
Sep 28 12:01:49 ctl02 heat-engine[12803]: 2017-09-28 12:01:49.289 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 8 seconds.
Sep 28 12:01:49 ctl02 heat-engine[12803]: 2017-09-28 12:01:49.325 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 8 seconds.
Sep 28 12:01:49 ctl02 heat-engine[12803]: 2017-09-28 12:01:49.327 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 8 seconds.
Sep 28 12:01:49 ctl02 heat-engine[12803]: 2017-09-28 12:01:49.332 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 8 seconds.
Sep 28 12:01:49 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb476bb03)
Sep 28 12:01:49 ctl02 nova-consoleauth[5433]: 2017-09-28 12:01:49.650 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:01:50 ctl02 nova-api[13171]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:01:50 ctl02 nova-api[13171]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:01:50 ctl02 nova-api[13171]: 2017-09-28 12:01:50.178 13171 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:01:50 ctl02 nova-api[13171]: 2017-09-28 12:01:50.179 13171 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:01:50 ctl02 nova-api[13171]: 2017-09-28 12:01:50.179 13171 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:01:50 ctl02 nova-api[13171]: 2017-09-28 12:01:50.179 13171 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:01:50 ctl02 nova-api[13171]: 2017-09-28 12:01:50.179 13171 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:01:50 ctl02 nova-api[13171]: 2017-09-28 12:01:50.179 13171 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:01:50 ctl02 nova-api[13171]: 2017-09-28 12:01:50.179 13171 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:01:50 ctl02 nova-api[13171]: 2017-09-28 12:01:50.179 13171 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:01:50 ctl02 nova-api[13171]: 2017-09-28 12:01:50.179 13171 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:01:50 ctl02 nova-api[13171]: 2017-09-28 12:01:50.179 13171 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:01:50 ctl02 nova-api[13171]: 2017-09-28 12:01:50.179 13171 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:01:50 ctl02 nova-api[13171]: 2017-09-28 12:01:50.179 13171 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:01:50 ctl02 nova-api[13171]: 2017-09-28 12:01:50.179 13171 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:01:50 ctl02 nova-api[13171]: 2017-09-28 12:01:50.179 13171 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:01:50 ctl02 nova-api[13171]: 2017-09-28 12:01:50.179 13171 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:01:50 ctl02 nova-api[13171]: 2017-09-28 12:01:50.179 13171 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:01:50 ctl02 nova-api[13171]: 2017-09-28 12:01:50.179 13171 ERROR nova.wsgi     self.filename))
Sep 28 12:01:50 ctl02 nova-api[13171]: 2017-09-28 12:01:50.179 13171 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:01:50 ctl02 nova-api[13171]: 2017-09-28 12:01:50.179 13171 ERROR nova.wsgi
Sep 28 12:01:50 ctl02 nova-api[13171]: 2017-09-28 12:01:50.180 13171 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:01:50 ctl02 nova-api[13171]: 2017-09-28 12:01:50.307 13171 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:01:50 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb476bb03)
Sep 28 12:01:50 ctl02 nova-api[13171]: 2017-09-28 12:01:50.546 13171 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:01:50 ctl02 nova-api[13171]: 2017-09-28 12:01:50.548 13171 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:01:50 ctl02 nova-api[13171]: 2017-09-28 12:01:50.548 13171 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:01:50 ctl02 nova-api[13171]: 2017-09-28 12:01:50.549 13171 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:01:50 ctl02 nova-api[13171]: 2017-09-28 12:01:50.678 13171 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:01:50 ctl02 nova-api[13171]: 2017-09-28 12:01:50.679 13171 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:01:50 ctl02 nova-api[13171]: 2017-09-28 12:01:50.680 13171 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:01:50 ctl02 nova-api[13171]: 2017-09-28 12:01:50.680 13171 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:01:50 ctl02 nova-api[13171]: 2017-09-28 12:01:50.683 13171 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:01:50 ctl02 nova-api[13171]: 2017-09-28 12:01:50.683 13171 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:01:50 ctl02 nova-api[13171]: 2017-09-28 12:01:50.683 13171 ERROR nova Traceback (most recent call last):
Sep 28 12:01:50 ctl02 nova-api[13171]: 2017-09-28 12:01:50.683 13171 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:01:50 ctl02 nova-api[13171]: 2017-09-28 12:01:50.683 13171 ERROR nova     sys.exit(main())
Sep 28 12:01:50 ctl02 nova-api[13171]: 2017-09-28 12:01:50.683 13171 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:01:50 ctl02 nova-api[13171]: 2017-09-28 12:01:50.683 13171 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:01:50 ctl02 nova-api[13171]: 2017-09-28 12:01:50.683 13171 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:01:50 ctl02 nova-api[13171]: 2017-09-28 12:01:50.683 13171 ERROR nova     max_url_len=max_url_len)
Sep 28 12:01:50 ctl02 nova-api[13171]: 2017-09-28 12:01:50.683 13171 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:01:50 ctl02 nova-api[13171]: 2017-09-28 12:01:50.683 13171 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:01:50 ctl02 nova-api[13171]: 2017-09-28 12:01:50.683 13171 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:01:50 ctl02 nova-api[13171]: 2017-09-28 12:01:50.683 13171 ERROR nova     sock.listen(backlog)
Sep 28 12:01:50 ctl02 nova-api[13171]: 2017-09-28 12:01:50.683 13171 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:01:50 ctl02 nova-api[13171]: 2017-09-28 12:01:50.683 13171 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:01:50 ctl02 nova-api[13171]: 2017-09-28 12:01:50.683 13171 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:01:50 ctl02 nova-api[13171]: 2017-09-28 12:01:50.683 13171 ERROR nova
Sep 28 12:01:50 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:01:50 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:01:50 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:01:51 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:01:51 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:01:51 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:01:51 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:01:51 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb476bb03)
Sep 28 12:01:52 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb476bb03)
Sep 28 12:01:52 ctl02 nova-scheduler[5620]: 2017-09-28 12:01:52.674 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:01:52 ctl02 nova-api[13189]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:01:52 ctl02 nova-api[13189]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:01:52 ctl02 nova-api[13189]: 2017-09-28 12:01:52.966 13189 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:01:52 ctl02 nova-api[13189]: 2017-09-28 12:01:52.967 13189 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:01:52 ctl02 nova-api[13189]: 2017-09-28 12:01:52.967 13189 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:01:52 ctl02 nova-api[13189]: 2017-09-28 12:01:52.967 13189 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:01:52 ctl02 nova-api[13189]: 2017-09-28 12:01:52.967 13189 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:01:52 ctl02 nova-api[13189]: 2017-09-28 12:01:52.967 13189 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:01:52 ctl02 nova-api[13189]: 2017-09-28 12:01:52.967 13189 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:01:52 ctl02 nova-api[13189]: 2017-09-28 12:01:52.967 13189 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:01:52 ctl02 nova-api[13189]: 2017-09-28 12:01:52.967 13189 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:01:52 ctl02 nova-api[13189]: 2017-09-28 12:01:52.967 13189 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:01:52 ctl02 nova-api[13189]: 2017-09-28 12:01:52.967 13189 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:01:52 ctl02 nova-api[13189]: 2017-09-28 12:01:52.967 13189 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:01:52 ctl02 nova-api[13189]: 2017-09-28 12:01:52.967 13189 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:01:52 ctl02 nova-api[13189]: 2017-09-28 12:01:52.967 13189 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:01:52 ctl02 nova-api[13189]: 2017-09-28 12:01:52.967 13189 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:01:52 ctl02 nova-api[13189]: 2017-09-28 12:01:52.967 13189 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:01:52 ctl02 nova-api[13189]: 2017-09-28 12:01:52.967 13189 ERROR nova.wsgi     self.filename))
Sep 28 12:01:52 ctl02 nova-api[13189]: 2017-09-28 12:01:52.967 13189 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:01:52 ctl02 nova-api[13189]: 2017-09-28 12:01:52.967 13189 ERROR nova.wsgi
Sep 28 12:01:52 ctl02 nova-api[13189]: 2017-09-28 12:01:52.968 13189 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:01:53 ctl02 nova-api[13189]: 2017-09-28 12:01:53.101 13189 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:01:53 ctl02 nova-api[13189]: 2017-09-28 12:01:53.334 13189 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:01:53 ctl02 nova-api[13189]: 2017-09-28 12:01:53.337 13189 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:01:53 ctl02 nova-api[13189]: 2017-09-28 12:01:53.337 13189 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:01:53 ctl02 nova-api[13189]: 2017-09-28 12:01:53.337 13189 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:01:53 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb476bb03)
Sep 28 12:01:53 ctl02 nova-api[13189]: 2017-09-28 12:01:53.469 13189 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:01:53 ctl02 nova-api[13189]: 2017-09-28 12:01:53.471 13189 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:01:53 ctl02 nova-api[13189]: 2017-09-28 12:01:53.471 13189 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:01:53 ctl02 nova-api[13189]: 2017-09-28 12:01:53.471 13189 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:01:53 ctl02 nova-api[13189]: 2017-09-28 12:01:53.474 13189 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:01:53 ctl02 nova-api[13189]: 2017-09-28 12:01:53.475 13189 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:01:53 ctl02 nova-api[13189]: 2017-09-28 12:01:53.475 13189 ERROR nova Traceback (most recent call last):
Sep 28 12:01:53 ctl02 nova-api[13189]: 2017-09-28 12:01:53.475 13189 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:01:53 ctl02 nova-api[13189]: 2017-09-28 12:01:53.475 13189 ERROR nova     sys.exit(main())
Sep 28 12:01:53 ctl02 nova-api[13189]: 2017-09-28 12:01:53.475 13189 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:01:53 ctl02 nova-api[13189]: 2017-09-28 12:01:53.475 13189 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:01:53 ctl02 nova-api[13189]: 2017-09-28 12:01:53.475 13189 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:01:53 ctl02 nova-api[13189]: 2017-09-28 12:01:53.475 13189 ERROR nova     max_url_len=max_url_len)
Sep 28 12:01:53 ctl02 nova-api[13189]: 2017-09-28 12:01:53.475 13189 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:01:53 ctl02 nova-api[13189]: 2017-09-28 12:01:53.475 13189 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:01:53 ctl02 nova-api[13189]: 2017-09-28 12:01:53.475 13189 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:01:53 ctl02 nova-api[13189]: 2017-09-28 12:01:53.475 13189 ERROR nova     sock.listen(backlog)
Sep 28 12:01:53 ctl02 nova-api[13189]: 2017-09-28 12:01:53.475 13189 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:01:53 ctl02 nova-api[13189]: 2017-09-28 12:01:53.475 13189 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:01:53 ctl02 nova-api[13189]: 2017-09-28 12:01:53.475 13189 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:01:53 ctl02 nova-api[13189]: 2017-09-28 12:01:53.475 13189 ERROR nova
Sep 28 12:01:53 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:01:53 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:01:53 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:01:53 ctl02 glance-api[29183]: 2017-09-28 12:01:53.621 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:01:53] "OPTIONS / HTTP/1.0" 200 134 0.000675
Sep 28 12:01:53 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:01:53 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:01:53 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:01:53 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:01:54 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb476bb03)
Sep 28 12:01:54 ctl02 heat-api[13008]: 2017-09-28 12:01:54.644 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:01:54] "OPTIONS / HTTP/1.0" 200 134 0.000601
Sep 28 12:01:54 ctl02 heat-api[13008]: 2017-09-28 12:01:54.924 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:01:54] "OPTIONS / HTTP/1.0" 200 134 0.000436
Sep 28 12:01:55 ctl02 heat-api[13008]: 2017-09-28 12:01:55.199 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:01:55] "OPTIONS / HTTP/1.0" 200 134 0.000659
Sep 28 12:01:55 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb476bb03)
Sep 28 12:01:55 ctl02 nova-api[13208]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:01:55 ctl02 nova-api[13208]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:01:55 ctl02 nova-api[13208]: 2017-09-28 12:01:55.740 13208 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:01:55 ctl02 nova-api[13208]: 2017-09-28 12:01:55.742 13208 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:01:55 ctl02 nova-api[13208]: 2017-09-28 12:01:55.742 13208 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:01:55 ctl02 nova-api[13208]: 2017-09-28 12:01:55.742 13208 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:01:55 ctl02 nova-api[13208]: 2017-09-28 12:01:55.742 13208 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:01:55 ctl02 nova-api[13208]: 2017-09-28 12:01:55.742 13208 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:01:55 ctl02 nova-api[13208]: 2017-09-28 12:01:55.742 13208 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:01:55 ctl02 nova-api[13208]: 2017-09-28 12:01:55.742 13208 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:01:55 ctl02 nova-api[13208]: 2017-09-28 12:01:55.742 13208 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:01:55 ctl02 nova-api[13208]: 2017-09-28 12:01:55.742 13208 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:01:55 ctl02 nova-api[13208]: 2017-09-28 12:01:55.742 13208 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:01:55 ctl02 nova-api[13208]: 2017-09-28 12:01:55.742 13208 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:01:55 ctl02 nova-api[13208]: 2017-09-28 12:01:55.742 13208 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:01:55 ctl02 nova-api[13208]: 2017-09-28 12:01:55.742 13208 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:01:55 ctl02 nova-api[13208]: 2017-09-28 12:01:55.742 13208 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:01:55 ctl02 nova-api[13208]: 2017-09-28 12:01:55.742 13208 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:01:55 ctl02 nova-api[13208]: 2017-09-28 12:01:55.742 13208 ERROR nova.wsgi     self.filename))
Sep 28 12:01:55 ctl02 nova-api[13208]: 2017-09-28 12:01:55.742 13208 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:01:55 ctl02 nova-api[13208]: 2017-09-28 12:01:55.742 13208 ERROR nova.wsgi
Sep 28 12:01:55 ctl02 nova-api[13208]: 2017-09-28 12:01:55.744 13208 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:01:55 ctl02 nova-api[13208]: 2017-09-28 12:01:55.888 13208 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:01:56 ctl02 nova-api[13208]: 2017-09-28 12:01:56.120 13208 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:01:56 ctl02 nova-api[13208]: 2017-09-28 12:01:56.122 13208 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:01:56 ctl02 nova-api[13208]: 2017-09-28 12:01:56.122 13208 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:01:56 ctl02 nova-api[13208]: 2017-09-28 12:01:56.122 13208 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:01:56 ctl02 nova-api[13208]: 2017-09-28 12:01:56.253 13208 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:01:56 ctl02 nova-api[13208]: 2017-09-28 12:01:56.255 13208 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:01:56 ctl02 nova-api[13208]: 2017-09-28 12:01:56.255 13208 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:01:56 ctl02 nova-api[13208]: 2017-09-28 12:01:56.256 13208 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:01:56 ctl02 nova-api[13208]: 2017-09-28 12:01:56.259 13208 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:01:56 ctl02 nova-api[13208]: 2017-09-28 12:01:56.259 13208 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:01:56 ctl02 nova-api[13208]: 2017-09-28 12:01:56.259 13208 ERROR nova Traceback (most recent call last):
Sep 28 12:01:56 ctl02 nova-api[13208]: 2017-09-28 12:01:56.259 13208 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:01:56 ctl02 nova-api[13208]: 2017-09-28 12:01:56.259 13208 ERROR nova     sys.exit(main())
Sep 28 12:01:56 ctl02 nova-api[13208]: 2017-09-28 12:01:56.259 13208 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:01:56 ctl02 nova-api[13208]: 2017-09-28 12:01:56.259 13208 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:01:56 ctl02 nova-api[13208]: 2017-09-28 12:01:56.259 13208 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:01:56 ctl02 nova-api[13208]: 2017-09-28 12:01:56.259 13208 ERROR nova     max_url_len=max_url_len)
Sep 28 12:01:56 ctl02 nova-api[13208]: 2017-09-28 12:01:56.259 13208 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:01:56 ctl02 nova-api[13208]: 2017-09-28 12:01:56.259 13208 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:01:56 ctl02 nova-api[13208]: 2017-09-28 12:01:56.259 13208 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:01:56 ctl02 nova-api[13208]: 2017-09-28 12:01:56.259 13208 ERROR nova     sock.listen(backlog)
Sep 28 12:01:56 ctl02 nova-api[13208]: 2017-09-28 12:01:56.259 13208 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:01:56 ctl02 nova-api[13208]: 2017-09-28 12:01:56.259 13208 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:01:56 ctl02 nova-api[13208]: 2017-09-28 12:01:56.259 13208 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:01:56 ctl02 nova-api[13208]: 2017-09-28 12:01:56.259 13208 ERROR nova
Sep 28 12:01:56 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:01:56 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:01:56 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:01:56 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:01:56 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:01:56 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:01:56 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:01:56 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:01:56 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:01:57 ctl02 glance-api[29183]: 2017-09-28 12:01:57.106 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:01:57] "OPTIONS / HTTP/1.0" 200 134 0.000644
Sep 28 12:01:57 ctl02 heat-engine[12803]: 2017-09-28 12:01:57.295 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 10 seconds.
Sep 28 12:01:57 ctl02 heat-engine[12803]: 2017-09-28 12:01:57.331 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 10 seconds.
Sep 28 12:01:57 ctl02 heat-engine[12803]: 2017-09-28 12:01:57.333 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 10 seconds.
Sep 28 12:01:57 ctl02 heat-engine[12803]: 2017-09-28 12:01:57.338 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 10 seconds.
Sep 28 12:01:58 ctl02 nova-api[13231]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:01:58 ctl02 nova-api[13231]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:01:58 ctl02 nova-api[13231]: 2017-09-28 12:01:58.507 13231 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:01:58 ctl02 nova-api[13231]: 2017-09-28 12:01:58.509 13231 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:01:58 ctl02 nova-api[13231]: 2017-09-28 12:01:58.509 13231 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:01:58 ctl02 nova-api[13231]: 2017-09-28 12:01:58.509 13231 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:01:58 ctl02 nova-api[13231]: 2017-09-28 12:01:58.509 13231 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:01:58 ctl02 nova-api[13231]: 2017-09-28 12:01:58.509 13231 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:01:58 ctl02 nova-api[13231]: 2017-09-28 12:01:58.509 13231 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:01:58 ctl02 nova-api[13231]: 2017-09-28 12:01:58.509 13231 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:01:58 ctl02 nova-api[13231]: 2017-09-28 12:01:58.509 13231 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:01:58 ctl02 nova-api[13231]: 2017-09-28 12:01:58.509 13231 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:01:58 ctl02 nova-api[13231]: 2017-09-28 12:01:58.509 13231 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:01:58 ctl02 nova-api[13231]: 2017-09-28 12:01:58.509 13231 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:01:58 ctl02 nova-api[13231]: 2017-09-28 12:01:58.509 13231 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:01:58 ctl02 nova-api[13231]: 2017-09-28 12:01:58.509 13231 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:01:58 ctl02 nova-api[13231]: 2017-09-28 12:01:58.509 13231 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:01:58 ctl02 nova-api[13231]: 2017-09-28 12:01:58.509 13231 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:01:58 ctl02 nova-api[13231]: 2017-09-28 12:01:58.509 13231 ERROR nova.wsgi     self.filename))
Sep 28 12:01:58 ctl02 nova-api[13231]: 2017-09-28 12:01:58.509 13231 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:01:58 ctl02 nova-api[13231]: 2017-09-28 12:01:58.509 13231 ERROR nova.wsgi
Sep 28 12:01:58 ctl02 nova-api[13231]: 2017-09-28 12:01:58.511 13231 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:01:58 ctl02 nova-api[13231]: 2017-09-28 12:01:58.646 13231 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:01:58 ctl02 nova-api[13231]: 2017-09-28 12:01:58.887 13231 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:01:58 ctl02 nova-api[13231]: 2017-09-28 12:01:58.890 13231 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:01:58 ctl02 nova-api[13231]: 2017-09-28 12:01:58.890 13231 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:01:58 ctl02 nova-api[13231]: 2017-09-28 12:01:58.891 13231 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:01:59 ctl02 nova-api[13231]: 2017-09-28 12:01:59.023 13231 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:01:59 ctl02 nova-api[13231]: 2017-09-28 12:01:59.025 13231 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:01:59 ctl02 nova-api[13231]: 2017-09-28 12:01:59.036 13231 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:01:59 ctl02 nova-api[13231]: 2017-09-28 12:01:59.037 13231 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:01:59 ctl02 nova-api[13231]: 2017-09-28 12:01:59.040 13231 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:01:59 ctl02 nova-api[13231]: 2017-09-28 12:01:59.040 13231 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:01:59 ctl02 nova-api[13231]: 2017-09-28 12:01:59.040 13231 ERROR nova Traceback (most recent call last):
Sep 28 12:01:59 ctl02 nova-api[13231]: 2017-09-28 12:01:59.040 13231 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:01:59 ctl02 nova-api[13231]: 2017-09-28 12:01:59.040 13231 ERROR nova     sys.exit(main())
Sep 28 12:01:59 ctl02 nova-api[13231]: 2017-09-28 12:01:59.040 13231 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:01:59 ctl02 nova-api[13231]: 2017-09-28 12:01:59.040 13231 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:01:59 ctl02 nova-api[13231]: 2017-09-28 12:01:59.040 13231 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:01:59 ctl02 nova-api[13231]: 2017-09-28 12:01:59.040 13231 ERROR nova     max_url_len=max_url_len)
Sep 28 12:01:59 ctl02 nova-api[13231]: 2017-09-28 12:01:59.040 13231 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:01:59 ctl02 nova-api[13231]: 2017-09-28 12:01:59.040 13231 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:01:59 ctl02 nova-api[13231]: 2017-09-28 12:01:59.040 13231 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:01:59 ctl02 nova-api[13231]: 2017-09-28 12:01:59.040 13231 ERROR nova     sock.listen(backlog)
Sep 28 12:01:59 ctl02 nova-api[13231]: 2017-09-28 12:01:59.040 13231 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:01:59 ctl02 nova-api[13231]: 2017-09-28 12:01:59.040 13231 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:01:59 ctl02 nova-api[13231]: 2017-09-28 12:01:59.040 13231 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:01:59 ctl02 nova-api[13231]: 2017-09-28 12:01:59.040 13231 ERROR nova
Sep 28 12:01:59 ctl02 glance-api[29183]: 2017-09-28 12:01:59.112 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:01:59] "OPTIONS / HTTP/1.0" 200 134 0.000628
Sep 28 12:01:59 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:01:59 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:01:59 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:01:59 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:01:59 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:01:59 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:01:59 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:02:00 ctl02 heat-api-cloudwatch[12377]: ERROR: Could not bind to ('0.0.0.0', 8003)after trying for 30 seconds
Sep 28 12:02:00 ctl02 systemd[1]: heat-api-cloudwatch.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:02:00 ctl02 systemd[1]: heat-api-cloudwatch.service: Unit entered failed state.
Sep 28 12:02:00 ctl02 systemd[1]: heat-api-cloudwatch.service: Failed with result 'exit-code'.
Sep 28 12:02:00 ctl02 systemd[1]: heat-api-cloudwatch.service: Service hold-off time over, scheduling restart.
Sep 28 12:02:00 ctl02 systemd[1]: Stopped Heat API.
Sep 28 12:02:00 ctl02 systemd[1]: Starting Heat API...
Sep 28 12:02:00 ctl02 systemd[1]: Started Heat API.
Sep 28 12:02:01 ctl02 nova-api[13249]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:02:01 ctl02 nova-api[13249]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:02:01 ctl02 nova-api[13249]: 2017-09-28 12:02:01.240 13249 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:02:01 ctl02 nova-api[13249]: 2017-09-28 12:02:01.243 13249 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:02:01 ctl02 nova-api[13249]: 2017-09-28 12:02:01.243 13249 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:02:01 ctl02 nova-api[13249]: 2017-09-28 12:02:01.243 13249 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:02:01 ctl02 nova-api[13249]: 2017-09-28 12:02:01.243 13249 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:02:01 ctl02 nova-api[13249]: 2017-09-28 12:02:01.243 13249 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:02:01 ctl02 nova-api[13249]: 2017-09-28 12:02:01.243 13249 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:02:01 ctl02 nova-api[13249]: 2017-09-28 12:02:01.243 13249 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:02:01 ctl02 nova-api[13249]: 2017-09-28 12:02:01.243 13249 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:02:01 ctl02 nova-api[13249]: 2017-09-28 12:02:01.243 13249 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:02:01 ctl02 nova-api[13249]: 2017-09-28 12:02:01.243 13249 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:02:01 ctl02 nova-api[13249]: 2017-09-28 12:02:01.243 13249 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:02:01 ctl02 nova-api[13249]: 2017-09-28 12:02:01.243 13249 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:02:01 ctl02 nova-api[13249]: 2017-09-28 12:02:01.243 13249 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:02:01 ctl02 nova-api[13249]: 2017-09-28 12:02:01.243 13249 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:02:01 ctl02 nova-api[13249]: 2017-09-28 12:02:01.243 13249 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:02:01 ctl02 nova-api[13249]: 2017-09-28 12:02:01.243 13249 ERROR nova.wsgi     self.filename))
Sep 28 12:02:01 ctl02 nova-api[13249]: 2017-09-28 12:02:01.243 13249 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:02:01 ctl02 nova-api[13249]: 2017-09-28 12:02:01.243 13249 ERROR nova.wsgi
Sep 28 12:02:01 ctl02 nova-api[13249]: 2017-09-28 12:02:01.245 13249 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:02:01 ctl02 heat-api-cloudwatch[13265]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:02:01 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:02:01.341 13265 INFO heat.api.cloudwatch [-] Starting Heat CloudWatch API on 10.167.4.12:8003
Sep 28 12:02:01 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:02:01.342 13265 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:02:01 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:02:01.343 13265 INFO heat.common.wsgi [-] Starting single process server
Sep 28 12:02:01 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:02:01.343 13265 INFO eventlet.wsgi.server [-] (13265) wsgi starting up on http://10.167.4.12:8003
Sep 28 12:02:01 ctl02 nova-api[13249]: 2017-09-28 12:02:01.378 13249 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:02:01 ctl02 nova-api[13249]: 2017-09-28 12:02:01.619 13249 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:02:01 ctl02 nova-api[13249]: 2017-09-28 12:02:01.622 13249 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:02:01 ctl02 nova-api[13249]: 2017-09-28 12:02:01.623 13249 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:02:01 ctl02 nova-api[13249]: 2017-09-28 12:02:01.623 13249 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:02:01 ctl02 nova-api[13249]: 2017-09-28 12:02:01.759 13249 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:02:01 ctl02 nova-api[13249]: 2017-09-28 12:02:01.762 13249 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:02:01 ctl02 nova-api[13249]: 2017-09-28 12:02:01.762 13249 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:02:01 ctl02 nova-api[13249]: 2017-09-28 12:02:01.762 13249 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:02:01 ctl02 nova-api[13249]: 2017-09-28 12:02:01.766 13249 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:02:01 ctl02 nova-api[13249]: 2017-09-28 12:02:01.766 13249 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:02:01 ctl02 nova-api[13249]: 2017-09-28 12:02:01.766 13249 ERROR nova Traceback (most recent call last):
Sep 28 12:02:01 ctl02 nova-api[13249]: 2017-09-28 12:02:01.766 13249 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:02:01 ctl02 nova-api[13249]: 2017-09-28 12:02:01.766 13249 ERROR nova     sys.exit(main())
Sep 28 12:02:01 ctl02 nova-api[13249]: 2017-09-28 12:02:01.766 13249 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:02:01 ctl02 nova-api[13249]: 2017-09-28 12:02:01.766 13249 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:02:01 ctl02 nova-api[13249]: 2017-09-28 12:02:01.766 13249 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:02:01 ctl02 nova-api[13249]: 2017-09-28 12:02:01.766 13249 ERROR nova     max_url_len=max_url_len)
Sep 28 12:02:01 ctl02 nova-api[13249]: 2017-09-28 12:02:01.766 13249 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:02:01 ctl02 nova-api[13249]: 2017-09-28 12:02:01.766 13249 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:02:01 ctl02 nova-api[13249]: 2017-09-28 12:02:01.766 13249 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:02:01 ctl02 nova-api[13249]: 2017-09-28 12:02:01.766 13249 ERROR nova     sock.listen(backlog)
Sep 28 12:02:01 ctl02 nova-api[13249]: 2017-09-28 12:02:01.766 13249 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:02:01 ctl02 nova-api[13249]: 2017-09-28 12:02:01.766 13249 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:02:01 ctl02 nova-api[13249]: 2017-09-28 12:02:01.766 13249 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:02:01 ctl02 nova-api[13249]: 2017-09-28 12:02:01.766 13249 ERROR nova
Sep 28 12:02:01 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:02:01 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:02:01 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:02:02 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:02:02 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:02:02 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:02:02 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:02:02 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:02:02.981 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:02:02] "OPTIONS / HTTP/1.0" 200 134 0.000598
Sep 28 12:02:03 ctl02 heat-api-cfn[12599]: ERROR: Could not bind to ('0.0.0.0', 8000)after trying for 30 seconds
Sep 28 12:02:03 ctl02 systemd[1]: heat-api-cfn.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:02:03 ctl02 systemd[1]: heat-api-cfn.service: Unit entered failed state.
Sep 28 12:02:03 ctl02 systemd[1]: heat-api-cfn.service: Failed with result 'exit-code'.
Sep 28 12:02:03 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:02:03.361 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:02:03] "OPTIONS / HTTP/1.0" 200 134 0.000496
Sep 28 12:02:03 ctl02 systemd[1]: heat-api-cfn.service: Service hold-off time over, scheduling restart.
Sep 28 12:02:03 ctl02 systemd[1]: Stopped Heat API.
Sep 28 12:02:03 ctl02 systemd[1]: Starting Heat API...
Sep 28 12:02:03 ctl02 glance-api[29183]: 2017-09-28 12:02:03.397 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:02:03] "OPTIONS / HTTP/1.0" 200 134 0.000574
Sep 28 12:02:03 ctl02 systemd[1]: Started Heat API.
Sep 28 12:02:03 ctl02 nova-api[13283]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:02:03 ctl02 nova-api[13283]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:02:03 ctl02 nova-api[13283]: 2017-09-28 12:02:03.948 13283 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:02:03 ctl02 nova-api[13283]: 2017-09-28 12:02:03.950 13283 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:02:03 ctl02 nova-api[13283]: 2017-09-28 12:02:03.950 13283 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:02:03 ctl02 nova-api[13283]: 2017-09-28 12:02:03.950 13283 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:02:03 ctl02 nova-api[13283]: 2017-09-28 12:02:03.950 13283 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:02:03 ctl02 nova-api[13283]: 2017-09-28 12:02:03.950 13283 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:02:03 ctl02 nova-api[13283]: 2017-09-28 12:02:03.950 13283 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:02:03 ctl02 nova-api[13283]: 2017-09-28 12:02:03.950 13283 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:02:03 ctl02 nova-api[13283]: 2017-09-28 12:02:03.950 13283 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:02:03 ctl02 nova-api[13283]: 2017-09-28 12:02:03.950 13283 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:02:03 ctl02 nova-api[13283]: 2017-09-28 12:02:03.950 13283 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:02:03 ctl02 nova-api[13283]: 2017-09-28 12:02:03.950 13283 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:02:03 ctl02 nova-api[13283]: 2017-09-28 12:02:03.950 13283 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:02:03 ctl02 nova-api[13283]: 2017-09-28 12:02:03.950 13283 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:02:03 ctl02 nova-api[13283]: 2017-09-28 12:02:03.950 13283 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:02:03 ctl02 nova-api[13283]: 2017-09-28 12:02:03.950 13283 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:02:03 ctl02 nova-api[13283]: 2017-09-28 12:02:03.950 13283 ERROR nova.wsgi     self.filename))
Sep 28 12:02:03 ctl02 nova-api[13283]: 2017-09-28 12:02:03.950 13283 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:02:03 ctl02 nova-api[13283]: 2017-09-28 12:02:03.950 13283 ERROR nova.wsgi
Sep 28 12:02:03 ctl02 nova-api[13283]: 2017-09-28 12:02:03.951 13283 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:02:04 ctl02 nova-api[13283]: 2017-09-28 12:02:04.085 13283 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:02:04 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:02:04.243 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:02:04] "OPTIONS / HTTP/1.0" 200 134 0.000428
Sep 28 12:02:04 ctl02 heat-api-cfn[13300]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:02:04 ctl02 nova-api[13283]: 2017-09-28 12:02:04.308 13283 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:02:04 ctl02 nova-api[13283]: 2017-09-28 12:02:04.311 13283 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:02:04 ctl02 nova-api[13283]: 2017-09-28 12:02:04.311 13283 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:02:04 ctl02 nova-api[13283]: 2017-09-28 12:02:04.311 13283 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:02:04 ctl02 heat-api-cfn[13300]: 2017-09-28 12:02:04.377 13300 INFO heat.api.cfn [-] Starting Heat API on 10.167.4.12:8000
Sep 28 12:02:04 ctl02 heat-api-cfn[13300]: 2017-09-28 12:02:04.377 13300 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:02:04 ctl02 heat-api-cfn[13300]: 2017-09-28 12:02:04.378 13300 INFO heat.common.wsgi [-] Starting single process server
Sep 28 12:02:04 ctl02 heat-api-cfn[13300]: 2017-09-28 12:02:04.378 13300 INFO eventlet.wsgi.server [-] (13300) wsgi starting up on http://10.167.4.12:8000
Sep 28 12:02:04 ctl02 nova-api[13283]: 2017-09-28 12:02:04.441 13283 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:02:04 ctl02 nova-api[13283]: 2017-09-28 12:02:04.443 13283 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:02:04 ctl02 nova-api[13283]: 2017-09-28 12:02:04.443 13283 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:02:04 ctl02 nova-api[13283]: 2017-09-28 12:02:04.443 13283 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:02:04 ctl02 nova-api[13283]: 2017-09-28 12:02:04.446 13283 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:02:04 ctl02 nova-api[13283]: 2017-09-28 12:02:04.446 13283 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:02:04 ctl02 nova-api[13283]: 2017-09-28 12:02:04.446 13283 ERROR nova Traceback (most recent call last):
Sep 28 12:02:04 ctl02 nova-api[13283]: 2017-09-28 12:02:04.446 13283 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:02:04 ctl02 nova-api[13283]: 2017-09-28 12:02:04.446 13283 ERROR nova     sys.exit(main())
Sep 28 12:02:04 ctl02 nova-api[13283]: 2017-09-28 12:02:04.446 13283 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:02:04 ctl02 nova-api[13283]: 2017-09-28 12:02:04.446 13283 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:02:04 ctl02 nova-api[13283]: 2017-09-28 12:02:04.446 13283 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:02:04 ctl02 nova-api[13283]: 2017-09-28 12:02:04.446 13283 ERROR nova     max_url_len=max_url_len)
Sep 28 12:02:04 ctl02 nova-api[13283]: 2017-09-28 12:02:04.446 13283 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:02:04 ctl02 nova-api[13283]: 2017-09-28 12:02:04.446 13283 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:02:04 ctl02 nova-api[13283]: 2017-09-28 12:02:04.446 13283 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:02:04 ctl02 nova-api[13283]: 2017-09-28 12:02:04.446 13283 ERROR nova     sock.listen(backlog)
Sep 28 12:02:04 ctl02 nova-api[13283]: 2017-09-28 12:02:04.446 13283 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:02:04 ctl02 nova-api[13283]: 2017-09-28 12:02:04.446 13283 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:02:04 ctl02 nova-api[13283]: 2017-09-28 12:02:04.446 13283 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:02:04 ctl02 nova-api[13283]: 2017-09-28 12:02:04.446 13283 ERROR nova
Sep 28 12:02:04 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:02:04 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:02:04 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:02:04 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:02:04 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:02:04 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:02:04 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:02:04 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:02:04.907 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:02:04] "OPTIONS / HTTP/1.0" 200 134 0.000569
Sep 28 12:02:05 ctl02 heat-api[13008]: 2017-09-28 12:02:05.013 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:02:05] "OPTIONS / HTTP/1.0" 200 134 0.000649
Sep 28 12:02:05 ctl02 heat-api[13008]: 2017-09-28 12:02:05.154 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:02:05] "OPTIONS / HTTP/1.0" 200 134 0.000584
Sep 28 12:02:05 ctl02 heat-api[13008]: 2017-09-28 12:02:05.331 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:02:05] "OPTIONS / HTTP/1.0" 200 134 0.000564
Sep 28 12:02:05 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:02:05.339 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:02:05] "OPTIONS / HTTP/1.0" 200 134 0.000428
Sep 28 12:02:05 ctl02 heat-api-cfn[13300]: 2017-09-28 12:02:05.858 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:02:05] "OPTIONS / HTTP/1.0" 200 134 0.000892
Sep 28 12:02:06 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:02:06.176 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:02:06] "OPTIONS / HTTP/1.0" 200 134 0.000452
Sep 28 12:02:06 ctl02 heat-api-cfn[13300]: 2017-09-28 12:02:06.375 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:02:06] "OPTIONS / HTTP/1.0" 200 134 0.000412
Sep 28 12:02:06 ctl02 heat-api-cfn[13300]: 2017-09-28 12:02:06.453 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:02:06] "OPTIONS / HTTP/1.0" 200 134 0.000337
Sep 28 12:02:06 ctl02 nova-api[13321]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:02:06 ctl02 nova-api[13321]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:02:06 ctl02 nova-api[13321]: 2017-09-28 12:02:06.750 13321 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:02:06 ctl02 nova-api[13321]: 2017-09-28 12:02:06.752 13321 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:02:06 ctl02 nova-api[13321]: 2017-09-28 12:02:06.752 13321 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:02:06 ctl02 nova-api[13321]: 2017-09-28 12:02:06.752 13321 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:02:06 ctl02 nova-api[13321]: 2017-09-28 12:02:06.752 13321 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:02:06 ctl02 nova-api[13321]: 2017-09-28 12:02:06.752 13321 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:02:06 ctl02 nova-api[13321]: 2017-09-28 12:02:06.752 13321 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:02:06 ctl02 nova-api[13321]: 2017-09-28 12:02:06.752 13321 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:02:06 ctl02 nova-api[13321]: 2017-09-28 12:02:06.752 13321 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:02:06 ctl02 nova-api[13321]: 2017-09-28 12:02:06.752 13321 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:02:06 ctl02 nova-api[13321]: 2017-09-28 12:02:06.752 13321 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:02:06 ctl02 nova-api[13321]: 2017-09-28 12:02:06.752 13321 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:02:06 ctl02 nova-api[13321]: 2017-09-28 12:02:06.752 13321 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:02:06 ctl02 nova-api[13321]: 2017-09-28 12:02:06.752 13321 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:02:06 ctl02 nova-api[13321]: 2017-09-28 12:02:06.752 13321 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:02:06 ctl02 nova-api[13321]: 2017-09-28 12:02:06.752 13321 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:02:06 ctl02 nova-api[13321]: 2017-09-28 12:02:06.752 13321 ERROR nova.wsgi     self.filename))
Sep 28 12:02:06 ctl02 nova-api[13321]: 2017-09-28 12:02:06.752 13321 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:02:06 ctl02 nova-api[13321]: 2017-09-28 12:02:06.752 13321 ERROR nova.wsgi
Sep 28 12:02:06 ctl02 nova-api[13321]: 2017-09-28 12:02:06.753 13321 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:02:06 ctl02 nova-api[13321]: 2017-09-28 12:02:06.879 13321 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:02:06 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:02:06.989 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:02:06] "OPTIONS / HTTP/1.0" 200 134 0.000492
Sep 28 12:02:07 ctl02 glance-api[29183]: 2017-09-28 12:02:07.050 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:02:07] "OPTIONS / HTTP/1.0" 200 134 0.000572
Sep 28 12:02:07 ctl02 nova-api[13321]: 2017-09-28 12:02:07.113 13321 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:02:07 ctl02 nova-api[13321]: 2017-09-28 12:02:07.116 13321 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:02:07 ctl02 nova-api[13321]: 2017-09-28 12:02:07.116 13321 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:02:07 ctl02 nova-api[13321]: 2017-09-28 12:02:07.117 13321 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:02:07 ctl02 nova-api[13321]: 2017-09-28 12:02:07.246 13321 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:02:07 ctl02 nova-api[13321]: 2017-09-28 12:02:07.248 13321 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:02:07 ctl02 nova-api[13321]: 2017-09-28 12:02:07.249 13321 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:02:07 ctl02 nova-api[13321]: 2017-09-28 12:02:07.249 13321 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:02:07 ctl02 nova-api[13321]: 2017-09-28 12:02:07.252 13321 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:02:07 ctl02 nova-api[13321]: 2017-09-28 12:02:07.253 13321 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:02:07 ctl02 nova-api[13321]: 2017-09-28 12:02:07.253 13321 ERROR nova Traceback (most recent call last):
Sep 28 12:02:07 ctl02 nova-api[13321]: 2017-09-28 12:02:07.253 13321 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:02:07 ctl02 nova-api[13321]: 2017-09-28 12:02:07.253 13321 ERROR nova     sys.exit(main())
Sep 28 12:02:07 ctl02 nova-api[13321]: 2017-09-28 12:02:07.253 13321 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:02:07 ctl02 nova-api[13321]: 2017-09-28 12:02:07.253 13321 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:02:07 ctl02 nova-api[13321]: 2017-09-28 12:02:07.253 13321 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:02:07 ctl02 nova-api[13321]: 2017-09-28 12:02:07.253 13321 ERROR nova     max_url_len=max_url_len)
Sep 28 12:02:07 ctl02 nova-api[13321]: 2017-09-28 12:02:07.253 13321 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:02:07 ctl02 nova-api[13321]: 2017-09-28 12:02:07.253 13321 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:02:07 ctl02 nova-api[13321]: 2017-09-28 12:02:07.253 13321 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:02:07 ctl02 nova-api[13321]: 2017-09-28 12:02:07.253 13321 ERROR nova     sock.listen(backlog)
Sep 28 12:02:07 ctl02 nova-api[13321]: 2017-09-28 12:02:07.253 13321 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:02:07 ctl02 nova-api[13321]: 2017-09-28 12:02:07.253 13321 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:02:07 ctl02 nova-api[13321]: 2017-09-28 12:02:07.253 13321 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:02:07 ctl02 nova-api[13321]: 2017-09-28 12:02:07.253 13321 ERROR nova
Sep 28 12:02:07 ctl02 heat-engine[12803]: 2017-09-28 12:02:07.302 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 12 seconds.
Sep 28 12:02:07 ctl02 heat-engine[12803]: 2017-09-28 12:02:07.337 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 12 seconds.
Sep 28 12:02:07 ctl02 heat-engine[12803]: 2017-09-28 12:02:07.348 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 12 seconds.
Sep 28 12:02:07 ctl02 heat-engine[12803]: 2017-09-28 12:02:07.349 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 12 seconds.
Sep 28 12:02:07 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:02:07.367 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:02:07] "OPTIONS / HTTP/1.0" 200 134 0.000475
Sep 28 12:02:07 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:02:07 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:02:07 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:02:07 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:02:07 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:02:07 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:02:07 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:02:07 ctl02 heat-api-cfn[13300]: 2017-09-28 12:02:07.830 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:02:07] "OPTIONS / HTTP/1.0" 200 134 0.000464
Sep 28 12:02:08 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:02:08.244 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:02:08] "OPTIONS / HTTP/1.0" 200 134 0.000556
Sep 28 12:02:08 ctl02 heat-api-cfn[13300]: 2017-09-28 12:02:08.302 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:02:08] "OPTIONS / HTTP/1.0" 200 134 0.000560
Sep 28 12:02:08 ctl02 heat-api-cfn[13300]: 2017-09-28 12:02:08.452 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:02:08] "OPTIONS / HTTP/1.0" 200 134 0.000393
Sep 28 12:02:09 ctl02 glance-api[29183]: 2017-09-28 12:02:09.154 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:02:09] "OPTIONS / HTTP/1.0" 200 134 0.000612
Sep 28 12:02:09 ctl02 nova-api[13339]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:02:09 ctl02 nova-api[13339]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:02:09 ctl02 nova-api[13339]: 2017-09-28 12:02:09.428 13339 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:02:09 ctl02 nova-api[13339]: 2017-09-28 12:02:09.430 13339 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:02:09 ctl02 nova-api[13339]: 2017-09-28 12:02:09.430 13339 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:02:09 ctl02 nova-api[13339]: 2017-09-28 12:02:09.430 13339 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:02:09 ctl02 nova-api[13339]: 2017-09-28 12:02:09.430 13339 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:02:09 ctl02 nova-api[13339]: 2017-09-28 12:02:09.430 13339 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:02:09 ctl02 nova-api[13339]: 2017-09-28 12:02:09.430 13339 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:02:09 ctl02 nova-api[13339]: 2017-09-28 12:02:09.430 13339 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:02:09 ctl02 nova-api[13339]: 2017-09-28 12:02:09.430 13339 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:02:09 ctl02 nova-api[13339]: 2017-09-28 12:02:09.430 13339 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:02:09 ctl02 nova-api[13339]: 2017-09-28 12:02:09.430 13339 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:02:09 ctl02 nova-api[13339]: 2017-09-28 12:02:09.430 13339 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:02:09 ctl02 nova-api[13339]: 2017-09-28 12:02:09.430 13339 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:02:09 ctl02 nova-api[13339]: 2017-09-28 12:02:09.430 13339 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:02:09 ctl02 nova-api[13339]: 2017-09-28 12:02:09.430 13339 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:02:09 ctl02 nova-api[13339]: 2017-09-28 12:02:09.430 13339 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:02:09 ctl02 nova-api[13339]: 2017-09-28 12:02:09.430 13339 ERROR nova.wsgi     self.filename))
Sep 28 12:02:09 ctl02 nova-api[13339]: 2017-09-28 12:02:09.430 13339 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:02:09 ctl02 nova-api[13339]: 2017-09-28 12:02:09.430 13339 ERROR nova.wsgi
Sep 28 12:02:09 ctl02 nova-api[13339]: 2017-09-28 12:02:09.431 13339 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:02:09 ctl02 nova-api[13339]: 2017-09-28 12:02:09.558 13339 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:02:09 ctl02 nova-api[13339]: 2017-09-28 12:02:09.790 13339 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:02:09 ctl02 nova-api[13339]: 2017-09-28 12:02:09.793 13339 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:02:09 ctl02 nova-api[13339]: 2017-09-28 12:02:09.793 13339 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:02:09 ctl02 nova-api[13339]: 2017-09-28 12:02:09.793 13339 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:02:09 ctl02 heat-api-cfn[13300]: 2017-09-28 12:02:09.899 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:02:09] "OPTIONS / HTTP/1.0" 200 134 0.000536
Sep 28 12:02:09 ctl02 nova-api[13339]: 2017-09-28 12:02:09.922 13339 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:02:09 ctl02 nova-api[13339]: 2017-09-28 12:02:09.924 13339 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:02:09 ctl02 nova-api[13339]: 2017-09-28 12:02:09.924 13339 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:02:09 ctl02 nova-api[13339]: 2017-09-28 12:02:09.925 13339 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:02:09 ctl02 nova-api[13339]: 2017-09-28 12:02:09.928 13339 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:02:09 ctl02 nova-api[13339]: 2017-09-28 12:02:09.928 13339 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:02:09 ctl02 nova-api[13339]: 2017-09-28 12:02:09.928 13339 ERROR nova Traceback (most recent call last):
Sep 28 12:02:09 ctl02 nova-api[13339]: 2017-09-28 12:02:09.928 13339 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:02:09 ctl02 nova-api[13339]: 2017-09-28 12:02:09.928 13339 ERROR nova     sys.exit(main())
Sep 28 12:02:09 ctl02 nova-api[13339]: 2017-09-28 12:02:09.928 13339 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:02:09 ctl02 nova-api[13339]: 2017-09-28 12:02:09.928 13339 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:02:09 ctl02 nova-api[13339]: 2017-09-28 12:02:09.928 13339 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:02:09 ctl02 nova-api[13339]: 2017-09-28 12:02:09.928 13339 ERROR nova     max_url_len=max_url_len)
Sep 28 12:02:09 ctl02 nova-api[13339]: 2017-09-28 12:02:09.928 13339 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:02:09 ctl02 nova-api[13339]: 2017-09-28 12:02:09.928 13339 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:02:09 ctl02 nova-api[13339]: 2017-09-28 12:02:09.928 13339 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:02:09 ctl02 nova-api[13339]: 2017-09-28 12:02:09.928 13339 ERROR nova     sock.listen(backlog)
Sep 28 12:02:09 ctl02 nova-api[13339]: 2017-09-28 12:02:09.928 13339 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:02:09 ctl02 nova-api[13339]: 2017-09-28 12:02:09.928 13339 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:02:09 ctl02 nova-api[13339]: 2017-09-28 12:02:09.928 13339 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:02:09 ctl02 nova-api[13339]: 2017-09-28 12:02:09.928 13339 ERROR nova
Sep 28 12:02:10 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:02:10 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:02:10 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:02:10 ctl02 heat-api-cfn[13300]: 2017-09-28 12:02:10.233 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:02:10] "OPTIONS / HTTP/1.0" 200 134 0.000569
Sep 28 12:02:10 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:02:10 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:02:10 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:02:10 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:02:10 ctl02 heat-api-cfn[13300]: 2017-09-28 12:02:10.438 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:02:10] "OPTIONS / HTTP/1.0" 200 134 0.000551
Sep 28 12:02:11 ctl02 nova-cert[4860]: 2017-09-28 12:02:11.797 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:02:12 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4bb3666b)
Sep 28 12:02:12 ctl02 nova-api[13357]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:02:12 ctl02 nova-api[13357]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:02:12 ctl02 nova-api[13357]: 2017-09-28 12:02:12.241 13357 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:02:12 ctl02 nova-api[13357]: 2017-09-28 12:02:12.244 13357 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:02:12 ctl02 nova-api[13357]: 2017-09-28 12:02:12.244 13357 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:02:12 ctl02 nova-api[13357]: 2017-09-28 12:02:12.244 13357 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:02:12 ctl02 nova-api[13357]: 2017-09-28 12:02:12.244 13357 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:02:12 ctl02 nova-api[13357]: 2017-09-28 12:02:12.244 13357 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:02:12 ctl02 nova-api[13357]: 2017-09-28 12:02:12.244 13357 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:02:12 ctl02 nova-api[13357]: 2017-09-28 12:02:12.244 13357 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:02:12 ctl02 nova-api[13357]: 2017-09-28 12:02:12.244 13357 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:02:12 ctl02 nova-api[13357]: 2017-09-28 12:02:12.244 13357 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:02:12 ctl02 nova-api[13357]: 2017-09-28 12:02:12.244 13357 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:02:12 ctl02 nova-api[13357]: 2017-09-28 12:02:12.244 13357 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:02:12 ctl02 nova-api[13357]: 2017-09-28 12:02:12.244 13357 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:02:12 ctl02 nova-api[13357]: 2017-09-28 12:02:12.244 13357 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:02:12 ctl02 nova-api[13357]: 2017-09-28 12:02:12.244 13357 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:02:12 ctl02 nova-api[13357]: 2017-09-28 12:02:12.244 13357 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:02:12 ctl02 nova-api[13357]: 2017-09-28 12:02:12.244 13357 ERROR nova.wsgi     self.filename))
Sep 28 12:02:12 ctl02 nova-api[13357]: 2017-09-28 12:02:12.244 13357 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:02:12 ctl02 nova-api[13357]: 2017-09-28 12:02:12.244 13357 ERROR nova.wsgi
Sep 28 12:02:12 ctl02 nova-api[13357]: 2017-09-28 12:02:12.246 13357 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:02:12 ctl02 nova-api[13357]: 2017-09-28 12:02:12.378 13357 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:02:12 ctl02 nova-api[13357]: 2017-09-28 12:02:12.621 13357 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:02:12 ctl02 nova-api[13357]: 2017-09-28 12:02:12.624 13357 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:02:12 ctl02 nova-api[13357]: 2017-09-28 12:02:12.624 13357 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:02:12 ctl02 nova-api[13357]: 2017-09-28 12:02:12.625 13357 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:02:12 ctl02 nova-api[13357]: 2017-09-28 12:02:12.757 13357 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:02:12 ctl02 nova-api[13357]: 2017-09-28 12:02:12.760 13357 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:02:12 ctl02 nova-api[13357]: 2017-09-28 12:02:12.760 13357 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:02:12 ctl02 nova-api[13357]: 2017-09-28 12:02:12.761 13357 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:02:12 ctl02 nova-api[13357]: 2017-09-28 12:02:12.764 13357 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:02:12 ctl02 nova-api[13357]: 2017-09-28 12:02:12.765 13357 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:02:12 ctl02 nova-api[13357]: 2017-09-28 12:02:12.765 13357 ERROR nova Traceback (most recent call last):
Sep 28 12:02:12 ctl02 nova-api[13357]: 2017-09-28 12:02:12.765 13357 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:02:12 ctl02 nova-api[13357]: 2017-09-28 12:02:12.765 13357 ERROR nova     sys.exit(main())
Sep 28 12:02:12 ctl02 nova-api[13357]: 2017-09-28 12:02:12.765 13357 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:02:12 ctl02 nova-api[13357]: 2017-09-28 12:02:12.765 13357 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:02:12 ctl02 nova-api[13357]: 2017-09-28 12:02:12.765 13357 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:02:12 ctl02 nova-api[13357]: 2017-09-28 12:02:12.765 13357 ERROR nova     max_url_len=max_url_len)
Sep 28 12:02:12 ctl02 nova-api[13357]: 2017-09-28 12:02:12.765 13357 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:02:12 ctl02 nova-api[13357]: 2017-09-28 12:02:12.765 13357 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:02:12 ctl02 nova-api[13357]: 2017-09-28 12:02:12.765 13357 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:02:12 ctl02 nova-api[13357]: 2017-09-28 12:02:12.765 13357 ERROR nova     sock.listen(backlog)
Sep 28 12:02:12 ctl02 nova-api[13357]: 2017-09-28 12:02:12.765 13357 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:02:12 ctl02 nova-api[13357]: 2017-09-28 12:02:12.765 13357 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:02:12 ctl02 nova-api[13357]: 2017-09-28 12:02:12.765 13357 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:02:12 ctl02 nova-api[13357]: 2017-09-28 12:02:12.765 13357 ERROR nova
Sep 28 12:02:12 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:02:12 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:02:12 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:02:13 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4bb3666b)
Sep 28 12:02:13 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:02:13 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:02:13 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:02:13 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:02:13 ctl02 glance-api[29183]: 2017-09-28 12:02:13.714 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:02:13] "OPTIONS / HTTP/1.0" 200 134 0.000567
Sep 28 12:02:14 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4bb3666b)
Sep 28 12:02:14 ctl02 nova-conductor[5056]: 2017-09-28 12:02:14.258 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:02:14 ctl02 nova-conductor[5056]: 2017-09-28 12:02:14.278 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:02:14 ctl02 nova-conductor[5056]: 2017-09-28 12:02:14.290 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:02:14 ctl02 nova-conductor[5056]: 2017-09-28 12:02:14.294 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:02:14 ctl02 nova-api[13375]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:02:14 ctl02 nova-api[13375]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:02:14 ctl02 nova-api[13375]: 2017-09-28 12:02:14.933 13375 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:02:14 ctl02 nova-api[13375]: 2017-09-28 12:02:14.935 13375 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:02:14 ctl02 nova-api[13375]: 2017-09-28 12:02:14.935 13375 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:02:14 ctl02 nova-api[13375]: 2017-09-28 12:02:14.935 13375 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:02:14 ctl02 nova-api[13375]: 2017-09-28 12:02:14.935 13375 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:02:14 ctl02 nova-api[13375]: 2017-09-28 12:02:14.935 13375 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:02:14 ctl02 nova-api[13375]: 2017-09-28 12:02:14.935 13375 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:02:14 ctl02 nova-api[13375]: 2017-09-28 12:02:14.935 13375 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:02:14 ctl02 nova-api[13375]: 2017-09-28 12:02:14.935 13375 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:02:14 ctl02 nova-api[13375]: 2017-09-28 12:02:14.935 13375 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:02:14 ctl02 nova-api[13375]: 2017-09-28 12:02:14.935 13375 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:02:14 ctl02 nova-api[13375]: 2017-09-28 12:02:14.935 13375 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:02:14 ctl02 nova-api[13375]: 2017-09-28 12:02:14.935 13375 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:02:14 ctl02 nova-api[13375]: 2017-09-28 12:02:14.935 13375 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:02:14 ctl02 nova-api[13375]: 2017-09-28 12:02:14.935 13375 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:02:14 ctl02 nova-api[13375]: 2017-09-28 12:02:14.935 13375 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:02:14 ctl02 nova-api[13375]: 2017-09-28 12:02:14.935 13375 ERROR nova.wsgi     self.filename))
Sep 28 12:02:14 ctl02 nova-api[13375]: 2017-09-28 12:02:14.935 13375 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:02:14 ctl02 nova-api[13375]: 2017-09-28 12:02:14.935 13375 ERROR nova.wsgi
Sep 28 12:02:14 ctl02 nova-api[13375]: 2017-09-28 12:02:14.936 13375 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:02:15 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4bb3666b)
Sep 28 12:02:15 ctl02 nova-api[13375]: 2017-09-28 12:02:15.062 13375 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:02:15 ctl02 heat-api[13008]: 2017-09-28 12:02:15.124 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:02:15] "OPTIONS / HTTP/1.0" 200 134 0.000793
Sep 28 12:02:15 ctl02 nova-api[13375]: 2017-09-28 12:02:15.296 13375 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:02:15 ctl02 nova-api[13375]: 2017-09-28 12:02:15.298 13375 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:02:15 ctl02 nova-api[13375]: 2017-09-28 12:02:15.298 13375 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:02:15 ctl02 nova-api[13375]: 2017-09-28 12:02:15.298 13375 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:02:15 ctl02 heat-api[13008]: 2017-09-28 12:02:15.365 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:02:15] "OPTIONS / HTTP/1.0" 200 134 0.000662
Sep 28 12:02:15 ctl02 nova-api[13375]: 2017-09-28 12:02:15.429 13375 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:02:15 ctl02 nova-api[13375]: 2017-09-28 12:02:15.431 13375 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:02:15 ctl02 nova-api[13375]: 2017-09-28 12:02:15.432 13375 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:02:15 ctl02 nova-api[13375]: 2017-09-28 12:02:15.432 13375 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:02:15 ctl02 nova-api[13375]: 2017-09-28 12:02:15.435 13375 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:02:15 ctl02 nova-api[13375]: 2017-09-28 12:02:15.435 13375 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:02:15 ctl02 nova-api[13375]: 2017-09-28 12:02:15.435 13375 ERROR nova Traceback (most recent call last):
Sep 28 12:02:15 ctl02 nova-api[13375]: 2017-09-28 12:02:15.435 13375 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:02:15 ctl02 nova-api[13375]: 2017-09-28 12:02:15.435 13375 ERROR nova     sys.exit(main())
Sep 28 12:02:15 ctl02 nova-api[13375]: 2017-09-28 12:02:15.435 13375 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:02:15 ctl02 nova-api[13375]: 2017-09-28 12:02:15.435 13375 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:02:15 ctl02 nova-api[13375]: 2017-09-28 12:02:15.435 13375 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:02:15 ctl02 nova-api[13375]: 2017-09-28 12:02:15.435 13375 ERROR nova     max_url_len=max_url_len)
Sep 28 12:02:15 ctl02 nova-api[13375]: 2017-09-28 12:02:15.435 13375 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:02:15 ctl02 nova-api[13375]: 2017-09-28 12:02:15.435 13375 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:02:15 ctl02 nova-api[13375]: 2017-09-28 12:02:15.435 13375 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:02:15 ctl02 nova-api[13375]: 2017-09-28 12:02:15.435 13375 ERROR nova     sock.listen(backlog)
Sep 28 12:02:15 ctl02 nova-api[13375]: 2017-09-28 12:02:15.435 13375 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:02:15 ctl02 nova-api[13375]: 2017-09-28 12:02:15.435 13375 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:02:15 ctl02 nova-api[13375]: 2017-09-28 12:02:15.435 13375 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:02:15 ctl02 nova-api[13375]: 2017-09-28 12:02:15.435 13375 ERROR nova
Sep 28 12:02:15 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:02:15 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:02:15 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:02:15 ctl02 heat-api[13008]: 2017-09-28 12:02:15.637 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:02:15] "OPTIONS / HTTP/1.0" 200 134 0.000532
Sep 28 12:02:15 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:02:15 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:02:15 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:02:15 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:02:16 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4bb3666b)
Sep 28 12:02:16 ctl02 glance-api[29183]: 2017-09-28 12:02:16.759 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:02:16] "OPTIONS / HTTP/1.0" 200 134 0.000628
Sep 28 12:02:17 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4bb3666b)
Sep 28 12:02:17 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:02:17.346 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:02:17] "OPTIONS / HTTP/1.0" 200 134 0.000417
Sep 28 12:02:17 ctl02 nova-api[13393]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:02:17 ctl02 nova-api[13393]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:02:17 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:02:17.573 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:02:17] "OPTIONS / HTTP/1.0" 200 134 0.000367
Sep 28 12:02:17 ctl02 nova-api[13393]: 2017-09-28 12:02:17.733 13393 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:02:17 ctl02 nova-api[13393]: 2017-09-28 12:02:17.735 13393 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:02:17 ctl02 nova-api[13393]: 2017-09-28 12:02:17.735 13393 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:02:17 ctl02 nova-api[13393]: 2017-09-28 12:02:17.735 13393 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:02:17 ctl02 nova-api[13393]: 2017-09-28 12:02:17.735 13393 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:02:17 ctl02 nova-api[13393]: 2017-09-28 12:02:17.735 13393 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:02:17 ctl02 nova-api[13393]: 2017-09-28 12:02:17.735 13393 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:02:17 ctl02 nova-api[13393]: 2017-09-28 12:02:17.735 13393 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:02:17 ctl02 nova-api[13393]: 2017-09-28 12:02:17.735 13393 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:02:17 ctl02 nova-api[13393]: 2017-09-28 12:02:17.735 13393 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:02:17 ctl02 nova-api[13393]: 2017-09-28 12:02:17.735 13393 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:02:17 ctl02 nova-api[13393]: 2017-09-28 12:02:17.735 13393 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:02:17 ctl02 nova-api[13393]: 2017-09-28 12:02:17.735 13393 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:02:17 ctl02 nova-api[13393]: 2017-09-28 12:02:17.735 13393 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:02:17 ctl02 nova-api[13393]: 2017-09-28 12:02:17.735 13393 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:02:17 ctl02 nova-api[13393]: 2017-09-28 12:02:17.735 13393 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:02:17 ctl02 nova-api[13393]: 2017-09-28 12:02:17.735 13393 ERROR nova.wsgi     self.filename))
Sep 28 12:02:17 ctl02 nova-api[13393]: 2017-09-28 12:02:17.735 13393 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:02:17 ctl02 nova-api[13393]: 2017-09-28 12:02:17.735 13393 ERROR nova.wsgi
Sep 28 12:02:17 ctl02 nova-api[13393]: 2017-09-28 12:02:17.736 13393 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:02:17 ctl02 nova-api[13393]: 2017-09-28 12:02:17.872 13393 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:02:18 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4bb3666b)
Sep 28 12:02:18 ctl02 nova-api[13393]: 2017-09-28 12:02:18.111 13393 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:02:18 ctl02 nova-api[13393]: 2017-09-28 12:02:18.113 13393 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:02:18 ctl02 nova-api[13393]: 2017-09-28 12:02:18.113 13393 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:02:18 ctl02 nova-api[13393]: 2017-09-28 12:02:18.113 13393 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:02:18 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:02:18.153 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:02:18] "OPTIONS / HTTP/1.0" 200 134 0.000433
Sep 28 12:02:18 ctl02 nova-api[13393]: 2017-09-28 12:02:18.253 13393 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:02:18 ctl02 nova-api[13393]: 2017-09-28 12:02:18.255 13393 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:02:18 ctl02 nova-api[13393]: 2017-09-28 12:02:18.255 13393 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:02:18 ctl02 nova-api[13393]: 2017-09-28 12:02:18.255 13393 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:02:18 ctl02 nova-api[13393]: 2017-09-28 12:02:18.259 13393 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:02:18 ctl02 nova-api[13393]: 2017-09-28 12:02:18.259 13393 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:02:18 ctl02 nova-api[13393]: 2017-09-28 12:02:18.259 13393 ERROR nova Traceback (most recent call last):
Sep 28 12:02:18 ctl02 nova-api[13393]: 2017-09-28 12:02:18.259 13393 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:02:18 ctl02 nova-api[13393]: 2017-09-28 12:02:18.259 13393 ERROR nova     sys.exit(main())
Sep 28 12:02:18 ctl02 nova-api[13393]: 2017-09-28 12:02:18.259 13393 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:02:18 ctl02 nova-api[13393]: 2017-09-28 12:02:18.259 13393 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:02:18 ctl02 nova-api[13393]: 2017-09-28 12:02:18.259 13393 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:02:18 ctl02 nova-api[13393]: 2017-09-28 12:02:18.259 13393 ERROR nova     max_url_len=max_url_len)
Sep 28 12:02:18 ctl02 nova-api[13393]: 2017-09-28 12:02:18.259 13393 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:02:18 ctl02 nova-api[13393]: 2017-09-28 12:02:18.259 13393 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:02:18 ctl02 nova-api[13393]: 2017-09-28 12:02:18.259 13393 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:02:18 ctl02 nova-api[13393]: 2017-09-28 12:02:18.259 13393 ERROR nova     sock.listen(backlog)
Sep 28 12:02:18 ctl02 nova-api[13393]: 2017-09-28 12:02:18.259 13393 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:02:18 ctl02 nova-api[13393]: 2017-09-28 12:02:18.259 13393 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:02:18 ctl02 nova-api[13393]: 2017-09-28 12:02:18.259 13393 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:02:18 ctl02 nova-api[13393]: 2017-09-28 12:02:18.259 13393 ERROR nova
Sep 28 12:02:18 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:02:18 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:02:18 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:02:18 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:02:18 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:02:18 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:02:18 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:02:18 ctl02 glance-api[29183]: 2017-09-28 12:02:18.800 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:02:18] "OPTIONS / HTTP/1.0" 200 134 0.000700
Sep 28 12:02:19 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4bb3666b)
Sep 28 12:02:19 ctl02 heat-engine[12803]: 2017-09-28 12:02:19.309 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 14 seconds.
Sep 28 12:02:19 ctl02 heat-engine[12803]: 2017-09-28 12:02:19.343 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 14 seconds.
Sep 28 12:02:19 ctl02 heat-engine[12803]: 2017-09-28 12:02:19.355 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 14 seconds.
Sep 28 12:02:19 ctl02 heat-engine[12803]: 2017-09-28 12:02:19.360 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 14 seconds.
Sep 28 12:02:19 ctl02 heat-api-cfn[13300]: 2017-09-28 12:02:19.817 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:02:19] "OPTIONS / HTTP/1.0" 200 134 0.000548
Sep 28 12:02:20 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4bb3666b)
Sep 28 12:02:20 ctl02 heat-api-cfn[13300]: 2017-09-28 12:02:20.119 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:02:20] "OPTIONS / HTTP/1.0" 200 134 0.000405
Sep 28 12:02:20 ctl02 nova-api[13409]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:02:20 ctl02 nova-api[13409]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:02:20 ctl02 heat-api-cfn[13300]: 2017-09-28 12:02:20.429 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:02:20] "OPTIONS / HTTP/1.0" 200 134 0.000581
Sep 28 12:02:20 ctl02 nova-api[13409]: 2017-09-28 12:02:20.467 13409 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:02:20 ctl02 nova-api[13409]: 2017-09-28 12:02:20.469 13409 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:02:20 ctl02 nova-api[13409]: 2017-09-28 12:02:20.469 13409 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:02:20 ctl02 nova-api[13409]: 2017-09-28 12:02:20.469 13409 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:02:20 ctl02 nova-api[13409]: 2017-09-28 12:02:20.469 13409 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:02:20 ctl02 nova-api[13409]: 2017-09-28 12:02:20.469 13409 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:02:20 ctl02 nova-api[13409]: 2017-09-28 12:02:20.469 13409 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:02:20 ctl02 nova-api[13409]: 2017-09-28 12:02:20.469 13409 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:02:20 ctl02 nova-api[13409]: 2017-09-28 12:02:20.469 13409 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:02:20 ctl02 nova-api[13409]: 2017-09-28 12:02:20.469 13409 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:02:20 ctl02 nova-api[13409]: 2017-09-28 12:02:20.469 13409 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:02:20 ctl02 nova-api[13409]: 2017-09-28 12:02:20.469 13409 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:02:20 ctl02 nova-api[13409]: 2017-09-28 12:02:20.469 13409 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:02:20 ctl02 nova-api[13409]: 2017-09-28 12:02:20.469 13409 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:02:20 ctl02 nova-api[13409]: 2017-09-28 12:02:20.469 13409 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:02:20 ctl02 nova-api[13409]: 2017-09-28 12:02:20.469 13409 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:02:20 ctl02 nova-api[13409]: 2017-09-28 12:02:20.469 13409 ERROR nova.wsgi     self.filename))
Sep 28 12:02:20 ctl02 nova-api[13409]: 2017-09-28 12:02:20.469 13409 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:02:20 ctl02 nova-api[13409]: 2017-09-28 12:02:20.469 13409 ERROR nova.wsgi
Sep 28 12:02:20 ctl02 nova-api[13409]: 2017-09-28 12:02:20.470 13409 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:02:20 ctl02 nova-api[13409]: 2017-09-28 12:02:20.600 13409 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:02:20 ctl02 nova-api[13409]: 2017-09-28 12:02:20.836 13409 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:02:20 ctl02 nova-api[13409]: 2017-09-28 12:02:20.839 13409 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:02:20 ctl02 nova-api[13409]: 2017-09-28 12:02:20.839 13409 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:02:20 ctl02 nova-api[13409]: 2017-09-28 12:02:20.839 13409 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:02:20 ctl02 nova-api[13409]: 2017-09-28 12:02:20.969 13409 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:02:20 ctl02 nova-api[13409]: 2017-09-28 12:02:20.971 13409 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:02:20 ctl02 nova-api[13409]: 2017-09-28 12:02:20.972 13409 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:02:20 ctl02 nova-api[13409]: 2017-09-28 12:02:20.972 13409 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:02:20 ctl02 nova-api[13409]: 2017-09-28 12:02:20.975 13409 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:02:20 ctl02 nova-api[13409]: 2017-09-28 12:02:20.976 13409 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:02:20 ctl02 nova-api[13409]: 2017-09-28 12:02:20.976 13409 ERROR nova Traceback (most recent call last):
Sep 28 12:02:20 ctl02 nova-api[13409]: 2017-09-28 12:02:20.976 13409 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:02:20 ctl02 nova-api[13409]: 2017-09-28 12:02:20.976 13409 ERROR nova     sys.exit(main())
Sep 28 12:02:20 ctl02 nova-api[13409]: 2017-09-28 12:02:20.976 13409 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:02:20 ctl02 nova-api[13409]: 2017-09-28 12:02:20.976 13409 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:02:20 ctl02 nova-api[13409]: 2017-09-28 12:02:20.976 13409 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:02:20 ctl02 nova-api[13409]: 2017-09-28 12:02:20.976 13409 ERROR nova     max_url_len=max_url_len)
Sep 28 12:02:20 ctl02 nova-api[13409]: 2017-09-28 12:02:20.976 13409 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:02:20 ctl02 nova-api[13409]: 2017-09-28 12:02:20.976 13409 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:02:20 ctl02 nova-api[13409]: 2017-09-28 12:02:20.976 13409 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:02:20 ctl02 nova-api[13409]: 2017-09-28 12:02:20.976 13409 ERROR nova     sock.listen(backlog)
Sep 28 12:02:20 ctl02 nova-api[13409]: 2017-09-28 12:02:20.976 13409 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:02:20 ctl02 nova-api[13409]: 2017-09-28 12:02:20.976 13409 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:02:20 ctl02 nova-api[13409]: 2017-09-28 12:02:20.976 13409 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:02:20 ctl02 nova-api[13409]: 2017-09-28 12:02:20.976 13409 ERROR nova
Sep 28 12:02:21 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4bb3666b)
Sep 28 12:02:21 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:02:21 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:02:21 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:02:21 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:02:21 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:02:21 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:02:21 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:02:21 ctl02 nova-consoleauth[5433]: 2017-09-28 12:02:21.688 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:02:22 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4bb3666b)
Sep 28 12:02:23 ctl02 nova-api[13429]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:02:23 ctl02 nova-api[13429]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:02:23 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:02:23 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:02:23 ctl02 nova-api[13429]: 2017-09-28 12:02:23.230 13429 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:02:23 ctl02 nova-api[13429]: 2017-09-28 12:02:23.233 13429 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:02:23 ctl02 nova-api[13429]: 2017-09-28 12:02:23.233 13429 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:02:23 ctl02 nova-api[13429]: 2017-09-28 12:02:23.233 13429 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:02:23 ctl02 nova-api[13429]: 2017-09-28 12:02:23.233 13429 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:02:23 ctl02 nova-api[13429]: 2017-09-28 12:02:23.233 13429 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:02:23 ctl02 nova-api[13429]: 2017-09-28 12:02:23.233 13429 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:02:23 ctl02 nova-api[13429]: 2017-09-28 12:02:23.233 13429 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:02:23 ctl02 nova-api[13429]: 2017-09-28 12:02:23.233 13429 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:02:23 ctl02 nova-api[13429]: 2017-09-28 12:02:23.233 13429 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:02:23 ctl02 nova-api[13429]: 2017-09-28 12:02:23.233 13429 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:02:23 ctl02 nova-api[13429]: 2017-09-28 12:02:23.233 13429 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:02:23 ctl02 nova-api[13429]: 2017-09-28 12:02:23.233 13429 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:02:23 ctl02 nova-api[13429]: 2017-09-28 12:02:23.233 13429 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:02:23 ctl02 nova-api[13429]: 2017-09-28 12:02:23.233 13429 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:02:23 ctl02 nova-api[13429]: 2017-09-28 12:02:23.233 13429 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:02:23 ctl02 nova-api[13429]: 2017-09-28 12:02:23.233 13429 ERROR nova.wsgi     self.filename))
Sep 28 12:02:23 ctl02 nova-api[13429]: 2017-09-28 12:02:23.233 13429 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:02:23 ctl02 nova-api[13429]: 2017-09-28 12:02:23.233 13429 ERROR nova.wsgi
Sep 28 12:02:23 ctl02 nova-api[13429]: 2017-09-28 12:02:23.234 13429 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:02:23 ctl02 nova-api[13429]: 2017-09-28 12:02:23.369 13429 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:02:23 ctl02 nova-api[13429]: 2017-09-28 12:02:23.610 13429 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:02:23 ctl02 nova-api[13429]: 2017-09-28 12:02:23.612 13429 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:02:23 ctl02 nova-api[13429]: 2017-09-28 12:02:23.612 13429 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:02:23 ctl02 nova-api[13429]: 2017-09-28 12:02:23.613 13429 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:02:23 ctl02 nova-api[13429]: 2017-09-28 12:02:23.745 13429 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:02:23 ctl02 nova-api[13429]: 2017-09-28 12:02:23.746 13429 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:02:23 ctl02 nova-api[13429]: 2017-09-28 12:02:23.747 13429 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:02:23 ctl02 nova-api[13429]: 2017-09-28 12:02:23.747 13429 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:02:23 ctl02 nova-api[13429]: 2017-09-28 12:02:23.750 13429 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:02:23 ctl02 nova-api[13429]: 2017-09-28 12:02:23.750 13429 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:02:23 ctl02 nova-api[13429]: 2017-09-28 12:02:23.750 13429 ERROR nova Traceback (most recent call last):
Sep 28 12:02:23 ctl02 nova-api[13429]: 2017-09-28 12:02:23.750 13429 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:02:23 ctl02 nova-api[13429]: 2017-09-28 12:02:23.750 13429 ERROR nova     sys.exit(main())
Sep 28 12:02:23 ctl02 nova-api[13429]: 2017-09-28 12:02:23.750 13429 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:02:23 ctl02 nova-api[13429]: 2017-09-28 12:02:23.750 13429 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:02:23 ctl02 nova-api[13429]: 2017-09-28 12:02:23.750 13429 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:02:23 ctl02 nova-api[13429]: 2017-09-28 12:02:23.750 13429 ERROR nova     max_url_len=max_url_len)
Sep 28 12:02:23 ctl02 nova-api[13429]: 2017-09-28 12:02:23.750 13429 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:02:23 ctl02 nova-api[13429]: 2017-09-28 12:02:23.750 13429 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:02:23 ctl02 nova-api[13429]: 2017-09-28 12:02:23.750 13429 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:02:23 ctl02 nova-api[13429]: 2017-09-28 12:02:23.750 13429 ERROR nova     sock.listen(backlog)
Sep 28 12:02:23 ctl02 nova-api[13429]: 2017-09-28 12:02:23.750 13429 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:02:23 ctl02 nova-api[13429]: 2017-09-28 12:02:23.750 13429 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:02:23 ctl02 nova-api[13429]: 2017-09-28 12:02:23.750 13429 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:02:23 ctl02 nova-api[13429]: 2017-09-28 12:02:23.750 13429 ERROR nova
Sep 28 12:02:23 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:02:23 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:02:23 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:02:24 ctl02 glance-api[29183]: 2017-09-28 12:02:24.005 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:02:24] "OPTIONS / HTTP/1.0" 200 134 0.000749
Sep 28 12:02:24 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:02:24 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:02:24 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:02:24 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:02:24 ctl02 nova-scheduler[5620]: 2017-09-28 12:02:24.710 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:02:24 ctl02 heat-api[13008]: 2017-09-28 12:02:24.882 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:02:24] "OPTIONS / HTTP/1.0" 200 134 0.000561
Sep 28 12:02:25 ctl02 heat-api[13008]: 2017-09-28 12:02:25.260 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:02:25] "OPTIONS / HTTP/1.0" 200 134 0.000513
Sep 28 12:02:25 ctl02 heat-api[13008]: 2017-09-28 12:02:25.634 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:02:25] "OPTIONS / HTTP/1.0" 200 134 0.001589
Sep 28 12:02:25 ctl02 nova-api[13452]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:02:25 ctl02 nova-api[13452]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:02:25 ctl02 nova-api[13452]: 2017-09-28 12:02:25.947 13452 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:02:25 ctl02 nova-api[13452]: 2017-09-28 12:02:25.949 13452 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:02:25 ctl02 nova-api[13452]: 2017-09-28 12:02:25.949 13452 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:02:25 ctl02 nova-api[13452]: 2017-09-28 12:02:25.949 13452 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:02:25 ctl02 nova-api[13452]: 2017-09-28 12:02:25.949 13452 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:02:25 ctl02 nova-api[13452]: 2017-09-28 12:02:25.949 13452 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:02:25 ctl02 nova-api[13452]: 2017-09-28 12:02:25.949 13452 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:02:25 ctl02 nova-api[13452]: 2017-09-28 12:02:25.949 13452 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:02:25 ctl02 nova-api[13452]: 2017-09-28 12:02:25.949 13452 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:02:25 ctl02 nova-api[13452]: 2017-09-28 12:02:25.949 13452 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:02:25 ctl02 nova-api[13452]: 2017-09-28 12:02:25.949 13452 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:02:25 ctl02 nova-api[13452]: 2017-09-28 12:02:25.949 13452 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:02:25 ctl02 nova-api[13452]: 2017-09-28 12:02:25.949 13452 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:02:25 ctl02 nova-api[13452]: 2017-09-28 12:02:25.949 13452 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:02:25 ctl02 nova-api[13452]: 2017-09-28 12:02:25.949 13452 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:02:25 ctl02 nova-api[13452]: 2017-09-28 12:02:25.949 13452 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:02:25 ctl02 nova-api[13452]: 2017-09-28 12:02:25.949 13452 ERROR nova.wsgi     self.filename))
Sep 28 12:02:25 ctl02 nova-api[13452]: 2017-09-28 12:02:25.949 13452 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:02:25 ctl02 nova-api[13452]: 2017-09-28 12:02:25.949 13452 ERROR nova.wsgi
Sep 28 12:02:25 ctl02 nova-api[13452]: 2017-09-28 12:02:25.950 13452 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:02:26 ctl02 nova-api[13452]: 2017-09-28 12:02:26.079 13452 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:02:26 ctl02 nova-api[13452]: 2017-09-28 12:02:26.318 13452 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:02:26 ctl02 nova-api[13452]: 2017-09-28 12:02:26.320 13452 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:02:26 ctl02 nova-api[13452]: 2017-09-28 12:02:26.321 13452 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:02:26 ctl02 nova-api[13452]: 2017-09-28 12:02:26.321 13452 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:02:26 ctl02 nova-api[13452]: 2017-09-28 12:02:26.453 13452 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:02:26 ctl02 nova-api[13452]: 2017-09-28 12:02:26.455 13452 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:02:26 ctl02 nova-api[13452]: 2017-09-28 12:02:26.456 13452 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:02:26 ctl02 nova-api[13452]: 2017-09-28 12:02:26.456 13452 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:02:26 ctl02 nova-api[13452]: 2017-09-28 12:02:26.460 13452 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:02:26 ctl02 nova-api[13452]: 2017-09-28 12:02:26.460 13452 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:02:26 ctl02 nova-api[13452]: 2017-09-28 12:02:26.460 13452 ERROR nova Traceback (most recent call last):
Sep 28 12:02:26 ctl02 nova-api[13452]: 2017-09-28 12:02:26.460 13452 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:02:26 ctl02 nova-api[13452]: 2017-09-28 12:02:26.460 13452 ERROR nova     sys.exit(main())
Sep 28 12:02:26 ctl02 nova-api[13452]: 2017-09-28 12:02:26.460 13452 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:02:26 ctl02 nova-api[13452]: 2017-09-28 12:02:26.460 13452 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:02:26 ctl02 nova-api[13452]: 2017-09-28 12:02:26.460 13452 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:02:26 ctl02 nova-api[13452]: 2017-09-28 12:02:26.460 13452 ERROR nova     max_url_len=max_url_len)
Sep 28 12:02:26 ctl02 nova-api[13452]: 2017-09-28 12:02:26.460 13452 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:02:26 ctl02 nova-api[13452]: 2017-09-28 12:02:26.460 13452 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:02:26 ctl02 nova-api[13452]: 2017-09-28 12:02:26.460 13452 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:02:26 ctl02 nova-api[13452]: 2017-09-28 12:02:26.460 13452 ERROR nova     sock.listen(backlog)
Sep 28 12:02:26 ctl02 nova-api[13452]: 2017-09-28 12:02:26.460 13452 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:02:26 ctl02 nova-api[13452]: 2017-09-28 12:02:26.460 13452 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:02:26 ctl02 nova-api[13452]: 2017-09-28 12:02:26.460 13452 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:02:26 ctl02 nova-api[13452]: 2017-09-28 12:02:26.460 13452 ERROR nova
Sep 28 12:02:26 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:02:26 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:02:26 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:02:26 ctl02 glance-api[29183]: 2017-09-28 12:02:26.850 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:02:26] "OPTIONS / HTTP/1.0" 200 134 0.001173
Sep 28 12:02:26 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:02:26 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:02:26 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:02:26 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:02:27 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:02:27.564 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:02:27] "OPTIONS / HTTP/1.0" 200 134 0.000475
Sep 28 12:02:27 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:02:27.964 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:02:27] "OPTIONS / HTTP/1.0" 200 134 0.000456
Sep 28 12:02:28 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:02:28.078 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:02:28] "OPTIONS / HTTP/1.0" 200 134 0.000371
Sep 28 12:02:28 ctl02 nova-api[13469]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:02:28 ctl02 nova-api[13469]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:02:28 ctl02 nova-api[13469]: 2017-09-28 12:02:28.706 13469 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:02:28 ctl02 nova-api[13469]: 2017-09-28 12:02:28.708 13469 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:02:28 ctl02 nova-api[13469]: 2017-09-28 12:02:28.708 13469 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:02:28 ctl02 nova-api[13469]: 2017-09-28 12:02:28.708 13469 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:02:28 ctl02 nova-api[13469]: 2017-09-28 12:02:28.708 13469 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:02:28 ctl02 nova-api[13469]: 2017-09-28 12:02:28.708 13469 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:02:28 ctl02 nova-api[13469]: 2017-09-28 12:02:28.708 13469 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:02:28 ctl02 nova-api[13469]: 2017-09-28 12:02:28.708 13469 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:02:28 ctl02 nova-api[13469]: 2017-09-28 12:02:28.708 13469 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:02:28 ctl02 nova-api[13469]: 2017-09-28 12:02:28.708 13469 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:02:28 ctl02 nova-api[13469]: 2017-09-28 12:02:28.708 13469 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:02:28 ctl02 nova-api[13469]: 2017-09-28 12:02:28.708 13469 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:02:28 ctl02 nova-api[13469]: 2017-09-28 12:02:28.708 13469 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:02:28 ctl02 nova-api[13469]: 2017-09-28 12:02:28.708 13469 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:02:28 ctl02 nova-api[13469]: 2017-09-28 12:02:28.708 13469 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:02:28 ctl02 nova-api[13469]: 2017-09-28 12:02:28.708 13469 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:02:28 ctl02 nova-api[13469]: 2017-09-28 12:02:28.708 13469 ERROR nova.wsgi     self.filename))
Sep 28 12:02:28 ctl02 nova-api[13469]: 2017-09-28 12:02:28.708 13469 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:02:28 ctl02 nova-api[13469]: 2017-09-28 12:02:28.708 13469 ERROR nova.wsgi
Sep 28 12:02:28 ctl02 nova-api[13469]: 2017-09-28 12:02:28.709 13469 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:02:28 ctl02 nova-api[13469]: 2017-09-28 12:02:28.838 13469 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:02:29 ctl02 nova-api[13469]: 2017-09-28 12:02:29.056 13469 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:02:29 ctl02 nova-api[13469]: 2017-09-28 12:02:29.058 13469 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:02:29 ctl02 nova-api[13469]: 2017-09-28 12:02:29.058 13469 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:02:29 ctl02 nova-api[13469]: 2017-09-28 12:02:29.059 13469 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:02:29 ctl02 glance-api[29183]: 2017-09-28 12:02:29.145 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:02:29] "OPTIONS / HTTP/1.0" 200 134 0.000552
Sep 28 12:02:29 ctl02 nova-api[13469]: 2017-09-28 12:02:29.190 13469 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:02:29 ctl02 nova-api[13469]: 2017-09-28 12:02:29.192 13469 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:02:29 ctl02 nova-api[13469]: 2017-09-28 12:02:29.192 13469 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:02:29 ctl02 nova-api[13469]: 2017-09-28 12:02:29.192 13469 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:02:29 ctl02 nova-api[13469]: 2017-09-28 12:02:29.195 13469 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:02:29 ctl02 nova-api[13469]: 2017-09-28 12:02:29.195 13469 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:02:29 ctl02 nova-api[13469]: 2017-09-28 12:02:29.195 13469 ERROR nova Traceback (most recent call last):
Sep 28 12:02:29 ctl02 nova-api[13469]: 2017-09-28 12:02:29.195 13469 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:02:29 ctl02 nova-api[13469]: 2017-09-28 12:02:29.195 13469 ERROR nova     sys.exit(main())
Sep 28 12:02:29 ctl02 nova-api[13469]: 2017-09-28 12:02:29.195 13469 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:02:29 ctl02 nova-api[13469]: 2017-09-28 12:02:29.195 13469 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:02:29 ctl02 nova-api[13469]: 2017-09-28 12:02:29.195 13469 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:02:29 ctl02 nova-api[13469]: 2017-09-28 12:02:29.195 13469 ERROR nova     max_url_len=max_url_len)
Sep 28 12:02:29 ctl02 nova-api[13469]: 2017-09-28 12:02:29.195 13469 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:02:29 ctl02 nova-api[13469]: 2017-09-28 12:02:29.195 13469 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:02:29 ctl02 nova-api[13469]: 2017-09-28 12:02:29.195 13469 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:02:29 ctl02 nova-api[13469]: 2017-09-28 12:02:29.195 13469 ERROR nova     sock.listen(backlog)
Sep 28 12:02:29 ctl02 nova-api[13469]: 2017-09-28 12:02:29.195 13469 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:02:29 ctl02 nova-api[13469]: 2017-09-28 12:02:29.195 13469 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:02:29 ctl02 nova-api[13469]: 2017-09-28 12:02:29.195 13469 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:02:29 ctl02 nova-api[13469]: 2017-09-28 12:02:29.195 13469 ERROR nova
Sep 28 12:02:29 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:02:29 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:02:29 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:02:29 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:02:29 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:02:29 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:02:29 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:02:29 ctl02 heat-api-cfn[13300]: 2017-09-28 12:02:29.690 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:02:29] "OPTIONS / HTTP/1.0" 200 134 0.000544
Sep 28 12:02:30 ctl02 heat-api-cfn[13300]: 2017-09-28 12:02:30.041 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:02:30] "OPTIONS / HTTP/1.0" 200 134 0.000416
Sep 28 12:02:30 ctl02 heat-api-cfn[13300]: 2017-09-28 12:02:30.648 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:02:30] "OPTIONS / HTTP/1.0" 200 134 0.000441
Sep 28 12:02:31 ctl02 nova-api[13488]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:02:31 ctl02 nova-api[13488]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:02:31 ctl02 nova-api[13488]: 2017-09-28 12:02:31.458 13488 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:02:31 ctl02 nova-api[13488]: 2017-09-28 12:02:31.460 13488 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:02:31 ctl02 nova-api[13488]: 2017-09-28 12:02:31.460 13488 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:02:31 ctl02 nova-api[13488]: 2017-09-28 12:02:31.460 13488 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:02:31 ctl02 nova-api[13488]: 2017-09-28 12:02:31.460 13488 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:02:31 ctl02 nova-api[13488]: 2017-09-28 12:02:31.460 13488 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:02:31 ctl02 nova-api[13488]: 2017-09-28 12:02:31.460 13488 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:02:31 ctl02 nova-api[13488]: 2017-09-28 12:02:31.460 13488 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:02:31 ctl02 nova-api[13488]: 2017-09-28 12:02:31.460 13488 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:02:31 ctl02 nova-api[13488]: 2017-09-28 12:02:31.460 13488 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:02:31 ctl02 nova-api[13488]: 2017-09-28 12:02:31.460 13488 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:02:31 ctl02 nova-api[13488]: 2017-09-28 12:02:31.460 13488 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:02:31 ctl02 nova-api[13488]: 2017-09-28 12:02:31.460 13488 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:02:31 ctl02 nova-api[13488]: 2017-09-28 12:02:31.460 13488 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:02:31 ctl02 nova-api[13488]: 2017-09-28 12:02:31.460 13488 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:02:31 ctl02 nova-api[13488]: 2017-09-28 12:02:31.460 13488 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:02:31 ctl02 nova-api[13488]: 2017-09-28 12:02:31.460 13488 ERROR nova.wsgi     self.filename))
Sep 28 12:02:31 ctl02 nova-api[13488]: 2017-09-28 12:02:31.460 13488 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:02:31 ctl02 nova-api[13488]: 2017-09-28 12:02:31.460 13488 ERROR nova.wsgi
Sep 28 12:02:31 ctl02 nova-api[13488]: 2017-09-28 12:02:31.463 13488 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:02:31 ctl02 nova-api[13488]: 2017-09-28 12:02:31.594 13488 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:02:31 ctl02 nova-api[13488]: 2017-09-28 12:02:31.828 13488 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:02:31 ctl02 nova-api[13488]: 2017-09-28 12:02:31.830 13488 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:02:31 ctl02 nova-api[13488]: 2017-09-28 12:02:31.831 13488 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:02:31 ctl02 nova-api[13488]: 2017-09-28 12:02:31.831 13488 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:02:31 ctl02 nova-api[13488]: 2017-09-28 12:02:31.964 13488 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:02:31 ctl02 nova-api[13488]: 2017-09-28 12:02:31.966 13488 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:02:31 ctl02 nova-api[13488]: 2017-09-28 12:02:31.967 13488 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:02:31 ctl02 nova-api[13488]: 2017-09-28 12:02:31.967 13488 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:02:31 ctl02 nova-api[13488]: 2017-09-28 12:02:31.971 13488 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:02:31 ctl02 nova-api[13488]: 2017-09-28 12:02:31.971 13488 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:02:31 ctl02 nova-api[13488]: 2017-09-28 12:02:31.971 13488 ERROR nova Traceback (most recent call last):
Sep 28 12:02:31 ctl02 nova-api[13488]: 2017-09-28 12:02:31.971 13488 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:02:31 ctl02 nova-api[13488]: 2017-09-28 12:02:31.971 13488 ERROR nova     sys.exit(main())
Sep 28 12:02:31 ctl02 nova-api[13488]: 2017-09-28 12:02:31.971 13488 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:02:31 ctl02 nova-api[13488]: 2017-09-28 12:02:31.971 13488 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:02:31 ctl02 nova-api[13488]: 2017-09-28 12:02:31.971 13488 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:02:31 ctl02 nova-api[13488]: 2017-09-28 12:02:31.971 13488 ERROR nova     max_url_len=max_url_len)
Sep 28 12:02:31 ctl02 nova-api[13488]: 2017-09-28 12:02:31.971 13488 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:02:31 ctl02 nova-api[13488]: 2017-09-28 12:02:31.971 13488 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:02:31 ctl02 nova-api[13488]: 2017-09-28 12:02:31.971 13488 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:02:31 ctl02 nova-api[13488]: 2017-09-28 12:02:31.971 13488 ERROR nova     sock.listen(backlog)
Sep 28 12:02:31 ctl02 nova-api[13488]: 2017-09-28 12:02:31.971 13488 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:02:31 ctl02 nova-api[13488]: 2017-09-28 12:02:31.971 13488 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:02:31 ctl02 nova-api[13488]: 2017-09-28 12:02:31.971 13488 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:02:31 ctl02 nova-api[13488]: 2017-09-28 12:02:31.971 13488 ERROR nova
Sep 28 12:02:32 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:02:32 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:02:32 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:02:32 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:02:32 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:02:32 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:02:32 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:02:33 ctl02 heat-engine[12803]: 2017-09-28 12:02:33.316 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 16 seconds.
Sep 28 12:02:33 ctl02 heat-engine[12803]: 2017-09-28 12:02:33.355 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 16 seconds.
Sep 28 12:02:33 ctl02 heat-engine[12803]: 2017-09-28 12:02:33.361 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 16 seconds.
Sep 28 12:02:33 ctl02 heat-engine[12803]: 2017-09-28 12:02:33.367 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 16 seconds.
Sep 28 12:02:34 ctl02 nova-api[13505]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:02:34 ctl02 nova-api[13505]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:02:34 ctl02 nova-api[13505]: 2017-09-28 12:02:34.170 13505 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:02:34 ctl02 nova-api[13505]: 2017-09-28 12:02:34.172 13505 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:02:34 ctl02 nova-api[13505]: 2017-09-28 12:02:34.172 13505 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:02:34 ctl02 nova-api[13505]: 2017-09-28 12:02:34.172 13505 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:02:34 ctl02 nova-api[13505]: 2017-09-28 12:02:34.172 13505 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:02:34 ctl02 nova-api[13505]: 2017-09-28 12:02:34.172 13505 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:02:34 ctl02 nova-api[13505]: 2017-09-28 12:02:34.172 13505 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:02:34 ctl02 nova-api[13505]: 2017-09-28 12:02:34.172 13505 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:02:34 ctl02 nova-api[13505]: 2017-09-28 12:02:34.172 13505 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:02:34 ctl02 nova-api[13505]: 2017-09-28 12:02:34.172 13505 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:02:34 ctl02 nova-api[13505]: 2017-09-28 12:02:34.172 13505 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:02:34 ctl02 nova-api[13505]: 2017-09-28 12:02:34.172 13505 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:02:34 ctl02 nova-api[13505]: 2017-09-28 12:02:34.172 13505 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:02:34 ctl02 nova-api[13505]: 2017-09-28 12:02:34.172 13505 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:02:34 ctl02 nova-api[13505]: 2017-09-28 12:02:34.172 13505 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:02:34 ctl02 nova-api[13505]: 2017-09-28 12:02:34.172 13505 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:02:34 ctl02 nova-api[13505]: 2017-09-28 12:02:34.172 13505 ERROR nova.wsgi     self.filename))
Sep 28 12:02:34 ctl02 nova-api[13505]: 2017-09-28 12:02:34.172 13505 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:02:34 ctl02 nova-api[13505]: 2017-09-28 12:02:34.172 13505 ERROR nova.wsgi
Sep 28 12:02:34 ctl02 nova-api[13505]: 2017-09-28 12:02:34.174 13505 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:02:34 ctl02 glance-api[29183]: 2017-09-28 12:02:34.287 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:02:34] "OPTIONS / HTTP/1.0" 200 134 0.000539
Sep 28 12:02:34 ctl02 nova-api[13505]: 2017-09-28 12:02:34.302 13505 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:02:34 ctl02 nova-api[13505]: 2017-09-28 12:02:34.521 13505 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:02:34 ctl02 nova-api[13505]: 2017-09-28 12:02:34.523 13505 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:02:34 ctl02 nova-api[13505]: 2017-09-28 12:02:34.524 13505 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:02:34 ctl02 nova-api[13505]: 2017-09-28 12:02:34.524 13505 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:02:34 ctl02 nova-api[13505]: 2017-09-28 12:02:34.652 13505 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:02:34 ctl02 nova-api[13505]: 2017-09-28 12:02:34.654 13505 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:02:34 ctl02 nova-api[13505]: 2017-09-28 12:02:34.659 13505 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:02:34 ctl02 nova-api[13505]: 2017-09-28 12:02:34.659 13505 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:02:34 ctl02 nova-api[13505]: 2017-09-28 12:02:34.662 13505 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:02:34 ctl02 nova-api[13505]: 2017-09-28 12:02:34.662 13505 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:02:34 ctl02 nova-api[13505]: 2017-09-28 12:02:34.662 13505 ERROR nova Traceback (most recent call last):
Sep 28 12:02:34 ctl02 nova-api[13505]: 2017-09-28 12:02:34.662 13505 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:02:34 ctl02 nova-api[13505]: 2017-09-28 12:02:34.662 13505 ERROR nova     sys.exit(main())
Sep 28 12:02:34 ctl02 nova-api[13505]: 2017-09-28 12:02:34.662 13505 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:02:34 ctl02 nova-api[13505]: 2017-09-28 12:02:34.662 13505 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:02:34 ctl02 nova-api[13505]: 2017-09-28 12:02:34.662 13505 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:02:34 ctl02 nova-api[13505]: 2017-09-28 12:02:34.662 13505 ERROR nova     max_url_len=max_url_len)
Sep 28 12:02:34 ctl02 nova-api[13505]: 2017-09-28 12:02:34.662 13505 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:02:34 ctl02 nova-api[13505]: 2017-09-28 12:02:34.662 13505 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:02:34 ctl02 nova-api[13505]: 2017-09-28 12:02:34.662 13505 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:02:34 ctl02 nova-api[13505]: 2017-09-28 12:02:34.662 13505 ERROR nova     sock.listen(backlog)
Sep 28 12:02:34 ctl02 nova-api[13505]: 2017-09-28 12:02:34.662 13505 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:02:34 ctl02 nova-api[13505]: 2017-09-28 12:02:34.662 13505 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:02:34 ctl02 nova-api[13505]: 2017-09-28 12:02:34.662 13505 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:02:34 ctl02 nova-api[13505]: 2017-09-28 12:02:34.662 13505 ERROR nova
Sep 28 12:02:34 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:02:34 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:02:34 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:02:34 ctl02 heat-api[13008]: 2017-09-28 12:02:34.927 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:02:34] "OPTIONS / HTTP/1.0" 200 134 0.000608
Sep 28 12:02:35 ctl02 heat-api[13008]: 2017-09-28 12:02:34.999 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:02:34] "OPTIONS / HTTP/1.0" 200 134 0.000637
Sep 28 12:02:35 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:02:35 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:02:35 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:02:35 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:02:35 ctl02 heat-api[13008]: 2017-09-28 12:02:35.415 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:02:35] "OPTIONS / HTTP/1.0" 200 134 0.000542
Sep 28 12:02:35 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x153a0725)
Sep 28 12:02:36 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x153a0725)
Sep 28 12:02:36 ctl02 nova-api[13524]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:02:36 ctl02 nova-api[13524]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:02:36 ctl02 glance-api[29183]: 2017-09-28 12:02:36.756 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:02:36] "OPTIONS / HTTP/1.0" 200 134 0.000583
Sep 28 12:02:36 ctl02 nova-api[13524]: 2017-09-28 12:02:36.930 13524 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:02:36 ctl02 nova-api[13524]: 2017-09-28 12:02:36.932 13524 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:02:36 ctl02 nova-api[13524]: 2017-09-28 12:02:36.932 13524 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:02:36 ctl02 nova-api[13524]: 2017-09-28 12:02:36.932 13524 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:02:36 ctl02 nova-api[13524]: 2017-09-28 12:02:36.932 13524 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:02:36 ctl02 nova-api[13524]: 2017-09-28 12:02:36.932 13524 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:02:36 ctl02 nova-api[13524]: 2017-09-28 12:02:36.932 13524 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:02:36 ctl02 nova-api[13524]: 2017-09-28 12:02:36.932 13524 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:02:36 ctl02 nova-api[13524]: 2017-09-28 12:02:36.932 13524 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:02:36 ctl02 nova-api[13524]: 2017-09-28 12:02:36.932 13524 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:02:36 ctl02 nova-api[13524]: 2017-09-28 12:02:36.932 13524 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:02:36 ctl02 nova-api[13524]: 2017-09-28 12:02:36.932 13524 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:02:36 ctl02 nova-api[13524]: 2017-09-28 12:02:36.932 13524 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:02:36 ctl02 nova-api[13524]: 2017-09-28 12:02:36.932 13524 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:02:36 ctl02 nova-api[13524]: 2017-09-28 12:02:36.932 13524 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:02:36 ctl02 nova-api[13524]: 2017-09-28 12:02:36.932 13524 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:02:36 ctl02 nova-api[13524]: 2017-09-28 12:02:36.932 13524 ERROR nova.wsgi     self.filename))
Sep 28 12:02:36 ctl02 nova-api[13524]: 2017-09-28 12:02:36.932 13524 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:02:36 ctl02 nova-api[13524]: 2017-09-28 12:02:36.932 13524 ERROR nova.wsgi
Sep 28 12:02:36 ctl02 nova-api[13524]: 2017-09-28 12:02:36.933 13524 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:02:37 ctl02 nova-api[13524]: 2017-09-28 12:02:37.060 13524 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:02:37 ctl02 nova-api[13524]: 2017-09-28 12:02:37.282 13524 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:02:37 ctl02 nova-api[13524]: 2017-09-28 12:02:37.284 13524 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:02:37 ctl02 nova-api[13524]: 2017-09-28 12:02:37.284 13524 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:02:37 ctl02 nova-api[13524]: 2017-09-28 12:02:37.285 13524 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:02:37 ctl02 nova-api[13524]: 2017-09-28 12:02:37.417 13524 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:02:37 ctl02 nova-api[13524]: 2017-09-28 12:02:37.419 13524 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:02:37 ctl02 nova-api[13524]: 2017-09-28 12:02:37.419 13524 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:02:37 ctl02 nova-api[13524]: 2017-09-28 12:02:37.419 13524 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:02:37 ctl02 nova-api[13524]: 2017-09-28 12:02:37.422 13524 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:02:37 ctl02 nova-api[13524]: 2017-09-28 12:02:37.423 13524 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:02:37 ctl02 nova-api[13524]: 2017-09-28 12:02:37.423 13524 ERROR nova Traceback (most recent call last):
Sep 28 12:02:37 ctl02 nova-api[13524]: 2017-09-28 12:02:37.423 13524 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:02:37 ctl02 nova-api[13524]: 2017-09-28 12:02:37.423 13524 ERROR nova     sys.exit(main())
Sep 28 12:02:37 ctl02 nova-api[13524]: 2017-09-28 12:02:37.423 13524 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:02:37 ctl02 nova-api[13524]: 2017-09-28 12:02:37.423 13524 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:02:37 ctl02 nova-api[13524]: 2017-09-28 12:02:37.423 13524 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:02:37 ctl02 nova-api[13524]: 2017-09-28 12:02:37.423 13524 ERROR nova     max_url_len=max_url_len)
Sep 28 12:02:37 ctl02 nova-api[13524]: 2017-09-28 12:02:37.423 13524 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:02:37 ctl02 nova-api[13524]: 2017-09-28 12:02:37.423 13524 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:02:37 ctl02 nova-api[13524]: 2017-09-28 12:02:37.423 13524 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:02:37 ctl02 nova-api[13524]: 2017-09-28 12:02:37.423 13524 ERROR nova     sock.listen(backlog)
Sep 28 12:02:37 ctl02 nova-api[13524]: 2017-09-28 12:02:37.423 13524 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:02:37 ctl02 nova-api[13524]: 2017-09-28 12:02:37.423 13524 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:02:37 ctl02 nova-api[13524]: 2017-09-28 12:02:37.423 13524 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:02:37 ctl02 nova-api[13524]: 2017-09-28 12:02:37.423 13524 ERROR nova
Sep 28 12:02:37 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:02:37 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:02:37 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:02:37 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x153a0725)
Sep 28 12:02:37 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:02:37.756 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:02:37] "OPTIONS / HTTP/1.0" 200 134 0.000559
Sep 28 12:02:37 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:02:37 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:02:37 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:02:37 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:02:37 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:02:37.954 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:02:37] "OPTIONS / HTTP/1.0" 200 134 0.000502
Sep 28 12:02:38 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:02:38.077 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:02:38] "OPTIONS / HTTP/1.0" 200 134 0.000417
Sep 28 12:02:38 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x153a0725)
Sep 28 12:02:39 ctl02 glance-api[29183]: 2017-09-28 12:02:39.490 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:02:39] "OPTIONS / HTTP/1.0" 200 134 0.000553
Sep 28 12:02:39 ctl02 nova-api[13542]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:02:39 ctl02 nova-api[13542]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:02:39 ctl02 nova-api[13542]: 2017-09-28 12:02:39.659 13542 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:02:39 ctl02 nova-api[13542]: 2017-09-28 12:02:39.661 13542 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:02:39 ctl02 nova-api[13542]: 2017-09-28 12:02:39.661 13542 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:02:39 ctl02 nova-api[13542]: 2017-09-28 12:02:39.661 13542 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:02:39 ctl02 nova-api[13542]: 2017-09-28 12:02:39.661 13542 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:02:39 ctl02 nova-api[13542]: 2017-09-28 12:02:39.661 13542 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:02:39 ctl02 nova-api[13542]: 2017-09-28 12:02:39.661 13542 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:02:39 ctl02 nova-api[13542]: 2017-09-28 12:02:39.661 13542 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:02:39 ctl02 nova-api[13542]: 2017-09-28 12:02:39.661 13542 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:02:39 ctl02 nova-api[13542]: 2017-09-28 12:02:39.661 13542 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:02:39 ctl02 nova-api[13542]: 2017-09-28 12:02:39.661 13542 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:02:39 ctl02 nova-api[13542]: 2017-09-28 12:02:39.661 13542 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:02:39 ctl02 nova-api[13542]: 2017-09-28 12:02:39.661 13542 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:02:39 ctl02 nova-api[13542]: 2017-09-28 12:02:39.661 13542 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:02:39 ctl02 nova-api[13542]: 2017-09-28 12:02:39.661 13542 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:02:39 ctl02 nova-api[13542]: 2017-09-28 12:02:39.661 13542 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:02:39 ctl02 nova-api[13542]: 2017-09-28 12:02:39.661 13542 ERROR nova.wsgi     self.filename))
Sep 28 12:02:39 ctl02 nova-api[13542]: 2017-09-28 12:02:39.661 13542 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:02:39 ctl02 nova-api[13542]: 2017-09-28 12:02:39.661 13542 ERROR nova.wsgi
Sep 28 12:02:39 ctl02 nova-api[13542]: 2017-09-28 12:02:39.668 13542 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:02:39 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x153a0725)
Sep 28 12:02:39 ctl02 nova-api[13542]: 2017-09-28 12:02:39.796 13542 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:02:40 ctl02 heat-api-cfn[13300]: 2017-09-28 12:02:40.001 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:02:40] "OPTIONS / HTTP/1.0" 200 134 0.000471
Sep 28 12:02:40 ctl02 heat-api-cfn[13300]: 2017-09-28 12:02:40.012 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:02:40] "OPTIONS / HTTP/1.0" 200 134 0.000379
Sep 28 12:02:40 ctl02 nova-api[13542]: 2017-09-28 12:02:40.027 13542 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:02:40 ctl02 nova-api[13542]: 2017-09-28 12:02:40.029 13542 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:02:40 ctl02 nova-api[13542]: 2017-09-28 12:02:40.029 13542 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:02:40 ctl02 nova-api[13542]: 2017-09-28 12:02:40.029 13542 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:02:40 ctl02 nova-api[13542]: 2017-09-28 12:02:40.160 13542 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:02:40 ctl02 nova-api[13542]: 2017-09-28 12:02:40.162 13542 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:02:40 ctl02 nova-api[13542]: 2017-09-28 12:02:40.162 13542 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:02:40 ctl02 nova-api[13542]: 2017-09-28 12:02:40.163 13542 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:02:40 ctl02 nova-api[13542]: 2017-09-28 12:02:40.166 13542 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:02:40 ctl02 nova-api[13542]: 2017-09-28 12:02:40.166 13542 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:02:40 ctl02 nova-api[13542]: 2017-09-28 12:02:40.166 13542 ERROR nova Traceback (most recent call last):
Sep 28 12:02:40 ctl02 nova-api[13542]: 2017-09-28 12:02:40.166 13542 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:02:40 ctl02 nova-api[13542]: 2017-09-28 12:02:40.166 13542 ERROR nova     sys.exit(main())
Sep 28 12:02:40 ctl02 nova-api[13542]: 2017-09-28 12:02:40.166 13542 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:02:40 ctl02 nova-api[13542]: 2017-09-28 12:02:40.166 13542 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:02:40 ctl02 nova-api[13542]: 2017-09-28 12:02:40.166 13542 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:02:40 ctl02 nova-api[13542]: 2017-09-28 12:02:40.166 13542 ERROR nova     max_url_len=max_url_len)
Sep 28 12:02:40 ctl02 nova-api[13542]: 2017-09-28 12:02:40.166 13542 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:02:40 ctl02 nova-api[13542]: 2017-09-28 12:02:40.166 13542 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:02:40 ctl02 nova-api[13542]: 2017-09-28 12:02:40.166 13542 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:02:40 ctl02 nova-api[13542]: 2017-09-28 12:02:40.166 13542 ERROR nova     sock.listen(backlog)
Sep 28 12:02:40 ctl02 nova-api[13542]: 2017-09-28 12:02:40.166 13542 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:02:40 ctl02 nova-api[13542]: 2017-09-28 12:02:40.166 13542 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:02:40 ctl02 nova-api[13542]: 2017-09-28 12:02:40.166 13542 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:02:40 ctl02 nova-api[13542]: 2017-09-28 12:02:40.166 13542 ERROR nova
Sep 28 12:02:40 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:02:40 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:02:40 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:02:40 ctl02 heat-api-cfn[13300]: 2017-09-28 12:02:40.427 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:02:40] "OPTIONS / HTTP/1.0" 200 134 0.000491
Sep 28 12:02:40 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:02:40 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:02:40 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:02:40 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:02:40 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x153a0725)
Sep 28 12:02:41 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x153a0725)
Sep 28 12:02:42 ctl02 nova-api[13559]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:02:42 ctl02 nova-api[13559]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:02:42 ctl02 nova-api[13559]: 2017-09-28 12:02:42.413 13559 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:02:42 ctl02 nova-api[13559]: 2017-09-28 12:02:42.415 13559 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:02:42 ctl02 nova-api[13559]: 2017-09-28 12:02:42.415 13559 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:02:42 ctl02 nova-api[13559]: 2017-09-28 12:02:42.415 13559 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:02:42 ctl02 nova-api[13559]: 2017-09-28 12:02:42.415 13559 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:02:42 ctl02 nova-api[13559]: 2017-09-28 12:02:42.415 13559 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:02:42 ctl02 nova-api[13559]: 2017-09-28 12:02:42.415 13559 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:02:42 ctl02 nova-api[13559]: 2017-09-28 12:02:42.415 13559 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:02:42 ctl02 nova-api[13559]: 2017-09-28 12:02:42.415 13559 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:02:42 ctl02 nova-api[13559]: 2017-09-28 12:02:42.415 13559 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:02:42 ctl02 nova-api[13559]: 2017-09-28 12:02:42.415 13559 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:02:42 ctl02 nova-api[13559]: 2017-09-28 12:02:42.415 13559 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:02:42 ctl02 nova-api[13559]: 2017-09-28 12:02:42.415 13559 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:02:42 ctl02 nova-api[13559]: 2017-09-28 12:02:42.415 13559 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:02:42 ctl02 nova-api[13559]: 2017-09-28 12:02:42.415 13559 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:02:42 ctl02 nova-api[13559]: 2017-09-28 12:02:42.415 13559 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:02:42 ctl02 nova-api[13559]: 2017-09-28 12:02:42.415 13559 ERROR nova.wsgi     self.filename))
Sep 28 12:02:42 ctl02 nova-api[13559]: 2017-09-28 12:02:42.415 13559 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:02:42 ctl02 nova-api[13559]: 2017-09-28 12:02:42.415 13559 ERROR nova.wsgi
Sep 28 12:02:42 ctl02 nova-api[13559]: 2017-09-28 12:02:42.416 13559 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:02:42 ctl02 nova-api[13559]: 2017-09-28 12:02:42.541 13559 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:02:42 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x153a0725)
Sep 28 12:02:42 ctl02 nova-api[13559]: 2017-09-28 12:02:42.767 13559 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:02:42 ctl02 nova-api[13559]: 2017-09-28 12:02:42.769 13559 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:02:42 ctl02 nova-api[13559]: 2017-09-28 12:02:42.770 13559 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:02:42 ctl02 nova-api[13559]: 2017-09-28 12:02:42.770 13559 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:02:42 ctl02 nova-api[13559]: 2017-09-28 12:02:42.899 13559 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:02:42 ctl02 nova-api[13559]: 2017-09-28 12:02:42.901 13559 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:02:42 ctl02 nova-api[13559]: 2017-09-28 12:02:42.901 13559 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:02:42 ctl02 nova-api[13559]: 2017-09-28 12:02:42.901 13559 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:02:42 ctl02 nova-api[13559]: 2017-09-28 12:02:42.904 13559 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:02:42 ctl02 nova-api[13559]: 2017-09-28 12:02:42.905 13559 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:02:42 ctl02 nova-api[13559]: 2017-09-28 12:02:42.905 13559 ERROR nova Traceback (most recent call last):
Sep 28 12:02:42 ctl02 nova-api[13559]: 2017-09-28 12:02:42.905 13559 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:02:42 ctl02 nova-api[13559]: 2017-09-28 12:02:42.905 13559 ERROR nova     sys.exit(main())
Sep 28 12:02:42 ctl02 nova-api[13559]: 2017-09-28 12:02:42.905 13559 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:02:42 ctl02 nova-api[13559]: 2017-09-28 12:02:42.905 13559 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:02:42 ctl02 nova-api[13559]: 2017-09-28 12:02:42.905 13559 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:02:42 ctl02 nova-api[13559]: 2017-09-28 12:02:42.905 13559 ERROR nova     max_url_len=max_url_len)
Sep 28 12:02:42 ctl02 nova-api[13559]: 2017-09-28 12:02:42.905 13559 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:02:42 ctl02 nova-api[13559]: 2017-09-28 12:02:42.905 13559 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:02:42 ctl02 nova-api[13559]: 2017-09-28 12:02:42.905 13559 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:02:42 ctl02 nova-api[13559]: 2017-09-28 12:02:42.905 13559 ERROR nova     sock.listen(backlog)
Sep 28 12:02:42 ctl02 nova-api[13559]: 2017-09-28 12:02:42.905 13559 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:02:42 ctl02 nova-api[13559]: 2017-09-28 12:02:42.905 13559 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:02:42 ctl02 nova-api[13559]: 2017-09-28 12:02:42.905 13559 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:02:42 ctl02 nova-api[13559]: 2017-09-28 12:02:42.905 13559 ERROR nova
Sep 28 12:02:43 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:02:43 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:02:43 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:02:43 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:02:43 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:02:43 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:02:43 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:02:43 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x153a0725)
Sep 28 12:02:43 ctl02 nova-cert[4860]: 2017-09-28 12:02:43.836 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:02:44 ctl02 glance-api[29183]: 2017-09-28 12:02:44.240 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:02:44] "OPTIONS / HTTP/1.0" 200 134 0.000903
Sep 28 12:02:44 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x153a0725)
Sep 28 12:02:45 ctl02 nova-api[13578]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:02:45 ctl02 nova-api[13578]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:02:45 ctl02 heat-api[13008]: 2017-09-28 12:02:45.018 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:02:45] "OPTIONS / HTTP/1.0" 200 134 0.000583
Sep 28 12:02:45 ctl02 heat-api[13008]: 2017-09-28 12:02:45.143 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:02:45] "OPTIONS / HTTP/1.0" 200 134 0.000637
Sep 28 12:02:45 ctl02 nova-api[13578]: 2017-09-28 12:02:45.178 13578 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:02:45 ctl02 nova-api[13578]: 2017-09-28 12:02:45.180 13578 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:02:45 ctl02 nova-api[13578]: 2017-09-28 12:02:45.180 13578 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:02:45 ctl02 nova-api[13578]: 2017-09-28 12:02:45.180 13578 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:02:45 ctl02 nova-api[13578]: 2017-09-28 12:02:45.180 13578 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:02:45 ctl02 nova-api[13578]: 2017-09-28 12:02:45.180 13578 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:02:45 ctl02 nova-api[13578]: 2017-09-28 12:02:45.180 13578 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:02:45 ctl02 nova-api[13578]: 2017-09-28 12:02:45.180 13578 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:02:45 ctl02 nova-api[13578]: 2017-09-28 12:02:45.180 13578 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:02:45 ctl02 nova-api[13578]: 2017-09-28 12:02:45.180 13578 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:02:45 ctl02 nova-api[13578]: 2017-09-28 12:02:45.180 13578 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:02:45 ctl02 nova-api[13578]: 2017-09-28 12:02:45.180 13578 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:02:45 ctl02 nova-api[13578]: 2017-09-28 12:02:45.180 13578 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:02:45 ctl02 nova-api[13578]: 2017-09-28 12:02:45.180 13578 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:02:45 ctl02 nova-api[13578]: 2017-09-28 12:02:45.180 13578 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:02:45 ctl02 nova-api[13578]: 2017-09-28 12:02:45.180 13578 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:02:45 ctl02 nova-api[13578]: 2017-09-28 12:02:45.180 13578 ERROR nova.wsgi     self.filename))
Sep 28 12:02:45 ctl02 nova-api[13578]: 2017-09-28 12:02:45.180 13578 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:02:45 ctl02 nova-api[13578]: 2017-09-28 12:02:45.180 13578 ERROR nova.wsgi
Sep 28 12:02:45 ctl02 nova-api[13578]: 2017-09-28 12:02:45.182 13578 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:02:45 ctl02 nova-api[13578]: 2017-09-28 12:02:45.307 13578 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:02:45 ctl02 nova-api[13578]: 2017-09-28 12:02:45.530 13578 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:02:45 ctl02 nova-api[13578]: 2017-09-28 12:02:45.532 13578 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:02:45 ctl02 nova-api[13578]: 2017-09-28 12:02:45.532 13578 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:02:45 ctl02 nova-api[13578]: 2017-09-28 12:02:45.532 13578 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:02:45 ctl02 nova-api[13578]: 2017-09-28 12:02:45.661 13578 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:02:45 ctl02 nova-api[13578]: 2017-09-28 12:02:45.663 13578 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:02:45 ctl02 nova-api[13578]: 2017-09-28 12:02:45.663 13578 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:02:45 ctl02 nova-api[13578]: 2017-09-28 12:02:45.663 13578 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:02:45 ctl02 nova-api[13578]: 2017-09-28 12:02:45.666 13578 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:02:45 ctl02 nova-api[13578]: 2017-09-28 12:02:45.667 13578 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:02:45 ctl02 nova-api[13578]: 2017-09-28 12:02:45.667 13578 ERROR nova Traceback (most recent call last):
Sep 28 12:02:45 ctl02 nova-api[13578]: 2017-09-28 12:02:45.667 13578 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:02:45 ctl02 nova-api[13578]: 2017-09-28 12:02:45.667 13578 ERROR nova     sys.exit(main())
Sep 28 12:02:45 ctl02 nova-api[13578]: 2017-09-28 12:02:45.667 13578 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:02:45 ctl02 nova-api[13578]: 2017-09-28 12:02:45.667 13578 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:02:45 ctl02 nova-api[13578]: 2017-09-28 12:02:45.667 13578 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:02:45 ctl02 nova-api[13578]: 2017-09-28 12:02:45.667 13578 ERROR nova     max_url_len=max_url_len)
Sep 28 12:02:45 ctl02 nova-api[13578]: 2017-09-28 12:02:45.667 13578 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:02:45 ctl02 nova-api[13578]: 2017-09-28 12:02:45.667 13578 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:02:45 ctl02 nova-api[13578]: 2017-09-28 12:02:45.667 13578 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:02:45 ctl02 nova-api[13578]: 2017-09-28 12:02:45.667 13578 ERROR nova     sock.listen(backlog)
Sep 28 12:02:45 ctl02 nova-api[13578]: 2017-09-28 12:02:45.667 13578 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:02:45 ctl02 nova-api[13578]: 2017-09-28 12:02:45.667 13578 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:02:45 ctl02 nova-api[13578]: 2017-09-28 12:02:45.667 13578 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:02:45 ctl02 nova-api[13578]: 2017-09-28 12:02:45.667 13578 ERROR nova
Sep 28 12:02:45 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x153a0725)
Sep 28 12:02:45 ctl02 heat-api[13008]: 2017-09-28 12:02:45.759 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:02:45] "OPTIONS / HTTP/1.0" 200 134 0.000526
Sep 28 12:02:45 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:02:45 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:02:45 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:02:46 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:02:46 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:02:46 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:02:46 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:02:46 ctl02 nova-conductor[5056]: 2017-09-28 12:02:46.267 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:02:46 ctl02 nova-conductor[5056]: 2017-09-28 12:02:46.292 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:02:46 ctl02 nova-conductor[5056]: 2017-09-28 12:02:46.303 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:02:46 ctl02 nova-conductor[5056]: 2017-09-28 12:02:46.306 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:02:46 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:02:46 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:02:46 ctl02 glance-api[29183]: 2017-09-28 12:02:46.914 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:02:46] "OPTIONS / HTTP/1.0" 200 134 0.000583
Sep 28 12:02:47 ctl02 nova-api[13596]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:02:47 ctl02 nova-api[13596]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:02:47 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:02:47.872 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:02:47] "OPTIONS / HTTP/1.0" 200 134 0.000447
Sep 28 12:02:47 ctl02 nova-api[13596]: 2017-09-28 12:02:47.929 13596 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:02:47 ctl02 nova-api[13596]: 2017-09-28 12:02:47.930 13596 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:02:47 ctl02 nova-api[13596]: 2017-09-28 12:02:47.930 13596 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:02:47 ctl02 nova-api[13596]: 2017-09-28 12:02:47.930 13596 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:02:47 ctl02 nova-api[13596]: 2017-09-28 12:02:47.930 13596 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:02:47 ctl02 nova-api[13596]: 2017-09-28 12:02:47.930 13596 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:02:47 ctl02 nova-api[13596]: 2017-09-28 12:02:47.930 13596 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:02:47 ctl02 nova-api[13596]: 2017-09-28 12:02:47.930 13596 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:02:47 ctl02 nova-api[13596]: 2017-09-28 12:02:47.930 13596 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:02:47 ctl02 nova-api[13596]: 2017-09-28 12:02:47.930 13596 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:02:47 ctl02 nova-api[13596]: 2017-09-28 12:02:47.930 13596 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:02:47 ctl02 nova-api[13596]: 2017-09-28 12:02:47.930 13596 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:02:47 ctl02 nova-api[13596]: 2017-09-28 12:02:47.930 13596 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:02:47 ctl02 nova-api[13596]: 2017-09-28 12:02:47.930 13596 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:02:47 ctl02 nova-api[13596]: 2017-09-28 12:02:47.930 13596 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:02:47 ctl02 nova-api[13596]: 2017-09-28 12:02:47.930 13596 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:02:47 ctl02 nova-api[13596]: 2017-09-28 12:02:47.930 13596 ERROR nova.wsgi     self.filename))
Sep 28 12:02:47 ctl02 nova-api[13596]: 2017-09-28 12:02:47.930 13596 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:02:47 ctl02 nova-api[13596]: 2017-09-28 12:02:47.930 13596 ERROR nova.wsgi
Sep 28 12:02:47 ctl02 nova-api[13596]: 2017-09-28 12:02:47.931 13596 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:02:48 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:02:48.056 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:02:48] "OPTIONS / HTTP/1.0" 200 134 0.000469
Sep 28 12:02:48 ctl02 nova-api[13596]: 2017-09-28 12:02:48.062 13596 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:02:48 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:02:48.230 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:02:48] "OPTIONS / HTTP/1.0" 200 134 0.000467
Sep 28 12:02:48 ctl02 nova-api[13596]: 2017-09-28 12:02:48.296 13596 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:02:48 ctl02 nova-api[13596]: 2017-09-28 12:02:48.298 13596 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:02:48 ctl02 nova-api[13596]: 2017-09-28 12:02:48.298 13596 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:02:48 ctl02 nova-api[13596]: 2017-09-28 12:02:48.298 13596 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:02:48 ctl02 nova-api[13596]: 2017-09-28 12:02:48.430 13596 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:02:48 ctl02 nova-api[13596]: 2017-09-28 12:02:48.432 13596 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:02:48 ctl02 nova-api[13596]: 2017-09-28 12:02:48.432 13596 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:02:48 ctl02 nova-api[13596]: 2017-09-28 12:02:48.433 13596 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:02:48 ctl02 nova-api[13596]: 2017-09-28 12:02:48.436 13596 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:02:48 ctl02 nova-api[13596]: 2017-09-28 12:02:48.436 13596 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:02:48 ctl02 nova-api[13596]: 2017-09-28 12:02:48.436 13596 ERROR nova Traceback (most recent call last):
Sep 28 12:02:48 ctl02 nova-api[13596]: 2017-09-28 12:02:48.436 13596 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:02:48 ctl02 nova-api[13596]: 2017-09-28 12:02:48.436 13596 ERROR nova     sys.exit(main())
Sep 28 12:02:48 ctl02 nova-api[13596]: 2017-09-28 12:02:48.436 13596 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:02:48 ctl02 nova-api[13596]: 2017-09-28 12:02:48.436 13596 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:02:48 ctl02 nova-api[13596]: 2017-09-28 12:02:48.436 13596 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:02:48 ctl02 nova-api[13596]: 2017-09-28 12:02:48.436 13596 ERROR nova     max_url_len=max_url_len)
Sep 28 12:02:48 ctl02 nova-api[13596]: 2017-09-28 12:02:48.436 13596 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:02:48 ctl02 nova-api[13596]: 2017-09-28 12:02:48.436 13596 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:02:48 ctl02 nova-api[13596]: 2017-09-28 12:02:48.436 13596 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:02:48 ctl02 nova-api[13596]: 2017-09-28 12:02:48.436 13596 ERROR nova     sock.listen(backlog)
Sep 28 12:02:48 ctl02 nova-api[13596]: 2017-09-28 12:02:48.436 13596 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:02:48 ctl02 nova-api[13596]: 2017-09-28 12:02:48.436 13596 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:02:48 ctl02 nova-api[13596]: 2017-09-28 12:02:48.436 13596 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:02:48 ctl02 nova-api[13596]: 2017-09-28 12:02:48.436 13596 ERROR nova
Sep 28 12:02:48 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:02:48 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:02:48 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:02:48 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:02:48 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:02:48 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:02:48 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:02:49 ctl02 heat-engine[12803]: 2017-09-28 12:02:49.323 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 18 seconds.
Sep 28 12:02:49 ctl02 heat-engine[12803]: 2017-09-28 12:02:49.361 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 18 seconds.
Sep 28 12:02:49 ctl02 heat-engine[12803]: 2017-09-28 12:02:49.373 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 18 seconds.
Sep 28 12:02:49 ctl02 heat-engine[12803]: 2017-09-28 12:02:49.373 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 18 seconds.
Sep 28 12:02:49 ctl02 glance-api[29183]: 2017-09-28 12:02:49.528 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:02:49] "OPTIONS / HTTP/1.0" 200 134 0.000609
Sep 28 12:02:49 ctl02 heat-api-cfn[13300]: 2017-09-28 12:02:49.700 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:02:49] "OPTIONS / HTTP/1.0" 200 134 0.000441
Sep 28 12:02:49 ctl02 heat-api-cfn[13300]: 2017-09-28 12:02:49.947 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:02:49] "OPTIONS / HTTP/1.0" 200 134 0.000407
Sep 28 12:02:50 ctl02 nova-api[13619]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:02:50 ctl02 nova-api[13619]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:02:50 ctl02 nova-api[13619]: 2017-09-28 12:02:50.681 13619 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:02:50 ctl02 nova-api[13619]: 2017-09-28 12:02:50.683 13619 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:02:50 ctl02 nova-api[13619]: 2017-09-28 12:02:50.683 13619 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:02:50 ctl02 nova-api[13619]: 2017-09-28 12:02:50.683 13619 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:02:50 ctl02 nova-api[13619]: 2017-09-28 12:02:50.683 13619 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:02:50 ctl02 nova-api[13619]: 2017-09-28 12:02:50.683 13619 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:02:50 ctl02 nova-api[13619]: 2017-09-28 12:02:50.683 13619 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:02:50 ctl02 nova-api[13619]: 2017-09-28 12:02:50.683 13619 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:02:50 ctl02 nova-api[13619]: 2017-09-28 12:02:50.683 13619 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:02:50 ctl02 nova-api[13619]: 2017-09-28 12:02:50.683 13619 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:02:50 ctl02 nova-api[13619]: 2017-09-28 12:02:50.683 13619 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:02:50 ctl02 nova-api[13619]: 2017-09-28 12:02:50.683 13619 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:02:50 ctl02 nova-api[13619]: 2017-09-28 12:02:50.683 13619 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:02:50 ctl02 nova-api[13619]: 2017-09-28 12:02:50.683 13619 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:02:50 ctl02 nova-api[13619]: 2017-09-28 12:02:50.683 13619 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:02:50 ctl02 nova-api[13619]: 2017-09-28 12:02:50.683 13619 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:02:50 ctl02 nova-api[13619]: 2017-09-28 12:02:50.683 13619 ERROR nova.wsgi     self.filename))
Sep 28 12:02:50 ctl02 nova-api[13619]: 2017-09-28 12:02:50.683 13619 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:02:50 ctl02 nova-api[13619]: 2017-09-28 12:02:50.683 13619 ERROR nova.wsgi
Sep 28 12:02:50 ctl02 nova-api[13619]: 2017-09-28 12:02:50.684 13619 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:02:50 ctl02 heat-api-cfn[13300]: 2017-09-28 12:02:50.700 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:02:50] "OPTIONS / HTTP/1.0" 200 134 0.000457
Sep 28 12:02:50 ctl02 nova-api[13619]: 2017-09-28 12:02:50.815 13619 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:02:51 ctl02 nova-api[13619]: 2017-09-28 12:02:51.045 13619 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:02:51 ctl02 nova-api[13619]: 2017-09-28 12:02:51.048 13619 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:02:51 ctl02 nova-api[13619]: 2017-09-28 12:02:51.048 13619 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:02:51 ctl02 nova-api[13619]: 2017-09-28 12:02:51.048 13619 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:02:51 ctl02 nova-api[13619]: 2017-09-28 12:02:51.180 13619 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:02:51 ctl02 nova-api[13619]: 2017-09-28 12:02:51.182 13619 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:02:51 ctl02 nova-api[13619]: 2017-09-28 12:02:51.182 13619 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:02:51 ctl02 nova-api[13619]: 2017-09-28 12:02:51.183 13619 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:02:51 ctl02 nova-api[13619]: 2017-09-28 12:02:51.186 13619 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:02:51 ctl02 nova-api[13619]: 2017-09-28 12:02:51.186 13619 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:02:51 ctl02 nova-api[13619]: 2017-09-28 12:02:51.186 13619 ERROR nova Traceback (most recent call last):
Sep 28 12:02:51 ctl02 nova-api[13619]: 2017-09-28 12:02:51.186 13619 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:02:51 ctl02 nova-api[13619]: 2017-09-28 12:02:51.186 13619 ERROR nova     sys.exit(main())
Sep 28 12:02:51 ctl02 nova-api[13619]: 2017-09-28 12:02:51.186 13619 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:02:51 ctl02 nova-api[13619]: 2017-09-28 12:02:51.186 13619 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:02:51 ctl02 nova-api[13619]: 2017-09-28 12:02:51.186 13619 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:02:51 ctl02 nova-api[13619]: 2017-09-28 12:02:51.186 13619 ERROR nova     max_url_len=max_url_len)
Sep 28 12:02:51 ctl02 nova-api[13619]: 2017-09-28 12:02:51.186 13619 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:02:51 ctl02 nova-api[13619]: 2017-09-28 12:02:51.186 13619 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:02:51 ctl02 nova-api[13619]: 2017-09-28 12:02:51.186 13619 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:02:51 ctl02 nova-api[13619]: 2017-09-28 12:02:51.186 13619 ERROR nova     sock.listen(backlog)
Sep 28 12:02:51 ctl02 nova-api[13619]: 2017-09-28 12:02:51.186 13619 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:02:51 ctl02 nova-api[13619]: 2017-09-28 12:02:51.186 13619 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:02:51 ctl02 nova-api[13619]: 2017-09-28 12:02:51.186 13619 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:02:51 ctl02 nova-api[13619]: 2017-09-28 12:02:51.186 13619 ERROR nova
Sep 28 12:02:51 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:02:51 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:02:51 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:02:51 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:02:51 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:02:51 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:02:51 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:02:53 ctl02 nova-api[13636]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:02:53 ctl02 nova-api[13636]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:02:53 ctl02 nova-api[13636]: 2017-09-28 12:02:53.450 13636 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:02:53 ctl02 nova-api[13636]: 2017-09-28 12:02:53.452 13636 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:02:53 ctl02 nova-api[13636]: 2017-09-28 12:02:53.452 13636 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:02:53 ctl02 nova-api[13636]: 2017-09-28 12:02:53.452 13636 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:02:53 ctl02 nova-api[13636]: 2017-09-28 12:02:53.452 13636 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:02:53 ctl02 nova-api[13636]: 2017-09-28 12:02:53.452 13636 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:02:53 ctl02 nova-api[13636]: 2017-09-28 12:02:53.452 13636 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:02:53 ctl02 nova-api[13636]: 2017-09-28 12:02:53.452 13636 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:02:53 ctl02 nova-api[13636]: 2017-09-28 12:02:53.452 13636 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:02:53 ctl02 nova-api[13636]: 2017-09-28 12:02:53.452 13636 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:02:53 ctl02 nova-api[13636]: 2017-09-28 12:02:53.452 13636 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:02:53 ctl02 nova-api[13636]: 2017-09-28 12:02:53.452 13636 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:02:53 ctl02 nova-api[13636]: 2017-09-28 12:02:53.452 13636 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:02:53 ctl02 nova-api[13636]: 2017-09-28 12:02:53.452 13636 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:02:53 ctl02 nova-api[13636]: 2017-09-28 12:02:53.452 13636 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:02:53 ctl02 nova-api[13636]: 2017-09-28 12:02:53.452 13636 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:02:53 ctl02 nova-api[13636]: 2017-09-28 12:02:53.452 13636 ERROR nova.wsgi     self.filename))
Sep 28 12:02:53 ctl02 nova-api[13636]: 2017-09-28 12:02:53.452 13636 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:02:53 ctl02 nova-api[13636]: 2017-09-28 12:02:53.452 13636 ERROR nova.wsgi
Sep 28 12:02:53 ctl02 nova-api[13636]: 2017-09-28 12:02:53.453 13636 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:02:53 ctl02 nova-api[13636]: 2017-09-28 12:02:53.584 13636 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:02:53 ctl02 nova-consoleauth[5433]: 2017-09-28 12:02:53.726 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:02:53 ctl02 nova-api[13636]: 2017-09-28 12:02:53.827 13636 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:02:53 ctl02 nova-api[13636]: 2017-09-28 12:02:53.829 13636 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:02:53 ctl02 nova-api[13636]: 2017-09-28 12:02:53.829 13636 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:02:53 ctl02 nova-api[13636]: 2017-09-28 12:02:53.829 13636 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:02:53 ctl02 nova-api[13636]: 2017-09-28 12:02:53.959 13636 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:02:53 ctl02 nova-api[13636]: 2017-09-28 12:02:53.961 13636 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:02:53 ctl02 nova-api[13636]: 2017-09-28 12:02:53.961 13636 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:02:53 ctl02 nova-api[13636]: 2017-09-28 12:02:53.961 13636 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:02:53 ctl02 nova-api[13636]: 2017-09-28 12:02:53.964 13636 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:02:53 ctl02 nova-api[13636]: 2017-09-28 12:02:53.965 13636 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:02:53 ctl02 nova-api[13636]: 2017-09-28 12:02:53.965 13636 ERROR nova Traceback (most recent call last):
Sep 28 12:02:53 ctl02 nova-api[13636]: 2017-09-28 12:02:53.965 13636 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:02:53 ctl02 nova-api[13636]: 2017-09-28 12:02:53.965 13636 ERROR nova     sys.exit(main())
Sep 28 12:02:53 ctl02 nova-api[13636]: 2017-09-28 12:02:53.965 13636 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:02:53 ctl02 nova-api[13636]: 2017-09-28 12:02:53.965 13636 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:02:53 ctl02 nova-api[13636]: 2017-09-28 12:02:53.965 13636 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:02:53 ctl02 nova-api[13636]: 2017-09-28 12:02:53.965 13636 ERROR nova     max_url_len=max_url_len)
Sep 28 12:02:53 ctl02 nova-api[13636]: 2017-09-28 12:02:53.965 13636 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:02:53 ctl02 nova-api[13636]: 2017-09-28 12:02:53.965 13636 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:02:53 ctl02 nova-api[13636]: 2017-09-28 12:02:53.965 13636 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:02:53 ctl02 nova-api[13636]: 2017-09-28 12:02:53.965 13636 ERROR nova     sock.listen(backlog)
Sep 28 12:02:53 ctl02 nova-api[13636]: 2017-09-28 12:02:53.965 13636 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:02:53 ctl02 nova-api[13636]: 2017-09-28 12:02:53.965 13636 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:02:53 ctl02 nova-api[13636]: 2017-09-28 12:02:53.965 13636 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:02:53 ctl02 nova-api[13636]: 2017-09-28 12:02:53.965 13636 ERROR nova
Sep 28 12:02:54 ctl02 glance-api[29183]: 2017-09-28 12:02:54.082 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:02:54] "OPTIONS / HTTP/1.0" 200 134 0.000619
Sep 28 12:02:54 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:02:54 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:02:54 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:02:54 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:02:54 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:02:54 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:02:54 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:02:54 ctl02 heat-api[13008]: 2017-09-28 12:02:54.898 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:02:54] "OPTIONS / HTTP/1.0" 200 134 0.000561
Sep 28 12:02:55 ctl02 heat-api[13008]: 2017-09-28 12:02:55.423 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:02:55] "OPTIONS / HTTP/1.0" 200 134 0.000572
Sep 28 12:02:55 ctl02 heat-api[13008]: 2017-09-28 12:02:55.992 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:02:55] "OPTIONS / HTTP/1.0" 200 134 0.000369
Sep 28 12:02:56 ctl02 nova-api[13655]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:02:56 ctl02 nova-api[13655]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:02:56 ctl02 nova-api[13655]: 2017-09-28 12:02:56.227 13655 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:02:56 ctl02 nova-api[13655]: 2017-09-28 12:02:56.229 13655 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:02:56 ctl02 nova-api[13655]: 2017-09-28 12:02:56.229 13655 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:02:56 ctl02 nova-api[13655]: 2017-09-28 12:02:56.229 13655 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:02:56 ctl02 nova-api[13655]: 2017-09-28 12:02:56.229 13655 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:02:56 ctl02 nova-api[13655]: 2017-09-28 12:02:56.229 13655 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:02:56 ctl02 nova-api[13655]: 2017-09-28 12:02:56.229 13655 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:02:56 ctl02 nova-api[13655]: 2017-09-28 12:02:56.229 13655 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:02:56 ctl02 nova-api[13655]: 2017-09-28 12:02:56.229 13655 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:02:56 ctl02 nova-api[13655]: 2017-09-28 12:02:56.229 13655 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:02:56 ctl02 nova-api[13655]: 2017-09-28 12:02:56.229 13655 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:02:56 ctl02 nova-api[13655]: 2017-09-28 12:02:56.229 13655 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:02:56 ctl02 nova-api[13655]: 2017-09-28 12:02:56.229 13655 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:02:56 ctl02 nova-api[13655]: 2017-09-28 12:02:56.229 13655 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:02:56 ctl02 nova-api[13655]: 2017-09-28 12:02:56.229 13655 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:02:56 ctl02 nova-api[13655]: 2017-09-28 12:02:56.229 13655 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:02:56 ctl02 nova-api[13655]: 2017-09-28 12:02:56.229 13655 ERROR nova.wsgi     self.filename))
Sep 28 12:02:56 ctl02 nova-api[13655]: 2017-09-28 12:02:56.229 13655 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:02:56 ctl02 nova-api[13655]: 2017-09-28 12:02:56.229 13655 ERROR nova.wsgi
Sep 28 12:02:56 ctl02 nova-api[13655]: 2017-09-28 12:02:56.230 13655 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:02:56 ctl02 nova-api[13655]: 2017-09-28 12:02:56.361 13655 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:02:56 ctl02 glance-api[29183]: 2017-09-28 12:02:56.586 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:02:56] "OPTIONS / HTTP/1.0" 200 134 0.000652
Sep 28 12:02:56 ctl02 nova-api[13655]: 2017-09-28 12:02:56.588 13655 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:02:56 ctl02 nova-api[13655]: 2017-09-28 12:02:56.591 13655 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:02:56 ctl02 nova-api[13655]: 2017-09-28 12:02:56.591 13655 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:02:56 ctl02 nova-api[13655]: 2017-09-28 12:02:56.592 13655 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:02:56 ctl02 nova-api[13655]: 2017-09-28 12:02:56.722 13655 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:02:56 ctl02 nova-api[13655]: 2017-09-28 12:02:56.724 13655 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:02:56 ctl02 nova-api[13655]: 2017-09-28 12:02:56.724 13655 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:02:56 ctl02 nova-api[13655]: 2017-09-28 12:02:56.724 13655 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:02:56 ctl02 nova-api[13655]: 2017-09-28 12:02:56.727 13655 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:02:56 ctl02 nova-api[13655]: 2017-09-28 12:02:56.728 13655 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:02:56 ctl02 nova-api[13655]: 2017-09-28 12:02:56.728 13655 ERROR nova Traceback (most recent call last):
Sep 28 12:02:56 ctl02 nova-api[13655]: 2017-09-28 12:02:56.728 13655 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:02:56 ctl02 nova-api[13655]: 2017-09-28 12:02:56.728 13655 ERROR nova     sys.exit(main())
Sep 28 12:02:56 ctl02 nova-api[13655]: 2017-09-28 12:02:56.728 13655 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:02:56 ctl02 nova-api[13655]: 2017-09-28 12:02:56.728 13655 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:02:56 ctl02 nova-api[13655]: 2017-09-28 12:02:56.728 13655 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:02:56 ctl02 nova-api[13655]: 2017-09-28 12:02:56.728 13655 ERROR nova     max_url_len=max_url_len)
Sep 28 12:02:56 ctl02 nova-api[13655]: 2017-09-28 12:02:56.728 13655 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:02:56 ctl02 nova-api[13655]: 2017-09-28 12:02:56.728 13655 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:02:56 ctl02 nova-api[13655]: 2017-09-28 12:02:56.728 13655 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:02:56 ctl02 nova-api[13655]: 2017-09-28 12:02:56.728 13655 ERROR nova     sock.listen(backlog)
Sep 28 12:02:56 ctl02 nova-api[13655]: 2017-09-28 12:02:56.728 13655 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:02:56 ctl02 nova-api[13655]: 2017-09-28 12:02:56.728 13655 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:02:56 ctl02 nova-api[13655]: 2017-09-28 12:02:56.728 13655 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:02:56 ctl02 nova-api[13655]: 2017-09-28 12:02:56.728 13655 ERROR nova
Sep 28 12:02:56 ctl02 nova-scheduler[5620]: 2017-09-28 12:02:56.745 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:02:56 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:02:56 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:02:56 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:02:57 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:02:57 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:02:57 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:02:57 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:02:58 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:02:58.118 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:02:58] "OPTIONS / HTTP/1.0" 200 134 0.000481
Sep 28 12:02:58 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:02:58.323 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:02:58] "OPTIONS / HTTP/1.0" 200 134 0.000364
Sep 28 12:02:58 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:02:58.335 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:02:58] "OPTIONS / HTTP/1.0" 200 134 0.000250
Sep 28 12:02:58 ctl02 nova-api[13673]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:02:58 ctl02 nova-api[13673]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:02:58 ctl02 nova-api[13673]: 2017-09-28 12:02:58.955 13673 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:02:58 ctl02 nova-api[13673]: 2017-09-28 12:02:58.956 13673 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:02:58 ctl02 nova-api[13673]: 2017-09-28 12:02:58.956 13673 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:02:58 ctl02 nova-api[13673]: 2017-09-28 12:02:58.956 13673 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:02:58 ctl02 nova-api[13673]: 2017-09-28 12:02:58.956 13673 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:02:58 ctl02 nova-api[13673]: 2017-09-28 12:02:58.956 13673 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:02:58 ctl02 nova-api[13673]: 2017-09-28 12:02:58.956 13673 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:02:58 ctl02 nova-api[13673]: 2017-09-28 12:02:58.956 13673 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:02:58 ctl02 nova-api[13673]: 2017-09-28 12:02:58.956 13673 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:02:58 ctl02 nova-api[13673]: 2017-09-28 12:02:58.956 13673 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:02:58 ctl02 nova-api[13673]: 2017-09-28 12:02:58.956 13673 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:02:58 ctl02 nova-api[13673]: 2017-09-28 12:02:58.956 13673 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:02:58 ctl02 nova-api[13673]: 2017-09-28 12:02:58.956 13673 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:02:58 ctl02 nova-api[13673]: 2017-09-28 12:02:58.956 13673 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:02:58 ctl02 nova-api[13673]: 2017-09-28 12:02:58.956 13673 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:02:58 ctl02 nova-api[13673]: 2017-09-28 12:02:58.956 13673 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:02:58 ctl02 nova-api[13673]: 2017-09-28 12:02:58.956 13673 ERROR nova.wsgi     self.filename))
Sep 28 12:02:58 ctl02 nova-api[13673]: 2017-09-28 12:02:58.956 13673 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:02:58 ctl02 nova-api[13673]: 2017-09-28 12:02:58.956 13673 ERROR nova.wsgi
Sep 28 12:02:58 ctl02 nova-api[13673]: 2017-09-28 12:02:58.957 13673 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:02:59 ctl02 nova-api[13673]: 2017-09-28 12:02:59.083 13673 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:02:59 ctl02 nova-api[13673]: 2017-09-28 12:02:59.311 13673 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:02:59 ctl02 nova-api[13673]: 2017-09-28 12:02:59.313 13673 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:02:59 ctl02 nova-api[13673]: 2017-09-28 12:02:59.313 13673 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:02:59 ctl02 nova-api[13673]: 2017-09-28 12:02:59.313 13673 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:02:59 ctl02 heat-api-cfn[13300]: 2017-09-28 12:02:59.370 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:02:59] "OPTIONS / HTTP/1.0" 200 134 0.000615
Sep 28 12:02:59 ctl02 nova-api[13673]: 2017-09-28 12:02:59.442 13673 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:02:59 ctl02 nova-api[13673]: 2017-09-28 12:02:59.444 13673 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:02:59 ctl02 nova-api[13673]: 2017-09-28 12:02:59.444 13673 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:02:59 ctl02 nova-api[13673]: 2017-09-28 12:02:59.445 13673 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:02:59 ctl02 nova-api[13673]: 2017-09-28 12:02:59.448 13673 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:02:59 ctl02 nova-api[13673]: 2017-09-28 12:02:59.448 13673 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:02:59 ctl02 nova-api[13673]: 2017-09-28 12:02:59.448 13673 ERROR nova Traceback (most recent call last):
Sep 28 12:02:59 ctl02 nova-api[13673]: 2017-09-28 12:02:59.448 13673 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:02:59 ctl02 nova-api[13673]: 2017-09-28 12:02:59.448 13673 ERROR nova     sys.exit(main())
Sep 28 12:02:59 ctl02 nova-api[13673]: 2017-09-28 12:02:59.448 13673 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:02:59 ctl02 nova-api[13673]: 2017-09-28 12:02:59.448 13673 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:02:59 ctl02 nova-api[13673]: 2017-09-28 12:02:59.448 13673 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:02:59 ctl02 nova-api[13673]: 2017-09-28 12:02:59.448 13673 ERROR nova     max_url_len=max_url_len)
Sep 28 12:02:59 ctl02 nova-api[13673]: 2017-09-28 12:02:59.448 13673 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:02:59 ctl02 nova-api[13673]: 2017-09-28 12:02:59.448 13673 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:02:59 ctl02 nova-api[13673]: 2017-09-28 12:02:59.448 13673 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:02:59 ctl02 nova-api[13673]: 2017-09-28 12:02:59.448 13673 ERROR nova     sock.listen(backlog)
Sep 28 12:02:59 ctl02 nova-api[13673]: 2017-09-28 12:02:59.448 13673 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:02:59 ctl02 nova-api[13673]: 2017-09-28 12:02:59.448 13673 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:02:59 ctl02 nova-api[13673]: 2017-09-28 12:02:59.448 13673 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:02:59 ctl02 nova-api[13673]: 2017-09-28 12:02:59.448 13673 ERROR nova
Sep 28 12:02:59 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:02:59 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:02:59 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:02:59 ctl02 glance-api[29183]: 2017-09-28 12:02:59.663 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:02:59] "OPTIONS / HTTP/1.0" 200 134 0.000759
Sep 28 12:02:59 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:02:59 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:02:59 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:02:59 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:03:00 ctl02 heat-api-cfn[13300]: 2017-09-28 12:03:00.185 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:03:00] "OPTIONS / HTTP/1.0" 200 134 0.000469
Sep 28 12:03:00 ctl02 heat-api-cfn[13300]: 2017-09-28 12:03:00.523 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:03:00] "OPTIONS / HTTP/1.0" 200 134 0.000353
Sep 28 12:03:01 ctl02 nova-api[13691]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:03:01 ctl02 nova-api[13691]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:03:01 ctl02 nova-api[13691]: 2017-09-28 12:03:01.731 13691 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:03:01 ctl02 nova-api[13691]: 2017-09-28 12:03:01.733 13691 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:03:01 ctl02 nova-api[13691]: 2017-09-28 12:03:01.733 13691 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:03:01 ctl02 nova-api[13691]: 2017-09-28 12:03:01.733 13691 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:03:01 ctl02 nova-api[13691]: 2017-09-28 12:03:01.733 13691 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:03:01 ctl02 nova-api[13691]: 2017-09-28 12:03:01.733 13691 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:03:01 ctl02 nova-api[13691]: 2017-09-28 12:03:01.733 13691 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:03:01 ctl02 nova-api[13691]: 2017-09-28 12:03:01.733 13691 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:03:01 ctl02 nova-api[13691]: 2017-09-28 12:03:01.733 13691 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:03:01 ctl02 nova-api[13691]: 2017-09-28 12:03:01.733 13691 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:03:01 ctl02 nova-api[13691]: 2017-09-28 12:03:01.733 13691 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:03:01 ctl02 nova-api[13691]: 2017-09-28 12:03:01.733 13691 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:03:01 ctl02 nova-api[13691]: 2017-09-28 12:03:01.733 13691 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:03:01 ctl02 nova-api[13691]: 2017-09-28 12:03:01.733 13691 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:03:01 ctl02 nova-api[13691]: 2017-09-28 12:03:01.733 13691 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:03:01 ctl02 nova-api[13691]: 2017-09-28 12:03:01.733 13691 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:03:01 ctl02 nova-api[13691]: 2017-09-28 12:03:01.733 13691 ERROR nova.wsgi     self.filename))
Sep 28 12:03:01 ctl02 nova-api[13691]: 2017-09-28 12:03:01.733 13691 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:03:01 ctl02 nova-api[13691]: 2017-09-28 12:03:01.733 13691 ERROR nova.wsgi
Sep 28 12:03:01 ctl02 nova-api[13691]: 2017-09-28 12:03:01.734 13691 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:03:01 ctl02 nova-api[13691]: 2017-09-28 12:03:01.867 13691 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:03:02 ctl02 nova-api[13691]: 2017-09-28 12:03:02.112 13691 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:03:02 ctl02 nova-api[13691]: 2017-09-28 12:03:02.114 13691 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:03:02 ctl02 nova-api[13691]: 2017-09-28 12:03:02.115 13691 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:03:02 ctl02 nova-api[13691]: 2017-09-28 12:03:02.115 13691 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:03:02 ctl02 nova-api[13691]: 2017-09-28 12:03:02.251 13691 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:03:02 ctl02 nova-api[13691]: 2017-09-28 12:03:02.253 13691 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:03:02 ctl02 nova-api[13691]: 2017-09-28 12:03:02.254 13691 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:03:02 ctl02 nova-api[13691]: 2017-09-28 12:03:02.254 13691 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:03:02 ctl02 nova-api[13691]: 2017-09-28 12:03:02.257 13691 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:03:02 ctl02 nova-api[13691]: 2017-09-28 12:03:02.258 13691 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:03:02 ctl02 nova-api[13691]: 2017-09-28 12:03:02.258 13691 ERROR nova Traceback (most recent call last):
Sep 28 12:03:02 ctl02 nova-api[13691]: 2017-09-28 12:03:02.258 13691 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:03:02 ctl02 nova-api[13691]: 2017-09-28 12:03:02.258 13691 ERROR nova     sys.exit(main())
Sep 28 12:03:02 ctl02 nova-api[13691]: 2017-09-28 12:03:02.258 13691 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:03:02 ctl02 nova-api[13691]: 2017-09-28 12:03:02.258 13691 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:03:02 ctl02 nova-api[13691]: 2017-09-28 12:03:02.258 13691 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:03:02 ctl02 nova-api[13691]: 2017-09-28 12:03:02.258 13691 ERROR nova     max_url_len=max_url_len)
Sep 28 12:03:02 ctl02 nova-api[13691]: 2017-09-28 12:03:02.258 13691 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:03:02 ctl02 nova-api[13691]: 2017-09-28 12:03:02.258 13691 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:03:02 ctl02 nova-api[13691]: 2017-09-28 12:03:02.258 13691 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:03:02 ctl02 nova-api[13691]: 2017-09-28 12:03:02.258 13691 ERROR nova     sock.listen(backlog)
Sep 28 12:03:02 ctl02 nova-api[13691]: 2017-09-28 12:03:02.258 13691 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:03:02 ctl02 nova-api[13691]: 2017-09-28 12:03:02.258 13691 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:03:02 ctl02 nova-api[13691]: 2017-09-28 12:03:02.258 13691 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:03:02 ctl02 nova-api[13691]: 2017-09-28 12:03:02.258 13691 ERROR nova
Sep 28 12:03:02 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:03:02 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:03:02 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:03:02 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:03:02 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:03:02 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:03:02 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:03:03 ctl02 glance-api[29183]: 2017-09-28 12:03:03.757 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:03:03] "OPTIONS / HTTP/1.0" 200 134 0.000612
Sep 28 12:03:04 ctl02 nova-api[13709]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:03:04 ctl02 nova-api[13709]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:03:04 ctl02 nova-api[13709]: 2017-09-28 12:03:04.435 13709 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:03:04 ctl02 nova-api[13709]: 2017-09-28 12:03:04.437 13709 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:03:04 ctl02 nova-api[13709]: 2017-09-28 12:03:04.437 13709 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:03:04 ctl02 nova-api[13709]: 2017-09-28 12:03:04.437 13709 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:03:04 ctl02 nova-api[13709]: 2017-09-28 12:03:04.437 13709 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:03:04 ctl02 nova-api[13709]: 2017-09-28 12:03:04.437 13709 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:03:04 ctl02 nova-api[13709]: 2017-09-28 12:03:04.437 13709 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:03:04 ctl02 nova-api[13709]: 2017-09-28 12:03:04.437 13709 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:03:04 ctl02 nova-api[13709]: 2017-09-28 12:03:04.437 13709 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:03:04 ctl02 nova-api[13709]: 2017-09-28 12:03:04.437 13709 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:03:04 ctl02 nova-api[13709]: 2017-09-28 12:03:04.437 13709 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:03:04 ctl02 nova-api[13709]: 2017-09-28 12:03:04.437 13709 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:03:04 ctl02 nova-api[13709]: 2017-09-28 12:03:04.437 13709 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:03:04 ctl02 nova-api[13709]: 2017-09-28 12:03:04.437 13709 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:03:04 ctl02 nova-api[13709]: 2017-09-28 12:03:04.437 13709 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:03:04 ctl02 nova-api[13709]: 2017-09-28 12:03:04.437 13709 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:03:04 ctl02 nova-api[13709]: 2017-09-28 12:03:04.437 13709 ERROR nova.wsgi     self.filename))
Sep 28 12:03:04 ctl02 nova-api[13709]: 2017-09-28 12:03:04.437 13709 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:03:04 ctl02 nova-api[13709]: 2017-09-28 12:03:04.437 13709 ERROR nova.wsgi
Sep 28 12:03:04 ctl02 nova-api[13709]: 2017-09-28 12:03:04.440 13709 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:03:04 ctl02 nova-api[13709]: 2017-09-28 12:03:04.567 13709 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:03:04 ctl02 nova-api[13709]: 2017-09-28 12:03:04.799 13709 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:03:04 ctl02 nova-api[13709]: 2017-09-28 12:03:04.802 13709 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:03:04 ctl02 nova-api[13709]: 2017-09-28 12:03:04.802 13709 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:03:04 ctl02 nova-api[13709]: 2017-09-28 12:03:04.802 13709 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:03:04 ctl02 nova-api[13709]: 2017-09-28 12:03:04.933 13709 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:03:04 ctl02 nova-api[13709]: 2017-09-28 12:03:04.935 13709 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:03:04 ctl02 nova-api[13709]: 2017-09-28 12:03:04.936 13709 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:03:04 ctl02 nova-api[13709]: 2017-09-28 12:03:04.936 13709 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:03:04 ctl02 nova-api[13709]: 2017-09-28 12:03:04.939 13709 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:03:04 ctl02 nova-api[13709]: 2017-09-28 12:03:04.940 13709 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:03:04 ctl02 nova-api[13709]: 2017-09-28 12:03:04.940 13709 ERROR nova Traceback (most recent call last):
Sep 28 12:03:04 ctl02 nova-api[13709]: 2017-09-28 12:03:04.940 13709 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:03:04 ctl02 nova-api[13709]: 2017-09-28 12:03:04.940 13709 ERROR nova     sys.exit(main())
Sep 28 12:03:04 ctl02 nova-api[13709]: 2017-09-28 12:03:04.940 13709 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:03:04 ctl02 nova-api[13709]: 2017-09-28 12:03:04.940 13709 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:03:04 ctl02 nova-api[13709]: 2017-09-28 12:03:04.940 13709 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:03:04 ctl02 nova-api[13709]: 2017-09-28 12:03:04.940 13709 ERROR nova     max_url_len=max_url_len)
Sep 28 12:03:04 ctl02 nova-api[13709]: 2017-09-28 12:03:04.940 13709 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:03:04 ctl02 nova-api[13709]: 2017-09-28 12:03:04.940 13709 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:03:04 ctl02 nova-api[13709]: 2017-09-28 12:03:04.940 13709 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:03:04 ctl02 nova-api[13709]: 2017-09-28 12:03:04.940 13709 ERROR nova     sock.listen(backlog)
Sep 28 12:03:04 ctl02 nova-api[13709]: 2017-09-28 12:03:04.940 13709 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:03:04 ctl02 nova-api[13709]: 2017-09-28 12:03:04.940 13709 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:03:04 ctl02 nova-api[13709]: 2017-09-28 12:03:04.940 13709 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:03:04 ctl02 nova-api[13709]: 2017-09-28 12:03:04.940 13709 ERROR nova
Sep 28 12:03:04 ctl02 heat-api[13008]: 2017-09-28 12:03:04.951 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:03:04] "OPTIONS / HTTP/1.0" 200 134 0.000575
Sep 28 12:03:05 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:03:05 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:03:05 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:03:05 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:03:05 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:03:05 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:03:05 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:03:05 ctl02 heat-api[13008]: 2017-09-28 12:03:05.458 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:03:05] "OPTIONS / HTTP/1.0" 200 134 0.000719
Sep 28 12:03:05 ctl02 heat-api[13008]: 2017-09-28 12:03:05.704 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:03:05] "OPTIONS / HTTP/1.0" 200 134 0.000655
Sep 28 12:03:06 ctl02 glance-api[29183]: 2017-09-28 12:03:06.296 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:03:06] "OPTIONS / HTTP/1.0" 200 134 0.000605
Sep 28 12:03:07 ctl02 nova-api[13727]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:03:07 ctl02 nova-api[13727]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:03:07 ctl02 nova-api[13727]: 2017-09-28 12:03:07.202 13727 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:03:07 ctl02 nova-api[13727]: 2017-09-28 12:03:07.204 13727 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:03:07 ctl02 nova-api[13727]: 2017-09-28 12:03:07.204 13727 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:03:07 ctl02 nova-api[13727]: 2017-09-28 12:03:07.204 13727 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:03:07 ctl02 nova-api[13727]: 2017-09-28 12:03:07.204 13727 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:03:07 ctl02 nova-api[13727]: 2017-09-28 12:03:07.204 13727 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:03:07 ctl02 nova-api[13727]: 2017-09-28 12:03:07.204 13727 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:03:07 ctl02 nova-api[13727]: 2017-09-28 12:03:07.204 13727 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:03:07 ctl02 nova-api[13727]: 2017-09-28 12:03:07.204 13727 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:03:07 ctl02 nova-api[13727]: 2017-09-28 12:03:07.204 13727 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:03:07 ctl02 nova-api[13727]: 2017-09-28 12:03:07.204 13727 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:03:07 ctl02 nova-api[13727]: 2017-09-28 12:03:07.204 13727 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:03:07 ctl02 nova-api[13727]: 2017-09-28 12:03:07.204 13727 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:03:07 ctl02 nova-api[13727]: 2017-09-28 12:03:07.204 13727 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:03:07 ctl02 nova-api[13727]: 2017-09-28 12:03:07.204 13727 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:03:07 ctl02 nova-api[13727]: 2017-09-28 12:03:07.204 13727 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:03:07 ctl02 nova-api[13727]: 2017-09-28 12:03:07.204 13727 ERROR nova.wsgi     self.filename))
Sep 28 12:03:07 ctl02 nova-api[13727]: 2017-09-28 12:03:07.204 13727 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:03:07 ctl02 nova-api[13727]: 2017-09-28 12:03:07.204 13727 ERROR nova.wsgi
Sep 28 12:03:07 ctl02 nova-api[13727]: 2017-09-28 12:03:07.205 13727 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:03:07 ctl02 heat-engine[12803]: 2017-09-28 12:03:07.330 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 20 seconds.
Sep 28 12:03:07 ctl02 nova-api[13727]: 2017-09-28 12:03:07.338 13727 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:03:07 ctl02 heat-engine[12803]: 2017-09-28 12:03:07.368 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 20 seconds.
Sep 28 12:03:07 ctl02 heat-engine[12803]: 2017-09-28 12:03:07.380 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 20 seconds.
Sep 28 12:03:07 ctl02 heat-engine[12803]: 2017-09-28 12:03:07.385 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 20 seconds.
Sep 28 12:03:07 ctl02 nova-api[13727]: 2017-09-28 12:03:07.584 13727 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:03:07 ctl02 nova-api[13727]: 2017-09-28 12:03:07.586 13727 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:03:07 ctl02 nova-api[13727]: 2017-09-28 12:03:07.587 13727 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:03:07 ctl02 nova-api[13727]: 2017-09-28 12:03:07.587 13727 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:03:07 ctl02 nova-api[13727]: 2017-09-28 12:03:07.720 13727 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:03:07 ctl02 nova-api[13727]: 2017-09-28 12:03:07.722 13727 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:03:07 ctl02 nova-api[13727]: 2017-09-28 12:03:07.722 13727 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:03:07 ctl02 nova-api[13727]: 2017-09-28 12:03:07.723 13727 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:03:07 ctl02 nova-api[13727]: 2017-09-28 12:03:07.726 13727 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:03:07 ctl02 nova-api[13727]: 2017-09-28 12:03:07.726 13727 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:03:07 ctl02 nova-api[13727]: 2017-09-28 12:03:07.726 13727 ERROR nova Traceback (most recent call last):
Sep 28 12:03:07 ctl02 nova-api[13727]: 2017-09-28 12:03:07.726 13727 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:03:07 ctl02 nova-api[13727]: 2017-09-28 12:03:07.726 13727 ERROR nova     sys.exit(main())
Sep 28 12:03:07 ctl02 nova-api[13727]: 2017-09-28 12:03:07.726 13727 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:03:07 ctl02 nova-api[13727]: 2017-09-28 12:03:07.726 13727 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:03:07 ctl02 nova-api[13727]: 2017-09-28 12:03:07.726 13727 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:03:07 ctl02 nova-api[13727]: 2017-09-28 12:03:07.726 13727 ERROR nova     max_url_len=max_url_len)
Sep 28 12:03:07 ctl02 nova-api[13727]: 2017-09-28 12:03:07.726 13727 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:03:07 ctl02 nova-api[13727]: 2017-09-28 12:03:07.726 13727 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:03:07 ctl02 nova-api[13727]: 2017-09-28 12:03:07.726 13727 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:03:07 ctl02 nova-api[13727]: 2017-09-28 12:03:07.726 13727 ERROR nova     sock.listen(backlog)
Sep 28 12:03:07 ctl02 nova-api[13727]: 2017-09-28 12:03:07.726 13727 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:03:07 ctl02 nova-api[13727]: 2017-09-28 12:03:07.726 13727 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:03:07 ctl02 nova-api[13727]: 2017-09-28 12:03:07.726 13727 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:03:07 ctl02 nova-api[13727]: 2017-09-28 12:03:07.726 13727 ERROR nova
Sep 28 12:03:07 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:03:07 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:03:07 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:03:07 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xabc0b75d)
Sep 28 12:03:08 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:03:08 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:03:08 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:03:08 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:03:08 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:03:08.313 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:03:08] "OPTIONS / HTTP/1.0" 200 134 0.000451
Sep 28 12:03:08 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:03:08.400 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:03:08] "OPTIONS / HTTP/1.0" 200 134 0.000455
Sep 28 12:03:08 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:03:08.468 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:03:08] "OPTIONS / HTTP/1.0" 200 134 0.000437
Sep 28 12:03:08 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xabc0b75d)
Sep 28 12:03:09 ctl02 glance-api[29183]: 2017-09-28 12:03:09.588 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:03:09] "OPTIONS / HTTP/1.0" 200 134 0.000577
Sep 28 12:03:09 ctl02 heat-api-cfn[13300]: 2017-09-28 12:03:09.641 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:03:09] "OPTIONS / HTTP/1.0" 200 134 0.000569
Sep 28 12:03:09 ctl02 nova-api[13745]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:03:09 ctl02 nova-api[13745]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:03:09 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xabc0b75d)
Sep 28 12:03:09 ctl02 nova-api[13745]: 2017-09-28 12:03:09.944 13745 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:03:09 ctl02 nova-api[13745]: 2017-09-28 12:03:09.946 13745 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:03:09 ctl02 nova-api[13745]: 2017-09-28 12:03:09.946 13745 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:03:09 ctl02 nova-api[13745]: 2017-09-28 12:03:09.946 13745 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:03:09 ctl02 nova-api[13745]: 2017-09-28 12:03:09.946 13745 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:03:09 ctl02 nova-api[13745]: 2017-09-28 12:03:09.946 13745 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:03:09 ctl02 nova-api[13745]: 2017-09-28 12:03:09.946 13745 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:03:09 ctl02 nova-api[13745]: 2017-09-28 12:03:09.946 13745 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:03:09 ctl02 nova-api[13745]: 2017-09-28 12:03:09.946 13745 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:03:09 ctl02 nova-api[13745]: 2017-09-28 12:03:09.946 13745 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:03:09 ctl02 nova-api[13745]: 2017-09-28 12:03:09.946 13745 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:03:09 ctl02 nova-api[13745]: 2017-09-28 12:03:09.946 13745 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:03:09 ctl02 nova-api[13745]: 2017-09-28 12:03:09.946 13745 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:03:09 ctl02 nova-api[13745]: 2017-09-28 12:03:09.946 13745 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:03:09 ctl02 nova-api[13745]: 2017-09-28 12:03:09.946 13745 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:03:09 ctl02 nova-api[13745]: 2017-09-28 12:03:09.946 13745 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:03:09 ctl02 nova-api[13745]: 2017-09-28 12:03:09.946 13745 ERROR nova.wsgi     self.filename))
Sep 28 12:03:09 ctl02 nova-api[13745]: 2017-09-28 12:03:09.946 13745 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:03:09 ctl02 nova-api[13745]: 2017-09-28 12:03:09.946 13745 ERROR nova.wsgi
Sep 28 12:03:09 ctl02 nova-api[13745]: 2017-09-28 12:03:09.947 13745 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:03:10 ctl02 nova-api[13745]: 2017-09-28 12:03:10.078 13745 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:03:10 ctl02 heat-api-cfn[13300]: 2017-09-28 12:03:10.277 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:03:10] "OPTIONS / HTTP/1.0" 200 134 0.000471
Sep 28 12:03:10 ctl02 nova-api[13745]: 2017-09-28 12:03:10.316 13745 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:03:10 ctl02 nova-api[13745]: 2017-09-28 12:03:10.318 13745 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:03:10 ctl02 nova-api[13745]: 2017-09-28 12:03:10.318 13745 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:03:10 ctl02 nova-api[13745]: 2017-09-28 12:03:10.318 13745 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:03:10 ctl02 heat-api-cfn[13300]: 2017-09-28 12:03:10.413 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:03:10] "OPTIONS / HTTP/1.0" 200 134 0.000485
Sep 28 12:03:10 ctl02 nova-api[13745]: 2017-09-28 12:03:10.453 13745 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:03:10 ctl02 nova-api[13745]: 2017-09-28 12:03:10.454 13745 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:03:10 ctl02 nova-api[13745]: 2017-09-28 12:03:10.455 13745 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:03:10 ctl02 nova-api[13745]: 2017-09-28 12:03:10.455 13745 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:03:10 ctl02 nova-api[13745]: 2017-09-28 12:03:10.458 13745 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:03:10 ctl02 nova-api[13745]: 2017-09-28 12:03:10.458 13745 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:03:10 ctl02 nova-api[13745]: 2017-09-28 12:03:10.458 13745 ERROR nova Traceback (most recent call last):
Sep 28 12:03:10 ctl02 nova-api[13745]: 2017-09-28 12:03:10.458 13745 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:03:10 ctl02 nova-api[13745]: 2017-09-28 12:03:10.458 13745 ERROR nova     sys.exit(main())
Sep 28 12:03:10 ctl02 nova-api[13745]: 2017-09-28 12:03:10.458 13745 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:03:10 ctl02 nova-api[13745]: 2017-09-28 12:03:10.458 13745 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:03:10 ctl02 nova-api[13745]: 2017-09-28 12:03:10.458 13745 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:03:10 ctl02 nova-api[13745]: 2017-09-28 12:03:10.458 13745 ERROR nova     max_url_len=max_url_len)
Sep 28 12:03:10 ctl02 nova-api[13745]: 2017-09-28 12:03:10.458 13745 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:03:10 ctl02 nova-api[13745]: 2017-09-28 12:03:10.458 13745 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:03:10 ctl02 nova-api[13745]: 2017-09-28 12:03:10.458 13745 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:03:10 ctl02 nova-api[13745]: 2017-09-28 12:03:10.458 13745 ERROR nova     sock.listen(backlog)
Sep 28 12:03:10 ctl02 nova-api[13745]: 2017-09-28 12:03:10.458 13745 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:03:10 ctl02 nova-api[13745]: 2017-09-28 12:03:10.458 13745 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:03:10 ctl02 nova-api[13745]: 2017-09-28 12:03:10.458 13745 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:03:10 ctl02 nova-api[13745]: 2017-09-28 12:03:10.458 13745 ERROR nova
Sep 28 12:03:10 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:03:10 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:03:10 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:03:10 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:03:10 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:03:10 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:03:10 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:03:10 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xabc0b75d)
Sep 28 12:03:11 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xabc0b75d)
Sep 28 12:03:12 ctl02 nova-api[13763]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:03:12 ctl02 nova-api[13763]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:03:12 ctl02 nova-api[13763]: 2017-09-28 12:03:12.706 13763 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:03:12 ctl02 nova-api[13763]: 2017-09-28 12:03:12.708 13763 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:03:12 ctl02 nova-api[13763]: 2017-09-28 12:03:12.708 13763 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:03:12 ctl02 nova-api[13763]: 2017-09-28 12:03:12.708 13763 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:03:12 ctl02 nova-api[13763]: 2017-09-28 12:03:12.708 13763 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:03:12 ctl02 nova-api[13763]: 2017-09-28 12:03:12.708 13763 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:03:12 ctl02 nova-api[13763]: 2017-09-28 12:03:12.708 13763 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:03:12 ctl02 nova-api[13763]: 2017-09-28 12:03:12.708 13763 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:03:12 ctl02 nova-api[13763]: 2017-09-28 12:03:12.708 13763 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:03:12 ctl02 nova-api[13763]: 2017-09-28 12:03:12.708 13763 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:03:12 ctl02 nova-api[13763]: 2017-09-28 12:03:12.708 13763 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:03:12 ctl02 nova-api[13763]: 2017-09-28 12:03:12.708 13763 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:03:12 ctl02 nova-api[13763]: 2017-09-28 12:03:12.708 13763 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:03:12 ctl02 nova-api[13763]: 2017-09-28 12:03:12.708 13763 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:03:12 ctl02 nova-api[13763]: 2017-09-28 12:03:12.708 13763 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:03:12 ctl02 nova-api[13763]: 2017-09-28 12:03:12.708 13763 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:03:12 ctl02 nova-api[13763]: 2017-09-28 12:03:12.708 13763 ERROR nova.wsgi     self.filename))
Sep 28 12:03:12 ctl02 nova-api[13763]: 2017-09-28 12:03:12.708 13763 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:03:12 ctl02 nova-api[13763]: 2017-09-28 12:03:12.708 13763 ERROR nova.wsgi
Sep 28 12:03:12 ctl02 nova-api[13763]: 2017-09-28 12:03:12.710 13763 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:03:12 ctl02 nova-api[13763]: 2017-09-28 12:03:12.840 13763 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:03:12 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xabc0b75d)
Sep 28 12:03:13 ctl02 nova-api[13763]: 2017-09-28 12:03:13.077 13763 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:03:13 ctl02 nova-api[13763]: 2017-09-28 12:03:13.080 13763 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:03:13 ctl02 nova-api[13763]: 2017-09-28 12:03:13.080 13763 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:03:13 ctl02 nova-api[13763]: 2017-09-28 12:03:13.081 13763 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:03:13 ctl02 nova-api[13763]: 2017-09-28 12:03:13.214 13763 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:03:13 ctl02 nova-api[13763]: 2017-09-28 12:03:13.216 13763 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:03:13 ctl02 nova-api[13763]: 2017-09-28 12:03:13.217 13763 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:03:13 ctl02 nova-api[13763]: 2017-09-28 12:03:13.217 13763 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:03:13 ctl02 nova-api[13763]: 2017-09-28 12:03:13.221 13763 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:03:13 ctl02 nova-api[13763]: 2017-09-28 12:03:13.221 13763 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:03:13 ctl02 nova-api[13763]: 2017-09-28 12:03:13.221 13763 ERROR nova Traceback (most recent call last):
Sep 28 12:03:13 ctl02 nova-api[13763]: 2017-09-28 12:03:13.221 13763 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:03:13 ctl02 nova-api[13763]: 2017-09-28 12:03:13.221 13763 ERROR nova     sys.exit(main())
Sep 28 12:03:13 ctl02 nova-api[13763]: 2017-09-28 12:03:13.221 13763 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:03:13 ctl02 nova-api[13763]: 2017-09-28 12:03:13.221 13763 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:03:13 ctl02 nova-api[13763]: 2017-09-28 12:03:13.221 13763 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:03:13 ctl02 nova-api[13763]: 2017-09-28 12:03:13.221 13763 ERROR nova     max_url_len=max_url_len)
Sep 28 12:03:13 ctl02 nova-api[13763]: 2017-09-28 12:03:13.221 13763 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:03:13 ctl02 nova-api[13763]: 2017-09-28 12:03:13.221 13763 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:03:13 ctl02 nova-api[13763]: 2017-09-28 12:03:13.221 13763 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:03:13 ctl02 nova-api[13763]: 2017-09-28 12:03:13.221 13763 ERROR nova     sock.listen(backlog)
Sep 28 12:03:13 ctl02 nova-api[13763]: 2017-09-28 12:03:13.221 13763 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:03:13 ctl02 nova-api[13763]: 2017-09-28 12:03:13.221 13763 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:03:13 ctl02 nova-api[13763]: 2017-09-28 12:03:13.221 13763 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:03:13 ctl02 nova-api[13763]: 2017-09-28 12:03:13.221 13763 ERROR nova
Sep 28 12:03:13 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:03:13 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:03:13 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:03:13 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:03:13 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:03:13 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:03:13 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:03:13 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xabc0b75d)
Sep 28 12:03:14 ctl02 glance-api[29183]: 2017-09-28 12:03:14.132 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:03:14] "OPTIONS / HTTP/1.0" 200 134 0.000634
Sep 28 12:03:14 ctl02 heat-api[13008]: 2017-09-28 12:03:14.827 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:03:14] "OPTIONS / HTTP/1.0" 200 134 0.000615
Sep 28 12:03:14 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xabc0b75d)
Sep 28 12:03:15 ctl02 nova-api[13780]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:03:15 ctl02 nova-api[13780]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:03:15 ctl02 heat-api[13008]: 2017-09-28 12:03:15.305 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:03:15] "OPTIONS / HTTP/1.0" 200 134 0.000593
Sep 28 12:03:15 ctl02 nova-api[13780]: 2017-09-28 12:03:15.466 13780 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:03:15 ctl02 nova-api[13780]: 2017-09-28 12:03:15.468 13780 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:03:15 ctl02 nova-api[13780]: 2017-09-28 12:03:15.468 13780 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:03:15 ctl02 nova-api[13780]: 2017-09-28 12:03:15.468 13780 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:03:15 ctl02 nova-api[13780]: 2017-09-28 12:03:15.468 13780 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:03:15 ctl02 nova-api[13780]: 2017-09-28 12:03:15.468 13780 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:03:15 ctl02 nova-api[13780]: 2017-09-28 12:03:15.468 13780 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:03:15 ctl02 nova-api[13780]: 2017-09-28 12:03:15.468 13780 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:03:15 ctl02 nova-api[13780]: 2017-09-28 12:03:15.468 13780 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:03:15 ctl02 nova-api[13780]: 2017-09-28 12:03:15.468 13780 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:03:15 ctl02 nova-api[13780]: 2017-09-28 12:03:15.468 13780 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:03:15 ctl02 nova-api[13780]: 2017-09-28 12:03:15.468 13780 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:03:15 ctl02 nova-api[13780]: 2017-09-28 12:03:15.468 13780 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:03:15 ctl02 nova-api[13780]: 2017-09-28 12:03:15.468 13780 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:03:15 ctl02 nova-api[13780]: 2017-09-28 12:03:15.468 13780 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:03:15 ctl02 nova-api[13780]: 2017-09-28 12:03:15.468 13780 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:03:15 ctl02 nova-api[13780]: 2017-09-28 12:03:15.468 13780 ERROR nova.wsgi     self.filename))
Sep 28 12:03:15 ctl02 nova-api[13780]: 2017-09-28 12:03:15.468 13780 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:03:15 ctl02 nova-api[13780]: 2017-09-28 12:03:15.468 13780 ERROR nova.wsgi
Sep 28 12:03:15 ctl02 nova-api[13780]: 2017-09-28 12:03:15.469 13780 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:03:15 ctl02 heat-api[13008]: 2017-09-28 12:03:15.577 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:03:15] "OPTIONS / HTTP/1.0" 200 134 0.000563
Sep 28 12:03:15 ctl02 nova-api[13780]: 2017-09-28 12:03:15.601 13780 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:03:15 ctl02 nova-api[13780]: 2017-09-28 12:03:15.832 13780 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:03:15 ctl02 nova-api[13780]: 2017-09-28 12:03:15.834 13780 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:03:15 ctl02 nova-api[13780]: 2017-09-28 12:03:15.834 13780 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:03:15 ctl02 nova-api[13780]: 2017-09-28 12:03:15.835 13780 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:03:15 ctl02 nova-cert[4860]: 2017-09-28 12:03:15.873 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:03:15 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xabc0b75d)
Sep 28 12:03:15 ctl02 dhclient[600]: DHCPREQUEST of 192.168.11.25 on ens2 to 192.168.11.3 port 67 (xid=0x3415f07)
Sep 28 12:03:15 ctl02 nova-api[13780]: 2017-09-28 12:03:15.967 13780 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:03:15 ctl02 nova-api[13780]: 2017-09-28 12:03:15.969 13780 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:03:15 ctl02 nova-api[13780]: 2017-09-28 12:03:15.969 13780 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:03:15 ctl02 nova-api[13780]: 2017-09-28 12:03:15.969 13780 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:03:15 ctl02 nova-api[13780]: 2017-09-28 12:03:15.972 13780 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:03:15 ctl02 nova-api[13780]: 2017-09-28 12:03:15.973 13780 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:03:15 ctl02 nova-api[13780]: 2017-09-28 12:03:15.973 13780 ERROR nova Traceback (most recent call last):
Sep 28 12:03:15 ctl02 nova-api[13780]: 2017-09-28 12:03:15.973 13780 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:03:15 ctl02 nova-api[13780]: 2017-09-28 12:03:15.973 13780 ERROR nova     sys.exit(main())
Sep 28 12:03:15 ctl02 nova-api[13780]: 2017-09-28 12:03:15.973 13780 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:03:15 ctl02 nova-api[13780]: 2017-09-28 12:03:15.973 13780 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:03:15 ctl02 nova-api[13780]: 2017-09-28 12:03:15.973 13780 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:03:15 ctl02 nova-api[13780]: 2017-09-28 12:03:15.973 13780 ERROR nova     max_url_len=max_url_len)
Sep 28 12:03:15 ctl02 nova-api[13780]: 2017-09-28 12:03:15.973 13780 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:03:15 ctl02 nova-api[13780]: 2017-09-28 12:03:15.973 13780 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:03:15 ctl02 nova-api[13780]: 2017-09-28 12:03:15.973 13780 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:03:15 ctl02 nova-api[13780]: 2017-09-28 12:03:15.973 13780 ERROR nova     sock.listen(backlog)
Sep 28 12:03:15 ctl02 nova-api[13780]: 2017-09-28 12:03:15.973 13780 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:03:15 ctl02 nova-api[13780]: 2017-09-28 12:03:15.973 13780 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:03:15 ctl02 nova-api[13780]: 2017-09-28 12:03:15.973 13780 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:03:15 ctl02 nova-api[13780]: 2017-09-28 12:03:15.973 13780 ERROR nova
Sep 28 12:03:16 ctl02 dhclient[600]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 12:03:16 ctl02 glance-api[29183]: 2017-09-28 12:03:16.076 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:03:16] "OPTIONS / HTTP/1.0" 200 134 0.000635
Sep 28 12:03:16 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 12:03:16 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:03:16 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:03:16 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:03:16 ctl02 ntp[13847]:  * Stopping NTP server ntpd
Sep 28 12:03:16 ctl02 ntp[13847]:    ...done.
Sep 28 12:03:16 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 12:03:16 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 12:03:16 ctl02 ntp[13859]:  * Starting NTP server ntpd
Sep 28 12:03:16 ctl02 ntpd[13866]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 12:03:16 ctl02 ntpd[13866]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -c /var/lib/ntp/ntp.conf.dhcp -u 108:112
Sep 28 12:03:16 ctl02 ntp[13859]:    ...done.
Sep 28 12:03:16 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 12:03:16 ctl02 ntpd[13869]: proto: precision = 0.042 usec (-24)
Sep 28 12:03:16 ctl02 ntpd[13869]: switching logging to file /var/log/ntp.log
Sep 28 12:03:16 ctl02 dhclient[600]: bound to 192.168.11.25 -- renewal in 236 seconds.
Sep 28 12:03:16 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:03:16 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:03:16 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:03:16 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:03:16 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xabc0b75d)
Sep 28 12:03:17 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xabc0b75d)
Sep 28 12:03:18 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:03:18.030 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:03:18] "OPTIONS / HTTP/1.0" 200 134 0.000535
Sep 28 12:03:18 ctl02 nova-api[13881]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:03:18 ctl02 nova-api[13881]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:03:18 ctl02 nova-api[13881]: 2017-09-28 12:03:18.248 13881 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:03:18 ctl02 nova-api[13881]: 2017-09-28 12:03:18.250 13881 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:03:18 ctl02 nova-api[13881]: 2017-09-28 12:03:18.250 13881 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:03:18 ctl02 nova-api[13881]: 2017-09-28 12:03:18.250 13881 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:03:18 ctl02 nova-api[13881]: 2017-09-28 12:03:18.250 13881 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:03:18 ctl02 nova-api[13881]: 2017-09-28 12:03:18.250 13881 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:03:18 ctl02 nova-api[13881]: 2017-09-28 12:03:18.250 13881 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:03:18 ctl02 nova-api[13881]: 2017-09-28 12:03:18.250 13881 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:03:18 ctl02 nova-api[13881]: 2017-09-28 12:03:18.250 13881 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:03:18 ctl02 nova-api[13881]: 2017-09-28 12:03:18.250 13881 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:03:18 ctl02 nova-api[13881]: 2017-09-28 12:03:18.250 13881 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:03:18 ctl02 nova-api[13881]: 2017-09-28 12:03:18.250 13881 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:03:18 ctl02 nova-api[13881]: 2017-09-28 12:03:18.250 13881 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:03:18 ctl02 nova-api[13881]: 2017-09-28 12:03:18.250 13881 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:03:18 ctl02 nova-api[13881]: 2017-09-28 12:03:18.250 13881 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:03:18 ctl02 nova-api[13881]: 2017-09-28 12:03:18.250 13881 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:03:18 ctl02 nova-api[13881]: 2017-09-28 12:03:18.250 13881 ERROR nova.wsgi     self.filename))
Sep 28 12:03:18 ctl02 nova-api[13881]: 2017-09-28 12:03:18.250 13881 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:03:18 ctl02 nova-api[13881]: 2017-09-28 12:03:18.250 13881 ERROR nova.wsgi
Sep 28 12:03:18 ctl02 nova-api[13881]: 2017-09-28 12:03:18.251 13881 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:03:18 ctl02 nova-conductor[5056]: 2017-09-28 12:03:18.275 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:03:18 ctl02 nova-conductor[5056]: 2017-09-28 12:03:18.300 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:03:18 ctl02 nova-conductor[5056]: 2017-09-28 12:03:18.312 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:03:18 ctl02 nova-conductor[5056]: 2017-09-28 12:03:18.314 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:03:18 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:03:18.360 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:03:18] "OPTIONS / HTTP/1.0" 200 134 0.000439
Sep 28 12:03:18 ctl02 nova-api[13881]: 2017-09-28 12:03:18.399 13881 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:03:18 ctl02 nova-api[13881]: 2017-09-28 12:03:18.638 13881 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:03:18 ctl02 nova-api[13881]: 2017-09-28 12:03:18.641 13881 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:03:18 ctl02 nova-api[13881]: 2017-09-28 12:03:18.641 13881 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:03:18 ctl02 nova-api[13881]: 2017-09-28 12:03:18.641 13881 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:03:18 ctl02 nova-api[13881]: 2017-09-28 12:03:18.771 13881 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:03:18 ctl02 nova-api[13881]: 2017-09-28 12:03:18.773 13881 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:03:18 ctl02 nova-api[13881]: 2017-09-28 12:03:18.773 13881 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:03:18 ctl02 nova-api[13881]: 2017-09-28 12:03:18.774 13881 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:03:18 ctl02 nova-api[13881]: 2017-09-28 12:03:18.777 13881 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:03:18 ctl02 nova-api[13881]: 2017-09-28 12:03:18.778 13881 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:03:18 ctl02 nova-api[13881]: 2017-09-28 12:03:18.778 13881 ERROR nova Traceback (most recent call last):
Sep 28 12:03:18 ctl02 nova-api[13881]: 2017-09-28 12:03:18.778 13881 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:03:18 ctl02 nova-api[13881]: 2017-09-28 12:03:18.778 13881 ERROR nova     sys.exit(main())
Sep 28 12:03:18 ctl02 nova-api[13881]: 2017-09-28 12:03:18.778 13881 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:03:18 ctl02 nova-api[13881]: 2017-09-28 12:03:18.778 13881 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:03:18 ctl02 nova-api[13881]: 2017-09-28 12:03:18.778 13881 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:03:18 ctl02 nova-api[13881]: 2017-09-28 12:03:18.778 13881 ERROR nova     max_url_len=max_url_len)
Sep 28 12:03:18 ctl02 nova-api[13881]: 2017-09-28 12:03:18.778 13881 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:03:18 ctl02 nova-api[13881]: 2017-09-28 12:03:18.778 13881 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:03:18 ctl02 nova-api[13881]: 2017-09-28 12:03:18.778 13881 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:03:18 ctl02 nova-api[13881]: 2017-09-28 12:03:18.778 13881 ERROR nova     sock.listen(backlog)
Sep 28 12:03:18 ctl02 nova-api[13881]: 2017-09-28 12:03:18.778 13881 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:03:18 ctl02 nova-api[13881]: 2017-09-28 12:03:18.778 13881 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:03:18 ctl02 nova-api[13881]: 2017-09-28 12:03:18.778 13881 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:03:18 ctl02 nova-api[13881]: 2017-09-28 12:03:18.778 13881 ERROR nova
Sep 28 12:03:18 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:03:18.850 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:03:18] "OPTIONS / HTTP/1.0" 200 134 0.000388
Sep 28 12:03:18 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:03:18 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:03:18 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:03:18 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:03:18 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:03:19 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 12:03:19 ctl02 ntp[13939]:  * Stopping NTP server ntpd
Sep 28 12:03:19 ctl02 ntp[13939]:    ...done.
Sep 28 12:03:19 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 12:03:19 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 12:03:19 ctl02 ntp[13950]:  * Starting NTP server ntpd
Sep 28 12:03:19 ctl02 ntpd[13957]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 12:03:19 ctl02 ntpd[13957]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 12:03:19 ctl02 ntp[13950]:    ...done.
Sep 28 12:03:19 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 12:03:19 ctl02 ntpd[13960]: proto: precision = 0.042 usec (-24)
Sep 28 12:03:19 ctl02 ntpd[13960]: switching logging to file /var/log/ntp.log
Sep 28 12:03:19 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:03:19 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:03:19 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:03:19 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:03:19 ctl02 glance-api[29183]: 2017-09-28 12:03:19.250 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:03:19] "OPTIONS / HTTP/1.0" 200 134 0.001206
Sep 28 12:03:19 ctl02 heat-api-cfn[13300]: 2017-09-28 12:03:19.336 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:03:19] "OPTIONS / HTTP/1.0" 200 134 0.000515
Sep 28 12:03:19 ctl02 heat-api-cfn[13300]: 2017-09-28 12:03:19.955 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:03:19] "OPTIONS / HTTP/1.0" 200 134 0.000505
Sep 28 12:03:20 ctl02 heat-api-cfn[13300]: 2017-09-28 12:03:20.422 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:03:20] "OPTIONS / HTTP/1.0" 200 134 0.000528
Sep 28 12:03:20 ctl02 nova-api[13970]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:03:20 ctl02 nova-api[13970]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:03:20 ctl02 nova-api[13970]: 2017-09-28 12:03:20.935 13970 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:03:20 ctl02 nova-api[13970]: 2017-09-28 12:03:20.936 13970 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:03:20 ctl02 nova-api[13970]: 2017-09-28 12:03:20.936 13970 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:03:20 ctl02 nova-api[13970]: 2017-09-28 12:03:20.936 13970 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:03:20 ctl02 nova-api[13970]: 2017-09-28 12:03:20.936 13970 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:03:20 ctl02 nova-api[13970]: 2017-09-28 12:03:20.936 13970 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:03:20 ctl02 nova-api[13970]: 2017-09-28 12:03:20.936 13970 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:03:20 ctl02 nova-api[13970]: 2017-09-28 12:03:20.936 13970 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:03:20 ctl02 nova-api[13970]: 2017-09-28 12:03:20.936 13970 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:03:20 ctl02 nova-api[13970]: 2017-09-28 12:03:20.936 13970 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:03:20 ctl02 nova-api[13970]: 2017-09-28 12:03:20.936 13970 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:03:20 ctl02 nova-api[13970]: 2017-09-28 12:03:20.936 13970 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:03:20 ctl02 nova-api[13970]: 2017-09-28 12:03:20.936 13970 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:03:20 ctl02 nova-api[13970]: 2017-09-28 12:03:20.936 13970 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:03:20 ctl02 nova-api[13970]: 2017-09-28 12:03:20.936 13970 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:03:20 ctl02 nova-api[13970]: 2017-09-28 12:03:20.936 13970 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:03:20 ctl02 nova-api[13970]: 2017-09-28 12:03:20.936 13970 ERROR nova.wsgi     self.filename))
Sep 28 12:03:20 ctl02 nova-api[13970]: 2017-09-28 12:03:20.936 13970 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:03:20 ctl02 nova-api[13970]: 2017-09-28 12:03:20.936 13970 ERROR nova.wsgi
Sep 28 12:03:20 ctl02 nova-api[13970]: 2017-09-28 12:03:20.937 13970 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:03:21 ctl02 nova-api[13970]: 2017-09-28 12:03:21.062 13970 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:03:21 ctl02 nova-api[13970]: 2017-09-28 12:03:21.294 13970 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:03:21 ctl02 nova-api[13970]: 2017-09-28 12:03:21.296 13970 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:03:21 ctl02 nova-api[13970]: 2017-09-28 12:03:21.322 13970 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:03:21 ctl02 nova-api[13970]: 2017-09-28 12:03:21.322 13970 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:03:21 ctl02 nova-api[13970]: 2017-09-28 12:03:21.451 13970 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:03:21 ctl02 nova-api[13970]: 2017-09-28 12:03:21.453 13970 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:03:21 ctl02 nova-api[13970]: 2017-09-28 12:03:21.453 13970 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:03:21 ctl02 nova-api[13970]: 2017-09-28 12:03:21.454 13970 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:03:21 ctl02 nova-api[13970]: 2017-09-28 12:03:21.457 13970 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:03:21 ctl02 nova-api[13970]: 2017-09-28 12:03:21.457 13970 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:03:21 ctl02 nova-api[13970]: 2017-09-28 12:03:21.457 13970 ERROR nova Traceback (most recent call last):
Sep 28 12:03:21 ctl02 nova-api[13970]: 2017-09-28 12:03:21.457 13970 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:03:21 ctl02 nova-api[13970]: 2017-09-28 12:03:21.457 13970 ERROR nova     sys.exit(main())
Sep 28 12:03:21 ctl02 nova-api[13970]: 2017-09-28 12:03:21.457 13970 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:03:21 ctl02 nova-api[13970]: 2017-09-28 12:03:21.457 13970 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:03:21 ctl02 nova-api[13970]: 2017-09-28 12:03:21.457 13970 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:03:21 ctl02 nova-api[13970]: 2017-09-28 12:03:21.457 13970 ERROR nova     max_url_len=max_url_len)
Sep 28 12:03:21 ctl02 nova-api[13970]: 2017-09-28 12:03:21.457 13970 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:03:21 ctl02 nova-api[13970]: 2017-09-28 12:03:21.457 13970 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:03:21 ctl02 nova-api[13970]: 2017-09-28 12:03:21.457 13970 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:03:21 ctl02 nova-api[13970]: 2017-09-28 12:03:21.457 13970 ERROR nova     sock.listen(backlog)
Sep 28 12:03:21 ctl02 nova-api[13970]: 2017-09-28 12:03:21.457 13970 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:03:21 ctl02 nova-api[13970]: 2017-09-28 12:03:21.457 13970 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:03:21 ctl02 nova-api[13970]: 2017-09-28 12:03:21.457 13970 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:03:21 ctl02 nova-api[13970]: 2017-09-28 12:03:21.457 13970 ERROR nova
Sep 28 12:03:21 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:03:21 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:03:21 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:03:21 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:03:21 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:03:21 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:03:21 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:03:23 ctl02 nova-api[13988]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:03:23 ctl02 nova-api[13988]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:03:23 ctl02 nova-api[13988]: 2017-09-28 12:03:23.697 13988 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:03:23 ctl02 nova-api[13988]: 2017-09-28 12:03:23.699 13988 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:03:23 ctl02 nova-api[13988]: 2017-09-28 12:03:23.699 13988 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:03:23 ctl02 nova-api[13988]: 2017-09-28 12:03:23.699 13988 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:03:23 ctl02 nova-api[13988]: 2017-09-28 12:03:23.699 13988 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:03:23 ctl02 nova-api[13988]: 2017-09-28 12:03:23.699 13988 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:03:23 ctl02 nova-api[13988]: 2017-09-28 12:03:23.699 13988 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:03:23 ctl02 nova-api[13988]: 2017-09-28 12:03:23.699 13988 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:03:23 ctl02 nova-api[13988]: 2017-09-28 12:03:23.699 13988 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:03:23 ctl02 nova-api[13988]: 2017-09-28 12:03:23.699 13988 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:03:23 ctl02 nova-api[13988]: 2017-09-28 12:03:23.699 13988 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:03:23 ctl02 nova-api[13988]: 2017-09-28 12:03:23.699 13988 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:03:23 ctl02 nova-api[13988]: 2017-09-28 12:03:23.699 13988 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:03:23 ctl02 nova-api[13988]: 2017-09-28 12:03:23.699 13988 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:03:23 ctl02 nova-api[13988]: 2017-09-28 12:03:23.699 13988 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:03:23 ctl02 nova-api[13988]: 2017-09-28 12:03:23.699 13988 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:03:23 ctl02 nova-api[13988]: 2017-09-28 12:03:23.699 13988 ERROR nova.wsgi     self.filename))
Sep 28 12:03:23 ctl02 nova-api[13988]: 2017-09-28 12:03:23.699 13988 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:03:23 ctl02 nova-api[13988]: 2017-09-28 12:03:23.699 13988 ERROR nova.wsgi
Sep 28 12:03:23 ctl02 nova-api[13988]: 2017-09-28 12:03:23.701 13988 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:03:23 ctl02 glance-api[29183]: 2017-09-28 12:03:23.826 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:03:23] "OPTIONS / HTTP/1.0" 200 134 0.000791
Sep 28 12:03:23 ctl02 nova-api[13988]: 2017-09-28 12:03:23.833 13988 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:03:24 ctl02 nova-api[13988]: 2017-09-28 12:03:24.075 13988 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:03:24 ctl02 nova-api[13988]: 2017-09-28 12:03:24.078 13988 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:03:24 ctl02 nova-api[13988]: 2017-09-28 12:03:24.079 13988 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:03:24 ctl02 nova-api[13988]: 2017-09-28 12:03:24.079 13988 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:03:24 ctl02 nova-api[13988]: 2017-09-28 12:03:24.213 13988 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:03:24 ctl02 nova-api[13988]: 2017-09-28 12:03:24.216 13988 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:03:24 ctl02 nova-api[13988]: 2017-09-28 12:03:24.216 13988 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:03:24 ctl02 nova-api[13988]: 2017-09-28 12:03:24.216 13988 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:03:24 ctl02 nova-api[13988]: 2017-09-28 12:03:24.220 13988 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:03:24 ctl02 nova-api[13988]: 2017-09-28 12:03:24.221 13988 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:03:24 ctl02 nova-api[13988]: 2017-09-28 12:03:24.221 13988 ERROR nova Traceback (most recent call last):
Sep 28 12:03:24 ctl02 nova-api[13988]: 2017-09-28 12:03:24.221 13988 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:03:24 ctl02 nova-api[13988]: 2017-09-28 12:03:24.221 13988 ERROR nova     sys.exit(main())
Sep 28 12:03:24 ctl02 nova-api[13988]: 2017-09-28 12:03:24.221 13988 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:03:24 ctl02 nova-api[13988]: 2017-09-28 12:03:24.221 13988 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:03:24 ctl02 nova-api[13988]: 2017-09-28 12:03:24.221 13988 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:03:24 ctl02 nova-api[13988]: 2017-09-28 12:03:24.221 13988 ERROR nova     max_url_len=max_url_len)
Sep 28 12:03:24 ctl02 nova-api[13988]: 2017-09-28 12:03:24.221 13988 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:03:24 ctl02 nova-api[13988]: 2017-09-28 12:03:24.221 13988 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:03:24 ctl02 nova-api[13988]: 2017-09-28 12:03:24.221 13988 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:03:24 ctl02 nova-api[13988]: 2017-09-28 12:03:24.221 13988 ERROR nova     sock.listen(backlog)
Sep 28 12:03:24 ctl02 nova-api[13988]: 2017-09-28 12:03:24.221 13988 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:03:24 ctl02 nova-api[13988]: 2017-09-28 12:03:24.221 13988 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:03:24 ctl02 nova-api[13988]: 2017-09-28 12:03:24.221 13988 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:03:24 ctl02 nova-api[13988]: 2017-09-28 12:03:24.221 13988 ERROR nova
Sep 28 12:03:24 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:03:24 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:03:24 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:03:24 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:03:24 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:03:24 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:03:24 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:03:24 ctl02 heat-api[13008]: 2017-09-28 12:03:24.799 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:03:24] "OPTIONS / HTTP/1.0" 200 134 0.000604
Sep 28 12:03:25 ctl02 heat-api[13008]: 2017-09-28 12:03:25.346 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:03:25] "OPTIONS / HTTP/1.0" 200 134 0.000596
Sep 28 12:03:25 ctl02 heat-api[13008]: 2017-09-28 12:03:25.638 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:03:25] "OPTIONS / HTTP/1.0" 200 134 0.000381
Sep 28 12:03:25 ctl02 nova-consoleauth[5433]: 2017-09-28 12:03:25.764 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:03:25 ctl02 glance-api[29183]: 2017-09-28 12:03:25.773 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:03:25] "OPTIONS / HTTP/1.0" 200 134 0.000716
Sep 28 12:03:26 ctl02 nova-api[14005]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:03:26 ctl02 nova-api[14005]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:03:26 ctl02 nova-api[14005]: 2017-09-28 12:03:26.456 14005 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:03:26 ctl02 nova-api[14005]: 2017-09-28 12:03:26.458 14005 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:03:26 ctl02 nova-api[14005]: 2017-09-28 12:03:26.458 14005 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:03:26 ctl02 nova-api[14005]: 2017-09-28 12:03:26.458 14005 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:03:26 ctl02 nova-api[14005]: 2017-09-28 12:03:26.458 14005 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:03:26 ctl02 nova-api[14005]: 2017-09-28 12:03:26.458 14005 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:03:26 ctl02 nova-api[14005]: 2017-09-28 12:03:26.458 14005 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:03:26 ctl02 nova-api[14005]: 2017-09-28 12:03:26.458 14005 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:03:26 ctl02 nova-api[14005]: 2017-09-28 12:03:26.458 14005 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:03:26 ctl02 nova-api[14005]: 2017-09-28 12:03:26.458 14005 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:03:26 ctl02 nova-api[14005]: 2017-09-28 12:03:26.458 14005 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:03:26 ctl02 nova-api[14005]: 2017-09-28 12:03:26.458 14005 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:03:26 ctl02 nova-api[14005]: 2017-09-28 12:03:26.458 14005 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:03:26 ctl02 nova-api[14005]: 2017-09-28 12:03:26.458 14005 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:03:26 ctl02 nova-api[14005]: 2017-09-28 12:03:26.458 14005 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:03:26 ctl02 nova-api[14005]: 2017-09-28 12:03:26.458 14005 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:03:26 ctl02 nova-api[14005]: 2017-09-28 12:03:26.458 14005 ERROR nova.wsgi     self.filename))
Sep 28 12:03:26 ctl02 nova-api[14005]: 2017-09-28 12:03:26.458 14005 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:03:26 ctl02 nova-api[14005]: 2017-09-28 12:03:26.458 14005 ERROR nova.wsgi
Sep 28 12:03:26 ctl02 nova-api[14005]: 2017-09-28 12:03:26.459 14005 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:03:26 ctl02 nova-api[14005]: 2017-09-28 12:03:26.587 14005 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:03:26 ctl02 nova-api[14005]: 2017-09-28 12:03:26.820 14005 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:03:26 ctl02 nova-api[14005]: 2017-09-28 12:03:26.822 14005 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:03:26 ctl02 nova-api[14005]: 2017-09-28 12:03:26.822 14005 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:03:26 ctl02 nova-api[14005]: 2017-09-28 12:03:26.823 14005 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:03:26 ctl02 nova-api[14005]: 2017-09-28 12:03:26.954 14005 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:03:26 ctl02 nova-api[14005]: 2017-09-28 12:03:26.956 14005 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:03:26 ctl02 nova-api[14005]: 2017-09-28 12:03:26.956 14005 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:03:26 ctl02 nova-api[14005]: 2017-09-28 12:03:26.956 14005 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:03:26 ctl02 nova-api[14005]: 2017-09-28 12:03:26.959 14005 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:03:26 ctl02 nova-api[14005]: 2017-09-28 12:03:26.960 14005 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:03:26 ctl02 nova-api[14005]: 2017-09-28 12:03:26.960 14005 ERROR nova Traceback (most recent call last):
Sep 28 12:03:26 ctl02 nova-api[14005]: 2017-09-28 12:03:26.960 14005 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:03:26 ctl02 nova-api[14005]: 2017-09-28 12:03:26.960 14005 ERROR nova     sys.exit(main())
Sep 28 12:03:26 ctl02 nova-api[14005]: 2017-09-28 12:03:26.960 14005 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:03:26 ctl02 nova-api[14005]: 2017-09-28 12:03:26.960 14005 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:03:26 ctl02 nova-api[14005]: 2017-09-28 12:03:26.960 14005 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:03:26 ctl02 nova-api[14005]: 2017-09-28 12:03:26.960 14005 ERROR nova     max_url_len=max_url_len)
Sep 28 12:03:26 ctl02 nova-api[14005]: 2017-09-28 12:03:26.960 14005 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:03:26 ctl02 nova-api[14005]: 2017-09-28 12:03:26.960 14005 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:03:26 ctl02 nova-api[14005]: 2017-09-28 12:03:26.960 14005 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:03:26 ctl02 nova-api[14005]: 2017-09-28 12:03:26.960 14005 ERROR nova     sock.listen(backlog)
Sep 28 12:03:26 ctl02 nova-api[14005]: 2017-09-28 12:03:26.960 14005 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:03:26 ctl02 nova-api[14005]: 2017-09-28 12:03:26.960 14005 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:03:26 ctl02 nova-api[14005]: 2017-09-28 12:03:26.960 14005 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:03:26 ctl02 nova-api[14005]: 2017-09-28 12:03:26.960 14005 ERROR nova
Sep 28 12:03:27 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:03:27 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:03:27 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:03:27 ctl02 heat-engine[12803]: 2017-09-28 12:03:27.337 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 22 seconds.
Sep 28 12:03:27 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:03:27 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:03:27 ctl02 heat-engine[12803]: 2017-09-28 12:03:27.376 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 22 seconds.
Sep 28 12:03:27 ctl02 heat-engine[12803]: 2017-09-28 12:03:27.391 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 22 seconds.
Sep 28 12:03:27 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:03:27 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:03:27 ctl02 heat-engine[12803]: 2017-09-28 12:03:27.397 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 22 seconds.
Sep 28 12:03:28 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:03:28.319 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:03:28] "OPTIONS / HTTP/1.0" 200 134 0.000542
Sep 28 12:03:28 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:03:28.586 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:03:28] "OPTIONS / HTTP/1.0" 200 134 0.000279
Sep 28 12:03:28 ctl02 nova-scheduler[5620]: 2017-09-28 12:03:28.784 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:03:29 ctl02 nova-api[14024]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:03:29 ctl02 nova-api[14024]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:03:29 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:03:29.183 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:03:29] "OPTIONS / HTTP/1.0" 200 134 0.000504
Sep 28 12:03:29 ctl02 heat-api-cfn[13300]: 2017-09-28 12:03:29.192 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:03:29] "OPTIONS / HTTP/1.0" 200 134 0.000559
Sep 28 12:03:29 ctl02 nova-api[14024]: 2017-09-28 12:03:29.198 14024 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:03:29 ctl02 nova-api[14024]: 2017-09-28 12:03:29.200 14024 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:03:29 ctl02 nova-api[14024]: 2017-09-28 12:03:29.200 14024 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:03:29 ctl02 nova-api[14024]: 2017-09-28 12:03:29.200 14024 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:03:29 ctl02 nova-api[14024]: 2017-09-28 12:03:29.200 14024 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:03:29 ctl02 nova-api[14024]: 2017-09-28 12:03:29.200 14024 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:03:29 ctl02 nova-api[14024]: 2017-09-28 12:03:29.200 14024 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:03:29 ctl02 nova-api[14024]: 2017-09-28 12:03:29.200 14024 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:03:29 ctl02 nova-api[14024]: 2017-09-28 12:03:29.200 14024 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:03:29 ctl02 nova-api[14024]: 2017-09-28 12:03:29.200 14024 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:03:29 ctl02 nova-api[14024]: 2017-09-28 12:03:29.200 14024 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:03:29 ctl02 nova-api[14024]: 2017-09-28 12:03:29.200 14024 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:03:29 ctl02 nova-api[14024]: 2017-09-28 12:03:29.200 14024 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:03:29 ctl02 nova-api[14024]: 2017-09-28 12:03:29.200 14024 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:03:29 ctl02 nova-api[14024]: 2017-09-28 12:03:29.200 14024 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:03:29 ctl02 nova-api[14024]: 2017-09-28 12:03:29.200 14024 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:03:29 ctl02 nova-api[14024]: 2017-09-28 12:03:29.200 14024 ERROR nova.wsgi     self.filename))
Sep 28 12:03:29 ctl02 nova-api[14024]: 2017-09-28 12:03:29.200 14024 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:03:29 ctl02 nova-api[14024]: 2017-09-28 12:03:29.200 14024 ERROR nova.wsgi
Sep 28 12:03:29 ctl02 nova-api[14024]: 2017-09-28 12:03:29.201 14024 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:03:29 ctl02 nova-api[14024]: 2017-09-28 12:03:29.332 14024 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:03:29 ctl02 glance-api[29183]: 2017-09-28 12:03:29.523 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:03:29] "OPTIONS / HTTP/1.0" 200 134 0.000682
Sep 28 12:03:29 ctl02 nova-api[14024]: 2017-09-28 12:03:29.566 14024 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:03:29 ctl02 nova-api[14024]: 2017-09-28 12:03:29.568 14024 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:03:29 ctl02 nova-api[14024]: 2017-09-28 12:03:29.568 14024 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:03:29 ctl02 nova-api[14024]: 2017-09-28 12:03:29.569 14024 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:03:29 ctl02 nova-api[14024]: 2017-09-28 12:03:29.701 14024 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:03:29 ctl02 nova-api[14024]: 2017-09-28 12:03:29.702 14024 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:03:29 ctl02 nova-api[14024]: 2017-09-28 12:03:29.703 14024 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:03:29 ctl02 nova-api[14024]: 2017-09-28 12:03:29.703 14024 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:03:29 ctl02 nova-api[14024]: 2017-09-28 12:03:29.706 14024 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:03:29 ctl02 nova-api[14024]: 2017-09-28 12:03:29.706 14024 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:03:29 ctl02 nova-api[14024]: 2017-09-28 12:03:29.706 14024 ERROR nova Traceback (most recent call last):
Sep 28 12:03:29 ctl02 nova-api[14024]: 2017-09-28 12:03:29.706 14024 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:03:29 ctl02 nova-api[14024]: 2017-09-28 12:03:29.706 14024 ERROR nova     sys.exit(main())
Sep 28 12:03:29 ctl02 nova-api[14024]: 2017-09-28 12:03:29.706 14024 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:03:29 ctl02 nova-api[14024]: 2017-09-28 12:03:29.706 14024 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:03:29 ctl02 nova-api[14024]: 2017-09-28 12:03:29.706 14024 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:03:29 ctl02 nova-api[14024]: 2017-09-28 12:03:29.706 14024 ERROR nova     max_url_len=max_url_len)
Sep 28 12:03:29 ctl02 nova-api[14024]: 2017-09-28 12:03:29.706 14024 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:03:29 ctl02 nova-api[14024]: 2017-09-28 12:03:29.706 14024 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:03:29 ctl02 nova-api[14024]: 2017-09-28 12:03:29.706 14024 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:03:29 ctl02 nova-api[14024]: 2017-09-28 12:03:29.706 14024 ERROR nova     sock.listen(backlog)
Sep 28 12:03:29 ctl02 nova-api[14024]: 2017-09-28 12:03:29.706 14024 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:03:29 ctl02 nova-api[14024]: 2017-09-28 12:03:29.706 14024 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:03:29 ctl02 nova-api[14024]: 2017-09-28 12:03:29.706 14024 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:03:29 ctl02 nova-api[14024]: 2017-09-28 12:03:29.706 14024 ERROR nova
Sep 28 12:03:29 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:03:29 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:03:29 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:03:30 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:03:30 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:03:30 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:03:30 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:03:30 ctl02 heat-api-cfn[13300]: 2017-09-28 12:03:30.215 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:03:30] "OPTIONS / HTTP/1.0" 200 134 0.000607
Sep 28 12:03:30 ctl02 heat-api-cfn[13300]: 2017-09-28 12:03:30.347 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:03:30] "OPTIONS / HTTP/1.0" 200 134 0.000603
Sep 28 12:03:30 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfe33486b)
Sep 28 12:03:31 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfe33486b)
Sep 28 12:03:31 ctl02 nova-api[14042]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:03:31 ctl02 nova-api[14042]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:03:31 ctl02 nova-api[14042]: 2017-09-28 12:03:31.949 14042 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:03:31 ctl02 nova-api[14042]: 2017-09-28 12:03:31.951 14042 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:03:31 ctl02 nova-api[14042]: 2017-09-28 12:03:31.951 14042 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:03:31 ctl02 nova-api[14042]: 2017-09-28 12:03:31.951 14042 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:03:31 ctl02 nova-api[14042]: 2017-09-28 12:03:31.951 14042 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:03:31 ctl02 nova-api[14042]: 2017-09-28 12:03:31.951 14042 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:03:31 ctl02 nova-api[14042]: 2017-09-28 12:03:31.951 14042 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:03:31 ctl02 nova-api[14042]: 2017-09-28 12:03:31.951 14042 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:03:31 ctl02 nova-api[14042]: 2017-09-28 12:03:31.951 14042 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:03:31 ctl02 nova-api[14042]: 2017-09-28 12:03:31.951 14042 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:03:31 ctl02 nova-api[14042]: 2017-09-28 12:03:31.951 14042 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:03:31 ctl02 nova-api[14042]: 2017-09-28 12:03:31.951 14042 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:03:31 ctl02 nova-api[14042]: 2017-09-28 12:03:31.951 14042 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:03:31 ctl02 nova-api[14042]: 2017-09-28 12:03:31.951 14042 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:03:31 ctl02 nova-api[14042]: 2017-09-28 12:03:31.951 14042 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:03:31 ctl02 nova-api[14042]: 2017-09-28 12:03:31.951 14042 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:03:31 ctl02 nova-api[14042]: 2017-09-28 12:03:31.951 14042 ERROR nova.wsgi     self.filename))
Sep 28 12:03:31 ctl02 nova-api[14042]: 2017-09-28 12:03:31.951 14042 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:03:31 ctl02 nova-api[14042]: 2017-09-28 12:03:31.951 14042 ERROR nova.wsgi
Sep 28 12:03:31 ctl02 nova-api[14042]: 2017-09-28 12:03:31.952 14042 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:03:32 ctl02 nova-api[14042]: 2017-09-28 12:03:32.079 14042 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:03:32 ctl02 nova-api[14042]: 2017-09-28 12:03:32.316 14042 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:03:32 ctl02 nova-api[14042]: 2017-09-28 12:03:32.319 14042 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:03:32 ctl02 nova-api[14042]: 2017-09-28 12:03:32.319 14042 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:03:32 ctl02 nova-api[14042]: 2017-09-28 12:03:32.319 14042 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:03:32 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfe33486b)
Sep 28 12:03:32 ctl02 nova-api[14042]: 2017-09-28 12:03:32.451 14042 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:03:32 ctl02 nova-api[14042]: 2017-09-28 12:03:32.453 14042 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:03:32 ctl02 nova-api[14042]: 2017-09-28 12:03:32.454 14042 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:03:32 ctl02 nova-api[14042]: 2017-09-28 12:03:32.454 14042 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:03:32 ctl02 nova-api[14042]: 2017-09-28 12:03:32.458 14042 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:03:32 ctl02 nova-api[14042]: 2017-09-28 12:03:32.458 14042 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:03:32 ctl02 nova-api[14042]: 2017-09-28 12:03:32.458 14042 ERROR nova Traceback (most recent call last):
Sep 28 12:03:32 ctl02 nova-api[14042]: 2017-09-28 12:03:32.458 14042 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:03:32 ctl02 nova-api[14042]: 2017-09-28 12:03:32.458 14042 ERROR nova     sys.exit(main())
Sep 28 12:03:32 ctl02 nova-api[14042]: 2017-09-28 12:03:32.458 14042 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:03:32 ctl02 nova-api[14042]: 2017-09-28 12:03:32.458 14042 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:03:32 ctl02 nova-api[14042]: 2017-09-28 12:03:32.458 14042 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:03:32 ctl02 nova-api[14042]: 2017-09-28 12:03:32.458 14042 ERROR nova     max_url_len=max_url_len)
Sep 28 12:03:32 ctl02 nova-api[14042]: 2017-09-28 12:03:32.458 14042 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:03:32 ctl02 nova-api[14042]: 2017-09-28 12:03:32.458 14042 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:03:32 ctl02 nova-api[14042]: 2017-09-28 12:03:32.458 14042 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:03:32 ctl02 nova-api[14042]: 2017-09-28 12:03:32.458 14042 ERROR nova     sock.listen(backlog)
Sep 28 12:03:32 ctl02 nova-api[14042]: 2017-09-28 12:03:32.458 14042 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:03:32 ctl02 nova-api[14042]: 2017-09-28 12:03:32.458 14042 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:03:32 ctl02 nova-api[14042]: 2017-09-28 12:03:32.458 14042 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:03:32 ctl02 nova-api[14042]: 2017-09-28 12:03:32.458 14042 ERROR nova
Sep 28 12:03:32 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:03:32 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:03:32 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:03:32 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:03:32 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:03:32 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:03:32 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:03:33 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfe33486b)
Sep 28 12:03:34 ctl02 glance-api[29183]: 2017-09-28 12:03:33.999 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:03:33] "OPTIONS / HTTP/1.0" 200 134 0.000570
Sep 28 12:03:34 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfe33486b)
Sep 28 12:03:34 ctl02 nova-api[14060]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:03:34 ctl02 nova-api[14060]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:03:34 ctl02 heat-api[13008]: 2017-09-28 12:03:34.528 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:03:34] "OPTIONS / HTTP/1.0" 200 134 0.000644
Sep 28 12:03:34 ctl02 nova-api[14060]: 2017-09-28 12:03:34.691 14060 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:03:34 ctl02 nova-api[14060]: 2017-09-28 12:03:34.693 14060 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:03:34 ctl02 nova-api[14060]: 2017-09-28 12:03:34.693 14060 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:03:34 ctl02 nova-api[14060]: 2017-09-28 12:03:34.693 14060 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:03:34 ctl02 nova-api[14060]: 2017-09-28 12:03:34.693 14060 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:03:34 ctl02 nova-api[14060]: 2017-09-28 12:03:34.693 14060 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:03:34 ctl02 nova-api[14060]: 2017-09-28 12:03:34.693 14060 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:03:34 ctl02 nova-api[14060]: 2017-09-28 12:03:34.693 14060 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:03:34 ctl02 nova-api[14060]: 2017-09-28 12:03:34.693 14060 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:03:34 ctl02 nova-api[14060]: 2017-09-28 12:03:34.693 14060 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:03:34 ctl02 nova-api[14060]: 2017-09-28 12:03:34.693 14060 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:03:34 ctl02 nova-api[14060]: 2017-09-28 12:03:34.693 14060 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:03:34 ctl02 nova-api[14060]: 2017-09-28 12:03:34.693 14060 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:03:34 ctl02 nova-api[14060]: 2017-09-28 12:03:34.693 14060 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:03:34 ctl02 nova-api[14060]: 2017-09-28 12:03:34.693 14060 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:03:34 ctl02 nova-api[14060]: 2017-09-28 12:03:34.693 14060 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:03:34 ctl02 nova-api[14060]: 2017-09-28 12:03:34.693 14060 ERROR nova.wsgi     self.filename))
Sep 28 12:03:34 ctl02 nova-api[14060]: 2017-09-28 12:03:34.693 14060 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:03:34 ctl02 nova-api[14060]: 2017-09-28 12:03:34.693 14060 ERROR nova.wsgi
Sep 28 12:03:34 ctl02 nova-api[14060]: 2017-09-28 12:03:34.694 14060 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:03:34 ctl02 nova-api[14060]: 2017-09-28 12:03:34.823 14060 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:03:35 ctl02 nova-api[14060]: 2017-09-28 12:03:35.060 14060 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:03:35 ctl02 nova-api[14060]: 2017-09-28 12:03:35.062 14060 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:03:35 ctl02 nova-api[14060]: 2017-09-28 12:03:35.063 14060 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:03:35 ctl02 nova-api[14060]: 2017-09-28 12:03:35.063 14060 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:03:35 ctl02 nova-api[14060]: 2017-09-28 12:03:35.193 14060 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:03:35 ctl02 nova-api[14060]: 2017-09-28 12:03:35.195 14060 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:03:35 ctl02 nova-api[14060]: 2017-09-28 12:03:35.195 14060 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:03:35 ctl02 nova-api[14060]: 2017-09-28 12:03:35.196 14060 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:03:35 ctl02 nova-api[14060]: 2017-09-28 12:03:35.199 14060 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:03:35 ctl02 nova-api[14060]: 2017-09-28 12:03:35.199 14060 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:03:35 ctl02 nova-api[14060]: 2017-09-28 12:03:35.199 14060 ERROR nova Traceback (most recent call last):
Sep 28 12:03:35 ctl02 nova-api[14060]: 2017-09-28 12:03:35.199 14060 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:03:35 ctl02 nova-api[14060]: 2017-09-28 12:03:35.199 14060 ERROR nova     sys.exit(main())
Sep 28 12:03:35 ctl02 nova-api[14060]: 2017-09-28 12:03:35.199 14060 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:03:35 ctl02 nova-api[14060]: 2017-09-28 12:03:35.199 14060 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:03:35 ctl02 nova-api[14060]: 2017-09-28 12:03:35.199 14060 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:03:35 ctl02 nova-api[14060]: 2017-09-28 12:03:35.199 14060 ERROR nova     max_url_len=max_url_len)
Sep 28 12:03:35 ctl02 nova-api[14060]: 2017-09-28 12:03:35.199 14060 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:03:35 ctl02 nova-api[14060]: 2017-09-28 12:03:35.199 14060 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:03:35 ctl02 nova-api[14060]: 2017-09-28 12:03:35.199 14060 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:03:35 ctl02 nova-api[14060]: 2017-09-28 12:03:35.199 14060 ERROR nova     sock.listen(backlog)
Sep 28 12:03:35 ctl02 nova-api[14060]: 2017-09-28 12:03:35.199 14060 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:03:35 ctl02 nova-api[14060]: 2017-09-28 12:03:35.199 14060 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:03:35 ctl02 nova-api[14060]: 2017-09-28 12:03:35.199 14060 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:03:35 ctl02 nova-api[14060]: 2017-09-28 12:03:35.199 14060 ERROR nova
Sep 28 12:03:35 ctl02 heat-api[13008]: 2017-09-28 12:03:35.337 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:03:35] "OPTIONS / HTTP/1.0" 200 134 0.000624
Sep 28 12:03:35 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:03:35 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:03:35 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:03:35 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfe33486b)
Sep 28 12:03:35 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:03:35 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:03:35 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:03:35 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:03:35 ctl02 glance-api[29183]: 2017-09-28 12:03:35.659 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:03:35] "OPTIONS / HTTP/1.0" 200 134 0.001078
Sep 28 12:03:35 ctl02 heat-api[13008]: 2017-09-28 12:03:35.709 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:03:35] "OPTIONS / HTTP/1.0" 200 134 0.000683
Sep 28 12:03:36 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfe33486b)
Sep 28 12:03:37 ctl02 nova-api[14078]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:03:37 ctl02 nova-api[14078]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:03:37 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfe33486b)
Sep 28 12:03:37 ctl02 nova-api[14078]: 2017-09-28 12:03:37.518 14078 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:03:37 ctl02 nova-api[14078]: 2017-09-28 12:03:37.520 14078 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:03:37 ctl02 nova-api[14078]: 2017-09-28 12:03:37.520 14078 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:03:37 ctl02 nova-api[14078]: 2017-09-28 12:03:37.520 14078 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:03:37 ctl02 nova-api[14078]: 2017-09-28 12:03:37.520 14078 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:03:37 ctl02 nova-api[14078]: 2017-09-28 12:03:37.520 14078 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:03:37 ctl02 nova-api[14078]: 2017-09-28 12:03:37.520 14078 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:03:37 ctl02 nova-api[14078]: 2017-09-28 12:03:37.520 14078 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:03:37 ctl02 nova-api[14078]: 2017-09-28 12:03:37.520 14078 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:03:37 ctl02 nova-api[14078]: 2017-09-28 12:03:37.520 14078 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:03:37 ctl02 nova-api[14078]: 2017-09-28 12:03:37.520 14078 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:03:37 ctl02 nova-api[14078]: 2017-09-28 12:03:37.520 14078 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:03:37 ctl02 nova-api[14078]: 2017-09-28 12:03:37.520 14078 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:03:37 ctl02 nova-api[14078]: 2017-09-28 12:03:37.520 14078 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:03:37 ctl02 nova-api[14078]: 2017-09-28 12:03:37.520 14078 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:03:37 ctl02 nova-api[14078]: 2017-09-28 12:03:37.520 14078 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:03:37 ctl02 nova-api[14078]: 2017-09-28 12:03:37.520 14078 ERROR nova.wsgi     self.filename))
Sep 28 12:03:37 ctl02 nova-api[14078]: 2017-09-28 12:03:37.520 14078 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:03:37 ctl02 nova-api[14078]: 2017-09-28 12:03:37.520 14078 ERROR nova.wsgi
Sep 28 12:03:37 ctl02 nova-api[14078]: 2017-09-28 12:03:37.522 14078 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:03:37 ctl02 nova-api[14078]: 2017-09-28 12:03:37.654 14078 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:03:37 ctl02 nova-api[14078]: 2017-09-28 12:03:37.894 14078 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:03:37 ctl02 nova-api[14078]: 2017-09-28 12:03:37.897 14078 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:03:37 ctl02 nova-api[14078]: 2017-09-28 12:03:37.897 14078 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:03:37 ctl02 nova-api[14078]: 2017-09-28 12:03:37.897 14078 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:03:38 ctl02 nova-api[14078]: 2017-09-28 12:03:38.029 14078 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:03:38 ctl02 nova-api[14078]: 2017-09-28 12:03:38.031 14078 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:03:38 ctl02 nova-api[14078]: 2017-09-28 12:03:38.031 14078 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:03:38 ctl02 nova-api[14078]: 2017-09-28 12:03:38.031 14078 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:03:38 ctl02 nova-api[14078]: 2017-09-28 12:03:38.035 14078 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:03:38 ctl02 nova-api[14078]: 2017-09-28 12:03:38.035 14078 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:03:38 ctl02 nova-api[14078]: 2017-09-28 12:03:38.035 14078 ERROR nova Traceback (most recent call last):
Sep 28 12:03:38 ctl02 nova-api[14078]: 2017-09-28 12:03:38.035 14078 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:03:38 ctl02 nova-api[14078]: 2017-09-28 12:03:38.035 14078 ERROR nova     sys.exit(main())
Sep 28 12:03:38 ctl02 nova-api[14078]: 2017-09-28 12:03:38.035 14078 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:03:38 ctl02 nova-api[14078]: 2017-09-28 12:03:38.035 14078 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:03:38 ctl02 nova-api[14078]: 2017-09-28 12:03:38.035 14078 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:03:38 ctl02 nova-api[14078]: 2017-09-28 12:03:38.035 14078 ERROR nova     max_url_len=max_url_len)
Sep 28 12:03:38 ctl02 nova-api[14078]: 2017-09-28 12:03:38.035 14078 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:03:38 ctl02 nova-api[14078]: 2017-09-28 12:03:38.035 14078 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:03:38 ctl02 nova-api[14078]: 2017-09-28 12:03:38.035 14078 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:03:38 ctl02 nova-api[14078]: 2017-09-28 12:03:38.035 14078 ERROR nova     sock.listen(backlog)
Sep 28 12:03:38 ctl02 nova-api[14078]: 2017-09-28 12:03:38.035 14078 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:03:38 ctl02 nova-api[14078]: 2017-09-28 12:03:38.035 14078 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:03:38 ctl02 nova-api[14078]: 2017-09-28 12:03:38.035 14078 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:03:38 ctl02 nova-api[14078]: 2017-09-28 12:03:38.035 14078 ERROR nova
Sep 28 12:03:38 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:03:38.119 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:03:38] "OPTIONS / HTTP/1.0" 200 134 0.000447
Sep 28 12:03:38 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:03:38 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:03:38 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:03:38 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:03:38 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:03:38 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:03:38 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:03:38 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfe33486b)
Sep 28 12:03:38 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:03:38.550 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:03:38] "OPTIONS / HTTP/1.0" 200 134 0.000475
Sep 28 12:03:39 ctl02 heat-api-cfn[13300]: 2017-09-28 12:03:39.216 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:03:39] "OPTIONS / HTTP/1.0" 200 134 0.000473
Sep 28 12:03:39 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:03:39.299 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:03:39] "OPTIONS / HTTP/1.0" 200 134 0.000489
Sep 28 12:03:39 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfe33486b)
Sep 28 12:03:39 ctl02 glance-api[29183]: 2017-09-28 12:03:39.568 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:03:39] "OPTIONS / HTTP/1.0" 200 134 0.000596
Sep 28 12:03:40 ctl02 nova-api[14096]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:03:40 ctl02 nova-api[14096]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:03:40 ctl02 heat-api-cfn[13300]: 2017-09-28 12:03:40.169 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:03:40] "OPTIONS / HTTP/1.0" 200 134 0.000535
Sep 28 12:03:40 ctl02 nova-api[14096]: 2017-09-28 12:03:40.234 14096 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:03:40 ctl02 nova-api[14096]: 2017-09-28 12:03:40.236 14096 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:03:40 ctl02 nova-api[14096]: 2017-09-28 12:03:40.236 14096 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:03:40 ctl02 nova-api[14096]: 2017-09-28 12:03:40.236 14096 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:03:40 ctl02 nova-api[14096]: 2017-09-28 12:03:40.236 14096 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:03:40 ctl02 nova-api[14096]: 2017-09-28 12:03:40.236 14096 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:03:40 ctl02 nova-api[14096]: 2017-09-28 12:03:40.236 14096 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:03:40 ctl02 nova-api[14096]: 2017-09-28 12:03:40.236 14096 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:03:40 ctl02 nova-api[14096]: 2017-09-28 12:03:40.236 14096 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:03:40 ctl02 nova-api[14096]: 2017-09-28 12:03:40.236 14096 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:03:40 ctl02 nova-api[14096]: 2017-09-28 12:03:40.236 14096 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:03:40 ctl02 nova-api[14096]: 2017-09-28 12:03:40.236 14096 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:03:40 ctl02 nova-api[14096]: 2017-09-28 12:03:40.236 14096 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:03:40 ctl02 nova-api[14096]: 2017-09-28 12:03:40.236 14096 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:03:40 ctl02 nova-api[14096]: 2017-09-28 12:03:40.236 14096 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:03:40 ctl02 nova-api[14096]: 2017-09-28 12:03:40.236 14096 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:03:40 ctl02 nova-api[14096]: 2017-09-28 12:03:40.236 14096 ERROR nova.wsgi     self.filename))
Sep 28 12:03:40 ctl02 nova-api[14096]: 2017-09-28 12:03:40.236 14096 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:03:40 ctl02 nova-api[14096]: 2017-09-28 12:03:40.236 14096 ERROR nova.wsgi
Sep 28 12:03:40 ctl02 nova-api[14096]: 2017-09-28 12:03:40.239 14096 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:03:40 ctl02 heat-api-cfn[13300]: 2017-09-28 12:03:40.363 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:03:40] "OPTIONS / HTTP/1.0" 200 134 0.000478
Sep 28 12:03:40 ctl02 nova-api[14096]: 2017-09-28 12:03:40.370 14096 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:03:40 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfe33486b)
Sep 28 12:03:40 ctl02 nova-api[14096]: 2017-09-28 12:03:40.606 14096 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:03:40 ctl02 nova-api[14096]: 2017-09-28 12:03:40.609 14096 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:03:40 ctl02 nova-api[14096]: 2017-09-28 12:03:40.609 14096 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:03:40 ctl02 nova-api[14096]: 2017-09-28 12:03:40.609 14096 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:03:40 ctl02 nova-api[14096]: 2017-09-28 12:03:40.740 14096 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:03:40 ctl02 nova-api[14096]: 2017-09-28 12:03:40.743 14096 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:03:40 ctl02 nova-api[14096]: 2017-09-28 12:03:40.743 14096 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:03:40 ctl02 nova-api[14096]: 2017-09-28 12:03:40.744 14096 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:03:40 ctl02 nova-api[14096]: 2017-09-28 12:03:40.747 14096 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:03:40 ctl02 nova-api[14096]: 2017-09-28 12:03:40.748 14096 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:03:40 ctl02 nova-api[14096]: 2017-09-28 12:03:40.748 14096 ERROR nova Traceback (most recent call last):
Sep 28 12:03:40 ctl02 nova-api[14096]: 2017-09-28 12:03:40.748 14096 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:03:40 ctl02 nova-api[14096]: 2017-09-28 12:03:40.748 14096 ERROR nova     sys.exit(main())
Sep 28 12:03:40 ctl02 nova-api[14096]: 2017-09-28 12:03:40.748 14096 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:03:40 ctl02 nova-api[14096]: 2017-09-28 12:03:40.748 14096 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:03:40 ctl02 nova-api[14096]: 2017-09-28 12:03:40.748 14096 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:03:40 ctl02 nova-api[14096]: 2017-09-28 12:03:40.748 14096 ERROR nova     max_url_len=max_url_len)
Sep 28 12:03:40 ctl02 nova-api[14096]: 2017-09-28 12:03:40.748 14096 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:03:40 ctl02 nova-api[14096]: 2017-09-28 12:03:40.748 14096 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:03:40 ctl02 nova-api[14096]: 2017-09-28 12:03:40.748 14096 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:03:40 ctl02 nova-api[14096]: 2017-09-28 12:03:40.748 14096 ERROR nova     sock.listen(backlog)
Sep 28 12:03:40 ctl02 nova-api[14096]: 2017-09-28 12:03:40.748 14096 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:03:40 ctl02 nova-api[14096]: 2017-09-28 12:03:40.748 14096 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:03:40 ctl02 nova-api[14096]: 2017-09-28 12:03:40.748 14096 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:03:40 ctl02 nova-api[14096]: 2017-09-28 12:03:40.748 14096 ERROR nova
Sep 28 12:03:40 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:03:40 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:03:40 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:03:41 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:03:41 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:03:41 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:03:41 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:03:41 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:03:41 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:03:42 ctl02 nova-api[14114]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:03:42 ctl02 nova-api[14114]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:03:42 ctl02 nova-api[14114]: 2017-09-28 12:03:42.927 14114 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:03:42 ctl02 nova-api[14114]: 2017-09-28 12:03:42.929 14114 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:03:42 ctl02 nova-api[14114]: 2017-09-28 12:03:42.929 14114 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:03:42 ctl02 nova-api[14114]: 2017-09-28 12:03:42.929 14114 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:03:42 ctl02 nova-api[14114]: 2017-09-28 12:03:42.929 14114 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:03:42 ctl02 nova-api[14114]: 2017-09-28 12:03:42.929 14114 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:03:42 ctl02 nova-api[14114]: 2017-09-28 12:03:42.929 14114 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:03:42 ctl02 nova-api[14114]: 2017-09-28 12:03:42.929 14114 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:03:42 ctl02 nova-api[14114]: 2017-09-28 12:03:42.929 14114 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:03:42 ctl02 nova-api[14114]: 2017-09-28 12:03:42.929 14114 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:03:42 ctl02 nova-api[14114]: 2017-09-28 12:03:42.929 14114 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:03:42 ctl02 nova-api[14114]: 2017-09-28 12:03:42.929 14114 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:03:42 ctl02 nova-api[14114]: 2017-09-28 12:03:42.929 14114 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:03:42 ctl02 nova-api[14114]: 2017-09-28 12:03:42.929 14114 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:03:42 ctl02 nova-api[14114]: 2017-09-28 12:03:42.929 14114 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:03:42 ctl02 nova-api[14114]: 2017-09-28 12:03:42.929 14114 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:03:42 ctl02 nova-api[14114]: 2017-09-28 12:03:42.929 14114 ERROR nova.wsgi     self.filename))
Sep 28 12:03:42 ctl02 nova-api[14114]: 2017-09-28 12:03:42.929 14114 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:03:42 ctl02 nova-api[14114]: 2017-09-28 12:03:42.929 14114 ERROR nova.wsgi
Sep 28 12:03:42 ctl02 nova-api[14114]: 2017-09-28 12:03:42.931 14114 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:03:43 ctl02 nova-api[14114]: 2017-09-28 12:03:43.075 14114 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:03:43 ctl02 nova-api[14114]: 2017-09-28 12:03:43.318 14114 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:03:43 ctl02 nova-api[14114]: 2017-09-28 12:03:43.321 14114 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:03:43 ctl02 nova-api[14114]: 2017-09-28 12:03:43.321 14114 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:03:43 ctl02 nova-api[14114]: 2017-09-28 12:03:43.322 14114 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:03:43 ctl02 nova-api[14114]: 2017-09-28 12:03:43.455 14114 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:03:43 ctl02 nova-api[14114]: 2017-09-28 12:03:43.458 14114 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:03:43 ctl02 nova-api[14114]: 2017-09-28 12:03:43.458 14114 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:03:43 ctl02 nova-api[14114]: 2017-09-28 12:03:43.458 14114 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:03:43 ctl02 nova-api[14114]: 2017-09-28 12:03:43.462 14114 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:03:43 ctl02 nova-api[14114]: 2017-09-28 12:03:43.462 14114 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:03:43 ctl02 nova-api[14114]: 2017-09-28 12:03:43.462 14114 ERROR nova Traceback (most recent call last):
Sep 28 12:03:43 ctl02 nova-api[14114]: 2017-09-28 12:03:43.462 14114 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:03:43 ctl02 nova-api[14114]: 2017-09-28 12:03:43.462 14114 ERROR nova     sys.exit(main())
Sep 28 12:03:43 ctl02 nova-api[14114]: 2017-09-28 12:03:43.462 14114 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:03:43 ctl02 nova-api[14114]: 2017-09-28 12:03:43.462 14114 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:03:43 ctl02 nova-api[14114]: 2017-09-28 12:03:43.462 14114 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:03:43 ctl02 nova-api[14114]: 2017-09-28 12:03:43.462 14114 ERROR nova     max_url_len=max_url_len)
Sep 28 12:03:43 ctl02 nova-api[14114]: 2017-09-28 12:03:43.462 14114 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:03:43 ctl02 nova-api[14114]: 2017-09-28 12:03:43.462 14114 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:03:43 ctl02 nova-api[14114]: 2017-09-28 12:03:43.462 14114 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:03:43 ctl02 nova-api[14114]: 2017-09-28 12:03:43.462 14114 ERROR nova     sock.listen(backlog)
Sep 28 12:03:43 ctl02 nova-api[14114]: 2017-09-28 12:03:43.462 14114 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:03:43 ctl02 nova-api[14114]: 2017-09-28 12:03:43.462 14114 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:03:43 ctl02 nova-api[14114]: 2017-09-28 12:03:43.462 14114 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:03:43 ctl02 nova-api[14114]: 2017-09-28 12:03:43.462 14114 ERROR nova
Sep 28 12:03:43 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:03:43 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:03:43 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:03:43 ctl02 glance-api[29183]: 2017-09-28 12:03:43.703 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:03:43] "OPTIONS / HTTP/1.0" 200 134 0.000647
Sep 28 12:03:43 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:03:43 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:03:43 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:03:43 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:03:44 ctl02 heat-api[13008]: 2017-09-28 12:03:44.314 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:03:44] "OPTIONS / HTTP/1.0" 200 134 0.000609
Sep 28 12:03:45 ctl02 heat-api[13008]: 2017-09-28 12:03:45.439 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:03:45] "OPTIONS / HTTP/1.0" 200 134 0.000578
Sep 28 12:03:45 ctl02 glance-api[29183]: 2017-09-28 12:03:45.468 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:03:45] "OPTIONS / HTTP/1.0" 200 134 0.000799
Sep 28 12:03:45 ctl02 nova-api[14137]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:03:45 ctl02 nova-api[14137]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:03:45 ctl02 nova-api[14137]: 2017-09-28 12:03:45.708 14137 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:03:45 ctl02 nova-api[14137]: 2017-09-28 12:03:45.710 14137 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:03:45 ctl02 nova-api[14137]: 2017-09-28 12:03:45.710 14137 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:03:45 ctl02 nova-api[14137]: 2017-09-28 12:03:45.710 14137 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:03:45 ctl02 nova-api[14137]: 2017-09-28 12:03:45.710 14137 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:03:45 ctl02 nova-api[14137]: 2017-09-28 12:03:45.710 14137 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:03:45 ctl02 nova-api[14137]: 2017-09-28 12:03:45.710 14137 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:03:45 ctl02 nova-api[14137]: 2017-09-28 12:03:45.710 14137 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:03:45 ctl02 nova-api[14137]: 2017-09-28 12:03:45.710 14137 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:03:45 ctl02 nova-api[14137]: 2017-09-28 12:03:45.710 14137 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:03:45 ctl02 nova-api[14137]: 2017-09-28 12:03:45.710 14137 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:03:45 ctl02 nova-api[14137]: 2017-09-28 12:03:45.710 14137 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:03:45 ctl02 nova-api[14137]: 2017-09-28 12:03:45.710 14137 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:03:45 ctl02 nova-api[14137]: 2017-09-28 12:03:45.710 14137 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:03:45 ctl02 nova-api[14137]: 2017-09-28 12:03:45.710 14137 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:03:45 ctl02 nova-api[14137]: 2017-09-28 12:03:45.710 14137 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:03:45 ctl02 nova-api[14137]: 2017-09-28 12:03:45.710 14137 ERROR nova.wsgi     self.filename))
Sep 28 12:03:45 ctl02 nova-api[14137]: 2017-09-28 12:03:45.710 14137 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:03:45 ctl02 nova-api[14137]: 2017-09-28 12:03:45.710 14137 ERROR nova.wsgi
Sep 28 12:03:45 ctl02 nova-api[14137]: 2017-09-28 12:03:45.711 14137 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:03:45 ctl02 nova-api[14137]: 2017-09-28 12:03:45.842 14137 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:03:45 ctl02 heat-api[13008]: 2017-09-28 12:03:45.936 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:03:45] "OPTIONS / HTTP/1.0" 200 134 0.000586
Sep 28 12:03:46 ctl02 nova-api[14137]: 2017-09-28 12:03:46.091 14137 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:03:46 ctl02 nova-api[14137]: 2017-09-28 12:03:46.094 14137 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:03:46 ctl02 nova-api[14137]: 2017-09-28 12:03:46.094 14137 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:03:46 ctl02 nova-api[14137]: 2017-09-28 12:03:46.094 14137 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:03:46 ctl02 nova-api[14137]: 2017-09-28 12:03:46.226 14137 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:03:46 ctl02 nova-api[14137]: 2017-09-28 12:03:46.228 14137 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:03:46 ctl02 nova-api[14137]: 2017-09-28 12:03:46.228 14137 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:03:46 ctl02 nova-api[14137]: 2017-09-28 12:03:46.228 14137 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:03:46 ctl02 nova-api[14137]: 2017-09-28 12:03:46.232 14137 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:03:46 ctl02 nova-api[14137]: 2017-09-28 12:03:46.232 14137 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:03:46 ctl02 nova-api[14137]: 2017-09-28 12:03:46.232 14137 ERROR nova Traceback (most recent call last):
Sep 28 12:03:46 ctl02 nova-api[14137]: 2017-09-28 12:03:46.232 14137 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:03:46 ctl02 nova-api[14137]: 2017-09-28 12:03:46.232 14137 ERROR nova     sys.exit(main())
Sep 28 12:03:46 ctl02 nova-api[14137]: 2017-09-28 12:03:46.232 14137 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:03:46 ctl02 nova-api[14137]: 2017-09-28 12:03:46.232 14137 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:03:46 ctl02 nova-api[14137]: 2017-09-28 12:03:46.232 14137 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:03:46 ctl02 nova-api[14137]: 2017-09-28 12:03:46.232 14137 ERROR nova     max_url_len=max_url_len)
Sep 28 12:03:46 ctl02 nova-api[14137]: 2017-09-28 12:03:46.232 14137 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:03:46 ctl02 nova-api[14137]: 2017-09-28 12:03:46.232 14137 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:03:46 ctl02 nova-api[14137]: 2017-09-28 12:03:46.232 14137 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:03:46 ctl02 nova-api[14137]: 2017-09-28 12:03:46.232 14137 ERROR nova     sock.listen(backlog)
Sep 28 12:03:46 ctl02 nova-api[14137]: 2017-09-28 12:03:46.232 14137 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:03:46 ctl02 nova-api[14137]: 2017-09-28 12:03:46.232 14137 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:03:46 ctl02 nova-api[14137]: 2017-09-28 12:03:46.232 14137 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:03:46 ctl02 nova-api[14137]: 2017-09-28 12:03:46.232 14137 ERROR nova
Sep 28 12:03:46 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:03:46 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:03:46 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:03:46 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:03:46 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:03:46 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:03:46 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:03:47 ctl02 nova-cert[4860]: 2017-09-28 12:03:47.907 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:03:48 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:03:48.267 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:03:48] "OPTIONS / HTTP/1.0" 200 134 0.000662
Sep 28 12:03:48 ctl02 nova-api[14155]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:03:48 ctl02 nova-api[14155]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:03:48 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:03:48.396 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:03:48] "OPTIONS / HTTP/1.0" 200 134 0.000583
Sep 28 12:03:48 ctl02 nova-api[14155]: 2017-09-28 12:03:48.455 14155 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:03:48 ctl02 nova-api[14155]: 2017-09-28 12:03:48.457 14155 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:03:48 ctl02 nova-api[14155]: 2017-09-28 12:03:48.457 14155 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:03:48 ctl02 nova-api[14155]: 2017-09-28 12:03:48.457 14155 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:03:48 ctl02 nova-api[14155]: 2017-09-28 12:03:48.457 14155 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:03:48 ctl02 nova-api[14155]: 2017-09-28 12:03:48.457 14155 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:03:48 ctl02 nova-api[14155]: 2017-09-28 12:03:48.457 14155 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:03:48 ctl02 nova-api[14155]: 2017-09-28 12:03:48.457 14155 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:03:48 ctl02 nova-api[14155]: 2017-09-28 12:03:48.457 14155 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:03:48 ctl02 nova-api[14155]: 2017-09-28 12:03:48.457 14155 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:03:48 ctl02 nova-api[14155]: 2017-09-28 12:03:48.457 14155 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:03:48 ctl02 nova-api[14155]: 2017-09-28 12:03:48.457 14155 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:03:48 ctl02 nova-api[14155]: 2017-09-28 12:03:48.457 14155 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:03:48 ctl02 nova-api[14155]: 2017-09-28 12:03:48.457 14155 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:03:48 ctl02 nova-api[14155]: 2017-09-28 12:03:48.457 14155 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:03:48 ctl02 nova-api[14155]: 2017-09-28 12:03:48.457 14155 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:03:48 ctl02 nova-api[14155]: 2017-09-28 12:03:48.457 14155 ERROR nova.wsgi     self.filename))
Sep 28 12:03:48 ctl02 nova-api[14155]: 2017-09-28 12:03:48.457 14155 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:03:48 ctl02 nova-api[14155]: 2017-09-28 12:03:48.457 14155 ERROR nova.wsgi
Sep 28 12:03:48 ctl02 nova-api[14155]: 2017-09-28 12:03:48.458 14155 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:03:48 ctl02 nova-api[14155]: 2017-09-28 12:03:48.589 14155 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:03:48 ctl02 nova-api[14155]: 2017-09-28 12:03:48.829 14155 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:03:48 ctl02 nova-api[14155]: 2017-09-28 12:03:48.832 14155 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:03:48 ctl02 nova-api[14155]: 2017-09-28 12:03:48.832 14155 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:03:48 ctl02 nova-api[14155]: 2017-09-28 12:03:48.832 14155 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:03:48 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:03:48.945 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:03:48] "OPTIONS / HTTP/1.0" 200 134 0.000656
Sep 28 12:03:48 ctl02 nova-api[14155]: 2017-09-28 12:03:48.965 14155 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:03:48 ctl02 nova-api[14155]: 2017-09-28 12:03:48.967 14155 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:03:48 ctl02 nova-api[14155]: 2017-09-28 12:03:48.967 14155 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:03:48 ctl02 nova-api[14155]: 2017-09-28 12:03:48.967 14155 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:03:48 ctl02 nova-api[14155]: 2017-09-28 12:03:48.970 14155 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:03:48 ctl02 nova-api[14155]: 2017-09-28 12:03:48.971 14155 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:03:48 ctl02 nova-api[14155]: 2017-09-28 12:03:48.971 14155 ERROR nova Traceback (most recent call last):
Sep 28 12:03:48 ctl02 nova-api[14155]: 2017-09-28 12:03:48.971 14155 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:03:48 ctl02 nova-api[14155]: 2017-09-28 12:03:48.971 14155 ERROR nova     sys.exit(main())
Sep 28 12:03:48 ctl02 nova-api[14155]: 2017-09-28 12:03:48.971 14155 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:03:48 ctl02 nova-api[14155]: 2017-09-28 12:03:48.971 14155 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:03:48 ctl02 nova-api[14155]: 2017-09-28 12:03:48.971 14155 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:03:48 ctl02 nova-api[14155]: 2017-09-28 12:03:48.971 14155 ERROR nova     max_url_len=max_url_len)
Sep 28 12:03:48 ctl02 nova-api[14155]: 2017-09-28 12:03:48.971 14155 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:03:48 ctl02 nova-api[14155]: 2017-09-28 12:03:48.971 14155 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:03:48 ctl02 nova-api[14155]: 2017-09-28 12:03:48.971 14155 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:03:48 ctl02 nova-api[14155]: 2017-09-28 12:03:48.971 14155 ERROR nova     sock.listen(backlog)
Sep 28 12:03:48 ctl02 nova-api[14155]: 2017-09-28 12:03:48.971 14155 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:03:48 ctl02 nova-api[14155]: 2017-09-28 12:03:48.971 14155 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:03:48 ctl02 nova-api[14155]: 2017-09-28 12:03:48.971 14155 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:03:48 ctl02 nova-api[14155]: 2017-09-28 12:03:48.971 14155 ERROR nova
Sep 28 12:03:49 ctl02 heat-api-cfn[13300]: 2017-09-28 12:03:49.090 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:03:49] "OPTIONS / HTTP/1.0" 200 134 0.000523
Sep 28 12:03:49 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:03:49 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:03:49 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:03:49 ctl02 heat-engine[12803]: 2017-09-28 12:03:49.346 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 24 seconds.
Sep 28 12:03:49 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:03:49 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:03:49 ctl02 heat-engine[12803]: 2017-09-28 12:03:49.384 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 24 seconds.
Sep 28 12:03:49 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:03:49 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:03:49 ctl02 heat-engine[12803]: 2017-09-28 12:03:49.400 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 24 seconds.
Sep 28 12:03:49 ctl02 heat-engine[12803]: 2017-09-28 12:03:49.408 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 24 seconds.
Sep 28 12:03:49 ctl02 glance-api[29183]: 2017-09-28 12:03:49.735 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:03:49] "OPTIONS / HTTP/1.0" 200 134 0.000646
Sep 28 12:03:50 ctl02 heat-api-cfn[13300]: 2017-09-28 12:03:50.070 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:03:50] "OPTIONS / HTTP/1.0" 200 134 0.000545
Sep 28 12:03:50 ctl02 nova-conductor[5056]: 2017-09-28 12:03:50.284 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:03:50 ctl02 nova-conductor[5056]: 2017-09-28 12:03:50.309 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:03:50 ctl02 nova-conductor[5056]: 2017-09-28 12:03:50.320 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:03:50 ctl02 nova-conductor[5056]: 2017-09-28 12:03:50.324 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:03:50 ctl02 heat-api-cfn[13300]: 2017-09-28 12:03:50.637 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:03:50] "OPTIONS / HTTP/1.0" 200 134 0.000468
Sep 28 12:03:51 ctl02 nova-api[14172]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:03:51 ctl02 nova-api[14172]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:03:51 ctl02 nova-api[14172]: 2017-09-28 12:03:51.247 14172 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:03:51 ctl02 nova-api[14172]: 2017-09-28 12:03:51.249 14172 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:03:51 ctl02 nova-api[14172]: 2017-09-28 12:03:51.249 14172 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:03:51 ctl02 nova-api[14172]: 2017-09-28 12:03:51.249 14172 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:03:51 ctl02 nova-api[14172]: 2017-09-28 12:03:51.249 14172 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:03:51 ctl02 nova-api[14172]: 2017-09-28 12:03:51.249 14172 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:03:51 ctl02 nova-api[14172]: 2017-09-28 12:03:51.249 14172 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:03:51 ctl02 nova-api[14172]: 2017-09-28 12:03:51.249 14172 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:03:51 ctl02 nova-api[14172]: 2017-09-28 12:03:51.249 14172 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:03:51 ctl02 nova-api[14172]: 2017-09-28 12:03:51.249 14172 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:03:51 ctl02 nova-api[14172]: 2017-09-28 12:03:51.249 14172 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:03:51 ctl02 nova-api[14172]: 2017-09-28 12:03:51.249 14172 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:03:51 ctl02 nova-api[14172]: 2017-09-28 12:03:51.249 14172 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:03:51 ctl02 nova-api[14172]: 2017-09-28 12:03:51.249 14172 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:03:51 ctl02 nova-api[14172]: 2017-09-28 12:03:51.249 14172 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:03:51 ctl02 nova-api[14172]: 2017-09-28 12:03:51.249 14172 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:03:51 ctl02 nova-api[14172]: 2017-09-28 12:03:51.249 14172 ERROR nova.wsgi     self.filename))
Sep 28 12:03:51 ctl02 nova-api[14172]: 2017-09-28 12:03:51.249 14172 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:03:51 ctl02 nova-api[14172]: 2017-09-28 12:03:51.249 14172 ERROR nova.wsgi
Sep 28 12:03:51 ctl02 nova-api[14172]: 2017-09-28 12:03:51.251 14172 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:03:51 ctl02 nova-api[14172]: 2017-09-28 12:03:51.384 14172 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:03:51 ctl02 nova-api[14172]: 2017-09-28 12:03:51.626 14172 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:03:51 ctl02 nova-api[14172]: 2017-09-28 12:03:51.628 14172 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:03:51 ctl02 nova-api[14172]: 2017-09-28 12:03:51.628 14172 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:03:51 ctl02 nova-api[14172]: 2017-09-28 12:03:51.628 14172 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:03:51 ctl02 nova-api[14172]: 2017-09-28 12:03:51.760 14172 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:03:51 ctl02 nova-api[14172]: 2017-09-28 12:03:51.762 14172 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:03:51 ctl02 nova-api[14172]: 2017-09-28 12:03:51.763 14172 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:03:51 ctl02 nova-api[14172]: 2017-09-28 12:03:51.763 14172 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:03:51 ctl02 nova-api[14172]: 2017-09-28 12:03:51.766 14172 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:03:51 ctl02 nova-api[14172]: 2017-09-28 12:03:51.767 14172 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:03:51 ctl02 nova-api[14172]: 2017-09-28 12:03:51.767 14172 ERROR nova Traceback (most recent call last):
Sep 28 12:03:51 ctl02 nova-api[14172]: 2017-09-28 12:03:51.767 14172 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:03:51 ctl02 nova-api[14172]: 2017-09-28 12:03:51.767 14172 ERROR nova     sys.exit(main())
Sep 28 12:03:51 ctl02 nova-api[14172]: 2017-09-28 12:03:51.767 14172 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:03:51 ctl02 nova-api[14172]: 2017-09-28 12:03:51.767 14172 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:03:51 ctl02 nova-api[14172]: 2017-09-28 12:03:51.767 14172 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:03:51 ctl02 nova-api[14172]: 2017-09-28 12:03:51.767 14172 ERROR nova     max_url_len=max_url_len)
Sep 28 12:03:51 ctl02 nova-api[14172]: 2017-09-28 12:03:51.767 14172 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:03:51 ctl02 nova-api[14172]: 2017-09-28 12:03:51.767 14172 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:03:51 ctl02 nova-api[14172]: 2017-09-28 12:03:51.767 14172 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:03:51 ctl02 nova-api[14172]: 2017-09-28 12:03:51.767 14172 ERROR nova     sock.listen(backlog)
Sep 28 12:03:51 ctl02 nova-api[14172]: 2017-09-28 12:03:51.767 14172 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:03:51 ctl02 nova-api[14172]: 2017-09-28 12:03:51.767 14172 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:03:51 ctl02 nova-api[14172]: 2017-09-28 12:03:51.767 14172 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:03:51 ctl02 nova-api[14172]: 2017-09-28 12:03:51.767 14172 ERROR nova
Sep 28 12:03:51 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:03:51 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:03:51 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:03:52 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:03:52 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:03:52 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:03:52 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:03:53 ctl02 glance-api[29183]: 2017-09-28 12:03:53.737 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:03:53] "OPTIONS / HTTP/1.0" 200 134 0.000542
Sep 28 12:03:53 ctl02 nova-api[14190]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:03:53 ctl02 nova-api[14190]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:03:53 ctl02 nova-api[14190]: 2017-09-28 12:03:53.972 14190 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:03:53 ctl02 nova-api[14190]: 2017-09-28 12:03:53.974 14190 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:03:53 ctl02 nova-api[14190]: 2017-09-28 12:03:53.974 14190 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:03:53 ctl02 nova-api[14190]: 2017-09-28 12:03:53.974 14190 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:03:53 ctl02 nova-api[14190]: 2017-09-28 12:03:53.974 14190 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:03:53 ctl02 nova-api[14190]: 2017-09-28 12:03:53.974 14190 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:03:53 ctl02 nova-api[14190]: 2017-09-28 12:03:53.974 14190 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:03:53 ctl02 nova-api[14190]: 2017-09-28 12:03:53.974 14190 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:03:53 ctl02 nova-api[14190]: 2017-09-28 12:03:53.974 14190 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:03:53 ctl02 nova-api[14190]: 2017-09-28 12:03:53.974 14190 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:03:53 ctl02 nova-api[14190]: 2017-09-28 12:03:53.974 14190 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:03:53 ctl02 nova-api[14190]: 2017-09-28 12:03:53.974 14190 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:03:53 ctl02 nova-api[14190]: 2017-09-28 12:03:53.974 14190 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:03:53 ctl02 nova-api[14190]: 2017-09-28 12:03:53.974 14190 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:03:53 ctl02 nova-api[14190]: 2017-09-28 12:03:53.974 14190 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:03:53 ctl02 nova-api[14190]: 2017-09-28 12:03:53.974 14190 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:03:53 ctl02 nova-api[14190]: 2017-09-28 12:03:53.974 14190 ERROR nova.wsgi     self.filename))
Sep 28 12:03:53 ctl02 nova-api[14190]: 2017-09-28 12:03:53.974 14190 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:03:53 ctl02 nova-api[14190]: 2017-09-28 12:03:53.974 14190 ERROR nova.wsgi
Sep 28 12:03:53 ctl02 nova-api[14190]: 2017-09-28 12:03:53.975 14190 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:03:54 ctl02 nova-api[14190]: 2017-09-28 12:03:54.111 14190 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:03:54 ctl02 nova-api[14190]: 2017-09-28 12:03:54.355 14190 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:03:54 ctl02 nova-api[14190]: 2017-09-28 12:03:54.358 14190 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:03:54 ctl02 nova-api[14190]: 2017-09-28 12:03:54.358 14190 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:03:54 ctl02 nova-api[14190]: 2017-09-28 12:03:54.358 14190 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:03:54 ctl02 nova-api[14190]: 2017-09-28 12:03:54.493 14190 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:03:54 ctl02 nova-api[14190]: 2017-09-28 12:03:54.495 14190 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:03:54 ctl02 nova-api[14190]: 2017-09-28 12:03:54.495 14190 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:03:54 ctl02 nova-api[14190]: 2017-09-28 12:03:54.496 14190 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:03:54 ctl02 nova-api[14190]: 2017-09-28 12:03:54.499 14190 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:03:54 ctl02 nova-api[14190]: 2017-09-28 12:03:54.500 14190 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:03:54 ctl02 nova-api[14190]: 2017-09-28 12:03:54.500 14190 ERROR nova Traceback (most recent call last):
Sep 28 12:03:54 ctl02 nova-api[14190]: 2017-09-28 12:03:54.500 14190 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:03:54 ctl02 nova-api[14190]: 2017-09-28 12:03:54.500 14190 ERROR nova     sys.exit(main())
Sep 28 12:03:54 ctl02 nova-api[14190]: 2017-09-28 12:03:54.500 14190 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:03:54 ctl02 nova-api[14190]: 2017-09-28 12:03:54.500 14190 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:03:54 ctl02 nova-api[14190]: 2017-09-28 12:03:54.500 14190 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:03:54 ctl02 nova-api[14190]: 2017-09-28 12:03:54.500 14190 ERROR nova     max_url_len=max_url_len)
Sep 28 12:03:54 ctl02 nova-api[14190]: 2017-09-28 12:03:54.500 14190 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:03:54 ctl02 nova-api[14190]: 2017-09-28 12:03:54.500 14190 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:03:54 ctl02 nova-api[14190]: 2017-09-28 12:03:54.500 14190 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:03:54 ctl02 nova-api[14190]: 2017-09-28 12:03:54.500 14190 ERROR nova     sock.listen(backlog)
Sep 28 12:03:54 ctl02 nova-api[14190]: 2017-09-28 12:03:54.500 14190 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:03:54 ctl02 nova-api[14190]: 2017-09-28 12:03:54.500 14190 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:03:54 ctl02 nova-api[14190]: 2017-09-28 12:03:54.500 14190 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:03:54 ctl02 nova-api[14190]: 2017-09-28 12:03:54.500 14190 ERROR nova
Sep 28 12:03:54 ctl02 heat-api[13008]: 2017-09-28 12:03:54.505 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:03:54] "OPTIONS / HTTP/1.0" 200 134 0.000598
Sep 28 12:03:54 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:03:54 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:03:54 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:03:54 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:03:54 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:03:54 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:03:54 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:03:55 ctl02 glance-api[29183]: 2017-09-28 12:03:55.078 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:03:55] "OPTIONS / HTTP/1.0" 200 134 0.000919
Sep 28 12:03:55 ctl02 heat-api[13008]: 2017-09-28 12:03:55.082 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:03:55] "OPTIONS / HTTP/1.0" 200 134 0.000704
Sep 28 12:03:56 ctl02 heat-api[13008]: 2017-09-28 12:03:56.119 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:03:56] "OPTIONS / HTTP/1.0" 200 134 0.000553
Sep 28 12:03:56 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7f42033f)
Sep 28 12:03:56 ctl02 nova-api[14209]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:03:56 ctl02 nova-api[14209]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:03:56 ctl02 nova-api[14209]: 2017-09-28 12:03:56.697 14209 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:03:56 ctl02 nova-api[14209]: 2017-09-28 12:03:56.699 14209 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:03:56 ctl02 nova-api[14209]: 2017-09-28 12:03:56.699 14209 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:03:56 ctl02 nova-api[14209]: 2017-09-28 12:03:56.699 14209 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:03:56 ctl02 nova-api[14209]: 2017-09-28 12:03:56.699 14209 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:03:56 ctl02 nova-api[14209]: 2017-09-28 12:03:56.699 14209 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:03:56 ctl02 nova-api[14209]: 2017-09-28 12:03:56.699 14209 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:03:56 ctl02 nova-api[14209]: 2017-09-28 12:03:56.699 14209 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:03:56 ctl02 nova-api[14209]: 2017-09-28 12:03:56.699 14209 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:03:56 ctl02 nova-api[14209]: 2017-09-28 12:03:56.699 14209 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:03:56 ctl02 nova-api[14209]: 2017-09-28 12:03:56.699 14209 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:03:56 ctl02 nova-api[14209]: 2017-09-28 12:03:56.699 14209 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:03:56 ctl02 nova-api[14209]: 2017-09-28 12:03:56.699 14209 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:03:56 ctl02 nova-api[14209]: 2017-09-28 12:03:56.699 14209 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:03:56 ctl02 nova-api[14209]: 2017-09-28 12:03:56.699 14209 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:03:56 ctl02 nova-api[14209]: 2017-09-28 12:03:56.699 14209 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:03:56 ctl02 nova-api[14209]: 2017-09-28 12:03:56.699 14209 ERROR nova.wsgi     self.filename))
Sep 28 12:03:56 ctl02 nova-api[14209]: 2017-09-28 12:03:56.699 14209 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:03:56 ctl02 nova-api[14209]: 2017-09-28 12:03:56.699 14209 ERROR nova.wsgi
Sep 28 12:03:56 ctl02 nova-api[14209]: 2017-09-28 12:03:56.700 14209 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:03:56 ctl02 nova-api[14209]: 2017-09-28 12:03:56.829 14209 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:03:57 ctl02 nova-api[14209]: 2017-09-28 12:03:57.068 14209 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:03:57 ctl02 nova-api[14209]: 2017-09-28 12:03:57.070 14209 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:03:57 ctl02 nova-api[14209]: 2017-09-28 12:03:57.070 14209 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:03:57 ctl02 nova-api[14209]: 2017-09-28 12:03:57.070 14209 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:03:57 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7f42033f)
Sep 28 12:03:57 ctl02 nova-api[14209]: 2017-09-28 12:03:57.201 14209 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:03:57 ctl02 nova-api[14209]: 2017-09-28 12:03:57.202 14209 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:03:57 ctl02 nova-api[14209]: 2017-09-28 12:03:57.203 14209 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:03:57 ctl02 nova-api[14209]: 2017-09-28 12:03:57.203 14209 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:03:57 ctl02 nova-api[14209]: 2017-09-28 12:03:57.206 14209 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:03:57 ctl02 nova-api[14209]: 2017-09-28 12:03:57.207 14209 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:03:57 ctl02 nova-api[14209]: 2017-09-28 12:03:57.207 14209 ERROR nova Traceback (most recent call last):
Sep 28 12:03:57 ctl02 nova-api[14209]: 2017-09-28 12:03:57.207 14209 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:03:57 ctl02 nova-api[14209]: 2017-09-28 12:03:57.207 14209 ERROR nova     sys.exit(main())
Sep 28 12:03:57 ctl02 nova-api[14209]: 2017-09-28 12:03:57.207 14209 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:03:57 ctl02 nova-api[14209]: 2017-09-28 12:03:57.207 14209 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:03:57 ctl02 nova-api[14209]: 2017-09-28 12:03:57.207 14209 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:03:57 ctl02 nova-api[14209]: 2017-09-28 12:03:57.207 14209 ERROR nova     max_url_len=max_url_len)
Sep 28 12:03:57 ctl02 nova-api[14209]: 2017-09-28 12:03:57.207 14209 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:03:57 ctl02 nova-api[14209]: 2017-09-28 12:03:57.207 14209 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:03:57 ctl02 nova-api[14209]: 2017-09-28 12:03:57.207 14209 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:03:57 ctl02 nova-api[14209]: 2017-09-28 12:03:57.207 14209 ERROR nova     sock.listen(backlog)
Sep 28 12:03:57 ctl02 nova-api[14209]: 2017-09-28 12:03:57.207 14209 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:03:57 ctl02 nova-api[14209]: 2017-09-28 12:03:57.207 14209 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:03:57 ctl02 nova-api[14209]: 2017-09-28 12:03:57.207 14209 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:03:57 ctl02 nova-api[14209]: 2017-09-28 12:03:57.207 14209 ERROR nova
Sep 28 12:03:57 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:03:57 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:03:57 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:03:57 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:03:57 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:03:57 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:03:57 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:03:57 ctl02 nova-consoleauth[5433]: 2017-09-28 12:03:57.803 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:03:58 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7f42033f)
Sep 28 12:03:58 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:03:58.355 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:03:58] "OPTIONS / HTTP/1.0" 200 134 0.000482
Sep 28 12:03:58 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:03:58.792 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:03:58] "OPTIONS / HTTP/1.0" 200 134 0.000461
Sep 28 12:03:59 ctl02 heat-api-cfn[13300]: 2017-09-28 12:03:59.089 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:03:59] "OPTIONS / HTTP/1.0" 200 134 0.000505
Sep 28 12:03:59 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7f42033f)
Sep 28 12:03:59 ctl02 nova-api[14227]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:03:59 ctl02 nova-api[14227]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:03:59 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:03:59.333 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:03:59] "OPTIONS / HTTP/1.0" 200 134 0.000450
Sep 28 12:03:59 ctl02 nova-api[14227]: 2017-09-28 12:03:59.484 14227 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:03:59 ctl02 nova-api[14227]: 2017-09-28 12:03:59.486 14227 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:03:59 ctl02 nova-api[14227]: 2017-09-28 12:03:59.486 14227 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:03:59 ctl02 nova-api[14227]: 2017-09-28 12:03:59.486 14227 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:03:59 ctl02 nova-api[14227]: 2017-09-28 12:03:59.486 14227 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:03:59 ctl02 nova-api[14227]: 2017-09-28 12:03:59.486 14227 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:03:59 ctl02 nova-api[14227]: 2017-09-28 12:03:59.486 14227 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:03:59 ctl02 nova-api[14227]: 2017-09-28 12:03:59.486 14227 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:03:59 ctl02 nova-api[14227]: 2017-09-28 12:03:59.486 14227 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:03:59 ctl02 nova-api[14227]: 2017-09-28 12:03:59.486 14227 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:03:59 ctl02 nova-api[14227]: 2017-09-28 12:03:59.486 14227 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:03:59 ctl02 nova-api[14227]: 2017-09-28 12:03:59.486 14227 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:03:59 ctl02 nova-api[14227]: 2017-09-28 12:03:59.486 14227 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:03:59 ctl02 nova-api[14227]: 2017-09-28 12:03:59.486 14227 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:03:59 ctl02 nova-api[14227]: 2017-09-28 12:03:59.486 14227 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:03:59 ctl02 nova-api[14227]: 2017-09-28 12:03:59.486 14227 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:03:59 ctl02 nova-api[14227]: 2017-09-28 12:03:59.486 14227 ERROR nova.wsgi     self.filename))
Sep 28 12:03:59 ctl02 nova-api[14227]: 2017-09-28 12:03:59.486 14227 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:03:59 ctl02 nova-api[14227]: 2017-09-28 12:03:59.486 14227 ERROR nova.wsgi
Sep 28 12:03:59 ctl02 nova-api[14227]: 2017-09-28 12:03:59.487 14227 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:03:59 ctl02 nova-api[14227]: 2017-09-28 12:03:59.618 14227 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:03:59 ctl02 heat-api-cfn[13300]: 2017-09-28 12:03:59.768 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:03:59] "OPTIONS / HTTP/1.0" 200 134 0.000577
Sep 28 12:03:59 ctl02 nova-api[14227]: 2017-09-28 12:03:59.858 14227 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:03:59 ctl02 nova-api[14227]: 2017-09-28 12:03:59.860 14227 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:03:59 ctl02 nova-api[14227]: 2017-09-28 12:03:59.860 14227 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:03:59 ctl02 nova-api[14227]: 2017-09-28 12:03:59.861 14227 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:03:59 ctl02 nova-api[14227]: 2017-09-28 12:03:59.991 14227 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:03:59 ctl02 nova-api[14227]: 2017-09-28 12:03:59.993 14227 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:03:59 ctl02 nova-api[14227]: 2017-09-28 12:03:59.993 14227 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:03:59 ctl02 nova-api[14227]: 2017-09-28 12:03:59.993 14227 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:03:59 ctl02 nova-api[14227]: 2017-09-28 12:03:59.997 14227 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:03:59 ctl02 nova-api[14227]: 2017-09-28 12:03:59.997 14227 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:03:59 ctl02 nova-api[14227]: 2017-09-28 12:03:59.997 14227 ERROR nova Traceback (most recent call last):
Sep 28 12:03:59 ctl02 nova-api[14227]: 2017-09-28 12:03:59.997 14227 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:03:59 ctl02 nova-api[14227]: 2017-09-28 12:03:59.997 14227 ERROR nova     sys.exit(main())
Sep 28 12:03:59 ctl02 nova-api[14227]: 2017-09-28 12:03:59.997 14227 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:03:59 ctl02 nova-api[14227]: 2017-09-28 12:03:59.997 14227 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:03:59 ctl02 nova-api[14227]: 2017-09-28 12:03:59.997 14227 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:03:59 ctl02 nova-api[14227]: 2017-09-28 12:03:59.997 14227 ERROR nova     max_url_len=max_url_len)
Sep 28 12:03:59 ctl02 nova-api[14227]: 2017-09-28 12:03:59.997 14227 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:03:59 ctl02 nova-api[14227]: 2017-09-28 12:03:59.997 14227 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:03:59 ctl02 nova-api[14227]: 2017-09-28 12:03:59.997 14227 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:03:59 ctl02 nova-api[14227]: 2017-09-28 12:03:59.997 14227 ERROR nova     sock.listen(backlog)
Sep 28 12:03:59 ctl02 nova-api[14227]: 2017-09-28 12:03:59.997 14227 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:03:59 ctl02 nova-api[14227]: 2017-09-28 12:03:59.997 14227 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:03:59 ctl02 nova-api[14227]: 2017-09-28 12:03:59.997 14227 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:03:59 ctl02 nova-api[14227]: 2017-09-28 12:03:59.997 14227 ERROR nova
Sep 28 12:04:00 ctl02 glance-api[29183]: 2017-09-28 12:04:00.045 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:04:00] "OPTIONS / HTTP/1.0" 200 134 0.000722
Sep 28 12:04:00 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:04:00 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:04:00 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:04:00 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7f42033f)
Sep 28 12:04:00 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:04:00 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:04:00 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:04:00 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:04:00 ctl02 nova-scheduler[5620]: 2017-09-28 12:04:00.821 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:04:00 ctl02 heat-api-cfn[13300]: 2017-09-28 12:04:00.932 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:04:00] "OPTIONS / HTTP/1.0" 200 134 0.000782
Sep 28 12:04:01 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7f42033f)
Sep 28 12:04:02 ctl02 nova-api[14245]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:04:02 ctl02 nova-api[14245]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:04:02 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7f42033f)
Sep 28 12:04:02 ctl02 nova-api[14245]: 2017-09-28 12:04:02.224 14245 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:04:02 ctl02 nova-api[14245]: 2017-09-28 12:04:02.226 14245 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:04:02 ctl02 nova-api[14245]: 2017-09-28 12:04:02.226 14245 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:04:02 ctl02 nova-api[14245]: 2017-09-28 12:04:02.226 14245 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:04:02 ctl02 nova-api[14245]: 2017-09-28 12:04:02.226 14245 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:04:02 ctl02 nova-api[14245]: 2017-09-28 12:04:02.226 14245 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:04:02 ctl02 nova-api[14245]: 2017-09-28 12:04:02.226 14245 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:04:02 ctl02 nova-api[14245]: 2017-09-28 12:04:02.226 14245 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:04:02 ctl02 nova-api[14245]: 2017-09-28 12:04:02.226 14245 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:04:02 ctl02 nova-api[14245]: 2017-09-28 12:04:02.226 14245 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:04:02 ctl02 nova-api[14245]: 2017-09-28 12:04:02.226 14245 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:04:02 ctl02 nova-api[14245]: 2017-09-28 12:04:02.226 14245 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:04:02 ctl02 nova-api[14245]: 2017-09-28 12:04:02.226 14245 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:04:02 ctl02 nova-api[14245]: 2017-09-28 12:04:02.226 14245 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:04:02 ctl02 nova-api[14245]: 2017-09-28 12:04:02.226 14245 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:04:02 ctl02 nova-api[14245]: 2017-09-28 12:04:02.226 14245 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:04:02 ctl02 nova-api[14245]: 2017-09-28 12:04:02.226 14245 ERROR nova.wsgi     self.filename))
Sep 28 12:04:02 ctl02 nova-api[14245]: 2017-09-28 12:04:02.226 14245 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:04:02 ctl02 nova-api[14245]: 2017-09-28 12:04:02.226 14245 ERROR nova.wsgi
Sep 28 12:04:02 ctl02 nova-api[14245]: 2017-09-28 12:04:02.226 14245 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:04:02 ctl02 nova-api[14245]: 2017-09-28 12:04:02.357 14245 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:04:02 ctl02 nova-api[14245]: 2017-09-28 12:04:02.595 14245 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:04:02 ctl02 nova-api[14245]: 2017-09-28 12:04:02.597 14245 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:04:02 ctl02 nova-api[14245]: 2017-09-28 12:04:02.597 14245 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:04:02 ctl02 nova-api[14245]: 2017-09-28 12:04:02.597 14245 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:04:02 ctl02 nova-api[14245]: 2017-09-28 12:04:02.729 14245 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:04:02 ctl02 nova-api[14245]: 2017-09-28 12:04:02.731 14245 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:04:02 ctl02 nova-api[14245]: 2017-09-28 12:04:02.774 14245 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:04:02 ctl02 nova-api[14245]: 2017-09-28 12:04:02.775 14245 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:04:02 ctl02 nova-api[14245]: 2017-09-28 12:04:02.778 14245 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:04:02 ctl02 nova-api[14245]: 2017-09-28 12:04:02.779 14245 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:04:02 ctl02 nova-api[14245]: 2017-09-28 12:04:02.779 14245 ERROR nova Traceback (most recent call last):
Sep 28 12:04:02 ctl02 nova-api[14245]: 2017-09-28 12:04:02.779 14245 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:04:02 ctl02 nova-api[14245]: 2017-09-28 12:04:02.779 14245 ERROR nova     sys.exit(main())
Sep 28 12:04:02 ctl02 nova-api[14245]: 2017-09-28 12:04:02.779 14245 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:04:02 ctl02 nova-api[14245]: 2017-09-28 12:04:02.779 14245 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:04:02 ctl02 nova-api[14245]: 2017-09-28 12:04:02.779 14245 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:04:02 ctl02 nova-api[14245]: 2017-09-28 12:04:02.779 14245 ERROR nova     max_url_len=max_url_len)
Sep 28 12:04:02 ctl02 nova-api[14245]: 2017-09-28 12:04:02.779 14245 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:04:02 ctl02 nova-api[14245]: 2017-09-28 12:04:02.779 14245 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:04:02 ctl02 nova-api[14245]: 2017-09-28 12:04:02.779 14245 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:04:02 ctl02 nova-api[14245]: 2017-09-28 12:04:02.779 14245 ERROR nova     sock.listen(backlog)
Sep 28 12:04:02 ctl02 nova-api[14245]: 2017-09-28 12:04:02.779 14245 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:04:02 ctl02 nova-api[14245]: 2017-09-28 12:04:02.779 14245 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:04:02 ctl02 nova-api[14245]: 2017-09-28 12:04:02.779 14245 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:04:02 ctl02 nova-api[14245]: 2017-09-28 12:04:02.779 14245 ERROR nova
Sep 28 12:04:02 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:04:02 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:04:02 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:04:03 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:04:03 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:04:03 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:04:03 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:04:03 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7f42033f)
Sep 28 12:04:03 ctl02 glance-api[29183]: 2017-09-28 12:04:03.359 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:04:03] "OPTIONS / HTTP/1.0" 200 134 0.000668
Sep 28 12:04:04 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7f42033f)
Sep 28 12:04:04 ctl02 heat-api[13008]: 2017-09-28 12:04:04.439 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:04:04] "OPTIONS / HTTP/1.0" 200 134 0.000613
Sep 28 12:04:04 ctl02 nova-api[14263]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:04:04 ctl02 nova-api[14263]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:04:04 ctl02 nova-api[14263]: 2017-09-28 12:04:04.945 14263 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:04:04 ctl02 nova-api[14263]: 2017-09-28 12:04:04.947 14263 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:04:04 ctl02 nova-api[14263]: 2017-09-28 12:04:04.947 14263 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:04:04 ctl02 nova-api[14263]: 2017-09-28 12:04:04.947 14263 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:04:04 ctl02 nova-api[14263]: 2017-09-28 12:04:04.947 14263 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:04:04 ctl02 nova-api[14263]: 2017-09-28 12:04:04.947 14263 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:04:04 ctl02 nova-api[14263]: 2017-09-28 12:04:04.947 14263 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:04:04 ctl02 nova-api[14263]: 2017-09-28 12:04:04.947 14263 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:04:04 ctl02 nova-api[14263]: 2017-09-28 12:04:04.947 14263 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:04:04 ctl02 nova-api[14263]: 2017-09-28 12:04:04.947 14263 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:04:04 ctl02 nova-api[14263]: 2017-09-28 12:04:04.947 14263 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:04:04 ctl02 nova-api[14263]: 2017-09-28 12:04:04.947 14263 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:04:04 ctl02 nova-api[14263]: 2017-09-28 12:04:04.947 14263 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:04:04 ctl02 nova-api[14263]: 2017-09-28 12:04:04.947 14263 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:04:04 ctl02 nova-api[14263]: 2017-09-28 12:04:04.947 14263 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:04:04 ctl02 nova-api[14263]: 2017-09-28 12:04:04.947 14263 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:04:04 ctl02 nova-api[14263]: 2017-09-28 12:04:04.947 14263 ERROR nova.wsgi     self.filename))
Sep 28 12:04:04 ctl02 nova-api[14263]: 2017-09-28 12:04:04.947 14263 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:04:04 ctl02 nova-api[14263]: 2017-09-28 12:04:04.947 14263 ERROR nova.wsgi
Sep 28 12:04:04 ctl02 nova-api[14263]: 2017-09-28 12:04:04.948 14263 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:04:05 ctl02 heat-api[13008]: 2017-09-28 12:04:05.050 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:04:05] "OPTIONS / HTTP/1.0" 200 134 0.000634
Sep 28 12:04:05 ctl02 nova-api[14263]: 2017-09-28 12:04:05.080 14263 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:04:05 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7f42033f)
Sep 28 12:04:05 ctl02 glance-api[29183]: 2017-09-28 12:04:05.186 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:04:05] "OPTIONS / HTTP/1.0" 200 134 0.000651
Sep 28 12:04:05 ctl02 nova-api[14263]: 2017-09-28 12:04:05.321 14263 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:04:05 ctl02 nova-api[14263]: 2017-09-28 12:04:05.323 14263 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:04:05 ctl02 nova-api[14263]: 2017-09-28 12:04:05.323 14263 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:04:05 ctl02 nova-api[14263]: 2017-09-28 12:04:05.324 14263 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:04:05 ctl02 nova-api[14263]: 2017-09-28 12:04:05.458 14263 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:04:05 ctl02 nova-api[14263]: 2017-09-28 12:04:05.461 14263 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:04:05 ctl02 nova-api[14263]: 2017-09-28 12:04:05.461 14263 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:04:05 ctl02 nova-api[14263]: 2017-09-28 12:04:05.461 14263 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:04:05 ctl02 nova-api[14263]: 2017-09-28 12:04:05.465 14263 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:04:05 ctl02 nova-api[14263]: 2017-09-28 12:04:05.465 14263 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:04:05 ctl02 nova-api[14263]: 2017-09-28 12:04:05.465 14263 ERROR nova Traceback (most recent call last):
Sep 28 12:04:05 ctl02 nova-api[14263]: 2017-09-28 12:04:05.465 14263 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:04:05 ctl02 nova-api[14263]: 2017-09-28 12:04:05.465 14263 ERROR nova     sys.exit(main())
Sep 28 12:04:05 ctl02 nova-api[14263]: 2017-09-28 12:04:05.465 14263 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:04:05 ctl02 nova-api[14263]: 2017-09-28 12:04:05.465 14263 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:04:05 ctl02 nova-api[14263]: 2017-09-28 12:04:05.465 14263 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:04:05 ctl02 nova-api[14263]: 2017-09-28 12:04:05.465 14263 ERROR nova     max_url_len=max_url_len)
Sep 28 12:04:05 ctl02 nova-api[14263]: 2017-09-28 12:04:05.465 14263 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:04:05 ctl02 nova-api[14263]: 2017-09-28 12:04:05.465 14263 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:04:05 ctl02 nova-api[14263]: 2017-09-28 12:04:05.465 14263 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:04:05 ctl02 nova-api[14263]: 2017-09-28 12:04:05.465 14263 ERROR nova     sock.listen(backlog)
Sep 28 12:04:05 ctl02 nova-api[14263]: 2017-09-28 12:04:05.465 14263 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:04:05 ctl02 nova-api[14263]: 2017-09-28 12:04:05.465 14263 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:04:05 ctl02 nova-api[14263]: 2017-09-28 12:04:05.465 14263 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:04:05 ctl02 nova-api[14263]: 2017-09-28 12:04:05.465 14263 ERROR nova
Sep 28 12:04:05 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:04:05 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:04:05 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:04:05 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:04:05 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:04:05 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:04:05 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:04:06 ctl02 heat-api[13008]: 2017-09-28 12:04:06.075 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:04:06] "OPTIONS / HTTP/1.0" 200 134 0.000672
Sep 28 12:04:06 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7f42033f)
Sep 28 12:04:07 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:04:07 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:04:07 ctl02 nova-api[14281]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:04:07 ctl02 nova-api[14281]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:04:07 ctl02 nova-api[14281]: 2017-09-28 12:04:07.708 14281 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:04:07 ctl02 nova-api[14281]: 2017-09-28 12:04:07.710 14281 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:04:07 ctl02 nova-api[14281]: 2017-09-28 12:04:07.710 14281 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:04:07 ctl02 nova-api[14281]: 2017-09-28 12:04:07.710 14281 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:04:07 ctl02 nova-api[14281]: 2017-09-28 12:04:07.710 14281 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:04:07 ctl02 nova-api[14281]: 2017-09-28 12:04:07.710 14281 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:04:07 ctl02 nova-api[14281]: 2017-09-28 12:04:07.710 14281 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:04:07 ctl02 nova-api[14281]: 2017-09-28 12:04:07.710 14281 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:04:07 ctl02 nova-api[14281]: 2017-09-28 12:04:07.710 14281 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:04:07 ctl02 nova-api[14281]: 2017-09-28 12:04:07.710 14281 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:04:07 ctl02 nova-api[14281]: 2017-09-28 12:04:07.710 14281 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:04:07 ctl02 nova-api[14281]: 2017-09-28 12:04:07.710 14281 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:04:07 ctl02 nova-api[14281]: 2017-09-28 12:04:07.710 14281 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:04:07 ctl02 nova-api[14281]: 2017-09-28 12:04:07.710 14281 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:04:07 ctl02 nova-api[14281]: 2017-09-28 12:04:07.710 14281 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:04:07 ctl02 nova-api[14281]: 2017-09-28 12:04:07.710 14281 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:04:07 ctl02 nova-api[14281]: 2017-09-28 12:04:07.710 14281 ERROR nova.wsgi     self.filename))
Sep 28 12:04:07 ctl02 nova-api[14281]: 2017-09-28 12:04:07.710 14281 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:04:07 ctl02 nova-api[14281]: 2017-09-28 12:04:07.710 14281 ERROR nova.wsgi
Sep 28 12:04:07 ctl02 nova-api[14281]: 2017-09-28 12:04:07.711 14281 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:04:07 ctl02 nova-api[14281]: 2017-09-28 12:04:07.841 14281 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:04:08 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:04:08.054 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:04:08] "OPTIONS / HTTP/1.0" 200 134 0.000511
Sep 28 12:04:08 ctl02 nova-api[14281]: 2017-09-28 12:04:08.080 14281 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:04:08 ctl02 nova-api[14281]: 2017-09-28 12:04:08.082 14281 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:04:08 ctl02 nova-api[14281]: 2017-09-28 12:04:08.082 14281 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:04:08 ctl02 nova-api[14281]: 2017-09-28 12:04:08.083 14281 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:04:08 ctl02 nova-api[14281]: 2017-09-28 12:04:08.213 14281 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:04:08 ctl02 nova-api[14281]: 2017-09-28 12:04:08.215 14281 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:04:08 ctl02 nova-api[14281]: 2017-09-28 12:04:08.215 14281 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:04:08 ctl02 nova-api[14281]: 2017-09-28 12:04:08.215 14281 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:04:08 ctl02 nova-api[14281]: 2017-09-28 12:04:08.219 14281 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:04:08 ctl02 nova-api[14281]: 2017-09-28 12:04:08.219 14281 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:04:08 ctl02 nova-api[14281]: 2017-09-28 12:04:08.219 14281 ERROR nova Traceback (most recent call last):
Sep 28 12:04:08 ctl02 nova-api[14281]: 2017-09-28 12:04:08.219 14281 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:04:08 ctl02 nova-api[14281]: 2017-09-28 12:04:08.219 14281 ERROR nova     sys.exit(main())
Sep 28 12:04:08 ctl02 nova-api[14281]: 2017-09-28 12:04:08.219 14281 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:04:08 ctl02 nova-api[14281]: 2017-09-28 12:04:08.219 14281 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:04:08 ctl02 nova-api[14281]: 2017-09-28 12:04:08.219 14281 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:04:08 ctl02 nova-api[14281]: 2017-09-28 12:04:08.219 14281 ERROR nova     max_url_len=max_url_len)
Sep 28 12:04:08 ctl02 nova-api[14281]: 2017-09-28 12:04:08.219 14281 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:04:08 ctl02 nova-api[14281]: 2017-09-28 12:04:08.219 14281 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:04:08 ctl02 nova-api[14281]: 2017-09-28 12:04:08.219 14281 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:04:08 ctl02 nova-api[14281]: 2017-09-28 12:04:08.219 14281 ERROR nova     sock.listen(backlog)
Sep 28 12:04:08 ctl02 nova-api[14281]: 2017-09-28 12:04:08.219 14281 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:04:08 ctl02 nova-api[14281]: 2017-09-28 12:04:08.219 14281 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:04:08 ctl02 nova-api[14281]: 2017-09-28 12:04:08.219 14281 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:04:08 ctl02 nova-api[14281]: 2017-09-28 12:04:08.219 14281 ERROR nova
Sep 28 12:04:08 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:04:08 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:04:08 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:04:08 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:04:08 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:04:08 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:04:08 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:04:09 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:04:09.068 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:04:09] "OPTIONS / HTTP/1.0" 200 134 0.000471
Sep 28 12:04:09 ctl02 heat-api-cfn[13300]: 2017-09-28 12:04:09.460 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:04:09] "OPTIONS / HTTP/1.0" 200 134 0.000643
Sep 28 12:04:09 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:04:09.634 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:04:09] "OPTIONS / HTTP/1.0" 200 134 0.000480
Sep 28 12:04:09 ctl02 heat-api-cfn[13300]: 2017-09-28 12:04:09.913 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:04:09] "OPTIONS / HTTP/1.0" 200 134 0.000477
Sep 28 12:04:09 ctl02 glance-api[29183]: 2017-09-28 12:04:09.930 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:04:09] "OPTIONS / HTTP/1.0" 200 134 0.000605
Sep 28 12:04:10 ctl02 nova-api[14304]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:04:10 ctl02 nova-api[14304]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:04:10 ctl02 nova-api[14304]: 2017-09-28 12:04:10.478 14304 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:04:10 ctl02 nova-api[14304]: 2017-09-28 12:04:10.479 14304 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:04:10 ctl02 nova-api[14304]: 2017-09-28 12:04:10.479 14304 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:04:10 ctl02 nova-api[14304]: 2017-09-28 12:04:10.479 14304 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:04:10 ctl02 nova-api[14304]: 2017-09-28 12:04:10.479 14304 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:04:10 ctl02 nova-api[14304]: 2017-09-28 12:04:10.479 14304 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:04:10 ctl02 nova-api[14304]: 2017-09-28 12:04:10.479 14304 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:04:10 ctl02 nova-api[14304]: 2017-09-28 12:04:10.479 14304 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:04:10 ctl02 nova-api[14304]: 2017-09-28 12:04:10.479 14304 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:04:10 ctl02 nova-api[14304]: 2017-09-28 12:04:10.479 14304 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:04:10 ctl02 nova-api[14304]: 2017-09-28 12:04:10.479 14304 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:04:10 ctl02 nova-api[14304]: 2017-09-28 12:04:10.479 14304 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:04:10 ctl02 nova-api[14304]: 2017-09-28 12:04:10.479 14304 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:04:10 ctl02 nova-api[14304]: 2017-09-28 12:04:10.479 14304 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:04:10 ctl02 nova-api[14304]: 2017-09-28 12:04:10.479 14304 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:04:10 ctl02 nova-api[14304]: 2017-09-28 12:04:10.479 14304 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:04:10 ctl02 nova-api[14304]: 2017-09-28 12:04:10.479 14304 ERROR nova.wsgi     self.filename))
Sep 28 12:04:10 ctl02 nova-api[14304]: 2017-09-28 12:04:10.479 14304 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:04:10 ctl02 nova-api[14304]: 2017-09-28 12:04:10.479 14304 ERROR nova.wsgi
Sep 28 12:04:10 ctl02 nova-api[14304]: 2017-09-28 12:04:10.481 14304 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:04:10 ctl02 heat-api-cfn[13300]: 2017-09-28 12:04:10.588 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:04:10] "OPTIONS / HTTP/1.0" 200 134 0.000585
Sep 28 12:04:10 ctl02 nova-api[14304]: 2017-09-28 12:04:10.610 14304 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:04:10 ctl02 nova-api[14304]: 2017-09-28 12:04:10.841 14304 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:04:10 ctl02 nova-api[14304]: 2017-09-28 12:04:10.843 14304 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:04:10 ctl02 nova-api[14304]: 2017-09-28 12:04:10.843 14304 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:04:10 ctl02 nova-api[14304]: 2017-09-28 12:04:10.844 14304 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:04:10 ctl02 nova-api[14304]: 2017-09-28 12:04:10.975 14304 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:04:10 ctl02 nova-api[14304]: 2017-09-28 12:04:10.977 14304 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:04:10 ctl02 nova-api[14304]: 2017-09-28 12:04:10.978 14304 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:04:10 ctl02 nova-api[14304]: 2017-09-28 12:04:10.978 14304 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:04:10 ctl02 nova-api[14304]: 2017-09-28 12:04:10.981 14304 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:04:10 ctl02 nova-api[14304]: 2017-09-28 12:04:10.981 14304 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:04:10 ctl02 nova-api[14304]: 2017-09-28 12:04:10.981 14304 ERROR nova Traceback (most recent call last):
Sep 28 12:04:10 ctl02 nova-api[14304]: 2017-09-28 12:04:10.981 14304 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:04:10 ctl02 nova-api[14304]: 2017-09-28 12:04:10.981 14304 ERROR nova     sys.exit(main())
Sep 28 12:04:10 ctl02 nova-api[14304]: 2017-09-28 12:04:10.981 14304 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:04:10 ctl02 nova-api[14304]: 2017-09-28 12:04:10.981 14304 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:04:10 ctl02 nova-api[14304]: 2017-09-28 12:04:10.981 14304 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:04:10 ctl02 nova-api[14304]: 2017-09-28 12:04:10.981 14304 ERROR nova     max_url_len=max_url_len)
Sep 28 12:04:10 ctl02 nova-api[14304]: 2017-09-28 12:04:10.981 14304 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:04:10 ctl02 nova-api[14304]: 2017-09-28 12:04:10.981 14304 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:04:10 ctl02 nova-api[14304]: 2017-09-28 12:04:10.981 14304 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:04:10 ctl02 nova-api[14304]: 2017-09-28 12:04:10.981 14304 ERROR nova     sock.listen(backlog)
Sep 28 12:04:10 ctl02 nova-api[14304]: 2017-09-28 12:04:10.981 14304 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:04:10 ctl02 nova-api[14304]: 2017-09-28 12:04:10.981 14304 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:04:10 ctl02 nova-api[14304]: 2017-09-28 12:04:10.981 14304 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:04:10 ctl02 nova-api[14304]: 2017-09-28 12:04:10.981 14304 ERROR nova
Sep 28 12:04:11 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:04:11 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:04:11 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:04:11 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:04:11 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:04:11 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:04:11 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:04:13 ctl02 nova-api[14322]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:04:13 ctl02 nova-api[14322]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:04:13 ctl02 glance-api[29183]: 2017-09-28 12:04:13.137 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:04:13] "OPTIONS / HTTP/1.0" 200 134 0.000676
Sep 28 12:04:13 ctl02 nova-api[14322]: 2017-09-28 12:04:13.220 14322 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:04:13 ctl02 nova-api[14322]: 2017-09-28 12:04:13.222 14322 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:04:13 ctl02 nova-api[14322]: 2017-09-28 12:04:13.222 14322 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:04:13 ctl02 nova-api[14322]: 2017-09-28 12:04:13.222 14322 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:04:13 ctl02 nova-api[14322]: 2017-09-28 12:04:13.222 14322 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:04:13 ctl02 nova-api[14322]: 2017-09-28 12:04:13.222 14322 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:04:13 ctl02 nova-api[14322]: 2017-09-28 12:04:13.222 14322 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:04:13 ctl02 nova-api[14322]: 2017-09-28 12:04:13.222 14322 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:04:13 ctl02 nova-api[14322]: 2017-09-28 12:04:13.222 14322 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:04:13 ctl02 nova-api[14322]: 2017-09-28 12:04:13.222 14322 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:04:13 ctl02 nova-api[14322]: 2017-09-28 12:04:13.222 14322 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:04:13 ctl02 nova-api[14322]: 2017-09-28 12:04:13.222 14322 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:04:13 ctl02 nova-api[14322]: 2017-09-28 12:04:13.222 14322 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:04:13 ctl02 nova-api[14322]: 2017-09-28 12:04:13.222 14322 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:04:13 ctl02 nova-api[14322]: 2017-09-28 12:04:13.222 14322 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:04:13 ctl02 nova-api[14322]: 2017-09-28 12:04:13.222 14322 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:04:13 ctl02 nova-api[14322]: 2017-09-28 12:04:13.222 14322 ERROR nova.wsgi     self.filename))
Sep 28 12:04:13 ctl02 nova-api[14322]: 2017-09-28 12:04:13.222 14322 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:04:13 ctl02 nova-api[14322]: 2017-09-28 12:04:13.222 14322 ERROR nova.wsgi
Sep 28 12:04:13 ctl02 nova-api[14322]: 2017-09-28 12:04:13.223 14322 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:04:13 ctl02 heat-engine[12803]: 2017-09-28 12:04:13.354 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 26 seconds.
Sep 28 12:04:13 ctl02 nova-api[14322]: 2017-09-28 12:04:13.356 14322 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:04:13 ctl02 heat-engine[12803]: 2017-09-28 12:04:13.394 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 26 seconds.
Sep 28 12:04:13 ctl02 heat-engine[12803]: 2017-09-28 12:04:13.412 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 26 seconds.
Sep 28 12:04:13 ctl02 heat-engine[12803]: 2017-09-28 12:04:13.416 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 26 seconds.
Sep 28 12:04:13 ctl02 nova-api[14322]: 2017-09-28 12:04:13.609 14322 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:04:13 ctl02 nova-api[14322]: 2017-09-28 12:04:13.611 14322 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:04:13 ctl02 nova-api[14322]: 2017-09-28 12:04:13.611 14322 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:04:13 ctl02 nova-api[14322]: 2017-09-28 12:04:13.611 14322 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:04:13 ctl02 nova-api[14322]: 2017-09-28 12:04:13.743 14322 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:04:13 ctl02 nova-api[14322]: 2017-09-28 12:04:13.745 14322 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:04:13 ctl02 nova-api[14322]: 2017-09-28 12:04:13.745 14322 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:04:13 ctl02 nova-api[14322]: 2017-09-28 12:04:13.745 14322 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:04:13 ctl02 nova-api[14322]: 2017-09-28 12:04:13.748 14322 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:04:13 ctl02 nova-api[14322]: 2017-09-28 12:04:13.749 14322 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:04:13 ctl02 nova-api[14322]: 2017-09-28 12:04:13.749 14322 ERROR nova Traceback (most recent call last):
Sep 28 12:04:13 ctl02 nova-api[14322]: 2017-09-28 12:04:13.749 14322 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:04:13 ctl02 nova-api[14322]: 2017-09-28 12:04:13.749 14322 ERROR nova     sys.exit(main())
Sep 28 12:04:13 ctl02 nova-api[14322]: 2017-09-28 12:04:13.749 14322 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:04:13 ctl02 nova-api[14322]: 2017-09-28 12:04:13.749 14322 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:04:13 ctl02 nova-api[14322]: 2017-09-28 12:04:13.749 14322 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:04:13 ctl02 nova-api[14322]: 2017-09-28 12:04:13.749 14322 ERROR nova     max_url_len=max_url_len)
Sep 28 12:04:13 ctl02 nova-api[14322]: 2017-09-28 12:04:13.749 14322 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:04:13 ctl02 nova-api[14322]: 2017-09-28 12:04:13.749 14322 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:04:13 ctl02 nova-api[14322]: 2017-09-28 12:04:13.749 14322 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:04:13 ctl02 nova-api[14322]: 2017-09-28 12:04:13.749 14322 ERROR nova     sock.listen(backlog)
Sep 28 12:04:13 ctl02 nova-api[14322]: 2017-09-28 12:04:13.749 14322 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:04:13 ctl02 nova-api[14322]: 2017-09-28 12:04:13.749 14322 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:04:13 ctl02 nova-api[14322]: 2017-09-28 12:04:13.749 14322 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:04:13 ctl02 nova-api[14322]: 2017-09-28 12:04:13.749 14322 ERROR nova
Sep 28 12:04:13 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:04:13 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:04:13 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:04:14 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:04:14 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:04:14 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:04:14 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:04:14 ctl02 heat-api[13008]: 2017-09-28 12:04:14.151 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:04:14] "OPTIONS / HTTP/1.0" 200 134 0.000723
Sep 28 12:04:15 ctl02 glance-api[29183]: 2017-09-28 12:04:15.118 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:04:15] "OPTIONS / HTTP/1.0" 200 134 0.000705
Sep 28 12:04:15 ctl02 heat-api[13008]: 2017-09-28 12:04:15.420 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:04:15] "OPTIONS / HTTP/1.0" 200 134 0.000612
Sep 28 12:04:15 ctl02 nova-api[14339]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:04:15 ctl02 nova-api[14339]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:04:15 ctl02 nova-api[14339]: 2017-09-28 12:04:15.956 14339 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:04:15 ctl02 nova-api[14339]: 2017-09-28 12:04:15.958 14339 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:04:15 ctl02 nova-api[14339]: 2017-09-28 12:04:15.958 14339 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:04:15 ctl02 nova-api[14339]: 2017-09-28 12:04:15.958 14339 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:04:15 ctl02 nova-api[14339]: 2017-09-28 12:04:15.958 14339 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:04:15 ctl02 nova-api[14339]: 2017-09-28 12:04:15.958 14339 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:04:15 ctl02 nova-api[14339]: 2017-09-28 12:04:15.958 14339 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:04:15 ctl02 nova-api[14339]: 2017-09-28 12:04:15.958 14339 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:04:15 ctl02 nova-api[14339]: 2017-09-28 12:04:15.958 14339 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:04:15 ctl02 nova-api[14339]: 2017-09-28 12:04:15.958 14339 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:04:15 ctl02 nova-api[14339]: 2017-09-28 12:04:15.958 14339 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:04:15 ctl02 nova-api[14339]: 2017-09-28 12:04:15.958 14339 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:04:15 ctl02 nova-api[14339]: 2017-09-28 12:04:15.958 14339 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:04:15 ctl02 nova-api[14339]: 2017-09-28 12:04:15.958 14339 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:04:15 ctl02 nova-api[14339]: 2017-09-28 12:04:15.958 14339 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:04:15 ctl02 nova-api[14339]: 2017-09-28 12:04:15.958 14339 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:04:15 ctl02 nova-api[14339]: 2017-09-28 12:04:15.958 14339 ERROR nova.wsgi     self.filename))
Sep 28 12:04:15 ctl02 nova-api[14339]: 2017-09-28 12:04:15.958 14339 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:04:15 ctl02 nova-api[14339]: 2017-09-28 12:04:15.958 14339 ERROR nova.wsgi
Sep 28 12:04:15 ctl02 nova-api[14339]: 2017-09-28 12:04:15.960 14339 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:04:16 ctl02 nova-api[14339]: 2017-09-28 12:04:16.089 14339 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:04:16 ctl02 heat-api[13008]: 2017-09-28 12:04:16.110 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:04:16] "OPTIONS / HTTP/1.0" 200 134 0.000561
Sep 28 12:04:16 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc8094f44)
Sep 28 12:04:16 ctl02 nova-api[14339]: 2017-09-28 12:04:16.336 14339 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:04:16 ctl02 nova-api[14339]: 2017-09-28 12:04:16.338 14339 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:04:16 ctl02 nova-api[14339]: 2017-09-28 12:04:16.339 14339 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:04:16 ctl02 nova-api[14339]: 2017-09-28 12:04:16.339 14339 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:04:16 ctl02 nova-api[14339]: 2017-09-28 12:04:16.471 14339 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:04:16 ctl02 nova-api[14339]: 2017-09-28 12:04:16.473 14339 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:04:16 ctl02 nova-api[14339]: 2017-09-28 12:04:16.473 14339 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:04:16 ctl02 nova-api[14339]: 2017-09-28 12:04:16.473 14339 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:04:16 ctl02 nova-api[14339]: 2017-09-28 12:04:16.477 14339 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:04:16 ctl02 nova-api[14339]: 2017-09-28 12:04:16.477 14339 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:04:16 ctl02 nova-api[14339]: 2017-09-28 12:04:16.477 14339 ERROR nova Traceback (most recent call last):
Sep 28 12:04:16 ctl02 nova-api[14339]: 2017-09-28 12:04:16.477 14339 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:04:16 ctl02 nova-api[14339]: 2017-09-28 12:04:16.477 14339 ERROR nova     sys.exit(main())
Sep 28 12:04:16 ctl02 nova-api[14339]: 2017-09-28 12:04:16.477 14339 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:04:16 ctl02 nova-api[14339]: 2017-09-28 12:04:16.477 14339 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:04:16 ctl02 nova-api[14339]: 2017-09-28 12:04:16.477 14339 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:04:16 ctl02 nova-api[14339]: 2017-09-28 12:04:16.477 14339 ERROR nova     max_url_len=max_url_len)
Sep 28 12:04:16 ctl02 nova-api[14339]: 2017-09-28 12:04:16.477 14339 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:04:16 ctl02 nova-api[14339]: 2017-09-28 12:04:16.477 14339 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:04:16 ctl02 nova-api[14339]: 2017-09-28 12:04:16.477 14339 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:04:16 ctl02 nova-api[14339]: 2017-09-28 12:04:16.477 14339 ERROR nova     sock.listen(backlog)
Sep 28 12:04:16 ctl02 nova-api[14339]: 2017-09-28 12:04:16.477 14339 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:04:16 ctl02 nova-api[14339]: 2017-09-28 12:04:16.477 14339 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:04:16 ctl02 nova-api[14339]: 2017-09-28 12:04:16.477 14339 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:04:16 ctl02 nova-api[14339]: 2017-09-28 12:04:16.477 14339 ERROR nova
Sep 28 12:04:16 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:04:16 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:04:16 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:04:16 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:04:16 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:04:16 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:04:16 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:04:17 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc8094f44)
Sep 28 12:04:18 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc8094f44)
Sep 28 12:04:18 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:04:18.413 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:04:18] "OPTIONS / HTTP/1.0" 200 134 0.000529
Sep 28 12:04:18 ctl02 nova-api[14358]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:04:18 ctl02 nova-api[14358]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:04:18 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:04:18.690 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:04:18] "OPTIONS / HTTP/1.0" 200 134 0.000421
Sep 28 12:04:18 ctl02 nova-api[14358]: 2017-09-28 12:04:18.702 14358 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:04:18 ctl02 nova-api[14358]: 2017-09-28 12:04:18.704 14358 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:04:18 ctl02 nova-api[14358]: 2017-09-28 12:04:18.704 14358 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:04:18 ctl02 nova-api[14358]: 2017-09-28 12:04:18.704 14358 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:04:18 ctl02 nova-api[14358]: 2017-09-28 12:04:18.704 14358 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:04:18 ctl02 nova-api[14358]: 2017-09-28 12:04:18.704 14358 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:04:18 ctl02 nova-api[14358]: 2017-09-28 12:04:18.704 14358 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:04:18 ctl02 nova-api[14358]: 2017-09-28 12:04:18.704 14358 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:04:18 ctl02 nova-api[14358]: 2017-09-28 12:04:18.704 14358 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:04:18 ctl02 nova-api[14358]: 2017-09-28 12:04:18.704 14358 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:04:18 ctl02 nova-api[14358]: 2017-09-28 12:04:18.704 14358 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:04:18 ctl02 nova-api[14358]: 2017-09-28 12:04:18.704 14358 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:04:18 ctl02 nova-api[14358]: 2017-09-28 12:04:18.704 14358 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:04:18 ctl02 nova-api[14358]: 2017-09-28 12:04:18.704 14358 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:04:18 ctl02 nova-api[14358]: 2017-09-28 12:04:18.704 14358 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:04:18 ctl02 nova-api[14358]: 2017-09-28 12:04:18.704 14358 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:04:18 ctl02 nova-api[14358]: 2017-09-28 12:04:18.704 14358 ERROR nova.wsgi     self.filename))
Sep 28 12:04:18 ctl02 nova-api[14358]: 2017-09-28 12:04:18.704 14358 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:04:18 ctl02 nova-api[14358]: 2017-09-28 12:04:18.704 14358 ERROR nova.wsgi
Sep 28 12:04:18 ctl02 nova-api[14358]: 2017-09-28 12:04:18.705 14358 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:04:18 ctl02 nova-api[14358]: 2017-09-28 12:04:18.839 14358 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:04:19 ctl02 nova-api[14358]: 2017-09-28 12:04:19.084 14358 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:04:19 ctl02 nova-api[14358]: 2017-09-28 12:04:19.086 14358 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:04:19 ctl02 nova-api[14358]: 2017-09-28 12:04:19.087 14358 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:04:19 ctl02 nova-api[14358]: 2017-09-28 12:04:19.087 14358 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:04:19 ctl02 heat-api-cfn[13300]: 2017-09-28 12:04:19.188 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:04:19] "OPTIONS / HTTP/1.0" 200 134 0.000831
Sep 28 12:04:19 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc8094f44)
Sep 28 12:04:19 ctl02 nova-api[14358]: 2017-09-28 12:04:19.223 14358 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:04:19 ctl02 nova-api[14358]: 2017-09-28 12:04:19.225 14358 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:04:19 ctl02 nova-api[14358]: 2017-09-28 12:04:19.225 14358 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:04:19 ctl02 nova-api[14358]: 2017-09-28 12:04:19.226 14358 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:04:19 ctl02 nova-api[14358]: 2017-09-28 12:04:19.229 14358 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:04:19 ctl02 nova-api[14358]: 2017-09-28 12:04:19.230 14358 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:04:19 ctl02 nova-api[14358]: 2017-09-28 12:04:19.230 14358 ERROR nova Traceback (most recent call last):
Sep 28 12:04:19 ctl02 nova-api[14358]: 2017-09-28 12:04:19.230 14358 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:04:19 ctl02 nova-api[14358]: 2017-09-28 12:04:19.230 14358 ERROR nova     sys.exit(main())
Sep 28 12:04:19 ctl02 nova-api[14358]: 2017-09-28 12:04:19.230 14358 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:04:19 ctl02 nova-api[14358]: 2017-09-28 12:04:19.230 14358 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:04:19 ctl02 nova-api[14358]: 2017-09-28 12:04:19.230 14358 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:04:19 ctl02 nova-api[14358]: 2017-09-28 12:04:19.230 14358 ERROR nova     max_url_len=max_url_len)
Sep 28 12:04:19 ctl02 nova-api[14358]: 2017-09-28 12:04:19.230 14358 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:04:19 ctl02 nova-api[14358]: 2017-09-28 12:04:19.230 14358 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:04:19 ctl02 nova-api[14358]: 2017-09-28 12:04:19.230 14358 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:04:19 ctl02 nova-api[14358]: 2017-09-28 12:04:19.230 14358 ERROR nova     sock.listen(backlog)
Sep 28 12:04:19 ctl02 nova-api[14358]: 2017-09-28 12:04:19.230 14358 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:04:19 ctl02 nova-api[14358]: 2017-09-28 12:04:19.230 14358 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:04:19 ctl02 nova-api[14358]: 2017-09-28 12:04:19.230 14358 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:04:19 ctl02 nova-api[14358]: 2017-09-28 12:04:19.230 14358 ERROR nova
Sep 28 12:04:19 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:04:19 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:04:19 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:04:19 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:04:19 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:04:19 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:04:19 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:04:19 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:04:19.897 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:04:19] "OPTIONS / HTTP/1.0" 200 134 0.000441
Sep 28 12:04:19 ctl02 nova-cert[4860]: 2017-09-28 12:04:19.947 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:04:20 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc8094f44)
Sep 28 12:04:20 ctl02 glance-api[29183]: 2017-09-28 12:04:20.258 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:04:20] "OPTIONS / HTTP/1.0" 200 134 0.000626
Sep 28 12:04:20 ctl02 heat-api-cfn[13300]: 2017-09-28 12:04:20.288 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:04:20] "OPTIONS / HTTP/1.0" 200 134 0.000484
Sep 28 12:04:20 ctl02 heat-api-cfn[13300]: 2017-09-28 12:04:20.618 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:04:20] "OPTIONS / HTTP/1.0" 200 134 0.000361
Sep 28 12:04:21 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc8094f44)
Sep 28 12:04:21 ctl02 nova-api[14376]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:04:21 ctl02 nova-api[14376]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:04:21 ctl02 nova-api[14376]: 2017-09-28 12:04:21.439 14376 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:04:21 ctl02 nova-api[14376]: 2017-09-28 12:04:21.441 14376 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:04:21 ctl02 nova-api[14376]: 2017-09-28 12:04:21.441 14376 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:04:21 ctl02 nova-api[14376]: 2017-09-28 12:04:21.441 14376 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:04:21 ctl02 nova-api[14376]: 2017-09-28 12:04:21.441 14376 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:04:21 ctl02 nova-api[14376]: 2017-09-28 12:04:21.441 14376 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:04:21 ctl02 nova-api[14376]: 2017-09-28 12:04:21.441 14376 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:04:21 ctl02 nova-api[14376]: 2017-09-28 12:04:21.441 14376 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:04:21 ctl02 nova-api[14376]: 2017-09-28 12:04:21.441 14376 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:04:21 ctl02 nova-api[14376]: 2017-09-28 12:04:21.441 14376 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:04:21 ctl02 nova-api[14376]: 2017-09-28 12:04:21.441 14376 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:04:21 ctl02 nova-api[14376]: 2017-09-28 12:04:21.441 14376 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:04:21 ctl02 nova-api[14376]: 2017-09-28 12:04:21.441 14376 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:04:21 ctl02 nova-api[14376]: 2017-09-28 12:04:21.441 14376 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:04:21 ctl02 nova-api[14376]: 2017-09-28 12:04:21.441 14376 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:04:21 ctl02 nova-api[14376]: 2017-09-28 12:04:21.441 14376 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:04:21 ctl02 nova-api[14376]: 2017-09-28 12:04:21.441 14376 ERROR nova.wsgi     self.filename))
Sep 28 12:04:21 ctl02 nova-api[14376]: 2017-09-28 12:04:21.441 14376 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:04:21 ctl02 nova-api[14376]: 2017-09-28 12:04:21.441 14376 ERROR nova.wsgi
Sep 28 12:04:21 ctl02 nova-api[14376]: 2017-09-28 12:04:21.443 14376 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:04:21 ctl02 nova-api[14376]: 2017-09-28 12:04:21.585 14376 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:04:21 ctl02 nova-api[14376]: 2017-09-28 12:04:21.826 14376 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:04:21 ctl02 nova-api[14376]: 2017-09-28 12:04:21.828 14376 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:04:21 ctl02 nova-api[14376]: 2017-09-28 12:04:21.828 14376 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:04:21 ctl02 nova-api[14376]: 2017-09-28 12:04:21.828 14376 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:04:21 ctl02 nova-api[14376]: 2017-09-28 12:04:21.958 14376 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:04:21 ctl02 nova-api[14376]: 2017-09-28 12:04:21.959 14376 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:04:21 ctl02 nova-api[14376]: 2017-09-28 12:04:21.960 14376 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:04:21 ctl02 nova-api[14376]: 2017-09-28 12:04:21.960 14376 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:04:21 ctl02 nova-api[14376]: 2017-09-28 12:04:21.963 14376 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:04:21 ctl02 nova-api[14376]: 2017-09-28 12:04:21.963 14376 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:04:21 ctl02 nova-api[14376]: 2017-09-28 12:04:21.963 14376 ERROR nova Traceback (most recent call last):
Sep 28 12:04:21 ctl02 nova-api[14376]: 2017-09-28 12:04:21.963 14376 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:04:21 ctl02 nova-api[14376]: 2017-09-28 12:04:21.963 14376 ERROR nova     sys.exit(main())
Sep 28 12:04:21 ctl02 nova-api[14376]: 2017-09-28 12:04:21.963 14376 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:04:21 ctl02 nova-api[14376]: 2017-09-28 12:04:21.963 14376 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:04:21 ctl02 nova-api[14376]: 2017-09-28 12:04:21.963 14376 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:04:21 ctl02 nova-api[14376]: 2017-09-28 12:04:21.963 14376 ERROR nova     max_url_len=max_url_len)
Sep 28 12:04:21 ctl02 nova-api[14376]: 2017-09-28 12:04:21.963 14376 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:04:21 ctl02 nova-api[14376]: 2017-09-28 12:04:21.963 14376 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:04:21 ctl02 nova-api[14376]: 2017-09-28 12:04:21.963 14376 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:04:21 ctl02 nova-api[14376]: 2017-09-28 12:04:21.963 14376 ERROR nova     sock.listen(backlog)
Sep 28 12:04:21 ctl02 nova-api[14376]: 2017-09-28 12:04:21.963 14376 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:04:21 ctl02 nova-api[14376]: 2017-09-28 12:04:21.963 14376 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:04:21 ctl02 nova-api[14376]: 2017-09-28 12:04:21.963 14376 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:04:21 ctl02 nova-api[14376]: 2017-09-28 12:04:21.963 14376 ERROR nova
Sep 28 12:04:22 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:04:22 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:04:22 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:04:22 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc8094f44)
Sep 28 12:04:22 ctl02 nova-conductor[5056]: 2017-09-28 12:04:22.293 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:04:22 ctl02 nova-conductor[5056]: 2017-09-28 12:04:22.318 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:04:22 ctl02 nova-conductor[5056]: 2017-09-28 12:04:22.329 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:04:22 ctl02 nova-conductor[5056]: 2017-09-28 12:04:22.333 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:04:22 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:04:22 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:04:22 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:04:22 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:04:23 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc8094f44)
Sep 28 12:04:23 ctl02 glance-api[29183]: 2017-09-28 12:04:23.318 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:04:23] "OPTIONS / HTTP/1.0" 200 134 0.000561
Sep 28 12:04:24 ctl02 nova-api[14394]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:04:24 ctl02 nova-api[14394]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:04:24 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc8094f44)
Sep 28 12:04:24 ctl02 nova-api[14394]: 2017-09-28 12:04:24.203 14394 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:04:24 ctl02 nova-api[14394]: 2017-09-28 12:04:24.205 14394 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:04:24 ctl02 nova-api[14394]: 2017-09-28 12:04:24.205 14394 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:04:24 ctl02 nova-api[14394]: 2017-09-28 12:04:24.205 14394 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:04:24 ctl02 nova-api[14394]: 2017-09-28 12:04:24.205 14394 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:04:24 ctl02 nova-api[14394]: 2017-09-28 12:04:24.205 14394 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:04:24 ctl02 nova-api[14394]: 2017-09-28 12:04:24.205 14394 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:04:24 ctl02 nova-api[14394]: 2017-09-28 12:04:24.205 14394 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:04:24 ctl02 nova-api[14394]: 2017-09-28 12:04:24.205 14394 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:04:24 ctl02 nova-api[14394]: 2017-09-28 12:04:24.205 14394 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:04:24 ctl02 nova-api[14394]: 2017-09-28 12:04:24.205 14394 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:04:24 ctl02 nova-api[14394]: 2017-09-28 12:04:24.205 14394 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:04:24 ctl02 nova-api[14394]: 2017-09-28 12:04:24.205 14394 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:04:24 ctl02 nova-api[14394]: 2017-09-28 12:04:24.205 14394 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:04:24 ctl02 nova-api[14394]: 2017-09-28 12:04:24.205 14394 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:04:24 ctl02 nova-api[14394]: 2017-09-28 12:04:24.205 14394 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:04:24 ctl02 nova-api[14394]: 2017-09-28 12:04:24.205 14394 ERROR nova.wsgi     self.filename))
Sep 28 12:04:24 ctl02 nova-api[14394]: 2017-09-28 12:04:24.205 14394 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:04:24 ctl02 nova-api[14394]: 2017-09-28 12:04:24.205 14394 ERROR nova.wsgi
Sep 28 12:04:24 ctl02 nova-api[14394]: 2017-09-28 12:04:24.206 14394 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:04:24 ctl02 heat-api[13008]: 2017-09-28 12:04:24.298 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:04:24] "OPTIONS / HTTP/1.0" 200 134 0.000566
Sep 28 12:04:24 ctl02 nova-api[14394]: 2017-09-28 12:04:24.336 14394 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:04:24 ctl02 nova-api[14394]: 2017-09-28 12:04:24.562 14394 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:04:24 ctl02 nova-api[14394]: 2017-09-28 12:04:24.564 14394 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:04:24 ctl02 nova-api[14394]: 2017-09-28 12:04:24.564 14394 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:04:24 ctl02 nova-api[14394]: 2017-09-28 12:04:24.565 14394 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:04:24 ctl02 nova-api[14394]: 2017-09-28 12:04:24.695 14394 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:04:24 ctl02 nova-api[14394]: 2017-09-28 12:04:24.696 14394 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:04:24 ctl02 nova-api[14394]: 2017-09-28 12:04:24.697 14394 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:04:24 ctl02 nova-api[14394]: 2017-09-28 12:04:24.697 14394 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:04:24 ctl02 nova-api[14394]: 2017-09-28 12:04:24.700 14394 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:04:24 ctl02 nova-api[14394]: 2017-09-28 12:04:24.700 14394 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:04:24 ctl02 nova-api[14394]: 2017-09-28 12:04:24.700 14394 ERROR nova Traceback (most recent call last):
Sep 28 12:04:24 ctl02 nova-api[14394]: 2017-09-28 12:04:24.700 14394 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:04:24 ctl02 nova-api[14394]: 2017-09-28 12:04:24.700 14394 ERROR nova     sys.exit(main())
Sep 28 12:04:24 ctl02 nova-api[14394]: 2017-09-28 12:04:24.700 14394 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:04:24 ctl02 nova-api[14394]: 2017-09-28 12:04:24.700 14394 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:04:24 ctl02 nova-api[14394]: 2017-09-28 12:04:24.700 14394 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:04:24 ctl02 nova-api[14394]: 2017-09-28 12:04:24.700 14394 ERROR nova     max_url_len=max_url_len)
Sep 28 12:04:24 ctl02 nova-api[14394]: 2017-09-28 12:04:24.700 14394 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:04:24 ctl02 nova-api[14394]: 2017-09-28 12:04:24.700 14394 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:04:24 ctl02 nova-api[14394]: 2017-09-28 12:04:24.700 14394 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:04:24 ctl02 nova-api[14394]: 2017-09-28 12:04:24.700 14394 ERROR nova     sock.listen(backlog)
Sep 28 12:04:24 ctl02 nova-api[14394]: 2017-09-28 12:04:24.700 14394 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:04:24 ctl02 nova-api[14394]: 2017-09-28 12:04:24.700 14394 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:04:24 ctl02 nova-api[14394]: 2017-09-28 12:04:24.700 14394 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:04:24 ctl02 nova-api[14394]: 2017-09-28 12:04:24.700 14394 ERROR nova
Sep 28 12:04:24 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:04:24 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:04:24 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:04:25 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:04:25 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:04:25 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:04:25 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:04:25 ctl02 glance-api[29183]: 2017-09-28 12:04:25.170 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:04:25] "OPTIONS / HTTP/1.0" 200 134 0.000834
Sep 28 12:04:25 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc8094f44)
Sep 28 12:04:25 ctl02 heat-api[13008]: 2017-09-28 12:04:25.718 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:04:25] "OPTIONS / HTTP/1.0" 200 134 0.000625
Sep 28 12:04:25 ctl02 heat-api[13008]: 2017-09-28 12:04:25.808 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:04:25] "OPTIONS / HTTP/1.0" 200 134 0.000670
Sep 28 12:04:26 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc8094f44)
Sep 28 12:04:26 ctl02 nova-api[14412]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:04:26 ctl02 nova-api[14412]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:04:26 ctl02 nova-api[14412]: 2017-09-28 12:04:26.968 14412 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:04:26 ctl02 nova-api[14412]: 2017-09-28 12:04:26.971 14412 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:04:26 ctl02 nova-api[14412]: 2017-09-28 12:04:26.971 14412 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:04:26 ctl02 nova-api[14412]: 2017-09-28 12:04:26.971 14412 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:04:26 ctl02 nova-api[14412]: 2017-09-28 12:04:26.971 14412 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:04:26 ctl02 nova-api[14412]: 2017-09-28 12:04:26.971 14412 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:04:26 ctl02 nova-api[14412]: 2017-09-28 12:04:26.971 14412 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:04:26 ctl02 nova-api[14412]: 2017-09-28 12:04:26.971 14412 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:04:26 ctl02 nova-api[14412]: 2017-09-28 12:04:26.971 14412 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:04:26 ctl02 nova-api[14412]: 2017-09-28 12:04:26.971 14412 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:04:26 ctl02 nova-api[14412]: 2017-09-28 12:04:26.971 14412 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:04:26 ctl02 nova-api[14412]: 2017-09-28 12:04:26.971 14412 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:04:26 ctl02 nova-api[14412]: 2017-09-28 12:04:26.971 14412 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:04:26 ctl02 nova-api[14412]: 2017-09-28 12:04:26.971 14412 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:04:26 ctl02 nova-api[14412]: 2017-09-28 12:04:26.971 14412 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:04:26 ctl02 nova-api[14412]: 2017-09-28 12:04:26.971 14412 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:04:26 ctl02 nova-api[14412]: 2017-09-28 12:04:26.971 14412 ERROR nova.wsgi     self.filename))
Sep 28 12:04:26 ctl02 nova-api[14412]: 2017-09-28 12:04:26.971 14412 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:04:26 ctl02 nova-api[14412]: 2017-09-28 12:04:26.971 14412 ERROR nova.wsgi
Sep 28 12:04:26 ctl02 nova-api[14412]: 2017-09-28 12:04:26.973 14412 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:04:27 ctl02 nova-api[14412]: 2017-09-28 12:04:27.100 14412 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:04:27 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:04:27 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:04:27 ctl02 nova-api[14412]: 2017-09-28 12:04:27.333 14412 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:04:27 ctl02 nova-api[14412]: 2017-09-28 12:04:27.336 14412 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:04:27 ctl02 nova-api[14412]: 2017-09-28 12:04:27.336 14412 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:04:27 ctl02 nova-api[14412]: 2017-09-28 12:04:27.336 14412 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:04:27 ctl02 nova-api[14412]: 2017-09-28 12:04:27.467 14412 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:04:27 ctl02 nova-api[14412]: 2017-09-28 12:04:27.469 14412 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:04:27 ctl02 nova-api[14412]: 2017-09-28 12:04:27.470 14412 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:04:27 ctl02 nova-api[14412]: 2017-09-28 12:04:27.470 14412 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:04:27 ctl02 nova-api[14412]: 2017-09-28 12:04:27.474 14412 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:04:27 ctl02 nova-api[14412]: 2017-09-28 12:04:27.474 14412 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:04:27 ctl02 nova-api[14412]: 2017-09-28 12:04:27.474 14412 ERROR nova Traceback (most recent call last):
Sep 28 12:04:27 ctl02 nova-api[14412]: 2017-09-28 12:04:27.474 14412 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:04:27 ctl02 nova-api[14412]: 2017-09-28 12:04:27.474 14412 ERROR nova     sys.exit(main())
Sep 28 12:04:27 ctl02 nova-api[14412]: 2017-09-28 12:04:27.474 14412 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:04:27 ctl02 nova-api[14412]: 2017-09-28 12:04:27.474 14412 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:04:27 ctl02 nova-api[14412]: 2017-09-28 12:04:27.474 14412 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:04:27 ctl02 nova-api[14412]: 2017-09-28 12:04:27.474 14412 ERROR nova     max_url_len=max_url_len)
Sep 28 12:04:27 ctl02 nova-api[14412]: 2017-09-28 12:04:27.474 14412 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:04:27 ctl02 nova-api[14412]: 2017-09-28 12:04:27.474 14412 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:04:27 ctl02 nova-api[14412]: 2017-09-28 12:04:27.474 14412 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:04:27 ctl02 nova-api[14412]: 2017-09-28 12:04:27.474 14412 ERROR nova     sock.listen(backlog)
Sep 28 12:04:27 ctl02 nova-api[14412]: 2017-09-28 12:04:27.474 14412 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:04:27 ctl02 nova-api[14412]: 2017-09-28 12:04:27.474 14412 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:04:27 ctl02 nova-api[14412]: 2017-09-28 12:04:27.474 14412 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:04:27 ctl02 nova-api[14412]: 2017-09-28 12:04:27.474 14412 ERROR nova
Sep 28 12:04:27 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:04:27 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:04:27 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:04:27 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:04:27 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:04:27 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:04:27 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:04:28 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:04:28.147 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:04:28] "OPTIONS / HTTP/1.0" 200 134 0.000461
Sep 28 12:04:28 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:04:28.438 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:04:28] "OPTIONS / HTTP/1.0" 200 134 0.000438
Sep 28 12:04:29 ctl02 heat-api-cfn[13300]: 2017-09-28 12:04:29.375 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:04:29] "OPTIONS / HTTP/1.0" 200 134 0.000573
Sep 28 12:04:29 ctl02 nova-api[14435]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:04:29 ctl02 nova-api[14435]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:04:29 ctl02 nova-api[14435]: 2017-09-28 12:04:29.719 14435 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:04:29 ctl02 nova-api[14435]: 2017-09-28 12:04:29.721 14435 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:04:29 ctl02 nova-api[14435]: 2017-09-28 12:04:29.721 14435 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:04:29 ctl02 nova-api[14435]: 2017-09-28 12:04:29.721 14435 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:04:29 ctl02 nova-api[14435]: 2017-09-28 12:04:29.721 14435 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:04:29 ctl02 nova-api[14435]: 2017-09-28 12:04:29.721 14435 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:04:29 ctl02 nova-api[14435]: 2017-09-28 12:04:29.721 14435 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:04:29 ctl02 nova-api[14435]: 2017-09-28 12:04:29.721 14435 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:04:29 ctl02 nova-api[14435]: 2017-09-28 12:04:29.721 14435 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:04:29 ctl02 nova-api[14435]: 2017-09-28 12:04:29.721 14435 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:04:29 ctl02 nova-api[14435]: 2017-09-28 12:04:29.721 14435 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:04:29 ctl02 nova-api[14435]: 2017-09-28 12:04:29.721 14435 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:04:29 ctl02 nova-api[14435]: 2017-09-28 12:04:29.721 14435 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:04:29 ctl02 nova-api[14435]: 2017-09-28 12:04:29.721 14435 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:04:29 ctl02 nova-api[14435]: 2017-09-28 12:04:29.721 14435 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:04:29 ctl02 nova-api[14435]: 2017-09-28 12:04:29.721 14435 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:04:29 ctl02 nova-api[14435]: 2017-09-28 12:04:29.721 14435 ERROR nova.wsgi     self.filename))
Sep 28 12:04:29 ctl02 nova-api[14435]: 2017-09-28 12:04:29.721 14435 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:04:29 ctl02 nova-api[14435]: 2017-09-28 12:04:29.721 14435 ERROR nova.wsgi
Sep 28 12:04:29 ctl02 nova-api[14435]: 2017-09-28 12:04:29.722 14435 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:04:29 ctl02 nova-consoleauth[5433]: 2017-09-28 12:04:29.840 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:04:29 ctl02 nova-api[14435]: 2017-09-28 12:04:29.861 14435 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:04:29 ctl02 heat-api-cfn[13300]: 2017-09-28 12:04:29.943 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:04:29] "OPTIONS / HTTP/1.0" 200 134 0.000523
Sep 28 12:04:29 ctl02 glance-api[29183]: 2017-09-28 12:04:29.945 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:04:29] "OPTIONS / HTTP/1.0" 200 134 0.000606
Sep 28 12:04:30 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:04:30.009 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:04:30] "OPTIONS / HTTP/1.0" 200 134 0.000486
Sep 28 12:04:30 ctl02 nova-api[14435]: 2017-09-28 12:04:30.112 14435 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:04:30 ctl02 nova-api[14435]: 2017-09-28 12:04:30.114 14435 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:04:30 ctl02 nova-api[14435]: 2017-09-28 12:04:30.115 14435 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:04:30 ctl02 nova-api[14435]: 2017-09-28 12:04:30.115 14435 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:04:30 ctl02 heat-api-cfn[13300]: 2017-09-28 12:04:30.238 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:04:30] "OPTIONS / HTTP/1.0" 200 134 0.000492
Sep 28 12:04:30 ctl02 nova-api[14435]: 2017-09-28 12:04:30.248 14435 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:04:30 ctl02 nova-api[14435]: 2017-09-28 12:04:30.250 14435 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:04:30 ctl02 nova-api[14435]: 2017-09-28 12:04:30.250 14435 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:04:30 ctl02 nova-api[14435]: 2017-09-28 12:04:30.250 14435 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:04:30 ctl02 nova-api[14435]: 2017-09-28 12:04:30.254 14435 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:04:30 ctl02 nova-api[14435]: 2017-09-28 12:04:30.254 14435 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:04:30 ctl02 nova-api[14435]: 2017-09-28 12:04:30.254 14435 ERROR nova Traceback (most recent call last):
Sep 28 12:04:30 ctl02 nova-api[14435]: 2017-09-28 12:04:30.254 14435 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:04:30 ctl02 nova-api[14435]: 2017-09-28 12:04:30.254 14435 ERROR nova     sys.exit(main())
Sep 28 12:04:30 ctl02 nova-api[14435]: 2017-09-28 12:04:30.254 14435 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:04:30 ctl02 nova-api[14435]: 2017-09-28 12:04:30.254 14435 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:04:30 ctl02 nova-api[14435]: 2017-09-28 12:04:30.254 14435 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:04:30 ctl02 nova-api[14435]: 2017-09-28 12:04:30.254 14435 ERROR nova     max_url_len=max_url_len)
Sep 28 12:04:30 ctl02 nova-api[14435]: 2017-09-28 12:04:30.254 14435 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:04:30 ctl02 nova-api[14435]: 2017-09-28 12:04:30.254 14435 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:04:30 ctl02 nova-api[14435]: 2017-09-28 12:04:30.254 14435 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:04:30 ctl02 nova-api[14435]: 2017-09-28 12:04:30.254 14435 ERROR nova     sock.listen(backlog)
Sep 28 12:04:30 ctl02 nova-api[14435]: 2017-09-28 12:04:30.254 14435 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:04:30 ctl02 nova-api[14435]: 2017-09-28 12:04:30.254 14435 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:04:30 ctl02 nova-api[14435]: 2017-09-28 12:04:30.254 14435 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:04:30 ctl02 nova-api[14435]: 2017-09-28 12:04:30.254 14435 ERROR nova
Sep 28 12:04:30 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:04:30 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:04:30 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:04:30 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:04:30 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:04:30 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:04:30 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:04:32 ctl02 nova-api[14453]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:04:32 ctl02 nova-api[14453]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:04:32 ctl02 nova-api[14453]: 2017-09-28 12:04:32.464 14453 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:04:32 ctl02 nova-api[14453]: 2017-09-28 12:04:32.466 14453 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:04:32 ctl02 nova-api[14453]: 2017-09-28 12:04:32.466 14453 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:04:32 ctl02 nova-api[14453]: 2017-09-28 12:04:32.466 14453 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:04:32 ctl02 nova-api[14453]: 2017-09-28 12:04:32.466 14453 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:04:32 ctl02 nova-api[14453]: 2017-09-28 12:04:32.466 14453 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:04:32 ctl02 nova-api[14453]: 2017-09-28 12:04:32.466 14453 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:04:32 ctl02 nova-api[14453]: 2017-09-28 12:04:32.466 14453 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:04:32 ctl02 nova-api[14453]: 2017-09-28 12:04:32.466 14453 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:04:32 ctl02 nova-api[14453]: 2017-09-28 12:04:32.466 14453 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:04:32 ctl02 nova-api[14453]: 2017-09-28 12:04:32.466 14453 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:04:32 ctl02 nova-api[14453]: 2017-09-28 12:04:32.466 14453 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:04:32 ctl02 nova-api[14453]: 2017-09-28 12:04:32.466 14453 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:04:32 ctl02 nova-api[14453]: 2017-09-28 12:04:32.466 14453 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:04:32 ctl02 nova-api[14453]: 2017-09-28 12:04:32.466 14453 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:04:32 ctl02 nova-api[14453]: 2017-09-28 12:04:32.466 14453 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:04:32 ctl02 nova-api[14453]: 2017-09-28 12:04:32.466 14453 ERROR nova.wsgi     self.filename))
Sep 28 12:04:32 ctl02 nova-api[14453]: 2017-09-28 12:04:32.466 14453 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:04:32 ctl02 nova-api[14453]: 2017-09-28 12:04:32.466 14453 ERROR nova.wsgi
Sep 28 12:04:32 ctl02 nova-api[14453]: 2017-09-28 12:04:32.467 14453 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:04:32 ctl02 nova-api[14453]: 2017-09-28 12:04:32.601 14453 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:04:32 ctl02 nova-api[14453]: 2017-09-28 12:04:32.839 14453 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:04:32 ctl02 nova-api[14453]: 2017-09-28 12:04:32.841 14453 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:04:32 ctl02 nova-api[14453]: 2017-09-28 12:04:32.842 14453 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:04:32 ctl02 nova-api[14453]: 2017-09-28 12:04:32.842 14453 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:04:32 ctl02 nova-scheduler[5620]: 2017-09-28 12:04:32.858 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:04:32 ctl02 nova-api[14453]: 2017-09-28 12:04:32.972 14453 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:04:32 ctl02 nova-api[14453]: 2017-09-28 12:04:32.974 14453 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:04:32 ctl02 nova-api[14453]: 2017-09-28 12:04:32.975 14453 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:04:32 ctl02 nova-api[14453]: 2017-09-28 12:04:32.975 14453 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:04:32 ctl02 nova-api[14453]: 2017-09-28 12:04:32.978 14453 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:04:32 ctl02 nova-api[14453]: 2017-09-28 12:04:32.979 14453 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:04:32 ctl02 nova-api[14453]: 2017-09-28 12:04:32.979 14453 ERROR nova Traceback (most recent call last):
Sep 28 12:04:32 ctl02 nova-api[14453]: 2017-09-28 12:04:32.979 14453 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:04:32 ctl02 nova-api[14453]: 2017-09-28 12:04:32.979 14453 ERROR nova     sys.exit(main())
Sep 28 12:04:32 ctl02 nova-api[14453]: 2017-09-28 12:04:32.979 14453 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:04:32 ctl02 nova-api[14453]: 2017-09-28 12:04:32.979 14453 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:04:32 ctl02 nova-api[14453]: 2017-09-28 12:04:32.979 14453 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:04:32 ctl02 nova-api[14453]: 2017-09-28 12:04:32.979 14453 ERROR nova     max_url_len=max_url_len)
Sep 28 12:04:32 ctl02 nova-api[14453]: 2017-09-28 12:04:32.979 14453 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:04:32 ctl02 nova-api[14453]: 2017-09-28 12:04:32.979 14453 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:04:32 ctl02 nova-api[14453]: 2017-09-28 12:04:32.979 14453 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:04:32 ctl02 nova-api[14453]: 2017-09-28 12:04:32.979 14453 ERROR nova     sock.listen(backlog)
Sep 28 12:04:32 ctl02 nova-api[14453]: 2017-09-28 12:04:32.979 14453 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:04:32 ctl02 nova-api[14453]: 2017-09-28 12:04:32.979 14453 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:04:32 ctl02 nova-api[14453]: 2017-09-28 12:04:32.979 14453 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:04:32 ctl02 nova-api[14453]: 2017-09-28 12:04:32.979 14453 ERROR nova
Sep 28 12:04:33 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:04:33 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:04:33 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:04:33 ctl02 glance-api[29183]: 2017-09-28 12:04:33.275 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:04:33] "OPTIONS / HTTP/1.0" 200 134 0.000936
Sep 28 12:04:33 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:04:33 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:04:33 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:04:33 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:04:33 ctl02 heat-api[13008]: 2017-09-28 12:04:33.967 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:04:33] "OPTIONS / HTTP/1.0" 200 134 0.000567
Sep 28 12:04:34 ctl02 glance-api[29183]: 2017-09-28 12:04:34.944 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:04:34] "OPTIONS / HTTP/1.0" 200 134 0.000672
Sep 28 12:04:35 ctl02 nova-api[14471]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:04:35 ctl02 nova-api[14471]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:04:35 ctl02 nova-api[14471]: 2017-09-28 12:04:35.186 14471 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:04:35 ctl02 nova-api[14471]: 2017-09-28 12:04:35.188 14471 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:04:35 ctl02 nova-api[14471]: 2017-09-28 12:04:35.188 14471 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:04:35 ctl02 nova-api[14471]: 2017-09-28 12:04:35.188 14471 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:04:35 ctl02 nova-api[14471]: 2017-09-28 12:04:35.188 14471 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:04:35 ctl02 nova-api[14471]: 2017-09-28 12:04:35.188 14471 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:04:35 ctl02 nova-api[14471]: 2017-09-28 12:04:35.188 14471 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:04:35 ctl02 nova-api[14471]: 2017-09-28 12:04:35.188 14471 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:04:35 ctl02 nova-api[14471]: 2017-09-28 12:04:35.188 14471 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:04:35 ctl02 nova-api[14471]: 2017-09-28 12:04:35.188 14471 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:04:35 ctl02 nova-api[14471]: 2017-09-28 12:04:35.188 14471 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:04:35 ctl02 nova-api[14471]: 2017-09-28 12:04:35.188 14471 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:04:35 ctl02 nova-api[14471]: 2017-09-28 12:04:35.188 14471 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:04:35 ctl02 nova-api[14471]: 2017-09-28 12:04:35.188 14471 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:04:35 ctl02 nova-api[14471]: 2017-09-28 12:04:35.188 14471 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:04:35 ctl02 nova-api[14471]: 2017-09-28 12:04:35.188 14471 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:04:35 ctl02 nova-api[14471]: 2017-09-28 12:04:35.188 14471 ERROR nova.wsgi     self.filename))
Sep 28 12:04:35 ctl02 nova-api[14471]: 2017-09-28 12:04:35.188 14471 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:04:35 ctl02 nova-api[14471]: 2017-09-28 12:04:35.188 14471 ERROR nova.wsgi
Sep 28 12:04:35 ctl02 nova-api[14471]: 2017-09-28 12:04:35.190 14471 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:04:35 ctl02 nova-api[14471]: 2017-09-28 12:04:35.321 14471 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:04:35 ctl02 nova-api[14471]: 2017-09-28 12:04:35.553 14471 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:04:35 ctl02 nova-api[14471]: 2017-09-28 12:04:35.556 14471 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:04:35 ctl02 nova-api[14471]: 2017-09-28 12:04:35.556 14471 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:04:35 ctl02 nova-api[14471]: 2017-09-28 12:04:35.557 14471 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:04:35 ctl02 heat-api[13008]: 2017-09-28 12:04:35.633 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:04:35] "OPTIONS / HTTP/1.0" 200 134 0.000550
Sep 28 12:04:35 ctl02 nova-api[14471]: 2017-09-28 12:04:35.689 14471 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:04:35 ctl02 nova-api[14471]: 2017-09-28 12:04:35.691 14471 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:04:35 ctl02 nova-api[14471]: 2017-09-28 12:04:35.691 14471 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:04:35 ctl02 nova-api[14471]: 2017-09-28 12:04:35.692 14471 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:04:35 ctl02 nova-api[14471]: 2017-09-28 12:04:35.695 14471 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:04:35 ctl02 nova-api[14471]: 2017-09-28 12:04:35.696 14471 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:04:35 ctl02 nova-api[14471]: 2017-09-28 12:04:35.696 14471 ERROR nova Traceback (most recent call last):
Sep 28 12:04:35 ctl02 nova-api[14471]: 2017-09-28 12:04:35.696 14471 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:04:35 ctl02 nova-api[14471]: 2017-09-28 12:04:35.696 14471 ERROR nova     sys.exit(main())
Sep 28 12:04:35 ctl02 nova-api[14471]: 2017-09-28 12:04:35.696 14471 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:04:35 ctl02 nova-api[14471]: 2017-09-28 12:04:35.696 14471 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:04:35 ctl02 nova-api[14471]: 2017-09-28 12:04:35.696 14471 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:04:35 ctl02 nova-api[14471]: 2017-09-28 12:04:35.696 14471 ERROR nova     max_url_len=max_url_len)
Sep 28 12:04:35 ctl02 nova-api[14471]: 2017-09-28 12:04:35.696 14471 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:04:35 ctl02 nova-api[14471]: 2017-09-28 12:04:35.696 14471 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:04:35 ctl02 nova-api[14471]: 2017-09-28 12:04:35.696 14471 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:04:35 ctl02 nova-api[14471]: 2017-09-28 12:04:35.696 14471 ERROR nova     sock.listen(backlog)
Sep 28 12:04:35 ctl02 nova-api[14471]: 2017-09-28 12:04:35.696 14471 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:04:35 ctl02 nova-api[14471]: 2017-09-28 12:04:35.696 14471 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:04:35 ctl02 nova-api[14471]: 2017-09-28 12:04:35.696 14471 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:04:35 ctl02 nova-api[14471]: 2017-09-28 12:04:35.696 14471 ERROR nova
Sep 28 12:04:35 ctl02 heat-api[13008]: 2017-09-28 12:04:35.707 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:04:35] "OPTIONS / HTTP/1.0" 200 134 0.000623
Sep 28 12:04:35 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:04:35 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:04:35 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:04:36 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:04:36 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:04:36 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:04:36 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:04:37 ctl02 nova-api[14489]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:04:37 ctl02 nova-api[14489]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:04:37 ctl02 nova-api[14489]: 2017-09-28 12:04:37.924 14489 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:04:37 ctl02 nova-api[14489]: 2017-09-28 12:04:37.925 14489 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:04:37 ctl02 nova-api[14489]: 2017-09-28 12:04:37.925 14489 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:04:37 ctl02 nova-api[14489]: 2017-09-28 12:04:37.925 14489 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:04:37 ctl02 nova-api[14489]: 2017-09-28 12:04:37.925 14489 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:04:37 ctl02 nova-api[14489]: 2017-09-28 12:04:37.925 14489 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:04:37 ctl02 nova-api[14489]: 2017-09-28 12:04:37.925 14489 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:04:37 ctl02 nova-api[14489]: 2017-09-28 12:04:37.925 14489 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:04:37 ctl02 nova-api[14489]: 2017-09-28 12:04:37.925 14489 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:04:37 ctl02 nova-api[14489]: 2017-09-28 12:04:37.925 14489 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:04:37 ctl02 nova-api[14489]: 2017-09-28 12:04:37.925 14489 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:04:37 ctl02 nova-api[14489]: 2017-09-28 12:04:37.925 14489 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:04:37 ctl02 nova-api[14489]: 2017-09-28 12:04:37.925 14489 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:04:37 ctl02 nova-api[14489]: 2017-09-28 12:04:37.925 14489 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:04:37 ctl02 nova-api[14489]: 2017-09-28 12:04:37.925 14489 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:04:37 ctl02 nova-api[14489]: 2017-09-28 12:04:37.925 14489 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:04:37 ctl02 nova-api[14489]: 2017-09-28 12:04:37.925 14489 ERROR nova.wsgi     self.filename))
Sep 28 12:04:37 ctl02 nova-api[14489]: 2017-09-28 12:04:37.925 14489 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:04:37 ctl02 nova-api[14489]: 2017-09-28 12:04:37.925 14489 ERROR nova.wsgi
Sep 28 12:04:37 ctl02 nova-api[14489]: 2017-09-28 12:04:37.926 14489 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:04:38 ctl02 nova-api[14489]: 2017-09-28 12:04:38.053 14489 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:04:38 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:04:38.268 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:04:38] "OPTIONS / HTTP/1.0" 200 134 0.000435
Sep 28 12:04:38 ctl02 nova-api[14489]: 2017-09-28 12:04:38.289 14489 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:04:38 ctl02 nova-api[14489]: 2017-09-28 12:04:38.292 14489 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:04:38 ctl02 nova-api[14489]: 2017-09-28 12:04:38.292 14489 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:04:38 ctl02 nova-api[14489]: 2017-09-28 12:04:38.292 14489 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:04:38 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:04:38.389 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:04:38] "OPTIONS / HTTP/1.0" 200 134 0.000418
Sep 28 12:04:38 ctl02 nova-api[14489]: 2017-09-28 12:04:38.435 14489 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:04:38 ctl02 nova-api[14489]: 2017-09-28 12:04:38.437 14489 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:04:38 ctl02 nova-api[14489]: 2017-09-28 12:04:38.447 14489 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:04:38 ctl02 nova-api[14489]: 2017-09-28 12:04:38.447 14489 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:04:38 ctl02 nova-api[14489]: 2017-09-28 12:04:38.451 14489 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:04:38 ctl02 nova-api[14489]: 2017-09-28 12:04:38.451 14489 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:04:38 ctl02 nova-api[14489]: 2017-09-28 12:04:38.451 14489 ERROR nova Traceback (most recent call last):
Sep 28 12:04:38 ctl02 nova-api[14489]: 2017-09-28 12:04:38.451 14489 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:04:38 ctl02 nova-api[14489]: 2017-09-28 12:04:38.451 14489 ERROR nova     sys.exit(main())
Sep 28 12:04:38 ctl02 nova-api[14489]: 2017-09-28 12:04:38.451 14489 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:04:38 ctl02 nova-api[14489]: 2017-09-28 12:04:38.451 14489 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:04:38 ctl02 nova-api[14489]: 2017-09-28 12:04:38.451 14489 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:04:38 ctl02 nova-api[14489]: 2017-09-28 12:04:38.451 14489 ERROR nova     max_url_len=max_url_len)
Sep 28 12:04:38 ctl02 nova-api[14489]: 2017-09-28 12:04:38.451 14489 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:04:38 ctl02 nova-api[14489]: 2017-09-28 12:04:38.451 14489 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:04:38 ctl02 nova-api[14489]: 2017-09-28 12:04:38.451 14489 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:04:38 ctl02 nova-api[14489]: 2017-09-28 12:04:38.451 14489 ERROR nova     sock.listen(backlog)
Sep 28 12:04:38 ctl02 nova-api[14489]: 2017-09-28 12:04:38.451 14489 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:04:38 ctl02 nova-api[14489]: 2017-09-28 12:04:38.451 14489 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:04:38 ctl02 nova-api[14489]: 2017-09-28 12:04:38.451 14489 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:04:38 ctl02 nova-api[14489]: 2017-09-28 12:04:38.451 14489 ERROR nova
Sep 28 12:04:38 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:04:38 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:04:38 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:04:38 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:04:38 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:04:38 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:04:38 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:04:39 ctl02 heat-api-cfn[13300]: 2017-09-28 12:04:39.319 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:04:39] "OPTIONS / HTTP/1.0" 200 134 0.000478
Sep 28 12:04:39 ctl02 heat-engine[12803]: 2017-09-28 12:04:39.362 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 28 seconds.
Sep 28 12:04:39 ctl02 heat-engine[12803]: 2017-09-28 12:04:39.402 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 28 seconds.
Sep 28 12:04:39 ctl02 heat-engine[12803]: 2017-09-28 12:04:39.420 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 28 seconds.
Sep 28 12:04:39 ctl02 heat-engine[12803]: 2017-09-28 12:04:39.425 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 28 seconds.
Sep 28 12:04:39 ctl02 glance-api[29183]: 2017-09-28 12:04:39.679 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:04:39] "OPTIONS / HTTP/1.0" 200 134 0.000586
Sep 28 12:04:39 ctl02 heat-api-cfn[13300]: 2017-09-28 12:04:39.964 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:04:39] "OPTIONS / HTTP/1.0" 200 134 0.000487
Sep 28 12:04:40 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:04:40.064 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:04:40] "OPTIONS / HTTP/1.0" 200 134 0.000498
Sep 28 12:04:40 ctl02 heat-api-cfn[13300]: 2017-09-28 12:04:40.494 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:04:40] "OPTIONS / HTTP/1.0" 200 134 0.000463
Sep 28 12:04:40 ctl02 nova-api[14507]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:04:40 ctl02 nova-api[14507]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:04:40 ctl02 nova-api[14507]: 2017-09-28 12:04:40.754 14507 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:04:40 ctl02 nova-api[14507]: 2017-09-28 12:04:40.756 14507 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:04:40 ctl02 nova-api[14507]: 2017-09-28 12:04:40.756 14507 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:04:40 ctl02 nova-api[14507]: 2017-09-28 12:04:40.756 14507 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:04:40 ctl02 nova-api[14507]: 2017-09-28 12:04:40.756 14507 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:04:40 ctl02 nova-api[14507]: 2017-09-28 12:04:40.756 14507 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:04:40 ctl02 nova-api[14507]: 2017-09-28 12:04:40.756 14507 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:04:40 ctl02 nova-api[14507]: 2017-09-28 12:04:40.756 14507 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:04:40 ctl02 nova-api[14507]: 2017-09-28 12:04:40.756 14507 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:04:40 ctl02 nova-api[14507]: 2017-09-28 12:04:40.756 14507 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:04:40 ctl02 nova-api[14507]: 2017-09-28 12:04:40.756 14507 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:04:40 ctl02 nova-api[14507]: 2017-09-28 12:04:40.756 14507 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:04:40 ctl02 nova-api[14507]: 2017-09-28 12:04:40.756 14507 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:04:40 ctl02 nova-api[14507]: 2017-09-28 12:04:40.756 14507 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:04:40 ctl02 nova-api[14507]: 2017-09-28 12:04:40.756 14507 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:04:40 ctl02 nova-api[14507]: 2017-09-28 12:04:40.756 14507 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:04:40 ctl02 nova-api[14507]: 2017-09-28 12:04:40.756 14507 ERROR nova.wsgi     self.filename))
Sep 28 12:04:40 ctl02 nova-api[14507]: 2017-09-28 12:04:40.756 14507 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:04:40 ctl02 nova-api[14507]: 2017-09-28 12:04:40.756 14507 ERROR nova.wsgi
Sep 28 12:04:40 ctl02 nova-api[14507]: 2017-09-28 12:04:40.757 14507 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:04:40 ctl02 nova-api[14507]: 2017-09-28 12:04:40.889 14507 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:04:41 ctl02 nova-api[14507]: 2017-09-28 12:04:41.131 14507 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:04:41 ctl02 nova-api[14507]: 2017-09-28 12:04:41.133 14507 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:04:41 ctl02 nova-api[14507]: 2017-09-28 12:04:41.133 14507 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:04:41 ctl02 nova-api[14507]: 2017-09-28 12:04:41.134 14507 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:04:41 ctl02 nova-api[14507]: 2017-09-28 12:04:41.266 14507 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:04:41 ctl02 nova-api[14507]: 2017-09-28 12:04:41.268 14507 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:04:41 ctl02 nova-api[14507]: 2017-09-28 12:04:41.268 14507 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:04:41 ctl02 nova-api[14507]: 2017-09-28 12:04:41.268 14507 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:04:41 ctl02 nova-api[14507]: 2017-09-28 12:04:41.272 14507 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:04:41 ctl02 nova-api[14507]: 2017-09-28 12:04:41.272 14507 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:04:41 ctl02 nova-api[14507]: 2017-09-28 12:04:41.272 14507 ERROR nova Traceback (most recent call last):
Sep 28 12:04:41 ctl02 nova-api[14507]: 2017-09-28 12:04:41.272 14507 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:04:41 ctl02 nova-api[14507]: 2017-09-28 12:04:41.272 14507 ERROR nova     sys.exit(main())
Sep 28 12:04:41 ctl02 nova-api[14507]: 2017-09-28 12:04:41.272 14507 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:04:41 ctl02 nova-api[14507]: 2017-09-28 12:04:41.272 14507 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:04:41 ctl02 nova-api[14507]: 2017-09-28 12:04:41.272 14507 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:04:41 ctl02 nova-api[14507]: 2017-09-28 12:04:41.272 14507 ERROR nova     max_url_len=max_url_len)
Sep 28 12:04:41 ctl02 nova-api[14507]: 2017-09-28 12:04:41.272 14507 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:04:41 ctl02 nova-api[14507]: 2017-09-28 12:04:41.272 14507 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:04:41 ctl02 nova-api[14507]: 2017-09-28 12:04:41.272 14507 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:04:41 ctl02 nova-api[14507]: 2017-09-28 12:04:41.272 14507 ERROR nova     sock.listen(backlog)
Sep 28 12:04:41 ctl02 nova-api[14507]: 2017-09-28 12:04:41.272 14507 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:04:41 ctl02 nova-api[14507]: 2017-09-28 12:04:41.272 14507 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:04:41 ctl02 nova-api[14507]: 2017-09-28 12:04:41.272 14507 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:04:41 ctl02 nova-api[14507]: 2017-09-28 12:04:41.272 14507 ERROR nova
Sep 28 12:04:41 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:04:41 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:04:41 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:04:41 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:04:41 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:04:41 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:04:41 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:04:43 ctl02 glance-api[29183]: 2017-09-28 12:04:43.147 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:04:43] "OPTIONS / HTTP/1.0" 200 134 0.000737
Sep 28 12:04:43 ctl02 nova-api[14526]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:04:43 ctl02 nova-api[14526]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:04:43 ctl02 nova-api[14526]: 2017-09-28 12:04:43.461 14526 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:04:43 ctl02 nova-api[14526]: 2017-09-28 12:04:43.463 14526 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:04:43 ctl02 nova-api[14526]: 2017-09-28 12:04:43.463 14526 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:04:43 ctl02 nova-api[14526]: 2017-09-28 12:04:43.463 14526 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:04:43 ctl02 nova-api[14526]: 2017-09-28 12:04:43.463 14526 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:04:43 ctl02 nova-api[14526]: 2017-09-28 12:04:43.463 14526 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:04:43 ctl02 nova-api[14526]: 2017-09-28 12:04:43.463 14526 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:04:43 ctl02 nova-api[14526]: 2017-09-28 12:04:43.463 14526 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:04:43 ctl02 nova-api[14526]: 2017-09-28 12:04:43.463 14526 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:04:43 ctl02 nova-api[14526]: 2017-09-28 12:04:43.463 14526 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:04:43 ctl02 nova-api[14526]: 2017-09-28 12:04:43.463 14526 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:04:43 ctl02 nova-api[14526]: 2017-09-28 12:04:43.463 14526 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:04:43 ctl02 nova-api[14526]: 2017-09-28 12:04:43.463 14526 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:04:43 ctl02 nova-api[14526]: 2017-09-28 12:04:43.463 14526 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:04:43 ctl02 nova-api[14526]: 2017-09-28 12:04:43.463 14526 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:04:43 ctl02 nova-api[14526]: 2017-09-28 12:04:43.463 14526 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:04:43 ctl02 nova-api[14526]: 2017-09-28 12:04:43.463 14526 ERROR nova.wsgi     self.filename))
Sep 28 12:04:43 ctl02 nova-api[14526]: 2017-09-28 12:04:43.463 14526 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:04:43 ctl02 nova-api[14526]: 2017-09-28 12:04:43.463 14526 ERROR nova.wsgi
Sep 28 12:04:43 ctl02 nova-api[14526]: 2017-09-28 12:04:43.475 14526 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:04:43 ctl02 nova-api[14526]: 2017-09-28 12:04:43.622 14526 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:04:43 ctl02 heat-api[13008]: 2017-09-28 12:04:43.864 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:04:43] "OPTIONS / HTTP/1.0" 200 134 0.000662
Sep 28 12:04:43 ctl02 nova-api[14526]: 2017-09-28 12:04:43.871 14526 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:04:43 ctl02 nova-api[14526]: 2017-09-28 12:04:43.873 14526 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:04:43 ctl02 nova-api[14526]: 2017-09-28 12:04:43.873 14526 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:04:43 ctl02 nova-api[14526]: 2017-09-28 12:04:43.874 14526 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:04:44 ctl02 nova-api[14526]: 2017-09-28 12:04:44.008 14526 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:04:44 ctl02 nova-api[14526]: 2017-09-28 12:04:44.011 14526 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:04:44 ctl02 nova-api[14526]: 2017-09-28 12:04:44.011 14526 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:04:44 ctl02 nova-api[14526]: 2017-09-28 12:04:44.011 14526 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:04:44 ctl02 nova-api[14526]: 2017-09-28 12:04:44.014 14526 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:04:44 ctl02 nova-api[14526]: 2017-09-28 12:04:44.015 14526 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:04:44 ctl02 nova-api[14526]: 2017-09-28 12:04:44.015 14526 ERROR nova Traceback (most recent call last):
Sep 28 12:04:44 ctl02 nova-api[14526]: 2017-09-28 12:04:44.015 14526 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:04:44 ctl02 nova-api[14526]: 2017-09-28 12:04:44.015 14526 ERROR nova     sys.exit(main())
Sep 28 12:04:44 ctl02 nova-api[14526]: 2017-09-28 12:04:44.015 14526 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:04:44 ctl02 nova-api[14526]: 2017-09-28 12:04:44.015 14526 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:04:44 ctl02 nova-api[14526]: 2017-09-28 12:04:44.015 14526 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:04:44 ctl02 nova-api[14526]: 2017-09-28 12:04:44.015 14526 ERROR nova     max_url_len=max_url_len)
Sep 28 12:04:44 ctl02 nova-api[14526]: 2017-09-28 12:04:44.015 14526 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:04:44 ctl02 nova-api[14526]: 2017-09-28 12:04:44.015 14526 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:04:44 ctl02 nova-api[14526]: 2017-09-28 12:04:44.015 14526 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:04:44 ctl02 nova-api[14526]: 2017-09-28 12:04:44.015 14526 ERROR nova     sock.listen(backlog)
Sep 28 12:04:44 ctl02 nova-api[14526]: 2017-09-28 12:04:44.015 14526 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:04:44 ctl02 nova-api[14526]: 2017-09-28 12:04:44.015 14526 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:04:44 ctl02 nova-api[14526]: 2017-09-28 12:04:44.015 14526 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:04:44 ctl02 nova-api[14526]: 2017-09-28 12:04:44.015 14526 ERROR nova
Sep 28 12:04:44 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:04:44 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:04:44 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:04:44 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:04:44 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:04:44 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:04:44 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:04:44 ctl02 glance-api[29183]: 2017-09-28 12:04:44.945 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:04:44] "OPTIONS / HTTP/1.0" 200 134 0.000616
Sep 28 12:04:45 ctl02 heat-api[13008]: 2017-09-28 12:04:45.773 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:04:45] "OPTIONS / HTTP/1.0" 200 134 0.000584
Sep 28 12:04:46 ctl02 nova-api[14544]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:04:46 ctl02 nova-api[14544]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:04:46 ctl02 heat-api[13008]: 2017-09-28 12:04:46.057 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:04:46] "OPTIONS / HTTP/1.0" 200 134 0.001183
Sep 28 12:04:46 ctl02 nova-api[14544]: 2017-09-28 12:04:46.230 14544 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:04:46 ctl02 nova-api[14544]: 2017-09-28 12:04:46.232 14544 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:04:46 ctl02 nova-api[14544]: 2017-09-28 12:04:46.232 14544 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:04:46 ctl02 nova-api[14544]: 2017-09-28 12:04:46.232 14544 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:04:46 ctl02 nova-api[14544]: 2017-09-28 12:04:46.232 14544 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:04:46 ctl02 nova-api[14544]: 2017-09-28 12:04:46.232 14544 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:04:46 ctl02 nova-api[14544]: 2017-09-28 12:04:46.232 14544 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:04:46 ctl02 nova-api[14544]: 2017-09-28 12:04:46.232 14544 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:04:46 ctl02 nova-api[14544]: 2017-09-28 12:04:46.232 14544 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:04:46 ctl02 nova-api[14544]: 2017-09-28 12:04:46.232 14544 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:04:46 ctl02 nova-api[14544]: 2017-09-28 12:04:46.232 14544 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:04:46 ctl02 nova-api[14544]: 2017-09-28 12:04:46.232 14544 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:04:46 ctl02 nova-api[14544]: 2017-09-28 12:04:46.232 14544 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:04:46 ctl02 nova-api[14544]: 2017-09-28 12:04:46.232 14544 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:04:46 ctl02 nova-api[14544]: 2017-09-28 12:04:46.232 14544 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:04:46 ctl02 nova-api[14544]: 2017-09-28 12:04:46.232 14544 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:04:46 ctl02 nova-api[14544]: 2017-09-28 12:04:46.232 14544 ERROR nova.wsgi     self.filename))
Sep 28 12:04:46 ctl02 nova-api[14544]: 2017-09-28 12:04:46.232 14544 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:04:46 ctl02 nova-api[14544]: 2017-09-28 12:04:46.232 14544 ERROR nova.wsgi
Sep 28 12:04:46 ctl02 nova-api[14544]: 2017-09-28 12:04:46.233 14544 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:04:46 ctl02 nova-api[14544]: 2017-09-28 12:04:46.364 14544 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:04:46 ctl02 nova-api[14544]: 2017-09-28 12:04:46.606 14544 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:04:46 ctl02 nova-api[14544]: 2017-09-28 12:04:46.608 14544 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:04:46 ctl02 nova-api[14544]: 2017-09-28 12:04:46.608 14544 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:04:46 ctl02 nova-api[14544]: 2017-09-28 12:04:46.609 14544 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:04:46 ctl02 nova-api[14544]: 2017-09-28 12:04:46.741 14544 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:04:46 ctl02 nova-api[14544]: 2017-09-28 12:04:46.743 14544 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:04:46 ctl02 nova-api[14544]: 2017-09-28 12:04:46.743 14544 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:04:46 ctl02 nova-api[14544]: 2017-09-28 12:04:46.743 14544 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:04:46 ctl02 nova-api[14544]: 2017-09-28 12:04:46.747 14544 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:04:46 ctl02 nova-api[14544]: 2017-09-28 12:04:46.747 14544 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:04:46 ctl02 nova-api[14544]: 2017-09-28 12:04:46.747 14544 ERROR nova Traceback (most recent call last):
Sep 28 12:04:46 ctl02 nova-api[14544]: 2017-09-28 12:04:46.747 14544 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:04:46 ctl02 nova-api[14544]: 2017-09-28 12:04:46.747 14544 ERROR nova     sys.exit(main())
Sep 28 12:04:46 ctl02 nova-api[14544]: 2017-09-28 12:04:46.747 14544 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:04:46 ctl02 nova-api[14544]: 2017-09-28 12:04:46.747 14544 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:04:46 ctl02 nova-api[14544]: 2017-09-28 12:04:46.747 14544 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:04:46 ctl02 nova-api[14544]: 2017-09-28 12:04:46.747 14544 ERROR nova     max_url_len=max_url_len)
Sep 28 12:04:46 ctl02 nova-api[14544]: 2017-09-28 12:04:46.747 14544 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:04:46 ctl02 nova-api[14544]: 2017-09-28 12:04:46.747 14544 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:04:46 ctl02 nova-api[14544]: 2017-09-28 12:04:46.747 14544 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:04:46 ctl02 nova-api[14544]: 2017-09-28 12:04:46.747 14544 ERROR nova     sock.listen(backlog)
Sep 28 12:04:46 ctl02 nova-api[14544]: 2017-09-28 12:04:46.747 14544 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:04:46 ctl02 nova-api[14544]: 2017-09-28 12:04:46.747 14544 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:04:46 ctl02 nova-api[14544]: 2017-09-28 12:04:46.747 14544 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:04:46 ctl02 nova-api[14544]: 2017-09-28 12:04:46.747 14544 ERROR nova
Sep 28 12:04:46 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:04:46 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:04:46 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:04:47 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:04:47 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:04:47 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:04:47 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:04:48 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:04:48.131 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:04:48] "OPTIONS / HTTP/1.0" 200 134 0.000421
Sep 28 12:04:48 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:04:48.231 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:04:48] "OPTIONS / HTTP/1.0" 200 134 0.000319
Sep 28 12:04:48 ctl02 nova-api[14562]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:04:48 ctl02 nova-api[14562]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:04:48 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x22abbb5c)
Sep 28 12:04:48 ctl02 nova-api[14562]: 2017-09-28 12:04:48.958 14562 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:04:48 ctl02 nova-api[14562]: 2017-09-28 12:04:48.960 14562 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:04:48 ctl02 nova-api[14562]: 2017-09-28 12:04:48.960 14562 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:04:48 ctl02 nova-api[14562]: 2017-09-28 12:04:48.960 14562 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:04:48 ctl02 nova-api[14562]: 2017-09-28 12:04:48.960 14562 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:04:48 ctl02 nova-api[14562]: 2017-09-28 12:04:48.960 14562 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:04:48 ctl02 nova-api[14562]: 2017-09-28 12:04:48.960 14562 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:04:48 ctl02 nova-api[14562]: 2017-09-28 12:04:48.960 14562 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:04:48 ctl02 nova-api[14562]: 2017-09-28 12:04:48.960 14562 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:04:48 ctl02 nova-api[14562]: 2017-09-28 12:04:48.960 14562 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:04:48 ctl02 nova-api[14562]: 2017-09-28 12:04:48.960 14562 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:04:48 ctl02 nova-api[14562]: 2017-09-28 12:04:48.960 14562 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:04:48 ctl02 nova-api[14562]: 2017-09-28 12:04:48.960 14562 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:04:48 ctl02 nova-api[14562]: 2017-09-28 12:04:48.960 14562 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:04:48 ctl02 nova-api[14562]: 2017-09-28 12:04:48.960 14562 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:04:48 ctl02 nova-api[14562]: 2017-09-28 12:04:48.960 14562 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:04:48 ctl02 nova-api[14562]: 2017-09-28 12:04:48.960 14562 ERROR nova.wsgi     self.filename))
Sep 28 12:04:48 ctl02 nova-api[14562]: 2017-09-28 12:04:48.960 14562 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:04:48 ctl02 nova-api[14562]: 2017-09-28 12:04:48.960 14562 ERROR nova.wsgi
Sep 28 12:04:48 ctl02 nova-api[14562]: 2017-09-28 12:04:48.961 14562 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:04:49 ctl02 nova-api[14562]: 2017-09-28 12:04:49.090 14562 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:04:49 ctl02 nova-api[14562]: 2017-09-28 12:04:49.323 14562 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:04:49 ctl02 nova-api[14562]: 2017-09-28 12:04:49.325 14562 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:04:49 ctl02 nova-api[14562]: 2017-09-28 12:04:49.325 14562 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:04:49 ctl02 nova-api[14562]: 2017-09-28 12:04:49.325 14562 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:04:49 ctl02 glance-api[29183]: 2017-09-28 12:04:49.458 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:04:49] "OPTIONS / HTTP/1.0" 200 134 0.000631
Sep 28 12:04:49 ctl02 nova-api[14562]: 2017-09-28 12:04:49.457 14562 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:04:49 ctl02 nova-api[14562]: 2017-09-28 12:04:49.460 14562 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:04:49 ctl02 nova-api[14562]: 2017-09-28 12:04:49.460 14562 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:04:49 ctl02 nova-api[14562]: 2017-09-28 12:04:49.460 14562 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:04:49 ctl02 nova-api[14562]: 2017-09-28 12:04:49.464 14562 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:04:49 ctl02 nova-api[14562]: 2017-09-28 12:04:49.464 14562 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:04:49 ctl02 nova-api[14562]: 2017-09-28 12:04:49.464 14562 ERROR nova Traceback (most recent call last):
Sep 28 12:04:49 ctl02 nova-api[14562]: 2017-09-28 12:04:49.464 14562 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:04:49 ctl02 nova-api[14562]: 2017-09-28 12:04:49.464 14562 ERROR nova     sys.exit(main())
Sep 28 12:04:49 ctl02 nova-api[14562]: 2017-09-28 12:04:49.464 14562 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:04:49 ctl02 nova-api[14562]: 2017-09-28 12:04:49.464 14562 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:04:49 ctl02 nova-api[14562]: 2017-09-28 12:04:49.464 14562 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:04:49 ctl02 nova-api[14562]: 2017-09-28 12:04:49.464 14562 ERROR nova     max_url_len=max_url_len)
Sep 28 12:04:49 ctl02 nova-api[14562]: 2017-09-28 12:04:49.464 14562 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:04:49 ctl02 nova-api[14562]: 2017-09-28 12:04:49.464 14562 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:04:49 ctl02 nova-api[14562]: 2017-09-28 12:04:49.464 14562 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:04:49 ctl02 nova-api[14562]: 2017-09-28 12:04:49.464 14562 ERROR nova     sock.listen(backlog)
Sep 28 12:04:49 ctl02 nova-api[14562]: 2017-09-28 12:04:49.464 14562 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:04:49 ctl02 nova-api[14562]: 2017-09-28 12:04:49.464 14562 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:04:49 ctl02 nova-api[14562]: 2017-09-28 12:04:49.464 14562 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:04:49 ctl02 nova-api[14562]: 2017-09-28 12:04:49.464 14562 ERROR nova
Sep 28 12:04:49 ctl02 heat-api-cfn[13300]: 2017-09-28 12:04:49.471 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:04:49] "OPTIONS / HTTP/1.0" 200 134 0.000574
Sep 28 12:04:49 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:04:49 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:04:49 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:04:49 ctl02 heat-api-cfn[13300]: 2017-09-28 12:04:49.802 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:04:49] "OPTIONS / HTTP/1.0" 200 134 0.000693
Sep 28 12:04:49 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x22abbb5c)
Sep 28 12:04:49 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:04:49 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:04:49 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:04:49.885 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:04:49] "OPTIONS / HTTP/1.0" 200 134 0.000575
Sep 28 12:04:49 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:04:49 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:04:50 ctl02 heat-api-cfn[13300]: 2017-09-28 12:04:50.467 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:04:50] "OPTIONS / HTTP/1.0" 200 134 0.000533
Sep 28 12:04:50 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x22abbb5c)
Sep 28 12:04:51 ctl02 nova-api[14580]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:04:51 ctl02 nova-api[14580]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:04:51 ctl02 nova-api[14580]: 2017-09-28 12:04:51.699 14580 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:04:51 ctl02 nova-api[14580]: 2017-09-28 12:04:51.701 14580 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:04:51 ctl02 nova-api[14580]: 2017-09-28 12:04:51.701 14580 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:04:51 ctl02 nova-api[14580]: 2017-09-28 12:04:51.701 14580 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:04:51 ctl02 nova-api[14580]: 2017-09-28 12:04:51.701 14580 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:04:51 ctl02 nova-api[14580]: 2017-09-28 12:04:51.701 14580 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:04:51 ctl02 nova-api[14580]: 2017-09-28 12:04:51.701 14580 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:04:51 ctl02 nova-api[14580]: 2017-09-28 12:04:51.701 14580 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:04:51 ctl02 nova-api[14580]: 2017-09-28 12:04:51.701 14580 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:04:51 ctl02 nova-api[14580]: 2017-09-28 12:04:51.701 14580 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:04:51 ctl02 nova-api[14580]: 2017-09-28 12:04:51.701 14580 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:04:51 ctl02 nova-api[14580]: 2017-09-28 12:04:51.701 14580 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:04:51 ctl02 nova-api[14580]: 2017-09-28 12:04:51.701 14580 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:04:51 ctl02 nova-api[14580]: 2017-09-28 12:04:51.701 14580 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:04:51 ctl02 nova-api[14580]: 2017-09-28 12:04:51.701 14580 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:04:51 ctl02 nova-api[14580]: 2017-09-28 12:04:51.701 14580 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:04:51 ctl02 nova-api[14580]: 2017-09-28 12:04:51.701 14580 ERROR nova.wsgi     self.filename))
Sep 28 12:04:51 ctl02 nova-api[14580]: 2017-09-28 12:04:51.701 14580 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:04:51 ctl02 nova-api[14580]: 2017-09-28 12:04:51.701 14580 ERROR nova.wsgi
Sep 28 12:04:51 ctl02 nova-api[14580]: 2017-09-28 12:04:51.702 14580 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:04:51 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x22abbb5c)
Sep 28 12:04:51 ctl02 nova-api[14580]: 2017-09-28 12:04:51.834 14580 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:04:51 ctl02 nova-cert[4860]: 2017-09-28 12:04:51.984 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:04:52 ctl02 nova-api[14580]: 2017-09-28 12:04:52.071 14580 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:04:52 ctl02 nova-api[14580]: 2017-09-28 12:04:52.073 14580 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:04:52 ctl02 nova-api[14580]: 2017-09-28 12:04:52.074 14580 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:04:52 ctl02 nova-api[14580]: 2017-09-28 12:04:52.074 14580 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:04:52 ctl02 nova-api[14580]: 2017-09-28 12:04:52.206 14580 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:04:52 ctl02 nova-api[14580]: 2017-09-28 12:04:52.208 14580 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:04:52 ctl02 nova-api[14580]: 2017-09-28 12:04:52.208 14580 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:04:52 ctl02 nova-api[14580]: 2017-09-28 12:04:52.208 14580 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:04:52 ctl02 nova-api[14580]: 2017-09-28 12:04:52.211 14580 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:04:52 ctl02 nova-api[14580]: 2017-09-28 12:04:52.212 14580 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:04:52 ctl02 nova-api[14580]: 2017-09-28 12:04:52.212 14580 ERROR nova Traceback (most recent call last):
Sep 28 12:04:52 ctl02 nova-api[14580]: 2017-09-28 12:04:52.212 14580 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:04:52 ctl02 nova-api[14580]: 2017-09-28 12:04:52.212 14580 ERROR nova     sys.exit(main())
Sep 28 12:04:52 ctl02 nova-api[14580]: 2017-09-28 12:04:52.212 14580 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:04:52 ctl02 nova-api[14580]: 2017-09-28 12:04:52.212 14580 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:04:52 ctl02 nova-api[14580]: 2017-09-28 12:04:52.212 14580 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:04:52 ctl02 nova-api[14580]: 2017-09-28 12:04:52.212 14580 ERROR nova     max_url_len=max_url_len)
Sep 28 12:04:52 ctl02 nova-api[14580]: 2017-09-28 12:04:52.212 14580 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:04:52 ctl02 nova-api[14580]: 2017-09-28 12:04:52.212 14580 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:04:52 ctl02 nova-api[14580]: 2017-09-28 12:04:52.212 14580 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:04:52 ctl02 nova-api[14580]: 2017-09-28 12:04:52.212 14580 ERROR nova     sock.listen(backlog)
Sep 28 12:04:52 ctl02 nova-api[14580]: 2017-09-28 12:04:52.212 14580 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:04:52 ctl02 nova-api[14580]: 2017-09-28 12:04:52.212 14580 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:04:52 ctl02 nova-api[14580]: 2017-09-28 12:04:52.212 14580 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:04:52 ctl02 nova-api[14580]: 2017-09-28 12:04:52.212 14580 ERROR nova
Sep 28 12:04:52 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:04:52 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:04:52 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:04:52 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:04:52 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:04:52 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:04:52 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:04:52 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x22abbb5c)
Sep 28 12:04:53 ctl02 glance-api[29183]: 2017-09-28 12:04:53.318 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:04:53] "OPTIONS / HTTP/1.0" 200 134 0.000573
Sep 28 12:04:53 ctl02 heat-api[13008]: 2017-09-28 12:04:53.710 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:04:53] "OPTIONS / HTTP/1.0" 200 134 0.000597
Sep 28 12:04:53 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x22abbb5c)
Sep 28 12:04:54 ctl02 nova-api[14598]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:04:54 ctl02 nova-api[14598]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:04:54 ctl02 nova-conductor[5056]: 2017-09-28 12:04:54.305 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:04:54 ctl02 nova-conductor[5056]: 2017-09-28 12:04:54.331 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:04:54 ctl02 nova-conductor[5056]: 2017-09-28 12:04:54.338 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:04:54 ctl02 nova-conductor[5056]: 2017-09-28 12:04:54.342 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:04:54 ctl02 nova-api[14598]: 2017-09-28 12:04:54.455 14598 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:04:54 ctl02 nova-api[14598]: 2017-09-28 12:04:54.457 14598 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:04:54 ctl02 nova-api[14598]: 2017-09-28 12:04:54.457 14598 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:04:54 ctl02 nova-api[14598]: 2017-09-28 12:04:54.457 14598 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:04:54 ctl02 nova-api[14598]: 2017-09-28 12:04:54.457 14598 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:04:54 ctl02 nova-api[14598]: 2017-09-28 12:04:54.457 14598 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:04:54 ctl02 nova-api[14598]: 2017-09-28 12:04:54.457 14598 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:04:54 ctl02 nova-api[14598]: 2017-09-28 12:04:54.457 14598 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:04:54 ctl02 nova-api[14598]: 2017-09-28 12:04:54.457 14598 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:04:54 ctl02 nova-api[14598]: 2017-09-28 12:04:54.457 14598 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:04:54 ctl02 nova-api[14598]: 2017-09-28 12:04:54.457 14598 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:04:54 ctl02 nova-api[14598]: 2017-09-28 12:04:54.457 14598 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:04:54 ctl02 nova-api[14598]: 2017-09-28 12:04:54.457 14598 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:04:54 ctl02 nova-api[14598]: 2017-09-28 12:04:54.457 14598 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:04:54 ctl02 nova-api[14598]: 2017-09-28 12:04:54.457 14598 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:04:54 ctl02 nova-api[14598]: 2017-09-28 12:04:54.457 14598 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:04:54 ctl02 nova-api[14598]: 2017-09-28 12:04:54.457 14598 ERROR nova.wsgi     self.filename))
Sep 28 12:04:54 ctl02 nova-api[14598]: 2017-09-28 12:04:54.457 14598 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:04:54 ctl02 nova-api[14598]: 2017-09-28 12:04:54.457 14598 ERROR nova.wsgi
Sep 28 12:04:54 ctl02 nova-api[14598]: 2017-09-28 12:04:54.460 14598 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:04:54 ctl02 nova-api[14598]: 2017-09-28 12:04:54.587 14598 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:04:54 ctl02 nova-api[14598]: 2017-09-28 12:04:54.819 14598 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:04:54 ctl02 nova-api[14598]: 2017-09-28 12:04:54.822 14598 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:04:54 ctl02 nova-api[14598]: 2017-09-28 12:04:54.822 14598 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:04:54 ctl02 nova-api[14598]: 2017-09-28 12:04:54.822 14598 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:04:54 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x22abbb5c)
Sep 28 12:04:54 ctl02 nova-api[14598]: 2017-09-28 12:04:54.953 14598 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:04:54 ctl02 nova-api[14598]: 2017-09-28 12:04:54.955 14598 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:04:54 ctl02 nova-api[14598]: 2017-09-28 12:04:54.955 14598 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:04:54 ctl02 nova-api[14598]: 2017-09-28 12:04:54.955 14598 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:04:54 ctl02 nova-api[14598]: 2017-09-28 12:04:54.959 14598 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:04:54 ctl02 nova-api[14598]: 2017-09-28 12:04:54.959 14598 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:04:54 ctl02 nova-api[14598]: 2017-09-28 12:04:54.959 14598 ERROR nova Traceback (most recent call last):
Sep 28 12:04:54 ctl02 nova-api[14598]: 2017-09-28 12:04:54.959 14598 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:04:54 ctl02 nova-api[14598]: 2017-09-28 12:04:54.959 14598 ERROR nova     sys.exit(main())
Sep 28 12:04:54 ctl02 nova-api[14598]: 2017-09-28 12:04:54.959 14598 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:04:54 ctl02 nova-api[14598]: 2017-09-28 12:04:54.959 14598 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:04:54 ctl02 nova-api[14598]: 2017-09-28 12:04:54.959 14598 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:04:54 ctl02 nova-api[14598]: 2017-09-28 12:04:54.959 14598 ERROR nova     max_url_len=max_url_len)
Sep 28 12:04:54 ctl02 nova-api[14598]: 2017-09-28 12:04:54.959 14598 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:04:54 ctl02 nova-api[14598]: 2017-09-28 12:04:54.959 14598 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:04:54 ctl02 nova-api[14598]: 2017-09-28 12:04:54.959 14598 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:04:54 ctl02 nova-api[14598]: 2017-09-28 12:04:54.959 14598 ERROR nova     sock.listen(backlog)
Sep 28 12:04:54 ctl02 nova-api[14598]: 2017-09-28 12:04:54.959 14598 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:04:54 ctl02 nova-api[14598]: 2017-09-28 12:04:54.959 14598 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:04:54 ctl02 nova-api[14598]: 2017-09-28 12:04:54.959 14598 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:04:54 ctl02 nova-api[14598]: 2017-09-28 12:04:54.959 14598 ERROR nova
Sep 28 12:04:54 ctl02 glance-api[29183]: 2017-09-28 12:04:54.985 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:04:54] "OPTIONS / HTTP/1.0" 200 134 0.000591
Sep 28 12:04:55 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:04:55 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:04:55 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:04:55 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:04:55 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:04:55 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:04:55 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:04:55 ctl02 heat-api[13008]: 2017-09-28 12:04:55.562 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:04:55] "OPTIONS / HTTP/1.0" 200 134 0.000631
Sep 28 12:04:55 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x22abbb5c)
Sep 28 12:04:55 ctl02 heat-api[13008]: 2017-09-28 12:04:55.876 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:04:55] "OPTIONS / HTTP/1.0" 200 134 0.000684
Sep 28 12:04:56 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x22abbb5c)
Sep 28 12:04:57 ctl02 nova-api[14616]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:04:57 ctl02 nova-api[14616]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:04:57 ctl02 nova-api[14616]: 2017-09-28 12:04:57.193 14616 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:04:57 ctl02 nova-api[14616]: 2017-09-28 12:04:57.195 14616 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:04:57 ctl02 nova-api[14616]: 2017-09-28 12:04:57.195 14616 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:04:57 ctl02 nova-api[14616]: 2017-09-28 12:04:57.195 14616 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:04:57 ctl02 nova-api[14616]: 2017-09-28 12:04:57.195 14616 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:04:57 ctl02 nova-api[14616]: 2017-09-28 12:04:57.195 14616 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:04:57 ctl02 nova-api[14616]: 2017-09-28 12:04:57.195 14616 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:04:57 ctl02 nova-api[14616]: 2017-09-28 12:04:57.195 14616 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:04:57 ctl02 nova-api[14616]: 2017-09-28 12:04:57.195 14616 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:04:57 ctl02 nova-api[14616]: 2017-09-28 12:04:57.195 14616 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:04:57 ctl02 nova-api[14616]: 2017-09-28 12:04:57.195 14616 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:04:57 ctl02 nova-api[14616]: 2017-09-28 12:04:57.195 14616 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:04:57 ctl02 nova-api[14616]: 2017-09-28 12:04:57.195 14616 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:04:57 ctl02 nova-api[14616]: 2017-09-28 12:04:57.195 14616 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:04:57 ctl02 nova-api[14616]: 2017-09-28 12:04:57.195 14616 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:04:57 ctl02 nova-api[14616]: 2017-09-28 12:04:57.195 14616 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:04:57 ctl02 nova-api[14616]: 2017-09-28 12:04:57.195 14616 ERROR nova.wsgi     self.filename))
Sep 28 12:04:57 ctl02 nova-api[14616]: 2017-09-28 12:04:57.195 14616 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:04:57 ctl02 nova-api[14616]: 2017-09-28 12:04:57.195 14616 ERROR nova.wsgi
Sep 28 12:04:57 ctl02 nova-api[14616]: 2017-09-28 12:04:57.197 14616 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:04:57 ctl02 nova-api[14616]: 2017-09-28 12:04:57.328 14616 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:04:57 ctl02 nova-api[14616]: 2017-09-28 12:04:57.556 14616 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:04:57 ctl02 nova-api[14616]: 2017-09-28 12:04:57.559 14616 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:04:57 ctl02 nova-api[14616]: 2017-09-28 12:04:57.560 14616 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:04:57 ctl02 nova-api[14616]: 2017-09-28 12:04:57.560 14616 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:04:57 ctl02 nova-api[14616]: 2017-09-28 12:04:57.691 14616 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:04:57 ctl02 nova-api[14616]: 2017-09-28 12:04:57.693 14616 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:04:57 ctl02 nova-api[14616]: 2017-09-28 12:04:57.694 14616 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:04:57 ctl02 nova-api[14616]: 2017-09-28 12:04:57.694 14616 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:04:57 ctl02 nova-api[14616]: 2017-09-28 12:04:57.698 14616 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:04:57 ctl02 nova-api[14616]: 2017-09-28 12:04:57.698 14616 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:04:57 ctl02 nova-api[14616]: 2017-09-28 12:04:57.698 14616 ERROR nova Traceback (most recent call last):
Sep 28 12:04:57 ctl02 nova-api[14616]: 2017-09-28 12:04:57.698 14616 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:04:57 ctl02 nova-api[14616]: 2017-09-28 12:04:57.698 14616 ERROR nova     sys.exit(main())
Sep 28 12:04:57 ctl02 nova-api[14616]: 2017-09-28 12:04:57.698 14616 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:04:57 ctl02 nova-api[14616]: 2017-09-28 12:04:57.698 14616 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:04:57 ctl02 nova-api[14616]: 2017-09-28 12:04:57.698 14616 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:04:57 ctl02 nova-api[14616]: 2017-09-28 12:04:57.698 14616 ERROR nova     max_url_len=max_url_len)
Sep 28 12:04:57 ctl02 nova-api[14616]: 2017-09-28 12:04:57.698 14616 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:04:57 ctl02 nova-api[14616]: 2017-09-28 12:04:57.698 14616 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:04:57 ctl02 nova-api[14616]: 2017-09-28 12:04:57.698 14616 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:04:57 ctl02 nova-api[14616]: 2017-09-28 12:04:57.698 14616 ERROR nova     sock.listen(backlog)
Sep 28 12:04:57 ctl02 nova-api[14616]: 2017-09-28 12:04:57.698 14616 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:04:57 ctl02 nova-api[14616]: 2017-09-28 12:04:57.698 14616 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:04:57 ctl02 nova-api[14616]: 2017-09-28 12:04:57.698 14616 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:04:57 ctl02 nova-api[14616]: 2017-09-28 12:04:57.698 14616 ERROR nova
Sep 28 12:04:57 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x22abbb5c)
Sep 28 12:04:57 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:04:57 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:04:57 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:04:58 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:04:58 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:04:58 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:04:58 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:04:58 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:04:58.334 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:04:58] "OPTIONS / HTTP/1.0" 200 134 0.000496
Sep 28 12:04:58 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:04:58.613 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:04:58] "OPTIONS / HTTP/1.0" 200 134 0.000472
Sep 28 12:04:58 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x22abbb5c)
Sep 28 12:04:59 ctl02 heat-api-cfn[13300]: 2017-09-28 12:04:59.148 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:04:59] "OPTIONS / HTTP/1.0" 200 134 0.000445
Sep 28 12:04:59 ctl02 glance-api[29183]: 2017-09-28 12:04:59.558 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:04:59] "OPTIONS / HTTP/1.0" 200 134 0.001083
Sep 28 12:04:59 ctl02 nova-api[14634]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:04:59 ctl02 nova-api[14634]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:04:59 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:04:59 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:04:59 ctl02 heat-api-cfn[13300]: 2017-09-28 12:04:59.957 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:04:59] "OPTIONS / HTTP/1.0" 200 134 0.000497
Sep 28 12:04:59 ctl02 nova-api[14634]: 2017-09-28 12:04:59.975 14634 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:04:59 ctl02 nova-api[14634]: 2017-09-28 12:04:59.977 14634 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:04:59 ctl02 nova-api[14634]: 2017-09-28 12:04:59.977 14634 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:04:59 ctl02 nova-api[14634]: 2017-09-28 12:04:59.977 14634 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:04:59 ctl02 nova-api[14634]: 2017-09-28 12:04:59.977 14634 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:04:59 ctl02 nova-api[14634]: 2017-09-28 12:04:59.977 14634 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:04:59 ctl02 nova-api[14634]: 2017-09-28 12:04:59.977 14634 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:04:59 ctl02 nova-api[14634]: 2017-09-28 12:04:59.977 14634 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:04:59 ctl02 nova-api[14634]: 2017-09-28 12:04:59.977 14634 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:04:59 ctl02 nova-api[14634]: 2017-09-28 12:04:59.977 14634 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:04:59 ctl02 nova-api[14634]: 2017-09-28 12:04:59.977 14634 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:04:59 ctl02 nova-api[14634]: 2017-09-28 12:04:59.977 14634 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:04:59 ctl02 nova-api[14634]: 2017-09-28 12:04:59.977 14634 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:04:59 ctl02 nova-api[14634]: 2017-09-28 12:04:59.977 14634 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:04:59 ctl02 nova-api[14634]: 2017-09-28 12:04:59.977 14634 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:04:59 ctl02 nova-api[14634]: 2017-09-28 12:04:59.977 14634 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:04:59 ctl02 nova-api[14634]: 2017-09-28 12:04:59.977 14634 ERROR nova.wsgi     self.filename))
Sep 28 12:04:59 ctl02 nova-api[14634]: 2017-09-28 12:04:59.977 14634 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:04:59 ctl02 nova-api[14634]: 2017-09-28 12:04:59.977 14634 ERROR nova.wsgi
Sep 28 12:04:59 ctl02 nova-api[14634]: 2017-09-28 12:04:59.978 14634 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:05:00 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:05:00.003 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:05:00] "OPTIONS / HTTP/1.0" 200 134 0.000676
Sep 28 12:05:00 ctl02 nova-api[14634]: 2017-09-28 12:05:00.111 14634 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:05:00 ctl02 nova-api[14634]: 2017-09-28 12:05:00.348 14634 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:05:00 ctl02 nova-api[14634]: 2017-09-28 12:05:00.351 14634 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:05:00 ctl02 nova-api[14634]: 2017-09-28 12:05:00.351 14634 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:05:00 ctl02 nova-api[14634]: 2017-09-28 12:05:00.352 14634 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:05:00 ctl02 nova-api[14634]: 2017-09-28 12:05:00.483 14634 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:05:00 ctl02 nova-api[14634]: 2017-09-28 12:05:00.486 14634 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:05:00 ctl02 nova-api[14634]: 2017-09-28 12:05:00.487 14634 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:05:00 ctl02 nova-api[14634]: 2017-09-28 12:05:00.487 14634 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:05:00 ctl02 nova-api[14634]: 2017-09-28 12:05:00.491 14634 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:05:00 ctl02 nova-api[14634]: 2017-09-28 12:05:00.491 14634 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:05:00 ctl02 nova-api[14634]: 2017-09-28 12:05:00.491 14634 ERROR nova Traceback (most recent call last):
Sep 28 12:05:00 ctl02 nova-api[14634]: 2017-09-28 12:05:00.491 14634 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:05:00 ctl02 nova-api[14634]: 2017-09-28 12:05:00.491 14634 ERROR nova     sys.exit(main())
Sep 28 12:05:00 ctl02 nova-api[14634]: 2017-09-28 12:05:00.491 14634 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:05:00 ctl02 nova-api[14634]: 2017-09-28 12:05:00.491 14634 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:05:00 ctl02 nova-api[14634]: 2017-09-28 12:05:00.491 14634 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:05:00 ctl02 nova-api[14634]: 2017-09-28 12:05:00.491 14634 ERROR nova     max_url_len=max_url_len)
Sep 28 12:05:00 ctl02 nova-api[14634]: 2017-09-28 12:05:00.491 14634 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:05:00 ctl02 nova-api[14634]: 2017-09-28 12:05:00.491 14634 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:05:00 ctl02 nova-api[14634]: 2017-09-28 12:05:00.491 14634 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:05:00 ctl02 nova-api[14634]: 2017-09-28 12:05:00.491 14634 ERROR nova     sock.listen(backlog)
Sep 28 12:05:00 ctl02 nova-api[14634]: 2017-09-28 12:05:00.491 14634 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:05:00 ctl02 nova-api[14634]: 2017-09-28 12:05:00.491 14634 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:05:00 ctl02 nova-api[14634]: 2017-09-28 12:05:00.491 14634 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:05:00 ctl02 nova-api[14634]: 2017-09-28 12:05:00.491 14634 ERROR nova
Sep 28 12:05:00 ctl02 heat-api-cfn[13300]: 2017-09-28 12:05:00.632 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:05:00] "OPTIONS / HTTP/1.0" 200 134 0.000529
Sep 28 12:05:00 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:05:00 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:05:00 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:05:00 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:05:00 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:05:00 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:05:00 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:05:01 ctl02 nova-consoleauth[5433]: 2017-09-28 12:05:01.876 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:05:02 ctl02 nova-api[14657]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:05:02 ctl02 nova-api[14657]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:05:02 ctl02 nova-api[14657]: 2017-09-28 12:05:02.749 14657 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:05:02 ctl02 nova-api[14657]: 2017-09-28 12:05:02.751 14657 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:05:02 ctl02 nova-api[14657]: 2017-09-28 12:05:02.751 14657 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:05:02 ctl02 nova-api[14657]: 2017-09-28 12:05:02.751 14657 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:05:02 ctl02 nova-api[14657]: 2017-09-28 12:05:02.751 14657 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:05:02 ctl02 nova-api[14657]: 2017-09-28 12:05:02.751 14657 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:05:02 ctl02 nova-api[14657]: 2017-09-28 12:05:02.751 14657 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:05:02 ctl02 nova-api[14657]: 2017-09-28 12:05:02.751 14657 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:05:02 ctl02 nova-api[14657]: 2017-09-28 12:05:02.751 14657 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:05:02 ctl02 nova-api[14657]: 2017-09-28 12:05:02.751 14657 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:05:02 ctl02 nova-api[14657]: 2017-09-28 12:05:02.751 14657 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:05:02 ctl02 nova-api[14657]: 2017-09-28 12:05:02.751 14657 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:05:02 ctl02 nova-api[14657]: 2017-09-28 12:05:02.751 14657 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:05:02 ctl02 nova-api[14657]: 2017-09-28 12:05:02.751 14657 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:05:02 ctl02 nova-api[14657]: 2017-09-28 12:05:02.751 14657 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:05:02 ctl02 nova-api[14657]: 2017-09-28 12:05:02.751 14657 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:05:02 ctl02 nova-api[14657]: 2017-09-28 12:05:02.751 14657 ERROR nova.wsgi     self.filename))
Sep 28 12:05:02 ctl02 nova-api[14657]: 2017-09-28 12:05:02.751 14657 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:05:02 ctl02 nova-api[14657]: 2017-09-28 12:05:02.751 14657 ERROR nova.wsgi
Sep 28 12:05:02 ctl02 nova-api[14657]: 2017-09-28 12:05:02.752 14657 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:05:02 ctl02 nova-api[14657]: 2017-09-28 12:05:02.886 14657 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:05:03 ctl02 nova-api[14657]: 2017-09-28 12:05:03.125 14657 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:05:03 ctl02 nova-api[14657]: 2017-09-28 12:05:03.127 14657 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:05:03 ctl02 nova-api[14657]: 2017-09-28 12:05:03.127 14657 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:05:03 ctl02 nova-api[14657]: 2017-09-28 12:05:03.128 14657 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:05:03 ctl02 nova-api[14657]: 2017-09-28 12:05:03.263 14657 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:05:03 ctl02 nova-api[14657]: 2017-09-28 12:05:03.265 14657 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:05:03 ctl02 nova-api[14657]: 2017-09-28 12:05:03.265 14657 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:05:03 ctl02 nova-api[14657]: 2017-09-28 12:05:03.265 14657 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:05:03 ctl02 nova-api[14657]: 2017-09-28 12:05:03.269 14657 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:05:03 ctl02 nova-api[14657]: 2017-09-28 12:05:03.269 14657 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:05:03 ctl02 nova-api[14657]: 2017-09-28 12:05:03.269 14657 ERROR nova Traceback (most recent call last):
Sep 28 12:05:03 ctl02 nova-api[14657]: 2017-09-28 12:05:03.269 14657 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:05:03 ctl02 nova-api[14657]: 2017-09-28 12:05:03.269 14657 ERROR nova     sys.exit(main())
Sep 28 12:05:03 ctl02 nova-api[14657]: 2017-09-28 12:05:03.269 14657 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:05:03 ctl02 nova-api[14657]: 2017-09-28 12:05:03.269 14657 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:05:03 ctl02 nova-api[14657]: 2017-09-28 12:05:03.269 14657 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:05:03 ctl02 nova-api[14657]: 2017-09-28 12:05:03.269 14657 ERROR nova     max_url_len=max_url_len)
Sep 28 12:05:03 ctl02 nova-api[14657]: 2017-09-28 12:05:03.269 14657 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:05:03 ctl02 nova-api[14657]: 2017-09-28 12:05:03.269 14657 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:05:03 ctl02 nova-api[14657]: 2017-09-28 12:05:03.269 14657 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:05:03 ctl02 nova-api[14657]: 2017-09-28 12:05:03.269 14657 ERROR nova     sock.listen(backlog)
Sep 28 12:05:03 ctl02 nova-api[14657]: 2017-09-28 12:05:03.269 14657 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:05:03 ctl02 nova-api[14657]: 2017-09-28 12:05:03.269 14657 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:05:03 ctl02 nova-api[14657]: 2017-09-28 12:05:03.269 14657 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:05:03 ctl02 nova-api[14657]: 2017-09-28 12:05:03.269 14657 ERROR nova
Sep 28 12:05:03 ctl02 glance-api[29183]: 2017-09-28 12:05:03.415 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:05:03] "OPTIONS / HTTP/1.0" 200 134 0.000704
Sep 28 12:05:03 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:05:03 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:05:03 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:05:03 ctl02 heat-api[13008]: 2017-09-28 12:05:03.421 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:05:03] "OPTIONS / HTTP/1.0" 200 134 0.000670
Sep 28 12:05:03 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:05:03 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:05:03 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:05:03 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:05:04 ctl02 nova-scheduler[5620]: 2017-09-28 12:05:04.897 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:05:05 ctl02 glance-api[29183]: 2017-09-28 12:05:05.013 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:05:05] "OPTIONS / HTTP/1.0" 200 134 0.000721
Sep 28 12:05:05 ctl02 nova-api[14675]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:05:05 ctl02 nova-api[14675]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:05:05 ctl02 nova-api[14675]: 2017-09-28 12:05:05.515 14675 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:05:05 ctl02 nova-api[14675]: 2017-09-28 12:05:05.517 14675 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:05:05 ctl02 nova-api[14675]: 2017-09-28 12:05:05.517 14675 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:05:05 ctl02 nova-api[14675]: 2017-09-28 12:05:05.517 14675 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:05:05 ctl02 nova-api[14675]: 2017-09-28 12:05:05.517 14675 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:05:05 ctl02 nova-api[14675]: 2017-09-28 12:05:05.517 14675 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:05:05 ctl02 nova-api[14675]: 2017-09-28 12:05:05.517 14675 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:05:05 ctl02 nova-api[14675]: 2017-09-28 12:05:05.517 14675 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:05:05 ctl02 nova-api[14675]: 2017-09-28 12:05:05.517 14675 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:05:05 ctl02 nova-api[14675]: 2017-09-28 12:05:05.517 14675 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:05:05 ctl02 nova-api[14675]: 2017-09-28 12:05:05.517 14675 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:05:05 ctl02 nova-api[14675]: 2017-09-28 12:05:05.517 14675 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:05:05 ctl02 nova-api[14675]: 2017-09-28 12:05:05.517 14675 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:05:05 ctl02 nova-api[14675]: 2017-09-28 12:05:05.517 14675 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:05:05 ctl02 nova-api[14675]: 2017-09-28 12:05:05.517 14675 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:05:05 ctl02 nova-api[14675]: 2017-09-28 12:05:05.517 14675 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:05:05 ctl02 nova-api[14675]: 2017-09-28 12:05:05.517 14675 ERROR nova.wsgi     self.filename))
Sep 28 12:05:05 ctl02 nova-api[14675]: 2017-09-28 12:05:05.517 14675 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:05:05 ctl02 nova-api[14675]: 2017-09-28 12:05:05.517 14675 ERROR nova.wsgi
Sep 28 12:05:05 ctl02 nova-api[14675]: 2017-09-28 12:05:05.519 14675 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:05:05 ctl02 nova-api[14675]: 2017-09-28 12:05:05.653 14675 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:05:05 ctl02 heat-api[13008]: 2017-09-28 12:05:05.669 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:05:05] "OPTIONS / HTTP/1.0" 200 134 0.000628
Sep 28 12:05:05 ctl02 heat-api[13008]: 2017-09-28 12:05:05.712 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:05:05] "OPTIONS / HTTP/1.0" 200 134 0.000461
Sep 28 12:05:05 ctl02 nova-api[14675]: 2017-09-28 12:05:05.901 14675 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:05:05 ctl02 nova-api[14675]: 2017-09-28 12:05:05.904 14675 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:05:05 ctl02 nova-api[14675]: 2017-09-28 12:05:05.904 14675 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:05:05 ctl02 nova-api[14675]: 2017-09-28 12:05:05.904 14675 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:05:06 ctl02 nova-api[14675]: 2017-09-28 12:05:06.036 14675 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:05:06 ctl02 nova-api[14675]: 2017-09-28 12:05:06.038 14675 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:05:06 ctl02 nova-api[14675]: 2017-09-28 12:05:06.038 14675 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:05:06 ctl02 nova-api[14675]: 2017-09-28 12:05:06.038 14675 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:05:06 ctl02 nova-api[14675]: 2017-09-28 12:05:06.042 14675 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:05:06 ctl02 nova-api[14675]: 2017-09-28 12:05:06.042 14675 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:05:06 ctl02 nova-api[14675]: 2017-09-28 12:05:06.042 14675 ERROR nova Traceback (most recent call last):
Sep 28 12:05:06 ctl02 nova-api[14675]: 2017-09-28 12:05:06.042 14675 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:05:06 ctl02 nova-api[14675]: 2017-09-28 12:05:06.042 14675 ERROR nova     sys.exit(main())
Sep 28 12:05:06 ctl02 nova-api[14675]: 2017-09-28 12:05:06.042 14675 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:05:06 ctl02 nova-api[14675]: 2017-09-28 12:05:06.042 14675 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:05:06 ctl02 nova-api[14675]: 2017-09-28 12:05:06.042 14675 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:05:06 ctl02 nova-api[14675]: 2017-09-28 12:05:06.042 14675 ERROR nova     max_url_len=max_url_len)
Sep 28 12:05:06 ctl02 nova-api[14675]: 2017-09-28 12:05:06.042 14675 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:05:06 ctl02 nova-api[14675]: 2017-09-28 12:05:06.042 14675 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:05:06 ctl02 nova-api[14675]: 2017-09-28 12:05:06.042 14675 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:05:06 ctl02 nova-api[14675]: 2017-09-28 12:05:06.042 14675 ERROR nova     sock.listen(backlog)
Sep 28 12:05:06 ctl02 nova-api[14675]: 2017-09-28 12:05:06.042 14675 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:05:06 ctl02 nova-api[14675]: 2017-09-28 12:05:06.042 14675 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:05:06 ctl02 nova-api[14675]: 2017-09-28 12:05:06.042 14675 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:05:06 ctl02 nova-api[14675]: 2017-09-28 12:05:06.042 14675 ERROR nova
Sep 28 12:05:06 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:05:06 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:05:06 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:05:06 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:05:06 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:05:06 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:05:06 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:05:07 ctl02 heat-engine[12803]: 2017-09-28 12:05:07.371 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 30 seconds.
Sep 28 12:05:07 ctl02 heat-engine[12803]: 2017-09-28 12:05:07.410 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 30 seconds.
Sep 28 12:05:07 ctl02 heat-engine[12803]: 2017-09-28 12:05:07.429 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 30 seconds.
Sep 28 12:05:07 ctl02 heat-engine[12803]: 2017-09-28 12:05:07.434 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 30 seconds.
Sep 28 12:05:07 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x49fe827)
Sep 28 12:05:08 ctl02 nova-api[14692]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:05:08 ctl02 nova-api[14692]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:05:08 ctl02 nova-api[14692]: 2017-09-28 12:05:08.223 14692 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:05:08 ctl02 nova-api[14692]: 2017-09-28 12:05:08.225 14692 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:05:08 ctl02 nova-api[14692]: 2017-09-28 12:05:08.225 14692 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:05:08 ctl02 nova-api[14692]: 2017-09-28 12:05:08.225 14692 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:05:08 ctl02 nova-api[14692]: 2017-09-28 12:05:08.225 14692 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:05:08 ctl02 nova-api[14692]: 2017-09-28 12:05:08.225 14692 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:05:08 ctl02 nova-api[14692]: 2017-09-28 12:05:08.225 14692 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:05:08 ctl02 nova-api[14692]: 2017-09-28 12:05:08.225 14692 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:05:08 ctl02 nova-api[14692]: 2017-09-28 12:05:08.225 14692 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:05:08 ctl02 nova-api[14692]: 2017-09-28 12:05:08.225 14692 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:05:08 ctl02 nova-api[14692]: 2017-09-28 12:05:08.225 14692 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:05:08 ctl02 nova-api[14692]: 2017-09-28 12:05:08.225 14692 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:05:08 ctl02 nova-api[14692]: 2017-09-28 12:05:08.225 14692 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:05:08 ctl02 nova-api[14692]: 2017-09-28 12:05:08.225 14692 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:05:08 ctl02 nova-api[14692]: 2017-09-28 12:05:08.225 14692 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:05:08 ctl02 nova-api[14692]: 2017-09-28 12:05:08.225 14692 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:05:08 ctl02 nova-api[14692]: 2017-09-28 12:05:08.225 14692 ERROR nova.wsgi     self.filename))
Sep 28 12:05:08 ctl02 nova-api[14692]: 2017-09-28 12:05:08.225 14692 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:05:08 ctl02 nova-api[14692]: 2017-09-28 12:05:08.225 14692 ERROR nova.wsgi
Sep 28 12:05:08 ctl02 nova-api[14692]: 2017-09-28 12:05:08.226 14692 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:05:08 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:05:08.257 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:05:08] "OPTIONS / HTTP/1.0" 200 134 0.000441
Sep 28 12:05:08 ctl02 nova-api[14692]: 2017-09-28 12:05:08.357 14692 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:05:08 ctl02 nova-api[14692]: 2017-09-28 12:05:08.588 14692 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:05:08 ctl02 nova-api[14692]: 2017-09-28 12:05:08.590 14692 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:05:08 ctl02 nova-api[14692]: 2017-09-28 12:05:08.590 14692 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:05:08 ctl02 nova-api[14692]: 2017-09-28 12:05:08.590 14692 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:05:08 ctl02 nova-api[14692]: 2017-09-28 12:05:08.722 14692 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:05:08 ctl02 nova-api[14692]: 2017-09-28 12:05:08.723 14692 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:05:08 ctl02 nova-api[14692]: 2017-09-28 12:05:08.724 14692 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:05:08 ctl02 nova-api[14692]: 2017-09-28 12:05:08.724 14692 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:05:08 ctl02 nova-api[14692]: 2017-09-28 12:05:08.727 14692 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:05:08 ctl02 nova-api[14692]: 2017-09-28 12:05:08.727 14692 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:05:08 ctl02 nova-api[14692]: 2017-09-28 12:05:08.727 14692 ERROR nova Traceback (most recent call last):
Sep 28 12:05:08 ctl02 nova-api[14692]: 2017-09-28 12:05:08.727 14692 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:05:08 ctl02 nova-api[14692]: 2017-09-28 12:05:08.727 14692 ERROR nova     sys.exit(main())
Sep 28 12:05:08 ctl02 nova-api[14692]: 2017-09-28 12:05:08.727 14692 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:05:08 ctl02 nova-api[14692]: 2017-09-28 12:05:08.727 14692 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:05:08 ctl02 nova-api[14692]: 2017-09-28 12:05:08.727 14692 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:05:08 ctl02 nova-api[14692]: 2017-09-28 12:05:08.727 14692 ERROR nova     max_url_len=max_url_len)
Sep 28 12:05:08 ctl02 nova-api[14692]: 2017-09-28 12:05:08.727 14692 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:05:08 ctl02 nova-api[14692]: 2017-09-28 12:05:08.727 14692 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:05:08 ctl02 nova-api[14692]: 2017-09-28 12:05:08.727 14692 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:05:08 ctl02 nova-api[14692]: 2017-09-28 12:05:08.727 14692 ERROR nova     sock.listen(backlog)
Sep 28 12:05:08 ctl02 nova-api[14692]: 2017-09-28 12:05:08.727 14692 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:05:08 ctl02 nova-api[14692]: 2017-09-28 12:05:08.727 14692 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:05:08 ctl02 nova-api[14692]: 2017-09-28 12:05:08.727 14692 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:05:08 ctl02 nova-api[14692]: 2017-09-28 12:05:08.727 14692 ERROR nova
Sep 28 12:05:08 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x49fe827)
Sep 28 12:05:08 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:05:08 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:05:08 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:05:08 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:05:08.975 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:05:08] "OPTIONS / HTTP/1.0" 200 134 0.000528
Sep 28 12:05:09 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:05:09 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:05:09 ctl02 heat-api-cfn[13300]: 2017-09-28 12:05:09.133 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:05:09] "OPTIONS / HTTP/1.0" 200 134 0.000609
Sep 28 12:05:09 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:05:09 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:05:09 ctl02 heat-api-cfn[13300]: 2017-09-28 12:05:09.655 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:05:09] "OPTIONS / HTTP/1.0" 200 134 0.000528
Sep 28 12:05:09 ctl02 glance-api[29183]: 2017-09-28 12:05:09.678 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:05:09] "OPTIONS / HTTP/1.0" 200 134 0.000702
Sep 28 12:05:09 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x49fe827)
Sep 28 12:05:10 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:05:10.130 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:05:10] "OPTIONS / HTTP/1.0" 200 134 0.000505
Sep 28 12:05:10 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x49fe827)
Sep 28 12:05:10 ctl02 nova-api[14712]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:05:10 ctl02 nova-api[14712]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:05:10 ctl02 nova-api[14712]: 2017-09-28 12:05:10.992 14712 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:05:10 ctl02 nova-api[14712]: 2017-09-28 12:05:10.993 14712 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:05:10 ctl02 nova-api[14712]: 2017-09-28 12:05:10.993 14712 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:05:10 ctl02 nova-api[14712]: 2017-09-28 12:05:10.993 14712 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:05:10 ctl02 nova-api[14712]: 2017-09-28 12:05:10.993 14712 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:05:10 ctl02 nova-api[14712]: 2017-09-28 12:05:10.993 14712 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:05:10 ctl02 nova-api[14712]: 2017-09-28 12:05:10.993 14712 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:05:10 ctl02 nova-api[14712]: 2017-09-28 12:05:10.993 14712 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:05:10 ctl02 nova-api[14712]: 2017-09-28 12:05:10.993 14712 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:05:10 ctl02 nova-api[14712]: 2017-09-28 12:05:10.993 14712 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:05:10 ctl02 nova-api[14712]: 2017-09-28 12:05:10.993 14712 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:05:10 ctl02 nova-api[14712]: 2017-09-28 12:05:10.993 14712 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:05:10 ctl02 nova-api[14712]: 2017-09-28 12:05:10.993 14712 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:05:10 ctl02 nova-api[14712]: 2017-09-28 12:05:10.993 14712 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:05:10 ctl02 nova-api[14712]: 2017-09-28 12:05:10.993 14712 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:05:10 ctl02 nova-api[14712]: 2017-09-28 12:05:10.993 14712 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:05:10 ctl02 nova-api[14712]: 2017-09-28 12:05:10.993 14712 ERROR nova.wsgi     self.filename))
Sep 28 12:05:10 ctl02 nova-api[14712]: 2017-09-28 12:05:10.993 14712 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:05:10 ctl02 nova-api[14712]: 2017-09-28 12:05:10.993 14712 ERROR nova.wsgi
Sep 28 12:05:10 ctl02 nova-api[14712]: 2017-09-28 12:05:10.994 14712 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:05:11 ctl02 heat-api-cfn[13300]: 2017-09-28 12:05:11.033 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:05:11] "OPTIONS / HTTP/1.0" 200 134 0.000606
Sep 28 12:05:11 ctl02 nova-api[14712]: 2017-09-28 12:05:11.126 14712 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:05:11 ctl02 nova-api[14712]: 2017-09-28 12:05:11.359 14712 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:05:11 ctl02 nova-api[14712]: 2017-09-28 12:05:11.361 14712 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:05:11 ctl02 nova-api[14712]: 2017-09-28 12:05:11.361 14712 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:05:11 ctl02 nova-api[14712]: 2017-09-28 12:05:11.362 14712 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:05:11 ctl02 nova-api[14712]: 2017-09-28 12:05:11.494 14712 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:05:11 ctl02 nova-api[14712]: 2017-09-28 12:05:11.495 14712 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:05:11 ctl02 nova-api[14712]: 2017-09-28 12:05:11.496 14712 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:05:11 ctl02 nova-api[14712]: 2017-09-28 12:05:11.496 14712 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:05:11 ctl02 nova-api[14712]: 2017-09-28 12:05:11.499 14712 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:05:11 ctl02 nova-api[14712]: 2017-09-28 12:05:11.499 14712 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:05:11 ctl02 nova-api[14712]: 2017-09-28 12:05:11.499 14712 ERROR nova Traceback (most recent call last):
Sep 28 12:05:11 ctl02 nova-api[14712]: 2017-09-28 12:05:11.499 14712 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:05:11 ctl02 nova-api[14712]: 2017-09-28 12:05:11.499 14712 ERROR nova     sys.exit(main())
Sep 28 12:05:11 ctl02 nova-api[14712]: 2017-09-28 12:05:11.499 14712 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:05:11 ctl02 nova-api[14712]: 2017-09-28 12:05:11.499 14712 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:05:11 ctl02 nova-api[14712]: 2017-09-28 12:05:11.499 14712 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:05:11 ctl02 nova-api[14712]: 2017-09-28 12:05:11.499 14712 ERROR nova     max_url_len=max_url_len)
Sep 28 12:05:11 ctl02 nova-api[14712]: 2017-09-28 12:05:11.499 14712 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:05:11 ctl02 nova-api[14712]: 2017-09-28 12:05:11.499 14712 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:05:11 ctl02 nova-api[14712]: 2017-09-28 12:05:11.499 14712 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:05:11 ctl02 nova-api[14712]: 2017-09-28 12:05:11.499 14712 ERROR nova     sock.listen(backlog)
Sep 28 12:05:11 ctl02 nova-api[14712]: 2017-09-28 12:05:11.499 14712 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:05:11 ctl02 nova-api[14712]: 2017-09-28 12:05:11.499 14712 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:05:11 ctl02 nova-api[14712]: 2017-09-28 12:05:11.499 14712 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:05:11 ctl02 nova-api[14712]: 2017-09-28 12:05:11.499 14712 ERROR nova
Sep 28 12:05:11 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:05:11 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:05:11 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:05:11 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x49fe827)
Sep 28 12:05:11 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:05:11 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:05:11 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:05:11 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:05:12 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x49fe827)
Sep 28 12:05:13 ctl02 heat-api[13008]: 2017-09-28 12:05:13.481 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:05:13] "OPTIONS / HTTP/1.0" 200 134 0.000546
Sep 28 12:05:13 ctl02 nova-api[14730]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:05:13 ctl02 nova-api[14730]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:05:13 ctl02 glance-api[29183]: 2017-09-28 12:05:13.559 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:05:13] "OPTIONS / HTTP/1.0" 200 134 0.000747
Sep 28 12:05:13 ctl02 nova-api[14730]: 2017-09-28 12:05:13.715 14730 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:05:13 ctl02 nova-api[14730]: 2017-09-28 12:05:13.717 14730 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:05:13 ctl02 nova-api[14730]: 2017-09-28 12:05:13.717 14730 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:05:13 ctl02 nova-api[14730]: 2017-09-28 12:05:13.717 14730 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:05:13 ctl02 nova-api[14730]: 2017-09-28 12:05:13.717 14730 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:05:13 ctl02 nova-api[14730]: 2017-09-28 12:05:13.717 14730 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:05:13 ctl02 nova-api[14730]: 2017-09-28 12:05:13.717 14730 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:05:13 ctl02 nova-api[14730]: 2017-09-28 12:05:13.717 14730 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:05:13 ctl02 nova-api[14730]: 2017-09-28 12:05:13.717 14730 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:05:13 ctl02 nova-api[14730]: 2017-09-28 12:05:13.717 14730 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:05:13 ctl02 nova-api[14730]: 2017-09-28 12:05:13.717 14730 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:05:13 ctl02 nova-api[14730]: 2017-09-28 12:05:13.717 14730 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:05:13 ctl02 nova-api[14730]: 2017-09-28 12:05:13.717 14730 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:05:13 ctl02 nova-api[14730]: 2017-09-28 12:05:13.717 14730 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:05:13 ctl02 nova-api[14730]: 2017-09-28 12:05:13.717 14730 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:05:13 ctl02 nova-api[14730]: 2017-09-28 12:05:13.717 14730 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:05:13 ctl02 nova-api[14730]: 2017-09-28 12:05:13.717 14730 ERROR nova.wsgi     self.filename))
Sep 28 12:05:13 ctl02 nova-api[14730]: 2017-09-28 12:05:13.717 14730 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:05:13 ctl02 nova-api[14730]: 2017-09-28 12:05:13.717 14730 ERROR nova.wsgi
Sep 28 12:05:13 ctl02 nova-api[14730]: 2017-09-28 12:05:13.718 14730 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:05:13 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x49fe827)
Sep 28 12:05:13 ctl02 nova-api[14730]: 2017-09-28 12:05:13.855 14730 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:05:14 ctl02 nova-api[14730]: 2017-09-28 12:05:14.103 14730 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:05:14 ctl02 nova-api[14730]: 2017-09-28 12:05:14.106 14730 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:05:14 ctl02 nova-api[14730]: 2017-09-28 12:05:14.115 14730 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:05:14 ctl02 nova-api[14730]: 2017-09-28 12:05:14.115 14730 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:05:14 ctl02 nova-api[14730]: 2017-09-28 12:05:14.246 14730 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:05:14 ctl02 nova-api[14730]: 2017-09-28 12:05:14.248 14730 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:05:14 ctl02 nova-api[14730]: 2017-09-28 12:05:14.248 14730 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:05:14 ctl02 nova-api[14730]: 2017-09-28 12:05:14.248 14730 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:05:14 ctl02 nova-api[14730]: 2017-09-28 12:05:14.252 14730 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:05:14 ctl02 nova-api[14730]: 2017-09-28 12:05:14.252 14730 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:05:14 ctl02 nova-api[14730]: 2017-09-28 12:05:14.252 14730 ERROR nova Traceback (most recent call last):
Sep 28 12:05:14 ctl02 nova-api[14730]: 2017-09-28 12:05:14.252 14730 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:05:14 ctl02 nova-api[14730]: 2017-09-28 12:05:14.252 14730 ERROR nova     sys.exit(main())
Sep 28 12:05:14 ctl02 nova-api[14730]: 2017-09-28 12:05:14.252 14730 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:05:14 ctl02 nova-api[14730]: 2017-09-28 12:05:14.252 14730 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:05:14 ctl02 nova-api[14730]: 2017-09-28 12:05:14.252 14730 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:05:14 ctl02 nova-api[14730]: 2017-09-28 12:05:14.252 14730 ERROR nova     max_url_len=max_url_len)
Sep 28 12:05:14 ctl02 nova-api[14730]: 2017-09-28 12:05:14.252 14730 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:05:14 ctl02 nova-api[14730]: 2017-09-28 12:05:14.252 14730 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:05:14 ctl02 nova-api[14730]: 2017-09-28 12:05:14.252 14730 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:05:14 ctl02 nova-api[14730]: 2017-09-28 12:05:14.252 14730 ERROR nova     sock.listen(backlog)
Sep 28 12:05:14 ctl02 nova-api[14730]: 2017-09-28 12:05:14.252 14730 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:05:14 ctl02 nova-api[14730]: 2017-09-28 12:05:14.252 14730 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:05:14 ctl02 nova-api[14730]: 2017-09-28 12:05:14.252 14730 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:05:14 ctl02 nova-api[14730]: 2017-09-28 12:05:14.252 14730 ERROR nova
Sep 28 12:05:14 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:05:14 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:05:14 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:05:14 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:05:14 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:05:14 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:05:14 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:05:14 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x49fe827)
Sep 28 12:05:15 ctl02 glance-api[29183]: 2017-09-28 12:05:15.300 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:05:15] "OPTIONS / HTTP/1.0" 200 134 0.000583
Sep 28 12:05:15 ctl02 heat-api[13008]: 2017-09-28 12:05:15.708 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:05:15] "OPTIONS / HTTP/1.0" 200 134 0.000565
Sep 28 12:05:15 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x49fe827)
Sep 28 12:05:15 ctl02 heat-api[13008]: 2017-09-28 12:05:15.838 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:05:15] "OPTIONS / HTTP/1.0" 200 134 0.000363
Sep 28 12:05:16 ctl02 nova-api[14748]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:05:16 ctl02 nova-api[14748]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:05:16 ctl02 nova-api[14748]: 2017-09-28 12:05:16.458 14748 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:05:16 ctl02 nova-api[14748]: 2017-09-28 12:05:16.460 14748 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:05:16 ctl02 nova-api[14748]: 2017-09-28 12:05:16.460 14748 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:05:16 ctl02 nova-api[14748]: 2017-09-28 12:05:16.460 14748 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:05:16 ctl02 nova-api[14748]: 2017-09-28 12:05:16.460 14748 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:05:16 ctl02 nova-api[14748]: 2017-09-28 12:05:16.460 14748 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:05:16 ctl02 nova-api[14748]: 2017-09-28 12:05:16.460 14748 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:05:16 ctl02 nova-api[14748]: 2017-09-28 12:05:16.460 14748 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:05:16 ctl02 nova-api[14748]: 2017-09-28 12:05:16.460 14748 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:05:16 ctl02 nova-api[14748]: 2017-09-28 12:05:16.460 14748 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:05:16 ctl02 nova-api[14748]: 2017-09-28 12:05:16.460 14748 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:05:16 ctl02 nova-api[14748]: 2017-09-28 12:05:16.460 14748 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:05:16 ctl02 nova-api[14748]: 2017-09-28 12:05:16.460 14748 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:05:16 ctl02 nova-api[14748]: 2017-09-28 12:05:16.460 14748 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:05:16 ctl02 nova-api[14748]: 2017-09-28 12:05:16.460 14748 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:05:16 ctl02 nova-api[14748]: 2017-09-28 12:05:16.460 14748 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:05:16 ctl02 nova-api[14748]: 2017-09-28 12:05:16.460 14748 ERROR nova.wsgi     self.filename))
Sep 28 12:05:16 ctl02 nova-api[14748]: 2017-09-28 12:05:16.460 14748 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:05:16 ctl02 nova-api[14748]: 2017-09-28 12:05:16.460 14748 ERROR nova.wsgi
Sep 28 12:05:16 ctl02 nova-api[14748]: 2017-09-28 12:05:16.461 14748 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:05:16 ctl02 nova-api[14748]: 2017-09-28 12:05:16.588 14748 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:05:16 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x49fe827)
Sep 28 12:05:16 ctl02 nova-api[14748]: 2017-09-28 12:05:16.818 14748 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:05:16 ctl02 nova-api[14748]: 2017-09-28 12:05:16.820 14748 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:05:16 ctl02 nova-api[14748]: 2017-09-28 12:05:16.820 14748 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:05:16 ctl02 nova-api[14748]: 2017-09-28 12:05:16.820 14748 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:05:16 ctl02 nova-api[14748]: 2017-09-28 12:05:16.950 14748 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:05:16 ctl02 nova-api[14748]: 2017-09-28 12:05:16.951 14748 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:05:16 ctl02 nova-api[14748]: 2017-09-28 12:05:16.951 14748 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:05:16 ctl02 nova-api[14748]: 2017-09-28 12:05:16.952 14748 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:05:16 ctl02 nova-api[14748]: 2017-09-28 12:05:16.955 14748 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:05:16 ctl02 nova-api[14748]: 2017-09-28 12:05:16.955 14748 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:05:16 ctl02 nova-api[14748]: 2017-09-28 12:05:16.955 14748 ERROR nova Traceback (most recent call last):
Sep 28 12:05:16 ctl02 nova-api[14748]: 2017-09-28 12:05:16.955 14748 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:05:16 ctl02 nova-api[14748]: 2017-09-28 12:05:16.955 14748 ERROR nova     sys.exit(main())
Sep 28 12:05:16 ctl02 nova-api[14748]: 2017-09-28 12:05:16.955 14748 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:05:16 ctl02 nova-api[14748]: 2017-09-28 12:05:16.955 14748 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:05:16 ctl02 nova-api[14748]: 2017-09-28 12:05:16.955 14748 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:05:16 ctl02 nova-api[14748]: 2017-09-28 12:05:16.955 14748 ERROR nova     max_url_len=max_url_len)
Sep 28 12:05:16 ctl02 nova-api[14748]: 2017-09-28 12:05:16.955 14748 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:05:16 ctl02 nova-api[14748]: 2017-09-28 12:05:16.955 14748 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:05:16 ctl02 nova-api[14748]: 2017-09-28 12:05:16.955 14748 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:05:16 ctl02 nova-api[14748]: 2017-09-28 12:05:16.955 14748 ERROR nova     sock.listen(backlog)
Sep 28 12:05:16 ctl02 nova-api[14748]: 2017-09-28 12:05:16.955 14748 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:05:16 ctl02 nova-api[14748]: 2017-09-28 12:05:16.955 14748 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:05:16 ctl02 nova-api[14748]: 2017-09-28 12:05:16.955 14748 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:05:16 ctl02 nova-api[14748]: 2017-09-28 12:05:16.955 14748 ERROR nova
Sep 28 12:05:17 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:05:17 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:05:17 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:05:17 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:05:17 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:05:17 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:05:17 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:05:17 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x49fe827)
Sep 28 12:05:17 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:05:17.967 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:05:17] "OPTIONS / HTTP/1.0" 200 134 0.000390
Sep 28 12:05:18 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:05:18 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:05:18 ctl02 nova-api[14765]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:05:18 ctl02 nova-api[14765]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:05:19 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:05:19.133 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:05:19] "OPTIONS / HTTP/1.0" 200 134 0.000457
Sep 28 12:05:19 ctl02 nova-api[14765]: 2017-09-28 12:05:19.187 14765 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:05:19 ctl02 nova-api[14765]: 2017-09-28 12:05:19.189 14765 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:05:19 ctl02 nova-api[14765]: 2017-09-28 12:05:19.189 14765 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:05:19 ctl02 nova-api[14765]: 2017-09-28 12:05:19.189 14765 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:05:19 ctl02 nova-api[14765]: 2017-09-28 12:05:19.189 14765 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:05:19 ctl02 nova-api[14765]: 2017-09-28 12:05:19.189 14765 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:05:19 ctl02 nova-api[14765]: 2017-09-28 12:05:19.189 14765 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:05:19 ctl02 nova-api[14765]: 2017-09-28 12:05:19.189 14765 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:05:19 ctl02 nova-api[14765]: 2017-09-28 12:05:19.189 14765 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:05:19 ctl02 nova-api[14765]: 2017-09-28 12:05:19.189 14765 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:05:19 ctl02 nova-api[14765]: 2017-09-28 12:05:19.189 14765 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:05:19 ctl02 nova-api[14765]: 2017-09-28 12:05:19.189 14765 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:05:19 ctl02 nova-api[14765]: 2017-09-28 12:05:19.189 14765 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:05:19 ctl02 nova-api[14765]: 2017-09-28 12:05:19.189 14765 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:05:19 ctl02 nova-api[14765]: 2017-09-28 12:05:19.189 14765 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:05:19 ctl02 nova-api[14765]: 2017-09-28 12:05:19.189 14765 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:05:19 ctl02 nova-api[14765]: 2017-09-28 12:05:19.189 14765 ERROR nova.wsgi     self.filename))
Sep 28 12:05:19 ctl02 nova-api[14765]: 2017-09-28 12:05:19.189 14765 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:05:19 ctl02 nova-api[14765]: 2017-09-28 12:05:19.189 14765 ERROR nova.wsgi
Sep 28 12:05:19 ctl02 nova-api[14765]: 2017-09-28 12:05:19.191 14765 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:05:19 ctl02 heat-api-cfn[13300]: 2017-09-28 12:05:19.223 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:05:19] "OPTIONS / HTTP/1.0" 200 134 0.000464
Sep 28 12:05:19 ctl02 nova-api[14765]: 2017-09-28 12:05:19.320 14765 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:05:19 ctl02 nova-api[14765]: 2017-09-28 12:05:19.549 14765 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:05:19 ctl02 nova-api[14765]: 2017-09-28 12:05:19.551 14765 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:05:19 ctl02 nova-api[14765]: 2017-09-28 12:05:19.552 14765 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:05:19 ctl02 nova-api[14765]: 2017-09-28 12:05:19.552 14765 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:05:19 ctl02 glance-api[29183]: 2017-09-28 12:05:19.626 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:05:19] "OPTIONS / HTTP/1.0" 200 134 0.000638
Sep 28 12:05:19 ctl02 nova-api[14765]: 2017-09-28 12:05:19.682 14765 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:05:19 ctl02 nova-api[14765]: 2017-09-28 12:05:19.684 14765 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:05:19 ctl02 nova-api[14765]: 2017-09-28 12:05:19.684 14765 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:05:19 ctl02 nova-api[14765]: 2017-09-28 12:05:19.685 14765 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:05:19 ctl02 nova-api[14765]: 2017-09-28 12:05:19.688 14765 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:05:19 ctl02 nova-api[14765]: 2017-09-28 12:05:19.688 14765 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:05:19 ctl02 nova-api[14765]: 2017-09-28 12:05:19.688 14765 ERROR nova Traceback (most recent call last):
Sep 28 12:05:19 ctl02 nova-api[14765]: 2017-09-28 12:05:19.688 14765 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:05:19 ctl02 nova-api[14765]: 2017-09-28 12:05:19.688 14765 ERROR nova     sys.exit(main())
Sep 28 12:05:19 ctl02 nova-api[14765]: 2017-09-28 12:05:19.688 14765 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:05:19 ctl02 nova-api[14765]: 2017-09-28 12:05:19.688 14765 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:05:19 ctl02 nova-api[14765]: 2017-09-28 12:05:19.688 14765 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:05:19 ctl02 nova-api[14765]: 2017-09-28 12:05:19.688 14765 ERROR nova     max_url_len=max_url_len)
Sep 28 12:05:19 ctl02 nova-api[14765]: 2017-09-28 12:05:19.688 14765 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:05:19 ctl02 nova-api[14765]: 2017-09-28 12:05:19.688 14765 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:05:19 ctl02 nova-api[14765]: 2017-09-28 12:05:19.688 14765 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:05:19 ctl02 nova-api[14765]: 2017-09-28 12:05:19.688 14765 ERROR nova     sock.listen(backlog)
Sep 28 12:05:19 ctl02 nova-api[14765]: 2017-09-28 12:05:19.688 14765 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:05:19 ctl02 nova-api[14765]: 2017-09-28 12:05:19.688 14765 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:05:19 ctl02 nova-api[14765]: 2017-09-28 12:05:19.688 14765 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:05:19 ctl02 nova-api[14765]: 2017-09-28 12:05:19.688 14765 ERROR nova
Sep 28 12:05:19 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:05:19 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:05:19 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:05:19 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:05:19.951 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:05:19] "OPTIONS / HTTP/1.0" 200 134 0.000464
Sep 28 12:05:20 ctl02 heat-api-cfn[13300]: 2017-09-28 12:05:20.053 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:05:20] "OPTIONS / HTTP/1.0" 200 134 0.000628
Sep 28 12:05:20 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:05:20 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:05:20 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:05:20 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:05:21 ctl02 heat-api-cfn[13300]: 2017-09-28 12:05:21.370 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:05:21] "OPTIONS / HTTP/1.0" 200 134 0.000553
Sep 28 12:05:21 ctl02 nova-api[14787]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:05:21 ctl02 nova-api[14787]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:05:21 ctl02 nova-api[14787]: 2017-09-28 12:05:21.936 14787 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:05:21 ctl02 nova-api[14787]: 2017-09-28 12:05:21.938 14787 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:05:21 ctl02 nova-api[14787]: 2017-09-28 12:05:21.938 14787 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:05:21 ctl02 nova-api[14787]: 2017-09-28 12:05:21.938 14787 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:05:21 ctl02 nova-api[14787]: 2017-09-28 12:05:21.938 14787 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:05:21 ctl02 nova-api[14787]: 2017-09-28 12:05:21.938 14787 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:05:21 ctl02 nova-api[14787]: 2017-09-28 12:05:21.938 14787 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:05:21 ctl02 nova-api[14787]: 2017-09-28 12:05:21.938 14787 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:05:21 ctl02 nova-api[14787]: 2017-09-28 12:05:21.938 14787 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:05:21 ctl02 nova-api[14787]: 2017-09-28 12:05:21.938 14787 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:05:21 ctl02 nova-api[14787]: 2017-09-28 12:05:21.938 14787 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:05:21 ctl02 nova-api[14787]: 2017-09-28 12:05:21.938 14787 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:05:21 ctl02 nova-api[14787]: 2017-09-28 12:05:21.938 14787 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:05:21 ctl02 nova-api[14787]: 2017-09-28 12:05:21.938 14787 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:05:21 ctl02 nova-api[14787]: 2017-09-28 12:05:21.938 14787 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:05:21 ctl02 nova-api[14787]: 2017-09-28 12:05:21.938 14787 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:05:21 ctl02 nova-api[14787]: 2017-09-28 12:05:21.938 14787 ERROR nova.wsgi     self.filename))
Sep 28 12:05:21 ctl02 nova-api[14787]: 2017-09-28 12:05:21.938 14787 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:05:21 ctl02 nova-api[14787]: 2017-09-28 12:05:21.938 14787 ERROR nova.wsgi
Sep 28 12:05:21 ctl02 nova-api[14787]: 2017-09-28 12:05:21.940 14787 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:05:22 ctl02 nova-api[14787]: 2017-09-28 12:05:22.084 14787 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:05:22 ctl02 nova-api[14787]: 2017-09-28 12:05:22.324 14787 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:05:22 ctl02 nova-api[14787]: 2017-09-28 12:05:22.326 14787 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:05:22 ctl02 nova-api[14787]: 2017-09-28 12:05:22.326 14787 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:05:22 ctl02 nova-api[14787]: 2017-09-28 12:05:22.327 14787 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:05:22 ctl02 nova-api[14787]: 2017-09-28 12:05:22.459 14787 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:05:22 ctl02 nova-api[14787]: 2017-09-28 12:05:22.461 14787 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:05:22 ctl02 nova-api[14787]: 2017-09-28 12:05:22.461 14787 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:05:22 ctl02 nova-api[14787]: 2017-09-28 12:05:22.462 14787 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:05:22 ctl02 nova-api[14787]: 2017-09-28 12:05:22.465 14787 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:05:22 ctl02 nova-api[14787]: 2017-09-28 12:05:22.465 14787 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:05:22 ctl02 nova-api[14787]: 2017-09-28 12:05:22.465 14787 ERROR nova Traceback (most recent call last):
Sep 28 12:05:22 ctl02 nova-api[14787]: 2017-09-28 12:05:22.465 14787 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:05:22 ctl02 nova-api[14787]: 2017-09-28 12:05:22.465 14787 ERROR nova     sys.exit(main())
Sep 28 12:05:22 ctl02 nova-api[14787]: 2017-09-28 12:05:22.465 14787 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:05:22 ctl02 nova-api[14787]: 2017-09-28 12:05:22.465 14787 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:05:22 ctl02 nova-api[14787]: 2017-09-28 12:05:22.465 14787 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:05:22 ctl02 nova-api[14787]: 2017-09-28 12:05:22.465 14787 ERROR nova     max_url_len=max_url_len)
Sep 28 12:05:22 ctl02 nova-api[14787]: 2017-09-28 12:05:22.465 14787 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:05:22 ctl02 nova-api[14787]: 2017-09-28 12:05:22.465 14787 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:05:22 ctl02 nova-api[14787]: 2017-09-28 12:05:22.465 14787 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:05:22 ctl02 nova-api[14787]: 2017-09-28 12:05:22.465 14787 ERROR nova     sock.listen(backlog)
Sep 28 12:05:22 ctl02 nova-api[14787]: 2017-09-28 12:05:22.465 14787 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:05:22 ctl02 nova-api[14787]: 2017-09-28 12:05:22.465 14787 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:05:22 ctl02 nova-api[14787]: 2017-09-28 12:05:22.465 14787 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:05:22 ctl02 nova-api[14787]: 2017-09-28 12:05:22.465 14787 ERROR nova
Sep 28 12:05:22 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:05:22 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:05:22 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:05:22 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:05:22 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:05:22 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:05:22 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:05:23 ctl02 glance-api[29183]: 2017-09-28 12:05:23.353 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:05:23] "OPTIONS / HTTP/1.0" 200 134 0.000568
Sep 28 12:05:23 ctl02 heat-api[13008]: 2017-09-28 12:05:23.701 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:05:23] "OPTIONS / HTTP/1.0" 200 134 0.000859
Sep 28 12:05:24 ctl02 nova-cert[4860]: 2017-09-28 12:05:24.020 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:05:24 ctl02 nova-api[14807]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:05:24 ctl02 nova-api[14807]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:05:24 ctl02 nova-api[14807]: 2017-09-28 12:05:24.691 14807 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:05:24 ctl02 nova-api[14807]: 2017-09-28 12:05:24.693 14807 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:05:24 ctl02 nova-api[14807]: 2017-09-28 12:05:24.693 14807 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:05:24 ctl02 nova-api[14807]: 2017-09-28 12:05:24.693 14807 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:05:24 ctl02 nova-api[14807]: 2017-09-28 12:05:24.693 14807 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:05:24 ctl02 nova-api[14807]: 2017-09-28 12:05:24.693 14807 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:05:24 ctl02 nova-api[14807]: 2017-09-28 12:05:24.693 14807 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:05:24 ctl02 nova-api[14807]: 2017-09-28 12:05:24.693 14807 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:05:24 ctl02 nova-api[14807]: 2017-09-28 12:05:24.693 14807 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:05:24 ctl02 nova-api[14807]: 2017-09-28 12:05:24.693 14807 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:05:24 ctl02 nova-api[14807]: 2017-09-28 12:05:24.693 14807 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:05:24 ctl02 nova-api[14807]: 2017-09-28 12:05:24.693 14807 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:05:24 ctl02 nova-api[14807]: 2017-09-28 12:05:24.693 14807 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:05:24 ctl02 nova-api[14807]: 2017-09-28 12:05:24.693 14807 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:05:24 ctl02 nova-api[14807]: 2017-09-28 12:05:24.693 14807 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:05:24 ctl02 nova-api[14807]: 2017-09-28 12:05:24.693 14807 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:05:24 ctl02 nova-api[14807]: 2017-09-28 12:05:24.693 14807 ERROR nova.wsgi     self.filename))
Sep 28 12:05:24 ctl02 nova-api[14807]: 2017-09-28 12:05:24.693 14807 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:05:24 ctl02 nova-api[14807]: 2017-09-28 12:05:24.693 14807 ERROR nova.wsgi
Sep 28 12:05:24 ctl02 nova-api[14807]: 2017-09-28 12:05:24.694 14807 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:05:24 ctl02 nova-api[14807]: 2017-09-28 12:05:24.824 14807 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:05:25 ctl02 nova-api[14807]: 2017-09-28 12:05:25.057 14807 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:05:25 ctl02 nova-api[14807]: 2017-09-28 12:05:25.059 14807 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:05:25 ctl02 nova-api[14807]: 2017-09-28 12:05:25.060 14807 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:05:25 ctl02 nova-api[14807]: 2017-09-28 12:05:25.060 14807 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:05:25 ctl02 glance-api[29183]: 2017-09-28 12:05:25.125 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:05:25] "OPTIONS / HTTP/1.0" 200 134 0.000558
Sep 28 12:05:25 ctl02 nova-api[14807]: 2017-09-28 12:05:25.194 14807 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:05:25 ctl02 nova-api[14807]: 2017-09-28 12:05:25.196 14807 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:05:25 ctl02 nova-api[14807]: 2017-09-28 12:05:25.197 14807 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:05:25 ctl02 nova-api[14807]: 2017-09-28 12:05:25.197 14807 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:05:25 ctl02 nova-api[14807]: 2017-09-28 12:05:25.200 14807 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:05:25 ctl02 nova-api[14807]: 2017-09-28 12:05:25.201 14807 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:05:25 ctl02 nova-api[14807]: 2017-09-28 12:05:25.201 14807 ERROR nova Traceback (most recent call last):
Sep 28 12:05:25 ctl02 nova-api[14807]: 2017-09-28 12:05:25.201 14807 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:05:25 ctl02 nova-api[14807]: 2017-09-28 12:05:25.201 14807 ERROR nova     sys.exit(main())
Sep 28 12:05:25 ctl02 nova-api[14807]: 2017-09-28 12:05:25.201 14807 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:05:25 ctl02 nova-api[14807]: 2017-09-28 12:05:25.201 14807 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:05:25 ctl02 nova-api[14807]: 2017-09-28 12:05:25.201 14807 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:05:25 ctl02 nova-api[14807]: 2017-09-28 12:05:25.201 14807 ERROR nova     max_url_len=max_url_len)
Sep 28 12:05:25 ctl02 nova-api[14807]: 2017-09-28 12:05:25.201 14807 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:05:25 ctl02 nova-api[14807]: 2017-09-28 12:05:25.201 14807 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:05:25 ctl02 nova-api[14807]: 2017-09-28 12:05:25.201 14807 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:05:25 ctl02 nova-api[14807]: 2017-09-28 12:05:25.201 14807 ERROR nova     sock.listen(backlog)
Sep 28 12:05:25 ctl02 nova-api[14807]: 2017-09-28 12:05:25.201 14807 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:05:25 ctl02 nova-api[14807]: 2017-09-28 12:05:25.201 14807 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:05:25 ctl02 nova-api[14807]: 2017-09-28 12:05:25.201 14807 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:05:25 ctl02 nova-api[14807]: 2017-09-28 12:05:25.201 14807 ERROR nova
Sep 28 12:05:25 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:05:25 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:05:25 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:05:25 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:05:25 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:05:25 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:05:25 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:05:25 ctl02 heat-api[13008]: 2017-09-28 12:05:25.752 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:05:25] "OPTIONS / HTTP/1.0" 200 134 0.000697
Sep 28 12:05:25 ctl02 heat-api[13008]: 2017-09-28 12:05:25.785 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:05:25] "OPTIONS / HTTP/1.0" 200 134 0.000456
Sep 28 12:05:26 ctl02 nova-conductor[5056]: 2017-09-28 12:05:26.314 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:05:26 ctl02 nova-conductor[5056]: 2017-09-28 12:05:26.340 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:05:26 ctl02 nova-conductor[5056]: 2017-09-28 12:05:26.346 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:05:26 ctl02 nova-conductor[5056]: 2017-09-28 12:05:26.351 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:05:27 ctl02 nova-api[14825]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:05:27 ctl02 nova-api[14825]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:05:27 ctl02 nova-api[14825]: 2017-09-28 12:05:27.497 14825 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:05:27 ctl02 nova-api[14825]: 2017-09-28 12:05:27.500 14825 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:05:27 ctl02 nova-api[14825]: 2017-09-28 12:05:27.500 14825 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:05:27 ctl02 nova-api[14825]: 2017-09-28 12:05:27.500 14825 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:05:27 ctl02 nova-api[14825]: 2017-09-28 12:05:27.500 14825 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:05:27 ctl02 nova-api[14825]: 2017-09-28 12:05:27.500 14825 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:05:27 ctl02 nova-api[14825]: 2017-09-28 12:05:27.500 14825 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:05:27 ctl02 nova-api[14825]: 2017-09-28 12:05:27.500 14825 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:05:27 ctl02 nova-api[14825]: 2017-09-28 12:05:27.500 14825 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:05:27 ctl02 nova-api[14825]: 2017-09-28 12:05:27.500 14825 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:05:27 ctl02 nova-api[14825]: 2017-09-28 12:05:27.500 14825 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:05:27 ctl02 nova-api[14825]: 2017-09-28 12:05:27.500 14825 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:05:27 ctl02 nova-api[14825]: 2017-09-28 12:05:27.500 14825 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:05:27 ctl02 nova-api[14825]: 2017-09-28 12:05:27.500 14825 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:05:27 ctl02 nova-api[14825]: 2017-09-28 12:05:27.500 14825 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:05:27 ctl02 nova-api[14825]: 2017-09-28 12:05:27.500 14825 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:05:27 ctl02 nova-api[14825]: 2017-09-28 12:05:27.500 14825 ERROR nova.wsgi     self.filename))
Sep 28 12:05:27 ctl02 nova-api[14825]: 2017-09-28 12:05:27.500 14825 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:05:27 ctl02 nova-api[14825]: 2017-09-28 12:05:27.500 14825 ERROR nova.wsgi
Sep 28 12:05:27 ctl02 nova-api[14825]: 2017-09-28 12:05:27.502 14825 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:05:27 ctl02 nova-api[14825]: 2017-09-28 12:05:27.635 14825 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:05:27 ctl02 nova-api[14825]: 2017-09-28 12:05:27.875 14825 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:05:27 ctl02 nova-api[14825]: 2017-09-28 12:05:27.878 14825 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:05:27 ctl02 nova-api[14825]: 2017-09-28 12:05:27.878 14825 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:05:27 ctl02 nova-api[14825]: 2017-09-28 12:05:27.878 14825 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:05:28 ctl02 nova-api[14825]: 2017-09-28 12:05:28.014 14825 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:05:28 ctl02 nova-api[14825]: 2017-09-28 12:05:28.017 14825 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:05:28 ctl02 nova-api[14825]: 2017-09-28 12:05:28.018 14825 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:05:28 ctl02 nova-api[14825]: 2017-09-28 12:05:28.018 14825 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:05:28 ctl02 nova-api[14825]: 2017-09-28 12:05:28.021 14825 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:05:28 ctl02 nova-api[14825]: 2017-09-28 12:05:28.022 14825 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:05:28 ctl02 nova-api[14825]: 2017-09-28 12:05:28.022 14825 ERROR nova Traceback (most recent call last):
Sep 28 12:05:28 ctl02 nova-api[14825]: 2017-09-28 12:05:28.022 14825 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:05:28 ctl02 nova-api[14825]: 2017-09-28 12:05:28.022 14825 ERROR nova     sys.exit(main())
Sep 28 12:05:28 ctl02 nova-api[14825]: 2017-09-28 12:05:28.022 14825 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:05:28 ctl02 nova-api[14825]: 2017-09-28 12:05:28.022 14825 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:05:28 ctl02 nova-api[14825]: 2017-09-28 12:05:28.022 14825 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:05:28 ctl02 nova-api[14825]: 2017-09-28 12:05:28.022 14825 ERROR nova     max_url_len=max_url_len)
Sep 28 12:05:28 ctl02 nova-api[14825]: 2017-09-28 12:05:28.022 14825 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:05:28 ctl02 nova-api[14825]: 2017-09-28 12:05:28.022 14825 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:05:28 ctl02 nova-api[14825]: 2017-09-28 12:05:28.022 14825 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:05:28 ctl02 nova-api[14825]: 2017-09-28 12:05:28.022 14825 ERROR nova     sock.listen(backlog)
Sep 28 12:05:28 ctl02 nova-api[14825]: 2017-09-28 12:05:28.022 14825 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:05:28 ctl02 nova-api[14825]: 2017-09-28 12:05:28.022 14825 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:05:28 ctl02 nova-api[14825]: 2017-09-28 12:05:28.022 14825 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:05:28 ctl02 nova-api[14825]: 2017-09-28 12:05:28.022 14825 ERROR nova
Sep 28 12:05:28 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:05:28 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:05:28 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:05:28 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:05:28.346 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:05:28] "OPTIONS / HTTP/1.0" 200 134 0.000502
Sep 28 12:05:28 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:05:28 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:05:28 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:05:28 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:05:29 ctl02 heat-api-cfn[13300]: 2017-09-28 12:05:29.002 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:05:29] "OPTIONS / HTTP/1.0" 200 134 0.000587
Sep 28 12:05:29 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:05:29.406 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:05:29] "OPTIONS / HTTP/1.0" 200 134 0.000520
Sep 28 12:05:29 ctl02 glance-api[29183]: 2017-09-28 12:05:29.422 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:05:29] "OPTIONS / HTTP/1.0" 200 134 0.000707
Sep 28 12:05:29 ctl02 heat-api-cfn[13300]: 2017-09-28 12:05:29.991 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:05:29] "OPTIONS / HTTP/1.0" 200 134 0.000578
Sep 28 12:05:30 ctl02 nova-api[14842]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:05:30 ctl02 nova-api[14842]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:05:30 ctl02 nova-api[14842]: 2017-09-28 12:05:30.229 14842 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:05:30 ctl02 nova-api[14842]: 2017-09-28 12:05:30.231 14842 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:05:30 ctl02 nova-api[14842]: 2017-09-28 12:05:30.231 14842 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:05:30 ctl02 nova-api[14842]: 2017-09-28 12:05:30.231 14842 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:05:30 ctl02 nova-api[14842]: 2017-09-28 12:05:30.231 14842 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:05:30 ctl02 nova-api[14842]: 2017-09-28 12:05:30.231 14842 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:05:30 ctl02 nova-api[14842]: 2017-09-28 12:05:30.231 14842 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:05:30 ctl02 nova-api[14842]: 2017-09-28 12:05:30.231 14842 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:05:30 ctl02 nova-api[14842]: 2017-09-28 12:05:30.231 14842 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:05:30 ctl02 nova-api[14842]: 2017-09-28 12:05:30.231 14842 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:05:30 ctl02 nova-api[14842]: 2017-09-28 12:05:30.231 14842 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:05:30 ctl02 nova-api[14842]: 2017-09-28 12:05:30.231 14842 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:05:30 ctl02 nova-api[14842]: 2017-09-28 12:05:30.231 14842 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:05:30 ctl02 nova-api[14842]: 2017-09-28 12:05:30.231 14842 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:05:30 ctl02 nova-api[14842]: 2017-09-28 12:05:30.231 14842 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:05:30 ctl02 nova-api[14842]: 2017-09-28 12:05:30.231 14842 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:05:30 ctl02 nova-api[14842]: 2017-09-28 12:05:30.231 14842 ERROR nova.wsgi     self.filename))
Sep 28 12:05:30 ctl02 nova-api[14842]: 2017-09-28 12:05:30.231 14842 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:05:30 ctl02 nova-api[14842]: 2017-09-28 12:05:30.231 14842 ERROR nova.wsgi
Sep 28 12:05:30 ctl02 nova-api[14842]: 2017-09-28 12:05:30.232 14842 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:05:30 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:05:30.274 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:05:30] "OPTIONS / HTTP/1.0" 200 134 0.000478
Sep 28 12:05:30 ctl02 nova-api[14842]: 2017-09-28 12:05:30.363 14842 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:05:30 ctl02 nova-api[14842]: 2017-09-28 12:05:30.602 14842 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:05:30 ctl02 nova-api[14842]: 2017-09-28 12:05:30.605 14842 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:05:30 ctl02 nova-api[14842]: 2017-09-28 12:05:30.605 14842 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:05:30 ctl02 nova-api[14842]: 2017-09-28 12:05:30.605 14842 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:05:30 ctl02 nova-api[14842]: 2017-09-28 12:05:30.737 14842 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:05:30 ctl02 nova-api[14842]: 2017-09-28 12:05:30.739 14842 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:05:30 ctl02 nova-api[14842]: 2017-09-28 12:05:30.740 14842 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:05:30 ctl02 nova-api[14842]: 2017-09-28 12:05:30.740 14842 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:05:30 ctl02 nova-api[14842]: 2017-09-28 12:05:30.743 14842 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:05:30 ctl02 nova-api[14842]: 2017-09-28 12:05:30.744 14842 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:05:30 ctl02 nova-api[14842]: 2017-09-28 12:05:30.744 14842 ERROR nova Traceback (most recent call last):
Sep 28 12:05:30 ctl02 nova-api[14842]: 2017-09-28 12:05:30.744 14842 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:05:30 ctl02 nova-api[14842]: 2017-09-28 12:05:30.744 14842 ERROR nova     sys.exit(main())
Sep 28 12:05:30 ctl02 nova-api[14842]: 2017-09-28 12:05:30.744 14842 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:05:30 ctl02 nova-api[14842]: 2017-09-28 12:05:30.744 14842 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:05:30 ctl02 nova-api[14842]: 2017-09-28 12:05:30.744 14842 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:05:30 ctl02 nova-api[14842]: 2017-09-28 12:05:30.744 14842 ERROR nova     max_url_len=max_url_len)
Sep 28 12:05:30 ctl02 nova-api[14842]: 2017-09-28 12:05:30.744 14842 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:05:30 ctl02 nova-api[14842]: 2017-09-28 12:05:30.744 14842 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:05:30 ctl02 nova-api[14842]: 2017-09-28 12:05:30.744 14842 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:05:30 ctl02 nova-api[14842]: 2017-09-28 12:05:30.744 14842 ERROR nova     sock.listen(backlog)
Sep 28 12:05:30 ctl02 nova-api[14842]: 2017-09-28 12:05:30.744 14842 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:05:30 ctl02 nova-api[14842]: 2017-09-28 12:05:30.744 14842 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:05:30 ctl02 nova-api[14842]: 2017-09-28 12:05:30.744 14842 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:05:30 ctl02 nova-api[14842]: 2017-09-28 12:05:30.744 14842 ERROR nova
Sep 28 12:05:30 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:05:30 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:05:30 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:05:31 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:05:31 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:05:31 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:05:31 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:05:31 ctl02 heat-api-cfn[13300]: 2017-09-28 12:05:31.448 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:05:31] "OPTIONS / HTTP/1.0" 200 134 0.000536
Sep 28 12:05:32 ctl02 nova-api[14862]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:05:32 ctl02 nova-api[14862]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:05:32 ctl02 nova-api[14862]: 2017-09-28 12:05:32.945 14862 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:05:32 ctl02 nova-api[14862]: 2017-09-28 12:05:32.947 14862 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:05:32 ctl02 nova-api[14862]: 2017-09-28 12:05:32.947 14862 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:05:32 ctl02 nova-api[14862]: 2017-09-28 12:05:32.947 14862 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:05:32 ctl02 nova-api[14862]: 2017-09-28 12:05:32.947 14862 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:05:32 ctl02 nova-api[14862]: 2017-09-28 12:05:32.947 14862 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:05:32 ctl02 nova-api[14862]: 2017-09-28 12:05:32.947 14862 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:05:32 ctl02 nova-api[14862]: 2017-09-28 12:05:32.947 14862 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:05:32 ctl02 nova-api[14862]: 2017-09-28 12:05:32.947 14862 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:05:32 ctl02 nova-api[14862]: 2017-09-28 12:05:32.947 14862 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:05:32 ctl02 nova-api[14862]: 2017-09-28 12:05:32.947 14862 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:05:32 ctl02 nova-api[14862]: 2017-09-28 12:05:32.947 14862 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:05:32 ctl02 nova-api[14862]: 2017-09-28 12:05:32.947 14862 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:05:32 ctl02 nova-api[14862]: 2017-09-28 12:05:32.947 14862 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:05:32 ctl02 nova-api[14862]: 2017-09-28 12:05:32.947 14862 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:05:32 ctl02 nova-api[14862]: 2017-09-28 12:05:32.947 14862 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:05:32 ctl02 nova-api[14862]: 2017-09-28 12:05:32.947 14862 ERROR nova.wsgi     self.filename))
Sep 28 12:05:32 ctl02 nova-api[14862]: 2017-09-28 12:05:32.947 14862 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:05:32 ctl02 nova-api[14862]: 2017-09-28 12:05:32.947 14862 ERROR nova.wsgi
Sep 28 12:05:32 ctl02 nova-api[14862]: 2017-09-28 12:05:32.948 14862 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:05:33 ctl02 nova-api[14862]: 2017-09-28 12:05:33.078 14862 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:05:33 ctl02 nova-api[14862]: 2017-09-28 12:05:33.313 14862 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:05:33 ctl02 nova-api[14862]: 2017-09-28 12:05:33.315 14862 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:05:33 ctl02 nova-api[14862]: 2017-09-28 12:05:33.315 14862 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:05:33 ctl02 nova-api[14862]: 2017-09-28 12:05:33.315 14862 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:05:33 ctl02 nova-api[14862]: 2017-09-28 12:05:33.447 14862 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:05:33 ctl02 nova-api[14862]: 2017-09-28 12:05:33.449 14862 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:05:33 ctl02 nova-api[14862]: 2017-09-28 12:05:33.449 14862 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:05:33 ctl02 nova-api[14862]: 2017-09-28 12:05:33.449 14862 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:05:33 ctl02 nova-api[14862]: 2017-09-28 12:05:33.453 14862 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:05:33 ctl02 nova-api[14862]: 2017-09-28 12:05:33.453 14862 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:05:33 ctl02 nova-api[14862]: 2017-09-28 12:05:33.453 14862 ERROR nova Traceback (most recent call last):
Sep 28 12:05:33 ctl02 nova-api[14862]: 2017-09-28 12:05:33.453 14862 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:05:33 ctl02 nova-api[14862]: 2017-09-28 12:05:33.453 14862 ERROR nova     sys.exit(main())
Sep 28 12:05:33 ctl02 nova-api[14862]: 2017-09-28 12:05:33.453 14862 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:05:33 ctl02 nova-api[14862]: 2017-09-28 12:05:33.453 14862 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:05:33 ctl02 nova-api[14862]: 2017-09-28 12:05:33.453 14862 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:05:33 ctl02 nova-api[14862]: 2017-09-28 12:05:33.453 14862 ERROR nova     max_url_len=max_url_len)
Sep 28 12:05:33 ctl02 nova-api[14862]: 2017-09-28 12:05:33.453 14862 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:05:33 ctl02 nova-api[14862]: 2017-09-28 12:05:33.453 14862 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:05:33 ctl02 nova-api[14862]: 2017-09-28 12:05:33.453 14862 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:05:33 ctl02 nova-api[14862]: 2017-09-28 12:05:33.453 14862 ERROR nova     sock.listen(backlog)
Sep 28 12:05:33 ctl02 nova-api[14862]: 2017-09-28 12:05:33.453 14862 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:05:33 ctl02 nova-api[14862]: 2017-09-28 12:05:33.453 14862 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:05:33 ctl02 nova-api[14862]: 2017-09-28 12:05:33.453 14862 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:05:33 ctl02 nova-api[14862]: 2017-09-28 12:05:33.453 14862 ERROR nova
Sep 28 12:05:33 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:05:33 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:05:33 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:05:33 ctl02 glance-api[29183]: 2017-09-28 12:05:33.620 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:05:33] "OPTIONS / HTTP/1.0" 200 134 0.000818
Sep 28 12:05:33 ctl02 heat-api[13008]: 2017-09-28 12:05:33.627 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:05:33] "OPTIONS / HTTP/1.0" 200 134 0.000701
Sep 28 12:05:33 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:05:33 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:05:33 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:05:33 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:05:33 ctl02 nova-consoleauth[5433]: 2017-09-28 12:05:33.915 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:05:35 ctl02 glance-api[29183]: 2017-09-28 12:05:35.240 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:05:35] "OPTIONS / HTTP/1.0" 200 134 0.000605
Sep 28 12:05:35 ctl02 nova-api[14880]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:05:35 ctl02 nova-api[14880]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:05:35 ctl02 nova-api[14880]: 2017-09-28 12:05:35.741 14880 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:05:35 ctl02 nova-api[14880]: 2017-09-28 12:05:35.743 14880 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:05:35 ctl02 nova-api[14880]: 2017-09-28 12:05:35.743 14880 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:05:35 ctl02 nova-api[14880]: 2017-09-28 12:05:35.743 14880 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:05:35 ctl02 nova-api[14880]: 2017-09-28 12:05:35.743 14880 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:05:35 ctl02 nova-api[14880]: 2017-09-28 12:05:35.743 14880 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:05:35 ctl02 nova-api[14880]: 2017-09-28 12:05:35.743 14880 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:05:35 ctl02 nova-api[14880]: 2017-09-28 12:05:35.743 14880 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:05:35 ctl02 nova-api[14880]: 2017-09-28 12:05:35.743 14880 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:05:35 ctl02 nova-api[14880]: 2017-09-28 12:05:35.743 14880 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:05:35 ctl02 nova-api[14880]: 2017-09-28 12:05:35.743 14880 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:05:35 ctl02 nova-api[14880]: 2017-09-28 12:05:35.743 14880 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:05:35 ctl02 nova-api[14880]: 2017-09-28 12:05:35.743 14880 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:05:35 ctl02 nova-api[14880]: 2017-09-28 12:05:35.743 14880 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:05:35 ctl02 nova-api[14880]: 2017-09-28 12:05:35.743 14880 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:05:35 ctl02 nova-api[14880]: 2017-09-28 12:05:35.743 14880 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:05:35 ctl02 nova-api[14880]: 2017-09-28 12:05:35.743 14880 ERROR nova.wsgi     self.filename))
Sep 28 12:05:35 ctl02 nova-api[14880]: 2017-09-28 12:05:35.743 14880 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:05:35 ctl02 nova-api[14880]: 2017-09-28 12:05:35.743 14880 ERROR nova.wsgi
Sep 28 12:05:35 ctl02 nova-api[14880]: 2017-09-28 12:05:35.744 14880 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:05:35 ctl02 nova-api[14880]: 2017-09-28 12:05:35.875 14880 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:05:36 ctl02 heat-api[13008]: 2017-09-28 12:05:36.114 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:05:36] "OPTIONS / HTTP/1.0" 200 134 0.000631
Sep 28 12:05:36 ctl02 nova-api[14880]: 2017-09-28 12:05:36.120 14880 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:05:36 ctl02 nova-api[14880]: 2017-09-28 12:05:36.122 14880 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:05:36 ctl02 nova-api[14880]: 2017-09-28 12:05:36.123 14880 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:05:36 ctl02 nova-api[14880]: 2017-09-28 12:05:36.123 14880 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:05:36 ctl02 heat-api[13008]: 2017-09-28 12:05:36.135 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:05:36] "OPTIONS / HTTP/1.0" 200 134 0.000592
Sep 28 12:05:36 ctl02 nova-api[14880]: 2017-09-28 12:05:36.256 14880 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:05:36 ctl02 nova-api[14880]: 2017-09-28 12:05:36.258 14880 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:05:36 ctl02 nova-api[14880]: 2017-09-28 12:05:36.258 14880 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:05:36 ctl02 nova-api[14880]: 2017-09-28 12:05:36.259 14880 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:05:36 ctl02 nova-api[14880]: 2017-09-28 12:05:36.262 14880 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:05:36 ctl02 nova-api[14880]: 2017-09-28 12:05:36.263 14880 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:05:36 ctl02 nova-api[14880]: 2017-09-28 12:05:36.263 14880 ERROR nova Traceback (most recent call last):
Sep 28 12:05:36 ctl02 nova-api[14880]: 2017-09-28 12:05:36.263 14880 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:05:36 ctl02 nova-api[14880]: 2017-09-28 12:05:36.263 14880 ERROR nova     sys.exit(main())
Sep 28 12:05:36 ctl02 nova-api[14880]: 2017-09-28 12:05:36.263 14880 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:05:36 ctl02 nova-api[14880]: 2017-09-28 12:05:36.263 14880 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:05:36 ctl02 nova-api[14880]: 2017-09-28 12:05:36.263 14880 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:05:36 ctl02 nova-api[14880]: 2017-09-28 12:05:36.263 14880 ERROR nova     max_url_len=max_url_len)
Sep 28 12:05:36 ctl02 nova-api[14880]: 2017-09-28 12:05:36.263 14880 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:05:36 ctl02 nova-api[14880]: 2017-09-28 12:05:36.263 14880 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:05:36 ctl02 nova-api[14880]: 2017-09-28 12:05:36.263 14880 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:05:36 ctl02 nova-api[14880]: 2017-09-28 12:05:36.263 14880 ERROR nova     sock.listen(backlog)
Sep 28 12:05:36 ctl02 nova-api[14880]: 2017-09-28 12:05:36.263 14880 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:05:36 ctl02 nova-api[14880]: 2017-09-28 12:05:36.263 14880 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:05:36 ctl02 nova-api[14880]: 2017-09-28 12:05:36.263 14880 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:05:36 ctl02 nova-api[14880]: 2017-09-28 12:05:36.263 14880 ERROR nova
Sep 28 12:05:36 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:05:36 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:05:36 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:05:36 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:05:36 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:05:36 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:05:36 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:05:36 ctl02 nova-scheduler[5620]: 2017-09-28 12:05:36.935 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:05:37 ctl02 heat-engine[12803]: 2017-09-28 12:05:37.385 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:05:37 ctl02 heat-engine[12803]: 2017-09-28 12:05:37.419 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:05:37 ctl02 heat-engine[12803]: 2017-09-28 12:05:37.437 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:05:37 ctl02 heat-engine[12803]: 2017-09-28 12:05:37.444 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:05:37 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:05:37.999 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:05:37] "OPTIONS / HTTP/1.0" 200 134 0.000476
Sep 28 12:05:38 ctl02 nova-api[14898]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:05:38 ctl02 nova-api[14898]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:05:38 ctl02 nova-api[14898]: 2017-09-28 12:05:38.451 14898 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:05:38 ctl02 nova-api[14898]: 2017-09-28 12:05:38.453 14898 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:05:38 ctl02 nova-api[14898]: 2017-09-28 12:05:38.453 14898 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:05:38 ctl02 nova-api[14898]: 2017-09-28 12:05:38.453 14898 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:05:38 ctl02 nova-api[14898]: 2017-09-28 12:05:38.453 14898 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:05:38 ctl02 nova-api[14898]: 2017-09-28 12:05:38.453 14898 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:05:38 ctl02 nova-api[14898]: 2017-09-28 12:05:38.453 14898 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:05:38 ctl02 nova-api[14898]: 2017-09-28 12:05:38.453 14898 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:05:38 ctl02 nova-api[14898]: 2017-09-28 12:05:38.453 14898 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:05:38 ctl02 nova-api[14898]: 2017-09-28 12:05:38.453 14898 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:05:38 ctl02 nova-api[14898]: 2017-09-28 12:05:38.453 14898 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:05:38 ctl02 nova-api[14898]: 2017-09-28 12:05:38.453 14898 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:05:38 ctl02 nova-api[14898]: 2017-09-28 12:05:38.453 14898 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:05:38 ctl02 nova-api[14898]: 2017-09-28 12:05:38.453 14898 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:05:38 ctl02 nova-api[14898]: 2017-09-28 12:05:38.453 14898 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:05:38 ctl02 nova-api[14898]: 2017-09-28 12:05:38.453 14898 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:05:38 ctl02 nova-api[14898]: 2017-09-28 12:05:38.453 14898 ERROR nova.wsgi     self.filename))
Sep 28 12:05:38 ctl02 nova-api[14898]: 2017-09-28 12:05:38.453 14898 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:05:38 ctl02 nova-api[14898]: 2017-09-28 12:05:38.453 14898 ERROR nova.wsgi
Sep 28 12:05:38 ctl02 nova-api[14898]: 2017-09-28 12:05:38.455 14898 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:05:38 ctl02 nova-api[14898]: 2017-09-28 12:05:38.587 14898 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:05:38 ctl02 nova-api[14898]: 2017-09-28 12:05:38.827 14898 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:05:38 ctl02 nova-api[14898]: 2017-09-28 12:05:38.830 14898 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:05:38 ctl02 nova-api[14898]: 2017-09-28 12:05:38.831 14898 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:05:38 ctl02 nova-api[14898]: 2017-09-28 12:05:38.831 14898 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:05:38 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdcd26220)
Sep 28 12:05:38 ctl02 nova-api[14898]: 2017-09-28 12:05:38.963 14898 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:05:38 ctl02 nova-api[14898]: 2017-09-28 12:05:38.965 14898 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:05:38 ctl02 nova-api[14898]: 2017-09-28 12:05:38.966 14898 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:05:38 ctl02 nova-api[14898]: 2017-09-28 12:05:38.966 14898 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:05:38 ctl02 heat-api-cfn[13300]: 2017-09-28 12:05:38.966 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:05:38] "OPTIONS / HTTP/1.0" 200 134 0.000493
Sep 28 12:05:38 ctl02 nova-api[14898]: 2017-09-28 12:05:38.969 14898 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:05:38 ctl02 nova-api[14898]: 2017-09-28 12:05:38.970 14898 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:05:38 ctl02 nova-api[14898]: 2017-09-28 12:05:38.970 14898 ERROR nova Traceback (most recent call last):
Sep 28 12:05:38 ctl02 nova-api[14898]: 2017-09-28 12:05:38.970 14898 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:05:38 ctl02 nova-api[14898]: 2017-09-28 12:05:38.970 14898 ERROR nova     sys.exit(main())
Sep 28 12:05:38 ctl02 nova-api[14898]: 2017-09-28 12:05:38.970 14898 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:05:38 ctl02 nova-api[14898]: 2017-09-28 12:05:38.970 14898 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:05:38 ctl02 nova-api[14898]: 2017-09-28 12:05:38.970 14898 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:05:38 ctl02 nova-api[14898]: 2017-09-28 12:05:38.970 14898 ERROR nova     max_url_len=max_url_len)
Sep 28 12:05:38 ctl02 nova-api[14898]: 2017-09-28 12:05:38.970 14898 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:05:38 ctl02 nova-api[14898]: 2017-09-28 12:05:38.970 14898 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:05:38 ctl02 nova-api[14898]: 2017-09-28 12:05:38.970 14898 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:05:38 ctl02 nova-api[14898]: 2017-09-28 12:05:38.970 14898 ERROR nova     sock.listen(backlog)
Sep 28 12:05:38 ctl02 nova-api[14898]: 2017-09-28 12:05:38.970 14898 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:05:38 ctl02 nova-api[14898]: 2017-09-28 12:05:38.970 14898 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:05:38 ctl02 nova-api[14898]: 2017-09-28 12:05:38.970 14898 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:05:38 ctl02 nova-api[14898]: 2017-09-28 12:05:38.970 14898 ERROR nova
Sep 28 12:05:39 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:05:39 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:05:39 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:05:39 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:05:39.227 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:05:39] "OPTIONS / HTTP/1.0" 200 134 0.000470
Sep 28 12:05:39 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:05:39 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:05:39 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:05:39 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:05:39 ctl02 heat-api-cfn[13300]: 2017-09-28 12:05:39.715 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:05:39] "OPTIONS / HTTP/1.0" 200 134 0.000471
Sep 28 12:05:39 ctl02 glance-api[29183]: 2017-09-28 12:05:39.746 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:05:39] "OPTIONS / HTTP/1.0" 200 134 0.000650
Sep 28 12:05:39 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdcd26220)
Sep 28 12:05:40 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:05:40.500 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:05:40] "OPTIONS / HTTP/1.0" 200 134 0.000452
Sep 28 12:05:40 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdcd26220)
Sep 28 12:05:41 ctl02 nova-api[14916]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:05:41 ctl02 nova-api[14916]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:05:41 ctl02 nova-api[14916]: 2017-09-28 12:05:41.216 14916 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:05:41 ctl02 nova-api[14916]: 2017-09-28 12:05:41.218 14916 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:05:41 ctl02 nova-api[14916]: 2017-09-28 12:05:41.218 14916 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:05:41 ctl02 nova-api[14916]: 2017-09-28 12:05:41.218 14916 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:05:41 ctl02 nova-api[14916]: 2017-09-28 12:05:41.218 14916 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:05:41 ctl02 nova-api[14916]: 2017-09-28 12:05:41.218 14916 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:05:41 ctl02 nova-api[14916]: 2017-09-28 12:05:41.218 14916 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:05:41 ctl02 nova-api[14916]: 2017-09-28 12:05:41.218 14916 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:05:41 ctl02 nova-api[14916]: 2017-09-28 12:05:41.218 14916 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:05:41 ctl02 nova-api[14916]: 2017-09-28 12:05:41.218 14916 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:05:41 ctl02 nova-api[14916]: 2017-09-28 12:05:41.218 14916 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:05:41 ctl02 nova-api[14916]: 2017-09-28 12:05:41.218 14916 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:05:41 ctl02 nova-api[14916]: 2017-09-28 12:05:41.218 14916 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:05:41 ctl02 nova-api[14916]: 2017-09-28 12:05:41.218 14916 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:05:41 ctl02 nova-api[14916]: 2017-09-28 12:05:41.218 14916 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:05:41 ctl02 nova-api[14916]: 2017-09-28 12:05:41.218 14916 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:05:41 ctl02 nova-api[14916]: 2017-09-28 12:05:41.218 14916 ERROR nova.wsgi     self.filename))
Sep 28 12:05:41 ctl02 nova-api[14916]: 2017-09-28 12:05:41.218 14916 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:05:41 ctl02 nova-api[14916]: 2017-09-28 12:05:41.218 14916 ERROR nova.wsgi
Sep 28 12:05:41 ctl02 nova-api[14916]: 2017-09-28 12:05:41.221 14916 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:05:41 ctl02 nova-api[14916]: 2017-09-28 12:05:41.364 14916 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:05:41 ctl02 nova-api[14916]: 2017-09-28 12:05:41.598 14916 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:05:41 ctl02 nova-api[14916]: 2017-09-28 12:05:41.600 14916 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:05:41 ctl02 nova-api[14916]: 2017-09-28 12:05:41.600 14916 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:05:41 ctl02 nova-api[14916]: 2017-09-28 12:05:41.601 14916 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:05:41 ctl02 nova-api[14916]: 2017-09-28 12:05:41.733 14916 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:05:41 ctl02 nova-api[14916]: 2017-09-28 12:05:41.735 14916 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:05:41 ctl02 nova-api[14916]: 2017-09-28 12:05:41.736 14916 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:05:41 ctl02 nova-api[14916]: 2017-09-28 12:05:41.736 14916 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:05:41 ctl02 nova-api[14916]: 2017-09-28 12:05:41.740 14916 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:05:41 ctl02 nova-api[14916]: 2017-09-28 12:05:41.740 14916 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:05:41 ctl02 nova-api[14916]: 2017-09-28 12:05:41.740 14916 ERROR nova Traceback (most recent call last):
Sep 28 12:05:41 ctl02 nova-api[14916]: 2017-09-28 12:05:41.740 14916 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:05:41 ctl02 nova-api[14916]: 2017-09-28 12:05:41.740 14916 ERROR nova     sys.exit(main())
Sep 28 12:05:41 ctl02 nova-api[14916]: 2017-09-28 12:05:41.740 14916 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:05:41 ctl02 nova-api[14916]: 2017-09-28 12:05:41.740 14916 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:05:41 ctl02 nova-api[14916]: 2017-09-28 12:05:41.740 14916 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:05:41 ctl02 nova-api[14916]: 2017-09-28 12:05:41.740 14916 ERROR nova     max_url_len=max_url_len)
Sep 28 12:05:41 ctl02 nova-api[14916]: 2017-09-28 12:05:41.740 14916 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:05:41 ctl02 nova-api[14916]: 2017-09-28 12:05:41.740 14916 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:05:41 ctl02 nova-api[14916]: 2017-09-28 12:05:41.740 14916 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:05:41 ctl02 nova-api[14916]: 2017-09-28 12:05:41.740 14916 ERROR nova     sock.listen(backlog)
Sep 28 12:05:41 ctl02 nova-api[14916]: 2017-09-28 12:05:41.740 14916 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:05:41 ctl02 nova-api[14916]: 2017-09-28 12:05:41.740 14916 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:05:41 ctl02 nova-api[14916]: 2017-09-28 12:05:41.740 14916 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:05:41 ctl02 nova-api[14916]: 2017-09-28 12:05:41.740 14916 ERROR nova
Sep 28 12:05:41 ctl02 heat-api-cfn[13300]: 2017-09-28 12:05:41.816 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:05:41] "OPTIONS / HTTP/1.0" 200 134 0.000611
Sep 28 12:05:41 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:05:41 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:05:41 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:05:41 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdcd26220)
Sep 28 12:05:42 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:05:42 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:05:42 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:05:42 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:05:42 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdcd26220)
Sep 28 12:05:43 ctl02 heat-api[13008]: 2017-09-28 12:05:43.484 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:05:43] "OPTIONS / HTTP/1.0" 200 134 0.000628
Sep 28 12:05:43 ctl02 nova-api[14934]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:05:43 ctl02 nova-api[14934]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:05:43 ctl02 glance-api[29183]: 2017-09-28 12:05:43.929 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:05:43] "OPTIONS / HTTP/1.0" 200 134 0.000647
Sep 28 12:05:43 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdcd26220)
Sep 28 12:05:43 ctl02 nova-api[14934]: 2017-09-28 12:05:43.972 14934 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:05:43 ctl02 nova-api[14934]: 2017-09-28 12:05:43.974 14934 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:05:43 ctl02 nova-api[14934]: 2017-09-28 12:05:43.974 14934 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:05:43 ctl02 nova-api[14934]: 2017-09-28 12:05:43.974 14934 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:05:43 ctl02 nova-api[14934]: 2017-09-28 12:05:43.974 14934 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:05:43 ctl02 nova-api[14934]: 2017-09-28 12:05:43.974 14934 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:05:43 ctl02 nova-api[14934]: 2017-09-28 12:05:43.974 14934 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:05:43 ctl02 nova-api[14934]: 2017-09-28 12:05:43.974 14934 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:05:43 ctl02 nova-api[14934]: 2017-09-28 12:05:43.974 14934 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:05:43 ctl02 nova-api[14934]: 2017-09-28 12:05:43.974 14934 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:05:43 ctl02 nova-api[14934]: 2017-09-28 12:05:43.974 14934 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:05:43 ctl02 nova-api[14934]: 2017-09-28 12:05:43.974 14934 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:05:43 ctl02 nova-api[14934]: 2017-09-28 12:05:43.974 14934 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:05:43 ctl02 nova-api[14934]: 2017-09-28 12:05:43.974 14934 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:05:43 ctl02 nova-api[14934]: 2017-09-28 12:05:43.974 14934 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:05:43 ctl02 nova-api[14934]: 2017-09-28 12:05:43.974 14934 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:05:43 ctl02 nova-api[14934]: 2017-09-28 12:05:43.974 14934 ERROR nova.wsgi     self.filename))
Sep 28 12:05:43 ctl02 nova-api[14934]: 2017-09-28 12:05:43.974 14934 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:05:43 ctl02 nova-api[14934]: 2017-09-28 12:05:43.974 14934 ERROR nova.wsgi
Sep 28 12:05:43 ctl02 nova-api[14934]: 2017-09-28 12:05:43.976 14934 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:05:44 ctl02 nova-api[14934]: 2017-09-28 12:05:44.112 14934 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:05:44 ctl02 nova-api[14934]: 2017-09-28 12:05:44.359 14934 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:05:44 ctl02 nova-api[14934]: 2017-09-28 12:05:44.362 14934 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:05:44 ctl02 nova-api[14934]: 2017-09-28 12:05:44.363 14934 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:05:44 ctl02 nova-api[14934]: 2017-09-28 12:05:44.363 14934 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:05:44 ctl02 nova-api[14934]: 2017-09-28 12:05:44.501 14934 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:05:44 ctl02 nova-api[14934]: 2017-09-28 12:05:44.503 14934 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:05:44 ctl02 nova-api[14934]: 2017-09-28 12:05:44.504 14934 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:05:44 ctl02 nova-api[14934]: 2017-09-28 12:05:44.504 14934 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:05:44 ctl02 nova-api[14934]: 2017-09-28 12:05:44.508 14934 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:05:44 ctl02 nova-api[14934]: 2017-09-28 12:05:44.508 14934 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:05:44 ctl02 nova-api[14934]: 2017-09-28 12:05:44.508 14934 ERROR nova Traceback (most recent call last):
Sep 28 12:05:44 ctl02 nova-api[14934]: 2017-09-28 12:05:44.508 14934 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:05:44 ctl02 nova-api[14934]: 2017-09-28 12:05:44.508 14934 ERROR nova     sys.exit(main())
Sep 28 12:05:44 ctl02 nova-api[14934]: 2017-09-28 12:05:44.508 14934 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:05:44 ctl02 nova-api[14934]: 2017-09-28 12:05:44.508 14934 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:05:44 ctl02 nova-api[14934]: 2017-09-28 12:05:44.508 14934 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:05:44 ctl02 nova-api[14934]: 2017-09-28 12:05:44.508 14934 ERROR nova     max_url_len=max_url_len)
Sep 28 12:05:44 ctl02 nova-api[14934]: 2017-09-28 12:05:44.508 14934 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:05:44 ctl02 nova-api[14934]: 2017-09-28 12:05:44.508 14934 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:05:44 ctl02 nova-api[14934]: 2017-09-28 12:05:44.508 14934 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:05:44 ctl02 nova-api[14934]: 2017-09-28 12:05:44.508 14934 ERROR nova     sock.listen(backlog)
Sep 28 12:05:44 ctl02 nova-api[14934]: 2017-09-28 12:05:44.508 14934 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:05:44 ctl02 nova-api[14934]: 2017-09-28 12:05:44.508 14934 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:05:44 ctl02 nova-api[14934]: 2017-09-28 12:05:44.508 14934 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:05:44 ctl02 nova-api[14934]: 2017-09-28 12:05:44.508 14934 ERROR nova
Sep 28 12:05:44 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:05:44 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:05:44 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:05:44 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:05:44 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:05:44 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:05:44 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:05:44 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdcd26220)
Sep 28 12:05:45 ctl02 glance-api[29183]: 2017-09-28 12:05:45.348 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:05:45] "OPTIONS / HTTP/1.0" 200 134 0.000706
Sep 28 12:05:45 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdcd26220)
Sep 28 12:05:46 ctl02 heat-api[13008]: 2017-09-28 12:05:46.255 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:05:46] "OPTIONS / HTTP/1.0" 200 134 0.000604
Sep 28 12:05:46 ctl02 heat-api[13008]: 2017-09-28 12:05:46.440 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:05:46] "OPTIONS / HTTP/1.0" 200 134 0.000459
Sep 28 12:05:46 ctl02 nova-api[14952]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:05:46 ctl02 nova-api[14952]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:05:46 ctl02 nova-api[14952]: 2017-09-28 12:05:46.682 14952 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:05:46 ctl02 nova-api[14952]: 2017-09-28 12:05:46.684 14952 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:05:46 ctl02 nova-api[14952]: 2017-09-28 12:05:46.684 14952 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:05:46 ctl02 nova-api[14952]: 2017-09-28 12:05:46.684 14952 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:05:46 ctl02 nova-api[14952]: 2017-09-28 12:05:46.684 14952 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:05:46 ctl02 nova-api[14952]: 2017-09-28 12:05:46.684 14952 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:05:46 ctl02 nova-api[14952]: 2017-09-28 12:05:46.684 14952 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:05:46 ctl02 nova-api[14952]: 2017-09-28 12:05:46.684 14952 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:05:46 ctl02 nova-api[14952]: 2017-09-28 12:05:46.684 14952 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:05:46 ctl02 nova-api[14952]: 2017-09-28 12:05:46.684 14952 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:05:46 ctl02 nova-api[14952]: 2017-09-28 12:05:46.684 14952 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:05:46 ctl02 nova-api[14952]: 2017-09-28 12:05:46.684 14952 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:05:46 ctl02 nova-api[14952]: 2017-09-28 12:05:46.684 14952 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:05:46 ctl02 nova-api[14952]: 2017-09-28 12:05:46.684 14952 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:05:46 ctl02 nova-api[14952]: 2017-09-28 12:05:46.684 14952 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:05:46 ctl02 nova-api[14952]: 2017-09-28 12:05:46.684 14952 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:05:46 ctl02 nova-api[14952]: 2017-09-28 12:05:46.684 14952 ERROR nova.wsgi     self.filename))
Sep 28 12:05:46 ctl02 nova-api[14952]: 2017-09-28 12:05:46.684 14952 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:05:46 ctl02 nova-api[14952]: 2017-09-28 12:05:46.684 14952 ERROR nova.wsgi
Sep 28 12:05:46 ctl02 nova-api[14952]: 2017-09-28 12:05:46.685 14952 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:05:46 ctl02 nova-api[14952]: 2017-09-28 12:05:46.818 14952 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:05:46 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdcd26220)
Sep 28 12:05:47 ctl02 nova-api[14952]: 2017-09-28 12:05:47.061 14952 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:05:47 ctl02 nova-api[14952]: 2017-09-28 12:05:47.063 14952 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:05:47 ctl02 nova-api[14952]: 2017-09-28 12:05:47.064 14952 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:05:47 ctl02 nova-api[14952]: 2017-09-28 12:05:47.064 14952 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:05:47 ctl02 nova-api[14952]: 2017-09-28 12:05:47.197 14952 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:05:47 ctl02 nova-api[14952]: 2017-09-28 12:05:47.199 14952 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:05:47 ctl02 nova-api[14952]: 2017-09-28 12:05:47.200 14952 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:05:47 ctl02 nova-api[14952]: 2017-09-28 12:05:47.200 14952 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:05:47 ctl02 nova-api[14952]: 2017-09-28 12:05:47.203 14952 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:05:47 ctl02 nova-api[14952]: 2017-09-28 12:05:47.203 14952 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:05:47 ctl02 nova-api[14952]: 2017-09-28 12:05:47.203 14952 ERROR nova Traceback (most recent call last):
Sep 28 12:05:47 ctl02 nova-api[14952]: 2017-09-28 12:05:47.203 14952 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:05:47 ctl02 nova-api[14952]: 2017-09-28 12:05:47.203 14952 ERROR nova     sys.exit(main())
Sep 28 12:05:47 ctl02 nova-api[14952]: 2017-09-28 12:05:47.203 14952 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:05:47 ctl02 nova-api[14952]: 2017-09-28 12:05:47.203 14952 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:05:47 ctl02 nova-api[14952]: 2017-09-28 12:05:47.203 14952 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:05:47 ctl02 nova-api[14952]: 2017-09-28 12:05:47.203 14952 ERROR nova     max_url_len=max_url_len)
Sep 28 12:05:47 ctl02 nova-api[14952]: 2017-09-28 12:05:47.203 14952 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:05:47 ctl02 nova-api[14952]: 2017-09-28 12:05:47.203 14952 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:05:47 ctl02 nova-api[14952]: 2017-09-28 12:05:47.203 14952 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:05:47 ctl02 nova-api[14952]: 2017-09-28 12:05:47.203 14952 ERROR nova     sock.listen(backlog)
Sep 28 12:05:47 ctl02 nova-api[14952]: 2017-09-28 12:05:47.203 14952 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:05:47 ctl02 nova-api[14952]: 2017-09-28 12:05:47.203 14952 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:05:47 ctl02 nova-api[14952]: 2017-09-28 12:05:47.203 14952 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:05:47 ctl02 nova-api[14952]: 2017-09-28 12:05:47.203 14952 ERROR nova
Sep 28 12:05:47 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:05:47 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:05:47 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:05:47 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:05:47 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:05:47 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:05:47 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:05:47 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:05:47.853 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:05:47] "OPTIONS / HTTP/1.0" 200 134 0.000443
Sep 28 12:05:47 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdcd26220)
Sep 28 12:05:48 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdcd26220)
Sep 28 12:05:49 ctl02 heat-api-cfn[13300]: 2017-09-28 12:05:49.171 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:05:49] "OPTIONS / HTTP/1.0" 200 134 0.000508
Sep 28 12:05:49 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:05:49.212 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:05:49] "OPTIONS / HTTP/1.0" 200 134 0.000493
Sep 28 12:05:49 ctl02 nova-api[14971]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:05:49 ctl02 nova-api[14971]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:05:49 ctl02 heat-api-cfn[13300]: 2017-09-28 12:05:49.402 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:05:49] "OPTIONS / HTTP/1.0" 200 134 0.000520
Sep 28 12:05:49 ctl02 nova-api[14971]: 2017-09-28 12:05:49.448 14971 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:05:49 ctl02 nova-api[14971]: 2017-09-28 12:05:49.450 14971 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:05:49 ctl02 nova-api[14971]: 2017-09-28 12:05:49.450 14971 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:05:49 ctl02 nova-api[14971]: 2017-09-28 12:05:49.450 14971 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:05:49 ctl02 nova-api[14971]: 2017-09-28 12:05:49.450 14971 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:05:49 ctl02 nova-api[14971]: 2017-09-28 12:05:49.450 14971 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:05:49 ctl02 nova-api[14971]: 2017-09-28 12:05:49.450 14971 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:05:49 ctl02 nova-api[14971]: 2017-09-28 12:05:49.450 14971 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:05:49 ctl02 nova-api[14971]: 2017-09-28 12:05:49.450 14971 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:05:49 ctl02 nova-api[14971]: 2017-09-28 12:05:49.450 14971 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:05:49 ctl02 nova-api[14971]: 2017-09-28 12:05:49.450 14971 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:05:49 ctl02 nova-api[14971]: 2017-09-28 12:05:49.450 14971 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:05:49 ctl02 nova-api[14971]: 2017-09-28 12:05:49.450 14971 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:05:49 ctl02 nova-api[14971]: 2017-09-28 12:05:49.450 14971 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:05:49 ctl02 nova-api[14971]: 2017-09-28 12:05:49.450 14971 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:05:49 ctl02 nova-api[14971]: 2017-09-28 12:05:49.450 14971 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:05:49 ctl02 nova-api[14971]: 2017-09-28 12:05:49.450 14971 ERROR nova.wsgi     self.filename))
Sep 28 12:05:49 ctl02 nova-api[14971]: 2017-09-28 12:05:49.450 14971 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:05:49 ctl02 nova-api[14971]: 2017-09-28 12:05:49.450 14971 ERROR nova.wsgi
Sep 28 12:05:49 ctl02 nova-api[14971]: 2017-09-28 12:05:49.451 14971 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:05:49 ctl02 nova-api[14971]: 2017-09-28 12:05:49.584 14971 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:05:49 ctl02 nova-api[14971]: 2017-09-28 12:05:49.824 14971 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:05:49 ctl02 nova-api[14971]: 2017-09-28 12:05:49.827 14971 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:05:49 ctl02 nova-api[14971]: 2017-09-28 12:05:49.827 14971 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:05:49 ctl02 nova-api[14971]: 2017-09-28 12:05:49.827 14971 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:05:49 ctl02 glance-api[29183]: 2017-09-28 12:05:49.837 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:05:49] "OPTIONS / HTTP/1.0" 200 134 0.000660
Sep 28 12:05:49 ctl02 nova-api[14971]: 2017-09-28 12:05:49.959 14971 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:05:49 ctl02 nova-api[14971]: 2017-09-28 12:05:49.961 14971 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:05:49 ctl02 nova-api[14971]: 2017-09-28 12:05:49.962 14971 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:05:49 ctl02 nova-api[14971]: 2017-09-28 12:05:49.962 14971 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:05:49 ctl02 nova-api[14971]: 2017-09-28 12:05:49.965 14971 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:05:49 ctl02 nova-api[14971]: 2017-09-28 12:05:49.965 14971 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:05:49 ctl02 nova-api[14971]: 2017-09-28 12:05:49.965 14971 ERROR nova Traceback (most recent call last):
Sep 28 12:05:49 ctl02 nova-api[14971]: 2017-09-28 12:05:49.965 14971 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:05:49 ctl02 nova-api[14971]: 2017-09-28 12:05:49.965 14971 ERROR nova     sys.exit(main())
Sep 28 12:05:49 ctl02 nova-api[14971]: 2017-09-28 12:05:49.965 14971 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:05:49 ctl02 nova-api[14971]: 2017-09-28 12:05:49.965 14971 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:05:49 ctl02 nova-api[14971]: 2017-09-28 12:05:49.965 14971 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:05:49 ctl02 nova-api[14971]: 2017-09-28 12:05:49.965 14971 ERROR nova     max_url_len=max_url_len)
Sep 28 12:05:49 ctl02 nova-api[14971]: 2017-09-28 12:05:49.965 14971 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:05:49 ctl02 nova-api[14971]: 2017-09-28 12:05:49.965 14971 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:05:49 ctl02 nova-api[14971]: 2017-09-28 12:05:49.965 14971 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:05:49 ctl02 nova-api[14971]: 2017-09-28 12:05:49.965 14971 ERROR nova     sock.listen(backlog)
Sep 28 12:05:49 ctl02 nova-api[14971]: 2017-09-28 12:05:49.965 14971 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:05:49 ctl02 nova-api[14971]: 2017-09-28 12:05:49.965 14971 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:05:49 ctl02 nova-api[14971]: 2017-09-28 12:05:49.965 14971 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:05:49 ctl02 nova-api[14971]: 2017-09-28 12:05:49.965 14971 ERROR nova
Sep 28 12:05:49 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:05:49 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:05:50 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:05:50 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:05:50 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:05:50 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:05:50 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:05:50 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:05:50 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:05:50 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:05:50.774 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:05:50] "OPTIONS / HTTP/1.0" 200 134 0.000464
Sep 28 12:05:51 ctl02 heat-api-cfn[13300]: 2017-09-28 12:05:51.988 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:05:51] "OPTIONS / HTTP/1.0" 200 134 0.000466
Sep 28 12:05:52 ctl02 nova-api[14996]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:05:52 ctl02 nova-api[14996]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:05:52 ctl02 nova-api[14996]: 2017-09-28 12:05:52.208 14996 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:05:52 ctl02 nova-api[14996]: 2017-09-28 12:05:52.210 14996 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:05:52 ctl02 nova-api[14996]: 2017-09-28 12:05:52.210 14996 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:05:52 ctl02 nova-api[14996]: 2017-09-28 12:05:52.210 14996 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:05:52 ctl02 nova-api[14996]: 2017-09-28 12:05:52.210 14996 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:05:52 ctl02 nova-api[14996]: 2017-09-28 12:05:52.210 14996 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:05:52 ctl02 nova-api[14996]: 2017-09-28 12:05:52.210 14996 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:05:52 ctl02 nova-api[14996]: 2017-09-28 12:05:52.210 14996 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:05:52 ctl02 nova-api[14996]: 2017-09-28 12:05:52.210 14996 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:05:52 ctl02 nova-api[14996]: 2017-09-28 12:05:52.210 14996 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:05:52 ctl02 nova-api[14996]: 2017-09-28 12:05:52.210 14996 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:05:52 ctl02 nova-api[14996]: 2017-09-28 12:05:52.210 14996 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:05:52 ctl02 nova-api[14996]: 2017-09-28 12:05:52.210 14996 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:05:52 ctl02 nova-api[14996]: 2017-09-28 12:05:52.210 14996 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:05:52 ctl02 nova-api[14996]: 2017-09-28 12:05:52.210 14996 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:05:52 ctl02 nova-api[14996]: 2017-09-28 12:05:52.210 14996 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:05:52 ctl02 nova-api[14996]: 2017-09-28 12:05:52.210 14996 ERROR nova.wsgi     self.filename))
Sep 28 12:05:52 ctl02 nova-api[14996]: 2017-09-28 12:05:52.210 14996 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:05:52 ctl02 nova-api[14996]: 2017-09-28 12:05:52.210 14996 ERROR nova.wsgi
Sep 28 12:05:52 ctl02 nova-api[14996]: 2017-09-28 12:05:52.211 14996 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:05:52 ctl02 nova-api[14996]: 2017-09-28 12:05:52.341 14996 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:05:52 ctl02 nova-api[14996]: 2017-09-28 12:05:52.580 14996 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:05:52 ctl02 nova-api[14996]: 2017-09-28 12:05:52.583 14996 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:05:52 ctl02 nova-api[14996]: 2017-09-28 12:05:52.583 14996 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:05:52 ctl02 nova-api[14996]: 2017-09-28 12:05:52.583 14996 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:05:52 ctl02 nova-api[14996]: 2017-09-28 12:05:52.718 14996 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:05:52 ctl02 nova-api[14996]: 2017-09-28 12:05:52.720 14996 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:05:52 ctl02 nova-api[14996]: 2017-09-28 12:05:52.720 14996 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:05:52 ctl02 nova-api[14996]: 2017-09-28 12:05:52.720 14996 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:05:52 ctl02 nova-api[14996]: 2017-09-28 12:05:52.723 14996 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:05:52 ctl02 nova-api[14996]: 2017-09-28 12:05:52.724 14996 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:05:52 ctl02 nova-api[14996]: 2017-09-28 12:05:52.724 14996 ERROR nova Traceback (most recent call last):
Sep 28 12:05:52 ctl02 nova-api[14996]: 2017-09-28 12:05:52.724 14996 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:05:52 ctl02 nova-api[14996]: 2017-09-28 12:05:52.724 14996 ERROR nova     sys.exit(main())
Sep 28 12:05:52 ctl02 nova-api[14996]: 2017-09-28 12:05:52.724 14996 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:05:52 ctl02 nova-api[14996]: 2017-09-28 12:05:52.724 14996 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:05:52 ctl02 nova-api[14996]: 2017-09-28 12:05:52.724 14996 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:05:52 ctl02 nova-api[14996]: 2017-09-28 12:05:52.724 14996 ERROR nova     max_url_len=max_url_len)
Sep 28 12:05:52 ctl02 nova-api[14996]: 2017-09-28 12:05:52.724 14996 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:05:52 ctl02 nova-api[14996]: 2017-09-28 12:05:52.724 14996 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:05:52 ctl02 nova-api[14996]: 2017-09-28 12:05:52.724 14996 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:05:52 ctl02 nova-api[14996]: 2017-09-28 12:05:52.724 14996 ERROR nova     sock.listen(backlog)
Sep 28 12:05:52 ctl02 nova-api[14996]: 2017-09-28 12:05:52.724 14996 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:05:52 ctl02 nova-api[14996]: 2017-09-28 12:05:52.724 14996 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:05:52 ctl02 nova-api[14996]: 2017-09-28 12:05:52.724 14996 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:05:52 ctl02 nova-api[14996]: 2017-09-28 12:05:52.724 14996 ERROR nova
Sep 28 12:05:52 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:05:52 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:05:52 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:05:53 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:05:53 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:05:53 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:05:53 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:05:53 ctl02 glance-api[29183]: 2017-09-28 12:05:53.687 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:05:53] "OPTIONS / HTTP/1.0" 200 134 0.000636
Sep 28 12:05:53 ctl02 heat-api[13008]: 2017-09-28 12:05:53.731 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:05:53] "OPTIONS / HTTP/1.0" 200 134 0.000617
Sep 28 12:05:54 ctl02 nova-api[15017]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:05:54 ctl02 nova-api[15017]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:05:54 ctl02 nova-api[15017]: 2017-09-28 12:05:54.947 15017 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:05:54 ctl02 nova-api[15017]: 2017-09-28 12:05:54.949 15017 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:05:54 ctl02 nova-api[15017]: 2017-09-28 12:05:54.949 15017 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:05:54 ctl02 nova-api[15017]: 2017-09-28 12:05:54.949 15017 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:05:54 ctl02 nova-api[15017]: 2017-09-28 12:05:54.949 15017 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:05:54 ctl02 nova-api[15017]: 2017-09-28 12:05:54.949 15017 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:05:54 ctl02 nova-api[15017]: 2017-09-28 12:05:54.949 15017 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:05:54 ctl02 nova-api[15017]: 2017-09-28 12:05:54.949 15017 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:05:54 ctl02 nova-api[15017]: 2017-09-28 12:05:54.949 15017 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:05:54 ctl02 nova-api[15017]: 2017-09-28 12:05:54.949 15017 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:05:54 ctl02 nova-api[15017]: 2017-09-28 12:05:54.949 15017 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:05:54 ctl02 nova-api[15017]: 2017-09-28 12:05:54.949 15017 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:05:54 ctl02 nova-api[15017]: 2017-09-28 12:05:54.949 15017 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:05:54 ctl02 nova-api[15017]: 2017-09-28 12:05:54.949 15017 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:05:54 ctl02 nova-api[15017]: 2017-09-28 12:05:54.949 15017 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:05:54 ctl02 nova-api[15017]: 2017-09-28 12:05:54.949 15017 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:05:54 ctl02 nova-api[15017]: 2017-09-28 12:05:54.949 15017 ERROR nova.wsgi     self.filename))
Sep 28 12:05:54 ctl02 nova-api[15017]: 2017-09-28 12:05:54.949 15017 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:05:54 ctl02 nova-api[15017]: 2017-09-28 12:05:54.949 15017 ERROR nova.wsgi
Sep 28 12:05:54 ctl02 nova-api[15017]: 2017-09-28 12:05:54.950 15017 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:05:55 ctl02 nova-api[15017]: 2017-09-28 12:05:55.079 15017 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:05:55 ctl02 glance-api[29183]: 2017-09-28 12:05:55.119 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:05:55] "OPTIONS / HTTP/1.0" 200 134 0.000683
Sep 28 12:05:55 ctl02 nova-api[15017]: 2017-09-28 12:05:55.317 15017 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:05:55 ctl02 nova-api[15017]: 2017-09-28 12:05:55.319 15017 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:05:55 ctl02 nova-api[15017]: 2017-09-28 12:05:55.319 15017 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:05:55 ctl02 nova-api[15017]: 2017-09-28 12:05:55.319 15017 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:05:55 ctl02 nova-api[15017]: 2017-09-28 12:05:55.450 15017 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:05:55 ctl02 nova-api[15017]: 2017-09-28 12:05:55.452 15017 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:05:55 ctl02 nova-api[15017]: 2017-09-28 12:05:55.453 15017 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:05:55 ctl02 nova-api[15017]: 2017-09-28 12:05:55.453 15017 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:05:55 ctl02 nova-api[15017]: 2017-09-28 12:05:55.456 15017 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:05:55 ctl02 nova-api[15017]: 2017-09-28 12:05:55.456 15017 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:05:55 ctl02 nova-api[15017]: 2017-09-28 12:05:55.456 15017 ERROR nova Traceback (most recent call last):
Sep 28 12:05:55 ctl02 nova-api[15017]: 2017-09-28 12:05:55.456 15017 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:05:55 ctl02 nova-api[15017]: 2017-09-28 12:05:55.456 15017 ERROR nova     sys.exit(main())
Sep 28 12:05:55 ctl02 nova-api[15017]: 2017-09-28 12:05:55.456 15017 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:05:55 ctl02 nova-api[15017]: 2017-09-28 12:05:55.456 15017 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:05:55 ctl02 nova-api[15017]: 2017-09-28 12:05:55.456 15017 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:05:55 ctl02 nova-api[15017]: 2017-09-28 12:05:55.456 15017 ERROR nova     max_url_len=max_url_len)
Sep 28 12:05:55 ctl02 nova-api[15017]: 2017-09-28 12:05:55.456 15017 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:05:55 ctl02 nova-api[15017]: 2017-09-28 12:05:55.456 15017 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:05:55 ctl02 nova-api[15017]: 2017-09-28 12:05:55.456 15017 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:05:55 ctl02 nova-api[15017]: 2017-09-28 12:05:55.456 15017 ERROR nova     sock.listen(backlog)
Sep 28 12:05:55 ctl02 nova-api[15017]: 2017-09-28 12:05:55.456 15017 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:05:55 ctl02 nova-api[15017]: 2017-09-28 12:05:55.456 15017 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:05:55 ctl02 nova-api[15017]: 2017-09-28 12:05:55.456 15017 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:05:55 ctl02 nova-api[15017]: 2017-09-28 12:05:55.456 15017 ERROR nova
Sep 28 12:05:55 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:05:55 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:05:55 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:05:55 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:05:55 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:05:55 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:05:55 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:05:56 ctl02 nova-cert[4860]: 2017-09-28 12:05:56.056 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:05:56 ctl02 heat-api[13008]: 2017-09-28 12:05:56.091 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:05:56] "OPTIONS / HTTP/1.0" 200 134 0.000660
Sep 28 12:05:56 ctl02 heat-api[13008]: 2017-09-28 12:05:56.264 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:05:56] "OPTIONS / HTTP/1.0" 200 134 0.000624
Sep 28 12:05:57 ctl02 nova-api[15035]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:05:57 ctl02 nova-api[15035]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:05:57 ctl02 nova-api[15035]: 2017-09-28 12:05:57.711 15035 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:05:57 ctl02 nova-api[15035]: 2017-09-28 12:05:57.713 15035 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:05:57 ctl02 nova-api[15035]: 2017-09-28 12:05:57.713 15035 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:05:57 ctl02 nova-api[15035]: 2017-09-28 12:05:57.713 15035 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:05:57 ctl02 nova-api[15035]: 2017-09-28 12:05:57.713 15035 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:05:57 ctl02 nova-api[15035]: 2017-09-28 12:05:57.713 15035 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:05:57 ctl02 nova-api[15035]: 2017-09-28 12:05:57.713 15035 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:05:57 ctl02 nova-api[15035]: 2017-09-28 12:05:57.713 15035 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:05:57 ctl02 nova-api[15035]: 2017-09-28 12:05:57.713 15035 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:05:57 ctl02 nova-api[15035]: 2017-09-28 12:05:57.713 15035 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:05:57 ctl02 nova-api[15035]: 2017-09-28 12:05:57.713 15035 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:05:57 ctl02 nova-api[15035]: 2017-09-28 12:05:57.713 15035 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:05:57 ctl02 nova-api[15035]: 2017-09-28 12:05:57.713 15035 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:05:57 ctl02 nova-api[15035]: 2017-09-28 12:05:57.713 15035 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:05:57 ctl02 nova-api[15035]: 2017-09-28 12:05:57.713 15035 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:05:57 ctl02 nova-api[15035]: 2017-09-28 12:05:57.713 15035 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:05:57 ctl02 nova-api[15035]: 2017-09-28 12:05:57.713 15035 ERROR nova.wsgi     self.filename))
Sep 28 12:05:57 ctl02 nova-api[15035]: 2017-09-28 12:05:57.713 15035 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:05:57 ctl02 nova-api[15035]: 2017-09-28 12:05:57.713 15035 ERROR nova.wsgi
Sep 28 12:05:57 ctl02 nova-api[15035]: 2017-09-28 12:05:57.716 15035 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:05:57 ctl02 nova-api[15035]: 2017-09-28 12:05:57.847 15035 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:05:57 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:05:57.976 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:05:57] "OPTIONS / HTTP/1.0" 200 134 0.000572
Sep 28 12:05:58 ctl02 nova-api[15035]: 2017-09-28 12:05:58.086 15035 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:05:58 ctl02 nova-api[15035]: 2017-09-28 12:05:58.088 15035 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:05:58 ctl02 nova-api[15035]: 2017-09-28 12:05:58.089 15035 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:05:58 ctl02 nova-api[15035]: 2017-09-28 12:05:58.089 15035 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:05:58 ctl02 nova-api[15035]: 2017-09-28 12:05:58.220 15035 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:05:58 ctl02 nova-api[15035]: 2017-09-28 12:05:58.223 15035 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:05:58 ctl02 nova-api[15035]: 2017-09-28 12:05:58.223 15035 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:05:58 ctl02 nova-api[15035]: 2017-09-28 12:05:58.224 15035 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:05:58 ctl02 nova-api[15035]: 2017-09-28 12:05:58.227 15035 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:05:58 ctl02 nova-api[15035]: 2017-09-28 12:05:58.228 15035 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:05:58 ctl02 nova-api[15035]: 2017-09-28 12:05:58.228 15035 ERROR nova Traceback (most recent call last):
Sep 28 12:05:58 ctl02 nova-api[15035]: 2017-09-28 12:05:58.228 15035 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:05:58 ctl02 nova-api[15035]: 2017-09-28 12:05:58.228 15035 ERROR nova     sys.exit(main())
Sep 28 12:05:58 ctl02 nova-api[15035]: 2017-09-28 12:05:58.228 15035 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:05:58 ctl02 nova-api[15035]: 2017-09-28 12:05:58.228 15035 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:05:58 ctl02 nova-api[15035]: 2017-09-28 12:05:58.228 15035 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:05:58 ctl02 nova-api[15035]: 2017-09-28 12:05:58.228 15035 ERROR nova     max_url_len=max_url_len)
Sep 28 12:05:58 ctl02 nova-api[15035]: 2017-09-28 12:05:58.228 15035 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:05:58 ctl02 nova-api[15035]: 2017-09-28 12:05:58.228 15035 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:05:58 ctl02 nova-api[15035]: 2017-09-28 12:05:58.228 15035 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:05:58 ctl02 nova-api[15035]: 2017-09-28 12:05:58.228 15035 ERROR nova     sock.listen(backlog)
Sep 28 12:05:58 ctl02 nova-api[15035]: 2017-09-28 12:05:58.228 15035 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:05:58 ctl02 nova-api[15035]: 2017-09-28 12:05:58.228 15035 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:05:58 ctl02 nova-api[15035]: 2017-09-28 12:05:58.228 15035 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:05:58 ctl02 nova-api[15035]: 2017-09-28 12:05:58.228 15035 ERROR nova
Sep 28 12:05:58 ctl02 nova-conductor[5056]: 2017-09-28 12:05:58.323 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:05:58 ctl02 nova-conductor[5056]: 2017-09-28 12:05:58.349 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:05:58 ctl02 nova-conductor[5056]: 2017-09-28 12:05:58.355 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:05:58 ctl02 nova-conductor[5056]: 2017-09-28 12:05:58.359 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:05:58 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:05:58 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:05:58 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:05:58 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:05:58 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:05:58 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:05:58 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:05:59 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:05:59.357 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:05:59] "OPTIONS / HTTP/1.0" 200 134 0.000481
Sep 28 12:05:59 ctl02 heat-api-cfn[13300]: 2017-09-28 12:05:59.396 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:05:59] "OPTIONS / HTTP/1.0" 200 134 0.000712
Sep 28 12:05:59 ctl02 heat-api-cfn[13300]: 2017-09-28 12:05:59.648 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:05:59] "OPTIONS / HTTP/1.0" 200 134 0.000627
Sep 28 12:05:59 ctl02 glance-api[29183]: 2017-09-28 12:05:59.850 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:05:59] "OPTIONS / HTTP/1.0" 200 134 0.001087
Sep 28 12:06:00 ctl02 nova-api[15053]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:06:00 ctl02 nova-api[15053]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:06:00 ctl02 nova-api[15053]: 2017-09-28 12:06:00.478 15053 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:06:00 ctl02 nova-api[15053]: 2017-09-28 12:06:00.480 15053 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:06:00 ctl02 nova-api[15053]: 2017-09-28 12:06:00.480 15053 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:06:00 ctl02 nova-api[15053]: 2017-09-28 12:06:00.480 15053 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:06:00 ctl02 nova-api[15053]: 2017-09-28 12:06:00.480 15053 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:06:00 ctl02 nova-api[15053]: 2017-09-28 12:06:00.480 15053 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:06:00 ctl02 nova-api[15053]: 2017-09-28 12:06:00.480 15053 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:06:00 ctl02 nova-api[15053]: 2017-09-28 12:06:00.480 15053 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:06:00 ctl02 nova-api[15053]: 2017-09-28 12:06:00.480 15053 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:06:00 ctl02 nova-api[15053]: 2017-09-28 12:06:00.480 15053 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:06:00 ctl02 nova-api[15053]: 2017-09-28 12:06:00.480 15053 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:06:00 ctl02 nova-api[15053]: 2017-09-28 12:06:00.480 15053 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:06:00 ctl02 nova-api[15053]: 2017-09-28 12:06:00.480 15053 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:06:00 ctl02 nova-api[15053]: 2017-09-28 12:06:00.480 15053 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:06:00 ctl02 nova-api[15053]: 2017-09-28 12:06:00.480 15053 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:06:00 ctl02 nova-api[15053]: 2017-09-28 12:06:00.480 15053 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:06:00 ctl02 nova-api[15053]: 2017-09-28 12:06:00.480 15053 ERROR nova.wsgi     self.filename))
Sep 28 12:06:00 ctl02 nova-api[15053]: 2017-09-28 12:06:00.480 15053 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:06:00 ctl02 nova-api[15053]: 2017-09-28 12:06:00.480 15053 ERROR nova.wsgi
Sep 28 12:06:00 ctl02 nova-api[15053]: 2017-09-28 12:06:00.481 15053 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:06:00 ctl02 nova-api[15053]: 2017-09-28 12:06:00.612 15053 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:06:00 ctl02 nova-api[15053]: 2017-09-28 12:06:00.850 15053 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:06:00 ctl02 nova-api[15053]: 2017-09-28 12:06:00.852 15053 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:06:00 ctl02 nova-api[15053]: 2017-09-28 12:06:00.852 15053 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:06:00 ctl02 nova-api[15053]: 2017-09-28 12:06:00.852 15053 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:06:00 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:06:00.872 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:06:00] "OPTIONS / HTTP/1.0" 200 134 0.000493
Sep 28 12:06:00 ctl02 nova-api[15053]: 2017-09-28 12:06:00.984 15053 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:06:00 ctl02 nova-api[15053]: 2017-09-28 12:06:00.986 15053 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:06:00 ctl02 nova-api[15053]: 2017-09-28 12:06:00.987 15053 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:06:00 ctl02 nova-api[15053]: 2017-09-28 12:06:00.987 15053 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:06:00 ctl02 nova-api[15053]: 2017-09-28 12:06:00.990 15053 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:06:00 ctl02 nova-api[15053]: 2017-09-28 12:06:00.990 15053 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:06:00 ctl02 nova-api[15053]: 2017-09-28 12:06:00.990 15053 ERROR nova Traceback (most recent call last):
Sep 28 12:06:00 ctl02 nova-api[15053]: 2017-09-28 12:06:00.990 15053 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:06:00 ctl02 nova-api[15053]: 2017-09-28 12:06:00.990 15053 ERROR nova     sys.exit(main())
Sep 28 12:06:00 ctl02 nova-api[15053]: 2017-09-28 12:06:00.990 15053 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:06:00 ctl02 nova-api[15053]: 2017-09-28 12:06:00.990 15053 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:06:00 ctl02 nova-api[15053]: 2017-09-28 12:06:00.990 15053 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:06:00 ctl02 nova-api[15053]: 2017-09-28 12:06:00.990 15053 ERROR nova     max_url_len=max_url_len)
Sep 28 12:06:00 ctl02 nova-api[15053]: 2017-09-28 12:06:00.990 15053 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:06:00 ctl02 nova-api[15053]: 2017-09-28 12:06:00.990 15053 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:06:00 ctl02 nova-api[15053]: 2017-09-28 12:06:00.990 15053 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:06:00 ctl02 nova-api[15053]: 2017-09-28 12:06:00.990 15053 ERROR nova     sock.listen(backlog)
Sep 28 12:06:00 ctl02 nova-api[15053]: 2017-09-28 12:06:00.990 15053 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:06:00 ctl02 nova-api[15053]: 2017-09-28 12:06:00.990 15053 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:06:00 ctl02 nova-api[15053]: 2017-09-28 12:06:00.990 15053 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:06:00 ctl02 nova-api[15053]: 2017-09-28 12:06:00.990 15053 ERROR nova
Sep 28 12:06:01 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:06:01 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:06:01 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:06:01 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:06:01 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:06:01 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:06:01 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:06:02 ctl02 heat-api-cfn[13300]: 2017-09-28 12:06:02.316 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:06:02] "OPTIONS / HTTP/1.0" 200 134 0.000522
Sep 28 12:06:03 ctl02 nova-api[15070]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:06:03 ctl02 nova-api[15070]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:06:03 ctl02 nova-api[15070]: 2017-09-28 12:06:03.203 15070 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:06:03 ctl02 nova-api[15070]: 2017-09-28 12:06:03.205 15070 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:06:03 ctl02 nova-api[15070]: 2017-09-28 12:06:03.205 15070 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:06:03 ctl02 nova-api[15070]: 2017-09-28 12:06:03.205 15070 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:06:03 ctl02 nova-api[15070]: 2017-09-28 12:06:03.205 15070 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:06:03 ctl02 nova-api[15070]: 2017-09-28 12:06:03.205 15070 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:06:03 ctl02 nova-api[15070]: 2017-09-28 12:06:03.205 15070 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:06:03 ctl02 nova-api[15070]: 2017-09-28 12:06:03.205 15070 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:06:03 ctl02 nova-api[15070]: 2017-09-28 12:06:03.205 15070 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:06:03 ctl02 nova-api[15070]: 2017-09-28 12:06:03.205 15070 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:06:03 ctl02 nova-api[15070]: 2017-09-28 12:06:03.205 15070 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:06:03 ctl02 nova-api[15070]: 2017-09-28 12:06:03.205 15070 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:06:03 ctl02 nova-api[15070]: 2017-09-28 12:06:03.205 15070 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:06:03 ctl02 nova-api[15070]: 2017-09-28 12:06:03.205 15070 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:06:03 ctl02 nova-api[15070]: 2017-09-28 12:06:03.205 15070 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:06:03 ctl02 nova-api[15070]: 2017-09-28 12:06:03.205 15070 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:06:03 ctl02 nova-api[15070]: 2017-09-28 12:06:03.205 15070 ERROR nova.wsgi     self.filename))
Sep 28 12:06:03 ctl02 nova-api[15070]: 2017-09-28 12:06:03.205 15070 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:06:03 ctl02 nova-api[15070]: 2017-09-28 12:06:03.205 15070 ERROR nova.wsgi
Sep 28 12:06:03 ctl02 nova-api[15070]: 2017-09-28 12:06:03.206 15070 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:06:03 ctl02 nova-api[15070]: 2017-09-28 12:06:03.339 15070 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:06:03 ctl02 heat-api[13008]: 2017-09-28 12:06:03.362 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:06:03] "OPTIONS / HTTP/1.0" 200 134 0.000629
Sep 28 12:06:03 ctl02 nova-api[15070]: 2017-09-28 12:06:03.578 15070 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:06:03 ctl02 nova-api[15070]: 2017-09-28 12:06:03.580 15070 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:06:03 ctl02 nova-api[15070]: 2017-09-28 12:06:03.581 15070 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:06:03 ctl02 nova-api[15070]: 2017-09-28 12:06:03.581 15070 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:06:03 ctl02 glance-api[29183]: 2017-09-28 12:06:03.650 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:06:03] "OPTIONS / HTTP/1.0" 200 134 0.000685
Sep 28 12:06:03 ctl02 nova-api[15070]: 2017-09-28 12:06:03.713 15070 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:06:03 ctl02 nova-api[15070]: 2017-09-28 12:06:03.715 15070 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:06:03 ctl02 nova-api[15070]: 2017-09-28 12:06:03.715 15070 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:06:03 ctl02 nova-api[15070]: 2017-09-28 12:06:03.716 15070 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:06:03 ctl02 nova-api[15070]: 2017-09-28 12:06:03.719 15070 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:06:03 ctl02 nova-api[15070]: 2017-09-28 12:06:03.720 15070 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:06:03 ctl02 nova-api[15070]: 2017-09-28 12:06:03.720 15070 ERROR nova Traceback (most recent call last):
Sep 28 12:06:03 ctl02 nova-api[15070]: 2017-09-28 12:06:03.720 15070 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:06:03 ctl02 nova-api[15070]: 2017-09-28 12:06:03.720 15070 ERROR nova     sys.exit(main())
Sep 28 12:06:03 ctl02 nova-api[15070]: 2017-09-28 12:06:03.720 15070 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:06:03 ctl02 nova-api[15070]: 2017-09-28 12:06:03.720 15070 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:06:03 ctl02 nova-api[15070]: 2017-09-28 12:06:03.720 15070 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:06:03 ctl02 nova-api[15070]: 2017-09-28 12:06:03.720 15070 ERROR nova     max_url_len=max_url_len)
Sep 28 12:06:03 ctl02 nova-api[15070]: 2017-09-28 12:06:03.720 15070 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:06:03 ctl02 nova-api[15070]: 2017-09-28 12:06:03.720 15070 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:06:03 ctl02 nova-api[15070]: 2017-09-28 12:06:03.720 15070 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:06:03 ctl02 nova-api[15070]: 2017-09-28 12:06:03.720 15070 ERROR nova     sock.listen(backlog)
Sep 28 12:06:03 ctl02 nova-api[15070]: 2017-09-28 12:06:03.720 15070 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:06:03 ctl02 nova-api[15070]: 2017-09-28 12:06:03.720 15070 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:06:03 ctl02 nova-api[15070]: 2017-09-28 12:06:03.720 15070 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:06:03 ctl02 nova-api[15070]: 2017-09-28 12:06:03.720 15070 ERROR nova
Sep 28 12:06:03 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:06:03 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:06:03 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:06:04 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:06:04 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:06:04 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:06:04 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:06:05 ctl02 glance-api[29183]: 2017-09-28 12:06:05.142 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:06:05] "OPTIONS / HTTP/1.0" 200 134 0.000617
Sep 28 12:06:05 ctl02 nova-api[15089]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:06:05 ctl02 nova-api[15089]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:06:05 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc573975e)
Sep 28 12:06:05 ctl02 nova-consoleauth[5433]: 2017-09-28 12:06:05.952 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:06:05 ctl02 nova-api[15089]: 2017-09-28 12:06:05.979 15089 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:06:05 ctl02 nova-api[15089]: 2017-09-28 12:06:05.981 15089 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:06:05 ctl02 nova-api[15089]: 2017-09-28 12:06:05.981 15089 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:06:05 ctl02 nova-api[15089]: 2017-09-28 12:06:05.981 15089 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:06:05 ctl02 nova-api[15089]: 2017-09-28 12:06:05.981 15089 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:06:05 ctl02 nova-api[15089]: 2017-09-28 12:06:05.981 15089 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:06:05 ctl02 nova-api[15089]: 2017-09-28 12:06:05.981 15089 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:06:05 ctl02 nova-api[15089]: 2017-09-28 12:06:05.981 15089 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:06:05 ctl02 nova-api[15089]: 2017-09-28 12:06:05.981 15089 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:06:05 ctl02 nova-api[15089]: 2017-09-28 12:06:05.981 15089 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:06:05 ctl02 nova-api[15089]: 2017-09-28 12:06:05.981 15089 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:06:05 ctl02 nova-api[15089]: 2017-09-28 12:06:05.981 15089 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:06:05 ctl02 nova-api[15089]: 2017-09-28 12:06:05.981 15089 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:06:05 ctl02 nova-api[15089]: 2017-09-28 12:06:05.981 15089 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:06:05 ctl02 nova-api[15089]: 2017-09-28 12:06:05.981 15089 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:06:05 ctl02 nova-api[15089]: 2017-09-28 12:06:05.981 15089 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:06:05 ctl02 nova-api[15089]: 2017-09-28 12:06:05.981 15089 ERROR nova.wsgi     self.filename))
Sep 28 12:06:05 ctl02 nova-api[15089]: 2017-09-28 12:06:05.981 15089 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:06:05 ctl02 nova-api[15089]: 2017-09-28 12:06:05.981 15089 ERROR nova.wsgi
Sep 28 12:06:05 ctl02 nova-api[15089]: 2017-09-28 12:06:05.982 15089 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:06:06 ctl02 nova-api[15089]: 2017-09-28 12:06:06.123 15089 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:06:06 ctl02 nova-api[15089]: 2017-09-28 12:06:06.368 15089 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:06:06 ctl02 nova-api[15089]: 2017-09-28 12:06:06.370 15089 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:06:06 ctl02 nova-api[15089]: 2017-09-28 12:06:06.370 15089 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:06:06 ctl02 nova-api[15089]: 2017-09-28 12:06:06.371 15089 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:06:06 ctl02 heat-api[13008]: 2017-09-28 12:06:06.446 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:06:06] "OPTIONS / HTTP/1.0" 200 134 0.000621
Sep 28 12:06:06 ctl02 nova-api[15089]: 2017-09-28 12:06:06.506 15089 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:06:06 ctl02 nova-api[15089]: 2017-09-28 12:06:06.508 15089 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:06:06 ctl02 nova-api[15089]: 2017-09-28 12:06:06.508 15089 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:06:06 ctl02 nova-api[15089]: 2017-09-28 12:06:06.509 15089 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:06:06 ctl02 nova-api[15089]: 2017-09-28 12:06:06.512 15089 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:06:06 ctl02 nova-api[15089]: 2017-09-28 12:06:06.512 15089 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:06:06 ctl02 nova-api[15089]: 2017-09-28 12:06:06.512 15089 ERROR nova Traceback (most recent call last):
Sep 28 12:06:06 ctl02 nova-api[15089]: 2017-09-28 12:06:06.512 15089 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:06:06 ctl02 nova-api[15089]: 2017-09-28 12:06:06.512 15089 ERROR nova     sys.exit(main())
Sep 28 12:06:06 ctl02 nova-api[15089]: 2017-09-28 12:06:06.512 15089 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:06:06 ctl02 nova-api[15089]: 2017-09-28 12:06:06.512 15089 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:06:06 ctl02 nova-api[15089]: 2017-09-28 12:06:06.512 15089 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:06:06 ctl02 nova-api[15089]: 2017-09-28 12:06:06.512 15089 ERROR nova     max_url_len=max_url_len)
Sep 28 12:06:06 ctl02 nova-api[15089]: 2017-09-28 12:06:06.512 15089 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:06:06 ctl02 nova-api[15089]: 2017-09-28 12:06:06.512 15089 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:06:06 ctl02 nova-api[15089]: 2017-09-28 12:06:06.512 15089 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:06:06 ctl02 nova-api[15089]: 2017-09-28 12:06:06.512 15089 ERROR nova     sock.listen(backlog)
Sep 28 12:06:06 ctl02 nova-api[15089]: 2017-09-28 12:06:06.512 15089 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:06:06 ctl02 nova-api[15089]: 2017-09-28 12:06:06.512 15089 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:06:06 ctl02 nova-api[15089]: 2017-09-28 12:06:06.512 15089 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:06:06 ctl02 nova-api[15089]: 2017-09-28 12:06:06.512 15089 ERROR nova
Sep 28 12:06:06 ctl02 heat-api[13008]: 2017-09-28 12:06:06.613 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:06:06] "OPTIONS / HTTP/1.0" 200 134 0.000657
Sep 28 12:06:06 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:06:06 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:06:06 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:06:06 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:06:06 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:06:06 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc573975e)
Sep 28 12:06:06 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:06:06 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:06:07 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:06:07.865 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:06:07] "OPTIONS / HTTP/1.0" 200 134 0.000435
Sep 28 12:06:07 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc573975e)
Sep 28 12:06:08 ctl02 nova-api[15107]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:06:08 ctl02 nova-api[15107]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:06:08 ctl02 nova-api[15107]: 2017-09-28 12:06:08.750 15107 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:06:08 ctl02 nova-api[15107]: 2017-09-28 12:06:08.752 15107 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:06:08 ctl02 nova-api[15107]: 2017-09-28 12:06:08.752 15107 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:06:08 ctl02 nova-api[15107]: 2017-09-28 12:06:08.752 15107 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:06:08 ctl02 nova-api[15107]: 2017-09-28 12:06:08.752 15107 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:06:08 ctl02 nova-api[15107]: 2017-09-28 12:06:08.752 15107 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:06:08 ctl02 nova-api[15107]: 2017-09-28 12:06:08.752 15107 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:06:08 ctl02 nova-api[15107]: 2017-09-28 12:06:08.752 15107 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:06:08 ctl02 nova-api[15107]: 2017-09-28 12:06:08.752 15107 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:06:08 ctl02 nova-api[15107]: 2017-09-28 12:06:08.752 15107 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:06:08 ctl02 nova-api[15107]: 2017-09-28 12:06:08.752 15107 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:06:08 ctl02 nova-api[15107]: 2017-09-28 12:06:08.752 15107 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:06:08 ctl02 nova-api[15107]: 2017-09-28 12:06:08.752 15107 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:06:08 ctl02 nova-api[15107]: 2017-09-28 12:06:08.752 15107 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:06:08 ctl02 nova-api[15107]: 2017-09-28 12:06:08.752 15107 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:06:08 ctl02 nova-api[15107]: 2017-09-28 12:06:08.752 15107 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:06:08 ctl02 nova-api[15107]: 2017-09-28 12:06:08.752 15107 ERROR nova.wsgi     self.filename))
Sep 28 12:06:08 ctl02 nova-api[15107]: 2017-09-28 12:06:08.752 15107 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:06:08 ctl02 nova-api[15107]: 2017-09-28 12:06:08.752 15107 ERROR nova.wsgi
Sep 28 12:06:08 ctl02 nova-api[15107]: 2017-09-28 12:06:08.753 15107 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:06:08 ctl02 nova-api[15107]: 2017-09-28 12:06:08.891 15107 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:06:08 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc573975e)
Sep 28 12:06:08 ctl02 nova-scheduler[5620]: 2017-09-28 12:06:08.972 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:06:09 ctl02 nova-api[15107]: 2017-09-28 12:06:09.147 15107 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:06:09 ctl02 nova-api[15107]: 2017-09-28 12:06:09.150 15107 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:06:09 ctl02 nova-api[15107]: 2017-09-28 12:06:09.150 15107 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:06:09 ctl02 nova-api[15107]: 2017-09-28 12:06:09.151 15107 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:06:09 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:06:09.235 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:06:09] "OPTIONS / HTTP/1.0" 200 134 0.000494
Sep 28 12:06:09 ctl02 nova-api[15107]: 2017-09-28 12:06:09.288 15107 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:06:09 ctl02 nova-api[15107]: 2017-09-28 12:06:09.290 15107 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:06:09 ctl02 nova-api[15107]: 2017-09-28 12:06:09.291 15107 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:06:09 ctl02 nova-api[15107]: 2017-09-28 12:06:09.291 15107 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:06:09 ctl02 nova-api[15107]: 2017-09-28 12:06:09.294 15107 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:06:09 ctl02 nova-api[15107]: 2017-09-28 12:06:09.295 15107 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:06:09 ctl02 nova-api[15107]: 2017-09-28 12:06:09.295 15107 ERROR nova Traceback (most recent call last):
Sep 28 12:06:09 ctl02 nova-api[15107]: 2017-09-28 12:06:09.295 15107 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:06:09 ctl02 nova-api[15107]: 2017-09-28 12:06:09.295 15107 ERROR nova     sys.exit(main())
Sep 28 12:06:09 ctl02 nova-api[15107]: 2017-09-28 12:06:09.295 15107 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:06:09 ctl02 nova-api[15107]: 2017-09-28 12:06:09.295 15107 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:06:09 ctl02 nova-api[15107]: 2017-09-28 12:06:09.295 15107 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:06:09 ctl02 nova-api[15107]: 2017-09-28 12:06:09.295 15107 ERROR nova     max_url_len=max_url_len)
Sep 28 12:06:09 ctl02 nova-api[15107]: 2017-09-28 12:06:09.295 15107 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:06:09 ctl02 nova-api[15107]: 2017-09-28 12:06:09.295 15107 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:06:09 ctl02 nova-api[15107]: 2017-09-28 12:06:09.295 15107 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:06:09 ctl02 nova-api[15107]: 2017-09-28 12:06:09.295 15107 ERROR nova     sock.listen(backlog)
Sep 28 12:06:09 ctl02 nova-api[15107]: 2017-09-28 12:06:09.295 15107 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:06:09 ctl02 nova-api[15107]: 2017-09-28 12:06:09.295 15107 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:06:09 ctl02 nova-api[15107]: 2017-09-28 12:06:09.295 15107 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:06:09 ctl02 nova-api[15107]: 2017-09-28 12:06:09.295 15107 ERROR nova
Sep 28 12:06:09 ctl02 heat-api-cfn[13300]: 2017-09-28 12:06:09.372 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:06:09] "OPTIONS / HTTP/1.0" 200 134 0.000643
Sep 28 12:06:09 ctl02 heat-engine[12803]: 2017-09-28 12:06:09.395 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:06:09 ctl02 heat-engine[12803]: 2017-09-28 12:06:09.427 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:06:09 ctl02 heat-engine[12803]: 2017-09-28 12:06:09.445 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:06:09 ctl02 heat-engine[12803]: 2017-09-28 12:06:09.453 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:06:09 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:06:09 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:06:09 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:06:09 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:06:09 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:06:09 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:06:09 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:06:09 ctl02 heat-api-cfn[13300]: 2017-09-28 12:06:09.725 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:06:09] "OPTIONS / HTTP/1.0" 200 134 0.000482
Sep 28 12:06:09 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc573975e)
Sep 28 12:06:09 ctl02 glance-api[29183]: 2017-09-28 12:06:09.993 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:06:09] "OPTIONS / HTTP/1.0" 200 134 0.001062
Sep 28 12:06:10 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc573975e)
Sep 28 12:06:11 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:06:11.028 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:06:11] "OPTIONS / HTTP/1.0" 200 134 0.000537
Sep 28 12:06:11 ctl02 nova-api[15124]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:06:11 ctl02 nova-api[15124]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:06:11 ctl02 nova-api[15124]: 2017-09-28 12:06:11.464 15124 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:06:11 ctl02 nova-api[15124]: 2017-09-28 12:06:11.467 15124 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:06:11 ctl02 nova-api[15124]: 2017-09-28 12:06:11.467 15124 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:06:11 ctl02 nova-api[15124]: 2017-09-28 12:06:11.467 15124 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:06:11 ctl02 nova-api[15124]: 2017-09-28 12:06:11.467 15124 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:06:11 ctl02 nova-api[15124]: 2017-09-28 12:06:11.467 15124 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:06:11 ctl02 nova-api[15124]: 2017-09-28 12:06:11.467 15124 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:06:11 ctl02 nova-api[15124]: 2017-09-28 12:06:11.467 15124 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:06:11 ctl02 nova-api[15124]: 2017-09-28 12:06:11.467 15124 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:06:11 ctl02 nova-api[15124]: 2017-09-28 12:06:11.467 15124 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:06:11 ctl02 nova-api[15124]: 2017-09-28 12:06:11.467 15124 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:06:11 ctl02 nova-api[15124]: 2017-09-28 12:06:11.467 15124 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:06:11 ctl02 nova-api[15124]: 2017-09-28 12:06:11.467 15124 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:06:11 ctl02 nova-api[15124]: 2017-09-28 12:06:11.467 15124 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:06:11 ctl02 nova-api[15124]: 2017-09-28 12:06:11.467 15124 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:06:11 ctl02 nova-api[15124]: 2017-09-28 12:06:11.467 15124 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:06:11 ctl02 nova-api[15124]: 2017-09-28 12:06:11.467 15124 ERROR nova.wsgi     self.filename))
Sep 28 12:06:11 ctl02 nova-api[15124]: 2017-09-28 12:06:11.467 15124 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:06:11 ctl02 nova-api[15124]: 2017-09-28 12:06:11.467 15124 ERROR nova.wsgi
Sep 28 12:06:11 ctl02 nova-api[15124]: 2017-09-28 12:06:11.469 15124 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:06:11 ctl02 nova-api[15124]: 2017-09-28 12:06:11.600 15124 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:06:11 ctl02 nova-api[15124]: 2017-09-28 12:06:11.839 15124 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:06:11 ctl02 nova-api[15124]: 2017-09-28 12:06:11.842 15124 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:06:11 ctl02 nova-api[15124]: 2017-09-28 12:06:11.842 15124 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:06:11 ctl02 nova-api[15124]: 2017-09-28 12:06:11.843 15124 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:06:11 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc573975e)
Sep 28 12:06:11 ctl02 nova-api[15124]: 2017-09-28 12:06:11.975 15124 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:06:11 ctl02 nova-api[15124]: 2017-09-28 12:06:11.977 15124 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:06:11 ctl02 nova-api[15124]: 2017-09-28 12:06:11.977 15124 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:06:11 ctl02 nova-api[15124]: 2017-09-28 12:06:11.978 15124 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:06:11 ctl02 nova-api[15124]: 2017-09-28 12:06:11.981 15124 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:06:11 ctl02 nova-api[15124]: 2017-09-28 12:06:11.981 15124 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:06:11 ctl02 nova-api[15124]: 2017-09-28 12:06:11.981 15124 ERROR nova Traceback (most recent call last):
Sep 28 12:06:11 ctl02 nova-api[15124]: 2017-09-28 12:06:11.981 15124 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:06:11 ctl02 nova-api[15124]: 2017-09-28 12:06:11.981 15124 ERROR nova     sys.exit(main())
Sep 28 12:06:11 ctl02 nova-api[15124]: 2017-09-28 12:06:11.981 15124 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:06:11 ctl02 nova-api[15124]: 2017-09-28 12:06:11.981 15124 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:06:11 ctl02 nova-api[15124]: 2017-09-28 12:06:11.981 15124 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:06:11 ctl02 nova-api[15124]: 2017-09-28 12:06:11.981 15124 ERROR nova     max_url_len=max_url_len)
Sep 28 12:06:11 ctl02 nova-api[15124]: 2017-09-28 12:06:11.981 15124 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:06:11 ctl02 nova-api[15124]: 2017-09-28 12:06:11.981 15124 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:06:11 ctl02 nova-api[15124]: 2017-09-28 12:06:11.981 15124 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:06:11 ctl02 nova-api[15124]: 2017-09-28 12:06:11.981 15124 ERROR nova     sock.listen(backlog)
Sep 28 12:06:11 ctl02 nova-api[15124]: 2017-09-28 12:06:11.981 15124 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:06:11 ctl02 nova-api[15124]: 2017-09-28 12:06:11.981 15124 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:06:11 ctl02 nova-api[15124]: 2017-09-28 12:06:11.981 15124 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:06:11 ctl02 nova-api[15124]: 2017-09-28 12:06:11.981 15124 ERROR nova
Sep 28 12:06:12 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:06:12 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:06:12 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:06:12 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:06:12 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:06:12 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:06:12 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:06:12 ctl02 heat-api-cfn[13300]: 2017-09-28 12:06:12.481 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:06:12] "OPTIONS / HTTP/1.0" 200 134 0.000767
Sep 28 12:06:12 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc573975e)
Sep 28 12:06:13 ctl02 heat-api[13008]: 2017-09-28 12:06:13.088 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:06:13] "OPTIONS / HTTP/1.0" 200 134 0.000570
Sep 28 12:06:13 ctl02 glance-api[29183]: 2017-09-28 12:06:13.624 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:06:13] "OPTIONS / HTTP/1.0" 200 134 0.000634
Sep 28 12:06:13 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc573975e)
Sep 28 12:06:14 ctl02 nova-api[15143]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:06:14 ctl02 nova-api[15143]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:06:14 ctl02 nova-api[15143]: 2017-09-28 12:06:14.198 15143 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:06:14 ctl02 nova-api[15143]: 2017-09-28 12:06:14.200 15143 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:06:14 ctl02 nova-api[15143]: 2017-09-28 12:06:14.200 15143 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:06:14 ctl02 nova-api[15143]: 2017-09-28 12:06:14.200 15143 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:06:14 ctl02 nova-api[15143]: 2017-09-28 12:06:14.200 15143 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:06:14 ctl02 nova-api[15143]: 2017-09-28 12:06:14.200 15143 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:06:14 ctl02 nova-api[15143]: 2017-09-28 12:06:14.200 15143 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:06:14 ctl02 nova-api[15143]: 2017-09-28 12:06:14.200 15143 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:06:14 ctl02 nova-api[15143]: 2017-09-28 12:06:14.200 15143 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:06:14 ctl02 nova-api[15143]: 2017-09-28 12:06:14.200 15143 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:06:14 ctl02 nova-api[15143]: 2017-09-28 12:06:14.200 15143 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:06:14 ctl02 nova-api[15143]: 2017-09-28 12:06:14.200 15143 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:06:14 ctl02 nova-api[15143]: 2017-09-28 12:06:14.200 15143 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:06:14 ctl02 nova-api[15143]: 2017-09-28 12:06:14.200 15143 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:06:14 ctl02 nova-api[15143]: 2017-09-28 12:06:14.200 15143 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:06:14 ctl02 nova-api[15143]: 2017-09-28 12:06:14.200 15143 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:06:14 ctl02 nova-api[15143]: 2017-09-28 12:06:14.200 15143 ERROR nova.wsgi     self.filename))
Sep 28 12:06:14 ctl02 nova-api[15143]: 2017-09-28 12:06:14.200 15143 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:06:14 ctl02 nova-api[15143]: 2017-09-28 12:06:14.200 15143 ERROR nova.wsgi
Sep 28 12:06:14 ctl02 nova-api[15143]: 2017-09-28 12:06:14.201 15143 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:06:14 ctl02 nova-api[15143]: 2017-09-28 12:06:14.331 15143 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:06:14 ctl02 nova-api[15143]: 2017-09-28 12:06:14.563 15143 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:06:14 ctl02 nova-api[15143]: 2017-09-28 12:06:14.565 15143 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:06:14 ctl02 nova-api[15143]: 2017-09-28 12:06:14.565 15143 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:06:14 ctl02 nova-api[15143]: 2017-09-28 12:06:14.565 15143 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:06:14 ctl02 nova-api[15143]: 2017-09-28 12:06:14.697 15143 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:06:14 ctl02 nova-api[15143]: 2017-09-28 12:06:14.699 15143 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:06:14 ctl02 nova-api[15143]: 2017-09-28 12:06:14.699 15143 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:06:14 ctl02 nova-api[15143]: 2017-09-28 12:06:14.699 15143 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:06:14 ctl02 nova-api[15143]: 2017-09-28 12:06:14.703 15143 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:06:14 ctl02 nova-api[15143]: 2017-09-28 12:06:14.703 15143 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:06:14 ctl02 nova-api[15143]: 2017-09-28 12:06:14.703 15143 ERROR nova Traceback (most recent call last):
Sep 28 12:06:14 ctl02 nova-api[15143]: 2017-09-28 12:06:14.703 15143 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:06:14 ctl02 nova-api[15143]: 2017-09-28 12:06:14.703 15143 ERROR nova     sys.exit(main())
Sep 28 12:06:14 ctl02 nova-api[15143]: 2017-09-28 12:06:14.703 15143 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:06:14 ctl02 nova-api[15143]: 2017-09-28 12:06:14.703 15143 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:06:14 ctl02 nova-api[15143]: 2017-09-28 12:06:14.703 15143 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:06:14 ctl02 nova-api[15143]: 2017-09-28 12:06:14.703 15143 ERROR nova     max_url_len=max_url_len)
Sep 28 12:06:14 ctl02 nova-api[15143]: 2017-09-28 12:06:14.703 15143 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:06:14 ctl02 nova-api[15143]: 2017-09-28 12:06:14.703 15143 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:06:14 ctl02 nova-api[15143]: 2017-09-28 12:06:14.703 15143 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:06:14 ctl02 nova-api[15143]: 2017-09-28 12:06:14.703 15143 ERROR nova     sock.listen(backlog)
Sep 28 12:06:14 ctl02 nova-api[15143]: 2017-09-28 12:06:14.703 15143 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:06:14 ctl02 nova-api[15143]: 2017-09-28 12:06:14.703 15143 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:06:14 ctl02 nova-api[15143]: 2017-09-28 12:06:14.703 15143 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:06:14 ctl02 nova-api[15143]: 2017-09-28 12:06:14.703 15143 ERROR nova
Sep 28 12:06:14 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:06:14 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:06:14 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:06:14 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc573975e)
Sep 28 12:06:14 ctl02 glance-api[29183]: 2017-09-28 12:06:14.991 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:06:14] "OPTIONS / HTTP/1.0" 200 134 0.000744
Sep 28 12:06:15 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:06:15 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:06:15 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:06:15 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:06:15 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc573975e)
Sep 28 12:06:16 ctl02 heat-api[13008]: 2017-09-28 12:06:16.337 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:06:16] "OPTIONS / HTTP/1.0" 200 134 0.000538
Sep 28 12:06:16 ctl02 nova-api[15160]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:06:16 ctl02 nova-api[15160]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:06:16 ctl02 heat-api[13008]: 2017-09-28 12:06:16.792 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:06:16] "OPTIONS / HTTP/1.0" 200 134 0.000578
Sep 28 12:06:16 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:06:16 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:06:16 ctl02 nova-api[15160]: 2017-09-28 12:06:16.949 15160 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:06:16 ctl02 nova-api[15160]: 2017-09-28 12:06:16.951 15160 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:06:16 ctl02 nova-api[15160]: 2017-09-28 12:06:16.951 15160 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:06:16 ctl02 nova-api[15160]: 2017-09-28 12:06:16.951 15160 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:06:16 ctl02 nova-api[15160]: 2017-09-28 12:06:16.951 15160 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:06:16 ctl02 nova-api[15160]: 2017-09-28 12:06:16.951 15160 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:06:16 ctl02 nova-api[15160]: 2017-09-28 12:06:16.951 15160 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:06:16 ctl02 nova-api[15160]: 2017-09-28 12:06:16.951 15160 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:06:16 ctl02 nova-api[15160]: 2017-09-28 12:06:16.951 15160 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:06:16 ctl02 nova-api[15160]: 2017-09-28 12:06:16.951 15160 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:06:16 ctl02 nova-api[15160]: 2017-09-28 12:06:16.951 15160 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:06:16 ctl02 nova-api[15160]: 2017-09-28 12:06:16.951 15160 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:06:16 ctl02 nova-api[15160]: 2017-09-28 12:06:16.951 15160 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:06:16 ctl02 nova-api[15160]: 2017-09-28 12:06:16.951 15160 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:06:16 ctl02 nova-api[15160]: 2017-09-28 12:06:16.951 15160 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:06:16 ctl02 nova-api[15160]: 2017-09-28 12:06:16.951 15160 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:06:16 ctl02 nova-api[15160]: 2017-09-28 12:06:16.951 15160 ERROR nova.wsgi     self.filename))
Sep 28 12:06:16 ctl02 nova-api[15160]: 2017-09-28 12:06:16.951 15160 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:06:16 ctl02 nova-api[15160]: 2017-09-28 12:06:16.951 15160 ERROR nova.wsgi
Sep 28 12:06:16 ctl02 nova-api[15160]: 2017-09-28 12:06:16.952 15160 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:06:17 ctl02 nova-api[15160]: 2017-09-28 12:06:17.079 15160 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:06:17 ctl02 nova-api[15160]: 2017-09-28 12:06:17.305 15160 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:06:17 ctl02 nova-api[15160]: 2017-09-28 12:06:17.307 15160 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:06:17 ctl02 nova-api[15160]: 2017-09-28 12:06:17.307 15160 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:06:17 ctl02 nova-api[15160]: 2017-09-28 12:06:17.307 15160 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:06:17 ctl02 nova-api[15160]: 2017-09-28 12:06:17.437 15160 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:06:17 ctl02 nova-api[15160]: 2017-09-28 12:06:17.439 15160 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:06:17 ctl02 nova-api[15160]: 2017-09-28 12:06:17.439 15160 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:06:17 ctl02 nova-api[15160]: 2017-09-28 12:06:17.439 15160 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:06:17 ctl02 nova-api[15160]: 2017-09-28 12:06:17.443 15160 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:06:17 ctl02 nova-api[15160]: 2017-09-28 12:06:17.443 15160 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:06:17 ctl02 nova-api[15160]: 2017-09-28 12:06:17.443 15160 ERROR nova Traceback (most recent call last):
Sep 28 12:06:17 ctl02 nova-api[15160]: 2017-09-28 12:06:17.443 15160 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:06:17 ctl02 nova-api[15160]: 2017-09-28 12:06:17.443 15160 ERROR nova     sys.exit(main())
Sep 28 12:06:17 ctl02 nova-api[15160]: 2017-09-28 12:06:17.443 15160 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:06:17 ctl02 nova-api[15160]: 2017-09-28 12:06:17.443 15160 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:06:17 ctl02 nova-api[15160]: 2017-09-28 12:06:17.443 15160 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:06:17 ctl02 nova-api[15160]: 2017-09-28 12:06:17.443 15160 ERROR nova     max_url_len=max_url_len)
Sep 28 12:06:17 ctl02 nova-api[15160]: 2017-09-28 12:06:17.443 15160 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:06:17 ctl02 nova-api[15160]: 2017-09-28 12:06:17.443 15160 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:06:17 ctl02 nova-api[15160]: 2017-09-28 12:06:17.443 15160 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:06:17 ctl02 nova-api[15160]: 2017-09-28 12:06:17.443 15160 ERROR nova     sock.listen(backlog)
Sep 28 12:06:17 ctl02 nova-api[15160]: 2017-09-28 12:06:17.443 15160 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:06:17 ctl02 nova-api[15160]: 2017-09-28 12:06:17.443 15160 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:06:17 ctl02 nova-api[15160]: 2017-09-28 12:06:17.443 15160 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:06:17 ctl02 nova-api[15160]: 2017-09-28 12:06:17.443 15160 ERROR nova
Sep 28 12:06:17 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:06:17 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:06:17 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:06:17 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:06:17.597 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:06:17] "OPTIONS / HTTP/1.0" 200 134 0.000436
Sep 28 12:06:17 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:06:17 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:06:17 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:06:17 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:06:19 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:06:19.031 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:06:19] "OPTIONS / HTTP/1.0" 200 134 0.000407
Sep 28 12:06:19 ctl02 nova-api[15184]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:06:19 ctl02 nova-api[15184]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:06:19 ctl02 heat-api-cfn[13300]: 2017-09-28 12:06:19.609 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:06:19] "OPTIONS / HTTP/1.0" 200 134 0.000465
Sep 28 12:06:19 ctl02 nova-api[15184]: 2017-09-28 12:06:19.715 15184 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:06:19 ctl02 nova-api[15184]: 2017-09-28 12:06:19.717 15184 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:06:19 ctl02 nova-api[15184]: 2017-09-28 12:06:19.717 15184 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:06:19 ctl02 nova-api[15184]: 2017-09-28 12:06:19.717 15184 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:06:19 ctl02 nova-api[15184]: 2017-09-28 12:06:19.717 15184 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:06:19 ctl02 nova-api[15184]: 2017-09-28 12:06:19.717 15184 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:06:19 ctl02 nova-api[15184]: 2017-09-28 12:06:19.717 15184 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:06:19 ctl02 nova-api[15184]: 2017-09-28 12:06:19.717 15184 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:06:19 ctl02 nova-api[15184]: 2017-09-28 12:06:19.717 15184 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:06:19 ctl02 nova-api[15184]: 2017-09-28 12:06:19.717 15184 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:06:19 ctl02 nova-api[15184]: 2017-09-28 12:06:19.717 15184 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:06:19 ctl02 nova-api[15184]: 2017-09-28 12:06:19.717 15184 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:06:19 ctl02 nova-api[15184]: 2017-09-28 12:06:19.717 15184 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:06:19 ctl02 nova-api[15184]: 2017-09-28 12:06:19.717 15184 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:06:19 ctl02 nova-api[15184]: 2017-09-28 12:06:19.717 15184 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:06:19 ctl02 nova-api[15184]: 2017-09-28 12:06:19.717 15184 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:06:19 ctl02 nova-api[15184]: 2017-09-28 12:06:19.717 15184 ERROR nova.wsgi     self.filename))
Sep 28 12:06:19 ctl02 nova-api[15184]: 2017-09-28 12:06:19.717 15184 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:06:19 ctl02 nova-api[15184]: 2017-09-28 12:06:19.717 15184 ERROR nova.wsgi
Sep 28 12:06:19 ctl02 nova-api[15184]: 2017-09-28 12:06:19.718 15184 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:06:19 ctl02 heat-api-cfn[13300]: 2017-09-28 12:06:19.747 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:06:19] "OPTIONS / HTTP/1.0" 200 134 0.000470
Sep 28 12:06:19 ctl02 nova-api[15184]: 2017-09-28 12:06:19.849 15184 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:06:20 ctl02 nova-api[15184]: 2017-09-28 12:06:20.093 15184 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:06:20 ctl02 nova-api[15184]: 2017-09-28 12:06:20.095 15184 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:06:20 ctl02 nova-api[15184]: 2017-09-28 12:06:20.095 15184 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:06:20 ctl02 nova-api[15184]: 2017-09-28 12:06:20.096 15184 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:06:20 ctl02 nova-api[15184]: 2017-09-28 12:06:20.229 15184 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:06:20 ctl02 nova-api[15184]: 2017-09-28 12:06:20.231 15184 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:06:20 ctl02 nova-api[15184]: 2017-09-28 12:06:20.231 15184 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:06:20 ctl02 nova-api[15184]: 2017-09-28 12:06:20.231 15184 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:06:20 ctl02 nova-api[15184]: 2017-09-28 12:06:20.234 15184 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:06:20 ctl02 nova-api[15184]: 2017-09-28 12:06:20.235 15184 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:06:20 ctl02 nova-api[15184]: 2017-09-28 12:06:20.235 15184 ERROR nova Traceback (most recent call last):
Sep 28 12:06:20 ctl02 nova-api[15184]: 2017-09-28 12:06:20.235 15184 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:06:20 ctl02 nova-api[15184]: 2017-09-28 12:06:20.235 15184 ERROR nova     sys.exit(main())
Sep 28 12:06:20 ctl02 nova-api[15184]: 2017-09-28 12:06:20.235 15184 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:06:20 ctl02 nova-api[15184]: 2017-09-28 12:06:20.235 15184 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:06:20 ctl02 nova-api[15184]: 2017-09-28 12:06:20.235 15184 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:06:20 ctl02 nova-api[15184]: 2017-09-28 12:06:20.235 15184 ERROR nova     max_url_len=max_url_len)
Sep 28 12:06:20 ctl02 nova-api[15184]: 2017-09-28 12:06:20.235 15184 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:06:20 ctl02 nova-api[15184]: 2017-09-28 12:06:20.235 15184 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:06:20 ctl02 nova-api[15184]: 2017-09-28 12:06:20.235 15184 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:06:20 ctl02 nova-api[15184]: 2017-09-28 12:06:20.235 15184 ERROR nova     sock.listen(backlog)
Sep 28 12:06:20 ctl02 nova-api[15184]: 2017-09-28 12:06:20.235 15184 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:06:20 ctl02 nova-api[15184]: 2017-09-28 12:06:20.235 15184 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:06:20 ctl02 nova-api[15184]: 2017-09-28 12:06:20.235 15184 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:06:20 ctl02 nova-api[15184]: 2017-09-28 12:06:20.235 15184 ERROR nova
Sep 28 12:06:20 ctl02 glance-api[29183]: 2017-09-28 12:06:20.257 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:06:20] "OPTIONS / HTTP/1.0" 200 134 0.000624
Sep 28 12:06:20 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:06:20 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:06:20 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:06:20 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:06:20 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:06:20 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:06:20 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:06:20 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command state.sls with jid 20170928120620713934
Sep 28 12:06:20 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 15209
Sep 28 12:06:21 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:06:21.272 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:06:21] "OPTIONS / HTTP/1.0" 200 134 0.000431
Sep 28 12:06:22 ctl02 nova-api[15202]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:06:22 ctl02 nova-api[15202]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:06:22 ctl02 salt-minion[14967]: [INFO    ] Loading fresh modules for state activity
Sep 28 12:06:22 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'cinder/init.sls'
Sep 28 12:06:22 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'cinder/controller.sls'
Sep 28 12:06:22 ctl02 nova-api[15202]: 2017-09-28 12:06:22.429 15202 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:06:22 ctl02 nova-api[15202]: 2017-09-28 12:06:22.431 15202 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:06:22 ctl02 nova-api[15202]: 2017-09-28 12:06:22.431 15202 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:06:22 ctl02 nova-api[15202]: 2017-09-28 12:06:22.431 15202 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:06:22 ctl02 nova-api[15202]: 2017-09-28 12:06:22.431 15202 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:06:22 ctl02 nova-api[15202]: 2017-09-28 12:06:22.431 15202 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:06:22 ctl02 nova-api[15202]: 2017-09-28 12:06:22.431 15202 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:06:22 ctl02 nova-api[15202]: 2017-09-28 12:06:22.431 15202 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:06:22 ctl02 nova-api[15202]: 2017-09-28 12:06:22.431 15202 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:06:22 ctl02 nova-api[15202]: 2017-09-28 12:06:22.431 15202 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:06:22 ctl02 nova-api[15202]: 2017-09-28 12:06:22.431 15202 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:06:22 ctl02 nova-api[15202]: 2017-09-28 12:06:22.431 15202 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:06:22 ctl02 nova-api[15202]: 2017-09-28 12:06:22.431 15202 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:06:22 ctl02 nova-api[15202]: 2017-09-28 12:06:22.431 15202 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:06:22 ctl02 nova-api[15202]: 2017-09-28 12:06:22.431 15202 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:06:22 ctl02 nova-api[15202]: 2017-09-28 12:06:22.431 15202 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:06:22 ctl02 nova-api[15202]: 2017-09-28 12:06:22.431 15202 ERROR nova.wsgi     self.filename))
Sep 28 12:06:22 ctl02 nova-api[15202]: 2017-09-28 12:06:22.431 15202 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:06:22 ctl02 nova-api[15202]: 2017-09-28 12:06:22.431 15202 ERROR nova.wsgi
Sep 28 12:06:22 ctl02 nova-api[15202]: 2017-09-28 12:06:22.432 15202 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:06:22 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'cinder/map.jinja'
Sep 28 12:06:22 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'cinder/user.sls'
Sep 28 12:06:22 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'cinder/volume.sls'
Sep 28 12:06:22 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'cinder/map.jinja'
Sep 28 12:06:22 ctl02 salt-minion[14967]: [INFO    ] Running state [cinder] at time 12:06:22.549104
Sep 28 12:06:22 ctl02 salt-minion[14967]: [INFO    ] Executing state group.present for cinder
Sep 28 12:06:22 ctl02 salt-minion[14967]: [INFO    ] Executing command 'groupadd -g 304 -r cinder' in directory '/root'
Sep 28 12:06:22 ctl02 nova-api[15202]: 2017-09-28 12:06:22.563 15202 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:06:22 ctl02 heat-api-cfn[13300]: 2017-09-28 12:06:22.693 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:06:22] "OPTIONS / HTTP/1.0" 200 134 0.000567
Sep 28 12:06:22 ctl02 salt-minion[14967]: [INFO    ] {'passwd': 'x', 'gid': 304, 'name': 'cinder', 'members': []}
Sep 28 12:06:22 ctl02 salt-minion[14967]: [INFO    ] Completed state [cinder] at time 12:06:22.699256 duration_in_ms=150.153
Sep 28 12:06:22 ctl02 salt-minion[14967]: [INFO    ] Running state [cinder] at time 12:06:22.699532
Sep 28 12:06:22 ctl02 salt-minion[14967]: [INFO    ] Executing state user.present for cinder
Sep 28 12:06:22 ctl02 salt-minion[14967]: [INFO    ] Executing command ['useradd', '-s', '/bin/false', '-u', '304', '-g', '304', '-m', '-d', '/var/lib/cinder', '-r', 'cinder'] in directory '/root'
Sep 28 12:06:22 ctl02 salt-minion[14967]: [INFO    ] {'shell': '/bin/false', 'workphone': '', 'uid': 304, 'passwd': 'x', 'roomnumber': '', 'groups': ['cinder'], 'home': '/var/lib/cinder', 'name': 'cinder', 'gid': 304, 'fullname': '', 'homephone': ''}
Sep 28 12:06:22 ctl02 salt-minion[14967]: [INFO    ] Completed state [cinder] at time 12:06:22.803123 duration_in_ms=103.59
Sep 28 12:06:22 ctl02 nova-api[15202]: 2017-09-28 12:06:22.818 15202 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:06:22 ctl02 nova-api[15202]: 2017-09-28 12:06:22.820 15202 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:06:22 ctl02 nova-api[15202]: 2017-09-28 12:06:22.820 15202 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:06:22 ctl02 nova-api[15202]: 2017-09-28 12:06:22.821 15202 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:06:22 ctl02 nova-api[15202]: 2017-09-28 12:06:22.954 15202 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:06:22 ctl02 nova-api[15202]: 2017-09-28 12:06:22.956 15202 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:06:22 ctl02 nova-api[15202]: 2017-09-28 12:06:22.956 15202 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:06:22 ctl02 nova-api[15202]: 2017-09-28 12:06:22.957 15202 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:06:22 ctl02 nova-api[15202]: 2017-09-28 12:06:22.960 15202 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:06:22 ctl02 nova-api[15202]: 2017-09-28 12:06:22.960 15202 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:06:22 ctl02 nova-api[15202]: 2017-09-28 12:06:22.960 15202 ERROR nova Traceback (most recent call last):
Sep 28 12:06:22 ctl02 nova-api[15202]: 2017-09-28 12:06:22.960 15202 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:06:22 ctl02 nova-api[15202]: 2017-09-28 12:06:22.960 15202 ERROR nova     sys.exit(main())
Sep 28 12:06:22 ctl02 nova-api[15202]: 2017-09-28 12:06:22.960 15202 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:06:22 ctl02 nova-api[15202]: 2017-09-28 12:06:22.960 15202 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:06:22 ctl02 nova-api[15202]: 2017-09-28 12:06:22.960 15202 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:06:22 ctl02 nova-api[15202]: 2017-09-28 12:06:22.960 15202 ERROR nova     max_url_len=max_url_len)
Sep 28 12:06:22 ctl02 nova-api[15202]: 2017-09-28 12:06:22.960 15202 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:06:22 ctl02 nova-api[15202]: 2017-09-28 12:06:22.960 15202 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:06:22 ctl02 nova-api[15202]: 2017-09-28 12:06:22.960 15202 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:06:22 ctl02 nova-api[15202]: 2017-09-28 12:06:22.960 15202 ERROR nova     sock.listen(backlog)
Sep 28 12:06:22 ctl02 nova-api[15202]: 2017-09-28 12:06:22.960 15202 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:06:22 ctl02 nova-api[15202]: 2017-09-28 12:06:22.960 15202 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:06:22 ctl02 nova-api[15202]: 2017-09-28 12:06:22.960 15202 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:06:22 ctl02 nova-api[15202]: 2017-09-28 12:06:22.960 15202 ERROR nova
Sep 28 12:06:23 ctl02 heat-api[13008]: 2017-09-28 12:06:23.076 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:06:23] "OPTIONS / HTTP/1.0" 200 134 0.000572
Sep 28 12:06:23 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:06:23 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:06:23 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:06:23 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:06:23 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:06:23 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:06:23 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:06:23 ctl02 glance-api[29183]: 2017-09-28 12:06:23.528 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:06:23] "OPTIONS / HTTP/1.0" 200 134 0.000566
Sep 28 12:06:23 ctl02 salt-minion[14967]: [INFO    ] Running state [python-cinder] at time 12:06:23.580956
Sep 28 12:06:23 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for python-cinder
Sep 28 12:06:23 ctl02 salt-minion[14967]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 12:06:24 ctl02 salt-minion[14967]: [INFO    ] Executing command ['apt-get', '-q', 'update'] in directory '/root'
Sep 28 12:06:24 ctl02 glance-api[29183]: 2017-09-28 12:06:24.676 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:06:24] "OPTIONS / HTTP/1.0" 200 134 0.000598
Sep 28 12:06:25 ctl02 nova-api[15244]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:06:25 ctl02 nova-api[15244]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:06:25 ctl02 nova-api[15244]: 2017-09-28 12:06:25.216 15244 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:06:25 ctl02 nova-api[15244]: 2017-09-28 12:06:25.218 15244 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:06:25 ctl02 nova-api[15244]: 2017-09-28 12:06:25.218 15244 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:06:25 ctl02 nova-api[15244]: 2017-09-28 12:06:25.218 15244 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:06:25 ctl02 nova-api[15244]: 2017-09-28 12:06:25.218 15244 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:06:25 ctl02 nova-api[15244]: 2017-09-28 12:06:25.218 15244 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:06:25 ctl02 nova-api[15244]: 2017-09-28 12:06:25.218 15244 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:06:25 ctl02 nova-api[15244]: 2017-09-28 12:06:25.218 15244 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:06:25 ctl02 nova-api[15244]: 2017-09-28 12:06:25.218 15244 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:06:25 ctl02 nova-api[15244]: 2017-09-28 12:06:25.218 15244 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:06:25 ctl02 nova-api[15244]: 2017-09-28 12:06:25.218 15244 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:06:25 ctl02 nova-api[15244]: 2017-09-28 12:06:25.218 15244 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:06:25 ctl02 nova-api[15244]: 2017-09-28 12:06:25.218 15244 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:06:25 ctl02 nova-api[15244]: 2017-09-28 12:06:25.218 15244 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:06:25 ctl02 nova-api[15244]: 2017-09-28 12:06:25.218 15244 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:06:25 ctl02 nova-api[15244]: 2017-09-28 12:06:25.218 15244 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:06:25 ctl02 nova-api[15244]: 2017-09-28 12:06:25.218 15244 ERROR nova.wsgi     self.filename))
Sep 28 12:06:25 ctl02 nova-api[15244]: 2017-09-28 12:06:25.218 15244 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:06:25 ctl02 nova-api[15244]: 2017-09-28 12:06:25.218 15244 ERROR nova.wsgi
Sep 28 12:06:25 ctl02 nova-api[15244]: 2017-09-28 12:06:25.219 15244 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:06:25 ctl02 nova-api[15244]: 2017-09-28 12:06:25.346 15244 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:06:25 ctl02 nova-api[15244]: 2017-09-28 12:06:25.573 15244 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:06:25 ctl02 nova-api[15244]: 2017-09-28 12:06:25.575 15244 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:06:25 ctl02 nova-api[15244]: 2017-09-28 12:06:25.575 15244 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:06:25 ctl02 nova-api[15244]: 2017-09-28 12:06:25.575 15244 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:06:25 ctl02 nova-api[15244]: 2017-09-28 12:06:25.707 15244 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:06:25 ctl02 nova-api[15244]: 2017-09-28 12:06:25.709 15244 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:06:25 ctl02 nova-api[15244]: 2017-09-28 12:06:25.709 15244 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:06:25 ctl02 nova-api[15244]: 2017-09-28 12:06:25.710 15244 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:06:25 ctl02 nova-api[15244]: 2017-09-28 12:06:25.713 15244 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:06:25 ctl02 nova-api[15244]: 2017-09-28 12:06:25.713 15244 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:06:25 ctl02 nova-api[15244]: 2017-09-28 12:06:25.713 15244 ERROR nova Traceback (most recent call last):
Sep 28 12:06:25 ctl02 nova-api[15244]: 2017-09-28 12:06:25.713 15244 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:06:25 ctl02 nova-api[15244]: 2017-09-28 12:06:25.713 15244 ERROR nova     sys.exit(main())
Sep 28 12:06:25 ctl02 nova-api[15244]: 2017-09-28 12:06:25.713 15244 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:06:25 ctl02 nova-api[15244]: 2017-09-28 12:06:25.713 15244 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:06:25 ctl02 nova-api[15244]: 2017-09-28 12:06:25.713 15244 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:06:25 ctl02 nova-api[15244]: 2017-09-28 12:06:25.713 15244 ERROR nova     max_url_len=max_url_len)
Sep 28 12:06:25 ctl02 nova-api[15244]: 2017-09-28 12:06:25.713 15244 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:06:25 ctl02 nova-api[15244]: 2017-09-28 12:06:25.713 15244 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:06:25 ctl02 nova-api[15244]: 2017-09-28 12:06:25.713 15244 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:06:25 ctl02 nova-api[15244]: 2017-09-28 12:06:25.713 15244 ERROR nova     sock.listen(backlog)
Sep 28 12:06:25 ctl02 nova-api[15244]: 2017-09-28 12:06:25.713 15244 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:06:25 ctl02 nova-api[15244]: 2017-09-28 12:06:25.713 15244 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:06:25 ctl02 nova-api[15244]: 2017-09-28 12:06:25.713 15244 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:06:25 ctl02 nova-api[15244]: 2017-09-28 12:06:25.713 15244 ERROR nova
Sep 28 12:06:25 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:06:25 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:06:25 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:06:26 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:06:26 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:06:26 ctl02 heat-api[13008]: 2017-09-28 12:06:26.140 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:06:26] "OPTIONS / HTTP/1.0" 200 134 0.000811
Sep 28 12:06:26 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:06:26 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:06:26 ctl02 heat-api[13008]: 2017-09-28 12:06:26.881 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:06:26] "OPTIONS / HTTP/1.0" 200 134 0.000523
Sep 28 12:06:27 ctl02 nova-api[15534]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:06:27 ctl02 nova-api[15534]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:06:27 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:06:27.819 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:06:27] "OPTIONS / HTTP/1.0" 200 134 0.000479
Sep 28 12:06:27 ctl02 nova-api[15534]: 2017-09-28 12:06:27.934 15534 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:06:27 ctl02 nova-api[15534]: 2017-09-28 12:06:27.936 15534 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:06:27 ctl02 nova-api[15534]: 2017-09-28 12:06:27.936 15534 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:06:27 ctl02 nova-api[15534]: 2017-09-28 12:06:27.936 15534 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:06:27 ctl02 nova-api[15534]: 2017-09-28 12:06:27.936 15534 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:06:27 ctl02 nova-api[15534]: 2017-09-28 12:06:27.936 15534 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:06:27 ctl02 nova-api[15534]: 2017-09-28 12:06:27.936 15534 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:06:27 ctl02 nova-api[15534]: 2017-09-28 12:06:27.936 15534 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:06:27 ctl02 nova-api[15534]: 2017-09-28 12:06:27.936 15534 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:06:27 ctl02 nova-api[15534]: 2017-09-28 12:06:27.936 15534 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:06:27 ctl02 nova-api[15534]: 2017-09-28 12:06:27.936 15534 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:06:27 ctl02 nova-api[15534]: 2017-09-28 12:06:27.936 15534 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:06:27 ctl02 nova-api[15534]: 2017-09-28 12:06:27.936 15534 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:06:27 ctl02 nova-api[15534]: 2017-09-28 12:06:27.936 15534 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:06:27 ctl02 nova-api[15534]: 2017-09-28 12:06:27.936 15534 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:06:27 ctl02 nova-api[15534]: 2017-09-28 12:06:27.936 15534 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:06:27 ctl02 nova-api[15534]: 2017-09-28 12:06:27.936 15534 ERROR nova.wsgi     self.filename))
Sep 28 12:06:27 ctl02 nova-api[15534]: 2017-09-28 12:06:27.936 15534 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:06:27 ctl02 nova-api[15534]: 2017-09-28 12:06:27.936 15534 ERROR nova.wsgi
Sep 28 12:06:27 ctl02 nova-api[15534]: 2017-09-28 12:06:27.937 15534 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:06:28 ctl02 nova-api[15534]: 2017-09-28 12:06:28.063 15534 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:06:28 ctl02 nova-cert[4860]: 2017-09-28 12:06:28.094 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:06:28 ctl02 nova-api[15534]: 2017-09-28 12:06:28.293 15534 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:06:28 ctl02 nova-api[15534]: 2017-09-28 12:06:28.295 15534 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:06:28 ctl02 nova-api[15534]: 2017-09-28 12:06:28.295 15534 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:06:28 ctl02 nova-api[15534]: 2017-09-28 12:06:28.295 15534 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:06:28 ctl02 nova-api[15534]: 2017-09-28 12:06:28.425 15534 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:06:28 ctl02 nova-api[15534]: 2017-09-28 12:06:28.427 15534 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:06:28 ctl02 nova-api[15534]: 2017-09-28 12:06:28.428 15534 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:06:28 ctl02 nova-api[15534]: 2017-09-28 12:06:28.428 15534 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:06:28 ctl02 nova-api[15534]: 2017-09-28 12:06:28.431 15534 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:06:28 ctl02 nova-api[15534]: 2017-09-28 12:06:28.431 15534 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:06:28 ctl02 nova-api[15534]: 2017-09-28 12:06:28.431 15534 ERROR nova Traceback (most recent call last):
Sep 28 12:06:28 ctl02 nova-api[15534]: 2017-09-28 12:06:28.431 15534 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:06:28 ctl02 nova-api[15534]: 2017-09-28 12:06:28.431 15534 ERROR nova     sys.exit(main())
Sep 28 12:06:28 ctl02 nova-api[15534]: 2017-09-28 12:06:28.431 15534 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:06:28 ctl02 nova-api[15534]: 2017-09-28 12:06:28.431 15534 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:06:28 ctl02 nova-api[15534]: 2017-09-28 12:06:28.431 15534 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:06:28 ctl02 nova-api[15534]: 2017-09-28 12:06:28.431 15534 ERROR nova     max_url_len=max_url_len)
Sep 28 12:06:28 ctl02 nova-api[15534]: 2017-09-28 12:06:28.431 15534 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:06:28 ctl02 nova-api[15534]: 2017-09-28 12:06:28.431 15534 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:06:28 ctl02 nova-api[15534]: 2017-09-28 12:06:28.431 15534 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:06:28 ctl02 nova-api[15534]: 2017-09-28 12:06:28.431 15534 ERROR nova     sock.listen(backlog)
Sep 28 12:06:28 ctl02 nova-api[15534]: 2017-09-28 12:06:28.431 15534 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:06:28 ctl02 nova-api[15534]: 2017-09-28 12:06:28.431 15534 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:06:28 ctl02 nova-api[15534]: 2017-09-28 12:06:28.431 15534 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:06:28 ctl02 nova-api[15534]: 2017-09-28 12:06:28.431 15534 ERROR nova
Sep 28 12:06:28 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:06:28 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:06:28 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:06:28 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:06:28 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:06:28 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:06:28 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:06:29 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:06:29.063 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:06:29] "OPTIONS / HTTP/1.0" 200 134 0.000418
Sep 28 12:06:29 ctl02 heat-api-cfn[13300]: 2017-09-28 12:06:29.335 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:06:29] "OPTIONS / HTTP/1.0" 200 134 0.000494
Sep 28 12:06:30 ctl02 heat-api-cfn[13300]: 2017-09-28 12:06:30.086 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:06:30] "OPTIONS / HTTP/1.0" 200 134 0.000572
Sep 28 12:06:30 ctl02 nova-conductor[5056]: 2017-09-28 12:06:30.342 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:06:30 ctl02 nova-conductor[5056]: 2017-09-28 12:06:30.357 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:06:30 ctl02 nova-conductor[5056]: 2017-09-28 12:06:30.363 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:06:30 ctl02 nova-conductor[5056]: 2017-09-28 12:06:30.367 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:06:30 ctl02 glance-api[29183]: 2017-09-28 12:06:30.485 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:06:30] "OPTIONS / HTTP/1.0" 200 134 0.000584
Sep 28 12:06:30 ctl02 nova-api[15552]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:06:30 ctl02 nova-api[15552]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:06:30 ctl02 nova-api[15552]: 2017-09-28 12:06:30.686 15552 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:06:30 ctl02 nova-api[15552]: 2017-09-28 12:06:30.688 15552 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:06:30 ctl02 nova-api[15552]: 2017-09-28 12:06:30.688 15552 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:06:30 ctl02 nova-api[15552]: 2017-09-28 12:06:30.688 15552 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:06:30 ctl02 nova-api[15552]: 2017-09-28 12:06:30.688 15552 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:06:30 ctl02 nova-api[15552]: 2017-09-28 12:06:30.688 15552 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:06:30 ctl02 nova-api[15552]: 2017-09-28 12:06:30.688 15552 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:06:30 ctl02 nova-api[15552]: 2017-09-28 12:06:30.688 15552 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:06:30 ctl02 nova-api[15552]: 2017-09-28 12:06:30.688 15552 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:06:30 ctl02 nova-api[15552]: 2017-09-28 12:06:30.688 15552 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:06:30 ctl02 nova-api[15552]: 2017-09-28 12:06:30.688 15552 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:06:30 ctl02 nova-api[15552]: 2017-09-28 12:06:30.688 15552 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:06:30 ctl02 nova-api[15552]: 2017-09-28 12:06:30.688 15552 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:06:30 ctl02 nova-api[15552]: 2017-09-28 12:06:30.688 15552 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:06:30 ctl02 nova-api[15552]: 2017-09-28 12:06:30.688 15552 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:06:30 ctl02 nova-api[15552]: 2017-09-28 12:06:30.688 15552 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:06:30 ctl02 nova-api[15552]: 2017-09-28 12:06:30.688 15552 ERROR nova.wsgi     self.filename))
Sep 28 12:06:30 ctl02 nova-api[15552]: 2017-09-28 12:06:30.688 15552 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:06:30 ctl02 nova-api[15552]: 2017-09-28 12:06:30.688 15552 ERROR nova.wsgi
Sep 28 12:06:30 ctl02 nova-api[15552]: 2017-09-28 12:06:30.689 15552 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:06:30 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928120630755701
Sep 28 12:06:30 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 15565
Sep 28 12:06:30 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928120630755701
Sep 28 12:06:30 ctl02 nova-api[15552]: 2017-09-28 12:06:30.823 15552 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:06:31 ctl02 nova-api[15552]: 2017-09-28 12:06:31.060 15552 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:06:31 ctl02 nova-api[15552]: 2017-09-28 12:06:31.062 15552 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:06:31 ctl02 nova-api[15552]: 2017-09-28 12:06:31.062 15552 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:06:31 ctl02 nova-api[15552]: 2017-09-28 12:06:31.062 15552 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:06:31 ctl02 nova-api[15552]: 2017-09-28 12:06:31.192 15552 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:06:31 ctl02 nova-api[15552]: 2017-09-28 12:06:31.194 15552 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:06:31 ctl02 nova-api[15552]: 2017-09-28 12:06:31.194 15552 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:06:31 ctl02 nova-api[15552]: 2017-09-28 12:06:31.194 15552 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:06:31 ctl02 nova-api[15552]: 2017-09-28 12:06:31.197 15552 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:06:31 ctl02 nova-api[15552]: 2017-09-28 12:06:31.198 15552 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:06:31 ctl02 nova-api[15552]: 2017-09-28 12:06:31.198 15552 ERROR nova Traceback (most recent call last):
Sep 28 12:06:31 ctl02 nova-api[15552]: 2017-09-28 12:06:31.198 15552 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:06:31 ctl02 nova-api[15552]: 2017-09-28 12:06:31.198 15552 ERROR nova     sys.exit(main())
Sep 28 12:06:31 ctl02 nova-api[15552]: 2017-09-28 12:06:31.198 15552 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:06:31 ctl02 nova-api[15552]: 2017-09-28 12:06:31.198 15552 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:06:31 ctl02 nova-api[15552]: 2017-09-28 12:06:31.198 15552 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:06:31 ctl02 nova-api[15552]: 2017-09-28 12:06:31.198 15552 ERROR nova     max_url_len=max_url_len)
Sep 28 12:06:31 ctl02 nova-api[15552]: 2017-09-28 12:06:31.198 15552 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:06:31 ctl02 nova-api[15552]: 2017-09-28 12:06:31.198 15552 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:06:31 ctl02 nova-api[15552]: 2017-09-28 12:06:31.198 15552 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:06:31 ctl02 nova-api[15552]: 2017-09-28 12:06:31.198 15552 ERROR nova     sock.listen(backlog)
Sep 28 12:06:31 ctl02 nova-api[15552]: 2017-09-28 12:06:31.198 15552 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:06:31 ctl02 nova-api[15552]: 2017-09-28 12:06:31.198 15552 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:06:31 ctl02 nova-api[15552]: 2017-09-28 12:06:31.198 15552 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:06:31 ctl02 nova-api[15552]: 2017-09-28 12:06:31.198 15552 ERROR nova
Sep 28 12:06:31 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:06:31 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:06:31 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:06:31 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:06:31.363 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:06:31] "OPTIONS / HTTP/1.0" 200 134 0.000463
Sep 28 12:06:31 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:06:31 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:06:31 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:06:31 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:06:32 ctl02 heat-api[13008]: 2017-09-28 12:06:32.925 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:06:32] "OPTIONS / HTTP/1.0" 200 134 0.000540
Sep 28 12:06:32 ctl02 heat-api-cfn[13300]: 2017-09-28 12:06:32.992 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:06:32] "OPTIONS / HTTP/1.0" 200 134 0.000449
Sep 28 12:06:33 ctl02 nova-api[15575]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:06:33 ctl02 nova-api[15575]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:06:33 ctl02 nova-api[15575]: 2017-09-28 12:06:33.449 15575 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:06:33 ctl02 nova-api[15575]: 2017-09-28 12:06:33.451 15575 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:06:33 ctl02 nova-api[15575]: 2017-09-28 12:06:33.451 15575 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:06:33 ctl02 nova-api[15575]: 2017-09-28 12:06:33.451 15575 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:06:33 ctl02 nova-api[15575]: 2017-09-28 12:06:33.451 15575 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:06:33 ctl02 nova-api[15575]: 2017-09-28 12:06:33.451 15575 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:06:33 ctl02 nova-api[15575]: 2017-09-28 12:06:33.451 15575 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:06:33 ctl02 nova-api[15575]: 2017-09-28 12:06:33.451 15575 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:06:33 ctl02 nova-api[15575]: 2017-09-28 12:06:33.451 15575 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:06:33 ctl02 nova-api[15575]: 2017-09-28 12:06:33.451 15575 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:06:33 ctl02 nova-api[15575]: 2017-09-28 12:06:33.451 15575 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:06:33 ctl02 nova-api[15575]: 2017-09-28 12:06:33.451 15575 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:06:33 ctl02 nova-api[15575]: 2017-09-28 12:06:33.451 15575 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:06:33 ctl02 nova-api[15575]: 2017-09-28 12:06:33.451 15575 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:06:33 ctl02 nova-api[15575]: 2017-09-28 12:06:33.451 15575 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:06:33 ctl02 nova-api[15575]: 2017-09-28 12:06:33.451 15575 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:06:33 ctl02 nova-api[15575]: 2017-09-28 12:06:33.451 15575 ERROR nova.wsgi     self.filename))
Sep 28 12:06:33 ctl02 nova-api[15575]: 2017-09-28 12:06:33.451 15575 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:06:33 ctl02 nova-api[15575]: 2017-09-28 12:06:33.451 15575 ERROR nova.wsgi
Sep 28 12:06:33 ctl02 nova-api[15575]: 2017-09-28 12:06:33.453 15575 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:06:33 ctl02 nova-api[15575]: 2017-09-28 12:06:33.582 15575 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:06:33 ctl02 glance-api[29183]: 2017-09-28 12:06:33.808 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:06:33] "OPTIONS / HTTP/1.0" 200 134 0.000612
Sep 28 12:06:33 ctl02 nova-api[15575]: 2017-09-28 12:06:33.825 15575 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:06:33 ctl02 nova-api[15575]: 2017-09-28 12:06:33.828 15575 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:06:33 ctl02 nova-api[15575]: 2017-09-28 12:06:33.829 15575 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:06:33 ctl02 nova-api[15575]: 2017-09-28 12:06:33.829 15575 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:06:33 ctl02 nova-api[15575]: 2017-09-28 12:06:33.969 15575 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:06:33 ctl02 nova-api[15575]: 2017-09-28 12:06:33.972 15575 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:06:33 ctl02 nova-api[15575]: 2017-09-28 12:06:33.972 15575 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:06:33 ctl02 nova-api[15575]: 2017-09-28 12:06:33.972 15575 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:06:33 ctl02 nova-api[15575]: 2017-09-28 12:06:33.976 15575 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:06:33 ctl02 nova-api[15575]: 2017-09-28 12:06:33.976 15575 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:06:33 ctl02 nova-api[15575]: 2017-09-28 12:06:33.976 15575 ERROR nova Traceback (most recent call last):
Sep 28 12:06:33 ctl02 nova-api[15575]: 2017-09-28 12:06:33.976 15575 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:06:33 ctl02 nova-api[15575]: 2017-09-28 12:06:33.976 15575 ERROR nova     sys.exit(main())
Sep 28 12:06:33 ctl02 nova-api[15575]: 2017-09-28 12:06:33.976 15575 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:06:33 ctl02 nova-api[15575]: 2017-09-28 12:06:33.976 15575 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:06:33 ctl02 nova-api[15575]: 2017-09-28 12:06:33.976 15575 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:06:33 ctl02 nova-api[15575]: 2017-09-28 12:06:33.976 15575 ERROR nova     max_url_len=max_url_len)
Sep 28 12:06:33 ctl02 nova-api[15575]: 2017-09-28 12:06:33.976 15575 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:06:33 ctl02 nova-api[15575]: 2017-09-28 12:06:33.976 15575 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:06:33 ctl02 nova-api[15575]: 2017-09-28 12:06:33.976 15575 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:06:33 ctl02 nova-api[15575]: 2017-09-28 12:06:33.976 15575 ERROR nova     sock.listen(backlog)
Sep 28 12:06:33 ctl02 nova-api[15575]: 2017-09-28 12:06:33.976 15575 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:06:33 ctl02 nova-api[15575]: 2017-09-28 12:06:33.976 15575 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:06:33 ctl02 nova-api[15575]: 2017-09-28 12:06:33.976 15575 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:06:33 ctl02 nova-api[15575]: 2017-09-28 12:06:33.976 15575 ERROR nova
Sep 28 12:06:34 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:06:34 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:06:34 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:06:34 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:06:34 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:06:34 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:06:34 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:06:34 ctl02 glance-api[29183]: 2017-09-28 12:06:34.619 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:06:34] "OPTIONS / HTTP/1.0" 200 134 0.000986
Sep 28 12:06:35 ctl02 heat-api[13008]: 2017-09-28 12:06:35.759 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:06:35] "OPTIONS / HTTP/1.0" 200 134 0.000597
Sep 28 12:06:36 ctl02 nova-api[15593]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:06:36 ctl02 nova-api[15593]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:06:36 ctl02 nova-api[15593]: 2017-09-28 12:06:36.218 15593 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:06:36 ctl02 nova-api[15593]: 2017-09-28 12:06:36.220 15593 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:06:36 ctl02 nova-api[15593]: 2017-09-28 12:06:36.220 15593 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:06:36 ctl02 nova-api[15593]: 2017-09-28 12:06:36.220 15593 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:06:36 ctl02 nova-api[15593]: 2017-09-28 12:06:36.220 15593 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:06:36 ctl02 nova-api[15593]: 2017-09-28 12:06:36.220 15593 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:06:36 ctl02 nova-api[15593]: 2017-09-28 12:06:36.220 15593 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:06:36 ctl02 nova-api[15593]: 2017-09-28 12:06:36.220 15593 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:06:36 ctl02 nova-api[15593]: 2017-09-28 12:06:36.220 15593 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:06:36 ctl02 nova-api[15593]: 2017-09-28 12:06:36.220 15593 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:06:36 ctl02 nova-api[15593]: 2017-09-28 12:06:36.220 15593 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:06:36 ctl02 nova-api[15593]: 2017-09-28 12:06:36.220 15593 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:06:36 ctl02 nova-api[15593]: 2017-09-28 12:06:36.220 15593 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:06:36 ctl02 nova-api[15593]: 2017-09-28 12:06:36.220 15593 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:06:36 ctl02 nova-api[15593]: 2017-09-28 12:06:36.220 15593 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:06:36 ctl02 nova-api[15593]: 2017-09-28 12:06:36.220 15593 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:06:36 ctl02 nova-api[15593]: 2017-09-28 12:06:36.220 15593 ERROR nova.wsgi     self.filename))
Sep 28 12:06:36 ctl02 nova-api[15593]: 2017-09-28 12:06:36.220 15593 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:06:36 ctl02 nova-api[15593]: 2017-09-28 12:06:36.220 15593 ERROR nova.wsgi
Sep 28 12:06:36 ctl02 nova-api[15593]: 2017-09-28 12:06:36.221 15593 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:06:36 ctl02 nova-api[15593]: 2017-09-28 12:06:36.352 15593 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:06:36 ctl02 heat-api[13008]: 2017-09-28 12:06:36.531 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:06:36] "OPTIONS / HTTP/1.0" 200 134 0.000658
Sep 28 12:06:36 ctl02 nova-api[15593]: 2017-09-28 12:06:36.594 15593 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:06:36 ctl02 nova-api[15593]: 2017-09-28 12:06:36.596 15593 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:06:36 ctl02 nova-api[15593]: 2017-09-28 12:06:36.596 15593 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:06:36 ctl02 nova-api[15593]: 2017-09-28 12:06:36.596 15593 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:06:36 ctl02 nova-api[15593]: 2017-09-28 12:06:36.727 15593 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:06:36 ctl02 nova-api[15593]: 2017-09-28 12:06:36.729 15593 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:06:36 ctl02 nova-api[15593]: 2017-09-28 12:06:36.730 15593 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:06:36 ctl02 nova-api[15593]: 2017-09-28 12:06:36.730 15593 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:06:36 ctl02 nova-api[15593]: 2017-09-28 12:06:36.733 15593 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:06:36 ctl02 nova-api[15593]: 2017-09-28 12:06:36.733 15593 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:06:36 ctl02 nova-api[15593]: 2017-09-28 12:06:36.733 15593 ERROR nova Traceback (most recent call last):
Sep 28 12:06:36 ctl02 nova-api[15593]: 2017-09-28 12:06:36.733 15593 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:06:36 ctl02 nova-api[15593]: 2017-09-28 12:06:36.733 15593 ERROR nova     sys.exit(main())
Sep 28 12:06:36 ctl02 nova-api[15593]: 2017-09-28 12:06:36.733 15593 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:06:36 ctl02 nova-api[15593]: 2017-09-28 12:06:36.733 15593 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:06:36 ctl02 nova-api[15593]: 2017-09-28 12:06:36.733 15593 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:06:36 ctl02 nova-api[15593]: 2017-09-28 12:06:36.733 15593 ERROR nova     max_url_len=max_url_len)
Sep 28 12:06:36 ctl02 nova-api[15593]: 2017-09-28 12:06:36.733 15593 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:06:36 ctl02 nova-api[15593]: 2017-09-28 12:06:36.733 15593 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:06:36 ctl02 nova-api[15593]: 2017-09-28 12:06:36.733 15593 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:06:36 ctl02 nova-api[15593]: 2017-09-28 12:06:36.733 15593 ERROR nova     sock.listen(backlog)
Sep 28 12:06:36 ctl02 nova-api[15593]: 2017-09-28 12:06:36.733 15593 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:06:36 ctl02 nova-api[15593]: 2017-09-28 12:06:36.733 15593 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:06:36 ctl02 nova-api[15593]: 2017-09-28 12:06:36.733 15593 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:06:36 ctl02 nova-api[15593]: 2017-09-28 12:06:36.733 15593 ERROR nova
Sep 28 12:06:36 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:06:36 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:06:36 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:06:37 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:06:37 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:06:37 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:06:37 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:06:37 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc248a678)
Sep 28 12:06:37 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:06:37.822 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:06:37] "OPTIONS / HTTP/1.0" 200 134 0.000468
Sep 28 12:06:37 ctl02 nova-consoleauth[5433]: 2017-09-28 12:06:37.989 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:06:38 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc248a678)
Sep 28 12:06:38 ctl02 nova-api[15611]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:06:38 ctl02 nova-api[15611]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:06:38 ctl02 nova-api[15611]: 2017-09-28 12:06:38.947 15611 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:06:38 ctl02 nova-api[15611]: 2017-09-28 12:06:38.950 15611 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:06:38 ctl02 nova-api[15611]: 2017-09-28 12:06:38.950 15611 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:06:38 ctl02 nova-api[15611]: 2017-09-28 12:06:38.950 15611 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:06:38 ctl02 nova-api[15611]: 2017-09-28 12:06:38.950 15611 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:06:38 ctl02 nova-api[15611]: 2017-09-28 12:06:38.950 15611 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:06:38 ctl02 nova-api[15611]: 2017-09-28 12:06:38.950 15611 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:06:38 ctl02 nova-api[15611]: 2017-09-28 12:06:38.950 15611 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:06:38 ctl02 nova-api[15611]: 2017-09-28 12:06:38.950 15611 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:06:38 ctl02 nova-api[15611]: 2017-09-28 12:06:38.950 15611 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:06:38 ctl02 nova-api[15611]: 2017-09-28 12:06:38.950 15611 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:06:38 ctl02 nova-api[15611]: 2017-09-28 12:06:38.950 15611 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:06:38 ctl02 nova-api[15611]: 2017-09-28 12:06:38.950 15611 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:06:38 ctl02 nova-api[15611]: 2017-09-28 12:06:38.950 15611 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:06:38 ctl02 nova-api[15611]: 2017-09-28 12:06:38.950 15611 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:06:38 ctl02 nova-api[15611]: 2017-09-28 12:06:38.950 15611 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:06:38 ctl02 nova-api[15611]: 2017-09-28 12:06:38.950 15611 ERROR nova.wsgi     self.filename))
Sep 28 12:06:38 ctl02 nova-api[15611]: 2017-09-28 12:06:38.950 15611 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:06:38 ctl02 nova-api[15611]: 2017-09-28 12:06:38.950 15611 ERROR nova.wsgi
Sep 28 12:06:38 ctl02 nova-api[15611]: 2017-09-28 12:06:38.952 15611 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:06:39 ctl02 nova-api[15611]: 2017-09-28 12:06:39.081 15611 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:06:39 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:06:39.105 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:06:39] "OPTIONS / HTTP/1.0" 200 134 0.000499
Sep 28 12:06:39 ctl02 nova-api[15611]: 2017-09-28 12:06:39.320 15611 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:06:39 ctl02 nova-api[15611]: 2017-09-28 12:06:39.322 15611 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:06:39 ctl02 nova-api[15611]: 2017-09-28 12:06:39.323 15611 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:06:39 ctl02 nova-api[15611]: 2017-09-28 12:06:39.323 15611 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:06:39 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc248a678)
Sep 28 12:06:39 ctl02 nova-api[15611]: 2017-09-28 12:06:39.456 15611 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:06:39 ctl02 nova-api[15611]: 2017-09-28 12:06:39.459 15611 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:06:39 ctl02 nova-api[15611]: 2017-09-28 12:06:39.460 15611 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:06:39 ctl02 nova-api[15611]: 2017-09-28 12:06:39.460 15611 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:06:39 ctl02 nova-api[15611]: 2017-09-28 12:06:39.463 15611 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:06:39 ctl02 nova-api[15611]: 2017-09-28 12:06:39.464 15611 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:06:39 ctl02 nova-api[15611]: 2017-09-28 12:06:39.464 15611 ERROR nova Traceback (most recent call last):
Sep 28 12:06:39 ctl02 nova-api[15611]: 2017-09-28 12:06:39.464 15611 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:06:39 ctl02 nova-api[15611]: 2017-09-28 12:06:39.464 15611 ERROR nova     sys.exit(main())
Sep 28 12:06:39 ctl02 nova-api[15611]: 2017-09-28 12:06:39.464 15611 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:06:39 ctl02 nova-api[15611]: 2017-09-28 12:06:39.464 15611 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:06:39 ctl02 nova-api[15611]: 2017-09-28 12:06:39.464 15611 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:06:39 ctl02 nova-api[15611]: 2017-09-28 12:06:39.464 15611 ERROR nova     max_url_len=max_url_len)
Sep 28 12:06:39 ctl02 nova-api[15611]: 2017-09-28 12:06:39.464 15611 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:06:39 ctl02 nova-api[15611]: 2017-09-28 12:06:39.464 15611 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:06:39 ctl02 nova-api[15611]: 2017-09-28 12:06:39.464 15611 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:06:39 ctl02 nova-api[15611]: 2017-09-28 12:06:39.464 15611 ERROR nova     sock.listen(backlog)
Sep 28 12:06:39 ctl02 nova-api[15611]: 2017-09-28 12:06:39.464 15611 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:06:39 ctl02 nova-api[15611]: 2017-09-28 12:06:39.464 15611 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:06:39 ctl02 nova-api[15611]: 2017-09-28 12:06:39.464 15611 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:06:39 ctl02 nova-api[15611]: 2017-09-28 12:06:39.464 15611 ERROR nova
Sep 28 12:06:39 ctl02 heat-api-cfn[13300]: 2017-09-28 12:06:39.568 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:06:39] "OPTIONS / HTTP/1.0" 200 134 0.000539
Sep 28 12:06:39 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:06:39 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:06:39 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:06:39 ctl02 heat-api-cfn[13300]: 2017-09-28 12:06:39.777 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:06:39] "OPTIONS / HTTP/1.0" 200 134 0.000364
Sep 28 12:06:39 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:06:39 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:06:39 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:06:39 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:06:40 ctl02 glance-api[29183]: 2017-09-28 12:06:40.125 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:06:40] "OPTIONS / HTTP/1.0" 200 134 0.000572
Sep 28 12:06:40 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc248a678)
Sep 28 12:06:40 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928120640898795
Sep 28 12:06:40 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 15640
Sep 28 12:06:40 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928120640898795
Sep 28 12:06:41 ctl02 nova-scheduler[5620]: 2017-09-28 12:06:41.009 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:06:41 ctl02 heat-engine[12803]: 2017-09-28 12:06:41.403 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:06:41 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc248a678)
Sep 28 12:06:41 ctl02 heat-engine[12803]: 2017-09-28 12:06:41.436 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:06:41 ctl02 heat-engine[12803]: 2017-09-28 12:06:41.454 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:06:41 ctl02 heat-engine[12803]: 2017-09-28 12:06:41.461 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:06:41 ctl02 nova-api[15629]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:06:41 ctl02 nova-api[15629]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:06:41 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:06:41.588 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:06:41] "OPTIONS / HTTP/1.0" 200 134 0.000448
Sep 28 12:06:41 ctl02 nova-api[15629]: 2017-09-28 12:06:41.707 15629 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:06:41 ctl02 nova-api[15629]: 2017-09-28 12:06:41.708 15629 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:06:41 ctl02 nova-api[15629]: 2017-09-28 12:06:41.708 15629 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:06:41 ctl02 nova-api[15629]: 2017-09-28 12:06:41.708 15629 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:06:41 ctl02 nova-api[15629]: 2017-09-28 12:06:41.708 15629 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:06:41 ctl02 nova-api[15629]: 2017-09-28 12:06:41.708 15629 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:06:41 ctl02 nova-api[15629]: 2017-09-28 12:06:41.708 15629 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:06:41 ctl02 nova-api[15629]: 2017-09-28 12:06:41.708 15629 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:06:41 ctl02 nova-api[15629]: 2017-09-28 12:06:41.708 15629 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:06:41 ctl02 nova-api[15629]: 2017-09-28 12:06:41.708 15629 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:06:41 ctl02 nova-api[15629]: 2017-09-28 12:06:41.708 15629 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:06:41 ctl02 nova-api[15629]: 2017-09-28 12:06:41.708 15629 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:06:41 ctl02 nova-api[15629]: 2017-09-28 12:06:41.708 15629 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:06:41 ctl02 nova-api[15629]: 2017-09-28 12:06:41.708 15629 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:06:41 ctl02 nova-api[15629]: 2017-09-28 12:06:41.708 15629 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:06:41 ctl02 nova-api[15629]: 2017-09-28 12:06:41.708 15629 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:06:41 ctl02 nova-api[15629]: 2017-09-28 12:06:41.708 15629 ERROR nova.wsgi     self.filename))
Sep 28 12:06:41 ctl02 nova-api[15629]: 2017-09-28 12:06:41.708 15629 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:06:41 ctl02 nova-api[15629]: 2017-09-28 12:06:41.708 15629 ERROR nova.wsgi
Sep 28 12:06:41 ctl02 nova-api[15629]: 2017-09-28 12:06:41.709 15629 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:06:41 ctl02 nova-api[15629]: 2017-09-28 12:06:41.836 15629 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:06:42 ctl02 nova-api[15629]: 2017-09-28 12:06:42.063 15629 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:06:42 ctl02 nova-api[15629]: 2017-09-28 12:06:42.065 15629 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:06:42 ctl02 nova-api[15629]: 2017-09-28 12:06:42.066 15629 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:06:42 ctl02 nova-api[15629]: 2017-09-28 12:06:42.066 15629 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:06:42 ctl02 nova-api[15629]: 2017-09-28 12:06:42.197 15629 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:06:42 ctl02 nova-api[15629]: 2017-09-28 12:06:42.198 15629 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:06:42 ctl02 nova-api[15629]: 2017-09-28 12:06:42.199 15629 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:06:42 ctl02 nova-api[15629]: 2017-09-28 12:06:42.199 15629 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:06:42 ctl02 nova-api[15629]: 2017-09-28 12:06:42.202 15629 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:06:42 ctl02 nova-api[15629]: 2017-09-28 12:06:42.202 15629 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:06:42 ctl02 nova-api[15629]: 2017-09-28 12:06:42.202 15629 ERROR nova Traceback (most recent call last):
Sep 28 12:06:42 ctl02 nova-api[15629]: 2017-09-28 12:06:42.202 15629 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:06:42 ctl02 nova-api[15629]: 2017-09-28 12:06:42.202 15629 ERROR nova     sys.exit(main())
Sep 28 12:06:42 ctl02 nova-api[15629]: 2017-09-28 12:06:42.202 15629 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:06:42 ctl02 nova-api[15629]: 2017-09-28 12:06:42.202 15629 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:06:42 ctl02 nova-api[15629]: 2017-09-28 12:06:42.202 15629 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:06:42 ctl02 nova-api[15629]: 2017-09-28 12:06:42.202 15629 ERROR nova     max_url_len=max_url_len)
Sep 28 12:06:42 ctl02 nova-api[15629]: 2017-09-28 12:06:42.202 15629 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:06:42 ctl02 nova-api[15629]: 2017-09-28 12:06:42.202 15629 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:06:42 ctl02 nova-api[15629]: 2017-09-28 12:06:42.202 15629 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:06:42 ctl02 nova-api[15629]: 2017-09-28 12:06:42.202 15629 ERROR nova     sock.listen(backlog)
Sep 28 12:06:42 ctl02 nova-api[15629]: 2017-09-28 12:06:42.202 15629 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:06:42 ctl02 nova-api[15629]: 2017-09-28 12:06:42.202 15629 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:06:42 ctl02 nova-api[15629]: 2017-09-28 12:06:42.202 15629 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:06:42 ctl02 nova-api[15629]: 2017-09-28 12:06:42.202 15629 ERROR nova
Sep 28 12:06:42 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:06:42 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:06:42 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:06:42 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc248a678)
Sep 28 12:06:42 ctl02 heat-api[13008]: 2017-09-28 12:06:42.613 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:06:42] "OPTIONS / HTTP/1.0" 200 134 0.000899
Sep 28 12:06:42 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:06:42 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:06:42 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:06:42 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:06:43 ctl02 heat-api-cfn[13300]: 2017-09-28 12:06:43.076 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:06:43] "OPTIONS / HTTP/1.0" 200 134 0.000500
Sep 28 12:06:43 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc248a678)
Sep 28 12:06:43 ctl02 glance-api[29183]: 2017-09-28 12:06:43.987 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:06:43] "OPTIONS / HTTP/1.0" 200 134 0.000650
Sep 28 12:06:44 ctl02 nova-api[15652]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:06:44 ctl02 nova-api[15652]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:06:44 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc248a678)
Sep 28 12:06:44 ctl02 nova-api[15652]: 2017-09-28 12:06:44.451 15652 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:06:44 ctl02 nova-api[15652]: 2017-09-28 12:06:44.453 15652 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:06:44 ctl02 nova-api[15652]: 2017-09-28 12:06:44.453 15652 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:06:44 ctl02 nova-api[15652]: 2017-09-28 12:06:44.453 15652 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:06:44 ctl02 nova-api[15652]: 2017-09-28 12:06:44.453 15652 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:06:44 ctl02 nova-api[15652]: 2017-09-28 12:06:44.453 15652 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:06:44 ctl02 nova-api[15652]: 2017-09-28 12:06:44.453 15652 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:06:44 ctl02 nova-api[15652]: 2017-09-28 12:06:44.453 15652 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:06:44 ctl02 nova-api[15652]: 2017-09-28 12:06:44.453 15652 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:06:44 ctl02 nova-api[15652]: 2017-09-28 12:06:44.453 15652 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:06:44 ctl02 nova-api[15652]: 2017-09-28 12:06:44.453 15652 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:06:44 ctl02 nova-api[15652]: 2017-09-28 12:06:44.453 15652 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:06:44 ctl02 nova-api[15652]: 2017-09-28 12:06:44.453 15652 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:06:44 ctl02 nova-api[15652]: 2017-09-28 12:06:44.453 15652 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:06:44 ctl02 nova-api[15652]: 2017-09-28 12:06:44.453 15652 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:06:44 ctl02 nova-api[15652]: 2017-09-28 12:06:44.453 15652 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:06:44 ctl02 nova-api[15652]: 2017-09-28 12:06:44.453 15652 ERROR nova.wsgi     self.filename))
Sep 28 12:06:44 ctl02 nova-api[15652]: 2017-09-28 12:06:44.453 15652 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:06:44 ctl02 nova-api[15652]: 2017-09-28 12:06:44.453 15652 ERROR nova.wsgi
Sep 28 12:06:44 ctl02 nova-api[15652]: 2017-09-28 12:06:44.454 15652 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:06:44 ctl02 glance-api[29183]: 2017-09-28 12:06:44.565 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:06:44] "OPTIONS / HTTP/1.0" 200 134 0.000673
Sep 28 12:06:44 ctl02 nova-api[15652]: 2017-09-28 12:06:44.584 15652 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:06:44 ctl02 nova-api[15652]: 2017-09-28 12:06:44.823 15652 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:06:44 ctl02 nova-api[15652]: 2017-09-28 12:06:44.825 15652 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:06:44 ctl02 nova-api[15652]: 2017-09-28 12:06:44.826 15652 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:06:44 ctl02 nova-api[15652]: 2017-09-28 12:06:44.826 15652 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:06:44 ctl02 nova-api[15652]: 2017-09-28 12:06:44.957 15652 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:06:44 ctl02 nova-api[15652]: 2017-09-28 12:06:44.959 15652 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:06:44 ctl02 nova-api[15652]: 2017-09-28 12:06:44.959 15652 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:06:44 ctl02 nova-api[15652]: 2017-09-28 12:06:44.959 15652 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:06:44 ctl02 nova-api[15652]: 2017-09-28 12:06:44.962 15652 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:06:44 ctl02 nova-api[15652]: 2017-09-28 12:06:44.963 15652 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:06:44 ctl02 nova-api[15652]: 2017-09-28 12:06:44.963 15652 ERROR nova Traceback (most recent call last):
Sep 28 12:06:44 ctl02 nova-api[15652]: 2017-09-28 12:06:44.963 15652 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:06:44 ctl02 nova-api[15652]: 2017-09-28 12:06:44.963 15652 ERROR nova     sys.exit(main())
Sep 28 12:06:44 ctl02 nova-api[15652]: 2017-09-28 12:06:44.963 15652 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:06:44 ctl02 nova-api[15652]: 2017-09-28 12:06:44.963 15652 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:06:44 ctl02 nova-api[15652]: 2017-09-28 12:06:44.963 15652 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:06:44 ctl02 nova-api[15652]: 2017-09-28 12:06:44.963 15652 ERROR nova     max_url_len=max_url_len)
Sep 28 12:06:44 ctl02 nova-api[15652]: 2017-09-28 12:06:44.963 15652 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:06:44 ctl02 nova-api[15652]: 2017-09-28 12:06:44.963 15652 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:06:44 ctl02 nova-api[15652]: 2017-09-28 12:06:44.963 15652 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:06:44 ctl02 nova-api[15652]: 2017-09-28 12:06:44.963 15652 ERROR nova     sock.listen(backlog)
Sep 28 12:06:44 ctl02 nova-api[15652]: 2017-09-28 12:06:44.963 15652 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:06:44 ctl02 nova-api[15652]: 2017-09-28 12:06:44.963 15652 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:06:44 ctl02 nova-api[15652]: 2017-09-28 12:06:44.963 15652 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:06:44 ctl02 nova-api[15652]: 2017-09-28 12:06:44.963 15652 ERROR nova
Sep 28 12:06:45 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:06:45 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:06:45 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:06:45 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:06:45 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:06:45 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:06:45 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:06:45 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc248a678)
Sep 28 12:06:46 ctl02 heat-api[13008]: 2017-09-28 12:06:46.068 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:06:46] "OPTIONS / HTTP/1.0" 200 134 0.000526
Sep 28 12:06:46 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc248a678)
Sep 28 12:06:46 ctl02 heat-api[13008]: 2017-09-28 12:06:46.475 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:06:46] "OPTIONS / HTTP/1.0" 200 134 0.000480
Sep 28 12:06:47 ctl02 nova-api[15670]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:06:47 ctl02 nova-api[15670]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:06:47 ctl02 nova-api[15670]: 2017-09-28 12:06:47.224 15670 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:06:47 ctl02 nova-api[15670]: 2017-09-28 12:06:47.226 15670 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:06:47 ctl02 nova-api[15670]: 2017-09-28 12:06:47.226 15670 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:06:47 ctl02 nova-api[15670]: 2017-09-28 12:06:47.226 15670 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:06:47 ctl02 nova-api[15670]: 2017-09-28 12:06:47.226 15670 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:06:47 ctl02 nova-api[15670]: 2017-09-28 12:06:47.226 15670 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:06:47 ctl02 nova-api[15670]: 2017-09-28 12:06:47.226 15670 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:06:47 ctl02 nova-api[15670]: 2017-09-28 12:06:47.226 15670 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:06:47 ctl02 nova-api[15670]: 2017-09-28 12:06:47.226 15670 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:06:47 ctl02 nova-api[15670]: 2017-09-28 12:06:47.226 15670 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:06:47 ctl02 nova-api[15670]: 2017-09-28 12:06:47.226 15670 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:06:47 ctl02 nova-api[15670]: 2017-09-28 12:06:47.226 15670 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:06:47 ctl02 nova-api[15670]: 2017-09-28 12:06:47.226 15670 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:06:47 ctl02 nova-api[15670]: 2017-09-28 12:06:47.226 15670 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:06:47 ctl02 nova-api[15670]: 2017-09-28 12:06:47.226 15670 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:06:47 ctl02 nova-api[15670]: 2017-09-28 12:06:47.226 15670 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:06:47 ctl02 nova-api[15670]: 2017-09-28 12:06:47.226 15670 ERROR nova.wsgi     self.filename))
Sep 28 12:06:47 ctl02 nova-api[15670]: 2017-09-28 12:06:47.226 15670 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:06:47 ctl02 nova-api[15670]: 2017-09-28 12:06:47.226 15670 ERROR nova.wsgi
Sep 28 12:06:47 ctl02 nova-api[15670]: 2017-09-28 12:06:47.227 15670 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:06:47 ctl02 nova-api[15670]: 2017-09-28 12:06:47.355 15670 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:06:47 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc248a678)
Sep 28 12:06:47 ctl02 nova-api[15670]: 2017-09-28 12:06:47.588 15670 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:06:47 ctl02 nova-api[15670]: 2017-09-28 12:06:47.590 15670 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:06:47 ctl02 nova-api[15670]: 2017-09-28 12:06:47.591 15670 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:06:47 ctl02 nova-api[15670]: 2017-09-28 12:06:47.591 15670 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:06:47 ctl02 nova-api[15670]: 2017-09-28 12:06:47.719 15670 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:06:47 ctl02 nova-api[15670]: 2017-09-28 12:06:47.721 15670 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:06:47 ctl02 nova-api[15670]: 2017-09-28 12:06:47.721 15670 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:06:47 ctl02 nova-api[15670]: 2017-09-28 12:06:47.722 15670 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:06:47 ctl02 nova-api[15670]: 2017-09-28 12:06:47.725 15670 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:06:47 ctl02 nova-api[15670]: 2017-09-28 12:06:47.725 15670 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:06:47 ctl02 nova-api[15670]: 2017-09-28 12:06:47.725 15670 ERROR nova Traceback (most recent call last):
Sep 28 12:06:47 ctl02 nova-api[15670]: 2017-09-28 12:06:47.725 15670 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:06:47 ctl02 nova-api[15670]: 2017-09-28 12:06:47.725 15670 ERROR nova     sys.exit(main())
Sep 28 12:06:47 ctl02 nova-api[15670]: 2017-09-28 12:06:47.725 15670 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:06:47 ctl02 nova-api[15670]: 2017-09-28 12:06:47.725 15670 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:06:47 ctl02 nova-api[15670]: 2017-09-28 12:06:47.725 15670 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:06:47 ctl02 nova-api[15670]: 2017-09-28 12:06:47.725 15670 ERROR nova     max_url_len=max_url_len)
Sep 28 12:06:47 ctl02 nova-api[15670]: 2017-09-28 12:06:47.725 15670 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:06:47 ctl02 nova-api[15670]: 2017-09-28 12:06:47.725 15670 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:06:47 ctl02 nova-api[15670]: 2017-09-28 12:06:47.725 15670 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:06:47 ctl02 nova-api[15670]: 2017-09-28 12:06:47.725 15670 ERROR nova     sock.listen(backlog)
Sep 28 12:06:47 ctl02 nova-api[15670]: 2017-09-28 12:06:47.725 15670 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:06:47 ctl02 nova-api[15670]: 2017-09-28 12:06:47.725 15670 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:06:47 ctl02 nova-api[15670]: 2017-09-28 12:06:47.725 15670 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:06:47 ctl02 nova-api[15670]: 2017-09-28 12:06:47.725 15670 ERROR nova
Sep 28 12:06:47 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:06:47 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:06:47 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:06:48 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:06:48.033 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:06:48] "OPTIONS / HTTP/1.0" 200 134 0.000586
Sep 28 12:06:48 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:06:48 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:06:48 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:06:48 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:06:48 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:06:48 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:06:48 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:06:48.893 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:06:48] "OPTIONS / HTTP/1.0" 200 134 0.000546
Sep 28 12:06:49 ctl02 heat-api-cfn[13300]: 2017-09-28 12:06:49.298 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:06:49] "OPTIONS / HTTP/1.0" 200 134 0.000452
Sep 28 12:06:49 ctl02 nova-api[15688]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:06:49 ctl02 nova-api[15688]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:06:49 ctl02 nova-api[15688]: 2017-09-28 12:06:49.904 15688 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:06:49 ctl02 nova-api[15688]: 2017-09-28 12:06:49.906 15688 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:06:49 ctl02 nova-api[15688]: 2017-09-28 12:06:49.906 15688 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:06:49 ctl02 nova-api[15688]: 2017-09-28 12:06:49.906 15688 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:06:49 ctl02 nova-api[15688]: 2017-09-28 12:06:49.906 15688 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:06:49 ctl02 nova-api[15688]: 2017-09-28 12:06:49.906 15688 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:06:49 ctl02 nova-api[15688]: 2017-09-28 12:06:49.906 15688 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:06:49 ctl02 nova-api[15688]: 2017-09-28 12:06:49.906 15688 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:06:49 ctl02 nova-api[15688]: 2017-09-28 12:06:49.906 15688 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:06:49 ctl02 nova-api[15688]: 2017-09-28 12:06:49.906 15688 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:06:49 ctl02 nova-api[15688]: 2017-09-28 12:06:49.906 15688 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:06:49 ctl02 nova-api[15688]: 2017-09-28 12:06:49.906 15688 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:06:49 ctl02 nova-api[15688]: 2017-09-28 12:06:49.906 15688 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:06:49 ctl02 nova-api[15688]: 2017-09-28 12:06:49.906 15688 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:06:49 ctl02 nova-api[15688]: 2017-09-28 12:06:49.906 15688 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:06:49 ctl02 nova-api[15688]: 2017-09-28 12:06:49.906 15688 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:06:49 ctl02 nova-api[15688]: 2017-09-28 12:06:49.906 15688 ERROR nova.wsgi     self.filename))
Sep 28 12:06:49 ctl02 nova-api[15688]: 2017-09-28 12:06:49.906 15688 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:06:49 ctl02 nova-api[15688]: 2017-09-28 12:06:49.906 15688 ERROR nova.wsgi
Sep 28 12:06:49 ctl02 nova-api[15688]: 2017-09-28 12:06:49.908 15688 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:06:50 ctl02 nova-api[15688]: 2017-09-28 12:06:50.032 15688 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:06:50 ctl02 heat-api-cfn[13300]: 2017-09-28 12:06:50.162 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:06:50] "OPTIONS / HTTP/1.0" 200 134 0.000458
Sep 28 12:06:50 ctl02 nova-api[15688]: 2017-09-28 12:06:50.260 15688 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:06:50 ctl02 nova-api[15688]: 2017-09-28 12:06:50.263 15688 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:06:50 ctl02 nova-api[15688]: 2017-09-28 12:06:50.263 15688 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:06:50 ctl02 nova-api[15688]: 2017-09-28 12:06:50.264 15688 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:06:50 ctl02 glance-api[29183]: 2017-09-28 12:06:50.319 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:06:50] "OPTIONS / HTTP/1.0" 200 134 0.000604
Sep 28 12:06:50 ctl02 nova-api[15688]: 2017-09-28 12:06:50.395 15688 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:06:50 ctl02 nova-api[15688]: 2017-09-28 12:06:50.398 15688 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:06:50 ctl02 nova-api[15688]: 2017-09-28 12:06:50.399 15688 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:06:50 ctl02 nova-api[15688]: 2017-09-28 12:06:50.399 15688 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:06:50 ctl02 nova-api[15688]: 2017-09-28 12:06:50.404 15688 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:06:50 ctl02 nova-api[15688]: 2017-09-28 12:06:50.404 15688 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:06:50 ctl02 nova-api[15688]: 2017-09-28 12:06:50.404 15688 ERROR nova Traceback (most recent call last):
Sep 28 12:06:50 ctl02 nova-api[15688]: 2017-09-28 12:06:50.404 15688 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:06:50 ctl02 nova-api[15688]: 2017-09-28 12:06:50.404 15688 ERROR nova     sys.exit(main())
Sep 28 12:06:50 ctl02 nova-api[15688]: 2017-09-28 12:06:50.404 15688 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:06:50 ctl02 nova-api[15688]: 2017-09-28 12:06:50.404 15688 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:06:50 ctl02 nova-api[15688]: 2017-09-28 12:06:50.404 15688 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:06:50 ctl02 nova-api[15688]: 2017-09-28 12:06:50.404 15688 ERROR nova     max_url_len=max_url_len)
Sep 28 12:06:50 ctl02 nova-api[15688]: 2017-09-28 12:06:50.404 15688 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:06:50 ctl02 nova-api[15688]: 2017-09-28 12:06:50.404 15688 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:06:50 ctl02 nova-api[15688]: 2017-09-28 12:06:50.404 15688 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:06:50 ctl02 nova-api[15688]: 2017-09-28 12:06:50.404 15688 ERROR nova     sock.listen(backlog)
Sep 28 12:06:50 ctl02 nova-api[15688]: 2017-09-28 12:06:50.404 15688 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:06:50 ctl02 nova-api[15688]: 2017-09-28 12:06:50.404 15688 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:06:50 ctl02 nova-api[15688]: 2017-09-28 12:06:50.404 15688 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:06:50 ctl02 nova-api[15688]: 2017-09-28 12:06:50.404 15688 ERROR nova
Sep 28 12:06:50 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:06:50 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:06:50 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:06:50 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:06:50 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:06:50 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:06:50 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:06:51 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928120651045397
Sep 28 12:06:51 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 15718
Sep 28 12:06:51 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928120651045397
Sep 28 12:06:51 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:06:51.949 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:06:51] "OPTIONS / HTTP/1.0" 200 134 0.000646
Sep 28 12:06:52 ctl02 nova-api[15711]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:06:52 ctl02 nova-api[15711]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:06:52 ctl02 heat-api[13008]: 2017-09-28 12:06:52.530 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:06:52] "OPTIONS / HTTP/1.0" 200 134 0.000685
Sep 28 12:06:52 ctl02 nova-api[15711]: 2017-09-28 12:06:52.702 15711 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:06:52 ctl02 nova-api[15711]: 2017-09-28 12:06:52.704 15711 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:06:52 ctl02 nova-api[15711]: 2017-09-28 12:06:52.704 15711 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:06:52 ctl02 nova-api[15711]: 2017-09-28 12:06:52.704 15711 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:06:52 ctl02 nova-api[15711]: 2017-09-28 12:06:52.704 15711 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:06:52 ctl02 nova-api[15711]: 2017-09-28 12:06:52.704 15711 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:06:52 ctl02 nova-api[15711]: 2017-09-28 12:06:52.704 15711 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:06:52 ctl02 nova-api[15711]: 2017-09-28 12:06:52.704 15711 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:06:52 ctl02 nova-api[15711]: 2017-09-28 12:06:52.704 15711 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:06:52 ctl02 nova-api[15711]: 2017-09-28 12:06:52.704 15711 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:06:52 ctl02 nova-api[15711]: 2017-09-28 12:06:52.704 15711 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:06:52 ctl02 nova-api[15711]: 2017-09-28 12:06:52.704 15711 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:06:52 ctl02 nova-api[15711]: 2017-09-28 12:06:52.704 15711 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:06:52 ctl02 nova-api[15711]: 2017-09-28 12:06:52.704 15711 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:06:52 ctl02 nova-api[15711]: 2017-09-28 12:06:52.704 15711 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:06:52 ctl02 nova-api[15711]: 2017-09-28 12:06:52.704 15711 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:06:52 ctl02 nova-api[15711]: 2017-09-28 12:06:52.704 15711 ERROR nova.wsgi     self.filename))
Sep 28 12:06:52 ctl02 nova-api[15711]: 2017-09-28 12:06:52.704 15711 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:06:52 ctl02 nova-api[15711]: 2017-09-28 12:06:52.704 15711 ERROR nova.wsgi
Sep 28 12:06:52 ctl02 nova-api[15711]: 2017-09-28 12:06:52.706 15711 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:06:52 ctl02 nova-api[15711]: 2017-09-28 12:06:52.839 15711 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:06:53 ctl02 nova-api[15711]: 2017-09-28 12:06:53.081 15711 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:06:53 ctl02 nova-api[15711]: 2017-09-28 12:06:53.084 15711 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:06:53 ctl02 nova-api[15711]: 2017-09-28 12:06:53.085 15711 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:06:53 ctl02 heat-api-cfn[13300]: 2017-09-28 12:06:53.085 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:06:53] "OPTIONS / HTTP/1.0" 200 134 0.000532
Sep 28 12:06:53 ctl02 nova-api[15711]: 2017-09-28 12:06:53.085 15711 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:06:53 ctl02 nova-api[15711]: 2017-09-28 12:06:53.216 15711 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:06:53 ctl02 nova-api[15711]: 2017-09-28 12:06:53.218 15711 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:06:53 ctl02 nova-api[15711]: 2017-09-28 12:06:53.225 15711 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:06:53 ctl02 nova-api[15711]: 2017-09-28 12:06:53.225 15711 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:06:53 ctl02 nova-api[15711]: 2017-09-28 12:06:53.229 15711 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:06:53 ctl02 nova-api[15711]: 2017-09-28 12:06:53.229 15711 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:06:53 ctl02 nova-api[15711]: 2017-09-28 12:06:53.229 15711 ERROR nova Traceback (most recent call last):
Sep 28 12:06:53 ctl02 nova-api[15711]: 2017-09-28 12:06:53.229 15711 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:06:53 ctl02 nova-api[15711]: 2017-09-28 12:06:53.229 15711 ERROR nova     sys.exit(main())
Sep 28 12:06:53 ctl02 nova-api[15711]: 2017-09-28 12:06:53.229 15711 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:06:53 ctl02 nova-api[15711]: 2017-09-28 12:06:53.229 15711 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:06:53 ctl02 nova-api[15711]: 2017-09-28 12:06:53.229 15711 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:06:53 ctl02 nova-api[15711]: 2017-09-28 12:06:53.229 15711 ERROR nova     max_url_len=max_url_len)
Sep 28 12:06:53 ctl02 nova-api[15711]: 2017-09-28 12:06:53.229 15711 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:06:53 ctl02 nova-api[15711]: 2017-09-28 12:06:53.229 15711 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:06:53 ctl02 nova-api[15711]: 2017-09-28 12:06:53.229 15711 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:06:53 ctl02 nova-api[15711]: 2017-09-28 12:06:53.229 15711 ERROR nova     sock.listen(backlog)
Sep 28 12:06:53 ctl02 nova-api[15711]: 2017-09-28 12:06:53.229 15711 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:06:53 ctl02 nova-api[15711]: 2017-09-28 12:06:53.229 15711 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:06:53 ctl02 nova-api[15711]: 2017-09-28 12:06:53.229 15711 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:06:53 ctl02 nova-api[15711]: 2017-09-28 12:06:53.229 15711 ERROR nova
Sep 28 12:06:53 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:06:53 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:06:53 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:06:53 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:06:53 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:06:53 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:06:53 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:06:53 ctl02 glance-api[29183]: 2017-09-28 12:06:53.679 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:06:53] "OPTIONS / HTTP/1.0" 200 134 0.001129
Sep 28 12:06:54 ctl02 glance-api[29183]: 2017-09-28 12:06:54.764 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:06:54] "OPTIONS / HTTP/1.0" 200 134 0.000633
Sep 28 12:06:55 ctl02 nova-api[15734]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:06:55 ctl02 nova-api[15734]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:06:55 ctl02 nova-api[15734]: 2017-09-28 12:06:55.435 15734 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:06:55 ctl02 nova-api[15734]: 2017-09-28 12:06:55.437 15734 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:06:55 ctl02 nova-api[15734]: 2017-09-28 12:06:55.437 15734 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:06:55 ctl02 nova-api[15734]: 2017-09-28 12:06:55.437 15734 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:06:55 ctl02 nova-api[15734]: 2017-09-28 12:06:55.437 15734 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:06:55 ctl02 nova-api[15734]: 2017-09-28 12:06:55.437 15734 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:06:55 ctl02 nova-api[15734]: 2017-09-28 12:06:55.437 15734 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:06:55 ctl02 nova-api[15734]: 2017-09-28 12:06:55.437 15734 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:06:55 ctl02 nova-api[15734]: 2017-09-28 12:06:55.437 15734 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:06:55 ctl02 nova-api[15734]: 2017-09-28 12:06:55.437 15734 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:06:55 ctl02 nova-api[15734]: 2017-09-28 12:06:55.437 15734 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:06:55 ctl02 nova-api[15734]: 2017-09-28 12:06:55.437 15734 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:06:55 ctl02 nova-api[15734]: 2017-09-28 12:06:55.437 15734 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:06:55 ctl02 nova-api[15734]: 2017-09-28 12:06:55.437 15734 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:06:55 ctl02 nova-api[15734]: 2017-09-28 12:06:55.437 15734 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:06:55 ctl02 nova-api[15734]: 2017-09-28 12:06:55.437 15734 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:06:55 ctl02 nova-api[15734]: 2017-09-28 12:06:55.437 15734 ERROR nova.wsgi     self.filename))
Sep 28 12:06:55 ctl02 nova-api[15734]: 2017-09-28 12:06:55.437 15734 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:06:55 ctl02 nova-api[15734]: 2017-09-28 12:06:55.437 15734 ERROR nova.wsgi
Sep 28 12:06:55 ctl02 nova-api[15734]: 2017-09-28 12:06:55.438 15734 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:06:55 ctl02 nova-api[15734]: 2017-09-28 12:06:55.569 15734 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:06:55 ctl02 nova-api[15734]: 2017-09-28 12:06:55.807 15734 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:06:55 ctl02 nova-api[15734]: 2017-09-28 12:06:55.809 15734 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:06:55 ctl02 nova-api[15734]: 2017-09-28 12:06:55.809 15734 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:06:55 ctl02 nova-api[15734]: 2017-09-28 12:06:55.810 15734 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:06:55 ctl02 nova-api[15734]: 2017-09-28 12:06:55.942 15734 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:06:55 ctl02 nova-api[15734]: 2017-09-28 12:06:55.944 15734 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:06:55 ctl02 nova-api[15734]: 2017-09-28 12:06:55.944 15734 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:06:55 ctl02 nova-api[15734]: 2017-09-28 12:06:55.944 15734 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:06:55 ctl02 nova-api[15734]: 2017-09-28 12:06:55.948 15734 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:06:55 ctl02 nova-api[15734]: 2017-09-28 12:06:55.948 15734 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:06:55 ctl02 nova-api[15734]: 2017-09-28 12:06:55.948 15734 ERROR nova Traceback (most recent call last):
Sep 28 12:06:55 ctl02 nova-api[15734]: 2017-09-28 12:06:55.948 15734 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:06:55 ctl02 nova-api[15734]: 2017-09-28 12:06:55.948 15734 ERROR nova     sys.exit(main())
Sep 28 12:06:55 ctl02 nova-api[15734]: 2017-09-28 12:06:55.948 15734 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:06:55 ctl02 nova-api[15734]: 2017-09-28 12:06:55.948 15734 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:06:55 ctl02 nova-api[15734]: 2017-09-28 12:06:55.948 15734 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:06:55 ctl02 nova-api[15734]: 2017-09-28 12:06:55.948 15734 ERROR nova     max_url_len=max_url_len)
Sep 28 12:06:55 ctl02 nova-api[15734]: 2017-09-28 12:06:55.948 15734 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:06:55 ctl02 nova-api[15734]: 2017-09-28 12:06:55.948 15734 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:06:55 ctl02 nova-api[15734]: 2017-09-28 12:06:55.948 15734 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:06:55 ctl02 nova-api[15734]: 2017-09-28 12:06:55.948 15734 ERROR nova     sock.listen(backlog)
Sep 28 12:06:55 ctl02 nova-api[15734]: 2017-09-28 12:06:55.948 15734 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:06:55 ctl02 nova-api[15734]: 2017-09-28 12:06:55.948 15734 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:06:55 ctl02 nova-api[15734]: 2017-09-28 12:06:55.948 15734 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:06:55 ctl02 nova-api[15734]: 2017-09-28 12:06:55.948 15734 ERROR nova
Sep 28 12:06:56 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:06:56 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:06:56 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:06:56 ctl02 heat-api[13008]: 2017-09-28 12:06:56.312 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:06:56] "OPTIONS / HTTP/1.0" 200 134 0.000739
Sep 28 12:06:56 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:06:56 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:06:56 ctl02 heat-api[13008]: 2017-09-28 12:06:56.377 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:06:56] "OPTIONS / HTTP/1.0" 200 134 0.000771
Sep 28 12:06:56 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:06:56 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:06:57 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:06:57.658 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:06:57] "OPTIONS / HTTP/1.0" 200 134 0.000512
Sep 28 12:06:58 ctl02 nova-api[15752]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:06:58 ctl02 nova-api[15752]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:06:58 ctl02 nova-api[15752]: 2017-09-28 12:06:58.224 15752 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:06:58 ctl02 nova-api[15752]: 2017-09-28 12:06:58.243 15752 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:06:58 ctl02 nova-api[15752]: 2017-09-28 12:06:58.243 15752 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:06:58 ctl02 nova-api[15752]: 2017-09-28 12:06:58.243 15752 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:06:58 ctl02 nova-api[15752]: 2017-09-28 12:06:58.243 15752 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:06:58 ctl02 nova-api[15752]: 2017-09-28 12:06:58.243 15752 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:06:58 ctl02 nova-api[15752]: 2017-09-28 12:06:58.243 15752 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:06:58 ctl02 nova-api[15752]: 2017-09-28 12:06:58.243 15752 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:06:58 ctl02 nova-api[15752]: 2017-09-28 12:06:58.243 15752 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:06:58 ctl02 nova-api[15752]: 2017-09-28 12:06:58.243 15752 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:06:58 ctl02 nova-api[15752]: 2017-09-28 12:06:58.243 15752 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:06:58 ctl02 nova-api[15752]: 2017-09-28 12:06:58.243 15752 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:06:58 ctl02 nova-api[15752]: 2017-09-28 12:06:58.243 15752 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:06:58 ctl02 nova-api[15752]: 2017-09-28 12:06:58.243 15752 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:06:58 ctl02 nova-api[15752]: 2017-09-28 12:06:58.243 15752 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:06:58 ctl02 nova-api[15752]: 2017-09-28 12:06:58.243 15752 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:06:58 ctl02 nova-api[15752]: 2017-09-28 12:06:58.243 15752 ERROR nova.wsgi     self.filename))
Sep 28 12:06:58 ctl02 nova-api[15752]: 2017-09-28 12:06:58.243 15752 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:06:58 ctl02 nova-api[15752]: 2017-09-28 12:06:58.243 15752 ERROR nova.wsgi
Sep 28 12:06:58 ctl02 nova-api[15752]: 2017-09-28 12:06:58.244 15752 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:06:58 ctl02 nova-api[15752]: 2017-09-28 12:06:58.373 15752 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:06:58 ctl02 nova-api[15752]: 2017-09-28 12:06:58.601 15752 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:06:58 ctl02 nova-api[15752]: 2017-09-28 12:06:58.603 15752 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:06:58 ctl02 nova-api[15752]: 2017-09-28 12:06:58.603 15752 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:06:58 ctl02 nova-api[15752]: 2017-09-28 12:06:58.604 15752 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:06:58 ctl02 nova-api[15752]: 2017-09-28 12:06:58.733 15752 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:06:58 ctl02 nova-api[15752]: 2017-09-28 12:06:58.735 15752 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:06:58 ctl02 nova-api[15752]: 2017-09-28 12:06:58.735 15752 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:06:58 ctl02 nova-api[15752]: 2017-09-28 12:06:58.736 15752 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:06:58 ctl02 nova-api[15752]: 2017-09-28 12:06:58.739 15752 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:06:58 ctl02 nova-api[15752]: 2017-09-28 12:06:58.739 15752 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:06:58 ctl02 nova-api[15752]: 2017-09-28 12:06:58.739 15752 ERROR nova Traceback (most recent call last):
Sep 28 12:06:58 ctl02 nova-api[15752]: 2017-09-28 12:06:58.739 15752 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:06:58 ctl02 nova-api[15752]: 2017-09-28 12:06:58.739 15752 ERROR nova     sys.exit(main())
Sep 28 12:06:58 ctl02 nova-api[15752]: 2017-09-28 12:06:58.739 15752 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:06:58 ctl02 nova-api[15752]: 2017-09-28 12:06:58.739 15752 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:06:58 ctl02 nova-api[15752]: 2017-09-28 12:06:58.739 15752 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:06:58 ctl02 nova-api[15752]: 2017-09-28 12:06:58.739 15752 ERROR nova     max_url_len=max_url_len)
Sep 28 12:06:58 ctl02 nova-api[15752]: 2017-09-28 12:06:58.739 15752 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:06:58 ctl02 nova-api[15752]: 2017-09-28 12:06:58.739 15752 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:06:58 ctl02 nova-api[15752]: 2017-09-28 12:06:58.739 15752 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:06:58 ctl02 nova-api[15752]: 2017-09-28 12:06:58.739 15752 ERROR nova     sock.listen(backlog)
Sep 28 12:06:58 ctl02 nova-api[15752]: 2017-09-28 12:06:58.739 15752 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:06:58 ctl02 nova-api[15752]: 2017-09-28 12:06:58.739 15752 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:06:58 ctl02 nova-api[15752]: 2017-09-28 12:06:58.739 15752 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:06:58 ctl02 nova-api[15752]: 2017-09-28 12:06:58.739 15752 ERROR nova
Sep 28 12:06:58 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:06:58 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:06:58 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:06:58 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:06:58.926 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:06:58] "OPTIONS / HTTP/1.0" 200 134 0.000525
Sep 28 12:06:59 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:06:59 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:06:59 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:06:59 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:06:59 ctl02 heat-api-cfn[13300]: 2017-09-28 12:06:59.195 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:06:59] "OPTIONS / HTTP/1.0" 200 134 0.000534
Sep 28 12:07:00 ctl02 heat-api-cfn[13300]: 2017-09-28 12:07:00.025 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:07:00] "OPTIONS / HTTP/1.0" 200 134 0.000453
Sep 28 12:07:00 ctl02 nova-cert[4860]: 2017-09-28 12:07:00.130 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:07:00 ctl02 glance-api[29183]: 2017-09-28 12:07:00.703 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:07:00] "OPTIONS / HTTP/1.0" 200 134 0.000732
Sep 28 12:07:00 ctl02 nova-api[15769]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:07:00 ctl02 nova-api[15769]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:07:00 ctl02 nova-api[15769]: 2017-09-28 12:07:00.944 15769 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:07:00 ctl02 nova-api[15769]: 2017-09-28 12:07:00.946 15769 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:07:00 ctl02 nova-api[15769]: 2017-09-28 12:07:00.946 15769 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:07:00 ctl02 nova-api[15769]: 2017-09-28 12:07:00.946 15769 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:07:00 ctl02 nova-api[15769]: 2017-09-28 12:07:00.946 15769 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:07:00 ctl02 nova-api[15769]: 2017-09-28 12:07:00.946 15769 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:07:00 ctl02 nova-api[15769]: 2017-09-28 12:07:00.946 15769 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:07:00 ctl02 nova-api[15769]: 2017-09-28 12:07:00.946 15769 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:07:00 ctl02 nova-api[15769]: 2017-09-28 12:07:00.946 15769 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:07:00 ctl02 nova-api[15769]: 2017-09-28 12:07:00.946 15769 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:07:00 ctl02 nova-api[15769]: 2017-09-28 12:07:00.946 15769 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:07:00 ctl02 nova-api[15769]: 2017-09-28 12:07:00.946 15769 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:07:00 ctl02 nova-api[15769]: 2017-09-28 12:07:00.946 15769 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:07:00 ctl02 nova-api[15769]: 2017-09-28 12:07:00.946 15769 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:07:00 ctl02 nova-api[15769]: 2017-09-28 12:07:00.946 15769 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:07:00 ctl02 nova-api[15769]: 2017-09-28 12:07:00.946 15769 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:07:00 ctl02 nova-api[15769]: 2017-09-28 12:07:00.946 15769 ERROR nova.wsgi     self.filename))
Sep 28 12:07:00 ctl02 nova-api[15769]: 2017-09-28 12:07:00.946 15769 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:07:00 ctl02 nova-api[15769]: 2017-09-28 12:07:00.946 15769 ERROR nova.wsgi
Sep 28 12:07:00 ctl02 nova-api[15769]: 2017-09-28 12:07:00.947 15769 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:07:01 ctl02 nova-api[15769]: 2017-09-28 12:07:01.073 15769 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:07:01 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928120701195194
Sep 28 12:07:01 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 15783
Sep 28 12:07:01 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928120701195194
Sep 28 12:07:01 ctl02 nova-api[15769]: 2017-09-28 12:07:01.298 15769 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:07:01 ctl02 nova-api[15769]: 2017-09-28 12:07:01.301 15769 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:07:01 ctl02 nova-api[15769]: 2017-09-28 12:07:01.301 15769 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:07:01 ctl02 nova-api[15769]: 2017-09-28 12:07:01.301 15769 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:07:01 ctl02 nova-api[15769]: 2017-09-28 12:07:01.430 15769 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:07:01 ctl02 nova-api[15769]: 2017-09-28 12:07:01.432 15769 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:07:01 ctl02 nova-api[15769]: 2017-09-28 12:07:01.432 15769 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:07:01 ctl02 nova-api[15769]: 2017-09-28 12:07:01.432 15769 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:07:01 ctl02 nova-api[15769]: 2017-09-28 12:07:01.435 15769 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:07:01 ctl02 nova-api[15769]: 2017-09-28 12:07:01.436 15769 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:07:01 ctl02 nova-api[15769]: 2017-09-28 12:07:01.436 15769 ERROR nova Traceback (most recent call last):
Sep 28 12:07:01 ctl02 nova-api[15769]: 2017-09-28 12:07:01.436 15769 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:07:01 ctl02 nova-api[15769]: 2017-09-28 12:07:01.436 15769 ERROR nova     sys.exit(main())
Sep 28 12:07:01 ctl02 nova-api[15769]: 2017-09-28 12:07:01.436 15769 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:07:01 ctl02 nova-api[15769]: 2017-09-28 12:07:01.436 15769 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:07:01 ctl02 nova-api[15769]: 2017-09-28 12:07:01.436 15769 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:07:01 ctl02 nova-api[15769]: 2017-09-28 12:07:01.436 15769 ERROR nova     max_url_len=max_url_len)
Sep 28 12:07:01 ctl02 nova-api[15769]: 2017-09-28 12:07:01.436 15769 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:07:01 ctl02 nova-api[15769]: 2017-09-28 12:07:01.436 15769 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:07:01 ctl02 nova-api[15769]: 2017-09-28 12:07:01.436 15769 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:07:01 ctl02 nova-api[15769]: 2017-09-28 12:07:01.436 15769 ERROR nova     sock.listen(backlog)
Sep 28 12:07:01 ctl02 nova-api[15769]: 2017-09-28 12:07:01.436 15769 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:07:01 ctl02 nova-api[15769]: 2017-09-28 12:07:01.436 15769 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:07:01 ctl02 nova-api[15769]: 2017-09-28 12:07:01.436 15769 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:07:01 ctl02 nova-api[15769]: 2017-09-28 12:07:01.436 15769 ERROR nova
Sep 28 12:07:01 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:07:01 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:07:01 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:07:01 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:07:01.856 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:07:01] "OPTIONS / HTTP/1.0" 200 134 0.000591
Sep 28 12:07:01 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:07:01 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:07:01 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:07:01 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:07:02 ctl02 heat-api[13008]: 2017-09-28 12:07:02.281 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:07:02] "OPTIONS / HTTP/1.0" 200 134 0.000553
Sep 28 12:07:02 ctl02 nova-conductor[5056]: 2017-09-28 12:07:02.350 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:07:02 ctl02 nova-conductor[5056]: 2017-09-28 12:07:02.366 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:07:02 ctl02 nova-conductor[5056]: 2017-09-28 12:07:02.371 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:07:02 ctl02 nova-conductor[5056]: 2017-09-28 12:07:02.376 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:07:03 ctl02 heat-api-cfn[13300]: 2017-09-28 12:07:03.008 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:07:03] "OPTIONS / HTTP/1.0" 200 134 0.000626
Sep 28 12:07:03 ctl02 nova-api[15793]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:07:03 ctl02 nova-api[15793]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:07:03 ctl02 glance-api[29183]: 2017-09-28 12:07:03.660 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:07:03] "OPTIONS / HTTP/1.0" 200 134 0.000644
Sep 28 12:07:03 ctl02 nova-api[15793]: 2017-09-28 12:07:03.669 15793 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:07:03 ctl02 nova-api[15793]: 2017-09-28 12:07:03.671 15793 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:07:03 ctl02 nova-api[15793]: 2017-09-28 12:07:03.671 15793 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:07:03 ctl02 nova-api[15793]: 2017-09-28 12:07:03.671 15793 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:07:03 ctl02 nova-api[15793]: 2017-09-28 12:07:03.671 15793 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:07:03 ctl02 nova-api[15793]: 2017-09-28 12:07:03.671 15793 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:07:03 ctl02 nova-api[15793]: 2017-09-28 12:07:03.671 15793 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:07:03 ctl02 nova-api[15793]: 2017-09-28 12:07:03.671 15793 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:07:03 ctl02 nova-api[15793]: 2017-09-28 12:07:03.671 15793 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:07:03 ctl02 nova-api[15793]: 2017-09-28 12:07:03.671 15793 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:07:03 ctl02 nova-api[15793]: 2017-09-28 12:07:03.671 15793 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:07:03 ctl02 nova-api[15793]: 2017-09-28 12:07:03.671 15793 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:07:03 ctl02 nova-api[15793]: 2017-09-28 12:07:03.671 15793 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:07:03 ctl02 nova-api[15793]: 2017-09-28 12:07:03.671 15793 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:07:03 ctl02 nova-api[15793]: 2017-09-28 12:07:03.671 15793 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:07:03 ctl02 nova-api[15793]: 2017-09-28 12:07:03.671 15793 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:07:03 ctl02 nova-api[15793]: 2017-09-28 12:07:03.671 15793 ERROR nova.wsgi     self.filename))
Sep 28 12:07:03 ctl02 nova-api[15793]: 2017-09-28 12:07:03.671 15793 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:07:03 ctl02 nova-api[15793]: 2017-09-28 12:07:03.671 15793 ERROR nova.wsgi
Sep 28 12:07:03 ctl02 nova-api[15793]: 2017-09-28 12:07:03.673 15793 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:07:03 ctl02 nova-api[15793]: 2017-09-28 12:07:03.800 15793 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:07:04 ctl02 nova-api[15793]: 2017-09-28 12:07:04.024 15793 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:07:04 ctl02 nova-api[15793]: 2017-09-28 12:07:04.026 15793 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:07:04 ctl02 nova-api[15793]: 2017-09-28 12:07:04.027 15793 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:07:04 ctl02 nova-api[15793]: 2017-09-28 12:07:04.027 15793 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:07:04 ctl02 nova-api[15793]: 2017-09-28 12:07:04.157 15793 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:07:04 ctl02 nova-api[15793]: 2017-09-28 12:07:04.159 15793 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:07:04 ctl02 nova-api[15793]: 2017-09-28 12:07:04.160 15793 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:07:04 ctl02 nova-api[15793]: 2017-09-28 12:07:04.160 15793 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:07:04 ctl02 nova-api[15793]: 2017-09-28 12:07:04.163 15793 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:07:04 ctl02 nova-api[15793]: 2017-09-28 12:07:04.164 15793 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:07:04 ctl02 nova-api[15793]: 2017-09-28 12:07:04.164 15793 ERROR nova Traceback (most recent call last):
Sep 28 12:07:04 ctl02 nova-api[15793]: 2017-09-28 12:07:04.164 15793 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:07:04 ctl02 nova-api[15793]: 2017-09-28 12:07:04.164 15793 ERROR nova     sys.exit(main())
Sep 28 12:07:04 ctl02 nova-api[15793]: 2017-09-28 12:07:04.164 15793 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:07:04 ctl02 nova-api[15793]: 2017-09-28 12:07:04.164 15793 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:07:04 ctl02 nova-api[15793]: 2017-09-28 12:07:04.164 15793 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:07:04 ctl02 nova-api[15793]: 2017-09-28 12:07:04.164 15793 ERROR nova     max_url_len=max_url_len)
Sep 28 12:07:04 ctl02 nova-api[15793]: 2017-09-28 12:07:04.164 15793 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:07:04 ctl02 nova-api[15793]: 2017-09-28 12:07:04.164 15793 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:07:04 ctl02 nova-api[15793]: 2017-09-28 12:07:04.164 15793 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:07:04 ctl02 nova-api[15793]: 2017-09-28 12:07:04.164 15793 ERROR nova     sock.listen(backlog)
Sep 28 12:07:04 ctl02 nova-api[15793]: 2017-09-28 12:07:04.164 15793 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:07:04 ctl02 nova-api[15793]: 2017-09-28 12:07:04.164 15793 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:07:04 ctl02 nova-api[15793]: 2017-09-28 12:07:04.164 15793 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:07:04 ctl02 nova-api[15793]: 2017-09-28 12:07:04.164 15793 ERROR nova
Sep 28 12:07:04 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:07:04 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:07:04 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:07:04 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:07:04 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:07:04 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:07:04 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:07:04 ctl02 glance-api[29183]: 2017-09-28 12:07:04.864 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:07:04] "OPTIONS / HTTP/1.0" 200 134 0.000737
Sep 28 12:07:06 ctl02 nova-api[15811]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:07:06 ctl02 nova-api[15811]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:07:06 ctl02 heat-api[13008]: 2017-09-28 12:07:06.433 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:07:06] "OPTIONS / HTTP/1.0" 200 134 0.000535
Sep 28 12:07:06 ctl02 nova-api[15811]: 2017-09-28 12:07:06.469 15811 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:07:06 ctl02 nova-api[15811]: 2017-09-28 12:07:06.472 15811 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:07:06 ctl02 nova-api[15811]: 2017-09-28 12:07:06.472 15811 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:07:06 ctl02 nova-api[15811]: 2017-09-28 12:07:06.472 15811 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:07:06 ctl02 nova-api[15811]: 2017-09-28 12:07:06.472 15811 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:07:06 ctl02 nova-api[15811]: 2017-09-28 12:07:06.472 15811 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:07:06 ctl02 nova-api[15811]: 2017-09-28 12:07:06.472 15811 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:07:06 ctl02 nova-api[15811]: 2017-09-28 12:07:06.472 15811 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:07:06 ctl02 nova-api[15811]: 2017-09-28 12:07:06.472 15811 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:07:06 ctl02 nova-api[15811]: 2017-09-28 12:07:06.472 15811 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:07:06 ctl02 nova-api[15811]: 2017-09-28 12:07:06.472 15811 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:07:06 ctl02 nova-api[15811]: 2017-09-28 12:07:06.472 15811 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:07:06 ctl02 nova-api[15811]: 2017-09-28 12:07:06.472 15811 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:07:06 ctl02 nova-api[15811]: 2017-09-28 12:07:06.472 15811 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:07:06 ctl02 nova-api[15811]: 2017-09-28 12:07:06.472 15811 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:07:06 ctl02 nova-api[15811]: 2017-09-28 12:07:06.472 15811 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:07:06 ctl02 nova-api[15811]: 2017-09-28 12:07:06.472 15811 ERROR nova.wsgi     self.filename))
Sep 28 12:07:06 ctl02 nova-api[15811]: 2017-09-28 12:07:06.472 15811 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:07:06 ctl02 nova-api[15811]: 2017-09-28 12:07:06.472 15811 ERROR nova.wsgi
Sep 28 12:07:06 ctl02 nova-api[15811]: 2017-09-28 12:07:06.474 15811 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:07:06 ctl02 heat-api[13008]: 2017-09-28 12:07:06.507 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:07:06] "OPTIONS / HTTP/1.0" 200 134 0.000616
Sep 28 12:07:06 ctl02 nova-api[15811]: 2017-09-28 12:07:06.614 15811 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:07:06 ctl02 nova-api[15811]: 2017-09-28 12:07:06.858 15811 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:07:06 ctl02 nova-api[15811]: 2017-09-28 12:07:06.861 15811 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:07:06 ctl02 nova-api[15811]: 2017-09-28 12:07:06.861 15811 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:07:06 ctl02 nova-api[15811]: 2017-09-28 12:07:06.862 15811 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:07:06 ctl02 nova-api[15811]: 2017-09-28 12:07:06.996 15811 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:07:06 ctl02 nova-api[15811]: 2017-09-28 12:07:06.998 15811 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:07:06 ctl02 nova-api[15811]: 2017-09-28 12:07:06.999 15811 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:07:06 ctl02 nova-api[15811]: 2017-09-28 12:07:06.999 15811 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:07:07 ctl02 nova-api[15811]: 2017-09-28 12:07:07.003 15811 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:07:07 ctl02 nova-api[15811]: 2017-09-28 12:07:07.003 15811 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:07:07 ctl02 nova-api[15811]: 2017-09-28 12:07:07.003 15811 ERROR nova Traceback (most recent call last):
Sep 28 12:07:07 ctl02 nova-api[15811]: 2017-09-28 12:07:07.003 15811 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:07:07 ctl02 nova-api[15811]: 2017-09-28 12:07:07.003 15811 ERROR nova     sys.exit(main())
Sep 28 12:07:07 ctl02 nova-api[15811]: 2017-09-28 12:07:07.003 15811 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:07:07 ctl02 nova-api[15811]: 2017-09-28 12:07:07.003 15811 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:07:07 ctl02 nova-api[15811]: 2017-09-28 12:07:07.003 15811 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:07:07 ctl02 nova-api[15811]: 2017-09-28 12:07:07.003 15811 ERROR nova     max_url_len=max_url_len)
Sep 28 12:07:07 ctl02 nova-api[15811]: 2017-09-28 12:07:07.003 15811 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:07:07 ctl02 nova-api[15811]: 2017-09-28 12:07:07.003 15811 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:07:07 ctl02 nova-api[15811]: 2017-09-28 12:07:07.003 15811 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:07:07 ctl02 nova-api[15811]: 2017-09-28 12:07:07.003 15811 ERROR nova     sock.listen(backlog)
Sep 28 12:07:07 ctl02 nova-api[15811]: 2017-09-28 12:07:07.003 15811 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:07:07 ctl02 nova-api[15811]: 2017-09-28 12:07:07.003 15811 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:07:07 ctl02 nova-api[15811]: 2017-09-28 12:07:07.003 15811 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:07:07 ctl02 nova-api[15811]: 2017-09-28 12:07:07.003 15811 ERROR nova
Sep 28 12:07:07 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:07:07 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:07:07 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:07:07 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:07:07 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:07:07 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:07:07 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:07:07 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:07:07.449 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:07:07] "OPTIONS / HTTP/1.0" 200 134 0.000531
Sep 28 12:07:08 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:07:08.717 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:07:08] "OPTIONS / HTTP/1.0" 200 134 0.000391
Sep 28 12:07:08 ctl02 heat-api-cfn[13300]: 2017-09-28 12:07:08.943 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:07:08] "OPTIONS / HTTP/1.0" 200 134 0.000469
Sep 28 12:07:09 ctl02 nova-api[15829]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:07:09 ctl02 nova-api[15829]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:07:09 ctl02 nova-api[15829]: 2017-09-28 12:07:09.210 15829 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:07:09 ctl02 nova-api[15829]: 2017-09-28 12:07:09.212 15829 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:07:09 ctl02 nova-api[15829]: 2017-09-28 12:07:09.212 15829 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:07:09 ctl02 nova-api[15829]: 2017-09-28 12:07:09.212 15829 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:07:09 ctl02 nova-api[15829]: 2017-09-28 12:07:09.212 15829 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:07:09 ctl02 nova-api[15829]: 2017-09-28 12:07:09.212 15829 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:07:09 ctl02 nova-api[15829]: 2017-09-28 12:07:09.212 15829 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:07:09 ctl02 nova-api[15829]: 2017-09-28 12:07:09.212 15829 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:07:09 ctl02 nova-api[15829]: 2017-09-28 12:07:09.212 15829 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:07:09 ctl02 nova-api[15829]: 2017-09-28 12:07:09.212 15829 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:07:09 ctl02 nova-api[15829]: 2017-09-28 12:07:09.212 15829 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:07:09 ctl02 nova-api[15829]: 2017-09-28 12:07:09.212 15829 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:07:09 ctl02 nova-api[15829]: 2017-09-28 12:07:09.212 15829 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:07:09 ctl02 nova-api[15829]: 2017-09-28 12:07:09.212 15829 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:07:09 ctl02 nova-api[15829]: 2017-09-28 12:07:09.212 15829 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:07:09 ctl02 nova-api[15829]: 2017-09-28 12:07:09.212 15829 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:07:09 ctl02 nova-api[15829]: 2017-09-28 12:07:09.212 15829 ERROR nova.wsgi     self.filename))
Sep 28 12:07:09 ctl02 nova-api[15829]: 2017-09-28 12:07:09.212 15829 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:07:09 ctl02 nova-api[15829]: 2017-09-28 12:07:09.212 15829 ERROR nova.wsgi
Sep 28 12:07:09 ctl02 nova-api[15829]: 2017-09-28 12:07:09.214 15829 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:07:09 ctl02 nova-api[15829]: 2017-09-28 12:07:09.342 15829 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:07:09 ctl02 nova-api[15829]: 2017-09-28 12:07:09.569 15829 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:07:09 ctl02 nova-api[15829]: 2017-09-28 12:07:09.571 15829 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:07:09 ctl02 nova-api[15829]: 2017-09-28 12:07:09.572 15829 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:07:09 ctl02 nova-api[15829]: 2017-09-28 12:07:09.572 15829 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:07:09 ctl02 nova-api[15829]: 2017-09-28 12:07:09.701 15829 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:07:09 ctl02 nova-api[15829]: 2017-09-28 12:07:09.704 15829 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:07:09 ctl02 nova-api[15829]: 2017-09-28 12:07:09.704 15829 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:07:09 ctl02 nova-api[15829]: 2017-09-28 12:07:09.705 15829 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:07:09 ctl02 nova-api[15829]: 2017-09-28 12:07:09.708 15829 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:07:09 ctl02 nova-api[15829]: 2017-09-28 12:07:09.708 15829 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:07:09 ctl02 nova-api[15829]: 2017-09-28 12:07:09.708 15829 ERROR nova Traceback (most recent call last):
Sep 28 12:07:09 ctl02 nova-api[15829]: 2017-09-28 12:07:09.708 15829 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:07:09 ctl02 nova-api[15829]: 2017-09-28 12:07:09.708 15829 ERROR nova     sys.exit(main())
Sep 28 12:07:09 ctl02 nova-api[15829]: 2017-09-28 12:07:09.708 15829 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:07:09 ctl02 nova-api[15829]: 2017-09-28 12:07:09.708 15829 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:07:09 ctl02 nova-api[15829]: 2017-09-28 12:07:09.708 15829 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:07:09 ctl02 nova-api[15829]: 2017-09-28 12:07:09.708 15829 ERROR nova     max_url_len=max_url_len)
Sep 28 12:07:09 ctl02 nova-api[15829]: 2017-09-28 12:07:09.708 15829 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:07:09 ctl02 nova-api[15829]: 2017-09-28 12:07:09.708 15829 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:07:09 ctl02 nova-api[15829]: 2017-09-28 12:07:09.708 15829 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:07:09 ctl02 nova-api[15829]: 2017-09-28 12:07:09.708 15829 ERROR nova     sock.listen(backlog)
Sep 28 12:07:09 ctl02 nova-api[15829]: 2017-09-28 12:07:09.708 15829 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:07:09 ctl02 nova-api[15829]: 2017-09-28 12:07:09.708 15829 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:07:09 ctl02 nova-api[15829]: 2017-09-28 12:07:09.708 15829 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:07:09 ctl02 nova-api[15829]: 2017-09-28 12:07:09.708 15829 ERROR nova
Sep 28 12:07:09 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:07:09 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:07:09 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:07:10 ctl02 nova-consoleauth[5433]: 2017-09-28 12:07:10.028 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:07:10 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:07:10 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:07:10 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:07:10 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:07:10 ctl02 heat-api-cfn[13300]: 2017-09-28 12:07:10.366 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:07:10] "OPTIONS / HTTP/1.0" 200 134 0.000483
Sep 28 12:07:10 ctl02 glance-api[29183]: 2017-09-28 12:07:10.684 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:07:10] "OPTIONS / HTTP/1.0" 200 134 0.000656
Sep 28 12:07:10 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe7cd0377)
Sep 28 12:07:11 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928120711351611
Sep 28 12:07:11 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 15858
Sep 28 12:07:11 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928120711351611
Sep 28 12:07:11 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:07:11.548 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:07:11] "OPTIONS / HTTP/1.0" 200 134 0.000440
Sep 28 12:07:11 ctl02 nova-api[15847]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:07:11 ctl02 nova-api[15847]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:07:11 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe7cd0377)
Sep 28 12:07:11 ctl02 nova-api[15847]: 2017-09-28 12:07:11.958 15847 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:07:11 ctl02 nova-api[15847]: 2017-09-28 12:07:11.960 15847 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:07:11 ctl02 nova-api[15847]: 2017-09-28 12:07:11.960 15847 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:07:11 ctl02 nova-api[15847]: 2017-09-28 12:07:11.960 15847 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:07:11 ctl02 nova-api[15847]: 2017-09-28 12:07:11.960 15847 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:07:11 ctl02 nova-api[15847]: 2017-09-28 12:07:11.960 15847 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:07:11 ctl02 nova-api[15847]: 2017-09-28 12:07:11.960 15847 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:07:11 ctl02 nova-api[15847]: 2017-09-28 12:07:11.960 15847 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:07:11 ctl02 nova-api[15847]: 2017-09-28 12:07:11.960 15847 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:07:11 ctl02 nova-api[15847]: 2017-09-28 12:07:11.960 15847 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:07:11 ctl02 nova-api[15847]: 2017-09-28 12:07:11.960 15847 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:07:11 ctl02 nova-api[15847]: 2017-09-28 12:07:11.960 15847 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:07:11 ctl02 nova-api[15847]: 2017-09-28 12:07:11.960 15847 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:07:11 ctl02 nova-api[15847]: 2017-09-28 12:07:11.960 15847 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:07:11 ctl02 nova-api[15847]: 2017-09-28 12:07:11.960 15847 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:07:11 ctl02 nova-api[15847]: 2017-09-28 12:07:11.960 15847 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:07:11 ctl02 nova-api[15847]: 2017-09-28 12:07:11.960 15847 ERROR nova.wsgi     self.filename))
Sep 28 12:07:11 ctl02 nova-api[15847]: 2017-09-28 12:07:11.960 15847 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:07:11 ctl02 nova-api[15847]: 2017-09-28 12:07:11.960 15847 ERROR nova.wsgi
Sep 28 12:07:11 ctl02 nova-api[15847]: 2017-09-28 12:07:11.962 15847 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:07:12 ctl02 nova-api[15847]: 2017-09-28 12:07:12.092 15847 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:07:12 ctl02 heat-api[13008]: 2017-09-28 12:07:12.115 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:07:12] "OPTIONS / HTTP/1.0" 200 134 0.000612
Sep 28 12:07:12 ctl02 nova-api[15847]: 2017-09-28 12:07:12.332 15847 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:07:12 ctl02 nova-api[15847]: 2017-09-28 12:07:12.335 15847 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:07:12 ctl02 nova-api[15847]: 2017-09-28 12:07:12.336 15847 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:07:12 ctl02 nova-api[15847]: 2017-09-28 12:07:12.336 15847 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:07:12 ctl02 nova-api[15847]: 2017-09-28 12:07:12.468 15847 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:07:12 ctl02 nova-api[15847]: 2017-09-28 12:07:12.471 15847 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:07:12 ctl02 nova-api[15847]: 2017-09-28 12:07:12.472 15847 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:07:12 ctl02 nova-api[15847]: 2017-09-28 12:07:12.472 15847 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:07:12 ctl02 nova-api[15847]: 2017-09-28 12:07:12.475 15847 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:07:12 ctl02 nova-api[15847]: 2017-09-28 12:07:12.476 15847 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:07:12 ctl02 nova-api[15847]: 2017-09-28 12:07:12.476 15847 ERROR nova Traceback (most recent call last):
Sep 28 12:07:12 ctl02 nova-api[15847]: 2017-09-28 12:07:12.476 15847 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:07:12 ctl02 nova-api[15847]: 2017-09-28 12:07:12.476 15847 ERROR nova     sys.exit(main())
Sep 28 12:07:12 ctl02 nova-api[15847]: 2017-09-28 12:07:12.476 15847 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:07:12 ctl02 nova-api[15847]: 2017-09-28 12:07:12.476 15847 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:07:12 ctl02 nova-api[15847]: 2017-09-28 12:07:12.476 15847 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:07:12 ctl02 nova-api[15847]: 2017-09-28 12:07:12.476 15847 ERROR nova     max_url_len=max_url_len)
Sep 28 12:07:12 ctl02 nova-api[15847]: 2017-09-28 12:07:12.476 15847 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:07:12 ctl02 nova-api[15847]: 2017-09-28 12:07:12.476 15847 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:07:12 ctl02 nova-api[15847]: 2017-09-28 12:07:12.476 15847 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:07:12 ctl02 nova-api[15847]: 2017-09-28 12:07:12.476 15847 ERROR nova     sock.listen(backlog)
Sep 28 12:07:12 ctl02 nova-api[15847]: 2017-09-28 12:07:12.476 15847 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:07:12 ctl02 nova-api[15847]: 2017-09-28 12:07:12.476 15847 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:07:12 ctl02 nova-api[15847]: 2017-09-28 12:07:12.476 15847 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:07:12 ctl02 nova-api[15847]: 2017-09-28 12:07:12.476 15847 ERROR nova
Sep 28 12:07:12 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:07:12 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:07:12 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:07:12 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe7cd0377)
Sep 28 12:07:12 ctl02 heat-api-cfn[13300]: 2017-09-28 12:07:12.851 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:07:12] "OPTIONS / HTTP/1.0" 200 134 0.000497
Sep 28 12:07:12 ctl02 dhclient[600]: DHCPREQUEST of 192.168.11.25 on ens2 to 192.168.11.3 port 67 (xid=0x3415f07)
Sep 28 12:07:12 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:07:12 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:07:12 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:07:12 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:07:12 ctl02 dhclient[600]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 12:07:13 ctl02 nova-scheduler[5620]: 2017-09-28 12:07:13.047 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:07:13 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 12:07:13 ctl02 ntp[15931]:  * Stopping NTP server ntpd
Sep 28 12:07:13 ctl02 ntp[15931]:    ...done.
Sep 28 12:07:13 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 12:07:13 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 12:07:13 ctl02 ntp[15941]:  * Starting NTP server ntpd
Sep 28 12:07:13 ctl02 ntpd[15951]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 12:07:13 ctl02 ntpd[15951]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -c /var/lib/ntp/ntp.conf.dhcp -u 108:112
Sep 28 12:07:13 ctl02 ntp[15941]:    ...done.
Sep 28 12:07:13 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 12:07:13 ctl02 dhclient[600]: bound to 192.168.11.25 -- renewal in 282 seconds.
Sep 28 12:07:13 ctl02 ntpd[15956]: proto: precision = 0.043 usec (-24)
Sep 28 12:07:13 ctl02 ntpd[15956]: switching logging to file /var/log/ntp.log
Sep 28 12:07:13 ctl02 glance-api[29183]: 2017-09-28 12:07:13.342 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:07:13] "OPTIONS / HTTP/1.0" 200 134 0.000623
Sep 28 12:07:13 ctl02 heat-engine[12803]: 2017-09-28 12:07:13.413 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:07:13 ctl02 heat-engine[12803]: 2017-09-28 12:07:13.445 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:07:13 ctl02 heat-engine[12803]: 2017-09-28 12:07:13.463 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:07:13 ctl02 heat-engine[12803]: 2017-09-28 12:07:13.470 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:07:13 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe7cd0377)
Sep 28 12:07:14 ctl02 nova-api[15869]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:07:14 ctl02 nova-api[15869]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:07:14 ctl02 glance-api[29183]: 2017-09-28 12:07:14.617 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:07:14] "OPTIONS / HTTP/1.0" 200 134 0.000694
Sep 28 12:07:14 ctl02 nova-api[15869]: 2017-09-28 12:07:14.730 15869 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:07:14 ctl02 nova-api[15869]: 2017-09-28 12:07:14.732 15869 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:07:14 ctl02 nova-api[15869]: 2017-09-28 12:07:14.732 15869 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:07:14 ctl02 nova-api[15869]: 2017-09-28 12:07:14.732 15869 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:07:14 ctl02 nova-api[15869]: 2017-09-28 12:07:14.732 15869 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:07:14 ctl02 nova-api[15869]: 2017-09-28 12:07:14.732 15869 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:07:14 ctl02 nova-api[15869]: 2017-09-28 12:07:14.732 15869 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:07:14 ctl02 nova-api[15869]: 2017-09-28 12:07:14.732 15869 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:07:14 ctl02 nova-api[15869]: 2017-09-28 12:07:14.732 15869 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:07:14 ctl02 nova-api[15869]: 2017-09-28 12:07:14.732 15869 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:07:14 ctl02 nova-api[15869]: 2017-09-28 12:07:14.732 15869 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:07:14 ctl02 nova-api[15869]: 2017-09-28 12:07:14.732 15869 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:07:14 ctl02 nova-api[15869]: 2017-09-28 12:07:14.732 15869 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:07:14 ctl02 nova-api[15869]: 2017-09-28 12:07:14.732 15869 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:07:14 ctl02 nova-api[15869]: 2017-09-28 12:07:14.732 15869 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:07:14 ctl02 nova-api[15869]: 2017-09-28 12:07:14.732 15869 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:07:14 ctl02 nova-api[15869]: 2017-09-28 12:07:14.732 15869 ERROR nova.wsgi     self.filename))
Sep 28 12:07:14 ctl02 nova-api[15869]: 2017-09-28 12:07:14.732 15869 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:07:14 ctl02 nova-api[15869]: 2017-09-28 12:07:14.732 15869 ERROR nova.wsgi
Sep 28 12:07:14 ctl02 nova-api[15869]: 2017-09-28 12:07:14.733 15869 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:07:14 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe7cd0377)
Sep 28 12:07:14 ctl02 nova-api[15869]: 2017-09-28 12:07:14.869 15869 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:07:15 ctl02 nova-api[15869]: 2017-09-28 12:07:15.106 15869 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:07:15 ctl02 nova-api[15869]: 2017-09-28 12:07:15.109 15869 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:07:15 ctl02 nova-api[15869]: 2017-09-28 12:07:15.109 15869 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:07:15 ctl02 nova-api[15869]: 2017-09-28 12:07:15.109 15869 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:07:15 ctl02 nova-api[15869]: 2017-09-28 12:07:15.241 15869 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:07:15 ctl02 nova-api[15869]: 2017-09-28 12:07:15.243 15869 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:07:15 ctl02 nova-api[15869]: 2017-09-28 12:07:15.243 15869 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:07:15 ctl02 nova-api[15869]: 2017-09-28 12:07:15.244 15869 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:07:15 ctl02 nova-api[15869]: 2017-09-28 12:07:15.247 15869 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:07:15 ctl02 nova-api[15869]: 2017-09-28 12:07:15.247 15869 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:07:15 ctl02 nova-api[15869]: 2017-09-28 12:07:15.247 15869 ERROR nova Traceback (most recent call last):
Sep 28 12:07:15 ctl02 nova-api[15869]: 2017-09-28 12:07:15.247 15869 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:07:15 ctl02 nova-api[15869]: 2017-09-28 12:07:15.247 15869 ERROR nova     sys.exit(main())
Sep 28 12:07:15 ctl02 nova-api[15869]: 2017-09-28 12:07:15.247 15869 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:07:15 ctl02 nova-api[15869]: 2017-09-28 12:07:15.247 15869 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:07:15 ctl02 nova-api[15869]: 2017-09-28 12:07:15.247 15869 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:07:15 ctl02 nova-api[15869]: 2017-09-28 12:07:15.247 15869 ERROR nova     max_url_len=max_url_len)
Sep 28 12:07:15 ctl02 nova-api[15869]: 2017-09-28 12:07:15.247 15869 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:07:15 ctl02 nova-api[15869]: 2017-09-28 12:07:15.247 15869 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:07:15 ctl02 nova-api[15869]: 2017-09-28 12:07:15.247 15869 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:07:15 ctl02 nova-api[15869]: 2017-09-28 12:07:15.247 15869 ERROR nova     sock.listen(backlog)
Sep 28 12:07:15 ctl02 nova-api[15869]: 2017-09-28 12:07:15.247 15869 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:07:15 ctl02 nova-api[15869]: 2017-09-28 12:07:15.247 15869 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:07:15 ctl02 nova-api[15869]: 2017-09-28 12:07:15.247 15869 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:07:15 ctl02 nova-api[15869]: 2017-09-28 12:07:15.247 15869 ERROR nova
Sep 28 12:07:15 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:07:15 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:07:15 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:07:15 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:07:15 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:07:15 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:07:15 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:07:15 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe7cd0377)
Sep 28 12:07:16 ctl02 heat-api[13008]: 2017-09-28 12:07:16.526 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:07:16] "OPTIONS / HTTP/1.0" 200 134 0.000601
Sep 28 12:07:16 ctl02 heat-api[13008]: 2017-09-28 12:07:16.724 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:07:16] "OPTIONS / HTTP/1.0" 200 134 0.000575
Sep 28 12:07:16 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe7cd0377)
Sep 28 12:07:17 ctl02 nova-api[15971]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:07:17 ctl02 nova-api[15971]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:07:17 ctl02 nova-api[15971]: 2017-09-28 12:07:17.452 15971 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:07:17 ctl02 nova-api[15971]: 2017-09-28 12:07:17.454 15971 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:07:17 ctl02 nova-api[15971]: 2017-09-28 12:07:17.454 15971 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:07:17 ctl02 nova-api[15971]: 2017-09-28 12:07:17.454 15971 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:07:17 ctl02 nova-api[15971]: 2017-09-28 12:07:17.454 15971 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:07:17 ctl02 nova-api[15971]: 2017-09-28 12:07:17.454 15971 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:07:17 ctl02 nova-api[15971]: 2017-09-28 12:07:17.454 15971 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:07:17 ctl02 nova-api[15971]: 2017-09-28 12:07:17.454 15971 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:07:17 ctl02 nova-api[15971]: 2017-09-28 12:07:17.454 15971 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:07:17 ctl02 nova-api[15971]: 2017-09-28 12:07:17.454 15971 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:07:17 ctl02 nova-api[15971]: 2017-09-28 12:07:17.454 15971 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:07:17 ctl02 nova-api[15971]: 2017-09-28 12:07:17.454 15971 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:07:17 ctl02 nova-api[15971]: 2017-09-28 12:07:17.454 15971 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:07:17 ctl02 nova-api[15971]: 2017-09-28 12:07:17.454 15971 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:07:17 ctl02 nova-api[15971]: 2017-09-28 12:07:17.454 15971 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:07:17 ctl02 nova-api[15971]: 2017-09-28 12:07:17.454 15971 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:07:17 ctl02 nova-api[15971]: 2017-09-28 12:07:17.454 15971 ERROR nova.wsgi     self.filename))
Sep 28 12:07:17 ctl02 nova-api[15971]: 2017-09-28 12:07:17.454 15971 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:07:17 ctl02 nova-api[15971]: 2017-09-28 12:07:17.454 15971 ERROR nova.wsgi
Sep 28 12:07:17 ctl02 nova-api[15971]: 2017-09-28 12:07:17.456 15971 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:07:17 ctl02 nova-api[15971]: 2017-09-28 12:07:17.588 15971 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:07:17 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:07:17.823 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:07:17] "OPTIONS / HTTP/1.0" 200 134 0.000487
Sep 28 12:07:17 ctl02 nova-api[15971]: 2017-09-28 12:07:17.827 15971 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:07:17 ctl02 nova-api[15971]: 2017-09-28 12:07:17.829 15971 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:07:17 ctl02 nova-api[15971]: 2017-09-28 12:07:17.829 15971 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:07:17 ctl02 nova-api[15971]: 2017-09-28 12:07:17.829 15971 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:07:17 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe7cd0377)
Sep 28 12:07:17 ctl02 nova-api[15971]: 2017-09-28 12:07:17.961 15971 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:07:17 ctl02 nova-api[15971]: 2017-09-28 12:07:17.963 15971 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:07:17 ctl02 nova-api[15971]: 2017-09-28 12:07:17.963 15971 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:07:17 ctl02 nova-api[15971]: 2017-09-28 12:07:17.963 15971 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:07:17 ctl02 nova-api[15971]: 2017-09-28 12:07:17.967 15971 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:07:17 ctl02 nova-api[15971]: 2017-09-28 12:07:17.967 15971 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:07:17 ctl02 nova-api[15971]: 2017-09-28 12:07:17.967 15971 ERROR nova Traceback (most recent call last):
Sep 28 12:07:17 ctl02 nova-api[15971]: 2017-09-28 12:07:17.967 15971 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:07:17 ctl02 nova-api[15971]: 2017-09-28 12:07:17.967 15971 ERROR nova     sys.exit(main())
Sep 28 12:07:17 ctl02 nova-api[15971]: 2017-09-28 12:07:17.967 15971 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:07:17 ctl02 nova-api[15971]: 2017-09-28 12:07:17.967 15971 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:07:17 ctl02 nova-api[15971]: 2017-09-28 12:07:17.967 15971 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:07:17 ctl02 nova-api[15971]: 2017-09-28 12:07:17.967 15971 ERROR nova     max_url_len=max_url_len)
Sep 28 12:07:17 ctl02 nova-api[15971]: 2017-09-28 12:07:17.967 15971 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:07:17 ctl02 nova-api[15971]: 2017-09-28 12:07:17.967 15971 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:07:17 ctl02 nova-api[15971]: 2017-09-28 12:07:17.967 15971 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:07:17 ctl02 nova-api[15971]: 2017-09-28 12:07:17.967 15971 ERROR nova     sock.listen(backlog)
Sep 28 12:07:17 ctl02 nova-api[15971]: 2017-09-28 12:07:17.967 15971 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:07:17 ctl02 nova-api[15971]: 2017-09-28 12:07:17.967 15971 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:07:17 ctl02 nova-api[15971]: 2017-09-28 12:07:17.967 15971 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:07:17 ctl02 nova-api[15971]: 2017-09-28 12:07:17.967 15971 ERROR nova
Sep 28 12:07:18 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:07:18 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:07:18 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:07:18 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:07:18.360 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:07:18] "OPTIONS / HTTP/1.0" 200 134 0.000590
Sep 28 12:07:18 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:07:18 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:07:18 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:07:18 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:07:18 ctl02 heat-api-cfn[13300]: 2017-09-28 12:07:18.676 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:07:18] "OPTIONS / HTTP/1.0" 200 134 0.000546
Sep 28 12:07:18 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe7cd0377)
Sep 28 12:07:19 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe7cd0377)
Sep 28 12:07:20 ctl02 nova-api[15989]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:07:20 ctl02 nova-api[15989]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:07:20 ctl02 nova-api[15989]: 2017-09-28 12:07:20.190 15989 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:07:20 ctl02 nova-api[15989]: 2017-09-28 12:07:20.192 15989 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:07:20 ctl02 nova-api[15989]: 2017-09-28 12:07:20.192 15989 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:07:20 ctl02 nova-api[15989]: 2017-09-28 12:07:20.192 15989 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:07:20 ctl02 nova-api[15989]: 2017-09-28 12:07:20.192 15989 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:07:20 ctl02 nova-api[15989]: 2017-09-28 12:07:20.192 15989 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:07:20 ctl02 nova-api[15989]: 2017-09-28 12:07:20.192 15989 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:07:20 ctl02 nova-api[15989]: 2017-09-28 12:07:20.192 15989 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:07:20 ctl02 nova-api[15989]: 2017-09-28 12:07:20.192 15989 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:07:20 ctl02 nova-api[15989]: 2017-09-28 12:07:20.192 15989 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:07:20 ctl02 nova-api[15989]: 2017-09-28 12:07:20.192 15989 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:07:20 ctl02 nova-api[15989]: 2017-09-28 12:07:20.192 15989 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:07:20 ctl02 nova-api[15989]: 2017-09-28 12:07:20.192 15989 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:07:20 ctl02 nova-api[15989]: 2017-09-28 12:07:20.192 15989 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:07:20 ctl02 nova-api[15989]: 2017-09-28 12:07:20.192 15989 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:07:20 ctl02 nova-api[15989]: 2017-09-28 12:07:20.192 15989 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:07:20 ctl02 nova-api[15989]: 2017-09-28 12:07:20.192 15989 ERROR nova.wsgi     self.filename))
Sep 28 12:07:20 ctl02 nova-api[15989]: 2017-09-28 12:07:20.192 15989 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:07:20 ctl02 nova-api[15989]: 2017-09-28 12:07:20.192 15989 ERROR nova.wsgi
Sep 28 12:07:20 ctl02 nova-api[15989]: 2017-09-28 12:07:20.193 15989 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:07:20 ctl02 heat-api-cfn[13300]: 2017-09-28 12:07:20.198 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:07:20] "OPTIONS / HTTP/1.0" 200 134 0.000560
Sep 28 12:07:20 ctl02 nova-api[15989]: 2017-09-28 12:07:20.318 15989 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:07:20 ctl02 nova-api[15989]: 2017-09-28 12:07:20.543 15989 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:07:20 ctl02 nova-api[15989]: 2017-09-28 12:07:20.546 15989 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:07:20 ctl02 nova-api[15989]: 2017-09-28 12:07:20.546 15989 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:07:20 ctl02 nova-api[15989]: 2017-09-28 12:07:20.546 15989 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:07:20 ctl02 glance-api[29183]: 2017-09-28 12:07:20.587 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:07:20] "OPTIONS / HTTP/1.0" 200 134 0.000746
Sep 28 12:07:20 ctl02 nova-api[15989]: 2017-09-28 12:07:20.674 15989 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:07:20 ctl02 nova-api[15989]: 2017-09-28 12:07:20.676 15989 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:07:20 ctl02 nova-api[15989]: 2017-09-28 12:07:20.676 15989 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:07:20 ctl02 nova-api[15989]: 2017-09-28 12:07:20.676 15989 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:07:20 ctl02 nova-api[15989]: 2017-09-28 12:07:20.679 15989 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:07:20 ctl02 nova-api[15989]: 2017-09-28 12:07:20.680 15989 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:07:20 ctl02 nova-api[15989]: 2017-09-28 12:07:20.680 15989 ERROR nova Traceback (most recent call last):
Sep 28 12:07:20 ctl02 nova-api[15989]: 2017-09-28 12:07:20.680 15989 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:07:20 ctl02 nova-api[15989]: 2017-09-28 12:07:20.680 15989 ERROR nova     sys.exit(main())
Sep 28 12:07:20 ctl02 nova-api[15989]: 2017-09-28 12:07:20.680 15989 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:07:20 ctl02 nova-api[15989]: 2017-09-28 12:07:20.680 15989 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:07:20 ctl02 nova-api[15989]: 2017-09-28 12:07:20.680 15989 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:07:20 ctl02 nova-api[15989]: 2017-09-28 12:07:20.680 15989 ERROR nova     max_url_len=max_url_len)
Sep 28 12:07:20 ctl02 nova-api[15989]: 2017-09-28 12:07:20.680 15989 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:07:20 ctl02 nova-api[15989]: 2017-09-28 12:07:20.680 15989 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:07:20 ctl02 nova-api[15989]: 2017-09-28 12:07:20.680 15989 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:07:20 ctl02 nova-api[15989]: 2017-09-28 12:07:20.680 15989 ERROR nova     sock.listen(backlog)
Sep 28 12:07:20 ctl02 nova-api[15989]: 2017-09-28 12:07:20.680 15989 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:07:20 ctl02 nova-api[15989]: 2017-09-28 12:07:20.680 15989 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:07:20 ctl02 nova-api[15989]: 2017-09-28 12:07:20.680 15989 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:07:20 ctl02 nova-api[15989]: 2017-09-28 12:07:20.680 15989 ERROR nova
Sep 28 12:07:20 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:07:20 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:07:20 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:07:20 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe7cd0377)
Sep 28 12:07:21 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:07:21 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:07:21 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:07:21 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:07:21 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:07:21.224 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:07:21] "OPTIONS / HTTP/1.0" 200 134 0.000648
Sep 28 12:07:21 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928120721506960
Sep 28 12:07:21 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 16018
Sep 28 12:07:21 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928120721506960
Sep 28 12:07:21 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:07:21 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:07:21 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 12:07:21 ctl02 ntp[16067]:  * Stopping NTP server ntpd
Sep 28 12:07:21 ctl02 ntp[16067]:    ...done.
Sep 28 12:07:21 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 12:07:21 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 12:07:21 ctl02 ntp[16078]:  * Starting NTP server ntpd
Sep 28 12:07:21 ctl02 ntpd[16085]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 12:07:21 ctl02 ntpd[16085]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 12:07:21 ctl02 ntp[16078]:    ...done.
Sep 28 12:07:21 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 12:07:21 ctl02 ntpd[16088]: proto: precision = 0.130 usec (-23)
Sep 28 12:07:21 ctl02 ntpd[16088]: switching logging to file /var/log/ntp.log
Sep 28 12:07:22 ctl02 heat-api[13008]: 2017-09-28 12:07:22.089 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:07:22] "OPTIONS / HTTP/1.0" 200 134 0.000620
Sep 28 12:07:22 ctl02 nova-api[16007]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:07:22 ctl02 nova-api[16007]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:07:22 ctl02 nova-api[16007]: 2017-09-28 12:07:22.969 16007 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:07:22 ctl02 nova-api[16007]: 2017-09-28 12:07:22.971 16007 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:07:22 ctl02 nova-api[16007]: 2017-09-28 12:07:22.971 16007 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:07:22 ctl02 nova-api[16007]: 2017-09-28 12:07:22.971 16007 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:07:22 ctl02 nova-api[16007]: 2017-09-28 12:07:22.971 16007 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:07:22 ctl02 nova-api[16007]: 2017-09-28 12:07:22.971 16007 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:07:22 ctl02 nova-api[16007]: 2017-09-28 12:07:22.971 16007 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:07:22 ctl02 nova-api[16007]: 2017-09-28 12:07:22.971 16007 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:07:22 ctl02 nova-api[16007]: 2017-09-28 12:07:22.971 16007 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:07:22 ctl02 nova-api[16007]: 2017-09-28 12:07:22.971 16007 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:07:22 ctl02 nova-api[16007]: 2017-09-28 12:07:22.971 16007 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:07:22 ctl02 nova-api[16007]: 2017-09-28 12:07:22.971 16007 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:07:22 ctl02 nova-api[16007]: 2017-09-28 12:07:22.971 16007 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:07:22 ctl02 nova-api[16007]: 2017-09-28 12:07:22.971 16007 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:07:22 ctl02 nova-api[16007]: 2017-09-28 12:07:22.971 16007 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:07:22 ctl02 nova-api[16007]: 2017-09-28 12:07:22.971 16007 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:07:22 ctl02 nova-api[16007]: 2017-09-28 12:07:22.971 16007 ERROR nova.wsgi     self.filename))
Sep 28 12:07:22 ctl02 nova-api[16007]: 2017-09-28 12:07:22.971 16007 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:07:22 ctl02 nova-api[16007]: 2017-09-28 12:07:22.971 16007 ERROR nova.wsgi
Sep 28 12:07:22 ctl02 nova-api[16007]: 2017-09-28 12:07:22.972 16007 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:07:23 ctl02 heat-api-cfn[13300]: 2017-09-28 12:07:23.082 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:07:23] "OPTIONS / HTTP/1.0" 200 134 0.000492
Sep 28 12:07:23 ctl02 nova-api[16007]: 2017-09-28 12:07:23.103 16007 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:07:23 ctl02 nova-api[16007]: 2017-09-28 12:07:23.343 16007 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:07:23 ctl02 nova-api[16007]: 2017-09-28 12:07:23.345 16007 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:07:23 ctl02 nova-api[16007]: 2017-09-28 12:07:23.353 16007 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:07:23 ctl02 nova-api[16007]: 2017-09-28 12:07:23.353 16007 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:07:23 ctl02 glance-api[29183]: 2017-09-28 12:07:23.353 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:07:23] "OPTIONS / HTTP/1.0" 200 134 0.000732
Sep 28 12:07:23 ctl02 nova-api[16007]: 2017-09-28 12:07:23.498 16007 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:07:23 ctl02 nova-api[16007]: 2017-09-28 12:07:23.500 16007 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:07:23 ctl02 nova-api[16007]: 2017-09-28 12:07:23.500 16007 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:07:23 ctl02 nova-api[16007]: 2017-09-28 12:07:23.501 16007 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:07:23 ctl02 nova-api[16007]: 2017-09-28 12:07:23.504 16007 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:07:23 ctl02 nova-api[16007]: 2017-09-28 12:07:23.504 16007 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:07:23 ctl02 nova-api[16007]: 2017-09-28 12:07:23.504 16007 ERROR nova Traceback (most recent call last):
Sep 28 12:07:23 ctl02 nova-api[16007]: 2017-09-28 12:07:23.504 16007 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:07:23 ctl02 nova-api[16007]: 2017-09-28 12:07:23.504 16007 ERROR nova     sys.exit(main())
Sep 28 12:07:23 ctl02 nova-api[16007]: 2017-09-28 12:07:23.504 16007 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:07:23 ctl02 nova-api[16007]: 2017-09-28 12:07:23.504 16007 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:07:23 ctl02 nova-api[16007]: 2017-09-28 12:07:23.504 16007 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:07:23 ctl02 nova-api[16007]: 2017-09-28 12:07:23.504 16007 ERROR nova     max_url_len=max_url_len)
Sep 28 12:07:23 ctl02 nova-api[16007]: 2017-09-28 12:07:23.504 16007 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:07:23 ctl02 nova-api[16007]: 2017-09-28 12:07:23.504 16007 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:07:23 ctl02 nova-api[16007]: 2017-09-28 12:07:23.504 16007 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:07:23 ctl02 nova-api[16007]: 2017-09-28 12:07:23.504 16007 ERROR nova     sock.listen(backlog)
Sep 28 12:07:23 ctl02 nova-api[16007]: 2017-09-28 12:07:23.504 16007 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:07:23 ctl02 nova-api[16007]: 2017-09-28 12:07:23.504 16007 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:07:23 ctl02 nova-api[16007]: 2017-09-28 12:07:23.504 16007 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:07:23 ctl02 nova-api[16007]: 2017-09-28 12:07:23.504 16007 ERROR nova
Sep 28 12:07:23 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:07:23 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:07:23 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:07:23 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:07:23 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:07:23 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:07:23 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:07:24 ctl02 glance-api[29183]: 2017-09-28 12:07:24.596 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:07:24] "OPTIONS / HTTP/1.0" 200 134 0.000688
Sep 28 12:07:25 ctl02 nova-api[16100]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:07:25 ctl02 nova-api[16100]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:07:25 ctl02 nova-api[16100]: 2017-09-28 12:07:25.700 16100 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:07:25 ctl02 nova-api[16100]: 2017-09-28 12:07:25.702 16100 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:07:25 ctl02 nova-api[16100]: 2017-09-28 12:07:25.702 16100 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:07:25 ctl02 nova-api[16100]: 2017-09-28 12:07:25.702 16100 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:07:25 ctl02 nova-api[16100]: 2017-09-28 12:07:25.702 16100 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:07:25 ctl02 nova-api[16100]: 2017-09-28 12:07:25.702 16100 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:07:25 ctl02 nova-api[16100]: 2017-09-28 12:07:25.702 16100 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:07:25 ctl02 nova-api[16100]: 2017-09-28 12:07:25.702 16100 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:07:25 ctl02 nova-api[16100]: 2017-09-28 12:07:25.702 16100 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:07:25 ctl02 nova-api[16100]: 2017-09-28 12:07:25.702 16100 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:07:25 ctl02 nova-api[16100]: 2017-09-28 12:07:25.702 16100 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:07:25 ctl02 nova-api[16100]: 2017-09-28 12:07:25.702 16100 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:07:25 ctl02 nova-api[16100]: 2017-09-28 12:07:25.702 16100 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:07:25 ctl02 nova-api[16100]: 2017-09-28 12:07:25.702 16100 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:07:25 ctl02 nova-api[16100]: 2017-09-28 12:07:25.702 16100 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:07:25 ctl02 nova-api[16100]: 2017-09-28 12:07:25.702 16100 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:07:25 ctl02 nova-api[16100]: 2017-09-28 12:07:25.702 16100 ERROR nova.wsgi     self.filename))
Sep 28 12:07:25 ctl02 nova-api[16100]: 2017-09-28 12:07:25.702 16100 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:07:25 ctl02 nova-api[16100]: 2017-09-28 12:07:25.702 16100 ERROR nova.wsgi
Sep 28 12:07:25 ctl02 nova-api[16100]: 2017-09-28 12:07:25.703 16100 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:07:25 ctl02 nova-api[16100]: 2017-09-28 12:07:25.833 16100 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:07:26 ctl02 nova-api[16100]: 2017-09-28 12:07:26.072 16100 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:07:26 ctl02 nova-api[16100]: 2017-09-28 12:07:26.074 16100 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:07:26 ctl02 nova-api[16100]: 2017-09-28 12:07:26.075 16100 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:07:26 ctl02 nova-api[16100]: 2017-09-28 12:07:26.075 16100 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:07:26 ctl02 nova-api[16100]: 2017-09-28 12:07:26.206 16100 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:07:26 ctl02 nova-api[16100]: 2017-09-28 12:07:26.208 16100 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:07:26 ctl02 nova-api[16100]: 2017-09-28 12:07:26.208 16100 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:07:26 ctl02 nova-api[16100]: 2017-09-28 12:07:26.208 16100 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:07:26 ctl02 nova-api[16100]: 2017-09-28 12:07:26.212 16100 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:07:26 ctl02 nova-api[16100]: 2017-09-28 12:07:26.212 16100 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:07:26 ctl02 nova-api[16100]: 2017-09-28 12:07:26.212 16100 ERROR nova Traceback (most recent call last):
Sep 28 12:07:26 ctl02 nova-api[16100]: 2017-09-28 12:07:26.212 16100 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:07:26 ctl02 nova-api[16100]: 2017-09-28 12:07:26.212 16100 ERROR nova     sys.exit(main())
Sep 28 12:07:26 ctl02 nova-api[16100]: 2017-09-28 12:07:26.212 16100 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:07:26 ctl02 nova-api[16100]: 2017-09-28 12:07:26.212 16100 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:07:26 ctl02 nova-api[16100]: 2017-09-28 12:07:26.212 16100 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:07:26 ctl02 nova-api[16100]: 2017-09-28 12:07:26.212 16100 ERROR nova     max_url_len=max_url_len)
Sep 28 12:07:26 ctl02 nova-api[16100]: 2017-09-28 12:07:26.212 16100 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:07:26 ctl02 nova-api[16100]: 2017-09-28 12:07:26.212 16100 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:07:26 ctl02 nova-api[16100]: 2017-09-28 12:07:26.212 16100 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:07:26 ctl02 nova-api[16100]: 2017-09-28 12:07:26.212 16100 ERROR nova     sock.listen(backlog)
Sep 28 12:07:26 ctl02 nova-api[16100]: 2017-09-28 12:07:26.212 16100 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:07:26 ctl02 nova-api[16100]: 2017-09-28 12:07:26.212 16100 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:07:26 ctl02 nova-api[16100]: 2017-09-28 12:07:26.212 16100 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:07:26 ctl02 nova-api[16100]: 2017-09-28 12:07:26.212 16100 ERROR nova
Sep 28 12:07:26 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:07:26 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:07:26 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:07:26 ctl02 heat-api[13008]: 2017-09-28 12:07:26.389 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:07:26] "OPTIONS / HTTP/1.0" 200 134 0.000633
Sep 28 12:07:26 ctl02 heat-api[13008]: 2017-09-28 12:07:26.610 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:07:26] "OPTIONS / HTTP/1.0" 200 134 0.000564
Sep 28 12:07:26 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:07:26 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:07:26 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:07:26 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:07:28 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:07:28.017 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:07:28] "OPTIONS / HTTP/1.0" 200 134 0.000513
Sep 28 12:07:28 ctl02 nova-api[16119]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:07:28 ctl02 nova-api[16119]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:07:28 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:07:28.385 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:07:28] "OPTIONS / HTTP/1.0" 200 134 0.000473
Sep 28 12:07:28 ctl02 nova-api[16119]: 2017-09-28 12:07:28.451 16119 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:07:28 ctl02 nova-api[16119]: 2017-09-28 12:07:28.453 16119 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:07:28 ctl02 nova-api[16119]: 2017-09-28 12:07:28.453 16119 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:07:28 ctl02 nova-api[16119]: 2017-09-28 12:07:28.453 16119 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:07:28 ctl02 nova-api[16119]: 2017-09-28 12:07:28.453 16119 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:07:28 ctl02 nova-api[16119]: 2017-09-28 12:07:28.453 16119 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:07:28 ctl02 nova-api[16119]: 2017-09-28 12:07:28.453 16119 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:07:28 ctl02 nova-api[16119]: 2017-09-28 12:07:28.453 16119 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:07:28 ctl02 nova-api[16119]: 2017-09-28 12:07:28.453 16119 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:07:28 ctl02 nova-api[16119]: 2017-09-28 12:07:28.453 16119 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:07:28 ctl02 nova-api[16119]: 2017-09-28 12:07:28.453 16119 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:07:28 ctl02 nova-api[16119]: 2017-09-28 12:07:28.453 16119 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:07:28 ctl02 nova-api[16119]: 2017-09-28 12:07:28.453 16119 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:07:28 ctl02 nova-api[16119]: 2017-09-28 12:07:28.453 16119 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:07:28 ctl02 nova-api[16119]: 2017-09-28 12:07:28.453 16119 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:07:28 ctl02 nova-api[16119]: 2017-09-28 12:07:28.453 16119 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:07:28 ctl02 nova-api[16119]: 2017-09-28 12:07:28.453 16119 ERROR nova.wsgi     self.filename))
Sep 28 12:07:28 ctl02 nova-api[16119]: 2017-09-28 12:07:28.453 16119 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:07:28 ctl02 nova-api[16119]: 2017-09-28 12:07:28.453 16119 ERROR nova.wsgi
Sep 28 12:07:28 ctl02 nova-api[16119]: 2017-09-28 12:07:28.454 16119 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:07:28 ctl02 nova-api[16119]: 2017-09-28 12:07:28.587 16119 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:07:28 ctl02 nova-api[16119]: 2017-09-28 12:07:28.825 16119 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:07:28 ctl02 nova-api[16119]: 2017-09-28 12:07:28.827 16119 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:07:28 ctl02 nova-api[16119]: 2017-09-28 12:07:28.827 16119 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:07:28 ctl02 nova-api[16119]: 2017-09-28 12:07:28.828 16119 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:07:28 ctl02 heat-api-cfn[13300]: 2017-09-28 12:07:28.936 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:07:28] "OPTIONS / HTTP/1.0" 200 134 0.000518
Sep 28 12:07:28 ctl02 nova-api[16119]: 2017-09-28 12:07:28.962 16119 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:07:28 ctl02 nova-api[16119]: 2017-09-28 12:07:28.964 16119 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:07:28 ctl02 nova-api[16119]: 2017-09-28 12:07:28.964 16119 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:07:28 ctl02 nova-api[16119]: 2017-09-28 12:07:28.964 16119 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:07:28 ctl02 nova-api[16119]: 2017-09-28 12:07:28.967 16119 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:07:28 ctl02 nova-api[16119]: 2017-09-28 12:07:28.968 16119 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:07:28 ctl02 nova-api[16119]: 2017-09-28 12:07:28.968 16119 ERROR nova Traceback (most recent call last):
Sep 28 12:07:28 ctl02 nova-api[16119]: 2017-09-28 12:07:28.968 16119 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:07:28 ctl02 nova-api[16119]: 2017-09-28 12:07:28.968 16119 ERROR nova     sys.exit(main())
Sep 28 12:07:28 ctl02 nova-api[16119]: 2017-09-28 12:07:28.968 16119 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:07:28 ctl02 nova-api[16119]: 2017-09-28 12:07:28.968 16119 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:07:28 ctl02 nova-api[16119]: 2017-09-28 12:07:28.968 16119 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:07:28 ctl02 nova-api[16119]: 2017-09-28 12:07:28.968 16119 ERROR nova     max_url_len=max_url_len)
Sep 28 12:07:28 ctl02 nova-api[16119]: 2017-09-28 12:07:28.968 16119 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:07:28 ctl02 nova-api[16119]: 2017-09-28 12:07:28.968 16119 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:07:28 ctl02 nova-api[16119]: 2017-09-28 12:07:28.968 16119 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:07:28 ctl02 nova-api[16119]: 2017-09-28 12:07:28.968 16119 ERROR nova     sock.listen(backlog)
Sep 28 12:07:28 ctl02 nova-api[16119]: 2017-09-28 12:07:28.968 16119 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:07:28 ctl02 nova-api[16119]: 2017-09-28 12:07:28.968 16119 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:07:28 ctl02 nova-api[16119]: 2017-09-28 12:07:28.968 16119 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:07:28 ctl02 nova-api[16119]: 2017-09-28 12:07:28.968 16119 ERROR nova
Sep 28 12:07:29 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:07:29 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:07:29 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:07:29 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:07:29 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:07:29 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:07:29 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:07:30 ctl02 heat-api-cfn[13300]: 2017-09-28 12:07:30.371 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:07:30] "OPTIONS / HTTP/1.0" 200 134 0.000549
Sep 28 12:07:30 ctl02 glance-api[29183]: 2017-09-28 12:07:30.511 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:07:30] "OPTIONS / HTTP/1.0" 200 134 0.000727
Sep 28 12:07:31 ctl02 nova-api[16137]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:07:31 ctl02 nova-api[16137]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:07:31 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:07:31.027 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:07:31] "OPTIONS / HTTP/1.0" 200 134 0.000523
Sep 28 12:07:31 ctl02 nova-api[16137]: 2017-09-28 12:07:31.194 16137 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:07:31 ctl02 nova-api[16137]: 2017-09-28 12:07:31.196 16137 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:07:31 ctl02 nova-api[16137]: 2017-09-28 12:07:31.196 16137 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:07:31 ctl02 nova-api[16137]: 2017-09-28 12:07:31.196 16137 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:07:31 ctl02 nova-api[16137]: 2017-09-28 12:07:31.196 16137 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:07:31 ctl02 nova-api[16137]: 2017-09-28 12:07:31.196 16137 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:07:31 ctl02 nova-api[16137]: 2017-09-28 12:07:31.196 16137 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:07:31 ctl02 nova-api[16137]: 2017-09-28 12:07:31.196 16137 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:07:31 ctl02 nova-api[16137]: 2017-09-28 12:07:31.196 16137 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:07:31 ctl02 nova-api[16137]: 2017-09-28 12:07:31.196 16137 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:07:31 ctl02 nova-api[16137]: 2017-09-28 12:07:31.196 16137 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:07:31 ctl02 nova-api[16137]: 2017-09-28 12:07:31.196 16137 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:07:31 ctl02 nova-api[16137]: 2017-09-28 12:07:31.196 16137 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:07:31 ctl02 nova-api[16137]: 2017-09-28 12:07:31.196 16137 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:07:31 ctl02 nova-api[16137]: 2017-09-28 12:07:31.196 16137 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:07:31 ctl02 nova-api[16137]: 2017-09-28 12:07:31.196 16137 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:07:31 ctl02 nova-api[16137]: 2017-09-28 12:07:31.196 16137 ERROR nova.wsgi     self.filename))
Sep 28 12:07:31 ctl02 nova-api[16137]: 2017-09-28 12:07:31.196 16137 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:07:31 ctl02 nova-api[16137]: 2017-09-28 12:07:31.196 16137 ERROR nova.wsgi
Sep 28 12:07:31 ctl02 nova-api[16137]: 2017-09-28 12:07:31.198 16137 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:07:31 ctl02 nova-api[16137]: 2017-09-28 12:07:31.328 16137 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:07:31 ctl02 nova-api[16137]: 2017-09-28 12:07:31.559 16137 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:07:31 ctl02 nova-api[16137]: 2017-09-28 12:07:31.562 16137 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:07:31 ctl02 nova-api[16137]: 2017-09-28 12:07:31.562 16137 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:07:31 ctl02 nova-api[16137]: 2017-09-28 12:07:31.563 16137 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:07:31 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928120731668605
Sep 28 12:07:31 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 16150
Sep 28 12:07:31 ctl02 nova-api[16137]: 2017-09-28 12:07:31.696 16137 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:07:31 ctl02 nova-api[16137]: 2017-09-28 12:07:31.698 16137 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:07:31 ctl02 nova-api[16137]: 2017-09-28 12:07:31.698 16137 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:07:31 ctl02 nova-api[16137]: 2017-09-28 12:07:31.699 16137 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:07:31 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928120731668605
Sep 28 12:07:31 ctl02 nova-api[16137]: 2017-09-28 12:07:31.702 16137 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:07:31 ctl02 nova-api[16137]: 2017-09-28 12:07:31.703 16137 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:07:31 ctl02 nova-api[16137]: 2017-09-28 12:07:31.703 16137 ERROR nova Traceback (most recent call last):
Sep 28 12:07:31 ctl02 nova-api[16137]: 2017-09-28 12:07:31.703 16137 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:07:31 ctl02 nova-api[16137]: 2017-09-28 12:07:31.703 16137 ERROR nova     sys.exit(main())
Sep 28 12:07:31 ctl02 nova-api[16137]: 2017-09-28 12:07:31.703 16137 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:07:31 ctl02 nova-api[16137]: 2017-09-28 12:07:31.703 16137 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:07:31 ctl02 nova-api[16137]: 2017-09-28 12:07:31.703 16137 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:07:31 ctl02 nova-api[16137]: 2017-09-28 12:07:31.703 16137 ERROR nova     max_url_len=max_url_len)
Sep 28 12:07:31 ctl02 nova-api[16137]: 2017-09-28 12:07:31.703 16137 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:07:31 ctl02 nova-api[16137]: 2017-09-28 12:07:31.703 16137 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:07:31 ctl02 nova-api[16137]: 2017-09-28 12:07:31.703 16137 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:07:31 ctl02 nova-api[16137]: 2017-09-28 12:07:31.703 16137 ERROR nova     sock.listen(backlog)
Sep 28 12:07:31 ctl02 nova-api[16137]: 2017-09-28 12:07:31.703 16137 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:07:31 ctl02 nova-api[16137]: 2017-09-28 12:07:31.703 16137 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:07:31 ctl02 nova-api[16137]: 2017-09-28 12:07:31.703 16137 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:07:31 ctl02 nova-api[16137]: 2017-09-28 12:07:31.703 16137 ERROR nova
Sep 28 12:07:31 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:07:31 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:07:31 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:07:31 ctl02 heat-api[13008]: 2017-09-28 12:07:31.912 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:07:31] "OPTIONS / HTTP/1.0" 200 134 0.000680
Sep 28 12:07:32 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:07:32 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:07:32 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:07:32 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:07:32 ctl02 nova-cert[4860]: 2017-09-28 12:07:32.165 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:07:33 ctl02 heat-api-cfn[13300]: 2017-09-28 12:07:33.114 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:07:33] "OPTIONS / HTTP/1.0" 200 134 0.000511
Sep 28 12:07:33 ctl02 glance-api[29183]: 2017-09-28 12:07:33.416 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:07:33] "OPTIONS / HTTP/1.0" 200 134 0.000755
Sep 28 12:07:33 ctl02 nova-api[16160]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:07:33 ctl02 nova-api[16160]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:07:33 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x171abf36)
Sep 28 12:07:33 ctl02 nova-api[16160]: 2017-09-28 12:07:33.974 16160 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:07:33 ctl02 nova-api[16160]: 2017-09-28 12:07:33.976 16160 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:07:33 ctl02 nova-api[16160]: 2017-09-28 12:07:33.976 16160 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:07:33 ctl02 nova-api[16160]: 2017-09-28 12:07:33.976 16160 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:07:33 ctl02 nova-api[16160]: 2017-09-28 12:07:33.976 16160 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:07:33 ctl02 nova-api[16160]: 2017-09-28 12:07:33.976 16160 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:07:33 ctl02 nova-api[16160]: 2017-09-28 12:07:33.976 16160 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:07:33 ctl02 nova-api[16160]: 2017-09-28 12:07:33.976 16160 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:07:33 ctl02 nova-api[16160]: 2017-09-28 12:07:33.976 16160 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:07:33 ctl02 nova-api[16160]: 2017-09-28 12:07:33.976 16160 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:07:33 ctl02 nova-api[16160]: 2017-09-28 12:07:33.976 16160 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:07:33 ctl02 nova-api[16160]: 2017-09-28 12:07:33.976 16160 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:07:33 ctl02 nova-api[16160]: 2017-09-28 12:07:33.976 16160 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:07:33 ctl02 nova-api[16160]: 2017-09-28 12:07:33.976 16160 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:07:33 ctl02 nova-api[16160]: 2017-09-28 12:07:33.976 16160 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:07:33 ctl02 nova-api[16160]: 2017-09-28 12:07:33.976 16160 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:07:33 ctl02 nova-api[16160]: 2017-09-28 12:07:33.976 16160 ERROR nova.wsgi     self.filename))
Sep 28 12:07:33 ctl02 nova-api[16160]: 2017-09-28 12:07:33.976 16160 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:07:33 ctl02 nova-api[16160]: 2017-09-28 12:07:33.976 16160 ERROR nova.wsgi
Sep 28 12:07:33 ctl02 nova-api[16160]: 2017-09-28 12:07:33.977 16160 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:07:34 ctl02 nova-api[16160]: 2017-09-28 12:07:34.108 16160 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:07:34 ctl02 nova-api[16160]: 2017-09-28 12:07:34.349 16160 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:07:34 ctl02 nova-api[16160]: 2017-09-28 12:07:34.352 16160 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:07:34 ctl02 nova-api[16160]: 2017-09-28 12:07:34.352 16160 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:07:34 ctl02 nova-api[16160]: 2017-09-28 12:07:34.352 16160 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:07:34 ctl02 glance-api[29183]: 2017-09-28 12:07:34.352 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:07:34] "OPTIONS / HTTP/1.0" 200 134 0.000696
Sep 28 12:07:34 ctl02 nova-conductor[5056]: 2017-09-28 12:07:34.360 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:07:34 ctl02 nova-conductor[5056]: 2017-09-28 12:07:34.375 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:07:34 ctl02 nova-conductor[5056]: 2017-09-28 12:07:34.380 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:07:34 ctl02 nova-conductor[5056]: 2017-09-28 12:07:34.385 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:07:34 ctl02 nova-api[16160]: 2017-09-28 12:07:34.486 16160 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:07:34 ctl02 nova-api[16160]: 2017-09-28 12:07:34.488 16160 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:07:34 ctl02 nova-api[16160]: 2017-09-28 12:07:34.488 16160 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:07:34 ctl02 nova-api[16160]: 2017-09-28 12:07:34.488 16160 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:07:34 ctl02 nova-api[16160]: 2017-09-28 12:07:34.491 16160 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:07:34 ctl02 nova-api[16160]: 2017-09-28 12:07:34.492 16160 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:07:34 ctl02 nova-api[16160]: 2017-09-28 12:07:34.492 16160 ERROR nova Traceback (most recent call last):
Sep 28 12:07:34 ctl02 nova-api[16160]: 2017-09-28 12:07:34.492 16160 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:07:34 ctl02 nova-api[16160]: 2017-09-28 12:07:34.492 16160 ERROR nova     sys.exit(main())
Sep 28 12:07:34 ctl02 nova-api[16160]: 2017-09-28 12:07:34.492 16160 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:07:34 ctl02 nova-api[16160]: 2017-09-28 12:07:34.492 16160 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:07:34 ctl02 nova-api[16160]: 2017-09-28 12:07:34.492 16160 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:07:34 ctl02 nova-api[16160]: 2017-09-28 12:07:34.492 16160 ERROR nova     max_url_len=max_url_len)
Sep 28 12:07:34 ctl02 nova-api[16160]: 2017-09-28 12:07:34.492 16160 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:07:34 ctl02 nova-api[16160]: 2017-09-28 12:07:34.492 16160 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:07:34 ctl02 nova-api[16160]: 2017-09-28 12:07:34.492 16160 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:07:34 ctl02 nova-api[16160]: 2017-09-28 12:07:34.492 16160 ERROR nova     sock.listen(backlog)
Sep 28 12:07:34 ctl02 nova-api[16160]: 2017-09-28 12:07:34.492 16160 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:07:34 ctl02 nova-api[16160]: 2017-09-28 12:07:34.492 16160 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:07:34 ctl02 nova-api[16160]: 2017-09-28 12:07:34.492 16160 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:07:34 ctl02 nova-api[16160]: 2017-09-28 12:07:34.492 16160 ERROR nova
Sep 28 12:07:34 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:07:34 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:07:34 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:07:34 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:07:34 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:07:34 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:07:34 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:07:34 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x171abf36)
Sep 28 12:07:35 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x171abf36)
Sep 28 12:07:36 ctl02 heat-api[13008]: 2017-09-28 12:07:36.285 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:07:36] "OPTIONS / HTTP/1.0" 200 134 0.000557
Sep 28 12:07:36 ctl02 nova-api[16178]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:07:36 ctl02 nova-api[16178]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:07:36 ctl02 nova-api[16178]: 2017-09-28 12:07:36.715 16178 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:07:36 ctl02 nova-api[16178]: 2017-09-28 12:07:36.717 16178 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:07:36 ctl02 nova-api[16178]: 2017-09-28 12:07:36.717 16178 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:07:36 ctl02 nova-api[16178]: 2017-09-28 12:07:36.717 16178 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:07:36 ctl02 nova-api[16178]: 2017-09-28 12:07:36.717 16178 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:07:36 ctl02 nova-api[16178]: 2017-09-28 12:07:36.717 16178 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:07:36 ctl02 nova-api[16178]: 2017-09-28 12:07:36.717 16178 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:07:36 ctl02 nova-api[16178]: 2017-09-28 12:07:36.717 16178 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:07:36 ctl02 nova-api[16178]: 2017-09-28 12:07:36.717 16178 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:07:36 ctl02 nova-api[16178]: 2017-09-28 12:07:36.717 16178 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:07:36 ctl02 nova-api[16178]: 2017-09-28 12:07:36.717 16178 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:07:36 ctl02 nova-api[16178]: 2017-09-28 12:07:36.717 16178 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:07:36 ctl02 nova-api[16178]: 2017-09-28 12:07:36.717 16178 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:07:36 ctl02 nova-api[16178]: 2017-09-28 12:07:36.717 16178 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:07:36 ctl02 nova-api[16178]: 2017-09-28 12:07:36.717 16178 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:07:36 ctl02 nova-api[16178]: 2017-09-28 12:07:36.717 16178 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:07:36 ctl02 nova-api[16178]: 2017-09-28 12:07:36.717 16178 ERROR nova.wsgi     self.filename))
Sep 28 12:07:36 ctl02 nova-api[16178]: 2017-09-28 12:07:36.717 16178 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:07:36 ctl02 nova-api[16178]: 2017-09-28 12:07:36.717 16178 ERROR nova.wsgi
Sep 28 12:07:36 ctl02 nova-api[16178]: 2017-09-28 12:07:36.718 16178 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:07:36 ctl02 heat-api[13008]: 2017-09-28 12:07:36.842 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:07:36] "OPTIONS / HTTP/1.0" 200 134 0.000570
Sep 28 12:07:36 ctl02 nova-api[16178]: 2017-09-28 12:07:36.845 16178 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:07:36 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x171abf36)
Sep 28 12:07:37 ctl02 nova-api[16178]: 2017-09-28 12:07:37.078 16178 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:07:37 ctl02 nova-api[16178]: 2017-09-28 12:07:37.080 16178 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:07:37 ctl02 nova-api[16178]: 2017-09-28 12:07:37.080 16178 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:07:37 ctl02 nova-api[16178]: 2017-09-28 12:07:37.080 16178 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:07:37 ctl02 nova-api[16178]: 2017-09-28 12:07:37.210 16178 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:07:37 ctl02 nova-api[16178]: 2017-09-28 12:07:37.212 16178 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:07:37 ctl02 nova-api[16178]: 2017-09-28 12:07:37.213 16178 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:07:37 ctl02 nova-api[16178]: 2017-09-28 12:07:37.213 16178 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:07:37 ctl02 nova-api[16178]: 2017-09-28 12:07:37.216 16178 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:07:37 ctl02 nova-api[16178]: 2017-09-28 12:07:37.216 16178 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:07:37 ctl02 nova-api[16178]: 2017-09-28 12:07:37.216 16178 ERROR nova Traceback (most recent call last):
Sep 28 12:07:37 ctl02 nova-api[16178]: 2017-09-28 12:07:37.216 16178 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:07:37 ctl02 nova-api[16178]: 2017-09-28 12:07:37.216 16178 ERROR nova     sys.exit(main())
Sep 28 12:07:37 ctl02 nova-api[16178]: 2017-09-28 12:07:37.216 16178 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:07:37 ctl02 nova-api[16178]: 2017-09-28 12:07:37.216 16178 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:07:37 ctl02 nova-api[16178]: 2017-09-28 12:07:37.216 16178 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:07:37 ctl02 nova-api[16178]: 2017-09-28 12:07:37.216 16178 ERROR nova     max_url_len=max_url_len)
Sep 28 12:07:37 ctl02 nova-api[16178]: 2017-09-28 12:07:37.216 16178 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:07:37 ctl02 nova-api[16178]: 2017-09-28 12:07:37.216 16178 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:07:37 ctl02 nova-api[16178]: 2017-09-28 12:07:37.216 16178 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:07:37 ctl02 nova-api[16178]: 2017-09-28 12:07:37.216 16178 ERROR nova     sock.listen(backlog)
Sep 28 12:07:37 ctl02 nova-api[16178]: 2017-09-28 12:07:37.216 16178 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:07:37 ctl02 nova-api[16178]: 2017-09-28 12:07:37.216 16178 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:07:37 ctl02 nova-api[16178]: 2017-09-28 12:07:37.216 16178 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:07:37 ctl02 nova-api[16178]: 2017-09-28 12:07:37.216 16178 ERROR nova
Sep 28 12:07:37 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:07:37 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:07:37 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:07:37 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:07:37 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:07:37 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:07:37 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:07:37 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:07:37.893 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:07:37] "OPTIONS / HTTP/1.0" 200 134 0.000445
Sep 28 12:07:37 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x171abf36)
Sep 28 12:07:38 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:07:38.304 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:07:38] "OPTIONS / HTTP/1.0" 200 134 0.000562
Sep 28 12:07:38 ctl02 heat-api-cfn[13300]: 2017-09-28 12:07:38.688 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:07:38] "OPTIONS / HTTP/1.0" 200 134 0.000656
Sep 28 12:07:38 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x171abf36)
Sep 28 12:07:39 ctl02 nova-api[16196]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:07:39 ctl02 nova-api[16196]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:07:39 ctl02 nova-api[16196]: 2017-09-28 12:07:39.451 16196 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:07:39 ctl02 nova-api[16196]: 2017-09-28 12:07:39.453 16196 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:07:39 ctl02 nova-api[16196]: 2017-09-28 12:07:39.453 16196 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:07:39 ctl02 nova-api[16196]: 2017-09-28 12:07:39.453 16196 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:07:39 ctl02 nova-api[16196]: 2017-09-28 12:07:39.453 16196 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:07:39 ctl02 nova-api[16196]: 2017-09-28 12:07:39.453 16196 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:07:39 ctl02 nova-api[16196]: 2017-09-28 12:07:39.453 16196 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:07:39 ctl02 nova-api[16196]: 2017-09-28 12:07:39.453 16196 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:07:39 ctl02 nova-api[16196]: 2017-09-28 12:07:39.453 16196 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:07:39 ctl02 nova-api[16196]: 2017-09-28 12:07:39.453 16196 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:07:39 ctl02 nova-api[16196]: 2017-09-28 12:07:39.453 16196 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:07:39 ctl02 nova-api[16196]: 2017-09-28 12:07:39.453 16196 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:07:39 ctl02 nova-api[16196]: 2017-09-28 12:07:39.453 16196 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:07:39 ctl02 nova-api[16196]: 2017-09-28 12:07:39.453 16196 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:07:39 ctl02 nova-api[16196]: 2017-09-28 12:07:39.453 16196 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:07:39 ctl02 nova-api[16196]: 2017-09-28 12:07:39.453 16196 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:07:39 ctl02 nova-api[16196]: 2017-09-28 12:07:39.453 16196 ERROR nova.wsgi     self.filename))
Sep 28 12:07:39 ctl02 nova-api[16196]: 2017-09-28 12:07:39.453 16196 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:07:39 ctl02 nova-api[16196]: 2017-09-28 12:07:39.453 16196 ERROR nova.wsgi
Sep 28 12:07:39 ctl02 nova-api[16196]: 2017-09-28 12:07:39.454 16196 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:07:39 ctl02 nova-api[16196]: 2017-09-28 12:07:39.581 16196 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:07:39 ctl02 nova-api[16196]: 2017-09-28 12:07:39.811 16196 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:07:39 ctl02 nova-api[16196]: 2017-09-28 12:07:39.813 16196 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:07:39 ctl02 nova-api[16196]: 2017-09-28 12:07:39.814 16196 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:07:39 ctl02 nova-api[16196]: 2017-09-28 12:07:39.814 16196 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:07:39 ctl02 nova-api[16196]: 2017-09-28 12:07:39.945 16196 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:07:39 ctl02 nova-api[16196]: 2017-09-28 12:07:39.947 16196 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:07:39 ctl02 nova-api[16196]: 2017-09-28 12:07:39.947 16196 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:07:39 ctl02 nova-api[16196]: 2017-09-28 12:07:39.947 16196 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:07:39 ctl02 nova-api[16196]: 2017-09-28 12:07:39.950 16196 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:07:39 ctl02 nova-api[16196]: 2017-09-28 12:07:39.951 16196 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:07:39 ctl02 nova-api[16196]: 2017-09-28 12:07:39.951 16196 ERROR nova Traceback (most recent call last):
Sep 28 12:07:39 ctl02 nova-api[16196]: 2017-09-28 12:07:39.951 16196 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:07:39 ctl02 nova-api[16196]: 2017-09-28 12:07:39.951 16196 ERROR nova     sys.exit(main())
Sep 28 12:07:39 ctl02 nova-api[16196]: 2017-09-28 12:07:39.951 16196 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:07:39 ctl02 nova-api[16196]: 2017-09-28 12:07:39.951 16196 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:07:39 ctl02 nova-api[16196]: 2017-09-28 12:07:39.951 16196 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:07:39 ctl02 nova-api[16196]: 2017-09-28 12:07:39.951 16196 ERROR nova     max_url_len=max_url_len)
Sep 28 12:07:39 ctl02 nova-api[16196]: 2017-09-28 12:07:39.951 16196 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:07:39 ctl02 nova-api[16196]: 2017-09-28 12:07:39.951 16196 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:07:39 ctl02 nova-api[16196]: 2017-09-28 12:07:39.951 16196 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:07:39 ctl02 nova-api[16196]: 2017-09-28 12:07:39.951 16196 ERROR nova     sock.listen(backlog)
Sep 28 12:07:39 ctl02 nova-api[16196]: 2017-09-28 12:07:39.951 16196 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:07:39 ctl02 nova-api[16196]: 2017-09-28 12:07:39.951 16196 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:07:39 ctl02 nova-api[16196]: 2017-09-28 12:07:39.951 16196 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:07:39 ctl02 nova-api[16196]: 2017-09-28 12:07:39.951 16196 ERROR nova
Sep 28 12:07:39 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x171abf36)
Sep 28 12:07:40 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:07:40 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:07:40 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:07:40 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:07:40 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:07:40 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:07:40 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:07:40 ctl02 heat-api-cfn[13300]: 2017-09-28 12:07:40.640 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:07:40] "OPTIONS / HTTP/1.0" 200 134 0.000476
Sep 28 12:07:40 ctl02 glance-api[29183]: 2017-09-28 12:07:40.689 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:07:40] "OPTIONS / HTTP/1.0" 200 134 0.001275
Sep 28 12:07:40 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:07:40.923 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:07:40] "OPTIONS / HTTP/1.0" 200 134 0.000439
Sep 28 12:07:40 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x171abf36)
Sep 28 12:07:41 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928120741830375
Sep 28 12:07:41 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 16225
Sep 28 12:07:41 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928120741830375
Sep 28 12:07:41 ctl02 heat-api[13008]: 2017-09-28 12:07:41.918 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:07:41] "OPTIONS / HTTP/1.0" 200 134 0.000533
Sep 28 12:07:41 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x171abf36)
Sep 28 12:07:42 ctl02 nova-api[16213]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:07:42 ctl02 nova-api[16213]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:07:42 ctl02 nova-consoleauth[5433]: 2017-09-28 12:07:42.064 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:07:42 ctl02 nova-api[16213]: 2017-09-28 12:07:42.228 16213 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:07:42 ctl02 nova-api[16213]: 2017-09-28 12:07:42.230 16213 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:07:42 ctl02 nova-api[16213]: 2017-09-28 12:07:42.230 16213 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:07:42 ctl02 nova-api[16213]: 2017-09-28 12:07:42.230 16213 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:07:42 ctl02 nova-api[16213]: 2017-09-28 12:07:42.230 16213 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:07:42 ctl02 nova-api[16213]: 2017-09-28 12:07:42.230 16213 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:07:42 ctl02 nova-api[16213]: 2017-09-28 12:07:42.230 16213 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:07:42 ctl02 nova-api[16213]: 2017-09-28 12:07:42.230 16213 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:07:42 ctl02 nova-api[16213]: 2017-09-28 12:07:42.230 16213 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:07:42 ctl02 nova-api[16213]: 2017-09-28 12:07:42.230 16213 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:07:42 ctl02 nova-api[16213]: 2017-09-28 12:07:42.230 16213 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:07:42 ctl02 nova-api[16213]: 2017-09-28 12:07:42.230 16213 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:07:42 ctl02 nova-api[16213]: 2017-09-28 12:07:42.230 16213 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:07:42 ctl02 nova-api[16213]: 2017-09-28 12:07:42.230 16213 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:07:42 ctl02 nova-api[16213]: 2017-09-28 12:07:42.230 16213 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:07:42 ctl02 nova-api[16213]: 2017-09-28 12:07:42.230 16213 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:07:42 ctl02 nova-api[16213]: 2017-09-28 12:07:42.230 16213 ERROR nova.wsgi     self.filename))
Sep 28 12:07:42 ctl02 nova-api[16213]: 2017-09-28 12:07:42.230 16213 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:07:42 ctl02 nova-api[16213]: 2017-09-28 12:07:42.230 16213 ERROR nova.wsgi
Sep 28 12:07:42 ctl02 nova-api[16213]: 2017-09-28 12:07:42.231 16213 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:07:42 ctl02 nova-api[16213]: 2017-09-28 12:07:42.364 16213 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:07:42 ctl02 nova-api[16213]: 2017-09-28 12:07:42.592 16213 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:07:42 ctl02 nova-api[16213]: 2017-09-28 12:07:42.594 16213 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:07:42 ctl02 nova-api[16213]: 2017-09-28 12:07:42.594 16213 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:07:42 ctl02 nova-api[16213]: 2017-09-28 12:07:42.595 16213 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:07:42 ctl02 nova-api[16213]: 2017-09-28 12:07:42.727 16213 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:07:42 ctl02 nova-api[16213]: 2017-09-28 12:07:42.728 16213 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:07:42 ctl02 nova-api[16213]: 2017-09-28 12:07:42.729 16213 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:07:42 ctl02 nova-api[16213]: 2017-09-28 12:07:42.729 16213 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:07:42 ctl02 nova-api[16213]: 2017-09-28 12:07:42.732 16213 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:07:42 ctl02 nova-api[16213]: 2017-09-28 12:07:42.733 16213 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:07:42 ctl02 nova-api[16213]: 2017-09-28 12:07:42.733 16213 ERROR nova Traceback (most recent call last):
Sep 28 12:07:42 ctl02 nova-api[16213]: 2017-09-28 12:07:42.733 16213 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:07:42 ctl02 nova-api[16213]: 2017-09-28 12:07:42.733 16213 ERROR nova     sys.exit(main())
Sep 28 12:07:42 ctl02 nova-api[16213]: 2017-09-28 12:07:42.733 16213 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:07:42 ctl02 nova-api[16213]: 2017-09-28 12:07:42.733 16213 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:07:42 ctl02 nova-api[16213]: 2017-09-28 12:07:42.733 16213 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:07:42 ctl02 nova-api[16213]: 2017-09-28 12:07:42.733 16213 ERROR nova     max_url_len=max_url_len)
Sep 28 12:07:42 ctl02 nova-api[16213]: 2017-09-28 12:07:42.733 16213 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:07:42 ctl02 nova-api[16213]: 2017-09-28 12:07:42.733 16213 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:07:42 ctl02 nova-api[16213]: 2017-09-28 12:07:42.733 16213 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:07:42 ctl02 nova-api[16213]: 2017-09-28 12:07:42.733 16213 ERROR nova     sock.listen(backlog)
Sep 28 12:07:42 ctl02 nova-api[16213]: 2017-09-28 12:07:42.733 16213 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:07:42 ctl02 nova-api[16213]: 2017-09-28 12:07:42.733 16213 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:07:42 ctl02 nova-api[16213]: 2017-09-28 12:07:42.733 16213 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:07:42 ctl02 nova-api[16213]: 2017-09-28 12:07:42.733 16213 ERROR nova
Sep 28 12:07:42 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:07:42 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:07:42 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:07:42 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x171abf36)
Sep 28 12:07:43 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:07:43 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:07:43 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:07:43 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:07:43 ctl02 heat-api-cfn[13300]: 2017-09-28 12:07:43.149 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:07:43] "OPTIONS / HTTP/1.0" 200 134 0.000633
Sep 28 12:07:43 ctl02 glance-api[29183]: 2017-09-28 12:07:43.473 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:07:43] "OPTIONS / HTTP/1.0" 200 134 0.001151
Sep 28 12:07:43 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x171abf36)
Sep 28 12:07:44 ctl02 glance-api[29183]: 2017-09-28 12:07:44.103 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:07:44] "OPTIONS / HTTP/1.0" 200 134 0.000594
Sep 28 12:07:44 ctl02 nova-api[16237]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:07:44 ctl02 nova-api[16237]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:07:44 ctl02 nova-api[16237]: 2017-09-28 12:07:44.962 16237 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:07:44 ctl02 nova-api[16237]: 2017-09-28 12:07:44.964 16237 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:07:44 ctl02 nova-api[16237]: 2017-09-28 12:07:44.964 16237 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:07:44 ctl02 nova-api[16237]: 2017-09-28 12:07:44.964 16237 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:07:44 ctl02 nova-api[16237]: 2017-09-28 12:07:44.964 16237 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:07:44 ctl02 nova-api[16237]: 2017-09-28 12:07:44.964 16237 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:07:44 ctl02 nova-api[16237]: 2017-09-28 12:07:44.964 16237 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:07:44 ctl02 nova-api[16237]: 2017-09-28 12:07:44.964 16237 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:07:44 ctl02 nova-api[16237]: 2017-09-28 12:07:44.964 16237 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:07:44 ctl02 nova-api[16237]: 2017-09-28 12:07:44.964 16237 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:07:44 ctl02 nova-api[16237]: 2017-09-28 12:07:44.964 16237 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:07:44 ctl02 nova-api[16237]: 2017-09-28 12:07:44.964 16237 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:07:44 ctl02 nova-api[16237]: 2017-09-28 12:07:44.964 16237 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:07:44 ctl02 nova-api[16237]: 2017-09-28 12:07:44.964 16237 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:07:44 ctl02 nova-api[16237]: 2017-09-28 12:07:44.964 16237 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:07:44 ctl02 nova-api[16237]: 2017-09-28 12:07:44.964 16237 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:07:44 ctl02 nova-api[16237]: 2017-09-28 12:07:44.964 16237 ERROR nova.wsgi     self.filename))
Sep 28 12:07:44 ctl02 nova-api[16237]: 2017-09-28 12:07:44.964 16237 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:07:44 ctl02 nova-api[16237]: 2017-09-28 12:07:44.964 16237 ERROR nova.wsgi
Sep 28 12:07:44 ctl02 nova-api[16237]: 2017-09-28 12:07:44.966 16237 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:07:44 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:07:44 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:07:45 ctl02 nova-scheduler[5620]: 2017-09-28 12:07:45.085 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:07:45 ctl02 nova-api[16237]: 2017-09-28 12:07:45.098 16237 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:07:45 ctl02 nova-api[16237]: 2017-09-28 12:07:45.338 16237 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:07:45 ctl02 nova-api[16237]: 2017-09-28 12:07:45.340 16237 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:07:45 ctl02 nova-api[16237]: 2017-09-28 12:07:45.340 16237 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:07:45 ctl02 nova-api[16237]: 2017-09-28 12:07:45.341 16237 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:07:45 ctl02 heat-engine[12803]: 2017-09-28 12:07:45.424 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:07:45 ctl02 heat-engine[12803]: 2017-09-28 12:07:45.454 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:07:45 ctl02 heat-engine[12803]: 2017-09-28 12:07:45.472 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:07:45 ctl02 nova-api[16237]: 2017-09-28 12:07:45.479 16237 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:07:45 ctl02 heat-engine[12803]: 2017-09-28 12:07:45.480 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:07:45 ctl02 nova-api[16237]: 2017-09-28 12:07:45.481 16237 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:07:45 ctl02 nova-api[16237]: 2017-09-28 12:07:45.482 16237 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:07:45 ctl02 nova-api[16237]: 2017-09-28 12:07:45.482 16237 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:07:45 ctl02 nova-api[16237]: 2017-09-28 12:07:45.485 16237 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:07:45 ctl02 nova-api[16237]: 2017-09-28 12:07:45.486 16237 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:07:45 ctl02 nova-api[16237]: 2017-09-28 12:07:45.486 16237 ERROR nova Traceback (most recent call last):
Sep 28 12:07:45 ctl02 nova-api[16237]: 2017-09-28 12:07:45.486 16237 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:07:45 ctl02 nova-api[16237]: 2017-09-28 12:07:45.486 16237 ERROR nova     sys.exit(main())
Sep 28 12:07:45 ctl02 nova-api[16237]: 2017-09-28 12:07:45.486 16237 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:07:45 ctl02 nova-api[16237]: 2017-09-28 12:07:45.486 16237 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:07:45 ctl02 nova-api[16237]: 2017-09-28 12:07:45.486 16237 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:07:45 ctl02 nova-api[16237]: 2017-09-28 12:07:45.486 16237 ERROR nova     max_url_len=max_url_len)
Sep 28 12:07:45 ctl02 nova-api[16237]: 2017-09-28 12:07:45.486 16237 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:07:45 ctl02 nova-api[16237]: 2017-09-28 12:07:45.486 16237 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:07:45 ctl02 nova-api[16237]: 2017-09-28 12:07:45.486 16237 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:07:45 ctl02 nova-api[16237]: 2017-09-28 12:07:45.486 16237 ERROR nova     sock.listen(backlog)
Sep 28 12:07:45 ctl02 nova-api[16237]: 2017-09-28 12:07:45.486 16237 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:07:45 ctl02 nova-api[16237]: 2017-09-28 12:07:45.486 16237 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:07:45 ctl02 nova-api[16237]: 2017-09-28 12:07:45.486 16237 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:07:45 ctl02 nova-api[16237]: 2017-09-28 12:07:45.486 16237 ERROR nova
Sep 28 12:07:45 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:07:45 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:07:45 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:07:45 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:07:45 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:07:45 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:07:45 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:07:46 ctl02 heat-api[13008]: 2017-09-28 12:07:46.183 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:07:46] "OPTIONS / HTTP/1.0" 200 134 0.000521
Sep 28 12:07:46 ctl02 heat-api[13008]: 2017-09-28 12:07:46.630 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:07:46] "OPTIONS / HTTP/1.0" 200 134 0.000530
Sep 28 12:07:47 ctl02 nova-api[16260]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:07:47 ctl02 nova-api[16260]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:07:47 ctl02 nova-api[16260]: 2017-09-28 12:07:47.674 16260 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:07:47 ctl02 nova-api[16260]: 2017-09-28 12:07:47.675 16260 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:07:47 ctl02 nova-api[16260]: 2017-09-28 12:07:47.675 16260 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:07:47 ctl02 nova-api[16260]: 2017-09-28 12:07:47.675 16260 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:07:47 ctl02 nova-api[16260]: 2017-09-28 12:07:47.675 16260 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:07:47 ctl02 nova-api[16260]: 2017-09-28 12:07:47.675 16260 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:07:47 ctl02 nova-api[16260]: 2017-09-28 12:07:47.675 16260 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:07:47 ctl02 nova-api[16260]: 2017-09-28 12:07:47.675 16260 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:07:47 ctl02 nova-api[16260]: 2017-09-28 12:07:47.675 16260 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:07:47 ctl02 nova-api[16260]: 2017-09-28 12:07:47.675 16260 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:07:47 ctl02 nova-api[16260]: 2017-09-28 12:07:47.675 16260 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:07:47 ctl02 nova-api[16260]: 2017-09-28 12:07:47.675 16260 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:07:47 ctl02 nova-api[16260]: 2017-09-28 12:07:47.675 16260 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:07:47 ctl02 nova-api[16260]: 2017-09-28 12:07:47.675 16260 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:07:47 ctl02 nova-api[16260]: 2017-09-28 12:07:47.675 16260 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:07:47 ctl02 nova-api[16260]: 2017-09-28 12:07:47.675 16260 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:07:47 ctl02 nova-api[16260]: 2017-09-28 12:07:47.675 16260 ERROR nova.wsgi     self.filename))
Sep 28 12:07:47 ctl02 nova-api[16260]: 2017-09-28 12:07:47.675 16260 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:07:47 ctl02 nova-api[16260]: 2017-09-28 12:07:47.675 16260 ERROR nova.wsgi
Sep 28 12:07:47 ctl02 nova-api[16260]: 2017-09-28 12:07:47.676 16260 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:07:47 ctl02 nova-api[16260]: 2017-09-28 12:07:47.801 16260 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:07:47 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:07:47.929 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:07:47] "OPTIONS / HTTP/1.0" 200 134 0.000449
Sep 28 12:07:48 ctl02 nova-api[16260]: 2017-09-28 12:07:48.030 16260 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:07:48 ctl02 nova-api[16260]: 2017-09-28 12:07:48.032 16260 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:07:48 ctl02 nova-api[16260]: 2017-09-28 12:07:48.033 16260 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:07:48 ctl02 nova-api[16260]: 2017-09-28 12:07:48.033 16260 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:07:48 ctl02 nova-api[16260]: 2017-09-28 12:07:48.162 16260 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:07:48 ctl02 nova-api[16260]: 2017-09-28 12:07:48.164 16260 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:07:48 ctl02 nova-api[16260]: 2017-09-28 12:07:48.164 16260 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:07:48 ctl02 nova-api[16260]: 2017-09-28 12:07:48.164 16260 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:07:48 ctl02 nova-api[16260]: 2017-09-28 12:07:48.167 16260 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:07:48 ctl02 nova-api[16260]: 2017-09-28 12:07:48.167 16260 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:07:48 ctl02 nova-api[16260]: 2017-09-28 12:07:48.167 16260 ERROR nova Traceback (most recent call last):
Sep 28 12:07:48 ctl02 nova-api[16260]: 2017-09-28 12:07:48.167 16260 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:07:48 ctl02 nova-api[16260]: 2017-09-28 12:07:48.167 16260 ERROR nova     sys.exit(main())
Sep 28 12:07:48 ctl02 nova-api[16260]: 2017-09-28 12:07:48.167 16260 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:07:48 ctl02 nova-api[16260]: 2017-09-28 12:07:48.167 16260 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:07:48 ctl02 nova-api[16260]: 2017-09-28 12:07:48.167 16260 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:07:48 ctl02 nova-api[16260]: 2017-09-28 12:07:48.167 16260 ERROR nova     max_url_len=max_url_len)
Sep 28 12:07:48 ctl02 nova-api[16260]: 2017-09-28 12:07:48.167 16260 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:07:48 ctl02 nova-api[16260]: 2017-09-28 12:07:48.167 16260 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:07:48 ctl02 nova-api[16260]: 2017-09-28 12:07:48.167 16260 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:07:48 ctl02 nova-api[16260]: 2017-09-28 12:07:48.167 16260 ERROR nova     sock.listen(backlog)
Sep 28 12:07:48 ctl02 nova-api[16260]: 2017-09-28 12:07:48.167 16260 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:07:48 ctl02 nova-api[16260]: 2017-09-28 12:07:48.167 16260 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:07:48 ctl02 nova-api[16260]: 2017-09-28 12:07:48.167 16260 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:07:48 ctl02 nova-api[16260]: 2017-09-28 12:07:48.167 16260 ERROR nova
Sep 28 12:07:48 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:07:48 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:07:48 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:07:48 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:07:48.620 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:07:48] "OPTIONS / HTTP/1.0" 200 134 0.000610
Sep 28 12:07:48 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:07:48 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:07:48 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:07:48 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:07:48 ctl02 heat-api-cfn[13300]: 2017-09-28 12:07:48.936 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:07:48] "OPTIONS / HTTP/1.0" 200 134 0.000527
Sep 28 12:07:50 ctl02 nova-api[16278]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:07:50 ctl02 nova-api[16278]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:07:50 ctl02 nova-api[16278]: 2017-09-28 12:07:50.428 16278 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:07:50 ctl02 nova-api[16278]: 2017-09-28 12:07:50.430 16278 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:07:50 ctl02 nova-api[16278]: 2017-09-28 12:07:50.430 16278 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:07:50 ctl02 nova-api[16278]: 2017-09-28 12:07:50.430 16278 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:07:50 ctl02 nova-api[16278]: 2017-09-28 12:07:50.430 16278 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:07:50 ctl02 nova-api[16278]: 2017-09-28 12:07:50.430 16278 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:07:50 ctl02 nova-api[16278]: 2017-09-28 12:07:50.430 16278 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:07:50 ctl02 nova-api[16278]: 2017-09-28 12:07:50.430 16278 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:07:50 ctl02 nova-api[16278]: 2017-09-28 12:07:50.430 16278 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:07:50 ctl02 nova-api[16278]: 2017-09-28 12:07:50.430 16278 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:07:50 ctl02 nova-api[16278]: 2017-09-28 12:07:50.430 16278 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:07:50 ctl02 nova-api[16278]: 2017-09-28 12:07:50.430 16278 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:07:50 ctl02 nova-api[16278]: 2017-09-28 12:07:50.430 16278 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:07:50 ctl02 nova-api[16278]: 2017-09-28 12:07:50.430 16278 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:07:50 ctl02 nova-api[16278]: 2017-09-28 12:07:50.430 16278 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:07:50 ctl02 nova-api[16278]: 2017-09-28 12:07:50.430 16278 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:07:50 ctl02 nova-api[16278]: 2017-09-28 12:07:50.430 16278 ERROR nova.wsgi     self.filename))
Sep 28 12:07:50 ctl02 nova-api[16278]: 2017-09-28 12:07:50.430 16278 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:07:50 ctl02 nova-api[16278]: 2017-09-28 12:07:50.430 16278 ERROR nova.wsgi
Sep 28 12:07:50 ctl02 nova-api[16278]: 2017-09-28 12:07:50.431 16278 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:07:50 ctl02 nova-api[16278]: 2017-09-28 12:07:50.558 16278 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:07:50 ctl02 heat-api-cfn[13300]: 2017-09-28 12:07:50.760 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:07:50] "OPTIONS / HTTP/1.0" 200 134 0.000547
Sep 28 12:07:50 ctl02 nova-api[16278]: 2017-09-28 12:07:50.785 16278 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:07:50 ctl02 nova-api[16278]: 2017-09-28 12:07:50.787 16278 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:07:50 ctl02 nova-api[16278]: 2017-09-28 12:07:50.788 16278 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:07:50 ctl02 nova-api[16278]: 2017-09-28 12:07:50.788 16278 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:07:50 ctl02 nova-api[16278]: 2017-09-28 12:07:50.916 16278 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:07:50 ctl02 nova-api[16278]: 2017-09-28 12:07:50.918 16278 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:07:50 ctl02 nova-api[16278]: 2017-09-28 12:07:50.918 16278 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:07:50 ctl02 nova-api[16278]: 2017-09-28 12:07:50.919 16278 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:07:50 ctl02 nova-api[16278]: 2017-09-28 12:07:50.922 16278 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:07:50 ctl02 nova-api[16278]: 2017-09-28 12:07:50.922 16278 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:07:50 ctl02 nova-api[16278]: 2017-09-28 12:07:50.922 16278 ERROR nova Traceback (most recent call last):
Sep 28 12:07:50 ctl02 nova-api[16278]: 2017-09-28 12:07:50.922 16278 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:07:50 ctl02 nova-api[16278]: 2017-09-28 12:07:50.922 16278 ERROR nova     sys.exit(main())
Sep 28 12:07:50 ctl02 nova-api[16278]: 2017-09-28 12:07:50.922 16278 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:07:50 ctl02 nova-api[16278]: 2017-09-28 12:07:50.922 16278 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:07:50 ctl02 nova-api[16278]: 2017-09-28 12:07:50.922 16278 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:07:50 ctl02 nova-api[16278]: 2017-09-28 12:07:50.922 16278 ERROR nova     max_url_len=max_url_len)
Sep 28 12:07:50 ctl02 nova-api[16278]: 2017-09-28 12:07:50.922 16278 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:07:50 ctl02 nova-api[16278]: 2017-09-28 12:07:50.922 16278 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:07:50 ctl02 nova-api[16278]: 2017-09-28 12:07:50.922 16278 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:07:50 ctl02 nova-api[16278]: 2017-09-28 12:07:50.922 16278 ERROR nova     sock.listen(backlog)
Sep 28 12:07:50 ctl02 nova-api[16278]: 2017-09-28 12:07:50.922 16278 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:07:50 ctl02 nova-api[16278]: 2017-09-28 12:07:50.922 16278 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:07:50 ctl02 nova-api[16278]: 2017-09-28 12:07:50.922 16278 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:07:50 ctl02 nova-api[16278]: 2017-09-28 12:07:50.922 16278 ERROR nova
Sep 28 12:07:50 ctl02 glance-api[29183]: 2017-09-28 12:07:50.944 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:07:50] "OPTIONS / HTTP/1.0" 200 134 0.000777
Sep 28 12:07:51 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:07:51 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:07:51 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:07:51 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:07:51.109 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:07:51] "OPTIONS / HTTP/1.0" 200 134 0.000505
Sep 28 12:07:51 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:07:51 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:07:51 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:07:51 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:07:52 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928120751994774
Sep 28 12:07:52 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 16307
Sep 28 12:07:52 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928120751994774
Sep 28 12:07:52 ctl02 heat-api[13008]: 2017-09-28 12:07:52.054 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:07:52] "OPTIONS / HTTP/1.0" 200 134 0.000590
Sep 28 12:07:53 ctl02 nova-api[16296]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:07:53 ctl02 nova-api[16296]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:07:53 ctl02 nova-api[16296]: 2017-09-28 12:07:53.224 16296 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:07:53 ctl02 nova-api[16296]: 2017-09-28 12:07:53.226 16296 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:07:53 ctl02 nova-api[16296]: 2017-09-28 12:07:53.226 16296 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:07:53 ctl02 nova-api[16296]: 2017-09-28 12:07:53.226 16296 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:07:53 ctl02 nova-api[16296]: 2017-09-28 12:07:53.226 16296 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:07:53 ctl02 nova-api[16296]: 2017-09-28 12:07:53.226 16296 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:07:53 ctl02 nova-api[16296]: 2017-09-28 12:07:53.226 16296 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:07:53 ctl02 nova-api[16296]: 2017-09-28 12:07:53.226 16296 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:07:53 ctl02 nova-api[16296]: 2017-09-28 12:07:53.226 16296 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:07:53 ctl02 nova-api[16296]: 2017-09-28 12:07:53.226 16296 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:07:53 ctl02 nova-api[16296]: 2017-09-28 12:07:53.226 16296 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:07:53 ctl02 nova-api[16296]: 2017-09-28 12:07:53.226 16296 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:07:53 ctl02 nova-api[16296]: 2017-09-28 12:07:53.226 16296 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:07:53 ctl02 nova-api[16296]: 2017-09-28 12:07:53.226 16296 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:07:53 ctl02 nova-api[16296]: 2017-09-28 12:07:53.226 16296 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:07:53 ctl02 nova-api[16296]: 2017-09-28 12:07:53.226 16296 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:07:53 ctl02 nova-api[16296]: 2017-09-28 12:07:53.226 16296 ERROR nova.wsgi     self.filename))
Sep 28 12:07:53 ctl02 nova-api[16296]: 2017-09-28 12:07:53.226 16296 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:07:53 ctl02 nova-api[16296]: 2017-09-28 12:07:53.226 16296 ERROR nova.wsgi
Sep 28 12:07:53 ctl02 nova-api[16296]: 2017-09-28 12:07:53.227 16296 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:07:53 ctl02 nova-api[16296]: 2017-09-28 12:07:53.357 16296 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:07:53 ctl02 heat-api-cfn[13300]: 2017-09-28 12:07:53.382 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:07:53] "OPTIONS / HTTP/1.0" 200 134 0.000508
Sep 28 12:07:53 ctl02 glance-api[29183]: 2017-09-28 12:07:53.506 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:07:53] "OPTIONS / HTTP/1.0" 200 134 0.000678
Sep 28 12:07:53 ctl02 nova-api[16296]: 2017-09-28 12:07:53.597 16296 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:07:53 ctl02 nova-api[16296]: 2017-09-28 12:07:53.600 16296 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:07:53 ctl02 nova-api[16296]: 2017-09-28 12:07:53.600 16296 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:07:53 ctl02 nova-api[16296]: 2017-09-28 12:07:53.600 16296 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:07:53 ctl02 nova-api[16296]: 2017-09-28 12:07:53.730 16296 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:07:53 ctl02 nova-api[16296]: 2017-09-28 12:07:53.732 16296 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:07:53 ctl02 nova-api[16296]: 2017-09-28 12:07:53.752 16296 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:07:53 ctl02 nova-api[16296]: 2017-09-28 12:07:53.752 16296 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:07:53 ctl02 nova-api[16296]: 2017-09-28 12:07:53.755 16296 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:07:53 ctl02 nova-api[16296]: 2017-09-28 12:07:53.756 16296 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:07:53 ctl02 nova-api[16296]: 2017-09-28 12:07:53.756 16296 ERROR nova Traceback (most recent call last):
Sep 28 12:07:53 ctl02 nova-api[16296]: 2017-09-28 12:07:53.756 16296 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:07:53 ctl02 nova-api[16296]: 2017-09-28 12:07:53.756 16296 ERROR nova     sys.exit(main())
Sep 28 12:07:53 ctl02 nova-api[16296]: 2017-09-28 12:07:53.756 16296 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:07:53 ctl02 nova-api[16296]: 2017-09-28 12:07:53.756 16296 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:07:53 ctl02 nova-api[16296]: 2017-09-28 12:07:53.756 16296 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:07:53 ctl02 nova-api[16296]: 2017-09-28 12:07:53.756 16296 ERROR nova     max_url_len=max_url_len)
Sep 28 12:07:53 ctl02 nova-api[16296]: 2017-09-28 12:07:53.756 16296 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:07:53 ctl02 nova-api[16296]: 2017-09-28 12:07:53.756 16296 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:07:53 ctl02 nova-api[16296]: 2017-09-28 12:07:53.756 16296 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:07:53 ctl02 nova-api[16296]: 2017-09-28 12:07:53.756 16296 ERROR nova     sock.listen(backlog)
Sep 28 12:07:53 ctl02 nova-api[16296]: 2017-09-28 12:07:53.756 16296 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:07:53 ctl02 nova-api[16296]: 2017-09-28 12:07:53.756 16296 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:07:53 ctl02 nova-api[16296]: 2017-09-28 12:07:53.756 16296 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:07:53 ctl02 nova-api[16296]: 2017-09-28 12:07:53.756 16296 ERROR nova
Sep 28 12:07:53 ctl02 glance-api[29183]: 2017-09-28 12:07:53.869 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:07:53] "OPTIONS / HTTP/1.0" 200 134 0.000937
Sep 28 12:07:53 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:07:53 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:07:53 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:07:54 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:07:54 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:07:54 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:07:54 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:07:55 ctl02 nova-api[16319]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:07:55 ctl02 nova-api[16319]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:07:55 ctl02 nova-api[16319]: 2017-09-28 12:07:55.920 16319 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:07:55 ctl02 nova-api[16319]: 2017-09-28 12:07:55.921 16319 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:07:55 ctl02 nova-api[16319]: 2017-09-28 12:07:55.921 16319 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:07:55 ctl02 nova-api[16319]: 2017-09-28 12:07:55.921 16319 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:07:55 ctl02 nova-api[16319]: 2017-09-28 12:07:55.921 16319 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:07:55 ctl02 nova-api[16319]: 2017-09-28 12:07:55.921 16319 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:07:55 ctl02 nova-api[16319]: 2017-09-28 12:07:55.921 16319 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:07:55 ctl02 nova-api[16319]: 2017-09-28 12:07:55.921 16319 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:07:55 ctl02 nova-api[16319]: 2017-09-28 12:07:55.921 16319 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:07:55 ctl02 nova-api[16319]: 2017-09-28 12:07:55.921 16319 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:07:55 ctl02 nova-api[16319]: 2017-09-28 12:07:55.921 16319 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:07:55 ctl02 nova-api[16319]: 2017-09-28 12:07:55.921 16319 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:07:55 ctl02 nova-api[16319]: 2017-09-28 12:07:55.921 16319 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:07:55 ctl02 nova-api[16319]: 2017-09-28 12:07:55.921 16319 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:07:55 ctl02 nova-api[16319]: 2017-09-28 12:07:55.921 16319 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:07:55 ctl02 nova-api[16319]: 2017-09-28 12:07:55.921 16319 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:07:55 ctl02 nova-api[16319]: 2017-09-28 12:07:55.921 16319 ERROR nova.wsgi     self.filename))
Sep 28 12:07:55 ctl02 nova-api[16319]: 2017-09-28 12:07:55.921 16319 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:07:55 ctl02 nova-api[16319]: 2017-09-28 12:07:55.921 16319 ERROR nova.wsgi
Sep 28 12:07:55 ctl02 nova-api[16319]: 2017-09-28 12:07:55.922 16319 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:07:55 ctl02 heat-api[13008]: 2017-09-28 12:07:55.965 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:07:55] "OPTIONS / HTTP/1.0" 200 134 0.000562
Sep 28 12:07:56 ctl02 nova-api[16319]: 2017-09-28 12:07:56.049 16319 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:07:56 ctl02 nova-api[16319]: 2017-09-28 12:07:56.277 16319 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:07:56 ctl02 nova-api[16319]: 2017-09-28 12:07:56.279 16319 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:07:56 ctl02 nova-api[16319]: 2017-09-28 12:07:56.280 16319 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:07:56 ctl02 nova-api[16319]: 2017-09-28 12:07:56.280 16319 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:07:56 ctl02 nova-api[16319]: 2017-09-28 12:07:56.409 16319 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:07:56 ctl02 nova-api[16319]: 2017-09-28 12:07:56.411 16319 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:07:56 ctl02 nova-api[16319]: 2017-09-28 12:07:56.411 16319 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:07:56 ctl02 nova-api[16319]: 2017-09-28 12:07:56.411 16319 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:07:56 ctl02 nova-api[16319]: 2017-09-28 12:07:56.414 16319 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:07:56 ctl02 nova-api[16319]: 2017-09-28 12:07:56.415 16319 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:07:56 ctl02 nova-api[16319]: 2017-09-28 12:07:56.415 16319 ERROR nova Traceback (most recent call last):
Sep 28 12:07:56 ctl02 nova-api[16319]: 2017-09-28 12:07:56.415 16319 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:07:56 ctl02 nova-api[16319]: 2017-09-28 12:07:56.415 16319 ERROR nova     sys.exit(main())
Sep 28 12:07:56 ctl02 nova-api[16319]: 2017-09-28 12:07:56.415 16319 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:07:56 ctl02 nova-api[16319]: 2017-09-28 12:07:56.415 16319 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:07:56 ctl02 nova-api[16319]: 2017-09-28 12:07:56.415 16319 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:07:56 ctl02 nova-api[16319]: 2017-09-28 12:07:56.415 16319 ERROR nova     max_url_len=max_url_len)
Sep 28 12:07:56 ctl02 nova-api[16319]: 2017-09-28 12:07:56.415 16319 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:07:56 ctl02 nova-api[16319]: 2017-09-28 12:07:56.415 16319 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:07:56 ctl02 nova-api[16319]: 2017-09-28 12:07:56.415 16319 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:07:56 ctl02 nova-api[16319]: 2017-09-28 12:07:56.415 16319 ERROR nova     sock.listen(backlog)
Sep 28 12:07:56 ctl02 nova-api[16319]: 2017-09-28 12:07:56.415 16319 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:07:56 ctl02 nova-api[16319]: 2017-09-28 12:07:56.415 16319 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:07:56 ctl02 nova-api[16319]: 2017-09-28 12:07:56.415 16319 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:07:56 ctl02 nova-api[16319]: 2017-09-28 12:07:56.415 16319 ERROR nova
Sep 28 12:07:56 ctl02 heat-api[13008]: 2017-09-28 12:07:56.418 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:07:56] "OPTIONS / HTTP/1.0" 200 134 0.000594
Sep 28 12:07:56 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:07:56 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:07:56 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:07:56 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:07:56 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:07:56 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:07:56 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:07:58 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:07:58.075 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:07:58] "OPTIONS / HTTP/1.0" 200 134 0.000456
Sep 28 12:07:58 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:07:58.518 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:07:58] "OPTIONS / HTTP/1.0" 200 134 0.000457
Sep 28 12:07:58 ctl02 nova-api[16337]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:07:58 ctl02 nova-api[16337]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:07:58 ctl02 nova-api[16337]: 2017-09-28 12:07:58.714 16337 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:07:58 ctl02 nova-api[16337]: 2017-09-28 12:07:58.716 16337 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:07:58 ctl02 nova-api[16337]: 2017-09-28 12:07:58.716 16337 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:07:58 ctl02 nova-api[16337]: 2017-09-28 12:07:58.716 16337 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:07:58 ctl02 nova-api[16337]: 2017-09-28 12:07:58.716 16337 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:07:58 ctl02 nova-api[16337]: 2017-09-28 12:07:58.716 16337 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:07:58 ctl02 nova-api[16337]: 2017-09-28 12:07:58.716 16337 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:07:58 ctl02 nova-api[16337]: 2017-09-28 12:07:58.716 16337 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:07:58 ctl02 nova-api[16337]: 2017-09-28 12:07:58.716 16337 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:07:58 ctl02 nova-api[16337]: 2017-09-28 12:07:58.716 16337 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:07:58 ctl02 nova-api[16337]: 2017-09-28 12:07:58.716 16337 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:07:58 ctl02 nova-api[16337]: 2017-09-28 12:07:58.716 16337 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:07:58 ctl02 nova-api[16337]: 2017-09-28 12:07:58.716 16337 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:07:58 ctl02 nova-api[16337]: 2017-09-28 12:07:58.716 16337 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:07:58 ctl02 nova-api[16337]: 2017-09-28 12:07:58.716 16337 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:07:58 ctl02 nova-api[16337]: 2017-09-28 12:07:58.716 16337 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:07:58 ctl02 nova-api[16337]: 2017-09-28 12:07:58.716 16337 ERROR nova.wsgi     self.filename))
Sep 28 12:07:58 ctl02 nova-api[16337]: 2017-09-28 12:07:58.716 16337 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:07:58 ctl02 nova-api[16337]: 2017-09-28 12:07:58.716 16337 ERROR nova.wsgi
Sep 28 12:07:58 ctl02 nova-api[16337]: 2017-09-28 12:07:58.717 16337 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:07:58 ctl02 nova-api[16337]: 2017-09-28 12:07:58.846 16337 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:07:59 ctl02 nova-api[16337]: 2017-09-28 12:07:59.085 16337 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:07:59 ctl02 nova-api[16337]: 2017-09-28 12:07:59.087 16337 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:07:59 ctl02 nova-api[16337]: 2017-09-28 12:07:59.087 16337 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:07:59 ctl02 nova-api[16337]: 2017-09-28 12:07:59.088 16337 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:07:59 ctl02 heat-api-cfn[13300]: 2017-09-28 12:07:59.198 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:07:59] "OPTIONS / HTTP/1.0" 200 134 0.000498
Sep 28 12:07:59 ctl02 nova-api[16337]: 2017-09-28 12:07:59.218 16337 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:07:59 ctl02 nova-api[16337]: 2017-09-28 12:07:59.220 16337 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:07:59 ctl02 nova-api[16337]: 2017-09-28 12:07:59.220 16337 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:07:59 ctl02 nova-api[16337]: 2017-09-28 12:07:59.221 16337 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:07:59 ctl02 nova-api[16337]: 2017-09-28 12:07:59.224 16337 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:07:59 ctl02 nova-api[16337]: 2017-09-28 12:07:59.224 16337 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:07:59 ctl02 nova-api[16337]: 2017-09-28 12:07:59.224 16337 ERROR nova Traceback (most recent call last):
Sep 28 12:07:59 ctl02 nova-api[16337]: 2017-09-28 12:07:59.224 16337 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:07:59 ctl02 nova-api[16337]: 2017-09-28 12:07:59.224 16337 ERROR nova     sys.exit(main())
Sep 28 12:07:59 ctl02 nova-api[16337]: 2017-09-28 12:07:59.224 16337 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:07:59 ctl02 nova-api[16337]: 2017-09-28 12:07:59.224 16337 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:07:59 ctl02 nova-api[16337]: 2017-09-28 12:07:59.224 16337 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:07:59 ctl02 nova-api[16337]: 2017-09-28 12:07:59.224 16337 ERROR nova     max_url_len=max_url_len)
Sep 28 12:07:59 ctl02 nova-api[16337]: 2017-09-28 12:07:59.224 16337 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:07:59 ctl02 nova-api[16337]: 2017-09-28 12:07:59.224 16337 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:07:59 ctl02 nova-api[16337]: 2017-09-28 12:07:59.224 16337 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:07:59 ctl02 nova-api[16337]: 2017-09-28 12:07:59.224 16337 ERROR nova     sock.listen(backlog)
Sep 28 12:07:59 ctl02 nova-api[16337]: 2017-09-28 12:07:59.224 16337 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:07:59 ctl02 nova-api[16337]: 2017-09-28 12:07:59.224 16337 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:07:59 ctl02 nova-api[16337]: 2017-09-28 12:07:59.224 16337 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:07:59 ctl02 nova-api[16337]: 2017-09-28 12:07:59.224 16337 ERROR nova
Sep 28 12:07:59 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:07:59 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:07:59 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:07:59 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:07:59 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:07:59 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:07:59 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:08:00 ctl02 heat-api-cfn[13300]: 2017-09-28 12:08:00.822 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:08:00] "OPTIONS / HTTP/1.0" 200 134 0.000479
Sep 28 12:08:01 ctl02 glance-api[29183]: 2017-09-28 12:08:01.163 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:08:01] "OPTIONS / HTTP/1.0" 200 134 0.000828
Sep 28 12:08:01 ctl02 nova-api[16355]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:08:01 ctl02 nova-api[16355]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:08:01 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:08:01.307 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:08:01] "OPTIONS / HTTP/1.0" 200 134 0.000495
Sep 28 12:08:01 ctl02 nova-api[16355]: 2017-09-28 12:08:01.438 16355 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:08:01 ctl02 nova-api[16355]: 2017-09-28 12:08:01.440 16355 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:08:01 ctl02 nova-api[16355]: 2017-09-28 12:08:01.440 16355 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:08:01 ctl02 nova-api[16355]: 2017-09-28 12:08:01.440 16355 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:08:01 ctl02 nova-api[16355]: 2017-09-28 12:08:01.440 16355 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:08:01 ctl02 nova-api[16355]: 2017-09-28 12:08:01.440 16355 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:08:01 ctl02 nova-api[16355]: 2017-09-28 12:08:01.440 16355 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:08:01 ctl02 nova-api[16355]: 2017-09-28 12:08:01.440 16355 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:08:01 ctl02 nova-api[16355]: 2017-09-28 12:08:01.440 16355 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:08:01 ctl02 nova-api[16355]: 2017-09-28 12:08:01.440 16355 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:08:01 ctl02 nova-api[16355]: 2017-09-28 12:08:01.440 16355 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:08:01 ctl02 nova-api[16355]: 2017-09-28 12:08:01.440 16355 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:08:01 ctl02 nova-api[16355]: 2017-09-28 12:08:01.440 16355 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:08:01 ctl02 nova-api[16355]: 2017-09-28 12:08:01.440 16355 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:08:01 ctl02 nova-api[16355]: 2017-09-28 12:08:01.440 16355 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:08:01 ctl02 nova-api[16355]: 2017-09-28 12:08:01.440 16355 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:08:01 ctl02 nova-api[16355]: 2017-09-28 12:08:01.440 16355 ERROR nova.wsgi     self.filename))
Sep 28 12:08:01 ctl02 nova-api[16355]: 2017-09-28 12:08:01.440 16355 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:08:01 ctl02 nova-api[16355]: 2017-09-28 12:08:01.440 16355 ERROR nova.wsgi
Sep 28 12:08:01 ctl02 nova-api[16355]: 2017-09-28 12:08:01.441 16355 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:08:01 ctl02 nova-api[16355]: 2017-09-28 12:08:01.572 16355 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:08:01 ctl02 nova-api[16355]: 2017-09-28 12:08:01.809 16355 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:08:01 ctl02 nova-api[16355]: 2017-09-28 12:08:01.812 16355 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:08:01 ctl02 nova-api[16355]: 2017-09-28 12:08:01.812 16355 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:08:01 ctl02 nova-api[16355]: 2017-09-28 12:08:01.813 16355 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:08:01 ctl02 nova-api[16355]: 2017-09-28 12:08:01.944 16355 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:08:01 ctl02 nova-api[16355]: 2017-09-28 12:08:01.947 16355 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:08:01 ctl02 nova-api[16355]: 2017-09-28 12:08:01.947 16355 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:08:01 ctl02 nova-api[16355]: 2017-09-28 12:08:01.948 16355 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:08:01 ctl02 nova-api[16355]: 2017-09-28 12:08:01.951 16355 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:08:01 ctl02 nova-api[16355]: 2017-09-28 12:08:01.952 16355 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:08:01 ctl02 nova-api[16355]: 2017-09-28 12:08:01.952 16355 ERROR nova Traceback (most recent call last):
Sep 28 12:08:01 ctl02 nova-api[16355]: 2017-09-28 12:08:01.952 16355 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:08:01 ctl02 nova-api[16355]: 2017-09-28 12:08:01.952 16355 ERROR nova     sys.exit(main())
Sep 28 12:08:01 ctl02 nova-api[16355]: 2017-09-28 12:08:01.952 16355 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:08:01 ctl02 nova-api[16355]: 2017-09-28 12:08:01.952 16355 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:08:01 ctl02 nova-api[16355]: 2017-09-28 12:08:01.952 16355 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:08:01 ctl02 nova-api[16355]: 2017-09-28 12:08:01.952 16355 ERROR nova     max_url_len=max_url_len)
Sep 28 12:08:01 ctl02 nova-api[16355]: 2017-09-28 12:08:01.952 16355 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:08:01 ctl02 nova-api[16355]: 2017-09-28 12:08:01.952 16355 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:08:01 ctl02 nova-api[16355]: 2017-09-28 12:08:01.952 16355 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:08:01 ctl02 nova-api[16355]: 2017-09-28 12:08:01.952 16355 ERROR nova     sock.listen(backlog)
Sep 28 12:08:01 ctl02 nova-api[16355]: 2017-09-28 12:08:01.952 16355 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:08:01 ctl02 nova-api[16355]: 2017-09-28 12:08:01.952 16355 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:08:01 ctl02 nova-api[16355]: 2017-09-28 12:08:01.952 16355 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:08:01 ctl02 nova-api[16355]: 2017-09-28 12:08:01.952 16355 ERROR nova
Sep 28 12:08:02 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:08:02 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:08:02 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:08:02 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928120802168561
Sep 28 12:08:02 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 16369
Sep 28 12:08:02 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928120802168561
Sep 28 12:08:02 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:08:02 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:08:02 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:08:02 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:08:02 ctl02 heat-api[13008]: 2017-09-28 12:08:02.346 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:08:02] "OPTIONS / HTTP/1.0" 200 134 0.000609
Sep 28 12:08:03 ctl02 glance-api[29183]: 2017-09-28 12:08:03.684 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:08:03] "OPTIONS / HTTP/1.0" 200 134 0.000598
Sep 28 12:08:03 ctl02 heat-api-cfn[13300]: 2017-09-28 12:08:03.705 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:08:03] "OPTIONS / HTTP/1.0" 200 134 0.000468
Sep 28 12:08:03 ctl02 glance-api[29183]: 2017-09-28 12:08:03.788 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:08:03] "OPTIONS / HTTP/1.0" 200 134 0.000411
Sep 28 12:08:03 ctl02 nova-api[16378]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:08:03 ctl02 nova-api[16378]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:08:04 ctl02 nova-api[16378]: 2017-09-28 12:08:04.050 16378 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:08:04 ctl02 nova-api[16378]: 2017-09-28 12:08:04.053 16378 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:08:04 ctl02 nova-api[16378]: 2017-09-28 12:08:04.053 16378 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:08:04 ctl02 nova-api[16378]: 2017-09-28 12:08:04.053 16378 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:08:04 ctl02 nova-api[16378]: 2017-09-28 12:08:04.053 16378 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:08:04 ctl02 nova-api[16378]: 2017-09-28 12:08:04.053 16378 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:08:04 ctl02 nova-api[16378]: 2017-09-28 12:08:04.053 16378 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:08:04 ctl02 nova-api[16378]: 2017-09-28 12:08:04.053 16378 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:08:04 ctl02 nova-api[16378]: 2017-09-28 12:08:04.053 16378 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:08:04 ctl02 nova-api[16378]: 2017-09-28 12:08:04.053 16378 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:08:04 ctl02 nova-api[16378]: 2017-09-28 12:08:04.053 16378 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:08:04 ctl02 nova-api[16378]: 2017-09-28 12:08:04.053 16378 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:08:04 ctl02 nova-api[16378]: 2017-09-28 12:08:04.053 16378 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:08:04 ctl02 nova-api[16378]: 2017-09-28 12:08:04.053 16378 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:08:04 ctl02 nova-api[16378]: 2017-09-28 12:08:04.053 16378 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:08:04 ctl02 nova-api[16378]: 2017-09-28 12:08:04.053 16378 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:08:04 ctl02 nova-api[16378]: 2017-09-28 12:08:04.053 16378 ERROR nova.wsgi     self.filename))
Sep 28 12:08:04 ctl02 nova-api[16378]: 2017-09-28 12:08:04.053 16378 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:08:04 ctl02 nova-api[16378]: 2017-09-28 12:08:04.053 16378 ERROR nova.wsgi
Sep 28 12:08:04 ctl02 nova-api[16378]: 2017-09-28 12:08:04.055 16378 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:08:04 ctl02 nova-api[16378]: 2017-09-28 12:08:04.184 16378 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:08:04 ctl02 nova-cert[4860]: 2017-09-28 12:08:04.204 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:08:04 ctl02 nova-api[16378]: 2017-09-28 12:08:04.423 16378 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:08:04 ctl02 nova-api[16378]: 2017-09-28 12:08:04.426 16378 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:08:04 ctl02 nova-api[16378]: 2017-09-28 12:08:04.427 16378 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:08:04 ctl02 nova-api[16378]: 2017-09-28 12:08:04.427 16378 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:08:04 ctl02 nova-api[16378]: 2017-09-28 12:08:04.560 16378 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:08:04 ctl02 nova-api[16378]: 2017-09-28 12:08:04.562 16378 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:08:04 ctl02 nova-api[16378]: 2017-09-28 12:08:04.563 16378 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:08:04 ctl02 nova-api[16378]: 2017-09-28 12:08:04.563 16378 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:08:04 ctl02 nova-api[16378]: 2017-09-28 12:08:04.567 16378 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:08:04 ctl02 nova-api[16378]: 2017-09-28 12:08:04.567 16378 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:08:04 ctl02 nova-api[16378]: 2017-09-28 12:08:04.567 16378 ERROR nova Traceback (most recent call last):
Sep 28 12:08:04 ctl02 nova-api[16378]: 2017-09-28 12:08:04.567 16378 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:08:04 ctl02 nova-api[16378]: 2017-09-28 12:08:04.567 16378 ERROR nova     sys.exit(main())
Sep 28 12:08:04 ctl02 nova-api[16378]: 2017-09-28 12:08:04.567 16378 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:08:04 ctl02 nova-api[16378]: 2017-09-28 12:08:04.567 16378 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:08:04 ctl02 nova-api[16378]: 2017-09-28 12:08:04.567 16378 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:08:04 ctl02 nova-api[16378]: 2017-09-28 12:08:04.567 16378 ERROR nova     max_url_len=max_url_len)
Sep 28 12:08:04 ctl02 nova-api[16378]: 2017-09-28 12:08:04.567 16378 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:08:04 ctl02 nova-api[16378]: 2017-09-28 12:08:04.567 16378 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:08:04 ctl02 nova-api[16378]: 2017-09-28 12:08:04.567 16378 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:08:04 ctl02 nova-api[16378]: 2017-09-28 12:08:04.567 16378 ERROR nova     sock.listen(backlog)
Sep 28 12:08:04 ctl02 nova-api[16378]: 2017-09-28 12:08:04.567 16378 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:08:04 ctl02 nova-api[16378]: 2017-09-28 12:08:04.567 16378 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:08:04 ctl02 nova-api[16378]: 2017-09-28 12:08:04.567 16378 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:08:04 ctl02 nova-api[16378]: 2017-09-28 12:08:04.567 16378 ERROR nova
Sep 28 12:08:04 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9b3f7450)
Sep 28 12:08:04 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:08:04 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:08:04 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:08:04 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:08:04 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:08:04 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:08:04 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:08:05 ctl02 heat-api[13008]: 2017-09-28 12:08:05.621 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:08:05] "OPTIONS / HTTP/1.0" 200 134 0.000663
Sep 28 12:08:05 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9b3f7450)
Sep 28 12:08:06 ctl02 nova-conductor[5056]: 2017-09-28 12:08:06.368 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:08:06 ctl02 nova-conductor[5056]: 2017-09-28 12:08:06.383 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:08:06 ctl02 nova-conductor[5056]: 2017-09-28 12:08:06.390 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:08:06 ctl02 nova-conductor[5056]: 2017-09-28 12:08:06.394 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:08:06 ctl02 heat-api[13008]: 2017-09-28 12:08:06.435 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:08:06] "OPTIONS / HTTP/1.0" 200 134 0.000627
Sep 28 12:08:06 ctl02 nova-api[16396]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:08:06 ctl02 nova-api[16396]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:08:06 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9b3f7450)
Sep 28 12:08:06 ctl02 nova-api[16396]: 2017-09-28 12:08:06.704 16396 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:08:06 ctl02 nova-api[16396]: 2017-09-28 12:08:06.706 16396 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:08:06 ctl02 nova-api[16396]: 2017-09-28 12:08:06.706 16396 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:08:06 ctl02 nova-api[16396]: 2017-09-28 12:08:06.706 16396 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:08:06 ctl02 nova-api[16396]: 2017-09-28 12:08:06.706 16396 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:08:06 ctl02 nova-api[16396]: 2017-09-28 12:08:06.706 16396 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:08:06 ctl02 nova-api[16396]: 2017-09-28 12:08:06.706 16396 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:08:06 ctl02 nova-api[16396]: 2017-09-28 12:08:06.706 16396 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:08:06 ctl02 nova-api[16396]: 2017-09-28 12:08:06.706 16396 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:08:06 ctl02 nova-api[16396]: 2017-09-28 12:08:06.706 16396 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:08:06 ctl02 nova-api[16396]: 2017-09-28 12:08:06.706 16396 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:08:06 ctl02 nova-api[16396]: 2017-09-28 12:08:06.706 16396 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:08:06 ctl02 nova-api[16396]: 2017-09-28 12:08:06.706 16396 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:08:06 ctl02 nova-api[16396]: 2017-09-28 12:08:06.706 16396 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:08:06 ctl02 nova-api[16396]: 2017-09-28 12:08:06.706 16396 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:08:06 ctl02 nova-api[16396]: 2017-09-28 12:08:06.706 16396 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:08:06 ctl02 nova-api[16396]: 2017-09-28 12:08:06.706 16396 ERROR nova.wsgi     self.filename))
Sep 28 12:08:06 ctl02 nova-api[16396]: 2017-09-28 12:08:06.706 16396 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:08:06 ctl02 nova-api[16396]: 2017-09-28 12:08:06.706 16396 ERROR nova.wsgi
Sep 28 12:08:06 ctl02 nova-api[16396]: 2017-09-28 12:08:06.707 16396 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:08:06 ctl02 nova-api[16396]: 2017-09-28 12:08:06.835 16396 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:08:07 ctl02 nova-api[16396]: 2017-09-28 12:08:07.070 16396 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:08:07 ctl02 nova-api[16396]: 2017-09-28 12:08:07.072 16396 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:08:07 ctl02 nova-api[16396]: 2017-09-28 12:08:07.073 16396 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:08:07 ctl02 nova-api[16396]: 2017-09-28 12:08:07.073 16396 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:08:07 ctl02 nova-api[16396]: 2017-09-28 12:08:07.203 16396 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:08:07 ctl02 nova-api[16396]: 2017-09-28 12:08:07.205 16396 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:08:07 ctl02 nova-api[16396]: 2017-09-28 12:08:07.205 16396 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:08:07 ctl02 nova-api[16396]: 2017-09-28 12:08:07.206 16396 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:08:07 ctl02 nova-api[16396]: 2017-09-28 12:08:07.209 16396 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:08:07 ctl02 nova-api[16396]: 2017-09-28 12:08:07.209 16396 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:08:07 ctl02 nova-api[16396]: 2017-09-28 12:08:07.209 16396 ERROR nova Traceback (most recent call last):
Sep 28 12:08:07 ctl02 nova-api[16396]: 2017-09-28 12:08:07.209 16396 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:08:07 ctl02 nova-api[16396]: 2017-09-28 12:08:07.209 16396 ERROR nova     sys.exit(main())
Sep 28 12:08:07 ctl02 nova-api[16396]: 2017-09-28 12:08:07.209 16396 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:08:07 ctl02 nova-api[16396]: 2017-09-28 12:08:07.209 16396 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:08:07 ctl02 nova-api[16396]: 2017-09-28 12:08:07.209 16396 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:08:07 ctl02 nova-api[16396]: 2017-09-28 12:08:07.209 16396 ERROR nova     max_url_len=max_url_len)
Sep 28 12:08:07 ctl02 nova-api[16396]: 2017-09-28 12:08:07.209 16396 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:08:07 ctl02 nova-api[16396]: 2017-09-28 12:08:07.209 16396 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:08:07 ctl02 nova-api[16396]: 2017-09-28 12:08:07.209 16396 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:08:07 ctl02 nova-api[16396]: 2017-09-28 12:08:07.209 16396 ERROR nova     sock.listen(backlog)
Sep 28 12:08:07 ctl02 nova-api[16396]: 2017-09-28 12:08:07.209 16396 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:08:07 ctl02 nova-api[16396]: 2017-09-28 12:08:07.209 16396 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:08:07 ctl02 nova-api[16396]: 2017-09-28 12:08:07.209 16396 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:08:07 ctl02 nova-api[16396]: 2017-09-28 12:08:07.209 16396 ERROR nova
Sep 28 12:08:07 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:08:07 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:08:07 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:08:07 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:08:07 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:08:07 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9b3f7450)
Sep 28 12:08:07 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:08:07 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:08:08 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:08:08.276 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:08:08] "OPTIONS / HTTP/1.0" 200 134 0.000454
Sep 28 12:08:08 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9b3f7450)
Sep 28 12:08:08 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:08:08.703 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:08:08] "OPTIONS / HTTP/1.0" 200 134 0.000467
Sep 28 12:08:09 ctl02 heat-api-cfn[13300]: 2017-09-28 12:08:09.230 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:08:09] "OPTIONS / HTTP/1.0" 200 134 0.000538
Sep 28 12:08:09 ctl02 nova-api[16414]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:08:09 ctl02 nova-api[16414]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:08:09 ctl02 nova-api[16414]: 2017-09-28 12:08:09.455 16414 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:08:09 ctl02 nova-api[16414]: 2017-09-28 12:08:09.457 16414 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:08:09 ctl02 nova-api[16414]: 2017-09-28 12:08:09.457 16414 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:08:09 ctl02 nova-api[16414]: 2017-09-28 12:08:09.457 16414 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:08:09 ctl02 nova-api[16414]: 2017-09-28 12:08:09.457 16414 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:08:09 ctl02 nova-api[16414]: 2017-09-28 12:08:09.457 16414 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:08:09 ctl02 nova-api[16414]: 2017-09-28 12:08:09.457 16414 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:08:09 ctl02 nova-api[16414]: 2017-09-28 12:08:09.457 16414 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:08:09 ctl02 nova-api[16414]: 2017-09-28 12:08:09.457 16414 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:08:09 ctl02 nova-api[16414]: 2017-09-28 12:08:09.457 16414 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:08:09 ctl02 nova-api[16414]: 2017-09-28 12:08:09.457 16414 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:08:09 ctl02 nova-api[16414]: 2017-09-28 12:08:09.457 16414 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:08:09 ctl02 nova-api[16414]: 2017-09-28 12:08:09.457 16414 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:08:09 ctl02 nova-api[16414]: 2017-09-28 12:08:09.457 16414 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:08:09 ctl02 nova-api[16414]: 2017-09-28 12:08:09.457 16414 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:08:09 ctl02 nova-api[16414]: 2017-09-28 12:08:09.457 16414 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:08:09 ctl02 nova-api[16414]: 2017-09-28 12:08:09.457 16414 ERROR nova.wsgi     self.filename))
Sep 28 12:08:09 ctl02 nova-api[16414]: 2017-09-28 12:08:09.457 16414 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:08:09 ctl02 nova-api[16414]: 2017-09-28 12:08:09.457 16414 ERROR nova.wsgi
Sep 28 12:08:09 ctl02 nova-api[16414]: 2017-09-28 12:08:09.459 16414 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:08:09 ctl02 nova-api[16414]: 2017-09-28 12:08:09.592 16414 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:08:09 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9b3f7450)
Sep 28 12:08:09 ctl02 nova-api[16414]: 2017-09-28 12:08:09.835 16414 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:08:09 ctl02 nova-api[16414]: 2017-09-28 12:08:09.838 16414 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:08:09 ctl02 nova-api[16414]: 2017-09-28 12:08:09.838 16414 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:08:09 ctl02 nova-api[16414]: 2017-09-28 12:08:09.838 16414 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:08:09 ctl02 nova-api[16414]: 2017-09-28 12:08:09.972 16414 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:08:09 ctl02 nova-api[16414]: 2017-09-28 12:08:09.975 16414 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:08:09 ctl02 nova-api[16414]: 2017-09-28 12:08:09.975 16414 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:08:09 ctl02 nova-api[16414]: 2017-09-28 12:08:09.976 16414 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:08:09 ctl02 nova-api[16414]: 2017-09-28 12:08:09.979 16414 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:08:09 ctl02 nova-api[16414]: 2017-09-28 12:08:09.980 16414 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:08:09 ctl02 nova-api[16414]: 2017-09-28 12:08:09.980 16414 ERROR nova Traceback (most recent call last):
Sep 28 12:08:09 ctl02 nova-api[16414]: 2017-09-28 12:08:09.980 16414 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:08:09 ctl02 nova-api[16414]: 2017-09-28 12:08:09.980 16414 ERROR nova     sys.exit(main())
Sep 28 12:08:09 ctl02 nova-api[16414]: 2017-09-28 12:08:09.980 16414 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:08:09 ctl02 nova-api[16414]: 2017-09-28 12:08:09.980 16414 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:08:09 ctl02 nova-api[16414]: 2017-09-28 12:08:09.980 16414 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:08:09 ctl02 nova-api[16414]: 2017-09-28 12:08:09.980 16414 ERROR nova     max_url_len=max_url_len)
Sep 28 12:08:09 ctl02 nova-api[16414]: 2017-09-28 12:08:09.980 16414 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:08:09 ctl02 nova-api[16414]: 2017-09-28 12:08:09.980 16414 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:08:09 ctl02 nova-api[16414]: 2017-09-28 12:08:09.980 16414 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:08:09 ctl02 nova-api[16414]: 2017-09-28 12:08:09.980 16414 ERROR nova     sock.listen(backlog)
Sep 28 12:08:09 ctl02 nova-api[16414]: 2017-09-28 12:08:09.980 16414 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:08:09 ctl02 nova-api[16414]: 2017-09-28 12:08:09.980 16414 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:08:09 ctl02 nova-api[16414]: 2017-09-28 12:08:09.980 16414 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:08:09 ctl02 nova-api[16414]: 2017-09-28 12:08:09.980 16414 ERROR nova
Sep 28 12:08:10 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:08:10 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:08:10 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:08:10 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:08:10 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:08:10 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:08:10 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:08:10 ctl02 heat-api-cfn[13300]: 2017-09-28 12:08:10.564 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:08:10] "OPTIONS / HTTP/1.0" 200 134 0.000502
Sep 28 12:08:10 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9b3f7450)
Sep 28 12:08:11 ctl02 glance-api[29183]: 2017-09-28 12:08:11.070 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:08:11] "OPTIONS / HTTP/1.0" 200 134 0.001009
Sep 28 12:08:11 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:08:11.438 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:08:11] "OPTIONS / HTTP/1.0" 200 134 0.000510
Sep 28 12:08:11 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9b3f7450)
Sep 28 12:08:12 ctl02 nova-api[16432]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:08:12 ctl02 nova-api[16432]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:08:12 ctl02 nova-api[16432]: 2017-09-28 12:08:12.231 16432 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:08:12 ctl02 nova-api[16432]: 2017-09-28 12:08:12.233 16432 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:08:12 ctl02 nova-api[16432]: 2017-09-28 12:08:12.233 16432 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:08:12 ctl02 nova-api[16432]: 2017-09-28 12:08:12.233 16432 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:08:12 ctl02 nova-api[16432]: 2017-09-28 12:08:12.233 16432 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:08:12 ctl02 nova-api[16432]: 2017-09-28 12:08:12.233 16432 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:08:12 ctl02 nova-api[16432]: 2017-09-28 12:08:12.233 16432 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:08:12 ctl02 nova-api[16432]: 2017-09-28 12:08:12.233 16432 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:08:12 ctl02 nova-api[16432]: 2017-09-28 12:08:12.233 16432 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:08:12 ctl02 nova-api[16432]: 2017-09-28 12:08:12.233 16432 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:08:12 ctl02 nova-api[16432]: 2017-09-28 12:08:12.233 16432 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:08:12 ctl02 nova-api[16432]: 2017-09-28 12:08:12.233 16432 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:08:12 ctl02 nova-api[16432]: 2017-09-28 12:08:12.233 16432 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:08:12 ctl02 nova-api[16432]: 2017-09-28 12:08:12.233 16432 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:08:12 ctl02 nova-api[16432]: 2017-09-28 12:08:12.233 16432 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:08:12 ctl02 nova-api[16432]: 2017-09-28 12:08:12.233 16432 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:08:12 ctl02 nova-api[16432]: 2017-09-28 12:08:12.233 16432 ERROR nova.wsgi     self.filename))
Sep 28 12:08:12 ctl02 nova-api[16432]: 2017-09-28 12:08:12.233 16432 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:08:12 ctl02 nova-api[16432]: 2017-09-28 12:08:12.233 16432 ERROR nova.wsgi
Sep 28 12:08:12 ctl02 nova-api[16432]: 2017-09-28 12:08:12.234 16432 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:08:12 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928120812339880
Sep 28 12:08:12 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 16445
Sep 28 12:08:12 ctl02 nova-api[16432]: 2017-09-28 12:08:12.374 16432 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:08:12 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928120812339880
Sep 28 12:08:12 ctl02 heat-api[13008]: 2017-09-28 12:08:12.472 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:08:12] "OPTIONS / HTTP/1.0" 200 134 0.000669
Sep 28 12:08:12 ctl02 nova-api[16432]: 2017-09-28 12:08:12.622 16432 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:08:12 ctl02 nova-api[16432]: 2017-09-28 12:08:12.625 16432 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:08:12 ctl02 nova-api[16432]: 2017-09-28 12:08:12.625 16432 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:08:12 ctl02 nova-api[16432]: 2017-09-28 12:08:12.626 16432 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:08:12 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9b3f7450)
Sep 28 12:08:12 ctl02 nova-api[16432]: 2017-09-28 12:08:12.759 16432 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:08:12 ctl02 nova-api[16432]: 2017-09-28 12:08:12.761 16432 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:08:12 ctl02 nova-api[16432]: 2017-09-28 12:08:12.761 16432 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:08:12 ctl02 nova-api[16432]: 2017-09-28 12:08:12.762 16432 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:08:12 ctl02 nova-api[16432]: 2017-09-28 12:08:12.765 16432 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:08:12 ctl02 nova-api[16432]: 2017-09-28 12:08:12.766 16432 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:08:12 ctl02 nova-api[16432]: 2017-09-28 12:08:12.766 16432 ERROR nova Traceback (most recent call last):
Sep 28 12:08:12 ctl02 nova-api[16432]: 2017-09-28 12:08:12.766 16432 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:08:12 ctl02 nova-api[16432]: 2017-09-28 12:08:12.766 16432 ERROR nova     sys.exit(main())
Sep 28 12:08:12 ctl02 nova-api[16432]: 2017-09-28 12:08:12.766 16432 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:08:12 ctl02 nova-api[16432]: 2017-09-28 12:08:12.766 16432 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:08:12 ctl02 nova-api[16432]: 2017-09-28 12:08:12.766 16432 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:08:12 ctl02 nova-api[16432]: 2017-09-28 12:08:12.766 16432 ERROR nova     max_url_len=max_url_len)
Sep 28 12:08:12 ctl02 nova-api[16432]: 2017-09-28 12:08:12.766 16432 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:08:12 ctl02 nova-api[16432]: 2017-09-28 12:08:12.766 16432 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:08:12 ctl02 nova-api[16432]: 2017-09-28 12:08:12.766 16432 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:08:12 ctl02 nova-api[16432]: 2017-09-28 12:08:12.766 16432 ERROR nova     sock.listen(backlog)
Sep 28 12:08:12 ctl02 nova-api[16432]: 2017-09-28 12:08:12.766 16432 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:08:12 ctl02 nova-api[16432]: 2017-09-28 12:08:12.766 16432 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:08:12 ctl02 nova-api[16432]: 2017-09-28 12:08:12.766 16432 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:08:12 ctl02 nova-api[16432]: 2017-09-28 12:08:12.766 16432 ERROR nova
Sep 28 12:08:12 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:08:12 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:08:12 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:08:13 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:08:13 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:08:13 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:08:13 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:08:13 ctl02 heat-api-cfn[13300]: 2017-09-28 12:08:13.420 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:08:13] "OPTIONS / HTTP/1.0" 200 134 0.000495
Sep 28 12:08:13 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9b3f7450)
Sep 28 12:08:13 ctl02 glance-api[29183]: 2017-09-28 12:08:13.823 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:08:13] "OPTIONS / HTTP/1.0" 200 134 0.000902
Sep 28 12:08:14 ctl02 glance-api[29183]: 2017-09-28 12:08:14.051 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:08:14] "OPTIONS / HTTP/1.0" 200 134 0.000446
Sep 28 12:08:14 ctl02 nova-consoleauth[5433]: 2017-09-28 12:08:14.099 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:08:14 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9b3f7450)
Sep 28 12:08:14 ctl02 nova-api[16454]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:08:14 ctl02 nova-api[16454]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:08:14 ctl02 nova-api[16454]: 2017-09-28 12:08:14.969 16454 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:08:14 ctl02 nova-api[16454]: 2017-09-28 12:08:14.971 16454 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:08:14 ctl02 nova-api[16454]: 2017-09-28 12:08:14.971 16454 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:08:14 ctl02 nova-api[16454]: 2017-09-28 12:08:14.971 16454 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:08:14 ctl02 nova-api[16454]: 2017-09-28 12:08:14.971 16454 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:08:14 ctl02 nova-api[16454]: 2017-09-28 12:08:14.971 16454 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:08:14 ctl02 nova-api[16454]: 2017-09-28 12:08:14.971 16454 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:08:14 ctl02 nova-api[16454]: 2017-09-28 12:08:14.971 16454 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:08:14 ctl02 nova-api[16454]: 2017-09-28 12:08:14.971 16454 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:08:14 ctl02 nova-api[16454]: 2017-09-28 12:08:14.971 16454 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:08:14 ctl02 nova-api[16454]: 2017-09-28 12:08:14.971 16454 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:08:14 ctl02 nova-api[16454]: 2017-09-28 12:08:14.971 16454 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:08:14 ctl02 nova-api[16454]: 2017-09-28 12:08:14.971 16454 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:08:14 ctl02 nova-api[16454]: 2017-09-28 12:08:14.971 16454 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:08:14 ctl02 nova-api[16454]: 2017-09-28 12:08:14.971 16454 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:08:14 ctl02 nova-api[16454]: 2017-09-28 12:08:14.971 16454 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:08:14 ctl02 nova-api[16454]: 2017-09-28 12:08:14.971 16454 ERROR nova.wsgi     self.filename))
Sep 28 12:08:14 ctl02 nova-api[16454]: 2017-09-28 12:08:14.971 16454 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:08:14 ctl02 nova-api[16454]: 2017-09-28 12:08:14.971 16454 ERROR nova.wsgi
Sep 28 12:08:14 ctl02 nova-api[16454]: 2017-09-28 12:08:14.972 16454 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:08:15 ctl02 nova-api[16454]: 2017-09-28 12:08:15.101 16454 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:08:15 ctl02 nova-api[16454]: 2017-09-28 12:08:15.339 16454 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:08:15 ctl02 nova-api[16454]: 2017-09-28 12:08:15.342 16454 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:08:15 ctl02 nova-api[16454]: 2017-09-28 12:08:15.342 16454 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:08:15 ctl02 nova-api[16454]: 2017-09-28 12:08:15.342 16454 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:08:15 ctl02 heat-api[13008]: 2017-09-28 12:08:15.358 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:08:15] "OPTIONS / HTTP/1.0" 200 134 0.000625
Sep 28 12:08:15 ctl02 nova-api[16454]: 2017-09-28 12:08:15.475 16454 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:08:15 ctl02 nova-api[16454]: 2017-09-28 12:08:15.477 16454 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:08:15 ctl02 nova-api[16454]: 2017-09-28 12:08:15.477 16454 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:08:15 ctl02 nova-api[16454]: 2017-09-28 12:08:15.478 16454 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:08:15 ctl02 nova-api[16454]: 2017-09-28 12:08:15.481 16454 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:08:15 ctl02 nova-api[16454]: 2017-09-28 12:08:15.481 16454 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:08:15 ctl02 nova-api[16454]: 2017-09-28 12:08:15.481 16454 ERROR nova Traceback (most recent call last):
Sep 28 12:08:15 ctl02 nova-api[16454]: 2017-09-28 12:08:15.481 16454 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:08:15 ctl02 nova-api[16454]: 2017-09-28 12:08:15.481 16454 ERROR nova     sys.exit(main())
Sep 28 12:08:15 ctl02 nova-api[16454]: 2017-09-28 12:08:15.481 16454 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:08:15 ctl02 nova-api[16454]: 2017-09-28 12:08:15.481 16454 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:08:15 ctl02 nova-api[16454]: 2017-09-28 12:08:15.481 16454 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:08:15 ctl02 nova-api[16454]: 2017-09-28 12:08:15.481 16454 ERROR nova     max_url_len=max_url_len)
Sep 28 12:08:15 ctl02 nova-api[16454]: 2017-09-28 12:08:15.481 16454 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:08:15 ctl02 nova-api[16454]: 2017-09-28 12:08:15.481 16454 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:08:15 ctl02 nova-api[16454]: 2017-09-28 12:08:15.481 16454 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:08:15 ctl02 nova-api[16454]: 2017-09-28 12:08:15.481 16454 ERROR nova     sock.listen(backlog)
Sep 28 12:08:15 ctl02 nova-api[16454]: 2017-09-28 12:08:15.481 16454 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:08:15 ctl02 nova-api[16454]: 2017-09-28 12:08:15.481 16454 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:08:15 ctl02 nova-api[16454]: 2017-09-28 12:08:15.481 16454 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:08:15 ctl02 nova-api[16454]: 2017-09-28 12:08:15.481 16454 ERROR nova
Sep 28 12:08:15 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:08:15 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:08:15 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:08:15 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:08:15 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:08:15 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:08:15 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:08:15 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:08:15 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:08:16 ctl02 heat-api[13008]: 2017-09-28 12:08:16.063 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:08:16] "OPTIONS / HTTP/1.0" 200 134 0.000647
Sep 28 12:08:17 ctl02 nova-scheduler[5620]: 2017-09-28 12:08:17.122 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:08:17 ctl02 heat-engine[12803]: 2017-09-28 12:08:17.433 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:08:17 ctl02 heat-engine[12803]: 2017-09-28 12:08:17.463 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:08:17 ctl02 heat-engine[12803]: 2017-09-28 12:08:17.481 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:08:17 ctl02 heat-engine[12803]: 2017-09-28 12:08:17.489 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:08:17 ctl02 nova-api[16478]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:08:17 ctl02 nova-api[16478]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:08:17 ctl02 nova-api[16478]: 2017-09-28 12:08:17.691 16478 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:08:17 ctl02 nova-api[16478]: 2017-09-28 12:08:17.693 16478 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:08:17 ctl02 nova-api[16478]: 2017-09-28 12:08:17.693 16478 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:08:17 ctl02 nova-api[16478]: 2017-09-28 12:08:17.693 16478 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:08:17 ctl02 nova-api[16478]: 2017-09-28 12:08:17.693 16478 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:08:17 ctl02 nova-api[16478]: 2017-09-28 12:08:17.693 16478 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:08:17 ctl02 nova-api[16478]: 2017-09-28 12:08:17.693 16478 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:08:17 ctl02 nova-api[16478]: 2017-09-28 12:08:17.693 16478 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:08:17 ctl02 nova-api[16478]: 2017-09-28 12:08:17.693 16478 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:08:17 ctl02 nova-api[16478]: 2017-09-28 12:08:17.693 16478 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:08:17 ctl02 nova-api[16478]: 2017-09-28 12:08:17.693 16478 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:08:17 ctl02 nova-api[16478]: 2017-09-28 12:08:17.693 16478 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:08:17 ctl02 nova-api[16478]: 2017-09-28 12:08:17.693 16478 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:08:17 ctl02 nova-api[16478]: 2017-09-28 12:08:17.693 16478 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:08:17 ctl02 nova-api[16478]: 2017-09-28 12:08:17.693 16478 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:08:17 ctl02 nova-api[16478]: 2017-09-28 12:08:17.693 16478 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:08:17 ctl02 nova-api[16478]: 2017-09-28 12:08:17.693 16478 ERROR nova.wsgi     self.filename))
Sep 28 12:08:17 ctl02 nova-api[16478]: 2017-09-28 12:08:17.693 16478 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:08:17 ctl02 nova-api[16478]: 2017-09-28 12:08:17.693 16478 ERROR nova.wsgi
Sep 28 12:08:17 ctl02 nova-api[16478]: 2017-09-28 12:08:17.694 16478 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:08:17 ctl02 nova-api[16478]: 2017-09-28 12:08:17.823 16478 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:08:18 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:08:18.058 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:08:18] "OPTIONS / HTTP/1.0" 200 134 0.000463
Sep 28 12:08:18 ctl02 nova-api[16478]: 2017-09-28 12:08:18.063 16478 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:08:18 ctl02 nova-api[16478]: 2017-09-28 12:08:18.066 16478 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:08:18 ctl02 nova-api[16478]: 2017-09-28 12:08:18.066 16478 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:08:18 ctl02 nova-api[16478]: 2017-09-28 12:08:18.066 16478 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:08:18 ctl02 nova-api[16478]: 2017-09-28 12:08:18.197 16478 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:08:18 ctl02 nova-api[16478]: 2017-09-28 12:08:18.199 16478 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:08:18 ctl02 nova-api[16478]: 2017-09-28 12:08:18.199 16478 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:08:18 ctl02 nova-api[16478]: 2017-09-28 12:08:18.199 16478 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:08:18 ctl02 nova-api[16478]: 2017-09-28 12:08:18.203 16478 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:08:18 ctl02 nova-api[16478]: 2017-09-28 12:08:18.203 16478 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:08:18 ctl02 nova-api[16478]: 2017-09-28 12:08:18.203 16478 ERROR nova Traceback (most recent call last):
Sep 28 12:08:18 ctl02 nova-api[16478]: 2017-09-28 12:08:18.203 16478 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:08:18 ctl02 nova-api[16478]: 2017-09-28 12:08:18.203 16478 ERROR nova     sys.exit(main())
Sep 28 12:08:18 ctl02 nova-api[16478]: 2017-09-28 12:08:18.203 16478 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:08:18 ctl02 nova-api[16478]: 2017-09-28 12:08:18.203 16478 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:08:18 ctl02 nova-api[16478]: 2017-09-28 12:08:18.203 16478 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:08:18 ctl02 nova-api[16478]: 2017-09-28 12:08:18.203 16478 ERROR nova     max_url_len=max_url_len)
Sep 28 12:08:18 ctl02 nova-api[16478]: 2017-09-28 12:08:18.203 16478 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:08:18 ctl02 nova-api[16478]: 2017-09-28 12:08:18.203 16478 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:08:18 ctl02 nova-api[16478]: 2017-09-28 12:08:18.203 16478 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:08:18 ctl02 nova-api[16478]: 2017-09-28 12:08:18.203 16478 ERROR nova     sock.listen(backlog)
Sep 28 12:08:18 ctl02 nova-api[16478]: 2017-09-28 12:08:18.203 16478 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:08:18 ctl02 nova-api[16478]: 2017-09-28 12:08:18.203 16478 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:08:18 ctl02 nova-api[16478]: 2017-09-28 12:08:18.203 16478 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:08:18 ctl02 nova-api[16478]: 2017-09-28 12:08:18.203 16478 ERROR nova
Sep 28 12:08:18 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:08:18 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:08:18 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:08:18 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:08:18 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:08:18 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:08:18 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:08:18 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:08:18.779 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:08:18] "OPTIONS / HTTP/1.0" 200 134 0.000464
Sep 28 12:08:19 ctl02 heat-api-cfn[13300]: 2017-09-28 12:08:19.608 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:08:19] "OPTIONS / HTTP/1.0" 200 134 0.000449
Sep 28 12:08:20 ctl02 nova-api[16496]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:08:20 ctl02 nova-api[16496]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:08:20 ctl02 heat-api-cfn[13300]: 2017-09-28 12:08:20.421 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:08:20] "OPTIONS / HTTP/1.0" 200 134 0.000504
Sep 28 12:08:20 ctl02 nova-api[16496]: 2017-09-28 12:08:20.429 16496 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:08:20 ctl02 nova-api[16496]: 2017-09-28 12:08:20.431 16496 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:08:20 ctl02 nova-api[16496]: 2017-09-28 12:08:20.431 16496 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:08:20 ctl02 nova-api[16496]: 2017-09-28 12:08:20.431 16496 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:08:20 ctl02 nova-api[16496]: 2017-09-28 12:08:20.431 16496 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:08:20 ctl02 nova-api[16496]: 2017-09-28 12:08:20.431 16496 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:08:20 ctl02 nova-api[16496]: 2017-09-28 12:08:20.431 16496 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:08:20 ctl02 nova-api[16496]: 2017-09-28 12:08:20.431 16496 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:08:20 ctl02 nova-api[16496]: 2017-09-28 12:08:20.431 16496 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:08:20 ctl02 nova-api[16496]: 2017-09-28 12:08:20.431 16496 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:08:20 ctl02 nova-api[16496]: 2017-09-28 12:08:20.431 16496 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:08:20 ctl02 nova-api[16496]: 2017-09-28 12:08:20.431 16496 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:08:20 ctl02 nova-api[16496]: 2017-09-28 12:08:20.431 16496 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:08:20 ctl02 nova-api[16496]: 2017-09-28 12:08:20.431 16496 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:08:20 ctl02 nova-api[16496]: 2017-09-28 12:08:20.431 16496 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:08:20 ctl02 nova-api[16496]: 2017-09-28 12:08:20.431 16496 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:08:20 ctl02 nova-api[16496]: 2017-09-28 12:08:20.431 16496 ERROR nova.wsgi     self.filename))
Sep 28 12:08:20 ctl02 nova-api[16496]: 2017-09-28 12:08:20.431 16496 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:08:20 ctl02 nova-api[16496]: 2017-09-28 12:08:20.431 16496 ERROR nova.wsgi
Sep 28 12:08:20 ctl02 nova-api[16496]: 2017-09-28 12:08:20.432 16496 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:08:20 ctl02 nova-api[16496]: 2017-09-28 12:08:20.561 16496 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:08:20 ctl02 nova-api[16496]: 2017-09-28 12:08:20.798 16496 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:08:20 ctl02 nova-api[16496]: 2017-09-28 12:08:20.800 16496 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:08:20 ctl02 nova-api[16496]: 2017-09-28 12:08:20.800 16496 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:08:20 ctl02 nova-api[16496]: 2017-09-28 12:08:20.801 16496 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:08:20 ctl02 glance-api[29183]: 2017-09-28 12:08:20.826 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:08:20] "OPTIONS / HTTP/1.0" 200 134 0.000650
Sep 28 12:08:20 ctl02 nova-api[16496]: 2017-09-28 12:08:20.934 16496 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:08:20 ctl02 nova-api[16496]: 2017-09-28 12:08:20.936 16496 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:08:20 ctl02 nova-api[16496]: 2017-09-28 12:08:20.936 16496 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:08:20 ctl02 nova-api[16496]: 2017-09-28 12:08:20.936 16496 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:08:20 ctl02 nova-api[16496]: 2017-09-28 12:08:20.939 16496 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:08:20 ctl02 nova-api[16496]: 2017-09-28 12:08:20.940 16496 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:08:20 ctl02 nova-api[16496]: 2017-09-28 12:08:20.940 16496 ERROR nova Traceback (most recent call last):
Sep 28 12:08:20 ctl02 nova-api[16496]: 2017-09-28 12:08:20.940 16496 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:08:20 ctl02 nova-api[16496]: 2017-09-28 12:08:20.940 16496 ERROR nova     sys.exit(main())
Sep 28 12:08:20 ctl02 nova-api[16496]: 2017-09-28 12:08:20.940 16496 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:08:20 ctl02 nova-api[16496]: 2017-09-28 12:08:20.940 16496 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:08:20 ctl02 nova-api[16496]: 2017-09-28 12:08:20.940 16496 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:08:20 ctl02 nova-api[16496]: 2017-09-28 12:08:20.940 16496 ERROR nova     max_url_len=max_url_len)
Sep 28 12:08:20 ctl02 nova-api[16496]: 2017-09-28 12:08:20.940 16496 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:08:20 ctl02 nova-api[16496]: 2017-09-28 12:08:20.940 16496 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:08:20 ctl02 nova-api[16496]: 2017-09-28 12:08:20.940 16496 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:08:20 ctl02 nova-api[16496]: 2017-09-28 12:08:20.940 16496 ERROR nova     sock.listen(backlog)
Sep 28 12:08:20 ctl02 nova-api[16496]: 2017-09-28 12:08:20.940 16496 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:08:20 ctl02 nova-api[16496]: 2017-09-28 12:08:20.940 16496 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:08:20 ctl02 nova-api[16496]: 2017-09-28 12:08:20.940 16496 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:08:20 ctl02 nova-api[16496]: 2017-09-28 12:08:20.940 16496 ERROR nova
Sep 28 12:08:21 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:08:21 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:08:21 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:08:21 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:08:21 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:08:21 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:08:21 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:08:21 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:08:21.436 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:08:21] "OPTIONS / HTTP/1.0" 200 134 0.000548
Sep 28 12:08:22 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928120822514802
Sep 28 12:08:22 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 16525
Sep 28 12:08:22 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928120822514802
Sep 28 12:08:22 ctl02 heat-api[13008]: 2017-09-28 12:08:22.564 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:08:22] "OPTIONS / HTTP/1.0" 200 134 0.000615
Sep 28 12:08:23 ctl02 nova-api[16514]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:08:23 ctl02 nova-api[16514]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:08:23 ctl02 nova-api[16514]: 2017-09-28 12:08:23.225 16514 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:08:23 ctl02 nova-api[16514]: 2017-09-28 12:08:23.227 16514 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:08:23 ctl02 nova-api[16514]: 2017-09-28 12:08:23.227 16514 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:08:23 ctl02 nova-api[16514]: 2017-09-28 12:08:23.227 16514 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:08:23 ctl02 nova-api[16514]: 2017-09-28 12:08:23.227 16514 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:08:23 ctl02 nova-api[16514]: 2017-09-28 12:08:23.227 16514 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:08:23 ctl02 nova-api[16514]: 2017-09-28 12:08:23.227 16514 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:08:23 ctl02 nova-api[16514]: 2017-09-28 12:08:23.227 16514 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:08:23 ctl02 nova-api[16514]: 2017-09-28 12:08:23.227 16514 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:08:23 ctl02 nova-api[16514]: 2017-09-28 12:08:23.227 16514 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:08:23 ctl02 nova-api[16514]: 2017-09-28 12:08:23.227 16514 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:08:23 ctl02 nova-api[16514]: 2017-09-28 12:08:23.227 16514 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:08:23 ctl02 nova-api[16514]: 2017-09-28 12:08:23.227 16514 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:08:23 ctl02 nova-api[16514]: 2017-09-28 12:08:23.227 16514 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:08:23 ctl02 nova-api[16514]: 2017-09-28 12:08:23.227 16514 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:08:23 ctl02 nova-api[16514]: 2017-09-28 12:08:23.227 16514 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:08:23 ctl02 nova-api[16514]: 2017-09-28 12:08:23.227 16514 ERROR nova.wsgi     self.filename))
Sep 28 12:08:23 ctl02 nova-api[16514]: 2017-09-28 12:08:23.227 16514 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:08:23 ctl02 nova-api[16514]: 2017-09-28 12:08:23.227 16514 ERROR nova.wsgi
Sep 28 12:08:23 ctl02 nova-api[16514]: 2017-09-28 12:08:23.228 16514 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:08:23 ctl02 nova-api[16514]: 2017-09-28 12:08:23.360 16514 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:08:23 ctl02 heat-api-cfn[13300]: 2017-09-28 12:08:23.417 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:08:23] "OPTIONS / HTTP/1.0" 200 134 0.000475
Sep 28 12:08:23 ctl02 nova-api[16514]: 2017-09-28 12:08:23.604 16514 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:08:23 ctl02 nova-api[16514]: 2017-09-28 12:08:23.606 16514 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:08:23 ctl02 nova-api[16514]: 2017-09-28 12:08:23.607 16514 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:08:23 ctl02 nova-api[16514]: 2017-09-28 12:08:23.607 16514 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:08:23 ctl02 nova-api[16514]: 2017-09-28 12:08:23.740 16514 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:08:23 ctl02 nova-api[16514]: 2017-09-28 12:08:23.742 16514 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:08:23 ctl02 nova-api[16514]: 2017-09-28 12:08:23.743 16514 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:08:23 ctl02 nova-api[16514]: 2017-09-28 12:08:23.743 16514 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:08:23 ctl02 nova-api[16514]: 2017-09-28 12:08:23.746 16514 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:08:23 ctl02 nova-api[16514]: 2017-09-28 12:08:23.746 16514 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:08:23 ctl02 nova-api[16514]: 2017-09-28 12:08:23.746 16514 ERROR nova Traceback (most recent call last):
Sep 28 12:08:23 ctl02 nova-api[16514]: 2017-09-28 12:08:23.746 16514 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:08:23 ctl02 nova-api[16514]: 2017-09-28 12:08:23.746 16514 ERROR nova     sys.exit(main())
Sep 28 12:08:23 ctl02 nova-api[16514]: 2017-09-28 12:08:23.746 16514 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:08:23 ctl02 nova-api[16514]: 2017-09-28 12:08:23.746 16514 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:08:23 ctl02 nova-api[16514]: 2017-09-28 12:08:23.746 16514 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:08:23 ctl02 nova-api[16514]: 2017-09-28 12:08:23.746 16514 ERROR nova     max_url_len=max_url_len)
Sep 28 12:08:23 ctl02 nova-api[16514]: 2017-09-28 12:08:23.746 16514 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:08:23 ctl02 nova-api[16514]: 2017-09-28 12:08:23.746 16514 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:08:23 ctl02 nova-api[16514]: 2017-09-28 12:08:23.746 16514 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:08:23 ctl02 nova-api[16514]: 2017-09-28 12:08:23.746 16514 ERROR nova     sock.listen(backlog)
Sep 28 12:08:23 ctl02 nova-api[16514]: 2017-09-28 12:08:23.746 16514 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:08:23 ctl02 nova-api[16514]: 2017-09-28 12:08:23.746 16514 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:08:23 ctl02 nova-api[16514]: 2017-09-28 12:08:23.746 16514 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:08:23 ctl02 nova-api[16514]: 2017-09-28 12:08:23.746 16514 ERROR nova
Sep 28 12:08:23 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:08:23 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:08:23 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:08:24 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:08:24 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:08:24 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:08:24 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:08:24 ctl02 glance-api[29183]: 2017-09-28 12:08:24.150 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:08:24] "OPTIONS / HTTP/1.0" 200 134 0.000829
Sep 28 12:08:24 ctl02 glance-api[29183]: 2017-09-28 12:08:24.395 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:08:24] "OPTIONS / HTTP/1.0" 200 134 0.000625
Sep 28 12:08:25 ctl02 heat-api[13008]: 2017-09-28 12:08:25.290 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:08:25] "OPTIONS / HTTP/1.0" 200 134 0.000563
Sep 28 12:08:25 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemd-run', '--scope', 'apt-get', '-q', '-y', '-o', 'DPkg::Options::=--force-confold', '-o', 'DPkg::Options::=--force-confdef', 'install', 'python-cinder'] in directory '/root'
Sep 28 12:08:25 ctl02 systemd[1]: Started /usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold -o DPkg::Options::=--force-confdef install python-cinder.
Sep 28 12:08:25 ctl02 nova-api[16537]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:08:25 ctl02 nova-api[16537]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:08:25 ctl02 nova-api[16537]: 2017-09-28 12:08:25.931 16537 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:08:25 ctl02 nova-api[16537]: 2017-09-28 12:08:25.933 16537 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:08:25 ctl02 nova-api[16537]: 2017-09-28 12:08:25.933 16537 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:08:25 ctl02 nova-api[16537]: 2017-09-28 12:08:25.933 16537 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:08:25 ctl02 nova-api[16537]: 2017-09-28 12:08:25.933 16537 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:08:25 ctl02 nova-api[16537]: 2017-09-28 12:08:25.933 16537 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:08:25 ctl02 nova-api[16537]: 2017-09-28 12:08:25.933 16537 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:08:25 ctl02 nova-api[16537]: 2017-09-28 12:08:25.933 16537 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:08:25 ctl02 nova-api[16537]: 2017-09-28 12:08:25.933 16537 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:08:25 ctl02 nova-api[16537]: 2017-09-28 12:08:25.933 16537 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:08:25 ctl02 nova-api[16537]: 2017-09-28 12:08:25.933 16537 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:08:25 ctl02 nova-api[16537]: 2017-09-28 12:08:25.933 16537 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:08:25 ctl02 nova-api[16537]: 2017-09-28 12:08:25.933 16537 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:08:25 ctl02 nova-api[16537]: 2017-09-28 12:08:25.933 16537 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:08:25 ctl02 nova-api[16537]: 2017-09-28 12:08:25.933 16537 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:08:25 ctl02 nova-api[16537]: 2017-09-28 12:08:25.933 16537 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:08:25 ctl02 nova-api[16537]: 2017-09-28 12:08:25.933 16537 ERROR nova.wsgi     self.filename))
Sep 28 12:08:25 ctl02 nova-api[16537]: 2017-09-28 12:08:25.933 16537 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:08:25 ctl02 nova-api[16537]: 2017-09-28 12:08:25.933 16537 ERROR nova.wsgi
Sep 28 12:08:25 ctl02 nova-api[16537]: 2017-09-28 12:08:25.934 16537 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:08:26 ctl02 nova-api[16537]: 2017-09-28 12:08:26.057 16537 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:08:26 ctl02 nova-api[16537]: 2017-09-28 12:08:26.278 16537 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:08:26 ctl02 nova-api[16537]: 2017-09-28 12:08:26.280 16537 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:08:26 ctl02 nova-api[16537]: 2017-09-28 12:08:26.280 16537 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:08:26 ctl02 nova-api[16537]: 2017-09-28 12:08:26.280 16537 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:08:26 ctl02 heat-api[13008]: 2017-09-28 12:08:26.374 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:08:26] "OPTIONS / HTTP/1.0" 200 134 0.000548
Sep 28 12:08:26 ctl02 nova-api[16537]: 2017-09-28 12:08:26.413 16537 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:08:26 ctl02 nova-api[16537]: 2017-09-28 12:08:26.415 16537 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:08:26 ctl02 nova-api[16537]: 2017-09-28 12:08:26.415 16537 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:08:26 ctl02 nova-api[16537]: 2017-09-28 12:08:26.415 16537 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:08:26 ctl02 nova-api[16537]: 2017-09-28 12:08:26.418 16537 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:08:26 ctl02 nova-api[16537]: 2017-09-28 12:08:26.419 16537 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:08:26 ctl02 nova-api[16537]: 2017-09-28 12:08:26.419 16537 ERROR nova Traceback (most recent call last):
Sep 28 12:08:26 ctl02 nova-api[16537]: 2017-09-28 12:08:26.419 16537 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:08:26 ctl02 nova-api[16537]: 2017-09-28 12:08:26.419 16537 ERROR nova     sys.exit(main())
Sep 28 12:08:26 ctl02 nova-api[16537]: 2017-09-28 12:08:26.419 16537 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:08:26 ctl02 nova-api[16537]: 2017-09-28 12:08:26.419 16537 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:08:26 ctl02 nova-api[16537]: 2017-09-28 12:08:26.419 16537 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:08:26 ctl02 nova-api[16537]: 2017-09-28 12:08:26.419 16537 ERROR nova     max_url_len=max_url_len)
Sep 28 12:08:26 ctl02 nova-api[16537]: 2017-09-28 12:08:26.419 16537 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:08:26 ctl02 nova-api[16537]: 2017-09-28 12:08:26.419 16537 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:08:26 ctl02 nova-api[16537]: 2017-09-28 12:08:26.419 16537 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:08:26 ctl02 nova-api[16537]: 2017-09-28 12:08:26.419 16537 ERROR nova     sock.listen(backlog)
Sep 28 12:08:26 ctl02 nova-api[16537]: 2017-09-28 12:08:26.419 16537 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:08:26 ctl02 nova-api[16537]: 2017-09-28 12:08:26.419 16537 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:08:26 ctl02 nova-api[16537]: 2017-09-28 12:08:26.419 16537 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:08:26 ctl02 nova-api[16537]: 2017-09-28 12:08:26.419 16537 ERROR nova
Sep 28 12:08:26 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:08:26 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:08:26 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:08:26 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:08:26 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:08:26 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:08:26 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:08:28 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:08:28.203 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:08:28] "OPTIONS / HTTP/1.0" 200 134 0.000462
Sep 28 12:08:28 ctl02 nova-api[16691]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:08:28 ctl02 nova-api[16691]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:08:28 ctl02 nova-api[16691]: 2017-09-28 12:08:28.746 16691 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:08:28 ctl02 nova-api[16691]: 2017-09-28 12:08:28.748 16691 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:08:28 ctl02 nova-api[16691]: 2017-09-28 12:08:28.748 16691 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:08:28 ctl02 nova-api[16691]: 2017-09-28 12:08:28.748 16691 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:08:28 ctl02 nova-api[16691]: 2017-09-28 12:08:28.748 16691 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:08:28 ctl02 nova-api[16691]: 2017-09-28 12:08:28.748 16691 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:08:28 ctl02 nova-api[16691]: 2017-09-28 12:08:28.748 16691 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:08:28 ctl02 nova-api[16691]: 2017-09-28 12:08:28.748 16691 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:08:28 ctl02 nova-api[16691]: 2017-09-28 12:08:28.748 16691 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:08:28 ctl02 nova-api[16691]: 2017-09-28 12:08:28.748 16691 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:08:28 ctl02 nova-api[16691]: 2017-09-28 12:08:28.748 16691 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:08:28 ctl02 nova-api[16691]: 2017-09-28 12:08:28.748 16691 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:08:28 ctl02 nova-api[16691]: 2017-09-28 12:08:28.748 16691 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:08:28 ctl02 nova-api[16691]: 2017-09-28 12:08:28.748 16691 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:08:28 ctl02 nova-api[16691]: 2017-09-28 12:08:28.748 16691 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:08:28 ctl02 nova-api[16691]: 2017-09-28 12:08:28.748 16691 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:08:28 ctl02 nova-api[16691]: 2017-09-28 12:08:28.748 16691 ERROR nova.wsgi     self.filename))
Sep 28 12:08:28 ctl02 nova-api[16691]: 2017-09-28 12:08:28.748 16691 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:08:28 ctl02 nova-api[16691]: 2017-09-28 12:08:28.748 16691 ERROR nova.wsgi
Sep 28 12:08:28 ctl02 nova-api[16691]: 2017-09-28 12:08:28.749 16691 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:08:28 ctl02 nova-api[16691]: 2017-09-28 12:08:28.877 16691 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:08:28 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:08:28.899 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:08:28] "OPTIONS / HTTP/1.0" 200 134 0.000584
Sep 28 12:08:29 ctl02 nova-api[16691]: 2017-09-28 12:08:29.115 16691 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:08:29 ctl02 nova-api[16691]: 2017-09-28 12:08:29.117 16691 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:08:29 ctl02 nova-api[16691]: 2017-09-28 12:08:29.118 16691 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:08:29 ctl02 nova-api[16691]: 2017-09-28 12:08:29.118 16691 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:08:29 ctl02 nova-api[16691]: 2017-09-28 12:08:29.251 16691 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:08:29 ctl02 nova-api[16691]: 2017-09-28 12:08:29.253 16691 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:08:29 ctl02 nova-api[16691]: 2017-09-28 12:08:29.253 16691 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:08:29 ctl02 nova-api[16691]: 2017-09-28 12:08:29.253 16691 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:08:29 ctl02 nova-api[16691]: 2017-09-28 12:08:29.256 16691 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:08:29 ctl02 nova-api[16691]: 2017-09-28 12:08:29.257 16691 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:08:29 ctl02 nova-api[16691]: 2017-09-28 12:08:29.257 16691 ERROR nova Traceback (most recent call last):
Sep 28 12:08:29 ctl02 nova-api[16691]: 2017-09-28 12:08:29.257 16691 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:08:29 ctl02 nova-api[16691]: 2017-09-28 12:08:29.257 16691 ERROR nova     sys.exit(main())
Sep 28 12:08:29 ctl02 nova-api[16691]: 2017-09-28 12:08:29.257 16691 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:08:29 ctl02 nova-api[16691]: 2017-09-28 12:08:29.257 16691 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:08:29 ctl02 nova-api[16691]: 2017-09-28 12:08:29.257 16691 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:08:29 ctl02 nova-api[16691]: 2017-09-28 12:08:29.257 16691 ERROR nova     max_url_len=max_url_len)
Sep 28 12:08:29 ctl02 nova-api[16691]: 2017-09-28 12:08:29.257 16691 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:08:29 ctl02 nova-api[16691]: 2017-09-28 12:08:29.257 16691 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:08:29 ctl02 nova-api[16691]: 2017-09-28 12:08:29.257 16691 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:08:29 ctl02 nova-api[16691]: 2017-09-28 12:08:29.257 16691 ERROR nova     sock.listen(backlog)
Sep 28 12:08:29 ctl02 nova-api[16691]: 2017-09-28 12:08:29.257 16691 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:08:29 ctl02 nova-api[16691]: 2017-09-28 12:08:29.257 16691 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:08:29 ctl02 nova-api[16691]: 2017-09-28 12:08:29.257 16691 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:08:29 ctl02 nova-api[16691]: 2017-09-28 12:08:29.257 16691 ERROR nova
Sep 28 12:08:29 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:08:29 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:08:29 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:08:29 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:08:29 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:08:29 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:08:29 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:08:29 ctl02 heat-api-cfn[13300]: 2017-09-28 12:08:29.916 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:08:29] "OPTIONS / HTTP/1.0" 200 134 0.000478
Sep 28 12:08:30 ctl02 heat-api-cfn[13300]: 2017-09-28 12:08:30.764 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:08:30] "OPTIONS / HTTP/1.0" 200 134 0.000586
Sep 28 12:08:30 ctl02 glance-api[29183]: 2017-09-28 12:08:30.825 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:08:30] "OPTIONS / HTTP/1.0" 200 134 0.000592
Sep 28 12:08:31 ctl02 nova-api[16773]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:08:31 ctl02 nova-api[16773]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:08:31 ctl02 nova-api[16773]: 2017-09-28 12:08:31.430 16773 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:08:31 ctl02 nova-api[16773]: 2017-09-28 12:08:31.432 16773 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:08:31 ctl02 nova-api[16773]: 2017-09-28 12:08:31.432 16773 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:08:31 ctl02 nova-api[16773]: 2017-09-28 12:08:31.432 16773 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:08:31 ctl02 nova-api[16773]: 2017-09-28 12:08:31.432 16773 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:08:31 ctl02 nova-api[16773]: 2017-09-28 12:08:31.432 16773 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:08:31 ctl02 nova-api[16773]: 2017-09-28 12:08:31.432 16773 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:08:31 ctl02 nova-api[16773]: 2017-09-28 12:08:31.432 16773 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:08:31 ctl02 nova-api[16773]: 2017-09-28 12:08:31.432 16773 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:08:31 ctl02 nova-api[16773]: 2017-09-28 12:08:31.432 16773 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:08:31 ctl02 nova-api[16773]: 2017-09-28 12:08:31.432 16773 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:08:31 ctl02 nova-api[16773]: 2017-09-28 12:08:31.432 16773 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:08:31 ctl02 nova-api[16773]: 2017-09-28 12:08:31.432 16773 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:08:31 ctl02 nova-api[16773]: 2017-09-28 12:08:31.432 16773 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:08:31 ctl02 nova-api[16773]: 2017-09-28 12:08:31.432 16773 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:08:31 ctl02 nova-api[16773]: 2017-09-28 12:08:31.432 16773 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:08:31 ctl02 nova-api[16773]: 2017-09-28 12:08:31.432 16773 ERROR nova.wsgi     self.filename))
Sep 28 12:08:31 ctl02 nova-api[16773]: 2017-09-28 12:08:31.432 16773 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:08:31 ctl02 nova-api[16773]: 2017-09-28 12:08:31.432 16773 ERROR nova.wsgi
Sep 28 12:08:31 ctl02 nova-api[16773]: 2017-09-28 12:08:31.435 16773 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:08:31 ctl02 nova-api[16773]: 2017-09-28 12:08:31.562 16773 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:08:31 ctl02 nova-api[16773]: 2017-09-28 12:08:31.787 16773 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:08:31 ctl02 nova-api[16773]: 2017-09-28 12:08:31.790 16773 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:08:31 ctl02 nova-api[16773]: 2017-09-28 12:08:31.791 16773 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:08:31 ctl02 nova-api[16773]: 2017-09-28 12:08:31.791 16773 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:08:31 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:08:31.833 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:08:31] "OPTIONS / HTTP/1.0" 200 134 0.000546
Sep 28 12:08:31 ctl02 nova-api[16773]: 2017-09-28 12:08:31.921 16773 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:08:31 ctl02 nova-api[16773]: 2017-09-28 12:08:31.924 16773 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:08:31 ctl02 nova-api[16773]: 2017-09-28 12:08:31.924 16773 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:08:31 ctl02 nova-api[16773]: 2017-09-28 12:08:31.924 16773 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:08:31 ctl02 nova-api[16773]: 2017-09-28 12:08:31.928 16773 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:08:31 ctl02 nova-api[16773]: 2017-09-28 12:08:31.928 16773 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:08:31 ctl02 nova-api[16773]: 2017-09-28 12:08:31.928 16773 ERROR nova Traceback (most recent call last):
Sep 28 12:08:31 ctl02 nova-api[16773]: 2017-09-28 12:08:31.928 16773 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:08:31 ctl02 nova-api[16773]: 2017-09-28 12:08:31.928 16773 ERROR nova     sys.exit(main())
Sep 28 12:08:31 ctl02 nova-api[16773]: 2017-09-28 12:08:31.928 16773 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:08:31 ctl02 nova-api[16773]: 2017-09-28 12:08:31.928 16773 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:08:31 ctl02 nova-api[16773]: 2017-09-28 12:08:31.928 16773 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:08:31 ctl02 nova-api[16773]: 2017-09-28 12:08:31.928 16773 ERROR nova     max_url_len=max_url_len)
Sep 28 12:08:31 ctl02 nova-api[16773]: 2017-09-28 12:08:31.928 16773 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:08:31 ctl02 nova-api[16773]: 2017-09-28 12:08:31.928 16773 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:08:31 ctl02 nova-api[16773]: 2017-09-28 12:08:31.928 16773 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:08:31 ctl02 nova-api[16773]: 2017-09-28 12:08:31.928 16773 ERROR nova     sock.listen(backlog)
Sep 28 12:08:31 ctl02 nova-api[16773]: 2017-09-28 12:08:31.928 16773 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:08:31 ctl02 nova-api[16773]: 2017-09-28 12:08:31.928 16773 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:08:31 ctl02 nova-api[16773]: 2017-09-28 12:08:31.928 16773 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:08:31 ctl02 nova-api[16773]: 2017-09-28 12:08:31.928 16773 ERROR nova
Sep 28 12:08:32 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:08:32 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:08:32 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:08:32 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:08:32 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:08:32 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:08:32 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:08:32 ctl02 heat-api[13008]: 2017-09-28 12:08:32.602 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:08:32] "OPTIONS / HTTP/1.0" 200 134 0.000590
Sep 28 12:08:32 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928120832690769
Sep 28 12:08:32 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 16820
Sep 28 12:08:32 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928120832690769
Sep 28 12:08:33 ctl02 heat-api-cfn[13300]: 2017-09-28 12:08:33.309 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:08:33] "OPTIONS / HTTP/1.0" 200 134 0.000440
Sep 28 12:08:33 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x64fc2b71)
Sep 28 12:08:34 ctl02 nova-api[16809]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:08:34 ctl02 nova-api[16809]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:08:34 ctl02 nova-api[16809]: 2017-09-28 12:08:34.225 16809 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:08:34 ctl02 nova-api[16809]: 2017-09-28 12:08:34.227 16809 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:08:34 ctl02 nova-api[16809]: 2017-09-28 12:08:34.227 16809 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:08:34 ctl02 nova-api[16809]: 2017-09-28 12:08:34.227 16809 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:08:34 ctl02 nova-api[16809]: 2017-09-28 12:08:34.227 16809 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:08:34 ctl02 nova-api[16809]: 2017-09-28 12:08:34.227 16809 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:08:34 ctl02 nova-api[16809]: 2017-09-28 12:08:34.227 16809 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:08:34 ctl02 nova-api[16809]: 2017-09-28 12:08:34.227 16809 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:08:34 ctl02 nova-api[16809]: 2017-09-28 12:08:34.227 16809 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:08:34 ctl02 nova-api[16809]: 2017-09-28 12:08:34.227 16809 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:08:34 ctl02 nova-api[16809]: 2017-09-28 12:08:34.227 16809 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:08:34 ctl02 nova-api[16809]: 2017-09-28 12:08:34.227 16809 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:08:34 ctl02 nova-api[16809]: 2017-09-28 12:08:34.227 16809 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:08:34 ctl02 nova-api[16809]: 2017-09-28 12:08:34.227 16809 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:08:34 ctl02 nova-api[16809]: 2017-09-28 12:08:34.227 16809 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:08:34 ctl02 nova-api[16809]: 2017-09-28 12:08:34.227 16809 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:08:34 ctl02 nova-api[16809]: 2017-09-28 12:08:34.227 16809 ERROR nova.wsgi     self.filename))
Sep 28 12:08:34 ctl02 nova-api[16809]: 2017-09-28 12:08:34.227 16809 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:08:34 ctl02 nova-api[16809]: 2017-09-28 12:08:34.227 16809 ERROR nova.wsgi
Sep 28 12:08:34 ctl02 nova-api[16809]: 2017-09-28 12:08:34.228 16809 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:08:34 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x64fc2b71)
Sep 28 12:08:34 ctl02 glance-api[29183]: 2017-09-28 12:08:34.319 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:08:34] "OPTIONS / HTTP/1.0" 200 134 0.000576
Sep 28 12:08:34 ctl02 nova-api[16809]: 2017-09-28 12:08:34.356 16809 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:08:34 ctl02 glance-api[29183]: 2017-09-28 12:08:34.456 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:08:34] "OPTIONS / HTTP/1.0" 200 134 0.000586
Sep 28 12:08:34 ctl02 nova-api[16809]: 2017-09-28 12:08:34.583 16809 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:08:34 ctl02 nova-api[16809]: 2017-09-28 12:08:34.585 16809 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:08:34 ctl02 nova-api[16809]: 2017-09-28 12:08:34.585 16809 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:08:34 ctl02 nova-api[16809]: 2017-09-28 12:08:34.586 16809 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:08:34 ctl02 nova-api[16809]: 2017-09-28 12:08:34.716 16809 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:08:34 ctl02 nova-api[16809]: 2017-09-28 12:08:34.718 16809 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:08:34 ctl02 nova-api[16809]: 2017-09-28 12:08:34.719 16809 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:08:34 ctl02 nova-api[16809]: 2017-09-28 12:08:34.719 16809 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:08:34 ctl02 nova-api[16809]: 2017-09-28 12:08:34.722 16809 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:08:34 ctl02 nova-api[16809]: 2017-09-28 12:08:34.723 16809 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:08:34 ctl02 nova-api[16809]: 2017-09-28 12:08:34.723 16809 ERROR nova Traceback (most recent call last):
Sep 28 12:08:34 ctl02 nova-api[16809]: 2017-09-28 12:08:34.723 16809 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:08:34 ctl02 nova-api[16809]: 2017-09-28 12:08:34.723 16809 ERROR nova     sys.exit(main())
Sep 28 12:08:34 ctl02 nova-api[16809]: 2017-09-28 12:08:34.723 16809 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:08:34 ctl02 nova-api[16809]: 2017-09-28 12:08:34.723 16809 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:08:34 ctl02 nova-api[16809]: 2017-09-28 12:08:34.723 16809 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:08:34 ctl02 nova-api[16809]: 2017-09-28 12:08:34.723 16809 ERROR nova     max_url_len=max_url_len)
Sep 28 12:08:34 ctl02 nova-api[16809]: 2017-09-28 12:08:34.723 16809 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:08:34 ctl02 nova-api[16809]: 2017-09-28 12:08:34.723 16809 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:08:34 ctl02 nova-api[16809]: 2017-09-28 12:08:34.723 16809 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:08:34 ctl02 nova-api[16809]: 2017-09-28 12:08:34.723 16809 ERROR nova     sock.listen(backlog)
Sep 28 12:08:34 ctl02 nova-api[16809]: 2017-09-28 12:08:34.723 16809 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:08:34 ctl02 nova-api[16809]: 2017-09-28 12:08:34.723 16809 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:08:34 ctl02 nova-api[16809]: 2017-09-28 12:08:34.723 16809 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:08:34 ctl02 nova-api[16809]: 2017-09-28 12:08:34.723 16809 ERROR nova
Sep 28 12:08:34 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:08:34 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:08:34 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:08:35 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:08:35 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:08:35 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:08:35 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:08:35 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x64fc2b71)
Sep 28 12:08:35 ctl02 heat-api[13008]: 2017-09-28 12:08:35.325 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:08:35] "OPTIONS / HTTP/1.0" 200 134 0.000524
Sep 28 12:08:35 ctl02 salt-minion[14967]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 12:08:35 ctl02 salt-minion[14967]: [INFO    ] Made the following changes:
Sep 28 12:08:35 ctl02 salt-minion[14967]: 'python-redis' changed from 'absent' to '2.10.5-1ubuntu1'
Sep 28 12:08:35 ctl02 salt-minion[14967]: 'python-pymemcache' changed from 'absent' to '1.3.2-2ubuntu1'
Sep 28 12:08:35 ctl02 salt-minion[14967]: 'python-zake' changed from 'absent' to '0.1.6-1'
Sep 28 12:08:35 ctl02 salt-minion[14967]: 'python-cinder' changed from 'absent' to '2:8.1.1-0ubuntu3'
Sep 28 12:08:35 ctl02 salt-minion[14967]: 'python-suds' changed from 'absent' to '0.7~git20150727.94664dd-3'
Sep 28 12:08:35 ctl02 salt-minion[14967]: 'python-voluptuous' changed from 'absent' to '0.8.8-1ubuntu1'
Sep 28 12:08:35 ctl02 salt-minion[14967]: 'python-tooz' changed from 'absent' to '1.34.0-1ubuntu1'
Sep 28 12:08:35 ctl02 salt-minion[14967]: 'python-oslo.vmware' changed from 'absent' to '2.5.0-2'
Sep 28 12:08:35 ctl02 salt-minion[14967]: [INFO    ] Loading fresh modules for state activity
Sep 28 12:08:35 ctl02 salt-minion[14967]: [INFO    ] Completed state [python-cinder] at time 12:08:35.734309 duration_in_ms=132153.352
Sep 28 12:08:35 ctl02 salt-minion[14967]: [INFO    ] Running state [lvm2] at time 12:08:35.739271
Sep 28 12:08:35 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for lvm2
Sep 28 12:08:35 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemd-run', '--scope', 'apt-get', '-q', '-y', '-o', 'DPkg::Options::=--force-confold', '-o', 'DPkg::Options::=--force-confdef', 'install', 'lvm2'] in directory '/root'
Sep 28 12:08:35 ctl02 systemd[1]: Started /usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold -o DPkg::Options::=--force-confdef install lvm2.
Sep 28 12:08:36 ctl02 nova-cert[4860]: 2017-09-28 12:08:36.240 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:08:36 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x64fc2b71)
Sep 28 12:08:36 ctl02 heat-api[13008]: 2017-09-28 12:08:36.757 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:08:36] "OPTIONS / HTTP/1.0" 200 134 0.001262
Sep 28 12:08:36 ctl02 nova-api[16890]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:08:36 ctl02 nova-api[16890]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:08:37 ctl02 nova-api[16890]: 2017-09-28 12:08:37.000 16890 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:08:37 ctl02 nova-api[16890]: 2017-09-28 12:08:37.002 16890 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:08:37 ctl02 nova-api[16890]: 2017-09-28 12:08:37.002 16890 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:08:37 ctl02 nova-api[16890]: 2017-09-28 12:08:37.002 16890 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:08:37 ctl02 nova-api[16890]: 2017-09-28 12:08:37.002 16890 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:08:37 ctl02 nova-api[16890]: 2017-09-28 12:08:37.002 16890 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:08:37 ctl02 nova-api[16890]: 2017-09-28 12:08:37.002 16890 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:08:37 ctl02 nova-api[16890]: 2017-09-28 12:08:37.002 16890 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:08:37 ctl02 nova-api[16890]: 2017-09-28 12:08:37.002 16890 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:08:37 ctl02 nova-api[16890]: 2017-09-28 12:08:37.002 16890 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:08:37 ctl02 nova-api[16890]: 2017-09-28 12:08:37.002 16890 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:08:37 ctl02 nova-api[16890]: 2017-09-28 12:08:37.002 16890 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:08:37 ctl02 nova-api[16890]: 2017-09-28 12:08:37.002 16890 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:08:37 ctl02 nova-api[16890]: 2017-09-28 12:08:37.002 16890 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:08:37 ctl02 nova-api[16890]: 2017-09-28 12:08:37.002 16890 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:08:37 ctl02 nova-api[16890]: 2017-09-28 12:08:37.002 16890 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:08:37 ctl02 nova-api[16890]: 2017-09-28 12:08:37.002 16890 ERROR nova.wsgi     self.filename))
Sep 28 12:08:37 ctl02 nova-api[16890]: 2017-09-28 12:08:37.002 16890 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:08:37 ctl02 nova-api[16890]: 2017-09-28 12:08:37.002 16890 ERROR nova.wsgi
Sep 28 12:08:37 ctl02 nova-api[16890]: 2017-09-28 12:08:37.003 16890 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:08:37 ctl02 nova-api[16890]: 2017-09-28 12:08:37.133 16890 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:08:37 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x64fc2b71)
Sep 28 12:08:37 ctl02 nova-api[16890]: 2017-09-28 12:08:37.379 16890 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:08:37 ctl02 nova-api[16890]: 2017-09-28 12:08:37.381 16890 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:08:37 ctl02 nova-api[16890]: 2017-09-28 12:08:37.382 16890 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:08:37 ctl02 nova-api[16890]: 2017-09-28 12:08:37.382 16890 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:08:37 ctl02 nova-api[16890]: 2017-09-28 12:08:37.513 16890 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:08:37 ctl02 nova-api[16890]: 2017-09-28 12:08:37.515 16890 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:08:37 ctl02 nova-api[16890]: 2017-09-28 12:08:37.515 16890 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:08:37 ctl02 nova-api[16890]: 2017-09-28 12:08:37.515 16890 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:08:37 ctl02 nova-api[16890]: 2017-09-28 12:08:37.518 16890 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:08:37 ctl02 nova-api[16890]: 2017-09-28 12:08:37.519 16890 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:08:37 ctl02 nova-api[16890]: 2017-09-28 12:08:37.519 16890 ERROR nova Traceback (most recent call last):
Sep 28 12:08:37 ctl02 nova-api[16890]: 2017-09-28 12:08:37.519 16890 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:08:37 ctl02 nova-api[16890]: 2017-09-28 12:08:37.519 16890 ERROR nova     sys.exit(main())
Sep 28 12:08:37 ctl02 nova-api[16890]: 2017-09-28 12:08:37.519 16890 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:08:37 ctl02 nova-api[16890]: 2017-09-28 12:08:37.519 16890 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:08:37 ctl02 nova-api[16890]: 2017-09-28 12:08:37.519 16890 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:08:37 ctl02 nova-api[16890]: 2017-09-28 12:08:37.519 16890 ERROR nova     max_url_len=max_url_len)
Sep 28 12:08:37 ctl02 nova-api[16890]: 2017-09-28 12:08:37.519 16890 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:08:37 ctl02 nova-api[16890]: 2017-09-28 12:08:37.519 16890 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:08:37 ctl02 nova-api[16890]: 2017-09-28 12:08:37.519 16890 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:08:37 ctl02 nova-api[16890]: 2017-09-28 12:08:37.519 16890 ERROR nova     sock.listen(backlog)
Sep 28 12:08:37 ctl02 nova-api[16890]: 2017-09-28 12:08:37.519 16890 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:08:37 ctl02 nova-api[16890]: 2017-09-28 12:08:37.519 16890 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:08:37 ctl02 nova-api[16890]: 2017-09-28 12:08:37.519 16890 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:08:37 ctl02 nova-api[16890]: 2017-09-28 12:08:37.519 16890 ERROR nova
Sep 28 12:08:37 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:08:37 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:08:37 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:08:37 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:08:37 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:08:37 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:08:37 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:08:38 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x64fc2b71)
Sep 28 12:08:38 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:08:38.373 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:08:38] "OPTIONS / HTTP/1.0" 200 134 0.000414
Sep 28 12:08:38 ctl02 nova-conductor[5056]: 2017-09-28 12:08:38.377 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:08:38 ctl02 nova-conductor[5056]: 2017-09-28 12:08:38.391 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:08:38 ctl02 nova-conductor[5056]: 2017-09-28 12:08:38.399 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:08:38 ctl02 nova-conductor[5056]: 2017-09-28 12:08:38.402 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:08:38 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:08:38.525 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:08:38] "OPTIONS / HTTP/1.0" 200 134 0.000406
Sep 28 12:08:39 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x64fc2b71)
Sep 28 12:08:39 ctl02 nova-api[16966]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:08:39 ctl02 nova-api[16966]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:08:39 ctl02 nova-api[16966]: 2017-09-28 12:08:39.725 16966 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:08:39 ctl02 nova-api[16966]: 2017-09-28 12:08:39.727 16966 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:08:39 ctl02 nova-api[16966]: 2017-09-28 12:08:39.727 16966 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:08:39 ctl02 nova-api[16966]: 2017-09-28 12:08:39.727 16966 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:08:39 ctl02 nova-api[16966]: 2017-09-28 12:08:39.727 16966 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:08:39 ctl02 nova-api[16966]: 2017-09-28 12:08:39.727 16966 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:08:39 ctl02 nova-api[16966]: 2017-09-28 12:08:39.727 16966 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:08:39 ctl02 nova-api[16966]: 2017-09-28 12:08:39.727 16966 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:08:39 ctl02 nova-api[16966]: 2017-09-28 12:08:39.727 16966 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:08:39 ctl02 nova-api[16966]: 2017-09-28 12:08:39.727 16966 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:08:39 ctl02 nova-api[16966]: 2017-09-28 12:08:39.727 16966 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:08:39 ctl02 nova-api[16966]: 2017-09-28 12:08:39.727 16966 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:08:39 ctl02 nova-api[16966]: 2017-09-28 12:08:39.727 16966 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:08:39 ctl02 nova-api[16966]: 2017-09-28 12:08:39.727 16966 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:08:39 ctl02 nova-api[16966]: 2017-09-28 12:08:39.727 16966 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:08:39 ctl02 nova-api[16966]: 2017-09-28 12:08:39.727 16966 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:08:39 ctl02 nova-api[16966]: 2017-09-28 12:08:39.727 16966 ERROR nova.wsgi     self.filename))
Sep 28 12:08:39 ctl02 nova-api[16966]: 2017-09-28 12:08:39.727 16966 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:08:39 ctl02 nova-api[16966]: 2017-09-28 12:08:39.727 16966 ERROR nova.wsgi
Sep 28 12:08:39 ctl02 nova-api[16966]: 2017-09-28 12:08:39.728 16966 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:08:39 ctl02 systemd[1]: Reloading.
Sep 28 12:08:39 ctl02 nova-api[16966]: 2017-09-28 12:08:39.854 16966 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:08:40 ctl02 nova-api[16966]: 2017-09-28 12:08:40.072 16966 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:08:40 ctl02 nova-api[16966]: 2017-09-28 12:08:40.074 16966 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:08:40 ctl02 nova-api[16966]: 2017-09-28 12:08:40.074 16966 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:08:40 ctl02 nova-api[16966]: 2017-09-28 12:08:40.074 16966 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:08:40 ctl02 heat-api-cfn[13300]: 2017-09-28 12:08:40.152 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:08:40] "OPTIONS / HTTP/1.0" 200 134 0.000432
Sep 28 12:08:40 ctl02 nova-api[16966]: 2017-09-28 12:08:40.215 16966 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:08:40 ctl02 nova-api[16966]: 2017-09-28 12:08:40.217 16966 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:08:40 ctl02 nova-api[16966]: 2017-09-28 12:08:40.217 16966 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:08:40 ctl02 nova-api[16966]: 2017-09-28 12:08:40.217 16966 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:08:40 ctl02 nova-api[16966]: 2017-09-28 12:08:40.220 16966 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:08:40 ctl02 nova-api[16966]: 2017-09-28 12:08:40.221 16966 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:08:40 ctl02 nova-api[16966]: 2017-09-28 12:08:40.221 16966 ERROR nova Traceback (most recent call last):
Sep 28 12:08:40 ctl02 nova-api[16966]: 2017-09-28 12:08:40.221 16966 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:08:40 ctl02 nova-api[16966]: 2017-09-28 12:08:40.221 16966 ERROR nova     sys.exit(main())
Sep 28 12:08:40 ctl02 nova-api[16966]: 2017-09-28 12:08:40.221 16966 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:08:40 ctl02 nova-api[16966]: 2017-09-28 12:08:40.221 16966 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:08:40 ctl02 nova-api[16966]: 2017-09-28 12:08:40.221 16966 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:08:40 ctl02 nova-api[16966]: 2017-09-28 12:08:40.221 16966 ERROR nova     max_url_len=max_url_len)
Sep 28 12:08:40 ctl02 nova-api[16966]: 2017-09-28 12:08:40.221 16966 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:08:40 ctl02 nova-api[16966]: 2017-09-28 12:08:40.221 16966 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:08:40 ctl02 nova-api[16966]: 2017-09-28 12:08:40.221 16966 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:08:40 ctl02 nova-api[16966]: 2017-09-28 12:08:40.221 16966 ERROR nova     sock.listen(backlog)
Sep 28 12:08:40 ctl02 nova-api[16966]: 2017-09-28 12:08:40.221 16966 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:08:40 ctl02 nova-api[16966]: 2017-09-28 12:08:40.221 16966 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:08:40 ctl02 nova-api[16966]: 2017-09-28 12:08:40.221 16966 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:08:40 ctl02 nova-api[16966]: 2017-09-28 12:08:40.221 16966 ERROR nova
Sep 28 12:08:40 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x64fc2b71)
Sep 28 12:08:40 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:08:40 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:08:40 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:08:40 ctl02 heat-api-cfn[13300]: 2017-09-28 12:08:40.515 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:08:40] "OPTIONS / HTTP/1.0" 200 134 0.000495
Sep 28 12:08:40 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:08:40 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:08:40 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:08:40 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:08:40 ctl02 systemd[1]: Reloading.
Sep 28 12:08:40 ctl02 systemd[1]: Reloading.
Sep 28 12:08:40 ctl02 systemd[1]: Listening on Device-mapper event daemon FIFOs.
Sep 28 12:08:41 ctl02 glance-api[29183]: 2017-09-28 12:08:41.026 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:08:41] "OPTIONS / HTTP/1.0" 200 134 0.000584
Sep 28 12:08:41 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x64fc2b71)
Sep 28 12:08:41 ctl02 systemd[1]: Reloading.
Sep 28 12:08:41 ctl02 systemd[1]: message repeated 6 times: [ Reloading.]
Sep 28 12:08:41 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:08:41.895 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:08:41] "OPTIONS / HTTP/1.0" 200 134 0.001475
Sep 28 12:08:42 ctl02 systemd[1]: Reloading.
Sep 28 12:08:42 ctl02 heat-api[13008]: 2017-09-28 12:08:42.310 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:08:42] "OPTIONS / HTTP/1.0" 200 134 0.000523
Sep 28 12:08:42 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x64fc2b71)
Sep 28 12:08:42 ctl02 nova-api[17059]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:08:42 ctl02 nova-api[17059]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:08:42 ctl02 nova-api[17059]: 2017-09-28 12:08:42.529 17059 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:08:42 ctl02 nova-api[17059]: 2017-09-28 12:08:42.531 17059 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:08:42 ctl02 nova-api[17059]: 2017-09-28 12:08:42.531 17059 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:08:42 ctl02 nova-api[17059]: 2017-09-28 12:08:42.531 17059 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:08:42 ctl02 nova-api[17059]: 2017-09-28 12:08:42.531 17059 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:08:42 ctl02 nova-api[17059]: 2017-09-28 12:08:42.531 17059 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:08:42 ctl02 nova-api[17059]: 2017-09-28 12:08:42.531 17059 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:08:42 ctl02 nova-api[17059]: 2017-09-28 12:08:42.531 17059 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:08:42 ctl02 nova-api[17059]: 2017-09-28 12:08:42.531 17059 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:08:42 ctl02 nova-api[17059]: 2017-09-28 12:08:42.531 17059 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:08:42 ctl02 nova-api[17059]: 2017-09-28 12:08:42.531 17059 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:08:42 ctl02 nova-api[17059]: 2017-09-28 12:08:42.531 17059 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:08:42 ctl02 nova-api[17059]: 2017-09-28 12:08:42.531 17059 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:08:42 ctl02 nova-api[17059]: 2017-09-28 12:08:42.531 17059 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:08:42 ctl02 nova-api[17059]: 2017-09-28 12:08:42.531 17059 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:08:42 ctl02 nova-api[17059]: 2017-09-28 12:08:42.531 17059 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:08:42 ctl02 nova-api[17059]: 2017-09-28 12:08:42.531 17059 ERROR nova.wsgi     self.filename))
Sep 28 12:08:42 ctl02 nova-api[17059]: 2017-09-28 12:08:42.531 17059 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:08:42 ctl02 nova-api[17059]: 2017-09-28 12:08:42.531 17059 ERROR nova.wsgi
Sep 28 12:08:42 ctl02 nova-api[17059]: 2017-09-28 12:08:42.533 17059 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:08:42 ctl02 nova-api[17059]: 2017-09-28 12:08:42.669 17059 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:08:42 ctl02 nova-api[17059]: 2017-09-28 12:08:42.887 17059 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:08:42 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928120842879935
Sep 28 12:08:42 ctl02 nova-api[17059]: 2017-09-28 12:08:42.889 17059 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:08:42 ctl02 nova-api[17059]: 2017-09-28 12:08:42.889 17059 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:08:42 ctl02 nova-api[17059]: 2017-09-28 12:08:42.889 17059 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:08:42 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 18266
Sep 28 12:08:42 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928120842879935
Sep 28 12:08:43 ctl02 nova-api[17059]: 2017-09-28 12:08:43.022 17059 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:08:43 ctl02 nova-api[17059]: 2017-09-28 12:08:43.024 17059 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:08:43 ctl02 nova-api[17059]: 2017-09-28 12:08:43.024 17059 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:08:43 ctl02 nova-api[17059]: 2017-09-28 12:08:43.025 17059 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:08:43 ctl02 nova-api[17059]: 2017-09-28 12:08:43.028 17059 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:08:43 ctl02 nova-api[17059]: 2017-09-28 12:08:43.028 17059 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:08:43 ctl02 nova-api[17059]: 2017-09-28 12:08:43.028 17059 ERROR nova Traceback (most recent call last):
Sep 28 12:08:43 ctl02 nova-api[17059]: 2017-09-28 12:08:43.028 17059 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:08:43 ctl02 nova-api[17059]: 2017-09-28 12:08:43.028 17059 ERROR nova     sys.exit(main())
Sep 28 12:08:43 ctl02 nova-api[17059]: 2017-09-28 12:08:43.028 17059 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:08:43 ctl02 nova-api[17059]: 2017-09-28 12:08:43.028 17059 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:08:43 ctl02 nova-api[17059]: 2017-09-28 12:08:43.028 17059 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:08:43 ctl02 nova-api[17059]: 2017-09-28 12:08:43.028 17059 ERROR nova     max_url_len=max_url_len)
Sep 28 12:08:43 ctl02 nova-api[17059]: 2017-09-28 12:08:43.028 17059 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:08:43 ctl02 nova-api[17059]: 2017-09-28 12:08:43.028 17059 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:08:43 ctl02 nova-api[17059]: 2017-09-28 12:08:43.028 17059 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:08:43 ctl02 nova-api[17059]: 2017-09-28 12:08:43.028 17059 ERROR nova     sock.listen(backlog)
Sep 28 12:08:43 ctl02 nova-api[17059]: 2017-09-28 12:08:43.028 17059 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:08:43 ctl02 nova-api[17059]: 2017-09-28 12:08:43.028 17059 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:08:43 ctl02 nova-api[17059]: 2017-09-28 12:08:43.028 17059 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:08:43 ctl02 nova-api[17059]: 2017-09-28 12:08:43.028 17059 ERROR nova
Sep 28 12:08:43 ctl02 heat-api-cfn[13300]: 2017-09-28 12:08:43.094 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:08:43] "OPTIONS / HTTP/1.0" 200 134 0.000460
Sep 28 12:08:43 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:08:43 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:08:43 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:08:43 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x64fc2b71)
Sep 28 12:08:43 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:08:43 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:08:43 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:08:43 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:08:44 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:08:44 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:08:44 ctl02 glance-api[29183]: 2017-09-28 12:08:44.474 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:08:44] "OPTIONS / HTTP/1.0" 200 134 0.000525
Sep 28 12:08:44 ctl02 glance-api[29183]: 2017-09-28 12:08:44.724 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:08:44] "OPTIONS / HTTP/1.0" 200 134 0.000419
Sep 28 12:08:45 ctl02 nova-api[18982]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:08:45 ctl02 nova-api[18982]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:08:45 ctl02 nova-api[18982]: 2017-09-28 12:08:45.186 18982 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:08:45 ctl02 nova-api[18982]: 2017-09-28 12:08:45.188 18982 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:08:45 ctl02 nova-api[18982]: 2017-09-28 12:08:45.188 18982 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:08:45 ctl02 nova-api[18982]: 2017-09-28 12:08:45.188 18982 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:08:45 ctl02 nova-api[18982]: 2017-09-28 12:08:45.188 18982 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:08:45 ctl02 nova-api[18982]: 2017-09-28 12:08:45.188 18982 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:08:45 ctl02 nova-api[18982]: 2017-09-28 12:08:45.188 18982 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:08:45 ctl02 nova-api[18982]: 2017-09-28 12:08:45.188 18982 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:08:45 ctl02 nova-api[18982]: 2017-09-28 12:08:45.188 18982 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:08:45 ctl02 nova-api[18982]: 2017-09-28 12:08:45.188 18982 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:08:45 ctl02 nova-api[18982]: 2017-09-28 12:08:45.188 18982 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:08:45 ctl02 nova-api[18982]: 2017-09-28 12:08:45.188 18982 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:08:45 ctl02 nova-api[18982]: 2017-09-28 12:08:45.188 18982 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:08:45 ctl02 nova-api[18982]: 2017-09-28 12:08:45.188 18982 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:08:45 ctl02 nova-api[18982]: 2017-09-28 12:08:45.188 18982 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:08:45 ctl02 nova-api[18982]: 2017-09-28 12:08:45.188 18982 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:08:45 ctl02 nova-api[18982]: 2017-09-28 12:08:45.188 18982 ERROR nova.wsgi     self.filename))
Sep 28 12:08:45 ctl02 nova-api[18982]: 2017-09-28 12:08:45.188 18982 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:08:45 ctl02 nova-api[18982]: 2017-09-28 12:08:45.188 18982 ERROR nova.wsgi
Sep 28 12:08:45 ctl02 nova-api[18982]: 2017-09-28 12:08:45.189 18982 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:08:45 ctl02 nova-api[18982]: 2017-09-28 12:08:45.313 18982 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:08:45 ctl02 heat-api[13008]: 2017-09-28 12:08:45.335 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:08:45] "OPTIONS / HTTP/1.0" 200 134 0.000506
Sep 28 12:08:45 ctl02 nova-api[18982]: 2017-09-28 12:08:45.531 18982 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:08:45 ctl02 nova-api[18982]: 2017-09-28 12:08:45.533 18982 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:08:45 ctl02 nova-api[18982]: 2017-09-28 12:08:45.534 18982 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:08:45 ctl02 nova-api[18982]: 2017-09-28 12:08:45.534 18982 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:08:45 ctl02 nova-api[18982]: 2017-09-28 12:08:45.661 18982 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:08:45 ctl02 nova-api[18982]: 2017-09-28 12:08:45.663 18982 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:08:45 ctl02 nova-api[18982]: 2017-09-28 12:08:45.663 18982 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:08:45 ctl02 nova-api[18982]: 2017-09-28 12:08:45.664 18982 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:08:45 ctl02 nova-api[18982]: 2017-09-28 12:08:45.667 18982 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:08:45 ctl02 nova-api[18982]: 2017-09-28 12:08:45.667 18982 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:08:45 ctl02 nova-api[18982]: 2017-09-28 12:08:45.667 18982 ERROR nova Traceback (most recent call last):
Sep 28 12:08:45 ctl02 nova-api[18982]: 2017-09-28 12:08:45.667 18982 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:08:45 ctl02 nova-api[18982]: 2017-09-28 12:08:45.667 18982 ERROR nova     sys.exit(main())
Sep 28 12:08:45 ctl02 nova-api[18982]: 2017-09-28 12:08:45.667 18982 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:08:45 ctl02 nova-api[18982]: 2017-09-28 12:08:45.667 18982 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:08:45 ctl02 nova-api[18982]: 2017-09-28 12:08:45.667 18982 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:08:45 ctl02 nova-api[18982]: 2017-09-28 12:08:45.667 18982 ERROR nova     max_url_len=max_url_len)
Sep 28 12:08:45 ctl02 nova-api[18982]: 2017-09-28 12:08:45.667 18982 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:08:45 ctl02 nova-api[18982]: 2017-09-28 12:08:45.667 18982 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:08:45 ctl02 nova-api[18982]: 2017-09-28 12:08:45.667 18982 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:08:45 ctl02 nova-api[18982]: 2017-09-28 12:08:45.667 18982 ERROR nova     sock.listen(backlog)
Sep 28 12:08:45 ctl02 nova-api[18982]: 2017-09-28 12:08:45.667 18982 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:08:45 ctl02 nova-api[18982]: 2017-09-28 12:08:45.667 18982 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:08:45 ctl02 nova-api[18982]: 2017-09-28 12:08:45.667 18982 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:08:45 ctl02 nova-api[18982]: 2017-09-28 12:08:45.667 18982 ERROR nova
Sep 28 12:08:45 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:08:45 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:08:45 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:08:46 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:08:46 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:08:46 ctl02 nova-consoleauth[5433]: 2017-09-28 12:08:46.134 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:08:46 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:08:46 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:08:46 ctl02 heat-api[13008]: 2017-09-28 12:08:46.535 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:08:46] "OPTIONS / HTTP/1.0" 200 134 0.000552
Sep 28 12:08:47 ctl02 nova-api[22409]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:08:47 ctl02 nova-api[22409]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:08:47 ctl02 nova-api[22409]: 2017-09-28 12:08:47.957 22409 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:08:47 ctl02 nova-api[22409]: 2017-09-28 12:08:47.959 22409 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:08:47 ctl02 nova-api[22409]: 2017-09-28 12:08:47.959 22409 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:08:47 ctl02 nova-api[22409]: 2017-09-28 12:08:47.959 22409 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:08:47 ctl02 nova-api[22409]: 2017-09-28 12:08:47.959 22409 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:08:47 ctl02 nova-api[22409]: 2017-09-28 12:08:47.959 22409 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:08:47 ctl02 nova-api[22409]: 2017-09-28 12:08:47.959 22409 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:08:47 ctl02 nova-api[22409]: 2017-09-28 12:08:47.959 22409 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:08:47 ctl02 nova-api[22409]: 2017-09-28 12:08:47.959 22409 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:08:47 ctl02 nova-api[22409]: 2017-09-28 12:08:47.959 22409 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:08:47 ctl02 nova-api[22409]: 2017-09-28 12:08:47.959 22409 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:08:47 ctl02 nova-api[22409]: 2017-09-28 12:08:47.959 22409 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:08:47 ctl02 nova-api[22409]: 2017-09-28 12:08:47.959 22409 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:08:47 ctl02 nova-api[22409]: 2017-09-28 12:08:47.959 22409 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:08:47 ctl02 nova-api[22409]: 2017-09-28 12:08:47.959 22409 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:08:47 ctl02 nova-api[22409]: 2017-09-28 12:08:47.959 22409 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:08:47 ctl02 nova-api[22409]: 2017-09-28 12:08:47.959 22409 ERROR nova.wsgi     self.filename))
Sep 28 12:08:47 ctl02 nova-api[22409]: 2017-09-28 12:08:47.959 22409 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:08:47 ctl02 nova-api[22409]: 2017-09-28 12:08:47.959 22409 ERROR nova.wsgi
Sep 28 12:08:47 ctl02 nova-api[22409]: 2017-09-28 12:08:47.961 22409 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:08:48 ctl02 nova-api[22409]: 2017-09-28 12:08:48.096 22409 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:08:48 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:08:48.194 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:08:48] "OPTIONS / HTTP/1.0" 200 134 0.000435
Sep 28 12:08:48 ctl02 nova-api[22409]: 2017-09-28 12:08:48.311 22409 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:08:48 ctl02 nova-api[22409]: 2017-09-28 12:08:48.313 22409 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:08:48 ctl02 nova-api[22409]: 2017-09-28 12:08:48.313 22409 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:08:48 ctl02 nova-api[22409]: 2017-09-28 12:08:48.313 22409 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:08:48 ctl02 nova-api[22409]: 2017-09-28 12:08:48.445 22409 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:08:48 ctl02 nova-api[22409]: 2017-09-28 12:08:48.447 22409 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:08:48 ctl02 nova-api[22409]: 2017-09-28 12:08:48.447 22409 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:08:48 ctl02 nova-api[22409]: 2017-09-28 12:08:48.447 22409 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:08:48 ctl02 nova-api[22409]: 2017-09-28 12:08:48.450 22409 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:08:48 ctl02 nova-api[22409]: 2017-09-28 12:08:48.450 22409 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:08:48 ctl02 nova-api[22409]: 2017-09-28 12:08:48.450 22409 ERROR nova Traceback (most recent call last):
Sep 28 12:08:48 ctl02 nova-api[22409]: 2017-09-28 12:08:48.450 22409 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:08:48 ctl02 nova-api[22409]: 2017-09-28 12:08:48.450 22409 ERROR nova     sys.exit(main())
Sep 28 12:08:48 ctl02 nova-api[22409]: 2017-09-28 12:08:48.450 22409 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:08:48 ctl02 nova-api[22409]: 2017-09-28 12:08:48.450 22409 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:08:48 ctl02 nova-api[22409]: 2017-09-28 12:08:48.450 22409 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:08:48 ctl02 nova-api[22409]: 2017-09-28 12:08:48.450 22409 ERROR nova     max_url_len=max_url_len)
Sep 28 12:08:48 ctl02 nova-api[22409]: 2017-09-28 12:08:48.450 22409 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:08:48 ctl02 nova-api[22409]: 2017-09-28 12:08:48.450 22409 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:08:48 ctl02 nova-api[22409]: 2017-09-28 12:08:48.450 22409 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:08:48 ctl02 nova-api[22409]: 2017-09-28 12:08:48.450 22409 ERROR nova     sock.listen(backlog)
Sep 28 12:08:48 ctl02 nova-api[22409]: 2017-09-28 12:08:48.450 22409 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:08:48 ctl02 nova-api[22409]: 2017-09-28 12:08:48.450 22409 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:08:48 ctl02 nova-api[22409]: 2017-09-28 12:08:48.450 22409 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:08:48 ctl02 nova-api[22409]: 2017-09-28 12:08:48.450 22409 ERROR nova
Sep 28 12:08:48 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:08:48 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:08:48 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:08:48 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:08:48.618 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:08:48] "OPTIONS / HTTP/1.0" 200 134 0.000452
Sep 28 12:08:48 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:08:48 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:08:48 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:08:48 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:08:49 ctl02 nova-scheduler[5620]: 2017-09-28 12:08:49.155 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:08:49 ctl02 heat-engine[12803]: 2017-09-28 12:08:49.443 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:08:49 ctl02 heat-engine[12803]: 2017-09-28 12:08:49.470 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:08:49 ctl02 heat-engine[12803]: 2017-09-28 12:08:49.489 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:08:49 ctl02 heat-engine[12803]: 2017-09-28 12:08:49.498 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:08:50 ctl02 heat-api-cfn[13300]: 2017-09-28 12:08:50.499 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:08:50] "OPTIONS / HTTP/1.0" 200 134 0.000498
Sep 28 12:08:50 ctl02 nova-api[22427]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:08:50 ctl02 nova-api[22427]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:08:50 ctl02 glance-api[29183]: 2017-09-28 12:08:50.658 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:08:50] "OPTIONS / HTTP/1.0" 200 134 0.000621
Sep 28 12:08:50 ctl02 heat-api-cfn[13300]: 2017-09-28 12:08:50.513 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:08:50] "OPTIONS / HTTP/1.0" 200 134 0.000288
Sep 28 12:08:50 ctl02 nova-api[22427]: 2017-09-28 12:08:50.738 22427 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:08:50 ctl02 nova-api[22427]: 2017-09-28 12:08:50.739 22427 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:08:50 ctl02 nova-api[22427]: 2017-09-28 12:08:50.739 22427 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:08:50 ctl02 nova-api[22427]: 2017-09-28 12:08:50.739 22427 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:08:50 ctl02 nova-api[22427]: 2017-09-28 12:08:50.739 22427 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:08:50 ctl02 nova-api[22427]: 2017-09-28 12:08:50.739 22427 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:08:50 ctl02 nova-api[22427]: 2017-09-28 12:08:50.739 22427 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:08:50 ctl02 nova-api[22427]: 2017-09-28 12:08:50.739 22427 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:08:50 ctl02 nova-api[22427]: 2017-09-28 12:08:50.739 22427 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:08:50 ctl02 nova-api[22427]: 2017-09-28 12:08:50.739 22427 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:08:50 ctl02 nova-api[22427]: 2017-09-28 12:08:50.739 22427 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:08:50 ctl02 nova-api[22427]: 2017-09-28 12:08:50.739 22427 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:08:50 ctl02 nova-api[22427]: 2017-09-28 12:08:50.739 22427 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:08:50 ctl02 nova-api[22427]: 2017-09-28 12:08:50.739 22427 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:08:50 ctl02 nova-api[22427]: 2017-09-28 12:08:50.739 22427 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:08:50 ctl02 nova-api[22427]: 2017-09-28 12:08:50.739 22427 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:08:50 ctl02 nova-api[22427]: 2017-09-28 12:08:50.739 22427 ERROR nova.wsgi     self.filename))
Sep 28 12:08:50 ctl02 nova-api[22427]: 2017-09-28 12:08:50.739 22427 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:08:50 ctl02 nova-api[22427]: 2017-09-28 12:08:50.739 22427 ERROR nova.wsgi
Sep 28 12:08:50 ctl02 nova-api[22427]: 2017-09-28 12:08:50.740 22427 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:08:50 ctl02 nova-api[22427]: 2017-09-28 12:08:50.868 22427 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:08:51 ctl02 nova-api[22427]: 2017-09-28 12:08:51.095 22427 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:08:51 ctl02 nova-api[22427]: 2017-09-28 12:08:51.098 22427 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:08:51 ctl02 nova-api[22427]: 2017-09-28 12:08:51.098 22427 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:08:51 ctl02 nova-api[22427]: 2017-09-28 12:08:51.098 22427 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:08:51 ctl02 systemd[1]: Reloading.
Sep 28 12:08:51 ctl02 nova-api[22427]: 2017-09-28 12:08:51.228 22427 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:08:51 ctl02 nova-api[22427]: 2017-09-28 12:08:51.229 22427 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:08:51 ctl02 nova-api[22427]: 2017-09-28 12:08:51.230 22427 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:08:51 ctl02 nova-api[22427]: 2017-09-28 12:08:51.230 22427 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:08:51 ctl02 nova-api[22427]: 2017-09-28 12:08:51.233 22427 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:08:51 ctl02 nova-api[22427]: 2017-09-28 12:08:51.233 22427 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:08:51 ctl02 nova-api[22427]: 2017-09-28 12:08:51.233 22427 ERROR nova Traceback (most recent call last):
Sep 28 12:08:51 ctl02 nova-api[22427]: 2017-09-28 12:08:51.233 22427 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:08:51 ctl02 nova-api[22427]: 2017-09-28 12:08:51.233 22427 ERROR nova     sys.exit(main())
Sep 28 12:08:51 ctl02 nova-api[22427]: 2017-09-28 12:08:51.233 22427 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:08:51 ctl02 nova-api[22427]: 2017-09-28 12:08:51.233 22427 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:08:51 ctl02 nova-api[22427]: 2017-09-28 12:08:51.233 22427 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:08:51 ctl02 nova-api[22427]: 2017-09-28 12:08:51.233 22427 ERROR nova     max_url_len=max_url_len)
Sep 28 12:08:51 ctl02 nova-api[22427]: 2017-09-28 12:08:51.233 22427 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:08:51 ctl02 nova-api[22427]: 2017-09-28 12:08:51.233 22427 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:08:51 ctl02 nova-api[22427]: 2017-09-28 12:08:51.233 22427 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:08:51 ctl02 nova-api[22427]: 2017-09-28 12:08:51.233 22427 ERROR nova     sock.listen(backlog)
Sep 28 12:08:51 ctl02 nova-api[22427]: 2017-09-28 12:08:51.233 22427 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:08:51 ctl02 nova-api[22427]: 2017-09-28 12:08:51.233 22427 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:08:51 ctl02 nova-api[22427]: 2017-09-28 12:08:51.233 22427 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:08:51 ctl02 nova-api[22427]: 2017-09-28 12:08:51.233 22427 ERROR nova
Sep 28 12:08:51 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:08:51 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:08:51 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:08:51 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:08:51.622 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:08:51] "OPTIONS / HTTP/1.0" 200 134 0.000450
Sep 28 12:08:51 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:08:51 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:08:51 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:08:51 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:08:51 ctl02 salt-minion[14967]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 12:08:51 ctl02 salt-minion[14967]: [INFO    ] Made the following changes:
Sep 28 12:08:51 ctl02 salt-minion[14967]: 'libreadline5' changed from 'absent' to '5.2+dfsg-3build1'
Sep 28 12:08:51 ctl02 salt-minion[14967]: 'dmsetup' changed from 'absent' to '2:1.02.110-1ubuntu10'
Sep 28 12:08:51 ctl02 salt-minion[14967]: 'dmeventd' changed from 'absent' to '2:1.02.110-1ubuntu10'
Sep 28 12:08:51 ctl02 salt-minion[14967]: 'liblvm2cmd2.02' changed from 'absent' to '2.02.133-1ubuntu10'
Sep 28 12:08:51 ctl02 salt-minion[14967]: 'lvm2' changed from 'absent' to '2.02.133-1ubuntu10'
Sep 28 12:08:51 ctl02 salt-minion[14967]: [INFO    ] Loading fresh modules for state activity
Sep 28 12:08:51 ctl02 salt-minion[14967]: [INFO    ] Completed state [lvm2] at time 12:08:51.728044 duration_in_ms=15988.772
Sep 28 12:08:51 ctl02 salt-minion[14967]: [INFO    ] Running state [cinder-api] at time 12:08:51.733538
Sep 28 12:08:51 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for cinder-api
Sep 28 12:08:51 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemd-run', '--scope', 'apt-get', '-q', '-y', '-o', 'DPkg::Options::=--force-confold', '-o', 'DPkg::Options::=--force-confdef', 'install', 'cinder-api'] in directory '/root'
Sep 28 12:08:52 ctl02 systemd[1]: Started /usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold -o DPkg::Options::=--force-confdef install cinder-api.
Sep 28 12:08:52 ctl02 heat-api[13008]: 2017-09-28 12:08:52.524 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:08:52] "OPTIONS / HTTP/1.0" 200 134 0.000556
Sep 28 12:08:52 ctl02 heat-api-cfn[13300]: 2017-09-28 12:08:52.910 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:08:52] "OPTIONS / HTTP/1.0" 200 134 0.000533
Sep 28 12:08:53 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928120853062629
Sep 28 12:08:53 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 22545
Sep 28 12:08:53 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928120853062629
Sep 28 12:08:53 ctl02 nova-api[22479]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:08:53 ctl02 nova-api[22479]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:08:53 ctl02 nova-api[22479]: 2017-09-28 12:08:53.492 22479 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:08:53 ctl02 nova-api[22479]: 2017-09-28 12:08:53.494 22479 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:08:53 ctl02 nova-api[22479]: 2017-09-28 12:08:53.494 22479 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:08:53 ctl02 nova-api[22479]: 2017-09-28 12:08:53.494 22479 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:08:53 ctl02 nova-api[22479]: 2017-09-28 12:08:53.494 22479 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:08:53 ctl02 nova-api[22479]: 2017-09-28 12:08:53.494 22479 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:08:53 ctl02 nova-api[22479]: 2017-09-28 12:08:53.494 22479 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:08:53 ctl02 nova-api[22479]: 2017-09-28 12:08:53.494 22479 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:08:53 ctl02 nova-api[22479]: 2017-09-28 12:08:53.494 22479 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:08:53 ctl02 nova-api[22479]: 2017-09-28 12:08:53.494 22479 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:08:53 ctl02 nova-api[22479]: 2017-09-28 12:08:53.494 22479 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:08:53 ctl02 nova-api[22479]: 2017-09-28 12:08:53.494 22479 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:08:53 ctl02 nova-api[22479]: 2017-09-28 12:08:53.494 22479 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:08:53 ctl02 nova-api[22479]: 2017-09-28 12:08:53.494 22479 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:08:53 ctl02 nova-api[22479]: 2017-09-28 12:08:53.494 22479 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:08:53 ctl02 nova-api[22479]: 2017-09-28 12:08:53.494 22479 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:08:53 ctl02 nova-api[22479]: 2017-09-28 12:08:53.494 22479 ERROR nova.wsgi     self.filename))
Sep 28 12:08:53 ctl02 nova-api[22479]: 2017-09-28 12:08:53.494 22479 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:08:53 ctl02 nova-api[22479]: 2017-09-28 12:08:53.494 22479 ERROR nova.wsgi
Sep 28 12:08:53 ctl02 nova-api[22479]: 2017-09-28 12:08:53.494 22479 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:08:53 ctl02 nova-api[22479]: 2017-09-28 12:08:53.623 22479 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:08:53 ctl02 systemd[1]: Reloading.
Sep 28 12:08:53 ctl02 nova-api[22479]: 2017-09-28 12:08:53.863 22479 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:08:53 ctl02 nova-api[22479]: 2017-09-28 12:08:53.866 22479 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:08:53 ctl02 nova-api[22479]: 2017-09-28 12:08:53.866 22479 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:08:53 ctl02 nova-api[22479]: 2017-09-28 12:08:53.866 22479 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:08:54 ctl02 nova-api[22479]: 2017-09-28 12:08:54.002 22479 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:08:54 ctl02 nova-api[22479]: 2017-09-28 12:08:54.004 22479 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:08:54 ctl02 nova-api[22479]: 2017-09-28 12:08:54.004 22479 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:08:54 ctl02 nova-api[22479]: 2017-09-28 12:08:54.005 22479 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:08:54 ctl02 nova-api[22479]: 2017-09-28 12:08:54.008 22479 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:08:54 ctl02 nova-api[22479]: 2017-09-28 12:08:54.008 22479 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:08:54 ctl02 nova-api[22479]: 2017-09-28 12:08:54.008 22479 ERROR nova Traceback (most recent call last):
Sep 28 12:08:54 ctl02 nova-api[22479]: 2017-09-28 12:08:54.008 22479 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:08:54 ctl02 nova-api[22479]: 2017-09-28 12:08:54.008 22479 ERROR nova     sys.exit(main())
Sep 28 12:08:54 ctl02 nova-api[22479]: 2017-09-28 12:08:54.008 22479 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:08:54 ctl02 nova-api[22479]: 2017-09-28 12:08:54.008 22479 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:08:54 ctl02 nova-api[22479]: 2017-09-28 12:08:54.008 22479 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:08:54 ctl02 nova-api[22479]: 2017-09-28 12:08:54.008 22479 ERROR nova     max_url_len=max_url_len)
Sep 28 12:08:54 ctl02 nova-api[22479]: 2017-09-28 12:08:54.008 22479 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:08:54 ctl02 nova-api[22479]: 2017-09-28 12:08:54.008 22479 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:08:54 ctl02 nova-api[22479]: 2017-09-28 12:08:54.008 22479 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:08:54 ctl02 nova-api[22479]: 2017-09-28 12:08:54.008 22479 ERROR nova     sock.listen(backlog)
Sep 28 12:08:54 ctl02 nova-api[22479]: 2017-09-28 12:08:54.008 22479 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:08:54 ctl02 nova-api[22479]: 2017-09-28 12:08:54.008 22479 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:08:54 ctl02 nova-api[22479]: 2017-09-28 12:08:54.008 22479 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:08:54 ctl02 nova-api[22479]: 2017-09-28 12:08:54.008 22479 ERROR nova
Sep 28 12:08:54 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:08:54 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:08:54 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:08:54 ctl02 glance-api[29183]: 2017-09-28 12:08:54.238 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:08:54] "OPTIONS / HTTP/1.0" 200 134 0.000599
Sep 28 12:08:54 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:08:54 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:08:54 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:08:54 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:08:54 ctl02 glance-api[29183]: 2017-09-28 12:08:54.888 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:08:54] "OPTIONS / HTTP/1.0" 200 134 0.000572
Sep 28 12:08:55 ctl02 heat-api[13008]: 2017-09-28 12:08:55.326 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:08:55] "OPTIONS / HTTP/1.0" 200 134 0.000558
Sep 28 12:08:56 ctl02 nova-api[22592]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:08:56 ctl02 nova-api[22592]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:08:56 ctl02 nova-api[22592]: 2017-09-28 12:08:56.177 22592 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:08:56 ctl02 nova-api[22592]: 2017-09-28 12:08:56.179 22592 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:08:56 ctl02 nova-api[22592]: 2017-09-28 12:08:56.179 22592 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:08:56 ctl02 nova-api[22592]: 2017-09-28 12:08:56.179 22592 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:08:56 ctl02 nova-api[22592]: 2017-09-28 12:08:56.179 22592 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:08:56 ctl02 nova-api[22592]: 2017-09-28 12:08:56.179 22592 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:08:56 ctl02 nova-api[22592]: 2017-09-28 12:08:56.179 22592 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:08:56 ctl02 nova-api[22592]: 2017-09-28 12:08:56.179 22592 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:08:56 ctl02 nova-api[22592]: 2017-09-28 12:08:56.179 22592 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:08:56 ctl02 nova-api[22592]: 2017-09-28 12:08:56.179 22592 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:08:56 ctl02 nova-api[22592]: 2017-09-28 12:08:56.179 22592 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:08:56 ctl02 nova-api[22592]: 2017-09-28 12:08:56.179 22592 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:08:56 ctl02 nova-api[22592]: 2017-09-28 12:08:56.179 22592 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:08:56 ctl02 nova-api[22592]: 2017-09-28 12:08:56.179 22592 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:08:56 ctl02 nova-api[22592]: 2017-09-28 12:08:56.179 22592 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:08:56 ctl02 nova-api[22592]: 2017-09-28 12:08:56.179 22592 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:08:56 ctl02 nova-api[22592]: 2017-09-28 12:08:56.179 22592 ERROR nova.wsgi     self.filename))
Sep 28 12:08:56 ctl02 nova-api[22592]: 2017-09-28 12:08:56.179 22592 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:08:56 ctl02 nova-api[22592]: 2017-09-28 12:08:56.179 22592 ERROR nova.wsgi
Sep 28 12:08:56 ctl02 nova-api[22592]: 2017-09-28 12:08:56.180 22592 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:08:56 ctl02 nova-api[22592]: 2017-09-28 12:08:56.308 22592 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:08:56 ctl02 nova-api[22592]: 2017-09-28 12:08:56.534 22592 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:08:56 ctl02 nova-api[22592]: 2017-09-28 12:08:56.536 22592 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:08:56 ctl02 nova-api[22592]: 2017-09-28 12:08:56.536 22592 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:08:56 ctl02 nova-api[22592]: 2017-09-28 12:08:56.537 22592 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:08:56 ctl02 nova-api[22592]: 2017-09-28 12:08:56.666 22592 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:08:56 ctl02 nova-api[22592]: 2017-09-28 12:08:56.668 22592 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:08:56 ctl02 nova-api[22592]: 2017-09-28 12:08:56.668 22592 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:08:56 ctl02 nova-api[22592]: 2017-09-28 12:08:56.668 22592 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:08:56 ctl02 nova-api[22592]: 2017-09-28 12:08:56.672 22592 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:08:56 ctl02 nova-api[22592]: 2017-09-28 12:08:56.676 22592 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:08:56 ctl02 nova-api[22592]: 2017-09-28 12:08:56.676 22592 ERROR nova Traceback (most recent call last):
Sep 28 12:08:56 ctl02 nova-api[22592]: 2017-09-28 12:08:56.676 22592 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:08:56 ctl02 nova-api[22592]: 2017-09-28 12:08:56.676 22592 ERROR nova     sys.exit(main())
Sep 28 12:08:56 ctl02 nova-api[22592]: 2017-09-28 12:08:56.676 22592 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:08:56 ctl02 nova-api[22592]: 2017-09-28 12:08:56.676 22592 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:08:56 ctl02 nova-api[22592]: 2017-09-28 12:08:56.676 22592 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:08:56 ctl02 nova-api[22592]: 2017-09-28 12:08:56.676 22592 ERROR nova     max_url_len=max_url_len)
Sep 28 12:08:56 ctl02 nova-api[22592]: 2017-09-28 12:08:56.676 22592 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:08:56 ctl02 nova-api[22592]: 2017-09-28 12:08:56.676 22592 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:08:56 ctl02 nova-api[22592]: 2017-09-28 12:08:56.676 22592 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:08:56 ctl02 nova-api[22592]: 2017-09-28 12:08:56.676 22592 ERROR nova     sock.listen(backlog)
Sep 28 12:08:56 ctl02 nova-api[22592]: 2017-09-28 12:08:56.676 22592 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:08:56 ctl02 nova-api[22592]: 2017-09-28 12:08:56.676 22592 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:08:56 ctl02 nova-api[22592]: 2017-09-28 12:08:56.676 22592 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:08:56 ctl02 nova-api[22592]: 2017-09-28 12:08:56.676 22592 ERROR nova
Sep 28 12:08:56 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd283ef79)
Sep 28 12:08:56 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:08:56 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:08:56 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:08:56 ctl02 heat-api[13008]: 2017-09-28 12:08:56.841 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:08:56] "OPTIONS / HTTP/1.0" 200 134 0.000559
Sep 28 12:08:57 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:08:57 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:08:57 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:08:57 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:08:57 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd283ef79)
Sep 28 12:08:58 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:08:58.272 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:08:58] "OPTIONS / HTTP/1.0" 200 134 0.000444
Sep 28 12:08:58 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:08:58.290 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:08:58] "OPTIONS / HTTP/1.0" 200 134 0.000265
Sep 28 12:08:58 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd283ef79)
Sep 28 12:08:58 ctl02 nova-api[22628]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:08:58 ctl02 nova-api[22628]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:08:58 ctl02 nova-api[22628]: 2017-09-28 12:08:58.946 22628 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:08:58 ctl02 nova-api[22628]: 2017-09-28 12:08:58.948 22628 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:08:58 ctl02 nova-api[22628]: 2017-09-28 12:08:58.948 22628 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:08:58 ctl02 nova-api[22628]: 2017-09-28 12:08:58.948 22628 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:08:58 ctl02 nova-api[22628]: 2017-09-28 12:08:58.948 22628 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:08:58 ctl02 nova-api[22628]: 2017-09-28 12:08:58.948 22628 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:08:58 ctl02 nova-api[22628]: 2017-09-28 12:08:58.948 22628 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:08:58 ctl02 nova-api[22628]: 2017-09-28 12:08:58.948 22628 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:08:58 ctl02 nova-api[22628]: 2017-09-28 12:08:58.948 22628 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:08:58 ctl02 nova-api[22628]: 2017-09-28 12:08:58.948 22628 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:08:58 ctl02 nova-api[22628]: 2017-09-28 12:08:58.948 22628 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:08:58 ctl02 nova-api[22628]: 2017-09-28 12:08:58.948 22628 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:08:58 ctl02 nova-api[22628]: 2017-09-28 12:08:58.948 22628 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:08:58 ctl02 nova-api[22628]: 2017-09-28 12:08:58.948 22628 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:08:58 ctl02 nova-api[22628]: 2017-09-28 12:08:58.948 22628 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:08:58 ctl02 nova-api[22628]: 2017-09-28 12:08:58.948 22628 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:08:58 ctl02 nova-api[22628]: 2017-09-28 12:08:58.948 22628 ERROR nova.wsgi     self.filename))
Sep 28 12:08:58 ctl02 nova-api[22628]: 2017-09-28 12:08:58.948 22628 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:08:58 ctl02 nova-api[22628]: 2017-09-28 12:08:58.948 22628 ERROR nova.wsgi
Sep 28 12:08:58 ctl02 nova-api[22628]: 2017-09-28 12:08:58.949 22628 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:08:59 ctl02 nova-api[22628]: 2017-09-28 12:08:59.076 22628 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:08:59 ctl02 nova-api[22628]: 2017-09-28 12:08:59.303 22628 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:08:59 ctl02 nova-api[22628]: 2017-09-28 12:08:59.305 22628 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:08:59 ctl02 nova-api[22628]: 2017-09-28 12:08:59.305 22628 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:08:59 ctl02 nova-api[22628]: 2017-09-28 12:08:59.306 22628 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:08:59 ctl02 nova-api[22628]: 2017-09-28 12:08:59.437 22628 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:08:59 ctl02 nova-api[22628]: 2017-09-28 12:08:59.439 22628 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:08:59 ctl02 nova-api[22628]: 2017-09-28 12:08:59.439 22628 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:08:59 ctl02 nova-api[22628]: 2017-09-28 12:08:59.439 22628 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:08:59 ctl02 nova-api[22628]: 2017-09-28 12:08:59.443 22628 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:08:59 ctl02 nova-api[22628]: 2017-09-28 12:08:59.443 22628 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:08:59 ctl02 nova-api[22628]: 2017-09-28 12:08:59.443 22628 ERROR nova Traceback (most recent call last):
Sep 28 12:08:59 ctl02 nova-api[22628]: 2017-09-28 12:08:59.443 22628 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:08:59 ctl02 nova-api[22628]: 2017-09-28 12:08:59.443 22628 ERROR nova     sys.exit(main())
Sep 28 12:08:59 ctl02 nova-api[22628]: 2017-09-28 12:08:59.443 22628 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:08:59 ctl02 nova-api[22628]: 2017-09-28 12:08:59.443 22628 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:08:59 ctl02 nova-api[22628]: 2017-09-28 12:08:59.443 22628 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:08:59 ctl02 nova-api[22628]: 2017-09-28 12:08:59.443 22628 ERROR nova     max_url_len=max_url_len)
Sep 28 12:08:59 ctl02 nova-api[22628]: 2017-09-28 12:08:59.443 22628 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:08:59 ctl02 nova-api[22628]: 2017-09-28 12:08:59.443 22628 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:08:59 ctl02 nova-api[22628]: 2017-09-28 12:08:59.443 22628 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:08:59 ctl02 nova-api[22628]: 2017-09-28 12:08:59.443 22628 ERROR nova     sock.listen(backlog)
Sep 28 12:08:59 ctl02 nova-api[22628]: 2017-09-28 12:08:59.443 22628 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:08:59 ctl02 nova-api[22628]: 2017-09-28 12:08:59.443 22628 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:08:59 ctl02 nova-api[22628]: 2017-09-28 12:08:59.443 22628 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:08:59 ctl02 nova-api[22628]: 2017-09-28 12:08:59.443 22628 ERROR nova
Sep 28 12:08:59 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:08:59 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:08:59 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:08:59 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd283ef79)
Sep 28 12:08:59 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:08:59 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:08:59 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:08:59 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:09:00 ctl02 heat-api-cfn[13300]: 2017-09-28 12:09:00.629 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:09:00] "OPTIONS / HTTP/1.0" 200 134 0.000433
Sep 28 12:09:00 ctl02 heat-api-cfn[13300]: 2017-09-28 12:09:00.684 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:09:00] "OPTIONS / HTTP/1.0" 200 134 0.000300
Sep 28 12:09:00 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd283ef79)
Sep 28 12:09:01 ctl02 glance-api[29183]: 2017-09-28 12:09:01.008 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:09:01] "OPTIONS / HTTP/1.0" 200 134 0.000647
Sep 28 12:09:01 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:09:01.337 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:09:01] "OPTIONS / HTTP/1.0" 200 134 0.000414
Sep 28 12:09:01 ctl02 nova-api[22647]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:09:01 ctl02 nova-api[22647]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:09:01 ctl02 nova-api[22647]: 2017-09-28 12:09:01.718 22647 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:09:01 ctl02 nova-api[22647]: 2017-09-28 12:09:01.720 22647 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:09:01 ctl02 nova-api[22647]: 2017-09-28 12:09:01.720 22647 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:09:01 ctl02 nova-api[22647]: 2017-09-28 12:09:01.720 22647 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:09:01 ctl02 nova-api[22647]: 2017-09-28 12:09:01.720 22647 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:09:01 ctl02 nova-api[22647]: 2017-09-28 12:09:01.720 22647 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:09:01 ctl02 nova-api[22647]: 2017-09-28 12:09:01.720 22647 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:09:01 ctl02 nova-api[22647]: 2017-09-28 12:09:01.720 22647 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:09:01 ctl02 nova-api[22647]: 2017-09-28 12:09:01.720 22647 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:09:01 ctl02 nova-api[22647]: 2017-09-28 12:09:01.720 22647 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:09:01 ctl02 nova-api[22647]: 2017-09-28 12:09:01.720 22647 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:09:01 ctl02 nova-api[22647]: 2017-09-28 12:09:01.720 22647 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:09:01 ctl02 nova-api[22647]: 2017-09-28 12:09:01.720 22647 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:09:01 ctl02 nova-api[22647]: 2017-09-28 12:09:01.720 22647 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:09:01 ctl02 nova-api[22647]: 2017-09-28 12:09:01.720 22647 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:09:01 ctl02 nova-api[22647]: 2017-09-28 12:09:01.720 22647 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:09:01 ctl02 nova-api[22647]: 2017-09-28 12:09:01.720 22647 ERROR nova.wsgi     self.filename))
Sep 28 12:09:01 ctl02 nova-api[22647]: 2017-09-28 12:09:01.720 22647 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:09:01 ctl02 nova-api[22647]: 2017-09-28 12:09:01.720 22647 ERROR nova.wsgi
Sep 28 12:09:01 ctl02 nova-api[22647]: 2017-09-28 12:09:01.722 22647 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:09:01 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd283ef79)
Sep 28 12:09:01 ctl02 nova-api[22647]: 2017-09-28 12:09:01.852 22647 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:09:02 ctl02 nova-api[22647]: 2017-09-28 12:09:02.071 22647 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:09:02 ctl02 nova-api[22647]: 2017-09-28 12:09:02.073 22647 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:09:02 ctl02 nova-api[22647]: 2017-09-28 12:09:02.074 22647 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:09:02 ctl02 nova-api[22647]: 2017-09-28 12:09:02.074 22647 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:09:02 ctl02 nova-api[22647]: 2017-09-28 12:09:02.205 22647 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:09:02 ctl02 nova-api[22647]: 2017-09-28 12:09:02.207 22647 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:09:02 ctl02 nova-api[22647]: 2017-09-28 12:09:02.208 22647 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:09:02 ctl02 nova-api[22647]: 2017-09-28 12:09:02.208 22647 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:09:02 ctl02 nova-api[22647]: 2017-09-28 12:09:02.212 22647 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:09:02 ctl02 nova-api[22647]: 2017-09-28 12:09:02.217 22647 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:09:02 ctl02 nova-api[22647]: 2017-09-28 12:09:02.217 22647 ERROR nova Traceback (most recent call last):
Sep 28 12:09:02 ctl02 nova-api[22647]: 2017-09-28 12:09:02.217 22647 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:09:02 ctl02 nova-api[22647]: 2017-09-28 12:09:02.217 22647 ERROR nova     sys.exit(main())
Sep 28 12:09:02 ctl02 nova-api[22647]: 2017-09-28 12:09:02.217 22647 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:09:02 ctl02 nova-api[22647]: 2017-09-28 12:09:02.217 22647 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:09:02 ctl02 nova-api[22647]: 2017-09-28 12:09:02.217 22647 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:09:02 ctl02 nova-api[22647]: 2017-09-28 12:09:02.217 22647 ERROR nova     max_url_len=max_url_len)
Sep 28 12:09:02 ctl02 nova-api[22647]: 2017-09-28 12:09:02.217 22647 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:09:02 ctl02 nova-api[22647]: 2017-09-28 12:09:02.217 22647 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:09:02 ctl02 nova-api[22647]: 2017-09-28 12:09:02.217 22647 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:09:02 ctl02 nova-api[22647]: 2017-09-28 12:09:02.217 22647 ERROR nova     sock.listen(backlog)
Sep 28 12:09:02 ctl02 nova-api[22647]: 2017-09-28 12:09:02.217 22647 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:09:02 ctl02 nova-api[22647]: 2017-09-28 12:09:02.217 22647 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:09:02 ctl02 nova-api[22647]: 2017-09-28 12:09:02.217 22647 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:09:02 ctl02 nova-api[22647]: 2017-09-28 12:09:02.217 22647 ERROR nova
Sep 28 12:09:02 ctl02 heat-api[13008]: 2017-09-28 12:09:02.353 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:09:02] "OPTIONS / HTTP/1.0" 200 134 0.001215
Sep 28 12:09:02 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:09:02 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:09:02 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:09:02 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:09:02 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:09:02 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:09:02 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:09:02 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd283ef79)
Sep 28 12:09:03 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928120903259593
Sep 28 12:09:03 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 22676
Sep 28 12:09:03 ctl02 heat-api-cfn[13300]: 2017-09-28 12:09:03.303 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:09:03] "OPTIONS / HTTP/1.0" 200 134 0.000443
Sep 28 12:09:03 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928120903259593
Sep 28 12:09:03 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd283ef79)
Sep 28 12:09:04 ctl02 systemd[1]: Reloading.
Sep 28 12:09:04 ctl02 systemd[1]: message repeated 2 times: [ Reloading.]
Sep 28 12:09:04 ctl02 systemd[1]: Starting OpenStack Cinder Api...
Sep 28 12:09:04 ctl02 systemd[1]: Started OpenStack Cinder Api.
Sep 28 12:09:04 ctl02 systemd[1]: Reloading.
Sep 28 12:09:04 ctl02 nova-api[22665]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:09:04 ctl02 nova-api[22665]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:09:04 ctl02 glance-api[29183]: 2017-09-28 12:09:04.331 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:09:04] "OPTIONS / HTTP/1.0" 200 134 0.000592
Sep 28 12:09:04 ctl02 nova-api[22665]: 2017-09-28 12:09:04.485 22665 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:09:04 ctl02 nova-api[22665]: 2017-09-28 12:09:04.487 22665 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:09:04 ctl02 nova-api[22665]: 2017-09-28 12:09:04.487 22665 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:09:04 ctl02 nova-api[22665]: 2017-09-28 12:09:04.487 22665 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:09:04 ctl02 nova-api[22665]: 2017-09-28 12:09:04.487 22665 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:09:04 ctl02 nova-api[22665]: 2017-09-28 12:09:04.487 22665 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:09:04 ctl02 nova-api[22665]: 2017-09-28 12:09:04.487 22665 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:09:04 ctl02 nova-api[22665]: 2017-09-28 12:09:04.487 22665 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:09:04 ctl02 nova-api[22665]: 2017-09-28 12:09:04.487 22665 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:09:04 ctl02 nova-api[22665]: 2017-09-28 12:09:04.487 22665 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:09:04 ctl02 nova-api[22665]: 2017-09-28 12:09:04.487 22665 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:09:04 ctl02 nova-api[22665]: 2017-09-28 12:09:04.487 22665 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:09:04 ctl02 nova-api[22665]: 2017-09-28 12:09:04.487 22665 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:09:04 ctl02 nova-api[22665]: 2017-09-28 12:09:04.487 22665 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:09:04 ctl02 nova-api[22665]: 2017-09-28 12:09:04.487 22665 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:09:04 ctl02 nova-api[22665]: 2017-09-28 12:09:04.487 22665 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:09:04 ctl02 nova-api[22665]: 2017-09-28 12:09:04.487 22665 ERROR nova.wsgi     self.filename))
Sep 28 12:09:04 ctl02 nova-api[22665]: 2017-09-28 12:09:04.487 22665 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:09:04 ctl02 nova-api[22665]: 2017-09-28 12:09:04.487 22665 ERROR nova.wsgi
Sep 28 12:09:04 ctl02 nova-api[22665]: 2017-09-28 12:09:04.489 22665 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:09:04 ctl02 nova-api[22665]: 2017-09-28 12:09:04.622 22665 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:09:04 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd283ef79)
Sep 28 12:09:04 ctl02 glance-api[29183]: 2017-09-28 12:09:04.828 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:09:04] "OPTIONS / HTTP/1.0" 200 134 0.000609
Sep 28 12:09:04 ctl02 nova-api[22665]: 2017-09-28 12:09:04.837 22665 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:09:04 ctl02 nova-api[22665]: 2017-09-28 12:09:04.839 22665 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:09:04 ctl02 nova-api[22665]: 2017-09-28 12:09:04.839 22665 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:09:04 ctl02 nova-api[22665]: 2017-09-28 12:09:04.839 22665 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:09:04 ctl02 nova-api[22665]: 2017-09-28 12:09:04.973 22665 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:09:04 ctl02 nova-api[22665]: 2017-09-28 12:09:04.975 22665 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:09:04 ctl02 nova-api[22665]: 2017-09-28 12:09:04.975 22665 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:09:04 ctl02 nova-api[22665]: 2017-09-28 12:09:04.975 22665 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:09:04 ctl02 nova-api[22665]: 2017-09-28 12:09:04.978 22665 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:09:04 ctl02 nova-api[22665]: 2017-09-28 12:09:04.979 22665 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:09:04 ctl02 nova-api[22665]: 2017-09-28 12:09:04.979 22665 ERROR nova Traceback (most recent call last):
Sep 28 12:09:04 ctl02 nova-api[22665]: 2017-09-28 12:09:04.979 22665 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:09:04 ctl02 nova-api[22665]: 2017-09-28 12:09:04.979 22665 ERROR nova     sys.exit(main())
Sep 28 12:09:04 ctl02 nova-api[22665]: 2017-09-28 12:09:04.979 22665 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:09:04 ctl02 nova-api[22665]: 2017-09-28 12:09:04.979 22665 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:09:04 ctl02 nova-api[22665]: 2017-09-28 12:09:04.979 22665 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:09:04 ctl02 nova-api[22665]: 2017-09-28 12:09:04.979 22665 ERROR nova     max_url_len=max_url_len)
Sep 28 12:09:04 ctl02 nova-api[22665]: 2017-09-28 12:09:04.979 22665 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:09:04 ctl02 nova-api[22665]: 2017-09-28 12:09:04.979 22665 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:09:04 ctl02 nova-api[22665]: 2017-09-28 12:09:04.979 22665 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:09:04 ctl02 nova-api[22665]: 2017-09-28 12:09:04.979 22665 ERROR nova     sock.listen(backlog)
Sep 28 12:09:04 ctl02 nova-api[22665]: 2017-09-28 12:09:04.979 22665 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:09:04 ctl02 nova-api[22665]: 2017-09-28 12:09:04.979 22665 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:09:04 ctl02 nova-api[22665]: 2017-09-28 12:09:04.979 22665 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:09:04 ctl02 nova-api[22665]: 2017-09-28 12:09:04.979 22665 ERROR nova
Sep 28 12:09:05 ctl02 salt-minion[14967]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 12:09:05 ctl02 salt-minion[14967]: [INFO    ] Made the following changes:
Sep 28 12:09:05 ctl02 salt-minion[14967]: 'cinder-api' changed from 'absent' to '2:8.1.1-0ubuntu3'
Sep 28 12:09:05 ctl02 salt-minion[14967]: 'cinder-common' changed from 'absent' to '2:8.1.1-0ubuntu3'
Sep 28 12:09:05 ctl02 salt-minion[14967]: [INFO    ] Loading fresh modules for state activity
Sep 28 12:09:05 ctl02 salt-minion[14967]: [INFO    ] Completed state [cinder-api] at time 12:09:05.069493 duration_in_ms=13335.955
Sep 28 12:09:05 ctl02 heat-api[13008]: 2017-09-28 12:09:05.072 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:09:05] "OPTIONS / HTTP/1.0" 200 134 0.000574
Sep 28 12:09:05 ctl02 salt-minion[14967]: [INFO    ] Running state [python-memcache] at time 12:09:05.075897
Sep 28 12:09:05 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for python-memcache
Sep 28 12:09:05 ctl02 cinder-api[22755]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.100 22755 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:09:05 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:09:05 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:09:05 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.179 22755 WARNING cinder.api [-] The v1 api is deprecated and is not under active development. You should set enable_v1_api=false and enable_v3_api=true in your cinder.conf file.
Sep 28 12:09:05 ctl02 salt-minion[14967]: [INFO    ] Package python-memcache is already installed
Sep 28 12:09:05 ctl02 salt-minion[14967]: [INFO    ] Completed state [python-memcache] at time 12:09:05.296784 duration_in_ms=220.887
Sep 28 12:09:05 ctl02 salt-minion[14967]: [INFO    ] Running state [python-pycadf] at time 12:09:05.297042
Sep 28 12:09:05 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for python-pycadf
Sep 28 12:09:05 ctl02 salt-minion[14967]: [INFO    ] Package python-pycadf is already installed
Sep 28 12:09:05 ctl02 salt-minion[14967]: [INFO    ] Completed state [python-pycadf] at time 12:09:05.300040 duration_in_ms=2.998
Sep 28 12:09:05 ctl02 salt-minion[14967]: [INFO    ] Running state [gettext-base] at time 12:09:05.300281
Sep 28 12:09:05 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for gettext-base
Sep 28 12:09:05 ctl02 salt-minion[14967]: [INFO    ] Package gettext-base is already installed
Sep 28 12:09:05 ctl02 salt-minion[14967]: [INFO    ] Completed state [gettext-base] at time 12:09:05.303114 duration_in_ms=2.833
Sep 28 12:09:05 ctl02 salt-minion[14967]: [INFO    ] Running state [cinder-scheduler] at time 12:09:05.303310
Sep 28 12:09:05 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for cinder-scheduler
Sep 28 12:09:05 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemd-run', '--scope', 'apt-get', '-q', '-y', '-o', 'DPkg::Options::=--force-confold', '-o', 'DPkg::Options::=--force-confdef', 'install', 'cinder-scheduler'] in directory '/root'
Sep 28 12:09:05 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:09:05 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.328 22755 INFO root [-] Generating grammar tables from /usr/lib/python2.7/lib2to3/Grammar.txt
Sep 28 12:09:05 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.348 22755 INFO root [-] Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt
Sep 28 12:09:05 ctl02 systemd[1]: Started /usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold -o DPkg::Options::=--force-confdef install cinder-scheduler.
Sep 28 12:09:05 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.422 22755 INFO cinder.api.extensions [-] Initializing extension manager.
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.423 22755 INFO cinder.api.extensions [-] Loaded extension: os-snapshot-actions
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.424 22755 INFO cinder.api.extensions [-] Loaded extension: os-availability-zone
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.425 22755 INFO cinder.api.extensions [-] Loaded extension: os-hosts
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.426 22755 INFO cinder.api.extensions [-] Loaded extension: os-volume-transfer
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.428 22755 INFO cinder.api.extensions [-] Loaded extension: os-admin-actions
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.429 22755 INFO cinder.api.extensions [-] Loaded extension: os-vol-host-attr
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.429 22755 INFO cinder.api.extensions [-] Loaded extension: os-vol-tenant-attr
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.430 22755 INFO cinder.api.extensions [-] Loaded extension: os-snapshot-manage
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.431 22755 INFO cinder.api.extensions [-] Loaded extension: capabilities
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.431 22755 INFO cinder.api.extensions [-] Loaded extension: cgsnapshots
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.432 22755 INFO cinder.api.extensions [-] Loaded extension: os-quota-class-sets
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.433 22755 INFO cinder.api.extensions [-] Loaded extension: os-extended-services
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.433 22755 INFO cinder.api.extensions [-] Loaded extension: os-volume-encryption-metadata
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.434 22755 INFO cinder.api.extensions [-] Loaded extension: os-image-create
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.436 22755 INFO cinder.api.extensions [-] Loaded extension: os-volume-actions
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.436 22755 INFO cinder.api.extensions [-] Loaded extension: scheduler-stats
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.437 22755 INFO cinder.api.extensions [-] Loaded extension: encryption
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.438 22755 INFO cinder.api.extensions [-] Loaded extension: os-services
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.439 22755 INFO cinder.api.extensions [-] Loaded extension: qos-specs
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.439 22755 INFO cinder.api.extensions [-] Loaded extension: OS-SCH-HNT
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.440 22755 INFO cinder.api.extensions [-] Loaded extension: backups
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.441 22755 INFO cinder.api.extensions [-] Loaded extension: consistencygroups
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.442 22755 INFO cinder.api.extensions [-] Loaded extension: os-snapshot-unmanage
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.442 22755 INFO cinder.api.extensions [-] Loaded extension: os-volume-unmanage
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.443 22755 INFO cinder.api.extensions [-] Loaded extension: os-vol-mig-status-attr
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.444 22755 INFO cinder.api.extensions [-] Loaded extension: os-types-extra-specs
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.444 22755 INFO cinder.api.extensions [-] Loaded extension: os-volume-manage
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.445 22755 INFO cinder.api.extensions [-] Loaded extension: os-used-limits
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.446 22755 INFO cinder.api.extensions [-] Loaded extension: os-volume-type-access
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.446 22755 INFO cinder.api.extensions [-] Loaded extension: os-vol-image-meta
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.447 22755 INFO cinder.api.extensions [-] Loaded extension: os-quota-sets
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.448 22755 INFO cinder.api.extensions [-] Loaded extension: os-types-manage
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.449 22755 INFO cinder.api.extensions [-] Loaded extension: os-extended-snapshot-attributes
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.450 22755 WARNING py.warnings [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/enginefacade.py:241: NotSupportedWarning: Configuration option(s) ['use_tpool'] not supported
Sep 28 12:09:05 ctl02 cinder-api[22755]:   exception.NotSupportedWarning
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.505 22755 INFO cinder.rpc [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Automatically selected cinder-scheduler objects version 1.3 as minimum service version.
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.508 22755 INFO cinder.rpc [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Automatically selected cinder-scheduler RPC version 2.0 as minimum service version.
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.510 22755 INFO cinder.rpc [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Automatically selected cinder-volume objects version 1.3 as minimum service version.
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.513 22755 INFO cinder.rpc [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Automatically selected cinder-volume RPC version 1.40 as minimum service version.
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.521 22755 INFO cinder.rpc [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Automatically selected cinder-backup objects version 1.3 as minimum service version.
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.524 22755 INFO cinder.rpc [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Automatically selected cinder-backup RPC version 1.3 as minimum service version.
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.543 22755 WARNING keystonemiddleware.auth_token [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.544 22755 WARNING keystonemiddleware.auth_token [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.544 22755 WARNING keystonemiddleware.auth_token [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.545 22755 WARNING oslo_log.versionutils [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Deprecated: RequestBodySizeLimiter() is deprecated as of Kilo in favor of oslo_middleware.RequestBodySizeLimiter and may be removed in Mitaka.
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.551 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Initializing extension manager.
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.551 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-snapshot-actions
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.552 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-availability-zone
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.553 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-hosts
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.553 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-volume-transfer
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.554 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-admin-actions
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.554 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-vol-host-attr
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.555 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-vol-tenant-attr
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.555 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-snapshot-manage
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.556 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: capabilities
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.557 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: cgsnapshots
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.557 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-quota-class-sets
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.558 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-extended-services
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.558 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-volume-encryption-metadata
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.559 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-image-create
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.559 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-volume-actions
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.560 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: scheduler-stats
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.560 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: encryption
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.561 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-services
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.561 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: qos-specs
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.562 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: OS-SCH-HNT
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.562 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: backups
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.563 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: consistencygroups
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.563 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-snapshot-unmanage
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.564 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-volume-unmanage
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.564 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-vol-mig-status-attr
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.565 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-types-extra-specs
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.565 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-volume-manage
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.566 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-used-limits
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.566 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-volume-type-access
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.567 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-vol-image-meta
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.567 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-quota-sets
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.568 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-types-manage
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.568 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-extended-snapshot-attributes
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.593 22755 WARNING keystonemiddleware.auth_token [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.593 22755 WARNING keystonemiddleware.auth_token [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.594 22755 WARNING keystonemiddleware.auth_token [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.601 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Initializing extension manager.
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.602 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-snapshot-actions
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.602 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-availability-zone
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.603 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-hosts
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.603 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-volume-transfer
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.604 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-admin-actions
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.604 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-vol-host-attr
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.605 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-vol-tenant-attr
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.605 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-snapshot-manage
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.606 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: capabilities
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.606 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: cgsnapshots
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.607 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-quota-class-sets
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.607 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-extended-services
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.608 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-volume-encryption-metadata
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.608 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-image-create
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.609 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-volume-actions
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.609 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: scheduler-stats
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.610 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: encryption
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.610 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-services
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.611 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: qos-specs
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.611 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: OS-SCH-HNT
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.612 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: backups
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.612 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: consistencygroups
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.613 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-snapshot-unmanage
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.613 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-volume-unmanage
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.614 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-vol-mig-status-attr
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.614 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-types-extra-specs
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.615 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-volume-manage
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.616 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-used-limits
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.616 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-volume-type-access
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.617 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-vol-image-meta
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.617 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-quota-sets
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.618 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-types-manage
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.618 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-extended-snapshot-attributes
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.643 22755 WARNING keystonemiddleware.auth_token [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.644 22755 WARNING keystonemiddleware.auth_token [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.644 22755 WARNING keystonemiddleware.auth_token [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.648 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Initializing extension manager.
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.649 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-snapshot-actions
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.650 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-availability-zone
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.650 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-hosts
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.651 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-volume-transfer
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.651 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-admin-actions
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.652 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-vol-host-attr
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.652 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-vol-tenant-attr
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.653 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-snapshot-manage
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.654 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: capabilities
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.654 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: cgsnapshots
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.655 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-quota-class-sets
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.655 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-extended-services
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.656 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-volume-encryption-metadata
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.656 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-image-create
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.657 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-volume-actions
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.657 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: scheduler-stats
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.658 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: encryption
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.659 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-services
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.659 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: qos-specs
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.660 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: OS-SCH-HNT
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.660 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: backups
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.661 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: consistencygroups
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.661 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-snapshot-unmanage
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.662 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-volume-unmanage
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.662 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-vol-mig-status-attr
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.663 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-types-extra-specs
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.663 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-volume-manage
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.664 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-used-limits
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.665 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-volume-type-access
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.665 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-vol-image-meta
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.666 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-quota-sets
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.666 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-types-manage
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.667 22755 INFO cinder.api.extensions [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Loaded extension: os-extended-snapshot-attributes
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.686 22755 WARNING cinder.api.openstack [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Extension SchedulerHints: Cannot extend resource volumes: No such resource
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.686 22755 WARNING cinder.api.openstack [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Extension VolumeTenantAttribute: Cannot extend resource volumes: No such resource
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.687 22755 WARNING cinder.api.openstack [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Extension TypesManage: Cannot extend resource types: No such resource
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.687 22755 WARNING cinder.api.openstack [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Extension SnapshotActions: Cannot extend resource snapshots: No such resource
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.688 22755 WARNING cinder.api.openstack [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Extension VolumeActions: Cannot extend resource volumes: No such resource
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.688 22755 WARNING cinder.api.openstack [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Extension VolumeUnmanage: Cannot extend resource volumes: No such resource
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.689 22755 WARNING cinder.api.openstack [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Extension VolumeHostAttribute: Cannot extend resource volumes: No such resource
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.689 22755 WARNING cinder.api.openstack [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Extension VolumeTypeEncryption: Cannot extend resource types: No such resource
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.690 22755 WARNING cinder.api.openstack [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Extension VolumeImageMetadata: Cannot extend resource volumes: No such resource
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.690 22755 WARNING cinder.api.openstack [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Extension UsedLimits: Cannot extend resource limits: No such resource
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.691 22755 WARNING cinder.api.openstack [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Extension VolumeMigStatusAttribute: Cannot extend resource volumes: No such resource
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.691 22755 WARNING cinder.api.openstack [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Extension VolumeTypeAccess: Cannot extend resource types: No such resource
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.692 22755 WARNING cinder.api.openstack [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Extension ExtendedSnapshotAttributes: Cannot extend resource snapshots: No such resource
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.692 22755 WARNING cinder.api.openstack [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Extension SnapshotUnmanage: Cannot extend resource snapshots: No such resource
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.693 22755 WARNING cinder.api.openstack [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Extension AdminActions: Cannot extend resource volumes: No such resource
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.693 22755 WARNING cinder.api.openstack [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Extension AdminActions: Cannot extend resource snapshots: No such resource
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.695 22755 ERROR oslo.service.wsgi [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] Could not bind to 0.0.0.0:8776
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.696 22755 CRITICAL cinder [req-c8f0eaee-57e5-42d6-9408-465f64eae12d - - - - -] error: [Errno 98] Address already in use
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.696 22755 ERROR cinder Traceback (most recent call last):
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.696 22755 ERROR cinder   File "/usr/bin/cinder-api", line 10, in <module>
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.696 22755 ERROR cinder     sys.exit(main())
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.696 22755 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/cmd/api.py", line 61, in main
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.696 22755 ERROR cinder     server = service.WSGIService('osapi_volume')
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.696 22755 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/service.py", line 393, in __init__
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.696 22755 ERROR cinder     port=self.port)
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.696 22755 ERROR cinder   File "/usr/lib/python2.7/dist-packages/oslo_service/wsgi.py", line 115, in __init__
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.696 22755 ERROR cinder     self.socket = self._get_socket(host, port, backlog)
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.696 22755 ERROR cinder   File "/usr/lib/python2.7/dist-packages/oslo_service/wsgi.py", line 143, in _get_socket
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.696 22755 ERROR cinder     sock = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.696 22755 ERROR cinder   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.696 22755 ERROR cinder     sock.listen(backlog)
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.696 22755 ERROR cinder   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.696 22755 ERROR cinder     return getattr(self._sock,name)(*args)
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.696 22755 ERROR cinder error: [Errno 98] Address already in use
Sep 28 12:09:05 ctl02 cinder-api[22755]: 2017-09-28 12:09:05.696 22755 ERROR cinder
Sep 28 12:09:05 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd283ef79)
Sep 28 12:09:05 ctl02 systemd[1]: cinder-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:09:05 ctl02 systemd[1]: cinder-api.service: Unit entered failed state.
Sep 28 12:09:05 ctl02 systemd[1]: cinder-api.service: Failed with result 'exit-code'.
Sep 28 12:09:06 ctl02 systemd[1]: cinder-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:09:06 ctl02 systemd[1]: Stopped OpenStack Cinder Api.
Sep 28 12:09:06 ctl02 systemd[1]: Starting OpenStack Cinder Api...
Sep 28 12:09:06 ctl02 systemd[1]: Started OpenStack Cinder Api.
Sep 28 12:09:06 ctl02 systemd[1]: Reloading.
Sep 28 12:09:06 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd283ef79)
Sep 28 12:09:06 ctl02 heat-api[13008]: 2017-09-28 12:09:06.918 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:09:06] "OPTIONS / HTTP/1.0" 200 134 0.000521
Sep 28 12:09:07 ctl02 nova-api[22832]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:09:07 ctl02 nova-api[22832]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:09:07 ctl02 cinder-api[22856]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.075 22856 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.144 22856 WARNING cinder.api [-] The v1 api is deprecated and is not under active development. You should set enable_v1_api=false and enable_v3_api=true in your cinder.conf file.
Sep 28 12:09:07 ctl02 nova-api[22832]: 2017-09-28 12:09:07.166 22832 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:09:07 ctl02 nova-api[22832]: 2017-09-28 12:09:07.168 22832 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:09:07 ctl02 nova-api[22832]: 2017-09-28 12:09:07.168 22832 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:09:07 ctl02 nova-api[22832]: 2017-09-28 12:09:07.168 22832 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:09:07 ctl02 nova-api[22832]: 2017-09-28 12:09:07.168 22832 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:09:07 ctl02 nova-api[22832]: 2017-09-28 12:09:07.168 22832 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:09:07 ctl02 nova-api[22832]: 2017-09-28 12:09:07.168 22832 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:09:07 ctl02 nova-api[22832]: 2017-09-28 12:09:07.168 22832 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:09:07 ctl02 nova-api[22832]: 2017-09-28 12:09:07.168 22832 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:09:07 ctl02 nova-api[22832]: 2017-09-28 12:09:07.168 22832 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:09:07 ctl02 nova-api[22832]: 2017-09-28 12:09:07.168 22832 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:09:07 ctl02 nova-api[22832]: 2017-09-28 12:09:07.168 22832 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:09:07 ctl02 nova-api[22832]: 2017-09-28 12:09:07.168 22832 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:09:07 ctl02 nova-api[22832]: 2017-09-28 12:09:07.168 22832 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:09:07 ctl02 nova-api[22832]: 2017-09-28 12:09:07.168 22832 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:09:07 ctl02 nova-api[22832]: 2017-09-28 12:09:07.168 22832 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:09:07 ctl02 nova-api[22832]: 2017-09-28 12:09:07.168 22832 ERROR nova.wsgi     self.filename))
Sep 28 12:09:07 ctl02 nova-api[22832]: 2017-09-28 12:09:07.168 22832 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:09:07 ctl02 nova-api[22832]: 2017-09-28 12:09:07.168 22832 ERROR nova.wsgi
Sep 28 12:09:07 ctl02 nova-api[22832]: 2017-09-28 12:09:07.169 22832 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.246 22856 INFO root [-] Generating grammar tables from /usr/lib/python2.7/lib2to3/Grammar.txt
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.263 22856 INFO root [-] Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt
Sep 28 12:09:07 ctl02 nova-api[22832]: 2017-09-28 12:09:07.297 22832 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.298 22856 INFO cinder.api.extensions [-] Initializing extension manager.
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.299 22856 INFO cinder.api.extensions [-] Loaded extension: os-snapshot-actions
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.300 22856 INFO cinder.api.extensions [-] Loaded extension: os-availability-zone
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.301 22856 INFO cinder.api.extensions [-] Loaded extension: os-hosts
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.302 22856 INFO cinder.api.extensions [-] Loaded extension: os-volume-transfer
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.304 22856 INFO cinder.api.extensions [-] Loaded extension: os-admin-actions
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.304 22856 INFO cinder.api.extensions [-] Loaded extension: os-vol-host-attr
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.305 22856 INFO cinder.api.extensions [-] Loaded extension: os-vol-tenant-attr
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.306 22856 INFO cinder.api.extensions [-] Loaded extension: os-snapshot-manage
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.306 22856 INFO cinder.api.extensions [-] Loaded extension: capabilities
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.310 22856 INFO cinder.api.extensions [-] Loaded extension: cgsnapshots
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.310 22856 INFO cinder.api.extensions [-] Loaded extension: os-quota-class-sets
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.311 22856 INFO cinder.api.extensions [-] Loaded extension: os-extended-services
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.311 22856 INFO cinder.api.extensions [-] Loaded extension: os-volume-encryption-metadata
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.312 22856 INFO cinder.api.extensions [-] Loaded extension: os-image-create
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.314 22856 INFO cinder.api.extensions [-] Loaded extension: os-volume-actions
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.315 22856 INFO cinder.api.extensions [-] Loaded extension: scheduler-stats
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.315 22856 INFO cinder.api.extensions [-] Loaded extension: encryption
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.316 22856 INFO cinder.api.extensions [-] Loaded extension: os-services
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.317 22856 INFO cinder.api.extensions [-] Loaded extension: qos-specs
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.317 22856 INFO cinder.api.extensions [-] Loaded extension: OS-SCH-HNT
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.318 22856 INFO cinder.api.extensions [-] Loaded extension: backups
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.319 22856 INFO cinder.api.extensions [-] Loaded extension: consistencygroups
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.320 22856 INFO cinder.api.extensions [-] Loaded extension: os-snapshot-unmanage
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.320 22856 INFO cinder.api.extensions [-] Loaded extension: os-volume-unmanage
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.321 22856 INFO cinder.api.extensions [-] Loaded extension: os-vol-mig-status-attr
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.322 22856 INFO cinder.api.extensions [-] Loaded extension: os-types-extra-specs
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.328 22856 INFO cinder.api.extensions [-] Loaded extension: os-volume-manage
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.328 22856 INFO cinder.api.extensions [-] Loaded extension: os-used-limits
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.329 22856 INFO cinder.api.extensions [-] Loaded extension: os-volume-type-access
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.330 22856 INFO cinder.api.extensions [-] Loaded extension: os-vol-image-meta
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.330 22856 INFO cinder.api.extensions [-] Loaded extension: os-quota-sets
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.331 22856 INFO cinder.api.extensions [-] Loaded extension: os-types-manage
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.332 22856 INFO cinder.api.extensions [-] Loaded extension: os-extended-snapshot-attributes
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.334 22856 WARNING py.warnings [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/enginefacade.py:241: NotSupportedWarning: Configuration option(s) ['use_tpool'] not supported
Sep 28 12:09:07 ctl02 cinder-api[22856]:   exception.NotSupportedWarning
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.391 22856 INFO cinder.rpc [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Automatically selected cinder-scheduler objects version 1.3 as minimum service version.
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.394 22856 INFO cinder.rpc [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Automatically selected cinder-scheduler RPC version 2.0 as minimum service version.
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.396 22856 INFO cinder.rpc [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Automatically selected cinder-volume objects version 1.3 as minimum service version.
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.399 22856 INFO cinder.rpc [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Automatically selected cinder-volume RPC version 1.40 as minimum service version.
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.407 22856 INFO cinder.rpc [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Automatically selected cinder-backup objects version 1.3 as minimum service version.
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.410 22856 INFO cinder.rpc [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Automatically selected cinder-backup RPC version 1.3 as minimum service version.
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.429 22856 WARNING keystonemiddleware.auth_token [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.429 22856 WARNING keystonemiddleware.auth_token [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.430 22856 WARNING keystonemiddleware.auth_token [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.431 22856 WARNING oslo_log.versionutils [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Deprecated: RequestBodySizeLimiter() is deprecated as of Kilo in favor of oslo_middleware.RequestBodySizeLimiter and may be removed in Mitaka.
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.436 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Initializing extension manager.
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.437 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-snapshot-actions
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.438 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-availability-zone
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.438 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-hosts
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.439 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-volume-transfer
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.439 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-admin-actions
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.440 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-vol-host-attr
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.441 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-vol-tenant-attr
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.441 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-snapshot-manage
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.442 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: capabilities
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.442 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: cgsnapshots
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.443 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-quota-class-sets
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.443 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-extended-services
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.444 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-volume-encryption-metadata
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.444 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-image-create
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.445 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-volume-actions
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.445 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: scheduler-stats
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.446 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: encryption
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.446 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-services
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.447 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: qos-specs
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.447 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: OS-SCH-HNT
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.448 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: backups
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.448 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: consistencygroups
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.449 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-snapshot-unmanage
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.449 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-volume-unmanage
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.450 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-vol-mig-status-attr
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.450 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-types-extra-specs
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.451 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-volume-manage
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.451 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-used-limits
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.452 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-volume-type-access
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.452 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-vol-image-meta
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.453 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-quota-sets
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.453 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-types-manage
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.454 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-extended-snapshot-attributes
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.478 22856 WARNING keystonemiddleware.auth_token [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.479 22856 WARNING keystonemiddleware.auth_token [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.479 22856 WARNING keystonemiddleware.auth_token [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.487 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Initializing extension manager.
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.488 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-snapshot-actions
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.488 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-availability-zone
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.489 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-hosts
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.489 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-volume-transfer
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.490 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-admin-actions
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.490 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-vol-host-attr
Sep 28 12:09:07 ctl02 systemd[1]: Reloading.
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.491 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-vol-tenant-attr
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.492 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-snapshot-manage
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.492 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: capabilities
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.493 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: cgsnapshots
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.493 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-quota-class-sets
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.494 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-extended-services
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.494 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-volume-encryption-metadata
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.495 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-image-create
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.495 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-volume-actions
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.496 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: scheduler-stats
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.496 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: encryption
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.497 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-services
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.497 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: qos-specs
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.498 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: OS-SCH-HNT
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.498 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: backups
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.499 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: consistencygroups
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.499 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-snapshot-unmanage
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.500 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-volume-unmanage
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.500 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-vol-mig-status-attr
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.501 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-types-extra-specs
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.501 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-volume-manage
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.502 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-used-limits
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.502 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-volume-type-access
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.503 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-vol-image-meta
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.503 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-quota-sets
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.504 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-types-manage
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.505 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-extended-snapshot-attributes
Sep 28 12:09:07 ctl02 nova-api[22832]: 2017-09-28 12:09:07.526 22832 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:09:07 ctl02 nova-api[22832]: 2017-09-28 12:09:07.528 22832 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:09:07 ctl02 nova-api[22832]: 2017-09-28 12:09:07.529 22832 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:09:07 ctl02 nova-api[22832]: 2017-09-28 12:09:07.529 22832 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.530 22856 WARNING keystonemiddleware.auth_token [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.531 22856 WARNING keystonemiddleware.auth_token [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.531 22856 WARNING keystonemiddleware.auth_token [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.536 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Initializing extension manager.
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.536 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-snapshot-actions
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.537 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-availability-zone
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.537 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-hosts
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.538 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-volume-transfer
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.538 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-admin-actions
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.539 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-vol-host-attr
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.540 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-vol-tenant-attr
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.540 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-snapshot-manage
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.541 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: capabilities
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.541 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: cgsnapshots
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.542 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-quota-class-sets
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.542 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-extended-services
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.543 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-volume-encryption-metadata
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.543 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-image-create
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.544 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-volume-actions
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.544 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: scheduler-stats
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.545 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: encryption
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.545 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-services
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.546 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: qos-specs
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.546 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: OS-SCH-HNT
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.547 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: backups
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.547 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: consistencygroups
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.548 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-snapshot-unmanage
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.548 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-volume-unmanage
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.549 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-vol-mig-status-attr
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.549 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-types-extra-specs
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.550 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-volume-manage
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.551 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-used-limits
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.551 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-volume-type-access
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.552 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-vol-image-meta
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.552 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-quota-sets
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.553 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-types-manage
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.553 22856 INFO cinder.api.extensions [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Loaded extension: os-extended-snapshot-attributes
Sep 28 12:09:07 ctl02 systemd[1]: Reloading.
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.572 22856 WARNING cinder.api.openstack [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Extension SchedulerHints: Cannot extend resource volumes: No such resource
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.572 22856 WARNING cinder.api.openstack [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Extension VolumeTenantAttribute: Cannot extend resource volumes: No such resource
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.573 22856 WARNING cinder.api.openstack [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Extension TypesManage: Cannot extend resource types: No such resource
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.573 22856 WARNING cinder.api.openstack [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Extension SnapshotActions: Cannot extend resource snapshots: No such resource
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.574 22856 WARNING cinder.api.openstack [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Extension VolumeActions: Cannot extend resource volumes: No such resource
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.574 22856 WARNING cinder.api.openstack [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Extension VolumeUnmanage: Cannot extend resource volumes: No such resource
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.575 22856 WARNING cinder.api.openstack [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Extension VolumeHostAttribute: Cannot extend resource volumes: No such resource
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.575 22856 WARNING cinder.api.openstack [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Extension VolumeTypeEncryption: Cannot extend resource types: No such resource
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.576 22856 WARNING cinder.api.openstack [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Extension VolumeImageMetadata: Cannot extend resource volumes: No such resource
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.576 22856 WARNING cinder.api.openstack [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Extension UsedLimits: Cannot extend resource limits: No such resource
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.577 22856 WARNING cinder.api.openstack [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Extension VolumeMigStatusAttribute: Cannot extend resource volumes: No such resource
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.577 22856 WARNING cinder.api.openstack [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Extension VolumeTypeAccess: Cannot extend resource types: No such resource
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.578 22856 WARNING cinder.api.openstack [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Extension ExtendedSnapshotAttributes: Cannot extend resource snapshots: No such resource
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.578 22856 WARNING cinder.api.openstack [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Extension SnapshotUnmanage: Cannot extend resource snapshots: No such resource
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.578 22856 WARNING cinder.api.openstack [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Extension AdminActions: Cannot extend resource volumes: No such resource
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.579 22856 WARNING cinder.api.openstack [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Extension AdminActions: Cannot extend resource snapshots: No such resource
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.581 22856 ERROR oslo.service.wsgi [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] Could not bind to 0.0.0.0:8776
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.582 22856 CRITICAL cinder [req-861b93a8-c581-448b-9e7a-7cde45b049e6 - - - - -] error: [Errno 98] Address already in use
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.582 22856 ERROR cinder Traceback (most recent call last):
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.582 22856 ERROR cinder   File "/usr/bin/cinder-api", line 10, in <module>
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.582 22856 ERROR cinder     sys.exit(main())
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.582 22856 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/cmd/api.py", line 61, in main
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.582 22856 ERROR cinder     server = service.WSGIService('osapi_volume')
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.582 22856 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/service.py", line 393, in __init__
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.582 22856 ERROR cinder     port=self.port)
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.582 22856 ERROR cinder   File "/usr/lib/python2.7/dist-packages/oslo_service/wsgi.py", line 115, in __init__
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.582 22856 ERROR cinder     self.socket = self._get_socket(host, port, backlog)
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.582 22856 ERROR cinder   File "/usr/lib/python2.7/dist-packages/oslo_service/wsgi.py", line 143, in _get_socket
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.582 22856 ERROR cinder     sock = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.582 22856 ERROR cinder   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.582 22856 ERROR cinder     sock.listen(backlog)
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.582 22856 ERROR cinder   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.582 22856 ERROR cinder     return getattr(self._sock,name)(*args)
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.582 22856 ERROR cinder error: [Errno 98] Address already in use
Sep 28 12:09:07 ctl02 cinder-api[22856]: 2017-09-28 12:09:07.582 22856 ERROR cinder
Sep 28 12:09:07 ctl02 systemd[1]: Reloading.
Sep 28 12:09:07 ctl02 systemd[1]: Starting OpenStack Cinder Scheduler...
Sep 28 12:09:07 ctl02 nova-api[22832]: 2017-09-28 12:09:07.671 22832 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:09:07 ctl02 nova-api[22832]: 2017-09-28 12:09:07.673 22832 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:09:07 ctl02 nova-api[22832]: 2017-09-28 12:09:07.673 22832 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:09:07 ctl02 nova-api[22832]: 2017-09-28 12:09:07.673 22832 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:09:07 ctl02 nova-api[22832]: 2017-09-28 12:09:07.677 22832 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:09:07 ctl02 nova-api[22832]: 2017-09-28 12:09:07.677 22832 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:09:07 ctl02 nova-api[22832]: 2017-09-28 12:09:07.677 22832 ERROR nova Traceback (most recent call last):
Sep 28 12:09:07 ctl02 nova-api[22832]: 2017-09-28 12:09:07.677 22832 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:09:07 ctl02 nova-api[22832]: 2017-09-28 12:09:07.677 22832 ERROR nova     sys.exit(main())
Sep 28 12:09:07 ctl02 nova-api[22832]: 2017-09-28 12:09:07.677 22832 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:09:07 ctl02 nova-api[22832]: 2017-09-28 12:09:07.677 22832 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:09:07 ctl02 nova-api[22832]: 2017-09-28 12:09:07.677 22832 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:09:07 ctl02 nova-api[22832]: 2017-09-28 12:09:07.677 22832 ERROR nova     max_url_len=max_url_len)
Sep 28 12:09:07 ctl02 nova-api[22832]: 2017-09-28 12:09:07.677 22832 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:09:07 ctl02 nova-api[22832]: 2017-09-28 12:09:07.677 22832 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:09:07 ctl02 nova-api[22832]: 2017-09-28 12:09:07.677 22832 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:09:07 ctl02 nova-api[22832]: 2017-09-28 12:09:07.677 22832 ERROR nova     sock.listen(backlog)
Sep 28 12:09:07 ctl02 nova-api[22832]: 2017-09-28 12:09:07.677 22832 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:09:07 ctl02 nova-api[22832]: 2017-09-28 12:09:07.677 22832 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:09:07 ctl02 nova-api[22832]: 2017-09-28 12:09:07.677 22832 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:09:07 ctl02 nova-api[22832]: 2017-09-28 12:09:07.677 22832 ERROR nova
Sep 28 12:09:07 ctl02 systemd[1]: Started OpenStack Cinder Scheduler.
Sep 28 12:09:07 ctl02 systemd[1]: cinder-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:09:07 ctl02 systemd[1]: cinder-api.service: Unit entered failed state.
Sep 28 12:09:07 ctl02 systemd[1]: cinder-api.service: Failed with result 'exit-code'.
Sep 28 12:09:07 ctl02 systemd[1]: Reloading.
Sep 28 12:09:07 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:09:07 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:09:07 ctl02 systemd[1]: cinder-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:09:07 ctl02 systemd[1]: Stopped OpenStack Cinder Api.
Sep 28 12:09:07 ctl02 systemd[1]: Starting OpenStack Cinder Api...
Sep 28 12:09:07 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:09:07 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:09:07 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:09:07 ctl02 systemd[1]: Started OpenStack Cinder Api.
Sep 28 12:09:07 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:09:07.894 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:09:07] "OPTIONS / HTTP/1.0" 200 134 0.000391
Sep 28 12:09:08 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:09:08 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:09:08 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:09:08 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:09:08 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:09:08.230 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:09:08] "OPTIONS / HTTP/1.0" 200 134 0.000373
Sep 28 12:09:08 ctl02 nova-cert[4860]: 2017-09-28 12:09:08.277 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:09:08 ctl02 salt-minion[14967]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 12:09:08 ctl02 salt-minion[14967]: [INFO    ] Made the following changes:
Sep 28 12:09:08 ctl02 salt-minion[14967]: 'cinder-scheduler' changed from 'absent' to '2:8.1.1-0ubuntu3'
Sep 28 12:09:08 ctl02 salt-minion[14967]: [INFO    ] Loading fresh modules for state activity
Sep 28 12:09:08 ctl02 salt-minion[14967]: [INFO    ] Completed state [cinder-scheduler] at time 12:09:08.484490 duration_in_ms=3181.179
Sep 28 12:09:08 ctl02 salt-minion[14967]: [INFO    ] Running state [/etc/cinder/cinder.conf] at time 12:09:08.486672
Sep 28 12:09:08 ctl02 salt-minion[14967]: [INFO    ] Executing state file.managed for /etc/cinder/cinder.conf
Sep 28 12:09:08 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'cinder/files/ocata/cinder.conf.controller.Debian'
Sep 28 12:09:08 ctl02 cinder-scheduler[22980]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:09:08 ctl02 cinder-scheduler[22980]: 2017-09-28 12:09:08.562 22980 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:09:08 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'cinder/map.jinja'
Sep 28 12:09:08 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'cinder/files/backend/_lvm.conf'
Sep 28 12:09:08 ctl02 salt-minion[14967]: [INFO    ] File changed:
Sep 28 12:09:08 ctl02 salt-minion[14967]: ---
Sep 28 12:09:08 ctl02 salt-minion[14967]: +++
Sep 28 12:09:08 ctl02 salt-minion[14967]: @@ -1,11 +1,157 @@
Sep 28 12:09:08 ctl02 salt-minion[14967]: +
Sep 28 12:09:08 ctl02 salt-minion[14967]: +
Sep 28 12:09:08 ctl02 salt-minion[14967]:  [DEFAULT]
Sep 28 12:09:08 ctl02 salt-minion[14967]:  rootwrap_config = /etc/cinder/rootwrap.conf
Sep 28 12:09:08 ctl02 salt-minion[14967]:  api_paste_confg = /etc/cinder/api-paste.ini
Sep 28 12:09:08 ctl02 salt-minion[14967]: +
Sep 28 12:09:08 ctl02 salt-minion[14967]:  iscsi_helper = tgtadm
Sep 28 12:09:08 ctl02 salt-minion[14967]:  volume_name_template = volume-%s
Sep 28 12:09:08 ctl02 salt-minion[14967]: -volume_group = cinder-volumes
Sep 28 12:09:08 ctl02 salt-minion[14967]: +#volume_group = cinder
Sep 28 12:09:08 ctl02 salt-minion[14967]: +
Sep 28 12:09:08 ctl02 salt-minion[14967]:  verbose = True
Sep 28 12:09:08 ctl02 salt-minion[14967]: +
Sep 28 12:09:08 ctl02 salt-minion[14967]: +osapi_volume_workers = 4
Sep 28 12:09:08 ctl02 salt-minion[14967]: +
Sep 28 12:09:08 ctl02 salt-minion[14967]:  auth_strategy = keystone
Sep 28 12:09:08 ctl02 salt-minion[14967]: +
Sep 28 12:09:08 ctl02 salt-minion[14967]:  state_path = /var/lib/cinder
Sep 28 12:09:08 ctl02 salt-minion[14967]: -lock_path = /var/lock/cinder
Sep 28 12:09:08 ctl02 salt-minion[14967]: +
Sep 28 12:09:08 ctl02 salt-minion[14967]: +use_syslog=False
Sep 28 12:09:08 ctl02 salt-minion[14967]: +
Sep 28 12:09:08 ctl02 salt-minion[14967]: +glance_num_retries=0
Sep 28 12:09:08 ctl02 salt-minion[14967]: +debug=False
Sep 28 12:09:08 ctl02 salt-minion[14967]: +
Sep 28 12:09:08 ctl02 salt-minion[14967]: +os_region_name=RegionOne
Sep 28 12:09:08 ctl02 salt-minion[14967]: +allow_availability_zone_fallback = True
Sep 28 12:09:08 ctl02 salt-minion[14967]: +
Sep 28 12:09:08 ctl02 salt-minion[14967]: +#glance_api_ssl_compression=False
Sep 28 12:09:08 ctl02 salt-minion[14967]: +#glance_api_insecure=False
Sep 28 12:09:08 ctl02 salt-minion[14967]: +
Sep 28 12:09:08 ctl02 salt-minion[14967]: +osapi_volume_listen=10.167.4.12
Sep 28 12:09:08 ctl02 salt-minion[14967]: +
Sep 28 12:09:08 ctl02 salt-minion[14967]: +glance_api_servers = http://10.167.4.10:9292
Sep 28 12:09:08 ctl02 salt-minion[14967]: +
Sep 28 12:09:08 ctl02 salt-minion[14967]: +glance_host=10.167.4.10
Sep 28 12:09:08 ctl02 salt-minion[14967]: +glance_port=9292
Sep 28 12:09:08 ctl02 salt-minion[14967]: +glance_api_version=2
Sep 28 12:09:08 ctl02 salt-minion[14967]: +
Sep 28 12:09:08 ctl02 salt-minion[14967]: +enable_v3_api = True
Sep 28 12:09:08 ctl02 salt-minion[14967]: +
Sep 28 12:09:08 ctl02 salt-minion[14967]: +os_privileged_user_name=cinder
Sep 28 12:09:08 ctl02 salt-minion[14967]: +os_privileged_user_password=opnfv_secret
Sep 28 12:09:08 ctl02 salt-minion[14967]: +os_privileged_user_tenant=service
Sep 28 12:09:08 ctl02 salt-minion[14967]: +os_privileged_user_auth_url=http://10.167.4.10:5000/v3/
Sep 28 12:09:08 ctl02 salt-minion[14967]: +
Sep 28 12:09:08 ctl02 salt-minion[14967]: +volume_backend_name=DEFAULT
Sep 28 12:09:08 ctl02 salt-minion[14967]: +
Sep 28 12:09:08 ctl02 salt-minion[14967]: +default_volume_type=lvm-driver
Sep 28 12:09:08 ctl02 salt-minion[14967]: +
Sep 28 12:09:08 ctl02 salt-minion[14967]: +enabled_backends=lvm-driver
Sep 28 12:09:08 ctl02 salt-minion[14967]: +
Sep 28 12:09:08 ctl02 salt-minion[14967]: +
Sep 28 12:09:08 ctl02 salt-minion[14967]: +#RPC response timeout recommended by Hitachi
Sep 28 12:09:08 ctl02 salt-minion[14967]: +rpc_response_timeout=3600
Sep 28 12:09:08 ctl02 salt-minion[14967]: +
Sep 28 12:09:08 ctl02 salt-minion[14967]: +#Rabbit
Sep 28 12:09:08 ctl02 salt-minion[14967]: +control_exchange=cinder
Sep 28 12:09:08 ctl02 salt-minion[14967]: +
Sep 28 12:09:08 ctl02 salt-minion[14967]: +
Sep 28 12:09:08 ctl02 salt-minion[14967]: +volume_clear=none
Sep 28 12:09:08 ctl02 salt-minion[14967]: +
Sep 28 12:09:08 ctl02 salt-minion[14967]: message repeated 2 times: [ +]
Sep 28 12:09:08 ctl02 salt-minion[14967]: +volume_name_template = volume-%s
Sep 28 12:09:08 ctl02 salt-minion[14967]: +
Sep 28 12:09:08 ctl02 salt-minion[14967]: +#volume_group = vg_cinder_volume
Sep 28 12:09:08 ctl02 salt-minion[14967]: +
Sep 28 12:09:08 ctl02 salt-minion[14967]:  volumes_dir = /var/lib/cinder/volumes
Sep 28 12:09:08 ctl02 salt-minion[14967]: +log_dir=/var/log/cinder
Sep 28 12:09:08 ctl02 salt-minion[14967]: +
Sep 28 12:09:08 ctl02 salt-minion[14967]: +# Use syslog for logging. (boolean value)
Sep 28 12:09:08 ctl02 salt-minion[14967]: +#use_syslog=false
Sep 28 12:09:08 ctl02 salt-minion[14967]: +
Sep 28 12:09:08 ctl02 salt-minion[14967]: +use_syslog=false
Sep 28 12:09:08 ctl02 salt-minion[14967]: +verbose=True
Sep 28 12:09:08 ctl02 salt-minion[14967]: +lock_path=/var/lock/cinder
Sep 28 12:09:08 ctl02 salt-minion[14967]: +
Sep 28 12:09:08 ctl02 salt-minion[14967]: +nova_catalog_admin_info = compute:nova:adminURL
Sep 28 12:09:08 ctl02 salt-minion[14967]: +nova_catalog_info = compute:nova:internalURL
Sep 28 12:09:08 ctl02 salt-minion[14967]: +
Sep 28 12:09:08 ctl02 salt-minion[14967]: +osapi_volume_extension = cinder.api.contrib.standard_extensions
Sep 28 12:09:08 ctl02 salt-minion[14967]: +transport_url = rabbit://openstack:opnfv_secret@10.167.4.41:5672,openstack:opnfv_secret@10.167.4.42:5672,openstack:opnfv_secret@10.167.4.43:5672//openstack
Sep 28 12:09:08 ctl02 salt-minion[14967]: +
Sep 28 12:09:08 ctl02 salt-minion[14967]: +[oslo_messaging_notifications]
Sep 28 12:09:08 ctl02 salt-minion[14967]: +driver = messagingv2
Sep 28 12:09:08 ctl02 salt-minion[14967]: +
Sep 28 12:09:08 ctl02 salt-minion[14967]: +[oslo_concurrency]
Sep 28 12:09:08 ctl02 salt-minion[14967]: +
Sep 28 12:09:08 ctl02 salt-minion[14967]: +lock_path=/var/lock/cinder
Sep 28 12:09:08 ctl02 salt-minion[14967]: +
Sep 28 12:09:08 ctl02 salt-minion[14967]: +[oslo_middleware]
Sep 28 12:09:08 ctl02 salt-minion[14967]: +
Sep 28 12:09:08 ctl02 salt-minion[14967]: +enable_proxy_headers_parsing = True
Sep 28 12:09:08 ctl02 salt-minion[14967]: +
Sep 28 12:09:08 ctl02 salt-minion[14967]: +
Sep 28 12:09:08 ctl02 salt-minion[14967]: +[keystone_authtoken]
Sep 28 12:09:08 ctl02 salt-minion[14967]: +signing_dir=/tmp/keystone-signing-cinder
Sep 28 12:09:08 ctl02 salt-minion[14967]: +revocation_cache_time = 10
Sep 28 12:09:08 ctl02 salt-minion[14967]: +auth_type = password
Sep 28 12:09:08 ctl02 salt-minion[14967]: +user_domain_name = Default
Sep 28 12:09:08 ctl02 salt-minion[14967]: +project_domain_name = Default
Sep 28 12:09:08 ctl02 salt-minion[14967]: +project_name = service
Sep 28 12:09:08 ctl02 salt-minion[14967]: +username = cinder
Sep 28 12:09:08 ctl02 salt-minion[14967]: +password = opnfv_secret
Sep 28 12:09:08 ctl02 salt-minion[14967]: +
Sep 28 12:09:08 ctl02 salt-minion[14967]: +auth_uri=http://10.167.4.10:5000
Sep 28 12:09:08 ctl02 salt-minion[14967]: +auth_url=http://10.167.4.10:35357
Sep 28 12:09:08 ctl02 salt-minion[14967]: +# Temporary disabled for backward compataiblity
Sep 28 12:09:08 ctl02 salt-minion[14967]: +#auth_uri=http://10.167.4.10/identity
Sep 28 12:09:08 ctl02 salt-minion[14967]: +#auth_url=http://10.167.4.10/identity_v2_admin
Sep 28 12:09:08 ctl02 salt-minion[14967]: +memcached_servers=10.167.4.11:11211,10.167.4.12:11211,10.167.4.13:11211,10.167.4.11:11211,10.167.4.12:11211,10.167.4.13:11211
Sep 28 12:09:08 ctl02 salt-minion[14967]: +auth_version = v3
Sep 28 12:09:08 ctl02 salt-minion[14967]: +
Sep 28 12:09:08 ctl02 salt-minion[14967]: +[barbican]
Sep 28 12:09:08 ctl02 salt-minion[14967]: +auth_endpoint=http://10.167.4.10:5000
Sep 28 12:09:08 ctl02 salt-minion[14967]: +
Sep 28 12:09:08 ctl02 salt-minion[14967]: +[database]
Sep 28 12:09:08 ctl02 salt-minion[14967]: +idle_timeout=3600
Sep 28 12:09:08 ctl02 salt-minion[14967]: +max_pool_size=30
Sep 28 12:09:08 ctl02 salt-minion[14967]: +max_retries=-1
Sep 28 12:09:08 ctl02 salt-minion[14967]: +max_overflow=40
Sep 28 12:09:08 ctl02 salt-minion[14967]: +connection = mysql+pymysql://cinder:opnfv_secret@10.167.4.50/cinder?charset=utf8
Sep 28 12:09:08 ctl02 salt-minion[14967]: +[lvm-driver]
Sep 28 12:09:08 ctl02 salt-minion[14967]: +host=ctl02
Sep 28 12:09:08 ctl02 salt-minion[14967]: +volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver
Sep 28 12:09:08 ctl02 salt-minion[14967]: +volume_backend_name=lvm-driver
Sep 28 12:09:08 ctl02 salt-minion[14967]: +lvm_type = default
Sep 28 12:09:08 ctl02 salt-minion[14967]: +iscsi_helper = tgtadm
Sep 28 12:09:08 ctl02 salt-minion[14967]: +volume_group = cinder-volume
Sep 28 12:09:08 ctl02 salt-minion[14967]: +
Sep 28 12:09:08 ctl02 salt-minion[14967]: +[cors]
Sep 28 12:09:08 ctl02 salt-minion[14967]: +
Sep 28 12:09:08 ctl02 salt-minion[14967]: +#
Sep 28 12:09:08 ctl02 salt-minion[14967]: +# From oslo.middleware.cors
Sep 28 12:09:08 ctl02 salt-minion[14967]: +#
Sep 28 12:09:08 ctl02 salt-minion[14967]: +
Sep 28 12:09:08 ctl02 salt-minion[14967]: +# Indicate whether this resource may be shared with the domain
Sep 28 12:09:08 ctl02 salt-minion[14967]: +# received in the requests "origin" header. (list value)
Sep 28 12:09:08 ctl02 salt-minion[14967]: +#allowed_origin = <None>
Sep 28 12:09:08 ctl02 salt-minion[14967]: +
Sep 28 12:09:08 ctl02 salt-minion[14967]: +# Indicate that the actual request can include user credentials
Sep 28 12:09:08 ctl02 salt-minion[14967]: +# (boolean value)
Sep 28 12:09:08 ctl02 salt-minion[14967]: +#allow_credentials = true
Sep 28 12:09:08 ctl02 salt-minion[14967]: +
Sep 28 12:09:08 ctl02 salt-minion[14967]: +# Indicate which headers are safe to expose to the API. Defaults to
Sep 28 12:09:08 ctl02 salt-minion[14967]: +# HTTP Simple Headers. (list value)
Sep 28 12:09:08 ctl02 salt-minion[14967]: +#expose_headers = X-Image-Meta-Checksum,X-Auth-Token,X-Subject-Token,X-Service-Token,X-OpenStack-Request-ID
Sep 28 12:09:08 ctl02 salt-minion[14967]: +
Sep 28 12:09:08 ctl02 salt-minion[14967]: +# Maximum cache age of CORS preflight requests. (integer value)
Sep 28 12:09:08 ctl02 salt-minion[14967]: +#max_age = 3600
Sep 28 12:09:08 ctl02 salt-minion[14967]: +
Sep 28 12:09:08 ctl02 salt-minion[14967]: +# Indicate which methods can be used during the actual request. (list
Sep 28 12:09:08 ctl02 salt-minion[14967]: +# value)
Sep 28 12:09:08 ctl02 salt-minion[14967]: +#allow_methods = GET,PUT,POST,DELETE,PATCH
Sep 28 12:09:08 ctl02 salt-minion[14967]: +
Sep 28 12:09:08 ctl02 salt-minion[14967]: +# Indicate which header field names may be used during the actual
Sep 28 12:09:08 ctl02 salt-minion[14967]: +# request. (list value)
Sep 28 12:09:08 ctl02 salt-minion[14967]: +#allow_headers = Content-MD5,X-Image-Meta-Checksum,X-Storage-Token,Accept-Encoding,X-Auth-Token,X-Identity-Status,X-Roles,X-Service-Catalog,X-User-Id,X-Tenant-Id,X-OpenStack-Request-ID
Sep 28 12:09:08 ctl02 salt-minion[14967]: [INFO    ] Completed state [/etc/cinder/cinder.conf] at time 12:09:08.688362 duration_in_ms=201.689
Sep 28 12:09:08 ctl02 salt-minion[14967]: [INFO    ] Running state [/etc/cinder/api-paste.ini] at time 12:09:08.688781
Sep 28 12:09:08 ctl02 salt-minion[14967]: [INFO    ] Executing state file.managed for /etc/cinder/api-paste.ini
Sep 28 12:09:08 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'cinder/files/ocata/api-paste.ini.controller.Debian'
Sep 28 12:09:08 ctl02 cinder-scheduler[22980]: 2017-09-28 12:09:08.714 22980 INFO root [-] Generating grammar tables from /usr/lib/python2.7/lib2to3/Grammar.txt
Sep 28 12:09:08 ctl02 cinder-scheduler[22980]: 2017-09-28 12:09:08.730 22980 INFO root [-] Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt
Sep 28 12:09:08 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'cinder/map.jinja'
Sep 28 12:09:08 ctl02 cinder-api[23013]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:09:08 ctl02 cinder-api[23013]: 2017-09-28 12:09:08.748 23013 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:09:08 ctl02 cinder-scheduler[22980]: 2017-09-28 12:09:08.763 22980 WARNING py.warnings [req-66e26842-cdbf-4b09-9458-0d59a7e94e7c - - - - -] /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/enginefacade.py:241: NotSupportedWarning: Configuration option(s) ['use_tpool'] not supported
Sep 28 12:09:08 ctl02 cinder-scheduler[22980]:   exception.NotSupportedWarning
Sep 28 12:09:08 ctl02 salt-minion[14967]: [INFO    ] File changed:
Sep 28 12:09:08 ctl02 salt-minion[14967]: ---
Sep 28 12:09:08 ctl02 salt-minion[14967]: +++
Sep 28 12:09:08 ctl02 salt-minion[14967]: @@ -47,7 +47,7 @@
Sep 28 12:09:08 ctl02 salt-minion[14967]:  paste.filter_factory = cinder.api.middleware.auth:NoAuthMiddleware.factory
Sep 28 12:09:08 ctl02 salt-minion[14967]:  
Sep 28 12:09:08 ctl02 salt-minion[14967]:  [filter:sizelimit]
Sep 28 12:09:08 ctl02 salt-minion[14967]: -paste.filter_factory = cinder.api.middleware.sizelimit:RequestBodySizeLimiter.factory
Sep 28 12:09:08 ctl02 salt-minion[14967]: +paste.filter_factory = oslo_middleware.sizelimit:RequestBodySizeLimiter.factory
Sep 28 12:09:08 ctl02 salt-minion[14967]:  
Sep 28 12:09:08 ctl02 salt-minion[14967]:  [app:apiv1]
Sep 28 12:09:08 ctl02 salt-minion[14967]:  paste.app_factory = cinder.api.v1.router:APIRouter.factory
Sep 28 12:09:08 ctl02 salt-minion[14967]: @@ -73,3 +73,4 @@
Sep 28 12:09:08 ctl02 salt-minion[14967]:  
Sep 28 12:09:08 ctl02 salt-minion[14967]:  [filter:authtoken]
Sep 28 12:09:08 ctl02 salt-minion[14967]:  paste.filter_factory = keystonemiddleware.auth_token:filter_factory
Sep 28 12:09:08 ctl02 salt-minion[14967]: +
Sep 28 12:09:08 ctl02 salt-minion[14967]: [INFO    ] Completed state [/etc/cinder/api-paste.ini] at time 12:09:08.787031 duration_in_ms=98.248
Sep 28 12:09:08 ctl02 salt-minion[14967]: [INFO    ] Running state [/etc/apache2/conf-available/cinder-wsgi.conf] at time 12:09:08.787302
Sep 28 12:09:08 ctl02 salt-minion[14967]: [INFO    ] Executing state file.managed for /etc/apache2/conf-available/cinder-wsgi.conf
Sep 28 12:09:08 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'cinder/files/ocata/cinder-wsgi.conf'
Sep 28 12:09:08 ctl02 cinder-api[23013]: 2017-09-28 12:09:08.820 23013 WARNING cinder.api [-] The v1 api is deprecated and is not under active development. You should set enable_v1_api=false and enable_v3_api=true in your cinder.conf file.
Sep 28 12:09:08 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'cinder/map.jinja'
Sep 28 12:09:08 ctl02 salt-minion[14967]: [INFO    ] File changed:
Sep 28 12:09:08 ctl02 salt-minion[14967]: New file
Sep 28 12:09:08 ctl02 salt-minion[14967]: [INFO    ] Completed state [/etc/apache2/conf-available/cinder-wsgi.conf] at time 12:09:08.864342 duration_in_ms=77.039
Sep 28 12:09:08 ctl02 cinder-api[23013]: 2017-09-28 12:09:08.926 23013 INFO root [-] Generating grammar tables from /usr/lib/python2.7/lib2to3/Grammar.txt
Sep 28 12:09:08 ctl02 cinder-api[23013]: 2017-09-28 12:09:08.945 23013 INFO root [-] Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt
Sep 28 12:09:08 ctl02 cinder-api[23013]: 2017-09-28 12:09:08.980 23013 INFO cinder.api.extensions [-] Initializing extension manager.
Sep 28 12:09:08 ctl02 cinder-api[23013]: 2017-09-28 12:09:08.982 23013 INFO cinder.api.extensions [-] Loaded extension: os-snapshot-actions
Sep 28 12:09:08 ctl02 cinder-api[23013]: 2017-09-28 12:09:08.983 23013 INFO cinder.api.extensions [-] Loaded extension: os-availability-zone
Sep 28 12:09:08 ctl02 cinder-api[23013]: 2017-09-28 12:09:08.983 23013 INFO cinder.api.extensions [-] Loaded extension: os-hosts
Sep 28 12:09:08 ctl02 cinder-api[23013]: 2017-09-28 12:09:08.984 23013 INFO cinder.api.extensions [-] Loaded extension: os-volume-transfer
Sep 28 12:09:08 ctl02 cinder-api[23013]: 2017-09-28 12:09:08.985 23013 INFO cinder.api.extensions [-] Loaded extension: os-admin-actions
Sep 28 12:09:08 ctl02 cinder-api[23013]: 2017-09-28 12:09:08.986 23013 INFO cinder.api.extensions [-] Loaded extension: os-vol-host-attr
Sep 28 12:09:08 ctl02 cinder-api[23013]: 2017-09-28 12:09:08.986 23013 INFO cinder.api.extensions [-] Loaded extension: os-vol-tenant-attr
Sep 28 12:09:08 ctl02 cinder-api[23013]: 2017-09-28 12:09:08.987 23013 INFO cinder.api.extensions [-] Loaded extension: os-snapshot-manage
Sep 28 12:09:08 ctl02 cinder-api[23013]: 2017-09-28 12:09:08.987 23013 INFO cinder.api.extensions [-] Loaded extension: capabilities
Sep 28 12:09:08 ctl02 cinder-api[23013]: 2017-09-28 12:09:08.988 23013 INFO cinder.api.extensions [-] Loaded extension: cgsnapshots
Sep 28 12:09:08 ctl02 cinder-api[23013]: 2017-09-28 12:09:08.989 23013 INFO cinder.api.extensions [-] Loaded extension: os-quota-class-sets
Sep 28 12:09:08 ctl02 cinder-api[23013]: 2017-09-28 12:09:08.989 23013 INFO cinder.api.extensions [-] Loaded extension: os-extended-services
Sep 28 12:09:08 ctl02 cinder-api[23013]: 2017-09-28 12:09:08.989 23013 INFO cinder.api.extensions [-] Loaded extension: os-volume-encryption-metadata
Sep 28 12:09:08 ctl02 cinder-api[23013]: 2017-09-28 12:09:08.990 23013 INFO cinder.api.extensions [-] Loaded extension: os-image-create
Sep 28 12:09:08 ctl02 cinder-api[23013]: 2017-09-28 12:09:08.992 23013 INFO cinder.api.extensions [-] Loaded extension: os-volume-actions
Sep 28 12:09:08 ctl02 cinder-api[23013]: 2017-09-28 12:09:08.992 23013 INFO cinder.api.extensions [-] Loaded extension: scheduler-stats
Sep 28 12:09:08 ctl02 cinder-api[23013]: 2017-09-28 12:09:08.993 23013 INFO cinder.api.extensions [-] Loaded extension: encryption
Sep 28 12:09:08 ctl02 cinder-api[23013]: 2017-09-28 12:09:08.993 23013 INFO cinder.api.extensions [-] Loaded extension: os-services
Sep 28 12:09:08 ctl02 cinder-api[23013]: 2017-09-28 12:09:08.994 23013 INFO cinder.api.extensions [-] Loaded extension: qos-specs
Sep 28 12:09:08 ctl02 cinder-api[23013]: 2017-09-28 12:09:08.994 23013 INFO cinder.api.extensions [-] Loaded extension: OS-SCH-HNT
Sep 28 12:09:08 ctl02 cinder-api[23013]: 2017-09-28 12:09:08.995 23013 INFO cinder.api.extensions [-] Loaded extension: backups
Sep 28 12:09:08 ctl02 cinder-api[23013]: 2017-09-28 12:09:08.996 23013 INFO cinder.api.extensions [-] Loaded extension: consistencygroups
Sep 28 12:09:08 ctl02 cinder-api[23013]: 2017-09-28 12:09:08.997 23013 INFO cinder.api.extensions [-] Loaded extension: os-snapshot-unmanage
Sep 28 12:09:08 ctl02 cinder-api[23013]: 2017-09-28 12:09:08.997 23013 INFO cinder.api.extensions [-] Loaded extension: os-volume-unmanage
Sep 28 12:09:08 ctl02 cinder-api[23013]: 2017-09-28 12:09:08.997 23013 INFO cinder.api.extensions [-] Loaded extension: os-vol-mig-status-attr
Sep 28 12:09:08 ctl02 cinder-api[23013]: 2017-09-28 12:09:08.998 23013 INFO cinder.api.extensions [-] Loaded extension: os-types-extra-specs
Sep 28 12:09:08 ctl02 cinder-api[23013]: 2017-09-28 12:09:08.998 23013 INFO cinder.api.extensions [-] Loaded extension: os-volume-manage
Sep 28 12:09:08 ctl02 cinder-api[23013]: 2017-09-28 12:09:08.999 23013 INFO cinder.api.extensions [-] Loaded extension: os-used-limits
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.000 23013 INFO cinder.api.extensions [-] Loaded extension: os-volume-type-access
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.000 23013 INFO cinder.api.extensions [-] Loaded extension: os-vol-image-meta
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.001 23013 INFO cinder.api.extensions [-] Loaded extension: os-quota-sets
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.001 23013 INFO cinder.api.extensions [-] Loaded extension: os-types-manage
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.002 23013 INFO cinder.api.extensions [-] Loaded extension: os-extended-snapshot-attributes
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.003 23013 WARNING py.warnings [req-fdbad539-9c6d-4904-ac77-7b81a3f909cc - - - - -] /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/enginefacade.py:241: NotSupportedWarning: Configuration option(s) ['use_tpool'] not supported
Sep 28 12:09:09 ctl02 cinder-api[23013]:   exception.NotSupportedWarning
Sep 28 12:09:09 ctl02 salt-minion[14967]: [INFO    ] Running state [apache2] at time 12:09:09.007884
Sep 28 12:09:09 ctl02 salt-minion[14967]: [INFO    ] Executing state service.running for apache2
Sep 28 12:09:09 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'status', 'apache2.service', '-n', '0'] in directory '/root'
Sep 28 12:09:09 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-active', 'apache2.service'] in directory '/root'
Sep 28 12:09:09 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-enabled', 'apache2.service'] in directory '/root'
Sep 28 12:09:09 ctl02 cinder-scheduler[22980]: 2017-09-28 12:09:09.040 22980 INFO cinder.rpc [req-66e26842-cdbf-4b09-9458-0d59a7e94e7c - - - - -] Automatically selected cinder-volume objects version 1.3 as minimum service version.
Sep 28 12:09:09 ctl02 cinder-scheduler[22980]: 2017-09-28 12:09:09.042 22980 INFO cinder.rpc [req-66e26842-cdbf-4b09-9458-0d59a7e94e7c - - - - -] Automatically selected cinder-volume RPC version 1.40 as minimum service version.
Sep 28 12:09:09 ctl02 salt-minion[14967]: [INFO    ] The service apache2 is already running
Sep 28 12:09:09 ctl02 salt-minion[14967]: [INFO    ] Completed state [apache2] at time 12:09:09.047913 duration_in_ms=40.027
Sep 28 12:09:09 ctl02 salt-minion[14967]: [INFO    ] Running state [apache2] at time 12:09:09.048097
Sep 28 12:09:09 ctl02 salt-minion[14967]: [INFO    ] Executing state service.mod_watch for apache2
Sep 28 12:09:09 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-active', 'apache2.service'] in directory '/root'
Sep 28 12:09:09 ctl02 cinder-scheduler[22980]: 2017-09-28 12:09:09.049 22980 WARNING oslo_config.cfg [req-66e26842-cdbf-4b09-9458-0d59a7e94e7c - - - - -] Option "lock_path" from group "DEFAULT" is deprecated. Use option "lock_path" from group "oslo_concurrency".
Sep 28 12:09:09 ctl02 cinder-scheduler[22980]: 2017-09-28 12:09:09.050 22980 INFO cinder.service [-] Starting cinder-scheduler node (version 8.1.1)
Sep 28 12:09:09 ctl02 cinder-scheduler[22980]: 2017-09-28 12:09:09.060 22980 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.
Sep 28 12:09:09 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-enabled', 'apache2.service'] in directory '/root'
Sep 28 12:09:09 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemd-run', '--scope', 'systemctl', 'restart', 'apache2.service'] in directory '/root'
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.078 23013 INFO cinder.rpc [req-fdbad539-9c6d-4904-ac77-7b81a3f909cc - - - - -] Automatically selected cinder-scheduler objects version 1.21 as minimum service version.
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 CRITICAL cinder [req-fdbad539-9c6d-4904-ac77-7b81a3f909cc - - - - -] CappedVersionUnknown: Unrecoverable Error: Versioned Objects in DB are capped to unknown version 1.21.
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder Traceback (most recent call last):
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder   File "/usr/bin/cinder-api", line 10, in <module>
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder     sys.exit(main())
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/cmd/api.py", line 61, in main
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder     server = service.WSGIService('osapi_volume')
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/service.py", line 375, in __init__
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder     self.app = self.loader.load_app(name)
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder   File "/usr/lib/python2.7/dist-packages/oslo_service/wsgi.py", line 353, in load_app
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 272, in loadobj
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder     return context.create()
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 710, in create
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder     return self.object_type.invoke(self)
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 144, in invoke
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder     **context.local_conf)
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/util.py", line 55, in fix_call
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder     val = callable(*args, **kw)
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/api/__init__.py", line 34, in root_app_factory
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder     return paste.urlmap.urlmap_factory(loader, global_conf, **local_conf)
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/urlmap.py", line 28, in urlmap_factory
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder     app = loader.get_app(app_name, global_conf=global_conf)
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 350, in get_app
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder     name=name, global_conf=global_conf).create()
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 710, in create
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder     return self.object_type.invoke(self)
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 144, in invoke
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder     **context.local_conf)
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/util.py", line 55, in fix_call
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder     val = callable(*args, **kw)
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/api/middleware/auth.py", line 56, in pipeline_factory
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder     app = loader.get_app(pipeline[-1])
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 350, in get_app
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder     name=name, global_conf=global_conf).create()
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 710, in create
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder     return self.object_type.invoke(self)
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 146, in invoke
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder     return fix_call(context.object, context.global_conf, **context.local_conf)
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/util.py", line 55, in fix_call
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder     val = callable(*args, **kw)
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/api/openstack/__init__.py", line 72, in factory
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder     return cls()
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/api/openstack/__init__.py", line 83, in __init__
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder     self._setup_routes(mapper, ext_mgr)
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/api/v2/router.py", line 50, in _setup_routes
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder     self.resources['volumes'] = volumes.create_resource(ext_mgr)
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/api/v2/volumes.py", line 473, in create_resource
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder     return wsgi.Resource(VolumeController(ext_mgr))
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/api/v2/volumes.py", line 165, in __init__
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder     self.volume_api = cinder_volume.API()
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/volume/__init__.py", line 30, in API
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder     return importutils.import_object(class_name, *args, **kwargs)
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder   File "/usr/lib/python2.7/dist-packages/oslo_utils/importutils.py", line 44, in import_object
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder     return import_class(import_str)(*args, **kwargs)
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/volume/api.py", line 130, in __init__
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder     self.scheduler_rpcapi = scheduler_rpcapi.SchedulerAPI()
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/rpc.py", line 188, in __init__
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder     serializer = base.CinderObjectSerializer(obj_version_cap)
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/objects/base.py", line 412, in __init__
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder     raise exception.CappedVersionUnknown(version=version_cap)
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder CappedVersionUnknown: Unrecoverable Error: Versioned Objects in DB are capped to unknown version 1.21.
Sep 28 12:09:09 ctl02 cinder-api[23013]: 2017-09-28 12:09:09.079 23013 ERROR cinder
Sep 28 12:09:09 ctl02 systemd[1]: Started /bin/systemctl restart apache2.service.
Sep 28 12:09:09 ctl02 systemd[1]: Stopping LSB: Apache2 web server...
Sep 28 12:09:09 ctl02 apache2[23107]:  * Stopping Apache httpd web server apache2
Sep 28 12:09:09 ctl02 systemd[1]: cinder-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:09:09 ctl02 systemd[1]: cinder-api.service: Unit entered failed state.
Sep 28 12:09:09 ctl02 systemd[1]: cinder-api.service: Failed with result 'exit-code'.
Sep 28 12:09:09 ctl02 systemd[1]: cinder-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:09:09 ctl02 systemd[1]: Stopped OpenStack Cinder Api.
Sep 28 12:09:09 ctl02 apache2[23107]:  *
Sep 28 12:09:09 ctl02 apache2[23107]:  * The apache2 configtest failed, so we are trying to kill it manually. This is almost certainly suboptimal, so please make sure your system is working as you'd expect now!
Sep 28 12:09:09 ctl02 systemd[1]: Starting OpenStack Cinder Api...
Sep 28 12:09:09 ctl02 systemd[1]: Stopped LSB: Apache2 web server.
Sep 28 12:09:09 ctl02 systemd[1]: Starting LSB: Apache2 web server...
Sep 28 12:09:09 ctl02 systemd[1]: Started OpenStack Cinder Api.
Sep 28 12:09:09 ctl02 apache2[23140]:  * Starting Apache httpd web server apache2
Sep 28 12:09:09 ctl02 apache2[23140]:  *
Sep 28 12:09:09 ctl02 apache2[23140]:  * The apache2 configtest failed.
Sep 28 12:09:09 ctl02 apache2[23140]: Output of config test was:
Sep 28 12:09:09 ctl02 apache2[23140]: apache2: Syntax error on line 219 of /etc/apache2/apache2.conf: Could not open configuration file /etc/apache2/sites-enabled/nova-placement-api.conf: No such file or directory
Sep 28 12:09:09 ctl02 apache2[23140]: Action 'configtest' failed.
Sep 28 12:09:09 ctl02 apache2[23140]: The Apache error log may have more information.
Sep 28 12:09:09 ctl02 systemd[1]: apache2.service: Control process exited, code=exited status=1
Sep 28 12:09:09 ctl02 systemd[1]: Failed to start LSB: Apache2 web server.
Sep 28 12:09:09 ctl02 systemd[1]: apache2.service: Unit entered failed state.
Sep 28 12:09:09 ctl02 systemd[1]: apache2.service: Failed with result 'exit-code'.
Sep 28 12:09:09 ctl02 salt-minion[14967]: [ERROR   ] Command '['systemd-run', '--scope', 'systemctl', 'restart', 'apache2.service']' failed with return code: 1
Sep 28 12:09:09 ctl02 salt-minion[14967]: [ERROR   ] output: Running scope as unit run-rebe77c2e75f643ab8dc59643186a864d.scope.
Sep 28 12:09:09 ctl02 salt-minion[14967]: Job for apache2.service failed because the control process exited with error code. See "systemctl status apache2.service" and "journalctl -xe" for details.
Sep 28 12:09:09 ctl02 salt-minion[14967]: [ERROR   ] {'apache2': False}
Sep 28 12:09:09 ctl02 salt-minion[14967]: [INFO    ] Completed state [apache2] at time 12:09:09.444048 duration_in_ms=395.95
Sep 28 12:09:09 ctl02 salt-minion[14967]: [INFO    ] Running state [cinder-scheduler] at time 12:09:09.444509
Sep 28 12:09:09 ctl02 salt-minion[14967]: [INFO    ] Executing state service.running for cinder-scheduler
Sep 28 12:09:09 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'status', 'cinder-scheduler.service', '-n', '0'] in directory '/root'
Sep 28 12:09:09 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-active', 'cinder-scheduler.service'] in directory '/root'
Sep 28 12:09:09 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-enabled', 'cinder-scheduler.service'] in directory '/root'
Sep 28 12:09:09 ctl02 salt-minion[14967]: [INFO    ] The service cinder-scheduler is already running
Sep 28 12:09:09 ctl02 salt-minion[14967]: [INFO    ] Completed state [cinder-scheduler] at time 12:09:09.494712 duration_in_ms=50.202
Sep 28 12:09:09 ctl02 salt-minion[14967]: [INFO    ] Running state [cinder-scheduler] at time 12:09:09.494891
Sep 28 12:09:09 ctl02 salt-minion[14967]: [INFO    ] Executing state service.mod_watch for cinder-scheduler
Sep 28 12:09:09 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-active', 'cinder-scheduler.service'] in directory '/root'
Sep 28 12:09:09 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-enabled', 'cinder-scheduler.service'] in directory '/root'
Sep 28 12:09:09 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemd-run', '--scope', 'systemctl', 'restart', 'cinder-scheduler.service'] in directory '/root'
Sep 28 12:09:09 ctl02 systemd[1]: Started /bin/systemctl restart cinder-scheduler.service.
Sep 28 12:09:09 ctl02 systemd[1]: Stopping OpenStack Cinder Scheduler...
Sep 28 12:09:09 ctl02 nova-api[23036]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:09:09 ctl02 nova-api[23036]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:09:10 ctl02 cinder-scheduler[22980]: 2017-09-28 12:09:10.065 22980 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 2 seconds.
Sep 28 12:09:10 ctl02 nova-api[23036]: 2017-09-28 12:09:10.077 23036 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:09:10 ctl02 nova-api[23036]: 2017-09-28 12:09:10.079 23036 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:09:10 ctl02 nova-api[23036]: 2017-09-28 12:09:10.079 23036 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:09:10 ctl02 nova-api[23036]: 2017-09-28 12:09:10.079 23036 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:09:10 ctl02 nova-api[23036]: 2017-09-28 12:09:10.079 23036 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:09:10 ctl02 nova-api[23036]: 2017-09-28 12:09:10.079 23036 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:09:10 ctl02 nova-api[23036]: 2017-09-28 12:09:10.079 23036 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:09:10 ctl02 nova-api[23036]: 2017-09-28 12:09:10.079 23036 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:09:10 ctl02 nova-api[23036]: 2017-09-28 12:09:10.079 23036 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:09:10 ctl02 nova-api[23036]: 2017-09-28 12:09:10.079 23036 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:09:10 ctl02 nova-api[23036]: 2017-09-28 12:09:10.079 23036 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:09:10 ctl02 nova-api[23036]: 2017-09-28 12:09:10.079 23036 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:09:10 ctl02 nova-api[23036]: 2017-09-28 12:09:10.079 23036 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:09:10 ctl02 nova-api[23036]: 2017-09-28 12:09:10.079 23036 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:09:10 ctl02 nova-api[23036]: 2017-09-28 12:09:10.079 23036 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:09:10 ctl02 nova-api[23036]: 2017-09-28 12:09:10.079 23036 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:09:10 ctl02 nova-api[23036]: 2017-09-28 12:09:10.079 23036 ERROR nova.wsgi     self.filename))
Sep 28 12:09:10 ctl02 nova-api[23036]: 2017-09-28 12:09:10.079 23036 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:09:10 ctl02 nova-api[23036]: 2017-09-28 12:09:10.079 23036 ERROR nova.wsgi
Sep 28 12:09:10 ctl02 nova-api[23036]: 2017-09-28 12:09:10.081 23036 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:09:10 ctl02 nova-api[23036]: 2017-09-28 12:09:10.205 23036 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:09:10 ctl02 cinder-api[23150]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.316 23150 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.389 23150 WARNING cinder.api [-] The v1 api is deprecated and is not under active development. You should set enable_v1_api=false and enable_v3_api=true in your cinder.conf file.
Sep 28 12:09:10 ctl02 nova-conductor[5056]: 2017-09-28 12:09:10.390 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:09:10 ctl02 nova-conductor[5056]: 2017-09-28 12:09:10.404 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:09:10 ctl02 nova-conductor[5056]: 2017-09-28 12:09:10.407 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:09:10 ctl02 nova-conductor[5056]: 2017-09-28 12:09:10.411 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:09:10 ctl02 nova-api[23036]: 2017-09-28 12:09:10.427 23036 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:09:10 ctl02 nova-api[23036]: 2017-09-28 12:09:10.430 23036 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:09:10 ctl02 nova-api[23036]: 2017-09-28 12:09:10.430 23036 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:09:10 ctl02 nova-api[23036]: 2017-09-28 12:09:10.430 23036 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:09:10 ctl02 heat-api-cfn[13300]: 2017-09-28 12:09:10.470 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:09:10] "OPTIONS / HTTP/1.0" 200 134 0.000480
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.502 23150 INFO root [-] Generating grammar tables from /usr/lib/python2.7/lib2to3/Grammar.txt
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.520 23150 INFO root [-] Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.557 23150 INFO cinder.api.extensions [-] Initializing extension manager.
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.558 23150 INFO cinder.api.extensions [-] Loaded extension: os-snapshot-actions
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.559 23150 INFO cinder.api.extensions [-] Loaded extension: os-availability-zone
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.560 23150 INFO cinder.api.extensions [-] Loaded extension: os-hosts
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.561 23150 INFO cinder.api.extensions [-] Loaded extension: os-volume-transfer
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.562 23150 INFO cinder.api.extensions [-] Loaded extension: os-admin-actions
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.563 23150 INFO cinder.api.extensions [-] Loaded extension: os-vol-host-attr
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.563 23150 INFO cinder.api.extensions [-] Loaded extension: os-vol-tenant-attr
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.564 23150 INFO cinder.api.extensions [-] Loaded extension: os-snapshot-manage
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.564 23150 INFO cinder.api.extensions [-] Loaded extension: capabilities
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.565 23150 INFO cinder.api.extensions [-] Loaded extension: cgsnapshots
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.565 23150 INFO cinder.api.extensions [-] Loaded extension: os-quota-class-sets
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.566 23150 INFO cinder.api.extensions [-] Loaded extension: os-extended-services
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.566 23150 INFO cinder.api.extensions [-] Loaded extension: os-volume-encryption-metadata
Sep 28 12:09:10 ctl02 nova-api[23036]: 2017-09-28 12:09:10.566 23036 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.567 23150 INFO cinder.api.extensions [-] Loaded extension: os-image-create
Sep 28 12:09:10 ctl02 nova-api[23036]: 2017-09-28 12:09:10.568 23036 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:09:10 ctl02 nova-api[23036]: 2017-09-28 12:09:10.568 23036 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:09:10 ctl02 nova-api[23036]: 2017-09-28 12:09:10.569 23036 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.569 23150 INFO cinder.api.extensions [-] Loaded extension: os-volume-actions
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.569 23150 INFO cinder.api.extensions [-] Loaded extension: scheduler-stats
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.570 23150 INFO cinder.api.extensions [-] Loaded extension: encryption
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.570 23150 INFO cinder.api.extensions [-] Loaded extension: os-services
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.571 23150 INFO cinder.api.extensions [-] Loaded extension: qos-specs
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.572 23150 INFO cinder.api.extensions [-] Loaded extension: OS-SCH-HNT
Sep 28 12:09:10 ctl02 nova-api[23036]: 2017-09-28 12:09:10.572 23036 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.572 23150 INFO cinder.api.extensions [-] Loaded extension: backups
Sep 28 12:09:10 ctl02 nova-api[23036]: 2017-09-28 12:09:10.573 23036 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:09:10 ctl02 nova-api[23036]: 2017-09-28 12:09:10.573 23036 ERROR nova Traceback (most recent call last):
Sep 28 12:09:10 ctl02 nova-api[23036]: 2017-09-28 12:09:10.573 23036 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:09:10 ctl02 nova-api[23036]: 2017-09-28 12:09:10.573 23036 ERROR nova     sys.exit(main())
Sep 28 12:09:10 ctl02 nova-api[23036]: 2017-09-28 12:09:10.573 23036 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:09:10 ctl02 nova-api[23036]: 2017-09-28 12:09:10.573 23036 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:09:10 ctl02 nova-api[23036]: 2017-09-28 12:09:10.573 23036 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:09:10 ctl02 nova-api[23036]: 2017-09-28 12:09:10.573 23036 ERROR nova     max_url_len=max_url_len)
Sep 28 12:09:10 ctl02 nova-api[23036]: 2017-09-28 12:09:10.573 23036 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:09:10 ctl02 nova-api[23036]: 2017-09-28 12:09:10.573 23036 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:09:10 ctl02 nova-api[23036]: 2017-09-28 12:09:10.573 23036 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:09:10 ctl02 nova-api[23036]: 2017-09-28 12:09:10.573 23036 ERROR nova     sock.listen(backlog)
Sep 28 12:09:10 ctl02 nova-api[23036]: 2017-09-28 12:09:10.573 23036 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:09:10 ctl02 nova-api[23036]: 2017-09-28 12:09:10.573 23036 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:09:10 ctl02 nova-api[23036]: 2017-09-28 12:09:10.573 23036 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:09:10 ctl02 nova-api[23036]: 2017-09-28 12:09:10.573 23036 ERROR nova
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.573 23150 INFO cinder.api.extensions [-] Loaded extension: consistencygroups
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.574 23150 INFO cinder.api.extensions [-] Loaded extension: os-snapshot-unmanage
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.574 23150 INFO cinder.api.extensions [-] Loaded extension: os-volume-unmanage
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.575 23150 INFO cinder.api.extensions [-] Loaded extension: os-vol-mig-status-attr
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.575 23150 INFO cinder.api.extensions [-] Loaded extension: os-types-extra-specs
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.576 23150 INFO cinder.api.extensions [-] Loaded extension: os-volume-manage
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.576 23150 INFO cinder.api.extensions [-] Loaded extension: os-used-limits
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.577 23150 INFO cinder.api.extensions [-] Loaded extension: os-volume-type-access
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.577 23150 INFO cinder.api.extensions [-] Loaded extension: os-vol-image-meta
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.578 23150 INFO cinder.api.extensions [-] Loaded extension: os-quota-sets
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.579 23150 INFO cinder.api.extensions [-] Loaded extension: os-types-manage
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.579 23150 INFO cinder.api.extensions [-] Loaded extension: os-extended-snapshot-attributes
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.581 23150 WARNING py.warnings [req-17322e3c-06d0-4695-86bd-b8dd962130c7 - - - - -] /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/enginefacade.py:241: NotSupportedWarning: Configuration option(s) ['use_tpool'] not supported
Sep 28 12:09:10 ctl02 cinder-api[23150]:   exception.NotSupportedWarning
Sep 28 12:09:10 ctl02 heat-api-cfn[13300]: 2017-09-28 12:09:10.582 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:09:10] "OPTIONS / HTTP/1.0" 200 134 0.000435
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.652 23150 INFO cinder.rpc [req-17322e3c-06d0-4695-86bd-b8dd962130c7 - - - - -] Automatically selected cinder-scheduler objects version 1.21 as minimum service version.
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 CRITICAL cinder [req-17322e3c-06d0-4695-86bd-b8dd962130c7 - - - - -] CappedVersionUnknown: Unrecoverable Error: Versioned Objects in DB are capped to unknown version 1.21.
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder Traceback (most recent call last):
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder   File "/usr/bin/cinder-api", line 10, in <module>
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder     sys.exit(main())
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/cmd/api.py", line 61, in main
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder     server = service.WSGIService('osapi_volume')
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/service.py", line 375, in __init__
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder     self.app = self.loader.load_app(name)
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder   File "/usr/lib/python2.7/dist-packages/oslo_service/wsgi.py", line 353, in load_app
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 272, in loadobj
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder     return context.create()
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 710, in create
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder     return self.object_type.invoke(self)
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 144, in invoke
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder     **context.local_conf)
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/util.py", line 55, in fix_call
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder     val = callable(*args, **kw)
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/api/__init__.py", line 34, in root_app_factory
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder     return paste.urlmap.urlmap_factory(loader, global_conf, **local_conf)
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/urlmap.py", line 28, in urlmap_factory
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder     app = loader.get_app(app_name, global_conf=global_conf)
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 350, in get_app
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder     name=name, global_conf=global_conf).create()
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 710, in create
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder     return self.object_type.invoke(self)
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 144, in invoke
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder     **context.local_conf)
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/util.py", line 55, in fix_call
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder     val = callable(*args, **kw)
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/api/middleware/auth.py", line 56, in pipeline_factory
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder     app = loader.get_app(pipeline[-1])
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 350, in get_app
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder     name=name, global_conf=global_conf).create()
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 710, in create
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder     return self.object_type.invoke(self)
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 146, in invoke
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder     return fix_call(context.object, context.global_conf, **context.local_conf)
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/util.py", line 55, in fix_call
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder     val = callable(*args, **kw)
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/api/openstack/__init__.py", line 72, in factory
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder     return cls()
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/api/openstack/__init__.py", line 83, in __init__
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder     self._setup_routes(mapper, ext_mgr)
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/api/v2/router.py", line 50, in _setup_routes
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder     self.resources['volumes'] = volumes.create_resource(ext_mgr)
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/api/v2/volumes.py", line 473, in create_resource
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder     return wsgi.Resource(VolumeController(ext_mgr))
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/api/v2/volumes.py", line 165, in __init__
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder     self.volume_api = cinder_volume.API()
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/volume/__init__.py", line 30, in API
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder     return importutils.import_object(class_name, *args, **kwargs)
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder   File "/usr/lib/python2.7/dist-packages/oslo_utils/importutils.py", line 44, in import_object
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder     return import_class(import_str)(*args, **kwargs)
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/volume/api.py", line 130, in __init__
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder     self.scheduler_rpcapi = scheduler_rpcapi.SchedulerAPI()
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/rpc.py", line 188, in __init__
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder     serializer = base.CinderObjectSerializer(obj_version_cap)
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/objects/base.py", line 412, in __init__
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder     raise exception.CappedVersionUnknown(version=version_cap)
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder CappedVersionUnknown: Unrecoverable Error: Versioned Objects in DB are capped to unknown version 1.21.
Sep 28 12:09:10 ctl02 cinder-api[23150]: 2017-09-28 12:09:10.653 23150 ERROR cinder
Sep 28 12:09:10 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:09:10 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:09:10 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:09:10 ctl02 systemd[1]: cinder-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:09:10 ctl02 systemd[1]: cinder-api.service: Unit entered failed state.
Sep 28 12:09:10 ctl02 systemd[1]: cinder-api.service: Failed with result 'exit-code'.
Sep 28 12:09:10 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:09:10 ctl02 systemd[1]: cinder-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:09:10 ctl02 systemd[1]: Stopped OpenStack Cinder Api.
Sep 28 12:09:10 ctl02 systemd[1]: Starting OpenStack Cinder Api...
Sep 28 12:09:10 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:09:10 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:09:10 ctl02 systemd[1]: Started OpenStack Cinder Api.
Sep 28 12:09:10 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:09:11 ctl02 glance-api[29183]: 2017-09-28 12:09:11.338 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:09:11] "OPTIONS / HTTP/1.0" 200 134 0.000581
Sep 28 12:09:11 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:09:11.379 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:09:11] "OPTIONS / HTTP/1.0" 200 134 0.000410
Sep 28 12:09:11 ctl02 cinder-api[23191]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:09:11 ctl02 cinder-api[23191]: 2017-09-28 12:09:11.769 23191 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:09:11 ctl02 cinder-api[23191]: 2017-09-28 12:09:11.841 23191 WARNING cinder.api [-] The v1 api is deprecated and is not under active development. You should set enable_v1_api=false and enable_v3_api=true in your cinder.conf file.
Sep 28 12:09:11 ctl02 cinder-api[23191]: 2017-09-28 12:09:11.937 23191 INFO root [-] Generating grammar tables from /usr/lib/python2.7/lib2to3/Grammar.txt
Sep 28 12:09:11 ctl02 cinder-api[23191]: 2017-09-28 12:09:11.955 23191 INFO root [-] Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt
Sep 28 12:09:11 ctl02 cinder-api[23191]: 2017-09-28 12:09:11.990 23191 INFO cinder.api.extensions [-] Initializing extension manager.
Sep 28 12:09:11 ctl02 cinder-api[23191]: 2017-09-28 12:09:11.991 23191 INFO cinder.api.extensions [-] Loaded extension: os-snapshot-actions
Sep 28 12:09:11 ctl02 cinder-api[23191]: 2017-09-28 12:09:11.992 23191 INFO cinder.api.extensions [-] Loaded extension: os-availability-zone
Sep 28 12:09:11 ctl02 cinder-api[23191]: 2017-09-28 12:09:11.993 23191 INFO cinder.api.extensions [-] Loaded extension: os-hosts
Sep 28 12:09:11 ctl02 cinder-api[23191]: 2017-09-28 12:09:11.994 23191 INFO cinder.api.extensions [-] Loaded extension: os-volume-transfer
Sep 28 12:09:11 ctl02 cinder-api[23191]: 2017-09-28 12:09:11.995 23191 INFO cinder.api.extensions [-] Loaded extension: os-admin-actions
Sep 28 12:09:11 ctl02 cinder-api[23191]: 2017-09-28 12:09:11.996 23191 INFO cinder.api.extensions [-] Loaded extension: os-vol-host-attr
Sep 28 12:09:11 ctl02 cinder-api[23191]: 2017-09-28 12:09:11.996 23191 INFO cinder.api.extensions [-] Loaded extension: os-vol-tenant-attr
Sep 28 12:09:11 ctl02 cinder-api[23191]: 2017-09-28 12:09:11.997 23191 INFO cinder.api.extensions [-] Loaded extension: os-snapshot-manage
Sep 28 12:09:11 ctl02 cinder-api[23191]: 2017-09-28 12:09:11.997 23191 INFO cinder.api.extensions [-] Loaded extension: capabilities
Sep 28 12:09:11 ctl02 cinder-api[23191]: 2017-09-28 12:09:11.998 23191 INFO cinder.api.extensions [-] Loaded extension: cgsnapshots
Sep 28 12:09:11 ctl02 cinder-api[23191]: 2017-09-28 12:09:11.999 23191 INFO cinder.api.extensions [-] Loaded extension: os-quota-class-sets
Sep 28 12:09:11 ctl02 cinder-api[23191]: 2017-09-28 12:09:11.999 23191 INFO cinder.api.extensions [-] Loaded extension: os-extended-services
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.000 23191 INFO cinder.api.extensions [-] Loaded extension: os-volume-encryption-metadata
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.000 23191 INFO cinder.api.extensions [-] Loaded extension: os-image-create
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.002 23191 INFO cinder.api.extensions [-] Loaded extension: os-volume-actions
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.003 23191 INFO cinder.api.extensions [-] Loaded extension: scheduler-stats
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.003 23191 INFO cinder.api.extensions [-] Loaded extension: encryption
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.004 23191 INFO cinder.api.extensions [-] Loaded extension: os-services
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.005 23191 INFO cinder.api.extensions [-] Loaded extension: qos-specs
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.005 23191 INFO cinder.api.extensions [-] Loaded extension: OS-SCH-HNT
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.006 23191 INFO cinder.api.extensions [-] Loaded extension: backups
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.007 23191 INFO cinder.api.extensions [-] Loaded extension: consistencygroups
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.008 23191 INFO cinder.api.extensions [-] Loaded extension: os-snapshot-unmanage
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.008 23191 INFO cinder.api.extensions [-] Loaded extension: os-volume-unmanage
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.009 23191 INFO cinder.api.extensions [-] Loaded extension: os-vol-mig-status-attr
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.009 23191 INFO cinder.api.extensions [-] Loaded extension: os-types-extra-specs
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.010 23191 INFO cinder.api.extensions [-] Loaded extension: os-volume-manage
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.010 23191 INFO cinder.api.extensions [-] Loaded extension: os-used-limits
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.011 23191 INFO cinder.api.extensions [-] Loaded extension: os-volume-type-access
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.012 23191 INFO cinder.api.extensions [-] Loaded extension: os-vol-image-meta
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.013 23191 INFO cinder.api.extensions [-] Loaded extension: os-quota-sets
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.013 23191 INFO cinder.api.extensions [-] Loaded extension: os-types-manage
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.014 23191 INFO cinder.api.extensions [-] Loaded extension: os-extended-snapshot-attributes
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.015 23191 WARNING py.warnings [req-4704209a-bae5-4dd6-ba31-89a359e62dcc - - - - -] /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/enginefacade.py:241: NotSupportedWarning: Configuration option(s) ['use_tpool'] not supported
Sep 28 12:09:12 ctl02 cinder-api[23191]:   exception.NotSupportedWarning
Sep 28 12:09:12 ctl02 cinder-scheduler[22980]: 2017-09-28 12:09:12.070 22980 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 4 seconds.
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.085 23191 INFO cinder.rpc [req-4704209a-bae5-4dd6-ba31-89a359e62dcc - - - - -] Automatically selected cinder-scheduler objects version 1.21 as minimum service version.
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 CRITICAL cinder [req-4704209a-bae5-4dd6-ba31-89a359e62dcc - - - - -] CappedVersionUnknown: Unrecoverable Error: Versioned Objects in DB are capped to unknown version 1.21.
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder Traceback (most recent call last):
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder   File "/usr/bin/cinder-api", line 10, in <module>
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder     sys.exit(main())
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/cmd/api.py", line 61, in main
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder     server = service.WSGIService('osapi_volume')
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/service.py", line 375, in __init__
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder     self.app = self.loader.load_app(name)
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder   File "/usr/lib/python2.7/dist-packages/oslo_service/wsgi.py", line 353, in load_app
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 272, in loadobj
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder     return context.create()
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 710, in create
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder     return self.object_type.invoke(self)
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 144, in invoke
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder     **context.local_conf)
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/util.py", line 55, in fix_call
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder     val = callable(*args, **kw)
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/api/__init__.py", line 34, in root_app_factory
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder     return paste.urlmap.urlmap_factory(loader, global_conf, **local_conf)
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/urlmap.py", line 28, in urlmap_factory
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder     app = loader.get_app(app_name, global_conf=global_conf)
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 350, in get_app
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder     name=name, global_conf=global_conf).create()
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 710, in create
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder     return self.object_type.invoke(self)
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 144, in invoke
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder     **context.local_conf)
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/util.py", line 55, in fix_call
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder     val = callable(*args, **kw)
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/api/middleware/auth.py", line 56, in pipeline_factory
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder     app = loader.get_app(pipeline[-1])
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 350, in get_app
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder     name=name, global_conf=global_conf).create()
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 710, in create
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder     return self.object_type.invoke(self)
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 146, in invoke
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder     return fix_call(context.object, context.global_conf, **context.local_conf)
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/util.py", line 55, in fix_call
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder     val = callable(*args, **kw)
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/api/openstack/__init__.py", line 72, in factory
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder     return cls()
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/api/openstack/__init__.py", line 83, in __init__
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder     self._setup_routes(mapper, ext_mgr)
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/api/v2/router.py", line 50, in _setup_routes
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder     self.resources['volumes'] = volumes.create_resource(ext_mgr)
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/api/v2/volumes.py", line 473, in create_resource
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder     return wsgi.Resource(VolumeController(ext_mgr))
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/api/v2/volumes.py", line 165, in __init__
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder     self.volume_api = cinder_volume.API()
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/volume/__init__.py", line 30, in API
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder     return importutils.import_object(class_name, *args, **kwargs)
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder   File "/usr/lib/python2.7/dist-packages/oslo_utils/importutils.py", line 44, in import_object
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder     return import_class(import_str)(*args, **kwargs)
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/volume/api.py", line 130, in __init__
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder     self.scheduler_rpcapi = scheduler_rpcapi.SchedulerAPI()
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/rpc.py", line 188, in __init__
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder     serializer = base.CinderObjectSerializer(obj_version_cap)
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/objects/base.py", line 412, in __init__
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder     raise exception.CappedVersionUnknown(version=version_cap)
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder CappedVersionUnknown: Unrecoverable Error: Versioned Objects in DB are capped to unknown version 1.21.
Sep 28 12:09:12 ctl02 cinder-api[23191]: 2017-09-28 12:09:12.086 23191 ERROR cinder
Sep 28 12:09:12 ctl02 systemd[1]: cinder-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:09:12 ctl02 systemd[1]: cinder-api.service: Unit entered failed state.
Sep 28 12:09:12 ctl02 systemd[1]: cinder-api.service: Failed with result 'exit-code'.
Sep 28 12:09:12 ctl02 systemd[1]: cinder-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:09:12 ctl02 systemd[1]: Stopped OpenStack Cinder Api.
Sep 28 12:09:12 ctl02 systemd[1]: Starting OpenStack Cinder Api...
Sep 28 12:09:12 ctl02 systemd[1]: Started OpenStack Cinder Api.
Sep 28 12:09:12 ctl02 heat-api[13008]: 2017-09-28 12:09:12.501 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:09:12] "OPTIONS / HTTP/1.0" 200 134 0.000732
Sep 28 12:09:12 ctl02 nova-api[23195]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:09:12 ctl02 nova-api[23195]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:09:12 ctl02 nova-api[23195]: 2017-09-28 12:09:12.721 23195 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:09:12 ctl02 nova-api[23195]: 2017-09-28 12:09:12.723 23195 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:09:12 ctl02 nova-api[23195]: 2017-09-28 12:09:12.723 23195 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:09:12 ctl02 nova-api[23195]: 2017-09-28 12:09:12.723 23195 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:09:12 ctl02 nova-api[23195]: 2017-09-28 12:09:12.723 23195 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:09:12 ctl02 nova-api[23195]: 2017-09-28 12:09:12.723 23195 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:09:12 ctl02 nova-api[23195]: 2017-09-28 12:09:12.723 23195 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:09:12 ctl02 nova-api[23195]: 2017-09-28 12:09:12.723 23195 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:09:12 ctl02 nova-api[23195]: 2017-09-28 12:09:12.723 23195 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:09:12 ctl02 nova-api[23195]: 2017-09-28 12:09:12.723 23195 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:09:12 ctl02 nova-api[23195]: 2017-09-28 12:09:12.723 23195 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:09:12 ctl02 nova-api[23195]: 2017-09-28 12:09:12.723 23195 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:09:12 ctl02 nova-api[23195]: 2017-09-28 12:09:12.723 23195 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:09:12 ctl02 nova-api[23195]: 2017-09-28 12:09:12.723 23195 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:09:12 ctl02 nova-api[23195]: 2017-09-28 12:09:12.723 23195 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:09:12 ctl02 nova-api[23195]: 2017-09-28 12:09:12.723 23195 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:09:12 ctl02 nova-api[23195]: 2017-09-28 12:09:12.723 23195 ERROR nova.wsgi     self.filename))
Sep 28 12:09:12 ctl02 nova-api[23195]: 2017-09-28 12:09:12.723 23195 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:09:12 ctl02 nova-api[23195]: 2017-09-28 12:09:12.723 23195 ERROR nova.wsgi
Sep 28 12:09:12 ctl02 nova-api[23195]: 2017-09-28 12:09:12.724 23195 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:09:12 ctl02 nova-api[23195]: 2017-09-28 12:09:12.855 23195 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:09:13 ctl02 nova-api[23195]: 2017-09-28 12:09:13.088 23195 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:09:13 ctl02 nova-api[23195]: 2017-09-28 12:09:13.090 23195 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:09:13 ctl02 nova-api[23195]: 2017-09-28 12:09:13.090 23195 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:09:13 ctl02 nova-api[23195]: 2017-09-28 12:09:13.091 23195 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:09:13 ctl02 nova-api[23195]: 2017-09-28 12:09:13.224 23195 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:09:13 ctl02 nova-api[23195]: 2017-09-28 12:09:13.226 23195 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:09:13 ctl02 nova-api[23195]: 2017-09-28 12:09:13.227 23195 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:09:13 ctl02 nova-api[23195]: 2017-09-28 12:09:13.227 23195 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:09:13 ctl02 nova-api[23195]: 2017-09-28 12:09:13.230 23195 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:09:13 ctl02 nova-api[23195]: 2017-09-28 12:09:13.230 23195 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:09:13 ctl02 nova-api[23195]: 2017-09-28 12:09:13.230 23195 ERROR nova Traceback (most recent call last):
Sep 28 12:09:13 ctl02 nova-api[23195]: 2017-09-28 12:09:13.230 23195 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:09:13 ctl02 nova-api[23195]: 2017-09-28 12:09:13.230 23195 ERROR nova     sys.exit(main())
Sep 28 12:09:13 ctl02 nova-api[23195]: 2017-09-28 12:09:13.230 23195 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:09:13 ctl02 nova-api[23195]: 2017-09-28 12:09:13.230 23195 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:09:13 ctl02 nova-api[23195]: 2017-09-28 12:09:13.230 23195 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:09:13 ctl02 nova-api[23195]: 2017-09-28 12:09:13.230 23195 ERROR nova     max_url_len=max_url_len)
Sep 28 12:09:13 ctl02 nova-api[23195]: 2017-09-28 12:09:13.230 23195 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:09:13 ctl02 nova-api[23195]: 2017-09-28 12:09:13.230 23195 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:09:13 ctl02 nova-api[23195]: 2017-09-28 12:09:13.230 23195 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:09:13 ctl02 nova-api[23195]: 2017-09-28 12:09:13.230 23195 ERROR nova     sock.listen(backlog)
Sep 28 12:09:13 ctl02 nova-api[23195]: 2017-09-28 12:09:13.230 23195 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:09:13 ctl02 nova-api[23195]: 2017-09-28 12:09:13.230 23195 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:09:13 ctl02 nova-api[23195]: 2017-09-28 12:09:13.230 23195 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:09:13 ctl02 nova-api[23195]: 2017-09-28 12:09:13.230 23195 ERROR nova
Sep 28 12:09:13 ctl02 cinder-api[23219]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.292 23219 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:09:13 ctl02 heat-api-cfn[13300]: 2017-09-28 12:09:13.352 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:09:13] "OPTIONS / HTTP/1.0" 200 134 0.000421
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.359 23219 WARNING cinder.api [-] The v1 api is deprecated and is not under active development. You should set enable_v1_api=false and enable_v3_api=true in your cinder.conf file.
Sep 28 12:09:13 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:09:13 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:09:13 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.458 23219 INFO root [-] Generating grammar tables from /usr/lib/python2.7/lib2to3/Grammar.txt
Sep 28 12:09:13 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928120913463806
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.475 23219 INFO root [-] Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt
Sep 28 12:09:13 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 23236
Sep 28 12:09:13 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:09:13 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:09:13 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928120913463806
Sep 28 12:09:13 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:09:13 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.516 23219 INFO cinder.api.extensions [-] Initializing extension manager.
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.518 23219 INFO cinder.api.extensions [-] Loaded extension: os-snapshot-actions
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.519 23219 INFO cinder.api.extensions [-] Loaded extension: os-availability-zone
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.520 23219 INFO cinder.api.extensions [-] Loaded extension: os-hosts
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.521 23219 INFO cinder.api.extensions [-] Loaded extension: os-volume-transfer
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.522 23219 INFO cinder.api.extensions [-] Loaded extension: os-admin-actions
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.523 23219 INFO cinder.api.extensions [-] Loaded extension: os-vol-host-attr
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.523 23219 INFO cinder.api.extensions [-] Loaded extension: os-vol-tenant-attr
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.524 23219 INFO cinder.api.extensions [-] Loaded extension: os-snapshot-manage
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.525 23219 INFO cinder.api.extensions [-] Loaded extension: capabilities
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.525 23219 INFO cinder.api.extensions [-] Loaded extension: cgsnapshots
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.526 23219 INFO cinder.api.extensions [-] Loaded extension: os-quota-class-sets
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.526 23219 INFO cinder.api.extensions [-] Loaded extension: os-extended-services
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.527 23219 INFO cinder.api.extensions [-] Loaded extension: os-volume-encryption-metadata
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.527 23219 INFO cinder.api.extensions [-] Loaded extension: os-image-create
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.529 23219 INFO cinder.api.extensions [-] Loaded extension: os-volume-actions
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.530 23219 INFO cinder.api.extensions [-] Loaded extension: scheduler-stats
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.530 23219 INFO cinder.api.extensions [-] Loaded extension: encryption
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.531 23219 INFO cinder.api.extensions [-] Loaded extension: os-services
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.532 23219 INFO cinder.api.extensions [-] Loaded extension: qos-specs
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.532 23219 INFO cinder.api.extensions [-] Loaded extension: OS-SCH-HNT
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.533 23219 INFO cinder.api.extensions [-] Loaded extension: backups
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.534 23219 INFO cinder.api.extensions [-] Loaded extension: consistencygroups
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.534 23219 INFO cinder.api.extensions [-] Loaded extension: os-snapshot-unmanage
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.535 23219 INFO cinder.api.extensions [-] Loaded extension: os-volume-unmanage
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.535 23219 INFO cinder.api.extensions [-] Loaded extension: os-vol-mig-status-attr
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.536 23219 INFO cinder.api.extensions [-] Loaded extension: os-types-extra-specs
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.537 23219 INFO cinder.api.extensions [-] Loaded extension: os-volume-manage
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.537 23219 INFO cinder.api.extensions [-] Loaded extension: os-used-limits
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.538 23219 INFO cinder.api.extensions [-] Loaded extension: os-volume-type-access
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.538 23219 INFO cinder.api.extensions [-] Loaded extension: os-vol-image-meta
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.539 23219 INFO cinder.api.extensions [-] Loaded extension: os-quota-sets
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.540 23219 INFO cinder.api.extensions [-] Loaded extension: os-types-manage
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.540 23219 INFO cinder.api.extensions [-] Loaded extension: os-extended-snapshot-attributes
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.542 23219 WARNING py.warnings [req-a18df906-4683-4ea8-b207-15cddd5c49c2 - - - - -] /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/enginefacade.py:241: NotSupportedWarning: Configuration option(s) ['use_tpool'] not supported
Sep 28 12:09:13 ctl02 cinder-api[23219]:   exception.NotSupportedWarning
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 INFO cinder.rpc [req-a18df906-4683-4ea8-b207-15cddd5c49c2 - - - - -] Automatically selected cinder-scheduler objects version 1.21 as minimum service version.
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 CRITICAL cinder [req-a18df906-4683-4ea8-b207-15cddd5c49c2 - - - - -] CappedVersionUnknown: Unrecoverable Error: Versioned Objects in DB are capped to unknown version 1.21.
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder Traceback (most recent call last):
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder   File "/usr/bin/cinder-api", line 10, in <module>
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder     sys.exit(main())
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/cmd/api.py", line 61, in main
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder     server = service.WSGIService('osapi_volume')
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/service.py", line 375, in __init__
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder     self.app = self.loader.load_app(name)
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder   File "/usr/lib/python2.7/dist-packages/oslo_service/wsgi.py", line 353, in load_app
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 272, in loadobj
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder     return context.create()
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 710, in create
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder     return self.object_type.invoke(self)
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 144, in invoke
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder     **context.local_conf)
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/util.py", line 55, in fix_call
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder     val = callable(*args, **kw)
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/api/__init__.py", line 34, in root_app_factory
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder     return paste.urlmap.urlmap_factory(loader, global_conf, **local_conf)
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/urlmap.py", line 28, in urlmap_factory
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder     app = loader.get_app(app_name, global_conf=global_conf)
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 350, in get_app
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder     name=name, global_conf=global_conf).create()
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 710, in create
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder     return self.object_type.invoke(self)
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 144, in invoke
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder     **context.local_conf)
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/util.py", line 55, in fix_call
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder     val = callable(*args, **kw)
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/api/middleware/auth.py", line 56, in pipeline_factory
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder     app = loader.get_app(pipeline[-1])
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 350, in get_app
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder     name=name, global_conf=global_conf).create()
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 710, in create
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder     return self.object_type.invoke(self)
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 146, in invoke
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder     return fix_call(context.object, context.global_conf, **context.local_conf)
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/util.py", line 55, in fix_call
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder     val = callable(*args, **kw)
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/api/openstack/__init__.py", line 72, in factory
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder     return cls()
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/api/openstack/__init__.py", line 83, in __init__
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder     self._setup_routes(mapper, ext_mgr)
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/api/v2/router.py", line 50, in _setup_routes
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder     self.resources['volumes'] = volumes.create_resource(ext_mgr)
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/api/v2/volumes.py", line 473, in create_resource
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder     return wsgi.Resource(VolumeController(ext_mgr))
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/api/v2/volumes.py", line 165, in __init__
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder     self.volume_api = cinder_volume.API()
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/volume/__init__.py", line 30, in API
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder     return importutils.import_object(class_name, *args, **kwargs)
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder   File "/usr/lib/python2.7/dist-packages/oslo_utils/importutils.py", line 44, in import_object
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder     return import_class(import_str)(*args, **kwargs)
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/volume/api.py", line 130, in __init__
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder     self.scheduler_rpcapi = scheduler_rpcapi.SchedulerAPI()
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/rpc.py", line 188, in __init__
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder     serializer = base.CinderObjectSerializer(obj_version_cap)
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/objects/base.py", line 412, in __init__
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder     raise exception.CappedVersionUnknown(version=version_cap)
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder CappedVersionUnknown: Unrecoverable Error: Versioned Objects in DB are capped to unknown version 1.21.
Sep 28 12:09:13 ctl02 cinder-api[23219]: 2017-09-28 12:09:13.610 23219 ERROR cinder
Sep 28 12:09:13 ctl02 systemd[1]: cinder-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:09:13 ctl02 systemd[1]: cinder-api.service: Unit entered failed state.
Sep 28 12:09:13 ctl02 systemd[1]: cinder-api.service: Failed with result 'exit-code'.
Sep 28 12:09:13 ctl02 systemd[1]: cinder-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:09:13 ctl02 systemd[1]: Stopped OpenStack Cinder Api.
Sep 28 12:09:13 ctl02 systemd[1]: Starting OpenStack Cinder Api...
Sep 28 12:09:13 ctl02 systemd[1]: Started OpenStack Cinder Api.
Sep 28 12:09:14 ctl02 glance-api[29183]: 2017-09-28 12:09:14.174 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:09:14] "OPTIONS / HTTP/1.0" 200 134 0.000615
Sep 28 12:09:14 ctl02 cinder-api[23260]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:09:14 ctl02 cinder-api[23260]: 2017-09-28 12:09:14.759 23260 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:09:14 ctl02 cinder-api[23260]: 2017-09-28 12:09:14.823 23260 WARNING cinder.api [-] The v1 api is deprecated and is not under active development. You should set enable_v1_api=false and enable_v3_api=true in your cinder.conf file.
Sep 28 12:09:14 ctl02 cinder-api[23260]: 2017-09-28 12:09:14.914 23260 INFO root [-] Generating grammar tables from /usr/lib/python2.7/lib2to3/Grammar.txt
Sep 28 12:09:14 ctl02 cinder-api[23260]: 2017-09-28 12:09:14.931 23260 INFO root [-] Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt
Sep 28 12:09:14 ctl02 cinder-api[23260]: 2017-09-28 12:09:14.965 23260 INFO cinder.api.extensions [-] Initializing extension manager.
Sep 28 12:09:14 ctl02 cinder-api[23260]: 2017-09-28 12:09:14.966 23260 INFO cinder.api.extensions [-] Loaded extension: os-snapshot-actions
Sep 28 12:09:14 ctl02 cinder-api[23260]: 2017-09-28 12:09:14.967 23260 INFO cinder.api.extensions [-] Loaded extension: os-availability-zone
Sep 28 12:09:14 ctl02 cinder-api[23260]: 2017-09-28 12:09:14.968 23260 INFO cinder.api.extensions [-] Loaded extension: os-hosts
Sep 28 12:09:14 ctl02 cinder-api[23260]: 2017-09-28 12:09:14.969 23260 INFO cinder.api.extensions [-] Loaded extension: os-volume-transfer
Sep 28 12:09:14 ctl02 cinder-api[23260]: 2017-09-28 12:09:14.970 23260 INFO cinder.api.extensions [-] Loaded extension: os-admin-actions
Sep 28 12:09:14 ctl02 cinder-api[23260]: 2017-09-28 12:09:14.971 23260 INFO cinder.api.extensions [-] Loaded extension: os-vol-host-attr
Sep 28 12:09:14 ctl02 cinder-api[23260]: 2017-09-28 12:09:14.971 23260 INFO cinder.api.extensions [-] Loaded extension: os-vol-tenant-attr
Sep 28 12:09:14 ctl02 cinder-api[23260]: 2017-09-28 12:09:14.972 23260 INFO cinder.api.extensions [-] Loaded extension: os-snapshot-manage
Sep 28 12:09:14 ctl02 cinder-api[23260]: 2017-09-28 12:09:14.972 23260 INFO cinder.api.extensions [-] Loaded extension: capabilities
Sep 28 12:09:14 ctl02 cinder-api[23260]: 2017-09-28 12:09:14.973 23260 INFO cinder.api.extensions [-] Loaded extension: cgsnapshots
Sep 28 12:09:14 ctl02 cinder-api[23260]: 2017-09-28 12:09:14.973 23260 INFO cinder.api.extensions [-] Loaded extension: os-quota-class-sets
Sep 28 12:09:14 ctl02 cinder-api[23260]: 2017-09-28 12:09:14.974 23260 INFO cinder.api.extensions [-] Loaded extension: os-extended-services
Sep 28 12:09:14 ctl02 cinder-api[23260]: 2017-09-28 12:09:14.974 23260 INFO cinder.api.extensions [-] Loaded extension: os-volume-encryption-metadata
Sep 28 12:09:14 ctl02 cinder-api[23260]: 2017-09-28 12:09:14.975 23260 INFO cinder.api.extensions [-] Loaded extension: os-image-create
Sep 28 12:09:14 ctl02 cinder-api[23260]: 2017-09-28 12:09:14.976 23260 INFO cinder.api.extensions [-] Loaded extension: os-volume-actions
Sep 28 12:09:14 ctl02 cinder-api[23260]: 2017-09-28 12:09:14.977 23260 INFO cinder.api.extensions [-] Loaded extension: scheduler-stats
Sep 28 12:09:14 ctl02 cinder-api[23260]: 2017-09-28 12:09:14.977 23260 INFO cinder.api.extensions [-] Loaded extension: encryption
Sep 28 12:09:14 ctl02 cinder-api[23260]: 2017-09-28 12:09:14.978 23260 INFO cinder.api.extensions [-] Loaded extension: os-services
Sep 28 12:09:14 ctl02 cinder-api[23260]: 2017-09-28 12:09:14.979 23260 INFO cinder.api.extensions [-] Loaded extension: qos-specs
Sep 28 12:09:14 ctl02 cinder-api[23260]: 2017-09-28 12:09:14.979 23260 INFO cinder.api.extensions [-] Loaded extension: OS-SCH-HNT
Sep 28 12:09:14 ctl02 cinder-api[23260]: 2017-09-28 12:09:14.980 23260 INFO cinder.api.extensions [-] Loaded extension: backups
Sep 28 12:09:14 ctl02 cinder-api[23260]: 2017-09-28 12:09:14.981 23260 INFO cinder.api.extensions [-] Loaded extension: consistencygroups
Sep 28 12:09:14 ctl02 cinder-api[23260]: 2017-09-28 12:09:14.981 23260 INFO cinder.api.extensions [-] Loaded extension: os-snapshot-unmanage
Sep 28 12:09:14 ctl02 cinder-api[23260]: 2017-09-28 12:09:14.982 23260 INFO cinder.api.extensions [-] Loaded extension: os-volume-unmanage
Sep 28 12:09:14 ctl02 cinder-api[23260]: 2017-09-28 12:09:14.982 23260 INFO cinder.api.extensions [-] Loaded extension: os-vol-mig-status-attr
Sep 28 12:09:14 ctl02 cinder-api[23260]: 2017-09-28 12:09:14.983 23260 INFO cinder.api.extensions [-] Loaded extension: os-types-extra-specs
Sep 28 12:09:14 ctl02 cinder-api[23260]: 2017-09-28 12:09:14.983 23260 INFO cinder.api.extensions [-] Loaded extension: os-volume-manage
Sep 28 12:09:14 ctl02 cinder-api[23260]: 2017-09-28 12:09:14.984 23260 INFO cinder.api.extensions [-] Loaded extension: os-used-limits
Sep 28 12:09:14 ctl02 cinder-api[23260]: 2017-09-28 12:09:14.984 23260 INFO cinder.api.extensions [-] Loaded extension: os-volume-type-access
Sep 28 12:09:14 ctl02 cinder-api[23260]: 2017-09-28 12:09:14.985 23260 INFO cinder.api.extensions [-] Loaded extension: os-vol-image-meta
Sep 28 12:09:14 ctl02 cinder-api[23260]: 2017-09-28 12:09:14.986 23260 INFO cinder.api.extensions [-] Loaded extension: os-quota-sets
Sep 28 12:09:14 ctl02 cinder-api[23260]: 2017-09-28 12:09:14.986 23260 INFO cinder.api.extensions [-] Loaded extension: os-types-manage
Sep 28 12:09:14 ctl02 cinder-api[23260]: 2017-09-28 12:09:14.987 23260 INFO cinder.api.extensions [-] Loaded extension: os-extended-snapshot-attributes
Sep 28 12:09:14 ctl02 cinder-api[23260]: 2017-09-28 12:09:14.988 23260 WARNING py.warnings [req-119249b2-e308-41c8-a5d1-70e44b169d11 - - - - -] /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/enginefacade.py:241: NotSupportedWarning: Configuration option(s) ['use_tpool'] not supported
Sep 28 12:09:14 ctl02 cinder-api[23260]:   exception.NotSupportedWarning
Sep 28 12:09:14 ctl02 heat-api[13008]: 2017-09-28 12:09:14.998 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:09:14] "OPTIONS / HTTP/1.0" 200 134 0.000625
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 INFO cinder.rpc [req-119249b2-e308-41c8-a5d1-70e44b169d11 - - - - -] Automatically selected cinder-scheduler objects version 1.21 as minimum service version.
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 CRITICAL cinder [req-119249b2-e308-41c8-a5d1-70e44b169d11 - - - - -] CappedVersionUnknown: Unrecoverable Error: Versioned Objects in DB are capped to unknown version 1.21.
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder Traceback (most recent call last):
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder   File "/usr/bin/cinder-api", line 10, in <module>
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder     sys.exit(main())
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/cmd/api.py", line 61, in main
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder     server = service.WSGIService('osapi_volume')
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/service.py", line 375, in __init__
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder     self.app = self.loader.load_app(name)
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder   File "/usr/lib/python2.7/dist-packages/oslo_service/wsgi.py", line 353, in load_app
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 272, in loadobj
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder     return context.create()
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 710, in create
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder     return self.object_type.invoke(self)
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 144, in invoke
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder     **context.local_conf)
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/util.py", line 55, in fix_call
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder     val = callable(*args, **kw)
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/api/__init__.py", line 34, in root_app_factory
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder     return paste.urlmap.urlmap_factory(loader, global_conf, **local_conf)
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/urlmap.py", line 28, in urlmap_factory
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder     app = loader.get_app(app_name, global_conf=global_conf)
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 350, in get_app
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder     name=name, global_conf=global_conf).create()
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 710, in create
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder     return self.object_type.invoke(self)
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 144, in invoke
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder     **context.local_conf)
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/util.py", line 55, in fix_call
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder     val = callable(*args, **kw)
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/api/middleware/auth.py", line 56, in pipeline_factory
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder     app = loader.get_app(pipeline[-1])
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 350, in get_app
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder     name=name, global_conf=global_conf).create()
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 710, in create
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder     return self.object_type.invoke(self)
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 146, in invoke
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder     return fix_call(context.object, context.global_conf, **context.local_conf)
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder   File "/usr/lib/python2.7/dist-packages/paste/deploy/util.py", line 55, in fix_call
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder     val = callable(*args, **kw)
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/api/openstack/__init__.py", line 72, in factory
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder     return cls()
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/api/openstack/__init__.py", line 83, in __init__
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder     self._setup_routes(mapper, ext_mgr)
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/api/v2/router.py", line 50, in _setup_routes
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder     self.resources['volumes'] = volumes.create_resource(ext_mgr)
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/api/v2/volumes.py", line 473, in create_resource
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder     return wsgi.Resource(VolumeController(ext_mgr))
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/api/v2/volumes.py", line 165, in __init__
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder     self.volume_api = cinder_volume.API()
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/volume/__init__.py", line 30, in API
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder     return importutils.import_object(class_name, *args, **kwargs)
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder   File "/usr/lib/python2.7/dist-packages/oslo_utils/importutils.py", line 44, in import_object
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder     return import_class(import_str)(*args, **kwargs)
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/volume/api.py", line 130, in __init__
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder     self.scheduler_rpcapi = scheduler_rpcapi.SchedulerAPI()
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/rpc.py", line 188, in __init__
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder     serializer = base.CinderObjectSerializer(obj_version_cap)
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/objects/base.py", line 412, in __init__
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder     raise exception.CappedVersionUnknown(version=version_cap)
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder CappedVersionUnknown: Unrecoverable Error: Versioned Objects in DB are capped to unknown version 1.21.
Sep 28 12:09:15 ctl02 cinder-api[23260]: 2017-09-28 12:09:15.055 23260 ERROR cinder
Sep 28 12:09:15 ctl02 glance-api[29183]: 2017-09-28 12:09:15.093 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:09:15] "OPTIONS / HTTP/1.0" 200 134 0.000586
Sep 28 12:09:15 ctl02 systemd[1]: cinder-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:09:15 ctl02 systemd[1]: cinder-api.service: Unit entered failed state.
Sep 28 12:09:15 ctl02 systemd[1]: cinder-api.service: Failed with result 'exit-code'.
Sep 28 12:09:15 ctl02 nova-api[23245]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:09:15 ctl02 nova-api[23245]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:09:15 ctl02 nova-api[23245]: 2017-09-28 12:09:15.319 23245 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:09:15 ctl02 nova-api[23245]: 2017-09-28 12:09:15.321 23245 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:09:15 ctl02 nova-api[23245]: 2017-09-28 12:09:15.321 23245 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:09:15 ctl02 nova-api[23245]: 2017-09-28 12:09:15.321 23245 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:09:15 ctl02 nova-api[23245]: 2017-09-28 12:09:15.321 23245 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:09:15 ctl02 nova-api[23245]: 2017-09-28 12:09:15.321 23245 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:09:15 ctl02 nova-api[23245]: 2017-09-28 12:09:15.321 23245 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:09:15 ctl02 nova-api[23245]: 2017-09-28 12:09:15.321 23245 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:09:15 ctl02 nova-api[23245]: 2017-09-28 12:09:15.321 23245 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:09:15 ctl02 nova-api[23245]: 2017-09-28 12:09:15.321 23245 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:09:15 ctl02 nova-api[23245]: 2017-09-28 12:09:15.321 23245 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:09:15 ctl02 nova-api[23245]: 2017-09-28 12:09:15.321 23245 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:09:15 ctl02 nova-api[23245]: 2017-09-28 12:09:15.321 23245 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:09:15 ctl02 nova-api[23245]: 2017-09-28 12:09:15.321 23245 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:09:15 ctl02 nova-api[23245]: 2017-09-28 12:09:15.321 23245 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:09:15 ctl02 nova-api[23245]: 2017-09-28 12:09:15.321 23245 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:09:15 ctl02 nova-api[23245]: 2017-09-28 12:09:15.321 23245 ERROR nova.wsgi     self.filename))
Sep 28 12:09:15 ctl02 nova-api[23245]: 2017-09-28 12:09:15.321 23245 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:09:15 ctl02 nova-api[23245]: 2017-09-28 12:09:15.321 23245 ERROR nova.wsgi
Sep 28 12:09:15 ctl02 nova-api[23245]: 2017-09-28 12:09:15.322 23245 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:09:15 ctl02 systemd[1]: cinder-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:09:15 ctl02 systemd[1]: Stopped OpenStack Cinder Api.
Sep 28 12:09:15 ctl02 systemd[1]: cinder-api.service: Start request repeated too quickly.
Sep 28 12:09:15 ctl02 systemd[1]: Failed to start OpenStack Cinder Api.
Sep 28 12:09:15 ctl02 nova-api[23245]: 2017-09-28 12:09:15.451 23245 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:09:15 ctl02 nova-api[23245]: 2017-09-28 12:09:15.678 23245 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:09:15 ctl02 nova-api[23245]: 2017-09-28 12:09:15.680 23245 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:09:15 ctl02 nova-api[23245]: 2017-09-28 12:09:15.680 23245 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:09:15 ctl02 nova-api[23245]: 2017-09-28 12:09:15.680 23245 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:09:15 ctl02 nova-api[23245]: 2017-09-28 12:09:15.812 23245 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:09:15 ctl02 nova-api[23245]: 2017-09-28 12:09:15.814 23245 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:09:15 ctl02 nova-api[23245]: 2017-09-28 12:09:15.814 23245 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:09:15 ctl02 nova-api[23245]: 2017-09-28 12:09:15.815 23245 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:09:15 ctl02 nova-api[23245]: 2017-09-28 12:09:15.818 23245 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:09:15 ctl02 nova-api[23245]: 2017-09-28 12:09:15.818 23245 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:09:15 ctl02 nova-api[23245]: 2017-09-28 12:09:15.818 23245 ERROR nova Traceback (most recent call last):
Sep 28 12:09:15 ctl02 nova-api[23245]: 2017-09-28 12:09:15.818 23245 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:09:15 ctl02 nova-api[23245]: 2017-09-28 12:09:15.818 23245 ERROR nova     sys.exit(main())
Sep 28 12:09:15 ctl02 nova-api[23245]: 2017-09-28 12:09:15.818 23245 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:09:15 ctl02 nova-api[23245]: 2017-09-28 12:09:15.818 23245 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:09:15 ctl02 nova-api[23245]: 2017-09-28 12:09:15.818 23245 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:09:15 ctl02 nova-api[23245]: 2017-09-28 12:09:15.818 23245 ERROR nova     max_url_len=max_url_len)
Sep 28 12:09:15 ctl02 nova-api[23245]: 2017-09-28 12:09:15.818 23245 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:09:15 ctl02 nova-api[23245]: 2017-09-28 12:09:15.818 23245 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:09:15 ctl02 nova-api[23245]: 2017-09-28 12:09:15.818 23245 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:09:15 ctl02 nova-api[23245]: 2017-09-28 12:09:15.818 23245 ERROR nova     sock.listen(backlog)
Sep 28 12:09:15 ctl02 nova-api[23245]: 2017-09-28 12:09:15.818 23245 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:09:15 ctl02 nova-api[23245]: 2017-09-28 12:09:15.818 23245 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:09:15 ctl02 nova-api[23245]: 2017-09-28 12:09:15.818 23245 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:09:15 ctl02 nova-api[23245]: 2017-09-28 12:09:15.818 23245 ERROR nova
Sep 28 12:09:15 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:09:15 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:09:15 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:09:16 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x55aa2369)
Sep 28 12:09:16 ctl02 cinder-scheduler[22980]: 2017-09-28 12:09:16.075 22980 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 6 seconds.
Sep 28 12:09:16 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:09:16 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:09:16 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:09:16 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:09:17 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x55aa2369)
Sep 28 12:09:17 ctl02 heat-api[13008]: 2017-09-28 12:09:17.193 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:09:17] "OPTIONS / HTTP/1.0" 200 134 0.000584
Sep 28 12:09:17 ctl02 nova-api[23282]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:09:17 ctl02 nova-api[23282]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:09:17 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:09:17.824 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:09:17] "OPTIONS / HTTP/1.0" 200 134 0.000457
Sep 28 12:09:17 ctl02 nova-api[23282]: 2017-09-28 12:09:17.947 23282 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:09:17 ctl02 nova-api[23282]: 2017-09-28 12:09:17.949 23282 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:09:17 ctl02 nova-api[23282]: 2017-09-28 12:09:17.949 23282 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:09:17 ctl02 nova-api[23282]: 2017-09-28 12:09:17.949 23282 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:09:17 ctl02 nova-api[23282]: 2017-09-28 12:09:17.949 23282 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:09:17 ctl02 nova-api[23282]: 2017-09-28 12:09:17.949 23282 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:09:17 ctl02 nova-api[23282]: 2017-09-28 12:09:17.949 23282 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:09:17 ctl02 nova-api[23282]: 2017-09-28 12:09:17.949 23282 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:09:17 ctl02 nova-api[23282]: 2017-09-28 12:09:17.949 23282 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:09:17 ctl02 nova-api[23282]: 2017-09-28 12:09:17.949 23282 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:09:17 ctl02 nova-api[23282]: 2017-09-28 12:09:17.949 23282 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:09:17 ctl02 nova-api[23282]: 2017-09-28 12:09:17.949 23282 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:09:17 ctl02 nova-api[23282]: 2017-09-28 12:09:17.949 23282 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:09:17 ctl02 nova-api[23282]: 2017-09-28 12:09:17.949 23282 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:09:17 ctl02 nova-api[23282]: 2017-09-28 12:09:17.949 23282 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:09:17 ctl02 nova-api[23282]: 2017-09-28 12:09:17.949 23282 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:09:17 ctl02 nova-api[23282]: 2017-09-28 12:09:17.949 23282 ERROR nova.wsgi     self.filename))
Sep 28 12:09:17 ctl02 nova-api[23282]: 2017-09-28 12:09:17.949 23282 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:09:17 ctl02 nova-api[23282]: 2017-09-28 12:09:17.949 23282 ERROR nova.wsgi
Sep 28 12:09:17 ctl02 nova-api[23282]: 2017-09-28 12:09:17.951 23282 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:09:18 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:09:18.003 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:09:18] "OPTIONS / HTTP/1.0" 200 134 0.000431
Sep 28 12:09:18 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x55aa2369)
Sep 28 12:09:18 ctl02 nova-api[23282]: 2017-09-28 12:09:18.080 23282 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:09:18 ctl02 nova-consoleauth[5433]: 2017-09-28 12:09:18.180 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:09:18 ctl02 nova-api[23282]: 2017-09-28 12:09:18.317 23282 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:09:18 ctl02 nova-api[23282]: 2017-09-28 12:09:18.320 23282 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:09:18 ctl02 nova-api[23282]: 2017-09-28 12:09:18.320 23282 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:09:18 ctl02 nova-api[23282]: 2017-09-28 12:09:18.321 23282 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:09:18 ctl02 nova-api[23282]: 2017-09-28 12:09:18.451 23282 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:09:18 ctl02 nova-api[23282]: 2017-09-28 12:09:18.454 23282 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:09:18 ctl02 nova-api[23282]: 2017-09-28 12:09:18.454 23282 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:09:18 ctl02 nova-api[23282]: 2017-09-28 12:09:18.454 23282 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:09:18 ctl02 nova-api[23282]: 2017-09-28 12:09:18.458 23282 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:09:18 ctl02 nova-api[23282]: 2017-09-28 12:09:18.458 23282 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:09:18 ctl02 nova-api[23282]: 2017-09-28 12:09:18.458 23282 ERROR nova Traceback (most recent call last):
Sep 28 12:09:18 ctl02 nova-api[23282]: 2017-09-28 12:09:18.458 23282 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:09:18 ctl02 nova-api[23282]: 2017-09-28 12:09:18.458 23282 ERROR nova     sys.exit(main())
Sep 28 12:09:18 ctl02 nova-api[23282]: 2017-09-28 12:09:18.458 23282 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:09:18 ctl02 nova-api[23282]: 2017-09-28 12:09:18.458 23282 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:09:18 ctl02 nova-api[23282]: 2017-09-28 12:09:18.458 23282 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:09:18 ctl02 nova-api[23282]: 2017-09-28 12:09:18.458 23282 ERROR nova     max_url_len=max_url_len)
Sep 28 12:09:18 ctl02 nova-api[23282]: 2017-09-28 12:09:18.458 23282 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:09:18 ctl02 nova-api[23282]: 2017-09-28 12:09:18.458 23282 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:09:18 ctl02 nova-api[23282]: 2017-09-28 12:09:18.458 23282 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:09:18 ctl02 nova-api[23282]: 2017-09-28 12:09:18.458 23282 ERROR nova     sock.listen(backlog)
Sep 28 12:09:18 ctl02 nova-api[23282]: 2017-09-28 12:09:18.458 23282 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:09:18 ctl02 nova-api[23282]: 2017-09-28 12:09:18.458 23282 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:09:18 ctl02 nova-api[23282]: 2017-09-28 12:09:18.458 23282 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:09:18 ctl02 nova-api[23282]: 2017-09-28 12:09:18.458 23282 ERROR nova
Sep 28 12:09:18 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:09:18 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:09:18 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:09:18 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:09:18 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:09:18 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:09:18 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:09:19 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x55aa2369)
Sep 28 12:09:20 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x55aa2369)
Sep 28 12:09:20 ctl02 nova-api[23299]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:09:20 ctl02 nova-api[23299]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:09:20 ctl02 heat-api-cfn[13300]: 2017-09-28 12:09:20.576 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:09:20] "OPTIONS / HTTP/1.0" 200 134 0.000460
Sep 28 12:09:20 ctl02 nova-api[23299]: 2017-09-28 12:09:20.696 23299 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:09:20 ctl02 nova-api[23299]: 2017-09-28 12:09:20.698 23299 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:09:20 ctl02 nova-api[23299]: 2017-09-28 12:09:20.698 23299 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:09:20 ctl02 nova-api[23299]: 2017-09-28 12:09:20.698 23299 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:09:20 ctl02 nova-api[23299]: 2017-09-28 12:09:20.698 23299 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:09:20 ctl02 nova-api[23299]: 2017-09-28 12:09:20.698 23299 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:09:20 ctl02 nova-api[23299]: 2017-09-28 12:09:20.698 23299 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:09:20 ctl02 nova-api[23299]: 2017-09-28 12:09:20.698 23299 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:09:20 ctl02 nova-api[23299]: 2017-09-28 12:09:20.698 23299 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:09:20 ctl02 nova-api[23299]: 2017-09-28 12:09:20.698 23299 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:09:20 ctl02 nova-api[23299]: 2017-09-28 12:09:20.698 23299 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:09:20 ctl02 nova-api[23299]: 2017-09-28 12:09:20.698 23299 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:09:20 ctl02 nova-api[23299]: 2017-09-28 12:09:20.698 23299 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:09:20 ctl02 nova-api[23299]: 2017-09-28 12:09:20.698 23299 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:09:20 ctl02 nova-api[23299]: 2017-09-28 12:09:20.698 23299 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:09:20 ctl02 nova-api[23299]: 2017-09-28 12:09:20.698 23299 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:09:20 ctl02 nova-api[23299]: 2017-09-28 12:09:20.698 23299 ERROR nova.wsgi     self.filename))
Sep 28 12:09:20 ctl02 nova-api[23299]: 2017-09-28 12:09:20.698 23299 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:09:20 ctl02 nova-api[23299]: 2017-09-28 12:09:20.698 23299 ERROR nova.wsgi
Sep 28 12:09:20 ctl02 nova-api[23299]: 2017-09-28 12:09:20.699 23299 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:09:20 ctl02 heat-api-cfn[13300]: 2017-09-28 12:09:20.823 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:09:20] "OPTIONS / HTTP/1.0" 200 134 0.000678
Sep 28 12:09:20 ctl02 nova-api[23299]: 2017-09-28 12:09:20.833 23299 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:09:20 ctl02 glance-api[29183]: 2017-09-28 12:09:20.976 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:09:20] "OPTIONS / HTTP/1.0" 200 134 0.001222
Sep 28 12:09:21 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x55aa2369)
Sep 28 12:09:21 ctl02 nova-api[23299]: 2017-09-28 12:09:21.072 23299 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:09:21 ctl02 nova-api[23299]: 2017-09-28 12:09:21.074 23299 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:09:21 ctl02 nova-api[23299]: 2017-09-28 12:09:21.075 23299 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:09:21 ctl02 nova-api[23299]: 2017-09-28 12:09:21.075 23299 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:09:21 ctl02 nova-scheduler[5620]: 2017-09-28 12:09:21.196 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:09:21 ctl02 nova-api[23299]: 2017-09-28 12:09:21.213 23299 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:09:21 ctl02 nova-api[23299]: 2017-09-28 12:09:21.216 23299 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:09:21 ctl02 nova-api[23299]: 2017-09-28 12:09:21.216 23299 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:09:21 ctl02 nova-api[23299]: 2017-09-28 12:09:21.217 23299 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:09:21 ctl02 nova-api[23299]: 2017-09-28 12:09:21.220 23299 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:09:21 ctl02 nova-api[23299]: 2017-09-28 12:09:21.220 23299 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:09:21 ctl02 nova-api[23299]: 2017-09-28 12:09:21.220 23299 ERROR nova Traceback (most recent call last):
Sep 28 12:09:21 ctl02 nova-api[23299]: 2017-09-28 12:09:21.220 23299 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:09:21 ctl02 nova-api[23299]: 2017-09-28 12:09:21.220 23299 ERROR nova     sys.exit(main())
Sep 28 12:09:21 ctl02 nova-api[23299]: 2017-09-28 12:09:21.220 23299 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:09:21 ctl02 nova-api[23299]: 2017-09-28 12:09:21.220 23299 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:09:21 ctl02 nova-api[23299]: 2017-09-28 12:09:21.220 23299 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:09:21 ctl02 nova-api[23299]: 2017-09-28 12:09:21.220 23299 ERROR nova     max_url_len=max_url_len)
Sep 28 12:09:21 ctl02 nova-api[23299]: 2017-09-28 12:09:21.220 23299 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:09:21 ctl02 nova-api[23299]: 2017-09-28 12:09:21.220 23299 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:09:21 ctl02 nova-api[23299]: 2017-09-28 12:09:21.220 23299 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:09:21 ctl02 nova-api[23299]: 2017-09-28 12:09:21.220 23299 ERROR nova     sock.listen(backlog)
Sep 28 12:09:21 ctl02 nova-api[23299]: 2017-09-28 12:09:21.220 23299 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:09:21 ctl02 nova-api[23299]: 2017-09-28 12:09:21.220 23299 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:09:21 ctl02 nova-api[23299]: 2017-09-28 12:09:21.220 23299 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:09:21 ctl02 nova-api[23299]: 2017-09-28 12:09:21.220 23299 ERROR nova
Sep 28 12:09:21 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:09:21 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:09:21 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:09:21 ctl02 heat-engine[12803]: 2017-09-28 12:09:21.452 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:09:21 ctl02 heat-engine[12803]: 2017-09-28 12:09:21.478 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:09:21 ctl02 heat-engine[12803]: 2017-09-28 12:09:21.497 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:09:21 ctl02 heat-engine[12803]: 2017-09-28 12:09:21.506 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:09:21 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:09:21 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:09:21 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:09:21 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:09:21 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:09:21.706 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:09:21] "OPTIONS / HTTP/1.0" 200 134 0.000473
Sep 28 12:09:22 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x55aa2369)
Sep 28 12:09:22 ctl02 cinder-scheduler[22980]: 2017-09-28 12:09:22.081 22980 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 8 seconds.
Sep 28 12:09:22 ctl02 heat-api[13008]: 2017-09-28 12:09:22.854 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:09:22] "OPTIONS / HTTP/1.0" 200 134 0.000555
Sep 28 12:09:23 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x55aa2369)
Sep 28 12:09:23 ctl02 heat-api-cfn[13300]: 2017-09-28 12:09:23.073 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:09:23] "OPTIONS / HTTP/1.0" 200 134 0.000571
Sep 28 12:09:23 ctl02 nova-api[23318]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:09:23 ctl02 nova-api[23318]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:09:23 ctl02 nova-api[23318]: 2017-09-28 12:09:23.448 23318 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:09:23 ctl02 nova-api[23318]: 2017-09-28 12:09:23.450 23318 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:09:23 ctl02 nova-api[23318]: 2017-09-28 12:09:23.450 23318 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:09:23 ctl02 nova-api[23318]: 2017-09-28 12:09:23.450 23318 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:09:23 ctl02 nova-api[23318]: 2017-09-28 12:09:23.450 23318 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:09:23 ctl02 nova-api[23318]: 2017-09-28 12:09:23.450 23318 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:09:23 ctl02 nova-api[23318]: 2017-09-28 12:09:23.450 23318 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:09:23 ctl02 nova-api[23318]: 2017-09-28 12:09:23.450 23318 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:09:23 ctl02 nova-api[23318]: 2017-09-28 12:09:23.450 23318 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:09:23 ctl02 nova-api[23318]: 2017-09-28 12:09:23.450 23318 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:09:23 ctl02 nova-api[23318]: 2017-09-28 12:09:23.450 23318 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:09:23 ctl02 nova-api[23318]: 2017-09-28 12:09:23.450 23318 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:09:23 ctl02 nova-api[23318]: 2017-09-28 12:09:23.450 23318 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:09:23 ctl02 nova-api[23318]: 2017-09-28 12:09:23.450 23318 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:09:23 ctl02 nova-api[23318]: 2017-09-28 12:09:23.450 23318 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:09:23 ctl02 nova-api[23318]: 2017-09-28 12:09:23.450 23318 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:09:23 ctl02 nova-api[23318]: 2017-09-28 12:09:23.450 23318 ERROR nova.wsgi     self.filename))
Sep 28 12:09:23 ctl02 nova-api[23318]: 2017-09-28 12:09:23.450 23318 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:09:23 ctl02 nova-api[23318]: 2017-09-28 12:09:23.450 23318 ERROR nova.wsgi
Sep 28 12:09:23 ctl02 nova-api[23318]: 2017-09-28 12:09:23.452 23318 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:09:23 ctl02 nova-api[23318]: 2017-09-28 12:09:23.580 23318 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:09:23 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928120923662528
Sep 28 12:09:23 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 23331
Sep 28 12:09:23 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928120923662528
Sep 28 12:09:23 ctl02 nova-api[23318]: 2017-09-28 12:09:23.808 23318 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:09:23 ctl02 nova-api[23318]: 2017-09-28 12:09:23.811 23318 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:09:23 ctl02 nova-api[23318]: 2017-09-28 12:09:23.811 23318 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:09:23 ctl02 nova-api[23318]: 2017-09-28 12:09:23.812 23318 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:09:23 ctl02 nova-api[23318]: 2017-09-28 12:09:23.942 23318 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:09:23 ctl02 nova-api[23318]: 2017-09-28 12:09:23.945 23318 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:09:23 ctl02 nova-api[23318]: 2017-09-28 12:09:23.945 23318 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:09:23 ctl02 nova-api[23318]: 2017-09-28 12:09:23.946 23318 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:09:23 ctl02 nova-api[23318]: 2017-09-28 12:09:23.949 23318 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:09:23 ctl02 nova-api[23318]: 2017-09-28 12:09:23.949 23318 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:09:23 ctl02 nova-api[23318]: 2017-09-28 12:09:23.949 23318 ERROR nova Traceback (most recent call last):
Sep 28 12:09:23 ctl02 nova-api[23318]: 2017-09-28 12:09:23.949 23318 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:09:23 ctl02 nova-api[23318]: 2017-09-28 12:09:23.949 23318 ERROR nova     sys.exit(main())
Sep 28 12:09:23 ctl02 nova-api[23318]: 2017-09-28 12:09:23.949 23318 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:09:23 ctl02 nova-api[23318]: 2017-09-28 12:09:23.949 23318 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:09:23 ctl02 nova-api[23318]: 2017-09-28 12:09:23.949 23318 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:09:23 ctl02 nova-api[23318]: 2017-09-28 12:09:23.949 23318 ERROR nova     max_url_len=max_url_len)
Sep 28 12:09:23 ctl02 nova-api[23318]: 2017-09-28 12:09:23.949 23318 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:09:23 ctl02 nova-api[23318]: 2017-09-28 12:09:23.949 23318 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:09:23 ctl02 nova-api[23318]: 2017-09-28 12:09:23.949 23318 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:09:23 ctl02 nova-api[23318]: 2017-09-28 12:09:23.949 23318 ERROR nova     sock.listen(backlog)
Sep 28 12:09:23 ctl02 nova-api[23318]: 2017-09-28 12:09:23.949 23318 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:09:23 ctl02 nova-api[23318]: 2017-09-28 12:09:23.949 23318 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:09:23 ctl02 nova-api[23318]: 2017-09-28 12:09:23.949 23318 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:09:23 ctl02 nova-api[23318]: 2017-09-28 12:09:23.949 23318 ERROR nova
Sep 28 12:09:24 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x55aa2369)
Sep 28 12:09:24 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:09:24 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:09:24 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:09:24 ctl02 glance-api[29183]: 2017-09-28 12:09:24.142 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:09:24] "OPTIONS / HTTP/1.0" 200 134 0.000664
Sep 28 12:09:24 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:09:24 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:09:24 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:09:24 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:09:24 ctl02 systemd[1]: cinder-scheduler.service: State 'stop-sigterm' timed out. Killing.
Sep 28 12:09:24 ctl02 systemd[1]: cinder-scheduler.service: Main process exited, code=killed, status=9/KILL
Sep 28 12:09:24 ctl02 systemd[1]: Stopped OpenStack Cinder Scheduler.
Sep 28 12:09:24 ctl02 systemd[1]: cinder-scheduler.service: Unit entered failed state.
Sep 28 12:09:24 ctl02 systemd[1]: cinder-scheduler.service: Failed with result 'signal'.
Sep 28 12:09:24 ctl02 systemd[1]: Starting OpenStack Cinder Scheduler...
Sep 28 12:09:24 ctl02 systemd[1]: Started OpenStack Cinder Scheduler.
Sep 28 12:09:24 ctl02 salt-minion[14967]: [INFO    ] {'cinder-scheduler': True}
Sep 28 12:09:24 ctl02 salt-minion[14967]: [INFO    ] Completed state [cinder-scheduler] at time 12:09:24.658207 duration_in_ms=15163.314
Sep 28 12:09:24 ctl02 salt-minion[14967]: [INFO    ] Running state [cinder-manage db sync; sleep 5;] at time 12:09:24.660183
Sep 28 12:09:24 ctl02 salt-minion[14967]: [INFO    ] Executing state cmd.run for cinder-manage db sync; sleep 5;
Sep 28 12:09:24 ctl02 salt-minion[14967]: [INFO    ] Executing command 'cinder-manage db sync; sleep 5;' in directory '/root'
Sep 28 12:09:25 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x55aa2369)
Sep 28 12:09:25 ctl02 heat-api[13008]: 2017-09-28 12:09:25.054 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:09:25] "OPTIONS / HTTP/1.0" 200 134 0.000510
Sep 28 12:09:25 ctl02 glance-api[29183]: 2017-09-28 12:09:25.395 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:09:25] "OPTIONS / HTTP/1.0" 200 134 0.000547
Sep 28 12:09:25 ctl02 cinder-scheduler[23357]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:09:25 ctl02 cinder-scheduler[23357]: 2017-09-28 12:09:25.565 23357 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:09:25 ctl02 cinder-scheduler[23357]: 2017-09-28 12:09:25.728 23357 INFO root [-] Generating grammar tables from /usr/lib/python2.7/lib2to3/Grammar.txt
Sep 28 12:09:25 ctl02 cinder-scheduler[23357]: 2017-09-28 12:09:25.745 23357 INFO root [-] Generating grammar tables from /usr/lib/python2.7/lib2to3/PatternGrammar.txt
Sep 28 12:09:25 ctl02 cinder-scheduler[23357]: 2017-09-28 12:09:25.778 23357 WARNING py.warnings [req-208b02d9-f1d5-4602-8c3f-94167a9d6ac9 - - - - -] /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/enginefacade.py:241: NotSupportedWarning: Configuration option(s) ['use_tpool'] not supported
Sep 28 12:09:25 ctl02 cinder-scheduler[23357]:   exception.NotSupportedWarning
Sep 28 12:09:25 ctl02 cinder-scheduler[23357]: 2017-09-28 12:09:25.939 23357 INFO cinder.rpc [req-208b02d9-f1d5-4602-8c3f-94167a9d6ac9 - - - - -] Automatically selected cinder-volume objects version 1.3 as minimum service version.
Sep 28 12:09:25 ctl02 cinder-scheduler[23357]: 2017-09-28 12:09:25.943 23357 INFO cinder.rpc [req-208b02d9-f1d5-4602-8c3f-94167a9d6ac9 - - - - -] Automatically selected cinder-volume RPC version 1.40 as minimum service version.
Sep 28 12:09:25 ctl02 cinder-scheduler[23357]: 2017-09-28 12:09:25.950 23357 INFO cinder.service [-] Starting cinder-scheduler node (version 8.1.1)
Sep 28 12:09:26 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x55aa2369)
Sep 28 12:09:26 ctl02 nova-api[23341]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:09:26 ctl02 nova-api[23341]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:09:26 ctl02 nova-api[23341]: 2017-09-28 12:09:26.231 23341 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:09:26 ctl02 nova-api[23341]: 2017-09-28 12:09:26.233 23341 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:09:26 ctl02 nova-api[23341]: 2017-09-28 12:09:26.233 23341 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:09:26 ctl02 nova-api[23341]: 2017-09-28 12:09:26.233 23341 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:09:26 ctl02 nova-api[23341]: 2017-09-28 12:09:26.233 23341 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:09:26 ctl02 nova-api[23341]: 2017-09-28 12:09:26.233 23341 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:09:26 ctl02 nova-api[23341]: 2017-09-28 12:09:26.233 23341 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:09:26 ctl02 nova-api[23341]: 2017-09-28 12:09:26.233 23341 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:09:26 ctl02 nova-api[23341]: 2017-09-28 12:09:26.233 23341 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:09:26 ctl02 nova-api[23341]: 2017-09-28 12:09:26.233 23341 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:09:26 ctl02 nova-api[23341]: 2017-09-28 12:09:26.233 23341 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:09:26 ctl02 nova-api[23341]: 2017-09-28 12:09:26.233 23341 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:09:26 ctl02 nova-api[23341]: 2017-09-28 12:09:26.233 23341 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:09:26 ctl02 nova-api[23341]: 2017-09-28 12:09:26.233 23341 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:09:26 ctl02 nova-api[23341]: 2017-09-28 12:09:26.233 23341 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:09:26 ctl02 nova-api[23341]: 2017-09-28 12:09:26.233 23341 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:09:26 ctl02 nova-api[23341]: 2017-09-28 12:09:26.233 23341 ERROR nova.wsgi     self.filename))
Sep 28 12:09:26 ctl02 nova-api[23341]: 2017-09-28 12:09:26.233 23341 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:09:26 ctl02 nova-api[23341]: 2017-09-28 12:09:26.233 23341 ERROR nova.wsgi
Sep 28 12:09:26 ctl02 nova-api[23341]: 2017-09-28 12:09:26.234 23341 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:09:26 ctl02 nova-api[23341]: 2017-09-28 12:09:26.361 23341 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:09:26 ctl02 nova-api[23341]: 2017-09-28 12:09:26.594 23341 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:09:26 ctl02 nova-api[23341]: 2017-09-28 12:09:26.596 23341 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:09:26 ctl02 nova-api[23341]: 2017-09-28 12:09:26.596 23341 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:09:26 ctl02 nova-api[23341]: 2017-09-28 12:09:26.596 23341 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:09:26 ctl02 nova-api[23341]: 2017-09-28 12:09:26.726 23341 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:09:26 ctl02 nova-api[23341]: 2017-09-28 12:09:26.727 23341 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:09:26 ctl02 nova-api[23341]: 2017-09-28 12:09:26.728 23341 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:09:26 ctl02 nova-api[23341]: 2017-09-28 12:09:26.728 23341 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:09:26 ctl02 nova-api[23341]: 2017-09-28 12:09:26.731 23341 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:09:26 ctl02 nova-api[23341]: 2017-09-28 12:09:26.732 23341 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:09:26 ctl02 nova-api[23341]: 2017-09-28 12:09:26.732 23341 ERROR nova Traceback (most recent call last):
Sep 28 12:09:26 ctl02 nova-api[23341]: 2017-09-28 12:09:26.732 23341 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:09:26 ctl02 nova-api[23341]: 2017-09-28 12:09:26.732 23341 ERROR nova     sys.exit(main())
Sep 28 12:09:26 ctl02 nova-api[23341]: 2017-09-28 12:09:26.732 23341 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:09:26 ctl02 nova-api[23341]: 2017-09-28 12:09:26.732 23341 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:09:26 ctl02 nova-api[23341]: 2017-09-28 12:09:26.732 23341 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:09:26 ctl02 nova-api[23341]: 2017-09-28 12:09:26.732 23341 ERROR nova     max_url_len=max_url_len)
Sep 28 12:09:26 ctl02 nova-api[23341]: 2017-09-28 12:09:26.732 23341 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:09:26 ctl02 nova-api[23341]: 2017-09-28 12:09:26.732 23341 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:09:26 ctl02 nova-api[23341]: 2017-09-28 12:09:26.732 23341 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:09:26 ctl02 nova-api[23341]: 2017-09-28 12:09:26.732 23341 ERROR nova     sock.listen(backlog)
Sep 28 12:09:26 ctl02 nova-api[23341]: 2017-09-28 12:09:26.732 23341 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:09:26 ctl02 nova-api[23341]: 2017-09-28 12:09:26.732 23341 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:09:26 ctl02 nova-api[23341]: 2017-09-28 12:09:26.732 23341 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:09:26 ctl02 nova-api[23341]: 2017-09-28 12:09:26.732 23341 ERROR nova
Sep 28 12:09:26 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:09:26 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:09:26 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:09:27 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:09:27 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:09:27 ctl02 heat-api[13008]: 2017-09-28 12:09:27.043 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:09:27] "OPTIONS / HTTP/1.0" 200 134 0.000675
Sep 28 12:09:27 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:09:27 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:09:27 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:09:27 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:09:27 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:09:27.686 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:09:27] "OPTIONS / HTTP/1.0" 200 134 0.000421
Sep 28 12:09:27 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:09:27.902 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:09:27] "OPTIONS / HTTP/1.0" 200 134 0.000403
Sep 28 12:09:28 ctl02 nova-api[23392]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:09:28 ctl02 nova-api[23392]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:09:28 ctl02 nova-api[23392]: 2017-09-28 12:09:28.952 23392 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:09:28 ctl02 nova-api[23392]: 2017-09-28 12:09:28.954 23392 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:09:28 ctl02 nova-api[23392]: 2017-09-28 12:09:28.954 23392 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:09:28 ctl02 nova-api[23392]: 2017-09-28 12:09:28.954 23392 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:09:28 ctl02 nova-api[23392]: 2017-09-28 12:09:28.954 23392 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:09:28 ctl02 nova-api[23392]: 2017-09-28 12:09:28.954 23392 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:09:28 ctl02 nova-api[23392]: 2017-09-28 12:09:28.954 23392 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:09:28 ctl02 nova-api[23392]: 2017-09-28 12:09:28.954 23392 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:09:28 ctl02 nova-api[23392]: 2017-09-28 12:09:28.954 23392 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:09:28 ctl02 nova-api[23392]: 2017-09-28 12:09:28.954 23392 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:09:28 ctl02 nova-api[23392]: 2017-09-28 12:09:28.954 23392 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:09:28 ctl02 nova-api[23392]: 2017-09-28 12:09:28.954 23392 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:09:28 ctl02 nova-api[23392]: 2017-09-28 12:09:28.954 23392 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:09:28 ctl02 nova-api[23392]: 2017-09-28 12:09:28.954 23392 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:09:28 ctl02 nova-api[23392]: 2017-09-28 12:09:28.954 23392 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:09:28 ctl02 nova-api[23392]: 2017-09-28 12:09:28.954 23392 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:09:28 ctl02 nova-api[23392]: 2017-09-28 12:09:28.954 23392 ERROR nova.wsgi     self.filename))
Sep 28 12:09:28 ctl02 nova-api[23392]: 2017-09-28 12:09:28.954 23392 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:09:28 ctl02 nova-api[23392]: 2017-09-28 12:09:28.954 23392 ERROR nova.wsgi
Sep 28 12:09:28 ctl02 nova-api[23392]: 2017-09-28 12:09:28.957 23392 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:09:29 ctl02 nova-api[23392]: 2017-09-28 12:09:29.101 23392 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:09:29 ctl02 nova-api[23392]: 2017-09-28 12:09:29.350 23392 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:09:29 ctl02 nova-api[23392]: 2017-09-28 12:09:29.352 23392 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:09:29 ctl02 nova-api[23392]: 2017-09-28 12:09:29.352 23392 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:09:29 ctl02 nova-api[23392]: 2017-09-28 12:09:29.352 23392 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:09:29 ctl02 nova-api[23392]: 2017-09-28 12:09:29.487 23392 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:09:29 ctl02 nova-api[23392]: 2017-09-28 12:09:29.509 23392 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:09:29 ctl02 nova-api[23392]: 2017-09-28 12:09:29.509 23392 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:09:29 ctl02 nova-api[23392]: 2017-09-28 12:09:29.509 23392 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:09:29 ctl02 nova-api[23392]: 2017-09-28 12:09:29.513 23392 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:09:29 ctl02 nova-api[23392]: 2017-09-28 12:09:29.514 23392 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:09:29 ctl02 nova-api[23392]: 2017-09-28 12:09:29.514 23392 ERROR nova Traceback (most recent call last):
Sep 28 12:09:29 ctl02 nova-api[23392]: 2017-09-28 12:09:29.514 23392 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:09:29 ctl02 nova-api[23392]: 2017-09-28 12:09:29.514 23392 ERROR nova     sys.exit(main())
Sep 28 12:09:29 ctl02 nova-api[23392]: 2017-09-28 12:09:29.514 23392 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:09:29 ctl02 nova-api[23392]: 2017-09-28 12:09:29.514 23392 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:09:29 ctl02 nova-api[23392]: 2017-09-28 12:09:29.514 23392 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:09:29 ctl02 nova-api[23392]: 2017-09-28 12:09:29.514 23392 ERROR nova     max_url_len=max_url_len)
Sep 28 12:09:29 ctl02 nova-api[23392]: 2017-09-28 12:09:29.514 23392 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:09:29 ctl02 nova-api[23392]: 2017-09-28 12:09:29.514 23392 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:09:29 ctl02 nova-api[23392]: 2017-09-28 12:09:29.514 23392 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:09:29 ctl02 nova-api[23392]: 2017-09-28 12:09:29.514 23392 ERROR nova     sock.listen(backlog)
Sep 28 12:09:29 ctl02 nova-api[23392]: 2017-09-28 12:09:29.514 23392 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:09:29 ctl02 nova-api[23392]: 2017-09-28 12:09:29.514 23392 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:09:29 ctl02 nova-api[23392]: 2017-09-28 12:09:29.514 23392 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:09:29 ctl02 nova-api[23392]: 2017-09-28 12:09:29.514 23392 ERROR nova
Sep 28 12:09:29 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:09:29 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:09:29 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:09:29 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:09:29 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:09:29 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:09:29 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:09:30 ctl02 heat-api-cfn[13300]: 2017-09-28 12:09:30.635 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:09:30] "OPTIONS / HTTP/1.0" 200 134 0.000575
Sep 28 12:09:30 ctl02 salt-minion[14967]: [INFO    ] {'pid': 23363, 'retcode': 0, 'stderr': 'Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.\n2017-09-28 12:09:25.595 23364 WARNING py.warnings [-] /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/enginefacade.py:241: NotSupportedWarning: Configuration option(s) [\'use_tpool\'] not supported\n  exception.NotSupportedWarning\n\n2017-09-28 12:09:25.639 23364 CRITICAL cinder [-] KeyError: <VerNum(96)>\n2017-09-28 12:09:25.639 23364 ERROR cinder Traceback (most recent call last):\n2017-09-28 12:09:25.639 23364 ERROR cinder   File "/usr/bin/cinder-manage", line 10, in <module>\n2017-09-28 12:09:25.639 23364 ERROR cinder     sys.exit(main())\n2017-09-28 12:09:25.639 23364 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/cmd/manage.py", line 597, in main\n2017-09-28 12:09:25.639 23364 ERROR cinder     fn(*fn_args)\n2017-09-28 12:09:25.639 23364 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/cmd/manage.py", line 215, in sync\n2017-09-28 12:09:25.639 23364 ERROR cinder     return db_migration.db_sync(version)\n2017-09-28 12:09:25.639 23364 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/db/migration.py", line 73, in db_sync\n2017-09-28 12:09:25.639 23364 ERROR cinder     init_version=init_version)\n2017-09-28 12:09:25.639 23364 ERROR cinder   File "/usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/migration.py", line 79, in db_sync\n2017-09-28 12:09:25.639 23364 ERROR cinder     migration = versioning_api.upgrade(engine, repository, version)\n2017-09-28 12:09:25.639 23364 ERROR cinder   File "/usr/lib/python2.7/dist-packages/migrate/versioning/api.py", line 186, in upgrade\n2017-09-28 12:09:25.639 23364 ERROR cinder     return _migrate(url, repository, version, upgrade=True, err=err, **opts)\n2017-09-28 12:09:25.639 23364 ERROR cinder   File "<decorator-gen-15>", line 2, in _migrate\n2017-09-28 12:09:25.639 23364 ERROR cinder   File "/usr/lib/python2.7/dist-packages/migrate/versioning/util/__init__.py", lin
Sep 28 12:09:30 ctl02 salt-minion[14967]: e 160, in with_engine\n2017-09-28 12:09:25.639 23364 ERROR cinder     return f(*a, **kw)\n2017-09-28 12:09:25.639 23364 ERROR cinder   File "/usr/lib/python2.7/dist-packages/migrate/versioning/api.py", line 345, in _migrate\n2017-09-28 12:09:25.639 23364 ERROR cinder     changeset = schema.changeset(version)\n2017-09-28 12:09:25.639 23364 ERROR cinder   File "/usr/lib/python2.7/dist-packages/migrate/versioning/schema.py", line 82, in changeset\n2017-09-28 12:09:25.639 23364 ERROR cinder     changeset = self.repository.changeset(database, start_ver, version)\n2017-09-28 12:09:25.639 23364 ERROR cinder   File "/usr/lib/python2.7/dist-packages/migrate/versioning/repository.py", line 225, in changeset\n2017-09-28 12:09:25.639 23364 ERROR cinder     changes = [self.version(v).script(database, op) for v in versions]\n2017-09-28 12:09:25.639 23364 ERROR cinder   File "/usr/lib/python2.7/dist-packages/migrate/versioning/repository.py", line 189, in version\n2017-09-28 12:09:25.639 23364 ERROR cinder     return self.versions.version(*p, **k)\n2017-09-28 12:09:25.639 23364 ERROR cinder   File "/usr/lib/python2.7/dist-packages/migrate/versioning/version.py", line 163, in version\n2017-09-28 12:09:25.639 23364 ERROR cinder     return self.versions[VerNum(vernum)]\n2017-09-28 12:09:25.639 23364 ERROR cinder KeyError: <VerNum(96)>\n2017-09-28 12:09:25.639 23364 ERROR cinder', 'stdout': ''}
Sep 28 12:09:30 ctl02 salt-minion[14967]: [INFO    ] Completed state [cinder-manage db sync; sleep 5;] at time 12:09:30.705395 duration_in_ms=6045.213
Sep 28 12:09:30 ctl02 salt-minion[14967]: [INFO    ] Running state [source /root/keystonerc; cinder type-create lvm-driver] at time 12:09:30.705781
Sep 28 12:09:30 ctl02 salt-minion[14967]: [INFO    ] Executing state cmd.run for source /root/keystonerc; cinder type-create lvm-driver
Sep 28 12:09:30 ctl02 salt-minion[14967]: [INFO    ] Executing command 'source /root/keystonerc; cinder type-list | grep lvm-driver' in directory '/root'
Sep 28 12:09:30 ctl02 glance-api[29183]: 2017-09-28 12:09:30.756 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:09:30] "OPTIONS / HTTP/1.0" 200 134 0.000659
Sep 28 12:09:30 ctl02 heat-api-cfn[13300]: 2017-09-28 12:09:30.900 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:09:30] "OPTIONS / HTTP/1.0" 200 134 0.000526
Sep 28 12:09:31 ctl02 salt-minion[14967]: [INFO    ] unless execution succeeded
Sep 28 12:09:31 ctl02 salt-minion[14967]: [INFO    ] Completed state [source /root/keystonerc; cinder type-create lvm-driver] at time 12:09:31.553214 duration_in_ms=847.432
Sep 28 12:09:31 ctl02 salt-minion[14967]: [INFO    ] Running state [source /root/keystonerc; cinder type-key lvm-driver set volume_backend_name=lvm-driver] at time 12:09:31.554025
Sep 28 12:09:31 ctl02 salt-minion[14967]: [INFO    ] Executing state cmd.run for source /root/keystonerc; cinder type-key lvm-driver set volume_backend_name=lvm-driver
Sep 28 12:09:31 ctl02 salt-minion[14967]: [INFO    ] Executing command 'source /root/keystonerc; cinder extra-specs-list | grep "{u'volume_backend_name': u'lvm-driver'}"' in directory '/root'
Sep 28 12:09:31 ctl02 nova-api[23410]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:09:31 ctl02 nova-api[23410]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:09:31 ctl02 nova-api[23410]: 2017-09-28 12:09:31.740 23410 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:09:31 ctl02 nova-api[23410]: 2017-09-28 12:09:31.741 23410 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:09:31 ctl02 nova-api[23410]: 2017-09-28 12:09:31.741 23410 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:09:31 ctl02 nova-api[23410]: 2017-09-28 12:09:31.741 23410 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:09:31 ctl02 nova-api[23410]: 2017-09-28 12:09:31.741 23410 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:09:31 ctl02 nova-api[23410]: 2017-09-28 12:09:31.741 23410 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:09:31 ctl02 nova-api[23410]: 2017-09-28 12:09:31.741 23410 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:09:31 ctl02 nova-api[23410]: 2017-09-28 12:09:31.741 23410 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:09:31 ctl02 nova-api[23410]: 2017-09-28 12:09:31.741 23410 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:09:31 ctl02 nova-api[23410]: 2017-09-28 12:09:31.741 23410 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:09:31 ctl02 nova-api[23410]: 2017-09-28 12:09:31.741 23410 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:09:31 ctl02 nova-api[23410]: 2017-09-28 12:09:31.741 23410 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:09:31 ctl02 nova-api[23410]: 2017-09-28 12:09:31.741 23410 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:09:31 ctl02 nova-api[23410]: 2017-09-28 12:09:31.741 23410 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:09:31 ctl02 nova-api[23410]: 2017-09-28 12:09:31.741 23410 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:09:31 ctl02 nova-api[23410]: 2017-09-28 12:09:31.741 23410 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:09:31 ctl02 nova-api[23410]: 2017-09-28 12:09:31.741 23410 ERROR nova.wsgi     self.filename))
Sep 28 12:09:31 ctl02 nova-api[23410]: 2017-09-28 12:09:31.741 23410 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:09:31 ctl02 nova-api[23410]: 2017-09-28 12:09:31.741 23410 ERROR nova.wsgi
Sep 28 12:09:31 ctl02 nova-api[23410]: 2017-09-28 12:09:31.742 23410 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:09:31 ctl02 nova-api[23410]: 2017-09-28 12:09:31.870 23410 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:09:32 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:09:32.071 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:09:32] "OPTIONS / HTTP/1.0" 200 134 0.000366
Sep 28 12:09:32 ctl02 nova-api[23410]: 2017-09-28 12:09:32.099 23410 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:09:32 ctl02 nova-api[23410]: 2017-09-28 12:09:32.102 23410 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:09:32 ctl02 nova-api[23410]: 2017-09-28 12:09:32.102 23410 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:09:32 ctl02 nova-api[23410]: 2017-09-28 12:09:32.102 23410 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:09:32 ctl02 nova-api[23410]: 2017-09-28 12:09:32.231 23410 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:09:32 ctl02 nova-api[23410]: 2017-09-28 12:09:32.233 23410 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:09:32 ctl02 nova-api[23410]: 2017-09-28 12:09:32.233 23410 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:09:32 ctl02 nova-api[23410]: 2017-09-28 12:09:32.233 23410 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:09:32 ctl02 nova-api[23410]: 2017-09-28 12:09:32.237 23410 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:09:32 ctl02 nova-api[23410]: 2017-09-28 12:09:32.237 23410 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:09:32 ctl02 nova-api[23410]: 2017-09-28 12:09:32.237 23410 ERROR nova Traceback (most recent call last):
Sep 28 12:09:32 ctl02 nova-api[23410]: 2017-09-28 12:09:32.237 23410 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:09:32 ctl02 nova-api[23410]: 2017-09-28 12:09:32.237 23410 ERROR nova     sys.exit(main())
Sep 28 12:09:32 ctl02 nova-api[23410]: 2017-09-28 12:09:32.237 23410 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:09:32 ctl02 nova-api[23410]: 2017-09-28 12:09:32.237 23410 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:09:32 ctl02 nova-api[23410]: 2017-09-28 12:09:32.237 23410 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:09:32 ctl02 nova-api[23410]: 2017-09-28 12:09:32.237 23410 ERROR nova     max_url_len=max_url_len)
Sep 28 12:09:32 ctl02 nova-api[23410]: 2017-09-28 12:09:32.237 23410 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:09:32 ctl02 nova-api[23410]: 2017-09-28 12:09:32.237 23410 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:09:32 ctl02 nova-api[23410]: 2017-09-28 12:09:32.237 23410 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:09:32 ctl02 nova-api[23410]: 2017-09-28 12:09:32.237 23410 ERROR nova     sock.listen(backlog)
Sep 28 12:09:32 ctl02 nova-api[23410]: 2017-09-28 12:09:32.237 23410 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:09:32 ctl02 nova-api[23410]: 2017-09-28 12:09:32.237 23410 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:09:32 ctl02 nova-api[23410]: 2017-09-28 12:09:32.237 23410 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:09:32 ctl02 nova-api[23410]: 2017-09-28 12:09:32.237 23410 ERROR nova
Sep 28 12:09:32 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:09:32 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:09:32 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:09:32 ctl02 salt-minion[14967]: [INFO    ] Executing command 'source /root/keystonerc; cinder type-key lvm-driver set volume_backend_name=lvm-driver' in directory '/root'
Sep 28 12:09:32 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:09:32 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:09:32 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:09:32 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:09:33 ctl02 heat-api[13008]: 2017-09-28 12:09:33.219 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:09:33] "OPTIONS / HTTP/1.0" 200 134 0.000706
Sep 28 12:09:33 ctl02 heat-api-cfn[13300]: 2017-09-28 12:09:33.234 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:09:33] "OPTIONS / HTTP/1.0" 200 134 0.000498
Sep 28 12:09:33 ctl02 salt-minion[14967]: [INFO    ] {'pid': 23440, 'retcode': 0, 'stderr': '', 'stdout': ''}
Sep 28 12:09:33 ctl02 salt-minion[14967]: [INFO    ] Completed state [source /root/keystonerc; cinder type-key lvm-driver set volume_backend_name=lvm-driver] at time 12:09:33.340662 duration_in_ms=1786.635
Sep 28 12:09:33 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928120620713934
Sep 28 12:09:33 ctl02 glance-api[29183]: 2017-09-28 12:09:33.850 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:09:33] "OPTIONS / HTTP/1.0" 200 134 0.000553
Sep 28 12:09:34 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command state.sls with jid 20170928120934173561
Sep 28 12:09:34 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 23467
Sep 28 12:09:34 ctl02 nova-api[23453]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:09:34 ctl02 nova-api[23453]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:09:34 ctl02 nova-api[23453]: 2017-09-28 12:09:34.473 23453 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:09:34 ctl02 nova-api[23453]: 2017-09-28 12:09:34.475 23453 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:09:34 ctl02 nova-api[23453]: 2017-09-28 12:09:34.475 23453 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:09:34 ctl02 nova-api[23453]: 2017-09-28 12:09:34.475 23453 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:09:34 ctl02 nova-api[23453]: 2017-09-28 12:09:34.475 23453 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:09:34 ctl02 nova-api[23453]: 2017-09-28 12:09:34.475 23453 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:09:34 ctl02 nova-api[23453]: 2017-09-28 12:09:34.475 23453 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:09:34 ctl02 nova-api[23453]: 2017-09-28 12:09:34.475 23453 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:09:34 ctl02 nova-api[23453]: 2017-09-28 12:09:34.475 23453 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:09:34 ctl02 nova-api[23453]: 2017-09-28 12:09:34.475 23453 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:09:34 ctl02 nova-api[23453]: 2017-09-28 12:09:34.475 23453 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:09:34 ctl02 nova-api[23453]: 2017-09-28 12:09:34.475 23453 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:09:34 ctl02 nova-api[23453]: 2017-09-28 12:09:34.475 23453 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:09:34 ctl02 nova-api[23453]: 2017-09-28 12:09:34.475 23453 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:09:34 ctl02 nova-api[23453]: 2017-09-28 12:09:34.475 23453 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:09:34 ctl02 nova-api[23453]: 2017-09-28 12:09:34.475 23453 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:09:34 ctl02 nova-api[23453]: 2017-09-28 12:09:34.475 23453 ERROR nova.wsgi     self.filename))
Sep 28 12:09:34 ctl02 nova-api[23453]: 2017-09-28 12:09:34.475 23453 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:09:34 ctl02 nova-api[23453]: 2017-09-28 12:09:34.475 23453 ERROR nova.wsgi
Sep 28 12:09:34 ctl02 nova-api[23453]: 2017-09-28 12:09:34.476 23453 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:09:34 ctl02 nova-api[23453]: 2017-09-28 12:09:34.608 23453 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:09:34 ctl02 heat-api[13008]: 2017-09-28 12:09:34.676 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:09:34] "OPTIONS / HTTP/1.0" 200 134 0.000569
Sep 28 12:09:34 ctl02 nova-api[23453]: 2017-09-28 12:09:34.856 23453 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:09:34 ctl02 nova-api[23453]: 2017-09-28 12:09:34.858 23453 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:09:34 ctl02 nova-api[23453]: 2017-09-28 12:09:34.859 23453 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:09:34 ctl02 nova-api[23453]: 2017-09-28 12:09:34.859 23453 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:09:34 ctl02 nova-api[23453]: 2017-09-28 12:09:34.992 23453 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:09:34 ctl02 nova-api[23453]: 2017-09-28 12:09:34.994 23453 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:09:34 ctl02 nova-api[23453]: 2017-09-28 12:09:34.994 23453 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:09:34 ctl02 nova-api[23453]: 2017-09-28 12:09:34.994 23453 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:09:34 ctl02 nova-api[23453]: 2017-09-28 12:09:34.998 23453 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:09:34 ctl02 nova-api[23453]: 2017-09-28 12:09:34.998 23453 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:09:34 ctl02 nova-api[23453]: 2017-09-28 12:09:34.998 23453 ERROR nova Traceback (most recent call last):
Sep 28 12:09:34 ctl02 nova-api[23453]: 2017-09-28 12:09:34.998 23453 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:09:34 ctl02 nova-api[23453]: 2017-09-28 12:09:34.998 23453 ERROR nova     sys.exit(main())
Sep 28 12:09:34 ctl02 nova-api[23453]: 2017-09-28 12:09:34.998 23453 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:09:34 ctl02 nova-api[23453]: 2017-09-28 12:09:34.998 23453 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:09:34 ctl02 nova-api[23453]: 2017-09-28 12:09:34.998 23453 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:09:34 ctl02 nova-api[23453]: 2017-09-28 12:09:34.998 23453 ERROR nova     max_url_len=max_url_len)
Sep 28 12:09:35 ctl02 nova-api[23453]: 2017-09-28 12:09:34.998 23453 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:09:35 ctl02 nova-api[23453]: 2017-09-28 12:09:34.998 23453 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:09:35 ctl02 nova-api[23453]: 2017-09-28 12:09:34.998 23453 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:09:35 ctl02 nova-api[23453]: 2017-09-28 12:09:34.998 23453 ERROR nova     sock.listen(backlog)
Sep 28 12:09:35 ctl02 nova-api[23453]: 2017-09-28 12:09:34.998 23453 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:09:35 ctl02 nova-api[23453]: 2017-09-28 12:09:34.998 23453 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:09:35 ctl02 nova-api[23453]: 2017-09-28 12:09:34.998 23453 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:09:35 ctl02 nova-api[23453]: 2017-09-28 12:09:34.998 23453 ERROR nova
Sep 28 12:09:35 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x58f29c77)
Sep 28 12:09:35 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:09:35 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:09:35 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:09:35 ctl02 glance-api[29183]: 2017-09-28 12:09:35.272 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:09:35] "OPTIONS / HTTP/1.0" 200 134 0.000620
Sep 28 12:09:35 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:09:35 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:09:35 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:09:35 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:09:36 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x58f29c77)
Sep 28 12:09:36 ctl02 salt-minion[14967]: [INFO    ] Loading fresh modules for state activity
Sep 28 12:09:36 ctl02 heat-api[13008]: 2017-09-28 12:09:36.831 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:09:36] "OPTIONS / HTTP/1.0" 200 134 0.000530
Sep 28 12:09:36 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'cinder/init.sls'
Sep 28 12:09:36 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'cinder/controller.sls'
Sep 28 12:09:36 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'cinder/map.jinja'
Sep 28 12:09:36 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'cinder/user.sls'
Sep 28 12:09:36 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'cinder/volume.sls'
Sep 28 12:09:36 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'cinder/map.jinja'
Sep 28 12:09:37 ctl02 nova-api[23479]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:09:37 ctl02 nova-api[23479]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:09:37 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x58f29c77)
Sep 28 12:09:37 ctl02 nova-api[23479]: 2017-09-28 12:09:37.191 23479 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:09:37 ctl02 nova-api[23479]: 2017-09-28 12:09:37.193 23479 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:09:37 ctl02 nova-api[23479]: 2017-09-28 12:09:37.193 23479 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:09:37 ctl02 nova-api[23479]: 2017-09-28 12:09:37.193 23479 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:09:37 ctl02 nova-api[23479]: 2017-09-28 12:09:37.193 23479 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:09:37 ctl02 nova-api[23479]: 2017-09-28 12:09:37.193 23479 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:09:37 ctl02 nova-api[23479]: 2017-09-28 12:09:37.193 23479 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:09:37 ctl02 nova-api[23479]: 2017-09-28 12:09:37.193 23479 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:09:37 ctl02 nova-api[23479]: 2017-09-28 12:09:37.193 23479 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:09:37 ctl02 nova-api[23479]: 2017-09-28 12:09:37.193 23479 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:09:37 ctl02 nova-api[23479]: 2017-09-28 12:09:37.193 23479 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:09:37 ctl02 nova-api[23479]: 2017-09-28 12:09:37.193 23479 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:09:37 ctl02 nova-api[23479]: 2017-09-28 12:09:37.193 23479 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:09:37 ctl02 nova-api[23479]: 2017-09-28 12:09:37.193 23479 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:09:37 ctl02 nova-api[23479]: 2017-09-28 12:09:37.193 23479 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:09:37 ctl02 nova-api[23479]: 2017-09-28 12:09:37.193 23479 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:09:37 ctl02 nova-api[23479]: 2017-09-28 12:09:37.193 23479 ERROR nova.wsgi     self.filename))
Sep 28 12:09:37 ctl02 nova-api[23479]: 2017-09-28 12:09:37.193 23479 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:09:37 ctl02 nova-api[23479]: 2017-09-28 12:09:37.193 23479 ERROR nova.wsgi
Sep 28 12:09:37 ctl02 nova-api[23479]: 2017-09-28 12:09:37.196 23479 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:09:37 ctl02 nova-api[23479]: 2017-09-28 12:09:37.327 23479 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:09:37 ctl02 nova-api[23479]: 2017-09-28 12:09:37.554 23479 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:09:37 ctl02 nova-api[23479]: 2017-09-28 12:09:37.557 23479 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:09:37 ctl02 nova-api[23479]: 2017-09-28 12:09:37.557 23479 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:09:37 ctl02 nova-api[23479]: 2017-09-28 12:09:37.558 23479 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:09:37 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:09:37.567 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:09:37] "OPTIONS / HTTP/1.0" 200 134 0.000388
Sep 28 12:09:37 ctl02 nova-api[23479]: 2017-09-28 12:09:37.691 23479 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:09:37 ctl02 nova-api[23479]: 2017-09-28 12:09:37.693 23479 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:09:37 ctl02 nova-api[23479]: 2017-09-28 12:09:37.693 23479 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:09:37 ctl02 nova-api[23479]: 2017-09-28 12:09:37.694 23479 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:09:37 ctl02 nova-api[23479]: 2017-09-28 12:09:37.697 23479 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:09:37 ctl02 nova-api[23479]: 2017-09-28 12:09:37.697 23479 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:09:37 ctl02 nova-api[23479]: 2017-09-28 12:09:37.697 23479 ERROR nova Traceback (most recent call last):
Sep 28 12:09:37 ctl02 nova-api[23479]: 2017-09-28 12:09:37.697 23479 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:09:37 ctl02 nova-api[23479]: 2017-09-28 12:09:37.697 23479 ERROR nova     sys.exit(main())
Sep 28 12:09:37 ctl02 nova-api[23479]: 2017-09-28 12:09:37.697 23479 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:09:37 ctl02 nova-api[23479]: 2017-09-28 12:09:37.697 23479 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:09:37 ctl02 nova-api[23479]: 2017-09-28 12:09:37.697 23479 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:09:37 ctl02 nova-api[23479]: 2017-09-28 12:09:37.697 23479 ERROR nova     max_url_len=max_url_len)
Sep 28 12:09:37 ctl02 nova-api[23479]: 2017-09-28 12:09:37.697 23479 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:09:37 ctl02 nova-api[23479]: 2017-09-28 12:09:37.697 23479 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:09:37 ctl02 nova-api[23479]: 2017-09-28 12:09:37.697 23479 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:09:37 ctl02 nova-api[23479]: 2017-09-28 12:09:37.697 23479 ERROR nova     sock.listen(backlog)
Sep 28 12:09:37 ctl02 nova-api[23479]: 2017-09-28 12:09:37.697 23479 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:09:37 ctl02 nova-api[23479]: 2017-09-28 12:09:37.697 23479 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:09:37 ctl02 nova-api[23479]: 2017-09-28 12:09:37.697 23479 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:09:37 ctl02 nova-api[23479]: 2017-09-28 12:09:37.697 23479 ERROR nova
Sep 28 12:09:37 ctl02 salt-minion[14967]: [INFO    ] Running state [python-cinder] at time 12:09:37.821777
Sep 28 12:09:37 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for python-cinder
Sep 28 12:09:37 ctl02 salt-minion[14967]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 12:09:37 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:09:37 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:09:37 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:09:37 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:09:37.985 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:09:37] "OPTIONS / HTTP/1.0" 200 134 0.000407
Sep 28 12:09:38 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:09:38 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:09:38 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x58f29c77)
Sep 28 12:09:38 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:09:38 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] Package python-cinder is already installed
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] Completed state [python-cinder] at time 12:09:38.271790 duration_in_ms=450.012
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] Running state [lvm2] at time 12:09:38.272031
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for lvm2
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] Package lvm2 is already installed
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] Completed state [lvm2] at time 12:09:38.275067 duration_in_ms=3.037
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] Running state [cinder-api] at time 12:09:38.275238
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for cinder-api
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] Package cinder-api is already installed
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] Completed state [cinder-api] at time 12:09:38.278185 duration_in_ms=2.947
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] Running state [python-memcache] at time 12:09:38.278354
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for python-memcache
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] Package python-memcache is already installed
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] Completed state [python-memcache] at time 12:09:38.281297 duration_in_ms=2.943
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] Running state [python-pycadf] at time 12:09:38.281459
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for python-pycadf
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] Package python-pycadf is already installed
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] Completed state [python-pycadf] at time 12:09:38.284479 duration_in_ms=3.02
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] Running state [gettext-base] at time 12:09:38.284646
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for gettext-base
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] Package gettext-base is already installed
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] Completed state [gettext-base] at time 12:09:38.287552 duration_in_ms=2.906
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] Running state [cinder-scheduler] at time 12:09:38.287713
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for cinder-scheduler
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] Package cinder-scheduler is already installed
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] Completed state [cinder-scheduler] at time 12:09:38.290655 duration_in_ms=2.942
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] Running state [/etc/cinder/cinder.conf] at time 12:09:38.292309
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] Executing state file.managed for /etc/cinder/cinder.conf
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'cinder/files/ocata/cinder.conf.controller.Debian'
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'cinder/map.jinja'
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'cinder/files/backend/_lvm.conf'
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] File /etc/cinder/cinder.conf is in the correct state
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] Completed state [/etc/cinder/cinder.conf] at time 12:09:38.418812 duration_in_ms=126.503
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] Running state [/etc/cinder/api-paste.ini] at time 12:09:38.419192
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] Executing state file.managed for /etc/cinder/api-paste.ini
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'cinder/files/ocata/api-paste.ini.controller.Debian'
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'cinder/map.jinja'
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] File /etc/cinder/api-paste.ini is in the correct state
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] Completed state [/etc/cinder/api-paste.ini] at time 12:09:38.476207 duration_in_ms=57.015
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] Running state [/etc/apache2/conf-available/cinder-wsgi.conf] at time 12:09:38.476604
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] Executing state file.managed for /etc/apache2/conf-available/cinder-wsgi.conf
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'cinder/files/ocata/cinder-wsgi.conf'
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'cinder/map.jinja'
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] File /etc/apache2/conf-available/cinder-wsgi.conf is in the correct state
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] Completed state [/etc/apache2/conf-available/cinder-wsgi.conf] at time 12:09:38.527994 duration_in_ms=51.39
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] Running state [apache2] at time 12:09:38.529251
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] Executing state service.running for apache2
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'status', 'apache2.service', '-n', '0'] in directory '/root'
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-active', 'apache2.service'] in directory '/root'
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-enabled', 'apache2.service'] in directory '/root'
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-enabled', 'apache2.service'] in directory '/root'
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemd-run', '--scope', 'systemctl', 'start', 'apache2.service'] in directory '/root'
Sep 28 12:09:38 ctl02 systemd[1]: Started /bin/systemctl start apache2.service.
Sep 28 12:09:38 ctl02 systemd[1]: Starting LSB: Apache2 web server...
Sep 28 12:09:38 ctl02 apache2[23539]:  * Starting Apache httpd web server apache2
Sep 28 12:09:38 ctl02 apache2[23539]:  *
Sep 28 12:09:38 ctl02 apache2[23539]:  * The apache2 configtest failed.
Sep 28 12:09:38 ctl02 apache2[23539]: Output of config test was:
Sep 28 12:09:38 ctl02 apache2[23539]: apache2: Syntax error on line 219 of /etc/apache2/apache2.conf: Could not open configuration file /etc/apache2/sites-enabled/nova-placement-api.conf: No such file or directory
Sep 28 12:09:38 ctl02 apache2[23539]: Action 'configtest' failed.
Sep 28 12:09:38 ctl02 apache2[23539]: The Apache error log may have more information.
Sep 28 12:09:38 ctl02 systemd[1]: apache2.service: Control process exited, code=exited status=1
Sep 28 12:09:38 ctl02 systemd[1]: Failed to start LSB: Apache2 web server.
Sep 28 12:09:38 ctl02 systemd[1]: apache2.service: Unit entered failed state.
Sep 28 12:09:38 ctl02 systemd[1]: apache2.service: Failed with result 'exit-code'.
Sep 28 12:09:38 ctl02 salt-minion[14967]: [ERROR   ] Command '['systemd-run', '--scope', 'systemctl', 'start', 'apache2.service']' failed with return code: 1
Sep 28 12:09:38 ctl02 salt-minion[14967]: [ERROR   ] output: Running scope as unit run-r40a61ebf33414f7fbb46f0615b60c7ed.scope.
Sep 28 12:09:38 ctl02 salt-minion[14967]: Job for apache2.service failed because the control process exited with error code. See "systemctl status apache2.service" and "journalctl -xe" for details.
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-enabled', 'apache2.service'] in directory '/root'
Sep 28 12:09:38 ctl02 salt-minion[14967]: [ERROR   ] Service apache2 is already enabled, and is dead
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] Completed state [apache2] at time 12:09:38.676714 duration_in_ms=147.461
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] Running state [cinder-scheduler] at time 12:09:38.677257
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] Executing state service.running for cinder-scheduler
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'status', 'cinder-scheduler.service', '-n', '0'] in directory '/root'
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-active', 'cinder-scheduler.service'] in directory '/root'
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-enabled', 'cinder-scheduler.service'] in directory '/root'
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] The service cinder-scheduler is already running
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] Completed state [cinder-scheduler] at time 12:09:38.712763 duration_in_ms=35.504
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] Running state [cinder-manage db sync; sleep 5;] at time 12:09:38.714457
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] Executing state cmd.run for cinder-manage db sync; sleep 5;
Sep 28 12:09:38 ctl02 salt-minion[14967]: [INFO    ] Executing command 'cinder-manage db sync; sleep 5;' in directory '/root'
Sep 28 12:09:39 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x58f29c77)
Sep 28 12:09:39 ctl02 nova-api[23509]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:09:39 ctl02 nova-api[23509]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:09:39 ctl02 nova-api[23509]: 2017-09-28 12:09:39.949 23509 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:09:39 ctl02 nova-api[23509]: 2017-09-28 12:09:39.951 23509 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:09:39 ctl02 nova-api[23509]: 2017-09-28 12:09:39.951 23509 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:09:39 ctl02 nova-api[23509]: 2017-09-28 12:09:39.951 23509 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:09:39 ctl02 nova-api[23509]: 2017-09-28 12:09:39.951 23509 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:09:39 ctl02 nova-api[23509]: 2017-09-28 12:09:39.951 23509 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:09:39 ctl02 nova-api[23509]: 2017-09-28 12:09:39.951 23509 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:09:39 ctl02 nova-api[23509]: 2017-09-28 12:09:39.951 23509 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:09:39 ctl02 nova-api[23509]: 2017-09-28 12:09:39.951 23509 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:09:39 ctl02 nova-api[23509]: 2017-09-28 12:09:39.951 23509 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:09:39 ctl02 nova-api[23509]: 2017-09-28 12:09:39.951 23509 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:09:39 ctl02 nova-api[23509]: 2017-09-28 12:09:39.951 23509 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:09:39 ctl02 nova-api[23509]: 2017-09-28 12:09:39.951 23509 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:09:39 ctl02 nova-api[23509]: 2017-09-28 12:09:39.951 23509 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:09:39 ctl02 nova-api[23509]: 2017-09-28 12:09:39.951 23509 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:09:39 ctl02 nova-api[23509]: 2017-09-28 12:09:39.951 23509 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:09:39 ctl02 nova-api[23509]: 2017-09-28 12:09:39.951 23509 ERROR nova.wsgi     self.filename))
Sep 28 12:09:39 ctl02 nova-api[23509]: 2017-09-28 12:09:39.951 23509 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:09:39 ctl02 nova-api[23509]: 2017-09-28 12:09:39.951 23509 ERROR nova.wsgi
Sep 28 12:09:39 ctl02 nova-api[23509]: 2017-09-28 12:09:39.953 23509 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:09:40 ctl02 nova-api[23509]: 2017-09-28 12:09:40.078 23509 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:09:40 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x58f29c77)
Sep 28 12:09:40 ctl02 nova-api[23509]: 2017-09-28 12:09:40.307 23509 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:09:40 ctl02 nova-api[23509]: 2017-09-28 12:09:40.313 23509 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:09:40 ctl02 nova-api[23509]: 2017-09-28 12:09:40.313 23509 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:09:40 ctl02 nova-api[23509]: 2017-09-28 12:09:40.313 23509 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:09:40 ctl02 nova-cert[4860]: 2017-09-28 12:09:40.314 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:09:40 ctl02 nova-api[23509]: 2017-09-28 12:09:40.443 23509 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:09:40 ctl02 nova-api[23509]: 2017-09-28 12:09:40.445 23509 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:09:40 ctl02 nova-api[23509]: 2017-09-28 12:09:40.445 23509 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:09:40 ctl02 nova-api[23509]: 2017-09-28 12:09:40.445 23509 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:09:40 ctl02 nova-api[23509]: 2017-09-28 12:09:40.448 23509 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:09:40 ctl02 nova-api[23509]: 2017-09-28 12:09:40.449 23509 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:09:40 ctl02 nova-api[23509]: 2017-09-28 12:09:40.449 23509 ERROR nova Traceback (most recent call last):
Sep 28 12:09:40 ctl02 nova-api[23509]: 2017-09-28 12:09:40.449 23509 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:09:40 ctl02 nova-api[23509]: 2017-09-28 12:09:40.449 23509 ERROR nova     sys.exit(main())
Sep 28 12:09:40 ctl02 nova-api[23509]: 2017-09-28 12:09:40.449 23509 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:09:40 ctl02 nova-api[23509]: 2017-09-28 12:09:40.449 23509 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:09:40 ctl02 nova-api[23509]: 2017-09-28 12:09:40.449 23509 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:09:40 ctl02 nova-api[23509]: 2017-09-28 12:09:40.449 23509 ERROR nova     max_url_len=max_url_len)
Sep 28 12:09:40 ctl02 nova-api[23509]: 2017-09-28 12:09:40.449 23509 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:09:40 ctl02 nova-api[23509]: 2017-09-28 12:09:40.449 23509 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:09:40 ctl02 nova-api[23509]: 2017-09-28 12:09:40.449 23509 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:09:40 ctl02 nova-api[23509]: 2017-09-28 12:09:40.449 23509 ERROR nova     sock.listen(backlog)
Sep 28 12:09:40 ctl02 nova-api[23509]: 2017-09-28 12:09:40.449 23509 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:09:40 ctl02 nova-api[23509]: 2017-09-28 12:09:40.449 23509 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:09:40 ctl02 nova-api[23509]: 2017-09-28 12:09:40.449 23509 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:09:40 ctl02 nova-api[23509]: 2017-09-28 12:09:40.449 23509 ERROR nova
Sep 28 12:09:40 ctl02 glance-api[29183]: 2017-09-28 12:09:40.528 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:09:40] "OPTIONS / HTTP/1.0" 200 134 0.000614
Sep 28 12:09:40 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:09:40 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:09:40 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:09:40 ctl02 heat-api-cfn[13300]: 2017-09-28 12:09:40.862 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:09:40] "OPTIONS / HTTP/1.0" 200 134 0.000602
Sep 28 12:09:40 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:09:40 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:09:40 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:09:40 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:09:41 ctl02 heat-api-cfn[13300]: 2017-09-28 12:09:41.067 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:09:41] "OPTIONS / HTTP/1.0" 200 134 0.000478
Sep 28 12:09:41 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x58f29c77)
Sep 28 12:09:41 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:09:41.974 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:09:41] "OPTIONS / HTTP/1.0" 200 134 0.000430
Sep 28 12:09:42 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x58f29c77)
Sep 28 12:09:42 ctl02 nova-conductor[5056]: 2017-09-28 12:09:42.399 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:09:42 ctl02 nova-conductor[5056]: 2017-09-28 12:09:42.412 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:09:42 ctl02 nova-conductor[5056]: 2017-09-28 12:09:42.414 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:09:42 ctl02 nova-conductor[5056]: 2017-09-28 12:09:42.420 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:09:42 ctl02 nova-api[23577]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:09:42 ctl02 nova-api[23577]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:09:42 ctl02 nova-api[23577]: 2017-09-28 12:09:42.719 23577 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:09:42 ctl02 nova-api[23577]: 2017-09-28 12:09:42.721 23577 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:09:42 ctl02 nova-api[23577]: 2017-09-28 12:09:42.721 23577 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:09:42 ctl02 nova-api[23577]: 2017-09-28 12:09:42.721 23577 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:09:42 ctl02 nova-api[23577]: 2017-09-28 12:09:42.721 23577 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:09:42 ctl02 nova-api[23577]: 2017-09-28 12:09:42.721 23577 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:09:42 ctl02 nova-api[23577]: 2017-09-28 12:09:42.721 23577 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:09:42 ctl02 nova-api[23577]: 2017-09-28 12:09:42.721 23577 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:09:42 ctl02 nova-api[23577]: 2017-09-28 12:09:42.721 23577 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:09:42 ctl02 nova-api[23577]: 2017-09-28 12:09:42.721 23577 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:09:42 ctl02 nova-api[23577]: 2017-09-28 12:09:42.721 23577 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:09:42 ctl02 nova-api[23577]: 2017-09-28 12:09:42.721 23577 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:09:42 ctl02 nova-api[23577]: 2017-09-28 12:09:42.721 23577 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:09:42 ctl02 nova-api[23577]: 2017-09-28 12:09:42.721 23577 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:09:42 ctl02 nova-api[23577]: 2017-09-28 12:09:42.721 23577 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:09:42 ctl02 nova-api[23577]: 2017-09-28 12:09:42.721 23577 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:09:42 ctl02 nova-api[23577]: 2017-09-28 12:09:42.721 23577 ERROR nova.wsgi     self.filename))
Sep 28 12:09:42 ctl02 nova-api[23577]: 2017-09-28 12:09:42.721 23577 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:09:42 ctl02 nova-api[23577]: 2017-09-28 12:09:42.721 23577 ERROR nova.wsgi
Sep 28 12:09:42 ctl02 nova-api[23577]: 2017-09-28 12:09:42.722 23577 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:09:42 ctl02 nova-api[23577]: 2017-09-28 12:09:42.848 23577 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:09:43 ctl02 nova-api[23577]: 2017-09-28 12:09:43.072 23577 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:09:43 ctl02 nova-api[23577]: 2017-09-28 12:09:43.074 23577 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:09:43 ctl02 nova-api[23577]: 2017-09-28 12:09:43.074 23577 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:09:43 ctl02 nova-api[23577]: 2017-09-28 12:09:43.074 23577 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:09:43 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x58f29c77)
Sep 28 12:09:43 ctl02 nova-api[23577]: 2017-09-28 12:09:43.204 23577 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:09:43 ctl02 nova-api[23577]: 2017-09-28 12:09:43.206 23577 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:09:43 ctl02 nova-api[23577]: 2017-09-28 12:09:43.206 23577 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:09:43 ctl02 nova-api[23577]: 2017-09-28 12:09:43.206 23577 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:09:43 ctl02 nova-api[23577]: 2017-09-28 12:09:43.210 23577 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:09:43 ctl02 nova-api[23577]: 2017-09-28 12:09:43.210 23577 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:09:43 ctl02 nova-api[23577]: 2017-09-28 12:09:43.210 23577 ERROR nova Traceback (most recent call last):
Sep 28 12:09:43 ctl02 nova-api[23577]: 2017-09-28 12:09:43.210 23577 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:09:43 ctl02 nova-api[23577]: 2017-09-28 12:09:43.210 23577 ERROR nova     sys.exit(main())
Sep 28 12:09:43 ctl02 nova-api[23577]: 2017-09-28 12:09:43.210 23577 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:09:43 ctl02 nova-api[23577]: 2017-09-28 12:09:43.210 23577 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:09:43 ctl02 nova-api[23577]: 2017-09-28 12:09:43.210 23577 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:09:43 ctl02 nova-api[23577]: 2017-09-28 12:09:43.210 23577 ERROR nova     max_url_len=max_url_len)
Sep 28 12:09:43 ctl02 nova-api[23577]: 2017-09-28 12:09:43.210 23577 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:09:43 ctl02 nova-api[23577]: 2017-09-28 12:09:43.210 23577 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:09:43 ctl02 nova-api[23577]: 2017-09-28 12:09:43.210 23577 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:09:43 ctl02 nova-api[23577]: 2017-09-28 12:09:43.210 23577 ERROR nova     sock.listen(backlog)
Sep 28 12:09:43 ctl02 nova-api[23577]: 2017-09-28 12:09:43.210 23577 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:09:43 ctl02 nova-api[23577]: 2017-09-28 12:09:43.210 23577 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:09:43 ctl02 nova-api[23577]: 2017-09-28 12:09:43.210 23577 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:09:43 ctl02 nova-api[23577]: 2017-09-28 12:09:43.210 23577 ERROR nova
Sep 28 12:09:43 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:09:43 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:09:43 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:09:43 ctl02 heat-api-cfn[13300]: 2017-09-28 12:09:43.372 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:09:43] "OPTIONS / HTTP/1.0" 200 134 0.000642
Sep 28 12:09:43 ctl02 heat-api[13008]: 2017-09-28 12:09:43.613 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:09:43] "OPTIONS / HTTP/1.0" 200 134 0.000762
Sep 28 12:09:43 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:09:43 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:09:43 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:09:43 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:09:44 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x58f29c77)
Sep 28 12:09:44 ctl02 glance-api[29183]: 2017-09-28 12:09:44.155 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:09:44] "OPTIONS / HTTP/1.0" 200 134 0.000641
Sep 28 12:09:44 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928120944267386
Sep 28 12:09:44 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 23606
Sep 28 12:09:44 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928120944267386
Sep 28 12:09:44 ctl02 salt-minion[14967]: [INFO    ] {'pid': 23559, 'retcode': 0, 'stderr': 'Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.\n2017-09-28 12:09:39.631 23560 WARNING py.warnings [-] /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/enginefacade.py:241: NotSupportedWarning: Configuration option(s) [\'use_tpool\'] not supported\n  exception.NotSupportedWarning\n\n2017-09-28 12:09:39.675 23560 CRITICAL cinder [-] KeyError: <VerNum(96)>\n2017-09-28 12:09:39.675 23560 ERROR cinder Traceback (most recent call last):\n2017-09-28 12:09:39.675 23560 ERROR cinder   File "/usr/bin/cinder-manage", line 10, in <module>\n2017-09-28 12:09:39.675 23560 ERROR cinder     sys.exit(main())\n2017-09-28 12:09:39.675 23560 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/cmd/manage.py", line 597, in main\n2017-09-28 12:09:39.675 23560 ERROR cinder     fn(*fn_args)\n2017-09-28 12:09:39.675 23560 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/cmd/manage.py", line 215, in sync\n2017-09-28 12:09:39.675 23560 ERROR cinder     return db_migration.db_sync(version)\n2017-09-28 12:09:39.675 23560 ERROR cinder   File "/usr/lib/python2.7/dist-packages/cinder/db/migration.py", line 73, in db_sync\n2017-09-28 12:09:39.675 23560 ERROR cinder     init_version=init_version)\n2017-09-28 12:09:39.675 23560 ERROR cinder   File "/usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/migration.py", line 79, in db_sync\n2017-09-28 12:09:39.675 23560 ERROR cinder     migration = versioning_api.upgrade(engine, repository, version)\n2017-09-28 12:09:39.675 23560 ERROR cinder   File "/usr/lib/python2.7/dist-packages/migrate/versioning/api.py", line 186, in upgrade\n2017-09-28 12:09:39.675 23560 ERROR cinder     return _migrate(url, repository, version, upgrade=True, err=err, **opts)\n2017-09-28 12:09:39.675 23560 ERROR cinder   File "<decorator-gen-15>", line 2, in _migrate\n2017-09-28 12:09:39.675 23560 ERROR cinder   File "/usr/lib/python2.7/dist-packages/migrate/versioning/util/__init__.py", lin
Sep 28 12:09:44 ctl02 salt-minion[14967]: e 160, in with_engine\n2017-09-28 12:09:39.675 23560 ERROR cinder     return f(*a, **kw)\n2017-09-28 12:09:39.675 23560 ERROR cinder   File "/usr/lib/python2.7/dist-packages/migrate/versioning/api.py", line 345, in _migrate\n2017-09-28 12:09:39.675 23560 ERROR cinder     changeset = schema.changeset(version)\n2017-09-28 12:09:39.675 23560 ERROR cinder   File "/usr/lib/python2.7/dist-packages/migrate/versioning/schema.py", line 82, in changeset\n2017-09-28 12:09:39.675 23560 ERROR cinder     changeset = self.repository.changeset(database, start_ver, version)\n2017-09-28 12:09:39.675 23560 ERROR cinder   File "/usr/lib/python2.7/dist-packages/migrate/versioning/repository.py", line 225, in changeset\n2017-09-28 12:09:39.675 23560 ERROR cinder     changes = [self.version(v).script(database, op) for v in versions]\n2017-09-28 12:09:39.675 23560 ERROR cinder   File "/usr/lib/python2.7/dist-packages/migrate/versioning/repository.py", line 189, in version\n2017-09-28 12:09:39.675 23560 ERROR cinder     return self.versions.version(*p, **k)\n2017-09-28 12:09:39.675 23560 ERROR cinder   File "/usr/lib/python2.7/dist-packages/migrate/versioning/version.py", line 163, in version\n2017-09-28 12:09:39.675 23560 ERROR cinder     return self.versions[VerNum(vernum)]\n2017-09-28 12:09:39.675 23560 ERROR cinder KeyError: <VerNum(96)>\n2017-09-28 12:09:39.675 23560 ERROR cinder', 'stdout': ''}
Sep 28 12:09:44 ctl02 salt-minion[14967]: [INFO    ] Completed state [cinder-manage db sync; sleep 5;] at time 12:09:44.750506 duration_in_ms=6036.047
Sep 28 12:09:44 ctl02 salt-minion[14967]: [INFO    ] Running state [source /root/keystonerc; cinder type-create lvm-driver] at time 12:09:44.750942
Sep 28 12:09:44 ctl02 salt-minion[14967]: [INFO    ] Executing state cmd.run for source /root/keystonerc; cinder type-create lvm-driver
Sep 28 12:09:44 ctl02 salt-minion[14967]: [INFO    ] Executing command 'source /root/keystonerc; cinder type-list | grep lvm-driver' in directory '/root'
Sep 28 12:09:45 ctl02 heat-api[13008]: 2017-09-28 12:09:45.006 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:09:45] "OPTIONS / HTTP/1.0" 200 134 0.000558
Sep 28 12:09:45 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x58f29c77)
Sep 28 12:09:45 ctl02 nova-api[23595]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:09:45 ctl02 nova-api[23595]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:09:45 ctl02 glance-api[29183]: 2017-09-28 12:09:45.391 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:09:45] "OPTIONS / HTTP/1.0" 200 134 0.000541
Sep 28 12:09:45 ctl02 nova-api[23595]: 2017-09-28 12:09:45.472 23595 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:09:45 ctl02 nova-api[23595]: 2017-09-28 12:09:45.475 23595 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:09:45 ctl02 nova-api[23595]: 2017-09-28 12:09:45.475 23595 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:09:45 ctl02 nova-api[23595]: 2017-09-28 12:09:45.475 23595 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:09:45 ctl02 nova-api[23595]: 2017-09-28 12:09:45.475 23595 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:09:45 ctl02 nova-api[23595]: 2017-09-28 12:09:45.475 23595 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:09:45 ctl02 nova-api[23595]: 2017-09-28 12:09:45.475 23595 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:09:45 ctl02 nova-api[23595]: 2017-09-28 12:09:45.475 23595 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:09:45 ctl02 nova-api[23595]: 2017-09-28 12:09:45.475 23595 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:09:45 ctl02 nova-api[23595]: 2017-09-28 12:09:45.475 23595 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:09:45 ctl02 nova-api[23595]: 2017-09-28 12:09:45.475 23595 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:09:45 ctl02 nova-api[23595]: 2017-09-28 12:09:45.475 23595 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:09:45 ctl02 nova-api[23595]: 2017-09-28 12:09:45.475 23595 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:09:45 ctl02 nova-api[23595]: 2017-09-28 12:09:45.475 23595 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:09:45 ctl02 nova-api[23595]: 2017-09-28 12:09:45.475 23595 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:09:45 ctl02 nova-api[23595]: 2017-09-28 12:09:45.475 23595 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:09:45 ctl02 nova-api[23595]: 2017-09-28 12:09:45.475 23595 ERROR nova.wsgi     self.filename))
Sep 28 12:09:45 ctl02 nova-api[23595]: 2017-09-28 12:09:45.475 23595 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:09:45 ctl02 nova-api[23595]: 2017-09-28 12:09:45.475 23595 ERROR nova.wsgi
Sep 28 12:09:45 ctl02 nova-api[23595]: 2017-09-28 12:09:45.477 23595 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:09:45 ctl02 salt-minion[14967]: [INFO    ] unless execution succeeded
Sep 28 12:09:45 ctl02 salt-minion[14967]: [INFO    ] Completed state [source /root/keystonerc; cinder type-create lvm-driver] at time 12:09:45.605881 duration_in_ms=854.937
Sep 28 12:09:45 ctl02 salt-minion[14967]: [INFO    ] Running state [source /root/keystonerc; cinder type-key lvm-driver set volume_backend_name=lvm-driver] at time 12:09:45.606788
Sep 28 12:09:45 ctl02 salt-minion[14967]: [INFO    ] Executing state cmd.run for source /root/keystonerc; cinder type-key lvm-driver set volume_backend_name=lvm-driver
Sep 28 12:09:45 ctl02 salt-minion[14967]: [INFO    ] Executing command 'source /root/keystonerc; cinder extra-specs-list | grep "{u'volume_backend_name': u'lvm-driver'}"' in directory '/root'
Sep 28 12:09:45 ctl02 nova-api[23595]: 2017-09-28 12:09:45.609 23595 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:09:45 ctl02 nova-api[23595]: 2017-09-28 12:09:45.823 23595 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:09:45 ctl02 nova-api[23595]: 2017-09-28 12:09:45.826 23595 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:09:45 ctl02 nova-api[23595]: 2017-09-28 12:09:45.826 23595 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:09:45 ctl02 nova-api[23595]: 2017-09-28 12:09:45.827 23595 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:09:45 ctl02 nova-api[23595]: 2017-09-28 12:09:45.957 23595 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:09:45 ctl02 nova-api[23595]: 2017-09-28 12:09:45.959 23595 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:09:45 ctl02 nova-api[23595]: 2017-09-28 12:09:45.959 23595 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:09:45 ctl02 nova-api[23595]: 2017-09-28 12:09:45.960 23595 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:09:45 ctl02 nova-api[23595]: 2017-09-28 12:09:45.963 23595 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:09:45 ctl02 nova-api[23595]: 2017-09-28 12:09:45.964 23595 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:09:45 ctl02 nova-api[23595]: 2017-09-28 12:09:45.964 23595 ERROR nova Traceback (most recent call last):
Sep 28 12:09:45 ctl02 nova-api[23595]: 2017-09-28 12:09:45.964 23595 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:09:45 ctl02 nova-api[23595]: 2017-09-28 12:09:45.964 23595 ERROR nova     sys.exit(main())
Sep 28 12:09:45 ctl02 nova-api[23595]: 2017-09-28 12:09:45.964 23595 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:09:45 ctl02 nova-api[23595]: 2017-09-28 12:09:45.964 23595 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:09:45 ctl02 nova-api[23595]: 2017-09-28 12:09:45.964 23595 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:09:45 ctl02 nova-api[23595]: 2017-09-28 12:09:45.964 23595 ERROR nova     max_url_len=max_url_len)
Sep 28 12:09:45 ctl02 nova-api[23595]: 2017-09-28 12:09:45.964 23595 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:09:45 ctl02 nova-api[23595]: 2017-09-28 12:09:45.964 23595 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:09:45 ctl02 nova-api[23595]: 2017-09-28 12:09:45.964 23595 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:09:45 ctl02 nova-api[23595]: 2017-09-28 12:09:45.964 23595 ERROR nova     sock.listen(backlog)
Sep 28 12:09:45 ctl02 nova-api[23595]: 2017-09-28 12:09:45.964 23595 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:09:45 ctl02 nova-api[23595]: 2017-09-28 12:09:45.964 23595 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:09:45 ctl02 nova-api[23595]: 2017-09-28 12:09:45.964 23595 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:09:45 ctl02 nova-api[23595]: 2017-09-28 12:09:45.964 23595 ERROR nova
Sep 28 12:09:46 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:09:46 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:09:46 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:09:46 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:09:46 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:09:46 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:09:46 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:09:46 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:09:46 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:09:46 ctl02 salt-minion[14967]: [INFO    ] Executing command 'source /root/keystonerc; cinder type-key lvm-driver set volume_backend_name=lvm-driver' in directory '/root'
Sep 28 12:09:46 ctl02 heat-api[13008]: 2017-09-28 12:09:46.917 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:09:46] "OPTIONS / HTTP/1.0" 200 134 0.000502
Sep 28 12:09:47 ctl02 salt-minion[14967]: [INFO    ] {'pid': 23646, 'retcode': 0, 'stderr': '', 'stdout': ''}
Sep 28 12:09:47 ctl02 salt-minion[14967]: [INFO    ] Completed state [source /root/keystonerc; cinder type-key lvm-driver set volume_backend_name=lvm-driver] at time 12:09:47.305427 duration_in_ms=1698.637
Sep 28 12:09:47 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928120934173561
Sep 28 12:09:47 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:09:47.326 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:09:47] "OPTIONS / HTTP/1.0" 200 134 0.000463
Sep 28 12:09:48 ctl02 nova-api[23640]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:09:48 ctl02 nova-api[23640]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:09:48 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:09:48.099 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:09:48] "OPTIONS / HTTP/1.0" 200 134 0.000428
Sep 28 12:09:48 ctl02 nova-api[23640]: 2017-09-28 12:09:48.207 23640 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:09:48 ctl02 nova-api[23640]: 2017-09-28 12:09:48.209 23640 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:09:48 ctl02 nova-api[23640]: 2017-09-28 12:09:48.209 23640 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:09:48 ctl02 nova-api[23640]: 2017-09-28 12:09:48.209 23640 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:09:48 ctl02 nova-api[23640]: 2017-09-28 12:09:48.209 23640 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:09:48 ctl02 nova-api[23640]: 2017-09-28 12:09:48.209 23640 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:09:48 ctl02 nova-api[23640]: 2017-09-28 12:09:48.209 23640 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:09:48 ctl02 nova-api[23640]: 2017-09-28 12:09:48.209 23640 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:09:48 ctl02 nova-api[23640]: 2017-09-28 12:09:48.209 23640 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:09:48 ctl02 nova-api[23640]: 2017-09-28 12:09:48.209 23640 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:09:48 ctl02 nova-api[23640]: 2017-09-28 12:09:48.209 23640 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:09:48 ctl02 nova-api[23640]: 2017-09-28 12:09:48.209 23640 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:09:48 ctl02 nova-api[23640]: 2017-09-28 12:09:48.209 23640 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:09:48 ctl02 nova-api[23640]: 2017-09-28 12:09:48.209 23640 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:09:48 ctl02 nova-api[23640]: 2017-09-28 12:09:48.209 23640 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:09:48 ctl02 nova-api[23640]: 2017-09-28 12:09:48.209 23640 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:09:48 ctl02 nova-api[23640]: 2017-09-28 12:09:48.209 23640 ERROR nova.wsgi     self.filename))
Sep 28 12:09:48 ctl02 nova-api[23640]: 2017-09-28 12:09:48.209 23640 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:09:48 ctl02 nova-api[23640]: 2017-09-28 12:09:48.209 23640 ERROR nova.wsgi
Sep 28 12:09:48 ctl02 nova-api[23640]: 2017-09-28 12:09:48.211 23640 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:09:48 ctl02 nova-api[23640]: 2017-09-28 12:09:48.339 23640 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:09:48 ctl02 nova-api[23640]: 2017-09-28 12:09:48.568 23640 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:09:48 ctl02 nova-api[23640]: 2017-09-28 12:09:48.570 23640 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:09:48 ctl02 nova-api[23640]: 2017-09-28 12:09:48.570 23640 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:09:48 ctl02 nova-api[23640]: 2017-09-28 12:09:48.570 23640 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:09:48 ctl02 nova-api[23640]: 2017-09-28 12:09:48.701 23640 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:09:48 ctl02 nova-api[23640]: 2017-09-28 12:09:48.703 23640 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:09:48 ctl02 nova-api[23640]: 2017-09-28 12:09:48.703 23640 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:09:48 ctl02 nova-api[23640]: 2017-09-28 12:09:48.703 23640 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:09:48 ctl02 nova-api[23640]: 2017-09-28 12:09:48.706 23640 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:09:48 ctl02 nova-api[23640]: 2017-09-28 12:09:48.707 23640 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:09:48 ctl02 nova-api[23640]: 2017-09-28 12:09:48.707 23640 ERROR nova Traceback (most recent call last):
Sep 28 12:09:48 ctl02 nova-api[23640]: 2017-09-28 12:09:48.707 23640 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:09:48 ctl02 nova-api[23640]: 2017-09-28 12:09:48.707 23640 ERROR nova     sys.exit(main())
Sep 28 12:09:48 ctl02 nova-api[23640]: 2017-09-28 12:09:48.707 23640 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:09:48 ctl02 nova-api[23640]: 2017-09-28 12:09:48.707 23640 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:09:48 ctl02 nova-api[23640]: 2017-09-28 12:09:48.707 23640 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:09:48 ctl02 nova-api[23640]: 2017-09-28 12:09:48.707 23640 ERROR nova     max_url_len=max_url_len)
Sep 28 12:09:48 ctl02 nova-api[23640]: 2017-09-28 12:09:48.707 23640 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:09:48 ctl02 nova-api[23640]: 2017-09-28 12:09:48.707 23640 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:09:48 ctl02 nova-api[23640]: 2017-09-28 12:09:48.707 23640 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:09:48 ctl02 nova-api[23640]: 2017-09-28 12:09:48.707 23640 ERROR nova     sock.listen(backlog)
Sep 28 12:09:48 ctl02 nova-api[23640]: 2017-09-28 12:09:48.707 23640 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:09:48 ctl02 nova-api[23640]: 2017-09-28 12:09:48.707 23640 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:09:48 ctl02 nova-api[23640]: 2017-09-28 12:09:48.707 23640 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:09:48 ctl02 nova-api[23640]: 2017-09-28 12:09:48.707 23640 ERROR nova
Sep 28 12:09:48 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:09:48 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:09:48 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:09:49 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:09:49 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:09:49 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:09:49 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:09:50 ctl02 nova-consoleauth[5433]: 2017-09-28 12:09:50.218 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:09:50 ctl02 glance-api[29183]: 2017-09-28 12:09:50.730 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:09:50] "OPTIONS / HTTP/1.0" 200 134 0.000568
Sep 28 12:09:50 ctl02 nova-api[23669]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:09:50 ctl02 nova-api[23669]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:09:50 ctl02 heat-api-cfn[13300]: 2017-09-28 12:09:50.793 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:09:50] "OPTIONS / HTTP/1.0" 200 134 0.000572
Sep 28 12:09:50 ctl02 nova-api[23669]: 2017-09-28 12:09:50.965 23669 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:09:50 ctl02 nova-api[23669]: 2017-09-28 12:09:50.967 23669 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:09:50 ctl02 nova-api[23669]: 2017-09-28 12:09:50.967 23669 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:09:50 ctl02 nova-api[23669]: 2017-09-28 12:09:50.967 23669 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:09:50 ctl02 nova-api[23669]: 2017-09-28 12:09:50.967 23669 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:09:50 ctl02 nova-api[23669]: 2017-09-28 12:09:50.967 23669 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:09:50 ctl02 nova-api[23669]: 2017-09-28 12:09:50.967 23669 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:09:50 ctl02 nova-api[23669]: 2017-09-28 12:09:50.967 23669 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:09:50 ctl02 nova-api[23669]: 2017-09-28 12:09:50.967 23669 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:09:50 ctl02 nova-api[23669]: 2017-09-28 12:09:50.967 23669 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:09:50 ctl02 nova-api[23669]: 2017-09-28 12:09:50.967 23669 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:09:50 ctl02 nova-api[23669]: 2017-09-28 12:09:50.967 23669 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:09:50 ctl02 nova-api[23669]: 2017-09-28 12:09:50.967 23669 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:09:50 ctl02 nova-api[23669]: 2017-09-28 12:09:50.967 23669 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:09:50 ctl02 nova-api[23669]: 2017-09-28 12:09:50.967 23669 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:09:50 ctl02 nova-api[23669]: 2017-09-28 12:09:50.967 23669 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:09:50 ctl02 nova-api[23669]: 2017-09-28 12:09:50.967 23669 ERROR nova.wsgi     self.filename))
Sep 28 12:09:50 ctl02 nova-api[23669]: 2017-09-28 12:09:50.967 23669 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:09:50 ctl02 nova-api[23669]: 2017-09-28 12:09:50.967 23669 ERROR nova.wsgi
Sep 28 12:09:50 ctl02 nova-api[23669]: 2017-09-28 12:09:50.968 23669 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:09:51 ctl02 heat-api-cfn[13300]: 2017-09-28 12:09:51.072 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:09:51] "OPTIONS / HTTP/1.0" 200 134 0.000572
Sep 28 12:09:51 ctl02 nova-api[23669]: 2017-09-28 12:09:51.101 23669 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:09:51 ctl02 nova-api[23669]: 2017-09-28 12:09:51.348 23669 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:09:51 ctl02 nova-api[23669]: 2017-09-28 12:09:51.351 23669 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:09:51 ctl02 nova-api[23669]: 2017-09-28 12:09:51.351 23669 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:09:51 ctl02 nova-api[23669]: 2017-09-28 12:09:51.351 23669 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:09:51 ctl02 nova-api[23669]: 2017-09-28 12:09:51.484 23669 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:09:51 ctl02 nova-api[23669]: 2017-09-28 12:09:51.486 23669 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:09:51 ctl02 nova-api[23669]: 2017-09-28 12:09:51.487 23669 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:09:51 ctl02 nova-api[23669]: 2017-09-28 12:09:51.487 23669 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:09:51 ctl02 nova-api[23669]: 2017-09-28 12:09:51.490 23669 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:09:51 ctl02 nova-api[23669]: 2017-09-28 12:09:51.491 23669 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:09:51 ctl02 nova-api[23669]: 2017-09-28 12:09:51.491 23669 ERROR nova Traceback (most recent call last):
Sep 28 12:09:51 ctl02 nova-api[23669]: 2017-09-28 12:09:51.491 23669 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:09:51 ctl02 nova-api[23669]: 2017-09-28 12:09:51.491 23669 ERROR nova     sys.exit(main())
Sep 28 12:09:51 ctl02 nova-api[23669]: 2017-09-28 12:09:51.491 23669 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:09:51 ctl02 nova-api[23669]: 2017-09-28 12:09:51.491 23669 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:09:51 ctl02 nova-api[23669]: 2017-09-28 12:09:51.491 23669 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:09:51 ctl02 nova-api[23669]: 2017-09-28 12:09:51.491 23669 ERROR nova     max_url_len=max_url_len)
Sep 28 12:09:51 ctl02 nova-api[23669]: 2017-09-28 12:09:51.491 23669 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:09:51 ctl02 nova-api[23669]: 2017-09-28 12:09:51.491 23669 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:09:51 ctl02 nova-api[23669]: 2017-09-28 12:09:51.491 23669 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:09:51 ctl02 nova-api[23669]: 2017-09-28 12:09:51.491 23669 ERROR nova     sock.listen(backlog)
Sep 28 12:09:51 ctl02 nova-api[23669]: 2017-09-28 12:09:51.491 23669 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:09:51 ctl02 nova-api[23669]: 2017-09-28 12:09:51.491 23669 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:09:51 ctl02 nova-api[23669]: 2017-09-28 12:09:51.491 23669 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:09:51 ctl02 nova-api[23669]: 2017-09-28 12:09:51.491 23669 ERROR nova
Sep 28 12:09:51 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:09:51 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:09:51 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:09:51 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:09:51 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:09:51 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:09:51 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:09:52 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:09:52.164 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:09:52] "OPTIONS / HTTP/1.0" 200 134 0.000704
Sep 28 12:09:53 ctl02 heat-api-cfn[13300]: 2017-09-28 12:09:53.206 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:09:53] "OPTIONS / HTTP/1.0" 200 134 0.000685
Sep 28 12:09:53 ctl02 nova-scheduler[5620]: 2017-09-28 12:09:53.235 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:09:53 ctl02 heat-engine[12803]: 2017-09-28 12:09:53.461 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:09:53 ctl02 heat-engine[12803]: 2017-09-28 12:09:53.491 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:09:53 ctl02 heat-engine[12803]: 2017-09-28 12:09:53.506 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:09:53 ctl02 heat-engine[12803]: 2017-09-28 12:09:53.515 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:09:53 ctl02 nova-api[23687]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:09:53 ctl02 nova-api[23687]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:09:53 ctl02 nova-api[23687]: 2017-09-28 12:09:53.738 23687 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:09:53 ctl02 nova-api[23687]: 2017-09-28 12:09:53.740 23687 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:09:53 ctl02 nova-api[23687]: 2017-09-28 12:09:53.740 23687 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:09:53 ctl02 nova-api[23687]: 2017-09-28 12:09:53.740 23687 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:09:53 ctl02 nova-api[23687]: 2017-09-28 12:09:53.740 23687 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:09:53 ctl02 nova-api[23687]: 2017-09-28 12:09:53.740 23687 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:09:53 ctl02 nova-api[23687]: 2017-09-28 12:09:53.740 23687 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:09:53 ctl02 nova-api[23687]: 2017-09-28 12:09:53.740 23687 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:09:53 ctl02 nova-api[23687]: 2017-09-28 12:09:53.740 23687 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:09:53 ctl02 nova-api[23687]: 2017-09-28 12:09:53.740 23687 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:09:53 ctl02 nova-api[23687]: 2017-09-28 12:09:53.740 23687 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:09:53 ctl02 nova-api[23687]: 2017-09-28 12:09:53.740 23687 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:09:53 ctl02 nova-api[23687]: 2017-09-28 12:09:53.740 23687 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:09:53 ctl02 nova-api[23687]: 2017-09-28 12:09:53.740 23687 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:09:53 ctl02 nova-api[23687]: 2017-09-28 12:09:53.740 23687 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:09:53 ctl02 nova-api[23687]: 2017-09-28 12:09:53.740 23687 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:09:53 ctl02 nova-api[23687]: 2017-09-28 12:09:53.740 23687 ERROR nova.wsgi     self.filename))
Sep 28 12:09:53 ctl02 nova-api[23687]: 2017-09-28 12:09:53.740 23687 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:09:53 ctl02 nova-api[23687]: 2017-09-28 12:09:53.740 23687 ERROR nova.wsgi
Sep 28 12:09:53 ctl02 nova-api[23687]: 2017-09-28 12:09:53.741 23687 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:09:53 ctl02 nova-api[23687]: 2017-09-28 12:09:53.871 23687 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:09:53 ctl02 heat-api[13008]: 2017-09-28 12:09:53.995 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:09:53] "OPTIONS / HTTP/1.0" 200 134 0.000678
Sep 28 12:09:54 ctl02 nova-api[23687]: 2017-09-28 12:09:54.122 23687 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:09:54 ctl02 nova-api[23687]: 2017-09-28 12:09:54.124 23687 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:09:54 ctl02 nova-api[23687]: 2017-09-28 12:09:54.124 23687 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:09:54 ctl02 nova-api[23687]: 2017-09-28 12:09:54.125 23687 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:09:54 ctl02 nova-api[23687]: 2017-09-28 12:09:54.258 23687 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:09:54 ctl02 nova-api[23687]: 2017-09-28 12:09:54.260 23687 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:09:54 ctl02 nova-api[23687]: 2017-09-28 12:09:54.260 23687 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:09:54 ctl02 nova-api[23687]: 2017-09-28 12:09:54.260 23687 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:09:54 ctl02 nova-api[23687]: 2017-09-28 12:09:54.263 23687 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:09:54 ctl02 nova-api[23687]: 2017-09-28 12:09:54.264 23687 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:09:54 ctl02 nova-api[23687]: 2017-09-28 12:09:54.264 23687 ERROR nova Traceback (most recent call last):
Sep 28 12:09:54 ctl02 nova-api[23687]: 2017-09-28 12:09:54.264 23687 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:09:54 ctl02 nova-api[23687]: 2017-09-28 12:09:54.264 23687 ERROR nova     sys.exit(main())
Sep 28 12:09:54 ctl02 nova-api[23687]: 2017-09-28 12:09:54.264 23687 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:09:54 ctl02 nova-api[23687]: 2017-09-28 12:09:54.264 23687 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:09:54 ctl02 nova-api[23687]: 2017-09-28 12:09:54.264 23687 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:09:54 ctl02 nova-api[23687]: 2017-09-28 12:09:54.264 23687 ERROR nova     max_url_len=max_url_len)
Sep 28 12:09:54 ctl02 nova-api[23687]: 2017-09-28 12:09:54.264 23687 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:09:54 ctl02 nova-api[23687]: 2017-09-28 12:09:54.264 23687 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:09:54 ctl02 nova-api[23687]: 2017-09-28 12:09:54.264 23687 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:09:54 ctl02 nova-api[23687]: 2017-09-28 12:09:54.264 23687 ERROR nova     sock.listen(backlog)
Sep 28 12:09:54 ctl02 nova-api[23687]: 2017-09-28 12:09:54.264 23687 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:09:54 ctl02 nova-api[23687]: 2017-09-28 12:09:54.264 23687 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:09:54 ctl02 nova-api[23687]: 2017-09-28 12:09:54.264 23687 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:09:54 ctl02 nova-api[23687]: 2017-09-28 12:09:54.264 23687 ERROR nova
Sep 28 12:09:54 ctl02 glance-api[29183]: 2017-09-28 12:09:54.392 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:09:54] "OPTIONS / HTTP/1.0" 200 134 0.000764
Sep 28 12:09:54 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:09:54 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:09:54 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:09:54 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:09:54 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:09:54 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:09:54 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:09:55 ctl02 heat-api[13008]: 2017-09-28 12:09:55.123 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:09:55] "OPTIONS / HTTP/1.0" 200 134 0.000612
Sep 28 12:09:55 ctl02 glance-api[29183]: 2017-09-28 12:09:55.151 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:09:55] "OPTIONS / HTTP/1.0" 200 134 0.000678
Sep 28 12:09:56 ctl02 nova-api[23704]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:09:56 ctl02 nova-api[23704]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:09:56 ctl02 nova-api[23704]: 2017-09-28 12:09:56.496 23704 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:09:56 ctl02 nova-api[23704]: 2017-09-28 12:09:56.498 23704 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:09:56 ctl02 nova-api[23704]: 2017-09-28 12:09:56.498 23704 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:09:56 ctl02 nova-api[23704]: 2017-09-28 12:09:56.498 23704 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:09:56 ctl02 nova-api[23704]: 2017-09-28 12:09:56.498 23704 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:09:56 ctl02 nova-api[23704]: 2017-09-28 12:09:56.498 23704 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:09:56 ctl02 nova-api[23704]: 2017-09-28 12:09:56.498 23704 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:09:56 ctl02 nova-api[23704]: 2017-09-28 12:09:56.498 23704 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:09:56 ctl02 nova-api[23704]: 2017-09-28 12:09:56.498 23704 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:09:56 ctl02 nova-api[23704]: 2017-09-28 12:09:56.498 23704 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:09:56 ctl02 nova-api[23704]: 2017-09-28 12:09:56.498 23704 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:09:56 ctl02 nova-api[23704]: 2017-09-28 12:09:56.498 23704 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:09:56 ctl02 nova-api[23704]: 2017-09-28 12:09:56.498 23704 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:09:56 ctl02 nova-api[23704]: 2017-09-28 12:09:56.498 23704 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:09:56 ctl02 nova-api[23704]: 2017-09-28 12:09:56.498 23704 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:09:56 ctl02 nova-api[23704]: 2017-09-28 12:09:56.498 23704 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:09:56 ctl02 nova-api[23704]: 2017-09-28 12:09:56.498 23704 ERROR nova.wsgi     self.filename))
Sep 28 12:09:56 ctl02 nova-api[23704]: 2017-09-28 12:09:56.498 23704 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:09:56 ctl02 nova-api[23704]: 2017-09-28 12:09:56.498 23704 ERROR nova.wsgi
Sep 28 12:09:56 ctl02 nova-api[23704]: 2017-09-28 12:09:56.499 23704 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:09:56 ctl02 nova-api[23704]: 2017-09-28 12:09:56.633 23704 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:09:56 ctl02 nova-api[23704]: 2017-09-28 12:09:56.884 23704 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:09:56 ctl02 nova-api[23704]: 2017-09-28 12:09:56.886 23704 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:09:56 ctl02 nova-api[23704]: 2017-09-28 12:09:56.886 23704 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:09:56 ctl02 nova-api[23704]: 2017-09-28 12:09:56.887 23704 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:09:57 ctl02 nova-api[23704]: 2017-09-28 12:09:57.019 23704 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:09:57 ctl02 nova-api[23704]: 2017-09-28 12:09:57.021 23704 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:09:57 ctl02 nova-api[23704]: 2017-09-28 12:09:57.021 23704 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:09:57 ctl02 nova-api[23704]: 2017-09-28 12:09:57.022 23704 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:09:57 ctl02 nova-api[23704]: 2017-09-28 12:09:57.025 23704 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:09:57 ctl02 nova-api[23704]: 2017-09-28 12:09:57.025 23704 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:09:57 ctl02 nova-api[23704]: 2017-09-28 12:09:57.025 23704 ERROR nova Traceback (most recent call last):
Sep 28 12:09:57 ctl02 nova-api[23704]: 2017-09-28 12:09:57.025 23704 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:09:57 ctl02 nova-api[23704]: 2017-09-28 12:09:57.025 23704 ERROR nova     sys.exit(main())
Sep 28 12:09:57 ctl02 nova-api[23704]: 2017-09-28 12:09:57.025 23704 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:09:57 ctl02 nova-api[23704]: 2017-09-28 12:09:57.025 23704 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:09:57 ctl02 nova-api[23704]: 2017-09-28 12:09:57.025 23704 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:09:57 ctl02 nova-api[23704]: 2017-09-28 12:09:57.025 23704 ERROR nova     max_url_len=max_url_len)
Sep 28 12:09:57 ctl02 nova-api[23704]: 2017-09-28 12:09:57.025 23704 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:09:57 ctl02 nova-api[23704]: 2017-09-28 12:09:57.025 23704 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:09:57 ctl02 nova-api[23704]: 2017-09-28 12:09:57.025 23704 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:09:57 ctl02 nova-api[23704]: 2017-09-28 12:09:57.025 23704 ERROR nova     sock.listen(backlog)
Sep 28 12:09:57 ctl02 nova-api[23704]: 2017-09-28 12:09:57.025 23704 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:09:57 ctl02 nova-api[23704]: 2017-09-28 12:09:57.025 23704 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:09:57 ctl02 nova-api[23704]: 2017-09-28 12:09:57.025 23704 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:09:57 ctl02 nova-api[23704]: 2017-09-28 12:09:57.025 23704 ERROR nova
Sep 28 12:09:57 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:09:57 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:09:57 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:09:57 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:09:57.284 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:09:57] "OPTIONS / HTTP/1.0" 200 134 0.000557
Sep 28 12:09:57 ctl02 heat-api[13008]: 2017-09-28 12:09:57.301 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:09:57] "OPTIONS / HTTP/1.0" 200 134 0.000681
Sep 28 12:09:57 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:09:57 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:09:57 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:09:57 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:09:58 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:09:58.305 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:09:58] "OPTIONS / HTTP/1.0" 200 134 0.000484
Sep 28 12:09:59 ctl02 nova-api[23722]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:09:59 ctl02 nova-api[23722]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:09:59 ctl02 nova-api[23722]: 2017-09-28 12:09:59.243 23722 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:09:59 ctl02 nova-api[23722]: 2017-09-28 12:09:59.246 23722 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:09:59 ctl02 nova-api[23722]: 2017-09-28 12:09:59.246 23722 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:09:59 ctl02 nova-api[23722]: 2017-09-28 12:09:59.246 23722 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:09:59 ctl02 nova-api[23722]: 2017-09-28 12:09:59.246 23722 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:09:59 ctl02 nova-api[23722]: 2017-09-28 12:09:59.246 23722 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:09:59 ctl02 nova-api[23722]: 2017-09-28 12:09:59.246 23722 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:09:59 ctl02 nova-api[23722]: 2017-09-28 12:09:59.246 23722 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:09:59 ctl02 nova-api[23722]: 2017-09-28 12:09:59.246 23722 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:09:59 ctl02 nova-api[23722]: 2017-09-28 12:09:59.246 23722 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:09:59 ctl02 nova-api[23722]: 2017-09-28 12:09:59.246 23722 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:09:59 ctl02 nova-api[23722]: 2017-09-28 12:09:59.246 23722 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:09:59 ctl02 nova-api[23722]: 2017-09-28 12:09:59.246 23722 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:09:59 ctl02 nova-api[23722]: 2017-09-28 12:09:59.246 23722 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:09:59 ctl02 nova-api[23722]: 2017-09-28 12:09:59.246 23722 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:09:59 ctl02 nova-api[23722]: 2017-09-28 12:09:59.246 23722 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:09:59 ctl02 nova-api[23722]: 2017-09-28 12:09:59.246 23722 ERROR nova.wsgi     self.filename))
Sep 28 12:09:59 ctl02 nova-api[23722]: 2017-09-28 12:09:59.246 23722 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:09:59 ctl02 nova-api[23722]: 2017-09-28 12:09:59.246 23722 ERROR nova.wsgi
Sep 28 12:09:59 ctl02 nova-api[23722]: 2017-09-28 12:09:59.248 23722 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:09:59 ctl02 nova-api[23722]: 2017-09-28 12:09:59.383 23722 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:09:59 ctl02 nova-api[23722]: 2017-09-28 12:09:59.636 23722 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:09:59 ctl02 nova-api[23722]: 2017-09-28 12:09:59.639 23722 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:09:59 ctl02 nova-api[23722]: 2017-09-28 12:09:59.639 23722 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:09:59 ctl02 nova-api[23722]: 2017-09-28 12:09:59.640 23722 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:09:59 ctl02 nova-api[23722]: 2017-09-28 12:09:59.774 23722 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:09:59 ctl02 nova-api[23722]: 2017-09-28 12:09:59.777 23722 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:09:59 ctl02 nova-api[23722]: 2017-09-28 12:09:59.777 23722 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:09:59 ctl02 nova-api[23722]: 2017-09-28 12:09:59.778 23722 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:09:59 ctl02 nova-api[23722]: 2017-09-28 12:09:59.781 23722 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:09:59 ctl02 nova-api[23722]: 2017-09-28 12:09:59.782 23722 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:09:59 ctl02 nova-api[23722]: 2017-09-28 12:09:59.782 23722 ERROR nova Traceback (most recent call last):
Sep 28 12:09:59 ctl02 nova-api[23722]: 2017-09-28 12:09:59.782 23722 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:09:59 ctl02 nova-api[23722]: 2017-09-28 12:09:59.782 23722 ERROR nova     sys.exit(main())
Sep 28 12:09:59 ctl02 nova-api[23722]: 2017-09-28 12:09:59.782 23722 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:09:59 ctl02 nova-api[23722]: 2017-09-28 12:09:59.782 23722 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:09:59 ctl02 nova-api[23722]: 2017-09-28 12:09:59.782 23722 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:09:59 ctl02 nova-api[23722]: 2017-09-28 12:09:59.782 23722 ERROR nova     max_url_len=max_url_len)
Sep 28 12:09:59 ctl02 nova-api[23722]: 2017-09-28 12:09:59.782 23722 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:09:59 ctl02 nova-api[23722]: 2017-09-28 12:09:59.782 23722 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:09:59 ctl02 nova-api[23722]: 2017-09-28 12:09:59.782 23722 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:09:59 ctl02 nova-api[23722]: 2017-09-28 12:09:59.782 23722 ERROR nova     sock.listen(backlog)
Sep 28 12:09:59 ctl02 nova-api[23722]: 2017-09-28 12:09:59.782 23722 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:09:59 ctl02 nova-api[23722]: 2017-09-28 12:09:59.782 23722 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:09:59 ctl02 nova-api[23722]: 2017-09-28 12:09:59.782 23722 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:09:59 ctl02 nova-api[23722]: 2017-09-28 12:09:59.782 23722 ERROR nova
Sep 28 12:09:59 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:09:59 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:09:59 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:10:00 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:10:00 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:10:00 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:10:00 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:10:00 ctl02 glance-api[29183]: 2017-09-28 12:10:00.830 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:10:00] "OPTIONS / HTTP/1.0" 200 134 0.000667
Sep 28 12:10:01 ctl02 heat-api-cfn[13300]: 2017-09-28 12:10:01.084 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:10:01] "OPTIONS / HTTP/1.0" 200 134 0.000414
Sep 28 12:10:01 ctl02 heat-api-cfn[13300]: 2017-09-28 12:10:01.179 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:10:01] "OPTIONS / HTTP/1.0" 200 134 0.000358
Sep 28 12:10:01 ctl02 nova-api[23741]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:10:01 ctl02 nova-api[23741]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:10:01 ctl02 nova-api[23741]: 2017-09-28 12:10:01.975 23741 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:10:01 ctl02 nova-api[23741]: 2017-09-28 12:10:01.977 23741 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:10:01 ctl02 nova-api[23741]: 2017-09-28 12:10:01.977 23741 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:10:01 ctl02 nova-api[23741]: 2017-09-28 12:10:01.977 23741 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:10:01 ctl02 nova-api[23741]: 2017-09-28 12:10:01.977 23741 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:10:01 ctl02 nova-api[23741]: 2017-09-28 12:10:01.977 23741 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:10:01 ctl02 nova-api[23741]: 2017-09-28 12:10:01.977 23741 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:10:01 ctl02 nova-api[23741]: 2017-09-28 12:10:01.977 23741 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:10:01 ctl02 nova-api[23741]: 2017-09-28 12:10:01.977 23741 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:10:01 ctl02 nova-api[23741]: 2017-09-28 12:10:01.977 23741 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:10:01 ctl02 nova-api[23741]: 2017-09-28 12:10:01.977 23741 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:10:01 ctl02 nova-api[23741]: 2017-09-28 12:10:01.977 23741 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:10:01 ctl02 nova-api[23741]: 2017-09-28 12:10:01.977 23741 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:10:01 ctl02 nova-api[23741]: 2017-09-28 12:10:01.977 23741 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:10:01 ctl02 nova-api[23741]: 2017-09-28 12:10:01.977 23741 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:10:01 ctl02 nova-api[23741]: 2017-09-28 12:10:01.977 23741 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:10:01 ctl02 nova-api[23741]: 2017-09-28 12:10:01.977 23741 ERROR nova.wsgi     self.filename))
Sep 28 12:10:01 ctl02 nova-api[23741]: 2017-09-28 12:10:01.977 23741 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:10:01 ctl02 nova-api[23741]: 2017-09-28 12:10:01.977 23741 ERROR nova.wsgi
Sep 28 12:10:01 ctl02 nova-api[23741]: 2017-09-28 12:10:01.978 23741 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:10:02 ctl02 nova-api[23741]: 2017-09-28 12:10:02.108 23741 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:10:02 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:10:02.309 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:10:02] "OPTIONS / HTTP/1.0" 200 134 0.000588
Sep 28 12:10:02 ctl02 nova-api[23741]: 2017-09-28 12:10:02.338 23741 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:10:02 ctl02 nova-api[23741]: 2017-09-28 12:10:02.341 23741 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:10:02 ctl02 nova-api[23741]: 2017-09-28 12:10:02.341 23741 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:10:02 ctl02 nova-api[23741]: 2017-09-28 12:10:02.341 23741 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:10:02 ctl02 nova-api[23741]: 2017-09-28 12:10:02.473 23741 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:10:02 ctl02 nova-api[23741]: 2017-09-28 12:10:02.475 23741 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:10:02 ctl02 nova-api[23741]: 2017-09-28 12:10:02.475 23741 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:10:02 ctl02 nova-api[23741]: 2017-09-28 12:10:02.476 23741 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:10:02 ctl02 nova-api[23741]: 2017-09-28 12:10:02.479 23741 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:10:02 ctl02 nova-api[23741]: 2017-09-28 12:10:02.479 23741 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:10:02 ctl02 nova-api[23741]: 2017-09-28 12:10:02.479 23741 ERROR nova Traceback (most recent call last):
Sep 28 12:10:02 ctl02 nova-api[23741]: 2017-09-28 12:10:02.479 23741 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:10:02 ctl02 nova-api[23741]: 2017-09-28 12:10:02.479 23741 ERROR nova     sys.exit(main())
Sep 28 12:10:02 ctl02 nova-api[23741]: 2017-09-28 12:10:02.479 23741 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:10:02 ctl02 nova-api[23741]: 2017-09-28 12:10:02.479 23741 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:10:02 ctl02 nova-api[23741]: 2017-09-28 12:10:02.479 23741 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:10:02 ctl02 nova-api[23741]: 2017-09-28 12:10:02.479 23741 ERROR nova     max_url_len=max_url_len)
Sep 28 12:10:02 ctl02 nova-api[23741]: 2017-09-28 12:10:02.479 23741 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:10:02 ctl02 nova-api[23741]: 2017-09-28 12:10:02.479 23741 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:10:02 ctl02 nova-api[23741]: 2017-09-28 12:10:02.479 23741 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:10:02 ctl02 nova-api[23741]: 2017-09-28 12:10:02.479 23741 ERROR nova     sock.listen(backlog)
Sep 28 12:10:02 ctl02 nova-api[23741]: 2017-09-28 12:10:02.479 23741 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:10:02 ctl02 nova-api[23741]: 2017-09-28 12:10:02.479 23741 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:10:02 ctl02 nova-api[23741]: 2017-09-28 12:10:02.479 23741 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:10:02 ctl02 nova-api[23741]: 2017-09-28 12:10:02.479 23741 ERROR nova
Sep 28 12:10:02 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:10:02 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:10:02 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:10:02 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:10:02 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:10:02 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:10:02 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:10:03 ctl02 heat-api-cfn[13300]: 2017-09-28 12:10:03.041 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:10:03] "OPTIONS / HTTP/1.0" 200 134 0.000456
Sep 28 12:10:03 ctl02 heat-api[13008]: 2017-09-28 12:10:03.688 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:10:03] "OPTIONS / HTTP/1.0" 200 134 0.000612
Sep 28 12:10:04 ctl02 glance-api[29183]: 2017-09-28 12:10:04.013 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:10:04] "OPTIONS / HTTP/1.0" 200 134 0.000553
Sep 28 12:10:04 ctl02 nova-api[23759]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:10:04 ctl02 nova-api[23759]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:10:04 ctl02 nova-api[23759]: 2017-09-28 12:10:04.715 23759 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:10:04 ctl02 nova-api[23759]: 2017-09-28 12:10:04.717 23759 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:10:04 ctl02 nova-api[23759]: 2017-09-28 12:10:04.717 23759 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:10:04 ctl02 nova-api[23759]: 2017-09-28 12:10:04.717 23759 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:10:04 ctl02 nova-api[23759]: 2017-09-28 12:10:04.717 23759 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:10:04 ctl02 nova-api[23759]: 2017-09-28 12:10:04.717 23759 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:10:04 ctl02 nova-api[23759]: 2017-09-28 12:10:04.717 23759 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:10:04 ctl02 nova-api[23759]: 2017-09-28 12:10:04.717 23759 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:10:04 ctl02 nova-api[23759]: 2017-09-28 12:10:04.717 23759 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:10:04 ctl02 nova-api[23759]: 2017-09-28 12:10:04.717 23759 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:10:04 ctl02 nova-api[23759]: 2017-09-28 12:10:04.717 23759 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:10:04 ctl02 nova-api[23759]: 2017-09-28 12:10:04.717 23759 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:10:04 ctl02 nova-api[23759]: 2017-09-28 12:10:04.717 23759 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:10:04 ctl02 nova-api[23759]: 2017-09-28 12:10:04.717 23759 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:10:04 ctl02 nova-api[23759]: 2017-09-28 12:10:04.717 23759 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:10:04 ctl02 nova-api[23759]: 2017-09-28 12:10:04.717 23759 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:10:04 ctl02 nova-api[23759]: 2017-09-28 12:10:04.717 23759 ERROR nova.wsgi     self.filename))
Sep 28 12:10:04 ctl02 nova-api[23759]: 2017-09-28 12:10:04.717 23759 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:10:04 ctl02 nova-api[23759]: 2017-09-28 12:10:04.717 23759 ERROR nova.wsgi
Sep 28 12:10:04 ctl02 nova-api[23759]: 2017-09-28 12:10:04.718 23759 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:10:04 ctl02 nova-api[23759]: 2017-09-28 12:10:04.849 23759 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:10:05 ctl02 nova-api[23759]: 2017-09-28 12:10:05.080 23759 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:10:05 ctl02 nova-api[23759]: 2017-09-28 12:10:05.082 23759 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:10:05 ctl02 nova-api[23759]: 2017-09-28 12:10:05.082 23759 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:10:05 ctl02 nova-api[23759]: 2017-09-28 12:10:05.083 23759 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:10:05 ctl02 glance-api[29183]: 2017-09-28 12:10:05.166 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:10:05] "OPTIONS / HTTP/1.0" 200 134 0.000560
Sep 28 12:10:05 ctl02 nova-api[23759]: 2017-09-28 12:10:05.217 23759 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:10:05 ctl02 nova-api[23759]: 2017-09-28 12:10:05.219 23759 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:10:05 ctl02 nova-api[23759]: 2017-09-28 12:10:05.219 23759 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:10:05 ctl02 nova-api[23759]: 2017-09-28 12:10:05.219 23759 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:10:05 ctl02 nova-api[23759]: 2017-09-28 12:10:05.223 23759 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:10:05 ctl02 nova-api[23759]: 2017-09-28 12:10:05.223 23759 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:10:05 ctl02 nova-api[23759]: 2017-09-28 12:10:05.223 23759 ERROR nova Traceback (most recent call last):
Sep 28 12:10:05 ctl02 nova-api[23759]: 2017-09-28 12:10:05.223 23759 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:10:05 ctl02 nova-api[23759]: 2017-09-28 12:10:05.223 23759 ERROR nova     sys.exit(main())
Sep 28 12:10:05 ctl02 nova-api[23759]: 2017-09-28 12:10:05.223 23759 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:10:05 ctl02 nova-api[23759]: 2017-09-28 12:10:05.223 23759 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:10:05 ctl02 nova-api[23759]: 2017-09-28 12:10:05.223 23759 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:10:05 ctl02 nova-api[23759]: 2017-09-28 12:10:05.223 23759 ERROR nova     max_url_len=max_url_len)
Sep 28 12:10:05 ctl02 nova-api[23759]: 2017-09-28 12:10:05.223 23759 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:10:05 ctl02 nova-api[23759]: 2017-09-28 12:10:05.223 23759 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:10:05 ctl02 nova-api[23759]: 2017-09-28 12:10:05.223 23759 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:10:05 ctl02 nova-api[23759]: 2017-09-28 12:10:05.223 23759 ERROR nova     sock.listen(backlog)
Sep 28 12:10:05 ctl02 nova-api[23759]: 2017-09-28 12:10:05.223 23759 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:10:05 ctl02 nova-api[23759]: 2017-09-28 12:10:05.223 23759 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:10:05 ctl02 nova-api[23759]: 2017-09-28 12:10:05.223 23759 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:10:05 ctl02 nova-api[23759]: 2017-09-28 12:10:05.223 23759 ERROR nova
Sep 28 12:10:05 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:10:05 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:10:05 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:10:05 ctl02 heat-api[13008]: 2017-09-28 12:10:05.499 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:10:05] "OPTIONS / HTTP/1.0" 200 134 0.000619
Sep 28 12:10:05 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:10:05 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:10:05 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:10:05 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:10:07 ctl02 nova-api[23776]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:10:07 ctl02 nova-api[23776]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:10:07 ctl02 nova-api[23776]: 2017-09-28 12:10:07.422 23776 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:10:07 ctl02 nova-api[23776]: 2017-09-28 12:10:07.424 23776 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:10:07 ctl02 nova-api[23776]: 2017-09-28 12:10:07.424 23776 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:10:07 ctl02 nova-api[23776]: 2017-09-28 12:10:07.424 23776 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:10:07 ctl02 nova-api[23776]: 2017-09-28 12:10:07.424 23776 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:10:07 ctl02 nova-api[23776]: 2017-09-28 12:10:07.424 23776 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:10:07 ctl02 nova-api[23776]: 2017-09-28 12:10:07.424 23776 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:10:07 ctl02 nova-api[23776]: 2017-09-28 12:10:07.424 23776 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:10:07 ctl02 nova-api[23776]: 2017-09-28 12:10:07.424 23776 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:10:07 ctl02 nova-api[23776]: 2017-09-28 12:10:07.424 23776 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:10:07 ctl02 nova-api[23776]: 2017-09-28 12:10:07.424 23776 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:10:07 ctl02 nova-api[23776]: 2017-09-28 12:10:07.424 23776 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:10:07 ctl02 nova-api[23776]: 2017-09-28 12:10:07.424 23776 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:10:07 ctl02 nova-api[23776]: 2017-09-28 12:10:07.424 23776 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:10:07 ctl02 nova-api[23776]: 2017-09-28 12:10:07.424 23776 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:10:07 ctl02 nova-api[23776]: 2017-09-28 12:10:07.424 23776 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:10:07 ctl02 nova-api[23776]: 2017-09-28 12:10:07.424 23776 ERROR nova.wsgi     self.filename))
Sep 28 12:10:07 ctl02 nova-api[23776]: 2017-09-28 12:10:07.424 23776 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:10:07 ctl02 nova-api[23776]: 2017-09-28 12:10:07.424 23776 ERROR nova.wsgi
Sep 28 12:10:07 ctl02 nova-api[23776]: 2017-09-28 12:10:07.427 23776 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:10:07 ctl02 nova-api[23776]: 2017-09-28 12:10:07.553 23776 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:10:07 ctl02 heat-api[13008]: 2017-09-28 12:10:07.608 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:10:07] "OPTIONS / HTTP/1.0" 200 134 0.000566
Sep 28 12:10:07 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:10:07.670 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:10:07] "OPTIONS / HTTP/1.0" 200 134 0.000504
Sep 28 12:10:07 ctl02 nova-api[23776]: 2017-09-28 12:10:07.826 23776 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:10:07 ctl02 nova-api[23776]: 2017-09-28 12:10:07.828 23776 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:10:07 ctl02 nova-api[23776]: 2017-09-28 12:10:07.828 23776 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:10:07 ctl02 nova-api[23776]: 2017-09-28 12:10:07.829 23776 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:10:07 ctl02 nova-api[23776]: 2017-09-28 12:10:07.964 23776 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:10:07 ctl02 nova-api[23776]: 2017-09-28 12:10:07.966 23776 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:10:07 ctl02 nova-api[23776]: 2017-09-28 12:10:07.966 23776 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:10:07 ctl02 nova-api[23776]: 2017-09-28 12:10:07.966 23776 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:10:07 ctl02 nova-api[23776]: 2017-09-28 12:10:07.969 23776 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:10:07 ctl02 nova-api[23776]: 2017-09-28 12:10:07.970 23776 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:10:07 ctl02 nova-api[23776]: 2017-09-28 12:10:07.970 23776 ERROR nova Traceback (most recent call last):
Sep 28 12:10:07 ctl02 nova-api[23776]: 2017-09-28 12:10:07.970 23776 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:10:07 ctl02 nova-api[23776]: 2017-09-28 12:10:07.970 23776 ERROR nova     sys.exit(main())
Sep 28 12:10:07 ctl02 nova-api[23776]: 2017-09-28 12:10:07.970 23776 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:10:07 ctl02 nova-api[23776]: 2017-09-28 12:10:07.970 23776 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:10:07 ctl02 nova-api[23776]: 2017-09-28 12:10:07.970 23776 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:10:07 ctl02 nova-api[23776]: 2017-09-28 12:10:07.970 23776 ERROR nova     max_url_len=max_url_len)
Sep 28 12:10:07 ctl02 nova-api[23776]: 2017-09-28 12:10:07.970 23776 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:10:07 ctl02 nova-api[23776]: 2017-09-28 12:10:07.970 23776 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:10:07 ctl02 nova-api[23776]: 2017-09-28 12:10:07.970 23776 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:10:07 ctl02 nova-api[23776]: 2017-09-28 12:10:07.970 23776 ERROR nova     sock.listen(backlog)
Sep 28 12:10:07 ctl02 nova-api[23776]: 2017-09-28 12:10:07.970 23776 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:10:07 ctl02 nova-api[23776]: 2017-09-28 12:10:07.970 23776 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:10:07 ctl02 nova-api[23776]: 2017-09-28 12:10:07.970 23776 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:10:07 ctl02 nova-api[23776]: 2017-09-28 12:10:07.970 23776 ERROR nova
Sep 28 12:10:08 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:10:08 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:10:08 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:10:08 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:10:08.339 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:10:08] "OPTIONS / HTTP/1.0" 200 134 0.000544
Sep 28 12:10:08 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:10:08 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:10:08 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:10:08 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:10:08 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2d7ec460)
Sep 28 12:10:09 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2d7ec460)
Sep 28 12:10:10 ctl02 nova-api[23794]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:10:10 ctl02 nova-api[23794]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:10:10 ctl02 nova-api[23794]: 2017-09-28 12:10:10.281 23794 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:10:10 ctl02 nova-api[23794]: 2017-09-28 12:10:10.283 23794 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:10:10 ctl02 nova-api[23794]: 2017-09-28 12:10:10.283 23794 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:10:10 ctl02 nova-api[23794]: 2017-09-28 12:10:10.283 23794 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:10:10 ctl02 nova-api[23794]: 2017-09-28 12:10:10.283 23794 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:10:10 ctl02 nova-api[23794]: 2017-09-28 12:10:10.283 23794 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:10:10 ctl02 nova-api[23794]: 2017-09-28 12:10:10.283 23794 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:10:10 ctl02 nova-api[23794]: 2017-09-28 12:10:10.283 23794 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:10:10 ctl02 nova-api[23794]: 2017-09-28 12:10:10.283 23794 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:10:10 ctl02 nova-api[23794]: 2017-09-28 12:10:10.283 23794 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:10:10 ctl02 nova-api[23794]: 2017-09-28 12:10:10.283 23794 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:10:10 ctl02 nova-api[23794]: 2017-09-28 12:10:10.283 23794 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:10:10 ctl02 nova-api[23794]: 2017-09-28 12:10:10.283 23794 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:10:10 ctl02 nova-api[23794]: 2017-09-28 12:10:10.283 23794 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:10:10 ctl02 nova-api[23794]: 2017-09-28 12:10:10.283 23794 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:10:10 ctl02 nova-api[23794]: 2017-09-28 12:10:10.283 23794 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:10:10 ctl02 nova-api[23794]: 2017-09-28 12:10:10.283 23794 ERROR nova.wsgi     self.filename))
Sep 28 12:10:10 ctl02 nova-api[23794]: 2017-09-28 12:10:10.283 23794 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:10:10 ctl02 nova-api[23794]: 2017-09-28 12:10:10.283 23794 ERROR nova.wsgi
Sep 28 12:10:10 ctl02 nova-api[23794]: 2017-09-28 12:10:10.284 23794 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:10:10 ctl02 nova-api[23794]: 2017-09-28 12:10:10.421 23794 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:10:10 ctl02 glance-api[29183]: 2017-09-28 12:10:10.473 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:10:10] "OPTIONS / HTTP/1.0" 200 134 0.000658
Sep 28 12:10:10 ctl02 nova-api[23794]: 2017-09-28 12:10:10.676 23794 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:10:10 ctl02 nova-api[23794]: 2017-09-28 12:10:10.678 23794 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:10:10 ctl02 nova-api[23794]: 2017-09-28 12:10:10.679 23794 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:10:10 ctl02 nova-api[23794]: 2017-09-28 12:10:10.679 23794 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:10:10 ctl02 nova-api[23794]: 2017-09-28 12:10:10.814 23794 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:10:10 ctl02 nova-api[23794]: 2017-09-28 12:10:10.816 23794 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:10:10 ctl02 nova-api[23794]: 2017-09-28 12:10:10.816 23794 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:10:10 ctl02 nova-api[23794]: 2017-09-28 12:10:10.817 23794 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:10:10 ctl02 nova-api[23794]: 2017-09-28 12:10:10.820 23794 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:10:10 ctl02 nova-api[23794]: 2017-09-28 12:10:10.820 23794 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:10:10 ctl02 nova-api[23794]: 2017-09-28 12:10:10.820 23794 ERROR nova Traceback (most recent call last):
Sep 28 12:10:10 ctl02 nova-api[23794]: 2017-09-28 12:10:10.820 23794 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:10:10 ctl02 nova-api[23794]: 2017-09-28 12:10:10.820 23794 ERROR nova     sys.exit(main())
Sep 28 12:10:10 ctl02 nova-api[23794]: 2017-09-28 12:10:10.820 23794 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:10:10 ctl02 nova-api[23794]: 2017-09-28 12:10:10.820 23794 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:10:10 ctl02 nova-api[23794]: 2017-09-28 12:10:10.820 23794 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:10:10 ctl02 nova-api[23794]: 2017-09-28 12:10:10.820 23794 ERROR nova     max_url_len=max_url_len)
Sep 28 12:10:10 ctl02 nova-api[23794]: 2017-09-28 12:10:10.820 23794 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:10:10 ctl02 nova-api[23794]: 2017-09-28 12:10:10.820 23794 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:10:10 ctl02 nova-api[23794]: 2017-09-28 12:10:10.820 23794 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:10:10 ctl02 nova-api[23794]: 2017-09-28 12:10:10.820 23794 ERROR nova     sock.listen(backlog)
Sep 28 12:10:10 ctl02 nova-api[23794]: 2017-09-28 12:10:10.820 23794 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:10:10 ctl02 nova-api[23794]: 2017-09-28 12:10:10.820 23794 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:10:10 ctl02 nova-api[23794]: 2017-09-28 12:10:10.820 23794 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:10:10 ctl02 nova-api[23794]: 2017-09-28 12:10:10.820 23794 ERROR nova
Sep 28 12:10:10 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2d7ec460)
Sep 28 12:10:10 ctl02 heat-api-cfn[13300]: 2017-09-28 12:10:10.991 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:10:10] "OPTIONS / HTTP/1.0" 200 134 0.000507
Sep 28 12:10:10 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:10:10 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:10:10 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:10:11 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:10:11 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:10:11 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:10:11 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:10:11 ctl02 heat-api-cfn[13300]: 2017-09-28 12:10:11.265 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:10:11] "OPTIONS / HTTP/1.0" 200 134 0.000561
Sep 28 12:10:11 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2d7ec460)
Sep 28 12:10:12 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:10:12.190 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:10:12] "OPTIONS / HTTP/1.0" 200 134 0.000493
Sep 28 12:10:12 ctl02 nova-cert[4860]: 2017-09-28 12:10:12.351 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:10:12 ctl02 nova-api[23813]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:10:12 ctl02 nova-api[23813]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:10:12 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2d7ec460)
Sep 28 12:10:12 ctl02 nova-api[23813]: 2017-09-28 12:10:12.971 23813 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:10:12 ctl02 nova-api[23813]: 2017-09-28 12:10:12.973 23813 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:10:12 ctl02 nova-api[23813]: 2017-09-28 12:10:12.973 23813 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:10:12 ctl02 nova-api[23813]: 2017-09-28 12:10:12.973 23813 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:10:12 ctl02 nova-api[23813]: 2017-09-28 12:10:12.973 23813 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:10:12 ctl02 nova-api[23813]: 2017-09-28 12:10:12.973 23813 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:10:12 ctl02 nova-api[23813]: 2017-09-28 12:10:12.973 23813 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:10:12 ctl02 nova-api[23813]: 2017-09-28 12:10:12.973 23813 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:10:12 ctl02 nova-api[23813]: 2017-09-28 12:10:12.973 23813 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:10:12 ctl02 nova-api[23813]: 2017-09-28 12:10:12.973 23813 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:10:12 ctl02 nova-api[23813]: 2017-09-28 12:10:12.973 23813 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:10:12 ctl02 nova-api[23813]: 2017-09-28 12:10:12.973 23813 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:10:12 ctl02 nova-api[23813]: 2017-09-28 12:10:12.973 23813 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:10:12 ctl02 nova-api[23813]: 2017-09-28 12:10:12.973 23813 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:10:12 ctl02 nova-api[23813]: 2017-09-28 12:10:12.973 23813 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:10:12 ctl02 nova-api[23813]: 2017-09-28 12:10:12.973 23813 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:10:12 ctl02 nova-api[23813]: 2017-09-28 12:10:12.973 23813 ERROR nova.wsgi     self.filename))
Sep 28 12:10:12 ctl02 nova-api[23813]: 2017-09-28 12:10:12.973 23813 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:10:12 ctl02 nova-api[23813]: 2017-09-28 12:10:12.973 23813 ERROR nova.wsgi
Sep 28 12:10:12 ctl02 nova-api[23813]: 2017-09-28 12:10:12.974 23813 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:10:13 ctl02 nova-api[23813]: 2017-09-28 12:10:13.106 23813 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:10:13 ctl02 heat-api-cfn[13300]: 2017-09-28 12:10:13.230 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:10:13] "OPTIONS / HTTP/1.0" 200 134 0.000585
Sep 28 12:10:13 ctl02 nova-api[23813]: 2017-09-28 12:10:13.356 23813 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:10:13 ctl02 nova-api[23813]: 2017-09-28 12:10:13.358 23813 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:10:13 ctl02 nova-api[23813]: 2017-09-28 12:10:13.358 23813 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:10:13 ctl02 nova-api[23813]: 2017-09-28 12:10:13.359 23813 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:10:13 ctl02 nova-api[23813]: 2017-09-28 12:10:13.492 23813 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:10:13 ctl02 nova-api[23813]: 2017-09-28 12:10:13.494 23813 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:10:13 ctl02 nova-api[23813]: 2017-09-28 12:10:13.494 23813 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:10:13 ctl02 nova-api[23813]: 2017-09-28 12:10:13.495 23813 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:10:13 ctl02 nova-api[23813]: 2017-09-28 12:10:13.498 23813 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:10:13 ctl02 nova-api[23813]: 2017-09-28 12:10:13.498 23813 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:10:13 ctl02 nova-api[23813]: 2017-09-28 12:10:13.498 23813 ERROR nova Traceback (most recent call last):
Sep 28 12:10:13 ctl02 nova-api[23813]: 2017-09-28 12:10:13.498 23813 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:10:13 ctl02 nova-api[23813]: 2017-09-28 12:10:13.498 23813 ERROR nova     sys.exit(main())
Sep 28 12:10:13 ctl02 nova-api[23813]: 2017-09-28 12:10:13.498 23813 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:10:13 ctl02 nova-api[23813]: 2017-09-28 12:10:13.498 23813 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:10:13 ctl02 nova-api[23813]: 2017-09-28 12:10:13.498 23813 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:10:13 ctl02 nova-api[23813]: 2017-09-28 12:10:13.498 23813 ERROR nova     max_url_len=max_url_len)
Sep 28 12:10:13 ctl02 nova-api[23813]: 2017-09-28 12:10:13.498 23813 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:10:13 ctl02 nova-api[23813]: 2017-09-28 12:10:13.498 23813 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:10:13 ctl02 nova-api[23813]: 2017-09-28 12:10:13.498 23813 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:10:13 ctl02 nova-api[23813]: 2017-09-28 12:10:13.498 23813 ERROR nova     sock.listen(backlog)
Sep 28 12:10:13 ctl02 nova-api[23813]: 2017-09-28 12:10:13.498 23813 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:10:13 ctl02 nova-api[23813]: 2017-09-28 12:10:13.498 23813 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:10:13 ctl02 nova-api[23813]: 2017-09-28 12:10:13.498 23813 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:10:13 ctl02 nova-api[23813]: 2017-09-28 12:10:13.498 23813 ERROR nova
Sep 28 12:10:13 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:10:13 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:10:13 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:10:13 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:10:13 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:10:13 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:10:13 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:10:13 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2d7ec460)
Sep 28 12:10:13 ctl02 glance-api[29183]: 2017-09-28 12:10:13.959 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:10:13] "OPTIONS / HTTP/1.0" 200 134 0.000684
Sep 28 12:10:14 ctl02 heat-api[13008]: 2017-09-28 12:10:14.027 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:10:14] "OPTIONS / HTTP/1.0" 200 134 0.000932
Sep 28 12:10:14 ctl02 nova-conductor[5056]: 2017-09-28 12:10:14.408 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:10:14 ctl02 nova-conductor[5056]: 2017-09-28 12:10:14.420 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:10:14 ctl02 nova-conductor[5056]: 2017-09-28 12:10:14.423 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:10:14 ctl02 nova-conductor[5056]: 2017-09-28 12:10:14.429 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:10:14 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2d7ec460)
Sep 28 12:10:15 ctl02 heat-api[13008]: 2017-09-28 12:10:15.208 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:10:15] "OPTIONS / HTTP/1.0" 200 134 0.000621
Sep 28 12:10:15 ctl02 glance-api[29183]: 2017-09-28 12:10:15.496 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:10:15] "OPTIONS / HTTP/1.0" 200 134 0.000631
Sep 28 12:10:15 ctl02 nova-api[23831]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:10:15 ctl02 nova-api[23831]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:10:15 ctl02 nova-api[23831]: 2017-09-28 12:10:15.757 23831 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:10:15 ctl02 nova-api[23831]: 2017-09-28 12:10:15.759 23831 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:10:15 ctl02 nova-api[23831]: 2017-09-28 12:10:15.759 23831 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:10:15 ctl02 nova-api[23831]: 2017-09-28 12:10:15.759 23831 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:10:15 ctl02 nova-api[23831]: 2017-09-28 12:10:15.759 23831 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:10:15 ctl02 nova-api[23831]: 2017-09-28 12:10:15.759 23831 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:10:15 ctl02 nova-api[23831]: 2017-09-28 12:10:15.759 23831 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:10:15 ctl02 nova-api[23831]: 2017-09-28 12:10:15.759 23831 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:10:15 ctl02 nova-api[23831]: 2017-09-28 12:10:15.759 23831 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:10:15 ctl02 nova-api[23831]: 2017-09-28 12:10:15.759 23831 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:10:15 ctl02 nova-api[23831]: 2017-09-28 12:10:15.759 23831 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:10:15 ctl02 nova-api[23831]: 2017-09-28 12:10:15.759 23831 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:10:15 ctl02 nova-api[23831]: 2017-09-28 12:10:15.759 23831 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:10:15 ctl02 nova-api[23831]: 2017-09-28 12:10:15.759 23831 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:10:15 ctl02 nova-api[23831]: 2017-09-28 12:10:15.759 23831 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:10:15 ctl02 nova-api[23831]: 2017-09-28 12:10:15.759 23831 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:10:15 ctl02 nova-api[23831]: 2017-09-28 12:10:15.759 23831 ERROR nova.wsgi     self.filename))
Sep 28 12:10:15 ctl02 nova-api[23831]: 2017-09-28 12:10:15.759 23831 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:10:15 ctl02 nova-api[23831]: 2017-09-28 12:10:15.759 23831 ERROR nova.wsgi
Sep 28 12:10:15 ctl02 nova-api[23831]: 2017-09-28 12:10:15.762 23831 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:10:15 ctl02 nova-api[23831]: 2017-09-28 12:10:15.896 23831 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:10:15 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2d7ec460)
Sep 28 12:10:16 ctl02 nova-api[23831]: 2017-09-28 12:10:16.150 23831 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:10:16 ctl02 nova-api[23831]: 2017-09-28 12:10:16.153 23831 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:10:16 ctl02 nova-api[23831]: 2017-09-28 12:10:16.153 23831 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:10:16 ctl02 nova-api[23831]: 2017-09-28 12:10:16.154 23831 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:10:16 ctl02 nova-api[23831]: 2017-09-28 12:10:16.288 23831 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:10:16 ctl02 nova-api[23831]: 2017-09-28 12:10:16.290 23831 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:10:16 ctl02 nova-api[23831]: 2017-09-28 12:10:16.291 23831 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:10:16 ctl02 nova-api[23831]: 2017-09-28 12:10:16.291 23831 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:10:16 ctl02 nova-api[23831]: 2017-09-28 12:10:16.295 23831 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:10:16 ctl02 nova-api[23831]: 2017-09-28 12:10:16.295 23831 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:10:16 ctl02 nova-api[23831]: 2017-09-28 12:10:16.295 23831 ERROR nova Traceback (most recent call last):
Sep 28 12:10:16 ctl02 nova-api[23831]: 2017-09-28 12:10:16.295 23831 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:10:16 ctl02 nova-api[23831]: 2017-09-28 12:10:16.295 23831 ERROR nova     sys.exit(main())
Sep 28 12:10:16 ctl02 nova-api[23831]: 2017-09-28 12:10:16.295 23831 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:10:16 ctl02 nova-api[23831]: 2017-09-28 12:10:16.295 23831 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:10:16 ctl02 nova-api[23831]: 2017-09-28 12:10:16.295 23831 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:10:16 ctl02 nova-api[23831]: 2017-09-28 12:10:16.295 23831 ERROR nova     max_url_len=max_url_len)
Sep 28 12:10:16 ctl02 nova-api[23831]: 2017-09-28 12:10:16.295 23831 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:10:16 ctl02 nova-api[23831]: 2017-09-28 12:10:16.295 23831 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:10:16 ctl02 nova-api[23831]: 2017-09-28 12:10:16.295 23831 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:10:16 ctl02 nova-api[23831]: 2017-09-28 12:10:16.295 23831 ERROR nova     sock.listen(backlog)
Sep 28 12:10:16 ctl02 nova-api[23831]: 2017-09-28 12:10:16.295 23831 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:10:16 ctl02 nova-api[23831]: 2017-09-28 12:10:16.295 23831 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:10:16 ctl02 nova-api[23831]: 2017-09-28 12:10:16.295 23831 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:10:16 ctl02 nova-api[23831]: 2017-09-28 12:10:16.295 23831 ERROR nova
Sep 28 12:10:16 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:10:16 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:10:16 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:10:16 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:10:16 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:10:16 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:10:16 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:10:16 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2d7ec460)
Sep 28 12:10:17 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:10:17.389 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:10:17] "OPTIONS / HTTP/1.0" 200 134 0.000493
Sep 28 12:10:17 ctl02 heat-api[13008]: 2017-09-28 12:10:17.906 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:10:17] "OPTIONS / HTTP/1.0" 200 134 0.000612
Sep 28 12:10:17 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2d7ec460)
Sep 28 12:10:18 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:10:18.016 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:10:18] "OPTIONS / HTTP/1.0" 200 134 0.000518
Sep 28 12:10:18 ctl02 nova-api[23849]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:10:18 ctl02 nova-api[23849]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:10:18 ctl02 nova-api[23849]: 2017-09-28 12:10:18.501 23849 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:10:18 ctl02 nova-api[23849]: 2017-09-28 12:10:18.503 23849 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:10:18 ctl02 nova-api[23849]: 2017-09-28 12:10:18.503 23849 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:10:18 ctl02 nova-api[23849]: 2017-09-28 12:10:18.503 23849 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:10:18 ctl02 nova-api[23849]: 2017-09-28 12:10:18.503 23849 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:10:18 ctl02 nova-api[23849]: 2017-09-28 12:10:18.503 23849 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:10:18 ctl02 nova-api[23849]: 2017-09-28 12:10:18.503 23849 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:10:18 ctl02 nova-api[23849]: 2017-09-28 12:10:18.503 23849 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:10:18 ctl02 nova-api[23849]: 2017-09-28 12:10:18.503 23849 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:10:18 ctl02 nova-api[23849]: 2017-09-28 12:10:18.503 23849 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:10:18 ctl02 nova-api[23849]: 2017-09-28 12:10:18.503 23849 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:10:18 ctl02 nova-api[23849]: 2017-09-28 12:10:18.503 23849 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:10:18 ctl02 nova-api[23849]: 2017-09-28 12:10:18.503 23849 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:10:18 ctl02 nova-api[23849]: 2017-09-28 12:10:18.503 23849 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:10:18 ctl02 nova-api[23849]: 2017-09-28 12:10:18.503 23849 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:10:18 ctl02 nova-api[23849]: 2017-09-28 12:10:18.503 23849 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:10:18 ctl02 nova-api[23849]: 2017-09-28 12:10:18.503 23849 ERROR nova.wsgi     self.filename))
Sep 28 12:10:18 ctl02 nova-api[23849]: 2017-09-28 12:10:18.503 23849 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:10:18 ctl02 nova-api[23849]: 2017-09-28 12:10:18.503 23849 ERROR nova.wsgi
Sep 28 12:10:18 ctl02 nova-api[23849]: 2017-09-28 12:10:18.504 23849 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:10:18 ctl02 nova-api[23849]: 2017-09-28 12:10:18.640 23849 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:10:18 ctl02 nova-api[23849]: 2017-09-28 12:10:18.894 23849 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:10:18 ctl02 nova-api[23849]: 2017-09-28 12:10:18.897 23849 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:10:18 ctl02 nova-api[23849]: 2017-09-28 12:10:18.897 23849 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:10:18 ctl02 nova-api[23849]: 2017-09-28 12:10:18.898 23849 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:10:18 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2d7ec460)
Sep 28 12:10:19 ctl02 nova-api[23849]: 2017-09-28 12:10:19.032 23849 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:10:19 ctl02 nova-api[23849]: 2017-09-28 12:10:19.035 23849 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:10:19 ctl02 nova-api[23849]: 2017-09-28 12:10:19.035 23849 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:10:19 ctl02 nova-api[23849]: 2017-09-28 12:10:19.036 23849 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:10:19 ctl02 nova-api[23849]: 2017-09-28 12:10:19.039 23849 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:10:19 ctl02 nova-api[23849]: 2017-09-28 12:10:19.040 23849 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:10:19 ctl02 nova-api[23849]: 2017-09-28 12:10:19.040 23849 ERROR nova Traceback (most recent call last):
Sep 28 12:10:19 ctl02 nova-api[23849]: 2017-09-28 12:10:19.040 23849 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:10:19 ctl02 nova-api[23849]: 2017-09-28 12:10:19.040 23849 ERROR nova     sys.exit(main())
Sep 28 12:10:19 ctl02 nova-api[23849]: 2017-09-28 12:10:19.040 23849 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:10:19 ctl02 nova-api[23849]: 2017-09-28 12:10:19.040 23849 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:10:19 ctl02 nova-api[23849]: 2017-09-28 12:10:19.040 23849 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:10:19 ctl02 nova-api[23849]: 2017-09-28 12:10:19.040 23849 ERROR nova     max_url_len=max_url_len)
Sep 28 12:10:19 ctl02 nova-api[23849]: 2017-09-28 12:10:19.040 23849 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:10:19 ctl02 nova-api[23849]: 2017-09-28 12:10:19.040 23849 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:10:19 ctl02 nova-api[23849]: 2017-09-28 12:10:19.040 23849 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:10:19 ctl02 nova-api[23849]: 2017-09-28 12:10:19.040 23849 ERROR nova     sock.listen(backlog)
Sep 28 12:10:19 ctl02 nova-api[23849]: 2017-09-28 12:10:19.040 23849 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:10:19 ctl02 nova-api[23849]: 2017-09-28 12:10:19.040 23849 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:10:19 ctl02 nova-api[23849]: 2017-09-28 12:10:19.040 23849 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:10:19 ctl02 nova-api[23849]: 2017-09-28 12:10:19.040 23849 ERROR nova
Sep 28 12:10:19 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:10:19 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:10:19 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:10:19 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:10:19 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:10:19 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:10:19 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:10:19 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:10:19 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:10:20 ctl02 glance-api[29183]: 2017-09-28 12:10:20.395 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:10:20] "OPTIONS / HTTP/1.0" 200 134 0.000601
Sep 28 12:10:20 ctl02 heat-api-cfn[13300]: 2017-09-28 12:10:20.816 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:10:20] "OPTIONS / HTTP/1.0" 200 134 0.000663
Sep 28 12:10:21 ctl02 nova-api[23868]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:10:21 ctl02 nova-api[23868]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:10:21 ctl02 nova-api[23868]: 2017-09-28 12:10:21.252 23868 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:10:21 ctl02 nova-api[23868]: 2017-09-28 12:10:21.255 23868 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:10:21 ctl02 nova-api[23868]: 2017-09-28 12:10:21.255 23868 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:10:21 ctl02 nova-api[23868]: 2017-09-28 12:10:21.255 23868 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:10:21 ctl02 nova-api[23868]: 2017-09-28 12:10:21.255 23868 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:10:21 ctl02 nova-api[23868]: 2017-09-28 12:10:21.255 23868 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:10:21 ctl02 nova-api[23868]: 2017-09-28 12:10:21.255 23868 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:10:21 ctl02 nova-api[23868]: 2017-09-28 12:10:21.255 23868 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:10:21 ctl02 nova-api[23868]: 2017-09-28 12:10:21.255 23868 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:10:21 ctl02 nova-api[23868]: 2017-09-28 12:10:21.255 23868 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:10:21 ctl02 nova-api[23868]: 2017-09-28 12:10:21.255 23868 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:10:21 ctl02 nova-api[23868]: 2017-09-28 12:10:21.255 23868 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:10:21 ctl02 nova-api[23868]: 2017-09-28 12:10:21.255 23868 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:10:21 ctl02 nova-api[23868]: 2017-09-28 12:10:21.255 23868 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:10:21 ctl02 nova-api[23868]: 2017-09-28 12:10:21.255 23868 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:10:21 ctl02 nova-api[23868]: 2017-09-28 12:10:21.255 23868 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:10:21 ctl02 nova-api[23868]: 2017-09-28 12:10:21.255 23868 ERROR nova.wsgi     self.filename))
Sep 28 12:10:21 ctl02 nova-api[23868]: 2017-09-28 12:10:21.255 23868 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:10:21 ctl02 nova-api[23868]: 2017-09-28 12:10:21.255 23868 ERROR nova.wsgi
Sep 28 12:10:21 ctl02 nova-api[23868]: 2017-09-28 12:10:21.256 23868 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:10:21 ctl02 nova-api[23868]: 2017-09-28 12:10:21.393 23868 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:10:21 ctl02 heat-api-cfn[13300]: 2017-09-28 12:10:21.465 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:10:21] "OPTIONS / HTTP/1.0" 200 134 0.000787
Sep 28 12:10:21 ctl02 nova-api[23868]: 2017-09-28 12:10:21.651 23868 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:10:21 ctl02 nova-api[23868]: 2017-09-28 12:10:21.654 23868 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:10:21 ctl02 nova-api[23868]: 2017-09-28 12:10:21.654 23868 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:10:21 ctl02 nova-api[23868]: 2017-09-28 12:10:21.655 23868 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:10:21 ctl02 nova-api[23868]: 2017-09-28 12:10:21.788 23868 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:10:21 ctl02 nova-api[23868]: 2017-09-28 12:10:21.791 23868 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:10:21 ctl02 nova-api[23868]: 2017-09-28 12:10:21.791 23868 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:10:21 ctl02 nova-api[23868]: 2017-09-28 12:10:21.792 23868 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:10:21 ctl02 nova-api[23868]: 2017-09-28 12:10:21.795 23868 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:10:21 ctl02 nova-api[23868]: 2017-09-28 12:10:21.796 23868 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:10:21 ctl02 nova-api[23868]: 2017-09-28 12:10:21.796 23868 ERROR nova Traceback (most recent call last):
Sep 28 12:10:21 ctl02 nova-api[23868]: 2017-09-28 12:10:21.796 23868 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:10:21 ctl02 nova-api[23868]: 2017-09-28 12:10:21.796 23868 ERROR nova     sys.exit(main())
Sep 28 12:10:21 ctl02 nova-api[23868]: 2017-09-28 12:10:21.796 23868 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:10:21 ctl02 nova-api[23868]: 2017-09-28 12:10:21.796 23868 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:10:21 ctl02 nova-api[23868]: 2017-09-28 12:10:21.796 23868 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:10:21 ctl02 nova-api[23868]: 2017-09-28 12:10:21.796 23868 ERROR nova     max_url_len=max_url_len)
Sep 28 12:10:21 ctl02 nova-api[23868]: 2017-09-28 12:10:21.796 23868 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:10:21 ctl02 nova-api[23868]: 2017-09-28 12:10:21.796 23868 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:10:21 ctl02 nova-api[23868]: 2017-09-28 12:10:21.796 23868 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:10:21 ctl02 nova-api[23868]: 2017-09-28 12:10:21.796 23868 ERROR nova     sock.listen(backlog)
Sep 28 12:10:21 ctl02 nova-api[23868]: 2017-09-28 12:10:21.796 23868 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:10:21 ctl02 nova-api[23868]: 2017-09-28 12:10:21.796 23868 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:10:21 ctl02 nova-api[23868]: 2017-09-28 12:10:21.796 23868 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:10:21 ctl02 nova-api[23868]: 2017-09-28 12:10:21.796 23868 ERROR nova
Sep 28 12:10:21 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:10:21 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:10:21 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:10:22 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:10:22 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:10:22 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:10:22 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:10:22 ctl02 nova-consoleauth[5433]: 2017-09-28 12:10:22.254 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:10:22 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:10:22.482 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:10:22] "OPTIONS / HTTP/1.0" 200 134 0.000447
Sep 28 12:10:23 ctl02 heat-api-cfn[13300]: 2017-09-28 12:10:23.174 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:10:23] "OPTIONS / HTTP/1.0" 200 134 0.000594
Sep 28 12:10:23 ctl02 nova-api[23891]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:10:23 ctl02 nova-api[23891]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:10:23 ctl02 nova-api[23891]: 2017-09-28 12:10:23.957 23891 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:10:23 ctl02 nova-api[23891]: 2017-09-28 12:10:23.959 23891 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:10:23 ctl02 nova-api[23891]: 2017-09-28 12:10:23.959 23891 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:10:23 ctl02 nova-api[23891]: 2017-09-28 12:10:23.959 23891 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:10:23 ctl02 nova-api[23891]: 2017-09-28 12:10:23.959 23891 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:10:23 ctl02 nova-api[23891]: 2017-09-28 12:10:23.959 23891 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:10:23 ctl02 nova-api[23891]: 2017-09-28 12:10:23.959 23891 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:10:23 ctl02 nova-api[23891]: 2017-09-28 12:10:23.959 23891 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:10:23 ctl02 nova-api[23891]: 2017-09-28 12:10:23.959 23891 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:10:23 ctl02 nova-api[23891]: 2017-09-28 12:10:23.959 23891 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:10:23 ctl02 nova-api[23891]: 2017-09-28 12:10:23.959 23891 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:10:23 ctl02 nova-api[23891]: 2017-09-28 12:10:23.959 23891 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:10:23 ctl02 nova-api[23891]: 2017-09-28 12:10:23.959 23891 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:10:23 ctl02 nova-api[23891]: 2017-09-28 12:10:23.959 23891 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:10:23 ctl02 nova-api[23891]: 2017-09-28 12:10:23.959 23891 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:10:23 ctl02 nova-api[23891]: 2017-09-28 12:10:23.959 23891 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:10:23 ctl02 nova-api[23891]: 2017-09-28 12:10:23.959 23891 ERROR nova.wsgi     self.filename))
Sep 28 12:10:23 ctl02 nova-api[23891]: 2017-09-28 12:10:23.959 23891 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:10:23 ctl02 nova-api[23891]: 2017-09-28 12:10:23.959 23891 ERROR nova.wsgi
Sep 28 12:10:23 ctl02 nova-api[23891]: 2017-09-28 12:10:23.960 23891 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:10:24 ctl02 nova-api[23891]: 2017-09-28 12:10:24.089 23891 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:10:24 ctl02 glance-api[29183]: 2017-09-28 12:10:24.116 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:10:24] "OPTIONS / HTTP/1.0" 200 134 0.000623
Sep 28 12:10:24 ctl02 nova-api[23891]: 2017-09-28 12:10:24.354 23891 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:10:24 ctl02 nova-api[23891]: 2017-09-28 12:10:24.357 23891 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:10:24 ctl02 nova-api[23891]: 2017-09-28 12:10:24.358 23891 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:10:24 ctl02 nova-api[23891]: 2017-09-28 12:10:24.358 23891 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:10:24 ctl02 heat-api[13008]: 2017-09-28 12:10:24.386 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:10:24] "OPTIONS / HTTP/1.0" 200 134 0.000608
Sep 28 12:10:24 ctl02 nova-api[23891]: 2017-09-28 12:10:24.494 23891 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:10:24 ctl02 nova-api[23891]: 2017-09-28 12:10:24.497 23891 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:10:24 ctl02 nova-api[23891]: 2017-09-28 12:10:24.497 23891 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:10:24 ctl02 nova-api[23891]: 2017-09-28 12:10:24.498 23891 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:10:24 ctl02 nova-api[23891]: 2017-09-28 12:10:24.501 23891 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:10:24 ctl02 nova-api[23891]: 2017-09-28 12:10:24.502 23891 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:10:24 ctl02 nova-api[23891]: 2017-09-28 12:10:24.502 23891 ERROR nova Traceback (most recent call last):
Sep 28 12:10:24 ctl02 nova-api[23891]: 2017-09-28 12:10:24.502 23891 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:10:24 ctl02 nova-api[23891]: 2017-09-28 12:10:24.502 23891 ERROR nova     sys.exit(main())
Sep 28 12:10:24 ctl02 nova-api[23891]: 2017-09-28 12:10:24.502 23891 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:10:24 ctl02 nova-api[23891]: 2017-09-28 12:10:24.502 23891 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:10:24 ctl02 nova-api[23891]: 2017-09-28 12:10:24.502 23891 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:10:24 ctl02 nova-api[23891]: 2017-09-28 12:10:24.502 23891 ERROR nova     max_url_len=max_url_len)
Sep 28 12:10:24 ctl02 nova-api[23891]: 2017-09-28 12:10:24.502 23891 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:10:24 ctl02 nova-api[23891]: 2017-09-28 12:10:24.502 23891 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:10:24 ctl02 nova-api[23891]: 2017-09-28 12:10:24.502 23891 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:10:24 ctl02 nova-api[23891]: 2017-09-28 12:10:24.502 23891 ERROR nova     sock.listen(backlog)
Sep 28 12:10:24 ctl02 nova-api[23891]: 2017-09-28 12:10:24.502 23891 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:10:24 ctl02 nova-api[23891]: 2017-09-28 12:10:24.502 23891 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:10:24 ctl02 nova-api[23891]: 2017-09-28 12:10:24.502 23891 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:10:24 ctl02 nova-api[23891]: 2017-09-28 12:10:24.502 23891 ERROR nova
Sep 28 12:10:24 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:10:24 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:10:24 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:10:24 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:10:24 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:10:24 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:10:24 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:10:25 ctl02 heat-api[13008]: 2017-09-28 12:10:25.256 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:10:25] "OPTIONS / HTTP/1.0" 200 134 0.000665
Sep 28 12:10:25 ctl02 nova-scheduler[5620]: 2017-09-28 12:10:25.271 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:10:25 ctl02 heat-engine[12803]: 2017-09-28 12:10:25.471 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:10:25 ctl02 heat-engine[12803]: 2017-09-28 12:10:25.500 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:10:25 ctl02 heat-engine[12803]: 2017-09-28 12:10:25.515 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:10:25 ctl02 heat-engine[12803]: 2017-09-28 12:10:25.524 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:10:25 ctl02 glance-api[29183]: 2017-09-28 12:10:25.813 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:10:25] "OPTIONS / HTTP/1.0" 200 134 0.000636
Sep 28 12:10:26 ctl02 nova-api[23909]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:10:26 ctl02 nova-api[23909]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:10:26 ctl02 nova-api[23909]: 2017-09-28 12:10:26.735 23909 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:10:26 ctl02 nova-api[23909]: 2017-09-28 12:10:26.737 23909 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:10:26 ctl02 nova-api[23909]: 2017-09-28 12:10:26.737 23909 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:10:26 ctl02 nova-api[23909]: 2017-09-28 12:10:26.737 23909 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:10:26 ctl02 nova-api[23909]: 2017-09-28 12:10:26.737 23909 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:10:26 ctl02 nova-api[23909]: 2017-09-28 12:10:26.737 23909 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:10:26 ctl02 nova-api[23909]: 2017-09-28 12:10:26.737 23909 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:10:26 ctl02 nova-api[23909]: 2017-09-28 12:10:26.737 23909 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:10:26 ctl02 nova-api[23909]: 2017-09-28 12:10:26.737 23909 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:10:26 ctl02 nova-api[23909]: 2017-09-28 12:10:26.737 23909 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:10:26 ctl02 nova-api[23909]: 2017-09-28 12:10:26.737 23909 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:10:26 ctl02 nova-api[23909]: 2017-09-28 12:10:26.737 23909 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:10:26 ctl02 nova-api[23909]: 2017-09-28 12:10:26.737 23909 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:10:26 ctl02 nova-api[23909]: 2017-09-28 12:10:26.737 23909 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:10:26 ctl02 nova-api[23909]: 2017-09-28 12:10:26.737 23909 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:10:26 ctl02 nova-api[23909]: 2017-09-28 12:10:26.737 23909 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:10:26 ctl02 nova-api[23909]: 2017-09-28 12:10:26.737 23909 ERROR nova.wsgi     self.filename))
Sep 28 12:10:26 ctl02 nova-api[23909]: 2017-09-28 12:10:26.737 23909 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:10:26 ctl02 nova-api[23909]: 2017-09-28 12:10:26.737 23909 ERROR nova.wsgi
Sep 28 12:10:26 ctl02 nova-api[23909]: 2017-09-28 12:10:26.739 23909 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:10:26 ctl02 nova-api[23909]: 2017-09-28 12:10:26.873 23909 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:10:27 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x99a43609)
Sep 28 12:10:27 ctl02 nova-api[23909]: 2017-09-28 12:10:27.127 23909 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:10:27 ctl02 nova-api[23909]: 2017-09-28 12:10:27.130 23909 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:10:27 ctl02 nova-api[23909]: 2017-09-28 12:10:27.130 23909 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:10:27 ctl02 nova-api[23909]: 2017-09-28 12:10:27.130 23909 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:10:27 ctl02 nova-api[23909]: 2017-09-28 12:10:27.262 23909 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:10:27 ctl02 nova-api[23909]: 2017-09-28 12:10:27.264 23909 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:10:27 ctl02 nova-api[23909]: 2017-09-28 12:10:27.264 23909 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:10:27 ctl02 nova-api[23909]: 2017-09-28 12:10:27.265 23909 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:10:27 ctl02 nova-api[23909]: 2017-09-28 12:10:27.268 23909 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:10:27 ctl02 nova-api[23909]: 2017-09-28 12:10:27.268 23909 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:10:27 ctl02 nova-api[23909]: 2017-09-28 12:10:27.268 23909 ERROR nova Traceback (most recent call last):
Sep 28 12:10:27 ctl02 nova-api[23909]: 2017-09-28 12:10:27.268 23909 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:10:27 ctl02 nova-api[23909]: 2017-09-28 12:10:27.268 23909 ERROR nova     sys.exit(main())
Sep 28 12:10:27 ctl02 nova-api[23909]: 2017-09-28 12:10:27.268 23909 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:10:27 ctl02 nova-api[23909]: 2017-09-28 12:10:27.268 23909 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:10:27 ctl02 nova-api[23909]: 2017-09-28 12:10:27.268 23909 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:10:27 ctl02 nova-api[23909]: 2017-09-28 12:10:27.268 23909 ERROR nova     max_url_len=max_url_len)
Sep 28 12:10:27 ctl02 nova-api[23909]: 2017-09-28 12:10:27.268 23909 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:10:27 ctl02 nova-api[23909]: 2017-09-28 12:10:27.268 23909 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:10:27 ctl02 nova-api[23909]: 2017-09-28 12:10:27.268 23909 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:10:27 ctl02 nova-api[23909]: 2017-09-28 12:10:27.268 23909 ERROR nova     sock.listen(backlog)
Sep 28 12:10:27 ctl02 nova-api[23909]: 2017-09-28 12:10:27.268 23909 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:10:27 ctl02 nova-api[23909]: 2017-09-28 12:10:27.268 23909 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:10:27 ctl02 nova-api[23909]: 2017-09-28 12:10:27.268 23909 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:10:27 ctl02 nova-api[23909]: 2017-09-28 12:10:27.268 23909 ERROR nova
Sep 28 12:10:27 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:10:27 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:10:27 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:10:27 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:10:27 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:10:27 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:10:27 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:10:27 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:10:27.761 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:10:27] "OPTIONS / HTTP/1.0" 200 134 0.000532
Sep 28 12:10:28 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x99a43609)
Sep 28 12:10:28 ctl02 heat-api[13008]: 2017-09-28 12:10:28.167 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:10:28] "OPTIONS / HTTP/1.0" 200 134 0.000657
Sep 28 12:10:28 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:10:28.324 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:10:28] "OPTIONS / HTTP/1.0" 200 134 0.000494
Sep 28 12:10:29 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x99a43609)
Sep 28 12:10:29 ctl02 nova-api[23928]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:10:29 ctl02 nova-api[23928]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:10:29 ctl02 nova-api[23928]: 2017-09-28 12:10:29.495 23928 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:10:29 ctl02 nova-api[23928]: 2017-09-28 12:10:29.497 23928 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:10:29 ctl02 nova-api[23928]: 2017-09-28 12:10:29.497 23928 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:10:29 ctl02 nova-api[23928]: 2017-09-28 12:10:29.497 23928 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:10:29 ctl02 nova-api[23928]: 2017-09-28 12:10:29.497 23928 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:10:29 ctl02 nova-api[23928]: 2017-09-28 12:10:29.497 23928 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:10:29 ctl02 nova-api[23928]: 2017-09-28 12:10:29.497 23928 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:10:29 ctl02 nova-api[23928]: 2017-09-28 12:10:29.497 23928 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:10:29 ctl02 nova-api[23928]: 2017-09-28 12:10:29.497 23928 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:10:29 ctl02 nova-api[23928]: 2017-09-28 12:10:29.497 23928 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:10:29 ctl02 nova-api[23928]: 2017-09-28 12:10:29.497 23928 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:10:29 ctl02 nova-api[23928]: 2017-09-28 12:10:29.497 23928 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:10:29 ctl02 nova-api[23928]: 2017-09-28 12:10:29.497 23928 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:10:29 ctl02 nova-api[23928]: 2017-09-28 12:10:29.497 23928 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:10:29 ctl02 nova-api[23928]: 2017-09-28 12:10:29.497 23928 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:10:29 ctl02 nova-api[23928]: 2017-09-28 12:10:29.497 23928 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:10:29 ctl02 nova-api[23928]: 2017-09-28 12:10:29.497 23928 ERROR nova.wsgi     self.filename))
Sep 28 12:10:29 ctl02 nova-api[23928]: 2017-09-28 12:10:29.497 23928 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:10:29 ctl02 nova-api[23928]: 2017-09-28 12:10:29.497 23928 ERROR nova.wsgi
Sep 28 12:10:29 ctl02 nova-api[23928]: 2017-09-28 12:10:29.498 23928 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:10:29 ctl02 nova-api[23928]: 2017-09-28 12:10:29.635 23928 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:10:29 ctl02 nova-api[23928]: 2017-09-28 12:10:29.886 23928 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:10:29 ctl02 nova-api[23928]: 2017-09-28 12:10:29.888 23928 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:10:29 ctl02 nova-api[23928]: 2017-09-28 12:10:29.888 23928 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:10:29 ctl02 nova-api[23928]: 2017-09-28 12:10:29.888 23928 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:10:30 ctl02 nova-api[23928]: 2017-09-28 12:10:30.024 23928 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:10:30 ctl02 nova-api[23928]: 2017-09-28 12:10:30.027 23928 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:10:30 ctl02 nova-api[23928]: 2017-09-28 12:10:30.027 23928 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:10:30 ctl02 nova-api[23928]: 2017-09-28 12:10:30.027 23928 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:10:30 ctl02 nova-api[23928]: 2017-09-28 12:10:30.030 23928 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:10:30 ctl02 nova-api[23928]: 2017-09-28 12:10:30.031 23928 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:10:30 ctl02 nova-api[23928]: 2017-09-28 12:10:30.031 23928 ERROR nova Traceback (most recent call last):
Sep 28 12:10:30 ctl02 nova-api[23928]: 2017-09-28 12:10:30.031 23928 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:10:30 ctl02 nova-api[23928]: 2017-09-28 12:10:30.031 23928 ERROR nova     sys.exit(main())
Sep 28 12:10:30 ctl02 nova-api[23928]: 2017-09-28 12:10:30.031 23928 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:10:30 ctl02 nova-api[23928]: 2017-09-28 12:10:30.031 23928 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:10:30 ctl02 nova-api[23928]: 2017-09-28 12:10:30.031 23928 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:10:30 ctl02 nova-api[23928]: 2017-09-28 12:10:30.031 23928 ERROR nova     max_url_len=max_url_len)
Sep 28 12:10:30 ctl02 nova-api[23928]: 2017-09-28 12:10:30.031 23928 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:10:30 ctl02 nova-api[23928]: 2017-09-28 12:10:30.031 23928 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:10:30 ctl02 nova-api[23928]: 2017-09-28 12:10:30.031 23928 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:10:30 ctl02 nova-api[23928]: 2017-09-28 12:10:30.031 23928 ERROR nova     sock.listen(backlog)
Sep 28 12:10:30 ctl02 nova-api[23928]: 2017-09-28 12:10:30.031 23928 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:10:30 ctl02 nova-api[23928]: 2017-09-28 12:10:30.031 23928 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:10:30 ctl02 nova-api[23928]: 2017-09-28 12:10:30.031 23928 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:10:30 ctl02 nova-api[23928]: 2017-09-28 12:10:30.031 23928 ERROR nova
Sep 28 12:10:30 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x99a43609)
Sep 28 12:10:30 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:10:30 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:10:30 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:10:30 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:10:30 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:10:30 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:10:30 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:10:30 ctl02 heat-api-cfn[13300]: 2017-09-28 12:10:30.433 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:10:30] "OPTIONS / HTTP/1.0" 200 134 0.000555
Sep 28 12:10:30 ctl02 glance-api[29183]: 2017-09-28 12:10:30.594 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:10:30] "OPTIONS / HTTP/1.0" 200 134 0.000613
Sep 28 12:10:31 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x99a43609)
Sep 28 12:10:31 ctl02 heat-api-cfn[13300]: 2017-09-28 12:10:31.265 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:10:31] "OPTIONS / HTTP/1.0" 200 134 0.000523
Sep 28 12:10:32 ctl02 nova-api[23946]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:10:32 ctl02 nova-api[23946]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:10:32 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x99a43609)
Sep 28 12:10:32 ctl02 nova-api[23946]: 2017-09-28 12:10:32.242 23946 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:10:32 ctl02 nova-api[23946]: 2017-09-28 12:10:32.244 23946 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:10:32 ctl02 nova-api[23946]: 2017-09-28 12:10:32.244 23946 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:10:32 ctl02 nova-api[23946]: 2017-09-28 12:10:32.244 23946 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:10:32 ctl02 nova-api[23946]: 2017-09-28 12:10:32.244 23946 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:10:32 ctl02 nova-api[23946]: 2017-09-28 12:10:32.244 23946 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:10:32 ctl02 nova-api[23946]: 2017-09-28 12:10:32.244 23946 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:10:32 ctl02 nova-api[23946]: 2017-09-28 12:10:32.244 23946 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:10:32 ctl02 nova-api[23946]: 2017-09-28 12:10:32.244 23946 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:10:32 ctl02 nova-api[23946]: 2017-09-28 12:10:32.244 23946 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:10:32 ctl02 nova-api[23946]: 2017-09-28 12:10:32.244 23946 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:10:32 ctl02 nova-api[23946]: 2017-09-28 12:10:32.244 23946 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:10:32 ctl02 nova-api[23946]: 2017-09-28 12:10:32.244 23946 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:10:32 ctl02 nova-api[23946]: 2017-09-28 12:10:32.244 23946 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:10:32 ctl02 nova-api[23946]: 2017-09-28 12:10:32.244 23946 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:10:32 ctl02 nova-api[23946]: 2017-09-28 12:10:32.244 23946 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:10:32 ctl02 nova-api[23946]: 2017-09-28 12:10:32.244 23946 ERROR nova.wsgi     self.filename))
Sep 28 12:10:32 ctl02 nova-api[23946]: 2017-09-28 12:10:32.244 23946 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:10:32 ctl02 nova-api[23946]: 2017-09-28 12:10:32.244 23946 ERROR nova.wsgi
Sep 28 12:10:32 ctl02 nova-api[23946]: 2017-09-28 12:10:32.247 23946 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:10:32 ctl02 nova-api[23946]: 2017-09-28 12:10:32.378 23946 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:10:32 ctl02 nova-api[23946]: 2017-09-28 12:10:32.627 23946 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:10:32 ctl02 nova-api[23946]: 2017-09-28 12:10:32.630 23946 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:10:32 ctl02 nova-api[23946]: 2017-09-28 12:10:32.637 23946 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:10:32 ctl02 nova-api[23946]: 2017-09-28 12:10:32.638 23946 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:10:32 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:10:32.769 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:10:32] "OPTIONS / HTTP/1.0" 200 134 0.000495
Sep 28 12:10:32 ctl02 nova-api[23946]: 2017-09-28 12:10:32.771 23946 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:10:32 ctl02 nova-api[23946]: 2017-09-28 12:10:32.773 23946 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:10:32 ctl02 nova-api[23946]: 2017-09-28 12:10:32.773 23946 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:10:32 ctl02 nova-api[23946]: 2017-09-28 12:10:32.774 23946 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:10:32 ctl02 nova-api[23946]: 2017-09-28 12:10:32.777 23946 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:10:32 ctl02 nova-api[23946]: 2017-09-28 12:10:32.777 23946 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:10:32 ctl02 nova-api[23946]: 2017-09-28 12:10:32.777 23946 ERROR nova Traceback (most recent call last):
Sep 28 12:10:32 ctl02 nova-api[23946]: 2017-09-28 12:10:32.777 23946 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:10:32 ctl02 nova-api[23946]: 2017-09-28 12:10:32.777 23946 ERROR nova     sys.exit(main())
Sep 28 12:10:32 ctl02 nova-api[23946]: 2017-09-28 12:10:32.777 23946 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:10:32 ctl02 nova-api[23946]: 2017-09-28 12:10:32.777 23946 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:10:32 ctl02 nova-api[23946]: 2017-09-28 12:10:32.777 23946 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:10:32 ctl02 nova-api[23946]: 2017-09-28 12:10:32.777 23946 ERROR nova     max_url_len=max_url_len)
Sep 28 12:10:32 ctl02 nova-api[23946]: 2017-09-28 12:10:32.777 23946 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:10:32 ctl02 nova-api[23946]: 2017-09-28 12:10:32.777 23946 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:10:32 ctl02 nova-api[23946]: 2017-09-28 12:10:32.777 23946 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:10:32 ctl02 nova-api[23946]: 2017-09-28 12:10:32.777 23946 ERROR nova     sock.listen(backlog)
Sep 28 12:10:32 ctl02 nova-api[23946]: 2017-09-28 12:10:32.777 23946 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:10:32 ctl02 nova-api[23946]: 2017-09-28 12:10:32.777 23946 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:10:32 ctl02 nova-api[23946]: 2017-09-28 12:10:32.777 23946 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:10:32 ctl02 nova-api[23946]: 2017-09-28 12:10:32.777 23946 ERROR nova
Sep 28 12:10:32 ctl02 heat-api-cfn[13300]: 2017-09-28 12:10:32.877 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:10:32] "OPTIONS / HTTP/1.0" 200 134 0.000544
Sep 28 12:10:32 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:10:32 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:10:32 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:10:33 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x99a43609)
Sep 28 12:10:33 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:10:33 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:10:33 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:10:33 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:10:34 ctl02 glance-api[29183]: 2017-09-28 12:10:34.036 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:10:34] "OPTIONS / HTTP/1.0" 200 134 0.000697
Sep 28 12:10:34 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x99a43609)
Sep 28 12:10:34 ctl02 heat-api[13008]: 2017-09-28 12:10:34.464 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:10:34] "OPTIONS / HTTP/1.0" 200 134 0.000658
Sep 28 12:10:34 ctl02 nova-api[23964]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:10:34 ctl02 nova-api[23964]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:10:35 ctl02 nova-api[23964]: 2017-09-28 12:10:34.999 23964 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:10:35 ctl02 nova-api[23964]: 2017-09-28 12:10:35.001 23964 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:10:35 ctl02 nova-api[23964]: 2017-09-28 12:10:35.001 23964 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:10:35 ctl02 nova-api[23964]: 2017-09-28 12:10:35.001 23964 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:10:35 ctl02 nova-api[23964]: 2017-09-28 12:10:35.001 23964 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:10:35 ctl02 nova-api[23964]: 2017-09-28 12:10:35.001 23964 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:10:35 ctl02 nova-api[23964]: 2017-09-28 12:10:35.001 23964 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:10:35 ctl02 nova-api[23964]: 2017-09-28 12:10:35.001 23964 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:10:35 ctl02 nova-api[23964]: 2017-09-28 12:10:35.001 23964 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:10:35 ctl02 nova-api[23964]: 2017-09-28 12:10:35.001 23964 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:10:35 ctl02 nova-api[23964]: 2017-09-28 12:10:35.001 23964 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:10:35 ctl02 nova-api[23964]: 2017-09-28 12:10:35.001 23964 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:10:35 ctl02 nova-api[23964]: 2017-09-28 12:10:35.001 23964 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:10:35 ctl02 nova-api[23964]: 2017-09-28 12:10:35.001 23964 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:10:35 ctl02 nova-api[23964]: 2017-09-28 12:10:35.001 23964 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:10:35 ctl02 nova-api[23964]: 2017-09-28 12:10:35.001 23964 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:10:35 ctl02 nova-api[23964]: 2017-09-28 12:10:35.001 23964 ERROR nova.wsgi     self.filename))
Sep 28 12:10:35 ctl02 nova-api[23964]: 2017-09-28 12:10:35.001 23964 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:10:35 ctl02 nova-api[23964]: 2017-09-28 12:10:35.001 23964 ERROR nova.wsgi
Sep 28 12:10:35 ctl02 nova-api[23964]: 2017-09-28 12:10:35.002 23964 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:10:35 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x99a43609)
Sep 28 12:10:35 ctl02 nova-api[23964]: 2017-09-28 12:10:35.138 23964 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:10:35 ctl02 heat-api[13008]: 2017-09-28 12:10:35.370 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:10:35] "OPTIONS / HTTP/1.0" 200 134 0.000669
Sep 28 12:10:35 ctl02 nova-api[23964]: 2017-09-28 12:10:35.394 23964 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:10:35 ctl02 nova-api[23964]: 2017-09-28 12:10:35.397 23964 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:10:35 ctl02 nova-api[23964]: 2017-09-28 12:10:35.397 23964 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:10:35 ctl02 nova-api[23964]: 2017-09-28 12:10:35.397 23964 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:10:35 ctl02 nova-api[23964]: 2017-09-28 12:10:35.534 23964 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:10:35 ctl02 nova-api[23964]: 2017-09-28 12:10:35.536 23964 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:10:35 ctl02 nova-api[23964]: 2017-09-28 12:10:35.537 23964 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:10:35 ctl02 nova-api[23964]: 2017-09-28 12:10:35.537 23964 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:10:35 ctl02 nova-api[23964]: 2017-09-28 12:10:35.540 23964 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:10:35 ctl02 nova-api[23964]: 2017-09-28 12:10:35.541 23964 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:10:35 ctl02 nova-api[23964]: 2017-09-28 12:10:35.541 23964 ERROR nova Traceback (most recent call last):
Sep 28 12:10:35 ctl02 nova-api[23964]: 2017-09-28 12:10:35.541 23964 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:10:35 ctl02 nova-api[23964]: 2017-09-28 12:10:35.541 23964 ERROR nova     sys.exit(main())
Sep 28 12:10:35 ctl02 nova-api[23964]: 2017-09-28 12:10:35.541 23964 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:10:35 ctl02 nova-api[23964]: 2017-09-28 12:10:35.541 23964 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:10:35 ctl02 nova-api[23964]: 2017-09-28 12:10:35.541 23964 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:10:35 ctl02 nova-api[23964]: 2017-09-28 12:10:35.541 23964 ERROR nova     max_url_len=max_url_len)
Sep 28 12:10:35 ctl02 nova-api[23964]: 2017-09-28 12:10:35.541 23964 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:10:35 ctl02 nova-api[23964]: 2017-09-28 12:10:35.541 23964 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:10:35 ctl02 nova-api[23964]: 2017-09-28 12:10:35.541 23964 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:10:35 ctl02 nova-api[23964]: 2017-09-28 12:10:35.541 23964 ERROR nova     sock.listen(backlog)
Sep 28 12:10:35 ctl02 nova-api[23964]: 2017-09-28 12:10:35.541 23964 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:10:35 ctl02 nova-api[23964]: 2017-09-28 12:10:35.541 23964 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:10:35 ctl02 nova-api[23964]: 2017-09-28 12:10:35.541 23964 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:10:35 ctl02 nova-api[23964]: 2017-09-28 12:10:35.541 23964 ERROR nova
Sep 28 12:10:35 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:10:35 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:10:35 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:10:35 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:10:35 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:10:35 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:10:35 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:10:36 ctl02 glance-api[29183]: 2017-09-28 12:10:36.037 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:10:36] "OPTIONS / HTTP/1.0" 200 134 0.000682
Sep 28 12:10:36 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x99a43609)
Sep 28 12:10:37 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x99a43609)
Sep 28 12:10:37 ctl02 nova-api[23982]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:10:37 ctl02 nova-api[23982]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:10:37 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:10:37.604 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:10:37] "OPTIONS / HTTP/1.0" 200 134 0.000485
Sep 28 12:10:37 ctl02 nova-api[23982]: 2017-09-28 12:10:37.740 23982 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:10:37 ctl02 nova-api[23982]: 2017-09-28 12:10:37.742 23982 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:10:37 ctl02 nova-api[23982]: 2017-09-28 12:10:37.742 23982 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:10:37 ctl02 nova-api[23982]: 2017-09-28 12:10:37.742 23982 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:10:37 ctl02 nova-api[23982]: 2017-09-28 12:10:37.742 23982 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:10:37 ctl02 nova-api[23982]: 2017-09-28 12:10:37.742 23982 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:10:37 ctl02 nova-api[23982]: 2017-09-28 12:10:37.742 23982 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:10:37 ctl02 nova-api[23982]: 2017-09-28 12:10:37.742 23982 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:10:37 ctl02 nova-api[23982]: 2017-09-28 12:10:37.742 23982 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:10:37 ctl02 nova-api[23982]: 2017-09-28 12:10:37.742 23982 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:10:37 ctl02 nova-api[23982]: 2017-09-28 12:10:37.742 23982 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:10:37 ctl02 nova-api[23982]: 2017-09-28 12:10:37.742 23982 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:10:37 ctl02 nova-api[23982]: 2017-09-28 12:10:37.742 23982 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:10:37 ctl02 nova-api[23982]: 2017-09-28 12:10:37.742 23982 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:10:37 ctl02 nova-api[23982]: 2017-09-28 12:10:37.742 23982 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:10:37 ctl02 nova-api[23982]: 2017-09-28 12:10:37.742 23982 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:10:37 ctl02 nova-api[23982]: 2017-09-28 12:10:37.742 23982 ERROR nova.wsgi     self.filename))
Sep 28 12:10:37 ctl02 nova-api[23982]: 2017-09-28 12:10:37.742 23982 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:10:37 ctl02 nova-api[23982]: 2017-09-28 12:10:37.742 23982 ERROR nova.wsgi
Sep 28 12:10:37 ctl02 nova-api[23982]: 2017-09-28 12:10:37.753 23982 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:10:37 ctl02 nova-api[23982]: 2017-09-28 12:10:37.888 23982 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:10:38 ctl02 heat-api[13008]: 2017-09-28 12:10:38.052 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:10:38] "OPTIONS / HTTP/1.0" 200 134 0.000718
Sep 28 12:10:38 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:10:38.058 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:10:38] "OPTIONS / HTTP/1.0" 200 134 0.000480
Sep 28 12:10:38 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:10:38 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:10:38 ctl02 nova-api[23982]: 2017-09-28 12:10:38.146 23982 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:10:38 ctl02 nova-api[23982]: 2017-09-28 12:10:38.150 23982 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:10:38 ctl02 nova-api[23982]: 2017-09-28 12:10:38.150 23982 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:10:38 ctl02 nova-api[23982]: 2017-09-28 12:10:38.150 23982 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:10:38 ctl02 nova-api[23982]: 2017-09-28 12:10:38.286 23982 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:10:38 ctl02 nova-api[23982]: 2017-09-28 12:10:38.289 23982 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:10:38 ctl02 nova-api[23982]: 2017-09-28 12:10:38.289 23982 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:10:38 ctl02 nova-api[23982]: 2017-09-28 12:10:38.290 23982 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:10:38 ctl02 nova-api[23982]: 2017-09-28 12:10:38.293 23982 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:10:38 ctl02 nova-api[23982]: 2017-09-28 12:10:38.294 23982 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:10:38 ctl02 nova-api[23982]: 2017-09-28 12:10:38.294 23982 ERROR nova Traceback (most recent call last):
Sep 28 12:10:38 ctl02 nova-api[23982]: 2017-09-28 12:10:38.294 23982 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:10:38 ctl02 nova-api[23982]: 2017-09-28 12:10:38.294 23982 ERROR nova     sys.exit(main())
Sep 28 12:10:38 ctl02 nova-api[23982]: 2017-09-28 12:10:38.294 23982 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:10:38 ctl02 nova-api[23982]: 2017-09-28 12:10:38.294 23982 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:10:38 ctl02 nova-api[23982]: 2017-09-28 12:10:38.294 23982 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:10:38 ctl02 nova-api[23982]: 2017-09-28 12:10:38.294 23982 ERROR nova     max_url_len=max_url_len)
Sep 28 12:10:38 ctl02 nova-api[23982]: 2017-09-28 12:10:38.294 23982 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:10:38 ctl02 nova-api[23982]: 2017-09-28 12:10:38.294 23982 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:10:38 ctl02 nova-api[23982]: 2017-09-28 12:10:38.294 23982 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:10:38 ctl02 nova-api[23982]: 2017-09-28 12:10:38.294 23982 ERROR nova     sock.listen(backlog)
Sep 28 12:10:38 ctl02 nova-api[23982]: 2017-09-28 12:10:38.294 23982 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:10:38 ctl02 nova-api[23982]: 2017-09-28 12:10:38.294 23982 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:10:38 ctl02 nova-api[23982]: 2017-09-28 12:10:38.294 23982 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:10:38 ctl02 nova-api[23982]: 2017-09-28 12:10:38.294 23982 ERROR nova
Sep 28 12:10:38 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:10:38 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:10:38 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:10:38 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:10:38 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:10:38 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:10:38 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:10:40 ctl02 nova-api[24005]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:10:40 ctl02 nova-api[24005]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:10:40 ctl02 nova-api[24005]: 2017-09-28 12:10:40.484 24005 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:10:40 ctl02 nova-api[24005]: 2017-09-28 12:10:40.487 24005 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:10:40 ctl02 nova-api[24005]: 2017-09-28 12:10:40.487 24005 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:10:40 ctl02 nova-api[24005]: 2017-09-28 12:10:40.487 24005 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:10:40 ctl02 nova-api[24005]: 2017-09-28 12:10:40.487 24005 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:10:40 ctl02 nova-api[24005]: 2017-09-28 12:10:40.487 24005 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:10:40 ctl02 nova-api[24005]: 2017-09-28 12:10:40.487 24005 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:10:40 ctl02 nova-api[24005]: 2017-09-28 12:10:40.487 24005 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:10:40 ctl02 nova-api[24005]: 2017-09-28 12:10:40.487 24005 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:10:40 ctl02 nova-api[24005]: 2017-09-28 12:10:40.487 24005 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:10:40 ctl02 nova-api[24005]: 2017-09-28 12:10:40.487 24005 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:10:40 ctl02 nova-api[24005]: 2017-09-28 12:10:40.487 24005 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:10:40 ctl02 nova-api[24005]: 2017-09-28 12:10:40.487 24005 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:10:40 ctl02 nova-api[24005]: 2017-09-28 12:10:40.487 24005 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:10:40 ctl02 nova-api[24005]: 2017-09-28 12:10:40.487 24005 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:10:40 ctl02 nova-api[24005]: 2017-09-28 12:10:40.487 24005 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:10:40 ctl02 nova-api[24005]: 2017-09-28 12:10:40.487 24005 ERROR nova.wsgi     self.filename))
Sep 28 12:10:40 ctl02 nova-api[24005]: 2017-09-28 12:10:40.487 24005 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:10:40 ctl02 nova-api[24005]: 2017-09-28 12:10:40.487 24005 ERROR nova.wsgi
Sep 28 12:10:40 ctl02 nova-api[24005]: 2017-09-28 12:10:40.489 24005 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:10:40 ctl02 glance-api[29183]: 2017-09-28 12:10:40.568 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:10:40] "OPTIONS / HTTP/1.0" 200 134 0.000722
Sep 28 12:10:40 ctl02 nova-api[24005]: 2017-09-28 12:10:40.624 24005 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:10:40 ctl02 heat-api-cfn[13300]: 2017-09-28 12:10:40.669 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:10:40] "OPTIONS / HTTP/1.0" 200 134 0.000475
Sep 28 12:10:40 ctl02 nova-api[24005]: 2017-09-28 12:10:40.876 24005 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:10:40 ctl02 nova-api[24005]: 2017-09-28 12:10:40.879 24005 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:10:40 ctl02 nova-api[24005]: 2017-09-28 12:10:40.879 24005 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:10:40 ctl02 nova-api[24005]: 2017-09-28 12:10:40.880 24005 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:10:41 ctl02 nova-api[24005]: 2017-09-28 12:10:41.015 24005 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:10:41 ctl02 nova-api[24005]: 2017-09-28 12:10:41.018 24005 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:10:41 ctl02 nova-api[24005]: 2017-09-28 12:10:41.018 24005 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:10:41 ctl02 nova-api[24005]: 2017-09-28 12:10:41.019 24005 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:10:41 ctl02 nova-api[24005]: 2017-09-28 12:10:41.022 24005 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:10:41 ctl02 nova-api[24005]: 2017-09-28 12:10:41.023 24005 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:10:41 ctl02 nova-api[24005]: 2017-09-28 12:10:41.023 24005 ERROR nova Traceback (most recent call last):
Sep 28 12:10:41 ctl02 nova-api[24005]: 2017-09-28 12:10:41.023 24005 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:10:41 ctl02 nova-api[24005]: 2017-09-28 12:10:41.023 24005 ERROR nova     sys.exit(main())
Sep 28 12:10:41 ctl02 nova-api[24005]: 2017-09-28 12:10:41.023 24005 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:10:41 ctl02 nova-api[24005]: 2017-09-28 12:10:41.023 24005 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:10:41 ctl02 nova-api[24005]: 2017-09-28 12:10:41.023 24005 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:10:41 ctl02 nova-api[24005]: 2017-09-28 12:10:41.023 24005 ERROR nova     max_url_len=max_url_len)
Sep 28 12:10:41 ctl02 nova-api[24005]: 2017-09-28 12:10:41.023 24005 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:10:41 ctl02 nova-api[24005]: 2017-09-28 12:10:41.023 24005 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:10:41 ctl02 nova-api[24005]: 2017-09-28 12:10:41.023 24005 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:10:41 ctl02 nova-api[24005]: 2017-09-28 12:10:41.023 24005 ERROR nova     sock.listen(backlog)
Sep 28 12:10:41 ctl02 nova-api[24005]: 2017-09-28 12:10:41.023 24005 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:10:41 ctl02 nova-api[24005]: 2017-09-28 12:10:41.023 24005 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:10:41 ctl02 nova-api[24005]: 2017-09-28 12:10:41.023 24005 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:10:41 ctl02 nova-api[24005]: 2017-09-28 12:10:41.023 24005 ERROR nova
Sep 28 12:10:41 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:10:41 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:10:41 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:10:41 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:10:41 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:10:41 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:10:41 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:10:41 ctl02 heat-api-cfn[13300]: 2017-09-28 12:10:41.421 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:10:41] "OPTIONS / HTTP/1.0" 200 134 0.000540
Sep 28 12:10:42 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:10:42.704 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:10:42] "OPTIONS / HTTP/1.0" 200 134 0.000653
Sep 28 12:10:42 ctl02 heat-api-cfn[13300]: 2017-09-28 12:10:42.867 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:10:42] "OPTIONS / HTTP/1.0" 200 134 0.000525
Sep 28 12:10:43 ctl02 nova-api[24023]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:10:43 ctl02 nova-api[24023]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:10:43 ctl02 nova-api[24023]: 2017-09-28 12:10:43.229 24023 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:10:43 ctl02 nova-api[24023]: 2017-09-28 12:10:43.231 24023 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:10:43 ctl02 nova-api[24023]: 2017-09-28 12:10:43.231 24023 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:10:43 ctl02 nova-api[24023]: 2017-09-28 12:10:43.231 24023 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:10:43 ctl02 nova-api[24023]: 2017-09-28 12:10:43.231 24023 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:10:43 ctl02 nova-api[24023]: 2017-09-28 12:10:43.231 24023 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:10:43 ctl02 nova-api[24023]: 2017-09-28 12:10:43.231 24023 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:10:43 ctl02 nova-api[24023]: 2017-09-28 12:10:43.231 24023 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:10:43 ctl02 nova-api[24023]: 2017-09-28 12:10:43.231 24023 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:10:43 ctl02 nova-api[24023]: 2017-09-28 12:10:43.231 24023 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:10:43 ctl02 nova-api[24023]: 2017-09-28 12:10:43.231 24023 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:10:43 ctl02 nova-api[24023]: 2017-09-28 12:10:43.231 24023 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:10:43 ctl02 nova-api[24023]: 2017-09-28 12:10:43.231 24023 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:10:43 ctl02 nova-api[24023]: 2017-09-28 12:10:43.231 24023 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:10:43 ctl02 nova-api[24023]: 2017-09-28 12:10:43.231 24023 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:10:43 ctl02 nova-api[24023]: 2017-09-28 12:10:43.231 24023 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:10:43 ctl02 nova-api[24023]: 2017-09-28 12:10:43.231 24023 ERROR nova.wsgi     self.filename))
Sep 28 12:10:43 ctl02 nova-api[24023]: 2017-09-28 12:10:43.231 24023 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:10:43 ctl02 nova-api[24023]: 2017-09-28 12:10:43.231 24023 ERROR nova.wsgi
Sep 28 12:10:43 ctl02 nova-api[24023]: 2017-09-28 12:10:43.232 24023 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:10:43 ctl02 nova-api[24023]: 2017-09-28 12:10:43.365 24023 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:10:43 ctl02 nova-api[24023]: 2017-09-28 12:10:43.618 24023 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:10:43 ctl02 nova-api[24023]: 2017-09-28 12:10:43.621 24023 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:10:43 ctl02 nova-api[24023]: 2017-09-28 12:10:43.621 24023 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:10:43 ctl02 nova-api[24023]: 2017-09-28 12:10:43.621 24023 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:10:43 ctl02 nova-api[24023]: 2017-09-28 12:10:43.754 24023 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:10:43 ctl02 nova-api[24023]: 2017-09-28 12:10:43.756 24023 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:10:43 ctl02 nova-api[24023]: 2017-09-28 12:10:43.756 24023 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:10:43 ctl02 nova-api[24023]: 2017-09-28 12:10:43.757 24023 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:10:43 ctl02 nova-api[24023]: 2017-09-28 12:10:43.760 24023 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:10:43 ctl02 nova-api[24023]: 2017-09-28 12:10:43.761 24023 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:10:43 ctl02 nova-api[24023]: 2017-09-28 12:10:43.761 24023 ERROR nova Traceback (most recent call last):
Sep 28 12:10:43 ctl02 nova-api[24023]: 2017-09-28 12:10:43.761 24023 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:10:43 ctl02 nova-api[24023]: 2017-09-28 12:10:43.761 24023 ERROR nova     sys.exit(main())
Sep 28 12:10:43 ctl02 nova-api[24023]: 2017-09-28 12:10:43.761 24023 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:10:43 ctl02 nova-api[24023]: 2017-09-28 12:10:43.761 24023 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:10:43 ctl02 nova-api[24023]: 2017-09-28 12:10:43.761 24023 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:10:43 ctl02 nova-api[24023]: 2017-09-28 12:10:43.761 24023 ERROR nova     max_url_len=max_url_len)
Sep 28 12:10:43 ctl02 nova-api[24023]: 2017-09-28 12:10:43.761 24023 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:10:43 ctl02 nova-api[24023]: 2017-09-28 12:10:43.761 24023 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:10:43 ctl02 nova-api[24023]: 2017-09-28 12:10:43.761 24023 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:10:43 ctl02 nova-api[24023]: 2017-09-28 12:10:43.761 24023 ERROR nova     sock.listen(backlog)
Sep 28 12:10:43 ctl02 nova-api[24023]: 2017-09-28 12:10:43.761 24023 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:10:43 ctl02 nova-api[24023]: 2017-09-28 12:10:43.761 24023 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:10:43 ctl02 nova-api[24023]: 2017-09-28 12:10:43.761 24023 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:10:43 ctl02 nova-api[24023]: 2017-09-28 12:10:43.761 24023 ERROR nova
Sep 28 12:10:43 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:10:43 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:10:43 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:10:43 ctl02 glance-api[29183]: 2017-09-28 12:10:43.942 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:10:43] "OPTIONS / HTTP/1.0" 200 134 0.000645
Sep 28 12:10:44 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:10:44 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:10:44 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:10:44 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:10:44 ctl02 nova-cert[4860]: 2017-09-28 12:10:44.390 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:10:44 ctl02 heat-api[13008]: 2017-09-28 12:10:44.414 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:10:44] "OPTIONS / HTTP/1.0" 200 134 0.000610
Sep 28 12:10:44 ctl02 heat-api[13008]: 2017-09-28 12:10:44.977 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:10:44] "OPTIONS / HTTP/1.0" 200 134 0.000624
Sep 28 12:10:45 ctl02 glance-api[29183]: 2017-09-28 12:10:45.719 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:10:45] "OPTIONS / HTTP/1.0" 200 134 0.000819
Sep 28 12:10:45 ctl02 nova-api[24041]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:10:45 ctl02 nova-api[24041]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:10:45 ctl02 nova-api[24041]: 2017-09-28 12:10:45.998 24041 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:10:46 ctl02 nova-api[24041]: 2017-09-28 12:10:46.000 24041 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:10:46 ctl02 nova-api[24041]: 2017-09-28 12:10:46.000 24041 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:10:46 ctl02 nova-api[24041]: 2017-09-28 12:10:46.000 24041 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:10:46 ctl02 nova-api[24041]: 2017-09-28 12:10:46.000 24041 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:10:46 ctl02 nova-api[24041]: 2017-09-28 12:10:46.000 24041 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:10:46 ctl02 nova-api[24041]: 2017-09-28 12:10:46.000 24041 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:10:46 ctl02 nova-api[24041]: 2017-09-28 12:10:46.000 24041 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:10:46 ctl02 nova-api[24041]: 2017-09-28 12:10:46.000 24041 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:10:46 ctl02 nova-api[24041]: 2017-09-28 12:10:46.000 24041 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:10:46 ctl02 nova-api[24041]: 2017-09-28 12:10:46.000 24041 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:10:46 ctl02 nova-api[24041]: 2017-09-28 12:10:46.000 24041 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:10:46 ctl02 nova-api[24041]: 2017-09-28 12:10:46.000 24041 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:10:46 ctl02 nova-api[24041]: 2017-09-28 12:10:46.000 24041 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:10:46 ctl02 nova-api[24041]: 2017-09-28 12:10:46.000 24041 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:10:46 ctl02 nova-api[24041]: 2017-09-28 12:10:46.000 24041 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:10:46 ctl02 nova-api[24041]: 2017-09-28 12:10:46.000 24041 ERROR nova.wsgi     self.filename))
Sep 28 12:10:46 ctl02 nova-api[24041]: 2017-09-28 12:10:46.000 24041 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:10:46 ctl02 nova-api[24041]: 2017-09-28 12:10:46.000 24041 ERROR nova.wsgi
Sep 28 12:10:46 ctl02 nova-api[24041]: 2017-09-28 12:10:46.002 24041 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:10:46 ctl02 nova-api[24041]: 2017-09-28 12:10:46.137 24041 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:10:46 ctl02 nova-api[24041]: 2017-09-28 12:10:46.390 24041 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:10:46 ctl02 nova-api[24041]: 2017-09-28 12:10:46.393 24041 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:10:46 ctl02 nova-api[24041]: 2017-09-28 12:10:46.393 24041 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:10:46 ctl02 nova-api[24041]: 2017-09-28 12:10:46.394 24041 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:10:46 ctl02 nova-conductor[5056]: 2017-09-28 12:10:46.416 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:10:46 ctl02 nova-conductor[5056]: 2017-09-28 12:10:46.429 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:10:46 ctl02 nova-conductor[5056]: 2017-09-28 12:10:46.431 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:10:46 ctl02 nova-conductor[5056]: 2017-09-28 12:10:46.438 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:10:46 ctl02 nova-api[24041]: 2017-09-28 12:10:46.536 24041 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:10:46 ctl02 nova-api[24041]: 2017-09-28 12:10:46.538 24041 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:10:46 ctl02 nova-api[24041]: 2017-09-28 12:10:46.539 24041 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:10:46 ctl02 nova-api[24041]: 2017-09-28 12:10:46.539 24041 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:10:46 ctl02 nova-api[24041]: 2017-09-28 12:10:46.543 24041 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:10:46 ctl02 nova-api[24041]: 2017-09-28 12:10:46.543 24041 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:10:46 ctl02 nova-api[24041]: 2017-09-28 12:10:46.543 24041 ERROR nova Traceback (most recent call last):
Sep 28 12:10:46 ctl02 nova-api[24041]: 2017-09-28 12:10:46.543 24041 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:10:46 ctl02 nova-api[24041]: 2017-09-28 12:10:46.543 24041 ERROR nova     sys.exit(main())
Sep 28 12:10:46 ctl02 nova-api[24041]: 2017-09-28 12:10:46.543 24041 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:10:46 ctl02 nova-api[24041]: 2017-09-28 12:10:46.543 24041 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:10:46 ctl02 nova-api[24041]: 2017-09-28 12:10:46.543 24041 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:10:46 ctl02 nova-api[24041]: 2017-09-28 12:10:46.543 24041 ERROR nova     max_url_len=max_url_len)
Sep 28 12:10:46 ctl02 nova-api[24041]: 2017-09-28 12:10:46.543 24041 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:10:46 ctl02 nova-api[24041]: 2017-09-28 12:10:46.543 24041 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:10:46 ctl02 nova-api[24041]: 2017-09-28 12:10:46.543 24041 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:10:46 ctl02 nova-api[24041]: 2017-09-28 12:10:46.543 24041 ERROR nova     sock.listen(backlog)
Sep 28 12:10:46 ctl02 nova-api[24041]: 2017-09-28 12:10:46.543 24041 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:10:46 ctl02 nova-api[24041]: 2017-09-28 12:10:46.543 24041 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:10:46 ctl02 nova-api[24041]: 2017-09-28 12:10:46.543 24041 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:10:46 ctl02 nova-api[24041]: 2017-09-28 12:10:46.543 24041 ERROR nova
Sep 28 12:10:46 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:10:46 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:10:46 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:10:46 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:10:46 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:10:46 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:10:46 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:10:47 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:10:47.920 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:10:47] "OPTIONS / HTTP/1.0" 200 134 0.000467
Sep 28 12:10:48 ctl02 heat-api[13008]: 2017-09-28 12:10:48.084 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:10:48] "OPTIONS / HTTP/1.0" 200 134 0.000614
Sep 28 12:10:48 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:10:48.211 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:10:48] "OPTIONS / HTTP/1.0" 200 134 0.000454
Sep 28 12:10:48 ctl02 nova-api[24058]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:10:48 ctl02 nova-api[24058]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:10:48 ctl02 nova-api[24058]: 2017-09-28 12:10:48.756 24058 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:10:48 ctl02 nova-api[24058]: 2017-09-28 12:10:48.758 24058 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:10:48 ctl02 nova-api[24058]: 2017-09-28 12:10:48.758 24058 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:10:48 ctl02 nova-api[24058]: 2017-09-28 12:10:48.758 24058 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:10:48 ctl02 nova-api[24058]: 2017-09-28 12:10:48.758 24058 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:10:48 ctl02 nova-api[24058]: 2017-09-28 12:10:48.758 24058 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:10:48 ctl02 nova-api[24058]: 2017-09-28 12:10:48.758 24058 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:10:48 ctl02 nova-api[24058]: 2017-09-28 12:10:48.758 24058 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:10:48 ctl02 nova-api[24058]: 2017-09-28 12:10:48.758 24058 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:10:48 ctl02 nova-api[24058]: 2017-09-28 12:10:48.758 24058 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:10:48 ctl02 nova-api[24058]: 2017-09-28 12:10:48.758 24058 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:10:48 ctl02 nova-api[24058]: 2017-09-28 12:10:48.758 24058 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:10:48 ctl02 nova-api[24058]: 2017-09-28 12:10:48.758 24058 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:10:48 ctl02 nova-api[24058]: 2017-09-28 12:10:48.758 24058 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:10:48 ctl02 nova-api[24058]: 2017-09-28 12:10:48.758 24058 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:10:48 ctl02 nova-api[24058]: 2017-09-28 12:10:48.758 24058 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:10:48 ctl02 nova-api[24058]: 2017-09-28 12:10:48.758 24058 ERROR nova.wsgi     self.filename))
Sep 28 12:10:48 ctl02 nova-api[24058]: 2017-09-28 12:10:48.758 24058 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:10:48 ctl02 nova-api[24058]: 2017-09-28 12:10:48.758 24058 ERROR nova.wsgi
Sep 28 12:10:48 ctl02 nova-api[24058]: 2017-09-28 12:10:48.761 24058 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:10:48 ctl02 nova-api[24058]: 2017-09-28 12:10:48.894 24058 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:10:49 ctl02 nova-api[24058]: 2017-09-28 12:10:49.147 24058 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:10:49 ctl02 nova-api[24058]: 2017-09-28 12:10:49.151 24058 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:10:49 ctl02 nova-api[24058]: 2017-09-28 12:10:49.151 24058 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:10:49 ctl02 nova-api[24058]: 2017-09-28 12:10:49.151 24058 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:10:49 ctl02 nova-api[24058]: 2017-09-28 12:10:49.285 24058 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:10:49 ctl02 nova-api[24058]: 2017-09-28 12:10:49.288 24058 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:10:49 ctl02 nova-api[24058]: 2017-09-28 12:10:49.288 24058 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:10:49 ctl02 nova-api[24058]: 2017-09-28 12:10:49.289 24058 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:10:49 ctl02 nova-api[24058]: 2017-09-28 12:10:49.292 24058 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:10:49 ctl02 nova-api[24058]: 2017-09-28 12:10:49.293 24058 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:10:49 ctl02 nova-api[24058]: 2017-09-28 12:10:49.293 24058 ERROR nova Traceback (most recent call last):
Sep 28 12:10:49 ctl02 nova-api[24058]: 2017-09-28 12:10:49.293 24058 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:10:49 ctl02 nova-api[24058]: 2017-09-28 12:10:49.293 24058 ERROR nova     sys.exit(main())
Sep 28 12:10:49 ctl02 nova-api[24058]: 2017-09-28 12:10:49.293 24058 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:10:49 ctl02 nova-api[24058]: 2017-09-28 12:10:49.293 24058 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:10:49 ctl02 nova-api[24058]: 2017-09-28 12:10:49.293 24058 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:10:49 ctl02 nova-api[24058]: 2017-09-28 12:10:49.293 24058 ERROR nova     max_url_len=max_url_len)
Sep 28 12:10:49 ctl02 nova-api[24058]: 2017-09-28 12:10:49.293 24058 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:10:49 ctl02 nova-api[24058]: 2017-09-28 12:10:49.293 24058 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:10:49 ctl02 nova-api[24058]: 2017-09-28 12:10:49.293 24058 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:10:49 ctl02 nova-api[24058]: 2017-09-28 12:10:49.293 24058 ERROR nova     sock.listen(backlog)
Sep 28 12:10:49 ctl02 nova-api[24058]: 2017-09-28 12:10:49.293 24058 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:10:49 ctl02 nova-api[24058]: 2017-09-28 12:10:49.293 24058 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:10:49 ctl02 nova-api[24058]: 2017-09-28 12:10:49.293 24058 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:10:49 ctl02 nova-api[24058]: 2017-09-28 12:10:49.293 24058 ERROR nova
Sep 28 12:10:49 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:10:49 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:10:49 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:10:49 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:10:49 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:10:49 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:10:49 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:10:50 ctl02 glance-api[29183]: 2017-09-28 12:10:50.237 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:10:50] "OPTIONS / HTTP/1.0" 200 134 0.000664
Sep 28 12:10:51 ctl02 heat-api-cfn[13300]: 2017-09-28 12:10:51.045 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:10:51] "OPTIONS / HTTP/1.0" 200 134 0.000514
Sep 28 12:10:51 ctl02 heat-api-cfn[13300]: 2017-09-28 12:10:51.076 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:10:51] "OPTIONS / HTTP/1.0" 200 134 0.000283
Sep 28 12:10:51 ctl02 nova-api[24078]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:10:51 ctl02 nova-api[24078]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:10:51 ctl02 nova-api[24078]: 2017-09-28 12:10:51.510 24078 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:10:51 ctl02 nova-api[24078]: 2017-09-28 12:10:51.512 24078 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:10:51 ctl02 nova-api[24078]: 2017-09-28 12:10:51.512 24078 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:10:51 ctl02 nova-api[24078]: 2017-09-28 12:10:51.512 24078 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:10:51 ctl02 nova-api[24078]: 2017-09-28 12:10:51.512 24078 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:10:51 ctl02 nova-api[24078]: 2017-09-28 12:10:51.512 24078 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:10:51 ctl02 nova-api[24078]: 2017-09-28 12:10:51.512 24078 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:10:51 ctl02 nova-api[24078]: 2017-09-28 12:10:51.512 24078 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:10:51 ctl02 nova-api[24078]: 2017-09-28 12:10:51.512 24078 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:10:51 ctl02 nova-api[24078]: 2017-09-28 12:10:51.512 24078 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:10:51 ctl02 nova-api[24078]: 2017-09-28 12:10:51.512 24078 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:10:51 ctl02 nova-api[24078]: 2017-09-28 12:10:51.512 24078 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:10:51 ctl02 nova-api[24078]: 2017-09-28 12:10:51.512 24078 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:10:51 ctl02 nova-api[24078]: 2017-09-28 12:10:51.512 24078 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:10:51 ctl02 nova-api[24078]: 2017-09-28 12:10:51.512 24078 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:10:51 ctl02 nova-api[24078]: 2017-09-28 12:10:51.512 24078 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:10:51 ctl02 nova-api[24078]: 2017-09-28 12:10:51.512 24078 ERROR nova.wsgi     self.filename))
Sep 28 12:10:51 ctl02 nova-api[24078]: 2017-09-28 12:10:51.512 24078 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:10:51 ctl02 nova-api[24078]: 2017-09-28 12:10:51.512 24078 ERROR nova.wsgi
Sep 28 12:10:51 ctl02 nova-api[24078]: 2017-09-28 12:10:51.514 24078 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:10:51 ctl02 nova-api[24078]: 2017-09-28 12:10:51.648 24078 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:10:51 ctl02 nova-api[24078]: 2017-09-28 12:10:51.901 24078 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:10:51 ctl02 nova-api[24078]: 2017-09-28 12:10:51.904 24078 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:10:51 ctl02 nova-api[24078]: 2017-09-28 12:10:51.904 24078 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:10:51 ctl02 nova-api[24078]: 2017-09-28 12:10:51.905 24078 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:10:52 ctl02 nova-api[24078]: 2017-09-28 12:10:52.040 24078 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:10:52 ctl02 nova-api[24078]: 2017-09-28 12:10:52.043 24078 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:10:52 ctl02 nova-api[24078]: 2017-09-28 12:10:52.043 24078 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:10:52 ctl02 nova-api[24078]: 2017-09-28 12:10:52.044 24078 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:10:52 ctl02 nova-api[24078]: 2017-09-28 12:10:52.047 24078 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:10:52 ctl02 nova-api[24078]: 2017-09-28 12:10:52.048 24078 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:10:52 ctl02 nova-api[24078]: 2017-09-28 12:10:52.048 24078 ERROR nova Traceback (most recent call last):
Sep 28 12:10:52 ctl02 nova-api[24078]: 2017-09-28 12:10:52.048 24078 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:10:52 ctl02 nova-api[24078]: 2017-09-28 12:10:52.048 24078 ERROR nova     sys.exit(main())
Sep 28 12:10:52 ctl02 nova-api[24078]: 2017-09-28 12:10:52.048 24078 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:10:52 ctl02 nova-api[24078]: 2017-09-28 12:10:52.048 24078 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:10:52 ctl02 nova-api[24078]: 2017-09-28 12:10:52.048 24078 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:10:52 ctl02 nova-api[24078]: 2017-09-28 12:10:52.048 24078 ERROR nova     max_url_len=max_url_len)
Sep 28 12:10:52 ctl02 nova-api[24078]: 2017-09-28 12:10:52.048 24078 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:10:52 ctl02 nova-api[24078]: 2017-09-28 12:10:52.048 24078 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:10:52 ctl02 nova-api[24078]: 2017-09-28 12:10:52.048 24078 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:10:52 ctl02 nova-api[24078]: 2017-09-28 12:10:52.048 24078 ERROR nova     sock.listen(backlog)
Sep 28 12:10:52 ctl02 nova-api[24078]: 2017-09-28 12:10:52.048 24078 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:10:52 ctl02 nova-api[24078]: 2017-09-28 12:10:52.048 24078 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:10:52 ctl02 nova-api[24078]: 2017-09-28 12:10:52.048 24078 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:10:52 ctl02 nova-api[24078]: 2017-09-28 12:10:52.048 24078 ERROR nova
Sep 28 12:10:52 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:10:52 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:10:52 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:10:52 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:10:52 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:10:52 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:10:52 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:10:52 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:10:52.729 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:10:52] "OPTIONS / HTTP/1.0" 200 134 0.000485
Sep 28 12:10:53 ctl02 heat-api-cfn[13300]: 2017-09-28 12:10:53.066 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:10:53] "OPTIONS / HTTP/1.0" 200 134 0.000484
Sep 28 12:10:54 ctl02 nova-api[24096]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:10:54 ctl02 nova-api[24096]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:10:54 ctl02 nova-api[24096]: 2017-09-28 12:10:54.230 24096 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:10:54 ctl02 nova-api[24096]: 2017-09-28 12:10:54.232 24096 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:10:54 ctl02 nova-api[24096]: 2017-09-28 12:10:54.232 24096 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:10:54 ctl02 nova-api[24096]: 2017-09-28 12:10:54.232 24096 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:10:54 ctl02 nova-api[24096]: 2017-09-28 12:10:54.232 24096 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:10:54 ctl02 nova-api[24096]: 2017-09-28 12:10:54.232 24096 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:10:54 ctl02 nova-api[24096]: 2017-09-28 12:10:54.232 24096 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:10:54 ctl02 nova-api[24096]: 2017-09-28 12:10:54.232 24096 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:10:54 ctl02 nova-api[24096]: 2017-09-28 12:10:54.232 24096 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:10:54 ctl02 nova-api[24096]: 2017-09-28 12:10:54.232 24096 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:10:54 ctl02 nova-api[24096]: 2017-09-28 12:10:54.232 24096 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:10:54 ctl02 nova-api[24096]: 2017-09-28 12:10:54.232 24096 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:10:54 ctl02 nova-api[24096]: 2017-09-28 12:10:54.232 24096 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:10:54 ctl02 nova-api[24096]: 2017-09-28 12:10:54.232 24096 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:10:54 ctl02 nova-api[24096]: 2017-09-28 12:10:54.232 24096 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:10:54 ctl02 nova-api[24096]: 2017-09-28 12:10:54.232 24096 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:10:54 ctl02 nova-api[24096]: 2017-09-28 12:10:54.232 24096 ERROR nova.wsgi     self.filename))
Sep 28 12:10:54 ctl02 nova-api[24096]: 2017-09-28 12:10:54.232 24096 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:10:54 ctl02 nova-api[24096]: 2017-09-28 12:10:54.232 24096 ERROR nova.wsgi
Sep 28 12:10:54 ctl02 nova-api[24096]: 2017-09-28 12:10:54.233 24096 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:10:54 ctl02 heat-api[13008]: 2017-09-28 12:10:54.258 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:10:54] "OPTIONS / HTTP/1.0" 200 134 0.000614
Sep 28 12:10:54 ctl02 glance-api[29183]: 2017-09-28 12:10:54.281 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:10:54] "OPTIONS / HTTP/1.0" 200 134 0.000675
Sep 28 12:10:54 ctl02 nova-consoleauth[5433]: 2017-09-28 12:10:54.291 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:10:54 ctl02 nova-api[24096]: 2017-09-28 12:10:54.371 24096 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:10:54 ctl02 nova-api[24096]: 2017-09-28 12:10:54.622 24096 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:10:54 ctl02 nova-api[24096]: 2017-09-28 12:10:54.625 24096 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:10:54 ctl02 nova-api[24096]: 2017-09-28 12:10:54.625 24096 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:10:54 ctl02 nova-api[24096]: 2017-09-28 12:10:54.625 24096 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:10:54 ctl02 nova-api[24096]: 2017-09-28 12:10:54.758 24096 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:10:54 ctl02 nova-api[24096]: 2017-09-28 12:10:54.761 24096 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:10:54 ctl02 nova-api[24096]: 2017-09-28 12:10:54.761 24096 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:10:54 ctl02 nova-api[24096]: 2017-09-28 12:10:54.761 24096 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:10:54 ctl02 nova-api[24096]: 2017-09-28 12:10:54.764 24096 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:10:54 ctl02 nova-api[24096]: 2017-09-28 12:10:54.765 24096 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:10:54 ctl02 nova-api[24096]: 2017-09-28 12:10:54.765 24096 ERROR nova Traceback (most recent call last):
Sep 28 12:10:54 ctl02 nova-api[24096]: 2017-09-28 12:10:54.765 24096 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:10:54 ctl02 nova-api[24096]: 2017-09-28 12:10:54.765 24096 ERROR nova     sys.exit(main())
Sep 28 12:10:54 ctl02 nova-api[24096]: 2017-09-28 12:10:54.765 24096 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:10:54 ctl02 nova-api[24096]: 2017-09-28 12:10:54.765 24096 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:10:54 ctl02 nova-api[24096]: 2017-09-28 12:10:54.765 24096 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:10:54 ctl02 nova-api[24096]: 2017-09-28 12:10:54.765 24096 ERROR nova     max_url_len=max_url_len)
Sep 28 12:10:54 ctl02 nova-api[24096]: 2017-09-28 12:10:54.765 24096 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:10:54 ctl02 nova-api[24096]: 2017-09-28 12:10:54.765 24096 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:10:54 ctl02 nova-api[24096]: 2017-09-28 12:10:54.765 24096 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:10:54 ctl02 nova-api[24096]: 2017-09-28 12:10:54.765 24096 ERROR nova     sock.listen(backlog)
Sep 28 12:10:54 ctl02 nova-api[24096]: 2017-09-28 12:10:54.765 24096 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:10:54 ctl02 nova-api[24096]: 2017-09-28 12:10:54.765 24096 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:10:54 ctl02 nova-api[24096]: 2017-09-28 12:10:54.765 24096 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:10:54 ctl02 nova-api[24096]: 2017-09-28 12:10:54.765 24096 ERROR nova
Sep 28 12:10:54 ctl02 heat-api[13008]: 2017-09-28 12:10:54.825 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:10:54] "OPTIONS / HTTP/1.0" 200 134 0.000633
Sep 28 12:10:54 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:10:54 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:10:54 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:10:55 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:10:55 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:10:55 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:10:55 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:10:56 ctl02 glance-api[29183]: 2017-09-28 12:10:56.023 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:10:56] "OPTIONS / HTTP/1.0" 200 134 0.001043
Sep 28 12:10:56 ctl02 nova-api[24114]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:10:56 ctl02 nova-api[24114]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:10:56 ctl02 nova-api[24114]: 2017-09-28 12:10:56.991 24114 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:10:56 ctl02 nova-api[24114]: 2017-09-28 12:10:56.993 24114 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:10:56 ctl02 nova-api[24114]: 2017-09-28 12:10:56.993 24114 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:10:56 ctl02 nova-api[24114]: 2017-09-28 12:10:56.993 24114 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:10:56 ctl02 nova-api[24114]: 2017-09-28 12:10:56.993 24114 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:10:56 ctl02 nova-api[24114]: 2017-09-28 12:10:56.993 24114 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:10:56 ctl02 nova-api[24114]: 2017-09-28 12:10:56.993 24114 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:10:56 ctl02 nova-api[24114]: 2017-09-28 12:10:56.993 24114 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:10:56 ctl02 nova-api[24114]: 2017-09-28 12:10:56.993 24114 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:10:56 ctl02 nova-api[24114]: 2017-09-28 12:10:56.993 24114 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:10:56 ctl02 nova-api[24114]: 2017-09-28 12:10:56.993 24114 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:10:56 ctl02 nova-api[24114]: 2017-09-28 12:10:56.993 24114 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:10:56 ctl02 nova-api[24114]: 2017-09-28 12:10:56.993 24114 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:10:56 ctl02 nova-api[24114]: 2017-09-28 12:10:56.993 24114 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:10:56 ctl02 nova-api[24114]: 2017-09-28 12:10:56.993 24114 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:10:56 ctl02 nova-api[24114]: 2017-09-28 12:10:56.993 24114 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:10:56 ctl02 nova-api[24114]: 2017-09-28 12:10:56.993 24114 ERROR nova.wsgi     self.filename))
Sep 28 12:10:56 ctl02 nova-api[24114]: 2017-09-28 12:10:56.993 24114 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:10:56 ctl02 nova-api[24114]: 2017-09-28 12:10:56.993 24114 ERROR nova.wsgi
Sep 28 12:10:56 ctl02 nova-api[24114]: 2017-09-28 12:10:56.994 24114 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:10:57 ctl02 nova-api[24114]: 2017-09-28 12:10:57.126 24114 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:10:57 ctl02 nova-scheduler[5620]: 2017-09-28 12:10:57.310 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:10:57 ctl02 nova-api[24114]: 2017-09-28 12:10:57.376 24114 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:10:57 ctl02 nova-api[24114]: 2017-09-28 12:10:57.379 24114 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:10:57 ctl02 nova-api[24114]: 2017-09-28 12:10:57.379 24114 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:10:57 ctl02 nova-api[24114]: 2017-09-28 12:10:57.379 24114 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:10:57 ctl02 heat-engine[12803]: 2017-09-28 12:10:57.480 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:10:57 ctl02 heat-engine[12803]: 2017-09-28 12:10:57.509 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:10:57 ctl02 nova-api[24114]: 2017-09-28 12:10:57.519 24114 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:10:57 ctl02 nova-api[24114]: 2017-09-28 12:10:57.521 24114 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:10:57 ctl02 nova-api[24114]: 2017-09-28 12:10:57.521 24114 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:10:57 ctl02 nova-api[24114]: 2017-09-28 12:10:57.522 24114 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:10:57 ctl02 heat-engine[12803]: 2017-09-28 12:10:57.524 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:10:57 ctl02 nova-api[24114]: 2017-09-28 12:10:57.526 24114 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:10:57 ctl02 nova-api[24114]: 2017-09-28 12:10:57.526 24114 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:10:57 ctl02 nova-api[24114]: 2017-09-28 12:10:57.526 24114 ERROR nova Traceback (most recent call last):
Sep 28 12:10:57 ctl02 nova-api[24114]: 2017-09-28 12:10:57.526 24114 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:10:57 ctl02 nova-api[24114]: 2017-09-28 12:10:57.526 24114 ERROR nova     sys.exit(main())
Sep 28 12:10:57 ctl02 nova-api[24114]: 2017-09-28 12:10:57.526 24114 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:10:57 ctl02 nova-api[24114]: 2017-09-28 12:10:57.526 24114 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:10:57 ctl02 nova-api[24114]: 2017-09-28 12:10:57.526 24114 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:10:57 ctl02 nova-api[24114]: 2017-09-28 12:10:57.526 24114 ERROR nova     max_url_len=max_url_len)
Sep 28 12:10:57 ctl02 nova-api[24114]: 2017-09-28 12:10:57.526 24114 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:10:57 ctl02 nova-api[24114]: 2017-09-28 12:10:57.526 24114 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:10:57 ctl02 nova-api[24114]: 2017-09-28 12:10:57.526 24114 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:10:57 ctl02 nova-api[24114]: 2017-09-28 12:10:57.526 24114 ERROR nova     sock.listen(backlog)
Sep 28 12:10:57 ctl02 nova-api[24114]: 2017-09-28 12:10:57.526 24114 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:10:57 ctl02 nova-api[24114]: 2017-09-28 12:10:57.526 24114 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:10:57 ctl02 nova-api[24114]: 2017-09-28 12:10:57.526 24114 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:10:57 ctl02 nova-api[24114]: 2017-09-28 12:10:57.526 24114 ERROR nova
Sep 28 12:10:57 ctl02 heat-engine[12803]: 2017-09-28 12:10:57.533 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:10:57 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:10:57 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:10:57 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:10:57 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:10:57 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:10:57 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:10:57 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:10:57 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:10:57.994 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:10:57] "OPTIONS / HTTP/1.0" 200 134 0.000558
Sep 28 12:10:58 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:10:58.153 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:10:58] "OPTIONS / HTTP/1.0" 200 134 0.000371
Sep 28 12:10:58 ctl02 heat-api[13008]: 2017-09-28 12:10:58.228 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:10:58] "OPTIONS / HTTP/1.0" 200 134 0.000637
Sep 28 12:10:58 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9a032d7e)
Sep 28 12:10:59 ctl02 nova-api[24130]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:10:59 ctl02 nova-api[24130]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:10:59 ctl02 nova-api[24130]: 2017-09-28 12:10:59.794 24130 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:10:59 ctl02 nova-api[24130]: 2017-09-28 12:10:59.796 24130 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:10:59 ctl02 nova-api[24130]: 2017-09-28 12:10:59.796 24130 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:10:59 ctl02 nova-api[24130]: 2017-09-28 12:10:59.796 24130 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:10:59 ctl02 nova-api[24130]: 2017-09-28 12:10:59.796 24130 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:10:59 ctl02 nova-api[24130]: 2017-09-28 12:10:59.796 24130 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:10:59 ctl02 nova-api[24130]: 2017-09-28 12:10:59.796 24130 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:10:59 ctl02 nova-api[24130]: 2017-09-28 12:10:59.796 24130 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:10:59 ctl02 nova-api[24130]: 2017-09-28 12:10:59.796 24130 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:10:59 ctl02 nova-api[24130]: 2017-09-28 12:10:59.796 24130 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:10:59 ctl02 nova-api[24130]: 2017-09-28 12:10:59.796 24130 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:10:59 ctl02 nova-api[24130]: 2017-09-28 12:10:59.796 24130 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:10:59 ctl02 nova-api[24130]: 2017-09-28 12:10:59.796 24130 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:10:59 ctl02 nova-api[24130]: 2017-09-28 12:10:59.796 24130 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:10:59 ctl02 nova-api[24130]: 2017-09-28 12:10:59.796 24130 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:10:59 ctl02 nova-api[24130]: 2017-09-28 12:10:59.796 24130 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:10:59 ctl02 nova-api[24130]: 2017-09-28 12:10:59.796 24130 ERROR nova.wsgi     self.filename))
Sep 28 12:10:59 ctl02 nova-api[24130]: 2017-09-28 12:10:59.796 24130 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:10:59 ctl02 nova-api[24130]: 2017-09-28 12:10:59.796 24130 ERROR nova.wsgi
Sep 28 12:10:59 ctl02 nova-api[24130]: 2017-09-28 12:10:59.797 24130 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:10:59 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9a032d7e)
Sep 28 12:10:59 ctl02 nova-api[24130]: 2017-09-28 12:10:59.932 24130 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:10:59 ctl02 glance-api[29183]: 2017-09-28 12:10:59.940 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:10:59] "OPTIONS / HTTP/1.0" 200 134 0.000678
Sep 28 12:11:00 ctl02 nova-api[24130]: 2017-09-28 12:11:00.187 24130 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:11:00 ctl02 nova-api[24130]: 2017-09-28 12:11:00.190 24130 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:11:00 ctl02 nova-api[24130]: 2017-09-28 12:11:00.190 24130 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:11:00 ctl02 nova-api[24130]: 2017-09-28 12:11:00.190 24130 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:11:00 ctl02 nova-api[24130]: 2017-09-28 12:11:00.329 24130 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:11:00 ctl02 nova-api[24130]: 2017-09-28 12:11:00.331 24130 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:11:00 ctl02 nova-api[24130]: 2017-09-28 12:11:00.331 24130 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:11:00 ctl02 nova-api[24130]: 2017-09-28 12:11:00.331 24130 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:11:00 ctl02 nova-api[24130]: 2017-09-28 12:11:00.335 24130 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:11:00 ctl02 nova-api[24130]: 2017-09-28 12:11:00.335 24130 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:11:00 ctl02 nova-api[24130]: 2017-09-28 12:11:00.335 24130 ERROR nova Traceback (most recent call last):
Sep 28 12:11:00 ctl02 nova-api[24130]: 2017-09-28 12:11:00.335 24130 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:11:00 ctl02 nova-api[24130]: 2017-09-28 12:11:00.335 24130 ERROR nova     sys.exit(main())
Sep 28 12:11:00 ctl02 nova-api[24130]: 2017-09-28 12:11:00.335 24130 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:11:00 ctl02 nova-api[24130]: 2017-09-28 12:11:00.335 24130 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:11:00 ctl02 nova-api[24130]: 2017-09-28 12:11:00.335 24130 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:11:00 ctl02 nova-api[24130]: 2017-09-28 12:11:00.335 24130 ERROR nova     max_url_len=max_url_len)
Sep 28 12:11:00 ctl02 nova-api[24130]: 2017-09-28 12:11:00.335 24130 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:11:00 ctl02 nova-api[24130]: 2017-09-28 12:11:00.335 24130 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:11:00 ctl02 nova-api[24130]: 2017-09-28 12:11:00.335 24130 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:11:00 ctl02 nova-api[24130]: 2017-09-28 12:11:00.335 24130 ERROR nova     sock.listen(backlog)
Sep 28 12:11:00 ctl02 nova-api[24130]: 2017-09-28 12:11:00.335 24130 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:11:00 ctl02 nova-api[24130]: 2017-09-28 12:11:00.335 24130 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:11:00 ctl02 nova-api[24130]: 2017-09-28 12:11:00.335 24130 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:11:00 ctl02 nova-api[24130]: 2017-09-28 12:11:00.335 24130 ERROR nova
Sep 28 12:11:00 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:11:00 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:11:00 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:11:00 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:11:00 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:11:00 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:11:00 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:11:00 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9a032d7e)
Sep 28 12:11:00 ctl02 heat-api-cfn[13300]: 2017-09-28 12:11:00.906 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:11:00] "OPTIONS / HTTP/1.0" 200 134 0.000538
Sep 28 12:11:01 ctl02 heat-api-cfn[13300]: 2017-09-28 12:11:01.078 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:11:01] "OPTIONS / HTTP/1.0" 200 134 0.000535
Sep 28 12:11:01 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9a032d7e)
Sep 28 12:11:02 ctl02 nova-api[24150]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:11:02 ctl02 nova-api[24150]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:11:02 ctl02 nova-api[24150]: 2017-09-28 12:11:02.487 24150 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:11:02 ctl02 nova-api[24150]: 2017-09-28 12:11:02.489 24150 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:11:02 ctl02 nova-api[24150]: 2017-09-28 12:11:02.489 24150 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:11:02 ctl02 nova-api[24150]: 2017-09-28 12:11:02.489 24150 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:11:02 ctl02 nova-api[24150]: 2017-09-28 12:11:02.489 24150 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:11:02 ctl02 nova-api[24150]: 2017-09-28 12:11:02.489 24150 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:11:02 ctl02 nova-api[24150]: 2017-09-28 12:11:02.489 24150 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:11:02 ctl02 nova-api[24150]: 2017-09-28 12:11:02.489 24150 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:11:02 ctl02 nova-api[24150]: 2017-09-28 12:11:02.489 24150 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:11:02 ctl02 nova-api[24150]: 2017-09-28 12:11:02.489 24150 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:11:02 ctl02 nova-api[24150]: 2017-09-28 12:11:02.489 24150 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:11:02 ctl02 nova-api[24150]: 2017-09-28 12:11:02.489 24150 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:11:02 ctl02 nova-api[24150]: 2017-09-28 12:11:02.489 24150 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:11:02 ctl02 nova-api[24150]: 2017-09-28 12:11:02.489 24150 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:11:02 ctl02 nova-api[24150]: 2017-09-28 12:11:02.489 24150 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:11:02 ctl02 nova-api[24150]: 2017-09-28 12:11:02.489 24150 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:11:02 ctl02 nova-api[24150]: 2017-09-28 12:11:02.489 24150 ERROR nova.wsgi     self.filename))
Sep 28 12:11:02 ctl02 nova-api[24150]: 2017-09-28 12:11:02.489 24150 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:11:02 ctl02 nova-api[24150]: 2017-09-28 12:11:02.489 24150 ERROR nova.wsgi
Sep 28 12:11:02 ctl02 nova-api[24150]: 2017-09-28 12:11:02.490 24150 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:11:02 ctl02 nova-api[24150]: 2017-09-28 12:11:02.626 24150 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:11:02 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:11:02.805 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:11:02] "OPTIONS / HTTP/1.0" 200 134 0.000492
Sep 28 12:11:02 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9a032d7e)
Sep 28 12:11:02 ctl02 nova-api[24150]: 2017-09-28 12:11:02.879 24150 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:11:02 ctl02 nova-api[24150]: 2017-09-28 12:11:02.881 24150 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:11:02 ctl02 nova-api[24150]: 2017-09-28 12:11:02.881 24150 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:11:02 ctl02 nova-api[24150]: 2017-09-28 12:11:02.882 24150 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:11:03 ctl02 nova-api[24150]: 2017-09-28 12:11:03.017 24150 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:11:03 ctl02 nova-api[24150]: 2017-09-28 12:11:03.019 24150 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:11:03 ctl02 nova-api[24150]: 2017-09-28 12:11:03.019 24150 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:11:03 ctl02 nova-api[24150]: 2017-09-28 12:11:03.020 24150 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:11:03 ctl02 nova-api[24150]: 2017-09-28 12:11:03.023 24150 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:11:03 ctl02 nova-api[24150]: 2017-09-28 12:11:03.023 24150 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:11:03 ctl02 nova-api[24150]: 2017-09-28 12:11:03.023 24150 ERROR nova Traceback (most recent call last):
Sep 28 12:11:03 ctl02 nova-api[24150]: 2017-09-28 12:11:03.023 24150 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:11:03 ctl02 nova-api[24150]: 2017-09-28 12:11:03.023 24150 ERROR nova     sys.exit(main())
Sep 28 12:11:03 ctl02 nova-api[24150]: 2017-09-28 12:11:03.023 24150 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:11:03 ctl02 nova-api[24150]: 2017-09-28 12:11:03.023 24150 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:11:03 ctl02 nova-api[24150]: 2017-09-28 12:11:03.023 24150 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:11:03 ctl02 nova-api[24150]: 2017-09-28 12:11:03.023 24150 ERROR nova     max_url_len=max_url_len)
Sep 28 12:11:03 ctl02 nova-api[24150]: 2017-09-28 12:11:03.023 24150 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:11:03 ctl02 nova-api[24150]: 2017-09-28 12:11:03.023 24150 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:11:03 ctl02 nova-api[24150]: 2017-09-28 12:11:03.023 24150 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:11:03 ctl02 nova-api[24150]: 2017-09-28 12:11:03.023 24150 ERROR nova     sock.listen(backlog)
Sep 28 12:11:03 ctl02 nova-api[24150]: 2017-09-28 12:11:03.023 24150 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:11:03 ctl02 nova-api[24150]: 2017-09-28 12:11:03.023 24150 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:11:03 ctl02 nova-api[24150]: 2017-09-28 12:11:03.023 24150 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:11:03 ctl02 nova-api[24150]: 2017-09-28 12:11:03.023 24150 ERROR nova
Sep 28 12:11:03 ctl02 heat-api-cfn[13300]: 2017-09-28 12:11:03.146 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:11:03] "OPTIONS / HTTP/1.0" 200 134 0.000536
Sep 28 12:11:03 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:11:03 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:11:03 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:11:03 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:11:03 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:11:03 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:11:03 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:11:03 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9a032d7e)
Sep 28 12:11:04 ctl02 heat-api[13008]: 2017-09-28 12:11:04.084 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:11:04] "OPTIONS / HTTP/1.0" 200 134 0.000592
Sep 28 12:11:04 ctl02 glance-api[29183]: 2017-09-28 12:11:04.312 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:11:04] "OPTIONS / HTTP/1.0" 200 134 0.000678
Sep 28 12:11:04 ctl02 heat-api[13008]: 2017-09-28 12:11:04.725 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:11:04] "OPTIONS / HTTP/1.0" 200 134 0.000622
Sep 28 12:11:04 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9a032d7e)
Sep 28 12:11:05 ctl02 nova-api[24168]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:11:05 ctl02 nova-api[24168]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:11:05 ctl02 nova-api[24168]: 2017-09-28 12:11:05.238 24168 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:11:05 ctl02 nova-api[24168]: 2017-09-28 12:11:05.240 24168 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:11:05 ctl02 nova-api[24168]: 2017-09-28 12:11:05.240 24168 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:11:05 ctl02 nova-api[24168]: 2017-09-28 12:11:05.240 24168 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:11:05 ctl02 nova-api[24168]: 2017-09-28 12:11:05.240 24168 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:11:05 ctl02 nova-api[24168]: 2017-09-28 12:11:05.240 24168 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:11:05 ctl02 nova-api[24168]: 2017-09-28 12:11:05.240 24168 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:11:05 ctl02 nova-api[24168]: 2017-09-28 12:11:05.240 24168 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:11:05 ctl02 nova-api[24168]: 2017-09-28 12:11:05.240 24168 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:11:05 ctl02 nova-api[24168]: 2017-09-28 12:11:05.240 24168 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:11:05 ctl02 nova-api[24168]: 2017-09-28 12:11:05.240 24168 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:11:05 ctl02 nova-api[24168]: 2017-09-28 12:11:05.240 24168 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:11:05 ctl02 nova-api[24168]: 2017-09-28 12:11:05.240 24168 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:11:05 ctl02 nova-api[24168]: 2017-09-28 12:11:05.240 24168 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:11:05 ctl02 nova-api[24168]: 2017-09-28 12:11:05.240 24168 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:11:05 ctl02 nova-api[24168]: 2017-09-28 12:11:05.240 24168 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:11:05 ctl02 nova-api[24168]: 2017-09-28 12:11:05.240 24168 ERROR nova.wsgi     self.filename))
Sep 28 12:11:05 ctl02 nova-api[24168]: 2017-09-28 12:11:05.240 24168 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:11:05 ctl02 nova-api[24168]: 2017-09-28 12:11:05.240 24168 ERROR nova.wsgi
Sep 28 12:11:05 ctl02 nova-api[24168]: 2017-09-28 12:11:05.242 24168 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:11:05 ctl02 nova-api[24168]: 2017-09-28 12:11:05.376 24168 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:11:05 ctl02 nova-api[24168]: 2017-09-28 12:11:05.625 24168 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:11:05 ctl02 nova-api[24168]: 2017-09-28 12:11:05.628 24168 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:11:05 ctl02 nova-api[24168]: 2017-09-28 12:11:05.628 24168 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:11:05 ctl02 nova-api[24168]: 2017-09-28 12:11:05.628 24168 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:11:05 ctl02 nova-api[24168]: 2017-09-28 12:11:05.760 24168 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:11:05 ctl02 nova-api[24168]: 2017-09-28 12:11:05.762 24168 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:11:05 ctl02 nova-api[24168]: 2017-09-28 12:11:05.763 24168 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:11:05 ctl02 nova-api[24168]: 2017-09-28 12:11:05.763 24168 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:11:05 ctl02 nova-api[24168]: 2017-09-28 12:11:05.767 24168 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:11:05 ctl02 nova-api[24168]: 2017-09-28 12:11:05.767 24168 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:11:05 ctl02 nova-api[24168]: 2017-09-28 12:11:05.767 24168 ERROR nova Traceback (most recent call last):
Sep 28 12:11:05 ctl02 nova-api[24168]: 2017-09-28 12:11:05.767 24168 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:11:05 ctl02 nova-api[24168]: 2017-09-28 12:11:05.767 24168 ERROR nova     sys.exit(main())
Sep 28 12:11:05 ctl02 nova-api[24168]: 2017-09-28 12:11:05.767 24168 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:11:05 ctl02 nova-api[24168]: 2017-09-28 12:11:05.767 24168 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:11:05 ctl02 nova-api[24168]: 2017-09-28 12:11:05.767 24168 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:11:05 ctl02 nova-api[24168]: 2017-09-28 12:11:05.767 24168 ERROR nova     max_url_len=max_url_len)
Sep 28 12:11:05 ctl02 nova-api[24168]: 2017-09-28 12:11:05.767 24168 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:11:05 ctl02 nova-api[24168]: 2017-09-28 12:11:05.767 24168 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:11:05 ctl02 nova-api[24168]: 2017-09-28 12:11:05.767 24168 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:11:05 ctl02 nova-api[24168]: 2017-09-28 12:11:05.767 24168 ERROR nova     sock.listen(backlog)
Sep 28 12:11:05 ctl02 nova-api[24168]: 2017-09-28 12:11:05.767 24168 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:11:05 ctl02 nova-api[24168]: 2017-09-28 12:11:05.767 24168 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:11:05 ctl02 nova-api[24168]: 2017-09-28 12:11:05.767 24168 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:11:05 ctl02 nova-api[24168]: 2017-09-28 12:11:05.767 24168 ERROR nova
Sep 28 12:11:05 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9a032d7e)
Sep 28 12:11:05 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:11:05 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:11:05 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:11:06 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:11:06 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:11:06 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:11:06 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:11:06 ctl02 glance-api[29183]: 2017-09-28 12:11:06.337 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:11:06] "OPTIONS / HTTP/1.0" 200 134 0.000888
Sep 28 12:11:06 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9a032d7e)
Sep 28 12:11:07 ctl02 nova-api[24186]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:11:07 ctl02 nova-api[24186]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:11:07 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:11:07.800 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:11:07] "OPTIONS / HTTP/1.0" 200 134 0.000545
Sep 28 12:11:07 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9a032d7e)
Sep 28 12:11:07 ctl02 nova-api[24186]: 2017-09-28 12:11:07.983 24186 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:11:07 ctl02 nova-api[24186]: 2017-09-28 12:11:07.985 24186 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:11:07 ctl02 nova-api[24186]: 2017-09-28 12:11:07.985 24186 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:11:07 ctl02 nova-api[24186]: 2017-09-28 12:11:07.985 24186 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:11:07 ctl02 nova-api[24186]: 2017-09-28 12:11:07.985 24186 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:11:07 ctl02 nova-api[24186]: 2017-09-28 12:11:07.985 24186 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:11:07 ctl02 nova-api[24186]: 2017-09-28 12:11:07.985 24186 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:11:07 ctl02 nova-api[24186]: 2017-09-28 12:11:07.985 24186 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:11:07 ctl02 nova-api[24186]: 2017-09-28 12:11:07.985 24186 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:11:07 ctl02 nova-api[24186]: 2017-09-28 12:11:07.985 24186 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:11:07 ctl02 nova-api[24186]: 2017-09-28 12:11:07.985 24186 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:11:07 ctl02 nova-api[24186]: 2017-09-28 12:11:07.985 24186 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:11:07 ctl02 nova-api[24186]: 2017-09-28 12:11:07.985 24186 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:11:07 ctl02 nova-api[24186]: 2017-09-28 12:11:07.985 24186 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:11:07 ctl02 nova-api[24186]: 2017-09-28 12:11:07.985 24186 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:11:07 ctl02 nova-api[24186]: 2017-09-28 12:11:07.985 24186 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:11:07 ctl02 nova-api[24186]: 2017-09-28 12:11:07.985 24186 ERROR nova.wsgi     self.filename))
Sep 28 12:11:07 ctl02 nova-api[24186]: 2017-09-28 12:11:07.985 24186 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:11:07 ctl02 nova-api[24186]: 2017-09-28 12:11:07.985 24186 ERROR nova.wsgi
Sep 28 12:11:07 ctl02 nova-api[24186]: 2017-09-28 12:11:07.986 24186 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:11:08 ctl02 nova-api[24186]: 2017-09-28 12:11:08.120 24186 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:11:08 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:11:08.183 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:11:08] "OPTIONS / HTTP/1.0" 200 134 0.000500
Sep 28 12:11:08 ctl02 heat-api[13008]: 2017-09-28 12:11:08.272 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:11:08] "OPTIONS / HTTP/1.0" 200 134 0.000624
Sep 28 12:11:08 ctl02 nova-api[24186]: 2017-09-28 12:11:08.375 24186 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:11:08 ctl02 nova-api[24186]: 2017-09-28 12:11:08.377 24186 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:11:08 ctl02 nova-api[24186]: 2017-09-28 12:11:08.394 24186 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:11:08 ctl02 nova-api[24186]: 2017-09-28 12:11:08.394 24186 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:11:08 ctl02 nova-api[24186]: 2017-09-28 12:11:08.528 24186 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:11:08 ctl02 nova-api[24186]: 2017-09-28 12:11:08.530 24186 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:11:08 ctl02 nova-api[24186]: 2017-09-28 12:11:08.530 24186 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:11:08 ctl02 nova-api[24186]: 2017-09-28 12:11:08.530 24186 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:11:08 ctl02 nova-api[24186]: 2017-09-28 12:11:08.534 24186 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:11:08 ctl02 nova-api[24186]: 2017-09-28 12:11:08.534 24186 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:11:08 ctl02 nova-api[24186]: 2017-09-28 12:11:08.534 24186 ERROR nova Traceback (most recent call last):
Sep 28 12:11:08 ctl02 nova-api[24186]: 2017-09-28 12:11:08.534 24186 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:11:08 ctl02 nova-api[24186]: 2017-09-28 12:11:08.534 24186 ERROR nova     sys.exit(main())
Sep 28 12:11:08 ctl02 nova-api[24186]: 2017-09-28 12:11:08.534 24186 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:11:08 ctl02 nova-api[24186]: 2017-09-28 12:11:08.534 24186 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:11:08 ctl02 nova-api[24186]: 2017-09-28 12:11:08.534 24186 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:11:08 ctl02 nova-api[24186]: 2017-09-28 12:11:08.534 24186 ERROR nova     max_url_len=max_url_len)
Sep 28 12:11:08 ctl02 nova-api[24186]: 2017-09-28 12:11:08.534 24186 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:11:08 ctl02 nova-api[24186]: 2017-09-28 12:11:08.534 24186 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:11:08 ctl02 nova-api[24186]: 2017-09-28 12:11:08.534 24186 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:11:08 ctl02 nova-api[24186]: 2017-09-28 12:11:08.534 24186 ERROR nova     sock.listen(backlog)
Sep 28 12:11:08 ctl02 nova-api[24186]: 2017-09-28 12:11:08.534 24186 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:11:08 ctl02 nova-api[24186]: 2017-09-28 12:11:08.534 24186 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:11:08 ctl02 nova-api[24186]: 2017-09-28 12:11:08.534 24186 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:11:08 ctl02 nova-api[24186]: 2017-09-28 12:11:08.534 24186 ERROR nova
Sep 28 12:11:08 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:11:08 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:11:08 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:11:08 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9a032d7e)
Sep 28 12:11:08 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:11:08 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:11:08 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:11:08 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:11:09 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:11:09 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:11:09 ctl02 glance-api[29183]: 2017-09-28 12:11:09.891 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:11:09] "OPTIONS / HTTP/1.0" 200 134 0.000632
Sep 28 12:11:10 ctl02 nova-api[24203]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:11:10 ctl02 nova-api[24203]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:11:10 ctl02 heat-api-cfn[13300]: 2017-09-28 12:11:10.564 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:11:10] "OPTIONS / HTTP/1.0" 200 134 0.000622
Sep 28 12:11:10 ctl02 nova-api[24203]: 2017-09-28 12:11:10.753 24203 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:11:10 ctl02 nova-api[24203]: 2017-09-28 12:11:10.755 24203 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:11:10 ctl02 nova-api[24203]: 2017-09-28 12:11:10.755 24203 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:11:10 ctl02 nova-api[24203]: 2017-09-28 12:11:10.755 24203 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:11:10 ctl02 nova-api[24203]: 2017-09-28 12:11:10.755 24203 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:11:10 ctl02 nova-api[24203]: 2017-09-28 12:11:10.755 24203 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:11:10 ctl02 nova-api[24203]: 2017-09-28 12:11:10.755 24203 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:11:10 ctl02 nova-api[24203]: 2017-09-28 12:11:10.755 24203 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:11:10 ctl02 nova-api[24203]: 2017-09-28 12:11:10.755 24203 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:11:10 ctl02 nova-api[24203]: 2017-09-28 12:11:10.755 24203 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:11:10 ctl02 nova-api[24203]: 2017-09-28 12:11:10.755 24203 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:11:10 ctl02 nova-api[24203]: 2017-09-28 12:11:10.755 24203 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:11:10 ctl02 nova-api[24203]: 2017-09-28 12:11:10.755 24203 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:11:10 ctl02 nova-api[24203]: 2017-09-28 12:11:10.755 24203 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:11:10 ctl02 nova-api[24203]: 2017-09-28 12:11:10.755 24203 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:11:10 ctl02 nova-api[24203]: 2017-09-28 12:11:10.755 24203 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:11:10 ctl02 nova-api[24203]: 2017-09-28 12:11:10.755 24203 ERROR nova.wsgi     self.filename))
Sep 28 12:11:10 ctl02 nova-api[24203]: 2017-09-28 12:11:10.755 24203 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:11:10 ctl02 nova-api[24203]: 2017-09-28 12:11:10.755 24203 ERROR nova.wsgi
Sep 28 12:11:10 ctl02 nova-api[24203]: 2017-09-28 12:11:10.756 24203 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:11:10 ctl02 nova-api[24203]: 2017-09-28 12:11:10.890 24203 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:11:11 ctl02 nova-api[24203]: 2017-09-28 12:11:11.145 24203 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:11:11 ctl02 nova-api[24203]: 2017-09-28 12:11:11.147 24203 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:11:11 ctl02 nova-api[24203]: 2017-09-28 12:11:11.147 24203 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:11:11 ctl02 nova-api[24203]: 2017-09-28 12:11:11.148 24203 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:11:11 ctl02 heat-api-cfn[13300]: 2017-09-28 12:11:11.268 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:11:11] "OPTIONS / HTTP/1.0" 200 134 0.000522
Sep 28 12:11:11 ctl02 nova-api[24203]: 2017-09-28 12:11:11.282 24203 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:11:11 ctl02 nova-api[24203]: 2017-09-28 12:11:11.284 24203 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:11:11 ctl02 nova-api[24203]: 2017-09-28 12:11:11.284 24203 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:11:11 ctl02 nova-api[24203]: 2017-09-28 12:11:11.284 24203 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:11:11 ctl02 nova-api[24203]: 2017-09-28 12:11:11.287 24203 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:11:11 ctl02 nova-api[24203]: 2017-09-28 12:11:11.288 24203 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:11:11 ctl02 nova-api[24203]: 2017-09-28 12:11:11.288 24203 ERROR nova Traceback (most recent call last):
Sep 28 12:11:11 ctl02 nova-api[24203]: 2017-09-28 12:11:11.288 24203 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:11:11 ctl02 nova-api[24203]: 2017-09-28 12:11:11.288 24203 ERROR nova     sys.exit(main())
Sep 28 12:11:11 ctl02 nova-api[24203]: 2017-09-28 12:11:11.288 24203 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:11:11 ctl02 nova-api[24203]: 2017-09-28 12:11:11.288 24203 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:11:11 ctl02 nova-api[24203]: 2017-09-28 12:11:11.288 24203 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:11:11 ctl02 nova-api[24203]: 2017-09-28 12:11:11.288 24203 ERROR nova     max_url_len=max_url_len)
Sep 28 12:11:11 ctl02 nova-api[24203]: 2017-09-28 12:11:11.288 24203 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:11:11 ctl02 nova-api[24203]: 2017-09-28 12:11:11.288 24203 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:11:11 ctl02 nova-api[24203]: 2017-09-28 12:11:11.288 24203 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:11:11 ctl02 nova-api[24203]: 2017-09-28 12:11:11.288 24203 ERROR nova     sock.listen(backlog)
Sep 28 12:11:11 ctl02 nova-api[24203]: 2017-09-28 12:11:11.288 24203 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:11:11 ctl02 nova-api[24203]: 2017-09-28 12:11:11.288 24203 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:11:11 ctl02 nova-api[24203]: 2017-09-28 12:11:11.288 24203 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:11:11 ctl02 nova-api[24203]: 2017-09-28 12:11:11.288 24203 ERROR nova
Sep 28 12:11:11 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:11:11 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:11:11 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:11:11 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:11:11 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:11:11 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:11:11 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:11:12 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:11:12.650 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:11:12] "OPTIONS / HTTP/1.0" 200 134 0.000510
Sep 28 12:11:13 ctl02 nova-api[24227]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:11:13 ctl02 nova-api[24227]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:11:13 ctl02 heat-api-cfn[13300]: 2017-09-28 12:11:13.477 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:11:13] "OPTIONS / HTTP/1.0" 200 134 0.000512
Sep 28 12:11:13 ctl02 nova-api[24227]: 2017-09-28 12:11:13.478 24227 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:11:13 ctl02 nova-api[24227]: 2017-09-28 12:11:13.493 24227 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:11:13 ctl02 nova-api[24227]: 2017-09-28 12:11:13.493 24227 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:11:13 ctl02 nova-api[24227]: 2017-09-28 12:11:13.493 24227 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:11:13 ctl02 nova-api[24227]: 2017-09-28 12:11:13.493 24227 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:11:13 ctl02 nova-api[24227]: 2017-09-28 12:11:13.493 24227 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:11:13 ctl02 nova-api[24227]: 2017-09-28 12:11:13.493 24227 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:11:13 ctl02 nova-api[24227]: 2017-09-28 12:11:13.493 24227 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:11:13 ctl02 nova-api[24227]: 2017-09-28 12:11:13.493 24227 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:11:13 ctl02 nova-api[24227]: 2017-09-28 12:11:13.493 24227 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:11:13 ctl02 nova-api[24227]: 2017-09-28 12:11:13.493 24227 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:11:13 ctl02 nova-api[24227]: 2017-09-28 12:11:13.493 24227 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:11:13 ctl02 nova-api[24227]: 2017-09-28 12:11:13.493 24227 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:11:13 ctl02 nova-api[24227]: 2017-09-28 12:11:13.493 24227 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:11:13 ctl02 nova-api[24227]: 2017-09-28 12:11:13.493 24227 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:11:13 ctl02 nova-api[24227]: 2017-09-28 12:11:13.493 24227 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:11:13 ctl02 nova-api[24227]: 2017-09-28 12:11:13.493 24227 ERROR nova.wsgi     self.filename))
Sep 28 12:11:13 ctl02 nova-api[24227]: 2017-09-28 12:11:13.493 24227 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:11:13 ctl02 nova-api[24227]: 2017-09-28 12:11:13.493 24227 ERROR nova.wsgi
Sep 28 12:11:13 ctl02 nova-api[24227]: 2017-09-28 12:11:13.494 24227 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:11:13 ctl02 nova-api[24227]: 2017-09-28 12:11:13.629 24227 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:11:13 ctl02 heat-api[13008]: 2017-09-28 12:11:13.759 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:11:13] "OPTIONS / HTTP/1.0" 200 134 0.000688
Sep 28 12:11:13 ctl02 nova-api[24227]: 2017-09-28 12:11:13.881 24227 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:11:13 ctl02 nova-api[24227]: 2017-09-28 12:11:13.883 24227 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:11:13 ctl02 nova-api[24227]: 2017-09-28 12:11:13.883 24227 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:11:13 ctl02 nova-api[24227]: 2017-09-28 12:11:13.884 24227 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:11:13 ctl02 glance-api[29183]: 2017-09-28 12:11:13.952 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:11:13] "OPTIONS / HTTP/1.0" 200 134 0.000720
Sep 28 12:11:14 ctl02 nova-api[24227]: 2017-09-28 12:11:14.018 24227 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:11:14 ctl02 nova-api[24227]: 2017-09-28 12:11:14.021 24227 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:11:14 ctl02 nova-api[24227]: 2017-09-28 12:11:14.021 24227 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:11:14 ctl02 nova-api[24227]: 2017-09-28 12:11:14.021 24227 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:11:14 ctl02 nova-api[24227]: 2017-09-28 12:11:14.024 24227 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:11:14 ctl02 nova-api[24227]: 2017-09-28 12:11:14.025 24227 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:11:14 ctl02 nova-api[24227]: 2017-09-28 12:11:14.025 24227 ERROR nova Traceback (most recent call last):
Sep 28 12:11:14 ctl02 nova-api[24227]: 2017-09-28 12:11:14.025 24227 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:11:14 ctl02 nova-api[24227]: 2017-09-28 12:11:14.025 24227 ERROR nova     sys.exit(main())
Sep 28 12:11:14 ctl02 nova-api[24227]: 2017-09-28 12:11:14.025 24227 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:11:14 ctl02 nova-api[24227]: 2017-09-28 12:11:14.025 24227 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:11:14 ctl02 nova-api[24227]: 2017-09-28 12:11:14.025 24227 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:11:14 ctl02 nova-api[24227]: 2017-09-28 12:11:14.025 24227 ERROR nova     max_url_len=max_url_len)
Sep 28 12:11:14 ctl02 nova-api[24227]: 2017-09-28 12:11:14.025 24227 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:11:14 ctl02 nova-api[24227]: 2017-09-28 12:11:14.025 24227 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:11:14 ctl02 nova-api[24227]: 2017-09-28 12:11:14.025 24227 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:11:14 ctl02 nova-api[24227]: 2017-09-28 12:11:14.025 24227 ERROR nova     sock.listen(backlog)
Sep 28 12:11:14 ctl02 nova-api[24227]: 2017-09-28 12:11:14.025 24227 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:11:14 ctl02 nova-api[24227]: 2017-09-28 12:11:14.025 24227 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:11:14 ctl02 nova-api[24227]: 2017-09-28 12:11:14.025 24227 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:11:14 ctl02 nova-api[24227]: 2017-09-28 12:11:14.025 24227 ERROR nova
Sep 28 12:11:14 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:11:14 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:11:14 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:11:14 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:11:14 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:11:14 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:11:14 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:11:14 ctl02 heat-api[13008]: 2017-09-28 12:11:14.581 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:11:14] "OPTIONS / HTTP/1.0" 200 134 0.000534
Sep 28 12:11:16 ctl02 nova-api[24245]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:11:16 ctl02 nova-api[24245]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:11:16 ctl02 nova-api[24245]: 2017-09-28 12:11:16.217 24245 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:11:16 ctl02 nova-api[24245]: 2017-09-28 12:11:16.219 24245 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:11:16 ctl02 nova-api[24245]: 2017-09-28 12:11:16.219 24245 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:11:16 ctl02 nova-api[24245]: 2017-09-28 12:11:16.219 24245 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:11:16 ctl02 nova-api[24245]: 2017-09-28 12:11:16.219 24245 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:11:16 ctl02 nova-api[24245]: 2017-09-28 12:11:16.219 24245 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:11:16 ctl02 nova-api[24245]: 2017-09-28 12:11:16.219 24245 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:11:16 ctl02 nova-api[24245]: 2017-09-28 12:11:16.219 24245 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:11:16 ctl02 nova-api[24245]: 2017-09-28 12:11:16.219 24245 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:11:16 ctl02 nova-api[24245]: 2017-09-28 12:11:16.219 24245 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:11:16 ctl02 nova-api[24245]: 2017-09-28 12:11:16.219 24245 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:11:16 ctl02 nova-api[24245]: 2017-09-28 12:11:16.219 24245 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:11:16 ctl02 nova-api[24245]: 2017-09-28 12:11:16.219 24245 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:11:16 ctl02 nova-api[24245]: 2017-09-28 12:11:16.219 24245 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:11:16 ctl02 nova-api[24245]: 2017-09-28 12:11:16.219 24245 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:11:16 ctl02 nova-api[24245]: 2017-09-28 12:11:16.219 24245 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:11:16 ctl02 nova-api[24245]: 2017-09-28 12:11:16.219 24245 ERROR nova.wsgi     self.filename))
Sep 28 12:11:16 ctl02 nova-api[24245]: 2017-09-28 12:11:16.219 24245 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:11:16 ctl02 nova-api[24245]: 2017-09-28 12:11:16.219 24245 ERROR nova.wsgi
Sep 28 12:11:16 ctl02 nova-api[24245]: 2017-09-28 12:11:16.220 24245 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:11:16 ctl02 nova-api[24245]: 2017-09-28 12:11:16.356 24245 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:11:16 ctl02 nova-cert[4860]: 2017-09-28 12:11:16.429 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:11:16 ctl02 nova-api[24245]: 2017-09-28 12:11:16.608 24245 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:11:16 ctl02 nova-api[24245]: 2017-09-28 12:11:16.611 24245 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:11:16 ctl02 nova-api[24245]: 2017-09-28 12:11:16.611 24245 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:11:16 ctl02 nova-api[24245]: 2017-09-28 12:11:16.611 24245 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:11:16 ctl02 glance-api[29183]: 2017-09-28 12:11:16.627 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:11:16] "OPTIONS / HTTP/1.0" 200 134 0.000626
Sep 28 12:11:16 ctl02 nova-api[24245]: 2017-09-28 12:11:16.746 24245 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:11:16 ctl02 nova-api[24245]: 2017-09-28 12:11:16.748 24245 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:11:16 ctl02 nova-api[24245]: 2017-09-28 12:11:16.748 24245 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:11:16 ctl02 nova-api[24245]: 2017-09-28 12:11:16.749 24245 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:11:16 ctl02 nova-api[24245]: 2017-09-28 12:11:16.752 24245 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:11:16 ctl02 nova-api[24245]: 2017-09-28 12:11:16.753 24245 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:11:16 ctl02 nova-api[24245]: 2017-09-28 12:11:16.753 24245 ERROR nova Traceback (most recent call last):
Sep 28 12:11:16 ctl02 nova-api[24245]: 2017-09-28 12:11:16.753 24245 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:11:16 ctl02 nova-api[24245]: 2017-09-28 12:11:16.753 24245 ERROR nova     sys.exit(main())
Sep 28 12:11:16 ctl02 nova-api[24245]: 2017-09-28 12:11:16.753 24245 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:11:16 ctl02 nova-api[24245]: 2017-09-28 12:11:16.753 24245 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:11:16 ctl02 nova-api[24245]: 2017-09-28 12:11:16.753 24245 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:11:16 ctl02 nova-api[24245]: 2017-09-28 12:11:16.753 24245 ERROR nova     max_url_len=max_url_len)
Sep 28 12:11:16 ctl02 nova-api[24245]: 2017-09-28 12:11:16.753 24245 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:11:16 ctl02 nova-api[24245]: 2017-09-28 12:11:16.753 24245 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:11:16 ctl02 nova-api[24245]: 2017-09-28 12:11:16.753 24245 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:11:16 ctl02 nova-api[24245]: 2017-09-28 12:11:16.753 24245 ERROR nova     sock.listen(backlog)
Sep 28 12:11:16 ctl02 nova-api[24245]: 2017-09-28 12:11:16.753 24245 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:11:16 ctl02 nova-api[24245]: 2017-09-28 12:11:16.753 24245 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:11:16 ctl02 nova-api[24245]: 2017-09-28 12:11:16.753 24245 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:11:16 ctl02 nova-api[24245]: 2017-09-28 12:11:16.753 24245 ERROR nova
Sep 28 12:11:16 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:11:16 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:11:16 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:11:17 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:11:17 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:11:17 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:11:17 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:11:17 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:11:17.558 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:11:17] "OPTIONS / HTTP/1.0" 200 134 0.000458
Sep 28 12:11:17 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:11:17.953 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:11:17] "OPTIONS / HTTP/1.0" 200 134 0.000462
Sep 28 12:11:18 ctl02 nova-conductor[5056]: 2017-09-28 12:11:18.426 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:11:18 ctl02 nova-conductor[5056]: 2017-09-28 12:11:18.438 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:11:18 ctl02 nova-conductor[5056]: 2017-09-28 12:11:18.440 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:11:18 ctl02 nova-conductor[5056]: 2017-09-28 12:11:18.447 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:11:18 ctl02 heat-api[13008]: 2017-09-28 12:11:18.633 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:11:18] "OPTIONS / HTTP/1.0" 200 134 0.000620
Sep 28 12:11:18 ctl02 nova-api[24263]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:11:18 ctl02 nova-api[24263]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:11:19 ctl02 nova-api[24263]: 2017-09-28 12:11:19.017 24263 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:11:19 ctl02 nova-api[24263]: 2017-09-28 12:11:19.019 24263 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:11:19 ctl02 nova-api[24263]: 2017-09-28 12:11:19.019 24263 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:11:19 ctl02 nova-api[24263]: 2017-09-28 12:11:19.019 24263 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:11:19 ctl02 nova-api[24263]: 2017-09-28 12:11:19.019 24263 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:11:19 ctl02 nova-api[24263]: 2017-09-28 12:11:19.019 24263 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:11:19 ctl02 nova-api[24263]: 2017-09-28 12:11:19.019 24263 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:11:19 ctl02 nova-api[24263]: 2017-09-28 12:11:19.019 24263 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:11:19 ctl02 nova-api[24263]: 2017-09-28 12:11:19.019 24263 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:11:19 ctl02 nova-api[24263]: 2017-09-28 12:11:19.019 24263 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:11:19 ctl02 nova-api[24263]: 2017-09-28 12:11:19.019 24263 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:11:19 ctl02 nova-api[24263]: 2017-09-28 12:11:19.019 24263 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:11:19 ctl02 nova-api[24263]: 2017-09-28 12:11:19.019 24263 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:11:19 ctl02 nova-api[24263]: 2017-09-28 12:11:19.019 24263 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:11:19 ctl02 nova-api[24263]: 2017-09-28 12:11:19.019 24263 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:11:19 ctl02 nova-api[24263]: 2017-09-28 12:11:19.019 24263 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:11:19 ctl02 nova-api[24263]: 2017-09-28 12:11:19.019 24263 ERROR nova.wsgi     self.filename))
Sep 28 12:11:19 ctl02 nova-api[24263]: 2017-09-28 12:11:19.019 24263 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:11:19 ctl02 nova-api[24263]: 2017-09-28 12:11:19.019 24263 ERROR nova.wsgi
Sep 28 12:11:19 ctl02 nova-api[24263]: 2017-09-28 12:11:19.020 24263 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:11:19 ctl02 nova-api[24263]: 2017-09-28 12:11:19.154 24263 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:11:19 ctl02 nova-api[24263]: 2017-09-28 12:11:19.405 24263 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:11:19 ctl02 nova-api[24263]: 2017-09-28 12:11:19.408 24263 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:11:19 ctl02 nova-api[24263]: 2017-09-28 12:11:19.408 24263 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:11:19 ctl02 nova-api[24263]: 2017-09-28 12:11:19.408 24263 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:11:19 ctl02 nova-api[24263]: 2017-09-28 12:11:19.542 24263 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:11:19 ctl02 nova-api[24263]: 2017-09-28 12:11:19.545 24263 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:11:19 ctl02 nova-api[24263]: 2017-09-28 12:11:19.545 24263 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:11:19 ctl02 nova-api[24263]: 2017-09-28 12:11:19.545 24263 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:11:19 ctl02 nova-api[24263]: 2017-09-28 12:11:19.548 24263 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:11:19 ctl02 nova-api[24263]: 2017-09-28 12:11:19.549 24263 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:11:19 ctl02 nova-api[24263]: 2017-09-28 12:11:19.549 24263 ERROR nova Traceback (most recent call last):
Sep 28 12:11:19 ctl02 nova-api[24263]: 2017-09-28 12:11:19.549 24263 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:11:19 ctl02 nova-api[24263]: 2017-09-28 12:11:19.549 24263 ERROR nova     sys.exit(main())
Sep 28 12:11:19 ctl02 nova-api[24263]: 2017-09-28 12:11:19.549 24263 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:11:19 ctl02 nova-api[24263]: 2017-09-28 12:11:19.549 24263 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:11:19 ctl02 nova-api[24263]: 2017-09-28 12:11:19.549 24263 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:11:19 ctl02 nova-api[24263]: 2017-09-28 12:11:19.549 24263 ERROR nova     max_url_len=max_url_len)
Sep 28 12:11:19 ctl02 nova-api[24263]: 2017-09-28 12:11:19.549 24263 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:11:19 ctl02 nova-api[24263]: 2017-09-28 12:11:19.549 24263 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:11:19 ctl02 nova-api[24263]: 2017-09-28 12:11:19.549 24263 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:11:19 ctl02 nova-api[24263]: 2017-09-28 12:11:19.549 24263 ERROR nova     sock.listen(backlog)
Sep 28 12:11:19 ctl02 nova-api[24263]: 2017-09-28 12:11:19.549 24263 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:11:19 ctl02 nova-api[24263]: 2017-09-28 12:11:19.549 24263 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:11:19 ctl02 nova-api[24263]: 2017-09-28 12:11:19.549 24263 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:11:19 ctl02 nova-api[24263]: 2017-09-28 12:11:19.549 24263 ERROR nova
Sep 28 12:11:19 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:11:19 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:11:19 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:11:19 ctl02 glance-api[29183]: 2017-09-28 12:11:19.824 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:11:19] "OPTIONS / HTTP/1.0" 200 134 0.000736
Sep 28 12:11:19 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:11:19 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:11:19 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:11:19 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:11:20 ctl02 heat-api-cfn[13300]: 2017-09-28 12:11:20.552 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:11:20] "OPTIONS / HTTP/1.0" 200 134 0.000488
Sep 28 12:11:21 ctl02 nova-api[24281]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:11:21 ctl02 nova-api[24281]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:11:21 ctl02 heat-api-cfn[13300]: 2017-09-28 12:11:21.639 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:11:21] "OPTIONS / HTTP/1.0" 200 134 0.000503
Sep 28 12:11:21 ctl02 nova-api[24281]: 2017-09-28 12:11:21.733 24281 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:11:21 ctl02 nova-api[24281]: 2017-09-28 12:11:21.735 24281 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:11:21 ctl02 nova-api[24281]: 2017-09-28 12:11:21.735 24281 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:11:21 ctl02 nova-api[24281]: 2017-09-28 12:11:21.735 24281 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:11:21 ctl02 nova-api[24281]: 2017-09-28 12:11:21.735 24281 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:11:21 ctl02 nova-api[24281]: 2017-09-28 12:11:21.735 24281 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:11:21 ctl02 nova-api[24281]: 2017-09-28 12:11:21.735 24281 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:11:21 ctl02 nova-api[24281]: 2017-09-28 12:11:21.735 24281 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:11:21 ctl02 nova-api[24281]: 2017-09-28 12:11:21.735 24281 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:11:21 ctl02 nova-api[24281]: 2017-09-28 12:11:21.735 24281 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:11:21 ctl02 nova-api[24281]: 2017-09-28 12:11:21.735 24281 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:11:21 ctl02 nova-api[24281]: 2017-09-28 12:11:21.735 24281 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:11:21 ctl02 nova-api[24281]: 2017-09-28 12:11:21.735 24281 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:11:21 ctl02 nova-api[24281]: 2017-09-28 12:11:21.735 24281 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:11:21 ctl02 nova-api[24281]: 2017-09-28 12:11:21.735 24281 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:11:21 ctl02 nova-api[24281]: 2017-09-28 12:11:21.735 24281 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:11:21 ctl02 nova-api[24281]: 2017-09-28 12:11:21.735 24281 ERROR nova.wsgi     self.filename))
Sep 28 12:11:21 ctl02 nova-api[24281]: 2017-09-28 12:11:21.735 24281 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:11:21 ctl02 nova-api[24281]: 2017-09-28 12:11:21.735 24281 ERROR nova.wsgi
Sep 28 12:11:21 ctl02 nova-api[24281]: 2017-09-28 12:11:21.737 24281 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:11:21 ctl02 nova-api[24281]: 2017-09-28 12:11:21.871 24281 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:11:22 ctl02 nova-api[24281]: 2017-09-28 12:11:22.121 24281 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:11:22 ctl02 nova-api[24281]: 2017-09-28 12:11:22.124 24281 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:11:22 ctl02 nova-api[24281]: 2017-09-28 12:11:22.124 24281 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:11:22 ctl02 nova-api[24281]: 2017-09-28 12:11:22.125 24281 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:11:22 ctl02 nova-api[24281]: 2017-09-28 12:11:22.257 24281 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:11:22 ctl02 nova-api[24281]: 2017-09-28 12:11:22.260 24281 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:11:22 ctl02 nova-api[24281]: 2017-09-28 12:11:22.260 24281 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:11:22 ctl02 nova-api[24281]: 2017-09-28 12:11:22.261 24281 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:11:22 ctl02 nova-api[24281]: 2017-09-28 12:11:22.264 24281 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:11:22 ctl02 nova-api[24281]: 2017-09-28 12:11:22.265 24281 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:11:22 ctl02 nova-api[24281]: 2017-09-28 12:11:22.265 24281 ERROR nova Traceback (most recent call last):
Sep 28 12:11:22 ctl02 nova-api[24281]: 2017-09-28 12:11:22.265 24281 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:11:22 ctl02 nova-api[24281]: 2017-09-28 12:11:22.265 24281 ERROR nova     sys.exit(main())
Sep 28 12:11:22 ctl02 nova-api[24281]: 2017-09-28 12:11:22.265 24281 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:11:22 ctl02 nova-api[24281]: 2017-09-28 12:11:22.265 24281 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:11:22 ctl02 nova-api[24281]: 2017-09-28 12:11:22.265 24281 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:11:22 ctl02 nova-api[24281]: 2017-09-28 12:11:22.265 24281 ERROR nova     max_url_len=max_url_len)
Sep 28 12:11:22 ctl02 nova-api[24281]: 2017-09-28 12:11:22.265 24281 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:11:22 ctl02 nova-api[24281]: 2017-09-28 12:11:22.265 24281 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:11:22 ctl02 nova-api[24281]: 2017-09-28 12:11:22.265 24281 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:11:22 ctl02 nova-api[24281]: 2017-09-28 12:11:22.265 24281 ERROR nova     sock.listen(backlog)
Sep 28 12:11:22 ctl02 nova-api[24281]: 2017-09-28 12:11:22.265 24281 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:11:22 ctl02 nova-api[24281]: 2017-09-28 12:11:22.265 24281 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:11:22 ctl02 nova-api[24281]: 2017-09-28 12:11:22.265 24281 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:11:22 ctl02 nova-api[24281]: 2017-09-28 12:11:22.265 24281 ERROR nova
Sep 28 12:11:22 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:11:22 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:11:22 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:11:22 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:11:22 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:11:22 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:11:22 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:11:22 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:11:22.979 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:11:22] "OPTIONS / HTTP/1.0" 200 134 0.000499
Sep 28 12:11:23 ctl02 heat-api-cfn[13300]: 2017-09-28 12:11:23.539 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:11:23] "OPTIONS / HTTP/1.0" 200 134 0.000535
Sep 28 12:11:23 ctl02 heat-api[13008]: 2017-09-28 12:11:23.908 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:11:23] "OPTIONS / HTTP/1.0" 200 134 0.000619
Sep 28 12:11:24 ctl02 glance-api[29183]: 2017-09-28 12:11:24.299 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:11:24] "OPTIONS / HTTP/1.0" 200 134 0.000646
Sep 28 12:11:24 ctl02 nova-api[24299]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:11:24 ctl02 nova-api[24299]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:11:24 ctl02 nova-api[24299]: 2017-09-28 12:11:24.504 24299 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:11:24 ctl02 nova-api[24299]: 2017-09-28 12:11:24.507 24299 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:11:24 ctl02 nova-api[24299]: 2017-09-28 12:11:24.507 24299 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:11:24 ctl02 nova-api[24299]: 2017-09-28 12:11:24.507 24299 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:11:24 ctl02 nova-api[24299]: 2017-09-28 12:11:24.507 24299 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:11:24 ctl02 nova-api[24299]: 2017-09-28 12:11:24.507 24299 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:11:24 ctl02 nova-api[24299]: 2017-09-28 12:11:24.507 24299 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:11:24 ctl02 nova-api[24299]: 2017-09-28 12:11:24.507 24299 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:11:24 ctl02 nova-api[24299]: 2017-09-28 12:11:24.507 24299 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:11:24 ctl02 nova-api[24299]: 2017-09-28 12:11:24.507 24299 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:11:24 ctl02 nova-api[24299]: 2017-09-28 12:11:24.507 24299 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:11:24 ctl02 nova-api[24299]: 2017-09-28 12:11:24.507 24299 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:11:24 ctl02 nova-api[24299]: 2017-09-28 12:11:24.507 24299 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:11:24 ctl02 nova-api[24299]: 2017-09-28 12:11:24.507 24299 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:11:24 ctl02 nova-api[24299]: 2017-09-28 12:11:24.507 24299 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:11:24 ctl02 nova-api[24299]: 2017-09-28 12:11:24.507 24299 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:11:24 ctl02 nova-api[24299]: 2017-09-28 12:11:24.507 24299 ERROR nova.wsgi     self.filename))
Sep 28 12:11:24 ctl02 nova-api[24299]: 2017-09-28 12:11:24.507 24299 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:11:24 ctl02 nova-api[24299]: 2017-09-28 12:11:24.507 24299 ERROR nova.wsgi
Sep 28 12:11:24 ctl02 nova-api[24299]: 2017-09-28 12:11:24.509 24299 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:11:24 ctl02 heat-api[13008]: 2017-09-28 12:11:24.571 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:11:24] "OPTIONS / HTTP/1.0" 200 134 0.000630
Sep 28 12:11:24 ctl02 nova-api[24299]: 2017-09-28 12:11:24.646 24299 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:11:24 ctl02 nova-api[24299]: 2017-09-28 12:11:24.898 24299 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:11:24 ctl02 nova-api[24299]: 2017-09-28 12:11:24.901 24299 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:11:24 ctl02 nova-api[24299]: 2017-09-28 12:11:24.902 24299 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:11:24 ctl02 nova-api[24299]: 2017-09-28 12:11:24.902 24299 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:11:25 ctl02 nova-api[24299]: 2017-09-28 12:11:25.036 24299 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:11:25 ctl02 nova-api[24299]: 2017-09-28 12:11:25.039 24299 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:11:25 ctl02 nova-api[24299]: 2017-09-28 12:11:25.039 24299 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:11:25 ctl02 nova-api[24299]: 2017-09-28 12:11:25.039 24299 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:11:25 ctl02 nova-api[24299]: 2017-09-28 12:11:25.043 24299 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:11:25 ctl02 nova-api[24299]: 2017-09-28 12:11:25.043 24299 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:11:25 ctl02 nova-api[24299]: 2017-09-28 12:11:25.043 24299 ERROR nova Traceback (most recent call last):
Sep 28 12:11:25 ctl02 nova-api[24299]: 2017-09-28 12:11:25.043 24299 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:11:25 ctl02 nova-api[24299]: 2017-09-28 12:11:25.043 24299 ERROR nova     sys.exit(main())
Sep 28 12:11:25 ctl02 nova-api[24299]: 2017-09-28 12:11:25.043 24299 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:11:25 ctl02 nova-api[24299]: 2017-09-28 12:11:25.043 24299 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:11:25 ctl02 nova-api[24299]: 2017-09-28 12:11:25.043 24299 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:11:25 ctl02 nova-api[24299]: 2017-09-28 12:11:25.043 24299 ERROR nova     max_url_len=max_url_len)
Sep 28 12:11:25 ctl02 nova-api[24299]: 2017-09-28 12:11:25.043 24299 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:11:25 ctl02 nova-api[24299]: 2017-09-28 12:11:25.043 24299 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:11:25 ctl02 nova-api[24299]: 2017-09-28 12:11:25.043 24299 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:11:25 ctl02 nova-api[24299]: 2017-09-28 12:11:25.043 24299 ERROR nova     sock.listen(backlog)
Sep 28 12:11:25 ctl02 nova-api[24299]: 2017-09-28 12:11:25.043 24299 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:11:25 ctl02 nova-api[24299]: 2017-09-28 12:11:25.043 24299 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:11:25 ctl02 nova-api[24299]: 2017-09-28 12:11:25.043 24299 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:11:25 ctl02 nova-api[24299]: 2017-09-28 12:11:25.043 24299 ERROR nova
Sep 28 12:11:25 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:11:25 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:11:25 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:11:25 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:11:25 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:11:25 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:11:25 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:11:26 ctl02 glance-api[29183]: 2017-09-28 12:11:26.325 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:11:26] "OPTIONS / HTTP/1.0" 200 134 0.000648
Sep 28 12:11:26 ctl02 nova-consoleauth[5433]: 2017-09-28 12:11:26.328 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:11:27 ctl02 nova-api[24317]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:11:27 ctl02 nova-api[24317]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:11:27 ctl02 nova-api[24317]: 2017-09-28 12:11:27.227 24317 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:11:27 ctl02 nova-api[24317]: 2017-09-28 12:11:27.229 24317 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:11:27 ctl02 nova-api[24317]: 2017-09-28 12:11:27.229 24317 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:11:27 ctl02 nova-api[24317]: 2017-09-28 12:11:27.229 24317 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:11:27 ctl02 nova-api[24317]: 2017-09-28 12:11:27.229 24317 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:11:27 ctl02 nova-api[24317]: 2017-09-28 12:11:27.229 24317 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:11:27 ctl02 nova-api[24317]: 2017-09-28 12:11:27.229 24317 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:11:27 ctl02 nova-api[24317]: 2017-09-28 12:11:27.229 24317 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:11:27 ctl02 nova-api[24317]: 2017-09-28 12:11:27.229 24317 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:11:27 ctl02 nova-api[24317]: 2017-09-28 12:11:27.229 24317 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:11:27 ctl02 nova-api[24317]: 2017-09-28 12:11:27.229 24317 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:11:27 ctl02 nova-api[24317]: 2017-09-28 12:11:27.229 24317 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:11:27 ctl02 nova-api[24317]: 2017-09-28 12:11:27.229 24317 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:11:27 ctl02 nova-api[24317]: 2017-09-28 12:11:27.229 24317 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:11:27 ctl02 nova-api[24317]: 2017-09-28 12:11:27.229 24317 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:11:27 ctl02 nova-api[24317]: 2017-09-28 12:11:27.229 24317 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:11:27 ctl02 nova-api[24317]: 2017-09-28 12:11:27.229 24317 ERROR nova.wsgi     self.filename))
Sep 28 12:11:27 ctl02 nova-api[24317]: 2017-09-28 12:11:27.229 24317 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:11:27 ctl02 nova-api[24317]: 2017-09-28 12:11:27.229 24317 ERROR nova.wsgi
Sep 28 12:11:27 ctl02 nova-api[24317]: 2017-09-28 12:11:27.230 24317 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:11:27 ctl02 nova-api[24317]: 2017-09-28 12:11:27.364 24317 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:11:27 ctl02 nova-api[24317]: 2017-09-28 12:11:27.618 24317 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:11:27 ctl02 nova-api[24317]: 2017-09-28 12:11:27.621 24317 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:11:27 ctl02 nova-api[24317]: 2017-09-28 12:11:27.621 24317 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:11:27 ctl02 nova-api[24317]: 2017-09-28 12:11:27.622 24317 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:11:27 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:11:27.713 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:11:27] "OPTIONS / HTTP/1.0" 200 134 0.000485
Sep 28 12:11:27 ctl02 nova-api[24317]: 2017-09-28 12:11:27.757 24317 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:11:27 ctl02 nova-api[24317]: 2017-09-28 12:11:27.760 24317 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:11:27 ctl02 nova-api[24317]: 2017-09-28 12:11:27.760 24317 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:11:27 ctl02 nova-api[24317]: 2017-09-28 12:11:27.760 24317 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:11:27 ctl02 nova-api[24317]: 2017-09-28 12:11:27.764 24317 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:11:27 ctl02 nova-api[24317]: 2017-09-28 12:11:27.764 24317 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:11:27 ctl02 nova-api[24317]: 2017-09-28 12:11:27.764 24317 ERROR nova Traceback (most recent call last):
Sep 28 12:11:27 ctl02 nova-api[24317]: 2017-09-28 12:11:27.764 24317 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:11:27 ctl02 nova-api[24317]: 2017-09-28 12:11:27.764 24317 ERROR nova     sys.exit(main())
Sep 28 12:11:27 ctl02 nova-api[24317]: 2017-09-28 12:11:27.764 24317 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:11:27 ctl02 nova-api[24317]: 2017-09-28 12:11:27.764 24317 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:11:27 ctl02 nova-api[24317]: 2017-09-28 12:11:27.764 24317 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:11:27 ctl02 nova-api[24317]: 2017-09-28 12:11:27.764 24317 ERROR nova     max_url_len=max_url_len)
Sep 28 12:11:27 ctl02 nova-api[24317]: 2017-09-28 12:11:27.764 24317 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:11:27 ctl02 nova-api[24317]: 2017-09-28 12:11:27.764 24317 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:11:27 ctl02 nova-api[24317]: 2017-09-28 12:11:27.764 24317 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:11:27 ctl02 nova-api[24317]: 2017-09-28 12:11:27.764 24317 ERROR nova     sock.listen(backlog)
Sep 28 12:11:27 ctl02 nova-api[24317]: 2017-09-28 12:11:27.764 24317 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:11:27 ctl02 nova-api[24317]: 2017-09-28 12:11:27.764 24317 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:11:27 ctl02 nova-api[24317]: 2017-09-28 12:11:27.764 24317 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:11:27 ctl02 nova-api[24317]: 2017-09-28 12:11:27.764 24317 ERROR nova
Sep 28 12:11:27 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:11:27 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:11:27 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:11:28 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:11:28.005 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:11:28] "OPTIONS / HTTP/1.0" 200 134 0.000510
Sep 28 12:11:28 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:11:28 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:11:28 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:11:28 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:11:28 ctl02 heat-api[13008]: 2017-09-28 12:11:28.462 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:11:28] "OPTIONS / HTTP/1.0" 200 134 0.000606
Sep 28 12:11:29 ctl02 nova-scheduler[5620]: 2017-09-28 12:11:29.347 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:11:29 ctl02 heat-engine[12803]: 2017-09-28 12:11:29.489 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:11:29 ctl02 heat-engine[12803]: 2017-09-28 12:11:29.518 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:11:29 ctl02 heat-engine[12803]: 2017-09-28 12:11:29.533 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:11:29 ctl02 heat-engine[12803]: 2017-09-28 12:11:29.541 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:11:29 ctl02 nova-api[24335]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:11:29 ctl02 nova-api[24335]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:11:29 ctl02 glance-api[29183]: 2017-09-28 12:11:29.860 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:11:29] "OPTIONS / HTTP/1.0" 200 134 0.000659
Sep 28 12:11:29 ctl02 nova-api[24335]: 2017-09-28 12:11:29.992 24335 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:11:29 ctl02 nova-api[24335]: 2017-09-28 12:11:29.994 24335 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:11:29 ctl02 nova-api[24335]: 2017-09-28 12:11:29.994 24335 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:11:29 ctl02 nova-api[24335]: 2017-09-28 12:11:29.994 24335 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:11:29 ctl02 nova-api[24335]: 2017-09-28 12:11:29.994 24335 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:11:29 ctl02 nova-api[24335]: 2017-09-28 12:11:29.994 24335 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:11:29 ctl02 nova-api[24335]: 2017-09-28 12:11:29.994 24335 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:11:29 ctl02 nova-api[24335]: 2017-09-28 12:11:29.994 24335 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:11:29 ctl02 nova-api[24335]: 2017-09-28 12:11:29.994 24335 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:11:29 ctl02 nova-api[24335]: 2017-09-28 12:11:29.994 24335 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:11:29 ctl02 nova-api[24335]: 2017-09-28 12:11:29.994 24335 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:11:29 ctl02 nova-api[24335]: 2017-09-28 12:11:29.994 24335 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:11:29 ctl02 nova-api[24335]: 2017-09-28 12:11:29.994 24335 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:11:29 ctl02 nova-api[24335]: 2017-09-28 12:11:29.994 24335 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:11:29 ctl02 nova-api[24335]: 2017-09-28 12:11:29.994 24335 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:11:29 ctl02 nova-api[24335]: 2017-09-28 12:11:29.994 24335 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:11:29 ctl02 nova-api[24335]: 2017-09-28 12:11:29.994 24335 ERROR nova.wsgi     self.filename))
Sep 28 12:11:29 ctl02 nova-api[24335]: 2017-09-28 12:11:29.994 24335 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:11:29 ctl02 nova-api[24335]: 2017-09-28 12:11:29.994 24335 ERROR nova.wsgi
Sep 28 12:11:29 ctl02 nova-api[24335]: 2017-09-28 12:11:29.995 24335 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:11:30 ctl02 nova-api[24335]: 2017-09-28 12:11:30.131 24335 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:11:30 ctl02 nova-api[24335]: 2017-09-28 12:11:30.383 24335 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:11:30 ctl02 nova-api[24335]: 2017-09-28 12:11:30.386 24335 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:11:30 ctl02 nova-api[24335]: 2017-09-28 12:11:30.386 24335 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:11:30 ctl02 nova-api[24335]: 2017-09-28 12:11:30.386 24335 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:11:30 ctl02 nova-api[24335]: 2017-09-28 12:11:30.520 24335 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:11:30 ctl02 nova-api[24335]: 2017-09-28 12:11:30.523 24335 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:11:30 ctl02 nova-api[24335]: 2017-09-28 12:11:30.523 24335 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:11:30 ctl02 nova-api[24335]: 2017-09-28 12:11:30.523 24335 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:11:30 ctl02 nova-api[24335]: 2017-09-28 12:11:30.526 24335 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:11:30 ctl02 nova-api[24335]: 2017-09-28 12:11:30.527 24335 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:11:30 ctl02 nova-api[24335]: 2017-09-28 12:11:30.527 24335 ERROR nova Traceback (most recent call last):
Sep 28 12:11:30 ctl02 nova-api[24335]: 2017-09-28 12:11:30.527 24335 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:11:30 ctl02 nova-api[24335]: 2017-09-28 12:11:30.527 24335 ERROR nova     sys.exit(main())
Sep 28 12:11:30 ctl02 nova-api[24335]: 2017-09-28 12:11:30.527 24335 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:11:30 ctl02 nova-api[24335]: 2017-09-28 12:11:30.527 24335 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:11:30 ctl02 nova-api[24335]: 2017-09-28 12:11:30.527 24335 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:11:30 ctl02 nova-api[24335]: 2017-09-28 12:11:30.527 24335 ERROR nova     max_url_len=max_url_len)
Sep 28 12:11:30 ctl02 nova-api[24335]: 2017-09-28 12:11:30.527 24335 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:11:30 ctl02 nova-api[24335]: 2017-09-28 12:11:30.527 24335 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:11:30 ctl02 nova-api[24335]: 2017-09-28 12:11:30.527 24335 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:11:30 ctl02 nova-api[24335]: 2017-09-28 12:11:30.527 24335 ERROR nova     sock.listen(backlog)
Sep 28 12:11:30 ctl02 nova-api[24335]: 2017-09-28 12:11:30.527 24335 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:11:30 ctl02 nova-api[24335]: 2017-09-28 12:11:30.527 24335 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:11:30 ctl02 nova-api[24335]: 2017-09-28 12:11:30.527 24335 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:11:30 ctl02 nova-api[24335]: 2017-09-28 12:11:30.527 24335 ERROR nova
Sep 28 12:11:30 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:11:30 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:11:30 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:11:30 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:11:30 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:11:30 ctl02 heat-api-cfn[13300]: 2017-09-28 12:11:30.878 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:11:30] "OPTIONS / HTTP/1.0" 200 134 0.000935
Sep 28 12:11:30 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:11:30 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:11:31 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe2452f39)
Sep 28 12:11:31 ctl02 heat-api-cfn[13300]: 2017-09-28 12:11:31.354 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:11:31] "OPTIONS / HTTP/1.0" 200 134 0.000546
Sep 28 12:11:32 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe2452f39)
Sep 28 12:11:32 ctl02 nova-api[24353]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:11:32 ctl02 nova-api[24353]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:11:32 ctl02 nova-api[24353]: 2017-09-28 12:11:32.736 24353 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:11:32 ctl02 nova-api[24353]: 2017-09-28 12:11:32.738 24353 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:11:32 ctl02 nova-api[24353]: 2017-09-28 12:11:32.738 24353 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:11:32 ctl02 nova-api[24353]: 2017-09-28 12:11:32.738 24353 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:11:32 ctl02 nova-api[24353]: 2017-09-28 12:11:32.738 24353 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:11:32 ctl02 nova-api[24353]: 2017-09-28 12:11:32.738 24353 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:11:32 ctl02 nova-api[24353]: 2017-09-28 12:11:32.738 24353 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:11:32 ctl02 nova-api[24353]: 2017-09-28 12:11:32.738 24353 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:11:32 ctl02 nova-api[24353]: 2017-09-28 12:11:32.738 24353 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:11:32 ctl02 nova-api[24353]: 2017-09-28 12:11:32.738 24353 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:11:32 ctl02 nova-api[24353]: 2017-09-28 12:11:32.738 24353 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:11:32 ctl02 nova-api[24353]: 2017-09-28 12:11:32.738 24353 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:11:32 ctl02 nova-api[24353]: 2017-09-28 12:11:32.738 24353 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:11:32 ctl02 nova-api[24353]: 2017-09-28 12:11:32.738 24353 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:11:32 ctl02 nova-api[24353]: 2017-09-28 12:11:32.738 24353 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:11:32 ctl02 nova-api[24353]: 2017-09-28 12:11:32.738 24353 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:11:32 ctl02 nova-api[24353]: 2017-09-28 12:11:32.738 24353 ERROR nova.wsgi     self.filename))
Sep 28 12:11:32 ctl02 nova-api[24353]: 2017-09-28 12:11:32.738 24353 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:11:32 ctl02 nova-api[24353]: 2017-09-28 12:11:32.738 24353 ERROR nova.wsgi
Sep 28 12:11:32 ctl02 nova-api[24353]: 2017-09-28 12:11:32.739 24353 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:11:32 ctl02 nova-api[24353]: 2017-09-28 12:11:32.873 24353 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:11:32 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:11:32.978 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:11:32] "OPTIONS / HTTP/1.0" 200 134 0.000514
Sep 28 12:11:33 ctl02 nova-api[24353]: 2017-09-28 12:11:33.126 24353 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:11:33 ctl02 nova-api[24353]: 2017-09-28 12:11:33.129 24353 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:11:33 ctl02 nova-api[24353]: 2017-09-28 12:11:33.129 24353 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:11:33 ctl02 nova-api[24353]: 2017-09-28 12:11:33.129 24353 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:11:33 ctl02 nova-api[24353]: 2017-09-28 12:11:33.261 24353 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:11:33 ctl02 nova-api[24353]: 2017-09-28 12:11:33.263 24353 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:11:33 ctl02 nova-api[24353]: 2017-09-28 12:11:33.263 24353 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:11:33 ctl02 nova-api[24353]: 2017-09-28 12:11:33.263 24353 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:11:33 ctl02 nova-api[24353]: 2017-09-28 12:11:33.266 24353 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:11:33 ctl02 nova-api[24353]: 2017-09-28 12:11:33.267 24353 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:11:33 ctl02 nova-api[24353]: 2017-09-28 12:11:33.267 24353 ERROR nova Traceback (most recent call last):
Sep 28 12:11:33 ctl02 nova-api[24353]: 2017-09-28 12:11:33.267 24353 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:11:33 ctl02 nova-api[24353]: 2017-09-28 12:11:33.267 24353 ERROR nova     sys.exit(main())
Sep 28 12:11:33 ctl02 nova-api[24353]: 2017-09-28 12:11:33.267 24353 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:11:33 ctl02 nova-api[24353]: 2017-09-28 12:11:33.267 24353 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:11:33 ctl02 nova-api[24353]: 2017-09-28 12:11:33.267 24353 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:11:33 ctl02 nova-api[24353]: 2017-09-28 12:11:33.267 24353 ERROR nova     max_url_len=max_url_len)
Sep 28 12:11:33 ctl02 nova-api[24353]: 2017-09-28 12:11:33.267 24353 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:11:33 ctl02 nova-api[24353]: 2017-09-28 12:11:33.267 24353 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:11:33 ctl02 nova-api[24353]: 2017-09-28 12:11:33.267 24353 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:11:33 ctl02 nova-api[24353]: 2017-09-28 12:11:33.267 24353 ERROR nova     sock.listen(backlog)
Sep 28 12:11:33 ctl02 nova-api[24353]: 2017-09-28 12:11:33.267 24353 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:11:33 ctl02 nova-api[24353]: 2017-09-28 12:11:33.267 24353 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:11:33 ctl02 nova-api[24353]: 2017-09-28 12:11:33.267 24353 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:11:33 ctl02 nova-api[24353]: 2017-09-28 12:11:33.267 24353 ERROR nova
Sep 28 12:11:33 ctl02 heat-api-cfn[13300]: 2017-09-28 12:11:33.272 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:11:33] "OPTIONS / HTTP/1.0" 200 134 0.000521
Sep 28 12:11:33 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe2452f39)
Sep 28 12:11:33 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:11:33 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:11:33 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:11:33 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:11:33 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:11:33 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:11:33 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:11:33 ctl02 heat-api[13008]: 2017-09-28 12:11:33.692 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:11:33] "OPTIONS / HTTP/1.0" 200 134 0.000616
Sep 28 12:11:34 ctl02 glance-api[29183]: 2017-09-28 12:11:34.249 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:11:34] "OPTIONS / HTTP/1.0" 200 134 0.000657
Sep 28 12:11:34 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe2452f39)
Sep 28 12:11:34 ctl02 heat-api[13008]: 2017-09-28 12:11:34.972 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:11:34] "OPTIONS / HTTP/1.0" 200 134 0.000592
Sep 28 12:11:35 ctl02 nova-api[24371]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:11:35 ctl02 nova-api[24371]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:11:35 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe2452f39)
Sep 28 12:11:35 ctl02 nova-api[24371]: 2017-09-28 12:11:35.481 24371 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:11:35 ctl02 nova-api[24371]: 2017-09-28 12:11:35.483 24371 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:11:35 ctl02 nova-api[24371]: 2017-09-28 12:11:35.483 24371 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:11:35 ctl02 nova-api[24371]: 2017-09-28 12:11:35.483 24371 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:11:35 ctl02 nova-api[24371]: 2017-09-28 12:11:35.483 24371 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:11:35 ctl02 nova-api[24371]: 2017-09-28 12:11:35.483 24371 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:11:35 ctl02 nova-api[24371]: 2017-09-28 12:11:35.483 24371 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:11:35 ctl02 nova-api[24371]: 2017-09-28 12:11:35.483 24371 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:11:35 ctl02 nova-api[24371]: 2017-09-28 12:11:35.483 24371 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:11:35 ctl02 nova-api[24371]: 2017-09-28 12:11:35.483 24371 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:11:35 ctl02 nova-api[24371]: 2017-09-28 12:11:35.483 24371 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:11:35 ctl02 nova-api[24371]: 2017-09-28 12:11:35.483 24371 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:11:35 ctl02 nova-api[24371]: 2017-09-28 12:11:35.483 24371 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:11:35 ctl02 nova-api[24371]: 2017-09-28 12:11:35.483 24371 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:11:35 ctl02 nova-api[24371]: 2017-09-28 12:11:35.483 24371 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:11:35 ctl02 nova-api[24371]: 2017-09-28 12:11:35.483 24371 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:11:35 ctl02 nova-api[24371]: 2017-09-28 12:11:35.483 24371 ERROR nova.wsgi     self.filename))
Sep 28 12:11:35 ctl02 nova-api[24371]: 2017-09-28 12:11:35.483 24371 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:11:35 ctl02 nova-api[24371]: 2017-09-28 12:11:35.483 24371 ERROR nova.wsgi
Sep 28 12:11:35 ctl02 nova-api[24371]: 2017-09-28 12:11:35.486 24371 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:11:35 ctl02 nova-api[24371]: 2017-09-28 12:11:35.622 24371 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:11:35 ctl02 nova-api[24371]: 2017-09-28 12:11:35.878 24371 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:11:35 ctl02 nova-api[24371]: 2017-09-28 12:11:35.881 24371 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:11:35 ctl02 nova-api[24371]: 2017-09-28 12:11:35.881 24371 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:11:35 ctl02 nova-api[24371]: 2017-09-28 12:11:35.881 24371 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:11:36 ctl02 nova-api[24371]: 2017-09-28 12:11:36.018 24371 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:11:36 ctl02 nova-api[24371]: 2017-09-28 12:11:36.021 24371 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:11:36 ctl02 nova-api[24371]: 2017-09-28 12:11:36.021 24371 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:11:36 ctl02 nova-api[24371]: 2017-09-28 12:11:36.022 24371 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:11:36 ctl02 nova-api[24371]: 2017-09-28 12:11:36.025 24371 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:11:36 ctl02 nova-api[24371]: 2017-09-28 12:11:36.026 24371 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:11:36 ctl02 nova-api[24371]: 2017-09-28 12:11:36.026 24371 ERROR nova Traceback (most recent call last):
Sep 28 12:11:36 ctl02 nova-api[24371]: 2017-09-28 12:11:36.026 24371 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:11:36 ctl02 nova-api[24371]: 2017-09-28 12:11:36.026 24371 ERROR nova     sys.exit(main())
Sep 28 12:11:36 ctl02 nova-api[24371]: 2017-09-28 12:11:36.026 24371 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:11:36 ctl02 nova-api[24371]: 2017-09-28 12:11:36.026 24371 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:11:36 ctl02 nova-api[24371]: 2017-09-28 12:11:36.026 24371 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:11:36 ctl02 nova-api[24371]: 2017-09-28 12:11:36.026 24371 ERROR nova     max_url_len=max_url_len)
Sep 28 12:11:36 ctl02 nova-api[24371]: 2017-09-28 12:11:36.026 24371 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:11:36 ctl02 nova-api[24371]: 2017-09-28 12:11:36.026 24371 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:11:36 ctl02 nova-api[24371]: 2017-09-28 12:11:36.026 24371 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:11:36 ctl02 nova-api[24371]: 2017-09-28 12:11:36.026 24371 ERROR nova     sock.listen(backlog)
Sep 28 12:11:36 ctl02 nova-api[24371]: 2017-09-28 12:11:36.026 24371 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:11:36 ctl02 nova-api[24371]: 2017-09-28 12:11:36.026 24371 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:11:36 ctl02 nova-api[24371]: 2017-09-28 12:11:36.026 24371 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:11:36 ctl02 nova-api[24371]: 2017-09-28 12:11:36.026 24371 ERROR nova
Sep 28 12:11:36 ctl02 glance-api[29183]: 2017-09-28 12:11:36.201 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:11:36] "OPTIONS / HTTP/1.0" 200 134 0.000701
Sep 28 12:11:36 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:11:36 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:11:36 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:11:36 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe2452f39)
Sep 28 12:11:36 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:11:36 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:11:36 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:11:36 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:11:37 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe2452f39)
Sep 28 12:11:37 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:11:37.490 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:11:37] "OPTIONS / HTTP/1.0" 200 134 0.000420
Sep 28 12:11:37 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:11:37.766 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:11:37] "OPTIONS / HTTP/1.0" 200 134 0.000258
Sep 28 12:11:38 ctl02 nova-api[24389]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:11:38 ctl02 nova-api[24389]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:11:38 ctl02 heat-api[13008]: 2017-09-28 12:11:38.208 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:11:38] "OPTIONS / HTTP/1.0" 200 134 0.000547
Sep 28 12:11:38 ctl02 nova-api[24389]: 2017-09-28 12:11:38.214 24389 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:11:38 ctl02 nova-api[24389]: 2017-09-28 12:11:38.216 24389 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:11:38 ctl02 nova-api[24389]: 2017-09-28 12:11:38.216 24389 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:11:38 ctl02 nova-api[24389]: 2017-09-28 12:11:38.216 24389 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:11:38 ctl02 nova-api[24389]: 2017-09-28 12:11:38.216 24389 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:11:38 ctl02 nova-api[24389]: 2017-09-28 12:11:38.216 24389 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:11:38 ctl02 nova-api[24389]: 2017-09-28 12:11:38.216 24389 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:11:38 ctl02 nova-api[24389]: 2017-09-28 12:11:38.216 24389 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:11:38 ctl02 nova-api[24389]: 2017-09-28 12:11:38.216 24389 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:11:38 ctl02 nova-api[24389]: 2017-09-28 12:11:38.216 24389 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:11:38 ctl02 nova-api[24389]: 2017-09-28 12:11:38.216 24389 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:11:38 ctl02 nova-api[24389]: 2017-09-28 12:11:38.216 24389 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:11:38 ctl02 nova-api[24389]: 2017-09-28 12:11:38.216 24389 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:11:38 ctl02 nova-api[24389]: 2017-09-28 12:11:38.216 24389 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:11:38 ctl02 nova-api[24389]: 2017-09-28 12:11:38.216 24389 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:11:38 ctl02 nova-api[24389]: 2017-09-28 12:11:38.216 24389 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:11:38 ctl02 nova-api[24389]: 2017-09-28 12:11:38.216 24389 ERROR nova.wsgi     self.filename))
Sep 28 12:11:38 ctl02 nova-api[24389]: 2017-09-28 12:11:38.216 24389 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:11:38 ctl02 nova-api[24389]: 2017-09-28 12:11:38.216 24389 ERROR nova.wsgi
Sep 28 12:11:38 ctl02 nova-api[24389]: 2017-09-28 12:11:38.219 24389 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:11:38 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe2452f39)
Sep 28 12:11:38 ctl02 nova-api[24389]: 2017-09-28 12:11:38.352 24389 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:11:38 ctl02 nova-api[24389]: 2017-09-28 12:11:38.584 24389 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:11:38 ctl02 nova-api[24389]: 2017-09-28 12:11:38.586 24389 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:11:38 ctl02 nova-api[24389]: 2017-09-28 12:11:38.587 24389 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:11:38 ctl02 nova-api[24389]: 2017-09-28 12:11:38.587 24389 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:11:38 ctl02 nova-api[24389]: 2017-09-28 12:11:38.719 24389 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:11:38 ctl02 nova-api[24389]: 2017-09-28 12:11:38.722 24389 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:11:38 ctl02 nova-api[24389]: 2017-09-28 12:11:38.722 24389 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:11:38 ctl02 nova-api[24389]: 2017-09-28 12:11:38.723 24389 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:11:38 ctl02 nova-api[24389]: 2017-09-28 12:11:38.726 24389 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:11:38 ctl02 nova-api[24389]: 2017-09-28 12:11:38.727 24389 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:11:38 ctl02 nova-api[24389]: 2017-09-28 12:11:38.727 24389 ERROR nova Traceback (most recent call last):
Sep 28 12:11:38 ctl02 nova-api[24389]: 2017-09-28 12:11:38.727 24389 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:11:38 ctl02 nova-api[24389]: 2017-09-28 12:11:38.727 24389 ERROR nova     sys.exit(main())
Sep 28 12:11:38 ctl02 nova-api[24389]: 2017-09-28 12:11:38.727 24389 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:11:38 ctl02 nova-api[24389]: 2017-09-28 12:11:38.727 24389 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:11:38 ctl02 nova-api[24389]: 2017-09-28 12:11:38.727 24389 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:11:38 ctl02 nova-api[24389]: 2017-09-28 12:11:38.727 24389 ERROR nova     max_url_len=max_url_len)
Sep 28 12:11:38 ctl02 nova-api[24389]: 2017-09-28 12:11:38.727 24389 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:11:38 ctl02 nova-api[24389]: 2017-09-28 12:11:38.727 24389 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:11:38 ctl02 nova-api[24389]: 2017-09-28 12:11:38.727 24389 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:11:38 ctl02 nova-api[24389]: 2017-09-28 12:11:38.727 24389 ERROR nova     sock.listen(backlog)
Sep 28 12:11:38 ctl02 nova-api[24389]: 2017-09-28 12:11:38.727 24389 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:11:38 ctl02 nova-api[24389]: 2017-09-28 12:11:38.727 24389 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:11:38 ctl02 nova-api[24389]: 2017-09-28 12:11:38.727 24389 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:11:38 ctl02 nova-api[24389]: 2017-09-28 12:11:38.727 24389 ERROR nova
Sep 28 12:11:38 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:11:38 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:11:38 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:11:39 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:11:39 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:11:39 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:11:39 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:11:39 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe2452f39)
Sep 28 12:11:39 ctl02 glance-api[29183]: 2017-09-28 12:11:39.627 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:11:39] "OPTIONS / HTTP/1.0" 200 134 0.000582
Sep 28 12:11:40 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe2452f39)
Sep 28 12:11:40 ctl02 nova-api[24407]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:11:40 ctl02 nova-api[24407]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:11:40 ctl02 nova-api[24407]: 2017-09-28 12:11:40.958 24407 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:11:40 ctl02 nova-api[24407]: 2017-09-28 12:11:40.961 24407 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:11:40 ctl02 nova-api[24407]: 2017-09-28 12:11:40.961 24407 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:11:40 ctl02 nova-api[24407]: 2017-09-28 12:11:40.961 24407 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:11:40 ctl02 nova-api[24407]: 2017-09-28 12:11:40.961 24407 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:11:40 ctl02 nova-api[24407]: 2017-09-28 12:11:40.961 24407 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:11:40 ctl02 nova-api[24407]: 2017-09-28 12:11:40.961 24407 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:11:40 ctl02 nova-api[24407]: 2017-09-28 12:11:40.961 24407 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:11:40 ctl02 nova-api[24407]: 2017-09-28 12:11:40.961 24407 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:11:40 ctl02 nova-api[24407]: 2017-09-28 12:11:40.961 24407 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:11:40 ctl02 nova-api[24407]: 2017-09-28 12:11:40.961 24407 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:11:40 ctl02 nova-api[24407]: 2017-09-28 12:11:40.961 24407 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:11:40 ctl02 nova-api[24407]: 2017-09-28 12:11:40.961 24407 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:11:40 ctl02 nova-api[24407]: 2017-09-28 12:11:40.961 24407 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:11:40 ctl02 nova-api[24407]: 2017-09-28 12:11:40.961 24407 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:11:40 ctl02 nova-api[24407]: 2017-09-28 12:11:40.961 24407 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:11:40 ctl02 nova-api[24407]: 2017-09-28 12:11:40.961 24407 ERROR nova.wsgi     self.filename))
Sep 28 12:11:40 ctl02 nova-api[24407]: 2017-09-28 12:11:40.961 24407 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:11:40 ctl02 nova-api[24407]: 2017-09-28 12:11:40.961 24407 ERROR nova.wsgi
Sep 28 12:11:40 ctl02 nova-api[24407]: 2017-09-28 12:11:40.963 24407 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:11:41 ctl02 heat-api-cfn[13300]: 2017-09-28 12:11:41.008 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:11:41] "OPTIONS / HTTP/1.0" 200 134 0.000603
Sep 28 12:11:41 ctl02 nova-api[24407]: 2017-09-28 12:11:41.092 24407 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:11:41 ctl02 heat-api-cfn[13300]: 2017-09-28 12:11:41.198 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:11:41] "OPTIONS / HTTP/1.0" 200 134 0.000382
Sep 28 12:11:41 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe2452f39)
Sep 28 12:11:41 ctl02 nova-api[24407]: 2017-09-28 12:11:41.321 24407 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:11:41 ctl02 nova-api[24407]: 2017-09-28 12:11:41.324 24407 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:11:41 ctl02 nova-api[24407]: 2017-09-28 12:11:41.324 24407 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:11:41 ctl02 nova-api[24407]: 2017-09-28 12:11:41.325 24407 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:11:41 ctl02 nova-api[24407]: 2017-09-28 12:11:41.456 24407 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:11:41 ctl02 nova-api[24407]: 2017-09-28 12:11:41.458 24407 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:11:41 ctl02 nova-api[24407]: 2017-09-28 12:11:41.458 24407 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:11:41 ctl02 nova-api[24407]: 2017-09-28 12:11:41.458 24407 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:11:41 ctl02 nova-api[24407]: 2017-09-28 12:11:41.462 24407 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:11:41 ctl02 nova-api[24407]: 2017-09-28 12:11:41.462 24407 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:11:41 ctl02 nova-api[24407]: 2017-09-28 12:11:41.462 24407 ERROR nova Traceback (most recent call last):
Sep 28 12:11:41 ctl02 nova-api[24407]: 2017-09-28 12:11:41.462 24407 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:11:41 ctl02 nova-api[24407]: 2017-09-28 12:11:41.462 24407 ERROR nova     sys.exit(main())
Sep 28 12:11:41 ctl02 nova-api[24407]: 2017-09-28 12:11:41.462 24407 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:11:41 ctl02 nova-api[24407]: 2017-09-28 12:11:41.462 24407 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:11:41 ctl02 nova-api[24407]: 2017-09-28 12:11:41.462 24407 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:11:41 ctl02 nova-api[24407]: 2017-09-28 12:11:41.462 24407 ERROR nova     max_url_len=max_url_len)
Sep 28 12:11:41 ctl02 nova-api[24407]: 2017-09-28 12:11:41.462 24407 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:11:41 ctl02 nova-api[24407]: 2017-09-28 12:11:41.462 24407 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:11:41 ctl02 nova-api[24407]: 2017-09-28 12:11:41.462 24407 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:11:41 ctl02 nova-api[24407]: 2017-09-28 12:11:41.462 24407 ERROR nova     sock.listen(backlog)
Sep 28 12:11:41 ctl02 nova-api[24407]: 2017-09-28 12:11:41.462 24407 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:11:41 ctl02 nova-api[24407]: 2017-09-28 12:11:41.462 24407 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:11:41 ctl02 nova-api[24407]: 2017-09-28 12:11:41.462 24407 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:11:41 ctl02 nova-api[24407]: 2017-09-28 12:11:41.462 24407 ERROR nova
Sep 28 12:11:41 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:11:41 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:11:41 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:11:41 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:11:41 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:11:41 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:11:41 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:11:42 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:11:42 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:11:42 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:11:42.817 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:11:42] "OPTIONS / HTTP/1.0" 200 134 0.000538
Sep 28 12:11:43 ctl02 nova-api[24425]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:11:43 ctl02 nova-api[24425]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:11:43 ctl02 heat-api-cfn[13300]: 2017-09-28 12:11:43.662 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:11:43] "OPTIONS / HTTP/1.0" 200 134 0.000592
Sep 28 12:11:43 ctl02 nova-api[24425]: 2017-09-28 12:11:43.718 24425 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:11:43 ctl02 nova-api[24425]: 2017-09-28 12:11:43.720 24425 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:11:43 ctl02 nova-api[24425]: 2017-09-28 12:11:43.720 24425 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:11:43 ctl02 nova-api[24425]: 2017-09-28 12:11:43.720 24425 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:11:43 ctl02 nova-api[24425]: 2017-09-28 12:11:43.720 24425 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:11:43 ctl02 nova-api[24425]: 2017-09-28 12:11:43.720 24425 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:11:43 ctl02 nova-api[24425]: 2017-09-28 12:11:43.720 24425 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:11:43 ctl02 nova-api[24425]: 2017-09-28 12:11:43.720 24425 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:11:43 ctl02 nova-api[24425]: 2017-09-28 12:11:43.720 24425 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:11:43 ctl02 nova-api[24425]: 2017-09-28 12:11:43.720 24425 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:11:43 ctl02 nova-api[24425]: 2017-09-28 12:11:43.720 24425 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:11:43 ctl02 nova-api[24425]: 2017-09-28 12:11:43.720 24425 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:11:43 ctl02 nova-api[24425]: 2017-09-28 12:11:43.720 24425 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:11:43 ctl02 nova-api[24425]: 2017-09-28 12:11:43.720 24425 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:11:43 ctl02 nova-api[24425]: 2017-09-28 12:11:43.720 24425 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:11:43 ctl02 nova-api[24425]: 2017-09-28 12:11:43.720 24425 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:11:43 ctl02 nova-api[24425]: 2017-09-28 12:11:43.720 24425 ERROR nova.wsgi     self.filename))
Sep 28 12:11:43 ctl02 nova-api[24425]: 2017-09-28 12:11:43.720 24425 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:11:43 ctl02 nova-api[24425]: 2017-09-28 12:11:43.720 24425 ERROR nova.wsgi
Sep 28 12:11:43 ctl02 nova-api[24425]: 2017-09-28 12:11:43.722 24425 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:11:43 ctl02 nova-api[24425]: 2017-09-28 12:11:43.855 24425 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:11:43 ctl02 heat-api[13008]: 2017-09-28 12:11:43.979 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:11:43] "OPTIONS / HTTP/1.0" 200 134 0.000587
Sep 28 12:11:44 ctl02 glance-api[29183]: 2017-09-28 12:11:44.035 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:11:44] "OPTIONS / HTTP/1.0" 200 134 0.000635
Sep 28 12:11:44 ctl02 nova-api[24425]: 2017-09-28 12:11:44.105 24425 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:11:44 ctl02 nova-api[24425]: 2017-09-28 12:11:44.108 24425 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:11:44 ctl02 nova-api[24425]: 2017-09-28 12:11:44.108 24425 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:11:44 ctl02 nova-api[24425]: 2017-09-28 12:11:44.109 24425 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:11:44 ctl02 nova-api[24425]: 2017-09-28 12:11:44.248 24425 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:11:44 ctl02 nova-api[24425]: 2017-09-28 12:11:44.251 24425 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:11:44 ctl02 nova-api[24425]: 2017-09-28 12:11:44.252 24425 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:11:44 ctl02 nova-api[24425]: 2017-09-28 12:11:44.252 24425 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:11:44 ctl02 nova-api[24425]: 2017-09-28 12:11:44.256 24425 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:11:44 ctl02 nova-api[24425]: 2017-09-28 12:11:44.256 24425 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:11:44 ctl02 nova-api[24425]: 2017-09-28 12:11:44.256 24425 ERROR nova Traceback (most recent call last):
Sep 28 12:11:44 ctl02 nova-api[24425]: 2017-09-28 12:11:44.256 24425 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:11:44 ctl02 nova-api[24425]: 2017-09-28 12:11:44.256 24425 ERROR nova     sys.exit(main())
Sep 28 12:11:44 ctl02 nova-api[24425]: 2017-09-28 12:11:44.256 24425 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:11:44 ctl02 nova-api[24425]: 2017-09-28 12:11:44.256 24425 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:11:44 ctl02 nova-api[24425]: 2017-09-28 12:11:44.256 24425 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:11:44 ctl02 nova-api[24425]: 2017-09-28 12:11:44.256 24425 ERROR nova     max_url_len=max_url_len)
Sep 28 12:11:44 ctl02 nova-api[24425]: 2017-09-28 12:11:44.256 24425 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:11:44 ctl02 nova-api[24425]: 2017-09-28 12:11:44.256 24425 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:11:44 ctl02 nova-api[24425]: 2017-09-28 12:11:44.256 24425 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:11:44 ctl02 nova-api[24425]: 2017-09-28 12:11:44.256 24425 ERROR nova     sock.listen(backlog)
Sep 28 12:11:44 ctl02 nova-api[24425]: 2017-09-28 12:11:44.256 24425 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:11:44 ctl02 nova-api[24425]: 2017-09-28 12:11:44.256 24425 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:11:44 ctl02 nova-api[24425]: 2017-09-28 12:11:44.256 24425 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:11:44 ctl02 nova-api[24425]: 2017-09-28 12:11:44.256 24425 ERROR nova
Sep 28 12:11:44 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:11:44 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:11:44 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:11:44 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:11:44 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:11:44 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:11:44 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:11:45 ctl02 heat-api[13008]: 2017-09-28 12:11:45.270 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:11:45] "OPTIONS / HTTP/1.0" 200 134 0.000639
Sep 28 12:11:46 ctl02 glance-api[29183]: 2017-09-28 12:11:46.121 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:11:46] "OPTIONS / HTTP/1.0" 200 134 0.000640
Sep 28 12:11:46 ctl02 nova-api[24448]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:11:46 ctl02 nova-api[24448]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:11:46 ctl02 nova-api[24448]: 2017-09-28 12:11:46.518 24448 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:11:46 ctl02 nova-api[24448]: 2017-09-28 12:11:46.520 24448 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:11:46 ctl02 nova-api[24448]: 2017-09-28 12:11:46.520 24448 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:11:46 ctl02 nova-api[24448]: 2017-09-28 12:11:46.520 24448 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:11:46 ctl02 nova-api[24448]: 2017-09-28 12:11:46.520 24448 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:11:46 ctl02 nova-api[24448]: 2017-09-28 12:11:46.520 24448 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:11:46 ctl02 nova-api[24448]: 2017-09-28 12:11:46.520 24448 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:11:46 ctl02 nova-api[24448]: 2017-09-28 12:11:46.520 24448 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:11:46 ctl02 nova-api[24448]: 2017-09-28 12:11:46.520 24448 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:11:46 ctl02 nova-api[24448]: 2017-09-28 12:11:46.520 24448 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:11:46 ctl02 nova-api[24448]: 2017-09-28 12:11:46.520 24448 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:11:46 ctl02 nova-api[24448]: 2017-09-28 12:11:46.520 24448 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:11:46 ctl02 nova-api[24448]: 2017-09-28 12:11:46.520 24448 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:11:46 ctl02 nova-api[24448]: 2017-09-28 12:11:46.520 24448 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:11:46 ctl02 nova-api[24448]: 2017-09-28 12:11:46.520 24448 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:11:46 ctl02 nova-api[24448]: 2017-09-28 12:11:46.520 24448 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:11:46 ctl02 nova-api[24448]: 2017-09-28 12:11:46.520 24448 ERROR nova.wsgi     self.filename))
Sep 28 12:11:46 ctl02 nova-api[24448]: 2017-09-28 12:11:46.520 24448 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:11:46 ctl02 nova-api[24448]: 2017-09-28 12:11:46.520 24448 ERROR nova.wsgi
Sep 28 12:11:46 ctl02 nova-api[24448]: 2017-09-28 12:11:46.521 24448 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:11:46 ctl02 nova-api[24448]: 2017-09-28 12:11:46.656 24448 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:11:46 ctl02 nova-api[24448]: 2017-09-28 12:11:46.910 24448 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:11:46 ctl02 nova-api[24448]: 2017-09-28 12:11:46.912 24448 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:11:46 ctl02 nova-api[24448]: 2017-09-28 12:11:46.912 24448 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:11:46 ctl02 nova-api[24448]: 2017-09-28 12:11:46.912 24448 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:11:47 ctl02 nova-api[24448]: 2017-09-28 12:11:47.048 24448 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:11:47 ctl02 nova-api[24448]: 2017-09-28 12:11:47.050 24448 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:11:47 ctl02 nova-api[24448]: 2017-09-28 12:11:47.050 24448 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:11:47 ctl02 nova-api[24448]: 2017-09-28 12:11:47.050 24448 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:11:47 ctl02 nova-api[24448]: 2017-09-28 12:11:47.054 24448 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:11:47 ctl02 nova-api[24448]: 2017-09-28 12:11:47.054 24448 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:11:47 ctl02 nova-api[24448]: 2017-09-28 12:11:47.054 24448 ERROR nova Traceback (most recent call last):
Sep 28 12:11:47 ctl02 nova-api[24448]: 2017-09-28 12:11:47.054 24448 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:11:47 ctl02 nova-api[24448]: 2017-09-28 12:11:47.054 24448 ERROR nova     sys.exit(main())
Sep 28 12:11:47 ctl02 nova-api[24448]: 2017-09-28 12:11:47.054 24448 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:11:47 ctl02 nova-api[24448]: 2017-09-28 12:11:47.054 24448 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:11:47 ctl02 nova-api[24448]: 2017-09-28 12:11:47.054 24448 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:11:47 ctl02 nova-api[24448]: 2017-09-28 12:11:47.054 24448 ERROR nova     max_url_len=max_url_len)
Sep 28 12:11:47 ctl02 nova-api[24448]: 2017-09-28 12:11:47.054 24448 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:11:47 ctl02 nova-api[24448]: 2017-09-28 12:11:47.054 24448 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:11:47 ctl02 nova-api[24448]: 2017-09-28 12:11:47.054 24448 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:11:47 ctl02 nova-api[24448]: 2017-09-28 12:11:47.054 24448 ERROR nova     sock.listen(backlog)
Sep 28 12:11:47 ctl02 nova-api[24448]: 2017-09-28 12:11:47.054 24448 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:11:47 ctl02 nova-api[24448]: 2017-09-28 12:11:47.054 24448 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:11:47 ctl02 nova-api[24448]: 2017-09-28 12:11:47.054 24448 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:11:47 ctl02 nova-api[24448]: 2017-09-28 12:11:47.054 24448 ERROR nova
Sep 28 12:11:47 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:11:47.105 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:11:47] "OPTIONS / HTTP/1.0" 200 134 0.000651
Sep 28 12:11:47 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:11:47 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:11:47 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:11:47 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:11:47 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:11:47 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:11:47 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:11:47 ctl02 heat-api[13008]: 2017-09-28 12:11:47.865 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:11:47] "OPTIONS / HTTP/1.0" 200 134 0.000556
Sep 28 12:11:48 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:11:48.088 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:11:48] "OPTIONS / HTTP/1.0" 200 134 0.000457
Sep 28 12:11:48 ctl02 nova-cert[4860]: 2017-09-28 12:11:48.467 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:11:49 ctl02 nova-api[24466]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:11:49 ctl02 nova-api[24466]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:11:49 ctl02 nova-api[24466]: 2017-09-28 12:11:49.204 24466 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:11:49 ctl02 nova-api[24466]: 2017-09-28 12:11:49.206 24466 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:11:49 ctl02 nova-api[24466]: 2017-09-28 12:11:49.206 24466 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:11:49 ctl02 nova-api[24466]: 2017-09-28 12:11:49.206 24466 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:11:49 ctl02 nova-api[24466]: 2017-09-28 12:11:49.206 24466 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:11:49 ctl02 nova-api[24466]: 2017-09-28 12:11:49.206 24466 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:11:49 ctl02 nova-api[24466]: 2017-09-28 12:11:49.206 24466 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:11:49 ctl02 nova-api[24466]: 2017-09-28 12:11:49.206 24466 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:11:49 ctl02 nova-api[24466]: 2017-09-28 12:11:49.206 24466 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:11:49 ctl02 nova-api[24466]: 2017-09-28 12:11:49.206 24466 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:11:49 ctl02 nova-api[24466]: 2017-09-28 12:11:49.206 24466 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:11:49 ctl02 nova-api[24466]: 2017-09-28 12:11:49.206 24466 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:11:49 ctl02 nova-api[24466]: 2017-09-28 12:11:49.206 24466 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:11:49 ctl02 nova-api[24466]: 2017-09-28 12:11:49.206 24466 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:11:49 ctl02 nova-api[24466]: 2017-09-28 12:11:49.206 24466 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:11:49 ctl02 nova-api[24466]: 2017-09-28 12:11:49.206 24466 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:11:49 ctl02 nova-api[24466]: 2017-09-28 12:11:49.206 24466 ERROR nova.wsgi     self.filename))
Sep 28 12:11:49 ctl02 nova-api[24466]: 2017-09-28 12:11:49.206 24466 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:11:49 ctl02 nova-api[24466]: 2017-09-28 12:11:49.206 24466 ERROR nova.wsgi
Sep 28 12:11:49 ctl02 nova-api[24466]: 2017-09-28 12:11:49.206 24466 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:11:49 ctl02 nova-api[24466]: 2017-09-28 12:11:49.335 24466 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:11:49 ctl02 nova-api[24466]: 2017-09-28 12:11:49.565 24466 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:11:49 ctl02 nova-api[24466]: 2017-09-28 12:11:49.567 24466 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:11:49 ctl02 nova-api[24466]: 2017-09-28 12:11:49.567 24466 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:11:49 ctl02 nova-api[24466]: 2017-09-28 12:11:49.567 24466 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:11:49 ctl02 nova-api[24466]: 2017-09-28 12:11:49.696 24466 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:11:49 ctl02 nova-api[24466]: 2017-09-28 12:11:49.698 24466 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:11:49 ctl02 nova-api[24466]: 2017-09-28 12:11:49.698 24466 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:11:49 ctl02 nova-api[24466]: 2017-09-28 12:11:49.699 24466 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:11:49 ctl02 nova-api[24466]: 2017-09-28 12:11:49.702 24466 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:11:49 ctl02 nova-api[24466]: 2017-09-28 12:11:49.702 24466 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:11:49 ctl02 nova-api[24466]: 2017-09-28 12:11:49.702 24466 ERROR nova Traceback (most recent call last):
Sep 28 12:11:49 ctl02 nova-api[24466]: 2017-09-28 12:11:49.702 24466 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:11:49 ctl02 nova-api[24466]: 2017-09-28 12:11:49.702 24466 ERROR nova     sys.exit(main())
Sep 28 12:11:49 ctl02 nova-api[24466]: 2017-09-28 12:11:49.702 24466 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:11:49 ctl02 nova-api[24466]: 2017-09-28 12:11:49.702 24466 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:11:49 ctl02 nova-api[24466]: 2017-09-28 12:11:49.702 24466 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:11:49 ctl02 nova-api[24466]: 2017-09-28 12:11:49.702 24466 ERROR nova     max_url_len=max_url_len)
Sep 28 12:11:49 ctl02 nova-api[24466]: 2017-09-28 12:11:49.702 24466 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:11:49 ctl02 nova-api[24466]: 2017-09-28 12:11:49.702 24466 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:11:49 ctl02 nova-api[24466]: 2017-09-28 12:11:49.702 24466 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:11:49 ctl02 nova-api[24466]: 2017-09-28 12:11:49.702 24466 ERROR nova     sock.listen(backlog)
Sep 28 12:11:49 ctl02 nova-api[24466]: 2017-09-28 12:11:49.702 24466 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:11:49 ctl02 nova-api[24466]: 2017-09-28 12:11:49.702 24466 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:11:49 ctl02 nova-api[24466]: 2017-09-28 12:11:49.702 24466 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:11:49 ctl02 nova-api[24466]: 2017-09-28 12:11:49.702 24466 ERROR nova
Sep 28 12:11:49 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:11:49 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:11:49 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:11:49 ctl02 glance-api[29183]: 2017-09-28 12:11:49.845 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:11:49] "OPTIONS / HTTP/1.0" 200 134 0.000798
Sep 28 12:11:50 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:11:50 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:11:50 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:11:50 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:11:50 ctl02 nova-conductor[5056]: 2017-09-28 12:11:50.434 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:11:50 ctl02 nova-conductor[5056]: 2017-09-28 12:11:50.448 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:11:50 ctl02 nova-conductor[5056]: 2017-09-28 12:11:50.449 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:11:50 ctl02 nova-conductor[5056]: 2017-09-28 12:11:50.455 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:11:50 ctl02 heat-api-cfn[13300]: 2017-09-28 12:11:50.747 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:11:50] "OPTIONS / HTTP/1.0" 200 134 0.000428
Sep 28 12:11:51 ctl02 heat-api-cfn[13300]: 2017-09-28 12:11:51.584 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:11:51] "OPTIONS / HTTP/1.0" 200 134 0.000587
Sep 28 12:11:51 ctl02 nova-api[24484]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:11:51 ctl02 nova-api[24484]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:11:51 ctl02 nova-api[24484]: 2017-09-28 12:11:51.948 24484 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:11:51 ctl02 nova-api[24484]: 2017-09-28 12:11:51.950 24484 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:11:51 ctl02 nova-api[24484]: 2017-09-28 12:11:51.950 24484 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:11:51 ctl02 nova-api[24484]: 2017-09-28 12:11:51.950 24484 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:11:51 ctl02 nova-api[24484]: 2017-09-28 12:11:51.950 24484 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:11:51 ctl02 nova-api[24484]: 2017-09-28 12:11:51.950 24484 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:11:51 ctl02 nova-api[24484]: 2017-09-28 12:11:51.950 24484 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:11:51 ctl02 nova-api[24484]: 2017-09-28 12:11:51.950 24484 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:11:51 ctl02 nova-api[24484]: 2017-09-28 12:11:51.950 24484 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:11:51 ctl02 nova-api[24484]: 2017-09-28 12:11:51.950 24484 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:11:51 ctl02 nova-api[24484]: 2017-09-28 12:11:51.950 24484 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:11:51 ctl02 nova-api[24484]: 2017-09-28 12:11:51.950 24484 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:11:51 ctl02 nova-api[24484]: 2017-09-28 12:11:51.950 24484 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:11:51 ctl02 nova-api[24484]: 2017-09-28 12:11:51.950 24484 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:11:51 ctl02 nova-api[24484]: 2017-09-28 12:11:51.950 24484 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:11:51 ctl02 nova-api[24484]: 2017-09-28 12:11:51.950 24484 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:11:51 ctl02 nova-api[24484]: 2017-09-28 12:11:51.950 24484 ERROR nova.wsgi     self.filename))
Sep 28 12:11:51 ctl02 nova-api[24484]: 2017-09-28 12:11:51.950 24484 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:11:51 ctl02 nova-api[24484]: 2017-09-28 12:11:51.950 24484 ERROR nova.wsgi
Sep 28 12:11:51 ctl02 nova-api[24484]: 2017-09-28 12:11:51.950 24484 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:11:52 ctl02 nova-api[24484]: 2017-09-28 12:11:52.078 24484 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:11:52 ctl02 nova-api[24484]: 2017-09-28 12:11:52.310 24484 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:11:52 ctl02 nova-api[24484]: 2017-09-28 12:11:52.312 24484 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:11:52 ctl02 nova-api[24484]: 2017-09-28 12:11:52.312 24484 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:11:52 ctl02 nova-api[24484]: 2017-09-28 12:11:52.313 24484 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:11:52 ctl02 nova-api[24484]: 2017-09-28 12:11:52.442 24484 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:11:52 ctl02 nova-api[24484]: 2017-09-28 12:11:52.444 24484 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:11:52 ctl02 nova-api[24484]: 2017-09-28 12:11:52.444 24484 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:11:52 ctl02 nova-api[24484]: 2017-09-28 12:11:52.444 24484 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:11:52 ctl02 nova-api[24484]: 2017-09-28 12:11:52.447 24484 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:11:52 ctl02 nova-api[24484]: 2017-09-28 12:11:52.447 24484 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:11:52 ctl02 nova-api[24484]: 2017-09-28 12:11:52.447 24484 ERROR nova Traceback (most recent call last):
Sep 28 12:11:52 ctl02 nova-api[24484]: 2017-09-28 12:11:52.447 24484 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:11:52 ctl02 nova-api[24484]: 2017-09-28 12:11:52.447 24484 ERROR nova     sys.exit(main())
Sep 28 12:11:52 ctl02 nova-api[24484]: 2017-09-28 12:11:52.447 24484 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:11:52 ctl02 nova-api[24484]: 2017-09-28 12:11:52.447 24484 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:11:52 ctl02 nova-api[24484]: 2017-09-28 12:11:52.447 24484 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:11:52 ctl02 nova-api[24484]: 2017-09-28 12:11:52.447 24484 ERROR nova     max_url_len=max_url_len)
Sep 28 12:11:52 ctl02 nova-api[24484]: 2017-09-28 12:11:52.447 24484 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:11:52 ctl02 nova-api[24484]: 2017-09-28 12:11:52.447 24484 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:11:52 ctl02 nova-api[24484]: 2017-09-28 12:11:52.447 24484 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:11:52 ctl02 nova-api[24484]: 2017-09-28 12:11:52.447 24484 ERROR nova     sock.listen(backlog)
Sep 28 12:11:52 ctl02 nova-api[24484]: 2017-09-28 12:11:52.447 24484 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:11:52 ctl02 nova-api[24484]: 2017-09-28 12:11:52.447 24484 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:11:52 ctl02 nova-api[24484]: 2017-09-28 12:11:52.447 24484 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:11:52 ctl02 nova-api[24484]: 2017-09-28 12:11:52.447 24484 ERROR nova
Sep 28 12:11:52 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:11:52.555 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:11:52] "OPTIONS / HTTP/1.0" 200 134 0.000420
Sep 28 12:11:52 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:11:52 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:11:52 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:11:52 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:11:52 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:11:52 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:11:52 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:11:53 ctl02 heat-api[13008]: 2017-09-28 12:11:53.730 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:11:53] "OPTIONS / HTTP/1.0" 200 134 0.000563
Sep 28 12:11:53 ctl02 heat-api-cfn[13300]: 2017-09-28 12:11:53.732 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:11:53] "OPTIONS / HTTP/1.0" 200 134 0.000595
Sep 28 12:11:54 ctl02 glance-api[29183]: 2017-09-28 12:11:54.286 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:11:54] "OPTIONS / HTTP/1.0" 200 134 0.000644
Sep 28 12:11:54 ctl02 nova-api[24502]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:11:54 ctl02 nova-api[24502]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:11:54 ctl02 nova-api[24502]: 2017-09-28 12:11:54.770 24502 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:11:54 ctl02 nova-api[24502]: 2017-09-28 12:11:54.773 24502 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:11:54 ctl02 nova-api[24502]: 2017-09-28 12:11:54.773 24502 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:11:54 ctl02 nova-api[24502]: 2017-09-28 12:11:54.773 24502 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:11:54 ctl02 nova-api[24502]: 2017-09-28 12:11:54.773 24502 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:11:54 ctl02 nova-api[24502]: 2017-09-28 12:11:54.773 24502 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:11:54 ctl02 nova-api[24502]: 2017-09-28 12:11:54.773 24502 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:11:54 ctl02 nova-api[24502]: 2017-09-28 12:11:54.773 24502 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:11:54 ctl02 nova-api[24502]: 2017-09-28 12:11:54.773 24502 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:11:54 ctl02 nova-api[24502]: 2017-09-28 12:11:54.773 24502 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:11:54 ctl02 nova-api[24502]: 2017-09-28 12:11:54.773 24502 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:11:54 ctl02 nova-api[24502]: 2017-09-28 12:11:54.773 24502 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:11:54 ctl02 nova-api[24502]: 2017-09-28 12:11:54.773 24502 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:11:54 ctl02 nova-api[24502]: 2017-09-28 12:11:54.773 24502 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:11:54 ctl02 nova-api[24502]: 2017-09-28 12:11:54.773 24502 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:11:54 ctl02 nova-api[24502]: 2017-09-28 12:11:54.773 24502 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:11:54 ctl02 nova-api[24502]: 2017-09-28 12:11:54.773 24502 ERROR nova.wsgi     self.filename))
Sep 28 12:11:54 ctl02 nova-api[24502]: 2017-09-28 12:11:54.773 24502 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:11:54 ctl02 nova-api[24502]: 2017-09-28 12:11:54.773 24502 ERROR nova.wsgi
Sep 28 12:11:54 ctl02 nova-api[24502]: 2017-09-28 12:11:54.775 24502 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:11:54 ctl02 nova-api[24502]: 2017-09-28 12:11:54.909 24502 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:11:54 ctl02 heat-api[13008]: 2017-09-28 12:11:54.984 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:11:54] "OPTIONS / HTTP/1.0" 200 134 0.000661
Sep 28 12:11:55 ctl02 nova-api[24502]: 2017-09-28 12:11:55.163 24502 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:11:55 ctl02 nova-api[24502]: 2017-09-28 12:11:55.165 24502 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:11:55 ctl02 nova-api[24502]: 2017-09-28 12:11:55.165 24502 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:11:55 ctl02 nova-api[24502]: 2017-09-28 12:11:55.166 24502 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:11:55 ctl02 nova-api[24502]: 2017-09-28 12:11:55.298 24502 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:11:55 ctl02 nova-api[24502]: 2017-09-28 12:11:55.300 24502 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:11:55 ctl02 nova-api[24502]: 2017-09-28 12:11:55.301 24502 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:11:55 ctl02 nova-api[24502]: 2017-09-28 12:11:55.301 24502 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:11:55 ctl02 nova-api[24502]: 2017-09-28 12:11:55.304 24502 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:11:55 ctl02 nova-api[24502]: 2017-09-28 12:11:55.305 24502 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:11:55 ctl02 nova-api[24502]: 2017-09-28 12:11:55.305 24502 ERROR nova Traceback (most recent call last):
Sep 28 12:11:55 ctl02 nova-api[24502]: 2017-09-28 12:11:55.305 24502 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:11:55 ctl02 nova-api[24502]: 2017-09-28 12:11:55.305 24502 ERROR nova     sys.exit(main())
Sep 28 12:11:55 ctl02 nova-api[24502]: 2017-09-28 12:11:55.305 24502 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:11:55 ctl02 nova-api[24502]: 2017-09-28 12:11:55.305 24502 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:11:55 ctl02 nova-api[24502]: 2017-09-28 12:11:55.305 24502 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:11:55 ctl02 nova-api[24502]: 2017-09-28 12:11:55.305 24502 ERROR nova     max_url_len=max_url_len)
Sep 28 12:11:55 ctl02 nova-api[24502]: 2017-09-28 12:11:55.305 24502 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:11:55 ctl02 nova-api[24502]: 2017-09-28 12:11:55.305 24502 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:11:55 ctl02 nova-api[24502]: 2017-09-28 12:11:55.305 24502 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:11:55 ctl02 nova-api[24502]: 2017-09-28 12:11:55.305 24502 ERROR nova     sock.listen(backlog)
Sep 28 12:11:55 ctl02 nova-api[24502]: 2017-09-28 12:11:55.305 24502 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:11:55 ctl02 nova-api[24502]: 2017-09-28 12:11:55.305 24502 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:11:55 ctl02 nova-api[24502]: 2017-09-28 12:11:55.305 24502 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:11:55 ctl02 nova-api[24502]: 2017-09-28 12:11:55.305 24502 ERROR nova
Sep 28 12:11:55 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:11:55 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:11:55 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:11:55 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:11:55 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:11:55 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:11:55 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:11:55 ctl02 dhclient[600]: DHCPREQUEST of 192.168.11.25 on ens2 to 192.168.11.3 port 67 (xid=0x3415f07)
Sep 28 12:11:56 ctl02 glance-api[29183]: 2017-09-28 12:11:56.037 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:11:56] "OPTIONS / HTTP/1.0" 200 134 0.000708
Sep 28 12:11:56 ctl02 dhclient[600]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 12:11:56 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 12:11:56 ctl02 ntp[24584]:  * Stopping NTP server ntpd
Sep 28 12:11:56 ctl02 ntp[24584]:    ...done.
Sep 28 12:11:56 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 12:11:56 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 12:11:56 ctl02 ntp[24594]:  * Starting NTP server ntpd
Sep 28 12:11:56 ctl02 ntpd[24602]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 12:11:56 ctl02 ntpd[24602]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -c /var/lib/ntp/ntp.conf.dhcp -u 108:112
Sep 28 12:11:56 ctl02 ntp[24594]:    ...done.
Sep 28 12:11:56 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 12:11:56 ctl02 ntpd[24605]: proto: precision = 0.042 usec (-24)
Sep 28 12:11:56 ctl02 ntpd[24605]: switching logging to file /var/log/ntp.log
Sep 28 12:11:56 ctl02 dhclient[600]: bound to 192.168.11.25 -- renewal in 258 seconds.
Sep 28 12:11:56 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:11:56.915 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:11:56] "OPTIONS / HTTP/1.0" 200 134 0.000467
Sep 28 12:11:57 ctl02 nova-api[24520]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:11:57 ctl02 nova-api[24520]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:11:57 ctl02 nova-api[24520]: 2017-09-28 12:11:57.535 24520 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:11:57 ctl02 nova-api[24520]: 2017-09-28 12:11:57.537 24520 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:11:57 ctl02 nova-api[24520]: 2017-09-28 12:11:57.537 24520 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:11:57 ctl02 nova-api[24520]: 2017-09-28 12:11:57.537 24520 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:11:57 ctl02 nova-api[24520]: 2017-09-28 12:11:57.537 24520 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:11:57 ctl02 nova-api[24520]: 2017-09-28 12:11:57.537 24520 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:11:57 ctl02 nova-api[24520]: 2017-09-28 12:11:57.537 24520 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:11:57 ctl02 nova-api[24520]: 2017-09-28 12:11:57.537 24520 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:11:57 ctl02 nova-api[24520]: 2017-09-28 12:11:57.537 24520 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:11:57 ctl02 nova-api[24520]: 2017-09-28 12:11:57.537 24520 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:11:57 ctl02 nova-api[24520]: 2017-09-28 12:11:57.537 24520 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:11:57 ctl02 nova-api[24520]: 2017-09-28 12:11:57.537 24520 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:11:57 ctl02 nova-api[24520]: 2017-09-28 12:11:57.537 24520 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:11:57 ctl02 nova-api[24520]: 2017-09-28 12:11:57.537 24520 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:11:57 ctl02 nova-api[24520]: 2017-09-28 12:11:57.537 24520 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:11:57 ctl02 nova-api[24520]: 2017-09-28 12:11:57.537 24520 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:11:57 ctl02 nova-api[24520]: 2017-09-28 12:11:57.537 24520 ERROR nova.wsgi     self.filename))
Sep 28 12:11:57 ctl02 nova-api[24520]: 2017-09-28 12:11:57.537 24520 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:11:57 ctl02 nova-api[24520]: 2017-09-28 12:11:57.537 24520 ERROR nova.wsgi
Sep 28 12:11:57 ctl02 nova-api[24520]: 2017-09-28 12:11:57.538 24520 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:11:57 ctl02 nova-api[24520]: 2017-09-28 12:11:57.670 24520 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:11:57 ctl02 nova-api[24520]: 2017-09-28 12:11:57.922 24520 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:11:57 ctl02 nova-api[24520]: 2017-09-28 12:11:57.925 24520 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:11:57 ctl02 nova-api[24520]: 2017-09-28 12:11:57.925 24520 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:11:57 ctl02 nova-api[24520]: 2017-09-28 12:11:57.925 24520 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:11:58 ctl02 nova-api[24520]: 2017-09-28 12:11:58.059 24520 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:11:58 ctl02 nova-api[24520]: 2017-09-28 12:11:58.061 24520 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:11:58 ctl02 nova-api[24520]: 2017-09-28 12:11:58.061 24520 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:11:58 ctl02 nova-api[24520]: 2017-09-28 12:11:58.061 24520 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:11:58 ctl02 nova-api[24520]: 2017-09-28 12:11:58.064 24520 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:11:58 ctl02 nova-api[24520]: 2017-09-28 12:11:58.065 24520 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:11:58 ctl02 nova-api[24520]: 2017-09-28 12:11:58.065 24520 ERROR nova Traceback (most recent call last):
Sep 28 12:11:58 ctl02 nova-api[24520]: 2017-09-28 12:11:58.065 24520 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:11:58 ctl02 nova-api[24520]: 2017-09-28 12:11:58.065 24520 ERROR nova     sys.exit(main())
Sep 28 12:11:58 ctl02 nova-api[24520]: 2017-09-28 12:11:58.065 24520 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:11:58 ctl02 nova-api[24520]: 2017-09-28 12:11:58.065 24520 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:11:58 ctl02 nova-api[24520]: 2017-09-28 12:11:58.065 24520 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:11:58 ctl02 nova-api[24520]: 2017-09-28 12:11:58.065 24520 ERROR nova     max_url_len=max_url_len)
Sep 28 12:11:58 ctl02 nova-api[24520]: 2017-09-28 12:11:58.065 24520 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:11:58 ctl02 nova-api[24520]: 2017-09-28 12:11:58.065 24520 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:11:58 ctl02 nova-api[24520]: 2017-09-28 12:11:58.065 24520 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:11:58 ctl02 nova-api[24520]: 2017-09-28 12:11:58.065 24520 ERROR nova     sock.listen(backlog)
Sep 28 12:11:58 ctl02 nova-api[24520]: 2017-09-28 12:11:58.065 24520 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:11:58 ctl02 nova-api[24520]: 2017-09-28 12:11:58.065 24520 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:11:58 ctl02 nova-api[24520]: 2017-09-28 12:11:58.065 24520 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:11:58 ctl02 nova-api[24520]: 2017-09-28 12:11:58.065 24520 ERROR nova
Sep 28 12:11:58 ctl02 heat-api[13008]: 2017-09-28 12:11:58.143 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:11:58] "OPTIONS / HTTP/1.0" 200 134 0.000614
Sep 28 12:11:58 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:11:58 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:11:58 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:11:58 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:11:58.330 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:11:58] "OPTIONS / HTTP/1.0" 200 134 0.000497
Sep 28 12:11:58 ctl02 nova-consoleauth[5433]: 2017-09-28 12:11:58.367 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:11:58 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:11:58 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:11:58 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:11:58 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:11:58 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xbd56b14e)
Sep 28 12:11:59 ctl02 glance-api[29183]: 2017-09-28 12:11:59.897 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:11:59] "OPTIONS / HTTP/1.0" 200 134 0.000989
Sep 28 12:11:59 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xbd56b14e)
Sep 28 12:12:00 ctl02 nova-api[24620]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:12:00 ctl02 nova-api[24620]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:12:00 ctl02 nova-api[24620]: 2017-09-28 12:12:00.214 24620 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:12:00 ctl02 nova-api[24620]: 2017-09-28 12:12:00.216 24620 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:12:00 ctl02 nova-api[24620]: 2017-09-28 12:12:00.216 24620 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:12:00 ctl02 nova-api[24620]: 2017-09-28 12:12:00.216 24620 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:12:00 ctl02 nova-api[24620]: 2017-09-28 12:12:00.216 24620 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:12:00 ctl02 nova-api[24620]: 2017-09-28 12:12:00.216 24620 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:12:00 ctl02 nova-api[24620]: 2017-09-28 12:12:00.216 24620 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:12:00 ctl02 nova-api[24620]: 2017-09-28 12:12:00.216 24620 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:12:00 ctl02 nova-api[24620]: 2017-09-28 12:12:00.216 24620 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:12:00 ctl02 nova-api[24620]: 2017-09-28 12:12:00.216 24620 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:12:00 ctl02 nova-api[24620]: 2017-09-28 12:12:00.216 24620 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:12:00 ctl02 nova-api[24620]: 2017-09-28 12:12:00.216 24620 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:12:00 ctl02 nova-api[24620]: 2017-09-28 12:12:00.216 24620 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:12:00 ctl02 nova-api[24620]: 2017-09-28 12:12:00.216 24620 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:12:00 ctl02 nova-api[24620]: 2017-09-28 12:12:00.216 24620 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:12:00 ctl02 nova-api[24620]: 2017-09-28 12:12:00.216 24620 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:12:00 ctl02 nova-api[24620]: 2017-09-28 12:12:00.216 24620 ERROR nova.wsgi     self.filename))
Sep 28 12:12:00 ctl02 nova-api[24620]: 2017-09-28 12:12:00.216 24620 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:12:00 ctl02 nova-api[24620]: 2017-09-28 12:12:00.216 24620 ERROR nova.wsgi
Sep 28 12:12:00 ctl02 nova-api[24620]: 2017-09-28 12:12:00.217 24620 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:12:00 ctl02 nova-api[24620]: 2017-09-28 12:12:00.351 24620 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:12:00 ctl02 nova-api[24620]: 2017-09-28 12:12:00.572 24620 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:12:00 ctl02 nova-api[24620]: 2017-09-28 12:12:00.574 24620 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:12:00 ctl02 nova-api[24620]: 2017-09-28 12:12:00.574 24620 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:12:00 ctl02 nova-api[24620]: 2017-09-28 12:12:00.574 24620 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:12:00 ctl02 nova-api[24620]: 2017-09-28 12:12:00.707 24620 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:12:00 ctl02 nova-api[24620]: 2017-09-28 12:12:00.709 24620 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:12:00 ctl02 nova-api[24620]: 2017-09-28 12:12:00.709 24620 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:12:00 ctl02 nova-api[24620]: 2017-09-28 12:12:00.710 24620 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:12:00 ctl02 nova-api[24620]: 2017-09-28 12:12:00.713 24620 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:12:00 ctl02 nova-api[24620]: 2017-09-28 12:12:00.713 24620 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:12:00 ctl02 nova-api[24620]: 2017-09-28 12:12:00.713 24620 ERROR nova Traceback (most recent call last):
Sep 28 12:12:00 ctl02 nova-api[24620]: 2017-09-28 12:12:00.713 24620 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:12:00 ctl02 nova-api[24620]: 2017-09-28 12:12:00.713 24620 ERROR nova     sys.exit(main())
Sep 28 12:12:00 ctl02 nova-api[24620]: 2017-09-28 12:12:00.713 24620 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:12:00 ctl02 nova-api[24620]: 2017-09-28 12:12:00.713 24620 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:12:00 ctl02 nova-api[24620]: 2017-09-28 12:12:00.713 24620 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:12:00 ctl02 nova-api[24620]: 2017-09-28 12:12:00.713 24620 ERROR nova     max_url_len=max_url_len)
Sep 28 12:12:00 ctl02 nova-api[24620]: 2017-09-28 12:12:00.713 24620 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:12:00 ctl02 nova-api[24620]: 2017-09-28 12:12:00.713 24620 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:12:00 ctl02 nova-api[24620]: 2017-09-28 12:12:00.713 24620 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:12:00 ctl02 nova-api[24620]: 2017-09-28 12:12:00.713 24620 ERROR nova     sock.listen(backlog)
Sep 28 12:12:00 ctl02 nova-api[24620]: 2017-09-28 12:12:00.713 24620 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:12:00 ctl02 nova-api[24620]: 2017-09-28 12:12:00.713 24620 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:12:00 ctl02 nova-api[24620]: 2017-09-28 12:12:00.713 24620 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:12:00 ctl02 nova-api[24620]: 2017-09-28 12:12:00.713 24620 ERROR nova
Sep 28 12:12:00 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:12:00 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:12:00 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:12:00 ctl02 heat-api-cfn[13300]: 2017-09-28 12:12:00.854 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:12:00] "OPTIONS / HTTP/1.0" 200 134 0.000791
Sep 28 12:12:00 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xbd56b14e)
Sep 28 12:12:01 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:12:01 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:12:01 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:12:01 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:12:01 ctl02 nova-scheduler[5620]: 2017-09-28 12:12:01.386 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:12:01 ctl02 heat-engine[12803]: 2017-09-28 12:12:01.499 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:12:01 ctl02 heat-engine[12803]: 2017-09-28 12:12:01.527 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:12:01 ctl02 heat-engine[12803]: 2017-09-28 12:12:01.541 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:12:01 ctl02 heat-engine[12803]: 2017-09-28 12:12:01.550 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:12:01 ctl02 heat-api-cfn[13300]: 2017-09-28 12:12:01.604 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:12:01] "OPTIONS / HTTP/1.0" 200 134 0.000644
Sep 28 12:12:01 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xbd56b14e)
Sep 28 12:12:02 ctl02 nova-api[24638]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:12:02 ctl02 nova-api[24638]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:12:02 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:12:02.874 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:12:02] "OPTIONS / HTTP/1.0" 200 134 0.000475
Sep 28 12:12:02 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xbd56b14e)
Sep 28 12:12:03 ctl02 nova-api[24638]: 2017-09-28 12:12:03.031 24638 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:12:03 ctl02 nova-api[24638]: 2017-09-28 12:12:03.033 24638 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:12:03 ctl02 nova-api[24638]: 2017-09-28 12:12:03.033 24638 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:12:03 ctl02 nova-api[24638]: 2017-09-28 12:12:03.033 24638 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:12:03 ctl02 nova-api[24638]: 2017-09-28 12:12:03.033 24638 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:12:03 ctl02 nova-api[24638]: 2017-09-28 12:12:03.033 24638 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:12:03 ctl02 nova-api[24638]: 2017-09-28 12:12:03.033 24638 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:12:03 ctl02 nova-api[24638]: 2017-09-28 12:12:03.033 24638 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:12:03 ctl02 nova-api[24638]: 2017-09-28 12:12:03.033 24638 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:12:03 ctl02 nova-api[24638]: 2017-09-28 12:12:03.033 24638 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:12:03 ctl02 nova-api[24638]: 2017-09-28 12:12:03.033 24638 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:12:03 ctl02 nova-api[24638]: 2017-09-28 12:12:03.033 24638 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:12:03 ctl02 nova-api[24638]: 2017-09-28 12:12:03.033 24638 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:12:03 ctl02 nova-api[24638]: 2017-09-28 12:12:03.033 24638 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:12:03 ctl02 nova-api[24638]: 2017-09-28 12:12:03.033 24638 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:12:03 ctl02 nova-api[24638]: 2017-09-28 12:12:03.033 24638 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:12:03 ctl02 nova-api[24638]: 2017-09-28 12:12:03.033 24638 ERROR nova.wsgi     self.filename))
Sep 28 12:12:03 ctl02 nova-api[24638]: 2017-09-28 12:12:03.033 24638 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:12:03 ctl02 nova-api[24638]: 2017-09-28 12:12:03.033 24638 ERROR nova.wsgi
Sep 28 12:12:03 ctl02 nova-api[24638]: 2017-09-28 12:12:03.034 24638 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:12:03 ctl02 nova-api[24638]: 2017-09-28 12:12:03.168 24638 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:12:03 ctl02 nova-api[24638]: 2017-09-28 12:12:03.420 24638 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:12:03 ctl02 nova-api[24638]: 2017-09-28 12:12:03.422 24638 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:12:03 ctl02 nova-api[24638]: 2017-09-28 12:12:03.423 24638 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:12:03 ctl02 nova-api[24638]: 2017-09-28 12:12:03.423 24638 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:12:03 ctl02 nova-api[24638]: 2017-09-28 12:12:03.558 24638 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:12:03 ctl02 nova-api[24638]: 2017-09-28 12:12:03.560 24638 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:12:03 ctl02 nova-api[24638]: 2017-09-28 12:12:03.560 24638 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:12:03 ctl02 nova-api[24638]: 2017-09-28 12:12:03.561 24638 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:12:03 ctl02 nova-api[24638]: 2017-09-28 12:12:03.564 24638 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:12:03 ctl02 nova-api[24638]: 2017-09-28 12:12:03.564 24638 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:12:03 ctl02 nova-api[24638]: 2017-09-28 12:12:03.564 24638 ERROR nova Traceback (most recent call last):
Sep 28 12:12:03 ctl02 nova-api[24638]: 2017-09-28 12:12:03.564 24638 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:12:03 ctl02 nova-api[24638]: 2017-09-28 12:12:03.564 24638 ERROR nova     sys.exit(main())
Sep 28 12:12:03 ctl02 nova-api[24638]: 2017-09-28 12:12:03.564 24638 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:12:03 ctl02 nova-api[24638]: 2017-09-28 12:12:03.564 24638 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:12:03 ctl02 nova-api[24638]: 2017-09-28 12:12:03.564 24638 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:12:03 ctl02 nova-api[24638]: 2017-09-28 12:12:03.564 24638 ERROR nova     max_url_len=max_url_len)
Sep 28 12:12:03 ctl02 nova-api[24638]: 2017-09-28 12:12:03.564 24638 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:12:03 ctl02 nova-api[24638]: 2017-09-28 12:12:03.564 24638 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:12:03 ctl02 nova-api[24638]: 2017-09-28 12:12:03.564 24638 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:12:03 ctl02 nova-api[24638]: 2017-09-28 12:12:03.564 24638 ERROR nova     sock.listen(backlog)
Sep 28 12:12:03 ctl02 nova-api[24638]: 2017-09-28 12:12:03.564 24638 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:12:03 ctl02 nova-api[24638]: 2017-09-28 12:12:03.564 24638 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:12:03 ctl02 nova-api[24638]: 2017-09-28 12:12:03.564 24638 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:12:03 ctl02 nova-api[24638]: 2017-09-28 12:12:03.564 24638 ERROR nova
Sep 28 12:12:03 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:12:03 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:12:03 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:12:03 ctl02 heat-api-cfn[13300]: 2017-09-28 12:12:03.866 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:12:03] "OPTIONS / HTTP/1.0" 200 134 0.000503
Sep 28 12:12:03 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:12:03 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:12:03 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:12:03 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:12:03 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xbd56b14e)
Sep 28 12:12:04 ctl02 heat-api[13008]: 2017-09-28 12:12:04.093 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:12:04] "OPTIONS / HTTP/1.0" 200 134 0.000616
Sep 28 12:12:04 ctl02 glance-api[29183]: 2017-09-28 12:12:04.520 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:12:04] "OPTIONS / HTTP/1.0" 200 134 0.000748
Sep 28 12:12:04 ctl02 heat-api[13008]: 2017-09-28 12:12:04.790 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:12:04] "OPTIONS / HTTP/1.0" 200 134 0.000611
Sep 28 12:12:04 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xbd56b14e)
Sep 28 12:12:05 ctl02 nova-api[24656]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:12:05 ctl02 nova-api[24656]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:12:05 ctl02 nova-api[24656]: 2017-09-28 12:12:05.797 24656 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:12:05 ctl02 nova-api[24656]: 2017-09-28 12:12:05.799 24656 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:12:05 ctl02 nova-api[24656]: 2017-09-28 12:12:05.799 24656 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:12:05 ctl02 nova-api[24656]: 2017-09-28 12:12:05.799 24656 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:12:05 ctl02 nova-api[24656]: 2017-09-28 12:12:05.799 24656 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:12:05 ctl02 nova-api[24656]: 2017-09-28 12:12:05.799 24656 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:12:05 ctl02 nova-api[24656]: 2017-09-28 12:12:05.799 24656 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:12:05 ctl02 nova-api[24656]: 2017-09-28 12:12:05.799 24656 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:12:05 ctl02 nova-api[24656]: 2017-09-28 12:12:05.799 24656 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:12:05 ctl02 nova-api[24656]: 2017-09-28 12:12:05.799 24656 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:12:05 ctl02 nova-api[24656]: 2017-09-28 12:12:05.799 24656 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:12:05 ctl02 nova-api[24656]: 2017-09-28 12:12:05.799 24656 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:12:05 ctl02 nova-api[24656]: 2017-09-28 12:12:05.799 24656 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:12:05 ctl02 nova-api[24656]: 2017-09-28 12:12:05.799 24656 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:12:05 ctl02 nova-api[24656]: 2017-09-28 12:12:05.799 24656 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:12:05 ctl02 nova-api[24656]: 2017-09-28 12:12:05.799 24656 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:12:05 ctl02 nova-api[24656]: 2017-09-28 12:12:05.799 24656 ERROR nova.wsgi     self.filename))
Sep 28 12:12:05 ctl02 nova-api[24656]: 2017-09-28 12:12:05.799 24656 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:12:05 ctl02 nova-api[24656]: 2017-09-28 12:12:05.799 24656 ERROR nova.wsgi
Sep 28 12:12:05 ctl02 nova-api[24656]: 2017-09-28 12:12:05.800 24656 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:12:05 ctl02 glance-api[29183]: 2017-09-28 12:12:05.863 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:12:05] "OPTIONS / HTTP/1.0" 200 134 0.000639
Sep 28 12:12:05 ctl02 nova-api[24656]: 2017-09-28 12:12:05.940 24656 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:12:05 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xbd56b14e)
Sep 28 12:12:06 ctl02 nova-api[24656]: 2017-09-28 12:12:06.198 24656 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:12:06 ctl02 nova-api[24656]: 2017-09-28 12:12:06.201 24656 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:12:06 ctl02 nova-api[24656]: 2017-09-28 12:12:06.201 24656 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:12:06 ctl02 nova-api[24656]: 2017-09-28 12:12:06.201 24656 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:12:06 ctl02 nova-api[24656]: 2017-09-28 12:12:06.341 24656 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:12:06 ctl02 nova-api[24656]: 2017-09-28 12:12:06.343 24656 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:12:06 ctl02 nova-api[24656]: 2017-09-28 12:12:06.343 24656 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:12:06 ctl02 nova-api[24656]: 2017-09-28 12:12:06.343 24656 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:12:06 ctl02 nova-api[24656]: 2017-09-28 12:12:06.347 24656 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:12:06 ctl02 nova-api[24656]: 2017-09-28 12:12:06.347 24656 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:12:06 ctl02 nova-api[24656]: 2017-09-28 12:12:06.347 24656 ERROR nova Traceback (most recent call last):
Sep 28 12:12:06 ctl02 nova-api[24656]: 2017-09-28 12:12:06.347 24656 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:12:06 ctl02 nova-api[24656]: 2017-09-28 12:12:06.347 24656 ERROR nova     sys.exit(main())
Sep 28 12:12:06 ctl02 nova-api[24656]: 2017-09-28 12:12:06.347 24656 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:12:06 ctl02 nova-api[24656]: 2017-09-28 12:12:06.347 24656 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:12:06 ctl02 nova-api[24656]: 2017-09-28 12:12:06.347 24656 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:12:06 ctl02 nova-api[24656]: 2017-09-28 12:12:06.347 24656 ERROR nova     max_url_len=max_url_len)
Sep 28 12:12:06 ctl02 nova-api[24656]: 2017-09-28 12:12:06.347 24656 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:12:06 ctl02 nova-api[24656]: 2017-09-28 12:12:06.347 24656 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:12:06 ctl02 nova-api[24656]: 2017-09-28 12:12:06.347 24656 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:12:06 ctl02 nova-api[24656]: 2017-09-28 12:12:06.347 24656 ERROR nova     sock.listen(backlog)
Sep 28 12:12:06 ctl02 nova-api[24656]: 2017-09-28 12:12:06.347 24656 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:12:06 ctl02 nova-api[24656]: 2017-09-28 12:12:06.347 24656 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:12:06 ctl02 nova-api[24656]: 2017-09-28 12:12:06.347 24656 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:12:06 ctl02 nova-api[24656]: 2017-09-28 12:12:06.347 24656 ERROR nova
Sep 28 12:12:06 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:12:06 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:12:06 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:12:06 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:12:06.560 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:12:06] "OPTIONS / HTTP/1.0" 200 134 0.000414
Sep 28 12:12:06 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:12:06 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:12:06 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:12:06 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:12:06 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xbd56b14e)
Sep 28 12:12:07 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xbd56b14e)
Sep 28 12:12:08 ctl02 heat-api[13008]: 2017-09-28 12:12:08.024 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:12:08] "OPTIONS / HTTP/1.0" 200 134 0.000658
Sep 28 12:12:08 ctl02 nova-api[24674]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:12:08 ctl02 nova-api[24674]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:12:08 ctl02 nova-api[24674]: 2017-09-28 12:12:08.515 24674 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:12:08 ctl02 nova-api[24674]: 2017-09-28 12:12:08.517 24674 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:12:08 ctl02 nova-api[24674]: 2017-09-28 12:12:08.517 24674 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:12:08 ctl02 nova-api[24674]: 2017-09-28 12:12:08.517 24674 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:12:08 ctl02 nova-api[24674]: 2017-09-28 12:12:08.517 24674 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:12:08 ctl02 nova-api[24674]: 2017-09-28 12:12:08.517 24674 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:12:08 ctl02 nova-api[24674]: 2017-09-28 12:12:08.517 24674 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:12:08 ctl02 nova-api[24674]: 2017-09-28 12:12:08.517 24674 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:12:08 ctl02 nova-api[24674]: 2017-09-28 12:12:08.517 24674 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:12:08 ctl02 nova-api[24674]: 2017-09-28 12:12:08.517 24674 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:12:08 ctl02 nova-api[24674]: 2017-09-28 12:12:08.517 24674 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:12:08 ctl02 nova-api[24674]: 2017-09-28 12:12:08.517 24674 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:12:08 ctl02 nova-api[24674]: 2017-09-28 12:12:08.517 24674 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:12:08 ctl02 nova-api[24674]: 2017-09-28 12:12:08.517 24674 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:12:08 ctl02 nova-api[24674]: 2017-09-28 12:12:08.517 24674 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:12:08 ctl02 nova-api[24674]: 2017-09-28 12:12:08.517 24674 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:12:08 ctl02 nova-api[24674]: 2017-09-28 12:12:08.517 24674 ERROR nova.wsgi     self.filename))
Sep 28 12:12:08 ctl02 nova-api[24674]: 2017-09-28 12:12:08.517 24674 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:12:08 ctl02 nova-api[24674]: 2017-09-28 12:12:08.517 24674 ERROR nova.wsgi
Sep 28 12:12:08 ctl02 nova-api[24674]: 2017-09-28 12:12:08.518 24674 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:12:08 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:12:08.601 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:12:08] "OPTIONS / HTTP/1.0" 200 134 0.000472
Sep 28 12:12:08 ctl02 nova-api[24674]: 2017-09-28 12:12:08.654 24674 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:12:08 ctl02 nova-api[24674]: 2017-09-28 12:12:08.909 24674 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:12:08 ctl02 nova-api[24674]: 2017-09-28 12:12:08.911 24674 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:12:08 ctl02 nova-api[24674]: 2017-09-28 12:12:08.911 24674 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:12:08 ctl02 nova-api[24674]: 2017-09-28 12:12:08.912 24674 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:12:08 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xbd56b14e)
Sep 28 12:12:09 ctl02 nova-api[24674]: 2017-09-28 12:12:09.050 24674 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:12:09 ctl02 nova-api[24674]: 2017-09-28 12:12:09.052 24674 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:12:09 ctl02 nova-api[24674]: 2017-09-28 12:12:09.052 24674 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:12:09 ctl02 nova-api[24674]: 2017-09-28 12:12:09.053 24674 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:12:09 ctl02 nova-api[24674]: 2017-09-28 12:12:09.056 24674 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:12:09 ctl02 nova-api[24674]: 2017-09-28 12:12:09.056 24674 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:12:09 ctl02 nova-api[24674]: 2017-09-28 12:12:09.056 24674 ERROR nova Traceback (most recent call last):
Sep 28 12:12:09 ctl02 nova-api[24674]: 2017-09-28 12:12:09.056 24674 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:12:09 ctl02 nova-api[24674]: 2017-09-28 12:12:09.056 24674 ERROR nova     sys.exit(main())
Sep 28 12:12:09 ctl02 nova-api[24674]: 2017-09-28 12:12:09.056 24674 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:12:09 ctl02 nova-api[24674]: 2017-09-28 12:12:09.056 24674 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:12:09 ctl02 nova-api[24674]: 2017-09-28 12:12:09.056 24674 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:12:09 ctl02 nova-api[24674]: 2017-09-28 12:12:09.056 24674 ERROR nova     max_url_len=max_url_len)
Sep 28 12:12:09 ctl02 nova-api[24674]: 2017-09-28 12:12:09.056 24674 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:12:09 ctl02 nova-api[24674]: 2017-09-28 12:12:09.056 24674 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:12:09 ctl02 nova-api[24674]: 2017-09-28 12:12:09.056 24674 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:12:09 ctl02 nova-api[24674]: 2017-09-28 12:12:09.056 24674 ERROR nova     sock.listen(backlog)
Sep 28 12:12:09 ctl02 nova-api[24674]: 2017-09-28 12:12:09.056 24674 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:12:09 ctl02 nova-api[24674]: 2017-09-28 12:12:09.056 24674 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:12:09 ctl02 nova-api[24674]: 2017-09-28 12:12:09.056 24674 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:12:09 ctl02 nova-api[24674]: 2017-09-28 12:12:09.056 24674 ERROR nova
Sep 28 12:12:09 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:12:09 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:12:09 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:12:09 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:12:09 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:12:09 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:12:09 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:12:09 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:12:09 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:12:10 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 12:12:10 ctl02 ntp[24747]:  * Stopping NTP server ntpd
Sep 28 12:12:10 ctl02 ntp[24747]:    ...done.
Sep 28 12:12:10 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 12:12:10 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 12:12:10 ctl02 ntp[24758]:  * Starting NTP server ntpd
Sep 28 12:12:10 ctl02 ntpd[24765]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 12:12:10 ctl02 ntpd[24765]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 12:12:10 ctl02 ntp[24758]:    ...done.
Sep 28 12:12:10 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 12:12:10 ctl02 ntpd[24768]: proto: precision = 0.044 usec (-24)
Sep 28 12:12:10 ctl02 ntpd[24768]: switching logging to file /var/log/ntp.log
Sep 28 12:12:10 ctl02 glance-api[29183]: 2017-09-28 12:12:10.159 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:12:10] "OPTIONS / HTTP/1.0" 200 134 0.000672
Sep 28 12:12:11 ctl02 heat-api-cfn[13300]: 2017-09-28 12:12:11.010 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:12:11] "OPTIONS / HTTP/1.0" 200 134 0.000504
Sep 28 12:12:11 ctl02 nova-api[24692]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:12:11 ctl02 nova-api[24692]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:12:11 ctl02 nova-api[24692]: 2017-09-28 12:12:11.246 24692 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:12:11 ctl02 nova-api[24692]: 2017-09-28 12:12:11.248 24692 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:12:11 ctl02 nova-api[24692]: 2017-09-28 12:12:11.248 24692 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:12:11 ctl02 nova-api[24692]: 2017-09-28 12:12:11.248 24692 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:12:11 ctl02 nova-api[24692]: 2017-09-28 12:12:11.248 24692 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:12:11 ctl02 nova-api[24692]: 2017-09-28 12:12:11.248 24692 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:12:11 ctl02 nova-api[24692]: 2017-09-28 12:12:11.248 24692 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:12:11 ctl02 nova-api[24692]: 2017-09-28 12:12:11.248 24692 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:12:11 ctl02 nova-api[24692]: 2017-09-28 12:12:11.248 24692 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:12:11 ctl02 nova-api[24692]: 2017-09-28 12:12:11.248 24692 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:12:11 ctl02 nova-api[24692]: 2017-09-28 12:12:11.248 24692 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:12:11 ctl02 nova-api[24692]: 2017-09-28 12:12:11.248 24692 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:12:11 ctl02 nova-api[24692]: 2017-09-28 12:12:11.248 24692 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:12:11 ctl02 nova-api[24692]: 2017-09-28 12:12:11.248 24692 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:12:11 ctl02 nova-api[24692]: 2017-09-28 12:12:11.248 24692 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:12:11 ctl02 nova-api[24692]: 2017-09-28 12:12:11.248 24692 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:12:11 ctl02 nova-api[24692]: 2017-09-28 12:12:11.248 24692 ERROR nova.wsgi     self.filename))
Sep 28 12:12:11 ctl02 nova-api[24692]: 2017-09-28 12:12:11.248 24692 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:12:11 ctl02 nova-api[24692]: 2017-09-28 12:12:11.248 24692 ERROR nova.wsgi
Sep 28 12:12:11 ctl02 nova-api[24692]: 2017-09-28 12:12:11.250 24692 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:12:11 ctl02 nova-api[24692]: 2017-09-28 12:12:11.384 24692 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:12:11 ctl02 heat-api-cfn[13300]: 2017-09-28 12:12:11.489 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:12:11] "OPTIONS / HTTP/1.0" 200 134 0.000563
Sep 28 12:12:11 ctl02 nova-api[24692]: 2017-09-28 12:12:11.637 24692 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:12:11 ctl02 nova-api[24692]: 2017-09-28 12:12:11.639 24692 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:12:11 ctl02 nova-api[24692]: 2017-09-28 12:12:11.656 24692 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:12:11 ctl02 nova-api[24692]: 2017-09-28 12:12:11.657 24692 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:12:11 ctl02 nova-api[24692]: 2017-09-28 12:12:11.789 24692 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:12:11 ctl02 nova-api[24692]: 2017-09-28 12:12:11.792 24692 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:12:11 ctl02 nova-api[24692]: 2017-09-28 12:12:11.792 24692 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:12:11 ctl02 nova-api[24692]: 2017-09-28 12:12:11.792 24692 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:12:11 ctl02 nova-api[24692]: 2017-09-28 12:12:11.796 24692 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:12:11 ctl02 nova-api[24692]: 2017-09-28 12:12:11.796 24692 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:12:11 ctl02 nova-api[24692]: 2017-09-28 12:12:11.796 24692 ERROR nova Traceback (most recent call last):
Sep 28 12:12:11 ctl02 nova-api[24692]: 2017-09-28 12:12:11.796 24692 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:12:11 ctl02 nova-api[24692]: 2017-09-28 12:12:11.796 24692 ERROR nova     sys.exit(main())
Sep 28 12:12:11 ctl02 nova-api[24692]: 2017-09-28 12:12:11.796 24692 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:12:11 ctl02 nova-api[24692]: 2017-09-28 12:12:11.796 24692 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:12:11 ctl02 nova-api[24692]: 2017-09-28 12:12:11.796 24692 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:12:11 ctl02 nova-api[24692]: 2017-09-28 12:12:11.796 24692 ERROR nova     max_url_len=max_url_len)
Sep 28 12:12:11 ctl02 nova-api[24692]: 2017-09-28 12:12:11.796 24692 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:12:11 ctl02 nova-api[24692]: 2017-09-28 12:12:11.796 24692 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:12:11 ctl02 nova-api[24692]: 2017-09-28 12:12:11.796 24692 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:12:11 ctl02 nova-api[24692]: 2017-09-28 12:12:11.796 24692 ERROR nova     sock.listen(backlog)
Sep 28 12:12:11 ctl02 nova-api[24692]: 2017-09-28 12:12:11.796 24692 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:12:11 ctl02 nova-api[24692]: 2017-09-28 12:12:11.796 24692 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:12:11 ctl02 nova-api[24692]: 2017-09-28 12:12:11.796 24692 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:12:11 ctl02 nova-api[24692]: 2017-09-28 12:12:11.796 24692 ERROR nova
Sep 28 12:12:11 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:12:11 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:12:11 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:12:12 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:12:12 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:12:12 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:12:12 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:12:12 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:12:12.513 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:12:12] "OPTIONS / HTTP/1.0" 200 134 0.000500
Sep 28 12:12:13 ctl02 heat-api[13008]: 2017-09-28 12:12:13.778 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:12:13] "OPTIONS / HTTP/1.0" 200 134 0.000678
Sep 28 12:12:13 ctl02 nova-api[24781]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:12:13 ctl02 nova-api[24781]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:12:14 ctl02 nova-api[24781]: 2017-09-28 12:12:14.006 24781 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:12:14 ctl02 nova-api[24781]: 2017-09-28 12:12:14.008 24781 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:12:14 ctl02 nova-api[24781]: 2017-09-28 12:12:14.008 24781 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:12:14 ctl02 nova-api[24781]: 2017-09-28 12:12:14.008 24781 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:12:14 ctl02 nova-api[24781]: 2017-09-28 12:12:14.008 24781 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:12:14 ctl02 nova-api[24781]: 2017-09-28 12:12:14.008 24781 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:12:14 ctl02 nova-api[24781]: 2017-09-28 12:12:14.008 24781 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:12:14 ctl02 nova-api[24781]: 2017-09-28 12:12:14.008 24781 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:12:14 ctl02 nova-api[24781]: 2017-09-28 12:12:14.008 24781 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:12:14 ctl02 nova-api[24781]: 2017-09-28 12:12:14.008 24781 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:12:14 ctl02 nova-api[24781]: 2017-09-28 12:12:14.008 24781 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:12:14 ctl02 nova-api[24781]: 2017-09-28 12:12:14.008 24781 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:12:14 ctl02 nova-api[24781]: 2017-09-28 12:12:14.008 24781 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:12:14 ctl02 nova-api[24781]: 2017-09-28 12:12:14.008 24781 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:12:14 ctl02 nova-api[24781]: 2017-09-28 12:12:14.008 24781 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:12:14 ctl02 nova-api[24781]: 2017-09-28 12:12:14.008 24781 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:12:14 ctl02 nova-api[24781]: 2017-09-28 12:12:14.008 24781 ERROR nova.wsgi     self.filename))
Sep 28 12:12:14 ctl02 nova-api[24781]: 2017-09-28 12:12:14.008 24781 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:12:14 ctl02 nova-api[24781]: 2017-09-28 12:12:14.008 24781 ERROR nova.wsgi
Sep 28 12:12:14 ctl02 nova-api[24781]: 2017-09-28 12:12:14.009 24781 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:12:14 ctl02 nova-api[24781]: 2017-09-28 12:12:14.146 24781 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:12:14 ctl02 heat-api-cfn[13300]: 2017-09-28 12:12:14.170 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:12:14] "OPTIONS / HTTP/1.0" 200 134 0.000503
Sep 28 12:12:14 ctl02 nova-api[24781]: 2017-09-28 12:12:14.399 24781 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:12:14 ctl02 nova-api[24781]: 2017-09-28 12:12:14.402 24781 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:12:14 ctl02 nova-api[24781]: 2017-09-28 12:12:14.402 24781 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:12:14 ctl02 nova-api[24781]: 2017-09-28 12:12:14.402 24781 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:12:14 ctl02 glance-api[29183]: 2017-09-28 12:12:14.471 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:12:14] "OPTIONS / HTTP/1.0" 200 134 0.000641
Sep 28 12:12:14 ctl02 nova-api[24781]: 2017-09-28 12:12:14.537 24781 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:12:14 ctl02 nova-api[24781]: 2017-09-28 12:12:14.539 24781 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:12:14 ctl02 nova-api[24781]: 2017-09-28 12:12:14.539 24781 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:12:14 ctl02 nova-api[24781]: 2017-09-28 12:12:14.540 24781 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:12:14 ctl02 nova-api[24781]: 2017-09-28 12:12:14.543 24781 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:12:14 ctl02 nova-api[24781]: 2017-09-28 12:12:14.543 24781 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:12:14 ctl02 nova-api[24781]: 2017-09-28 12:12:14.543 24781 ERROR nova Traceback (most recent call last):
Sep 28 12:12:14 ctl02 nova-api[24781]: 2017-09-28 12:12:14.543 24781 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:12:14 ctl02 nova-api[24781]: 2017-09-28 12:12:14.543 24781 ERROR nova     sys.exit(main())
Sep 28 12:12:14 ctl02 nova-api[24781]: 2017-09-28 12:12:14.543 24781 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:12:14 ctl02 nova-api[24781]: 2017-09-28 12:12:14.543 24781 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:12:14 ctl02 nova-api[24781]: 2017-09-28 12:12:14.543 24781 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:12:14 ctl02 nova-api[24781]: 2017-09-28 12:12:14.543 24781 ERROR nova     max_url_len=max_url_len)
Sep 28 12:12:14 ctl02 nova-api[24781]: 2017-09-28 12:12:14.543 24781 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:12:14 ctl02 nova-api[24781]: 2017-09-28 12:12:14.543 24781 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:12:14 ctl02 nova-api[24781]: 2017-09-28 12:12:14.543 24781 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:12:14 ctl02 nova-api[24781]: 2017-09-28 12:12:14.543 24781 ERROR nova     sock.listen(backlog)
Sep 28 12:12:14 ctl02 nova-api[24781]: 2017-09-28 12:12:14.543 24781 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:12:14 ctl02 nova-api[24781]: 2017-09-28 12:12:14.543 24781 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:12:14 ctl02 nova-api[24781]: 2017-09-28 12:12:14.543 24781 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:12:14 ctl02 nova-api[24781]: 2017-09-28 12:12:14.543 24781 ERROR nova
Sep 28 12:12:14 ctl02 heat-api[13008]: 2017-09-28 12:12:14.633 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:12:14] "OPTIONS / HTTP/1.0" 200 134 0.000633
Sep 28 12:12:14 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:12:14 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:12:14 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:12:14 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:12:14 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:12:14 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:12:14 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:12:15 ctl02 glance-api[29183]: 2017-09-28 12:12:15.545 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:12:15] "OPTIONS / HTTP/1.0" 200 134 0.000644
Sep 28 12:12:16 ctl02 nova-api[24799]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:12:16 ctl02 nova-api[24799]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:12:16 ctl02 nova-api[24799]: 2017-09-28 12:12:16.728 24799 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:12:16 ctl02 nova-api[24799]: 2017-09-28 12:12:16.730 24799 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:12:16 ctl02 nova-api[24799]: 2017-09-28 12:12:16.730 24799 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:12:16 ctl02 nova-api[24799]: 2017-09-28 12:12:16.730 24799 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:12:16 ctl02 nova-api[24799]: 2017-09-28 12:12:16.730 24799 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:12:16 ctl02 nova-api[24799]: 2017-09-28 12:12:16.730 24799 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:12:16 ctl02 nova-api[24799]: 2017-09-28 12:12:16.730 24799 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:12:16 ctl02 nova-api[24799]: 2017-09-28 12:12:16.730 24799 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:12:16 ctl02 nova-api[24799]: 2017-09-28 12:12:16.730 24799 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:12:16 ctl02 nova-api[24799]: 2017-09-28 12:12:16.730 24799 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:12:16 ctl02 nova-api[24799]: 2017-09-28 12:12:16.730 24799 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:12:16 ctl02 nova-api[24799]: 2017-09-28 12:12:16.730 24799 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:12:16 ctl02 nova-api[24799]: 2017-09-28 12:12:16.730 24799 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:12:16 ctl02 nova-api[24799]: 2017-09-28 12:12:16.730 24799 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:12:16 ctl02 nova-api[24799]: 2017-09-28 12:12:16.730 24799 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:12:16 ctl02 nova-api[24799]: 2017-09-28 12:12:16.730 24799 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:12:16 ctl02 nova-api[24799]: 2017-09-28 12:12:16.730 24799 ERROR nova.wsgi     self.filename))
Sep 28 12:12:16 ctl02 nova-api[24799]: 2017-09-28 12:12:16.730 24799 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:12:16 ctl02 nova-api[24799]: 2017-09-28 12:12:16.730 24799 ERROR nova.wsgi
Sep 28 12:12:16 ctl02 nova-api[24799]: 2017-09-28 12:12:16.793 24799 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:12:16 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:12:16.869 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:12:16] "OPTIONS / HTTP/1.0" 200 134 0.000465
Sep 28 12:12:16 ctl02 nova-api[24799]: 2017-09-28 12:12:16.929 24799 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:12:17 ctl02 nova-api[24799]: 2017-09-28 12:12:17.182 24799 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:12:17 ctl02 nova-api[24799]: 2017-09-28 12:12:17.185 24799 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:12:17 ctl02 nova-api[24799]: 2017-09-28 12:12:17.185 24799 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:12:17 ctl02 nova-api[24799]: 2017-09-28 12:12:17.186 24799 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:12:17 ctl02 nova-api[24799]: 2017-09-28 12:12:17.318 24799 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:12:17 ctl02 nova-api[24799]: 2017-09-28 12:12:17.321 24799 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:12:17 ctl02 nova-api[24799]: 2017-09-28 12:12:17.321 24799 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:12:17 ctl02 nova-api[24799]: 2017-09-28 12:12:17.322 24799 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:12:17 ctl02 nova-api[24799]: 2017-09-28 12:12:17.325 24799 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:12:17 ctl02 nova-api[24799]: 2017-09-28 12:12:17.326 24799 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:12:17 ctl02 nova-api[24799]: 2017-09-28 12:12:17.326 24799 ERROR nova Traceback (most recent call last):
Sep 28 12:12:17 ctl02 nova-api[24799]: 2017-09-28 12:12:17.326 24799 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:12:17 ctl02 nova-api[24799]: 2017-09-28 12:12:17.326 24799 ERROR nova     sys.exit(main())
Sep 28 12:12:17 ctl02 nova-api[24799]: 2017-09-28 12:12:17.326 24799 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:12:17 ctl02 nova-api[24799]: 2017-09-28 12:12:17.326 24799 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:12:17 ctl02 nova-api[24799]: 2017-09-28 12:12:17.326 24799 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:12:17 ctl02 nova-api[24799]: 2017-09-28 12:12:17.326 24799 ERROR nova     max_url_len=max_url_len)
Sep 28 12:12:17 ctl02 nova-api[24799]: 2017-09-28 12:12:17.326 24799 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:12:17 ctl02 nova-api[24799]: 2017-09-28 12:12:17.326 24799 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:12:17 ctl02 nova-api[24799]: 2017-09-28 12:12:17.326 24799 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:12:17 ctl02 nova-api[24799]: 2017-09-28 12:12:17.326 24799 ERROR nova     sock.listen(backlog)
Sep 28 12:12:17 ctl02 nova-api[24799]: 2017-09-28 12:12:17.326 24799 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:12:17 ctl02 nova-api[24799]: 2017-09-28 12:12:17.326 24799 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:12:17 ctl02 nova-api[24799]: 2017-09-28 12:12:17.326 24799 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:12:17 ctl02 nova-api[24799]: 2017-09-28 12:12:17.326 24799 ERROR nova
Sep 28 12:12:17 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:12:17 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:12:17 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:12:17 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:12:17 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:12:17 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:12:17 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:12:18 ctl02 heat-api[13008]: 2017-09-28 12:12:18.342 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:12:18] "OPTIONS / HTTP/1.0" 200 134 0.000632
Sep 28 12:12:18 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:12:18.522 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:12:18] "OPTIONS / HTTP/1.0" 200 134 0.000496
Sep 28 12:12:19 ctl02 nova-api[24818]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:12:19 ctl02 nova-api[24818]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:12:19 ctl02 nova-api[24818]: 2017-09-28 12:12:19.496 24818 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:12:19 ctl02 nova-api[24818]: 2017-09-28 12:12:19.498 24818 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:12:19 ctl02 nova-api[24818]: 2017-09-28 12:12:19.498 24818 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:12:19 ctl02 nova-api[24818]: 2017-09-28 12:12:19.498 24818 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:12:19 ctl02 nova-api[24818]: 2017-09-28 12:12:19.498 24818 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:12:19 ctl02 nova-api[24818]: 2017-09-28 12:12:19.498 24818 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:12:19 ctl02 nova-api[24818]: 2017-09-28 12:12:19.498 24818 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:12:19 ctl02 nova-api[24818]: 2017-09-28 12:12:19.498 24818 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:12:19 ctl02 nova-api[24818]: 2017-09-28 12:12:19.498 24818 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:12:19 ctl02 nova-api[24818]: 2017-09-28 12:12:19.498 24818 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:12:19 ctl02 nova-api[24818]: 2017-09-28 12:12:19.498 24818 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:12:19 ctl02 nova-api[24818]: 2017-09-28 12:12:19.498 24818 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:12:19 ctl02 nova-api[24818]: 2017-09-28 12:12:19.498 24818 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:12:19 ctl02 nova-api[24818]: 2017-09-28 12:12:19.498 24818 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:12:19 ctl02 nova-api[24818]: 2017-09-28 12:12:19.498 24818 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:12:19 ctl02 nova-api[24818]: 2017-09-28 12:12:19.498 24818 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:12:19 ctl02 nova-api[24818]: 2017-09-28 12:12:19.498 24818 ERROR nova.wsgi     self.filename))
Sep 28 12:12:19 ctl02 nova-api[24818]: 2017-09-28 12:12:19.498 24818 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:12:19 ctl02 nova-api[24818]: 2017-09-28 12:12:19.498 24818 ERROR nova.wsgi
Sep 28 12:12:19 ctl02 nova-api[24818]: 2017-09-28 12:12:19.501 24818 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:12:19 ctl02 nova-api[24818]: 2017-09-28 12:12:19.635 24818 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:12:19 ctl02 nova-api[24818]: 2017-09-28 12:12:19.888 24818 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:12:19 ctl02 nova-api[24818]: 2017-09-28 12:12:19.891 24818 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:12:19 ctl02 nova-api[24818]: 2017-09-28 12:12:19.891 24818 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:12:19 ctl02 nova-api[24818]: 2017-09-28 12:12:19.892 24818 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:12:19 ctl02 glance-api[29183]: 2017-09-28 12:12:19.907 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:12:19] "OPTIONS / HTTP/1.0" 200 134 0.000635
Sep 28 12:12:20 ctl02 nova-api[24818]: 2017-09-28 12:12:20.028 24818 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:12:20 ctl02 nova-api[24818]: 2017-09-28 12:12:20.031 24818 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:12:20 ctl02 nova-api[24818]: 2017-09-28 12:12:20.032 24818 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:12:20 ctl02 nova-api[24818]: 2017-09-28 12:12:20.032 24818 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:12:20 ctl02 nova-api[24818]: 2017-09-28 12:12:20.036 24818 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:12:20 ctl02 nova-api[24818]: 2017-09-28 12:12:20.036 24818 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:12:20 ctl02 nova-api[24818]: 2017-09-28 12:12:20.036 24818 ERROR nova Traceback (most recent call last):
Sep 28 12:12:20 ctl02 nova-api[24818]: 2017-09-28 12:12:20.036 24818 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:12:20 ctl02 nova-api[24818]: 2017-09-28 12:12:20.036 24818 ERROR nova     sys.exit(main())
Sep 28 12:12:20 ctl02 nova-api[24818]: 2017-09-28 12:12:20.036 24818 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:12:20 ctl02 nova-api[24818]: 2017-09-28 12:12:20.036 24818 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:12:20 ctl02 nova-api[24818]: 2017-09-28 12:12:20.036 24818 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:12:20 ctl02 nova-api[24818]: 2017-09-28 12:12:20.036 24818 ERROR nova     max_url_len=max_url_len)
Sep 28 12:12:20 ctl02 nova-api[24818]: 2017-09-28 12:12:20.036 24818 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:12:20 ctl02 nova-api[24818]: 2017-09-28 12:12:20.036 24818 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:12:20 ctl02 nova-api[24818]: 2017-09-28 12:12:20.036 24818 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:12:20 ctl02 nova-api[24818]: 2017-09-28 12:12:20.036 24818 ERROR nova     sock.listen(backlog)
Sep 28 12:12:20 ctl02 nova-api[24818]: 2017-09-28 12:12:20.036 24818 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:12:20 ctl02 nova-api[24818]: 2017-09-28 12:12:20.036 24818 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:12:20 ctl02 nova-api[24818]: 2017-09-28 12:12:20.036 24818 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:12:20 ctl02 nova-api[24818]: 2017-09-28 12:12:20.036 24818 ERROR nova
Sep 28 12:12:20 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:12:20 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:12:20 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:12:20 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:12:20 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:12:20 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:12:20 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:12:20 ctl02 nova-cert[4860]: 2017-09-28 12:12:20.507 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:12:20 ctl02 heat-api-cfn[13300]: 2017-09-28 12:12:20.766 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:12:20] "OPTIONS / HTTP/1.0" 200 134 0.000518
Sep 28 12:12:20 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xaba0c211)
Sep 28 12:12:21 ctl02 heat-api-cfn[13300]: 2017-09-28 12:12:21.594 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:12:21] "OPTIONS / HTTP/1.0" 200 134 0.000496
Sep 28 12:12:21 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xaba0c211)
Sep 28 12:12:22 ctl02 nova-api[24836]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:12:22 ctl02 nova-api[24836]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:12:22 ctl02 nova-api[24836]: 2017-09-28 12:12:22.238 24836 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:12:22 ctl02 nova-api[24836]: 2017-09-28 12:12:22.240 24836 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:12:22 ctl02 nova-api[24836]: 2017-09-28 12:12:22.240 24836 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:12:22 ctl02 nova-api[24836]: 2017-09-28 12:12:22.240 24836 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:12:22 ctl02 nova-api[24836]: 2017-09-28 12:12:22.240 24836 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:12:22 ctl02 nova-api[24836]: 2017-09-28 12:12:22.240 24836 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:12:22 ctl02 nova-api[24836]: 2017-09-28 12:12:22.240 24836 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:12:22 ctl02 nova-api[24836]: 2017-09-28 12:12:22.240 24836 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:12:22 ctl02 nova-api[24836]: 2017-09-28 12:12:22.240 24836 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:12:22 ctl02 nova-api[24836]: 2017-09-28 12:12:22.240 24836 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:12:22 ctl02 nova-api[24836]: 2017-09-28 12:12:22.240 24836 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:12:22 ctl02 nova-api[24836]: 2017-09-28 12:12:22.240 24836 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:12:22 ctl02 nova-api[24836]: 2017-09-28 12:12:22.240 24836 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:12:22 ctl02 nova-api[24836]: 2017-09-28 12:12:22.240 24836 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:12:22 ctl02 nova-api[24836]: 2017-09-28 12:12:22.240 24836 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:12:22 ctl02 nova-api[24836]: 2017-09-28 12:12:22.240 24836 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:12:22 ctl02 nova-api[24836]: 2017-09-28 12:12:22.240 24836 ERROR nova.wsgi     self.filename))
Sep 28 12:12:22 ctl02 nova-api[24836]: 2017-09-28 12:12:22.240 24836 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:12:22 ctl02 nova-api[24836]: 2017-09-28 12:12:22.240 24836 ERROR nova.wsgi
Sep 28 12:12:22 ctl02 nova-api[24836]: 2017-09-28 12:12:22.241 24836 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:12:22 ctl02 nova-api[24836]: 2017-09-28 12:12:22.375 24836 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:12:22 ctl02 nova-conductor[5056]: 2017-09-28 12:12:22.442 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:12:22 ctl02 nova-conductor[5056]: 2017-09-28 12:12:22.457 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:12:22 ctl02 nova-conductor[5056]: 2017-09-28 12:12:22.458 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:12:22 ctl02 nova-conductor[5056]: 2017-09-28 12:12:22.463 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:12:22 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:12:22.563 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:12:22] "OPTIONS / HTTP/1.0" 200 134 0.000430
Sep 28 12:12:22 ctl02 nova-api[24836]: 2017-09-28 12:12:22.633 24836 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:12:22 ctl02 nova-api[24836]: 2017-09-28 12:12:22.635 24836 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:12:22 ctl02 nova-api[24836]: 2017-09-28 12:12:22.635 24836 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:12:22 ctl02 nova-api[24836]: 2017-09-28 12:12:22.636 24836 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:12:22 ctl02 nova-api[24836]: 2017-09-28 12:12:22.768 24836 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:12:22 ctl02 nova-api[24836]: 2017-09-28 12:12:22.770 24836 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:12:22 ctl02 nova-api[24836]: 2017-09-28 12:12:22.770 24836 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:12:22 ctl02 nova-api[24836]: 2017-09-28 12:12:22.771 24836 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:12:22 ctl02 nova-api[24836]: 2017-09-28 12:12:22.774 24836 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:12:22 ctl02 nova-api[24836]: 2017-09-28 12:12:22.775 24836 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:12:22 ctl02 nova-api[24836]: 2017-09-28 12:12:22.775 24836 ERROR nova Traceback (most recent call last):
Sep 28 12:12:22 ctl02 nova-api[24836]: 2017-09-28 12:12:22.775 24836 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:12:22 ctl02 nova-api[24836]: 2017-09-28 12:12:22.775 24836 ERROR nova     sys.exit(main())
Sep 28 12:12:22 ctl02 nova-api[24836]: 2017-09-28 12:12:22.775 24836 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:12:22 ctl02 nova-api[24836]: 2017-09-28 12:12:22.775 24836 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:12:22 ctl02 nova-api[24836]: 2017-09-28 12:12:22.775 24836 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:12:22 ctl02 nova-api[24836]: 2017-09-28 12:12:22.775 24836 ERROR nova     max_url_len=max_url_len)
Sep 28 12:12:22 ctl02 nova-api[24836]: 2017-09-28 12:12:22.775 24836 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:12:22 ctl02 nova-api[24836]: 2017-09-28 12:12:22.775 24836 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:12:22 ctl02 nova-api[24836]: 2017-09-28 12:12:22.775 24836 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:12:22 ctl02 nova-api[24836]: 2017-09-28 12:12:22.775 24836 ERROR nova     sock.listen(backlog)
Sep 28 12:12:22 ctl02 nova-api[24836]: 2017-09-28 12:12:22.775 24836 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:12:22 ctl02 nova-api[24836]: 2017-09-28 12:12:22.775 24836 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:12:22 ctl02 nova-api[24836]: 2017-09-28 12:12:22.775 24836 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:12:22 ctl02 nova-api[24836]: 2017-09-28 12:12:22.775 24836 ERROR nova
Sep 28 12:12:22 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xaba0c211)
Sep 28 12:12:22 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:12:22 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:12:22 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:12:23 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:12:23 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:12:23 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:12:23 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:12:23 ctl02 heat-api[13008]: 2017-09-28 12:12:23.506 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:12:23] "OPTIONS / HTTP/1.0" 200 134 0.000521
Sep 28 12:12:23 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xaba0c211)
Sep 28 12:12:24 ctl02 glance-api[29183]: 2017-09-28 12:12:24.397 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:12:24] "OPTIONS / HTTP/1.0" 200 134 0.000616
Sep 28 12:12:24 ctl02 heat-api[13008]: 2017-09-28 12:12:24.397 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:12:24] "OPTIONS / HTTP/1.0" 200 134 0.000753
Sep 28 12:12:24 ctl02 heat-api-cfn[13300]: 2017-09-28 12:12:24.563 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:12:24] "OPTIONS / HTTP/1.0" 200 134 0.000560
Sep 28 12:12:24 ctl02 nova-api[24854]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:12:24 ctl02 nova-api[24854]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:12:24 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xaba0c211)
Sep 28 12:12:24 ctl02 nova-api[24854]: 2017-09-28 12:12:24.976 24854 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:12:24 ctl02 nova-api[24854]: 2017-09-28 12:12:24.978 24854 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:12:24 ctl02 nova-api[24854]: 2017-09-28 12:12:24.978 24854 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:12:24 ctl02 nova-api[24854]: 2017-09-28 12:12:24.978 24854 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:12:24 ctl02 nova-api[24854]: 2017-09-28 12:12:24.978 24854 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:12:24 ctl02 nova-api[24854]: 2017-09-28 12:12:24.978 24854 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:12:24 ctl02 nova-api[24854]: 2017-09-28 12:12:24.978 24854 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:12:24 ctl02 nova-api[24854]: 2017-09-28 12:12:24.978 24854 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:12:24 ctl02 nova-api[24854]: 2017-09-28 12:12:24.978 24854 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:12:24 ctl02 nova-api[24854]: 2017-09-28 12:12:24.978 24854 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:12:24 ctl02 nova-api[24854]: 2017-09-28 12:12:24.978 24854 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:12:24 ctl02 nova-api[24854]: 2017-09-28 12:12:24.978 24854 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:12:24 ctl02 nova-api[24854]: 2017-09-28 12:12:24.978 24854 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:12:24 ctl02 nova-api[24854]: 2017-09-28 12:12:24.978 24854 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:12:24 ctl02 nova-api[24854]: 2017-09-28 12:12:24.978 24854 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:12:24 ctl02 nova-api[24854]: 2017-09-28 12:12:24.978 24854 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:12:24 ctl02 nova-api[24854]: 2017-09-28 12:12:24.978 24854 ERROR nova.wsgi     self.filename))
Sep 28 12:12:24 ctl02 nova-api[24854]: 2017-09-28 12:12:24.978 24854 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:12:24 ctl02 nova-api[24854]: 2017-09-28 12:12:24.978 24854 ERROR nova.wsgi
Sep 28 12:12:24 ctl02 nova-api[24854]: 2017-09-28 12:12:24.979 24854 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:12:25 ctl02 nova-api[24854]: 2017-09-28 12:12:25.109 24854 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:12:25 ctl02 nova-api[24854]: 2017-09-28 12:12:25.338 24854 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:12:25 ctl02 nova-api[24854]: 2017-09-28 12:12:25.340 24854 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:12:25 ctl02 nova-api[24854]: 2017-09-28 12:12:25.340 24854 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:12:25 ctl02 nova-api[24854]: 2017-09-28 12:12:25.341 24854 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:12:25 ctl02 glance-api[29183]: 2017-09-28 12:12:25.434 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:12:25] "OPTIONS / HTTP/1.0" 200 134 0.000562
Sep 28 12:12:25 ctl02 nova-api[24854]: 2017-09-28 12:12:25.475 24854 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:12:25 ctl02 nova-api[24854]: 2017-09-28 12:12:25.477 24854 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:12:25 ctl02 nova-api[24854]: 2017-09-28 12:12:25.477 24854 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:12:25 ctl02 nova-api[24854]: 2017-09-28 12:12:25.477 24854 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:12:25 ctl02 nova-api[24854]: 2017-09-28 12:12:25.480 24854 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:12:25 ctl02 nova-api[24854]: 2017-09-28 12:12:25.481 24854 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:12:25 ctl02 nova-api[24854]: 2017-09-28 12:12:25.481 24854 ERROR nova Traceback (most recent call last):
Sep 28 12:12:25 ctl02 nova-api[24854]: 2017-09-28 12:12:25.481 24854 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:12:25 ctl02 nova-api[24854]: 2017-09-28 12:12:25.481 24854 ERROR nova     sys.exit(main())
Sep 28 12:12:25 ctl02 nova-api[24854]: 2017-09-28 12:12:25.481 24854 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:12:25 ctl02 nova-api[24854]: 2017-09-28 12:12:25.481 24854 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:12:25 ctl02 nova-api[24854]: 2017-09-28 12:12:25.481 24854 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:12:25 ctl02 nova-api[24854]: 2017-09-28 12:12:25.481 24854 ERROR nova     max_url_len=max_url_len)
Sep 28 12:12:25 ctl02 nova-api[24854]: 2017-09-28 12:12:25.481 24854 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:12:25 ctl02 nova-api[24854]: 2017-09-28 12:12:25.481 24854 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:12:25 ctl02 nova-api[24854]: 2017-09-28 12:12:25.481 24854 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:12:25 ctl02 nova-api[24854]: 2017-09-28 12:12:25.481 24854 ERROR nova     sock.listen(backlog)
Sep 28 12:12:25 ctl02 nova-api[24854]: 2017-09-28 12:12:25.481 24854 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:12:25 ctl02 nova-api[24854]: 2017-09-28 12:12:25.481 24854 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:12:25 ctl02 nova-api[24854]: 2017-09-28 12:12:25.481 24854 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:12:25 ctl02 nova-api[24854]: 2017-09-28 12:12:25.481 24854 ERROR nova
Sep 28 12:12:25 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:12:25 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:12:25 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:12:25 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:12:25 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:12:25 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xaba0c211)
Sep 28 12:12:25 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:12:25 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:12:26 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:12:26.489 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:12:26] "OPTIONS / HTTP/1.0" 200 134 0.000464
Sep 28 12:12:26 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xaba0c211)
Sep 28 12:12:27 ctl02 nova-api[24872]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:12:27 ctl02 nova-api[24872]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:12:27 ctl02 nova-api[24872]: 2017-09-28 12:12:27.671 24872 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:12:27 ctl02 nova-api[24872]: 2017-09-28 12:12:27.673 24872 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:12:27 ctl02 nova-api[24872]: 2017-09-28 12:12:27.673 24872 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:12:27 ctl02 nova-api[24872]: 2017-09-28 12:12:27.673 24872 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:12:27 ctl02 nova-api[24872]: 2017-09-28 12:12:27.673 24872 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:12:27 ctl02 nova-api[24872]: 2017-09-28 12:12:27.673 24872 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:12:27 ctl02 nova-api[24872]: 2017-09-28 12:12:27.673 24872 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:12:27 ctl02 nova-api[24872]: 2017-09-28 12:12:27.673 24872 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:12:27 ctl02 nova-api[24872]: 2017-09-28 12:12:27.673 24872 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:12:27 ctl02 nova-api[24872]: 2017-09-28 12:12:27.673 24872 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:12:27 ctl02 nova-api[24872]: 2017-09-28 12:12:27.673 24872 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:12:27 ctl02 nova-api[24872]: 2017-09-28 12:12:27.673 24872 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:12:27 ctl02 nova-api[24872]: 2017-09-28 12:12:27.673 24872 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:12:27 ctl02 nova-api[24872]: 2017-09-28 12:12:27.673 24872 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:12:27 ctl02 nova-api[24872]: 2017-09-28 12:12:27.673 24872 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:12:27 ctl02 nova-api[24872]: 2017-09-28 12:12:27.673 24872 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:12:27 ctl02 nova-api[24872]: 2017-09-28 12:12:27.673 24872 ERROR nova.wsgi     self.filename))
Sep 28 12:12:27 ctl02 nova-api[24872]: 2017-09-28 12:12:27.673 24872 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:12:27 ctl02 nova-api[24872]: 2017-09-28 12:12:27.673 24872 ERROR nova.wsgi
Sep 28 12:12:27 ctl02 nova-api[24872]: 2017-09-28 12:12:27.675 24872 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:12:27 ctl02 nova-api[24872]: 2017-09-28 12:12:27.822 24872 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:12:27 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xaba0c211)
Sep 28 12:12:28 ctl02 nova-api[24872]: 2017-09-28 12:12:28.077 24872 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:12:28 ctl02 nova-api[24872]: 2017-09-28 12:12:28.080 24872 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:12:28 ctl02 nova-api[24872]: 2017-09-28 12:12:28.080 24872 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:12:28 ctl02 nova-api[24872]: 2017-09-28 12:12:28.080 24872 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:12:28 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:12:28.176 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:12:28] "OPTIONS / HTTP/1.0" 200 134 0.000510
Sep 28 12:12:28 ctl02 nova-api[24872]: 2017-09-28 12:12:28.214 24872 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:12:28 ctl02 nova-api[24872]: 2017-09-28 12:12:28.216 24872 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:12:28 ctl02 nova-api[24872]: 2017-09-28 12:12:28.216 24872 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:12:28 ctl02 nova-api[24872]: 2017-09-28 12:12:28.217 24872 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:12:28 ctl02 nova-api[24872]: 2017-09-28 12:12:28.220 24872 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:12:28 ctl02 nova-api[24872]: 2017-09-28 12:12:28.220 24872 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:12:28 ctl02 nova-api[24872]: 2017-09-28 12:12:28.220 24872 ERROR nova Traceback (most recent call last):
Sep 28 12:12:28 ctl02 nova-api[24872]: 2017-09-28 12:12:28.220 24872 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:12:28 ctl02 nova-api[24872]: 2017-09-28 12:12:28.220 24872 ERROR nova     sys.exit(main())
Sep 28 12:12:28 ctl02 nova-api[24872]: 2017-09-28 12:12:28.220 24872 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:12:28 ctl02 nova-api[24872]: 2017-09-28 12:12:28.220 24872 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:12:28 ctl02 nova-api[24872]: 2017-09-28 12:12:28.220 24872 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:12:28 ctl02 nova-api[24872]: 2017-09-28 12:12:28.220 24872 ERROR nova     max_url_len=max_url_len)
Sep 28 12:12:28 ctl02 nova-api[24872]: 2017-09-28 12:12:28.220 24872 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:12:28 ctl02 nova-api[24872]: 2017-09-28 12:12:28.220 24872 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:12:28 ctl02 nova-api[24872]: 2017-09-28 12:12:28.220 24872 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:12:28 ctl02 nova-api[24872]: 2017-09-28 12:12:28.220 24872 ERROR nova     sock.listen(backlog)
Sep 28 12:12:28 ctl02 nova-api[24872]: 2017-09-28 12:12:28.220 24872 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:12:28 ctl02 nova-api[24872]: 2017-09-28 12:12:28.220 24872 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:12:28 ctl02 nova-api[24872]: 2017-09-28 12:12:28.220 24872 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:12:28 ctl02 nova-api[24872]: 2017-09-28 12:12:28.220 24872 ERROR nova
Sep 28 12:12:28 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:12:28 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:12:28 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:12:28 ctl02 heat-api[13008]: 2017-09-28 12:12:28.490 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:12:28] "OPTIONS / HTTP/1.0" 200 134 0.000656
Sep 28 12:12:28 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:12:28 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:12:28 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:12:28 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:12:28 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xaba0c211)
Sep 28 12:12:29 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xaba0c211)
Sep 28 12:12:30 ctl02 glance-api[29183]: 2017-09-28 12:12:30.189 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:12:30] "OPTIONS / HTTP/1.0" 200 134 0.000688
Sep 28 12:12:30 ctl02 nova-api[24890]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:12:30 ctl02 nova-api[24890]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:12:30 ctl02 nova-consoleauth[5433]: 2017-09-28 12:12:30.404 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:12:30 ctl02 nova-api[24890]: 2017-09-28 12:12:30.512 24890 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:12:30 ctl02 nova-api[24890]: 2017-09-28 12:12:30.514 24890 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:12:30 ctl02 nova-api[24890]: 2017-09-28 12:12:30.514 24890 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:12:30 ctl02 nova-api[24890]: 2017-09-28 12:12:30.514 24890 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:12:30 ctl02 nova-api[24890]: 2017-09-28 12:12:30.514 24890 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:12:30 ctl02 nova-api[24890]: 2017-09-28 12:12:30.514 24890 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:12:30 ctl02 nova-api[24890]: 2017-09-28 12:12:30.514 24890 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:12:30 ctl02 nova-api[24890]: 2017-09-28 12:12:30.514 24890 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:12:30 ctl02 nova-api[24890]: 2017-09-28 12:12:30.514 24890 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:12:30 ctl02 nova-api[24890]: 2017-09-28 12:12:30.514 24890 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:12:30 ctl02 nova-api[24890]: 2017-09-28 12:12:30.514 24890 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:12:30 ctl02 nova-api[24890]: 2017-09-28 12:12:30.514 24890 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:12:30 ctl02 nova-api[24890]: 2017-09-28 12:12:30.514 24890 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:12:30 ctl02 nova-api[24890]: 2017-09-28 12:12:30.514 24890 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:12:30 ctl02 nova-api[24890]: 2017-09-28 12:12:30.514 24890 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:12:30 ctl02 nova-api[24890]: 2017-09-28 12:12:30.514 24890 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:12:30 ctl02 nova-api[24890]: 2017-09-28 12:12:30.514 24890 ERROR nova.wsgi     self.filename))
Sep 28 12:12:30 ctl02 nova-api[24890]: 2017-09-28 12:12:30.514 24890 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:12:30 ctl02 nova-api[24890]: 2017-09-28 12:12:30.514 24890 ERROR nova.wsgi
Sep 28 12:12:30 ctl02 nova-api[24890]: 2017-09-28 12:12:30.515 24890 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:12:30 ctl02 nova-api[24890]: 2017-09-28 12:12:30.653 24890 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:12:30 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xaba0c211)
Sep 28 12:12:30 ctl02 heat-api-cfn[13300]: 2017-09-28 12:12:30.889 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:12:30] "OPTIONS / HTTP/1.0" 200 134 0.000566
Sep 28 12:12:30 ctl02 nova-api[24890]: 2017-09-28 12:12:30.911 24890 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:12:30 ctl02 nova-api[24890]: 2017-09-28 12:12:30.913 24890 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:12:30 ctl02 nova-api[24890]: 2017-09-28 12:12:30.913 24890 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:12:30 ctl02 nova-api[24890]: 2017-09-28 12:12:30.913 24890 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:12:31 ctl02 nova-api[24890]: 2017-09-28 12:12:31.050 24890 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:12:31 ctl02 nova-api[24890]: 2017-09-28 12:12:31.052 24890 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:12:31 ctl02 nova-api[24890]: 2017-09-28 12:12:31.052 24890 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:12:31 ctl02 nova-api[24890]: 2017-09-28 12:12:31.052 24890 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:12:31 ctl02 nova-api[24890]: 2017-09-28 12:12:31.056 24890 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:12:31 ctl02 nova-api[24890]: 2017-09-28 12:12:31.056 24890 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:12:31 ctl02 nova-api[24890]: 2017-09-28 12:12:31.056 24890 ERROR nova Traceback (most recent call last):
Sep 28 12:12:31 ctl02 nova-api[24890]: 2017-09-28 12:12:31.056 24890 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:12:31 ctl02 nova-api[24890]: 2017-09-28 12:12:31.056 24890 ERROR nova     sys.exit(main())
Sep 28 12:12:31 ctl02 nova-api[24890]: 2017-09-28 12:12:31.056 24890 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:12:31 ctl02 nova-api[24890]: 2017-09-28 12:12:31.056 24890 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:12:31 ctl02 nova-api[24890]: 2017-09-28 12:12:31.056 24890 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:12:31 ctl02 nova-api[24890]: 2017-09-28 12:12:31.056 24890 ERROR nova     max_url_len=max_url_len)
Sep 28 12:12:31 ctl02 nova-api[24890]: 2017-09-28 12:12:31.056 24890 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:12:31 ctl02 nova-api[24890]: 2017-09-28 12:12:31.056 24890 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:12:31 ctl02 nova-api[24890]: 2017-09-28 12:12:31.056 24890 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:12:31 ctl02 nova-api[24890]: 2017-09-28 12:12:31.056 24890 ERROR nova     sock.listen(backlog)
Sep 28 12:12:31 ctl02 nova-api[24890]: 2017-09-28 12:12:31.056 24890 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:12:31 ctl02 nova-api[24890]: 2017-09-28 12:12:31.056 24890 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:12:31 ctl02 nova-api[24890]: 2017-09-28 12:12:31.056 24890 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:12:31 ctl02 nova-api[24890]: 2017-09-28 12:12:31.056 24890 ERROR nova
Sep 28 12:12:31 ctl02 heat-api-cfn[13300]: 2017-09-28 12:12:31.224 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:12:31] "OPTIONS / HTTP/1.0" 200 134 0.000560
Sep 28 12:12:31 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:12:31 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:12:31 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:12:31 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:12:31 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:12:31 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:12:31 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:12:31 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:12:31 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:12:32 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:12:32.521 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:12:32] "OPTIONS / HTTP/1.0" 200 134 0.000494
Sep 28 12:12:33 ctl02 nova-api[24908]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:12:33 ctl02 nova-api[24908]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:12:33 ctl02 nova-api[24908]: 2017-09-28 12:12:33.236 24908 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:12:33 ctl02 nova-api[24908]: 2017-09-28 12:12:33.239 24908 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:12:33 ctl02 nova-api[24908]: 2017-09-28 12:12:33.239 24908 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:12:33 ctl02 nova-api[24908]: 2017-09-28 12:12:33.239 24908 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:12:33 ctl02 nova-api[24908]: 2017-09-28 12:12:33.239 24908 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:12:33 ctl02 nova-api[24908]: 2017-09-28 12:12:33.239 24908 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:12:33 ctl02 nova-api[24908]: 2017-09-28 12:12:33.239 24908 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:12:33 ctl02 nova-api[24908]: 2017-09-28 12:12:33.239 24908 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:12:33 ctl02 nova-api[24908]: 2017-09-28 12:12:33.239 24908 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:12:33 ctl02 nova-api[24908]: 2017-09-28 12:12:33.239 24908 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:12:33 ctl02 nova-api[24908]: 2017-09-28 12:12:33.239 24908 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:12:33 ctl02 nova-api[24908]: 2017-09-28 12:12:33.239 24908 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:12:33 ctl02 nova-api[24908]: 2017-09-28 12:12:33.239 24908 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:12:33 ctl02 nova-api[24908]: 2017-09-28 12:12:33.239 24908 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:12:33 ctl02 nova-api[24908]: 2017-09-28 12:12:33.239 24908 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:12:33 ctl02 nova-api[24908]: 2017-09-28 12:12:33.239 24908 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:12:33 ctl02 nova-api[24908]: 2017-09-28 12:12:33.239 24908 ERROR nova.wsgi     self.filename))
Sep 28 12:12:33 ctl02 nova-api[24908]: 2017-09-28 12:12:33.239 24908 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:12:33 ctl02 nova-api[24908]: 2017-09-28 12:12:33.239 24908 ERROR nova.wsgi
Sep 28 12:12:33 ctl02 nova-api[24908]: 2017-09-28 12:12:33.241 24908 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:12:33 ctl02 nova-api[24908]: 2017-09-28 12:12:33.375 24908 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:12:33 ctl02 nova-scheduler[5620]: 2017-09-28 12:12:33.422 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:12:33 ctl02 heat-engine[12803]: 2017-09-28 12:12:33.510 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:12:33 ctl02 heat-engine[12803]: 2017-09-28 12:12:33.536 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:12:33 ctl02 heat-engine[12803]: 2017-09-28 12:12:33.551 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:12:33 ctl02 heat-engine[12803]: 2017-09-28 12:12:33.559 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:12:33 ctl02 nova-api[24908]: 2017-09-28 12:12:33.632 24908 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:12:33 ctl02 nova-api[24908]: 2017-09-28 12:12:33.635 24908 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:12:33 ctl02 nova-api[24908]: 2017-09-28 12:12:33.635 24908 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:12:33 ctl02 nova-api[24908]: 2017-09-28 12:12:33.635 24908 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:12:33 ctl02 nova-api[24908]: 2017-09-28 12:12:33.768 24908 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:12:33 ctl02 nova-api[24908]: 2017-09-28 12:12:33.771 24908 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:12:33 ctl02 nova-api[24908]: 2017-09-28 12:12:33.771 24908 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:12:33 ctl02 nova-api[24908]: 2017-09-28 12:12:33.771 24908 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:12:33 ctl02 nova-api[24908]: 2017-09-28 12:12:33.775 24908 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:12:33 ctl02 nova-api[24908]: 2017-09-28 12:12:33.775 24908 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:12:33 ctl02 nova-api[24908]: 2017-09-28 12:12:33.775 24908 ERROR nova Traceback (most recent call last):
Sep 28 12:12:33 ctl02 nova-api[24908]: 2017-09-28 12:12:33.775 24908 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:12:33 ctl02 nova-api[24908]: 2017-09-28 12:12:33.775 24908 ERROR nova     sys.exit(main())
Sep 28 12:12:33 ctl02 nova-api[24908]: 2017-09-28 12:12:33.775 24908 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:12:33 ctl02 nova-api[24908]: 2017-09-28 12:12:33.775 24908 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:12:33 ctl02 nova-api[24908]: 2017-09-28 12:12:33.775 24908 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:12:33 ctl02 nova-api[24908]: 2017-09-28 12:12:33.775 24908 ERROR nova     max_url_len=max_url_len)
Sep 28 12:12:33 ctl02 nova-api[24908]: 2017-09-28 12:12:33.775 24908 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:12:33 ctl02 nova-api[24908]: 2017-09-28 12:12:33.775 24908 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:12:33 ctl02 nova-api[24908]: 2017-09-28 12:12:33.775 24908 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:12:33 ctl02 nova-api[24908]: 2017-09-28 12:12:33.775 24908 ERROR nova     sock.listen(backlog)
Sep 28 12:12:33 ctl02 nova-api[24908]: 2017-09-28 12:12:33.775 24908 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:12:33 ctl02 nova-api[24908]: 2017-09-28 12:12:33.775 24908 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:12:33 ctl02 nova-api[24908]: 2017-09-28 12:12:33.775 24908 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:12:33 ctl02 nova-api[24908]: 2017-09-28 12:12:33.775 24908 ERROR nova
Sep 28 12:12:33 ctl02 heat-api[13008]: 2017-09-28 12:12:33.863 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:12:33] "OPTIONS / HTTP/1.0" 200 134 0.000626
Sep 28 12:12:33 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:12:33 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:12:33 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:12:34 ctl02 glance-api[29183]: 2017-09-28 12:12:34.037 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:12:34] "OPTIONS / HTTP/1.0" 200 134 0.000650
Sep 28 12:12:34 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:12:34 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:12:34 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:12:34 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:12:34 ctl02 heat-api-cfn[13300]: 2017-09-28 12:12:34.268 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:12:34] "OPTIONS / HTTP/1.0" 200 134 0.000538
Sep 28 12:12:34 ctl02 heat-api[13008]: 2017-09-28 12:12:34.429 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:12:34] "OPTIONS / HTTP/1.0" 200 134 0.000609
Sep 28 12:12:35 ctl02 glance-api[29183]: 2017-09-28 12:12:35.082 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:12:35] "OPTIONS / HTTP/1.0" 200 134 0.000686
Sep 28 12:12:35 ctl02 nova-api[24931]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:12:35 ctl02 nova-api[24931]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:12:35 ctl02 nova-api[24931]: 2017-09-28 12:12:35.992 24931 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:12:35 ctl02 nova-api[24931]: 2017-09-28 12:12:35.994 24931 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:12:35 ctl02 nova-api[24931]: 2017-09-28 12:12:35.994 24931 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:12:35 ctl02 nova-api[24931]: 2017-09-28 12:12:35.994 24931 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:12:35 ctl02 nova-api[24931]: 2017-09-28 12:12:35.994 24931 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:12:35 ctl02 nova-api[24931]: 2017-09-28 12:12:35.994 24931 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:12:35 ctl02 nova-api[24931]: 2017-09-28 12:12:35.994 24931 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:12:35 ctl02 nova-api[24931]: 2017-09-28 12:12:35.994 24931 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:12:35 ctl02 nova-api[24931]: 2017-09-28 12:12:35.994 24931 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:12:35 ctl02 nova-api[24931]: 2017-09-28 12:12:35.994 24931 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:12:35 ctl02 nova-api[24931]: 2017-09-28 12:12:35.994 24931 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:12:35 ctl02 nova-api[24931]: 2017-09-28 12:12:35.994 24931 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:12:35 ctl02 nova-api[24931]: 2017-09-28 12:12:35.994 24931 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:12:35 ctl02 nova-api[24931]: 2017-09-28 12:12:35.994 24931 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:12:35 ctl02 nova-api[24931]: 2017-09-28 12:12:35.994 24931 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:12:35 ctl02 nova-api[24931]: 2017-09-28 12:12:35.994 24931 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:12:35 ctl02 nova-api[24931]: 2017-09-28 12:12:35.994 24931 ERROR nova.wsgi     self.filename))
Sep 28 12:12:35 ctl02 nova-api[24931]: 2017-09-28 12:12:35.994 24931 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:12:35 ctl02 nova-api[24931]: 2017-09-28 12:12:35.994 24931 ERROR nova.wsgi
Sep 28 12:12:35 ctl02 nova-api[24931]: 2017-09-28 12:12:35.995 24931 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:12:36 ctl02 nova-api[24931]: 2017-09-28 12:12:36.130 24931 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:12:36 ctl02 nova-api[24931]: 2017-09-28 12:12:36.380 24931 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:12:36 ctl02 nova-api[24931]: 2017-09-28 12:12:36.383 24931 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:12:36 ctl02 nova-api[24931]: 2017-09-28 12:12:36.383 24931 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:12:36 ctl02 nova-api[24931]: 2017-09-28 12:12:36.383 24931 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:12:36 ctl02 nova-api[24931]: 2017-09-28 12:12:36.516 24931 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:12:36 ctl02 nova-api[24931]: 2017-09-28 12:12:36.518 24931 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:12:36 ctl02 nova-api[24931]: 2017-09-28 12:12:36.518 24931 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:12:36 ctl02 nova-api[24931]: 2017-09-28 12:12:36.519 24931 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:12:36 ctl02 nova-api[24931]: 2017-09-28 12:12:36.522 24931 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:12:36 ctl02 nova-api[24931]: 2017-09-28 12:12:36.522 24931 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:12:36 ctl02 nova-api[24931]: 2017-09-28 12:12:36.522 24931 ERROR nova Traceback (most recent call last):
Sep 28 12:12:36 ctl02 nova-api[24931]: 2017-09-28 12:12:36.522 24931 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:12:36 ctl02 nova-api[24931]: 2017-09-28 12:12:36.522 24931 ERROR nova     sys.exit(main())
Sep 28 12:12:36 ctl02 nova-api[24931]: 2017-09-28 12:12:36.522 24931 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:12:36 ctl02 nova-api[24931]: 2017-09-28 12:12:36.522 24931 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:12:36 ctl02 nova-api[24931]: 2017-09-28 12:12:36.522 24931 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:12:36 ctl02 nova-api[24931]: 2017-09-28 12:12:36.522 24931 ERROR nova     max_url_len=max_url_len)
Sep 28 12:12:36 ctl02 nova-api[24931]: 2017-09-28 12:12:36.522 24931 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:12:36 ctl02 nova-api[24931]: 2017-09-28 12:12:36.522 24931 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:12:36 ctl02 nova-api[24931]: 2017-09-28 12:12:36.522 24931 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:12:36 ctl02 nova-api[24931]: 2017-09-28 12:12:36.522 24931 ERROR nova     sock.listen(backlog)
Sep 28 12:12:36 ctl02 nova-api[24931]: 2017-09-28 12:12:36.522 24931 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:12:36 ctl02 nova-api[24931]: 2017-09-28 12:12:36.522 24931 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:12:36 ctl02 nova-api[24931]: 2017-09-28 12:12:36.522 24931 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:12:36 ctl02 nova-api[24931]: 2017-09-28 12:12:36.522 24931 ERROR nova
Sep 28 12:12:36 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:12:36.573 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:12:36] "OPTIONS / HTTP/1.0" 200 134 0.000486
Sep 28 12:12:36 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:12:36 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:12:36 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:12:36 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:12:36 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:12:36 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:12:36 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:12:37 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:12:37.831 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:12:37] "OPTIONS / HTTP/1.0" 200 134 0.000501
Sep 28 12:12:38 ctl02 nova-api[24949]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:12:38 ctl02 nova-api[24949]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:12:38 ctl02 nova-api[24949]: 2017-09-28 12:12:38.740 24949 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:12:38 ctl02 nova-api[24949]: 2017-09-28 12:12:38.742 24949 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:12:38 ctl02 nova-api[24949]: 2017-09-28 12:12:38.742 24949 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:12:38 ctl02 nova-api[24949]: 2017-09-28 12:12:38.742 24949 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:12:38 ctl02 nova-api[24949]: 2017-09-28 12:12:38.742 24949 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:12:38 ctl02 nova-api[24949]: 2017-09-28 12:12:38.742 24949 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:12:38 ctl02 nova-api[24949]: 2017-09-28 12:12:38.742 24949 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:12:38 ctl02 nova-api[24949]: 2017-09-28 12:12:38.742 24949 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:12:38 ctl02 nova-api[24949]: 2017-09-28 12:12:38.742 24949 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:12:38 ctl02 nova-api[24949]: 2017-09-28 12:12:38.742 24949 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:12:38 ctl02 nova-api[24949]: 2017-09-28 12:12:38.742 24949 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:12:38 ctl02 nova-api[24949]: 2017-09-28 12:12:38.742 24949 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:12:38 ctl02 nova-api[24949]: 2017-09-28 12:12:38.742 24949 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:12:38 ctl02 nova-api[24949]: 2017-09-28 12:12:38.742 24949 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:12:38 ctl02 nova-api[24949]: 2017-09-28 12:12:38.742 24949 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:12:38 ctl02 nova-api[24949]: 2017-09-28 12:12:38.742 24949 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:12:38 ctl02 nova-api[24949]: 2017-09-28 12:12:38.742 24949 ERROR nova.wsgi     self.filename))
Sep 28 12:12:38 ctl02 nova-api[24949]: 2017-09-28 12:12:38.742 24949 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:12:38 ctl02 nova-api[24949]: 2017-09-28 12:12:38.742 24949 ERROR nova.wsgi
Sep 28 12:12:38 ctl02 nova-api[24949]: 2017-09-28 12:12:38.743 24949 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:12:38 ctl02 heat-api[13008]: 2017-09-28 12:12:38.784 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:12:38] "OPTIONS / HTTP/1.0" 200 134 0.000679
Sep 28 12:12:38 ctl02 nova-api[24949]: 2017-09-28 12:12:38.875 24949 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:12:39 ctl02 nova-api[24949]: 2017-09-28 12:12:39.127 24949 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:12:39 ctl02 nova-api[24949]: 2017-09-28 12:12:39.130 24949 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:12:39 ctl02 nova-api[24949]: 2017-09-28 12:12:39.130 24949 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:12:39 ctl02 nova-api[24949]: 2017-09-28 12:12:39.130 24949 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:12:39 ctl02 nova-api[24949]: 2017-09-28 12:12:39.263 24949 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:12:39 ctl02 nova-api[24949]: 2017-09-28 12:12:39.265 24949 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:12:39 ctl02 nova-api[24949]: 2017-09-28 12:12:39.265 24949 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:12:39 ctl02 nova-api[24949]: 2017-09-28 12:12:39.266 24949 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:12:39 ctl02 nova-api[24949]: 2017-09-28 12:12:39.269 24949 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:12:39 ctl02 nova-api[24949]: 2017-09-28 12:12:39.269 24949 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:12:39 ctl02 nova-api[24949]: 2017-09-28 12:12:39.269 24949 ERROR nova Traceback (most recent call last):
Sep 28 12:12:39 ctl02 nova-api[24949]: 2017-09-28 12:12:39.269 24949 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:12:39 ctl02 nova-api[24949]: 2017-09-28 12:12:39.269 24949 ERROR nova     sys.exit(main())
Sep 28 12:12:39 ctl02 nova-api[24949]: 2017-09-28 12:12:39.269 24949 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:12:39 ctl02 nova-api[24949]: 2017-09-28 12:12:39.269 24949 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:12:39 ctl02 nova-api[24949]: 2017-09-28 12:12:39.269 24949 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:12:39 ctl02 nova-api[24949]: 2017-09-28 12:12:39.269 24949 ERROR nova     max_url_len=max_url_len)
Sep 28 12:12:39 ctl02 nova-api[24949]: 2017-09-28 12:12:39.269 24949 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:12:39 ctl02 nova-api[24949]: 2017-09-28 12:12:39.269 24949 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:12:39 ctl02 nova-api[24949]: 2017-09-28 12:12:39.269 24949 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:12:39 ctl02 nova-api[24949]: 2017-09-28 12:12:39.269 24949 ERROR nova     sock.listen(backlog)
Sep 28 12:12:39 ctl02 nova-api[24949]: 2017-09-28 12:12:39.269 24949 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:12:39 ctl02 nova-api[24949]: 2017-09-28 12:12:39.269 24949 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:12:39 ctl02 nova-api[24949]: 2017-09-28 12:12:39.269 24949 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:12:39 ctl02 nova-api[24949]: 2017-09-28 12:12:39.269 24949 ERROR nova
Sep 28 12:12:39 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:12:39 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:12:39 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:12:39 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:12:39 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:12:39 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:12:39 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:12:40 ctl02 glance-api[29183]: 2017-09-28 12:12:40.091 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:12:40] "OPTIONS / HTTP/1.0" 200 134 0.000704
Sep 28 12:12:40 ctl02 heat-api-cfn[13300]: 2017-09-28 12:12:40.788 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:12:40] "OPTIONS / HTTP/1.0" 200 134 0.000558
Sep 28 12:12:40 ctl02 heat-api-cfn[13300]: 2017-09-28 12:12:40.899 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:12:40] "OPTIONS / HTTP/1.0" 200 134 0.000326
Sep 28 12:12:41 ctl02 nova-api[24967]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:12:41 ctl02 nova-api[24967]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:12:41 ctl02 nova-api[24967]: 2017-09-28 12:12:41.477 24967 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:12:41 ctl02 nova-api[24967]: 2017-09-28 12:12:41.479 24967 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:12:41 ctl02 nova-api[24967]: 2017-09-28 12:12:41.479 24967 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:12:41 ctl02 nova-api[24967]: 2017-09-28 12:12:41.479 24967 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:12:41 ctl02 nova-api[24967]: 2017-09-28 12:12:41.479 24967 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:12:41 ctl02 nova-api[24967]: 2017-09-28 12:12:41.479 24967 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:12:41 ctl02 nova-api[24967]: 2017-09-28 12:12:41.479 24967 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:12:41 ctl02 nova-api[24967]: 2017-09-28 12:12:41.479 24967 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:12:41 ctl02 nova-api[24967]: 2017-09-28 12:12:41.479 24967 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:12:41 ctl02 nova-api[24967]: 2017-09-28 12:12:41.479 24967 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:12:41 ctl02 nova-api[24967]: 2017-09-28 12:12:41.479 24967 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:12:41 ctl02 nova-api[24967]: 2017-09-28 12:12:41.479 24967 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:12:41 ctl02 nova-api[24967]: 2017-09-28 12:12:41.479 24967 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:12:41 ctl02 nova-api[24967]: 2017-09-28 12:12:41.479 24967 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:12:41 ctl02 nova-api[24967]: 2017-09-28 12:12:41.479 24967 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:12:41 ctl02 nova-api[24967]: 2017-09-28 12:12:41.479 24967 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:12:41 ctl02 nova-api[24967]: 2017-09-28 12:12:41.479 24967 ERROR nova.wsgi     self.filename))
Sep 28 12:12:41 ctl02 nova-api[24967]: 2017-09-28 12:12:41.479 24967 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:12:41 ctl02 nova-api[24967]: 2017-09-28 12:12:41.479 24967 ERROR nova.wsgi
Sep 28 12:12:41 ctl02 nova-api[24967]: 2017-09-28 12:12:41.480 24967 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:12:41 ctl02 nova-api[24967]: 2017-09-28 12:12:41.616 24967 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:12:41 ctl02 nova-api[24967]: 2017-09-28 12:12:41.869 24967 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:12:41 ctl02 nova-api[24967]: 2017-09-28 12:12:41.871 24967 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:12:41 ctl02 nova-api[24967]: 2017-09-28 12:12:41.871 24967 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:12:41 ctl02 nova-api[24967]: 2017-09-28 12:12:41.872 24967 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:12:42 ctl02 nova-api[24967]: 2017-09-28 12:12:42.006 24967 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:12:42 ctl02 nova-api[24967]: 2017-09-28 12:12:42.008 24967 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:12:42 ctl02 nova-api[24967]: 2017-09-28 12:12:42.008 24967 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:12:42 ctl02 nova-api[24967]: 2017-09-28 12:12:42.008 24967 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:12:42 ctl02 nova-api[24967]: 2017-09-28 12:12:42.012 24967 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:12:42 ctl02 nova-api[24967]: 2017-09-28 12:12:42.012 24967 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:12:42 ctl02 nova-api[24967]: 2017-09-28 12:12:42.012 24967 ERROR nova Traceback (most recent call last):
Sep 28 12:12:42 ctl02 nova-api[24967]: 2017-09-28 12:12:42.012 24967 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:12:42 ctl02 nova-api[24967]: 2017-09-28 12:12:42.012 24967 ERROR nova     sys.exit(main())
Sep 28 12:12:42 ctl02 nova-api[24967]: 2017-09-28 12:12:42.012 24967 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:12:42 ctl02 nova-api[24967]: 2017-09-28 12:12:42.012 24967 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:12:42 ctl02 nova-api[24967]: 2017-09-28 12:12:42.012 24967 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:12:42 ctl02 nova-api[24967]: 2017-09-28 12:12:42.012 24967 ERROR nova     max_url_len=max_url_len)
Sep 28 12:12:42 ctl02 nova-api[24967]: 2017-09-28 12:12:42.012 24967 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:12:42 ctl02 nova-api[24967]: 2017-09-28 12:12:42.012 24967 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:12:42 ctl02 nova-api[24967]: 2017-09-28 12:12:42.012 24967 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:12:42 ctl02 nova-api[24967]: 2017-09-28 12:12:42.012 24967 ERROR nova     sock.listen(backlog)
Sep 28 12:12:42 ctl02 nova-api[24967]: 2017-09-28 12:12:42.012 24967 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:12:42 ctl02 nova-api[24967]: 2017-09-28 12:12:42.012 24967 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:12:42 ctl02 nova-api[24967]: 2017-09-28 12:12:42.012 24967 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:12:42 ctl02 nova-api[24967]: 2017-09-28 12:12:42.012 24967 ERROR nova
Sep 28 12:12:42 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:12:42 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:12:42 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:12:42 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:12:42 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:12:42 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:12:42 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:12:42 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:12:42.610 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:12:42] "OPTIONS / HTTP/1.0" 200 134 0.000509
Sep 28 12:12:43 ctl02 heat-api[13008]: 2017-09-28 12:12:43.963 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:12:43] "OPTIONS / HTTP/1.0" 200 134 0.000674
Sep 28 12:12:43 ctl02 glance-api[29183]: 2017-09-28 12:12:43.992 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:12:43] "OPTIONS / HTTP/1.0" 200 134 0.000688
Sep 28 12:12:44 ctl02 nova-api[24985]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:12:44 ctl02 nova-api[24985]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:12:44 ctl02 nova-api[24985]: 2017-09-28 12:12:44.265 24985 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:12:44 ctl02 nova-api[24985]: 2017-09-28 12:12:44.267 24985 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:12:44 ctl02 nova-api[24985]: 2017-09-28 12:12:44.267 24985 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:12:44 ctl02 nova-api[24985]: 2017-09-28 12:12:44.267 24985 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:12:44 ctl02 nova-api[24985]: 2017-09-28 12:12:44.267 24985 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:12:44 ctl02 nova-api[24985]: 2017-09-28 12:12:44.267 24985 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:12:44 ctl02 nova-api[24985]: 2017-09-28 12:12:44.267 24985 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:12:44 ctl02 nova-api[24985]: 2017-09-28 12:12:44.267 24985 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:12:44 ctl02 nova-api[24985]: 2017-09-28 12:12:44.267 24985 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:12:44 ctl02 nova-api[24985]: 2017-09-28 12:12:44.267 24985 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:12:44 ctl02 nova-api[24985]: 2017-09-28 12:12:44.267 24985 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:12:44 ctl02 nova-api[24985]: 2017-09-28 12:12:44.267 24985 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:12:44 ctl02 nova-api[24985]: 2017-09-28 12:12:44.267 24985 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:12:44 ctl02 nova-api[24985]: 2017-09-28 12:12:44.267 24985 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:12:44 ctl02 nova-api[24985]: 2017-09-28 12:12:44.267 24985 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:12:44 ctl02 nova-api[24985]: 2017-09-28 12:12:44.267 24985 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:12:44 ctl02 nova-api[24985]: 2017-09-28 12:12:44.267 24985 ERROR nova.wsgi     self.filename))
Sep 28 12:12:44 ctl02 nova-api[24985]: 2017-09-28 12:12:44.267 24985 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:12:44 ctl02 nova-api[24985]: 2017-09-28 12:12:44.267 24985 ERROR nova.wsgi
Sep 28 12:12:44 ctl02 nova-api[24985]: 2017-09-28 12:12:44.268 24985 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:12:44 ctl02 heat-api-cfn[13300]: 2017-09-28 12:12:44.357 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:12:44] "OPTIONS / HTTP/1.0" 200 134 0.000534
Sep 28 12:12:44 ctl02 nova-api[24985]: 2017-09-28 12:12:44.405 24985 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:12:44 ctl02 heat-api[13008]: 2017-09-28 12:12:44.660 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:12:44] "OPTIONS / HTTP/1.0" 200 134 0.000626
Sep 28 12:12:44 ctl02 nova-api[24985]: 2017-09-28 12:12:44.663 24985 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:12:44 ctl02 nova-api[24985]: 2017-09-28 12:12:44.665 24985 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:12:44 ctl02 nova-api[24985]: 2017-09-28 12:12:44.666 24985 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:12:44 ctl02 nova-api[24985]: 2017-09-28 12:12:44.666 24985 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:12:44 ctl02 nova-api[24985]: 2017-09-28 12:12:44.802 24985 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:12:44 ctl02 nova-api[24985]: 2017-09-28 12:12:44.804 24985 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:12:44 ctl02 nova-api[24985]: 2017-09-28 12:12:44.805 24985 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:12:44 ctl02 nova-api[24985]: 2017-09-28 12:12:44.805 24985 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:12:44 ctl02 nova-api[24985]: 2017-09-28 12:12:44.808 24985 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:12:44 ctl02 nova-api[24985]: 2017-09-28 12:12:44.809 24985 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:12:44 ctl02 nova-api[24985]: 2017-09-28 12:12:44.809 24985 ERROR nova Traceback (most recent call last):
Sep 28 12:12:44 ctl02 nova-api[24985]: 2017-09-28 12:12:44.809 24985 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:12:44 ctl02 nova-api[24985]: 2017-09-28 12:12:44.809 24985 ERROR nova     sys.exit(main())
Sep 28 12:12:44 ctl02 nova-api[24985]: 2017-09-28 12:12:44.809 24985 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:12:44 ctl02 nova-api[24985]: 2017-09-28 12:12:44.809 24985 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:12:44 ctl02 nova-api[24985]: 2017-09-28 12:12:44.809 24985 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:12:44 ctl02 nova-api[24985]: 2017-09-28 12:12:44.809 24985 ERROR nova     max_url_len=max_url_len)
Sep 28 12:12:44 ctl02 nova-api[24985]: 2017-09-28 12:12:44.809 24985 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:12:44 ctl02 nova-api[24985]: 2017-09-28 12:12:44.809 24985 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:12:44 ctl02 nova-api[24985]: 2017-09-28 12:12:44.809 24985 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:12:44 ctl02 nova-api[24985]: 2017-09-28 12:12:44.809 24985 ERROR nova     sock.listen(backlog)
Sep 28 12:12:44 ctl02 nova-api[24985]: 2017-09-28 12:12:44.809 24985 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:12:44 ctl02 nova-api[24985]: 2017-09-28 12:12:44.809 24985 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:12:44 ctl02 nova-api[24985]: 2017-09-28 12:12:44.809 24985 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:12:44 ctl02 nova-api[24985]: 2017-09-28 12:12:44.809 24985 ERROR nova
Sep 28 12:12:44 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:12:44 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:12:44 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:12:45 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:12:45 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:12:45 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:12:45 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:12:45 ctl02 glance-api[29183]: 2017-09-28 12:12:45.391 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:12:45] "OPTIONS / HTTP/1.0" 200 134 0.000644
Sep 28 12:12:46 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:12:46.711 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:12:46] "OPTIONS / HTTP/1.0" 200 134 0.000504
Sep 28 12:12:46 ctl02 nova-api[25003]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:12:46 ctl02 nova-api[25003]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:12:47 ctl02 nova-api[25003]: 2017-09-28 12:12:47.008 25003 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:12:47 ctl02 nova-api[25003]: 2017-09-28 12:12:47.010 25003 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:12:47 ctl02 nova-api[25003]: 2017-09-28 12:12:47.010 25003 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:12:47 ctl02 nova-api[25003]: 2017-09-28 12:12:47.010 25003 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:12:47 ctl02 nova-api[25003]: 2017-09-28 12:12:47.010 25003 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:12:47 ctl02 nova-api[25003]: 2017-09-28 12:12:47.010 25003 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:12:47 ctl02 nova-api[25003]: 2017-09-28 12:12:47.010 25003 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:12:47 ctl02 nova-api[25003]: 2017-09-28 12:12:47.010 25003 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:12:47 ctl02 nova-api[25003]: 2017-09-28 12:12:47.010 25003 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:12:47 ctl02 nova-api[25003]: 2017-09-28 12:12:47.010 25003 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:12:47 ctl02 nova-api[25003]: 2017-09-28 12:12:47.010 25003 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:12:47 ctl02 nova-api[25003]: 2017-09-28 12:12:47.010 25003 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:12:47 ctl02 nova-api[25003]: 2017-09-28 12:12:47.010 25003 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:12:47 ctl02 nova-api[25003]: 2017-09-28 12:12:47.010 25003 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:12:47 ctl02 nova-api[25003]: 2017-09-28 12:12:47.010 25003 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:12:47 ctl02 nova-api[25003]: 2017-09-28 12:12:47.010 25003 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:12:47 ctl02 nova-api[25003]: 2017-09-28 12:12:47.010 25003 ERROR nova.wsgi     self.filename))
Sep 28 12:12:47 ctl02 nova-api[25003]: 2017-09-28 12:12:47.010 25003 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:12:47 ctl02 nova-api[25003]: 2017-09-28 12:12:47.010 25003 ERROR nova.wsgi
Sep 28 12:12:47 ctl02 nova-api[25003]: 2017-09-28 12:12:47.011 25003 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:12:47 ctl02 nova-api[25003]: 2017-09-28 12:12:47.146 25003 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:12:47 ctl02 nova-api[25003]: 2017-09-28 12:12:47.396 25003 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:12:47 ctl02 nova-api[25003]: 2017-09-28 12:12:47.399 25003 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:12:47 ctl02 nova-api[25003]: 2017-09-28 12:12:47.399 25003 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:12:47 ctl02 nova-api[25003]: 2017-09-28 12:12:47.399 25003 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:12:47 ctl02 nova-api[25003]: 2017-09-28 12:12:47.532 25003 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:12:47 ctl02 nova-api[25003]: 2017-09-28 12:12:47.534 25003 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:12:47 ctl02 nova-api[25003]: 2017-09-28 12:12:47.534 25003 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:12:47 ctl02 nova-api[25003]: 2017-09-28 12:12:47.534 25003 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:12:47 ctl02 nova-api[25003]: 2017-09-28 12:12:47.538 25003 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:12:47 ctl02 nova-api[25003]: 2017-09-28 12:12:47.538 25003 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:12:47 ctl02 nova-api[25003]: 2017-09-28 12:12:47.538 25003 ERROR nova Traceback (most recent call last):
Sep 28 12:12:47 ctl02 nova-api[25003]: 2017-09-28 12:12:47.538 25003 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:12:47 ctl02 nova-api[25003]: 2017-09-28 12:12:47.538 25003 ERROR nova     sys.exit(main())
Sep 28 12:12:47 ctl02 nova-api[25003]: 2017-09-28 12:12:47.538 25003 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:12:47 ctl02 nova-api[25003]: 2017-09-28 12:12:47.538 25003 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:12:47 ctl02 nova-api[25003]: 2017-09-28 12:12:47.538 25003 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:12:47 ctl02 nova-api[25003]: 2017-09-28 12:12:47.538 25003 ERROR nova     max_url_len=max_url_len)
Sep 28 12:12:47 ctl02 nova-api[25003]: 2017-09-28 12:12:47.538 25003 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:12:47 ctl02 nova-api[25003]: 2017-09-28 12:12:47.538 25003 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:12:47 ctl02 nova-api[25003]: 2017-09-28 12:12:47.538 25003 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:12:47 ctl02 nova-api[25003]: 2017-09-28 12:12:47.538 25003 ERROR nova     sock.listen(backlog)
Sep 28 12:12:47 ctl02 nova-api[25003]: 2017-09-28 12:12:47.538 25003 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:12:47 ctl02 nova-api[25003]: 2017-09-28 12:12:47.538 25003 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:12:47 ctl02 nova-api[25003]: 2017-09-28 12:12:47.538 25003 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:12:47 ctl02 nova-api[25003]: 2017-09-28 12:12:47.538 25003 ERROR nova
Sep 28 12:12:47 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:12:47 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:12:47 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:12:47 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:12:47.804 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:12:47] "OPTIONS / HTTP/1.0" 200 134 0.000537
Sep 28 12:12:47 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:12:47 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:12:47 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:12:47 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:12:48 ctl02 heat-api[13008]: 2017-09-28 12:12:48.820 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:12:48] "OPTIONS / HTTP/1.0" 200 134 0.000645
Sep 28 12:12:49 ctl02 nova-api[25021]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:12:49 ctl02 nova-api[25021]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:12:49 ctl02 nova-api[25021]: 2017-09-28 12:12:49.729 25021 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:12:49 ctl02 nova-api[25021]: 2017-09-28 12:12:49.732 25021 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:12:49 ctl02 nova-api[25021]: 2017-09-28 12:12:49.732 25021 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:12:49 ctl02 nova-api[25021]: 2017-09-28 12:12:49.732 25021 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:12:49 ctl02 nova-api[25021]: 2017-09-28 12:12:49.732 25021 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:12:49 ctl02 nova-api[25021]: 2017-09-28 12:12:49.732 25021 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:12:49 ctl02 nova-api[25021]: 2017-09-28 12:12:49.732 25021 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:12:49 ctl02 nova-api[25021]: 2017-09-28 12:12:49.732 25021 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:12:49 ctl02 nova-api[25021]: 2017-09-28 12:12:49.732 25021 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:12:49 ctl02 nova-api[25021]: 2017-09-28 12:12:49.732 25021 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:12:49 ctl02 nova-api[25021]: 2017-09-28 12:12:49.732 25021 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:12:49 ctl02 nova-api[25021]: 2017-09-28 12:12:49.732 25021 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:12:49 ctl02 nova-api[25021]: 2017-09-28 12:12:49.732 25021 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:12:49 ctl02 nova-api[25021]: 2017-09-28 12:12:49.732 25021 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:12:49 ctl02 nova-api[25021]: 2017-09-28 12:12:49.732 25021 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:12:49 ctl02 nova-api[25021]: 2017-09-28 12:12:49.732 25021 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:12:49 ctl02 nova-api[25021]: 2017-09-28 12:12:49.732 25021 ERROR nova.wsgi     self.filename))
Sep 28 12:12:49 ctl02 nova-api[25021]: 2017-09-28 12:12:49.732 25021 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:12:49 ctl02 nova-api[25021]: 2017-09-28 12:12:49.732 25021 ERROR nova.wsgi
Sep 28 12:12:49 ctl02 nova-api[25021]: 2017-09-28 12:12:49.734 25021 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:12:49 ctl02 nova-api[25021]: 2017-09-28 12:12:49.870 25021 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:12:49 ctl02 glance-api[29183]: 2017-09-28 12:12:49.873 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:12:49] "OPTIONS / HTTP/1.0" 200 134 0.000641
Sep 28 12:12:50 ctl02 nova-api[25021]: 2017-09-28 12:12:50.128 25021 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:12:50 ctl02 nova-api[25021]: 2017-09-28 12:12:50.131 25021 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:12:50 ctl02 nova-api[25021]: 2017-09-28 12:12:50.131 25021 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:12:50 ctl02 nova-api[25021]: 2017-09-28 12:12:50.132 25021 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:12:50 ctl02 nova-api[25021]: 2017-09-28 12:12:50.268 25021 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:12:50 ctl02 nova-api[25021]: 2017-09-28 12:12:50.271 25021 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:12:50 ctl02 nova-api[25021]: 2017-09-28 12:12:50.272 25021 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:12:50 ctl02 nova-api[25021]: 2017-09-28 12:12:50.272 25021 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:12:50 ctl02 nova-api[25021]: 2017-09-28 12:12:50.275 25021 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:12:50 ctl02 nova-api[25021]: 2017-09-28 12:12:50.276 25021 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:12:50 ctl02 nova-api[25021]: 2017-09-28 12:12:50.276 25021 ERROR nova Traceback (most recent call last):
Sep 28 12:12:50 ctl02 nova-api[25021]: 2017-09-28 12:12:50.276 25021 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:12:50 ctl02 nova-api[25021]: 2017-09-28 12:12:50.276 25021 ERROR nova     sys.exit(main())
Sep 28 12:12:50 ctl02 nova-api[25021]: 2017-09-28 12:12:50.276 25021 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:12:50 ctl02 nova-api[25021]: 2017-09-28 12:12:50.276 25021 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:12:50 ctl02 nova-api[25021]: 2017-09-28 12:12:50.276 25021 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:12:50 ctl02 nova-api[25021]: 2017-09-28 12:12:50.276 25021 ERROR nova     max_url_len=max_url_len)
Sep 28 12:12:50 ctl02 nova-api[25021]: 2017-09-28 12:12:50.276 25021 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:12:50 ctl02 nova-api[25021]: 2017-09-28 12:12:50.276 25021 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:12:50 ctl02 nova-api[25021]: 2017-09-28 12:12:50.276 25021 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:12:50 ctl02 nova-api[25021]: 2017-09-28 12:12:50.276 25021 ERROR nova     sock.listen(backlog)
Sep 28 12:12:50 ctl02 nova-api[25021]: 2017-09-28 12:12:50.276 25021 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:12:50 ctl02 nova-api[25021]: 2017-09-28 12:12:50.276 25021 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:12:50 ctl02 nova-api[25021]: 2017-09-28 12:12:50.276 25021 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:12:50 ctl02 nova-api[25021]: 2017-09-28 12:12:50.276 25021 ERROR nova
Sep 28 12:12:50 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:12:50 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:12:50 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:12:50 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:12:50 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:12:50 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:12:50 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:12:50 ctl02 heat-api-cfn[13300]: 2017-09-28 12:12:50.902 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:12:50] "OPTIONS / HTTP/1.0" 200 134 0.000547
Sep 28 12:12:51 ctl02 heat-api-cfn[13300]: 2017-09-28 12:12:51.064 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:12:51] "OPTIONS / HTTP/1.0" 200 134 0.000554
Sep 28 12:12:52 ctl02 nova-api[25039]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:12:52 ctl02 nova-api[25039]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:12:52 ctl02 nova-api[25039]: 2017-09-28 12:12:52.490 25039 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:12:52 ctl02 nova-api[25039]: 2017-09-28 12:12:52.492 25039 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:12:52 ctl02 nova-api[25039]: 2017-09-28 12:12:52.492 25039 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:12:52 ctl02 nova-api[25039]: 2017-09-28 12:12:52.492 25039 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:12:52 ctl02 nova-api[25039]: 2017-09-28 12:12:52.492 25039 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:12:52 ctl02 nova-api[25039]: 2017-09-28 12:12:52.492 25039 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:12:52 ctl02 nova-api[25039]: 2017-09-28 12:12:52.492 25039 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:12:52 ctl02 nova-api[25039]: 2017-09-28 12:12:52.492 25039 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:12:52 ctl02 nova-api[25039]: 2017-09-28 12:12:52.492 25039 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:12:52 ctl02 nova-api[25039]: 2017-09-28 12:12:52.492 25039 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:12:52 ctl02 nova-api[25039]: 2017-09-28 12:12:52.492 25039 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:12:52 ctl02 nova-api[25039]: 2017-09-28 12:12:52.492 25039 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:12:52 ctl02 nova-api[25039]: 2017-09-28 12:12:52.492 25039 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:12:52 ctl02 nova-api[25039]: 2017-09-28 12:12:52.492 25039 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:12:52 ctl02 nova-api[25039]: 2017-09-28 12:12:52.492 25039 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:12:52 ctl02 nova-api[25039]: 2017-09-28 12:12:52.492 25039 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:12:52 ctl02 nova-api[25039]: 2017-09-28 12:12:52.492 25039 ERROR nova.wsgi     self.filename))
Sep 28 12:12:52 ctl02 nova-api[25039]: 2017-09-28 12:12:52.492 25039 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:12:52 ctl02 nova-api[25039]: 2017-09-28 12:12:52.492 25039 ERROR nova.wsgi
Sep 28 12:12:52 ctl02 nova-api[25039]: 2017-09-28 12:12:52.493 25039 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:12:52 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x97ab5b26)
Sep 28 12:12:52 ctl02 nova-cert[4860]: 2017-09-28 12:12:52.546 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:12:52 ctl02 nova-api[25039]: 2017-09-28 12:12:52.629 25039 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:12:52 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:12:52.782 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:12:52] "OPTIONS / HTTP/1.0" 200 134 0.000461
Sep 28 12:12:52 ctl02 nova-api[25039]: 2017-09-28 12:12:52.885 25039 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:12:52 ctl02 nova-api[25039]: 2017-09-28 12:12:52.887 25039 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:12:52 ctl02 nova-api[25039]: 2017-09-28 12:12:52.887 25039 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:12:52 ctl02 nova-api[25039]: 2017-09-28 12:12:52.888 25039 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:12:53 ctl02 nova-api[25039]: 2017-09-28 12:12:53.021 25039 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:12:53 ctl02 nova-api[25039]: 2017-09-28 12:12:53.023 25039 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:12:53 ctl02 nova-api[25039]: 2017-09-28 12:12:53.024 25039 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:12:53 ctl02 nova-api[25039]: 2017-09-28 12:12:53.024 25039 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:12:53 ctl02 nova-api[25039]: 2017-09-28 12:12:53.027 25039 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:12:53 ctl02 nova-api[25039]: 2017-09-28 12:12:53.028 25039 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:12:53 ctl02 nova-api[25039]: 2017-09-28 12:12:53.028 25039 ERROR nova Traceback (most recent call last):
Sep 28 12:12:53 ctl02 nova-api[25039]: 2017-09-28 12:12:53.028 25039 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:12:53 ctl02 nova-api[25039]: 2017-09-28 12:12:53.028 25039 ERROR nova     sys.exit(main())
Sep 28 12:12:53 ctl02 nova-api[25039]: 2017-09-28 12:12:53.028 25039 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:12:53 ctl02 nova-api[25039]: 2017-09-28 12:12:53.028 25039 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:12:53 ctl02 nova-api[25039]: 2017-09-28 12:12:53.028 25039 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:12:53 ctl02 nova-api[25039]: 2017-09-28 12:12:53.028 25039 ERROR nova     max_url_len=max_url_len)
Sep 28 12:12:53 ctl02 nova-api[25039]: 2017-09-28 12:12:53.028 25039 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:12:53 ctl02 nova-api[25039]: 2017-09-28 12:12:53.028 25039 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:12:53 ctl02 nova-api[25039]: 2017-09-28 12:12:53.028 25039 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:12:53 ctl02 nova-api[25039]: 2017-09-28 12:12:53.028 25039 ERROR nova     sock.listen(backlog)
Sep 28 12:12:53 ctl02 nova-api[25039]: 2017-09-28 12:12:53.028 25039 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:12:53 ctl02 nova-api[25039]: 2017-09-28 12:12:53.028 25039 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:12:53 ctl02 nova-api[25039]: 2017-09-28 12:12:53.028 25039 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:12:53 ctl02 nova-api[25039]: 2017-09-28 12:12:53.028 25039 ERROR nova
Sep 28 12:12:53 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:12:53 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:12:53 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:12:53 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:12:53 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:12:53 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:12:53 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:12:53 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x97ab5b26)
Sep 28 12:12:53 ctl02 glance-api[29183]: 2017-09-28 12:12:53.902 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:12:53] "OPTIONS / HTTP/1.0" 200 134 0.000636
Sep 28 12:12:54 ctl02 heat-api[13008]: 2017-09-28 12:12:54.025 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:12:54] "OPTIONS / HTTP/1.0" 200 134 0.000694
Sep 28 12:12:54 ctl02 heat-api[13008]: 2017-09-28 12:12:54.412 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:12:54] "OPTIONS / HTTP/1.0" 200 134 0.000675
Sep 28 12:12:54 ctl02 nova-conductor[5056]: 2017-09-28 12:12:54.451 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:12:54 ctl02 nova-conductor[5056]: 2017-09-28 12:12:54.466 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:12:54 ctl02 nova-conductor[5056]: 2017-09-28 12:12:54.467 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:12:54 ctl02 nova-conductor[5056]: 2017-09-28 12:12:54.472 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:12:54 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x97ab5b26)
Sep 28 12:12:54 ctl02 heat-api-cfn[13300]: 2017-09-28 12:12:54.654 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:12:54] "OPTIONS / HTTP/1.0" 200 134 0.000512
Sep 28 12:12:55 ctl02 nova-api[25057]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:12:55 ctl02 nova-api[25057]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:12:55 ctl02 glance-api[29183]: 2017-09-28 12:12:55.141 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:12:55] "OPTIONS / HTTP/1.0" 200 134 0.000622
Sep 28 12:12:55 ctl02 nova-api[25057]: 2017-09-28 12:12:55.248 25057 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:12:55 ctl02 nova-api[25057]: 2017-09-28 12:12:55.250 25057 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:12:55 ctl02 nova-api[25057]: 2017-09-28 12:12:55.250 25057 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:12:55 ctl02 nova-api[25057]: 2017-09-28 12:12:55.250 25057 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:12:55 ctl02 nova-api[25057]: 2017-09-28 12:12:55.250 25057 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:12:55 ctl02 nova-api[25057]: 2017-09-28 12:12:55.250 25057 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:12:55 ctl02 nova-api[25057]: 2017-09-28 12:12:55.250 25057 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:12:55 ctl02 nova-api[25057]: 2017-09-28 12:12:55.250 25057 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:12:55 ctl02 nova-api[25057]: 2017-09-28 12:12:55.250 25057 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:12:55 ctl02 nova-api[25057]: 2017-09-28 12:12:55.250 25057 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:12:55 ctl02 nova-api[25057]: 2017-09-28 12:12:55.250 25057 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:12:55 ctl02 nova-api[25057]: 2017-09-28 12:12:55.250 25057 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:12:55 ctl02 nova-api[25057]: 2017-09-28 12:12:55.250 25057 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:12:55 ctl02 nova-api[25057]: 2017-09-28 12:12:55.250 25057 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:12:55 ctl02 nova-api[25057]: 2017-09-28 12:12:55.250 25057 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:12:55 ctl02 nova-api[25057]: 2017-09-28 12:12:55.250 25057 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:12:55 ctl02 nova-api[25057]: 2017-09-28 12:12:55.250 25057 ERROR nova.wsgi     self.filename))
Sep 28 12:12:55 ctl02 nova-api[25057]: 2017-09-28 12:12:55.250 25057 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:12:55 ctl02 nova-api[25057]: 2017-09-28 12:12:55.250 25057 ERROR nova.wsgi
Sep 28 12:12:55 ctl02 nova-api[25057]: 2017-09-28 12:12:55.252 25057 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:12:55 ctl02 nova-api[25057]: 2017-09-28 12:12:55.386 25057 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:12:55 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x97ab5b26)
Sep 28 12:12:55 ctl02 nova-api[25057]: 2017-09-28 12:12:55.640 25057 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:12:55 ctl02 nova-api[25057]: 2017-09-28 12:12:55.643 25057 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:12:55 ctl02 nova-api[25057]: 2017-09-28 12:12:55.643 25057 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:12:55 ctl02 nova-api[25057]: 2017-09-28 12:12:55.643 25057 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:12:55 ctl02 nova-api[25057]: 2017-09-28 12:12:55.776 25057 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:12:55 ctl02 nova-api[25057]: 2017-09-28 12:12:55.778 25057 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:12:55 ctl02 nova-api[25057]: 2017-09-28 12:12:55.778 25057 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:12:55 ctl02 nova-api[25057]: 2017-09-28 12:12:55.778 25057 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:12:55 ctl02 nova-api[25057]: 2017-09-28 12:12:55.782 25057 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:12:55 ctl02 nova-api[25057]: 2017-09-28 12:12:55.782 25057 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:12:55 ctl02 nova-api[25057]: 2017-09-28 12:12:55.782 25057 ERROR nova Traceback (most recent call last):
Sep 28 12:12:55 ctl02 nova-api[25057]: 2017-09-28 12:12:55.782 25057 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:12:55 ctl02 nova-api[25057]: 2017-09-28 12:12:55.782 25057 ERROR nova     sys.exit(main())
Sep 28 12:12:55 ctl02 nova-api[25057]: 2017-09-28 12:12:55.782 25057 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:12:55 ctl02 nova-api[25057]: 2017-09-28 12:12:55.782 25057 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:12:55 ctl02 nova-api[25057]: 2017-09-28 12:12:55.782 25057 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:12:55 ctl02 nova-api[25057]: 2017-09-28 12:12:55.782 25057 ERROR nova     max_url_len=max_url_len)
Sep 28 12:12:55 ctl02 nova-api[25057]: 2017-09-28 12:12:55.782 25057 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:12:55 ctl02 nova-api[25057]: 2017-09-28 12:12:55.782 25057 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:12:55 ctl02 nova-api[25057]: 2017-09-28 12:12:55.782 25057 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:12:55 ctl02 nova-api[25057]: 2017-09-28 12:12:55.782 25057 ERROR nova     sock.listen(backlog)
Sep 28 12:12:55 ctl02 nova-api[25057]: 2017-09-28 12:12:55.782 25057 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:12:55 ctl02 nova-api[25057]: 2017-09-28 12:12:55.782 25057 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:12:55 ctl02 nova-api[25057]: 2017-09-28 12:12:55.782 25057 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:12:55 ctl02 nova-api[25057]: 2017-09-28 12:12:55.782 25057 ERROR nova
Sep 28 12:12:55 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:12:55 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:12:55 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:12:56 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:12:56 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:12:56 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:12:56 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:12:56 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x97ab5b26)
Sep 28 12:12:57 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:12:57.069 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:12:57] "OPTIONS / HTTP/1.0" 200 134 0.000582
Sep 28 12:12:57 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x97ab5b26)
Sep 28 12:12:57 ctl02 nova-api[25074]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:12:57 ctl02 nova-api[25074]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:12:57 ctl02 nova-api[25074]: 2017-09-28 12:12:57.969 25074 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:12:57 ctl02 nova-api[25074]: 2017-09-28 12:12:57.971 25074 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:12:57 ctl02 nova-api[25074]: 2017-09-28 12:12:57.971 25074 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:12:57 ctl02 nova-api[25074]: 2017-09-28 12:12:57.971 25074 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:12:57 ctl02 nova-api[25074]: 2017-09-28 12:12:57.971 25074 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:12:57 ctl02 nova-api[25074]: 2017-09-28 12:12:57.971 25074 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:12:57 ctl02 nova-api[25074]: 2017-09-28 12:12:57.971 25074 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:12:57 ctl02 nova-api[25074]: 2017-09-28 12:12:57.971 25074 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:12:57 ctl02 nova-api[25074]: 2017-09-28 12:12:57.971 25074 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:12:57 ctl02 nova-api[25074]: 2017-09-28 12:12:57.971 25074 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:12:57 ctl02 nova-api[25074]: 2017-09-28 12:12:57.971 25074 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:12:57 ctl02 nova-api[25074]: 2017-09-28 12:12:57.971 25074 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:12:57 ctl02 nova-api[25074]: 2017-09-28 12:12:57.971 25074 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:12:57 ctl02 nova-api[25074]: 2017-09-28 12:12:57.971 25074 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:12:57 ctl02 nova-api[25074]: 2017-09-28 12:12:57.971 25074 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:12:57 ctl02 nova-api[25074]: 2017-09-28 12:12:57.971 25074 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:12:57 ctl02 nova-api[25074]: 2017-09-28 12:12:57.971 25074 ERROR nova.wsgi     self.filename))
Sep 28 12:12:57 ctl02 nova-api[25074]: 2017-09-28 12:12:57.971 25074 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:12:57 ctl02 nova-api[25074]: 2017-09-28 12:12:57.971 25074 ERROR nova.wsgi
Sep 28 12:12:57 ctl02 nova-api[25074]: 2017-09-28 12:12:57.972 25074 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:12:58 ctl02 nova-api[25074]: 2017-09-28 12:12:58.107 25074 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:12:58 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:12:58.161 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:12:58] "OPTIONS / HTTP/1.0" 200 134 0.000603
Sep 28 12:12:58 ctl02 nova-api[25074]: 2017-09-28 12:12:58.361 25074 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:12:58 ctl02 nova-api[25074]: 2017-09-28 12:12:58.363 25074 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:12:58 ctl02 nova-api[25074]: 2017-09-28 12:12:58.364 25074 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:12:58 ctl02 nova-api[25074]: 2017-09-28 12:12:58.364 25074 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:12:58 ctl02 nova-api[25074]: 2017-09-28 12:12:58.498 25074 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:12:58 ctl02 nova-api[25074]: 2017-09-28 12:12:58.501 25074 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:12:58 ctl02 nova-api[25074]: 2017-09-28 12:12:58.501 25074 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:12:58 ctl02 nova-api[25074]: 2017-09-28 12:12:58.502 25074 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:12:58 ctl02 nova-api[25074]: 2017-09-28 12:12:58.505 25074 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:12:58 ctl02 nova-api[25074]: 2017-09-28 12:12:58.506 25074 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:12:58 ctl02 nova-api[25074]: 2017-09-28 12:12:58.506 25074 ERROR nova Traceback (most recent call last):
Sep 28 12:12:58 ctl02 nova-api[25074]: 2017-09-28 12:12:58.506 25074 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:12:58 ctl02 nova-api[25074]: 2017-09-28 12:12:58.506 25074 ERROR nova     sys.exit(main())
Sep 28 12:12:58 ctl02 nova-api[25074]: 2017-09-28 12:12:58.506 25074 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:12:58 ctl02 nova-api[25074]: 2017-09-28 12:12:58.506 25074 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:12:58 ctl02 nova-api[25074]: 2017-09-28 12:12:58.506 25074 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:12:58 ctl02 nova-api[25074]: 2017-09-28 12:12:58.506 25074 ERROR nova     max_url_len=max_url_len)
Sep 28 12:12:58 ctl02 nova-api[25074]: 2017-09-28 12:12:58.506 25074 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:12:58 ctl02 nova-api[25074]: 2017-09-28 12:12:58.506 25074 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:12:58 ctl02 nova-api[25074]: 2017-09-28 12:12:58.506 25074 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:12:58 ctl02 nova-api[25074]: 2017-09-28 12:12:58.506 25074 ERROR nova     sock.listen(backlog)
Sep 28 12:12:58 ctl02 nova-api[25074]: 2017-09-28 12:12:58.506 25074 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:12:58 ctl02 nova-api[25074]: 2017-09-28 12:12:58.506 25074 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:12:58 ctl02 nova-api[25074]: 2017-09-28 12:12:58.506 25074 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:12:58 ctl02 nova-api[25074]: 2017-09-28 12:12:58.506 25074 ERROR nova
Sep 28 12:12:58 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x97ab5b26)
Sep 28 12:12:58 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:12:58 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:12:58 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:12:58 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:12:58 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:12:58 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:12:58 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:12:59 ctl02 heat-api[13008]: 2017-09-28 12:12:59.057 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:12:59] "OPTIONS / HTTP/1.0" 200 134 0.000640
Sep 28 12:12:59 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x97ab5b26)
Sep 28 12:12:59 ctl02 glance-api[29183]: 2017-09-28 12:12:59.864 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:12:59] "OPTIONS / HTTP/1.0" 200 134 0.000641
Sep 28 12:13:00 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x97ab5b26)
Sep 28 12:13:00 ctl02 nova-api[25093]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:13:00 ctl02 nova-api[25093]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:13:00 ctl02 nova-api[25093]: 2017-09-28 12:13:00.780 25093 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:13:00 ctl02 nova-api[25093]: 2017-09-28 12:13:00.782 25093 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:13:00 ctl02 nova-api[25093]: 2017-09-28 12:13:00.782 25093 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:13:00 ctl02 nova-api[25093]: 2017-09-28 12:13:00.782 25093 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:13:00 ctl02 nova-api[25093]: 2017-09-28 12:13:00.782 25093 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:13:00 ctl02 nova-api[25093]: 2017-09-28 12:13:00.782 25093 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:13:00 ctl02 nova-api[25093]: 2017-09-28 12:13:00.782 25093 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:13:00 ctl02 nova-api[25093]: 2017-09-28 12:13:00.782 25093 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:13:00 ctl02 nova-api[25093]: 2017-09-28 12:13:00.782 25093 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:13:00 ctl02 nova-api[25093]: 2017-09-28 12:13:00.782 25093 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:13:00 ctl02 nova-api[25093]: 2017-09-28 12:13:00.782 25093 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:13:00 ctl02 nova-api[25093]: 2017-09-28 12:13:00.782 25093 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:13:00 ctl02 nova-api[25093]: 2017-09-28 12:13:00.782 25093 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:13:00 ctl02 nova-api[25093]: 2017-09-28 12:13:00.782 25093 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:13:00 ctl02 nova-api[25093]: 2017-09-28 12:13:00.782 25093 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:13:00 ctl02 nova-api[25093]: 2017-09-28 12:13:00.782 25093 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:13:00 ctl02 nova-api[25093]: 2017-09-28 12:13:00.782 25093 ERROR nova.wsgi     self.filename))
Sep 28 12:13:00 ctl02 nova-api[25093]: 2017-09-28 12:13:00.782 25093 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:13:00 ctl02 nova-api[25093]: 2017-09-28 12:13:00.782 25093 ERROR nova.wsgi
Sep 28 12:13:00 ctl02 nova-api[25093]: 2017-09-28 12:13:00.783 25093 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:13:00 ctl02 nova-api[25093]: 2017-09-28 12:13:00.918 25093 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:13:01 ctl02 heat-api-cfn[13300]: 2017-09-28 12:13:01.141 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:13:01] "OPTIONS / HTTP/1.0" 200 134 0.000571
Sep 28 12:13:01 ctl02 nova-api[25093]: 2017-09-28 12:13:01.172 25093 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:13:01 ctl02 nova-api[25093]: 2017-09-28 12:13:01.174 25093 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:13:01 ctl02 nova-api[25093]: 2017-09-28 12:13:01.174 25093 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:13:01 ctl02 nova-api[25093]: 2017-09-28 12:13:01.175 25093 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:13:01 ctl02 heat-api-cfn[13300]: 2017-09-28 12:13:01.272 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:13:01] "OPTIONS / HTTP/1.0" 200 134 0.000576
Sep 28 12:13:01 ctl02 nova-api[25093]: 2017-09-28 12:13:01.309 25093 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:13:01 ctl02 nova-api[25093]: 2017-09-28 12:13:01.311 25093 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:13:01 ctl02 nova-api[25093]: 2017-09-28 12:13:01.312 25093 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:13:01 ctl02 nova-api[25093]: 2017-09-28 12:13:01.312 25093 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:13:01 ctl02 nova-api[25093]: 2017-09-28 12:13:01.315 25093 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:13:01 ctl02 nova-api[25093]: 2017-09-28 12:13:01.316 25093 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:13:01 ctl02 nova-api[25093]: 2017-09-28 12:13:01.316 25093 ERROR nova Traceback (most recent call last):
Sep 28 12:13:01 ctl02 nova-api[25093]: 2017-09-28 12:13:01.316 25093 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:13:01 ctl02 nova-api[25093]: 2017-09-28 12:13:01.316 25093 ERROR nova     sys.exit(main())
Sep 28 12:13:01 ctl02 nova-api[25093]: 2017-09-28 12:13:01.316 25093 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:13:01 ctl02 nova-api[25093]: 2017-09-28 12:13:01.316 25093 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:13:01 ctl02 nova-api[25093]: 2017-09-28 12:13:01.316 25093 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:13:01 ctl02 nova-api[25093]: 2017-09-28 12:13:01.316 25093 ERROR nova     max_url_len=max_url_len)
Sep 28 12:13:01 ctl02 nova-api[25093]: 2017-09-28 12:13:01.316 25093 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:13:01 ctl02 nova-api[25093]: 2017-09-28 12:13:01.316 25093 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:13:01 ctl02 nova-api[25093]: 2017-09-28 12:13:01.316 25093 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:13:01 ctl02 nova-api[25093]: 2017-09-28 12:13:01.316 25093 ERROR nova     sock.listen(backlog)
Sep 28 12:13:01 ctl02 nova-api[25093]: 2017-09-28 12:13:01.316 25093 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:13:01 ctl02 nova-api[25093]: 2017-09-28 12:13:01.316 25093 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:13:01 ctl02 nova-api[25093]: 2017-09-28 12:13:01.316 25093 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:13:01 ctl02 nova-api[25093]: 2017-09-28 12:13:01.316 25093 ERROR nova
Sep 28 12:13:01 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:13:01 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:13:01 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:13:01 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x97ab5b26)
Sep 28 12:13:01 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:13:01 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:13:01 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:13:01 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:13:02 ctl02 nova-consoleauth[5433]: 2017-09-28 12:13:02.440 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:13:02 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x97ab5b26)
Sep 28 12:13:02 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:13:02.654 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:13:02] "OPTIONS / HTTP/1.0" 200 134 0.000538
Sep 28 12:13:03 ctl02 nova-api[25111]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:13:03 ctl02 nova-api[25111]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:13:03 ctl02 nova-api[25111]: 2017-09-28 12:13:03.501 25111 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:13:03 ctl02 nova-api[25111]: 2017-09-28 12:13:03.503 25111 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:13:03 ctl02 nova-api[25111]: 2017-09-28 12:13:03.503 25111 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:13:03 ctl02 nova-api[25111]: 2017-09-28 12:13:03.503 25111 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:13:03 ctl02 nova-api[25111]: 2017-09-28 12:13:03.503 25111 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:13:03 ctl02 nova-api[25111]: 2017-09-28 12:13:03.503 25111 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:13:03 ctl02 nova-api[25111]: 2017-09-28 12:13:03.503 25111 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:13:03 ctl02 nova-api[25111]: 2017-09-28 12:13:03.503 25111 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:13:03 ctl02 nova-api[25111]: 2017-09-28 12:13:03.503 25111 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:13:03 ctl02 nova-api[25111]: 2017-09-28 12:13:03.503 25111 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:13:03 ctl02 nova-api[25111]: 2017-09-28 12:13:03.503 25111 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:13:03 ctl02 nova-api[25111]: 2017-09-28 12:13:03.503 25111 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:13:03 ctl02 nova-api[25111]: 2017-09-28 12:13:03.503 25111 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:13:03 ctl02 nova-api[25111]: 2017-09-28 12:13:03.503 25111 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:13:03 ctl02 nova-api[25111]: 2017-09-28 12:13:03.503 25111 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:13:03 ctl02 nova-api[25111]: 2017-09-28 12:13:03.503 25111 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:13:03 ctl02 nova-api[25111]: 2017-09-28 12:13:03.503 25111 ERROR nova.wsgi     self.filename))
Sep 28 12:13:03 ctl02 nova-api[25111]: 2017-09-28 12:13:03.503 25111 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:13:03 ctl02 nova-api[25111]: 2017-09-28 12:13:03.503 25111 ERROR nova.wsgi
Sep 28 12:13:03 ctl02 nova-api[25111]: 2017-09-28 12:13:03.505 25111 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:13:03 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:13:03 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:13:03 ctl02 nova-api[25111]: 2017-09-28 12:13:03.644 25111 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:13:03 ctl02 nova-api[25111]: 2017-09-28 12:13:03.897 25111 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:13:03 ctl02 nova-api[25111]: 2017-09-28 12:13:03.900 25111 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:13:03 ctl02 nova-api[25111]: 2017-09-28 12:13:03.900 25111 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:13:03 ctl02 nova-api[25111]: 2017-09-28 12:13:03.901 25111 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:13:03 ctl02 heat-api[13008]: 2017-09-28 12:13:03.916 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:13:03] "OPTIONS / HTTP/1.0" 200 134 0.000656
Sep 28 12:13:04 ctl02 heat-api[13008]: 2017-09-28 12:13:04.019 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:13:04] "OPTIONS / HTTP/1.0" 200 134 0.000669
Sep 28 12:13:04 ctl02 nova-api[25111]: 2017-09-28 12:13:04.036 25111 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:13:04 ctl02 nova-api[25111]: 2017-09-28 12:13:04.038 25111 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:13:04 ctl02 nova-api[25111]: 2017-09-28 12:13:04.038 25111 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:13:04 ctl02 nova-api[25111]: 2017-09-28 12:13:04.038 25111 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:13:04 ctl02 nova-api[25111]: 2017-09-28 12:13:04.041 25111 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:13:04 ctl02 nova-api[25111]: 2017-09-28 12:13:04.042 25111 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:13:04 ctl02 nova-api[25111]: 2017-09-28 12:13:04.042 25111 ERROR nova Traceback (most recent call last):
Sep 28 12:13:04 ctl02 nova-api[25111]: 2017-09-28 12:13:04.042 25111 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:13:04 ctl02 nova-api[25111]: 2017-09-28 12:13:04.042 25111 ERROR nova     sys.exit(main())
Sep 28 12:13:04 ctl02 nova-api[25111]: 2017-09-28 12:13:04.042 25111 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:13:04 ctl02 nova-api[25111]: 2017-09-28 12:13:04.042 25111 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:13:04 ctl02 nova-api[25111]: 2017-09-28 12:13:04.042 25111 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:13:04 ctl02 nova-api[25111]: 2017-09-28 12:13:04.042 25111 ERROR nova     max_url_len=max_url_len)
Sep 28 12:13:04 ctl02 nova-api[25111]: 2017-09-28 12:13:04.042 25111 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:13:04 ctl02 nova-api[25111]: 2017-09-28 12:13:04.042 25111 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:13:04 ctl02 nova-api[25111]: 2017-09-28 12:13:04.042 25111 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:13:04 ctl02 nova-api[25111]: 2017-09-28 12:13:04.042 25111 ERROR nova     sock.listen(backlog)
Sep 28 12:13:04 ctl02 nova-api[25111]: 2017-09-28 12:13:04.042 25111 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:13:04 ctl02 nova-api[25111]: 2017-09-28 12:13:04.042 25111 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:13:04 ctl02 nova-api[25111]: 2017-09-28 12:13:04.042 25111 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:13:04 ctl02 nova-api[25111]: 2017-09-28 12:13:04.042 25111 ERROR nova
Sep 28 12:13:04 ctl02 glance-api[29183]: 2017-09-28 12:13:04.050 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:13:04] "OPTIONS / HTTP/1.0" 200 134 0.000639
Sep 28 12:13:04 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:13:04 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:13:04 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:13:04 ctl02 heat-api-cfn[13300]: 2017-09-28 12:13:04.317 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:13:04] "OPTIONS / HTTP/1.0" 200 134 0.000593
Sep 28 12:13:04 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:13:04 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:13:04 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:13:04 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:13:04 ctl02 glance-api[29183]: 2017-09-28 12:13:04.932 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:13:04] "OPTIONS / HTTP/1.0" 200 134 0.000700
Sep 28 12:13:05 ctl02 nova-scheduler[5620]: 2017-09-28 12:13:05.458 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:13:05 ctl02 heat-engine[12803]: 2017-09-28 12:13:05.519 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:13:05 ctl02 heat-engine[12803]: 2017-09-28 12:13:05.545 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:13:05 ctl02 heat-engine[12803]: 2017-09-28 12:13:05.560 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:13:05 ctl02 heat-engine[12803]: 2017-09-28 12:13:05.568 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:13:06 ctl02 nova-api[25134]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:13:06 ctl02 nova-api[25134]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:13:06 ctl02 nova-api[25134]: 2017-09-28 12:13:06.250 25134 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:13:06 ctl02 nova-api[25134]: 2017-09-28 12:13:06.252 25134 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:13:06 ctl02 nova-api[25134]: 2017-09-28 12:13:06.252 25134 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:13:06 ctl02 nova-api[25134]: 2017-09-28 12:13:06.252 25134 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:13:06 ctl02 nova-api[25134]: 2017-09-28 12:13:06.252 25134 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:13:06 ctl02 nova-api[25134]: 2017-09-28 12:13:06.252 25134 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:13:06 ctl02 nova-api[25134]: 2017-09-28 12:13:06.252 25134 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:13:06 ctl02 nova-api[25134]: 2017-09-28 12:13:06.252 25134 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:13:06 ctl02 nova-api[25134]: 2017-09-28 12:13:06.252 25134 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:13:06 ctl02 nova-api[25134]: 2017-09-28 12:13:06.252 25134 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:13:06 ctl02 nova-api[25134]: 2017-09-28 12:13:06.252 25134 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:13:06 ctl02 nova-api[25134]: 2017-09-28 12:13:06.252 25134 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:13:06 ctl02 nova-api[25134]: 2017-09-28 12:13:06.252 25134 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:13:06 ctl02 nova-api[25134]: 2017-09-28 12:13:06.252 25134 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:13:06 ctl02 nova-api[25134]: 2017-09-28 12:13:06.252 25134 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:13:06 ctl02 nova-api[25134]: 2017-09-28 12:13:06.252 25134 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:13:06 ctl02 nova-api[25134]: 2017-09-28 12:13:06.252 25134 ERROR nova.wsgi     self.filename))
Sep 28 12:13:06 ctl02 nova-api[25134]: 2017-09-28 12:13:06.252 25134 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:13:06 ctl02 nova-api[25134]: 2017-09-28 12:13:06.252 25134 ERROR nova.wsgi
Sep 28 12:13:06 ctl02 nova-api[25134]: 2017-09-28 12:13:06.254 25134 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:13:06 ctl02 nova-api[25134]: 2017-09-28 12:13:06.387 25134 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:13:06 ctl02 nova-api[25134]: 2017-09-28 12:13:06.640 25134 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:13:06 ctl02 nova-api[25134]: 2017-09-28 12:13:06.643 25134 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:13:06 ctl02 nova-api[25134]: 2017-09-28 12:13:06.644 25134 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:13:06 ctl02 nova-api[25134]: 2017-09-28 12:13:06.644 25134 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:13:06 ctl02 nova-api[25134]: 2017-09-28 12:13:06.778 25134 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:13:06 ctl02 nova-api[25134]: 2017-09-28 12:13:06.781 25134 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:13:06 ctl02 nova-api[25134]: 2017-09-28 12:13:06.781 25134 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:13:06 ctl02 nova-api[25134]: 2017-09-28 12:13:06.782 25134 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:13:06 ctl02 nova-api[25134]: 2017-09-28 12:13:06.785 25134 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:13:06 ctl02 nova-api[25134]: 2017-09-28 12:13:06.785 25134 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:13:06 ctl02 nova-api[25134]: 2017-09-28 12:13:06.785 25134 ERROR nova Traceback (most recent call last):
Sep 28 12:13:06 ctl02 nova-api[25134]: 2017-09-28 12:13:06.785 25134 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:13:06 ctl02 nova-api[25134]: 2017-09-28 12:13:06.785 25134 ERROR nova     sys.exit(main())
Sep 28 12:13:06 ctl02 nova-api[25134]: 2017-09-28 12:13:06.785 25134 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:13:06 ctl02 nova-api[25134]: 2017-09-28 12:13:06.785 25134 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:13:06 ctl02 nova-api[25134]: 2017-09-28 12:13:06.785 25134 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:13:06 ctl02 nova-api[25134]: 2017-09-28 12:13:06.785 25134 ERROR nova     max_url_len=max_url_len)
Sep 28 12:13:06 ctl02 nova-api[25134]: 2017-09-28 12:13:06.785 25134 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:13:06 ctl02 nova-api[25134]: 2017-09-28 12:13:06.785 25134 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:13:06 ctl02 nova-api[25134]: 2017-09-28 12:13:06.785 25134 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:13:06 ctl02 nova-api[25134]: 2017-09-28 12:13:06.785 25134 ERROR nova     sock.listen(backlog)
Sep 28 12:13:06 ctl02 nova-api[25134]: 2017-09-28 12:13:06.785 25134 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:13:06 ctl02 nova-api[25134]: 2017-09-28 12:13:06.785 25134 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:13:06 ctl02 nova-api[25134]: 2017-09-28 12:13:06.785 25134 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:13:06 ctl02 nova-api[25134]: 2017-09-28 12:13:06.785 25134 ERROR nova
Sep 28 12:13:06 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:13:06 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:13:06 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:13:07 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:13:07 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:13:07 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:13:07 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:13:07 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:13:07.195 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:13:07] "OPTIONS / HTTP/1.0" 200 134 0.000703
Sep 28 12:13:08 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:13:08.471 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:13:08] "OPTIONS / HTTP/1.0" 200 134 0.000477
Sep 28 12:13:08 ctl02 nova-api[25152]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:13:08 ctl02 nova-api[25152]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:13:08 ctl02 heat-api[13008]: 2017-09-28 12:13:08.806 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:13:08] "OPTIONS / HTTP/1.0" 200 134 0.000639
Sep 28 12:13:09 ctl02 nova-api[25152]: 2017-09-28 12:13:09.000 25152 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:13:09 ctl02 nova-api[25152]: 2017-09-28 12:13:09.002 25152 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:13:09 ctl02 nova-api[25152]: 2017-09-28 12:13:09.002 25152 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:13:09 ctl02 nova-api[25152]: 2017-09-28 12:13:09.002 25152 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:13:09 ctl02 nova-api[25152]: 2017-09-28 12:13:09.002 25152 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:13:09 ctl02 nova-api[25152]: 2017-09-28 12:13:09.002 25152 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:13:09 ctl02 nova-api[25152]: 2017-09-28 12:13:09.002 25152 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:13:09 ctl02 nova-api[25152]: 2017-09-28 12:13:09.002 25152 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:13:09 ctl02 nova-api[25152]: 2017-09-28 12:13:09.002 25152 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:13:09 ctl02 nova-api[25152]: 2017-09-28 12:13:09.002 25152 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:13:09 ctl02 nova-api[25152]: 2017-09-28 12:13:09.002 25152 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:13:09 ctl02 nova-api[25152]: 2017-09-28 12:13:09.002 25152 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:13:09 ctl02 nova-api[25152]: 2017-09-28 12:13:09.002 25152 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:13:09 ctl02 nova-api[25152]: 2017-09-28 12:13:09.002 25152 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:13:09 ctl02 nova-api[25152]: 2017-09-28 12:13:09.002 25152 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:13:09 ctl02 nova-api[25152]: 2017-09-28 12:13:09.002 25152 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:13:09 ctl02 nova-api[25152]: 2017-09-28 12:13:09.002 25152 ERROR nova.wsgi     self.filename))
Sep 28 12:13:09 ctl02 nova-api[25152]: 2017-09-28 12:13:09.002 25152 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:13:09 ctl02 nova-api[25152]: 2017-09-28 12:13:09.002 25152 ERROR nova.wsgi
Sep 28 12:13:09 ctl02 nova-api[25152]: 2017-09-28 12:13:09.003 25152 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:13:09 ctl02 nova-api[25152]: 2017-09-28 12:13:09.139 25152 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:13:09 ctl02 nova-api[25152]: 2017-09-28 12:13:09.395 25152 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:13:09 ctl02 nova-api[25152]: 2017-09-28 12:13:09.398 25152 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:13:09 ctl02 nova-api[25152]: 2017-09-28 12:13:09.398 25152 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:13:09 ctl02 nova-api[25152]: 2017-09-28 12:13:09.398 25152 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:13:09 ctl02 nova-api[25152]: 2017-09-28 12:13:09.532 25152 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:13:09 ctl02 nova-api[25152]: 2017-09-28 12:13:09.534 25152 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:13:09 ctl02 nova-api[25152]: 2017-09-28 12:13:09.535 25152 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:13:09 ctl02 nova-api[25152]: 2017-09-28 12:13:09.535 25152 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:13:09 ctl02 nova-api[25152]: 2017-09-28 12:13:09.539 25152 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:13:09 ctl02 nova-api[25152]: 2017-09-28 12:13:09.539 25152 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:13:09 ctl02 nova-api[25152]: 2017-09-28 12:13:09.539 25152 ERROR nova Traceback (most recent call last):
Sep 28 12:13:09 ctl02 nova-api[25152]: 2017-09-28 12:13:09.539 25152 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:13:09 ctl02 nova-api[25152]: 2017-09-28 12:13:09.539 25152 ERROR nova     sys.exit(main())
Sep 28 12:13:09 ctl02 nova-api[25152]: 2017-09-28 12:13:09.539 25152 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:13:09 ctl02 nova-api[25152]: 2017-09-28 12:13:09.539 25152 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:13:09 ctl02 nova-api[25152]: 2017-09-28 12:13:09.539 25152 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:13:09 ctl02 nova-api[25152]: 2017-09-28 12:13:09.539 25152 ERROR nova     max_url_len=max_url_len)
Sep 28 12:13:09 ctl02 nova-api[25152]: 2017-09-28 12:13:09.539 25152 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:13:09 ctl02 nova-api[25152]: 2017-09-28 12:13:09.539 25152 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:13:09 ctl02 nova-api[25152]: 2017-09-28 12:13:09.539 25152 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:13:09 ctl02 nova-api[25152]: 2017-09-28 12:13:09.539 25152 ERROR nova     sock.listen(backlog)
Sep 28 12:13:09 ctl02 nova-api[25152]: 2017-09-28 12:13:09.539 25152 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:13:09 ctl02 nova-api[25152]: 2017-09-28 12:13:09.539 25152 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:13:09 ctl02 nova-api[25152]: 2017-09-28 12:13:09.539 25152 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:13:09 ctl02 nova-api[25152]: 2017-09-28 12:13:09.539 25152 ERROR nova
Sep 28 12:13:09 ctl02 glance-api[29183]: 2017-09-28 12:13:09.654 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:13:09] "OPTIONS / HTTP/1.0" 200 134 0.000646
Sep 28 12:13:09 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:13:09 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:13:09 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:13:09 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:13:09 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:13:09 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:13:09 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:13:11 ctl02 heat-api-cfn[13300]: 2017-09-28 12:13:11.161 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:13:11] "OPTIONS / HTTP/1.0" 200 134 0.000509
Sep 28 12:13:11 ctl02 heat-api-cfn[13300]: 2017-09-28 12:13:11.373 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:13:11] "OPTIONS / HTTP/1.0" 200 134 0.000326
Sep 28 12:13:11 ctl02 nova-api[25170]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:13:11 ctl02 nova-api[25170]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:13:11 ctl02 nova-api[25170]: 2017-09-28 12:13:11.743 25170 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:13:11 ctl02 nova-api[25170]: 2017-09-28 12:13:11.745 25170 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:13:11 ctl02 nova-api[25170]: 2017-09-28 12:13:11.745 25170 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:13:11 ctl02 nova-api[25170]: 2017-09-28 12:13:11.745 25170 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:13:11 ctl02 nova-api[25170]: 2017-09-28 12:13:11.745 25170 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:13:11 ctl02 nova-api[25170]: 2017-09-28 12:13:11.745 25170 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:13:11 ctl02 nova-api[25170]: 2017-09-28 12:13:11.745 25170 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:13:11 ctl02 nova-api[25170]: 2017-09-28 12:13:11.745 25170 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:13:11 ctl02 nova-api[25170]: 2017-09-28 12:13:11.745 25170 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:13:11 ctl02 nova-api[25170]: 2017-09-28 12:13:11.745 25170 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:13:11 ctl02 nova-api[25170]: 2017-09-28 12:13:11.745 25170 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:13:11 ctl02 nova-api[25170]: 2017-09-28 12:13:11.745 25170 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:13:11 ctl02 nova-api[25170]: 2017-09-28 12:13:11.745 25170 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:13:11 ctl02 nova-api[25170]: 2017-09-28 12:13:11.745 25170 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:13:11 ctl02 nova-api[25170]: 2017-09-28 12:13:11.745 25170 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:13:11 ctl02 nova-api[25170]: 2017-09-28 12:13:11.745 25170 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:13:11 ctl02 nova-api[25170]: 2017-09-28 12:13:11.745 25170 ERROR nova.wsgi     self.filename))
Sep 28 12:13:11 ctl02 nova-api[25170]: 2017-09-28 12:13:11.745 25170 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:13:11 ctl02 nova-api[25170]: 2017-09-28 12:13:11.745 25170 ERROR nova.wsgi
Sep 28 12:13:11 ctl02 nova-api[25170]: 2017-09-28 12:13:11.745 25170 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:13:11 ctl02 nova-api[25170]: 2017-09-28 12:13:11.874 25170 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:13:12 ctl02 nova-api[25170]: 2017-09-28 12:13:12.102 25170 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:13:12 ctl02 nova-api[25170]: 2017-09-28 12:13:12.104 25170 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:13:12 ctl02 nova-api[25170]: 2017-09-28 12:13:12.104 25170 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:13:12 ctl02 nova-api[25170]: 2017-09-28 12:13:12.105 25170 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:13:12 ctl02 nova-api[25170]: 2017-09-28 12:13:12.235 25170 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:13:12 ctl02 nova-api[25170]: 2017-09-28 12:13:12.237 25170 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:13:12 ctl02 nova-api[25170]: 2017-09-28 12:13:12.237 25170 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:13:12 ctl02 nova-api[25170]: 2017-09-28 12:13:12.237 25170 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:13:12 ctl02 nova-api[25170]: 2017-09-28 12:13:12.240 25170 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:13:12 ctl02 nova-api[25170]: 2017-09-28 12:13:12.241 25170 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:13:12 ctl02 nova-api[25170]: 2017-09-28 12:13:12.241 25170 ERROR nova Traceback (most recent call last):
Sep 28 12:13:12 ctl02 nova-api[25170]: 2017-09-28 12:13:12.241 25170 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:13:12 ctl02 nova-api[25170]: 2017-09-28 12:13:12.241 25170 ERROR nova     sys.exit(main())
Sep 28 12:13:12 ctl02 nova-api[25170]: 2017-09-28 12:13:12.241 25170 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:13:12 ctl02 nova-api[25170]: 2017-09-28 12:13:12.241 25170 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:13:12 ctl02 nova-api[25170]: 2017-09-28 12:13:12.241 25170 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:13:12 ctl02 nova-api[25170]: 2017-09-28 12:13:12.241 25170 ERROR nova     max_url_len=max_url_len)
Sep 28 12:13:12 ctl02 nova-api[25170]: 2017-09-28 12:13:12.241 25170 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:13:12 ctl02 nova-api[25170]: 2017-09-28 12:13:12.241 25170 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:13:12 ctl02 nova-api[25170]: 2017-09-28 12:13:12.241 25170 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:13:12 ctl02 nova-api[25170]: 2017-09-28 12:13:12.241 25170 ERROR nova     sock.listen(backlog)
Sep 28 12:13:12 ctl02 nova-api[25170]: 2017-09-28 12:13:12.241 25170 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:13:12 ctl02 nova-api[25170]: 2017-09-28 12:13:12.241 25170 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:13:12 ctl02 nova-api[25170]: 2017-09-28 12:13:12.241 25170 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:13:12 ctl02 nova-api[25170]: 2017-09-28 12:13:12.241 25170 ERROR nova
Sep 28 12:13:12 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:13:12.294 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:13:12] "OPTIONS / HTTP/1.0" 200 134 0.000535
Sep 28 12:13:12 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:13:12 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:13:12 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:13:12 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:13:12 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:13:12 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:13:12 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:13:13 ctl02 heat-api[13008]: 2017-09-28 12:13:13.975 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:13:13] "OPTIONS / HTTP/1.0" 200 134 0.000613
Sep 28 12:13:14 ctl02 glance-api[29183]: 2017-09-28 12:13:14.014 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:13:14] "OPTIONS / HTTP/1.0" 200 134 0.000622
Sep 28 12:13:14 ctl02 heat-api[13008]: 2017-09-28 12:13:14.308 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:13:14] "OPTIONS / HTTP/1.0" 200 134 0.000566
Sep 28 12:13:14 ctl02 nova-api[25188]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:13:14 ctl02 nova-api[25188]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:13:14 ctl02 heat-api-cfn[13300]: 2017-09-28 12:13:14.419 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:13:14] "OPTIONS / HTTP/1.0" 200 134 0.000660
Sep 28 12:13:14 ctl02 nova-api[25188]: 2017-09-28 12:13:14.526 25188 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:13:14 ctl02 nova-api[25188]: 2017-09-28 12:13:14.528 25188 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:13:14 ctl02 nova-api[25188]: 2017-09-28 12:13:14.528 25188 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:13:14 ctl02 nova-api[25188]: 2017-09-28 12:13:14.528 25188 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:13:14 ctl02 nova-api[25188]: 2017-09-28 12:13:14.528 25188 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:13:14 ctl02 nova-api[25188]: 2017-09-28 12:13:14.528 25188 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:13:14 ctl02 nova-api[25188]: 2017-09-28 12:13:14.528 25188 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:13:14 ctl02 nova-api[25188]: 2017-09-28 12:13:14.528 25188 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:13:14 ctl02 nova-api[25188]: 2017-09-28 12:13:14.528 25188 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:13:14 ctl02 nova-api[25188]: 2017-09-28 12:13:14.528 25188 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:13:14 ctl02 nova-api[25188]: 2017-09-28 12:13:14.528 25188 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:13:14 ctl02 nova-api[25188]: 2017-09-28 12:13:14.528 25188 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:13:14 ctl02 nova-api[25188]: 2017-09-28 12:13:14.528 25188 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:13:14 ctl02 nova-api[25188]: 2017-09-28 12:13:14.528 25188 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:13:14 ctl02 nova-api[25188]: 2017-09-28 12:13:14.528 25188 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:13:14 ctl02 nova-api[25188]: 2017-09-28 12:13:14.528 25188 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:13:14 ctl02 nova-api[25188]: 2017-09-28 12:13:14.528 25188 ERROR nova.wsgi     self.filename))
Sep 28 12:13:14 ctl02 nova-api[25188]: 2017-09-28 12:13:14.528 25188 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:13:14 ctl02 nova-api[25188]: 2017-09-28 12:13:14.528 25188 ERROR nova.wsgi
Sep 28 12:13:14 ctl02 nova-api[25188]: 2017-09-28 12:13:14.529 25188 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:13:14 ctl02 nova-api[25188]: 2017-09-28 12:13:14.665 25188 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:13:14 ctl02 nova-api[25188]: 2017-09-28 12:13:14.916 25188 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:13:14 ctl02 nova-api[25188]: 2017-09-28 12:13:14.918 25188 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:13:14 ctl02 nova-api[25188]: 2017-09-28 12:13:14.919 25188 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:13:14 ctl02 nova-api[25188]: 2017-09-28 12:13:14.919 25188 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:13:15 ctl02 nova-api[25188]: 2017-09-28 12:13:15.054 25188 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:13:15 ctl02 nova-api[25188]: 2017-09-28 12:13:15.056 25188 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:13:15 ctl02 nova-api[25188]: 2017-09-28 12:13:15.057 25188 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:13:15 ctl02 nova-api[25188]: 2017-09-28 12:13:15.057 25188 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:13:15 ctl02 nova-api[25188]: 2017-09-28 12:13:15.061 25188 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:13:15 ctl02 nova-api[25188]: 2017-09-28 12:13:15.061 25188 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:13:15 ctl02 nova-api[25188]: 2017-09-28 12:13:15.061 25188 ERROR nova Traceback (most recent call last):
Sep 28 12:13:15 ctl02 nova-api[25188]: 2017-09-28 12:13:15.061 25188 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:13:15 ctl02 nova-api[25188]: 2017-09-28 12:13:15.061 25188 ERROR nova     sys.exit(main())
Sep 28 12:13:15 ctl02 nova-api[25188]: 2017-09-28 12:13:15.061 25188 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:13:15 ctl02 nova-api[25188]: 2017-09-28 12:13:15.061 25188 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:13:15 ctl02 nova-api[25188]: 2017-09-28 12:13:15.061 25188 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:13:15 ctl02 nova-api[25188]: 2017-09-28 12:13:15.061 25188 ERROR nova     max_url_len=max_url_len)
Sep 28 12:13:15 ctl02 nova-api[25188]: 2017-09-28 12:13:15.061 25188 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:13:15 ctl02 nova-api[25188]: 2017-09-28 12:13:15.061 25188 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:13:15 ctl02 nova-api[25188]: 2017-09-28 12:13:15.061 25188 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:13:15 ctl02 nova-api[25188]: 2017-09-28 12:13:15.061 25188 ERROR nova     sock.listen(backlog)
Sep 28 12:13:15 ctl02 nova-api[25188]: 2017-09-28 12:13:15.061 25188 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:13:15 ctl02 nova-api[25188]: 2017-09-28 12:13:15.061 25188 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:13:15 ctl02 nova-api[25188]: 2017-09-28 12:13:15.061 25188 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:13:15 ctl02 nova-api[25188]: 2017-09-28 12:13:15.061 25188 ERROR nova
Sep 28 12:13:15 ctl02 glance-api[29183]: 2017-09-28 12:13:15.162 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:13:15] "OPTIONS / HTTP/1.0" 200 134 0.000644
Sep 28 12:13:15 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:13:15 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:13:15 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:13:15 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:13:15 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:13:15 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:13:15 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:13:17 ctl02 nova-api[25206]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:13:17 ctl02 nova-api[25206]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:13:17 ctl02 nova-api[25206]: 2017-09-28 12:13:17.283 25206 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:13:17 ctl02 nova-api[25206]: 2017-09-28 12:13:17.285 25206 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:13:17 ctl02 nova-api[25206]: 2017-09-28 12:13:17.285 25206 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:13:17 ctl02 nova-api[25206]: 2017-09-28 12:13:17.285 25206 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:13:17 ctl02 nova-api[25206]: 2017-09-28 12:13:17.285 25206 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:13:17 ctl02 nova-api[25206]: 2017-09-28 12:13:17.285 25206 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:13:17 ctl02 nova-api[25206]: 2017-09-28 12:13:17.285 25206 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:13:17 ctl02 nova-api[25206]: 2017-09-28 12:13:17.285 25206 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:13:17 ctl02 nova-api[25206]: 2017-09-28 12:13:17.285 25206 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:13:17 ctl02 nova-api[25206]: 2017-09-28 12:13:17.285 25206 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:13:17 ctl02 nova-api[25206]: 2017-09-28 12:13:17.285 25206 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:13:17 ctl02 nova-api[25206]: 2017-09-28 12:13:17.285 25206 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:13:17 ctl02 nova-api[25206]: 2017-09-28 12:13:17.285 25206 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:13:17 ctl02 nova-api[25206]: 2017-09-28 12:13:17.285 25206 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:13:17 ctl02 nova-api[25206]: 2017-09-28 12:13:17.285 25206 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:13:17 ctl02 nova-api[25206]: 2017-09-28 12:13:17.285 25206 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:13:17 ctl02 nova-api[25206]: 2017-09-28 12:13:17.285 25206 ERROR nova.wsgi     self.filename))
Sep 28 12:13:17 ctl02 nova-api[25206]: 2017-09-28 12:13:17.285 25206 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:13:17 ctl02 nova-api[25206]: 2017-09-28 12:13:17.285 25206 ERROR nova.wsgi
Sep 28 12:13:17 ctl02 nova-api[25206]: 2017-09-28 12:13:17.286 25206 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:13:17 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:13:17.409 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:13:17] "OPTIONS / HTTP/1.0" 200 134 0.000506
Sep 28 12:13:17 ctl02 nova-api[25206]: 2017-09-28 12:13:17.420 25206 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:13:17 ctl02 nova-api[25206]: 2017-09-28 12:13:17.672 25206 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:13:17 ctl02 nova-api[25206]: 2017-09-28 12:13:17.674 25206 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:13:17 ctl02 nova-api[25206]: 2017-09-28 12:13:17.674 25206 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:13:17 ctl02 nova-api[25206]: 2017-09-28 12:13:17.675 25206 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:13:17 ctl02 nova-api[25206]: 2017-09-28 12:13:17.808 25206 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:13:17 ctl02 nova-api[25206]: 2017-09-28 12:13:17.810 25206 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:13:17 ctl02 nova-api[25206]: 2017-09-28 12:13:17.810 25206 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:13:17 ctl02 nova-api[25206]: 2017-09-28 12:13:17.811 25206 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:13:17 ctl02 nova-api[25206]: 2017-09-28 12:13:17.814 25206 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:13:17 ctl02 nova-api[25206]: 2017-09-28 12:13:17.814 25206 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:13:17 ctl02 nova-api[25206]: 2017-09-28 12:13:17.814 25206 ERROR nova Traceback (most recent call last):
Sep 28 12:13:17 ctl02 nova-api[25206]: 2017-09-28 12:13:17.814 25206 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:13:17 ctl02 nova-api[25206]: 2017-09-28 12:13:17.814 25206 ERROR nova     sys.exit(main())
Sep 28 12:13:17 ctl02 nova-api[25206]: 2017-09-28 12:13:17.814 25206 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:13:17 ctl02 nova-api[25206]: 2017-09-28 12:13:17.814 25206 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:13:17 ctl02 nova-api[25206]: 2017-09-28 12:13:17.814 25206 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:13:17 ctl02 nova-api[25206]: 2017-09-28 12:13:17.814 25206 ERROR nova     max_url_len=max_url_len)
Sep 28 12:13:17 ctl02 nova-api[25206]: 2017-09-28 12:13:17.814 25206 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:13:17 ctl02 nova-api[25206]: 2017-09-28 12:13:17.814 25206 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:13:17 ctl02 nova-api[25206]: 2017-09-28 12:13:17.814 25206 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:13:17 ctl02 nova-api[25206]: 2017-09-28 12:13:17.814 25206 ERROR nova     sock.listen(backlog)
Sep 28 12:13:17 ctl02 nova-api[25206]: 2017-09-28 12:13:17.814 25206 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:13:17 ctl02 nova-api[25206]: 2017-09-28 12:13:17.814 25206 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:13:17 ctl02 nova-api[25206]: 2017-09-28 12:13:17.814 25206 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:13:17 ctl02 nova-api[25206]: 2017-09-28 12:13:17.814 25206 ERROR nova
Sep 28 12:13:17 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:13:17 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:13:17 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:13:18 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:13:18 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:13:18 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:13:18 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:13:18 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:13:18.862 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:13:18] "OPTIONS / HTTP/1.0" 200 134 0.000528
Sep 28 12:13:19 ctl02 heat-api[13008]: 2017-09-28 12:13:19.112 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:13:19] "OPTIONS / HTTP/1.0" 200 134 0.000682
Sep 28 12:13:19 ctl02 nova-api[25224]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:13:19 ctl02 nova-api[25224]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:13:19 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf2045517)
Sep 28 12:13:19 ctl02 nova-api[25224]: 2017-09-28 12:13:19.993 25224 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:13:19 ctl02 nova-api[25224]: 2017-09-28 12:13:19.995 25224 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:13:19 ctl02 nova-api[25224]: 2017-09-28 12:13:19.995 25224 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:13:19 ctl02 nova-api[25224]: 2017-09-28 12:13:19.995 25224 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:13:19 ctl02 nova-api[25224]: 2017-09-28 12:13:19.995 25224 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:13:19 ctl02 nova-api[25224]: 2017-09-28 12:13:19.995 25224 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:13:19 ctl02 nova-api[25224]: 2017-09-28 12:13:19.995 25224 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:13:19 ctl02 nova-api[25224]: 2017-09-28 12:13:19.995 25224 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:13:19 ctl02 nova-api[25224]: 2017-09-28 12:13:19.995 25224 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:13:19 ctl02 nova-api[25224]: 2017-09-28 12:13:19.995 25224 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:13:19 ctl02 nova-api[25224]: 2017-09-28 12:13:19.995 25224 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:13:19 ctl02 nova-api[25224]: 2017-09-28 12:13:19.995 25224 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:13:19 ctl02 nova-api[25224]: 2017-09-28 12:13:19.995 25224 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:13:19 ctl02 nova-api[25224]: 2017-09-28 12:13:19.995 25224 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:13:19 ctl02 nova-api[25224]: 2017-09-28 12:13:19.995 25224 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:13:19 ctl02 nova-api[25224]: 2017-09-28 12:13:19.995 25224 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:13:19 ctl02 nova-api[25224]: 2017-09-28 12:13:19.995 25224 ERROR nova.wsgi     self.filename))
Sep 28 12:13:19 ctl02 nova-api[25224]: 2017-09-28 12:13:19.995 25224 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:13:19 ctl02 nova-api[25224]: 2017-09-28 12:13:19.995 25224 ERROR nova.wsgi
Sep 28 12:13:19 ctl02 nova-api[25224]: 2017-09-28 12:13:19.996 25224 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:13:20 ctl02 glance-api[29183]: 2017-09-28 12:13:20.033 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:13:20] "OPTIONS / HTTP/1.0" 200 134 0.000641
Sep 28 12:13:20 ctl02 nova-api[25224]: 2017-09-28 12:13:20.134 25224 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:13:20 ctl02 nova-api[25224]: 2017-09-28 12:13:20.387 25224 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:13:20 ctl02 nova-api[25224]: 2017-09-28 12:13:20.404 25224 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:13:20 ctl02 nova-api[25224]: 2017-09-28 12:13:20.405 25224 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:13:20 ctl02 nova-api[25224]: 2017-09-28 12:13:20.405 25224 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:13:20 ctl02 nova-api[25224]: 2017-09-28 12:13:20.553 25224 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:13:20 ctl02 nova-api[25224]: 2017-09-28 12:13:20.555 25224 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:13:20 ctl02 nova-api[25224]: 2017-09-28 12:13:20.555 25224 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:13:20 ctl02 nova-api[25224]: 2017-09-28 12:13:20.556 25224 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:13:20 ctl02 nova-api[25224]: 2017-09-28 12:13:20.559 25224 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:13:20 ctl02 nova-api[25224]: 2017-09-28 12:13:20.559 25224 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:13:20 ctl02 nova-api[25224]: 2017-09-28 12:13:20.559 25224 ERROR nova Traceback (most recent call last):
Sep 28 12:13:20 ctl02 nova-api[25224]: 2017-09-28 12:13:20.559 25224 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:13:20 ctl02 nova-api[25224]: 2017-09-28 12:13:20.559 25224 ERROR nova     sys.exit(main())
Sep 28 12:13:20 ctl02 nova-api[25224]: 2017-09-28 12:13:20.559 25224 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:13:20 ctl02 nova-api[25224]: 2017-09-28 12:13:20.559 25224 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:13:20 ctl02 nova-api[25224]: 2017-09-28 12:13:20.559 25224 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:13:20 ctl02 nova-api[25224]: 2017-09-28 12:13:20.559 25224 ERROR nova     max_url_len=max_url_len)
Sep 28 12:13:20 ctl02 nova-api[25224]: 2017-09-28 12:13:20.559 25224 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:13:20 ctl02 nova-api[25224]: 2017-09-28 12:13:20.559 25224 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:13:20 ctl02 nova-api[25224]: 2017-09-28 12:13:20.559 25224 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:13:20 ctl02 nova-api[25224]: 2017-09-28 12:13:20.559 25224 ERROR nova     sock.listen(backlog)
Sep 28 12:13:20 ctl02 nova-api[25224]: 2017-09-28 12:13:20.559 25224 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:13:20 ctl02 nova-api[25224]: 2017-09-28 12:13:20.559 25224 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:13:20 ctl02 nova-api[25224]: 2017-09-28 12:13:20.559 25224 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:13:20 ctl02 nova-api[25224]: 2017-09-28 12:13:20.559 25224 ERROR nova
Sep 28 12:13:20 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:13:20 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:13:20 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:13:20 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf2045517)
Sep 28 12:13:20 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:13:20 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:13:20 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:13:20 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:13:21 ctl02 heat-api-cfn[13300]: 2017-09-28 12:13:21.103 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:13:21] "OPTIONS / HTTP/1.0" 200 134 0.000526
Sep 28 12:13:21 ctl02 heat-api-cfn[13300]: 2017-09-28 12:13:21.271 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:13:21] "OPTIONS / HTTP/1.0" 200 134 0.000527
Sep 28 12:13:21 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf2045517)
Sep 28 12:13:22 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:13:22.500 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:13:22] "OPTIONS / HTTP/1.0" 200 134 0.000493
Sep 28 12:13:22 ctl02 nova-api[25242]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:13:22 ctl02 nova-api[25242]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:13:22 ctl02 nova-api[25242]: 2017-09-28 12:13:22.732 25242 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:13:22 ctl02 nova-api[25242]: 2017-09-28 12:13:22.734 25242 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:13:22 ctl02 nova-api[25242]: 2017-09-28 12:13:22.734 25242 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:13:22 ctl02 nova-api[25242]: 2017-09-28 12:13:22.734 25242 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:13:22 ctl02 nova-api[25242]: 2017-09-28 12:13:22.734 25242 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:13:22 ctl02 nova-api[25242]: 2017-09-28 12:13:22.734 25242 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:13:22 ctl02 nova-api[25242]: 2017-09-28 12:13:22.734 25242 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:13:22 ctl02 nova-api[25242]: 2017-09-28 12:13:22.734 25242 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:13:22 ctl02 nova-api[25242]: 2017-09-28 12:13:22.734 25242 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:13:22 ctl02 nova-api[25242]: 2017-09-28 12:13:22.734 25242 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:13:22 ctl02 nova-api[25242]: 2017-09-28 12:13:22.734 25242 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:13:22 ctl02 nova-api[25242]: 2017-09-28 12:13:22.734 25242 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:13:22 ctl02 nova-api[25242]: 2017-09-28 12:13:22.734 25242 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:13:22 ctl02 nova-api[25242]: 2017-09-28 12:13:22.734 25242 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:13:22 ctl02 nova-api[25242]: 2017-09-28 12:13:22.734 25242 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:13:22 ctl02 nova-api[25242]: 2017-09-28 12:13:22.734 25242 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:13:22 ctl02 nova-api[25242]: 2017-09-28 12:13:22.734 25242 ERROR nova.wsgi     self.filename))
Sep 28 12:13:22 ctl02 nova-api[25242]: 2017-09-28 12:13:22.734 25242 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:13:22 ctl02 nova-api[25242]: 2017-09-28 12:13:22.734 25242 ERROR nova.wsgi
Sep 28 12:13:22 ctl02 nova-api[25242]: 2017-09-28 12:13:22.735 25242 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:13:22 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf2045517)
Sep 28 12:13:22 ctl02 nova-api[25242]: 2017-09-28 12:13:22.867 25242 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:13:23 ctl02 nova-api[25242]: 2017-09-28 12:13:23.117 25242 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:13:23 ctl02 nova-api[25242]: 2017-09-28 12:13:23.120 25242 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:13:23 ctl02 nova-api[25242]: 2017-09-28 12:13:23.120 25242 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:13:23 ctl02 nova-api[25242]: 2017-09-28 12:13:23.120 25242 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:13:23 ctl02 nova-api[25242]: 2017-09-28 12:13:23.252 25242 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:13:23 ctl02 nova-api[25242]: 2017-09-28 12:13:23.254 25242 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:13:23 ctl02 nova-api[25242]: 2017-09-28 12:13:23.254 25242 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:13:23 ctl02 nova-api[25242]: 2017-09-28 12:13:23.254 25242 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:13:23 ctl02 nova-api[25242]: 2017-09-28 12:13:23.258 25242 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:13:23 ctl02 nova-api[25242]: 2017-09-28 12:13:23.258 25242 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:13:23 ctl02 nova-api[25242]: 2017-09-28 12:13:23.258 25242 ERROR nova Traceback (most recent call last):
Sep 28 12:13:23 ctl02 nova-api[25242]: 2017-09-28 12:13:23.258 25242 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:13:23 ctl02 nova-api[25242]: 2017-09-28 12:13:23.258 25242 ERROR nova     sys.exit(main())
Sep 28 12:13:23 ctl02 nova-api[25242]: 2017-09-28 12:13:23.258 25242 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:13:23 ctl02 nova-api[25242]: 2017-09-28 12:13:23.258 25242 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:13:23 ctl02 nova-api[25242]: 2017-09-28 12:13:23.258 25242 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:13:23 ctl02 nova-api[25242]: 2017-09-28 12:13:23.258 25242 ERROR nova     max_url_len=max_url_len)
Sep 28 12:13:23 ctl02 nova-api[25242]: 2017-09-28 12:13:23.258 25242 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:13:23 ctl02 nova-api[25242]: 2017-09-28 12:13:23.258 25242 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:13:23 ctl02 nova-api[25242]: 2017-09-28 12:13:23.258 25242 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:13:23 ctl02 nova-api[25242]: 2017-09-28 12:13:23.258 25242 ERROR nova     sock.listen(backlog)
Sep 28 12:13:23 ctl02 nova-api[25242]: 2017-09-28 12:13:23.258 25242 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:13:23 ctl02 nova-api[25242]: 2017-09-28 12:13:23.258 25242 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:13:23 ctl02 nova-api[25242]: 2017-09-28 12:13:23.258 25242 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:13:23 ctl02 nova-api[25242]: 2017-09-28 12:13:23.258 25242 ERROR nova
Sep 28 12:13:23 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:13:23 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:13:23 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:13:23 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:13:23 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:13:23 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:13:23 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:13:23 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf2045517)
Sep 28 12:13:23 ctl02 glance-api[29183]: 2017-09-28 12:13:23.917 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:13:23] "OPTIONS / HTTP/1.0" 200 134 0.000720
Sep 28 12:13:24 ctl02 heat-api[13008]: 2017-09-28 12:13:24.023 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:13:24] "OPTIONS / HTTP/1.0" 200 134 0.000617
Sep 28 12:13:24 ctl02 heat-api-cfn[13300]: 2017-09-28 12:13:24.374 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:13:24] "OPTIONS / HTTP/1.0" 200 134 0.000546
Sep 28 12:13:24 ctl02 heat-api[13008]: 2017-09-28 12:13:24.468 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:13:24] "OPTIONS / HTTP/1.0" 200 134 0.000641
Sep 28 12:13:24 ctl02 nova-cert[4860]: 2017-09-28 12:13:24.583 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:13:24 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf2045517)
Sep 28 12:13:25 ctl02 nova-api[25260]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:13:25 ctl02 nova-api[25260]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:13:25 ctl02 glance-api[29183]: 2017-09-28 12:13:25.383 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:13:25] "OPTIONS / HTTP/1.0" 200 134 0.001017
Sep 28 12:13:25 ctl02 nova-api[25260]: 2017-09-28 12:13:25.501 25260 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:13:25 ctl02 nova-api[25260]: 2017-09-28 12:13:25.503 25260 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:13:25 ctl02 nova-api[25260]: 2017-09-28 12:13:25.503 25260 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:13:25 ctl02 nova-api[25260]: 2017-09-28 12:13:25.503 25260 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:13:25 ctl02 nova-api[25260]: 2017-09-28 12:13:25.503 25260 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:13:25 ctl02 nova-api[25260]: 2017-09-28 12:13:25.503 25260 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:13:25 ctl02 nova-api[25260]: 2017-09-28 12:13:25.503 25260 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:13:25 ctl02 nova-api[25260]: 2017-09-28 12:13:25.503 25260 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:13:25 ctl02 nova-api[25260]: 2017-09-28 12:13:25.503 25260 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:13:25 ctl02 nova-api[25260]: 2017-09-28 12:13:25.503 25260 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:13:25 ctl02 nova-api[25260]: 2017-09-28 12:13:25.503 25260 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:13:25 ctl02 nova-api[25260]: 2017-09-28 12:13:25.503 25260 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:13:25 ctl02 nova-api[25260]: 2017-09-28 12:13:25.503 25260 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:13:25 ctl02 nova-api[25260]: 2017-09-28 12:13:25.503 25260 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:13:25 ctl02 nova-api[25260]: 2017-09-28 12:13:25.503 25260 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:13:25 ctl02 nova-api[25260]: 2017-09-28 12:13:25.503 25260 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:13:25 ctl02 nova-api[25260]: 2017-09-28 12:13:25.503 25260 ERROR nova.wsgi     self.filename))
Sep 28 12:13:25 ctl02 nova-api[25260]: 2017-09-28 12:13:25.503 25260 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:13:25 ctl02 nova-api[25260]: 2017-09-28 12:13:25.503 25260 ERROR nova.wsgi
Sep 28 12:13:25 ctl02 nova-api[25260]: 2017-09-28 12:13:25.520 25260 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:13:25 ctl02 nova-api[25260]: 2017-09-28 12:13:25.653 25260 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:13:25 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf2045517)
Sep 28 12:13:25 ctl02 nova-api[25260]: 2017-09-28 12:13:25.887 25260 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:13:25 ctl02 nova-api[25260]: 2017-09-28 12:13:25.890 25260 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:13:25 ctl02 nova-api[25260]: 2017-09-28 12:13:25.890 25260 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:13:25 ctl02 nova-api[25260]: 2017-09-28 12:13:25.890 25260 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:13:26 ctl02 nova-api[25260]: 2017-09-28 12:13:26.026 25260 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:13:26 ctl02 nova-api[25260]: 2017-09-28 12:13:26.028 25260 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:13:26 ctl02 nova-api[25260]: 2017-09-28 12:13:26.028 25260 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:13:26 ctl02 nova-api[25260]: 2017-09-28 12:13:26.029 25260 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:13:26 ctl02 nova-api[25260]: 2017-09-28 12:13:26.032 25260 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:13:26 ctl02 nova-api[25260]: 2017-09-28 12:13:26.033 25260 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:13:26 ctl02 nova-api[25260]: 2017-09-28 12:13:26.033 25260 ERROR nova Traceback (most recent call last):
Sep 28 12:13:26 ctl02 nova-api[25260]: 2017-09-28 12:13:26.033 25260 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:13:26 ctl02 nova-api[25260]: 2017-09-28 12:13:26.033 25260 ERROR nova     sys.exit(main())
Sep 28 12:13:26 ctl02 nova-api[25260]: 2017-09-28 12:13:26.033 25260 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:13:26 ctl02 nova-api[25260]: 2017-09-28 12:13:26.033 25260 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:13:26 ctl02 nova-api[25260]: 2017-09-28 12:13:26.033 25260 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:13:26 ctl02 nova-api[25260]: 2017-09-28 12:13:26.033 25260 ERROR nova     max_url_len=max_url_len)
Sep 28 12:13:26 ctl02 nova-api[25260]: 2017-09-28 12:13:26.033 25260 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:13:26 ctl02 nova-api[25260]: 2017-09-28 12:13:26.033 25260 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:13:26 ctl02 nova-api[25260]: 2017-09-28 12:13:26.033 25260 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:13:26 ctl02 nova-api[25260]: 2017-09-28 12:13:26.033 25260 ERROR nova     sock.listen(backlog)
Sep 28 12:13:26 ctl02 nova-api[25260]: 2017-09-28 12:13:26.033 25260 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:13:26 ctl02 nova-api[25260]: 2017-09-28 12:13:26.033 25260 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:13:26 ctl02 nova-api[25260]: 2017-09-28 12:13:26.033 25260 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:13:26 ctl02 nova-api[25260]: 2017-09-28 12:13:26.033 25260 ERROR nova
Sep 28 12:13:26 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:13:26 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:13:26 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:13:26 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:13:26 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:13:26 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:13:26 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:13:26 ctl02 nova-conductor[5056]: 2017-09-28 12:13:26.460 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:13:26 ctl02 nova-conductor[5056]: 2017-09-28 12:13:26.475 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:13:26 ctl02 nova-conductor[5056]: 2017-09-28 12:13:26.476 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:13:26 ctl02 nova-conductor[5056]: 2017-09-28 12:13:26.480 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:13:26 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf2045517)
Sep 28 12:13:27 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:13:27.422 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:13:27] "OPTIONS / HTTP/1.0" 200 134 0.000489
Sep 28 12:13:27 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf2045517)
Sep 28 12:13:28 ctl02 nova-api[25278]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:13:28 ctl02 nova-api[25278]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:13:28 ctl02 nova-api[25278]: 2017-09-28 12:13:28.280 25278 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:13:28 ctl02 nova-api[25278]: 2017-09-28 12:13:28.282 25278 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:13:28 ctl02 nova-api[25278]: 2017-09-28 12:13:28.282 25278 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:13:28 ctl02 nova-api[25278]: 2017-09-28 12:13:28.282 25278 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:13:28 ctl02 nova-api[25278]: 2017-09-28 12:13:28.282 25278 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:13:28 ctl02 nova-api[25278]: 2017-09-28 12:13:28.282 25278 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:13:28 ctl02 nova-api[25278]: 2017-09-28 12:13:28.282 25278 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:13:28 ctl02 nova-api[25278]: 2017-09-28 12:13:28.282 25278 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:13:28 ctl02 nova-api[25278]: 2017-09-28 12:13:28.282 25278 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:13:28 ctl02 nova-api[25278]: 2017-09-28 12:13:28.282 25278 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:13:28 ctl02 nova-api[25278]: 2017-09-28 12:13:28.282 25278 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:13:28 ctl02 nova-api[25278]: 2017-09-28 12:13:28.282 25278 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:13:28 ctl02 nova-api[25278]: 2017-09-28 12:13:28.282 25278 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:13:28 ctl02 nova-api[25278]: 2017-09-28 12:13:28.282 25278 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:13:28 ctl02 nova-api[25278]: 2017-09-28 12:13:28.282 25278 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:13:28 ctl02 nova-api[25278]: 2017-09-28 12:13:28.282 25278 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:13:28 ctl02 nova-api[25278]: 2017-09-28 12:13:28.282 25278 ERROR nova.wsgi     self.filename))
Sep 28 12:13:28 ctl02 nova-api[25278]: 2017-09-28 12:13:28.282 25278 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:13:28 ctl02 nova-api[25278]: 2017-09-28 12:13:28.282 25278 ERROR nova.wsgi
Sep 28 12:13:28 ctl02 nova-api[25278]: 2017-09-28 12:13:28.285 25278 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:13:28 ctl02 nova-api[25278]: 2017-09-28 12:13:28.421 25278 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:13:28 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:13:28.606 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:13:28] "OPTIONS / HTTP/1.0" 200 134 0.000520
Sep 28 12:13:28 ctl02 nova-api[25278]: 2017-09-28 12:13:28.675 25278 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:13:28 ctl02 nova-api[25278]: 2017-09-28 12:13:28.678 25278 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:13:28 ctl02 nova-api[25278]: 2017-09-28 12:13:28.679 25278 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:13:28 ctl02 nova-api[25278]: 2017-09-28 12:13:28.679 25278 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:13:28 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf2045517)
Sep 28 12:13:28 ctl02 nova-api[25278]: 2017-09-28 12:13:28.814 25278 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:13:28 ctl02 nova-api[25278]: 2017-09-28 12:13:28.817 25278 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:13:28 ctl02 nova-api[25278]: 2017-09-28 12:13:28.817 25278 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:13:28 ctl02 nova-api[25278]: 2017-09-28 12:13:28.817 25278 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:13:28 ctl02 nova-api[25278]: 2017-09-28 12:13:28.821 25278 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:13:28 ctl02 nova-api[25278]: 2017-09-28 12:13:28.822 25278 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:13:28 ctl02 nova-api[25278]: 2017-09-28 12:13:28.822 25278 ERROR nova Traceback (most recent call last):
Sep 28 12:13:28 ctl02 nova-api[25278]: 2017-09-28 12:13:28.822 25278 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:13:28 ctl02 nova-api[25278]: 2017-09-28 12:13:28.822 25278 ERROR nova     sys.exit(main())
Sep 28 12:13:28 ctl02 nova-api[25278]: 2017-09-28 12:13:28.822 25278 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:13:28 ctl02 nova-api[25278]: 2017-09-28 12:13:28.822 25278 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:13:28 ctl02 nova-api[25278]: 2017-09-28 12:13:28.822 25278 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:13:28 ctl02 nova-api[25278]: 2017-09-28 12:13:28.822 25278 ERROR nova     max_url_len=max_url_len)
Sep 28 12:13:28 ctl02 nova-api[25278]: 2017-09-28 12:13:28.822 25278 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:13:28 ctl02 nova-api[25278]: 2017-09-28 12:13:28.822 25278 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:13:28 ctl02 nova-api[25278]: 2017-09-28 12:13:28.822 25278 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:13:28 ctl02 nova-api[25278]: 2017-09-28 12:13:28.822 25278 ERROR nova     sock.listen(backlog)
Sep 28 12:13:28 ctl02 nova-api[25278]: 2017-09-28 12:13:28.822 25278 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:13:28 ctl02 nova-api[25278]: 2017-09-28 12:13:28.822 25278 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:13:28 ctl02 nova-api[25278]: 2017-09-28 12:13:28.822 25278 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:13:28 ctl02 nova-api[25278]: 2017-09-28 12:13:28.822 25278 ERROR nova
Sep 28 12:13:28 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:13:28 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:13:28 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:13:29 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:13:29 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:13:29 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:13:29 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:13:29 ctl02 heat-api[13008]: 2017-09-28 12:13:29.378 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:13:29] "OPTIONS / HTTP/1.0" 200 134 0.000614
Sep 28 12:13:29 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf2045517)
Sep 28 12:13:30 ctl02 glance-api[29183]: 2017-09-28 12:13:30.303 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:13:30] "OPTIONS / HTTP/1.0" 200 134 0.000625
Sep 28 12:13:30 ctl02 nova-api[25295]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:13:30 ctl02 nova-api[25295]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:13:30 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:13:30 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:13:30 ctl02 heat-api-cfn[13300]: 2017-09-28 12:13:30.942 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:13:30] "OPTIONS / HTTP/1.0" 200 134 0.000464
Sep 28 12:13:30 ctl02 nova-api[25295]: 2017-09-28 12:13:30.961 25295 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:13:30 ctl02 nova-api[25295]: 2017-09-28 12:13:30.963 25295 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:13:30 ctl02 nova-api[25295]: 2017-09-28 12:13:30.963 25295 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:13:30 ctl02 nova-api[25295]: 2017-09-28 12:13:30.963 25295 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:13:30 ctl02 nova-api[25295]: 2017-09-28 12:13:30.963 25295 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:13:30 ctl02 nova-api[25295]: 2017-09-28 12:13:30.963 25295 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:13:30 ctl02 nova-api[25295]: 2017-09-28 12:13:30.963 25295 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:13:30 ctl02 nova-api[25295]: 2017-09-28 12:13:30.963 25295 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:13:30 ctl02 nova-api[25295]: 2017-09-28 12:13:30.963 25295 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:13:30 ctl02 nova-api[25295]: 2017-09-28 12:13:30.963 25295 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:13:30 ctl02 nova-api[25295]: 2017-09-28 12:13:30.963 25295 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:13:30 ctl02 nova-api[25295]: 2017-09-28 12:13:30.963 25295 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:13:30 ctl02 nova-api[25295]: 2017-09-28 12:13:30.963 25295 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:13:30 ctl02 nova-api[25295]: 2017-09-28 12:13:30.963 25295 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:13:30 ctl02 nova-api[25295]: 2017-09-28 12:13:30.963 25295 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:13:30 ctl02 nova-api[25295]: 2017-09-28 12:13:30.963 25295 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:13:30 ctl02 nova-api[25295]: 2017-09-28 12:13:30.963 25295 ERROR nova.wsgi     self.filename))
Sep 28 12:13:30 ctl02 nova-api[25295]: 2017-09-28 12:13:30.963 25295 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:13:30 ctl02 nova-api[25295]: 2017-09-28 12:13:30.963 25295 ERROR nova.wsgi
Sep 28 12:13:30 ctl02 nova-api[25295]: 2017-09-28 12:13:30.965 25295 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:13:31 ctl02 nova-api[25295]: 2017-09-28 12:13:31.095 25295 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:13:31 ctl02 heat-api-cfn[13300]: 2017-09-28 12:13:31.304 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:13:31] "OPTIONS / HTTP/1.0" 200 134 0.000498
Sep 28 12:13:31 ctl02 nova-api[25295]: 2017-09-28 12:13:31.331 25295 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:13:31 ctl02 nova-api[25295]: 2017-09-28 12:13:31.334 25295 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:13:31 ctl02 nova-api[25295]: 2017-09-28 12:13:31.335 25295 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:13:31 ctl02 nova-api[25295]: 2017-09-28 12:13:31.335 25295 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:13:31 ctl02 nova-api[25295]: 2017-09-28 12:13:31.470 25295 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:13:31 ctl02 nova-api[25295]: 2017-09-28 12:13:31.473 25295 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:13:31 ctl02 nova-api[25295]: 2017-09-28 12:13:31.473 25295 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:13:31 ctl02 nova-api[25295]: 2017-09-28 12:13:31.473 25295 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:13:31 ctl02 nova-api[25295]: 2017-09-28 12:13:31.477 25295 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:13:31 ctl02 nova-api[25295]: 2017-09-28 12:13:31.477 25295 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:13:31 ctl02 nova-api[25295]: 2017-09-28 12:13:31.477 25295 ERROR nova Traceback (most recent call last):
Sep 28 12:13:31 ctl02 nova-api[25295]: 2017-09-28 12:13:31.477 25295 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:13:31 ctl02 nova-api[25295]: 2017-09-28 12:13:31.477 25295 ERROR nova     sys.exit(main())
Sep 28 12:13:31 ctl02 nova-api[25295]: 2017-09-28 12:13:31.477 25295 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:13:31 ctl02 nova-api[25295]: 2017-09-28 12:13:31.477 25295 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:13:31 ctl02 nova-api[25295]: 2017-09-28 12:13:31.477 25295 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:13:31 ctl02 nova-api[25295]: 2017-09-28 12:13:31.477 25295 ERROR nova     max_url_len=max_url_len)
Sep 28 12:13:31 ctl02 nova-api[25295]: 2017-09-28 12:13:31.477 25295 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:13:31 ctl02 nova-api[25295]: 2017-09-28 12:13:31.477 25295 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:13:31 ctl02 nova-api[25295]: 2017-09-28 12:13:31.477 25295 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:13:31 ctl02 nova-api[25295]: 2017-09-28 12:13:31.477 25295 ERROR nova     sock.listen(backlog)
Sep 28 12:13:31 ctl02 nova-api[25295]: 2017-09-28 12:13:31.477 25295 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:13:31 ctl02 nova-api[25295]: 2017-09-28 12:13:31.477 25295 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:13:31 ctl02 nova-api[25295]: 2017-09-28 12:13:31.477 25295 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:13:31 ctl02 nova-api[25295]: 2017-09-28 12:13:31.477 25295 ERROR nova
Sep 28 12:13:31 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:13:31 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:13:31 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:13:31 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:13:31 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:13:31 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:13:31 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:13:32 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:13:32.664 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:13:32] "OPTIONS / HTTP/1.0" 200 134 0.000537
Sep 28 12:13:33 ctl02 nova-api[25319]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:13:33 ctl02 nova-api[25319]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:13:33 ctl02 glance-api[29183]: 2017-09-28 12:13:33.710 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:13:33] "OPTIONS / HTTP/1.0" 200 134 0.000608
Sep 28 12:13:33 ctl02 nova-api[25319]: 2017-09-28 12:13:33.749 25319 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:13:33 ctl02 nova-api[25319]: 2017-09-28 12:13:33.751 25319 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:13:33 ctl02 nova-api[25319]: 2017-09-28 12:13:33.751 25319 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:13:33 ctl02 nova-api[25319]: 2017-09-28 12:13:33.751 25319 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:13:33 ctl02 nova-api[25319]: 2017-09-28 12:13:33.751 25319 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:13:33 ctl02 nova-api[25319]: 2017-09-28 12:13:33.751 25319 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:13:33 ctl02 nova-api[25319]: 2017-09-28 12:13:33.751 25319 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:13:33 ctl02 nova-api[25319]: 2017-09-28 12:13:33.751 25319 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:13:33 ctl02 nova-api[25319]: 2017-09-28 12:13:33.751 25319 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:13:33 ctl02 nova-api[25319]: 2017-09-28 12:13:33.751 25319 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:13:33 ctl02 nova-api[25319]: 2017-09-28 12:13:33.751 25319 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:13:33 ctl02 nova-api[25319]: 2017-09-28 12:13:33.751 25319 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:13:33 ctl02 nova-api[25319]: 2017-09-28 12:13:33.751 25319 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:13:33 ctl02 nova-api[25319]: 2017-09-28 12:13:33.751 25319 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:13:33 ctl02 nova-api[25319]: 2017-09-28 12:13:33.751 25319 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:13:33 ctl02 nova-api[25319]: 2017-09-28 12:13:33.751 25319 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:13:33 ctl02 nova-api[25319]: 2017-09-28 12:13:33.751 25319 ERROR nova.wsgi     self.filename))
Sep 28 12:13:33 ctl02 nova-api[25319]: 2017-09-28 12:13:33.751 25319 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:13:33 ctl02 nova-api[25319]: 2017-09-28 12:13:33.751 25319 ERROR nova.wsgi
Sep 28 12:13:33 ctl02 nova-api[25319]: 2017-09-28 12:13:33.752 25319 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:13:33 ctl02 nova-api[25319]: 2017-09-28 12:13:33.886 25319 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:13:34 ctl02 heat-api-cfn[13300]: 2017-09-28 12:13:34.121 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:13:34] "OPTIONS / HTTP/1.0" 200 134 0.000551
Sep 28 12:13:34 ctl02 nova-api[25319]: 2017-09-28 12:13:34.140 25319 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:13:34 ctl02 nova-api[25319]: 2017-09-28 12:13:34.142 25319 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:13:34 ctl02 nova-api[25319]: 2017-09-28 12:13:34.143 25319 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:13:34 ctl02 nova-api[25319]: 2017-09-28 12:13:34.143 25319 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:13:34 ctl02 nova-api[25319]: 2017-09-28 12:13:34.276 25319 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:13:34 ctl02 heat-api[13008]: 2017-09-28 12:13:34.279 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:13:34] "OPTIONS / HTTP/1.0" 200 134 0.000634
Sep 28 12:13:34 ctl02 nova-api[25319]: 2017-09-28 12:13:34.280 25319 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:13:34 ctl02 nova-api[25319]: 2017-09-28 12:13:34.281 25319 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:13:34 ctl02 nova-api[25319]: 2017-09-28 12:13:34.281 25319 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:13:34 ctl02 nova-api[25319]: 2017-09-28 12:13:34.285 25319 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:13:34 ctl02 nova-api[25319]: 2017-09-28 12:13:34.285 25319 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:13:34 ctl02 nova-api[25319]: 2017-09-28 12:13:34.285 25319 ERROR nova Traceback (most recent call last):
Sep 28 12:13:34 ctl02 nova-api[25319]: 2017-09-28 12:13:34.285 25319 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:13:34 ctl02 nova-api[25319]: 2017-09-28 12:13:34.285 25319 ERROR nova     sys.exit(main())
Sep 28 12:13:34 ctl02 nova-api[25319]: 2017-09-28 12:13:34.285 25319 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:13:34 ctl02 nova-api[25319]: 2017-09-28 12:13:34.285 25319 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:13:34 ctl02 nova-api[25319]: 2017-09-28 12:13:34.285 25319 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:13:34 ctl02 nova-api[25319]: 2017-09-28 12:13:34.285 25319 ERROR nova     max_url_len=max_url_len)
Sep 28 12:13:34 ctl02 nova-api[25319]: 2017-09-28 12:13:34.285 25319 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:13:34 ctl02 nova-api[25319]: 2017-09-28 12:13:34.285 25319 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:13:34 ctl02 nova-api[25319]: 2017-09-28 12:13:34.285 25319 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:13:34 ctl02 nova-api[25319]: 2017-09-28 12:13:34.285 25319 ERROR nova     sock.listen(backlog)
Sep 28 12:13:34 ctl02 nova-api[25319]: 2017-09-28 12:13:34.285 25319 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:13:34 ctl02 nova-api[25319]: 2017-09-28 12:13:34.285 25319 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:13:34 ctl02 nova-api[25319]: 2017-09-28 12:13:34.285 25319 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:13:34 ctl02 nova-api[25319]: 2017-09-28 12:13:34.285 25319 ERROR nova
Sep 28 12:13:34 ctl02 heat-api[13008]: 2017-09-28 12:13:34.366 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:13:34] "OPTIONS / HTTP/1.0" 200 134 0.000625
Sep 28 12:13:34 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:13:34 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:13:34 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:13:34 ctl02 nova-consoleauth[5433]: 2017-09-28 12:13:34.477 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:13:34 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:13:34 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:13:34 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:13:34 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:13:35 ctl02 glance-api[29183]: 2017-09-28 12:13:35.084 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:13:35] "OPTIONS / HTTP/1.0" 200 134 0.000728
Sep 28 12:13:36 ctl02 nova-api[25337]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:13:36 ctl02 nova-api[25337]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:13:36 ctl02 nova-api[25337]: 2017-09-28 12:13:36.483 25337 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:13:36 ctl02 nova-api[25337]: 2017-09-28 12:13:36.485 25337 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:13:36 ctl02 nova-api[25337]: 2017-09-28 12:13:36.485 25337 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:13:36 ctl02 nova-api[25337]: 2017-09-28 12:13:36.485 25337 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:13:36 ctl02 nova-api[25337]: 2017-09-28 12:13:36.485 25337 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:13:36 ctl02 nova-api[25337]: 2017-09-28 12:13:36.485 25337 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:13:36 ctl02 nova-api[25337]: 2017-09-28 12:13:36.485 25337 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:13:36 ctl02 nova-api[25337]: 2017-09-28 12:13:36.485 25337 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:13:36 ctl02 nova-api[25337]: 2017-09-28 12:13:36.485 25337 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:13:36 ctl02 nova-api[25337]: 2017-09-28 12:13:36.485 25337 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:13:36 ctl02 nova-api[25337]: 2017-09-28 12:13:36.485 25337 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:13:36 ctl02 nova-api[25337]: 2017-09-28 12:13:36.485 25337 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:13:36 ctl02 nova-api[25337]: 2017-09-28 12:13:36.485 25337 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:13:36 ctl02 nova-api[25337]: 2017-09-28 12:13:36.485 25337 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:13:36 ctl02 nova-api[25337]: 2017-09-28 12:13:36.485 25337 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:13:36 ctl02 nova-api[25337]: 2017-09-28 12:13:36.485 25337 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:13:36 ctl02 nova-api[25337]: 2017-09-28 12:13:36.485 25337 ERROR nova.wsgi     self.filename))
Sep 28 12:13:36 ctl02 nova-api[25337]: 2017-09-28 12:13:36.485 25337 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:13:36 ctl02 nova-api[25337]: 2017-09-28 12:13:36.485 25337 ERROR nova.wsgi
Sep 28 12:13:36 ctl02 nova-api[25337]: 2017-09-28 12:13:36.486 25337 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:13:36 ctl02 nova-api[25337]: 2017-09-28 12:13:36.620 25337 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:13:36 ctl02 nova-api[25337]: 2017-09-28 12:13:36.869 25337 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:13:36 ctl02 nova-api[25337]: 2017-09-28 12:13:36.871 25337 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:13:36 ctl02 nova-api[25337]: 2017-09-28 12:13:36.871 25337 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:13:36 ctl02 nova-api[25337]: 2017-09-28 12:13:36.872 25337 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:13:37 ctl02 nova-api[25337]: 2017-09-28 12:13:37.007 25337 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:13:37 ctl02 nova-api[25337]: 2017-09-28 12:13:37.009 25337 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:13:37 ctl02 nova-api[25337]: 2017-09-28 12:13:37.009 25337 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:13:37 ctl02 nova-api[25337]: 2017-09-28 12:13:37.010 25337 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:13:37 ctl02 nova-api[25337]: 2017-09-28 12:13:37.013 25337 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:13:37 ctl02 nova-api[25337]: 2017-09-28 12:13:37.013 25337 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:13:37 ctl02 nova-api[25337]: 2017-09-28 12:13:37.013 25337 ERROR nova Traceback (most recent call last):
Sep 28 12:13:37 ctl02 nova-api[25337]: 2017-09-28 12:13:37.013 25337 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:13:37 ctl02 nova-api[25337]: 2017-09-28 12:13:37.013 25337 ERROR nova     sys.exit(main())
Sep 28 12:13:37 ctl02 nova-api[25337]: 2017-09-28 12:13:37.013 25337 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:13:37 ctl02 nova-api[25337]: 2017-09-28 12:13:37.013 25337 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:13:37 ctl02 nova-api[25337]: 2017-09-28 12:13:37.013 25337 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:13:37 ctl02 nova-api[25337]: 2017-09-28 12:13:37.013 25337 ERROR nova     max_url_len=max_url_len)
Sep 28 12:13:37 ctl02 nova-api[25337]: 2017-09-28 12:13:37.013 25337 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:13:37 ctl02 nova-api[25337]: 2017-09-28 12:13:37.013 25337 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:13:37 ctl02 nova-api[25337]: 2017-09-28 12:13:37.013 25337 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:13:37 ctl02 nova-api[25337]: 2017-09-28 12:13:37.013 25337 ERROR nova     sock.listen(backlog)
Sep 28 12:13:37 ctl02 nova-api[25337]: 2017-09-28 12:13:37.013 25337 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:13:37 ctl02 nova-api[25337]: 2017-09-28 12:13:37.013 25337 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:13:37 ctl02 nova-api[25337]: 2017-09-28 12:13:37.013 25337 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:13:37 ctl02 nova-api[25337]: 2017-09-28 12:13:37.013 25337 ERROR nova
Sep 28 12:13:37 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:13:37 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:13:37 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:13:37 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:13:37.256 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:13:37] "OPTIONS / HTTP/1.0" 200 134 0.000550
Sep 28 12:13:37 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:13:37 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:13:37 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:13:37 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:13:37 ctl02 nova-scheduler[5620]: 2017-09-28 12:13:37.500 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:13:37 ctl02 heat-engine[12803]: 2017-09-28 12:13:37.528 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:13:37 ctl02 heat-engine[12803]: 2017-09-28 12:13:37.555 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:13:37 ctl02 heat-engine[12803]: 2017-09-28 12:13:37.568 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:13:37 ctl02 heat-engine[12803]: 2017-09-28 12:13:37.580 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:13:38 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:13:38.436 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:13:38] "OPTIONS / HTTP/1.0" 200 134 0.000575
Sep 28 12:13:39 ctl02 nova-api[25355]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:13:39 ctl02 nova-api[25355]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:13:39 ctl02 nova-api[25355]: 2017-09-28 12:13:39.218 25355 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:13:39 ctl02 nova-api[25355]: 2017-09-28 12:13:39.220 25355 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:13:39 ctl02 nova-api[25355]: 2017-09-28 12:13:39.220 25355 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:13:39 ctl02 nova-api[25355]: 2017-09-28 12:13:39.220 25355 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:13:39 ctl02 nova-api[25355]: 2017-09-28 12:13:39.220 25355 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:13:39 ctl02 nova-api[25355]: 2017-09-28 12:13:39.220 25355 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:13:39 ctl02 nova-api[25355]: 2017-09-28 12:13:39.220 25355 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:13:39 ctl02 nova-api[25355]: 2017-09-28 12:13:39.220 25355 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:13:39 ctl02 nova-api[25355]: 2017-09-28 12:13:39.220 25355 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:13:39 ctl02 nova-api[25355]: 2017-09-28 12:13:39.220 25355 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:13:39 ctl02 nova-api[25355]: 2017-09-28 12:13:39.220 25355 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:13:39 ctl02 nova-api[25355]: 2017-09-28 12:13:39.220 25355 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:13:39 ctl02 nova-api[25355]: 2017-09-28 12:13:39.220 25355 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:13:39 ctl02 nova-api[25355]: 2017-09-28 12:13:39.220 25355 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:13:39 ctl02 nova-api[25355]: 2017-09-28 12:13:39.220 25355 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:13:39 ctl02 nova-api[25355]: 2017-09-28 12:13:39.220 25355 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:13:39 ctl02 nova-api[25355]: 2017-09-28 12:13:39.220 25355 ERROR nova.wsgi     self.filename))
Sep 28 12:13:39 ctl02 nova-api[25355]: 2017-09-28 12:13:39.220 25355 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:13:39 ctl02 nova-api[25355]: 2017-09-28 12:13:39.220 25355 ERROR nova.wsgi
Sep 28 12:13:39 ctl02 nova-api[25355]: 2017-09-28 12:13:39.223 25355 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:13:39 ctl02 nova-api[25355]: 2017-09-28 12:13:39.356 25355 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:13:39 ctl02 nova-api[25355]: 2017-09-28 12:13:39.589 25355 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:13:39 ctl02 nova-api[25355]: 2017-09-28 12:13:39.592 25355 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:13:39 ctl02 nova-api[25355]: 2017-09-28 12:13:39.592 25355 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:13:39 ctl02 nova-api[25355]: 2017-09-28 12:13:39.592 25355 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:13:39 ctl02 nova-api[25355]: 2017-09-28 12:13:39.725 25355 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:13:39 ctl02 nova-api[25355]: 2017-09-28 12:13:39.728 25355 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:13:39 ctl02 nova-api[25355]: 2017-09-28 12:13:39.728 25355 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:13:39 ctl02 nova-api[25355]: 2017-09-28 12:13:39.729 25355 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:13:39 ctl02 nova-api[25355]: 2017-09-28 12:13:39.732 25355 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:13:39 ctl02 nova-api[25355]: 2017-09-28 12:13:39.733 25355 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:13:39 ctl02 nova-api[25355]: 2017-09-28 12:13:39.733 25355 ERROR nova Traceback (most recent call last):
Sep 28 12:13:39 ctl02 nova-api[25355]: 2017-09-28 12:13:39.733 25355 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:13:39 ctl02 nova-api[25355]: 2017-09-28 12:13:39.733 25355 ERROR nova     sys.exit(main())
Sep 28 12:13:39 ctl02 nova-api[25355]: 2017-09-28 12:13:39.733 25355 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:13:39 ctl02 nova-api[25355]: 2017-09-28 12:13:39.733 25355 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:13:39 ctl02 nova-api[25355]: 2017-09-28 12:13:39.733 25355 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:13:39 ctl02 nova-api[25355]: 2017-09-28 12:13:39.733 25355 ERROR nova     max_url_len=max_url_len)
Sep 28 12:13:39 ctl02 nova-api[25355]: 2017-09-28 12:13:39.733 25355 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:13:39 ctl02 nova-api[25355]: 2017-09-28 12:13:39.733 25355 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:13:39 ctl02 nova-api[25355]: 2017-09-28 12:13:39.733 25355 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:13:39 ctl02 nova-api[25355]: 2017-09-28 12:13:39.733 25355 ERROR nova     sock.listen(backlog)
Sep 28 12:13:39 ctl02 nova-api[25355]: 2017-09-28 12:13:39.733 25355 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:13:39 ctl02 nova-api[25355]: 2017-09-28 12:13:39.733 25355 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:13:39 ctl02 nova-api[25355]: 2017-09-28 12:13:39.733 25355 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:13:39 ctl02 nova-api[25355]: 2017-09-28 12:13:39.733 25355 ERROR nova
Sep 28 12:13:39 ctl02 heat-api[13008]: 2017-09-28 12:13:39.769 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:13:39] "OPTIONS / HTTP/1.0" 200 134 0.000576
Sep 28 12:13:39 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:13:39 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:13:39 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:13:40 ctl02 glance-api[29183]: 2017-09-28 12:13:40.040 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:13:40] "OPTIONS / HTTP/1.0" 200 134 0.000696
Sep 28 12:13:40 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:13:40 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:13:40 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:13:40 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:13:40 ctl02 heat-api-cfn[13300]: 2017-09-28 12:13:40.545 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:13:40] "OPTIONS / HTTP/1.0" 200 134 0.000466
Sep 28 12:13:41 ctl02 heat-api-cfn[13300]: 2017-09-28 12:13:41.403 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:13:41] "OPTIONS / HTTP/1.0" 200 134 0.000451
Sep 28 12:13:41 ctl02 nova-api[25373]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:13:41 ctl02 nova-api[25373]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:13:41 ctl02 nova-api[25373]: 2017-09-28 12:13:41.958 25373 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:13:41 ctl02 nova-api[25373]: 2017-09-28 12:13:41.960 25373 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:13:41 ctl02 nova-api[25373]: 2017-09-28 12:13:41.960 25373 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:13:41 ctl02 nova-api[25373]: 2017-09-28 12:13:41.960 25373 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:13:41 ctl02 nova-api[25373]: 2017-09-28 12:13:41.960 25373 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:13:41 ctl02 nova-api[25373]: 2017-09-28 12:13:41.960 25373 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:13:41 ctl02 nova-api[25373]: 2017-09-28 12:13:41.960 25373 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:13:41 ctl02 nova-api[25373]: 2017-09-28 12:13:41.960 25373 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:13:41 ctl02 nova-api[25373]: 2017-09-28 12:13:41.960 25373 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:13:41 ctl02 nova-api[25373]: 2017-09-28 12:13:41.960 25373 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:13:41 ctl02 nova-api[25373]: 2017-09-28 12:13:41.960 25373 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:13:41 ctl02 nova-api[25373]: 2017-09-28 12:13:41.960 25373 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:13:41 ctl02 nova-api[25373]: 2017-09-28 12:13:41.960 25373 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:13:41 ctl02 nova-api[25373]: 2017-09-28 12:13:41.960 25373 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:13:41 ctl02 nova-api[25373]: 2017-09-28 12:13:41.960 25373 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:13:41 ctl02 nova-api[25373]: 2017-09-28 12:13:41.960 25373 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:13:41 ctl02 nova-api[25373]: 2017-09-28 12:13:41.960 25373 ERROR nova.wsgi     self.filename))
Sep 28 12:13:41 ctl02 nova-api[25373]: 2017-09-28 12:13:41.960 25373 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:13:41 ctl02 nova-api[25373]: 2017-09-28 12:13:41.960 25373 ERROR nova.wsgi
Sep 28 12:13:41 ctl02 nova-api[25373]: 2017-09-28 12:13:41.961 25373 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:13:42 ctl02 nova-api[25373]: 2017-09-28 12:13:42.089 25373 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:13:42 ctl02 nova-api[25373]: 2017-09-28 12:13:42.321 25373 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:13:42 ctl02 nova-api[25373]: 2017-09-28 12:13:42.323 25373 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:13:42 ctl02 nova-api[25373]: 2017-09-28 12:13:42.323 25373 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:13:42 ctl02 nova-api[25373]: 2017-09-28 12:13:42.324 25373 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:13:42 ctl02 nova-api[25373]: 2017-09-28 12:13:42.455 25373 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:13:42 ctl02 nova-api[25373]: 2017-09-28 12:13:42.457 25373 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:13:42 ctl02 nova-api[25373]: 2017-09-28 12:13:42.457 25373 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:13:42 ctl02 nova-api[25373]: 2017-09-28 12:13:42.457 25373 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:13:42 ctl02 nova-api[25373]: 2017-09-28 12:13:42.461 25373 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:13:42 ctl02 nova-api[25373]: 2017-09-28 12:13:42.461 25373 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:13:42 ctl02 nova-api[25373]: 2017-09-28 12:13:42.461 25373 ERROR nova Traceback (most recent call last):
Sep 28 12:13:42 ctl02 nova-api[25373]: 2017-09-28 12:13:42.461 25373 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:13:42 ctl02 nova-api[25373]: 2017-09-28 12:13:42.461 25373 ERROR nova     sys.exit(main())
Sep 28 12:13:42 ctl02 nova-api[25373]: 2017-09-28 12:13:42.461 25373 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:13:42 ctl02 nova-api[25373]: 2017-09-28 12:13:42.461 25373 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:13:42 ctl02 nova-api[25373]: 2017-09-28 12:13:42.461 25373 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:13:42 ctl02 nova-api[25373]: 2017-09-28 12:13:42.461 25373 ERROR nova     max_url_len=max_url_len)
Sep 28 12:13:42 ctl02 nova-api[25373]: 2017-09-28 12:13:42.461 25373 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:13:42 ctl02 nova-api[25373]: 2017-09-28 12:13:42.461 25373 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:13:42 ctl02 nova-api[25373]: 2017-09-28 12:13:42.461 25373 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:13:42 ctl02 nova-api[25373]: 2017-09-28 12:13:42.461 25373 ERROR nova     sock.listen(backlog)
Sep 28 12:13:42 ctl02 nova-api[25373]: 2017-09-28 12:13:42.461 25373 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:13:42 ctl02 nova-api[25373]: 2017-09-28 12:13:42.461 25373 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:13:42 ctl02 nova-api[25373]: 2017-09-28 12:13:42.461 25373 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:13:42 ctl02 nova-api[25373]: 2017-09-28 12:13:42.461 25373 ERROR nova
Sep 28 12:13:42 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:13:42 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:13:42 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:13:42 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:13:42 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:13:42 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:13:42.876 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:13:42] "OPTIONS / HTTP/1.0" 200 134 0.000645
Sep 28 12:13:42 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:13:42 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:13:43 ctl02 glance-api[29183]: 2017-09-28 12:13:43.804 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:13:43] "OPTIONS / HTTP/1.0" 200 134 0.001063
Sep 28 12:13:44 ctl02 heat-api[13008]: 2017-09-28 12:13:44.001 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:13:44] "OPTIONS / HTTP/1.0" 200 134 0.000495
Sep 28 12:13:44 ctl02 heat-api-cfn[13300]: 2017-09-28 12:13:44.141 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:13:44] "OPTIONS / HTTP/1.0" 200 134 0.000599
Sep 28 12:13:44 ctl02 nova-api[25391]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:13:44 ctl02 nova-api[25391]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:13:44 ctl02 heat-api[13008]: 2017-09-28 12:13:44.609 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:13:44] "OPTIONS / HTTP/1.0" 200 134 0.000643
Sep 28 12:13:44 ctl02 nova-api[25391]: 2017-09-28 12:13:44.770 25391 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:13:44 ctl02 nova-api[25391]: 2017-09-28 12:13:44.772 25391 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:13:44 ctl02 nova-api[25391]: 2017-09-28 12:13:44.772 25391 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:13:44 ctl02 nova-api[25391]: 2017-09-28 12:13:44.772 25391 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:13:44 ctl02 nova-api[25391]: 2017-09-28 12:13:44.772 25391 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:13:44 ctl02 nova-api[25391]: 2017-09-28 12:13:44.772 25391 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:13:44 ctl02 nova-api[25391]: 2017-09-28 12:13:44.772 25391 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:13:44 ctl02 nova-api[25391]: 2017-09-28 12:13:44.772 25391 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:13:44 ctl02 nova-api[25391]: 2017-09-28 12:13:44.772 25391 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:13:44 ctl02 nova-api[25391]: 2017-09-28 12:13:44.772 25391 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:13:44 ctl02 nova-api[25391]: 2017-09-28 12:13:44.772 25391 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:13:44 ctl02 nova-api[25391]: 2017-09-28 12:13:44.772 25391 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:13:44 ctl02 nova-api[25391]: 2017-09-28 12:13:44.772 25391 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:13:44 ctl02 nova-api[25391]: 2017-09-28 12:13:44.772 25391 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:13:44 ctl02 nova-api[25391]: 2017-09-28 12:13:44.772 25391 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:13:44 ctl02 nova-api[25391]: 2017-09-28 12:13:44.772 25391 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:13:44 ctl02 nova-api[25391]: 2017-09-28 12:13:44.772 25391 ERROR nova.wsgi     self.filename))
Sep 28 12:13:44 ctl02 nova-api[25391]: 2017-09-28 12:13:44.772 25391 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:13:44 ctl02 nova-api[25391]: 2017-09-28 12:13:44.772 25391 ERROR nova.wsgi
Sep 28 12:13:44 ctl02 nova-api[25391]: 2017-09-28 12:13:44.773 25391 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:13:44 ctl02 nova-api[25391]: 2017-09-28 12:13:44.904 25391 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:13:45 ctl02 glance-api[29183]: 2017-09-28 12:13:45.081 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:13:45] "OPTIONS / HTTP/1.0" 200 134 0.000660
Sep 28 12:13:45 ctl02 nova-api[25391]: 2017-09-28 12:13:45.154 25391 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:13:45 ctl02 nova-api[25391]: 2017-09-28 12:13:45.157 25391 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:13:45 ctl02 nova-api[25391]: 2017-09-28 12:13:45.157 25391 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:13:45 ctl02 nova-api[25391]: 2017-09-28 12:13:45.157 25391 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:13:45 ctl02 nova-api[25391]: 2017-09-28 12:13:45.289 25391 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:13:45 ctl02 nova-api[25391]: 2017-09-28 12:13:45.291 25391 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:13:45 ctl02 nova-api[25391]: 2017-09-28 12:13:45.291 25391 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:13:45 ctl02 nova-api[25391]: 2017-09-28 12:13:45.291 25391 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:13:45 ctl02 nova-api[25391]: 2017-09-28 12:13:45.295 25391 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:13:45 ctl02 nova-api[25391]: 2017-09-28 12:13:45.295 25391 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:13:45 ctl02 nova-api[25391]: 2017-09-28 12:13:45.295 25391 ERROR nova Traceback (most recent call last):
Sep 28 12:13:45 ctl02 nova-api[25391]: 2017-09-28 12:13:45.295 25391 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:13:45 ctl02 nova-api[25391]: 2017-09-28 12:13:45.295 25391 ERROR nova     sys.exit(main())
Sep 28 12:13:45 ctl02 nova-api[25391]: 2017-09-28 12:13:45.295 25391 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:13:45 ctl02 nova-api[25391]: 2017-09-28 12:13:45.295 25391 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:13:45 ctl02 nova-api[25391]: 2017-09-28 12:13:45.295 25391 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:13:45 ctl02 nova-api[25391]: 2017-09-28 12:13:45.295 25391 ERROR nova     max_url_len=max_url_len)
Sep 28 12:13:45 ctl02 nova-api[25391]: 2017-09-28 12:13:45.295 25391 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:13:45 ctl02 nova-api[25391]: 2017-09-28 12:13:45.295 25391 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:13:45 ctl02 nova-api[25391]: 2017-09-28 12:13:45.295 25391 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:13:45 ctl02 nova-api[25391]: 2017-09-28 12:13:45.295 25391 ERROR nova     sock.listen(backlog)
Sep 28 12:13:45 ctl02 nova-api[25391]: 2017-09-28 12:13:45.295 25391 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:13:45 ctl02 nova-api[25391]: 2017-09-28 12:13:45.295 25391 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:13:45 ctl02 nova-api[25391]: 2017-09-28 12:13:45.295 25391 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:13:45 ctl02 nova-api[25391]: 2017-09-28 12:13:45.295 25391 ERROR nova
Sep 28 12:13:45 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:13:45 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:13:45 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:13:45 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:13:45 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:13:45 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:13:45 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:13:47 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:13:47.064 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:13:47] "OPTIONS / HTTP/1.0" 200 134 0.000506
Sep 28 12:13:47 ctl02 nova-api[25409]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:13:47 ctl02 nova-api[25409]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:13:47 ctl02 nova-api[25409]: 2017-09-28 12:13:47.462 25409 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:13:47 ctl02 nova-api[25409]: 2017-09-28 12:13:47.465 25409 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:13:47 ctl02 nova-api[25409]: 2017-09-28 12:13:47.465 25409 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:13:47 ctl02 nova-api[25409]: 2017-09-28 12:13:47.465 25409 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:13:47 ctl02 nova-api[25409]: 2017-09-28 12:13:47.465 25409 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:13:47 ctl02 nova-api[25409]: 2017-09-28 12:13:47.465 25409 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:13:47 ctl02 nova-api[25409]: 2017-09-28 12:13:47.465 25409 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:13:47 ctl02 nova-api[25409]: 2017-09-28 12:13:47.465 25409 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:13:47 ctl02 nova-api[25409]: 2017-09-28 12:13:47.465 25409 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:13:47 ctl02 nova-api[25409]: 2017-09-28 12:13:47.465 25409 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:13:47 ctl02 nova-api[25409]: 2017-09-28 12:13:47.465 25409 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:13:47 ctl02 nova-api[25409]: 2017-09-28 12:13:47.465 25409 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:13:47 ctl02 nova-api[25409]: 2017-09-28 12:13:47.465 25409 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:13:47 ctl02 nova-api[25409]: 2017-09-28 12:13:47.465 25409 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:13:47 ctl02 nova-api[25409]: 2017-09-28 12:13:47.465 25409 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:13:47 ctl02 nova-api[25409]: 2017-09-28 12:13:47.465 25409 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:13:47 ctl02 nova-api[25409]: 2017-09-28 12:13:47.465 25409 ERROR nova.wsgi     self.filename))
Sep 28 12:13:47 ctl02 nova-api[25409]: 2017-09-28 12:13:47.465 25409 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:13:47 ctl02 nova-api[25409]: 2017-09-28 12:13:47.465 25409 ERROR nova.wsgi
Sep 28 12:13:47 ctl02 nova-api[25409]: 2017-09-28 12:13:47.466 25409 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:13:47 ctl02 nova-api[25409]: 2017-09-28 12:13:47.598 25409 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:13:47 ctl02 nova-api[25409]: 2017-09-28 12:13:47.838 25409 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:13:47 ctl02 nova-api[25409]: 2017-09-28 12:13:47.840 25409 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:13:47 ctl02 nova-api[25409]: 2017-09-28 12:13:47.840 25409 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:13:47 ctl02 nova-api[25409]: 2017-09-28 12:13:47.840 25409 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:13:47 ctl02 nova-api[25409]: 2017-09-28 12:13:47.973 25409 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:13:47 ctl02 nova-api[25409]: 2017-09-28 12:13:47.975 25409 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:13:47 ctl02 nova-api[25409]: 2017-09-28 12:13:47.975 25409 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:13:47 ctl02 nova-api[25409]: 2017-09-28 12:13:47.976 25409 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:13:47 ctl02 nova-api[25409]: 2017-09-28 12:13:47.979 25409 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:13:47 ctl02 nova-api[25409]: 2017-09-28 12:13:47.979 25409 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:13:47 ctl02 nova-api[25409]: 2017-09-28 12:13:47.979 25409 ERROR nova Traceback (most recent call last):
Sep 28 12:13:47 ctl02 nova-api[25409]: 2017-09-28 12:13:47.979 25409 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:13:47 ctl02 nova-api[25409]: 2017-09-28 12:13:47.979 25409 ERROR nova     sys.exit(main())
Sep 28 12:13:47 ctl02 nova-api[25409]: 2017-09-28 12:13:47.979 25409 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:13:47 ctl02 nova-api[25409]: 2017-09-28 12:13:47.979 25409 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:13:47 ctl02 nova-api[25409]: 2017-09-28 12:13:47.979 25409 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:13:47 ctl02 nova-api[25409]: 2017-09-28 12:13:47.979 25409 ERROR nova     max_url_len=max_url_len)
Sep 28 12:13:47 ctl02 nova-api[25409]: 2017-09-28 12:13:47.979 25409 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:13:47 ctl02 nova-api[25409]: 2017-09-28 12:13:47.979 25409 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:13:47 ctl02 nova-api[25409]: 2017-09-28 12:13:47.979 25409 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:13:47 ctl02 nova-api[25409]: 2017-09-28 12:13:47.979 25409 ERROR nova     sock.listen(backlog)
Sep 28 12:13:47 ctl02 nova-api[25409]: 2017-09-28 12:13:47.979 25409 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:13:47 ctl02 nova-api[25409]: 2017-09-28 12:13:47.979 25409 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:13:47 ctl02 nova-api[25409]: 2017-09-28 12:13:47.979 25409 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:13:47 ctl02 nova-api[25409]: 2017-09-28 12:13:47.979 25409 ERROR nova
Sep 28 12:13:48 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:13:48.103 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:13:48] "OPTIONS / HTTP/1.0" 200 134 0.000536
Sep 28 12:13:48 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:13:48 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:13:48 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:13:48 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:13:48 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:13:48 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:13:48 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:13:49 ctl02 heat-api[13008]: 2017-09-28 12:13:49.881 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:13:49] "OPTIONS / HTTP/1.0" 200 134 0.000614
Sep 28 12:13:50 ctl02 nova-api[25427]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:13:50 ctl02 nova-api[25427]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:13:50 ctl02 nova-api[25427]: 2017-09-28 12:13:50.231 25427 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:13:50 ctl02 nova-api[25427]: 2017-09-28 12:13:50.233 25427 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:13:50 ctl02 nova-api[25427]: 2017-09-28 12:13:50.233 25427 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:13:50 ctl02 nova-api[25427]: 2017-09-28 12:13:50.233 25427 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:13:50 ctl02 nova-api[25427]: 2017-09-28 12:13:50.233 25427 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:13:50 ctl02 nova-api[25427]: 2017-09-28 12:13:50.233 25427 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:13:50 ctl02 nova-api[25427]: 2017-09-28 12:13:50.233 25427 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:13:50 ctl02 nova-api[25427]: 2017-09-28 12:13:50.233 25427 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:13:50 ctl02 nova-api[25427]: 2017-09-28 12:13:50.233 25427 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:13:50 ctl02 nova-api[25427]: 2017-09-28 12:13:50.233 25427 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:13:50 ctl02 nova-api[25427]: 2017-09-28 12:13:50.233 25427 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:13:50 ctl02 nova-api[25427]: 2017-09-28 12:13:50.233 25427 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:13:50 ctl02 nova-api[25427]: 2017-09-28 12:13:50.233 25427 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:13:50 ctl02 nova-api[25427]: 2017-09-28 12:13:50.233 25427 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:13:50 ctl02 nova-api[25427]: 2017-09-28 12:13:50.233 25427 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:13:50 ctl02 nova-api[25427]: 2017-09-28 12:13:50.233 25427 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:13:50 ctl02 nova-api[25427]: 2017-09-28 12:13:50.233 25427 ERROR nova.wsgi     self.filename))
Sep 28 12:13:50 ctl02 nova-api[25427]: 2017-09-28 12:13:50.233 25427 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:13:50 ctl02 nova-api[25427]: 2017-09-28 12:13:50.233 25427 ERROR nova.wsgi
Sep 28 12:13:50 ctl02 nova-api[25427]: 2017-09-28 12:13:50.236 25427 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:13:50 ctl02 glance-api[29183]: 2017-09-28 12:13:50.302 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:13:50] "OPTIONS / HTTP/1.0" 200 134 0.000644
Sep 28 12:13:50 ctl02 heat-api-cfn[13300]: 2017-09-28 12:13:50.314 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:13:50] "OPTIONS / HTTP/1.0" 200 134 0.000495
Sep 28 12:13:50 ctl02 nova-api[25427]: 2017-09-28 12:13:50.374 25427 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:13:50 ctl02 nova-api[25427]: 2017-09-28 12:13:50.626 25427 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:13:50 ctl02 nova-api[25427]: 2017-09-28 12:13:50.629 25427 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:13:50 ctl02 nova-api[25427]: 2017-09-28 12:13:50.630 25427 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:13:50 ctl02 nova-api[25427]: 2017-09-28 12:13:50.630 25427 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:13:50 ctl02 nova-api[25427]: 2017-09-28 12:13:50.765 25427 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:13:50 ctl02 nova-api[25427]: 2017-09-28 12:13:50.767 25427 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:13:50 ctl02 nova-api[25427]: 2017-09-28 12:13:50.767 25427 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:13:50 ctl02 nova-api[25427]: 2017-09-28 12:13:50.768 25427 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:13:50 ctl02 nova-api[25427]: 2017-09-28 12:13:50.771 25427 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:13:50 ctl02 nova-api[25427]: 2017-09-28 12:13:50.772 25427 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:13:50 ctl02 nova-api[25427]: 2017-09-28 12:13:50.772 25427 ERROR nova Traceback (most recent call last):
Sep 28 12:13:50 ctl02 nova-api[25427]: 2017-09-28 12:13:50.772 25427 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:13:50 ctl02 nova-api[25427]: 2017-09-28 12:13:50.772 25427 ERROR nova     sys.exit(main())
Sep 28 12:13:50 ctl02 nova-api[25427]: 2017-09-28 12:13:50.772 25427 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:13:50 ctl02 nova-api[25427]: 2017-09-28 12:13:50.772 25427 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:13:50 ctl02 nova-api[25427]: 2017-09-28 12:13:50.772 25427 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:13:50 ctl02 nova-api[25427]: 2017-09-28 12:13:50.772 25427 ERROR nova     max_url_len=max_url_len)
Sep 28 12:13:50 ctl02 nova-api[25427]: 2017-09-28 12:13:50.772 25427 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:13:50 ctl02 nova-api[25427]: 2017-09-28 12:13:50.772 25427 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:13:50 ctl02 nova-api[25427]: 2017-09-28 12:13:50.772 25427 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:13:50 ctl02 nova-api[25427]: 2017-09-28 12:13:50.772 25427 ERROR nova     sock.listen(backlog)
Sep 28 12:13:50 ctl02 nova-api[25427]: 2017-09-28 12:13:50.772 25427 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:13:50 ctl02 nova-api[25427]: 2017-09-28 12:13:50.772 25427 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:13:50 ctl02 nova-api[25427]: 2017-09-28 12:13:50.772 25427 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:13:50 ctl02 nova-api[25427]: 2017-09-28 12:13:50.772 25427 ERROR nova
Sep 28 12:13:50 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:13:50 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:13:50 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:13:51 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:13:51 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:13:51 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:13:51 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:13:51 ctl02 heat-api-cfn[13300]: 2017-09-28 12:13:51.165 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:13:51] "OPTIONS / HTTP/1.0" 200 134 0.000616
Sep 28 12:13:52 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:13:52.577 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:13:52] "OPTIONS / HTTP/1.0" 200 134 0.000524
Sep 28 12:13:52 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf5f322b)
Sep 28 12:13:52 ctl02 nova-api[25445]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:13:52 ctl02 nova-api[25445]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:13:53 ctl02 nova-api[25445]: 2017-09-28 12:13:53.033 25445 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:13:53 ctl02 nova-api[25445]: 2017-09-28 12:13:53.035 25445 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:13:53 ctl02 nova-api[25445]: 2017-09-28 12:13:53.035 25445 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:13:53 ctl02 nova-api[25445]: 2017-09-28 12:13:53.035 25445 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:13:53 ctl02 nova-api[25445]: 2017-09-28 12:13:53.035 25445 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:13:53 ctl02 nova-api[25445]: 2017-09-28 12:13:53.035 25445 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:13:53 ctl02 nova-api[25445]: 2017-09-28 12:13:53.035 25445 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:13:53 ctl02 nova-api[25445]: 2017-09-28 12:13:53.035 25445 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:13:53 ctl02 nova-api[25445]: 2017-09-28 12:13:53.035 25445 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:13:53 ctl02 nova-api[25445]: 2017-09-28 12:13:53.035 25445 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:13:53 ctl02 nova-api[25445]: 2017-09-28 12:13:53.035 25445 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:13:53 ctl02 nova-api[25445]: 2017-09-28 12:13:53.035 25445 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:13:53 ctl02 nova-api[25445]: 2017-09-28 12:13:53.035 25445 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:13:53 ctl02 nova-api[25445]: 2017-09-28 12:13:53.035 25445 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:13:53 ctl02 nova-api[25445]: 2017-09-28 12:13:53.035 25445 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:13:53 ctl02 nova-api[25445]: 2017-09-28 12:13:53.035 25445 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:13:53 ctl02 nova-api[25445]: 2017-09-28 12:13:53.035 25445 ERROR nova.wsgi     self.filename))
Sep 28 12:13:53 ctl02 nova-api[25445]: 2017-09-28 12:13:53.035 25445 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:13:53 ctl02 nova-api[25445]: 2017-09-28 12:13:53.035 25445 ERROR nova.wsgi
Sep 28 12:13:53 ctl02 nova-api[25445]: 2017-09-28 12:13:53.036 25445 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:13:53 ctl02 nova-api[25445]: 2017-09-28 12:13:53.175 25445 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:13:53 ctl02 nova-api[25445]: 2017-09-28 12:13:53.439 25445 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:13:53 ctl02 nova-api[25445]: 2017-09-28 12:13:53.441 25445 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:13:53 ctl02 nova-api[25445]: 2017-09-28 12:13:53.441 25445 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:13:53 ctl02 nova-api[25445]: 2017-09-28 12:13:53.442 25445 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:13:53 ctl02 nova-api[25445]: 2017-09-28 12:13:53.585 25445 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:13:53 ctl02 nova-api[25445]: 2017-09-28 12:13:53.588 25445 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:13:53 ctl02 nova-api[25445]: 2017-09-28 12:13:53.588 25445 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:13:53 ctl02 nova-api[25445]: 2017-09-28 12:13:53.588 25445 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:13:53 ctl02 glance-api[29183]: 2017-09-28 12:13:53.590 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:13:53] "OPTIONS / HTTP/1.0" 200 134 0.000639
Sep 28 12:13:53 ctl02 nova-api[25445]: 2017-09-28 12:13:53.592 25445 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:13:53 ctl02 nova-api[25445]: 2017-09-28 12:13:53.593 25445 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:13:53 ctl02 nova-api[25445]: 2017-09-28 12:13:53.593 25445 ERROR nova Traceback (most recent call last):
Sep 28 12:13:53 ctl02 nova-api[25445]: 2017-09-28 12:13:53.593 25445 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:13:53 ctl02 nova-api[25445]: 2017-09-28 12:13:53.593 25445 ERROR nova     sys.exit(main())
Sep 28 12:13:53 ctl02 nova-api[25445]: 2017-09-28 12:13:53.593 25445 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:13:53 ctl02 nova-api[25445]: 2017-09-28 12:13:53.593 25445 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:13:53 ctl02 nova-api[25445]: 2017-09-28 12:13:53.593 25445 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:13:53 ctl02 nova-api[25445]: 2017-09-28 12:13:53.593 25445 ERROR nova     max_url_len=max_url_len)
Sep 28 12:13:53 ctl02 nova-api[25445]: 2017-09-28 12:13:53.593 25445 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:13:53 ctl02 nova-api[25445]: 2017-09-28 12:13:53.593 25445 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:13:53 ctl02 nova-api[25445]: 2017-09-28 12:13:53.593 25445 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:13:53 ctl02 nova-api[25445]: 2017-09-28 12:13:53.593 25445 ERROR nova     sock.listen(backlog)
Sep 28 12:13:53 ctl02 nova-api[25445]: 2017-09-28 12:13:53.593 25445 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:13:53 ctl02 nova-api[25445]: 2017-09-28 12:13:53.593 25445 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:13:53 ctl02 nova-api[25445]: 2017-09-28 12:13:53.593 25445 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:13:53 ctl02 nova-api[25445]: 2017-09-28 12:13:53.593 25445 ERROR nova
Sep 28 12:13:53 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf5f322b)
Sep 28 12:13:53 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:13:53 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:13:53 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:13:53 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:13:53 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:13:53 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:13:53 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:13:54 ctl02 heat-api-cfn[13300]: 2017-09-28 12:13:54.180 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:13:54] "OPTIONS / HTTP/1.0" 200 134 0.000765
Sep 28 12:13:54 ctl02 heat-api[13008]: 2017-09-28 12:13:54.309 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:13:54] "OPTIONS / HTTP/1.0" 200 134 0.000635
Sep 28 12:13:54 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf5f322b)
Sep 28 12:13:54 ctl02 glance-api[29183]: 2017-09-28 12:13:54.744 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:13:54] "OPTIONS / HTTP/1.0" 200 134 0.001188
Sep 28 12:13:54 ctl02 heat-api[13008]: 2017-09-28 12:13:54.768 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:13:54] "OPTIONS / HTTP/1.0" 200 134 0.000650
Sep 28 12:13:55 ctl02 nova-api[25463]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:13:55 ctl02 nova-api[25463]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:13:55 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf5f322b)
Sep 28 12:13:55 ctl02 nova-api[25463]: 2017-09-28 12:13:55.744 25463 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:13:55 ctl02 nova-api[25463]: 2017-09-28 12:13:55.746 25463 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:13:55 ctl02 nova-api[25463]: 2017-09-28 12:13:55.746 25463 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:13:55 ctl02 nova-api[25463]: 2017-09-28 12:13:55.746 25463 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:13:55 ctl02 nova-api[25463]: 2017-09-28 12:13:55.746 25463 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:13:55 ctl02 nova-api[25463]: 2017-09-28 12:13:55.746 25463 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:13:55 ctl02 nova-api[25463]: 2017-09-28 12:13:55.746 25463 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:13:55 ctl02 nova-api[25463]: 2017-09-28 12:13:55.746 25463 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:13:55 ctl02 nova-api[25463]: 2017-09-28 12:13:55.746 25463 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:13:55 ctl02 nova-api[25463]: 2017-09-28 12:13:55.746 25463 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:13:55 ctl02 nova-api[25463]: 2017-09-28 12:13:55.746 25463 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:13:55 ctl02 nova-api[25463]: 2017-09-28 12:13:55.746 25463 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:13:55 ctl02 nova-api[25463]: 2017-09-28 12:13:55.746 25463 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:13:55 ctl02 nova-api[25463]: 2017-09-28 12:13:55.746 25463 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:13:55 ctl02 nova-api[25463]: 2017-09-28 12:13:55.746 25463 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:13:55 ctl02 nova-api[25463]: 2017-09-28 12:13:55.746 25463 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:13:55 ctl02 nova-api[25463]: 2017-09-28 12:13:55.746 25463 ERROR nova.wsgi     self.filename))
Sep 28 12:13:55 ctl02 nova-api[25463]: 2017-09-28 12:13:55.746 25463 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:13:55 ctl02 nova-api[25463]: 2017-09-28 12:13:55.746 25463 ERROR nova.wsgi
Sep 28 12:13:55 ctl02 nova-api[25463]: 2017-09-28 12:13:55.748 25463 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:13:55 ctl02 nova-api[25463]: 2017-09-28 12:13:55.884 25463 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:13:56 ctl02 nova-api[25463]: 2017-09-28 12:13:56.140 25463 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:13:56 ctl02 nova-api[25463]: 2017-09-28 12:13:56.143 25463 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:13:56 ctl02 nova-api[25463]: 2017-09-28 12:13:56.143 25463 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:13:56 ctl02 nova-api[25463]: 2017-09-28 12:13:56.144 25463 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:13:56 ctl02 nova-api[25463]: 2017-09-28 12:13:56.279 25463 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:13:56 ctl02 nova-api[25463]: 2017-09-28 12:13:56.281 25463 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:13:56 ctl02 nova-api[25463]: 2017-09-28 12:13:56.281 25463 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:13:56 ctl02 nova-api[25463]: 2017-09-28 12:13:56.281 25463 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:13:56 ctl02 nova-api[25463]: 2017-09-28 12:13:56.285 25463 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:13:56 ctl02 nova-api[25463]: 2017-09-28 12:13:56.285 25463 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:13:56 ctl02 nova-api[25463]: 2017-09-28 12:13:56.285 25463 ERROR nova Traceback (most recent call last):
Sep 28 12:13:56 ctl02 nova-api[25463]: 2017-09-28 12:13:56.285 25463 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:13:56 ctl02 nova-api[25463]: 2017-09-28 12:13:56.285 25463 ERROR nova     sys.exit(main())
Sep 28 12:13:56 ctl02 nova-api[25463]: 2017-09-28 12:13:56.285 25463 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:13:56 ctl02 nova-api[25463]: 2017-09-28 12:13:56.285 25463 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:13:56 ctl02 nova-api[25463]: 2017-09-28 12:13:56.285 25463 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:13:56 ctl02 nova-api[25463]: 2017-09-28 12:13:56.285 25463 ERROR nova     max_url_len=max_url_len)
Sep 28 12:13:56 ctl02 nova-api[25463]: 2017-09-28 12:13:56.285 25463 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:13:56 ctl02 nova-api[25463]: 2017-09-28 12:13:56.285 25463 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:13:56 ctl02 nova-api[25463]: 2017-09-28 12:13:56.285 25463 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:13:56 ctl02 nova-api[25463]: 2017-09-28 12:13:56.285 25463 ERROR nova     sock.listen(backlog)
Sep 28 12:13:56 ctl02 nova-api[25463]: 2017-09-28 12:13:56.285 25463 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:13:56 ctl02 nova-api[25463]: 2017-09-28 12:13:56.285 25463 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:13:56 ctl02 nova-api[25463]: 2017-09-28 12:13:56.285 25463 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:13:56 ctl02 nova-api[25463]: 2017-09-28 12:13:56.285 25463 ERROR nova
Sep 28 12:13:56 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:13:56 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:13:56 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:13:56 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf5f322b)
Sep 28 12:13:56 ctl02 nova-cert[4860]: 2017-09-28 12:13:56.620 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:13:56 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:13:56 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:13:56 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:13:56 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:13:57 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:13:57.328 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:13:57] "OPTIONS / HTTP/1.0" 200 134 0.000504
Sep 28 12:13:57 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf5f322b)
Sep 28 12:13:57 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:13:57.779 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:13:57] "OPTIONS / HTTP/1.0" 200 134 0.000510
Sep 28 12:13:58 ctl02 nova-api[25481]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:13:58 ctl02 nova-api[25481]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:13:58 ctl02 nova-conductor[5056]: 2017-09-28 12:13:58.469 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:13:58 ctl02 nova-conductor[5056]: 2017-09-28 12:13:58.484 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:13:58 ctl02 nova-conductor[5056]: 2017-09-28 12:13:58.485 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:13:58 ctl02 nova-conductor[5056]: 2017-09-28 12:13:58.489 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:13:58 ctl02 nova-api[25481]: 2017-09-28 12:13:58.511 25481 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:13:58 ctl02 nova-api[25481]: 2017-09-28 12:13:58.513 25481 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:13:58 ctl02 nova-api[25481]: 2017-09-28 12:13:58.513 25481 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:13:58 ctl02 nova-api[25481]: 2017-09-28 12:13:58.513 25481 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:13:58 ctl02 nova-api[25481]: 2017-09-28 12:13:58.513 25481 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:13:58 ctl02 nova-api[25481]: 2017-09-28 12:13:58.513 25481 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:13:58 ctl02 nova-api[25481]: 2017-09-28 12:13:58.513 25481 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:13:58 ctl02 nova-api[25481]: 2017-09-28 12:13:58.513 25481 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:13:58 ctl02 nova-api[25481]: 2017-09-28 12:13:58.513 25481 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:13:58 ctl02 nova-api[25481]: 2017-09-28 12:13:58.513 25481 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:13:58 ctl02 nova-api[25481]: 2017-09-28 12:13:58.513 25481 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:13:58 ctl02 nova-api[25481]: 2017-09-28 12:13:58.513 25481 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:13:58 ctl02 nova-api[25481]: 2017-09-28 12:13:58.513 25481 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:13:58 ctl02 nova-api[25481]: 2017-09-28 12:13:58.513 25481 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:13:58 ctl02 nova-api[25481]: 2017-09-28 12:13:58.513 25481 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:13:58 ctl02 nova-api[25481]: 2017-09-28 12:13:58.513 25481 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:13:58 ctl02 nova-api[25481]: 2017-09-28 12:13:58.513 25481 ERROR nova.wsgi     self.filename))
Sep 28 12:13:58 ctl02 nova-api[25481]: 2017-09-28 12:13:58.513 25481 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:13:58 ctl02 nova-api[25481]: 2017-09-28 12:13:58.513 25481 ERROR nova.wsgi
Sep 28 12:13:58 ctl02 nova-api[25481]: 2017-09-28 12:13:58.514 25481 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:13:58 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf5f322b)
Sep 28 12:13:58 ctl02 nova-api[25481]: 2017-09-28 12:13:58.647 25481 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:13:58 ctl02 nova-api[25481]: 2017-09-28 12:13:58.897 25481 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:13:58 ctl02 nova-api[25481]: 2017-09-28 12:13:58.899 25481 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:13:58 ctl02 nova-api[25481]: 2017-09-28 12:13:58.899 25481 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:13:58 ctl02 nova-api[25481]: 2017-09-28 12:13:58.899 25481 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:13:59 ctl02 nova-api[25481]: 2017-09-28 12:13:59.031 25481 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:13:59 ctl02 nova-api[25481]: 2017-09-28 12:13:59.033 25481 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:13:59 ctl02 nova-api[25481]: 2017-09-28 12:13:59.033 25481 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:13:59 ctl02 nova-api[25481]: 2017-09-28 12:13:59.034 25481 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:13:59 ctl02 nova-api[25481]: 2017-09-28 12:13:59.037 25481 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:13:59 ctl02 nova-api[25481]: 2017-09-28 12:13:59.037 25481 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:13:59 ctl02 nova-api[25481]: 2017-09-28 12:13:59.037 25481 ERROR nova Traceback (most recent call last):
Sep 28 12:13:59 ctl02 nova-api[25481]: 2017-09-28 12:13:59.037 25481 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:13:59 ctl02 nova-api[25481]: 2017-09-28 12:13:59.037 25481 ERROR nova     sys.exit(main())
Sep 28 12:13:59 ctl02 nova-api[25481]: 2017-09-28 12:13:59.037 25481 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:13:59 ctl02 nova-api[25481]: 2017-09-28 12:13:59.037 25481 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:13:59 ctl02 nova-api[25481]: 2017-09-28 12:13:59.037 25481 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:13:59 ctl02 nova-api[25481]: 2017-09-28 12:13:59.037 25481 ERROR nova     max_url_len=max_url_len)
Sep 28 12:13:59 ctl02 nova-api[25481]: 2017-09-28 12:13:59.037 25481 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:13:59 ctl02 nova-api[25481]: 2017-09-28 12:13:59.037 25481 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:13:59 ctl02 nova-api[25481]: 2017-09-28 12:13:59.037 25481 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:13:59 ctl02 nova-api[25481]: 2017-09-28 12:13:59.037 25481 ERROR nova     sock.listen(backlog)
Sep 28 12:13:59 ctl02 nova-api[25481]: 2017-09-28 12:13:59.037 25481 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:13:59 ctl02 nova-api[25481]: 2017-09-28 12:13:59.037 25481 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:13:59 ctl02 nova-api[25481]: 2017-09-28 12:13:59.037 25481 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:13:59 ctl02 nova-api[25481]: 2017-09-28 12:13:59.037 25481 ERROR nova
Sep 28 12:13:59 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:13:59 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:13:59 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:13:59 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:13:59 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:13:59 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:13:59 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:13:59 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf5f322b)
Sep 28 12:13:59 ctl02 heat-api[13008]: 2017-09-28 12:13:59.823 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:13:59] "OPTIONS / HTTP/1.0" 200 134 0.000619
Sep 28 12:13:59 ctl02 heat-api-cfn[13300]: 2017-09-28 12:13:59.969 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:13:59] "OPTIONS / HTTP/1.0" 200 134 0.000620
Sep 28 12:13:59 ctl02 glance-api[29183]: 2017-09-28 12:13:59.975 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:13:59] "OPTIONS / HTTP/1.0" 200 134 0.001073
Sep 28 12:14:00 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf5f322b)
Sep 28 12:14:01 ctl02 nova-api[25499]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:14:01 ctl02 nova-api[25499]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:14:01 ctl02 nova-api[25499]: 2017-09-28 12:14:01.280 25499 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:14:01 ctl02 nova-api[25499]: 2017-09-28 12:14:01.282 25499 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:14:01 ctl02 nova-api[25499]: 2017-09-28 12:14:01.282 25499 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:14:01 ctl02 nova-api[25499]: 2017-09-28 12:14:01.282 25499 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:14:01 ctl02 nova-api[25499]: 2017-09-28 12:14:01.282 25499 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:14:01 ctl02 nova-api[25499]: 2017-09-28 12:14:01.282 25499 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:14:01 ctl02 nova-api[25499]: 2017-09-28 12:14:01.282 25499 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:14:01 ctl02 nova-api[25499]: 2017-09-28 12:14:01.282 25499 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:14:01 ctl02 nova-api[25499]: 2017-09-28 12:14:01.282 25499 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:14:01 ctl02 nova-api[25499]: 2017-09-28 12:14:01.282 25499 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:14:01 ctl02 nova-api[25499]: 2017-09-28 12:14:01.282 25499 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:14:01 ctl02 nova-api[25499]: 2017-09-28 12:14:01.282 25499 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:14:01 ctl02 nova-api[25499]: 2017-09-28 12:14:01.282 25499 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:14:01 ctl02 nova-api[25499]: 2017-09-28 12:14:01.282 25499 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:14:01 ctl02 nova-api[25499]: 2017-09-28 12:14:01.282 25499 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:14:01 ctl02 nova-api[25499]: 2017-09-28 12:14:01.282 25499 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:14:01 ctl02 nova-api[25499]: 2017-09-28 12:14:01.282 25499 ERROR nova.wsgi     self.filename))
Sep 28 12:14:01 ctl02 nova-api[25499]: 2017-09-28 12:14:01.282 25499 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:14:01 ctl02 nova-api[25499]: 2017-09-28 12:14:01.282 25499 ERROR nova.wsgi
Sep 28 12:14:01 ctl02 nova-api[25499]: 2017-09-28 12:14:01.283 25499 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:14:01 ctl02 nova-api[25499]: 2017-09-28 12:14:01.418 25499 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:14:01 ctl02 heat-api-cfn[13300]: 2017-09-28 12:14:01.418 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:14:01] "OPTIONS / HTTP/1.0" 200 134 0.000463
Sep 28 12:14:01 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf5f322b)
Sep 28 12:14:01 ctl02 nova-api[25499]: 2017-09-28 12:14:01.654 25499 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:14:01 ctl02 nova-api[25499]: 2017-09-28 12:14:01.656 25499 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:14:01 ctl02 nova-api[25499]: 2017-09-28 12:14:01.656 25499 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:14:01 ctl02 nova-api[25499]: 2017-09-28 12:14:01.657 25499 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:14:01 ctl02 nova-api[25499]: 2017-09-28 12:14:01.790 25499 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:14:01 ctl02 nova-api[25499]: 2017-09-28 12:14:01.792 25499 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:14:01 ctl02 nova-api[25499]: 2017-09-28 12:14:01.792 25499 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:14:01 ctl02 nova-api[25499]: 2017-09-28 12:14:01.792 25499 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:14:01 ctl02 nova-api[25499]: 2017-09-28 12:14:01.795 25499 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:14:01 ctl02 nova-api[25499]: 2017-09-28 12:14:01.796 25499 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:14:01 ctl02 nova-api[25499]: 2017-09-28 12:14:01.796 25499 ERROR nova Traceback (most recent call last):
Sep 28 12:14:01 ctl02 nova-api[25499]: 2017-09-28 12:14:01.796 25499 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:14:01 ctl02 nova-api[25499]: 2017-09-28 12:14:01.796 25499 ERROR nova     sys.exit(main())
Sep 28 12:14:01 ctl02 nova-api[25499]: 2017-09-28 12:14:01.796 25499 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:14:01 ctl02 nova-api[25499]: 2017-09-28 12:14:01.796 25499 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:14:01 ctl02 nova-api[25499]: 2017-09-28 12:14:01.796 25499 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:14:01 ctl02 nova-api[25499]: 2017-09-28 12:14:01.796 25499 ERROR nova     max_url_len=max_url_len)
Sep 28 12:14:01 ctl02 nova-api[25499]: 2017-09-28 12:14:01.796 25499 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:14:01 ctl02 nova-api[25499]: 2017-09-28 12:14:01.796 25499 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:14:01 ctl02 nova-api[25499]: 2017-09-28 12:14:01.796 25499 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:14:01 ctl02 nova-api[25499]: 2017-09-28 12:14:01.796 25499 ERROR nova     sock.listen(backlog)
Sep 28 12:14:01 ctl02 nova-api[25499]: 2017-09-28 12:14:01.796 25499 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:14:01 ctl02 nova-api[25499]: 2017-09-28 12:14:01.796 25499 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:14:01 ctl02 nova-api[25499]: 2017-09-28 12:14:01.796 25499 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:14:01 ctl02 nova-api[25499]: 2017-09-28 12:14:01.796 25499 ERROR nova
Sep 28 12:14:01 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:14:01 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:14:01 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:14:02 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:14:02 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:14:02 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:14:02 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:14:02 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf5f322b)
Sep 28 12:14:02 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:14:02.939 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:14:02] "OPTIONS / HTTP/1.0" 200 134 0.000474
Sep 28 12:14:03 ctl02 glance-api[29183]: 2017-09-28 12:14:03.597 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:14:03] "OPTIONS / HTTP/1.0" 200 134 0.001020
Sep 28 12:14:03 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:14:03 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:14:03 ctl02 nova-api[25517]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:14:03 ctl02 nova-api[25517]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:14:03 ctl02 heat-api[13008]: 2017-09-28 12:14:03.949 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:14:03] "OPTIONS / HTTP/1.0" 200 134 0.000565
Sep 28 12:14:03 ctl02 nova-api[25517]: 2017-09-28 12:14:03.996 25517 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:14:03 ctl02 nova-api[25517]: 2017-09-28 12:14:03.998 25517 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:14:03 ctl02 nova-api[25517]: 2017-09-28 12:14:03.998 25517 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:14:04 ctl02 nova-api[25517]: 2017-09-28 12:14:03.998 25517 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:14:04 ctl02 nova-api[25517]: 2017-09-28 12:14:03.998 25517 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:14:04 ctl02 nova-api[25517]: 2017-09-28 12:14:03.998 25517 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:14:04 ctl02 nova-api[25517]: 2017-09-28 12:14:03.998 25517 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:14:04 ctl02 nova-api[25517]: 2017-09-28 12:14:03.998 25517 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:14:04 ctl02 nova-api[25517]: 2017-09-28 12:14:03.998 25517 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:14:04 ctl02 nova-api[25517]: 2017-09-28 12:14:03.998 25517 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:14:04 ctl02 nova-api[25517]: 2017-09-28 12:14:03.998 25517 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:14:04 ctl02 nova-api[25517]: 2017-09-28 12:14:03.998 25517 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:14:04 ctl02 nova-api[25517]: 2017-09-28 12:14:03.998 25517 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:14:04 ctl02 nova-api[25517]: 2017-09-28 12:14:03.998 25517 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:14:04 ctl02 nova-api[25517]: 2017-09-28 12:14:03.998 25517 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:14:04 ctl02 nova-api[25517]: 2017-09-28 12:14:03.998 25517 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:14:04 ctl02 nova-api[25517]: 2017-09-28 12:14:03.998 25517 ERROR nova.wsgi     self.filename))
Sep 28 12:14:04 ctl02 nova-api[25517]: 2017-09-28 12:14:03.998 25517 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:14:04 ctl02 nova-api[25517]: 2017-09-28 12:14:03.998 25517 ERROR nova.wsgi
Sep 28 12:14:04 ctl02 nova-api[25517]: 2017-09-28 12:14:03.999 25517 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:14:04 ctl02 nova-api[25517]: 2017-09-28 12:14:04.130 25517 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:14:04 ctl02 nova-api[25517]: 2017-09-28 12:14:04.360 25517 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:14:04 ctl02 nova-api[25517]: 2017-09-28 12:14:04.363 25517 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:14:04 ctl02 nova-api[25517]: 2017-09-28 12:14:04.363 25517 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:14:04 ctl02 nova-api[25517]: 2017-09-28 12:14:04.363 25517 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:14:04 ctl02 heat-api[13008]: 2017-09-28 12:14:04.455 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:14:04] "OPTIONS / HTTP/1.0" 200 134 0.000564
Sep 28 12:14:04 ctl02 nova-api[25517]: 2017-09-28 12:14:04.497 25517 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:14:04 ctl02 nova-api[25517]: 2017-09-28 12:14:04.499 25517 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:14:04 ctl02 nova-api[25517]: 2017-09-28 12:14:04.499 25517 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:14:04 ctl02 nova-api[25517]: 2017-09-28 12:14:04.499 25517 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:14:04 ctl02 nova-api[25517]: 2017-09-28 12:14:04.502 25517 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:14:04 ctl02 nova-api[25517]: 2017-09-28 12:14:04.503 25517 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:14:04 ctl02 nova-api[25517]: 2017-09-28 12:14:04.503 25517 ERROR nova Traceback (most recent call last):
Sep 28 12:14:04 ctl02 nova-api[25517]: 2017-09-28 12:14:04.503 25517 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:14:04 ctl02 nova-api[25517]: 2017-09-28 12:14:04.503 25517 ERROR nova     sys.exit(main())
Sep 28 12:14:04 ctl02 nova-api[25517]: 2017-09-28 12:14:04.503 25517 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:14:04 ctl02 nova-api[25517]: 2017-09-28 12:14:04.503 25517 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:14:04 ctl02 nova-api[25517]: 2017-09-28 12:14:04.503 25517 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:14:04 ctl02 nova-api[25517]: 2017-09-28 12:14:04.503 25517 ERROR nova     max_url_len=max_url_len)
Sep 28 12:14:04 ctl02 nova-api[25517]: 2017-09-28 12:14:04.503 25517 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:14:04 ctl02 nova-api[25517]: 2017-09-28 12:14:04.503 25517 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:14:04 ctl02 nova-api[25517]: 2017-09-28 12:14:04.503 25517 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:14:04 ctl02 nova-api[25517]: 2017-09-28 12:14:04.503 25517 ERROR nova     sock.listen(backlog)
Sep 28 12:14:04 ctl02 nova-api[25517]: 2017-09-28 12:14:04.503 25517 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:14:04 ctl02 nova-api[25517]: 2017-09-28 12:14:04.503 25517 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:14:04 ctl02 nova-api[25517]: 2017-09-28 12:14:04.503 25517 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:14:04 ctl02 nova-api[25517]: 2017-09-28 12:14:04.503 25517 ERROR nova
Sep 28 12:14:04 ctl02 heat-api-cfn[13300]: 2017-09-28 12:14:04.525 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:14:04] "OPTIONS / HTTP/1.0" 200 134 0.000593
Sep 28 12:14:04 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:14:04 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:14:04 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:14:04 ctl02 glance-api[29183]: 2017-09-28 12:14:04.802 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:14:04] "OPTIONS / HTTP/1.0" 200 134 0.000773
Sep 28 12:14:04 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:14:04 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:14:04 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:14:04 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:14:06 ctl02 nova-consoleauth[5433]: 2017-09-28 12:14:06.514 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:14:06 ctl02 nova-api[25540]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:14:06 ctl02 nova-api[25540]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:14:06 ctl02 nova-api[25540]: 2017-09-28 12:14:06.757 25540 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:14:06 ctl02 nova-api[25540]: 2017-09-28 12:14:06.759 25540 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:14:06 ctl02 nova-api[25540]: 2017-09-28 12:14:06.759 25540 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:14:06 ctl02 nova-api[25540]: 2017-09-28 12:14:06.759 25540 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:14:06 ctl02 nova-api[25540]: 2017-09-28 12:14:06.759 25540 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:14:06 ctl02 nova-api[25540]: 2017-09-28 12:14:06.759 25540 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:14:06 ctl02 nova-api[25540]: 2017-09-28 12:14:06.759 25540 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:14:06 ctl02 nova-api[25540]: 2017-09-28 12:14:06.759 25540 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:14:06 ctl02 nova-api[25540]: 2017-09-28 12:14:06.759 25540 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:14:06 ctl02 nova-api[25540]: 2017-09-28 12:14:06.759 25540 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:14:06 ctl02 nova-api[25540]: 2017-09-28 12:14:06.759 25540 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:14:06 ctl02 nova-api[25540]: 2017-09-28 12:14:06.759 25540 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:14:06 ctl02 nova-api[25540]: 2017-09-28 12:14:06.759 25540 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:14:06 ctl02 nova-api[25540]: 2017-09-28 12:14:06.759 25540 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:14:06 ctl02 nova-api[25540]: 2017-09-28 12:14:06.759 25540 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:14:06 ctl02 nova-api[25540]: 2017-09-28 12:14:06.759 25540 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:14:06 ctl02 nova-api[25540]: 2017-09-28 12:14:06.759 25540 ERROR nova.wsgi     self.filename))
Sep 28 12:14:06 ctl02 nova-api[25540]: 2017-09-28 12:14:06.759 25540 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:14:06 ctl02 nova-api[25540]: 2017-09-28 12:14:06.759 25540 ERROR nova.wsgi
Sep 28 12:14:06 ctl02 nova-api[25540]: 2017-09-28 12:14:06.761 25540 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:14:06 ctl02 nova-api[25540]: 2017-09-28 12:14:06.894 25540 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:14:06 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:14:06.979 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:14:06] "OPTIONS / HTTP/1.0" 200 134 0.000498
Sep 28 12:14:07 ctl02 nova-api[25540]: 2017-09-28 12:14:07.145 25540 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:14:07 ctl02 nova-api[25540]: 2017-09-28 12:14:07.148 25540 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:14:07 ctl02 nova-api[25540]: 2017-09-28 12:14:07.148 25540 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:14:07 ctl02 nova-api[25540]: 2017-09-28 12:14:07.148 25540 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:14:07 ctl02 nova-api[25540]: 2017-09-28 12:14:07.282 25540 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:14:07 ctl02 nova-api[25540]: 2017-09-28 12:14:07.285 25540 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:14:07 ctl02 nova-api[25540]: 2017-09-28 12:14:07.285 25540 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:14:07 ctl02 nova-api[25540]: 2017-09-28 12:14:07.286 25540 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:14:07 ctl02 nova-api[25540]: 2017-09-28 12:14:07.289 25540 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:14:07 ctl02 nova-api[25540]: 2017-09-28 12:14:07.290 25540 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:14:07 ctl02 nova-api[25540]: 2017-09-28 12:14:07.290 25540 ERROR nova Traceback (most recent call last):
Sep 28 12:14:07 ctl02 nova-api[25540]: 2017-09-28 12:14:07.290 25540 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:14:07 ctl02 nova-api[25540]: 2017-09-28 12:14:07.290 25540 ERROR nova     sys.exit(main())
Sep 28 12:14:07 ctl02 nova-api[25540]: 2017-09-28 12:14:07.290 25540 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:14:07 ctl02 nova-api[25540]: 2017-09-28 12:14:07.290 25540 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:14:07 ctl02 nova-api[25540]: 2017-09-28 12:14:07.290 25540 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:14:07 ctl02 nova-api[25540]: 2017-09-28 12:14:07.290 25540 ERROR nova     max_url_len=max_url_len)
Sep 28 12:14:07 ctl02 nova-api[25540]: 2017-09-28 12:14:07.290 25540 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:14:07 ctl02 nova-api[25540]: 2017-09-28 12:14:07.290 25540 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:14:07 ctl02 nova-api[25540]: 2017-09-28 12:14:07.290 25540 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:14:07 ctl02 nova-api[25540]: 2017-09-28 12:14:07.290 25540 ERROR nova     sock.listen(backlog)
Sep 28 12:14:07 ctl02 nova-api[25540]: 2017-09-28 12:14:07.290 25540 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:14:07 ctl02 nova-api[25540]: 2017-09-28 12:14:07.290 25540 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:14:07 ctl02 nova-api[25540]: 2017-09-28 12:14:07.290 25540 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:14:07 ctl02 nova-api[25540]: 2017-09-28 12:14:07.290 25540 ERROR nova
Sep 28 12:14:07 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:14:07 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:14:07 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:14:07 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:14:07.597 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:14:07] "OPTIONS / HTTP/1.0" 200 134 0.000490
Sep 28 12:14:07 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:14:07 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:14:07 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:14:07 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:14:09 ctl02 nova-api[25558]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:14:09 ctl02 nova-api[25558]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:14:09 ctl02 nova-api[25558]: 2017-09-28 12:14:09.491 25558 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:14:09 ctl02 nova-api[25558]: 2017-09-28 12:14:09.493 25558 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:14:09 ctl02 nova-api[25558]: 2017-09-28 12:14:09.493 25558 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:14:09 ctl02 nova-api[25558]: 2017-09-28 12:14:09.493 25558 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:14:09 ctl02 nova-api[25558]: 2017-09-28 12:14:09.493 25558 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:14:09 ctl02 nova-api[25558]: 2017-09-28 12:14:09.493 25558 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:14:09 ctl02 nova-api[25558]: 2017-09-28 12:14:09.493 25558 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:14:09 ctl02 nova-api[25558]: 2017-09-28 12:14:09.493 25558 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:14:09 ctl02 nova-api[25558]: 2017-09-28 12:14:09.493 25558 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:14:09 ctl02 nova-api[25558]: 2017-09-28 12:14:09.493 25558 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:14:09 ctl02 nova-api[25558]: 2017-09-28 12:14:09.493 25558 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:14:09 ctl02 nova-api[25558]: 2017-09-28 12:14:09.493 25558 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:14:09 ctl02 nova-api[25558]: 2017-09-28 12:14:09.493 25558 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:14:09 ctl02 nova-api[25558]: 2017-09-28 12:14:09.493 25558 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:14:09 ctl02 nova-api[25558]: 2017-09-28 12:14:09.493 25558 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:14:09 ctl02 nova-api[25558]: 2017-09-28 12:14:09.493 25558 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:14:09 ctl02 nova-api[25558]: 2017-09-28 12:14:09.493 25558 ERROR nova.wsgi     self.filename))
Sep 28 12:14:09 ctl02 nova-api[25558]: 2017-09-28 12:14:09.493 25558 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:14:09 ctl02 nova-api[25558]: 2017-09-28 12:14:09.493 25558 ERROR nova.wsgi
Sep 28 12:14:09 ctl02 nova-api[25558]: 2017-09-28 12:14:09.494 25558 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:14:09 ctl02 heat-engine[12803]: 2017-09-28 12:14:09.537 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:14:09 ctl02 nova-scheduler[5620]: 2017-09-28 12:14:09.543 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:14:09 ctl02 heat-engine[12803]: 2017-09-28 12:14:09.565 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:14:09 ctl02 heat-engine[12803]: 2017-09-28 12:14:09.578 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:14:09 ctl02 heat-engine[12803]: 2017-09-28 12:14:09.589 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:14:09 ctl02 nova-api[25558]: 2017-09-28 12:14:09.645 25558 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:14:09 ctl02 heat-api[13008]: 2017-09-28 12:14:09.655 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:14:09] "OPTIONS / HTTP/1.0" 200 134 0.000596
Sep 28 12:14:09 ctl02 nova-api[25558]: 2017-09-28 12:14:09.898 25558 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:14:09 ctl02 nova-api[25558]: 2017-09-28 12:14:09.900 25558 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:14:09 ctl02 nova-api[25558]: 2017-09-28 12:14:09.901 25558 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:14:09 ctl02 nova-api[25558]: 2017-09-28 12:14:09.901 25558 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:14:10 ctl02 nova-api[25558]: 2017-09-28 12:14:10.033 25558 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:14:10 ctl02 nova-api[25558]: 2017-09-28 12:14:10.035 25558 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:14:10 ctl02 nova-api[25558]: 2017-09-28 12:14:10.035 25558 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:14:10 ctl02 nova-api[25558]: 2017-09-28 12:14:10.035 25558 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:14:10 ctl02 nova-api[25558]: 2017-09-28 12:14:10.039 25558 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:14:10 ctl02 nova-api[25558]: 2017-09-28 12:14:10.039 25558 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:14:10 ctl02 nova-api[25558]: 2017-09-28 12:14:10.039 25558 ERROR nova Traceback (most recent call last):
Sep 28 12:14:10 ctl02 nova-api[25558]: 2017-09-28 12:14:10.039 25558 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:14:10 ctl02 nova-api[25558]: 2017-09-28 12:14:10.039 25558 ERROR nova     sys.exit(main())
Sep 28 12:14:10 ctl02 nova-api[25558]: 2017-09-28 12:14:10.039 25558 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:14:10 ctl02 nova-api[25558]: 2017-09-28 12:14:10.039 25558 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:14:10 ctl02 nova-api[25558]: 2017-09-28 12:14:10.039 25558 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:14:10 ctl02 nova-api[25558]: 2017-09-28 12:14:10.039 25558 ERROR nova     max_url_len=max_url_len)
Sep 28 12:14:10 ctl02 nova-api[25558]: 2017-09-28 12:14:10.039 25558 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:14:10 ctl02 nova-api[25558]: 2017-09-28 12:14:10.039 25558 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:14:10 ctl02 nova-api[25558]: 2017-09-28 12:14:10.039 25558 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:14:10 ctl02 nova-api[25558]: 2017-09-28 12:14:10.039 25558 ERROR nova     sock.listen(backlog)
Sep 28 12:14:10 ctl02 nova-api[25558]: 2017-09-28 12:14:10.039 25558 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:14:10 ctl02 nova-api[25558]: 2017-09-28 12:14:10.039 25558 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:14:10 ctl02 nova-api[25558]: 2017-09-28 12:14:10.039 25558 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:14:10 ctl02 nova-api[25558]: 2017-09-28 12:14:10.039 25558 ERROR nova
Sep 28 12:14:10 ctl02 glance-api[29183]: 2017-09-28 12:14:10.199 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:14:10] "OPTIONS / HTTP/1.0" 200 134 0.000614
Sep 28 12:14:10 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:14:10 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:14:10 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:14:10 ctl02 heat-api-cfn[13300]: 2017-09-28 12:14:10.308 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:14:10] "OPTIONS / HTTP/1.0" 200 134 0.000640
Sep 28 12:14:10 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:14:10 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:14:10 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:14:10 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:14:11 ctl02 heat-api-cfn[13300]: 2017-09-28 12:14:11.627 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:14:11] "OPTIONS / HTTP/1.0" 200 134 0.000464
Sep 28 12:14:12 ctl02 nova-api[25576]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:14:12 ctl02 nova-api[25576]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:14:12 ctl02 nova-api[25576]: 2017-09-28 12:14:12.218 25576 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:14:12 ctl02 nova-api[25576]: 2017-09-28 12:14:12.220 25576 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:14:12 ctl02 nova-api[25576]: 2017-09-28 12:14:12.220 25576 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:14:12 ctl02 nova-api[25576]: 2017-09-28 12:14:12.220 25576 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:14:12 ctl02 nova-api[25576]: 2017-09-28 12:14:12.220 25576 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:14:12 ctl02 nova-api[25576]: 2017-09-28 12:14:12.220 25576 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:14:12 ctl02 nova-api[25576]: 2017-09-28 12:14:12.220 25576 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:14:12 ctl02 nova-api[25576]: 2017-09-28 12:14:12.220 25576 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:14:12 ctl02 nova-api[25576]: 2017-09-28 12:14:12.220 25576 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:14:12 ctl02 nova-api[25576]: 2017-09-28 12:14:12.220 25576 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:14:12 ctl02 nova-api[25576]: 2017-09-28 12:14:12.220 25576 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:14:12 ctl02 nova-api[25576]: 2017-09-28 12:14:12.220 25576 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:14:12 ctl02 nova-api[25576]: 2017-09-28 12:14:12.220 25576 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:14:12 ctl02 nova-api[25576]: 2017-09-28 12:14:12.220 25576 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:14:12 ctl02 nova-api[25576]: 2017-09-28 12:14:12.220 25576 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:14:12 ctl02 nova-api[25576]: 2017-09-28 12:14:12.220 25576 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:14:12 ctl02 nova-api[25576]: 2017-09-28 12:14:12.220 25576 ERROR nova.wsgi     self.filename))
Sep 28 12:14:12 ctl02 nova-api[25576]: 2017-09-28 12:14:12.220 25576 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:14:12 ctl02 nova-api[25576]: 2017-09-28 12:14:12.220 25576 ERROR nova.wsgi
Sep 28 12:14:12 ctl02 nova-api[25576]: 2017-09-28 12:14:12.223 25576 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:14:12 ctl02 nova-api[25576]: 2017-09-28 12:14:12.356 25576 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:14:12 ctl02 nova-api[25576]: 2017-09-28 12:14:12.606 25576 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:14:12 ctl02 nova-api[25576]: 2017-09-28 12:14:12.609 25576 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:14:12 ctl02 nova-api[25576]: 2017-09-28 12:14:12.609 25576 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:14:12 ctl02 nova-api[25576]: 2017-09-28 12:14:12.610 25576 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:14:12 ctl02 nova-api[25576]: 2017-09-28 12:14:12.742 25576 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:14:12 ctl02 nova-api[25576]: 2017-09-28 12:14:12.745 25576 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:14:12 ctl02 nova-api[25576]: 2017-09-28 12:14:12.745 25576 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:14:12 ctl02 nova-api[25576]: 2017-09-28 12:14:12.746 25576 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:14:12 ctl02 nova-api[25576]: 2017-09-28 12:14:12.749 25576 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:14:12 ctl02 nova-api[25576]: 2017-09-28 12:14:12.750 25576 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:14:12 ctl02 nova-api[25576]: 2017-09-28 12:14:12.750 25576 ERROR nova Traceback (most recent call last):
Sep 28 12:14:12 ctl02 nova-api[25576]: 2017-09-28 12:14:12.750 25576 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:14:12 ctl02 nova-api[25576]: 2017-09-28 12:14:12.750 25576 ERROR nova     sys.exit(main())
Sep 28 12:14:12 ctl02 nova-api[25576]: 2017-09-28 12:14:12.750 25576 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:14:12 ctl02 nova-api[25576]: 2017-09-28 12:14:12.750 25576 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:14:12 ctl02 nova-api[25576]: 2017-09-28 12:14:12.750 25576 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:14:12 ctl02 nova-api[25576]: 2017-09-28 12:14:12.750 25576 ERROR nova     max_url_len=max_url_len)
Sep 28 12:14:12 ctl02 nova-api[25576]: 2017-09-28 12:14:12.750 25576 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:14:12 ctl02 nova-api[25576]: 2017-09-28 12:14:12.750 25576 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:14:12 ctl02 nova-api[25576]: 2017-09-28 12:14:12.750 25576 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:14:12 ctl02 nova-api[25576]: 2017-09-28 12:14:12.750 25576 ERROR nova     sock.listen(backlog)
Sep 28 12:14:12 ctl02 nova-api[25576]: 2017-09-28 12:14:12.750 25576 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:14:12 ctl02 nova-api[25576]: 2017-09-28 12:14:12.750 25576 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:14:12 ctl02 nova-api[25576]: 2017-09-28 12:14:12.750 25576 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:14:12 ctl02 nova-api[25576]: 2017-09-28 12:14:12.750 25576 ERROR nova
Sep 28 12:14:12 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:14:12 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:14:12 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:14:12 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:14:12.935 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:14:12] "OPTIONS / HTTP/1.0" 200 134 0.000467
Sep 28 12:14:13 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:14:13 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:14:13 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:14:13 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:14:13 ctl02 glance-api[29183]: 2017-09-28 12:14:13.461 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:14:13] "OPTIONS / HTTP/1.0" 200 134 0.000651
Sep 28 12:14:13 ctl02 heat-api[13008]: 2017-09-28 12:14:13.780 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:14:13] "OPTIONS / HTTP/1.0" 200 134 0.000584
Sep 28 12:14:14 ctl02 heat-api-cfn[13300]: 2017-09-28 12:14:14.546 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:14:14] "OPTIONS / HTTP/1.0" 200 134 0.000497
Sep 28 12:14:14 ctl02 glance-api[29183]: 2017-09-28 12:14:14.616 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:14:14] "OPTIONS / HTTP/1.0" 200 134 0.000639
Sep 28 12:14:14 ctl02 heat-api[13008]: 2017-09-28 12:14:14.759 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:14:14] "OPTIONS / HTTP/1.0" 200 134 0.000622
Sep 28 12:14:14 ctl02 nova-api[25594]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:14:14 ctl02 nova-api[25594]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:14:14 ctl02 nova-api[25594]: 2017-09-28 12:14:14.975 25594 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:14:14 ctl02 nova-api[25594]: 2017-09-28 12:14:14.977 25594 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:14:14 ctl02 nova-api[25594]: 2017-09-28 12:14:14.977 25594 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:14:14 ctl02 nova-api[25594]: 2017-09-28 12:14:14.977 25594 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:14:14 ctl02 nova-api[25594]: 2017-09-28 12:14:14.977 25594 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:14:14 ctl02 nova-api[25594]: 2017-09-28 12:14:14.977 25594 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:14:14 ctl02 nova-api[25594]: 2017-09-28 12:14:14.977 25594 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:14:14 ctl02 nova-api[25594]: 2017-09-28 12:14:14.977 25594 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:14:14 ctl02 nova-api[25594]: 2017-09-28 12:14:14.977 25594 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:14:14 ctl02 nova-api[25594]: 2017-09-28 12:14:14.977 25594 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:14:14 ctl02 nova-api[25594]: 2017-09-28 12:14:14.977 25594 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:14:14 ctl02 nova-api[25594]: 2017-09-28 12:14:14.977 25594 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:14:14 ctl02 nova-api[25594]: 2017-09-28 12:14:14.977 25594 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:14:14 ctl02 nova-api[25594]: 2017-09-28 12:14:14.977 25594 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:14:14 ctl02 nova-api[25594]: 2017-09-28 12:14:14.977 25594 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:14:14 ctl02 nova-api[25594]: 2017-09-28 12:14:14.977 25594 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:14:14 ctl02 nova-api[25594]: 2017-09-28 12:14:14.977 25594 ERROR nova.wsgi     self.filename))
Sep 28 12:14:14 ctl02 nova-api[25594]: 2017-09-28 12:14:14.977 25594 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:14:14 ctl02 nova-api[25594]: 2017-09-28 12:14:14.977 25594 ERROR nova.wsgi
Sep 28 12:14:14 ctl02 nova-api[25594]: 2017-09-28 12:14:14.979 25594 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:14:15 ctl02 nova-api[25594]: 2017-09-28 12:14:15.116 25594 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:14:15 ctl02 nova-api[25594]: 2017-09-28 12:14:15.365 25594 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:14:15 ctl02 nova-api[25594]: 2017-09-28 12:14:15.368 25594 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:14:15 ctl02 nova-api[25594]: 2017-09-28 12:14:15.368 25594 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:14:15 ctl02 nova-api[25594]: 2017-09-28 12:14:15.369 25594 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:14:15 ctl02 nova-api[25594]: 2017-09-28 12:14:15.501 25594 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:14:15 ctl02 nova-api[25594]: 2017-09-28 12:14:15.504 25594 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:14:15 ctl02 nova-api[25594]: 2017-09-28 12:14:15.504 25594 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:14:15 ctl02 nova-api[25594]: 2017-09-28 12:14:15.505 25594 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:14:15 ctl02 nova-api[25594]: 2017-09-28 12:14:15.508 25594 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:14:15 ctl02 nova-api[25594]: 2017-09-28 12:14:15.509 25594 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:14:15 ctl02 nova-api[25594]: 2017-09-28 12:14:15.509 25594 ERROR nova Traceback (most recent call last):
Sep 28 12:14:15 ctl02 nova-api[25594]: 2017-09-28 12:14:15.509 25594 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:14:15 ctl02 nova-api[25594]: 2017-09-28 12:14:15.509 25594 ERROR nova     sys.exit(main())
Sep 28 12:14:15 ctl02 nova-api[25594]: 2017-09-28 12:14:15.509 25594 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:14:15 ctl02 nova-api[25594]: 2017-09-28 12:14:15.509 25594 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:14:15 ctl02 nova-api[25594]: 2017-09-28 12:14:15.509 25594 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:14:15 ctl02 nova-api[25594]: 2017-09-28 12:14:15.509 25594 ERROR nova     max_url_len=max_url_len)
Sep 28 12:14:15 ctl02 nova-api[25594]: 2017-09-28 12:14:15.509 25594 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:14:15 ctl02 nova-api[25594]: 2017-09-28 12:14:15.509 25594 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:14:15 ctl02 nova-api[25594]: 2017-09-28 12:14:15.509 25594 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:14:15 ctl02 nova-api[25594]: 2017-09-28 12:14:15.509 25594 ERROR nova     sock.listen(backlog)
Sep 28 12:14:15 ctl02 nova-api[25594]: 2017-09-28 12:14:15.509 25594 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:14:15 ctl02 nova-api[25594]: 2017-09-28 12:14:15.509 25594 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:14:15 ctl02 nova-api[25594]: 2017-09-28 12:14:15.509 25594 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:14:15 ctl02 nova-api[25594]: 2017-09-28 12:14:15.509 25594 ERROR nova
Sep 28 12:14:15 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:14:15 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:14:15 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:14:15 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:14:15 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:14:15 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:14:15 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:14:17 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:14:17.245 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:14:17] "OPTIONS / HTTP/1.0" 200 134 0.000469
Sep 28 12:14:17 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:14:17.287 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:14:17] "OPTIONS / HTTP/1.0" 200 134 0.000254
Sep 28 12:14:17 ctl02 nova-api[25612]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:14:17 ctl02 nova-api[25612]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:14:17 ctl02 nova-api[25612]: 2017-09-28 12:14:17.764 25612 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:14:17 ctl02 nova-api[25612]: 2017-09-28 12:14:17.766 25612 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:14:17 ctl02 nova-api[25612]: 2017-09-28 12:14:17.766 25612 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:14:17 ctl02 nova-api[25612]: 2017-09-28 12:14:17.766 25612 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:14:17 ctl02 nova-api[25612]: 2017-09-28 12:14:17.766 25612 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:14:17 ctl02 nova-api[25612]: 2017-09-28 12:14:17.766 25612 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:14:17 ctl02 nova-api[25612]: 2017-09-28 12:14:17.766 25612 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:14:17 ctl02 nova-api[25612]: 2017-09-28 12:14:17.766 25612 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:14:17 ctl02 nova-api[25612]: 2017-09-28 12:14:17.766 25612 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:14:17 ctl02 nova-api[25612]: 2017-09-28 12:14:17.766 25612 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:14:17 ctl02 nova-api[25612]: 2017-09-28 12:14:17.766 25612 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:14:17 ctl02 nova-api[25612]: 2017-09-28 12:14:17.766 25612 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:14:17 ctl02 nova-api[25612]: 2017-09-28 12:14:17.766 25612 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:14:17 ctl02 nova-api[25612]: 2017-09-28 12:14:17.766 25612 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:14:17 ctl02 nova-api[25612]: 2017-09-28 12:14:17.766 25612 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:14:17 ctl02 nova-api[25612]: 2017-09-28 12:14:17.766 25612 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:14:17 ctl02 nova-api[25612]: 2017-09-28 12:14:17.766 25612 ERROR nova.wsgi     self.filename))
Sep 28 12:14:17 ctl02 nova-api[25612]: 2017-09-28 12:14:17.766 25612 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:14:17 ctl02 nova-api[25612]: 2017-09-28 12:14:17.766 25612 ERROR nova.wsgi
Sep 28 12:14:17 ctl02 nova-api[25612]: 2017-09-28 12:14:17.768 25612 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:14:17 ctl02 nova-api[25612]: 2017-09-28 12:14:17.905 25612 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:14:18 ctl02 nova-api[25612]: 2017-09-28 12:14:18.163 25612 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:14:18 ctl02 nova-api[25612]: 2017-09-28 12:14:18.165 25612 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:14:18 ctl02 nova-api[25612]: 2017-09-28 12:14:18.166 25612 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:14:18 ctl02 nova-api[25612]: 2017-09-28 12:14:18.166 25612 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:14:18 ctl02 nova-api[25612]: 2017-09-28 12:14:18.299 25612 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:14:18 ctl02 nova-api[25612]: 2017-09-28 12:14:18.302 25612 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:14:18 ctl02 nova-api[25612]: 2017-09-28 12:14:18.302 25612 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:14:18 ctl02 nova-api[25612]: 2017-09-28 12:14:18.303 25612 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:14:18 ctl02 nova-api[25612]: 2017-09-28 12:14:18.306 25612 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:14:18 ctl02 nova-api[25612]: 2017-09-28 12:14:18.307 25612 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:14:18 ctl02 nova-api[25612]: 2017-09-28 12:14:18.307 25612 ERROR nova Traceback (most recent call last):
Sep 28 12:14:18 ctl02 nova-api[25612]: 2017-09-28 12:14:18.307 25612 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:14:18 ctl02 nova-api[25612]: 2017-09-28 12:14:18.307 25612 ERROR nova     sys.exit(main())
Sep 28 12:14:18 ctl02 nova-api[25612]: 2017-09-28 12:14:18.307 25612 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:14:18 ctl02 nova-api[25612]: 2017-09-28 12:14:18.307 25612 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:14:18 ctl02 nova-api[25612]: 2017-09-28 12:14:18.307 25612 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:14:18 ctl02 nova-api[25612]: 2017-09-28 12:14:18.307 25612 ERROR nova     max_url_len=max_url_len)
Sep 28 12:14:18 ctl02 nova-api[25612]: 2017-09-28 12:14:18.307 25612 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:14:18 ctl02 nova-api[25612]: 2017-09-28 12:14:18.307 25612 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:14:18 ctl02 nova-api[25612]: 2017-09-28 12:14:18.307 25612 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:14:18 ctl02 nova-api[25612]: 2017-09-28 12:14:18.307 25612 ERROR nova     sock.listen(backlog)
Sep 28 12:14:18 ctl02 nova-api[25612]: 2017-09-28 12:14:18.307 25612 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:14:18 ctl02 nova-api[25612]: 2017-09-28 12:14:18.307 25612 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:14:18 ctl02 nova-api[25612]: 2017-09-28 12:14:18.307 25612 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:14:18 ctl02 nova-api[25612]: 2017-09-28 12:14:18.307 25612 ERROR nova
Sep 28 12:14:18 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:14:18 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:14:18 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:14:18 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:14:18 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:14:18 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:14:18 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:14:19 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x96dd484e)
Sep 28 12:14:19 ctl02 heat-api[13008]: 2017-09-28 12:14:19.600 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:14:19] "OPTIONS / HTTP/1.0" 200 134 0.000667
Sep 28 12:14:20 ctl02 heat-api-cfn[13300]: 2017-09-28 12:14:20.098 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:14:20] "OPTIONS / HTTP/1.0" 200 134 0.000534
Sep 28 12:14:20 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x96dd484e)
Sep 28 12:14:20 ctl02 nova-api[25631]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:14:20 ctl02 nova-api[25631]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:14:20 ctl02 glance-api[29183]: 2017-09-28 12:14:20.311 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:14:20] "OPTIONS / HTTP/1.0" 200 134 0.000687
Sep 28 12:14:20 ctl02 nova-api[25631]: 2017-09-28 12:14:20.481 25631 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:14:20 ctl02 nova-api[25631]: 2017-09-28 12:14:20.483 25631 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:14:20 ctl02 nova-api[25631]: 2017-09-28 12:14:20.483 25631 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:14:20 ctl02 nova-api[25631]: 2017-09-28 12:14:20.483 25631 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:14:20 ctl02 nova-api[25631]: 2017-09-28 12:14:20.483 25631 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:14:20 ctl02 nova-api[25631]: 2017-09-28 12:14:20.483 25631 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:14:20 ctl02 nova-api[25631]: 2017-09-28 12:14:20.483 25631 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:14:20 ctl02 nova-api[25631]: 2017-09-28 12:14:20.483 25631 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:14:20 ctl02 nova-api[25631]: 2017-09-28 12:14:20.483 25631 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:14:20 ctl02 nova-api[25631]: 2017-09-28 12:14:20.483 25631 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:14:20 ctl02 nova-api[25631]: 2017-09-28 12:14:20.483 25631 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:14:20 ctl02 nova-api[25631]: 2017-09-28 12:14:20.483 25631 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:14:20 ctl02 nova-api[25631]: 2017-09-28 12:14:20.483 25631 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:14:20 ctl02 nova-api[25631]: 2017-09-28 12:14:20.483 25631 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:14:20 ctl02 nova-api[25631]: 2017-09-28 12:14:20.483 25631 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:14:20 ctl02 nova-api[25631]: 2017-09-28 12:14:20.483 25631 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:14:20 ctl02 nova-api[25631]: 2017-09-28 12:14:20.483 25631 ERROR nova.wsgi     self.filename))
Sep 28 12:14:20 ctl02 nova-api[25631]: 2017-09-28 12:14:20.483 25631 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:14:20 ctl02 nova-api[25631]: 2017-09-28 12:14:20.483 25631 ERROR nova.wsgi
Sep 28 12:14:20 ctl02 nova-api[25631]: 2017-09-28 12:14:20.486 25631 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:14:20 ctl02 nova-api[25631]: 2017-09-28 12:14:20.623 25631 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:14:20 ctl02 nova-api[25631]: 2017-09-28 12:14:20.875 25631 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:14:20 ctl02 nova-api[25631]: 2017-09-28 12:14:20.878 25631 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:14:20 ctl02 nova-api[25631]: 2017-09-28 12:14:20.878 25631 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:14:20 ctl02 nova-api[25631]: 2017-09-28 12:14:20.879 25631 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:14:21 ctl02 nova-api[25631]: 2017-09-28 12:14:21.012 25631 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:14:21 ctl02 nova-api[25631]: 2017-09-28 12:14:21.015 25631 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:14:21 ctl02 nova-api[25631]: 2017-09-28 12:14:21.015 25631 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:14:21 ctl02 nova-api[25631]: 2017-09-28 12:14:21.016 25631 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:14:21 ctl02 nova-api[25631]: 2017-09-28 12:14:21.019 25631 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:14:21 ctl02 nova-api[25631]: 2017-09-28 12:14:21.020 25631 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:14:21 ctl02 nova-api[25631]: 2017-09-28 12:14:21.020 25631 ERROR nova Traceback (most recent call last):
Sep 28 12:14:21 ctl02 nova-api[25631]: 2017-09-28 12:14:21.020 25631 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:14:21 ctl02 nova-api[25631]: 2017-09-28 12:14:21.020 25631 ERROR nova     sys.exit(main())
Sep 28 12:14:21 ctl02 nova-api[25631]: 2017-09-28 12:14:21.020 25631 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:14:21 ctl02 nova-api[25631]: 2017-09-28 12:14:21.020 25631 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:14:21 ctl02 nova-api[25631]: 2017-09-28 12:14:21.020 25631 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:14:21 ctl02 nova-api[25631]: 2017-09-28 12:14:21.020 25631 ERROR nova     max_url_len=max_url_len)
Sep 28 12:14:21 ctl02 nova-api[25631]: 2017-09-28 12:14:21.020 25631 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:14:21 ctl02 nova-api[25631]: 2017-09-28 12:14:21.020 25631 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:14:21 ctl02 nova-api[25631]: 2017-09-28 12:14:21.020 25631 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:14:21 ctl02 nova-api[25631]: 2017-09-28 12:14:21.020 25631 ERROR nova     sock.listen(backlog)
Sep 28 12:14:21 ctl02 nova-api[25631]: 2017-09-28 12:14:21.020 25631 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:14:21 ctl02 nova-api[25631]: 2017-09-28 12:14:21.020 25631 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:14:21 ctl02 nova-api[25631]: 2017-09-28 12:14:21.020 25631 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:14:21 ctl02 nova-api[25631]: 2017-09-28 12:14:21.020 25631 ERROR nova
Sep 28 12:14:21 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:14:21 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:14:21 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:14:21 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x96dd484e)
Sep 28 12:14:21 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:14:21 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:14:21 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:14:21 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:14:21 ctl02 heat-api-cfn[13300]: 2017-09-28 12:14:21.961 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:14:21] "OPTIONS / HTTP/1.0" 200 134 0.000546
Sep 28 12:14:22 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x96dd484e)
Sep 28 12:14:22 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:14:22.769 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:14:22] "OPTIONS / HTTP/1.0" 200 134 0.000470
Sep 28 12:14:23 ctl02 nova-api[25649]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:14:23 ctl02 nova-api[25649]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:14:23 ctl02 nova-api[25649]: 2017-09-28 12:14:23.246 25649 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:14:23 ctl02 nova-api[25649]: 2017-09-28 12:14:23.248 25649 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:14:23 ctl02 nova-api[25649]: 2017-09-28 12:14:23.248 25649 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:14:23 ctl02 nova-api[25649]: 2017-09-28 12:14:23.248 25649 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:14:23 ctl02 nova-api[25649]: 2017-09-28 12:14:23.248 25649 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:14:23 ctl02 nova-api[25649]: 2017-09-28 12:14:23.248 25649 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:14:23 ctl02 nova-api[25649]: 2017-09-28 12:14:23.248 25649 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:14:23 ctl02 nova-api[25649]: 2017-09-28 12:14:23.248 25649 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:14:23 ctl02 nova-api[25649]: 2017-09-28 12:14:23.248 25649 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:14:23 ctl02 nova-api[25649]: 2017-09-28 12:14:23.248 25649 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:14:23 ctl02 nova-api[25649]: 2017-09-28 12:14:23.248 25649 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:14:23 ctl02 nova-api[25649]: 2017-09-28 12:14:23.248 25649 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:14:23 ctl02 nova-api[25649]: 2017-09-28 12:14:23.248 25649 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:14:23 ctl02 nova-api[25649]: 2017-09-28 12:14:23.248 25649 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:14:23 ctl02 nova-api[25649]: 2017-09-28 12:14:23.248 25649 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:14:23 ctl02 nova-api[25649]: 2017-09-28 12:14:23.248 25649 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:14:23 ctl02 nova-api[25649]: 2017-09-28 12:14:23.248 25649 ERROR nova.wsgi     self.filename))
Sep 28 12:14:23 ctl02 nova-api[25649]: 2017-09-28 12:14:23.248 25649 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:14:23 ctl02 nova-api[25649]: 2017-09-28 12:14:23.248 25649 ERROR nova.wsgi
Sep 28 12:14:23 ctl02 nova-api[25649]: 2017-09-28 12:14:23.251 25649 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:14:23 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x96dd484e)
Sep 28 12:14:23 ctl02 nova-api[25649]: 2017-09-28 12:14:23.386 25649 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:14:23 ctl02 glance-api[29183]: 2017-09-28 12:14:23.532 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:14:23] "OPTIONS / HTTP/1.0" 200 134 0.000648
Sep 28 12:14:23 ctl02 nova-api[25649]: 2017-09-28 12:14:23.640 25649 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:14:23 ctl02 nova-api[25649]: 2017-09-28 12:14:23.643 25649 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:14:23 ctl02 nova-api[25649]: 2017-09-28 12:14:23.643 25649 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:14:23 ctl02 nova-api[25649]: 2017-09-28 12:14:23.644 25649 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:14:23 ctl02 nova-api[25649]: 2017-09-28 12:14:23.777 25649 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:14:23 ctl02 nova-api[25649]: 2017-09-28 12:14:23.780 25649 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:14:23 ctl02 nova-api[25649]: 2017-09-28 12:14:23.781 25649 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:14:23 ctl02 nova-api[25649]: 2017-09-28 12:14:23.781 25649 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:14:23 ctl02 nova-api[25649]: 2017-09-28 12:14:23.785 25649 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:14:23 ctl02 nova-api[25649]: 2017-09-28 12:14:23.785 25649 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:14:23 ctl02 nova-api[25649]: 2017-09-28 12:14:23.785 25649 ERROR nova Traceback (most recent call last):
Sep 28 12:14:23 ctl02 nova-api[25649]: 2017-09-28 12:14:23.785 25649 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:14:23 ctl02 nova-api[25649]: 2017-09-28 12:14:23.785 25649 ERROR nova     sys.exit(main())
Sep 28 12:14:23 ctl02 nova-api[25649]: 2017-09-28 12:14:23.785 25649 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:14:23 ctl02 nova-api[25649]: 2017-09-28 12:14:23.785 25649 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:14:23 ctl02 nova-api[25649]: 2017-09-28 12:14:23.785 25649 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:14:23 ctl02 nova-api[25649]: 2017-09-28 12:14:23.785 25649 ERROR nova     max_url_len=max_url_len)
Sep 28 12:14:23 ctl02 nova-api[25649]: 2017-09-28 12:14:23.785 25649 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:14:23 ctl02 nova-api[25649]: 2017-09-28 12:14:23.785 25649 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:14:23 ctl02 nova-api[25649]: 2017-09-28 12:14:23.785 25649 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:14:23 ctl02 nova-api[25649]: 2017-09-28 12:14:23.785 25649 ERROR nova     sock.listen(backlog)
Sep 28 12:14:23 ctl02 nova-api[25649]: 2017-09-28 12:14:23.785 25649 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:14:23 ctl02 nova-api[25649]: 2017-09-28 12:14:23.785 25649 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:14:23 ctl02 nova-api[25649]: 2017-09-28 12:14:23.785 25649 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:14:23 ctl02 nova-api[25649]: 2017-09-28 12:14:23.785 25649 ERROR nova
Sep 28 12:14:23 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:14:23 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:14:23 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:14:24 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:14:24 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:14:24 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:14:24 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:14:24 ctl02 heat-api[13008]: 2017-09-28 12:14:24.165 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:14:24] "OPTIONS / HTTP/1.0" 200 134 0.000769
Sep 28 12:14:24 ctl02 heat-api-cfn[13300]: 2017-09-28 12:14:24.186 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:14:24] "OPTIONS / HTTP/1.0" 200 134 0.000540
Sep 28 12:14:24 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x96dd484e)
Sep 28 12:14:24 ctl02 glance-api[29183]: 2017-09-28 12:14:24.366 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:14:24] "OPTIONS / HTTP/1.0" 200 134 0.001089
Sep 28 12:14:24 ctl02 heat-api[13008]: 2017-09-28 12:14:24.701 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:14:24] "OPTIONS / HTTP/1.0" 200 134 0.000584
Sep 28 12:14:25 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x96dd484e)
Sep 28 12:14:25 ctl02 nova-api[25666]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:14:25 ctl02 nova-api[25666]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:14:26 ctl02 nova-api[25666]: 2017-09-28 12:14:26.004 25666 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:14:26 ctl02 nova-api[25666]: 2017-09-28 12:14:26.006 25666 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:14:26 ctl02 nova-api[25666]: 2017-09-28 12:14:26.006 25666 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:14:26 ctl02 nova-api[25666]: 2017-09-28 12:14:26.006 25666 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:14:26 ctl02 nova-api[25666]: 2017-09-28 12:14:26.006 25666 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:14:26 ctl02 nova-api[25666]: 2017-09-28 12:14:26.006 25666 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:14:26 ctl02 nova-api[25666]: 2017-09-28 12:14:26.006 25666 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:14:26 ctl02 nova-api[25666]: 2017-09-28 12:14:26.006 25666 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:14:26 ctl02 nova-api[25666]: 2017-09-28 12:14:26.006 25666 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:14:26 ctl02 nova-api[25666]: 2017-09-28 12:14:26.006 25666 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:14:26 ctl02 nova-api[25666]: 2017-09-28 12:14:26.006 25666 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:14:26 ctl02 nova-api[25666]: 2017-09-28 12:14:26.006 25666 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:14:26 ctl02 nova-api[25666]: 2017-09-28 12:14:26.006 25666 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:14:26 ctl02 nova-api[25666]: 2017-09-28 12:14:26.006 25666 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:14:26 ctl02 nova-api[25666]: 2017-09-28 12:14:26.006 25666 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:14:26 ctl02 nova-api[25666]: 2017-09-28 12:14:26.006 25666 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:14:26 ctl02 nova-api[25666]: 2017-09-28 12:14:26.006 25666 ERROR nova.wsgi     self.filename))
Sep 28 12:14:26 ctl02 nova-api[25666]: 2017-09-28 12:14:26.006 25666 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:14:26 ctl02 nova-api[25666]: 2017-09-28 12:14:26.006 25666 ERROR nova.wsgi
Sep 28 12:14:26 ctl02 nova-api[25666]: 2017-09-28 12:14:26.007 25666 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:14:26 ctl02 nova-api[25666]: 2017-09-28 12:14:26.140 25666 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:14:26 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x96dd484e)
Sep 28 12:14:26 ctl02 nova-api[25666]: 2017-09-28 12:14:26.381 25666 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:14:26 ctl02 nova-api[25666]: 2017-09-28 12:14:26.383 25666 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:14:26 ctl02 nova-api[25666]: 2017-09-28 12:14:26.383 25666 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:14:26 ctl02 nova-api[25666]: 2017-09-28 12:14:26.383 25666 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:14:26 ctl02 nova-api[25666]: 2017-09-28 12:14:26.518 25666 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:14:26 ctl02 nova-api[25666]: 2017-09-28 12:14:26.520 25666 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:14:26 ctl02 nova-api[25666]: 2017-09-28 12:14:26.520 25666 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:14:26 ctl02 nova-api[25666]: 2017-09-28 12:14:26.520 25666 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:14:26 ctl02 nova-api[25666]: 2017-09-28 12:14:26.523 25666 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:14:26 ctl02 nova-api[25666]: 2017-09-28 12:14:26.524 25666 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:14:26 ctl02 nova-api[25666]: 2017-09-28 12:14:26.524 25666 ERROR nova Traceback (most recent call last):
Sep 28 12:14:26 ctl02 nova-api[25666]: 2017-09-28 12:14:26.524 25666 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:14:26 ctl02 nova-api[25666]: 2017-09-28 12:14:26.524 25666 ERROR nova     sys.exit(main())
Sep 28 12:14:26 ctl02 nova-api[25666]: 2017-09-28 12:14:26.524 25666 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:14:26 ctl02 nova-api[25666]: 2017-09-28 12:14:26.524 25666 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:14:26 ctl02 nova-api[25666]: 2017-09-28 12:14:26.524 25666 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:14:26 ctl02 nova-api[25666]: 2017-09-28 12:14:26.524 25666 ERROR nova     max_url_len=max_url_len)
Sep 28 12:14:26 ctl02 nova-api[25666]: 2017-09-28 12:14:26.524 25666 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:14:26 ctl02 nova-api[25666]: 2017-09-28 12:14:26.524 25666 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:14:26 ctl02 nova-api[25666]: 2017-09-28 12:14:26.524 25666 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:14:26 ctl02 nova-api[25666]: 2017-09-28 12:14:26.524 25666 ERROR nova     sock.listen(backlog)
Sep 28 12:14:26 ctl02 nova-api[25666]: 2017-09-28 12:14:26.524 25666 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:14:26 ctl02 nova-api[25666]: 2017-09-28 12:14:26.524 25666 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:14:26 ctl02 nova-api[25666]: 2017-09-28 12:14:26.524 25666 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:14:26 ctl02 nova-api[25666]: 2017-09-28 12:14:26.524 25666 ERROR nova
Sep 28 12:14:26 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:14:26 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:14:26 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:14:26 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:14:26 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:14:26 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:14:26 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:14:27 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x96dd484e)
Sep 28 12:14:27 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:14:27.322 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:14:27] "OPTIONS / HTTP/1.0" 200 134 0.000508
Sep 28 12:14:27 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:14:27.549 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:14:27] "OPTIONS / HTTP/1.0" 200 134 0.000489
Sep 28 12:14:28 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x96dd484e)
Sep 28 12:14:28 ctl02 nova-api[25685]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:14:28 ctl02 nova-api[25685]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:14:28 ctl02 nova-cert[4860]: 2017-09-28 12:14:28.660 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:14:28 ctl02 nova-api[25685]: 2017-09-28 12:14:28.761 25685 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:14:28 ctl02 nova-api[25685]: 2017-09-28 12:14:28.763 25685 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:14:28 ctl02 nova-api[25685]: 2017-09-28 12:14:28.763 25685 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:14:28 ctl02 nova-api[25685]: 2017-09-28 12:14:28.763 25685 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:14:28 ctl02 nova-api[25685]: 2017-09-28 12:14:28.763 25685 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:14:28 ctl02 nova-api[25685]: 2017-09-28 12:14:28.763 25685 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:14:28 ctl02 nova-api[25685]: 2017-09-28 12:14:28.763 25685 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:14:28 ctl02 nova-api[25685]: 2017-09-28 12:14:28.763 25685 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:14:28 ctl02 nova-api[25685]: 2017-09-28 12:14:28.763 25685 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:14:28 ctl02 nova-api[25685]: 2017-09-28 12:14:28.763 25685 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:14:28 ctl02 nova-api[25685]: 2017-09-28 12:14:28.763 25685 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:14:28 ctl02 nova-api[25685]: 2017-09-28 12:14:28.763 25685 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:14:28 ctl02 nova-api[25685]: 2017-09-28 12:14:28.763 25685 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:14:28 ctl02 nova-api[25685]: 2017-09-28 12:14:28.763 25685 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:14:28 ctl02 nova-api[25685]: 2017-09-28 12:14:28.763 25685 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:14:28 ctl02 nova-api[25685]: 2017-09-28 12:14:28.763 25685 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:14:28 ctl02 nova-api[25685]: 2017-09-28 12:14:28.763 25685 ERROR nova.wsgi     self.filename))
Sep 28 12:14:28 ctl02 nova-api[25685]: 2017-09-28 12:14:28.763 25685 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:14:28 ctl02 nova-api[25685]: 2017-09-28 12:14:28.763 25685 ERROR nova.wsgi
Sep 28 12:14:28 ctl02 nova-api[25685]: 2017-09-28 12:14:28.764 25685 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:14:28 ctl02 nova-api[25685]: 2017-09-28 12:14:28.897 25685 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:14:29 ctl02 nova-api[25685]: 2017-09-28 12:14:29.153 25685 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:14:29 ctl02 nova-api[25685]: 2017-09-28 12:14:29.155 25685 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:14:29 ctl02 nova-api[25685]: 2017-09-28 12:14:29.155 25685 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:14:29 ctl02 nova-api[25685]: 2017-09-28 12:14:29.156 25685 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:14:29 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x96dd484e)
Sep 28 12:14:29 ctl02 nova-api[25685]: 2017-09-28 12:14:29.290 25685 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:14:29 ctl02 nova-api[25685]: 2017-09-28 12:14:29.292 25685 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:14:29 ctl02 nova-api[25685]: 2017-09-28 12:14:29.292 25685 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:14:29 ctl02 nova-api[25685]: 2017-09-28 12:14:29.293 25685 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:14:29 ctl02 nova-api[25685]: 2017-09-28 12:14:29.296 25685 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:14:29 ctl02 nova-api[25685]: 2017-09-28 12:14:29.296 25685 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:14:29 ctl02 nova-api[25685]: 2017-09-28 12:14:29.296 25685 ERROR nova Traceback (most recent call last):
Sep 28 12:14:29 ctl02 nova-api[25685]: 2017-09-28 12:14:29.296 25685 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:14:29 ctl02 nova-api[25685]: 2017-09-28 12:14:29.296 25685 ERROR nova     sys.exit(main())
Sep 28 12:14:29 ctl02 nova-api[25685]: 2017-09-28 12:14:29.296 25685 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:14:29 ctl02 nova-api[25685]: 2017-09-28 12:14:29.296 25685 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:14:29 ctl02 nova-api[25685]: 2017-09-28 12:14:29.296 25685 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:14:29 ctl02 nova-api[25685]: 2017-09-28 12:14:29.296 25685 ERROR nova     max_url_len=max_url_len)
Sep 28 12:14:29 ctl02 nova-api[25685]: 2017-09-28 12:14:29.296 25685 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:14:29 ctl02 nova-api[25685]: 2017-09-28 12:14:29.296 25685 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:14:29 ctl02 nova-api[25685]: 2017-09-28 12:14:29.296 25685 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:14:29 ctl02 nova-api[25685]: 2017-09-28 12:14:29.296 25685 ERROR nova     sock.listen(backlog)
Sep 28 12:14:29 ctl02 nova-api[25685]: 2017-09-28 12:14:29.296 25685 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:14:29 ctl02 nova-api[25685]: 2017-09-28 12:14:29.296 25685 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:14:29 ctl02 nova-api[25685]: 2017-09-28 12:14:29.296 25685 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:14:29 ctl02 nova-api[25685]: 2017-09-28 12:14:29.296 25685 ERROR nova
Sep 28 12:14:29 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:14:29 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:14:29 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:14:29 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:14:29 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:14:29 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:14:29 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:14:29 ctl02 heat-api[13008]: 2017-09-28 12:14:29.732 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:14:29] "OPTIONS / HTTP/1.0" 200 134 0.000682
Sep 28 12:14:30 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:14:30 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:14:30 ctl02 heat-api-cfn[13300]: 2017-09-28 12:14:30.379 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:14:30] "OPTIONS / HTTP/1.0" 200 134 0.000528
Sep 28 12:14:30 ctl02 nova-conductor[5056]: 2017-09-28 12:14:30.478 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:14:30 ctl02 nova-conductor[5056]: 2017-09-28 12:14:30.493 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:14:30 ctl02 nova-conductor[5056]: 2017-09-28 12:14:30.495 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:14:30 ctl02 nova-conductor[5056]: 2017-09-28 12:14:30.498 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:14:30 ctl02 glance-api[29183]: 2017-09-28 12:14:30.557 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:14:30] "OPTIONS / HTTP/1.0" 200 134 0.000783
Sep 28 12:14:31 ctl02 nova-api[25702]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:14:31 ctl02 nova-api[25702]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:14:31 ctl02 nova-api[25702]: 2017-09-28 12:14:31.517 25702 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:14:31 ctl02 nova-api[25702]: 2017-09-28 12:14:31.519 25702 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:14:31 ctl02 nova-api[25702]: 2017-09-28 12:14:31.519 25702 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:14:31 ctl02 nova-api[25702]: 2017-09-28 12:14:31.519 25702 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:14:31 ctl02 nova-api[25702]: 2017-09-28 12:14:31.519 25702 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:14:31 ctl02 nova-api[25702]: 2017-09-28 12:14:31.519 25702 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:14:31 ctl02 nova-api[25702]: 2017-09-28 12:14:31.519 25702 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:14:31 ctl02 nova-api[25702]: 2017-09-28 12:14:31.519 25702 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:14:31 ctl02 nova-api[25702]: 2017-09-28 12:14:31.519 25702 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:14:31 ctl02 nova-api[25702]: 2017-09-28 12:14:31.519 25702 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:14:31 ctl02 nova-api[25702]: 2017-09-28 12:14:31.519 25702 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:14:31 ctl02 nova-api[25702]: 2017-09-28 12:14:31.519 25702 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:14:31 ctl02 nova-api[25702]: 2017-09-28 12:14:31.519 25702 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:14:31 ctl02 nova-api[25702]: 2017-09-28 12:14:31.519 25702 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:14:31 ctl02 nova-api[25702]: 2017-09-28 12:14:31.519 25702 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:14:31 ctl02 nova-api[25702]: 2017-09-28 12:14:31.519 25702 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:14:31 ctl02 nova-api[25702]: 2017-09-28 12:14:31.519 25702 ERROR nova.wsgi     self.filename))
Sep 28 12:14:31 ctl02 nova-api[25702]: 2017-09-28 12:14:31.519 25702 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:14:31 ctl02 nova-api[25702]: 2017-09-28 12:14:31.519 25702 ERROR nova.wsgi
Sep 28 12:14:31 ctl02 nova-api[25702]: 2017-09-28 12:14:31.520 25702 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:14:31 ctl02 nova-api[25702]: 2017-09-28 12:14:31.656 25702 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:14:31 ctl02 heat-api-cfn[13300]: 2017-09-28 12:14:31.902 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:14:31] "OPTIONS / HTTP/1.0" 200 134 0.000549
Sep 28 12:14:31 ctl02 nova-api[25702]: 2017-09-28 12:14:31.907 25702 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:14:31 ctl02 nova-api[25702]: 2017-09-28 12:14:31.910 25702 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:14:31 ctl02 nova-api[25702]: 2017-09-28 12:14:31.910 25702 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:14:31 ctl02 nova-api[25702]: 2017-09-28 12:14:31.910 25702 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:14:32 ctl02 nova-api[25702]: 2017-09-28 12:14:32.045 25702 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:14:32 ctl02 nova-api[25702]: 2017-09-28 12:14:32.047 25702 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:14:32 ctl02 nova-api[25702]: 2017-09-28 12:14:32.047 25702 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:14:32 ctl02 nova-api[25702]: 2017-09-28 12:14:32.047 25702 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:14:32 ctl02 nova-api[25702]: 2017-09-28 12:14:32.050 25702 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:14:32 ctl02 nova-api[25702]: 2017-09-28 12:14:32.051 25702 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:14:32 ctl02 nova-api[25702]: 2017-09-28 12:14:32.051 25702 ERROR nova Traceback (most recent call last):
Sep 28 12:14:32 ctl02 nova-api[25702]: 2017-09-28 12:14:32.051 25702 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:14:32 ctl02 nova-api[25702]: 2017-09-28 12:14:32.051 25702 ERROR nova     sys.exit(main())
Sep 28 12:14:32 ctl02 nova-api[25702]: 2017-09-28 12:14:32.051 25702 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:14:32 ctl02 nova-api[25702]: 2017-09-28 12:14:32.051 25702 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:14:32 ctl02 nova-api[25702]: 2017-09-28 12:14:32.051 25702 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:14:32 ctl02 nova-api[25702]: 2017-09-28 12:14:32.051 25702 ERROR nova     max_url_len=max_url_len)
Sep 28 12:14:32 ctl02 nova-api[25702]: 2017-09-28 12:14:32.051 25702 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:14:32 ctl02 nova-api[25702]: 2017-09-28 12:14:32.051 25702 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:14:32 ctl02 nova-api[25702]: 2017-09-28 12:14:32.051 25702 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:14:32 ctl02 nova-api[25702]: 2017-09-28 12:14:32.051 25702 ERROR nova     sock.listen(backlog)
Sep 28 12:14:32 ctl02 nova-api[25702]: 2017-09-28 12:14:32.051 25702 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:14:32 ctl02 nova-api[25702]: 2017-09-28 12:14:32.051 25702 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:14:32 ctl02 nova-api[25702]: 2017-09-28 12:14:32.051 25702 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:14:32 ctl02 nova-api[25702]: 2017-09-28 12:14:32.051 25702 ERROR nova
Sep 28 12:14:32 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:14:32 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:14:32 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:14:32 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:14:32 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:14:32 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:14:32 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:14:32 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:14:32.475 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:14:32] "OPTIONS / HTTP/1.0" 200 134 0.000506
Sep 28 12:14:33 ctl02 glance-api[29183]: 2017-09-28 12:14:33.214 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:14:33] "OPTIONS / HTTP/1.0" 200 134 0.000559
Sep 28 12:14:34 ctl02 nova-api[25726]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:14:34 ctl02 nova-api[25726]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:14:34 ctl02 heat-api[13008]: 2017-09-28 12:14:34.080 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:14:34] "OPTIONS / HTTP/1.0" 200 134 0.000675
Sep 28 12:14:34 ctl02 heat-api-cfn[13300]: 2017-09-28 12:14:34.179 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:14:34] "OPTIONS / HTTP/1.0" 200 134 0.000541
Sep 28 12:14:34 ctl02 nova-api[25726]: 2017-09-28 12:14:34.243 25726 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:14:34 ctl02 nova-api[25726]: 2017-09-28 12:14:34.245 25726 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:14:34 ctl02 nova-api[25726]: 2017-09-28 12:14:34.245 25726 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:14:34 ctl02 nova-api[25726]: 2017-09-28 12:14:34.245 25726 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:14:34 ctl02 nova-api[25726]: 2017-09-28 12:14:34.245 25726 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:14:34 ctl02 nova-api[25726]: 2017-09-28 12:14:34.245 25726 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:14:34 ctl02 nova-api[25726]: 2017-09-28 12:14:34.245 25726 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:14:34 ctl02 nova-api[25726]: 2017-09-28 12:14:34.245 25726 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:14:34 ctl02 nova-api[25726]: 2017-09-28 12:14:34.245 25726 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:14:34 ctl02 nova-api[25726]: 2017-09-28 12:14:34.245 25726 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:14:34 ctl02 nova-api[25726]: 2017-09-28 12:14:34.245 25726 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:14:34 ctl02 nova-api[25726]: 2017-09-28 12:14:34.245 25726 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:14:34 ctl02 nova-api[25726]: 2017-09-28 12:14:34.245 25726 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:14:34 ctl02 nova-api[25726]: 2017-09-28 12:14:34.245 25726 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:14:34 ctl02 nova-api[25726]: 2017-09-28 12:14:34.245 25726 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:14:34 ctl02 nova-api[25726]: 2017-09-28 12:14:34.245 25726 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:14:34 ctl02 nova-api[25726]: 2017-09-28 12:14:34.245 25726 ERROR nova.wsgi     self.filename))
Sep 28 12:14:34 ctl02 nova-api[25726]: 2017-09-28 12:14:34.245 25726 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:14:34 ctl02 nova-api[25726]: 2017-09-28 12:14:34.245 25726 ERROR nova.wsgi
Sep 28 12:14:34 ctl02 nova-api[25726]: 2017-09-28 12:14:34.246 25726 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:14:34 ctl02 nova-api[25726]: 2017-09-28 12:14:34.380 25726 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:14:34 ctl02 glance-api[29183]: 2017-09-28 12:14:34.402 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:14:34] "OPTIONS / HTTP/1.0" 200 134 0.000636
Sep 28 12:14:34 ctl02 nova-api[25726]: 2017-09-28 12:14:34.637 25726 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:14:34 ctl02 nova-api[25726]: 2017-09-28 12:14:34.639 25726 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:14:34 ctl02 nova-api[25726]: 2017-09-28 12:14:34.639 25726 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:14:34 ctl02 nova-api[25726]: 2017-09-28 12:14:34.639 25726 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:14:34 ctl02 nova-api[25726]: 2017-09-28 12:14:34.773 25726 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:14:34 ctl02 nova-api[25726]: 2017-09-28 12:14:34.783 25726 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:14:34 ctl02 nova-api[25726]: 2017-09-28 12:14:34.783 25726 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:14:34 ctl02 nova-api[25726]: 2017-09-28 12:14:34.784 25726 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:14:34 ctl02 nova-api[25726]: 2017-09-28 12:14:34.787 25726 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:14:34 ctl02 nova-api[25726]: 2017-09-28 12:14:34.788 25726 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:14:34 ctl02 nova-api[25726]: 2017-09-28 12:14:34.788 25726 ERROR nova Traceback (most recent call last):
Sep 28 12:14:34 ctl02 nova-api[25726]: 2017-09-28 12:14:34.788 25726 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:14:34 ctl02 nova-api[25726]: 2017-09-28 12:14:34.788 25726 ERROR nova     sys.exit(main())
Sep 28 12:14:34 ctl02 nova-api[25726]: 2017-09-28 12:14:34.788 25726 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:14:34 ctl02 nova-api[25726]: 2017-09-28 12:14:34.788 25726 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:14:34 ctl02 nova-api[25726]: 2017-09-28 12:14:34.788 25726 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:14:34 ctl02 nova-api[25726]: 2017-09-28 12:14:34.788 25726 ERROR nova     max_url_len=max_url_len)
Sep 28 12:14:34 ctl02 nova-api[25726]: 2017-09-28 12:14:34.788 25726 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:14:34 ctl02 nova-api[25726]: 2017-09-28 12:14:34.788 25726 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:14:34 ctl02 nova-api[25726]: 2017-09-28 12:14:34.788 25726 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:14:34 ctl02 nova-api[25726]: 2017-09-28 12:14:34.788 25726 ERROR nova     sock.listen(backlog)
Sep 28 12:14:34 ctl02 nova-api[25726]: 2017-09-28 12:14:34.788 25726 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:14:34 ctl02 nova-api[25726]: 2017-09-28 12:14:34.788 25726 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:14:34 ctl02 nova-api[25726]: 2017-09-28 12:14:34.788 25726 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:14:34 ctl02 nova-api[25726]: 2017-09-28 12:14:34.788 25726 ERROR nova
Sep 28 12:14:34 ctl02 heat-api[13008]: 2017-09-28 12:14:34.902 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:14:34] "OPTIONS / HTTP/1.0" 200 134 0.000652
Sep 28 12:14:34 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:14:34 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:14:34 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:14:35 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:14:35 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:14:35 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:14:35 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:14:36 ctl02 nova-api[25743]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:14:36 ctl02 nova-api[25743]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:14:37 ctl02 nova-api[25743]: 2017-09-28 12:14:37.004 25743 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:14:37 ctl02 nova-api[25743]: 2017-09-28 12:14:37.006 25743 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:14:37 ctl02 nova-api[25743]: 2017-09-28 12:14:37.006 25743 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:14:37 ctl02 nova-api[25743]: 2017-09-28 12:14:37.006 25743 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:14:37 ctl02 nova-api[25743]: 2017-09-28 12:14:37.006 25743 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:14:37 ctl02 nova-api[25743]: 2017-09-28 12:14:37.006 25743 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:14:37 ctl02 nova-api[25743]: 2017-09-28 12:14:37.006 25743 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:14:37 ctl02 nova-api[25743]: 2017-09-28 12:14:37.006 25743 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:14:37 ctl02 nova-api[25743]: 2017-09-28 12:14:37.006 25743 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:14:37 ctl02 nova-api[25743]: 2017-09-28 12:14:37.006 25743 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:14:37 ctl02 nova-api[25743]: 2017-09-28 12:14:37.006 25743 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:14:37 ctl02 nova-api[25743]: 2017-09-28 12:14:37.006 25743 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:14:37 ctl02 nova-api[25743]: 2017-09-28 12:14:37.006 25743 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:14:37 ctl02 nova-api[25743]: 2017-09-28 12:14:37.006 25743 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:14:37 ctl02 nova-api[25743]: 2017-09-28 12:14:37.006 25743 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:14:37 ctl02 nova-api[25743]: 2017-09-28 12:14:37.006 25743 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:14:37 ctl02 nova-api[25743]: 2017-09-28 12:14:37.006 25743 ERROR nova.wsgi     self.filename))
Sep 28 12:14:37 ctl02 nova-api[25743]: 2017-09-28 12:14:37.006 25743 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:14:37 ctl02 nova-api[25743]: 2017-09-28 12:14:37.006 25743 ERROR nova.wsgi
Sep 28 12:14:37 ctl02 nova-api[25743]: 2017-09-28 12:14:37.007 25743 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:14:37 ctl02 nova-api[25743]: 2017-09-28 12:14:37.142 25743 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:14:37 ctl02 nova-api[25743]: 2017-09-28 12:14:37.395 25743 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:14:37 ctl02 nova-api[25743]: 2017-09-28 12:14:37.397 25743 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:14:37 ctl02 nova-api[25743]: 2017-09-28 12:14:37.398 25743 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:14:37 ctl02 nova-api[25743]: 2017-09-28 12:14:37.398 25743 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:14:37 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:14:37.427 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:14:37] "OPTIONS / HTTP/1.0" 200 134 0.000444
Sep 28 12:14:37 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:14:37.482 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:14:37] "OPTIONS / HTTP/1.0" 200 134 0.000412
Sep 28 12:14:37 ctl02 nova-api[25743]: 2017-09-28 12:14:37.535 25743 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:14:37 ctl02 nova-api[25743]: 2017-09-28 12:14:37.537 25743 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:14:37 ctl02 nova-api[25743]: 2017-09-28 12:14:37.537 25743 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:14:37 ctl02 nova-api[25743]: 2017-09-28 12:14:37.537 25743 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:14:37 ctl02 nova-api[25743]: 2017-09-28 12:14:37.541 25743 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:14:37 ctl02 nova-api[25743]: 2017-09-28 12:14:37.541 25743 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:14:37 ctl02 nova-api[25743]: 2017-09-28 12:14:37.541 25743 ERROR nova Traceback (most recent call last):
Sep 28 12:14:37 ctl02 nova-api[25743]: 2017-09-28 12:14:37.541 25743 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:14:37 ctl02 nova-api[25743]: 2017-09-28 12:14:37.541 25743 ERROR nova     sys.exit(main())
Sep 28 12:14:37 ctl02 nova-api[25743]: 2017-09-28 12:14:37.541 25743 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:14:37 ctl02 nova-api[25743]: 2017-09-28 12:14:37.541 25743 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:14:37 ctl02 nova-api[25743]: 2017-09-28 12:14:37.541 25743 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:14:37 ctl02 nova-api[25743]: 2017-09-28 12:14:37.541 25743 ERROR nova     max_url_len=max_url_len)
Sep 28 12:14:37 ctl02 nova-api[25743]: 2017-09-28 12:14:37.541 25743 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:14:37 ctl02 nova-api[25743]: 2017-09-28 12:14:37.541 25743 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:14:37 ctl02 nova-api[25743]: 2017-09-28 12:14:37.541 25743 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:14:37 ctl02 nova-api[25743]: 2017-09-28 12:14:37.541 25743 ERROR nova     sock.listen(backlog)
Sep 28 12:14:37 ctl02 nova-api[25743]: 2017-09-28 12:14:37.541 25743 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:14:37 ctl02 nova-api[25743]: 2017-09-28 12:14:37.541 25743 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:14:37 ctl02 nova-api[25743]: 2017-09-28 12:14:37.541 25743 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:14:37 ctl02 nova-api[25743]: 2017-09-28 12:14:37.541 25743 ERROR nova
Sep 28 12:14:37 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:14:37 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:14:37 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:14:37 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:14:37 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:14:37 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:14:37 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:14:38 ctl02 nova-consoleauth[5433]: 2017-09-28 12:14:38.552 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:14:39 ctl02 nova-api[25762]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:14:39 ctl02 nova-api[25762]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:14:39 ctl02 heat-api[13008]: 2017-09-28 12:14:39.659 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:14:39] "OPTIONS / HTTP/1.0" 200 134 0.000639
Sep 28 12:14:39 ctl02 nova-api[25762]: 2017-09-28 12:14:39.754 25762 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:14:39 ctl02 nova-api[25762]: 2017-09-28 12:14:39.756 25762 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:14:39 ctl02 nova-api[25762]: 2017-09-28 12:14:39.756 25762 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:14:39 ctl02 nova-api[25762]: 2017-09-28 12:14:39.756 25762 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:14:39 ctl02 nova-api[25762]: 2017-09-28 12:14:39.756 25762 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:14:39 ctl02 nova-api[25762]: 2017-09-28 12:14:39.756 25762 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:14:39 ctl02 nova-api[25762]: 2017-09-28 12:14:39.756 25762 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:14:39 ctl02 nova-api[25762]: 2017-09-28 12:14:39.756 25762 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:14:39 ctl02 nova-api[25762]: 2017-09-28 12:14:39.756 25762 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:14:39 ctl02 nova-api[25762]: 2017-09-28 12:14:39.756 25762 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:14:39 ctl02 nova-api[25762]: 2017-09-28 12:14:39.756 25762 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:14:39 ctl02 nova-api[25762]: 2017-09-28 12:14:39.756 25762 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:14:39 ctl02 nova-api[25762]: 2017-09-28 12:14:39.756 25762 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:14:39 ctl02 nova-api[25762]: 2017-09-28 12:14:39.756 25762 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:14:39 ctl02 nova-api[25762]: 2017-09-28 12:14:39.756 25762 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:14:39 ctl02 nova-api[25762]: 2017-09-28 12:14:39.756 25762 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:14:39 ctl02 nova-api[25762]: 2017-09-28 12:14:39.756 25762 ERROR nova.wsgi     self.filename))
Sep 28 12:14:39 ctl02 nova-api[25762]: 2017-09-28 12:14:39.756 25762 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:14:39 ctl02 nova-api[25762]: 2017-09-28 12:14:39.756 25762 ERROR nova.wsgi
Sep 28 12:14:39 ctl02 nova-api[25762]: 2017-09-28 12:14:39.757 25762 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:14:39 ctl02 nova-api[25762]: 2017-09-28 12:14:39.891 25762 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:14:40 ctl02 nova-api[25762]: 2017-09-28 12:14:40.138 25762 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:14:40 ctl02 nova-api[25762]: 2017-09-28 12:14:40.141 25762 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:14:40 ctl02 nova-api[25762]: 2017-09-28 12:14:40.141 25762 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:14:40 ctl02 nova-api[25762]: 2017-09-28 12:14:40.141 25762 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:14:40 ctl02 nova-api[25762]: 2017-09-28 12:14:40.277 25762 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:14:40 ctl02 nova-api[25762]: 2017-09-28 12:14:40.279 25762 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:14:40 ctl02 nova-api[25762]: 2017-09-28 12:14:40.279 25762 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:14:40 ctl02 nova-api[25762]: 2017-09-28 12:14:40.280 25762 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:14:40 ctl02 nova-api[25762]: 2017-09-28 12:14:40.283 25762 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:14:40 ctl02 nova-api[25762]: 2017-09-28 12:14:40.283 25762 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:14:40 ctl02 nova-api[25762]: 2017-09-28 12:14:40.283 25762 ERROR nova Traceback (most recent call last):
Sep 28 12:14:40 ctl02 nova-api[25762]: 2017-09-28 12:14:40.283 25762 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:14:40 ctl02 nova-api[25762]: 2017-09-28 12:14:40.283 25762 ERROR nova     sys.exit(main())
Sep 28 12:14:40 ctl02 nova-api[25762]: 2017-09-28 12:14:40.283 25762 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:14:40 ctl02 nova-api[25762]: 2017-09-28 12:14:40.283 25762 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:14:40 ctl02 nova-api[25762]: 2017-09-28 12:14:40.283 25762 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:14:40 ctl02 nova-api[25762]: 2017-09-28 12:14:40.283 25762 ERROR nova     max_url_len=max_url_len)
Sep 28 12:14:40 ctl02 nova-api[25762]: 2017-09-28 12:14:40.283 25762 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:14:40 ctl02 nova-api[25762]: 2017-09-28 12:14:40.283 25762 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:14:40 ctl02 nova-api[25762]: 2017-09-28 12:14:40.283 25762 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:14:40 ctl02 nova-api[25762]: 2017-09-28 12:14:40.283 25762 ERROR nova     sock.listen(backlog)
Sep 28 12:14:40 ctl02 nova-api[25762]: 2017-09-28 12:14:40.283 25762 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:14:40 ctl02 nova-api[25762]: 2017-09-28 12:14:40.283 25762 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:14:40 ctl02 nova-api[25762]: 2017-09-28 12:14:40.283 25762 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:14:40 ctl02 nova-api[25762]: 2017-09-28 12:14:40.283 25762 ERROR nova
Sep 28 12:14:40 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:14:40 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:14:40 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:14:40 ctl02 heat-api-cfn[13300]: 2017-09-28 12:14:40.556 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:14:40] "OPTIONS / HTTP/1.0" 200 134 0.000652
Sep 28 12:14:40 ctl02 glance-api[29183]: 2017-09-28 12:14:40.620 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:14:40] "OPTIONS / HTTP/1.0" 200 134 0.000727
Sep 28 12:14:40 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:14:40 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:14:40 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:14:40 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:14:41 ctl02 heat-engine[12803]: 2017-09-28 12:14:41.546 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:14:41 ctl02 heat-engine[12803]: 2017-09-28 12:14:41.573 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:14:41 ctl02 nova-scheduler[5620]: 2017-09-28 12:14:41.577 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:14:41 ctl02 heat-engine[12803]: 2017-09-28 12:14:41.587 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:14:41 ctl02 heat-engine[12803]: 2017-09-28 12:14:41.598 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:14:41 ctl02 heat-api-cfn[13300]: 2017-09-28 12:14:41.610 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:14:41] "OPTIONS / HTTP/1.0" 200 134 0.000541
Sep 28 12:14:42 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:14:42.205 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:14:42] "OPTIONS / HTTP/1.0" 200 134 0.000502
Sep 28 12:14:42 ctl02 nova-api[25780]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:14:42 ctl02 nova-api[25780]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:14:42 ctl02 nova-api[25780]: 2017-09-28 12:14:42.497 25780 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:14:42 ctl02 nova-api[25780]: 2017-09-28 12:14:42.499 25780 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:14:42 ctl02 nova-api[25780]: 2017-09-28 12:14:42.499 25780 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:14:42 ctl02 nova-api[25780]: 2017-09-28 12:14:42.499 25780 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:14:42 ctl02 nova-api[25780]: 2017-09-28 12:14:42.499 25780 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:14:42 ctl02 nova-api[25780]: 2017-09-28 12:14:42.499 25780 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:14:42 ctl02 nova-api[25780]: 2017-09-28 12:14:42.499 25780 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:14:42 ctl02 nova-api[25780]: 2017-09-28 12:14:42.499 25780 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:14:42 ctl02 nova-api[25780]: 2017-09-28 12:14:42.499 25780 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:14:42 ctl02 nova-api[25780]: 2017-09-28 12:14:42.499 25780 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:14:42 ctl02 nova-api[25780]: 2017-09-28 12:14:42.499 25780 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:14:42 ctl02 nova-api[25780]: 2017-09-28 12:14:42.499 25780 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:14:42 ctl02 nova-api[25780]: 2017-09-28 12:14:42.499 25780 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:14:42 ctl02 nova-api[25780]: 2017-09-28 12:14:42.499 25780 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:14:42 ctl02 nova-api[25780]: 2017-09-28 12:14:42.499 25780 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:14:42 ctl02 nova-api[25780]: 2017-09-28 12:14:42.499 25780 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:14:42 ctl02 nova-api[25780]: 2017-09-28 12:14:42.499 25780 ERROR nova.wsgi     self.filename))
Sep 28 12:14:42 ctl02 nova-api[25780]: 2017-09-28 12:14:42.499 25780 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:14:42 ctl02 nova-api[25780]: 2017-09-28 12:14:42.499 25780 ERROR nova.wsgi
Sep 28 12:14:42 ctl02 nova-api[25780]: 2017-09-28 12:14:42.501 25780 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:14:42 ctl02 nova-api[25780]: 2017-09-28 12:14:42.635 25780 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:14:42 ctl02 nova-api[25780]: 2017-09-28 12:14:42.885 25780 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:14:42 ctl02 nova-api[25780]: 2017-09-28 12:14:42.887 25780 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:14:42 ctl02 nova-api[25780]: 2017-09-28 12:14:42.887 25780 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:14:42 ctl02 nova-api[25780]: 2017-09-28 12:14:42.888 25780 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:14:43 ctl02 nova-api[25780]: 2017-09-28 12:14:43.020 25780 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:14:43 ctl02 nova-api[25780]: 2017-09-28 12:14:43.022 25780 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:14:43 ctl02 nova-api[25780]: 2017-09-28 12:14:43.022 25780 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:14:43 ctl02 nova-api[25780]: 2017-09-28 12:14:43.023 25780 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:14:43 ctl02 nova-api[25780]: 2017-09-28 12:14:43.026 25780 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:14:43 ctl02 nova-api[25780]: 2017-09-28 12:14:43.026 25780 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:14:43 ctl02 nova-api[25780]: 2017-09-28 12:14:43.026 25780 ERROR nova Traceback (most recent call last):
Sep 28 12:14:43 ctl02 nova-api[25780]: 2017-09-28 12:14:43.026 25780 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:14:43 ctl02 nova-api[25780]: 2017-09-28 12:14:43.026 25780 ERROR nova     sys.exit(main())
Sep 28 12:14:43 ctl02 nova-api[25780]: 2017-09-28 12:14:43.026 25780 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:14:43 ctl02 nova-api[25780]: 2017-09-28 12:14:43.026 25780 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:14:43 ctl02 nova-api[25780]: 2017-09-28 12:14:43.026 25780 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:14:43 ctl02 nova-api[25780]: 2017-09-28 12:14:43.026 25780 ERROR nova     max_url_len=max_url_len)
Sep 28 12:14:43 ctl02 nova-api[25780]: 2017-09-28 12:14:43.026 25780 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:14:43 ctl02 nova-api[25780]: 2017-09-28 12:14:43.026 25780 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:14:43 ctl02 nova-api[25780]: 2017-09-28 12:14:43.026 25780 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:14:43 ctl02 nova-api[25780]: 2017-09-28 12:14:43.026 25780 ERROR nova     sock.listen(backlog)
Sep 28 12:14:43 ctl02 nova-api[25780]: 2017-09-28 12:14:43.026 25780 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:14:43 ctl02 nova-api[25780]: 2017-09-28 12:14:43.026 25780 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:14:43 ctl02 nova-api[25780]: 2017-09-28 12:14:43.026 25780 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:14:43 ctl02 nova-api[25780]: 2017-09-28 12:14:43.026 25780 ERROR nova
Sep 28 12:14:43 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:14:43 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:14:43 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:14:43 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:14:43 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:14:43 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:14:43 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:14:43 ctl02 glance-api[29183]: 2017-09-28 12:14:43.483 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:14:43] "OPTIONS / HTTP/1.0" 200 134 0.000691
Sep 28 12:14:44 ctl02 heat-api-cfn[13300]: 2017-09-28 12:14:44.007 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:14:44] "OPTIONS / HTTP/1.0" 200 134 0.000576
Sep 28 12:14:44 ctl02 heat-api[13008]: 2017-09-28 12:14:44.050 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:14:44] "OPTIONS / HTTP/1.0" 200 134 0.000588
Sep 28 12:14:44 ctl02 glance-api[29183]: 2017-09-28 12:14:44.171 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:14:44] "OPTIONS / HTTP/1.0" 200 134 0.000657
Sep 28 12:14:45 ctl02 nova-api[25798]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:14:45 ctl02 nova-api[25798]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:14:45 ctl02 nova-api[25798]: 2017-09-28 12:14:45.232 25798 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:14:45 ctl02 nova-api[25798]: 2017-09-28 12:14:45.234 25798 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:14:45 ctl02 nova-api[25798]: 2017-09-28 12:14:45.234 25798 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:14:45 ctl02 nova-api[25798]: 2017-09-28 12:14:45.234 25798 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:14:45 ctl02 nova-api[25798]: 2017-09-28 12:14:45.234 25798 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:14:45 ctl02 nova-api[25798]: 2017-09-28 12:14:45.234 25798 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:14:45 ctl02 nova-api[25798]: 2017-09-28 12:14:45.234 25798 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:14:45 ctl02 nova-api[25798]: 2017-09-28 12:14:45.234 25798 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:14:45 ctl02 nova-api[25798]: 2017-09-28 12:14:45.234 25798 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:14:45 ctl02 nova-api[25798]: 2017-09-28 12:14:45.234 25798 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:14:45 ctl02 nova-api[25798]: 2017-09-28 12:14:45.234 25798 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:14:45 ctl02 nova-api[25798]: 2017-09-28 12:14:45.234 25798 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:14:45 ctl02 nova-api[25798]: 2017-09-28 12:14:45.234 25798 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:14:45 ctl02 nova-api[25798]: 2017-09-28 12:14:45.234 25798 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:14:45 ctl02 nova-api[25798]: 2017-09-28 12:14:45.234 25798 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:14:45 ctl02 nova-api[25798]: 2017-09-28 12:14:45.234 25798 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:14:45 ctl02 nova-api[25798]: 2017-09-28 12:14:45.234 25798 ERROR nova.wsgi     self.filename))
Sep 28 12:14:45 ctl02 nova-api[25798]: 2017-09-28 12:14:45.234 25798 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:14:45 ctl02 nova-api[25798]: 2017-09-28 12:14:45.234 25798 ERROR nova.wsgi
Sep 28 12:14:45 ctl02 nova-api[25798]: 2017-09-28 12:14:45.235 25798 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:14:45 ctl02 heat-api[13008]: 2017-09-28 12:14:45.252 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:14:45] "OPTIONS / HTTP/1.0" 200 134 0.000726
Sep 28 12:14:45 ctl02 nova-api[25798]: 2017-09-28 12:14:45.373 25798 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:14:45 ctl02 nova-api[25798]: 2017-09-28 12:14:45.623 25798 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:14:45 ctl02 nova-api[25798]: 2017-09-28 12:14:45.625 25798 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:14:45 ctl02 nova-api[25798]: 2017-09-28 12:14:45.626 25798 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:14:45 ctl02 nova-api[25798]: 2017-09-28 12:14:45.626 25798 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:14:45 ctl02 nova-api[25798]: 2017-09-28 12:14:45.758 25798 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:14:45 ctl02 nova-api[25798]: 2017-09-28 12:14:45.760 25798 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:14:45 ctl02 nova-api[25798]: 2017-09-28 12:14:45.760 25798 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:14:45 ctl02 nova-api[25798]: 2017-09-28 12:14:45.761 25798 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:14:45 ctl02 nova-api[25798]: 2017-09-28 12:14:45.764 25798 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:14:45 ctl02 nova-api[25798]: 2017-09-28 12:14:45.764 25798 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:14:45 ctl02 nova-api[25798]: 2017-09-28 12:14:45.764 25798 ERROR nova Traceback (most recent call last):
Sep 28 12:14:45 ctl02 nova-api[25798]: 2017-09-28 12:14:45.764 25798 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:14:45 ctl02 nova-api[25798]: 2017-09-28 12:14:45.764 25798 ERROR nova     sys.exit(main())
Sep 28 12:14:45 ctl02 nova-api[25798]: 2017-09-28 12:14:45.764 25798 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:14:45 ctl02 nova-api[25798]: 2017-09-28 12:14:45.764 25798 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:14:45 ctl02 nova-api[25798]: 2017-09-28 12:14:45.764 25798 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:14:45 ctl02 nova-api[25798]: 2017-09-28 12:14:45.764 25798 ERROR nova     max_url_len=max_url_len)
Sep 28 12:14:45 ctl02 nova-api[25798]: 2017-09-28 12:14:45.764 25798 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:14:45 ctl02 nova-api[25798]: 2017-09-28 12:14:45.764 25798 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:14:45 ctl02 nova-api[25798]: 2017-09-28 12:14:45.764 25798 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:14:45 ctl02 nova-api[25798]: 2017-09-28 12:14:45.764 25798 ERROR nova     sock.listen(backlog)
Sep 28 12:14:45 ctl02 nova-api[25798]: 2017-09-28 12:14:45.764 25798 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:14:45 ctl02 nova-api[25798]: 2017-09-28 12:14:45.764 25798 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:14:45 ctl02 nova-api[25798]: 2017-09-28 12:14:45.764 25798 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:14:45 ctl02 nova-api[25798]: 2017-09-28 12:14:45.764 25798 ERROR nova
Sep 28 12:14:45 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:14:45 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:14:45 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:14:46 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:14:46 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:14:46 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:14:46 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:14:47 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:14:47.446 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:14:47] "OPTIONS / HTTP/1.0" 200 134 0.000503
Sep 28 12:14:47 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:14:47.714 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:14:47] "OPTIONS / HTTP/1.0" 200 134 0.000312
Sep 28 12:14:47 ctl02 nova-api[25815]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:14:47 ctl02 nova-api[25815]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:14:47 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfd34a232)
Sep 28 12:14:47 ctl02 nova-api[25815]: 2017-09-28 12:14:47.983 25815 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:14:47 ctl02 nova-api[25815]: 2017-09-28 12:14:47.986 25815 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:14:47 ctl02 nova-api[25815]: 2017-09-28 12:14:47.986 25815 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:14:47 ctl02 nova-api[25815]: 2017-09-28 12:14:47.986 25815 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:14:47 ctl02 nova-api[25815]: 2017-09-28 12:14:47.986 25815 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:14:47 ctl02 nova-api[25815]: 2017-09-28 12:14:47.986 25815 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:14:47 ctl02 nova-api[25815]: 2017-09-28 12:14:47.986 25815 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:14:47 ctl02 nova-api[25815]: 2017-09-28 12:14:47.986 25815 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:14:47 ctl02 nova-api[25815]: 2017-09-28 12:14:47.986 25815 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:14:47 ctl02 nova-api[25815]: 2017-09-28 12:14:47.986 25815 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:14:47 ctl02 nova-api[25815]: 2017-09-28 12:14:47.986 25815 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:14:47 ctl02 nova-api[25815]: 2017-09-28 12:14:47.986 25815 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:14:47 ctl02 nova-api[25815]: 2017-09-28 12:14:47.986 25815 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:14:47 ctl02 nova-api[25815]: 2017-09-28 12:14:47.986 25815 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:14:47 ctl02 nova-api[25815]: 2017-09-28 12:14:47.986 25815 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:14:47 ctl02 nova-api[25815]: 2017-09-28 12:14:47.986 25815 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:14:47 ctl02 nova-api[25815]: 2017-09-28 12:14:47.986 25815 ERROR nova.wsgi     self.filename))
Sep 28 12:14:47 ctl02 nova-api[25815]: 2017-09-28 12:14:47.986 25815 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:14:47 ctl02 nova-api[25815]: 2017-09-28 12:14:47.986 25815 ERROR nova.wsgi
Sep 28 12:14:47 ctl02 nova-api[25815]: 2017-09-28 12:14:47.988 25815 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:14:48 ctl02 nova-api[25815]: 2017-09-28 12:14:48.121 25815 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:14:48 ctl02 nova-api[25815]: 2017-09-28 12:14:48.371 25815 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:14:48 ctl02 nova-api[25815]: 2017-09-28 12:14:48.373 25815 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:14:48 ctl02 nova-api[25815]: 2017-09-28 12:14:48.374 25815 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:14:48 ctl02 nova-api[25815]: 2017-09-28 12:14:48.374 25815 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:14:48 ctl02 nova-api[25815]: 2017-09-28 12:14:48.508 25815 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:14:48 ctl02 nova-api[25815]: 2017-09-28 12:14:48.510 25815 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:14:48 ctl02 nova-api[25815]: 2017-09-28 12:14:48.510 25815 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:14:48 ctl02 nova-api[25815]: 2017-09-28 12:14:48.511 25815 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:14:48 ctl02 nova-api[25815]: 2017-09-28 12:14:48.514 25815 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:14:48 ctl02 nova-api[25815]: 2017-09-28 12:14:48.514 25815 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:14:48 ctl02 nova-api[25815]: 2017-09-28 12:14:48.514 25815 ERROR nova Traceback (most recent call last):
Sep 28 12:14:48 ctl02 nova-api[25815]: 2017-09-28 12:14:48.514 25815 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:14:48 ctl02 nova-api[25815]: 2017-09-28 12:14:48.514 25815 ERROR nova     sys.exit(main())
Sep 28 12:14:48 ctl02 nova-api[25815]: 2017-09-28 12:14:48.514 25815 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:14:48 ctl02 nova-api[25815]: 2017-09-28 12:14:48.514 25815 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:14:48 ctl02 nova-api[25815]: 2017-09-28 12:14:48.514 25815 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:14:48 ctl02 nova-api[25815]: 2017-09-28 12:14:48.514 25815 ERROR nova     max_url_len=max_url_len)
Sep 28 12:14:48 ctl02 nova-api[25815]: 2017-09-28 12:14:48.514 25815 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:14:48 ctl02 nova-api[25815]: 2017-09-28 12:14:48.514 25815 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:14:48 ctl02 nova-api[25815]: 2017-09-28 12:14:48.514 25815 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:14:48 ctl02 nova-api[25815]: 2017-09-28 12:14:48.514 25815 ERROR nova     sock.listen(backlog)
Sep 28 12:14:48 ctl02 nova-api[25815]: 2017-09-28 12:14:48.514 25815 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:14:48 ctl02 nova-api[25815]: 2017-09-28 12:14:48.514 25815 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:14:48 ctl02 nova-api[25815]: 2017-09-28 12:14:48.514 25815 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:14:48 ctl02 nova-api[25815]: 2017-09-28 12:14:48.514 25815 ERROR nova
Sep 28 12:14:48 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:14:48 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:14:48 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:14:48 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfd34a232)
Sep 28 12:14:48 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:14:48 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:14:48 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:14:48 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:14:49 ctl02 heat-api[13008]: 2017-09-28 12:14:49.498 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:14:49] "OPTIONS / HTTP/1.0" 200 134 0.000643
Sep 28 12:14:49 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfd34a232)
Sep 28 12:14:50 ctl02 nova-api[25834]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:14:50 ctl02 nova-api[25834]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:14:50 ctl02 glance-api[29183]: 2017-09-28 12:14:50.573 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:14:50] "OPTIONS / HTTP/1.0" 200 134 0.000666
Sep 28 12:14:50 ctl02 heat-api-cfn[13300]: 2017-09-28 12:14:50.677 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:14:50] "OPTIONS / HTTP/1.0" 200 134 0.000519
Sep 28 12:14:50 ctl02 nova-api[25834]: 2017-09-28 12:14:50.739 25834 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:14:50 ctl02 nova-api[25834]: 2017-09-28 12:14:50.741 25834 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:14:50 ctl02 nova-api[25834]: 2017-09-28 12:14:50.741 25834 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:14:50 ctl02 nova-api[25834]: 2017-09-28 12:14:50.741 25834 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:14:50 ctl02 nova-api[25834]: 2017-09-28 12:14:50.741 25834 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:14:50 ctl02 nova-api[25834]: 2017-09-28 12:14:50.741 25834 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:14:50 ctl02 nova-api[25834]: 2017-09-28 12:14:50.741 25834 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:14:50 ctl02 nova-api[25834]: 2017-09-28 12:14:50.741 25834 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:14:50 ctl02 nova-api[25834]: 2017-09-28 12:14:50.741 25834 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:14:50 ctl02 nova-api[25834]: 2017-09-28 12:14:50.741 25834 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:14:50 ctl02 nova-api[25834]: 2017-09-28 12:14:50.741 25834 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:14:50 ctl02 nova-api[25834]: 2017-09-28 12:14:50.741 25834 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:14:50 ctl02 nova-api[25834]: 2017-09-28 12:14:50.741 25834 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:14:50 ctl02 nova-api[25834]: 2017-09-28 12:14:50.741 25834 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:14:50 ctl02 nova-api[25834]: 2017-09-28 12:14:50.741 25834 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:14:50 ctl02 nova-api[25834]: 2017-09-28 12:14:50.741 25834 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:14:50 ctl02 nova-api[25834]: 2017-09-28 12:14:50.741 25834 ERROR nova.wsgi     self.filename))
Sep 28 12:14:50 ctl02 nova-api[25834]: 2017-09-28 12:14:50.741 25834 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:14:50 ctl02 nova-api[25834]: 2017-09-28 12:14:50.741 25834 ERROR nova.wsgi
Sep 28 12:14:50 ctl02 nova-api[25834]: 2017-09-28 12:14:50.742 25834 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:14:50 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfd34a232)
Sep 28 12:14:50 ctl02 nova-api[25834]: 2017-09-28 12:14:50.886 25834 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:14:51 ctl02 nova-api[25834]: 2017-09-28 12:14:51.126 25834 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:14:51 ctl02 nova-api[25834]: 2017-09-28 12:14:51.129 25834 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:14:51 ctl02 nova-api[25834]: 2017-09-28 12:14:51.129 25834 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:14:51 ctl02 nova-api[25834]: 2017-09-28 12:14:51.129 25834 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:14:51 ctl02 nova-api[25834]: 2017-09-28 12:14:51.261 25834 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:14:51 ctl02 nova-api[25834]: 2017-09-28 12:14:51.262 25834 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:14:51 ctl02 nova-api[25834]: 2017-09-28 12:14:51.263 25834 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:14:51 ctl02 nova-api[25834]: 2017-09-28 12:14:51.263 25834 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:14:51 ctl02 nova-api[25834]: 2017-09-28 12:14:51.266 25834 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:14:51 ctl02 nova-api[25834]: 2017-09-28 12:14:51.266 25834 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:14:51 ctl02 nova-api[25834]: 2017-09-28 12:14:51.266 25834 ERROR nova Traceback (most recent call last):
Sep 28 12:14:51 ctl02 nova-api[25834]: 2017-09-28 12:14:51.266 25834 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:14:51 ctl02 nova-api[25834]: 2017-09-28 12:14:51.266 25834 ERROR nova     sys.exit(main())
Sep 28 12:14:51 ctl02 nova-api[25834]: 2017-09-28 12:14:51.266 25834 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:14:51 ctl02 nova-api[25834]: 2017-09-28 12:14:51.266 25834 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:14:51 ctl02 nova-api[25834]: 2017-09-28 12:14:51.266 25834 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:14:51 ctl02 nova-api[25834]: 2017-09-28 12:14:51.266 25834 ERROR nova     max_url_len=max_url_len)
Sep 28 12:14:51 ctl02 nova-api[25834]: 2017-09-28 12:14:51.266 25834 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:14:51 ctl02 nova-api[25834]: 2017-09-28 12:14:51.266 25834 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:14:51 ctl02 nova-api[25834]: 2017-09-28 12:14:51.266 25834 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:14:51 ctl02 nova-api[25834]: 2017-09-28 12:14:51.266 25834 ERROR nova     sock.listen(backlog)
Sep 28 12:14:51 ctl02 nova-api[25834]: 2017-09-28 12:14:51.266 25834 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:14:51 ctl02 nova-api[25834]: 2017-09-28 12:14:51.266 25834 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:14:51 ctl02 nova-api[25834]: 2017-09-28 12:14:51.266 25834 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:14:51 ctl02 nova-api[25834]: 2017-09-28 12:14:51.266 25834 ERROR nova
Sep 28 12:14:51 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:14:51 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:14:51 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:14:51 ctl02 heat-api-cfn[13300]: 2017-09-28 12:14:51.532 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:14:51] "OPTIONS / HTTP/1.0" 200 134 0.000551
Sep 28 12:14:51 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:14:51 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:14:51 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:14:51 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:14:51 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfd34a232)
Sep 28 12:14:52 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:14:52.298 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:14:52] "OPTIONS / HTTP/1.0" 200 134 0.000480
Sep 28 12:14:52 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfd34a232)
Sep 28 12:14:53 ctl02 nova-api[25852]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:14:53 ctl02 nova-api[25852]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:14:53 ctl02 nova-api[25852]: 2017-09-28 12:14:53.492 25852 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:14:53 ctl02 nova-api[25852]: 2017-09-28 12:14:53.494 25852 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:14:53 ctl02 nova-api[25852]: 2017-09-28 12:14:53.494 25852 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:14:53 ctl02 nova-api[25852]: 2017-09-28 12:14:53.494 25852 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:14:53 ctl02 nova-api[25852]: 2017-09-28 12:14:53.494 25852 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:14:53 ctl02 nova-api[25852]: 2017-09-28 12:14:53.494 25852 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:14:53 ctl02 nova-api[25852]: 2017-09-28 12:14:53.494 25852 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:14:53 ctl02 nova-api[25852]: 2017-09-28 12:14:53.494 25852 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:14:53 ctl02 nova-api[25852]: 2017-09-28 12:14:53.494 25852 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:14:53 ctl02 nova-api[25852]: 2017-09-28 12:14:53.494 25852 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:14:53 ctl02 nova-api[25852]: 2017-09-28 12:14:53.494 25852 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:14:53 ctl02 nova-api[25852]: 2017-09-28 12:14:53.494 25852 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:14:53 ctl02 nova-api[25852]: 2017-09-28 12:14:53.494 25852 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:14:53 ctl02 nova-api[25852]: 2017-09-28 12:14:53.494 25852 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:14:53 ctl02 nova-api[25852]: 2017-09-28 12:14:53.494 25852 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:14:53 ctl02 nova-api[25852]: 2017-09-28 12:14:53.494 25852 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:14:53 ctl02 nova-api[25852]: 2017-09-28 12:14:53.494 25852 ERROR nova.wsgi     self.filename))
Sep 28 12:14:53 ctl02 nova-api[25852]: 2017-09-28 12:14:53.494 25852 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:14:53 ctl02 nova-api[25852]: 2017-09-28 12:14:53.494 25852 ERROR nova.wsgi
Sep 28 12:14:53 ctl02 nova-api[25852]: 2017-09-28 12:14:53.497 25852 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:14:53 ctl02 glance-api[29183]: 2017-09-28 12:14:53.623 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:14:53] "OPTIONS / HTTP/1.0" 200 134 0.000640
Sep 28 12:14:53 ctl02 nova-api[25852]: 2017-09-28 12:14:53.635 25852 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:14:53 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfd34a232)
Sep 28 12:14:53 ctl02 nova-api[25852]: 2017-09-28 12:14:53.891 25852 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:14:53 ctl02 nova-api[25852]: 2017-09-28 12:14:53.894 25852 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:14:53 ctl02 nova-api[25852]: 2017-09-28 12:14:53.894 25852 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:14:53 ctl02 nova-api[25852]: 2017-09-28 12:14:53.894 25852 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:14:54 ctl02 nova-api[25852]: 2017-09-28 12:14:54.029 25852 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:14:54 ctl02 nova-api[25852]: 2017-09-28 12:14:54.031 25852 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:14:54 ctl02 nova-api[25852]: 2017-09-28 12:14:54.031 25852 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:14:54 ctl02 nova-api[25852]: 2017-09-28 12:14:54.031 25852 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:14:54 ctl02 nova-api[25852]: 2017-09-28 12:14:54.035 25852 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:14:54 ctl02 nova-api[25852]: 2017-09-28 12:14:54.035 25852 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:14:54 ctl02 nova-api[25852]: 2017-09-28 12:14:54.035 25852 ERROR nova Traceback (most recent call last):
Sep 28 12:14:54 ctl02 nova-api[25852]: 2017-09-28 12:14:54.035 25852 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:14:54 ctl02 nova-api[25852]: 2017-09-28 12:14:54.035 25852 ERROR nova     sys.exit(main())
Sep 28 12:14:54 ctl02 nova-api[25852]: 2017-09-28 12:14:54.035 25852 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:14:54 ctl02 nova-api[25852]: 2017-09-28 12:14:54.035 25852 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:14:54 ctl02 nova-api[25852]: 2017-09-28 12:14:54.035 25852 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:14:54 ctl02 nova-api[25852]: 2017-09-28 12:14:54.035 25852 ERROR nova     max_url_len=max_url_len)
Sep 28 12:14:54 ctl02 nova-api[25852]: 2017-09-28 12:14:54.035 25852 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:14:54 ctl02 nova-api[25852]: 2017-09-28 12:14:54.035 25852 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:14:54 ctl02 nova-api[25852]: 2017-09-28 12:14:54.035 25852 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:14:54 ctl02 nova-api[25852]: 2017-09-28 12:14:54.035 25852 ERROR nova     sock.listen(backlog)
Sep 28 12:14:54 ctl02 nova-api[25852]: 2017-09-28 12:14:54.035 25852 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:14:54 ctl02 nova-api[25852]: 2017-09-28 12:14:54.035 25852 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:14:54 ctl02 nova-api[25852]: 2017-09-28 12:14:54.035 25852 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:14:54 ctl02 nova-api[25852]: 2017-09-28 12:14:54.035 25852 ERROR nova
Sep 28 12:14:54 ctl02 heat-api-cfn[13300]: 2017-09-28 12:14:54.060 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:14:54] "OPTIONS / HTTP/1.0" 200 134 0.000583
Sep 28 12:14:54 ctl02 heat-api[13008]: 2017-09-28 12:14:54.060 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:14:54] "OPTIONS / HTTP/1.0" 200 134 0.000644
Sep 28 12:14:54 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:14:54 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:14:54 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:14:54 ctl02 glance-api[29183]: 2017-09-28 12:14:54.232 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:14:54] "OPTIONS / HTTP/1.0" 200 134 0.000649
Sep 28 12:14:54 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:14:54 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:14:54 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:14:54 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:14:54 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfd34a232)
Sep 28 12:14:55 ctl02 heat-api[13008]: 2017-09-28 12:14:55.533 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:14:55] "OPTIONS / HTTP/1.0" 200 134 0.000643
Sep 28 12:14:55 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfd34a232)
Sep 28 12:14:56 ctl02 nova-api[25870]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:14:56 ctl02 nova-api[25870]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:14:56 ctl02 nova-api[25870]: 2017-09-28 12:14:56.239 25870 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:14:56 ctl02 nova-api[25870]: 2017-09-28 12:14:56.241 25870 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:14:56 ctl02 nova-api[25870]: 2017-09-28 12:14:56.241 25870 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:14:56 ctl02 nova-api[25870]: 2017-09-28 12:14:56.241 25870 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:14:56 ctl02 nova-api[25870]: 2017-09-28 12:14:56.241 25870 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:14:56 ctl02 nova-api[25870]: 2017-09-28 12:14:56.241 25870 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:14:56 ctl02 nova-api[25870]: 2017-09-28 12:14:56.241 25870 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:14:56 ctl02 nova-api[25870]: 2017-09-28 12:14:56.241 25870 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:14:56 ctl02 nova-api[25870]: 2017-09-28 12:14:56.241 25870 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:14:56 ctl02 nova-api[25870]: 2017-09-28 12:14:56.241 25870 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:14:56 ctl02 nova-api[25870]: 2017-09-28 12:14:56.241 25870 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:14:56 ctl02 nova-api[25870]: 2017-09-28 12:14:56.241 25870 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:14:56 ctl02 nova-api[25870]: 2017-09-28 12:14:56.241 25870 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:14:56 ctl02 nova-api[25870]: 2017-09-28 12:14:56.241 25870 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:14:56 ctl02 nova-api[25870]: 2017-09-28 12:14:56.241 25870 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:14:56 ctl02 nova-api[25870]: 2017-09-28 12:14:56.241 25870 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:14:56 ctl02 nova-api[25870]: 2017-09-28 12:14:56.241 25870 ERROR nova.wsgi     self.filename))
Sep 28 12:14:56 ctl02 nova-api[25870]: 2017-09-28 12:14:56.241 25870 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:14:56 ctl02 nova-api[25870]: 2017-09-28 12:14:56.241 25870 ERROR nova.wsgi
Sep 28 12:14:56 ctl02 nova-api[25870]: 2017-09-28 12:14:56.242 25870 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:14:56 ctl02 nova-api[25870]: 2017-09-28 12:14:56.376 25870 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:14:56 ctl02 nova-api[25870]: 2017-09-28 12:14:56.630 25870 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:14:56 ctl02 nova-api[25870]: 2017-09-28 12:14:56.633 25870 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:14:56 ctl02 nova-api[25870]: 2017-09-28 12:14:56.633 25870 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:14:56 ctl02 nova-api[25870]: 2017-09-28 12:14:56.633 25870 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:14:56 ctl02 nova-api[25870]: 2017-09-28 12:14:56.767 25870 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:14:56 ctl02 nova-api[25870]: 2017-09-28 12:14:56.769 25870 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:14:56 ctl02 nova-api[25870]: 2017-09-28 12:14:56.769 25870 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:14:56 ctl02 nova-api[25870]: 2017-09-28 12:14:56.769 25870 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:14:56 ctl02 nova-api[25870]: 2017-09-28 12:14:56.773 25870 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:14:56 ctl02 nova-api[25870]: 2017-09-28 12:14:56.773 25870 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:14:56 ctl02 nova-api[25870]: 2017-09-28 12:14:56.773 25870 ERROR nova Traceback (most recent call last):
Sep 28 12:14:56 ctl02 nova-api[25870]: 2017-09-28 12:14:56.773 25870 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:14:56 ctl02 nova-api[25870]: 2017-09-28 12:14:56.773 25870 ERROR nova     sys.exit(main())
Sep 28 12:14:56 ctl02 nova-api[25870]: 2017-09-28 12:14:56.773 25870 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:14:56 ctl02 nova-api[25870]: 2017-09-28 12:14:56.773 25870 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:14:56 ctl02 nova-api[25870]: 2017-09-28 12:14:56.773 25870 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:14:56 ctl02 nova-api[25870]: 2017-09-28 12:14:56.773 25870 ERROR nova     max_url_len=max_url_len)
Sep 28 12:14:56 ctl02 nova-api[25870]: 2017-09-28 12:14:56.773 25870 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:14:56 ctl02 nova-api[25870]: 2017-09-28 12:14:56.773 25870 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:14:56 ctl02 nova-api[25870]: 2017-09-28 12:14:56.773 25870 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:14:56 ctl02 nova-api[25870]: 2017-09-28 12:14:56.773 25870 ERROR nova     sock.listen(backlog)
Sep 28 12:14:56 ctl02 nova-api[25870]: 2017-09-28 12:14:56.773 25870 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:14:56 ctl02 nova-api[25870]: 2017-09-28 12:14:56.773 25870 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:14:56 ctl02 nova-api[25870]: 2017-09-28 12:14:56.773 25870 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:14:56 ctl02 nova-api[25870]: 2017-09-28 12:14:56.773 25870 ERROR nova
Sep 28 12:14:56 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfd34a232)
Sep 28 12:14:56 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:14:56 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:14:56 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:14:57 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:14:57 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:14:57 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:14:57 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:14:57 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:14:57.719 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:14:57] "OPTIONS / HTTP/1.0" 200 134 0.000433
Sep 28 12:14:57 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfd34a232)
Sep 28 12:14:57 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:14:57.833 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:14:57] "OPTIONS / HTTP/1.0" 200 134 0.000511
Sep 28 12:14:58 ctl02 nova-api[25887]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:14:58 ctl02 nova-api[25887]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:14:58 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:14:58 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:14:58 ctl02 nova-api[25887]: 2017-09-28 12:14:58.986 25887 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:14:58 ctl02 nova-api[25887]: 2017-09-28 12:14:58.987 25887 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:14:58 ctl02 nova-api[25887]: 2017-09-28 12:14:58.987 25887 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:14:58 ctl02 nova-api[25887]: 2017-09-28 12:14:58.987 25887 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:14:58 ctl02 nova-api[25887]: 2017-09-28 12:14:58.987 25887 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:14:58 ctl02 nova-api[25887]: 2017-09-28 12:14:58.987 25887 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:14:58 ctl02 nova-api[25887]: 2017-09-28 12:14:58.987 25887 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:14:58 ctl02 nova-api[25887]: 2017-09-28 12:14:58.987 25887 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:14:58 ctl02 nova-api[25887]: 2017-09-28 12:14:58.987 25887 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:14:58 ctl02 nova-api[25887]: 2017-09-28 12:14:58.987 25887 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:14:58 ctl02 nova-api[25887]: 2017-09-28 12:14:58.987 25887 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:14:58 ctl02 nova-api[25887]: 2017-09-28 12:14:58.987 25887 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:14:58 ctl02 nova-api[25887]: 2017-09-28 12:14:58.987 25887 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:14:58 ctl02 nova-api[25887]: 2017-09-28 12:14:58.987 25887 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:14:58 ctl02 nova-api[25887]: 2017-09-28 12:14:58.987 25887 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:14:58 ctl02 nova-api[25887]: 2017-09-28 12:14:58.987 25887 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:14:58 ctl02 nova-api[25887]: 2017-09-28 12:14:58.987 25887 ERROR nova.wsgi     self.filename))
Sep 28 12:14:58 ctl02 nova-api[25887]: 2017-09-28 12:14:58.987 25887 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:14:58 ctl02 nova-api[25887]: 2017-09-28 12:14:58.987 25887 ERROR nova.wsgi
Sep 28 12:14:58 ctl02 nova-api[25887]: 2017-09-28 12:14:58.988 25887 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:14:59 ctl02 nova-api[25887]: 2017-09-28 12:14:59.122 25887 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:14:59 ctl02 nova-api[25887]: 2017-09-28 12:14:59.375 25887 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:14:59 ctl02 nova-api[25887]: 2017-09-28 12:14:59.377 25887 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:14:59 ctl02 nova-api[25887]: 2017-09-28 12:14:59.378 25887 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:14:59 ctl02 nova-api[25887]: 2017-09-28 12:14:59.378 25887 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:14:59 ctl02 nova-api[25887]: 2017-09-28 12:14:59.513 25887 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:14:59 ctl02 nova-api[25887]: 2017-09-28 12:14:59.516 25887 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:14:59 ctl02 nova-api[25887]: 2017-09-28 12:14:59.516 25887 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:14:59 ctl02 nova-api[25887]: 2017-09-28 12:14:59.516 25887 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:14:59 ctl02 nova-api[25887]: 2017-09-28 12:14:59.519 25887 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:14:59 ctl02 nova-api[25887]: 2017-09-28 12:14:59.520 25887 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:14:59 ctl02 nova-api[25887]: 2017-09-28 12:14:59.520 25887 ERROR nova Traceback (most recent call last):
Sep 28 12:14:59 ctl02 nova-api[25887]: 2017-09-28 12:14:59.520 25887 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:14:59 ctl02 nova-api[25887]: 2017-09-28 12:14:59.520 25887 ERROR nova     sys.exit(main())
Sep 28 12:14:59 ctl02 nova-api[25887]: 2017-09-28 12:14:59.520 25887 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:14:59 ctl02 nova-api[25887]: 2017-09-28 12:14:59.520 25887 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:14:59 ctl02 nova-api[25887]: 2017-09-28 12:14:59.520 25887 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:14:59 ctl02 nova-api[25887]: 2017-09-28 12:14:59.520 25887 ERROR nova     max_url_len=max_url_len)
Sep 28 12:14:59 ctl02 nova-api[25887]: 2017-09-28 12:14:59.520 25887 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:14:59 ctl02 nova-api[25887]: 2017-09-28 12:14:59.520 25887 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:14:59 ctl02 nova-api[25887]: 2017-09-28 12:14:59.520 25887 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:14:59 ctl02 nova-api[25887]: 2017-09-28 12:14:59.520 25887 ERROR nova     sock.listen(backlog)
Sep 28 12:14:59 ctl02 nova-api[25887]: 2017-09-28 12:14:59.520 25887 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:14:59 ctl02 nova-api[25887]: 2017-09-28 12:14:59.520 25887 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:14:59 ctl02 nova-api[25887]: 2017-09-28 12:14:59.520 25887 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:14:59 ctl02 nova-api[25887]: 2017-09-28 12:14:59.520 25887 ERROR nova
Sep 28 12:14:59 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:14:59 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:14:59 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:14:59 ctl02 heat-api[13008]: 2017-09-28 12:14:59.851 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:14:59] "OPTIONS / HTTP/1.0" 200 134 0.000718
Sep 28 12:14:59 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:14:59 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:14:59 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:14:59 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:15:00 ctl02 heat-api-cfn[13300]: 2017-09-28 12:15:00.532 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:15:00] "OPTIONS / HTTP/1.0" 200 134 0.000549
Sep 28 12:15:00 ctl02 nova-cert[4860]: 2017-09-28 12:15:00.704 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:15:00 ctl02 glance-api[29183]: 2017-09-28 12:15:00.776 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:15:00] "OPTIONS / HTTP/1.0" 200 134 0.000727
Sep 28 12:15:01 ctl02 heat-api-cfn[13300]: 2017-09-28 12:15:01.397 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:15:01] "OPTIONS / HTTP/1.0" 200 134 0.000514
Sep 28 12:15:01 ctl02 nova-api[25911]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:15:01 ctl02 nova-api[25911]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:15:01 ctl02 nova-api[25911]: 2017-09-28 12:15:01.748 25911 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:15:01 ctl02 nova-api[25911]: 2017-09-28 12:15:01.750 25911 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:15:01 ctl02 nova-api[25911]: 2017-09-28 12:15:01.750 25911 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:15:01 ctl02 nova-api[25911]: 2017-09-28 12:15:01.750 25911 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:15:01 ctl02 nova-api[25911]: 2017-09-28 12:15:01.750 25911 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:15:01 ctl02 nova-api[25911]: 2017-09-28 12:15:01.750 25911 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:15:01 ctl02 nova-api[25911]: 2017-09-28 12:15:01.750 25911 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:15:01 ctl02 nova-api[25911]: 2017-09-28 12:15:01.750 25911 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:15:01 ctl02 nova-api[25911]: 2017-09-28 12:15:01.750 25911 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:15:01 ctl02 nova-api[25911]: 2017-09-28 12:15:01.750 25911 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:15:01 ctl02 nova-api[25911]: 2017-09-28 12:15:01.750 25911 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:15:01 ctl02 nova-api[25911]: 2017-09-28 12:15:01.750 25911 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:15:01 ctl02 nova-api[25911]: 2017-09-28 12:15:01.750 25911 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:15:01 ctl02 nova-api[25911]: 2017-09-28 12:15:01.750 25911 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:15:01 ctl02 nova-api[25911]: 2017-09-28 12:15:01.750 25911 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:15:01 ctl02 nova-api[25911]: 2017-09-28 12:15:01.750 25911 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:15:01 ctl02 nova-api[25911]: 2017-09-28 12:15:01.750 25911 ERROR nova.wsgi     self.filename))
Sep 28 12:15:01 ctl02 nova-api[25911]: 2017-09-28 12:15:01.750 25911 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:15:01 ctl02 nova-api[25911]: 2017-09-28 12:15:01.750 25911 ERROR nova.wsgi
Sep 28 12:15:01 ctl02 nova-api[25911]: 2017-09-28 12:15:01.751 25911 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:15:01 ctl02 nova-api[25911]: 2017-09-28 12:15:01.884 25911 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:15:01 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:15:01.974 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:15:01] "OPTIONS / HTTP/1.0" 200 134 0.000476
Sep 28 12:15:02 ctl02 nova-api[25911]: 2017-09-28 12:15:02.135 25911 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:15:02 ctl02 nova-api[25911]: 2017-09-28 12:15:02.137 25911 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:15:02 ctl02 nova-api[25911]: 2017-09-28 12:15:02.137 25911 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:15:02 ctl02 nova-api[25911]: 2017-09-28 12:15:02.137 25911 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:15:02 ctl02 nova-api[25911]: 2017-09-28 12:15:02.271 25911 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:15:02 ctl02 nova-api[25911]: 2017-09-28 12:15:02.273 25911 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:15:02 ctl02 nova-api[25911]: 2017-09-28 12:15:02.273 25911 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:15:02 ctl02 nova-api[25911]: 2017-09-28 12:15:02.274 25911 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:15:02 ctl02 nova-api[25911]: 2017-09-28 12:15:02.277 25911 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:15:02 ctl02 nova-api[25911]: 2017-09-28 12:15:02.277 25911 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:15:02 ctl02 nova-api[25911]: 2017-09-28 12:15:02.277 25911 ERROR nova Traceback (most recent call last):
Sep 28 12:15:02 ctl02 nova-api[25911]: 2017-09-28 12:15:02.277 25911 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:15:02 ctl02 nova-api[25911]: 2017-09-28 12:15:02.277 25911 ERROR nova     sys.exit(main())
Sep 28 12:15:02 ctl02 nova-api[25911]: 2017-09-28 12:15:02.277 25911 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:15:02 ctl02 nova-api[25911]: 2017-09-28 12:15:02.277 25911 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:15:02 ctl02 nova-api[25911]: 2017-09-28 12:15:02.277 25911 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:15:02 ctl02 nova-api[25911]: 2017-09-28 12:15:02.277 25911 ERROR nova     max_url_len=max_url_len)
Sep 28 12:15:02 ctl02 nova-api[25911]: 2017-09-28 12:15:02.277 25911 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:15:02 ctl02 nova-api[25911]: 2017-09-28 12:15:02.277 25911 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:15:02 ctl02 nova-api[25911]: 2017-09-28 12:15:02.277 25911 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:15:02 ctl02 nova-api[25911]: 2017-09-28 12:15:02.277 25911 ERROR nova     sock.listen(backlog)
Sep 28 12:15:02 ctl02 nova-api[25911]: 2017-09-28 12:15:02.277 25911 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:15:02 ctl02 nova-api[25911]: 2017-09-28 12:15:02.277 25911 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:15:02 ctl02 nova-api[25911]: 2017-09-28 12:15:02.277 25911 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:15:02 ctl02 nova-api[25911]: 2017-09-28 12:15:02.277 25911 ERROR nova
Sep 28 12:15:02 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:15:02 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:15:02 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:15:02 ctl02 nova-conductor[5056]: 2017-09-28 12:15:02.487 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:15:02 ctl02 nova-conductor[5056]: 2017-09-28 12:15:02.502 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:15:02 ctl02 nova-conductor[5056]: 2017-09-28 12:15:02.504 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:15:02 ctl02 nova-conductor[5056]: 2017-09-28 12:15:02.507 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:15:02 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:15:02 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:15:02 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:15:02 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:15:03 ctl02 glance-api[29183]: 2017-09-28 12:15:03.502 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:15:03] "OPTIONS / HTTP/1.0" 200 134 0.000678
Sep 28 12:15:03 ctl02 heat-api-cfn[13300]: 2017-09-28 12:15:03.992 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:15:03] "OPTIONS / HTTP/1.0" 200 134 0.000749
Sep 28 12:15:04 ctl02 heat-api[13008]: 2017-09-28 12:15:04.129 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:15:04] "OPTIONS / HTTP/1.0" 200 134 0.000657
Sep 28 12:15:04 ctl02 nova-api[25929]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:15:04 ctl02 nova-api[25929]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:15:04 ctl02 glance-api[29183]: 2017-09-28 12:15:04.345 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:15:04] "OPTIONS / HTTP/1.0" 200 134 0.000720
Sep 28 12:15:04 ctl02 nova-api[25929]: 2017-09-28 12:15:04.497 25929 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:15:04 ctl02 nova-api[25929]: 2017-09-28 12:15:04.499 25929 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:15:04 ctl02 nova-api[25929]: 2017-09-28 12:15:04.499 25929 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:15:04 ctl02 nova-api[25929]: 2017-09-28 12:15:04.499 25929 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:15:04 ctl02 nova-api[25929]: 2017-09-28 12:15:04.499 25929 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:15:04 ctl02 nova-api[25929]: 2017-09-28 12:15:04.499 25929 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:15:04 ctl02 nova-api[25929]: 2017-09-28 12:15:04.499 25929 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:15:04 ctl02 nova-api[25929]: 2017-09-28 12:15:04.499 25929 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:15:04 ctl02 nova-api[25929]: 2017-09-28 12:15:04.499 25929 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:15:04 ctl02 nova-api[25929]: 2017-09-28 12:15:04.499 25929 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:15:04 ctl02 nova-api[25929]: 2017-09-28 12:15:04.499 25929 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:15:04 ctl02 nova-api[25929]: 2017-09-28 12:15:04.499 25929 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:15:04 ctl02 nova-api[25929]: 2017-09-28 12:15:04.499 25929 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:15:04 ctl02 nova-api[25929]: 2017-09-28 12:15:04.499 25929 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:15:04 ctl02 nova-api[25929]: 2017-09-28 12:15:04.499 25929 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:15:04 ctl02 nova-api[25929]: 2017-09-28 12:15:04.499 25929 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:15:04 ctl02 nova-api[25929]: 2017-09-28 12:15:04.499 25929 ERROR nova.wsgi     self.filename))
Sep 28 12:15:04 ctl02 nova-api[25929]: 2017-09-28 12:15:04.499 25929 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:15:04 ctl02 nova-api[25929]: 2017-09-28 12:15:04.499 25929 ERROR nova.wsgi
Sep 28 12:15:04 ctl02 nova-api[25929]: 2017-09-28 12:15:04.502 25929 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:15:04 ctl02 nova-api[25929]: 2017-09-28 12:15:04.638 25929 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:15:04 ctl02 nova-api[25929]: 2017-09-28 12:15:04.894 25929 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:15:04 ctl02 nova-api[25929]: 2017-09-28 12:15:04.897 25929 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:15:04 ctl02 nova-api[25929]: 2017-09-28 12:15:04.897 25929 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:15:04 ctl02 nova-api[25929]: 2017-09-28 12:15:04.898 25929 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:15:05 ctl02 nova-api[25929]: 2017-09-28 12:15:05.032 25929 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:15:05 ctl02 nova-api[25929]: 2017-09-28 12:15:05.035 25929 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:15:05 ctl02 nova-api[25929]: 2017-09-28 12:15:05.036 25929 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:15:05 ctl02 nova-api[25929]: 2017-09-28 12:15:05.036 25929 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:15:05 ctl02 nova-api[25929]: 2017-09-28 12:15:05.040 25929 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:15:05 ctl02 nova-api[25929]: 2017-09-28 12:15:05.040 25929 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:15:05 ctl02 nova-api[25929]: 2017-09-28 12:15:05.040 25929 ERROR nova Traceback (most recent call last):
Sep 28 12:15:05 ctl02 nova-api[25929]: 2017-09-28 12:15:05.040 25929 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:15:05 ctl02 nova-api[25929]: 2017-09-28 12:15:05.040 25929 ERROR nova     sys.exit(main())
Sep 28 12:15:05 ctl02 nova-api[25929]: 2017-09-28 12:15:05.040 25929 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:15:05 ctl02 nova-api[25929]: 2017-09-28 12:15:05.040 25929 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:15:05 ctl02 nova-api[25929]: 2017-09-28 12:15:05.040 25929 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:15:05 ctl02 nova-api[25929]: 2017-09-28 12:15:05.040 25929 ERROR nova     max_url_len=max_url_len)
Sep 28 12:15:05 ctl02 nova-api[25929]: 2017-09-28 12:15:05.040 25929 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:15:05 ctl02 nova-api[25929]: 2017-09-28 12:15:05.040 25929 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:15:05 ctl02 nova-api[25929]: 2017-09-28 12:15:05.040 25929 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:15:05 ctl02 nova-api[25929]: 2017-09-28 12:15:05.040 25929 ERROR nova     sock.listen(backlog)
Sep 28 12:15:05 ctl02 nova-api[25929]: 2017-09-28 12:15:05.040 25929 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:15:05 ctl02 nova-api[25929]: 2017-09-28 12:15:05.040 25929 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:15:05 ctl02 nova-api[25929]: 2017-09-28 12:15:05.040 25929 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:15:05 ctl02 nova-api[25929]: 2017-09-28 12:15:05.040 25929 ERROR nova
Sep 28 12:15:05 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:15:05 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:15:05 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:15:05 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:15:05 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:15:05 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:15:05 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:15:05 ctl02 heat-api[13008]: 2017-09-28 12:15:05.664 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:15:05] "OPTIONS / HTTP/1.0" 200 134 0.000669
Sep 28 12:15:07 ctl02 nova-api[25947]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:15:07 ctl02 nova-api[25947]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:15:07 ctl02 nova-api[25947]: 2017-09-28 12:15:07.254 25947 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:15:07 ctl02 nova-api[25947]: 2017-09-28 12:15:07.257 25947 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:15:07 ctl02 nova-api[25947]: 2017-09-28 12:15:07.257 25947 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:15:07 ctl02 nova-api[25947]: 2017-09-28 12:15:07.257 25947 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:15:07 ctl02 nova-api[25947]: 2017-09-28 12:15:07.257 25947 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:15:07 ctl02 nova-api[25947]: 2017-09-28 12:15:07.257 25947 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:15:07 ctl02 nova-api[25947]: 2017-09-28 12:15:07.257 25947 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:15:07 ctl02 nova-api[25947]: 2017-09-28 12:15:07.257 25947 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:15:07 ctl02 nova-api[25947]: 2017-09-28 12:15:07.257 25947 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:15:07 ctl02 nova-api[25947]: 2017-09-28 12:15:07.257 25947 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:15:07 ctl02 nova-api[25947]: 2017-09-28 12:15:07.257 25947 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:15:07 ctl02 nova-api[25947]: 2017-09-28 12:15:07.257 25947 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:15:07 ctl02 nova-api[25947]: 2017-09-28 12:15:07.257 25947 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:15:07 ctl02 nova-api[25947]: 2017-09-28 12:15:07.257 25947 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:15:07 ctl02 nova-api[25947]: 2017-09-28 12:15:07.257 25947 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:15:07 ctl02 nova-api[25947]: 2017-09-28 12:15:07.257 25947 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:15:07 ctl02 nova-api[25947]: 2017-09-28 12:15:07.257 25947 ERROR nova.wsgi     self.filename))
Sep 28 12:15:07 ctl02 nova-api[25947]: 2017-09-28 12:15:07.257 25947 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:15:07 ctl02 nova-api[25947]: 2017-09-28 12:15:07.257 25947 ERROR nova.wsgi
Sep 28 12:15:07 ctl02 nova-api[25947]: 2017-09-28 12:15:07.259 25947 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:15:07 ctl02 nova-api[25947]: 2017-09-28 12:15:07.393 25947 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:15:07 ctl02 nova-api[25947]: 2017-09-28 12:15:07.647 25947 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:15:07 ctl02 nova-api[25947]: 2017-09-28 12:15:07.650 25947 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:15:07 ctl02 nova-api[25947]: 2017-09-28 12:15:07.650 25947 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:15:07 ctl02 nova-api[25947]: 2017-09-28 12:15:07.650 25947 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:15:07 ctl02 nova-api[25947]: 2017-09-28 12:15:07.784 25947 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:15:07 ctl02 nova-api[25947]: 2017-09-28 12:15:07.787 25947 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:15:07 ctl02 nova-api[25947]: 2017-09-28 12:15:07.788 25947 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:15:07 ctl02 nova-api[25947]: 2017-09-28 12:15:07.788 25947 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:15:07 ctl02 nova-api[25947]: 2017-09-28 12:15:07.792 25947 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:15:07 ctl02 nova-api[25947]: 2017-09-28 12:15:07.792 25947 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:15:07 ctl02 nova-api[25947]: 2017-09-28 12:15:07.792 25947 ERROR nova Traceback (most recent call last):
Sep 28 12:15:07 ctl02 nova-api[25947]: 2017-09-28 12:15:07.792 25947 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:15:07 ctl02 nova-api[25947]: 2017-09-28 12:15:07.792 25947 ERROR nova     sys.exit(main())
Sep 28 12:15:07 ctl02 nova-api[25947]: 2017-09-28 12:15:07.792 25947 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:15:07 ctl02 nova-api[25947]: 2017-09-28 12:15:07.792 25947 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:15:07 ctl02 nova-api[25947]: 2017-09-28 12:15:07.792 25947 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:15:07 ctl02 nova-api[25947]: 2017-09-28 12:15:07.792 25947 ERROR nova     max_url_len=max_url_len)
Sep 28 12:15:07 ctl02 nova-api[25947]: 2017-09-28 12:15:07.792 25947 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:15:07 ctl02 nova-api[25947]: 2017-09-28 12:15:07.792 25947 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:15:07 ctl02 nova-api[25947]: 2017-09-28 12:15:07.792 25947 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:15:07 ctl02 nova-api[25947]: 2017-09-28 12:15:07.792 25947 ERROR nova     sock.listen(backlog)
Sep 28 12:15:07 ctl02 nova-api[25947]: 2017-09-28 12:15:07.792 25947 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:15:07 ctl02 nova-api[25947]: 2017-09-28 12:15:07.792 25947 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:15:07 ctl02 nova-api[25947]: 2017-09-28 12:15:07.792 25947 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:15:07 ctl02 nova-api[25947]: 2017-09-28 12:15:07.792 25947 ERROR nova
Sep 28 12:15:07 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:15:07.926 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:15:07] "OPTIONS / HTTP/1.0" 200 134 0.000479
Sep 28 12:15:07 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:15:07 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:15:07 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:15:08 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:15:08 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:15:08 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:15:08 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:15:08 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:15:08.187 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:15:08] "OPTIONS / HTTP/1.0" 200 134 0.000526
Sep 28 12:15:09 ctl02 nova-api[25965]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:15:09 ctl02 nova-api[25965]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:15:10 ctl02 nova-api[25965]: 2017-09-28 12:15:10.008 25965 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:15:10 ctl02 nova-api[25965]: 2017-09-28 12:15:10.010 25965 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:15:10 ctl02 nova-api[25965]: 2017-09-28 12:15:10.010 25965 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:15:10 ctl02 nova-api[25965]: 2017-09-28 12:15:10.010 25965 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:15:10 ctl02 nova-api[25965]: 2017-09-28 12:15:10.010 25965 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:15:10 ctl02 nova-api[25965]: 2017-09-28 12:15:10.010 25965 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:15:10 ctl02 nova-api[25965]: 2017-09-28 12:15:10.010 25965 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:15:10 ctl02 nova-api[25965]: 2017-09-28 12:15:10.010 25965 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:15:10 ctl02 nova-api[25965]: 2017-09-28 12:15:10.010 25965 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:15:10 ctl02 nova-api[25965]: 2017-09-28 12:15:10.010 25965 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:15:10 ctl02 nova-api[25965]: 2017-09-28 12:15:10.010 25965 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:15:10 ctl02 nova-api[25965]: 2017-09-28 12:15:10.010 25965 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:15:10 ctl02 nova-api[25965]: 2017-09-28 12:15:10.010 25965 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:15:10 ctl02 nova-api[25965]: 2017-09-28 12:15:10.010 25965 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:15:10 ctl02 nova-api[25965]: 2017-09-28 12:15:10.010 25965 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:15:10 ctl02 nova-api[25965]: 2017-09-28 12:15:10.010 25965 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:15:10 ctl02 nova-api[25965]: 2017-09-28 12:15:10.010 25965 ERROR nova.wsgi     self.filename))
Sep 28 12:15:10 ctl02 nova-api[25965]: 2017-09-28 12:15:10.010 25965 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:15:10 ctl02 nova-api[25965]: 2017-09-28 12:15:10.010 25965 ERROR nova.wsgi
Sep 28 12:15:10 ctl02 nova-api[25965]: 2017-09-28 12:15:10.012 25965 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:15:10 ctl02 nova-api[25965]: 2017-09-28 12:15:10.145 25965 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:15:10 ctl02 heat-api[13008]: 2017-09-28 12:15:10.218 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:15:10] "OPTIONS / HTTP/1.0" 200 134 0.000631
Sep 28 12:15:10 ctl02 heat-api-cfn[13300]: 2017-09-28 12:15:10.362 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:15:10] "OPTIONS / HTTP/1.0" 200 134 0.000538
Sep 28 12:15:10 ctl02 nova-api[25965]: 2017-09-28 12:15:10.401 25965 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:15:10 ctl02 nova-api[25965]: 2017-09-28 12:15:10.403 25965 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:15:10 ctl02 nova-api[25965]: 2017-09-28 12:15:10.403 25965 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:15:10 ctl02 nova-api[25965]: 2017-09-28 12:15:10.404 25965 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:15:10 ctl02 nova-api[25965]: 2017-09-28 12:15:10.536 25965 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:15:10 ctl02 nova-api[25965]: 2017-09-28 12:15:10.538 25965 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:15:10 ctl02 nova-api[25965]: 2017-09-28 12:15:10.538 25965 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:15:10 ctl02 nova-api[25965]: 2017-09-28 12:15:10.538 25965 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:15:10 ctl02 nova-api[25965]: 2017-09-28 12:15:10.542 25965 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:15:10 ctl02 nova-api[25965]: 2017-09-28 12:15:10.542 25965 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:15:10 ctl02 nova-api[25965]: 2017-09-28 12:15:10.542 25965 ERROR nova Traceback (most recent call last):
Sep 28 12:15:10 ctl02 nova-api[25965]: 2017-09-28 12:15:10.542 25965 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:15:10 ctl02 nova-api[25965]: 2017-09-28 12:15:10.542 25965 ERROR nova     sys.exit(main())
Sep 28 12:15:10 ctl02 nova-api[25965]: 2017-09-28 12:15:10.542 25965 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:15:10 ctl02 nova-api[25965]: 2017-09-28 12:15:10.542 25965 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:15:10 ctl02 nova-api[25965]: 2017-09-28 12:15:10.542 25965 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:15:10 ctl02 nova-api[25965]: 2017-09-28 12:15:10.542 25965 ERROR nova     max_url_len=max_url_len)
Sep 28 12:15:10 ctl02 nova-api[25965]: 2017-09-28 12:15:10.542 25965 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:15:10 ctl02 nova-api[25965]: 2017-09-28 12:15:10.542 25965 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:15:10 ctl02 nova-api[25965]: 2017-09-28 12:15:10.542 25965 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:15:10 ctl02 nova-api[25965]: 2017-09-28 12:15:10.542 25965 ERROR nova     sock.listen(backlog)
Sep 28 12:15:10 ctl02 nova-api[25965]: 2017-09-28 12:15:10.542 25965 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:15:10 ctl02 nova-api[25965]: 2017-09-28 12:15:10.542 25965 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:15:10 ctl02 nova-api[25965]: 2017-09-28 12:15:10.542 25965 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:15:10 ctl02 nova-api[25965]: 2017-09-28 12:15:10.542 25965 ERROR nova
Sep 28 12:15:10 ctl02 nova-consoleauth[5433]: 2017-09-28 12:15:10.588 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:15:10 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:15:10 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:15:10 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:15:10 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:15:10 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:15:10 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:15:10 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:15:10 ctl02 glance-api[29183]: 2017-09-28 12:15:10.920 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:15:10] "OPTIONS / HTTP/1.0" 200 134 0.000766
Sep 28 12:15:11 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:15:11.594 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:15:11] "OPTIONS / HTTP/1.0" 200 134 0.000487
Sep 28 12:15:11 ctl02 heat-api-cfn[13300]: 2017-09-28 12:15:11.779 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:15:11] "OPTIONS / HTTP/1.0" 200 134 0.000586
Sep 28 12:15:12 ctl02 nova-api[25983]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:15:12 ctl02 nova-api[25983]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:15:12 ctl02 nova-api[25983]: 2017-09-28 12:15:12.737 25983 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:15:12 ctl02 nova-api[25983]: 2017-09-28 12:15:12.739 25983 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:15:12 ctl02 nova-api[25983]: 2017-09-28 12:15:12.739 25983 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:15:12 ctl02 nova-api[25983]: 2017-09-28 12:15:12.739 25983 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:15:12 ctl02 nova-api[25983]: 2017-09-28 12:15:12.739 25983 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:15:12 ctl02 nova-api[25983]: 2017-09-28 12:15:12.739 25983 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:15:12 ctl02 nova-api[25983]: 2017-09-28 12:15:12.739 25983 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:15:12 ctl02 nova-api[25983]: 2017-09-28 12:15:12.739 25983 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:15:12 ctl02 nova-api[25983]: 2017-09-28 12:15:12.739 25983 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:15:12 ctl02 nova-api[25983]: 2017-09-28 12:15:12.739 25983 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:15:12 ctl02 nova-api[25983]: 2017-09-28 12:15:12.739 25983 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:15:12 ctl02 nova-api[25983]: 2017-09-28 12:15:12.739 25983 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:15:12 ctl02 nova-api[25983]: 2017-09-28 12:15:12.739 25983 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:15:12 ctl02 nova-api[25983]: 2017-09-28 12:15:12.739 25983 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:15:12 ctl02 nova-api[25983]: 2017-09-28 12:15:12.739 25983 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:15:12 ctl02 nova-api[25983]: 2017-09-28 12:15:12.739 25983 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:15:12 ctl02 nova-api[25983]: 2017-09-28 12:15:12.739 25983 ERROR nova.wsgi     self.filename))
Sep 28 12:15:12 ctl02 nova-api[25983]: 2017-09-28 12:15:12.739 25983 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:15:12 ctl02 nova-api[25983]: 2017-09-28 12:15:12.739 25983 ERROR nova.wsgi
Sep 28 12:15:12 ctl02 nova-api[25983]: 2017-09-28 12:15:12.740 25983 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:15:12 ctl02 nova-api[25983]: 2017-09-28 12:15:12.872 25983 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:15:13 ctl02 nova-api[25983]: 2017-09-28 12:15:13.122 25983 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:15:13 ctl02 nova-api[25983]: 2017-09-28 12:15:13.124 25983 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:15:13 ctl02 nova-api[25983]: 2017-09-28 12:15:13.124 25983 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:15:13 ctl02 nova-api[25983]: 2017-09-28 12:15:13.125 25983 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:15:13 ctl02 nova-api[25983]: 2017-09-28 12:15:13.258 25983 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:15:13 ctl02 nova-api[25983]: 2017-09-28 12:15:13.260 25983 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:15:13 ctl02 nova-api[25983]: 2017-09-28 12:15:13.260 25983 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:15:13 ctl02 nova-api[25983]: 2017-09-28 12:15:13.261 25983 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:15:13 ctl02 nova-api[25983]: 2017-09-28 12:15:13.264 25983 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:15:13 ctl02 nova-api[25983]: 2017-09-28 12:15:13.264 25983 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:15:13 ctl02 nova-api[25983]: 2017-09-28 12:15:13.264 25983 ERROR nova Traceback (most recent call last):
Sep 28 12:15:13 ctl02 nova-api[25983]: 2017-09-28 12:15:13.264 25983 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:15:13 ctl02 nova-api[25983]: 2017-09-28 12:15:13.264 25983 ERROR nova     sys.exit(main())
Sep 28 12:15:13 ctl02 nova-api[25983]: 2017-09-28 12:15:13.264 25983 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:15:13 ctl02 nova-api[25983]: 2017-09-28 12:15:13.264 25983 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:15:13 ctl02 nova-api[25983]: 2017-09-28 12:15:13.264 25983 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:15:13 ctl02 nova-api[25983]: 2017-09-28 12:15:13.264 25983 ERROR nova     max_url_len=max_url_len)
Sep 28 12:15:13 ctl02 nova-api[25983]: 2017-09-28 12:15:13.264 25983 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:15:13 ctl02 nova-api[25983]: 2017-09-28 12:15:13.264 25983 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:15:13 ctl02 nova-api[25983]: 2017-09-28 12:15:13.264 25983 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:15:13 ctl02 nova-api[25983]: 2017-09-28 12:15:13.264 25983 ERROR nova     sock.listen(backlog)
Sep 28 12:15:13 ctl02 nova-api[25983]: 2017-09-28 12:15:13.264 25983 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:15:13 ctl02 nova-api[25983]: 2017-09-28 12:15:13.264 25983 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:15:13 ctl02 nova-api[25983]: 2017-09-28 12:15:13.264 25983 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:15:13 ctl02 nova-api[25983]: 2017-09-28 12:15:13.264 25983 ERROR nova
Sep 28 12:15:13 ctl02 glance-api[29183]: 2017-09-28 12:15:13.323 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:15:13] "OPTIONS / HTTP/1.0" 200 134 0.000663
Sep 28 12:15:13 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:15:13 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:15:13 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:15:13 ctl02 heat-engine[12803]: 2017-09-28 12:15:13.556 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:15:13 ctl02 heat-engine[12803]: 2017-09-28 12:15:13.582 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:15:13 ctl02 heat-engine[12803]: 2017-09-28 12:15:13.596 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:15:13 ctl02 heat-engine[12803]: 2017-09-28 12:15:13.607 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:15:13 ctl02 nova-scheduler[5620]: 2017-09-28 12:15:13.615 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:15:13 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:15:13 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:15:13 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:15:13 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:15:13 ctl02 heat-api-cfn[13300]: 2017-09-28 12:15:13.907 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:15:13] "OPTIONS / HTTP/1.0" 200 134 0.000458
Sep 28 12:15:14 ctl02 heat-api[13008]: 2017-09-28 12:15:14.015 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:15:14] "OPTIONS / HTTP/1.0" 200 134 0.000571
Sep 28 12:15:14 ctl02 glance-api[29183]: 2017-09-28 12:15:14.480 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:15:14] "OPTIONS / HTTP/1.0" 200 134 0.000616
Sep 28 12:15:15 ctl02 nova-api[26001]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:15:15 ctl02 nova-api[26001]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:15:15 ctl02 heat-api[13008]: 2017-09-28 12:15:15.468 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:15:15] "OPTIONS / HTTP/1.0" 200 134 0.000638
Sep 28 12:15:15 ctl02 nova-api[26001]: 2017-09-28 12:15:15.527 26001 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:15:15 ctl02 nova-api[26001]: 2017-09-28 12:15:15.529 26001 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:15:15 ctl02 nova-api[26001]: 2017-09-28 12:15:15.529 26001 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:15:15 ctl02 nova-api[26001]: 2017-09-28 12:15:15.529 26001 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:15:15 ctl02 nova-api[26001]: 2017-09-28 12:15:15.529 26001 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:15:15 ctl02 nova-api[26001]: 2017-09-28 12:15:15.529 26001 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:15:15 ctl02 nova-api[26001]: 2017-09-28 12:15:15.529 26001 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:15:15 ctl02 nova-api[26001]: 2017-09-28 12:15:15.529 26001 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:15:15 ctl02 nova-api[26001]: 2017-09-28 12:15:15.529 26001 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:15:15 ctl02 nova-api[26001]: 2017-09-28 12:15:15.529 26001 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:15:15 ctl02 nova-api[26001]: 2017-09-28 12:15:15.529 26001 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:15:15 ctl02 nova-api[26001]: 2017-09-28 12:15:15.529 26001 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:15:15 ctl02 nova-api[26001]: 2017-09-28 12:15:15.529 26001 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:15:15 ctl02 nova-api[26001]: 2017-09-28 12:15:15.529 26001 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:15:15 ctl02 nova-api[26001]: 2017-09-28 12:15:15.529 26001 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:15:15 ctl02 nova-api[26001]: 2017-09-28 12:15:15.529 26001 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:15:15 ctl02 nova-api[26001]: 2017-09-28 12:15:15.529 26001 ERROR nova.wsgi     self.filename))
Sep 28 12:15:15 ctl02 nova-api[26001]: 2017-09-28 12:15:15.529 26001 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:15:15 ctl02 nova-api[26001]: 2017-09-28 12:15:15.529 26001 ERROR nova.wsgi
Sep 28 12:15:15 ctl02 nova-api[26001]: 2017-09-28 12:15:15.530 26001 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:15:15 ctl02 nova-api[26001]: 2017-09-28 12:15:15.666 26001 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:15:15 ctl02 nova-api[26001]: 2017-09-28 12:15:15.912 26001 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:15:15 ctl02 nova-api[26001]: 2017-09-28 12:15:15.915 26001 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:15:15 ctl02 nova-api[26001]: 2017-09-28 12:15:15.915 26001 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:15:15 ctl02 nova-api[26001]: 2017-09-28 12:15:15.915 26001 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:15:16 ctl02 nova-api[26001]: 2017-09-28 12:15:16.048 26001 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:15:16 ctl02 nova-api[26001]: 2017-09-28 12:15:16.050 26001 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:15:16 ctl02 nova-api[26001]: 2017-09-28 12:15:16.050 26001 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:15:16 ctl02 nova-api[26001]: 2017-09-28 12:15:16.050 26001 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:15:16 ctl02 nova-api[26001]: 2017-09-28 12:15:16.054 26001 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:15:16 ctl02 nova-api[26001]: 2017-09-28 12:15:16.054 26001 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:15:16 ctl02 nova-api[26001]: 2017-09-28 12:15:16.054 26001 ERROR nova Traceback (most recent call last):
Sep 28 12:15:16 ctl02 nova-api[26001]: 2017-09-28 12:15:16.054 26001 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:15:16 ctl02 nova-api[26001]: 2017-09-28 12:15:16.054 26001 ERROR nova     sys.exit(main())
Sep 28 12:15:16 ctl02 nova-api[26001]: 2017-09-28 12:15:16.054 26001 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:15:16 ctl02 nova-api[26001]: 2017-09-28 12:15:16.054 26001 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:15:16 ctl02 nova-api[26001]: 2017-09-28 12:15:16.054 26001 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:15:16 ctl02 nova-api[26001]: 2017-09-28 12:15:16.054 26001 ERROR nova     max_url_len=max_url_len)
Sep 28 12:15:16 ctl02 nova-api[26001]: 2017-09-28 12:15:16.054 26001 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:15:16 ctl02 nova-api[26001]: 2017-09-28 12:15:16.054 26001 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:15:16 ctl02 nova-api[26001]: 2017-09-28 12:15:16.054 26001 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:15:16 ctl02 nova-api[26001]: 2017-09-28 12:15:16.054 26001 ERROR nova     sock.listen(backlog)
Sep 28 12:15:16 ctl02 nova-api[26001]: 2017-09-28 12:15:16.054 26001 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:15:16 ctl02 nova-api[26001]: 2017-09-28 12:15:16.054 26001 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:15:16 ctl02 nova-api[26001]: 2017-09-28 12:15:16.054 26001 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:15:16 ctl02 nova-api[26001]: 2017-09-28 12:15:16.054 26001 ERROR nova
Sep 28 12:15:16 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:15:16 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:15:16 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:15:16 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:15:16 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:15:16 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:15:16 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:15:17 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:15:17.583 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:15:17] "OPTIONS / HTTP/1.0" 200 134 0.000493
Sep 28 12:15:17 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xff9aa45)
Sep 28 12:15:18 ctl02 nova-api[26019]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:15:18 ctl02 nova-api[26019]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:15:18 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:15:18.241 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:15:18] "OPTIONS / HTTP/1.0" 200 134 0.000461
Sep 28 12:15:18 ctl02 nova-api[26019]: 2017-09-28 12:15:18.255 26019 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:15:18 ctl02 nova-api[26019]: 2017-09-28 12:15:18.257 26019 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:15:18 ctl02 nova-api[26019]: 2017-09-28 12:15:18.257 26019 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:15:18 ctl02 nova-api[26019]: 2017-09-28 12:15:18.257 26019 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:15:18 ctl02 nova-api[26019]: 2017-09-28 12:15:18.257 26019 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:15:18 ctl02 nova-api[26019]: 2017-09-28 12:15:18.257 26019 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:15:18 ctl02 nova-api[26019]: 2017-09-28 12:15:18.257 26019 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:15:18 ctl02 nova-api[26019]: 2017-09-28 12:15:18.257 26019 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:15:18 ctl02 nova-api[26019]: 2017-09-28 12:15:18.257 26019 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:15:18 ctl02 nova-api[26019]: 2017-09-28 12:15:18.257 26019 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:15:18 ctl02 nova-api[26019]: 2017-09-28 12:15:18.257 26019 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:15:18 ctl02 nova-api[26019]: 2017-09-28 12:15:18.257 26019 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:15:18 ctl02 nova-api[26019]: 2017-09-28 12:15:18.257 26019 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:15:18 ctl02 nova-api[26019]: 2017-09-28 12:15:18.257 26019 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:15:18 ctl02 nova-api[26019]: 2017-09-28 12:15:18.257 26019 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:15:18 ctl02 nova-api[26019]: 2017-09-28 12:15:18.257 26019 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:15:18 ctl02 nova-api[26019]: 2017-09-28 12:15:18.257 26019 ERROR nova.wsgi     self.filename))
Sep 28 12:15:18 ctl02 nova-api[26019]: 2017-09-28 12:15:18.257 26019 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:15:18 ctl02 nova-api[26019]: 2017-09-28 12:15:18.257 26019 ERROR nova.wsgi
Sep 28 12:15:18 ctl02 nova-api[26019]: 2017-09-28 12:15:18.258 26019 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:15:18 ctl02 nova-api[26019]: 2017-09-28 12:15:18.391 26019 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:15:18 ctl02 nova-api[26019]: 2017-09-28 12:15:18.642 26019 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:15:18 ctl02 nova-api[26019]: 2017-09-28 12:15:18.645 26019 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:15:18 ctl02 nova-api[26019]: 2017-09-28 12:15:18.645 26019 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:15:18 ctl02 nova-api[26019]: 2017-09-28 12:15:18.645 26019 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:15:18 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xff9aa45)
Sep 28 12:15:18 ctl02 nova-api[26019]: 2017-09-28 12:15:18.777 26019 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:15:18 ctl02 nova-api[26019]: 2017-09-28 12:15:18.779 26019 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:15:18 ctl02 nova-api[26019]: 2017-09-28 12:15:18.779 26019 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:15:18 ctl02 nova-api[26019]: 2017-09-28 12:15:18.779 26019 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:15:18 ctl02 nova-api[26019]: 2017-09-28 12:15:18.783 26019 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:15:18 ctl02 nova-api[26019]: 2017-09-28 12:15:18.783 26019 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:15:18 ctl02 nova-api[26019]: 2017-09-28 12:15:18.783 26019 ERROR nova Traceback (most recent call last):
Sep 28 12:15:18 ctl02 nova-api[26019]: 2017-09-28 12:15:18.783 26019 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:15:18 ctl02 nova-api[26019]: 2017-09-28 12:15:18.783 26019 ERROR nova     sys.exit(main())
Sep 28 12:15:18 ctl02 nova-api[26019]: 2017-09-28 12:15:18.783 26019 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:15:18 ctl02 nova-api[26019]: 2017-09-28 12:15:18.783 26019 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:15:18 ctl02 nova-api[26019]: 2017-09-28 12:15:18.783 26019 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:15:18 ctl02 nova-api[26019]: 2017-09-28 12:15:18.783 26019 ERROR nova     max_url_len=max_url_len)
Sep 28 12:15:18 ctl02 nova-api[26019]: 2017-09-28 12:15:18.783 26019 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:15:18 ctl02 nova-api[26019]: 2017-09-28 12:15:18.783 26019 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:15:18 ctl02 nova-api[26019]: 2017-09-28 12:15:18.783 26019 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:15:18 ctl02 nova-api[26019]: 2017-09-28 12:15:18.783 26019 ERROR nova     sock.listen(backlog)
Sep 28 12:15:18 ctl02 nova-api[26019]: 2017-09-28 12:15:18.783 26019 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:15:18 ctl02 nova-api[26019]: 2017-09-28 12:15:18.783 26019 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:15:18 ctl02 nova-api[26019]: 2017-09-28 12:15:18.783 26019 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:15:18 ctl02 nova-api[26019]: 2017-09-28 12:15:18.783 26019 ERROR nova
Sep 28 12:15:18 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:15:18 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:15:18 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:15:19 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:15:19 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:15:19 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:15:19 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:15:19 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xff9aa45)
Sep 28 12:15:20 ctl02 heat-api-cfn[13300]: 2017-09-28 12:15:20.410 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:15:20] "OPTIONS / HTTP/1.0" 200 134 0.000503
Sep 28 12:15:20 ctl02 heat-api[13008]: 2017-09-28 12:15:20.441 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:15:20] "OPTIONS / HTTP/1.0" 200 134 0.000599
Sep 28 12:15:20 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xff9aa45)
Sep 28 12:15:20 ctl02 nova-api[26036]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:15:20 ctl02 nova-api[26036]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:15:20 ctl02 glance-api[29183]: 2017-09-28 12:15:20.798 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:15:20] "OPTIONS / HTTP/1.0" 200 134 0.000574
Sep 28 12:15:20 ctl02 nova-api[26036]: 2017-09-28 12:15:20.997 26036 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:15:21 ctl02 nova-api[26036]: 2017-09-28 12:15:21.000 26036 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:15:21 ctl02 nova-api[26036]: 2017-09-28 12:15:21.000 26036 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:15:21 ctl02 nova-api[26036]: 2017-09-28 12:15:21.000 26036 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:15:21 ctl02 nova-api[26036]: 2017-09-28 12:15:21.000 26036 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:15:21 ctl02 nova-api[26036]: 2017-09-28 12:15:21.000 26036 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:15:21 ctl02 nova-api[26036]: 2017-09-28 12:15:21.000 26036 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:15:21 ctl02 nova-api[26036]: 2017-09-28 12:15:21.000 26036 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:15:21 ctl02 nova-api[26036]: 2017-09-28 12:15:21.000 26036 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:15:21 ctl02 nova-api[26036]: 2017-09-28 12:15:21.000 26036 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:15:21 ctl02 nova-api[26036]: 2017-09-28 12:15:21.000 26036 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:15:21 ctl02 nova-api[26036]: 2017-09-28 12:15:21.000 26036 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:15:21 ctl02 nova-api[26036]: 2017-09-28 12:15:21.000 26036 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:15:21 ctl02 nova-api[26036]: 2017-09-28 12:15:21.000 26036 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:15:21 ctl02 nova-api[26036]: 2017-09-28 12:15:21.000 26036 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:15:21 ctl02 nova-api[26036]: 2017-09-28 12:15:21.000 26036 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:15:21 ctl02 nova-api[26036]: 2017-09-28 12:15:21.000 26036 ERROR nova.wsgi     self.filename))
Sep 28 12:15:21 ctl02 nova-api[26036]: 2017-09-28 12:15:21.000 26036 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:15:21 ctl02 nova-api[26036]: 2017-09-28 12:15:21.000 26036 ERROR nova.wsgi
Sep 28 12:15:21 ctl02 nova-api[26036]: 2017-09-28 12:15:21.002 26036 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:15:21 ctl02 nova-api[26036]: 2017-09-28 12:15:21.131 26036 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:15:21 ctl02 nova-api[26036]: 2017-09-28 12:15:21.382 26036 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:15:21 ctl02 nova-api[26036]: 2017-09-28 12:15:21.385 26036 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:15:21 ctl02 nova-api[26036]: 2017-09-28 12:15:21.386 26036 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:15:21 ctl02 nova-api[26036]: 2017-09-28 12:15:21.386 26036 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:15:21 ctl02 heat-api-cfn[13300]: 2017-09-28 12:15:21.465 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:15:21] "OPTIONS / HTTP/1.0" 200 134 0.000505
Sep 28 12:15:21 ctl02 nova-api[26036]: 2017-09-28 12:15:21.523 26036 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:15:21 ctl02 nova-api[26036]: 2017-09-28 12:15:21.525 26036 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:15:21 ctl02 nova-api[26036]: 2017-09-28 12:15:21.526 26036 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:15:21 ctl02 nova-api[26036]: 2017-09-28 12:15:21.526 26036 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:15:21 ctl02 nova-api[26036]: 2017-09-28 12:15:21.529 26036 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:15:21 ctl02 nova-api[26036]: 2017-09-28 12:15:21.530 26036 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:15:21 ctl02 nova-api[26036]: 2017-09-28 12:15:21.530 26036 ERROR nova Traceback (most recent call last):
Sep 28 12:15:21 ctl02 nova-api[26036]: 2017-09-28 12:15:21.530 26036 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:15:21 ctl02 nova-api[26036]: 2017-09-28 12:15:21.530 26036 ERROR nova     sys.exit(main())
Sep 28 12:15:21 ctl02 nova-api[26036]: 2017-09-28 12:15:21.530 26036 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:15:21 ctl02 nova-api[26036]: 2017-09-28 12:15:21.530 26036 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:15:21 ctl02 nova-api[26036]: 2017-09-28 12:15:21.530 26036 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:15:21 ctl02 nova-api[26036]: 2017-09-28 12:15:21.530 26036 ERROR nova     max_url_len=max_url_len)
Sep 28 12:15:21 ctl02 nova-api[26036]: 2017-09-28 12:15:21.530 26036 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:15:21 ctl02 nova-api[26036]: 2017-09-28 12:15:21.530 26036 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:15:21 ctl02 nova-api[26036]: 2017-09-28 12:15:21.530 26036 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:15:21 ctl02 nova-api[26036]: 2017-09-28 12:15:21.530 26036 ERROR nova     sock.listen(backlog)
Sep 28 12:15:21 ctl02 nova-api[26036]: 2017-09-28 12:15:21.530 26036 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:15:21 ctl02 nova-api[26036]: 2017-09-28 12:15:21.530 26036 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:15:21 ctl02 nova-api[26036]: 2017-09-28 12:15:21.530 26036 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:15:21 ctl02 nova-api[26036]: 2017-09-28 12:15:21.530 26036 ERROR nova
Sep 28 12:15:21 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:15:21 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:15:21 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:15:21 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:15:21.751 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:15:21] "OPTIONS / HTTP/1.0" 200 134 0.000556
Sep 28 12:15:21 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xff9aa45)
Sep 28 12:15:21 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:15:21 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:15:21 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:15:21 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:15:22 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xff9aa45)
Sep 28 12:15:23 ctl02 glance-api[29183]: 2017-09-28 12:15:23.374 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:15:23] "OPTIONS / HTTP/1.0" 200 134 0.000624
Sep 28 12:15:23 ctl02 nova-api[26055]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:15:23 ctl02 nova-api[26055]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:15:23 ctl02 heat-api-cfn[13300]: 2017-09-28 12:15:23.686 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:15:23] "OPTIONS / HTTP/1.0" 200 134 0.000449
Sep 28 12:15:23 ctl02 nova-api[26055]: 2017-09-28 12:15:23.721 26055 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:15:23 ctl02 nova-api[26055]: 2017-09-28 12:15:23.723 26055 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:15:23 ctl02 nova-api[26055]: 2017-09-28 12:15:23.723 26055 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:15:23 ctl02 nova-api[26055]: 2017-09-28 12:15:23.723 26055 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:15:23 ctl02 nova-api[26055]: 2017-09-28 12:15:23.723 26055 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:15:23 ctl02 nova-api[26055]: 2017-09-28 12:15:23.723 26055 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:15:23 ctl02 nova-api[26055]: 2017-09-28 12:15:23.723 26055 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:15:23 ctl02 nova-api[26055]: 2017-09-28 12:15:23.723 26055 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:15:23 ctl02 nova-api[26055]: 2017-09-28 12:15:23.723 26055 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:15:23 ctl02 nova-api[26055]: 2017-09-28 12:15:23.723 26055 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:15:23 ctl02 nova-api[26055]: 2017-09-28 12:15:23.723 26055 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:15:23 ctl02 nova-api[26055]: 2017-09-28 12:15:23.723 26055 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:15:23 ctl02 nova-api[26055]: 2017-09-28 12:15:23.723 26055 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:15:23 ctl02 nova-api[26055]: 2017-09-28 12:15:23.723 26055 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:15:23 ctl02 nova-api[26055]: 2017-09-28 12:15:23.723 26055 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:15:23 ctl02 nova-api[26055]: 2017-09-28 12:15:23.723 26055 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:15:23 ctl02 nova-api[26055]: 2017-09-28 12:15:23.723 26055 ERROR nova.wsgi     self.filename))
Sep 28 12:15:23 ctl02 nova-api[26055]: 2017-09-28 12:15:23.723 26055 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:15:23 ctl02 nova-api[26055]: 2017-09-28 12:15:23.723 26055 ERROR nova.wsgi
Sep 28 12:15:23 ctl02 nova-api[26055]: 2017-09-28 12:15:23.725 26055 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:15:23 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xff9aa45)
Sep 28 12:15:23 ctl02 nova-api[26055]: 2017-09-28 12:15:23.857 26055 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:15:24 ctl02 nova-api[26055]: 2017-09-28 12:15:24.085 26055 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:15:24 ctl02 nova-api[26055]: 2017-09-28 12:15:24.088 26055 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:15:24 ctl02 nova-api[26055]: 2017-09-28 12:15:24.088 26055 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:15:24 ctl02 nova-api[26055]: 2017-09-28 12:15:24.089 26055 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:15:24 ctl02 heat-api[13008]: 2017-09-28 12:15:24.103 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:15:24] "OPTIONS / HTTP/1.0" 200 134 0.000538
Sep 28 12:15:24 ctl02 nova-api[26055]: 2017-09-28 12:15:24.223 26055 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:15:24 ctl02 nova-api[26055]: 2017-09-28 12:15:24.226 26055 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:15:24 ctl02 nova-api[26055]: 2017-09-28 12:15:24.226 26055 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:15:24 ctl02 nova-api[26055]: 2017-09-28 12:15:24.226 26055 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:15:24 ctl02 nova-api[26055]: 2017-09-28 12:15:24.230 26055 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:15:24 ctl02 nova-api[26055]: 2017-09-28 12:15:24.230 26055 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:15:24 ctl02 nova-api[26055]: 2017-09-28 12:15:24.230 26055 ERROR nova Traceback (most recent call last):
Sep 28 12:15:24 ctl02 nova-api[26055]: 2017-09-28 12:15:24.230 26055 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:15:24 ctl02 nova-api[26055]: 2017-09-28 12:15:24.230 26055 ERROR nova     sys.exit(main())
Sep 28 12:15:24 ctl02 nova-api[26055]: 2017-09-28 12:15:24.230 26055 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:15:24 ctl02 nova-api[26055]: 2017-09-28 12:15:24.230 26055 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:15:24 ctl02 nova-api[26055]: 2017-09-28 12:15:24.230 26055 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:15:24 ctl02 nova-api[26055]: 2017-09-28 12:15:24.230 26055 ERROR nova     max_url_len=max_url_len)
Sep 28 12:15:24 ctl02 nova-api[26055]: 2017-09-28 12:15:24.230 26055 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:15:24 ctl02 nova-api[26055]: 2017-09-28 12:15:24.230 26055 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:15:24 ctl02 nova-api[26055]: 2017-09-28 12:15:24.230 26055 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:15:24 ctl02 nova-api[26055]: 2017-09-28 12:15:24.230 26055 ERROR nova     sock.listen(backlog)
Sep 28 12:15:24 ctl02 nova-api[26055]: 2017-09-28 12:15:24.230 26055 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:15:24 ctl02 nova-api[26055]: 2017-09-28 12:15:24.230 26055 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:15:24 ctl02 nova-api[26055]: 2017-09-28 12:15:24.230 26055 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:15:24 ctl02 nova-api[26055]: 2017-09-28 12:15:24.230 26055 ERROR nova
Sep 28 12:15:24 ctl02 glance-api[29183]: 2017-09-28 12:15:24.265 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:15:24] "OPTIONS / HTTP/1.0" 200 134 0.001005
Sep 28 12:15:24 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:15:24 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:15:24 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:15:24 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:15:24 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:15:24 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:15:24 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:15:24 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xff9aa45)
Sep 28 12:15:25 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xff9aa45)
Sep 28 12:15:25 ctl02 heat-api[13008]: 2017-09-28 12:15:25.852 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:15:25] "OPTIONS / HTTP/1.0" 200 134 0.000652
Sep 28 12:15:26 ctl02 nova-api[26073]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:15:26 ctl02 nova-api[26073]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:15:26 ctl02 nova-api[26073]: 2017-09-28 12:15:26.467 26073 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:15:26 ctl02 nova-api[26073]: 2017-09-28 12:15:26.469 26073 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:15:26 ctl02 nova-api[26073]: 2017-09-28 12:15:26.469 26073 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:15:26 ctl02 nova-api[26073]: 2017-09-28 12:15:26.469 26073 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:15:26 ctl02 nova-api[26073]: 2017-09-28 12:15:26.469 26073 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:15:26 ctl02 nova-api[26073]: 2017-09-28 12:15:26.469 26073 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:15:26 ctl02 nova-api[26073]: 2017-09-28 12:15:26.469 26073 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:15:26 ctl02 nova-api[26073]: 2017-09-28 12:15:26.469 26073 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:15:26 ctl02 nova-api[26073]: 2017-09-28 12:15:26.469 26073 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:15:26 ctl02 nova-api[26073]: 2017-09-28 12:15:26.469 26073 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:15:26 ctl02 nova-api[26073]: 2017-09-28 12:15:26.469 26073 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:15:26 ctl02 nova-api[26073]: 2017-09-28 12:15:26.469 26073 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:15:26 ctl02 nova-api[26073]: 2017-09-28 12:15:26.469 26073 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:15:26 ctl02 nova-api[26073]: 2017-09-28 12:15:26.469 26073 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:15:26 ctl02 nova-api[26073]: 2017-09-28 12:15:26.469 26073 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:15:26 ctl02 nova-api[26073]: 2017-09-28 12:15:26.469 26073 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:15:26 ctl02 nova-api[26073]: 2017-09-28 12:15:26.469 26073 ERROR nova.wsgi     self.filename))
Sep 28 12:15:26 ctl02 nova-api[26073]: 2017-09-28 12:15:26.469 26073 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:15:26 ctl02 nova-api[26073]: 2017-09-28 12:15:26.469 26073 ERROR nova.wsgi
Sep 28 12:15:26 ctl02 nova-api[26073]: 2017-09-28 12:15:26.471 26073 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:15:26 ctl02 nova-api[26073]: 2017-09-28 12:15:26.605 26073 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:15:26 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xff9aa45)
Sep 28 12:15:26 ctl02 nova-api[26073]: 2017-09-28 12:15:26.858 26073 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:15:26 ctl02 nova-api[26073]: 2017-09-28 12:15:26.860 26073 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:15:26 ctl02 nova-api[26073]: 2017-09-28 12:15:26.861 26073 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:15:26 ctl02 nova-api[26073]: 2017-09-28 12:15:26.861 26073 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:15:26 ctl02 nova-api[26073]: 2017-09-28 12:15:26.995 26073 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:15:26 ctl02 nova-api[26073]: 2017-09-28 12:15:26.997 26073 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:15:26 ctl02 nova-api[26073]: 2017-09-28 12:15:26.998 26073 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:15:26 ctl02 nova-api[26073]: 2017-09-28 12:15:26.998 26073 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:15:27 ctl02 nova-api[26073]: 2017-09-28 12:15:27.002 26073 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:15:27 ctl02 nova-api[26073]: 2017-09-28 12:15:27.002 26073 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:15:27 ctl02 nova-api[26073]: 2017-09-28 12:15:27.002 26073 ERROR nova Traceback (most recent call last):
Sep 28 12:15:27 ctl02 nova-api[26073]: 2017-09-28 12:15:27.002 26073 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:15:27 ctl02 nova-api[26073]: 2017-09-28 12:15:27.002 26073 ERROR nova     sys.exit(main())
Sep 28 12:15:27 ctl02 nova-api[26073]: 2017-09-28 12:15:27.002 26073 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:15:27 ctl02 nova-api[26073]: 2017-09-28 12:15:27.002 26073 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:15:27 ctl02 nova-api[26073]: 2017-09-28 12:15:27.002 26073 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:15:27 ctl02 nova-api[26073]: 2017-09-28 12:15:27.002 26073 ERROR nova     max_url_len=max_url_len)
Sep 28 12:15:27 ctl02 nova-api[26073]: 2017-09-28 12:15:27.002 26073 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:15:27 ctl02 nova-api[26073]: 2017-09-28 12:15:27.002 26073 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:15:27 ctl02 nova-api[26073]: 2017-09-28 12:15:27.002 26073 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:15:27 ctl02 nova-api[26073]: 2017-09-28 12:15:27.002 26073 ERROR nova     sock.listen(backlog)
Sep 28 12:15:27 ctl02 nova-api[26073]: 2017-09-28 12:15:27.002 26073 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:15:27 ctl02 nova-api[26073]: 2017-09-28 12:15:27.002 26073 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:15:27 ctl02 nova-api[26073]: 2017-09-28 12:15:27.002 26073 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:15:27 ctl02 nova-api[26073]: 2017-09-28 12:15:27.002 26073 ERROR nova
Sep 28 12:15:27 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:15:27 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:15:27 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:15:27 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:15:27 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:15:27 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:15:27 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:15:27 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:15:27.670 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:15:27] "OPTIONS / HTTP/1.0" 200 134 0.000497
Sep 28 12:15:27 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xff9aa45)
Sep 28 12:15:27 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:15:27.907 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:15:27] "OPTIONS / HTTP/1.0" 200 134 0.000560
Sep 28 12:15:28 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:15:28 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:15:29 ctl02 nova-api[26091]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:15:29 ctl02 nova-api[26091]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:15:29 ctl02 nova-api[26091]: 2017-09-28 12:15:29.231 26091 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:15:29 ctl02 nova-api[26091]: 2017-09-28 12:15:29.233 26091 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:15:29 ctl02 nova-api[26091]: 2017-09-28 12:15:29.233 26091 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:15:29 ctl02 nova-api[26091]: 2017-09-28 12:15:29.233 26091 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:15:29 ctl02 nova-api[26091]: 2017-09-28 12:15:29.233 26091 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:15:29 ctl02 nova-api[26091]: 2017-09-28 12:15:29.233 26091 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:15:29 ctl02 nova-api[26091]: 2017-09-28 12:15:29.233 26091 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:15:29 ctl02 nova-api[26091]: 2017-09-28 12:15:29.233 26091 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:15:29 ctl02 nova-api[26091]: 2017-09-28 12:15:29.233 26091 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:15:29 ctl02 nova-api[26091]: 2017-09-28 12:15:29.233 26091 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:15:29 ctl02 nova-api[26091]: 2017-09-28 12:15:29.233 26091 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:15:29 ctl02 nova-api[26091]: 2017-09-28 12:15:29.233 26091 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:15:29 ctl02 nova-api[26091]: 2017-09-28 12:15:29.233 26091 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:15:29 ctl02 nova-api[26091]: 2017-09-28 12:15:29.233 26091 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:15:29 ctl02 nova-api[26091]: 2017-09-28 12:15:29.233 26091 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:15:29 ctl02 nova-api[26091]: 2017-09-28 12:15:29.233 26091 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:15:29 ctl02 nova-api[26091]: 2017-09-28 12:15:29.233 26091 ERROR nova.wsgi     self.filename))
Sep 28 12:15:29 ctl02 nova-api[26091]: 2017-09-28 12:15:29.233 26091 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:15:29 ctl02 nova-api[26091]: 2017-09-28 12:15:29.233 26091 ERROR nova.wsgi
Sep 28 12:15:29 ctl02 nova-api[26091]: 2017-09-28 12:15:29.234 26091 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:15:29 ctl02 nova-api[26091]: 2017-09-28 12:15:29.367 26091 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:15:29 ctl02 nova-api[26091]: 2017-09-28 12:15:29.617 26091 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:15:29 ctl02 nova-api[26091]: 2017-09-28 12:15:29.619 26091 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:15:29 ctl02 nova-api[26091]: 2017-09-28 12:15:29.620 26091 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:15:29 ctl02 nova-api[26091]: 2017-09-28 12:15:29.620 26091 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:15:29 ctl02 nova-api[26091]: 2017-09-28 12:15:29.752 26091 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:15:29 ctl02 nova-api[26091]: 2017-09-28 12:15:29.754 26091 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:15:29 ctl02 nova-api[26091]: 2017-09-28 12:15:29.754 26091 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:15:29 ctl02 nova-api[26091]: 2017-09-28 12:15:29.755 26091 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:15:29 ctl02 nova-api[26091]: 2017-09-28 12:15:29.758 26091 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:15:29 ctl02 nova-api[26091]: 2017-09-28 12:15:29.758 26091 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:15:29 ctl02 nova-api[26091]: 2017-09-28 12:15:29.758 26091 ERROR nova Traceback (most recent call last):
Sep 28 12:15:29 ctl02 nova-api[26091]: 2017-09-28 12:15:29.758 26091 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:15:29 ctl02 nova-api[26091]: 2017-09-28 12:15:29.758 26091 ERROR nova     sys.exit(main())
Sep 28 12:15:29 ctl02 nova-api[26091]: 2017-09-28 12:15:29.758 26091 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:15:29 ctl02 nova-api[26091]: 2017-09-28 12:15:29.758 26091 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:15:29 ctl02 nova-api[26091]: 2017-09-28 12:15:29.758 26091 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:15:29 ctl02 nova-api[26091]: 2017-09-28 12:15:29.758 26091 ERROR nova     max_url_len=max_url_len)
Sep 28 12:15:29 ctl02 nova-api[26091]: 2017-09-28 12:15:29.758 26091 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:15:29 ctl02 nova-api[26091]: 2017-09-28 12:15:29.758 26091 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:15:29 ctl02 nova-api[26091]: 2017-09-28 12:15:29.758 26091 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:15:29 ctl02 nova-api[26091]: 2017-09-28 12:15:29.758 26091 ERROR nova     sock.listen(backlog)
Sep 28 12:15:29 ctl02 nova-api[26091]: 2017-09-28 12:15:29.758 26091 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:15:29 ctl02 nova-api[26091]: 2017-09-28 12:15:29.758 26091 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:15:29 ctl02 nova-api[26091]: 2017-09-28 12:15:29.758 26091 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:15:29 ctl02 nova-api[26091]: 2017-09-28 12:15:29.758 26091 ERROR nova
Sep 28 12:15:29 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:15:29 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:15:29 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:15:30 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:15:30 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:15:30 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:15:30 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:15:30 ctl02 heat-api[13008]: 2017-09-28 12:15:30.274 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:15:30] "OPTIONS / HTTP/1.0" 200 134 0.000659
Sep 28 12:15:30 ctl02 heat-api-cfn[13300]: 2017-09-28 12:15:30.717 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:15:30] "OPTIONS / HTTP/1.0" 200 134 0.000534
Sep 28 12:15:30 ctl02 glance-api[29183]: 2017-09-28 12:15:30.822 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:15:30] "OPTIONS / HTTP/1.0" 200 134 0.000625
Sep 28 12:15:31 ctl02 heat-api-cfn[13300]: 2017-09-28 12:15:31.493 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:15:31] "OPTIONS / HTTP/1.0" 200 134 0.000506
Sep 28 12:15:31 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:15:31.777 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:15:31] "OPTIONS / HTTP/1.0" 200 134 0.000425
Sep 28 12:15:31 ctl02 nova-api[26114]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:15:31 ctl02 nova-api[26114]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:15:31 ctl02 nova-api[26114]: 2017-09-28 12:15:31.981 26114 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:15:31 ctl02 nova-api[26114]: 2017-09-28 12:15:31.983 26114 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:15:31 ctl02 nova-api[26114]: 2017-09-28 12:15:31.983 26114 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:15:31 ctl02 nova-api[26114]: 2017-09-28 12:15:31.983 26114 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:15:31 ctl02 nova-api[26114]: 2017-09-28 12:15:31.983 26114 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:15:31 ctl02 nova-api[26114]: 2017-09-28 12:15:31.983 26114 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:15:31 ctl02 nova-api[26114]: 2017-09-28 12:15:31.983 26114 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:15:31 ctl02 nova-api[26114]: 2017-09-28 12:15:31.983 26114 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:15:31 ctl02 nova-api[26114]: 2017-09-28 12:15:31.983 26114 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:15:31 ctl02 nova-api[26114]: 2017-09-28 12:15:31.983 26114 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:15:31 ctl02 nova-api[26114]: 2017-09-28 12:15:31.983 26114 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:15:31 ctl02 nova-api[26114]: 2017-09-28 12:15:31.983 26114 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:15:31 ctl02 nova-api[26114]: 2017-09-28 12:15:31.983 26114 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:15:31 ctl02 nova-api[26114]: 2017-09-28 12:15:31.983 26114 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:15:31 ctl02 nova-api[26114]: 2017-09-28 12:15:31.983 26114 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:15:31 ctl02 nova-api[26114]: 2017-09-28 12:15:31.983 26114 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:15:31 ctl02 nova-api[26114]: 2017-09-28 12:15:31.983 26114 ERROR nova.wsgi     self.filename))
Sep 28 12:15:31 ctl02 nova-api[26114]: 2017-09-28 12:15:31.983 26114 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:15:31 ctl02 nova-api[26114]: 2017-09-28 12:15:31.983 26114 ERROR nova.wsgi
Sep 28 12:15:31 ctl02 nova-api[26114]: 2017-09-28 12:15:31.984 26114 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:15:32 ctl02 nova-api[26114]: 2017-09-28 12:15:32.117 26114 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:15:32 ctl02 nova-api[26114]: 2017-09-28 12:15:32.368 26114 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:15:32 ctl02 nova-api[26114]: 2017-09-28 12:15:32.371 26114 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:15:32 ctl02 nova-api[26114]: 2017-09-28 12:15:32.371 26114 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:15:32 ctl02 nova-api[26114]: 2017-09-28 12:15:32.371 26114 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:15:32 ctl02 nova-api[26114]: 2017-09-28 12:15:32.503 26114 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:15:32 ctl02 nova-api[26114]: 2017-09-28 12:15:32.506 26114 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:15:32 ctl02 nova-api[26114]: 2017-09-28 12:15:32.506 26114 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:15:32 ctl02 nova-api[26114]: 2017-09-28 12:15:32.506 26114 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:15:32 ctl02 nova-api[26114]: 2017-09-28 12:15:32.510 26114 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:15:32 ctl02 nova-api[26114]: 2017-09-28 12:15:32.510 26114 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:15:32 ctl02 nova-api[26114]: 2017-09-28 12:15:32.510 26114 ERROR nova Traceback (most recent call last):
Sep 28 12:15:32 ctl02 nova-api[26114]: 2017-09-28 12:15:32.510 26114 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:15:32 ctl02 nova-api[26114]: 2017-09-28 12:15:32.510 26114 ERROR nova     sys.exit(main())
Sep 28 12:15:32 ctl02 nova-api[26114]: 2017-09-28 12:15:32.510 26114 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:15:32 ctl02 nova-api[26114]: 2017-09-28 12:15:32.510 26114 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:15:32 ctl02 nova-api[26114]: 2017-09-28 12:15:32.510 26114 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:15:32 ctl02 nova-api[26114]: 2017-09-28 12:15:32.510 26114 ERROR nova     max_url_len=max_url_len)
Sep 28 12:15:32 ctl02 nova-api[26114]: 2017-09-28 12:15:32.510 26114 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:15:32 ctl02 nova-api[26114]: 2017-09-28 12:15:32.510 26114 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:15:32 ctl02 nova-api[26114]: 2017-09-28 12:15:32.510 26114 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:15:32 ctl02 nova-api[26114]: 2017-09-28 12:15:32.510 26114 ERROR nova     sock.listen(backlog)
Sep 28 12:15:32 ctl02 nova-api[26114]: 2017-09-28 12:15:32.510 26114 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:15:32 ctl02 nova-api[26114]: 2017-09-28 12:15:32.510 26114 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:15:32 ctl02 nova-api[26114]: 2017-09-28 12:15:32.510 26114 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:15:32 ctl02 nova-api[26114]: 2017-09-28 12:15:32.510 26114 ERROR nova
Sep 28 12:15:32 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:15:32 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:15:32 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:15:32 ctl02 nova-cert[4860]: 2017-09-28 12:15:32.743 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:15:32 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:15:32 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:15:32 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:15:32 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:15:33 ctl02 glance-api[29183]: 2017-09-28 12:15:33.108 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:15:33] "OPTIONS / HTTP/1.0" 200 134 0.000641
Sep 28 12:15:33 ctl02 heat-api-cfn[13300]: 2017-09-28 12:15:33.604 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:15:33] "OPTIONS / HTTP/1.0" 200 134 0.000575
Sep 28 12:15:33 ctl02 heat-api[13008]: 2017-09-28 12:15:33.938 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:15:33] "OPTIONS / HTTP/1.0" 200 134 0.000548
Sep 28 12:15:34 ctl02 glance-api[29183]: 2017-09-28 12:15:34.260 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:15:34] "OPTIONS / HTTP/1.0" 200 134 0.000557
Sep 28 12:15:34 ctl02 nova-conductor[5056]: 2017-09-28 12:15:34.495 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:15:34 ctl02 nova-conductor[5056]: 2017-09-28 12:15:34.510 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:15:34 ctl02 nova-conductor[5056]: 2017-09-28 12:15:34.512 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:15:34 ctl02 nova-conductor[5056]: 2017-09-28 12:15:34.515 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:15:34 ctl02 nova-api[26133]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:15:34 ctl02 nova-api[26133]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:15:34 ctl02 nova-api[26133]: 2017-09-28 12:15:34.714 26133 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:15:34 ctl02 nova-api[26133]: 2017-09-28 12:15:34.716 26133 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:15:34 ctl02 nova-api[26133]: 2017-09-28 12:15:34.716 26133 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:15:34 ctl02 nova-api[26133]: 2017-09-28 12:15:34.716 26133 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:15:34 ctl02 nova-api[26133]: 2017-09-28 12:15:34.716 26133 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:15:34 ctl02 nova-api[26133]: 2017-09-28 12:15:34.716 26133 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:15:34 ctl02 nova-api[26133]: 2017-09-28 12:15:34.716 26133 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:15:34 ctl02 nova-api[26133]: 2017-09-28 12:15:34.716 26133 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:15:34 ctl02 nova-api[26133]: 2017-09-28 12:15:34.716 26133 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:15:34 ctl02 nova-api[26133]: 2017-09-28 12:15:34.716 26133 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:15:34 ctl02 nova-api[26133]: 2017-09-28 12:15:34.716 26133 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:15:34 ctl02 nova-api[26133]: 2017-09-28 12:15:34.716 26133 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:15:34 ctl02 nova-api[26133]: 2017-09-28 12:15:34.716 26133 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:15:34 ctl02 nova-api[26133]: 2017-09-28 12:15:34.716 26133 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:15:34 ctl02 nova-api[26133]: 2017-09-28 12:15:34.716 26133 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:15:34 ctl02 nova-api[26133]: 2017-09-28 12:15:34.716 26133 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:15:34 ctl02 nova-api[26133]: 2017-09-28 12:15:34.716 26133 ERROR nova.wsgi     self.filename))
Sep 28 12:15:34 ctl02 nova-api[26133]: 2017-09-28 12:15:34.716 26133 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:15:34 ctl02 nova-api[26133]: 2017-09-28 12:15:34.716 26133 ERROR nova.wsgi
Sep 28 12:15:34 ctl02 nova-api[26133]: 2017-09-28 12:15:34.717 26133 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:15:34 ctl02 nova-api[26133]: 2017-09-28 12:15:34.849 26133 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:15:35 ctl02 nova-api[26133]: 2017-09-28 12:15:35.101 26133 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:15:35 ctl02 nova-api[26133]: 2017-09-28 12:15:35.103 26133 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:15:35 ctl02 nova-api[26133]: 2017-09-28 12:15:35.103 26133 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:15:35 ctl02 nova-api[26133]: 2017-09-28 12:15:35.104 26133 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:15:35 ctl02 nova-api[26133]: 2017-09-28 12:15:35.237 26133 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:15:35 ctl02 nova-api[26133]: 2017-09-28 12:15:35.239 26133 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:15:35 ctl02 nova-api[26133]: 2017-09-28 12:15:35.239 26133 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:15:35 ctl02 nova-api[26133]: 2017-09-28 12:15:35.239 26133 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:15:35 ctl02 nova-api[26133]: 2017-09-28 12:15:35.243 26133 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:15:35 ctl02 nova-api[26133]: 2017-09-28 12:15:35.243 26133 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:15:35 ctl02 nova-api[26133]: 2017-09-28 12:15:35.243 26133 ERROR nova Traceback (most recent call last):
Sep 28 12:15:35 ctl02 nova-api[26133]: 2017-09-28 12:15:35.243 26133 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:15:35 ctl02 nova-api[26133]: 2017-09-28 12:15:35.243 26133 ERROR nova     sys.exit(main())
Sep 28 12:15:35 ctl02 nova-api[26133]: 2017-09-28 12:15:35.243 26133 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:15:35 ctl02 nova-api[26133]: 2017-09-28 12:15:35.243 26133 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:15:35 ctl02 nova-api[26133]: 2017-09-28 12:15:35.243 26133 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:15:35 ctl02 nova-api[26133]: 2017-09-28 12:15:35.243 26133 ERROR nova     max_url_len=max_url_len)
Sep 28 12:15:35 ctl02 nova-api[26133]: 2017-09-28 12:15:35.243 26133 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:15:35 ctl02 nova-api[26133]: 2017-09-28 12:15:35.243 26133 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:15:35 ctl02 nova-api[26133]: 2017-09-28 12:15:35.243 26133 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:15:35 ctl02 nova-api[26133]: 2017-09-28 12:15:35.243 26133 ERROR nova     sock.listen(backlog)
Sep 28 12:15:35 ctl02 nova-api[26133]: 2017-09-28 12:15:35.243 26133 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:15:35 ctl02 nova-api[26133]: 2017-09-28 12:15:35.243 26133 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:15:35 ctl02 nova-api[26133]: 2017-09-28 12:15:35.243 26133 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:15:35 ctl02 nova-api[26133]: 2017-09-28 12:15:35.243 26133 ERROR nova
Sep 28 12:15:35 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:15:35 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:15:35 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:15:35 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:15:35 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:15:35 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:15:35 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:15:35 ctl02 heat-api[13008]: 2017-09-28 12:15:35.766 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:15:35] "OPTIONS / HTTP/1.0" 200 134 0.000610
Sep 28 12:15:37 ctl02 nova-api[26150]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:15:37 ctl02 nova-api[26150]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:15:37 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:15:37.383 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:15:37] "OPTIONS / HTTP/1.0" 200 134 0.000477
Sep 28 12:15:37 ctl02 nova-api[26150]: 2017-09-28 12:15:37.475 26150 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:15:37 ctl02 nova-api[26150]: 2017-09-28 12:15:37.477 26150 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:15:37 ctl02 nova-api[26150]: 2017-09-28 12:15:37.477 26150 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:15:37 ctl02 nova-api[26150]: 2017-09-28 12:15:37.477 26150 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:15:37 ctl02 nova-api[26150]: 2017-09-28 12:15:37.477 26150 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:15:37 ctl02 nova-api[26150]: 2017-09-28 12:15:37.477 26150 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:15:37 ctl02 nova-api[26150]: 2017-09-28 12:15:37.477 26150 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:15:37 ctl02 nova-api[26150]: 2017-09-28 12:15:37.477 26150 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:15:37 ctl02 nova-api[26150]: 2017-09-28 12:15:37.477 26150 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:15:37 ctl02 nova-api[26150]: 2017-09-28 12:15:37.477 26150 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:15:37 ctl02 nova-api[26150]: 2017-09-28 12:15:37.477 26150 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:15:37 ctl02 nova-api[26150]: 2017-09-28 12:15:37.477 26150 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:15:37 ctl02 nova-api[26150]: 2017-09-28 12:15:37.477 26150 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:15:37 ctl02 nova-api[26150]: 2017-09-28 12:15:37.477 26150 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:15:37 ctl02 nova-api[26150]: 2017-09-28 12:15:37.477 26150 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:15:37 ctl02 nova-api[26150]: 2017-09-28 12:15:37.477 26150 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:15:37 ctl02 nova-api[26150]: 2017-09-28 12:15:37.477 26150 ERROR nova.wsgi     self.filename))
Sep 28 12:15:37 ctl02 nova-api[26150]: 2017-09-28 12:15:37.477 26150 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:15:37 ctl02 nova-api[26150]: 2017-09-28 12:15:37.477 26150 ERROR nova.wsgi
Sep 28 12:15:37 ctl02 nova-api[26150]: 2017-09-28 12:15:37.479 26150 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:15:37 ctl02 nova-api[26150]: 2017-09-28 12:15:37.611 26150 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:15:37 ctl02 nova-api[26150]: 2017-09-28 12:15:37.854 26150 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:15:37 ctl02 nova-api[26150]: 2017-09-28 12:15:37.857 26150 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:15:37 ctl02 nova-api[26150]: 2017-09-28 12:15:37.858 26150 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:15:37 ctl02 nova-api[26150]: 2017-09-28 12:15:37.858 26150 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:15:37 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:15:37.887 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:15:37] "OPTIONS / HTTP/1.0" 200 134 0.000476
Sep 28 12:15:37 ctl02 nova-api[26150]: 2017-09-28 12:15:37.990 26150 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:15:37 ctl02 nova-api[26150]: 2017-09-28 12:15:37.992 26150 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:15:37 ctl02 nova-api[26150]: 2017-09-28 12:15:37.992 26150 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:15:37 ctl02 nova-api[26150]: 2017-09-28 12:15:37.993 26150 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:15:37 ctl02 nova-api[26150]: 2017-09-28 12:15:37.996 26150 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:15:37 ctl02 nova-api[26150]: 2017-09-28 12:15:37.997 26150 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:15:37 ctl02 nova-api[26150]: 2017-09-28 12:15:37.997 26150 ERROR nova Traceback (most recent call last):
Sep 28 12:15:37 ctl02 nova-api[26150]: 2017-09-28 12:15:37.997 26150 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:15:37 ctl02 nova-api[26150]: 2017-09-28 12:15:37.997 26150 ERROR nova     sys.exit(main())
Sep 28 12:15:37 ctl02 nova-api[26150]: 2017-09-28 12:15:37.997 26150 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:15:37 ctl02 nova-api[26150]: 2017-09-28 12:15:37.997 26150 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:15:37 ctl02 nova-api[26150]: 2017-09-28 12:15:37.997 26150 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:15:37 ctl02 nova-api[26150]: 2017-09-28 12:15:37.997 26150 ERROR nova     max_url_len=max_url_len)
Sep 28 12:15:37 ctl02 nova-api[26150]: 2017-09-28 12:15:37.997 26150 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:15:37 ctl02 nova-api[26150]: 2017-09-28 12:15:37.997 26150 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:15:37 ctl02 nova-api[26150]: 2017-09-28 12:15:37.997 26150 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:15:37 ctl02 nova-api[26150]: 2017-09-28 12:15:37.997 26150 ERROR nova     sock.listen(backlog)
Sep 28 12:15:37 ctl02 nova-api[26150]: 2017-09-28 12:15:37.997 26150 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:15:37 ctl02 nova-api[26150]: 2017-09-28 12:15:37.997 26150 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:15:37 ctl02 nova-api[26150]: 2017-09-28 12:15:37.997 26150 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:15:37 ctl02 nova-api[26150]: 2017-09-28 12:15:37.997 26150 ERROR nova
Sep 28 12:15:38 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa98ceb35)
Sep 28 12:15:38 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:15:38 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:15:38 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:15:38 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:15:38 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:15:38 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:15:38 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:15:39 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa98ceb35)
Sep 28 12:15:39 ctl02 heat-api[13008]: 2017-09-28 12:15:39.890 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:15:39] "OPTIONS / HTTP/1.0" 200 134 0.000742
Sep 28 12:15:40 ctl02 nova-api[26169]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:15:40 ctl02 nova-api[26169]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:15:40 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa98ceb35)
Sep 28 12:15:40 ctl02 nova-api[26169]: 2017-09-28 12:15:40.227 26169 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:15:40 ctl02 nova-api[26169]: 2017-09-28 12:15:40.229 26169 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:15:40 ctl02 nova-api[26169]: 2017-09-28 12:15:40.229 26169 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:15:40 ctl02 nova-api[26169]: 2017-09-28 12:15:40.229 26169 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:15:40 ctl02 nova-api[26169]: 2017-09-28 12:15:40.229 26169 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:15:40 ctl02 nova-api[26169]: 2017-09-28 12:15:40.229 26169 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:15:40 ctl02 nova-api[26169]: 2017-09-28 12:15:40.229 26169 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:15:40 ctl02 nova-api[26169]: 2017-09-28 12:15:40.229 26169 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:15:40 ctl02 nova-api[26169]: 2017-09-28 12:15:40.229 26169 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:15:40 ctl02 nova-api[26169]: 2017-09-28 12:15:40.229 26169 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:15:40 ctl02 nova-api[26169]: 2017-09-28 12:15:40.229 26169 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:15:40 ctl02 nova-api[26169]: 2017-09-28 12:15:40.229 26169 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:15:40 ctl02 nova-api[26169]: 2017-09-28 12:15:40.229 26169 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:15:40 ctl02 nova-api[26169]: 2017-09-28 12:15:40.229 26169 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:15:40 ctl02 nova-api[26169]: 2017-09-28 12:15:40.229 26169 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:15:40 ctl02 nova-api[26169]: 2017-09-28 12:15:40.229 26169 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:15:40 ctl02 nova-api[26169]: 2017-09-28 12:15:40.229 26169 ERROR nova.wsgi     self.filename))
Sep 28 12:15:40 ctl02 nova-api[26169]: 2017-09-28 12:15:40.229 26169 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:15:40 ctl02 nova-api[26169]: 2017-09-28 12:15:40.229 26169 ERROR nova.wsgi
Sep 28 12:15:40 ctl02 nova-api[26169]: 2017-09-28 12:15:40.230 26169 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:15:40 ctl02 nova-api[26169]: 2017-09-28 12:15:40.364 26169 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:15:40 ctl02 nova-api[26169]: 2017-09-28 12:15:40.613 26169 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:15:40 ctl02 nova-api[26169]: 2017-09-28 12:15:40.616 26169 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:15:40 ctl02 nova-api[26169]: 2017-09-28 12:15:40.616 26169 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:15:40 ctl02 nova-api[26169]: 2017-09-28 12:15:40.616 26169 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:15:40 ctl02 nova-api[26169]: 2017-09-28 12:15:40.749 26169 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:15:40 ctl02 nova-api[26169]: 2017-09-28 12:15:40.751 26169 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:15:40 ctl02 nova-api[26169]: 2017-09-28 12:15:40.751 26169 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:15:40 ctl02 nova-api[26169]: 2017-09-28 12:15:40.752 26169 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:15:40 ctl02 nova-api[26169]: 2017-09-28 12:15:40.755 26169 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:15:40 ctl02 nova-api[26169]: 2017-09-28 12:15:40.755 26169 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:15:40 ctl02 nova-api[26169]: 2017-09-28 12:15:40.755 26169 ERROR nova Traceback (most recent call last):
Sep 28 12:15:40 ctl02 nova-api[26169]: 2017-09-28 12:15:40.755 26169 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:15:40 ctl02 nova-api[26169]: 2017-09-28 12:15:40.755 26169 ERROR nova     sys.exit(main())
Sep 28 12:15:40 ctl02 nova-api[26169]: 2017-09-28 12:15:40.755 26169 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:15:40 ctl02 nova-api[26169]: 2017-09-28 12:15:40.755 26169 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:15:40 ctl02 nova-api[26169]: 2017-09-28 12:15:40.755 26169 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:15:40 ctl02 nova-api[26169]: 2017-09-28 12:15:40.755 26169 ERROR nova     max_url_len=max_url_len)
Sep 28 12:15:40 ctl02 nova-api[26169]: 2017-09-28 12:15:40.755 26169 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:15:40 ctl02 nova-api[26169]: 2017-09-28 12:15:40.755 26169 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:15:40 ctl02 nova-api[26169]: 2017-09-28 12:15:40.755 26169 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:15:40 ctl02 nova-api[26169]: 2017-09-28 12:15:40.755 26169 ERROR nova     sock.listen(backlog)
Sep 28 12:15:40 ctl02 nova-api[26169]: 2017-09-28 12:15:40.755 26169 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:15:40 ctl02 nova-api[26169]: 2017-09-28 12:15:40.755 26169 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:15:40 ctl02 nova-api[26169]: 2017-09-28 12:15:40.755 26169 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:15:40 ctl02 nova-api[26169]: 2017-09-28 12:15:40.755 26169 ERROR nova
Sep 28 12:15:40 ctl02 heat-api-cfn[13300]: 2017-09-28 12:15:40.860 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:15:40] "OPTIONS / HTTP/1.0" 200 134 0.000563
Sep 28 12:15:40 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:15:40 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:15:40 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:15:41 ctl02 glance-api[29183]: 2017-09-28 12:15:41.082 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:15:41] "OPTIONS / HTTP/1.0" 200 134 0.000782
Sep 28 12:15:41 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa98ceb35)
Sep 28 12:15:41 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:15:41 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:15:41 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:15:41 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:15:41 ctl02 heat-api-cfn[13300]: 2017-09-28 12:15:41.609 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:15:41] "OPTIONS / HTTP/1.0" 200 134 0.000504
Sep 28 12:15:41 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:15:41.865 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:15:41] "OPTIONS / HTTP/1.0" 200 134 0.000483
Sep 28 12:15:42 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa98ceb35)
Sep 28 12:15:42 ctl02 nova-consoleauth[5433]: 2017-09-28 12:15:42.624 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:15:42 ctl02 nova-api[26186]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:15:42 ctl02 nova-api[26186]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:15:43 ctl02 nova-api[26186]: 2017-09-28 12:15:43.032 26186 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:15:43 ctl02 nova-api[26186]: 2017-09-28 12:15:43.034 26186 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:15:43 ctl02 nova-api[26186]: 2017-09-28 12:15:43.034 26186 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:15:43 ctl02 nova-api[26186]: 2017-09-28 12:15:43.034 26186 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:15:43 ctl02 nova-api[26186]: 2017-09-28 12:15:43.034 26186 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:15:43 ctl02 nova-api[26186]: 2017-09-28 12:15:43.034 26186 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:15:43 ctl02 nova-api[26186]: 2017-09-28 12:15:43.034 26186 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:15:43 ctl02 nova-api[26186]: 2017-09-28 12:15:43.034 26186 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:15:43 ctl02 nova-api[26186]: 2017-09-28 12:15:43.034 26186 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:15:43 ctl02 nova-api[26186]: 2017-09-28 12:15:43.034 26186 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:15:43 ctl02 nova-api[26186]: 2017-09-28 12:15:43.034 26186 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:15:43 ctl02 nova-api[26186]: 2017-09-28 12:15:43.034 26186 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:15:43 ctl02 nova-api[26186]: 2017-09-28 12:15:43.034 26186 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:15:43 ctl02 nova-api[26186]: 2017-09-28 12:15:43.034 26186 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:15:43 ctl02 nova-api[26186]: 2017-09-28 12:15:43.034 26186 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:15:43 ctl02 nova-api[26186]: 2017-09-28 12:15:43.034 26186 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:15:43 ctl02 nova-api[26186]: 2017-09-28 12:15:43.034 26186 ERROR nova.wsgi     self.filename))
Sep 28 12:15:43 ctl02 nova-api[26186]: 2017-09-28 12:15:43.034 26186 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:15:43 ctl02 nova-api[26186]: 2017-09-28 12:15:43.034 26186 ERROR nova.wsgi
Sep 28 12:15:43 ctl02 nova-api[26186]: 2017-09-28 12:15:43.035 26186 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:15:43 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa98ceb35)
Sep 28 12:15:43 ctl02 glance-api[29183]: 2017-09-28 12:15:43.138 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:15:43] "OPTIONS / HTTP/1.0" 200 134 0.000759
Sep 28 12:15:43 ctl02 nova-api[26186]: 2017-09-28 12:15:43.167 26186 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:15:43 ctl02 heat-api-cfn[13300]: 2017-09-28 12:15:43.215 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:15:43] "OPTIONS / HTTP/1.0" 200 134 0.000513
Sep 28 12:15:43 ctl02 nova-api[26186]: 2017-09-28 12:15:43.420 26186 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:15:43 ctl02 nova-api[26186]: 2017-09-28 12:15:43.423 26186 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:15:43 ctl02 nova-api[26186]: 2017-09-28 12:15:43.423 26186 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:15:43 ctl02 nova-api[26186]: 2017-09-28 12:15:43.423 26186 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:15:43 ctl02 nova-api[26186]: 2017-09-28 12:15:43.557 26186 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:15:43 ctl02 nova-api[26186]: 2017-09-28 12:15:43.559 26186 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:15:43 ctl02 nova-api[26186]: 2017-09-28 12:15:43.559 26186 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:15:43 ctl02 nova-api[26186]: 2017-09-28 12:15:43.559 26186 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:15:43 ctl02 nova-api[26186]: 2017-09-28 12:15:43.563 26186 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:15:43 ctl02 nova-api[26186]: 2017-09-28 12:15:43.563 26186 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:15:43 ctl02 nova-api[26186]: 2017-09-28 12:15:43.563 26186 ERROR nova Traceback (most recent call last):
Sep 28 12:15:43 ctl02 nova-api[26186]: 2017-09-28 12:15:43.563 26186 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:15:43 ctl02 nova-api[26186]: 2017-09-28 12:15:43.563 26186 ERROR nova     sys.exit(main())
Sep 28 12:15:43 ctl02 nova-api[26186]: 2017-09-28 12:15:43.563 26186 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:15:43 ctl02 nova-api[26186]: 2017-09-28 12:15:43.563 26186 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:15:43 ctl02 nova-api[26186]: 2017-09-28 12:15:43.563 26186 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:15:43 ctl02 nova-api[26186]: 2017-09-28 12:15:43.563 26186 ERROR nova     max_url_len=max_url_len)
Sep 28 12:15:43 ctl02 nova-api[26186]: 2017-09-28 12:15:43.563 26186 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:15:43 ctl02 nova-api[26186]: 2017-09-28 12:15:43.563 26186 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:15:43 ctl02 nova-api[26186]: 2017-09-28 12:15:43.563 26186 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:15:43 ctl02 nova-api[26186]: 2017-09-28 12:15:43.563 26186 ERROR nova     sock.listen(backlog)
Sep 28 12:15:43 ctl02 nova-api[26186]: 2017-09-28 12:15:43.563 26186 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:15:43 ctl02 nova-api[26186]: 2017-09-28 12:15:43.563 26186 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:15:43 ctl02 nova-api[26186]: 2017-09-28 12:15:43.563 26186 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:15:43 ctl02 nova-api[26186]: 2017-09-28 12:15:43.563 26186 ERROR nova
Sep 28 12:15:43 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:15:43 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:15:43 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:15:43 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:15:43 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:15:43 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:15:43 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:15:44 ctl02 glance-api[29183]: 2017-09-28 12:15:44.062 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:15:44] "OPTIONS / HTTP/1.0" 200 134 0.000757
Sep 28 12:15:44 ctl02 heat-api[13008]: 2017-09-28 12:15:44.063 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:15:44] "OPTIONS / HTTP/1.0" 200 134 0.000616
Sep 28 12:15:44 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa98ceb35)
Sep 28 12:15:45 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa98ceb35)
Sep 28 12:15:45 ctl02 nova-api[26205]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:15:45 ctl02 nova-api[26205]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:15:45 ctl02 heat-api[13008]: 2017-09-28 12:15:45.593 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:15:45] "OPTIONS / HTTP/1.0" 200 134 0.000712
Sep 28 12:15:45 ctl02 heat-engine[12803]: 2017-09-28 12:15:45.566 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:15:45 ctl02 heat-engine[12803]: 2017-09-28 12:15:45.590 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:15:45 ctl02 heat-engine[12803]: 2017-09-28 12:15:45.605 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:15:45 ctl02 heat-engine[12803]: 2017-09-28 12:15:45.616 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:15:45 ctl02 nova-scheduler[5620]: 2017-09-28 12:15:45.650 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:15:45 ctl02 nova-api[26205]: 2017-09-28 12:15:45.751 26205 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:15:45 ctl02 nova-api[26205]: 2017-09-28 12:15:45.753 26205 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:15:45 ctl02 nova-api[26205]: 2017-09-28 12:15:45.753 26205 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:15:45 ctl02 nova-api[26205]: 2017-09-28 12:15:45.753 26205 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:15:45 ctl02 nova-api[26205]: 2017-09-28 12:15:45.753 26205 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:15:45 ctl02 nova-api[26205]: 2017-09-28 12:15:45.753 26205 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:15:45 ctl02 nova-api[26205]: 2017-09-28 12:15:45.753 26205 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:15:45 ctl02 nova-api[26205]: 2017-09-28 12:15:45.753 26205 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:15:45 ctl02 nova-api[26205]: 2017-09-28 12:15:45.753 26205 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:15:45 ctl02 nova-api[26205]: 2017-09-28 12:15:45.753 26205 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:15:45 ctl02 nova-api[26205]: 2017-09-28 12:15:45.753 26205 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:15:45 ctl02 nova-api[26205]: 2017-09-28 12:15:45.753 26205 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:15:45 ctl02 nova-api[26205]: 2017-09-28 12:15:45.753 26205 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:15:45 ctl02 nova-api[26205]: 2017-09-28 12:15:45.753 26205 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:15:45 ctl02 nova-api[26205]: 2017-09-28 12:15:45.753 26205 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:15:45 ctl02 nova-api[26205]: 2017-09-28 12:15:45.753 26205 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:15:45 ctl02 nova-api[26205]: 2017-09-28 12:15:45.753 26205 ERROR nova.wsgi     self.filename))
Sep 28 12:15:45 ctl02 nova-api[26205]: 2017-09-28 12:15:45.753 26205 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:15:45 ctl02 nova-api[26205]: 2017-09-28 12:15:45.753 26205 ERROR nova.wsgi
Sep 28 12:15:45 ctl02 nova-api[26205]: 2017-09-28 12:15:45.754 26205 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:15:45 ctl02 nova-api[26205]: 2017-09-28 12:15:45.887 26205 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:15:46 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa98ceb35)
Sep 28 12:15:46 ctl02 nova-api[26205]: 2017-09-28 12:15:46.136 26205 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:15:46 ctl02 nova-api[26205]: 2017-09-28 12:15:46.138 26205 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:15:46 ctl02 nova-api[26205]: 2017-09-28 12:15:46.139 26205 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:15:46 ctl02 nova-api[26205]: 2017-09-28 12:15:46.139 26205 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:15:46 ctl02 nova-api[26205]: 2017-09-28 12:15:46.273 26205 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:15:46 ctl02 nova-api[26205]: 2017-09-28 12:15:46.275 26205 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:15:46 ctl02 nova-api[26205]: 2017-09-28 12:15:46.275 26205 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:15:46 ctl02 nova-api[26205]: 2017-09-28 12:15:46.275 26205 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:15:46 ctl02 nova-api[26205]: 2017-09-28 12:15:46.279 26205 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:15:46 ctl02 nova-api[26205]: 2017-09-28 12:15:46.279 26205 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:15:46 ctl02 nova-api[26205]: 2017-09-28 12:15:46.279 26205 ERROR nova Traceback (most recent call last):
Sep 28 12:15:46 ctl02 nova-api[26205]: 2017-09-28 12:15:46.279 26205 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:15:46 ctl02 nova-api[26205]: 2017-09-28 12:15:46.279 26205 ERROR nova     sys.exit(main())
Sep 28 12:15:46 ctl02 nova-api[26205]: 2017-09-28 12:15:46.279 26205 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:15:46 ctl02 nova-api[26205]: 2017-09-28 12:15:46.279 26205 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:15:46 ctl02 nova-api[26205]: 2017-09-28 12:15:46.279 26205 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:15:46 ctl02 nova-api[26205]: 2017-09-28 12:15:46.279 26205 ERROR nova     max_url_len=max_url_len)
Sep 28 12:15:46 ctl02 nova-api[26205]: 2017-09-28 12:15:46.279 26205 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:15:46 ctl02 nova-api[26205]: 2017-09-28 12:15:46.279 26205 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:15:46 ctl02 nova-api[26205]: 2017-09-28 12:15:46.279 26205 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:15:46 ctl02 nova-api[26205]: 2017-09-28 12:15:46.279 26205 ERROR nova     sock.listen(backlog)
Sep 28 12:15:46 ctl02 nova-api[26205]: 2017-09-28 12:15:46.279 26205 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:15:46 ctl02 nova-api[26205]: 2017-09-28 12:15:46.279 26205 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:15:46 ctl02 nova-api[26205]: 2017-09-28 12:15:46.279 26205 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:15:46 ctl02 nova-api[26205]: 2017-09-28 12:15:46.279 26205 ERROR nova
Sep 28 12:15:46 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:15:46 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:15:46 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:15:46 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:15:46 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:15:46 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:15:46 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:15:47 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa98ceb35)
Sep 28 12:15:47 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:15:47.495 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:15:47] "OPTIONS / HTTP/1.0" 200 134 0.000493
Sep 28 12:15:47 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:15:47.896 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:15:47] "OPTIONS / HTTP/1.0" 200 134 0.000508
Sep 28 12:15:48 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa98ceb35)
Sep 28 12:15:48 ctl02 nova-api[26224]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:15:48 ctl02 nova-api[26224]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:15:48 ctl02 nova-api[26224]: 2017-09-28 12:15:48.471 26224 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:15:48 ctl02 nova-api[26224]: 2017-09-28 12:15:48.472 26224 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:15:48 ctl02 nova-api[26224]: 2017-09-28 12:15:48.472 26224 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:15:48 ctl02 nova-api[26224]: 2017-09-28 12:15:48.472 26224 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:15:48 ctl02 nova-api[26224]: 2017-09-28 12:15:48.472 26224 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:15:48 ctl02 nova-api[26224]: 2017-09-28 12:15:48.472 26224 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:15:48 ctl02 nova-api[26224]: 2017-09-28 12:15:48.472 26224 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:15:48 ctl02 nova-api[26224]: 2017-09-28 12:15:48.472 26224 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:15:48 ctl02 nova-api[26224]: 2017-09-28 12:15:48.472 26224 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:15:48 ctl02 nova-api[26224]: 2017-09-28 12:15:48.472 26224 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:15:48 ctl02 nova-api[26224]: 2017-09-28 12:15:48.472 26224 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:15:48 ctl02 nova-api[26224]: 2017-09-28 12:15:48.472 26224 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:15:48 ctl02 nova-api[26224]: 2017-09-28 12:15:48.472 26224 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:15:48 ctl02 nova-api[26224]: 2017-09-28 12:15:48.472 26224 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:15:48 ctl02 nova-api[26224]: 2017-09-28 12:15:48.472 26224 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:15:48 ctl02 nova-api[26224]: 2017-09-28 12:15:48.472 26224 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:15:48 ctl02 nova-api[26224]: 2017-09-28 12:15:48.472 26224 ERROR nova.wsgi     self.filename))
Sep 28 12:15:48 ctl02 nova-api[26224]: 2017-09-28 12:15:48.472 26224 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:15:48 ctl02 nova-api[26224]: 2017-09-28 12:15:48.472 26224 ERROR nova.wsgi
Sep 28 12:15:48 ctl02 nova-api[26224]: 2017-09-28 12:15:48.473 26224 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:15:48 ctl02 nova-api[26224]: 2017-09-28 12:15:48.609 26224 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:15:48 ctl02 nova-api[26224]: 2017-09-28 12:15:48.855 26224 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:15:48 ctl02 nova-api[26224]: 2017-09-28 12:15:48.858 26224 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:15:48 ctl02 nova-api[26224]: 2017-09-28 12:15:48.858 26224 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:15:48 ctl02 nova-api[26224]: 2017-09-28 12:15:48.858 26224 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:15:48 ctl02 nova-api[26224]: 2017-09-28 12:15:48.990 26224 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:15:48 ctl02 nova-api[26224]: 2017-09-28 12:15:48.992 26224 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:15:48 ctl02 nova-api[26224]: 2017-09-28 12:15:48.992 26224 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:15:48 ctl02 nova-api[26224]: 2017-09-28 12:15:48.992 26224 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:15:48 ctl02 nova-api[26224]: 2017-09-28 12:15:48.996 26224 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:15:48 ctl02 nova-api[26224]: 2017-09-28 12:15:48.996 26224 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:15:48 ctl02 nova-api[26224]: 2017-09-28 12:15:48.996 26224 ERROR nova Traceback (most recent call last):
Sep 28 12:15:48 ctl02 nova-api[26224]: 2017-09-28 12:15:48.996 26224 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:15:48 ctl02 nova-api[26224]: 2017-09-28 12:15:48.996 26224 ERROR nova     sys.exit(main())
Sep 28 12:15:48 ctl02 nova-api[26224]: 2017-09-28 12:15:48.996 26224 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:15:48 ctl02 nova-api[26224]: 2017-09-28 12:15:48.996 26224 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:15:48 ctl02 nova-api[26224]: 2017-09-28 12:15:48.996 26224 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:15:48 ctl02 nova-api[26224]: 2017-09-28 12:15:48.996 26224 ERROR nova     max_url_len=max_url_len)
Sep 28 12:15:48 ctl02 nova-api[26224]: 2017-09-28 12:15:48.996 26224 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:15:48 ctl02 nova-api[26224]: 2017-09-28 12:15:48.996 26224 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:15:48 ctl02 nova-api[26224]: 2017-09-28 12:15:48.996 26224 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:15:48 ctl02 nova-api[26224]: 2017-09-28 12:15:48.996 26224 ERROR nova     sock.listen(backlog)
Sep 28 12:15:48 ctl02 nova-api[26224]: 2017-09-28 12:15:48.996 26224 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:15:48 ctl02 nova-api[26224]: 2017-09-28 12:15:48.996 26224 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:15:48 ctl02 nova-api[26224]: 2017-09-28 12:15:48.996 26224 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:15:48 ctl02 nova-api[26224]: 2017-09-28 12:15:48.996 26224 ERROR nova
Sep 28 12:15:49 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:15:49 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:15:49 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:15:49 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:15:49 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:15:49 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:15:49 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:15:49 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:15:49 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:15:49 ctl02 heat-api[13008]: 2017-09-28 12:15:49.926 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:15:49] "OPTIONS / HTTP/1.0" 200 134 0.000656
Sep 28 12:15:50 ctl02 heat-api-cfn[13300]: 2017-09-28 12:15:50.542 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:15:50] "OPTIONS / HTTP/1.0" 200 134 0.000614
Sep 28 12:15:51 ctl02 glance-api[29183]: 2017-09-28 12:15:51.019 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:15:51] "OPTIONS / HTTP/1.0" 200 134 0.000640
Sep 28 12:15:51 ctl02 nova-api[26247]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:15:51 ctl02 nova-api[26247]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:15:51 ctl02 nova-api[26247]: 2017-09-28 12:15:51.235 26247 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:15:51 ctl02 nova-api[26247]: 2017-09-28 12:15:51.237 26247 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:15:51 ctl02 nova-api[26247]: 2017-09-28 12:15:51.237 26247 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:15:51 ctl02 nova-api[26247]: 2017-09-28 12:15:51.237 26247 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:15:51 ctl02 nova-api[26247]: 2017-09-28 12:15:51.237 26247 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:15:51 ctl02 nova-api[26247]: 2017-09-28 12:15:51.237 26247 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:15:51 ctl02 nova-api[26247]: 2017-09-28 12:15:51.237 26247 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:15:51 ctl02 nova-api[26247]: 2017-09-28 12:15:51.237 26247 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:15:51 ctl02 nova-api[26247]: 2017-09-28 12:15:51.237 26247 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:15:51 ctl02 nova-api[26247]: 2017-09-28 12:15:51.237 26247 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:15:51 ctl02 nova-api[26247]: 2017-09-28 12:15:51.237 26247 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:15:51 ctl02 nova-api[26247]: 2017-09-28 12:15:51.237 26247 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:15:51 ctl02 nova-api[26247]: 2017-09-28 12:15:51.237 26247 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:15:51 ctl02 nova-api[26247]: 2017-09-28 12:15:51.237 26247 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:15:51 ctl02 nova-api[26247]: 2017-09-28 12:15:51.237 26247 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:15:51 ctl02 nova-api[26247]: 2017-09-28 12:15:51.237 26247 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:15:51 ctl02 nova-api[26247]: 2017-09-28 12:15:51.237 26247 ERROR nova.wsgi     self.filename))
Sep 28 12:15:51 ctl02 nova-api[26247]: 2017-09-28 12:15:51.237 26247 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:15:51 ctl02 nova-api[26247]: 2017-09-28 12:15:51.237 26247 ERROR nova.wsgi
Sep 28 12:15:51 ctl02 nova-api[26247]: 2017-09-28 12:15:51.238 26247 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:15:51 ctl02 heat-api-cfn[13300]: 2017-09-28 12:15:51.278 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:15:51] "OPTIONS / HTTP/1.0" 200 134 0.000515
Sep 28 12:15:51 ctl02 nova-api[26247]: 2017-09-28 12:15:51.371 26247 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:15:51 ctl02 nova-api[26247]: 2017-09-28 12:15:51.624 26247 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:15:51 ctl02 nova-api[26247]: 2017-09-28 12:15:51.626 26247 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:15:51 ctl02 nova-api[26247]: 2017-09-28 12:15:51.626 26247 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:15:51 ctl02 nova-api[26247]: 2017-09-28 12:15:51.627 26247 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:15:51 ctl02 nova-api[26247]: 2017-09-28 12:15:51.759 26247 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:15:51 ctl02 nova-api[26247]: 2017-09-28 12:15:51.761 26247 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:15:51 ctl02 nova-api[26247]: 2017-09-28 12:15:51.761 26247 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:15:51 ctl02 nova-api[26247]: 2017-09-28 12:15:51.761 26247 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:15:51 ctl02 nova-api[26247]: 2017-09-28 12:15:51.765 26247 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:15:51 ctl02 nova-api[26247]: 2017-09-28 12:15:51.765 26247 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:15:51 ctl02 nova-api[26247]: 2017-09-28 12:15:51.765 26247 ERROR nova Traceback (most recent call last):
Sep 28 12:15:51 ctl02 nova-api[26247]: 2017-09-28 12:15:51.765 26247 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:15:51 ctl02 nova-api[26247]: 2017-09-28 12:15:51.765 26247 ERROR nova     sys.exit(main())
Sep 28 12:15:51 ctl02 nova-api[26247]: 2017-09-28 12:15:51.765 26247 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:15:51 ctl02 nova-api[26247]: 2017-09-28 12:15:51.765 26247 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:15:51 ctl02 nova-api[26247]: 2017-09-28 12:15:51.765 26247 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:15:51 ctl02 nova-api[26247]: 2017-09-28 12:15:51.765 26247 ERROR nova     max_url_len=max_url_len)
Sep 28 12:15:51 ctl02 nova-api[26247]: 2017-09-28 12:15:51.765 26247 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:15:51 ctl02 nova-api[26247]: 2017-09-28 12:15:51.765 26247 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:15:51 ctl02 nova-api[26247]: 2017-09-28 12:15:51.765 26247 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:15:51 ctl02 nova-api[26247]: 2017-09-28 12:15:51.765 26247 ERROR nova     sock.listen(backlog)
Sep 28 12:15:51 ctl02 nova-api[26247]: 2017-09-28 12:15:51.765 26247 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:15:51 ctl02 nova-api[26247]: 2017-09-28 12:15:51.765 26247 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:15:51 ctl02 nova-api[26247]: 2017-09-28 12:15:51.765 26247 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:15:51 ctl02 nova-api[26247]: 2017-09-28 12:15:51.765 26247 ERROR nova
Sep 28 12:15:51 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:15:51 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:15:51 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:15:52 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:15:52 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:15:52 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:15:52.136 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:15:52] "OPTIONS / HTTP/1.0" 200 134 0.000544
Sep 28 12:15:52 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:15:52 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:15:53 ctl02 heat-api-cfn[13300]: 2017-09-28 12:15:53.062 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:15:53] "OPTIONS / HTTP/1.0" 200 134 0.000549
Sep 28 12:15:53 ctl02 glance-api[29183]: 2017-09-28 12:15:53.540 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:15:53] "OPTIONS / HTTP/1.0" 200 134 0.000641
Sep 28 12:15:53 ctl02 nova-api[26264]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:15:53 ctl02 nova-api[26264]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:15:53 ctl02 nova-api[26264]: 2017-09-28 12:15:53.976 26264 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:15:53 ctl02 nova-api[26264]: 2017-09-28 12:15:53.978 26264 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:15:53 ctl02 nova-api[26264]: 2017-09-28 12:15:53.978 26264 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:15:53 ctl02 nova-api[26264]: 2017-09-28 12:15:53.978 26264 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:15:53 ctl02 nova-api[26264]: 2017-09-28 12:15:53.978 26264 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:15:53 ctl02 nova-api[26264]: 2017-09-28 12:15:53.978 26264 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:15:53 ctl02 nova-api[26264]: 2017-09-28 12:15:53.978 26264 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:15:53 ctl02 nova-api[26264]: 2017-09-28 12:15:53.978 26264 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:15:53 ctl02 nova-api[26264]: 2017-09-28 12:15:53.978 26264 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:15:53 ctl02 nova-api[26264]: 2017-09-28 12:15:53.978 26264 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:15:53 ctl02 nova-api[26264]: 2017-09-28 12:15:53.978 26264 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:15:53 ctl02 nova-api[26264]: 2017-09-28 12:15:53.978 26264 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:15:53 ctl02 nova-api[26264]: 2017-09-28 12:15:53.978 26264 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:15:53 ctl02 nova-api[26264]: 2017-09-28 12:15:53.978 26264 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:15:53 ctl02 nova-api[26264]: 2017-09-28 12:15:53.978 26264 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:15:53 ctl02 nova-api[26264]: 2017-09-28 12:15:53.978 26264 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:15:53 ctl02 nova-api[26264]: 2017-09-28 12:15:53.978 26264 ERROR nova.wsgi     self.filename))
Sep 28 12:15:53 ctl02 nova-api[26264]: 2017-09-28 12:15:53.978 26264 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:15:53 ctl02 nova-api[26264]: 2017-09-28 12:15:53.978 26264 ERROR nova.wsgi
Sep 28 12:15:53 ctl02 nova-api[26264]: 2017-09-28 12:15:53.979 26264 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:15:53 ctl02 heat-api[13008]: 2017-09-28 12:15:53.987 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:15:53] "OPTIONS / HTTP/1.0" 200 134 0.000576
Sep 28 12:15:54 ctl02 nova-api[26264]: 2017-09-28 12:15:54.115 26264 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:15:54 ctl02 glance-api[29183]: 2017-09-28 12:15:54.153 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:15:54] "OPTIONS / HTTP/1.0" 200 134 0.000650
Sep 28 12:15:54 ctl02 nova-api[26264]: 2017-09-28 12:15:54.367 26264 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:15:54 ctl02 nova-api[26264]: 2017-09-28 12:15:54.369 26264 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:15:54 ctl02 nova-api[26264]: 2017-09-28 12:15:54.369 26264 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:15:54 ctl02 nova-api[26264]: 2017-09-28 12:15:54.370 26264 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:15:54 ctl02 nova-api[26264]: 2017-09-28 12:15:54.503 26264 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:15:54 ctl02 nova-api[26264]: 2017-09-28 12:15:54.505 26264 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:15:54 ctl02 nova-api[26264]: 2017-09-28 12:15:54.505 26264 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:15:54 ctl02 nova-api[26264]: 2017-09-28 12:15:54.506 26264 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:15:54 ctl02 nova-api[26264]: 2017-09-28 12:15:54.509 26264 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:15:54 ctl02 nova-api[26264]: 2017-09-28 12:15:54.509 26264 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:15:54 ctl02 nova-api[26264]: 2017-09-28 12:15:54.509 26264 ERROR nova Traceback (most recent call last):
Sep 28 12:15:54 ctl02 nova-api[26264]: 2017-09-28 12:15:54.509 26264 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:15:54 ctl02 nova-api[26264]: 2017-09-28 12:15:54.509 26264 ERROR nova     sys.exit(main())
Sep 28 12:15:54 ctl02 nova-api[26264]: 2017-09-28 12:15:54.509 26264 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:15:54 ctl02 nova-api[26264]: 2017-09-28 12:15:54.509 26264 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:15:54 ctl02 nova-api[26264]: 2017-09-28 12:15:54.509 26264 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:15:54 ctl02 nova-api[26264]: 2017-09-28 12:15:54.509 26264 ERROR nova     max_url_len=max_url_len)
Sep 28 12:15:54 ctl02 nova-api[26264]: 2017-09-28 12:15:54.509 26264 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:15:54 ctl02 nova-api[26264]: 2017-09-28 12:15:54.509 26264 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:15:54 ctl02 nova-api[26264]: 2017-09-28 12:15:54.509 26264 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:15:54 ctl02 nova-api[26264]: 2017-09-28 12:15:54.509 26264 ERROR nova     sock.listen(backlog)
Sep 28 12:15:54 ctl02 nova-api[26264]: 2017-09-28 12:15:54.509 26264 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:15:54 ctl02 nova-api[26264]: 2017-09-28 12:15:54.509 26264 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:15:54 ctl02 nova-api[26264]: 2017-09-28 12:15:54.509 26264 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:15:54 ctl02 nova-api[26264]: 2017-09-28 12:15:54.509 26264 ERROR nova
Sep 28 12:15:54 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:15:54 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:15:54 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:15:54 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:15:54 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:15:54 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:15:54 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:15:55 ctl02 heat-api[13008]: 2017-09-28 12:15:55.338 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:15:55] "OPTIONS / HTTP/1.0" 200 134 0.000618
Sep 28 12:15:56 ctl02 nova-api[26283]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:15:56 ctl02 nova-api[26283]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:15:56 ctl02 nova-api[26283]: 2017-09-28 12:15:56.741 26283 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:15:56 ctl02 nova-api[26283]: 2017-09-28 12:15:56.744 26283 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:15:56 ctl02 nova-api[26283]: 2017-09-28 12:15:56.744 26283 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:15:56 ctl02 nova-api[26283]: 2017-09-28 12:15:56.744 26283 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:15:56 ctl02 nova-api[26283]: 2017-09-28 12:15:56.744 26283 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:15:56 ctl02 nova-api[26283]: 2017-09-28 12:15:56.744 26283 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:15:56 ctl02 nova-api[26283]: 2017-09-28 12:15:56.744 26283 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:15:56 ctl02 nova-api[26283]: 2017-09-28 12:15:56.744 26283 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:15:56 ctl02 nova-api[26283]: 2017-09-28 12:15:56.744 26283 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:15:56 ctl02 nova-api[26283]: 2017-09-28 12:15:56.744 26283 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:15:56 ctl02 nova-api[26283]: 2017-09-28 12:15:56.744 26283 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:15:56 ctl02 nova-api[26283]: 2017-09-28 12:15:56.744 26283 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:15:56 ctl02 nova-api[26283]: 2017-09-28 12:15:56.744 26283 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:15:56 ctl02 nova-api[26283]: 2017-09-28 12:15:56.744 26283 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:15:56 ctl02 nova-api[26283]: 2017-09-28 12:15:56.744 26283 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:15:56 ctl02 nova-api[26283]: 2017-09-28 12:15:56.744 26283 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:15:56 ctl02 nova-api[26283]: 2017-09-28 12:15:56.744 26283 ERROR nova.wsgi     self.filename))
Sep 28 12:15:56 ctl02 nova-api[26283]: 2017-09-28 12:15:56.744 26283 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:15:56 ctl02 nova-api[26283]: 2017-09-28 12:15:56.744 26283 ERROR nova.wsgi
Sep 28 12:15:56 ctl02 nova-api[26283]: 2017-09-28 12:15:56.746 26283 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:15:56 ctl02 nova-api[26283]: 2017-09-28 12:15:56.880 26283 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:15:57 ctl02 nova-api[26283]: 2017-09-28 12:15:57.130 26283 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:15:57 ctl02 nova-api[26283]: 2017-09-28 12:15:57.134 26283 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:15:57 ctl02 nova-api[26283]: 2017-09-28 12:15:57.134 26283 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:15:57 ctl02 nova-api[26283]: 2017-09-28 12:15:57.134 26283 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:15:57 ctl02 nova-api[26283]: 2017-09-28 12:15:57.269 26283 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:15:57 ctl02 nova-api[26283]: 2017-09-28 12:15:57.271 26283 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:15:57 ctl02 nova-api[26283]: 2017-09-28 12:15:57.271 26283 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:15:57 ctl02 nova-api[26283]: 2017-09-28 12:15:57.272 26283 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:15:57 ctl02 nova-api[26283]: 2017-09-28 12:15:57.275 26283 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:15:57 ctl02 nova-api[26283]: 2017-09-28 12:15:57.275 26283 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:15:57 ctl02 nova-api[26283]: 2017-09-28 12:15:57.275 26283 ERROR nova Traceback (most recent call last):
Sep 28 12:15:57 ctl02 nova-api[26283]: 2017-09-28 12:15:57.275 26283 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:15:57 ctl02 nova-api[26283]: 2017-09-28 12:15:57.275 26283 ERROR nova     sys.exit(main())
Sep 28 12:15:57 ctl02 nova-api[26283]: 2017-09-28 12:15:57.275 26283 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:15:57 ctl02 nova-api[26283]: 2017-09-28 12:15:57.275 26283 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:15:57 ctl02 nova-api[26283]: 2017-09-28 12:15:57.275 26283 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:15:57 ctl02 nova-api[26283]: 2017-09-28 12:15:57.275 26283 ERROR nova     max_url_len=max_url_len)
Sep 28 12:15:57 ctl02 nova-api[26283]: 2017-09-28 12:15:57.275 26283 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:15:57 ctl02 nova-api[26283]: 2017-09-28 12:15:57.275 26283 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:15:57 ctl02 nova-api[26283]: 2017-09-28 12:15:57.275 26283 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:15:57 ctl02 nova-api[26283]: 2017-09-28 12:15:57.275 26283 ERROR nova     sock.listen(backlog)
Sep 28 12:15:57 ctl02 nova-api[26283]: 2017-09-28 12:15:57.275 26283 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:15:57 ctl02 nova-api[26283]: 2017-09-28 12:15:57.275 26283 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:15:57 ctl02 nova-api[26283]: 2017-09-28 12:15:57.275 26283 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:15:57 ctl02 nova-api[26283]: 2017-09-28 12:15:57.275 26283 ERROR nova
Sep 28 12:15:57 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:15:57.382 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:15:57] "OPTIONS / HTTP/1.0" 200 134 0.000480
Sep 28 12:15:57 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:15:57 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:15:57 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:15:57 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:15:57.603 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:15:57] "OPTIONS / HTTP/1.0" 200 134 0.000520
Sep 28 12:15:57 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:15:57 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:15:57 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:15:57 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:15:59 ctl02 nova-api[26301]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:15:59 ctl02 nova-api[26301]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:15:59 ctl02 nova-api[26301]: 2017-09-28 12:15:59.464 26301 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:15:59 ctl02 nova-api[26301]: 2017-09-28 12:15:59.467 26301 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:15:59 ctl02 nova-api[26301]: 2017-09-28 12:15:59.467 26301 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:15:59 ctl02 nova-api[26301]: 2017-09-28 12:15:59.467 26301 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:15:59 ctl02 nova-api[26301]: 2017-09-28 12:15:59.467 26301 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:15:59 ctl02 nova-api[26301]: 2017-09-28 12:15:59.467 26301 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:15:59 ctl02 nova-api[26301]: 2017-09-28 12:15:59.467 26301 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:15:59 ctl02 nova-api[26301]: 2017-09-28 12:15:59.467 26301 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:15:59 ctl02 nova-api[26301]: 2017-09-28 12:15:59.467 26301 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:15:59 ctl02 nova-api[26301]: 2017-09-28 12:15:59.467 26301 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:15:59 ctl02 nova-api[26301]: 2017-09-28 12:15:59.467 26301 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:15:59 ctl02 nova-api[26301]: 2017-09-28 12:15:59.467 26301 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:15:59 ctl02 nova-api[26301]: 2017-09-28 12:15:59.467 26301 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:15:59 ctl02 nova-api[26301]: 2017-09-28 12:15:59.467 26301 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:15:59 ctl02 nova-api[26301]: 2017-09-28 12:15:59.467 26301 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:15:59 ctl02 nova-api[26301]: 2017-09-28 12:15:59.467 26301 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:15:59 ctl02 nova-api[26301]: 2017-09-28 12:15:59.467 26301 ERROR nova.wsgi     self.filename))
Sep 28 12:15:59 ctl02 nova-api[26301]: 2017-09-28 12:15:59.467 26301 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:15:59 ctl02 nova-api[26301]: 2017-09-28 12:15:59.467 26301 ERROR nova.wsgi
Sep 28 12:15:59 ctl02 nova-api[26301]: 2017-09-28 12:15:59.469 26301 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:15:59 ctl02 nova-api[26301]: 2017-09-28 12:15:59.596 26301 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:15:59 ctl02 nova-api[26301]: 2017-09-28 12:15:59.825 26301 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:15:59 ctl02 nova-api[26301]: 2017-09-28 12:15:59.828 26301 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:15:59 ctl02 nova-api[26301]: 2017-09-28 12:15:59.829 26301 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:15:59 ctl02 nova-api[26301]: 2017-09-28 12:15:59.829 26301 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:15:59 ctl02 heat-api[13008]: 2017-09-28 12:15:59.840 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:15:59] "OPTIONS / HTTP/1.0" 200 134 0.000553
Sep 28 12:15:59 ctl02 nova-api[26301]: 2017-09-28 12:15:59.961 26301 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:15:59 ctl02 nova-api[26301]: 2017-09-28 12:15:59.964 26301 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:15:59 ctl02 nova-api[26301]: 2017-09-28 12:15:59.964 26301 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:15:59 ctl02 nova-api[26301]: 2017-09-28 12:15:59.965 26301 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:15:59 ctl02 nova-api[26301]: 2017-09-28 12:15:59.968 26301 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:15:59 ctl02 nova-api[26301]: 2017-09-28 12:15:59.969 26301 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:15:59 ctl02 nova-api[26301]: 2017-09-28 12:15:59.969 26301 ERROR nova Traceback (most recent call last):
Sep 28 12:15:59 ctl02 nova-api[26301]: 2017-09-28 12:15:59.969 26301 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:15:59 ctl02 nova-api[26301]: 2017-09-28 12:15:59.969 26301 ERROR nova     sys.exit(main())
Sep 28 12:15:59 ctl02 nova-api[26301]: 2017-09-28 12:15:59.969 26301 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:15:59 ctl02 nova-api[26301]: 2017-09-28 12:15:59.969 26301 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:15:59 ctl02 nova-api[26301]: 2017-09-28 12:15:59.969 26301 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:15:59 ctl02 nova-api[26301]: 2017-09-28 12:15:59.969 26301 ERROR nova     max_url_len=max_url_len)
Sep 28 12:15:59 ctl02 nova-api[26301]: 2017-09-28 12:15:59.969 26301 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:15:59 ctl02 nova-api[26301]: 2017-09-28 12:15:59.969 26301 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:15:59 ctl02 nova-api[26301]: 2017-09-28 12:15:59.969 26301 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:15:59 ctl02 nova-api[26301]: 2017-09-28 12:15:59.969 26301 ERROR nova     sock.listen(backlog)
Sep 28 12:15:59 ctl02 nova-api[26301]: 2017-09-28 12:15:59.969 26301 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:15:59 ctl02 nova-api[26301]: 2017-09-28 12:15:59.969 26301 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:15:59 ctl02 nova-api[26301]: 2017-09-28 12:15:59.969 26301 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:15:59 ctl02 nova-api[26301]: 2017-09-28 12:15:59.969 26301 ERROR nova
Sep 28 12:16:00 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:16:00 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:16:00 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:16:00 ctl02 heat-api-cfn[13300]: 2017-09-28 12:16:00.250 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:16:00] "OPTIONS / HTTP/1.0" 200 134 0.000622
Sep 28 12:16:00 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:16:00 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:16:00 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:16:00 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:16:01 ctl02 glance-api[29183]: 2017-09-28 12:16:01.105 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:16:01] "OPTIONS / HTTP/1.0" 200 134 0.001287
Sep 28 12:16:01 ctl02 heat-api-cfn[13300]: 2017-09-28 12:16:01.434 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:16:01] "OPTIONS / HTTP/1.0" 200 134 0.000547
Sep 28 12:16:02 ctl02 nova-api[26319]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:16:02 ctl02 nova-api[26319]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:16:02 ctl02 nova-api[26319]: 2017-09-28 12:16:02.244 26319 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:16:02 ctl02 nova-api[26319]: 2017-09-28 12:16:02.246 26319 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:16:02 ctl02 nova-api[26319]: 2017-09-28 12:16:02.246 26319 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:16:02 ctl02 nova-api[26319]: 2017-09-28 12:16:02.246 26319 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:16:02 ctl02 nova-api[26319]: 2017-09-28 12:16:02.246 26319 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:16:02 ctl02 nova-api[26319]: 2017-09-28 12:16:02.246 26319 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:16:02 ctl02 nova-api[26319]: 2017-09-28 12:16:02.246 26319 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:16:02 ctl02 nova-api[26319]: 2017-09-28 12:16:02.246 26319 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:16:02 ctl02 nova-api[26319]: 2017-09-28 12:16:02.246 26319 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:16:02 ctl02 nova-api[26319]: 2017-09-28 12:16:02.246 26319 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:16:02 ctl02 nova-api[26319]: 2017-09-28 12:16:02.246 26319 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:16:02 ctl02 nova-api[26319]: 2017-09-28 12:16:02.246 26319 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:16:02 ctl02 nova-api[26319]: 2017-09-28 12:16:02.246 26319 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:16:02 ctl02 nova-api[26319]: 2017-09-28 12:16:02.246 26319 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:16:02 ctl02 nova-api[26319]: 2017-09-28 12:16:02.246 26319 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:16:02 ctl02 nova-api[26319]: 2017-09-28 12:16:02.246 26319 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:16:02 ctl02 nova-api[26319]: 2017-09-28 12:16:02.246 26319 ERROR nova.wsgi     self.filename))
Sep 28 12:16:02 ctl02 nova-api[26319]: 2017-09-28 12:16:02.246 26319 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:16:02 ctl02 nova-api[26319]: 2017-09-28 12:16:02.246 26319 ERROR nova.wsgi
Sep 28 12:16:02 ctl02 nova-api[26319]: 2017-09-28 12:16:02.249 26319 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:16:02 ctl02 nova-api[26319]: 2017-09-28 12:16:02.383 26319 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:16:02 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:16:02.491 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:16:02] "OPTIONS / HTTP/1.0" 200 134 0.000511
Sep 28 12:16:02 ctl02 nova-api[26319]: 2017-09-28 12:16:02.630 26319 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:16:02 ctl02 nova-api[26319]: 2017-09-28 12:16:02.633 26319 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:16:02 ctl02 nova-api[26319]: 2017-09-28 12:16:02.633 26319 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:16:02 ctl02 nova-api[26319]: 2017-09-28 12:16:02.633 26319 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:16:02 ctl02 nova-api[26319]: 2017-09-28 12:16:02.765 26319 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:16:02 ctl02 nova-api[26319]: 2017-09-28 12:16:02.768 26319 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:16:02 ctl02 nova-api[26319]: 2017-09-28 12:16:02.768 26319 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:16:02 ctl02 nova-api[26319]: 2017-09-28 12:16:02.769 26319 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:16:02 ctl02 nova-api[26319]: 2017-09-28 12:16:02.772 26319 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:16:02 ctl02 nova-api[26319]: 2017-09-28 12:16:02.773 26319 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:16:02 ctl02 nova-api[26319]: 2017-09-28 12:16:02.773 26319 ERROR nova Traceback (most recent call last):
Sep 28 12:16:02 ctl02 nova-api[26319]: 2017-09-28 12:16:02.773 26319 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:16:02 ctl02 nova-api[26319]: 2017-09-28 12:16:02.773 26319 ERROR nova     sys.exit(main())
Sep 28 12:16:02 ctl02 nova-api[26319]: 2017-09-28 12:16:02.773 26319 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:16:02 ctl02 nova-api[26319]: 2017-09-28 12:16:02.773 26319 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:16:02 ctl02 nova-api[26319]: 2017-09-28 12:16:02.773 26319 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:16:02 ctl02 nova-api[26319]: 2017-09-28 12:16:02.773 26319 ERROR nova     max_url_len=max_url_len)
Sep 28 12:16:02 ctl02 nova-api[26319]: 2017-09-28 12:16:02.773 26319 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:16:02 ctl02 nova-api[26319]: 2017-09-28 12:16:02.773 26319 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:16:02 ctl02 nova-api[26319]: 2017-09-28 12:16:02.773 26319 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:16:02 ctl02 nova-api[26319]: 2017-09-28 12:16:02.773 26319 ERROR nova     sock.listen(backlog)
Sep 28 12:16:02 ctl02 nova-api[26319]: 2017-09-28 12:16:02.773 26319 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:16:02 ctl02 nova-api[26319]: 2017-09-28 12:16:02.773 26319 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:16:02 ctl02 nova-api[26319]: 2017-09-28 12:16:02.773 26319 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:16:02 ctl02 nova-api[26319]: 2017-09-28 12:16:02.773 26319 ERROR nova
Sep 28 12:16:02 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:16:02 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:16:02 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:16:03 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:16:03 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:16:03 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:16:03 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:16:03 ctl02 heat-api-cfn[13300]: 2017-09-28 12:16:03.356 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:16:03] "OPTIONS / HTTP/1.0" 200 134 0.000546
Sep 28 12:16:03 ctl02 glance-api[29183]: 2017-09-28 12:16:03.423 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:16:03] "OPTIONS / HTTP/1.0" 200 134 0.000639
Sep 28 12:16:04 ctl02 heat-api[13008]: 2017-09-28 12:16:04.295 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:16:04] "OPTIONS / HTTP/1.0" 200 134 0.000603
Sep 28 12:16:04 ctl02 glance-api[29183]: 2017-09-28 12:16:04.302 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:16:04] "OPTIONS / HTTP/1.0" 200 134 0.000619
Sep 28 12:16:04 ctl02 nova-cert[4860]: 2017-09-28 12:16:04.781 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:16:04 ctl02 nova-api[26338]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:16:04 ctl02 nova-api[26338]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:16:04 ctl02 nova-api[26338]: 2017-09-28 12:16:04.998 26338 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:16:05 ctl02 nova-api[26338]: 2017-09-28 12:16:05.000 26338 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:16:05 ctl02 nova-api[26338]: 2017-09-28 12:16:05.000 26338 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:16:05 ctl02 nova-api[26338]: 2017-09-28 12:16:05.000 26338 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:16:05 ctl02 nova-api[26338]: 2017-09-28 12:16:05.000 26338 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:16:05 ctl02 nova-api[26338]: 2017-09-28 12:16:05.000 26338 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:16:05 ctl02 nova-api[26338]: 2017-09-28 12:16:05.000 26338 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:16:05 ctl02 nova-api[26338]: 2017-09-28 12:16:05.000 26338 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:16:05 ctl02 nova-api[26338]: 2017-09-28 12:16:05.000 26338 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:16:05 ctl02 nova-api[26338]: 2017-09-28 12:16:05.000 26338 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:16:05 ctl02 nova-api[26338]: 2017-09-28 12:16:05.000 26338 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:16:05 ctl02 nova-api[26338]: 2017-09-28 12:16:05.000 26338 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:16:05 ctl02 nova-api[26338]: 2017-09-28 12:16:05.000 26338 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:16:05 ctl02 nova-api[26338]: 2017-09-28 12:16:05.000 26338 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:16:05 ctl02 nova-api[26338]: 2017-09-28 12:16:05.000 26338 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:16:05 ctl02 nova-api[26338]: 2017-09-28 12:16:05.000 26338 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:16:05 ctl02 nova-api[26338]: 2017-09-28 12:16:05.000 26338 ERROR nova.wsgi     self.filename))
Sep 28 12:16:05 ctl02 nova-api[26338]: 2017-09-28 12:16:05.000 26338 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:16:05 ctl02 nova-api[26338]: 2017-09-28 12:16:05.000 26338 ERROR nova.wsgi
Sep 28 12:16:05 ctl02 nova-api[26338]: 2017-09-28 12:16:05.003 26338 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:16:05 ctl02 nova-api[26338]: 2017-09-28 12:16:05.136 26338 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:16:05 ctl02 nova-api[26338]: 2017-09-28 12:16:05.385 26338 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:16:05 ctl02 nova-api[26338]: 2017-09-28 12:16:05.388 26338 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:16:05 ctl02 nova-api[26338]: 2017-09-28 12:16:05.388 26338 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:16:05 ctl02 nova-api[26338]: 2017-09-28 12:16:05.389 26338 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:16:05 ctl02 nova-api[26338]: 2017-09-28 12:16:05.521 26338 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:16:05 ctl02 nova-api[26338]: 2017-09-28 12:16:05.524 26338 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:16:05 ctl02 nova-api[26338]: 2017-09-28 12:16:05.524 26338 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:16:05 ctl02 nova-api[26338]: 2017-09-28 12:16:05.525 26338 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:16:05 ctl02 nova-api[26338]: 2017-09-28 12:16:05.528 26338 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:16:05 ctl02 nova-api[26338]: 2017-09-28 12:16:05.529 26338 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:16:05 ctl02 nova-api[26338]: 2017-09-28 12:16:05.529 26338 ERROR nova Traceback (most recent call last):
Sep 28 12:16:05 ctl02 nova-api[26338]: 2017-09-28 12:16:05.529 26338 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:16:05 ctl02 nova-api[26338]: 2017-09-28 12:16:05.529 26338 ERROR nova     sys.exit(main())
Sep 28 12:16:05 ctl02 nova-api[26338]: 2017-09-28 12:16:05.529 26338 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:16:05 ctl02 nova-api[26338]: 2017-09-28 12:16:05.529 26338 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:16:05 ctl02 nova-api[26338]: 2017-09-28 12:16:05.529 26338 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:16:05 ctl02 nova-api[26338]: 2017-09-28 12:16:05.529 26338 ERROR nova     max_url_len=max_url_len)
Sep 28 12:16:05 ctl02 nova-api[26338]: 2017-09-28 12:16:05.529 26338 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:16:05 ctl02 nova-api[26338]: 2017-09-28 12:16:05.529 26338 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:16:05 ctl02 nova-api[26338]: 2017-09-28 12:16:05.529 26338 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:16:05 ctl02 nova-api[26338]: 2017-09-28 12:16:05.529 26338 ERROR nova     sock.listen(backlog)
Sep 28 12:16:05 ctl02 nova-api[26338]: 2017-09-28 12:16:05.529 26338 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:16:05 ctl02 nova-api[26338]: 2017-09-28 12:16:05.529 26338 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:16:05 ctl02 nova-api[26338]: 2017-09-28 12:16:05.529 26338 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:16:05 ctl02 nova-api[26338]: 2017-09-28 12:16:05.529 26338 ERROR nova
Sep 28 12:16:05 ctl02 heat-api[13008]: 2017-09-28 12:16:05.563 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:16:05] "OPTIONS / HTTP/1.0" 200 134 0.000649
Sep 28 12:16:05 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:16:05 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:16:05 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:16:05 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:16:05 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:16:05 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:16:05 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:16:06 ctl02 nova-conductor[5056]: 2017-09-28 12:16:06.504 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:16:06 ctl02 nova-conductor[5056]: 2017-09-28 12:16:06.519 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:16:06 ctl02 nova-conductor[5056]: 2017-09-28 12:16:06.521 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:16:06 ctl02 nova-conductor[5056]: 2017-09-28 12:16:06.524 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:16:07 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:16:07.287 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:16:07] "OPTIONS / HTTP/1.0" 200 134 0.000461
Sep 28 12:16:07 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:16:07.336 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:16:07] "OPTIONS / HTTP/1.0" 200 134 0.000279
Sep 28 12:16:07 ctl02 nova-api[26356]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:16:07 ctl02 nova-api[26356]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:16:07 ctl02 nova-api[26356]: 2017-09-28 12:16:07.748 26356 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:16:07 ctl02 nova-api[26356]: 2017-09-28 12:16:07.750 26356 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:16:07 ctl02 nova-api[26356]: 2017-09-28 12:16:07.750 26356 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:16:07 ctl02 nova-api[26356]: 2017-09-28 12:16:07.750 26356 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:16:07 ctl02 nova-api[26356]: 2017-09-28 12:16:07.750 26356 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:16:07 ctl02 nova-api[26356]: 2017-09-28 12:16:07.750 26356 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:16:07 ctl02 nova-api[26356]: 2017-09-28 12:16:07.750 26356 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:16:07 ctl02 nova-api[26356]: 2017-09-28 12:16:07.750 26356 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:16:07 ctl02 nova-api[26356]: 2017-09-28 12:16:07.750 26356 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:16:07 ctl02 nova-api[26356]: 2017-09-28 12:16:07.750 26356 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:16:07 ctl02 nova-api[26356]: 2017-09-28 12:16:07.750 26356 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:16:07 ctl02 nova-api[26356]: 2017-09-28 12:16:07.750 26356 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:16:07 ctl02 nova-api[26356]: 2017-09-28 12:16:07.750 26356 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:16:07 ctl02 nova-api[26356]: 2017-09-28 12:16:07.750 26356 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:16:07 ctl02 nova-api[26356]: 2017-09-28 12:16:07.750 26356 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:16:07 ctl02 nova-api[26356]: 2017-09-28 12:16:07.750 26356 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:16:07 ctl02 nova-api[26356]: 2017-09-28 12:16:07.750 26356 ERROR nova.wsgi     self.filename))
Sep 28 12:16:07 ctl02 nova-api[26356]: 2017-09-28 12:16:07.750 26356 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:16:07 ctl02 nova-api[26356]: 2017-09-28 12:16:07.750 26356 ERROR nova.wsgi
Sep 28 12:16:07 ctl02 nova-api[26356]: 2017-09-28 12:16:07.750 26356 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:16:07 ctl02 nova-api[26356]: 2017-09-28 12:16:07.882 26356 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:16:08 ctl02 nova-api[26356]: 2017-09-28 12:16:08.134 26356 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:16:08 ctl02 nova-api[26356]: 2017-09-28 12:16:08.136 26356 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:16:08 ctl02 nova-api[26356]: 2017-09-28 12:16:08.136 26356 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:16:08 ctl02 nova-api[26356]: 2017-09-28 12:16:08.137 26356 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:16:08 ctl02 nova-api[26356]: 2017-09-28 12:16:08.269 26356 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:16:08 ctl02 nova-api[26356]: 2017-09-28 12:16:08.271 26356 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:16:08 ctl02 nova-api[26356]: 2017-09-28 12:16:08.271 26356 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:16:08 ctl02 nova-api[26356]: 2017-09-28 12:16:08.272 26356 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:16:08 ctl02 nova-api[26356]: 2017-09-28 12:16:08.275 26356 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:16:08 ctl02 nova-api[26356]: 2017-09-28 12:16:08.275 26356 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:16:08 ctl02 nova-api[26356]: 2017-09-28 12:16:08.275 26356 ERROR nova Traceback (most recent call last):
Sep 28 12:16:08 ctl02 nova-api[26356]: 2017-09-28 12:16:08.275 26356 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:16:08 ctl02 nova-api[26356]: 2017-09-28 12:16:08.275 26356 ERROR nova     sys.exit(main())
Sep 28 12:16:08 ctl02 nova-api[26356]: 2017-09-28 12:16:08.275 26356 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:16:08 ctl02 nova-api[26356]: 2017-09-28 12:16:08.275 26356 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:16:08 ctl02 nova-api[26356]: 2017-09-28 12:16:08.275 26356 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:16:08 ctl02 nova-api[26356]: 2017-09-28 12:16:08.275 26356 ERROR nova     max_url_len=max_url_len)
Sep 28 12:16:08 ctl02 nova-api[26356]: 2017-09-28 12:16:08.275 26356 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:16:08 ctl02 nova-api[26356]: 2017-09-28 12:16:08.275 26356 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:16:08 ctl02 nova-api[26356]: 2017-09-28 12:16:08.275 26356 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:16:08 ctl02 nova-api[26356]: 2017-09-28 12:16:08.275 26356 ERROR nova     sock.listen(backlog)
Sep 28 12:16:08 ctl02 nova-api[26356]: 2017-09-28 12:16:08.275 26356 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:16:08 ctl02 nova-api[26356]: 2017-09-28 12:16:08.275 26356 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:16:08 ctl02 nova-api[26356]: 2017-09-28 12:16:08.275 26356 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:16:08 ctl02 nova-api[26356]: 2017-09-28 12:16:08.275 26356 ERROR nova
Sep 28 12:16:08 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:16:08 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:16:08 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:16:08 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:16:08 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:16:08 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:16:08 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:16:09 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xce649050)
Sep 28 12:16:09 ctl02 heat-api[13008]: 2017-09-28 12:16:09.467 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:16:09] "OPTIONS / HTTP/1.0" 200 134 0.000630
Sep 28 12:16:10 ctl02 heat-api-cfn[13300]: 2017-09-28 12:16:10.185 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:16:10] "OPTIONS / HTTP/1.0" 200 134 0.000518
Sep 28 12:16:10 ctl02 nova-api[26374]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:16:10 ctl02 nova-api[26374]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:16:10 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xce649050)
Sep 28 12:16:10 ctl02 nova-api[26374]: 2017-09-28 12:16:10.490 26374 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:16:10 ctl02 nova-api[26374]: 2017-09-28 12:16:10.492 26374 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:16:10 ctl02 nova-api[26374]: 2017-09-28 12:16:10.492 26374 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:16:10 ctl02 nova-api[26374]: 2017-09-28 12:16:10.492 26374 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:16:10 ctl02 nova-api[26374]: 2017-09-28 12:16:10.492 26374 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:16:10 ctl02 nova-api[26374]: 2017-09-28 12:16:10.492 26374 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:16:10 ctl02 nova-api[26374]: 2017-09-28 12:16:10.492 26374 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:16:10 ctl02 nova-api[26374]: 2017-09-28 12:16:10.492 26374 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:16:10 ctl02 nova-api[26374]: 2017-09-28 12:16:10.492 26374 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:16:10 ctl02 nova-api[26374]: 2017-09-28 12:16:10.492 26374 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:16:10 ctl02 nova-api[26374]: 2017-09-28 12:16:10.492 26374 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:16:10 ctl02 nova-api[26374]: 2017-09-28 12:16:10.492 26374 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:16:10 ctl02 nova-api[26374]: 2017-09-28 12:16:10.492 26374 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:16:10 ctl02 nova-api[26374]: 2017-09-28 12:16:10.492 26374 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:16:10 ctl02 nova-api[26374]: 2017-09-28 12:16:10.492 26374 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:16:10 ctl02 nova-api[26374]: 2017-09-28 12:16:10.492 26374 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:16:10 ctl02 nova-api[26374]: 2017-09-28 12:16:10.492 26374 ERROR nova.wsgi     self.filename))
Sep 28 12:16:10 ctl02 nova-api[26374]: 2017-09-28 12:16:10.492 26374 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:16:10 ctl02 nova-api[26374]: 2017-09-28 12:16:10.492 26374 ERROR nova.wsgi
Sep 28 12:16:10 ctl02 nova-api[26374]: 2017-09-28 12:16:10.495 26374 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:16:10 ctl02 nova-api[26374]: 2017-09-28 12:16:10.629 26374 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:16:10 ctl02 nova-api[26374]: 2017-09-28 12:16:10.883 26374 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:16:10 ctl02 nova-api[26374]: 2017-09-28 12:16:10.886 26374 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:16:10 ctl02 nova-api[26374]: 2017-09-28 12:16:10.887 26374 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:16:10 ctl02 nova-api[26374]: 2017-09-28 12:16:10.887 26374 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:16:11 ctl02 nova-api[26374]: 2017-09-28 12:16:11.020 26374 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:16:11 ctl02 nova-api[26374]: 2017-09-28 12:16:11.023 26374 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:16:11 ctl02 nova-api[26374]: 2017-09-28 12:16:11.023 26374 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:16:11 ctl02 nova-api[26374]: 2017-09-28 12:16:11.024 26374 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:16:11 ctl02 glance-api[29183]: 2017-09-28 12:16:11.028 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:16:11] "OPTIONS / HTTP/1.0" 200 134 0.000632
Sep 28 12:16:11 ctl02 nova-api[26374]: 2017-09-28 12:16:11.029 26374 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:16:11 ctl02 nova-api[26374]: 2017-09-28 12:16:11.029 26374 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:16:11 ctl02 nova-api[26374]: 2017-09-28 12:16:11.029 26374 ERROR nova Traceback (most recent call last):
Sep 28 12:16:11 ctl02 nova-api[26374]: 2017-09-28 12:16:11.029 26374 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:16:11 ctl02 nova-api[26374]: 2017-09-28 12:16:11.029 26374 ERROR nova     sys.exit(main())
Sep 28 12:16:11 ctl02 nova-api[26374]: 2017-09-28 12:16:11.029 26374 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:16:11 ctl02 nova-api[26374]: 2017-09-28 12:16:11.029 26374 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:16:11 ctl02 nova-api[26374]: 2017-09-28 12:16:11.029 26374 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:16:11 ctl02 nova-api[26374]: 2017-09-28 12:16:11.029 26374 ERROR nova     max_url_len=max_url_len)
Sep 28 12:16:11 ctl02 nova-api[26374]: 2017-09-28 12:16:11.029 26374 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:16:11 ctl02 nova-api[26374]: 2017-09-28 12:16:11.029 26374 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:16:11 ctl02 nova-api[26374]: 2017-09-28 12:16:11.029 26374 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:16:11 ctl02 nova-api[26374]: 2017-09-28 12:16:11.029 26374 ERROR nova     sock.listen(backlog)
Sep 28 12:16:11 ctl02 nova-api[26374]: 2017-09-28 12:16:11.029 26374 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:16:11 ctl02 nova-api[26374]: 2017-09-28 12:16:11.029 26374 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:16:11 ctl02 nova-api[26374]: 2017-09-28 12:16:11.029 26374 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:16:11 ctl02 nova-api[26374]: 2017-09-28 12:16:11.029 26374 ERROR nova
Sep 28 12:16:11 ctl02 heat-api-cfn[13300]: 2017-09-28 12:16:11.174 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:16:11] "OPTIONS / HTTP/1.0" 200 134 0.000501
Sep 28 12:16:11 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:16:11 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:16:11 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:16:11 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:16:11 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:16:11 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:16:11 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:16:11 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xce649050)
Sep 28 12:16:12 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:16:12.400 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:16:12] "OPTIONS / HTTP/1.0" 200 134 0.000493
Sep 28 12:16:12 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xce649050)
Sep 28 12:16:12 ctl02 heat-api-cfn[13300]: 2017-09-28 12:16:12.968 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:16:12] "OPTIONS / HTTP/1.0" 200 134 0.000626
Sep 28 12:16:13 ctl02 nova-api[26392]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:16:13 ctl02 nova-api[26392]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:16:13 ctl02 nova-api[26392]: 2017-09-28 12:16:13.252 26392 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:16:13 ctl02 nova-api[26392]: 2017-09-28 12:16:13.254 26392 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:16:13 ctl02 nova-api[26392]: 2017-09-28 12:16:13.254 26392 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:16:13 ctl02 nova-api[26392]: 2017-09-28 12:16:13.254 26392 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:16:13 ctl02 nova-api[26392]: 2017-09-28 12:16:13.254 26392 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:16:13 ctl02 nova-api[26392]: 2017-09-28 12:16:13.254 26392 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:16:13 ctl02 nova-api[26392]: 2017-09-28 12:16:13.254 26392 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:16:13 ctl02 nova-api[26392]: 2017-09-28 12:16:13.254 26392 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:16:13 ctl02 nova-api[26392]: 2017-09-28 12:16:13.254 26392 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:16:13 ctl02 nova-api[26392]: 2017-09-28 12:16:13.254 26392 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:16:13 ctl02 nova-api[26392]: 2017-09-28 12:16:13.254 26392 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:16:13 ctl02 nova-api[26392]: 2017-09-28 12:16:13.254 26392 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:16:13 ctl02 nova-api[26392]: 2017-09-28 12:16:13.254 26392 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:16:13 ctl02 nova-api[26392]: 2017-09-28 12:16:13.254 26392 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:16:13 ctl02 nova-api[26392]: 2017-09-28 12:16:13.254 26392 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:16:13 ctl02 nova-api[26392]: 2017-09-28 12:16:13.254 26392 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:16:13 ctl02 nova-api[26392]: 2017-09-28 12:16:13.254 26392 ERROR nova.wsgi     self.filename))
Sep 28 12:16:13 ctl02 nova-api[26392]: 2017-09-28 12:16:13.254 26392 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:16:13 ctl02 nova-api[26392]: 2017-09-28 12:16:13.254 26392 ERROR nova.wsgi
Sep 28 12:16:13 ctl02 nova-api[26392]: 2017-09-28 12:16:13.257 26392 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:16:13 ctl02 nova-api[26392]: 2017-09-28 12:16:13.395 26392 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:16:13 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xce649050)
Sep 28 12:16:13 ctl02 nova-api[26392]: 2017-09-28 12:16:13.648 26392 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:16:13 ctl02 nova-api[26392]: 2017-09-28 12:16:13.650 26392 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:16:13 ctl02 nova-api[26392]: 2017-09-28 12:16:13.651 26392 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:16:13 ctl02 nova-api[26392]: 2017-09-28 12:16:13.651 26392 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:16:13 ctl02 glance-api[29183]: 2017-09-28 12:16:13.752 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:16:13] "OPTIONS / HTTP/1.0" 200 134 0.000640
Sep 28 12:16:13 ctl02 nova-api[26392]: 2017-09-28 12:16:13.786 26392 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:16:13 ctl02 nova-api[26392]: 2017-09-28 12:16:13.789 26392 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:16:13 ctl02 nova-api[26392]: 2017-09-28 12:16:13.789 26392 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:16:13 ctl02 nova-api[26392]: 2017-09-28 12:16:13.789 26392 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:16:13 ctl02 nova-api[26392]: 2017-09-28 12:16:13.793 26392 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:16:13 ctl02 nova-api[26392]: 2017-09-28 12:16:13.793 26392 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:16:13 ctl02 nova-api[26392]: 2017-09-28 12:16:13.793 26392 ERROR nova Traceback (most recent call last):
Sep 28 12:16:13 ctl02 nova-api[26392]: 2017-09-28 12:16:13.793 26392 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:16:13 ctl02 nova-api[26392]: 2017-09-28 12:16:13.793 26392 ERROR nova     sys.exit(main())
Sep 28 12:16:13 ctl02 nova-api[26392]: 2017-09-28 12:16:13.793 26392 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:16:13 ctl02 nova-api[26392]: 2017-09-28 12:16:13.793 26392 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:16:13 ctl02 nova-api[26392]: 2017-09-28 12:16:13.793 26392 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:16:13 ctl02 nova-api[26392]: 2017-09-28 12:16:13.793 26392 ERROR nova     max_url_len=max_url_len)
Sep 28 12:16:13 ctl02 nova-api[26392]: 2017-09-28 12:16:13.793 26392 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:16:13 ctl02 nova-api[26392]: 2017-09-28 12:16:13.793 26392 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:16:13 ctl02 nova-api[26392]: 2017-09-28 12:16:13.793 26392 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:16:13 ctl02 nova-api[26392]: 2017-09-28 12:16:13.793 26392 ERROR nova     sock.listen(backlog)
Sep 28 12:16:13 ctl02 nova-api[26392]: 2017-09-28 12:16:13.793 26392 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:16:13 ctl02 nova-api[26392]: 2017-09-28 12:16:13.793 26392 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:16:13 ctl02 nova-api[26392]: 2017-09-28 12:16:13.793 26392 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:16:13 ctl02 nova-api[26392]: 2017-09-28 12:16:13.793 26392 ERROR nova
Sep 28 12:16:13 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:16:13 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:16:13 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:16:14 ctl02 heat-api[13008]: 2017-09-28 12:16:14.065 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:16:14] "OPTIONS / HTTP/1.0" 200 134 0.000714
Sep 28 12:16:14 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:16:14 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:16:14 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:16:14 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:16:14 ctl02 glance-api[29183]: 2017-09-28 12:16:14.191 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:16:14] "OPTIONS / HTTP/1.0" 200 134 0.000657
Sep 28 12:16:14 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xce649050)
Sep 28 12:16:14 ctl02 nova-consoleauth[5433]: 2017-09-28 12:16:14.661 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:16:14 ctl02 dhclient[600]: DHCPREQUEST of 192.168.11.25 on ens2 to 192.168.11.3 port 67 (xid=0x3415f07)
Sep 28 12:16:14 ctl02 dhclient[600]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 12:16:14 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 12:16:14 ctl02 ntp[26474]:  * Stopping NTP server ntpd
Sep 28 12:16:14 ctl02 ntp[26474]:    ...done.
Sep 28 12:16:14 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 12:16:14 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 12:16:14 ctl02 ntp[26485]:  * Starting NTP server ntpd
Sep 28 12:16:14 ctl02 ntpd[26492]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 12:16:14 ctl02 ntpd[26492]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -c /var/lib/ntp/ntp.conf.dhcp -u 108:112
Sep 28 12:16:14 ctl02 ntp[26485]:    ...done.
Sep 28 12:16:14 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 12:16:14 ctl02 ntpd[26495]: proto: precision = 0.041 usec (-24)
Sep 28 12:16:14 ctl02 ntpd[26495]: switching logging to file /var/log/ntp.log
Sep 28 12:16:15 ctl02 dhclient[600]: bound to 192.168.11.25 -- renewal in 270 seconds.
Sep 28 12:16:15 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xce649050)
Sep 28 12:16:15 ctl02 heat-api[13008]: 2017-09-28 12:16:15.490 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:16:15] "OPTIONS / HTTP/1.0" 200 134 0.000616
Sep 28 12:16:15 ctl02 nova-api[26410]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:16:15 ctl02 nova-api[26410]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:16:16 ctl02 nova-api[26410]: 2017-09-28 12:16:16.000 26410 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:16:16 ctl02 nova-api[26410]: 2017-09-28 12:16:16.003 26410 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:16:16 ctl02 nova-api[26410]: 2017-09-28 12:16:16.003 26410 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:16:16 ctl02 nova-api[26410]: 2017-09-28 12:16:16.003 26410 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:16:16 ctl02 nova-api[26410]: 2017-09-28 12:16:16.003 26410 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:16:16 ctl02 nova-api[26410]: 2017-09-28 12:16:16.003 26410 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:16:16 ctl02 nova-api[26410]: 2017-09-28 12:16:16.003 26410 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:16:16 ctl02 nova-api[26410]: 2017-09-28 12:16:16.003 26410 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:16:16 ctl02 nova-api[26410]: 2017-09-28 12:16:16.003 26410 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:16:16 ctl02 nova-api[26410]: 2017-09-28 12:16:16.003 26410 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:16:16 ctl02 nova-api[26410]: 2017-09-28 12:16:16.003 26410 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:16:16 ctl02 nova-api[26410]: 2017-09-28 12:16:16.003 26410 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:16:16 ctl02 nova-api[26410]: 2017-09-28 12:16:16.003 26410 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:16:16 ctl02 nova-api[26410]: 2017-09-28 12:16:16.003 26410 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:16:16 ctl02 nova-api[26410]: 2017-09-28 12:16:16.003 26410 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:16:16 ctl02 nova-api[26410]: 2017-09-28 12:16:16.003 26410 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:16:16 ctl02 nova-api[26410]: 2017-09-28 12:16:16.003 26410 ERROR nova.wsgi     self.filename))
Sep 28 12:16:16 ctl02 nova-api[26410]: 2017-09-28 12:16:16.003 26410 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:16:16 ctl02 nova-api[26410]: 2017-09-28 12:16:16.003 26410 ERROR nova.wsgi
Sep 28 12:16:16 ctl02 nova-api[26410]: 2017-09-28 12:16:16.005 26410 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:16:16 ctl02 nova-api[26410]: 2017-09-28 12:16:16.140 26410 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:16:16 ctl02 nova-api[26410]: 2017-09-28 12:16:16.395 26410 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:16:16 ctl02 nova-api[26410]: 2017-09-28 12:16:16.398 26410 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:16:16 ctl02 nova-api[26410]: 2017-09-28 12:16:16.398 26410 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:16:16 ctl02 nova-api[26410]: 2017-09-28 12:16:16.399 26410 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:16:16 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xce649050)
Sep 28 12:16:16 ctl02 nova-api[26410]: 2017-09-28 12:16:16.533 26410 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:16:16 ctl02 nova-api[26410]: 2017-09-28 12:16:16.535 26410 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:16:16 ctl02 nova-api[26410]: 2017-09-28 12:16:16.536 26410 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:16:16 ctl02 nova-api[26410]: 2017-09-28 12:16:16.536 26410 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:16:16 ctl02 nova-api[26410]: 2017-09-28 12:16:16.540 26410 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:16:16 ctl02 nova-api[26410]: 2017-09-28 12:16:16.540 26410 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:16:16 ctl02 nova-api[26410]: 2017-09-28 12:16:16.540 26410 ERROR nova Traceback (most recent call last):
Sep 28 12:16:16 ctl02 nova-api[26410]: 2017-09-28 12:16:16.540 26410 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:16:16 ctl02 nova-api[26410]: 2017-09-28 12:16:16.540 26410 ERROR nova     sys.exit(main())
Sep 28 12:16:16 ctl02 nova-api[26410]: 2017-09-28 12:16:16.540 26410 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:16:16 ctl02 nova-api[26410]: 2017-09-28 12:16:16.540 26410 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:16:16 ctl02 nova-api[26410]: 2017-09-28 12:16:16.540 26410 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:16:16 ctl02 nova-api[26410]: 2017-09-28 12:16:16.540 26410 ERROR nova     max_url_len=max_url_len)
Sep 28 12:16:16 ctl02 nova-api[26410]: 2017-09-28 12:16:16.540 26410 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:16:16 ctl02 nova-api[26410]: 2017-09-28 12:16:16.540 26410 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:16:16 ctl02 nova-api[26410]: 2017-09-28 12:16:16.540 26410 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:16:16 ctl02 nova-api[26410]: 2017-09-28 12:16:16.540 26410 ERROR nova     sock.listen(backlog)
Sep 28 12:16:16 ctl02 nova-api[26410]: 2017-09-28 12:16:16.540 26410 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:16:16 ctl02 nova-api[26410]: 2017-09-28 12:16:16.540 26410 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:16:16 ctl02 nova-api[26410]: 2017-09-28 12:16:16.540 26410 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:16:16 ctl02 nova-api[26410]: 2017-09-28 12:16:16.540 26410 ERROR nova
Sep 28 12:16:16 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:16:16 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:16:16 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:16:16 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:16:16 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:16:16 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:16:16 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:16:17 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:16:17.164 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:16:17] "OPTIONS / HTTP/1.0" 200 134 0.000528
Sep 28 12:16:17 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:16:17.337 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:16:17] "OPTIONS / HTTP/1.0" 200 134 0.000499
Sep 28 12:16:17 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xce649050)
Sep 28 12:16:17 ctl02 heat-engine[12803]: 2017-09-28 12:16:17.614 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:16:17 ctl02 heat-engine[12803]: 2017-09-28 12:16:17.615 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:16:17 ctl02 heat-engine[12803]: 2017-09-28 12:16:17.617 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:16:17 ctl02 heat-engine[12803]: 2017-09-28 12:16:17.625 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:16:17 ctl02 nova-scheduler[5620]: 2017-09-28 12:16:17.687 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:16:18 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xce649050)
Sep 28 12:16:18 ctl02 nova-api[26510]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:16:18 ctl02 nova-api[26510]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:16:18 ctl02 nova-api[26510]: 2017-09-28 12:16:18.740 26510 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:16:18 ctl02 nova-api[26510]: 2017-09-28 12:16:18.742 26510 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:16:18 ctl02 nova-api[26510]: 2017-09-28 12:16:18.742 26510 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:16:18 ctl02 nova-api[26510]: 2017-09-28 12:16:18.742 26510 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:16:18 ctl02 nova-api[26510]: 2017-09-28 12:16:18.742 26510 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:16:18 ctl02 nova-api[26510]: 2017-09-28 12:16:18.742 26510 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:16:18 ctl02 nova-api[26510]: 2017-09-28 12:16:18.742 26510 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:16:18 ctl02 nova-api[26510]: 2017-09-28 12:16:18.742 26510 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:16:18 ctl02 nova-api[26510]: 2017-09-28 12:16:18.742 26510 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:16:18 ctl02 nova-api[26510]: 2017-09-28 12:16:18.742 26510 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:16:18 ctl02 nova-api[26510]: 2017-09-28 12:16:18.742 26510 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:16:18 ctl02 nova-api[26510]: 2017-09-28 12:16:18.742 26510 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:16:18 ctl02 nova-api[26510]: 2017-09-28 12:16:18.742 26510 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:16:18 ctl02 nova-api[26510]: 2017-09-28 12:16:18.742 26510 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:16:18 ctl02 nova-api[26510]: 2017-09-28 12:16:18.742 26510 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:16:18 ctl02 nova-api[26510]: 2017-09-28 12:16:18.742 26510 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:16:18 ctl02 nova-api[26510]: 2017-09-28 12:16:18.742 26510 ERROR nova.wsgi     self.filename))
Sep 28 12:16:18 ctl02 nova-api[26510]: 2017-09-28 12:16:18.742 26510 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:16:18 ctl02 nova-api[26510]: 2017-09-28 12:16:18.742 26510 ERROR nova.wsgi
Sep 28 12:16:18 ctl02 nova-api[26510]: 2017-09-28 12:16:18.743 26510 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:16:18 ctl02 nova-api[26510]: 2017-09-28 12:16:18.876 26510 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:16:19 ctl02 heat-api[13008]: 2017-09-28 12:16:19.115 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:16:19] "OPTIONS / HTTP/1.0" 200 134 0.000611
Sep 28 12:16:19 ctl02 nova-api[26510]: 2017-09-28 12:16:19.131 26510 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:16:19 ctl02 nova-api[26510]: 2017-09-28 12:16:19.133 26510 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:16:19 ctl02 nova-api[26510]: 2017-09-28 12:16:19.133 26510 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:16:19 ctl02 nova-api[26510]: 2017-09-28 12:16:19.134 26510 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:16:19 ctl02 nova-api[26510]: 2017-09-28 12:16:19.268 26510 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:16:19 ctl02 nova-api[26510]: 2017-09-28 12:16:19.270 26510 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:16:19 ctl02 nova-api[26510]: 2017-09-28 12:16:19.270 26510 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:16:19 ctl02 nova-api[26510]: 2017-09-28 12:16:19.270 26510 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:16:19 ctl02 nova-api[26510]: 2017-09-28 12:16:19.274 26510 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:16:19 ctl02 nova-api[26510]: 2017-09-28 12:16:19.274 26510 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:16:19 ctl02 nova-api[26510]: 2017-09-28 12:16:19.274 26510 ERROR nova Traceback (most recent call last):
Sep 28 12:16:19 ctl02 nova-api[26510]: 2017-09-28 12:16:19.274 26510 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:16:19 ctl02 nova-api[26510]: 2017-09-28 12:16:19.274 26510 ERROR nova     sys.exit(main())
Sep 28 12:16:19 ctl02 nova-api[26510]: 2017-09-28 12:16:19.274 26510 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:16:19 ctl02 nova-api[26510]: 2017-09-28 12:16:19.274 26510 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:16:19 ctl02 nova-api[26510]: 2017-09-28 12:16:19.274 26510 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:16:19 ctl02 nova-api[26510]: 2017-09-28 12:16:19.274 26510 ERROR nova     max_url_len=max_url_len)
Sep 28 12:16:19 ctl02 nova-api[26510]: 2017-09-28 12:16:19.274 26510 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:16:19 ctl02 nova-api[26510]: 2017-09-28 12:16:19.274 26510 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:16:19 ctl02 nova-api[26510]: 2017-09-28 12:16:19.274 26510 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:16:19 ctl02 nova-api[26510]: 2017-09-28 12:16:19.274 26510 ERROR nova     sock.listen(backlog)
Sep 28 12:16:19 ctl02 nova-api[26510]: 2017-09-28 12:16:19.274 26510 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:16:19 ctl02 nova-api[26510]: 2017-09-28 12:16:19.274 26510 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:16:19 ctl02 nova-api[26510]: 2017-09-28 12:16:19.274 26510 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:16:19 ctl02 nova-api[26510]: 2017-09-28 12:16:19.274 26510 ERROR nova
Sep 28 12:16:19 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xce649050)
Sep 28 12:16:19 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:16:19 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:16:19 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:16:19 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:16:19 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:16:19 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:16:19 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:16:19 ctl02 heat-api-cfn[13300]: 2017-09-28 12:16:19.838 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:16:19] "OPTIONS / HTTP/1.0" 200 134 0.000455
Sep 28 12:16:20 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:16:20 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:16:20 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 12:16:20 ctl02 ntp[26583]:  * Stopping NTP server ntpd
Sep 28 12:16:20 ctl02 ntp[26583]:    ...done.
Sep 28 12:16:20 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 12:16:20 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 12:16:20 ctl02 ntp[26593]:  * Starting NTP server ntpd
Sep 28 12:16:20 ctl02 ntpd[26601]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 12:16:20 ctl02 ntpd[26601]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 12:16:20 ctl02 ntp[26593]:    ...done.
Sep 28 12:16:20 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 12:16:20 ctl02 ntpd[26604]: proto: precision = 0.043 usec (-24)
Sep 28 12:16:20 ctl02 ntpd[26604]: switching logging to file /var/log/ntp.log
Sep 28 12:16:20 ctl02 heat-api-cfn[13300]: 2017-09-28 12:16:20.918 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:16:20] "OPTIONS / HTTP/1.0" 200 134 0.000506
Sep 28 12:16:21 ctl02 glance-api[29183]: 2017-09-28 12:16:21.169 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:16:21] "OPTIONS / HTTP/1.0" 200 134 0.000634
Sep 28 12:16:21 ctl02 nova-api[26527]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:16:21 ctl02 nova-api[26527]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:16:21 ctl02 nova-api[26527]: 2017-09-28 12:16:21.496 26527 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:16:21 ctl02 nova-api[26527]: 2017-09-28 12:16:21.498 26527 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:16:21 ctl02 nova-api[26527]: 2017-09-28 12:16:21.498 26527 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:16:21 ctl02 nova-api[26527]: 2017-09-28 12:16:21.498 26527 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:16:21 ctl02 nova-api[26527]: 2017-09-28 12:16:21.498 26527 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:16:21 ctl02 nova-api[26527]: 2017-09-28 12:16:21.498 26527 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:16:21 ctl02 nova-api[26527]: 2017-09-28 12:16:21.498 26527 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:16:21 ctl02 nova-api[26527]: 2017-09-28 12:16:21.498 26527 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:16:21 ctl02 nova-api[26527]: 2017-09-28 12:16:21.498 26527 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:16:21 ctl02 nova-api[26527]: 2017-09-28 12:16:21.498 26527 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:16:21 ctl02 nova-api[26527]: 2017-09-28 12:16:21.498 26527 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:16:21 ctl02 nova-api[26527]: 2017-09-28 12:16:21.498 26527 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:16:21 ctl02 nova-api[26527]: 2017-09-28 12:16:21.498 26527 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:16:21 ctl02 nova-api[26527]: 2017-09-28 12:16:21.498 26527 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:16:21 ctl02 nova-api[26527]: 2017-09-28 12:16:21.498 26527 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:16:21 ctl02 nova-api[26527]: 2017-09-28 12:16:21.498 26527 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:16:21 ctl02 nova-api[26527]: 2017-09-28 12:16:21.498 26527 ERROR nova.wsgi     self.filename))
Sep 28 12:16:21 ctl02 nova-api[26527]: 2017-09-28 12:16:21.498 26527 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:16:21 ctl02 nova-api[26527]: 2017-09-28 12:16:21.498 26527 ERROR nova.wsgi
Sep 28 12:16:21 ctl02 nova-api[26527]: 2017-09-28 12:16:21.499 26527 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:16:21 ctl02 nova-api[26527]: 2017-09-28 12:16:21.633 26527 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:16:21 ctl02 nova-api[26527]: 2017-09-28 12:16:21.883 26527 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:16:21 ctl02 nova-api[26527]: 2017-09-28 12:16:21.885 26527 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:16:21 ctl02 nova-api[26527]: 2017-09-28 12:16:21.885 26527 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:16:21 ctl02 nova-api[26527]: 2017-09-28 12:16:21.886 26527 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:16:22 ctl02 nova-api[26527]: 2017-09-28 12:16:22.018 26527 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:16:22 ctl02 nova-api[26527]: 2017-09-28 12:16:22.021 26527 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:16:22 ctl02 nova-api[26527]: 2017-09-28 12:16:22.021 26527 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:16:22 ctl02 nova-api[26527]: 2017-09-28 12:16:22.021 26527 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:16:22 ctl02 nova-api[26527]: 2017-09-28 12:16:22.024 26527 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:16:22 ctl02 nova-api[26527]: 2017-09-28 12:16:22.025 26527 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:16:22 ctl02 nova-api[26527]: 2017-09-28 12:16:22.025 26527 ERROR nova Traceback (most recent call last):
Sep 28 12:16:22 ctl02 nova-api[26527]: 2017-09-28 12:16:22.025 26527 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:16:22 ctl02 nova-api[26527]: 2017-09-28 12:16:22.025 26527 ERROR nova     sys.exit(main())
Sep 28 12:16:22 ctl02 nova-api[26527]: 2017-09-28 12:16:22.025 26527 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:16:22 ctl02 nova-api[26527]: 2017-09-28 12:16:22.025 26527 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:16:22 ctl02 nova-api[26527]: 2017-09-28 12:16:22.025 26527 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:16:22 ctl02 nova-api[26527]: 2017-09-28 12:16:22.025 26527 ERROR nova     max_url_len=max_url_len)
Sep 28 12:16:22 ctl02 nova-api[26527]: 2017-09-28 12:16:22.025 26527 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:16:22 ctl02 nova-api[26527]: 2017-09-28 12:16:22.025 26527 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:16:22 ctl02 nova-api[26527]: 2017-09-28 12:16:22.025 26527 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:16:22 ctl02 nova-api[26527]: 2017-09-28 12:16:22.025 26527 ERROR nova     sock.listen(backlog)
Sep 28 12:16:22 ctl02 nova-api[26527]: 2017-09-28 12:16:22.025 26527 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:16:22 ctl02 nova-api[26527]: 2017-09-28 12:16:22.025 26527 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:16:22 ctl02 nova-api[26527]: 2017-09-28 12:16:22.025 26527 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:16:22 ctl02 nova-api[26527]: 2017-09-28 12:16:22.025 26527 ERROR nova
Sep 28 12:16:22 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:16:22 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:16:22 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:16:22 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:16:22 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:16:22 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:16:22 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:16:22 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:16:22.606 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:16:22] "OPTIONS / HTTP/1.0" 200 134 0.000516
Sep 28 12:16:22 ctl02 heat-api-cfn[13300]: 2017-09-28 12:16:22.922 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:16:22] "OPTIONS / HTTP/1.0" 200 134 0.000517
Sep 28 12:16:23 ctl02 glance-api[29183]: 2017-09-28 12:16:23.990 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:16:23] "OPTIONS / HTTP/1.0" 200 134 0.000643
Sep 28 12:16:24 ctl02 nova-api[26617]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:16:24 ctl02 nova-api[26617]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:16:24 ctl02 heat-api[13008]: 2017-09-28 12:16:24.168 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:16:24] "OPTIONS / HTTP/1.0" 200 134 0.000662
Sep 28 12:16:24 ctl02 nova-api[26617]: 2017-09-28 12:16:24.285 26617 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:16:24 ctl02 nova-api[26617]: 2017-09-28 12:16:24.287 26617 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:16:24 ctl02 nova-api[26617]: 2017-09-28 12:16:24.287 26617 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:16:24 ctl02 nova-api[26617]: 2017-09-28 12:16:24.287 26617 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:16:24 ctl02 nova-api[26617]: 2017-09-28 12:16:24.287 26617 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:16:24 ctl02 nova-api[26617]: 2017-09-28 12:16:24.287 26617 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:16:24 ctl02 nova-api[26617]: 2017-09-28 12:16:24.287 26617 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:16:24 ctl02 nova-api[26617]: 2017-09-28 12:16:24.287 26617 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:16:24 ctl02 nova-api[26617]: 2017-09-28 12:16:24.287 26617 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:16:24 ctl02 nova-api[26617]: 2017-09-28 12:16:24.287 26617 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:16:24 ctl02 nova-api[26617]: 2017-09-28 12:16:24.287 26617 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:16:24 ctl02 nova-api[26617]: 2017-09-28 12:16:24.287 26617 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:16:24 ctl02 nova-api[26617]: 2017-09-28 12:16:24.287 26617 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:16:24 ctl02 nova-api[26617]: 2017-09-28 12:16:24.287 26617 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:16:24 ctl02 nova-api[26617]: 2017-09-28 12:16:24.287 26617 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:16:24 ctl02 nova-api[26617]: 2017-09-28 12:16:24.287 26617 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:16:24 ctl02 nova-api[26617]: 2017-09-28 12:16:24.287 26617 ERROR nova.wsgi     self.filename))
Sep 28 12:16:24 ctl02 nova-api[26617]: 2017-09-28 12:16:24.287 26617 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:16:24 ctl02 nova-api[26617]: 2017-09-28 12:16:24.287 26617 ERROR nova.wsgi
Sep 28 12:16:24 ctl02 nova-api[26617]: 2017-09-28 12:16:24.288 26617 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:16:24 ctl02 nova-api[26617]: 2017-09-28 12:16:24.425 26617 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:16:24 ctl02 glance-api[29183]: 2017-09-28 12:16:24.546 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:16:24] "OPTIONS / HTTP/1.0" 200 134 0.000714
Sep 28 12:16:24 ctl02 nova-api[26617]: 2017-09-28 12:16:24.681 26617 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:16:24 ctl02 nova-api[26617]: 2017-09-28 12:16:24.683 26617 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:16:24 ctl02 nova-api[26617]: 2017-09-28 12:16:24.684 26617 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:16:24 ctl02 nova-api[26617]: 2017-09-28 12:16:24.684 26617 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:16:24 ctl02 nova-api[26617]: 2017-09-28 12:16:24.820 26617 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:16:24 ctl02 nova-api[26617]: 2017-09-28 12:16:24.822 26617 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:16:24 ctl02 nova-api[26617]: 2017-09-28 12:16:24.822 26617 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:16:24 ctl02 nova-api[26617]: 2017-09-28 12:16:24.822 26617 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:16:24 ctl02 nova-api[26617]: 2017-09-28 12:16:24.826 26617 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:16:24 ctl02 nova-api[26617]: 2017-09-28 12:16:24.826 26617 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:16:24 ctl02 nova-api[26617]: 2017-09-28 12:16:24.826 26617 ERROR nova Traceback (most recent call last):
Sep 28 12:16:24 ctl02 nova-api[26617]: 2017-09-28 12:16:24.826 26617 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:16:24 ctl02 nova-api[26617]: 2017-09-28 12:16:24.826 26617 ERROR nova     sys.exit(main())
Sep 28 12:16:24 ctl02 nova-api[26617]: 2017-09-28 12:16:24.826 26617 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:16:24 ctl02 nova-api[26617]: 2017-09-28 12:16:24.826 26617 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:16:24 ctl02 nova-api[26617]: 2017-09-28 12:16:24.826 26617 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:16:24 ctl02 nova-api[26617]: 2017-09-28 12:16:24.826 26617 ERROR nova     max_url_len=max_url_len)
Sep 28 12:16:24 ctl02 nova-api[26617]: 2017-09-28 12:16:24.826 26617 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:16:24 ctl02 nova-api[26617]: 2017-09-28 12:16:24.826 26617 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:16:24 ctl02 nova-api[26617]: 2017-09-28 12:16:24.826 26617 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:16:24 ctl02 nova-api[26617]: 2017-09-28 12:16:24.826 26617 ERROR nova     sock.listen(backlog)
Sep 28 12:16:24 ctl02 nova-api[26617]: 2017-09-28 12:16:24.826 26617 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:16:24 ctl02 nova-api[26617]: 2017-09-28 12:16:24.826 26617 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:16:24 ctl02 nova-api[26617]: 2017-09-28 12:16:24.826 26617 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:16:24 ctl02 nova-api[26617]: 2017-09-28 12:16:24.826 26617 ERROR nova
Sep 28 12:16:25 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:16:25 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:16:25 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:16:25 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:16:25 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:16:25 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:16:25 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:16:25 ctl02 heat-api[13008]: 2017-09-28 12:16:25.293 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:16:25] "OPTIONS / HTTP/1.0" 200 134 0.000621
Sep 28 12:16:26 ctl02 nova-api[26635]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:16:26 ctl02 nova-api[26635]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:16:26 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:16:26.878 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:16:26] "OPTIONS / HTTP/1.0" 200 134 0.000494
Sep 28 12:16:27 ctl02 nova-api[26635]: 2017-09-28 12:16:27.007 26635 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:16:27 ctl02 nova-api[26635]: 2017-09-28 12:16:27.009 26635 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:16:27 ctl02 nova-api[26635]: 2017-09-28 12:16:27.009 26635 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:16:27 ctl02 nova-api[26635]: 2017-09-28 12:16:27.009 26635 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:16:27 ctl02 nova-api[26635]: 2017-09-28 12:16:27.009 26635 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:16:27 ctl02 nova-api[26635]: 2017-09-28 12:16:27.009 26635 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:16:27 ctl02 nova-api[26635]: 2017-09-28 12:16:27.009 26635 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:16:27 ctl02 nova-api[26635]: 2017-09-28 12:16:27.009 26635 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:16:27 ctl02 nova-api[26635]: 2017-09-28 12:16:27.009 26635 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:16:27 ctl02 nova-api[26635]: 2017-09-28 12:16:27.009 26635 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:16:27 ctl02 nova-api[26635]: 2017-09-28 12:16:27.009 26635 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:16:27 ctl02 nova-api[26635]: 2017-09-28 12:16:27.009 26635 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:16:27 ctl02 nova-api[26635]: 2017-09-28 12:16:27.009 26635 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:16:27 ctl02 nova-api[26635]: 2017-09-28 12:16:27.009 26635 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:16:27 ctl02 nova-api[26635]: 2017-09-28 12:16:27.009 26635 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:16:27 ctl02 nova-api[26635]: 2017-09-28 12:16:27.009 26635 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:16:27 ctl02 nova-api[26635]: 2017-09-28 12:16:27.009 26635 ERROR nova.wsgi     self.filename))
Sep 28 12:16:27 ctl02 nova-api[26635]: 2017-09-28 12:16:27.009 26635 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:16:27 ctl02 nova-api[26635]: 2017-09-28 12:16:27.009 26635 ERROR nova.wsgi
Sep 28 12:16:27 ctl02 nova-api[26635]: 2017-09-28 12:16:27.012 26635 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:16:27 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:16:27.073 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:16:27] "OPTIONS / HTTP/1.0" 200 134 0.000470
Sep 28 12:16:27 ctl02 nova-api[26635]: 2017-09-28 12:16:27.148 26635 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:16:27 ctl02 nova-api[26635]: 2017-09-28 12:16:27.403 26635 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:16:27 ctl02 nova-api[26635]: 2017-09-28 12:16:27.406 26635 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:16:27 ctl02 nova-api[26635]: 2017-09-28 12:16:27.407 26635 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:16:27 ctl02 nova-api[26635]: 2017-09-28 12:16:27.407 26635 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:16:27 ctl02 nova-api[26635]: 2017-09-28 12:16:27.542 26635 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:16:27 ctl02 nova-api[26635]: 2017-09-28 12:16:27.545 26635 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:16:27 ctl02 nova-api[26635]: 2017-09-28 12:16:27.545 26635 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:16:27 ctl02 nova-api[26635]: 2017-09-28 12:16:27.546 26635 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:16:27 ctl02 nova-api[26635]: 2017-09-28 12:16:27.549 26635 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:16:27 ctl02 nova-api[26635]: 2017-09-28 12:16:27.549 26635 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:16:27 ctl02 nova-api[26635]: 2017-09-28 12:16:27.549 26635 ERROR nova Traceback (most recent call last):
Sep 28 12:16:27 ctl02 nova-api[26635]: 2017-09-28 12:16:27.549 26635 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:16:27 ctl02 nova-api[26635]: 2017-09-28 12:16:27.549 26635 ERROR nova     sys.exit(main())
Sep 28 12:16:27 ctl02 nova-api[26635]: 2017-09-28 12:16:27.549 26635 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:16:27 ctl02 nova-api[26635]: 2017-09-28 12:16:27.549 26635 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:16:27 ctl02 nova-api[26635]: 2017-09-28 12:16:27.549 26635 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:16:27 ctl02 nova-api[26635]: 2017-09-28 12:16:27.549 26635 ERROR nova     max_url_len=max_url_len)
Sep 28 12:16:27 ctl02 nova-api[26635]: 2017-09-28 12:16:27.549 26635 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:16:27 ctl02 nova-api[26635]: 2017-09-28 12:16:27.549 26635 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:16:27 ctl02 nova-api[26635]: 2017-09-28 12:16:27.549 26635 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:16:27 ctl02 nova-api[26635]: 2017-09-28 12:16:27.549 26635 ERROR nova     sock.listen(backlog)
Sep 28 12:16:27 ctl02 nova-api[26635]: 2017-09-28 12:16:27.549 26635 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:16:27 ctl02 nova-api[26635]: 2017-09-28 12:16:27.549 26635 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:16:27 ctl02 nova-api[26635]: 2017-09-28 12:16:27.549 26635 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:16:27 ctl02 nova-api[26635]: 2017-09-28 12:16:27.549 26635 ERROR nova
Sep 28 12:16:27 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:16:27 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:16:27 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:16:27 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:16:27 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:16:27 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:16:27 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:16:29 ctl02 heat-api[13008]: 2017-09-28 12:16:29.246 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:16:29] "OPTIONS / HTTP/1.0" 200 134 0.000616
Sep 28 12:16:29 ctl02 nova-api[26653]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:16:29 ctl02 nova-api[26653]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:16:29 ctl02 heat-api-cfn[13300]: 2017-09-28 12:16:29.648 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:16:29] "OPTIONS / HTTP/1.0" 200 134 0.000574
Sep 28 12:16:29 ctl02 nova-api[26653]: 2017-09-28 12:16:29.762 26653 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:16:29 ctl02 nova-api[26653]: 2017-09-28 12:16:29.764 26653 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:16:29 ctl02 nova-api[26653]: 2017-09-28 12:16:29.764 26653 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:16:29 ctl02 nova-api[26653]: 2017-09-28 12:16:29.764 26653 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:16:29 ctl02 nova-api[26653]: 2017-09-28 12:16:29.764 26653 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:16:29 ctl02 nova-api[26653]: 2017-09-28 12:16:29.764 26653 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:16:29 ctl02 nova-api[26653]: 2017-09-28 12:16:29.764 26653 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:16:29 ctl02 nova-api[26653]: 2017-09-28 12:16:29.764 26653 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:16:29 ctl02 nova-api[26653]: 2017-09-28 12:16:29.764 26653 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:16:29 ctl02 nova-api[26653]: 2017-09-28 12:16:29.764 26653 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:16:29 ctl02 nova-api[26653]: 2017-09-28 12:16:29.764 26653 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:16:29 ctl02 nova-api[26653]: 2017-09-28 12:16:29.764 26653 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:16:29 ctl02 nova-api[26653]: 2017-09-28 12:16:29.764 26653 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:16:29 ctl02 nova-api[26653]: 2017-09-28 12:16:29.764 26653 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:16:29 ctl02 nova-api[26653]: 2017-09-28 12:16:29.764 26653 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:16:29 ctl02 nova-api[26653]: 2017-09-28 12:16:29.764 26653 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:16:29 ctl02 nova-api[26653]: 2017-09-28 12:16:29.764 26653 ERROR nova.wsgi     self.filename))
Sep 28 12:16:29 ctl02 nova-api[26653]: 2017-09-28 12:16:29.764 26653 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:16:29 ctl02 nova-api[26653]: 2017-09-28 12:16:29.764 26653 ERROR nova.wsgi
Sep 28 12:16:29 ctl02 nova-api[26653]: 2017-09-28 12:16:29.766 26653 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:16:29 ctl02 nova-api[26653]: 2017-09-28 12:16:29.902 26653 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:16:30 ctl02 nova-api[26653]: 2017-09-28 12:16:30.156 26653 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:16:30 ctl02 nova-api[26653]: 2017-09-28 12:16:30.159 26653 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:16:30 ctl02 nova-api[26653]: 2017-09-28 12:16:30.160 26653 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:16:30 ctl02 nova-api[26653]: 2017-09-28 12:16:30.160 26653 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:16:30 ctl02 nova-api[26653]: 2017-09-28 12:16:30.300 26653 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:16:30 ctl02 nova-api[26653]: 2017-09-28 12:16:30.303 26653 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:16:30 ctl02 nova-api[26653]: 2017-09-28 12:16:30.304 26653 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:16:30 ctl02 nova-api[26653]: 2017-09-28 12:16:30.304 26653 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:16:30 ctl02 nova-api[26653]: 2017-09-28 12:16:30.308 26653 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:16:30 ctl02 nova-api[26653]: 2017-09-28 12:16:30.308 26653 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:16:30 ctl02 nova-api[26653]: 2017-09-28 12:16:30.308 26653 ERROR nova Traceback (most recent call last):
Sep 28 12:16:30 ctl02 nova-api[26653]: 2017-09-28 12:16:30.308 26653 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:16:30 ctl02 nova-api[26653]: 2017-09-28 12:16:30.308 26653 ERROR nova     sys.exit(main())
Sep 28 12:16:30 ctl02 nova-api[26653]: 2017-09-28 12:16:30.308 26653 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:16:30 ctl02 nova-api[26653]: 2017-09-28 12:16:30.308 26653 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:16:30 ctl02 nova-api[26653]: 2017-09-28 12:16:30.308 26653 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:16:30 ctl02 nova-api[26653]: 2017-09-28 12:16:30.308 26653 ERROR nova     max_url_len=max_url_len)
Sep 28 12:16:30 ctl02 nova-api[26653]: 2017-09-28 12:16:30.308 26653 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:16:30 ctl02 nova-api[26653]: 2017-09-28 12:16:30.308 26653 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:16:30 ctl02 nova-api[26653]: 2017-09-28 12:16:30.308 26653 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:16:30 ctl02 nova-api[26653]: 2017-09-28 12:16:30.308 26653 ERROR nova     sock.listen(backlog)
Sep 28 12:16:30 ctl02 nova-api[26653]: 2017-09-28 12:16:30.308 26653 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:16:30 ctl02 nova-api[26653]: 2017-09-28 12:16:30.308 26653 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:16:30 ctl02 nova-api[26653]: 2017-09-28 12:16:30.308 26653 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:16:30 ctl02 nova-api[26653]: 2017-09-28 12:16:30.308 26653 ERROR nova
Sep 28 12:16:30 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:16:30 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:16:30 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:16:30 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:16:30 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:16:30 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:16:30 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:16:30 ctl02 glance-api[29183]: 2017-09-28 12:16:30.800 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:16:30] "OPTIONS / HTTP/1.0" 200 134 0.000712
Sep 28 12:16:30 ctl02 heat-api-cfn[13300]: 2017-09-28 12:16:30.896 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:16:30] "OPTIONS / HTTP/1.0" 200 134 0.000516
Sep 28 12:16:32 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:16:32.269 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:16:32] "OPTIONS / HTTP/1.0" 200 134 0.000532
Sep 28 12:16:32 ctl02 nova-api[26671]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:16:32 ctl02 nova-api[26671]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:16:32 ctl02 nova-api[26671]: 2017-09-28 12:16:32.466 26671 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:16:32 ctl02 nova-api[26671]: 2017-09-28 12:16:32.468 26671 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:16:32 ctl02 nova-api[26671]: 2017-09-28 12:16:32.468 26671 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:16:32 ctl02 nova-api[26671]: 2017-09-28 12:16:32.468 26671 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:16:32 ctl02 nova-api[26671]: 2017-09-28 12:16:32.468 26671 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:16:32 ctl02 nova-api[26671]: 2017-09-28 12:16:32.468 26671 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:16:32 ctl02 nova-api[26671]: 2017-09-28 12:16:32.468 26671 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:16:32 ctl02 nova-api[26671]: 2017-09-28 12:16:32.468 26671 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:16:32 ctl02 nova-api[26671]: 2017-09-28 12:16:32.468 26671 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:16:32 ctl02 nova-api[26671]: 2017-09-28 12:16:32.468 26671 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:16:32 ctl02 nova-api[26671]: 2017-09-28 12:16:32.468 26671 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:16:32 ctl02 nova-api[26671]: 2017-09-28 12:16:32.468 26671 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:16:32 ctl02 nova-api[26671]: 2017-09-28 12:16:32.468 26671 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:16:32 ctl02 nova-api[26671]: 2017-09-28 12:16:32.468 26671 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:16:32 ctl02 nova-api[26671]: 2017-09-28 12:16:32.468 26671 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:16:32 ctl02 nova-api[26671]: 2017-09-28 12:16:32.468 26671 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:16:32 ctl02 nova-api[26671]: 2017-09-28 12:16:32.468 26671 ERROR nova.wsgi     self.filename))
Sep 28 12:16:32 ctl02 nova-api[26671]: 2017-09-28 12:16:32.468 26671 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:16:32 ctl02 nova-api[26671]: 2017-09-28 12:16:32.468 26671 ERROR nova.wsgi
Sep 28 12:16:32 ctl02 nova-api[26671]: 2017-09-28 12:16:32.469 26671 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:16:32 ctl02 nova-api[26671]: 2017-09-28 12:16:32.602 26671 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:16:32 ctl02 nova-api[26671]: 2017-09-28 12:16:32.850 26671 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:16:32 ctl02 nova-api[26671]: 2017-09-28 12:16:32.853 26671 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:16:32 ctl02 nova-api[26671]: 2017-09-28 12:16:32.853 26671 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:16:32 ctl02 nova-api[26671]: 2017-09-28 12:16:32.853 26671 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:16:32 ctl02 heat-api-cfn[13300]: 2017-09-28 12:16:32.907 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:16:32] "OPTIONS / HTTP/1.0" 200 134 0.000528
Sep 28 12:16:32 ctl02 nova-api[26671]: 2017-09-28 12:16:32.984 26671 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:16:32 ctl02 nova-api[26671]: 2017-09-28 12:16:32.986 26671 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:16:32 ctl02 nova-api[26671]: 2017-09-28 12:16:32.986 26671 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:16:32 ctl02 nova-api[26671]: 2017-09-28 12:16:32.986 26671 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:16:32 ctl02 nova-api[26671]: 2017-09-28 12:16:32.990 26671 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:16:32 ctl02 nova-api[26671]: 2017-09-28 12:16:32.990 26671 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:16:32 ctl02 nova-api[26671]: 2017-09-28 12:16:32.990 26671 ERROR nova Traceback (most recent call last):
Sep 28 12:16:32 ctl02 nova-api[26671]: 2017-09-28 12:16:32.990 26671 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:16:32 ctl02 nova-api[26671]: 2017-09-28 12:16:32.990 26671 ERROR nova     sys.exit(main())
Sep 28 12:16:32 ctl02 nova-api[26671]: 2017-09-28 12:16:32.990 26671 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:16:32 ctl02 nova-api[26671]: 2017-09-28 12:16:32.990 26671 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:16:32 ctl02 nova-api[26671]: 2017-09-28 12:16:32.990 26671 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:16:32 ctl02 nova-api[26671]: 2017-09-28 12:16:32.990 26671 ERROR nova     max_url_len=max_url_len)
Sep 28 12:16:32 ctl02 nova-api[26671]: 2017-09-28 12:16:32.990 26671 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:16:32 ctl02 nova-api[26671]: 2017-09-28 12:16:32.990 26671 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:16:32 ctl02 nova-api[26671]: 2017-09-28 12:16:32.990 26671 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:16:32 ctl02 nova-api[26671]: 2017-09-28 12:16:32.990 26671 ERROR nova     sock.listen(backlog)
Sep 28 12:16:32 ctl02 nova-api[26671]: 2017-09-28 12:16:32.990 26671 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:16:32 ctl02 nova-api[26671]: 2017-09-28 12:16:32.990 26671 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:16:32 ctl02 nova-api[26671]: 2017-09-28 12:16:32.990 26671 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:16:32 ctl02 nova-api[26671]: 2017-09-28 12:16:32.990 26671 ERROR nova
Sep 28 12:16:33 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:16:33 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:16:33 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:16:33 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:16:33 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:16:33 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:16:33 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:16:33 ctl02 glance-api[29183]: 2017-09-28 12:16:33.864 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:16:33] "OPTIONS / HTTP/1.0" 200 134 0.000705
Sep 28 12:16:34 ctl02 heat-api[13008]: 2017-09-28 12:16:34.128 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:16:34] "OPTIONS / HTTP/1.0" 200 134 0.000691
Sep 28 12:16:34 ctl02 glance-api[29183]: 2017-09-28 12:16:34.453 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:16:34] "OPTIONS / HTTP/1.0" 200 134 0.000963
Sep 28 12:16:35 ctl02 nova-api[26689]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:16:35 ctl02 nova-api[26689]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:16:35 ctl02 nova-api[26689]: 2017-09-28 12:16:35.226 26689 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:16:35 ctl02 nova-api[26689]: 2017-09-28 12:16:35.229 26689 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:16:35 ctl02 nova-api[26689]: 2017-09-28 12:16:35.229 26689 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:16:35 ctl02 nova-api[26689]: 2017-09-28 12:16:35.229 26689 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:16:35 ctl02 nova-api[26689]: 2017-09-28 12:16:35.229 26689 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:16:35 ctl02 nova-api[26689]: 2017-09-28 12:16:35.229 26689 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:16:35 ctl02 nova-api[26689]: 2017-09-28 12:16:35.229 26689 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:16:35 ctl02 nova-api[26689]: 2017-09-28 12:16:35.229 26689 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:16:35 ctl02 nova-api[26689]: 2017-09-28 12:16:35.229 26689 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:16:35 ctl02 nova-api[26689]: 2017-09-28 12:16:35.229 26689 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:16:35 ctl02 nova-api[26689]: 2017-09-28 12:16:35.229 26689 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:16:35 ctl02 nova-api[26689]: 2017-09-28 12:16:35.229 26689 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:16:35 ctl02 nova-api[26689]: 2017-09-28 12:16:35.229 26689 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:16:35 ctl02 nova-api[26689]: 2017-09-28 12:16:35.229 26689 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:16:35 ctl02 nova-api[26689]: 2017-09-28 12:16:35.229 26689 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:16:35 ctl02 nova-api[26689]: 2017-09-28 12:16:35.229 26689 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:16:35 ctl02 nova-api[26689]: 2017-09-28 12:16:35.229 26689 ERROR nova.wsgi     self.filename))
Sep 28 12:16:35 ctl02 nova-api[26689]: 2017-09-28 12:16:35.229 26689 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:16:35 ctl02 nova-api[26689]: 2017-09-28 12:16:35.229 26689 ERROR nova.wsgi
Sep 28 12:16:35 ctl02 nova-api[26689]: 2017-09-28 12:16:35.231 26689 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:16:35 ctl02 nova-api[26689]: 2017-09-28 12:16:35.364 26689 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:16:35 ctl02 heat-api[13008]: 2017-09-28 12:16:35.403 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:16:35] "OPTIONS / HTTP/1.0" 200 134 0.000652
Sep 28 12:16:35 ctl02 nova-api[26689]: 2017-09-28 12:16:35.619 26689 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:16:35 ctl02 nova-api[26689]: 2017-09-28 12:16:35.622 26689 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:16:35 ctl02 nova-api[26689]: 2017-09-28 12:16:35.623 26689 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:16:35 ctl02 nova-api[26689]: 2017-09-28 12:16:35.623 26689 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:16:35 ctl02 nova-api[26689]: 2017-09-28 12:16:35.755 26689 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:16:35 ctl02 nova-api[26689]: 2017-09-28 12:16:35.758 26689 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:16:35 ctl02 nova-api[26689]: 2017-09-28 12:16:35.759 26689 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:16:35 ctl02 nova-api[26689]: 2017-09-28 12:16:35.759 26689 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:16:35 ctl02 nova-api[26689]: 2017-09-28 12:16:35.762 26689 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:16:35 ctl02 nova-api[26689]: 2017-09-28 12:16:35.763 26689 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:16:35 ctl02 nova-api[26689]: 2017-09-28 12:16:35.763 26689 ERROR nova Traceback (most recent call last):
Sep 28 12:16:35 ctl02 nova-api[26689]: 2017-09-28 12:16:35.763 26689 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:16:35 ctl02 nova-api[26689]: 2017-09-28 12:16:35.763 26689 ERROR nova     sys.exit(main())
Sep 28 12:16:35 ctl02 nova-api[26689]: 2017-09-28 12:16:35.763 26689 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:16:35 ctl02 nova-api[26689]: 2017-09-28 12:16:35.763 26689 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:16:35 ctl02 nova-api[26689]: 2017-09-28 12:16:35.763 26689 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:16:35 ctl02 nova-api[26689]: 2017-09-28 12:16:35.763 26689 ERROR nova     max_url_len=max_url_len)
Sep 28 12:16:35 ctl02 nova-api[26689]: 2017-09-28 12:16:35.763 26689 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:16:35 ctl02 nova-api[26689]: 2017-09-28 12:16:35.763 26689 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:16:35 ctl02 nova-api[26689]: 2017-09-28 12:16:35.763 26689 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:16:35 ctl02 nova-api[26689]: 2017-09-28 12:16:35.763 26689 ERROR nova     sock.listen(backlog)
Sep 28 12:16:35 ctl02 nova-api[26689]: 2017-09-28 12:16:35.763 26689 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:16:35 ctl02 nova-api[26689]: 2017-09-28 12:16:35.763 26689 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:16:35 ctl02 nova-api[26689]: 2017-09-28 12:16:35.763 26689 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:16:35 ctl02 nova-api[26689]: 2017-09-28 12:16:35.763 26689 ERROR nova
Sep 28 12:16:35 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:16:35 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:16:35 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:16:36 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:16:36 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:16:36 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:16:36 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:16:36 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:16:36.564 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:16:36] "OPTIONS / HTTP/1.0" 200 134 0.000525
Sep 28 12:16:36 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:16:36.776 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:16:36] "OPTIONS / HTTP/1.0" 200 134 0.000490
Sep 28 12:16:36 ctl02 nova-cert[4860]: 2017-09-28 12:16:36.821 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:16:37 ctl02 nova-api[26707]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:16:37 ctl02 nova-api[26707]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:16:37 ctl02 nova-api[26707]: 2017-09-28 12:16:37.985 26707 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:16:37 ctl02 nova-api[26707]: 2017-09-28 12:16:37.987 26707 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:16:37 ctl02 nova-api[26707]: 2017-09-28 12:16:37.987 26707 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:16:37 ctl02 nova-api[26707]: 2017-09-28 12:16:37.987 26707 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:16:37 ctl02 nova-api[26707]: 2017-09-28 12:16:37.987 26707 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:16:37 ctl02 nova-api[26707]: 2017-09-28 12:16:37.987 26707 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:16:37 ctl02 nova-api[26707]: 2017-09-28 12:16:37.987 26707 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:16:37 ctl02 nova-api[26707]: 2017-09-28 12:16:37.987 26707 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:16:37 ctl02 nova-api[26707]: 2017-09-28 12:16:37.987 26707 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:16:37 ctl02 nova-api[26707]: 2017-09-28 12:16:37.987 26707 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:16:37 ctl02 nova-api[26707]: 2017-09-28 12:16:37.987 26707 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:16:37 ctl02 nova-api[26707]: 2017-09-28 12:16:37.987 26707 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:16:37 ctl02 nova-api[26707]: 2017-09-28 12:16:37.987 26707 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:16:37 ctl02 nova-api[26707]: 2017-09-28 12:16:37.987 26707 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:16:37 ctl02 nova-api[26707]: 2017-09-28 12:16:37.987 26707 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:16:37 ctl02 nova-api[26707]: 2017-09-28 12:16:37.987 26707 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:16:37 ctl02 nova-api[26707]: 2017-09-28 12:16:37.987 26707 ERROR nova.wsgi     self.filename))
Sep 28 12:16:37 ctl02 nova-api[26707]: 2017-09-28 12:16:37.987 26707 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:16:37 ctl02 nova-api[26707]: 2017-09-28 12:16:37.987 26707 ERROR nova.wsgi
Sep 28 12:16:37 ctl02 nova-api[26707]: 2017-09-28 12:16:37.989 26707 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:16:38 ctl02 nova-api[26707]: 2017-09-28 12:16:38.118 26707 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:16:38 ctl02 nova-api[26707]: 2017-09-28 12:16:38.346 26707 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:16:38 ctl02 nova-api[26707]: 2017-09-28 12:16:38.348 26707 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:16:38 ctl02 nova-api[26707]: 2017-09-28 12:16:38.349 26707 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:16:38 ctl02 nova-api[26707]: 2017-09-28 12:16:38.349 26707 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:16:38 ctl02 nova-api[26707]: 2017-09-28 12:16:38.478 26707 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:16:38 ctl02 nova-api[26707]: 2017-09-28 12:16:38.481 26707 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:16:38 ctl02 nova-api[26707]: 2017-09-28 12:16:38.481 26707 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:16:38 ctl02 nova-api[26707]: 2017-09-28 12:16:38.482 26707 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:16:38 ctl02 nova-api[26707]: 2017-09-28 12:16:38.485 26707 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:16:38 ctl02 nova-api[26707]: 2017-09-28 12:16:38.485 26707 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:16:38 ctl02 nova-api[26707]: 2017-09-28 12:16:38.485 26707 ERROR nova Traceback (most recent call last):
Sep 28 12:16:38 ctl02 nova-api[26707]: 2017-09-28 12:16:38.485 26707 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:16:38 ctl02 nova-api[26707]: 2017-09-28 12:16:38.485 26707 ERROR nova     sys.exit(main())
Sep 28 12:16:38 ctl02 nova-api[26707]: 2017-09-28 12:16:38.485 26707 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:16:38 ctl02 nova-api[26707]: 2017-09-28 12:16:38.485 26707 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:16:38 ctl02 nova-api[26707]: 2017-09-28 12:16:38.485 26707 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:16:38 ctl02 nova-api[26707]: 2017-09-28 12:16:38.485 26707 ERROR nova     max_url_len=max_url_len)
Sep 28 12:16:38 ctl02 nova-api[26707]: 2017-09-28 12:16:38.485 26707 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:16:38 ctl02 nova-api[26707]: 2017-09-28 12:16:38.485 26707 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:16:38 ctl02 nova-api[26707]: 2017-09-28 12:16:38.485 26707 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:16:38 ctl02 nova-api[26707]: 2017-09-28 12:16:38.485 26707 ERROR nova     sock.listen(backlog)
Sep 28 12:16:38 ctl02 nova-api[26707]: 2017-09-28 12:16:38.485 26707 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:16:38 ctl02 nova-api[26707]: 2017-09-28 12:16:38.485 26707 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:16:38 ctl02 nova-api[26707]: 2017-09-28 12:16:38.485 26707 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:16:38 ctl02 nova-api[26707]: 2017-09-28 12:16:38.485 26707 ERROR nova
Sep 28 12:16:38 ctl02 nova-conductor[5056]: 2017-09-28 12:16:38.513 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:16:38 ctl02 nova-conductor[5056]: 2017-09-28 12:16:38.529 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:16:38 ctl02 nova-conductor[5056]: 2017-09-28 12:16:38.530 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:16:38 ctl02 nova-conductor[5056]: 2017-09-28 12:16:38.532 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:16:38 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:16:38 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:16:38 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:16:38 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:16:38 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:16:38 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:16:38 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:16:39 ctl02 heat-api[13008]: 2017-09-28 12:16:39.285 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:16:39] "OPTIONS / HTTP/1.0" 200 134 0.000646
Sep 28 12:16:39 ctl02 heat-api-cfn[13300]: 2017-09-28 12:16:39.360 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:16:39] "OPTIONS / HTTP/1.0" 200 134 0.000596
Sep 28 12:16:40 ctl02 glance-api[29183]: 2017-09-28 12:16:40.437 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:16:40] "OPTIONS / HTTP/1.0" 200 134 0.000642
Sep 28 12:16:40 ctl02 nova-api[26725]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:16:40 ctl02 nova-api[26725]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:16:40 ctl02 nova-api[26725]: 2017-09-28 12:16:40.734 26725 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:16:40 ctl02 nova-api[26725]: 2017-09-28 12:16:40.737 26725 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:16:40 ctl02 nova-api[26725]: 2017-09-28 12:16:40.737 26725 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:16:40 ctl02 nova-api[26725]: 2017-09-28 12:16:40.737 26725 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:16:40 ctl02 nova-api[26725]: 2017-09-28 12:16:40.737 26725 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:16:40 ctl02 nova-api[26725]: 2017-09-28 12:16:40.737 26725 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:16:40 ctl02 nova-api[26725]: 2017-09-28 12:16:40.737 26725 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:16:40 ctl02 nova-api[26725]: 2017-09-28 12:16:40.737 26725 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:16:40 ctl02 nova-api[26725]: 2017-09-28 12:16:40.737 26725 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:16:40 ctl02 nova-api[26725]: 2017-09-28 12:16:40.737 26725 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:16:40 ctl02 nova-api[26725]: 2017-09-28 12:16:40.737 26725 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:16:40 ctl02 nova-api[26725]: 2017-09-28 12:16:40.737 26725 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:16:40 ctl02 nova-api[26725]: 2017-09-28 12:16:40.737 26725 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:16:40 ctl02 nova-api[26725]: 2017-09-28 12:16:40.737 26725 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:16:40 ctl02 nova-api[26725]: 2017-09-28 12:16:40.737 26725 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:16:40 ctl02 nova-api[26725]: 2017-09-28 12:16:40.737 26725 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:16:40 ctl02 nova-api[26725]: 2017-09-28 12:16:40.737 26725 ERROR nova.wsgi     self.filename))
Sep 28 12:16:40 ctl02 nova-api[26725]: 2017-09-28 12:16:40.737 26725 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:16:40 ctl02 nova-api[26725]: 2017-09-28 12:16:40.737 26725 ERROR nova.wsgi
Sep 28 12:16:40 ctl02 nova-api[26725]: 2017-09-28 12:16:40.739 26725 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:16:40 ctl02 heat-api-cfn[13300]: 2017-09-28 12:16:40.778 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:16:40] "OPTIONS / HTTP/1.0" 200 134 0.000499
Sep 28 12:16:40 ctl02 nova-api[26725]: 2017-09-28 12:16:40.873 26725 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:16:41 ctl02 nova-api[26725]: 2017-09-28 12:16:41.126 26725 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:16:41 ctl02 nova-api[26725]: 2017-09-28 12:16:41.129 26725 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:16:41 ctl02 nova-api[26725]: 2017-09-28 12:16:41.130 26725 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:16:41 ctl02 nova-api[26725]: 2017-09-28 12:16:41.130 26725 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:16:41 ctl02 nova-api[26725]: 2017-09-28 12:16:41.262 26725 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:16:41 ctl02 nova-api[26725]: 2017-09-28 12:16:41.265 26725 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:16:41 ctl02 nova-api[26725]: 2017-09-28 12:16:41.266 26725 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:16:41 ctl02 nova-api[26725]: 2017-09-28 12:16:41.266 26725 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:16:41 ctl02 nova-api[26725]: 2017-09-28 12:16:41.270 26725 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:16:41 ctl02 nova-api[26725]: 2017-09-28 12:16:41.270 26725 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:16:41 ctl02 nova-api[26725]: 2017-09-28 12:16:41.270 26725 ERROR nova Traceback (most recent call last):
Sep 28 12:16:41 ctl02 nova-api[26725]: 2017-09-28 12:16:41.270 26725 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:16:41 ctl02 nova-api[26725]: 2017-09-28 12:16:41.270 26725 ERROR nova     sys.exit(main())
Sep 28 12:16:41 ctl02 nova-api[26725]: 2017-09-28 12:16:41.270 26725 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:16:41 ctl02 nova-api[26725]: 2017-09-28 12:16:41.270 26725 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:16:41 ctl02 nova-api[26725]: 2017-09-28 12:16:41.270 26725 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:16:41 ctl02 nova-api[26725]: 2017-09-28 12:16:41.270 26725 ERROR nova     max_url_len=max_url_len)
Sep 28 12:16:41 ctl02 nova-api[26725]: 2017-09-28 12:16:41.270 26725 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:16:41 ctl02 nova-api[26725]: 2017-09-28 12:16:41.270 26725 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:16:41 ctl02 nova-api[26725]: 2017-09-28 12:16:41.270 26725 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:16:41 ctl02 nova-api[26725]: 2017-09-28 12:16:41.270 26725 ERROR nova     sock.listen(backlog)
Sep 28 12:16:41 ctl02 nova-api[26725]: 2017-09-28 12:16:41.270 26725 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:16:41 ctl02 nova-api[26725]: 2017-09-28 12:16:41.270 26725 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:16:41 ctl02 nova-api[26725]: 2017-09-28 12:16:41.270 26725 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:16:41 ctl02 nova-api[26725]: 2017-09-28 12:16:41.270 26725 ERROR nova
Sep 28 12:16:41 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:16:41 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:16:41 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:16:41 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:16:41 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:16:41 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:16:41 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:16:42 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:16:42.525 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:16:42] "OPTIONS / HTTP/1.0" 200 134 0.000411
Sep 28 12:16:42 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc20c865f)
Sep 28 12:16:43 ctl02 heat-api-cfn[13300]: 2017-09-28 12:16:43.247 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:16:43] "OPTIONS / HTTP/1.0" 200 134 0.000456
Sep 28 12:16:43 ctl02 nova-api[26743]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:16:43 ctl02 nova-api[26743]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:16:43 ctl02 nova-api[26743]: 2017-09-28 12:16:43.440 26743 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:16:43 ctl02 nova-api[26743]: 2017-09-28 12:16:43.442 26743 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:16:43 ctl02 nova-api[26743]: 2017-09-28 12:16:43.442 26743 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:16:43 ctl02 nova-api[26743]: 2017-09-28 12:16:43.442 26743 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:16:43 ctl02 nova-api[26743]: 2017-09-28 12:16:43.442 26743 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:16:43 ctl02 nova-api[26743]: 2017-09-28 12:16:43.442 26743 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:16:43 ctl02 nova-api[26743]: 2017-09-28 12:16:43.442 26743 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:16:43 ctl02 nova-api[26743]: 2017-09-28 12:16:43.442 26743 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:16:43 ctl02 nova-api[26743]: 2017-09-28 12:16:43.442 26743 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:16:43 ctl02 nova-api[26743]: 2017-09-28 12:16:43.442 26743 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:16:43 ctl02 nova-api[26743]: 2017-09-28 12:16:43.442 26743 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:16:43 ctl02 nova-api[26743]: 2017-09-28 12:16:43.442 26743 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:16:43 ctl02 nova-api[26743]: 2017-09-28 12:16:43.442 26743 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:16:43 ctl02 nova-api[26743]: 2017-09-28 12:16:43.442 26743 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:16:43 ctl02 nova-api[26743]: 2017-09-28 12:16:43.442 26743 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:16:43 ctl02 nova-api[26743]: 2017-09-28 12:16:43.442 26743 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:16:43 ctl02 nova-api[26743]: 2017-09-28 12:16:43.442 26743 ERROR nova.wsgi     self.filename))
Sep 28 12:16:43 ctl02 nova-api[26743]: 2017-09-28 12:16:43.442 26743 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:16:43 ctl02 nova-api[26743]: 2017-09-28 12:16:43.442 26743 ERROR nova.wsgi
Sep 28 12:16:43 ctl02 nova-api[26743]: 2017-09-28 12:16:43.443 26743 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:16:43 ctl02 nova-api[26743]: 2017-09-28 12:16:43.572 26743 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:16:43 ctl02 nova-api[26743]: 2017-09-28 12:16:43.804 26743 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:16:43 ctl02 nova-api[26743]: 2017-09-28 12:16:43.806 26743 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:16:43 ctl02 nova-api[26743]: 2017-09-28 12:16:43.806 26743 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:16:43 ctl02 nova-api[26743]: 2017-09-28 12:16:43.806 26743 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:16:43 ctl02 nova-api[26743]: 2017-09-28 12:16:43.937 26743 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:16:43 ctl02 nova-api[26743]: 2017-09-28 12:16:43.939 26743 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:16:43 ctl02 nova-api[26743]: 2017-09-28 12:16:43.939 26743 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:16:43 ctl02 nova-api[26743]: 2017-09-28 12:16:43.940 26743 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:16:43 ctl02 nova-api[26743]: 2017-09-28 12:16:43.943 26743 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:16:43 ctl02 nova-api[26743]: 2017-09-28 12:16:43.943 26743 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:16:43 ctl02 nova-api[26743]: 2017-09-28 12:16:43.943 26743 ERROR nova Traceback (most recent call last):
Sep 28 12:16:43 ctl02 nova-api[26743]: 2017-09-28 12:16:43.943 26743 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:16:43 ctl02 nova-api[26743]: 2017-09-28 12:16:43.943 26743 ERROR nova     sys.exit(main())
Sep 28 12:16:43 ctl02 nova-api[26743]: 2017-09-28 12:16:43.943 26743 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:16:43 ctl02 nova-api[26743]: 2017-09-28 12:16:43.943 26743 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:16:43 ctl02 nova-api[26743]: 2017-09-28 12:16:43.943 26743 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:16:43 ctl02 nova-api[26743]: 2017-09-28 12:16:43.943 26743 ERROR nova     max_url_len=max_url_len)
Sep 28 12:16:43 ctl02 nova-api[26743]: 2017-09-28 12:16:43.943 26743 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:16:43 ctl02 nova-api[26743]: 2017-09-28 12:16:43.943 26743 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:16:43 ctl02 nova-api[26743]: 2017-09-28 12:16:43.943 26743 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:16:43 ctl02 nova-api[26743]: 2017-09-28 12:16:43.943 26743 ERROR nova     sock.listen(backlog)
Sep 28 12:16:43 ctl02 nova-api[26743]: 2017-09-28 12:16:43.943 26743 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:16:43 ctl02 nova-api[26743]: 2017-09-28 12:16:43.943 26743 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:16:43 ctl02 nova-api[26743]: 2017-09-28 12:16:43.943 26743 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:16:43 ctl02 nova-api[26743]: 2017-09-28 12:16:43.943 26743 ERROR nova
Sep 28 12:16:43 ctl02 glance-api[29183]: 2017-09-28 12:16:43.976 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:16:43] "OPTIONS / HTTP/1.0" 200 134 0.000604
Sep 28 12:16:43 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc20c865f)
Sep 28 12:16:44 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:16:44 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:16:44 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:16:44 ctl02 heat-api[13008]: 2017-09-28 12:16:44.168 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:16:44] "OPTIONS / HTTP/1.0" 200 134 0.000769
Sep 28 12:16:44 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:16:44 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:16:44 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:16:44 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:16:44 ctl02 glance-api[29183]: 2017-09-28 12:16:44.455 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:16:44] "OPTIONS / HTTP/1.0" 200 134 0.000717
Sep 28 12:16:44 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc20c865f)
Sep 28 12:16:45 ctl02 heat-api[13008]: 2017-09-28 12:16:45.021 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:16:45] "OPTIONS / HTTP/1.0" 200 134 0.000682
Sep 28 12:16:45 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc20c865f)
Sep 28 12:16:46 ctl02 nova-api[26761]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:16:46 ctl02 nova-api[26761]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:16:46 ctl02 nova-api[26761]: 2017-09-28 12:16:46.264 26761 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:16:46 ctl02 nova-api[26761]: 2017-09-28 12:16:46.266 26761 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:16:46 ctl02 nova-api[26761]: 2017-09-28 12:16:46.266 26761 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:16:46 ctl02 nova-api[26761]: 2017-09-28 12:16:46.266 26761 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:16:46 ctl02 nova-api[26761]: 2017-09-28 12:16:46.266 26761 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:16:46 ctl02 nova-api[26761]: 2017-09-28 12:16:46.266 26761 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:16:46 ctl02 nova-api[26761]: 2017-09-28 12:16:46.266 26761 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:16:46 ctl02 nova-api[26761]: 2017-09-28 12:16:46.266 26761 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:16:46 ctl02 nova-api[26761]: 2017-09-28 12:16:46.266 26761 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:16:46 ctl02 nova-api[26761]: 2017-09-28 12:16:46.266 26761 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:16:46 ctl02 nova-api[26761]: 2017-09-28 12:16:46.266 26761 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:16:46 ctl02 nova-api[26761]: 2017-09-28 12:16:46.266 26761 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:16:46 ctl02 nova-api[26761]: 2017-09-28 12:16:46.266 26761 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:16:46 ctl02 nova-api[26761]: 2017-09-28 12:16:46.266 26761 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:16:46 ctl02 nova-api[26761]: 2017-09-28 12:16:46.266 26761 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:16:46 ctl02 nova-api[26761]: 2017-09-28 12:16:46.266 26761 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:16:46 ctl02 nova-api[26761]: 2017-09-28 12:16:46.266 26761 ERROR nova.wsgi     self.filename))
Sep 28 12:16:46 ctl02 nova-api[26761]: 2017-09-28 12:16:46.266 26761 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:16:46 ctl02 nova-api[26761]: 2017-09-28 12:16:46.266 26761 ERROR nova.wsgi
Sep 28 12:16:46 ctl02 nova-api[26761]: 2017-09-28 12:16:46.269 26761 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:16:46 ctl02 nova-api[26761]: 2017-09-28 12:16:46.410 26761 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:16:46 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command test.ping with jid 20170928121646524767
Sep 28 12:16:46 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 26774
Sep 28 12:16:46 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928121646524767
Sep 28 12:16:46 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:16:46.626 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:16:46] "OPTIONS / HTTP/1.0" 200 134 0.000459
Sep 28 12:16:46 ctl02 nova-api[26761]: 2017-09-28 12:16:46.665 26761 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:16:46 ctl02 nova-api[26761]: 2017-09-28 12:16:46.667 26761 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:16:46 ctl02 nova-api[26761]: 2017-09-28 12:16:46.667 26761 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:16:46 ctl02 nova-api[26761]: 2017-09-28 12:16:46.668 26761 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:16:46 ctl02 nova-consoleauth[5433]: 2017-09-28 12:16:46.699 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:16:46 ctl02 nova-api[26761]: 2017-09-28 12:16:46.800 26761 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:16:46 ctl02 nova-api[26761]: 2017-09-28 12:16:46.802 26761 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:16:46 ctl02 nova-api[26761]: 2017-09-28 12:16:46.802 26761 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:16:46 ctl02 nova-api[26761]: 2017-09-28 12:16:46.802 26761 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:16:46 ctl02 nova-api[26761]: 2017-09-28 12:16:46.806 26761 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:16:46 ctl02 nova-api[26761]: 2017-09-28 12:16:46.806 26761 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:16:46 ctl02 nova-api[26761]: 2017-09-28 12:16:46.806 26761 ERROR nova Traceback (most recent call last):
Sep 28 12:16:46 ctl02 nova-api[26761]: 2017-09-28 12:16:46.806 26761 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:16:46 ctl02 nova-api[26761]: 2017-09-28 12:16:46.806 26761 ERROR nova     sys.exit(main())
Sep 28 12:16:46 ctl02 nova-api[26761]: 2017-09-28 12:16:46.806 26761 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:16:46 ctl02 nova-api[26761]: 2017-09-28 12:16:46.806 26761 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:16:46 ctl02 nova-api[26761]: 2017-09-28 12:16:46.806 26761 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:16:46 ctl02 nova-api[26761]: 2017-09-28 12:16:46.806 26761 ERROR nova     max_url_len=max_url_len)
Sep 28 12:16:46 ctl02 nova-api[26761]: 2017-09-28 12:16:46.806 26761 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:16:46 ctl02 nova-api[26761]: 2017-09-28 12:16:46.806 26761 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:16:46 ctl02 nova-api[26761]: 2017-09-28 12:16:46.806 26761 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:16:46 ctl02 nova-api[26761]: 2017-09-28 12:16:46.806 26761 ERROR nova     sock.listen(backlog)
Sep 28 12:16:46 ctl02 nova-api[26761]: 2017-09-28 12:16:46.806 26761 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:16:46 ctl02 nova-api[26761]: 2017-09-28 12:16:46.806 26761 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:16:46 ctl02 nova-api[26761]: 2017-09-28 12:16:46.806 26761 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:16:46 ctl02 nova-api[26761]: 2017-09-28 12:16:46.806 26761 ERROR nova
Sep 28 12:16:46 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:16:46.885 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:16:46] "OPTIONS / HTTP/1.0" 200 134 0.000449
Sep 28 12:16:46 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:16:46 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:16:46 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:16:46 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc20c865f)
Sep 28 12:16:47 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:16:47 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:16:47 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:16:47 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:16:47 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc20c865f)
Sep 28 12:16:48 ctl02 nova-api[26784]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:16:48 ctl02 nova-api[26784]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:16:48 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc20c865f)
Sep 28 12:16:49 ctl02 nova-api[26784]: 2017-09-28 12:16:49.012 26784 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:16:49 ctl02 nova-api[26784]: 2017-09-28 12:16:49.014 26784 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:16:49 ctl02 nova-api[26784]: 2017-09-28 12:16:49.014 26784 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:16:49 ctl02 nova-api[26784]: 2017-09-28 12:16:49.014 26784 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:16:49 ctl02 nova-api[26784]: 2017-09-28 12:16:49.014 26784 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:16:49 ctl02 nova-api[26784]: 2017-09-28 12:16:49.014 26784 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:16:49 ctl02 nova-api[26784]: 2017-09-28 12:16:49.014 26784 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:16:49 ctl02 nova-api[26784]: 2017-09-28 12:16:49.014 26784 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:16:49 ctl02 nova-api[26784]: 2017-09-28 12:16:49.014 26784 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:16:49 ctl02 nova-api[26784]: 2017-09-28 12:16:49.014 26784 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:16:49 ctl02 nova-api[26784]: 2017-09-28 12:16:49.014 26784 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:16:49 ctl02 nova-api[26784]: 2017-09-28 12:16:49.014 26784 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:16:49 ctl02 nova-api[26784]: 2017-09-28 12:16:49.014 26784 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:16:49 ctl02 nova-api[26784]: 2017-09-28 12:16:49.014 26784 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:16:49 ctl02 nova-api[26784]: 2017-09-28 12:16:49.014 26784 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:16:49 ctl02 nova-api[26784]: 2017-09-28 12:16:49.014 26784 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:16:49 ctl02 nova-api[26784]: 2017-09-28 12:16:49.014 26784 ERROR nova.wsgi     self.filename))
Sep 28 12:16:49 ctl02 nova-api[26784]: 2017-09-28 12:16:49.014 26784 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:16:49 ctl02 nova-api[26784]: 2017-09-28 12:16:49.014 26784 ERROR nova.wsgi
Sep 28 12:16:49 ctl02 nova-api[26784]: 2017-09-28 12:16:49.016 26784 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:16:49 ctl02 heat-api[13008]: 2017-09-28 12:16:49.056 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:16:49] "OPTIONS / HTTP/1.0" 200 134 0.000599
Sep 28 12:16:49 ctl02 nova-api[26784]: 2017-09-28 12:16:49.146 26784 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:16:49 ctl02 nova-api[26784]: 2017-09-28 12:16:49.374 26784 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:16:49 ctl02 nova-api[26784]: 2017-09-28 12:16:49.376 26784 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:16:49 ctl02 nova-api[26784]: 2017-09-28 12:16:49.377 26784 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:16:49 ctl02 nova-api[26784]: 2017-09-28 12:16:49.377 26784 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:16:49 ctl02 nova-api[26784]: 2017-09-28 12:16:49.508 26784 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:16:49 ctl02 nova-api[26784]: 2017-09-28 12:16:49.510 26784 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:16:49 ctl02 nova-api[26784]: 2017-09-28 12:16:49.510 26784 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:16:49 ctl02 nova-api[26784]: 2017-09-28 12:16:49.510 26784 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:16:49 ctl02 nova-api[26784]: 2017-09-28 12:16:49.514 26784 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:16:49 ctl02 nova-api[26784]: 2017-09-28 12:16:49.514 26784 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:16:49 ctl02 nova-api[26784]: 2017-09-28 12:16:49.514 26784 ERROR nova Traceback (most recent call last):
Sep 28 12:16:49 ctl02 nova-api[26784]: 2017-09-28 12:16:49.514 26784 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:16:49 ctl02 nova-api[26784]: 2017-09-28 12:16:49.514 26784 ERROR nova     sys.exit(main())
Sep 28 12:16:49 ctl02 nova-api[26784]: 2017-09-28 12:16:49.514 26784 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:16:49 ctl02 nova-api[26784]: 2017-09-28 12:16:49.514 26784 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:16:49 ctl02 nova-api[26784]: 2017-09-28 12:16:49.514 26784 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:16:49 ctl02 nova-api[26784]: 2017-09-28 12:16:49.514 26784 ERROR nova     max_url_len=max_url_len)
Sep 28 12:16:49 ctl02 nova-api[26784]: 2017-09-28 12:16:49.514 26784 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:16:49 ctl02 nova-api[26784]: 2017-09-28 12:16:49.514 26784 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:16:49 ctl02 nova-api[26784]: 2017-09-28 12:16:49.514 26784 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:16:49 ctl02 nova-api[26784]: 2017-09-28 12:16:49.514 26784 ERROR nova     sock.listen(backlog)
Sep 28 12:16:49 ctl02 nova-api[26784]: 2017-09-28 12:16:49.514 26784 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:16:49 ctl02 nova-api[26784]: 2017-09-28 12:16:49.514 26784 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:16:49 ctl02 nova-api[26784]: 2017-09-28 12:16:49.514 26784 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:16:49 ctl02 nova-api[26784]: 2017-09-28 12:16:49.514 26784 ERROR nova
Sep 28 12:16:49 ctl02 heat-api-cfn[13300]: 2017-09-28 12:16:49.593 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:16:49] "OPTIONS / HTTP/1.0" 200 134 0.000460
Sep 28 12:16:49 ctl02 heat-engine[12803]: 2017-09-28 12:16:49.623 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:16:49 ctl02 heat-engine[12803]: 2017-09-28 12:16:49.627 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:16:49 ctl02 heat-engine[12803]: 2017-09-28 12:16:49.634 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:16:49 ctl02 heat-engine[12803]: 2017-09-28 12:16:49.630 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:16:49 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:16:49 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:16:49 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:16:49 ctl02 nova-scheduler[5620]: 2017-09-28 12:16:49.723 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:16:49 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:16:49 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:16:49 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:16:49 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:16:49 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc20c865f)
Sep 28 12:16:50 ctl02 glance-api[29183]: 2017-09-28 12:16:50.646 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:16:50] "OPTIONS / HTTP/1.0" 200 134 0.000576
Sep 28 12:16:50 ctl02 heat-api-cfn[13300]: 2017-09-28 12:16:50.897 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:16:50] "OPTIONS / HTTP/1.0" 200 134 0.000453
Sep 28 12:16:51 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc20c865f)
Sep 28 12:16:51 ctl02 nova-api[26802]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:16:51 ctl02 nova-api[26802]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:16:51 ctl02 nova-api[26802]: 2017-09-28 12:16:51.685 26802 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:16:51 ctl02 nova-api[26802]: 2017-09-28 12:16:51.687 26802 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:16:51 ctl02 nova-api[26802]: 2017-09-28 12:16:51.687 26802 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:16:51 ctl02 nova-api[26802]: 2017-09-28 12:16:51.687 26802 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:16:51 ctl02 nova-api[26802]: 2017-09-28 12:16:51.687 26802 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:16:51 ctl02 nova-api[26802]: 2017-09-28 12:16:51.687 26802 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:16:51 ctl02 nova-api[26802]: 2017-09-28 12:16:51.687 26802 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:16:51 ctl02 nova-api[26802]: 2017-09-28 12:16:51.687 26802 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:16:51 ctl02 nova-api[26802]: 2017-09-28 12:16:51.687 26802 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:16:51 ctl02 nova-api[26802]: 2017-09-28 12:16:51.687 26802 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:16:51 ctl02 nova-api[26802]: 2017-09-28 12:16:51.687 26802 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:16:51 ctl02 nova-api[26802]: 2017-09-28 12:16:51.687 26802 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:16:51 ctl02 nova-api[26802]: 2017-09-28 12:16:51.687 26802 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:16:51 ctl02 nova-api[26802]: 2017-09-28 12:16:51.687 26802 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:16:51 ctl02 nova-api[26802]: 2017-09-28 12:16:51.687 26802 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:16:51 ctl02 nova-api[26802]: 2017-09-28 12:16:51.687 26802 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:16:51 ctl02 nova-api[26802]: 2017-09-28 12:16:51.687 26802 ERROR nova.wsgi     self.filename))
Sep 28 12:16:51 ctl02 nova-api[26802]: 2017-09-28 12:16:51.687 26802 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:16:51 ctl02 nova-api[26802]: 2017-09-28 12:16:51.687 26802 ERROR nova.wsgi
Sep 28 12:16:51 ctl02 nova-api[26802]: 2017-09-28 12:16:51.688 26802 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:16:51 ctl02 nova-api[26802]: 2017-09-28 12:16:51.817 26802 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:16:52 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc20c865f)
Sep 28 12:16:52 ctl02 nova-api[26802]: 2017-09-28 12:16:52.044 26802 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:16:52 ctl02 nova-api[26802]: 2017-09-28 12:16:52.046 26802 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:16:52 ctl02 nova-api[26802]: 2017-09-28 12:16:52.047 26802 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:16:52 ctl02 nova-api[26802]: 2017-09-28 12:16:52.047 26802 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:16:52 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:16:52.134 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:16:52] "OPTIONS / HTTP/1.0" 200 134 0.000417
Sep 28 12:16:52 ctl02 nova-api[26802]: 2017-09-28 12:16:52.178 26802 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:16:52 ctl02 nova-api[26802]: 2017-09-28 12:16:52.179 26802 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:16:52 ctl02 nova-api[26802]: 2017-09-28 12:16:52.180 26802 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:16:52 ctl02 nova-api[26802]: 2017-09-28 12:16:52.180 26802 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:16:52 ctl02 nova-api[26802]: 2017-09-28 12:16:52.183 26802 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:16:52 ctl02 nova-api[26802]: 2017-09-28 12:16:52.184 26802 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:16:52 ctl02 nova-api[26802]: 2017-09-28 12:16:52.184 26802 ERROR nova Traceback (most recent call last):
Sep 28 12:16:52 ctl02 nova-api[26802]: 2017-09-28 12:16:52.184 26802 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:16:52 ctl02 nova-api[26802]: 2017-09-28 12:16:52.184 26802 ERROR nova     sys.exit(main())
Sep 28 12:16:52 ctl02 nova-api[26802]: 2017-09-28 12:16:52.184 26802 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:16:52 ctl02 nova-api[26802]: 2017-09-28 12:16:52.184 26802 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:16:52 ctl02 nova-api[26802]: 2017-09-28 12:16:52.184 26802 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:16:52 ctl02 nova-api[26802]: 2017-09-28 12:16:52.184 26802 ERROR nova     max_url_len=max_url_len)
Sep 28 12:16:52 ctl02 nova-api[26802]: 2017-09-28 12:16:52.184 26802 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:16:52 ctl02 nova-api[26802]: 2017-09-28 12:16:52.184 26802 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:16:52 ctl02 nova-api[26802]: 2017-09-28 12:16:52.184 26802 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:16:52 ctl02 nova-api[26802]: 2017-09-28 12:16:52.184 26802 ERROR nova     sock.listen(backlog)
Sep 28 12:16:52 ctl02 nova-api[26802]: 2017-09-28 12:16:52.184 26802 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:16:52 ctl02 nova-api[26802]: 2017-09-28 12:16:52.184 26802 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:16:52 ctl02 nova-api[26802]: 2017-09-28 12:16:52.184 26802 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:16:52 ctl02 nova-api[26802]: 2017-09-28 12:16:52.184 26802 ERROR nova
Sep 28 12:16:52 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:16:52 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:16:52 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:16:52 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:16:52 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:16:52 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:16:52 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:16:53 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:16:53 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:16:53 ctl02 heat-api-cfn[13300]: 2017-09-28 12:16:53.345 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:16:53] "OPTIONS / HTTP/1.0" 200 134 0.000561
Sep 28 12:16:53 ctl02 glance-api[29183]: 2017-09-28 12:16:53.582 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:16:53] "OPTIONS / HTTP/1.0" 200 134 0.000596
Sep 28 12:16:54 ctl02 nova-api[26820]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:16:54 ctl02 nova-api[26820]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:16:54 ctl02 glance-api[29183]: 2017-09-28 12:16:54.376 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:16:54] "OPTIONS / HTTP/1.0" 200 134 0.000651
Sep 28 12:16:54 ctl02 heat-api[13008]: 2017-09-28 12:16:54.479 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:16:54] "OPTIONS / HTTP/1.0" 200 134 0.000586
Sep 28 12:16:54 ctl02 nova-api[26820]: 2017-09-28 12:16:54.503 26820 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:16:54 ctl02 nova-api[26820]: 2017-09-28 12:16:54.505 26820 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:16:54 ctl02 nova-api[26820]: 2017-09-28 12:16:54.505 26820 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:16:54 ctl02 nova-api[26820]: 2017-09-28 12:16:54.505 26820 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:16:54 ctl02 nova-api[26820]: 2017-09-28 12:16:54.505 26820 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:16:54 ctl02 nova-api[26820]: 2017-09-28 12:16:54.505 26820 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:16:54 ctl02 nova-api[26820]: 2017-09-28 12:16:54.505 26820 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:16:54 ctl02 nova-api[26820]: 2017-09-28 12:16:54.505 26820 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:16:54 ctl02 nova-api[26820]: 2017-09-28 12:16:54.505 26820 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:16:54 ctl02 nova-api[26820]: 2017-09-28 12:16:54.505 26820 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:16:54 ctl02 nova-api[26820]: 2017-09-28 12:16:54.505 26820 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:16:54 ctl02 nova-api[26820]: 2017-09-28 12:16:54.505 26820 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:16:54 ctl02 nova-api[26820]: 2017-09-28 12:16:54.505 26820 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:16:54 ctl02 nova-api[26820]: 2017-09-28 12:16:54.505 26820 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:16:54 ctl02 nova-api[26820]: 2017-09-28 12:16:54.505 26820 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:16:54 ctl02 nova-api[26820]: 2017-09-28 12:16:54.505 26820 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:16:54 ctl02 nova-api[26820]: 2017-09-28 12:16:54.505 26820 ERROR nova.wsgi     self.filename))
Sep 28 12:16:54 ctl02 nova-api[26820]: 2017-09-28 12:16:54.505 26820 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:16:54 ctl02 nova-api[26820]: 2017-09-28 12:16:54.505 26820 ERROR nova.wsgi
Sep 28 12:16:54 ctl02 nova-api[26820]: 2017-09-28 12:16:54.507 26820 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:16:54 ctl02 nova-api[26820]: 2017-09-28 12:16:54.643 26820 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:16:54 ctl02 nova-api[26820]: 2017-09-28 12:16:54.895 26820 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:16:54 ctl02 nova-api[26820]: 2017-09-28 12:16:54.897 26820 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:16:54 ctl02 nova-api[26820]: 2017-09-28 12:16:54.898 26820 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:16:54 ctl02 nova-api[26820]: 2017-09-28 12:16:54.898 26820 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:16:55 ctl02 nova-api[26820]: 2017-09-28 12:16:55.031 26820 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:16:55 ctl02 nova-api[26820]: 2017-09-28 12:16:55.034 26820 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:16:55 ctl02 nova-api[26820]: 2017-09-28 12:16:55.034 26820 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:16:55 ctl02 nova-api[26820]: 2017-09-28 12:16:55.035 26820 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:16:55 ctl02 nova-api[26820]: 2017-09-28 12:16:55.038 26820 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:16:55 ctl02 nova-api[26820]: 2017-09-28 12:16:55.039 26820 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:16:55 ctl02 nova-api[26820]: 2017-09-28 12:16:55.039 26820 ERROR nova Traceback (most recent call last):
Sep 28 12:16:55 ctl02 nova-api[26820]: 2017-09-28 12:16:55.039 26820 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:16:55 ctl02 nova-api[26820]: 2017-09-28 12:16:55.039 26820 ERROR nova     sys.exit(main())
Sep 28 12:16:55 ctl02 nova-api[26820]: 2017-09-28 12:16:55.039 26820 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:16:55 ctl02 nova-api[26820]: 2017-09-28 12:16:55.039 26820 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:16:55 ctl02 nova-api[26820]: 2017-09-28 12:16:55.039 26820 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:16:55 ctl02 nova-api[26820]: 2017-09-28 12:16:55.039 26820 ERROR nova     max_url_len=max_url_len)
Sep 28 12:16:55 ctl02 nova-api[26820]: 2017-09-28 12:16:55.039 26820 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:16:55 ctl02 nova-api[26820]: 2017-09-28 12:16:55.039 26820 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:16:55 ctl02 nova-api[26820]: 2017-09-28 12:16:55.039 26820 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:16:55 ctl02 nova-api[26820]: 2017-09-28 12:16:55.039 26820 ERROR nova     sock.listen(backlog)
Sep 28 12:16:55 ctl02 nova-api[26820]: 2017-09-28 12:16:55.039 26820 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:16:55 ctl02 nova-api[26820]: 2017-09-28 12:16:55.039 26820 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:16:55 ctl02 nova-api[26820]: 2017-09-28 12:16:55.039 26820 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:16:55 ctl02 nova-api[26820]: 2017-09-28 12:16:55.039 26820 ERROR nova
Sep 28 12:16:55 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:16:55 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:16:55 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:16:55 ctl02 heat-api[13008]: 2017-09-28 12:16:55.257 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:16:55] "OPTIONS / HTTP/1.0" 200 134 0.000642
Sep 28 12:16:55 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:16:55 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:16:55 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:16:55 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:16:56 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:16:56.583 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:16:56] "OPTIONS / HTTP/1.0" 200 134 0.000460
Sep 28 12:16:56 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:16:56.902 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:16:56] "OPTIONS / HTTP/1.0" 200 134 0.000366
Sep 28 12:16:57 ctl02 nova-api[26843]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:16:57 ctl02 nova-api[26843]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:16:57 ctl02 nova-api[26843]: 2017-09-28 12:16:57.277 26843 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:16:57 ctl02 nova-api[26843]: 2017-09-28 12:16:57.279 26843 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:16:57 ctl02 nova-api[26843]: 2017-09-28 12:16:57.279 26843 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:16:57 ctl02 nova-api[26843]: 2017-09-28 12:16:57.279 26843 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:16:57 ctl02 nova-api[26843]: 2017-09-28 12:16:57.279 26843 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:16:57 ctl02 nova-api[26843]: 2017-09-28 12:16:57.279 26843 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:16:57 ctl02 nova-api[26843]: 2017-09-28 12:16:57.279 26843 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:16:57 ctl02 nova-api[26843]: 2017-09-28 12:16:57.279 26843 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:16:57 ctl02 nova-api[26843]: 2017-09-28 12:16:57.279 26843 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:16:57 ctl02 nova-api[26843]: 2017-09-28 12:16:57.279 26843 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:16:57 ctl02 nova-api[26843]: 2017-09-28 12:16:57.279 26843 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:16:57 ctl02 nova-api[26843]: 2017-09-28 12:16:57.279 26843 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:16:57 ctl02 nova-api[26843]: 2017-09-28 12:16:57.279 26843 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:16:57 ctl02 nova-api[26843]: 2017-09-28 12:16:57.279 26843 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:16:57 ctl02 nova-api[26843]: 2017-09-28 12:16:57.279 26843 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:16:57 ctl02 nova-api[26843]: 2017-09-28 12:16:57.279 26843 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:16:57 ctl02 nova-api[26843]: 2017-09-28 12:16:57.279 26843 ERROR nova.wsgi     self.filename))
Sep 28 12:16:57 ctl02 nova-api[26843]: 2017-09-28 12:16:57.279 26843 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:16:57 ctl02 nova-api[26843]: 2017-09-28 12:16:57.279 26843 ERROR nova.wsgi
Sep 28 12:16:57 ctl02 nova-api[26843]: 2017-09-28 12:16:57.280 26843 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:16:57 ctl02 nova-api[26843]: 2017-09-28 12:16:57.415 26843 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:16:57 ctl02 nova-api[26843]: 2017-09-28 12:16:57.665 26843 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:16:57 ctl02 nova-api[26843]: 2017-09-28 12:16:57.668 26843 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:16:57 ctl02 nova-api[26843]: 2017-09-28 12:16:57.668 26843 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:16:57 ctl02 nova-api[26843]: 2017-09-28 12:16:57.668 26843 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:16:57 ctl02 nova-api[26843]: 2017-09-28 12:16:57.801 26843 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:16:57 ctl02 nova-api[26843]: 2017-09-28 12:16:57.804 26843 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:16:57 ctl02 nova-api[26843]: 2017-09-28 12:16:57.804 26843 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:16:57 ctl02 nova-api[26843]: 2017-09-28 12:16:57.805 26843 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:16:57 ctl02 nova-api[26843]: 2017-09-28 12:16:57.808 26843 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:16:57 ctl02 nova-api[26843]: 2017-09-28 12:16:57.809 26843 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:16:57 ctl02 nova-api[26843]: 2017-09-28 12:16:57.809 26843 ERROR nova Traceback (most recent call last):
Sep 28 12:16:57 ctl02 nova-api[26843]: 2017-09-28 12:16:57.809 26843 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:16:57 ctl02 nova-api[26843]: 2017-09-28 12:16:57.809 26843 ERROR nova     sys.exit(main())
Sep 28 12:16:57 ctl02 nova-api[26843]: 2017-09-28 12:16:57.809 26843 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:16:57 ctl02 nova-api[26843]: 2017-09-28 12:16:57.809 26843 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:16:57 ctl02 nova-api[26843]: 2017-09-28 12:16:57.809 26843 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:16:57 ctl02 nova-api[26843]: 2017-09-28 12:16:57.809 26843 ERROR nova     max_url_len=max_url_len)
Sep 28 12:16:57 ctl02 nova-api[26843]: 2017-09-28 12:16:57.809 26843 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:16:57 ctl02 nova-api[26843]: 2017-09-28 12:16:57.809 26843 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:16:57 ctl02 nova-api[26843]: 2017-09-28 12:16:57.809 26843 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:16:57 ctl02 nova-api[26843]: 2017-09-28 12:16:57.809 26843 ERROR nova     sock.listen(backlog)
Sep 28 12:16:57 ctl02 nova-api[26843]: 2017-09-28 12:16:57.809 26843 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:16:57 ctl02 nova-api[26843]: 2017-09-28 12:16:57.809 26843 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:16:57 ctl02 nova-api[26843]: 2017-09-28 12:16:57.809 26843 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:16:57 ctl02 nova-api[26843]: 2017-09-28 12:16:57.809 26843 ERROR nova
Sep 28 12:16:57 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:16:57 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:16:57 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:16:58 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:16:58 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:16:58 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:16:58 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:16:58 ctl02 heat-api[13008]: 2017-09-28 12:16:58.961 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:16:58] "OPTIONS / HTTP/1.0" 200 134 0.000652
Sep 28 12:16:59 ctl02 heat-api-cfn[13300]: 2017-09-28 12:16:59.446 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:16:59] "OPTIONS / HTTP/1.0" 200 134 0.000527
Sep 28 12:16:59 ctl02 nova-api[26861]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:16:59 ctl02 nova-api[26861]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:16:59 ctl02 nova-api[26861]: 2017-09-28 12:16:59.984 26861 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:16:59 ctl02 nova-api[26861]: 2017-09-28 12:16:59.986 26861 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:16:59 ctl02 nova-api[26861]: 2017-09-28 12:16:59.986 26861 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:16:59 ctl02 nova-api[26861]: 2017-09-28 12:16:59.986 26861 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:16:59 ctl02 nova-api[26861]: 2017-09-28 12:16:59.986 26861 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:16:59 ctl02 nova-api[26861]: 2017-09-28 12:16:59.986 26861 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:16:59 ctl02 nova-api[26861]: 2017-09-28 12:16:59.986 26861 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:16:59 ctl02 nova-api[26861]: 2017-09-28 12:16:59.986 26861 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:16:59 ctl02 nova-api[26861]: 2017-09-28 12:16:59.986 26861 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:16:59 ctl02 nova-api[26861]: 2017-09-28 12:16:59.986 26861 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:16:59 ctl02 nova-api[26861]: 2017-09-28 12:16:59.986 26861 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:16:59 ctl02 nova-api[26861]: 2017-09-28 12:16:59.986 26861 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:16:59 ctl02 nova-api[26861]: 2017-09-28 12:16:59.986 26861 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:16:59 ctl02 nova-api[26861]: 2017-09-28 12:16:59.986 26861 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:16:59 ctl02 nova-api[26861]: 2017-09-28 12:16:59.986 26861 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:16:59 ctl02 nova-api[26861]: 2017-09-28 12:16:59.986 26861 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:16:59 ctl02 nova-api[26861]: 2017-09-28 12:16:59.986 26861 ERROR nova.wsgi     self.filename))
Sep 28 12:16:59 ctl02 nova-api[26861]: 2017-09-28 12:16:59.986 26861 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:16:59 ctl02 nova-api[26861]: 2017-09-28 12:16:59.986 26861 ERROR nova.wsgi
Sep 28 12:16:59 ctl02 nova-api[26861]: 2017-09-28 12:16:59.988 26861 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:17:00 ctl02 nova-api[26861]: 2017-09-28 12:17:00.124 26861 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:17:00 ctl02 nova-api[26861]: 2017-09-28 12:17:00.373 26861 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:17:00 ctl02 nova-api[26861]: 2017-09-28 12:17:00.376 26861 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:17:00 ctl02 nova-api[26861]: 2017-09-28 12:17:00.377 26861 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:17:00 ctl02 nova-api[26861]: 2017-09-28 12:17:00.377 26861 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:17:00 ctl02 nova-api[26861]: 2017-09-28 12:17:00.509 26861 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:17:00 ctl02 nova-api[26861]: 2017-09-28 12:17:00.512 26861 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:17:00 ctl02 nova-api[26861]: 2017-09-28 12:17:00.512 26861 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:17:00 ctl02 nova-api[26861]: 2017-09-28 12:17:00.513 26861 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:17:00 ctl02 nova-api[26861]: 2017-09-28 12:17:00.516 26861 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:17:00 ctl02 nova-api[26861]: 2017-09-28 12:17:00.517 26861 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:17:00 ctl02 nova-api[26861]: 2017-09-28 12:17:00.517 26861 ERROR nova Traceback (most recent call last):
Sep 28 12:17:00 ctl02 nova-api[26861]: 2017-09-28 12:17:00.517 26861 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:17:00 ctl02 nova-api[26861]: 2017-09-28 12:17:00.517 26861 ERROR nova     sys.exit(main())
Sep 28 12:17:00 ctl02 nova-api[26861]: 2017-09-28 12:17:00.517 26861 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:17:00 ctl02 nova-api[26861]: 2017-09-28 12:17:00.517 26861 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:17:00 ctl02 nova-api[26861]: 2017-09-28 12:17:00.517 26861 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:17:00 ctl02 nova-api[26861]: 2017-09-28 12:17:00.517 26861 ERROR nova     max_url_len=max_url_len)
Sep 28 12:17:00 ctl02 nova-api[26861]: 2017-09-28 12:17:00.517 26861 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:17:00 ctl02 nova-api[26861]: 2017-09-28 12:17:00.517 26861 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:17:00 ctl02 nova-api[26861]: 2017-09-28 12:17:00.517 26861 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:17:00 ctl02 nova-api[26861]: 2017-09-28 12:17:00.517 26861 ERROR nova     sock.listen(backlog)
Sep 28 12:17:00 ctl02 nova-api[26861]: 2017-09-28 12:17:00.517 26861 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:17:00 ctl02 nova-api[26861]: 2017-09-28 12:17:00.517 26861 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:17:00 ctl02 nova-api[26861]: 2017-09-28 12:17:00.517 26861 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:17:00 ctl02 nova-api[26861]: 2017-09-28 12:17:00.517 26861 ERROR nova
Sep 28 12:17:00 ctl02 heat-api-cfn[13300]: 2017-09-28 12:17:00.540 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:17:00] "OPTIONS / HTTP/1.0" 200 134 0.000568
Sep 28 12:17:00 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:17:00 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:17:00 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:17:00 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:17:00 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:17:00 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:17:00 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:17:00 ctl02 glance-api[29183]: 2017-09-28 12:17:00.969 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:17:00] "OPTIONS / HTTP/1.0" 200 134 0.000682
Sep 28 12:17:01 ctl02 CRON[26889]: (root) CMD (   cd / && run-parts --report /etc/cron.hourly)
Sep 28 12:17:01 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:17:01.855 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:17:01] "OPTIONS / HTTP/1.0" 200 134 0.000532
Sep 28 12:17:02 ctl02 nova-api[26878]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:17:02 ctl02 nova-api[26878]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:17:02 ctl02 nova-api[26878]: 2017-09-28 12:17:02.722 26878 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:17:02 ctl02 nova-api[26878]: 2017-09-28 12:17:02.724 26878 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:17:02 ctl02 nova-api[26878]: 2017-09-28 12:17:02.724 26878 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:17:02 ctl02 nova-api[26878]: 2017-09-28 12:17:02.724 26878 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:17:02 ctl02 nova-api[26878]: 2017-09-28 12:17:02.724 26878 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:17:02 ctl02 nova-api[26878]: 2017-09-28 12:17:02.724 26878 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:17:02 ctl02 nova-api[26878]: 2017-09-28 12:17:02.724 26878 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:17:02 ctl02 nova-api[26878]: 2017-09-28 12:17:02.724 26878 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:17:02 ctl02 nova-api[26878]: 2017-09-28 12:17:02.724 26878 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:17:02 ctl02 nova-api[26878]: 2017-09-28 12:17:02.724 26878 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:17:02 ctl02 nova-api[26878]: 2017-09-28 12:17:02.724 26878 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:17:02 ctl02 nova-api[26878]: 2017-09-28 12:17:02.724 26878 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:17:02 ctl02 nova-api[26878]: 2017-09-28 12:17:02.724 26878 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:17:02 ctl02 nova-api[26878]: 2017-09-28 12:17:02.724 26878 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:17:02 ctl02 nova-api[26878]: 2017-09-28 12:17:02.724 26878 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:17:02 ctl02 nova-api[26878]: 2017-09-28 12:17:02.724 26878 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:17:02 ctl02 nova-api[26878]: 2017-09-28 12:17:02.724 26878 ERROR nova.wsgi     self.filename))
Sep 28 12:17:02 ctl02 nova-api[26878]: 2017-09-28 12:17:02.724 26878 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:17:02 ctl02 nova-api[26878]: 2017-09-28 12:17:02.724 26878 ERROR nova.wsgi
Sep 28 12:17:02 ctl02 nova-api[26878]: 2017-09-28 12:17:02.726 26878 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:17:02 ctl02 nova-api[26878]: 2017-09-28 12:17:02.860 26878 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:17:03 ctl02 nova-api[26878]: 2017-09-28 12:17:03.110 26878 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:17:03 ctl02 nova-api[26878]: 2017-09-28 12:17:03.113 26878 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:17:03 ctl02 nova-api[26878]: 2017-09-28 12:17:03.114 26878 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:17:03 ctl02 nova-api[26878]: 2017-09-28 12:17:03.114 26878 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:17:03 ctl02 heat-api-cfn[13300]: 2017-09-28 12:17:03.227 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:17:03] "OPTIONS / HTTP/1.0" 200 134 0.000575
Sep 28 12:17:03 ctl02 nova-api[26878]: 2017-09-28 12:17:03.246 26878 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:17:03 ctl02 nova-api[26878]: 2017-09-28 12:17:03.249 26878 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:17:03 ctl02 nova-api[26878]: 2017-09-28 12:17:03.249 26878 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:17:03 ctl02 nova-api[26878]: 2017-09-28 12:17:03.249 26878 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:17:03 ctl02 nova-api[26878]: 2017-09-28 12:17:03.253 26878 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:17:03 ctl02 nova-api[26878]: 2017-09-28 12:17:03.253 26878 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:17:03 ctl02 nova-api[26878]: 2017-09-28 12:17:03.253 26878 ERROR nova Traceback (most recent call last):
Sep 28 12:17:03 ctl02 nova-api[26878]: 2017-09-28 12:17:03.253 26878 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:17:03 ctl02 nova-api[26878]: 2017-09-28 12:17:03.253 26878 ERROR nova     sys.exit(main())
Sep 28 12:17:03 ctl02 nova-api[26878]: 2017-09-28 12:17:03.253 26878 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:17:03 ctl02 nova-api[26878]: 2017-09-28 12:17:03.253 26878 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:17:03 ctl02 nova-api[26878]: 2017-09-28 12:17:03.253 26878 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:17:03 ctl02 nova-api[26878]: 2017-09-28 12:17:03.253 26878 ERROR nova     max_url_len=max_url_len)
Sep 28 12:17:03 ctl02 nova-api[26878]: 2017-09-28 12:17:03.253 26878 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:17:03 ctl02 nova-api[26878]: 2017-09-28 12:17:03.253 26878 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:17:03 ctl02 nova-api[26878]: 2017-09-28 12:17:03.253 26878 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:17:03 ctl02 nova-api[26878]: 2017-09-28 12:17:03.253 26878 ERROR nova     sock.listen(backlog)
Sep 28 12:17:03 ctl02 nova-api[26878]: 2017-09-28 12:17:03.253 26878 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:17:03 ctl02 nova-api[26878]: 2017-09-28 12:17:03.253 26878 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:17:03 ctl02 nova-api[26878]: 2017-09-28 12:17:03.253 26878 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:17:03 ctl02 nova-api[26878]: 2017-09-28 12:17:03.253 26878 ERROR nova
Sep 28 12:17:03 ctl02 glance-api[29183]: 2017-09-28 12:17:03.342 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:17:03] "OPTIONS / HTTP/1.0" 200 134 0.000640
Sep 28 12:17:03 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:17:03 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:17:03 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:17:03 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:17:03 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:17:03 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:17:03 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:17:04 ctl02 glance-api[29183]: 2017-09-28 12:17:04.284 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:17:04] "OPTIONS / HTTP/1.0" 200 134 0.000625
Sep 28 12:17:04 ctl02 heat-api[13008]: 2017-09-28 12:17:04.526 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:17:04] "OPTIONS / HTTP/1.0" 200 134 0.000610
Sep 28 12:17:05 ctl02 nova-api[26900]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:17:05 ctl02 nova-api[26900]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:17:05 ctl02 nova-api[26900]: 2017-09-28 12:17:05.509 26900 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:17:05 ctl02 nova-api[26900]: 2017-09-28 12:17:05.511 26900 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:17:05 ctl02 nova-api[26900]: 2017-09-28 12:17:05.511 26900 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:17:05 ctl02 nova-api[26900]: 2017-09-28 12:17:05.511 26900 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:17:05 ctl02 nova-api[26900]: 2017-09-28 12:17:05.511 26900 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:17:05 ctl02 nova-api[26900]: 2017-09-28 12:17:05.511 26900 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:17:05 ctl02 nova-api[26900]: 2017-09-28 12:17:05.511 26900 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:17:05 ctl02 nova-api[26900]: 2017-09-28 12:17:05.511 26900 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:17:05 ctl02 nova-api[26900]: 2017-09-28 12:17:05.511 26900 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:17:05 ctl02 nova-api[26900]: 2017-09-28 12:17:05.511 26900 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:17:05 ctl02 nova-api[26900]: 2017-09-28 12:17:05.511 26900 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:17:05 ctl02 nova-api[26900]: 2017-09-28 12:17:05.511 26900 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:17:05 ctl02 nova-api[26900]: 2017-09-28 12:17:05.511 26900 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:17:05 ctl02 nova-api[26900]: 2017-09-28 12:17:05.511 26900 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:17:05 ctl02 nova-api[26900]: 2017-09-28 12:17:05.511 26900 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:17:05 ctl02 nova-api[26900]: 2017-09-28 12:17:05.511 26900 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:17:05 ctl02 nova-api[26900]: 2017-09-28 12:17:05.511 26900 ERROR nova.wsgi     self.filename))
Sep 28 12:17:05 ctl02 nova-api[26900]: 2017-09-28 12:17:05.511 26900 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:17:05 ctl02 nova-api[26900]: 2017-09-28 12:17:05.511 26900 ERROR nova.wsgi
Sep 28 12:17:05 ctl02 nova-api[26900]: 2017-09-28 12:17:05.512 26900 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:17:05 ctl02 heat-api[13008]: 2017-09-28 12:17:05.544 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:17:05] "OPTIONS / HTTP/1.0" 200 134 0.000636
Sep 28 12:17:05 ctl02 nova-api[26900]: 2017-09-28 12:17:05.649 26900 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:17:05 ctl02 nova-api[26900]: 2017-09-28 12:17:05.899 26900 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:17:05 ctl02 nova-api[26900]: 2017-09-28 12:17:05.902 26900 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:17:05 ctl02 nova-api[26900]: 2017-09-28 12:17:05.902 26900 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:17:05 ctl02 nova-api[26900]: 2017-09-28 12:17:05.902 26900 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:17:06 ctl02 nova-api[26900]: 2017-09-28 12:17:06.035 26900 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:17:06 ctl02 nova-api[26900]: 2017-09-28 12:17:06.037 26900 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:17:06 ctl02 nova-api[26900]: 2017-09-28 12:17:06.037 26900 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:17:06 ctl02 nova-api[26900]: 2017-09-28 12:17:06.038 26900 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:17:06 ctl02 nova-api[26900]: 2017-09-28 12:17:06.041 26900 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:17:06 ctl02 nova-api[26900]: 2017-09-28 12:17:06.041 26900 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:17:06 ctl02 nova-api[26900]: 2017-09-28 12:17:06.041 26900 ERROR nova Traceback (most recent call last):
Sep 28 12:17:06 ctl02 nova-api[26900]: 2017-09-28 12:17:06.041 26900 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:17:06 ctl02 nova-api[26900]: 2017-09-28 12:17:06.041 26900 ERROR nova     sys.exit(main())
Sep 28 12:17:06 ctl02 nova-api[26900]: 2017-09-28 12:17:06.041 26900 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:17:06 ctl02 nova-api[26900]: 2017-09-28 12:17:06.041 26900 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:17:06 ctl02 nova-api[26900]: 2017-09-28 12:17:06.041 26900 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:17:06 ctl02 nova-api[26900]: 2017-09-28 12:17:06.041 26900 ERROR nova     max_url_len=max_url_len)
Sep 28 12:17:06 ctl02 nova-api[26900]: 2017-09-28 12:17:06.041 26900 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:17:06 ctl02 nova-api[26900]: 2017-09-28 12:17:06.041 26900 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:17:06 ctl02 nova-api[26900]: 2017-09-28 12:17:06.041 26900 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:17:06 ctl02 nova-api[26900]: 2017-09-28 12:17:06.041 26900 ERROR nova     sock.listen(backlog)
Sep 28 12:17:06 ctl02 nova-api[26900]: 2017-09-28 12:17:06.041 26900 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:17:06 ctl02 nova-api[26900]: 2017-09-28 12:17:06.041 26900 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:17:06 ctl02 nova-api[26900]: 2017-09-28 12:17:06.041 26900 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:17:06 ctl02 nova-api[26900]: 2017-09-28 12:17:06.041 26900 ERROR nova
Sep 28 12:17:06 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:17:06 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:17:06 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:17:06 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:17:06.307 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:17:06] "OPTIONS / HTTP/1.0" 200 134 0.000457
Sep 28 12:17:06 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:17:06 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:17:06 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:17:06 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:17:07 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:17:07.111 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:17:07] "OPTIONS / HTTP/1.0" 200 134 0.000461
Sep 28 12:17:08 ctl02 nova-api[26918]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:17:08 ctl02 nova-api[26918]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:17:08 ctl02 nova-api[26918]: 2017-09-28 12:17:08.229 26918 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:17:08 ctl02 nova-api[26918]: 2017-09-28 12:17:08.231 26918 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:17:08 ctl02 nova-api[26918]: 2017-09-28 12:17:08.231 26918 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:17:08 ctl02 nova-api[26918]: 2017-09-28 12:17:08.231 26918 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:17:08 ctl02 nova-api[26918]: 2017-09-28 12:17:08.231 26918 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:17:08 ctl02 nova-api[26918]: 2017-09-28 12:17:08.231 26918 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:17:08 ctl02 nova-api[26918]: 2017-09-28 12:17:08.231 26918 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:17:08 ctl02 nova-api[26918]: 2017-09-28 12:17:08.231 26918 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:17:08 ctl02 nova-api[26918]: 2017-09-28 12:17:08.231 26918 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:17:08 ctl02 nova-api[26918]: 2017-09-28 12:17:08.231 26918 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:17:08 ctl02 nova-api[26918]: 2017-09-28 12:17:08.231 26918 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:17:08 ctl02 nova-api[26918]: 2017-09-28 12:17:08.231 26918 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:17:08 ctl02 nova-api[26918]: 2017-09-28 12:17:08.231 26918 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:17:08 ctl02 nova-api[26918]: 2017-09-28 12:17:08.231 26918 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:17:08 ctl02 nova-api[26918]: 2017-09-28 12:17:08.231 26918 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:17:08 ctl02 nova-api[26918]: 2017-09-28 12:17:08.231 26918 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:17:08 ctl02 nova-api[26918]: 2017-09-28 12:17:08.231 26918 ERROR nova.wsgi     self.filename))
Sep 28 12:17:08 ctl02 nova-api[26918]: 2017-09-28 12:17:08.231 26918 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:17:08 ctl02 nova-api[26918]: 2017-09-28 12:17:08.231 26918 ERROR nova.wsgi
Sep 28 12:17:08 ctl02 nova-api[26918]: 2017-09-28 12:17:08.232 26918 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:17:08 ctl02 nova-api[26918]: 2017-09-28 12:17:08.361 26918 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:17:08 ctl02 nova-api[26918]: 2017-09-28 12:17:08.593 26918 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:17:08 ctl02 nova-api[26918]: 2017-09-28 12:17:08.595 26918 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:17:08 ctl02 nova-api[26918]: 2017-09-28 12:17:08.595 26918 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:17:08 ctl02 nova-api[26918]: 2017-09-28 12:17:08.595 26918 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:17:08 ctl02 nova-api[26918]: 2017-09-28 12:17:08.727 26918 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:17:08 ctl02 nova-api[26918]: 2017-09-28 12:17:08.729 26918 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:17:08 ctl02 nova-api[26918]: 2017-09-28 12:17:08.729 26918 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:17:08 ctl02 nova-api[26918]: 2017-09-28 12:17:08.730 26918 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:17:08 ctl02 nova-api[26918]: 2017-09-28 12:17:08.733 26918 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:17:08 ctl02 nova-api[26918]: 2017-09-28 12:17:08.733 26918 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:17:08 ctl02 nova-api[26918]: 2017-09-28 12:17:08.733 26918 ERROR nova Traceback (most recent call last):
Sep 28 12:17:08 ctl02 nova-api[26918]: 2017-09-28 12:17:08.733 26918 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:17:08 ctl02 nova-api[26918]: 2017-09-28 12:17:08.733 26918 ERROR nova     sys.exit(main())
Sep 28 12:17:08 ctl02 nova-api[26918]: 2017-09-28 12:17:08.733 26918 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:17:08 ctl02 nova-api[26918]: 2017-09-28 12:17:08.733 26918 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:17:08 ctl02 nova-api[26918]: 2017-09-28 12:17:08.733 26918 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:17:08 ctl02 nova-api[26918]: 2017-09-28 12:17:08.733 26918 ERROR nova     max_url_len=max_url_len)
Sep 28 12:17:08 ctl02 nova-api[26918]: 2017-09-28 12:17:08.733 26918 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:17:08 ctl02 nova-api[26918]: 2017-09-28 12:17:08.733 26918 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:17:08 ctl02 nova-api[26918]: 2017-09-28 12:17:08.733 26918 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:17:08 ctl02 nova-api[26918]: 2017-09-28 12:17:08.733 26918 ERROR nova     sock.listen(backlog)
Sep 28 12:17:08 ctl02 nova-api[26918]: 2017-09-28 12:17:08.733 26918 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:17:08 ctl02 nova-api[26918]: 2017-09-28 12:17:08.733 26918 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:17:08 ctl02 nova-api[26918]: 2017-09-28 12:17:08.733 26918 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:17:08 ctl02 nova-api[26918]: 2017-09-28 12:17:08.733 26918 ERROR nova
Sep 28 12:17:08 ctl02 nova-cert[4860]: 2017-09-28 12:17:08.859 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:17:08 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:17:08 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:17:08 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:17:09 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:17:09 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:17:09 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:17:09 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:17:09 ctl02 heat-api[13008]: 2017-09-28 12:17:09.248 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:17:09] "OPTIONS / HTTP/1.0" 200 134 0.000633
Sep 28 12:17:09 ctl02 heat-api-cfn[13300]: 2017-09-28 12:17:09.790 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:17:09] "OPTIONS / HTTP/1.0" 200 134 0.000469
Sep 28 12:17:10 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xaf2cd837)
Sep 28 12:17:10 ctl02 nova-conductor[5056]: 2017-09-28 12:17:10.522 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:17:10 ctl02 nova-conductor[5056]: 2017-09-28 12:17:10.538 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:17:10 ctl02 nova-conductor[5056]: 2017-09-28 12:17:10.542 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:17:10 ctl02 nova-conductor[5056]: 2017-09-28 12:17:10.543 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:17:10 ctl02 heat-api-cfn[13300]: 2017-09-28 12:17:10.634 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:17:10] "OPTIONS / HTTP/1.0" 200 134 0.000432
Sep 28 12:17:10 ctl02 nova-api[26936]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:17:10 ctl02 nova-api[26936]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:17:10 ctl02 glance-api[29183]: 2017-09-28 12:17:10.894 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:17:10] "OPTIONS / HTTP/1.0" 200 134 0.000612
Sep 28 12:17:10 ctl02 nova-api[26936]: 2017-09-28 12:17:10.984 26936 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:17:10 ctl02 nova-api[26936]: 2017-09-28 12:17:10.986 26936 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:17:10 ctl02 nova-api[26936]: 2017-09-28 12:17:10.986 26936 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:17:10 ctl02 nova-api[26936]: 2017-09-28 12:17:10.986 26936 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:17:10 ctl02 nova-api[26936]: 2017-09-28 12:17:10.986 26936 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:17:10 ctl02 nova-api[26936]: 2017-09-28 12:17:10.986 26936 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:17:10 ctl02 nova-api[26936]: 2017-09-28 12:17:10.986 26936 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:17:10 ctl02 nova-api[26936]: 2017-09-28 12:17:10.986 26936 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:17:10 ctl02 nova-api[26936]: 2017-09-28 12:17:10.986 26936 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:17:10 ctl02 nova-api[26936]: 2017-09-28 12:17:10.986 26936 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:17:10 ctl02 nova-api[26936]: 2017-09-28 12:17:10.986 26936 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:17:10 ctl02 nova-api[26936]: 2017-09-28 12:17:10.986 26936 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:17:10 ctl02 nova-api[26936]: 2017-09-28 12:17:10.986 26936 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:17:10 ctl02 nova-api[26936]: 2017-09-28 12:17:10.986 26936 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:17:10 ctl02 nova-api[26936]: 2017-09-28 12:17:10.986 26936 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:17:10 ctl02 nova-api[26936]: 2017-09-28 12:17:10.986 26936 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:17:10 ctl02 nova-api[26936]: 2017-09-28 12:17:10.986 26936 ERROR nova.wsgi     self.filename))
Sep 28 12:17:10 ctl02 nova-api[26936]: 2017-09-28 12:17:10.986 26936 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:17:10 ctl02 nova-api[26936]: 2017-09-28 12:17:10.986 26936 ERROR nova.wsgi
Sep 28 12:17:10 ctl02 nova-api[26936]: 2017-09-28 12:17:10.989 26936 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:17:11 ctl02 nova-api[26936]: 2017-09-28 12:17:11.120 26936 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:17:11 ctl02 nova-api[26936]: 2017-09-28 12:17:11.356 26936 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:17:11 ctl02 nova-api[26936]: 2017-09-28 12:17:11.359 26936 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:17:11 ctl02 nova-api[26936]: 2017-09-28 12:17:11.359 26936 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:17:11 ctl02 nova-api[26936]: 2017-09-28 12:17:11.360 26936 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:17:11 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xaf2cd837)
Sep 28 12:17:11 ctl02 nova-api[26936]: 2017-09-28 12:17:11.492 26936 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:17:11 ctl02 nova-api[26936]: 2017-09-28 12:17:11.494 26936 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:17:11 ctl02 nova-api[26936]: 2017-09-28 12:17:11.494 26936 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:17:11 ctl02 nova-api[26936]: 2017-09-28 12:17:11.494 26936 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:17:11 ctl02 nova-api[26936]: 2017-09-28 12:17:11.497 26936 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:17:11 ctl02 nova-api[26936]: 2017-09-28 12:17:11.498 26936 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:17:11 ctl02 nova-api[26936]: 2017-09-28 12:17:11.498 26936 ERROR nova Traceback (most recent call last):
Sep 28 12:17:11 ctl02 nova-api[26936]: 2017-09-28 12:17:11.498 26936 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:17:11 ctl02 nova-api[26936]: 2017-09-28 12:17:11.498 26936 ERROR nova     sys.exit(main())
Sep 28 12:17:11 ctl02 nova-api[26936]: 2017-09-28 12:17:11.498 26936 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:17:11 ctl02 nova-api[26936]: 2017-09-28 12:17:11.498 26936 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:17:11 ctl02 nova-api[26936]: 2017-09-28 12:17:11.498 26936 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:17:11 ctl02 nova-api[26936]: 2017-09-28 12:17:11.498 26936 ERROR nova     max_url_len=max_url_len)
Sep 28 12:17:11 ctl02 nova-api[26936]: 2017-09-28 12:17:11.498 26936 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:17:11 ctl02 nova-api[26936]: 2017-09-28 12:17:11.498 26936 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:17:11 ctl02 nova-api[26936]: 2017-09-28 12:17:11.498 26936 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:17:11 ctl02 nova-api[26936]: 2017-09-28 12:17:11.498 26936 ERROR nova     sock.listen(backlog)
Sep 28 12:17:11 ctl02 nova-api[26936]: 2017-09-28 12:17:11.498 26936 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:17:11 ctl02 nova-api[26936]: 2017-09-28 12:17:11.498 26936 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:17:11 ctl02 nova-api[26936]: 2017-09-28 12:17:11.498 26936 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:17:11 ctl02 nova-api[26936]: 2017-09-28 12:17:11.498 26936 ERROR nova
Sep 28 12:17:11 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:17:11 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:17:11 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:17:11 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:17:11 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:17:11 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:17:11 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:17:11 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:17:11.976 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:17:11] "OPTIONS / HTTP/1.0" 200 134 0.000476
Sep 28 12:17:12 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xaf2cd837)
Sep 28 12:17:13 ctl02 heat-api-cfn[13300]: 2017-09-28 12:17:13.082 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:17:13] "OPTIONS / HTTP/1.0" 200 134 0.000608
Sep 28 12:17:13 ctl02 glance-api[29183]: 2017-09-28 12:17:13.148 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:17:13] "OPTIONS / HTTP/1.0" 200 134 0.000790
Sep 28 12:17:13 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xaf2cd837)
Sep 28 12:17:13 ctl02 nova-api[26954]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:17:13 ctl02 nova-api[26954]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:17:13 ctl02 nova-api[26954]: 2017-09-28 12:17:13.719 26954 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:17:13 ctl02 nova-api[26954]: 2017-09-28 12:17:13.721 26954 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:17:13 ctl02 nova-api[26954]: 2017-09-28 12:17:13.721 26954 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:17:13 ctl02 nova-api[26954]: 2017-09-28 12:17:13.721 26954 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:17:13 ctl02 nova-api[26954]: 2017-09-28 12:17:13.721 26954 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:17:13 ctl02 nova-api[26954]: 2017-09-28 12:17:13.721 26954 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:17:13 ctl02 nova-api[26954]: 2017-09-28 12:17:13.721 26954 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:17:13 ctl02 nova-api[26954]: 2017-09-28 12:17:13.721 26954 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:17:13 ctl02 nova-api[26954]: 2017-09-28 12:17:13.721 26954 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:17:13 ctl02 nova-api[26954]: 2017-09-28 12:17:13.721 26954 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:17:13 ctl02 nova-api[26954]: 2017-09-28 12:17:13.721 26954 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:17:13 ctl02 nova-api[26954]: 2017-09-28 12:17:13.721 26954 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:17:13 ctl02 nova-api[26954]: 2017-09-28 12:17:13.721 26954 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:17:13 ctl02 nova-api[26954]: 2017-09-28 12:17:13.721 26954 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:17:13 ctl02 nova-api[26954]: 2017-09-28 12:17:13.721 26954 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:17:13 ctl02 nova-api[26954]: 2017-09-28 12:17:13.721 26954 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:17:13 ctl02 nova-api[26954]: 2017-09-28 12:17:13.721 26954 ERROR nova.wsgi     self.filename))
Sep 28 12:17:13 ctl02 nova-api[26954]: 2017-09-28 12:17:13.721 26954 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:17:13 ctl02 nova-api[26954]: 2017-09-28 12:17:13.721 26954 ERROR nova.wsgi
Sep 28 12:17:13 ctl02 nova-api[26954]: 2017-09-28 12:17:13.722 26954 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:17:13 ctl02 nova-api[26954]: 2017-09-28 12:17:13.853 26954 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:17:14 ctl02 nova-api[26954]: 2017-09-28 12:17:14.081 26954 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:17:14 ctl02 nova-api[26954]: 2017-09-28 12:17:14.083 26954 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:17:14 ctl02 nova-api[26954]: 2017-09-28 12:17:14.083 26954 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:17:14 ctl02 nova-api[26954]: 2017-09-28 12:17:14.083 26954 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:17:14 ctl02 glance-api[29183]: 2017-09-28 12:17:14.126 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:17:14] "OPTIONS / HTTP/1.0" 200 134 0.000570
Sep 28 12:17:14 ctl02 nova-api[26954]: 2017-09-28 12:17:14.217 26954 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:17:14 ctl02 nova-api[26954]: 2017-09-28 12:17:14.219 26954 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:17:14 ctl02 nova-api[26954]: 2017-09-28 12:17:14.219 26954 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:17:14 ctl02 nova-api[26954]: 2017-09-28 12:17:14.220 26954 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:17:14 ctl02 nova-api[26954]: 2017-09-28 12:17:14.223 26954 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:17:14 ctl02 nova-api[26954]: 2017-09-28 12:17:14.223 26954 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:17:14 ctl02 nova-api[26954]: 2017-09-28 12:17:14.223 26954 ERROR nova Traceback (most recent call last):
Sep 28 12:17:14 ctl02 nova-api[26954]: 2017-09-28 12:17:14.223 26954 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:17:14 ctl02 nova-api[26954]: 2017-09-28 12:17:14.223 26954 ERROR nova     sys.exit(main())
Sep 28 12:17:14 ctl02 nova-api[26954]: 2017-09-28 12:17:14.223 26954 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:17:14 ctl02 nova-api[26954]: 2017-09-28 12:17:14.223 26954 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:17:14 ctl02 nova-api[26954]: 2017-09-28 12:17:14.223 26954 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:17:14 ctl02 nova-api[26954]: 2017-09-28 12:17:14.223 26954 ERROR nova     max_url_len=max_url_len)
Sep 28 12:17:14 ctl02 nova-api[26954]: 2017-09-28 12:17:14.223 26954 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:17:14 ctl02 nova-api[26954]: 2017-09-28 12:17:14.223 26954 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:17:14 ctl02 nova-api[26954]: 2017-09-28 12:17:14.223 26954 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:17:14 ctl02 nova-api[26954]: 2017-09-28 12:17:14.223 26954 ERROR nova     sock.listen(backlog)
Sep 28 12:17:14 ctl02 nova-api[26954]: 2017-09-28 12:17:14.223 26954 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:17:14 ctl02 nova-api[26954]: 2017-09-28 12:17:14.223 26954 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:17:14 ctl02 nova-api[26954]: 2017-09-28 12:17:14.223 26954 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:17:14 ctl02 nova-api[26954]: 2017-09-28 12:17:14.223 26954 ERROR nova
Sep 28 12:17:14 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:17:14 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:17:14 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:17:14 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xaf2cd837)
Sep 28 12:17:14 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:17:14 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:17:14 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:17:14 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:17:14 ctl02 heat-api[13008]: 2017-09-28 12:17:14.905 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:17:14] "OPTIONS / HTTP/1.0" 200 134 0.000661
Sep 28 12:17:15 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xaf2cd837)
Sep 28 12:17:15 ctl02 heat-api[13008]: 2017-09-28 12:17:15.917 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:17:15] "OPTIONS / HTTP/1.0" 200 134 0.000612
Sep 28 12:17:15 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:17:15.992 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:17:15] "OPTIONS / HTTP/1.0" 200 134 0.000462
Sep 28 12:17:16 ctl02 nova-api[26972]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:17:16 ctl02 nova-api[26972]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:17:16 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xaf2cd837)
Sep 28 12:17:16 ctl02 nova-api[26972]: 2017-09-28 12:17:16.502 26972 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:17:16 ctl02 nova-api[26972]: 2017-09-28 12:17:16.504 26972 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:17:16 ctl02 nova-api[26972]: 2017-09-28 12:17:16.504 26972 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:17:16 ctl02 nova-api[26972]: 2017-09-28 12:17:16.504 26972 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:17:16 ctl02 nova-api[26972]: 2017-09-28 12:17:16.504 26972 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:17:16 ctl02 nova-api[26972]: 2017-09-28 12:17:16.504 26972 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:17:16 ctl02 nova-api[26972]: 2017-09-28 12:17:16.504 26972 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:17:16 ctl02 nova-api[26972]: 2017-09-28 12:17:16.504 26972 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:17:16 ctl02 nova-api[26972]: 2017-09-28 12:17:16.504 26972 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:17:16 ctl02 nova-api[26972]: 2017-09-28 12:17:16.504 26972 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:17:16 ctl02 nova-api[26972]: 2017-09-28 12:17:16.504 26972 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:17:16 ctl02 nova-api[26972]: 2017-09-28 12:17:16.504 26972 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:17:16 ctl02 nova-api[26972]: 2017-09-28 12:17:16.504 26972 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:17:16 ctl02 nova-api[26972]: 2017-09-28 12:17:16.504 26972 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:17:16 ctl02 nova-api[26972]: 2017-09-28 12:17:16.504 26972 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:17:16 ctl02 nova-api[26972]: 2017-09-28 12:17:16.504 26972 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:17:16 ctl02 nova-api[26972]: 2017-09-28 12:17:16.504 26972 ERROR nova.wsgi     self.filename))
Sep 28 12:17:16 ctl02 nova-api[26972]: 2017-09-28 12:17:16.504 26972 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:17:16 ctl02 nova-api[26972]: 2017-09-28 12:17:16.504 26972 ERROR nova.wsgi
Sep 28 12:17:16 ctl02 nova-api[26972]: 2017-09-28 12:17:16.505 26972 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:17:16 ctl02 nova-api[26972]: 2017-09-28 12:17:16.639 26972 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:17:16 ctl02 nova-api[26972]: 2017-09-28 12:17:16.887 26972 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:17:16 ctl02 nova-api[26972]: 2017-09-28 12:17:16.890 26972 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:17:16 ctl02 nova-api[26972]: 2017-09-28 12:17:16.890 26972 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:17:16 ctl02 nova-api[26972]: 2017-09-28 12:17:16.890 26972 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:17:17 ctl02 nova-api[26972]: 2017-09-28 12:17:17.022 26972 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:17:17 ctl02 nova-api[26972]: 2017-09-28 12:17:17.024 26972 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:17:17 ctl02 nova-api[26972]: 2017-09-28 12:17:17.024 26972 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:17:17 ctl02 nova-api[26972]: 2017-09-28 12:17:17.025 26972 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:17:17 ctl02 nova-api[26972]: 2017-09-28 12:17:17.028 26972 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:17:17 ctl02 nova-api[26972]: 2017-09-28 12:17:17.028 26972 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:17:17 ctl02 nova-api[26972]: 2017-09-28 12:17:17.028 26972 ERROR nova Traceback (most recent call last):
Sep 28 12:17:17 ctl02 nova-api[26972]: 2017-09-28 12:17:17.028 26972 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:17:17 ctl02 nova-api[26972]: 2017-09-28 12:17:17.028 26972 ERROR nova     sys.exit(main())
Sep 28 12:17:17 ctl02 nova-api[26972]: 2017-09-28 12:17:17.028 26972 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:17:17 ctl02 nova-api[26972]: 2017-09-28 12:17:17.028 26972 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:17:17 ctl02 nova-api[26972]: 2017-09-28 12:17:17.028 26972 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:17:17 ctl02 nova-api[26972]: 2017-09-28 12:17:17.028 26972 ERROR nova     max_url_len=max_url_len)
Sep 28 12:17:17 ctl02 nova-api[26972]: 2017-09-28 12:17:17.028 26972 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:17:17 ctl02 nova-api[26972]: 2017-09-28 12:17:17.028 26972 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:17:17 ctl02 nova-api[26972]: 2017-09-28 12:17:17.028 26972 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:17:17 ctl02 nova-api[26972]: 2017-09-28 12:17:17.028 26972 ERROR nova     sock.listen(backlog)
Sep 28 12:17:17 ctl02 nova-api[26972]: 2017-09-28 12:17:17.028 26972 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:17:17 ctl02 nova-api[26972]: 2017-09-28 12:17:17.028 26972 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:17:17 ctl02 nova-api[26972]: 2017-09-28 12:17:17.028 26972 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:17:17 ctl02 nova-api[26972]: 2017-09-28 12:17:17.028 26972 ERROR nova
Sep 28 12:17:17 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:17:17 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:17:17 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:17:17 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:17:17 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:17:17 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:17:17 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xaf2cd837)
Sep 28 12:17:17 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:17:17 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:17:17.508 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:17:17] "OPTIONS / HTTP/1.0" 200 134 0.000457
Sep 28 12:17:18 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xaf2cd837)
Sep 28 12:17:18 ctl02 nova-consoleauth[5433]: 2017-09-28 12:17:18.735 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:17:19 ctl02 nova-api[26990]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:17:19 ctl02 nova-api[26990]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:17:19 ctl02 nova-api[26990]: 2017-09-28 12:17:19.247 26990 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:17:19 ctl02 nova-api[26990]: 2017-09-28 12:17:19.249 26990 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:17:19 ctl02 nova-api[26990]: 2017-09-28 12:17:19.249 26990 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:17:19 ctl02 nova-api[26990]: 2017-09-28 12:17:19.249 26990 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:17:19 ctl02 nova-api[26990]: 2017-09-28 12:17:19.249 26990 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:17:19 ctl02 nova-api[26990]: 2017-09-28 12:17:19.249 26990 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:17:19 ctl02 nova-api[26990]: 2017-09-28 12:17:19.249 26990 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:17:19 ctl02 nova-api[26990]: 2017-09-28 12:17:19.249 26990 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:17:19 ctl02 nova-api[26990]: 2017-09-28 12:17:19.249 26990 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:17:19 ctl02 nova-api[26990]: 2017-09-28 12:17:19.249 26990 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:17:19 ctl02 nova-api[26990]: 2017-09-28 12:17:19.249 26990 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:17:19 ctl02 nova-api[26990]: 2017-09-28 12:17:19.249 26990 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:17:19 ctl02 nova-api[26990]: 2017-09-28 12:17:19.249 26990 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:17:19 ctl02 nova-api[26990]: 2017-09-28 12:17:19.249 26990 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:17:19 ctl02 nova-api[26990]: 2017-09-28 12:17:19.249 26990 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:17:19 ctl02 nova-api[26990]: 2017-09-28 12:17:19.249 26990 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:17:19 ctl02 nova-api[26990]: 2017-09-28 12:17:19.249 26990 ERROR nova.wsgi     self.filename))
Sep 28 12:17:19 ctl02 nova-api[26990]: 2017-09-28 12:17:19.249 26990 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:17:19 ctl02 nova-api[26990]: 2017-09-28 12:17:19.249 26990 ERROR nova.wsgi
Sep 28 12:17:19 ctl02 nova-api[26990]: 2017-09-28 12:17:19.250 26990 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:17:19 ctl02 nova-api[26990]: 2017-09-28 12:17:19.384 26990 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:17:19 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xaf2cd837)
Sep 28 12:17:19 ctl02 heat-api[13008]: 2017-09-28 12:17:19.404 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:17:19] "OPTIONS / HTTP/1.0" 200 134 0.000612
Sep 28 12:17:19 ctl02 nova-api[26990]: 2017-09-28 12:17:19.639 26990 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:17:19 ctl02 nova-api[26990]: 2017-09-28 12:17:19.642 26990 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:17:19 ctl02 nova-api[26990]: 2017-09-28 12:17:19.642 26990 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:17:19 ctl02 nova-api[26990]: 2017-09-28 12:17:19.642 26990 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:17:19 ctl02 nova-api[26990]: 2017-09-28 12:17:19.774 26990 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:17:19 ctl02 nova-api[26990]: 2017-09-28 12:17:19.777 26990 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:17:19 ctl02 nova-api[26990]: 2017-09-28 12:17:19.777 26990 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:17:19 ctl02 nova-api[26990]: 2017-09-28 12:17:19.777 26990 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:17:19 ctl02 nova-api[26990]: 2017-09-28 12:17:19.780 26990 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:17:19 ctl02 nova-api[26990]: 2017-09-28 12:17:19.781 26990 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:17:19 ctl02 nova-api[26990]: 2017-09-28 12:17:19.781 26990 ERROR nova Traceback (most recent call last):
Sep 28 12:17:19 ctl02 nova-api[26990]: 2017-09-28 12:17:19.781 26990 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:17:19 ctl02 nova-api[26990]: 2017-09-28 12:17:19.781 26990 ERROR nova     sys.exit(main())
Sep 28 12:17:19 ctl02 nova-api[26990]: 2017-09-28 12:17:19.781 26990 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:17:19 ctl02 nova-api[26990]: 2017-09-28 12:17:19.781 26990 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:17:19 ctl02 nova-api[26990]: 2017-09-28 12:17:19.781 26990 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:17:19 ctl02 nova-api[26990]: 2017-09-28 12:17:19.781 26990 ERROR nova     max_url_len=max_url_len)
Sep 28 12:17:19 ctl02 nova-api[26990]: 2017-09-28 12:17:19.781 26990 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:17:19 ctl02 nova-api[26990]: 2017-09-28 12:17:19.781 26990 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:17:19 ctl02 nova-api[26990]: 2017-09-28 12:17:19.781 26990 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:17:19 ctl02 nova-api[26990]: 2017-09-28 12:17:19.781 26990 ERROR nova     sock.listen(backlog)
Sep 28 12:17:19 ctl02 nova-api[26990]: 2017-09-28 12:17:19.781 26990 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:17:19 ctl02 nova-api[26990]: 2017-09-28 12:17:19.781 26990 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:17:19 ctl02 nova-api[26990]: 2017-09-28 12:17:19.781 26990 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:17:19 ctl02 nova-api[26990]: 2017-09-28 12:17:19.781 26990 ERROR nova
Sep 28 12:17:19 ctl02 heat-api-cfn[13300]: 2017-09-28 12:17:19.797 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:17:19] "OPTIONS / HTTP/1.0" 200 134 0.000596
Sep 28 12:17:19 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:17:19 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:17:19 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:17:20 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:17:20 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:17:20 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:17:20 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:17:20 ctl02 heat-api-cfn[13300]: 2017-09-28 12:17:20.315 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:17:20] "OPTIONS / HTTP/1.0" 200 134 0.000543
Sep 28 12:17:20 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xaf2cd837)
Sep 28 12:17:20 ctl02 glance-api[29183]: 2017-09-28 12:17:20.629 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:17:20] "OPTIONS / HTTP/1.0" 200 134 0.001154
Sep 28 12:17:21 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:17:21 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:17:21 ctl02 heat-engine[12803]: 2017-09-28 12:17:21.632 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:17:21 ctl02 heat-engine[12803]: 2017-09-28 12:17:21.637 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:17:21 ctl02 heat-engine[12803]: 2017-09-28 12:17:21.643 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:17:21 ctl02 heat-engine[12803]: 2017-09-28 12:17:21.645 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:17:21 ctl02 nova-scheduler[5620]: 2017-09-28 12:17:21.761 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:17:21 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:17:21.788 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:17:21] "OPTIONS / HTTP/1.0" 200 134 0.000473
Sep 28 12:17:21 ctl02 nova-api[27008]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:17:21 ctl02 nova-api[27008]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:17:22 ctl02 nova-api[27008]: 2017-09-28 12:17:22.015 27008 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:17:22 ctl02 nova-api[27008]: 2017-09-28 12:17:22.017 27008 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:17:22 ctl02 nova-api[27008]: 2017-09-28 12:17:22.017 27008 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:17:22 ctl02 nova-api[27008]: 2017-09-28 12:17:22.017 27008 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:17:22 ctl02 nova-api[27008]: 2017-09-28 12:17:22.017 27008 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:17:22 ctl02 nova-api[27008]: 2017-09-28 12:17:22.017 27008 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:17:22 ctl02 nova-api[27008]: 2017-09-28 12:17:22.017 27008 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:17:22 ctl02 nova-api[27008]: 2017-09-28 12:17:22.017 27008 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:17:22 ctl02 nova-api[27008]: 2017-09-28 12:17:22.017 27008 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:17:22 ctl02 nova-api[27008]: 2017-09-28 12:17:22.017 27008 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:17:22 ctl02 nova-api[27008]: 2017-09-28 12:17:22.017 27008 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:17:22 ctl02 nova-api[27008]: 2017-09-28 12:17:22.017 27008 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:17:22 ctl02 nova-api[27008]: 2017-09-28 12:17:22.017 27008 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:17:22 ctl02 nova-api[27008]: 2017-09-28 12:17:22.017 27008 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:17:22 ctl02 nova-api[27008]: 2017-09-28 12:17:22.017 27008 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:17:22 ctl02 nova-api[27008]: 2017-09-28 12:17:22.017 27008 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:17:22 ctl02 nova-api[27008]: 2017-09-28 12:17:22.017 27008 ERROR nova.wsgi     self.filename))
Sep 28 12:17:22 ctl02 nova-api[27008]: 2017-09-28 12:17:22.017 27008 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:17:22 ctl02 nova-api[27008]: 2017-09-28 12:17:22.017 27008 ERROR nova.wsgi
Sep 28 12:17:22 ctl02 nova-api[27008]: 2017-09-28 12:17:22.018 27008 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:17:22 ctl02 nova-api[27008]: 2017-09-28 12:17:22.154 27008 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:17:22 ctl02 nova-api[27008]: 2017-09-28 12:17:22.411 27008 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:17:22 ctl02 nova-api[27008]: 2017-09-28 12:17:22.413 27008 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:17:22 ctl02 nova-api[27008]: 2017-09-28 12:17:22.413 27008 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:17:22 ctl02 nova-api[27008]: 2017-09-28 12:17:22.414 27008 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:17:22 ctl02 nova-api[27008]: 2017-09-28 12:17:22.551 27008 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:17:22 ctl02 nova-api[27008]: 2017-09-28 12:17:22.553 27008 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:17:22 ctl02 nova-api[27008]: 2017-09-28 12:17:22.553 27008 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:17:22 ctl02 nova-api[27008]: 2017-09-28 12:17:22.553 27008 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:17:22 ctl02 nova-api[27008]: 2017-09-28 12:17:22.557 27008 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:17:22 ctl02 nova-api[27008]: 2017-09-28 12:17:22.557 27008 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:17:22 ctl02 nova-api[27008]: 2017-09-28 12:17:22.557 27008 ERROR nova Traceback (most recent call last):
Sep 28 12:17:22 ctl02 nova-api[27008]: 2017-09-28 12:17:22.557 27008 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:17:22 ctl02 nova-api[27008]: 2017-09-28 12:17:22.557 27008 ERROR nova     sys.exit(main())
Sep 28 12:17:22 ctl02 nova-api[27008]: 2017-09-28 12:17:22.557 27008 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:17:22 ctl02 nova-api[27008]: 2017-09-28 12:17:22.557 27008 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:17:22 ctl02 nova-api[27008]: 2017-09-28 12:17:22.557 27008 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:17:22 ctl02 nova-api[27008]: 2017-09-28 12:17:22.557 27008 ERROR nova     max_url_len=max_url_len)
Sep 28 12:17:22 ctl02 nova-api[27008]: 2017-09-28 12:17:22.557 27008 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:17:22 ctl02 nova-api[27008]: 2017-09-28 12:17:22.557 27008 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:17:22 ctl02 nova-api[27008]: 2017-09-28 12:17:22.557 27008 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:17:22 ctl02 nova-api[27008]: 2017-09-28 12:17:22.557 27008 ERROR nova     sock.listen(backlog)
Sep 28 12:17:22 ctl02 nova-api[27008]: 2017-09-28 12:17:22.557 27008 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:17:22 ctl02 nova-api[27008]: 2017-09-28 12:17:22.557 27008 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:17:22 ctl02 nova-api[27008]: 2017-09-28 12:17:22.557 27008 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:17:22 ctl02 nova-api[27008]: 2017-09-28 12:17:22.557 27008 ERROR nova
Sep 28 12:17:22 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:17:22 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:17:22 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:17:22 ctl02 heat-api-cfn[13300]: 2017-09-28 12:17:22.752 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:17:22] "OPTIONS / HTTP/1.0" 200 134 0.000528
Sep 28 12:17:22 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:17:22 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:17:22 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:17:22 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:17:23 ctl02 glance-api[29183]: 2017-09-28 12:17:23.101 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:17:23] "OPTIONS / HTTP/1.0" 200 134 0.000693
Sep 28 12:17:24 ctl02 glance-api[29183]: 2017-09-28 12:17:24.115 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:17:24] "OPTIONS / HTTP/1.0" 200 134 0.000640
Sep 28 12:17:24 ctl02 nova-api[27031]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:17:24 ctl02 nova-api[27031]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:17:24 ctl02 heat-api[13008]: 2017-09-28 12:17:24.764 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:17:24] "OPTIONS / HTTP/1.0" 200 134 0.000679
Sep 28 12:17:24 ctl02 nova-api[27031]: 2017-09-28 12:17:24.770 27031 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:17:24 ctl02 nova-api[27031]: 2017-09-28 12:17:24.772 27031 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:17:24 ctl02 nova-api[27031]: 2017-09-28 12:17:24.772 27031 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:17:24 ctl02 nova-api[27031]: 2017-09-28 12:17:24.772 27031 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:17:24 ctl02 nova-api[27031]: 2017-09-28 12:17:24.772 27031 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:17:24 ctl02 nova-api[27031]: 2017-09-28 12:17:24.772 27031 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:17:24 ctl02 nova-api[27031]: 2017-09-28 12:17:24.772 27031 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:17:24 ctl02 nova-api[27031]: 2017-09-28 12:17:24.772 27031 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:17:24 ctl02 nova-api[27031]: 2017-09-28 12:17:24.772 27031 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:17:24 ctl02 nova-api[27031]: 2017-09-28 12:17:24.772 27031 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:17:24 ctl02 nova-api[27031]: 2017-09-28 12:17:24.772 27031 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:17:24 ctl02 nova-api[27031]: 2017-09-28 12:17:24.772 27031 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:17:24 ctl02 nova-api[27031]: 2017-09-28 12:17:24.772 27031 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:17:24 ctl02 nova-api[27031]: 2017-09-28 12:17:24.772 27031 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:17:24 ctl02 nova-api[27031]: 2017-09-28 12:17:24.772 27031 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:17:24 ctl02 nova-api[27031]: 2017-09-28 12:17:24.772 27031 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:17:24 ctl02 nova-api[27031]: 2017-09-28 12:17:24.772 27031 ERROR nova.wsgi     self.filename))
Sep 28 12:17:24 ctl02 nova-api[27031]: 2017-09-28 12:17:24.772 27031 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:17:24 ctl02 nova-api[27031]: 2017-09-28 12:17:24.772 27031 ERROR nova.wsgi
Sep 28 12:17:24 ctl02 nova-api[27031]: 2017-09-28 12:17:24.773 27031 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:17:24 ctl02 nova-api[27031]: 2017-09-28 12:17:24.904 27031 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:17:25 ctl02 nova-api[27031]: 2017-09-28 12:17:25.154 27031 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:17:25 ctl02 nova-api[27031]: 2017-09-28 12:17:25.157 27031 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:17:25 ctl02 nova-api[27031]: 2017-09-28 12:17:25.169 27031 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:17:25 ctl02 nova-api[27031]: 2017-09-28 12:17:25.169 27031 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:17:25 ctl02 nova-api[27031]: 2017-09-28 12:17:25.311 27031 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:17:25 ctl02 nova-api[27031]: 2017-09-28 12:17:25.313 27031 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:17:25 ctl02 nova-api[27031]: 2017-09-28 12:17:25.313 27031 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:17:25 ctl02 nova-api[27031]: 2017-09-28 12:17:25.313 27031 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:17:25 ctl02 nova-api[27031]: 2017-09-28 12:17:25.317 27031 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:17:25 ctl02 nova-api[27031]: 2017-09-28 12:17:25.317 27031 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:17:25 ctl02 nova-api[27031]: 2017-09-28 12:17:25.317 27031 ERROR nova Traceback (most recent call last):
Sep 28 12:17:25 ctl02 nova-api[27031]: 2017-09-28 12:17:25.317 27031 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:17:25 ctl02 nova-api[27031]: 2017-09-28 12:17:25.317 27031 ERROR nova     sys.exit(main())
Sep 28 12:17:25 ctl02 nova-api[27031]: 2017-09-28 12:17:25.317 27031 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:17:25 ctl02 nova-api[27031]: 2017-09-28 12:17:25.317 27031 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:17:25 ctl02 nova-api[27031]: 2017-09-28 12:17:25.317 27031 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:17:25 ctl02 nova-api[27031]: 2017-09-28 12:17:25.317 27031 ERROR nova     max_url_len=max_url_len)
Sep 28 12:17:25 ctl02 nova-api[27031]: 2017-09-28 12:17:25.317 27031 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:17:25 ctl02 nova-api[27031]: 2017-09-28 12:17:25.317 27031 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:17:25 ctl02 nova-api[27031]: 2017-09-28 12:17:25.317 27031 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:17:25 ctl02 nova-api[27031]: 2017-09-28 12:17:25.317 27031 ERROR nova     sock.listen(backlog)
Sep 28 12:17:25 ctl02 nova-api[27031]: 2017-09-28 12:17:25.317 27031 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:17:25 ctl02 nova-api[27031]: 2017-09-28 12:17:25.317 27031 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:17:25 ctl02 nova-api[27031]: 2017-09-28 12:17:25.317 27031 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:17:25 ctl02 nova-api[27031]: 2017-09-28 12:17:25.317 27031 ERROR nova
Sep 28 12:17:25 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:17:25 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:17:25 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:17:25 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:17:25 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:17:25 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:17:25 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:17:26 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:17:26.237 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:17:26] "OPTIONS / HTTP/1.0" 200 134 0.000473
Sep 28 12:17:26 ctl02 heat-api[13008]: 2017-09-28 12:17:26.306 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:17:26] "OPTIONS / HTTP/1.0" 200 134 0.000614
Sep 28 12:17:27 ctl02 nova-api[27049]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:17:27 ctl02 nova-api[27049]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:17:27 ctl02 nova-api[27049]: 2017-09-28 12:17:27.486 27049 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:17:27 ctl02 nova-api[27049]: 2017-09-28 12:17:27.488 27049 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:17:27 ctl02 nova-api[27049]: 2017-09-28 12:17:27.488 27049 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:17:27 ctl02 nova-api[27049]: 2017-09-28 12:17:27.488 27049 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:17:27 ctl02 nova-api[27049]: 2017-09-28 12:17:27.488 27049 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:17:27 ctl02 nova-api[27049]: 2017-09-28 12:17:27.488 27049 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:17:27 ctl02 nova-api[27049]: 2017-09-28 12:17:27.488 27049 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:17:27 ctl02 nova-api[27049]: 2017-09-28 12:17:27.488 27049 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:17:27 ctl02 nova-api[27049]: 2017-09-28 12:17:27.488 27049 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:17:27 ctl02 nova-api[27049]: 2017-09-28 12:17:27.488 27049 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:17:27 ctl02 nova-api[27049]: 2017-09-28 12:17:27.488 27049 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:17:27 ctl02 nova-api[27049]: 2017-09-28 12:17:27.488 27049 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:17:27 ctl02 nova-api[27049]: 2017-09-28 12:17:27.488 27049 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:17:27 ctl02 nova-api[27049]: 2017-09-28 12:17:27.488 27049 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:17:27 ctl02 nova-api[27049]: 2017-09-28 12:17:27.488 27049 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:17:27 ctl02 nova-api[27049]: 2017-09-28 12:17:27.488 27049 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:17:27 ctl02 nova-api[27049]: 2017-09-28 12:17:27.488 27049 ERROR nova.wsgi     self.filename))
Sep 28 12:17:27 ctl02 nova-api[27049]: 2017-09-28 12:17:27.488 27049 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:17:27 ctl02 nova-api[27049]: 2017-09-28 12:17:27.488 27049 ERROR nova.wsgi
Sep 28 12:17:27 ctl02 nova-api[27049]: 2017-09-28 12:17:27.489 27049 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:17:27 ctl02 nova-api[27049]: 2017-09-28 12:17:27.621 27049 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:17:27 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:17:27.787 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:17:27] "OPTIONS / HTTP/1.0" 200 134 0.000471
Sep 28 12:17:27 ctl02 nova-api[27049]: 2017-09-28 12:17:27.872 27049 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:17:27 ctl02 nova-api[27049]: 2017-09-28 12:17:27.874 27049 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:17:27 ctl02 nova-api[27049]: 2017-09-28 12:17:27.875 27049 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:17:27 ctl02 nova-api[27049]: 2017-09-28 12:17:27.875 27049 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:17:28 ctl02 nova-api[27049]: 2017-09-28 12:17:28.006 27049 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:17:28 ctl02 nova-api[27049]: 2017-09-28 12:17:28.008 27049 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:17:28 ctl02 nova-api[27049]: 2017-09-28 12:17:28.008 27049 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:17:28 ctl02 nova-api[27049]: 2017-09-28 12:17:28.008 27049 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:17:28 ctl02 nova-api[27049]: 2017-09-28 12:17:28.012 27049 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:17:28 ctl02 nova-api[27049]: 2017-09-28 12:17:28.012 27049 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:17:28 ctl02 nova-api[27049]: 2017-09-28 12:17:28.012 27049 ERROR nova Traceback (most recent call last):
Sep 28 12:17:28 ctl02 nova-api[27049]: 2017-09-28 12:17:28.012 27049 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:17:28 ctl02 nova-api[27049]: 2017-09-28 12:17:28.012 27049 ERROR nova     sys.exit(main())
Sep 28 12:17:28 ctl02 nova-api[27049]: 2017-09-28 12:17:28.012 27049 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:17:28 ctl02 nova-api[27049]: 2017-09-28 12:17:28.012 27049 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:17:28 ctl02 nova-api[27049]: 2017-09-28 12:17:28.012 27049 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:17:28 ctl02 nova-api[27049]: 2017-09-28 12:17:28.012 27049 ERROR nova     max_url_len=max_url_len)
Sep 28 12:17:28 ctl02 nova-api[27049]: 2017-09-28 12:17:28.012 27049 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:17:28 ctl02 nova-api[27049]: 2017-09-28 12:17:28.012 27049 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:17:28 ctl02 nova-api[27049]: 2017-09-28 12:17:28.012 27049 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:17:28 ctl02 nova-api[27049]: 2017-09-28 12:17:28.012 27049 ERROR nova     sock.listen(backlog)
Sep 28 12:17:28 ctl02 nova-api[27049]: 2017-09-28 12:17:28.012 27049 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:17:28 ctl02 nova-api[27049]: 2017-09-28 12:17:28.012 27049 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:17:28 ctl02 nova-api[27049]: 2017-09-28 12:17:28.012 27049 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:17:28 ctl02 nova-api[27049]: 2017-09-28 12:17:28.012 27049 ERROR nova
Sep 28 12:17:28 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:17:28 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:17:28 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:17:28 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:17:28 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:17:28 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:17:28 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:17:29 ctl02 heat-api-cfn[13300]: 2017-09-28 12:17:29.542 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:17:29] "OPTIONS / HTTP/1.0" 200 134 0.000703
Sep 28 12:17:29 ctl02 heat-api[13008]: 2017-09-28 12:17:29.546 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:17:29] "OPTIONS / HTTP/1.0" 200 134 0.000653
Sep 28 12:17:30 ctl02 nova-api[27066]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:17:30 ctl02 nova-api[27066]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:17:30 ctl02 heat-api-cfn[13300]: 2017-09-28 12:17:30.233 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:17:30] "OPTIONS / HTTP/1.0" 200 134 0.000513
Sep 28 12:17:30 ctl02 nova-api[27066]: 2017-09-28 12:17:30.256 27066 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:17:30 ctl02 nova-api[27066]: 2017-09-28 12:17:30.258 27066 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:17:30 ctl02 nova-api[27066]: 2017-09-28 12:17:30.258 27066 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:17:30 ctl02 nova-api[27066]: 2017-09-28 12:17:30.258 27066 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:17:30 ctl02 nova-api[27066]: 2017-09-28 12:17:30.258 27066 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:17:30 ctl02 nova-api[27066]: 2017-09-28 12:17:30.258 27066 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:17:30 ctl02 nova-api[27066]: 2017-09-28 12:17:30.258 27066 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:17:30 ctl02 nova-api[27066]: 2017-09-28 12:17:30.258 27066 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:17:30 ctl02 nova-api[27066]: 2017-09-28 12:17:30.258 27066 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:17:30 ctl02 nova-api[27066]: 2017-09-28 12:17:30.258 27066 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:17:30 ctl02 nova-api[27066]: 2017-09-28 12:17:30.258 27066 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:17:30 ctl02 nova-api[27066]: 2017-09-28 12:17:30.258 27066 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:17:30 ctl02 nova-api[27066]: 2017-09-28 12:17:30.258 27066 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:17:30 ctl02 nova-api[27066]: 2017-09-28 12:17:30.258 27066 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:17:30 ctl02 nova-api[27066]: 2017-09-28 12:17:30.258 27066 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:17:30 ctl02 nova-api[27066]: 2017-09-28 12:17:30.258 27066 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:17:30 ctl02 nova-api[27066]: 2017-09-28 12:17:30.258 27066 ERROR nova.wsgi     self.filename))
Sep 28 12:17:30 ctl02 nova-api[27066]: 2017-09-28 12:17:30.258 27066 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:17:30 ctl02 nova-api[27066]: 2017-09-28 12:17:30.258 27066 ERROR nova.wsgi
Sep 28 12:17:30 ctl02 nova-api[27066]: 2017-09-28 12:17:30.259 27066 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:17:30 ctl02 glance-api[29183]: 2017-09-28 12:17:30.361 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:17:30] "OPTIONS / HTTP/1.0" 200 134 0.000652
Sep 28 12:17:30 ctl02 nova-api[27066]: 2017-09-28 12:17:30.398 27066 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:17:30 ctl02 nova-api[27066]: 2017-09-28 12:17:30.651 27066 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:17:30 ctl02 nova-api[27066]: 2017-09-28 12:17:30.653 27066 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:17:30 ctl02 nova-api[27066]: 2017-09-28 12:17:30.654 27066 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:17:30 ctl02 nova-api[27066]: 2017-09-28 12:17:30.654 27066 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:17:30 ctl02 nova-api[27066]: 2017-09-28 12:17:30.788 27066 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:17:30 ctl02 nova-api[27066]: 2017-09-28 12:17:30.790 27066 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:17:30 ctl02 nova-api[27066]: 2017-09-28 12:17:30.790 27066 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:17:30 ctl02 nova-api[27066]: 2017-09-28 12:17:30.791 27066 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:17:30 ctl02 nova-api[27066]: 2017-09-28 12:17:30.794 27066 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:17:30 ctl02 nova-api[27066]: 2017-09-28 12:17:30.794 27066 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:17:30 ctl02 nova-api[27066]: 2017-09-28 12:17:30.794 27066 ERROR nova Traceback (most recent call last):
Sep 28 12:17:30 ctl02 nova-api[27066]: 2017-09-28 12:17:30.794 27066 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:17:30 ctl02 nova-api[27066]: 2017-09-28 12:17:30.794 27066 ERROR nova     sys.exit(main())
Sep 28 12:17:30 ctl02 nova-api[27066]: 2017-09-28 12:17:30.794 27066 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:17:30 ctl02 nova-api[27066]: 2017-09-28 12:17:30.794 27066 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:17:30 ctl02 nova-api[27066]: 2017-09-28 12:17:30.794 27066 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:17:30 ctl02 nova-api[27066]: 2017-09-28 12:17:30.794 27066 ERROR nova     max_url_len=max_url_len)
Sep 28 12:17:30 ctl02 nova-api[27066]: 2017-09-28 12:17:30.794 27066 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:17:30 ctl02 nova-api[27066]: 2017-09-28 12:17:30.794 27066 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:17:30 ctl02 nova-api[27066]: 2017-09-28 12:17:30.794 27066 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:17:30 ctl02 nova-api[27066]: 2017-09-28 12:17:30.794 27066 ERROR nova     sock.listen(backlog)
Sep 28 12:17:30 ctl02 nova-api[27066]: 2017-09-28 12:17:30.794 27066 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:17:30 ctl02 nova-api[27066]: 2017-09-28 12:17:30.794 27066 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:17:30 ctl02 nova-api[27066]: 2017-09-28 12:17:30.794 27066 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:17:30 ctl02 nova-api[27066]: 2017-09-28 12:17:30.794 27066 ERROR nova
Sep 28 12:17:30 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:17:30 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:17:30 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:17:31 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:17:31 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:17:31 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:17:31 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:17:32 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:17:32.113 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:17:32] "OPTIONS / HTTP/1.0" 200 134 0.000515
Sep 28 12:17:32 ctl02 heat-api-cfn[13300]: 2017-09-28 12:17:32.614 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:17:32] "OPTIONS / HTTP/1.0" 200 134 0.000573
Sep 28 12:17:32 ctl02 nova-api[27084]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:17:32 ctl02 nova-api[27084]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:17:33 ctl02 nova-api[27084]: 2017-09-28 12:17:33.005 27084 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:17:33 ctl02 nova-api[27084]: 2017-09-28 12:17:33.008 27084 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:17:33 ctl02 nova-api[27084]: 2017-09-28 12:17:33.008 27084 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:17:33 ctl02 nova-api[27084]: 2017-09-28 12:17:33.008 27084 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:17:33 ctl02 nova-api[27084]: 2017-09-28 12:17:33.008 27084 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:17:33 ctl02 nova-api[27084]: 2017-09-28 12:17:33.008 27084 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:17:33 ctl02 nova-api[27084]: 2017-09-28 12:17:33.008 27084 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:17:33 ctl02 nova-api[27084]: 2017-09-28 12:17:33.008 27084 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:17:33 ctl02 nova-api[27084]: 2017-09-28 12:17:33.008 27084 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:17:33 ctl02 nova-api[27084]: 2017-09-28 12:17:33.008 27084 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:17:33 ctl02 nova-api[27084]: 2017-09-28 12:17:33.008 27084 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:17:33 ctl02 nova-api[27084]: 2017-09-28 12:17:33.008 27084 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:17:33 ctl02 nova-api[27084]: 2017-09-28 12:17:33.008 27084 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:17:33 ctl02 nova-api[27084]: 2017-09-28 12:17:33.008 27084 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:17:33 ctl02 nova-api[27084]: 2017-09-28 12:17:33.008 27084 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:17:33 ctl02 nova-api[27084]: 2017-09-28 12:17:33.008 27084 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:17:33 ctl02 nova-api[27084]: 2017-09-28 12:17:33.008 27084 ERROR nova.wsgi     self.filename))
Sep 28 12:17:33 ctl02 nova-api[27084]: 2017-09-28 12:17:33.008 27084 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:17:33 ctl02 nova-api[27084]: 2017-09-28 12:17:33.008 27084 ERROR nova.wsgi
Sep 28 12:17:33 ctl02 nova-api[27084]: 2017-09-28 12:17:33.009 27084 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:17:33 ctl02 glance-api[29183]: 2017-09-28 12:17:33.038 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:17:33] "OPTIONS / HTTP/1.0" 200 134 0.000660
Sep 28 12:17:33 ctl02 nova-api[27084]: 2017-09-28 12:17:33.147 27084 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:17:33 ctl02 nova-api[27084]: 2017-09-28 12:17:33.396 27084 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:17:33 ctl02 nova-api[27084]: 2017-09-28 12:17:33.398 27084 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:17:33 ctl02 nova-api[27084]: 2017-09-28 12:17:33.398 27084 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:17:33 ctl02 nova-api[27084]: 2017-09-28 12:17:33.399 27084 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:17:33 ctl02 nova-api[27084]: 2017-09-28 12:17:33.532 27084 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:17:33 ctl02 nova-api[27084]: 2017-09-28 12:17:33.534 27084 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:17:33 ctl02 nova-api[27084]: 2017-09-28 12:17:33.534 27084 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:17:33 ctl02 nova-api[27084]: 2017-09-28 12:17:33.534 27084 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:17:33 ctl02 nova-api[27084]: 2017-09-28 12:17:33.538 27084 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:17:33 ctl02 nova-api[27084]: 2017-09-28 12:17:33.538 27084 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:17:33 ctl02 nova-api[27084]: 2017-09-28 12:17:33.538 27084 ERROR nova Traceback (most recent call last):
Sep 28 12:17:33 ctl02 nova-api[27084]: 2017-09-28 12:17:33.538 27084 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:17:33 ctl02 nova-api[27084]: 2017-09-28 12:17:33.538 27084 ERROR nova     sys.exit(main())
Sep 28 12:17:33 ctl02 nova-api[27084]: 2017-09-28 12:17:33.538 27084 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:17:33 ctl02 nova-api[27084]: 2017-09-28 12:17:33.538 27084 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:17:33 ctl02 nova-api[27084]: 2017-09-28 12:17:33.538 27084 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:17:33 ctl02 nova-api[27084]: 2017-09-28 12:17:33.538 27084 ERROR nova     max_url_len=max_url_len)
Sep 28 12:17:33 ctl02 nova-api[27084]: 2017-09-28 12:17:33.538 27084 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:17:33 ctl02 nova-api[27084]: 2017-09-28 12:17:33.538 27084 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:17:33 ctl02 nova-api[27084]: 2017-09-28 12:17:33.538 27084 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:17:33 ctl02 nova-api[27084]: 2017-09-28 12:17:33.538 27084 ERROR nova     sock.listen(backlog)
Sep 28 12:17:33 ctl02 nova-api[27084]: 2017-09-28 12:17:33.538 27084 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:17:33 ctl02 nova-api[27084]: 2017-09-28 12:17:33.538 27084 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:17:33 ctl02 nova-api[27084]: 2017-09-28 12:17:33.538 27084 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:17:33 ctl02 nova-api[27084]: 2017-09-28 12:17:33.538 27084 ERROR nova
Sep 28 12:17:33 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:17:33 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:17:33 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:17:33 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:17:33 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:17:33 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:17:33 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:17:34 ctl02 glance-api[29183]: 2017-09-28 12:17:34.092 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:17:34] "OPTIONS / HTTP/1.0" 200 134 0.000634
Sep 28 12:17:34 ctl02 heat-api[13008]: 2017-09-28 12:17:34.485 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:17:34] "OPTIONS / HTTP/1.0" 200 134 0.000669
Sep 28 12:17:35 ctl02 nova-api[27102]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:17:35 ctl02 nova-api[27102]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:17:35 ctl02 nova-api[27102]: 2017-09-28 12:17:35.790 27102 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:17:35 ctl02 nova-api[27102]: 2017-09-28 12:17:35.792 27102 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:17:35 ctl02 nova-api[27102]: 2017-09-28 12:17:35.792 27102 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:17:35 ctl02 nova-api[27102]: 2017-09-28 12:17:35.792 27102 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:17:35 ctl02 nova-api[27102]: 2017-09-28 12:17:35.792 27102 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:17:35 ctl02 nova-api[27102]: 2017-09-28 12:17:35.792 27102 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:17:35 ctl02 nova-api[27102]: 2017-09-28 12:17:35.792 27102 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:17:35 ctl02 nova-api[27102]: 2017-09-28 12:17:35.792 27102 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:17:35 ctl02 nova-api[27102]: 2017-09-28 12:17:35.792 27102 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:17:35 ctl02 nova-api[27102]: 2017-09-28 12:17:35.792 27102 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:17:35 ctl02 nova-api[27102]: 2017-09-28 12:17:35.792 27102 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:17:35 ctl02 nova-api[27102]: 2017-09-28 12:17:35.792 27102 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:17:35 ctl02 nova-api[27102]: 2017-09-28 12:17:35.792 27102 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:17:35 ctl02 nova-api[27102]: 2017-09-28 12:17:35.792 27102 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:17:35 ctl02 nova-api[27102]: 2017-09-28 12:17:35.792 27102 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:17:35 ctl02 nova-api[27102]: 2017-09-28 12:17:35.792 27102 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:17:35 ctl02 nova-api[27102]: 2017-09-28 12:17:35.792 27102 ERROR nova.wsgi     self.filename))
Sep 28 12:17:35 ctl02 nova-api[27102]: 2017-09-28 12:17:35.792 27102 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:17:35 ctl02 nova-api[27102]: 2017-09-28 12:17:35.792 27102 ERROR nova.wsgi
Sep 28 12:17:35 ctl02 nova-api[27102]: 2017-09-28 12:17:35.793 27102 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:17:35 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:17:35.899 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:17:35] "OPTIONS / HTTP/1.0" 200 134 0.000489
Sep 28 12:17:35 ctl02 nova-api[27102]: 2017-09-28 12:17:35.933 27102 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:17:36 ctl02 nova-api[27102]: 2017-09-28 12:17:36.191 27102 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:17:36 ctl02 nova-api[27102]: 2017-09-28 12:17:36.194 27102 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:17:36 ctl02 nova-api[27102]: 2017-09-28 12:17:36.194 27102 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:17:36 ctl02 nova-api[27102]: 2017-09-28 12:17:36.194 27102 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:17:36 ctl02 nova-api[27102]: 2017-09-28 12:17:36.333 27102 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:17:36 ctl02 nova-api[27102]: 2017-09-28 12:17:36.336 27102 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:17:36 ctl02 nova-api[27102]: 2017-09-28 12:17:36.336 27102 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:17:36 ctl02 nova-api[27102]: 2017-09-28 12:17:36.336 27102 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:17:36 ctl02 nova-api[27102]: 2017-09-28 12:17:36.340 27102 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:17:36 ctl02 nova-api[27102]: 2017-09-28 12:17:36.340 27102 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:17:36 ctl02 nova-api[27102]: 2017-09-28 12:17:36.340 27102 ERROR nova Traceback (most recent call last):
Sep 28 12:17:36 ctl02 nova-api[27102]: 2017-09-28 12:17:36.340 27102 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:17:36 ctl02 nova-api[27102]: 2017-09-28 12:17:36.340 27102 ERROR nova     sys.exit(main())
Sep 28 12:17:36 ctl02 nova-api[27102]: 2017-09-28 12:17:36.340 27102 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:17:36 ctl02 nova-api[27102]: 2017-09-28 12:17:36.340 27102 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:17:36 ctl02 nova-api[27102]: 2017-09-28 12:17:36.340 27102 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:17:36 ctl02 nova-api[27102]: 2017-09-28 12:17:36.340 27102 ERROR nova     max_url_len=max_url_len)
Sep 28 12:17:36 ctl02 nova-api[27102]: 2017-09-28 12:17:36.340 27102 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:17:36 ctl02 nova-api[27102]: 2017-09-28 12:17:36.340 27102 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:17:36 ctl02 nova-api[27102]: 2017-09-28 12:17:36.340 27102 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:17:36 ctl02 nova-api[27102]: 2017-09-28 12:17:36.340 27102 ERROR nova     sock.listen(backlog)
Sep 28 12:17:36 ctl02 nova-api[27102]: 2017-09-28 12:17:36.340 27102 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:17:36 ctl02 nova-api[27102]: 2017-09-28 12:17:36.340 27102 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:17:36 ctl02 nova-api[27102]: 2017-09-28 12:17:36.340 27102 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:17:36 ctl02 nova-api[27102]: 2017-09-28 12:17:36.340 27102 ERROR nova
Sep 28 12:17:36 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:17:36 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:17:36 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:17:36 ctl02 heat-api[13008]: 2017-09-28 12:17:36.620 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:17:36] "OPTIONS / HTTP/1.0" 200 134 0.000682
Sep 28 12:17:36 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:17:36 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:17:36 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:17:36 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:17:37 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:17:37.786 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:17:37] "OPTIONS / HTTP/1.0" 200 134 0.000394
Sep 28 12:17:38 ctl02 nova-api[27121]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:17:38 ctl02 nova-api[27121]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:17:38 ctl02 nova-api[27121]: 2017-09-28 12:17:38.464 27121 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:17:38 ctl02 nova-api[27121]: 2017-09-28 12:17:38.466 27121 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:17:38 ctl02 nova-api[27121]: 2017-09-28 12:17:38.466 27121 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:17:38 ctl02 nova-api[27121]: 2017-09-28 12:17:38.466 27121 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:17:38 ctl02 nova-api[27121]: 2017-09-28 12:17:38.466 27121 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:17:38 ctl02 nova-api[27121]: 2017-09-28 12:17:38.466 27121 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:17:38 ctl02 nova-api[27121]: 2017-09-28 12:17:38.466 27121 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:17:38 ctl02 nova-api[27121]: 2017-09-28 12:17:38.466 27121 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:17:38 ctl02 nova-api[27121]: 2017-09-28 12:17:38.466 27121 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:17:38 ctl02 nova-api[27121]: 2017-09-28 12:17:38.466 27121 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:17:38 ctl02 nova-api[27121]: 2017-09-28 12:17:38.466 27121 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:17:38 ctl02 nova-api[27121]: 2017-09-28 12:17:38.466 27121 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:17:38 ctl02 nova-api[27121]: 2017-09-28 12:17:38.466 27121 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:17:38 ctl02 nova-api[27121]: 2017-09-28 12:17:38.466 27121 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:17:38 ctl02 nova-api[27121]: 2017-09-28 12:17:38.466 27121 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:17:38 ctl02 nova-api[27121]: 2017-09-28 12:17:38.466 27121 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:17:38 ctl02 nova-api[27121]: 2017-09-28 12:17:38.466 27121 ERROR nova.wsgi     self.filename))
Sep 28 12:17:38 ctl02 nova-api[27121]: 2017-09-28 12:17:38.466 27121 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:17:38 ctl02 nova-api[27121]: 2017-09-28 12:17:38.466 27121 ERROR nova.wsgi
Sep 28 12:17:38 ctl02 nova-api[27121]: 2017-09-28 12:17:38.468 27121 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:17:38 ctl02 nova-api[27121]: 2017-09-28 12:17:38.604 27121 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:17:38 ctl02 nova-api[27121]: 2017-09-28 12:17:38.861 27121 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:17:38 ctl02 nova-api[27121]: 2017-09-28 12:17:38.864 27121 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:17:38 ctl02 nova-api[27121]: 2017-09-28 12:17:38.864 27121 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:17:38 ctl02 nova-api[27121]: 2017-09-28 12:17:38.865 27121 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:17:39 ctl02 nova-api[27121]: 2017-09-28 12:17:38.999 27121 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:17:39 ctl02 nova-api[27121]: 2017-09-28 12:17:39.002 27121 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:17:39 ctl02 nova-api[27121]: 2017-09-28 12:17:39.003 27121 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:17:39 ctl02 nova-api[27121]: 2017-09-28 12:17:39.003 27121 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:17:39 ctl02 nova-api[27121]: 2017-09-28 12:17:39.007 27121 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:17:39 ctl02 nova-api[27121]: 2017-09-28 12:17:39.007 27121 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:17:39 ctl02 nova-api[27121]: 2017-09-28 12:17:39.007 27121 ERROR nova Traceback (most recent call last):
Sep 28 12:17:39 ctl02 nova-api[27121]: 2017-09-28 12:17:39.007 27121 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:17:39 ctl02 nova-api[27121]: 2017-09-28 12:17:39.007 27121 ERROR nova     sys.exit(main())
Sep 28 12:17:39 ctl02 nova-api[27121]: 2017-09-28 12:17:39.007 27121 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:17:39 ctl02 nova-api[27121]: 2017-09-28 12:17:39.007 27121 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:17:39 ctl02 nova-api[27121]: 2017-09-28 12:17:39.007 27121 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:17:39 ctl02 nova-api[27121]: 2017-09-28 12:17:39.007 27121 ERROR nova     max_url_len=max_url_len)
Sep 28 12:17:39 ctl02 nova-api[27121]: 2017-09-28 12:17:39.007 27121 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:17:39 ctl02 nova-api[27121]: 2017-09-28 12:17:39.007 27121 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:17:39 ctl02 nova-api[27121]: 2017-09-28 12:17:39.007 27121 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:17:39 ctl02 nova-api[27121]: 2017-09-28 12:17:39.007 27121 ERROR nova     sock.listen(backlog)
Sep 28 12:17:39 ctl02 nova-api[27121]: 2017-09-28 12:17:39.007 27121 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:17:39 ctl02 nova-api[27121]: 2017-09-28 12:17:39.007 27121 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:17:39 ctl02 nova-api[27121]: 2017-09-28 12:17:39.007 27121 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:17:39 ctl02 nova-api[27121]: 2017-09-28 12:17:39.007 27121 ERROR nova
Sep 28 12:17:39 ctl02 heat-api[13008]: 2017-09-28 12:17:39.159 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:17:39] "OPTIONS / HTTP/1.0" 200 134 0.000609
Sep 28 12:17:39 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:17:39 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:17:39 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:17:39 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:17:39 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:17:39 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:17:39 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:17:39 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8cd1262e)
Sep 28 12:17:39 ctl02 heat-api-cfn[13300]: 2017-09-28 12:17:39.869 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:17:39] "OPTIONS / HTTP/1.0" 200 134 0.000510
Sep 28 12:17:40 ctl02 glance-api[29183]: 2017-09-28 12:17:40.003 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:17:40] "OPTIONS / HTTP/1.0" 200 134 0.000656
Sep 28 12:17:40 ctl02 heat-api-cfn[13300]: 2017-09-28 12:17:40.347 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:17:40] "OPTIONS / HTTP/1.0" 200 134 0.000506
Sep 28 12:17:40 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8cd1262e)
Sep 28 12:17:40 ctl02 nova-cert[4860]: 2017-09-28 12:17:40.898 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:17:41 ctl02 nova-api[27140]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:17:41 ctl02 nova-api[27140]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:17:41 ctl02 nova-api[27140]: 2017-09-28 12:17:41.239 27140 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:17:41 ctl02 nova-api[27140]: 2017-09-28 12:17:41.241 27140 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:17:41 ctl02 nova-api[27140]: 2017-09-28 12:17:41.241 27140 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:17:41 ctl02 nova-api[27140]: 2017-09-28 12:17:41.241 27140 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:17:41 ctl02 nova-api[27140]: 2017-09-28 12:17:41.241 27140 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:17:41 ctl02 nova-api[27140]: 2017-09-28 12:17:41.241 27140 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:17:41 ctl02 nova-api[27140]: 2017-09-28 12:17:41.241 27140 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:17:41 ctl02 nova-api[27140]: 2017-09-28 12:17:41.241 27140 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:17:41 ctl02 nova-api[27140]: 2017-09-28 12:17:41.241 27140 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:17:41 ctl02 nova-api[27140]: 2017-09-28 12:17:41.241 27140 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:17:41 ctl02 nova-api[27140]: 2017-09-28 12:17:41.241 27140 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:17:41 ctl02 nova-api[27140]: 2017-09-28 12:17:41.241 27140 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:17:41 ctl02 nova-api[27140]: 2017-09-28 12:17:41.241 27140 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:17:41 ctl02 nova-api[27140]: 2017-09-28 12:17:41.241 27140 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:17:41 ctl02 nova-api[27140]: 2017-09-28 12:17:41.241 27140 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:17:41 ctl02 nova-api[27140]: 2017-09-28 12:17:41.241 27140 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:17:41 ctl02 nova-api[27140]: 2017-09-28 12:17:41.241 27140 ERROR nova.wsgi     self.filename))
Sep 28 12:17:41 ctl02 nova-api[27140]: 2017-09-28 12:17:41.241 27140 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:17:41 ctl02 nova-api[27140]: 2017-09-28 12:17:41.241 27140 ERROR nova.wsgi
Sep 28 12:17:41 ctl02 nova-api[27140]: 2017-09-28 12:17:41.244 27140 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:17:41 ctl02 nova-api[27140]: 2017-09-28 12:17:41.375 27140 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:17:41 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8cd1262e)
Sep 28 12:17:41 ctl02 nova-api[27140]: 2017-09-28 12:17:41.611 27140 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:17:41 ctl02 nova-api[27140]: 2017-09-28 12:17:41.614 27140 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:17:41 ctl02 nova-api[27140]: 2017-09-28 12:17:41.614 27140 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:17:41 ctl02 nova-api[27140]: 2017-09-28 12:17:41.615 27140 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:17:41 ctl02 nova-api[27140]: 2017-09-28 12:17:41.746 27140 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:17:41 ctl02 nova-api[27140]: 2017-09-28 12:17:41.749 27140 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:17:41 ctl02 nova-api[27140]: 2017-09-28 12:17:41.749 27140 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:17:41 ctl02 nova-api[27140]: 2017-09-28 12:17:41.750 27140 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:17:41 ctl02 nova-api[27140]: 2017-09-28 12:17:41.753 27140 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:17:41 ctl02 nova-api[27140]: 2017-09-28 12:17:41.754 27140 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:17:41 ctl02 nova-api[27140]: 2017-09-28 12:17:41.754 27140 ERROR nova Traceback (most recent call last):
Sep 28 12:17:41 ctl02 nova-api[27140]: 2017-09-28 12:17:41.754 27140 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:17:41 ctl02 nova-api[27140]: 2017-09-28 12:17:41.754 27140 ERROR nova     sys.exit(main())
Sep 28 12:17:41 ctl02 nova-api[27140]: 2017-09-28 12:17:41.754 27140 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:17:41 ctl02 nova-api[27140]: 2017-09-28 12:17:41.754 27140 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:17:41 ctl02 nova-api[27140]: 2017-09-28 12:17:41.754 27140 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:17:41 ctl02 nova-api[27140]: 2017-09-28 12:17:41.754 27140 ERROR nova     max_url_len=max_url_len)
Sep 28 12:17:41 ctl02 nova-api[27140]: 2017-09-28 12:17:41.754 27140 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:17:41 ctl02 nova-api[27140]: 2017-09-28 12:17:41.754 27140 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:17:41 ctl02 nova-api[27140]: 2017-09-28 12:17:41.754 27140 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:17:41 ctl02 nova-api[27140]: 2017-09-28 12:17:41.754 27140 ERROR nova     sock.listen(backlog)
Sep 28 12:17:41 ctl02 nova-api[27140]: 2017-09-28 12:17:41.754 27140 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:17:41 ctl02 nova-api[27140]: 2017-09-28 12:17:41.754 27140 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:17:41 ctl02 nova-api[27140]: 2017-09-28 12:17:41.754 27140 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:17:41 ctl02 nova-api[27140]: 2017-09-28 12:17:41.754 27140 ERROR nova
Sep 28 12:17:41 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:17:41.820 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:17:41] "OPTIONS / HTTP/1.0" 200 134 0.000567
Sep 28 12:17:41 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:17:41 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:17:41 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:17:42 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:17:42 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:17:42 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:17:42 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:17:42 ctl02 heat-api-cfn[13300]: 2017-09-28 12:17:42.231 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:17:42] "OPTIONS / HTTP/1.0" 200 134 0.000632
Sep 28 12:17:42 ctl02 nova-conductor[5056]: 2017-09-28 12:17:42.531 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:17:42 ctl02 nova-conductor[5056]: 2017-09-28 12:17:42.546 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:17:42 ctl02 nova-conductor[5056]: 2017-09-28 12:17:42.550 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:17:42 ctl02 nova-conductor[5056]: 2017-09-28 12:17:42.551 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:17:42 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8cd1262e)
Sep 28 12:17:42 ctl02 glance-api[29183]: 2017-09-28 12:17:42.673 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:17:42] "OPTIONS / HTTP/1.0" 200 134 0.000751
Sep 28 12:17:43 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8cd1262e)
Sep 28 12:17:43 ctl02 nova-api[27157]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:17:43 ctl02 nova-api[27157]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:17:43 ctl02 glance-api[29183]: 2017-09-28 12:17:43.900 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:17:43] "OPTIONS / HTTP/1.0" 200 134 0.000756
Sep 28 12:17:43 ctl02 nova-api[27157]: 2017-09-28 12:17:43.961 27157 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:17:43 ctl02 nova-api[27157]: 2017-09-28 12:17:43.963 27157 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:17:43 ctl02 nova-api[27157]: 2017-09-28 12:17:43.963 27157 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:17:43 ctl02 nova-api[27157]: 2017-09-28 12:17:43.963 27157 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:17:43 ctl02 nova-api[27157]: 2017-09-28 12:17:43.963 27157 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:17:43 ctl02 nova-api[27157]: 2017-09-28 12:17:43.963 27157 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:17:43 ctl02 nova-api[27157]: 2017-09-28 12:17:43.963 27157 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:17:43 ctl02 nova-api[27157]: 2017-09-28 12:17:43.963 27157 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:17:43 ctl02 nova-api[27157]: 2017-09-28 12:17:43.963 27157 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:17:43 ctl02 nova-api[27157]: 2017-09-28 12:17:43.963 27157 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:17:43 ctl02 nova-api[27157]: 2017-09-28 12:17:43.963 27157 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:17:43 ctl02 nova-api[27157]: 2017-09-28 12:17:43.963 27157 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:17:43 ctl02 nova-api[27157]: 2017-09-28 12:17:43.963 27157 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:17:43 ctl02 nova-api[27157]: 2017-09-28 12:17:43.963 27157 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:17:43 ctl02 nova-api[27157]: 2017-09-28 12:17:43.963 27157 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:17:43 ctl02 nova-api[27157]: 2017-09-28 12:17:43.963 27157 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:17:43 ctl02 nova-api[27157]: 2017-09-28 12:17:43.963 27157 ERROR nova.wsgi     self.filename))
Sep 28 12:17:43 ctl02 nova-api[27157]: 2017-09-28 12:17:43.963 27157 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:17:43 ctl02 nova-api[27157]: 2017-09-28 12:17:43.963 27157 ERROR nova.wsgi
Sep 28 12:17:43 ctl02 nova-api[27157]: 2017-09-28 12:17:43.964 27157 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:17:44 ctl02 nova-api[27157]: 2017-09-28 12:17:44.101 27157 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:17:44 ctl02 nova-api[27157]: 2017-09-28 12:17:44.338 27157 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:17:44 ctl02 nova-api[27157]: 2017-09-28 12:17:44.340 27157 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:17:44 ctl02 nova-api[27157]: 2017-09-28 12:17:44.340 27157 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:17:44 ctl02 nova-api[27157]: 2017-09-28 12:17:44.340 27157 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:17:44 ctl02 nova-api[27157]: 2017-09-28 12:17:44.473 27157 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:17:44 ctl02 nova-api[27157]: 2017-09-28 12:17:44.475 27157 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:17:44 ctl02 nova-api[27157]: 2017-09-28 12:17:44.475 27157 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:17:44 ctl02 nova-api[27157]: 2017-09-28 12:17:44.475 27157 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:17:44 ctl02 nova-api[27157]: 2017-09-28 12:17:44.479 27157 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:17:44 ctl02 nova-api[27157]: 2017-09-28 12:17:44.479 27157 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:17:44 ctl02 nova-api[27157]: 2017-09-28 12:17:44.479 27157 ERROR nova Traceback (most recent call last):
Sep 28 12:17:44 ctl02 nova-api[27157]: 2017-09-28 12:17:44.479 27157 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:17:44 ctl02 nova-api[27157]: 2017-09-28 12:17:44.479 27157 ERROR nova     sys.exit(main())
Sep 28 12:17:44 ctl02 nova-api[27157]: 2017-09-28 12:17:44.479 27157 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:17:44 ctl02 nova-api[27157]: 2017-09-28 12:17:44.479 27157 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:17:44 ctl02 nova-api[27157]: 2017-09-28 12:17:44.479 27157 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:17:44 ctl02 nova-api[27157]: 2017-09-28 12:17:44.479 27157 ERROR nova     max_url_len=max_url_len)
Sep 28 12:17:44 ctl02 nova-api[27157]: 2017-09-28 12:17:44.479 27157 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:17:44 ctl02 nova-api[27157]: 2017-09-28 12:17:44.479 27157 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:17:44 ctl02 nova-api[27157]: 2017-09-28 12:17:44.479 27157 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:17:44 ctl02 nova-api[27157]: 2017-09-28 12:17:44.479 27157 ERROR nova     sock.listen(backlog)
Sep 28 12:17:44 ctl02 nova-api[27157]: 2017-09-28 12:17:44.479 27157 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:17:44 ctl02 nova-api[27157]: 2017-09-28 12:17:44.479 27157 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:17:44 ctl02 nova-api[27157]: 2017-09-28 12:17:44.479 27157 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:17:44 ctl02 nova-api[27157]: 2017-09-28 12:17:44.479 27157 ERROR nova
Sep 28 12:17:44 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8cd1262e)
Sep 28 12:17:44 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:17:44 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:17:44 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:17:44 ctl02 heat-api[13008]: 2017-09-28 12:17:44.821 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:17:44] "OPTIONS / HTTP/1.0" 200 134 0.000703
Sep 28 12:17:44 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:17:44 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:17:44 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:17:44 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:17:45 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8cd1262e)
Sep 28 12:17:46 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:17:46.183 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:17:46] "OPTIONS / HTTP/1.0" 200 134 0.000562
Sep 28 12:17:46 ctl02 nova-api[27175]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:17:46 ctl02 nova-api[27175]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:17:46 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8cd1262e)
Sep 28 12:17:46 ctl02 nova-api[27175]: 2017-09-28 12:17:46.711 27175 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:17:46 ctl02 nova-api[27175]: 2017-09-28 12:17:46.713 27175 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:17:46 ctl02 nova-api[27175]: 2017-09-28 12:17:46.713 27175 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:17:46 ctl02 nova-api[27175]: 2017-09-28 12:17:46.713 27175 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:17:46 ctl02 nova-api[27175]: 2017-09-28 12:17:46.713 27175 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:17:46 ctl02 nova-api[27175]: 2017-09-28 12:17:46.713 27175 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:17:46 ctl02 nova-api[27175]: 2017-09-28 12:17:46.713 27175 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:17:46 ctl02 nova-api[27175]: 2017-09-28 12:17:46.713 27175 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:17:46 ctl02 nova-api[27175]: 2017-09-28 12:17:46.713 27175 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:17:46 ctl02 nova-api[27175]: 2017-09-28 12:17:46.713 27175 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:17:46 ctl02 nova-api[27175]: 2017-09-28 12:17:46.713 27175 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:17:46 ctl02 nova-api[27175]: 2017-09-28 12:17:46.713 27175 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:17:46 ctl02 nova-api[27175]: 2017-09-28 12:17:46.713 27175 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:17:46 ctl02 nova-api[27175]: 2017-09-28 12:17:46.713 27175 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:17:46 ctl02 nova-api[27175]: 2017-09-28 12:17:46.713 27175 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:17:46 ctl02 nova-api[27175]: 2017-09-28 12:17:46.713 27175 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:17:46 ctl02 nova-api[27175]: 2017-09-28 12:17:46.713 27175 ERROR nova.wsgi     self.filename))
Sep 28 12:17:46 ctl02 nova-api[27175]: 2017-09-28 12:17:46.713 27175 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:17:46 ctl02 nova-api[27175]: 2017-09-28 12:17:46.713 27175 ERROR nova.wsgi
Sep 28 12:17:46 ctl02 nova-api[27175]: 2017-09-28 12:17:46.714 27175 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:17:46 ctl02 heat-api[13008]: 2017-09-28 12:17:46.730 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:17:46] "OPTIONS / HTTP/1.0" 200 134 0.000604
Sep 28 12:17:46 ctl02 nova-api[27175]: 2017-09-28 12:17:46.848 27175 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:17:47 ctl02 nova-api[27175]: 2017-09-28 12:17:47.083 27175 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:17:47 ctl02 nova-api[27175]: 2017-09-28 12:17:47.085 27175 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:17:47 ctl02 nova-api[27175]: 2017-09-28 12:17:47.085 27175 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:17:47 ctl02 nova-api[27175]: 2017-09-28 12:17:47.085 27175 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:17:47 ctl02 nova-api[27175]: 2017-09-28 12:17:47.217 27175 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:17:47 ctl02 nova-api[27175]: 2017-09-28 12:17:47.218 27175 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:17:47 ctl02 nova-api[27175]: 2017-09-28 12:17:47.219 27175 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:17:47 ctl02 nova-api[27175]: 2017-09-28 12:17:47.219 27175 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:17:47 ctl02 nova-api[27175]: 2017-09-28 12:17:47.222 27175 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:17:47 ctl02 nova-api[27175]: 2017-09-28 12:17:47.223 27175 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:17:47 ctl02 nova-api[27175]: 2017-09-28 12:17:47.223 27175 ERROR nova Traceback (most recent call last):
Sep 28 12:17:47 ctl02 nova-api[27175]: 2017-09-28 12:17:47.223 27175 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:17:47 ctl02 nova-api[27175]: 2017-09-28 12:17:47.223 27175 ERROR nova     sys.exit(main())
Sep 28 12:17:47 ctl02 nova-api[27175]: 2017-09-28 12:17:47.223 27175 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:17:47 ctl02 nova-api[27175]: 2017-09-28 12:17:47.223 27175 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:17:47 ctl02 nova-api[27175]: 2017-09-28 12:17:47.223 27175 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:17:47 ctl02 nova-api[27175]: 2017-09-28 12:17:47.223 27175 ERROR nova     max_url_len=max_url_len)
Sep 28 12:17:47 ctl02 nova-api[27175]: 2017-09-28 12:17:47.223 27175 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:17:47 ctl02 nova-api[27175]: 2017-09-28 12:17:47.223 27175 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:17:47 ctl02 nova-api[27175]: 2017-09-28 12:17:47.223 27175 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:17:47 ctl02 nova-api[27175]: 2017-09-28 12:17:47.223 27175 ERROR nova     sock.listen(backlog)
Sep 28 12:17:47 ctl02 nova-api[27175]: 2017-09-28 12:17:47.223 27175 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:17:47 ctl02 nova-api[27175]: 2017-09-28 12:17:47.223 27175 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:17:47 ctl02 nova-api[27175]: 2017-09-28 12:17:47.223 27175 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:17:47 ctl02 nova-api[27175]: 2017-09-28 12:17:47.223 27175 ERROR nova
Sep 28 12:17:47 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:17:47 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:17:47 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:17:47 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8cd1262e)
Sep 28 12:17:47 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:17:47 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:17:47 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:17:47 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:17:47 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:17:47.814 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:17:47] "OPTIONS / HTTP/1.0" 200 134 0.000505
Sep 28 12:17:48 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8cd1262e)
Sep 28 12:17:49 ctl02 nova-api[27194]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:17:49 ctl02 nova-api[27194]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:17:49 ctl02 heat-api[13008]: 2017-09-28 12:17:49.314 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:17:49] "OPTIONS / HTTP/1.0" 200 134 0.000692
Sep 28 12:17:49 ctl02 nova-api[27194]: 2017-09-28 12:17:49.486 27194 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:17:49 ctl02 nova-api[27194]: 2017-09-28 12:17:49.488 27194 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:17:49 ctl02 nova-api[27194]: 2017-09-28 12:17:49.488 27194 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:17:49 ctl02 nova-api[27194]: 2017-09-28 12:17:49.488 27194 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:17:49 ctl02 nova-api[27194]: 2017-09-28 12:17:49.488 27194 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:17:49 ctl02 nova-api[27194]: 2017-09-28 12:17:49.488 27194 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:17:49 ctl02 nova-api[27194]: 2017-09-28 12:17:49.488 27194 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:17:49 ctl02 nova-api[27194]: 2017-09-28 12:17:49.488 27194 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:17:49 ctl02 nova-api[27194]: 2017-09-28 12:17:49.488 27194 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:17:49 ctl02 nova-api[27194]: 2017-09-28 12:17:49.488 27194 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:17:49 ctl02 nova-api[27194]: 2017-09-28 12:17:49.488 27194 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:17:49 ctl02 nova-api[27194]: 2017-09-28 12:17:49.488 27194 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:17:49 ctl02 nova-api[27194]: 2017-09-28 12:17:49.488 27194 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:17:49 ctl02 nova-api[27194]: 2017-09-28 12:17:49.488 27194 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:17:49 ctl02 nova-api[27194]: 2017-09-28 12:17:49.488 27194 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:17:49 ctl02 nova-api[27194]: 2017-09-28 12:17:49.488 27194 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:17:49 ctl02 nova-api[27194]: 2017-09-28 12:17:49.488 27194 ERROR nova.wsgi     self.filename))
Sep 28 12:17:49 ctl02 nova-api[27194]: 2017-09-28 12:17:49.488 27194 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:17:49 ctl02 nova-api[27194]: 2017-09-28 12:17:49.488 27194 ERROR nova.wsgi
Sep 28 12:17:49 ctl02 nova-api[27194]: 2017-09-28 12:17:49.489 27194 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:17:49 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8cd1262e)
Sep 28 12:17:49 ctl02 nova-api[27194]: 2017-09-28 12:17:49.622 27194 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:17:49 ctl02 heat-api-cfn[13300]: 2017-09-28 12:17:49.628 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:17:49] "OPTIONS / HTTP/1.0" 200 134 0.000684
Sep 28 12:17:49 ctl02 nova-api[27194]: 2017-09-28 12:17:49.870 27194 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:17:49 ctl02 nova-api[27194]: 2017-09-28 12:17:49.872 27194 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:17:49 ctl02 nova-api[27194]: 2017-09-28 12:17:49.872 27194 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:17:49 ctl02 nova-api[27194]: 2017-09-28 12:17:49.873 27194 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:17:50 ctl02 nova-api[27194]: 2017-09-28 12:17:50.004 27194 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:17:50 ctl02 nova-api[27194]: 2017-09-28 12:17:50.006 27194 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:17:50 ctl02 nova-api[27194]: 2017-09-28 12:17:50.006 27194 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:17:50 ctl02 nova-api[27194]: 2017-09-28 12:17:50.007 27194 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:17:50 ctl02 nova-api[27194]: 2017-09-28 12:17:50.010 27194 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:17:50 ctl02 nova-api[27194]: 2017-09-28 12:17:50.010 27194 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:17:50 ctl02 nova-api[27194]: 2017-09-28 12:17:50.010 27194 ERROR nova Traceback (most recent call last):
Sep 28 12:17:50 ctl02 nova-api[27194]: 2017-09-28 12:17:50.010 27194 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:17:50 ctl02 nova-api[27194]: 2017-09-28 12:17:50.010 27194 ERROR nova     sys.exit(main())
Sep 28 12:17:50 ctl02 nova-api[27194]: 2017-09-28 12:17:50.010 27194 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:17:50 ctl02 nova-api[27194]: 2017-09-28 12:17:50.010 27194 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:17:50 ctl02 nova-api[27194]: 2017-09-28 12:17:50.010 27194 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:17:50 ctl02 nova-api[27194]: 2017-09-28 12:17:50.010 27194 ERROR nova     max_url_len=max_url_len)
Sep 28 12:17:50 ctl02 nova-api[27194]: 2017-09-28 12:17:50.010 27194 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:17:50 ctl02 nova-api[27194]: 2017-09-28 12:17:50.010 27194 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:17:50 ctl02 nova-api[27194]: 2017-09-28 12:17:50.010 27194 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:17:50 ctl02 nova-api[27194]: 2017-09-28 12:17:50.010 27194 ERROR nova     sock.listen(backlog)
Sep 28 12:17:50 ctl02 nova-api[27194]: 2017-09-28 12:17:50.010 27194 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:17:50 ctl02 nova-api[27194]: 2017-09-28 12:17:50.010 27194 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:17:50 ctl02 nova-api[27194]: 2017-09-28 12:17:50.010 27194 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:17:50 ctl02 nova-api[27194]: 2017-09-28 12:17:50.010 27194 ERROR nova
Sep 28 12:17:50 ctl02 glance-api[29183]: 2017-09-28 12:17:50.169 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:17:50] "OPTIONS / HTTP/1.0" 200 134 0.000751
Sep 28 12:17:50 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:17:50 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:17:50 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:17:50 ctl02 heat-api-cfn[13300]: 2017-09-28 12:17:50.340 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:17:50] "OPTIONS / HTTP/1.0" 200 134 0.000601
Sep 28 12:17:50 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:17:50 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:17:50 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:17:50 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:17:50 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:17:50 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:17:50 ctl02 nova-consoleauth[5433]: 2017-09-28 12:17:50.773 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:17:51 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:17:51.953 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:17:51] "OPTIONS / HTTP/1.0" 200 134 0.000527
Sep 28 12:17:52 ctl02 heat-api-cfn[13300]: 2017-09-28 12:17:52.044 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:17:52] "OPTIONS / HTTP/1.0" 200 134 0.000469
Sep 28 12:17:52 ctl02 nova-api[27212]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:17:52 ctl02 nova-api[27212]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:17:52 ctl02 nova-api[27212]: 2017-09-28 12:17:52.246 27212 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:17:52 ctl02 nova-api[27212]: 2017-09-28 12:17:52.249 27212 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:17:52 ctl02 nova-api[27212]: 2017-09-28 12:17:52.249 27212 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:17:52 ctl02 nova-api[27212]: 2017-09-28 12:17:52.249 27212 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:17:52 ctl02 nova-api[27212]: 2017-09-28 12:17:52.249 27212 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:17:52 ctl02 nova-api[27212]: 2017-09-28 12:17:52.249 27212 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:17:52 ctl02 nova-api[27212]: 2017-09-28 12:17:52.249 27212 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:17:52 ctl02 nova-api[27212]: 2017-09-28 12:17:52.249 27212 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:17:52 ctl02 nova-api[27212]: 2017-09-28 12:17:52.249 27212 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:17:52 ctl02 nova-api[27212]: 2017-09-28 12:17:52.249 27212 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:17:52 ctl02 nova-api[27212]: 2017-09-28 12:17:52.249 27212 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:17:52 ctl02 nova-api[27212]: 2017-09-28 12:17:52.249 27212 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:17:52 ctl02 nova-api[27212]: 2017-09-28 12:17:52.249 27212 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:17:52 ctl02 nova-api[27212]: 2017-09-28 12:17:52.249 27212 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:17:52 ctl02 nova-api[27212]: 2017-09-28 12:17:52.249 27212 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:17:52 ctl02 nova-api[27212]: 2017-09-28 12:17:52.249 27212 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:17:52 ctl02 nova-api[27212]: 2017-09-28 12:17:52.249 27212 ERROR nova.wsgi     self.filename))
Sep 28 12:17:52 ctl02 nova-api[27212]: 2017-09-28 12:17:52.249 27212 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:17:52 ctl02 nova-api[27212]: 2017-09-28 12:17:52.249 27212 ERROR nova.wsgi
Sep 28 12:17:52 ctl02 nova-api[27212]: 2017-09-28 12:17:52.250 27212 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:17:52 ctl02 nova-api[27212]: 2017-09-28 12:17:52.386 27212 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:17:52 ctl02 nova-api[27212]: 2017-09-28 12:17:52.643 27212 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:17:52 ctl02 nova-api[27212]: 2017-09-28 12:17:52.646 27212 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:17:52 ctl02 nova-api[27212]: 2017-09-28 12:17:52.646 27212 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:17:52 ctl02 nova-api[27212]: 2017-09-28 12:17:52.646 27212 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:17:52 ctl02 nova-api[27212]: 2017-09-28 12:17:52.786 27212 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:17:52 ctl02 nova-api[27212]: 2017-09-28 12:17:52.788 27212 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:17:52 ctl02 nova-api[27212]: 2017-09-28 12:17:52.788 27212 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:17:52 ctl02 nova-api[27212]: 2017-09-28 12:17:52.788 27212 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:17:52 ctl02 nova-api[27212]: 2017-09-28 12:17:52.792 27212 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:17:52 ctl02 nova-api[27212]: 2017-09-28 12:17:52.792 27212 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:17:52 ctl02 nova-api[27212]: 2017-09-28 12:17:52.792 27212 ERROR nova Traceback (most recent call last):
Sep 28 12:17:52 ctl02 nova-api[27212]: 2017-09-28 12:17:52.792 27212 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:17:52 ctl02 nova-api[27212]: 2017-09-28 12:17:52.792 27212 ERROR nova     sys.exit(main())
Sep 28 12:17:52 ctl02 nova-api[27212]: 2017-09-28 12:17:52.792 27212 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:17:52 ctl02 nova-api[27212]: 2017-09-28 12:17:52.792 27212 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:17:52 ctl02 nova-api[27212]: 2017-09-28 12:17:52.792 27212 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:17:52 ctl02 nova-api[27212]: 2017-09-28 12:17:52.792 27212 ERROR nova     max_url_len=max_url_len)
Sep 28 12:17:52 ctl02 nova-api[27212]: 2017-09-28 12:17:52.792 27212 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:17:52 ctl02 nova-api[27212]: 2017-09-28 12:17:52.792 27212 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:17:52 ctl02 nova-api[27212]: 2017-09-28 12:17:52.792 27212 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:17:52 ctl02 nova-api[27212]: 2017-09-28 12:17:52.792 27212 ERROR nova     sock.listen(backlog)
Sep 28 12:17:52 ctl02 nova-api[27212]: 2017-09-28 12:17:52.792 27212 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:17:52 ctl02 nova-api[27212]: 2017-09-28 12:17:52.792 27212 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:17:52 ctl02 nova-api[27212]: 2017-09-28 12:17:52.792 27212 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:17:52 ctl02 nova-api[27212]: 2017-09-28 12:17:52.792 27212 ERROR nova
Sep 28 12:17:52 ctl02 glance-api[29183]: 2017-09-28 12:17:52.898 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:17:52] "OPTIONS / HTTP/1.0" 200 134 0.000652
Sep 28 12:17:52 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:17:52 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:17:52 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:17:53 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:17:53 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:17:53 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:17:53 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:17:53 ctl02 heat-engine[12803]: 2017-09-28 12:17:53.641 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:17:53 ctl02 heat-engine[12803]: 2017-09-28 12:17:53.646 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:17:53 ctl02 heat-engine[12803]: 2017-09-28 12:17:53.651 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:17:53 ctl02 heat-engine[12803]: 2017-09-28 12:17:53.653 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:17:53 ctl02 nova-scheduler[5620]: 2017-09-28 12:17:53.797 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:17:53 ctl02 glance-api[29183]: 2017-09-28 12:17:53.880 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:17:53] "OPTIONS / HTTP/1.0" 200 134 0.000623
Sep 28 12:17:54 ctl02 nova-api[27235]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:17:54 ctl02 nova-api[27235]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:17:54 ctl02 nova-api[27235]: 2017-09-28 12:17:54.963 27235 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:17:54 ctl02 nova-api[27235]: 2017-09-28 12:17:54.965 27235 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:17:54 ctl02 nova-api[27235]: 2017-09-28 12:17:54.965 27235 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:17:54 ctl02 nova-api[27235]: 2017-09-28 12:17:54.965 27235 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:17:54 ctl02 nova-api[27235]: 2017-09-28 12:17:54.965 27235 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:17:54 ctl02 nova-api[27235]: 2017-09-28 12:17:54.965 27235 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:17:54 ctl02 nova-api[27235]: 2017-09-28 12:17:54.965 27235 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:17:54 ctl02 nova-api[27235]: 2017-09-28 12:17:54.965 27235 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:17:54 ctl02 nova-api[27235]: 2017-09-28 12:17:54.965 27235 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:17:54 ctl02 nova-api[27235]: 2017-09-28 12:17:54.965 27235 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:17:54 ctl02 nova-api[27235]: 2017-09-28 12:17:54.965 27235 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:17:54 ctl02 nova-api[27235]: 2017-09-28 12:17:54.965 27235 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:17:54 ctl02 nova-api[27235]: 2017-09-28 12:17:54.965 27235 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:17:54 ctl02 nova-api[27235]: 2017-09-28 12:17:54.965 27235 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:17:54 ctl02 nova-api[27235]: 2017-09-28 12:17:54.965 27235 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:17:54 ctl02 nova-api[27235]: 2017-09-28 12:17:54.965 27235 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:17:54 ctl02 nova-api[27235]: 2017-09-28 12:17:54.965 27235 ERROR nova.wsgi     self.filename))
Sep 28 12:17:54 ctl02 nova-api[27235]: 2017-09-28 12:17:54.965 27235 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:17:54 ctl02 nova-api[27235]: 2017-09-28 12:17:54.965 27235 ERROR nova.wsgi
Sep 28 12:17:54 ctl02 nova-api[27235]: 2017-09-28 12:17:54.966 27235 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:17:55 ctl02 nova-api[27235]: 2017-09-28 12:17:55.093 27235 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:17:55 ctl02 heat-api[13008]: 2017-09-28 12:17:55.130 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:17:55] "OPTIONS / HTTP/1.0" 200 134 0.000529
Sep 28 12:17:55 ctl02 nova-api[27235]: 2017-09-28 12:17:55.322 27235 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:17:55 ctl02 nova-api[27235]: 2017-09-28 12:17:55.324 27235 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:17:55 ctl02 nova-api[27235]: 2017-09-28 12:17:55.325 27235 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:17:55 ctl02 nova-api[27235]: 2017-09-28 12:17:55.325 27235 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:17:55 ctl02 nova-api[27235]: 2017-09-28 12:17:55.455 27235 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:17:55 ctl02 nova-api[27235]: 2017-09-28 12:17:55.457 27235 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:17:55 ctl02 nova-api[27235]: 2017-09-28 12:17:55.457 27235 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:17:55 ctl02 nova-api[27235]: 2017-09-28 12:17:55.457 27235 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:17:55 ctl02 nova-api[27235]: 2017-09-28 12:17:55.460 27235 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:17:55 ctl02 nova-api[27235]: 2017-09-28 12:17:55.461 27235 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:17:55 ctl02 nova-api[27235]: 2017-09-28 12:17:55.461 27235 ERROR nova Traceback (most recent call last):
Sep 28 12:17:55 ctl02 nova-api[27235]: 2017-09-28 12:17:55.461 27235 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:17:55 ctl02 nova-api[27235]: 2017-09-28 12:17:55.461 27235 ERROR nova     sys.exit(main())
Sep 28 12:17:55 ctl02 nova-api[27235]: 2017-09-28 12:17:55.461 27235 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:17:55 ctl02 nova-api[27235]: 2017-09-28 12:17:55.461 27235 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:17:55 ctl02 nova-api[27235]: 2017-09-28 12:17:55.461 27235 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:17:55 ctl02 nova-api[27235]: 2017-09-28 12:17:55.461 27235 ERROR nova     max_url_len=max_url_len)
Sep 28 12:17:55 ctl02 nova-api[27235]: 2017-09-28 12:17:55.461 27235 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:17:55 ctl02 nova-api[27235]: 2017-09-28 12:17:55.461 27235 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:17:55 ctl02 nova-api[27235]: 2017-09-28 12:17:55.461 27235 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:17:55 ctl02 nova-api[27235]: 2017-09-28 12:17:55.461 27235 ERROR nova     sock.listen(backlog)
Sep 28 12:17:55 ctl02 nova-api[27235]: 2017-09-28 12:17:55.461 27235 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:17:55 ctl02 nova-api[27235]: 2017-09-28 12:17:55.461 27235 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:17:55 ctl02 nova-api[27235]: 2017-09-28 12:17:55.461 27235 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:17:55 ctl02 nova-api[27235]: 2017-09-28 12:17:55.461 27235 ERROR nova
Sep 28 12:17:55 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:17:55 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:17:55 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:17:55 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:17:55 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:17:55 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:17:55 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:17:55.895 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:17:55] "OPTIONS / HTTP/1.0" 200 134 0.000921
Sep 28 12:17:55 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:17:56 ctl02 heat-api[13008]: 2017-09-28 12:17:56.627 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:17:56] "OPTIONS / HTTP/1.0" 200 134 0.000616
Sep 28 12:17:57 ctl02 nova-api[27253]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:17:57 ctl02 nova-api[27253]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:17:57 ctl02 nova-api[27253]: 2017-09-28 12:17:57.760 27253 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:17:57 ctl02 nova-api[27253]: 2017-09-28 12:17:57.762 27253 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:17:57 ctl02 nova-api[27253]: 2017-09-28 12:17:57.762 27253 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:17:57 ctl02 nova-api[27253]: 2017-09-28 12:17:57.762 27253 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:17:57 ctl02 nova-api[27253]: 2017-09-28 12:17:57.762 27253 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:17:57 ctl02 nova-api[27253]: 2017-09-28 12:17:57.762 27253 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:17:57 ctl02 nova-api[27253]: 2017-09-28 12:17:57.762 27253 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:17:57 ctl02 nova-api[27253]: 2017-09-28 12:17:57.762 27253 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:17:57 ctl02 nova-api[27253]: 2017-09-28 12:17:57.762 27253 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:17:57 ctl02 nova-api[27253]: 2017-09-28 12:17:57.762 27253 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:17:57 ctl02 nova-api[27253]: 2017-09-28 12:17:57.762 27253 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:17:57 ctl02 nova-api[27253]: 2017-09-28 12:17:57.762 27253 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:17:57 ctl02 nova-api[27253]: 2017-09-28 12:17:57.762 27253 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:17:57 ctl02 nova-api[27253]: 2017-09-28 12:17:57.762 27253 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:17:57 ctl02 nova-api[27253]: 2017-09-28 12:17:57.762 27253 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:17:57 ctl02 nova-api[27253]: 2017-09-28 12:17:57.762 27253 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:17:57 ctl02 nova-api[27253]: 2017-09-28 12:17:57.762 27253 ERROR nova.wsgi     self.filename))
Sep 28 12:17:57 ctl02 nova-api[27253]: 2017-09-28 12:17:57.762 27253 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:17:57 ctl02 nova-api[27253]: 2017-09-28 12:17:57.762 27253 ERROR nova.wsgi
Sep 28 12:17:57 ctl02 nova-api[27253]: 2017-09-28 12:17:57.763 27253 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:17:57 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:17:57.887 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:17:57] "OPTIONS / HTTP/1.0" 200 134 0.000470
Sep 28 12:17:57 ctl02 nova-api[27253]: 2017-09-28 12:17:57.897 27253 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:17:58 ctl02 nova-api[27253]: 2017-09-28 12:17:58.147 27253 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:17:58 ctl02 nova-api[27253]: 2017-09-28 12:17:58.150 27253 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:17:58 ctl02 nova-api[27253]: 2017-09-28 12:17:58.150 27253 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:17:58 ctl02 nova-api[27253]: 2017-09-28 12:17:58.150 27253 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:17:58 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf825d77c)
Sep 28 12:17:58 ctl02 nova-api[27253]: 2017-09-28 12:17:58.283 27253 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:17:58 ctl02 nova-api[27253]: 2017-09-28 12:17:58.285 27253 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:17:58 ctl02 nova-api[27253]: 2017-09-28 12:17:58.285 27253 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:17:58 ctl02 nova-api[27253]: 2017-09-28 12:17:58.286 27253 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:17:58 ctl02 nova-api[27253]: 2017-09-28 12:17:58.289 27253 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:17:58 ctl02 nova-api[27253]: 2017-09-28 12:17:58.289 27253 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:17:58 ctl02 nova-api[27253]: 2017-09-28 12:17:58.289 27253 ERROR nova Traceback (most recent call last):
Sep 28 12:17:58 ctl02 nova-api[27253]: 2017-09-28 12:17:58.289 27253 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:17:58 ctl02 nova-api[27253]: 2017-09-28 12:17:58.289 27253 ERROR nova     sys.exit(main())
Sep 28 12:17:58 ctl02 nova-api[27253]: 2017-09-28 12:17:58.289 27253 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:17:58 ctl02 nova-api[27253]: 2017-09-28 12:17:58.289 27253 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:17:58 ctl02 nova-api[27253]: 2017-09-28 12:17:58.289 27253 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:17:58 ctl02 nova-api[27253]: 2017-09-28 12:17:58.289 27253 ERROR nova     max_url_len=max_url_len)
Sep 28 12:17:58 ctl02 nova-api[27253]: 2017-09-28 12:17:58.289 27253 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:17:58 ctl02 nova-api[27253]: 2017-09-28 12:17:58.289 27253 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:17:58 ctl02 nova-api[27253]: 2017-09-28 12:17:58.289 27253 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:17:58 ctl02 nova-api[27253]: 2017-09-28 12:17:58.289 27253 ERROR nova     sock.listen(backlog)
Sep 28 12:17:58 ctl02 nova-api[27253]: 2017-09-28 12:17:58.289 27253 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:17:58 ctl02 nova-api[27253]: 2017-09-28 12:17:58.289 27253 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:17:58 ctl02 nova-api[27253]: 2017-09-28 12:17:58.289 27253 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:17:58 ctl02 nova-api[27253]: 2017-09-28 12:17:58.289 27253 ERROR nova
Sep 28 12:17:58 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:17:58 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:17:58 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:17:58 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:17:58 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:17:58 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:17:58 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:17:59 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf825d77c)
Sep 28 12:17:59 ctl02 heat-api[13008]: 2017-09-28 12:17:59.679 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:17:59] "OPTIONS / HTTP/1.0" 200 134 0.000625
Sep 28 12:17:59 ctl02 heat-api-cfn[13300]: 2017-09-28 12:17:59.726 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:17:59] "OPTIONS / HTTP/1.0" 200 134 0.000545
Sep 28 12:18:00 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf825d77c)
Sep 28 12:18:00 ctl02 nova-api[27271]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:18:00 ctl02 nova-api[27271]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:18:00 ctl02 heat-api-cfn[13300]: 2017-09-28 12:18:00.435 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:18:00] "OPTIONS / HTTP/1.0" 200 134 0.000558
Sep 28 12:18:00 ctl02 nova-api[27271]: 2017-09-28 12:18:00.475 27271 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:18:00 ctl02 nova-api[27271]: 2017-09-28 12:18:00.477 27271 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:18:00 ctl02 nova-api[27271]: 2017-09-28 12:18:00.477 27271 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:18:00 ctl02 nova-api[27271]: 2017-09-28 12:18:00.477 27271 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:18:00 ctl02 nova-api[27271]: 2017-09-28 12:18:00.477 27271 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:18:00 ctl02 nova-api[27271]: 2017-09-28 12:18:00.477 27271 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:18:00 ctl02 nova-api[27271]: 2017-09-28 12:18:00.477 27271 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:18:00 ctl02 nova-api[27271]: 2017-09-28 12:18:00.477 27271 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:18:00 ctl02 nova-api[27271]: 2017-09-28 12:18:00.477 27271 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:18:00 ctl02 nova-api[27271]: 2017-09-28 12:18:00.477 27271 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:18:00 ctl02 nova-api[27271]: 2017-09-28 12:18:00.477 27271 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:18:00 ctl02 nova-api[27271]: 2017-09-28 12:18:00.477 27271 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:18:00 ctl02 nova-api[27271]: 2017-09-28 12:18:00.477 27271 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:18:00 ctl02 nova-api[27271]: 2017-09-28 12:18:00.477 27271 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:18:00 ctl02 nova-api[27271]: 2017-09-28 12:18:00.477 27271 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:18:00 ctl02 nova-api[27271]: 2017-09-28 12:18:00.477 27271 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:18:00 ctl02 nova-api[27271]: 2017-09-28 12:18:00.477 27271 ERROR nova.wsgi     self.filename))
Sep 28 12:18:00 ctl02 nova-api[27271]: 2017-09-28 12:18:00.477 27271 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:18:00 ctl02 nova-api[27271]: 2017-09-28 12:18:00.477 27271 ERROR nova.wsgi
Sep 28 12:18:00 ctl02 nova-api[27271]: 2017-09-28 12:18:00.478 27271 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:18:00 ctl02 glance-api[29183]: 2017-09-28 12:18:00.554 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:18:00] "OPTIONS / HTTP/1.0" 200 134 0.000834
Sep 28 12:18:00 ctl02 nova-api[27271]: 2017-09-28 12:18:00.614 27271 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:18:00 ctl02 nova-api[27271]: 2017-09-28 12:18:00.865 27271 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:18:00 ctl02 nova-api[27271]: 2017-09-28 12:18:00.868 27271 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:18:00 ctl02 nova-api[27271]: 2017-09-28 12:18:00.868 27271 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:18:00 ctl02 nova-api[27271]: 2017-09-28 12:18:00.868 27271 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:18:01 ctl02 nova-api[27271]: 2017-09-28 12:18:01.001 27271 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:18:01 ctl02 nova-api[27271]: 2017-09-28 12:18:01.003 27271 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:18:01 ctl02 nova-api[27271]: 2017-09-28 12:18:01.003 27271 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:18:01 ctl02 nova-api[27271]: 2017-09-28 12:18:01.003 27271 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:18:01 ctl02 nova-api[27271]: 2017-09-28 12:18:01.007 27271 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:18:01 ctl02 nova-api[27271]: 2017-09-28 12:18:01.007 27271 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:18:01 ctl02 nova-api[27271]: 2017-09-28 12:18:01.007 27271 ERROR nova Traceback (most recent call last):
Sep 28 12:18:01 ctl02 nova-api[27271]: 2017-09-28 12:18:01.007 27271 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:18:01 ctl02 nova-api[27271]: 2017-09-28 12:18:01.007 27271 ERROR nova     sys.exit(main())
Sep 28 12:18:01 ctl02 nova-api[27271]: 2017-09-28 12:18:01.007 27271 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:18:01 ctl02 nova-api[27271]: 2017-09-28 12:18:01.007 27271 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:18:01 ctl02 nova-api[27271]: 2017-09-28 12:18:01.007 27271 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:18:01 ctl02 nova-api[27271]: 2017-09-28 12:18:01.007 27271 ERROR nova     max_url_len=max_url_len)
Sep 28 12:18:01 ctl02 nova-api[27271]: 2017-09-28 12:18:01.007 27271 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:18:01 ctl02 nova-api[27271]: 2017-09-28 12:18:01.007 27271 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:18:01 ctl02 nova-api[27271]: 2017-09-28 12:18:01.007 27271 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:18:01 ctl02 nova-api[27271]: 2017-09-28 12:18:01.007 27271 ERROR nova     sock.listen(backlog)
Sep 28 12:18:01 ctl02 nova-api[27271]: 2017-09-28 12:18:01.007 27271 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:18:01 ctl02 nova-api[27271]: 2017-09-28 12:18:01.007 27271 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:18:01 ctl02 nova-api[27271]: 2017-09-28 12:18:01.007 27271 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:18:01 ctl02 nova-api[27271]: 2017-09-28 12:18:01.007 27271 ERROR nova
Sep 28 12:18:01 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:18:01 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:18:01 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:18:01 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf825d77c)
Sep 28 12:18:01 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:18:01 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:18:01 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:18:01 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:18:01 ctl02 heat-api-cfn[13300]: 2017-09-28 12:18:01.873 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:18:01] "OPTIONS / HTTP/1.0" 200 134 0.000538
Sep 28 12:18:02 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf825d77c)
Sep 28 12:18:02 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:18:02.310 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:18:02] "OPTIONS / HTTP/1.0" 200 134 0.000456
Sep 28 12:18:02 ctl02 glance-api[29183]: 2017-09-28 12:18:02.530 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:18:02] "OPTIONS / HTTP/1.0" 200 134 0.000878
Sep 28 12:18:03 ctl02 nova-api[27289]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:18:03 ctl02 nova-api[27289]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:18:03 ctl02 nova-api[27289]: 2017-09-28 12:18:03.248 27289 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:18:03 ctl02 nova-api[27289]: 2017-09-28 12:18:03.250 27289 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:18:03 ctl02 nova-api[27289]: 2017-09-28 12:18:03.250 27289 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:18:03 ctl02 nova-api[27289]: 2017-09-28 12:18:03.250 27289 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:18:03 ctl02 nova-api[27289]: 2017-09-28 12:18:03.250 27289 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:18:03 ctl02 nova-api[27289]: 2017-09-28 12:18:03.250 27289 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:18:03 ctl02 nova-api[27289]: 2017-09-28 12:18:03.250 27289 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:18:03 ctl02 nova-api[27289]: 2017-09-28 12:18:03.250 27289 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:18:03 ctl02 nova-api[27289]: 2017-09-28 12:18:03.250 27289 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:18:03 ctl02 nova-api[27289]: 2017-09-28 12:18:03.250 27289 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:18:03 ctl02 nova-api[27289]: 2017-09-28 12:18:03.250 27289 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:18:03 ctl02 nova-api[27289]: 2017-09-28 12:18:03.250 27289 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:18:03 ctl02 nova-api[27289]: 2017-09-28 12:18:03.250 27289 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:18:03 ctl02 nova-api[27289]: 2017-09-28 12:18:03.250 27289 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:18:03 ctl02 nova-api[27289]: 2017-09-28 12:18:03.250 27289 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:18:03 ctl02 nova-api[27289]: 2017-09-28 12:18:03.250 27289 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:18:03 ctl02 nova-api[27289]: 2017-09-28 12:18:03.250 27289 ERROR nova.wsgi     self.filename))
Sep 28 12:18:03 ctl02 nova-api[27289]: 2017-09-28 12:18:03.250 27289 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:18:03 ctl02 nova-api[27289]: 2017-09-28 12:18:03.250 27289 ERROR nova.wsgi
Sep 28 12:18:03 ctl02 nova-api[27289]: 2017-09-28 12:18:03.253 27289 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:18:03 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf825d77c)
Sep 28 12:18:03 ctl02 nova-api[27289]: 2017-09-28 12:18:03.387 27289 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:18:03 ctl02 nova-api[27289]: 2017-09-28 12:18:03.642 27289 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:18:03 ctl02 nova-api[27289]: 2017-09-28 12:18:03.645 27289 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:18:03 ctl02 glance-api[29183]: 2017-09-28 12:18:03.645 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:18:03] "OPTIONS / HTTP/1.0" 200 134 0.000904
Sep 28 12:18:03 ctl02 nova-api[27289]: 2017-09-28 12:18:03.646 27289 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:18:03 ctl02 nova-api[27289]: 2017-09-28 12:18:03.646 27289 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:18:03 ctl02 nova-api[27289]: 2017-09-28 12:18:03.782 27289 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:18:03 ctl02 nova-api[27289]: 2017-09-28 12:18:03.784 27289 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:18:03 ctl02 nova-api[27289]: 2017-09-28 12:18:03.784 27289 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:18:03 ctl02 nova-api[27289]: 2017-09-28 12:18:03.784 27289 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:18:03 ctl02 nova-api[27289]: 2017-09-28 12:18:03.788 27289 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:18:03 ctl02 nova-api[27289]: 2017-09-28 12:18:03.788 27289 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:18:03 ctl02 nova-api[27289]: 2017-09-28 12:18:03.788 27289 ERROR nova Traceback (most recent call last):
Sep 28 12:18:03 ctl02 nova-api[27289]: 2017-09-28 12:18:03.788 27289 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:18:03 ctl02 nova-api[27289]: 2017-09-28 12:18:03.788 27289 ERROR nova     sys.exit(main())
Sep 28 12:18:03 ctl02 nova-api[27289]: 2017-09-28 12:18:03.788 27289 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:18:03 ctl02 nova-api[27289]: 2017-09-28 12:18:03.788 27289 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:18:03 ctl02 nova-api[27289]: 2017-09-28 12:18:03.788 27289 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:18:03 ctl02 nova-api[27289]: 2017-09-28 12:18:03.788 27289 ERROR nova     max_url_len=max_url_len)
Sep 28 12:18:03 ctl02 nova-api[27289]: 2017-09-28 12:18:03.788 27289 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:18:03 ctl02 nova-api[27289]: 2017-09-28 12:18:03.788 27289 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:18:03 ctl02 nova-api[27289]: 2017-09-28 12:18:03.788 27289 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:18:03 ctl02 nova-api[27289]: 2017-09-28 12:18:03.788 27289 ERROR nova     sock.listen(backlog)
Sep 28 12:18:03 ctl02 nova-api[27289]: 2017-09-28 12:18:03.788 27289 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:18:03 ctl02 nova-api[27289]: 2017-09-28 12:18:03.788 27289 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:18:03 ctl02 nova-api[27289]: 2017-09-28 12:18:03.788 27289 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:18:03 ctl02 nova-api[27289]: 2017-09-28 12:18:03.788 27289 ERROR nova
Sep 28 12:18:03 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:18:03 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:18:03 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:18:04 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:18:04 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:18:04 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:18:04 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:18:04 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf825d77c)
Sep 28 12:18:05 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf825d77c)
Sep 28 12:18:05 ctl02 heat-api[13008]: 2017-09-28 12:18:05.413 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:18:05] "OPTIONS / HTTP/1.0" 200 134 0.000601
Sep 28 12:18:05 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:18:05.696 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:18:05] "OPTIONS / HTTP/1.0" 200 134 0.000546
Sep 28 12:18:05 ctl02 nova-api[27307]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:18:05 ctl02 nova-api[27307]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:18:06 ctl02 nova-api[27307]: 2017-09-28 12:18:06.005 27307 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:18:06 ctl02 nova-api[27307]: 2017-09-28 12:18:06.007 27307 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:18:06 ctl02 nova-api[27307]: 2017-09-28 12:18:06.007 27307 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:18:06 ctl02 nova-api[27307]: 2017-09-28 12:18:06.007 27307 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:18:06 ctl02 nova-api[27307]: 2017-09-28 12:18:06.007 27307 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:18:06 ctl02 nova-api[27307]: 2017-09-28 12:18:06.007 27307 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:18:06 ctl02 nova-api[27307]: 2017-09-28 12:18:06.007 27307 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:18:06 ctl02 nova-api[27307]: 2017-09-28 12:18:06.007 27307 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:18:06 ctl02 nova-api[27307]: 2017-09-28 12:18:06.007 27307 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:18:06 ctl02 nova-api[27307]: 2017-09-28 12:18:06.007 27307 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:18:06 ctl02 nova-api[27307]: 2017-09-28 12:18:06.007 27307 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:18:06 ctl02 nova-api[27307]: 2017-09-28 12:18:06.007 27307 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:18:06 ctl02 nova-api[27307]: 2017-09-28 12:18:06.007 27307 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:18:06 ctl02 nova-api[27307]: 2017-09-28 12:18:06.007 27307 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:18:06 ctl02 nova-api[27307]: 2017-09-28 12:18:06.007 27307 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:18:06 ctl02 nova-api[27307]: 2017-09-28 12:18:06.007 27307 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:18:06 ctl02 nova-api[27307]: 2017-09-28 12:18:06.007 27307 ERROR nova.wsgi     self.filename))
Sep 28 12:18:06 ctl02 nova-api[27307]: 2017-09-28 12:18:06.007 27307 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:18:06 ctl02 nova-api[27307]: 2017-09-28 12:18:06.007 27307 ERROR nova.wsgi
Sep 28 12:18:06 ctl02 nova-api[27307]: 2017-09-28 12:18:06.008 27307 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:18:06 ctl02 nova-api[27307]: 2017-09-28 12:18:06.144 27307 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:18:06 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf825d77c)
Sep 28 12:18:06 ctl02 nova-api[27307]: 2017-09-28 12:18:06.400 27307 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:18:06 ctl02 nova-api[27307]: 2017-09-28 12:18:06.402 27307 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:18:06 ctl02 nova-api[27307]: 2017-09-28 12:18:06.402 27307 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:18:06 ctl02 nova-api[27307]: 2017-09-28 12:18:06.403 27307 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:18:06 ctl02 heat-api[13008]: 2017-09-28 12:18:06.439 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:18:06] "OPTIONS / HTTP/1.0" 200 134 0.000671
Sep 28 12:18:06 ctl02 nova-api[27307]: 2017-09-28 12:18:06.539 27307 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:18:06 ctl02 nova-api[27307]: 2017-09-28 12:18:06.541 27307 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:18:06 ctl02 nova-api[27307]: 2017-09-28 12:18:06.541 27307 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:18:06 ctl02 nova-api[27307]: 2017-09-28 12:18:06.542 27307 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:18:06 ctl02 nova-api[27307]: 2017-09-28 12:18:06.545 27307 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:18:06 ctl02 nova-api[27307]: 2017-09-28 12:18:06.545 27307 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:18:06 ctl02 nova-api[27307]: 2017-09-28 12:18:06.545 27307 ERROR nova Traceback (most recent call last):
Sep 28 12:18:06 ctl02 nova-api[27307]: 2017-09-28 12:18:06.545 27307 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:18:06 ctl02 nova-api[27307]: 2017-09-28 12:18:06.545 27307 ERROR nova     sys.exit(main())
Sep 28 12:18:06 ctl02 nova-api[27307]: 2017-09-28 12:18:06.545 27307 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:18:06 ctl02 nova-api[27307]: 2017-09-28 12:18:06.545 27307 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:18:06 ctl02 nova-api[27307]: 2017-09-28 12:18:06.545 27307 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:18:06 ctl02 nova-api[27307]: 2017-09-28 12:18:06.545 27307 ERROR nova     max_url_len=max_url_len)
Sep 28 12:18:06 ctl02 nova-api[27307]: 2017-09-28 12:18:06.545 27307 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:18:06 ctl02 nova-api[27307]: 2017-09-28 12:18:06.545 27307 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:18:06 ctl02 nova-api[27307]: 2017-09-28 12:18:06.545 27307 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:18:06 ctl02 nova-api[27307]: 2017-09-28 12:18:06.545 27307 ERROR nova     sock.listen(backlog)
Sep 28 12:18:06 ctl02 nova-api[27307]: 2017-09-28 12:18:06.545 27307 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:18:06 ctl02 nova-api[27307]: 2017-09-28 12:18:06.545 27307 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:18:06 ctl02 nova-api[27307]: 2017-09-28 12:18:06.545 27307 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:18:06 ctl02 nova-api[27307]: 2017-09-28 12:18:06.545 27307 ERROR nova
Sep 28 12:18:06 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:18:06 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:18:06 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:18:06 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:18:06 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:18:06 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:18:06 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:18:07 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf825d77c)
Sep 28 12:18:08 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:18:08.172 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:18:08] "OPTIONS / HTTP/1.0" 200 134 0.000665
Sep 28 12:18:08 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf825d77c)
Sep 28 12:18:08 ctl02 nova-api[27325]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:18:08 ctl02 nova-api[27325]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:18:08 ctl02 nova-api[27325]: 2017-09-28 12:18:08.722 27325 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:18:08 ctl02 nova-api[27325]: 2017-09-28 12:18:08.724 27325 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:18:08 ctl02 nova-api[27325]: 2017-09-28 12:18:08.724 27325 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:18:08 ctl02 nova-api[27325]: 2017-09-28 12:18:08.724 27325 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:18:08 ctl02 nova-api[27325]: 2017-09-28 12:18:08.724 27325 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:18:08 ctl02 nova-api[27325]: 2017-09-28 12:18:08.724 27325 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:18:08 ctl02 nova-api[27325]: 2017-09-28 12:18:08.724 27325 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:18:08 ctl02 nova-api[27325]: 2017-09-28 12:18:08.724 27325 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:18:08 ctl02 nova-api[27325]: 2017-09-28 12:18:08.724 27325 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:18:08 ctl02 nova-api[27325]: 2017-09-28 12:18:08.724 27325 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:18:08 ctl02 nova-api[27325]: 2017-09-28 12:18:08.724 27325 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:18:08 ctl02 nova-api[27325]: 2017-09-28 12:18:08.724 27325 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:18:08 ctl02 nova-api[27325]: 2017-09-28 12:18:08.724 27325 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:18:08 ctl02 nova-api[27325]: 2017-09-28 12:18:08.724 27325 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:18:08 ctl02 nova-api[27325]: 2017-09-28 12:18:08.724 27325 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:18:08 ctl02 nova-api[27325]: 2017-09-28 12:18:08.724 27325 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:18:08 ctl02 nova-api[27325]: 2017-09-28 12:18:08.724 27325 ERROR nova.wsgi     self.filename))
Sep 28 12:18:08 ctl02 nova-api[27325]: 2017-09-28 12:18:08.724 27325 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:18:08 ctl02 nova-api[27325]: 2017-09-28 12:18:08.724 27325 ERROR nova.wsgi
Sep 28 12:18:08 ctl02 nova-api[27325]: 2017-09-28 12:18:08.726 27325 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:18:08 ctl02 nova-api[27325]: 2017-09-28 12:18:08.869 27325 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:18:09 ctl02 nova-api[27325]: 2017-09-28 12:18:09.119 27325 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:18:09 ctl02 nova-api[27325]: 2017-09-28 12:18:09.122 27325 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:18:09 ctl02 nova-api[27325]: 2017-09-28 12:18:09.122 27325 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:18:09 ctl02 nova-api[27325]: 2017-09-28 12:18:09.122 27325 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:18:09 ctl02 nova-api[27325]: 2017-09-28 12:18:09.254 27325 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:18:09 ctl02 nova-api[27325]: 2017-09-28 12:18:09.257 27325 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:18:09 ctl02 nova-api[27325]: 2017-09-28 12:18:09.257 27325 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:18:09 ctl02 nova-api[27325]: 2017-09-28 12:18:09.257 27325 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:18:09 ctl02 nova-api[27325]: 2017-09-28 12:18:09.260 27325 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:18:09 ctl02 nova-api[27325]: 2017-09-28 12:18:09.261 27325 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:18:09 ctl02 nova-api[27325]: 2017-09-28 12:18:09.261 27325 ERROR nova Traceback (most recent call last):
Sep 28 12:18:09 ctl02 nova-api[27325]: 2017-09-28 12:18:09.261 27325 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:18:09 ctl02 nova-api[27325]: 2017-09-28 12:18:09.261 27325 ERROR nova     sys.exit(main())
Sep 28 12:18:09 ctl02 nova-api[27325]: 2017-09-28 12:18:09.261 27325 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:18:09 ctl02 nova-api[27325]: 2017-09-28 12:18:09.261 27325 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:18:09 ctl02 nova-api[27325]: 2017-09-28 12:18:09.261 27325 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:18:09 ctl02 nova-api[27325]: 2017-09-28 12:18:09.261 27325 ERROR nova     max_url_len=max_url_len)
Sep 28 12:18:09 ctl02 nova-api[27325]: 2017-09-28 12:18:09.261 27325 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:18:09 ctl02 nova-api[27325]: 2017-09-28 12:18:09.261 27325 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:18:09 ctl02 nova-api[27325]: 2017-09-28 12:18:09.261 27325 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:18:09 ctl02 nova-api[27325]: 2017-09-28 12:18:09.261 27325 ERROR nova     sock.listen(backlog)
Sep 28 12:18:09 ctl02 nova-api[27325]: 2017-09-28 12:18:09.261 27325 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:18:09 ctl02 nova-api[27325]: 2017-09-28 12:18:09.261 27325 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:18:09 ctl02 nova-api[27325]: 2017-09-28 12:18:09.261 27325 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:18:09 ctl02 nova-api[27325]: 2017-09-28 12:18:09.261 27325 ERROR nova
Sep 28 12:18:09 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:18:09 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:18:09 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:18:09 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:18:09 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:18:09 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:18:09 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:18:09 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:18:09 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:18:09 ctl02 heat-api-cfn[13300]: 2017-09-28 12:18:09.690 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:18:09] "OPTIONS / HTTP/1.0" 200 134 0.000521
Sep 28 12:18:09 ctl02 heat-api[13008]: 2017-09-28 12:18:09.908 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:18:09] "OPTIONS / HTTP/1.0" 200 134 0.000657
Sep 28 12:18:10 ctl02 heat-api-cfn[13300]: 2017-09-28 12:18:10.148 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:18:10] "OPTIONS / HTTP/1.0" 200 134 0.000556
Sep 28 12:18:10 ctl02 glance-api[29183]: 2017-09-28 12:18:10.441 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:18:10] "OPTIONS / HTTP/1.0" 200 134 0.000901
Sep 28 12:18:11 ctl02 nova-api[27348]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:18:11 ctl02 nova-api[27348]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:18:11 ctl02 nova-api[27348]: 2017-09-28 12:18:11.515 27348 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:18:11 ctl02 nova-api[27348]: 2017-09-28 12:18:11.517 27348 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:18:11 ctl02 nova-api[27348]: 2017-09-28 12:18:11.517 27348 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:18:11 ctl02 nova-api[27348]: 2017-09-28 12:18:11.517 27348 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:18:11 ctl02 nova-api[27348]: 2017-09-28 12:18:11.517 27348 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:18:11 ctl02 nova-api[27348]: 2017-09-28 12:18:11.517 27348 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:18:11 ctl02 nova-api[27348]: 2017-09-28 12:18:11.517 27348 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:18:11 ctl02 nova-api[27348]: 2017-09-28 12:18:11.517 27348 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:18:11 ctl02 nova-api[27348]: 2017-09-28 12:18:11.517 27348 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:18:11 ctl02 nova-api[27348]: 2017-09-28 12:18:11.517 27348 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:18:11 ctl02 nova-api[27348]: 2017-09-28 12:18:11.517 27348 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:18:11 ctl02 nova-api[27348]: 2017-09-28 12:18:11.517 27348 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:18:11 ctl02 nova-api[27348]: 2017-09-28 12:18:11.517 27348 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:18:11 ctl02 nova-api[27348]: 2017-09-28 12:18:11.517 27348 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:18:11 ctl02 nova-api[27348]: 2017-09-28 12:18:11.517 27348 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:18:11 ctl02 nova-api[27348]: 2017-09-28 12:18:11.517 27348 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:18:11 ctl02 nova-api[27348]: 2017-09-28 12:18:11.517 27348 ERROR nova.wsgi     self.filename))
Sep 28 12:18:11 ctl02 nova-api[27348]: 2017-09-28 12:18:11.517 27348 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:18:11 ctl02 nova-api[27348]: 2017-09-28 12:18:11.517 27348 ERROR nova.wsgi
Sep 28 12:18:11 ctl02 nova-api[27348]: 2017-09-28 12:18:11.518 27348 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:18:11 ctl02 nova-api[27348]: 2017-09-28 12:18:11.653 27348 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:18:11 ctl02 heat-api-cfn[13300]: 2017-09-28 12:18:11.745 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:18:11] "OPTIONS / HTTP/1.0" 200 134 0.000550
Sep 28 12:18:11 ctl02 nova-api[27348]: 2017-09-28 12:18:11.902 27348 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:18:11 ctl02 nova-api[27348]: 2017-09-28 12:18:11.905 27348 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:18:11 ctl02 nova-api[27348]: 2017-09-28 12:18:11.905 27348 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:18:11 ctl02 nova-api[27348]: 2017-09-28 12:18:11.905 27348 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:18:12 ctl02 nova-api[27348]: 2017-09-28 12:18:12.037 27348 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:18:12 ctl02 nova-api[27348]: 2017-09-28 12:18:12.039 27348 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:18:12 ctl02 nova-api[27348]: 2017-09-28 12:18:12.040 27348 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:18:12 ctl02 nova-api[27348]: 2017-09-28 12:18:12.040 27348 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:18:12 ctl02 nova-api[27348]: 2017-09-28 12:18:12.043 27348 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:18:12 ctl02 nova-api[27348]: 2017-09-28 12:18:12.044 27348 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:18:12 ctl02 nova-api[27348]: 2017-09-28 12:18:12.044 27348 ERROR nova Traceback (most recent call last):
Sep 28 12:18:12 ctl02 nova-api[27348]: 2017-09-28 12:18:12.044 27348 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:18:12 ctl02 nova-api[27348]: 2017-09-28 12:18:12.044 27348 ERROR nova     sys.exit(main())
Sep 28 12:18:12 ctl02 nova-api[27348]: 2017-09-28 12:18:12.044 27348 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:18:12 ctl02 nova-api[27348]: 2017-09-28 12:18:12.044 27348 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:18:12 ctl02 nova-api[27348]: 2017-09-28 12:18:12.044 27348 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:18:12 ctl02 nova-api[27348]: 2017-09-28 12:18:12.044 27348 ERROR nova     max_url_len=max_url_len)
Sep 28 12:18:12 ctl02 nova-api[27348]: 2017-09-28 12:18:12.044 27348 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:18:12 ctl02 nova-api[27348]: 2017-09-28 12:18:12.044 27348 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:18:12 ctl02 nova-api[27348]: 2017-09-28 12:18:12.044 27348 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:18:12 ctl02 nova-api[27348]: 2017-09-28 12:18:12.044 27348 ERROR nova     sock.listen(backlog)
Sep 28 12:18:12 ctl02 nova-api[27348]: 2017-09-28 12:18:12.044 27348 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:18:12 ctl02 nova-api[27348]: 2017-09-28 12:18:12.044 27348 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:18:12 ctl02 nova-api[27348]: 2017-09-28 12:18:12.044 27348 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:18:12 ctl02 nova-api[27348]: 2017-09-28 12:18:12.044 27348 ERROR nova
Sep 28 12:18:12 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:18:12 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:18:12 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:18:12 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:18:12 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:18:12 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:18:12.388 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:18:12] "OPTIONS / HTTP/1.0" 200 134 0.000545
Sep 28 12:18:12 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:18:12 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:18:12 ctl02 glance-api[29183]: 2017-09-28 12:18:12.787 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:18:12] "OPTIONS / HTTP/1.0" 200 134 0.000791
Sep 28 12:18:12 ctl02 nova-cert[4860]: 2017-09-28 12:18:12.933 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:18:13 ctl02 glance-api[29183]: 2017-09-28 12:18:13.818 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:18:13] "OPTIONS / HTTP/1.0" 200 134 0.000715
Sep 28 12:18:14 ctl02 nova-api[27366]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:18:14 ctl02 nova-api[27366]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:18:14 ctl02 nova-api[27366]: 2017-09-28 12:18:14.241 27366 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:18:14 ctl02 nova-api[27366]: 2017-09-28 12:18:14.242 27366 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:18:14 ctl02 nova-api[27366]: 2017-09-28 12:18:14.242 27366 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:18:14 ctl02 nova-api[27366]: 2017-09-28 12:18:14.242 27366 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:18:14 ctl02 nova-api[27366]: 2017-09-28 12:18:14.242 27366 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:18:14 ctl02 nova-api[27366]: 2017-09-28 12:18:14.242 27366 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:18:14 ctl02 nova-api[27366]: 2017-09-28 12:18:14.242 27366 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:18:14 ctl02 nova-api[27366]: 2017-09-28 12:18:14.242 27366 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:18:14 ctl02 nova-api[27366]: 2017-09-28 12:18:14.242 27366 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:18:14 ctl02 nova-api[27366]: 2017-09-28 12:18:14.242 27366 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:18:14 ctl02 nova-api[27366]: 2017-09-28 12:18:14.242 27366 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:18:14 ctl02 nova-api[27366]: 2017-09-28 12:18:14.242 27366 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:18:14 ctl02 nova-api[27366]: 2017-09-28 12:18:14.242 27366 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:18:14 ctl02 nova-api[27366]: 2017-09-28 12:18:14.242 27366 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:18:14 ctl02 nova-api[27366]: 2017-09-28 12:18:14.242 27366 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:18:14 ctl02 nova-api[27366]: 2017-09-28 12:18:14.242 27366 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:18:14 ctl02 nova-api[27366]: 2017-09-28 12:18:14.242 27366 ERROR nova.wsgi     self.filename))
Sep 28 12:18:14 ctl02 nova-api[27366]: 2017-09-28 12:18:14.242 27366 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:18:14 ctl02 nova-api[27366]: 2017-09-28 12:18:14.242 27366 ERROR nova.wsgi
Sep 28 12:18:14 ctl02 nova-api[27366]: 2017-09-28 12:18:14.243 27366 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:18:14 ctl02 nova-api[27366]: 2017-09-28 12:18:14.373 27366 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:18:14 ctl02 nova-conductor[5056]: 2017-09-28 12:18:14.540 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:18:14 ctl02 nova-conductor[5056]: 2017-09-28 12:18:14.555 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:18:14 ctl02 nova-conductor[5056]: 2017-09-28 12:18:14.558 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:18:14 ctl02 nova-conductor[5056]: 2017-09-28 12:18:14.559 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:18:14 ctl02 nova-api[27366]: 2017-09-28 12:18:14.611 27366 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:18:14 ctl02 nova-api[27366]: 2017-09-28 12:18:14.613 27366 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:18:14 ctl02 nova-api[27366]: 2017-09-28 12:18:14.613 27366 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:18:14 ctl02 nova-api[27366]: 2017-09-28 12:18:14.613 27366 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:18:14 ctl02 nova-api[27366]: 2017-09-28 12:18:14.745 27366 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:18:14 ctl02 nova-api[27366]: 2017-09-28 12:18:14.747 27366 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:18:14 ctl02 nova-api[27366]: 2017-09-28 12:18:14.747 27366 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:18:14 ctl02 nova-api[27366]: 2017-09-28 12:18:14.747 27366 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:18:14 ctl02 nova-api[27366]: 2017-09-28 12:18:14.750 27366 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:18:14 ctl02 nova-api[27366]: 2017-09-28 12:18:14.751 27366 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:18:14 ctl02 nova-api[27366]: 2017-09-28 12:18:14.751 27366 ERROR nova Traceback (most recent call last):
Sep 28 12:18:14 ctl02 nova-api[27366]: 2017-09-28 12:18:14.751 27366 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:18:14 ctl02 nova-api[27366]: 2017-09-28 12:18:14.751 27366 ERROR nova     sys.exit(main())
Sep 28 12:18:14 ctl02 nova-api[27366]: 2017-09-28 12:18:14.751 27366 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:18:14 ctl02 nova-api[27366]: 2017-09-28 12:18:14.751 27366 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:18:14 ctl02 nova-api[27366]: 2017-09-28 12:18:14.751 27366 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:18:14 ctl02 nova-api[27366]: 2017-09-28 12:18:14.751 27366 ERROR nova     max_url_len=max_url_len)
Sep 28 12:18:14 ctl02 nova-api[27366]: 2017-09-28 12:18:14.751 27366 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:18:14 ctl02 nova-api[27366]: 2017-09-28 12:18:14.751 27366 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:18:14 ctl02 nova-api[27366]: 2017-09-28 12:18:14.751 27366 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:18:14 ctl02 nova-api[27366]: 2017-09-28 12:18:14.751 27366 ERROR nova     sock.listen(backlog)
Sep 28 12:18:14 ctl02 nova-api[27366]: 2017-09-28 12:18:14.751 27366 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:18:14 ctl02 nova-api[27366]: 2017-09-28 12:18:14.751 27366 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:18:14 ctl02 nova-api[27366]: 2017-09-28 12:18:14.751 27366 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:18:14 ctl02 nova-api[27366]: 2017-09-28 12:18:14.751 27366 ERROR nova
Sep 28 12:18:14 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:18:14 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:18:14 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:18:15 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:18:15 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:18:15 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:18:15 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:18:15 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:18:15.400 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:18:15] "OPTIONS / HTTP/1.0" 200 134 0.000417
Sep 28 12:18:15 ctl02 heat-api[13008]: 2017-09-28 12:18:15.723 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:18:15] "OPTIONS / HTTP/1.0" 200 134 0.000530
Sep 28 12:18:16 ctl02 heat-api[13008]: 2017-09-28 12:18:16.311 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:18:16] "OPTIONS / HTTP/1.0" 200 134 0.000532
Sep 28 12:18:16 ctl02 nova-api[27384]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:18:16 ctl02 nova-api[27384]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:18:16 ctl02 nova-api[27384]: 2017-09-28 12:18:16.978 27384 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:18:16 ctl02 nova-api[27384]: 2017-09-28 12:18:16.980 27384 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:18:16 ctl02 nova-api[27384]: 2017-09-28 12:18:16.980 27384 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:18:16 ctl02 nova-api[27384]: 2017-09-28 12:18:16.980 27384 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:18:16 ctl02 nova-api[27384]: 2017-09-28 12:18:16.980 27384 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:18:16 ctl02 nova-api[27384]: 2017-09-28 12:18:16.980 27384 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:18:16 ctl02 nova-api[27384]: 2017-09-28 12:18:16.980 27384 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:18:16 ctl02 nova-api[27384]: 2017-09-28 12:18:16.980 27384 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:18:16 ctl02 nova-api[27384]: 2017-09-28 12:18:16.980 27384 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:18:16 ctl02 nova-api[27384]: 2017-09-28 12:18:16.980 27384 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:18:16 ctl02 nova-api[27384]: 2017-09-28 12:18:16.980 27384 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:18:16 ctl02 nova-api[27384]: 2017-09-28 12:18:16.980 27384 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:18:16 ctl02 nova-api[27384]: 2017-09-28 12:18:16.980 27384 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:18:16 ctl02 nova-api[27384]: 2017-09-28 12:18:16.980 27384 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:18:16 ctl02 nova-api[27384]: 2017-09-28 12:18:16.980 27384 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:18:16 ctl02 nova-api[27384]: 2017-09-28 12:18:16.980 27384 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:18:16 ctl02 nova-api[27384]: 2017-09-28 12:18:16.980 27384 ERROR nova.wsgi     self.filename))
Sep 28 12:18:16 ctl02 nova-api[27384]: 2017-09-28 12:18:16.980 27384 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:18:16 ctl02 nova-api[27384]: 2017-09-28 12:18:16.980 27384 ERROR nova.wsgi
Sep 28 12:18:16 ctl02 nova-api[27384]: 2017-09-28 12:18:16.981 27384 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:18:17 ctl02 nova-api[27384]: 2017-09-28 12:18:17.113 27384 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:18:17 ctl02 nova-api[27384]: 2017-09-28 12:18:17.366 27384 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:18:17 ctl02 nova-api[27384]: 2017-09-28 12:18:17.369 27384 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:18:17 ctl02 nova-api[27384]: 2017-09-28 12:18:17.369 27384 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:18:17 ctl02 nova-api[27384]: 2017-09-28 12:18:17.369 27384 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:18:17 ctl02 nova-api[27384]: 2017-09-28 12:18:17.502 27384 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:18:17 ctl02 nova-api[27384]: 2017-09-28 12:18:17.504 27384 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:18:17 ctl02 nova-api[27384]: 2017-09-28 12:18:17.504 27384 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:18:17 ctl02 nova-api[27384]: 2017-09-28 12:18:17.505 27384 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:18:17 ctl02 nova-api[27384]: 2017-09-28 12:18:17.508 27384 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:18:17 ctl02 nova-api[27384]: 2017-09-28 12:18:17.508 27384 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:18:17 ctl02 nova-api[27384]: 2017-09-28 12:18:17.508 27384 ERROR nova Traceback (most recent call last):
Sep 28 12:18:17 ctl02 nova-api[27384]: 2017-09-28 12:18:17.508 27384 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:18:17 ctl02 nova-api[27384]: 2017-09-28 12:18:17.508 27384 ERROR nova     sys.exit(main())
Sep 28 12:18:17 ctl02 nova-api[27384]: 2017-09-28 12:18:17.508 27384 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:18:17 ctl02 nova-api[27384]: 2017-09-28 12:18:17.508 27384 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:18:17 ctl02 nova-api[27384]: 2017-09-28 12:18:17.508 27384 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:18:17 ctl02 nova-api[27384]: 2017-09-28 12:18:17.508 27384 ERROR nova     max_url_len=max_url_len)
Sep 28 12:18:17 ctl02 nova-api[27384]: 2017-09-28 12:18:17.508 27384 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:18:17 ctl02 nova-api[27384]: 2017-09-28 12:18:17.508 27384 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:18:17 ctl02 nova-api[27384]: 2017-09-28 12:18:17.508 27384 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:18:17 ctl02 nova-api[27384]: 2017-09-28 12:18:17.508 27384 ERROR nova     sock.listen(backlog)
Sep 28 12:18:17 ctl02 nova-api[27384]: 2017-09-28 12:18:17.508 27384 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:18:17 ctl02 nova-api[27384]: 2017-09-28 12:18:17.508 27384 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:18:17 ctl02 nova-api[27384]: 2017-09-28 12:18:17.508 27384 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:18:17 ctl02 nova-api[27384]: 2017-09-28 12:18:17.508 27384 ERROR nova
Sep 28 12:18:17 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:18:17 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:18:17 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:18:17 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:18:17 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:18:17 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:18:17 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:18:18 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:18:18.562 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:18:18] "OPTIONS / HTTP/1.0" 200 134 0.000504
Sep 28 12:18:18 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb66c542d)
Sep 28 12:18:19 ctl02 heat-api-cfn[13300]: 2017-09-28 12:18:19.429 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:18:19] "OPTIONS / HTTP/1.0" 200 134 0.000580
Sep 28 12:18:19 ctl02 nova-api[27402]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:18:19 ctl02 nova-api[27402]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:18:19 ctl02 heat-api[13008]: 2017-09-28 12:18:19.596 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:18:19] "OPTIONS / HTTP/1.0" 200 134 0.000661
Sep 28 12:18:19 ctl02 nova-api[27402]: 2017-09-28 12:18:19.745 27402 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:18:19 ctl02 nova-api[27402]: 2017-09-28 12:18:19.747 27402 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:18:19 ctl02 nova-api[27402]: 2017-09-28 12:18:19.747 27402 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:18:19 ctl02 nova-api[27402]: 2017-09-28 12:18:19.747 27402 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:18:19 ctl02 nova-api[27402]: 2017-09-28 12:18:19.747 27402 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:18:19 ctl02 nova-api[27402]: 2017-09-28 12:18:19.747 27402 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:18:19 ctl02 nova-api[27402]: 2017-09-28 12:18:19.747 27402 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:18:19 ctl02 nova-api[27402]: 2017-09-28 12:18:19.747 27402 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:18:19 ctl02 nova-api[27402]: 2017-09-28 12:18:19.747 27402 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:18:19 ctl02 nova-api[27402]: 2017-09-28 12:18:19.747 27402 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:18:19 ctl02 nova-api[27402]: 2017-09-28 12:18:19.747 27402 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:18:19 ctl02 nova-api[27402]: 2017-09-28 12:18:19.747 27402 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:18:19 ctl02 nova-api[27402]: 2017-09-28 12:18:19.747 27402 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:18:19 ctl02 nova-api[27402]: 2017-09-28 12:18:19.747 27402 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:18:19 ctl02 nova-api[27402]: 2017-09-28 12:18:19.747 27402 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:18:19 ctl02 nova-api[27402]: 2017-09-28 12:18:19.747 27402 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:18:19 ctl02 nova-api[27402]: 2017-09-28 12:18:19.747 27402 ERROR nova.wsgi     self.filename))
Sep 28 12:18:19 ctl02 nova-api[27402]: 2017-09-28 12:18:19.747 27402 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:18:19 ctl02 nova-api[27402]: 2017-09-28 12:18:19.747 27402 ERROR nova.wsgi
Sep 28 12:18:19 ctl02 nova-api[27402]: 2017-09-28 12:18:19.750 27402 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:18:19 ctl02 nova-api[27402]: 2017-09-28 12:18:19.893 27402 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:18:19 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb66c542d)
Sep 28 12:18:20 ctl02 nova-api[27402]: 2017-09-28 12:18:20.123 27402 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:18:20 ctl02 nova-api[27402]: 2017-09-28 12:18:20.125 27402 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:18:20 ctl02 nova-api[27402]: 2017-09-28 12:18:20.125 27402 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:18:20 ctl02 nova-api[27402]: 2017-09-28 12:18:20.126 27402 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:18:20 ctl02 heat-api-cfn[13300]: 2017-09-28 12:18:20.190 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:18:20] "OPTIONS / HTTP/1.0" 200 134 0.000446
Sep 28 12:18:20 ctl02 nova-api[27402]: 2017-09-28 12:18:20.259 27402 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:18:20 ctl02 nova-api[27402]: 2017-09-28 12:18:20.262 27402 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:18:20 ctl02 nova-api[27402]: 2017-09-28 12:18:20.262 27402 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:18:20 ctl02 nova-api[27402]: 2017-09-28 12:18:20.263 27402 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:18:20 ctl02 nova-api[27402]: 2017-09-28 12:18:20.267 27402 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:18:20 ctl02 nova-api[27402]: 2017-09-28 12:18:20.267 27402 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:18:20 ctl02 nova-api[27402]: 2017-09-28 12:18:20.267 27402 ERROR nova Traceback (most recent call last):
Sep 28 12:18:20 ctl02 nova-api[27402]: 2017-09-28 12:18:20.267 27402 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:18:20 ctl02 nova-api[27402]: 2017-09-28 12:18:20.267 27402 ERROR nova     sys.exit(main())
Sep 28 12:18:20 ctl02 nova-api[27402]: 2017-09-28 12:18:20.267 27402 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:18:20 ctl02 nova-api[27402]: 2017-09-28 12:18:20.267 27402 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:18:20 ctl02 nova-api[27402]: 2017-09-28 12:18:20.267 27402 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:18:20 ctl02 nova-api[27402]: 2017-09-28 12:18:20.267 27402 ERROR nova     max_url_len=max_url_len)
Sep 28 12:18:20 ctl02 nova-api[27402]: 2017-09-28 12:18:20.267 27402 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:18:20 ctl02 nova-api[27402]: 2017-09-28 12:18:20.267 27402 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:18:20 ctl02 nova-api[27402]: 2017-09-28 12:18:20.267 27402 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:18:20 ctl02 nova-api[27402]: 2017-09-28 12:18:20.267 27402 ERROR nova     sock.listen(backlog)
Sep 28 12:18:20 ctl02 nova-api[27402]: 2017-09-28 12:18:20.267 27402 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:18:20 ctl02 nova-api[27402]: 2017-09-28 12:18:20.267 27402 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:18:20 ctl02 nova-api[27402]: 2017-09-28 12:18:20.267 27402 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:18:20 ctl02 nova-api[27402]: 2017-09-28 12:18:20.267 27402 ERROR nova
Sep 28 12:18:20 ctl02 glance-api[29183]: 2017-09-28 12:18:20.291 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:18:20] "OPTIONS / HTTP/1.0" 200 134 0.000683
Sep 28 12:18:20 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:18:20 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:18:20 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:18:20 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:18:20 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:18:20 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:18:20 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:18:20 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb66c542d)
Sep 28 12:18:21 ctl02 heat-api-cfn[13300]: 2017-09-28 12:18:21.626 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:18:21] "OPTIONS / HTTP/1.0" 200 134 0.000580
Sep 28 12:18:21 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb66c542d)
Sep 28 12:18:22 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:18:22.033 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:18:22] "OPTIONS / HTTP/1.0" 200 134 0.000393
Sep 28 12:18:22 ctl02 nova-api[27420]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:18:22 ctl02 nova-api[27420]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:18:22 ctl02 nova-api[27420]: 2017-09-28 12:18:22.506 27420 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:18:22 ctl02 nova-api[27420]: 2017-09-28 12:18:22.508 27420 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:18:22 ctl02 nova-api[27420]: 2017-09-28 12:18:22.508 27420 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:18:22 ctl02 nova-api[27420]: 2017-09-28 12:18:22.508 27420 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:18:22 ctl02 nova-api[27420]: 2017-09-28 12:18:22.508 27420 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:18:22 ctl02 nova-api[27420]: 2017-09-28 12:18:22.508 27420 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:18:22 ctl02 nova-api[27420]: 2017-09-28 12:18:22.508 27420 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:18:22 ctl02 nova-api[27420]: 2017-09-28 12:18:22.508 27420 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:18:22 ctl02 nova-api[27420]: 2017-09-28 12:18:22.508 27420 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:18:22 ctl02 nova-api[27420]: 2017-09-28 12:18:22.508 27420 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:18:22 ctl02 nova-api[27420]: 2017-09-28 12:18:22.508 27420 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:18:22 ctl02 nova-api[27420]: 2017-09-28 12:18:22.508 27420 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:18:22 ctl02 nova-api[27420]: 2017-09-28 12:18:22.508 27420 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:18:22 ctl02 nova-api[27420]: 2017-09-28 12:18:22.508 27420 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:18:22 ctl02 nova-api[27420]: 2017-09-28 12:18:22.508 27420 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:18:22 ctl02 nova-api[27420]: 2017-09-28 12:18:22.508 27420 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:18:22 ctl02 nova-api[27420]: 2017-09-28 12:18:22.508 27420 ERROR nova.wsgi     self.filename))
Sep 28 12:18:22 ctl02 nova-api[27420]: 2017-09-28 12:18:22.508 27420 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:18:22 ctl02 nova-api[27420]: 2017-09-28 12:18:22.508 27420 ERROR nova.wsgi
Sep 28 12:18:22 ctl02 nova-api[27420]: 2017-09-28 12:18:22.511 27420 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:18:22 ctl02 nova-api[27420]: 2017-09-28 12:18:22.646 27420 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:18:22 ctl02 nova-consoleauth[5433]: 2017-09-28 12:18:22.812 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:18:22 ctl02 nova-api[27420]: 2017-09-28 12:18:22.883 27420 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:18:22 ctl02 nova-api[27420]: 2017-09-28 12:18:22.886 27420 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:18:22 ctl02 nova-api[27420]: 2017-09-28 12:18:22.886 27420 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:18:22 ctl02 nova-api[27420]: 2017-09-28 12:18:22.886 27420 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:18:22 ctl02 glance-api[29183]: 2017-09-28 12:18:22.915 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:18:22] "OPTIONS / HTTP/1.0" 200 134 0.000622
Sep 28 12:18:22 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb66c542d)
Sep 28 12:18:23 ctl02 nova-api[27420]: 2017-09-28 12:18:23.022 27420 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:18:23 ctl02 nova-api[27420]: 2017-09-28 12:18:23.024 27420 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:18:23 ctl02 nova-api[27420]: 2017-09-28 12:18:23.024 27420 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:18:23 ctl02 nova-api[27420]: 2017-09-28 12:18:23.024 27420 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:18:23 ctl02 nova-api[27420]: 2017-09-28 12:18:23.027 27420 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:18:23 ctl02 nova-api[27420]: 2017-09-28 12:18:23.028 27420 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:18:23 ctl02 nova-api[27420]: 2017-09-28 12:18:23.028 27420 ERROR nova Traceback (most recent call last):
Sep 28 12:18:23 ctl02 nova-api[27420]: 2017-09-28 12:18:23.028 27420 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:18:23 ctl02 nova-api[27420]: 2017-09-28 12:18:23.028 27420 ERROR nova     sys.exit(main())
Sep 28 12:18:23 ctl02 nova-api[27420]: 2017-09-28 12:18:23.028 27420 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:18:23 ctl02 nova-api[27420]: 2017-09-28 12:18:23.028 27420 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:18:23 ctl02 nova-api[27420]: 2017-09-28 12:18:23.028 27420 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:18:23 ctl02 nova-api[27420]: 2017-09-28 12:18:23.028 27420 ERROR nova     max_url_len=max_url_len)
Sep 28 12:18:23 ctl02 nova-api[27420]: 2017-09-28 12:18:23.028 27420 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:18:23 ctl02 nova-api[27420]: 2017-09-28 12:18:23.028 27420 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:18:23 ctl02 nova-api[27420]: 2017-09-28 12:18:23.028 27420 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:18:23 ctl02 nova-api[27420]: 2017-09-28 12:18:23.028 27420 ERROR nova     sock.listen(backlog)
Sep 28 12:18:23 ctl02 nova-api[27420]: 2017-09-28 12:18:23.028 27420 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:18:23 ctl02 nova-api[27420]: 2017-09-28 12:18:23.028 27420 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:18:23 ctl02 nova-api[27420]: 2017-09-28 12:18:23.028 27420 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:18:23 ctl02 nova-api[27420]: 2017-09-28 12:18:23.028 27420 ERROR nova
Sep 28 12:18:23 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:18:23 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:18:23 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:18:23 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:18:23 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:18:23 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:18:23 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:18:23 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb66c542d)
Sep 28 12:18:23 ctl02 glance-api[29183]: 2017-09-28 12:18:23.964 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:18:23] "OPTIONS / HTTP/1.0" 200 134 0.000683
Sep 28 12:18:24 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb66c542d)
Sep 28 12:18:25 ctl02 nova-api[27438]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:18:25 ctl02 nova-api[27438]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:18:25 ctl02 nova-api[27438]: 2017-09-28 12:18:25.191 27438 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:18:25 ctl02 nova-api[27438]: 2017-09-28 12:18:25.192 27438 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:18:25 ctl02 nova-api[27438]: 2017-09-28 12:18:25.192 27438 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:18:25 ctl02 nova-api[27438]: 2017-09-28 12:18:25.192 27438 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:18:25 ctl02 nova-api[27438]: 2017-09-28 12:18:25.192 27438 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:18:25 ctl02 nova-api[27438]: 2017-09-28 12:18:25.192 27438 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:18:25 ctl02 nova-api[27438]: 2017-09-28 12:18:25.192 27438 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:18:25 ctl02 nova-api[27438]: 2017-09-28 12:18:25.192 27438 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:18:25 ctl02 nova-api[27438]: 2017-09-28 12:18:25.192 27438 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:18:25 ctl02 nova-api[27438]: 2017-09-28 12:18:25.192 27438 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:18:25 ctl02 nova-api[27438]: 2017-09-28 12:18:25.192 27438 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:18:25 ctl02 nova-api[27438]: 2017-09-28 12:18:25.192 27438 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:18:25 ctl02 nova-api[27438]: 2017-09-28 12:18:25.192 27438 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:18:25 ctl02 nova-api[27438]: 2017-09-28 12:18:25.192 27438 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:18:25 ctl02 nova-api[27438]: 2017-09-28 12:18:25.192 27438 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:18:25 ctl02 nova-api[27438]: 2017-09-28 12:18:25.192 27438 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:18:25 ctl02 nova-api[27438]: 2017-09-28 12:18:25.192 27438 ERROR nova.wsgi     self.filename))
Sep 28 12:18:25 ctl02 nova-api[27438]: 2017-09-28 12:18:25.192 27438 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:18:25 ctl02 nova-api[27438]: 2017-09-28 12:18:25.192 27438 ERROR nova.wsgi
Sep 28 12:18:25 ctl02 nova-api[27438]: 2017-09-28 12:18:25.193 27438 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:18:25 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:18:25.208 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:18:25] "OPTIONS / HTTP/1.0" 200 134 0.000403
Sep 28 12:18:25 ctl02 nova-api[27438]: 2017-09-28 12:18:25.341 27438 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:18:25 ctl02 nova-api[27438]: 2017-09-28 12:18:25.592 27438 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:18:25 ctl02 nova-api[27438]: 2017-09-28 12:18:25.595 27438 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:18:25 ctl02 nova-api[27438]: 2017-09-28 12:18:25.595 27438 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:18:25 ctl02 nova-api[27438]: 2017-09-28 12:18:25.596 27438 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:18:25 ctl02 heat-engine[12803]: 2017-09-28 12:18:25.649 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:18:25 ctl02 heat-engine[12803]: 2017-09-28 12:18:25.655 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:18:25 ctl02 heat-engine[12803]: 2017-09-28 12:18:25.660 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:18:25 ctl02 heat-engine[12803]: 2017-09-28 12:18:25.661 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:18:25 ctl02 heat-api[13008]: 2017-09-28 12:18:25.670 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:18:25] "OPTIONS / HTTP/1.0" 200 134 0.000624
Sep 28 12:18:25 ctl02 nova-api[27438]: 2017-09-28 12:18:25.733 27438 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:18:25 ctl02 nova-api[27438]: 2017-09-28 12:18:25.735 27438 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:18:25 ctl02 nova-api[27438]: 2017-09-28 12:18:25.736 27438 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:18:25 ctl02 nova-api[27438]: 2017-09-28 12:18:25.736 27438 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:18:25 ctl02 nova-api[27438]: 2017-09-28 12:18:25.739 27438 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:18:25 ctl02 nova-api[27438]: 2017-09-28 12:18:25.740 27438 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:18:25 ctl02 nova-api[27438]: 2017-09-28 12:18:25.740 27438 ERROR nova Traceback (most recent call last):
Sep 28 12:18:25 ctl02 nova-api[27438]: 2017-09-28 12:18:25.740 27438 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:18:25 ctl02 nova-api[27438]: 2017-09-28 12:18:25.740 27438 ERROR nova     sys.exit(main())
Sep 28 12:18:25 ctl02 nova-api[27438]: 2017-09-28 12:18:25.740 27438 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:18:25 ctl02 nova-api[27438]: 2017-09-28 12:18:25.740 27438 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:18:25 ctl02 nova-api[27438]: 2017-09-28 12:18:25.740 27438 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:18:25 ctl02 nova-api[27438]: 2017-09-28 12:18:25.740 27438 ERROR nova     max_url_len=max_url_len)
Sep 28 12:18:25 ctl02 nova-api[27438]: 2017-09-28 12:18:25.740 27438 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:18:25 ctl02 nova-api[27438]: 2017-09-28 12:18:25.740 27438 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:18:25 ctl02 nova-api[27438]: 2017-09-28 12:18:25.740 27438 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:18:25 ctl02 nova-api[27438]: 2017-09-28 12:18:25.740 27438 ERROR nova     sock.listen(backlog)
Sep 28 12:18:25 ctl02 nova-api[27438]: 2017-09-28 12:18:25.740 27438 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:18:25 ctl02 nova-api[27438]: 2017-09-28 12:18:25.740 27438 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:18:25 ctl02 nova-api[27438]: 2017-09-28 12:18:25.740 27438 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:18:25 ctl02 nova-api[27438]: 2017-09-28 12:18:25.740 27438 ERROR nova
Sep 28 12:18:25 ctl02 nova-scheduler[5620]: 2017-09-28 12:18:25.836 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:18:25 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:18:25 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:18:25 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:18:25 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb66c542d)
Sep 28 12:18:26 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:18:26 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:18:26 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:18:26 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:18:26 ctl02 heat-api[13008]: 2017-09-28 12:18:26.498 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:18:26] "OPTIONS / HTTP/1.0" 200 134 0.000545
Sep 28 12:18:26 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb66c542d)
Sep 28 12:18:27 ctl02 nova-api[27456]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:18:27 ctl02 nova-api[27456]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:18:27 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb66c542d)
Sep 28 12:18:27 ctl02 nova-api[27456]: 2017-09-28 12:18:27.948 27456 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:18:27 ctl02 nova-api[27456]: 2017-09-28 12:18:27.950 27456 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:18:27 ctl02 nova-api[27456]: 2017-09-28 12:18:27.950 27456 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:18:27 ctl02 nova-api[27456]: 2017-09-28 12:18:27.950 27456 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:18:27 ctl02 nova-api[27456]: 2017-09-28 12:18:27.950 27456 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:18:27 ctl02 nova-api[27456]: 2017-09-28 12:18:27.950 27456 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:18:27 ctl02 nova-api[27456]: 2017-09-28 12:18:27.950 27456 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:18:27 ctl02 nova-api[27456]: 2017-09-28 12:18:27.950 27456 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:18:27 ctl02 nova-api[27456]: 2017-09-28 12:18:27.950 27456 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:18:27 ctl02 nova-api[27456]: 2017-09-28 12:18:27.950 27456 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:18:27 ctl02 nova-api[27456]: 2017-09-28 12:18:27.950 27456 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:18:27 ctl02 nova-api[27456]: 2017-09-28 12:18:27.950 27456 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:18:27 ctl02 nova-api[27456]: 2017-09-28 12:18:27.950 27456 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:18:27 ctl02 nova-api[27456]: 2017-09-28 12:18:27.950 27456 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:18:27 ctl02 nova-api[27456]: 2017-09-28 12:18:27.950 27456 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:18:27 ctl02 nova-api[27456]: 2017-09-28 12:18:27.950 27456 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:18:27 ctl02 nova-api[27456]: 2017-09-28 12:18:27.950 27456 ERROR nova.wsgi     self.filename))
Sep 28 12:18:27 ctl02 nova-api[27456]: 2017-09-28 12:18:27.950 27456 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:18:27 ctl02 nova-api[27456]: 2017-09-28 12:18:27.950 27456 ERROR nova.wsgi
Sep 28 12:18:27 ctl02 nova-api[27456]: 2017-09-28 12:18:27.951 27456 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:18:28 ctl02 nova-api[27456]: 2017-09-28 12:18:28.077 27456 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:18:28 ctl02 nova-api[27456]: 2017-09-28 12:18:28.311 27456 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:18:28 ctl02 nova-api[27456]: 2017-09-28 12:18:28.313 27456 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:18:28 ctl02 nova-api[27456]: 2017-09-28 12:18:28.313 27456 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:18:28 ctl02 nova-api[27456]: 2017-09-28 12:18:28.314 27456 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:18:28 ctl02 nova-api[27456]: 2017-09-28 12:18:28.443 27456 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:18:28 ctl02 nova-api[27456]: 2017-09-28 12:18:28.445 27456 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:18:28 ctl02 nova-api[27456]: 2017-09-28 12:18:28.445 27456 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:18:28 ctl02 nova-api[27456]: 2017-09-28 12:18:28.445 27456 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:18:28 ctl02 nova-api[27456]: 2017-09-28 12:18:28.448 27456 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:18:28 ctl02 nova-api[27456]: 2017-09-28 12:18:28.449 27456 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:18:28 ctl02 nova-api[27456]: 2017-09-28 12:18:28.449 27456 ERROR nova Traceback (most recent call last):
Sep 28 12:18:28 ctl02 nova-api[27456]: 2017-09-28 12:18:28.449 27456 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:18:28 ctl02 nova-api[27456]: 2017-09-28 12:18:28.449 27456 ERROR nova     sys.exit(main())
Sep 28 12:18:28 ctl02 nova-api[27456]: 2017-09-28 12:18:28.449 27456 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:18:28 ctl02 nova-api[27456]: 2017-09-28 12:18:28.449 27456 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:18:28 ctl02 nova-api[27456]: 2017-09-28 12:18:28.449 27456 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:18:28 ctl02 nova-api[27456]: 2017-09-28 12:18:28.449 27456 ERROR nova     max_url_len=max_url_len)
Sep 28 12:18:28 ctl02 nova-api[27456]: 2017-09-28 12:18:28.449 27456 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:18:28 ctl02 nova-api[27456]: 2017-09-28 12:18:28.449 27456 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:18:28 ctl02 nova-api[27456]: 2017-09-28 12:18:28.449 27456 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:18:28 ctl02 nova-api[27456]: 2017-09-28 12:18:28.449 27456 ERROR nova     sock.listen(backlog)
Sep 28 12:18:28 ctl02 nova-api[27456]: 2017-09-28 12:18:28.449 27456 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:18:28 ctl02 nova-api[27456]: 2017-09-28 12:18:28.449 27456 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:18:28 ctl02 nova-api[27456]: 2017-09-28 12:18:28.449 27456 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:18:28 ctl02 nova-api[27456]: 2017-09-28 12:18:28.449 27456 ERROR nova
Sep 28 12:18:28 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:18:28 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:18:28 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:18:28 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:18:28.818 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:18:28] "OPTIONS / HTTP/1.0" 200 134 0.000533
Sep 28 12:18:28 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:18:28 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:18:28 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:18:28 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:18:28 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb66c542d)
Sep 28 12:18:29 ctl02 heat-api[13008]: 2017-09-28 12:18:29.305 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:18:29] "OPTIONS / HTTP/1.0" 200 134 0.000532
Sep 28 12:18:29 ctl02 heat-api-cfn[13300]: 2017-09-28 12:18:29.418 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:18:29] "OPTIONS / HTTP/1.0" 200 134 0.000460
Sep 28 12:18:29 ctl02 heat-api-cfn[13300]: 2017-09-28 12:18:29.939 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:18:29] "OPTIONS / HTTP/1.0" 200 134 0.000457
Sep 28 12:18:29 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:18:29 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:18:30 ctl02 glance-api[29183]: 2017-09-28 12:18:30.099 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:18:30] "OPTIONS / HTTP/1.0" 200 134 0.000635
Sep 28 12:18:30 ctl02 nova-api[27474]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:18:30 ctl02 nova-api[27474]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:18:30 ctl02 nova-api[27474]: 2017-09-28 12:18:30.711 27474 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:18:30 ctl02 nova-api[27474]: 2017-09-28 12:18:30.713 27474 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:18:30 ctl02 nova-api[27474]: 2017-09-28 12:18:30.713 27474 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:18:30 ctl02 nova-api[27474]: 2017-09-28 12:18:30.713 27474 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:18:30 ctl02 nova-api[27474]: 2017-09-28 12:18:30.713 27474 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:18:30 ctl02 nova-api[27474]: 2017-09-28 12:18:30.713 27474 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:18:30 ctl02 nova-api[27474]: 2017-09-28 12:18:30.713 27474 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:18:30 ctl02 nova-api[27474]: 2017-09-28 12:18:30.713 27474 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:18:30 ctl02 nova-api[27474]: 2017-09-28 12:18:30.713 27474 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:18:30 ctl02 nova-api[27474]: 2017-09-28 12:18:30.713 27474 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:18:30 ctl02 nova-api[27474]: 2017-09-28 12:18:30.713 27474 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:18:30 ctl02 nova-api[27474]: 2017-09-28 12:18:30.713 27474 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:18:30 ctl02 nova-api[27474]: 2017-09-28 12:18:30.713 27474 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:18:30 ctl02 nova-api[27474]: 2017-09-28 12:18:30.713 27474 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:18:30 ctl02 nova-api[27474]: 2017-09-28 12:18:30.713 27474 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:18:30 ctl02 nova-api[27474]: 2017-09-28 12:18:30.713 27474 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:18:30 ctl02 nova-api[27474]: 2017-09-28 12:18:30.713 27474 ERROR nova.wsgi     self.filename))
Sep 28 12:18:30 ctl02 nova-api[27474]: 2017-09-28 12:18:30.713 27474 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:18:30 ctl02 nova-api[27474]: 2017-09-28 12:18:30.713 27474 ERROR nova.wsgi
Sep 28 12:18:30 ctl02 nova-api[27474]: 2017-09-28 12:18:30.715 27474 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:18:30 ctl02 nova-api[27474]: 2017-09-28 12:18:30.847 27474 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:18:31 ctl02 nova-api[27474]: 2017-09-28 12:18:31.078 27474 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:18:31 ctl02 nova-api[27474]: 2017-09-28 12:18:31.081 27474 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:18:31 ctl02 nova-api[27474]: 2017-09-28 12:18:31.081 27474 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:18:31 ctl02 nova-api[27474]: 2017-09-28 12:18:31.081 27474 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:18:31 ctl02 nova-api[27474]: 2017-09-28 12:18:31.215 27474 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:18:31 ctl02 nova-api[27474]: 2017-09-28 12:18:31.217 27474 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:18:31 ctl02 nova-api[27474]: 2017-09-28 12:18:31.218 27474 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:18:31 ctl02 nova-api[27474]: 2017-09-28 12:18:31.218 27474 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:18:31 ctl02 nova-api[27474]: 2017-09-28 12:18:31.222 27474 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:18:31 ctl02 nova-api[27474]: 2017-09-28 12:18:31.222 27474 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:18:31 ctl02 nova-api[27474]: 2017-09-28 12:18:31.222 27474 ERROR nova Traceback (most recent call last):
Sep 28 12:18:31 ctl02 nova-api[27474]: 2017-09-28 12:18:31.222 27474 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:18:31 ctl02 nova-api[27474]: 2017-09-28 12:18:31.222 27474 ERROR nova     sys.exit(main())
Sep 28 12:18:31 ctl02 nova-api[27474]: 2017-09-28 12:18:31.222 27474 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:18:31 ctl02 nova-api[27474]: 2017-09-28 12:18:31.222 27474 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:18:31 ctl02 nova-api[27474]: 2017-09-28 12:18:31.222 27474 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:18:31 ctl02 nova-api[27474]: 2017-09-28 12:18:31.222 27474 ERROR nova     max_url_len=max_url_len)
Sep 28 12:18:31 ctl02 nova-api[27474]: 2017-09-28 12:18:31.222 27474 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:18:31 ctl02 nova-api[27474]: 2017-09-28 12:18:31.222 27474 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:18:31 ctl02 nova-api[27474]: 2017-09-28 12:18:31.222 27474 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:18:31 ctl02 nova-api[27474]: 2017-09-28 12:18:31.222 27474 ERROR nova     sock.listen(backlog)
Sep 28 12:18:31 ctl02 nova-api[27474]: 2017-09-28 12:18:31.222 27474 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:18:31 ctl02 nova-api[27474]: 2017-09-28 12:18:31.222 27474 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:18:31 ctl02 nova-api[27474]: 2017-09-28 12:18:31.222 27474 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:18:31 ctl02 nova-api[27474]: 2017-09-28 12:18:31.222 27474 ERROR nova
Sep 28 12:18:31 ctl02 heat-api-cfn[13300]: 2017-09-28 12:18:31.362 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:18:31] "OPTIONS / HTTP/1.0" 200 134 0.000476
Sep 28 12:18:31 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:18:31 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:18:31 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:18:31 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:18:31 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:18:31 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:18:31 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:18:32 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:18:32.340 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:18:32] "OPTIONS / HTTP/1.0" 200 134 0.000430
Sep 28 12:18:32 ctl02 glance-api[29183]: 2017-09-28 12:18:32.974 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:18:32] "OPTIONS / HTTP/1.0" 200 134 0.000566
Sep 28 12:18:33 ctl02 nova-api[27497]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:18:33 ctl02 nova-api[27497]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:18:33 ctl02 nova-api[27497]: 2017-09-28 12:18:33.493 27497 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:18:33 ctl02 nova-api[27497]: 2017-09-28 12:18:33.495 27497 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:18:33 ctl02 nova-api[27497]: 2017-09-28 12:18:33.495 27497 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:18:33 ctl02 nova-api[27497]: 2017-09-28 12:18:33.495 27497 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:18:33 ctl02 nova-api[27497]: 2017-09-28 12:18:33.495 27497 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:18:33 ctl02 nova-api[27497]: 2017-09-28 12:18:33.495 27497 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:18:33 ctl02 nova-api[27497]: 2017-09-28 12:18:33.495 27497 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:18:33 ctl02 nova-api[27497]: 2017-09-28 12:18:33.495 27497 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:18:33 ctl02 nova-api[27497]: 2017-09-28 12:18:33.495 27497 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:18:33 ctl02 nova-api[27497]: 2017-09-28 12:18:33.495 27497 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:18:33 ctl02 nova-api[27497]: 2017-09-28 12:18:33.495 27497 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:18:33 ctl02 nova-api[27497]: 2017-09-28 12:18:33.495 27497 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:18:33 ctl02 nova-api[27497]: 2017-09-28 12:18:33.495 27497 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:18:33 ctl02 nova-api[27497]: 2017-09-28 12:18:33.495 27497 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:18:33 ctl02 nova-api[27497]: 2017-09-28 12:18:33.495 27497 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:18:33 ctl02 nova-api[27497]: 2017-09-28 12:18:33.495 27497 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:18:33 ctl02 nova-api[27497]: 2017-09-28 12:18:33.495 27497 ERROR nova.wsgi     self.filename))
Sep 28 12:18:33 ctl02 nova-api[27497]: 2017-09-28 12:18:33.495 27497 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:18:33 ctl02 nova-api[27497]: 2017-09-28 12:18:33.495 27497 ERROR nova.wsgi
Sep 28 12:18:33 ctl02 nova-api[27497]: 2017-09-28 12:18:33.496 27497 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:18:33 ctl02 nova-api[27497]: 2017-09-28 12:18:33.625 27497 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:18:33 ctl02 glance-api[29183]: 2017-09-28 12:18:33.771 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:18:33] "OPTIONS / HTTP/1.0" 200 134 0.000592
Sep 28 12:18:33 ctl02 nova-api[27497]: 2017-09-28 12:18:33.864 27497 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:18:33 ctl02 nova-api[27497]: 2017-09-28 12:18:33.866 27497 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:18:33 ctl02 nova-api[27497]: 2017-09-28 12:18:33.866 27497 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:18:33 ctl02 nova-api[27497]: 2017-09-28 12:18:33.866 27497 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:18:33 ctl02 nova-api[27497]: 2017-09-28 12:18:33.996 27497 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:18:33 ctl02 nova-api[27497]: 2017-09-28 12:18:33.998 27497 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:18:33 ctl02 nova-api[27497]: 2017-09-28 12:18:33.998 27497 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:18:33 ctl02 nova-api[27497]: 2017-09-28 12:18:33.998 27497 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:18:34 ctl02 nova-api[27497]: 2017-09-28 12:18:34.002 27497 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:18:34 ctl02 nova-api[27497]: 2017-09-28 12:18:34.002 27497 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:18:34 ctl02 nova-api[27497]: 2017-09-28 12:18:34.002 27497 ERROR nova Traceback (most recent call last):
Sep 28 12:18:34 ctl02 nova-api[27497]: 2017-09-28 12:18:34.002 27497 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:18:34 ctl02 nova-api[27497]: 2017-09-28 12:18:34.002 27497 ERROR nova     sys.exit(main())
Sep 28 12:18:34 ctl02 nova-api[27497]: 2017-09-28 12:18:34.002 27497 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:18:34 ctl02 nova-api[27497]: 2017-09-28 12:18:34.002 27497 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:18:34 ctl02 nova-api[27497]: 2017-09-28 12:18:34.002 27497 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:18:34 ctl02 nova-api[27497]: 2017-09-28 12:18:34.002 27497 ERROR nova     max_url_len=max_url_len)
Sep 28 12:18:34 ctl02 nova-api[27497]: 2017-09-28 12:18:34.002 27497 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:18:34 ctl02 nova-api[27497]: 2017-09-28 12:18:34.002 27497 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:18:34 ctl02 nova-api[27497]: 2017-09-28 12:18:34.002 27497 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:18:34 ctl02 nova-api[27497]: 2017-09-28 12:18:34.002 27497 ERROR nova     sock.listen(backlog)
Sep 28 12:18:34 ctl02 nova-api[27497]: 2017-09-28 12:18:34.002 27497 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:18:34 ctl02 nova-api[27497]: 2017-09-28 12:18:34.002 27497 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:18:34 ctl02 nova-api[27497]: 2017-09-28 12:18:34.002 27497 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:18:34 ctl02 nova-api[27497]: 2017-09-28 12:18:34.002 27497 ERROR nova
Sep 28 12:18:34 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:18:34 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:18:34 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:18:34 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:18:34 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:18:34 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:18:34 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:18:34 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:18:34.905 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:18:34] "OPTIONS / HTTP/1.0" 200 134 0.000429
Sep 28 12:18:35 ctl02 heat-api[13008]: 2017-09-28 12:18:35.418 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:18:35] "OPTIONS / HTTP/1.0" 200 134 0.000551
Sep 28 12:18:36 ctl02 nova-api[27514]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:18:36 ctl02 nova-api[27514]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:18:36 ctl02 nova-api[27514]: 2017-09-28 12:18:36.233 27514 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:18:36 ctl02 nova-api[27514]: 2017-09-28 12:18:36.234 27514 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:18:36 ctl02 nova-api[27514]: 2017-09-28 12:18:36.234 27514 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:18:36 ctl02 nova-api[27514]: 2017-09-28 12:18:36.234 27514 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:18:36 ctl02 nova-api[27514]: 2017-09-28 12:18:36.234 27514 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:18:36 ctl02 nova-api[27514]: 2017-09-28 12:18:36.234 27514 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:18:36 ctl02 nova-api[27514]: 2017-09-28 12:18:36.234 27514 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:18:36 ctl02 nova-api[27514]: 2017-09-28 12:18:36.234 27514 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:18:36 ctl02 nova-api[27514]: 2017-09-28 12:18:36.234 27514 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:18:36 ctl02 nova-api[27514]: 2017-09-28 12:18:36.234 27514 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:18:36 ctl02 nova-api[27514]: 2017-09-28 12:18:36.234 27514 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:18:36 ctl02 nova-api[27514]: 2017-09-28 12:18:36.234 27514 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:18:36 ctl02 nova-api[27514]: 2017-09-28 12:18:36.234 27514 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:18:36 ctl02 nova-api[27514]: 2017-09-28 12:18:36.234 27514 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:18:36 ctl02 nova-api[27514]: 2017-09-28 12:18:36.234 27514 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:18:36 ctl02 nova-api[27514]: 2017-09-28 12:18:36.234 27514 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:18:36 ctl02 nova-api[27514]: 2017-09-28 12:18:36.234 27514 ERROR nova.wsgi     self.filename))
Sep 28 12:18:36 ctl02 nova-api[27514]: 2017-09-28 12:18:36.234 27514 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:18:36 ctl02 nova-api[27514]: 2017-09-28 12:18:36.234 27514 ERROR nova.wsgi
Sep 28 12:18:36 ctl02 nova-api[27514]: 2017-09-28 12:18:36.235 27514 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:18:36 ctl02 heat-api[13008]: 2017-09-28 12:18:36.335 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:18:36] "OPTIONS / HTTP/1.0" 200 134 0.000540
Sep 28 12:18:36 ctl02 nova-api[27514]: 2017-09-28 12:18:36.367 27514 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:18:36 ctl02 nova-api[27514]: 2017-09-28 12:18:36.598 27514 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:18:36 ctl02 nova-api[27514]: 2017-09-28 12:18:36.601 27514 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:18:36 ctl02 nova-api[27514]: 2017-09-28 12:18:36.601 27514 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:18:36 ctl02 nova-api[27514]: 2017-09-28 12:18:36.601 27514 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:18:36 ctl02 nova-api[27514]: 2017-09-28 12:18:36.732 27514 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:18:36 ctl02 nova-api[27514]: 2017-09-28 12:18:36.734 27514 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:18:36 ctl02 nova-api[27514]: 2017-09-28 12:18:36.734 27514 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:18:36 ctl02 nova-api[27514]: 2017-09-28 12:18:36.735 27514 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:18:36 ctl02 nova-api[27514]: 2017-09-28 12:18:36.738 27514 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:18:36 ctl02 nova-api[27514]: 2017-09-28 12:18:36.738 27514 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:18:36 ctl02 nova-api[27514]: 2017-09-28 12:18:36.738 27514 ERROR nova Traceback (most recent call last):
Sep 28 12:18:36 ctl02 nova-api[27514]: 2017-09-28 12:18:36.738 27514 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:18:36 ctl02 nova-api[27514]: 2017-09-28 12:18:36.738 27514 ERROR nova     sys.exit(main())
Sep 28 12:18:36 ctl02 nova-api[27514]: 2017-09-28 12:18:36.738 27514 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:18:36 ctl02 nova-api[27514]: 2017-09-28 12:18:36.738 27514 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:18:36 ctl02 nova-api[27514]: 2017-09-28 12:18:36.738 27514 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:18:36 ctl02 nova-api[27514]: 2017-09-28 12:18:36.738 27514 ERROR nova     max_url_len=max_url_len)
Sep 28 12:18:36 ctl02 nova-api[27514]: 2017-09-28 12:18:36.738 27514 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:18:36 ctl02 nova-api[27514]: 2017-09-28 12:18:36.738 27514 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:18:36 ctl02 nova-api[27514]: 2017-09-28 12:18:36.738 27514 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:18:36 ctl02 nova-api[27514]: 2017-09-28 12:18:36.738 27514 ERROR nova     sock.listen(backlog)
Sep 28 12:18:36 ctl02 nova-api[27514]: 2017-09-28 12:18:36.738 27514 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:18:36 ctl02 nova-api[27514]: 2017-09-28 12:18:36.738 27514 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:18:36 ctl02 nova-api[27514]: 2017-09-28 12:18:36.738 27514 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:18:36 ctl02 nova-api[27514]: 2017-09-28 12:18:36.738 27514 ERROR nova
Sep 28 12:18:36 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:18:36 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:18:36 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:18:37 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:18:37 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:18:37 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd2cf4e60)
Sep 28 12:18:37 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:18:37 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:18:38 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd2cf4e60)
Sep 28 12:18:38 ctl02 nova-api[27531]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:18:38 ctl02 nova-api[27531]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:18:38 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:18:38.985 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:18:38] "OPTIONS / HTTP/1.0" 200 134 0.000472
Sep 28 12:18:38 ctl02 nova-api[27531]: 2017-09-28 12:18:38.995 27531 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:18:38 ctl02 nova-api[27531]: 2017-09-28 12:18:38.997 27531 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:18:38 ctl02 nova-api[27531]: 2017-09-28 12:18:38.997 27531 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:18:38 ctl02 nova-api[27531]: 2017-09-28 12:18:38.997 27531 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:18:38 ctl02 nova-api[27531]: 2017-09-28 12:18:38.997 27531 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:18:38 ctl02 nova-api[27531]: 2017-09-28 12:18:38.997 27531 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:18:38 ctl02 nova-api[27531]: 2017-09-28 12:18:38.997 27531 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:18:38 ctl02 nova-api[27531]: 2017-09-28 12:18:38.997 27531 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:18:38 ctl02 nova-api[27531]: 2017-09-28 12:18:38.997 27531 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:18:38 ctl02 nova-api[27531]: 2017-09-28 12:18:38.997 27531 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:18:38 ctl02 nova-api[27531]: 2017-09-28 12:18:38.997 27531 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:18:38 ctl02 nova-api[27531]: 2017-09-28 12:18:38.997 27531 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:18:38 ctl02 nova-api[27531]: 2017-09-28 12:18:38.997 27531 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:18:38 ctl02 nova-api[27531]: 2017-09-28 12:18:38.997 27531 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:18:38 ctl02 nova-api[27531]: 2017-09-28 12:18:38.997 27531 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:18:38 ctl02 nova-api[27531]: 2017-09-28 12:18:38.997 27531 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:18:38 ctl02 nova-api[27531]: 2017-09-28 12:18:38.997 27531 ERROR nova.wsgi     self.filename))
Sep 28 12:18:38 ctl02 nova-api[27531]: 2017-09-28 12:18:38.997 27531 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:18:38 ctl02 nova-api[27531]: 2017-09-28 12:18:38.997 27531 ERROR nova.wsgi
Sep 28 12:18:39 ctl02 nova-api[27531]: 2017-09-28 12:18:39.000 27531 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:18:39 ctl02 nova-api[27531]: 2017-09-28 12:18:39.135 27531 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:18:39 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd2cf4e60)
Sep 28 12:18:39 ctl02 nova-api[27531]: 2017-09-28 12:18:39.385 27531 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:18:39 ctl02 nova-api[27531]: 2017-09-28 12:18:39.388 27531 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:18:39 ctl02 nova-api[27531]: 2017-09-28 12:18:39.389 27531 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:18:39 ctl02 nova-api[27531]: 2017-09-28 12:18:39.389 27531 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:18:39 ctl02 heat-api-cfn[13300]: 2017-09-28 12:18:39.417 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:18:39] "OPTIONS / HTTP/1.0" 200 134 0.000509
Sep 28 12:18:39 ctl02 nova-api[27531]: 2017-09-28 12:18:39.522 27531 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:18:39 ctl02 nova-api[27531]: 2017-09-28 12:18:39.524 27531 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:18:39 ctl02 nova-api[27531]: 2017-09-28 12:18:39.525 27531 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:18:39 ctl02 nova-api[27531]: 2017-09-28 12:18:39.525 27531 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:18:39 ctl02 nova-api[27531]: 2017-09-28 12:18:39.529 27531 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:18:39 ctl02 nova-api[27531]: 2017-09-28 12:18:39.529 27531 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:18:39 ctl02 nova-api[27531]: 2017-09-28 12:18:39.529 27531 ERROR nova Traceback (most recent call last):
Sep 28 12:18:39 ctl02 nova-api[27531]: 2017-09-28 12:18:39.529 27531 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:18:39 ctl02 nova-api[27531]: 2017-09-28 12:18:39.529 27531 ERROR nova     sys.exit(main())
Sep 28 12:18:39 ctl02 nova-api[27531]: 2017-09-28 12:18:39.529 27531 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:18:39 ctl02 nova-api[27531]: 2017-09-28 12:18:39.529 27531 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:18:39 ctl02 nova-api[27531]: 2017-09-28 12:18:39.529 27531 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:18:39 ctl02 nova-api[27531]: 2017-09-28 12:18:39.529 27531 ERROR nova     max_url_len=max_url_len)
Sep 28 12:18:39 ctl02 nova-api[27531]: 2017-09-28 12:18:39.529 27531 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:18:39 ctl02 nova-api[27531]: 2017-09-28 12:18:39.529 27531 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:18:39 ctl02 nova-api[27531]: 2017-09-28 12:18:39.529 27531 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:18:39 ctl02 nova-api[27531]: 2017-09-28 12:18:39.529 27531 ERROR nova     sock.listen(backlog)
Sep 28 12:18:39 ctl02 nova-api[27531]: 2017-09-28 12:18:39.529 27531 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:18:39 ctl02 nova-api[27531]: 2017-09-28 12:18:39.529 27531 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:18:39 ctl02 nova-api[27531]: 2017-09-28 12:18:39.529 27531 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:18:39 ctl02 nova-api[27531]: 2017-09-28 12:18:39.529 27531 ERROR nova
Sep 28 12:18:39 ctl02 heat-api[13008]: 2017-09-28 12:18:39.607 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:18:39] "OPTIONS / HTTP/1.0" 200 134 0.000658
Sep 28 12:18:39 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:18:39 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:18:39 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:18:39 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:18:39 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:18:39 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:18:39 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:18:40 ctl02 heat-api-cfn[13300]: 2017-09-28 12:18:40.086 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:18:40] "OPTIONS / HTTP/1.0" 200 134 0.000531
Sep 28 12:18:40 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd2cf4e60)
Sep 28 12:18:40 ctl02 glance-api[29183]: 2017-09-28 12:18:40.275 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:18:40] "OPTIONS / HTTP/1.0" 200 134 0.000657
Sep 28 12:18:41 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd2cf4e60)
Sep 28 12:18:41 ctl02 nova-api[27551]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:18:41 ctl02 nova-api[27551]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:18:41 ctl02 heat-api-cfn[13300]: 2017-09-28 12:18:41.693 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:18:41] "OPTIONS / HTTP/1.0" 200 134 0.000519
Sep 28 12:18:41 ctl02 nova-api[27551]: 2017-09-28 12:18:41.768 27551 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:18:41 ctl02 nova-api[27551]: 2017-09-28 12:18:41.770 27551 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:18:41 ctl02 nova-api[27551]: 2017-09-28 12:18:41.770 27551 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:18:41 ctl02 nova-api[27551]: 2017-09-28 12:18:41.770 27551 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:18:41 ctl02 nova-api[27551]: 2017-09-28 12:18:41.770 27551 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:18:41 ctl02 nova-api[27551]: 2017-09-28 12:18:41.770 27551 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:18:41 ctl02 nova-api[27551]: 2017-09-28 12:18:41.770 27551 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:18:41 ctl02 nova-api[27551]: 2017-09-28 12:18:41.770 27551 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:18:41 ctl02 nova-api[27551]: 2017-09-28 12:18:41.770 27551 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:18:41 ctl02 nova-api[27551]: 2017-09-28 12:18:41.770 27551 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:18:41 ctl02 nova-api[27551]: 2017-09-28 12:18:41.770 27551 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:18:41 ctl02 nova-api[27551]: 2017-09-28 12:18:41.770 27551 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:18:41 ctl02 nova-api[27551]: 2017-09-28 12:18:41.770 27551 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:18:41 ctl02 nova-api[27551]: 2017-09-28 12:18:41.770 27551 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:18:41 ctl02 nova-api[27551]: 2017-09-28 12:18:41.770 27551 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:18:41 ctl02 nova-api[27551]: 2017-09-28 12:18:41.770 27551 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:18:41 ctl02 nova-api[27551]: 2017-09-28 12:18:41.770 27551 ERROR nova.wsgi     self.filename))
Sep 28 12:18:41 ctl02 nova-api[27551]: 2017-09-28 12:18:41.770 27551 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:18:41 ctl02 nova-api[27551]: 2017-09-28 12:18:41.770 27551 ERROR nova.wsgi
Sep 28 12:18:41 ctl02 nova-api[27551]: 2017-09-28 12:18:41.771 27551 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:18:41 ctl02 nova-api[27551]: 2017-09-28 12:18:41.906 27551 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:18:41 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:18:41.984 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:18:41] "OPTIONS / HTTP/1.0" 200 134 0.000492
Sep 28 12:18:42 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd2cf4e60)
Sep 28 12:18:42 ctl02 nova-api[27551]: 2017-09-28 12:18:42.160 27551 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:18:42 ctl02 nova-api[27551]: 2017-09-28 12:18:42.162 27551 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:18:42 ctl02 nova-api[27551]: 2017-09-28 12:18:42.162 27551 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:18:42 ctl02 nova-api[27551]: 2017-09-28 12:18:42.162 27551 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:18:42 ctl02 nova-api[27551]: 2017-09-28 12:18:42.296 27551 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:18:42 ctl02 nova-api[27551]: 2017-09-28 12:18:42.298 27551 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:18:42 ctl02 nova-api[27551]: 2017-09-28 12:18:42.299 27551 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:18:42 ctl02 nova-api[27551]: 2017-09-28 12:18:42.299 27551 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:18:42 ctl02 nova-api[27551]: 2017-09-28 12:18:42.302 27551 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:18:42 ctl02 nova-api[27551]: 2017-09-28 12:18:42.303 27551 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:18:42 ctl02 nova-api[27551]: 2017-09-28 12:18:42.303 27551 ERROR nova Traceback (most recent call last):
Sep 28 12:18:42 ctl02 nova-api[27551]: 2017-09-28 12:18:42.303 27551 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:18:42 ctl02 nova-api[27551]: 2017-09-28 12:18:42.303 27551 ERROR nova     sys.exit(main())
Sep 28 12:18:42 ctl02 nova-api[27551]: 2017-09-28 12:18:42.303 27551 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:18:42 ctl02 nova-api[27551]: 2017-09-28 12:18:42.303 27551 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:18:42 ctl02 nova-api[27551]: 2017-09-28 12:18:42.303 27551 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:18:42 ctl02 nova-api[27551]: 2017-09-28 12:18:42.303 27551 ERROR nova     max_url_len=max_url_len)
Sep 28 12:18:42 ctl02 nova-api[27551]: 2017-09-28 12:18:42.303 27551 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:18:42 ctl02 nova-api[27551]: 2017-09-28 12:18:42.303 27551 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:18:42 ctl02 nova-api[27551]: 2017-09-28 12:18:42.303 27551 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:18:42 ctl02 nova-api[27551]: 2017-09-28 12:18:42.303 27551 ERROR nova     sock.listen(backlog)
Sep 28 12:18:42 ctl02 nova-api[27551]: 2017-09-28 12:18:42.303 27551 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:18:42 ctl02 nova-api[27551]: 2017-09-28 12:18:42.303 27551 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:18:42 ctl02 nova-api[27551]: 2017-09-28 12:18:42.303 27551 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:18:42 ctl02 nova-api[27551]: 2017-09-28 12:18:42.303 27551 ERROR nova
Sep 28 12:18:42 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:18:42 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:18:42 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:18:42 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:18:42 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:18:42 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:18:42 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:18:42 ctl02 glance-api[29183]: 2017-09-28 12:18:42.697 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:18:42] "OPTIONS / HTTP/1.0" 200 134 0.000687
Sep 28 12:18:43 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd2cf4e60)
Sep 28 12:18:43 ctl02 glance-api[29183]: 2017-09-28 12:18:43.434 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:18:43] "OPTIONS / HTTP/1.0" 200 134 0.000668
Sep 28 12:18:44 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd2cf4e60)
Sep 28 12:18:44 ctl02 nova-api[27569]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:18:44 ctl02 nova-api[27569]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:18:44 ctl02 nova-api[27569]: 2017-09-28 12:18:44.489 27569 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:18:44 ctl02 nova-api[27569]: 2017-09-28 12:18:44.491 27569 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:18:44 ctl02 nova-api[27569]: 2017-09-28 12:18:44.491 27569 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:18:44 ctl02 nova-api[27569]: 2017-09-28 12:18:44.491 27569 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:18:44 ctl02 nova-api[27569]: 2017-09-28 12:18:44.491 27569 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:18:44 ctl02 nova-api[27569]: 2017-09-28 12:18:44.491 27569 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:18:44 ctl02 nova-api[27569]: 2017-09-28 12:18:44.491 27569 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:18:44 ctl02 nova-api[27569]: 2017-09-28 12:18:44.491 27569 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:18:44 ctl02 nova-api[27569]: 2017-09-28 12:18:44.491 27569 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:18:44 ctl02 nova-api[27569]: 2017-09-28 12:18:44.491 27569 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:18:44 ctl02 nova-api[27569]: 2017-09-28 12:18:44.491 27569 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:18:44 ctl02 nova-api[27569]: 2017-09-28 12:18:44.491 27569 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:18:44 ctl02 nova-api[27569]: 2017-09-28 12:18:44.491 27569 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:18:44 ctl02 nova-api[27569]: 2017-09-28 12:18:44.491 27569 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:18:44 ctl02 nova-api[27569]: 2017-09-28 12:18:44.491 27569 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:18:44 ctl02 nova-api[27569]: 2017-09-28 12:18:44.491 27569 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:18:44 ctl02 nova-api[27569]: 2017-09-28 12:18:44.491 27569 ERROR nova.wsgi     self.filename))
Sep 28 12:18:44 ctl02 nova-api[27569]: 2017-09-28 12:18:44.491 27569 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:18:44 ctl02 nova-api[27569]: 2017-09-28 12:18:44.491 27569 ERROR nova.wsgi
Sep 28 12:18:44 ctl02 nova-api[27569]: 2017-09-28 12:18:44.493 27569 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:18:44 ctl02 nova-api[27569]: 2017-09-28 12:18:44.629 27569 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:18:44 ctl02 nova-api[27569]: 2017-09-28 12:18:44.881 27569 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:18:44 ctl02 nova-api[27569]: 2017-09-28 12:18:44.884 27569 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:18:44 ctl02 nova-api[27569]: 2017-09-28 12:18:44.885 27569 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:18:44 ctl02 nova-api[27569]: 2017-09-28 12:18:44.885 27569 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:18:44 ctl02 nova-cert[4860]: 2017-09-28 12:18:44.971 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:18:45 ctl02 nova-api[27569]: 2017-09-28 12:18:45.020 27569 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:18:45 ctl02 nova-api[27569]: 2017-09-28 12:18:45.022 27569 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:18:45 ctl02 nova-api[27569]: 2017-09-28 12:18:45.023 27569 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:18:45 ctl02 nova-api[27569]: 2017-09-28 12:18:45.023 27569 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:18:45 ctl02 nova-api[27569]: 2017-09-28 12:18:45.027 27569 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:18:45 ctl02 nova-api[27569]: 2017-09-28 12:18:45.027 27569 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:18:45 ctl02 nova-api[27569]: 2017-09-28 12:18:45.027 27569 ERROR nova Traceback (most recent call last):
Sep 28 12:18:45 ctl02 nova-api[27569]: 2017-09-28 12:18:45.027 27569 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:18:45 ctl02 nova-api[27569]: 2017-09-28 12:18:45.027 27569 ERROR nova     sys.exit(main())
Sep 28 12:18:45 ctl02 nova-api[27569]: 2017-09-28 12:18:45.027 27569 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:18:45 ctl02 nova-api[27569]: 2017-09-28 12:18:45.027 27569 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:18:45 ctl02 nova-api[27569]: 2017-09-28 12:18:45.027 27569 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:18:45 ctl02 nova-api[27569]: 2017-09-28 12:18:45.027 27569 ERROR nova     max_url_len=max_url_len)
Sep 28 12:18:45 ctl02 nova-api[27569]: 2017-09-28 12:18:45.027 27569 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:18:45 ctl02 nova-api[27569]: 2017-09-28 12:18:45.027 27569 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:18:45 ctl02 nova-api[27569]: 2017-09-28 12:18:45.027 27569 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:18:45 ctl02 nova-api[27569]: 2017-09-28 12:18:45.027 27569 ERROR nova     sock.listen(backlog)
Sep 28 12:18:45 ctl02 nova-api[27569]: 2017-09-28 12:18:45.027 27569 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:18:45 ctl02 nova-api[27569]: 2017-09-28 12:18:45.027 27569 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:18:45 ctl02 nova-api[27569]: 2017-09-28 12:18:45.027 27569 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:18:45 ctl02 nova-api[27569]: 2017-09-28 12:18:45.027 27569 ERROR nova
Sep 28 12:18:45 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:18:45.146 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:18:45] "OPTIONS / HTTP/1.0" 200 134 0.000521
Sep 28 12:18:45 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd2cf4e60)
Sep 28 12:18:45 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:18:45 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:18:45 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:18:45 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:18:45 ctl02 heat-api[13008]: 2017-09-28 12:18:45.390 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:18:45] "OPTIONS / HTTP/1.0" 200 134 0.000731
Sep 28 12:18:45 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:18:45 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:18:45 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:18:46 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd2cf4e60)
Sep 28 12:18:46 ctl02 heat-api[13008]: 2017-09-28 12:18:46.220 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:18:46] "OPTIONS / HTTP/1.0" 200 134 0.000676
Sep 28 12:18:46 ctl02 nova-conductor[5056]: 2017-09-28 12:18:46.548 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:18:46 ctl02 nova-conductor[5056]: 2017-09-28 12:18:46.564 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:18:46 ctl02 nova-conductor[5056]: 2017-09-28 12:18:46.572 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:18:46 ctl02 nova-conductor[5056]: 2017-09-28 12:18:46.573 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:18:47 ctl02 nova-api[27587]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:18:47 ctl02 nova-api[27587]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:18:47 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd2cf4e60)
Sep 28 12:18:47 ctl02 nova-api[27587]: 2017-09-28 12:18:47.241 27587 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:18:47 ctl02 nova-api[27587]: 2017-09-28 12:18:47.243 27587 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:18:47 ctl02 nova-api[27587]: 2017-09-28 12:18:47.243 27587 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:18:47 ctl02 nova-api[27587]: 2017-09-28 12:18:47.243 27587 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:18:47 ctl02 nova-api[27587]: 2017-09-28 12:18:47.243 27587 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:18:47 ctl02 nova-api[27587]: 2017-09-28 12:18:47.243 27587 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:18:47 ctl02 nova-api[27587]: 2017-09-28 12:18:47.243 27587 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:18:47 ctl02 nova-api[27587]: 2017-09-28 12:18:47.243 27587 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:18:47 ctl02 nova-api[27587]: 2017-09-28 12:18:47.243 27587 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:18:47 ctl02 nova-api[27587]: 2017-09-28 12:18:47.243 27587 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:18:47 ctl02 nova-api[27587]: 2017-09-28 12:18:47.243 27587 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:18:47 ctl02 nova-api[27587]: 2017-09-28 12:18:47.243 27587 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:18:47 ctl02 nova-api[27587]: 2017-09-28 12:18:47.243 27587 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:18:47 ctl02 nova-api[27587]: 2017-09-28 12:18:47.243 27587 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:18:47 ctl02 nova-api[27587]: 2017-09-28 12:18:47.243 27587 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:18:47 ctl02 nova-api[27587]: 2017-09-28 12:18:47.243 27587 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:18:47 ctl02 nova-api[27587]: 2017-09-28 12:18:47.243 27587 ERROR nova.wsgi     self.filename))
Sep 28 12:18:47 ctl02 nova-api[27587]: 2017-09-28 12:18:47.243 27587 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:18:47 ctl02 nova-api[27587]: 2017-09-28 12:18:47.243 27587 ERROR nova.wsgi
Sep 28 12:18:47 ctl02 nova-api[27587]: 2017-09-28 12:18:47.244 27587 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:18:47 ctl02 nova-api[27587]: 2017-09-28 12:18:47.380 27587 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:18:47 ctl02 nova-api[27587]: 2017-09-28 12:18:47.633 27587 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:18:47 ctl02 nova-api[27587]: 2017-09-28 12:18:47.635 27587 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:18:47 ctl02 nova-api[27587]: 2017-09-28 12:18:47.635 27587 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:18:47 ctl02 nova-api[27587]: 2017-09-28 12:18:47.636 27587 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:18:47 ctl02 nova-api[27587]: 2017-09-28 12:18:47.770 27587 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:18:47 ctl02 nova-api[27587]: 2017-09-28 12:18:47.772 27587 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:18:47 ctl02 nova-api[27587]: 2017-09-28 12:18:47.773 27587 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:18:47 ctl02 nova-api[27587]: 2017-09-28 12:18:47.773 27587 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:18:47 ctl02 nova-api[27587]: 2017-09-28 12:18:47.776 27587 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:18:47 ctl02 nova-api[27587]: 2017-09-28 12:18:47.777 27587 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:18:47 ctl02 nova-api[27587]: 2017-09-28 12:18:47.777 27587 ERROR nova Traceback (most recent call last):
Sep 28 12:18:47 ctl02 nova-api[27587]: 2017-09-28 12:18:47.777 27587 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:18:47 ctl02 nova-api[27587]: 2017-09-28 12:18:47.777 27587 ERROR nova     sys.exit(main())
Sep 28 12:18:47 ctl02 nova-api[27587]: 2017-09-28 12:18:47.777 27587 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:18:47 ctl02 nova-api[27587]: 2017-09-28 12:18:47.777 27587 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:18:47 ctl02 nova-api[27587]: 2017-09-28 12:18:47.777 27587 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:18:47 ctl02 nova-api[27587]: 2017-09-28 12:18:47.777 27587 ERROR nova     max_url_len=max_url_len)
Sep 28 12:18:47 ctl02 nova-api[27587]: 2017-09-28 12:18:47.777 27587 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:18:47 ctl02 nova-api[27587]: 2017-09-28 12:18:47.777 27587 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:18:47 ctl02 nova-api[27587]: 2017-09-28 12:18:47.777 27587 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:18:47 ctl02 nova-api[27587]: 2017-09-28 12:18:47.777 27587 ERROR nova     sock.listen(backlog)
Sep 28 12:18:47 ctl02 nova-api[27587]: 2017-09-28 12:18:47.777 27587 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:18:47 ctl02 nova-api[27587]: 2017-09-28 12:18:47.777 27587 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:18:47 ctl02 nova-api[27587]: 2017-09-28 12:18:47.777 27587 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:18:47 ctl02 nova-api[27587]: 2017-09-28 12:18:47.777 27587 ERROR nova
Sep 28 12:18:47 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:18:47 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:18:47 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:18:48 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:18:48 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:18:48 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:18:48 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:18:48 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:18:48 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:18:49 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:18:49.327 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:18:49] "OPTIONS / HTTP/1.0" 200 134 0.000500
Sep 28 12:18:49 ctl02 heat-api-cfn[13300]: 2017-09-28 12:18:49.331 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:18:49] "OPTIONS / HTTP/1.0" 200 134 0.000492
Sep 28 12:18:49 ctl02 heat-api[13008]: 2017-09-28 12:18:49.380 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:18:49] "OPTIONS / HTTP/1.0" 200 134 0.000633
Sep 28 12:18:49 ctl02 nova-api[27605]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:18:49 ctl02 nova-api[27605]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:18:49 ctl02 nova-api[27605]: 2017-09-28 12:18:49.993 27605 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:18:49 ctl02 nova-api[27605]: 2017-09-28 12:18:49.995 27605 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:18:49 ctl02 nova-api[27605]: 2017-09-28 12:18:49.995 27605 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:18:49 ctl02 nova-api[27605]: 2017-09-28 12:18:49.995 27605 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:18:49 ctl02 nova-api[27605]: 2017-09-28 12:18:49.995 27605 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:18:49 ctl02 nova-api[27605]: 2017-09-28 12:18:49.995 27605 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:18:49 ctl02 nova-api[27605]: 2017-09-28 12:18:49.995 27605 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:18:49 ctl02 nova-api[27605]: 2017-09-28 12:18:49.995 27605 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:18:49 ctl02 nova-api[27605]: 2017-09-28 12:18:49.995 27605 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:18:49 ctl02 nova-api[27605]: 2017-09-28 12:18:49.995 27605 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:18:49 ctl02 nova-api[27605]: 2017-09-28 12:18:49.995 27605 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:18:49 ctl02 nova-api[27605]: 2017-09-28 12:18:49.995 27605 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:18:49 ctl02 nova-api[27605]: 2017-09-28 12:18:49.995 27605 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:18:49 ctl02 nova-api[27605]: 2017-09-28 12:18:49.995 27605 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:18:49 ctl02 nova-api[27605]: 2017-09-28 12:18:49.995 27605 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:18:49 ctl02 nova-api[27605]: 2017-09-28 12:18:49.995 27605 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:18:49 ctl02 nova-api[27605]: 2017-09-28 12:18:49.995 27605 ERROR nova.wsgi     self.filename))
Sep 28 12:18:49 ctl02 nova-api[27605]: 2017-09-28 12:18:49.995 27605 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:18:49 ctl02 nova-api[27605]: 2017-09-28 12:18:49.995 27605 ERROR nova.wsgi
Sep 28 12:18:49 ctl02 nova-api[27605]: 2017-09-28 12:18:49.997 27605 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:18:50 ctl02 heat-api-cfn[13300]: 2017-09-28 12:18:50.031 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:18:50] "OPTIONS / HTTP/1.0" 200 134 0.000516
Sep 28 12:18:50 ctl02 nova-api[27605]: 2017-09-28 12:18:50.133 27605 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:18:50 ctl02 nova-api[27605]: 2017-09-28 12:18:50.387 27605 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:18:50 ctl02 nova-api[27605]: 2017-09-28 12:18:50.390 27605 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:18:50 ctl02 nova-api[27605]: 2017-09-28 12:18:50.390 27605 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:18:50 ctl02 nova-api[27605]: 2017-09-28 12:18:50.391 27605 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:18:50 ctl02 nova-api[27605]: 2017-09-28 12:18:50.524 27605 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:18:50 ctl02 nova-api[27605]: 2017-09-28 12:18:50.527 27605 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:18:50 ctl02 nova-api[27605]: 2017-09-28 12:18:50.527 27605 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:18:50 ctl02 nova-api[27605]: 2017-09-28 12:18:50.528 27605 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:18:50 ctl02 nova-api[27605]: 2017-09-28 12:18:50.531 27605 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:18:50 ctl02 nova-api[27605]: 2017-09-28 12:18:50.532 27605 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:18:50 ctl02 nova-api[27605]: 2017-09-28 12:18:50.532 27605 ERROR nova Traceback (most recent call last):
Sep 28 12:18:50 ctl02 nova-api[27605]: 2017-09-28 12:18:50.532 27605 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:18:50 ctl02 nova-api[27605]: 2017-09-28 12:18:50.532 27605 ERROR nova     sys.exit(main())
Sep 28 12:18:50 ctl02 nova-api[27605]: 2017-09-28 12:18:50.532 27605 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:18:50 ctl02 nova-api[27605]: 2017-09-28 12:18:50.532 27605 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:18:50 ctl02 nova-api[27605]: 2017-09-28 12:18:50.532 27605 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:18:50 ctl02 nova-api[27605]: 2017-09-28 12:18:50.532 27605 ERROR nova     max_url_len=max_url_len)
Sep 28 12:18:50 ctl02 nova-api[27605]: 2017-09-28 12:18:50.532 27605 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:18:50 ctl02 nova-api[27605]: 2017-09-28 12:18:50.532 27605 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:18:50 ctl02 nova-api[27605]: 2017-09-28 12:18:50.532 27605 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:18:50 ctl02 nova-api[27605]: 2017-09-28 12:18:50.532 27605 ERROR nova     sock.listen(backlog)
Sep 28 12:18:50 ctl02 nova-api[27605]: 2017-09-28 12:18:50.532 27605 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:18:50 ctl02 nova-api[27605]: 2017-09-28 12:18:50.532 27605 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:18:50 ctl02 nova-api[27605]: 2017-09-28 12:18:50.532 27605 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:18:50 ctl02 nova-api[27605]: 2017-09-28 12:18:50.532 27605 ERROR nova
Sep 28 12:18:50 ctl02 glance-api[29183]: 2017-09-28 12:18:50.542 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:18:50] "OPTIONS / HTTP/1.0" 200 134 0.000676
Sep 28 12:18:50 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:18:50 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:18:50 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:18:50 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:18:50 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:18:50 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:18:50 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:18:51 ctl02 heat-api-cfn[13300]: 2017-09-28 12:18:51.960 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:18:51] "OPTIONS / HTTP/1.0" 200 134 0.000513
Sep 28 12:18:52 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:18:52.256 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:18:52] "OPTIONS / HTTP/1.0" 200 134 0.000636
Sep 28 12:18:52 ctl02 glance-api[29183]: 2017-09-28 12:18:52.369 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:18:52] "OPTIONS / HTTP/1.0" 200 134 0.000877
Sep 28 12:18:52 ctl02 nova-api[27628]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:18:52 ctl02 nova-api[27628]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:18:52 ctl02 nova-api[27628]: 2017-09-28 12:18:52.761 27628 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:18:52 ctl02 nova-api[27628]: 2017-09-28 12:18:52.763 27628 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:18:52 ctl02 nova-api[27628]: 2017-09-28 12:18:52.763 27628 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:18:52 ctl02 nova-api[27628]: 2017-09-28 12:18:52.763 27628 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:18:52 ctl02 nova-api[27628]: 2017-09-28 12:18:52.763 27628 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:18:52 ctl02 nova-api[27628]: 2017-09-28 12:18:52.763 27628 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:18:52 ctl02 nova-api[27628]: 2017-09-28 12:18:52.763 27628 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:18:52 ctl02 nova-api[27628]: 2017-09-28 12:18:52.763 27628 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:18:52 ctl02 nova-api[27628]: 2017-09-28 12:18:52.763 27628 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:18:52 ctl02 nova-api[27628]: 2017-09-28 12:18:52.763 27628 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:18:52 ctl02 nova-api[27628]: 2017-09-28 12:18:52.763 27628 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:18:52 ctl02 nova-api[27628]: 2017-09-28 12:18:52.763 27628 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:18:52 ctl02 nova-api[27628]: 2017-09-28 12:18:52.763 27628 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:18:52 ctl02 nova-api[27628]: 2017-09-28 12:18:52.763 27628 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:18:52 ctl02 nova-api[27628]: 2017-09-28 12:18:52.763 27628 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:18:52 ctl02 nova-api[27628]: 2017-09-28 12:18:52.763 27628 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:18:52 ctl02 nova-api[27628]: 2017-09-28 12:18:52.763 27628 ERROR nova.wsgi     self.filename))
Sep 28 12:18:52 ctl02 nova-api[27628]: 2017-09-28 12:18:52.763 27628 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:18:52 ctl02 nova-api[27628]: 2017-09-28 12:18:52.763 27628 ERROR nova.wsgi
Sep 28 12:18:52 ctl02 nova-api[27628]: 2017-09-28 12:18:52.764 27628 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:18:52 ctl02 nova-api[27628]: 2017-09-28 12:18:52.898 27628 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:18:53 ctl02 nova-api[27628]: 2017-09-28 12:18:53.150 27628 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:18:53 ctl02 nova-api[27628]: 2017-09-28 12:18:53.152 27628 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:18:53 ctl02 nova-api[27628]: 2017-09-28 12:18:53.152 27628 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:18:53 ctl02 nova-api[27628]: 2017-09-28 12:18:53.153 27628 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:18:53 ctl02 nova-api[27628]: 2017-09-28 12:18:53.288 27628 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:18:53 ctl02 nova-api[27628]: 2017-09-28 12:18:53.290 27628 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:18:53 ctl02 nova-api[27628]: 2017-09-28 12:18:53.290 27628 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:18:53 ctl02 nova-api[27628]: 2017-09-28 12:18:53.290 27628 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:18:53 ctl02 nova-api[27628]: 2017-09-28 12:18:53.294 27628 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:18:53 ctl02 nova-api[27628]: 2017-09-28 12:18:53.294 27628 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:18:53 ctl02 nova-api[27628]: 2017-09-28 12:18:53.294 27628 ERROR nova Traceback (most recent call last):
Sep 28 12:18:53 ctl02 nova-api[27628]: 2017-09-28 12:18:53.294 27628 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:18:53 ctl02 nova-api[27628]: 2017-09-28 12:18:53.294 27628 ERROR nova     sys.exit(main())
Sep 28 12:18:53 ctl02 nova-api[27628]: 2017-09-28 12:18:53.294 27628 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:18:53 ctl02 nova-api[27628]: 2017-09-28 12:18:53.294 27628 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:18:53 ctl02 nova-api[27628]: 2017-09-28 12:18:53.294 27628 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:18:53 ctl02 nova-api[27628]: 2017-09-28 12:18:53.294 27628 ERROR nova     max_url_len=max_url_len)
Sep 28 12:18:53 ctl02 nova-api[27628]: 2017-09-28 12:18:53.294 27628 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:18:53 ctl02 nova-api[27628]: 2017-09-28 12:18:53.294 27628 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:18:53 ctl02 nova-api[27628]: 2017-09-28 12:18:53.294 27628 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:18:53 ctl02 nova-api[27628]: 2017-09-28 12:18:53.294 27628 ERROR nova     sock.listen(backlog)
Sep 28 12:18:53 ctl02 nova-api[27628]: 2017-09-28 12:18:53.294 27628 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:18:53 ctl02 nova-api[27628]: 2017-09-28 12:18:53.294 27628 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:18:53 ctl02 nova-api[27628]: 2017-09-28 12:18:53.294 27628 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:18:53 ctl02 nova-api[27628]: 2017-09-28 12:18:53.294 27628 ERROR nova
Sep 28 12:18:53 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:18:53 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:18:53 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:18:53 ctl02 glance-api[29183]: 2017-09-28 12:18:53.490 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:18:53] "OPTIONS / HTTP/1.0" 200 134 0.000624
Sep 28 12:18:53 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:18:53 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:18:53 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:18:53 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:18:54 ctl02 nova-consoleauth[5433]: 2017-09-28 12:18:54.849 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:18:54 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:18:54.968 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:18:54] "OPTIONS / HTTP/1.0" 200 134 0.000539
Sep 28 12:18:55 ctl02 nova-api[27646]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:18:55 ctl02 nova-api[27646]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:18:55 ctl02 heat-api[13008]: 2017-09-28 12:18:55.381 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:18:55] "OPTIONS / HTTP/1.0" 200 134 0.000640
Sep 28 12:18:55 ctl02 nova-api[27646]: 2017-09-28 12:18:55.513 27646 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:18:55 ctl02 nova-api[27646]: 2017-09-28 12:18:55.515 27646 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:18:55 ctl02 nova-api[27646]: 2017-09-28 12:18:55.515 27646 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:18:55 ctl02 nova-api[27646]: 2017-09-28 12:18:55.515 27646 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:18:55 ctl02 nova-api[27646]: 2017-09-28 12:18:55.515 27646 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:18:55 ctl02 nova-api[27646]: 2017-09-28 12:18:55.515 27646 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:18:55 ctl02 nova-api[27646]: 2017-09-28 12:18:55.515 27646 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:18:55 ctl02 nova-api[27646]: 2017-09-28 12:18:55.515 27646 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:18:55 ctl02 nova-api[27646]: 2017-09-28 12:18:55.515 27646 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:18:55 ctl02 nova-api[27646]: 2017-09-28 12:18:55.515 27646 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:18:55 ctl02 nova-api[27646]: 2017-09-28 12:18:55.515 27646 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:18:55 ctl02 nova-api[27646]: 2017-09-28 12:18:55.515 27646 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:18:55 ctl02 nova-api[27646]: 2017-09-28 12:18:55.515 27646 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:18:55 ctl02 nova-api[27646]: 2017-09-28 12:18:55.515 27646 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:18:55 ctl02 nova-api[27646]: 2017-09-28 12:18:55.515 27646 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:18:55 ctl02 nova-api[27646]: 2017-09-28 12:18:55.515 27646 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:18:55 ctl02 nova-api[27646]: 2017-09-28 12:18:55.515 27646 ERROR nova.wsgi     self.filename))
Sep 28 12:18:55 ctl02 nova-api[27646]: 2017-09-28 12:18:55.515 27646 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:18:55 ctl02 nova-api[27646]: 2017-09-28 12:18:55.515 27646 ERROR nova.wsgi
Sep 28 12:18:55 ctl02 nova-api[27646]: 2017-09-28 12:18:55.516 27646 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:18:55 ctl02 nova-api[27646]: 2017-09-28 12:18:55.650 27646 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:18:55 ctl02 nova-api[27646]: 2017-09-28 12:18:55.904 27646 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:18:55 ctl02 nova-api[27646]: 2017-09-28 12:18:55.906 27646 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:18:55 ctl02 nova-api[27646]: 2017-09-28 12:18:55.907 27646 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:18:55 ctl02 nova-api[27646]: 2017-09-28 12:18:55.907 27646 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:18:56 ctl02 nova-api[27646]: 2017-09-28 12:18:56.043 27646 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:18:56 ctl02 nova-api[27646]: 2017-09-28 12:18:56.046 27646 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:18:56 ctl02 nova-api[27646]: 2017-09-28 12:18:56.046 27646 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:18:56 ctl02 nova-api[27646]: 2017-09-28 12:18:56.047 27646 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:18:56 ctl02 nova-api[27646]: 2017-09-28 12:18:56.050 27646 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:18:56 ctl02 nova-api[27646]: 2017-09-28 12:18:56.051 27646 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:18:56 ctl02 nova-api[27646]: 2017-09-28 12:18:56.051 27646 ERROR nova Traceback (most recent call last):
Sep 28 12:18:56 ctl02 nova-api[27646]: 2017-09-28 12:18:56.051 27646 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:18:56 ctl02 nova-api[27646]: 2017-09-28 12:18:56.051 27646 ERROR nova     sys.exit(main())
Sep 28 12:18:56 ctl02 nova-api[27646]: 2017-09-28 12:18:56.051 27646 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:18:56 ctl02 nova-api[27646]: 2017-09-28 12:18:56.051 27646 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:18:56 ctl02 nova-api[27646]: 2017-09-28 12:18:56.051 27646 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:18:56 ctl02 nova-api[27646]: 2017-09-28 12:18:56.051 27646 ERROR nova     max_url_len=max_url_len)
Sep 28 12:18:56 ctl02 nova-api[27646]: 2017-09-28 12:18:56.051 27646 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:18:56 ctl02 nova-api[27646]: 2017-09-28 12:18:56.051 27646 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:18:56 ctl02 nova-api[27646]: 2017-09-28 12:18:56.051 27646 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:18:56 ctl02 nova-api[27646]: 2017-09-28 12:18:56.051 27646 ERROR nova     sock.listen(backlog)
Sep 28 12:18:56 ctl02 nova-api[27646]: 2017-09-28 12:18:56.051 27646 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:18:56 ctl02 nova-api[27646]: 2017-09-28 12:18:56.051 27646 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:18:56 ctl02 nova-api[27646]: 2017-09-28 12:18:56.051 27646 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:18:56 ctl02 nova-api[27646]: 2017-09-28 12:18:56.051 27646 ERROR nova
Sep 28 12:18:56 ctl02 heat-api[13008]: 2017-09-28 12:18:56.088 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:18:56] "OPTIONS / HTTP/1.0" 200 134 0.000682
Sep 28 12:18:56 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:18:56 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:18:56 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:18:56 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:18:56 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:18:56 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:18:56 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:18:57 ctl02 heat-engine[12803]: 2017-09-28 12:18:57.659 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:18:57 ctl02 heat-engine[12803]: 2017-09-28 12:18:57.663 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:18:57 ctl02 heat-engine[12803]: 2017-09-28 12:18:57.669 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:18:57 ctl02 heat-engine[12803]: 2017-09-28 12:18:57.670 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:18:57 ctl02 nova-scheduler[5620]: 2017-09-28 12:18:57.873 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:18:58 ctl02 nova-api[27664]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:18:58 ctl02 nova-api[27664]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:18:58 ctl02 nova-api[27664]: 2017-09-28 12:18:58.264 27664 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:18:58 ctl02 nova-api[27664]: 2017-09-28 12:18:58.266 27664 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:18:58 ctl02 nova-api[27664]: 2017-09-28 12:18:58.266 27664 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:18:58 ctl02 nova-api[27664]: 2017-09-28 12:18:58.266 27664 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:18:58 ctl02 nova-api[27664]: 2017-09-28 12:18:58.266 27664 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:18:58 ctl02 nova-api[27664]: 2017-09-28 12:18:58.266 27664 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:18:58 ctl02 nova-api[27664]: 2017-09-28 12:18:58.266 27664 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:18:58 ctl02 nova-api[27664]: 2017-09-28 12:18:58.266 27664 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:18:58 ctl02 nova-api[27664]: 2017-09-28 12:18:58.266 27664 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:18:58 ctl02 nova-api[27664]: 2017-09-28 12:18:58.266 27664 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:18:58 ctl02 nova-api[27664]: 2017-09-28 12:18:58.266 27664 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:18:58 ctl02 nova-api[27664]: 2017-09-28 12:18:58.266 27664 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:18:58 ctl02 nova-api[27664]: 2017-09-28 12:18:58.266 27664 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:18:58 ctl02 nova-api[27664]: 2017-09-28 12:18:58.266 27664 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:18:58 ctl02 nova-api[27664]: 2017-09-28 12:18:58.266 27664 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:18:58 ctl02 nova-api[27664]: 2017-09-28 12:18:58.266 27664 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:18:58 ctl02 nova-api[27664]: 2017-09-28 12:18:58.266 27664 ERROR nova.wsgi     self.filename))
Sep 28 12:18:58 ctl02 nova-api[27664]: 2017-09-28 12:18:58.266 27664 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:18:58 ctl02 nova-api[27664]: 2017-09-28 12:18:58.266 27664 ERROR nova.wsgi
Sep 28 12:18:58 ctl02 nova-api[27664]: 2017-09-28 12:18:58.268 27664 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:18:58 ctl02 nova-api[27664]: 2017-09-28 12:18:58.402 27664 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:18:58 ctl02 nova-api[27664]: 2017-09-28 12:18:58.653 27664 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:18:58 ctl02 nova-api[27664]: 2017-09-28 12:18:58.656 27664 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:18:58 ctl02 nova-api[27664]: 2017-09-28 12:18:58.656 27664 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:18:58 ctl02 nova-api[27664]: 2017-09-28 12:18:58.657 27664 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:18:58 ctl02 nova-api[27664]: 2017-09-28 12:18:58.790 27664 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:18:58 ctl02 nova-api[27664]: 2017-09-28 12:18:58.793 27664 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:18:58 ctl02 nova-api[27664]: 2017-09-28 12:18:58.793 27664 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:18:58 ctl02 nova-api[27664]: 2017-09-28 12:18:58.794 27664 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:18:58 ctl02 nova-api[27664]: 2017-09-28 12:18:58.797 27664 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:18:58 ctl02 nova-api[27664]: 2017-09-28 12:18:58.798 27664 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:18:58 ctl02 nova-api[27664]: 2017-09-28 12:18:58.798 27664 ERROR nova Traceback (most recent call last):
Sep 28 12:18:58 ctl02 nova-api[27664]: 2017-09-28 12:18:58.798 27664 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:18:58 ctl02 nova-api[27664]: 2017-09-28 12:18:58.798 27664 ERROR nova     sys.exit(main())
Sep 28 12:18:58 ctl02 nova-api[27664]: 2017-09-28 12:18:58.798 27664 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:18:58 ctl02 nova-api[27664]: 2017-09-28 12:18:58.798 27664 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:18:58 ctl02 nova-api[27664]: 2017-09-28 12:18:58.798 27664 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:18:58 ctl02 nova-api[27664]: 2017-09-28 12:18:58.798 27664 ERROR nova     max_url_len=max_url_len)
Sep 28 12:18:58 ctl02 nova-api[27664]: 2017-09-28 12:18:58.798 27664 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:18:58 ctl02 nova-api[27664]: 2017-09-28 12:18:58.798 27664 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:18:58 ctl02 nova-api[27664]: 2017-09-28 12:18:58.798 27664 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:18:58 ctl02 nova-api[27664]: 2017-09-28 12:18:58.798 27664 ERROR nova     sock.listen(backlog)
Sep 28 12:18:58 ctl02 nova-api[27664]: 2017-09-28 12:18:58.798 27664 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:18:58 ctl02 nova-api[27664]: 2017-09-28 12:18:58.798 27664 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:18:58 ctl02 nova-api[27664]: 2017-09-28 12:18:58.798 27664 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:18:58 ctl02 nova-api[27664]: 2017-09-28 12:18:58.798 27664 ERROR nova
Sep 28 12:18:58 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:18:58 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:18:58 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:18:59 ctl02 heat-api[13008]: 2017-09-28 12:18:59.046 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:18:59] "OPTIONS / HTTP/1.0" 200 134 0.000655
Sep 28 12:18:59 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:18:59 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:18:59 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:18:59.136 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:18:59] "OPTIONS / HTTP/1.0" 200 134 0.000532
Sep 28 12:18:59 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:18:59 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:18:59 ctl02 heat-api-cfn[13300]: 2017-09-28 12:18:59.274 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:18:59] "OPTIONS / HTTP/1.0" 200 134 0.000535
Sep 28 12:18:59 ctl02 heat-api-cfn[13300]: 2017-09-28 12:18:59.933 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:18:59] "OPTIONS / HTTP/1.0" 200 134 0.000577
Sep 28 12:19:00 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x10eaf769)
Sep 28 12:19:00 ctl02 glance-api[29183]: 2017-09-28 12:19:00.411 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:19:00] "OPTIONS / HTTP/1.0" 200 134 0.000637
Sep 28 12:19:00 ctl02 nova-api[27682]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:19:00 ctl02 nova-api[27682]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:19:00 ctl02 nova-api[27682]: 2017-09-28 12:19:00.981 27682 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:19:00 ctl02 nova-api[27682]: 2017-09-28 12:19:00.983 27682 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:19:00 ctl02 nova-api[27682]: 2017-09-28 12:19:00.983 27682 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:19:00 ctl02 nova-api[27682]: 2017-09-28 12:19:00.983 27682 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:19:00 ctl02 nova-api[27682]: 2017-09-28 12:19:00.983 27682 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:19:00 ctl02 nova-api[27682]: 2017-09-28 12:19:00.983 27682 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:19:00 ctl02 nova-api[27682]: 2017-09-28 12:19:00.983 27682 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:19:00 ctl02 nova-api[27682]: 2017-09-28 12:19:00.983 27682 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:19:00 ctl02 nova-api[27682]: 2017-09-28 12:19:00.983 27682 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:19:00 ctl02 nova-api[27682]: 2017-09-28 12:19:00.983 27682 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:19:00 ctl02 nova-api[27682]: 2017-09-28 12:19:00.983 27682 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:19:00 ctl02 nova-api[27682]: 2017-09-28 12:19:00.983 27682 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:19:00 ctl02 nova-api[27682]: 2017-09-28 12:19:00.983 27682 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:19:00 ctl02 nova-api[27682]: 2017-09-28 12:19:00.983 27682 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:19:00 ctl02 nova-api[27682]: 2017-09-28 12:19:00.983 27682 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:19:00 ctl02 nova-api[27682]: 2017-09-28 12:19:00.983 27682 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:19:00 ctl02 nova-api[27682]: 2017-09-28 12:19:00.983 27682 ERROR nova.wsgi     self.filename))
Sep 28 12:19:00 ctl02 nova-api[27682]: 2017-09-28 12:19:00.983 27682 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:19:00 ctl02 nova-api[27682]: 2017-09-28 12:19:00.983 27682 ERROR nova.wsgi
Sep 28 12:19:00 ctl02 nova-api[27682]: 2017-09-28 12:19:00.985 27682 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:19:01 ctl02 nova-api[27682]: 2017-09-28 12:19:01.118 27682 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:19:01 ctl02 nova-api[27682]: 2017-09-28 12:19:01.368 27682 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:19:01 ctl02 nova-api[27682]: 2017-09-28 12:19:01.371 27682 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:19:01 ctl02 nova-api[27682]: 2017-09-28 12:19:01.371 27682 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:19:01 ctl02 nova-api[27682]: 2017-09-28 12:19:01.371 27682 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:19:01 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x10eaf769)
Sep 28 12:19:01 ctl02 nova-api[27682]: 2017-09-28 12:19:01.505 27682 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:19:01 ctl02 nova-api[27682]: 2017-09-28 12:19:01.507 27682 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:19:01 ctl02 nova-api[27682]: 2017-09-28 12:19:01.508 27682 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:19:01 ctl02 nova-api[27682]: 2017-09-28 12:19:01.508 27682 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:19:01 ctl02 nova-api[27682]: 2017-09-28 12:19:01.512 27682 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:19:01 ctl02 nova-api[27682]: 2017-09-28 12:19:01.512 27682 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:19:01 ctl02 nova-api[27682]: 2017-09-28 12:19:01.512 27682 ERROR nova Traceback (most recent call last):
Sep 28 12:19:01 ctl02 nova-api[27682]: 2017-09-28 12:19:01.512 27682 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:19:01 ctl02 nova-api[27682]: 2017-09-28 12:19:01.512 27682 ERROR nova     sys.exit(main())
Sep 28 12:19:01 ctl02 nova-api[27682]: 2017-09-28 12:19:01.512 27682 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:19:01 ctl02 nova-api[27682]: 2017-09-28 12:19:01.512 27682 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:19:01 ctl02 nova-api[27682]: 2017-09-28 12:19:01.512 27682 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:19:01 ctl02 nova-api[27682]: 2017-09-28 12:19:01.512 27682 ERROR nova     max_url_len=max_url_len)
Sep 28 12:19:01 ctl02 nova-api[27682]: 2017-09-28 12:19:01.512 27682 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:19:01 ctl02 nova-api[27682]: 2017-09-28 12:19:01.512 27682 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:19:01 ctl02 nova-api[27682]: 2017-09-28 12:19:01.512 27682 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:19:01 ctl02 nova-api[27682]: 2017-09-28 12:19:01.512 27682 ERROR nova     sock.listen(backlog)
Sep 28 12:19:01 ctl02 nova-api[27682]: 2017-09-28 12:19:01.512 27682 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:19:01 ctl02 nova-api[27682]: 2017-09-28 12:19:01.512 27682 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:19:01 ctl02 nova-api[27682]: 2017-09-28 12:19:01.512 27682 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:19:01 ctl02 nova-api[27682]: 2017-09-28 12:19:01.512 27682 ERROR nova
Sep 28 12:19:01 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:19:01 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:19:01 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:19:01 ctl02 heat-api-cfn[13300]: 2017-09-28 12:19:01.774 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:19:01] "OPTIONS / HTTP/1.0" 200 134 0.000578
Sep 28 12:19:01 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:19:01 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:19:01 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:19:01 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:19:02 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x10eaf769)
Sep 28 12:19:02 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:19:02.436 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:19:02] "OPTIONS / HTTP/1.0" 200 134 0.000470
Sep 28 12:19:02 ctl02 glance-api[29183]: 2017-09-28 12:19:02.722 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:19:02] "OPTIONS / HTTP/1.0" 200 134 0.000571
Sep 28 12:19:03 ctl02 glance-api[29183]: 2017-09-28 12:19:03.319 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:19:03] "OPTIONS / HTTP/1.0" 200 134 0.000500
Sep 28 12:19:03 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x10eaf769)
Sep 28 12:19:03 ctl02 nova-api[27699]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:19:03 ctl02 nova-api[27699]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:19:03 ctl02 nova-api[27699]: 2017-09-28 12:19:03.749 27699 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:19:03 ctl02 nova-api[27699]: 2017-09-28 12:19:03.751 27699 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:19:03 ctl02 nova-api[27699]: 2017-09-28 12:19:03.751 27699 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:19:03 ctl02 nova-api[27699]: 2017-09-28 12:19:03.751 27699 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:19:03 ctl02 nova-api[27699]: 2017-09-28 12:19:03.751 27699 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:19:03 ctl02 nova-api[27699]: 2017-09-28 12:19:03.751 27699 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:19:03 ctl02 nova-api[27699]: 2017-09-28 12:19:03.751 27699 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:19:03 ctl02 nova-api[27699]: 2017-09-28 12:19:03.751 27699 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:19:03 ctl02 nova-api[27699]: 2017-09-28 12:19:03.751 27699 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:19:03 ctl02 nova-api[27699]: 2017-09-28 12:19:03.751 27699 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:19:03 ctl02 nova-api[27699]: 2017-09-28 12:19:03.751 27699 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:19:03 ctl02 nova-api[27699]: 2017-09-28 12:19:03.751 27699 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:19:03 ctl02 nova-api[27699]: 2017-09-28 12:19:03.751 27699 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:19:03 ctl02 nova-api[27699]: 2017-09-28 12:19:03.751 27699 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:19:03 ctl02 nova-api[27699]: 2017-09-28 12:19:03.751 27699 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:19:03 ctl02 nova-api[27699]: 2017-09-28 12:19:03.751 27699 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:19:03 ctl02 nova-api[27699]: 2017-09-28 12:19:03.751 27699 ERROR nova.wsgi     self.filename))
Sep 28 12:19:03 ctl02 nova-api[27699]: 2017-09-28 12:19:03.751 27699 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:19:03 ctl02 nova-api[27699]: 2017-09-28 12:19:03.751 27699 ERROR nova.wsgi
Sep 28 12:19:03 ctl02 nova-api[27699]: 2017-09-28 12:19:03.752 27699 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:19:03 ctl02 nova-api[27699]: 2017-09-28 12:19:03.881 27699 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:19:04 ctl02 nova-api[27699]: 2017-09-28 12:19:04.108 27699 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:19:04 ctl02 nova-api[27699]: 2017-09-28 12:19:04.110 27699 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:19:04 ctl02 nova-api[27699]: 2017-09-28 12:19:04.110 27699 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:19:04 ctl02 nova-api[27699]: 2017-09-28 12:19:04.111 27699 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:19:04 ctl02 nova-api[27699]: 2017-09-28 12:19:04.239 27699 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:19:04 ctl02 nova-api[27699]: 2017-09-28 12:19:04.241 27699 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:19:04 ctl02 nova-api[27699]: 2017-09-28 12:19:04.241 27699 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:19:04 ctl02 nova-api[27699]: 2017-09-28 12:19:04.242 27699 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:19:04 ctl02 nova-api[27699]: 2017-09-28 12:19:04.245 27699 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:19:04 ctl02 nova-api[27699]: 2017-09-28 12:19:04.245 27699 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:19:04 ctl02 nova-api[27699]: 2017-09-28 12:19:04.245 27699 ERROR nova Traceback (most recent call last):
Sep 28 12:19:04 ctl02 nova-api[27699]: 2017-09-28 12:19:04.245 27699 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:19:04 ctl02 nova-api[27699]: 2017-09-28 12:19:04.245 27699 ERROR nova     sys.exit(main())
Sep 28 12:19:04 ctl02 nova-api[27699]: 2017-09-28 12:19:04.245 27699 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:19:04 ctl02 nova-api[27699]: 2017-09-28 12:19:04.245 27699 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:19:04 ctl02 nova-api[27699]: 2017-09-28 12:19:04.245 27699 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:19:04 ctl02 nova-api[27699]: 2017-09-28 12:19:04.245 27699 ERROR nova     max_url_len=max_url_len)
Sep 28 12:19:04 ctl02 nova-api[27699]: 2017-09-28 12:19:04.245 27699 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:19:04 ctl02 nova-api[27699]: 2017-09-28 12:19:04.245 27699 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:19:04 ctl02 nova-api[27699]: 2017-09-28 12:19:04.245 27699 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:19:04 ctl02 nova-api[27699]: 2017-09-28 12:19:04.245 27699 ERROR nova     sock.listen(backlog)
Sep 28 12:19:04 ctl02 nova-api[27699]: 2017-09-28 12:19:04.245 27699 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:19:04 ctl02 nova-api[27699]: 2017-09-28 12:19:04.245 27699 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:19:04 ctl02 nova-api[27699]: 2017-09-28 12:19:04.245 27699 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:19:04 ctl02 nova-api[27699]: 2017-09-28 12:19:04.245 27699 ERROR nova
Sep 28 12:19:04 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x10eaf769)
Sep 28 12:19:04 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:19:04 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:19:04 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:19:04 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:19:04 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:19:04 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:19:04 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:19:04 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:19:04.777 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:19:04] "OPTIONS / HTTP/1.0" 200 134 0.000477
Sep 28 12:19:05 ctl02 heat-api[13008]: 2017-09-28 12:19:05.236 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:19:05] "OPTIONS / HTTP/1.0" 200 134 0.000657
Sep 28 12:19:05 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x10eaf769)
Sep 28 12:19:05 ctl02 heat-api[13008]: 2017-09-28 12:19:05.940 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:19:05] "OPTIONS / HTTP/1.0" 200 134 0.000655
Sep 28 12:19:06 ctl02 nova-api[27718]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:19:06 ctl02 nova-api[27718]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:19:06 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x10eaf769)
Sep 28 12:19:06 ctl02 nova-api[27718]: 2017-09-28 12:19:06.536 27718 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:19:06 ctl02 nova-api[27718]: 2017-09-28 12:19:06.538 27718 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:19:06 ctl02 nova-api[27718]: 2017-09-28 12:19:06.538 27718 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:19:06 ctl02 nova-api[27718]: 2017-09-28 12:19:06.538 27718 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:19:06 ctl02 nova-api[27718]: 2017-09-28 12:19:06.538 27718 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:19:06 ctl02 nova-api[27718]: 2017-09-28 12:19:06.538 27718 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:19:06 ctl02 nova-api[27718]: 2017-09-28 12:19:06.538 27718 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:19:06 ctl02 nova-api[27718]: 2017-09-28 12:19:06.538 27718 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:19:06 ctl02 nova-api[27718]: 2017-09-28 12:19:06.538 27718 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:19:06 ctl02 nova-api[27718]: 2017-09-28 12:19:06.538 27718 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:19:06 ctl02 nova-api[27718]: 2017-09-28 12:19:06.538 27718 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:19:06 ctl02 nova-api[27718]: 2017-09-28 12:19:06.538 27718 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:19:06 ctl02 nova-api[27718]: 2017-09-28 12:19:06.538 27718 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:19:06 ctl02 nova-api[27718]: 2017-09-28 12:19:06.538 27718 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:19:06 ctl02 nova-api[27718]: 2017-09-28 12:19:06.538 27718 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:19:06 ctl02 nova-api[27718]: 2017-09-28 12:19:06.538 27718 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:19:06 ctl02 nova-api[27718]: 2017-09-28 12:19:06.538 27718 ERROR nova.wsgi     self.filename))
Sep 28 12:19:06 ctl02 nova-api[27718]: 2017-09-28 12:19:06.538 27718 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:19:06 ctl02 nova-api[27718]: 2017-09-28 12:19:06.538 27718 ERROR nova.wsgi
Sep 28 12:19:06 ctl02 nova-api[27718]: 2017-09-28 12:19:06.539 27718 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:19:06 ctl02 nova-api[27718]: 2017-09-28 12:19:06.675 27718 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:19:06 ctl02 nova-api[27718]: 2017-09-28 12:19:06.925 27718 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:19:06 ctl02 nova-api[27718]: 2017-09-28 12:19:06.927 27718 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:19:06 ctl02 nova-api[27718]: 2017-09-28 12:19:06.927 27718 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:19:06 ctl02 nova-api[27718]: 2017-09-28 12:19:06.928 27718 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:19:07 ctl02 nova-api[27718]: 2017-09-28 12:19:07.061 27718 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:19:07 ctl02 nova-api[27718]: 2017-09-28 12:19:07.063 27718 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:19:07 ctl02 nova-api[27718]: 2017-09-28 12:19:07.063 27718 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:19:07 ctl02 nova-api[27718]: 2017-09-28 12:19:07.064 27718 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:19:07 ctl02 nova-api[27718]: 2017-09-28 12:19:07.067 27718 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:19:07 ctl02 nova-api[27718]: 2017-09-28 12:19:07.067 27718 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:19:07 ctl02 nova-api[27718]: 2017-09-28 12:19:07.067 27718 ERROR nova Traceback (most recent call last):
Sep 28 12:19:07 ctl02 nova-api[27718]: 2017-09-28 12:19:07.067 27718 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:19:07 ctl02 nova-api[27718]: 2017-09-28 12:19:07.067 27718 ERROR nova     sys.exit(main())
Sep 28 12:19:07 ctl02 nova-api[27718]: 2017-09-28 12:19:07.067 27718 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:19:07 ctl02 nova-api[27718]: 2017-09-28 12:19:07.067 27718 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:19:07 ctl02 nova-api[27718]: 2017-09-28 12:19:07.067 27718 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:19:07 ctl02 nova-api[27718]: 2017-09-28 12:19:07.067 27718 ERROR nova     max_url_len=max_url_len)
Sep 28 12:19:07 ctl02 nova-api[27718]: 2017-09-28 12:19:07.067 27718 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:19:07 ctl02 nova-api[27718]: 2017-09-28 12:19:07.067 27718 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:19:07 ctl02 nova-api[27718]: 2017-09-28 12:19:07.067 27718 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:19:07 ctl02 nova-api[27718]: 2017-09-28 12:19:07.067 27718 ERROR nova     sock.listen(backlog)
Sep 28 12:19:07 ctl02 nova-api[27718]: 2017-09-28 12:19:07.067 27718 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:19:07 ctl02 nova-api[27718]: 2017-09-28 12:19:07.067 27718 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:19:07 ctl02 nova-api[27718]: 2017-09-28 12:19:07.067 27718 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:19:07 ctl02 nova-api[27718]: 2017-09-28 12:19:07.067 27718 ERROR nova
Sep 28 12:19:07 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:19:07 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:19:07 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:19:07 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:19:07 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:19:07 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x10eaf769)
Sep 28 12:19:07 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:19:07 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:19:08 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x10eaf769)
Sep 28 12:19:08 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:19:08.968 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:19:08] "OPTIONS / HTTP/1.0" 200 134 0.000495
Sep 28 12:19:08 ctl02 heat-api-cfn[13300]: 2017-09-28 12:19:08.974 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:19:08] "OPTIONS / HTTP/1.0" 200 134 0.000492
Sep 28 12:19:09 ctl02 nova-api[27735]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:19:09 ctl02 nova-api[27735]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:19:09 ctl02 heat-api[13008]: 2017-09-28 12:19:09.180 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:19:09] "OPTIONS / HTTP/1.0" 200 134 0.000630
Sep 28 12:19:09 ctl02 nova-api[27735]: 2017-09-28 12:19:09.237 27735 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:19:09 ctl02 nova-api[27735]: 2017-09-28 12:19:09.239 27735 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:19:09 ctl02 nova-api[27735]: 2017-09-28 12:19:09.239 27735 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:19:09 ctl02 nova-api[27735]: 2017-09-28 12:19:09.239 27735 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:19:09 ctl02 nova-api[27735]: 2017-09-28 12:19:09.239 27735 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:19:09 ctl02 nova-api[27735]: 2017-09-28 12:19:09.239 27735 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:19:09 ctl02 nova-api[27735]: 2017-09-28 12:19:09.239 27735 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:19:09 ctl02 nova-api[27735]: 2017-09-28 12:19:09.239 27735 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:19:09 ctl02 nova-api[27735]: 2017-09-28 12:19:09.239 27735 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:19:09 ctl02 nova-api[27735]: 2017-09-28 12:19:09.239 27735 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:19:09 ctl02 nova-api[27735]: 2017-09-28 12:19:09.239 27735 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:19:09 ctl02 nova-api[27735]: 2017-09-28 12:19:09.239 27735 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:19:09 ctl02 nova-api[27735]: 2017-09-28 12:19:09.239 27735 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:19:09 ctl02 nova-api[27735]: 2017-09-28 12:19:09.239 27735 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:19:09 ctl02 nova-api[27735]: 2017-09-28 12:19:09.239 27735 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:19:09 ctl02 nova-api[27735]: 2017-09-28 12:19:09.239 27735 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:19:09 ctl02 nova-api[27735]: 2017-09-28 12:19:09.239 27735 ERROR nova.wsgi     self.filename))
Sep 28 12:19:09 ctl02 nova-api[27735]: 2017-09-28 12:19:09.239 27735 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:19:09 ctl02 nova-api[27735]: 2017-09-28 12:19:09.239 27735 ERROR nova.wsgi
Sep 28 12:19:09 ctl02 nova-api[27735]: 2017-09-28 12:19:09.240 27735 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:19:09 ctl02 nova-api[27735]: 2017-09-28 12:19:09.375 27735 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:19:09 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x10eaf769)
Sep 28 12:19:09 ctl02 nova-api[27735]: 2017-09-28 12:19:09.626 27735 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:19:09 ctl02 nova-api[27735]: 2017-09-28 12:19:09.629 27735 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:19:09 ctl02 nova-api[27735]: 2017-09-28 12:19:09.629 27735 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:19:09 ctl02 nova-api[27735]: 2017-09-28 12:19:09.629 27735 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:19:09 ctl02 nova-api[27735]: 2017-09-28 12:19:09.763 27735 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:19:09 ctl02 nova-api[27735]: 2017-09-28 12:19:09.765 27735 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:19:09 ctl02 nova-api[27735]: 2017-09-28 12:19:09.765 27735 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:19:09 ctl02 nova-api[27735]: 2017-09-28 12:19:09.765 27735 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:19:09 ctl02 nova-api[27735]: 2017-09-28 12:19:09.769 27735 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:19:09 ctl02 nova-api[27735]: 2017-09-28 12:19:09.769 27735 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:19:09 ctl02 nova-api[27735]: 2017-09-28 12:19:09.769 27735 ERROR nova Traceback (most recent call last):
Sep 28 12:19:09 ctl02 nova-api[27735]: 2017-09-28 12:19:09.769 27735 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:19:09 ctl02 nova-api[27735]: 2017-09-28 12:19:09.769 27735 ERROR nova     sys.exit(main())
Sep 28 12:19:09 ctl02 nova-api[27735]: 2017-09-28 12:19:09.769 27735 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:19:09 ctl02 nova-api[27735]: 2017-09-28 12:19:09.769 27735 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:19:09 ctl02 nova-api[27735]: 2017-09-28 12:19:09.769 27735 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:19:09 ctl02 nova-api[27735]: 2017-09-28 12:19:09.769 27735 ERROR nova     max_url_len=max_url_len)
Sep 28 12:19:09 ctl02 nova-api[27735]: 2017-09-28 12:19:09.769 27735 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:19:09 ctl02 nova-api[27735]: 2017-09-28 12:19:09.769 27735 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:19:09 ctl02 nova-api[27735]: 2017-09-28 12:19:09.769 27735 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:19:09 ctl02 nova-api[27735]: 2017-09-28 12:19:09.769 27735 ERROR nova     sock.listen(backlog)
Sep 28 12:19:09 ctl02 nova-api[27735]: 2017-09-28 12:19:09.769 27735 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:19:09 ctl02 nova-api[27735]: 2017-09-28 12:19:09.769 27735 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:19:09 ctl02 nova-api[27735]: 2017-09-28 12:19:09.769 27735 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:19:09 ctl02 nova-api[27735]: 2017-09-28 12:19:09.769 27735 ERROR nova
Sep 28 12:19:09 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:19:09 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:19:09 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:19:10 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:19:10 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:19:10 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:19:10 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:19:10 ctl02 heat-api-cfn[13300]: 2017-09-28 12:19:10.205 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:19:10] "OPTIONS / HTTP/1.0" 200 134 0.000767
Sep 28 12:19:10 ctl02 glance-api[29183]: 2017-09-28 12:19:10.300 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:19:10] "OPTIONS / HTTP/1.0" 200 134 0.000649
Sep 28 12:19:10 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x10eaf769)
Sep 28 12:19:11 ctl02 heat-api-cfn[13300]: 2017-09-28 12:19:11.381 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:19:11] "OPTIONS / HTTP/1.0" 200 134 0.000750
Sep 28 12:19:11 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:19:11 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:19:11 ctl02 nova-api[27754]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:19:11 ctl02 nova-api[27754]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:19:11 ctl02 nova-api[27754]: 2017-09-28 12:19:11.995 27754 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:19:11 ctl02 nova-api[27754]: 2017-09-28 12:19:11.997 27754 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:19:11 ctl02 nova-api[27754]: 2017-09-28 12:19:11.997 27754 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:19:11 ctl02 nova-api[27754]: 2017-09-28 12:19:11.997 27754 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:19:11 ctl02 nova-api[27754]: 2017-09-28 12:19:11.997 27754 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:19:11 ctl02 nova-api[27754]: 2017-09-28 12:19:11.997 27754 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:19:11 ctl02 nova-api[27754]: 2017-09-28 12:19:11.997 27754 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:19:11 ctl02 nova-api[27754]: 2017-09-28 12:19:11.997 27754 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:19:11 ctl02 nova-api[27754]: 2017-09-28 12:19:11.997 27754 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:19:11 ctl02 nova-api[27754]: 2017-09-28 12:19:11.997 27754 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:19:11 ctl02 nova-api[27754]: 2017-09-28 12:19:11.997 27754 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:19:11 ctl02 nova-api[27754]: 2017-09-28 12:19:11.997 27754 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:19:11 ctl02 nova-api[27754]: 2017-09-28 12:19:11.997 27754 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:19:11 ctl02 nova-api[27754]: 2017-09-28 12:19:11.997 27754 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:19:11 ctl02 nova-api[27754]: 2017-09-28 12:19:11.997 27754 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:19:11 ctl02 nova-api[27754]: 2017-09-28 12:19:11.997 27754 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:19:11 ctl02 nova-api[27754]: 2017-09-28 12:19:11.997 27754 ERROR nova.wsgi     self.filename))
Sep 28 12:19:11 ctl02 nova-api[27754]: 2017-09-28 12:19:11.997 27754 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:19:11 ctl02 nova-api[27754]: 2017-09-28 12:19:11.997 27754 ERROR nova.wsgi
Sep 28 12:19:11 ctl02 nova-api[27754]: 2017-09-28 12:19:11.998 27754 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:19:12 ctl02 nova-api[27754]: 2017-09-28 12:19:12.132 27754 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:19:12 ctl02 nova-api[27754]: 2017-09-28 12:19:12.383 27754 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:19:12 ctl02 nova-api[27754]: 2017-09-28 12:19:12.385 27754 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:19:12 ctl02 nova-api[27754]: 2017-09-28 12:19:12.386 27754 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:19:12 ctl02 nova-api[27754]: 2017-09-28 12:19:12.386 27754 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:19:12 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:19:12.512 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:19:12] "OPTIONS / HTTP/1.0" 200 134 0.000474
Sep 28 12:19:12 ctl02 nova-api[27754]: 2017-09-28 12:19:12.520 27754 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:19:12 ctl02 nova-api[27754]: 2017-09-28 12:19:12.522 27754 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:19:12 ctl02 nova-api[27754]: 2017-09-28 12:19:12.522 27754 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:19:12 ctl02 nova-api[27754]: 2017-09-28 12:19:12.523 27754 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:19:12 ctl02 nova-api[27754]: 2017-09-28 12:19:12.526 27754 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:19:12 ctl02 nova-api[27754]: 2017-09-28 12:19:12.526 27754 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:19:12 ctl02 nova-api[27754]: 2017-09-28 12:19:12.526 27754 ERROR nova Traceback (most recent call last):
Sep 28 12:19:12 ctl02 nova-api[27754]: 2017-09-28 12:19:12.526 27754 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:19:12 ctl02 nova-api[27754]: 2017-09-28 12:19:12.526 27754 ERROR nova     sys.exit(main())
Sep 28 12:19:12 ctl02 nova-api[27754]: 2017-09-28 12:19:12.526 27754 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:19:12 ctl02 nova-api[27754]: 2017-09-28 12:19:12.526 27754 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:19:12 ctl02 nova-api[27754]: 2017-09-28 12:19:12.526 27754 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:19:12 ctl02 nova-api[27754]: 2017-09-28 12:19:12.526 27754 ERROR nova     max_url_len=max_url_len)
Sep 28 12:19:12 ctl02 nova-api[27754]: 2017-09-28 12:19:12.526 27754 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:19:12 ctl02 nova-api[27754]: 2017-09-28 12:19:12.526 27754 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:19:12 ctl02 nova-api[27754]: 2017-09-28 12:19:12.526 27754 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:19:12 ctl02 nova-api[27754]: 2017-09-28 12:19:12.526 27754 ERROR nova     sock.listen(backlog)
Sep 28 12:19:12 ctl02 nova-api[27754]: 2017-09-28 12:19:12.526 27754 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:19:12 ctl02 nova-api[27754]: 2017-09-28 12:19:12.526 27754 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:19:12 ctl02 nova-api[27754]: 2017-09-28 12:19:12.526 27754 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:19:12 ctl02 nova-api[27754]: 2017-09-28 12:19:12.526 27754 ERROR nova
Sep 28 12:19:12 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:19:12 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:19:12 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:19:12 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:19:12 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:19:12 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:19:12 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:19:12 ctl02 glance-api[29183]: 2017-09-28 12:19:12.936 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:19:12] "OPTIONS / HTTP/1.0" 200 134 0.000729
Sep 28 12:19:13 ctl02 glance-api[29183]: 2017-09-28 12:19:13.363 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:19:13] "OPTIONS / HTTP/1.0" 200 134 0.000594
Sep 28 12:19:14 ctl02 nova-api[27777]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:19:14 ctl02 nova-api[27777]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:19:14 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:19:14.578 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:19:14] "OPTIONS / HTTP/1.0" 200 134 0.000557
Sep 28 12:19:14 ctl02 nova-api[27777]: 2017-09-28 12:19:14.721 27777 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:19:14 ctl02 nova-api[27777]: 2017-09-28 12:19:14.723 27777 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:19:14 ctl02 nova-api[27777]: 2017-09-28 12:19:14.723 27777 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:19:14 ctl02 nova-api[27777]: 2017-09-28 12:19:14.723 27777 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:19:14 ctl02 nova-api[27777]: 2017-09-28 12:19:14.723 27777 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:19:14 ctl02 nova-api[27777]: 2017-09-28 12:19:14.723 27777 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:19:14 ctl02 nova-api[27777]: 2017-09-28 12:19:14.723 27777 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:19:14 ctl02 nova-api[27777]: 2017-09-28 12:19:14.723 27777 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:19:14 ctl02 nova-api[27777]: 2017-09-28 12:19:14.723 27777 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:19:14 ctl02 nova-api[27777]: 2017-09-28 12:19:14.723 27777 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:19:14 ctl02 nova-api[27777]: 2017-09-28 12:19:14.723 27777 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:19:14 ctl02 nova-api[27777]: 2017-09-28 12:19:14.723 27777 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:19:14 ctl02 nova-api[27777]: 2017-09-28 12:19:14.723 27777 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:19:14 ctl02 nova-api[27777]: 2017-09-28 12:19:14.723 27777 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:19:14 ctl02 nova-api[27777]: 2017-09-28 12:19:14.723 27777 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:19:14 ctl02 nova-api[27777]: 2017-09-28 12:19:14.723 27777 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:19:14 ctl02 nova-api[27777]: 2017-09-28 12:19:14.723 27777 ERROR nova.wsgi     self.filename))
Sep 28 12:19:14 ctl02 nova-api[27777]: 2017-09-28 12:19:14.723 27777 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:19:14 ctl02 nova-api[27777]: 2017-09-28 12:19:14.723 27777 ERROR nova.wsgi
Sep 28 12:19:14 ctl02 nova-api[27777]: 2017-09-28 12:19:14.724 27777 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:19:14 ctl02 nova-api[27777]: 2017-09-28 12:19:14.860 27777 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:19:15 ctl02 nova-api[27777]: 2017-09-28 12:19:15.113 27777 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:19:15 ctl02 nova-api[27777]: 2017-09-28 12:19:15.115 27777 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:19:15 ctl02 nova-api[27777]: 2017-09-28 12:19:15.115 27777 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:19:15 ctl02 nova-api[27777]: 2017-09-28 12:19:15.116 27777 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:19:15 ctl02 nova-api[27777]: 2017-09-28 12:19:15.248 27777 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:19:15 ctl02 nova-api[27777]: 2017-09-28 12:19:15.250 27777 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:19:15 ctl02 nova-api[27777]: 2017-09-28 12:19:15.250 27777 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:19:15 ctl02 nova-api[27777]: 2017-09-28 12:19:15.250 27777 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:19:15 ctl02 nova-api[27777]: 2017-09-28 12:19:15.254 27777 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:19:15 ctl02 nova-api[27777]: 2017-09-28 12:19:15.254 27777 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:19:15 ctl02 nova-api[27777]: 2017-09-28 12:19:15.254 27777 ERROR nova Traceback (most recent call last):
Sep 28 12:19:15 ctl02 nova-api[27777]: 2017-09-28 12:19:15.254 27777 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:19:15 ctl02 nova-api[27777]: 2017-09-28 12:19:15.254 27777 ERROR nova     sys.exit(main())
Sep 28 12:19:15 ctl02 nova-api[27777]: 2017-09-28 12:19:15.254 27777 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:19:15 ctl02 nova-api[27777]: 2017-09-28 12:19:15.254 27777 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:19:15 ctl02 nova-api[27777]: 2017-09-28 12:19:15.254 27777 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:19:15 ctl02 nova-api[27777]: 2017-09-28 12:19:15.254 27777 ERROR nova     max_url_len=max_url_len)
Sep 28 12:19:15 ctl02 nova-api[27777]: 2017-09-28 12:19:15.254 27777 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:19:15 ctl02 nova-api[27777]: 2017-09-28 12:19:15.254 27777 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:19:15 ctl02 nova-api[27777]: 2017-09-28 12:19:15.254 27777 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:19:15 ctl02 nova-api[27777]: 2017-09-28 12:19:15.254 27777 ERROR nova     sock.listen(backlog)
Sep 28 12:19:15 ctl02 nova-api[27777]: 2017-09-28 12:19:15.254 27777 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:19:15 ctl02 nova-api[27777]: 2017-09-28 12:19:15.254 27777 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:19:15 ctl02 nova-api[27777]: 2017-09-28 12:19:15.254 27777 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:19:15 ctl02 nova-api[27777]: 2017-09-28 12:19:15.254 27777 ERROR nova
Sep 28 12:19:15 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:19:15 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:19:15 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:19:15 ctl02 heat-api[13008]: 2017-09-28 12:19:15.566 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:19:15] "OPTIONS / HTTP/1.0" 200 134 0.000632
Sep 28 12:19:15 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:19:15 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:19:15 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:19:15 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:19:16 ctl02 heat-api[13008]: 2017-09-28 12:19:16.057 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:19:16] "OPTIONS / HTTP/1.0" 200 134 0.000911
Sep 28 12:19:17 ctl02 nova-cert[4860]: 2017-09-28 12:19:17.006 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:19:17 ctl02 nova-api[27795]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:19:17 ctl02 nova-api[27795]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:19:17 ctl02 nova-api[27795]: 2017-09-28 12:19:17.491 27795 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:19:17 ctl02 nova-api[27795]: 2017-09-28 12:19:17.494 27795 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:19:17 ctl02 nova-api[27795]: 2017-09-28 12:19:17.494 27795 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:19:17 ctl02 nova-api[27795]: 2017-09-28 12:19:17.494 27795 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:19:17 ctl02 nova-api[27795]: 2017-09-28 12:19:17.494 27795 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:19:17 ctl02 nova-api[27795]: 2017-09-28 12:19:17.494 27795 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:19:17 ctl02 nova-api[27795]: 2017-09-28 12:19:17.494 27795 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:19:17 ctl02 nova-api[27795]: 2017-09-28 12:19:17.494 27795 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:19:17 ctl02 nova-api[27795]: 2017-09-28 12:19:17.494 27795 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:19:17 ctl02 nova-api[27795]: 2017-09-28 12:19:17.494 27795 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:19:17 ctl02 nova-api[27795]: 2017-09-28 12:19:17.494 27795 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:19:17 ctl02 nova-api[27795]: 2017-09-28 12:19:17.494 27795 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:19:17 ctl02 nova-api[27795]: 2017-09-28 12:19:17.494 27795 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:19:17 ctl02 nova-api[27795]: 2017-09-28 12:19:17.494 27795 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:19:17 ctl02 nova-api[27795]: 2017-09-28 12:19:17.494 27795 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:19:17 ctl02 nova-api[27795]: 2017-09-28 12:19:17.494 27795 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:19:17 ctl02 nova-api[27795]: 2017-09-28 12:19:17.494 27795 ERROR nova.wsgi     self.filename))
Sep 28 12:19:17 ctl02 nova-api[27795]: 2017-09-28 12:19:17.494 27795 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:19:17 ctl02 nova-api[27795]: 2017-09-28 12:19:17.494 27795 ERROR nova.wsgi
Sep 28 12:19:17 ctl02 nova-api[27795]: 2017-09-28 12:19:17.496 27795 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:19:17 ctl02 nova-api[27795]: 2017-09-28 12:19:17.633 27795 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:19:17 ctl02 nova-api[27795]: 2017-09-28 12:19:17.885 27795 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:19:17 ctl02 nova-api[27795]: 2017-09-28 12:19:17.889 27795 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:19:17 ctl02 nova-api[27795]: 2017-09-28 12:19:17.889 27795 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:19:17 ctl02 nova-api[27795]: 2017-09-28 12:19:17.889 27795 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:19:18 ctl02 nova-api[27795]: 2017-09-28 12:19:18.022 27795 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:19:18 ctl02 nova-api[27795]: 2017-09-28 12:19:18.025 27795 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:19:18 ctl02 nova-api[27795]: 2017-09-28 12:19:18.025 27795 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:19:18 ctl02 nova-api[27795]: 2017-09-28 12:19:18.026 27795 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:19:18 ctl02 nova-api[27795]: 2017-09-28 12:19:18.029 27795 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:19:18 ctl02 nova-api[27795]: 2017-09-28 12:19:18.030 27795 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:19:18 ctl02 nova-api[27795]: 2017-09-28 12:19:18.030 27795 ERROR nova Traceback (most recent call last):
Sep 28 12:19:18 ctl02 nova-api[27795]: 2017-09-28 12:19:18.030 27795 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:19:18 ctl02 nova-api[27795]: 2017-09-28 12:19:18.030 27795 ERROR nova     sys.exit(main())
Sep 28 12:19:18 ctl02 nova-api[27795]: 2017-09-28 12:19:18.030 27795 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:19:18 ctl02 nova-api[27795]: 2017-09-28 12:19:18.030 27795 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:19:18 ctl02 nova-api[27795]: 2017-09-28 12:19:18.030 27795 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:19:18 ctl02 nova-api[27795]: 2017-09-28 12:19:18.030 27795 ERROR nova     max_url_len=max_url_len)
Sep 28 12:19:18 ctl02 nova-api[27795]: 2017-09-28 12:19:18.030 27795 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:19:18 ctl02 nova-api[27795]: 2017-09-28 12:19:18.030 27795 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:19:18 ctl02 nova-api[27795]: 2017-09-28 12:19:18.030 27795 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:19:18 ctl02 nova-api[27795]: 2017-09-28 12:19:18.030 27795 ERROR nova     sock.listen(backlog)
Sep 28 12:19:18 ctl02 nova-api[27795]: 2017-09-28 12:19:18.030 27795 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:19:18 ctl02 nova-api[27795]: 2017-09-28 12:19:18.030 27795 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:19:18 ctl02 nova-api[27795]: 2017-09-28 12:19:18.030 27795 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:19:18 ctl02 nova-api[27795]: 2017-09-28 12:19:18.030 27795 ERROR nova
Sep 28 12:19:18 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:19:18 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:19:18 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:19:18 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:19:18 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:19:18 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:19:18 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:19:18 ctl02 nova-conductor[5056]: 2017-09-28 12:19:18.557 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:19:18 ctl02 nova-conductor[5056]: 2017-09-28 12:19:18.572 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:19:18 ctl02 nova-conductor[5056]: 2017-09-28 12:19:18.581 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:19:18 ctl02 nova-conductor[5056]: 2017-09-28 12:19:18.582 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:19:19 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:19:19.110 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:19:19] "OPTIONS / HTTP/1.0" 200 134 0.000495
Sep 28 12:19:19 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x50605d19)
Sep 28 12:19:19 ctl02 heat-api[13008]: 2017-09-28 12:19:19.205 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:19:19] "OPTIONS / HTTP/1.0" 200 134 0.000686
Sep 28 12:19:19 ctl02 heat-api-cfn[13300]: 2017-09-28 12:19:19.247 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:19:19] "OPTIONS / HTTP/1.0" 200 134 0.000552
Sep 28 12:19:20 ctl02 glance-api[29183]: 2017-09-28 12:19:20.025 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:19:20] "OPTIONS / HTTP/1.0" 200 134 0.000789
Sep 28 12:19:20 ctl02 nova-api[27813]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:19:20 ctl02 nova-api[27813]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:19:20 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x50605d19)
Sep 28 12:19:20 ctl02 heat-api-cfn[13300]: 2017-09-28 12:19:20.137 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:19:20] "OPTIONS / HTTP/1.0" 200 134 0.000458
Sep 28 12:19:20 ctl02 nova-api[27813]: 2017-09-28 12:19:20.266 27813 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:19:20 ctl02 nova-api[27813]: 2017-09-28 12:19:20.268 27813 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:19:20 ctl02 nova-api[27813]: 2017-09-28 12:19:20.268 27813 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:19:20 ctl02 nova-api[27813]: 2017-09-28 12:19:20.268 27813 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:19:20 ctl02 nova-api[27813]: 2017-09-28 12:19:20.268 27813 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:19:20 ctl02 nova-api[27813]: 2017-09-28 12:19:20.268 27813 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:19:20 ctl02 nova-api[27813]: 2017-09-28 12:19:20.268 27813 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:19:20 ctl02 nova-api[27813]: 2017-09-28 12:19:20.268 27813 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:19:20 ctl02 nova-api[27813]: 2017-09-28 12:19:20.268 27813 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:19:20 ctl02 nova-api[27813]: 2017-09-28 12:19:20.268 27813 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:19:20 ctl02 nova-api[27813]: 2017-09-28 12:19:20.268 27813 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:19:20 ctl02 nova-api[27813]: 2017-09-28 12:19:20.268 27813 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:19:20 ctl02 nova-api[27813]: 2017-09-28 12:19:20.268 27813 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:19:20 ctl02 nova-api[27813]: 2017-09-28 12:19:20.268 27813 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:19:20 ctl02 nova-api[27813]: 2017-09-28 12:19:20.268 27813 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:19:20 ctl02 nova-api[27813]: 2017-09-28 12:19:20.268 27813 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:19:20 ctl02 nova-api[27813]: 2017-09-28 12:19:20.268 27813 ERROR nova.wsgi     self.filename))
Sep 28 12:19:20 ctl02 nova-api[27813]: 2017-09-28 12:19:20.268 27813 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:19:20 ctl02 nova-api[27813]: 2017-09-28 12:19:20.268 27813 ERROR nova.wsgi
Sep 28 12:19:20 ctl02 nova-api[27813]: 2017-09-28 12:19:20.269 27813 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:19:20 ctl02 nova-api[27813]: 2017-09-28 12:19:20.403 27813 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:19:20 ctl02 nova-api[27813]: 2017-09-28 12:19:20.655 27813 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:19:20 ctl02 nova-api[27813]: 2017-09-28 12:19:20.658 27813 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:19:20 ctl02 nova-api[27813]: 2017-09-28 12:19:20.658 27813 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:19:20 ctl02 nova-api[27813]: 2017-09-28 12:19:20.658 27813 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:19:20 ctl02 nova-api[27813]: 2017-09-28 12:19:20.790 27813 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:19:20 ctl02 nova-api[27813]: 2017-09-28 12:19:20.792 27813 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:19:20 ctl02 nova-api[27813]: 2017-09-28 12:19:20.792 27813 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:19:20 ctl02 nova-api[27813]: 2017-09-28 12:19:20.792 27813 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:19:20 ctl02 nova-api[27813]: 2017-09-28 12:19:20.795 27813 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:19:20 ctl02 nova-api[27813]: 2017-09-28 12:19:20.796 27813 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:19:20 ctl02 nova-api[27813]: 2017-09-28 12:19:20.796 27813 ERROR nova Traceback (most recent call last):
Sep 28 12:19:20 ctl02 nova-api[27813]: 2017-09-28 12:19:20.796 27813 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:19:20 ctl02 nova-api[27813]: 2017-09-28 12:19:20.796 27813 ERROR nova     sys.exit(main())
Sep 28 12:19:20 ctl02 nova-api[27813]: 2017-09-28 12:19:20.796 27813 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:19:20 ctl02 nova-api[27813]: 2017-09-28 12:19:20.796 27813 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:19:20 ctl02 nova-api[27813]: 2017-09-28 12:19:20.796 27813 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:19:20 ctl02 nova-api[27813]: 2017-09-28 12:19:20.796 27813 ERROR nova     max_url_len=max_url_len)
Sep 28 12:19:20 ctl02 nova-api[27813]: 2017-09-28 12:19:20.796 27813 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:19:20 ctl02 nova-api[27813]: 2017-09-28 12:19:20.796 27813 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:19:20 ctl02 nova-api[27813]: 2017-09-28 12:19:20.796 27813 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:19:20 ctl02 nova-api[27813]: 2017-09-28 12:19:20.796 27813 ERROR nova     sock.listen(backlog)
Sep 28 12:19:20 ctl02 nova-api[27813]: 2017-09-28 12:19:20.796 27813 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:19:20 ctl02 nova-api[27813]: 2017-09-28 12:19:20.796 27813 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:19:20 ctl02 nova-api[27813]: 2017-09-28 12:19:20.796 27813 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:19:20 ctl02 nova-api[27813]: 2017-09-28 12:19:20.796 27813 ERROR nova
Sep 28 12:19:20 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:19:20 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:19:20 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:19:21 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x50605d19)
Sep 28 12:19:21 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:19:21 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:19:21 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:19:21 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:19:21 ctl02 heat-api-cfn[13300]: 2017-09-28 12:19:21.227 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:19:21] "OPTIONS / HTTP/1.0" 200 134 0.000525
Sep 28 12:19:22 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x50605d19)
Sep 28 12:19:22 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:19:22.572 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:19:22] "OPTIONS / HTTP/1.0" 200 134 0.000461
Sep 28 12:19:22 ctl02 nova-api[27831]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:19:22 ctl02 nova-api[27831]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:19:22 ctl02 nova-api[27831]: 2017-09-28 12:19:22.945 27831 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:19:22 ctl02 nova-api[27831]: 2017-09-28 12:19:22.947 27831 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:19:22 ctl02 nova-api[27831]: 2017-09-28 12:19:22.947 27831 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:19:22 ctl02 nova-api[27831]: 2017-09-28 12:19:22.947 27831 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:19:22 ctl02 nova-api[27831]: 2017-09-28 12:19:22.947 27831 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:19:22 ctl02 nova-api[27831]: 2017-09-28 12:19:22.947 27831 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:19:22 ctl02 nova-api[27831]: 2017-09-28 12:19:22.947 27831 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:19:22 ctl02 nova-api[27831]: 2017-09-28 12:19:22.947 27831 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:19:22 ctl02 nova-api[27831]: 2017-09-28 12:19:22.947 27831 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:19:22 ctl02 nova-api[27831]: 2017-09-28 12:19:22.947 27831 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:19:22 ctl02 nova-api[27831]: 2017-09-28 12:19:22.947 27831 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:19:22 ctl02 nova-api[27831]: 2017-09-28 12:19:22.947 27831 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:19:22 ctl02 nova-api[27831]: 2017-09-28 12:19:22.947 27831 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:19:22 ctl02 nova-api[27831]: 2017-09-28 12:19:22.947 27831 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:19:22 ctl02 nova-api[27831]: 2017-09-28 12:19:22.947 27831 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:19:22 ctl02 nova-api[27831]: 2017-09-28 12:19:22.947 27831 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:19:22 ctl02 nova-api[27831]: 2017-09-28 12:19:22.947 27831 ERROR nova.wsgi     self.filename))
Sep 28 12:19:22 ctl02 nova-api[27831]: 2017-09-28 12:19:22.947 27831 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:19:22 ctl02 nova-api[27831]: 2017-09-28 12:19:22.947 27831 ERROR nova.wsgi
Sep 28 12:19:22 ctl02 nova-api[27831]: 2017-09-28 12:19:22.948 27831 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:19:22 ctl02 glance-api[29183]: 2017-09-28 12:19:22.965 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:19:22] "OPTIONS / HTTP/1.0" 200 134 0.000905
Sep 28 12:19:22 ctl02 glance-api[29183]: 2017-09-28 12:19:22.994 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:19:22] "OPTIONS / HTTP/1.0" 200 134 0.000627
Sep 28 12:19:23 ctl02 nova-api[27831]: 2017-09-28 12:19:23.084 27831 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:19:23 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x50605d19)
Sep 28 12:19:23 ctl02 nova-api[27831]: 2017-09-28 12:19:23.313 27831 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:19:23 ctl02 nova-api[27831]: 2017-09-28 12:19:23.315 27831 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:19:23 ctl02 nova-api[27831]: 2017-09-28 12:19:23.316 27831 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:19:23 ctl02 nova-api[27831]: 2017-09-28 12:19:23.316 27831 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:19:23 ctl02 nova-api[27831]: 2017-09-28 12:19:23.447 27831 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:19:23 ctl02 nova-api[27831]: 2017-09-28 12:19:23.449 27831 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:19:23 ctl02 nova-api[27831]: 2017-09-28 12:19:23.450 27831 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:19:23 ctl02 nova-api[27831]: 2017-09-28 12:19:23.450 27831 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:19:23 ctl02 nova-api[27831]: 2017-09-28 12:19:23.453 27831 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:19:23 ctl02 nova-api[27831]: 2017-09-28 12:19:23.453 27831 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:19:23 ctl02 nova-api[27831]: 2017-09-28 12:19:23.453 27831 ERROR nova Traceback (most recent call last):
Sep 28 12:19:23 ctl02 nova-api[27831]: 2017-09-28 12:19:23.453 27831 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:19:23 ctl02 nova-api[27831]: 2017-09-28 12:19:23.453 27831 ERROR nova     sys.exit(main())
Sep 28 12:19:23 ctl02 nova-api[27831]: 2017-09-28 12:19:23.453 27831 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:19:23 ctl02 nova-api[27831]: 2017-09-28 12:19:23.453 27831 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:19:23 ctl02 nova-api[27831]: 2017-09-28 12:19:23.453 27831 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:19:23 ctl02 nova-api[27831]: 2017-09-28 12:19:23.453 27831 ERROR nova     max_url_len=max_url_len)
Sep 28 12:19:23 ctl02 nova-api[27831]: 2017-09-28 12:19:23.453 27831 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:19:23 ctl02 nova-api[27831]: 2017-09-28 12:19:23.453 27831 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:19:23 ctl02 nova-api[27831]: 2017-09-28 12:19:23.453 27831 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:19:23 ctl02 nova-api[27831]: 2017-09-28 12:19:23.453 27831 ERROR nova     sock.listen(backlog)
Sep 28 12:19:23 ctl02 nova-api[27831]: 2017-09-28 12:19:23.453 27831 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:19:23 ctl02 nova-api[27831]: 2017-09-28 12:19:23.453 27831 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:19:23 ctl02 nova-api[27831]: 2017-09-28 12:19:23.453 27831 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:19:23 ctl02 nova-api[27831]: 2017-09-28 12:19:23.453 27831 ERROR nova
Sep 28 12:19:23 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:19:23 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:19:23 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:19:23 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:19:23 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:19:23 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:19:23 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:19:24 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x50605d19)
Sep 28 12:19:24 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:19:24.847 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:19:24] "OPTIONS / HTTP/1.0" 200 134 0.000493
Sep 28 12:19:25 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x50605d19)
Sep 28 12:19:25 ctl02 heat-api[13008]: 2017-09-28 12:19:25.283 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:19:25] "OPTIONS / HTTP/1.0" 200 134 0.000625
Sep 28 12:19:25 ctl02 nova-api[27849]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:19:25 ctl02 nova-api[27849]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:19:25 ctl02 nova-api[27849]: 2017-09-28 12:19:25.756 27849 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:19:25 ctl02 nova-api[27849]: 2017-09-28 12:19:25.758 27849 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:19:25 ctl02 nova-api[27849]: 2017-09-28 12:19:25.758 27849 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:19:25 ctl02 nova-api[27849]: 2017-09-28 12:19:25.758 27849 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:19:25 ctl02 nova-api[27849]: 2017-09-28 12:19:25.758 27849 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:19:25 ctl02 nova-api[27849]: 2017-09-28 12:19:25.758 27849 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:19:25 ctl02 nova-api[27849]: 2017-09-28 12:19:25.758 27849 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:19:25 ctl02 nova-api[27849]: 2017-09-28 12:19:25.758 27849 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:19:25 ctl02 nova-api[27849]: 2017-09-28 12:19:25.758 27849 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:19:25 ctl02 nova-api[27849]: 2017-09-28 12:19:25.758 27849 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:19:25 ctl02 nova-api[27849]: 2017-09-28 12:19:25.758 27849 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:19:25 ctl02 nova-api[27849]: 2017-09-28 12:19:25.758 27849 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:19:25 ctl02 nova-api[27849]: 2017-09-28 12:19:25.758 27849 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:19:25 ctl02 nova-api[27849]: 2017-09-28 12:19:25.758 27849 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:19:25 ctl02 nova-api[27849]: 2017-09-28 12:19:25.758 27849 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:19:25 ctl02 nova-api[27849]: 2017-09-28 12:19:25.758 27849 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:19:25 ctl02 nova-api[27849]: 2017-09-28 12:19:25.758 27849 ERROR nova.wsgi     self.filename))
Sep 28 12:19:25 ctl02 nova-api[27849]: 2017-09-28 12:19:25.758 27849 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:19:25 ctl02 nova-api[27849]: 2017-09-28 12:19:25.758 27849 ERROR nova.wsgi
Sep 28 12:19:25 ctl02 nova-api[27849]: 2017-09-28 12:19:25.769 27849 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:19:25 ctl02 nova-api[27849]: 2017-09-28 12:19:25.909 27849 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:19:26 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x50605d19)
Sep 28 12:19:26 ctl02 nova-api[27849]: 2017-09-28 12:19:26.167 27849 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:19:26 ctl02 nova-api[27849]: 2017-09-28 12:19:26.170 27849 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:19:26 ctl02 nova-api[27849]: 2017-09-28 12:19:26.170 27849 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:19:26 ctl02 nova-api[27849]: 2017-09-28 12:19:26.170 27849 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:19:26 ctl02 nova-api[27849]: 2017-09-28 12:19:26.304 27849 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:19:26 ctl02 nova-api[27849]: 2017-09-28 12:19:26.306 27849 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:19:26 ctl02 nova-api[27849]: 2017-09-28 12:19:26.306 27849 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:19:26 ctl02 nova-api[27849]: 2017-09-28 12:19:26.307 27849 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:19:26 ctl02 nova-api[27849]: 2017-09-28 12:19:26.310 27849 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:19:26 ctl02 nova-api[27849]: 2017-09-28 12:19:26.310 27849 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:19:26 ctl02 nova-api[27849]: 2017-09-28 12:19:26.310 27849 ERROR nova Traceback (most recent call last):
Sep 28 12:19:26 ctl02 nova-api[27849]: 2017-09-28 12:19:26.310 27849 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:19:26 ctl02 nova-api[27849]: 2017-09-28 12:19:26.310 27849 ERROR nova     sys.exit(main())
Sep 28 12:19:26 ctl02 nova-api[27849]: 2017-09-28 12:19:26.310 27849 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:19:26 ctl02 nova-api[27849]: 2017-09-28 12:19:26.310 27849 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:19:26 ctl02 nova-api[27849]: 2017-09-28 12:19:26.310 27849 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:19:26 ctl02 nova-api[27849]: 2017-09-28 12:19:26.310 27849 ERROR nova     max_url_len=max_url_len)
Sep 28 12:19:26 ctl02 nova-api[27849]: 2017-09-28 12:19:26.310 27849 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:19:26 ctl02 nova-api[27849]: 2017-09-28 12:19:26.310 27849 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:19:26 ctl02 nova-api[27849]: 2017-09-28 12:19:26.310 27849 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:19:26 ctl02 nova-api[27849]: 2017-09-28 12:19:26.310 27849 ERROR nova     sock.listen(backlog)
Sep 28 12:19:26 ctl02 nova-api[27849]: 2017-09-28 12:19:26.310 27849 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:19:26 ctl02 nova-api[27849]: 2017-09-28 12:19:26.310 27849 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:19:26 ctl02 nova-api[27849]: 2017-09-28 12:19:26.310 27849 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:19:26 ctl02 nova-api[27849]: 2017-09-28 12:19:26.310 27849 ERROR nova
Sep 28 12:19:26 ctl02 heat-api[13008]: 2017-09-28 12:19:26.406 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:19:26] "OPTIONS / HTTP/1.0" 200 134 0.000611
Sep 28 12:19:26 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:19:26 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:19:26 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:19:26 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:19:26 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:19:26 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:19:26 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:19:26 ctl02 nova-consoleauth[5433]: 2017-09-28 12:19:26.889 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:19:27 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x50605d19)
Sep 28 12:19:28 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x50605d19)
Sep 28 12:19:28 ctl02 nova-api[27866]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:19:28 ctl02 nova-api[27866]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:19:28 ctl02 nova-api[27866]: 2017-09-28 12:19:28.490 27866 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:19:28 ctl02 nova-api[27866]: 2017-09-28 12:19:28.492 27866 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:19:28 ctl02 nova-api[27866]: 2017-09-28 12:19:28.492 27866 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:19:28 ctl02 nova-api[27866]: 2017-09-28 12:19:28.492 27866 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:19:28 ctl02 nova-api[27866]: 2017-09-28 12:19:28.492 27866 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:19:28 ctl02 nova-api[27866]: 2017-09-28 12:19:28.492 27866 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:19:28 ctl02 nova-api[27866]: 2017-09-28 12:19:28.492 27866 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:19:28 ctl02 nova-api[27866]: 2017-09-28 12:19:28.492 27866 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:19:28 ctl02 nova-api[27866]: 2017-09-28 12:19:28.492 27866 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:19:28 ctl02 nova-api[27866]: 2017-09-28 12:19:28.492 27866 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:19:28 ctl02 nova-api[27866]: 2017-09-28 12:19:28.492 27866 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:19:28 ctl02 nova-api[27866]: 2017-09-28 12:19:28.492 27866 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:19:28 ctl02 nova-api[27866]: 2017-09-28 12:19:28.492 27866 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:19:28 ctl02 nova-api[27866]: 2017-09-28 12:19:28.492 27866 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:19:28 ctl02 nova-api[27866]: 2017-09-28 12:19:28.492 27866 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:19:28 ctl02 nova-api[27866]: 2017-09-28 12:19:28.492 27866 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:19:28 ctl02 nova-api[27866]: 2017-09-28 12:19:28.492 27866 ERROR nova.wsgi     self.filename))
Sep 28 12:19:28 ctl02 nova-api[27866]: 2017-09-28 12:19:28.492 27866 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:19:28 ctl02 nova-api[27866]: 2017-09-28 12:19:28.492 27866 ERROR nova.wsgi
Sep 28 12:19:28 ctl02 nova-api[27866]: 2017-09-28 12:19:28.493 27866 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:19:28 ctl02 nova-api[27866]: 2017-09-28 12:19:28.629 27866 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:19:28 ctl02 nova-api[27866]: 2017-09-28 12:19:28.883 27866 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:19:28 ctl02 nova-api[27866]: 2017-09-28 12:19:28.885 27866 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:19:28 ctl02 nova-api[27866]: 2017-09-28 12:19:28.885 27866 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:19:28 ctl02 nova-api[27866]: 2017-09-28 12:19:28.885 27866 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:19:29 ctl02 nova-api[27866]: 2017-09-28 12:19:29.019 27866 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:19:29 ctl02 nova-api[27866]: 2017-09-28 12:19:29.021 27866 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:19:29 ctl02 nova-api[27866]: 2017-09-28 12:19:29.021 27866 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:19:29 ctl02 nova-api[27866]: 2017-09-28 12:19:29.021 27866 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:19:29 ctl02 nova-api[27866]: 2017-09-28 12:19:29.025 27866 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:19:29 ctl02 nova-api[27866]: 2017-09-28 12:19:29.025 27866 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:19:29 ctl02 nova-api[27866]: 2017-09-28 12:19:29.025 27866 ERROR nova Traceback (most recent call last):
Sep 28 12:19:29 ctl02 nova-api[27866]: 2017-09-28 12:19:29.025 27866 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:19:29 ctl02 nova-api[27866]: 2017-09-28 12:19:29.025 27866 ERROR nova     sys.exit(main())
Sep 28 12:19:29 ctl02 nova-api[27866]: 2017-09-28 12:19:29.025 27866 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:19:29 ctl02 nova-api[27866]: 2017-09-28 12:19:29.025 27866 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:19:29 ctl02 nova-api[27866]: 2017-09-28 12:19:29.025 27866 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:19:29 ctl02 nova-api[27866]: 2017-09-28 12:19:29.025 27866 ERROR nova     max_url_len=max_url_len)
Sep 28 12:19:29 ctl02 nova-api[27866]: 2017-09-28 12:19:29.025 27866 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:19:29 ctl02 nova-api[27866]: 2017-09-28 12:19:29.025 27866 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:19:29 ctl02 nova-api[27866]: 2017-09-28 12:19:29.025 27866 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:19:29 ctl02 nova-api[27866]: 2017-09-28 12:19:29.025 27866 ERROR nova     sock.listen(backlog)
Sep 28 12:19:29 ctl02 nova-api[27866]: 2017-09-28 12:19:29.025 27866 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:19:29 ctl02 nova-api[27866]: 2017-09-28 12:19:29.025 27866 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:19:29 ctl02 nova-api[27866]: 2017-09-28 12:19:29.025 27866 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:19:29 ctl02 nova-api[27866]: 2017-09-28 12:19:29.025 27866 ERROR nova
Sep 28 12:19:29 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x50605d19)
Sep 28 12:19:29 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:19:29 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:19:29 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:19:29 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:19:29.264 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:19:29] "OPTIONS / HTTP/1.0" 200 134 0.000537
Sep 28 12:19:29 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:19:29 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:19:29 ctl02 heat-api[13008]: 2017-09-28 12:19:29.398 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:19:29] "OPTIONS / HTTP/1.0" 200 134 0.000663
Sep 28 12:19:29 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:19:29 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:19:29 ctl02 heat-api-cfn[13300]: 2017-09-28 12:19:29.577 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:19:29] "OPTIONS / HTTP/1.0" 200 134 0.000516
Sep 28 12:19:29 ctl02 heat-engine[12803]: 2017-09-28 12:19:29.668 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:19:29 ctl02 heat-engine[12803]: 2017-09-28 12:19:29.672 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:19:29 ctl02 heat-engine[12803]: 2017-09-28 12:19:29.677 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:19:29 ctl02 heat-engine[12803]: 2017-09-28 12:19:29.679 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:19:29 ctl02 nova-scheduler[5620]: 2017-09-28 12:19:29.910 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:19:30 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:19:30 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:19:30 ctl02 glance-api[29183]: 2017-09-28 12:19:30.236 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:19:30] "OPTIONS / HTTP/1.0" 200 134 0.000687
Sep 28 12:19:30 ctl02 heat-api-cfn[13300]: 2017-09-28 12:19:30.367 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:19:30] "OPTIONS / HTTP/1.0" 200 134 0.000419
Sep 28 12:19:30 ctl02 heat-api-cfn[13300]: 2017-09-28 12:19:30.987 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:19:30] "OPTIONS / HTTP/1.0" 200 134 0.000379
Sep 28 12:19:31 ctl02 nova-api[27885]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:19:31 ctl02 nova-api[27885]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:19:31 ctl02 nova-api[27885]: 2017-09-28 12:19:31.235 27885 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:19:31 ctl02 nova-api[27885]: 2017-09-28 12:19:31.237 27885 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:19:31 ctl02 nova-api[27885]: 2017-09-28 12:19:31.237 27885 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:19:31 ctl02 nova-api[27885]: 2017-09-28 12:19:31.237 27885 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:19:31 ctl02 nova-api[27885]: 2017-09-28 12:19:31.237 27885 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:19:31 ctl02 nova-api[27885]: 2017-09-28 12:19:31.237 27885 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:19:31 ctl02 nova-api[27885]: 2017-09-28 12:19:31.237 27885 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:19:31 ctl02 nova-api[27885]: 2017-09-28 12:19:31.237 27885 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:19:31 ctl02 nova-api[27885]: 2017-09-28 12:19:31.237 27885 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:19:31 ctl02 nova-api[27885]: 2017-09-28 12:19:31.237 27885 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:19:31 ctl02 nova-api[27885]: 2017-09-28 12:19:31.237 27885 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:19:31 ctl02 nova-api[27885]: 2017-09-28 12:19:31.237 27885 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:19:31 ctl02 nova-api[27885]: 2017-09-28 12:19:31.237 27885 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:19:31 ctl02 nova-api[27885]: 2017-09-28 12:19:31.237 27885 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:19:31 ctl02 nova-api[27885]: 2017-09-28 12:19:31.237 27885 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:19:31 ctl02 nova-api[27885]: 2017-09-28 12:19:31.237 27885 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:19:31 ctl02 nova-api[27885]: 2017-09-28 12:19:31.237 27885 ERROR nova.wsgi     self.filename))
Sep 28 12:19:31 ctl02 nova-api[27885]: 2017-09-28 12:19:31.237 27885 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:19:31 ctl02 nova-api[27885]: 2017-09-28 12:19:31.237 27885 ERROR nova.wsgi
Sep 28 12:19:31 ctl02 nova-api[27885]: 2017-09-28 12:19:31.238 27885 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:19:31 ctl02 nova-api[27885]: 2017-09-28 12:19:31.366 27885 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:19:31 ctl02 nova-api[27885]: 2017-09-28 12:19:31.593 27885 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:19:31 ctl02 nova-api[27885]: 2017-09-28 12:19:31.595 27885 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:19:31 ctl02 nova-api[27885]: 2017-09-28 12:19:31.595 27885 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:19:31 ctl02 nova-api[27885]: 2017-09-28 12:19:31.595 27885 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:19:31 ctl02 nova-api[27885]: 2017-09-28 12:19:31.728 27885 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:19:31 ctl02 nova-api[27885]: 2017-09-28 12:19:31.730 27885 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:19:31 ctl02 nova-api[27885]: 2017-09-28 12:19:31.730 27885 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:19:31 ctl02 nova-api[27885]: 2017-09-28 12:19:31.730 27885 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:19:31 ctl02 nova-api[27885]: 2017-09-28 12:19:31.733 27885 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:19:31 ctl02 nova-api[27885]: 2017-09-28 12:19:31.734 27885 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:19:31 ctl02 nova-api[27885]: 2017-09-28 12:19:31.734 27885 ERROR nova Traceback (most recent call last):
Sep 28 12:19:31 ctl02 nova-api[27885]: 2017-09-28 12:19:31.734 27885 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:19:31 ctl02 nova-api[27885]: 2017-09-28 12:19:31.734 27885 ERROR nova     sys.exit(main())
Sep 28 12:19:31 ctl02 nova-api[27885]: 2017-09-28 12:19:31.734 27885 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:19:31 ctl02 nova-api[27885]: 2017-09-28 12:19:31.734 27885 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:19:31 ctl02 nova-api[27885]: 2017-09-28 12:19:31.734 27885 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:19:31 ctl02 nova-api[27885]: 2017-09-28 12:19:31.734 27885 ERROR nova     max_url_len=max_url_len)
Sep 28 12:19:31 ctl02 nova-api[27885]: 2017-09-28 12:19:31.734 27885 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:19:31 ctl02 nova-api[27885]: 2017-09-28 12:19:31.734 27885 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:19:31 ctl02 nova-api[27885]: 2017-09-28 12:19:31.734 27885 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:19:31 ctl02 nova-api[27885]: 2017-09-28 12:19:31.734 27885 ERROR nova     sock.listen(backlog)
Sep 28 12:19:31 ctl02 nova-api[27885]: 2017-09-28 12:19:31.734 27885 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:19:31 ctl02 nova-api[27885]: 2017-09-28 12:19:31.734 27885 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:19:31 ctl02 nova-api[27885]: 2017-09-28 12:19:31.734 27885 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:19:31 ctl02 nova-api[27885]: 2017-09-28 12:19:31.734 27885 ERROR nova
Sep 28 12:19:31 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:19:31 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:19:31 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:19:32 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:19:32 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:19:32 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:19:32 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:19:32 ctl02 glance-api[29183]: 2017-09-28 12:19:32.792 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:19:32] "OPTIONS / HTTP/1.0" 200 134 0.000590
Sep 28 12:19:32 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:19:32.853 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:19:32] "OPTIONS / HTTP/1.0" 200 134 0.000399
Sep 28 12:19:33 ctl02 glance-api[29183]: 2017-09-28 12:19:33.230 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:19:33] "OPTIONS / HTTP/1.0" 200 134 0.000551
Sep 28 12:19:33 ctl02 nova-api[27908]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:19:33 ctl02 nova-api[27908]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:19:33 ctl02 nova-api[27908]: 2017-09-28 12:19:33.965 27908 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:19:33 ctl02 nova-api[27908]: 2017-09-28 12:19:33.967 27908 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:19:33 ctl02 nova-api[27908]: 2017-09-28 12:19:33.967 27908 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:19:33 ctl02 nova-api[27908]: 2017-09-28 12:19:33.967 27908 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:19:33 ctl02 nova-api[27908]: 2017-09-28 12:19:33.967 27908 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:19:33 ctl02 nova-api[27908]: 2017-09-28 12:19:33.967 27908 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:19:33 ctl02 nova-api[27908]: 2017-09-28 12:19:33.967 27908 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:19:33 ctl02 nova-api[27908]: 2017-09-28 12:19:33.967 27908 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:19:33 ctl02 nova-api[27908]: 2017-09-28 12:19:33.967 27908 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:19:33 ctl02 nova-api[27908]: 2017-09-28 12:19:33.967 27908 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:19:33 ctl02 nova-api[27908]: 2017-09-28 12:19:33.967 27908 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:19:33 ctl02 nova-api[27908]: 2017-09-28 12:19:33.967 27908 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:19:33 ctl02 nova-api[27908]: 2017-09-28 12:19:33.967 27908 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:19:33 ctl02 nova-api[27908]: 2017-09-28 12:19:33.967 27908 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:19:33 ctl02 nova-api[27908]: 2017-09-28 12:19:33.967 27908 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:19:33 ctl02 nova-api[27908]: 2017-09-28 12:19:33.967 27908 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:19:33 ctl02 nova-api[27908]: 2017-09-28 12:19:33.967 27908 ERROR nova.wsgi     self.filename))
Sep 28 12:19:33 ctl02 nova-api[27908]: 2017-09-28 12:19:33.967 27908 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:19:33 ctl02 nova-api[27908]: 2017-09-28 12:19:33.967 27908 ERROR nova.wsgi
Sep 28 12:19:33 ctl02 nova-api[27908]: 2017-09-28 12:19:33.968 27908 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:19:34 ctl02 nova-api[27908]: 2017-09-28 12:19:34.094 27908 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:19:34 ctl02 nova-api[27908]: 2017-09-28 12:19:34.320 27908 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:19:34 ctl02 nova-api[27908]: 2017-09-28 12:19:34.322 27908 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:19:34 ctl02 nova-api[27908]: 2017-09-28 12:19:34.322 27908 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:19:34 ctl02 nova-api[27908]: 2017-09-28 12:19:34.323 27908 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:19:34 ctl02 nova-api[27908]: 2017-09-28 12:19:34.453 27908 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:19:34 ctl02 nova-api[27908]: 2017-09-28 12:19:34.454 27908 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:19:34 ctl02 nova-api[27908]: 2017-09-28 12:19:34.455 27908 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:19:34 ctl02 nova-api[27908]: 2017-09-28 12:19:34.455 27908 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:19:34 ctl02 nova-api[27908]: 2017-09-28 12:19:34.458 27908 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:19:34 ctl02 nova-api[27908]: 2017-09-28 12:19:34.458 27908 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:19:34 ctl02 nova-api[27908]: 2017-09-28 12:19:34.458 27908 ERROR nova Traceback (most recent call last):
Sep 28 12:19:34 ctl02 nova-api[27908]: 2017-09-28 12:19:34.458 27908 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:19:34 ctl02 nova-api[27908]: 2017-09-28 12:19:34.458 27908 ERROR nova     sys.exit(main())
Sep 28 12:19:34 ctl02 nova-api[27908]: 2017-09-28 12:19:34.458 27908 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:19:34 ctl02 nova-api[27908]: 2017-09-28 12:19:34.458 27908 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:19:34 ctl02 nova-api[27908]: 2017-09-28 12:19:34.458 27908 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:19:34 ctl02 nova-api[27908]: 2017-09-28 12:19:34.458 27908 ERROR nova     max_url_len=max_url_len)
Sep 28 12:19:34 ctl02 nova-api[27908]: 2017-09-28 12:19:34.458 27908 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:19:34 ctl02 nova-api[27908]: 2017-09-28 12:19:34.458 27908 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:19:34 ctl02 nova-api[27908]: 2017-09-28 12:19:34.458 27908 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:19:34 ctl02 nova-api[27908]: 2017-09-28 12:19:34.458 27908 ERROR nova     sock.listen(backlog)
Sep 28 12:19:34 ctl02 nova-api[27908]: 2017-09-28 12:19:34.458 27908 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:19:34 ctl02 nova-api[27908]: 2017-09-28 12:19:34.458 27908 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:19:34 ctl02 nova-api[27908]: 2017-09-28 12:19:34.458 27908 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:19:34 ctl02 nova-api[27908]: 2017-09-28 12:19:34.458 27908 ERROR nova
Sep 28 12:19:34 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:19:34 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:19:34 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:19:34 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:19:34 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:19:34 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:19:34 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:19:35 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:19:35.028 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:19:35] "OPTIONS / HTTP/1.0" 200 134 0.000794
Sep 28 12:19:35 ctl02 heat-api[13008]: 2017-09-28 12:19:35.100 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:19:35] "OPTIONS / HTTP/1.0" 200 134 0.000669
Sep 28 12:19:36 ctl02 heat-api[13008]: 2017-09-28 12:19:36.517 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:19:36] "OPTIONS / HTTP/1.0" 200 134 0.000695
Sep 28 12:19:36 ctl02 nova-api[27926]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:19:36 ctl02 nova-api[27926]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:19:36 ctl02 nova-api[27926]: 2017-09-28 12:19:36.766 27926 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:19:36 ctl02 nova-api[27926]: 2017-09-28 12:19:36.768 27926 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:19:36 ctl02 nova-api[27926]: 2017-09-28 12:19:36.768 27926 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:19:36 ctl02 nova-api[27926]: 2017-09-28 12:19:36.768 27926 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:19:36 ctl02 nova-api[27926]: 2017-09-28 12:19:36.768 27926 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:19:36 ctl02 nova-api[27926]: 2017-09-28 12:19:36.768 27926 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:19:36 ctl02 nova-api[27926]: 2017-09-28 12:19:36.768 27926 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:19:36 ctl02 nova-api[27926]: 2017-09-28 12:19:36.768 27926 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:19:36 ctl02 nova-api[27926]: 2017-09-28 12:19:36.768 27926 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:19:36 ctl02 nova-api[27926]: 2017-09-28 12:19:36.768 27926 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:19:36 ctl02 nova-api[27926]: 2017-09-28 12:19:36.768 27926 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:19:36 ctl02 nova-api[27926]: 2017-09-28 12:19:36.768 27926 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:19:36 ctl02 nova-api[27926]: 2017-09-28 12:19:36.768 27926 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:19:36 ctl02 nova-api[27926]: 2017-09-28 12:19:36.768 27926 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:19:36 ctl02 nova-api[27926]: 2017-09-28 12:19:36.768 27926 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:19:36 ctl02 nova-api[27926]: 2017-09-28 12:19:36.768 27926 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:19:36 ctl02 nova-api[27926]: 2017-09-28 12:19:36.768 27926 ERROR nova.wsgi     self.filename))
Sep 28 12:19:36 ctl02 nova-api[27926]: 2017-09-28 12:19:36.768 27926 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:19:36 ctl02 nova-api[27926]: 2017-09-28 12:19:36.768 27926 ERROR nova.wsgi
Sep 28 12:19:36 ctl02 nova-api[27926]: 2017-09-28 12:19:36.769 27926 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:19:36 ctl02 nova-api[27926]: 2017-09-28 12:19:36.900 27926 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:19:37 ctl02 nova-api[27926]: 2017-09-28 12:19:37.153 27926 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:19:37 ctl02 nova-api[27926]: 2017-09-28 12:19:37.155 27926 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:19:37 ctl02 nova-api[27926]: 2017-09-28 12:19:37.155 27926 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:19:37 ctl02 nova-api[27926]: 2017-09-28 12:19:37.155 27926 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:19:37 ctl02 nova-api[27926]: 2017-09-28 12:19:37.289 27926 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:19:37 ctl02 nova-api[27926]: 2017-09-28 12:19:37.291 27926 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:19:37 ctl02 nova-api[27926]: 2017-09-28 12:19:37.291 27926 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:19:37 ctl02 nova-api[27926]: 2017-09-28 12:19:37.291 27926 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:19:37 ctl02 nova-api[27926]: 2017-09-28 12:19:37.295 27926 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:19:37 ctl02 nova-api[27926]: 2017-09-28 12:19:37.295 27926 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:19:37 ctl02 nova-api[27926]: 2017-09-28 12:19:37.295 27926 ERROR nova Traceback (most recent call last):
Sep 28 12:19:37 ctl02 nova-api[27926]: 2017-09-28 12:19:37.295 27926 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:19:37 ctl02 nova-api[27926]: 2017-09-28 12:19:37.295 27926 ERROR nova     sys.exit(main())
Sep 28 12:19:37 ctl02 nova-api[27926]: 2017-09-28 12:19:37.295 27926 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:19:37 ctl02 nova-api[27926]: 2017-09-28 12:19:37.295 27926 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:19:37 ctl02 nova-api[27926]: 2017-09-28 12:19:37.295 27926 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:19:37 ctl02 nova-api[27926]: 2017-09-28 12:19:37.295 27926 ERROR nova     max_url_len=max_url_len)
Sep 28 12:19:37 ctl02 nova-api[27926]: 2017-09-28 12:19:37.295 27926 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:19:37 ctl02 nova-api[27926]: 2017-09-28 12:19:37.295 27926 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:19:37 ctl02 nova-api[27926]: 2017-09-28 12:19:37.295 27926 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:19:37 ctl02 nova-api[27926]: 2017-09-28 12:19:37.295 27926 ERROR nova     sock.listen(backlog)
Sep 28 12:19:37 ctl02 nova-api[27926]: 2017-09-28 12:19:37.295 27926 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:19:37 ctl02 nova-api[27926]: 2017-09-28 12:19:37.295 27926 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:19:37 ctl02 nova-api[27926]: 2017-09-28 12:19:37.295 27926 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:19:37 ctl02 nova-api[27926]: 2017-09-28 12:19:37.295 27926 ERROR nova
Sep 28 12:19:37 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:19:37 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:19:37 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:19:37 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:19:37 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:19:37 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:19:37 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:19:39 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:19:39.166 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:19:39] "OPTIONS / HTTP/1.0" 200 134 0.000507
Sep 28 12:19:39 ctl02 nova-api[27943]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:19:39 ctl02 nova-api[27943]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:19:39 ctl02 heat-api-cfn[13300]: 2017-09-28 12:19:39.464 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:19:39] "OPTIONS / HTTP/1.0" 200 134 0.000502
Sep 28 12:19:39 ctl02 nova-api[27943]: 2017-09-28 12:19:39.497 27943 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:19:39 ctl02 nova-api[27943]: 2017-09-28 12:19:39.499 27943 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:19:39 ctl02 nova-api[27943]: 2017-09-28 12:19:39.499 27943 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:19:39 ctl02 nova-api[27943]: 2017-09-28 12:19:39.499 27943 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:19:39 ctl02 nova-api[27943]: 2017-09-28 12:19:39.499 27943 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:19:39 ctl02 nova-api[27943]: 2017-09-28 12:19:39.499 27943 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:19:39 ctl02 nova-api[27943]: 2017-09-28 12:19:39.499 27943 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:19:39 ctl02 nova-api[27943]: 2017-09-28 12:19:39.499 27943 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:19:39 ctl02 nova-api[27943]: 2017-09-28 12:19:39.499 27943 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:19:39 ctl02 nova-api[27943]: 2017-09-28 12:19:39.499 27943 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:19:39 ctl02 nova-api[27943]: 2017-09-28 12:19:39.499 27943 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:19:39 ctl02 nova-api[27943]: 2017-09-28 12:19:39.499 27943 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:19:39 ctl02 nova-api[27943]: 2017-09-28 12:19:39.499 27943 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:19:39 ctl02 nova-api[27943]: 2017-09-28 12:19:39.499 27943 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:19:39 ctl02 nova-api[27943]: 2017-09-28 12:19:39.499 27943 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:19:39 ctl02 nova-api[27943]: 2017-09-28 12:19:39.499 27943 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:19:39 ctl02 nova-api[27943]: 2017-09-28 12:19:39.499 27943 ERROR nova.wsgi     self.filename))
Sep 28 12:19:39 ctl02 nova-api[27943]: 2017-09-28 12:19:39.499 27943 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:19:39 ctl02 nova-api[27943]: 2017-09-28 12:19:39.499 27943 ERROR nova.wsgi
Sep 28 12:19:39 ctl02 nova-api[27943]: 2017-09-28 12:19:39.500 27943 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:19:39 ctl02 nova-api[27943]: 2017-09-28 12:19:39.638 27943 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:19:39 ctl02 heat-api[13008]: 2017-09-28 12:19:39.730 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:19:39] "OPTIONS / HTTP/1.0" 200 134 0.000590
Sep 28 12:19:39 ctl02 nova-api[27943]: 2017-09-28 12:19:39.886 27943 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:19:39 ctl02 nova-api[27943]: 2017-09-28 12:19:39.888 27943 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:19:39 ctl02 nova-api[27943]: 2017-09-28 12:19:39.888 27943 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:19:39 ctl02 nova-api[27943]: 2017-09-28 12:19:39.889 27943 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:19:40 ctl02 nova-api[27943]: 2017-09-28 12:19:40.024 27943 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:19:40 ctl02 heat-api-cfn[13300]: 2017-09-28 12:19:40.026 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:19:40] "OPTIONS / HTTP/1.0" 200 134 0.000504
Sep 28 12:19:40 ctl02 nova-api[27943]: 2017-09-28 12:19:40.027 27943 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:19:40 ctl02 nova-api[27943]: 2017-09-28 12:19:40.028 27943 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:19:40 ctl02 nova-api[27943]: 2017-09-28 12:19:40.028 27943 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:19:40 ctl02 nova-api[27943]: 2017-09-28 12:19:40.031 27943 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:19:40 ctl02 nova-api[27943]: 2017-09-28 12:19:40.032 27943 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:19:40 ctl02 nova-api[27943]: 2017-09-28 12:19:40.032 27943 ERROR nova Traceback (most recent call last):
Sep 28 12:19:40 ctl02 nova-api[27943]: 2017-09-28 12:19:40.032 27943 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:19:40 ctl02 nova-api[27943]: 2017-09-28 12:19:40.032 27943 ERROR nova     sys.exit(main())
Sep 28 12:19:40 ctl02 nova-api[27943]: 2017-09-28 12:19:40.032 27943 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:19:40 ctl02 nova-api[27943]: 2017-09-28 12:19:40.032 27943 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:19:40 ctl02 nova-api[27943]: 2017-09-28 12:19:40.032 27943 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:19:40 ctl02 nova-api[27943]: 2017-09-28 12:19:40.032 27943 ERROR nova     max_url_len=max_url_len)
Sep 28 12:19:40 ctl02 nova-api[27943]: 2017-09-28 12:19:40.032 27943 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:19:40 ctl02 nova-api[27943]: 2017-09-28 12:19:40.032 27943 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:19:40 ctl02 nova-api[27943]: 2017-09-28 12:19:40.032 27943 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:19:40 ctl02 nova-api[27943]: 2017-09-28 12:19:40.032 27943 ERROR nova     sock.listen(backlog)
Sep 28 12:19:40 ctl02 nova-api[27943]: 2017-09-28 12:19:40.032 27943 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:19:40 ctl02 nova-api[27943]: 2017-09-28 12:19:40.032 27943 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:19:40 ctl02 nova-api[27943]: 2017-09-28 12:19:40.032 27943 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:19:40 ctl02 nova-api[27943]: 2017-09-28 12:19:40.032 27943 ERROR nova
Sep 28 12:19:40 ctl02 glance-api[29183]: 2017-09-28 12:19:40.106 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:19:40] "OPTIONS / HTTP/1.0" 200 134 0.000638
Sep 28 12:19:40 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:19:40 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:19:40 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:19:40 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:19:40 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:19:40 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:19:40 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:19:40 ctl02 heat-api-cfn[13300]: 2017-09-28 12:19:40.786 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:19:40] "OPTIONS / HTTP/1.0" 200 134 0.000488
Sep 28 12:19:42 ctl02 nova-api[27962]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:19:42 ctl02 nova-api[27962]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:19:42 ctl02 nova-api[27962]: 2017-09-28 12:19:42.263 27962 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:19:42 ctl02 nova-api[27962]: 2017-09-28 12:19:42.266 27962 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:19:42 ctl02 nova-api[27962]: 2017-09-28 12:19:42.266 27962 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:19:42 ctl02 nova-api[27962]: 2017-09-28 12:19:42.266 27962 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:19:42 ctl02 nova-api[27962]: 2017-09-28 12:19:42.266 27962 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:19:42 ctl02 nova-api[27962]: 2017-09-28 12:19:42.266 27962 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:19:42 ctl02 nova-api[27962]: 2017-09-28 12:19:42.266 27962 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:19:42 ctl02 nova-api[27962]: 2017-09-28 12:19:42.266 27962 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:19:42 ctl02 nova-api[27962]: 2017-09-28 12:19:42.266 27962 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:19:42 ctl02 nova-api[27962]: 2017-09-28 12:19:42.266 27962 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:19:42 ctl02 nova-api[27962]: 2017-09-28 12:19:42.266 27962 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:19:42 ctl02 nova-api[27962]: 2017-09-28 12:19:42.266 27962 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:19:42 ctl02 nova-api[27962]: 2017-09-28 12:19:42.266 27962 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:19:42 ctl02 nova-api[27962]: 2017-09-28 12:19:42.266 27962 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:19:42 ctl02 nova-api[27962]: 2017-09-28 12:19:42.266 27962 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:19:42 ctl02 nova-api[27962]: 2017-09-28 12:19:42.266 27962 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:19:42 ctl02 nova-api[27962]: 2017-09-28 12:19:42.266 27962 ERROR nova.wsgi     self.filename))
Sep 28 12:19:42 ctl02 nova-api[27962]: 2017-09-28 12:19:42.266 27962 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:19:42 ctl02 nova-api[27962]: 2017-09-28 12:19:42.266 27962 ERROR nova.wsgi
Sep 28 12:19:42 ctl02 nova-api[27962]: 2017-09-28 12:19:42.268 27962 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:19:42 ctl02 nova-api[27962]: 2017-09-28 12:19:42.405 27962 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:19:42 ctl02 glance-api[29183]: 2017-09-28 12:19:42.614 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:19:42] "OPTIONS / HTTP/1.0" 200 134 0.000964
Sep 28 12:19:42 ctl02 nova-api[27962]: 2017-09-28 12:19:42.663 27962 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:19:42 ctl02 nova-api[27962]: 2017-09-28 12:19:42.666 27962 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:19:42 ctl02 nova-api[27962]: 2017-09-28 12:19:42.666 27962 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:19:42 ctl02 nova-api[27962]: 2017-09-28 12:19:42.666 27962 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:19:42 ctl02 nova-api[27962]: 2017-09-28 12:19:42.799 27962 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:19:42 ctl02 nova-api[27962]: 2017-09-28 12:19:42.801 27962 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:19:42 ctl02 nova-api[27962]: 2017-09-28 12:19:42.802 27962 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:19:42 ctl02 nova-api[27962]: 2017-09-28 12:19:42.802 27962 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:19:42 ctl02 nova-api[27962]: 2017-09-28 12:19:42.805 27962 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:19:42 ctl02 nova-api[27962]: 2017-09-28 12:19:42.806 27962 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:19:42 ctl02 nova-api[27962]: 2017-09-28 12:19:42.806 27962 ERROR nova Traceback (most recent call last):
Sep 28 12:19:42 ctl02 nova-api[27962]: 2017-09-28 12:19:42.806 27962 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:19:42 ctl02 nova-api[27962]: 2017-09-28 12:19:42.806 27962 ERROR nova     sys.exit(main())
Sep 28 12:19:42 ctl02 nova-api[27962]: 2017-09-28 12:19:42.806 27962 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:19:42 ctl02 nova-api[27962]: 2017-09-28 12:19:42.806 27962 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:19:42 ctl02 nova-api[27962]: 2017-09-28 12:19:42.806 27962 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:19:42 ctl02 nova-api[27962]: 2017-09-28 12:19:42.806 27962 ERROR nova     max_url_len=max_url_len)
Sep 28 12:19:42 ctl02 nova-api[27962]: 2017-09-28 12:19:42.806 27962 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:19:42 ctl02 nova-api[27962]: 2017-09-28 12:19:42.806 27962 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:19:42 ctl02 nova-api[27962]: 2017-09-28 12:19:42.806 27962 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:19:42 ctl02 nova-api[27962]: 2017-09-28 12:19:42.806 27962 ERROR nova     sock.listen(backlog)
Sep 28 12:19:42 ctl02 nova-api[27962]: 2017-09-28 12:19:42.806 27962 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:19:42 ctl02 nova-api[27962]: 2017-09-28 12:19:42.806 27962 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:19:42 ctl02 nova-api[27962]: 2017-09-28 12:19:42.806 27962 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:19:42 ctl02 nova-api[27962]: 2017-09-28 12:19:42.806 27962 ERROR nova
Sep 28 12:19:42 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:19:42 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:19:42 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:19:43 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:19:43.077 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:19:43] "OPTIONS / HTTP/1.0" 200 134 0.000503
Sep 28 12:19:43 ctl02 salt-minion[14967]: [INFO    ] Running scheduled job: __mine_interval
Sep 28 12:19:43 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:19:43 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:19:43 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:19:43 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:19:43 ctl02 glance-api[29183]: 2017-09-28 12:19:43.284 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:19:43] "OPTIONS / HTTP/1.0" 200 134 0.000569
Sep 28 12:19:44 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:19:44.652 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:19:44] "OPTIONS / HTTP/1.0" 200 134 0.000482
Sep 28 12:19:44 ctl02 heat-api[13008]: 2017-09-28 12:19:44.738 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:19:44] "OPTIONS / HTTP/1.0" 200 134 0.000507
Sep 28 12:19:44 ctl02 nova-api[27987]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:19:44 ctl02 nova-api[27987]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:19:44 ctl02 nova-api[27987]: 2017-09-28 12:19:44.912 27987 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:19:44 ctl02 nova-api[27987]: 2017-09-28 12:19:44.915 27987 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:19:44 ctl02 nova-api[27987]: 2017-09-28 12:19:44.915 27987 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:19:44 ctl02 nova-api[27987]: 2017-09-28 12:19:44.915 27987 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:19:44 ctl02 nova-api[27987]: 2017-09-28 12:19:44.915 27987 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:19:44 ctl02 nova-api[27987]: 2017-09-28 12:19:44.915 27987 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:19:44 ctl02 nova-api[27987]: 2017-09-28 12:19:44.915 27987 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:19:44 ctl02 nova-api[27987]: 2017-09-28 12:19:44.915 27987 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:19:44 ctl02 nova-api[27987]: 2017-09-28 12:19:44.915 27987 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:19:44 ctl02 nova-api[27987]: 2017-09-28 12:19:44.915 27987 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:19:44 ctl02 nova-api[27987]: 2017-09-28 12:19:44.915 27987 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:19:44 ctl02 nova-api[27987]: 2017-09-28 12:19:44.915 27987 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:19:44 ctl02 nova-api[27987]: 2017-09-28 12:19:44.915 27987 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:19:44 ctl02 nova-api[27987]: 2017-09-28 12:19:44.915 27987 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:19:44 ctl02 nova-api[27987]: 2017-09-28 12:19:44.915 27987 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:19:44 ctl02 nova-api[27987]: 2017-09-28 12:19:44.915 27987 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:19:44 ctl02 nova-api[27987]: 2017-09-28 12:19:44.915 27987 ERROR nova.wsgi     self.filename))
Sep 28 12:19:44 ctl02 nova-api[27987]: 2017-09-28 12:19:44.915 27987 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:19:44 ctl02 nova-api[27987]: 2017-09-28 12:19:44.915 27987 ERROR nova.wsgi
Sep 28 12:19:44 ctl02 nova-api[27987]: 2017-09-28 12:19:44.917 27987 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:19:45 ctl02 nova-api[27987]: 2017-09-28 12:19:45.043 27987 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:19:45 ctl02 nova-api[27987]: 2017-09-28 12:19:45.260 27987 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:19:45 ctl02 nova-api[27987]: 2017-09-28 12:19:45.263 27987 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:19:45 ctl02 nova-api[27987]: 2017-09-28 12:19:45.263 27987 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:19:45 ctl02 nova-api[27987]: 2017-09-28 12:19:45.263 27987 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:19:45 ctl02 nova-api[27987]: 2017-09-28 12:19:45.393 27987 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:19:45 ctl02 nova-api[27987]: 2017-09-28 12:19:45.395 27987 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:19:45 ctl02 nova-api[27987]: 2017-09-28 12:19:45.396 27987 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:19:45 ctl02 nova-api[27987]: 2017-09-28 12:19:45.396 27987 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:19:45 ctl02 nova-api[27987]: 2017-09-28 12:19:45.399 27987 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:19:45 ctl02 nova-api[27987]: 2017-09-28 12:19:45.400 27987 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:19:45 ctl02 nova-api[27987]: 2017-09-28 12:19:45.400 27987 ERROR nova Traceback (most recent call last):
Sep 28 12:19:45 ctl02 nova-api[27987]: 2017-09-28 12:19:45.400 27987 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:19:45 ctl02 nova-api[27987]: 2017-09-28 12:19:45.400 27987 ERROR nova     sys.exit(main())
Sep 28 12:19:45 ctl02 nova-api[27987]: 2017-09-28 12:19:45.400 27987 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:19:45 ctl02 nova-api[27987]: 2017-09-28 12:19:45.400 27987 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:19:45 ctl02 nova-api[27987]: 2017-09-28 12:19:45.400 27987 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:19:45 ctl02 nova-api[27987]: 2017-09-28 12:19:45.400 27987 ERROR nova     max_url_len=max_url_len)
Sep 28 12:19:45 ctl02 nova-api[27987]: 2017-09-28 12:19:45.400 27987 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:19:45 ctl02 nova-api[27987]: 2017-09-28 12:19:45.400 27987 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:19:45 ctl02 nova-api[27987]: 2017-09-28 12:19:45.400 27987 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:19:45 ctl02 nova-api[27987]: 2017-09-28 12:19:45.400 27987 ERROR nova     sock.listen(backlog)
Sep 28 12:19:45 ctl02 nova-api[27987]: 2017-09-28 12:19:45.400 27987 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:19:45 ctl02 nova-api[27987]: 2017-09-28 12:19:45.400 27987 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:19:45 ctl02 nova-api[27987]: 2017-09-28 12:19:45.400 27987 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:19:45 ctl02 nova-api[27987]: 2017-09-28 12:19:45.400 27987 ERROR nova
Sep 28 12:19:45 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:19:45 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:19:45 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:19:45 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:19:45 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:19:45 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:19:45 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:19:46 ctl02 heat-api[13008]: 2017-09-28 12:19:46.272 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:19:46] "OPTIONS / HTTP/1.0" 200 134 0.000541
Sep 28 12:19:47 ctl02 nova-api[28007]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:19:47 ctl02 nova-api[28007]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:19:47 ctl02 nova-api[28007]: 2017-09-28 12:19:47.683 28007 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:19:47 ctl02 nova-api[28007]: 2017-09-28 12:19:47.685 28007 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:19:47 ctl02 nova-api[28007]: 2017-09-28 12:19:47.685 28007 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:19:47 ctl02 nova-api[28007]: 2017-09-28 12:19:47.685 28007 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:19:47 ctl02 nova-api[28007]: 2017-09-28 12:19:47.685 28007 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:19:47 ctl02 nova-api[28007]: 2017-09-28 12:19:47.685 28007 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:19:47 ctl02 nova-api[28007]: 2017-09-28 12:19:47.685 28007 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:19:47 ctl02 nova-api[28007]: 2017-09-28 12:19:47.685 28007 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:19:47 ctl02 nova-api[28007]: 2017-09-28 12:19:47.685 28007 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:19:47 ctl02 nova-api[28007]: 2017-09-28 12:19:47.685 28007 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:19:47 ctl02 nova-api[28007]: 2017-09-28 12:19:47.685 28007 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:19:47 ctl02 nova-api[28007]: 2017-09-28 12:19:47.685 28007 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:19:47 ctl02 nova-api[28007]: 2017-09-28 12:19:47.685 28007 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:19:47 ctl02 nova-api[28007]: 2017-09-28 12:19:47.685 28007 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:19:47 ctl02 nova-api[28007]: 2017-09-28 12:19:47.685 28007 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:19:47 ctl02 nova-api[28007]: 2017-09-28 12:19:47.685 28007 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:19:47 ctl02 nova-api[28007]: 2017-09-28 12:19:47.685 28007 ERROR nova.wsgi     self.filename))
Sep 28 12:19:47 ctl02 nova-api[28007]: 2017-09-28 12:19:47.685 28007 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:19:47 ctl02 nova-api[28007]: 2017-09-28 12:19:47.685 28007 ERROR nova.wsgi
Sep 28 12:19:47 ctl02 nova-api[28007]: 2017-09-28 12:19:47.687 28007 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:19:47 ctl02 nova-api[28007]: 2017-09-28 12:19:47.813 28007 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:19:48 ctl02 nova-api[28007]: 2017-09-28 12:19:48.031 28007 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:19:48 ctl02 nova-api[28007]: 2017-09-28 12:19:48.033 28007 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:19:48 ctl02 nova-api[28007]: 2017-09-28 12:19:48.034 28007 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:19:48 ctl02 nova-api[28007]: 2017-09-28 12:19:48.034 28007 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:19:48 ctl02 nova-api[28007]: 2017-09-28 12:19:48.163 28007 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:19:48 ctl02 nova-api[28007]: 2017-09-28 12:19:48.166 28007 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:19:48 ctl02 nova-api[28007]: 2017-09-28 12:19:48.166 28007 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:19:48 ctl02 nova-api[28007]: 2017-09-28 12:19:48.167 28007 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:19:48 ctl02 nova-api[28007]: 2017-09-28 12:19:48.170 28007 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:19:48 ctl02 nova-api[28007]: 2017-09-28 12:19:48.170 28007 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:19:48 ctl02 nova-api[28007]: 2017-09-28 12:19:48.170 28007 ERROR nova Traceback (most recent call last):
Sep 28 12:19:48 ctl02 nova-api[28007]: 2017-09-28 12:19:48.170 28007 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:19:48 ctl02 nova-api[28007]: 2017-09-28 12:19:48.170 28007 ERROR nova     sys.exit(main())
Sep 28 12:19:48 ctl02 nova-api[28007]: 2017-09-28 12:19:48.170 28007 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:19:48 ctl02 nova-api[28007]: 2017-09-28 12:19:48.170 28007 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:19:48 ctl02 nova-api[28007]: 2017-09-28 12:19:48.170 28007 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:19:48 ctl02 nova-api[28007]: 2017-09-28 12:19:48.170 28007 ERROR nova     max_url_len=max_url_len)
Sep 28 12:19:48 ctl02 nova-api[28007]: 2017-09-28 12:19:48.170 28007 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:19:48 ctl02 nova-api[28007]: 2017-09-28 12:19:48.170 28007 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:19:48 ctl02 nova-api[28007]: 2017-09-28 12:19:48.170 28007 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:19:48 ctl02 nova-api[28007]: 2017-09-28 12:19:48.170 28007 ERROR nova     sock.listen(backlog)
Sep 28 12:19:48 ctl02 nova-api[28007]: 2017-09-28 12:19:48.170 28007 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:19:48 ctl02 nova-api[28007]: 2017-09-28 12:19:48.170 28007 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:19:48 ctl02 nova-api[28007]: 2017-09-28 12:19:48.170 28007 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:19:48 ctl02 nova-api[28007]: 2017-09-28 12:19:48.170 28007 ERROR nova
Sep 28 12:19:48 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:19:48 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:19:48 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:19:48 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:19:48 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:19:48 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:19:48 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:19:49 ctl02 nova-cert[4860]: 2017-09-28 12:19:49.043 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:19:49 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:19:49.097 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:19:49] "OPTIONS / HTTP/1.0" 200 134 0.000386
Sep 28 12:19:49 ctl02 heat-api-cfn[13300]: 2017-09-28 12:19:49.458 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:19:49] "OPTIONS / HTTP/1.0" 200 134 0.000412
Sep 28 12:19:49 ctl02 heat-api[13008]: 2017-09-28 12:19:49.565 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:19:49] "OPTIONS / HTTP/1.0" 200 134 0.000472
Sep 28 12:19:49 ctl02 glance-api[29183]: 2017-09-28 12:19:49.990 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:19:49] "OPTIONS / HTTP/1.0" 200 134 0.000559
Sep 28 12:19:50 ctl02 nova-api[28024]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:19:50 ctl02 nova-api[28024]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:19:50 ctl02 heat-api-cfn[13300]: 2017-09-28 12:19:50.306 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:19:50] "OPTIONS / HTTP/1.0" 200 134 0.000440
Sep 28 12:19:50 ctl02 nova-api[28024]: 2017-09-28 12:19:50.429 28024 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:19:50 ctl02 nova-api[28024]: 2017-09-28 12:19:50.431 28024 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:19:50 ctl02 nova-api[28024]: 2017-09-28 12:19:50.431 28024 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:19:50 ctl02 nova-api[28024]: 2017-09-28 12:19:50.431 28024 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:19:50 ctl02 nova-api[28024]: 2017-09-28 12:19:50.431 28024 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:19:50 ctl02 nova-api[28024]: 2017-09-28 12:19:50.431 28024 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:19:50 ctl02 nova-api[28024]: 2017-09-28 12:19:50.431 28024 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:19:50 ctl02 nova-api[28024]: 2017-09-28 12:19:50.431 28024 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:19:50 ctl02 nova-api[28024]: 2017-09-28 12:19:50.431 28024 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:19:50 ctl02 nova-api[28024]: 2017-09-28 12:19:50.431 28024 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:19:50 ctl02 nova-api[28024]: 2017-09-28 12:19:50.431 28024 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:19:50 ctl02 nova-api[28024]: 2017-09-28 12:19:50.431 28024 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:19:50 ctl02 nova-api[28024]: 2017-09-28 12:19:50.431 28024 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:19:50 ctl02 nova-api[28024]: 2017-09-28 12:19:50.431 28024 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:19:50 ctl02 nova-api[28024]: 2017-09-28 12:19:50.431 28024 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:19:50 ctl02 nova-api[28024]: 2017-09-28 12:19:50.431 28024 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:19:50 ctl02 nova-api[28024]: 2017-09-28 12:19:50.431 28024 ERROR nova.wsgi     self.filename))
Sep 28 12:19:50 ctl02 nova-api[28024]: 2017-09-28 12:19:50.431 28024 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:19:50 ctl02 nova-api[28024]: 2017-09-28 12:19:50.431 28024 ERROR nova.wsgi
Sep 28 12:19:50 ctl02 nova-api[28024]: 2017-09-28 12:19:50.431 28024 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:19:50 ctl02 heat-api-cfn[13300]: 2017-09-28 12:19:50.490 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:19:50] "OPTIONS / HTTP/1.0" 200 134 0.000422
Sep 28 12:19:50 ctl02 nova-api[28024]: 2017-09-28 12:19:50.559 28024 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:19:50 ctl02 nova-conductor[5056]: 2017-09-28 12:19:50.565 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:19:50 ctl02 nova-conductor[5056]: 2017-09-28 12:19:50.581 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:19:50 ctl02 nova-conductor[5056]: 2017-09-28 12:19:50.588 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:19:50 ctl02 nova-conductor[5056]: 2017-09-28 12:19:50.591 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:19:50 ctl02 nova-api[28024]: 2017-09-28 12:19:50.785 28024 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:19:50 ctl02 nova-api[28024]: 2017-09-28 12:19:50.787 28024 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:19:50 ctl02 nova-api[28024]: 2017-09-28 12:19:50.787 28024 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:19:50 ctl02 nova-api[28024]: 2017-09-28 12:19:50.787 28024 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:19:50 ctl02 nova-api[28024]: 2017-09-28 12:19:50.918 28024 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:19:50 ctl02 nova-api[28024]: 2017-09-28 12:19:50.920 28024 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:19:50 ctl02 nova-api[28024]: 2017-09-28 12:19:50.920 28024 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:19:50 ctl02 nova-api[28024]: 2017-09-28 12:19:50.920 28024 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:19:50 ctl02 nova-api[28024]: 2017-09-28 12:19:50.923 28024 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:19:50 ctl02 nova-api[28024]: 2017-09-28 12:19:50.923 28024 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:19:50 ctl02 nova-api[28024]: 2017-09-28 12:19:50.923 28024 ERROR nova Traceback (most recent call last):
Sep 28 12:19:50 ctl02 nova-api[28024]: 2017-09-28 12:19:50.923 28024 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:19:50 ctl02 nova-api[28024]: 2017-09-28 12:19:50.923 28024 ERROR nova     sys.exit(main())
Sep 28 12:19:50 ctl02 nova-api[28024]: 2017-09-28 12:19:50.923 28024 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:19:50 ctl02 nova-api[28024]: 2017-09-28 12:19:50.923 28024 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:19:50 ctl02 nova-api[28024]: 2017-09-28 12:19:50.923 28024 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:19:50 ctl02 nova-api[28024]: 2017-09-28 12:19:50.923 28024 ERROR nova     max_url_len=max_url_len)
Sep 28 12:19:50 ctl02 nova-api[28024]: 2017-09-28 12:19:50.923 28024 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:19:50 ctl02 nova-api[28024]: 2017-09-28 12:19:50.923 28024 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:19:50 ctl02 nova-api[28024]: 2017-09-28 12:19:50.923 28024 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:19:50 ctl02 nova-api[28024]: 2017-09-28 12:19:50.923 28024 ERROR nova     sock.listen(backlog)
Sep 28 12:19:50 ctl02 nova-api[28024]: 2017-09-28 12:19:50.923 28024 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:19:50 ctl02 nova-api[28024]: 2017-09-28 12:19:50.923 28024 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:19:50 ctl02 nova-api[28024]: 2017-09-28 12:19:50.923 28024 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:19:50 ctl02 nova-api[28024]: 2017-09-28 12:19:50.923 28024 ERROR nova
Sep 28 12:19:51 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:19:51 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:19:51 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:19:51 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:19:51 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:19:51 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:19:51 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:19:52 ctl02 glance-api[29183]: 2017-09-28 12:19:52.401 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:19:52] "OPTIONS / HTTP/1.0" 200 134 0.000547
Sep 28 12:19:52 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc222ed3d)
Sep 28 12:19:53 ctl02 nova-api[28042]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:19:53 ctl02 nova-api[28042]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:19:53 ctl02 nova-api[28042]: 2017-09-28 12:19:53.170 28042 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:19:53 ctl02 nova-api[28042]: 2017-09-28 12:19:53.172 28042 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:19:53 ctl02 nova-api[28042]: 2017-09-28 12:19:53.172 28042 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:19:53 ctl02 nova-api[28042]: 2017-09-28 12:19:53.172 28042 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:19:53 ctl02 nova-api[28042]: 2017-09-28 12:19:53.172 28042 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:19:53 ctl02 nova-api[28042]: 2017-09-28 12:19:53.172 28042 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:19:53 ctl02 nova-api[28042]: 2017-09-28 12:19:53.172 28042 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:19:53 ctl02 nova-api[28042]: 2017-09-28 12:19:53.172 28042 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:19:53 ctl02 nova-api[28042]: 2017-09-28 12:19:53.172 28042 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:19:53 ctl02 nova-api[28042]: 2017-09-28 12:19:53.172 28042 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:19:53 ctl02 nova-api[28042]: 2017-09-28 12:19:53.172 28042 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:19:53 ctl02 nova-api[28042]: 2017-09-28 12:19:53.172 28042 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:19:53 ctl02 nova-api[28042]: 2017-09-28 12:19:53.172 28042 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:19:53 ctl02 nova-api[28042]: 2017-09-28 12:19:53.172 28042 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:19:53 ctl02 nova-api[28042]: 2017-09-28 12:19:53.172 28042 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:19:53 ctl02 nova-api[28042]: 2017-09-28 12:19:53.172 28042 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:19:53 ctl02 nova-api[28042]: 2017-09-28 12:19:53.172 28042 ERROR nova.wsgi     self.filename))
Sep 28 12:19:53 ctl02 nova-api[28042]: 2017-09-28 12:19:53.172 28042 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:19:53 ctl02 nova-api[28042]: 2017-09-28 12:19:53.172 28042 ERROR nova.wsgi
Sep 28 12:19:53 ctl02 nova-api[28042]: 2017-09-28 12:19:53.175 28042 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:19:53 ctl02 glance-api[29183]: 2017-09-28 12:19:53.189 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:19:53] "OPTIONS / HTTP/1.0" 200 134 0.000585
Sep 28 12:19:53 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:19:53.234 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:19:53] "OPTIONS / HTTP/1.0" 200 134 0.000389
Sep 28 12:19:53 ctl02 nova-api[28042]: 2017-09-28 12:19:53.304 28042 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:19:53 ctl02 nova-api[28042]: 2017-09-28 12:19:53.522 28042 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:19:53 ctl02 nova-api[28042]: 2017-09-28 12:19:53.524 28042 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:19:53 ctl02 nova-api[28042]: 2017-09-28 12:19:53.524 28042 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:19:53 ctl02 nova-api[28042]: 2017-09-28 12:19:53.525 28042 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:19:53 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc222ed3d)
Sep 28 12:19:53 ctl02 nova-api[28042]: 2017-09-28 12:19:53.653 28042 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:19:53 ctl02 nova-api[28042]: 2017-09-28 12:19:53.654 28042 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:19:53 ctl02 nova-api[28042]: 2017-09-28 12:19:53.655 28042 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:19:53 ctl02 nova-api[28042]: 2017-09-28 12:19:53.655 28042 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:19:53 ctl02 nova-api[28042]: 2017-09-28 12:19:53.658 28042 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:19:53 ctl02 nova-api[28042]: 2017-09-28 12:19:53.658 28042 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:19:53 ctl02 nova-api[28042]: 2017-09-28 12:19:53.658 28042 ERROR nova Traceback (most recent call last):
Sep 28 12:19:53 ctl02 nova-api[28042]: 2017-09-28 12:19:53.658 28042 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:19:53 ctl02 nova-api[28042]: 2017-09-28 12:19:53.658 28042 ERROR nova     sys.exit(main())
Sep 28 12:19:53 ctl02 nova-api[28042]: 2017-09-28 12:19:53.658 28042 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:19:53 ctl02 nova-api[28042]: 2017-09-28 12:19:53.658 28042 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:19:53 ctl02 nova-api[28042]: 2017-09-28 12:19:53.658 28042 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:19:53 ctl02 nova-api[28042]: 2017-09-28 12:19:53.658 28042 ERROR nova     max_url_len=max_url_len)
Sep 28 12:19:53 ctl02 nova-api[28042]: 2017-09-28 12:19:53.658 28042 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:19:53 ctl02 nova-api[28042]: 2017-09-28 12:19:53.658 28042 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:19:53 ctl02 nova-api[28042]: 2017-09-28 12:19:53.658 28042 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:19:53 ctl02 nova-api[28042]: 2017-09-28 12:19:53.658 28042 ERROR nova     sock.listen(backlog)
Sep 28 12:19:53 ctl02 nova-api[28042]: 2017-09-28 12:19:53.658 28042 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:19:53 ctl02 nova-api[28042]: 2017-09-28 12:19:53.658 28042 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:19:53 ctl02 nova-api[28042]: 2017-09-28 12:19:53.658 28042 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:19:53 ctl02 nova-api[28042]: 2017-09-28 12:19:53.658 28042 ERROR nova
Sep 28 12:19:53 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:19:53 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:19:53 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:19:54 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:19:54 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:19:54 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:19:54 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:19:54 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc222ed3d)
Sep 28 12:19:54 ctl02 heat-api[13008]: 2017-09-28 12:19:54.953 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:19:54] "OPTIONS / HTTP/1.0" 200 134 0.000504
Sep 28 12:19:55 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:19:55.024 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:19:55] "OPTIONS / HTTP/1.0" 200 134 0.000372
Sep 28 12:19:55 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc222ed3d)
Sep 28 12:19:55 ctl02 nova-api[28061]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:19:55 ctl02 nova-api[28061]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:19:55 ctl02 nova-api[28061]: 2017-09-28 12:19:55.937 28061 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:19:55 ctl02 nova-api[28061]: 2017-09-28 12:19:55.939 28061 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:19:55 ctl02 nova-api[28061]: 2017-09-28 12:19:55.939 28061 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:19:55 ctl02 nova-api[28061]: 2017-09-28 12:19:55.939 28061 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:19:55 ctl02 nova-api[28061]: 2017-09-28 12:19:55.939 28061 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:19:55 ctl02 nova-api[28061]: 2017-09-28 12:19:55.939 28061 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:19:55 ctl02 nova-api[28061]: 2017-09-28 12:19:55.939 28061 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:19:55 ctl02 nova-api[28061]: 2017-09-28 12:19:55.939 28061 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:19:55 ctl02 nova-api[28061]: 2017-09-28 12:19:55.939 28061 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:19:55 ctl02 nova-api[28061]: 2017-09-28 12:19:55.939 28061 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:19:55 ctl02 nova-api[28061]: 2017-09-28 12:19:55.939 28061 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:19:55 ctl02 nova-api[28061]: 2017-09-28 12:19:55.939 28061 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:19:55 ctl02 nova-api[28061]: 2017-09-28 12:19:55.939 28061 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:19:55 ctl02 nova-api[28061]: 2017-09-28 12:19:55.939 28061 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:19:55 ctl02 nova-api[28061]: 2017-09-28 12:19:55.939 28061 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:19:55 ctl02 nova-api[28061]: 2017-09-28 12:19:55.939 28061 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:19:55 ctl02 nova-api[28061]: 2017-09-28 12:19:55.939 28061 ERROR nova.wsgi     self.filename))
Sep 28 12:19:55 ctl02 nova-api[28061]: 2017-09-28 12:19:55.939 28061 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:19:55 ctl02 nova-api[28061]: 2017-09-28 12:19:55.939 28061 ERROR nova.wsgi
Sep 28 12:19:55 ctl02 nova-api[28061]: 2017-09-28 12:19:55.941 28061 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:19:56 ctl02 nova-api[28061]: 2017-09-28 12:19:56.069 28061 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:19:56 ctl02 nova-api[28061]: 2017-09-28 12:19:56.292 28061 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:19:56 ctl02 nova-api[28061]: 2017-09-28 12:19:56.294 28061 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:19:56 ctl02 nova-api[28061]: 2017-09-28 12:19:56.295 28061 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:19:56 ctl02 nova-api[28061]: 2017-09-28 12:19:56.295 28061 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:19:56 ctl02 nova-api[28061]: 2017-09-28 12:19:56.426 28061 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:19:56 ctl02 nova-api[28061]: 2017-09-28 12:19:56.429 28061 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:19:56 ctl02 nova-api[28061]: 2017-09-28 12:19:56.429 28061 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:19:56 ctl02 nova-api[28061]: 2017-09-28 12:19:56.430 28061 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:19:56 ctl02 nova-api[28061]: 2017-09-28 12:19:56.433 28061 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:19:56 ctl02 nova-api[28061]: 2017-09-28 12:19:56.433 28061 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:19:56 ctl02 nova-api[28061]: 2017-09-28 12:19:56.433 28061 ERROR nova Traceback (most recent call last):
Sep 28 12:19:56 ctl02 nova-api[28061]: 2017-09-28 12:19:56.433 28061 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:19:56 ctl02 nova-api[28061]: 2017-09-28 12:19:56.433 28061 ERROR nova     sys.exit(main())
Sep 28 12:19:56 ctl02 nova-api[28061]: 2017-09-28 12:19:56.433 28061 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:19:56 ctl02 nova-api[28061]: 2017-09-28 12:19:56.433 28061 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:19:56 ctl02 nova-api[28061]: 2017-09-28 12:19:56.433 28061 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:19:56 ctl02 nova-api[28061]: 2017-09-28 12:19:56.433 28061 ERROR nova     max_url_len=max_url_len)
Sep 28 12:19:56 ctl02 nova-api[28061]: 2017-09-28 12:19:56.433 28061 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:19:56 ctl02 nova-api[28061]: 2017-09-28 12:19:56.433 28061 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:19:56 ctl02 nova-api[28061]: 2017-09-28 12:19:56.433 28061 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:19:56 ctl02 nova-api[28061]: 2017-09-28 12:19:56.433 28061 ERROR nova     sock.listen(backlog)
Sep 28 12:19:56 ctl02 nova-api[28061]: 2017-09-28 12:19:56.433 28061 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:19:56 ctl02 nova-api[28061]: 2017-09-28 12:19:56.433 28061 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:19:56 ctl02 nova-api[28061]: 2017-09-28 12:19:56.433 28061 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:19:56 ctl02 nova-api[28061]: 2017-09-28 12:19:56.433 28061 ERROR nova
Sep 28 12:19:56 ctl02 heat-api[13008]: 2017-09-28 12:19:56.493 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:19:56] "OPTIONS / HTTP/1.0" 200 134 0.000528
Sep 28 12:19:56 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:19:56 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:19:56 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:19:56 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc222ed3d)
Sep 28 12:19:56 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:19:56 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:19:56 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:19:56 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:19:57 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc222ed3d)
Sep 28 12:19:58 ctl02 nova-api[28079]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:19:58 ctl02 nova-api[28079]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:19:58 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc222ed3d)
Sep 28 12:19:58 ctl02 nova-api[28079]: 2017-09-28 12:19:58.682 28079 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:19:58 ctl02 nova-api[28079]: 2017-09-28 12:19:58.683 28079 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:19:58 ctl02 nova-api[28079]: 2017-09-28 12:19:58.683 28079 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:19:58 ctl02 nova-api[28079]: 2017-09-28 12:19:58.683 28079 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:19:58 ctl02 nova-api[28079]: 2017-09-28 12:19:58.683 28079 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:19:58 ctl02 nova-api[28079]: 2017-09-28 12:19:58.683 28079 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:19:58 ctl02 nova-api[28079]: 2017-09-28 12:19:58.683 28079 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:19:58 ctl02 nova-api[28079]: 2017-09-28 12:19:58.683 28079 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:19:58 ctl02 nova-api[28079]: 2017-09-28 12:19:58.683 28079 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:19:58 ctl02 nova-api[28079]: 2017-09-28 12:19:58.683 28079 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:19:58 ctl02 nova-api[28079]: 2017-09-28 12:19:58.683 28079 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:19:58 ctl02 nova-api[28079]: 2017-09-28 12:19:58.683 28079 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:19:58 ctl02 nova-api[28079]: 2017-09-28 12:19:58.683 28079 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:19:58 ctl02 nova-api[28079]: 2017-09-28 12:19:58.683 28079 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:19:58 ctl02 nova-api[28079]: 2017-09-28 12:19:58.683 28079 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:19:58 ctl02 nova-api[28079]: 2017-09-28 12:19:58.683 28079 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:19:58 ctl02 nova-api[28079]: 2017-09-28 12:19:58.683 28079 ERROR nova.wsgi     self.filename))
Sep 28 12:19:58 ctl02 nova-api[28079]: 2017-09-28 12:19:58.683 28079 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:19:58 ctl02 nova-api[28079]: 2017-09-28 12:19:58.683 28079 ERROR nova.wsgi
Sep 28 12:19:58 ctl02 nova-api[28079]: 2017-09-28 12:19:58.684 28079 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:19:58 ctl02 nova-api[28079]: 2017-09-28 12:19:58.811 28079 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:19:58 ctl02 nova-consoleauth[5433]: 2017-09-28 12:19:58.926 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:19:59 ctl02 nova-api[28079]: 2017-09-28 12:19:59.028 28079 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:19:59 ctl02 nova-api[28079]: 2017-09-28 12:19:59.030 28079 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:19:59 ctl02 nova-api[28079]: 2017-09-28 12:19:59.030 28079 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:19:59 ctl02 nova-api[28079]: 2017-09-28 12:19:59.030 28079 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:19:59 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:19:59.048 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:19:59] "OPTIONS / HTTP/1.0" 200 134 0.000407
Sep 28 12:19:59 ctl02 nova-api[28079]: 2017-09-28 12:19:59.160 28079 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:19:59 ctl02 nova-api[28079]: 2017-09-28 12:19:59.161 28079 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:19:59 ctl02 nova-api[28079]: 2017-09-28 12:19:59.161 28079 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:19:59 ctl02 nova-api[28079]: 2017-09-28 12:19:59.162 28079 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:19:59 ctl02 nova-api[28079]: 2017-09-28 12:19:59.165 28079 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:19:59 ctl02 nova-api[28079]: 2017-09-28 12:19:59.165 28079 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:19:59 ctl02 nova-api[28079]: 2017-09-28 12:19:59.165 28079 ERROR nova Traceback (most recent call last):
Sep 28 12:19:59 ctl02 nova-api[28079]: 2017-09-28 12:19:59.165 28079 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:19:59 ctl02 nova-api[28079]: 2017-09-28 12:19:59.165 28079 ERROR nova     sys.exit(main())
Sep 28 12:19:59 ctl02 nova-api[28079]: 2017-09-28 12:19:59.165 28079 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:19:59 ctl02 nova-api[28079]: 2017-09-28 12:19:59.165 28079 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:19:59 ctl02 nova-api[28079]: 2017-09-28 12:19:59.165 28079 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:19:59 ctl02 nova-api[28079]: 2017-09-28 12:19:59.165 28079 ERROR nova     max_url_len=max_url_len)
Sep 28 12:19:59 ctl02 nova-api[28079]: 2017-09-28 12:19:59.165 28079 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:19:59 ctl02 nova-api[28079]: 2017-09-28 12:19:59.165 28079 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:19:59 ctl02 nova-api[28079]: 2017-09-28 12:19:59.165 28079 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:19:59 ctl02 nova-api[28079]: 2017-09-28 12:19:59.165 28079 ERROR nova     sock.listen(backlog)
Sep 28 12:19:59 ctl02 nova-api[28079]: 2017-09-28 12:19:59.165 28079 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:19:59 ctl02 nova-api[28079]: 2017-09-28 12:19:59.165 28079 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:19:59 ctl02 nova-api[28079]: 2017-09-28 12:19:59.165 28079 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:19:59 ctl02 nova-api[28079]: 2017-09-28 12:19:59.165 28079 ERROR nova
Sep 28 12:19:59 ctl02 heat-api[13008]: 2017-09-28 12:19:59.275 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:19:59] "OPTIONS / HTTP/1.0" 200 134 0.000600
Sep 28 12:19:59 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:19:59 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:19:59 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:19:59 ctl02 heat-api-cfn[13300]: 2017-09-28 12:19:59.575 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:19:59] "OPTIONS / HTTP/1.0" 200 134 0.000561
Sep 28 12:19:59 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:19:59 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:19:59 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc222ed3d)
Sep 28 12:19:59 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:19:59 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:20:00 ctl02 heat-api-cfn[13300]: 2017-09-28 12:20:00.150 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:20:00] "OPTIONS / HTTP/1.0" 200 134 0.000516
Sep 28 12:20:00 ctl02 glance-api[29183]: 2017-09-28 12:20:00.215 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:20:00] "OPTIONS / HTTP/1.0" 200 134 0.000661
Sep 28 12:20:00 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc222ed3d)
Sep 28 12:20:00 ctl02 heat-api-cfn[13300]: 2017-09-28 12:20:00.861 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:20:00] "OPTIONS / HTTP/1.0" 200 134 0.000536
Sep 28 12:20:01 ctl02 nova-api[28098]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:20:01 ctl02 nova-api[28098]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:20:01 ctl02 nova-api[28098]: 2017-09-28 12:20:01.550 28098 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:20:01 ctl02 nova-api[28098]: 2017-09-28 12:20:01.552 28098 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:20:01 ctl02 nova-api[28098]: 2017-09-28 12:20:01.552 28098 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:20:01 ctl02 nova-api[28098]: 2017-09-28 12:20:01.552 28098 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:20:01 ctl02 nova-api[28098]: 2017-09-28 12:20:01.552 28098 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:20:01 ctl02 nova-api[28098]: 2017-09-28 12:20:01.552 28098 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:20:01 ctl02 nova-api[28098]: 2017-09-28 12:20:01.552 28098 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:20:01 ctl02 nova-api[28098]: 2017-09-28 12:20:01.552 28098 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:20:01 ctl02 nova-api[28098]: 2017-09-28 12:20:01.552 28098 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:20:01 ctl02 nova-api[28098]: 2017-09-28 12:20:01.552 28098 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:20:01 ctl02 nova-api[28098]: 2017-09-28 12:20:01.552 28098 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:20:01 ctl02 nova-api[28098]: 2017-09-28 12:20:01.552 28098 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:20:01 ctl02 nova-api[28098]: 2017-09-28 12:20:01.552 28098 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:20:01 ctl02 nova-api[28098]: 2017-09-28 12:20:01.552 28098 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:20:01 ctl02 nova-api[28098]: 2017-09-28 12:20:01.552 28098 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:20:01 ctl02 nova-api[28098]: 2017-09-28 12:20:01.552 28098 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:20:01 ctl02 nova-api[28098]: 2017-09-28 12:20:01.552 28098 ERROR nova.wsgi     self.filename))
Sep 28 12:20:01 ctl02 nova-api[28098]: 2017-09-28 12:20:01.552 28098 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:20:01 ctl02 nova-api[28098]: 2017-09-28 12:20:01.552 28098 ERROR nova.wsgi
Sep 28 12:20:01 ctl02 nova-api[28098]: 2017-09-28 12:20:01.553 28098 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:20:01 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc222ed3d)
Sep 28 12:20:01 ctl02 heat-engine[12803]: 2017-09-28 12:20:01.678 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:20:01 ctl02 heat-engine[12803]: 2017-09-28 12:20:01.681 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:20:01 ctl02 heat-engine[12803]: 2017-09-28 12:20:01.686 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:20:01 ctl02 heat-engine[12803]: 2017-09-28 12:20:01.687 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:20:01 ctl02 nova-api[28098]: 2017-09-28 12:20:01.692 28098 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:20:01 ctl02 nova-scheduler[5620]: 2017-09-28 12:20:01.946 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:20:01 ctl02 nova-api[28098]: 2017-09-28 12:20:01.949 28098 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:20:01 ctl02 nova-api[28098]: 2017-09-28 12:20:01.951 28098 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:20:01 ctl02 nova-api[28098]: 2017-09-28 12:20:01.952 28098 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:20:01 ctl02 nova-api[28098]: 2017-09-28 12:20:01.952 28098 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:20:02 ctl02 nova-api[28098]: 2017-09-28 12:20:02.087 28098 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:20:02 ctl02 nova-api[28098]: 2017-09-28 12:20:02.090 28098 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:20:02 ctl02 nova-api[28098]: 2017-09-28 12:20:02.090 28098 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:20:02 ctl02 nova-api[28098]: 2017-09-28 12:20:02.091 28098 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:20:02 ctl02 nova-api[28098]: 2017-09-28 12:20:02.094 28098 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:20:02 ctl02 nova-api[28098]: 2017-09-28 12:20:02.095 28098 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:20:02 ctl02 nova-api[28098]: 2017-09-28 12:20:02.095 28098 ERROR nova Traceback (most recent call last):
Sep 28 12:20:02 ctl02 nova-api[28098]: 2017-09-28 12:20:02.095 28098 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:20:02 ctl02 nova-api[28098]: 2017-09-28 12:20:02.095 28098 ERROR nova     sys.exit(main())
Sep 28 12:20:02 ctl02 nova-api[28098]: 2017-09-28 12:20:02.095 28098 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:20:02 ctl02 nova-api[28098]: 2017-09-28 12:20:02.095 28098 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:20:02 ctl02 nova-api[28098]: 2017-09-28 12:20:02.095 28098 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:20:02 ctl02 nova-api[28098]: 2017-09-28 12:20:02.095 28098 ERROR nova     max_url_len=max_url_len)
Sep 28 12:20:02 ctl02 nova-api[28098]: 2017-09-28 12:20:02.095 28098 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:20:02 ctl02 nova-api[28098]: 2017-09-28 12:20:02.095 28098 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:20:02 ctl02 nova-api[28098]: 2017-09-28 12:20:02.095 28098 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:20:02 ctl02 nova-api[28098]: 2017-09-28 12:20:02.095 28098 ERROR nova     sock.listen(backlog)
Sep 28 12:20:02 ctl02 nova-api[28098]: 2017-09-28 12:20:02.095 28098 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:20:02 ctl02 nova-api[28098]: 2017-09-28 12:20:02.095 28098 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:20:02 ctl02 nova-api[28098]: 2017-09-28 12:20:02.095 28098 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:20:02 ctl02 nova-api[28098]: 2017-09-28 12:20:02.095 28098 ERROR nova
Sep 28 12:20:02 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:20:02 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:20:02 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:20:02 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:20:02 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:20:02 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:20:02 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc222ed3d)
Sep 28 12:20:02 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:20:02 ctl02 glance-api[29183]: 2017-09-28 12:20:02.672 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:20:02] "OPTIONS / HTTP/1.0" 200 134 0.000630
Sep 28 12:20:02 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:20:02.893 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:20:02] "OPTIONS / HTTP/1.0" 200 134 0.000476
Sep 28 12:20:03 ctl02 glance-api[29183]: 2017-09-28 12:20:03.528 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:20:03] "OPTIONS / HTTP/1.0" 200 134 0.000706
Sep 28 12:20:03 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:20:03 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:20:04 ctl02 nova-api[28115]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:20:04 ctl02 nova-api[28115]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:20:04 ctl02 nova-api[28115]: 2017-09-28 12:20:04.548 28115 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:20:04 ctl02 nova-api[28115]: 2017-09-28 12:20:04.551 28115 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:20:04 ctl02 nova-api[28115]: 2017-09-28 12:20:04.551 28115 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:20:04 ctl02 nova-api[28115]: 2017-09-28 12:20:04.551 28115 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:20:04 ctl02 nova-api[28115]: 2017-09-28 12:20:04.551 28115 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:20:04 ctl02 nova-api[28115]: 2017-09-28 12:20:04.551 28115 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:20:04 ctl02 nova-api[28115]: 2017-09-28 12:20:04.551 28115 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:20:04 ctl02 nova-api[28115]: 2017-09-28 12:20:04.551 28115 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:20:04 ctl02 nova-api[28115]: 2017-09-28 12:20:04.551 28115 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:20:04 ctl02 nova-api[28115]: 2017-09-28 12:20:04.551 28115 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:20:04 ctl02 nova-api[28115]: 2017-09-28 12:20:04.551 28115 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:20:04 ctl02 nova-api[28115]: 2017-09-28 12:20:04.551 28115 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:20:04 ctl02 nova-api[28115]: 2017-09-28 12:20:04.551 28115 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:20:04 ctl02 nova-api[28115]: 2017-09-28 12:20:04.551 28115 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:20:04 ctl02 nova-api[28115]: 2017-09-28 12:20:04.551 28115 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:20:04 ctl02 nova-api[28115]: 2017-09-28 12:20:04.551 28115 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:20:04 ctl02 nova-api[28115]: 2017-09-28 12:20:04.551 28115 ERROR nova.wsgi     self.filename))
Sep 28 12:20:04 ctl02 nova-api[28115]: 2017-09-28 12:20:04.551 28115 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:20:04 ctl02 nova-api[28115]: 2017-09-28 12:20:04.551 28115 ERROR nova.wsgi
Sep 28 12:20:04 ctl02 nova-api[28115]: 2017-09-28 12:20:04.553 28115 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:20:04 ctl02 nova-api[28115]: 2017-09-28 12:20:04.696 28115 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:20:04 ctl02 nova-api[28115]: 2017-09-28 12:20:04.959 28115 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:20:04 ctl02 nova-api[28115]: 2017-09-28 12:20:04.962 28115 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:20:04 ctl02 nova-api[28115]: 2017-09-28 12:20:04.963 28115 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:20:04 ctl02 nova-api[28115]: 2017-09-28 12:20:04.963 28115 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:20:05 ctl02 nova-api[28115]: 2017-09-28 12:20:05.104 28115 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:20:05 ctl02 nova-api[28115]: 2017-09-28 12:20:05.108 28115 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:20:05 ctl02 nova-api[28115]: 2017-09-28 12:20:05.108 28115 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:20:05 ctl02 nova-api[28115]: 2017-09-28 12:20:05.109 28115 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:20:05 ctl02 nova-api[28115]: 2017-09-28 12:20:05.112 28115 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:20:05 ctl02 nova-api[28115]: 2017-09-28 12:20:05.113 28115 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:20:05 ctl02 nova-api[28115]: 2017-09-28 12:20:05.113 28115 ERROR nova Traceback (most recent call last):
Sep 28 12:20:05 ctl02 nova-api[28115]: 2017-09-28 12:20:05.113 28115 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:20:05 ctl02 nova-api[28115]: 2017-09-28 12:20:05.113 28115 ERROR nova     sys.exit(main())
Sep 28 12:20:05 ctl02 nova-api[28115]: 2017-09-28 12:20:05.113 28115 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:20:05 ctl02 nova-api[28115]: 2017-09-28 12:20:05.113 28115 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:20:05 ctl02 nova-api[28115]: 2017-09-28 12:20:05.113 28115 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:20:05 ctl02 nova-api[28115]: 2017-09-28 12:20:05.113 28115 ERROR nova     max_url_len=max_url_len)
Sep 28 12:20:05 ctl02 nova-api[28115]: 2017-09-28 12:20:05.113 28115 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:20:05 ctl02 nova-api[28115]: 2017-09-28 12:20:05.113 28115 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:20:05 ctl02 nova-api[28115]: 2017-09-28 12:20:05.113 28115 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:20:05 ctl02 nova-api[28115]: 2017-09-28 12:20:05.113 28115 ERROR nova     sock.listen(backlog)
Sep 28 12:20:05 ctl02 nova-api[28115]: 2017-09-28 12:20:05.113 28115 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:20:05 ctl02 nova-api[28115]: 2017-09-28 12:20:05.113 28115 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:20:05 ctl02 nova-api[28115]: 2017-09-28 12:20:05.113 28115 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:20:05 ctl02 nova-api[28115]: 2017-09-28 12:20:05.113 28115 ERROR nova
Sep 28 12:20:05 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:20:05.149 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:20:05] "OPTIONS / HTTP/1.0" 200 134 0.000467
Sep 28 12:20:05 ctl02 heat-api[13008]: 2017-09-28 12:20:05.234 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:20:05] "OPTIONS / HTTP/1.0" 200 134 0.000631
Sep 28 12:20:05 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:20:05 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:20:05 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:20:05 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:20:05 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:20:05 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:20:05 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:20:06 ctl02 heat-api[13008]: 2017-09-28 12:20:06.591 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:20:06] "OPTIONS / HTTP/1.0" 200 134 0.000665
Sep 28 12:20:07 ctl02 nova-api[28139]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:20:07 ctl02 nova-api[28139]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:20:07 ctl02 nova-api[28139]: 2017-09-28 12:20:07.515 28139 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:20:07 ctl02 nova-api[28139]: 2017-09-28 12:20:07.517 28139 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:20:07 ctl02 nova-api[28139]: 2017-09-28 12:20:07.517 28139 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:20:07 ctl02 nova-api[28139]: 2017-09-28 12:20:07.517 28139 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:20:07 ctl02 nova-api[28139]: 2017-09-28 12:20:07.517 28139 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:20:07 ctl02 nova-api[28139]: 2017-09-28 12:20:07.517 28139 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:20:07 ctl02 nova-api[28139]: 2017-09-28 12:20:07.517 28139 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:20:07 ctl02 nova-api[28139]: 2017-09-28 12:20:07.517 28139 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:20:07 ctl02 nova-api[28139]: 2017-09-28 12:20:07.517 28139 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:20:07 ctl02 nova-api[28139]: 2017-09-28 12:20:07.517 28139 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:20:07 ctl02 nova-api[28139]: 2017-09-28 12:20:07.517 28139 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:20:07 ctl02 nova-api[28139]: 2017-09-28 12:20:07.517 28139 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:20:07 ctl02 nova-api[28139]: 2017-09-28 12:20:07.517 28139 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:20:07 ctl02 nova-api[28139]: 2017-09-28 12:20:07.517 28139 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:20:07 ctl02 nova-api[28139]: 2017-09-28 12:20:07.517 28139 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:20:07 ctl02 nova-api[28139]: 2017-09-28 12:20:07.517 28139 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:20:07 ctl02 nova-api[28139]: 2017-09-28 12:20:07.517 28139 ERROR nova.wsgi     self.filename))
Sep 28 12:20:07 ctl02 nova-api[28139]: 2017-09-28 12:20:07.517 28139 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:20:07 ctl02 nova-api[28139]: 2017-09-28 12:20:07.517 28139 ERROR nova.wsgi
Sep 28 12:20:07 ctl02 nova-api[28139]: 2017-09-28 12:20:07.520 28139 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:20:07 ctl02 nova-api[28139]: 2017-09-28 12:20:07.660 28139 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:20:07 ctl02 nova-api[28139]: 2017-09-28 12:20:07.921 28139 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:20:07 ctl02 nova-api[28139]: 2017-09-28 12:20:07.924 28139 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:20:07 ctl02 nova-api[28139]: 2017-09-28 12:20:07.924 28139 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:20:07 ctl02 nova-api[28139]: 2017-09-28 12:20:07.925 28139 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:20:08 ctl02 nova-api[28139]: 2017-09-28 12:20:08.064 28139 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:20:08 ctl02 nova-api[28139]: 2017-09-28 12:20:08.067 28139 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:20:08 ctl02 nova-api[28139]: 2017-09-28 12:20:08.068 28139 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:20:08 ctl02 nova-api[28139]: 2017-09-28 12:20:08.068 28139 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:20:08 ctl02 nova-api[28139]: 2017-09-28 12:20:08.072 28139 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:20:08 ctl02 nova-api[28139]: 2017-09-28 12:20:08.072 28139 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:20:08 ctl02 nova-api[28139]: 2017-09-28 12:20:08.072 28139 ERROR nova Traceback (most recent call last):
Sep 28 12:20:08 ctl02 nova-api[28139]: 2017-09-28 12:20:08.072 28139 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:20:08 ctl02 nova-api[28139]: 2017-09-28 12:20:08.072 28139 ERROR nova     sys.exit(main())
Sep 28 12:20:08 ctl02 nova-api[28139]: 2017-09-28 12:20:08.072 28139 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:20:08 ctl02 nova-api[28139]: 2017-09-28 12:20:08.072 28139 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:20:08 ctl02 nova-api[28139]: 2017-09-28 12:20:08.072 28139 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:20:08 ctl02 nova-api[28139]: 2017-09-28 12:20:08.072 28139 ERROR nova     max_url_len=max_url_len)
Sep 28 12:20:08 ctl02 nova-api[28139]: 2017-09-28 12:20:08.072 28139 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:20:08 ctl02 nova-api[28139]: 2017-09-28 12:20:08.072 28139 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:20:08 ctl02 nova-api[28139]: 2017-09-28 12:20:08.072 28139 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:20:08 ctl02 nova-api[28139]: 2017-09-28 12:20:08.072 28139 ERROR nova     sock.listen(backlog)
Sep 28 12:20:08 ctl02 nova-api[28139]: 2017-09-28 12:20:08.072 28139 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:20:08 ctl02 nova-api[28139]: 2017-09-28 12:20:08.072 28139 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:20:08 ctl02 nova-api[28139]: 2017-09-28 12:20:08.072 28139 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:20:08 ctl02 nova-api[28139]: 2017-09-28 12:20:08.072 28139 ERROR nova
Sep 28 12:20:08 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:20:08 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:20:08 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:20:08 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:20:08 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:20:08 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:20:08 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:20:08 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:20:08.973 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:20:08] "OPTIONS / HTTP/1.0" 200 134 0.000429
Sep 28 12:20:09 ctl02 heat-api-cfn[13300]: 2017-09-28 12:20:09.314 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:20:09] "OPTIONS / HTTP/1.0" 200 134 0.000424
Sep 28 12:20:09 ctl02 heat-api[13008]: 2017-09-28 12:20:09.321 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:20:09] "OPTIONS / HTTP/1.0" 200 134 0.000508
Sep 28 12:20:09 ctl02 heat-api-cfn[13300]: 2017-09-28 12:20:09.923 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:20:09] "OPTIONS / HTTP/1.0" 200 134 0.000397
Sep 28 12:20:10 ctl02 nova-api[28156]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:20:10 ctl02 nova-api[28156]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:20:10 ctl02 nova-api[28156]: 2017-09-28 12:20:10.193 28156 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:20:10 ctl02 nova-api[28156]: 2017-09-28 12:20:10.195 28156 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:20:10 ctl02 nova-api[28156]: 2017-09-28 12:20:10.195 28156 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:20:10 ctl02 nova-api[28156]: 2017-09-28 12:20:10.195 28156 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:20:10 ctl02 nova-api[28156]: 2017-09-28 12:20:10.195 28156 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:20:10 ctl02 nova-api[28156]: 2017-09-28 12:20:10.195 28156 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:20:10 ctl02 nova-api[28156]: 2017-09-28 12:20:10.195 28156 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:20:10 ctl02 nova-api[28156]: 2017-09-28 12:20:10.195 28156 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:20:10 ctl02 nova-api[28156]: 2017-09-28 12:20:10.195 28156 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:20:10 ctl02 nova-api[28156]: 2017-09-28 12:20:10.195 28156 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:20:10 ctl02 nova-api[28156]: 2017-09-28 12:20:10.195 28156 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:20:10 ctl02 nova-api[28156]: 2017-09-28 12:20:10.195 28156 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:20:10 ctl02 nova-api[28156]: 2017-09-28 12:20:10.195 28156 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:20:10 ctl02 nova-api[28156]: 2017-09-28 12:20:10.195 28156 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:20:10 ctl02 nova-api[28156]: 2017-09-28 12:20:10.195 28156 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:20:10 ctl02 nova-api[28156]: 2017-09-28 12:20:10.195 28156 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:20:10 ctl02 nova-api[28156]: 2017-09-28 12:20:10.195 28156 ERROR nova.wsgi     self.filename))
Sep 28 12:20:10 ctl02 nova-api[28156]: 2017-09-28 12:20:10.195 28156 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:20:10 ctl02 nova-api[28156]: 2017-09-28 12:20:10.195 28156 ERROR nova.wsgi
Sep 28 12:20:10 ctl02 nova-api[28156]: 2017-09-28 12:20:10.197 28156 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:20:10 ctl02 nova-api[28156]: 2017-09-28 12:20:10.326 28156 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:20:10 ctl02 glance-api[29183]: 2017-09-28 12:20:10.493 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:20:10] "OPTIONS / HTTP/1.0" 200 134 0.000635
Sep 28 12:20:10 ctl02 heat-api-cfn[13300]: 2017-09-28 12:20:10.519 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:20:10] "OPTIONS / HTTP/1.0" 200 134 0.000443
Sep 28 12:20:10 ctl02 nova-api[28156]: 2017-09-28 12:20:10.555 28156 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:20:10 ctl02 nova-api[28156]: 2017-09-28 12:20:10.558 28156 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:20:10 ctl02 nova-api[28156]: 2017-09-28 12:20:10.558 28156 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:20:10 ctl02 nova-api[28156]: 2017-09-28 12:20:10.558 28156 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:20:10 ctl02 nova-api[28156]: 2017-09-28 12:20:10.688 28156 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:20:10 ctl02 nova-api[28156]: 2017-09-28 12:20:10.689 28156 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:20:10 ctl02 nova-api[28156]: 2017-09-28 12:20:10.690 28156 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:20:10 ctl02 nova-api[28156]: 2017-09-28 12:20:10.690 28156 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:20:10 ctl02 nova-api[28156]: 2017-09-28 12:20:10.693 28156 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:20:10 ctl02 nova-api[28156]: 2017-09-28 12:20:10.693 28156 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:20:10 ctl02 nova-api[28156]: 2017-09-28 12:20:10.693 28156 ERROR nova Traceback (most recent call last):
Sep 28 12:20:10 ctl02 nova-api[28156]: 2017-09-28 12:20:10.693 28156 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:20:10 ctl02 nova-api[28156]: 2017-09-28 12:20:10.693 28156 ERROR nova     sys.exit(main())
Sep 28 12:20:10 ctl02 nova-api[28156]: 2017-09-28 12:20:10.693 28156 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:20:10 ctl02 nova-api[28156]: 2017-09-28 12:20:10.693 28156 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:20:10 ctl02 nova-api[28156]: 2017-09-28 12:20:10.693 28156 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:20:10 ctl02 nova-api[28156]: 2017-09-28 12:20:10.693 28156 ERROR nova     max_url_len=max_url_len)
Sep 28 12:20:10 ctl02 nova-api[28156]: 2017-09-28 12:20:10.693 28156 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:20:10 ctl02 nova-api[28156]: 2017-09-28 12:20:10.693 28156 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:20:10 ctl02 nova-api[28156]: 2017-09-28 12:20:10.693 28156 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:20:10 ctl02 nova-api[28156]: 2017-09-28 12:20:10.693 28156 ERROR nova     sock.listen(backlog)
Sep 28 12:20:10 ctl02 nova-api[28156]: 2017-09-28 12:20:10.693 28156 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:20:10 ctl02 nova-api[28156]: 2017-09-28 12:20:10.693 28156 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:20:10 ctl02 nova-api[28156]: 2017-09-28 12:20:10.693 28156 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:20:10 ctl02 nova-api[28156]: 2017-09-28 12:20:10.693 28156 ERROR nova
Sep 28 12:20:10 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:20:10 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:20:10 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:20:11 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:20:11 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:20:11 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:20:11 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:20:12 ctl02 glance-api[29183]: 2017-09-28 12:20:12.479 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:20:12] "OPTIONS / HTTP/1.0" 200 134 0.000544
Sep 28 12:20:12 ctl02 nova-api[28174]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:20:12 ctl02 nova-api[28174]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:20:13 ctl02 nova-api[28174]: 2017-09-28 12:20:13.013 28174 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:20:13 ctl02 nova-api[28174]: 2017-09-28 12:20:13.015 28174 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:20:13 ctl02 nova-api[28174]: 2017-09-28 12:20:13.015 28174 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:20:13 ctl02 nova-api[28174]: 2017-09-28 12:20:13.015 28174 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:20:13 ctl02 nova-api[28174]: 2017-09-28 12:20:13.015 28174 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:20:13 ctl02 nova-api[28174]: 2017-09-28 12:20:13.015 28174 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:20:13 ctl02 nova-api[28174]: 2017-09-28 12:20:13.015 28174 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:20:13 ctl02 nova-api[28174]: 2017-09-28 12:20:13.015 28174 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:20:13 ctl02 nova-api[28174]: 2017-09-28 12:20:13.015 28174 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:20:13 ctl02 nova-api[28174]: 2017-09-28 12:20:13.015 28174 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:20:13 ctl02 nova-api[28174]: 2017-09-28 12:20:13.015 28174 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:20:13 ctl02 nova-api[28174]: 2017-09-28 12:20:13.015 28174 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:20:13 ctl02 nova-api[28174]: 2017-09-28 12:20:13.015 28174 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:20:13 ctl02 nova-api[28174]: 2017-09-28 12:20:13.015 28174 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:20:13 ctl02 nova-api[28174]: 2017-09-28 12:20:13.015 28174 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:20:13 ctl02 nova-api[28174]: 2017-09-28 12:20:13.015 28174 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:20:13 ctl02 nova-api[28174]: 2017-09-28 12:20:13.015 28174 ERROR nova.wsgi     self.filename))
Sep 28 12:20:13 ctl02 nova-api[28174]: 2017-09-28 12:20:13.015 28174 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:20:13 ctl02 nova-api[28174]: 2017-09-28 12:20:13.015 28174 ERROR nova.wsgi
Sep 28 12:20:13 ctl02 nova-api[28174]: 2017-09-28 12:20:13.016 28174 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:20:13 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:20:13.088 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:20:13] "OPTIONS / HTTP/1.0" 200 134 0.000483
Sep 28 12:20:13 ctl02 nova-api[28174]: 2017-09-28 12:20:13.160 28174 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:20:13 ctl02 glance-api[29183]: 2017-09-28 12:20:13.167 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:20:13] "OPTIONS / HTTP/1.0" 200 134 0.000657
Sep 28 12:20:13 ctl02 nova-api[28174]: 2017-09-28 12:20:13.426 28174 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:20:13 ctl02 nova-api[28174]: 2017-09-28 12:20:13.429 28174 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:20:13 ctl02 nova-api[28174]: 2017-09-28 12:20:13.430 28174 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:20:13 ctl02 nova-api[28174]: 2017-09-28 12:20:13.430 28174 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:20:13 ctl02 nova-api[28174]: 2017-09-28 12:20:13.570 28174 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:20:13 ctl02 nova-api[28174]: 2017-09-28 12:20:13.572 28174 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:20:13 ctl02 nova-api[28174]: 2017-09-28 12:20:13.573 28174 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:20:13 ctl02 nova-api[28174]: 2017-09-28 12:20:13.573 28174 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:20:13 ctl02 nova-api[28174]: 2017-09-28 12:20:13.577 28174 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:20:13 ctl02 nova-api[28174]: 2017-09-28 12:20:13.577 28174 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:20:13 ctl02 nova-api[28174]: 2017-09-28 12:20:13.577 28174 ERROR nova Traceback (most recent call last):
Sep 28 12:20:13 ctl02 nova-api[28174]: 2017-09-28 12:20:13.577 28174 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:20:13 ctl02 nova-api[28174]: 2017-09-28 12:20:13.577 28174 ERROR nova     sys.exit(main())
Sep 28 12:20:13 ctl02 nova-api[28174]: 2017-09-28 12:20:13.577 28174 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:20:13 ctl02 nova-api[28174]: 2017-09-28 12:20:13.577 28174 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:20:13 ctl02 nova-api[28174]: 2017-09-28 12:20:13.577 28174 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:20:13 ctl02 nova-api[28174]: 2017-09-28 12:20:13.577 28174 ERROR nova     max_url_len=max_url_len)
Sep 28 12:20:13 ctl02 nova-api[28174]: 2017-09-28 12:20:13.577 28174 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:20:13 ctl02 nova-api[28174]: 2017-09-28 12:20:13.577 28174 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:20:13 ctl02 nova-api[28174]: 2017-09-28 12:20:13.577 28174 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:20:13 ctl02 nova-api[28174]: 2017-09-28 12:20:13.577 28174 ERROR nova     sock.listen(backlog)
Sep 28 12:20:13 ctl02 nova-api[28174]: 2017-09-28 12:20:13.577 28174 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:20:13 ctl02 nova-api[28174]: 2017-09-28 12:20:13.577 28174 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:20:13 ctl02 nova-api[28174]: 2017-09-28 12:20:13.577 28174 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:20:13 ctl02 nova-api[28174]: 2017-09-28 12:20:13.577 28174 ERROR nova
Sep 28 12:20:13 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:20:13 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:20:13 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:20:13 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:20:13 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:20:13 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:20:13 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:20:14 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8b960315)
Sep 28 12:20:15 ctl02 heat-api[13008]: 2017-09-28 12:20:15.205 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:20:15] "OPTIONS / HTTP/1.0" 200 134 0.000688
Sep 28 12:20:15 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:20:15.332 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:20:15] "OPTIONS / HTTP/1.0" 200 134 0.000488
Sep 28 12:20:15 ctl02 nova-api[28193]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:20:15 ctl02 nova-api[28193]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:20:15 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8b960315)
Sep 28 12:20:15 ctl02 nova-api[28193]: 2017-09-28 12:20:15.797 28193 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:20:15 ctl02 nova-api[28193]: 2017-09-28 12:20:15.799 28193 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:20:15 ctl02 nova-api[28193]: 2017-09-28 12:20:15.799 28193 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:20:15 ctl02 nova-api[28193]: 2017-09-28 12:20:15.799 28193 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:20:15 ctl02 nova-api[28193]: 2017-09-28 12:20:15.799 28193 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:20:15 ctl02 nova-api[28193]: 2017-09-28 12:20:15.799 28193 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:20:15 ctl02 nova-api[28193]: 2017-09-28 12:20:15.799 28193 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:20:15 ctl02 nova-api[28193]: 2017-09-28 12:20:15.799 28193 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:20:15 ctl02 nova-api[28193]: 2017-09-28 12:20:15.799 28193 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:20:15 ctl02 nova-api[28193]: 2017-09-28 12:20:15.799 28193 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:20:15 ctl02 nova-api[28193]: 2017-09-28 12:20:15.799 28193 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:20:15 ctl02 nova-api[28193]: 2017-09-28 12:20:15.799 28193 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:20:15 ctl02 nova-api[28193]: 2017-09-28 12:20:15.799 28193 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:20:15 ctl02 nova-api[28193]: 2017-09-28 12:20:15.799 28193 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:20:15 ctl02 nova-api[28193]: 2017-09-28 12:20:15.799 28193 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:20:15 ctl02 nova-api[28193]: 2017-09-28 12:20:15.799 28193 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:20:15 ctl02 nova-api[28193]: 2017-09-28 12:20:15.799 28193 ERROR nova.wsgi     self.filename))
Sep 28 12:20:15 ctl02 nova-api[28193]: 2017-09-28 12:20:15.799 28193 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:20:15 ctl02 nova-api[28193]: 2017-09-28 12:20:15.799 28193 ERROR nova.wsgi
Sep 28 12:20:15 ctl02 nova-api[28193]: 2017-09-28 12:20:15.800 28193 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:20:15 ctl02 nova-api[28193]: 2017-09-28 12:20:15.958 28193 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:20:16 ctl02 nova-api[28193]: 2017-09-28 12:20:16.219 28193 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:20:16 ctl02 nova-api[28193]: 2017-09-28 12:20:16.222 28193 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:20:16 ctl02 nova-api[28193]: 2017-09-28 12:20:16.222 28193 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:20:16 ctl02 nova-api[28193]: 2017-09-28 12:20:16.222 28193 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:20:16 ctl02 nova-api[28193]: 2017-09-28 12:20:16.358 28193 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:20:16 ctl02 nova-api[28193]: 2017-09-28 12:20:16.360 28193 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:20:16 ctl02 nova-api[28193]: 2017-09-28 12:20:16.360 28193 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:20:16 ctl02 nova-api[28193]: 2017-09-28 12:20:16.361 28193 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:20:16 ctl02 nova-api[28193]: 2017-09-28 12:20:16.364 28193 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:20:16 ctl02 nova-api[28193]: 2017-09-28 12:20:16.364 28193 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:20:16 ctl02 nova-api[28193]: 2017-09-28 12:20:16.364 28193 ERROR nova Traceback (most recent call last):
Sep 28 12:20:16 ctl02 nova-api[28193]: 2017-09-28 12:20:16.364 28193 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:20:16 ctl02 nova-api[28193]: 2017-09-28 12:20:16.364 28193 ERROR nova     sys.exit(main())
Sep 28 12:20:16 ctl02 nova-api[28193]: 2017-09-28 12:20:16.364 28193 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:20:16 ctl02 nova-api[28193]: 2017-09-28 12:20:16.364 28193 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:20:16 ctl02 nova-api[28193]: 2017-09-28 12:20:16.364 28193 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:20:16 ctl02 nova-api[28193]: 2017-09-28 12:20:16.364 28193 ERROR nova     max_url_len=max_url_len)
Sep 28 12:20:16 ctl02 nova-api[28193]: 2017-09-28 12:20:16.364 28193 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:20:16 ctl02 nova-api[28193]: 2017-09-28 12:20:16.364 28193 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:20:16 ctl02 nova-api[28193]: 2017-09-28 12:20:16.364 28193 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:20:16 ctl02 nova-api[28193]: 2017-09-28 12:20:16.364 28193 ERROR nova     sock.listen(backlog)
Sep 28 12:20:16 ctl02 nova-api[28193]: 2017-09-28 12:20:16.364 28193 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:20:16 ctl02 nova-api[28193]: 2017-09-28 12:20:16.364 28193 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:20:16 ctl02 nova-api[28193]: 2017-09-28 12:20:16.364 28193 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:20:16 ctl02 nova-api[28193]: 2017-09-28 12:20:16.364 28193 ERROR nova
Sep 28 12:20:16 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:20:16 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:20:16 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:20:16 ctl02 heat-api[13008]: 2017-09-28 12:20:16.639 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:20:16] "OPTIONS / HTTP/1.0" 200 134 0.000670
Sep 28 12:20:16 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8b960315)
Sep 28 12:20:16 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:20:16 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:20:16 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:20:16 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:20:17 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8b960315)
Sep 28 12:20:18 ctl02 nova-api[28210]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:20:18 ctl02 nova-api[28210]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:20:18 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:20:18.658 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:20:18] "OPTIONS / HTTP/1.0" 200 134 0.000402
Sep 28 12:20:18 ctl02 nova-api[28210]: 2017-09-28 12:20:18.697 28210 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:20:18 ctl02 nova-api[28210]: 2017-09-28 12:20:18.699 28210 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:20:18 ctl02 nova-api[28210]: 2017-09-28 12:20:18.699 28210 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:20:18 ctl02 nova-api[28210]: 2017-09-28 12:20:18.699 28210 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:20:18 ctl02 nova-api[28210]: 2017-09-28 12:20:18.699 28210 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:20:18 ctl02 nova-api[28210]: 2017-09-28 12:20:18.699 28210 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:20:18 ctl02 nova-api[28210]: 2017-09-28 12:20:18.699 28210 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:20:18 ctl02 nova-api[28210]: 2017-09-28 12:20:18.699 28210 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:20:18 ctl02 nova-api[28210]: 2017-09-28 12:20:18.699 28210 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:20:18 ctl02 nova-api[28210]: 2017-09-28 12:20:18.699 28210 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:20:18 ctl02 nova-api[28210]: 2017-09-28 12:20:18.699 28210 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:20:18 ctl02 nova-api[28210]: 2017-09-28 12:20:18.699 28210 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:20:18 ctl02 nova-api[28210]: 2017-09-28 12:20:18.699 28210 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:20:18 ctl02 nova-api[28210]: 2017-09-28 12:20:18.699 28210 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:20:18 ctl02 nova-api[28210]: 2017-09-28 12:20:18.699 28210 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:20:18 ctl02 nova-api[28210]: 2017-09-28 12:20:18.699 28210 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:20:18 ctl02 nova-api[28210]: 2017-09-28 12:20:18.699 28210 ERROR nova.wsgi     self.filename))
Sep 28 12:20:18 ctl02 nova-api[28210]: 2017-09-28 12:20:18.699 28210 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:20:18 ctl02 nova-api[28210]: 2017-09-28 12:20:18.699 28210 ERROR nova.wsgi
Sep 28 12:20:18 ctl02 nova-api[28210]: 2017-09-28 12:20:18.701 28210 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:20:18 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8b960315)
Sep 28 12:20:18 ctl02 nova-api[28210]: 2017-09-28 12:20:18.835 28210 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:20:19 ctl02 heat-api-cfn[13300]: 2017-09-28 12:20:19.039 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:20:19] "OPTIONS / HTTP/1.0" 200 134 0.000428
Sep 28 12:20:19 ctl02 nova-api[28210]: 2017-09-28 12:20:19.061 28210 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:20:19 ctl02 nova-api[28210]: 2017-09-28 12:20:19.063 28210 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:20:19 ctl02 nova-api[28210]: 2017-09-28 12:20:19.064 28210 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:20:19 ctl02 nova-api[28210]: 2017-09-28 12:20:19.064 28210 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:20:19 ctl02 nova-api[28210]: 2017-09-28 12:20:19.194 28210 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:20:19 ctl02 nova-api[28210]: 2017-09-28 12:20:19.197 28210 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:20:19 ctl02 nova-api[28210]: 2017-09-28 12:20:19.203 28210 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:20:19 ctl02 nova-api[28210]: 2017-09-28 12:20:19.203 28210 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:20:19 ctl02 nova-api[28210]: 2017-09-28 12:20:19.206 28210 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:20:19 ctl02 nova-api[28210]: 2017-09-28 12:20:19.207 28210 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:20:19 ctl02 nova-api[28210]: 2017-09-28 12:20:19.207 28210 ERROR nova Traceback (most recent call last):
Sep 28 12:20:19 ctl02 nova-api[28210]: 2017-09-28 12:20:19.207 28210 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:20:19 ctl02 nova-api[28210]: 2017-09-28 12:20:19.207 28210 ERROR nova     sys.exit(main())
Sep 28 12:20:19 ctl02 nova-api[28210]: 2017-09-28 12:20:19.207 28210 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:20:19 ctl02 nova-api[28210]: 2017-09-28 12:20:19.207 28210 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:20:19 ctl02 nova-api[28210]: 2017-09-28 12:20:19.207 28210 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:20:19 ctl02 nova-api[28210]: 2017-09-28 12:20:19.207 28210 ERROR nova     max_url_len=max_url_len)
Sep 28 12:20:19 ctl02 nova-api[28210]: 2017-09-28 12:20:19.207 28210 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:20:19 ctl02 nova-api[28210]: 2017-09-28 12:20:19.207 28210 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:20:19 ctl02 nova-api[28210]: 2017-09-28 12:20:19.207 28210 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:20:19 ctl02 nova-api[28210]: 2017-09-28 12:20:19.207 28210 ERROR nova     sock.listen(backlog)
Sep 28 12:20:19 ctl02 nova-api[28210]: 2017-09-28 12:20:19.207 28210 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:20:19 ctl02 nova-api[28210]: 2017-09-28 12:20:19.207 28210 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:20:19 ctl02 nova-api[28210]: 2017-09-28 12:20:19.207 28210 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:20:19 ctl02 nova-api[28210]: 2017-09-28 12:20:19.207 28210 ERROR nova
Sep 28 12:20:19 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:20:19 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:20:19 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:20:19 ctl02 heat-api[13008]: 2017-09-28 12:20:19.589 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:20:19] "OPTIONS / HTTP/1.0" 200 134 0.000704
Sep 28 12:20:19 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:20:19 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:20:19 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:20:19 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:20:19 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8b960315)
Sep 28 12:20:20 ctl02 heat-api-cfn[13300]: 2017-09-28 12:20:20.331 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:20:20] "OPTIONS / HTTP/1.0" 200 134 0.000455
Sep 28 12:20:20 ctl02 glance-api[29183]: 2017-09-28 12:20:20.361 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:20:20] "OPTIONS / HTTP/1.0" 200 134 0.000580
Sep 28 12:20:20 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8b960315)
Sep 28 12:20:20 ctl02 heat-api-cfn[13300]: 2017-09-28 12:20:20.913 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:20:20] "OPTIONS / HTTP/1.0" 200 134 0.000449
Sep 28 12:20:21 ctl02 nova-cert[4860]: 2017-09-28 12:20:21.080 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:20:21 ctl02 nova-api[28229]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:20:21 ctl02 nova-api[28229]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:20:21 ctl02 nova-api[28229]: 2017-09-28 12:20:21.509 28229 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:20:21 ctl02 nova-api[28229]: 2017-09-28 12:20:21.511 28229 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:20:21 ctl02 nova-api[28229]: 2017-09-28 12:20:21.511 28229 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:20:21 ctl02 nova-api[28229]: 2017-09-28 12:20:21.511 28229 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:20:21 ctl02 nova-api[28229]: 2017-09-28 12:20:21.511 28229 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:20:21 ctl02 nova-api[28229]: 2017-09-28 12:20:21.511 28229 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:20:21 ctl02 nova-api[28229]: 2017-09-28 12:20:21.511 28229 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:20:21 ctl02 nova-api[28229]: 2017-09-28 12:20:21.511 28229 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:20:21 ctl02 nova-api[28229]: 2017-09-28 12:20:21.511 28229 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:20:21 ctl02 nova-api[28229]: 2017-09-28 12:20:21.511 28229 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:20:21 ctl02 nova-api[28229]: 2017-09-28 12:20:21.511 28229 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:20:21 ctl02 nova-api[28229]: 2017-09-28 12:20:21.511 28229 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:20:21 ctl02 nova-api[28229]: 2017-09-28 12:20:21.511 28229 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:20:21 ctl02 nova-api[28229]: 2017-09-28 12:20:21.511 28229 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:20:21 ctl02 nova-api[28229]: 2017-09-28 12:20:21.511 28229 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:20:21 ctl02 nova-api[28229]: 2017-09-28 12:20:21.511 28229 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:20:21 ctl02 nova-api[28229]: 2017-09-28 12:20:21.511 28229 ERROR nova.wsgi     self.filename))
Sep 28 12:20:21 ctl02 nova-api[28229]: 2017-09-28 12:20:21.511 28229 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:20:21 ctl02 nova-api[28229]: 2017-09-28 12:20:21.511 28229 ERROR nova.wsgi
Sep 28 12:20:21 ctl02 nova-api[28229]: 2017-09-28 12:20:21.513 28229 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:20:21 ctl02 nova-api[28229]: 2017-09-28 12:20:21.647 28229 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:20:21 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8b960315)
Sep 28 12:20:21 ctl02 nova-api[28229]: 2017-09-28 12:20:21.897 28229 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:20:21 ctl02 nova-api[28229]: 2017-09-28 12:20:21.900 28229 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:20:21 ctl02 nova-api[28229]: 2017-09-28 12:20:21.900 28229 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:20:21 ctl02 nova-api[28229]: 2017-09-28 12:20:21.901 28229 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:20:22 ctl02 nova-api[28229]: 2017-09-28 12:20:22.034 28229 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:20:22 ctl02 nova-api[28229]: 2017-09-28 12:20:22.037 28229 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:20:22 ctl02 nova-api[28229]: 2017-09-28 12:20:22.037 28229 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:20:22 ctl02 nova-api[28229]: 2017-09-28 12:20:22.037 28229 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:20:22 ctl02 nova-api[28229]: 2017-09-28 12:20:22.041 28229 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:20:22 ctl02 nova-api[28229]: 2017-09-28 12:20:22.041 28229 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:20:22 ctl02 nova-api[28229]: 2017-09-28 12:20:22.041 28229 ERROR nova Traceback (most recent call last):
Sep 28 12:20:22 ctl02 nova-api[28229]: 2017-09-28 12:20:22.041 28229 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:20:22 ctl02 nova-api[28229]: 2017-09-28 12:20:22.041 28229 ERROR nova     sys.exit(main())
Sep 28 12:20:22 ctl02 nova-api[28229]: 2017-09-28 12:20:22.041 28229 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:20:22 ctl02 nova-api[28229]: 2017-09-28 12:20:22.041 28229 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:20:22 ctl02 nova-api[28229]: 2017-09-28 12:20:22.041 28229 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:20:22 ctl02 nova-api[28229]: 2017-09-28 12:20:22.041 28229 ERROR nova     max_url_len=max_url_len)
Sep 28 12:20:22 ctl02 nova-api[28229]: 2017-09-28 12:20:22.041 28229 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:20:22 ctl02 nova-api[28229]: 2017-09-28 12:20:22.041 28229 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:20:22 ctl02 nova-api[28229]: 2017-09-28 12:20:22.041 28229 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:20:22 ctl02 nova-api[28229]: 2017-09-28 12:20:22.041 28229 ERROR nova     sock.listen(backlog)
Sep 28 12:20:22 ctl02 nova-api[28229]: 2017-09-28 12:20:22.041 28229 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:20:22 ctl02 nova-api[28229]: 2017-09-28 12:20:22.041 28229 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:20:22 ctl02 nova-api[28229]: 2017-09-28 12:20:22.041 28229 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:20:22 ctl02 nova-api[28229]: 2017-09-28 12:20:22.041 28229 ERROR nova
Sep 28 12:20:22 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:20:22 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:20:22 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:20:22 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:20:22 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:20:22 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:20:22 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:20:22 ctl02 glance-api[29183]: 2017-09-28 12:20:22.551 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:20:22] "OPTIONS / HTTP/1.0" 200 134 0.000554
Sep 28 12:20:22 ctl02 nova-conductor[5056]: 2017-09-28 12:20:22.573 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:20:22 ctl02 nova-conductor[5056]: 2017-09-28 12:20:22.589 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:20:22 ctl02 nova-conductor[5056]: 2017-09-28 12:20:22.597 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:20:22 ctl02 nova-conductor[5056]: 2017-09-28 12:20:22.599 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:20:22 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8b960315)
Sep 28 12:20:23 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:20:23.043 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:20:23] "OPTIONS / HTTP/1.0" 200 134 0.000401
Sep 28 12:20:23 ctl02 glance-api[29183]: 2017-09-28 12:20:23.354 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:20:23] "OPTIONS / HTTP/1.0" 200 134 0.000564
Sep 28 12:20:23 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8b960315)
Sep 28 12:20:24 ctl02 nova-api[28247]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:20:24 ctl02 nova-api[28247]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:20:24 ctl02 nova-api[28247]: 2017-09-28 12:20:24.210 28247 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:20:24 ctl02 nova-api[28247]: 2017-09-28 12:20:24.212 28247 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:20:24 ctl02 nova-api[28247]: 2017-09-28 12:20:24.212 28247 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:20:24 ctl02 nova-api[28247]: 2017-09-28 12:20:24.212 28247 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:20:24 ctl02 nova-api[28247]: 2017-09-28 12:20:24.212 28247 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:20:24 ctl02 nova-api[28247]: 2017-09-28 12:20:24.212 28247 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:20:24 ctl02 nova-api[28247]: 2017-09-28 12:20:24.212 28247 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:20:24 ctl02 nova-api[28247]: 2017-09-28 12:20:24.212 28247 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:20:24 ctl02 nova-api[28247]: 2017-09-28 12:20:24.212 28247 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:20:24 ctl02 nova-api[28247]: 2017-09-28 12:20:24.212 28247 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:20:24 ctl02 nova-api[28247]: 2017-09-28 12:20:24.212 28247 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:20:24 ctl02 nova-api[28247]: 2017-09-28 12:20:24.212 28247 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:20:24 ctl02 nova-api[28247]: 2017-09-28 12:20:24.212 28247 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:20:24 ctl02 nova-api[28247]: 2017-09-28 12:20:24.212 28247 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:20:24 ctl02 nova-api[28247]: 2017-09-28 12:20:24.212 28247 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:20:24 ctl02 nova-api[28247]: 2017-09-28 12:20:24.212 28247 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:20:24 ctl02 nova-api[28247]: 2017-09-28 12:20:24.212 28247 ERROR nova.wsgi     self.filename))
Sep 28 12:20:24 ctl02 nova-api[28247]: 2017-09-28 12:20:24.212 28247 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:20:24 ctl02 nova-api[28247]: 2017-09-28 12:20:24.212 28247 ERROR nova.wsgi
Sep 28 12:20:24 ctl02 nova-api[28247]: 2017-09-28 12:20:24.218 28247 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:20:24 ctl02 nova-api[28247]: 2017-09-28 12:20:24.363 28247 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:20:24 ctl02 nova-api[28247]: 2017-09-28 12:20:24.617 28247 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:20:24 ctl02 nova-api[28247]: 2017-09-28 12:20:24.619 28247 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:20:24 ctl02 nova-api[28247]: 2017-09-28 12:20:24.619 28247 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:20:24 ctl02 nova-api[28247]: 2017-09-28 12:20:24.620 28247 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:20:24 ctl02 nova-api[28247]: 2017-09-28 12:20:24.755 28247 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:20:24 ctl02 nova-api[28247]: 2017-09-28 12:20:24.757 28247 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:20:24 ctl02 nova-api[28247]: 2017-09-28 12:20:24.757 28247 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:20:24 ctl02 nova-api[28247]: 2017-09-28 12:20:24.757 28247 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:20:24 ctl02 nova-api[28247]: 2017-09-28 12:20:24.761 28247 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:20:24 ctl02 nova-api[28247]: 2017-09-28 12:20:24.761 28247 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:20:24 ctl02 nova-api[28247]: 2017-09-28 12:20:24.761 28247 ERROR nova Traceback (most recent call last):
Sep 28 12:20:24 ctl02 nova-api[28247]: 2017-09-28 12:20:24.761 28247 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:20:24 ctl02 nova-api[28247]: 2017-09-28 12:20:24.761 28247 ERROR nova     sys.exit(main())
Sep 28 12:20:24 ctl02 nova-api[28247]: 2017-09-28 12:20:24.761 28247 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:20:24 ctl02 nova-api[28247]: 2017-09-28 12:20:24.761 28247 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:20:24 ctl02 nova-api[28247]: 2017-09-28 12:20:24.761 28247 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:20:24 ctl02 nova-api[28247]: 2017-09-28 12:20:24.761 28247 ERROR nova     max_url_len=max_url_len)
Sep 28 12:20:24 ctl02 nova-api[28247]: 2017-09-28 12:20:24.761 28247 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:20:24 ctl02 nova-api[28247]: 2017-09-28 12:20:24.761 28247 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:20:24 ctl02 nova-api[28247]: 2017-09-28 12:20:24.761 28247 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:20:24 ctl02 nova-api[28247]: 2017-09-28 12:20:24.761 28247 ERROR nova     sock.listen(backlog)
Sep 28 12:20:24 ctl02 nova-api[28247]: 2017-09-28 12:20:24.761 28247 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:20:24 ctl02 nova-api[28247]: 2017-09-28 12:20:24.761 28247 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:20:24 ctl02 nova-api[28247]: 2017-09-28 12:20:24.761 28247 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:20:24 ctl02 nova-api[28247]: 2017-09-28 12:20:24.761 28247 ERROR nova
Sep 28 12:20:24 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8b960315)
Sep 28 12:20:24 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:20:24 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:20:24 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:20:25 ctl02 heat-api[13008]: 2017-09-28 12:20:25.071 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:20:25] "OPTIONS / HTTP/1.0" 200 134 0.000694
Sep 28 12:20:25 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:20:25 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:20:25 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:20:25 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:20:25 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:20:25.327 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:20:25] "OPTIONS / HTTP/1.0" 200 134 0.000463
Sep 28 12:20:25 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:20:25 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:20:26 ctl02 nova-api[28265]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:20:26 ctl02 nova-api[28265]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:20:26 ctl02 heat-api[13008]: 2017-09-28 12:20:26.968 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:20:26] "OPTIONS / HTTP/1.0" 200 134 0.000743
Sep 28 12:20:27 ctl02 nova-api[28265]: 2017-09-28 12:20:27.055 28265 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:20:27 ctl02 nova-api[28265]: 2017-09-28 12:20:27.057 28265 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:20:27 ctl02 nova-api[28265]: 2017-09-28 12:20:27.057 28265 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:20:27 ctl02 nova-api[28265]: 2017-09-28 12:20:27.057 28265 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:20:27 ctl02 nova-api[28265]: 2017-09-28 12:20:27.057 28265 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:20:27 ctl02 nova-api[28265]: 2017-09-28 12:20:27.057 28265 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:20:27 ctl02 nova-api[28265]: 2017-09-28 12:20:27.057 28265 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:20:27 ctl02 nova-api[28265]: 2017-09-28 12:20:27.057 28265 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:20:27 ctl02 nova-api[28265]: 2017-09-28 12:20:27.057 28265 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:20:27 ctl02 nova-api[28265]: 2017-09-28 12:20:27.057 28265 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:20:27 ctl02 nova-api[28265]: 2017-09-28 12:20:27.057 28265 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:20:27 ctl02 nova-api[28265]: 2017-09-28 12:20:27.057 28265 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:20:27 ctl02 nova-api[28265]: 2017-09-28 12:20:27.057 28265 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:20:27 ctl02 nova-api[28265]: 2017-09-28 12:20:27.057 28265 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:20:27 ctl02 nova-api[28265]: 2017-09-28 12:20:27.057 28265 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:20:27 ctl02 nova-api[28265]: 2017-09-28 12:20:27.057 28265 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:20:27 ctl02 nova-api[28265]: 2017-09-28 12:20:27.057 28265 ERROR nova.wsgi     self.filename))
Sep 28 12:20:27 ctl02 nova-api[28265]: 2017-09-28 12:20:27.057 28265 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:20:27 ctl02 nova-api[28265]: 2017-09-28 12:20:27.057 28265 ERROR nova.wsgi
Sep 28 12:20:27 ctl02 nova-api[28265]: 2017-09-28 12:20:27.058 28265 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:20:27 ctl02 nova-api[28265]: 2017-09-28 12:20:27.194 28265 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:20:27 ctl02 nova-api[28265]: 2017-09-28 12:20:27.446 28265 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:20:27 ctl02 nova-api[28265]: 2017-09-28 12:20:27.448 28265 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:20:27 ctl02 nova-api[28265]: 2017-09-28 12:20:27.449 28265 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:20:27 ctl02 nova-api[28265]: 2017-09-28 12:20:27.449 28265 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:20:27 ctl02 nova-api[28265]: 2017-09-28 12:20:27.584 28265 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:20:27 ctl02 nova-api[28265]: 2017-09-28 12:20:27.586 28265 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:20:27 ctl02 nova-api[28265]: 2017-09-28 12:20:27.586 28265 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:20:27 ctl02 nova-api[28265]: 2017-09-28 12:20:27.586 28265 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:20:27 ctl02 nova-api[28265]: 2017-09-28 12:20:27.590 28265 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:20:27 ctl02 nova-api[28265]: 2017-09-28 12:20:27.590 28265 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:20:27 ctl02 nova-api[28265]: 2017-09-28 12:20:27.590 28265 ERROR nova Traceback (most recent call last):
Sep 28 12:20:27 ctl02 nova-api[28265]: 2017-09-28 12:20:27.590 28265 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:20:27 ctl02 nova-api[28265]: 2017-09-28 12:20:27.590 28265 ERROR nova     sys.exit(main())
Sep 28 12:20:27 ctl02 nova-api[28265]: 2017-09-28 12:20:27.590 28265 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:20:27 ctl02 nova-api[28265]: 2017-09-28 12:20:27.590 28265 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:20:27 ctl02 nova-api[28265]: 2017-09-28 12:20:27.590 28265 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:20:27 ctl02 nova-api[28265]: 2017-09-28 12:20:27.590 28265 ERROR nova     max_url_len=max_url_len)
Sep 28 12:20:27 ctl02 nova-api[28265]: 2017-09-28 12:20:27.590 28265 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:20:27 ctl02 nova-api[28265]: 2017-09-28 12:20:27.590 28265 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:20:27 ctl02 nova-api[28265]: 2017-09-28 12:20:27.590 28265 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:20:27 ctl02 nova-api[28265]: 2017-09-28 12:20:27.590 28265 ERROR nova     sock.listen(backlog)
Sep 28 12:20:27 ctl02 nova-api[28265]: 2017-09-28 12:20:27.590 28265 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:20:27 ctl02 nova-api[28265]: 2017-09-28 12:20:27.590 28265 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:20:27 ctl02 nova-api[28265]: 2017-09-28 12:20:27.590 28265 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:20:27 ctl02 nova-api[28265]: 2017-09-28 12:20:27.590 28265 ERROR nova
Sep 28 12:20:27 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:20:27 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:20:27 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:20:27 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:20:27 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:20:27 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:20:27 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:20:29 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:20:29.042 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:20:29] "OPTIONS / HTTP/1.0" 200 134 0.000464
Sep 28 12:20:29 ctl02 heat-api-cfn[13300]: 2017-09-28 12:20:29.405 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:20:29] "OPTIONS / HTTP/1.0" 200 134 0.000522
Sep 28 12:20:29 ctl02 nova-api[28288]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:20:29 ctl02 nova-api[28288]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:20:29 ctl02 nova-api[28288]: 2017-09-28 12:20:29.736 28288 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:20:29 ctl02 nova-api[28288]: 2017-09-28 12:20:29.738 28288 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:20:29 ctl02 nova-api[28288]: 2017-09-28 12:20:29.738 28288 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:20:29 ctl02 nova-api[28288]: 2017-09-28 12:20:29.738 28288 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:20:29 ctl02 nova-api[28288]: 2017-09-28 12:20:29.738 28288 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:20:29 ctl02 nova-api[28288]: 2017-09-28 12:20:29.738 28288 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:20:29 ctl02 nova-api[28288]: 2017-09-28 12:20:29.738 28288 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:20:29 ctl02 nova-api[28288]: 2017-09-28 12:20:29.738 28288 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:20:29 ctl02 nova-api[28288]: 2017-09-28 12:20:29.738 28288 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:20:29 ctl02 nova-api[28288]: 2017-09-28 12:20:29.738 28288 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:20:29 ctl02 nova-api[28288]: 2017-09-28 12:20:29.738 28288 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:20:29 ctl02 nova-api[28288]: 2017-09-28 12:20:29.738 28288 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:20:29 ctl02 nova-api[28288]: 2017-09-28 12:20:29.738 28288 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:20:29 ctl02 nova-api[28288]: 2017-09-28 12:20:29.738 28288 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:20:29 ctl02 nova-api[28288]: 2017-09-28 12:20:29.738 28288 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:20:29 ctl02 nova-api[28288]: 2017-09-28 12:20:29.738 28288 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:20:29 ctl02 nova-api[28288]: 2017-09-28 12:20:29.738 28288 ERROR nova.wsgi     self.filename))
Sep 28 12:20:29 ctl02 nova-api[28288]: 2017-09-28 12:20:29.738 28288 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:20:29 ctl02 nova-api[28288]: 2017-09-28 12:20:29.738 28288 ERROR nova.wsgi
Sep 28 12:20:29 ctl02 nova-api[28288]: 2017-09-28 12:20:29.742 28288 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:20:29 ctl02 nova-api[28288]: 2017-09-28 12:20:29.877 28288 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:20:29 ctl02 heat-api[13008]: 2017-09-28 12:20:29.954 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:20:29] "OPTIONS / HTTP/1.0" 200 134 0.000626
Sep 28 12:20:30 ctl02 heat-api-cfn[13300]: 2017-09-28 12:20:30.091 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:20:30] "OPTIONS / HTTP/1.0" 200 134 0.000534
Sep 28 12:20:30 ctl02 nova-api[28288]: 2017-09-28 12:20:30.134 28288 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:20:30 ctl02 nova-api[28288]: 2017-09-28 12:20:30.136 28288 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:20:30 ctl02 nova-api[28288]: 2017-09-28 12:20:30.137 28288 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:20:30 ctl02 nova-api[28288]: 2017-09-28 12:20:30.137 28288 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:20:30 ctl02 glance-api[29183]: 2017-09-28 12:20:30.165 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:20:30] "OPTIONS / HTTP/1.0" 200 134 0.000616
Sep 28 12:20:30 ctl02 nova-api[28288]: 2017-09-28 12:20:30.273 28288 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:20:30 ctl02 nova-api[28288]: 2017-09-28 12:20:30.275 28288 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:20:30 ctl02 nova-api[28288]: 2017-09-28 12:20:30.275 28288 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:20:30 ctl02 nova-api[28288]: 2017-09-28 12:20:30.276 28288 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:20:30 ctl02 nova-api[28288]: 2017-09-28 12:20:30.279 28288 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:20:30 ctl02 nova-api[28288]: 2017-09-28 12:20:30.280 28288 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:20:30 ctl02 nova-api[28288]: 2017-09-28 12:20:30.280 28288 ERROR nova Traceback (most recent call last):
Sep 28 12:20:30 ctl02 nova-api[28288]: 2017-09-28 12:20:30.280 28288 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:20:30 ctl02 nova-api[28288]: 2017-09-28 12:20:30.280 28288 ERROR nova     sys.exit(main())
Sep 28 12:20:30 ctl02 nova-api[28288]: 2017-09-28 12:20:30.280 28288 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:20:30 ctl02 nova-api[28288]: 2017-09-28 12:20:30.280 28288 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:20:30 ctl02 nova-api[28288]: 2017-09-28 12:20:30.280 28288 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:20:30 ctl02 nova-api[28288]: 2017-09-28 12:20:30.280 28288 ERROR nova     max_url_len=max_url_len)
Sep 28 12:20:30 ctl02 nova-api[28288]: 2017-09-28 12:20:30.280 28288 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:20:30 ctl02 nova-api[28288]: 2017-09-28 12:20:30.280 28288 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:20:30 ctl02 nova-api[28288]: 2017-09-28 12:20:30.280 28288 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:20:30 ctl02 nova-api[28288]: 2017-09-28 12:20:30.280 28288 ERROR nova     sock.listen(backlog)
Sep 28 12:20:30 ctl02 nova-api[28288]: 2017-09-28 12:20:30.280 28288 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:20:30 ctl02 nova-api[28288]: 2017-09-28 12:20:30.280 28288 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:20:30 ctl02 nova-api[28288]: 2017-09-28 12:20:30.280 28288 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:20:30 ctl02 nova-api[28288]: 2017-09-28 12:20:30.280 28288 ERROR nova
Sep 28 12:20:30 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:20:30 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:20:30 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:20:30 ctl02 heat-api-cfn[13300]: 2017-09-28 12:20:30.623 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:20:30] "OPTIONS / HTTP/1.0" 200 134 0.000557
Sep 28 12:20:30 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:20:30 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:20:30 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:20:30 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:20:30 ctl02 nova-consoleauth[5433]: 2017-09-28 12:20:30.964 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:20:32 ctl02 nova-api[28306]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:20:32 ctl02 nova-api[28306]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:20:32 ctl02 glance-api[29183]: 2017-09-28 12:20:32.368 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:20:32] "OPTIONS / HTTP/1.0" 200 134 0.000750
Sep 28 12:20:32 ctl02 nova-api[28306]: 2017-09-28 12:20:32.501 28306 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:20:32 ctl02 nova-api[28306]: 2017-09-28 12:20:32.503 28306 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:20:32 ctl02 nova-api[28306]: 2017-09-28 12:20:32.503 28306 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:20:32 ctl02 nova-api[28306]: 2017-09-28 12:20:32.503 28306 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:20:32 ctl02 nova-api[28306]: 2017-09-28 12:20:32.503 28306 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:20:32 ctl02 nova-api[28306]: 2017-09-28 12:20:32.503 28306 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:20:32 ctl02 nova-api[28306]: 2017-09-28 12:20:32.503 28306 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:20:32 ctl02 nova-api[28306]: 2017-09-28 12:20:32.503 28306 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:20:32 ctl02 nova-api[28306]: 2017-09-28 12:20:32.503 28306 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:20:32 ctl02 nova-api[28306]: 2017-09-28 12:20:32.503 28306 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:20:32 ctl02 nova-api[28306]: 2017-09-28 12:20:32.503 28306 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:20:32 ctl02 nova-api[28306]: 2017-09-28 12:20:32.503 28306 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:20:32 ctl02 nova-api[28306]: 2017-09-28 12:20:32.503 28306 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:20:32 ctl02 nova-api[28306]: 2017-09-28 12:20:32.503 28306 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:20:32 ctl02 nova-api[28306]: 2017-09-28 12:20:32.503 28306 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:20:32 ctl02 nova-api[28306]: 2017-09-28 12:20:32.503 28306 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:20:32 ctl02 nova-api[28306]: 2017-09-28 12:20:32.503 28306 ERROR nova.wsgi     self.filename))
Sep 28 12:20:32 ctl02 nova-api[28306]: 2017-09-28 12:20:32.503 28306 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:20:32 ctl02 nova-api[28306]: 2017-09-28 12:20:32.503 28306 ERROR nova.wsgi
Sep 28 12:20:32 ctl02 nova-api[28306]: 2017-09-28 12:20:32.505 28306 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:20:32 ctl02 nova-api[28306]: 2017-09-28 12:20:32.641 28306 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:20:32 ctl02 nova-api[28306]: 2017-09-28 12:20:32.895 28306 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:20:32 ctl02 nova-api[28306]: 2017-09-28 12:20:32.898 28306 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:20:32 ctl02 nova-api[28306]: 2017-09-28 12:20:32.898 28306 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:20:32 ctl02 nova-api[28306]: 2017-09-28 12:20:32.899 28306 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:20:33 ctl02 nova-api[28306]: 2017-09-28 12:20:33.034 28306 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:20:33 ctl02 nova-api[28306]: 2017-09-28 12:20:33.037 28306 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:20:33 ctl02 nova-api[28306]: 2017-09-28 12:20:33.037 28306 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:20:33 ctl02 nova-api[28306]: 2017-09-28 12:20:33.037 28306 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:20:33 ctl02 nova-api[28306]: 2017-09-28 12:20:33.041 28306 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:20:33 ctl02 nova-api[28306]: 2017-09-28 12:20:33.041 28306 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:20:33 ctl02 nova-api[28306]: 2017-09-28 12:20:33.041 28306 ERROR nova Traceback (most recent call last):
Sep 28 12:20:33 ctl02 nova-api[28306]: 2017-09-28 12:20:33.041 28306 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:20:33 ctl02 nova-api[28306]: 2017-09-28 12:20:33.041 28306 ERROR nova     sys.exit(main())
Sep 28 12:20:33 ctl02 nova-api[28306]: 2017-09-28 12:20:33.041 28306 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:20:33 ctl02 nova-api[28306]: 2017-09-28 12:20:33.041 28306 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:20:33 ctl02 nova-api[28306]: 2017-09-28 12:20:33.041 28306 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:20:33 ctl02 nova-api[28306]: 2017-09-28 12:20:33.041 28306 ERROR nova     max_url_len=max_url_len)
Sep 28 12:20:33 ctl02 nova-api[28306]: 2017-09-28 12:20:33.041 28306 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:20:33 ctl02 nova-api[28306]: 2017-09-28 12:20:33.041 28306 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:20:33 ctl02 nova-api[28306]: 2017-09-28 12:20:33.041 28306 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:20:33 ctl02 nova-api[28306]: 2017-09-28 12:20:33.041 28306 ERROR nova     sock.listen(backlog)
Sep 28 12:20:33 ctl02 nova-api[28306]: 2017-09-28 12:20:33.041 28306 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:20:33 ctl02 nova-api[28306]: 2017-09-28 12:20:33.041 28306 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:20:33 ctl02 nova-api[28306]: 2017-09-28 12:20:33.041 28306 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:20:33 ctl02 nova-api[28306]: 2017-09-28 12:20:33.041 28306 ERROR nova
Sep 28 12:20:33 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:20:33.191 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:20:33] "OPTIONS / HTTP/1.0" 200 134 0.000458
Sep 28 12:20:33 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:20:33 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:20:33 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:20:33 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:20:33 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:20:33 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:20:33 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:20:33 ctl02 heat-engine[12803]: 2017-09-28 12:20:33.687 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:20:33 ctl02 heat-engine[12803]: 2017-09-28 12:20:33.690 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:20:33 ctl02 heat-engine[12803]: 2017-09-28 12:20:33.694 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:20:33 ctl02 heat-engine[12803]: 2017-09-28 12:20:33.696 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:20:33 ctl02 glance-api[29183]: 2017-09-28 12:20:33.762 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:20:33] "OPTIONS / HTTP/1.0" 200 134 0.000761
Sep 28 12:20:33 ctl02 nova-scheduler[5620]: 2017-09-28 12:20:33.984 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:20:35 ctl02 nova-api[28324]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:20:35 ctl02 nova-api[28324]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:20:35 ctl02 nova-api[28324]: 2017-09-28 12:20:35.258 28324 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:20:35 ctl02 nova-api[28324]: 2017-09-28 12:20:35.260 28324 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:20:35 ctl02 nova-api[28324]: 2017-09-28 12:20:35.260 28324 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:20:35 ctl02 nova-api[28324]: 2017-09-28 12:20:35.260 28324 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:20:35 ctl02 nova-api[28324]: 2017-09-28 12:20:35.260 28324 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:20:35 ctl02 nova-api[28324]: 2017-09-28 12:20:35.260 28324 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:20:35 ctl02 nova-api[28324]: 2017-09-28 12:20:35.260 28324 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:20:35 ctl02 nova-api[28324]: 2017-09-28 12:20:35.260 28324 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:20:35 ctl02 nova-api[28324]: 2017-09-28 12:20:35.260 28324 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:20:35 ctl02 nova-api[28324]: 2017-09-28 12:20:35.260 28324 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:20:35 ctl02 nova-api[28324]: 2017-09-28 12:20:35.260 28324 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:20:35 ctl02 nova-api[28324]: 2017-09-28 12:20:35.260 28324 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:20:35 ctl02 nova-api[28324]: 2017-09-28 12:20:35.260 28324 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:20:35 ctl02 nova-api[28324]: 2017-09-28 12:20:35.260 28324 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:20:35 ctl02 nova-api[28324]: 2017-09-28 12:20:35.260 28324 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:20:35 ctl02 nova-api[28324]: 2017-09-28 12:20:35.260 28324 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:20:35 ctl02 nova-api[28324]: 2017-09-28 12:20:35.260 28324 ERROR nova.wsgi     self.filename))
Sep 28 12:20:35 ctl02 nova-api[28324]: 2017-09-28 12:20:35.260 28324 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:20:35 ctl02 nova-api[28324]: 2017-09-28 12:20:35.260 28324 ERROR nova.wsgi
Sep 28 12:20:35 ctl02 nova-api[28324]: 2017-09-28 12:20:35.261 28324 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:20:35 ctl02 heat-api[13008]: 2017-09-28 12:20:35.311 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:20:35] "OPTIONS / HTTP/1.0" 200 134 0.000601
Sep 28 12:20:35 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:20:35.373 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:20:35] "OPTIONS / HTTP/1.0" 200 134 0.000509
Sep 28 12:20:35 ctl02 nova-api[28324]: 2017-09-28 12:20:35.401 28324 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:20:35 ctl02 nova-api[28324]: 2017-09-28 12:20:35.657 28324 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:20:35 ctl02 nova-api[28324]: 2017-09-28 12:20:35.660 28324 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:20:35 ctl02 nova-api[28324]: 2017-09-28 12:20:35.660 28324 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:20:35 ctl02 nova-api[28324]: 2017-09-28 12:20:35.660 28324 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:20:35 ctl02 nova-api[28324]: 2017-09-28 12:20:35.794 28324 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:20:35 ctl02 nova-api[28324]: 2017-09-28 12:20:35.796 28324 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:20:35 ctl02 nova-api[28324]: 2017-09-28 12:20:35.796 28324 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:20:35 ctl02 nova-api[28324]: 2017-09-28 12:20:35.796 28324 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:20:35 ctl02 nova-api[28324]: 2017-09-28 12:20:35.799 28324 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:20:35 ctl02 nova-api[28324]: 2017-09-28 12:20:35.800 28324 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:20:35 ctl02 nova-api[28324]: 2017-09-28 12:20:35.800 28324 ERROR nova Traceback (most recent call last):
Sep 28 12:20:35 ctl02 nova-api[28324]: 2017-09-28 12:20:35.800 28324 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:20:35 ctl02 nova-api[28324]: 2017-09-28 12:20:35.800 28324 ERROR nova     sys.exit(main())
Sep 28 12:20:35 ctl02 nova-api[28324]: 2017-09-28 12:20:35.800 28324 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:20:35 ctl02 nova-api[28324]: 2017-09-28 12:20:35.800 28324 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:20:35 ctl02 nova-api[28324]: 2017-09-28 12:20:35.800 28324 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:20:35 ctl02 nova-api[28324]: 2017-09-28 12:20:35.800 28324 ERROR nova     max_url_len=max_url_len)
Sep 28 12:20:35 ctl02 nova-api[28324]: 2017-09-28 12:20:35.800 28324 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:20:35 ctl02 nova-api[28324]: 2017-09-28 12:20:35.800 28324 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:20:35 ctl02 nova-api[28324]: 2017-09-28 12:20:35.800 28324 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:20:35 ctl02 nova-api[28324]: 2017-09-28 12:20:35.800 28324 ERROR nova     sock.listen(backlog)
Sep 28 12:20:35 ctl02 nova-api[28324]: 2017-09-28 12:20:35.800 28324 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:20:35 ctl02 nova-api[28324]: 2017-09-28 12:20:35.800 28324 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:20:35 ctl02 nova-api[28324]: 2017-09-28 12:20:35.800 28324 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:20:35 ctl02 nova-api[28324]: 2017-09-28 12:20:35.800 28324 ERROR nova
Sep 28 12:20:35 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:20:35 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:20:35 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:20:36 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:20:36 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:20:36 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:20:36 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:20:36 ctl02 heat-api[13008]: 2017-09-28 12:20:36.687 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:20:36] "OPTIONS / HTTP/1.0" 200 134 0.000564
Sep 28 12:20:37 ctl02 nova-api[28340]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:20:37 ctl02 nova-api[28340]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:20:37 ctl02 nova-api[28340]: 2017-09-28 12:20:37.949 28340 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:20:37 ctl02 nova-api[28340]: 2017-09-28 12:20:37.951 28340 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:20:37 ctl02 nova-api[28340]: 2017-09-28 12:20:37.951 28340 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:20:37 ctl02 nova-api[28340]: 2017-09-28 12:20:37.951 28340 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:20:37 ctl02 nova-api[28340]: 2017-09-28 12:20:37.951 28340 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:20:37 ctl02 nova-api[28340]: 2017-09-28 12:20:37.951 28340 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:20:37 ctl02 nova-api[28340]: 2017-09-28 12:20:37.951 28340 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:20:37 ctl02 nova-api[28340]: 2017-09-28 12:20:37.951 28340 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:20:37 ctl02 nova-api[28340]: 2017-09-28 12:20:37.951 28340 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:20:37 ctl02 nova-api[28340]: 2017-09-28 12:20:37.951 28340 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:20:37 ctl02 nova-api[28340]: 2017-09-28 12:20:37.951 28340 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:20:37 ctl02 nova-api[28340]: 2017-09-28 12:20:37.951 28340 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:20:37 ctl02 nova-api[28340]: 2017-09-28 12:20:37.951 28340 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:20:37 ctl02 nova-api[28340]: 2017-09-28 12:20:37.951 28340 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:20:37 ctl02 nova-api[28340]: 2017-09-28 12:20:37.951 28340 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:20:37 ctl02 nova-api[28340]: 2017-09-28 12:20:37.951 28340 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:20:37 ctl02 nova-api[28340]: 2017-09-28 12:20:37.951 28340 ERROR nova.wsgi     self.filename))
Sep 28 12:20:37 ctl02 nova-api[28340]: 2017-09-28 12:20:37.951 28340 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:20:37 ctl02 nova-api[28340]: 2017-09-28 12:20:37.951 28340 ERROR nova.wsgi
Sep 28 12:20:37 ctl02 nova-api[28340]: 2017-09-28 12:20:37.952 28340 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:20:38 ctl02 nova-api[28340]: 2017-09-28 12:20:38.084 28340 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:20:38 ctl02 nova-api[28340]: 2017-09-28 12:20:38.314 28340 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:20:38 ctl02 nova-api[28340]: 2017-09-28 12:20:38.316 28340 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:20:38 ctl02 nova-api[28340]: 2017-09-28 12:20:38.316 28340 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:20:38 ctl02 nova-api[28340]: 2017-09-28 12:20:38.317 28340 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:20:38 ctl02 nova-api[28340]: 2017-09-28 12:20:38.448 28340 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:20:38 ctl02 nova-api[28340]: 2017-09-28 12:20:38.450 28340 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:20:38 ctl02 nova-api[28340]: 2017-09-28 12:20:38.451 28340 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:20:38 ctl02 nova-api[28340]: 2017-09-28 12:20:38.451 28340 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:20:38 ctl02 nova-api[28340]: 2017-09-28 12:20:38.454 28340 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:20:38 ctl02 nova-api[28340]: 2017-09-28 12:20:38.454 28340 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:20:38 ctl02 nova-api[28340]: 2017-09-28 12:20:38.454 28340 ERROR nova Traceback (most recent call last):
Sep 28 12:20:38 ctl02 nova-api[28340]: 2017-09-28 12:20:38.454 28340 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:20:38 ctl02 nova-api[28340]: 2017-09-28 12:20:38.454 28340 ERROR nova     sys.exit(main())
Sep 28 12:20:38 ctl02 nova-api[28340]: 2017-09-28 12:20:38.454 28340 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:20:38 ctl02 nova-api[28340]: 2017-09-28 12:20:38.454 28340 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:20:38 ctl02 nova-api[28340]: 2017-09-28 12:20:38.454 28340 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:20:38 ctl02 nova-api[28340]: 2017-09-28 12:20:38.454 28340 ERROR nova     max_url_len=max_url_len)
Sep 28 12:20:38 ctl02 nova-api[28340]: 2017-09-28 12:20:38.454 28340 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:20:38 ctl02 nova-api[28340]: 2017-09-28 12:20:38.454 28340 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:20:38 ctl02 nova-api[28340]: 2017-09-28 12:20:38.454 28340 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:20:38 ctl02 nova-api[28340]: 2017-09-28 12:20:38.454 28340 ERROR nova     sock.listen(backlog)
Sep 28 12:20:38 ctl02 nova-api[28340]: 2017-09-28 12:20:38.454 28340 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:20:38 ctl02 nova-api[28340]: 2017-09-28 12:20:38.454 28340 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:20:38 ctl02 nova-api[28340]: 2017-09-28 12:20:38.454 28340 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:20:38 ctl02 nova-api[28340]: 2017-09-28 12:20:38.454 28340 ERROR nova
Sep 28 12:20:38 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:20:38 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:20:38 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:20:38 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:20:38.781 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:20:38] "OPTIONS / HTTP/1.0" 200 134 0.000580
Sep 28 12:20:38 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:20:38 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:20:38 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:20:38 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:20:39 ctl02 heat-api-cfn[13300]: 2017-09-28 12:20:39.701 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:20:39] "OPTIONS / HTTP/1.0" 200 134 0.000464
Sep 28 12:20:39 ctl02 heat-api[13008]: 2017-09-28 12:20:39.830 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:20:39] "OPTIONS / HTTP/1.0" 200 134 0.000526
Sep 28 12:20:40 ctl02 heat-api-cfn[13300]: 2017-09-28 12:20:40.001 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:20:40] "OPTIONS / HTTP/1.0" 200 134 0.000543
Sep 28 12:20:40 ctl02 heat-api-cfn[13300]: 2017-09-28 12:20:40.373 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:20:40] "OPTIONS / HTTP/1.0" 200 134 0.000411
Sep 28 12:20:40 ctl02 nova-api[28360]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:20:40 ctl02 nova-api[28360]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:20:40 ctl02 glance-api[29183]: 2017-09-28 12:20:40.548 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:20:40] "OPTIONS / HTTP/1.0" 200 134 0.000627
Sep 28 12:20:40 ctl02 nova-api[28360]: 2017-09-28 12:20:40.704 28360 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:20:40 ctl02 nova-api[28360]: 2017-09-28 12:20:40.707 28360 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:20:40 ctl02 nova-api[28360]: 2017-09-28 12:20:40.707 28360 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:20:40 ctl02 nova-api[28360]: 2017-09-28 12:20:40.707 28360 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:20:40 ctl02 nova-api[28360]: 2017-09-28 12:20:40.707 28360 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:20:40 ctl02 nova-api[28360]: 2017-09-28 12:20:40.707 28360 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:20:40 ctl02 nova-api[28360]: 2017-09-28 12:20:40.707 28360 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:20:40 ctl02 nova-api[28360]: 2017-09-28 12:20:40.707 28360 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:20:40 ctl02 nova-api[28360]: 2017-09-28 12:20:40.707 28360 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:20:40 ctl02 nova-api[28360]: 2017-09-28 12:20:40.707 28360 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:20:40 ctl02 nova-api[28360]: 2017-09-28 12:20:40.707 28360 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:20:40 ctl02 nova-api[28360]: 2017-09-28 12:20:40.707 28360 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:20:40 ctl02 nova-api[28360]: 2017-09-28 12:20:40.707 28360 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:20:40 ctl02 nova-api[28360]: 2017-09-28 12:20:40.707 28360 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:20:40 ctl02 nova-api[28360]: 2017-09-28 12:20:40.707 28360 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:20:40 ctl02 nova-api[28360]: 2017-09-28 12:20:40.707 28360 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:20:40 ctl02 nova-api[28360]: 2017-09-28 12:20:40.707 28360 ERROR nova.wsgi     self.filename))
Sep 28 12:20:40 ctl02 nova-api[28360]: 2017-09-28 12:20:40.707 28360 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:20:40 ctl02 nova-api[28360]: 2017-09-28 12:20:40.707 28360 ERROR nova.wsgi
Sep 28 12:20:40 ctl02 nova-api[28360]: 2017-09-28 12:20:40.709 28360 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:20:40 ctl02 nova-api[28360]: 2017-09-28 12:20:40.840 28360 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:20:41 ctl02 nova-api[28360]: 2017-09-28 12:20:41.070 28360 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:20:41 ctl02 nova-api[28360]: 2017-09-28 12:20:41.073 28360 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:20:41 ctl02 nova-api[28360]: 2017-09-28 12:20:41.074 28360 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:20:41 ctl02 nova-api[28360]: 2017-09-28 12:20:41.074 28360 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:20:41 ctl02 nova-api[28360]: 2017-09-28 12:20:41.206 28360 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:20:41 ctl02 nova-api[28360]: 2017-09-28 12:20:41.209 28360 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:20:41 ctl02 nova-api[28360]: 2017-09-28 12:20:41.209 28360 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:20:41 ctl02 nova-api[28360]: 2017-09-28 12:20:41.210 28360 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:20:41 ctl02 nova-api[28360]: 2017-09-28 12:20:41.213 28360 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:20:41 ctl02 nova-api[28360]: 2017-09-28 12:20:41.214 28360 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:20:41 ctl02 nova-api[28360]: 2017-09-28 12:20:41.214 28360 ERROR nova Traceback (most recent call last):
Sep 28 12:20:41 ctl02 nova-api[28360]: 2017-09-28 12:20:41.214 28360 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:20:41 ctl02 nova-api[28360]: 2017-09-28 12:20:41.214 28360 ERROR nova     sys.exit(main())
Sep 28 12:20:41 ctl02 nova-api[28360]: 2017-09-28 12:20:41.214 28360 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:20:41 ctl02 nova-api[28360]: 2017-09-28 12:20:41.214 28360 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:20:41 ctl02 nova-api[28360]: 2017-09-28 12:20:41.214 28360 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:20:41 ctl02 nova-api[28360]: 2017-09-28 12:20:41.214 28360 ERROR nova     max_url_len=max_url_len)
Sep 28 12:20:41 ctl02 nova-api[28360]: 2017-09-28 12:20:41.214 28360 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:20:41 ctl02 nova-api[28360]: 2017-09-28 12:20:41.214 28360 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:20:41 ctl02 nova-api[28360]: 2017-09-28 12:20:41.214 28360 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:20:41 ctl02 nova-api[28360]: 2017-09-28 12:20:41.214 28360 ERROR nova     sock.listen(backlog)
Sep 28 12:20:41 ctl02 nova-api[28360]: 2017-09-28 12:20:41.214 28360 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:20:41 ctl02 nova-api[28360]: 2017-09-28 12:20:41.214 28360 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:20:41 ctl02 nova-api[28360]: 2017-09-28 12:20:41.214 28360 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:20:41 ctl02 nova-api[28360]: 2017-09-28 12:20:41.214 28360 ERROR nova
Sep 28 12:20:41 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:20:41 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:20:41 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:20:41 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:20:41 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:20:41 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:20:41 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:20:42 ctl02 glance-api[29183]: 2017-09-28 12:20:42.189 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:20:42] "OPTIONS / HTTP/1.0" 200 134 0.000575
Sep 28 12:20:43 ctl02 nova-api[28378]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:20:43 ctl02 nova-api[28378]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:20:43 ctl02 nova-api[28378]: 2017-09-28 12:20:43.461 28378 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:20:43 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:20:43.464 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:20:43] "OPTIONS / HTTP/1.0" 200 134 0.000589
Sep 28 12:20:43 ctl02 nova-api[28378]: 2017-09-28 12:20:43.464 28378 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:20:43 ctl02 nova-api[28378]: 2017-09-28 12:20:43.464 28378 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:20:43 ctl02 nova-api[28378]: 2017-09-28 12:20:43.464 28378 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:20:43 ctl02 nova-api[28378]: 2017-09-28 12:20:43.464 28378 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:20:43 ctl02 nova-api[28378]: 2017-09-28 12:20:43.464 28378 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:20:43 ctl02 nova-api[28378]: 2017-09-28 12:20:43.464 28378 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:20:43 ctl02 nova-api[28378]: 2017-09-28 12:20:43.464 28378 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:20:43 ctl02 nova-api[28378]: 2017-09-28 12:20:43.464 28378 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:20:43 ctl02 nova-api[28378]: 2017-09-28 12:20:43.464 28378 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:20:43 ctl02 nova-api[28378]: 2017-09-28 12:20:43.464 28378 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:20:43 ctl02 nova-api[28378]: 2017-09-28 12:20:43.464 28378 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:20:43 ctl02 nova-api[28378]: 2017-09-28 12:20:43.464 28378 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:20:43 ctl02 nova-api[28378]: 2017-09-28 12:20:43.464 28378 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:20:43 ctl02 nova-api[28378]: 2017-09-28 12:20:43.464 28378 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:20:43 ctl02 nova-api[28378]: 2017-09-28 12:20:43.464 28378 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:20:43 ctl02 nova-api[28378]: 2017-09-28 12:20:43.464 28378 ERROR nova.wsgi     self.filename))
Sep 28 12:20:43 ctl02 nova-api[28378]: 2017-09-28 12:20:43.464 28378 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:20:43 ctl02 nova-api[28378]: 2017-09-28 12:20:43.464 28378 ERROR nova.wsgi
Sep 28 12:20:43 ctl02 nova-api[28378]: 2017-09-28 12:20:43.466 28378 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:20:43 ctl02 nova-api[28378]: 2017-09-28 12:20:43.594 28378 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:20:43 ctl02 glance-api[29183]: 2017-09-28 12:20:43.613 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:20:43] "OPTIONS / HTTP/1.0" 200 134 0.000557
Sep 28 12:20:43 ctl02 nova-api[28378]: 2017-09-28 12:20:43.824 28378 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:20:43 ctl02 nova-api[28378]: 2017-09-28 12:20:43.827 28378 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:20:43 ctl02 nova-api[28378]: 2017-09-28 12:20:43.827 28378 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:20:43 ctl02 nova-api[28378]: 2017-09-28 12:20:43.827 28378 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:20:43 ctl02 nova-api[28378]: 2017-09-28 12:20:43.957 28378 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:20:43 ctl02 nova-api[28378]: 2017-09-28 12:20:43.959 28378 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:20:43 ctl02 nova-api[28378]: 2017-09-28 12:20:43.959 28378 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:20:43 ctl02 nova-api[28378]: 2017-09-28 12:20:43.959 28378 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:20:43 ctl02 nova-api[28378]: 2017-09-28 12:20:43.963 28378 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:20:43 ctl02 nova-api[28378]: 2017-09-28 12:20:43.963 28378 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:20:43 ctl02 nova-api[28378]: 2017-09-28 12:20:43.963 28378 ERROR nova Traceback (most recent call last):
Sep 28 12:20:43 ctl02 nova-api[28378]: 2017-09-28 12:20:43.963 28378 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:20:43 ctl02 nova-api[28378]: 2017-09-28 12:20:43.963 28378 ERROR nova     sys.exit(main())
Sep 28 12:20:43 ctl02 nova-api[28378]: 2017-09-28 12:20:43.963 28378 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:20:43 ctl02 nova-api[28378]: 2017-09-28 12:20:43.963 28378 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:20:43 ctl02 nova-api[28378]: 2017-09-28 12:20:43.963 28378 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:20:43 ctl02 nova-api[28378]: 2017-09-28 12:20:43.963 28378 ERROR nova     max_url_len=max_url_len)
Sep 28 12:20:43 ctl02 nova-api[28378]: 2017-09-28 12:20:43.963 28378 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:20:43 ctl02 nova-api[28378]: 2017-09-28 12:20:43.963 28378 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:20:43 ctl02 nova-api[28378]: 2017-09-28 12:20:43.963 28378 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:20:43 ctl02 nova-api[28378]: 2017-09-28 12:20:43.963 28378 ERROR nova     sock.listen(backlog)
Sep 28 12:20:43 ctl02 nova-api[28378]: 2017-09-28 12:20:43.963 28378 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:20:43 ctl02 nova-api[28378]: 2017-09-28 12:20:43.963 28378 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:20:43 ctl02 nova-api[28378]: 2017-09-28 12:20:43.963 28378 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:20:43 ctl02 nova-api[28378]: 2017-09-28 12:20:43.963 28378 ERROR nova
Sep 28 12:20:44 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:20:44 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:20:44 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:20:44 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:20:44 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:20:44 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:20:44 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:20:44 ctl02 dhclient[600]: DHCPREQUEST of 192.168.11.25 on ens2 to 192.168.11.3 port 67 (xid=0x3415f07)
Sep 28 12:20:44 ctl02 dhclient[600]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 12:20:45 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 12:20:45 ctl02 ntp[28460]:  * Stopping NTP server ntpd
Sep 28 12:20:45 ctl02 ntp[28460]:    ...done.
Sep 28 12:20:45 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 12:20:45 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 12:20:45 ctl02 ntp[28471]:  * Starting NTP server ntpd
Sep 28 12:20:45 ctl02 ntpd[28478]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 12:20:45 ctl02 ntpd[28478]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -c /var/lib/ntp/ntp.conf.dhcp -u 108:112
Sep 28 12:20:45 ctl02 ntp[28471]:    ...done.
Sep 28 12:20:45 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 12:20:45 ctl02 ntpd[28481]: proto: precision = 0.047 usec (-24)
Sep 28 12:20:45 ctl02 ntpd[28481]: switching logging to file /var/log/ntp.log
Sep 28 12:20:45 ctl02 dhclient[600]: bound to 192.168.11.25 -- renewal in 270 seconds.
Sep 28 12:20:45 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:20:45.081 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:20:45] "OPTIONS / HTTP/1.0" 200 134 0.000435
Sep 28 12:20:45 ctl02 heat-api[13008]: 2017-09-28 12:20:45.664 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:20:45] "OPTIONS / HTTP/1.0" 200 134 0.000691
Sep 28 12:20:46 ctl02 nova-api[28396]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:20:46 ctl02 nova-api[28396]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:20:46 ctl02 nova-api[28396]: 2017-09-28 12:20:46.262 28396 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:20:46 ctl02 nova-api[28396]: 2017-09-28 12:20:46.264 28396 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:20:46 ctl02 nova-api[28396]: 2017-09-28 12:20:46.264 28396 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:20:46 ctl02 nova-api[28396]: 2017-09-28 12:20:46.264 28396 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:20:46 ctl02 nova-api[28396]: 2017-09-28 12:20:46.264 28396 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:20:46 ctl02 nova-api[28396]: 2017-09-28 12:20:46.264 28396 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:20:46 ctl02 nova-api[28396]: 2017-09-28 12:20:46.264 28396 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:20:46 ctl02 nova-api[28396]: 2017-09-28 12:20:46.264 28396 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:20:46 ctl02 nova-api[28396]: 2017-09-28 12:20:46.264 28396 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:20:46 ctl02 nova-api[28396]: 2017-09-28 12:20:46.264 28396 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:20:46 ctl02 nova-api[28396]: 2017-09-28 12:20:46.264 28396 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:20:46 ctl02 nova-api[28396]: 2017-09-28 12:20:46.264 28396 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:20:46 ctl02 nova-api[28396]: 2017-09-28 12:20:46.264 28396 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:20:46 ctl02 nova-api[28396]: 2017-09-28 12:20:46.264 28396 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:20:46 ctl02 nova-api[28396]: 2017-09-28 12:20:46.264 28396 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:20:46 ctl02 nova-api[28396]: 2017-09-28 12:20:46.264 28396 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:20:46 ctl02 nova-api[28396]: 2017-09-28 12:20:46.264 28396 ERROR nova.wsgi     self.filename))
Sep 28 12:20:46 ctl02 nova-api[28396]: 2017-09-28 12:20:46.264 28396 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:20:46 ctl02 nova-api[28396]: 2017-09-28 12:20:46.264 28396 ERROR nova.wsgi
Sep 28 12:20:46 ctl02 nova-api[28396]: 2017-09-28 12:20:46.265 28396 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:20:46 ctl02 nova-api[28396]: 2017-09-28 12:20:46.397 28396 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:20:46 ctl02 nova-api[28396]: 2017-09-28 12:20:46.650 28396 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:20:46 ctl02 nova-api[28396]: 2017-09-28 12:20:46.652 28396 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:20:46 ctl02 nova-api[28396]: 2017-09-28 12:20:46.652 28396 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:20:46 ctl02 nova-api[28396]: 2017-09-28 12:20:46.653 28396 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:20:46 ctl02 nova-api[28396]: 2017-09-28 12:20:46.785 28396 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:20:46 ctl02 nova-api[28396]: 2017-09-28 12:20:46.787 28396 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:20:46 ctl02 nova-api[28396]: 2017-09-28 12:20:46.787 28396 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:20:46 ctl02 nova-api[28396]: 2017-09-28 12:20:46.787 28396 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:20:46 ctl02 nova-api[28396]: 2017-09-28 12:20:46.791 28396 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:20:46 ctl02 nova-api[28396]: 2017-09-28 12:20:46.791 28396 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:20:46 ctl02 nova-api[28396]: 2017-09-28 12:20:46.791 28396 ERROR nova Traceback (most recent call last):
Sep 28 12:20:46 ctl02 nova-api[28396]: 2017-09-28 12:20:46.791 28396 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:20:46 ctl02 nova-api[28396]: 2017-09-28 12:20:46.791 28396 ERROR nova     sys.exit(main())
Sep 28 12:20:46 ctl02 nova-api[28396]: 2017-09-28 12:20:46.791 28396 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:20:46 ctl02 nova-api[28396]: 2017-09-28 12:20:46.791 28396 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:20:46 ctl02 nova-api[28396]: 2017-09-28 12:20:46.791 28396 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:20:46 ctl02 nova-api[28396]: 2017-09-28 12:20:46.791 28396 ERROR nova     max_url_len=max_url_len)
Sep 28 12:20:46 ctl02 nova-api[28396]: 2017-09-28 12:20:46.791 28396 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:20:46 ctl02 nova-api[28396]: 2017-09-28 12:20:46.791 28396 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:20:46 ctl02 nova-api[28396]: 2017-09-28 12:20:46.791 28396 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:20:46 ctl02 nova-api[28396]: 2017-09-28 12:20:46.791 28396 ERROR nova     sock.listen(backlog)
Sep 28 12:20:46 ctl02 nova-api[28396]: 2017-09-28 12:20:46.791 28396 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:20:46 ctl02 nova-api[28396]: 2017-09-28 12:20:46.791 28396 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:20:46 ctl02 nova-api[28396]: 2017-09-28 12:20:46.791 28396 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:20:46 ctl02 nova-api[28396]: 2017-09-28 12:20:46.791 28396 ERROR nova
Sep 28 12:20:46 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:20:46 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:20:46 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:20:47 ctl02 heat-api[13008]: 2017-09-28 12:20:47.018 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:20:47] "OPTIONS / HTTP/1.0" 200 134 0.000662
Sep 28 12:20:47 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:20:47 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:20:47 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:20:47 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:20:47 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5a30564f)
Sep 28 12:20:48 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5a30564f)
Sep 28 12:20:48 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:20:48.601 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:20:48] "OPTIONS / HTTP/1.0" 200 134 0.000474
Sep 28 12:20:48 ctl02 nova-api[28496]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:20:48 ctl02 nova-api[28496]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:20:49 ctl02 nova-api[28496]: 2017-09-28 12:20:48.999 28496 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:20:49 ctl02 nova-api[28496]: 2017-09-28 12:20:49.001 28496 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:20:49 ctl02 nova-api[28496]: 2017-09-28 12:20:49.001 28496 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:20:49 ctl02 nova-api[28496]: 2017-09-28 12:20:49.001 28496 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:20:49 ctl02 nova-api[28496]: 2017-09-28 12:20:49.001 28496 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:20:49 ctl02 nova-api[28496]: 2017-09-28 12:20:49.001 28496 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:20:49 ctl02 nova-api[28496]: 2017-09-28 12:20:49.001 28496 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:20:49 ctl02 nova-api[28496]: 2017-09-28 12:20:49.001 28496 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:20:49 ctl02 nova-api[28496]: 2017-09-28 12:20:49.001 28496 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:20:49 ctl02 nova-api[28496]: 2017-09-28 12:20:49.001 28496 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:20:49 ctl02 nova-api[28496]: 2017-09-28 12:20:49.001 28496 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:20:49 ctl02 nova-api[28496]: 2017-09-28 12:20:49.001 28496 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:20:49 ctl02 nova-api[28496]: 2017-09-28 12:20:49.001 28496 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:20:49 ctl02 nova-api[28496]: 2017-09-28 12:20:49.001 28496 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:20:49 ctl02 nova-api[28496]: 2017-09-28 12:20:49.001 28496 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:20:49 ctl02 nova-api[28496]: 2017-09-28 12:20:49.001 28496 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:20:49 ctl02 nova-api[28496]: 2017-09-28 12:20:49.001 28496 ERROR nova.wsgi     self.filename))
Sep 28 12:20:49 ctl02 nova-api[28496]: 2017-09-28 12:20:49.001 28496 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:20:49 ctl02 nova-api[28496]: 2017-09-28 12:20:49.001 28496 ERROR nova.wsgi
Sep 28 12:20:49 ctl02 nova-api[28496]: 2017-09-28 12:20:49.002 28496 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:20:49 ctl02 nova-api[28496]: 2017-09-28 12:20:49.136 28496 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:20:49 ctl02 nova-api[28496]: 2017-09-28 12:20:49.388 28496 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:20:49 ctl02 nova-api[28496]: 2017-09-28 12:20:49.390 28496 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:20:49 ctl02 nova-api[28496]: 2017-09-28 12:20:49.390 28496 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:20:49 ctl02 nova-api[28496]: 2017-09-28 12:20:49.390 28496 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:20:49 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5a30564f)
Sep 28 12:20:49 ctl02 nova-api[28496]: 2017-09-28 12:20:49.526 28496 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:20:49 ctl02 nova-api[28496]: 2017-09-28 12:20:49.528 28496 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:20:49 ctl02 nova-api[28496]: 2017-09-28 12:20:49.528 28496 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:20:49 ctl02 nova-api[28496]: 2017-09-28 12:20:49.529 28496 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:20:49 ctl02 nova-api[28496]: 2017-09-28 12:20:49.532 28496 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:20:49 ctl02 nova-api[28496]: 2017-09-28 12:20:49.532 28496 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:20:49 ctl02 nova-api[28496]: 2017-09-28 12:20:49.532 28496 ERROR nova Traceback (most recent call last):
Sep 28 12:20:49 ctl02 nova-api[28496]: 2017-09-28 12:20:49.532 28496 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:20:49 ctl02 nova-api[28496]: 2017-09-28 12:20:49.532 28496 ERROR nova     sys.exit(main())
Sep 28 12:20:49 ctl02 nova-api[28496]: 2017-09-28 12:20:49.532 28496 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:20:49 ctl02 nova-api[28496]: 2017-09-28 12:20:49.532 28496 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:20:49 ctl02 nova-api[28496]: 2017-09-28 12:20:49.532 28496 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:20:49 ctl02 nova-api[28496]: 2017-09-28 12:20:49.532 28496 ERROR nova     max_url_len=max_url_len)
Sep 28 12:20:49 ctl02 nova-api[28496]: 2017-09-28 12:20:49.532 28496 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:20:49 ctl02 nova-api[28496]: 2017-09-28 12:20:49.532 28496 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:20:49 ctl02 nova-api[28496]: 2017-09-28 12:20:49.532 28496 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:20:49 ctl02 nova-api[28496]: 2017-09-28 12:20:49.532 28496 ERROR nova     sock.listen(backlog)
Sep 28 12:20:49 ctl02 nova-api[28496]: 2017-09-28 12:20:49.532 28496 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:20:49 ctl02 nova-api[28496]: 2017-09-28 12:20:49.532 28496 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:20:49 ctl02 nova-api[28496]: 2017-09-28 12:20:49.532 28496 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:20:49 ctl02 nova-api[28496]: 2017-09-28 12:20:49.532 28496 ERROR nova
Sep 28 12:20:49 ctl02 heat-api-cfn[13300]: 2017-09-28 12:20:49.557 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:20:49] "OPTIONS / HTTP/1.0" 200 134 0.000542
Sep 28 12:20:49 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:20:49 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:20:49 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:20:49 ctl02 heat-api-cfn[13300]: 2017-09-28 12:20:49.810 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:20:49] "OPTIONS / HTTP/1.0" 200 134 0.000563
Sep 28 12:20:49 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:20:49 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:20:49 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:20:49 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:20:50 ctl02 heat-api[13008]: 2017-09-28 12:20:50.085 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:20:50] "OPTIONS / HTTP/1.0" 200 134 0.000661
Sep 28 12:20:50 ctl02 heat-api-cfn[13300]: 2017-09-28 12:20:50.150 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:20:50] "OPTIONS / HTTP/1.0" 200 134 0.000503
Sep 28 12:20:50 ctl02 glance-api[29183]: 2017-09-28 12:20:50.356 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:20:50] "OPTIONS / HTTP/1.0" 200 134 0.000695
Sep 28 12:20:50 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5a30564f)
Sep 28 12:20:51 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5a30564f)
Sep 28 12:20:51 ctl02 nova-api[28514]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:20:51 ctl02 nova-api[28514]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:20:51 ctl02 nova-api[28514]: 2017-09-28 12:20:51.764 28514 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:20:51 ctl02 nova-api[28514]: 2017-09-28 12:20:51.767 28514 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:20:51 ctl02 nova-api[28514]: 2017-09-28 12:20:51.767 28514 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:20:51 ctl02 nova-api[28514]: 2017-09-28 12:20:51.767 28514 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:20:51 ctl02 nova-api[28514]: 2017-09-28 12:20:51.767 28514 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:20:51 ctl02 nova-api[28514]: 2017-09-28 12:20:51.767 28514 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:20:51 ctl02 nova-api[28514]: 2017-09-28 12:20:51.767 28514 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:20:51 ctl02 nova-api[28514]: 2017-09-28 12:20:51.767 28514 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:20:51 ctl02 nova-api[28514]: 2017-09-28 12:20:51.767 28514 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:20:51 ctl02 nova-api[28514]: 2017-09-28 12:20:51.767 28514 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:20:51 ctl02 nova-api[28514]: 2017-09-28 12:20:51.767 28514 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:20:51 ctl02 nova-api[28514]: 2017-09-28 12:20:51.767 28514 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:20:51 ctl02 nova-api[28514]: 2017-09-28 12:20:51.767 28514 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:20:51 ctl02 nova-api[28514]: 2017-09-28 12:20:51.767 28514 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:20:51 ctl02 nova-api[28514]: 2017-09-28 12:20:51.767 28514 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:20:51 ctl02 nova-api[28514]: 2017-09-28 12:20:51.767 28514 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:20:51 ctl02 nova-api[28514]: 2017-09-28 12:20:51.767 28514 ERROR nova.wsgi     self.filename))
Sep 28 12:20:51 ctl02 nova-api[28514]: 2017-09-28 12:20:51.767 28514 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:20:51 ctl02 nova-api[28514]: 2017-09-28 12:20:51.767 28514 ERROR nova.wsgi
Sep 28 12:20:51 ctl02 nova-api[28514]: 2017-09-28 12:20:51.769 28514 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:20:51 ctl02 nova-api[28514]: 2017-09-28 12:20:51.903 28514 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:20:52 ctl02 nova-api[28514]: 2017-09-28 12:20:52.160 28514 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:20:52 ctl02 nova-api[28514]: 2017-09-28 12:20:52.163 28514 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:20:52 ctl02 nova-api[28514]: 2017-09-28 12:20:52.163 28514 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:20:52 ctl02 nova-api[28514]: 2017-09-28 12:20:52.163 28514 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:20:52 ctl02 glance-api[29183]: 2017-09-28 12:20:52.231 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:20:52] "OPTIONS / HTTP/1.0" 200 134 0.000642
Sep 28 12:20:52 ctl02 nova-api[28514]: 2017-09-28 12:20:52.299 28514 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:20:52 ctl02 nova-api[28514]: 2017-09-28 12:20:52.301 28514 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:20:52 ctl02 nova-api[28514]: 2017-09-28 12:20:52.302 28514 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:20:52 ctl02 nova-api[28514]: 2017-09-28 12:20:52.302 28514 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:20:52 ctl02 nova-api[28514]: 2017-09-28 12:20:52.305 28514 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:20:52 ctl02 nova-api[28514]: 2017-09-28 12:20:52.306 28514 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:20:52 ctl02 nova-api[28514]: 2017-09-28 12:20:52.306 28514 ERROR nova Traceback (most recent call last):
Sep 28 12:20:52 ctl02 nova-api[28514]: 2017-09-28 12:20:52.306 28514 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:20:52 ctl02 nova-api[28514]: 2017-09-28 12:20:52.306 28514 ERROR nova     sys.exit(main())
Sep 28 12:20:52 ctl02 nova-api[28514]: 2017-09-28 12:20:52.306 28514 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:20:52 ctl02 nova-api[28514]: 2017-09-28 12:20:52.306 28514 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:20:52 ctl02 nova-api[28514]: 2017-09-28 12:20:52.306 28514 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:20:52 ctl02 nova-api[28514]: 2017-09-28 12:20:52.306 28514 ERROR nova     max_url_len=max_url_len)
Sep 28 12:20:52 ctl02 nova-api[28514]: 2017-09-28 12:20:52.306 28514 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:20:52 ctl02 nova-api[28514]: 2017-09-28 12:20:52.306 28514 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:20:52 ctl02 nova-api[28514]: 2017-09-28 12:20:52.306 28514 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:20:52 ctl02 nova-api[28514]: 2017-09-28 12:20:52.306 28514 ERROR nova     sock.listen(backlog)
Sep 28 12:20:52 ctl02 nova-api[28514]: 2017-09-28 12:20:52.306 28514 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:20:52 ctl02 nova-api[28514]: 2017-09-28 12:20:52.306 28514 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:20:52 ctl02 nova-api[28514]: 2017-09-28 12:20:52.306 28514 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:20:52 ctl02 nova-api[28514]: 2017-09-28 12:20:52.306 28514 ERROR nova
Sep 28 12:20:52 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:20:52 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:20:52 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:20:52 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5a30564f)
Sep 28 12:20:52 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:20:52 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:20:52 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:20:52 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:20:53 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:20:53.088 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:20:53] "OPTIONS / HTTP/1.0" 200 134 0.000528
Sep 28 12:20:53 ctl02 nova-cert[4860]: 2017-09-28 12:20:53.115 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:20:53 ctl02 glance-api[29183]: 2017-09-28 12:20:53.273 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:20:53] "OPTIONS / HTTP/1.0" 200 134 0.000658
Sep 28 12:20:53 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5a30564f)
Sep 28 12:20:54 ctl02 nova-api[28532]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:20:54 ctl02 nova-api[28532]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:20:54 ctl02 nova-api[28532]: 2017-09-28 12:20:54.516 28532 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:20:54 ctl02 nova-api[28532]: 2017-09-28 12:20:54.518 28532 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:20:54 ctl02 nova-api[28532]: 2017-09-28 12:20:54.518 28532 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:20:54 ctl02 nova-api[28532]: 2017-09-28 12:20:54.518 28532 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:20:54 ctl02 nova-api[28532]: 2017-09-28 12:20:54.518 28532 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:20:54 ctl02 nova-api[28532]: 2017-09-28 12:20:54.518 28532 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:20:54 ctl02 nova-api[28532]: 2017-09-28 12:20:54.518 28532 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:20:54 ctl02 nova-api[28532]: 2017-09-28 12:20:54.518 28532 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:20:54 ctl02 nova-api[28532]: 2017-09-28 12:20:54.518 28532 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:20:54 ctl02 nova-api[28532]: 2017-09-28 12:20:54.518 28532 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:20:54 ctl02 nova-api[28532]: 2017-09-28 12:20:54.518 28532 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:20:54 ctl02 nova-api[28532]: 2017-09-28 12:20:54.518 28532 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:20:54 ctl02 nova-api[28532]: 2017-09-28 12:20:54.518 28532 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:20:54 ctl02 nova-api[28532]: 2017-09-28 12:20:54.518 28532 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:20:54 ctl02 nova-api[28532]: 2017-09-28 12:20:54.518 28532 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:20:54 ctl02 nova-api[28532]: 2017-09-28 12:20:54.518 28532 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:20:54 ctl02 nova-api[28532]: 2017-09-28 12:20:54.518 28532 ERROR nova.wsgi     self.filename))
Sep 28 12:20:54 ctl02 nova-api[28532]: 2017-09-28 12:20:54.518 28532 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:20:54 ctl02 nova-api[28532]: 2017-09-28 12:20:54.518 28532 ERROR nova.wsgi
Sep 28 12:20:54 ctl02 nova-api[28532]: 2017-09-28 12:20:54.520 28532 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:20:54 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5a30564f)
Sep 28 12:20:54 ctl02 nova-conductor[5056]: 2017-09-28 12:20:54.582 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:20:54 ctl02 nova-conductor[5056]: 2017-09-28 12:20:54.601 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:20:54 ctl02 nova-conductor[5056]: 2017-09-28 12:20:54.615 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:20:54 ctl02 nova-conductor[5056]: 2017-09-28 12:20:54.617 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:20:54 ctl02 nova-api[28532]: 2017-09-28 12:20:54.657 28532 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:20:54 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:20:54.885 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:20:54] "OPTIONS / HTTP/1.0" 200 134 0.000471
Sep 28 12:20:54 ctl02 nova-api[28532]: 2017-09-28 12:20:54.908 28532 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:20:54 ctl02 nova-api[28532]: 2017-09-28 12:20:54.910 28532 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:20:54 ctl02 nova-api[28532]: 2017-09-28 12:20:54.911 28532 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:20:54 ctl02 nova-api[28532]: 2017-09-28 12:20:54.911 28532 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:20:55 ctl02 nova-api[28532]: 2017-09-28 12:20:55.043 28532 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:20:55 ctl02 nova-api[28532]: 2017-09-28 12:20:55.045 28532 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:20:55 ctl02 nova-api[28532]: 2017-09-28 12:20:55.046 28532 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:20:55 ctl02 nova-api[28532]: 2017-09-28 12:20:55.046 28532 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:20:55 ctl02 nova-api[28532]: 2017-09-28 12:20:55.049 28532 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:20:55 ctl02 nova-api[28532]: 2017-09-28 12:20:55.050 28532 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:20:55 ctl02 nova-api[28532]: 2017-09-28 12:20:55.050 28532 ERROR nova Traceback (most recent call last):
Sep 28 12:20:55 ctl02 nova-api[28532]: 2017-09-28 12:20:55.050 28532 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:20:55 ctl02 nova-api[28532]: 2017-09-28 12:20:55.050 28532 ERROR nova     sys.exit(main())
Sep 28 12:20:55 ctl02 nova-api[28532]: 2017-09-28 12:20:55.050 28532 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:20:55 ctl02 nova-api[28532]: 2017-09-28 12:20:55.050 28532 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:20:55 ctl02 nova-api[28532]: 2017-09-28 12:20:55.050 28532 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:20:55 ctl02 nova-api[28532]: 2017-09-28 12:20:55.050 28532 ERROR nova     max_url_len=max_url_len)
Sep 28 12:20:55 ctl02 nova-api[28532]: 2017-09-28 12:20:55.050 28532 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:20:55 ctl02 nova-api[28532]: 2017-09-28 12:20:55.050 28532 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:20:55 ctl02 nova-api[28532]: 2017-09-28 12:20:55.050 28532 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:20:55 ctl02 nova-api[28532]: 2017-09-28 12:20:55.050 28532 ERROR nova     sock.listen(backlog)
Sep 28 12:20:55 ctl02 nova-api[28532]: 2017-09-28 12:20:55.050 28532 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:20:55 ctl02 nova-api[28532]: 2017-09-28 12:20:55.050 28532 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:20:55 ctl02 nova-api[28532]: 2017-09-28 12:20:55.050 28532 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:20:55 ctl02 nova-api[28532]: 2017-09-28 12:20:55.050 28532 ERROR nova
Sep 28 12:20:55 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:20:55 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:20:55 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:20:55 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:20:55 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:20:55 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:20:55 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:20:55 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5a30564f)
Sep 28 12:20:56 ctl02 heat-api[13008]: 2017-09-28 12:20:56.005 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:20:56] "OPTIONS / HTTP/1.0" 200 134 0.000671
Sep 28 12:20:56 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5a30564f)
Sep 28 12:20:56 ctl02 heat-api[13008]: 2017-09-28 12:20:56.929 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:20:56] "OPTIONS / HTTP/1.0" 200 134 0.000647
Sep 28 12:20:57 ctl02 nova-api[28550]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:20:57 ctl02 nova-api[28550]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:20:57 ctl02 nova-api[28550]: 2017-09-28 12:20:57.285 28550 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:20:57 ctl02 nova-api[28550]: 2017-09-28 12:20:57.287 28550 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:20:57 ctl02 nova-api[28550]: 2017-09-28 12:20:57.287 28550 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:20:57 ctl02 nova-api[28550]: 2017-09-28 12:20:57.287 28550 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:20:57 ctl02 nova-api[28550]: 2017-09-28 12:20:57.287 28550 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:20:57 ctl02 nova-api[28550]: 2017-09-28 12:20:57.287 28550 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:20:57 ctl02 nova-api[28550]: 2017-09-28 12:20:57.287 28550 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:20:57 ctl02 nova-api[28550]: 2017-09-28 12:20:57.287 28550 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:20:57 ctl02 nova-api[28550]: 2017-09-28 12:20:57.287 28550 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:20:57 ctl02 nova-api[28550]: 2017-09-28 12:20:57.287 28550 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:20:57 ctl02 nova-api[28550]: 2017-09-28 12:20:57.287 28550 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:20:57 ctl02 nova-api[28550]: 2017-09-28 12:20:57.287 28550 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:20:57 ctl02 nova-api[28550]: 2017-09-28 12:20:57.287 28550 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:20:57 ctl02 nova-api[28550]: 2017-09-28 12:20:57.287 28550 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:20:57 ctl02 nova-api[28550]: 2017-09-28 12:20:57.287 28550 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:20:57 ctl02 nova-api[28550]: 2017-09-28 12:20:57.287 28550 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:20:57 ctl02 nova-api[28550]: 2017-09-28 12:20:57.287 28550 ERROR nova.wsgi     self.filename))
Sep 28 12:20:57 ctl02 nova-api[28550]: 2017-09-28 12:20:57.287 28550 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:20:57 ctl02 nova-api[28550]: 2017-09-28 12:20:57.287 28550 ERROR nova.wsgi
Sep 28 12:20:57 ctl02 nova-api[28550]: 2017-09-28 12:20:57.288 28550 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:20:57 ctl02 nova-api[28550]: 2017-09-28 12:20:57.426 28550 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:20:57 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5a30564f)
Sep 28 12:20:57 ctl02 nova-api[28550]: 2017-09-28 12:20:57.685 28550 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:20:57 ctl02 nova-api[28550]: 2017-09-28 12:20:57.687 28550 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:20:57 ctl02 nova-api[28550]: 2017-09-28 12:20:57.688 28550 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:20:57 ctl02 nova-api[28550]: 2017-09-28 12:20:57.688 28550 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:20:57 ctl02 nova-api[28550]: 2017-09-28 12:20:57.826 28550 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:20:57 ctl02 nova-api[28550]: 2017-09-28 12:20:57.828 28550 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:20:57 ctl02 nova-api[28550]: 2017-09-28 12:20:57.828 28550 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:20:57 ctl02 nova-api[28550]: 2017-09-28 12:20:57.828 28550 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:20:57 ctl02 nova-api[28550]: 2017-09-28 12:20:57.832 28550 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:20:57 ctl02 nova-api[28550]: 2017-09-28 12:20:57.832 28550 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:20:57 ctl02 nova-api[28550]: 2017-09-28 12:20:57.832 28550 ERROR nova Traceback (most recent call last):
Sep 28 12:20:57 ctl02 nova-api[28550]: 2017-09-28 12:20:57.832 28550 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:20:57 ctl02 nova-api[28550]: 2017-09-28 12:20:57.832 28550 ERROR nova     sys.exit(main())
Sep 28 12:20:57 ctl02 nova-api[28550]: 2017-09-28 12:20:57.832 28550 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:20:57 ctl02 nova-api[28550]: 2017-09-28 12:20:57.832 28550 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:20:57 ctl02 nova-api[28550]: 2017-09-28 12:20:57.832 28550 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:20:57 ctl02 nova-api[28550]: 2017-09-28 12:20:57.832 28550 ERROR nova     max_url_len=max_url_len)
Sep 28 12:20:57 ctl02 nova-api[28550]: 2017-09-28 12:20:57.832 28550 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:20:57 ctl02 nova-api[28550]: 2017-09-28 12:20:57.832 28550 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:20:57 ctl02 nova-api[28550]: 2017-09-28 12:20:57.832 28550 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:20:57 ctl02 nova-api[28550]: 2017-09-28 12:20:57.832 28550 ERROR nova     sock.listen(backlog)
Sep 28 12:20:57 ctl02 nova-api[28550]: 2017-09-28 12:20:57.832 28550 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:20:57 ctl02 nova-api[28550]: 2017-09-28 12:20:57.832 28550 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:20:57 ctl02 nova-api[28550]: 2017-09-28 12:20:57.832 28550 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:20:57 ctl02 nova-api[28550]: 2017-09-28 12:20:57.832 28550 ERROR nova
Sep 28 12:20:58 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:20:58 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:20:58 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:20:58 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:20:58 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:20:58 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:20:58 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:20:58 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:20:58.225 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:20:58] "OPTIONS / HTTP/1.0" 200 134 0.000483
Sep 28 12:20:58 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:20:58 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:20:58 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 12:20:58 ctl02 ntp[28624]:  * Stopping NTP server ntpd
Sep 28 12:20:58 ctl02 ntp[28624]:    ...done.
Sep 28 12:20:58 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 12:20:58 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 12:20:58 ctl02 ntp[28635]:  * Starting NTP server ntpd
Sep 28 12:20:58 ctl02 ntpd[28642]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 12:20:58 ctl02 ntpd[28642]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 12:20:58 ctl02 ntp[28635]:    ...done.
Sep 28 12:20:58 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 12:20:58 ctl02 ntpd[28645]: proto: precision = 0.043 usec (-24)
Sep 28 12:20:58 ctl02 ntpd[28645]: switching logging to file /var/log/ntp.log
Sep 28 12:20:59 ctl02 nova-api[28568]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:20:59 ctl02 nova-api[28568]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:20:59 ctl02 heat-api-cfn[13300]: 2017-09-28 12:20:59.836 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:20:59] "OPTIONS / HTTP/1.0" 200 134 0.000602
Sep 28 12:20:59 ctl02 heat-api-cfn[13300]: 2017-09-28 12:20:59.977 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:20:59] "OPTIONS / HTTP/1.0" 200 134 0.000452
Sep 28 12:20:59 ctl02 heat-api[13008]: 2017-09-28 12:20:59.982 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:20:59] "OPTIONS / HTTP/1.0" 200 134 0.000541
Sep 28 12:20:59 ctl02 nova-api[28568]: 2017-09-28 12:20:59.983 28568 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:20:59 ctl02 nova-api[28568]: 2017-09-28 12:20:59.985 28568 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:20:59 ctl02 nova-api[28568]: 2017-09-28 12:20:59.985 28568 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:20:59 ctl02 nova-api[28568]: 2017-09-28 12:20:59.985 28568 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:20:59 ctl02 nova-api[28568]: 2017-09-28 12:20:59.985 28568 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:20:59 ctl02 nova-api[28568]: 2017-09-28 12:20:59.985 28568 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:20:59 ctl02 nova-api[28568]: 2017-09-28 12:20:59.985 28568 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:20:59 ctl02 nova-api[28568]: 2017-09-28 12:20:59.985 28568 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:20:59 ctl02 nova-api[28568]: 2017-09-28 12:20:59.985 28568 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:20:59 ctl02 nova-api[28568]: 2017-09-28 12:20:59.985 28568 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:20:59 ctl02 nova-api[28568]: 2017-09-28 12:20:59.985 28568 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:20:59 ctl02 nova-api[28568]: 2017-09-28 12:20:59.985 28568 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:20:59 ctl02 nova-api[28568]: 2017-09-28 12:20:59.985 28568 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:20:59 ctl02 nova-api[28568]: 2017-09-28 12:20:59.985 28568 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:20:59 ctl02 nova-api[28568]: 2017-09-28 12:20:59.985 28568 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:20:59 ctl02 nova-api[28568]: 2017-09-28 12:20:59.985 28568 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:20:59 ctl02 nova-api[28568]: 2017-09-28 12:20:59.985 28568 ERROR nova.wsgi     self.filename))
Sep 28 12:20:59 ctl02 nova-api[28568]: 2017-09-28 12:20:59.985 28568 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:20:59 ctl02 nova-api[28568]: 2017-09-28 12:20:59.985 28568 ERROR nova.wsgi
Sep 28 12:20:59 ctl02 nova-api[28568]: 2017-09-28 12:20:59.987 28568 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:21:00 ctl02 nova-api[28568]: 2017-09-28 12:21:00.116 28568 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:21:00 ctl02 heat-api-cfn[13300]: 2017-09-28 12:21:00.137 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:21:00] "OPTIONS / HTTP/1.0" 200 134 0.000425
Sep 28 12:21:00 ctl02 glance-api[29183]: 2017-09-28 12:21:00.285 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:21:00] "OPTIONS / HTTP/1.0" 200 134 0.000590
Sep 28 12:21:00 ctl02 nova-api[28568]: 2017-09-28 12:21:00.355 28568 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:21:00 ctl02 nova-api[28568]: 2017-09-28 12:21:00.357 28568 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:21:00 ctl02 nova-api[28568]: 2017-09-28 12:21:00.357 28568 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:21:00 ctl02 nova-api[28568]: 2017-09-28 12:21:00.357 28568 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:21:00 ctl02 nova-api[28568]: 2017-09-28 12:21:00.488 28568 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:21:00 ctl02 nova-api[28568]: 2017-09-28 12:21:00.490 28568 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:21:00 ctl02 nova-api[28568]: 2017-09-28 12:21:00.490 28568 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:21:00 ctl02 nova-api[28568]: 2017-09-28 12:21:00.490 28568 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:21:00 ctl02 nova-api[28568]: 2017-09-28 12:21:00.493 28568 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:21:00 ctl02 nova-api[28568]: 2017-09-28 12:21:00.494 28568 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:21:00 ctl02 nova-api[28568]: 2017-09-28 12:21:00.494 28568 ERROR nova Traceback (most recent call last):
Sep 28 12:21:00 ctl02 nova-api[28568]: 2017-09-28 12:21:00.494 28568 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:21:00 ctl02 nova-api[28568]: 2017-09-28 12:21:00.494 28568 ERROR nova     sys.exit(main())
Sep 28 12:21:00 ctl02 nova-api[28568]: 2017-09-28 12:21:00.494 28568 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:21:00 ctl02 nova-api[28568]: 2017-09-28 12:21:00.494 28568 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:21:00 ctl02 nova-api[28568]: 2017-09-28 12:21:00.494 28568 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:21:00 ctl02 nova-api[28568]: 2017-09-28 12:21:00.494 28568 ERROR nova     max_url_len=max_url_len)
Sep 28 12:21:00 ctl02 nova-api[28568]: 2017-09-28 12:21:00.494 28568 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:21:00 ctl02 nova-api[28568]: 2017-09-28 12:21:00.494 28568 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:21:00 ctl02 nova-api[28568]: 2017-09-28 12:21:00.494 28568 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:21:00 ctl02 nova-api[28568]: 2017-09-28 12:21:00.494 28568 ERROR nova     sock.listen(backlog)
Sep 28 12:21:00 ctl02 nova-api[28568]: 2017-09-28 12:21:00.494 28568 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:21:00 ctl02 nova-api[28568]: 2017-09-28 12:21:00.494 28568 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:21:00 ctl02 nova-api[28568]: 2017-09-28 12:21:00.494 28568 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:21:00 ctl02 nova-api[28568]: 2017-09-28 12:21:00.494 28568 ERROR nova
Sep 28 12:21:00 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:21:00 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:21:00 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:21:00 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:21:00 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:21:00 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:21:00 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:21:02 ctl02 glance-api[29183]: 2017-09-28 12:21:02.085 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:21:02] "OPTIONS / HTTP/1.0" 200 134 0.000569
Sep 28 12:21:02 ctl02 nova-api[28658]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:21:02 ctl02 nova-api[28658]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:21:02 ctl02 nova-api[28658]: 2017-09-28 12:21:02.683 28658 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:21:02 ctl02 nova-api[28658]: 2017-09-28 12:21:02.685 28658 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:21:02 ctl02 nova-api[28658]: 2017-09-28 12:21:02.685 28658 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:21:02 ctl02 nova-api[28658]: 2017-09-28 12:21:02.685 28658 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:21:02 ctl02 nova-api[28658]: 2017-09-28 12:21:02.685 28658 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:21:02 ctl02 nova-api[28658]: 2017-09-28 12:21:02.685 28658 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:21:02 ctl02 nova-api[28658]: 2017-09-28 12:21:02.685 28658 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:21:02 ctl02 nova-api[28658]: 2017-09-28 12:21:02.685 28658 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:21:02 ctl02 nova-api[28658]: 2017-09-28 12:21:02.685 28658 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:21:02 ctl02 nova-api[28658]: 2017-09-28 12:21:02.685 28658 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:21:02 ctl02 nova-api[28658]: 2017-09-28 12:21:02.685 28658 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:21:02 ctl02 nova-api[28658]: 2017-09-28 12:21:02.685 28658 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:21:02 ctl02 nova-api[28658]: 2017-09-28 12:21:02.685 28658 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:21:02 ctl02 nova-api[28658]: 2017-09-28 12:21:02.685 28658 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:21:02 ctl02 nova-api[28658]: 2017-09-28 12:21:02.685 28658 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:21:02 ctl02 nova-api[28658]: 2017-09-28 12:21:02.685 28658 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:21:02 ctl02 nova-api[28658]: 2017-09-28 12:21:02.685 28658 ERROR nova.wsgi     self.filename))
Sep 28 12:21:02 ctl02 nova-api[28658]: 2017-09-28 12:21:02.685 28658 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:21:02 ctl02 nova-api[28658]: 2017-09-28 12:21:02.685 28658 ERROR nova.wsgi
Sep 28 12:21:02 ctl02 nova-api[28658]: 2017-09-28 12:21:02.686 28658 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:21:02 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:21:02.734 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:21:02] "OPTIONS / HTTP/1.0" 200 134 0.000534
Sep 28 12:21:02 ctl02 nova-api[28658]: 2017-09-28 12:21:02.813 28658 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:21:03 ctl02 nova-consoleauth[5433]: 2017-09-28 12:21:03.000 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:21:03 ctl02 nova-api[28658]: 2017-09-28 12:21:03.038 28658 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:21:03 ctl02 nova-api[28658]: 2017-09-28 12:21:03.040 28658 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:21:03 ctl02 nova-api[28658]: 2017-09-28 12:21:03.040 28658 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:21:03 ctl02 nova-api[28658]: 2017-09-28 12:21:03.041 28658 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:21:03 ctl02 nova-api[28658]: 2017-09-28 12:21:03.170 28658 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:21:03 ctl02 nova-api[28658]: 2017-09-28 12:21:03.171 28658 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:21:03 ctl02 nova-api[28658]: 2017-09-28 12:21:03.172 28658 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:21:03 ctl02 nova-api[28658]: 2017-09-28 12:21:03.172 28658 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:21:03 ctl02 nova-api[28658]: 2017-09-28 12:21:03.175 28658 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:21:03 ctl02 nova-api[28658]: 2017-09-28 12:21:03.176 28658 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:21:03 ctl02 nova-api[28658]: 2017-09-28 12:21:03.176 28658 ERROR nova Traceback (most recent call last):
Sep 28 12:21:03 ctl02 nova-api[28658]: 2017-09-28 12:21:03.176 28658 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:21:03 ctl02 nova-api[28658]: 2017-09-28 12:21:03.176 28658 ERROR nova     sys.exit(main())
Sep 28 12:21:03 ctl02 nova-api[28658]: 2017-09-28 12:21:03.176 28658 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:21:03 ctl02 nova-api[28658]: 2017-09-28 12:21:03.176 28658 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:21:03 ctl02 nova-api[28658]: 2017-09-28 12:21:03.176 28658 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:21:03 ctl02 nova-api[28658]: 2017-09-28 12:21:03.176 28658 ERROR nova     max_url_len=max_url_len)
Sep 28 12:21:03 ctl02 nova-api[28658]: 2017-09-28 12:21:03.176 28658 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:21:03 ctl02 nova-api[28658]: 2017-09-28 12:21:03.176 28658 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:21:03 ctl02 nova-api[28658]: 2017-09-28 12:21:03.176 28658 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:21:03 ctl02 nova-api[28658]: 2017-09-28 12:21:03.176 28658 ERROR nova     sock.listen(backlog)
Sep 28 12:21:03 ctl02 nova-api[28658]: 2017-09-28 12:21:03.176 28658 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:21:03 ctl02 nova-api[28658]: 2017-09-28 12:21:03.176 28658 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:21:03 ctl02 nova-api[28658]: 2017-09-28 12:21:03.176 28658 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:21:03 ctl02 nova-api[28658]: 2017-09-28 12:21:03.176 28658 ERROR nova
Sep 28 12:21:03 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:21:03 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:21:03 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:21:03 ctl02 glance-api[29183]: 2017-09-28 12:21:03.607 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:21:03] "OPTIONS / HTTP/1.0" 200 134 0.000802
Sep 28 12:21:03 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:21:03 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:21:03 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:21:03 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:21:04 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:21:04.961 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:21:04] "OPTIONS / HTTP/1.0" 200 134 0.000472
Sep 28 12:21:05 ctl02 nova-api[28676]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:21:05 ctl02 nova-api[28676]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:21:05 ctl02 nova-api[28676]: 2017-09-28 12:21:05.486 28676 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:21:05 ctl02 nova-api[28676]: 2017-09-28 12:21:05.488 28676 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:21:05 ctl02 nova-api[28676]: 2017-09-28 12:21:05.488 28676 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:21:05 ctl02 nova-api[28676]: 2017-09-28 12:21:05.488 28676 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:21:05 ctl02 nova-api[28676]: 2017-09-28 12:21:05.488 28676 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:21:05 ctl02 nova-api[28676]: 2017-09-28 12:21:05.488 28676 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:21:05 ctl02 nova-api[28676]: 2017-09-28 12:21:05.488 28676 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:21:05 ctl02 nova-api[28676]: 2017-09-28 12:21:05.488 28676 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:21:05 ctl02 nova-api[28676]: 2017-09-28 12:21:05.488 28676 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:21:05 ctl02 nova-api[28676]: 2017-09-28 12:21:05.488 28676 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:21:05 ctl02 nova-api[28676]: 2017-09-28 12:21:05.488 28676 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:21:05 ctl02 nova-api[28676]: 2017-09-28 12:21:05.488 28676 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:21:05 ctl02 nova-api[28676]: 2017-09-28 12:21:05.488 28676 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:21:05 ctl02 nova-api[28676]: 2017-09-28 12:21:05.488 28676 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:21:05 ctl02 nova-api[28676]: 2017-09-28 12:21:05.488 28676 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:21:05 ctl02 nova-api[28676]: 2017-09-28 12:21:05.488 28676 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:21:05 ctl02 nova-api[28676]: 2017-09-28 12:21:05.488 28676 ERROR nova.wsgi     self.filename))
Sep 28 12:21:05 ctl02 nova-api[28676]: 2017-09-28 12:21:05.488 28676 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:21:05 ctl02 nova-api[28676]: 2017-09-28 12:21:05.488 28676 ERROR nova.wsgi
Sep 28 12:21:05 ctl02 nova-api[28676]: 2017-09-28 12:21:05.489 28676 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:21:05 ctl02 nova-api[28676]: 2017-09-28 12:21:05.623 28676 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:21:05 ctl02 heat-engine[12803]: 2017-09-28 12:21:05.696 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:21:05 ctl02 heat-engine[12803]: 2017-09-28 12:21:05.700 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:21:05 ctl02 heat-engine[12803]: 2017-09-28 12:21:05.703 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:21:05 ctl02 heat-engine[12803]: 2017-09-28 12:21:05.706 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:21:05 ctl02 nova-api[28676]: 2017-09-28 12:21:05.879 28676 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:21:05 ctl02 nova-api[28676]: 2017-09-28 12:21:05.882 28676 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:21:05 ctl02 nova-api[28676]: 2017-09-28 12:21:05.882 28676 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:21:05 ctl02 nova-api[28676]: 2017-09-28 12:21:05.882 28676 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:21:06 ctl02 nova-api[28676]: 2017-09-28 12:21:06.015 28676 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:21:06 ctl02 nova-api[28676]: 2017-09-28 12:21:06.017 28676 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:21:06 ctl02 nova-api[28676]: 2017-09-28 12:21:06.017 28676 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:21:06 ctl02 nova-api[28676]: 2017-09-28 12:21:06.017 28676 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:21:06 ctl02 nova-api[28676]: 2017-09-28 12:21:06.021 28676 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:21:06 ctl02 nova-scheduler[5620]: 2017-09-28 12:21:06.021 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:21:06 ctl02 nova-api[28676]: 2017-09-28 12:21:06.021 28676 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:21:06 ctl02 nova-api[28676]: 2017-09-28 12:21:06.021 28676 ERROR nova Traceback (most recent call last):
Sep 28 12:21:06 ctl02 nova-api[28676]: 2017-09-28 12:21:06.021 28676 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:21:06 ctl02 nova-api[28676]: 2017-09-28 12:21:06.021 28676 ERROR nova     sys.exit(main())
Sep 28 12:21:06 ctl02 nova-api[28676]: 2017-09-28 12:21:06.021 28676 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:21:06 ctl02 nova-api[28676]: 2017-09-28 12:21:06.021 28676 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:21:06 ctl02 nova-api[28676]: 2017-09-28 12:21:06.021 28676 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:21:06 ctl02 nova-api[28676]: 2017-09-28 12:21:06.021 28676 ERROR nova     max_url_len=max_url_len)
Sep 28 12:21:06 ctl02 nova-api[28676]: 2017-09-28 12:21:06.021 28676 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:21:06 ctl02 nova-api[28676]: 2017-09-28 12:21:06.021 28676 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:21:06 ctl02 nova-api[28676]: 2017-09-28 12:21:06.021 28676 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:21:06 ctl02 nova-api[28676]: 2017-09-28 12:21:06.021 28676 ERROR nova     sock.listen(backlog)
Sep 28 12:21:06 ctl02 nova-api[28676]: 2017-09-28 12:21:06.021 28676 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:21:06 ctl02 nova-api[28676]: 2017-09-28 12:21:06.021 28676 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:21:06 ctl02 nova-api[28676]: 2017-09-28 12:21:06.021 28676 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:21:06 ctl02 nova-api[28676]: 2017-09-28 12:21:06.021 28676 ERROR nova
Sep 28 12:21:06 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:21:06 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:21:06 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:21:06 ctl02 heat-api[13008]: 2017-09-28 12:21:06.375 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:21:06] "OPTIONS / HTTP/1.0" 200 134 0.000703
Sep 28 12:21:06 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:21:06 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:21:06 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:21:06 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:21:06 ctl02 heat-api[13008]: 2017-09-28 12:21:06.734 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:21:06] "OPTIONS / HTTP/1.0" 200 134 0.000592
Sep 28 12:21:08 ctl02 nova-api[28693]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:21:08 ctl02 nova-api[28693]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:21:08 ctl02 nova-api[28693]: 2017-09-28 12:21:08.195 28693 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:21:08 ctl02 nova-api[28693]: 2017-09-28 12:21:08.197 28693 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:21:08 ctl02 nova-api[28693]: 2017-09-28 12:21:08.197 28693 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:21:08 ctl02 nova-api[28693]: 2017-09-28 12:21:08.197 28693 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:21:08 ctl02 nova-api[28693]: 2017-09-28 12:21:08.197 28693 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:21:08 ctl02 nova-api[28693]: 2017-09-28 12:21:08.197 28693 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:21:08 ctl02 nova-api[28693]: 2017-09-28 12:21:08.197 28693 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:21:08 ctl02 nova-api[28693]: 2017-09-28 12:21:08.197 28693 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:21:08 ctl02 nova-api[28693]: 2017-09-28 12:21:08.197 28693 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:21:08 ctl02 nova-api[28693]: 2017-09-28 12:21:08.197 28693 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:21:08 ctl02 nova-api[28693]: 2017-09-28 12:21:08.197 28693 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:21:08 ctl02 nova-api[28693]: 2017-09-28 12:21:08.197 28693 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:21:08 ctl02 nova-api[28693]: 2017-09-28 12:21:08.197 28693 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:21:08 ctl02 nova-api[28693]: 2017-09-28 12:21:08.197 28693 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:21:08 ctl02 nova-api[28693]: 2017-09-28 12:21:08.197 28693 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:21:08 ctl02 nova-api[28693]: 2017-09-28 12:21:08.197 28693 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:21:08 ctl02 nova-api[28693]: 2017-09-28 12:21:08.197 28693 ERROR nova.wsgi     self.filename))
Sep 28 12:21:08 ctl02 nova-api[28693]: 2017-09-28 12:21:08.197 28693 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:21:08 ctl02 nova-api[28693]: 2017-09-28 12:21:08.197 28693 ERROR nova.wsgi
Sep 28 12:21:08 ctl02 nova-api[28693]: 2017-09-28 12:21:08.199 28693 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:21:08 ctl02 nova-api[28693]: 2017-09-28 12:21:08.327 28693 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:21:08 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:21:08.355 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:21:08] "OPTIONS / HTTP/1.0" 200 134 0.000438
Sep 28 12:21:08 ctl02 nova-api[28693]: 2017-09-28 12:21:08.554 28693 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:21:08 ctl02 nova-api[28693]: 2017-09-28 12:21:08.556 28693 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:21:08 ctl02 nova-api[28693]: 2017-09-28 12:21:08.556 28693 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:21:08 ctl02 nova-api[28693]: 2017-09-28 12:21:08.557 28693 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:21:08 ctl02 nova-api[28693]: 2017-09-28 12:21:08.686 28693 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:21:08 ctl02 nova-api[28693]: 2017-09-28 12:21:08.688 28693 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:21:08 ctl02 nova-api[28693]: 2017-09-28 12:21:08.688 28693 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:21:08 ctl02 nova-api[28693]: 2017-09-28 12:21:08.689 28693 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:21:08 ctl02 nova-api[28693]: 2017-09-28 12:21:08.692 28693 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:21:08 ctl02 nova-api[28693]: 2017-09-28 12:21:08.692 28693 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:21:08 ctl02 nova-api[28693]: 2017-09-28 12:21:08.692 28693 ERROR nova Traceback (most recent call last):
Sep 28 12:21:08 ctl02 nova-api[28693]: 2017-09-28 12:21:08.692 28693 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:21:08 ctl02 nova-api[28693]: 2017-09-28 12:21:08.692 28693 ERROR nova     sys.exit(main())
Sep 28 12:21:08 ctl02 nova-api[28693]: 2017-09-28 12:21:08.692 28693 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:21:08 ctl02 nova-api[28693]: 2017-09-28 12:21:08.692 28693 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:21:08 ctl02 nova-api[28693]: 2017-09-28 12:21:08.692 28693 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:21:08 ctl02 nova-api[28693]: 2017-09-28 12:21:08.692 28693 ERROR nova     max_url_len=max_url_len)
Sep 28 12:21:08 ctl02 nova-api[28693]: 2017-09-28 12:21:08.692 28693 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:21:08 ctl02 nova-api[28693]: 2017-09-28 12:21:08.692 28693 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:21:08 ctl02 nova-api[28693]: 2017-09-28 12:21:08.692 28693 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:21:08 ctl02 nova-api[28693]: 2017-09-28 12:21:08.692 28693 ERROR nova     sock.listen(backlog)
Sep 28 12:21:08 ctl02 nova-api[28693]: 2017-09-28 12:21:08.692 28693 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:21:08 ctl02 nova-api[28693]: 2017-09-28 12:21:08.692 28693 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:21:08 ctl02 nova-api[28693]: 2017-09-28 12:21:08.692 28693 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:21:08 ctl02 nova-api[28693]: 2017-09-28 12:21:08.692 28693 ERROR nova
Sep 28 12:21:08 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:21:08 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:21:08 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:21:09 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:21:09 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:21:09 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:21:09 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:21:09 ctl02 heat-api-cfn[13300]: 2017-09-28 12:21:09.783 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:21:09] "OPTIONS / HTTP/1.0" 200 134 0.000487
Sep 28 12:21:09 ctl02 heat-api[13008]: 2017-09-28 12:21:09.804 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:21:09] "OPTIONS / HTTP/1.0" 200 134 0.000531
Sep 28 12:21:10 ctl02 heat-api-cfn[13300]: 2017-09-28 12:21:10.070 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:21:10] "OPTIONS / HTTP/1.0" 200 134 0.000307
Sep 28 12:21:10 ctl02 glance-api[29183]: 2017-09-28 12:21:10.227 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:21:10] "OPTIONS / HTTP/1.0" 200 134 0.000584
Sep 28 12:21:10 ctl02 heat-api-cfn[13300]: 2017-09-28 12:21:10.318 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:21:10] "OPTIONS / HTTP/1.0" 200 134 0.000570
Sep 28 12:21:10 ctl02 nova-api[28713]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:21:10 ctl02 nova-api[28713]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:21:10 ctl02 nova-api[28713]: 2017-09-28 12:21:10.970 28713 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:21:10 ctl02 nova-api[28713]: 2017-09-28 12:21:10.972 28713 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:21:10 ctl02 nova-api[28713]: 2017-09-28 12:21:10.972 28713 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:21:10 ctl02 nova-api[28713]: 2017-09-28 12:21:10.972 28713 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:21:10 ctl02 nova-api[28713]: 2017-09-28 12:21:10.972 28713 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:21:10 ctl02 nova-api[28713]: 2017-09-28 12:21:10.972 28713 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:21:10 ctl02 nova-api[28713]: 2017-09-28 12:21:10.972 28713 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:21:10 ctl02 nova-api[28713]: 2017-09-28 12:21:10.972 28713 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:21:10 ctl02 nova-api[28713]: 2017-09-28 12:21:10.972 28713 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:21:10 ctl02 nova-api[28713]: 2017-09-28 12:21:10.972 28713 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:21:10 ctl02 nova-api[28713]: 2017-09-28 12:21:10.972 28713 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:21:10 ctl02 nova-api[28713]: 2017-09-28 12:21:10.972 28713 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:21:10 ctl02 nova-api[28713]: 2017-09-28 12:21:10.972 28713 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:21:10 ctl02 nova-api[28713]: 2017-09-28 12:21:10.972 28713 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:21:10 ctl02 nova-api[28713]: 2017-09-28 12:21:10.972 28713 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:21:10 ctl02 nova-api[28713]: 2017-09-28 12:21:10.972 28713 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:21:10 ctl02 nova-api[28713]: 2017-09-28 12:21:10.972 28713 ERROR nova.wsgi     self.filename))
Sep 28 12:21:10 ctl02 nova-api[28713]: 2017-09-28 12:21:10.972 28713 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:21:10 ctl02 nova-api[28713]: 2017-09-28 12:21:10.972 28713 ERROR nova.wsgi
Sep 28 12:21:10 ctl02 nova-api[28713]: 2017-09-28 12:21:10.973 28713 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:21:11 ctl02 nova-api[28713]: 2017-09-28 12:21:11.105 28713 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:21:11 ctl02 nova-api[28713]: 2017-09-28 12:21:11.349 28713 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:21:11 ctl02 nova-api[28713]: 2017-09-28 12:21:11.351 28713 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:21:11 ctl02 nova-api[28713]: 2017-09-28 12:21:11.351 28713 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:21:11 ctl02 nova-api[28713]: 2017-09-28 12:21:11.352 28713 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:21:11 ctl02 nova-api[28713]: 2017-09-28 12:21:11.488 28713 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:21:11 ctl02 nova-api[28713]: 2017-09-28 12:21:11.490 28713 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:21:11 ctl02 nova-api[28713]: 2017-09-28 12:21:11.490 28713 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:21:11 ctl02 nova-api[28713]: 2017-09-28 12:21:11.490 28713 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:21:11 ctl02 nova-api[28713]: 2017-09-28 12:21:11.493 28713 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:21:11 ctl02 nova-api[28713]: 2017-09-28 12:21:11.494 28713 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:21:11 ctl02 nova-api[28713]: 2017-09-28 12:21:11.494 28713 ERROR nova Traceback (most recent call last):
Sep 28 12:21:11 ctl02 nova-api[28713]: 2017-09-28 12:21:11.494 28713 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:21:11 ctl02 nova-api[28713]: 2017-09-28 12:21:11.494 28713 ERROR nova     sys.exit(main())
Sep 28 12:21:11 ctl02 nova-api[28713]: 2017-09-28 12:21:11.494 28713 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:21:11 ctl02 nova-api[28713]: 2017-09-28 12:21:11.494 28713 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:21:11 ctl02 nova-api[28713]: 2017-09-28 12:21:11.494 28713 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:21:11 ctl02 nova-api[28713]: 2017-09-28 12:21:11.494 28713 ERROR nova     max_url_len=max_url_len)
Sep 28 12:21:11 ctl02 nova-api[28713]: 2017-09-28 12:21:11.494 28713 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:21:11 ctl02 nova-api[28713]: 2017-09-28 12:21:11.494 28713 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:21:11 ctl02 nova-api[28713]: 2017-09-28 12:21:11.494 28713 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:21:11 ctl02 nova-api[28713]: 2017-09-28 12:21:11.494 28713 ERROR nova     sock.listen(backlog)
Sep 28 12:21:11 ctl02 nova-api[28713]: 2017-09-28 12:21:11.494 28713 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:21:11 ctl02 nova-api[28713]: 2017-09-28 12:21:11.494 28713 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:21:11 ctl02 nova-api[28713]: 2017-09-28 12:21:11.494 28713 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:21:11 ctl02 nova-api[28713]: 2017-09-28 12:21:11.494 28713 ERROR nova
Sep 28 12:21:11 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:21:11 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:21:11 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:21:11 ctl02 glance-api[29183]: 2017-09-28 12:21:11.738 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:21:11] "OPTIONS / HTTP/1.0" 200 134 0.000644
Sep 28 12:21:11 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:21:11 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:21:11 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:21:11 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:21:12 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:21:12.798 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:21:12] "OPTIONS / HTTP/1.0" 200 134 0.000481
Sep 28 12:21:13 ctl02 nova-api[28731]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:21:13 ctl02 nova-api[28731]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:21:13 ctl02 nova-api[28731]: 2017-09-28 12:21:13.736 28731 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:21:13 ctl02 nova-api[28731]: 2017-09-28 12:21:13.738 28731 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:21:13 ctl02 nova-api[28731]: 2017-09-28 12:21:13.738 28731 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:21:13 ctl02 nova-api[28731]: 2017-09-28 12:21:13.738 28731 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:21:13 ctl02 nova-api[28731]: 2017-09-28 12:21:13.738 28731 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:21:13 ctl02 nova-api[28731]: 2017-09-28 12:21:13.738 28731 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:21:13 ctl02 nova-api[28731]: 2017-09-28 12:21:13.738 28731 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:21:13 ctl02 nova-api[28731]: 2017-09-28 12:21:13.738 28731 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:21:13 ctl02 nova-api[28731]: 2017-09-28 12:21:13.738 28731 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:21:13 ctl02 nova-api[28731]: 2017-09-28 12:21:13.738 28731 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:21:13 ctl02 nova-api[28731]: 2017-09-28 12:21:13.738 28731 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:21:13 ctl02 nova-api[28731]: 2017-09-28 12:21:13.738 28731 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:21:13 ctl02 nova-api[28731]: 2017-09-28 12:21:13.738 28731 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:21:13 ctl02 nova-api[28731]: 2017-09-28 12:21:13.738 28731 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:21:13 ctl02 nova-api[28731]: 2017-09-28 12:21:13.738 28731 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:21:13 ctl02 nova-api[28731]: 2017-09-28 12:21:13.738 28731 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:21:13 ctl02 nova-api[28731]: 2017-09-28 12:21:13.738 28731 ERROR nova.wsgi     self.filename))
Sep 28 12:21:13 ctl02 nova-api[28731]: 2017-09-28 12:21:13.738 28731 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:21:13 ctl02 nova-api[28731]: 2017-09-28 12:21:13.738 28731 ERROR nova.wsgi
Sep 28 12:21:13 ctl02 nova-api[28731]: 2017-09-28 12:21:13.738 28731 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:21:13 ctl02 nova-api[28731]: 2017-09-28 12:21:13.871 28731 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:21:13 ctl02 glance-api[29183]: 2017-09-28 12:21:13.940 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:21:13] "OPTIONS / HTTP/1.0" 200 134 0.000692
Sep 28 12:21:13 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xebda7065)
Sep 28 12:21:14 ctl02 nova-api[28731]: 2017-09-28 12:21:14.123 28731 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:21:14 ctl02 nova-api[28731]: 2017-09-28 12:21:14.126 28731 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:21:14 ctl02 nova-api[28731]: 2017-09-28 12:21:14.126 28731 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:21:14 ctl02 nova-api[28731]: 2017-09-28 12:21:14.126 28731 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:21:14 ctl02 nova-api[28731]: 2017-09-28 12:21:14.258 28731 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:21:14 ctl02 nova-api[28731]: 2017-09-28 12:21:14.260 28731 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:21:14 ctl02 nova-api[28731]: 2017-09-28 12:21:14.261 28731 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:21:14 ctl02 nova-api[28731]: 2017-09-28 12:21:14.261 28731 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:21:14 ctl02 nova-api[28731]: 2017-09-28 12:21:14.264 28731 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:21:14 ctl02 nova-api[28731]: 2017-09-28 12:21:14.265 28731 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:21:14 ctl02 nova-api[28731]: 2017-09-28 12:21:14.265 28731 ERROR nova Traceback (most recent call last):
Sep 28 12:21:14 ctl02 nova-api[28731]: 2017-09-28 12:21:14.265 28731 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:21:14 ctl02 nova-api[28731]: 2017-09-28 12:21:14.265 28731 ERROR nova     sys.exit(main())
Sep 28 12:21:14 ctl02 nova-api[28731]: 2017-09-28 12:21:14.265 28731 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:21:14 ctl02 nova-api[28731]: 2017-09-28 12:21:14.265 28731 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:21:14 ctl02 nova-api[28731]: 2017-09-28 12:21:14.265 28731 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:21:14 ctl02 nova-api[28731]: 2017-09-28 12:21:14.265 28731 ERROR nova     max_url_len=max_url_len)
Sep 28 12:21:14 ctl02 nova-api[28731]: 2017-09-28 12:21:14.265 28731 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:21:14 ctl02 nova-api[28731]: 2017-09-28 12:21:14.265 28731 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:21:14 ctl02 nova-api[28731]: 2017-09-28 12:21:14.265 28731 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:21:14 ctl02 nova-api[28731]: 2017-09-28 12:21:14.265 28731 ERROR nova     sock.listen(backlog)
Sep 28 12:21:14 ctl02 nova-api[28731]: 2017-09-28 12:21:14.265 28731 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:21:14 ctl02 nova-api[28731]: 2017-09-28 12:21:14.265 28731 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:21:14 ctl02 nova-api[28731]: 2017-09-28 12:21:14.265 28731 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:21:14 ctl02 nova-api[28731]: 2017-09-28 12:21:14.265 28731 ERROR nova
Sep 28 12:21:14 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:21:14 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:21:14 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:21:14 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:21:14 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:21:14 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:21:14 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:21:14 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xebda7065)
Sep 28 12:21:15 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:21:15.349 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:21:15] "OPTIONS / HTTP/1.0" 200 134 0.000475
Sep 28 12:21:16 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xebda7065)
Sep 28 12:21:16 ctl02 nova-api[28749]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:21:16 ctl02 nova-api[28749]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:21:16 ctl02 nova-api[28749]: 2017-09-28 12:21:16.503 28749 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:21:16 ctl02 nova-api[28749]: 2017-09-28 12:21:16.505 28749 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:21:16 ctl02 nova-api[28749]: 2017-09-28 12:21:16.505 28749 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:21:16 ctl02 nova-api[28749]: 2017-09-28 12:21:16.505 28749 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:21:16 ctl02 nova-api[28749]: 2017-09-28 12:21:16.505 28749 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:21:16 ctl02 nova-api[28749]: 2017-09-28 12:21:16.505 28749 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:21:16 ctl02 nova-api[28749]: 2017-09-28 12:21:16.505 28749 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:21:16 ctl02 nova-api[28749]: 2017-09-28 12:21:16.505 28749 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:21:16 ctl02 nova-api[28749]: 2017-09-28 12:21:16.505 28749 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:21:16 ctl02 nova-api[28749]: 2017-09-28 12:21:16.505 28749 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:21:16 ctl02 nova-api[28749]: 2017-09-28 12:21:16.505 28749 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:21:16 ctl02 nova-api[28749]: 2017-09-28 12:21:16.505 28749 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:21:16 ctl02 nova-api[28749]: 2017-09-28 12:21:16.505 28749 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:21:16 ctl02 nova-api[28749]: 2017-09-28 12:21:16.505 28749 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:21:16 ctl02 nova-api[28749]: 2017-09-28 12:21:16.505 28749 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:21:16 ctl02 nova-api[28749]: 2017-09-28 12:21:16.505 28749 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:21:16 ctl02 nova-api[28749]: 2017-09-28 12:21:16.505 28749 ERROR nova.wsgi     self.filename))
Sep 28 12:21:16 ctl02 nova-api[28749]: 2017-09-28 12:21:16.505 28749 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:21:16 ctl02 nova-api[28749]: 2017-09-28 12:21:16.505 28749 ERROR nova.wsgi
Sep 28 12:21:16 ctl02 nova-api[28749]: 2017-09-28 12:21:16.508 28749 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:21:16 ctl02 nova-api[28749]: 2017-09-28 12:21:16.646 28749 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:21:16 ctl02 heat-api[13008]: 2017-09-28 12:21:16.697 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:21:16] "OPTIONS / HTTP/1.0" 200 134 0.000886
Sep 28 12:21:16 ctl02 nova-api[28749]: 2017-09-28 12:21:16.899 28749 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:21:16 ctl02 nova-api[28749]: 2017-09-28 12:21:16.901 28749 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:21:16 ctl02 nova-api[28749]: 2017-09-28 12:21:16.902 28749 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:21:16 ctl02 nova-api[28749]: 2017-09-28 12:21:16.902 28749 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:21:17 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xebda7065)
Sep 28 12:21:17 ctl02 heat-api[13008]: 2017-09-28 12:21:17.020 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:21:17] "OPTIONS / HTTP/1.0" 200 134 0.000650
Sep 28 12:21:17 ctl02 nova-api[28749]: 2017-09-28 12:21:17.038 28749 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:21:17 ctl02 nova-api[28749]: 2017-09-28 12:21:17.040 28749 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:21:17 ctl02 nova-api[28749]: 2017-09-28 12:21:17.040 28749 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:21:17 ctl02 nova-api[28749]: 2017-09-28 12:21:17.041 28749 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:21:17 ctl02 nova-api[28749]: 2017-09-28 12:21:17.045 28749 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:21:17 ctl02 nova-api[28749]: 2017-09-28 12:21:17.045 28749 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:21:17 ctl02 nova-api[28749]: 2017-09-28 12:21:17.045 28749 ERROR nova Traceback (most recent call last):
Sep 28 12:21:17 ctl02 nova-api[28749]: 2017-09-28 12:21:17.045 28749 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:21:17 ctl02 nova-api[28749]: 2017-09-28 12:21:17.045 28749 ERROR nova     sys.exit(main())
Sep 28 12:21:17 ctl02 nova-api[28749]: 2017-09-28 12:21:17.045 28749 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:21:17 ctl02 nova-api[28749]: 2017-09-28 12:21:17.045 28749 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:21:17 ctl02 nova-api[28749]: 2017-09-28 12:21:17.045 28749 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:21:17 ctl02 nova-api[28749]: 2017-09-28 12:21:17.045 28749 ERROR nova     max_url_len=max_url_len)
Sep 28 12:21:17 ctl02 nova-api[28749]: 2017-09-28 12:21:17.045 28749 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:21:17 ctl02 nova-api[28749]: 2017-09-28 12:21:17.045 28749 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:21:17 ctl02 nova-api[28749]: 2017-09-28 12:21:17.045 28749 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:21:17 ctl02 nova-api[28749]: 2017-09-28 12:21:17.045 28749 ERROR nova     sock.listen(backlog)
Sep 28 12:21:17 ctl02 nova-api[28749]: 2017-09-28 12:21:17.045 28749 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:21:17 ctl02 nova-api[28749]: 2017-09-28 12:21:17.045 28749 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:21:17 ctl02 nova-api[28749]: 2017-09-28 12:21:17.045 28749 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:21:17 ctl02 nova-api[28749]: 2017-09-28 12:21:17.045 28749 ERROR nova
Sep 28 12:21:17 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:21:17 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:21:17 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:21:17 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:21:17 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:21:17 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:21:17 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:21:18 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xebda7065)
Sep 28 12:21:18 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:21:18.289 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:21:18] "OPTIONS / HTTP/1.0" 200 134 0.000509
Sep 28 12:21:19 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xebda7065)
Sep 28 12:21:19 ctl02 nova-api[28767]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:21:19 ctl02 nova-api[28767]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:21:19 ctl02 nova-api[28767]: 2017-09-28 12:21:19.246 28767 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:21:19 ctl02 nova-api[28767]: 2017-09-28 12:21:19.248 28767 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:21:19 ctl02 nova-api[28767]: 2017-09-28 12:21:19.248 28767 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:21:19 ctl02 nova-api[28767]: 2017-09-28 12:21:19.248 28767 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:21:19 ctl02 nova-api[28767]: 2017-09-28 12:21:19.248 28767 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:21:19 ctl02 nova-api[28767]: 2017-09-28 12:21:19.248 28767 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:21:19 ctl02 nova-api[28767]: 2017-09-28 12:21:19.248 28767 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:21:19 ctl02 nova-api[28767]: 2017-09-28 12:21:19.248 28767 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:21:19 ctl02 nova-api[28767]: 2017-09-28 12:21:19.248 28767 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:21:19 ctl02 nova-api[28767]: 2017-09-28 12:21:19.248 28767 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:21:19 ctl02 nova-api[28767]: 2017-09-28 12:21:19.248 28767 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:21:19 ctl02 nova-api[28767]: 2017-09-28 12:21:19.248 28767 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:21:19 ctl02 nova-api[28767]: 2017-09-28 12:21:19.248 28767 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:21:19 ctl02 nova-api[28767]: 2017-09-28 12:21:19.248 28767 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:21:19 ctl02 nova-api[28767]: 2017-09-28 12:21:19.248 28767 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:21:19 ctl02 nova-api[28767]: 2017-09-28 12:21:19.248 28767 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:21:19 ctl02 nova-api[28767]: 2017-09-28 12:21:19.248 28767 ERROR nova.wsgi     self.filename))
Sep 28 12:21:19 ctl02 nova-api[28767]: 2017-09-28 12:21:19.248 28767 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:21:19 ctl02 nova-api[28767]: 2017-09-28 12:21:19.248 28767 ERROR nova.wsgi
Sep 28 12:21:19 ctl02 nova-api[28767]: 2017-09-28 12:21:19.251 28767 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:21:19 ctl02 nova-api[28767]: 2017-09-28 12:21:19.384 28767 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:21:19 ctl02 nova-api[28767]: 2017-09-28 12:21:19.639 28767 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:21:19 ctl02 nova-api[28767]: 2017-09-28 12:21:19.641 28767 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:21:19 ctl02 nova-api[28767]: 2017-09-28 12:21:19.642 28767 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:21:19 ctl02 nova-api[28767]: 2017-09-28 12:21:19.642 28767 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:21:19 ctl02 nova-api[28767]: 2017-09-28 12:21:19.775 28767 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:21:19 ctl02 nova-api[28767]: 2017-09-28 12:21:19.778 28767 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:21:19 ctl02 nova-api[28767]: 2017-09-28 12:21:19.779 28767 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:21:19 ctl02 nova-api[28767]: 2017-09-28 12:21:19.779 28767 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:21:19 ctl02 nova-api[28767]: 2017-09-28 12:21:19.783 28767 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:21:19 ctl02 nova-api[28767]: 2017-09-28 12:21:19.783 28767 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:21:19 ctl02 nova-api[28767]: 2017-09-28 12:21:19.783 28767 ERROR nova Traceback (most recent call last):
Sep 28 12:21:19 ctl02 nova-api[28767]: 2017-09-28 12:21:19.783 28767 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:21:19 ctl02 nova-api[28767]: 2017-09-28 12:21:19.783 28767 ERROR nova     sys.exit(main())
Sep 28 12:21:19 ctl02 nova-api[28767]: 2017-09-28 12:21:19.783 28767 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:21:19 ctl02 nova-api[28767]: 2017-09-28 12:21:19.783 28767 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:21:19 ctl02 nova-api[28767]: 2017-09-28 12:21:19.783 28767 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:21:19 ctl02 nova-api[28767]: 2017-09-28 12:21:19.783 28767 ERROR nova     max_url_len=max_url_len)
Sep 28 12:21:19 ctl02 nova-api[28767]: 2017-09-28 12:21:19.783 28767 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:21:19 ctl02 nova-api[28767]: 2017-09-28 12:21:19.783 28767 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:21:19 ctl02 nova-api[28767]: 2017-09-28 12:21:19.783 28767 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:21:19 ctl02 nova-api[28767]: 2017-09-28 12:21:19.783 28767 ERROR nova     sock.listen(backlog)
Sep 28 12:21:19 ctl02 nova-api[28767]: 2017-09-28 12:21:19.783 28767 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:21:19 ctl02 nova-api[28767]: 2017-09-28 12:21:19.783 28767 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:21:19 ctl02 nova-api[28767]: 2017-09-28 12:21:19.783 28767 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:21:19 ctl02 nova-api[28767]: 2017-09-28 12:21:19.783 28767 ERROR nova
Sep 28 12:21:19 ctl02 heat-api-cfn[13300]: 2017-09-28 12:21:19.835 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:21:19] "OPTIONS / HTTP/1.0" 200 134 0.000511
Sep 28 12:21:19 ctl02 heat-api[13008]: 2017-09-28 12:21:19.886 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:21:19] "OPTIONS / HTTP/1.0" 200 134 0.000693
Sep 28 12:21:19 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:21:19 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:21:19 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:21:20 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xebda7065)
Sep 28 12:21:20 ctl02 heat-api-cfn[13300]: 2017-09-28 12:21:20.100 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:21:20] "OPTIONS / HTTP/1.0" 200 134 0.000553
Sep 28 12:21:20 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:21:20 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:21:20 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:21:20 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:21:20 ctl02 heat-api-cfn[13300]: 2017-09-28 12:21:20.239 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:21:20] "OPTIONS / HTTP/1.0" 200 134 0.000549
Sep 28 12:21:20 ctl02 glance-api[29183]: 2017-09-28 12:21:20.432 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:21:20] "OPTIONS / HTTP/1.0" 200 134 0.000637
Sep 28 12:21:21 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xebda7065)
Sep 28 12:21:21 ctl02 glance-api[29183]: 2017-09-28 12:21:21.791 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:21:21] "OPTIONS / HTTP/1.0" 200 134 0.000807
Sep 28 12:21:21 ctl02 nova-api[28785]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:21:21 ctl02 nova-api[28785]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:21:22 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xebda7065)
Sep 28 12:21:22 ctl02 nova-api[28785]: 2017-09-28 12:21:22.014 28785 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:21:22 ctl02 nova-api[28785]: 2017-09-28 12:21:22.016 28785 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:21:22 ctl02 nova-api[28785]: 2017-09-28 12:21:22.016 28785 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:21:22 ctl02 nova-api[28785]: 2017-09-28 12:21:22.016 28785 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:21:22 ctl02 nova-api[28785]: 2017-09-28 12:21:22.016 28785 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:21:22 ctl02 nova-api[28785]: 2017-09-28 12:21:22.016 28785 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:21:22 ctl02 nova-api[28785]: 2017-09-28 12:21:22.016 28785 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:21:22 ctl02 nova-api[28785]: 2017-09-28 12:21:22.016 28785 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:21:22 ctl02 nova-api[28785]: 2017-09-28 12:21:22.016 28785 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:21:22 ctl02 nova-api[28785]: 2017-09-28 12:21:22.016 28785 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:21:22 ctl02 nova-api[28785]: 2017-09-28 12:21:22.016 28785 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:21:22 ctl02 nova-api[28785]: 2017-09-28 12:21:22.016 28785 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:21:22 ctl02 nova-api[28785]: 2017-09-28 12:21:22.016 28785 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:21:22 ctl02 nova-api[28785]: 2017-09-28 12:21:22.016 28785 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:21:22 ctl02 nova-api[28785]: 2017-09-28 12:21:22.016 28785 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:21:22 ctl02 nova-api[28785]: 2017-09-28 12:21:22.016 28785 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:21:22 ctl02 nova-api[28785]: 2017-09-28 12:21:22.016 28785 ERROR nova.wsgi     self.filename))
Sep 28 12:21:22 ctl02 nova-api[28785]: 2017-09-28 12:21:22.016 28785 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:21:22 ctl02 nova-api[28785]: 2017-09-28 12:21:22.016 28785 ERROR nova.wsgi
Sep 28 12:21:22 ctl02 nova-api[28785]: 2017-09-28 12:21:22.018 28785 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:21:22 ctl02 nova-api[28785]: 2017-09-28 12:21:22.154 28785 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:21:22 ctl02 nova-api[28785]: 2017-09-28 12:21:22.404 28785 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:21:22 ctl02 nova-api[28785]: 2017-09-28 12:21:22.406 28785 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:21:22 ctl02 nova-api[28785]: 2017-09-28 12:21:22.406 28785 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:21:22 ctl02 nova-api[28785]: 2017-09-28 12:21:22.406 28785 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:21:22 ctl02 nova-api[28785]: 2017-09-28 12:21:22.538 28785 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:21:22 ctl02 nova-api[28785]: 2017-09-28 12:21:22.539 28785 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:21:22 ctl02 nova-api[28785]: 2017-09-28 12:21:22.540 28785 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:21:22 ctl02 nova-api[28785]: 2017-09-28 12:21:22.540 28785 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:21:22 ctl02 nova-api[28785]: 2017-09-28 12:21:22.543 28785 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:21:22 ctl02 nova-api[28785]: 2017-09-28 12:21:22.543 28785 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:21:22 ctl02 nova-api[28785]: 2017-09-28 12:21:22.543 28785 ERROR nova Traceback (most recent call last):
Sep 28 12:21:22 ctl02 nova-api[28785]: 2017-09-28 12:21:22.543 28785 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:21:22 ctl02 nova-api[28785]: 2017-09-28 12:21:22.543 28785 ERROR nova     sys.exit(main())
Sep 28 12:21:22 ctl02 nova-api[28785]: 2017-09-28 12:21:22.543 28785 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:21:22 ctl02 nova-api[28785]: 2017-09-28 12:21:22.543 28785 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:21:22 ctl02 nova-api[28785]: 2017-09-28 12:21:22.543 28785 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:21:22 ctl02 nova-api[28785]: 2017-09-28 12:21:22.543 28785 ERROR nova     max_url_len=max_url_len)
Sep 28 12:21:22 ctl02 nova-api[28785]: 2017-09-28 12:21:22.543 28785 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:21:22 ctl02 nova-api[28785]: 2017-09-28 12:21:22.543 28785 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:21:22 ctl02 nova-api[28785]: 2017-09-28 12:21:22.543 28785 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:21:22 ctl02 nova-api[28785]: 2017-09-28 12:21:22.543 28785 ERROR nova     sock.listen(backlog)
Sep 28 12:21:22 ctl02 nova-api[28785]: 2017-09-28 12:21:22.543 28785 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:21:22 ctl02 nova-api[28785]: 2017-09-28 12:21:22.543 28785 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:21:22 ctl02 nova-api[28785]: 2017-09-28 12:21:22.543 28785 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:21:22 ctl02 nova-api[28785]: 2017-09-28 12:21:22.543 28785 ERROR nova
Sep 28 12:21:22 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:21:22 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:21:22 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:21:22 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:21:22 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:21:22 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:21:22 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:21:23 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xebda7065)
Sep 28 12:21:23 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:21:23.098 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:21:23] "OPTIONS / HTTP/1.0" 200 134 0.000844
Sep 28 12:21:23 ctl02 glance-api[29183]: 2017-09-28 12:21:23.915 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:21:23] "OPTIONS / HTTP/1.0" 200 134 0.000703
Sep 28 12:21:24 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:21:24 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:21:24 ctl02 nova-api[28803]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:21:24 ctl02 nova-api[28803]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:21:24 ctl02 nova-api[28803]: 2017-09-28 12:21:24.755 28803 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:21:24 ctl02 nova-api[28803]: 2017-09-28 12:21:24.757 28803 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:21:24 ctl02 nova-api[28803]: 2017-09-28 12:21:24.757 28803 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:21:24 ctl02 nova-api[28803]: 2017-09-28 12:21:24.757 28803 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:21:24 ctl02 nova-api[28803]: 2017-09-28 12:21:24.757 28803 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:21:24 ctl02 nova-api[28803]: 2017-09-28 12:21:24.757 28803 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:21:24 ctl02 nova-api[28803]: 2017-09-28 12:21:24.757 28803 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:21:24 ctl02 nova-api[28803]: 2017-09-28 12:21:24.757 28803 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:21:24 ctl02 nova-api[28803]: 2017-09-28 12:21:24.757 28803 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:21:24 ctl02 nova-api[28803]: 2017-09-28 12:21:24.757 28803 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:21:24 ctl02 nova-api[28803]: 2017-09-28 12:21:24.757 28803 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:21:24 ctl02 nova-api[28803]: 2017-09-28 12:21:24.757 28803 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:21:24 ctl02 nova-api[28803]: 2017-09-28 12:21:24.757 28803 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:21:24 ctl02 nova-api[28803]: 2017-09-28 12:21:24.757 28803 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:21:24 ctl02 nova-api[28803]: 2017-09-28 12:21:24.757 28803 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:21:24 ctl02 nova-api[28803]: 2017-09-28 12:21:24.757 28803 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:21:24 ctl02 nova-api[28803]: 2017-09-28 12:21:24.757 28803 ERROR nova.wsgi     self.filename))
Sep 28 12:21:24 ctl02 nova-api[28803]: 2017-09-28 12:21:24.757 28803 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:21:24 ctl02 nova-api[28803]: 2017-09-28 12:21:24.757 28803 ERROR nova.wsgi
Sep 28 12:21:24 ctl02 nova-api[28803]: 2017-09-28 12:21:24.758 28803 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:21:24 ctl02 nova-api[28803]: 2017-09-28 12:21:24.887 28803 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:21:24 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:21:24.988 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:21:24] "OPTIONS / HTTP/1.0" 200 134 0.000440
Sep 28 12:21:25 ctl02 nova-api[28803]: 2017-09-28 12:21:25.116 28803 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:21:25 ctl02 nova-api[28803]: 2017-09-28 12:21:25.118 28803 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:21:25 ctl02 nova-api[28803]: 2017-09-28 12:21:25.118 28803 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:21:25 ctl02 nova-api[28803]: 2017-09-28 12:21:25.118 28803 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:21:25 ctl02 nova-cert[4860]: 2017-09-28 12:21:25.153 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:21:25 ctl02 nova-api[28803]: 2017-09-28 12:21:25.250 28803 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:21:25 ctl02 nova-api[28803]: 2017-09-28 12:21:25.252 28803 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:21:25 ctl02 nova-api[28803]: 2017-09-28 12:21:25.252 28803 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:21:25 ctl02 nova-api[28803]: 2017-09-28 12:21:25.252 28803 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:21:25 ctl02 nova-api[28803]: 2017-09-28 12:21:25.255 28803 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:21:25 ctl02 nova-api[28803]: 2017-09-28 12:21:25.256 28803 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:21:25 ctl02 nova-api[28803]: 2017-09-28 12:21:25.256 28803 ERROR nova Traceback (most recent call last):
Sep 28 12:21:25 ctl02 nova-api[28803]: 2017-09-28 12:21:25.256 28803 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:21:25 ctl02 nova-api[28803]: 2017-09-28 12:21:25.256 28803 ERROR nova     sys.exit(main())
Sep 28 12:21:25 ctl02 nova-api[28803]: 2017-09-28 12:21:25.256 28803 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:21:25 ctl02 nova-api[28803]: 2017-09-28 12:21:25.256 28803 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:21:25 ctl02 nova-api[28803]: 2017-09-28 12:21:25.256 28803 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:21:25 ctl02 nova-api[28803]: 2017-09-28 12:21:25.256 28803 ERROR nova     max_url_len=max_url_len)
Sep 28 12:21:25 ctl02 nova-api[28803]: 2017-09-28 12:21:25.256 28803 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:21:25 ctl02 nova-api[28803]: 2017-09-28 12:21:25.256 28803 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:21:25 ctl02 nova-api[28803]: 2017-09-28 12:21:25.256 28803 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:21:25 ctl02 nova-api[28803]: 2017-09-28 12:21:25.256 28803 ERROR nova     sock.listen(backlog)
Sep 28 12:21:25 ctl02 nova-api[28803]: 2017-09-28 12:21:25.256 28803 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:21:25 ctl02 nova-api[28803]: 2017-09-28 12:21:25.256 28803 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:21:25 ctl02 nova-api[28803]: 2017-09-28 12:21:25.256 28803 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:21:25 ctl02 nova-api[28803]: 2017-09-28 12:21:25.256 28803 ERROR nova
Sep 28 12:21:25 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:21:25 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:21:25 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:21:25 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:21:25 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:21:25 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:21:25 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:21:26 ctl02 heat-api[13008]: 2017-09-28 12:21:26.406 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:21:26] "OPTIONS / HTTP/1.0" 200 134 0.000539
Sep 28 12:21:26 ctl02 nova-conductor[5056]: 2017-09-28 12:21:26.590 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:21:26 ctl02 nova-conductor[5056]: 2017-09-28 12:21:26.609 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:21:26 ctl02 nova-conductor[5056]: 2017-09-28 12:21:26.623 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:21:26 ctl02 nova-conductor[5056]: 2017-09-28 12:21:26.628 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:21:26 ctl02 heat-api[13008]: 2017-09-28 12:21:26.641 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:21:26] "OPTIONS / HTTP/1.0" 200 134 0.000530
Sep 28 12:21:27 ctl02 nova-api[28826]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:21:27 ctl02 nova-api[28826]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:21:27 ctl02 nova-api[28826]: 2017-09-28 12:21:27.466 28826 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:21:27 ctl02 nova-api[28826]: 2017-09-28 12:21:27.468 28826 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:21:27 ctl02 nova-api[28826]: 2017-09-28 12:21:27.468 28826 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:21:27 ctl02 nova-api[28826]: 2017-09-28 12:21:27.468 28826 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:21:27 ctl02 nova-api[28826]: 2017-09-28 12:21:27.468 28826 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:21:27 ctl02 nova-api[28826]: 2017-09-28 12:21:27.468 28826 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:21:27 ctl02 nova-api[28826]: 2017-09-28 12:21:27.468 28826 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:21:27 ctl02 nova-api[28826]: 2017-09-28 12:21:27.468 28826 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:21:27 ctl02 nova-api[28826]: 2017-09-28 12:21:27.468 28826 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:21:27 ctl02 nova-api[28826]: 2017-09-28 12:21:27.468 28826 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:21:27 ctl02 nova-api[28826]: 2017-09-28 12:21:27.468 28826 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:21:27 ctl02 nova-api[28826]: 2017-09-28 12:21:27.468 28826 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:21:27 ctl02 nova-api[28826]: 2017-09-28 12:21:27.468 28826 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:21:27 ctl02 nova-api[28826]: 2017-09-28 12:21:27.468 28826 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:21:27 ctl02 nova-api[28826]: 2017-09-28 12:21:27.468 28826 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:21:27 ctl02 nova-api[28826]: 2017-09-28 12:21:27.468 28826 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:21:27 ctl02 nova-api[28826]: 2017-09-28 12:21:27.468 28826 ERROR nova.wsgi     self.filename))
Sep 28 12:21:27 ctl02 nova-api[28826]: 2017-09-28 12:21:27.468 28826 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:21:27 ctl02 nova-api[28826]: 2017-09-28 12:21:27.468 28826 ERROR nova.wsgi
Sep 28 12:21:27 ctl02 nova-api[28826]: 2017-09-28 12:21:27.469 28826 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:21:27 ctl02 nova-api[28826]: 2017-09-28 12:21:27.596 28826 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:21:27 ctl02 nova-api[28826]: 2017-09-28 12:21:27.824 28826 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:21:27 ctl02 nova-api[28826]: 2017-09-28 12:21:27.826 28826 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:21:27 ctl02 nova-api[28826]: 2017-09-28 12:21:27.827 28826 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:21:27 ctl02 nova-api[28826]: 2017-09-28 12:21:27.827 28826 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:21:27 ctl02 nova-api[28826]: 2017-09-28 12:21:27.957 28826 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:21:27 ctl02 nova-api[28826]: 2017-09-28 12:21:27.959 28826 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:21:27 ctl02 nova-api[28826]: 2017-09-28 12:21:27.959 28826 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:21:27 ctl02 nova-api[28826]: 2017-09-28 12:21:27.960 28826 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:21:27 ctl02 nova-api[28826]: 2017-09-28 12:21:27.963 28826 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:21:27 ctl02 nova-api[28826]: 2017-09-28 12:21:27.963 28826 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:21:27 ctl02 nova-api[28826]: 2017-09-28 12:21:27.963 28826 ERROR nova Traceback (most recent call last):
Sep 28 12:21:27 ctl02 nova-api[28826]: 2017-09-28 12:21:27.963 28826 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:21:27 ctl02 nova-api[28826]: 2017-09-28 12:21:27.963 28826 ERROR nova     sys.exit(main())
Sep 28 12:21:27 ctl02 nova-api[28826]: 2017-09-28 12:21:27.963 28826 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:21:27 ctl02 nova-api[28826]: 2017-09-28 12:21:27.963 28826 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:21:27 ctl02 nova-api[28826]: 2017-09-28 12:21:27.963 28826 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:21:27 ctl02 nova-api[28826]: 2017-09-28 12:21:27.963 28826 ERROR nova     max_url_len=max_url_len)
Sep 28 12:21:27 ctl02 nova-api[28826]: 2017-09-28 12:21:27.963 28826 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:21:27 ctl02 nova-api[28826]: 2017-09-28 12:21:27.963 28826 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:21:27 ctl02 nova-api[28826]: 2017-09-28 12:21:27.963 28826 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:21:27 ctl02 nova-api[28826]: 2017-09-28 12:21:27.963 28826 ERROR nova     sock.listen(backlog)
Sep 28 12:21:27 ctl02 nova-api[28826]: 2017-09-28 12:21:27.963 28826 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:21:27 ctl02 nova-api[28826]: 2017-09-28 12:21:27.963 28826 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:21:27 ctl02 nova-api[28826]: 2017-09-28 12:21:27.963 28826 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:21:27 ctl02 nova-api[28826]: 2017-09-28 12:21:27.963 28826 ERROR nova
Sep 28 12:21:28 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:21:28 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:21:28 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:21:28 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:21:28 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:21:28 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:21:28.387 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:21:28] "OPTIONS / HTTP/1.0" 200 134 0.000595
Sep 28 12:21:28 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:21:28 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:21:29 ctl02 heat-api-cfn[13300]: 2017-09-28 12:21:29.477 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:21:29] "OPTIONS / HTTP/1.0" 200 134 0.000447
Sep 28 12:21:29 ctl02 heat-api[13008]: 2017-09-28 12:21:29.973 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:21:29] "OPTIONS / HTTP/1.0" 200 134 0.000515
Sep 28 12:21:30 ctl02 nova-api[28844]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:21:30 ctl02 nova-api[28844]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:21:30 ctl02 nova-api[28844]: 2017-09-28 12:21:30.216 28844 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:21:30 ctl02 nova-api[28844]: 2017-09-28 12:21:30.218 28844 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:21:30 ctl02 nova-api[28844]: 2017-09-28 12:21:30.218 28844 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:21:30 ctl02 nova-api[28844]: 2017-09-28 12:21:30.218 28844 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:21:30 ctl02 nova-api[28844]: 2017-09-28 12:21:30.218 28844 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:21:30 ctl02 nova-api[28844]: 2017-09-28 12:21:30.218 28844 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:21:30 ctl02 nova-api[28844]: 2017-09-28 12:21:30.218 28844 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:21:30 ctl02 nova-api[28844]: 2017-09-28 12:21:30.218 28844 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:21:30 ctl02 nova-api[28844]: 2017-09-28 12:21:30.218 28844 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:21:30 ctl02 nova-api[28844]: 2017-09-28 12:21:30.218 28844 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:21:30 ctl02 nova-api[28844]: 2017-09-28 12:21:30.218 28844 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:21:30 ctl02 nova-api[28844]: 2017-09-28 12:21:30.218 28844 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:21:30 ctl02 nova-api[28844]: 2017-09-28 12:21:30.218 28844 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:21:30 ctl02 nova-api[28844]: 2017-09-28 12:21:30.218 28844 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:21:30 ctl02 nova-api[28844]: 2017-09-28 12:21:30.218 28844 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:21:30 ctl02 nova-api[28844]: 2017-09-28 12:21:30.218 28844 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:21:30 ctl02 nova-api[28844]: 2017-09-28 12:21:30.218 28844 ERROR nova.wsgi     self.filename))
Sep 28 12:21:30 ctl02 nova-api[28844]: 2017-09-28 12:21:30.218 28844 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:21:30 ctl02 nova-api[28844]: 2017-09-28 12:21:30.218 28844 ERROR nova.wsgi
Sep 28 12:21:30 ctl02 nova-api[28844]: 2017-09-28 12:21:30.219 28844 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:21:30 ctl02 heat-api-cfn[13300]: 2017-09-28 12:21:30.247 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:21:30] "OPTIONS / HTTP/1.0" 200 134 0.000579
Sep 28 12:21:30 ctl02 heat-api-cfn[13300]: 2017-09-28 12:21:30.251 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:21:30] "OPTIONS / HTTP/1.0" 200 134 0.000362
Sep 28 12:21:30 ctl02 nova-api[28844]: 2017-09-28 12:21:30.346 28844 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:21:30 ctl02 nova-api[28844]: 2017-09-28 12:21:30.569 28844 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:21:30 ctl02 nova-api[28844]: 2017-09-28 12:21:30.571 28844 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:21:30 ctl02 nova-api[28844]: 2017-09-28 12:21:30.572 28844 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:21:30 ctl02 nova-api[28844]: 2017-09-28 12:21:30.572 28844 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:21:30 ctl02 nova-api[28844]: 2017-09-28 12:21:30.702 28844 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:21:30 ctl02 nova-api[28844]: 2017-09-28 12:21:30.705 28844 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:21:30 ctl02 nova-api[28844]: 2017-09-28 12:21:30.706 28844 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:21:30 ctl02 nova-api[28844]: 2017-09-28 12:21:30.706 28844 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:21:30 ctl02 nova-api[28844]: 2017-09-28 12:21:30.709 28844 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:21:30 ctl02 nova-api[28844]: 2017-09-28 12:21:30.710 28844 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:21:30 ctl02 nova-api[28844]: 2017-09-28 12:21:30.710 28844 ERROR nova Traceback (most recent call last):
Sep 28 12:21:30 ctl02 nova-api[28844]: 2017-09-28 12:21:30.710 28844 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:21:30 ctl02 nova-api[28844]: 2017-09-28 12:21:30.710 28844 ERROR nova     sys.exit(main())
Sep 28 12:21:30 ctl02 nova-api[28844]: 2017-09-28 12:21:30.710 28844 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:21:30 ctl02 nova-api[28844]: 2017-09-28 12:21:30.710 28844 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:21:30 ctl02 nova-api[28844]: 2017-09-28 12:21:30.710 28844 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:21:30 ctl02 nova-api[28844]: 2017-09-28 12:21:30.710 28844 ERROR nova     max_url_len=max_url_len)
Sep 28 12:21:30 ctl02 nova-api[28844]: 2017-09-28 12:21:30.710 28844 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:21:30 ctl02 nova-api[28844]: 2017-09-28 12:21:30.710 28844 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:21:30 ctl02 nova-api[28844]: 2017-09-28 12:21:30.710 28844 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:21:30 ctl02 nova-api[28844]: 2017-09-28 12:21:30.710 28844 ERROR nova     sock.listen(backlog)
Sep 28 12:21:30 ctl02 nova-api[28844]: 2017-09-28 12:21:30.710 28844 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:21:30 ctl02 nova-api[28844]: 2017-09-28 12:21:30.710 28844 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:21:30 ctl02 nova-api[28844]: 2017-09-28 12:21:30.710 28844 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:21:30 ctl02 nova-api[28844]: 2017-09-28 12:21:30.710 28844 ERROR nova
Sep 28 12:21:30 ctl02 glance-api[29183]: 2017-09-28 12:21:30.757 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:21:30] "OPTIONS / HTTP/1.0" 200 134 0.000581
Sep 28 12:21:30 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:21:30 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:21:30 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:21:31 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:21:31 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:21:31 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:21:31 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:21:32 ctl02 glance-api[29183]: 2017-09-28 12:21:32.088 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:21:32] "OPTIONS / HTTP/1.0" 200 134 0.000695
Sep 28 12:21:32 ctl02 nova-api[28862]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:21:32 ctl02 nova-api[28862]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:21:33 ctl02 nova-api[28862]: 2017-09-28 12:21:33.021 28862 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:21:33 ctl02 nova-api[28862]: 2017-09-28 12:21:33.023 28862 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:21:33 ctl02 nova-api[28862]: 2017-09-28 12:21:33.023 28862 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:21:33 ctl02 nova-api[28862]: 2017-09-28 12:21:33.023 28862 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:21:33 ctl02 nova-api[28862]: 2017-09-28 12:21:33.023 28862 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:21:33 ctl02 nova-api[28862]: 2017-09-28 12:21:33.023 28862 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:21:33 ctl02 nova-api[28862]: 2017-09-28 12:21:33.023 28862 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:21:33 ctl02 nova-api[28862]: 2017-09-28 12:21:33.023 28862 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:21:33 ctl02 nova-api[28862]: 2017-09-28 12:21:33.023 28862 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:21:33 ctl02 nova-api[28862]: 2017-09-28 12:21:33.023 28862 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:21:33 ctl02 nova-api[28862]: 2017-09-28 12:21:33.023 28862 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:21:33 ctl02 nova-api[28862]: 2017-09-28 12:21:33.023 28862 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:21:33 ctl02 nova-api[28862]: 2017-09-28 12:21:33.023 28862 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:21:33 ctl02 nova-api[28862]: 2017-09-28 12:21:33.023 28862 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:21:33 ctl02 nova-api[28862]: 2017-09-28 12:21:33.023 28862 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:21:33 ctl02 nova-api[28862]: 2017-09-28 12:21:33.023 28862 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:21:33 ctl02 nova-api[28862]: 2017-09-28 12:21:33.023 28862 ERROR nova.wsgi     self.filename))
Sep 28 12:21:33 ctl02 nova-api[28862]: 2017-09-28 12:21:33.023 28862 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:21:33 ctl02 nova-api[28862]: 2017-09-28 12:21:33.023 28862 ERROR nova.wsgi
Sep 28 12:21:33 ctl02 nova-api[28862]: 2017-09-28 12:21:33.025 28862 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:21:33 ctl02 nova-api[28862]: 2017-09-28 12:21:33.160 28862 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:21:33 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:21:33.255 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:21:33] "OPTIONS / HTTP/1.0" 200 134 0.000461
Sep 28 12:21:33 ctl02 nova-api[28862]: 2017-09-28 12:21:33.410 28862 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:21:33 ctl02 nova-api[28862]: 2017-09-28 12:21:33.413 28862 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:21:33 ctl02 nova-api[28862]: 2017-09-28 12:21:33.413 28862 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:21:33 ctl02 nova-api[28862]: 2017-09-28 12:21:33.413 28862 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:21:33 ctl02 nova-api[28862]: 2017-09-28 12:21:33.545 28862 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:21:33 ctl02 nova-api[28862]: 2017-09-28 12:21:33.548 28862 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:21:33 ctl02 nova-api[28862]: 2017-09-28 12:21:33.549 28862 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:21:33 ctl02 nova-api[28862]: 2017-09-28 12:21:33.549 28862 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:21:33 ctl02 nova-api[28862]: 2017-09-28 12:21:33.553 28862 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:21:33 ctl02 nova-api[28862]: 2017-09-28 12:21:33.553 28862 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:21:33 ctl02 nova-api[28862]: 2017-09-28 12:21:33.553 28862 ERROR nova Traceback (most recent call last):
Sep 28 12:21:33 ctl02 nova-api[28862]: 2017-09-28 12:21:33.553 28862 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:21:33 ctl02 nova-api[28862]: 2017-09-28 12:21:33.553 28862 ERROR nova     sys.exit(main())
Sep 28 12:21:33 ctl02 nova-api[28862]: 2017-09-28 12:21:33.553 28862 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:21:33 ctl02 nova-api[28862]: 2017-09-28 12:21:33.553 28862 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:21:33 ctl02 nova-api[28862]: 2017-09-28 12:21:33.553 28862 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:21:33 ctl02 nova-api[28862]: 2017-09-28 12:21:33.553 28862 ERROR nova     max_url_len=max_url_len)
Sep 28 12:21:33 ctl02 nova-api[28862]: 2017-09-28 12:21:33.553 28862 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:21:33 ctl02 nova-api[28862]: 2017-09-28 12:21:33.553 28862 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:21:33 ctl02 nova-api[28862]: 2017-09-28 12:21:33.553 28862 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:21:33 ctl02 nova-api[28862]: 2017-09-28 12:21:33.553 28862 ERROR nova     sock.listen(backlog)
Sep 28 12:21:33 ctl02 nova-api[28862]: 2017-09-28 12:21:33.553 28862 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:21:33 ctl02 nova-api[28862]: 2017-09-28 12:21:33.553 28862 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:21:33 ctl02 nova-api[28862]: 2017-09-28 12:21:33.553 28862 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:21:33 ctl02 nova-api[28862]: 2017-09-28 12:21:33.553 28862 ERROR nova
Sep 28 12:21:33 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:21:33 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:21:33 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:21:33 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:21:33 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:21:33 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:21:33 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:21:34 ctl02 glance-api[29183]: 2017-09-28 12:21:34.088 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:21:34] "OPTIONS / HTTP/1.0" 200 134 0.000702
Sep 28 12:21:34 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:21:34.745 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:21:34] "OPTIONS / HTTP/1.0" 200 134 0.000376
Sep 28 12:21:35 ctl02 nova-consoleauth[5433]: 2017-09-28 12:21:35.036 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:21:35 ctl02 nova-api[28880]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:21:35 ctl02 nova-api[28880]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:21:35 ctl02 nova-api[28880]: 2017-09-28 12:21:35.714 28880 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:21:35 ctl02 nova-api[28880]: 2017-09-28 12:21:35.716 28880 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:21:35 ctl02 nova-api[28880]: 2017-09-28 12:21:35.716 28880 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:21:35 ctl02 nova-api[28880]: 2017-09-28 12:21:35.716 28880 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:21:35 ctl02 nova-api[28880]: 2017-09-28 12:21:35.716 28880 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:21:35 ctl02 nova-api[28880]: 2017-09-28 12:21:35.716 28880 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:21:35 ctl02 nova-api[28880]: 2017-09-28 12:21:35.716 28880 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:21:35 ctl02 nova-api[28880]: 2017-09-28 12:21:35.716 28880 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:21:35 ctl02 nova-api[28880]: 2017-09-28 12:21:35.716 28880 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:21:35 ctl02 nova-api[28880]: 2017-09-28 12:21:35.716 28880 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:21:35 ctl02 nova-api[28880]: 2017-09-28 12:21:35.716 28880 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:21:35 ctl02 nova-api[28880]: 2017-09-28 12:21:35.716 28880 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:21:35 ctl02 nova-api[28880]: 2017-09-28 12:21:35.716 28880 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:21:35 ctl02 nova-api[28880]: 2017-09-28 12:21:35.716 28880 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:21:35 ctl02 nova-api[28880]: 2017-09-28 12:21:35.716 28880 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:21:35 ctl02 nova-api[28880]: 2017-09-28 12:21:35.716 28880 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:21:35 ctl02 nova-api[28880]: 2017-09-28 12:21:35.716 28880 ERROR nova.wsgi     self.filename))
Sep 28 12:21:35 ctl02 nova-api[28880]: 2017-09-28 12:21:35.716 28880 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:21:35 ctl02 nova-api[28880]: 2017-09-28 12:21:35.716 28880 ERROR nova.wsgi
Sep 28 12:21:35 ctl02 nova-api[28880]: 2017-09-28 12:21:35.717 28880 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:21:35 ctl02 nova-api[28880]: 2017-09-28 12:21:35.848 28880 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:21:36 ctl02 nova-api[28880]: 2017-09-28 12:21:36.079 28880 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:21:36 ctl02 nova-api[28880]: 2017-09-28 12:21:36.081 28880 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:21:36 ctl02 nova-api[28880]: 2017-09-28 12:21:36.081 28880 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:21:36 ctl02 nova-api[28880]: 2017-09-28 12:21:36.081 28880 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:21:36 ctl02 nova-api[28880]: 2017-09-28 12:21:36.211 28880 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:21:36 ctl02 nova-api[28880]: 2017-09-28 12:21:36.213 28880 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:21:36 ctl02 nova-api[28880]: 2017-09-28 12:21:36.213 28880 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:21:36 ctl02 nova-api[28880]: 2017-09-28 12:21:36.213 28880 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:21:36 ctl02 nova-api[28880]: 2017-09-28 12:21:36.216 28880 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:21:36 ctl02 nova-api[28880]: 2017-09-28 12:21:36.217 28880 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:21:36 ctl02 nova-api[28880]: 2017-09-28 12:21:36.217 28880 ERROR nova Traceback (most recent call last):
Sep 28 12:21:36 ctl02 nova-api[28880]: 2017-09-28 12:21:36.217 28880 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:21:36 ctl02 nova-api[28880]: 2017-09-28 12:21:36.217 28880 ERROR nova     sys.exit(main())
Sep 28 12:21:36 ctl02 nova-api[28880]: 2017-09-28 12:21:36.217 28880 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:21:36 ctl02 nova-api[28880]: 2017-09-28 12:21:36.217 28880 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:21:36 ctl02 nova-api[28880]: 2017-09-28 12:21:36.217 28880 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:21:36 ctl02 nova-api[28880]: 2017-09-28 12:21:36.217 28880 ERROR nova     max_url_len=max_url_len)
Sep 28 12:21:36 ctl02 nova-api[28880]: 2017-09-28 12:21:36.217 28880 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:21:36 ctl02 nova-api[28880]: 2017-09-28 12:21:36.217 28880 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:21:36 ctl02 nova-api[28880]: 2017-09-28 12:21:36.217 28880 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:21:36 ctl02 nova-api[28880]: 2017-09-28 12:21:36.217 28880 ERROR nova     sock.listen(backlog)
Sep 28 12:21:36 ctl02 nova-api[28880]: 2017-09-28 12:21:36.217 28880 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:21:36 ctl02 nova-api[28880]: 2017-09-28 12:21:36.217 28880 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:21:36 ctl02 nova-api[28880]: 2017-09-28 12:21:36.217 28880 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:21:36 ctl02 nova-api[28880]: 2017-09-28 12:21:36.217 28880 ERROR nova
Sep 28 12:21:36 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:21:36 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:21:36 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:21:36 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:21:36 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:21:36 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:21:36 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:21:36 ctl02 heat-api[13008]: 2017-09-28 12:21:36.742 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:21:36] "OPTIONS / HTTP/1.0" 200 134 0.000592
Sep 28 12:21:36 ctl02 heat-api[13008]: 2017-09-28 12:21:36.940 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:21:36] "OPTIONS / HTTP/1.0" 200 134 0.000557
Sep 28 12:21:37 ctl02 heat-engine[12803]: 2017-09-28 12:21:37.704 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:21:37 ctl02 heat-engine[12803]: 2017-09-28 12:21:37.709 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:21:37 ctl02 heat-engine[12803]: 2017-09-28 12:21:37.710 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:21:37 ctl02 heat-engine[12803]: 2017-09-28 12:21:37.722 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:21:38 ctl02 nova-scheduler[5620]: 2017-09-28 12:21:38.057 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:21:38 ctl02 nova-api[28898]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:21:38 ctl02 nova-api[28898]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:21:38 ctl02 nova-api[28898]: 2017-09-28 12:21:38.441 28898 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:21:38 ctl02 nova-api[28898]: 2017-09-28 12:21:38.443 28898 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:21:38 ctl02 nova-api[28898]: 2017-09-28 12:21:38.443 28898 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:21:38 ctl02 nova-api[28898]: 2017-09-28 12:21:38.443 28898 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:21:38 ctl02 nova-api[28898]: 2017-09-28 12:21:38.443 28898 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:21:38 ctl02 nova-api[28898]: 2017-09-28 12:21:38.443 28898 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:21:38 ctl02 nova-api[28898]: 2017-09-28 12:21:38.443 28898 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:21:38 ctl02 nova-api[28898]: 2017-09-28 12:21:38.443 28898 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:21:38 ctl02 nova-api[28898]: 2017-09-28 12:21:38.443 28898 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:21:38 ctl02 nova-api[28898]: 2017-09-28 12:21:38.443 28898 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:21:38 ctl02 nova-api[28898]: 2017-09-28 12:21:38.443 28898 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:21:38 ctl02 nova-api[28898]: 2017-09-28 12:21:38.443 28898 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:21:38 ctl02 nova-api[28898]: 2017-09-28 12:21:38.443 28898 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:21:38 ctl02 nova-api[28898]: 2017-09-28 12:21:38.443 28898 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:21:38 ctl02 nova-api[28898]: 2017-09-28 12:21:38.443 28898 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:21:38 ctl02 nova-api[28898]: 2017-09-28 12:21:38.443 28898 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:21:38 ctl02 nova-api[28898]: 2017-09-28 12:21:38.443 28898 ERROR nova.wsgi     self.filename))
Sep 28 12:21:38 ctl02 nova-api[28898]: 2017-09-28 12:21:38.443 28898 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:21:38 ctl02 nova-api[28898]: 2017-09-28 12:21:38.443 28898 ERROR nova.wsgi
Sep 28 12:21:38 ctl02 nova-api[28898]: 2017-09-28 12:21:38.444 28898 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:21:38 ctl02 nova-api[28898]: 2017-09-28 12:21:38.572 28898 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:21:38 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:21:38.624 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:21:38] "OPTIONS / HTTP/1.0" 200 134 0.000417
Sep 28 12:21:38 ctl02 nova-api[28898]: 2017-09-28 12:21:38.800 28898 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:21:38 ctl02 nova-api[28898]: 2017-09-28 12:21:38.802 28898 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:21:38 ctl02 nova-api[28898]: 2017-09-28 12:21:38.802 28898 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:21:38 ctl02 nova-api[28898]: 2017-09-28 12:21:38.803 28898 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:21:38 ctl02 nova-api[28898]: 2017-09-28 12:21:38.934 28898 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:21:38 ctl02 nova-api[28898]: 2017-09-28 12:21:38.936 28898 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:21:38 ctl02 nova-api[28898]: 2017-09-28 12:21:38.936 28898 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:21:38 ctl02 nova-api[28898]: 2017-09-28 12:21:38.937 28898 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:21:38 ctl02 nova-api[28898]: 2017-09-28 12:21:38.940 28898 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:21:38 ctl02 nova-api[28898]: 2017-09-28 12:21:38.940 28898 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:21:38 ctl02 nova-api[28898]: 2017-09-28 12:21:38.940 28898 ERROR nova Traceback (most recent call last):
Sep 28 12:21:38 ctl02 nova-api[28898]: 2017-09-28 12:21:38.940 28898 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:21:38 ctl02 nova-api[28898]: 2017-09-28 12:21:38.940 28898 ERROR nova     sys.exit(main())
Sep 28 12:21:38 ctl02 nova-api[28898]: 2017-09-28 12:21:38.940 28898 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:21:38 ctl02 nova-api[28898]: 2017-09-28 12:21:38.940 28898 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:21:38 ctl02 nova-api[28898]: 2017-09-28 12:21:38.940 28898 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:21:38 ctl02 nova-api[28898]: 2017-09-28 12:21:38.940 28898 ERROR nova     max_url_len=max_url_len)
Sep 28 12:21:38 ctl02 nova-api[28898]: 2017-09-28 12:21:38.940 28898 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:21:38 ctl02 nova-api[28898]: 2017-09-28 12:21:38.940 28898 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:21:38 ctl02 nova-api[28898]: 2017-09-28 12:21:38.940 28898 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:21:38 ctl02 nova-api[28898]: 2017-09-28 12:21:38.940 28898 ERROR nova     sock.listen(backlog)
Sep 28 12:21:38 ctl02 nova-api[28898]: 2017-09-28 12:21:38.940 28898 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:21:38 ctl02 nova-api[28898]: 2017-09-28 12:21:38.940 28898 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:21:38 ctl02 nova-api[28898]: 2017-09-28 12:21:38.940 28898 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:21:38 ctl02 nova-api[28898]: 2017-09-28 12:21:38.940 28898 ERROR nova
Sep 28 12:21:39 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:21:39 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:21:39 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:21:39 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:21:39 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:21:39 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:21:39 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:21:39 ctl02 heat-api-cfn[13300]: 2017-09-28 12:21:39.595 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:21:39] "OPTIONS / HTTP/1.0" 200 134 0.000440
Sep 28 12:21:40 ctl02 heat-api-cfn[13300]: 2017-09-28 12:21:40.170 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:21:40] "OPTIONS / HTTP/1.0" 200 134 0.000557
Sep 28 12:21:40 ctl02 heat-api[13008]: 2017-09-28 12:21:40.307 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:21:40] "OPTIONS / HTTP/1.0" 200 134 0.000527
Sep 28 12:21:40 ctl02 heat-api-cfn[13300]: 2017-09-28 12:21:40.433 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:21:40] "OPTIONS / HTTP/1.0" 200 134 0.000425
Sep 28 12:21:40 ctl02 glance-api[29183]: 2017-09-28 12:21:40.602 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:21:40] "OPTIONS / HTTP/1.0" 200 134 0.000600
Sep 28 12:21:41 ctl02 nova-api[28916]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:21:41 ctl02 nova-api[28916]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:21:41 ctl02 nova-api[28916]: 2017-09-28 12:21:41.192 28916 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:21:41 ctl02 nova-api[28916]: 2017-09-28 12:21:41.194 28916 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:21:41 ctl02 nova-api[28916]: 2017-09-28 12:21:41.194 28916 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:21:41 ctl02 nova-api[28916]: 2017-09-28 12:21:41.194 28916 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:21:41 ctl02 nova-api[28916]: 2017-09-28 12:21:41.194 28916 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:21:41 ctl02 nova-api[28916]: 2017-09-28 12:21:41.194 28916 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:21:41 ctl02 nova-api[28916]: 2017-09-28 12:21:41.194 28916 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:21:41 ctl02 nova-api[28916]: 2017-09-28 12:21:41.194 28916 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:21:41 ctl02 nova-api[28916]: 2017-09-28 12:21:41.194 28916 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:21:41 ctl02 nova-api[28916]: 2017-09-28 12:21:41.194 28916 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:21:41 ctl02 nova-api[28916]: 2017-09-28 12:21:41.194 28916 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:21:41 ctl02 nova-api[28916]: 2017-09-28 12:21:41.194 28916 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:21:41 ctl02 nova-api[28916]: 2017-09-28 12:21:41.194 28916 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:21:41 ctl02 nova-api[28916]: 2017-09-28 12:21:41.194 28916 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:21:41 ctl02 nova-api[28916]: 2017-09-28 12:21:41.194 28916 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:21:41 ctl02 nova-api[28916]: 2017-09-28 12:21:41.194 28916 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:21:41 ctl02 nova-api[28916]: 2017-09-28 12:21:41.194 28916 ERROR nova.wsgi     self.filename))
Sep 28 12:21:41 ctl02 nova-api[28916]: 2017-09-28 12:21:41.194 28916 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:21:41 ctl02 nova-api[28916]: 2017-09-28 12:21:41.194 28916 ERROR nova.wsgi
Sep 28 12:21:41 ctl02 nova-api[28916]: 2017-09-28 12:21:41.194 28916 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:21:41 ctl02 nova-api[28916]: 2017-09-28 12:21:41.322 28916 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:21:41 ctl02 nova-api[28916]: 2017-09-28 12:21:41.552 28916 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:21:41 ctl02 nova-api[28916]: 2017-09-28 12:21:41.555 28916 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:21:41 ctl02 nova-api[28916]: 2017-09-28 12:21:41.555 28916 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:21:41 ctl02 nova-api[28916]: 2017-09-28 12:21:41.555 28916 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:21:41 ctl02 nova-api[28916]: 2017-09-28 12:21:41.684 28916 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:21:41 ctl02 nova-api[28916]: 2017-09-28 12:21:41.685 28916 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:21:41 ctl02 nova-api[28916]: 2017-09-28 12:21:41.686 28916 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:21:41 ctl02 nova-api[28916]: 2017-09-28 12:21:41.686 28916 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:21:41 ctl02 nova-api[28916]: 2017-09-28 12:21:41.689 28916 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:21:41 ctl02 nova-api[28916]: 2017-09-28 12:21:41.689 28916 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:21:41 ctl02 nova-api[28916]: 2017-09-28 12:21:41.689 28916 ERROR nova Traceback (most recent call last):
Sep 28 12:21:41 ctl02 nova-api[28916]: 2017-09-28 12:21:41.689 28916 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:21:41 ctl02 nova-api[28916]: 2017-09-28 12:21:41.689 28916 ERROR nova     sys.exit(main())
Sep 28 12:21:41 ctl02 nova-api[28916]: 2017-09-28 12:21:41.689 28916 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:21:41 ctl02 nova-api[28916]: 2017-09-28 12:21:41.689 28916 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:21:41 ctl02 nova-api[28916]: 2017-09-28 12:21:41.689 28916 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:21:41 ctl02 nova-api[28916]: 2017-09-28 12:21:41.689 28916 ERROR nova     max_url_len=max_url_len)
Sep 28 12:21:41 ctl02 nova-api[28916]: 2017-09-28 12:21:41.689 28916 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:21:41 ctl02 nova-api[28916]: 2017-09-28 12:21:41.689 28916 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:21:41 ctl02 nova-api[28916]: 2017-09-28 12:21:41.689 28916 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:21:41 ctl02 nova-api[28916]: 2017-09-28 12:21:41.689 28916 ERROR nova     sock.listen(backlog)
Sep 28 12:21:41 ctl02 nova-api[28916]: 2017-09-28 12:21:41.689 28916 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:21:41 ctl02 nova-api[28916]: 2017-09-28 12:21:41.689 28916 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:21:41 ctl02 nova-api[28916]: 2017-09-28 12:21:41.689 28916 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:21:41 ctl02 nova-api[28916]: 2017-09-28 12:21:41.689 28916 ERROR nova
Sep 28 12:21:41 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:21:41 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:21:41 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:21:42 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:21:42 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:21:42 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:21:42 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:21:42 ctl02 glance-api[29183]: 2017-09-28 12:21:42.393 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:21:42] "OPTIONS / HTTP/1.0" 200 134 0.000565
Sep 28 12:21:43 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:21:43.472 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:21:43] "OPTIONS / HTTP/1.0" 200 134 0.000555
Sep 28 12:21:43 ctl02 nova-api[28934]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:21:43 ctl02 nova-api[28934]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:21:43 ctl02 nova-api[28934]: 2017-09-28 12:21:43.957 28934 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:21:43 ctl02 nova-api[28934]: 2017-09-28 12:21:43.959 28934 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:21:43 ctl02 nova-api[28934]: 2017-09-28 12:21:43.959 28934 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:21:43 ctl02 nova-api[28934]: 2017-09-28 12:21:43.959 28934 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:21:43 ctl02 nova-api[28934]: 2017-09-28 12:21:43.959 28934 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:21:43 ctl02 nova-api[28934]: 2017-09-28 12:21:43.959 28934 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:21:43 ctl02 nova-api[28934]: 2017-09-28 12:21:43.959 28934 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:21:43 ctl02 nova-api[28934]: 2017-09-28 12:21:43.959 28934 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:21:43 ctl02 nova-api[28934]: 2017-09-28 12:21:43.959 28934 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:21:43 ctl02 nova-api[28934]: 2017-09-28 12:21:43.959 28934 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:21:43 ctl02 nova-api[28934]: 2017-09-28 12:21:43.959 28934 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:21:43 ctl02 nova-api[28934]: 2017-09-28 12:21:43.959 28934 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:21:43 ctl02 nova-api[28934]: 2017-09-28 12:21:43.959 28934 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:21:43 ctl02 nova-api[28934]: 2017-09-28 12:21:43.959 28934 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:21:43 ctl02 nova-api[28934]: 2017-09-28 12:21:43.959 28934 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:21:43 ctl02 nova-api[28934]: 2017-09-28 12:21:43.959 28934 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:21:43 ctl02 nova-api[28934]: 2017-09-28 12:21:43.959 28934 ERROR nova.wsgi     self.filename))
Sep 28 12:21:43 ctl02 nova-api[28934]: 2017-09-28 12:21:43.959 28934 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:21:43 ctl02 nova-api[28934]: 2017-09-28 12:21:43.959 28934 ERROR nova.wsgi
Sep 28 12:21:43 ctl02 nova-api[28934]: 2017-09-28 12:21:43.960 28934 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:21:44 ctl02 nova-api[28934]: 2017-09-28 12:21:44.095 28934 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:21:44 ctl02 nova-api[28934]: 2017-09-28 12:21:44.349 28934 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:21:44 ctl02 nova-api[28934]: 2017-09-28 12:21:44.352 28934 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:21:44 ctl02 nova-api[28934]: 2017-09-28 12:21:44.352 28934 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:21:44 ctl02 nova-api[28934]: 2017-09-28 12:21:44.353 28934 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:21:44 ctl02 glance-api[29183]: 2017-09-28 12:21:44.375 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:21:44] "OPTIONS / HTTP/1.0" 200 134 0.000688
Sep 28 12:21:44 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x162c6705)
Sep 28 12:21:44 ctl02 nova-api[28934]: 2017-09-28 12:21:44.491 28934 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:21:44 ctl02 nova-api[28934]: 2017-09-28 12:21:44.493 28934 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:21:44 ctl02 nova-api[28934]: 2017-09-28 12:21:44.493 28934 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:21:44 ctl02 nova-api[28934]: 2017-09-28 12:21:44.494 28934 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:21:44 ctl02 nova-api[28934]: 2017-09-28 12:21:44.497 28934 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:21:44 ctl02 nova-api[28934]: 2017-09-28 12:21:44.498 28934 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:21:44 ctl02 nova-api[28934]: 2017-09-28 12:21:44.498 28934 ERROR nova Traceback (most recent call last):
Sep 28 12:21:44 ctl02 nova-api[28934]: 2017-09-28 12:21:44.498 28934 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:21:44 ctl02 nova-api[28934]: 2017-09-28 12:21:44.498 28934 ERROR nova     sys.exit(main())
Sep 28 12:21:44 ctl02 nova-api[28934]: 2017-09-28 12:21:44.498 28934 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:21:44 ctl02 nova-api[28934]: 2017-09-28 12:21:44.498 28934 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:21:44 ctl02 nova-api[28934]: 2017-09-28 12:21:44.498 28934 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:21:44 ctl02 nova-api[28934]: 2017-09-28 12:21:44.498 28934 ERROR nova     max_url_len=max_url_len)
Sep 28 12:21:44 ctl02 nova-api[28934]: 2017-09-28 12:21:44.498 28934 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:21:44 ctl02 nova-api[28934]: 2017-09-28 12:21:44.498 28934 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:21:44 ctl02 nova-api[28934]: 2017-09-28 12:21:44.498 28934 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:21:44 ctl02 nova-api[28934]: 2017-09-28 12:21:44.498 28934 ERROR nova     sock.listen(backlog)
Sep 28 12:21:44 ctl02 nova-api[28934]: 2017-09-28 12:21:44.498 28934 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:21:44 ctl02 nova-api[28934]: 2017-09-28 12:21:44.498 28934 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:21:44 ctl02 nova-api[28934]: 2017-09-28 12:21:44.498 28934 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:21:44 ctl02 nova-api[28934]: 2017-09-28 12:21:44.498 28934 ERROR nova
Sep 28 12:21:44 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:21:44.562 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:21:44] "OPTIONS / HTTP/1.0" 200 134 0.000466
Sep 28 12:21:44 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:21:44 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:21:44 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:21:44 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:21:44 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:21:44 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:21:44 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:21:45 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x162c6705)
Sep 28 12:21:46 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x162c6705)
Sep 28 12:21:46 ctl02 nova-api[28952]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:21:46 ctl02 nova-api[28952]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:21:46 ctl02 heat-api[13008]: 2017-09-28 12:21:46.651 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:21:46] "OPTIONS / HTTP/1.0" 200 134 0.000607
Sep 28 12:21:46 ctl02 nova-api[28952]: 2017-09-28 12:21:46.737 28952 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:21:46 ctl02 nova-api[28952]: 2017-09-28 12:21:46.739 28952 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:21:46 ctl02 nova-api[28952]: 2017-09-28 12:21:46.739 28952 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:21:46 ctl02 nova-api[28952]: 2017-09-28 12:21:46.739 28952 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:21:46 ctl02 nova-api[28952]: 2017-09-28 12:21:46.739 28952 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:21:46 ctl02 nova-api[28952]: 2017-09-28 12:21:46.739 28952 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:21:46 ctl02 nova-api[28952]: 2017-09-28 12:21:46.739 28952 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:21:46 ctl02 nova-api[28952]: 2017-09-28 12:21:46.739 28952 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:21:46 ctl02 nova-api[28952]: 2017-09-28 12:21:46.739 28952 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:21:46 ctl02 nova-api[28952]: 2017-09-28 12:21:46.739 28952 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:21:46 ctl02 nova-api[28952]: 2017-09-28 12:21:46.739 28952 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:21:46 ctl02 nova-api[28952]: 2017-09-28 12:21:46.739 28952 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:21:46 ctl02 nova-api[28952]: 2017-09-28 12:21:46.739 28952 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:21:46 ctl02 nova-api[28952]: 2017-09-28 12:21:46.739 28952 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:21:46 ctl02 nova-api[28952]: 2017-09-28 12:21:46.739 28952 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:21:46 ctl02 nova-api[28952]: 2017-09-28 12:21:46.739 28952 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:21:46 ctl02 nova-api[28952]: 2017-09-28 12:21:46.739 28952 ERROR nova.wsgi     self.filename))
Sep 28 12:21:46 ctl02 nova-api[28952]: 2017-09-28 12:21:46.739 28952 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:21:46 ctl02 nova-api[28952]: 2017-09-28 12:21:46.739 28952 ERROR nova.wsgi
Sep 28 12:21:46 ctl02 nova-api[28952]: 2017-09-28 12:21:46.740 28952 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:21:46 ctl02 nova-api[28952]: 2017-09-28 12:21:46.874 28952 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:21:46 ctl02 heat-api[13008]: 2017-09-28 12:21:46.953 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:21:46] "OPTIONS / HTTP/1.0" 200 134 0.000651
Sep 28 12:21:47 ctl02 nova-api[28952]: 2017-09-28 12:21:47.126 28952 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:21:47 ctl02 nova-api[28952]: 2017-09-28 12:21:47.128 28952 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:21:47 ctl02 nova-api[28952]: 2017-09-28 12:21:47.128 28952 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:21:47 ctl02 nova-api[28952]: 2017-09-28 12:21:47.129 28952 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:21:47 ctl02 nova-api[28952]: 2017-09-28 12:21:47.262 28952 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:21:47 ctl02 nova-api[28952]: 2017-09-28 12:21:47.264 28952 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:21:47 ctl02 nova-api[28952]: 2017-09-28 12:21:47.264 28952 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:21:47 ctl02 nova-api[28952]: 2017-09-28 12:21:47.264 28952 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:21:47 ctl02 nova-api[28952]: 2017-09-28 12:21:47.268 28952 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:21:47 ctl02 nova-api[28952]: 2017-09-28 12:21:47.268 28952 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:21:47 ctl02 nova-api[28952]: 2017-09-28 12:21:47.268 28952 ERROR nova Traceback (most recent call last):
Sep 28 12:21:47 ctl02 nova-api[28952]: 2017-09-28 12:21:47.268 28952 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:21:47 ctl02 nova-api[28952]: 2017-09-28 12:21:47.268 28952 ERROR nova     sys.exit(main())
Sep 28 12:21:47 ctl02 nova-api[28952]: 2017-09-28 12:21:47.268 28952 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:21:47 ctl02 nova-api[28952]: 2017-09-28 12:21:47.268 28952 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:21:47 ctl02 nova-api[28952]: 2017-09-28 12:21:47.268 28952 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:21:47 ctl02 nova-api[28952]: 2017-09-28 12:21:47.268 28952 ERROR nova     max_url_len=max_url_len)
Sep 28 12:21:47 ctl02 nova-api[28952]: 2017-09-28 12:21:47.268 28952 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:21:47 ctl02 nova-api[28952]: 2017-09-28 12:21:47.268 28952 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:21:47 ctl02 nova-api[28952]: 2017-09-28 12:21:47.268 28952 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:21:47 ctl02 nova-api[28952]: 2017-09-28 12:21:47.268 28952 ERROR nova     sock.listen(backlog)
Sep 28 12:21:47 ctl02 nova-api[28952]: 2017-09-28 12:21:47.268 28952 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:21:47 ctl02 nova-api[28952]: 2017-09-28 12:21:47.268 28952 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:21:47 ctl02 nova-api[28952]: 2017-09-28 12:21:47.268 28952 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:21:47 ctl02 nova-api[28952]: 2017-09-28 12:21:47.268 28952 ERROR nova
Sep 28 12:21:47 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:21:47 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:21:47 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:21:47 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x162c6705)
Sep 28 12:21:47 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:21:47 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:21:47 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:21:47 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:21:48 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x162c6705)
Sep 28 12:21:49 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:21:49.019 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:21:49] "OPTIONS / HTTP/1.0" 200 134 0.000411
Sep 28 12:21:49 ctl02 nova-api[28970]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:21:49 ctl02 nova-api[28970]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:21:49 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x162c6705)
Sep 28 12:21:49 ctl02 heat-api-cfn[13300]: 2017-09-28 12:21:49.486 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:21:49] "OPTIONS / HTTP/1.0" 200 134 0.000547
Sep 28 12:21:49 ctl02 nova-api[28970]: 2017-09-28 12:21:49.495 28970 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:21:49 ctl02 nova-api[28970]: 2017-09-28 12:21:49.497 28970 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:21:49 ctl02 nova-api[28970]: 2017-09-28 12:21:49.497 28970 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:21:49 ctl02 nova-api[28970]: 2017-09-28 12:21:49.497 28970 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:21:49 ctl02 nova-api[28970]: 2017-09-28 12:21:49.497 28970 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:21:49 ctl02 nova-api[28970]: 2017-09-28 12:21:49.497 28970 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:21:49 ctl02 nova-api[28970]: 2017-09-28 12:21:49.497 28970 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:21:49 ctl02 nova-api[28970]: 2017-09-28 12:21:49.497 28970 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:21:49 ctl02 nova-api[28970]: 2017-09-28 12:21:49.497 28970 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:21:49 ctl02 nova-api[28970]: 2017-09-28 12:21:49.497 28970 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:21:49 ctl02 nova-api[28970]: 2017-09-28 12:21:49.497 28970 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:21:49 ctl02 nova-api[28970]: 2017-09-28 12:21:49.497 28970 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:21:49 ctl02 nova-api[28970]: 2017-09-28 12:21:49.497 28970 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:21:49 ctl02 nova-api[28970]: 2017-09-28 12:21:49.497 28970 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:21:49 ctl02 nova-api[28970]: 2017-09-28 12:21:49.497 28970 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:21:49 ctl02 nova-api[28970]: 2017-09-28 12:21:49.497 28970 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:21:49 ctl02 nova-api[28970]: 2017-09-28 12:21:49.497 28970 ERROR nova.wsgi     self.filename))
Sep 28 12:21:49 ctl02 nova-api[28970]: 2017-09-28 12:21:49.497 28970 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:21:49 ctl02 nova-api[28970]: 2017-09-28 12:21:49.497 28970 ERROR nova.wsgi
Sep 28 12:21:49 ctl02 nova-api[28970]: 2017-09-28 12:21:49.498 28970 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:21:49 ctl02 nova-api[28970]: 2017-09-28 12:21:49.641 28970 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:21:49 ctl02 nova-api[28970]: 2017-09-28 12:21:49.873 28970 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:21:49 ctl02 nova-api[28970]: 2017-09-28 12:21:49.875 28970 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:21:49 ctl02 nova-api[28970]: 2017-09-28 12:21:49.876 28970 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:21:49 ctl02 nova-api[28970]: 2017-09-28 12:21:49.876 28970 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:21:50 ctl02 nova-api[28970]: 2017-09-28 12:21:50.006 28970 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:21:50 ctl02 nova-api[28970]: 2017-09-28 12:21:50.008 28970 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:21:50 ctl02 nova-api[28970]: 2017-09-28 12:21:50.009 28970 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:21:50 ctl02 nova-api[28970]: 2017-09-28 12:21:50.009 28970 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:21:50 ctl02 nova-api[28970]: 2017-09-28 12:21:50.012 28970 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:21:50 ctl02 nova-api[28970]: 2017-09-28 12:21:50.012 28970 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:21:50 ctl02 nova-api[28970]: 2017-09-28 12:21:50.012 28970 ERROR nova Traceback (most recent call last):
Sep 28 12:21:50 ctl02 nova-api[28970]: 2017-09-28 12:21:50.012 28970 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:21:50 ctl02 nova-api[28970]: 2017-09-28 12:21:50.012 28970 ERROR nova     sys.exit(main())
Sep 28 12:21:50 ctl02 nova-api[28970]: 2017-09-28 12:21:50.012 28970 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:21:50 ctl02 nova-api[28970]: 2017-09-28 12:21:50.012 28970 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:21:50 ctl02 nova-api[28970]: 2017-09-28 12:21:50.012 28970 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:21:50 ctl02 nova-api[28970]: 2017-09-28 12:21:50.012 28970 ERROR nova     max_url_len=max_url_len)
Sep 28 12:21:50 ctl02 nova-api[28970]: 2017-09-28 12:21:50.012 28970 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:21:50 ctl02 nova-api[28970]: 2017-09-28 12:21:50.012 28970 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:21:50 ctl02 nova-api[28970]: 2017-09-28 12:21:50.012 28970 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:21:50 ctl02 nova-api[28970]: 2017-09-28 12:21:50.012 28970 ERROR nova     sock.listen(backlog)
Sep 28 12:21:50 ctl02 nova-api[28970]: 2017-09-28 12:21:50.012 28970 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:21:50 ctl02 nova-api[28970]: 2017-09-28 12:21:50.012 28970 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:21:50 ctl02 nova-api[28970]: 2017-09-28 12:21:50.012 28970 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:21:50 ctl02 nova-api[28970]: 2017-09-28 12:21:50.012 28970 ERROR nova
Sep 28 12:21:50 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:21:50 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:21:50 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:21:50 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:21:50 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:21:50 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:21:50 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:21:50 ctl02 heat-api-cfn[13300]: 2017-09-28 12:21:50.417 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:21:50] "OPTIONS / HTTP/1.0" 200 134 0.000559
Sep 28 12:21:50 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x162c6705)
Sep 28 12:21:50 ctl02 heat-api[13008]: 2017-09-28 12:21:50.583 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:21:50] "OPTIONS / HTTP/1.0" 200 134 0.000552
Sep 28 12:21:50 ctl02 heat-api-cfn[13300]: 2017-09-28 12:21:50.692 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:21:50] "OPTIONS / HTTP/1.0" 200 134 0.000418
Sep 28 12:21:50 ctl02 glance-api[29183]: 2017-09-28 12:21:50.740 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:21:50] "OPTIONS / HTTP/1.0" 200 134 0.000546
Sep 28 12:21:51 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x162c6705)
Sep 28 12:21:52 ctl02 nova-api[28988]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:21:52 ctl02 nova-api[28988]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:21:52 ctl02 nova-api[28988]: 2017-09-28 12:21:52.197 28988 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:21:52 ctl02 nova-api[28988]: 2017-09-28 12:21:52.199 28988 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:21:52 ctl02 nova-api[28988]: 2017-09-28 12:21:52.199 28988 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:21:52 ctl02 nova-api[28988]: 2017-09-28 12:21:52.199 28988 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:21:52 ctl02 nova-api[28988]: 2017-09-28 12:21:52.199 28988 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:21:52 ctl02 nova-api[28988]: 2017-09-28 12:21:52.199 28988 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:21:52 ctl02 nova-api[28988]: 2017-09-28 12:21:52.199 28988 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:21:52 ctl02 nova-api[28988]: 2017-09-28 12:21:52.199 28988 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:21:52 ctl02 nova-api[28988]: 2017-09-28 12:21:52.199 28988 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:21:52 ctl02 nova-api[28988]: 2017-09-28 12:21:52.199 28988 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:21:52 ctl02 nova-api[28988]: 2017-09-28 12:21:52.199 28988 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:21:52 ctl02 nova-api[28988]: 2017-09-28 12:21:52.199 28988 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:21:52 ctl02 nova-api[28988]: 2017-09-28 12:21:52.199 28988 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:21:52 ctl02 nova-api[28988]: 2017-09-28 12:21:52.199 28988 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:21:52 ctl02 nova-api[28988]: 2017-09-28 12:21:52.199 28988 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:21:52 ctl02 nova-api[28988]: 2017-09-28 12:21:52.199 28988 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:21:52 ctl02 nova-api[28988]: 2017-09-28 12:21:52.199 28988 ERROR nova.wsgi     self.filename))
Sep 28 12:21:52 ctl02 nova-api[28988]: 2017-09-28 12:21:52.199 28988 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:21:52 ctl02 nova-api[28988]: 2017-09-28 12:21:52.199 28988 ERROR nova.wsgi
Sep 28 12:21:52 ctl02 nova-api[28988]: 2017-09-28 12:21:52.202 28988 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:21:52 ctl02 nova-api[28988]: 2017-09-28 12:21:52.331 28988 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:21:52 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x162c6705)
Sep 28 12:21:52 ctl02 nova-api[28988]: 2017-09-28 12:21:52.562 28988 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:21:52 ctl02 nova-api[28988]: 2017-09-28 12:21:52.564 28988 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:21:52 ctl02 nova-api[28988]: 2017-09-28 12:21:52.565 28988 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:21:52 ctl02 nova-api[28988]: 2017-09-28 12:21:52.565 28988 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:21:52 ctl02 nova-api[28988]: 2017-09-28 12:21:52.697 28988 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:21:52 ctl02 nova-api[28988]: 2017-09-28 12:21:52.699 28988 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:21:52 ctl02 nova-api[28988]: 2017-09-28 12:21:52.700 28988 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:21:52 ctl02 nova-api[28988]: 2017-09-28 12:21:52.700 28988 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:21:52 ctl02 nova-api[28988]: 2017-09-28 12:21:52.703 28988 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:21:52 ctl02 nova-api[28988]: 2017-09-28 12:21:52.704 28988 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:21:52 ctl02 nova-api[28988]: 2017-09-28 12:21:52.704 28988 ERROR nova Traceback (most recent call last):
Sep 28 12:21:52 ctl02 nova-api[28988]: 2017-09-28 12:21:52.704 28988 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:21:52 ctl02 nova-api[28988]: 2017-09-28 12:21:52.704 28988 ERROR nova     sys.exit(main())
Sep 28 12:21:52 ctl02 nova-api[28988]: 2017-09-28 12:21:52.704 28988 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:21:52 ctl02 nova-api[28988]: 2017-09-28 12:21:52.704 28988 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:21:52 ctl02 nova-api[28988]: 2017-09-28 12:21:52.704 28988 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:21:52 ctl02 nova-api[28988]: 2017-09-28 12:21:52.704 28988 ERROR nova     max_url_len=max_url_len)
Sep 28 12:21:52 ctl02 nova-api[28988]: 2017-09-28 12:21:52.704 28988 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:21:52 ctl02 nova-api[28988]: 2017-09-28 12:21:52.704 28988 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:21:52 ctl02 nova-api[28988]: 2017-09-28 12:21:52.704 28988 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:21:52 ctl02 nova-api[28988]: 2017-09-28 12:21:52.704 28988 ERROR nova     sock.listen(backlog)
Sep 28 12:21:52 ctl02 nova-api[28988]: 2017-09-28 12:21:52.704 28988 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:21:52 ctl02 nova-api[28988]: 2017-09-28 12:21:52.704 28988 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:21:52 ctl02 nova-api[28988]: 2017-09-28 12:21:52.704 28988 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:21:52 ctl02 nova-api[28988]: 2017-09-28 12:21:52.704 28988 ERROR nova
Sep 28 12:21:52 ctl02 glance-api[29183]: 2017-09-28 12:21:52.736 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:21:52] "OPTIONS / HTTP/1.0" 200 134 0.000580
Sep 28 12:21:52 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:21:52 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:21:52 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:21:53 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:21:53 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:21:53 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:21:53 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:21:53 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:21:53.377 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:21:53] "OPTIONS / HTTP/1.0" 200 134 0.000590
Sep 28 12:21:53 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x162c6705)
Sep 28 12:21:54 ctl02 glance-api[29183]: 2017-09-28 12:21:54.153 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:21:54] "OPTIONS / HTTP/1.0" 200 134 0.000561
Sep 28 12:21:54 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x162c6705)
Sep 28 12:21:54 ctl02 nova-api[29006]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:21:54 ctl02 nova-api[29006]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:21:54 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:21:54.819 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:21:54] "OPTIONS / HTTP/1.0" 200 134 0.000548
Sep 28 12:21:54 ctl02 nova-api[29006]: 2017-09-28 12:21:54.976 29006 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:21:54 ctl02 nova-api[29006]: 2017-09-28 12:21:54.978 29006 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:21:54 ctl02 nova-api[29006]: 2017-09-28 12:21:54.978 29006 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:21:54 ctl02 nova-api[29006]: 2017-09-28 12:21:54.978 29006 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:21:54 ctl02 nova-api[29006]: 2017-09-28 12:21:54.978 29006 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:21:54 ctl02 nova-api[29006]: 2017-09-28 12:21:54.978 29006 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:21:54 ctl02 nova-api[29006]: 2017-09-28 12:21:54.978 29006 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:21:54 ctl02 nova-api[29006]: 2017-09-28 12:21:54.978 29006 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:21:54 ctl02 nova-api[29006]: 2017-09-28 12:21:54.978 29006 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:21:54 ctl02 nova-api[29006]: 2017-09-28 12:21:54.978 29006 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:21:54 ctl02 nova-api[29006]: 2017-09-28 12:21:54.978 29006 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:21:54 ctl02 nova-api[29006]: 2017-09-28 12:21:54.978 29006 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:21:54 ctl02 nova-api[29006]: 2017-09-28 12:21:54.978 29006 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:21:54 ctl02 nova-api[29006]: 2017-09-28 12:21:54.978 29006 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:21:54 ctl02 nova-api[29006]: 2017-09-28 12:21:54.978 29006 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:21:54 ctl02 nova-api[29006]: 2017-09-28 12:21:54.978 29006 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:21:54 ctl02 nova-api[29006]: 2017-09-28 12:21:54.978 29006 ERROR nova.wsgi     self.filename))
Sep 28 12:21:54 ctl02 nova-api[29006]: 2017-09-28 12:21:54.978 29006 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:21:54 ctl02 nova-api[29006]: 2017-09-28 12:21:54.978 29006 ERROR nova.wsgi
Sep 28 12:21:54 ctl02 nova-api[29006]: 2017-09-28 12:21:54.979 29006 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:21:55 ctl02 nova-api[29006]: 2017-09-28 12:21:55.105 29006 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:21:55 ctl02 nova-api[29006]: 2017-09-28 12:21:55.339 29006 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:21:55 ctl02 nova-api[29006]: 2017-09-28 12:21:55.341 29006 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:21:55 ctl02 nova-api[29006]: 2017-09-28 12:21:55.341 29006 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:21:55 ctl02 nova-api[29006]: 2017-09-28 12:21:55.341 29006 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:21:55 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:21:55 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:21:55 ctl02 nova-api[29006]: 2017-09-28 12:21:55.471 29006 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:21:55 ctl02 nova-api[29006]: 2017-09-28 12:21:55.473 29006 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:21:55 ctl02 nova-api[29006]: 2017-09-28 12:21:55.473 29006 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:21:55 ctl02 nova-api[29006]: 2017-09-28 12:21:55.473 29006 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:21:55 ctl02 nova-api[29006]: 2017-09-28 12:21:55.477 29006 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:21:55 ctl02 nova-api[29006]: 2017-09-28 12:21:55.477 29006 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:21:55 ctl02 nova-api[29006]: 2017-09-28 12:21:55.477 29006 ERROR nova Traceback (most recent call last):
Sep 28 12:21:55 ctl02 nova-api[29006]: 2017-09-28 12:21:55.477 29006 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:21:55 ctl02 nova-api[29006]: 2017-09-28 12:21:55.477 29006 ERROR nova     sys.exit(main())
Sep 28 12:21:55 ctl02 nova-api[29006]: 2017-09-28 12:21:55.477 29006 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:21:55 ctl02 nova-api[29006]: 2017-09-28 12:21:55.477 29006 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:21:55 ctl02 nova-api[29006]: 2017-09-28 12:21:55.477 29006 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:21:55 ctl02 nova-api[29006]: 2017-09-28 12:21:55.477 29006 ERROR nova     max_url_len=max_url_len)
Sep 28 12:21:55 ctl02 nova-api[29006]: 2017-09-28 12:21:55.477 29006 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:21:55 ctl02 nova-api[29006]: 2017-09-28 12:21:55.477 29006 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:21:55 ctl02 nova-api[29006]: 2017-09-28 12:21:55.477 29006 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:21:55 ctl02 nova-api[29006]: 2017-09-28 12:21:55.477 29006 ERROR nova     sock.listen(backlog)
Sep 28 12:21:55 ctl02 nova-api[29006]: 2017-09-28 12:21:55.477 29006 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:21:55 ctl02 nova-api[29006]: 2017-09-28 12:21:55.477 29006 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:21:55 ctl02 nova-api[29006]: 2017-09-28 12:21:55.477 29006 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:21:55 ctl02 nova-api[29006]: 2017-09-28 12:21:55.477 29006 ERROR nova
Sep 28 12:21:55 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:21:55 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:21:55 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:21:55 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:21:55 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:21:55 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:21:55 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:21:56 ctl02 heat-api[13008]: 2017-09-28 12:21:56.285 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:21:56] "OPTIONS / HTTP/1.0" 200 134 0.000809
Sep 28 12:21:56 ctl02 heat-api[13008]: 2017-09-28 12:21:56.592 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:21:56] "OPTIONS / HTTP/1.0" 200 134 0.000648
Sep 28 12:21:57 ctl02 nova-cert[4860]: 2017-09-28 12:21:57.190 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:21:57 ctl02 nova-api[29029]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:21:57 ctl02 nova-api[29029]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:21:57 ctl02 nova-api[29029]: 2017-09-28 12:21:57.770 29029 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:21:57 ctl02 nova-api[29029]: 2017-09-28 12:21:57.772 29029 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:21:57 ctl02 nova-api[29029]: 2017-09-28 12:21:57.772 29029 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:21:57 ctl02 nova-api[29029]: 2017-09-28 12:21:57.772 29029 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:21:57 ctl02 nova-api[29029]: 2017-09-28 12:21:57.772 29029 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:21:57 ctl02 nova-api[29029]: 2017-09-28 12:21:57.772 29029 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:21:57 ctl02 nova-api[29029]: 2017-09-28 12:21:57.772 29029 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:21:57 ctl02 nova-api[29029]: 2017-09-28 12:21:57.772 29029 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:21:57 ctl02 nova-api[29029]: 2017-09-28 12:21:57.772 29029 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:21:57 ctl02 nova-api[29029]: 2017-09-28 12:21:57.772 29029 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:21:57 ctl02 nova-api[29029]: 2017-09-28 12:21:57.772 29029 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:21:57 ctl02 nova-api[29029]: 2017-09-28 12:21:57.772 29029 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:21:57 ctl02 nova-api[29029]: 2017-09-28 12:21:57.772 29029 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:21:57 ctl02 nova-api[29029]: 2017-09-28 12:21:57.772 29029 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:21:57 ctl02 nova-api[29029]: 2017-09-28 12:21:57.772 29029 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:21:57 ctl02 nova-api[29029]: 2017-09-28 12:21:57.772 29029 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:21:57 ctl02 nova-api[29029]: 2017-09-28 12:21:57.772 29029 ERROR nova.wsgi     self.filename))
Sep 28 12:21:57 ctl02 nova-api[29029]: 2017-09-28 12:21:57.772 29029 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:21:57 ctl02 nova-api[29029]: 2017-09-28 12:21:57.772 29029 ERROR nova.wsgi
Sep 28 12:21:57 ctl02 nova-api[29029]: 2017-09-28 12:21:57.774 29029 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:21:57 ctl02 nova-api[29029]: 2017-09-28 12:21:57.907 29029 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:21:58 ctl02 nova-api[29029]: 2017-09-28 12:21:58.158 29029 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:21:58 ctl02 nova-api[29029]: 2017-09-28 12:21:58.160 29029 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:21:58 ctl02 nova-api[29029]: 2017-09-28 12:21:58.161 29029 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:21:58 ctl02 nova-api[29029]: 2017-09-28 12:21:58.161 29029 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:21:58 ctl02 nova-api[29029]: 2017-09-28 12:21:58.293 29029 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:21:58 ctl02 nova-api[29029]: 2017-09-28 12:21:58.295 29029 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:21:58 ctl02 nova-api[29029]: 2017-09-28 12:21:58.295 29029 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:21:58 ctl02 nova-api[29029]: 2017-09-28 12:21:58.296 29029 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:21:58 ctl02 nova-api[29029]: 2017-09-28 12:21:58.299 29029 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:21:58 ctl02 nova-api[29029]: 2017-09-28 12:21:58.299 29029 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:21:58 ctl02 nova-api[29029]: 2017-09-28 12:21:58.299 29029 ERROR nova Traceback (most recent call last):
Sep 28 12:21:58 ctl02 nova-api[29029]: 2017-09-28 12:21:58.299 29029 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:21:58 ctl02 nova-api[29029]: 2017-09-28 12:21:58.299 29029 ERROR nova     sys.exit(main())
Sep 28 12:21:58 ctl02 nova-api[29029]: 2017-09-28 12:21:58.299 29029 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:21:58 ctl02 nova-api[29029]: 2017-09-28 12:21:58.299 29029 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:21:58 ctl02 nova-api[29029]: 2017-09-28 12:21:58.299 29029 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:21:58 ctl02 nova-api[29029]: 2017-09-28 12:21:58.299 29029 ERROR nova     max_url_len=max_url_len)
Sep 28 12:21:58 ctl02 nova-api[29029]: 2017-09-28 12:21:58.299 29029 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:21:58 ctl02 nova-api[29029]: 2017-09-28 12:21:58.299 29029 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:21:58 ctl02 nova-api[29029]: 2017-09-28 12:21:58.299 29029 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:21:58 ctl02 nova-api[29029]: 2017-09-28 12:21:58.299 29029 ERROR nova     sock.listen(backlog)
Sep 28 12:21:58 ctl02 nova-api[29029]: 2017-09-28 12:21:58.299 29029 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:21:58 ctl02 nova-api[29029]: 2017-09-28 12:21:58.299 29029 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:21:58 ctl02 nova-api[29029]: 2017-09-28 12:21:58.299 29029 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:21:58 ctl02 nova-api[29029]: 2017-09-28 12:21:58.299 29029 ERROR nova
Sep 28 12:21:58 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:21:58 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:21:58 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:21:58 ctl02 nova-conductor[5056]: 2017-09-28 12:21:58.599 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:21:58 ctl02 nova-conductor[5056]: 2017-09-28 12:21:58.617 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:21:58 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:21:58 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:21:58 ctl02 nova-conductor[5056]: 2017-09-28 12:21:58.637 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:21:58 ctl02 nova-conductor[5056]: 2017-09-28 12:21:58.637 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:21:58 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:21:58 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:21:58 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:21:58.820 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:21:58] "OPTIONS / HTTP/1.0" 200 134 0.000484
Sep 28 12:21:59 ctl02 heat-api-cfn[13300]: 2017-09-28 12:21:59.438 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:21:59] "OPTIONS / HTTP/1.0" 200 134 0.000570
Sep 28 12:22:00 ctl02 heat-api-cfn[13300]: 2017-09-28 12:22:00.122 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:22:00] "OPTIONS / HTTP/1.0" 200 134 0.000559
Sep 28 12:22:00 ctl02 heat-api[13008]: 2017-09-28 12:22:00.259 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:22:00] "OPTIONS / HTTP/1.0" 200 134 0.000678
Sep 28 12:22:00 ctl02 nova-api[29046]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:22:00 ctl02 nova-api[29046]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:22:00 ctl02 nova-api[29046]: 2017-09-28 12:22:00.480 29046 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:22:00 ctl02 nova-api[29046]: 2017-09-28 12:22:00.482 29046 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:22:00 ctl02 nova-api[29046]: 2017-09-28 12:22:00.482 29046 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:22:00 ctl02 nova-api[29046]: 2017-09-28 12:22:00.482 29046 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:22:00 ctl02 nova-api[29046]: 2017-09-28 12:22:00.482 29046 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:22:00 ctl02 nova-api[29046]: 2017-09-28 12:22:00.482 29046 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:22:00 ctl02 nova-api[29046]: 2017-09-28 12:22:00.482 29046 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:22:00 ctl02 nova-api[29046]: 2017-09-28 12:22:00.482 29046 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:22:00 ctl02 nova-api[29046]: 2017-09-28 12:22:00.482 29046 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:22:00 ctl02 nova-api[29046]: 2017-09-28 12:22:00.482 29046 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:22:00 ctl02 nova-api[29046]: 2017-09-28 12:22:00.482 29046 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:22:00 ctl02 nova-api[29046]: 2017-09-28 12:22:00.482 29046 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:22:00 ctl02 nova-api[29046]: 2017-09-28 12:22:00.482 29046 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:22:00 ctl02 nova-api[29046]: 2017-09-28 12:22:00.482 29046 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:22:00 ctl02 nova-api[29046]: 2017-09-28 12:22:00.482 29046 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:22:00 ctl02 nova-api[29046]: 2017-09-28 12:22:00.482 29046 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:22:00 ctl02 nova-api[29046]: 2017-09-28 12:22:00.482 29046 ERROR nova.wsgi     self.filename))
Sep 28 12:22:00 ctl02 nova-api[29046]: 2017-09-28 12:22:00.482 29046 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:22:00 ctl02 nova-api[29046]: 2017-09-28 12:22:00.482 29046 ERROR nova.wsgi
Sep 28 12:22:00 ctl02 nova-api[29046]: 2017-09-28 12:22:00.483 29046 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:22:00 ctl02 nova-api[29046]: 2017-09-28 12:22:00.611 29046 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:22:00 ctl02 nova-api[29046]: 2017-09-28 12:22:00.841 29046 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:22:00 ctl02 nova-api[29046]: 2017-09-28 12:22:00.843 29046 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:22:00 ctl02 nova-api[29046]: 2017-09-28 12:22:00.844 29046 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:22:00 ctl02 nova-api[29046]: 2017-09-28 12:22:00.844 29046 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:22:00 ctl02 heat-api-cfn[13300]: 2017-09-28 12:22:00.889 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:22:00] "OPTIONS / HTTP/1.0" 200 134 0.000452
Sep 28 12:22:00 ctl02 nova-api[29046]: 2017-09-28 12:22:00.977 29046 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:22:00 ctl02 nova-api[29046]: 2017-09-28 12:22:00.979 29046 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:22:00 ctl02 nova-api[29046]: 2017-09-28 12:22:00.980 29046 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:22:00 ctl02 nova-api[29046]: 2017-09-28 12:22:00.980 29046 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:22:00 ctl02 nova-api[29046]: 2017-09-28 12:22:00.983 29046 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:22:00 ctl02 nova-api[29046]: 2017-09-28 12:22:00.983 29046 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:22:00 ctl02 nova-api[29046]: 2017-09-28 12:22:00.983 29046 ERROR nova Traceback (most recent call last):
Sep 28 12:22:00 ctl02 nova-api[29046]: 2017-09-28 12:22:00.983 29046 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:22:00 ctl02 nova-api[29046]: 2017-09-28 12:22:00.983 29046 ERROR nova     sys.exit(main())
Sep 28 12:22:00 ctl02 nova-api[29046]: 2017-09-28 12:22:00.983 29046 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:22:00 ctl02 nova-api[29046]: 2017-09-28 12:22:00.983 29046 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:22:00 ctl02 nova-api[29046]: 2017-09-28 12:22:00.983 29046 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:22:00 ctl02 nova-api[29046]: 2017-09-28 12:22:00.983 29046 ERROR nova     max_url_len=max_url_len)
Sep 28 12:22:00 ctl02 nova-api[29046]: 2017-09-28 12:22:00.983 29046 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:22:00 ctl02 nova-api[29046]: 2017-09-28 12:22:00.983 29046 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:22:00 ctl02 nova-api[29046]: 2017-09-28 12:22:00.983 29046 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:22:00 ctl02 nova-api[29046]: 2017-09-28 12:22:00.983 29046 ERROR nova     sock.listen(backlog)
Sep 28 12:22:00 ctl02 nova-api[29046]: 2017-09-28 12:22:00.983 29046 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:22:00 ctl02 nova-api[29046]: 2017-09-28 12:22:00.983 29046 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:22:00 ctl02 nova-api[29046]: 2017-09-28 12:22:00.983 29046 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:22:00 ctl02 nova-api[29046]: 2017-09-28 12:22:00.983 29046 ERROR nova
Sep 28 12:22:01 ctl02 glance-api[29183]: 2017-09-28 12:22:01.095 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:22:01] "OPTIONS / HTTP/1.0" 200 134 0.000580
Sep 28 12:22:01 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:22:01 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:22:01 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:22:01 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:22:01 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:22:01 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:22:01 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:22:02 ctl02 glance-api[29183]: 2017-09-28 12:22:02.345 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:22:02] "OPTIONS / HTTP/1.0" 200 134 0.000565
Sep 28 12:22:03 ctl02 nova-api[29065]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:22:03 ctl02 nova-api[29065]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:22:03 ctl02 nova-api[29065]: 2017-09-28 12:22:03.178 29065 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:22:03 ctl02 nova-api[29065]: 2017-09-28 12:22:03.180 29065 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:22:03 ctl02 nova-api[29065]: 2017-09-28 12:22:03.180 29065 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:22:03 ctl02 nova-api[29065]: 2017-09-28 12:22:03.180 29065 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:22:03 ctl02 nova-api[29065]: 2017-09-28 12:22:03.180 29065 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:22:03 ctl02 nova-api[29065]: 2017-09-28 12:22:03.180 29065 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:22:03 ctl02 nova-api[29065]: 2017-09-28 12:22:03.180 29065 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:22:03 ctl02 nova-api[29065]: 2017-09-28 12:22:03.180 29065 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:22:03 ctl02 nova-api[29065]: 2017-09-28 12:22:03.180 29065 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:22:03 ctl02 nova-api[29065]: 2017-09-28 12:22:03.180 29065 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:22:03 ctl02 nova-api[29065]: 2017-09-28 12:22:03.180 29065 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:22:03 ctl02 nova-api[29065]: 2017-09-28 12:22:03.180 29065 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:22:03 ctl02 nova-api[29065]: 2017-09-28 12:22:03.180 29065 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:22:03 ctl02 nova-api[29065]: 2017-09-28 12:22:03.180 29065 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:22:03 ctl02 nova-api[29065]: 2017-09-28 12:22:03.180 29065 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:22:03 ctl02 nova-api[29065]: 2017-09-28 12:22:03.180 29065 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:22:03 ctl02 nova-api[29065]: 2017-09-28 12:22:03.180 29065 ERROR nova.wsgi     self.filename))
Sep 28 12:22:03 ctl02 nova-api[29065]: 2017-09-28 12:22:03.180 29065 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:22:03 ctl02 nova-api[29065]: 2017-09-28 12:22:03.180 29065 ERROR nova.wsgi
Sep 28 12:22:03 ctl02 nova-api[29065]: 2017-09-28 12:22:03.182 29065 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:22:03 ctl02 nova-api[29065]: 2017-09-28 12:22:03.308 29065 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:22:03 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:22:03.361 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:22:03] "OPTIONS / HTTP/1.0" 200 134 0.000532
Sep 28 12:22:03 ctl02 nova-api[29065]: 2017-09-28 12:22:03.532 29065 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:22:03 ctl02 nova-api[29065]: 2017-09-28 12:22:03.534 29065 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:22:03 ctl02 nova-api[29065]: 2017-09-28 12:22:03.535 29065 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:22:03 ctl02 nova-api[29065]: 2017-09-28 12:22:03.535 29065 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:22:03 ctl02 nova-api[29065]: 2017-09-28 12:22:03.666 29065 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:22:03 ctl02 nova-api[29065]: 2017-09-28 12:22:03.668 29065 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:22:03 ctl02 nova-api[29065]: 2017-09-28 12:22:03.668 29065 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:22:03 ctl02 nova-api[29065]: 2017-09-28 12:22:03.669 29065 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:22:03 ctl02 nova-api[29065]: 2017-09-28 12:22:03.672 29065 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:22:03 ctl02 nova-api[29065]: 2017-09-28 12:22:03.673 29065 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:22:03 ctl02 nova-api[29065]: 2017-09-28 12:22:03.673 29065 ERROR nova Traceback (most recent call last):
Sep 28 12:22:03 ctl02 nova-api[29065]: 2017-09-28 12:22:03.673 29065 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:22:03 ctl02 nova-api[29065]: 2017-09-28 12:22:03.673 29065 ERROR nova     sys.exit(main())
Sep 28 12:22:03 ctl02 nova-api[29065]: 2017-09-28 12:22:03.673 29065 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:22:03 ctl02 nova-api[29065]: 2017-09-28 12:22:03.673 29065 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:22:03 ctl02 nova-api[29065]: 2017-09-28 12:22:03.673 29065 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:22:03 ctl02 nova-api[29065]: 2017-09-28 12:22:03.673 29065 ERROR nova     max_url_len=max_url_len)
Sep 28 12:22:03 ctl02 nova-api[29065]: 2017-09-28 12:22:03.673 29065 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:22:03 ctl02 nova-api[29065]: 2017-09-28 12:22:03.673 29065 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:22:03 ctl02 nova-api[29065]: 2017-09-28 12:22:03.673 29065 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:22:03 ctl02 nova-api[29065]: 2017-09-28 12:22:03.673 29065 ERROR nova     sock.listen(backlog)
Sep 28 12:22:03 ctl02 nova-api[29065]: 2017-09-28 12:22:03.673 29065 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:22:03 ctl02 nova-api[29065]: 2017-09-28 12:22:03.673 29065 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:22:03 ctl02 nova-api[29065]: 2017-09-28 12:22:03.673 29065 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:22:03 ctl02 nova-api[29065]: 2017-09-28 12:22:03.673 29065 ERROR nova
Sep 28 12:22:03 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:22:03 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:22:03 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:22:04 ctl02 glance-api[29183]: 2017-09-28 12:22:04.076 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:22:04] "OPTIONS / HTTP/1.0" 200 134 0.000899
Sep 28 12:22:04 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:22:04 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:22:04 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:22:04 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:22:05 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:22:05.192 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:22:05] "OPTIONS / HTTP/1.0" 200 134 0.000429
Sep 28 12:22:05 ctl02 nova-api[29083]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:22:05 ctl02 nova-api[29083]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:22:05 ctl02 nova-api[29083]: 2017-09-28 12:22:05.941 29083 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:22:05 ctl02 nova-api[29083]: 2017-09-28 12:22:05.943 29083 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:22:05 ctl02 nova-api[29083]: 2017-09-28 12:22:05.943 29083 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:22:05 ctl02 nova-api[29083]: 2017-09-28 12:22:05.943 29083 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:22:05 ctl02 nova-api[29083]: 2017-09-28 12:22:05.943 29083 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:22:05 ctl02 nova-api[29083]: 2017-09-28 12:22:05.943 29083 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:22:05 ctl02 nova-api[29083]: 2017-09-28 12:22:05.943 29083 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:22:05 ctl02 nova-api[29083]: 2017-09-28 12:22:05.943 29083 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:22:05 ctl02 nova-api[29083]: 2017-09-28 12:22:05.943 29083 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:22:05 ctl02 nova-api[29083]: 2017-09-28 12:22:05.943 29083 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:22:05 ctl02 nova-api[29083]: 2017-09-28 12:22:05.943 29083 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:22:05 ctl02 nova-api[29083]: 2017-09-28 12:22:05.943 29083 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:22:05 ctl02 nova-api[29083]: 2017-09-28 12:22:05.943 29083 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:22:05 ctl02 nova-api[29083]: 2017-09-28 12:22:05.943 29083 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:22:05 ctl02 nova-api[29083]: 2017-09-28 12:22:05.943 29083 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:22:05 ctl02 nova-api[29083]: 2017-09-28 12:22:05.943 29083 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:22:05 ctl02 nova-api[29083]: 2017-09-28 12:22:05.943 29083 ERROR nova.wsgi     self.filename))
Sep 28 12:22:05 ctl02 nova-api[29083]: 2017-09-28 12:22:05.943 29083 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:22:05 ctl02 nova-api[29083]: 2017-09-28 12:22:05.943 29083 ERROR nova.wsgi
Sep 28 12:22:05 ctl02 nova-api[29083]: 2017-09-28 12:22:05.944 29083 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:22:05 ctl02 heat-api[13008]: 2017-09-28 12:22:05.975 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:22:05] "OPTIONS / HTTP/1.0" 200 134 0.000584
Sep 28 12:22:06 ctl02 nova-api[29083]: 2017-09-28 12:22:06.072 29083 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:22:06 ctl02 heat-api[13008]: 2017-09-28 12:22:06.288 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:22:06] "OPTIONS / HTTP/1.0" 200 134 0.000597
Sep 28 12:22:06 ctl02 nova-api[29083]: 2017-09-28 12:22:06.306 29083 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:22:06 ctl02 nova-api[29083]: 2017-09-28 12:22:06.308 29083 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:22:06 ctl02 nova-api[29083]: 2017-09-28 12:22:06.308 29083 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:22:06 ctl02 nova-api[29083]: 2017-09-28 12:22:06.308 29083 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:22:06 ctl02 nova-api[29083]: 2017-09-28 12:22:06.438 29083 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:22:06 ctl02 nova-api[29083]: 2017-09-28 12:22:06.440 29083 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:22:06 ctl02 nova-api[29083]: 2017-09-28 12:22:06.440 29083 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:22:06 ctl02 nova-api[29083]: 2017-09-28 12:22:06.440 29083 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:22:06 ctl02 nova-api[29083]: 2017-09-28 12:22:06.443 29083 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:22:06 ctl02 nova-api[29083]: 2017-09-28 12:22:06.444 29083 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:22:06 ctl02 nova-api[29083]: 2017-09-28 12:22:06.444 29083 ERROR nova Traceback (most recent call last):
Sep 28 12:22:06 ctl02 nova-api[29083]: 2017-09-28 12:22:06.444 29083 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:22:06 ctl02 nova-api[29083]: 2017-09-28 12:22:06.444 29083 ERROR nova     sys.exit(main())
Sep 28 12:22:06 ctl02 nova-api[29083]: 2017-09-28 12:22:06.444 29083 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:22:06 ctl02 nova-api[29083]: 2017-09-28 12:22:06.444 29083 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:22:06 ctl02 nova-api[29083]: 2017-09-28 12:22:06.444 29083 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:22:06 ctl02 nova-api[29083]: 2017-09-28 12:22:06.444 29083 ERROR nova     max_url_len=max_url_len)
Sep 28 12:22:06 ctl02 nova-api[29083]: 2017-09-28 12:22:06.444 29083 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:22:06 ctl02 nova-api[29083]: 2017-09-28 12:22:06.444 29083 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:22:06 ctl02 nova-api[29083]: 2017-09-28 12:22:06.444 29083 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:22:06 ctl02 nova-api[29083]: 2017-09-28 12:22:06.444 29083 ERROR nova     sock.listen(backlog)
Sep 28 12:22:06 ctl02 nova-api[29083]: 2017-09-28 12:22:06.444 29083 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:22:06 ctl02 nova-api[29083]: 2017-09-28 12:22:06.444 29083 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:22:06 ctl02 nova-api[29083]: 2017-09-28 12:22:06.444 29083 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:22:06 ctl02 nova-api[29083]: 2017-09-28 12:22:06.444 29083 ERROR nova
Sep 28 12:22:06 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:22:06 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:22:06 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:22:06 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:22:06 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:22:06 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:22:06 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:22:07 ctl02 nova-consoleauth[5433]: 2017-09-28 12:22:07.070 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:22:08 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:22:08.569 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:22:08] "OPTIONS / HTTP/1.0" 200 134 0.000462
Sep 28 12:22:08 ctl02 nova-api[29101]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:22:08 ctl02 nova-api[29101]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:22:08 ctl02 nova-api[29101]: 2017-09-28 12:22:08.767 29101 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:22:08 ctl02 nova-api[29101]: 2017-09-28 12:22:08.769 29101 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:22:08 ctl02 nova-api[29101]: 2017-09-28 12:22:08.769 29101 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:22:08 ctl02 nova-api[29101]: 2017-09-28 12:22:08.769 29101 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:22:08 ctl02 nova-api[29101]: 2017-09-28 12:22:08.769 29101 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:22:08 ctl02 nova-api[29101]: 2017-09-28 12:22:08.769 29101 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:22:08 ctl02 nova-api[29101]: 2017-09-28 12:22:08.769 29101 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:22:08 ctl02 nova-api[29101]: 2017-09-28 12:22:08.769 29101 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:22:08 ctl02 nova-api[29101]: 2017-09-28 12:22:08.769 29101 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:22:08 ctl02 nova-api[29101]: 2017-09-28 12:22:08.769 29101 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:22:08 ctl02 nova-api[29101]: 2017-09-28 12:22:08.769 29101 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:22:08 ctl02 nova-api[29101]: 2017-09-28 12:22:08.769 29101 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:22:08 ctl02 nova-api[29101]: 2017-09-28 12:22:08.769 29101 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:22:08 ctl02 nova-api[29101]: 2017-09-28 12:22:08.769 29101 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:22:08 ctl02 nova-api[29101]: 2017-09-28 12:22:08.769 29101 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:22:08 ctl02 nova-api[29101]: 2017-09-28 12:22:08.769 29101 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:22:08 ctl02 nova-api[29101]: 2017-09-28 12:22:08.769 29101 ERROR nova.wsgi     self.filename))
Sep 28 12:22:08 ctl02 nova-api[29101]: 2017-09-28 12:22:08.769 29101 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:22:08 ctl02 nova-api[29101]: 2017-09-28 12:22:08.769 29101 ERROR nova.wsgi
Sep 28 12:22:08 ctl02 nova-api[29101]: 2017-09-28 12:22:08.770 29101 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:22:08 ctl02 nova-api[29101]: 2017-09-28 12:22:08.905 29101 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:22:09 ctl02 nova-api[29101]: 2017-09-28 12:22:09.156 29101 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:22:09 ctl02 nova-api[29101]: 2017-09-28 12:22:09.158 29101 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:22:09 ctl02 nova-api[29101]: 2017-09-28 12:22:09.158 29101 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:22:09 ctl02 nova-api[29101]: 2017-09-28 12:22:09.158 29101 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:22:09 ctl02 nova-api[29101]: 2017-09-28 12:22:09.292 29101 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:22:09 ctl02 nova-api[29101]: 2017-09-28 12:22:09.294 29101 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:22:09 ctl02 nova-api[29101]: 2017-09-28 12:22:09.294 29101 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:22:09 ctl02 nova-api[29101]: 2017-09-28 12:22:09.294 29101 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:22:09 ctl02 nova-api[29101]: 2017-09-28 12:22:09.298 29101 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:22:09 ctl02 nova-api[29101]: 2017-09-28 12:22:09.298 29101 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:22:09 ctl02 nova-api[29101]: 2017-09-28 12:22:09.298 29101 ERROR nova Traceback (most recent call last):
Sep 28 12:22:09 ctl02 nova-api[29101]: 2017-09-28 12:22:09.298 29101 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:22:09 ctl02 nova-api[29101]: 2017-09-28 12:22:09.298 29101 ERROR nova     sys.exit(main())
Sep 28 12:22:09 ctl02 nova-api[29101]: 2017-09-28 12:22:09.298 29101 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:22:09 ctl02 nova-api[29101]: 2017-09-28 12:22:09.298 29101 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:22:09 ctl02 nova-api[29101]: 2017-09-28 12:22:09.298 29101 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:22:09 ctl02 nova-api[29101]: 2017-09-28 12:22:09.298 29101 ERROR nova     max_url_len=max_url_len)
Sep 28 12:22:09 ctl02 nova-api[29101]: 2017-09-28 12:22:09.298 29101 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:22:09 ctl02 nova-api[29101]: 2017-09-28 12:22:09.298 29101 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:22:09 ctl02 nova-api[29101]: 2017-09-28 12:22:09.298 29101 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:22:09 ctl02 nova-api[29101]: 2017-09-28 12:22:09.298 29101 ERROR nova     sock.listen(backlog)
Sep 28 12:22:09 ctl02 nova-api[29101]: 2017-09-28 12:22:09.298 29101 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:22:09 ctl02 nova-api[29101]: 2017-09-28 12:22:09.298 29101 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:22:09 ctl02 nova-api[29101]: 2017-09-28 12:22:09.298 29101 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:22:09 ctl02 nova-api[29101]: 2017-09-28 12:22:09.298 29101 ERROR nova
Sep 28 12:22:09 ctl02 heat-api-cfn[13300]: 2017-09-28 12:22:09.404 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:22:09] "OPTIONS / HTTP/1.0" 200 134 0.000610
Sep 28 12:22:09 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:22:09 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:22:09 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:22:09 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:22:09 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:22:09 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:22:09 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:22:09 ctl02 heat-engine[12803]: 2017-09-28 12:22:09.713 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:22:09 ctl02 heat-engine[12803]: 2017-09-28 12:22:09.718 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:22:09 ctl02 heat-engine[12803]: 2017-09-28 12:22:09.719 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:22:09 ctl02 heat-engine[12803]: 2017-09-28 12:22:09.731 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:22:09 ctl02 heat-api-cfn[13300]: 2017-09-28 12:22:09.874 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:22:09] "OPTIONS / HTTP/1.0" 200 134 0.000463
Sep 28 12:22:10 ctl02 nova-scheduler[5620]: 2017-09-28 12:22:10.094 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:22:10 ctl02 heat-api[13008]: 2017-09-28 12:22:10.119 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:22:10] "OPTIONS / HTTP/1.0" 200 134 0.000535
Sep 28 12:22:10 ctl02 heat-api-cfn[13300]: 2017-09-28 12:22:10.963 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:22:10] "OPTIONS / HTTP/1.0" 200 134 0.000431
Sep 28 12:22:11 ctl02 glance-api[29183]: 2017-09-28 12:22:11.200 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:22:11] "OPTIONS / HTTP/1.0" 200 134 0.000596
Sep 28 12:22:11 ctl02 nova-api[29119]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:22:11 ctl02 nova-api[29119]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:22:11 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1b4e0a66)
Sep 28 12:22:11 ctl02 nova-api[29119]: 2017-09-28 12:22:11.514 29119 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:22:11 ctl02 nova-api[29119]: 2017-09-28 12:22:11.516 29119 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:22:11 ctl02 nova-api[29119]: 2017-09-28 12:22:11.516 29119 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:22:11 ctl02 nova-api[29119]: 2017-09-28 12:22:11.516 29119 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:22:11 ctl02 nova-api[29119]: 2017-09-28 12:22:11.516 29119 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:22:11 ctl02 nova-api[29119]: 2017-09-28 12:22:11.516 29119 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:22:11 ctl02 nova-api[29119]: 2017-09-28 12:22:11.516 29119 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:22:11 ctl02 nova-api[29119]: 2017-09-28 12:22:11.516 29119 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:22:11 ctl02 nova-api[29119]: 2017-09-28 12:22:11.516 29119 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:22:11 ctl02 nova-api[29119]: 2017-09-28 12:22:11.516 29119 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:22:11 ctl02 nova-api[29119]: 2017-09-28 12:22:11.516 29119 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:22:11 ctl02 nova-api[29119]: 2017-09-28 12:22:11.516 29119 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:22:11 ctl02 nova-api[29119]: 2017-09-28 12:22:11.516 29119 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:22:11 ctl02 nova-api[29119]: 2017-09-28 12:22:11.516 29119 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:22:11 ctl02 nova-api[29119]: 2017-09-28 12:22:11.516 29119 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:22:11 ctl02 nova-api[29119]: 2017-09-28 12:22:11.516 29119 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:22:11 ctl02 nova-api[29119]: 2017-09-28 12:22:11.516 29119 ERROR nova.wsgi     self.filename))
Sep 28 12:22:11 ctl02 nova-api[29119]: 2017-09-28 12:22:11.516 29119 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:22:11 ctl02 nova-api[29119]: 2017-09-28 12:22:11.516 29119 ERROR nova.wsgi
Sep 28 12:22:11 ctl02 nova-api[29119]: 2017-09-28 12:22:11.517 29119 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:22:11 ctl02 nova-api[29119]: 2017-09-28 12:22:11.652 29119 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:22:11 ctl02 nova-api[29119]: 2017-09-28 12:22:11.906 29119 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:22:11 ctl02 nova-api[29119]: 2017-09-28 12:22:11.909 29119 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:22:11 ctl02 nova-api[29119]: 2017-09-28 12:22:11.909 29119 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:22:11 ctl02 nova-api[29119]: 2017-09-28 12:22:11.909 29119 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:22:12 ctl02 nova-api[29119]: 2017-09-28 12:22:12.043 29119 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:22:12 ctl02 nova-api[29119]: 2017-09-28 12:22:12.045 29119 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:22:12 ctl02 nova-api[29119]: 2017-09-28 12:22:12.045 29119 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:22:12 ctl02 nova-api[29119]: 2017-09-28 12:22:12.046 29119 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:22:12 ctl02 nova-api[29119]: 2017-09-28 12:22:12.049 29119 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:22:12 ctl02 nova-api[29119]: 2017-09-28 12:22:12.050 29119 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:22:12 ctl02 nova-api[29119]: 2017-09-28 12:22:12.050 29119 ERROR nova Traceback (most recent call last):
Sep 28 12:22:12 ctl02 nova-api[29119]: 2017-09-28 12:22:12.050 29119 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:22:12 ctl02 nova-api[29119]: 2017-09-28 12:22:12.050 29119 ERROR nova     sys.exit(main())
Sep 28 12:22:12 ctl02 nova-api[29119]: 2017-09-28 12:22:12.050 29119 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:22:12 ctl02 nova-api[29119]: 2017-09-28 12:22:12.050 29119 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:22:12 ctl02 nova-api[29119]: 2017-09-28 12:22:12.050 29119 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:22:12 ctl02 nova-api[29119]: 2017-09-28 12:22:12.050 29119 ERROR nova     max_url_len=max_url_len)
Sep 28 12:22:12 ctl02 nova-api[29119]: 2017-09-28 12:22:12.050 29119 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:22:12 ctl02 nova-api[29119]: 2017-09-28 12:22:12.050 29119 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:22:12 ctl02 nova-api[29119]: 2017-09-28 12:22:12.050 29119 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:22:12 ctl02 nova-api[29119]: 2017-09-28 12:22:12.050 29119 ERROR nova     sock.listen(backlog)
Sep 28 12:22:12 ctl02 nova-api[29119]: 2017-09-28 12:22:12.050 29119 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:22:12 ctl02 nova-api[29119]: 2017-09-28 12:22:12.050 29119 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:22:12 ctl02 nova-api[29119]: 2017-09-28 12:22:12.050 29119 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:22:12 ctl02 nova-api[29119]: 2017-09-28 12:22:12.050 29119 ERROR nova
Sep 28 12:22:12 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:22:12 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:22:12 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:22:12 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:22:12 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:22:12 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:22:12 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:22:12 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1b4e0a66)
Sep 28 12:22:12 ctl02 glance-api[29183]: 2017-09-28 12:22:12.600 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:22:12] "OPTIONS / HTTP/1.0" 200 134 0.000704
Sep 28 12:22:13 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:22:13.116 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:22:13] "OPTIONS / HTTP/1.0" 200 134 0.000504
Sep 28 12:22:13 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1b4e0a66)
Sep 28 12:22:14 ctl02 nova-api[29136]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:22:14 ctl02 nova-api[29136]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:22:14 ctl02 nova-api[29136]: 2017-09-28 12:22:14.241 29136 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:22:14 ctl02 nova-api[29136]: 2017-09-28 12:22:14.243 29136 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:22:14 ctl02 nova-api[29136]: 2017-09-28 12:22:14.243 29136 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:22:14 ctl02 nova-api[29136]: 2017-09-28 12:22:14.243 29136 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:22:14 ctl02 nova-api[29136]: 2017-09-28 12:22:14.243 29136 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:22:14 ctl02 nova-api[29136]: 2017-09-28 12:22:14.243 29136 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:22:14 ctl02 nova-api[29136]: 2017-09-28 12:22:14.243 29136 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:22:14 ctl02 nova-api[29136]: 2017-09-28 12:22:14.243 29136 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:22:14 ctl02 nova-api[29136]: 2017-09-28 12:22:14.243 29136 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:22:14 ctl02 nova-api[29136]: 2017-09-28 12:22:14.243 29136 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:22:14 ctl02 nova-api[29136]: 2017-09-28 12:22:14.243 29136 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:22:14 ctl02 nova-api[29136]: 2017-09-28 12:22:14.243 29136 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:22:14 ctl02 nova-api[29136]: 2017-09-28 12:22:14.243 29136 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:22:14 ctl02 nova-api[29136]: 2017-09-28 12:22:14.243 29136 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:22:14 ctl02 nova-api[29136]: 2017-09-28 12:22:14.243 29136 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:22:14 ctl02 nova-api[29136]: 2017-09-28 12:22:14.243 29136 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:22:14 ctl02 nova-api[29136]: 2017-09-28 12:22:14.243 29136 ERROR nova.wsgi     self.filename))
Sep 28 12:22:14 ctl02 nova-api[29136]: 2017-09-28 12:22:14.243 29136 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:22:14 ctl02 nova-api[29136]: 2017-09-28 12:22:14.243 29136 ERROR nova.wsgi
Sep 28 12:22:14 ctl02 nova-api[29136]: 2017-09-28 12:22:14.246 29136 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:22:14 ctl02 nova-api[29136]: 2017-09-28 12:22:14.380 29136 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:22:14 ctl02 glance-api[29183]: 2017-09-28 12:22:14.390 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:22:14] "OPTIONS / HTTP/1.0" 200 134 0.000638
Sep 28 12:22:14 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1b4e0a66)
Sep 28 12:22:14 ctl02 nova-api[29136]: 2017-09-28 12:22:14.633 29136 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:22:14 ctl02 nova-api[29136]: 2017-09-28 12:22:14.636 29136 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:22:14 ctl02 nova-api[29136]: 2017-09-28 12:22:14.636 29136 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:22:14 ctl02 nova-api[29136]: 2017-09-28 12:22:14.636 29136 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:22:14 ctl02 nova-api[29136]: 2017-09-28 12:22:14.769 29136 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:22:14 ctl02 nova-api[29136]: 2017-09-28 12:22:14.771 29136 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:22:14 ctl02 nova-api[29136]: 2017-09-28 12:22:14.771 29136 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:22:14 ctl02 nova-api[29136]: 2017-09-28 12:22:14.772 29136 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:22:14 ctl02 nova-api[29136]: 2017-09-28 12:22:14.775 29136 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:22:14 ctl02 nova-api[29136]: 2017-09-28 12:22:14.775 29136 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:22:14 ctl02 nova-api[29136]: 2017-09-28 12:22:14.775 29136 ERROR nova Traceback (most recent call last):
Sep 28 12:22:14 ctl02 nova-api[29136]: 2017-09-28 12:22:14.775 29136 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:22:14 ctl02 nova-api[29136]: 2017-09-28 12:22:14.775 29136 ERROR nova     sys.exit(main())
Sep 28 12:22:14 ctl02 nova-api[29136]: 2017-09-28 12:22:14.775 29136 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:22:14 ctl02 nova-api[29136]: 2017-09-28 12:22:14.775 29136 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:22:14 ctl02 nova-api[29136]: 2017-09-28 12:22:14.775 29136 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:22:14 ctl02 nova-api[29136]: 2017-09-28 12:22:14.775 29136 ERROR nova     max_url_len=max_url_len)
Sep 28 12:22:14 ctl02 nova-api[29136]: 2017-09-28 12:22:14.775 29136 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:22:14 ctl02 nova-api[29136]: 2017-09-28 12:22:14.775 29136 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:22:14 ctl02 nova-api[29136]: 2017-09-28 12:22:14.775 29136 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:22:14 ctl02 nova-api[29136]: 2017-09-28 12:22:14.775 29136 ERROR nova     sock.listen(backlog)
Sep 28 12:22:14 ctl02 nova-api[29136]: 2017-09-28 12:22:14.775 29136 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:22:14 ctl02 nova-api[29136]: 2017-09-28 12:22:14.775 29136 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:22:14 ctl02 nova-api[29136]: 2017-09-28 12:22:14.775 29136 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:22:14 ctl02 nova-api[29136]: 2017-09-28 12:22:14.775 29136 ERROR nova
Sep 28 12:22:14 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:22:14 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:22:14 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:22:15 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:22:15 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:22:15 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:22:15 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:22:15 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1b4e0a66)
Sep 28 12:22:15 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:22:15.564 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:22:15] "OPTIONS / HTTP/1.0" 200 134 0.000476
Sep 28 12:22:15 ctl02 heat-api[13008]: 2017-09-28 12:22:15.709 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:22:15] "OPTIONS / HTTP/1.0" 200 134 0.000674
Sep 28 12:22:16 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1b4e0a66)
Sep 28 12:22:16 ctl02 heat-api[13008]: 2017-09-28 12:22:16.502 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:22:16] "OPTIONS / HTTP/1.0" 200 134 0.000668
Sep 28 12:22:16 ctl02 nova-api[29155]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:22:16 ctl02 nova-api[29155]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:22:17 ctl02 nova-api[29155]: 2017-09-28 12:22:17.011 29155 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:22:17 ctl02 nova-api[29155]: 2017-09-28 12:22:17.013 29155 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:22:17 ctl02 nova-api[29155]: 2017-09-28 12:22:17.013 29155 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:22:17 ctl02 nova-api[29155]: 2017-09-28 12:22:17.013 29155 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:22:17 ctl02 nova-api[29155]: 2017-09-28 12:22:17.013 29155 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:22:17 ctl02 nova-api[29155]: 2017-09-28 12:22:17.013 29155 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:22:17 ctl02 nova-api[29155]: 2017-09-28 12:22:17.013 29155 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:22:17 ctl02 nova-api[29155]: 2017-09-28 12:22:17.013 29155 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:22:17 ctl02 nova-api[29155]: 2017-09-28 12:22:17.013 29155 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:22:17 ctl02 nova-api[29155]: 2017-09-28 12:22:17.013 29155 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:22:17 ctl02 nova-api[29155]: 2017-09-28 12:22:17.013 29155 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:22:17 ctl02 nova-api[29155]: 2017-09-28 12:22:17.013 29155 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:22:17 ctl02 nova-api[29155]: 2017-09-28 12:22:17.013 29155 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:22:17 ctl02 nova-api[29155]: 2017-09-28 12:22:17.013 29155 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:22:17 ctl02 nova-api[29155]: 2017-09-28 12:22:17.013 29155 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:22:17 ctl02 nova-api[29155]: 2017-09-28 12:22:17.013 29155 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:22:17 ctl02 nova-api[29155]: 2017-09-28 12:22:17.013 29155 ERROR nova.wsgi     self.filename))
Sep 28 12:22:17 ctl02 nova-api[29155]: 2017-09-28 12:22:17.013 29155 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:22:17 ctl02 nova-api[29155]: 2017-09-28 12:22:17.013 29155 ERROR nova.wsgi
Sep 28 12:22:17 ctl02 nova-api[29155]: 2017-09-28 12:22:17.015 29155 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:22:17 ctl02 nova-api[29155]: 2017-09-28 12:22:17.151 29155 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:22:17 ctl02 nova-api[29155]: 2017-09-28 12:22:17.405 29155 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:22:17 ctl02 nova-api[29155]: 2017-09-28 12:22:17.408 29155 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:22:17 ctl02 nova-api[29155]: 2017-09-28 12:22:17.408 29155 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:22:17 ctl02 nova-api[29155]: 2017-09-28 12:22:17.409 29155 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:22:17 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1b4e0a66)
Sep 28 12:22:17 ctl02 nova-api[29155]: 2017-09-28 12:22:17.544 29155 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:22:17 ctl02 nova-api[29155]: 2017-09-28 12:22:17.547 29155 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:22:17 ctl02 nova-api[29155]: 2017-09-28 12:22:17.547 29155 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:22:17 ctl02 nova-api[29155]: 2017-09-28 12:22:17.547 29155 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:22:17 ctl02 nova-api[29155]: 2017-09-28 12:22:17.551 29155 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:22:17 ctl02 nova-api[29155]: 2017-09-28 12:22:17.551 29155 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:22:17 ctl02 nova-api[29155]: 2017-09-28 12:22:17.551 29155 ERROR nova Traceback (most recent call last):
Sep 28 12:22:17 ctl02 nova-api[29155]: 2017-09-28 12:22:17.551 29155 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:22:17 ctl02 nova-api[29155]: 2017-09-28 12:22:17.551 29155 ERROR nova     sys.exit(main())
Sep 28 12:22:17 ctl02 nova-api[29155]: 2017-09-28 12:22:17.551 29155 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:22:17 ctl02 nova-api[29155]: 2017-09-28 12:22:17.551 29155 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:22:17 ctl02 nova-api[29155]: 2017-09-28 12:22:17.551 29155 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:22:17 ctl02 nova-api[29155]: 2017-09-28 12:22:17.551 29155 ERROR nova     max_url_len=max_url_len)
Sep 28 12:22:17 ctl02 nova-api[29155]: 2017-09-28 12:22:17.551 29155 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:22:17 ctl02 nova-api[29155]: 2017-09-28 12:22:17.551 29155 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:22:17 ctl02 nova-api[29155]: 2017-09-28 12:22:17.551 29155 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:22:17 ctl02 nova-api[29155]: 2017-09-28 12:22:17.551 29155 ERROR nova     sock.listen(backlog)
Sep 28 12:22:17 ctl02 nova-api[29155]: 2017-09-28 12:22:17.551 29155 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:22:17 ctl02 nova-api[29155]: 2017-09-28 12:22:17.551 29155 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:22:17 ctl02 nova-api[29155]: 2017-09-28 12:22:17.551 29155 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:22:17 ctl02 nova-api[29155]: 2017-09-28 12:22:17.551 29155 ERROR nova
Sep 28 12:22:17 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:22:17 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:22:17 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:22:17 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:22:17 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:22:17 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:22:17 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:22:18 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1b4e0a66)
Sep 28 12:22:18 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:22:18.964 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:22:18] "OPTIONS / HTTP/1.0" 200 134 0.000548
Sep 28 12:22:19 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1b4e0a66)
Sep 28 12:22:19 ctl02 nova-api[29174]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:22:19 ctl02 nova-api[29174]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:22:19 ctl02 nova-api[29174]: 2017-09-28 12:22:19.743 29174 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:22:19 ctl02 nova-api[29174]: 2017-09-28 12:22:19.746 29174 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:22:19 ctl02 nova-api[29174]: 2017-09-28 12:22:19.746 29174 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:22:19 ctl02 nova-api[29174]: 2017-09-28 12:22:19.746 29174 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:22:19 ctl02 nova-api[29174]: 2017-09-28 12:22:19.746 29174 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:22:19 ctl02 nova-api[29174]: 2017-09-28 12:22:19.746 29174 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:22:19 ctl02 nova-api[29174]: 2017-09-28 12:22:19.746 29174 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:22:19 ctl02 nova-api[29174]: 2017-09-28 12:22:19.746 29174 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:22:19 ctl02 nova-api[29174]: 2017-09-28 12:22:19.746 29174 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:22:19 ctl02 nova-api[29174]: 2017-09-28 12:22:19.746 29174 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:22:19 ctl02 nova-api[29174]: 2017-09-28 12:22:19.746 29174 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:22:19 ctl02 nova-api[29174]: 2017-09-28 12:22:19.746 29174 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:22:19 ctl02 nova-api[29174]: 2017-09-28 12:22:19.746 29174 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:22:19 ctl02 nova-api[29174]: 2017-09-28 12:22:19.746 29174 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:22:19 ctl02 nova-api[29174]: 2017-09-28 12:22:19.746 29174 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:22:19 ctl02 nova-api[29174]: 2017-09-28 12:22:19.746 29174 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:22:19 ctl02 nova-api[29174]: 2017-09-28 12:22:19.746 29174 ERROR nova.wsgi     self.filename))
Sep 28 12:22:19 ctl02 nova-api[29174]: 2017-09-28 12:22:19.746 29174 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:22:19 ctl02 nova-api[29174]: 2017-09-28 12:22:19.746 29174 ERROR nova.wsgi
Sep 28 12:22:19 ctl02 nova-api[29174]: 2017-09-28 12:22:19.748 29174 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:22:19 ctl02 heat-api-cfn[13300]: 2017-09-28 12:22:19.764 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:22:19] "OPTIONS / HTTP/1.0" 200 134 0.000649
Sep 28 12:22:19 ctl02 nova-api[29174]: 2017-09-28 12:22:19.881 29174 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:22:19 ctl02 heat-api-cfn[13300]: 2017-09-28 12:22:19.984 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:22:19] "OPTIONS / HTTP/1.0" 200 134 0.000667
Sep 28 12:22:20 ctl02 nova-api[29174]: 2017-09-28 12:22:20.133 29174 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:22:20 ctl02 nova-api[29174]: 2017-09-28 12:22:20.136 29174 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:22:20 ctl02 nova-api[29174]: 2017-09-28 12:22:20.136 29174 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:22:20 ctl02 nova-api[29174]: 2017-09-28 12:22:20.137 29174 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:22:20 ctl02 heat-api[13008]: 2017-09-28 12:22:20.251 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:22:20] "OPTIONS / HTTP/1.0" 200 134 0.000696
Sep 28 12:22:20 ctl02 nova-api[29174]: 2017-09-28 12:22:20.271 29174 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:22:20 ctl02 nova-api[29174]: 2017-09-28 12:22:20.273 29174 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:22:20 ctl02 nova-api[29174]: 2017-09-28 12:22:20.273 29174 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:22:20 ctl02 nova-api[29174]: 2017-09-28 12:22:20.274 29174 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:22:20 ctl02 nova-api[29174]: 2017-09-28 12:22:20.277 29174 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:22:20 ctl02 nova-api[29174]: 2017-09-28 12:22:20.277 29174 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:22:20 ctl02 nova-api[29174]: 2017-09-28 12:22:20.277 29174 ERROR nova Traceback (most recent call last):
Sep 28 12:22:20 ctl02 nova-api[29174]: 2017-09-28 12:22:20.277 29174 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:22:20 ctl02 nova-api[29174]: 2017-09-28 12:22:20.277 29174 ERROR nova     sys.exit(main())
Sep 28 12:22:20 ctl02 nova-api[29174]: 2017-09-28 12:22:20.277 29174 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:22:20 ctl02 nova-api[29174]: 2017-09-28 12:22:20.277 29174 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:22:20 ctl02 nova-api[29174]: 2017-09-28 12:22:20.277 29174 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:22:20 ctl02 nova-api[29174]: 2017-09-28 12:22:20.277 29174 ERROR nova     max_url_len=max_url_len)
Sep 28 12:22:20 ctl02 nova-api[29174]: 2017-09-28 12:22:20.277 29174 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:22:20 ctl02 nova-api[29174]: 2017-09-28 12:22:20.277 29174 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:22:20 ctl02 nova-api[29174]: 2017-09-28 12:22:20.277 29174 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:22:20 ctl02 nova-api[29174]: 2017-09-28 12:22:20.277 29174 ERROR nova     sock.listen(backlog)
Sep 28 12:22:20 ctl02 nova-api[29174]: 2017-09-28 12:22:20.277 29174 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:22:20 ctl02 nova-api[29174]: 2017-09-28 12:22:20.277 29174 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:22:20 ctl02 nova-api[29174]: 2017-09-28 12:22:20.277 29174 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:22:20 ctl02 nova-api[29174]: 2017-09-28 12:22:20.277 29174 ERROR nova
Sep 28 12:22:20 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:22:20 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:22:20 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:22:20 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1b4e0a66)
Sep 28 12:22:20 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:22:20 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:22:20 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:22:20 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:22:20 ctl02 heat-api-cfn[13300]: 2017-09-28 12:22:20.716 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:22:20] "OPTIONS / HTTP/1.0" 200 134 0.000543
Sep 28 12:22:21 ctl02 glance-api[29183]: 2017-09-28 12:22:21.377 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:22:21] "OPTIONS / HTTP/1.0" 200 134 0.000623
Sep 28 12:22:21 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1b4e0a66)
Sep 28 12:22:22 ctl02 nova-api[29193]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:22:22 ctl02 nova-api[29193]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:22:22 ctl02 glance-api[29183]: 2017-09-28 12:22:22.316 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:22:22] "OPTIONS / HTTP/1.0" 200 134 0.000728
Sep 28 12:22:22 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:22:22 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:22:22 ctl02 nova-api[29193]: 2017-09-28 12:22:22.485 29193 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:22:22 ctl02 nova-api[29193]: 2017-09-28 12:22:22.487 29193 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:22:22 ctl02 nova-api[29193]: 2017-09-28 12:22:22.487 29193 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:22:22 ctl02 nova-api[29193]: 2017-09-28 12:22:22.487 29193 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:22:22 ctl02 nova-api[29193]: 2017-09-28 12:22:22.487 29193 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:22:22 ctl02 nova-api[29193]: 2017-09-28 12:22:22.487 29193 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:22:22 ctl02 nova-api[29193]: 2017-09-28 12:22:22.487 29193 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:22:22 ctl02 nova-api[29193]: 2017-09-28 12:22:22.487 29193 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:22:22 ctl02 nova-api[29193]: 2017-09-28 12:22:22.487 29193 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:22:22 ctl02 nova-api[29193]: 2017-09-28 12:22:22.487 29193 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:22:22 ctl02 nova-api[29193]: 2017-09-28 12:22:22.487 29193 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:22:22 ctl02 nova-api[29193]: 2017-09-28 12:22:22.487 29193 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:22:22 ctl02 nova-api[29193]: 2017-09-28 12:22:22.487 29193 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:22:22 ctl02 nova-api[29193]: 2017-09-28 12:22:22.487 29193 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:22:22 ctl02 nova-api[29193]: 2017-09-28 12:22:22.487 29193 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:22:22 ctl02 nova-api[29193]: 2017-09-28 12:22:22.487 29193 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:22:22 ctl02 nova-api[29193]: 2017-09-28 12:22:22.487 29193 ERROR nova.wsgi     self.filename))
Sep 28 12:22:22 ctl02 nova-api[29193]: 2017-09-28 12:22:22.487 29193 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:22:22 ctl02 nova-api[29193]: 2017-09-28 12:22:22.487 29193 ERROR nova.wsgi
Sep 28 12:22:22 ctl02 nova-api[29193]: 2017-09-28 12:22:22.488 29193 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:22:22 ctl02 nova-api[29193]: 2017-09-28 12:22:22.630 29193 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:22:22 ctl02 nova-api[29193]: 2017-09-28 12:22:22.884 29193 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:22:22 ctl02 nova-api[29193]: 2017-09-28 12:22:22.886 29193 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:22:22 ctl02 nova-api[29193]: 2017-09-28 12:22:22.886 29193 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:22:22 ctl02 nova-api[29193]: 2017-09-28 12:22:22.886 29193 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:22:23 ctl02 nova-api[29193]: 2017-09-28 12:22:23.019 29193 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:22:23 ctl02 nova-api[29193]: 2017-09-28 12:22:23.021 29193 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:22:23 ctl02 nova-api[29193]: 2017-09-28 12:22:23.022 29193 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:22:23 ctl02 nova-api[29193]: 2017-09-28 12:22:23.022 29193 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:22:23 ctl02 nova-api[29193]: 2017-09-28 12:22:23.025 29193 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:22:23 ctl02 nova-api[29193]: 2017-09-28 12:22:23.026 29193 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:22:23 ctl02 nova-api[29193]: 2017-09-28 12:22:23.026 29193 ERROR nova Traceback (most recent call last):
Sep 28 12:22:23 ctl02 nova-api[29193]: 2017-09-28 12:22:23.026 29193 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:22:23 ctl02 nova-api[29193]: 2017-09-28 12:22:23.026 29193 ERROR nova     sys.exit(main())
Sep 28 12:22:23 ctl02 nova-api[29193]: 2017-09-28 12:22:23.026 29193 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:22:23 ctl02 nova-api[29193]: 2017-09-28 12:22:23.026 29193 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:22:23 ctl02 nova-api[29193]: 2017-09-28 12:22:23.026 29193 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:22:23 ctl02 nova-api[29193]: 2017-09-28 12:22:23.026 29193 ERROR nova     max_url_len=max_url_len)
Sep 28 12:22:23 ctl02 nova-api[29193]: 2017-09-28 12:22:23.026 29193 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:22:23 ctl02 nova-api[29193]: 2017-09-28 12:22:23.026 29193 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:22:23 ctl02 nova-api[29193]: 2017-09-28 12:22:23.026 29193 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:22:23 ctl02 nova-api[29193]: 2017-09-28 12:22:23.026 29193 ERROR nova     sock.listen(backlog)
Sep 28 12:22:23 ctl02 nova-api[29193]: 2017-09-28 12:22:23.026 29193 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:22:23 ctl02 nova-api[29193]: 2017-09-28 12:22:23.026 29193 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:22:23 ctl02 nova-api[29193]: 2017-09-28 12:22:23.026 29193 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:22:23 ctl02 nova-api[29193]: 2017-09-28 12:22:23.026 29193 ERROR nova
Sep 28 12:22:23 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:22:23 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:22:23 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:22:23 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:22:23.369 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:22:23] "OPTIONS / HTTP/1.0" 200 134 0.000532
Sep 28 12:22:23 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:22:23 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:22:23 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:22:23 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:22:24 ctl02 glance-api[29183]: 2017-09-28 12:22:24.204 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:22:24] "OPTIONS / HTTP/1.0" 200 134 0.000712
Sep 28 12:22:25 ctl02 nova-api[29217]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:22:25 ctl02 nova-api[29217]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:22:25 ctl02 nova-api[29217]: 2017-09-28 12:22:25.227 29217 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:22:25 ctl02 nova-api[29217]: 2017-09-28 12:22:25.229 29217 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:22:25 ctl02 nova-api[29217]: 2017-09-28 12:22:25.229 29217 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:22:25 ctl02 nova-api[29217]: 2017-09-28 12:22:25.229 29217 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:22:25 ctl02 nova-api[29217]: 2017-09-28 12:22:25.229 29217 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:22:25 ctl02 nova-api[29217]: 2017-09-28 12:22:25.229 29217 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:22:25 ctl02 nova-api[29217]: 2017-09-28 12:22:25.229 29217 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:22:25 ctl02 nova-api[29217]: 2017-09-28 12:22:25.229 29217 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:22:25 ctl02 nova-api[29217]: 2017-09-28 12:22:25.229 29217 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:22:25 ctl02 nova-api[29217]: 2017-09-28 12:22:25.229 29217 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:22:25 ctl02 nova-api[29217]: 2017-09-28 12:22:25.229 29217 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:22:25 ctl02 nova-api[29217]: 2017-09-28 12:22:25.229 29217 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:22:25 ctl02 nova-api[29217]: 2017-09-28 12:22:25.229 29217 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:22:25 ctl02 nova-api[29217]: 2017-09-28 12:22:25.229 29217 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:22:25 ctl02 nova-api[29217]: 2017-09-28 12:22:25.229 29217 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:22:25 ctl02 nova-api[29217]: 2017-09-28 12:22:25.229 29217 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:22:25 ctl02 nova-api[29217]: 2017-09-28 12:22:25.229 29217 ERROR nova.wsgi     self.filename))
Sep 28 12:22:25 ctl02 nova-api[29217]: 2017-09-28 12:22:25.229 29217 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:22:25 ctl02 nova-api[29217]: 2017-09-28 12:22:25.229 29217 ERROR nova.wsgi
Sep 28 12:22:25 ctl02 nova-api[29217]: 2017-09-28 12:22:25.231 29217 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:22:25 ctl02 nova-api[29217]: 2017-09-28 12:22:25.363 29217 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:22:25 ctl02 nova-api[29217]: 2017-09-28 12:22:25.611 29217 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:22:25 ctl02 nova-api[29217]: 2017-09-28 12:22:25.614 29217 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:22:25 ctl02 nova-api[29217]: 2017-09-28 12:22:25.614 29217 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:22:25 ctl02 nova-api[29217]: 2017-09-28 12:22:25.615 29217 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:22:25 ctl02 heat-api[13008]: 2017-09-28 12:22:25.667 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:22:25] "OPTIONS / HTTP/1.0" 200 134 0.000630
Sep 28 12:22:25 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:22:25.719 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:22:25] "OPTIONS / HTTP/1.0" 200 134 0.000509
Sep 28 12:22:25 ctl02 nova-api[29217]: 2017-09-28 12:22:25.751 29217 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:22:25 ctl02 nova-api[29217]: 2017-09-28 12:22:25.753 29217 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:22:25 ctl02 nova-api[29217]: 2017-09-28 12:22:25.753 29217 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:22:25 ctl02 nova-api[29217]: 2017-09-28 12:22:25.753 29217 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:22:25 ctl02 nova-api[29217]: 2017-09-28 12:22:25.757 29217 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:22:25 ctl02 nova-api[29217]: 2017-09-28 12:22:25.757 29217 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:22:25 ctl02 nova-api[29217]: 2017-09-28 12:22:25.757 29217 ERROR nova Traceback (most recent call last):
Sep 28 12:22:25 ctl02 nova-api[29217]: 2017-09-28 12:22:25.757 29217 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:22:25 ctl02 nova-api[29217]: 2017-09-28 12:22:25.757 29217 ERROR nova     sys.exit(main())
Sep 28 12:22:25 ctl02 nova-api[29217]: 2017-09-28 12:22:25.757 29217 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:22:25 ctl02 nova-api[29217]: 2017-09-28 12:22:25.757 29217 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:22:25 ctl02 nova-api[29217]: 2017-09-28 12:22:25.757 29217 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:22:25 ctl02 nova-api[29217]: 2017-09-28 12:22:25.757 29217 ERROR nova     max_url_len=max_url_len)
Sep 28 12:22:25 ctl02 nova-api[29217]: 2017-09-28 12:22:25.757 29217 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:22:25 ctl02 nova-api[29217]: 2017-09-28 12:22:25.757 29217 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:22:25 ctl02 nova-api[29217]: 2017-09-28 12:22:25.757 29217 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:22:25 ctl02 nova-api[29217]: 2017-09-28 12:22:25.757 29217 ERROR nova     sock.listen(backlog)
Sep 28 12:22:25 ctl02 nova-api[29217]: 2017-09-28 12:22:25.757 29217 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:22:25 ctl02 nova-api[29217]: 2017-09-28 12:22:25.757 29217 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:22:25 ctl02 nova-api[29217]: 2017-09-28 12:22:25.757 29217 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:22:25 ctl02 nova-api[29217]: 2017-09-28 12:22:25.757 29217 ERROR nova
Sep 28 12:22:25 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:22:25 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:22:25 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:22:26 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:22:26 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:22:26 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:22:26 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:22:26 ctl02 heat-api[13008]: 2017-09-28 12:22:26.604 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:22:26] "OPTIONS / HTTP/1.0" 200 134 0.000703
Sep 28 12:22:27 ctl02 nova-api[29250]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:22:27 ctl02 nova-api[29250]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:22:28 ctl02 nova-api[29250]: 2017-09-28 12:22:28.001 29250 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:22:28 ctl02 nova-api[29250]: 2017-09-28 12:22:28.003 29250 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:22:28 ctl02 nova-api[29250]: 2017-09-28 12:22:28.003 29250 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:22:28 ctl02 nova-api[29250]: 2017-09-28 12:22:28.003 29250 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:22:28 ctl02 nova-api[29250]: 2017-09-28 12:22:28.003 29250 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:22:28 ctl02 nova-api[29250]: 2017-09-28 12:22:28.003 29250 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:22:28 ctl02 nova-api[29250]: 2017-09-28 12:22:28.003 29250 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:22:28 ctl02 nova-api[29250]: 2017-09-28 12:22:28.003 29250 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:22:28 ctl02 nova-api[29250]: 2017-09-28 12:22:28.003 29250 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:22:28 ctl02 nova-api[29250]: 2017-09-28 12:22:28.003 29250 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:22:28 ctl02 nova-api[29250]: 2017-09-28 12:22:28.003 29250 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:22:28 ctl02 nova-api[29250]: 2017-09-28 12:22:28.003 29250 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:22:28 ctl02 nova-api[29250]: 2017-09-28 12:22:28.003 29250 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:22:28 ctl02 nova-api[29250]: 2017-09-28 12:22:28.003 29250 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:22:28 ctl02 nova-api[29250]: 2017-09-28 12:22:28.003 29250 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:22:28 ctl02 nova-api[29250]: 2017-09-28 12:22:28.003 29250 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:22:28 ctl02 nova-api[29250]: 2017-09-28 12:22:28.003 29250 ERROR nova.wsgi     self.filename))
Sep 28 12:22:28 ctl02 nova-api[29250]: 2017-09-28 12:22:28.003 29250 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:22:28 ctl02 nova-api[29250]: 2017-09-28 12:22:28.003 29250 ERROR nova.wsgi
Sep 28 12:22:28 ctl02 nova-api[29250]: 2017-09-28 12:22:28.004 29250 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:22:28 ctl02 nova-api[29250]: 2017-09-28 12:22:28.138 29250 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:22:28 ctl02 nova-api[29250]: 2017-09-28 12:22:28.390 29250 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:22:28 ctl02 nova-api[29250]: 2017-09-28 12:22:28.393 29250 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:22:28 ctl02 nova-api[29250]: 2017-09-28 12:22:28.393 29250 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:22:28 ctl02 nova-api[29250]: 2017-09-28 12:22:28.393 29250 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:22:28 ctl02 nova-api[29250]: 2017-09-28 12:22:28.527 29250 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:22:28 ctl02 nova-api[29250]: 2017-09-28 12:22:28.529 29250 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:22:28 ctl02 nova-api[29250]: 2017-09-28 12:22:28.529 29250 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:22:28 ctl02 nova-api[29250]: 2017-09-28 12:22:28.529 29250 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:22:28 ctl02 nova-api[29250]: 2017-09-28 12:22:28.533 29250 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:22:28 ctl02 nova-api[29250]: 2017-09-28 12:22:28.533 29250 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:22:28 ctl02 nova-api[29250]: 2017-09-28 12:22:28.533 29250 ERROR nova Traceback (most recent call last):
Sep 28 12:22:28 ctl02 nova-api[29250]: 2017-09-28 12:22:28.533 29250 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:22:28 ctl02 nova-api[29250]: 2017-09-28 12:22:28.533 29250 ERROR nova     sys.exit(main())
Sep 28 12:22:28 ctl02 nova-api[29250]: 2017-09-28 12:22:28.533 29250 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:22:28 ctl02 nova-api[29250]: 2017-09-28 12:22:28.533 29250 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:22:28 ctl02 nova-api[29250]: 2017-09-28 12:22:28.533 29250 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:22:28 ctl02 nova-api[29250]: 2017-09-28 12:22:28.533 29250 ERROR nova     max_url_len=max_url_len)
Sep 28 12:22:28 ctl02 nova-api[29250]: 2017-09-28 12:22:28.533 29250 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:22:28 ctl02 nova-api[29250]: 2017-09-28 12:22:28.533 29250 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:22:28 ctl02 nova-api[29250]: 2017-09-28 12:22:28.533 29250 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:22:28 ctl02 nova-api[29250]: 2017-09-28 12:22:28.533 29250 ERROR nova     sock.listen(backlog)
Sep 28 12:22:28 ctl02 nova-api[29250]: 2017-09-28 12:22:28.533 29250 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:22:28 ctl02 nova-api[29250]: 2017-09-28 12:22:28.533 29250 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:22:28 ctl02 nova-api[29250]: 2017-09-28 12:22:28.533 29250 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:22:28 ctl02 nova-api[29250]: 2017-09-28 12:22:28.533 29250 ERROR nova
Sep 28 12:22:28 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:22:28 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:22:28 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:22:28 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:22:28.829 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:22:28] "OPTIONS / HTTP/1.0" 200 134 0.000493
Sep 28 12:22:28 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:22:28 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:22:28 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:22:28 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:22:29 ctl02 nova-cert[4860]: 2017-09-28 12:22:29.227 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:22:29 ctl02 heat-api[13008]: 2017-09-28 12:22:29.943 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:22:29] "OPTIONS / HTTP/1.0" 200 134 0.000702
Sep 28 12:22:29 ctl02 heat-api-cfn[13300]: 2017-09-28 12:22:29.990 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:22:29] "OPTIONS / HTTP/1.0" 200 134 0.000497
Sep 28 12:22:30 ctl02 heat-api-cfn[13300]: 2017-09-28 12:22:30.073 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:22:30] "OPTIONS / HTTP/1.0" 200 134 0.000309
Sep 28 12:22:30 ctl02 heat-api-cfn[13300]: 2017-09-28 12:22:30.509 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:22:30] "OPTIONS / HTTP/1.0" 200 134 0.000456
Sep 28 12:22:30 ctl02 nova-api[29277]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:22:30 ctl02 nova-api[29277]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:22:30 ctl02 nova-conductor[5056]: 2017-09-28 12:22:30.608 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:22:30 ctl02 nova-conductor[5056]: 2017-09-28 12:22:30.625 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:22:30 ctl02 nova-conductor[5056]: 2017-09-28 12:22:30.646 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:22:30 ctl02 nova-conductor[5056]: 2017-09-28 12:22:30.646 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:22:30 ctl02 nova-api[29277]: 2017-09-28 12:22:30.763 29277 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:22:30 ctl02 nova-api[29277]: 2017-09-28 12:22:30.765 29277 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:22:30 ctl02 nova-api[29277]: 2017-09-28 12:22:30.765 29277 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:22:30 ctl02 nova-api[29277]: 2017-09-28 12:22:30.765 29277 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:22:30 ctl02 nova-api[29277]: 2017-09-28 12:22:30.765 29277 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:22:30 ctl02 nova-api[29277]: 2017-09-28 12:22:30.765 29277 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:22:30 ctl02 nova-api[29277]: 2017-09-28 12:22:30.765 29277 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:22:30 ctl02 nova-api[29277]: 2017-09-28 12:22:30.765 29277 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:22:30 ctl02 nova-api[29277]: 2017-09-28 12:22:30.765 29277 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:22:30 ctl02 nova-api[29277]: 2017-09-28 12:22:30.765 29277 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:22:30 ctl02 nova-api[29277]: 2017-09-28 12:22:30.765 29277 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:22:30 ctl02 nova-api[29277]: 2017-09-28 12:22:30.765 29277 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:22:30 ctl02 nova-api[29277]: 2017-09-28 12:22:30.765 29277 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:22:30 ctl02 nova-api[29277]: 2017-09-28 12:22:30.765 29277 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:22:30 ctl02 nova-api[29277]: 2017-09-28 12:22:30.765 29277 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:22:30 ctl02 nova-api[29277]: 2017-09-28 12:22:30.765 29277 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:22:30 ctl02 nova-api[29277]: 2017-09-28 12:22:30.765 29277 ERROR nova.wsgi     self.filename))
Sep 28 12:22:30 ctl02 nova-api[29277]: 2017-09-28 12:22:30.765 29277 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:22:30 ctl02 nova-api[29277]: 2017-09-28 12:22:30.765 29277 ERROR nova.wsgi
Sep 28 12:22:30 ctl02 nova-api[29277]: 2017-09-28 12:22:30.765 29277 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:22:30 ctl02 nova-api[29277]: 2017-09-28 12:22:30.900 29277 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:22:31 ctl02 nova-api[29277]: 2017-09-28 12:22:31.151 29277 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:22:31 ctl02 nova-api[29277]: 2017-09-28 12:22:31.154 29277 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:22:31 ctl02 nova-api[29277]: 2017-09-28 12:22:31.154 29277 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:22:31 ctl02 nova-api[29277]: 2017-09-28 12:22:31.154 29277 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:22:31 ctl02 nova-api[29277]: 2017-09-28 12:22:31.288 29277 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:22:31 ctl02 nova-api[29277]: 2017-09-28 12:22:31.290 29277 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:22:31 ctl02 nova-api[29277]: 2017-09-28 12:22:31.290 29277 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:22:31 ctl02 nova-api[29277]: 2017-09-28 12:22:31.290 29277 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:22:31 ctl02 nova-api[29277]: 2017-09-28 12:22:31.294 29277 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:22:31 ctl02 nova-api[29277]: 2017-09-28 12:22:31.294 29277 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:22:31 ctl02 nova-api[29277]: 2017-09-28 12:22:31.294 29277 ERROR nova Traceback (most recent call last):
Sep 28 12:22:31 ctl02 nova-api[29277]: 2017-09-28 12:22:31.294 29277 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:22:31 ctl02 nova-api[29277]: 2017-09-28 12:22:31.294 29277 ERROR nova     sys.exit(main())
Sep 28 12:22:31 ctl02 nova-api[29277]: 2017-09-28 12:22:31.294 29277 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:22:31 ctl02 nova-api[29277]: 2017-09-28 12:22:31.294 29277 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:22:31 ctl02 nova-api[29277]: 2017-09-28 12:22:31.294 29277 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:22:31 ctl02 nova-api[29277]: 2017-09-28 12:22:31.294 29277 ERROR nova     max_url_len=max_url_len)
Sep 28 12:22:31 ctl02 nova-api[29277]: 2017-09-28 12:22:31.294 29277 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:22:31 ctl02 nova-api[29277]: 2017-09-28 12:22:31.294 29277 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:22:31 ctl02 nova-api[29277]: 2017-09-28 12:22:31.294 29277 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:22:31 ctl02 nova-api[29277]: 2017-09-28 12:22:31.294 29277 ERROR nova     sock.listen(backlog)
Sep 28 12:22:31 ctl02 nova-api[29277]: 2017-09-28 12:22:31.294 29277 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:22:31 ctl02 nova-api[29277]: 2017-09-28 12:22:31.294 29277 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:22:31 ctl02 nova-api[29277]: 2017-09-28 12:22:31.294 29277 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:22:31 ctl02 nova-api[29277]: 2017-09-28 12:22:31.294 29277 ERROR nova
Sep 28 12:22:31 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:22:31 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:22:31 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:22:31 ctl02 glance-api[29183]: 2017-09-28 12:22:31.561 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:22:31] "OPTIONS / HTTP/1.0" 200 134 0.000705
Sep 28 12:22:31 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:22:31 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:22:31 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:22:31 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:22:32 ctl02 glance-api[29183]: 2017-09-28 12:22:32.133 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:22:32] "OPTIONS / HTTP/1.0" 200 134 0.000642
Sep 28 12:22:33 ctl02 nova-api[29295]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:22:33 ctl02 nova-api[29295]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:22:33 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:22:33.423 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:22:33] "OPTIONS / HTTP/1.0" 200 134 0.000524
Sep 28 12:22:33 ctl02 nova-api[29295]: 2017-09-28 12:22:33.493 29295 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:22:33 ctl02 nova-api[29295]: 2017-09-28 12:22:33.495 29295 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:22:33 ctl02 nova-api[29295]: 2017-09-28 12:22:33.495 29295 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:22:33 ctl02 nova-api[29295]: 2017-09-28 12:22:33.495 29295 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:22:33 ctl02 nova-api[29295]: 2017-09-28 12:22:33.495 29295 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:22:33 ctl02 nova-api[29295]: 2017-09-28 12:22:33.495 29295 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:22:33 ctl02 nova-api[29295]: 2017-09-28 12:22:33.495 29295 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:22:33 ctl02 nova-api[29295]: 2017-09-28 12:22:33.495 29295 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:22:33 ctl02 nova-api[29295]: 2017-09-28 12:22:33.495 29295 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:22:33 ctl02 nova-api[29295]: 2017-09-28 12:22:33.495 29295 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:22:33 ctl02 nova-api[29295]: 2017-09-28 12:22:33.495 29295 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:22:33 ctl02 nova-api[29295]: 2017-09-28 12:22:33.495 29295 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:22:33 ctl02 nova-api[29295]: 2017-09-28 12:22:33.495 29295 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:22:33 ctl02 nova-api[29295]: 2017-09-28 12:22:33.495 29295 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:22:33 ctl02 nova-api[29295]: 2017-09-28 12:22:33.495 29295 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:22:33 ctl02 nova-api[29295]: 2017-09-28 12:22:33.495 29295 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:22:33 ctl02 nova-api[29295]: 2017-09-28 12:22:33.495 29295 ERROR nova.wsgi     self.filename))
Sep 28 12:22:33 ctl02 nova-api[29295]: 2017-09-28 12:22:33.495 29295 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:22:33 ctl02 nova-api[29295]: 2017-09-28 12:22:33.495 29295 ERROR nova.wsgi
Sep 28 12:22:33 ctl02 nova-api[29295]: 2017-09-28 12:22:33.497 29295 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:22:33 ctl02 nova-api[29295]: 2017-09-28 12:22:33.631 29295 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:22:33 ctl02 nova-api[29295]: 2017-09-28 12:22:33.879 29295 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:22:33 ctl02 nova-api[29295]: 2017-09-28 12:22:33.882 29295 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:22:33 ctl02 nova-api[29295]: 2017-09-28 12:22:33.882 29295 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:22:33 ctl02 nova-api[29295]: 2017-09-28 12:22:33.883 29295 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:22:34 ctl02 glance-api[29183]: 2017-09-28 12:22:34.006 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:22:34] "OPTIONS / HTTP/1.0" 200 134 0.000642
Sep 28 12:22:34 ctl02 nova-api[29295]: 2017-09-28 12:22:34.018 29295 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:22:34 ctl02 nova-api[29295]: 2017-09-28 12:22:34.021 29295 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:22:34 ctl02 nova-api[29295]: 2017-09-28 12:22:34.021 29295 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:22:34 ctl02 nova-api[29295]: 2017-09-28 12:22:34.022 29295 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:22:34 ctl02 nova-api[29295]: 2017-09-28 12:22:34.025 29295 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:22:34 ctl02 nova-api[29295]: 2017-09-28 12:22:34.026 29295 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:22:34 ctl02 nova-api[29295]: 2017-09-28 12:22:34.026 29295 ERROR nova Traceback (most recent call last):
Sep 28 12:22:34 ctl02 nova-api[29295]: 2017-09-28 12:22:34.026 29295 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:22:34 ctl02 nova-api[29295]: 2017-09-28 12:22:34.026 29295 ERROR nova     sys.exit(main())
Sep 28 12:22:34 ctl02 nova-api[29295]: 2017-09-28 12:22:34.026 29295 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:22:34 ctl02 nova-api[29295]: 2017-09-28 12:22:34.026 29295 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:22:34 ctl02 nova-api[29295]: 2017-09-28 12:22:34.026 29295 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:22:34 ctl02 nova-api[29295]: 2017-09-28 12:22:34.026 29295 ERROR nova     max_url_len=max_url_len)
Sep 28 12:22:34 ctl02 nova-api[29295]: 2017-09-28 12:22:34.026 29295 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:22:34 ctl02 nova-api[29295]: 2017-09-28 12:22:34.026 29295 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:22:34 ctl02 nova-api[29295]: 2017-09-28 12:22:34.026 29295 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:22:34 ctl02 nova-api[29295]: 2017-09-28 12:22:34.026 29295 ERROR nova     sock.listen(backlog)
Sep 28 12:22:34 ctl02 nova-api[29295]: 2017-09-28 12:22:34.026 29295 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:22:34 ctl02 nova-api[29295]: 2017-09-28 12:22:34.026 29295 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:22:34 ctl02 nova-api[29295]: 2017-09-28 12:22:34.026 29295 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:22:34 ctl02 nova-api[29295]: 2017-09-28 12:22:34.026 29295 ERROR nova
Sep 28 12:22:34 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:22:34 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:22:34 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:22:34 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:22:34 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:22:34 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:22:34 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:22:35 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:22:35.342 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:22:35] "OPTIONS / HTTP/1.0" 200 134 0.000491
Sep 28 12:22:35 ctl02 heat-api[13008]: 2017-09-28 12:22:35.592 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:22:35] "OPTIONS / HTTP/1.0" 200 134 0.000627
Sep 28 12:22:36 ctl02 nova-api[29314]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:22:36 ctl02 nova-api[29314]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:22:36 ctl02 nova-api[29314]: 2017-09-28 12:22:36.246 29314 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:22:36 ctl02 nova-api[29314]: 2017-09-28 12:22:36.248 29314 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:22:36 ctl02 nova-api[29314]: 2017-09-28 12:22:36.248 29314 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:22:36 ctl02 nova-api[29314]: 2017-09-28 12:22:36.248 29314 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:22:36 ctl02 nova-api[29314]: 2017-09-28 12:22:36.248 29314 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:22:36 ctl02 nova-api[29314]: 2017-09-28 12:22:36.248 29314 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:22:36 ctl02 nova-api[29314]: 2017-09-28 12:22:36.248 29314 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:22:36 ctl02 nova-api[29314]: 2017-09-28 12:22:36.248 29314 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:22:36 ctl02 nova-api[29314]: 2017-09-28 12:22:36.248 29314 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:22:36 ctl02 nova-api[29314]: 2017-09-28 12:22:36.248 29314 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:22:36 ctl02 nova-api[29314]: 2017-09-28 12:22:36.248 29314 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:22:36 ctl02 nova-api[29314]: 2017-09-28 12:22:36.248 29314 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:22:36 ctl02 nova-api[29314]: 2017-09-28 12:22:36.248 29314 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:22:36 ctl02 nova-api[29314]: 2017-09-28 12:22:36.248 29314 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:22:36 ctl02 nova-api[29314]: 2017-09-28 12:22:36.248 29314 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:22:36 ctl02 nova-api[29314]: 2017-09-28 12:22:36.248 29314 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:22:36 ctl02 nova-api[29314]: 2017-09-28 12:22:36.248 29314 ERROR nova.wsgi     self.filename))
Sep 28 12:22:36 ctl02 nova-api[29314]: 2017-09-28 12:22:36.248 29314 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:22:36 ctl02 nova-api[29314]: 2017-09-28 12:22:36.248 29314 ERROR nova.wsgi
Sep 28 12:22:36 ctl02 nova-api[29314]: 2017-09-28 12:22:36.249 29314 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:22:36 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x68abd91b)
Sep 28 12:22:36 ctl02 nova-api[29314]: 2017-09-28 12:22:36.385 29314 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:22:36 ctl02 nova-api[29314]: 2017-09-28 12:22:36.637 29314 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:22:36 ctl02 nova-api[29314]: 2017-09-28 12:22:36.639 29314 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:22:36 ctl02 nova-api[29314]: 2017-09-28 12:22:36.640 29314 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:22:36 ctl02 nova-api[29314]: 2017-09-28 12:22:36.640 29314 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:22:36 ctl02 heat-api[13008]: 2017-09-28 12:22:36.680 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:22:36] "OPTIONS / HTTP/1.0" 200 134 0.000611
Sep 28 12:22:36 ctl02 nova-api[29314]: 2017-09-28 12:22:36.776 29314 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:22:36 ctl02 nova-api[29314]: 2017-09-28 12:22:36.779 29314 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:22:36 ctl02 nova-api[29314]: 2017-09-28 12:22:36.779 29314 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:22:36 ctl02 nova-api[29314]: 2017-09-28 12:22:36.779 29314 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:22:36 ctl02 nova-api[29314]: 2017-09-28 12:22:36.783 29314 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:22:36 ctl02 nova-api[29314]: 2017-09-28 12:22:36.783 29314 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:22:36 ctl02 nova-api[29314]: 2017-09-28 12:22:36.783 29314 ERROR nova Traceback (most recent call last):
Sep 28 12:22:36 ctl02 nova-api[29314]: 2017-09-28 12:22:36.783 29314 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:22:36 ctl02 nova-api[29314]: 2017-09-28 12:22:36.783 29314 ERROR nova     sys.exit(main())
Sep 28 12:22:36 ctl02 nova-api[29314]: 2017-09-28 12:22:36.783 29314 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:22:36 ctl02 nova-api[29314]: 2017-09-28 12:22:36.783 29314 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:22:36 ctl02 nova-api[29314]: 2017-09-28 12:22:36.783 29314 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:22:36 ctl02 nova-api[29314]: 2017-09-28 12:22:36.783 29314 ERROR nova     max_url_len=max_url_len)
Sep 28 12:22:36 ctl02 nova-api[29314]: 2017-09-28 12:22:36.783 29314 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:22:36 ctl02 nova-api[29314]: 2017-09-28 12:22:36.783 29314 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:22:36 ctl02 nova-api[29314]: 2017-09-28 12:22:36.783 29314 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:22:36 ctl02 nova-api[29314]: 2017-09-28 12:22:36.783 29314 ERROR nova     sock.listen(backlog)
Sep 28 12:22:36 ctl02 nova-api[29314]: 2017-09-28 12:22:36.783 29314 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:22:36 ctl02 nova-api[29314]: 2017-09-28 12:22:36.783 29314 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:22:36 ctl02 nova-api[29314]: 2017-09-28 12:22:36.783 29314 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:22:36 ctl02 nova-api[29314]: 2017-09-28 12:22:36.783 29314 ERROR nova
Sep 28 12:22:36 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:22:36 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:22:36 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:22:37 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:22:37 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:22:37 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:22:37 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:22:37 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x68abd91b)
Sep 28 12:22:38 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x68abd91b)
Sep 28 12:22:38 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:22:38.685 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:22:38] "OPTIONS / HTTP/1.0" 200 134 0.000463
Sep 28 12:22:38 ctl02 nova-api[29332]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:22:38 ctl02 nova-api[29332]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:22:38 ctl02 nova-api[29332]: 2017-09-28 12:22:38.984 29332 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:22:38 ctl02 nova-api[29332]: 2017-09-28 12:22:38.986 29332 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:22:38 ctl02 nova-api[29332]: 2017-09-28 12:22:38.986 29332 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:22:38 ctl02 nova-api[29332]: 2017-09-28 12:22:38.986 29332 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:22:38 ctl02 nova-api[29332]: 2017-09-28 12:22:38.986 29332 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:22:38 ctl02 nova-api[29332]: 2017-09-28 12:22:38.986 29332 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:22:38 ctl02 nova-api[29332]: 2017-09-28 12:22:38.986 29332 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:22:38 ctl02 nova-api[29332]: 2017-09-28 12:22:38.986 29332 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:22:38 ctl02 nova-api[29332]: 2017-09-28 12:22:38.986 29332 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:22:38 ctl02 nova-api[29332]: 2017-09-28 12:22:38.986 29332 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:22:38 ctl02 nova-api[29332]: 2017-09-28 12:22:38.986 29332 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:22:38 ctl02 nova-api[29332]: 2017-09-28 12:22:38.986 29332 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:22:38 ctl02 nova-api[29332]: 2017-09-28 12:22:38.986 29332 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:22:38 ctl02 nova-api[29332]: 2017-09-28 12:22:38.986 29332 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:22:38 ctl02 nova-api[29332]: 2017-09-28 12:22:38.986 29332 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:22:38 ctl02 nova-api[29332]: 2017-09-28 12:22:38.986 29332 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:22:38 ctl02 nova-api[29332]: 2017-09-28 12:22:38.986 29332 ERROR nova.wsgi     self.filename))
Sep 28 12:22:38 ctl02 nova-api[29332]: 2017-09-28 12:22:38.986 29332 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:22:38 ctl02 nova-api[29332]: 2017-09-28 12:22:38.986 29332 ERROR nova.wsgi
Sep 28 12:22:38 ctl02 nova-api[29332]: 2017-09-28 12:22:38.987 29332 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:22:39 ctl02 nova-consoleauth[5433]: 2017-09-28 12:22:39.107 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:22:39 ctl02 nova-api[29332]: 2017-09-28 12:22:39.120 29332 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:22:39 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x68abd91b)
Sep 28 12:22:39 ctl02 nova-api[29332]: 2017-09-28 12:22:39.373 29332 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:22:39 ctl02 nova-api[29332]: 2017-09-28 12:22:39.375 29332 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:22:39 ctl02 nova-api[29332]: 2017-09-28 12:22:39.375 29332 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:22:39 ctl02 nova-api[29332]: 2017-09-28 12:22:39.376 29332 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:22:39 ctl02 nova-api[29332]: 2017-09-28 12:22:39.510 29332 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:22:39 ctl02 nova-api[29332]: 2017-09-28 12:22:39.512 29332 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:22:39 ctl02 nova-api[29332]: 2017-09-28 12:22:39.512 29332 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:22:39 ctl02 nova-api[29332]: 2017-09-28 12:22:39.512 29332 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:22:39 ctl02 nova-api[29332]: 2017-09-28 12:22:39.516 29332 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:22:39 ctl02 nova-api[29332]: 2017-09-28 12:22:39.516 29332 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:22:39 ctl02 nova-api[29332]: 2017-09-28 12:22:39.516 29332 ERROR nova Traceback (most recent call last):
Sep 28 12:22:39 ctl02 nova-api[29332]: 2017-09-28 12:22:39.516 29332 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:22:39 ctl02 nova-api[29332]: 2017-09-28 12:22:39.516 29332 ERROR nova     sys.exit(main())
Sep 28 12:22:39 ctl02 nova-api[29332]: 2017-09-28 12:22:39.516 29332 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:22:39 ctl02 nova-api[29332]: 2017-09-28 12:22:39.516 29332 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:22:39 ctl02 nova-api[29332]: 2017-09-28 12:22:39.516 29332 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:22:39 ctl02 nova-api[29332]: 2017-09-28 12:22:39.516 29332 ERROR nova     max_url_len=max_url_len)
Sep 28 12:22:39 ctl02 nova-api[29332]: 2017-09-28 12:22:39.516 29332 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:22:39 ctl02 nova-api[29332]: 2017-09-28 12:22:39.516 29332 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:22:39 ctl02 nova-api[29332]: 2017-09-28 12:22:39.516 29332 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:22:39 ctl02 nova-api[29332]: 2017-09-28 12:22:39.516 29332 ERROR nova     sock.listen(backlog)
Sep 28 12:22:39 ctl02 nova-api[29332]: 2017-09-28 12:22:39.516 29332 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:22:39 ctl02 nova-api[29332]: 2017-09-28 12:22:39.516 29332 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:22:39 ctl02 nova-api[29332]: 2017-09-28 12:22:39.516 29332 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:22:39 ctl02 nova-api[29332]: 2017-09-28 12:22:39.516 29332 ERROR nova
Sep 28 12:22:39 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:22:39 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:22:39 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:22:39 ctl02 heat-api-cfn[13300]: 2017-09-28 12:22:39.692 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:22:39] "OPTIONS / HTTP/1.0" 200 134 0.000548
Sep 28 12:22:39 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:22:39 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:22:39 ctl02 heat-api-cfn[13300]: 2017-09-28 12:22:39.891 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:22:39] "OPTIONS / HTTP/1.0" 200 134 0.000445
Sep 28 12:22:39 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:22:39 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:22:40 ctl02 heat-api[13008]: 2017-09-28 12:22:40.037 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:22:40] "OPTIONS / HTTP/1.0" 200 134 0.000619
Sep 28 12:22:40 ctl02 heat-api-cfn[13300]: 2017-09-28 12:22:40.175 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:22:40] "OPTIONS / HTTP/1.0" 200 134 0.000510
Sep 28 12:22:40 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x68abd91b)
Sep 28 12:22:41 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x68abd91b)
Sep 28 12:22:41 ctl02 nova-api[29350]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:22:41 ctl02 nova-api[29350]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:22:41 ctl02 glance-api[29183]: 2017-09-28 12:22:41.654 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:22:41] "OPTIONS / HTTP/1.0" 200 134 0.000599
Sep 28 12:22:41 ctl02 heat-engine[12803]: 2017-09-28 12:22:41.728 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:22:41 ctl02 heat-engine[12803]: 2017-09-28 12:22:41.728 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:22:41 ctl02 heat-engine[12803]: 2017-09-28 12:22:41.728 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:22:41 ctl02 heat-engine[12803]: 2017-09-28 12:22:41.740 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:22:41 ctl02 nova-api[29350]: 2017-09-28 12:22:41.777 29350 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:22:41 ctl02 nova-api[29350]: 2017-09-28 12:22:41.779 29350 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:22:41 ctl02 nova-api[29350]: 2017-09-28 12:22:41.779 29350 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:22:41 ctl02 nova-api[29350]: 2017-09-28 12:22:41.779 29350 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:22:41 ctl02 nova-api[29350]: 2017-09-28 12:22:41.779 29350 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:22:41 ctl02 nova-api[29350]: 2017-09-28 12:22:41.779 29350 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:22:41 ctl02 nova-api[29350]: 2017-09-28 12:22:41.779 29350 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:22:41 ctl02 nova-api[29350]: 2017-09-28 12:22:41.779 29350 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:22:41 ctl02 nova-api[29350]: 2017-09-28 12:22:41.779 29350 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:22:41 ctl02 nova-api[29350]: 2017-09-28 12:22:41.779 29350 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:22:41 ctl02 nova-api[29350]: 2017-09-28 12:22:41.779 29350 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:22:41 ctl02 nova-api[29350]: 2017-09-28 12:22:41.779 29350 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:22:41 ctl02 nova-api[29350]: 2017-09-28 12:22:41.779 29350 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:22:41 ctl02 nova-api[29350]: 2017-09-28 12:22:41.779 29350 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:22:41 ctl02 nova-api[29350]: 2017-09-28 12:22:41.779 29350 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:22:41 ctl02 nova-api[29350]: 2017-09-28 12:22:41.779 29350 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:22:41 ctl02 nova-api[29350]: 2017-09-28 12:22:41.779 29350 ERROR nova.wsgi     self.filename))
Sep 28 12:22:41 ctl02 nova-api[29350]: 2017-09-28 12:22:41.779 29350 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:22:41 ctl02 nova-api[29350]: 2017-09-28 12:22:41.779 29350 ERROR nova.wsgi
Sep 28 12:22:41 ctl02 nova-api[29350]: 2017-09-28 12:22:41.780 29350 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:22:41 ctl02 nova-api[29350]: 2017-09-28 12:22:41.917 29350 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:22:42 ctl02 nova-scheduler[5620]: 2017-09-28 12:22:42.131 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:22:42 ctl02 nova-api[29350]: 2017-09-28 12:22:42.178 29350 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:22:42 ctl02 nova-api[29350]: 2017-09-28 12:22:42.180 29350 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:22:42 ctl02 nova-api[29350]: 2017-09-28 12:22:42.180 29350 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:22:42 ctl02 nova-api[29350]: 2017-09-28 12:22:42.180 29350 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:22:42 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x68abd91b)
Sep 28 12:22:42 ctl02 nova-api[29350]: 2017-09-28 12:22:42.318 29350 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:22:42 ctl02 nova-api[29350]: 2017-09-28 12:22:42.320 29350 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:22:42 ctl02 nova-api[29350]: 2017-09-28 12:22:42.320 29350 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:22:42 ctl02 nova-api[29350]: 2017-09-28 12:22:42.320 29350 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:22:42 ctl02 nova-api[29350]: 2017-09-28 12:22:42.323 29350 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:22:42 ctl02 nova-api[29350]: 2017-09-28 12:22:42.324 29350 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:22:42 ctl02 nova-api[29350]: 2017-09-28 12:22:42.324 29350 ERROR nova Traceback (most recent call last):
Sep 28 12:22:42 ctl02 nova-api[29350]: 2017-09-28 12:22:42.324 29350 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:22:42 ctl02 nova-api[29350]: 2017-09-28 12:22:42.324 29350 ERROR nova     sys.exit(main())
Sep 28 12:22:42 ctl02 nova-api[29350]: 2017-09-28 12:22:42.324 29350 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:22:42 ctl02 nova-api[29350]: 2017-09-28 12:22:42.324 29350 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:22:42 ctl02 nova-api[29350]: 2017-09-28 12:22:42.324 29350 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:22:42 ctl02 nova-api[29350]: 2017-09-28 12:22:42.324 29350 ERROR nova     max_url_len=max_url_len)
Sep 28 12:22:42 ctl02 nova-api[29350]: 2017-09-28 12:22:42.324 29350 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:22:42 ctl02 nova-api[29350]: 2017-09-28 12:22:42.324 29350 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:22:42 ctl02 nova-api[29350]: 2017-09-28 12:22:42.324 29350 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:22:42 ctl02 nova-api[29350]: 2017-09-28 12:22:42.324 29350 ERROR nova     sock.listen(backlog)
Sep 28 12:22:42 ctl02 nova-api[29350]: 2017-09-28 12:22:42.324 29350 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:22:42 ctl02 nova-api[29350]: 2017-09-28 12:22:42.324 29350 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:22:42 ctl02 nova-api[29350]: 2017-09-28 12:22:42.324 29350 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:22:42 ctl02 nova-api[29350]: 2017-09-28 12:22:42.324 29350 ERROR nova
Sep 28 12:22:42 ctl02 glance-api[29183]: 2017-09-28 12:22:42.473 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:22:42] "OPTIONS / HTTP/1.0" 200 134 0.000617
Sep 28 12:22:42 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:22:42 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:22:42 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:22:42 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:22:42 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:22:42 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:22:42 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:22:43 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x68abd91b)
Sep 28 12:22:43 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:22:43.375 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:22:43] "OPTIONS / HTTP/1.0" 200 134 0.000487
Sep 28 12:22:44 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x68abd91b)
Sep 28 12:22:44 ctl02 nova-api[29367]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:22:44 ctl02 nova-api[29367]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:22:44 ctl02 glance-api[29183]: 2017-09-28 12:22:44.358 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:22:44] "OPTIONS / HTTP/1.0" 200 134 0.000836
Sep 28 12:22:44 ctl02 nova-api[29367]: 2017-09-28 12:22:44.514 29367 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:22:44 ctl02 nova-api[29367]: 2017-09-28 12:22:44.516 29367 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:22:44 ctl02 nova-api[29367]: 2017-09-28 12:22:44.516 29367 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:22:44 ctl02 nova-api[29367]: 2017-09-28 12:22:44.516 29367 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:22:44 ctl02 nova-api[29367]: 2017-09-28 12:22:44.516 29367 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:22:44 ctl02 nova-api[29367]: 2017-09-28 12:22:44.516 29367 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:22:44 ctl02 nova-api[29367]: 2017-09-28 12:22:44.516 29367 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:22:44 ctl02 nova-api[29367]: 2017-09-28 12:22:44.516 29367 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:22:44 ctl02 nova-api[29367]: 2017-09-28 12:22:44.516 29367 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:22:44 ctl02 nova-api[29367]: 2017-09-28 12:22:44.516 29367 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:22:44 ctl02 nova-api[29367]: 2017-09-28 12:22:44.516 29367 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:22:44 ctl02 nova-api[29367]: 2017-09-28 12:22:44.516 29367 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:22:44 ctl02 nova-api[29367]: 2017-09-28 12:22:44.516 29367 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:22:44 ctl02 nova-api[29367]: 2017-09-28 12:22:44.516 29367 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:22:44 ctl02 nova-api[29367]: 2017-09-28 12:22:44.516 29367 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:22:44 ctl02 nova-api[29367]: 2017-09-28 12:22:44.516 29367 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:22:44 ctl02 nova-api[29367]: 2017-09-28 12:22:44.516 29367 ERROR nova.wsgi     self.filename))
Sep 28 12:22:44 ctl02 nova-api[29367]: 2017-09-28 12:22:44.516 29367 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:22:44 ctl02 nova-api[29367]: 2017-09-28 12:22:44.516 29367 ERROR nova.wsgi
Sep 28 12:22:44 ctl02 nova-api[29367]: 2017-09-28 12:22:44.517 29367 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:22:44 ctl02 nova-api[29367]: 2017-09-28 12:22:44.657 29367 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:22:44 ctl02 nova-api[29367]: 2017-09-28 12:22:44.921 29367 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:22:44 ctl02 nova-api[29367]: 2017-09-28 12:22:44.924 29367 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:22:44 ctl02 nova-api[29367]: 2017-09-28 12:22:44.924 29367 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:22:44 ctl02 nova-api[29367]: 2017-09-28 12:22:44.924 29367 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:22:45 ctl02 nova-api[29367]: 2017-09-28 12:22:45.065 29367 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:22:45 ctl02 nova-api[29367]: 2017-09-28 12:22:45.067 29367 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:22:45 ctl02 nova-api[29367]: 2017-09-28 12:22:45.067 29367 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:22:45 ctl02 nova-api[29367]: 2017-09-28 12:22:45.067 29367 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:22:45 ctl02 nova-api[29367]: 2017-09-28 12:22:45.071 29367 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:22:45 ctl02 nova-api[29367]: 2017-09-28 12:22:45.071 29367 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:22:45 ctl02 nova-api[29367]: 2017-09-28 12:22:45.071 29367 ERROR nova Traceback (most recent call last):
Sep 28 12:22:45 ctl02 nova-api[29367]: 2017-09-28 12:22:45.071 29367 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:22:45 ctl02 nova-api[29367]: 2017-09-28 12:22:45.071 29367 ERROR nova     sys.exit(main())
Sep 28 12:22:45 ctl02 nova-api[29367]: 2017-09-28 12:22:45.071 29367 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:22:45 ctl02 nova-api[29367]: 2017-09-28 12:22:45.071 29367 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:22:45 ctl02 nova-api[29367]: 2017-09-28 12:22:45.071 29367 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:22:45 ctl02 nova-api[29367]: 2017-09-28 12:22:45.071 29367 ERROR nova     max_url_len=max_url_len)
Sep 28 12:22:45 ctl02 nova-api[29367]: 2017-09-28 12:22:45.071 29367 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:22:45 ctl02 nova-api[29367]: 2017-09-28 12:22:45.071 29367 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:22:45 ctl02 nova-api[29367]: 2017-09-28 12:22:45.071 29367 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:22:45 ctl02 nova-api[29367]: 2017-09-28 12:22:45.071 29367 ERROR nova     sock.listen(backlog)
Sep 28 12:22:45 ctl02 nova-api[29367]: 2017-09-28 12:22:45.071 29367 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:22:45 ctl02 nova-api[29367]: 2017-09-28 12:22:45.071 29367 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:22:45 ctl02 nova-api[29367]: 2017-09-28 12:22:45.071 29367 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:22:45 ctl02 nova-api[29367]: 2017-09-28 12:22:45.071 29367 ERROR nova
Sep 28 12:22:45 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:22:45.198 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:22:45] "OPTIONS / HTTP/1.0" 200 134 0.000468
Sep 28 12:22:45 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:22:45 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:22:45 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:22:45 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x68abd91b)
Sep 28 12:22:45 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:22:45 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:22:45 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:22:45 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:22:45 ctl02 heat-api[13008]: 2017-09-28 12:22:45.680 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:22:45] "OPTIONS / HTTP/1.0" 200 134 0.000667
Sep 28 12:22:46 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x68abd91b)
Sep 28 12:22:46 ctl02 heat-api[13008]: 2017-09-28 12:22:46.353 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:22:46] "OPTIONS / HTTP/1.0" 200 134 0.000608
Sep 28 12:22:47 ctl02 nova-api[29386]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:22:47 ctl02 nova-api[29386]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:22:47 ctl02 nova-api[29386]: 2017-09-28 12:22:47.290 29386 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:22:47 ctl02 nova-api[29386]: 2017-09-28 12:22:47.292 29386 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:22:47 ctl02 nova-api[29386]: 2017-09-28 12:22:47.292 29386 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:22:47 ctl02 nova-api[29386]: 2017-09-28 12:22:47.292 29386 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:22:47 ctl02 nova-api[29386]: 2017-09-28 12:22:47.292 29386 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:22:47 ctl02 nova-api[29386]: 2017-09-28 12:22:47.292 29386 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:22:47 ctl02 nova-api[29386]: 2017-09-28 12:22:47.292 29386 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:22:47 ctl02 nova-api[29386]: 2017-09-28 12:22:47.292 29386 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:22:47 ctl02 nova-api[29386]: 2017-09-28 12:22:47.292 29386 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:22:47 ctl02 nova-api[29386]: 2017-09-28 12:22:47.292 29386 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:22:47 ctl02 nova-api[29386]: 2017-09-28 12:22:47.292 29386 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:22:47 ctl02 nova-api[29386]: 2017-09-28 12:22:47.292 29386 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:22:47 ctl02 nova-api[29386]: 2017-09-28 12:22:47.292 29386 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:22:47 ctl02 nova-api[29386]: 2017-09-28 12:22:47.292 29386 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:22:47 ctl02 nova-api[29386]: 2017-09-28 12:22:47.292 29386 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:22:47 ctl02 nova-api[29386]: 2017-09-28 12:22:47.292 29386 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:22:47 ctl02 nova-api[29386]: 2017-09-28 12:22:47.292 29386 ERROR nova.wsgi     self.filename))
Sep 28 12:22:47 ctl02 nova-api[29386]: 2017-09-28 12:22:47.292 29386 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:22:47 ctl02 nova-api[29386]: 2017-09-28 12:22:47.292 29386 ERROR nova.wsgi
Sep 28 12:22:47 ctl02 nova-api[29386]: 2017-09-28 12:22:47.293 29386 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:22:47 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:22:47 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:22:47 ctl02 nova-api[29386]: 2017-09-28 12:22:47.429 29386 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:22:47 ctl02 nova-api[29386]: 2017-09-28 12:22:47.686 29386 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:22:47 ctl02 nova-api[29386]: 2017-09-28 12:22:47.688 29386 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:22:47 ctl02 nova-api[29386]: 2017-09-28 12:22:47.688 29386 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:22:47 ctl02 nova-api[29386]: 2017-09-28 12:22:47.689 29386 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:22:47 ctl02 nova-api[29386]: 2017-09-28 12:22:47.827 29386 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:22:47 ctl02 nova-api[29386]: 2017-09-28 12:22:47.829 29386 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:22:47 ctl02 nova-api[29386]: 2017-09-28 12:22:47.829 29386 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:22:47 ctl02 nova-api[29386]: 2017-09-28 12:22:47.829 29386 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:22:47 ctl02 nova-api[29386]: 2017-09-28 12:22:47.833 29386 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:22:47 ctl02 nova-api[29386]: 2017-09-28 12:22:47.834 29386 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:22:47 ctl02 nova-api[29386]: 2017-09-28 12:22:47.834 29386 ERROR nova Traceback (most recent call last):
Sep 28 12:22:47 ctl02 nova-api[29386]: 2017-09-28 12:22:47.834 29386 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:22:47 ctl02 nova-api[29386]: 2017-09-28 12:22:47.834 29386 ERROR nova     sys.exit(main())
Sep 28 12:22:47 ctl02 nova-api[29386]: 2017-09-28 12:22:47.834 29386 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:22:47 ctl02 nova-api[29386]: 2017-09-28 12:22:47.834 29386 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:22:47 ctl02 nova-api[29386]: 2017-09-28 12:22:47.834 29386 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:22:47 ctl02 nova-api[29386]: 2017-09-28 12:22:47.834 29386 ERROR nova     max_url_len=max_url_len)
Sep 28 12:22:47 ctl02 nova-api[29386]: 2017-09-28 12:22:47.834 29386 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:22:47 ctl02 nova-api[29386]: 2017-09-28 12:22:47.834 29386 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:22:47 ctl02 nova-api[29386]: 2017-09-28 12:22:47.834 29386 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:22:47 ctl02 nova-api[29386]: 2017-09-28 12:22:47.834 29386 ERROR nova     sock.listen(backlog)
Sep 28 12:22:47 ctl02 nova-api[29386]: 2017-09-28 12:22:47.834 29386 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:22:47 ctl02 nova-api[29386]: 2017-09-28 12:22:47.834 29386 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:22:47 ctl02 nova-api[29386]: 2017-09-28 12:22:47.834 29386 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:22:47 ctl02 nova-api[29386]: 2017-09-28 12:22:47.834 29386 ERROR nova
Sep 28 12:22:48 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:22:48 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:22:48 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:22:48 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:22:48 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:22:48 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:22:48 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:22:48 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:22:48.474 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:22:48] "OPTIONS / HTTP/1.0" 200 134 0.000483
Sep 28 12:22:49 ctl02 heat-api-cfn[13300]: 2017-09-28 12:22:49.455 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:22:49] "OPTIONS / HTTP/1.0" 200 134 0.000474
Sep 28 12:22:49 ctl02 heat-api-cfn[13300]: 2017-09-28 12:22:49.752 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:22:49] "OPTIONS / HTTP/1.0" 200 134 0.000439
Sep 28 12:22:49 ctl02 nova-api[29409]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:22:49 ctl02 nova-api[29409]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:22:49 ctl02 nova-api[29409]: 2017-09-28 12:22:49.965 29409 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:22:49 ctl02 nova-api[29409]: 2017-09-28 12:22:49.967 29409 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:22:49 ctl02 nova-api[29409]: 2017-09-28 12:22:49.967 29409 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:22:49 ctl02 nova-api[29409]: 2017-09-28 12:22:49.967 29409 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:22:49 ctl02 nova-api[29409]: 2017-09-28 12:22:49.967 29409 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:22:49 ctl02 nova-api[29409]: 2017-09-28 12:22:49.967 29409 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:22:49 ctl02 nova-api[29409]: 2017-09-28 12:22:49.967 29409 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:22:49 ctl02 nova-api[29409]: 2017-09-28 12:22:49.967 29409 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:22:49 ctl02 nova-api[29409]: 2017-09-28 12:22:49.967 29409 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:22:49 ctl02 nova-api[29409]: 2017-09-28 12:22:49.967 29409 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:22:49 ctl02 nova-api[29409]: 2017-09-28 12:22:49.967 29409 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:22:49 ctl02 nova-api[29409]: 2017-09-28 12:22:49.967 29409 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:22:49 ctl02 nova-api[29409]: 2017-09-28 12:22:49.967 29409 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:22:49 ctl02 nova-api[29409]: 2017-09-28 12:22:49.967 29409 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:22:49 ctl02 nova-api[29409]: 2017-09-28 12:22:49.967 29409 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:22:49 ctl02 nova-api[29409]: 2017-09-28 12:22:49.967 29409 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:22:49 ctl02 nova-api[29409]: 2017-09-28 12:22:49.967 29409 ERROR nova.wsgi     self.filename))
Sep 28 12:22:49 ctl02 nova-api[29409]: 2017-09-28 12:22:49.967 29409 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:22:49 ctl02 nova-api[29409]: 2017-09-28 12:22:49.967 29409 ERROR nova.wsgi
Sep 28 12:22:49 ctl02 nova-api[29409]: 2017-09-28 12:22:49.968 29409 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:22:50 ctl02 nova-api[29409]: 2017-09-28 12:22:50.098 29409 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:22:50 ctl02 nova-api[29409]: 2017-09-28 12:22:50.318 29409 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:22:50 ctl02 nova-api[29409]: 2017-09-28 12:22:50.320 29409 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:22:50 ctl02 nova-api[29409]: 2017-09-28 12:22:50.320 29409 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:22:50 ctl02 nova-api[29409]: 2017-09-28 12:22:50.320 29409 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:22:50 ctl02 heat-api[13008]: 2017-09-28 12:22:50.350 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:22:50] "OPTIONS / HTTP/1.0" 200 134 0.000593
Sep 28 12:22:50 ctl02 nova-api[29409]: 2017-09-28 12:22:50.452 29409 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:22:50 ctl02 nova-api[29409]: 2017-09-28 12:22:50.454 29409 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:22:50 ctl02 nova-api[29409]: 2017-09-28 12:22:50.454 29409 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:22:50 ctl02 nova-api[29409]: 2017-09-28 12:22:50.454 29409 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:22:50 ctl02 nova-api[29409]: 2017-09-28 12:22:50.457 29409 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:22:50 ctl02 nova-api[29409]: 2017-09-28 12:22:50.458 29409 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:22:50 ctl02 nova-api[29409]: 2017-09-28 12:22:50.458 29409 ERROR nova Traceback (most recent call last):
Sep 28 12:22:50 ctl02 nova-api[29409]: 2017-09-28 12:22:50.458 29409 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:22:50 ctl02 nova-api[29409]: 2017-09-28 12:22:50.458 29409 ERROR nova     sys.exit(main())
Sep 28 12:22:50 ctl02 nova-api[29409]: 2017-09-28 12:22:50.458 29409 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:22:50 ctl02 nova-api[29409]: 2017-09-28 12:22:50.458 29409 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:22:50 ctl02 nova-api[29409]: 2017-09-28 12:22:50.458 29409 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:22:50 ctl02 nova-api[29409]: 2017-09-28 12:22:50.458 29409 ERROR nova     max_url_len=max_url_len)
Sep 28 12:22:50 ctl02 nova-api[29409]: 2017-09-28 12:22:50.458 29409 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:22:50 ctl02 nova-api[29409]: 2017-09-28 12:22:50.458 29409 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:22:50 ctl02 nova-api[29409]: 2017-09-28 12:22:50.458 29409 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:22:50 ctl02 nova-api[29409]: 2017-09-28 12:22:50.458 29409 ERROR nova     sock.listen(backlog)
Sep 28 12:22:50 ctl02 nova-api[29409]: 2017-09-28 12:22:50.458 29409 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:22:50 ctl02 nova-api[29409]: 2017-09-28 12:22:50.458 29409 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:22:50 ctl02 nova-api[29409]: 2017-09-28 12:22:50.458 29409 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:22:50 ctl02 nova-api[29409]: 2017-09-28 12:22:50.458 29409 ERROR nova
Sep 28 12:22:50 ctl02 heat-api-cfn[13300]: 2017-09-28 12:22:50.479 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:22:50] "OPTIONS / HTTP/1.0" 200 134 0.000558
Sep 28 12:22:50 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:22:50 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:22:50 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:22:50 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:22:50 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:22:50 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:22:50 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:22:51 ctl02 glance-api[29183]: 2017-09-28 12:22:51.356 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:22:51] "OPTIONS / HTTP/1.0" 200 134 0.000680
Sep 28 12:22:52 ctl02 glance-api[29183]: 2017-09-28 12:22:52.103 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:22:52] "OPTIONS / HTTP/1.0" 200 134 0.000652
Sep 28 12:22:52 ctl02 nova-api[29427]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:22:52 ctl02 nova-api[29427]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:22:52 ctl02 nova-api[29427]: 2017-09-28 12:22:52.747 29427 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:22:52 ctl02 nova-api[29427]: 2017-09-28 12:22:52.749 29427 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:22:52 ctl02 nova-api[29427]: 2017-09-28 12:22:52.749 29427 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:22:52 ctl02 nova-api[29427]: 2017-09-28 12:22:52.749 29427 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:22:52 ctl02 nova-api[29427]: 2017-09-28 12:22:52.749 29427 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:22:52 ctl02 nova-api[29427]: 2017-09-28 12:22:52.749 29427 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:22:52 ctl02 nova-api[29427]: 2017-09-28 12:22:52.749 29427 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:22:52 ctl02 nova-api[29427]: 2017-09-28 12:22:52.749 29427 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:22:52 ctl02 nova-api[29427]: 2017-09-28 12:22:52.749 29427 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:22:52 ctl02 nova-api[29427]: 2017-09-28 12:22:52.749 29427 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:22:52 ctl02 nova-api[29427]: 2017-09-28 12:22:52.749 29427 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:22:52 ctl02 nova-api[29427]: 2017-09-28 12:22:52.749 29427 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:22:52 ctl02 nova-api[29427]: 2017-09-28 12:22:52.749 29427 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:22:52 ctl02 nova-api[29427]: 2017-09-28 12:22:52.749 29427 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:22:52 ctl02 nova-api[29427]: 2017-09-28 12:22:52.749 29427 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:22:52 ctl02 nova-api[29427]: 2017-09-28 12:22:52.749 29427 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:22:52 ctl02 nova-api[29427]: 2017-09-28 12:22:52.749 29427 ERROR nova.wsgi     self.filename))
Sep 28 12:22:52 ctl02 nova-api[29427]: 2017-09-28 12:22:52.749 29427 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:22:52 ctl02 nova-api[29427]: 2017-09-28 12:22:52.749 29427 ERROR nova.wsgi
Sep 28 12:22:52 ctl02 nova-api[29427]: 2017-09-28 12:22:52.751 29427 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:22:52 ctl02 nova-api[29427]: 2017-09-28 12:22:52.887 29427 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:22:53 ctl02 nova-api[29427]: 2017-09-28 12:22:53.143 29427 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:22:53 ctl02 nova-api[29427]: 2017-09-28 12:22:53.146 29427 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:22:53 ctl02 nova-api[29427]: 2017-09-28 12:22:53.146 29427 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:22:53 ctl02 nova-api[29427]: 2017-09-28 12:22:53.146 29427 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:22:53 ctl02 nova-api[29427]: 2017-09-28 12:22:53.283 29427 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:22:53 ctl02 nova-api[29427]: 2017-09-28 12:22:53.285 29427 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:22:53 ctl02 nova-api[29427]: 2017-09-28 12:22:53.285 29427 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:22:53 ctl02 nova-api[29427]: 2017-09-28 12:22:53.285 29427 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:22:53 ctl02 nova-api[29427]: 2017-09-28 12:22:53.289 29427 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:22:53 ctl02 nova-api[29427]: 2017-09-28 12:22:53.289 29427 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:22:53 ctl02 nova-api[29427]: 2017-09-28 12:22:53.289 29427 ERROR nova Traceback (most recent call last):
Sep 28 12:22:53 ctl02 nova-api[29427]: 2017-09-28 12:22:53.289 29427 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:22:53 ctl02 nova-api[29427]: 2017-09-28 12:22:53.289 29427 ERROR nova     sys.exit(main())
Sep 28 12:22:53 ctl02 nova-api[29427]: 2017-09-28 12:22:53.289 29427 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:22:53 ctl02 nova-api[29427]: 2017-09-28 12:22:53.289 29427 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:22:53 ctl02 nova-api[29427]: 2017-09-28 12:22:53.289 29427 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:22:53 ctl02 nova-api[29427]: 2017-09-28 12:22:53.289 29427 ERROR nova     max_url_len=max_url_len)
Sep 28 12:22:53 ctl02 nova-api[29427]: 2017-09-28 12:22:53.289 29427 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:22:53 ctl02 nova-api[29427]: 2017-09-28 12:22:53.289 29427 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:22:53 ctl02 nova-api[29427]: 2017-09-28 12:22:53.289 29427 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:22:53 ctl02 nova-api[29427]: 2017-09-28 12:22:53.289 29427 ERROR nova     sock.listen(backlog)
Sep 28 12:22:53 ctl02 nova-api[29427]: 2017-09-28 12:22:53.289 29427 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:22:53 ctl02 nova-api[29427]: 2017-09-28 12:22:53.289 29427 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:22:53 ctl02 nova-api[29427]: 2017-09-28 12:22:53.289 29427 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:22:53 ctl02 nova-api[29427]: 2017-09-28 12:22:53.289 29427 ERROR nova
Sep 28 12:22:53 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:22:53 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:22:53 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:22:53 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:22:53 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:22:53 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:22:53 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:22:53 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:22:53.711 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:22:53] "OPTIONS / HTTP/1.0" 200 134 0.000475
Sep 28 12:22:54 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command state.sls with jid 20170928122254321820
Sep 28 12:22:54 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 29456
Sep 28 12:22:54 ctl02 glance-api[29183]: 2017-09-28 12:22:54.620 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:22:54] "OPTIONS / HTTP/1.0" 200 134 0.000596
Sep 28 12:22:55 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:22:55.022 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:22:55] "OPTIONS / HTTP/1.0" 200 134 0.000505
Sep 28 12:22:55 ctl02 nova-api[29445]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:22:55 ctl02 nova-api[29445]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:22:55 ctl02 heat-api[13008]: 2017-09-28 12:22:55.505 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:22:55] "OPTIONS / HTTP/1.0" 200 134 0.000657
Sep 28 12:22:55 ctl02 nova-api[29445]: 2017-09-28 12:22:55.530 29445 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:22:55 ctl02 nova-api[29445]: 2017-09-28 12:22:55.532 29445 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:22:55 ctl02 nova-api[29445]: 2017-09-28 12:22:55.532 29445 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:22:55 ctl02 nova-api[29445]: 2017-09-28 12:22:55.532 29445 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:22:55 ctl02 nova-api[29445]: 2017-09-28 12:22:55.532 29445 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:22:55 ctl02 nova-api[29445]: 2017-09-28 12:22:55.532 29445 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:22:55 ctl02 nova-api[29445]: 2017-09-28 12:22:55.532 29445 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:22:55 ctl02 nova-api[29445]: 2017-09-28 12:22:55.532 29445 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:22:55 ctl02 nova-api[29445]: 2017-09-28 12:22:55.532 29445 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:22:55 ctl02 nova-api[29445]: 2017-09-28 12:22:55.532 29445 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:22:55 ctl02 nova-api[29445]: 2017-09-28 12:22:55.532 29445 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:22:55 ctl02 nova-api[29445]: 2017-09-28 12:22:55.532 29445 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:22:55 ctl02 nova-api[29445]: 2017-09-28 12:22:55.532 29445 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:22:55 ctl02 nova-api[29445]: 2017-09-28 12:22:55.532 29445 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:22:55 ctl02 nova-api[29445]: 2017-09-28 12:22:55.532 29445 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:22:55 ctl02 nova-api[29445]: 2017-09-28 12:22:55.532 29445 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:22:55 ctl02 nova-api[29445]: 2017-09-28 12:22:55.532 29445 ERROR nova.wsgi     self.filename))
Sep 28 12:22:55 ctl02 nova-api[29445]: 2017-09-28 12:22:55.532 29445 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:22:55 ctl02 nova-api[29445]: 2017-09-28 12:22:55.532 29445 ERROR nova.wsgi
Sep 28 12:22:55 ctl02 nova-api[29445]: 2017-09-28 12:22:55.533 29445 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:22:55 ctl02 nova-api[29445]: 2017-09-28 12:22:55.672 29445 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:22:55 ctl02 nova-api[29445]: 2017-09-28 12:22:55.916 29445 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:22:55 ctl02 nova-api[29445]: 2017-09-28 12:22:55.918 29445 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:22:55 ctl02 nova-api[29445]: 2017-09-28 12:22:55.918 29445 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:22:55 ctl02 nova-api[29445]: 2017-09-28 12:22:55.919 29445 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:22:56 ctl02 salt-minion[14967]: [INFO    ] Loading fresh modules for state activity
Sep 28 12:22:56 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'neutron/init.sls'
Sep 28 12:22:56 ctl02 nova-api[29445]: 2017-09-28 12:22:56.053 29445 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:22:56 ctl02 nova-api[29445]: 2017-09-28 12:22:56.055 29445 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:22:56 ctl02 nova-api[29445]: 2017-09-28 12:22:56.055 29445 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:22:56 ctl02 nova-api[29445]: 2017-09-28 12:22:56.056 29445 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:22:56 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'neutron/server.sls'
Sep 28 12:22:56 ctl02 nova-api[29445]: 2017-09-28 12:22:56.059 29445 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:22:56 ctl02 nova-api[29445]: 2017-09-28 12:22:56.059 29445 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:22:56 ctl02 nova-api[29445]: 2017-09-28 12:22:56.059 29445 ERROR nova Traceback (most recent call last):
Sep 28 12:22:56 ctl02 nova-api[29445]: 2017-09-28 12:22:56.059 29445 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:22:56 ctl02 nova-api[29445]: 2017-09-28 12:22:56.059 29445 ERROR nova     sys.exit(main())
Sep 28 12:22:56 ctl02 nova-api[29445]: 2017-09-28 12:22:56.059 29445 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:22:56 ctl02 nova-api[29445]: 2017-09-28 12:22:56.059 29445 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:22:56 ctl02 nova-api[29445]: 2017-09-28 12:22:56.059 29445 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:22:56 ctl02 nova-api[29445]: 2017-09-28 12:22:56.059 29445 ERROR nova     max_url_len=max_url_len)
Sep 28 12:22:56 ctl02 nova-api[29445]: 2017-09-28 12:22:56.059 29445 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:22:56 ctl02 nova-api[29445]: 2017-09-28 12:22:56.059 29445 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:22:56 ctl02 nova-api[29445]: 2017-09-28 12:22:56.059 29445 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:22:56 ctl02 nova-api[29445]: 2017-09-28 12:22:56.059 29445 ERROR nova     sock.listen(backlog)
Sep 28 12:22:56 ctl02 nova-api[29445]: 2017-09-28 12:22:56.059 29445 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:22:56 ctl02 nova-api[29445]: 2017-09-28 12:22:56.059 29445 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:22:56 ctl02 nova-api[29445]: 2017-09-28 12:22:56.059 29445 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:22:56 ctl02 nova-api[29445]: 2017-09-28 12:22:56.059 29445 ERROR nova
Sep 28 12:22:56 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'neutron/map.jinja'
Sep 28 12:22:56 ctl02 salt-minion[14967]: [INFO    ] Running state [/usr/sbin/policy-rc.d] at time 12:22:56.128574
Sep 28 12:22:56 ctl02 salt-minion[14967]: [INFO    ] Executing state file.managed for /usr/sbin/policy-rc.d
Sep 28 12:22:56 ctl02 salt-minion[14967]: [INFO    ] File changed:
Sep 28 12:22:56 ctl02 salt-minion[14967]: New file
Sep 28 12:22:56 ctl02 salt-minion[14967]: [INFO    ] Completed state [/usr/sbin/policy-rc.d] at time 12:22:56.138985 duration_in_ms=10.41
Sep 28 12:22:56 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:22:56 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:22:56 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:22:56 ctl02 heat-api[13008]: 2017-09-28 12:22:56.277 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:22:56] "OPTIONS / HTTP/1.0" 200 134 0.000591
Sep 28 12:22:56 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:22:56 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:22:56 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:22:56 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:22:56 ctl02 salt-minion[14967]: [INFO    ] Running state [neutron-server] at time 12:22:56.936830
Sep 28 12:22:56 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for neutron-server
Sep 28 12:22:56 ctl02 salt-minion[14967]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 12:22:57 ctl02 salt-minion[14967]: [INFO    ] Executing command ['apt-get', '-q', 'update'] in directory '/root'
Sep 28 12:22:58 ctl02 nova-api[29474]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:22:58 ctl02 nova-api[29474]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:22:58 ctl02 nova-api[29474]: 2017-09-28 12:22:58.230 29474 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:22:58 ctl02 nova-api[29474]: 2017-09-28 12:22:58.232 29474 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:22:58 ctl02 nova-api[29474]: 2017-09-28 12:22:58.232 29474 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:22:58 ctl02 nova-api[29474]: 2017-09-28 12:22:58.232 29474 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:22:58 ctl02 nova-api[29474]: 2017-09-28 12:22:58.232 29474 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:22:58 ctl02 nova-api[29474]: 2017-09-28 12:22:58.232 29474 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:22:58 ctl02 nova-api[29474]: 2017-09-28 12:22:58.232 29474 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:22:58 ctl02 nova-api[29474]: 2017-09-28 12:22:58.232 29474 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:22:58 ctl02 nova-api[29474]: 2017-09-28 12:22:58.232 29474 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:22:58 ctl02 nova-api[29474]: 2017-09-28 12:22:58.232 29474 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:22:58 ctl02 nova-api[29474]: 2017-09-28 12:22:58.232 29474 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:22:58 ctl02 nova-api[29474]: 2017-09-28 12:22:58.232 29474 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:22:58 ctl02 nova-api[29474]: 2017-09-28 12:22:58.232 29474 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:22:58 ctl02 nova-api[29474]: 2017-09-28 12:22:58.232 29474 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:22:58 ctl02 nova-api[29474]: 2017-09-28 12:22:58.232 29474 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:22:58 ctl02 nova-api[29474]: 2017-09-28 12:22:58.232 29474 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:22:58 ctl02 nova-api[29474]: 2017-09-28 12:22:58.232 29474 ERROR nova.wsgi     self.filename))
Sep 28 12:22:58 ctl02 nova-api[29474]: 2017-09-28 12:22:58.232 29474 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:22:58 ctl02 nova-api[29474]: 2017-09-28 12:22:58.232 29474 ERROR nova.wsgi
Sep 28 12:22:58 ctl02 nova-api[29474]: 2017-09-28 12:22:58.233 29474 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:22:58 ctl02 nova-api[29474]: 2017-09-28 12:22:58.367 29474 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:22:58 ctl02 nova-api[29474]: 2017-09-28 12:22:58.585 29474 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:22:58 ctl02 nova-api[29474]: 2017-09-28 12:22:58.587 29474 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:22:58 ctl02 nova-api[29474]: 2017-09-28 12:22:58.587 29474 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:22:58 ctl02 nova-api[29474]: 2017-09-28 12:22:58.588 29474 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:22:58 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:22:58.710 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:22:58] "OPTIONS / HTTP/1.0" 200 134 0.000439
Sep 28 12:22:58 ctl02 nova-api[29474]: 2017-09-28 12:22:58.719 29474 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:22:58 ctl02 nova-api[29474]: 2017-09-28 12:22:58.721 29474 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:22:58 ctl02 nova-api[29474]: 2017-09-28 12:22:58.721 29474 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:22:58 ctl02 nova-api[29474]: 2017-09-28 12:22:58.722 29474 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:22:58 ctl02 nova-api[29474]: 2017-09-28 12:22:58.725 29474 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:22:58 ctl02 nova-api[29474]: 2017-09-28 12:22:58.725 29474 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:22:58 ctl02 nova-api[29474]: 2017-09-28 12:22:58.725 29474 ERROR nova Traceback (most recent call last):
Sep 28 12:22:58 ctl02 nova-api[29474]: 2017-09-28 12:22:58.725 29474 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:22:58 ctl02 nova-api[29474]: 2017-09-28 12:22:58.725 29474 ERROR nova     sys.exit(main())
Sep 28 12:22:58 ctl02 nova-api[29474]: 2017-09-28 12:22:58.725 29474 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:22:58 ctl02 nova-api[29474]: 2017-09-28 12:22:58.725 29474 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:22:58 ctl02 nova-api[29474]: 2017-09-28 12:22:58.725 29474 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:22:58 ctl02 nova-api[29474]: 2017-09-28 12:22:58.725 29474 ERROR nova     max_url_len=max_url_len)
Sep 28 12:22:58 ctl02 nova-api[29474]: 2017-09-28 12:22:58.725 29474 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:22:58 ctl02 nova-api[29474]: 2017-09-28 12:22:58.725 29474 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:22:58 ctl02 nova-api[29474]: 2017-09-28 12:22:58.725 29474 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:22:58 ctl02 nova-api[29474]: 2017-09-28 12:22:58.725 29474 ERROR nova     sock.listen(backlog)
Sep 28 12:22:58 ctl02 nova-api[29474]: 2017-09-28 12:22:58.725 29474 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:22:58 ctl02 nova-api[29474]: 2017-09-28 12:22:58.725 29474 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:22:58 ctl02 nova-api[29474]: 2017-09-28 12:22:58.725 29474 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:22:58 ctl02 nova-api[29474]: 2017-09-28 12:22:58.725 29474 ERROR nova
Sep 28 12:22:58 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:22:58 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:22:58 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:22:59 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:22:59 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:22:59 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:22:59 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:22:59 ctl02 heat-api-cfn[13300]: 2017-09-28 12:22:59.435 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:22:59] "OPTIONS / HTTP/1.0" 200 134 0.000508
Sep 28 12:22:59 ctl02 heat-api-cfn[13300]: 2017-09-28 12:22:59.581 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:22:59] "OPTIONS / HTTP/1.0" 200 134 0.000479
Sep 28 12:22:59 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemd-run', '--scope', 'apt-get', '-q', '-y', '-o', 'DPkg::Options::=--force-confold', '-o', 'DPkg::Options::=--force-confdef', 'install', 'neutron-server'] in directory '/root'
Sep 28 12:22:59 ctl02 systemd[1]: Started /usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold -o DPkg::Options::=--force-confdef install neutron-server.
Sep 28 12:23:00 ctl02 heat-api[13008]: 2017-09-28 12:23:00.296 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:23:00] "OPTIONS / HTTP/1.0" 200 134 0.000634
Sep 28 12:23:00 ctl02 heat-api-cfn[13300]: 2017-09-28 12:23:00.322 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:23:00] "OPTIONS / HTTP/1.0" 200 134 0.000527
Sep 28 12:23:00 ctl02 nova-api[29895]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:23:00 ctl02 nova-api[29895]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:23:00 ctl02 nova-api[29895]: 2017-09-28 12:23:00.957 29895 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:23:00 ctl02 nova-api[29895]: 2017-09-28 12:23:00.959 29895 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:23:00 ctl02 nova-api[29895]: 2017-09-28 12:23:00.959 29895 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:23:00 ctl02 nova-api[29895]: 2017-09-28 12:23:00.959 29895 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:23:00 ctl02 nova-api[29895]: 2017-09-28 12:23:00.959 29895 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:23:00 ctl02 nova-api[29895]: 2017-09-28 12:23:00.959 29895 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:23:00 ctl02 nova-api[29895]: 2017-09-28 12:23:00.959 29895 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:23:00 ctl02 nova-api[29895]: 2017-09-28 12:23:00.959 29895 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:23:00 ctl02 nova-api[29895]: 2017-09-28 12:23:00.959 29895 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:23:00 ctl02 nova-api[29895]: 2017-09-28 12:23:00.959 29895 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:23:00 ctl02 nova-api[29895]: 2017-09-28 12:23:00.959 29895 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:23:00 ctl02 nova-api[29895]: 2017-09-28 12:23:00.959 29895 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:23:00 ctl02 nova-api[29895]: 2017-09-28 12:23:00.959 29895 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:23:00 ctl02 nova-api[29895]: 2017-09-28 12:23:00.959 29895 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:23:00 ctl02 nova-api[29895]: 2017-09-28 12:23:00.959 29895 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:23:00 ctl02 nova-api[29895]: 2017-09-28 12:23:00.959 29895 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:23:00 ctl02 nova-api[29895]: 2017-09-28 12:23:00.959 29895 ERROR nova.wsgi     self.filename))
Sep 28 12:23:00 ctl02 nova-api[29895]: 2017-09-28 12:23:00.959 29895 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:23:00 ctl02 nova-api[29895]: 2017-09-28 12:23:00.959 29895 ERROR nova.wsgi
Sep 28 12:23:00 ctl02 nova-api[29895]: 2017-09-28 12:23:00.960 29895 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:23:01 ctl02 nova-api[29895]: 2017-09-28 12:23:01.090 29895 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:23:01 ctl02 nova-cert[4860]: 2017-09-28 12:23:01.265 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:23:01 ctl02 nova-api[29895]: 2017-09-28 12:23:01.308 29895 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:23:01 ctl02 nova-api[29895]: 2017-09-28 12:23:01.310 29895 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:23:01 ctl02 nova-api[29895]: 2017-09-28 12:23:01.310 29895 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:23:01 ctl02 nova-api[29895]: 2017-09-28 12:23:01.311 29895 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:23:01 ctl02 nova-api[29895]: 2017-09-28 12:23:01.442 29895 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:23:01 ctl02 nova-api[29895]: 2017-09-28 12:23:01.444 29895 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:23:01 ctl02 nova-api[29895]: 2017-09-28 12:23:01.444 29895 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:23:01 ctl02 nova-api[29895]: 2017-09-28 12:23:01.444 29895 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:23:01 ctl02 nova-api[29895]: 2017-09-28 12:23:01.448 29895 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:23:01 ctl02 nova-api[29895]: 2017-09-28 12:23:01.448 29895 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:23:01 ctl02 nova-api[29895]: 2017-09-28 12:23:01.448 29895 ERROR nova Traceback (most recent call last):
Sep 28 12:23:01 ctl02 nova-api[29895]: 2017-09-28 12:23:01.448 29895 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:23:01 ctl02 nova-api[29895]: 2017-09-28 12:23:01.448 29895 ERROR nova     sys.exit(main())
Sep 28 12:23:01 ctl02 nova-api[29895]: 2017-09-28 12:23:01.448 29895 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:23:01 ctl02 nova-api[29895]: 2017-09-28 12:23:01.448 29895 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:23:01 ctl02 nova-api[29895]: 2017-09-28 12:23:01.448 29895 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:23:01 ctl02 nova-api[29895]: 2017-09-28 12:23:01.448 29895 ERROR nova     max_url_len=max_url_len)
Sep 28 12:23:01 ctl02 nova-api[29895]: 2017-09-28 12:23:01.448 29895 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:23:01 ctl02 nova-api[29895]: 2017-09-28 12:23:01.448 29895 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:23:01 ctl02 nova-api[29895]: 2017-09-28 12:23:01.448 29895 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:23:01 ctl02 nova-api[29895]: 2017-09-28 12:23:01.448 29895 ERROR nova     sock.listen(backlog)
Sep 28 12:23:01 ctl02 nova-api[29895]: 2017-09-28 12:23:01.448 29895 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:23:01 ctl02 nova-api[29895]: 2017-09-28 12:23:01.448 29895 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:23:01 ctl02 nova-api[29895]: 2017-09-28 12:23:01.448 29895 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:23:01 ctl02 nova-api[29895]: 2017-09-28 12:23:01.448 29895 ERROR nova
Sep 28 12:23:01 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:23:01 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:23:01 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:23:01 ctl02 glance-api[29183]: 2017-09-28 12:23:01.686 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:23:01] "OPTIONS / HTTP/1.0" 200 134 0.000620
Sep 28 12:23:01 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:23:01 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:23:01 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:23:01 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:23:02 ctl02 glance-api[29183]: 2017-09-28 12:23:02.071 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:23:02] "OPTIONS / HTTP/1.0" 200 134 0.000645
Sep 28 12:23:02 ctl02 nova-conductor[5056]: 2017-09-28 12:23:02.616 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:23:02 ctl02 nova-conductor[5056]: 2017-09-28 12:23:02.633 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:23:02 ctl02 nova-conductor[5056]: 2017-09-28 12:23:02.654 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:23:02 ctl02 nova-conductor[5056]: 2017-09-28 12:23:02.659 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:23:03 ctl02 nova-api[29951]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:23:03 ctl02 nova-api[29951]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:23:03 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:23:03.776 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:23:03] "OPTIONS / HTTP/1.0" 200 134 0.000444
Sep 28 12:23:03 ctl02 nova-api[29951]: 2017-09-28 12:23:03.778 29951 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:23:03 ctl02 nova-api[29951]: 2017-09-28 12:23:03.780 29951 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:23:03 ctl02 nova-api[29951]: 2017-09-28 12:23:03.780 29951 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:23:03 ctl02 nova-api[29951]: 2017-09-28 12:23:03.780 29951 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:23:03 ctl02 nova-api[29951]: 2017-09-28 12:23:03.780 29951 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:23:03 ctl02 nova-api[29951]: 2017-09-28 12:23:03.780 29951 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:23:03 ctl02 nova-api[29951]: 2017-09-28 12:23:03.780 29951 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:23:03 ctl02 nova-api[29951]: 2017-09-28 12:23:03.780 29951 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:23:03 ctl02 nova-api[29951]: 2017-09-28 12:23:03.780 29951 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:23:03 ctl02 nova-api[29951]: 2017-09-28 12:23:03.780 29951 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:23:03 ctl02 nova-api[29951]: 2017-09-28 12:23:03.780 29951 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:23:03 ctl02 nova-api[29951]: 2017-09-28 12:23:03.780 29951 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:23:03 ctl02 nova-api[29951]: 2017-09-28 12:23:03.780 29951 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:23:03 ctl02 nova-api[29951]: 2017-09-28 12:23:03.780 29951 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:23:03 ctl02 nova-api[29951]: 2017-09-28 12:23:03.780 29951 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:23:03 ctl02 nova-api[29951]: 2017-09-28 12:23:03.780 29951 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:23:03 ctl02 nova-api[29951]: 2017-09-28 12:23:03.780 29951 ERROR nova.wsgi     self.filename))
Sep 28 12:23:03 ctl02 nova-api[29951]: 2017-09-28 12:23:03.780 29951 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:23:03 ctl02 nova-api[29951]: 2017-09-28 12:23:03.780 29951 ERROR nova.wsgi
Sep 28 12:23:03 ctl02 nova-api[29951]: 2017-09-28 12:23:03.781 29951 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:23:03 ctl02 nova-api[29951]: 2017-09-28 12:23:03.912 29951 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:23:04 ctl02 nova-api[29951]: 2017-09-28 12:23:04.136 29951 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:23:04 ctl02 nova-api[29951]: 2017-09-28 12:23:04.138 29951 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:23:04 ctl02 nova-api[29951]: 2017-09-28 12:23:04.138 29951 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:23:04 ctl02 nova-api[29951]: 2017-09-28 12:23:04.138 29951 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:23:04 ctl02 nova-api[29951]: 2017-09-28 12:23:04.272 29951 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:23:04 ctl02 nova-api[29951]: 2017-09-28 12:23:04.274 29951 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:23:04 ctl02 nova-api[29951]: 2017-09-28 12:23:04.275 29951 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:23:04 ctl02 nova-api[29951]: 2017-09-28 12:23:04.275 29951 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:23:04 ctl02 nova-api[29951]: 2017-09-28 12:23:04.278 29951 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:23:04 ctl02 nova-api[29951]: 2017-09-28 12:23:04.278 29951 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:23:04 ctl02 nova-api[29951]: 2017-09-28 12:23:04.278 29951 ERROR nova Traceback (most recent call last):
Sep 28 12:23:04 ctl02 nova-api[29951]: 2017-09-28 12:23:04.278 29951 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:23:04 ctl02 nova-api[29951]: 2017-09-28 12:23:04.278 29951 ERROR nova     sys.exit(main())
Sep 28 12:23:04 ctl02 nova-api[29951]: 2017-09-28 12:23:04.278 29951 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:23:04 ctl02 nova-api[29951]: 2017-09-28 12:23:04.278 29951 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:23:04 ctl02 nova-api[29951]: 2017-09-28 12:23:04.278 29951 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:23:04 ctl02 nova-api[29951]: 2017-09-28 12:23:04.278 29951 ERROR nova     max_url_len=max_url_len)
Sep 28 12:23:04 ctl02 nova-api[29951]: 2017-09-28 12:23:04.278 29951 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:23:04 ctl02 nova-api[29951]: 2017-09-28 12:23:04.278 29951 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:23:04 ctl02 nova-api[29951]: 2017-09-28 12:23:04.278 29951 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:23:04 ctl02 nova-api[29951]: 2017-09-28 12:23:04.278 29951 ERROR nova     sock.listen(backlog)
Sep 28 12:23:04 ctl02 nova-api[29951]: 2017-09-28 12:23:04.278 29951 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:23:04 ctl02 nova-api[29951]: 2017-09-28 12:23:04.278 29951 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:23:04 ctl02 nova-api[29951]: 2017-09-28 12:23:04.278 29951 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:23:04 ctl02 nova-api[29951]: 2017-09-28 12:23:04.278 29951 ERROR nova
Sep 28 12:23:04 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928122304364150
Sep 28 12:23:04 ctl02 glance-api[29183]: 2017-09-28 12:23:04.373 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:23:04] "OPTIONS / HTTP/1.0" 200 134 0.000728
Sep 28 12:23:04 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 30024
Sep 28 12:23:04 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928122304364150
Sep 28 12:23:04 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:23:04 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:23:04 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:23:04 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:23:04 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:23:04 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:23:04 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:23:05 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:23:05.251 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:23:05] "OPTIONS / HTTP/1.0" 200 134 0.000421
Sep 28 12:23:05 ctl02 heat-api[13008]: 2017-09-28 12:23:05.402 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:23:05] "OPTIONS / HTTP/1.0" 200 134 0.000595
Sep 28 12:23:06 ctl02 nova-api[30043]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:23:06 ctl02 nova-api[30043]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:23:06 ctl02 nova-api[30043]: 2017-09-28 12:23:06.458 30043 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:23:06 ctl02 nova-api[30043]: 2017-09-28 12:23:06.460 30043 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:23:06 ctl02 nova-api[30043]: 2017-09-28 12:23:06.460 30043 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:23:06 ctl02 nova-api[30043]: 2017-09-28 12:23:06.460 30043 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:23:06 ctl02 nova-api[30043]: 2017-09-28 12:23:06.460 30043 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:23:06 ctl02 nova-api[30043]: 2017-09-28 12:23:06.460 30043 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:23:06 ctl02 nova-api[30043]: 2017-09-28 12:23:06.460 30043 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:23:06 ctl02 nova-api[30043]: 2017-09-28 12:23:06.460 30043 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:23:06 ctl02 nova-api[30043]: 2017-09-28 12:23:06.460 30043 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:23:06 ctl02 nova-api[30043]: 2017-09-28 12:23:06.460 30043 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:23:06 ctl02 nova-api[30043]: 2017-09-28 12:23:06.460 30043 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:23:06 ctl02 nova-api[30043]: 2017-09-28 12:23:06.460 30043 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:23:06 ctl02 nova-api[30043]: 2017-09-28 12:23:06.460 30043 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:23:06 ctl02 nova-api[30043]: 2017-09-28 12:23:06.460 30043 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:23:06 ctl02 nova-api[30043]: 2017-09-28 12:23:06.460 30043 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:23:06 ctl02 nova-api[30043]: 2017-09-28 12:23:06.460 30043 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:23:06 ctl02 nova-api[30043]: 2017-09-28 12:23:06.460 30043 ERROR nova.wsgi     self.filename))
Sep 28 12:23:06 ctl02 nova-api[30043]: 2017-09-28 12:23:06.460 30043 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:23:06 ctl02 nova-api[30043]: 2017-09-28 12:23:06.460 30043 ERROR nova.wsgi
Sep 28 12:23:06 ctl02 nova-api[30043]: 2017-09-28 12:23:06.461 30043 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:23:06 ctl02 heat-api[13008]: 2017-09-28 12:23:06.478 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:23:06] "OPTIONS / HTTP/1.0" 200 134 0.000596
Sep 28 12:23:06 ctl02 nova-api[30043]: 2017-09-28 12:23:06.598 30043 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:23:06 ctl02 nova-api[30043]: 2017-09-28 12:23:06.827 30043 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:23:06 ctl02 nova-api[30043]: 2017-09-28 12:23:06.829 30043 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:23:06 ctl02 nova-api[30043]: 2017-09-28 12:23:06.830 30043 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:23:06 ctl02 nova-api[30043]: 2017-09-28 12:23:06.830 30043 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:23:06 ctl02 nova-api[30043]: 2017-09-28 12:23:06.963 30043 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:23:06 ctl02 nova-api[30043]: 2017-09-28 12:23:06.965 30043 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:23:06 ctl02 nova-api[30043]: 2017-09-28 12:23:06.965 30043 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:23:06 ctl02 nova-api[30043]: 2017-09-28 12:23:06.966 30043 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:23:06 ctl02 nova-api[30043]: 2017-09-28 12:23:06.969 30043 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:23:06 ctl02 nova-api[30043]: 2017-09-28 12:23:06.969 30043 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:23:06 ctl02 nova-api[30043]: 2017-09-28 12:23:06.969 30043 ERROR nova Traceback (most recent call last):
Sep 28 12:23:06 ctl02 nova-api[30043]: 2017-09-28 12:23:06.969 30043 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:23:06 ctl02 nova-api[30043]: 2017-09-28 12:23:06.969 30043 ERROR nova     sys.exit(main())
Sep 28 12:23:06 ctl02 nova-api[30043]: 2017-09-28 12:23:06.969 30043 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:23:06 ctl02 nova-api[30043]: 2017-09-28 12:23:06.969 30043 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:23:06 ctl02 nova-api[30043]: 2017-09-28 12:23:06.969 30043 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:23:06 ctl02 nova-api[30043]: 2017-09-28 12:23:06.969 30043 ERROR nova     max_url_len=max_url_len)
Sep 28 12:23:06 ctl02 nova-api[30043]: 2017-09-28 12:23:06.969 30043 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:23:06 ctl02 nova-api[30043]: 2017-09-28 12:23:06.969 30043 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:23:06 ctl02 nova-api[30043]: 2017-09-28 12:23:06.969 30043 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:23:06 ctl02 nova-api[30043]: 2017-09-28 12:23:06.969 30043 ERROR nova     sock.listen(backlog)
Sep 28 12:23:06 ctl02 nova-api[30043]: 2017-09-28 12:23:06.969 30043 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:23:06 ctl02 nova-api[30043]: 2017-09-28 12:23:06.969 30043 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:23:06 ctl02 nova-api[30043]: 2017-09-28 12:23:06.969 30043 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:23:06 ctl02 nova-api[30043]: 2017-09-28 12:23:06.969 30043 ERROR nova
Sep 28 12:23:07 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:23:07 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:23:07 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:23:07 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:23:07 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:23:07 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:23:07 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:23:07 ctl02 systemd[1]: Reloading.
Sep 28 12:23:08 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:23:08.551 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:23:08] "OPTIONS / HTTP/1.0" 200 134 0.000411
Sep 28 12:23:09 ctl02 nova-api[30094]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:23:09 ctl02 nova-api[30094]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:23:09 ctl02 heat-api-cfn[13300]: 2017-09-28 12:23:09.082 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:23:09] "OPTIONS / HTTP/1.0" 200 134 0.000450
Sep 28 12:23:09 ctl02 nova-api[30094]: 2017-09-28 12:23:09.239 30094 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:23:09 ctl02 nova-api[30094]: 2017-09-28 12:23:09.241 30094 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:23:09 ctl02 nova-api[30094]: 2017-09-28 12:23:09.241 30094 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:23:09 ctl02 nova-api[30094]: 2017-09-28 12:23:09.241 30094 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:23:09 ctl02 nova-api[30094]: 2017-09-28 12:23:09.241 30094 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:23:09 ctl02 nova-api[30094]: 2017-09-28 12:23:09.241 30094 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:23:09 ctl02 nova-api[30094]: 2017-09-28 12:23:09.241 30094 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:23:09 ctl02 nova-api[30094]: 2017-09-28 12:23:09.241 30094 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:23:09 ctl02 nova-api[30094]: 2017-09-28 12:23:09.241 30094 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:23:09 ctl02 nova-api[30094]: 2017-09-28 12:23:09.241 30094 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:23:09 ctl02 nova-api[30094]: 2017-09-28 12:23:09.241 30094 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:23:09 ctl02 nova-api[30094]: 2017-09-28 12:23:09.241 30094 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:23:09 ctl02 nova-api[30094]: 2017-09-28 12:23:09.241 30094 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:23:09 ctl02 nova-api[30094]: 2017-09-28 12:23:09.241 30094 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:23:09 ctl02 nova-api[30094]: 2017-09-28 12:23:09.241 30094 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:23:09 ctl02 nova-api[30094]: 2017-09-28 12:23:09.241 30094 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:23:09 ctl02 nova-api[30094]: 2017-09-28 12:23:09.241 30094 ERROR nova.wsgi     self.filename))
Sep 28 12:23:09 ctl02 nova-api[30094]: 2017-09-28 12:23:09.241 30094 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:23:09 ctl02 nova-api[30094]: 2017-09-28 12:23:09.241 30094 ERROR nova.wsgi
Sep 28 12:23:09 ctl02 nova-api[30094]: 2017-09-28 12:23:09.242 30094 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:23:09 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xea9d5508)
Sep 28 12:23:09 ctl02 nova-api[30094]: 2017-09-28 12:23:09.377 30094 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:23:09 ctl02 heat-api-cfn[13300]: 2017-09-28 12:23:09.561 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:23:09] "OPTIONS / HTTP/1.0" 200 134 0.000478
Sep 28 12:23:09 ctl02 nova-api[30094]: 2017-09-28 12:23:09.606 30094 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:23:09 ctl02 nova-api[30094]: 2017-09-28 12:23:09.608 30094 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:23:09 ctl02 nova-api[30094]: 2017-09-28 12:23:09.608 30094 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:23:09 ctl02 nova-api[30094]: 2017-09-28 12:23:09.609 30094 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:23:09 ctl02 nova-api[30094]: 2017-09-28 12:23:09.743 30094 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:23:09 ctl02 nova-api[30094]: 2017-09-28 12:23:09.745 30094 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:23:09 ctl02 nova-api[30094]: 2017-09-28 12:23:09.746 30094 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:23:09 ctl02 nova-api[30094]: 2017-09-28 12:23:09.746 30094 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:23:09 ctl02 nova-api[30094]: 2017-09-28 12:23:09.749 30094 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:23:09 ctl02 nova-api[30094]: 2017-09-28 12:23:09.749 30094 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:23:09 ctl02 nova-api[30094]: 2017-09-28 12:23:09.749 30094 ERROR nova Traceback (most recent call last):
Sep 28 12:23:09 ctl02 nova-api[30094]: 2017-09-28 12:23:09.749 30094 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:23:09 ctl02 nova-api[30094]: 2017-09-28 12:23:09.749 30094 ERROR nova     sys.exit(main())
Sep 28 12:23:09 ctl02 nova-api[30094]: 2017-09-28 12:23:09.749 30094 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:23:09 ctl02 nova-api[30094]: 2017-09-28 12:23:09.749 30094 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:23:09 ctl02 nova-api[30094]: 2017-09-28 12:23:09.749 30094 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:23:09 ctl02 nova-api[30094]: 2017-09-28 12:23:09.749 30094 ERROR nova     max_url_len=max_url_len)
Sep 28 12:23:09 ctl02 nova-api[30094]: 2017-09-28 12:23:09.749 30094 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:23:09 ctl02 nova-api[30094]: 2017-09-28 12:23:09.749 30094 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:23:09 ctl02 nova-api[30094]: 2017-09-28 12:23:09.749 30094 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:23:09 ctl02 nova-api[30094]: 2017-09-28 12:23:09.749 30094 ERROR nova     sock.listen(backlog)
Sep 28 12:23:09 ctl02 nova-api[30094]: 2017-09-28 12:23:09.749 30094 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:23:09 ctl02 nova-api[30094]: 2017-09-28 12:23:09.749 30094 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:23:09 ctl02 nova-api[30094]: 2017-09-28 12:23:09.749 30094 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:23:09 ctl02 nova-api[30094]: 2017-09-28 12:23:09.749 30094 ERROR nova
Sep 28 12:23:09 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:23:09 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:23:09 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:23:10 ctl02 heat-api[13008]: 2017-09-28 12:23:10.009 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:23:10] "OPTIONS / HTTP/1.0" 200 134 0.000638
Sep 28 12:23:10 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:23:10 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:23:10 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:23:10 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:23:10 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xea9d5508)
Sep 28 12:23:10 ctl02 heat-api-cfn[13300]: 2017-09-28 12:23:10.460 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:23:10] "OPTIONS / HTTP/1.0" 200 134 0.000448
Sep 28 12:23:11 ctl02 nova-consoleauth[5433]: 2017-09-28 12:23:11.144 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:23:11 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xea9d5508)
Sep 28 12:23:11 ctl02 nova-api[30198]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:23:11 ctl02 nova-api[30198]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:23:11 ctl02 glance-api[29183]: 2017-09-28 12:23:11.836 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:23:11] "OPTIONS / HTTP/1.0" 200 134 0.000730
Sep 28 12:23:12 ctl02 nova-api[30198]: 2017-09-28 12:23:12.007 30198 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:23:12 ctl02 nova-api[30198]: 2017-09-28 12:23:12.009 30198 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:23:12 ctl02 nova-api[30198]: 2017-09-28 12:23:12.009 30198 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:23:12 ctl02 nova-api[30198]: 2017-09-28 12:23:12.009 30198 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:23:12 ctl02 nova-api[30198]: 2017-09-28 12:23:12.009 30198 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:23:12 ctl02 nova-api[30198]: 2017-09-28 12:23:12.009 30198 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:23:12 ctl02 nova-api[30198]: 2017-09-28 12:23:12.009 30198 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:23:12 ctl02 nova-api[30198]: 2017-09-28 12:23:12.009 30198 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:23:12 ctl02 nova-api[30198]: 2017-09-28 12:23:12.009 30198 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:23:12 ctl02 nova-api[30198]: 2017-09-28 12:23:12.009 30198 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:23:12 ctl02 nova-api[30198]: 2017-09-28 12:23:12.009 30198 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:23:12 ctl02 nova-api[30198]: 2017-09-28 12:23:12.009 30198 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:23:12 ctl02 nova-api[30198]: 2017-09-28 12:23:12.009 30198 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:23:12 ctl02 nova-api[30198]: 2017-09-28 12:23:12.009 30198 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:23:12 ctl02 nova-api[30198]: 2017-09-28 12:23:12.009 30198 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:23:12 ctl02 nova-api[30198]: 2017-09-28 12:23:12.009 30198 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:23:12 ctl02 nova-api[30198]: 2017-09-28 12:23:12.009 30198 ERROR nova.wsgi     self.filename))
Sep 28 12:23:12 ctl02 nova-api[30198]: 2017-09-28 12:23:12.009 30198 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:23:12 ctl02 nova-api[30198]: 2017-09-28 12:23:12.009 30198 ERROR nova.wsgi
Sep 28 12:23:12 ctl02 nova-api[30198]: 2017-09-28 12:23:12.010 30198 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:23:12 ctl02 systemd[1]: Reloading.
Sep 28 12:23:12 ctl02 nova-api[30198]: 2017-09-28 12:23:12.151 30198 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:23:12 ctl02 systemd[1]: Reloading.
Sep 28 12:23:12 ctl02 glance-api[29183]: 2017-09-28 12:23:12.220 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:23:12] "OPTIONS / HTTP/1.0" 200 134 0.000610
Sep 28 12:23:12 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xea9d5508)
Sep 28 12:23:12 ctl02 nova-api[30198]: 2017-09-28 12:23:12.380 30198 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:23:12 ctl02 nova-api[30198]: 2017-09-28 12:23:12.382 30198 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:23:12 ctl02 nova-api[30198]: 2017-09-28 12:23:12.382 30198 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:23:12 ctl02 nova-api[30198]: 2017-09-28 12:23:12.383 30198 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:23:12 ctl02 systemd[1]: Reloading.
Sep 28 12:23:12 ctl02 nova-api[30198]: 2017-09-28 12:23:12.515 30198 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:23:12 ctl02 nova-api[30198]: 2017-09-28 12:23:12.516 30198 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:23:12 ctl02 nova-api[30198]: 2017-09-28 12:23:12.517 30198 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:23:12 ctl02 nova-api[30198]: 2017-09-28 12:23:12.517 30198 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:23:12 ctl02 nova-api[30198]: 2017-09-28 12:23:12.520 30198 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:23:12 ctl02 nova-api[30198]: 2017-09-28 12:23:12.521 30198 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:23:12 ctl02 nova-api[30198]: 2017-09-28 12:23:12.521 30198 ERROR nova Traceback (most recent call last):
Sep 28 12:23:12 ctl02 nova-api[30198]: 2017-09-28 12:23:12.521 30198 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:23:12 ctl02 nova-api[30198]: 2017-09-28 12:23:12.521 30198 ERROR nova     sys.exit(main())
Sep 28 12:23:12 ctl02 nova-api[30198]: 2017-09-28 12:23:12.521 30198 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:23:12 ctl02 nova-api[30198]: 2017-09-28 12:23:12.521 30198 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:23:12 ctl02 nova-api[30198]: 2017-09-28 12:23:12.521 30198 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:23:12 ctl02 nova-api[30198]: 2017-09-28 12:23:12.521 30198 ERROR nova     max_url_len=max_url_len)
Sep 28 12:23:12 ctl02 nova-api[30198]: 2017-09-28 12:23:12.521 30198 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:23:12 ctl02 nova-api[30198]: 2017-09-28 12:23:12.521 30198 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:23:12 ctl02 nova-api[30198]: 2017-09-28 12:23:12.521 30198 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:23:12 ctl02 nova-api[30198]: 2017-09-28 12:23:12.521 30198 ERROR nova     sock.listen(backlog)
Sep 28 12:23:12 ctl02 nova-api[30198]: 2017-09-28 12:23:12.521 30198 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:23:12 ctl02 nova-api[30198]: 2017-09-28 12:23:12.521 30198 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:23:12 ctl02 nova-api[30198]: 2017-09-28 12:23:12.521 30198 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:23:12 ctl02 nova-api[30198]: 2017-09-28 12:23:12.521 30198 ERROR nova
Sep 28 12:23:12 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:23:12 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:23:12 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:23:12 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:23:12 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:23:12 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:23:12 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:23:12 ctl02 salt-minion[14967]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 12:23:12 ctl02 salt-minion[14967]: [INFO    ] Made the following changes:
Sep 28 12:23:12 ctl02 salt-minion[14967]: 'python-waitress' changed from 'absent' to '0.8.10-1'
Sep 28 12:23:12 ctl02 salt-minion[14967]: 'ipset' changed from 'absent' to '6.29-1'
Sep 28 12:23:12 ctl02 salt-minion[14967]: 'neutron-server' changed from 'absent' to '2:8.4.0-0ubuntu5'
Sep 28 12:23:12 ctl02 salt-minion[14967]: 'python-neutron-fwaas' changed from 'absent' to '1:8.2.0-0ubuntu1'
Sep 28 12:23:12 ctl02 salt-minion[14967]: 'python-singledispatch' changed from 'absent' to '3.4.0.3-2'
Sep 28 12:23:12 ctl02 salt-minion[14967]: 'neutron-plugin-ml2' changed from 'absent' to '2:8.4.0-0ubuntu5'
Sep 28 12:23:12 ctl02 salt-minion[14967]: 'libipset3' changed from 'absent' to '6.29-1'
Sep 28 12:23:12 ctl02 salt-minion[14967]: 'python-neutron' changed from 'absent' to '2:8.4.0-0ubuntu5'
Sep 28 12:23:12 ctl02 salt-minion[14967]: 'python-pecan' changed from 'absent' to '1.0.2-2ubuntu1'
Sep 28 12:23:12 ctl02 salt-minion[14967]: 'python-logutils' changed from 'absent' to '0.3.3-5'
Sep 28 12:23:12 ctl02 salt-minion[14967]: 'ipset-6.29' changed from 'absent' to '1'
Sep 28 12:23:12 ctl02 salt-minion[14967]: 'python-openvswitch' changed from 'absent' to '2.5.2-0ubuntu0.16.04.1'
Sep 28 12:23:12 ctl02 salt-minion[14967]: 'python-webtest' changed from 'absent' to '2.0.18-1ubuntu1'
Sep 28 12:23:12 ctl02 salt-minion[14967]: 'neutron-plugin' changed from 'absent' to '1'
Sep 28 12:23:12 ctl02 salt-minion[14967]: 'python2.7-neutron' changed from 'absent' to '1'
Sep 28 12:23:12 ctl02 salt-minion[14967]: 'neutron-common' changed from 'absent' to '2:8.4.0-0ubuntu5'
Sep 28 12:23:12 ctl02 salt-minion[14967]: 'python2.7-waitress' changed from 'absent' to '1'
Sep 28 12:23:12 ctl02 salt-minion[14967]: 'python-neutron-lib' changed from 'absent' to '0.0.2-2'
Sep 28 12:23:13 ctl02 salt-minion[14967]: [INFO    ] Loading fresh modules for state activity
Sep 28 12:23:13 ctl02 salt-minion[14967]: [INFO    ] Completed state [neutron-server] at time 12:23:13.028832 duration_in_ms=16092.003
Sep 28 12:23:13 ctl02 salt-minion[14967]: [INFO    ] Running state [python-neutron-lbaas] at time 12:23:13.033735
Sep 28 12:23:13 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for python-neutron-lbaas
Sep 28 12:23:13 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemd-run', '--scope', 'apt-get', '-q', '-y', '-o', 'DPkg::Options::=--force-confold', '-o', 'DPkg::Options::=--force-confdef', 'install', 'python-neutron-lbaas'] in directory '/root'
Sep 28 12:23:13 ctl02 systemd[1]: Started /usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold -o DPkg::Options::=--force-confdef install python-neutron-lbaas.
Sep 28 12:23:13 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xea9d5508)
Sep 28 12:23:13 ctl02 heat-engine[12803]: 2017-09-28 12:23:13.737 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:23:13 ctl02 heat-engine[12803]: 2017-09-28 12:23:13.737 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:23:13 ctl02 heat-engine[12803]: 2017-09-28 12:23:13.741 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:23:13 ctl02 heat-engine[12803]: 2017-09-28 12:23:13.749 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:23:13 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:23:13.834 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:23:13] "OPTIONS / HTTP/1.0" 200 134 0.000553
Sep 28 12:23:14 ctl02 nova-scheduler[5620]: 2017-09-28 12:23:14.165 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:23:14 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xea9d5508)
Sep 28 12:23:14 ctl02 glance-api[29183]: 2017-09-28 12:23:14.421 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:23:14] "OPTIONS / HTTP/1.0" 200 134 0.000697
Sep 28 12:23:14 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command saltutil.find_job with jid 20170928122314515288
Sep 28 12:23:14 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 30400
Sep 28 12:23:14 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928122314515288
Sep 28 12:23:14 ctl02 nova-api[30333]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:23:14 ctl02 nova-api[30333]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:23:14 ctl02 nova-api[30333]: 2017-09-28 12:23:14.797 30333 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:23:14 ctl02 nova-api[30333]: 2017-09-28 12:23:14.799 30333 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:23:14 ctl02 nova-api[30333]: 2017-09-28 12:23:14.799 30333 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:23:14 ctl02 nova-api[30333]: 2017-09-28 12:23:14.799 30333 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:23:14 ctl02 nova-api[30333]: 2017-09-28 12:23:14.799 30333 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:23:14 ctl02 nova-api[30333]: 2017-09-28 12:23:14.799 30333 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:23:14 ctl02 nova-api[30333]: 2017-09-28 12:23:14.799 30333 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:23:14 ctl02 nova-api[30333]: 2017-09-28 12:23:14.799 30333 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:23:14 ctl02 nova-api[30333]: 2017-09-28 12:23:14.799 30333 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:23:14 ctl02 nova-api[30333]: 2017-09-28 12:23:14.799 30333 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:23:14 ctl02 nova-api[30333]: 2017-09-28 12:23:14.799 30333 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:23:14 ctl02 nova-api[30333]: 2017-09-28 12:23:14.799 30333 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:23:14 ctl02 nova-api[30333]: 2017-09-28 12:23:14.799 30333 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:23:14 ctl02 nova-api[30333]: 2017-09-28 12:23:14.799 30333 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:23:14 ctl02 nova-api[30333]: 2017-09-28 12:23:14.799 30333 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:23:14 ctl02 nova-api[30333]: 2017-09-28 12:23:14.799 30333 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:23:14 ctl02 nova-api[30333]: 2017-09-28 12:23:14.799 30333 ERROR nova.wsgi     self.filename))
Sep 28 12:23:14 ctl02 nova-api[30333]: 2017-09-28 12:23:14.799 30333 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:23:14 ctl02 nova-api[30333]: 2017-09-28 12:23:14.799 30333 ERROR nova.wsgi
Sep 28 12:23:14 ctl02 nova-api[30333]: 2017-09-28 12:23:14.801 30333 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:23:14 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:23:14.897 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:23:14] "OPTIONS / HTTP/1.0" 200 134 0.000566
Sep 28 12:23:14 ctl02 nova-api[30333]: 2017-09-28 12:23:14.939 30333 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:23:15 ctl02 heat-api[13008]: 2017-09-28 12:23:15.046 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:23:15] "OPTIONS / HTTP/1.0" 200 134 0.000608
Sep 28 12:23:15 ctl02 nova-api[30333]: 2017-09-28 12:23:15.175 30333 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:23:15 ctl02 nova-api[30333]: 2017-09-28 12:23:15.178 30333 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:23:15 ctl02 nova-api[30333]: 2017-09-28 12:23:15.178 30333 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:23:15 ctl02 nova-api[30333]: 2017-09-28 12:23:15.178 30333 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:23:15 ctl02 nova-api[30333]: 2017-09-28 12:23:15.312 30333 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:23:15 ctl02 nova-api[30333]: 2017-09-28 12:23:15.314 30333 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:23:15 ctl02 nova-api[30333]: 2017-09-28 12:23:15.314 30333 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:23:15 ctl02 nova-api[30333]: 2017-09-28 12:23:15.314 30333 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:23:15 ctl02 nova-api[30333]: 2017-09-28 12:23:15.317 30333 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:23:15 ctl02 nova-api[30333]: 2017-09-28 12:23:15.318 30333 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:23:15 ctl02 nova-api[30333]: 2017-09-28 12:23:15.318 30333 ERROR nova Traceback (most recent call last):
Sep 28 12:23:15 ctl02 nova-api[30333]: 2017-09-28 12:23:15.318 30333 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:23:15 ctl02 nova-api[30333]: 2017-09-28 12:23:15.318 30333 ERROR nova     sys.exit(main())
Sep 28 12:23:15 ctl02 nova-api[30333]: 2017-09-28 12:23:15.318 30333 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:23:15 ctl02 nova-api[30333]: 2017-09-28 12:23:15.318 30333 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:23:15 ctl02 nova-api[30333]: 2017-09-28 12:23:15.318 30333 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:23:15 ctl02 nova-api[30333]: 2017-09-28 12:23:15.318 30333 ERROR nova     max_url_len=max_url_len)
Sep 28 12:23:15 ctl02 nova-api[30333]: 2017-09-28 12:23:15.318 30333 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:23:15 ctl02 nova-api[30333]: 2017-09-28 12:23:15.318 30333 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:23:15 ctl02 nova-api[30333]: 2017-09-28 12:23:15.318 30333 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:23:15 ctl02 nova-api[30333]: 2017-09-28 12:23:15.318 30333 ERROR nova     sock.listen(backlog)
Sep 28 12:23:15 ctl02 nova-api[30333]: 2017-09-28 12:23:15.318 30333 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:23:15 ctl02 nova-api[30333]: 2017-09-28 12:23:15.318 30333 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:23:15 ctl02 nova-api[30333]: 2017-09-28 12:23:15.318 30333 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:23:15 ctl02 nova-api[30333]: 2017-09-28 12:23:15.318 30333 ERROR nova
Sep 28 12:23:15 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xea9d5508)
Sep 28 12:23:15 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:23:15 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:23:15 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:23:15 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:23:15 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:23:15 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:23:15 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:23:16 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xea9d5508)
Sep 28 12:23:16 ctl02 heat-api[13008]: 2017-09-28 12:23:16.844 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:23:16] "OPTIONS / HTTP/1.0" 200 134 0.000535
Sep 28 12:23:16 ctl02 salt-minion[14967]: [INFO    ] Executing command ['dpkg-query', '--showformat', '${Status} ${Package} ${Version} ${Architecture}\n', '-W'] in directory '/root'
Sep 28 12:23:16 ctl02 salt-minion[14967]: [INFO    ] Made the following changes:
Sep 28 12:23:16 ctl02 salt-minion[14967]: 'python-pyasn1-modules' changed from 'absent' to '0.0.7-0.1'
Sep 28 12:23:16 ctl02 salt-minion[14967]: 'python-neutron-lbaas' changed from 'absent' to '2:8.3.0-0ubuntu3'
Sep 28 12:23:16 ctl02 salt-minion[14967]: [INFO    ] Loading fresh modules for state activity
Sep 28 12:23:16 ctl02 salt-minion[14967]: [INFO    ] Completed state [python-neutron-lbaas] at time 12:23:16.994983 duration_in_ms=3961.248
Sep 28 12:23:16 ctl02 salt-minion[14967]: [INFO    ] Running state [python-pycadf] at time 12:23:16.999697
Sep 28 12:23:16 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for python-pycadf
Sep 28 12:23:17 ctl02 salt-minion[14967]: [INFO    ] Package python-pycadf is already installed
Sep 28 12:23:17 ctl02 salt-minion[14967]: [INFO    ] Completed state [python-pycadf] at time 12:23:17.282242 duration_in_ms=282.545
Sep 28 12:23:17 ctl02 salt-minion[14967]: [INFO    ] Running state [gettext-base] at time 12:23:17.282499
Sep 28 12:23:17 ctl02 salt-minion[14967]: [INFO    ] Executing state pkg.installed for gettext-base
Sep 28 12:23:17 ctl02 salt-minion[14967]: [INFO    ] Package gettext-base is already installed
Sep 28 12:23:17 ctl02 salt-minion[14967]: [INFO    ] Completed state [gettext-base] at time 12:23:17.285570 duration_in_ms=3.071
Sep 28 12:23:17 ctl02 salt-minion[14967]: [INFO    ] Running state [/usr/sbin/policy-rc.d] at time 12:23:17.286433
Sep 28 12:23:17 ctl02 salt-minion[14967]: [INFO    ] Executing state file.absent for /usr/sbin/policy-rc.d
Sep 28 12:23:17 ctl02 salt-minion[14967]: [INFO    ] {'removed': '/usr/sbin/policy-rc.d'}
Sep 28 12:23:17 ctl02 salt-minion[14967]: [INFO    ] Completed state [/usr/sbin/policy-rc.d] at time 12:23:17.287053 duration_in_ms=0.62
Sep 28 12:23:17 ctl02 salt-minion[14967]: [INFO    ] Running state [/etc/neutron/plugins/ml2/ml2_conf.ini] at time 12:23:17.287354
Sep 28 12:23:17 ctl02 salt-minion[14967]: [INFO    ] Executing state file.managed for /etc/neutron/plugins/ml2/ml2_conf.ini
Sep 28 12:23:17 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'neutron/files/ocata/ml2_conf.ini'
Sep 28 12:23:17 ctl02 nova-api[30424]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:23:17 ctl02 nova-api[30424]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:23:17 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'neutron/map.jinja'
Sep 28 12:23:17 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xea9d5508)
Sep 28 12:23:17 ctl02 salt-minion[14967]: [INFO    ] File changed:
Sep 28 12:23:17 ctl02 salt-minion[14967]: ---
Sep 28 12:23:17 ctl02 salt-minion[14967]: +++
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -1,3 +1,4 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]:  [DEFAULT]
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -6,10 +7,11 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # If set to true, the logging level will be set to DEBUG instead of the default
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # INFO level. (boolean value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Note: This option can be changed without restarting.
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #debug = false
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# If set to false, the logging level will be set to WARNING instead of the
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# default INFO level. (boolean value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# DEPRECATED: If set to false, the logging level will be set to WARNING instead
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# of the default INFO level. (boolean value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # This option is deprecated for removal.
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Its value may be silently ignored in the future.
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #verbose = true
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -20,6 +22,7 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # configuration files are used then all logging configuration is set in the
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # configuration file and other logging configuration options are ignored (for
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # example, logging_context_format_string). (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Note: This option can be changed without restarting.
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/log_config
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #log_config_append = <None>
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -57,7 +60,7 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Log output to standard error. This option is ignored if log_config_append is
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # set. (boolean value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: -#use_stderr = true
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#use_stderr = false
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Format string to use for log messages with context. (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #logging_context_format_string = %(asctime)s.%(msecs)03d %(process)d %(levelname)s %(name)s [%(request_id)s %(user_identity)s] %(instance)s%(message)s
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -92,6 +95,18 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #instance_uuid_format = "[instance: %(uuid)s] "
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Interval, number of seconds, of log rate limiting. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#rate_limit_interval = 0
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Maximum number of logged messages per rate_limit_interval. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#rate_limit_burst = 0
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Log level name used by rate limiting: CRITICAL, ERROR, INFO, WARNING, DEBUG
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# or empty string. Logs with level greater or equal to rate_limit_except_level
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# are not filtered. An empty string means that all levels are filtered. (string
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#rate_limit_except_level = CRITICAL
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Enables or disables fatal status of deprecations. (boolean value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #fatal_deprecations = false
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -105,32 +120,38 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # List of network type driver entrypoints to be loaded from the
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # neutron.ml2.type_drivers namespace. (list value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #type_drivers = local,flat,vlan,gre,vxlan,geneve
Sep 28 12:23:17 ctl02 salt-minion[14967]: +type_drivers = local,flat,vlan,gre,vxlan
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Ordered list of network_types to allocate as tenant networks. The default
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # value 'local' is useful for single-box testing but provides no connectivity
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # between hosts. (list value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #tenant_network_types = local
Sep 28 12:23:17 ctl02 salt-minion[14967]: +tenant_network_types = flat,vxlan
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # An ordered list of networking mechanism driver entrypoints to be loaded from
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # the neutron.ml2.mechanism_drivers namespace. (list value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #mechanism_drivers =
Sep 28 12:23:17 ctl02 salt-minion[14967]: +mechanism_drivers =openvswitch,l2population
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # An ordered list of extension driver entrypoints to be loaded from the
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # neutron.ml2.extension_drivers namespace. For example: extension_drivers =
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # port_security,qos (list value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #extension_drivers =
Sep 28 12:23:17 ctl02 salt-minion[14967]: +extension_drivers=port_security
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Maximum size of an IP packet (MTU) that can traverse the underlying physical
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# network infrastructure without fragmentation for overlay/tunnel networks. In
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# most cases, use the same value as the global_physnet_mtu option. (integer
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: -#path_mtu = 1500
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# network infrastructure without fragmentation when using an overlay/tunnel
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# protocol. This option allows specifying a physical network MTU value that
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# differs from the default global_physnet_mtu value. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#path_mtu = 0
Sep 28 12:23:17 ctl02 salt-minion[14967]: +path_mtu = 1500
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # A list of mappings of physical networks to MTU values. The format of the
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # mapping is <physnet>:<mtu val>. This mapping allows specifying a physical
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # network MTU value that differs from the default global_physnet_mtu value.
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # (list value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #physical_network_mtus =
Sep 28 12:23:17 ctl02 salt-minion[14967]: +physical_network_mtus =physnet1:1500
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Default network type for external networks when no provider attributes are
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # specified. By default it is None, which means that if provider attributes are
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -140,6 +161,10 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # option. (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #external_network_type = <None>
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# IP version of all overlay (tunnel) network endpoints. Use a value of 4 for
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# IPv4 or 6 for IPv6. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#overlay_ip_version = 4
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  [ml2_type_flat]
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -151,6 +176,7 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # default '*' to allow flat networks with arbitrary physical_network names. Use
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # an empty list to disable flat networks. (list value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #flat_networks = *
Sep 28 12:23:17 ctl02 salt-minion[14967]: +flat_networks = *
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  [ml2_type_geneve]
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -168,7 +194,7 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # + IP + UDP + GENEVE header sizes. The default size for this field is 50,
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # which is the size of the Geneve header without any additional option headers.
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: -#max_header_size = 50
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#max_header_size = 30
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  [ml2_type_gre]
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -180,6 +206,7 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Comma-separated list of <tun_min>:<tun_max> tuples enumerating ranges of GRE
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # tunnel IDs that are available for tenant network allocation (list value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #tunnel_id_ranges =
Sep 28 12:23:17 ctl02 salt-minion[14967]: +tunnel_id_ranges =2:65535
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  [ml2_type_vlan]
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -193,6 +220,7 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # networks, as well as ranges of VLAN tags on each available for allocation to
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # tenant networks. (list value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #network_vlan_ranges =
Sep 28 12:23:17 ctl02 salt-minion[14967]: +network_vlan_ranges = physnet1
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  [ml2_type_vxlan]
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -204,11 +232,13 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Comma-separated list of <vni_min>:<vni_max> tuples enumerating ranges of
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # VXLAN VNI IDs that are available for tenant network allocation (list value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #vni_ranges =
Sep 28 12:23:17 ctl02 salt-minion[14967]: +vni_ranges = 2:65535
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Multicast group for VXLAN. When configured, will enable sending all broadcast
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # traffic to this multicast group. When left unconfigured, will disable
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # multicast VXLAN mode. (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #vxlan_group = <None>
Sep 28 12:23:17 ctl02 salt-minion[14967]: +vxlan_group = 224.0.0.1
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  [securitygroup]
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -224,6 +254,8 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # should be false when using no security groups or using the nova security
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # group API. (boolean value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #enable_security_group = true
Sep 28 12:23:17 ctl02 salt-minion[14967]: +firewall_driver = neutron.agent.linux.iptables_firewall.OVSHybridIptablesFirewallDriver
Sep 28 12:23:17 ctl02 salt-minion[14967]: +enable_security_group = True
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Use ipset to speed-up the iptables based security groups. Enabling ipset
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # support requires that ipset is installed on L2 agent node. (boolean value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: [INFO    ] Completed state [/etc/neutron/plugins/ml2/ml2_conf.ini] at time 12:23:17.362248 duration_in_ms=74.892
Sep 28 12:23:17 ctl02 salt-minion[14967]: [INFO    ] Running state [ln -s /etc/neutron/plugins/ml2/ml2_conf.ini /etc/neutron/plugin.ini] at time 12:23:17.363321
Sep 28 12:23:17 ctl02 salt-minion[14967]: [INFO    ] Executing state cmd.run for ln -s /etc/neutron/plugins/ml2/ml2_conf.ini /etc/neutron/plugin.ini
Sep 28 12:23:17 ctl02 salt-minion[14967]: [INFO    ] Executing command 'test -e /etc/neutron/plugin.ini' in directory '/root'
Sep 28 12:23:17 ctl02 salt-minion[14967]: [INFO    ] Executing command 'ln -s /etc/neutron/plugins/ml2/ml2_conf.ini /etc/neutron/plugin.ini' in directory '/root'
Sep 28 12:23:17 ctl02 salt-minion[14967]: [INFO    ] {'pid': 30494, 'retcode': 0, 'stderr': '', 'stdout': ''}
Sep 28 12:23:17 ctl02 salt-minion[14967]: [INFO    ] Completed state [ln -s /etc/neutron/plugins/ml2/ml2_conf.ini /etc/neutron/plugin.ini] at time 12:23:17.385361 duration_in_ms=22.038
Sep 28 12:23:17 ctl02 salt-minion[14967]: [INFO    ] Running state [/etc/neutron/neutron.conf] at time 12:23:17.386277
Sep 28 12:23:17 ctl02 salt-minion[14967]: [INFO    ] Executing state file.managed for /etc/neutron/neutron.conf
Sep 28 12:23:17 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'neutron/files/ocata/neutron-server.conf.Debian'
Sep 28 12:23:17 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'neutron/map.jinja'
Sep 28 12:23:17 ctl02 salt-minion[14967]: [INFO    ] File changed:
Sep 28 12:23:17 ctl02 salt-minion[14967]: ---
Sep 28 12:23:17 ctl02 salt-minion[14967]: +++
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -1,3 +1,4 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]:  [DEFAULT]
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -7,14 +8,17 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Where to store Neutron state files. This directory must be writable by the
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # agent. (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #state_path = /var/lib/neutron
Sep 28 12:23:17 ctl02 salt-minion[14967]: +state_path = /var/lib/neutron
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # The host IP to bind to (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #bind_host = 0.0.0.0
Sep 28 12:23:17 ctl02 salt-minion[14967]: +bind_host = 10.167.4.12
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # The port to bind to (port value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Minimum value: 0
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Maximum value: 65535
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #bind_port = 9696
Sep 28 12:23:17 ctl02 salt-minion[14967]: +bind_port = 9696
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # The path for API extensions. Note that this can be a colon-separated list of
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # paths. For example: api_extensions_path =
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -22,36 +26,36 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # neutron.extensions is appended to this, so if your extensions are in there
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # you don't need to specify them here. (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #api_extensions_path =
Sep 28 12:23:17 ctl02 salt-minion[14967]: +agent_down_time = 30
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # The type of authentication to use (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #auth_strategy = keystone
Sep 28 12:23:17 ctl02 salt-minion[14967]: -
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# The core plugin Neutron will use (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: -core_plugin = ml2
Sep 28 12:23:17 ctl02 salt-minion[14967]: +auth_strategy = keystone
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: message repeated 2 times: [ +]
Sep 28 12:23:17 ctl02 salt-minion[14967]: +core_plugin = neutron.plugins.ml2.plugin.Ml2Plugin
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +service_plugins = router,metering
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # The service plugins Neutron will use (list value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #service_plugins =
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +allow_pagination = False
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # The base MAC address Neutron will use for VIFs. The first 3 octets will
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # remain unchanged. If the 4th octet is not 00, it will also be used. The
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # others will be randomly generated. (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #base_mac = fa:16:3e:00:00:00
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# How many times Neutron will retry MAC generation (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: -#mac_generation_retries = 16
Sep 28 12:23:17 ctl02 salt-minion[14967]: -
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Allow the usage of the bulk API (boolean value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #allow_bulk = true
Sep 28 12:23:17 ctl02 salt-minion[14967]: -
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Allow the usage of the pagination (boolean value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: -#allow_pagination = false
Sep 28 12:23:17 ctl02 salt-minion[14967]: -
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Allow the usage of the sorting (boolean value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: -#allow_sorting = false
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # The maximum number of items returned in a single response, value was
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # 'infinite' or negative integer means no limit (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #pagination_max_limit = -1
Sep 28 12:23:17 ctl02 salt-minion[14967]: +pagination_max_limit = -1
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Default value of availability zone hints. The availability zone aware
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # schedulers use this when the resources availability_zone_hints is empty.
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -67,31 +71,11 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Maximum number of host routes per subnet (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #max_subnet_host_routes = 20
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Maximum number of fixed ips per port. This option is deprecated and will be
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# removed in the N release. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# DEPRECATED: Maximum number of fixed ips per port. This option is deprecated
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# and will be removed in the Ocata release. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # This option is deprecated for removal.
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Its value may be silently ignored in the future.
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #max_fixed_ips_per_port = 5
Sep 28 12:23:17 ctl02 salt-minion[14967]: -
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Default IPv4 subnet pool to be used for automatic subnet CIDR allocation.
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Specifies by UUID the pool to be used in case where creation of a subnet is
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# being called without a subnet pool ID. If not set then no pool will be used
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# unless passed explicitly to the subnet create. If no pool is used, then a
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# CIDR must be passed to create a subnet and that subnet will not be allocated
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# from any pool; it will be considered part of the tenant's private address
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# space. This option is deprecated for removal in the N release. (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# This option is deprecated for removal.
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Its value may be silently ignored in the future.
Sep 28 12:23:17 ctl02 salt-minion[14967]: -#default_ipv4_subnet_pool = <None>
Sep 28 12:23:17 ctl02 salt-minion[14967]: -
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Default IPv6 subnet pool to be used for automatic subnet CIDR allocation.
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Specifies by UUID the pool to be used in case where creation of a subnet is
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# being called without a subnet pool ID. See the description for
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# default_ipv4_subnet_pool for more information. This option is deprecated for
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# removal in the N release. (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# This option is deprecated for removal.
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Its value may be silently ignored in the future.
Sep 28 12:23:17 ctl02 salt-minion[14967]: -#default_ipv6_subnet_pool = <None>
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Enables IPv6 Prefix Delegation for automatic subnet CIDR allocation. Set to
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # True to enable IPv6 Prefix Delegation for subnet allocation in a PD-capable
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -103,11 +87,12 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # DHCP lease duration (in seconds). Use -1 to tell dnsmasq to use infinite
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # lease times. (integer value)
Sep 28 12:23:17 ctl02 nova-api[30424]: 2017-09-28 12:23:17.514 30424 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:23:17 ctl02 nova-api[30424]: 2017-09-28 12:23:17.516 30424 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:23:17 ctl02 nova-api[30424]: 2017-09-28 12:23:17.516 30424 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:23:17 ctl02 nova-api[30424]: 2017-09-28 12:23:17.516 30424 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:23:17 ctl02 nova-api[30424]: 2017-09-28 12:23:17.516 30424 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:23:17 ctl02 nova-api[30424]: 2017-09-28 12:23:17.516 30424 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:23:17 ctl02 nova-api[30424]: 2017-09-28 12:23:17.516 30424 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:23:17 ctl02 nova-api[30424]: 2017-09-28 12:23:17.516 30424 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:23:17 ctl02 nova-api[30424]: 2017-09-28 12:23:17.516 30424 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:23:17 ctl02 nova-api[30424]: 2017-09-28 12:23:17.516 30424 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:23:17 ctl02 nova-api[30424]: 2017-09-28 12:23:17.516 30424 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:23:17 ctl02 nova-api[30424]: 2017-09-28 12:23:17.516 30424 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:23:17 ctl02 nova-api[30424]: 2017-09-28 12:23:17.516 30424 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:23:17 ctl02 nova-api[30424]: 2017-09-28 12:23:17.516 30424 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:23:17 ctl02 nova-api[30424]: 2017-09-28 12:23:17.516 30424 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:23:17 ctl02 nova-api[30424]: 2017-09-28 12:23:17.516 30424 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:23:17 ctl02 nova-api[30424]: 2017-09-28 12:23:17.516 30424 ERROR nova.wsgi     self.filename))
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Deprecated group/name - [DEFAULT]/dhcp_lease_time
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #dhcp_lease_duration = 86400
Sep 28 12:23:17 ctl02 salt-minion[14967]: +dhcp_lease_duration = 600
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Domain to use for building the hostnames (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #dns_domain = openstacklocal
Sep 28 12:23:17 ctl02 salt-minion[14967]: +dns_domain = novalocal
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Driver for external DNS integration. (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #external_dns_driver = <None>
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -119,46 +104,36 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # MUST be set to False if Neutron is being used in conjunction with Nova
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # security groups. (boolean value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #allow_overlapping_ips = false
Sep 28 12:23:17 ctl02 salt-minion[14967]: +allow_overlapping_ips = True
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Hostname to be used by the Neutron server, agents and services running on
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # this machine. All the agents and services running on this machine must use
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # the same host value. (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #host = example.domain
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Ensure that configured gateway is on subnet. For IPv6, validate only if
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# gateway is not a link local address. Deprecated, to be removed during the
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Newton release, at which point the gateway will not be forced on to subnet.
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# (boolean value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# This option is deprecated for removal.
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Its value may be silently ignored in the future.
Sep 28 12:23:17 ctl02 salt-minion[14967]: -#force_gateway_on_subnet = true
Sep 28 12:23:17 ctl02 salt-minion[14967]: -
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Send notification to nova when port status changes (boolean value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #notify_nova_on_port_status_changes = true
Sep 28 12:23:17 ctl02 salt-minion[14967]: +notify_nova_on_port_status_changes = true
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Send notification to nova when port data (fixed_ips/floatingip) changes so
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # nova can update its cache. (boolean value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #notify_nova_on_port_data_changes = true
Sep 28 12:23:17 ctl02 salt-minion[14967]: +notify_nova_on_port_data_changes = true
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Number of seconds between sending events to nova if there are any events to
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # send. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #send_events_interval = 2
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# If True, advertise network MTU values if core plugin calculates them. MTU is
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# advertised to running instances via DHCP and RA MTU options. (boolean value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: -#advertise_mtu = true
Sep 28 12:23:17 ctl02 salt-minion[14967]: -
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Neutron IPAM (IP address management) driver to use. If ipam_driver is not set
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# (default behavior), no IPAM driver is used. In order to use the reference
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# implementation of Neutron IPAM driver, use 'internal'. (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: -#ipam_driver = <None>
Sep 28 12:23:17 ctl02 nova-api[30424]: 2017-09-28 12:23:17.516 30424 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:23:17 ctl02 nova-api[30424]: 2017-09-28 12:23:17.516 30424 ERROR nova.wsgi
Sep 28 12:23:17 ctl02 nova-api[30424]: 2017-09-28 12:23:17.517 30424 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Neutron IPAM (IP address management) driver to use. By default, the reference
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# implementation of the Neutron IPAM driver is used. (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#ipam_driver = internal
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # If True, then allow plugins that support it to create VLAN transparent
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # networks. (boolean value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #vlan_transparent = false
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # This will choose the web framework in which to run the Neutron API server.
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# 'pecan' is a new experiemental rewrite of the API server. (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# 'pecan' is a new experimental rewrite of the API server. (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Allowed values: legacy, pecan
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #web_framework = legacy
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -166,11 +141,10 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # MTU for all virtual network components. For flat and VLAN networks, neutron
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # uses this value without modification. For overlay networks such as VXLAN,
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # neutron automatically subtracts the overlay protocol overhead from this
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# value. Defaults to 1500, the standard value for Ethernet. If using the ML2
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# plug-in with overlay/tunnel networks, also configure the ml2 path_mtu option
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# with the same value as the global_physnet_mtu option. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# value. Defaults to 1500, the standard value for Ethernet. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Deprecated group/name - [ml2]/segment_mtu
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #global_physnet_mtu = 1500
Sep 28 12:23:17 ctl02 salt-minion[14967]: +global_physnet_mtu = 1500
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Number of backlog requests to configure the socket with (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #backlog = 4096
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -181,7 +155,7 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Enable SSL on the API server (boolean value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #use_ssl = false
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Seconds between running periodic tasks (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Seconds between running periodic tasks. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #periodic_interval = 40
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Number of separate API worker processes for service. If not specified, the
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -189,12 +163,14 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #api_workers = <None>
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Number of RPC worker processes for service (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Number of RPC worker processes for service. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #rpc_workers = 1
Sep 28 12:23:17 ctl02 salt-minion[14967]: -
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Number of RPC worker processes dedicated to state reports queue (integer
Sep 28 12:23:17 ctl02 salt-minion[14967]: +rpc_workers = 4
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Number of RPC worker processes dedicated to state reports queue. (integer
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #rpc_state_report_workers = 1
Sep 28 12:23:17 ctl02 salt-minion[14967]: +rpc_state_report_workers = 4
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Range of seconds to randomly delay when starting the periodic task scheduler
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # to reduce stampeding. (Disable by setting to 0) (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -229,10 +205,6 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # From neutron.db
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #
Sep 28 12:23:17 ctl02 salt-minion[14967]: -
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Seconds to regard the agent is down; should be at least twice
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# report_interval, to be sure the agent is down for good. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: -#agent_down_time = 75
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Representing the resource type whose load is being reported by the agent.
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # This can be "networks", "subnets" or "ports". When specified (Default is
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -273,6 +245,7 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # a given tenant network, providing high availability for DHCP service.
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #dhcp_agents_per_network = 1
Sep 28 12:23:17 ctl02 salt-minion[14967]: +dhcp_agents_per_network = 2
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Enable services on an agent with admin_state_up False. If this option is
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # False, when admin_state_up of an agent is turned False, services on it will
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -292,9 +265,11 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # System-wide flag to determine the type of router that tenants can create.
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Only admin can override. (boolean value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #router_distributed = false
Sep 28 12:23:17 ctl02 salt-minion[14967]: +router_distributed = False
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Driver to use for scheduling router to a default L3 agent (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler
Sep 28 12:23:17 ctl02 salt-minion[14967]: +router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.ChanceScheduler
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Allow auto scheduling of routers to L3 agent. (boolean value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #router_auto_schedule = true
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -302,17 +277,16 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Automatically reschedule routers from offline L3 agents to online L3 agents.
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # (boolean value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #allow_automatic_l3agent_failover = false
Sep 28 12:23:17 ctl02 salt-minion[14967]: +allow_automatic_l3agent_failover = true
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Enable HA mode for virtual routers. (boolean value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #l3_ha = false
Sep 28 12:23:17 ctl02 salt-minion[14967]: +l3_ha = True
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Maximum number of L3 agents which a HA router will be scheduled on. If it is
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # set to 0 then the router will be scheduled on every agent. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #max_l3_agents_per_router = 3
Sep 28 12:23:17 ctl02 salt-minion[14967]: -
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Minimum number of L3 agents that have to be available in order to allow a new
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# HA router to be scheduled. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: -#min_l3_agents_per_router = 2
Sep 28 12:23:17 ctl02 salt-minion[14967]: +max_l3_agents_per_router = 0
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Subnet used for the l3 HA admin network. (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #l3_ha_net_cidr = 169.254.192.0/18
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -340,13 +314,15 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # If set to true, the logging level will be set to DEBUG instead of the default
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # INFO level. (boolean value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Note: This option can be changed without restarting.
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #debug = false
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# If set to false, the logging level will be set to WARNING instead of the
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# default INFO level. (boolean value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# DEPRECATED: If set to false, the logging level will be set to WARNING instead
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# of the default INFO level. (boolean value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # This option is deprecated for removal.
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Its value may be silently ignored in the future.
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #verbose = true
Sep 28 12:23:17 ctl02 salt-minion[14967]: +verbose = true
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # The name of a logging configuration file. This file is appended to any
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # existing logging configuration files. For details about logging configuration
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -354,6 +330,7 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # configuration files are used then all logging configuration is set in the
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # configuration file and other logging configuration options are ignored (for
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # example, logging_context_format_string). (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Note: This option can be changed without restarting.
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/log_config
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #log_config_append = <None>
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -391,7 +368,7 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Log output to standard error. This option is ignored if log_config_append is
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # set. (boolean value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: -#use_stderr = true
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#use_stderr = false
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Format string to use for log messages with context. (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #logging_context_format_string = %(asctime)s.%(msecs)03d %(process)d %(levelname)s %(name)s [%(request_id)s %(user_identity)s] %(instance)s%(message)s
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -426,6 +403,18 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #instance_uuid_format = "[instance: %(uuid)s] "
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Interval, number of seconds, of log rate limiting. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#rate_limit_interval = 0
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Maximum number of logged messages per rate_limit_interval. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#rate_limit_burst = 0
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Log level name used by rate limiting: CRITICAL, ERROR, INFO, WARNING, DEBUG
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# or empty string. Logs with level greater or equal to rate_limit_except_level
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# are not filtered. An empty string means that all levels are filtered. (string
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#rate_limit_except_level = CRITICAL
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Enables or disables fatal status of deprecations. (boolean value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #fatal_deprecations = false
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -437,77 +426,186 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rpc_conn_pool_size
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #rpc_conn_pool_size = 30
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# The pool size limit for connections expiration policy (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#conn_pool_min_size = 2
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# The time-to-live in sec of idle connections in the pool (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#conn_pool_ttl = 1200
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # ZeroMQ bind address. Should be a wildcard (*), an ethernet interface, or IP.
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # The "host" option should point or resolve to this address. (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_bind_address
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #rpc_zmq_bind_address = *
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # MatchMaker driver. (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Allowed values: redis, dummy
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Allowed values: redis, sentinel, dummy
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_matchmaker
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #rpc_zmq_matchmaker = redis
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Type of concurrency used. Either "native" or "eventlet" (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: -#rpc_zmq_concurrency = eventlet
Sep 28 12:23:17 ctl02 salt-minion[14967]: -
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Number of ZeroMQ contexts, defaults to 1. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_contexts
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #rpc_zmq_contexts = 1
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Maximum number of ingress messages to locally buffer per topic. Default is
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # unlimited. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_topic_backlog
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #rpc_zmq_topic_backlog = <None>
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Directory for holding IPC sockets. (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_ipc_dir
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #rpc_zmq_ipc_dir = /var/run/openstack
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Name of this node. Must be a valid hostname, FQDN, or IP address. Must match
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # "host" option, if running Nova. (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_host
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #rpc_zmq_host = localhost
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Seconds to wait before a cast expires (TTL). The default value of -1
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# specifies an infinite linger period. The value of 0 specifies no linger
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# period. Pending messages shall be discarded immediately when the socket is
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# closed. Only supported by impl_zmq. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: -#rpc_cast_timeout = -1
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Number of seconds to wait before all pending messages will be sent after
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# closing a socket. The default value of -1 specifies an infinite linger
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# period. The value of 0 specifies no linger period. Pending messages shall be
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# discarded immediately when the socket is closed. Positive values specify an
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# upper bound for the linger period. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_cast_timeout
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#zmq_linger = -1
Sep 28 12:23:17 ctl02 salt-minion[14967]: +zmq_linger = 30
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # The default number of seconds that poll should wait. Poll raises timeout
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # exception when timeout expired. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_poll_timeout
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #rpc_poll_timeout = 1
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Expiration timeout in seconds of a name service record about existing target
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # ( < 0 means no timeout). (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: -#zmq_target_expire = 120
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/zmq_target_expire
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#zmq_target_expire = 300
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Update period in seconds of a name service record about existing target.
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/zmq_target_update
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#zmq_target_update = 180
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Use PUB/SUB pattern for fanout methods. PUB/SUB always uses proxy. (boolean
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: -#use_pub_sub = true
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/use_pub_sub
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#use_pub_sub = false
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Use ROUTER remote proxy. (boolean value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/use_router_proxy
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#use_router_proxy = false
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# This option makes direct connections dynamic or static. It makes sense only
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# with use_router_proxy=False which means to use direct connections for direct
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# message types (ignored otherwise). (boolean value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#use_dynamic_connections = false
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# How many additional connections to a host will be made for failover reasons.
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# This option is actual only in dynamic connections mode. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#zmq_failover_connections = 2
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Minimal port number for random ports range. (port value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Minimum value: 0
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Maximum value: 65535
Sep 28 12:23:17 ctl02 salt-minion[14967]: -#rpc_zmq_min_port = 49152
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_min_port
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#rpc_zmq_min_port = 49153
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Maximal port number for random ports range. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Minimum value: 1
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Maximum value: 65536
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_max_port
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #rpc_zmq_max_port = 65536
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Number of retries to find free port number before fail with ZMQBindError.
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_bind_port_retries
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #rpc_zmq_bind_port_retries = 100
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Default serialization mechanism for serializing/deserializing
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# outgoing/incoming messages (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Allowed values: json, msgpack
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_serialization
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#rpc_zmq_serialization = json
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# This option configures round-robin mode in zmq socket. True means not keeping
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# a queue when server side disconnects. False means to keep queue and messages
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# even if server is disconnected, when the server appears we send all
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# accumulated messages to it. (boolean value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#zmq_immediate = true
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Enable/disable TCP keepalive (KA) mechanism. The default value of -1 (or any
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# other negative value) means to skip any overrides and leave it to OS default;
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# 0 and 1 (or any other positive value) mean to disable and enable the option
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# respectively. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#zmq_tcp_keepalive = -1
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# The duration between two keepalive transmissions in idle condition. The unit
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# is platform dependent, for example, seconds in Linux, milliseconds in Windows
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# etc. The default value of -1 (or any other negative value and 0) means to
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# skip any overrides and leave it to OS default. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#zmq_tcp_keepalive_idle = -1
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# The number of retransmissions to be carried out before declaring that remote
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# end is not available. The default value of -1 (or any other negative value
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# and 0) means to skip any overrides and leave it to OS default. (integer
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#zmq_tcp_keepalive_cnt = -1
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# The duration between two successive keepalive retransmissions, if
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# acknowledgement to the previous keepalive transmission is not received. The
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# unit is platform dependent, for example, seconds in Linux, milliseconds in
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Windows etc. The default value of -1 (or any other negative value and 0)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# means to skip any overrides and leave it to OS default. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#zmq_tcp_keepalive_intvl = -1
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Maximum number of (green) threads to work concurrently. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#rpc_thread_pool_size = 100
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Expiration timeout in seconds of a sent/received message after which it is
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# not tracked anymore by a client/server. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#rpc_message_ttl = 300
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Wait for message acknowledgements from receivers. This mechanism works only
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# via proxy without PUB/SUB. (boolean value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#rpc_use_acks = false
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Number of seconds to wait for an ack from a cast/call. After each retry
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# attempt this timeout is multiplied by some specified multiplier. (integer
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#rpc_ack_timeout_base = 15
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Number to multiply base ack timeout by after each retry attempt. (integer
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#rpc_ack_timeout_multiplier = 2
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Default number of message sending attempts in case of any problems occurred:
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# positive value N means at most N retries, 0 means no retries, None or -1 (or
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# any other negative values) mean to retry forever. This option is used only if
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# acknowledgments are enabled. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#rpc_retry_attempts = 3
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# List of publisher hosts SubConsumer can subscribe on. This option has higher
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# priority then the default publishers list taken from the matchmaker. (list
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#subscribe_on =
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Size of executor thread pool. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rpc_thread_pool_size
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #executor_thread_pool_size = 64
Sep 28 12:23:17 ctl02 salt-minion[14967]: +executor_thread_pool_size = 70
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Seconds to wait for a response from a call. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #rpc_response_timeout = 60
Sep 28 12:23:17 ctl02 salt-minion[14967]: -
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# A URL representing the messaging driver to use and its full configuration. If
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# not set, we fall back to the rpc_backend option and driver specific
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# configuration. (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +rpc_response_timeout=120
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# A URL representing the messaging driver to use and its full configuration.
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #transport_url = <None>
Sep 28 12:23:17 ctl02 salt-minion[14967]: -
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# The messaging driver to use, defaults to rabbit. Other drivers include amqp
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# and zmq. (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +transport_url = rabbit://openstack:opnfv_secret@10.167.4.41:5672,openstack:opnfv_secret@10.167.4.42:5672,openstack:opnfv_secret@10.167.4.43:5672//openstack
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# DEPRECATED: The messaging driver to use, defaults to rabbit. Other drivers
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# include amqp and zmq. (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #rpc_backend = rabbit
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # The default exchange under which topics are scoped. May be overridden by an
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -546,6 +644,7 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # is idle for this number of seconds it will be closed. A value of '0' means
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # wait forever. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #client_socket_timeout = 900
Sep 28 12:23:17 ctl02 salt-minion[14967]: +nova_url = http://10.167.4.10:8774/v2
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  [agent]
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -565,13 +664,17 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # required, set this to False for a performance improvement. (boolean value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #use_helper_for_ns_read = true
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Root helper daemon application to use when possible. (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: -#root_helper_daemon = <None>
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Root helper daemon application to use when possible. For the agent which
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# needs to execute commands in Dom0 in the hypervisor of XenServer, this item
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# should be set to 'xenapi_root_helper', so that it will keep a XenAPI session
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# to pass commands to Dom0. (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +root_helper_daemon = sudo neutron-rootwrap-daemon /etc/neutron/rootwrap.conf
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Seconds between nodes reporting state to server; should be less than
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # agent_down_time, best if it is half or less than agent_down_time. (floating
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # point value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #report_interval = 30
Sep 28 12:23:17 ctl02 salt-minion[14967]: +report_interval = 10
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Log agent heartbeats (boolean value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #log_agent_heartbeats = false
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -582,6 +685,12 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # (boolean value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #comment_iptables_rules = true
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Duplicate every iptables difference calculation to ensure the format being
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# generated matches the format of iptables-save. This option should not be
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# turned on for production systems because it imposes a performance penalty.
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# (boolean value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#debug_iptables_rules = false
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Action to be executed when a child process dies (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Allowed values: respawn, exit
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #check_child_processes_action = respawn
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -601,7 +710,8 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Indicate whether this resource may be shared with the domain received in the
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# requests "origin" header. (list value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# requests "origin" header. Format: "<protocol>://<host>[:<port>]", no trailing
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# slash. Example: https://horizon.example.com (list value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #allowed_origin = <None>
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Indicate that the actual request can include user credentials (boolean value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -621,7 +731,6 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # (list value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #allow_headers = X-Auth-Token,X-Identity-Status,X-Roles,X-Service-Catalog,X-User-Id,X-Tenant-Id,X-OpenStack-Request-ID
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: -
Sep 28 12:23:17 ctl02 salt-minion[14967]:  [cors.subdomain]
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -629,7 +738,8 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Indicate whether this resource may be shared with the domain received in the
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# requests "origin" header. (list value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# requests "origin" header. Format: "<protocol>://<host>[:<port>]", no trailing
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# slash. Example: https://horizon.example.com (list value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #allowed_origin = <None>
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Indicate that the actual request can include user credentials (boolean value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -664,8 +774,12 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # From oslo.db
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# The file name to use with SQLite. (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# DEPRECATED: The file name to use with SQLite. (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/sqlite_db
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Reason: Should use config option connection or slave_connection to connect
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# the database.
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #sqlite_db = oslo.sqlite
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # If True, SQLite uses synchronous mode. (boolean value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -681,7 +795,8 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/sql_connection
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Deprecated group/name - [DATABASE]/sql_connection
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Deprecated group/name - [sql]/connection
Sep 28 12:23:17 ctl02 salt-minion[14967]: -connection = sqlite:////var/lib/neutron/neutron.sqlite
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +connection = mysql+pymysql://neutron:opnfv_secret@10.167.4.50/neutron?charset=utf8
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # The SQLAlchemy connection string to use to connect to the slave database.
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -698,35 +813,43 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Deprecated group/name - [DATABASE]/sql_idle_timeout
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Deprecated group/name - [sql]/idle_timeout
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #idle_timeout = 3600
Sep 28 12:23:17 ctl02 salt-minion[14967]: +idle_timeout = 3600
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Minimum number of SQL connections to keep open in a pool. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/sql_min_pool_size
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Deprecated group/name - [DATABASE]/sql_min_pool_size
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #min_pool_size = 1
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Maximum number of SQL connections to keep open in a pool. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Maximum number of SQL connections to keep open in a pool. Setting a value of
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# 0 indicates no limit. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/sql_max_pool_size
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Deprecated group/name - [DATABASE]/sql_max_pool_size
Sep 28 12:23:17 ctl02 salt-minion[14967]: -#max_pool_size = <None>
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#max_pool_size = 5
Sep 28 12:23:17 ctl02 salt-minion[14967]: +max_pool_size = 20
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Maximum number of database connection retries during startup. Set to -1 to
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # specify an infinite retry count. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/sql_max_retries
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Deprecated group/name - [DATABASE]/sql_max_retries
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #max_retries = 10
Sep 28 12:23:17 ctl02 salt-minion[14967]: +max_retries = -1
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Interval between retries of opening a SQL connection. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/sql_retry_interval
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Deprecated group/name - [DATABASE]/reconnect_interval
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #retry_interval = 10
Sep 28 12:23:17 ctl02 salt-minion[14967]: +retry_interval = 2
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # If set, use this value for max_overflow with SQLAlchemy. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/sql_max_overflow
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Deprecated group/name - [DATABASE]/sqlalchemy_max_overflow
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #max_overflow = 50
Sep 28 12:23:17 ctl02 salt-minion[14967]: +max_overflow = 20
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Verbosity of SQL debugging information: 0=None, 100=Everything. (integer
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Maximum value: 100
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/sql_connection_debug
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #connection_debug = 0
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -760,11 +883,31 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  [keystone_authtoken]
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: +auth_region=RegionOne
Sep 28 12:23:17 ctl02 salt-minion[14967]: +auth_protocol=http
Sep 28 12:23:17 ctl02 salt-minion[14967]: +revocation_cache_time = 10
Sep 28 12:23:17 ctl02 salt-minion[14967]: +auth_type = password
Sep 28 12:23:17 ctl02 salt-minion[14967]: +auth_host = 10.167.4.10
Sep 28 12:23:17 ctl02 salt-minion[14967]: +auth_port = 35357
Sep 28 12:23:17 ctl02 salt-minion[14967]: +user_domain_id = default
Sep 28 12:23:17 ctl02 salt-minion[14967]: +project_domain_id = default
Sep 28 12:23:17 ctl02 salt-minion[14967]: +project_name = service
Sep 28 12:23:17 ctl02 salt-minion[14967]: +username = neutron
Sep 28 12:23:17 ctl02 salt-minion[14967]: +password = opnfv_secret
Sep 28 12:23:17 ctl02 salt-minion[14967]: +auth_uri=http://10.167.4.10:5000
Sep 28 12:23:17 ctl02 salt-minion[14967]: +auth_url=http://10.167.4.10:35357
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # From keystonemiddleware.auth_token
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Complete public Identity API endpoint. (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Complete "public" Identity API endpoint. This endpoint should not be an
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# "admin" endpoint, as it should be accessible by all end users.
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Unauthenticated clients are redirected to this endpoint to authenticate.
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Although this endpoint should  ideally be unversioned, client support in the
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# wild varies.  If you're using a versioned v2 endpoint here, then this  should
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# *not* be the same endpoint the service user utilizes  for validating tokens,
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# because normal end users may not be  able to reach that endpoint. (string
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #auth_uri = <None>
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # API version of the admin Identity API endpoint. (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -782,7 +925,10 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # API Server. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #http_request_max_retries = 3
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Env key for the swift cache. (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Request environment key where the Swift cache object is stored. When
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# auth_token middleware is deployed with a Swift cache, use this option to have
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# the middleware share a caching backend with swift. Otherwise, use the
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# ``memcached_servers`` option instead. (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #cache = <None>
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Required if identity server requires client certificate (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -801,12 +947,17 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # The region in which the identity server can be found. (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #region_name = <None>
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Directory used to cache files related to PKI tokens. (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# DEPRECATED: Directory used to cache files related to PKI tokens. This option
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# has been deprecated in the Ocata release and will be removed in the P
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# release. (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# This option is deprecated for removal since Ocata.
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Reason: PKI token format is no longer supported.
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #signing_dir = <None>
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Optionally specify a list of memcached server(s) to use for caching. If left
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # undefined, tokens will instead be cached in-process. (list value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Deprecated group/name - [DEFAULT]/memcache_servers
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Deprecated group/name - [keystone_authtoken]/memcache_servers
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #memcached_servers = <None>
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # In order to prevent excessive effort spent validating tokens, the middleware
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -814,10 +965,14 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # to -1 to disable caching completely. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #token_cache_time = 300
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Determines the frequency at which the list of revoked tokens is retrieved
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# from the Identity service (in seconds). A high number of revocation events
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# combined with a low cache duration may significantly reduce performance.
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# DEPRECATED: Determines the frequency at which the list of revoked tokens is
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# retrieved from the Identity service (in seconds). A high number of revocation
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# events combined with a low cache duration may significantly reduce
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# performance. Only valid for PKI tokens. This option has been deprecated in
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# the Ocata release and will be removed in the P release. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# This option is deprecated for removal since Ocata.
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Reason: PKI token format is no longer supported.
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #revocation_cache_time = 10
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # (Optional) If defined, indicate whether token data should be authenticated or
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -870,19 +1025,40 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #enforce_token_bind = permissive
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# If true, the revocation list will be checked for cached tokens. This requires
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# that PKI tokens are configured on the identity server. (boolean value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# DEPRECATED: If true, the revocation list will be checked for cached tokens.
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# This requires that PKI tokens are configured on the identity server. (boolean
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# This option is deprecated for removal since Ocata.
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Reason: PKI token format is no longer supported.
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #check_revocations_for_cached = false
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Hash algorithms to use for hashing PKI tokens. This may be a single algorithm
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# or multiple. The algorithms are those supported by Python standard
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# hashlib.new(). The hashes will be tried in the order given, so put the
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# preferred one first for performance. The result of the first hash will be
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# DEPRECATED: Hash algorithms to use for hashing PKI tokens. This may be a
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# single algorithm or multiple. The algorithms are those supported by Python
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# standard hashlib.new(). The hashes will be tried in the order given, so put
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# the preferred one first for performance. The result of the first hash will be
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # stored in the cache. This will typically be set to multiple values only while
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # migrating from a less secure algorithm to a more secure one. Once all the old
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # tokens are expired this option should be set to a single value for better
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # performance. (list value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# This option is deprecated for removal since Ocata.
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Reason: PKI token format is no longer supported.
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #hash_algorithms = md5
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# A choice of roles that must be present in a service token. Service tokens are
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# allowed to request that an expired token can be used and so this check should
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# tightly control that only actual services should be sending this token. Roles
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# here are applied as an ANY check so any role in this list must be present.
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# For backwards compatibility reasons this currently only affects the
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# allow_expired check. (list value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#service_token_roles = service
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# For backwards compatibility reasons we must let valid service tokens pass
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# that don't pass the service_token_roles check as valid. Setting this true
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# will become the default in a future release and should be enabled if
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# possible. (boolean value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#service_token_roles_required = false
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Prefix to prepend at the beginning of the path. Deprecated, use identity_uri.
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -921,11 +1097,11 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Service tenant name. (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #admin_tenant_name = admin
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Authentication type to load (unknown value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Deprecated group/name - [DEFAULT]/auth_plugin
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Authentication type to load (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Deprecated group/name - [keystone_authtoken]/auth_plugin
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #auth_type = <None>
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Config Section from which to load plugin specific options (unknown value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Config Section from which to load plugin specific options (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #auth_section = <None>
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -935,32 +1111,44 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # From oslo.messaging
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Host to locate redis. (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# DEPRECATED: Host to locate redis. (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #host = 127.0.0.1
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Use this port to connect to redis host. (port value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# DEPRECATED: Use this port to connect to redis host. (port value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Minimum value: 0
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Maximum value: 65535
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #port = 6379
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Password for Redis server (optional). (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# DEPRECATED: Password for Redis server (optional). (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #password =
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# List of Redis Sentinel hosts (fault tolerance mode) e.g.
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# DEPRECATED: List of Redis Sentinel hosts (fault tolerance mode), e.g.,
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # [host:port, host1:port ... ] (list value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #sentinel_hosts =
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Redis replica set name. (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #sentinel_group_name = oslo-messaging-zeromq
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Time in ms to wait between connection attempts. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: -#wait_timeout = 500
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#wait_timeout = 2000
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Time in ms to wait before the transaction is killed. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #check_timeout = 20000
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Timeout in ms on blocking socket operations (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: -#socket_timeout = 1000
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Timeout in ms on blocking socket operations. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#socket_timeout = 10000
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  [nova]
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -972,22 +1160,31 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Name of nova region to use. Useful if keystone manages more than one region.
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #region_name = <None>
Sep 28 12:23:17 ctl02 salt-minion[14967]: +region_name = RegionOne
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Type of the nova endpoint to use.  This endpoint will be looked up in the
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # keystone catalog and should be one of public, internal or admin. (string
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Allowed values: public, admin, internal
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #endpoint_type = public
Sep 28 12:23:17 ctl02 salt-minion[14967]: +endpoint_type = internal
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # From nova.auth
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Authentication URL (unknown value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Authentication URL (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #auth_url = <None>
Sep 28 12:23:17 ctl02 salt-minion[14967]: -
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Authentication type to load (unknown value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Deprecated group/name - [DEFAULT]/auth_plugin
Sep 28 12:23:17 ctl02 salt-minion[14967]: +user_domain_id = default
Sep 28 12:23:17 ctl02 salt-minion[14967]: +project_domain_id = default
Sep 28 12:23:17 ctl02 salt-minion[14967]: +project_name = service
Sep 28 12:23:17 ctl02 salt-minion[14967]: +password = opnfv_secret
Sep 28 12:23:17 ctl02 salt-minion[14967]: +username = nova
Sep 28 12:23:17 ctl02 salt-minion[14967]: +auth_type = password
Sep 28 12:23:17 ctl02 salt-minion[14967]: +auth_url = http://10.167.4.10:35357
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Authentication type to load (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Deprecated group/name - [nova]/auth_plugin
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #auth_type = <None>
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # PEM encoded Certificate Authority to use when verifying HTTPs connections.
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -998,19 +1195,19 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #certfile = <None>
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Optional domain ID to use with v3 and v2 parameters. It will be used for both
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# the user and project domain in v3 and ignored in v2 authentication. (unknown
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# the user and project domain in v3 and ignored in v2 authentication. (string
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #default_domain_id = <None>
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Optional domain name to use with v3 API and v2 parameters. It will be used
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # for both the user and project domain in v3 and ignored in v2 authentication.
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# (unknown value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #default_domain_name = <None>
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Domain ID to scope to (unknown value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Domain ID to scope to (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #domain_id = <None>
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Domain name to scope to (unknown value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Domain name to scope to (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #domain_name = <None>
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Verify HTTPS connections. (boolean value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -1019,46 +1216,46 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # PEM encoded client certificate key file (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #keyfile = <None>
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# User's password (unknown value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# User's password (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #password = <None>
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Domain ID containing project (unknown value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Domain ID containing project (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #project_domain_id = <None>
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Domain name containing project (unknown value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Domain name containing project (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #project_domain_name = <None>
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Project ID to scope to (unknown value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Deprecated group/name - [DEFAULT]/tenant-id
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Project ID to scope to (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Deprecated group/name - [nova]/tenant-id
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #project_id = <None>
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Project name to scope to (unknown value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Deprecated group/name - [DEFAULT]/tenant-name
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Project name to scope to (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Deprecated group/name - [nova]/tenant-name
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #project_name = <None>
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Tenant ID (unknown value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Tenant ID (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #tenant_id = <None>
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Tenant Name (unknown value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Tenant Name (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #tenant_name = <None>
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Timeout value for http requests (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #timeout = <None>
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Trust ID (unknown value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Trust ID (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #trust_id = <None>
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# User's domain id (unknown value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# User's domain id (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #user_domain_id = <None>
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# User's domain name (unknown value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# User's domain name (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #user_domain_name = <None>
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# User id (unknown value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# User id (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #user_id = <None>
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Username (unknown value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Deprecated group/name - [DEFAULT]/user-name
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Username (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Deprecated group/name - [nova]/user-name
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #username = <None>
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -1080,6 +1277,7 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/lock_path
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #lock_path = /tmp
Sep 28 12:23:17 ctl02 salt-minion[14967]: +lock_path = $state_path/lock
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  [oslo_messaging_amqp]
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -1087,6 +1285,116 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # From oslo.messaging
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Name for the AMQP container. must be globally unique. Defaults to a generated
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# UUID (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/container_name
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#container_name = <None>
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Timeout for inactive connections (in seconds) (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/idle_timeout
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#idle_timeout = 0
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Debug: dump AMQP frames to stdout (boolean value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/trace
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#trace = false
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# CA certificate PEM file used to verify the server's certificate (string
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/ssl_ca_file
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#ssl_ca_file =
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Self-identifying certificate PEM file for client authentication (string
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/ssl_cert_file
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#ssl_cert_file =
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Private key PEM file used to sign ssl_cert_file certificate (optional)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/ssl_key_file
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#ssl_key_file =
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Password for decrypting ssl_key_file (if encrypted) (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/ssl_key_password
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#ssl_key_password = <None>
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# DEPRECATED: Accept clients using either SSL or plain TCP (boolean value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/allow_insecure_clients
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Reason: Not applicable - not a SSL server
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#allow_insecure_clients = false
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Space separated list of acceptable SASL mechanisms (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/sasl_mechanisms
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#sasl_mechanisms =
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Path to directory that contains the SASL configuration (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/sasl_config_dir
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#sasl_config_dir =
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Name of configuration file (without .conf suffix) (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/sasl_config_name
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#sasl_config_name =
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# User name for message broker authentication (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/username
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#username =
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Password for message broker authentication (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Deprecated group/name - [amqp1]/password
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#password =
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Seconds to pause before attempting to re-connect. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#connection_retry_interval = 1
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Increase the connection_retry_interval by this many seconds after each
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# unsuccessful failover attempt. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#connection_retry_backoff = 2
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Maximum limit for connection_retry_interval + connection_retry_backoff
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#connection_retry_interval_max = 30
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Time to pause between re-connecting an AMQP 1.0 link that failed due to a
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# recoverable error. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#link_retry_delay = 10
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# The maximum number of attempts to re-send a reply message which failed due to
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# a recoverable error. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Minimum value: -1
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#default_reply_retry = 0
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# The deadline for an rpc reply message delivery. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Minimum value: 5
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#default_reply_timeout = 30
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# The deadline for an rpc cast or call message delivery. Only used when caller
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# does not provide a timeout expiry. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Minimum value: 5
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#default_send_timeout = 30
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# The deadline for a sent notification message delivery. Only used when caller
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# does not provide a timeout expiry. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Minimum value: 5
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#default_notify_timeout = 30
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# The duration to schedule a purge of idle sender links. Detach link after
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# expiry. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#default_sender_link_timeout = 600
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Indicates the addressing mode used by the driver.
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Permitted values:
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# 'legacy'   - use legacy non-routable addressing
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# 'routable' - use routable addresses
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# 'dynamic'  - use legacy addresses if the message bus does not support routing
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# otherwise use routable addressing (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#addressing_mode = dynamic
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # address prefix used when sending to a specific server (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Deprecated group/name - [amqp1]/server_request_prefix
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -1100,57 +1408,113 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Deprecated group/name - [amqp1]/group_request_prefix
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #group_request_prefix = unicast
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Name for the AMQP container (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/container_name
Sep 28 12:23:17 ctl02 salt-minion[14967]: -#container_name = <None>
Sep 28 12:23:17 ctl02 salt-minion[14967]: -
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Timeout for inactive connections (in seconds) (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/idle_timeout
Sep 28 12:23:17 ctl02 salt-minion[14967]: -#idle_timeout = 0
Sep 28 12:23:17 ctl02 salt-minion[14967]: -
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Debug: dump AMQP frames to stdout (boolean value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/trace
Sep 28 12:23:17 ctl02 salt-minion[14967]: -#trace = false
Sep 28 12:23:17 ctl02 salt-minion[14967]: -
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# CA certificate PEM file to verify server certificate (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/ssl_ca_file
Sep 28 12:23:17 ctl02 salt-minion[14967]: -#ssl_ca_file =
Sep 28 12:23:17 ctl02 salt-minion[14967]: -
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Identifying certificate PEM file to present to clients (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/ssl_cert_file
Sep 28 12:23:17 ctl02 salt-minion[14967]: -#ssl_cert_file =
Sep 28 12:23:17 ctl02 salt-minion[14967]: -
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Private key PEM file used to sign cert_file certificate (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/ssl_key_file
Sep 28 12:23:17 ctl02 salt-minion[14967]: -#ssl_key_file =
Sep 28 12:23:17 ctl02 salt-minion[14967]: -
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Password for decrypting ssl_key_file (if encrypted) (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/ssl_key_password
Sep 28 12:23:17 ctl02 salt-minion[14967]: -#ssl_key_password = <None>
Sep 28 12:23:17 ctl02 salt-minion[14967]: -
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Accept clients using either SSL or plain TCP (boolean value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/allow_insecure_clients
Sep 28 12:23:17 ctl02 salt-minion[14967]: -#allow_insecure_clients = false
Sep 28 12:23:17 ctl02 salt-minion[14967]: -
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Space separated list of acceptable SASL mechanisms (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/sasl_mechanisms
Sep 28 12:23:17 ctl02 salt-minion[14967]: -#sasl_mechanisms =
Sep 28 12:23:17 ctl02 salt-minion[14967]: -
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Path to directory that contains the SASL configuration (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/sasl_config_dir
Sep 28 12:23:17 ctl02 salt-minion[14967]: -#sasl_config_dir =
Sep 28 12:23:17 ctl02 salt-minion[14967]: -
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Name of configuration file (without .conf suffix) (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/sasl_config_name
Sep 28 12:23:17 ctl02 salt-minion[14967]: -#sasl_config_name =
Sep 28 12:23:17 ctl02 salt-minion[14967]: -
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# User name for message broker authentication (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/username
Sep 28 12:23:17 ctl02 salt-minion[14967]: -#username =
Sep 28 12:23:17 ctl02 salt-minion[14967]: -
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Password for message broker authentication (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Deprecated group/name - [amqp1]/password
Sep 28 12:23:17 ctl02 salt-minion[14967]: -#password =
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Address prefix for all generated RPC addresses (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#rpc_address_prefix = openstack.org/om/rpc
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Address prefix for all generated Notification addresses (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#notify_address_prefix = openstack.org/om/notify
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Appended to the address prefix when sending a fanout message. Used by the
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# message bus to identify fanout messages. (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#multicast_address = multicast
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Appended to the address prefix when sending to a particular RPC/Notification
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# server. Used by the message bus to identify messages sent to a single
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# destination. (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#unicast_address = unicast
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Appended to the address prefix when sending to a group of consumers. Used by
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# the message bus to identify messages that should be delivered in a round-
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# robin fashion across consumers. (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#anycast_address = anycast
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Exchange name used in notification addresses.
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Exchange name resolution precedence:
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Target.exchange if set
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# else default_notification_exchange if set
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# else control_exchange if set
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# else 'notify' (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#default_notification_exchange = <None>
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Exchange name used in RPC addresses.
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Exchange name resolution precedence:
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Target.exchange if set
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# else default_rpc_exchange if set
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# else control_exchange if set
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# else 'rpc' (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#default_rpc_exchange = <None>
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Window size for incoming RPC Reply messages. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#reply_link_credit = 200
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Window size for incoming RPC Request messages (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#rpc_server_credit = 100
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Window size for incoming Notification messages (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#notify_server_credit = 100
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Send messages of this type pre-settled.
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Pre-settled messages will not receive acknowledgement
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# from the peer. Note well: pre-settled messages may be
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# silently discarded if the delivery fails.
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Permitted values:
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# 'rpc-call' - send RPC Calls pre-settled
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# 'rpc-reply'- send RPC Replies pre-settled
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# 'rpc-cast' - Send RPC Casts pre-settled
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# 'notify'   - Send Notifications pre-settled
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#  (multi valued)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#pre_settled = rpc-cast
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#pre_settled = rpc-reply
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +[oslo_messaging_kafka]
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# From oslo.messaging
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# DEPRECATED: Default Kafka broker Host (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#kafka_default_host = localhost
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# DEPRECATED: Default Kafka broker Port (port value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Maximum value: 65535
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#kafka_default_port = 9092
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Max fetch bytes of Kafka consumer (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#kafka_max_fetch_bytes = 1048576
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Default timeout(s) for Kafka consumers (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#kafka_consumer_timeout = 1.0
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Pool Size for Kafka Consumers (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#pool_size = 10
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# The pool size limit for connections expiration policy (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#conn_pool_min_size = 2
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# The time-to-live in sec of idle connections in the pool (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#conn_pool_ttl = 1200
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Group id for Kafka consumer. Consumers in one group will coordinate message
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# consumption (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#consumer_group = oslo_messaging_consumer
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Upper bound on the delay for KafkaProducer batching in seconds (floating
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# point value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#producer_batch_timeout = 0.0
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Size of batch for the producer async send (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#producer_batch_size = 16384
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  [oslo_messaging_notifications]
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -1214,12 +1578,12 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #kombu_reconnect_delay = 1.0
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # EXPERIMENTAL: Possible values are: gzip, bz2. If not set compression will not
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# be used. This option may notbe available in future versions. (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# be used. This option may not be available in future versions. (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #kombu_compression = <None>
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# How long to wait a missing client beforce abandoning to send it its replies.
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# How long to wait a missing client before abandoning to send it its replies.
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # This value should not be longer than rpc_response_timeout. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Deprecated group/name - [DEFAULT]/kombu_reconnect_timeout
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Deprecated group/name - [oslo_messaging_rabbit]/kombu_reconnect_timeout
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #kombu_missing_consumer_retry_timeout = 60
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Determines how the next RabbitMQ node is chosen in case the one we are
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -1228,61 +1592,86 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Allowed values: round-robin, shuffle
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #kombu_failover_strategy = round-robin
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# The RabbitMQ broker address where a single node is used. (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# DEPRECATED: The RabbitMQ broker address where a single node is used. (string
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rabbit_host
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #rabbit_host = localhost
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# The RabbitMQ broker port where a single node is used. (port value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# DEPRECATED: The RabbitMQ broker port where a single node is used. (port
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Minimum value: 0
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Maximum value: 65535
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rabbit_port
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #rabbit_port = 5672
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# RabbitMQ HA cluster host:port pairs. (list value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# DEPRECATED: RabbitMQ HA cluster host:port pairs. (list value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rabbit_hosts
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #rabbit_hosts = $rabbit_host:$rabbit_port
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Connect over SSL for RabbitMQ. (boolean value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rabbit_use_ssl
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #rabbit_use_ssl = false
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# The RabbitMQ userid. (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# DEPRECATED: The RabbitMQ userid. (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rabbit_userid
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #rabbit_userid = guest
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# The RabbitMQ password. (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# DEPRECATED: The RabbitMQ password. (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rabbit_password
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #rabbit_password = guest
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # The RabbitMQ login method. (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Allowed values: PLAIN, AMQPLAIN, RABBIT-CR-DEMO
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rabbit_login_method
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #rabbit_login_method = AMQPLAIN
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# The RabbitMQ virtual host. (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# DEPRECATED: The RabbitMQ virtual host. (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rabbit_virtual_host
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Reason: Replaced by [DEFAULT]/transport_url
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #rabbit_virtual_host = /
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # How frequently to retry connecting with RabbitMQ. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #rabbit_retry_interval = 1
Sep 28 12:23:17 ctl02 salt-minion[14967]: +rabbit_retry_interval = 1
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # How long to backoff for between retries when connecting to RabbitMQ. (integer
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rabbit_retry_backoff
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #rabbit_retry_backoff = 2
Sep 28 12:23:17 ctl02 salt-minion[14967]: +rabbit_retry_backoff = 2
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Maximum interval of RabbitMQ connection retries. Default is 30 seconds.
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #rabbit_interval_max = 30
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Maximum number of RabbitMQ connection retries. Default is 0 (infinite retry
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# count). (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# DEPRECATED: Maximum number of RabbitMQ connection retries. Default is 0
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# (infinite retry count). (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rabbit_max_retries
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #rabbit_max_retries = 0
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Try to use HA queues in RabbitMQ (x-ha-policy: all). If you change this
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # option, you must wipe the RabbitMQ database. In RabbitMQ 3.0, queue mirroring
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # is no longer controlled by the x-ha-policy argument when declaring a queue.
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# If you just want to make sure that all queues (except  those with auto-
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# If you just want to make sure that all queues (except those with auto-
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # generated names) are mirrored across all nodes, run: "rabbitmqctl set_policy
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # HA '^(?!amq\.).*' '{"ha-mode": "all"}' " (boolean value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/rabbit_ha_queues
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -1302,10 +1691,12 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # heartbeat's keep-alive fails (0 disable the heartbeat). EXPERIMENTAL (integer
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #heartbeat_timeout_threshold = 60
Sep 28 12:23:17 ctl02 salt-minion[14967]: +heartbeat_timeout_threshold = 0
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # How often times during the heartbeat_timeout_threshold we check the
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # heartbeat. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #heartbeat_rate = 2
Sep 28 12:23:17 ctl02 salt-minion[14967]: +heartbeat_rate = 2
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Deprecated, use rpc_backend=kombu+memory or rpc_backend=fake (boolean value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/fake_rabbit
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -1318,7 +1709,7 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #frame_max = <None>
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # How often to send heartbeats for consumer's connections (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: -#heartbeat_interval = 1
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#heartbeat_interval = 3
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Enable SSL (boolean value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #ssl = <None>
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -1337,8 +1728,12 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # point value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #host_connection_reconnect_delay = 0.25
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Connection factory implementation (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Allowed values: new, single, read_write
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#connection_factory = single
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Maximum number of connections to keep queued. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: -#pool_max_size = 10
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#pool_max_size = 30
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Maximum number of connections to create above `pool_max_size`. (integer
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -1357,10 +1752,15 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #pool_stale = 60
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Default serialization mechanism for serializing/deserializing
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# outgoing/incoming messages (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Allowed values: json, msgpack
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#default_serializer_type = json
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Persist notification messages. (boolean value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #notification_persistence = false
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Exchange name for for sending notifications (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Exchange name for sending notifications (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #default_notification_exchange = ${control_exchange}_notification
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Max number of not acknowledged message which RabbitMQ can send to
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -1402,7 +1802,7 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Reconnecting retry count in case of connectivity problem during sending RPC
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # message, -1 means infinite retry. If actual retry attempts in not 0 the rpc
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# request could be processed more then one time (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# request could be processed more than one time (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #default_rpc_retry_attempts = -1
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Reconnecting retry delay in case of connectivity problem during sending RPC
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -1410,13 +1810,185 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #rpc_retry_delay = 0.25
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: +[oslo_messaging_zmq]
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# From oslo.messaging
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# ZeroMQ bind address. Should be a wildcard (*), an ethernet interface, or IP.
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# The "host" option should point or resolve to this address. (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_bind_address
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#rpc_zmq_bind_address = *
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# MatchMaker driver. (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Allowed values: redis, sentinel, dummy
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_matchmaker
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#rpc_zmq_matchmaker = redis
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Number of ZeroMQ contexts, defaults to 1. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_contexts
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#rpc_zmq_contexts = 1
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Maximum number of ingress messages to locally buffer per topic. Default is
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# unlimited. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_topic_backlog
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#rpc_zmq_topic_backlog = <None>
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Directory for holding IPC sockets. (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_ipc_dir
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#rpc_zmq_ipc_dir = /var/run/openstack
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Name of this node. Must be a valid hostname, FQDN, or IP address. Must match
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# "host" option, if running Nova. (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_host
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#rpc_zmq_host = localhost
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Number of seconds to wait before all pending messages will be sent after
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# closing a socket. The default value of -1 specifies an infinite linger
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# period. The value of 0 specifies no linger period. Pending messages shall be
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# discarded immediately when the socket is closed. Positive values specify an
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# upper bound for the linger period. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_cast_timeout
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#zmq_linger = -1
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# The default number of seconds that poll should wait. Poll raises timeout
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# exception when timeout expired. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_poll_timeout
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#rpc_poll_timeout = 1
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Expiration timeout in seconds of a name service record about existing target
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# ( < 0 means no timeout). (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/zmq_target_expire
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#zmq_target_expire = 300
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Update period in seconds of a name service record about existing target.
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/zmq_target_update
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#zmq_target_update = 180
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Use PUB/SUB pattern for fanout methods. PUB/SUB always uses proxy. (boolean
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/use_pub_sub
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#use_pub_sub = false
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Use ROUTER remote proxy. (boolean value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/use_router_proxy
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#use_router_proxy = false
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# This option makes direct connections dynamic or static. It makes sense only
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# with use_router_proxy=False which means to use direct connections for direct
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# message types (ignored otherwise). (boolean value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#use_dynamic_connections = false
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# How many additional connections to a host will be made for failover reasons.
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# This option is actual only in dynamic connections mode. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#zmq_failover_connections = 2
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Minimal port number for random ports range. (port value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Minimum value: 0
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Maximum value: 65535
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_min_port
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#rpc_zmq_min_port = 49153
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Maximal port number for random ports range. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Minimum value: 1
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Maximum value: 65536
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_max_port
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#rpc_zmq_max_port = 65536
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Number of retries to find free port number before fail with ZMQBindError.
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_bind_port_retries
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#rpc_zmq_bind_port_retries = 100
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Default serialization mechanism for serializing/deserializing
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# outgoing/incoming messages (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Allowed values: json, msgpack
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Deprecated group/name - [DEFAULT]/rpc_zmq_serialization
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#rpc_zmq_serialization = json
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# This option configures round-robin mode in zmq socket. True means not keeping
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# a queue when server side disconnects. False means to keep queue and messages
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# even if server is disconnected, when the server appears we send all
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# accumulated messages to it. (boolean value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#zmq_immediate = true
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Enable/disable TCP keepalive (KA) mechanism. The default value of -1 (or any
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# other negative value) means to skip any overrides and leave it to OS default;
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# 0 and 1 (or any other positive value) mean to disable and enable the option
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# respectively. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#zmq_tcp_keepalive = -1
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# The duration between two keepalive transmissions in idle condition. The unit
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# is platform dependent, for example, seconds in Linux, milliseconds in Windows
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# etc. The default value of -1 (or any other negative value and 0) means to
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# skip any overrides and leave it to OS default. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#zmq_tcp_keepalive_idle = -1
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# The number of retransmissions to be carried out before declaring that remote
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# end is not available. The default value of -1 (or any other negative value
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# and 0) means to skip any overrides and leave it to OS default. (integer
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#zmq_tcp_keepalive_cnt = -1
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# The duration between two successive keepalive retransmissions, if
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# acknowledgement to the previous keepalive transmission is not received. The
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# unit is platform dependent, for example, seconds in Linux, milliseconds in
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Windows etc. The default value of -1 (or any other negative value and 0)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# means to skip any overrides and leave it to OS default. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#zmq_tcp_keepalive_intvl = -1
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Maximum number of (green) threads to work concurrently. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#rpc_thread_pool_size = 100
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Expiration timeout in seconds of a sent/received message after which it is
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# not tracked anymore by a client/server. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#rpc_message_ttl = 300
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Wait for message acknowledgements from receivers. This mechanism works only
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# via proxy without PUB/SUB. (boolean value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#rpc_use_acks = false
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Number of seconds to wait for an ack from a cast/call. After each retry
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# attempt this timeout is multiplied by some specified multiplier. (integer
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#rpc_ack_timeout_base = 15
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Number to multiply base ack timeout by after each retry attempt. (integer
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#rpc_ack_timeout_multiplier = 2
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Default number of message sending attempts in case of any problems occurred:
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# positive value N means at most N retries, 0 means no retries, None or -1 (or
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# any other negative values) mean to retry forever. This option is used only if
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# acknowledgments are enabled. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#rpc_retry_attempts = 3
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# List of publisher hosts SubConsumer can subscribe on. This option has higher
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# priority then the default publishers list taken from the matchmaker. (list
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#subscribe_on =
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +[oslo_middleware]
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# From oslo.middleware.http_proxy_to_wsgi
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Whether the application is behind a proxy or not. This determines if the
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# middleware should parse the headers or not. (boolean value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +#enable_proxy_headers_parsing = false
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]:  [oslo_policy]
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # From oslo.policy
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# The JSON file that defines policies. (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# The file that defines policies. (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Deprecated group/name - [DEFAULT]/policy_file
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #policy_file = policy.json
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -1439,7 +2011,10 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # From neutron.qos
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Drivers list to use to send the update notification (list value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# DEPRECATED: Drivers list to use to send the update notification. This option
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# will be unused in Pike. (list value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# This option is deprecated for removal.
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Its value may be silently ignored in the future.
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #notification_drivers = message_queue
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -1448,12 +2023,6 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # From neutron
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #
Sep 28 12:23:17 ctl02 salt-minion[14967]: -
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Resource name(s) that are supported in quota features. This option is now
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# deprecated for removal. (list value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# This option is deprecated for removal.
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Its value may be silently ignored in the future.
Sep 28 12:23:17 ctl02 salt-minion[14967]: -#quota_items = network,subnet,port
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Default number of resource allowed per tenant. A negative value means
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # unlimited. (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -1471,11 +2040,11 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # (integer value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #quota_port = 50
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Default driver to use for quota checks (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Default driver to use for quota checks. (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #quota_driver = neutron.db.quota.driver.DbQuotaDriver
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# Keep in track in the database of current resourcequota usage. Plugins which
Sep 28 12:23:17 ctl02 salt-minion[14967]: -# do not leverage the neutron database should set this flag to False (boolean
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# Keep in track in the database of current resource quota usage. Plugins which
Sep 28 12:23:17 ctl02 salt-minion[14967]: +# do not leverage the neutron database should set this flag to False. (boolean
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #track_quota_usage = true
Sep 28 12:23:17 ctl02 salt-minion[14967]:  
Sep 28 12:23:17 ctl02 salt-minion[14967]: @@ -1526,3 +2095,6 @@
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # Sets the list of available ciphers. value should be a string in the OpenSSL
Sep 28 12:23:17 ctl02 salt-minion[14967]:  # cipher list format. (string value)
Sep 28 12:23:17 ctl02 salt-minion[14967]:  #ciphers = <None>
Sep 28 12:23:17 ctl02 salt-minion[14967]: +[service_providers]
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: +
Sep 28 12:23:17 ctl02 salt-minion[14967]: [INFO    ] Completed state [/etc/neutron/neutron.conf] at time 12:23:17.509703 duration_in_ms=123.426
Sep 28 12:23:17 ctl02 salt-minion[14967]: [INFO    ] Running state [neutron-db-manage --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini upgrade head] at time 12:23:17.510006
Sep 28 12:23:17 ctl02 salt-minion[14967]: [INFO    ] Executing state cmd.run for neutron-db-manage --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini upgrade head
Sep 28 12:23:17 ctl02 salt-minion[14967]: [INFO    ] Executing command 'neutron-db-manage --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini upgrade head' in directory '/root'
Sep 28 12:23:17 ctl02 nova-api[30424]: 2017-09-28 12:23:17.646 30424 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:23:17 ctl02 nova-api[30424]: 2017-09-28 12:23:17.864 30424 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:23:17 ctl02 nova-api[30424]: 2017-09-28 12:23:17.866 30424 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:23:17 ctl02 nova-api[30424]: 2017-09-28 12:23:17.866 30424 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:23:17 ctl02 nova-api[30424]: 2017-09-28 12:23:17.867 30424 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:23:17 ctl02 nova-api[30424]: 2017-09-28 12:23:17.998 30424 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:23:18 ctl02 nova-api[30424]: 2017-09-28 12:23:18.000 30424 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:23:18 ctl02 nova-api[30424]: 2017-09-28 12:23:18.000 30424 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:23:18 ctl02 nova-api[30424]: 2017-09-28 12:23:18.001 30424 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:23:18 ctl02 nova-api[30424]: 2017-09-28 12:23:18.004 30424 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:23:18 ctl02 nova-api[30424]: 2017-09-28 12:23:18.004 30424 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:23:18 ctl02 nova-api[30424]: 2017-09-28 12:23:18.004 30424 ERROR nova Traceback (most recent call last):
Sep 28 12:23:18 ctl02 nova-api[30424]: 2017-09-28 12:23:18.004 30424 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:23:18 ctl02 nova-api[30424]: 2017-09-28 12:23:18.004 30424 ERROR nova     sys.exit(main())
Sep 28 12:23:18 ctl02 nova-api[30424]: 2017-09-28 12:23:18.004 30424 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:23:18 ctl02 nova-api[30424]: 2017-09-28 12:23:18.004 30424 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:23:18 ctl02 nova-api[30424]: 2017-09-28 12:23:18.004 30424 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:23:18 ctl02 nova-api[30424]: 2017-09-28 12:23:18.004 30424 ERROR nova     max_url_len=max_url_len)
Sep 28 12:23:18 ctl02 nova-api[30424]: 2017-09-28 12:23:18.004 30424 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:23:18 ctl02 nova-api[30424]: 2017-09-28 12:23:18.004 30424 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:23:18 ctl02 nova-api[30424]: 2017-09-28 12:23:18.004 30424 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:23:18 ctl02 nova-api[30424]: 2017-09-28 12:23:18.004 30424 ERROR nova     sock.listen(backlog)
Sep 28 12:23:18 ctl02 nova-api[30424]: 2017-09-28 12:23:18.004 30424 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:23:18 ctl02 nova-api[30424]: 2017-09-28 12:23:18.004 30424 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:23:18 ctl02 nova-api[30424]: 2017-09-28 12:23:18.004 30424 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:23:18 ctl02 nova-api[30424]: 2017-09-28 12:23:18.004 30424 ERROR nova
Sep 28 12:23:18 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:23:18 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:23:18 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:23:18 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:23:18.176 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:23:18] "OPTIONS / HTTP/1.0" 200 134 0.000522
Sep 28 12:23:18 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xea9d5508)
Sep 28 12:23:18 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:23:18 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:23:18 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:23:18 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:23:18 ctl02 salt-minion[14967]: [ERROR   ] Command 'neutron-db-manage --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini upgrade head' failed with return code: 1
Sep 28 12:23:18 ctl02 salt-minion[14967]: [ERROR   ] stderr: No handlers could be found for logger "oslo_config.cfg"
Sep 28 12:23:18 ctl02 salt-minion[14967]: INFO  [alembic.runtime.migration] Context impl MySQLImpl.
Sep 28 12:23:18 ctl02 salt-minion[14967]: INFO  [alembic.runtime.migration] Will assume non-transactional DDL.
Sep 28 12:23:18 ctl02 salt-minion[14967]: Traceback (most recent call last):
Sep 28 12:23:18 ctl02 salt-minion[14967]:   File "/usr/bin/neutron-db-manage", line 10, in <module>
Sep 28 12:23:18 ctl02 salt-minion[14967]:     sys.exit(main())
Sep 28 12:23:18 ctl02 salt-minion[14967]:   File "/usr/lib/python2.7/dist-packages/neutron/db/migration/cli.py", line 750, in main
Sep 28 12:23:18 ctl02 salt-minion[14967]:     return_val |= bool(CONF.command.func(config, CONF.command.name))
Sep 28 12:23:18 ctl02 salt-minion[14967]:   File "/usr/lib/python2.7/dist-packages/neutron/db/migration/cli.py", line 224, in do_upgrade
Sep 28 12:23:18 ctl02 salt-minion[14967]:     run_sanity_checks(config, revision)
Sep 28 12:23:18 ctl02 salt-minion[14967]:   File "/usr/lib/python2.7/dist-packages/neutron/db/migration/cli.py", line 732, in run_sanity_checks
Sep 28 12:23:18 ctl02 salt-minion[14967]:     script_dir.run_env()
Sep 28 12:23:18 ctl02 salt-minion[14967]:   File "/usr/lib/python2.7/dist-packages/alembic/script/base.py", line 397, in run_env
Sep 28 12:23:18 ctl02 salt-minion[14967]:     util.load_python_file(self.dir, 'env.py')
Sep 28 12:23:18 ctl02 salt-minion[14967]:   File "/usr/lib/python2.7/dist-packages/alembic/util/pyfiles.py", line 81, in load_python_file
Sep 28 12:23:18 ctl02 salt-minion[14967]:     module = load_module_py(module_id, path)
Sep 28 12:23:18 ctl02 salt-minion[14967]:   File "/usr/lib/python2.7/dist-packages/alembic/util/compat.py", line 79, in load_module_py
Sep 28 12:23:18 ctl02 salt-minion[14967]:     mod = imp.load_source(module_id, path, fp)
Sep 28 12:23:18 ctl02 salt-minion[14967]:   File "/usr/lib/python2.7/dist-packages/neutron/db/migration/alembic_migrations/env.py", line 126, in <module>
Sep 28 12:23:18 ctl02 salt-minion[14967]:     run_migrations_online()
Sep 28 12:23:18 ctl02 salt-minion[14967]:   File "/usr/lib/python2.7/dist-packages/neutron/db/migration/alembic_migrations/env.py", line 120, in run_migrations_online
Sep 28 12:23:18 ctl02 salt-minion[14967]:     context.run_migrations()
Sep 28 12:23:18 ctl02 salt-minion[14967]:   File "<string>", line 8, in run_migrations
Sep 28 12:23:18 ctl02 salt-minion[14967]:   File "/usr/lib/python2.7/dist-packages/alembic/runtime/environment.py", line 797, in run_migrations
Sep 28 12:23:18 ctl02 salt-minion[14967]:     self.get_context().run_migrations(**kw)
Sep 28 12:23:18 ctl02 salt-minion[14967]:   File "/usr/lib/python2.7/dist-packages/alembic/runtime/migration.py", line 303, in run_migrations
Sep 28 12:23:18 ctl02 salt-minion[14967]:     for step in self._migrations_fn(heads, self):
Sep 28 12:23:18 ctl02 salt-minion[14967]:   File "/usr/lib/python2.7/dist-packages/neutron/db/migration/cli.py", line 723, in check_sanity
Sep 28 12:23:18 ctl02 salt-minion[14967]:     revision, rev, implicit_base=True):
Sep 28 12:23:18 ctl02 salt-minion[14967]:   File "/usr/lib/python2.7/dist-packages/alembic/script/revision.py", line 610, in _iterate_revisions
Sep 28 12:23:18 ctl02 salt-minion[14967]:     requested_lowers = self.get_revisions(lower)
Sep 28 12:23:18 ctl02 salt-minion[14967]:   File "/usr/lib/python2.7/dist-packages/alembic/script/revision.py", line 299, in get_revisions
Sep 28 12:23:18 ctl02 salt-minion[14967]:     return sum([self.get_revisions(id_elem) for id_elem in id_], ())
Sep 28 12:23:18 ctl02 salt-minion[14967]:   File "/usr/lib/python2.7/dist-packages/alembic/script/revision.py", line 304, in get_revisions
Sep 28 12:23:18 ctl02 salt-minion[14967]:     for rev_id in resolved_id)
Sep 28 12:23:18 ctl02 salt-minion[14967]:   File "/usr/lib/python2.7/dist-packages/alembic/script/revision.py", line 304, in <genexpr>
Sep 28 12:23:18 ctl02 salt-minion[14967]:     for rev_id in resolved_id)
Sep 28 12:23:18 ctl02 salt-minion[14967]:   File "/usr/lib/python2.7/dist-packages/alembic/script/revision.py", line 359, in _revision_for_ident
Sep 28 12:23:18 ctl02 salt-minion[14967]:     resolved_id)
Sep 28 12:23:18 ctl02 salt-minion[14967]: alembic.script.revision.ResolutionError: No such revision or branch '5c85685d616d'
Sep 28 12:23:18 ctl02 salt-minion[14967]: [ERROR   ] retcode: 1
Sep 28 12:23:18 ctl02 salt-minion[14967]: [ERROR   ] {'pid': 30499, 'retcode': 1, 'stderr': 'No handlers could be found for logger "oslo_config.cfg"\nINFO  [alembic.runtime.migration] Context impl MySQLImpl.\nINFO  [alembic.runtime.migration] Will assume non-transactional DDL.\nTraceback (most recent call last):\n  File "/usr/bin/neutron-db-manage", line 10, in <module>\n    sys.exit(main())\n  File "/usr/lib/python2.7/dist-packages/neutron/db/migration/cli.py", line 750, in main\n    return_val |= bool(CONF.command.func(config, CONF.command.name))\n  File "/usr/lib/python2.7/dist-packages/neutron/db/migration/cli.py", line 224, in do_upgrade\n    run_sanity_checks(config, revision)\n  File "/usr/lib/python2.7/dist-packages/neutron/db/migration/cli.py", line 732, in run_sanity_checks\n    script_dir.run_env()\n  File "/usr/lib/python2.7/dist-packages/alembic/script/base.py", line 397, in run_env\n    util.load_python_file(self.dir, \'env.py\')\n  File "/usr/lib/python2.7/dist-packages/alembic/util/pyfiles.py", line 81, in load_python_file\n    module = load_module_py(module_id, path)\n  File "/usr/lib/python2.7/dist-packages/alembic/util/compat.py", line 79, in load_module_py\n    mod = imp.load_source(module_id, path, fp)\n  File "/usr/lib/python2.7/dist-packages/neutron/db/migration/alembic_migrations/env.py", line 126, in <module>\n    run_migrations_online()\n  File "/usr/lib/python2.7/dist-packages/neutron/db/migration/alembic_migrations/env.py", line 120, in run_migrations_online\n    context.run_migrations()\n  File "<string>", line 8, in run_migrations\n  File "/usr/lib/python2.7/dist-packages/alembic/runtime/environment.py", line 797, in run_migrations\n    self.get_context().run_migrations(**kw)\n  File "/usr/lib/python2.7/dist-packages/alembic/runtime/migration.py", line 303, in run_migrations\n    for step in self._migrations_fn(heads, self):\n  File "/usr/lib/python2.7/dist-packages/neutron/db/migration/cli.py", line 723, in check_sanity\n    revision, rev, implicit_base=True):\n  File "/usr/lib/python2.7/dist-packages/alembic/script/revisio
Sep 28 12:23:18 ctl02 salt-minion[14967]: n.py", line 610, in _iterate_revisions\n    requested_lowers = self.get_revisions(lower)\n  File "/usr/lib/python2.7/dist-packages/alembic/script/revision.py", line 299, in get_revisions\n    return sum([self.get_revisions(id_elem) for id_elem in id_], ())\n  File "/usr/lib/python2.7/dist-packages/alembic/script/revision.py", line 304, in get_revisions\n    for rev_id in resolved_id)\n  File "/usr/lib/python2.7/dist-packages/alembic/script/revision.py", line 304, in <genexpr>\n    for rev_id in resolved_id)\n  File "/usr/lib/python2.7/dist-packages/alembic/script/revision.py", line 359, in _revision_for_ident\n    resolved_id)\nalembic.script.revision.ResolutionError: No such revision or branch \'5c85685d616d\'', 'stdout': ''}
Sep 28 12:23:18 ctl02 salt-minion[14967]: [INFO    ] Completed state [neutron-db-manage --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini upgrade head] at time 12:23:18.628972 duration_in_ms=1118.963
Sep 28 12:23:18 ctl02 salt-minion[14967]: [INFO    ] Running state [/etc/neutron/api-paste.ini] at time 12:23:18.629356
Sep 28 12:23:18 ctl02 salt-minion[14967]: [INFO    ] Executing state file.managed for /etc/neutron/api-paste.ini
Sep 28 12:23:18 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'neutron/files/ocata/api-paste.ini.Debian'
Sep 28 12:23:18 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'neutron/map.jinja'
Sep 28 12:23:18 ctl02 salt-minion[14967]: [INFO    ] File changed:
Sep 28 12:23:18 ctl02 salt-minion[14967]: ---
Sep 28 12:23:18 ctl02 salt-minion[14967]: +++
Sep 28 12:23:18 ctl02 salt-minion[14967]: @@ -1,12 +1,18 @@
Sep 28 12:23:18 ctl02 salt-minion[14967]: +
Sep 28 12:23:18 ctl02 salt-minion[14967]:  [composite:neutron]
Sep 28 12:23:18 ctl02 salt-minion[14967]:  use = egg:Paste#urlmap
Sep 28 12:23:18 ctl02 salt-minion[14967]: -/: neutronversions
Sep 28 12:23:18 ctl02 salt-minion[14967]: +/: neutronversions_composite
Sep 28 12:23:18 ctl02 salt-minion[14967]:  /v2.0: neutronapi_v2_0
Sep 28 12:23:18 ctl02 salt-minion[14967]:  
Sep 28 12:23:18 ctl02 salt-minion[14967]:  [composite:neutronapi_v2_0]
Sep 28 12:23:18 ctl02 salt-minion[14967]:  use = call:neutron.auth:pipeline_factory
Sep 28 12:23:18 ctl02 salt-minion[14967]: -noauth = cors request_id catch_errors extensions neutronapiapp_v2_0
Sep 28 12:23:18 ctl02 salt-minion[14967]: -keystone = cors request_id catch_errors authtoken keystonecontext extensions neutronapiapp_v2_0
Sep 28 12:23:18 ctl02 salt-minion[14967]: +noauth = cors http_proxy_to_wsgi request_id catch_errors extensions neutronapiapp_v2_0
Sep 28 12:23:18 ctl02 salt-minion[14967]: +keystone = cors http_proxy_to_wsgi request_id catch_errors authtoken keystonecontext extensions neutronapiapp_v2_0
Sep 28 12:23:18 ctl02 salt-minion[14967]: +
Sep 28 12:23:18 ctl02 salt-minion[14967]: +[composite:neutronversions_composite]
Sep 28 12:23:18 ctl02 salt-minion[14967]: +use = call:neutron.auth:pipeline_factory
Sep 28 12:23:18 ctl02 salt-minion[14967]: +noauth = cors http_proxy_to_wsgi neutronversions
Sep 28 12:23:18 ctl02 salt-minion[14967]: +keystone = cors http_proxy_to_wsgi neutronversions
Sep 28 12:23:18 ctl02 salt-minion[14967]:  
Sep 28 12:23:18 ctl02 salt-minion[14967]:  [filter:request_id]
Sep 28 12:23:18 ctl02 salt-minion[14967]:  paste.filter_factory = oslo_middleware:RequestId.factory
Sep 28 12:23:18 ctl02 salt-minion[14967]: @@ -17,6 +23,9 @@
Sep 28 12:23:18 ctl02 salt-minion[14967]:  [filter:cors]
Sep 28 12:23:18 ctl02 salt-minion[14967]:  paste.filter_factory = oslo_middleware.cors:filter_factory
Sep 28 12:23:18 ctl02 salt-minion[14967]:  oslo_config_project = neutron
Sep 28 12:23:18 ctl02 salt-minion[14967]: +
Sep 28 12:23:18 ctl02 salt-minion[14967]: +[filter:http_proxy_to_wsgi]
Sep 28 12:23:18 ctl02 salt-minion[14967]: +paste.filter_factory = oslo_middleware.http_proxy_to_wsgi:HTTPProxyToWSGI.factory
Sep 28 12:23:18 ctl02 salt-minion[14967]:  
Sep 28 12:23:18 ctl02 salt-minion[14967]:  [filter:keystonecontext]
Sep 28 12:23:18 ctl02 salt-minion[14967]:  paste.filter_factory = neutron.auth:NeutronKeystoneContext.factory
Sep 28 12:23:18 ctl02 salt-minion[14967]: @@ -32,3 +41,6 @@
Sep 28 12:23:18 ctl02 salt-minion[14967]:  
Sep 28 12:23:18 ctl02 salt-minion[14967]:  [app:neutronapiapp_v2_0]
Sep 28 12:23:18 ctl02 salt-minion[14967]:  paste.app_factory = neutron.api.v2.router:APIRouter.factory
Sep 28 12:23:18 ctl02 salt-minion[14967]: +
Sep 28 12:23:18 ctl02 salt-minion[14967]: +[filter:osprofiler]
Sep 28 12:23:18 ctl02 salt-minion[14967]: +paste.filter_factory = osprofiler.web:WsgiMiddleware.factory
Sep 28 12:23:18 ctl02 salt-minion[14967]: [INFO    ] Completed state [/etc/neutron/api-paste.ini] at time 12:23:18.692303 duration_in_ms=62.946
Sep 28 12:23:18 ctl02 salt-minion[14967]: [INFO    ] Running state [/etc/default/neutron-server] at time 12:23:18.692563
Sep 28 12:23:18 ctl02 salt-minion[14967]: [INFO    ] Executing state file.managed for /etc/default/neutron-server
Sep 28 12:23:18 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'neutron/files/ocata/neutron-server'
Sep 28 12:23:18 ctl02 salt-minion[14967]: [INFO    ] Fetching file from saltenv 'base', ** done ** 'neutron/map.jinja'
Sep 28 12:23:18 ctl02 heat-api-cfn[13300]: 2017-09-28 12:23:18.733 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:23:18] "OPTIONS / HTTP/1.0" 200 134 0.000565
Sep 28 12:23:18 ctl02 salt-minion[14967]: [INFO    ] File changed:
Sep 28 12:23:18 ctl02 salt-minion[14967]: ---
Sep 28 12:23:18 ctl02 salt-minion[14967]: +++
Sep 28 12:23:18 ctl02 salt-minion[14967]: @@ -1,5 +1,8 @@
Sep 28 12:23:18 ctl02 salt-minion[14967]: +# Generated by Salt.
Sep 28 12:23:18 ctl02 salt-minion[14967]: +
Sep 28 12:23:18 ctl02 salt-minion[14967]:  # defaults for neutron-server
Sep 28 12:23:18 ctl02 salt-minion[14967]:  
Sep 28 12:23:18 ctl02 salt-minion[14967]:  # path to config file corresponding to the core_plugin specified in
Sep 28 12:23:18 ctl02 salt-minion[14967]:  # neutron.conf
Sep 28 12:23:18 ctl02 salt-minion[14967]: -NEUTRON_PLUGIN_CONFIG="/etc/neutron/plugins/ml2/ml2_conf.ini"
Sep 28 12:23:18 ctl02 salt-minion[14967]: +#NEUTRON_PLUGIN_CONFIG="/etc/neutron/plugins/openvswitch/ovs_neutron_plugin.ini"
Sep 28 12:23:18 ctl02 salt-minion[14967]: +NEUTRON_PLUGIN_CONFIG="/etc/neutron/plugins/ml2/ml2_conf.ini"
Sep 28 12:23:18 ctl02 salt-minion[14967]: [INFO    ] Completed state [/etc/default/neutron-server] at time 12:23:18.754891 duration_in_ms=62.326
Sep 28 12:23:18 ctl02 salt-minion[14967]: [INFO    ] Running state [neutron-server] at time 12:23:18.755709
Sep 28 12:23:18 ctl02 salt-minion[14967]: [INFO    ] Executing state service.running for neutron-server
Sep 28 12:23:18 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'status', 'neutron-server.service', '-n', '0'] in directory '/root'
Sep 28 12:23:18 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-active', 'neutron-server.service'] in directory '/root'
Sep 28 12:23:18 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-enabled', 'neutron-server.service'] in directory '/root'
Sep 28 12:23:18 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-enabled', 'neutron-server.service'] in directory '/root'
Sep 28 12:23:18 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemd-run', '--scope', 'systemctl', 'start', 'neutron-server.service'] in directory '/root'
Sep 28 12:23:18 ctl02 systemd[1]: Started /bin/systemctl start neutron-server.service.
Sep 28 12:23:18 ctl02 systemd[1]: Starting OpenStack Neutron Server...
Sep 28 12:23:18 ctl02 systemd[1]: Started OpenStack Neutron Server.
Sep 28 12:23:18 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-active', 'neutron-server.service'] in directory '/root'
Sep 28 12:23:18 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-enabled', 'neutron-server.service'] in directory '/root'
Sep 28 12:23:18 ctl02 salt-minion[14967]: [INFO    ] Executing command ['systemctl', 'is-enabled', 'neutron-server.service'] in directory '/root'
Sep 28 12:23:18 ctl02 salt-minion[14967]: [INFO    ] {'neutron-server': True}
Sep 28 12:23:18 ctl02 salt-minion[14967]: [INFO    ] Completed state [neutron-server] at time 12:23:18.876732 duration_in_ms=121.022
Sep 28 12:23:18 ctl02 salt-minion[14967]: [INFO    ] Returning information for job: 20170928122254321820
Sep 28 12:23:19 ctl02 neutron-server[30536]: Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:23:19 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xea9d5508)
Sep 28 12:23:19 ctl02 heat-api-cfn[13300]: 2017-09-28 12:23:19.597 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:23:19] "OPTIONS / HTTP/1.0" 200 134 0.000429
Sep 28 12:23:19 ctl02 neutron-server[30536]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:23:19 ctl02 heat-api[13008]: 2017-09-28 12:23:19.712 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:23:19] "OPTIONS / HTTP/1.0" 200 134 0.000588
Sep 28 12:23:19 ctl02 neutron-server[30536]: 2017-09-28 12:23:19.767 30536 INFO neutron.common.config [-] Logging enabled!
Sep 28 12:23:19 ctl02 neutron-server[30536]: 2017-09-28 12:23:19.767 30536 INFO neutron.common.config [-] /usr/bin/neutron-server version 8.4.0
Sep 28 12:23:19 ctl02 neutron-server[30536]: 2017-09-28 12:23:19.768 30536 INFO neutron.common.config [-] Logging enabled!
Sep 28 12:23:19 ctl02 neutron-server[30536]: 2017-09-28 12:23:19.768 30536 INFO neutron.common.config [-] /usr/bin/neutron-server version 8.4.0
Sep 28 12:23:19 ctl02 neutron-server[30536]: 2017-09-28 12:23:19.777 30536 INFO neutron.manager [-] Loading core plugin: neutron.plugins.ml2.plugin.Ml2Plugin
Sep 28 12:23:19 ctl02 neutron-server[30536]: 2017-09-28 12:23:19.918 30536 INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan']
Sep 28 12:23:19 ctl02 neutron-server[30536]: 2017-09-28 12:23:19.920 30536 INFO neutron.plugins.ml2.drivers.type_flat [-] Arbitrary flat physical_network names allowed
Sep 28 12:23:19 ctl02 neutron-server[30536]: 2017-09-28 12:23:19.922 30536 INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: {'physnet1': []}
Sep 28 12:23:19 ctl02 neutron-server[30536]: 2017-09-28 12:23:19.924 30536 INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete
Sep 28 12:23:19 ctl02 neutron-server[30536]: 2017-09-28 12:23:19.927 30536 INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'vlan', 'gre', 'local', 'vxlan']
Sep 28 12:23:19 ctl02 neutron-server[30536]: 2017-09-28 12:23:19.928 30536 INFO neutron.plugins.ml2.managers [-] Registered types: ['flat', 'vlan', 'local', 'gre', 'vxlan']
Sep 28 12:23:19 ctl02 neutron-server[30536]: 2017-09-28 12:23:19.928 30536 INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['flat', 'vxlan']
Sep 28 12:23:19 ctl02 neutron-server[30536]: 2017-09-28 12:23:19.928 30536 INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security']
Sep 28 12:23:19 ctl02 neutron-server[30536]: 2017-09-28 12:23:19.931 30536 INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security']
Sep 28 12:23:19 ctl02 neutron-server[30536]: 2017-09-28 12:23:19.932 30536 INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security']
Sep 28 12:23:19 ctl02 neutron-server[30536]: 2017-09-28 12:23:19.932 30536 INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch', 'l2population']
Sep 28 12:23:19 ctl02 neutron-server[30536]: 2017-09-28 12:23:19.934 30536 INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch', 'l2population']
Sep 28 12:23:19 ctl02 neutron-server[30536]: 2017-09-28 12:23:19.934 30536 INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch', 'l2population']
Sep 28 12:23:19 ctl02 neutron-server[30536]: 2017-09-28 12:23:19.975 30536 INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat'
Sep 28 12:23:19 ctl02 neutron-server[30536]: 2017-09-28 12:23:19.975 30536 INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete
Sep 28 12:23:19 ctl02 neutron-server[30536]: 2017-09-28 12:23:19.975 30536 INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'vlan'
Sep 28 12:23:20 ctl02 neutron-server[30536]: 2017-09-28 12:23:20.060 30536 INFO neutron.plugins.ml2.drivers.type_vlan [-] VlanTypeDriver initialization complete
Sep 28 12:23:20 ctl02 neutron-server[30536]: 2017-09-28 12:23:20.061 30536 INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'local'
Sep 28 12:23:20 ctl02 neutron-server[30536]: 2017-09-28 12:23:20.061 30536 INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'gre'
Sep 28 12:23:20 ctl02 neutron-server[30536]: 2017-09-28 12:23:20.061 30536 INFO neutron.plugins.ml2.drivers.type_tunnel [-] gre ID ranges: [(2, 65535)]
Sep 28 12:23:20 ctl02 nova-api[30512]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:23:20 ctl02 nova-api[30512]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:23:20 ctl02 heat-api-cfn[13300]: 2017-09-28 12:23:20.177 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:23:20] "OPTIONS / HTTP/1.0" 200 134 0.000455
Sep 28 12:23:20 ctl02 nova-api[30512]: 2017-09-28 12:23:20.231 30512 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:23:20 ctl02 nova-api[30512]: 2017-09-28 12:23:20.232 30512 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:23:20 ctl02 nova-api[30512]: 2017-09-28 12:23:20.232 30512 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:23:20 ctl02 nova-api[30512]: 2017-09-28 12:23:20.232 30512 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:23:20 ctl02 nova-api[30512]: 2017-09-28 12:23:20.232 30512 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:23:20 ctl02 nova-api[30512]: 2017-09-28 12:23:20.232 30512 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:23:20 ctl02 nova-api[30512]: 2017-09-28 12:23:20.232 30512 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:23:20 ctl02 nova-api[30512]: 2017-09-28 12:23:20.232 30512 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:23:20 ctl02 nova-api[30512]: 2017-09-28 12:23:20.232 30512 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:23:20 ctl02 nova-api[30512]: 2017-09-28 12:23:20.232 30512 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:23:20 ctl02 nova-api[30512]: 2017-09-28 12:23:20.232 30512 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:23:20 ctl02 nova-api[30512]: 2017-09-28 12:23:20.232 30512 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:23:20 ctl02 nova-api[30512]: 2017-09-28 12:23:20.232 30512 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:23:20 ctl02 nova-api[30512]: 2017-09-28 12:23:20.232 30512 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:23:20 ctl02 nova-api[30512]: 2017-09-28 12:23:20.232 30512 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:23:20 ctl02 nova-api[30512]: 2017-09-28 12:23:20.232 30512 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:23:20 ctl02 nova-api[30512]: 2017-09-28 12:23:20.232 30512 ERROR nova.wsgi     self.filename))
Sep 28 12:23:20 ctl02 nova-api[30512]: 2017-09-28 12:23:20.232 30512 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:23:20 ctl02 nova-api[30512]: 2017-09-28 12:23:20.232 30512 ERROR nova.wsgi
Sep 28 12:23:20 ctl02 nova-api[30512]: 2017-09-28 12:23:20.233 30512 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:23:20 ctl02 nova-api[30512]: 2017-09-28 12:23:20.361 30512 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:23:20 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:23:20 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:23:20 ctl02 nova-api[30512]: 2017-09-28 12:23:20.588 30512 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:23:20 ctl02 nova-api[30512]: 2017-09-28 12:23:20.590 30512 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:23:20 ctl02 nova-api[30512]: 2017-09-28 12:23:20.590 30512 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:23:20 ctl02 nova-api[30512]: 2017-09-28 12:23:20.591 30512 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:23:20 ctl02 nova-api[30512]: 2017-09-28 12:23:20.723 30512 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:23:20 ctl02 nova-api[30512]: 2017-09-28 12:23:20.725 30512 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:23:20 ctl02 nova-api[30512]: 2017-09-28 12:23:20.725 30512 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:23:20 ctl02 nova-api[30512]: 2017-09-28 12:23:20.725 30512 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:23:20 ctl02 nova-api[30512]: 2017-09-28 12:23:20.728 30512 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:23:20 ctl02 nova-api[30512]: 2017-09-28 12:23:20.729 30512 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:23:20 ctl02 nova-api[30512]: 2017-09-28 12:23:20.729 30512 ERROR nova Traceback (most recent call last):
Sep 28 12:23:20 ctl02 nova-api[30512]: 2017-09-28 12:23:20.729 30512 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:23:20 ctl02 nova-api[30512]: 2017-09-28 12:23:20.729 30512 ERROR nova     sys.exit(main())
Sep 28 12:23:20 ctl02 nova-api[30512]: 2017-09-28 12:23:20.729 30512 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:23:20 ctl02 nova-api[30512]: 2017-09-28 12:23:20.729 30512 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:23:20 ctl02 nova-api[30512]: 2017-09-28 12:23:20.729 30512 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:23:20 ctl02 nova-api[30512]: 2017-09-28 12:23:20.729 30512 ERROR nova     max_url_len=max_url_len)
Sep 28 12:23:20 ctl02 nova-api[30512]: 2017-09-28 12:23:20.729 30512 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:23:20 ctl02 nova-api[30512]: 2017-09-28 12:23:20.729 30512 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:23:20 ctl02 nova-api[30512]: 2017-09-28 12:23:20.729 30512 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:23:20 ctl02 nova-api[30512]: 2017-09-28 12:23:20.729 30512 ERROR nova     sock.listen(backlog)
Sep 28 12:23:20 ctl02 nova-api[30512]: 2017-09-28 12:23:20.729 30512 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:23:20 ctl02 nova-api[30512]: 2017-09-28 12:23:20.729 30512 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:23:20 ctl02 nova-api[30512]: 2017-09-28 12:23:20.729 30512 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:23:20 ctl02 nova-api[30512]: 2017-09-28 12:23:20.729 30512 ERROR nova
Sep 28 12:23:20 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:23:20 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:23:20 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:23:21 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:23:21 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:23:21 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:23:21 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:23:21 ctl02 glance-api[29183]: 2017-09-28 12:23:21.471 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:23:21] "OPTIONS / HTTP/1.0" 200 134 0.001014
Sep 28 12:23:21 ctl02 neutron-server[30536]: 2017-09-28 12:23:21.900 30536 INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'vxlan'
Sep 28 12:23:21 ctl02 neutron-server[30536]: 2017-09-28 12:23:21.927 30536 INFO neutron.plugins.ml2.drivers.type_tunnel [-] vxlan ID ranges: [(2, 65535)]
Sep 28 12:23:22 ctl02 glance-api[29183]: 2017-09-28 12:23:22.255 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:23:22] "OPTIONS / HTTP/1.0" 200 134 0.000624
Sep 28 12:23:22 ctl02 nova-api[30567]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:23:22 ctl02 nova-api[30567]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:23:22 ctl02 nova-api[30567]: 2017-09-28 12:23:22.991 30567 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:23:22 ctl02 nova-api[30567]: 2017-09-28 12:23:22.992 30567 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:23:22 ctl02 nova-api[30567]: 2017-09-28 12:23:22.992 30567 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:23:22 ctl02 nova-api[30567]: 2017-09-28 12:23:22.992 30567 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:23:22 ctl02 nova-api[30567]: 2017-09-28 12:23:22.992 30567 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:23:22 ctl02 nova-api[30567]: 2017-09-28 12:23:22.992 30567 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:23:22 ctl02 nova-api[30567]: 2017-09-28 12:23:22.992 30567 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:23:22 ctl02 nova-api[30567]: 2017-09-28 12:23:22.992 30567 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:23:22 ctl02 nova-api[30567]: 2017-09-28 12:23:22.992 30567 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:23:22 ctl02 nova-api[30567]: 2017-09-28 12:23:22.992 30567 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:23:22 ctl02 nova-api[30567]: 2017-09-28 12:23:22.992 30567 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:23:22 ctl02 nova-api[30567]: 2017-09-28 12:23:22.992 30567 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:23:22 ctl02 nova-api[30567]: 2017-09-28 12:23:22.992 30567 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:23:22 ctl02 nova-api[30567]: 2017-09-28 12:23:22.992 30567 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:23:22 ctl02 nova-api[30567]: 2017-09-28 12:23:22.992 30567 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:23:22 ctl02 nova-api[30567]: 2017-09-28 12:23:22.992 30567 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:23:22 ctl02 nova-api[30567]: 2017-09-28 12:23:22.992 30567 ERROR nova.wsgi     self.filename))
Sep 28 12:23:22 ctl02 nova-api[30567]: 2017-09-28 12:23:22.992 30567 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:23:22 ctl02 nova-api[30567]: 2017-09-28 12:23:22.992 30567 ERROR nova.wsgi
Sep 28 12:23:22 ctl02 nova-api[30567]: 2017-09-28 12:23:22.993 30567 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:23:23 ctl02 nova-api[30567]: 2017-09-28 12:23:23.133 30567 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:23:23 ctl02 nova-api[30567]: 2017-09-28 12:23:23.363 30567 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:23:23 ctl02 nova-api[30567]: 2017-09-28 12:23:23.366 30567 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:23:23 ctl02 nova-api[30567]: 2017-09-28 12:23:23.366 30567 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:23:23 ctl02 nova-api[30567]: 2017-09-28 12:23:23.366 30567 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:23:23 ctl02 neutron-server[30536]: 2017-09-28 12:23:23.437 30536 INFO neutron.plugins.ml2.managers [-] Initializing extension driver 'port_security'
Sep 28 12:23:23 ctl02 neutron-server[30536]: 2017-09-28 12:23:23.437 30536 INFO neutron.plugins.ml2.extensions.port_security [-] PortSecurityExtensionDriver initialization complete
Sep 28 12:23:23 ctl02 neutron-server[30536]: 2017-09-28 12:23:23.438 30536 INFO neutron.plugins.ml2.managers [-] Initializing mechanism driver 'openvswitch'
Sep 28 12:23:23 ctl02 neutron-server[30536]: 2017-09-28 12:23:23.438 30536 INFO neutron.plugins.ml2.managers [-] Initializing mechanism driver 'l2population'
Sep 28 12:23:23 ctl02 neutron-server[30536]: 2017-09-28 12:23:23.439 30536 INFO neutron.plugins.ml2.plugin [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Modular L2 Plugin initialization complete
Sep 28 12:23:23 ctl02 neutron-server[30536]: 2017-09-28 12:23:23.440 30536 INFO neutron.plugins.ml2.managers [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Got port-security extension from driver 'port_security'
Sep 28 12:23:23 ctl02 neutron-server[30536]: 2017-09-28 12:23:23.440 30536 INFO neutron.extensions.vlantransparent [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Disabled vlantransparent extension.
Sep 28 12:23:23 ctl02 neutron-server[30536]: 2017-09-28 12:23:23.440 30536 INFO neutron.manager [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Loading Plugin: router
Sep 28 12:23:23 ctl02 nova-api[30567]: 2017-09-28 12:23:23.498 30567 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:23:23 ctl02 nova-api[30567]: 2017-09-28 12:23:23.500 30567 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:23:23 ctl02 nova-api[30567]: 2017-09-28 12:23:23.500 30567 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:23:23 ctl02 nova-api[30567]: 2017-09-28 12:23:23.500 30567 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:23:23 ctl02 nova-api[30567]: 2017-09-28 12:23:23.503 30567 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:23:23 ctl02 nova-api[30567]: 2017-09-28 12:23:23.504 30567 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:23:23 ctl02 nova-api[30567]: 2017-09-28 12:23:23.504 30567 ERROR nova Traceback (most recent call last):
Sep 28 12:23:23 ctl02 nova-api[30567]: 2017-09-28 12:23:23.504 30567 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:23:23 ctl02 nova-api[30567]: 2017-09-28 12:23:23.504 30567 ERROR nova     sys.exit(main())
Sep 28 12:23:23 ctl02 nova-api[30567]: 2017-09-28 12:23:23.504 30567 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:23:23 ctl02 nova-api[30567]: 2017-09-28 12:23:23.504 30567 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:23:23 ctl02 nova-api[30567]: 2017-09-28 12:23:23.504 30567 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:23:23 ctl02 nova-api[30567]: 2017-09-28 12:23:23.504 30567 ERROR nova     max_url_len=max_url_len)
Sep 28 12:23:23 ctl02 nova-api[30567]: 2017-09-28 12:23:23.504 30567 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:23:23 ctl02 nova-api[30567]: 2017-09-28 12:23:23.504 30567 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:23:23 ctl02 nova-api[30567]: 2017-09-28 12:23:23.504 30567 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:23:23 ctl02 nova-api[30567]: 2017-09-28 12:23:23.504 30567 ERROR nova     sock.listen(backlog)
Sep 28 12:23:23 ctl02 nova-api[30567]: 2017-09-28 12:23:23.504 30567 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:23:23 ctl02 nova-api[30567]: 2017-09-28 12:23:23.504 30567 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:23:23 ctl02 nova-api[30567]: 2017-09-28 12:23:23.504 30567 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:23:23 ctl02 nova-api[30567]: 2017-09-28 12:23:23.504 30567 ERROR nova
Sep 28 12:23:23 ctl02 neutron-server[30536]: 2017-09-28 12:23:23.504 30536 INFO neutron.manager [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Loading Plugin: metering
Sep 28 12:23:23 ctl02 neutron-server[30536]: 2017-09-28 12:23:23.598 30536 INFO neutron.manager [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Loading Plugin: auto_allocate
Sep 28 12:23:23 ctl02 neutron-server[30536]: 2017-09-28 12:23:23.601 30536 INFO neutron.manager [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Loading Plugin: tag
Sep 28 12:23:23 ctl02 neutron-server[30536]: 2017-09-28 12:23:23.603 30536 INFO neutron.manager [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Loading Plugin: timestamp_core
Sep 28 12:23:23 ctl02 neutron-server[30536]: 2017-09-28 12:23:23.604 30536 INFO neutron.manager [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Loading Plugin: network_ip_availability
Sep 28 12:23:23 ctl02 neutron-server[30536]: 2017-09-28 12:23:23.637 30536 INFO neutron.api.extensions [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Initializing extension manager.
Sep 28 12:23:23 ctl02 neutron-server[30536]: 2017-09-28 12:23:23.638 30536 INFO neutron.api.extensions [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Loaded extension: address-scope
Sep 28 12:23:23 ctl02 neutron-server[30536]: 2017-09-28 12:23:23.638 30536 INFO neutron.api.extensions [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Loaded extension: agent
Sep 28 12:23:23 ctl02 neutron-server[30536]: 2017-09-28 12:23:23.639 30536 INFO neutron.api.extensions [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Loaded extension: allowed-address-pairs
Sep 28 12:23:23 ctl02 neutron-server[30536]: 2017-09-28 12:23:23.640 30536 INFO neutron.api.extensions [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Loaded extension: auto-allocated-topology
Sep 28 12:23:23 ctl02 neutron-server[30536]: 2017-09-28 12:23:23.640 30536 INFO neutron.api.extensions [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Loaded extension: availability_zone
Sep 28 12:23:23 ctl02 neutron-server[30536]: 2017-09-28 12:23:23.641 30536 WARNING neutron.api.extensions [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Extension bgp not supported by any of loaded plugins
Sep 28 12:23:23 ctl02 neutron-server[30536]: 2017-09-28 12:23:23.642 30536 WARNING neutron.api.extensions [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Extension bgp_dragent_scheduler not supported by any of loaded plugins
Sep 28 12:23:23 ctl02 neutron-server[30536]: 2017-09-28 12:23:23.643 30536 INFO neutron.api.extensions [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Loaded extension: default-subnetpools
Sep 28 12:23:23 ctl02 neutron-server[30536]: 2017-09-28 12:23:23.643 30536 INFO neutron.api.extensions [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Loaded extension: dhcp_agent_scheduler
Sep 28 12:23:23 ctl02 neutron-server[30536]: 2017-09-28 12:23:23.644 30536 WARNING neutron.api.extensions [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Extension dns-integration not supported by any of loaded plugins
Sep 28 12:23:23 ctl02 neutron-server[30536]: 2017-09-28 12:23:23.645 30536 INFO neutron.api.extensions [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Loaded extension: dvr
Sep 28 12:23:23 ctl02 neutron-server[30536]: 2017-09-28 12:23:23.645 30536 INFO neutron.api.extensions [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Loaded extension: external-net
Sep 28 12:23:23 ctl02 neutron-server[30536]: 2017-09-28 12:23:23.646 30536 INFO neutron.api.extensions [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Loaded extension: extra_dhcp_opt
Sep 28 12:23:23 ctl02 neutron-server[30536]: 2017-09-28 12:23:23.646 30536 INFO neutron.api.extensions [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Loaded extension: extraroute
Sep 28 12:23:23 ctl02 neutron-server[30536]: 2017-09-28 12:23:23.647 30536 WARNING neutron.api.extensions [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Extension flavors not supported by any of loaded plugins
Sep 28 12:23:23 ctl02 neutron-server[30536]: 2017-09-28 12:23:23.648 30536 INFO neutron.api.extensions [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Loaded extension: router
Sep 28 12:23:23 ctl02 neutron-server[30536]: 2017-09-28 12:23:23.648 30536 INFO neutron.api.extensions [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Loaded extension: ext-gw-mode
Sep 28 12:23:23 ctl02 neutron-server[30536]: 2017-09-28 12:23:23.649 30536 INFO neutron.api.extensions [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Loaded extension: l3-ha
Sep 28 12:23:23 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:23:23 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:23:23 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:23:23 ctl02 neutron-server[30536]: 2017-09-28 12:23:23.650 30536 INFO neutron.api.extensions [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Loaded extension: l3_agent_scheduler
Sep 28 12:23:23 ctl02 neutron-server[30536]: 2017-09-28 12:23:23.651 30536 INFO neutron.api.extensions [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Loaded extension: metering
Sep 28 12:23:23 ctl02 neutron-server[30536]: 2017-09-28 12:23:23.651 30536 INFO neutron.api.extensions [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Loaded extension: multi-provider
Sep 28 12:23:23 ctl02 neutron-server[30536]: 2017-09-28 12:23:23.652 30536 INFO neutron.api.extensions [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Loaded extension: net-mtu
Sep 28 12:23:23 ctl02 neutron-server[30536]: 2017-09-28 12:23:23.652 30536 INFO neutron.api.extensions [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Loaded extension: network_availability_zone
Sep 28 12:23:23 ctl02 neutron-server[30536]: 2017-09-28 12:23:23.653 30536 INFO neutron.api.extensions [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Loaded extension: network-ip-availability
Sep 28 12:23:23 ctl02 neutron-server[30536]: 2017-09-28 12:23:23.653 30536 INFO neutron.api.extensions [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Loaded extension: binding
Sep 28 12:23:23 ctl02 neutron-server[30536]: 2017-09-28 12:23:23.654 30536 INFO neutron.api.extensions [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Loaded extension: port-security
Sep 28 12:23:23 ctl02 neutron-server[30536]: 2017-09-28 12:23:23.654 30536 INFO neutron.api.extensions [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Loaded extension: provider
Sep 28 12:23:23 ctl02 neutron-server[30536]: 2017-09-28 12:23:23.655 30536 WARNING neutron.api.extensions [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Extension qos not supported by any of loaded plugins
Sep 28 12:23:23 ctl02 neutron-server[30536]: 2017-09-28 12:23:23.655 30536 INFO neutron.api.extensions [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Loaded extension: quotas
Sep 28 12:23:23 ctl02 neutron-server[30536]: 2017-09-28 12:23:23.656 30536 INFO neutron.api.extensions [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Loaded extension: rbac-policies
Sep 28 12:23:23 ctl02 neutron-server[30536]: 2017-09-28 12:23:23.657 30536 INFO neutron.api.extensions [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Loaded extension: router_availability_zone
Sep 28 12:23:23 ctl02 neutron-server[30536]: 2017-09-28 12:23:23.657 30536 WARNING neutron.api.extensions [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Extension router-service-type not supported by any of loaded plugins
Sep 28 12:23:23 ctl02 neutron-server[30536]: 2017-09-28 12:23:23.658 30536 INFO neutron.api.extensions [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Loaded extension: security-group
Sep 28 12:23:23 ctl02 neutron-server[30536]: 2017-09-28 12:23:23.659 30536 WARNING neutron.api.extensions [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Extension service-type not supported by any of loaded plugins
Sep 28 12:23:23 ctl02 neutron-server[30536]: 2017-09-28 12:23:23.659 30536 INFO neutron.api.extensions [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Loaded extension: standard-attr-description
Sep 28 12:23:23 ctl02 neutron-server[30536]: 2017-09-28 12:23:23.660 30536 INFO neutron.api.extensions [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Loaded extension: subnet_allocation
Sep 28 12:23:23 ctl02 neutron-server[30536]: 2017-09-28 12:23:23.661 30536 INFO neutron.api.extensions [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Loaded extension: tag
Sep 28 12:23:23 ctl02 neutron-server[30536]: 2017-09-28 12:23:23.661 30536 INFO neutron.api.extensions [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Loaded extension: timestamp_core
Sep 28 12:23:23 ctl02 neutron-server[30536]: 2017-09-28 12:23:23.662 30536 WARNING neutron.api.extensions [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Extension vlan-transparent not supported by any of loaded plugins
Sep 28 12:23:23 ctl02 neutron-server[30536]: 2017-09-28 12:23:23.693 30536 INFO neutron.quota.resource_registry [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Creating instance of TrackedResource for resource:subnet
Sep 28 12:23:23 ctl02 neutron-server[30536]: 2017-09-28 12:23:23.723 30536 INFO neutron.quota.resource_registry [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Creating instance of TrackedResource for resource:subnetpool
Sep 28 12:23:23 ctl02 neutron-server[30536]: 2017-09-28 12:23:23.753 30536 INFO neutron.quota.resource_registry [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Creating instance of TrackedResource for resource:network
Sep 28 12:23:23 ctl02 neutron-server[30536]: 2017-09-28 12:23:23.782 30536 INFO neutron.quota.resource_registry [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Creating instance of TrackedResource for resource:port
Sep 28 12:23:23 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:23:23 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:23:23 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:23:23 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:23:24 ctl02 neutron-server[30536]: 2017-09-28 12:23:24.014 30536 INFO neutron.quota.resource_registry [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Creating instance of TrackedResource for resource:router
Sep 28 12:23:24 ctl02 glance-api[29183]: 2017-09-28 12:23:24.042 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:23:24] "OPTIONS / HTTP/1.0" 200 134 0.000522
Sep 28 12:23:24 ctl02 neutron-server[30536]: 2017-09-28 12:23:24.046 30536 INFO neutron.quota.resource_registry [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Creating instance of TrackedResource for resource:floatingip
Sep 28 12:23:24 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:23:24.075 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:23:24] "OPTIONS / HTTP/1.0" 200 134 0.000361
Sep 28 12:23:24 ctl02 neutron-server[30536]: 2017-09-28 12:23:24.077 30536 INFO neutron.quota.resource_registry [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Creating instance of TrackedResource for resource:security_group
Sep 28 12:23:24 ctl02 neutron-server[30536]: 2017-09-28 12:23:24.108 30536 INFO neutron.quota.resource_registry [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Creating instance of TrackedResource for resource:security_group_rule
Sep 28 12:23:24 ctl02 neutron-server[30536]: 2017-09-28 12:23:24.141 30536 INFO neutron.quota.resource_registry [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Creating instance of CountableResource for resource:rbac_policy
Sep 28 12:23:24 ctl02 neutron-server[30536]: 2017-09-28 12:23:24.193 30536 INFO oslo_service.service [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Starting 4 workers
Sep 28 12:23:24 ctl02 neutron-server[30536]: 2017-09-28 12:23:24.202 30594 INFO neutron.wsgi [-] (30594) wsgi starting up on http://10.167.4.12:9696
Sep 28 12:23:24 ctl02 neutron-server[30536]: 2017-09-28 12:23:24.205 30536 INFO neutron.service [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Neutron service started, listening on 10.167.4.12:9696
Sep 28 12:23:24 ctl02 neutron-server[30536]: 2017-09-28 12:23:24.206 30596 INFO neutron.wsgi [-] (30596) wsgi starting up on http://10.167.4.12:9696
Sep 28 12:23:24 ctl02 neutron-server[30536]: 2017-09-28 12:23:24.208 30536 INFO oslo_service.service [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Starting 4 workers
Sep 28 12:23:24 ctl02 neutron-server[30536]: 2017-09-28 12:23:24.208 30595 INFO neutron.wsgi [-] (30595) wsgi starting up on http://10.167.4.12:9696
Sep 28 12:23:24 ctl02 neutron-server[30536]: 2017-09-28 12:23:24.210 30597 INFO neutron.wsgi [-] (30597) wsgi starting up on http://10.167.4.12:9696
Sep 28 12:23:24 ctl02 neutron-server[30536]: 2017-09-28 12:23:24.223 30536 INFO oslo_service.service [req-c652e6c6-60cf-4b47-8820-d3117c29a633 - - - - -] Starting 4 workers
Sep 28 12:23:24 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:23:24.515 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:23:24] "OPTIONS / HTTP/1.0" 200 134 0.000376
Sep 28 12:23:25 ctl02 heat-api[13008]: 2017-09-28 12:23:25.330 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:23:25] "OPTIONS / HTTP/1.0" 200 134 0.000512
Sep 28 12:23:25 ctl02 nova-api[30585]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:23:25 ctl02 nova-api[30585]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:23:25 ctl02 nova-api[30585]: 2017-09-28 12:23:25.753 30585 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:23:25 ctl02 nova-api[30585]: 2017-09-28 12:23:25.754 30585 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:23:25 ctl02 nova-api[30585]: 2017-09-28 12:23:25.754 30585 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:23:25 ctl02 nova-api[30585]: 2017-09-28 12:23:25.754 30585 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:23:25 ctl02 nova-api[30585]: 2017-09-28 12:23:25.754 30585 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:23:25 ctl02 nova-api[30585]: 2017-09-28 12:23:25.754 30585 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:23:25 ctl02 nova-api[30585]: 2017-09-28 12:23:25.754 30585 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:23:25 ctl02 nova-api[30585]: 2017-09-28 12:23:25.754 30585 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:23:25 ctl02 nova-api[30585]: 2017-09-28 12:23:25.754 30585 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:23:25 ctl02 nova-api[30585]: 2017-09-28 12:23:25.754 30585 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:23:25 ctl02 nova-api[30585]: 2017-09-28 12:23:25.754 30585 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:23:25 ctl02 nova-api[30585]: 2017-09-28 12:23:25.754 30585 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:23:25 ctl02 nova-api[30585]: 2017-09-28 12:23:25.754 30585 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:23:25 ctl02 nova-api[30585]: 2017-09-28 12:23:25.754 30585 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:23:25 ctl02 nova-api[30585]: 2017-09-28 12:23:25.754 30585 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:23:25 ctl02 nova-api[30585]: 2017-09-28 12:23:25.754 30585 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:23:25 ctl02 nova-api[30585]: 2017-09-28 12:23:25.754 30585 ERROR nova.wsgi     self.filename))
Sep 28 12:23:25 ctl02 nova-api[30585]: 2017-09-28 12:23:25.754 30585 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:23:25 ctl02 nova-api[30585]: 2017-09-28 12:23:25.754 30585 ERROR nova.wsgi
Sep 28 12:23:25 ctl02 nova-api[30585]: 2017-09-28 12:23:25.755 30585 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:23:25 ctl02 nova-api[30585]: 2017-09-28 12:23:25.884 30585 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:23:26 ctl02 nova-api[30585]: 2017-09-28 12:23:26.108 30585 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:23:26 ctl02 nova-api[30585]: 2017-09-28 12:23:26.110 30585 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:23:26 ctl02 nova-api[30585]: 2017-09-28 12:23:26.111 30585 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:23:26 ctl02 nova-api[30585]: 2017-09-28 12:23:26.111 30585 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:23:26 ctl02 neutron-server[30536]: 2017-09-28 12:23:26.187 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:23:26] "OPTIONS / HTTP/1.0" 200 262 0.001827
Sep 28 12:23:26 ctl02 nova-api[30585]: 2017-09-28 12:23:26.242 30585 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:23:26 ctl02 nova-api[30585]: 2017-09-28 12:23:26.244 30585 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:23:26 ctl02 nova-api[30585]: 2017-09-28 12:23:26.244 30585 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:23:26 ctl02 nova-api[30585]: 2017-09-28 12:23:26.245 30585 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:23:26 ctl02 nova-api[30585]: 2017-09-28 12:23:26.250 30585 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:23:26 ctl02 nova-api[30585]: 2017-09-28 12:23:26.250 30585 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:23:26 ctl02 nova-api[30585]: 2017-09-28 12:23:26.250 30585 ERROR nova Traceback (most recent call last):
Sep 28 12:23:26 ctl02 nova-api[30585]: 2017-09-28 12:23:26.250 30585 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:23:26 ctl02 nova-api[30585]: 2017-09-28 12:23:26.250 30585 ERROR nova     sys.exit(main())
Sep 28 12:23:26 ctl02 nova-api[30585]: 2017-09-28 12:23:26.250 30585 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:23:26 ctl02 nova-api[30585]: 2017-09-28 12:23:26.250 30585 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:23:26 ctl02 nova-api[30585]: 2017-09-28 12:23:26.250 30585 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:23:26 ctl02 nova-api[30585]: 2017-09-28 12:23:26.250 30585 ERROR nova     max_url_len=max_url_len)
Sep 28 12:23:26 ctl02 nova-api[30585]: 2017-09-28 12:23:26.250 30585 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:23:26 ctl02 nova-api[30585]: 2017-09-28 12:23:26.250 30585 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:23:26 ctl02 nova-api[30585]: 2017-09-28 12:23:26.250 30585 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:23:26 ctl02 nova-api[30585]: 2017-09-28 12:23:26.250 30585 ERROR nova     sock.listen(backlog)
Sep 28 12:23:26 ctl02 nova-api[30585]: 2017-09-28 12:23:26.250 30585 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:23:26 ctl02 nova-api[30585]: 2017-09-28 12:23:26.250 30585 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:23:26 ctl02 nova-api[30585]: 2017-09-28 12:23:26.250 30585 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:23:26 ctl02 nova-api[30585]: 2017-09-28 12:23:26.250 30585 ERROR nova
Sep 28 12:23:26 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:23:26 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:23:26 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:23:26 ctl02 neutron-server[30536]: 2017-09-28 12:23:26.455 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:23:26] "OPTIONS / HTTP/1.0" 200 262 0.001862
Sep 28 12:23:26 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:23:26 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:23:26 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:23:26 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:23:27 ctl02 neutron-server[30536]: 2017-09-28 12:23:27.065 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:23:27] "OPTIONS / HTTP/1.0" 200 262 0.002102
Sep 28 12:23:27 ctl02 heat-api[13008]: 2017-09-28 12:23:27.187 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:23:27] "OPTIONS / HTTP/1.0" 200 134 0.000932
Sep 28 12:23:28 ctl02 neutron-server[30536]: 2017-09-28 12:23:28.233 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:23:28] "OPTIONS / HTTP/1.0" 200 262 0.000609
Sep 28 12:23:28 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:23:28.237 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:23:28] "OPTIONS / HTTP/1.0" 200 134 0.000497
Sep 28 12:23:28 ctl02 heat-api-cfn[13300]: 2017-09-28 12:23:28.338 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:23:28] "OPTIONS / HTTP/1.0" 200 134 0.000562
Sep 28 12:23:28 ctl02 nova-api[30615]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:23:28 ctl02 nova-api[30615]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:23:28 ctl02 neutron-server[30536]: 2017-09-28 12:23:28.531 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:23:28] "OPTIONS / HTTP/1.0" 200 262 0.000597
Sep 28 12:23:28 ctl02 nova-api[30615]: 2017-09-28 12:23:28.540 30615 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:23:28 ctl02 nova-api[30615]: 2017-09-28 12:23:28.542 30615 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:23:28 ctl02 nova-api[30615]: 2017-09-28 12:23:28.542 30615 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:23:28 ctl02 nova-api[30615]: 2017-09-28 12:23:28.542 30615 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:23:28 ctl02 nova-api[30615]: 2017-09-28 12:23:28.542 30615 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:23:28 ctl02 nova-api[30615]: 2017-09-28 12:23:28.542 30615 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:23:28 ctl02 nova-api[30615]: 2017-09-28 12:23:28.542 30615 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:23:28 ctl02 nova-api[30615]: 2017-09-28 12:23:28.542 30615 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:23:28 ctl02 nova-api[30615]: 2017-09-28 12:23:28.542 30615 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:23:28 ctl02 nova-api[30615]: 2017-09-28 12:23:28.542 30615 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:23:28 ctl02 nova-api[30615]: 2017-09-28 12:23:28.542 30615 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:23:28 ctl02 nova-api[30615]: 2017-09-28 12:23:28.542 30615 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:23:28 ctl02 nova-api[30615]: 2017-09-28 12:23:28.542 30615 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:23:28 ctl02 nova-api[30615]: 2017-09-28 12:23:28.542 30615 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:23:28 ctl02 nova-api[30615]: 2017-09-28 12:23:28.542 30615 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:23:28 ctl02 nova-api[30615]: 2017-09-28 12:23:28.542 30615 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:23:28 ctl02 nova-api[30615]: 2017-09-28 12:23:28.542 30615 ERROR nova.wsgi     self.filename))
Sep 28 12:23:28 ctl02 nova-api[30615]: 2017-09-28 12:23:28.542 30615 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:23:28 ctl02 nova-api[30615]: 2017-09-28 12:23:28.542 30615 ERROR nova.wsgi
Sep 28 12:23:28 ctl02 nova-api[30615]: 2017-09-28 12:23:28.544 30615 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:23:28 ctl02 nova-api[30615]: 2017-09-28 12:23:28.674 30615 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:23:28 ctl02 nova-api[30615]: 2017-09-28 12:23:28.898 30615 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:23:28 ctl02 nova-api[30615]: 2017-09-28 12:23:28.902 30615 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:23:28 ctl02 nova-api[30615]: 2017-09-28 12:23:28.902 30615 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:23:28 ctl02 nova-api[30615]: 2017-09-28 12:23:28.903 30615 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:23:29 ctl02 nova-api[30615]: 2017-09-28 12:23:29.053 30615 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:23:29 ctl02 nova-api[30615]: 2017-09-28 12:23:29.055 30615 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:23:29 ctl02 nova-api[30615]: 2017-09-28 12:23:29.055 30615 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:23:29 ctl02 nova-api[30615]: 2017-09-28 12:23:29.055 30615 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:23:29 ctl02 nova-api[30615]: 2017-09-28 12:23:29.059 30615 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:23:29 ctl02 nova-api[30615]: 2017-09-28 12:23:29.059 30615 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:23:29 ctl02 nova-api[30615]: 2017-09-28 12:23:29.059 30615 ERROR nova Traceback (most recent call last):
Sep 28 12:23:29 ctl02 nova-api[30615]: 2017-09-28 12:23:29.059 30615 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:23:29 ctl02 nova-api[30615]: 2017-09-28 12:23:29.059 30615 ERROR nova     sys.exit(main())
Sep 28 12:23:29 ctl02 nova-api[30615]: 2017-09-28 12:23:29.059 30615 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:23:29 ctl02 nova-api[30615]: 2017-09-28 12:23:29.059 30615 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:23:29 ctl02 nova-api[30615]: 2017-09-28 12:23:29.059 30615 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:23:29 ctl02 nova-api[30615]: 2017-09-28 12:23:29.059 30615 ERROR nova     max_url_len=max_url_len)
Sep 28 12:23:29 ctl02 nova-api[30615]: 2017-09-28 12:23:29.059 30615 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:23:29 ctl02 nova-api[30615]: 2017-09-28 12:23:29.059 30615 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:23:29 ctl02 nova-api[30615]: 2017-09-28 12:23:29.059 30615 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:23:29 ctl02 nova-api[30615]: 2017-09-28 12:23:29.059 30615 ERROR nova     sock.listen(backlog)
Sep 28 12:23:29 ctl02 nova-api[30615]: 2017-09-28 12:23:29.059 30615 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:23:29 ctl02 nova-api[30615]: 2017-09-28 12:23:29.059 30615 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:23:29 ctl02 nova-api[30615]: 2017-09-28 12:23:29.059 30615 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:23:29 ctl02 nova-api[30615]: 2017-09-28 12:23:29.059 30615 ERROR nova
Sep 28 12:23:29 ctl02 neutron-server[30536]: 2017-09-28 12:23:29.091 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:23:29] "OPTIONS / HTTP/1.0" 200 262 0.000630
Sep 28 12:23:29 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:23:29 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:23:29 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:23:29 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:23:29 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:23:29 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:23:29 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:23:29 ctl02 heat-api-cfn[13300]: 2017-09-28 12:23:29.414 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:23:29] "OPTIONS / HTTP/1.0" 200 134 0.000555
Sep 28 12:23:29 ctl02 heat-api[13008]: 2017-09-28 12:23:29.490 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:23:29] "OPTIONS / HTTP/1.0" 200 134 0.000623
Sep 28 12:23:30 ctl02 neutron-server[30536]: 2017-09-28 12:23:30.176 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:23:30] "OPTIONS / HTTP/1.0" 200 262 0.000609
Sep 28 12:23:30 ctl02 heat-api-cfn[13300]: 2017-09-28 12:23:30.458 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:23:30] "OPTIONS / HTTP/1.0" 200 134 0.000598
Sep 28 12:23:30 ctl02 neutron-server[30536]: 2017-09-28 12:23:30.523 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:23:30] "OPTIONS / HTTP/1.0" 200 262 0.000566
Sep 28 12:23:31 ctl02 nova-api[30632]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:23:31 ctl02 nova-api[30632]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:23:31 ctl02 glance-api[29183]: 2017-09-28 12:23:31.093 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:23:31] "OPTIONS / HTTP/1.0" 200 134 0.000881
Sep 28 12:23:31 ctl02 neutron-server[30536]: 2017-09-28 12:23:31.141 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:23:31] "OPTIONS / HTTP/1.0" 200 262 0.000625
Sep 28 12:23:31 ctl02 nova-api[30632]: 2017-09-28 12:23:31.240 30632 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:23:31 ctl02 nova-api[30632]: 2017-09-28 12:23:31.241 30632 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:23:31 ctl02 nova-api[30632]: 2017-09-28 12:23:31.241 30632 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:23:31 ctl02 nova-api[30632]: 2017-09-28 12:23:31.241 30632 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:23:31 ctl02 nova-api[30632]: 2017-09-28 12:23:31.241 30632 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:23:31 ctl02 nova-api[30632]: 2017-09-28 12:23:31.241 30632 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:23:31 ctl02 nova-api[30632]: 2017-09-28 12:23:31.241 30632 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:23:31 ctl02 nova-api[30632]: 2017-09-28 12:23:31.241 30632 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:23:31 ctl02 nova-api[30632]: 2017-09-28 12:23:31.241 30632 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:23:31 ctl02 nova-api[30632]: 2017-09-28 12:23:31.241 30632 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:23:31 ctl02 nova-api[30632]: 2017-09-28 12:23:31.241 30632 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:23:31 ctl02 nova-api[30632]: 2017-09-28 12:23:31.241 30632 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:23:31 ctl02 nova-api[30632]: 2017-09-28 12:23:31.241 30632 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:23:31 ctl02 nova-api[30632]: 2017-09-28 12:23:31.241 30632 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:23:31 ctl02 nova-api[30632]: 2017-09-28 12:23:31.241 30632 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:23:31 ctl02 nova-api[30632]: 2017-09-28 12:23:31.241 30632 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:23:31 ctl02 nova-api[30632]: 2017-09-28 12:23:31.241 30632 ERROR nova.wsgi     self.filename))
Sep 28 12:23:31 ctl02 nova-api[30632]: 2017-09-28 12:23:31.241 30632 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:23:31 ctl02 nova-api[30632]: 2017-09-28 12:23:31.241 30632 ERROR nova.wsgi
Sep 28 12:23:31 ctl02 nova-api[30632]: 2017-09-28 12:23:31.242 30632 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:23:31 ctl02 nova-api[30632]: 2017-09-28 12:23:31.373 30632 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:23:31 ctl02 nova-api[30632]: 2017-09-28 12:23:31.621 30632 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:23:31 ctl02 nova-api[30632]: 2017-09-28 12:23:31.623 30632 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:23:31 ctl02 nova-api[30632]: 2017-09-28 12:23:31.623 30632 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:23:31 ctl02 nova-api[30632]: 2017-09-28 12:23:31.624 30632 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:23:31 ctl02 nova-api[30632]: 2017-09-28 12:23:31.756 30632 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:23:31 ctl02 nova-api[30632]: 2017-09-28 12:23:31.758 30632 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:23:31 ctl02 nova-api[30632]: 2017-09-28 12:23:31.758 30632 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:23:31 ctl02 nova-api[30632]: 2017-09-28 12:23:31.758 30632 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:23:31 ctl02 nova-api[30632]: 2017-09-28 12:23:31.761 30632 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:23:31 ctl02 nova-api[30632]: 2017-09-28 12:23:31.762 30632 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:23:31 ctl02 nova-api[30632]: 2017-09-28 12:23:31.762 30632 ERROR nova Traceback (most recent call last):
Sep 28 12:23:31 ctl02 nova-api[30632]: 2017-09-28 12:23:31.762 30632 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:23:31 ctl02 nova-api[30632]: 2017-09-28 12:23:31.762 30632 ERROR nova     sys.exit(main())
Sep 28 12:23:31 ctl02 nova-api[30632]: 2017-09-28 12:23:31.762 30632 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:23:31 ctl02 nova-api[30632]: 2017-09-28 12:23:31.762 30632 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:23:31 ctl02 nova-api[30632]: 2017-09-28 12:23:31.762 30632 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:23:31 ctl02 nova-api[30632]: 2017-09-28 12:23:31.762 30632 ERROR nova     max_url_len=max_url_len)
Sep 28 12:23:31 ctl02 nova-api[30632]: 2017-09-28 12:23:31.762 30632 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:23:31 ctl02 nova-api[30632]: 2017-09-28 12:23:31.762 30632 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:23:31 ctl02 nova-api[30632]: 2017-09-28 12:23:31.762 30632 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:23:31 ctl02 nova-api[30632]: 2017-09-28 12:23:31.762 30632 ERROR nova     sock.listen(backlog)
Sep 28 12:23:31 ctl02 nova-api[30632]: 2017-09-28 12:23:31.762 30632 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:23:31 ctl02 nova-api[30632]: 2017-09-28 12:23:31.762 30632 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:23:31 ctl02 nova-api[30632]: 2017-09-28 12:23:31.762 30632 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:23:31 ctl02 nova-api[30632]: 2017-09-28 12:23:31.762 30632 ERROR nova
Sep 28 12:23:31 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:23:31 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:23:31 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:23:32 ctl02 glance-api[29183]: 2017-09-28 12:23:32.039 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:23:32] "OPTIONS / HTTP/1.0" 200 134 0.000656
Sep 28 12:23:32 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:23:32 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:23:32 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:23:32 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:23:33 ctl02 nova-cert[4860]: 2017-09-28 12:23:33.301 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:23:33 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:23:33.775 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:23:33] "OPTIONS / HTTP/1.0" 200 134 0.000398
Sep 28 12:23:33 ctl02 nova-api[30651]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:23:33 ctl02 nova-api[30651]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:23:33 ctl02 glance-api[29183]: 2017-09-28 12:23:33.887 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:23:33] "OPTIONS / HTTP/1.0" 200 134 0.000554
Sep 28 12:23:33 ctl02 nova-api[30651]: 2017-09-28 12:23:33.993 30651 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:23:33 ctl02 nova-api[30651]: 2017-09-28 12:23:33.995 30651 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:23:33 ctl02 nova-api[30651]: 2017-09-28 12:23:33.995 30651 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:23:33 ctl02 nova-api[30651]: 2017-09-28 12:23:33.995 30651 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:23:33 ctl02 nova-api[30651]: 2017-09-28 12:23:33.995 30651 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:23:33 ctl02 nova-api[30651]: 2017-09-28 12:23:33.995 30651 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:23:33 ctl02 nova-api[30651]: 2017-09-28 12:23:33.995 30651 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:23:33 ctl02 nova-api[30651]: 2017-09-28 12:23:33.995 30651 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:23:33 ctl02 nova-api[30651]: 2017-09-28 12:23:33.995 30651 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:23:33 ctl02 nova-api[30651]: 2017-09-28 12:23:33.995 30651 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:23:33 ctl02 nova-api[30651]: 2017-09-28 12:23:33.995 30651 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:23:33 ctl02 nova-api[30651]: 2017-09-28 12:23:33.995 30651 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:23:33 ctl02 nova-api[30651]: 2017-09-28 12:23:33.995 30651 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:23:33 ctl02 nova-api[30651]: 2017-09-28 12:23:33.995 30651 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:23:33 ctl02 nova-api[30651]: 2017-09-28 12:23:33.995 30651 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:23:33 ctl02 nova-api[30651]: 2017-09-28 12:23:33.995 30651 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:23:33 ctl02 nova-api[30651]: 2017-09-28 12:23:33.995 30651 ERROR nova.wsgi     self.filename))
Sep 28 12:23:33 ctl02 nova-api[30651]: 2017-09-28 12:23:33.995 30651 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:23:33 ctl02 nova-api[30651]: 2017-09-28 12:23:33.995 30651 ERROR nova.wsgi
Sep 28 12:23:33 ctl02 nova-api[30651]: 2017-09-28 12:23:33.997 30651 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:23:34 ctl02 nova-api[30651]: 2017-09-28 12:23:34.123 30651 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:23:34 ctl02 nova-api[30651]: 2017-09-28 12:23:34.351 30651 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:23:34 ctl02 nova-api[30651]: 2017-09-28 12:23:34.354 30651 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:23:34 ctl02 nova-api[30651]: 2017-09-28 12:23:34.354 30651 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:23:34 ctl02 nova-api[30651]: 2017-09-28 12:23:34.355 30651 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:23:34 ctl02 nova-api[30651]: 2017-09-28 12:23:34.488 30651 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:23:34 ctl02 nova-api[30651]: 2017-09-28 12:23:34.490 30651 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:23:34 ctl02 nova-api[30651]: 2017-09-28 12:23:34.491 30651 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:23:34 ctl02 nova-api[30651]: 2017-09-28 12:23:34.491 30651 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:23:34 ctl02 nova-api[30651]: 2017-09-28 12:23:34.494 30651 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:23:34 ctl02 nova-api[30651]: 2017-09-28 12:23:34.494 30651 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:23:34 ctl02 nova-api[30651]: 2017-09-28 12:23:34.494 30651 ERROR nova Traceback (most recent call last):
Sep 28 12:23:34 ctl02 nova-api[30651]: 2017-09-28 12:23:34.494 30651 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:23:34 ctl02 nova-api[30651]: 2017-09-28 12:23:34.494 30651 ERROR nova     sys.exit(main())
Sep 28 12:23:34 ctl02 nova-api[30651]: 2017-09-28 12:23:34.494 30651 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:23:34 ctl02 nova-api[30651]: 2017-09-28 12:23:34.494 30651 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:23:34 ctl02 nova-api[30651]: 2017-09-28 12:23:34.494 30651 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:23:34 ctl02 nova-api[30651]: 2017-09-28 12:23:34.494 30651 ERROR nova     max_url_len=max_url_len)
Sep 28 12:23:34 ctl02 nova-api[30651]: 2017-09-28 12:23:34.494 30651 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:23:34 ctl02 nova-api[30651]: 2017-09-28 12:23:34.494 30651 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:23:34 ctl02 nova-api[30651]: 2017-09-28 12:23:34.494 30651 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:23:34 ctl02 nova-api[30651]: 2017-09-28 12:23:34.494 30651 ERROR nova     sock.listen(backlog)
Sep 28 12:23:34 ctl02 nova-api[30651]: 2017-09-28 12:23:34.494 30651 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:23:34 ctl02 nova-api[30651]: 2017-09-28 12:23:34.494 30651 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:23:34 ctl02 nova-api[30651]: 2017-09-28 12:23:34.494 30651 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:23:34 ctl02 nova-api[30651]: 2017-09-28 12:23:34.494 30651 ERROR nova
Sep 28 12:23:34 ctl02 nova-conductor[5056]: 2017-09-28 12:23:34.624 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:23:34 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:23:34 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:23:34 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:23:34 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:23:34.634 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:23:34] "OPTIONS / HTTP/1.0" 200 134 0.000393
Sep 28 12:23:34 ctl02 nova-conductor[5056]: 2017-09-28 12:23:34.641 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:23:34 ctl02 nova-conductor[5056]: 2017-09-28 12:23:34.662 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:23:34 ctl02 nova-conductor[5056]: 2017-09-28 12:23:34.667 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:23:34 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:23:34 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:23:34 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:23:34 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:23:35 ctl02 heat-api[13008]: 2017-09-28 12:23:35.359 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:23:35] "OPTIONS / HTTP/1.0" 200 134 0.000522
Sep 28 12:23:36 ctl02 nova-api[30669]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:23:36 ctl02 nova-api[30669]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:23:36 ctl02 nova-api[30669]: 2017-09-28 12:23:36.741 30669 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:23:36 ctl02 nova-api[30669]: 2017-09-28 12:23:36.742 30669 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:23:36 ctl02 nova-api[30669]: 2017-09-28 12:23:36.742 30669 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:23:36 ctl02 nova-api[30669]: 2017-09-28 12:23:36.742 30669 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:23:36 ctl02 nova-api[30669]: 2017-09-28 12:23:36.742 30669 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:23:36 ctl02 nova-api[30669]: 2017-09-28 12:23:36.742 30669 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:23:36 ctl02 nova-api[30669]: 2017-09-28 12:23:36.742 30669 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:23:36 ctl02 nova-api[30669]: 2017-09-28 12:23:36.742 30669 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:23:36 ctl02 nova-api[30669]: 2017-09-28 12:23:36.742 30669 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:23:36 ctl02 nova-api[30669]: 2017-09-28 12:23:36.742 30669 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:23:36 ctl02 nova-api[30669]: 2017-09-28 12:23:36.742 30669 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:23:36 ctl02 nova-api[30669]: 2017-09-28 12:23:36.742 30669 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:23:36 ctl02 nova-api[30669]: 2017-09-28 12:23:36.742 30669 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:23:36 ctl02 nova-api[30669]: 2017-09-28 12:23:36.742 30669 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:23:36 ctl02 nova-api[30669]: 2017-09-28 12:23:36.742 30669 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:23:36 ctl02 nova-api[30669]: 2017-09-28 12:23:36.742 30669 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:23:36 ctl02 nova-api[30669]: 2017-09-28 12:23:36.742 30669 ERROR nova.wsgi     self.filename))
Sep 28 12:23:36 ctl02 nova-api[30669]: 2017-09-28 12:23:36.742 30669 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:23:36 ctl02 nova-api[30669]: 2017-09-28 12:23:36.742 30669 ERROR nova.wsgi
Sep 28 12:23:36 ctl02 nova-api[30669]: 2017-09-28 12:23:36.743 30669 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:23:36 ctl02 nova-api[30669]: 2017-09-28 12:23:36.874 30669 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:23:37 ctl02 nova-api[30669]: 2017-09-28 12:23:37.111 30669 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:23:37 ctl02 nova-api[30669]: 2017-09-28 12:23:37.113 30669 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:23:37 ctl02 nova-api[30669]: 2017-09-28 12:23:37.119 30669 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:23:37 ctl02 nova-api[30669]: 2017-09-28 12:23:37.120 30669 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:23:37 ctl02 nova-api[30669]: 2017-09-28 12:23:37.253 30669 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:23:37 ctl02 nova-api[30669]: 2017-09-28 12:23:37.255 30669 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:23:37 ctl02 nova-api[30669]: 2017-09-28 12:23:37.255 30669 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:23:37 ctl02 nova-api[30669]: 2017-09-28 12:23:37.256 30669 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:23:37 ctl02 nova-api[30669]: 2017-09-28 12:23:37.259 30669 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:23:37 ctl02 nova-api[30669]: 2017-09-28 12:23:37.259 30669 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:23:37 ctl02 nova-api[30669]: 2017-09-28 12:23:37.259 30669 ERROR nova Traceback (most recent call last):
Sep 28 12:23:37 ctl02 nova-api[30669]: 2017-09-28 12:23:37.259 30669 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:23:37 ctl02 nova-api[30669]: 2017-09-28 12:23:37.259 30669 ERROR nova     sys.exit(main())
Sep 28 12:23:37 ctl02 nova-api[30669]: 2017-09-28 12:23:37.259 30669 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:23:37 ctl02 nova-api[30669]: 2017-09-28 12:23:37.259 30669 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:23:37 ctl02 nova-api[30669]: 2017-09-28 12:23:37.259 30669 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:23:37 ctl02 nova-api[30669]: 2017-09-28 12:23:37.259 30669 ERROR nova     max_url_len=max_url_len)
Sep 28 12:23:37 ctl02 nova-api[30669]: 2017-09-28 12:23:37.259 30669 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:23:37 ctl02 nova-api[30669]: 2017-09-28 12:23:37.259 30669 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:23:37 ctl02 nova-api[30669]: 2017-09-28 12:23:37.259 30669 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:23:37 ctl02 nova-api[30669]: 2017-09-28 12:23:37.259 30669 ERROR nova     sock.listen(backlog)
Sep 28 12:23:37 ctl02 nova-api[30669]: 2017-09-28 12:23:37.259 30669 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:23:37 ctl02 nova-api[30669]: 2017-09-28 12:23:37.259 30669 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:23:37 ctl02 nova-api[30669]: 2017-09-28 12:23:37.259 30669 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:23:37 ctl02 nova-api[30669]: 2017-09-28 12:23:37.259 30669 ERROR nova
Sep 28 12:23:37 ctl02 heat-api[13008]: 2017-09-28 12:23:37.315 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:23:37] "OPTIONS / HTTP/1.0" 200 134 0.000863
Sep 28 12:23:37 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:23:37 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:23:37 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:23:37 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:23:37 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:23:37 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:23:37 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:23:37 ctl02 heat-api-cfn[13300]: 2017-09-28 12:23:37.995 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:23:37] "OPTIONS / HTTP/1.0" 200 134 0.000454
Sep 28 12:23:38 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:23:38.065 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:23:38] "OPTIONS / HTTP/1.0" 200 134 0.000453
Sep 28 12:23:39 ctl02 nova-api[30687]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:23:39 ctl02 nova-api[30687]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:23:39 ctl02 heat-api-cfn[13300]: 2017-09-28 12:23:39.319 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:23:39] "OPTIONS / HTTP/1.0" 200 134 0.000597
Sep 28 12:23:39 ctl02 nova-api[30687]: 2017-09-28 12:23:39.507 30687 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:23:39 ctl02 nova-api[30687]: 2017-09-28 12:23:39.508 30687 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:23:39 ctl02 nova-api[30687]: 2017-09-28 12:23:39.508 30687 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:23:39 ctl02 nova-api[30687]: 2017-09-28 12:23:39.508 30687 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:23:39 ctl02 nova-api[30687]: 2017-09-28 12:23:39.508 30687 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:23:39 ctl02 nova-api[30687]: 2017-09-28 12:23:39.508 30687 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:23:39 ctl02 nova-api[30687]: 2017-09-28 12:23:39.508 30687 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:23:39 ctl02 nova-api[30687]: 2017-09-28 12:23:39.508 30687 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:23:39 ctl02 nova-api[30687]: 2017-09-28 12:23:39.508 30687 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:23:39 ctl02 nova-api[30687]: 2017-09-28 12:23:39.508 30687 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:23:39 ctl02 nova-api[30687]: 2017-09-28 12:23:39.508 30687 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:23:39 ctl02 nova-api[30687]: 2017-09-28 12:23:39.508 30687 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:23:39 ctl02 nova-api[30687]: 2017-09-28 12:23:39.508 30687 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:23:39 ctl02 nova-api[30687]: 2017-09-28 12:23:39.508 30687 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:23:39 ctl02 nova-api[30687]: 2017-09-28 12:23:39.508 30687 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:23:39 ctl02 nova-api[30687]: 2017-09-28 12:23:39.508 30687 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:23:39 ctl02 nova-api[30687]: 2017-09-28 12:23:39.508 30687 ERROR nova.wsgi     self.filename))
Sep 28 12:23:39 ctl02 nova-api[30687]: 2017-09-28 12:23:39.508 30687 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:23:39 ctl02 nova-api[30687]: 2017-09-28 12:23:39.508 30687 ERROR nova.wsgi
Sep 28 12:23:39 ctl02 nova-api[30687]: 2017-09-28 12:23:39.509 30687 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:23:39 ctl02 nova-api[30687]: 2017-09-28 12:23:39.641 30687 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:23:39 ctl02 heat-api[13008]: 2017-09-28 12:23:39.711 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:23:39] "OPTIONS / HTTP/1.0" 200 134 0.000980
Sep 28 12:23:39 ctl02 nova-api[30687]: 2017-09-28 12:23:39.897 30687 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:23:39 ctl02 nova-api[30687]: 2017-09-28 12:23:39.899 30687 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:23:39 ctl02 nova-api[30687]: 2017-09-28 12:23:39.899 30687 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:23:39 ctl02 nova-api[30687]: 2017-09-28 12:23:39.900 30687 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:23:40 ctl02 nova-api[30687]: 2017-09-28 12:23:40.034 30687 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:23:40 ctl02 nova-api[30687]: 2017-09-28 12:23:40.037 30687 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:23:40 ctl02 nova-api[30687]: 2017-09-28 12:23:40.037 30687 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:23:40 ctl02 nova-api[30687]: 2017-09-28 12:23:40.037 30687 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:23:40 ctl02 nova-api[30687]: 2017-09-28 12:23:40.040 30687 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:23:40 ctl02 nova-api[30687]: 2017-09-28 12:23:40.041 30687 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:23:40 ctl02 nova-api[30687]: 2017-09-28 12:23:40.041 30687 ERROR nova Traceback (most recent call last):
Sep 28 12:23:40 ctl02 nova-api[30687]: 2017-09-28 12:23:40.041 30687 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:23:40 ctl02 nova-api[30687]: 2017-09-28 12:23:40.041 30687 ERROR nova     sys.exit(main())
Sep 28 12:23:40 ctl02 nova-api[30687]: 2017-09-28 12:23:40.041 30687 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:23:40 ctl02 nova-api[30687]: 2017-09-28 12:23:40.041 30687 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:23:40 ctl02 nova-api[30687]: 2017-09-28 12:23:40.041 30687 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:23:40 ctl02 nova-api[30687]: 2017-09-28 12:23:40.041 30687 ERROR nova     max_url_len=max_url_len)
Sep 28 12:23:40 ctl02 nova-api[30687]: 2017-09-28 12:23:40.041 30687 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:23:40 ctl02 nova-api[30687]: 2017-09-28 12:23:40.041 30687 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:23:40 ctl02 nova-api[30687]: 2017-09-28 12:23:40.041 30687 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:23:40 ctl02 nova-api[30687]: 2017-09-28 12:23:40.041 30687 ERROR nova     sock.listen(backlog)
Sep 28 12:23:40 ctl02 nova-api[30687]: 2017-09-28 12:23:40.041 30687 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:23:40 ctl02 nova-api[30687]: 2017-09-28 12:23:40.041 30687 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:23:40 ctl02 nova-api[30687]: 2017-09-28 12:23:40.041 30687 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:23:40 ctl02 nova-api[30687]: 2017-09-28 12:23:40.041 30687 ERROR nova
Sep 28 12:23:40 ctl02 neutron-server[30536]: 2017-09-28 12:23:40.183 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:23:40] "OPTIONS / HTTP/1.0" 200 262 0.000529
Sep 28 12:23:40 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:23:40 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:23:40 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:23:40 ctl02 heat-api-cfn[13300]: 2017-09-28 12:23:40.361 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:23:40] "OPTIONS / HTTP/1.0" 200 134 0.000511
Sep 28 12:23:40 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:23:40 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:23:40 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:23:40 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:23:40 ctl02 neutron-server[30536]: 2017-09-28 12:23:40.797 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:23:40] "OPTIONS / HTTP/1.0" 200 262 0.001732
Sep 28 12:23:41 ctl02 glance-api[29183]: 2017-09-28 12:23:41.029 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:23:41] "OPTIONS / HTTP/1.0" 200 134 0.000564
Sep 28 12:23:41 ctl02 neutron-server[30536]: 2017-09-28 12:23:41.311 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:23:41] "OPTIONS / HTTP/1.0" 200 262 0.000525
Sep 28 12:23:41 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x36315742)
Sep 28 12:23:42 ctl02 nova-api[30705]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:23:42 ctl02 nova-api[30705]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:23:42 ctl02 nova-api[30705]: 2017-09-28 12:23:42.248 30705 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:23:42 ctl02 nova-api[30705]: 2017-09-28 12:23:42.267 30705 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:23:42 ctl02 nova-api[30705]: 2017-09-28 12:23:42.267 30705 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:23:42 ctl02 nova-api[30705]: 2017-09-28 12:23:42.267 30705 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:23:42 ctl02 nova-api[30705]: 2017-09-28 12:23:42.267 30705 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:23:42 ctl02 nova-api[30705]: 2017-09-28 12:23:42.267 30705 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:23:42 ctl02 nova-api[30705]: 2017-09-28 12:23:42.267 30705 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:23:42 ctl02 nova-api[30705]: 2017-09-28 12:23:42.267 30705 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:23:42 ctl02 nova-api[30705]: 2017-09-28 12:23:42.267 30705 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:23:42 ctl02 nova-api[30705]: 2017-09-28 12:23:42.267 30705 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:23:42 ctl02 nova-api[30705]: 2017-09-28 12:23:42.267 30705 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:23:42 ctl02 nova-api[30705]: 2017-09-28 12:23:42.267 30705 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:23:42 ctl02 nova-api[30705]: 2017-09-28 12:23:42.267 30705 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:23:42 ctl02 nova-api[30705]: 2017-09-28 12:23:42.267 30705 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:23:42 ctl02 nova-api[30705]: 2017-09-28 12:23:42.267 30705 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:23:42 ctl02 nova-api[30705]: 2017-09-28 12:23:42.267 30705 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:23:42 ctl02 nova-api[30705]: 2017-09-28 12:23:42.267 30705 ERROR nova.wsgi     self.filename))
Sep 28 12:23:42 ctl02 nova-api[30705]: 2017-09-28 12:23:42.267 30705 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:23:42 ctl02 nova-api[30705]: 2017-09-28 12:23:42.267 30705 ERROR nova.wsgi
Sep 28 12:23:42 ctl02 nova-api[30705]: 2017-09-28 12:23:42.268 30705 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:23:42 ctl02 glance-api[29183]: 2017-09-28 12:23:42.341 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:23:42] "OPTIONS / HTTP/1.0" 200 134 0.001001
Sep 28 12:23:42 ctl02 nova-api[30705]: 2017-09-28 12:23:42.405 30705 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:23:42 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x36315742)
Sep 28 12:23:42 ctl02 nova-api[30705]: 2017-09-28 12:23:42.651 30705 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:23:42 ctl02 nova-api[30705]: 2017-09-28 12:23:42.653 30705 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:23:42 ctl02 nova-api[30705]: 2017-09-28 12:23:42.654 30705 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:23:42 ctl02 nova-api[30705]: 2017-09-28 12:23:42.654 30705 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:23:42 ctl02 nova-api[30705]: 2017-09-28 12:23:42.786 30705 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:23:42 ctl02 nova-api[30705]: 2017-09-28 12:23:42.788 30705 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:23:42 ctl02 nova-api[30705]: 2017-09-28 12:23:42.788 30705 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:23:42 ctl02 nova-api[30705]: 2017-09-28 12:23:42.789 30705 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:23:42 ctl02 nova-api[30705]: 2017-09-28 12:23:42.792 30705 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:23:42 ctl02 nova-api[30705]: 2017-09-28 12:23:42.792 30705 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:23:42 ctl02 nova-api[30705]: 2017-09-28 12:23:42.792 30705 ERROR nova Traceback (most recent call last):
Sep 28 12:23:42 ctl02 nova-api[30705]: 2017-09-28 12:23:42.792 30705 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:23:42 ctl02 nova-api[30705]: 2017-09-28 12:23:42.792 30705 ERROR nova     sys.exit(main())
Sep 28 12:23:42 ctl02 nova-api[30705]: 2017-09-28 12:23:42.792 30705 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:23:42 ctl02 nova-api[30705]: 2017-09-28 12:23:42.792 30705 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:23:42 ctl02 nova-api[30705]: 2017-09-28 12:23:42.792 30705 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:23:42 ctl02 nova-api[30705]: 2017-09-28 12:23:42.792 30705 ERROR nova     max_url_len=max_url_len)
Sep 28 12:23:42 ctl02 nova-api[30705]: 2017-09-28 12:23:42.792 30705 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:23:42 ctl02 nova-api[30705]: 2017-09-28 12:23:42.792 30705 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:23:42 ctl02 nova-api[30705]: 2017-09-28 12:23:42.792 30705 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:23:42 ctl02 nova-api[30705]: 2017-09-28 12:23:42.792 30705 ERROR nova     sock.listen(backlog)
Sep 28 12:23:42 ctl02 nova-api[30705]: 2017-09-28 12:23:42.792 30705 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:23:42 ctl02 nova-api[30705]: 2017-09-28 12:23:42.792 30705 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:23:42 ctl02 nova-api[30705]: 2017-09-28 12:23:42.792 30705 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:23:42 ctl02 nova-api[30705]: 2017-09-28 12:23:42.792 30705 ERROR nova
Sep 28 12:23:42 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:23:42 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:23:42 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:23:43 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:23:43 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:23:43 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:23:43 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:23:43 ctl02 nova-consoleauth[5433]: 2017-09-28 12:23:43.180 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:23:43 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x36315742)
Sep 28 12:23:43 ctl02 glance-api[29183]: 2017-09-28 12:23:43.772 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:23:43] "OPTIONS / HTTP/1.0" 200 134 0.000675
Sep 28 12:23:43 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:23:43.824 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:23:43] "OPTIONS / HTTP/1.0" 200 134 0.000581
Sep 28 12:23:44 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x36315742)
Sep 28 12:23:44 ctl02 nova-api[30722]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:23:44 ctl02 nova-api[30722]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:23:44 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:23:44.929 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:23:44] "OPTIONS / HTTP/1.0" 200 134 0.000501
Sep 28 12:23:44 ctl02 nova-api[30722]: 2017-09-28 12:23:44.993 30722 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:23:44 ctl02 nova-api[30722]: 2017-09-28 12:23:44.995 30722 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:23:44 ctl02 nova-api[30722]: 2017-09-28 12:23:44.995 30722 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:23:44 ctl02 nova-api[30722]: 2017-09-28 12:23:44.995 30722 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:23:44 ctl02 nova-api[30722]: 2017-09-28 12:23:44.995 30722 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:23:44 ctl02 nova-api[30722]: 2017-09-28 12:23:44.995 30722 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:23:44 ctl02 nova-api[30722]: 2017-09-28 12:23:44.995 30722 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:23:44 ctl02 nova-api[30722]: 2017-09-28 12:23:44.995 30722 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:23:44 ctl02 nova-api[30722]: 2017-09-28 12:23:44.995 30722 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:23:44 ctl02 nova-api[30722]: 2017-09-28 12:23:44.995 30722 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:23:44 ctl02 nova-api[30722]: 2017-09-28 12:23:44.995 30722 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:23:44 ctl02 nova-api[30722]: 2017-09-28 12:23:44.995 30722 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:23:44 ctl02 nova-api[30722]: 2017-09-28 12:23:44.995 30722 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:23:44 ctl02 nova-api[30722]: 2017-09-28 12:23:44.995 30722 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:23:44 ctl02 nova-api[30722]: 2017-09-28 12:23:44.995 30722 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:23:44 ctl02 nova-api[30722]: 2017-09-28 12:23:44.995 30722 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:23:44 ctl02 nova-api[30722]: 2017-09-28 12:23:44.995 30722 ERROR nova.wsgi     self.filename))
Sep 28 12:23:44 ctl02 nova-api[30722]: 2017-09-28 12:23:44.995 30722 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:23:44 ctl02 nova-api[30722]: 2017-09-28 12:23:44.995 30722 ERROR nova.wsgi
Sep 28 12:23:44 ctl02 nova-api[30722]: 2017-09-28 12:23:44.997 30722 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:23:45 ctl02 nova-api[30722]: 2017-09-28 12:23:45.130 30722 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:23:45 ctl02 heat-api[13008]: 2017-09-28 12:23:45.134 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:23:45] "OPTIONS / HTTP/1.0" 200 134 0.000879
Sep 28 12:23:45 ctl02 nova-api[30722]: 2017-09-28 12:23:45.377 30722 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:23:45 ctl02 nova-api[30722]: 2017-09-28 12:23:45.380 30722 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:23:45 ctl02 nova-api[30722]: 2017-09-28 12:23:45.380 30722 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:23:45 ctl02 nova-api[30722]: 2017-09-28 12:23:45.381 30722 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:23:45 ctl02 nova-api[30722]: 2017-09-28 12:23:45.513 30722 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:23:45 ctl02 nova-api[30722]: 2017-09-28 12:23:45.516 30722 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:23:45 ctl02 nova-api[30722]: 2017-09-28 12:23:45.516 30722 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:23:45 ctl02 nova-api[30722]: 2017-09-28 12:23:45.517 30722 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:23:45 ctl02 nova-api[30722]: 2017-09-28 12:23:45.520 30722 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:23:45 ctl02 nova-api[30722]: 2017-09-28 12:23:45.521 30722 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:23:45 ctl02 nova-api[30722]: 2017-09-28 12:23:45.521 30722 ERROR nova Traceback (most recent call last):
Sep 28 12:23:45 ctl02 nova-api[30722]: 2017-09-28 12:23:45.521 30722 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:23:45 ctl02 nova-api[30722]: 2017-09-28 12:23:45.521 30722 ERROR nova     sys.exit(main())
Sep 28 12:23:45 ctl02 nova-api[30722]: 2017-09-28 12:23:45.521 30722 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:23:45 ctl02 nova-api[30722]: 2017-09-28 12:23:45.521 30722 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:23:45 ctl02 nova-api[30722]: 2017-09-28 12:23:45.521 30722 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:23:45 ctl02 nova-api[30722]: 2017-09-28 12:23:45.521 30722 ERROR nova     max_url_len=max_url_len)
Sep 28 12:23:45 ctl02 nova-api[30722]: 2017-09-28 12:23:45.521 30722 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:23:45 ctl02 nova-api[30722]: 2017-09-28 12:23:45.521 30722 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:23:45 ctl02 nova-api[30722]: 2017-09-28 12:23:45.521 30722 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:23:45 ctl02 nova-api[30722]: 2017-09-28 12:23:45.521 30722 ERROR nova     sock.listen(backlog)
Sep 28 12:23:45 ctl02 nova-api[30722]: 2017-09-28 12:23:45.521 30722 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:23:45 ctl02 nova-api[30722]: 2017-09-28 12:23:45.521 30722 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:23:45 ctl02 nova-api[30722]: 2017-09-28 12:23:45.521 30722 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:23:45 ctl02 nova-api[30722]: 2017-09-28 12:23:45.521 30722 ERROR nova
Sep 28 12:23:45 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x36315742)
Sep 28 12:23:45 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:23:45 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:23:45 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:23:45 ctl02 heat-engine[12803]: 2017-09-28 12:23:45.745 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:23:45 ctl02 heat-engine[12803]: 2017-09-28 12:23:45.746 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:23:45 ctl02 heat-engine[12803]: 2017-09-28 12:23:45.751 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:23:45 ctl02 heat-engine[12803]: 2017-09-28 12:23:45.757 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:23:45 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:23:45 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:23:45 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:23:45 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:23:46 ctl02 nova-scheduler[5620]: 2017-09-28 12:23:46.200 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:23:46 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x36315742)
Sep 28 12:23:47 ctl02 heat-api[13008]: 2017-09-28 12:23:47.002 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:23:47] "OPTIONS / HTTP/1.0" 200 134 0.000609
Sep 28 12:23:47 ctl02 nova-api[30740]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:23:47 ctl02 nova-api[30740]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:23:47 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x36315742)
Sep 28 12:23:47 ctl02 nova-api[30740]: 2017-09-28 12:23:47.790 30740 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:23:47 ctl02 nova-api[30740]: 2017-09-28 12:23:47.791 30740 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:23:47 ctl02 nova-api[30740]: 2017-09-28 12:23:47.791 30740 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:23:47 ctl02 nova-api[30740]: 2017-09-28 12:23:47.791 30740 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:23:47 ctl02 nova-api[30740]: 2017-09-28 12:23:47.791 30740 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:23:47 ctl02 nova-api[30740]: 2017-09-28 12:23:47.791 30740 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:23:47 ctl02 nova-api[30740]: 2017-09-28 12:23:47.791 30740 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:23:47 ctl02 nova-api[30740]: 2017-09-28 12:23:47.791 30740 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:23:47 ctl02 nova-api[30740]: 2017-09-28 12:23:47.791 30740 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:23:47 ctl02 nova-api[30740]: 2017-09-28 12:23:47.791 30740 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:23:47 ctl02 nova-api[30740]: 2017-09-28 12:23:47.791 30740 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:23:47 ctl02 nova-api[30740]: 2017-09-28 12:23:47.791 30740 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:23:47 ctl02 nova-api[30740]: 2017-09-28 12:23:47.791 30740 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:23:47 ctl02 nova-api[30740]: 2017-09-28 12:23:47.791 30740 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:23:47 ctl02 nova-api[30740]: 2017-09-28 12:23:47.791 30740 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:23:47 ctl02 nova-api[30740]: 2017-09-28 12:23:47.791 30740 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:23:47 ctl02 nova-api[30740]: 2017-09-28 12:23:47.791 30740 ERROR nova.wsgi     self.filename))
Sep 28 12:23:47 ctl02 nova-api[30740]: 2017-09-28 12:23:47.791 30740 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:23:47 ctl02 nova-api[30740]: 2017-09-28 12:23:47.791 30740 ERROR nova.wsgi
Sep 28 12:23:47 ctl02 nova-api[30740]: 2017-09-28 12:23:47.792 30740 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:23:47 ctl02 nova-api[30740]: 2017-09-28 12:23:47.923 30740 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:23:48 ctl02 nova-api[30740]: 2017-09-28 12:23:48.156 30740 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:23:48 ctl02 nova-api[30740]: 2017-09-28 12:23:48.158 30740 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:23:48 ctl02 nova-api[30740]: 2017-09-28 12:23:48.158 30740 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:23:48 ctl02 nova-api[30740]: 2017-09-28 12:23:48.159 30740 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:23:48 ctl02 heat-api-cfn[13300]: 2017-09-28 12:23:48.180 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:23:48] "OPTIONS / HTTP/1.0" 200 134 0.000436
Sep 28 12:23:48 ctl02 nova-api[30740]: 2017-09-28 12:23:48.292 30740 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:23:48 ctl02 nova-api[30740]: 2017-09-28 12:23:48.294 30740 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:23:48 ctl02 nova-api[30740]: 2017-09-28 12:23:48.294 30740 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:23:48 ctl02 nova-api[30740]: 2017-09-28 12:23:48.295 30740 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:23:48 ctl02 nova-api[30740]: 2017-09-28 12:23:48.298 30740 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:23:48 ctl02 nova-api[30740]: 2017-09-28 12:23:48.298 30740 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:23:48 ctl02 nova-api[30740]: 2017-09-28 12:23:48.298 30740 ERROR nova Traceback (most recent call last):
Sep 28 12:23:48 ctl02 nova-api[30740]: 2017-09-28 12:23:48.298 30740 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:23:48 ctl02 nova-api[30740]: 2017-09-28 12:23:48.298 30740 ERROR nova     sys.exit(main())
Sep 28 12:23:48 ctl02 nova-api[30740]: 2017-09-28 12:23:48.298 30740 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:23:48 ctl02 nova-api[30740]: 2017-09-28 12:23:48.298 30740 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:23:48 ctl02 nova-api[30740]: 2017-09-28 12:23:48.298 30740 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:23:48 ctl02 nova-api[30740]: 2017-09-28 12:23:48.298 30740 ERROR nova     max_url_len=max_url_len)
Sep 28 12:23:48 ctl02 nova-api[30740]: 2017-09-28 12:23:48.298 30740 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:23:48 ctl02 nova-api[30740]: 2017-09-28 12:23:48.298 30740 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:23:48 ctl02 nova-api[30740]: 2017-09-28 12:23:48.298 30740 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:23:48 ctl02 nova-api[30740]: 2017-09-28 12:23:48.298 30740 ERROR nova     sock.listen(backlog)
Sep 28 12:23:48 ctl02 nova-api[30740]: 2017-09-28 12:23:48.298 30740 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:23:48 ctl02 nova-api[30740]: 2017-09-28 12:23:48.298 30740 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:23:48 ctl02 nova-api[30740]: 2017-09-28 12:23:48.298 30740 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:23:48 ctl02 nova-api[30740]: 2017-09-28 12:23:48.298 30740 ERROR nova
Sep 28 12:23:48 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:23:48.311 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:23:48] "OPTIONS / HTTP/1.0" 200 134 0.000426
Sep 28 12:23:48 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:23:48 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:23:48 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:23:48 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:23:48 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:23:48 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:23:48 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x36315742)
Sep 28 12:23:48 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:23:49 ctl02 heat-api-cfn[13300]: 2017-09-28 12:23:49.001 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:23:49] "OPTIONS / HTTP/1.0" 200 134 0.000459
Sep 28 12:23:49 ctl02 heat-api[13008]: 2017-09-28 12:23:49.632 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:23:49] "OPTIONS / HTTP/1.0" 200 134 0.000962
Sep 28 12:23:49 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x36315742)
Sep 28 12:23:50 ctl02 neutron-server[30536]: 2017-09-28 12:23:50.050 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:23:50] "OPTIONS / HTTP/1.0" 200 262 0.000649
Sep 28 12:23:50 ctl02 heat-api-cfn[13300]: 2017-09-28 12:23:50.170 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:23:50] "OPTIONS / HTTP/1.0" 200 134 0.000557
Sep 28 12:23:50 ctl02 nova-api[30759]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:23:50 ctl02 nova-api[30759]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:23:50 ctl02 neutron-server[30536]: 2017-09-28 12:23:50.420 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:23:50] "OPTIONS / HTTP/1.0" 200 262 0.000597
Sep 28 12:23:50 ctl02 nova-api[30759]: 2017-09-28 12:23:50.487 30759 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:23:50 ctl02 nova-api[30759]: 2017-09-28 12:23:50.488 30759 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:23:50 ctl02 nova-api[30759]: 2017-09-28 12:23:50.488 30759 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:23:50 ctl02 nova-api[30759]: 2017-09-28 12:23:50.488 30759 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:23:50 ctl02 nova-api[30759]: 2017-09-28 12:23:50.488 30759 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:23:50 ctl02 nova-api[30759]: 2017-09-28 12:23:50.488 30759 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:23:50 ctl02 nova-api[30759]: 2017-09-28 12:23:50.488 30759 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:23:50 ctl02 nova-api[30759]: 2017-09-28 12:23:50.488 30759 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:23:50 ctl02 nova-api[30759]: 2017-09-28 12:23:50.488 30759 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:23:50 ctl02 nova-api[30759]: 2017-09-28 12:23:50.488 30759 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:23:50 ctl02 nova-api[30759]: 2017-09-28 12:23:50.488 30759 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:23:50 ctl02 nova-api[30759]: 2017-09-28 12:23:50.488 30759 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:23:50 ctl02 nova-api[30759]: 2017-09-28 12:23:50.488 30759 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:23:50 ctl02 nova-api[30759]: 2017-09-28 12:23:50.488 30759 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:23:50 ctl02 nova-api[30759]: 2017-09-28 12:23:50.488 30759 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:23:50 ctl02 nova-api[30759]: 2017-09-28 12:23:50.488 30759 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:23:50 ctl02 nova-api[30759]: 2017-09-28 12:23:50.488 30759 ERROR nova.wsgi     self.filename))
Sep 28 12:23:50 ctl02 nova-api[30759]: 2017-09-28 12:23:50.488 30759 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:23:50 ctl02 nova-api[30759]: 2017-09-28 12:23:50.488 30759 ERROR nova.wsgi
Sep 28 12:23:50 ctl02 nova-api[30759]: 2017-09-28 12:23:50.489 30759 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:23:50 ctl02 nova-api[30759]: 2017-09-28 12:23:50.617 30759 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:23:50 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x36315742)
Sep 28 12:23:50 ctl02 glance-api[29183]: 2017-09-28 12:23:50.706 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:23:50] "OPTIONS / HTTP/1.0" 200 134 0.000613
Sep 28 12:23:50 ctl02 nova-api[30759]: 2017-09-28 12:23:50.878 30759 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:23:50 ctl02 nova-api[30759]: 2017-09-28 12:23:50.880 30759 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:23:50 ctl02 nova-api[30759]: 2017-09-28 12:23:50.880 30759 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:23:50 ctl02 nova-api[30759]: 2017-09-28 12:23:50.881 30759 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:23:51 ctl02 nova-api[30759]: 2017-09-28 12:23:51.016 30759 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:23:51 ctl02 nova-api[30759]: 2017-09-28 12:23:51.019 30759 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:23:51 ctl02 nova-api[30759]: 2017-09-28 12:23:51.019 30759 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:23:51 ctl02 nova-api[30759]: 2017-09-28 12:23:51.019 30759 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:23:51 ctl02 nova-api[30759]: 2017-09-28 12:23:51.022 30759 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:23:51 ctl02 nova-api[30759]: 2017-09-28 12:23:51.023 30759 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:23:51 ctl02 nova-api[30759]: 2017-09-28 12:23:51.023 30759 ERROR nova Traceback (most recent call last):
Sep 28 12:23:51 ctl02 nova-api[30759]: 2017-09-28 12:23:51.023 30759 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:23:51 ctl02 nova-api[30759]: 2017-09-28 12:23:51.023 30759 ERROR nova     sys.exit(main())
Sep 28 12:23:51 ctl02 nova-api[30759]: 2017-09-28 12:23:51.023 30759 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:23:51 ctl02 nova-api[30759]: 2017-09-28 12:23:51.023 30759 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:23:51 ctl02 nova-api[30759]: 2017-09-28 12:23:51.023 30759 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:23:51 ctl02 nova-api[30759]: 2017-09-28 12:23:51.023 30759 ERROR nova     max_url_len=max_url_len)
Sep 28 12:23:51 ctl02 nova-api[30759]: 2017-09-28 12:23:51.023 30759 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:23:51 ctl02 nova-api[30759]: 2017-09-28 12:23:51.023 30759 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:23:51 ctl02 nova-api[30759]: 2017-09-28 12:23:51.023 30759 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:23:51 ctl02 nova-api[30759]: 2017-09-28 12:23:51.023 30759 ERROR nova     sock.listen(backlog)
Sep 28 12:23:51 ctl02 nova-api[30759]: 2017-09-28 12:23:51.023 30759 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:23:51 ctl02 nova-api[30759]: 2017-09-28 12:23:51.023 30759 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:23:51 ctl02 nova-api[30759]: 2017-09-28 12:23:51.023 30759 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:23:51 ctl02 nova-api[30759]: 2017-09-28 12:23:51.023 30759 ERROR nova
Sep 28 12:23:51 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:23:51 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:23:51 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:23:51 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:23:51 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:23:51 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:23:51 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:23:51 ctl02 neutron-server[30536]: 2017-09-28 12:23:51.493 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:23:51] "OPTIONS / HTTP/1.0" 200 262 0.000546
Sep 28 12:23:51 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x36315742)
Sep 28 12:23:52 ctl02 glance-api[29183]: 2017-09-28 12:23:52.486 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:23:52] "OPTIONS / HTTP/1.0" 200 134 0.000616
Sep 28 12:23:52 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:23:52 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:23:53 ctl02 nova-api[30777]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:23:53 ctl02 nova-api[30777]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:23:53 ctl02 nova-api[30777]: 2017-09-28 12:23:53.274 30777 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:23:53 ctl02 nova-api[30777]: 2017-09-28 12:23:53.275 30777 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:23:53 ctl02 nova-api[30777]: 2017-09-28 12:23:53.275 30777 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:23:53 ctl02 nova-api[30777]: 2017-09-28 12:23:53.275 30777 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:23:53 ctl02 nova-api[30777]: 2017-09-28 12:23:53.275 30777 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:23:53 ctl02 nova-api[30777]: 2017-09-28 12:23:53.275 30777 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:23:53 ctl02 nova-api[30777]: 2017-09-28 12:23:53.275 30777 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:23:53 ctl02 nova-api[30777]: 2017-09-28 12:23:53.275 30777 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:23:53 ctl02 nova-api[30777]: 2017-09-28 12:23:53.275 30777 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:23:53 ctl02 nova-api[30777]: 2017-09-28 12:23:53.275 30777 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:23:53 ctl02 nova-api[30777]: 2017-09-28 12:23:53.275 30777 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:23:53 ctl02 nova-api[30777]: 2017-09-28 12:23:53.275 30777 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:23:53 ctl02 nova-api[30777]: 2017-09-28 12:23:53.275 30777 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:23:53 ctl02 nova-api[30777]: 2017-09-28 12:23:53.275 30777 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:23:53 ctl02 nova-api[30777]: 2017-09-28 12:23:53.275 30777 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:23:53 ctl02 nova-api[30777]: 2017-09-28 12:23:53.275 30777 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:23:53 ctl02 nova-api[30777]: 2017-09-28 12:23:53.275 30777 ERROR nova.wsgi     self.filename))
Sep 28 12:23:53 ctl02 nova-api[30777]: 2017-09-28 12:23:53.275 30777 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:23:53 ctl02 nova-api[30777]: 2017-09-28 12:23:53.275 30777 ERROR nova.wsgi
Sep 28 12:23:53 ctl02 nova-api[30777]: 2017-09-28 12:23:53.277 30777 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:23:53 ctl02 glance-api[29183]: 2017-09-28 12:23:53.416 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:23:53] "OPTIONS / HTTP/1.0" 200 134 0.000932
Sep 28 12:23:53 ctl02 nova-api[30777]: 2017-09-28 12:23:53.431 30777 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:23:53 ctl02 nova-api[30777]: 2017-09-28 12:23:53.679 30777 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:23:53 ctl02 nova-api[30777]: 2017-09-28 12:23:53.682 30777 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:23:53 ctl02 nova-api[30777]: 2017-09-28 12:23:53.683 30777 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:23:53 ctl02 nova-api[30777]: 2017-09-28 12:23:53.684 30777 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:23:53 ctl02 nova-api[30777]: 2017-09-28 12:23:53.824 30777 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:23:53 ctl02 nova-api[30777]: 2017-09-28 12:23:53.827 30777 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:23:53 ctl02 nova-api[30777]: 2017-09-28 12:23:53.827 30777 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:23:53 ctl02 nova-api[30777]: 2017-09-28 12:23:53.827 30777 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:23:53 ctl02 nova-api[30777]: 2017-09-28 12:23:53.831 30777 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:23:53 ctl02 nova-api[30777]: 2017-09-28 12:23:53.831 30777 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:23:53 ctl02 nova-api[30777]: 2017-09-28 12:23:53.831 30777 ERROR nova Traceback (most recent call last):
Sep 28 12:23:53 ctl02 nova-api[30777]: 2017-09-28 12:23:53.831 30777 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:23:53 ctl02 nova-api[30777]: 2017-09-28 12:23:53.831 30777 ERROR nova     sys.exit(main())
Sep 28 12:23:53 ctl02 nova-api[30777]: 2017-09-28 12:23:53.831 30777 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:23:53 ctl02 nova-api[30777]: 2017-09-28 12:23:53.831 30777 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:23:53 ctl02 nova-api[30777]: 2017-09-28 12:23:53.831 30777 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:23:53 ctl02 nova-api[30777]: 2017-09-28 12:23:53.831 30777 ERROR nova     max_url_len=max_url_len)
Sep 28 12:23:53 ctl02 nova-api[30777]: 2017-09-28 12:23:53.831 30777 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:23:53 ctl02 nova-api[30777]: 2017-09-28 12:23:53.831 30777 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:23:53 ctl02 nova-api[30777]: 2017-09-28 12:23:53.831 30777 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:23:53 ctl02 nova-api[30777]: 2017-09-28 12:23:53.831 30777 ERROR nova     sock.listen(backlog)
Sep 28 12:23:53 ctl02 nova-api[30777]: 2017-09-28 12:23:53.831 30777 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:23:53 ctl02 nova-api[30777]: 2017-09-28 12:23:53.831 30777 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:23:53 ctl02 nova-api[30777]: 2017-09-28 12:23:53.831 30777 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:23:53 ctl02 nova-api[30777]: 2017-09-28 12:23:53.831 30777 ERROR nova
Sep 28 12:23:53 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:23:53 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:23:53 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:23:54 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:23:54.123 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:23:54] "OPTIONS / HTTP/1.0" 200 134 0.000509
Sep 28 12:23:54 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:23:54 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:23:54 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:23:54 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:23:54 ctl02 heat-api[13008]: 2017-09-28 12:23:54.942 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:23:54] "OPTIONS / HTTP/1.0" 200 134 0.000556
Sep 28 12:23:55 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:23:55.257 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:23:55] "OPTIONS / HTTP/1.0" 200 134 0.000419
Sep 28 12:23:55 ctl02 nova-api[30800]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:23:55 ctl02 nova-api[30800]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:23:55 ctl02 nova-api[30800]: 2017-09-28 12:23:55.977 30800 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:23:55 ctl02 nova-api[30800]: 2017-09-28 12:23:55.979 30800 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:23:55 ctl02 nova-api[30800]: 2017-09-28 12:23:55.979 30800 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:23:55 ctl02 nova-api[30800]: 2017-09-28 12:23:55.979 30800 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:23:55 ctl02 nova-api[30800]: 2017-09-28 12:23:55.979 30800 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:23:55 ctl02 nova-api[30800]: 2017-09-28 12:23:55.979 30800 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:23:55 ctl02 nova-api[30800]: 2017-09-28 12:23:55.979 30800 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:23:55 ctl02 nova-api[30800]: 2017-09-28 12:23:55.979 30800 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:23:55 ctl02 nova-api[30800]: 2017-09-28 12:23:55.979 30800 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:23:55 ctl02 nova-api[30800]: 2017-09-28 12:23:55.979 30800 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:23:55 ctl02 nova-api[30800]: 2017-09-28 12:23:55.979 30800 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:23:55 ctl02 nova-api[30800]: 2017-09-28 12:23:55.979 30800 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:23:55 ctl02 nova-api[30800]: 2017-09-28 12:23:55.979 30800 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:23:55 ctl02 nova-api[30800]: 2017-09-28 12:23:55.979 30800 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:23:55 ctl02 nova-api[30800]: 2017-09-28 12:23:55.979 30800 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:23:55 ctl02 nova-api[30800]: 2017-09-28 12:23:55.979 30800 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:23:55 ctl02 nova-api[30800]: 2017-09-28 12:23:55.979 30800 ERROR nova.wsgi     self.filename))
Sep 28 12:23:55 ctl02 nova-api[30800]: 2017-09-28 12:23:55.979 30800 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:23:55 ctl02 nova-api[30800]: 2017-09-28 12:23:55.979 30800 ERROR nova.wsgi
Sep 28 12:23:55 ctl02 nova-api[30800]: 2017-09-28 12:23:55.981 30800 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:23:56 ctl02 nova-api[30800]: 2017-09-28 12:23:56.105 30800 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:23:56 ctl02 nova-api[30800]: 2017-09-28 12:23:56.326 30800 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:23:56 ctl02 nova-api[30800]: 2017-09-28 12:23:56.328 30800 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:23:56 ctl02 nova-api[30800]: 2017-09-28 12:23:56.329 30800 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:23:56 ctl02 nova-api[30800]: 2017-09-28 12:23:56.329 30800 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:23:56 ctl02 nova-api[30800]: 2017-09-28 12:23:56.461 30800 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:23:56 ctl02 nova-api[30800]: 2017-09-28 12:23:56.464 30800 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:23:56 ctl02 nova-api[30800]: 2017-09-28 12:23:56.464 30800 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:23:56 ctl02 nova-api[30800]: 2017-09-28 12:23:56.464 30800 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:23:56 ctl02 nova-api[30800]: 2017-09-28 12:23:56.467 30800 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:23:56 ctl02 nova-api[30800]: 2017-09-28 12:23:56.468 30800 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:23:56 ctl02 nova-api[30800]: 2017-09-28 12:23:56.468 30800 ERROR nova Traceback (most recent call last):
Sep 28 12:23:56 ctl02 nova-api[30800]: 2017-09-28 12:23:56.468 30800 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:23:56 ctl02 nova-api[30800]: 2017-09-28 12:23:56.468 30800 ERROR nova     sys.exit(main())
Sep 28 12:23:56 ctl02 nova-api[30800]: 2017-09-28 12:23:56.468 30800 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:23:56 ctl02 nova-api[30800]: 2017-09-28 12:23:56.468 30800 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:23:56 ctl02 nova-api[30800]: 2017-09-28 12:23:56.468 30800 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:23:56 ctl02 nova-api[30800]: 2017-09-28 12:23:56.468 30800 ERROR nova     max_url_len=max_url_len)
Sep 28 12:23:56 ctl02 nova-api[30800]: 2017-09-28 12:23:56.468 30800 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:23:56 ctl02 nova-api[30800]: 2017-09-28 12:23:56.468 30800 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:23:56 ctl02 nova-api[30800]: 2017-09-28 12:23:56.468 30800 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:23:56 ctl02 nova-api[30800]: 2017-09-28 12:23:56.468 30800 ERROR nova     sock.listen(backlog)
Sep 28 12:23:56 ctl02 nova-api[30800]: 2017-09-28 12:23:56.468 30800 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:23:56 ctl02 nova-api[30800]: 2017-09-28 12:23:56.468 30800 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:23:56 ctl02 nova-api[30800]: 2017-09-28 12:23:56.468 30800 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:23:56 ctl02 nova-api[30800]: 2017-09-28 12:23:56.468 30800 ERROR nova
Sep 28 12:23:56 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:23:56 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:23:56 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:23:56 ctl02 heat-api[13008]: 2017-09-28 12:23:56.838 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:23:56] "OPTIONS / HTTP/1.0" 200 134 0.000704
Sep 28 12:23:56 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:23:56 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:23:56 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:23:56 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:23:58 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:23:58.100 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:23:58] "OPTIONS / HTTP/1.0" 200 134 0.000453
Sep 28 12:23:58 ctl02 heat-api-cfn[13300]: 2017-09-28 12:23:58.560 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:23:58] "OPTIONS / HTTP/1.0" 200 134 0.000465
Sep 28 12:23:58 ctl02 nova-api[30817]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:23:58 ctl02 nova-api[30817]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:23:58 ctl02 nova-api[30817]: 2017-09-28 12:23:58.743 30817 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:23:58 ctl02 nova-api[30817]: 2017-09-28 12:23:58.745 30817 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:23:58 ctl02 nova-api[30817]: 2017-09-28 12:23:58.745 30817 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:23:58 ctl02 nova-api[30817]: 2017-09-28 12:23:58.745 30817 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:23:58 ctl02 nova-api[30817]: 2017-09-28 12:23:58.745 30817 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:23:58 ctl02 nova-api[30817]: 2017-09-28 12:23:58.745 30817 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:23:58 ctl02 nova-api[30817]: 2017-09-28 12:23:58.745 30817 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:23:58 ctl02 nova-api[30817]: 2017-09-28 12:23:58.745 30817 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:23:58 ctl02 nova-api[30817]: 2017-09-28 12:23:58.745 30817 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:23:58 ctl02 nova-api[30817]: 2017-09-28 12:23:58.745 30817 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:23:58 ctl02 nova-api[30817]: 2017-09-28 12:23:58.745 30817 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:23:58 ctl02 nova-api[30817]: 2017-09-28 12:23:58.745 30817 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:23:58 ctl02 nova-api[30817]: 2017-09-28 12:23:58.745 30817 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:23:58 ctl02 nova-api[30817]: 2017-09-28 12:23:58.745 30817 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:23:58 ctl02 nova-api[30817]: 2017-09-28 12:23:58.745 30817 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:23:58 ctl02 nova-api[30817]: 2017-09-28 12:23:58.745 30817 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:23:58 ctl02 nova-api[30817]: 2017-09-28 12:23:58.745 30817 ERROR nova.wsgi     self.filename))
Sep 28 12:23:58 ctl02 nova-api[30817]: 2017-09-28 12:23:58.745 30817 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:23:58 ctl02 nova-api[30817]: 2017-09-28 12:23:58.745 30817 ERROR nova.wsgi
Sep 28 12:23:58 ctl02 nova-api[30817]: 2017-09-28 12:23:58.746 30817 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:23:58 ctl02 nova-api[30817]: 2017-09-28 12:23:58.874 30817 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:23:59 ctl02 nova-api[30817]: 2017-09-28 12:23:59.099 30817 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:23:59 ctl02 nova-api[30817]: 2017-09-28 12:23:59.101 30817 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:23:59 ctl02 nova-api[30817]: 2017-09-28 12:23:59.102 30817 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:23:59 ctl02 nova-api[30817]: 2017-09-28 12:23:59.102 30817 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:23:59 ctl02 heat-api-cfn[13300]: 2017-09-28 12:23:59.193 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:23:59] "OPTIONS / HTTP/1.0" 200 134 0.000469
Sep 28 12:23:59 ctl02 nova-api[30817]: 2017-09-28 12:23:59.233 30817 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:23:59 ctl02 nova-api[30817]: 2017-09-28 12:23:59.235 30817 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:23:59 ctl02 nova-api[30817]: 2017-09-28 12:23:59.235 30817 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:23:59 ctl02 nova-api[30817]: 2017-09-28 12:23:59.235 30817 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:23:59 ctl02 nova-api[30817]: 2017-09-28 12:23:59.238 30817 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:23:59 ctl02 nova-api[30817]: 2017-09-28 12:23:59.239 30817 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:23:59 ctl02 nova-api[30817]: 2017-09-28 12:23:59.239 30817 ERROR nova Traceback (most recent call last):
Sep 28 12:23:59 ctl02 nova-api[30817]: 2017-09-28 12:23:59.239 30817 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:23:59 ctl02 nova-api[30817]: 2017-09-28 12:23:59.239 30817 ERROR nova     sys.exit(main())
Sep 28 12:23:59 ctl02 nova-api[30817]: 2017-09-28 12:23:59.239 30817 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:23:59 ctl02 nova-api[30817]: 2017-09-28 12:23:59.239 30817 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:23:59 ctl02 nova-api[30817]: 2017-09-28 12:23:59.239 30817 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:23:59 ctl02 nova-api[30817]: 2017-09-28 12:23:59.239 30817 ERROR nova     max_url_len=max_url_len)
Sep 28 12:23:59 ctl02 nova-api[30817]: 2017-09-28 12:23:59.239 30817 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:23:59 ctl02 nova-api[30817]: 2017-09-28 12:23:59.239 30817 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:23:59 ctl02 nova-api[30817]: 2017-09-28 12:23:59.239 30817 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:23:59 ctl02 nova-api[30817]: 2017-09-28 12:23:59.239 30817 ERROR nova     sock.listen(backlog)
Sep 28 12:23:59 ctl02 nova-api[30817]: 2017-09-28 12:23:59.239 30817 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:23:59 ctl02 nova-api[30817]: 2017-09-28 12:23:59.239 30817 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:23:59 ctl02 nova-api[30817]: 2017-09-28 12:23:59.239 30817 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:23:59 ctl02 nova-api[30817]: 2017-09-28 12:23:59.239 30817 ERROR nova
Sep 28 12:23:59 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:23:59 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:23:59 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:23:59 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:23:59 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:23:59 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:23:59 ctl02 heat-api[13008]: 2017-09-28 12:23:59.649 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:23:59] "OPTIONS / HTTP/1.0" 200 134 0.000785
Sep 28 12:23:59 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:23:59 ctl02 heat-api-cfn[13300]: 2017-09-28 12:23:59.952 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:23:59] "OPTIONS / HTTP/1.0" 200 134 0.000549
Sep 28 12:24:00 ctl02 neutron-server[30536]: 2017-09-28 12:24:00.071 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:24:00] "OPTIONS / HTTP/1.0" 200 262 0.000550
Sep 28 12:24:00 ctl02 neutron-server[30536]: 2017-09-28 12:24:00.416 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:24:00] "OPTIONS / HTTP/1.0" 200 262 0.000556
Sep 28 12:24:00 ctl02 glance-api[29183]: 2017-09-28 12:24:00.487 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:24:00] "OPTIONS / HTTP/1.0" 200 134 0.000660
Sep 28 12:24:01 ctl02 neutron-server[30536]: 2017-09-28 12:24:01.199 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:24:01] "OPTIONS / HTTP/1.0" 200 262 0.000572
Sep 28 12:24:01 ctl02 nova-api[30836]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:24:01 ctl02 nova-api[30836]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:24:01 ctl02 nova-api[30836]: 2017-09-28 12:24:01.549 30836 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:24:01 ctl02 nova-api[30836]: 2017-09-28 12:24:01.550 30836 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:24:01 ctl02 nova-api[30836]: 2017-09-28 12:24:01.550 30836 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:24:01 ctl02 nova-api[30836]: 2017-09-28 12:24:01.550 30836 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:24:01 ctl02 nova-api[30836]: 2017-09-28 12:24:01.550 30836 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:24:01 ctl02 nova-api[30836]: 2017-09-28 12:24:01.550 30836 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:24:01 ctl02 nova-api[30836]: 2017-09-28 12:24:01.550 30836 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:24:01 ctl02 nova-api[30836]: 2017-09-28 12:24:01.550 30836 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:24:01 ctl02 nova-api[30836]: 2017-09-28 12:24:01.550 30836 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:24:01 ctl02 nova-api[30836]: 2017-09-28 12:24:01.550 30836 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:24:01 ctl02 nova-api[30836]: 2017-09-28 12:24:01.550 30836 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:24:01 ctl02 nova-api[30836]: 2017-09-28 12:24:01.550 30836 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:24:01 ctl02 nova-api[30836]: 2017-09-28 12:24:01.550 30836 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:24:01 ctl02 nova-api[30836]: 2017-09-28 12:24:01.550 30836 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:24:01 ctl02 nova-api[30836]: 2017-09-28 12:24:01.550 30836 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:24:01 ctl02 nova-api[30836]: 2017-09-28 12:24:01.550 30836 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:24:01 ctl02 nova-api[30836]: 2017-09-28 12:24:01.550 30836 ERROR nova.wsgi     self.filename))
Sep 28 12:24:01 ctl02 nova-api[30836]: 2017-09-28 12:24:01.550 30836 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:24:01 ctl02 nova-api[30836]: 2017-09-28 12:24:01.550 30836 ERROR nova.wsgi
Sep 28 12:24:01 ctl02 nova-api[30836]: 2017-09-28 12:24:01.551 30836 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:24:01 ctl02 nova-api[30836]: 2017-09-28 12:24:01.687 30836 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:24:01 ctl02 nova-api[30836]: 2017-09-28 12:24:01.940 30836 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:24:01 ctl02 nova-api[30836]: 2017-09-28 12:24:01.942 30836 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:24:01 ctl02 nova-api[30836]: 2017-09-28 12:24:01.942 30836 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:24:01 ctl02 nova-api[30836]: 2017-09-28 12:24:01.943 30836 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:24:02 ctl02 nova-api[30836]: 2017-09-28 12:24:02.077 30836 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:24:02 ctl02 nova-api[30836]: 2017-09-28 12:24:02.079 30836 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:24:02 ctl02 nova-api[30836]: 2017-09-28 12:24:02.080 30836 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:24:02 ctl02 nova-api[30836]: 2017-09-28 12:24:02.080 30836 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:24:02 ctl02 nova-api[30836]: 2017-09-28 12:24:02.083 30836 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:24:02 ctl02 nova-api[30836]: 2017-09-28 12:24:02.084 30836 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:24:02 ctl02 nova-api[30836]: 2017-09-28 12:24:02.084 30836 ERROR nova Traceback (most recent call last):
Sep 28 12:24:02 ctl02 nova-api[30836]: 2017-09-28 12:24:02.084 30836 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:24:02 ctl02 nova-api[30836]: 2017-09-28 12:24:02.084 30836 ERROR nova     sys.exit(main())
Sep 28 12:24:02 ctl02 nova-api[30836]: 2017-09-28 12:24:02.084 30836 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:24:02 ctl02 nova-api[30836]: 2017-09-28 12:24:02.084 30836 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:24:02 ctl02 nova-api[30836]: 2017-09-28 12:24:02.084 30836 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:24:02 ctl02 nova-api[30836]: 2017-09-28 12:24:02.084 30836 ERROR nova     max_url_len=max_url_len)
Sep 28 12:24:02 ctl02 nova-api[30836]: 2017-09-28 12:24:02.084 30836 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:24:02 ctl02 nova-api[30836]: 2017-09-28 12:24:02.084 30836 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:24:02 ctl02 nova-api[30836]: 2017-09-28 12:24:02.084 30836 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:24:02 ctl02 nova-api[30836]: 2017-09-28 12:24:02.084 30836 ERROR nova     sock.listen(backlog)
Sep 28 12:24:02 ctl02 nova-api[30836]: 2017-09-28 12:24:02.084 30836 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:24:02 ctl02 nova-api[30836]: 2017-09-28 12:24:02.084 30836 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:24:02 ctl02 nova-api[30836]: 2017-09-28 12:24:02.084 30836 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:24:02 ctl02 nova-api[30836]: 2017-09-28 12:24:02.084 30836 ERROR nova
Sep 28 12:24:02 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:24:02 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:24:02 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:24:02 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:24:02 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:24:02 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:24:02 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:24:02 ctl02 glance-api[29183]: 2017-09-28 12:24:02.710 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:24:02] "OPTIONS / HTTP/1.0" 200 134 0.000651
Sep 28 12:24:03 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf6d8b819)
Sep 28 12:24:03 ctl02 glance-api[29183]: 2017-09-28 12:24:03.638 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:24:03] "OPTIONS / HTTP/1.0" 200 134 0.000585
Sep 28 12:24:03 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:24:03.801 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:24:03] "OPTIONS / HTTP/1.0" 200 134 0.000401
Sep 28 12:24:04 ctl02 nova-api[30854]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:24:04 ctl02 nova-api[30854]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:24:04 ctl02 nova-api[30854]: 2017-09-28 12:24:04.264 30854 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:24:04 ctl02 nova-api[30854]: 2017-09-28 12:24:04.266 30854 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:24:04 ctl02 nova-api[30854]: 2017-09-28 12:24:04.266 30854 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:24:04 ctl02 nova-api[30854]: 2017-09-28 12:24:04.266 30854 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:24:04 ctl02 nova-api[30854]: 2017-09-28 12:24:04.266 30854 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:24:04 ctl02 nova-api[30854]: 2017-09-28 12:24:04.266 30854 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:24:04 ctl02 nova-api[30854]: 2017-09-28 12:24:04.266 30854 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:24:04 ctl02 nova-api[30854]: 2017-09-28 12:24:04.266 30854 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:24:04 ctl02 nova-api[30854]: 2017-09-28 12:24:04.266 30854 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:24:04 ctl02 nova-api[30854]: 2017-09-28 12:24:04.266 30854 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:24:04 ctl02 nova-api[30854]: 2017-09-28 12:24:04.266 30854 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:24:04 ctl02 nova-api[30854]: 2017-09-28 12:24:04.266 30854 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:24:04 ctl02 nova-api[30854]: 2017-09-28 12:24:04.266 30854 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:24:04 ctl02 nova-api[30854]: 2017-09-28 12:24:04.266 30854 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:24:04 ctl02 nova-api[30854]: 2017-09-28 12:24:04.266 30854 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:24:04 ctl02 nova-api[30854]: 2017-09-28 12:24:04.266 30854 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:24:04 ctl02 nova-api[30854]: 2017-09-28 12:24:04.266 30854 ERROR nova.wsgi     self.filename))
Sep 28 12:24:04 ctl02 nova-api[30854]: 2017-09-28 12:24:04.266 30854 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:24:04 ctl02 nova-api[30854]: 2017-09-28 12:24:04.266 30854 ERROR nova.wsgi
Sep 28 12:24:04 ctl02 nova-api[30854]: 2017-09-28 12:24:04.268 30854 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:24:04 ctl02 nova-api[30854]: 2017-09-28 12:24:04.395 30854 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:24:04 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf6d8b819)
Sep 28 12:24:04 ctl02 nova-api[30854]: 2017-09-28 12:24:04.610 30854 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:24:04 ctl02 nova-api[30854]: 2017-09-28 12:24:04.612 30854 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:24:04 ctl02 nova-api[30854]: 2017-09-28 12:24:04.612 30854 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:24:04 ctl02 nova-api[30854]: 2017-09-28 12:24:04.613 30854 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:24:04 ctl02 nova-api[30854]: 2017-09-28 12:24:04.740 30854 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:24:04 ctl02 nova-api[30854]: 2017-09-28 12:24:04.742 30854 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:24:04 ctl02 nova-api[30854]: 2017-09-28 12:24:04.742 30854 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:24:04 ctl02 nova-api[30854]: 2017-09-28 12:24:04.742 30854 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:24:04 ctl02 nova-api[30854]: 2017-09-28 12:24:04.745 30854 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:24:04 ctl02 nova-api[30854]: 2017-09-28 12:24:04.746 30854 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:24:04 ctl02 nova-api[30854]: 2017-09-28 12:24:04.746 30854 ERROR nova Traceback (most recent call last):
Sep 28 12:24:04 ctl02 nova-api[30854]: 2017-09-28 12:24:04.746 30854 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:24:04 ctl02 nova-api[30854]: 2017-09-28 12:24:04.746 30854 ERROR nova     sys.exit(main())
Sep 28 12:24:04 ctl02 nova-api[30854]: 2017-09-28 12:24:04.746 30854 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:24:04 ctl02 nova-api[30854]: 2017-09-28 12:24:04.746 30854 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:24:04 ctl02 nova-api[30854]: 2017-09-28 12:24:04.746 30854 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:24:04 ctl02 nova-api[30854]: 2017-09-28 12:24:04.746 30854 ERROR nova     max_url_len=max_url_len)
Sep 28 12:24:04 ctl02 nova-api[30854]: 2017-09-28 12:24:04.746 30854 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:24:04 ctl02 nova-api[30854]: 2017-09-28 12:24:04.746 30854 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:24:04 ctl02 nova-api[30854]: 2017-09-28 12:24:04.746 30854 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:24:04 ctl02 nova-api[30854]: 2017-09-28 12:24:04.746 30854 ERROR nova     sock.listen(backlog)
Sep 28 12:24:04 ctl02 nova-api[30854]: 2017-09-28 12:24:04.746 30854 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:24:04 ctl02 nova-api[30854]: 2017-09-28 12:24:04.746 30854 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:24:04 ctl02 nova-api[30854]: 2017-09-28 12:24:04.746 30854 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:24:04 ctl02 nova-api[30854]: 2017-09-28 12:24:04.746 30854 ERROR nova
Sep 28 12:24:04 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:24:04 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:24:04 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:24:04 ctl02 heat-api[13008]: 2017-09-28 12:24:04.963 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:24:04] "OPTIONS / HTTP/1.0" 200 134 0.000768
Sep 28 12:24:05 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:24:05.053 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:24:05] "OPTIONS / HTTP/1.0" 200 134 0.000539
Sep 28 12:24:05 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:24:05 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:24:05 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:24:05 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:24:05 ctl02 nova-cert[4860]: 2017-09-28 12:24:05.335 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:24:05 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf6d8b819)
Sep 28 12:24:06 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf6d8b819)
Sep 28 12:24:06 ctl02 nova-conductor[5056]: 2017-09-28 12:24:06.633 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:24:06 ctl02 nova-conductor[5056]: 2017-09-28 12:24:06.650 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:24:06 ctl02 nova-conductor[5056]: 2017-09-28 12:24:06.670 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:24:06 ctl02 nova-conductor[5056]: 2017-09-28 12:24:06.674 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:24:06 ctl02 heat-api[13008]: 2017-09-28 12:24:06.714 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:24:06] "OPTIONS / HTTP/1.0" 200 134 0.000596
Sep 28 12:24:06 ctl02 nova-api[30872]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:24:06 ctl02 nova-api[30872]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:24:07 ctl02 nova-api[30872]: 2017-09-28 12:24:07.005 30872 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:24:07 ctl02 nova-api[30872]: 2017-09-28 12:24:07.006 30872 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:24:07 ctl02 nova-api[30872]: 2017-09-28 12:24:07.006 30872 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:24:07 ctl02 nova-api[30872]: 2017-09-28 12:24:07.006 30872 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:24:07 ctl02 nova-api[30872]: 2017-09-28 12:24:07.006 30872 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:24:07 ctl02 nova-api[30872]: 2017-09-28 12:24:07.006 30872 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:24:07 ctl02 nova-api[30872]: 2017-09-28 12:24:07.006 30872 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:24:07 ctl02 nova-api[30872]: 2017-09-28 12:24:07.006 30872 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:24:07 ctl02 nova-api[30872]: 2017-09-28 12:24:07.006 30872 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:24:07 ctl02 nova-api[30872]: 2017-09-28 12:24:07.006 30872 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:24:07 ctl02 nova-api[30872]: 2017-09-28 12:24:07.006 30872 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:24:07 ctl02 nova-api[30872]: 2017-09-28 12:24:07.006 30872 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:24:07 ctl02 nova-api[30872]: 2017-09-28 12:24:07.006 30872 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:24:07 ctl02 nova-api[30872]: 2017-09-28 12:24:07.006 30872 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:24:07 ctl02 nova-api[30872]: 2017-09-28 12:24:07.006 30872 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:24:07 ctl02 nova-api[30872]: 2017-09-28 12:24:07.006 30872 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:24:07 ctl02 nova-api[30872]: 2017-09-28 12:24:07.006 30872 ERROR nova.wsgi     self.filename))
Sep 28 12:24:07 ctl02 nova-api[30872]: 2017-09-28 12:24:07.006 30872 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:24:07 ctl02 nova-api[30872]: 2017-09-28 12:24:07.006 30872 ERROR nova.wsgi
Sep 28 12:24:07 ctl02 nova-api[30872]: 2017-09-28 12:24:07.007 30872 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:24:07 ctl02 nova-api[30872]: 2017-09-28 12:24:07.135 30872 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:24:07 ctl02 nova-api[30872]: 2017-09-28 12:24:07.361 30872 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:24:07 ctl02 nova-api[30872]: 2017-09-28 12:24:07.363 30872 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:24:07 ctl02 nova-api[30872]: 2017-09-28 12:24:07.363 30872 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:24:07 ctl02 nova-api[30872]: 2017-09-28 12:24:07.363 30872 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:24:07 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf6d8b819)
Sep 28 12:24:07 ctl02 nova-api[30872]: 2017-09-28 12:24:07.496 30872 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:24:07 ctl02 nova-api[30872]: 2017-09-28 12:24:07.498 30872 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:24:07 ctl02 nova-api[30872]: 2017-09-28 12:24:07.498 30872 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:24:07 ctl02 nova-api[30872]: 2017-09-28 12:24:07.499 30872 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:24:07 ctl02 nova-api[30872]: 2017-09-28 12:24:07.502 30872 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:24:07 ctl02 nova-api[30872]: 2017-09-28 12:24:07.503 30872 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:24:07 ctl02 nova-api[30872]: 2017-09-28 12:24:07.503 30872 ERROR nova Traceback (most recent call last):
Sep 28 12:24:07 ctl02 nova-api[30872]: 2017-09-28 12:24:07.503 30872 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:24:07 ctl02 nova-api[30872]: 2017-09-28 12:24:07.503 30872 ERROR nova     sys.exit(main())
Sep 28 12:24:07 ctl02 nova-api[30872]: 2017-09-28 12:24:07.503 30872 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:24:07 ctl02 nova-api[30872]: 2017-09-28 12:24:07.503 30872 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:24:07 ctl02 nova-api[30872]: 2017-09-28 12:24:07.503 30872 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:24:07 ctl02 nova-api[30872]: 2017-09-28 12:24:07.503 30872 ERROR nova     max_url_len=max_url_len)
Sep 28 12:24:07 ctl02 nova-api[30872]: 2017-09-28 12:24:07.503 30872 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:24:07 ctl02 nova-api[30872]: 2017-09-28 12:24:07.503 30872 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:24:07 ctl02 nova-api[30872]: 2017-09-28 12:24:07.503 30872 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:24:07 ctl02 nova-api[30872]: 2017-09-28 12:24:07.503 30872 ERROR nova     sock.listen(backlog)
Sep 28 12:24:07 ctl02 nova-api[30872]: 2017-09-28 12:24:07.503 30872 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:24:07 ctl02 nova-api[30872]: 2017-09-28 12:24:07.503 30872 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:24:07 ctl02 nova-api[30872]: 2017-09-28 12:24:07.503 30872 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:24:07 ctl02 nova-api[30872]: 2017-09-28 12:24:07.503 30872 ERROR nova
Sep 28 12:24:07 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:24:07 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:24:07 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:24:07 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:24:07 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:24:07 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:24:07 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:24:08 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:24:08.421 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:24:08] "OPTIONS / HTTP/1.0" 200 134 0.000519
Sep 28 12:24:08 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf6d8b819)
Sep 28 12:24:08 ctl02 heat-api-cfn[13300]: 2017-09-28 12:24:08.491 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:24:08] "OPTIONS / HTTP/1.0" 200 134 0.000585
Sep 28 12:24:09 ctl02 heat-api-cfn[13300]: 2017-09-28 12:24:09.146 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:24:09] "OPTIONS / HTTP/1.0" 200 134 0.000573
Sep 28 12:24:09 ctl02 heat-api[13008]: 2017-09-28 12:24:09.434 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:24:09] "OPTIONS / HTTP/1.0" 200 134 0.000696
Sep 28 12:24:09 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf6d8b819)
Sep 28 12:24:09 ctl02 nova-api[30889]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:24:09 ctl02 nova-api[30889]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:24:09 ctl02 heat-api-cfn[13300]: 2017-09-28 12:24:09.707 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:24:09] "OPTIONS / HTTP/1.0" 200 134 0.000545
Sep 28 12:24:09 ctl02 nova-api[30889]: 2017-09-28 12:24:09.751 30889 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:24:09 ctl02 nova-api[30889]: 2017-09-28 12:24:09.753 30889 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:24:09 ctl02 nova-api[30889]: 2017-09-28 12:24:09.753 30889 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:24:09 ctl02 nova-api[30889]: 2017-09-28 12:24:09.753 30889 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:24:09 ctl02 nova-api[30889]: 2017-09-28 12:24:09.753 30889 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:24:09 ctl02 nova-api[30889]: 2017-09-28 12:24:09.753 30889 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:24:09 ctl02 nova-api[30889]: 2017-09-28 12:24:09.753 30889 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:24:09 ctl02 nova-api[30889]: 2017-09-28 12:24:09.753 30889 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:24:09 ctl02 nova-api[30889]: 2017-09-28 12:24:09.753 30889 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:24:09 ctl02 nova-api[30889]: 2017-09-28 12:24:09.753 30889 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:24:09 ctl02 nova-api[30889]: 2017-09-28 12:24:09.753 30889 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:24:09 ctl02 nova-api[30889]: 2017-09-28 12:24:09.753 30889 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:24:09 ctl02 nova-api[30889]: 2017-09-28 12:24:09.753 30889 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:24:09 ctl02 nova-api[30889]: 2017-09-28 12:24:09.753 30889 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:24:09 ctl02 nova-api[30889]: 2017-09-28 12:24:09.753 30889 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:24:09 ctl02 nova-api[30889]: 2017-09-28 12:24:09.753 30889 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:24:09 ctl02 nova-api[30889]: 2017-09-28 12:24:09.753 30889 ERROR nova.wsgi     self.filename))
Sep 28 12:24:09 ctl02 nova-api[30889]: 2017-09-28 12:24:09.753 30889 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:24:09 ctl02 nova-api[30889]: 2017-09-28 12:24:09.753 30889 ERROR nova.wsgi
Sep 28 12:24:09 ctl02 nova-api[30889]: 2017-09-28 12:24:09.754 30889 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:24:09 ctl02 nova-api[30889]: 2017-09-28 12:24:09.887 30889 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:24:10 ctl02 nova-api[30889]: 2017-09-28 12:24:10.131 30889 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:24:10 ctl02 nova-api[30889]: 2017-09-28 12:24:10.134 30889 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:24:10 ctl02 nova-api[30889]: 2017-09-28 12:24:10.134 30889 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:24:10 ctl02 nova-api[30889]: 2017-09-28 12:24:10.134 30889 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:24:10 ctl02 neutron-server[30536]: 2017-09-28 12:24:10.135 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:24:10] "OPTIONS / HTTP/1.0" 200 262 0.000512
Sep 28 12:24:10 ctl02 nova-api[30889]: 2017-09-28 12:24:10.268 30889 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:24:10 ctl02 nova-api[30889]: 2017-09-28 12:24:10.270 30889 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:24:10 ctl02 nova-api[30889]: 2017-09-28 12:24:10.270 30889 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:24:10 ctl02 nova-api[30889]: 2017-09-28 12:24:10.270 30889 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:24:10 ctl02 nova-api[30889]: 2017-09-28 12:24:10.273 30889 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:24:10 ctl02 nova-api[30889]: 2017-09-28 12:24:10.274 30889 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:24:10 ctl02 nova-api[30889]: 2017-09-28 12:24:10.274 30889 ERROR nova Traceback (most recent call last):
Sep 28 12:24:10 ctl02 nova-api[30889]: 2017-09-28 12:24:10.274 30889 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:24:10 ctl02 nova-api[30889]: 2017-09-28 12:24:10.274 30889 ERROR nova     sys.exit(main())
Sep 28 12:24:10 ctl02 nova-api[30889]: 2017-09-28 12:24:10.274 30889 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:24:10 ctl02 nova-api[30889]: 2017-09-28 12:24:10.274 30889 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:24:10 ctl02 nova-api[30889]: 2017-09-28 12:24:10.274 30889 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:24:10 ctl02 nova-api[30889]: 2017-09-28 12:24:10.274 30889 ERROR nova     max_url_len=max_url_len)
Sep 28 12:24:10 ctl02 nova-api[30889]: 2017-09-28 12:24:10.274 30889 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:24:10 ctl02 nova-api[30889]: 2017-09-28 12:24:10.274 30889 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:24:10 ctl02 nova-api[30889]: 2017-09-28 12:24:10.274 30889 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:24:10 ctl02 nova-api[30889]: 2017-09-28 12:24:10.274 30889 ERROR nova     sock.listen(backlog)
Sep 28 12:24:10 ctl02 nova-api[30889]: 2017-09-28 12:24:10.274 30889 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:24:10 ctl02 nova-api[30889]: 2017-09-28 12:24:10.274 30889 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:24:10 ctl02 nova-api[30889]: 2017-09-28 12:24:10.274 30889 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:24:10 ctl02 nova-api[30889]: 2017-09-28 12:24:10.274 30889 ERROR nova
Sep 28 12:24:10 ctl02 neutron-server[30536]: 2017-09-28 12:24:10.293 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:24:10] "OPTIONS / HTTP/1.0" 200 262 0.000616
Sep 28 12:24:10 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:24:10 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:24:10 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:24:10 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf6d8b819)
Sep 28 12:24:10 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:24:10 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:24:10 ctl02 glance-api[29183]: 2017-09-28 12:24:10.632 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:24:10] "OPTIONS / HTTP/1.0" 200 134 0.001121
Sep 28 12:24:10 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:24:10 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:24:11 ctl02 neutron-server[30536]: 2017-09-28 12:24:11.049 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:24:11] "OPTIONS / HTTP/1.0" 200 262 0.000657
Sep 28 12:24:11 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf6d8b819)
Sep 28 12:24:12 ctl02 nova-api[30907]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:24:12 ctl02 nova-api[30907]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:24:12 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf6d8b819)
Sep 28 12:24:12 ctl02 nova-api[30907]: 2017-09-28 12:24:12.477 30907 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:24:12 ctl02 nova-api[30907]: 2017-09-28 12:24:12.479 30907 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:24:12 ctl02 nova-api[30907]: 2017-09-28 12:24:12.479 30907 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:24:12 ctl02 nova-api[30907]: 2017-09-28 12:24:12.479 30907 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:24:12 ctl02 nova-api[30907]: 2017-09-28 12:24:12.479 30907 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:24:12 ctl02 nova-api[30907]: 2017-09-28 12:24:12.479 30907 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:24:12 ctl02 nova-api[30907]: 2017-09-28 12:24:12.479 30907 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:24:12 ctl02 nova-api[30907]: 2017-09-28 12:24:12.479 30907 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:24:12 ctl02 nova-api[30907]: 2017-09-28 12:24:12.479 30907 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:24:12 ctl02 nova-api[30907]: 2017-09-28 12:24:12.479 30907 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:24:12 ctl02 nova-api[30907]: 2017-09-28 12:24:12.479 30907 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:24:12 ctl02 nova-api[30907]: 2017-09-28 12:24:12.479 30907 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:24:12 ctl02 nova-api[30907]: 2017-09-28 12:24:12.479 30907 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:24:12 ctl02 nova-api[30907]: 2017-09-28 12:24:12.479 30907 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:24:12 ctl02 nova-api[30907]: 2017-09-28 12:24:12.479 30907 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:24:12 ctl02 nova-api[30907]: 2017-09-28 12:24:12.479 30907 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:24:12 ctl02 nova-api[30907]: 2017-09-28 12:24:12.479 30907 ERROR nova.wsgi     self.filename))
Sep 28 12:24:12 ctl02 nova-api[30907]: 2017-09-28 12:24:12.479 30907 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:24:12 ctl02 nova-api[30907]: 2017-09-28 12:24:12.479 30907 ERROR nova.wsgi
Sep 28 12:24:12 ctl02 nova-api[30907]: 2017-09-28 12:24:12.481 30907 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:24:12 ctl02 nova-api[30907]: 2017-09-28 12:24:12.607 30907 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:24:12 ctl02 glance-api[29183]: 2017-09-28 12:24:12.740 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:24:12] "OPTIONS / HTTP/1.0" 200 134 0.000587
Sep 28 12:24:12 ctl02 nova-api[30907]: 2017-09-28 12:24:12.837 30907 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:24:12 ctl02 nova-api[30907]: 2017-09-28 12:24:12.840 30907 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:24:12 ctl02 nova-api[30907]: 2017-09-28 12:24:12.840 30907 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:24:12 ctl02 nova-api[30907]: 2017-09-28 12:24:12.840 30907 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:24:12 ctl02 nova-api[30907]: 2017-09-28 12:24:12.971 30907 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:24:12 ctl02 nova-api[30907]: 2017-09-28 12:24:12.972 30907 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:24:12 ctl02 nova-api[30907]: 2017-09-28 12:24:12.973 30907 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:24:12 ctl02 nova-api[30907]: 2017-09-28 12:24:12.973 30907 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:24:12 ctl02 nova-api[30907]: 2017-09-28 12:24:12.976 30907 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:24:12 ctl02 nova-api[30907]: 2017-09-28 12:24:12.976 30907 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:24:12 ctl02 nova-api[30907]: 2017-09-28 12:24:12.976 30907 ERROR nova Traceback (most recent call last):
Sep 28 12:24:12 ctl02 nova-api[30907]: 2017-09-28 12:24:12.976 30907 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:24:12 ctl02 nova-api[30907]: 2017-09-28 12:24:12.976 30907 ERROR nova     sys.exit(main())
Sep 28 12:24:12 ctl02 nova-api[30907]: 2017-09-28 12:24:12.976 30907 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:24:12 ctl02 nova-api[30907]: 2017-09-28 12:24:12.976 30907 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:24:12 ctl02 nova-api[30907]: 2017-09-28 12:24:12.976 30907 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:24:12 ctl02 nova-api[30907]: 2017-09-28 12:24:12.976 30907 ERROR nova     max_url_len=max_url_len)
Sep 28 12:24:12 ctl02 nova-api[30907]: 2017-09-28 12:24:12.976 30907 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:24:12 ctl02 nova-api[30907]: 2017-09-28 12:24:12.976 30907 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:24:12 ctl02 nova-api[30907]: 2017-09-28 12:24:12.976 30907 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:24:12 ctl02 nova-api[30907]: 2017-09-28 12:24:12.976 30907 ERROR nova     sock.listen(backlog)
Sep 28 12:24:12 ctl02 nova-api[30907]: 2017-09-28 12:24:12.976 30907 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:24:12 ctl02 nova-api[30907]: 2017-09-28 12:24:12.976 30907 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:24:12 ctl02 nova-api[30907]: 2017-09-28 12:24:12.976 30907 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:24:12 ctl02 nova-api[30907]: 2017-09-28 12:24:12.976 30907 ERROR nova
Sep 28 12:24:13 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:24:13 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:24:13 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:24:13 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:24:13 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:24:13 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:24:13 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:24:13 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf6d8b819)
Sep 28 12:24:13 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:24:13.779 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:24:13] "OPTIONS / HTTP/1.0" 200 134 0.000414
Sep 28 12:24:13 ctl02 glance-api[29183]: 2017-09-28 12:24:13.979 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:24:13] "OPTIONS / HTTP/1.0" 200 134 0.000671
Sep 28 12:24:14 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:24:14 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:24:14 ctl02 heat-api[13008]: 2017-09-28 12:24:14.749 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:24:14] "OPTIONS / HTTP/1.0" 200 134 0.000514
Sep 28 12:24:15 ctl02 nova-api[30926]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:24:15 ctl02 nova-api[30926]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:24:15 ctl02 nova-consoleauth[5433]: 2017-09-28 12:24:15.220 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:24:15 ctl02 nova-api[30926]: 2017-09-28 12:24:15.230 30926 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:24:15 ctl02 nova-api[30926]: 2017-09-28 12:24:15.231 30926 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:24:15 ctl02 nova-api[30926]: 2017-09-28 12:24:15.231 30926 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:24:15 ctl02 nova-api[30926]: 2017-09-28 12:24:15.231 30926 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:24:15 ctl02 nova-api[30926]: 2017-09-28 12:24:15.231 30926 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:24:15 ctl02 nova-api[30926]: 2017-09-28 12:24:15.231 30926 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:24:15 ctl02 nova-api[30926]: 2017-09-28 12:24:15.231 30926 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:24:15 ctl02 nova-api[30926]: 2017-09-28 12:24:15.231 30926 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:24:15 ctl02 nova-api[30926]: 2017-09-28 12:24:15.231 30926 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:24:15 ctl02 nova-api[30926]: 2017-09-28 12:24:15.231 30926 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:24:15 ctl02 nova-api[30926]: 2017-09-28 12:24:15.231 30926 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:24:15 ctl02 nova-api[30926]: 2017-09-28 12:24:15.231 30926 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:24:15 ctl02 nova-api[30926]: 2017-09-28 12:24:15.231 30926 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:24:15 ctl02 nova-api[30926]: 2017-09-28 12:24:15.231 30926 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:24:15 ctl02 nova-api[30926]: 2017-09-28 12:24:15.231 30926 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:24:15 ctl02 nova-api[30926]: 2017-09-28 12:24:15.231 30926 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:24:15 ctl02 nova-api[30926]: 2017-09-28 12:24:15.231 30926 ERROR nova.wsgi     self.filename))
Sep 28 12:24:15 ctl02 nova-api[30926]: 2017-09-28 12:24:15.231 30926 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:24:15 ctl02 nova-api[30926]: 2017-09-28 12:24:15.231 30926 ERROR nova.wsgi
Sep 28 12:24:15 ctl02 nova-api[30926]: 2017-09-28 12:24:15.232 30926 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:24:15 ctl02 nova-api[30926]: 2017-09-28 12:24:15.362 30926 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:24:15 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:24:15.423 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:24:15] "OPTIONS / HTTP/1.0" 200 134 0.000432
Sep 28 12:24:15 ctl02 nova-api[30926]: 2017-09-28 12:24:15.587 30926 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:24:15 ctl02 nova-api[30926]: 2017-09-28 12:24:15.589 30926 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:24:15 ctl02 nova-api[30926]: 2017-09-28 12:24:15.589 30926 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:24:15 ctl02 nova-api[30926]: 2017-09-28 12:24:15.590 30926 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:24:15 ctl02 nova-api[30926]: 2017-09-28 12:24:15.719 30926 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:24:15 ctl02 nova-api[30926]: 2017-09-28 12:24:15.721 30926 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:24:15 ctl02 nova-api[30926]: 2017-09-28 12:24:15.721 30926 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:24:15 ctl02 nova-api[30926]: 2017-09-28 12:24:15.721 30926 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:24:15 ctl02 nova-api[30926]: 2017-09-28 12:24:15.724 30926 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:24:15 ctl02 nova-api[30926]: 2017-09-28 12:24:15.724 30926 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:24:15 ctl02 nova-api[30926]: 2017-09-28 12:24:15.724 30926 ERROR nova Traceback (most recent call last):
Sep 28 12:24:15 ctl02 nova-api[30926]: 2017-09-28 12:24:15.724 30926 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:24:15 ctl02 nova-api[30926]: 2017-09-28 12:24:15.724 30926 ERROR nova     sys.exit(main())
Sep 28 12:24:15 ctl02 nova-api[30926]: 2017-09-28 12:24:15.724 30926 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:24:15 ctl02 nova-api[30926]: 2017-09-28 12:24:15.724 30926 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:24:15 ctl02 nova-api[30926]: 2017-09-28 12:24:15.724 30926 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:24:15 ctl02 nova-api[30926]: 2017-09-28 12:24:15.724 30926 ERROR nova     max_url_len=max_url_len)
Sep 28 12:24:15 ctl02 nova-api[30926]: 2017-09-28 12:24:15.724 30926 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:24:15 ctl02 nova-api[30926]: 2017-09-28 12:24:15.724 30926 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:24:15 ctl02 nova-api[30926]: 2017-09-28 12:24:15.724 30926 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:24:15 ctl02 nova-api[30926]: 2017-09-28 12:24:15.724 30926 ERROR nova     sock.listen(backlog)
Sep 28 12:24:15 ctl02 nova-api[30926]: 2017-09-28 12:24:15.724 30926 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:24:15 ctl02 nova-api[30926]: 2017-09-28 12:24:15.724 30926 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:24:15 ctl02 nova-api[30926]: 2017-09-28 12:24:15.724 30926 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:24:15 ctl02 nova-api[30926]: 2017-09-28 12:24:15.724 30926 ERROR nova
Sep 28 12:24:15 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:24:15 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:24:15 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:24:16 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:24:16 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:24:16 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:24:16 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:24:16 ctl02 heat-api[13008]: 2017-09-28 12:24:16.505 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:24:16] "OPTIONS / HTTP/1.0" 200 134 0.000614
Sep 28 12:24:17 ctl02 heat-engine[12803]: 2017-09-28 12:24:17.754 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:24:17 ctl02 heat-engine[12803]: 2017-09-28 12:24:17.756 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:24:17 ctl02 heat-engine[12803]: 2017-09-28 12:24:17.760 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:24:17 ctl02 heat-engine[12803]: 2017-09-28 12:24:17.766 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:24:17 ctl02 nova-api[30949]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:24:17 ctl02 nova-api[30949]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:24:18 ctl02 nova-api[30949]: 2017-09-28 12:24:18.004 30949 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:24:18 ctl02 nova-api[30949]: 2017-09-28 12:24:18.005 30949 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:24:18 ctl02 nova-api[30949]: 2017-09-28 12:24:18.005 30949 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:24:18 ctl02 nova-api[30949]: 2017-09-28 12:24:18.005 30949 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:24:18 ctl02 nova-api[30949]: 2017-09-28 12:24:18.005 30949 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:24:18 ctl02 nova-api[30949]: 2017-09-28 12:24:18.005 30949 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:24:18 ctl02 nova-api[30949]: 2017-09-28 12:24:18.005 30949 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:24:18 ctl02 nova-api[30949]: 2017-09-28 12:24:18.005 30949 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:24:18 ctl02 nova-api[30949]: 2017-09-28 12:24:18.005 30949 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:24:18 ctl02 nova-api[30949]: 2017-09-28 12:24:18.005 30949 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:24:18 ctl02 nova-api[30949]: 2017-09-28 12:24:18.005 30949 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:24:18 ctl02 nova-api[30949]: 2017-09-28 12:24:18.005 30949 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:24:18 ctl02 nova-api[30949]: 2017-09-28 12:24:18.005 30949 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:24:18 ctl02 nova-api[30949]: 2017-09-28 12:24:18.005 30949 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:24:18 ctl02 nova-api[30949]: 2017-09-28 12:24:18.005 30949 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:24:18 ctl02 nova-api[30949]: 2017-09-28 12:24:18.005 30949 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:24:18 ctl02 nova-api[30949]: 2017-09-28 12:24:18.005 30949 ERROR nova.wsgi     self.filename))
Sep 28 12:24:18 ctl02 nova-api[30949]: 2017-09-28 12:24:18.005 30949 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:24:18 ctl02 nova-api[30949]: 2017-09-28 12:24:18.005 30949 ERROR nova.wsgi
Sep 28 12:24:18 ctl02 nova-api[30949]: 2017-09-28 12:24:18.006 30949 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:24:18 ctl02 nova-api[30949]: 2017-09-28 12:24:18.135 30949 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:24:18 ctl02 nova-scheduler[5620]: 2017-09-28 12:24:18.236 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:24:18 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:24:18.251 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:24:18] "OPTIONS / HTTP/1.0" 200 134 0.000447
Sep 28 12:24:18 ctl02 nova-api[30949]: 2017-09-28 12:24:18.365 30949 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:24:18 ctl02 nova-api[30949]: 2017-09-28 12:24:18.367 30949 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:24:18 ctl02 nova-api[30949]: 2017-09-28 12:24:18.368 30949 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:24:18 ctl02 nova-api[30949]: 2017-09-28 12:24:18.368 30949 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:24:18 ctl02 nova-api[30949]: 2017-09-28 12:24:18.499 30949 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:24:18 ctl02 nova-api[30949]: 2017-09-28 12:24:18.501 30949 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:24:18 ctl02 nova-api[30949]: 2017-09-28 12:24:18.501 30949 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:24:18 ctl02 nova-api[30949]: 2017-09-28 12:24:18.501 30949 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:24:18 ctl02 nova-api[30949]: 2017-09-28 12:24:18.504 30949 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:24:18 ctl02 nova-api[30949]: 2017-09-28 12:24:18.505 30949 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:24:18 ctl02 nova-api[30949]: 2017-09-28 12:24:18.505 30949 ERROR nova Traceback (most recent call last):
Sep 28 12:24:18 ctl02 nova-api[30949]: 2017-09-28 12:24:18.505 30949 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:24:18 ctl02 nova-api[30949]: 2017-09-28 12:24:18.505 30949 ERROR nova     sys.exit(main())
Sep 28 12:24:18 ctl02 nova-api[30949]: 2017-09-28 12:24:18.505 30949 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:24:18 ctl02 nova-api[30949]: 2017-09-28 12:24:18.505 30949 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:24:18 ctl02 nova-api[30949]: 2017-09-28 12:24:18.505 30949 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:24:18 ctl02 nova-api[30949]: 2017-09-28 12:24:18.505 30949 ERROR nova     max_url_len=max_url_len)
Sep 28 12:24:18 ctl02 nova-api[30949]: 2017-09-28 12:24:18.505 30949 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:24:18 ctl02 nova-api[30949]: 2017-09-28 12:24:18.505 30949 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:24:18 ctl02 nova-api[30949]: 2017-09-28 12:24:18.505 30949 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:24:18 ctl02 nova-api[30949]: 2017-09-28 12:24:18.505 30949 ERROR nova     sock.listen(backlog)
Sep 28 12:24:18 ctl02 nova-api[30949]: 2017-09-28 12:24:18.505 30949 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:24:18 ctl02 nova-api[30949]: 2017-09-28 12:24:18.505 30949 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:24:18 ctl02 nova-api[30949]: 2017-09-28 12:24:18.505 30949 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:24:18 ctl02 nova-api[30949]: 2017-09-28 12:24:18.505 30949 ERROR nova
Sep 28 12:24:18 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:24:18 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:24:18 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:24:18 ctl02 heat-api-cfn[13300]: 2017-09-28 12:24:18.775 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:24:18] "OPTIONS / HTTP/1.0" 200 134 0.000502
Sep 28 12:24:18 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:24:18 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:24:18 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:24:18 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:24:19 ctl02 heat-api-cfn[13300]: 2017-09-28 12:24:19.046 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:24:19] "OPTIONS / HTTP/1.0" 200 134 0.000530
Sep 28 12:24:19 ctl02 heat-api[13008]: 2017-09-28 12:24:19.288 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:24:19] "OPTIONS / HTTP/1.0" 200 134 0.000687
Sep 28 12:24:19 ctl02 heat-api-cfn[13300]: 2017-09-28 12:24:19.918 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:24:19] "OPTIONS / HTTP/1.0" 200 134 0.000616
Sep 28 12:24:20 ctl02 glance-api[29183]: 2017-09-28 12:24:20.282 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:24:20] "OPTIONS / HTTP/1.0" 200 134 0.000752
Sep 28 12:24:20 ctl02 neutron-server[30536]: 2017-09-28 12:24:20.450 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:24:20] "OPTIONS / HTTP/1.0" 200 262 0.000617
Sep 28 12:24:20 ctl02 nova-api[30967]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:24:20 ctl02 nova-api[30967]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:24:20 ctl02 neutron-server[30536]: 2017-09-28 12:24:20.562 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:24:20] "OPTIONS / HTTP/1.0" 200 262 0.000404
Sep 28 12:24:20 ctl02 nova-api[30967]: 2017-09-28 12:24:20.726 30967 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:24:20 ctl02 nova-api[30967]: 2017-09-28 12:24:20.728 30967 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:24:20 ctl02 nova-api[30967]: 2017-09-28 12:24:20.728 30967 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:24:20 ctl02 nova-api[30967]: 2017-09-28 12:24:20.728 30967 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:24:20 ctl02 nova-api[30967]: 2017-09-28 12:24:20.728 30967 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:24:20 ctl02 nova-api[30967]: 2017-09-28 12:24:20.728 30967 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:24:20 ctl02 nova-api[30967]: 2017-09-28 12:24:20.728 30967 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:24:20 ctl02 nova-api[30967]: 2017-09-28 12:24:20.728 30967 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:24:20 ctl02 nova-api[30967]: 2017-09-28 12:24:20.728 30967 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:24:20 ctl02 nova-api[30967]: 2017-09-28 12:24:20.728 30967 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:24:20 ctl02 nova-api[30967]: 2017-09-28 12:24:20.728 30967 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:24:20 ctl02 nova-api[30967]: 2017-09-28 12:24:20.728 30967 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:24:20 ctl02 nova-api[30967]: 2017-09-28 12:24:20.728 30967 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:24:20 ctl02 nova-api[30967]: 2017-09-28 12:24:20.728 30967 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:24:20 ctl02 nova-api[30967]: 2017-09-28 12:24:20.728 30967 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:24:20 ctl02 nova-api[30967]: 2017-09-28 12:24:20.728 30967 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:24:20 ctl02 nova-api[30967]: 2017-09-28 12:24:20.728 30967 ERROR nova.wsgi     self.filename))
Sep 28 12:24:20 ctl02 nova-api[30967]: 2017-09-28 12:24:20.728 30967 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:24:20 ctl02 nova-api[30967]: 2017-09-28 12:24:20.728 30967 ERROR nova.wsgi
Sep 28 12:24:20 ctl02 nova-api[30967]: 2017-09-28 12:24:20.730 30967 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:24:20 ctl02 nova-api[30967]: 2017-09-28 12:24:20.858 30967 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:24:21 ctl02 nova-api[30967]: 2017-09-28 12:24:21.079 30967 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:24:21 ctl02 nova-api[30967]: 2017-09-28 12:24:21.082 30967 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:24:21 ctl02 nova-api[30967]: 2017-09-28 12:24:21.082 30967 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:24:21 ctl02 nova-api[30967]: 2017-09-28 12:24:21.082 30967 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:24:21 ctl02 neutron-server[30536]: 2017-09-28 12:24:21.114 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:24:21] "OPTIONS / HTTP/1.0" 200 262 0.000612
Sep 28 12:24:21 ctl02 nova-api[30967]: 2017-09-28 12:24:21.212 30967 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:24:21 ctl02 nova-api[30967]: 2017-09-28 12:24:21.214 30967 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:24:21 ctl02 nova-api[30967]: 2017-09-28 12:24:21.214 30967 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:24:21 ctl02 nova-api[30967]: 2017-09-28 12:24:21.215 30967 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:24:21 ctl02 nova-api[30967]: 2017-09-28 12:24:21.218 30967 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:24:21 ctl02 nova-api[30967]: 2017-09-28 12:24:21.219 30967 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:24:21 ctl02 nova-api[30967]: 2017-09-28 12:24:21.219 30967 ERROR nova Traceback (most recent call last):
Sep 28 12:24:21 ctl02 nova-api[30967]: 2017-09-28 12:24:21.219 30967 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:24:21 ctl02 nova-api[30967]: 2017-09-28 12:24:21.219 30967 ERROR nova     sys.exit(main())
Sep 28 12:24:21 ctl02 nova-api[30967]: 2017-09-28 12:24:21.219 30967 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:24:21 ctl02 nova-api[30967]: 2017-09-28 12:24:21.219 30967 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:24:21 ctl02 nova-api[30967]: 2017-09-28 12:24:21.219 30967 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:24:21 ctl02 nova-api[30967]: 2017-09-28 12:24:21.219 30967 ERROR nova     max_url_len=max_url_len)
Sep 28 12:24:21 ctl02 nova-api[30967]: 2017-09-28 12:24:21.219 30967 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:24:21 ctl02 nova-api[30967]: 2017-09-28 12:24:21.219 30967 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:24:21 ctl02 nova-api[30967]: 2017-09-28 12:24:21.219 30967 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:24:21 ctl02 nova-api[30967]: 2017-09-28 12:24:21.219 30967 ERROR nova     sock.listen(backlog)
Sep 28 12:24:21 ctl02 nova-api[30967]: 2017-09-28 12:24:21.219 30967 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:24:21 ctl02 nova-api[30967]: 2017-09-28 12:24:21.219 30967 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:24:21 ctl02 nova-api[30967]: 2017-09-28 12:24:21.219 30967 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:24:21 ctl02 nova-api[30967]: 2017-09-28 12:24:21.219 30967 ERROR nova
Sep 28 12:24:21 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:24:21 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:24:21 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:24:21 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:24:21 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:24:21 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:24:21 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:24:23 ctl02 glance-api[29183]: 2017-09-28 12:24:23.035 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:24:23] "OPTIONS / HTTP/1.0" 200 134 0.000560
Sep 28 12:24:23 ctl02 nova-api[30985]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:24:23 ctl02 nova-api[30985]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:24:23 ctl02 nova-api[30985]: 2017-09-28 12:24:23.502 30985 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:24:23 ctl02 nova-api[30985]: 2017-09-28 12:24:23.504 30985 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:24:23 ctl02 nova-api[30985]: 2017-09-28 12:24:23.504 30985 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:24:23 ctl02 nova-api[30985]: 2017-09-28 12:24:23.504 30985 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:24:23 ctl02 nova-api[30985]: 2017-09-28 12:24:23.504 30985 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:24:23 ctl02 nova-api[30985]: 2017-09-28 12:24:23.504 30985 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:24:23 ctl02 nova-api[30985]: 2017-09-28 12:24:23.504 30985 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:24:23 ctl02 nova-api[30985]: 2017-09-28 12:24:23.504 30985 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:24:23 ctl02 nova-api[30985]: 2017-09-28 12:24:23.504 30985 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:24:23 ctl02 nova-api[30985]: 2017-09-28 12:24:23.504 30985 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:24:23 ctl02 nova-api[30985]: 2017-09-28 12:24:23.504 30985 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:24:23 ctl02 nova-api[30985]: 2017-09-28 12:24:23.504 30985 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:24:23 ctl02 nova-api[30985]: 2017-09-28 12:24:23.504 30985 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:24:23 ctl02 nova-api[30985]: 2017-09-28 12:24:23.504 30985 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:24:23 ctl02 nova-api[30985]: 2017-09-28 12:24:23.504 30985 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:24:23 ctl02 nova-api[30985]: 2017-09-28 12:24:23.504 30985 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:24:23 ctl02 nova-api[30985]: 2017-09-28 12:24:23.504 30985 ERROR nova.wsgi     self.filename))
Sep 28 12:24:23 ctl02 nova-api[30985]: 2017-09-28 12:24:23.504 30985 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:24:23 ctl02 nova-api[30985]: 2017-09-28 12:24:23.504 30985 ERROR nova.wsgi
Sep 28 12:24:23 ctl02 nova-api[30985]: 2017-09-28 12:24:23.505 30985 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:24:23 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:24:23.518 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:24:23] "OPTIONS / HTTP/1.0" 200 134 0.000509
Sep 28 12:24:23 ctl02 nova-api[30985]: 2017-09-28 12:24:23.637 30985 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:24:23 ctl02 nova-api[30985]: 2017-09-28 12:24:23.881 30985 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:24:23 ctl02 nova-api[30985]: 2017-09-28 12:24:23.883 30985 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:24:23 ctl02 nova-api[30985]: 2017-09-28 12:24:23.883 30985 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:24:23 ctl02 nova-api[30985]: 2017-09-28 12:24:23.883 30985 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:24:24 ctl02 nova-api[30985]: 2017-09-28 12:24:24.014 30985 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:24:24 ctl02 nova-api[30985]: 2017-09-28 12:24:24.016 30985 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:24:24 ctl02 nova-api[30985]: 2017-09-28 12:24:24.016 30985 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:24:24 ctl02 glance-api[29183]: 2017-09-28 12:24:24.016 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:24:24] "OPTIONS / HTTP/1.0" 200 134 0.000534
Sep 28 12:24:24 ctl02 nova-api[30985]: 2017-09-28 12:24:24.017 30985 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:24:24 ctl02 nova-api[30985]: 2017-09-28 12:24:24.020 30985 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:24:24 ctl02 nova-api[30985]: 2017-09-28 12:24:24.020 30985 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:24:24 ctl02 nova-api[30985]: 2017-09-28 12:24:24.020 30985 ERROR nova Traceback (most recent call last):
Sep 28 12:24:24 ctl02 nova-api[30985]: 2017-09-28 12:24:24.020 30985 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:24:24 ctl02 nova-api[30985]: 2017-09-28 12:24:24.020 30985 ERROR nova     sys.exit(main())
Sep 28 12:24:24 ctl02 nova-api[30985]: 2017-09-28 12:24:24.020 30985 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:24:24 ctl02 nova-api[30985]: 2017-09-28 12:24:24.020 30985 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:24:24 ctl02 nova-api[30985]: 2017-09-28 12:24:24.020 30985 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:24:24 ctl02 nova-api[30985]: 2017-09-28 12:24:24.020 30985 ERROR nova     max_url_len=max_url_len)
Sep 28 12:24:24 ctl02 nova-api[30985]: 2017-09-28 12:24:24.020 30985 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:24:24 ctl02 nova-api[30985]: 2017-09-28 12:24:24.020 30985 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:24:24 ctl02 nova-api[30985]: 2017-09-28 12:24:24.020 30985 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:24:24 ctl02 nova-api[30985]: 2017-09-28 12:24:24.020 30985 ERROR nova     sock.listen(backlog)
Sep 28 12:24:24 ctl02 nova-api[30985]: 2017-09-28 12:24:24.020 30985 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:24:24 ctl02 nova-api[30985]: 2017-09-28 12:24:24.020 30985 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:24:24 ctl02 nova-api[30985]: 2017-09-28 12:24:24.020 30985 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:24:24 ctl02 nova-api[30985]: 2017-09-28 12:24:24.020 30985 ERROR nova
Sep 28 12:24:24 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:24:24 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:24:24 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:24:24 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:24:24 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:24:24 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:24:24 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:24:24 ctl02 heat-api[13008]: 2017-09-28 12:24:24.766 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:24:24] "OPTIONS / HTTP/1.0" 200 134 0.000557
Sep 28 12:24:25 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:24:25.180 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:24:25] "OPTIONS / HTTP/1.0" 200 134 0.000441
Sep 28 12:24:26 ctl02 nova-api[31001]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:24:26 ctl02 nova-api[31001]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:24:26 ctl02 nova-api[31001]: 2017-09-28 12:24:26.240 31001 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:24:26 ctl02 nova-api[31001]: 2017-09-28 12:24:26.242 31001 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:24:26 ctl02 nova-api[31001]: 2017-09-28 12:24:26.242 31001 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:24:26 ctl02 nova-api[31001]: 2017-09-28 12:24:26.242 31001 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:24:26 ctl02 nova-api[31001]: 2017-09-28 12:24:26.242 31001 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:24:26 ctl02 nova-api[31001]: 2017-09-28 12:24:26.242 31001 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:24:26 ctl02 nova-api[31001]: 2017-09-28 12:24:26.242 31001 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:24:26 ctl02 nova-api[31001]: 2017-09-28 12:24:26.242 31001 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:24:26 ctl02 nova-api[31001]: 2017-09-28 12:24:26.242 31001 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:24:26 ctl02 nova-api[31001]: 2017-09-28 12:24:26.242 31001 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:24:26 ctl02 nova-api[31001]: 2017-09-28 12:24:26.242 31001 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:24:26 ctl02 nova-api[31001]: 2017-09-28 12:24:26.242 31001 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:24:26 ctl02 nova-api[31001]: 2017-09-28 12:24:26.242 31001 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:24:26 ctl02 nova-api[31001]: 2017-09-28 12:24:26.242 31001 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:24:26 ctl02 nova-api[31001]: 2017-09-28 12:24:26.242 31001 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:24:26 ctl02 nova-api[31001]: 2017-09-28 12:24:26.242 31001 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:24:26 ctl02 nova-api[31001]: 2017-09-28 12:24:26.242 31001 ERROR nova.wsgi     self.filename))
Sep 28 12:24:26 ctl02 nova-api[31001]: 2017-09-28 12:24:26.242 31001 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:24:26 ctl02 nova-api[31001]: 2017-09-28 12:24:26.242 31001 ERROR nova.wsgi
Sep 28 12:24:26 ctl02 nova-api[31001]: 2017-09-28 12:24:26.243 31001 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:24:26 ctl02 heat-api[13008]: 2017-09-28 12:24:26.376 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:24:26] "OPTIONS / HTTP/1.0" 200 134 0.000661
Sep 28 12:24:26 ctl02 nova-api[31001]: 2017-09-28 12:24:26.379 31001 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:24:26 ctl02 nova-api[31001]: 2017-09-28 12:24:26.629 31001 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:24:26 ctl02 nova-api[31001]: 2017-09-28 12:24:26.631 31001 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:24:26 ctl02 nova-api[31001]: 2017-09-28 12:24:26.632 31001 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:24:26 ctl02 nova-api[31001]: 2017-09-28 12:24:26.632 31001 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:24:26 ctl02 nova-api[31001]: 2017-09-28 12:24:26.765 31001 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:24:26 ctl02 nova-api[31001]: 2017-09-28 12:24:26.767 31001 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:24:26 ctl02 nova-api[31001]: 2017-09-28 12:24:26.767 31001 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:24:26 ctl02 nova-api[31001]: 2017-09-28 12:24:26.768 31001 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:24:26 ctl02 nova-api[31001]: 2017-09-28 12:24:26.771 31001 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:24:26 ctl02 nova-api[31001]: 2017-09-28 12:24:26.772 31001 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:24:26 ctl02 nova-api[31001]: 2017-09-28 12:24:26.772 31001 ERROR nova Traceback (most recent call last):
Sep 28 12:24:26 ctl02 nova-api[31001]: 2017-09-28 12:24:26.772 31001 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:24:26 ctl02 nova-api[31001]: 2017-09-28 12:24:26.772 31001 ERROR nova     sys.exit(main())
Sep 28 12:24:26 ctl02 nova-api[31001]: 2017-09-28 12:24:26.772 31001 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:24:26 ctl02 nova-api[31001]: 2017-09-28 12:24:26.772 31001 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:24:26 ctl02 nova-api[31001]: 2017-09-28 12:24:26.772 31001 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:24:26 ctl02 nova-api[31001]: 2017-09-28 12:24:26.772 31001 ERROR nova     max_url_len=max_url_len)
Sep 28 12:24:26 ctl02 nova-api[31001]: 2017-09-28 12:24:26.772 31001 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:24:26 ctl02 nova-api[31001]: 2017-09-28 12:24:26.772 31001 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:24:26 ctl02 nova-api[31001]: 2017-09-28 12:24:26.772 31001 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:24:26 ctl02 nova-api[31001]: 2017-09-28 12:24:26.772 31001 ERROR nova     sock.listen(backlog)
Sep 28 12:24:26 ctl02 nova-api[31001]: 2017-09-28 12:24:26.772 31001 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:24:26 ctl02 nova-api[31001]: 2017-09-28 12:24:26.772 31001 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:24:26 ctl02 nova-api[31001]: 2017-09-28 12:24:26.772 31001 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:24:26 ctl02 nova-api[31001]: 2017-09-28 12:24:26.772 31001 ERROR nova
Sep 28 12:24:26 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:24:26 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:24:26 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:24:27 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:24:27 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:24:27 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:24:27 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:24:28 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:24:28.329 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:24:28] "OPTIONS / HTTP/1.0" 200 134 0.000519
Sep 28 12:24:28 ctl02 heat-api-cfn[13300]: 2017-09-28 12:24:28.423 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:24:28] "OPTIONS / HTTP/1.0" 200 134 0.000516
Sep 28 12:24:28 ctl02 heat-api-cfn[13300]: 2017-09-28 12:24:28.660 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:24:28] "OPTIONS / HTTP/1.0" 200 134 0.000523
Sep 28 12:24:28 ctl02 nova-api[31021]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:24:28 ctl02 nova-api[31021]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:24:28 ctl02 heat-api[13008]: 2017-09-28 12:24:28.994 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:24:28] "OPTIONS / HTTP/1.0" 200 134 0.000722
Sep 28 12:24:29 ctl02 nova-api[31021]: 2017-09-28 12:24:29.038 31021 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:24:29 ctl02 nova-api[31021]: 2017-09-28 12:24:29.040 31021 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:24:29 ctl02 nova-api[31021]: 2017-09-28 12:24:29.040 31021 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:24:29 ctl02 nova-api[31021]: 2017-09-28 12:24:29.040 31021 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:24:29 ctl02 nova-api[31021]: 2017-09-28 12:24:29.040 31021 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:24:29 ctl02 nova-api[31021]: 2017-09-28 12:24:29.040 31021 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:24:29 ctl02 nova-api[31021]: 2017-09-28 12:24:29.040 31021 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:24:29 ctl02 nova-api[31021]: 2017-09-28 12:24:29.040 31021 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:24:29 ctl02 nova-api[31021]: 2017-09-28 12:24:29.040 31021 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:24:29 ctl02 nova-api[31021]: 2017-09-28 12:24:29.040 31021 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:24:29 ctl02 nova-api[31021]: 2017-09-28 12:24:29.040 31021 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:24:29 ctl02 nova-api[31021]: 2017-09-28 12:24:29.040 31021 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:24:29 ctl02 nova-api[31021]: 2017-09-28 12:24:29.040 31021 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:24:29 ctl02 nova-api[31021]: 2017-09-28 12:24:29.040 31021 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:24:29 ctl02 nova-api[31021]: 2017-09-28 12:24:29.040 31021 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:24:29 ctl02 nova-api[31021]: 2017-09-28 12:24:29.040 31021 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:24:29 ctl02 nova-api[31021]: 2017-09-28 12:24:29.040 31021 ERROR nova.wsgi     self.filename))
Sep 28 12:24:29 ctl02 nova-api[31021]: 2017-09-28 12:24:29.040 31021 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:24:29 ctl02 nova-api[31021]: 2017-09-28 12:24:29.040 31021 ERROR nova.wsgi
Sep 28 12:24:29 ctl02 nova-api[31021]: 2017-09-28 12:24:29.041 31021 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:24:29 ctl02 nova-api[31021]: 2017-09-28 12:24:29.173 31021 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:24:29 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd5366050)
Sep 28 12:24:29 ctl02 nova-api[31021]: 2017-09-28 12:24:29.428 31021 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:24:29 ctl02 nova-api[31021]: 2017-09-28 12:24:29.431 31021 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:24:29 ctl02 nova-api[31021]: 2017-09-28 12:24:29.431 31021 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:24:29 ctl02 nova-api[31021]: 2017-09-28 12:24:29.431 31021 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:24:29 ctl02 nova-api[31021]: 2017-09-28 12:24:29.563 31021 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:24:29 ctl02 nova-api[31021]: 2017-09-28 12:24:29.565 31021 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:24:29 ctl02 nova-api[31021]: 2017-09-28 12:24:29.565 31021 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:24:29 ctl02 nova-api[31021]: 2017-09-28 12:24:29.565 31021 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:24:29 ctl02 nova-api[31021]: 2017-09-28 12:24:29.568 31021 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:24:29 ctl02 nova-api[31021]: 2017-09-28 12:24:29.569 31021 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:24:29 ctl02 nova-api[31021]: 2017-09-28 12:24:29.569 31021 ERROR nova Traceback (most recent call last):
Sep 28 12:24:29 ctl02 nova-api[31021]: 2017-09-28 12:24:29.569 31021 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:24:29 ctl02 nova-api[31021]: 2017-09-28 12:24:29.569 31021 ERROR nova     sys.exit(main())
Sep 28 12:24:29 ctl02 nova-api[31021]: 2017-09-28 12:24:29.569 31021 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:24:29 ctl02 nova-api[31021]: 2017-09-28 12:24:29.569 31021 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:24:29 ctl02 nova-api[31021]: 2017-09-28 12:24:29.569 31021 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:24:29 ctl02 nova-api[31021]: 2017-09-28 12:24:29.569 31021 ERROR nova     max_url_len=max_url_len)
Sep 28 12:24:29 ctl02 nova-api[31021]: 2017-09-28 12:24:29.569 31021 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:24:29 ctl02 nova-api[31021]: 2017-09-28 12:24:29.569 31021 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:24:29 ctl02 nova-api[31021]: 2017-09-28 12:24:29.569 31021 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:24:29 ctl02 nova-api[31021]: 2017-09-28 12:24:29.569 31021 ERROR nova     sock.listen(backlog)
Sep 28 12:24:29 ctl02 nova-api[31021]: 2017-09-28 12:24:29.569 31021 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:24:29 ctl02 nova-api[31021]: 2017-09-28 12:24:29.569 31021 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:24:29 ctl02 nova-api[31021]: 2017-09-28 12:24:29.569 31021 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:24:29 ctl02 nova-api[31021]: 2017-09-28 12:24:29.569 31021 ERROR nova
Sep 28 12:24:29 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:24:29 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:24:29 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:24:29 ctl02 heat-api-cfn[13300]: 2017-09-28 12:24:29.755 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:24:29] "OPTIONS / HTTP/1.0" 200 134 0.000523
Sep 28 12:24:29 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:24:29 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:24:29 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:24:29 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:24:30 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd5366050)
Sep 28 12:24:30 ctl02 glance-api[29183]: 2017-09-28 12:24:30.610 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:24:30] "OPTIONS / HTTP/1.0" 200 134 0.001048
Sep 28 12:24:30 ctl02 neutron-server[30536]: 2017-09-28 12:24:30.629 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:24:30] "OPTIONS / HTTP/1.0" 200 262 0.000758
Sep 28 12:24:30 ctl02 neutron-server[30536]: 2017-09-28 12:24:30.744 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:24:30] "OPTIONS / HTTP/1.0" 200 262 0.000485
Sep 28 12:24:30 ctl02 neutron-server[30536]: 2017-09-28 12:24:30.913 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:24:30] "OPTIONS / HTTP/1.0" 200 262 0.000358
Sep 28 12:24:31 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd5366050)
Sep 28 12:24:31 ctl02 nova-api[31039]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:24:31 ctl02 nova-api[31039]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:24:31 ctl02 nova-api[31039]: 2017-09-28 12:24:31.795 31039 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:24:31 ctl02 nova-api[31039]: 2017-09-28 12:24:31.797 31039 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:24:31 ctl02 nova-api[31039]: 2017-09-28 12:24:31.797 31039 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:24:31 ctl02 nova-api[31039]: 2017-09-28 12:24:31.797 31039 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:24:31 ctl02 nova-api[31039]: 2017-09-28 12:24:31.797 31039 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:24:31 ctl02 nova-api[31039]: 2017-09-28 12:24:31.797 31039 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:24:31 ctl02 nova-api[31039]: 2017-09-28 12:24:31.797 31039 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:24:31 ctl02 nova-api[31039]: 2017-09-28 12:24:31.797 31039 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:24:31 ctl02 nova-api[31039]: 2017-09-28 12:24:31.797 31039 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:24:31 ctl02 nova-api[31039]: 2017-09-28 12:24:31.797 31039 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:24:31 ctl02 nova-api[31039]: 2017-09-28 12:24:31.797 31039 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:24:31 ctl02 nova-api[31039]: 2017-09-28 12:24:31.797 31039 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:24:31 ctl02 nova-api[31039]: 2017-09-28 12:24:31.797 31039 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:24:31 ctl02 nova-api[31039]: 2017-09-28 12:24:31.797 31039 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:24:31 ctl02 nova-api[31039]: 2017-09-28 12:24:31.797 31039 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:24:31 ctl02 nova-api[31039]: 2017-09-28 12:24:31.797 31039 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:24:31 ctl02 nova-api[31039]: 2017-09-28 12:24:31.797 31039 ERROR nova.wsgi     self.filename))
Sep 28 12:24:31 ctl02 nova-api[31039]: 2017-09-28 12:24:31.797 31039 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:24:31 ctl02 nova-api[31039]: 2017-09-28 12:24:31.797 31039 ERROR nova.wsgi
Sep 28 12:24:31 ctl02 nova-api[31039]: 2017-09-28 12:24:31.799 31039 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:24:31 ctl02 nova-api[31039]: 2017-09-28 12:24:31.931 31039 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:24:32 ctl02 nova-api[31039]: 2017-09-28 12:24:32.180 31039 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:24:32 ctl02 nova-api[31039]: 2017-09-28 12:24:32.183 31039 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:24:32 ctl02 nova-api[31039]: 2017-09-28 12:24:32.184 31039 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:24:32 ctl02 nova-api[31039]: 2017-09-28 12:24:32.184 31039 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:24:32 ctl02 nova-api[31039]: 2017-09-28 12:24:32.316 31039 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:24:32 ctl02 nova-api[31039]: 2017-09-28 12:24:32.319 31039 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:24:32 ctl02 nova-api[31039]: 2017-09-28 12:24:32.319 31039 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:24:32 ctl02 nova-api[31039]: 2017-09-28 12:24:32.320 31039 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:24:32 ctl02 nova-api[31039]: 2017-09-28 12:24:32.323 31039 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:24:32 ctl02 nova-api[31039]: 2017-09-28 12:24:32.324 31039 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:24:32 ctl02 nova-api[31039]: 2017-09-28 12:24:32.324 31039 ERROR nova Traceback (most recent call last):
Sep 28 12:24:32 ctl02 nova-api[31039]: 2017-09-28 12:24:32.324 31039 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:24:32 ctl02 nova-api[31039]: 2017-09-28 12:24:32.324 31039 ERROR nova     sys.exit(main())
Sep 28 12:24:32 ctl02 nova-api[31039]: 2017-09-28 12:24:32.324 31039 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:24:32 ctl02 nova-api[31039]: 2017-09-28 12:24:32.324 31039 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:24:32 ctl02 nova-api[31039]: 2017-09-28 12:24:32.324 31039 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:24:32 ctl02 nova-api[31039]: 2017-09-28 12:24:32.324 31039 ERROR nova     max_url_len=max_url_len)
Sep 28 12:24:32 ctl02 nova-api[31039]: 2017-09-28 12:24:32.324 31039 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:24:32 ctl02 nova-api[31039]: 2017-09-28 12:24:32.324 31039 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:24:32 ctl02 nova-api[31039]: 2017-09-28 12:24:32.324 31039 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:24:32 ctl02 nova-api[31039]: 2017-09-28 12:24:32.324 31039 ERROR nova     sock.listen(backlog)
Sep 28 12:24:32 ctl02 nova-api[31039]: 2017-09-28 12:24:32.324 31039 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:24:32 ctl02 nova-api[31039]: 2017-09-28 12:24:32.324 31039 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:24:32 ctl02 nova-api[31039]: 2017-09-28 12:24:32.324 31039 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:24:32 ctl02 nova-api[31039]: 2017-09-28 12:24:32.324 31039 ERROR nova
Sep 28 12:24:32 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd5366050)
Sep 28 12:24:32 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:24:32 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:24:32 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:24:32 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:24:32 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:24:32 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:24:32 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:24:33 ctl02 glance-api[29183]: 2017-09-28 12:24:33.113 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:24:33] "OPTIONS / HTTP/1.0" 200 134 0.000697
Sep 28 12:24:33 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:24:33.243 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:24:33] "OPTIONS / HTTP/1.0" 200 134 0.000483
Sep 28 12:24:33 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd5366050)
Sep 28 12:24:33 ctl02 glance-api[29183]: 2017-09-28 12:24:33.818 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:24:33] "OPTIONS / HTTP/1.0" 200 134 0.001105
Sep 28 12:24:34 ctl02 nova-api[31057]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:24:34 ctl02 nova-api[31057]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:24:34 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd5366050)
Sep 28 12:24:34 ctl02 nova-api[31057]: 2017-09-28 12:24:34.527 31057 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:24:34 ctl02 nova-api[31057]: 2017-09-28 12:24:34.528 31057 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:24:34 ctl02 nova-api[31057]: 2017-09-28 12:24:34.528 31057 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:24:34 ctl02 nova-api[31057]: 2017-09-28 12:24:34.528 31057 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:24:34 ctl02 nova-api[31057]: 2017-09-28 12:24:34.528 31057 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:24:34 ctl02 nova-api[31057]: 2017-09-28 12:24:34.528 31057 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:24:34 ctl02 nova-api[31057]: 2017-09-28 12:24:34.528 31057 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:24:34 ctl02 nova-api[31057]: 2017-09-28 12:24:34.528 31057 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:24:34 ctl02 nova-api[31057]: 2017-09-28 12:24:34.528 31057 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:24:34 ctl02 nova-api[31057]: 2017-09-28 12:24:34.528 31057 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:24:34 ctl02 nova-api[31057]: 2017-09-28 12:24:34.528 31057 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:24:34 ctl02 nova-api[31057]: 2017-09-28 12:24:34.528 31057 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:24:34 ctl02 nova-api[31057]: 2017-09-28 12:24:34.528 31057 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:24:34 ctl02 nova-api[31057]: 2017-09-28 12:24:34.528 31057 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:24:34 ctl02 nova-api[31057]: 2017-09-28 12:24:34.528 31057 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:24:34 ctl02 nova-api[31057]: 2017-09-28 12:24:34.528 31057 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:24:34 ctl02 nova-api[31057]: 2017-09-28 12:24:34.528 31057 ERROR nova.wsgi     self.filename))
Sep 28 12:24:34 ctl02 nova-api[31057]: 2017-09-28 12:24:34.528 31057 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:24:34 ctl02 nova-api[31057]: 2017-09-28 12:24:34.528 31057 ERROR nova.wsgi
Sep 28 12:24:34 ctl02 nova-api[31057]: 2017-09-28 12:24:34.529 31057 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:24:34 ctl02 nova-api[31057]: 2017-09-28 12:24:34.662 31057 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:24:34 ctl02 heat-api[13008]: 2017-09-28 12:24:34.770 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:24:34] "OPTIONS / HTTP/1.0" 200 134 0.000746
Sep 28 12:24:34 ctl02 nova-api[31057]: 2017-09-28 12:24:34.896 31057 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:24:34 ctl02 nova-api[31057]: 2017-09-28 12:24:34.898 31057 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:24:34 ctl02 nova-api[31057]: 2017-09-28 12:24:34.898 31057 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:24:34 ctl02 nova-api[31057]: 2017-09-28 12:24:34.899 31057 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:24:35 ctl02 nova-api[31057]: 2017-09-28 12:24:35.030 31057 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:24:35 ctl02 nova-api[31057]: 2017-09-28 12:24:35.032 31057 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:24:35 ctl02 nova-api[31057]: 2017-09-28 12:24:35.032 31057 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:24:35 ctl02 nova-api[31057]: 2017-09-28 12:24:35.033 31057 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:24:35 ctl02 nova-api[31057]: 2017-09-28 12:24:35.036 31057 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:24:35 ctl02 nova-api[31057]: 2017-09-28 12:24:35.036 31057 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:24:35 ctl02 nova-api[31057]: 2017-09-28 12:24:35.036 31057 ERROR nova Traceback (most recent call last):
Sep 28 12:24:35 ctl02 nova-api[31057]: 2017-09-28 12:24:35.036 31057 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:24:35 ctl02 nova-api[31057]: 2017-09-28 12:24:35.036 31057 ERROR nova     sys.exit(main())
Sep 28 12:24:35 ctl02 nova-api[31057]: 2017-09-28 12:24:35.036 31057 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:24:35 ctl02 nova-api[31057]: 2017-09-28 12:24:35.036 31057 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:24:35 ctl02 nova-api[31057]: 2017-09-28 12:24:35.036 31057 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:24:35 ctl02 nova-api[31057]: 2017-09-28 12:24:35.036 31057 ERROR nova     max_url_len=max_url_len)
Sep 28 12:24:35 ctl02 nova-api[31057]: 2017-09-28 12:24:35.036 31057 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:24:35 ctl02 nova-api[31057]: 2017-09-28 12:24:35.036 31057 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:24:35 ctl02 nova-api[31057]: 2017-09-28 12:24:35.036 31057 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:24:35 ctl02 nova-api[31057]: 2017-09-28 12:24:35.036 31057 ERROR nova     sock.listen(backlog)
Sep 28 12:24:35 ctl02 nova-api[31057]: 2017-09-28 12:24:35.036 31057 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:24:35 ctl02 nova-api[31057]: 2017-09-28 12:24:35.036 31057 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:24:35 ctl02 nova-api[31057]: 2017-09-28 12:24:35.036 31057 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:24:35 ctl02 nova-api[31057]: 2017-09-28 12:24:35.036 31057 ERROR nova
Sep 28 12:24:35 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:24:35 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:24:35 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:24:35 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:24:35.363 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:24:35] "OPTIONS / HTTP/1.0" 200 134 0.000599
Sep 28 12:24:35 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:24:35 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:24:35 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:24:35 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:24:35 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd5366050)
Sep 28 12:24:36 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd5366050)
Sep 28 12:24:36 ctl02 neutron-server[30536]: 2017-09-28 12:24:36.483 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 2 dead agents out of 2:
Sep 28 12:24:36 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:24:36 ctl02 neutron-server[30536]:       Metadata agent  2017-09-28 12:23:58 cmp001
Sep 28 12:24:36 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:23:57 cmp001
Sep 28 12:24:36 ctl02 heat-api[13008]: 2017-09-28 12:24:36.661 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:24:36] "OPTIONS / HTTP/1.0" 200 134 0.000912
Sep 28 12:24:37 ctl02 nova-api[31075]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:24:37 ctl02 nova-api[31075]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:24:37 ctl02 nova-api[31075]: 2017-09-28 12:24:37.287 31075 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:24:37 ctl02 nova-api[31075]: 2017-09-28 12:24:37.289 31075 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:24:37 ctl02 nova-api[31075]: 2017-09-28 12:24:37.289 31075 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:24:37 ctl02 nova-api[31075]: 2017-09-28 12:24:37.289 31075 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:24:37 ctl02 nova-api[31075]: 2017-09-28 12:24:37.289 31075 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:24:37 ctl02 nova-api[31075]: 2017-09-28 12:24:37.289 31075 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:24:37 ctl02 nova-api[31075]: 2017-09-28 12:24:37.289 31075 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:24:37 ctl02 nova-api[31075]: 2017-09-28 12:24:37.289 31075 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:24:37 ctl02 nova-api[31075]: 2017-09-28 12:24:37.289 31075 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:24:37 ctl02 nova-api[31075]: 2017-09-28 12:24:37.289 31075 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:24:37 ctl02 nova-api[31075]: 2017-09-28 12:24:37.289 31075 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:24:37 ctl02 nova-api[31075]: 2017-09-28 12:24:37.289 31075 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:24:37 ctl02 nova-api[31075]: 2017-09-28 12:24:37.289 31075 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:24:37 ctl02 nova-api[31075]: 2017-09-28 12:24:37.289 31075 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:24:37 ctl02 nova-api[31075]: 2017-09-28 12:24:37.289 31075 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:24:37 ctl02 nova-api[31075]: 2017-09-28 12:24:37.289 31075 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:24:37 ctl02 nova-api[31075]: 2017-09-28 12:24:37.289 31075 ERROR nova.wsgi     self.filename))
Sep 28 12:24:37 ctl02 nova-api[31075]: 2017-09-28 12:24:37.289 31075 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:24:37 ctl02 nova-api[31075]: 2017-09-28 12:24:37.289 31075 ERROR nova.wsgi
Sep 28 12:24:37 ctl02 nova-api[31075]: 2017-09-28 12:24:37.291 31075 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:24:37 ctl02 nova-cert[4860]: 2017-09-28 12:24:37.368 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:24:37 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd5366050)
Sep 28 12:24:37 ctl02 nova-api[31075]: 2017-09-28 12:24:37.423 31075 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:24:37 ctl02 nova-api[31075]: 2017-09-28 12:24:37.650 31075 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:24:37 ctl02 nova-api[31075]: 2017-09-28 12:24:37.652 31075 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:24:37 ctl02 nova-api[31075]: 2017-09-28 12:24:37.652 31075 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:24:37 ctl02 nova-api[31075]: 2017-09-28 12:24:37.652 31075 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:24:37 ctl02 nova-api[31075]: 2017-09-28 12:24:37.786 31075 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:24:37 ctl02 nova-api[31075]: 2017-09-28 12:24:37.787 31075 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:24:37 ctl02 nova-api[31075]: 2017-09-28 12:24:37.788 31075 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:24:37 ctl02 nova-api[31075]: 2017-09-28 12:24:37.788 31075 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:24:37 ctl02 nova-api[31075]: 2017-09-28 12:24:37.791 31075 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:24:37 ctl02 nova-api[31075]: 2017-09-28 12:24:37.791 31075 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:24:37 ctl02 nova-api[31075]: 2017-09-28 12:24:37.791 31075 ERROR nova Traceback (most recent call last):
Sep 28 12:24:37 ctl02 nova-api[31075]: 2017-09-28 12:24:37.791 31075 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:24:37 ctl02 nova-api[31075]: 2017-09-28 12:24:37.791 31075 ERROR nova     sys.exit(main())
Sep 28 12:24:37 ctl02 nova-api[31075]: 2017-09-28 12:24:37.791 31075 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:24:37 ctl02 nova-api[31075]: 2017-09-28 12:24:37.791 31075 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:24:37 ctl02 nova-api[31075]: 2017-09-28 12:24:37.791 31075 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:24:37 ctl02 nova-api[31075]: 2017-09-28 12:24:37.791 31075 ERROR nova     max_url_len=max_url_len)
Sep 28 12:24:37 ctl02 nova-api[31075]: 2017-09-28 12:24:37.791 31075 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:24:37 ctl02 nova-api[31075]: 2017-09-28 12:24:37.791 31075 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:24:37 ctl02 nova-api[31075]: 2017-09-28 12:24:37.791 31075 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:24:37 ctl02 nova-api[31075]: 2017-09-28 12:24:37.791 31075 ERROR nova     sock.listen(backlog)
Sep 28 12:24:37 ctl02 nova-api[31075]: 2017-09-28 12:24:37.791 31075 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:24:37 ctl02 nova-api[31075]: 2017-09-28 12:24:37.791 31075 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:24:37 ctl02 nova-api[31075]: 2017-09-28 12:24:37.791 31075 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:24:37 ctl02 nova-api[31075]: 2017-09-28 12:24:37.791 31075 ERROR nova
Sep 28 12:24:37 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:24:37 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:24:37 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:24:38 ctl02 heat-api-cfn[13300]: 2017-09-28 12:24:38.098 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:24:38] "OPTIONS / HTTP/1.0" 200 134 0.000507
Sep 28 12:24:38 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:24:38 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:24:38 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:24:38 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:24:38 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd5366050)
Sep 28 12:24:38 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:24:38.414 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:24:38] "OPTIONS / HTTP/1.0" 200 134 0.000410
Sep 28 12:24:38 ctl02 nova-conductor[5056]: 2017-09-28 12:24:38.641 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:24:38 ctl02 nova-conductor[5056]: 2017-09-28 12:24:38.658 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:24:38 ctl02 nova-conductor[5056]: 2017-09-28 12:24:38.679 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:24:38 ctl02 nova-conductor[5056]: 2017-09-28 12:24:38.682 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:24:38 ctl02 heat-api[13008]: 2017-09-28 12:24:38.690 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:24:38] "OPTIONS / HTTP/1.0" 200 134 0.000544
Sep 28 12:24:38 ctl02 heat-api-cfn[13300]: 2017-09-28 12:24:38.822 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:24:38] "OPTIONS / HTTP/1.0" 200 134 0.000615
Sep 28 12:24:39 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd5366050)
Sep 28 12:24:39 ctl02 nova-api[31093]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:24:39 ctl02 nova-api[31093]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:24:39 ctl02 heat-api-cfn[13300]: 2017-09-28 12:24:39.896 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:24:39] "OPTIONS / HTTP/1.0" 200 134 0.000571
Sep 28 12:24:39 ctl02 nova-api[31093]: 2017-09-28 12:24:39.983 31093 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:24:39 ctl02 nova-api[31093]: 2017-09-28 12:24:39.984 31093 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:24:39 ctl02 nova-api[31093]: 2017-09-28 12:24:39.984 31093 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:24:39 ctl02 nova-api[31093]: 2017-09-28 12:24:39.984 31093 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:24:39 ctl02 nova-api[31093]: 2017-09-28 12:24:39.984 31093 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:24:39 ctl02 nova-api[31093]: 2017-09-28 12:24:39.984 31093 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:24:39 ctl02 nova-api[31093]: 2017-09-28 12:24:39.984 31093 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:24:39 ctl02 nova-api[31093]: 2017-09-28 12:24:39.984 31093 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:24:39 ctl02 nova-api[31093]: 2017-09-28 12:24:39.984 31093 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:24:39 ctl02 nova-api[31093]: 2017-09-28 12:24:39.984 31093 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:24:39 ctl02 nova-api[31093]: 2017-09-28 12:24:39.984 31093 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:24:39 ctl02 nova-api[31093]: 2017-09-28 12:24:39.984 31093 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:24:39 ctl02 nova-api[31093]: 2017-09-28 12:24:39.984 31093 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:24:39 ctl02 nova-api[31093]: 2017-09-28 12:24:39.984 31093 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:24:39 ctl02 nova-api[31093]: 2017-09-28 12:24:39.984 31093 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:24:39 ctl02 nova-api[31093]: 2017-09-28 12:24:39.984 31093 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:24:39 ctl02 nova-api[31093]: 2017-09-28 12:24:39.984 31093 ERROR nova.wsgi     self.filename))
Sep 28 12:24:39 ctl02 nova-api[31093]: 2017-09-28 12:24:39.984 31093 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:24:39 ctl02 nova-api[31093]: 2017-09-28 12:24:39.984 31093 ERROR nova.wsgi
Sep 28 12:24:39 ctl02 nova-api[31093]: 2017-09-28 12:24:39.986 31093 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:24:40 ctl02 nova-api[31093]: 2017-09-28 12:24:40.112 31093 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:24:40 ctl02 nova-api[31093]: 2017-09-28 12:24:40.335 31093 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:24:40 ctl02 nova-api[31093]: 2017-09-28 12:24:40.338 31093 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:24:40 ctl02 nova-api[31093]: 2017-09-28 12:24:40.338 31093 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:24:40 ctl02 nova-api[31093]: 2017-09-28 12:24:40.339 31093 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:24:40 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:24:40 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:24:40 ctl02 nova-api[31093]: 2017-09-28 12:24:40.484 31093 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:24:40 ctl02 nova-api[31093]: 2017-09-28 12:24:40.486 31093 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:24:40 ctl02 nova-api[31093]: 2017-09-28 12:24:40.486 31093 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:24:40 ctl02 nova-api[31093]: 2017-09-28 12:24:40.487 31093 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:24:40 ctl02 nova-api[31093]: 2017-09-28 12:24:40.490 31093 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:24:40 ctl02 nova-api[31093]: 2017-09-28 12:24:40.490 31093 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:24:40 ctl02 nova-api[31093]: 2017-09-28 12:24:40.490 31093 ERROR nova Traceback (most recent call last):
Sep 28 12:24:40 ctl02 nova-api[31093]: 2017-09-28 12:24:40.490 31093 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:24:40 ctl02 nova-api[31093]: 2017-09-28 12:24:40.490 31093 ERROR nova     sys.exit(main())
Sep 28 12:24:40 ctl02 nova-api[31093]: 2017-09-28 12:24:40.490 31093 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:24:40 ctl02 nova-api[31093]: 2017-09-28 12:24:40.490 31093 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:24:40 ctl02 nova-api[31093]: 2017-09-28 12:24:40.490 31093 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:24:40 ctl02 nova-api[31093]: 2017-09-28 12:24:40.490 31093 ERROR nova     max_url_len=max_url_len)
Sep 28 12:24:40 ctl02 nova-api[31093]: 2017-09-28 12:24:40.490 31093 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:24:40 ctl02 nova-api[31093]: 2017-09-28 12:24:40.490 31093 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:24:40 ctl02 nova-api[31093]: 2017-09-28 12:24:40.490 31093 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:24:40 ctl02 nova-api[31093]: 2017-09-28 12:24:40.490 31093 ERROR nova     sock.listen(backlog)
Sep 28 12:24:40 ctl02 nova-api[31093]: 2017-09-28 12:24:40.490 31093 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:24:40 ctl02 nova-api[31093]: 2017-09-28 12:24:40.490 31093 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:24:40 ctl02 nova-api[31093]: 2017-09-28 12:24:40.490 31093 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:24:40 ctl02 nova-api[31093]: 2017-09-28 12:24:40.490 31093 ERROR nova
Sep 28 12:24:40 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:24:40 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:24:40 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:24:40 ctl02 glance-api[29183]: 2017-09-28 12:24:40.795 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:24:40] "OPTIONS / HTTP/1.0" 200 134 0.000917
Sep 28 12:24:40 ctl02 neutron-server[30536]: 2017-09-28 12:24:40.856 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:24:40] "OPTIONS / HTTP/1.0" 200 262 0.000653
Sep 28 12:24:40 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:24:40 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:24:40 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:24:40 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:24:40 ctl02 neutron-server[30536]: 2017-09-28 12:24:40.963 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:24:40] "OPTIONS / HTTP/1.0" 200 262 0.000553
Sep 28 12:24:41 ctl02 neutron-server[30536]: 2017-09-28 12:24:41.105 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:24:41] "OPTIONS / HTTP/1.0" 200 262 0.000558
Sep 28 12:24:42 ctl02 nova-api[31116]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:24:42 ctl02 nova-api[31116]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:24:42 ctl02 nova-api[31116]: 2017-09-28 12:24:42.714 31116 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:24:42 ctl02 nova-api[31116]: 2017-09-28 12:24:42.716 31116 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:24:42 ctl02 nova-api[31116]: 2017-09-28 12:24:42.716 31116 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:24:42 ctl02 nova-api[31116]: 2017-09-28 12:24:42.716 31116 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:24:42 ctl02 nova-api[31116]: 2017-09-28 12:24:42.716 31116 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:24:42 ctl02 nova-api[31116]: 2017-09-28 12:24:42.716 31116 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:24:42 ctl02 nova-api[31116]: 2017-09-28 12:24:42.716 31116 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:24:42 ctl02 nova-api[31116]: 2017-09-28 12:24:42.716 31116 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:24:42 ctl02 nova-api[31116]: 2017-09-28 12:24:42.716 31116 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:24:42 ctl02 nova-api[31116]: 2017-09-28 12:24:42.716 31116 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:24:42 ctl02 nova-api[31116]: 2017-09-28 12:24:42.716 31116 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:24:42 ctl02 nova-api[31116]: 2017-09-28 12:24:42.716 31116 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:24:42 ctl02 nova-api[31116]: 2017-09-28 12:24:42.716 31116 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:24:42 ctl02 nova-api[31116]: 2017-09-28 12:24:42.716 31116 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:24:42 ctl02 nova-api[31116]: 2017-09-28 12:24:42.716 31116 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:24:42 ctl02 nova-api[31116]: 2017-09-28 12:24:42.716 31116 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:24:42 ctl02 nova-api[31116]: 2017-09-28 12:24:42.716 31116 ERROR nova.wsgi     self.filename))
Sep 28 12:24:42 ctl02 nova-api[31116]: 2017-09-28 12:24:42.716 31116 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:24:42 ctl02 nova-api[31116]: 2017-09-28 12:24:42.716 31116 ERROR nova.wsgi
Sep 28 12:24:42 ctl02 nova-api[31116]: 2017-09-28 12:24:42.718 31116 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:24:42 ctl02 glance-api[29183]: 2017-09-28 12:24:42.787 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:24:42] "OPTIONS / HTTP/1.0" 200 134 0.000661
Sep 28 12:24:42 ctl02 nova-api[31116]: 2017-09-28 12:24:42.871 31116 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:24:42 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:24:42.967 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:24:42] "OPTIONS / HTTP/1.0" 200 134 0.000534
Sep 28 12:24:43 ctl02 nova-api[31116]: 2017-09-28 12:24:43.112 31116 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:24:43 ctl02 nova-api[31116]: 2017-09-28 12:24:43.115 31116 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:24:43 ctl02 nova-api[31116]: 2017-09-28 12:24:43.115 31116 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:24:43 ctl02 nova-api[31116]: 2017-09-28 12:24:43.116 31116 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:24:43 ctl02 nova-api[31116]: 2017-09-28 12:24:43.247 31116 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:24:43 ctl02 nova-api[31116]: 2017-09-28 12:24:43.250 31116 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:24:43 ctl02 nova-api[31116]: 2017-09-28 12:24:43.250 31116 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:24:43 ctl02 nova-api[31116]: 2017-09-28 12:24:43.251 31116 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:24:43 ctl02 nova-api[31116]: 2017-09-28 12:24:43.254 31116 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:24:43 ctl02 nova-api[31116]: 2017-09-28 12:24:43.255 31116 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:24:43 ctl02 nova-api[31116]: 2017-09-28 12:24:43.255 31116 ERROR nova Traceback (most recent call last):
Sep 28 12:24:43 ctl02 nova-api[31116]: 2017-09-28 12:24:43.255 31116 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:24:43 ctl02 nova-api[31116]: 2017-09-28 12:24:43.255 31116 ERROR nova     sys.exit(main())
Sep 28 12:24:43 ctl02 nova-api[31116]: 2017-09-28 12:24:43.255 31116 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:24:43 ctl02 nova-api[31116]: 2017-09-28 12:24:43.255 31116 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:24:43 ctl02 nova-api[31116]: 2017-09-28 12:24:43.255 31116 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:24:43 ctl02 nova-api[31116]: 2017-09-28 12:24:43.255 31116 ERROR nova     max_url_len=max_url_len)
Sep 28 12:24:43 ctl02 nova-api[31116]: 2017-09-28 12:24:43.255 31116 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:24:43 ctl02 nova-api[31116]: 2017-09-28 12:24:43.255 31116 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:24:43 ctl02 nova-api[31116]: 2017-09-28 12:24:43.255 31116 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:24:43 ctl02 nova-api[31116]: 2017-09-28 12:24:43.255 31116 ERROR nova     sock.listen(backlog)
Sep 28 12:24:43 ctl02 nova-api[31116]: 2017-09-28 12:24:43.255 31116 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:24:43 ctl02 nova-api[31116]: 2017-09-28 12:24:43.255 31116 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:24:43 ctl02 nova-api[31116]: 2017-09-28 12:24:43.255 31116 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:24:43 ctl02 nova-api[31116]: 2017-09-28 12:24:43.255 31116 ERROR nova
Sep 28 12:24:43 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:24:43 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:24:43 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:24:43 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:24:43 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:24:43 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:24:43 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:24:44 ctl02 glance-api[29183]: 2017-09-28 12:24:44.146 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:24:44] "OPTIONS / HTTP/1.0" 200 134 0.000641
Sep 28 12:24:44 ctl02 heat-api[13008]: 2017-09-28 12:24:44.531 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:24:44] "OPTIONS / HTTP/1.0" 200 134 0.000619
Sep 28 12:24:45 ctl02 nova-api[31134]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:24:45 ctl02 nova-api[31134]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:24:45 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:24:45.388 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:24:45] "OPTIONS / HTTP/1.0" 200 134 0.000514
Sep 28 12:24:45 ctl02 nova-api[31134]: 2017-09-28 12:24:45.523 31134 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:24:45 ctl02 nova-api[31134]: 2017-09-28 12:24:45.525 31134 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:24:45 ctl02 nova-api[31134]: 2017-09-28 12:24:45.525 31134 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:24:45 ctl02 nova-api[31134]: 2017-09-28 12:24:45.525 31134 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:24:45 ctl02 nova-api[31134]: 2017-09-28 12:24:45.525 31134 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:24:45 ctl02 nova-api[31134]: 2017-09-28 12:24:45.525 31134 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:24:45 ctl02 nova-api[31134]: 2017-09-28 12:24:45.525 31134 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:24:45 ctl02 nova-api[31134]: 2017-09-28 12:24:45.525 31134 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:24:45 ctl02 nova-api[31134]: 2017-09-28 12:24:45.525 31134 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:24:45 ctl02 nova-api[31134]: 2017-09-28 12:24:45.525 31134 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:24:45 ctl02 nova-api[31134]: 2017-09-28 12:24:45.525 31134 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:24:45 ctl02 nova-api[31134]: 2017-09-28 12:24:45.525 31134 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:24:45 ctl02 nova-api[31134]: 2017-09-28 12:24:45.525 31134 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:24:45 ctl02 nova-api[31134]: 2017-09-28 12:24:45.525 31134 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:24:45 ctl02 nova-api[31134]: 2017-09-28 12:24:45.525 31134 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:24:45 ctl02 nova-api[31134]: 2017-09-28 12:24:45.525 31134 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:24:45 ctl02 nova-api[31134]: 2017-09-28 12:24:45.525 31134 ERROR nova.wsgi     self.filename))
Sep 28 12:24:45 ctl02 nova-api[31134]: 2017-09-28 12:24:45.525 31134 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:24:45 ctl02 nova-api[31134]: 2017-09-28 12:24:45.525 31134 ERROR nova.wsgi
Sep 28 12:24:45 ctl02 nova-api[31134]: 2017-09-28 12:24:45.526 31134 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:24:45 ctl02 nova-api[31134]: 2017-09-28 12:24:45.660 31134 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:24:45 ctl02 nova-api[31134]: 2017-09-28 12:24:45.907 31134 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:24:45 ctl02 nova-api[31134]: 2017-09-28 12:24:45.909 31134 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:24:45 ctl02 nova-api[31134]: 2017-09-28 12:24:45.910 31134 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:24:45 ctl02 nova-api[31134]: 2017-09-28 12:24:45.910 31134 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:24:46 ctl02 nova-api[31134]: 2017-09-28 12:24:46.041 31134 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:24:46 ctl02 nova-api[31134]: 2017-09-28 12:24:46.043 31134 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:24:46 ctl02 nova-api[31134]: 2017-09-28 12:24:46.043 31134 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:24:46 ctl02 nova-api[31134]: 2017-09-28 12:24:46.044 31134 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:24:46 ctl02 nova-api[31134]: 2017-09-28 12:24:46.047 31134 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:24:46 ctl02 nova-api[31134]: 2017-09-28 12:24:46.047 31134 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:24:46 ctl02 nova-api[31134]: 2017-09-28 12:24:46.047 31134 ERROR nova Traceback (most recent call last):
Sep 28 12:24:46 ctl02 nova-api[31134]: 2017-09-28 12:24:46.047 31134 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:24:46 ctl02 nova-api[31134]: 2017-09-28 12:24:46.047 31134 ERROR nova     sys.exit(main())
Sep 28 12:24:46 ctl02 nova-api[31134]: 2017-09-28 12:24:46.047 31134 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:24:46 ctl02 nova-api[31134]: 2017-09-28 12:24:46.047 31134 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:24:46 ctl02 nova-api[31134]: 2017-09-28 12:24:46.047 31134 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:24:46 ctl02 nova-api[31134]: 2017-09-28 12:24:46.047 31134 ERROR nova     max_url_len=max_url_len)
Sep 28 12:24:46 ctl02 nova-api[31134]: 2017-09-28 12:24:46.047 31134 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:24:46 ctl02 nova-api[31134]: 2017-09-28 12:24:46.047 31134 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:24:46 ctl02 nova-api[31134]: 2017-09-28 12:24:46.047 31134 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:24:46 ctl02 nova-api[31134]: 2017-09-28 12:24:46.047 31134 ERROR nova     sock.listen(backlog)
Sep 28 12:24:46 ctl02 nova-api[31134]: 2017-09-28 12:24:46.047 31134 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:24:46 ctl02 nova-api[31134]: 2017-09-28 12:24:46.047 31134 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:24:46 ctl02 nova-api[31134]: 2017-09-28 12:24:46.047 31134 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:24:46 ctl02 nova-api[31134]: 2017-09-28 12:24:46.047 31134 ERROR nova
Sep 28 12:24:46 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:24:46 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:24:46 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:24:46 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:24:46 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:24:46 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:24:46 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:24:46 ctl02 heat-api[13008]: 2017-09-28 12:24:46.624 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:24:46] "OPTIONS / HTTP/1.0" 200 134 0.000684
Sep 28 12:24:47 ctl02 nova-consoleauth[5433]: 2017-09-28 12:24:47.257 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:24:47 ctl02 heat-api-cfn[13300]: 2017-09-28 12:24:47.896 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:24:47] "OPTIONS / HTTP/1.0" 200 134 0.000592
Sep 28 12:24:48 ctl02 nova-api[31152]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:24:48 ctl02 nova-api[31152]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:24:48 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:24:48.244 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:24:48] "OPTIONS / HTTP/1.0" 200 134 0.000463
Sep 28 12:24:48 ctl02 nova-api[31152]: 2017-09-28 12:24:48.259 31152 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:24:48 ctl02 nova-api[31152]: 2017-09-28 12:24:48.260 31152 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:24:48 ctl02 nova-api[31152]: 2017-09-28 12:24:48.260 31152 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:24:48 ctl02 nova-api[31152]: 2017-09-28 12:24:48.260 31152 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:24:48 ctl02 nova-api[31152]: 2017-09-28 12:24:48.260 31152 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:24:48 ctl02 nova-api[31152]: 2017-09-28 12:24:48.260 31152 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:24:48 ctl02 nova-api[31152]: 2017-09-28 12:24:48.260 31152 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:24:48 ctl02 nova-api[31152]: 2017-09-28 12:24:48.260 31152 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:24:48 ctl02 nova-api[31152]: 2017-09-28 12:24:48.260 31152 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:24:48 ctl02 nova-api[31152]: 2017-09-28 12:24:48.260 31152 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:24:48 ctl02 nova-api[31152]: 2017-09-28 12:24:48.260 31152 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:24:48 ctl02 nova-api[31152]: 2017-09-28 12:24:48.260 31152 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:24:48 ctl02 nova-api[31152]: 2017-09-28 12:24:48.260 31152 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:24:48 ctl02 nova-api[31152]: 2017-09-28 12:24:48.260 31152 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:24:48 ctl02 nova-api[31152]: 2017-09-28 12:24:48.260 31152 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:24:48 ctl02 nova-api[31152]: 2017-09-28 12:24:48.260 31152 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:24:48 ctl02 nova-api[31152]: 2017-09-28 12:24:48.260 31152 ERROR nova.wsgi     self.filename))
Sep 28 12:24:48 ctl02 nova-api[31152]: 2017-09-28 12:24:48.260 31152 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:24:48 ctl02 nova-api[31152]: 2017-09-28 12:24:48.260 31152 ERROR nova.wsgi
Sep 28 12:24:48 ctl02 nova-api[31152]: 2017-09-28 12:24:48.261 31152 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:24:48 ctl02 nova-api[31152]: 2017-09-28 12:24:48.390 31152 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:24:48 ctl02 nova-api[31152]: 2017-09-28 12:24:48.623 31152 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:24:48 ctl02 nova-api[31152]: 2017-09-28 12:24:48.625 31152 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:24:48 ctl02 nova-api[31152]: 2017-09-28 12:24:48.625 31152 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:24:48 ctl02 nova-api[31152]: 2017-09-28 12:24:48.625 31152 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:24:48 ctl02 heat-api[13008]: 2017-09-28 12:24:48.666 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:24:48] "OPTIONS / HTTP/1.0" 200 134 0.000554
Sep 28 12:24:48 ctl02 nova-api[31152]: 2017-09-28 12:24:48.755 31152 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:24:48 ctl02 nova-api[31152]: 2017-09-28 12:24:48.756 31152 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:24:48 ctl02 nova-api[31152]: 2017-09-28 12:24:48.757 31152 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:24:48 ctl02 nova-api[31152]: 2017-09-28 12:24:48.757 31152 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:24:48 ctl02 nova-api[31152]: 2017-09-28 12:24:48.760 31152 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:24:48 ctl02 nova-api[31152]: 2017-09-28 12:24:48.760 31152 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:24:48 ctl02 nova-api[31152]: 2017-09-28 12:24:48.760 31152 ERROR nova Traceback (most recent call last):
Sep 28 12:24:48 ctl02 nova-api[31152]: 2017-09-28 12:24:48.760 31152 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:24:48 ctl02 nova-api[31152]: 2017-09-28 12:24:48.760 31152 ERROR nova     sys.exit(main())
Sep 28 12:24:48 ctl02 nova-api[31152]: 2017-09-28 12:24:48.760 31152 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:24:48 ctl02 nova-api[31152]: 2017-09-28 12:24:48.760 31152 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:24:48 ctl02 nova-api[31152]: 2017-09-28 12:24:48.760 31152 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:24:48 ctl02 nova-api[31152]: 2017-09-28 12:24:48.760 31152 ERROR nova     max_url_len=max_url_len)
Sep 28 12:24:48 ctl02 nova-api[31152]: 2017-09-28 12:24:48.760 31152 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:24:48 ctl02 nova-api[31152]: 2017-09-28 12:24:48.760 31152 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:24:48 ctl02 nova-api[31152]: 2017-09-28 12:24:48.760 31152 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:24:48 ctl02 nova-api[31152]: 2017-09-28 12:24:48.760 31152 ERROR nova     sock.listen(backlog)
Sep 28 12:24:48 ctl02 nova-api[31152]: 2017-09-28 12:24:48.760 31152 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:24:48 ctl02 nova-api[31152]: 2017-09-28 12:24:48.760 31152 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:24:48 ctl02 nova-api[31152]: 2017-09-28 12:24:48.760 31152 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:24:48 ctl02 nova-api[31152]: 2017-09-28 12:24:48.760 31152 ERROR nova
Sep 28 12:24:48 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:24:48 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:24:48 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:24:48 ctl02 heat-api-cfn[13300]: 2017-09-28 12:24:48.996 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:24:48] "OPTIONS / HTTP/1.0" 200 134 0.000491
Sep 28 12:24:49 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:24:49 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:24:49 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:24:49 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:24:49 ctl02 heat-engine[12803]: 2017-09-28 12:24:49.763 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:24:49 ctl02 heat-engine[12803]: 2017-09-28 12:24:49.767 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:24:49 ctl02 heat-api-cfn[13300]: 2017-09-28 12:24:49.768 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:24:49] "OPTIONS / HTTP/1.0" 200 134 0.000448
Sep 28 12:24:49 ctl02 heat-engine[12803]: 2017-09-28 12:24:49.769 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:24:49 ctl02 heat-engine[12803]: 2017-09-28 12:24:49.775 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:24:50 ctl02 nova-scheduler[5620]: 2017-09-28 12:24:50.274 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:24:50 ctl02 glance-api[29183]: 2017-09-28 12:24:50.475 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:24:50] "OPTIONS / HTTP/1.0" 200 134 0.000589
Sep 28 12:24:50 ctl02 nova-api[31170]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:24:50 ctl02 nova-api[31170]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:24:50 ctl02 neutron-server[30536]: 2017-09-28 12:24:50.942 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:24:50] "OPTIONS / HTTP/1.0" 200 262 0.000527
Sep 28 12:24:50 ctl02 nova-api[31170]: 2017-09-28 12:24:50.984 31170 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:24:50 ctl02 nova-api[31170]: 2017-09-28 12:24:50.986 31170 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:24:50 ctl02 nova-api[31170]: 2017-09-28 12:24:50.986 31170 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:24:50 ctl02 nova-api[31170]: 2017-09-28 12:24:50.986 31170 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:24:50 ctl02 nova-api[31170]: 2017-09-28 12:24:50.986 31170 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:24:50 ctl02 nova-api[31170]: 2017-09-28 12:24:50.986 31170 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:24:50 ctl02 nova-api[31170]: 2017-09-28 12:24:50.986 31170 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:24:50 ctl02 nova-api[31170]: 2017-09-28 12:24:50.986 31170 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:24:50 ctl02 nova-api[31170]: 2017-09-28 12:24:50.986 31170 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:24:50 ctl02 nova-api[31170]: 2017-09-28 12:24:50.986 31170 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:24:50 ctl02 nova-api[31170]: 2017-09-28 12:24:50.986 31170 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:24:50 ctl02 nova-api[31170]: 2017-09-28 12:24:50.986 31170 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:24:50 ctl02 nova-api[31170]: 2017-09-28 12:24:50.986 31170 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:24:50 ctl02 nova-api[31170]: 2017-09-28 12:24:50.986 31170 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:24:50 ctl02 nova-api[31170]: 2017-09-28 12:24:50.986 31170 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:24:50 ctl02 nova-api[31170]: 2017-09-28 12:24:50.986 31170 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:24:50 ctl02 nova-api[31170]: 2017-09-28 12:24:50.986 31170 ERROR nova.wsgi     self.filename))
Sep 28 12:24:50 ctl02 nova-api[31170]: 2017-09-28 12:24:50.986 31170 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:24:50 ctl02 nova-api[31170]: 2017-09-28 12:24:50.986 31170 ERROR nova.wsgi
Sep 28 12:24:50 ctl02 nova-api[31170]: 2017-09-28 12:24:50.988 31170 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:24:51 ctl02 neutron-server[30536]: 2017-09-28 12:24:51.043 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:24:51] "OPTIONS / HTTP/1.0" 200 262 0.000643
Sep 28 12:24:51 ctl02 nova-api[31170]: 2017-09-28 12:24:51.117 31170 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:24:51 ctl02 neutron-server[30536]: 2017-09-28 12:24:51.298 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:24:51] "OPTIONS / HTTP/1.0" 200 262 0.000498
Sep 28 12:24:51 ctl02 nova-api[31170]: 2017-09-28 12:24:51.348 31170 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:24:51 ctl02 nova-api[31170]: 2017-09-28 12:24:51.351 31170 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:24:51 ctl02 nova-api[31170]: 2017-09-28 12:24:51.351 31170 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:24:51 ctl02 nova-api[31170]: 2017-09-28 12:24:51.352 31170 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:24:51 ctl02 neutron-server[30536]: 2017-09-28 12:24:51.479 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 2 dead agents out of 2:
Sep 28 12:24:51 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:24:51 ctl02 neutron-server[30536]:       Metadata agent  2017-09-28 12:23:58 cmp001
Sep 28 12:24:51 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:23:57 cmp001
Sep 28 12:24:51 ctl02 nova-api[31170]: 2017-09-28 12:24:51.482 31170 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:24:51 ctl02 nova-api[31170]: 2017-09-28 12:24:51.483 31170 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:24:51 ctl02 nova-api[31170]: 2017-09-28 12:24:51.484 31170 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:24:51 ctl02 nova-api[31170]: 2017-09-28 12:24:51.484 31170 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:24:51 ctl02 nova-api[31170]: 2017-09-28 12:24:51.488 31170 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:24:51 ctl02 nova-api[31170]: 2017-09-28 12:24:51.488 31170 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:24:51 ctl02 nova-api[31170]: 2017-09-28 12:24:51.488 31170 ERROR nova Traceback (most recent call last):
Sep 28 12:24:51 ctl02 nova-api[31170]: 2017-09-28 12:24:51.488 31170 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:24:51 ctl02 nova-api[31170]: 2017-09-28 12:24:51.488 31170 ERROR nova     sys.exit(main())
Sep 28 12:24:51 ctl02 nova-api[31170]: 2017-09-28 12:24:51.488 31170 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:24:51 ctl02 nova-api[31170]: 2017-09-28 12:24:51.488 31170 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:24:51 ctl02 nova-api[31170]: 2017-09-28 12:24:51.488 31170 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:24:51 ctl02 nova-api[31170]: 2017-09-28 12:24:51.488 31170 ERROR nova     max_url_len=max_url_len)
Sep 28 12:24:51 ctl02 nova-api[31170]: 2017-09-28 12:24:51.488 31170 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:24:51 ctl02 nova-api[31170]: 2017-09-28 12:24:51.488 31170 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:24:51 ctl02 nova-api[31170]: 2017-09-28 12:24:51.488 31170 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:24:51 ctl02 nova-api[31170]: 2017-09-28 12:24:51.488 31170 ERROR nova     sock.listen(backlog)
Sep 28 12:24:51 ctl02 nova-api[31170]: 2017-09-28 12:24:51.488 31170 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:24:51 ctl02 nova-api[31170]: 2017-09-28 12:24:51.488 31170 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:24:51 ctl02 nova-api[31170]: 2017-09-28 12:24:51.488 31170 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:24:51 ctl02 nova-api[31170]: 2017-09-28 12:24:51.488 31170 ERROR nova
Sep 28 12:24:51 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:24:51 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:24:51 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:24:51 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:24:51 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:24:51 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:24:51 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:24:52 ctl02 glance-api[29183]: 2017-09-28 12:24:52.636 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:24:52] "OPTIONS / HTTP/1.0" 200 134 0.000807
Sep 28 12:24:52 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:24:52.926 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:24:52] "OPTIONS / HTTP/1.0" 200 134 0.000498
Sep 28 12:24:53 ctl02 nova-api[31188]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:24:53 ctl02 nova-api[31188]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:24:53 ctl02 nova-api[31188]: 2017-09-28 12:24:53.787 31188 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:24:53 ctl02 nova-api[31188]: 2017-09-28 12:24:53.789 31188 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:24:53 ctl02 nova-api[31188]: 2017-09-28 12:24:53.789 31188 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:24:53 ctl02 nova-api[31188]: 2017-09-28 12:24:53.789 31188 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:24:53 ctl02 nova-api[31188]: 2017-09-28 12:24:53.789 31188 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:24:53 ctl02 nova-api[31188]: 2017-09-28 12:24:53.789 31188 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:24:53 ctl02 nova-api[31188]: 2017-09-28 12:24:53.789 31188 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:24:53 ctl02 nova-api[31188]: 2017-09-28 12:24:53.789 31188 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:24:53 ctl02 nova-api[31188]: 2017-09-28 12:24:53.789 31188 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:24:53 ctl02 nova-api[31188]: 2017-09-28 12:24:53.789 31188 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:24:53 ctl02 nova-api[31188]: 2017-09-28 12:24:53.789 31188 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:24:53 ctl02 nova-api[31188]: 2017-09-28 12:24:53.789 31188 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:24:53 ctl02 nova-api[31188]: 2017-09-28 12:24:53.789 31188 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:24:53 ctl02 nova-api[31188]: 2017-09-28 12:24:53.789 31188 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:24:53 ctl02 nova-api[31188]: 2017-09-28 12:24:53.789 31188 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:24:53 ctl02 nova-api[31188]: 2017-09-28 12:24:53.789 31188 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:24:53 ctl02 nova-api[31188]: 2017-09-28 12:24:53.789 31188 ERROR nova.wsgi     self.filename))
Sep 28 12:24:53 ctl02 nova-api[31188]: 2017-09-28 12:24:53.789 31188 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:24:53 ctl02 nova-api[31188]: 2017-09-28 12:24:53.789 31188 ERROR nova.wsgi
Sep 28 12:24:53 ctl02 nova-api[31188]: 2017-09-28 12:24:53.790 31188 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:24:53 ctl02 nova-api[31188]: 2017-09-28 12:24:53.922 31188 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:24:53 ctl02 glance-api[29183]: 2017-09-28 12:24:53.929 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:24:53] "OPTIONS / HTTP/1.0" 200 134 0.000998
Sep 28 12:24:54 ctl02 nova-api[31188]: 2017-09-28 12:24:54.168 31188 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:24:54 ctl02 nova-api[31188]: 2017-09-28 12:24:54.170 31188 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:24:54 ctl02 nova-api[31188]: 2017-09-28 12:24:54.170 31188 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:24:54 ctl02 nova-api[31188]: 2017-09-28 12:24:54.171 31188 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:24:54 ctl02 nova-api[31188]: 2017-09-28 12:24:54.303 31188 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:24:54 ctl02 nova-api[31188]: 2017-09-28 12:24:54.305 31188 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:24:54 ctl02 nova-api[31188]: 2017-09-28 12:24:54.306 31188 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:24:54 ctl02 nova-api[31188]: 2017-09-28 12:24:54.306 31188 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:24:54 ctl02 nova-api[31188]: 2017-09-28 12:24:54.309 31188 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:24:54 ctl02 nova-api[31188]: 2017-09-28 12:24:54.310 31188 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:24:54 ctl02 nova-api[31188]: 2017-09-28 12:24:54.310 31188 ERROR nova Traceback (most recent call last):
Sep 28 12:24:54 ctl02 nova-api[31188]: 2017-09-28 12:24:54.310 31188 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:24:54 ctl02 nova-api[31188]: 2017-09-28 12:24:54.310 31188 ERROR nova     sys.exit(main())
Sep 28 12:24:54 ctl02 nova-api[31188]: 2017-09-28 12:24:54.310 31188 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:24:54 ctl02 nova-api[31188]: 2017-09-28 12:24:54.310 31188 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:24:54 ctl02 nova-api[31188]: 2017-09-28 12:24:54.310 31188 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:24:54 ctl02 nova-api[31188]: 2017-09-28 12:24:54.310 31188 ERROR nova     max_url_len=max_url_len)
Sep 28 12:24:54 ctl02 nova-api[31188]: 2017-09-28 12:24:54.310 31188 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:24:54 ctl02 nova-api[31188]: 2017-09-28 12:24:54.310 31188 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:24:54 ctl02 nova-api[31188]: 2017-09-28 12:24:54.310 31188 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:24:54 ctl02 nova-api[31188]: 2017-09-28 12:24:54.310 31188 ERROR nova     sock.listen(backlog)
Sep 28 12:24:54 ctl02 nova-api[31188]: 2017-09-28 12:24:54.310 31188 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:24:54 ctl02 nova-api[31188]: 2017-09-28 12:24:54.310 31188 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:24:54 ctl02 nova-api[31188]: 2017-09-28 12:24:54.310 31188 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:24:54 ctl02 nova-api[31188]: 2017-09-28 12:24:54.310 31188 ERROR nova
Sep 28 12:24:54 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:24:54 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:24:54 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:24:54 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:24:54 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:24:54 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:24:54 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:24:54 ctl02 heat-api[13008]: 2017-09-28 12:24:54.675 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:24:54] "OPTIONS / HTTP/1.0" 200 134 0.000647
Sep 28 12:24:55 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:24:55.289 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:24:55] "OPTIONS / HTTP/1.0" 200 134 0.000466
Sep 28 12:24:56 ctl02 heat-api[13008]: 2017-09-28 12:24:56.228 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:24:56] "OPTIONS / HTTP/1.0" 200 134 0.000588
Sep 28 12:24:56 ctl02 nova-api[31206]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:24:56 ctl02 nova-api[31206]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:24:56 ctl02 nova-api[31206]: 2017-09-28 12:24:56.497 31206 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:24:56 ctl02 nova-api[31206]: 2017-09-28 12:24:56.498 31206 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:24:56 ctl02 nova-api[31206]: 2017-09-28 12:24:56.498 31206 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:24:56 ctl02 nova-api[31206]: 2017-09-28 12:24:56.498 31206 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:24:56 ctl02 nova-api[31206]: 2017-09-28 12:24:56.498 31206 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:24:56 ctl02 nova-api[31206]: 2017-09-28 12:24:56.498 31206 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:24:56 ctl02 nova-api[31206]: 2017-09-28 12:24:56.498 31206 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:24:56 ctl02 nova-api[31206]: 2017-09-28 12:24:56.498 31206 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:24:56 ctl02 nova-api[31206]: 2017-09-28 12:24:56.498 31206 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:24:56 ctl02 nova-api[31206]: 2017-09-28 12:24:56.498 31206 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:24:56 ctl02 nova-api[31206]: 2017-09-28 12:24:56.498 31206 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:24:56 ctl02 nova-api[31206]: 2017-09-28 12:24:56.498 31206 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:24:56 ctl02 nova-api[31206]: 2017-09-28 12:24:56.498 31206 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:24:56 ctl02 nova-api[31206]: 2017-09-28 12:24:56.498 31206 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:24:56 ctl02 nova-api[31206]: 2017-09-28 12:24:56.498 31206 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:24:56 ctl02 nova-api[31206]: 2017-09-28 12:24:56.498 31206 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:24:56 ctl02 nova-api[31206]: 2017-09-28 12:24:56.498 31206 ERROR nova.wsgi     self.filename))
Sep 28 12:24:56 ctl02 nova-api[31206]: 2017-09-28 12:24:56.498 31206 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:24:56 ctl02 nova-api[31206]: 2017-09-28 12:24:56.498 31206 ERROR nova.wsgi
Sep 28 12:24:56 ctl02 nova-api[31206]: 2017-09-28 12:24:56.500 31206 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:24:56 ctl02 nova-api[31206]: 2017-09-28 12:24:56.646 31206 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:24:56 ctl02 nova-api[31206]: 2017-09-28 12:24:56.898 31206 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:24:56 ctl02 nova-api[31206]: 2017-09-28 12:24:56.900 31206 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:24:56 ctl02 nova-api[31206]: 2017-09-28 12:24:56.901 31206 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:24:56 ctl02 nova-api[31206]: 2017-09-28 12:24:56.901 31206 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:24:57 ctl02 nova-api[31206]: 2017-09-28 12:24:57.033 31206 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:24:57 ctl02 nova-api[31206]: 2017-09-28 12:24:57.036 31206 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:24:57 ctl02 nova-api[31206]: 2017-09-28 12:24:57.036 31206 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:24:57 ctl02 nova-api[31206]: 2017-09-28 12:24:57.036 31206 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:24:57 ctl02 nova-api[31206]: 2017-09-28 12:24:57.039 31206 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:24:57 ctl02 nova-api[31206]: 2017-09-28 12:24:57.040 31206 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:24:57 ctl02 nova-api[31206]: 2017-09-28 12:24:57.040 31206 ERROR nova Traceback (most recent call last):
Sep 28 12:24:57 ctl02 nova-api[31206]: 2017-09-28 12:24:57.040 31206 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:24:57 ctl02 nova-api[31206]: 2017-09-28 12:24:57.040 31206 ERROR nova     sys.exit(main())
Sep 28 12:24:57 ctl02 nova-api[31206]: 2017-09-28 12:24:57.040 31206 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:24:57 ctl02 nova-api[31206]: 2017-09-28 12:24:57.040 31206 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:24:57 ctl02 nova-api[31206]: 2017-09-28 12:24:57.040 31206 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:24:57 ctl02 nova-api[31206]: 2017-09-28 12:24:57.040 31206 ERROR nova     max_url_len=max_url_len)
Sep 28 12:24:57 ctl02 nova-api[31206]: 2017-09-28 12:24:57.040 31206 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:24:57 ctl02 nova-api[31206]: 2017-09-28 12:24:57.040 31206 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:24:57 ctl02 nova-api[31206]: 2017-09-28 12:24:57.040 31206 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:24:57 ctl02 nova-api[31206]: 2017-09-28 12:24:57.040 31206 ERROR nova     sock.listen(backlog)
Sep 28 12:24:57 ctl02 nova-api[31206]: 2017-09-28 12:24:57.040 31206 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:24:57 ctl02 nova-api[31206]: 2017-09-28 12:24:57.040 31206 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:24:57 ctl02 nova-api[31206]: 2017-09-28 12:24:57.040 31206 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:24:57 ctl02 nova-api[31206]: 2017-09-28 12:24:57.040 31206 ERROR nova
Sep 28 12:24:57 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:24:57 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:24:57 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:24:57 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:24:57 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:24:57 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:24:57 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:24:58 ctl02 heat-api-cfn[13300]: 2017-09-28 12:24:58.112 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:24:58] "OPTIONS / HTTP/1.0" 200 134 0.000536
Sep 28 12:24:58 ctl02 heat-api[13008]: 2017-09-28 12:24:58.353 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:24:58] "OPTIONS / HTTP/1.0" 200 134 0.000647
Sep 28 12:24:58 ctl02 neutron-server[30536]: 2017-09-28 12:24:58.470 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:24:58 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:24:58.647 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:24:58] "OPTIONS / HTTP/1.0" 200 134 0.000473
Sep 28 12:24:58 ctl02 heat-api-cfn[13300]: 2017-09-28 12:24:58.806 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:24:58] "OPTIONS / HTTP/1.0" 200 134 0.000527
Sep 28 12:24:59 ctl02 nova-api[31224]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:24:59 ctl02 nova-api[31224]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:24:59 ctl02 nova-api[31224]: 2017-09-28 12:24:59.290 31224 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:24:59 ctl02 nova-api[31224]: 2017-09-28 12:24:59.292 31224 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:24:59 ctl02 nova-api[31224]: 2017-09-28 12:24:59.292 31224 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:24:59 ctl02 nova-api[31224]: 2017-09-28 12:24:59.292 31224 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:24:59 ctl02 nova-api[31224]: 2017-09-28 12:24:59.292 31224 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:24:59 ctl02 nova-api[31224]: 2017-09-28 12:24:59.292 31224 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:24:59 ctl02 nova-api[31224]: 2017-09-28 12:24:59.292 31224 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:24:59 ctl02 nova-api[31224]: 2017-09-28 12:24:59.292 31224 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:24:59 ctl02 nova-api[31224]: 2017-09-28 12:24:59.292 31224 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:24:59 ctl02 nova-api[31224]: 2017-09-28 12:24:59.292 31224 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:24:59 ctl02 nova-api[31224]: 2017-09-28 12:24:59.292 31224 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:24:59 ctl02 nova-api[31224]: 2017-09-28 12:24:59.292 31224 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:24:59 ctl02 nova-api[31224]: 2017-09-28 12:24:59.292 31224 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:24:59 ctl02 nova-api[31224]: 2017-09-28 12:24:59.292 31224 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:24:59 ctl02 nova-api[31224]: 2017-09-28 12:24:59.292 31224 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:24:59 ctl02 nova-api[31224]: 2017-09-28 12:24:59.292 31224 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:24:59 ctl02 nova-api[31224]: 2017-09-28 12:24:59.292 31224 ERROR nova.wsgi     self.filename))
Sep 28 12:24:59 ctl02 nova-api[31224]: 2017-09-28 12:24:59.292 31224 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:24:59 ctl02 nova-api[31224]: 2017-09-28 12:24:59.292 31224 ERROR nova.wsgi
Sep 28 12:24:59 ctl02 nova-api[31224]: 2017-09-28 12:24:59.294 31224 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:24:59 ctl02 nova-api[31224]: 2017-09-28 12:24:59.429 31224 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:24:59 ctl02 heat-api-cfn[13300]: 2017-09-28 12:24:59.614 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:24:59] "OPTIONS / HTTP/1.0" 200 134 0.000556
Sep 28 12:24:59 ctl02 nova-api[31224]: 2017-09-28 12:24:59.676 31224 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:24:59 ctl02 nova-api[31224]: 2017-09-28 12:24:59.679 31224 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:24:59 ctl02 nova-api[31224]: 2017-09-28 12:24:59.680 31224 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:24:59 ctl02 nova-api[31224]: 2017-09-28 12:24:59.680 31224 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:24:59 ctl02 nova-api[31224]: 2017-09-28 12:24:59.811 31224 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:24:59 ctl02 nova-api[31224]: 2017-09-28 12:24:59.814 31224 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:24:59 ctl02 nova-api[31224]: 2017-09-28 12:24:59.814 31224 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:24:59 ctl02 nova-api[31224]: 2017-09-28 12:24:59.815 31224 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:24:59 ctl02 nova-api[31224]: 2017-09-28 12:24:59.818 31224 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:24:59 ctl02 nova-api[31224]: 2017-09-28 12:24:59.819 31224 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:24:59 ctl02 nova-api[31224]: 2017-09-28 12:24:59.819 31224 ERROR nova Traceback (most recent call last):
Sep 28 12:24:59 ctl02 nova-api[31224]: 2017-09-28 12:24:59.819 31224 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:24:59 ctl02 nova-api[31224]: 2017-09-28 12:24:59.819 31224 ERROR nova     sys.exit(main())
Sep 28 12:24:59 ctl02 nova-api[31224]: 2017-09-28 12:24:59.819 31224 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:24:59 ctl02 nova-api[31224]: 2017-09-28 12:24:59.819 31224 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:24:59 ctl02 nova-api[31224]: 2017-09-28 12:24:59.819 31224 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:24:59 ctl02 nova-api[31224]: 2017-09-28 12:24:59.819 31224 ERROR nova     max_url_len=max_url_len)
Sep 28 12:24:59 ctl02 nova-api[31224]: 2017-09-28 12:24:59.819 31224 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:24:59 ctl02 nova-api[31224]: 2017-09-28 12:24:59.819 31224 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:24:59 ctl02 nova-api[31224]: 2017-09-28 12:24:59.819 31224 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:24:59 ctl02 nova-api[31224]: 2017-09-28 12:24:59.819 31224 ERROR nova     sock.listen(backlog)
Sep 28 12:24:59 ctl02 nova-api[31224]: 2017-09-28 12:24:59.819 31224 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:24:59 ctl02 nova-api[31224]: 2017-09-28 12:24:59.819 31224 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:24:59 ctl02 nova-api[31224]: 2017-09-28 12:24:59.819 31224 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:24:59 ctl02 nova-api[31224]: 2017-09-28 12:24:59.819 31224 ERROR nova
Sep 28 12:24:59 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:24:59 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:24:59 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:25:00 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:25:00 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:25:00 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:25:00 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:25:00 ctl02 glance-api[29183]: 2017-09-28 12:25:00.650 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:25:00] "OPTIONS / HTTP/1.0" 200 134 0.000657
Sep 28 12:25:00 ctl02 neutron-server[30536]: 2017-09-28 12:25:00.652 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:25:00] "OPTIONS / HTTP/1.0" 200 262 0.000554
Sep 28 12:25:01 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6522e53b)
Sep 28 12:25:01 ctl02 neutron-server[30536]: 2017-09-28 12:25:01.157 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:25:01] "OPTIONS / HTTP/1.0" 200 262 0.000565
Sep 28 12:25:01 ctl02 neutron-server[30536]: 2017-09-28 12:25:01.539 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:25:01] "OPTIONS / HTTP/1.0" 200 262 0.000590
Sep 28 12:25:01 ctl02 nova-api[31242]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:25:01 ctl02 nova-api[31242]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:25:02 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6522e53b)
Sep 28 12:25:02 ctl02 nova-api[31242]: 2017-09-28 12:25:02.031 31242 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:25:02 ctl02 nova-api[31242]: 2017-09-28 12:25:02.033 31242 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:25:02 ctl02 nova-api[31242]: 2017-09-28 12:25:02.033 31242 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:25:02 ctl02 nova-api[31242]: 2017-09-28 12:25:02.033 31242 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:25:02 ctl02 nova-api[31242]: 2017-09-28 12:25:02.033 31242 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:25:02 ctl02 nova-api[31242]: 2017-09-28 12:25:02.033 31242 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:25:02 ctl02 nova-api[31242]: 2017-09-28 12:25:02.033 31242 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:25:02 ctl02 nova-api[31242]: 2017-09-28 12:25:02.033 31242 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:25:02 ctl02 nova-api[31242]: 2017-09-28 12:25:02.033 31242 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:25:02 ctl02 nova-api[31242]: 2017-09-28 12:25:02.033 31242 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:25:02 ctl02 nova-api[31242]: 2017-09-28 12:25:02.033 31242 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:25:02 ctl02 nova-api[31242]: 2017-09-28 12:25:02.033 31242 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:25:02 ctl02 nova-api[31242]: 2017-09-28 12:25:02.033 31242 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:25:02 ctl02 nova-api[31242]: 2017-09-28 12:25:02.033 31242 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:25:02 ctl02 nova-api[31242]: 2017-09-28 12:25:02.033 31242 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:25:02 ctl02 nova-api[31242]: 2017-09-28 12:25:02.033 31242 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:25:02 ctl02 nova-api[31242]: 2017-09-28 12:25:02.033 31242 ERROR nova.wsgi     self.filename))
Sep 28 12:25:02 ctl02 nova-api[31242]: 2017-09-28 12:25:02.033 31242 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:25:02 ctl02 nova-api[31242]: 2017-09-28 12:25:02.033 31242 ERROR nova.wsgi
Sep 28 12:25:02 ctl02 nova-api[31242]: 2017-09-28 12:25:02.035 31242 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:25:02 ctl02 nova-api[31242]: 2017-09-28 12:25:02.169 31242 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:25:02 ctl02 nova-api[31242]: 2017-09-28 12:25:02.419 31242 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:25:02 ctl02 nova-api[31242]: 2017-09-28 12:25:02.421 31242 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:25:02 ctl02 nova-api[31242]: 2017-09-28 12:25:02.421 31242 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:25:02 ctl02 nova-api[31242]: 2017-09-28 12:25:02.422 31242 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:25:02 ctl02 nova-api[31242]: 2017-09-28 12:25:02.555 31242 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:25:02 ctl02 nova-api[31242]: 2017-09-28 12:25:02.558 31242 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:25:02 ctl02 nova-api[31242]: 2017-09-28 12:25:02.558 31242 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:25:02 ctl02 nova-api[31242]: 2017-09-28 12:25:02.559 31242 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:25:02 ctl02 nova-api[31242]: 2017-09-28 12:25:02.562 31242 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:25:02 ctl02 nova-api[31242]: 2017-09-28 12:25:02.563 31242 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:25:02 ctl02 nova-api[31242]: 2017-09-28 12:25:02.563 31242 ERROR nova Traceback (most recent call last):
Sep 28 12:25:02 ctl02 nova-api[31242]: 2017-09-28 12:25:02.563 31242 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:25:02 ctl02 nova-api[31242]: 2017-09-28 12:25:02.563 31242 ERROR nova     sys.exit(main())
Sep 28 12:25:02 ctl02 nova-api[31242]: 2017-09-28 12:25:02.563 31242 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:25:02 ctl02 nova-api[31242]: 2017-09-28 12:25:02.563 31242 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:25:02 ctl02 nova-api[31242]: 2017-09-28 12:25:02.563 31242 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:25:02 ctl02 nova-api[31242]: 2017-09-28 12:25:02.563 31242 ERROR nova     max_url_len=max_url_len)
Sep 28 12:25:02 ctl02 nova-api[31242]: 2017-09-28 12:25:02.563 31242 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:25:02 ctl02 nova-api[31242]: 2017-09-28 12:25:02.563 31242 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:25:02 ctl02 nova-api[31242]: 2017-09-28 12:25:02.563 31242 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:25:02 ctl02 nova-api[31242]: 2017-09-28 12:25:02.563 31242 ERROR nova     sock.listen(backlog)
Sep 28 12:25:02 ctl02 nova-api[31242]: 2017-09-28 12:25:02.563 31242 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:25:02 ctl02 nova-api[31242]: 2017-09-28 12:25:02.563 31242 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:25:02 ctl02 nova-api[31242]: 2017-09-28 12:25:02.563 31242 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:25:02 ctl02 nova-api[31242]: 2017-09-28 12:25:02.563 31242 ERROR nova
Sep 28 12:25:02 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:25:02 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:25:02 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:25:02 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:25:02 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:25:02 ctl02 glance-api[29183]: 2017-09-28 12:25:02.884 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:25:02] "OPTIONS / HTTP/1.0" 200 134 0.000764
Sep 28 12:25:02 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:25:02 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:25:03 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6522e53b)
Sep 28 12:25:03 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:25:03.167 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:25:03] "OPTIONS / HTTP/1.0" 200 134 0.000520
Sep 28 12:25:04 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6522e53b)
Sep 28 12:25:04 ctl02 glance-api[29183]: 2017-09-28 12:25:04.269 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:25:04] "OPTIONS / HTTP/1.0" 200 134 0.001015
Sep 28 12:25:04 ctl02 nova-api[31260]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:25:04 ctl02 nova-api[31260]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:25:04 ctl02 nova-api[31260]: 2017-09-28 12:25:04.745 31260 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:25:04 ctl02 nova-api[31260]: 2017-09-28 12:25:04.746 31260 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:25:04 ctl02 nova-api[31260]: 2017-09-28 12:25:04.746 31260 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:25:04 ctl02 nova-api[31260]: 2017-09-28 12:25:04.746 31260 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:25:04 ctl02 nova-api[31260]: 2017-09-28 12:25:04.746 31260 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:25:04 ctl02 nova-api[31260]: 2017-09-28 12:25:04.746 31260 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:25:04 ctl02 nova-api[31260]: 2017-09-28 12:25:04.746 31260 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:25:04 ctl02 nova-api[31260]: 2017-09-28 12:25:04.746 31260 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:25:04 ctl02 nova-api[31260]: 2017-09-28 12:25:04.746 31260 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:25:04 ctl02 nova-api[31260]: 2017-09-28 12:25:04.746 31260 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:25:04 ctl02 nova-api[31260]: 2017-09-28 12:25:04.746 31260 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:25:04 ctl02 nova-api[31260]: 2017-09-28 12:25:04.746 31260 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:25:04 ctl02 nova-api[31260]: 2017-09-28 12:25:04.746 31260 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:25:04 ctl02 nova-api[31260]: 2017-09-28 12:25:04.746 31260 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:25:04 ctl02 nova-api[31260]: 2017-09-28 12:25:04.746 31260 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:25:04 ctl02 nova-api[31260]: 2017-09-28 12:25:04.746 31260 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:25:04 ctl02 nova-api[31260]: 2017-09-28 12:25:04.746 31260 ERROR nova.wsgi     self.filename))
Sep 28 12:25:04 ctl02 nova-api[31260]: 2017-09-28 12:25:04.746 31260 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:25:04 ctl02 nova-api[31260]: 2017-09-28 12:25:04.746 31260 ERROR nova.wsgi
Sep 28 12:25:04 ctl02 nova-api[31260]: 2017-09-28 12:25:04.749 31260 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:25:04 ctl02 nova-api[31260]: 2017-09-28 12:25:04.878 31260 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:25:05 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6522e53b)
Sep 28 12:25:05 ctl02 heat-api[13008]: 2017-09-28 12:25:05.040 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:25:05] "OPTIONS / HTTP/1.0" 200 134 0.000690
Sep 28 12:25:05 ctl02 nova-api[31260]: 2017-09-28 12:25:05.109 31260 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:25:05 ctl02 nova-api[31260]: 2017-09-28 12:25:05.111 31260 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:25:05 ctl02 nova-api[31260]: 2017-09-28 12:25:05.111 31260 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:25:05 ctl02 nova-api[31260]: 2017-09-28 12:25:05.112 31260 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:25:05 ctl02 nova-api[31260]: 2017-09-28 12:25:05.242 31260 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:25:05 ctl02 nova-api[31260]: 2017-09-28 12:25:05.245 31260 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:25:05 ctl02 nova-api[31260]: 2017-09-28 12:25:05.245 31260 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:25:05 ctl02 nova-api[31260]: 2017-09-28 12:25:05.245 31260 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:25:05 ctl02 nova-api[31260]: 2017-09-28 12:25:05.249 31260 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:25:05 ctl02 nova-api[31260]: 2017-09-28 12:25:05.249 31260 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:25:05 ctl02 nova-api[31260]: 2017-09-28 12:25:05.249 31260 ERROR nova Traceback (most recent call last):
Sep 28 12:25:05 ctl02 nova-api[31260]: 2017-09-28 12:25:05.249 31260 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:25:05 ctl02 nova-api[31260]: 2017-09-28 12:25:05.249 31260 ERROR nova     sys.exit(main())
Sep 28 12:25:05 ctl02 nova-api[31260]: 2017-09-28 12:25:05.249 31260 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:25:05 ctl02 nova-api[31260]: 2017-09-28 12:25:05.249 31260 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:25:05 ctl02 nova-api[31260]: 2017-09-28 12:25:05.249 31260 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:25:05 ctl02 nova-api[31260]: 2017-09-28 12:25:05.249 31260 ERROR nova     max_url_len=max_url_len)
Sep 28 12:25:05 ctl02 nova-api[31260]: 2017-09-28 12:25:05.249 31260 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:25:05 ctl02 nova-api[31260]: 2017-09-28 12:25:05.249 31260 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:25:05 ctl02 nova-api[31260]: 2017-09-28 12:25:05.249 31260 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:25:05 ctl02 nova-api[31260]: 2017-09-28 12:25:05.249 31260 ERROR nova     sock.listen(backlog)
Sep 28 12:25:05 ctl02 nova-api[31260]: 2017-09-28 12:25:05.249 31260 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:25:05 ctl02 nova-api[31260]: 2017-09-28 12:25:05.249 31260 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:25:05 ctl02 nova-api[31260]: 2017-09-28 12:25:05.249 31260 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:25:05 ctl02 nova-api[31260]: 2017-09-28 12:25:05.249 31260 ERROR nova
Sep 28 12:25:05 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:25:05.425 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:25:05] "OPTIONS / HTTP/1.0" 200 134 0.000438
Sep 28 12:25:05 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:25:05 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:25:05 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:25:05 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:25:05 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:25:05 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:25:05 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:25:05 ctl02 heat-api[13008]: 2017-09-28 12:25:05.958 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:25:05] "OPTIONS / HTTP/1.0" 200 134 0.000601
Sep 28 12:25:06 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6522e53b)
Sep 28 12:25:06 ctl02 neutron-server[30536]: 2017-09-28 12:25:06.474 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 2 dead agents out of 2:
Sep 28 12:25:06 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:25:06 ctl02 neutron-server[30536]:       Metadata agent  2017-09-28 12:23:58 cmp001
Sep 28 12:25:06 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:23:57 cmp001
Sep 28 12:25:07 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6522e53b)
Sep 28 12:25:07 ctl02 nova-api[31277]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:25:07 ctl02 nova-api[31277]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:25:07 ctl02 nova-api[31277]: 2017-09-28 12:25:07.491 31277 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:25:07 ctl02 nova-api[31277]: 2017-09-28 12:25:07.492 31277 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:25:07 ctl02 nova-api[31277]: 2017-09-28 12:25:07.492 31277 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:25:07 ctl02 nova-api[31277]: 2017-09-28 12:25:07.492 31277 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:25:07 ctl02 nova-api[31277]: 2017-09-28 12:25:07.492 31277 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:25:07 ctl02 nova-api[31277]: 2017-09-28 12:25:07.492 31277 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:25:07 ctl02 nova-api[31277]: 2017-09-28 12:25:07.492 31277 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:25:07 ctl02 nova-api[31277]: 2017-09-28 12:25:07.492 31277 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:25:07 ctl02 nova-api[31277]: 2017-09-28 12:25:07.492 31277 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:25:07 ctl02 nova-api[31277]: 2017-09-28 12:25:07.492 31277 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:25:07 ctl02 nova-api[31277]: 2017-09-28 12:25:07.492 31277 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:25:07 ctl02 nova-api[31277]: 2017-09-28 12:25:07.492 31277 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:25:07 ctl02 nova-api[31277]: 2017-09-28 12:25:07.492 31277 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:25:07 ctl02 nova-api[31277]: 2017-09-28 12:25:07.492 31277 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:25:07 ctl02 nova-api[31277]: 2017-09-28 12:25:07.492 31277 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:25:07 ctl02 nova-api[31277]: 2017-09-28 12:25:07.492 31277 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:25:07 ctl02 nova-api[31277]: 2017-09-28 12:25:07.492 31277 ERROR nova.wsgi     self.filename))
Sep 28 12:25:07 ctl02 nova-api[31277]: 2017-09-28 12:25:07.492 31277 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:25:07 ctl02 nova-api[31277]: 2017-09-28 12:25:07.492 31277 ERROR nova.wsgi
Sep 28 12:25:07 ctl02 nova-api[31277]: 2017-09-28 12:25:07.495 31277 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:25:07 ctl02 nova-api[31277]: 2017-09-28 12:25:07.622 31277 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:25:07 ctl02 nova-api[31277]: 2017-09-28 12:25:07.850 31277 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:25:07 ctl02 nova-api[31277]: 2017-09-28 12:25:07.853 31277 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:25:07 ctl02 nova-api[31277]: 2017-09-28 12:25:07.853 31277 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:25:07 ctl02 nova-api[31277]: 2017-09-28 12:25:07.854 31277 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:25:07 ctl02 heat-api-cfn[13300]: 2017-09-28 12:25:07.875 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:25:07] "OPTIONS / HTTP/1.0" 200 134 0.000432
Sep 28 12:25:07 ctl02 nova-api[31277]: 2017-09-28 12:25:07.982 31277 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:25:07 ctl02 nova-api[31277]: 2017-09-28 12:25:07.985 31277 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:25:07 ctl02 nova-api[31277]: 2017-09-28 12:25:07.985 31277 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:25:07 ctl02 nova-api[31277]: 2017-09-28 12:25:07.986 31277 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:25:07 ctl02 nova-api[31277]: 2017-09-28 12:25:07.989 31277 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:25:07 ctl02 nova-api[31277]: 2017-09-28 12:25:07.990 31277 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:25:07 ctl02 nova-api[31277]: 2017-09-28 12:25:07.990 31277 ERROR nova Traceback (most recent call last):
Sep 28 12:25:07 ctl02 nova-api[31277]: 2017-09-28 12:25:07.990 31277 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:25:07 ctl02 nova-api[31277]: 2017-09-28 12:25:07.990 31277 ERROR nova     sys.exit(main())
Sep 28 12:25:07 ctl02 nova-api[31277]: 2017-09-28 12:25:07.990 31277 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:25:07 ctl02 nova-api[31277]: 2017-09-28 12:25:07.990 31277 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:25:07 ctl02 nova-api[31277]: 2017-09-28 12:25:07.990 31277 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:25:07 ctl02 nova-api[31277]: 2017-09-28 12:25:07.990 31277 ERROR nova     max_url_len=max_url_len)
Sep 28 12:25:07 ctl02 nova-api[31277]: 2017-09-28 12:25:07.990 31277 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:25:07 ctl02 nova-api[31277]: 2017-09-28 12:25:07.990 31277 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:25:07 ctl02 nova-api[31277]: 2017-09-28 12:25:07.990 31277 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:25:07 ctl02 nova-api[31277]: 2017-09-28 12:25:07.990 31277 ERROR nova     sock.listen(backlog)
Sep 28 12:25:07 ctl02 nova-api[31277]: 2017-09-28 12:25:07.990 31277 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:25:07 ctl02 nova-api[31277]: 2017-09-28 12:25:07.990 31277 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:25:07 ctl02 nova-api[31277]: 2017-09-28 12:25:07.990 31277 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:25:07 ctl02 nova-api[31277]: 2017-09-28 12:25:07.990 31277 ERROR nova
Sep 28 12:25:08 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6522e53b)
Sep 28 12:25:08 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:25:08 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:25:08 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:25:08 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:25:08 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:25:08 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:25:08 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:25:08 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:25:08.532 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:25:08] "OPTIONS / HTTP/1.0" 200 134 0.000436
Sep 28 12:25:08 ctl02 heat-api[13008]: 2017-09-28 12:25:08.644 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:25:08] "OPTIONS / HTTP/1.0" 200 134 0.000544
Sep 28 12:25:09 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6522e53b)
Sep 28 12:25:09 ctl02 heat-api-cfn[13300]: 2017-09-28 12:25:09.081 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:25:09] "OPTIONS / HTTP/1.0" 200 134 0.000427
Sep 28 12:25:09 ctl02 nova-cert[4860]: 2017-09-28 12:25:09.401 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:25:09 ctl02 heat-api-cfn[13300]: 2017-09-28 12:25:09.668 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:25:09] "OPTIONS / HTTP/1.0" 200 134 0.000440
Sep 28 12:25:10 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6522e53b)
Sep 28 12:25:10 ctl02 nova-api[31296]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:25:10 ctl02 nova-api[31296]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:25:10 ctl02 nova-api[31296]: 2017-09-28 12:25:10.233 31296 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:25:10 ctl02 nova-api[31296]: 2017-09-28 12:25:10.235 31296 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:25:10 ctl02 nova-api[31296]: 2017-09-28 12:25:10.235 31296 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:25:10 ctl02 nova-api[31296]: 2017-09-28 12:25:10.235 31296 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:25:10 ctl02 nova-api[31296]: 2017-09-28 12:25:10.235 31296 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:25:10 ctl02 nova-api[31296]: 2017-09-28 12:25:10.235 31296 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:25:10 ctl02 nova-api[31296]: 2017-09-28 12:25:10.235 31296 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:25:10 ctl02 nova-api[31296]: 2017-09-28 12:25:10.235 31296 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:25:10 ctl02 nova-api[31296]: 2017-09-28 12:25:10.235 31296 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:25:10 ctl02 nova-api[31296]: 2017-09-28 12:25:10.235 31296 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:25:10 ctl02 nova-api[31296]: 2017-09-28 12:25:10.235 31296 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:25:10 ctl02 nova-api[31296]: 2017-09-28 12:25:10.235 31296 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:25:10 ctl02 nova-api[31296]: 2017-09-28 12:25:10.235 31296 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:25:10 ctl02 nova-api[31296]: 2017-09-28 12:25:10.235 31296 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:25:10 ctl02 nova-api[31296]: 2017-09-28 12:25:10.235 31296 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:25:10 ctl02 nova-api[31296]: 2017-09-28 12:25:10.235 31296 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:25:10 ctl02 nova-api[31296]: 2017-09-28 12:25:10.235 31296 ERROR nova.wsgi     self.filename))
Sep 28 12:25:10 ctl02 nova-api[31296]: 2017-09-28 12:25:10.235 31296 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:25:10 ctl02 nova-api[31296]: 2017-09-28 12:25:10.235 31296 ERROR nova.wsgi
Sep 28 12:25:10 ctl02 nova-api[31296]: 2017-09-28 12:25:10.237 31296 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:25:10 ctl02 glance-api[29183]: 2017-09-28 12:25:10.272 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:25:10] "OPTIONS / HTTP/1.0" 200 134 0.000638
Sep 28 12:25:10 ctl02 nova-api[31296]: 2017-09-28 12:25:10.366 31296 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:25:10 ctl02 nova-api[31296]: 2017-09-28 12:25:10.595 31296 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:25:10 ctl02 nova-api[31296]: 2017-09-28 12:25:10.598 31296 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:25:10 ctl02 nova-api[31296]: 2017-09-28 12:25:10.598 31296 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:25:10 ctl02 nova-api[31296]: 2017-09-28 12:25:10.599 31296 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:25:10 ctl02 nova-conductor[5056]: 2017-09-28 12:25:10.649 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:25:10 ctl02 nova-conductor[5056]: 2017-09-28 12:25:10.666 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:25:10 ctl02 nova-conductor[5056]: 2017-09-28 12:25:10.686 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:25:10 ctl02 nova-conductor[5056]: 2017-09-28 12:25:10.696 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:25:10 ctl02 nova-api[31296]: 2017-09-28 12:25:10.736 31296 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:25:10 ctl02 nova-api[31296]: 2017-09-28 12:25:10.738 31296 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:25:10 ctl02 nova-api[31296]: 2017-09-28 12:25:10.738 31296 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:25:10 ctl02 nova-api[31296]: 2017-09-28 12:25:10.739 31296 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:25:10 ctl02 nova-api[31296]: 2017-09-28 12:25:10.742 31296 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:25:10 ctl02 nova-api[31296]: 2017-09-28 12:25:10.742 31296 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:25:10 ctl02 nova-api[31296]: 2017-09-28 12:25:10.742 31296 ERROR nova Traceback (most recent call last):
Sep 28 12:25:10 ctl02 nova-api[31296]: 2017-09-28 12:25:10.742 31296 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:25:10 ctl02 nova-api[31296]: 2017-09-28 12:25:10.742 31296 ERROR nova     sys.exit(main())
Sep 28 12:25:10 ctl02 nova-api[31296]: 2017-09-28 12:25:10.742 31296 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:25:10 ctl02 nova-api[31296]: 2017-09-28 12:25:10.742 31296 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:25:10 ctl02 nova-api[31296]: 2017-09-28 12:25:10.742 31296 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:25:10 ctl02 nova-api[31296]: 2017-09-28 12:25:10.742 31296 ERROR nova     max_url_len=max_url_len)
Sep 28 12:25:10 ctl02 nova-api[31296]: 2017-09-28 12:25:10.742 31296 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:25:10 ctl02 nova-api[31296]: 2017-09-28 12:25:10.742 31296 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:25:10 ctl02 nova-api[31296]: 2017-09-28 12:25:10.742 31296 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:25:10 ctl02 nova-api[31296]: 2017-09-28 12:25:10.742 31296 ERROR nova     sock.listen(backlog)
Sep 28 12:25:10 ctl02 nova-api[31296]: 2017-09-28 12:25:10.742 31296 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:25:10 ctl02 nova-api[31296]: 2017-09-28 12:25:10.742 31296 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:25:10 ctl02 nova-api[31296]: 2017-09-28 12:25:10.742 31296 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:25:10 ctl02 nova-api[31296]: 2017-09-28 12:25:10.742 31296 ERROR nova
Sep 28 12:25:10 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:25:10 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:25:10 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:25:11 ctl02 neutron-server[30536]: 2017-09-28 12:25:11.014 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:25:11] "OPTIONS / HTTP/1.0" 200 262 0.000660
Sep 28 12:25:11 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6522e53b)
Sep 28 12:25:11 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:25:11 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:25:11 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:25:11 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:25:11 ctl02 neutron-server[30536]: 2017-09-28 12:25:11.334 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:25:11] "OPTIONS / HTTP/1.0" 200 262 0.000476
Sep 28 12:25:11 ctl02 neutron-server[30536]: 2017-09-28 12:25:11.428 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:25:11] "OPTIONS / HTTP/1.0" 200 262 0.000557
Sep 28 12:25:12 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:25:12 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:25:12 ctl02 glance-api[29183]: 2017-09-28 12:25:12.646 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:25:12] "OPTIONS / HTTP/1.0" 200 134 0.000550
Sep 28 12:25:12 ctl02 nova-api[31314]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:25:12 ctl02 nova-api[31314]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:25:13 ctl02 nova-api[31314]: 2017-09-28 12:25:13.024 31314 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:25:13 ctl02 nova-api[31314]: 2017-09-28 12:25:13.025 31314 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:25:13 ctl02 nova-api[31314]: 2017-09-28 12:25:13.025 31314 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:25:13 ctl02 nova-api[31314]: 2017-09-28 12:25:13.025 31314 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:25:13 ctl02 nova-api[31314]: 2017-09-28 12:25:13.025 31314 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:25:13 ctl02 nova-api[31314]: 2017-09-28 12:25:13.025 31314 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:25:13 ctl02 nova-api[31314]: 2017-09-28 12:25:13.025 31314 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:25:13 ctl02 nova-api[31314]: 2017-09-28 12:25:13.025 31314 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:25:13 ctl02 nova-api[31314]: 2017-09-28 12:25:13.025 31314 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:25:13 ctl02 nova-api[31314]: 2017-09-28 12:25:13.025 31314 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:25:13 ctl02 nova-api[31314]: 2017-09-28 12:25:13.025 31314 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:25:13 ctl02 nova-api[31314]: 2017-09-28 12:25:13.025 31314 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:25:13 ctl02 nova-api[31314]: 2017-09-28 12:25:13.025 31314 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:25:13 ctl02 nova-api[31314]: 2017-09-28 12:25:13.025 31314 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:25:13 ctl02 nova-api[31314]: 2017-09-28 12:25:13.025 31314 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:25:13 ctl02 nova-api[31314]: 2017-09-28 12:25:13.025 31314 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:25:13 ctl02 nova-api[31314]: 2017-09-28 12:25:13.025 31314 ERROR nova.wsgi     self.filename))
Sep 28 12:25:13 ctl02 nova-api[31314]: 2017-09-28 12:25:13.025 31314 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:25:13 ctl02 nova-api[31314]: 2017-09-28 12:25:13.025 31314 ERROR nova.wsgi
Sep 28 12:25:13 ctl02 nova-api[31314]: 2017-09-28 12:25:13.026 31314 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:25:13 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:25:13.047 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:25:13] "OPTIONS / HTTP/1.0" 200 134 0.000385
Sep 28 12:25:13 ctl02 nova-api[31314]: 2017-09-28 12:25:13.158 31314 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:25:13 ctl02 nova-api[31314]: 2017-09-28 12:25:13.378 31314 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:25:13 ctl02 nova-api[31314]: 2017-09-28 12:25:13.381 31314 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:25:13 ctl02 nova-api[31314]: 2017-09-28 12:25:13.381 31314 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:25:13 ctl02 nova-api[31314]: 2017-09-28 12:25:13.381 31314 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:25:13 ctl02 neutron-server[30536]: 2017-09-28 12:25:13.475 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:25:13 ctl02 nova-api[31314]: 2017-09-28 12:25:13.515 31314 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:25:13 ctl02 nova-api[31314]: 2017-09-28 12:25:13.517 31314 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:25:13 ctl02 nova-api[31314]: 2017-09-28 12:25:13.517 31314 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:25:13 ctl02 nova-api[31314]: 2017-09-28 12:25:13.518 31314 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:25:13 ctl02 nova-api[31314]: 2017-09-28 12:25:13.521 31314 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:25:13 ctl02 nova-api[31314]: 2017-09-28 12:25:13.521 31314 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:25:13 ctl02 nova-api[31314]: 2017-09-28 12:25:13.521 31314 ERROR nova Traceback (most recent call last):
Sep 28 12:25:13 ctl02 nova-api[31314]: 2017-09-28 12:25:13.521 31314 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:25:13 ctl02 nova-api[31314]: 2017-09-28 12:25:13.521 31314 ERROR nova     sys.exit(main())
Sep 28 12:25:13 ctl02 nova-api[31314]: 2017-09-28 12:25:13.521 31314 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:25:13 ctl02 nova-api[31314]: 2017-09-28 12:25:13.521 31314 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:25:13 ctl02 nova-api[31314]: 2017-09-28 12:25:13.521 31314 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:25:13 ctl02 nova-api[31314]: 2017-09-28 12:25:13.521 31314 ERROR nova     max_url_len=max_url_len)
Sep 28 12:25:13 ctl02 nova-api[31314]: 2017-09-28 12:25:13.521 31314 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:25:13 ctl02 nova-api[31314]: 2017-09-28 12:25:13.521 31314 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:25:13 ctl02 nova-api[31314]: 2017-09-28 12:25:13.521 31314 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:25:13 ctl02 nova-api[31314]: 2017-09-28 12:25:13.521 31314 ERROR nova     sock.listen(backlog)
Sep 28 12:25:13 ctl02 nova-api[31314]: 2017-09-28 12:25:13.521 31314 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:25:13 ctl02 nova-api[31314]: 2017-09-28 12:25:13.521 31314 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:25:13 ctl02 nova-api[31314]: 2017-09-28 12:25:13.521 31314 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:25:13 ctl02 nova-api[31314]: 2017-09-28 12:25:13.521 31314 ERROR nova
Sep 28 12:25:13 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:25:13 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:25:13 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:25:13 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:25:13 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:25:13 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:25:13 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:25:14 ctl02 glance-api[29183]: 2017-09-28 12:25:14.399 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:25:14] "OPTIONS / HTTP/1.0" 200 134 0.001171
Sep 28 12:25:15 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:25:15.326 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:25:15] "OPTIONS / HTTP/1.0" 200 134 0.000476
Sep 28 12:25:15 ctl02 heat-api[13008]: 2017-09-28 12:25:15.361 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:25:15] "OPTIONS / HTTP/1.0" 200 134 0.000614
Sep 28 12:25:15 ctl02 nova-api[31337]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:25:15 ctl02 nova-api[31337]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:25:15 ctl02 dhclient[600]: DHCPREQUEST of 192.168.11.25 on ens2 to 192.168.11.3 port 67 (xid=0x3415f07)
Sep 28 12:25:15 ctl02 dhclient[600]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 12:25:15 ctl02 nova-api[31337]: 2017-09-28 12:25:15.801 31337 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:25:15 ctl02 nova-api[31337]: 2017-09-28 12:25:15.802 31337 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:25:15 ctl02 nova-api[31337]: 2017-09-28 12:25:15.802 31337 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:25:15 ctl02 nova-api[31337]: 2017-09-28 12:25:15.802 31337 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:25:15 ctl02 nova-api[31337]: 2017-09-28 12:25:15.802 31337 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:25:15 ctl02 nova-api[31337]: 2017-09-28 12:25:15.802 31337 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:25:15 ctl02 nova-api[31337]: 2017-09-28 12:25:15.802 31337 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:25:15 ctl02 nova-api[31337]: 2017-09-28 12:25:15.802 31337 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:25:15 ctl02 nova-api[31337]: 2017-09-28 12:25:15.802 31337 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:25:15 ctl02 nova-api[31337]: 2017-09-28 12:25:15.802 31337 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:25:15 ctl02 nova-api[31337]: 2017-09-28 12:25:15.802 31337 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:25:15 ctl02 nova-api[31337]: 2017-09-28 12:25:15.802 31337 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:25:15 ctl02 nova-api[31337]: 2017-09-28 12:25:15.802 31337 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:25:15 ctl02 nova-api[31337]: 2017-09-28 12:25:15.802 31337 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:25:15 ctl02 nova-api[31337]: 2017-09-28 12:25:15.802 31337 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:25:15 ctl02 nova-api[31337]: 2017-09-28 12:25:15.802 31337 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:25:15 ctl02 nova-api[31337]: 2017-09-28 12:25:15.802 31337 ERROR nova.wsgi     self.filename))
Sep 28 12:25:15 ctl02 nova-api[31337]: 2017-09-28 12:25:15.802 31337 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:25:15 ctl02 nova-api[31337]: 2017-09-28 12:25:15.802 31337 ERROR nova.wsgi
Sep 28 12:25:15 ctl02 nova-api[31337]: 2017-09-28 12:25:15.803 31337 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:25:15 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 12:25:15 ctl02 ntp[31403]:  * Stopping NTP server ntpd
Sep 28 12:25:15 ctl02 ntp[31403]:    ...done.
Sep 28 12:25:15 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 12:25:15 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 12:25:15 ctl02 ntp[31414]:  * Starting NTP server ntpd
Sep 28 12:25:15 ctl02 ntpd[31421]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 12:25:15 ctl02 ntpd[31421]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -c /var/lib/ntp/ntp.conf.dhcp -u 108:112
Sep 28 12:25:15 ctl02 ntp[31414]:    ...done.
Sep 28 12:25:15 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 12:25:15 ctl02 ntpd[31424]: proto: precision = 0.043 usec (-24)
Sep 28 12:25:15 ctl02 ntpd[31424]: switching logging to file /var/log/ntp.log
Sep 28 12:25:15 ctl02 heat-api[13008]: 2017-09-28 12:25:15.869 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:25:15] "OPTIONS / HTTP/1.0" 200 134 0.000606
Sep 28 12:25:15 ctl02 dhclient[600]: bound to 192.168.11.25 -- renewal in 256 seconds.
Sep 28 12:25:15 ctl02 nova-api[31337]: 2017-09-28 12:25:15.934 31337 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:25:16 ctl02 nova-api[31337]: 2017-09-28 12:25:16.179 31337 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:25:16 ctl02 nova-api[31337]: 2017-09-28 12:25:16.182 31337 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:25:16 ctl02 nova-api[31337]: 2017-09-28 12:25:16.182 31337 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:25:16 ctl02 nova-api[31337]: 2017-09-28 12:25:16.182 31337 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:25:16 ctl02 nova-api[31337]: 2017-09-28 12:25:16.314 31337 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:25:16 ctl02 nova-api[31337]: 2017-09-28 12:25:16.316 31337 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:25:16 ctl02 nova-api[31337]: 2017-09-28 12:25:16.316 31337 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:25:16 ctl02 nova-api[31337]: 2017-09-28 12:25:16.316 31337 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:25:16 ctl02 nova-api[31337]: 2017-09-28 12:25:16.320 31337 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:25:16 ctl02 nova-api[31337]: 2017-09-28 12:25:16.320 31337 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:25:16 ctl02 nova-api[31337]: 2017-09-28 12:25:16.320 31337 ERROR nova Traceback (most recent call last):
Sep 28 12:25:16 ctl02 nova-api[31337]: 2017-09-28 12:25:16.320 31337 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:25:16 ctl02 nova-api[31337]: 2017-09-28 12:25:16.320 31337 ERROR nova     sys.exit(main())
Sep 28 12:25:16 ctl02 nova-api[31337]: 2017-09-28 12:25:16.320 31337 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:25:16 ctl02 nova-api[31337]: 2017-09-28 12:25:16.320 31337 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:25:16 ctl02 nova-api[31337]: 2017-09-28 12:25:16.320 31337 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:25:16 ctl02 nova-api[31337]: 2017-09-28 12:25:16.320 31337 ERROR nova     max_url_len=max_url_len)
Sep 28 12:25:16 ctl02 nova-api[31337]: 2017-09-28 12:25:16.320 31337 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:25:16 ctl02 nova-api[31337]: 2017-09-28 12:25:16.320 31337 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:25:16 ctl02 nova-api[31337]: 2017-09-28 12:25:16.320 31337 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:25:16 ctl02 nova-api[31337]: 2017-09-28 12:25:16.320 31337 ERROR nova     sock.listen(backlog)
Sep 28 12:25:16 ctl02 nova-api[31337]: 2017-09-28 12:25:16.320 31337 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:25:16 ctl02 nova-api[31337]: 2017-09-28 12:25:16.320 31337 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:25:16 ctl02 nova-api[31337]: 2017-09-28 12:25:16.320 31337 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:25:16 ctl02 nova-api[31337]: 2017-09-28 12:25:16.320 31337 ERROR nova
Sep 28 12:25:16 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:25:16 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:25:16 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:25:16 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:25:16 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:25:16 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:25:16 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:25:17 ctl02 heat-api-cfn[13300]: 2017-09-28 12:25:17.836 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:25:17] "OPTIONS / HTTP/1.0" 200 134 0.000449
Sep 28 12:25:18 ctl02 nova-api[31437]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:25:18 ctl02 nova-api[31437]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:25:18 ctl02 heat-api[13008]: 2017-09-28 12:25:18.384 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:25:18] "OPTIONS / HTTP/1.0" 200 134 0.000633
Sep 28 12:25:18 ctl02 nova-api[31437]: 2017-09-28 12:25:18.471 31437 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:25:18 ctl02 nova-api[31437]: 2017-09-28 12:25:18.472 31437 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:25:18 ctl02 nova-api[31437]: 2017-09-28 12:25:18.472 31437 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:25:18 ctl02 nova-api[31437]: 2017-09-28 12:25:18.472 31437 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:25:18 ctl02 nova-api[31437]: 2017-09-28 12:25:18.472 31437 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:25:18 ctl02 nova-api[31437]: 2017-09-28 12:25:18.472 31437 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:25:18 ctl02 nova-api[31437]: 2017-09-28 12:25:18.472 31437 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:25:18 ctl02 nova-api[31437]: 2017-09-28 12:25:18.472 31437 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:25:18 ctl02 nova-api[31437]: 2017-09-28 12:25:18.472 31437 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:25:18 ctl02 nova-api[31437]: 2017-09-28 12:25:18.472 31437 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:25:18 ctl02 nova-api[31437]: 2017-09-28 12:25:18.472 31437 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:25:18 ctl02 nova-api[31437]: 2017-09-28 12:25:18.472 31437 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:25:18 ctl02 nova-api[31437]: 2017-09-28 12:25:18.472 31437 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:25:18 ctl02 nova-api[31437]: 2017-09-28 12:25:18.472 31437 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:25:18 ctl02 nova-api[31437]: 2017-09-28 12:25:18.472 31437 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:25:18 ctl02 nova-api[31437]: 2017-09-28 12:25:18.472 31437 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:25:18 ctl02 nova-api[31437]: 2017-09-28 12:25:18.472 31437 ERROR nova.wsgi     self.filename))
Sep 28 12:25:18 ctl02 nova-api[31437]: 2017-09-28 12:25:18.472 31437 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:25:18 ctl02 nova-api[31437]: 2017-09-28 12:25:18.472 31437 ERROR nova.wsgi
Sep 28 12:25:18 ctl02 nova-api[31437]: 2017-09-28 12:25:18.473 31437 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:25:18 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:25:18.558 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:25:18] "OPTIONS / HTTP/1.0" 200 134 0.000391
Sep 28 12:25:18 ctl02 nova-api[31437]: 2017-09-28 12:25:18.603 31437 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:25:18 ctl02 nova-api[31437]: 2017-09-28 12:25:18.827 31437 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:25:18 ctl02 nova-api[31437]: 2017-09-28 12:25:18.829 31437 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:25:18 ctl02 nova-api[31437]: 2017-09-28 12:25:18.829 31437 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:25:18 ctl02 nova-api[31437]: 2017-09-28 12:25:18.830 31437 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:25:18 ctl02 nova-api[31437]: 2017-09-28 12:25:18.960 31437 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:25:18 ctl02 nova-api[31437]: 2017-09-28 12:25:18.962 31437 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:25:18 ctl02 nova-api[31437]: 2017-09-28 12:25:18.962 31437 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:25:18 ctl02 nova-api[31437]: 2017-09-28 12:25:18.962 31437 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:25:18 ctl02 nova-api[31437]: 2017-09-28 12:25:18.965 31437 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:25:18 ctl02 nova-api[31437]: 2017-09-28 12:25:18.966 31437 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:25:18 ctl02 nova-api[31437]: 2017-09-28 12:25:18.966 31437 ERROR nova Traceback (most recent call last):
Sep 28 12:25:18 ctl02 nova-api[31437]: 2017-09-28 12:25:18.966 31437 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:25:18 ctl02 nova-api[31437]: 2017-09-28 12:25:18.966 31437 ERROR nova     sys.exit(main())
Sep 28 12:25:18 ctl02 nova-api[31437]: 2017-09-28 12:25:18.966 31437 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:25:18 ctl02 nova-api[31437]: 2017-09-28 12:25:18.966 31437 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:25:18 ctl02 nova-api[31437]: 2017-09-28 12:25:18.966 31437 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:25:18 ctl02 nova-api[31437]: 2017-09-28 12:25:18.966 31437 ERROR nova     max_url_len=max_url_len)
Sep 28 12:25:18 ctl02 nova-api[31437]: 2017-09-28 12:25:18.966 31437 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:25:18 ctl02 nova-api[31437]: 2017-09-28 12:25:18.966 31437 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:25:18 ctl02 nova-api[31437]: 2017-09-28 12:25:18.966 31437 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:25:18 ctl02 nova-api[31437]: 2017-09-28 12:25:18.966 31437 ERROR nova     sock.listen(backlog)
Sep 28 12:25:18 ctl02 nova-api[31437]: 2017-09-28 12:25:18.966 31437 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:25:18 ctl02 nova-api[31437]: 2017-09-28 12:25:18.966 31437 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:25:18 ctl02 nova-api[31437]: 2017-09-28 12:25:18.966 31437 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:25:18 ctl02 nova-api[31437]: 2017-09-28 12:25:18.966 31437 ERROR nova
Sep 28 12:25:19 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:25:19 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:25:19 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:25:19 ctl02 nova-consoleauth[5433]: 2017-09-28 12:25:19.292 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:25:19 ctl02 heat-api-cfn[13300]: 2017-09-28 12:25:19.354 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:25:19] "OPTIONS / HTTP/1.0" 200 134 0.000621
Sep 28 12:25:19 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:25:19 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:25:19 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:25:19 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:25:19 ctl02 heat-api-cfn[13300]: 2017-09-28 12:25:19.991 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:25:19] "OPTIONS / HTTP/1.0" 200 134 0.000585
Sep 28 12:25:20 ctl02 glance-api[29183]: 2017-09-28 12:25:20.404 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:25:20] "OPTIONS / HTTP/1.0" 200 134 0.000621
Sep 28 12:25:20 ctl02 neutron-server[30536]: 2017-09-28 12:25:20.843 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:25:20] "OPTIONS / HTTP/1.0" 200 262 0.000489
Sep 28 12:25:21 ctl02 nova-api[31455]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:25:21 ctl02 nova-api[31455]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:25:21 ctl02 neutron-server[30536]: 2017-09-28 12:25:21.088 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:25:21] "OPTIONS / HTTP/1.0" 200 262 0.000547
Sep 28 12:25:21 ctl02 nova-api[31455]: 2017-09-28 12:25:21.223 31455 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:25:21 ctl02 nova-api[31455]: 2017-09-28 12:25:21.224 31455 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:25:21 ctl02 nova-api[31455]: 2017-09-28 12:25:21.224 31455 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:25:21 ctl02 nova-api[31455]: 2017-09-28 12:25:21.224 31455 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:25:21 ctl02 nova-api[31455]: 2017-09-28 12:25:21.224 31455 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:25:21 ctl02 nova-api[31455]: 2017-09-28 12:25:21.224 31455 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:25:21 ctl02 nova-api[31455]: 2017-09-28 12:25:21.224 31455 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:25:21 ctl02 nova-api[31455]: 2017-09-28 12:25:21.224 31455 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:25:21 ctl02 nova-api[31455]: 2017-09-28 12:25:21.224 31455 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:25:21 ctl02 nova-api[31455]: 2017-09-28 12:25:21.224 31455 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:25:21 ctl02 nova-api[31455]: 2017-09-28 12:25:21.224 31455 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:25:21 ctl02 nova-api[31455]: 2017-09-28 12:25:21.224 31455 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:25:21 ctl02 nova-api[31455]: 2017-09-28 12:25:21.224 31455 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:25:21 ctl02 nova-api[31455]: 2017-09-28 12:25:21.224 31455 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:25:21 ctl02 nova-api[31455]: 2017-09-28 12:25:21.224 31455 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:25:21 ctl02 nova-api[31455]: 2017-09-28 12:25:21.224 31455 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:25:21 ctl02 nova-api[31455]: 2017-09-28 12:25:21.224 31455 ERROR nova.wsgi     self.filename))
Sep 28 12:25:21 ctl02 nova-api[31455]: 2017-09-28 12:25:21.224 31455 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:25:21 ctl02 nova-api[31455]: 2017-09-28 12:25:21.224 31455 ERROR nova.wsgi
Sep 28 12:25:21 ctl02 nova-api[31455]: 2017-09-28 12:25:21.225 31455 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:25:21 ctl02 neutron-server[30536]: 2017-09-28 12:25:21.273 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:25:21] "OPTIONS / HTTP/1.0" 200 262 0.000500
Sep 28 12:25:21 ctl02 nova-api[31455]: 2017-09-28 12:25:21.354 31455 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:25:21 ctl02 neutron-server[30536]: 2017-09-28 12:25:21.480 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 2 dead agents out of 2:
Sep 28 12:25:21 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:25:21 ctl02 neutron-server[30536]:       Metadata agent  2017-09-28 12:23:58 cmp001
Sep 28 12:25:21 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:23:57 cmp001
Sep 28 12:25:21 ctl02 nova-api[31455]: 2017-09-28 12:25:21.586 31455 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:25:21 ctl02 nova-api[31455]: 2017-09-28 12:25:21.588 31455 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:25:21 ctl02 nova-api[31455]: 2017-09-28 12:25:21.589 31455 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:25:21 ctl02 nova-api[31455]: 2017-09-28 12:25:21.589 31455 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:25:21 ctl02 nova-api[31455]: 2017-09-28 12:25:21.719 31455 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:25:21 ctl02 nova-api[31455]: 2017-09-28 12:25:21.721 31455 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:25:21 ctl02 nova-api[31455]: 2017-09-28 12:25:21.721 31455 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:25:21 ctl02 nova-api[31455]: 2017-09-28 12:25:21.721 31455 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:25:21 ctl02 nova-api[31455]: 2017-09-28 12:25:21.725 31455 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:25:21 ctl02 nova-api[31455]: 2017-09-28 12:25:21.725 31455 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:25:21 ctl02 nova-api[31455]: 2017-09-28 12:25:21.725 31455 ERROR nova Traceback (most recent call last):
Sep 28 12:25:21 ctl02 nova-api[31455]: 2017-09-28 12:25:21.725 31455 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:25:21 ctl02 nova-api[31455]: 2017-09-28 12:25:21.725 31455 ERROR nova     sys.exit(main())
Sep 28 12:25:21 ctl02 nova-api[31455]: 2017-09-28 12:25:21.725 31455 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:25:21 ctl02 nova-api[31455]: 2017-09-28 12:25:21.725 31455 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:25:21 ctl02 nova-api[31455]: 2017-09-28 12:25:21.725 31455 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:25:21 ctl02 nova-api[31455]: 2017-09-28 12:25:21.725 31455 ERROR nova     max_url_len=max_url_len)
Sep 28 12:25:21 ctl02 nova-api[31455]: 2017-09-28 12:25:21.725 31455 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:25:21 ctl02 nova-api[31455]: 2017-09-28 12:25:21.725 31455 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:25:21 ctl02 nova-api[31455]: 2017-09-28 12:25:21.725 31455 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:25:21 ctl02 nova-api[31455]: 2017-09-28 12:25:21.725 31455 ERROR nova     sock.listen(backlog)
Sep 28 12:25:21 ctl02 nova-api[31455]: 2017-09-28 12:25:21.725 31455 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:25:21 ctl02 nova-api[31455]: 2017-09-28 12:25:21.725 31455 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:25:21 ctl02 nova-api[31455]: 2017-09-28 12:25:21.725 31455 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:25:21 ctl02 nova-api[31455]: 2017-09-28 12:25:21.725 31455 ERROR nova
Sep 28 12:25:21 ctl02 heat-engine[12803]: 2017-09-28 12:25:21.772 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:25:21 ctl02 heat-engine[12803]: 2017-09-28 12:25:21.775 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:25:21 ctl02 heat-engine[12803]: 2017-09-28 12:25:21.777 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:25:21 ctl02 heat-engine[12803]: 2017-09-28 12:25:21.784 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:25:21 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:25:21 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:25:21 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:25:22 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:25:22 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:25:22 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:25:22 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:25:22 ctl02 nova-scheduler[5620]: 2017-09-28 12:25:22.312 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:25:22 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:25:22.883 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:25:22] "OPTIONS / HTTP/1.0" 200 134 0.000530
Sep 28 12:25:22 ctl02 glance-api[29183]: 2017-09-28 12:25:22.906 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:25:22] "OPTIONS / HTTP/1.0" 200 134 0.000584
Sep 28 12:25:23 ctl02 nova-api[31473]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:25:23 ctl02 nova-api[31473]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:25:23 ctl02 nova-api[31473]: 2017-09-28 12:25:23.971 31473 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:25:23 ctl02 nova-api[31473]: 2017-09-28 12:25:23.973 31473 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:25:23 ctl02 nova-api[31473]: 2017-09-28 12:25:23.973 31473 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:25:23 ctl02 nova-api[31473]: 2017-09-28 12:25:23.973 31473 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:25:23 ctl02 nova-api[31473]: 2017-09-28 12:25:23.973 31473 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:25:23 ctl02 nova-api[31473]: 2017-09-28 12:25:23.973 31473 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:25:23 ctl02 nova-api[31473]: 2017-09-28 12:25:23.973 31473 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:25:23 ctl02 nova-api[31473]: 2017-09-28 12:25:23.973 31473 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:25:23 ctl02 nova-api[31473]: 2017-09-28 12:25:23.973 31473 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:25:23 ctl02 nova-api[31473]: 2017-09-28 12:25:23.973 31473 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:25:23 ctl02 nova-api[31473]: 2017-09-28 12:25:23.973 31473 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:25:23 ctl02 nova-api[31473]: 2017-09-28 12:25:23.973 31473 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:25:23 ctl02 nova-api[31473]: 2017-09-28 12:25:23.973 31473 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:25:23 ctl02 nova-api[31473]: 2017-09-28 12:25:23.973 31473 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:25:23 ctl02 nova-api[31473]: 2017-09-28 12:25:23.973 31473 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:25:23 ctl02 nova-api[31473]: 2017-09-28 12:25:23.973 31473 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:25:23 ctl02 nova-api[31473]: 2017-09-28 12:25:23.973 31473 ERROR nova.wsgi     self.filename))
Sep 28 12:25:23 ctl02 nova-api[31473]: 2017-09-28 12:25:23.973 31473 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:25:23 ctl02 nova-api[31473]: 2017-09-28 12:25:23.973 31473 ERROR nova.wsgi
Sep 28 12:25:23 ctl02 nova-api[31473]: 2017-09-28 12:25:23.974 31473 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:25:24 ctl02 nova-api[31473]: 2017-09-28 12:25:24.099 31473 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:25:24 ctl02 glance-api[29183]: 2017-09-28 12:25:24.219 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:25:24] "OPTIONS / HTTP/1.0" 200 134 0.000610
Sep 28 12:25:24 ctl02 nova-api[31473]: 2017-09-28 12:25:24.327 31473 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:25:24 ctl02 nova-api[31473]: 2017-09-28 12:25:24.329 31473 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:25:24 ctl02 nova-api[31473]: 2017-09-28 12:25:24.330 31473 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:25:24 ctl02 nova-api[31473]: 2017-09-28 12:25:24.330 31473 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:25:24 ctl02 nova-api[31473]: 2017-09-28 12:25:24.462 31473 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:25:24 ctl02 nova-api[31473]: 2017-09-28 12:25:24.465 31473 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:25:24 ctl02 nova-api[31473]: 2017-09-28 12:25:24.465 31473 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:25:24 ctl02 nova-api[31473]: 2017-09-28 12:25:24.466 31473 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:25:24 ctl02 nova-api[31473]: 2017-09-28 12:25:24.469 31473 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:25:24 ctl02 nova-api[31473]: 2017-09-28 12:25:24.469 31473 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:25:24 ctl02 nova-api[31473]: 2017-09-28 12:25:24.469 31473 ERROR nova Traceback (most recent call last):
Sep 28 12:25:24 ctl02 nova-api[31473]: 2017-09-28 12:25:24.469 31473 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:25:24 ctl02 nova-api[31473]: 2017-09-28 12:25:24.469 31473 ERROR nova     sys.exit(main())
Sep 28 12:25:24 ctl02 nova-api[31473]: 2017-09-28 12:25:24.469 31473 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:25:24 ctl02 nova-api[31473]: 2017-09-28 12:25:24.469 31473 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:25:24 ctl02 nova-api[31473]: 2017-09-28 12:25:24.469 31473 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:25:24 ctl02 nova-api[31473]: 2017-09-28 12:25:24.469 31473 ERROR nova     max_url_len=max_url_len)
Sep 28 12:25:24 ctl02 nova-api[31473]: 2017-09-28 12:25:24.469 31473 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:25:24 ctl02 nova-api[31473]: 2017-09-28 12:25:24.469 31473 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:25:24 ctl02 nova-api[31473]: 2017-09-28 12:25:24.469 31473 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:25:24 ctl02 nova-api[31473]: 2017-09-28 12:25:24.469 31473 ERROR nova     sock.listen(backlog)
Sep 28 12:25:24 ctl02 nova-api[31473]: 2017-09-28 12:25:24.469 31473 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:25:24 ctl02 nova-api[31473]: 2017-09-28 12:25:24.469 31473 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:25:24 ctl02 nova-api[31473]: 2017-09-28 12:25:24.469 31473 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:25:24 ctl02 nova-api[31473]: 2017-09-28 12:25:24.469 31473 ERROR nova
Sep 28 12:25:24 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:25:24 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:25:24 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:25:24 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:25:24 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:25:24 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:25:24 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:25:25 ctl02 heat-api[13008]: 2017-09-28 12:25:25.201 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:25:25] "OPTIONS / HTTP/1.0" 200 134 0.000628
Sep 28 12:25:25 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:25:25.451 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:25:25] "OPTIONS / HTTP/1.0" 200 134 0.000459
Sep 28 12:25:26 ctl02 heat-api[13008]: 2017-09-28 12:25:26.211 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:25:26] "OPTIONS / HTTP/1.0" 200 134 0.000627
Sep 28 12:25:26 ctl02 nova-api[31491]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:25:26 ctl02 nova-api[31491]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:25:26 ctl02 nova-api[31491]: 2017-09-28 12:25:26.774 31491 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:25:26 ctl02 nova-api[31491]: 2017-09-28 12:25:26.776 31491 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:25:26 ctl02 nova-api[31491]: 2017-09-28 12:25:26.776 31491 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:25:26 ctl02 nova-api[31491]: 2017-09-28 12:25:26.776 31491 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:25:26 ctl02 nova-api[31491]: 2017-09-28 12:25:26.776 31491 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:25:26 ctl02 nova-api[31491]: 2017-09-28 12:25:26.776 31491 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:25:26 ctl02 nova-api[31491]: 2017-09-28 12:25:26.776 31491 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:25:26 ctl02 nova-api[31491]: 2017-09-28 12:25:26.776 31491 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:25:26 ctl02 nova-api[31491]: 2017-09-28 12:25:26.776 31491 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:25:26 ctl02 nova-api[31491]: 2017-09-28 12:25:26.776 31491 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:25:26 ctl02 nova-api[31491]: 2017-09-28 12:25:26.776 31491 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:25:26 ctl02 nova-api[31491]: 2017-09-28 12:25:26.776 31491 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:25:26 ctl02 nova-api[31491]: 2017-09-28 12:25:26.776 31491 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:25:26 ctl02 nova-api[31491]: 2017-09-28 12:25:26.776 31491 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:25:26 ctl02 nova-api[31491]: 2017-09-28 12:25:26.776 31491 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:25:26 ctl02 nova-api[31491]: 2017-09-28 12:25:26.776 31491 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:25:26 ctl02 nova-api[31491]: 2017-09-28 12:25:26.776 31491 ERROR nova.wsgi     self.filename))
Sep 28 12:25:26 ctl02 nova-api[31491]: 2017-09-28 12:25:26.776 31491 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:25:26 ctl02 nova-api[31491]: 2017-09-28 12:25:26.776 31491 ERROR nova.wsgi
Sep 28 12:25:26 ctl02 nova-api[31491]: 2017-09-28 12:25:26.778 31491 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:25:26 ctl02 nova-api[31491]: 2017-09-28 12:25:26.910 31491 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:25:27 ctl02 nova-api[31491]: 2017-09-28 12:25:27.142 31491 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:25:27 ctl02 nova-api[31491]: 2017-09-28 12:25:27.145 31491 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:25:27 ctl02 nova-api[31491]: 2017-09-28 12:25:27.145 31491 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:25:27 ctl02 nova-api[31491]: 2017-09-28 12:25:27.146 31491 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:25:27 ctl02 nova-api[31491]: 2017-09-28 12:25:27.276 31491 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:25:27 ctl02 nova-api[31491]: 2017-09-28 12:25:27.279 31491 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:25:27 ctl02 nova-api[31491]: 2017-09-28 12:25:27.279 31491 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:25:27 ctl02 nova-api[31491]: 2017-09-28 12:25:27.280 31491 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:25:27 ctl02 nova-api[31491]: 2017-09-28 12:25:27.283 31491 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:25:27 ctl02 nova-api[31491]: 2017-09-28 12:25:27.284 31491 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:25:27 ctl02 nova-api[31491]: 2017-09-28 12:25:27.284 31491 ERROR nova Traceback (most recent call last):
Sep 28 12:25:27 ctl02 nova-api[31491]: 2017-09-28 12:25:27.284 31491 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:25:27 ctl02 nova-api[31491]: 2017-09-28 12:25:27.284 31491 ERROR nova     sys.exit(main())
Sep 28 12:25:27 ctl02 nova-api[31491]: 2017-09-28 12:25:27.284 31491 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:25:27 ctl02 nova-api[31491]: 2017-09-28 12:25:27.284 31491 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:25:27 ctl02 nova-api[31491]: 2017-09-28 12:25:27.284 31491 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:25:27 ctl02 nova-api[31491]: 2017-09-28 12:25:27.284 31491 ERROR nova     max_url_len=max_url_len)
Sep 28 12:25:27 ctl02 nova-api[31491]: 2017-09-28 12:25:27.284 31491 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:25:27 ctl02 nova-api[31491]: 2017-09-28 12:25:27.284 31491 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:25:27 ctl02 nova-api[31491]: 2017-09-28 12:25:27.284 31491 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:25:27 ctl02 nova-api[31491]: 2017-09-28 12:25:27.284 31491 ERROR nova     sock.listen(backlog)
Sep 28 12:25:27 ctl02 nova-api[31491]: 2017-09-28 12:25:27.284 31491 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:25:27 ctl02 nova-api[31491]: 2017-09-28 12:25:27.284 31491 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:25:27 ctl02 nova-api[31491]: 2017-09-28 12:25:27.284 31491 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:25:27 ctl02 nova-api[31491]: 2017-09-28 12:25:27.284 31491 ERROR nova
Sep 28 12:25:27 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:25:27 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:25:27 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:25:27 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:25:27 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:25:27 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:25:27 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:25:27 ctl02 heat-api-cfn[13300]: 2017-09-28 12:25:27.695 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:25:27] "OPTIONS / HTTP/1.0" 200 134 0.000585
Sep 28 12:25:28 ctl02 neutron-server[30536]: 2017-09-28 12:25:28.465 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:25:28 ctl02 heat-api[13008]: 2017-09-28 12:25:28.758 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:25:28] "OPTIONS / HTTP/1.0" 200 134 0.000695
Sep 28 12:25:28 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:25:28.774 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:25:28] "OPTIONS / HTTP/1.0" 200 134 0.000529
Sep 28 12:25:29 ctl02 nova-api[31509]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:25:29 ctl02 nova-api[31509]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:25:29 ctl02 heat-api-cfn[13300]: 2017-09-28 12:25:29.407 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:25:29] "OPTIONS / HTTP/1.0" 200 134 0.000463
Sep 28 12:25:29 ctl02 nova-api[31509]: 2017-09-28 12:25:29.496 31509 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:25:29 ctl02 nova-api[31509]: 2017-09-28 12:25:29.498 31509 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:25:29 ctl02 nova-api[31509]: 2017-09-28 12:25:29.498 31509 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:25:29 ctl02 nova-api[31509]: 2017-09-28 12:25:29.498 31509 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:25:29 ctl02 nova-api[31509]: 2017-09-28 12:25:29.498 31509 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:25:29 ctl02 nova-api[31509]: 2017-09-28 12:25:29.498 31509 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:25:29 ctl02 nova-api[31509]: 2017-09-28 12:25:29.498 31509 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:25:29 ctl02 nova-api[31509]: 2017-09-28 12:25:29.498 31509 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:25:29 ctl02 nova-api[31509]: 2017-09-28 12:25:29.498 31509 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:25:29 ctl02 nova-api[31509]: 2017-09-28 12:25:29.498 31509 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:25:29 ctl02 nova-api[31509]: 2017-09-28 12:25:29.498 31509 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:25:29 ctl02 nova-api[31509]: 2017-09-28 12:25:29.498 31509 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:25:29 ctl02 nova-api[31509]: 2017-09-28 12:25:29.498 31509 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:25:29 ctl02 nova-api[31509]: 2017-09-28 12:25:29.498 31509 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:25:29 ctl02 nova-api[31509]: 2017-09-28 12:25:29.498 31509 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:25:29 ctl02 nova-api[31509]: 2017-09-28 12:25:29.498 31509 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:25:29 ctl02 nova-api[31509]: 2017-09-28 12:25:29.498 31509 ERROR nova.wsgi     self.filename))
Sep 28 12:25:29 ctl02 nova-api[31509]: 2017-09-28 12:25:29.498 31509 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:25:29 ctl02 nova-api[31509]: 2017-09-28 12:25:29.498 31509 ERROR nova.wsgi
Sep 28 12:25:29 ctl02 nova-api[31509]: 2017-09-28 12:25:29.500 31509 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:25:29 ctl02 nova-api[31509]: 2017-09-28 12:25:29.635 31509 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:25:29 ctl02 nova-api[31509]: 2017-09-28 12:25:29.883 31509 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:25:29 ctl02 nova-api[31509]: 2017-09-28 12:25:29.885 31509 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:25:29 ctl02 nova-api[31509]: 2017-09-28 12:25:29.885 31509 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:25:29 ctl02 nova-api[31509]: 2017-09-28 12:25:29.885 31509 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:25:30 ctl02 glance-api[29183]: 2017-09-28 12:25:30.011 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:25:30] "OPTIONS / HTTP/1.0" 200 134 0.001038
Sep 28 12:25:30 ctl02 nova-api[31509]: 2017-09-28 12:25:30.018 31509 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:25:30 ctl02 nova-api[31509]: 2017-09-28 12:25:30.020 31509 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:25:30 ctl02 nova-api[31509]: 2017-09-28 12:25:30.020 31509 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:25:30 ctl02 nova-api[31509]: 2017-09-28 12:25:30.020 31509 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:25:30 ctl02 nova-api[31509]: 2017-09-28 12:25:30.024 31509 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:25:30 ctl02 nova-api[31509]: 2017-09-28 12:25:30.024 31509 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:25:30 ctl02 nova-api[31509]: 2017-09-28 12:25:30.024 31509 ERROR nova Traceback (most recent call last):
Sep 28 12:25:30 ctl02 nova-api[31509]: 2017-09-28 12:25:30.024 31509 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:25:30 ctl02 nova-api[31509]: 2017-09-28 12:25:30.024 31509 ERROR nova     sys.exit(main())
Sep 28 12:25:30 ctl02 nova-api[31509]: 2017-09-28 12:25:30.024 31509 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:25:30 ctl02 nova-api[31509]: 2017-09-28 12:25:30.024 31509 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:25:30 ctl02 nova-api[31509]: 2017-09-28 12:25:30.024 31509 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:25:30 ctl02 nova-api[31509]: 2017-09-28 12:25:30.024 31509 ERROR nova     max_url_len=max_url_len)
Sep 28 12:25:30 ctl02 nova-api[31509]: 2017-09-28 12:25:30.024 31509 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:25:30 ctl02 nova-api[31509]: 2017-09-28 12:25:30.024 31509 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:25:30 ctl02 nova-api[31509]: 2017-09-28 12:25:30.024 31509 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:25:30 ctl02 nova-api[31509]: 2017-09-28 12:25:30.024 31509 ERROR nova     sock.listen(backlog)
Sep 28 12:25:30 ctl02 nova-api[31509]: 2017-09-28 12:25:30.024 31509 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:25:30 ctl02 nova-api[31509]: 2017-09-28 12:25:30.024 31509 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:25:30 ctl02 nova-api[31509]: 2017-09-28 12:25:30.024 31509 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:25:30 ctl02 nova-api[31509]: 2017-09-28 12:25:30.024 31509 ERROR nova
Sep 28 12:25:30 ctl02 heat-api-cfn[13300]: 2017-09-28 12:25:30.131 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:25:30] "OPTIONS / HTTP/1.0" 200 134 0.000558
Sep 28 12:25:30 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:25:30 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:25:30 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:25:30 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:25:30 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:25:30 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:25:30 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:25:30 ctl02 neutron-server[30536]: 2017-09-28 12:25:30.750 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:25:30] "OPTIONS / HTTP/1.0" 200 262 0.000608
Sep 28 12:25:30 ctl02 neutron-server[30536]: 2017-09-28 12:25:30.759 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:25:30] "OPTIONS / HTTP/1.0" 200 262 0.000688
Sep 28 12:25:30 ctl02 neutron-server[30536]: 2017-09-28 12:25:30.943 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:25:30] "OPTIONS / HTTP/1.0" 200 262 0.000610
Sep 28 12:25:32 ctl02 nova-api[31527]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:25:32 ctl02 nova-api[31527]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:25:32 ctl02 nova-api[31527]: 2017-09-28 12:25:32.278 31527 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:25:32 ctl02 nova-api[31527]: 2017-09-28 12:25:32.279 31527 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:25:32 ctl02 nova-api[31527]: 2017-09-28 12:25:32.279 31527 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:25:32 ctl02 nova-api[31527]: 2017-09-28 12:25:32.279 31527 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:25:32 ctl02 nova-api[31527]: 2017-09-28 12:25:32.279 31527 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:25:32 ctl02 nova-api[31527]: 2017-09-28 12:25:32.279 31527 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:25:32 ctl02 nova-api[31527]: 2017-09-28 12:25:32.279 31527 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:25:32 ctl02 nova-api[31527]: 2017-09-28 12:25:32.279 31527 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:25:32 ctl02 nova-api[31527]: 2017-09-28 12:25:32.279 31527 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:25:32 ctl02 nova-api[31527]: 2017-09-28 12:25:32.279 31527 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:25:32 ctl02 nova-api[31527]: 2017-09-28 12:25:32.279 31527 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:25:32 ctl02 nova-api[31527]: 2017-09-28 12:25:32.279 31527 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:25:32 ctl02 nova-api[31527]: 2017-09-28 12:25:32.279 31527 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:25:32 ctl02 nova-api[31527]: 2017-09-28 12:25:32.279 31527 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:25:32 ctl02 nova-api[31527]: 2017-09-28 12:25:32.279 31527 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:25:32 ctl02 nova-api[31527]: 2017-09-28 12:25:32.279 31527 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:25:32 ctl02 nova-api[31527]: 2017-09-28 12:25:32.279 31527 ERROR nova.wsgi     self.filename))
Sep 28 12:25:32 ctl02 nova-api[31527]: 2017-09-28 12:25:32.279 31527 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:25:32 ctl02 nova-api[31527]: 2017-09-28 12:25:32.279 31527 ERROR nova.wsgi
Sep 28 12:25:32 ctl02 nova-api[31527]: 2017-09-28 12:25:32.282 31527 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:25:32 ctl02 nova-api[31527]: 2017-09-28 12:25:32.415 31527 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:25:32 ctl02 nova-api[31527]: 2017-09-28 12:25:32.664 31527 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:25:32 ctl02 nova-api[31527]: 2017-09-28 12:25:32.666 31527 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:25:32 ctl02 nova-api[31527]: 2017-09-28 12:25:32.666 31527 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:25:32 ctl02 nova-api[31527]: 2017-09-28 12:25:32.667 31527 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:25:32 ctl02 nova-api[31527]: 2017-09-28 12:25:32.799 31527 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:25:32 ctl02 nova-api[31527]: 2017-09-28 12:25:32.801 31527 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:25:32 ctl02 nova-api[31527]: 2017-09-28 12:25:32.801 31527 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:25:32 ctl02 nova-api[31527]: 2017-09-28 12:25:32.802 31527 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:25:32 ctl02 nova-api[31527]: 2017-09-28 12:25:32.805 31527 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:25:32 ctl02 nova-api[31527]: 2017-09-28 12:25:32.805 31527 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:25:32 ctl02 nova-api[31527]: 2017-09-28 12:25:32.805 31527 ERROR nova Traceback (most recent call last):
Sep 28 12:25:32 ctl02 nova-api[31527]: 2017-09-28 12:25:32.805 31527 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:25:32 ctl02 nova-api[31527]: 2017-09-28 12:25:32.805 31527 ERROR nova     sys.exit(main())
Sep 28 12:25:32 ctl02 nova-api[31527]: 2017-09-28 12:25:32.805 31527 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:25:32 ctl02 nova-api[31527]: 2017-09-28 12:25:32.805 31527 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:25:32 ctl02 nova-api[31527]: 2017-09-28 12:25:32.805 31527 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:25:32 ctl02 nova-api[31527]: 2017-09-28 12:25:32.805 31527 ERROR nova     max_url_len=max_url_len)
Sep 28 12:25:32 ctl02 nova-api[31527]: 2017-09-28 12:25:32.805 31527 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:25:32 ctl02 nova-api[31527]: 2017-09-28 12:25:32.805 31527 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:25:32 ctl02 nova-api[31527]: 2017-09-28 12:25:32.805 31527 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:25:32 ctl02 nova-api[31527]: 2017-09-28 12:25:32.805 31527 ERROR nova     sock.listen(backlog)
Sep 28 12:25:32 ctl02 nova-api[31527]: 2017-09-28 12:25:32.805 31527 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:25:32 ctl02 nova-api[31527]: 2017-09-28 12:25:32.805 31527 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:25:32 ctl02 nova-api[31527]: 2017-09-28 12:25:32.805 31527 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:25:32 ctl02 nova-api[31527]: 2017-09-28 12:25:32.805 31527 ERROR nova
Sep 28 12:25:32 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9889695f)
Sep 28 12:25:32 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:25:32.895 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:25:32] "OPTIONS / HTTP/1.0" 200 134 0.000530
Sep 28 12:25:32 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:25:32 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:25:32 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:25:33 ctl02 glance-api[29183]: 2017-09-28 12:25:33.113 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:25:33] "OPTIONS / HTTP/1.0" 200 134 0.001017
Sep 28 12:25:33 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:25:33 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:25:33 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:25:33 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:25:33 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9889695f)
Sep 28 12:25:34 ctl02 glance-api[29183]: 2017-09-28 12:25:34.542 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:25:34] "OPTIONS / HTTP/1.0" 200 134 0.000579
Sep 28 12:25:34 ctl02 nova-api[31544]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:25:34 ctl02 nova-api[31544]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:25:34 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9889695f)
Sep 28 12:25:35 ctl02 nova-api[31544]: 2017-09-28 12:25:35.002 31544 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:25:35 ctl02 nova-api[31544]: 2017-09-28 12:25:35.004 31544 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:25:35 ctl02 nova-api[31544]: 2017-09-28 12:25:35.004 31544 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:25:35 ctl02 nova-api[31544]: 2017-09-28 12:25:35.004 31544 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:25:35 ctl02 nova-api[31544]: 2017-09-28 12:25:35.004 31544 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:25:35 ctl02 nova-api[31544]: 2017-09-28 12:25:35.004 31544 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:25:35 ctl02 nova-api[31544]: 2017-09-28 12:25:35.004 31544 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:25:35 ctl02 nova-api[31544]: 2017-09-28 12:25:35.004 31544 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:25:35 ctl02 nova-api[31544]: 2017-09-28 12:25:35.004 31544 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:25:35 ctl02 nova-api[31544]: 2017-09-28 12:25:35.004 31544 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:25:35 ctl02 nova-api[31544]: 2017-09-28 12:25:35.004 31544 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:25:35 ctl02 nova-api[31544]: 2017-09-28 12:25:35.004 31544 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:25:35 ctl02 nova-api[31544]: 2017-09-28 12:25:35.004 31544 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:25:35 ctl02 nova-api[31544]: 2017-09-28 12:25:35.004 31544 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:25:35 ctl02 nova-api[31544]: 2017-09-28 12:25:35.004 31544 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:25:35 ctl02 nova-api[31544]: 2017-09-28 12:25:35.004 31544 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:25:35 ctl02 nova-api[31544]: 2017-09-28 12:25:35.004 31544 ERROR nova.wsgi     self.filename))
Sep 28 12:25:35 ctl02 nova-api[31544]: 2017-09-28 12:25:35.004 31544 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:25:35 ctl02 nova-api[31544]: 2017-09-28 12:25:35.004 31544 ERROR nova.wsgi
Sep 28 12:25:35 ctl02 nova-api[31544]: 2017-09-28 12:25:35.005 31544 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:25:35 ctl02 nova-api[31544]: 2017-09-28 12:25:35.138 31544 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:25:35 ctl02 heat-api[13008]: 2017-09-28 12:25:35.328 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:25:35] "OPTIONS / HTTP/1.0" 200 134 0.000641
Sep 28 12:25:35 ctl02 nova-api[31544]: 2017-09-28 12:25:35.389 31544 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:25:35 ctl02 nova-api[31544]: 2017-09-28 12:25:35.391 31544 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:25:35 ctl02 nova-api[31544]: 2017-09-28 12:25:35.391 31544 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:25:35 ctl02 nova-api[31544]: 2017-09-28 12:25:35.392 31544 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:25:35 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:25:35.439 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:25:35] "OPTIONS / HTTP/1.0" 200 134 0.000502
Sep 28 12:25:35 ctl02 nova-api[31544]: 2017-09-28 12:25:35.529 31544 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:25:35 ctl02 nova-api[31544]: 2017-09-28 12:25:35.531 31544 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:25:35 ctl02 nova-api[31544]: 2017-09-28 12:25:35.531 31544 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:25:35 ctl02 nova-api[31544]: 2017-09-28 12:25:35.531 31544 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:25:35 ctl02 nova-api[31544]: 2017-09-28 12:25:35.535 31544 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:25:35 ctl02 nova-api[31544]: 2017-09-28 12:25:35.535 31544 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:25:35 ctl02 nova-api[31544]: 2017-09-28 12:25:35.535 31544 ERROR nova Traceback (most recent call last):
Sep 28 12:25:35 ctl02 nova-api[31544]: 2017-09-28 12:25:35.535 31544 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:25:35 ctl02 nova-api[31544]: 2017-09-28 12:25:35.535 31544 ERROR nova     sys.exit(main())
Sep 28 12:25:35 ctl02 nova-api[31544]: 2017-09-28 12:25:35.535 31544 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:25:35 ctl02 nova-api[31544]: 2017-09-28 12:25:35.535 31544 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:25:35 ctl02 nova-api[31544]: 2017-09-28 12:25:35.535 31544 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:25:35 ctl02 nova-api[31544]: 2017-09-28 12:25:35.535 31544 ERROR nova     max_url_len=max_url_len)
Sep 28 12:25:35 ctl02 nova-api[31544]: 2017-09-28 12:25:35.535 31544 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:25:35 ctl02 nova-api[31544]: 2017-09-28 12:25:35.535 31544 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:25:35 ctl02 nova-api[31544]: 2017-09-28 12:25:35.535 31544 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:25:35 ctl02 nova-api[31544]: 2017-09-28 12:25:35.535 31544 ERROR nova     sock.listen(backlog)
Sep 28 12:25:35 ctl02 nova-api[31544]: 2017-09-28 12:25:35.535 31544 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:25:35 ctl02 nova-api[31544]: 2017-09-28 12:25:35.535 31544 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:25:35 ctl02 nova-api[31544]: 2017-09-28 12:25:35.535 31544 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:25:35 ctl02 nova-api[31544]: 2017-09-28 12:25:35.535 31544 ERROR nova
Sep 28 12:25:35 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:25:35 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:25:35 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:25:35 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9889695f)
Sep 28 12:25:35 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:25:35 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:25:35 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:25:35 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:25:36 ctl02 heat-api[13008]: 2017-09-28 12:25:36.457 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:25:36] "OPTIONS / HTTP/1.0" 200 134 0.000569
Sep 28 12:25:36 ctl02 neutron-server[30536]: 2017-09-28 12:25:36.477 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 2 dead agents out of 2:
Sep 28 12:25:36 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:25:36 ctl02 neutron-server[30536]:       Metadata agent  2017-09-28 12:23:58 cmp001
Sep 28 12:25:36 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:23:57 cmp001
Sep 28 12:25:36 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9889695f)
Sep 28 12:25:37 ctl02 heat-api-cfn[13300]: 2017-09-28 12:25:37.341 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:25:37] "OPTIONS / HTTP/1.0" 200 134 0.000590
Sep 28 12:25:37 ctl02 nova-api[31563]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:25:37 ctl02 nova-api[31563]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:25:37 ctl02 nova-api[31563]: 2017-09-28 12:25:37.734 31563 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:25:37 ctl02 nova-api[31563]: 2017-09-28 12:25:37.735 31563 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:25:37 ctl02 nova-api[31563]: 2017-09-28 12:25:37.735 31563 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:25:37 ctl02 nova-api[31563]: 2017-09-28 12:25:37.735 31563 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:25:37 ctl02 nova-api[31563]: 2017-09-28 12:25:37.735 31563 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:25:37 ctl02 nova-api[31563]: 2017-09-28 12:25:37.735 31563 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:25:37 ctl02 nova-api[31563]: 2017-09-28 12:25:37.735 31563 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:25:37 ctl02 nova-api[31563]: 2017-09-28 12:25:37.735 31563 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:25:37 ctl02 nova-api[31563]: 2017-09-28 12:25:37.735 31563 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:25:37 ctl02 nova-api[31563]: 2017-09-28 12:25:37.735 31563 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:25:37 ctl02 nova-api[31563]: 2017-09-28 12:25:37.735 31563 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:25:37 ctl02 nova-api[31563]: 2017-09-28 12:25:37.735 31563 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:25:37 ctl02 nova-api[31563]: 2017-09-28 12:25:37.735 31563 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:25:37 ctl02 nova-api[31563]: 2017-09-28 12:25:37.735 31563 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:25:37 ctl02 nova-api[31563]: 2017-09-28 12:25:37.735 31563 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:25:37 ctl02 nova-api[31563]: 2017-09-28 12:25:37.735 31563 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:25:37 ctl02 nova-api[31563]: 2017-09-28 12:25:37.735 31563 ERROR nova.wsgi     self.filename))
Sep 28 12:25:37 ctl02 nova-api[31563]: 2017-09-28 12:25:37.735 31563 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:25:37 ctl02 nova-api[31563]: 2017-09-28 12:25:37.735 31563 ERROR nova.wsgi
Sep 28 12:25:37 ctl02 nova-api[31563]: 2017-09-28 12:25:37.738 31563 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:25:37 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9889695f)
Sep 28 12:25:37 ctl02 nova-api[31563]: 2017-09-28 12:25:37.868 31563 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:25:38 ctl02 nova-api[31563]: 2017-09-28 12:25:38.098 31563 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:25:38 ctl02 nova-api[31563]: 2017-09-28 12:25:38.101 31563 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:25:38 ctl02 nova-api[31563]: 2017-09-28 12:25:38.102 31563 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:25:38 ctl02 nova-api[31563]: 2017-09-28 12:25:38.102 31563 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:25:38 ctl02 nova-api[31563]: 2017-09-28 12:25:38.232 31563 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:25:38 ctl02 nova-api[31563]: 2017-09-28 12:25:38.235 31563 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:25:38 ctl02 nova-api[31563]: 2017-09-28 12:25:38.235 31563 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:25:38 ctl02 nova-api[31563]: 2017-09-28 12:25:38.235 31563 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:25:38 ctl02 nova-api[31563]: 2017-09-28 12:25:38.239 31563 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:25:38 ctl02 nova-api[31563]: 2017-09-28 12:25:38.239 31563 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:25:38 ctl02 nova-api[31563]: 2017-09-28 12:25:38.239 31563 ERROR nova Traceback (most recent call last):
Sep 28 12:25:38 ctl02 nova-api[31563]: 2017-09-28 12:25:38.239 31563 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:25:38 ctl02 nova-api[31563]: 2017-09-28 12:25:38.239 31563 ERROR nova     sys.exit(main())
Sep 28 12:25:38 ctl02 nova-api[31563]: 2017-09-28 12:25:38.239 31563 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:25:38 ctl02 nova-api[31563]: 2017-09-28 12:25:38.239 31563 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:25:38 ctl02 nova-api[31563]: 2017-09-28 12:25:38.239 31563 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:25:38 ctl02 nova-api[31563]: 2017-09-28 12:25:38.239 31563 ERROR nova     max_url_len=max_url_len)
Sep 28 12:25:38 ctl02 nova-api[31563]: 2017-09-28 12:25:38.239 31563 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:25:38 ctl02 nova-api[31563]: 2017-09-28 12:25:38.239 31563 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:25:38 ctl02 nova-api[31563]: 2017-09-28 12:25:38.239 31563 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:25:38 ctl02 nova-api[31563]: 2017-09-28 12:25:38.239 31563 ERROR nova     sock.listen(backlog)
Sep 28 12:25:38 ctl02 nova-api[31563]: 2017-09-28 12:25:38.239 31563 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:25:38 ctl02 nova-api[31563]: 2017-09-28 12:25:38.239 31563 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:25:38 ctl02 nova-api[31563]: 2017-09-28 12:25:38.239 31563 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:25:38 ctl02 nova-api[31563]: 2017-09-28 12:25:38.239 31563 ERROR nova
Sep 28 12:25:38 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:25:38 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:25:38 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:25:38 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:25:38 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:25:38 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:25:38 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:25:38 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9889695f)
Sep 28 12:25:38 ctl02 heat-api[13008]: 2017-09-28 12:25:38.898 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:25:38] "OPTIONS / HTTP/1.0" 200 134 0.000527
Sep 28 12:25:39 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:25:39.152 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:25:39] "OPTIONS / HTTP/1.0" 200 134 0.000383
Sep 28 12:25:39 ctl02 heat-api-cfn[13300]: 2017-09-28 12:25:39.246 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:25:39] "OPTIONS / HTTP/1.0" 200 134 0.000460
Sep 28 12:25:39 ctl02 glance-api[29183]: 2017-09-28 12:25:39.752 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:25:39] "OPTIONS / HTTP/1.0" 200 134 0.000617
Sep 28 12:25:39 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9889695f)
Sep 28 12:25:40 ctl02 heat-api-cfn[13300]: 2017-09-28 12:25:40.081 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:25:40] "OPTIONS / HTTP/1.0" 200 134 0.000436
Sep 28 12:25:40 ctl02 nova-api[31581]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:25:40 ctl02 nova-api[31581]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:25:40 ctl02 nova-api[31581]: 2017-09-28 12:25:40.501 31581 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:25:40 ctl02 nova-api[31581]: 2017-09-28 12:25:40.502 31581 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:25:40 ctl02 nova-api[31581]: 2017-09-28 12:25:40.502 31581 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:25:40 ctl02 nova-api[31581]: 2017-09-28 12:25:40.502 31581 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:25:40 ctl02 nova-api[31581]: 2017-09-28 12:25:40.502 31581 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:25:40 ctl02 nova-api[31581]: 2017-09-28 12:25:40.502 31581 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:25:40 ctl02 nova-api[31581]: 2017-09-28 12:25:40.502 31581 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:25:40 ctl02 nova-api[31581]: 2017-09-28 12:25:40.502 31581 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:25:40 ctl02 nova-api[31581]: 2017-09-28 12:25:40.502 31581 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:25:40 ctl02 nova-api[31581]: 2017-09-28 12:25:40.502 31581 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:25:40 ctl02 nova-api[31581]: 2017-09-28 12:25:40.502 31581 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:25:40 ctl02 nova-api[31581]: 2017-09-28 12:25:40.502 31581 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:25:40 ctl02 nova-api[31581]: 2017-09-28 12:25:40.502 31581 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:25:40 ctl02 nova-api[31581]: 2017-09-28 12:25:40.502 31581 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:25:40 ctl02 nova-api[31581]: 2017-09-28 12:25:40.502 31581 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:25:40 ctl02 nova-api[31581]: 2017-09-28 12:25:40.502 31581 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:25:40 ctl02 nova-api[31581]: 2017-09-28 12:25:40.502 31581 ERROR nova.wsgi     self.filename))
Sep 28 12:25:40 ctl02 nova-api[31581]: 2017-09-28 12:25:40.502 31581 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:25:40 ctl02 nova-api[31581]: 2017-09-28 12:25:40.502 31581 ERROR nova.wsgi
Sep 28 12:25:40 ctl02 nova-api[31581]: 2017-09-28 12:25:40.505 31581 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:25:40 ctl02 nova-api[31581]: 2017-09-28 12:25:40.635 31581 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:25:40 ctl02 neutron-server[30536]: 2017-09-28 12:25:40.830 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:25:40] "OPTIONS / HTTP/1.0" 200 262 0.000488
Sep 28 12:25:40 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9889695f)
Sep 28 12:25:40 ctl02 nova-api[31581]: 2017-09-28 12:25:40.862 31581 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:25:40 ctl02 nova-api[31581]: 2017-09-28 12:25:40.865 31581 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:25:40 ctl02 nova-api[31581]: 2017-09-28 12:25:40.865 31581 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:25:40 ctl02 nova-api[31581]: 2017-09-28 12:25:40.866 31581 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:25:40 ctl02 neutron-server[30536]: 2017-09-28 12:25:40.920 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:25:40] "OPTIONS / HTTP/1.0" 200 262 0.000463
Sep 28 12:25:40 ctl02 nova-api[31581]: 2017-09-28 12:25:40.996 31581 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:25:40 ctl02 nova-api[31581]: 2017-09-28 12:25:40.999 31581 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:25:40 ctl02 nova-api[31581]: 2017-09-28 12:25:40.999 31581 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:25:41 ctl02 nova-api[31581]: 2017-09-28 12:25:41.000 31581 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:25:41 ctl02 nova-api[31581]: 2017-09-28 12:25:41.003 31581 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:25:41 ctl02 nova-api[31581]: 2017-09-28 12:25:41.004 31581 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:25:41 ctl02 nova-api[31581]: 2017-09-28 12:25:41.004 31581 ERROR nova Traceback (most recent call last):
Sep 28 12:25:41 ctl02 nova-api[31581]: 2017-09-28 12:25:41.004 31581 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:25:41 ctl02 nova-api[31581]: 2017-09-28 12:25:41.004 31581 ERROR nova     sys.exit(main())
Sep 28 12:25:41 ctl02 nova-api[31581]: 2017-09-28 12:25:41.004 31581 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:25:41 ctl02 nova-api[31581]: 2017-09-28 12:25:41.004 31581 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:25:41 ctl02 nova-api[31581]: 2017-09-28 12:25:41.004 31581 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:25:41 ctl02 nova-api[31581]: 2017-09-28 12:25:41.004 31581 ERROR nova     max_url_len=max_url_len)
Sep 28 12:25:41 ctl02 nova-api[31581]: 2017-09-28 12:25:41.004 31581 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:25:41 ctl02 nova-api[31581]: 2017-09-28 12:25:41.004 31581 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:25:41 ctl02 nova-api[31581]: 2017-09-28 12:25:41.004 31581 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:25:41 ctl02 nova-api[31581]: 2017-09-28 12:25:41.004 31581 ERROR nova     sock.listen(backlog)
Sep 28 12:25:41 ctl02 nova-api[31581]: 2017-09-28 12:25:41.004 31581 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:25:41 ctl02 nova-api[31581]: 2017-09-28 12:25:41.004 31581 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:25:41 ctl02 nova-api[31581]: 2017-09-28 12:25:41.004 31581 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:25:41 ctl02 nova-api[31581]: 2017-09-28 12:25:41.004 31581 ERROR nova
Sep 28 12:25:41 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:25:41 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:25:41 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:25:41 ctl02 neutron-server[30536]: 2017-09-28 12:25:41.298 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:25:41] "OPTIONS / HTTP/1.0" 200 262 0.000592
Sep 28 12:25:41 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:25:41 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:25:41 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:25:41 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:25:41 ctl02 nova-cert[4860]: 2017-09-28 12:25:41.436 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:25:41 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9889695f)
Sep 28 12:25:42 ctl02 nova-conductor[5056]: 2017-09-28 12:25:42.657 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:25:42 ctl02 nova-conductor[5056]: 2017-09-28 12:25:42.674 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:25:42 ctl02 nova-conductor[5056]: 2017-09-28 12:25:42.694 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:25:42 ctl02 nova-conductor[5056]: 2017-09-28 12:25:42.705 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:25:42 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9889695f)
Sep 28 12:25:42 ctl02 glance-api[29183]: 2017-09-28 12:25:42.892 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:25:42] "OPTIONS / HTTP/1.0" 200 134 0.000562
Sep 28 12:25:42 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:25:42.981 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:25:42] "OPTIONS / HTTP/1.0" 200 134 0.000387
Sep 28 12:25:43 ctl02 nova-api[31599]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:25:43 ctl02 nova-api[31599]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:25:43 ctl02 nova-api[31599]: 2017-09-28 12:25:43.256 31599 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:25:43 ctl02 nova-api[31599]: 2017-09-28 12:25:43.258 31599 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:25:43 ctl02 nova-api[31599]: 2017-09-28 12:25:43.258 31599 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:25:43 ctl02 nova-api[31599]: 2017-09-28 12:25:43.258 31599 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:25:43 ctl02 nova-api[31599]: 2017-09-28 12:25:43.258 31599 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:25:43 ctl02 nova-api[31599]: 2017-09-28 12:25:43.258 31599 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:25:43 ctl02 nova-api[31599]: 2017-09-28 12:25:43.258 31599 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:25:43 ctl02 nova-api[31599]: 2017-09-28 12:25:43.258 31599 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:25:43 ctl02 nova-api[31599]: 2017-09-28 12:25:43.258 31599 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:25:43 ctl02 nova-api[31599]: 2017-09-28 12:25:43.258 31599 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:25:43 ctl02 nova-api[31599]: 2017-09-28 12:25:43.258 31599 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:25:43 ctl02 nova-api[31599]: 2017-09-28 12:25:43.258 31599 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:25:43 ctl02 nova-api[31599]: 2017-09-28 12:25:43.258 31599 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:25:43 ctl02 nova-api[31599]: 2017-09-28 12:25:43.258 31599 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:25:43 ctl02 nova-api[31599]: 2017-09-28 12:25:43.258 31599 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:25:43 ctl02 nova-api[31599]: 2017-09-28 12:25:43.258 31599 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:25:43 ctl02 nova-api[31599]: 2017-09-28 12:25:43.258 31599 ERROR nova.wsgi     self.filename))
Sep 28 12:25:43 ctl02 nova-api[31599]: 2017-09-28 12:25:43.258 31599 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:25:43 ctl02 nova-api[31599]: 2017-09-28 12:25:43.258 31599 ERROR nova.wsgi
Sep 28 12:25:43 ctl02 nova-api[31599]: 2017-09-28 12:25:43.259 31599 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:25:43 ctl02 nova-api[31599]: 2017-09-28 12:25:43.389 31599 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:25:43 ctl02 neutron-server[30536]: 2017-09-28 12:25:43.469 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:25:43 ctl02 nova-api[31599]: 2017-09-28 12:25:43.614 31599 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:25:43 ctl02 nova-api[31599]: 2017-09-28 12:25:43.616 31599 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:25:43 ctl02 nova-api[31599]: 2017-09-28 12:25:43.616 31599 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:25:43 ctl02 nova-api[31599]: 2017-09-28 12:25:43.617 31599 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:25:43 ctl02 nova-api[31599]: 2017-09-28 12:25:43.745 31599 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:25:43 ctl02 nova-api[31599]: 2017-09-28 12:25:43.747 31599 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:25:43 ctl02 nova-api[31599]: 2017-09-28 12:25:43.747 31599 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:25:43 ctl02 nova-api[31599]: 2017-09-28 12:25:43.747 31599 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:25:43 ctl02 nova-api[31599]: 2017-09-28 12:25:43.750 31599 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:25:43 ctl02 nova-api[31599]: 2017-09-28 12:25:43.751 31599 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:25:43 ctl02 nova-api[31599]: 2017-09-28 12:25:43.751 31599 ERROR nova Traceback (most recent call last):
Sep 28 12:25:43 ctl02 nova-api[31599]: 2017-09-28 12:25:43.751 31599 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:25:43 ctl02 nova-api[31599]: 2017-09-28 12:25:43.751 31599 ERROR nova     sys.exit(main())
Sep 28 12:25:43 ctl02 nova-api[31599]: 2017-09-28 12:25:43.751 31599 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:25:43 ctl02 nova-api[31599]: 2017-09-28 12:25:43.751 31599 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:25:43 ctl02 nova-api[31599]: 2017-09-28 12:25:43.751 31599 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:25:43 ctl02 nova-api[31599]: 2017-09-28 12:25:43.751 31599 ERROR nova     max_url_len=max_url_len)
Sep 28 12:25:43 ctl02 nova-api[31599]: 2017-09-28 12:25:43.751 31599 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:25:43 ctl02 nova-api[31599]: 2017-09-28 12:25:43.751 31599 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:25:43 ctl02 nova-api[31599]: 2017-09-28 12:25:43.751 31599 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:25:43 ctl02 nova-api[31599]: 2017-09-28 12:25:43.751 31599 ERROR nova     sock.listen(backlog)
Sep 28 12:25:43 ctl02 nova-api[31599]: 2017-09-28 12:25:43.751 31599 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:25:43 ctl02 nova-api[31599]: 2017-09-28 12:25:43.751 31599 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:25:43 ctl02 nova-api[31599]: 2017-09-28 12:25:43.751 31599 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:25:43 ctl02 nova-api[31599]: 2017-09-28 12:25:43.751 31599 ERROR nova
Sep 28 12:25:43 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:25:43 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:25:43 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:25:43 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:25:43 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:25:43 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 12:25:43 ctl02 ntp[31657]:  * Stopping NTP server ntpd
Sep 28 12:25:43 ctl02 ntp[31657]:    ...done.
Sep 28 12:25:43 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 12:25:43 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 12:25:43 ctl02 ntp[31668]:  * Starting NTP server ntpd
Sep 28 12:25:43 ctl02 ntpd[31675]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 12:25:43 ctl02 ntpd[31675]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 12:25:43 ctl02 ntp[31668]:    ...done.
Sep 28 12:25:43 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 12:25:43 ctl02 ntpd[31678]: proto: precision = 0.042 usec (-24)
Sep 28 12:25:43 ctl02 ntpd[31678]: switching logging to file /var/log/ntp.log
Sep 28 12:25:44 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:25:44 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:25:44 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:25:44 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:25:44 ctl02 glance-api[29183]: 2017-09-28 12:25:44.196 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:25:44] "OPTIONS / HTTP/1.0" 200 134 0.000758
Sep 28 12:25:45 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:25:45.171 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:25:45] "OPTIONS / HTTP/1.0" 200 134 0.000455
Sep 28 12:25:45 ctl02 heat-api[13008]: 2017-09-28 12:25:45.498 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:25:45] "OPTIONS / HTTP/1.0" 200 134 0.000559
Sep 28 12:25:45 ctl02 nova-api[31688]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:25:45 ctl02 nova-api[31688]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:25:46 ctl02 nova-api[31688]: 2017-09-28 12:25:46.026 31688 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:25:46 ctl02 nova-api[31688]: 2017-09-28 12:25:46.028 31688 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:25:46 ctl02 nova-api[31688]: 2017-09-28 12:25:46.028 31688 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:25:46 ctl02 nova-api[31688]: 2017-09-28 12:25:46.028 31688 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:25:46 ctl02 nova-api[31688]: 2017-09-28 12:25:46.028 31688 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:25:46 ctl02 nova-api[31688]: 2017-09-28 12:25:46.028 31688 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:25:46 ctl02 nova-api[31688]: 2017-09-28 12:25:46.028 31688 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:25:46 ctl02 nova-api[31688]: 2017-09-28 12:25:46.028 31688 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:25:46 ctl02 nova-api[31688]: 2017-09-28 12:25:46.028 31688 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:25:46 ctl02 nova-api[31688]: 2017-09-28 12:25:46.028 31688 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:25:46 ctl02 nova-api[31688]: 2017-09-28 12:25:46.028 31688 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:25:46 ctl02 nova-api[31688]: 2017-09-28 12:25:46.028 31688 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:25:46 ctl02 nova-api[31688]: 2017-09-28 12:25:46.028 31688 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:25:46 ctl02 nova-api[31688]: 2017-09-28 12:25:46.028 31688 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:25:46 ctl02 nova-api[31688]: 2017-09-28 12:25:46.028 31688 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:25:46 ctl02 nova-api[31688]: 2017-09-28 12:25:46.028 31688 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:25:46 ctl02 nova-api[31688]: 2017-09-28 12:25:46.028 31688 ERROR nova.wsgi     self.filename))
Sep 28 12:25:46 ctl02 nova-api[31688]: 2017-09-28 12:25:46.028 31688 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:25:46 ctl02 nova-api[31688]: 2017-09-28 12:25:46.028 31688 ERROR nova.wsgi
Sep 28 12:25:46 ctl02 nova-api[31688]: 2017-09-28 12:25:46.031 31688 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:25:46 ctl02 nova-api[31688]: 2017-09-28 12:25:46.175 31688 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:25:46 ctl02 nova-api[31688]: 2017-09-28 12:25:46.406 31688 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:25:46 ctl02 nova-api[31688]: 2017-09-28 12:25:46.409 31688 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:25:46 ctl02 nova-api[31688]: 2017-09-28 12:25:46.409 31688 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:25:46 ctl02 nova-api[31688]: 2017-09-28 12:25:46.410 31688 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:25:46 ctl02 nova-api[31688]: 2017-09-28 12:25:46.540 31688 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:25:46 ctl02 nova-api[31688]: 2017-09-28 12:25:46.542 31688 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:25:46 ctl02 nova-api[31688]: 2017-09-28 12:25:46.543 31688 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:25:46 ctl02 nova-api[31688]: 2017-09-28 12:25:46.543 31688 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:25:46 ctl02 nova-api[31688]: 2017-09-28 12:25:46.547 31688 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:25:46 ctl02 nova-api[31688]: 2017-09-28 12:25:46.547 31688 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:25:46 ctl02 nova-api[31688]: 2017-09-28 12:25:46.547 31688 ERROR nova Traceback (most recent call last):
Sep 28 12:25:46 ctl02 nova-api[31688]: 2017-09-28 12:25:46.547 31688 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:25:46 ctl02 nova-api[31688]: 2017-09-28 12:25:46.547 31688 ERROR nova     sys.exit(main())
Sep 28 12:25:46 ctl02 nova-api[31688]: 2017-09-28 12:25:46.547 31688 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:25:46 ctl02 nova-api[31688]: 2017-09-28 12:25:46.547 31688 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:25:46 ctl02 nova-api[31688]: 2017-09-28 12:25:46.547 31688 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:25:46 ctl02 nova-api[31688]: 2017-09-28 12:25:46.547 31688 ERROR nova     max_url_len=max_url_len)
Sep 28 12:25:46 ctl02 nova-api[31688]: 2017-09-28 12:25:46.547 31688 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:25:46 ctl02 nova-api[31688]: 2017-09-28 12:25:46.547 31688 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:25:46 ctl02 nova-api[31688]: 2017-09-28 12:25:46.547 31688 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:25:46 ctl02 nova-api[31688]: 2017-09-28 12:25:46.547 31688 ERROR nova     sock.listen(backlog)
Sep 28 12:25:46 ctl02 nova-api[31688]: 2017-09-28 12:25:46.547 31688 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:25:46 ctl02 nova-api[31688]: 2017-09-28 12:25:46.547 31688 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:25:46 ctl02 nova-api[31688]: 2017-09-28 12:25:46.547 31688 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:25:46 ctl02 nova-api[31688]: 2017-09-28 12:25:46.547 31688 ERROR nova
Sep 28 12:25:46 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:25:46 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:25:46 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:25:46 ctl02 heat-api[13008]: 2017-09-28 12:25:46.766 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:25:46] "OPTIONS / HTTP/1.0" 200 134 0.000615
Sep 28 12:25:46 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:25:46 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:25:46 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:25:46 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:25:47 ctl02 heat-api-cfn[13300]: 2017-09-28 12:25:47.444 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:25:47] "OPTIONS / HTTP/1.0" 200 134 0.000512
Sep 28 12:25:48 ctl02 nova-api[31706]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:25:48 ctl02 nova-api[31706]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:25:48 ctl02 nova-api[31706]: 2017-09-28 12:25:48.792 31706 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:25:48 ctl02 nova-api[31706]: 2017-09-28 12:25:48.793 31706 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:25:48 ctl02 nova-api[31706]: 2017-09-28 12:25:48.793 31706 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:25:48 ctl02 nova-api[31706]: 2017-09-28 12:25:48.793 31706 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:25:48 ctl02 nova-api[31706]: 2017-09-28 12:25:48.793 31706 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:25:48 ctl02 nova-api[31706]: 2017-09-28 12:25:48.793 31706 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:25:48 ctl02 nova-api[31706]: 2017-09-28 12:25:48.793 31706 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:25:48 ctl02 nova-api[31706]: 2017-09-28 12:25:48.793 31706 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:25:48 ctl02 nova-api[31706]: 2017-09-28 12:25:48.793 31706 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:25:48 ctl02 nova-api[31706]: 2017-09-28 12:25:48.793 31706 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:25:48 ctl02 nova-api[31706]: 2017-09-28 12:25:48.793 31706 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:25:48 ctl02 nova-api[31706]: 2017-09-28 12:25:48.793 31706 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:25:48 ctl02 nova-api[31706]: 2017-09-28 12:25:48.793 31706 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:25:48 ctl02 nova-api[31706]: 2017-09-28 12:25:48.793 31706 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:25:48 ctl02 nova-api[31706]: 2017-09-28 12:25:48.793 31706 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:25:48 ctl02 nova-api[31706]: 2017-09-28 12:25:48.793 31706 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:25:48 ctl02 nova-api[31706]: 2017-09-28 12:25:48.793 31706 ERROR nova.wsgi     self.filename))
Sep 28 12:25:48 ctl02 nova-api[31706]: 2017-09-28 12:25:48.793 31706 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:25:48 ctl02 nova-api[31706]: 2017-09-28 12:25:48.793 31706 ERROR nova.wsgi
Sep 28 12:25:48 ctl02 nova-api[31706]: 2017-09-28 12:25:48.794 31706 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:25:48 ctl02 nova-api[31706]: 2017-09-28 12:25:48.926 31706 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:25:48 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:25:48.938 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:25:48] "OPTIONS / HTTP/1.0" 200 134 0.000463
Sep 28 12:25:49 ctl02 nova-api[31706]: 2017-09-28 12:25:49.179 31706 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:25:49 ctl02 nova-api[31706]: 2017-09-28 12:25:49.183 31706 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:25:49 ctl02 nova-api[31706]: 2017-09-28 12:25:49.183 31706 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:25:49 ctl02 nova-api[31706]: 2017-09-28 12:25:49.183 31706 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:25:49 ctl02 heat-api[13008]: 2017-09-28 12:25:49.301 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:25:49] "OPTIONS / HTTP/1.0" 200 134 0.000473
Sep 28 12:25:49 ctl02 nova-api[31706]: 2017-09-28 12:25:49.318 31706 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:25:49 ctl02 nova-api[31706]: 2017-09-28 12:25:49.321 31706 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:25:49 ctl02 nova-api[31706]: 2017-09-28 12:25:49.321 31706 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:25:49 ctl02 nova-api[31706]: 2017-09-28 12:25:49.321 31706 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:25:49 ctl02 nova-api[31706]: 2017-09-28 12:25:49.325 31706 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:25:49 ctl02 nova-api[31706]: 2017-09-28 12:25:49.326 31706 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:25:49 ctl02 nova-api[31706]: 2017-09-28 12:25:49.326 31706 ERROR nova Traceback (most recent call last):
Sep 28 12:25:49 ctl02 nova-api[31706]: 2017-09-28 12:25:49.326 31706 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:25:49 ctl02 nova-api[31706]: 2017-09-28 12:25:49.326 31706 ERROR nova     sys.exit(main())
Sep 28 12:25:49 ctl02 nova-api[31706]: 2017-09-28 12:25:49.326 31706 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:25:49 ctl02 nova-api[31706]: 2017-09-28 12:25:49.326 31706 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:25:49 ctl02 nova-api[31706]: 2017-09-28 12:25:49.326 31706 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:25:49 ctl02 nova-api[31706]: 2017-09-28 12:25:49.326 31706 ERROR nova     max_url_len=max_url_len)
Sep 28 12:25:49 ctl02 nova-api[31706]: 2017-09-28 12:25:49.326 31706 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:25:49 ctl02 nova-api[31706]: 2017-09-28 12:25:49.326 31706 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:25:49 ctl02 nova-api[31706]: 2017-09-28 12:25:49.326 31706 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:25:49 ctl02 nova-api[31706]: 2017-09-28 12:25:49.326 31706 ERROR nova     sock.listen(backlog)
Sep 28 12:25:49 ctl02 nova-api[31706]: 2017-09-28 12:25:49.326 31706 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:25:49 ctl02 nova-api[31706]: 2017-09-28 12:25:49.326 31706 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:25:49 ctl02 nova-api[31706]: 2017-09-28 12:25:49.326 31706 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:25:49 ctl02 nova-api[31706]: 2017-09-28 12:25:49.326 31706 ERROR nova
Sep 28 12:25:49 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:25:49 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:25:49 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:25:49 ctl02 glance-api[29183]: 2017-09-28 12:25:49.601 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:25:49] "OPTIONS / HTTP/1.0" 200 134 0.000822
Sep 28 12:25:49 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:25:49 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:25:49 ctl02 heat-api-cfn[13300]: 2017-09-28 12:25:49.633 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:25:49] "OPTIONS / HTTP/1.0" 200 134 0.000572
Sep 28 12:25:49 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:25:49 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:25:49 ctl02 heat-api-cfn[13300]: 2017-09-28 12:25:49.777 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:25:49] "OPTIONS / HTTP/1.0" 200 134 0.000451
Sep 28 12:25:51 ctl02 neutron-server[30536]: 2017-09-28 12:25:51.112 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:25:51] "OPTIONS / HTTP/1.0" 200 262 0.000498
Sep 28 12:25:51 ctl02 neutron-server[30536]: 2017-09-28 12:25:51.205 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:25:51] "OPTIONS / HTTP/1.0" 200 262 0.000438
Sep 28 12:25:51 ctl02 nova-consoleauth[5433]: 2017-09-28 12:25:51.330 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:25:51 ctl02 nova-api[31724]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:25:51 ctl02 nova-api[31724]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:25:51 ctl02 neutron-server[30536]: 2017-09-28 12:25:51.472 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 2 dead agents out of 2:
Sep 28 12:25:51 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:25:51 ctl02 neutron-server[30536]:       Metadata agent  2017-09-28 12:23:58 cmp001
Sep 28 12:25:51 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:23:57 cmp001
Sep 28 12:25:51 ctl02 neutron-server[30536]: 2017-09-28 12:25:51.474 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:25:51] "OPTIONS / HTTP/1.0" 200 262 0.000465
Sep 28 12:25:51 ctl02 nova-api[31724]: 2017-09-28 12:25:51.532 31724 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:25:51 ctl02 nova-api[31724]: 2017-09-28 12:25:51.533 31724 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:25:51 ctl02 nova-api[31724]: 2017-09-28 12:25:51.533 31724 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:25:51 ctl02 nova-api[31724]: 2017-09-28 12:25:51.533 31724 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:25:51 ctl02 nova-api[31724]: 2017-09-28 12:25:51.533 31724 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:25:51 ctl02 nova-api[31724]: 2017-09-28 12:25:51.533 31724 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:25:51 ctl02 nova-api[31724]: 2017-09-28 12:25:51.533 31724 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:25:51 ctl02 nova-api[31724]: 2017-09-28 12:25:51.533 31724 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:25:51 ctl02 nova-api[31724]: 2017-09-28 12:25:51.533 31724 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:25:51 ctl02 nova-api[31724]: 2017-09-28 12:25:51.533 31724 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:25:51 ctl02 nova-api[31724]: 2017-09-28 12:25:51.533 31724 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:25:51 ctl02 nova-api[31724]: 2017-09-28 12:25:51.533 31724 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:25:51 ctl02 nova-api[31724]: 2017-09-28 12:25:51.533 31724 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:25:51 ctl02 nova-api[31724]: 2017-09-28 12:25:51.533 31724 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:25:51 ctl02 nova-api[31724]: 2017-09-28 12:25:51.533 31724 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:25:51 ctl02 nova-api[31724]: 2017-09-28 12:25:51.533 31724 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:25:51 ctl02 nova-api[31724]: 2017-09-28 12:25:51.533 31724 ERROR nova.wsgi     self.filename))
Sep 28 12:25:51 ctl02 nova-api[31724]: 2017-09-28 12:25:51.533 31724 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:25:51 ctl02 nova-api[31724]: 2017-09-28 12:25:51.533 31724 ERROR nova.wsgi
Sep 28 12:25:51 ctl02 nova-api[31724]: 2017-09-28 12:25:51.534 31724 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:25:51 ctl02 nova-api[31724]: 2017-09-28 12:25:51.664 31724 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:25:51 ctl02 nova-api[31724]: 2017-09-28 12:25:51.901 31724 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:25:51 ctl02 nova-api[31724]: 2017-09-28 12:25:51.904 31724 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:25:51 ctl02 nova-api[31724]: 2017-09-28 12:25:51.904 31724 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:25:51 ctl02 nova-api[31724]: 2017-09-28 12:25:51.904 31724 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:25:52 ctl02 nova-api[31724]: 2017-09-28 12:25:52.039 31724 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:25:52 ctl02 nova-api[31724]: 2017-09-28 12:25:52.041 31724 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:25:52 ctl02 nova-api[31724]: 2017-09-28 12:25:52.041 31724 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:25:52 ctl02 nova-api[31724]: 2017-09-28 12:25:52.041 31724 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:25:52 ctl02 nova-api[31724]: 2017-09-28 12:25:52.044 31724 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:25:52 ctl02 nova-api[31724]: 2017-09-28 12:25:52.045 31724 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:25:52 ctl02 nova-api[31724]: 2017-09-28 12:25:52.045 31724 ERROR nova Traceback (most recent call last):
Sep 28 12:25:52 ctl02 nova-api[31724]: 2017-09-28 12:25:52.045 31724 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:25:52 ctl02 nova-api[31724]: 2017-09-28 12:25:52.045 31724 ERROR nova     sys.exit(main())
Sep 28 12:25:52 ctl02 nova-api[31724]: 2017-09-28 12:25:52.045 31724 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:25:52 ctl02 nova-api[31724]: 2017-09-28 12:25:52.045 31724 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:25:52 ctl02 nova-api[31724]: 2017-09-28 12:25:52.045 31724 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:25:52 ctl02 nova-api[31724]: 2017-09-28 12:25:52.045 31724 ERROR nova     max_url_len=max_url_len)
Sep 28 12:25:52 ctl02 nova-api[31724]: 2017-09-28 12:25:52.045 31724 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:25:52 ctl02 nova-api[31724]: 2017-09-28 12:25:52.045 31724 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:25:52 ctl02 nova-api[31724]: 2017-09-28 12:25:52.045 31724 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:25:52 ctl02 nova-api[31724]: 2017-09-28 12:25:52.045 31724 ERROR nova     sock.listen(backlog)
Sep 28 12:25:52 ctl02 nova-api[31724]: 2017-09-28 12:25:52.045 31724 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:25:52 ctl02 nova-api[31724]: 2017-09-28 12:25:52.045 31724 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:25:52 ctl02 nova-api[31724]: 2017-09-28 12:25:52.045 31724 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:25:52 ctl02 nova-api[31724]: 2017-09-28 12:25:52.045 31724 ERROR nova
Sep 28 12:25:52 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:25:52 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:25:52 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:25:52 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:25:52 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:25:52 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:25:52 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:25:52 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:25:52.723 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:25:52] "OPTIONS / HTTP/1.0" 200 134 0.000408
Sep 28 12:25:53 ctl02 glance-api[29183]: 2017-09-28 12:25:53.087 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:25:53] "OPTIONS / HTTP/1.0" 200 134 0.000641
Sep 28 12:25:53 ctl02 heat-engine[12803]: 2017-09-28 12:25:53.782 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:25:53 ctl02 heat-engine[12803]: 2017-09-28 12:25:53.784 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:25:53 ctl02 heat-engine[12803]: 2017-09-28 12:25:53.786 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:25:53 ctl02 heat-engine[12803]: 2017-09-28 12:25:53.793 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:25:54 ctl02 nova-api[31742]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:25:54 ctl02 nova-api[31742]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:25:54 ctl02 nova-api[31742]: 2017-09-28 12:25:54.273 31742 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:25:54 ctl02 nova-api[31742]: 2017-09-28 12:25:54.275 31742 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:25:54 ctl02 nova-api[31742]: 2017-09-28 12:25:54.275 31742 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:25:54 ctl02 nova-api[31742]: 2017-09-28 12:25:54.275 31742 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:25:54 ctl02 nova-api[31742]: 2017-09-28 12:25:54.275 31742 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:25:54 ctl02 nova-api[31742]: 2017-09-28 12:25:54.275 31742 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:25:54 ctl02 nova-api[31742]: 2017-09-28 12:25:54.275 31742 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:25:54 ctl02 nova-api[31742]: 2017-09-28 12:25:54.275 31742 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:25:54 ctl02 nova-api[31742]: 2017-09-28 12:25:54.275 31742 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:25:54 ctl02 nova-api[31742]: 2017-09-28 12:25:54.275 31742 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:25:54 ctl02 nova-api[31742]: 2017-09-28 12:25:54.275 31742 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:25:54 ctl02 nova-api[31742]: 2017-09-28 12:25:54.275 31742 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:25:54 ctl02 nova-api[31742]: 2017-09-28 12:25:54.275 31742 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:25:54 ctl02 nova-api[31742]: 2017-09-28 12:25:54.275 31742 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:25:54 ctl02 nova-api[31742]: 2017-09-28 12:25:54.275 31742 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:25:54 ctl02 nova-api[31742]: 2017-09-28 12:25:54.275 31742 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:25:54 ctl02 nova-api[31742]: 2017-09-28 12:25:54.275 31742 ERROR nova.wsgi     self.filename))
Sep 28 12:25:54 ctl02 nova-api[31742]: 2017-09-28 12:25:54.275 31742 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:25:54 ctl02 nova-api[31742]: 2017-09-28 12:25:54.275 31742 ERROR nova.wsgi
Sep 28 12:25:54 ctl02 nova-api[31742]: 2017-09-28 12:25:54.276 31742 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:25:54 ctl02 glance-api[29183]: 2017-09-28 12:25:54.342 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:25:54] "OPTIONS / HTTP/1.0" 200 134 0.000912
Sep 28 12:25:54 ctl02 nova-scheduler[5620]: 2017-09-28 12:25:54.348 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:25:54 ctl02 nova-api[31742]: 2017-09-28 12:25:54.414 31742 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:25:54 ctl02 nova-api[31742]: 2017-09-28 12:25:54.650 31742 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:25:54 ctl02 nova-api[31742]: 2017-09-28 12:25:54.653 31742 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:25:54 ctl02 nova-api[31742]: 2017-09-28 12:25:54.653 31742 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:25:54 ctl02 nova-api[31742]: 2017-09-28 12:25:54.653 31742 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:25:54 ctl02 nova-api[31742]: 2017-09-28 12:25:54.792 31742 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:25:54 ctl02 nova-api[31742]: 2017-09-28 12:25:54.794 31742 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:25:54 ctl02 nova-api[31742]: 2017-09-28 12:25:54.794 31742 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:25:54 ctl02 nova-api[31742]: 2017-09-28 12:25:54.794 31742 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:25:54 ctl02 nova-api[31742]: 2017-09-28 12:25:54.798 31742 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:25:54 ctl02 nova-api[31742]: 2017-09-28 12:25:54.799 31742 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:25:54 ctl02 nova-api[31742]: 2017-09-28 12:25:54.799 31742 ERROR nova Traceback (most recent call last):
Sep 28 12:25:54 ctl02 nova-api[31742]: 2017-09-28 12:25:54.799 31742 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:25:54 ctl02 nova-api[31742]: 2017-09-28 12:25:54.799 31742 ERROR nova     sys.exit(main())
Sep 28 12:25:54 ctl02 nova-api[31742]: 2017-09-28 12:25:54.799 31742 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:25:54 ctl02 nova-api[31742]: 2017-09-28 12:25:54.799 31742 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:25:54 ctl02 nova-api[31742]: 2017-09-28 12:25:54.799 31742 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:25:54 ctl02 nova-api[31742]: 2017-09-28 12:25:54.799 31742 ERROR nova     max_url_len=max_url_len)
Sep 28 12:25:54 ctl02 nova-api[31742]: 2017-09-28 12:25:54.799 31742 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:25:54 ctl02 nova-api[31742]: 2017-09-28 12:25:54.799 31742 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:25:54 ctl02 nova-api[31742]: 2017-09-28 12:25:54.799 31742 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:25:54 ctl02 nova-api[31742]: 2017-09-28 12:25:54.799 31742 ERROR nova     sock.listen(backlog)
Sep 28 12:25:54 ctl02 nova-api[31742]: 2017-09-28 12:25:54.799 31742 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:25:54 ctl02 nova-api[31742]: 2017-09-28 12:25:54.799 31742 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:25:54 ctl02 nova-api[31742]: 2017-09-28 12:25:54.799 31742 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:25:54 ctl02 nova-api[31742]: 2017-09-28 12:25:54.799 31742 ERROR nova
Sep 28 12:25:54 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:25:54 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:25:54 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:25:55 ctl02 heat-api[13008]: 2017-09-28 12:25:55.109 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:25:55] "OPTIONS / HTTP/1.0" 200 134 0.000870
Sep 28 12:25:55 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:25:55 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:25:55 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:25:55 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:25:55 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:25:55.381 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:25:55] "OPTIONS / HTTP/1.0" 200 134 0.000617
Sep 28 12:25:56 ctl02 heat-api[13008]: 2017-09-28 12:25:56.614 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:25:56] "OPTIONS / HTTP/1.0" 200 134 0.000550
Sep 28 12:25:56 ctl02 nova-api[31760]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:25:56 ctl02 nova-api[31760]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:25:57 ctl02 nova-api[31760]: 2017-09-28 12:25:57.023 31760 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:25:57 ctl02 nova-api[31760]: 2017-09-28 12:25:57.024 31760 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:25:57 ctl02 nova-api[31760]: 2017-09-28 12:25:57.024 31760 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:25:57 ctl02 nova-api[31760]: 2017-09-28 12:25:57.024 31760 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:25:57 ctl02 nova-api[31760]: 2017-09-28 12:25:57.024 31760 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:25:57 ctl02 nova-api[31760]: 2017-09-28 12:25:57.024 31760 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:25:57 ctl02 nova-api[31760]: 2017-09-28 12:25:57.024 31760 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:25:57 ctl02 nova-api[31760]: 2017-09-28 12:25:57.024 31760 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:25:57 ctl02 nova-api[31760]: 2017-09-28 12:25:57.024 31760 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:25:57 ctl02 nova-api[31760]: 2017-09-28 12:25:57.024 31760 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:25:57 ctl02 nova-api[31760]: 2017-09-28 12:25:57.024 31760 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:25:57 ctl02 nova-api[31760]: 2017-09-28 12:25:57.024 31760 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:25:57 ctl02 nova-api[31760]: 2017-09-28 12:25:57.024 31760 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:25:57 ctl02 nova-api[31760]: 2017-09-28 12:25:57.024 31760 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:25:57 ctl02 nova-api[31760]: 2017-09-28 12:25:57.024 31760 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:25:57 ctl02 nova-api[31760]: 2017-09-28 12:25:57.024 31760 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:25:57 ctl02 nova-api[31760]: 2017-09-28 12:25:57.024 31760 ERROR nova.wsgi     self.filename))
Sep 28 12:25:57 ctl02 nova-api[31760]: 2017-09-28 12:25:57.024 31760 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:25:57 ctl02 nova-api[31760]: 2017-09-28 12:25:57.024 31760 ERROR nova.wsgi
Sep 28 12:25:57 ctl02 nova-api[31760]: 2017-09-28 12:25:57.025 31760 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:25:57 ctl02 nova-api[31760]: 2017-09-28 12:25:57.152 31760 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:25:57 ctl02 heat-api-cfn[13300]: 2017-09-28 12:25:57.270 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:25:57] "OPTIONS / HTTP/1.0" 200 134 0.000521
Sep 28 12:25:57 ctl02 nova-api[31760]: 2017-09-28 12:25:57.379 31760 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:25:57 ctl02 nova-api[31760]: 2017-09-28 12:25:57.381 31760 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:25:57 ctl02 nova-api[31760]: 2017-09-28 12:25:57.381 31760 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:25:57 ctl02 nova-api[31760]: 2017-09-28 12:25:57.382 31760 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:25:57 ctl02 nova-api[31760]: 2017-09-28 12:25:57.511 31760 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:25:57 ctl02 nova-api[31760]: 2017-09-28 12:25:57.513 31760 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:25:57 ctl02 nova-api[31760]: 2017-09-28 12:25:57.513 31760 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:25:57 ctl02 nova-api[31760]: 2017-09-28 12:25:57.513 31760 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:25:57 ctl02 nova-api[31760]: 2017-09-28 12:25:57.516 31760 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:25:57 ctl02 nova-api[31760]: 2017-09-28 12:25:57.517 31760 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:25:57 ctl02 nova-api[31760]: 2017-09-28 12:25:57.517 31760 ERROR nova Traceback (most recent call last):
Sep 28 12:25:57 ctl02 nova-api[31760]: 2017-09-28 12:25:57.517 31760 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:25:57 ctl02 nova-api[31760]: 2017-09-28 12:25:57.517 31760 ERROR nova     sys.exit(main())
Sep 28 12:25:57 ctl02 nova-api[31760]: 2017-09-28 12:25:57.517 31760 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:25:57 ctl02 nova-api[31760]: 2017-09-28 12:25:57.517 31760 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:25:57 ctl02 nova-api[31760]: 2017-09-28 12:25:57.517 31760 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:25:57 ctl02 nova-api[31760]: 2017-09-28 12:25:57.517 31760 ERROR nova     max_url_len=max_url_len)
Sep 28 12:25:57 ctl02 nova-api[31760]: 2017-09-28 12:25:57.517 31760 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:25:57 ctl02 nova-api[31760]: 2017-09-28 12:25:57.517 31760 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:25:57 ctl02 nova-api[31760]: 2017-09-28 12:25:57.517 31760 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:25:57 ctl02 nova-api[31760]: 2017-09-28 12:25:57.517 31760 ERROR nova     sock.listen(backlog)
Sep 28 12:25:57 ctl02 nova-api[31760]: 2017-09-28 12:25:57.517 31760 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:25:57 ctl02 nova-api[31760]: 2017-09-28 12:25:57.517 31760 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:25:57 ctl02 nova-api[31760]: 2017-09-28 12:25:57.517 31760 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:25:57 ctl02 nova-api[31760]: 2017-09-28 12:25:57.517 31760 ERROR nova
Sep 28 12:25:57 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:25:57 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:25:57 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:25:57 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:25:57 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:25:57 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:25:57 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:25:58 ctl02 neutron-server[30536]: 2017-09-28 12:25:58.474 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:25:59 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:25:59.252 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:25:59] "OPTIONS / HTTP/1.0" 200 134 0.000432
Sep 28 12:25:59 ctl02 heat-api[13008]: 2017-09-28 12:25:59.341 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:25:59] "OPTIONS / HTTP/1.0" 200 134 0.000587
Sep 28 12:25:59 ctl02 nova-api[31778]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:25:59 ctl02 nova-api[31778]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:25:59 ctl02 glance-api[29183]: 2017-09-28 12:25:59.552 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:25:59] "OPTIONS / HTTP/1.0" 200 134 0.000636
Sep 28 12:25:59 ctl02 heat-api-cfn[13300]: 2017-09-28 12:25:59.661 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:25:59] "OPTIONS / HTTP/1.0" 200 134 0.000598
Sep 28 12:25:59 ctl02 nova-api[31778]: 2017-09-28 12:25:59.705 31778 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:25:59 ctl02 nova-api[31778]: 2017-09-28 12:25:59.707 31778 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:25:59 ctl02 nova-api[31778]: 2017-09-28 12:25:59.707 31778 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:25:59 ctl02 nova-api[31778]: 2017-09-28 12:25:59.707 31778 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:25:59 ctl02 nova-api[31778]: 2017-09-28 12:25:59.707 31778 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:25:59 ctl02 nova-api[31778]: 2017-09-28 12:25:59.707 31778 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:25:59 ctl02 nova-api[31778]: 2017-09-28 12:25:59.707 31778 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:25:59 ctl02 nova-api[31778]: 2017-09-28 12:25:59.707 31778 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:25:59 ctl02 nova-api[31778]: 2017-09-28 12:25:59.707 31778 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:25:59 ctl02 nova-api[31778]: 2017-09-28 12:25:59.707 31778 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:25:59 ctl02 nova-api[31778]: 2017-09-28 12:25:59.707 31778 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:25:59 ctl02 nova-api[31778]: 2017-09-28 12:25:59.707 31778 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:25:59 ctl02 nova-api[31778]: 2017-09-28 12:25:59.707 31778 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:25:59 ctl02 nova-api[31778]: 2017-09-28 12:25:59.707 31778 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:25:59 ctl02 nova-api[31778]: 2017-09-28 12:25:59.707 31778 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:25:59 ctl02 nova-api[31778]: 2017-09-28 12:25:59.707 31778 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:25:59 ctl02 nova-api[31778]: 2017-09-28 12:25:59.707 31778 ERROR nova.wsgi     self.filename))
Sep 28 12:25:59 ctl02 nova-api[31778]: 2017-09-28 12:25:59.707 31778 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:25:59 ctl02 nova-api[31778]: 2017-09-28 12:25:59.707 31778 ERROR nova.wsgi
Sep 28 12:25:59 ctl02 nova-api[31778]: 2017-09-28 12:25:59.707 31778 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:25:59 ctl02 nova-api[31778]: 2017-09-28 12:25:59.833 31778 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:25:59 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x23447e6b)
Sep 28 12:25:59 ctl02 heat-api-cfn[13300]: 2017-09-28 12:25:59.984 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:25:59] "OPTIONS / HTTP/1.0" 200 134 0.000512
Sep 28 12:26:00 ctl02 nova-api[31778]: 2017-09-28 12:26:00.057 31778 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:26:00 ctl02 nova-api[31778]: 2017-09-28 12:26:00.059 31778 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:26:00 ctl02 nova-api[31778]: 2017-09-28 12:26:00.059 31778 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:26:00 ctl02 nova-api[31778]: 2017-09-28 12:26:00.059 31778 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:26:00 ctl02 nova-api[31778]: 2017-09-28 12:26:00.189 31778 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:26:00 ctl02 nova-api[31778]: 2017-09-28 12:26:00.190 31778 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:26:00 ctl02 nova-api[31778]: 2017-09-28 12:26:00.191 31778 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:26:00 ctl02 nova-api[31778]: 2017-09-28 12:26:00.191 31778 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:26:00 ctl02 nova-api[31778]: 2017-09-28 12:26:00.194 31778 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:26:00 ctl02 nova-api[31778]: 2017-09-28 12:26:00.194 31778 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:26:00 ctl02 nova-api[31778]: 2017-09-28 12:26:00.194 31778 ERROR nova Traceback (most recent call last):
Sep 28 12:26:00 ctl02 nova-api[31778]: 2017-09-28 12:26:00.194 31778 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:26:00 ctl02 nova-api[31778]: 2017-09-28 12:26:00.194 31778 ERROR nova     sys.exit(main())
Sep 28 12:26:00 ctl02 nova-api[31778]: 2017-09-28 12:26:00.194 31778 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:26:00 ctl02 nova-api[31778]: 2017-09-28 12:26:00.194 31778 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:26:00 ctl02 nova-api[31778]: 2017-09-28 12:26:00.194 31778 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:26:00 ctl02 nova-api[31778]: 2017-09-28 12:26:00.194 31778 ERROR nova     max_url_len=max_url_len)
Sep 28 12:26:00 ctl02 nova-api[31778]: 2017-09-28 12:26:00.194 31778 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:26:00 ctl02 nova-api[31778]: 2017-09-28 12:26:00.194 31778 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:26:00 ctl02 nova-api[31778]: 2017-09-28 12:26:00.194 31778 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:26:00 ctl02 nova-api[31778]: 2017-09-28 12:26:00.194 31778 ERROR nova     sock.listen(backlog)
Sep 28 12:26:00 ctl02 nova-api[31778]: 2017-09-28 12:26:00.194 31778 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:26:00 ctl02 nova-api[31778]: 2017-09-28 12:26:00.194 31778 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:26:00 ctl02 nova-api[31778]: 2017-09-28 12:26:00.194 31778 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:26:00 ctl02 nova-api[31778]: 2017-09-28 12:26:00.194 31778 ERROR nova
Sep 28 12:26:00 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:26:00 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:26:00 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:26:00 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:26:00 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:26:00 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:26:00 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:26:00 ctl02 neutron-server[30536]: 2017-09-28 12:26:00.866 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:26:00] "OPTIONS / HTTP/1.0" 200 262 0.000568
Sep 28 12:26:00 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x23447e6b)
Sep 28 12:26:01 ctl02 neutron-server[30536]: 2017-09-28 12:26:01.048 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:26:01] "OPTIONS / HTTP/1.0" 200 262 0.000452
Sep 28 12:26:01 ctl02 neutron-server[30536]: 2017-09-28 12:26:01.191 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:26:01] "OPTIONS / HTTP/1.0" 200 262 0.000454
Sep 28 12:26:01 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x23447e6b)
Sep 28 12:26:02 ctl02 nova-api[31796]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:26:02 ctl02 nova-api[31796]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:26:02 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:26:02.428 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:26:02] "OPTIONS / HTTP/1.0" 200 134 0.000408
Sep 28 12:26:02 ctl02 nova-api[31796]: 2017-09-28 12:26:02.473 31796 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:26:02 ctl02 nova-api[31796]: 2017-09-28 12:26:02.474 31796 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:26:02 ctl02 nova-api[31796]: 2017-09-28 12:26:02.474 31796 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:26:02 ctl02 nova-api[31796]: 2017-09-28 12:26:02.474 31796 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:26:02 ctl02 nova-api[31796]: 2017-09-28 12:26:02.474 31796 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:26:02 ctl02 nova-api[31796]: 2017-09-28 12:26:02.474 31796 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:26:02 ctl02 nova-api[31796]: 2017-09-28 12:26:02.474 31796 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:26:02 ctl02 nova-api[31796]: 2017-09-28 12:26:02.474 31796 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:26:02 ctl02 nova-api[31796]: 2017-09-28 12:26:02.474 31796 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:26:02 ctl02 nova-api[31796]: 2017-09-28 12:26:02.474 31796 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:26:02 ctl02 nova-api[31796]: 2017-09-28 12:26:02.474 31796 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:26:02 ctl02 nova-api[31796]: 2017-09-28 12:26:02.474 31796 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:26:02 ctl02 nova-api[31796]: 2017-09-28 12:26:02.474 31796 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:26:02 ctl02 nova-api[31796]: 2017-09-28 12:26:02.474 31796 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:26:02 ctl02 nova-api[31796]: 2017-09-28 12:26:02.474 31796 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:26:02 ctl02 nova-api[31796]: 2017-09-28 12:26:02.474 31796 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:26:02 ctl02 nova-api[31796]: 2017-09-28 12:26:02.474 31796 ERROR nova.wsgi     self.filename))
Sep 28 12:26:02 ctl02 nova-api[31796]: 2017-09-28 12:26:02.474 31796 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:26:02 ctl02 nova-api[31796]: 2017-09-28 12:26:02.474 31796 ERROR nova.wsgi
Sep 28 12:26:02 ctl02 nova-api[31796]: 2017-09-28 12:26:02.475 31796 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:26:02 ctl02 nova-api[31796]: 2017-09-28 12:26:02.601 31796 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:26:02 ctl02 nova-api[31796]: 2017-09-28 12:26:02.826 31796 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:26:02 ctl02 nova-api[31796]: 2017-09-28 12:26:02.828 31796 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:26:02 ctl02 nova-api[31796]: 2017-09-28 12:26:02.828 31796 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:26:02 ctl02 nova-api[31796]: 2017-09-28 12:26:02.829 31796 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:26:02 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x23447e6b)
Sep 28 12:26:02 ctl02 nova-api[31796]: 2017-09-28 12:26:02.958 31796 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:26:02 ctl02 nova-api[31796]: 2017-09-28 12:26:02.959 31796 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:26:02 ctl02 nova-api[31796]: 2017-09-28 12:26:02.960 31796 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:26:02 ctl02 nova-api[31796]: 2017-09-28 12:26:02.960 31796 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:26:02 ctl02 nova-api[31796]: 2017-09-28 12:26:02.964 31796 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:26:02 ctl02 nova-api[31796]: 2017-09-28 12:26:02.964 31796 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:26:02 ctl02 nova-api[31796]: 2017-09-28 12:26:02.964 31796 ERROR nova Traceback (most recent call last):
Sep 28 12:26:02 ctl02 nova-api[31796]: 2017-09-28 12:26:02.964 31796 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:26:02 ctl02 nova-api[31796]: 2017-09-28 12:26:02.964 31796 ERROR nova     sys.exit(main())
Sep 28 12:26:02 ctl02 nova-api[31796]: 2017-09-28 12:26:02.964 31796 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:26:02 ctl02 nova-api[31796]: 2017-09-28 12:26:02.964 31796 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:26:02 ctl02 nova-api[31796]: 2017-09-28 12:26:02.964 31796 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:26:02 ctl02 nova-api[31796]: 2017-09-28 12:26:02.964 31796 ERROR nova     max_url_len=max_url_len)
Sep 28 12:26:02 ctl02 nova-api[31796]: 2017-09-28 12:26:02.964 31796 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:26:02 ctl02 nova-api[31796]: 2017-09-28 12:26:02.964 31796 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:26:02 ctl02 nova-api[31796]: 2017-09-28 12:26:02.964 31796 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:26:02 ctl02 nova-api[31796]: 2017-09-28 12:26:02.964 31796 ERROR nova     sock.listen(backlog)
Sep 28 12:26:02 ctl02 nova-api[31796]: 2017-09-28 12:26:02.964 31796 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:26:02 ctl02 nova-api[31796]: 2017-09-28 12:26:02.964 31796 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:26:02 ctl02 nova-api[31796]: 2017-09-28 12:26:02.964 31796 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:26:02 ctl02 nova-api[31796]: 2017-09-28 12:26:02.964 31796 ERROR nova
Sep 28 12:26:03 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:26:03 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:26:03 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:26:03 ctl02 glance-api[29183]: 2017-09-28 12:26:03.215 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:26:03] "OPTIONS / HTTP/1.0" 200 134 0.000810
Sep 28 12:26:03 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:26:03 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:26:03 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:26:03 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:26:03 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x23447e6b)
Sep 28 12:26:04 ctl02 glance-api[29183]: 2017-09-28 12:26:04.169 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:26:04] "OPTIONS / HTTP/1.0" 200 134 0.000829
Sep 28 12:26:04 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x23447e6b)
Sep 28 12:26:05 ctl02 nova-api[31814]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:26:05 ctl02 nova-api[31814]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:26:05 ctl02 nova-api[31814]: 2017-09-28 12:26:05.210 31814 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:26:05 ctl02 nova-api[31814]: 2017-09-28 12:26:05.211 31814 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:26:05 ctl02 nova-api[31814]: 2017-09-28 12:26:05.211 31814 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:26:05 ctl02 nova-api[31814]: 2017-09-28 12:26:05.211 31814 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:26:05 ctl02 nova-api[31814]: 2017-09-28 12:26:05.211 31814 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:26:05 ctl02 nova-api[31814]: 2017-09-28 12:26:05.211 31814 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:26:05 ctl02 nova-api[31814]: 2017-09-28 12:26:05.211 31814 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:26:05 ctl02 nova-api[31814]: 2017-09-28 12:26:05.211 31814 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:26:05 ctl02 nova-api[31814]: 2017-09-28 12:26:05.211 31814 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:26:05 ctl02 nova-api[31814]: 2017-09-28 12:26:05.211 31814 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:26:05 ctl02 nova-api[31814]: 2017-09-28 12:26:05.211 31814 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:26:05 ctl02 nova-api[31814]: 2017-09-28 12:26:05.211 31814 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:26:05 ctl02 nova-api[31814]: 2017-09-28 12:26:05.211 31814 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:26:05 ctl02 nova-api[31814]: 2017-09-28 12:26:05.211 31814 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:26:05 ctl02 nova-api[31814]: 2017-09-28 12:26:05.211 31814 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:26:05 ctl02 nova-api[31814]: 2017-09-28 12:26:05.211 31814 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:26:05 ctl02 nova-api[31814]: 2017-09-28 12:26:05.211 31814 ERROR nova.wsgi     self.filename))
Sep 28 12:26:05 ctl02 nova-api[31814]: 2017-09-28 12:26:05.211 31814 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:26:05 ctl02 nova-api[31814]: 2017-09-28 12:26:05.211 31814 ERROR nova.wsgi
Sep 28 12:26:05 ctl02 nova-api[31814]: 2017-09-28 12:26:05.214 31814 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:26:05 ctl02 nova-api[31814]: 2017-09-28 12:26:05.341 31814 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:26:05 ctl02 heat-api[13008]: 2017-09-28 12:26:05.393 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:26:05] "OPTIONS / HTTP/1.0" 200 134 0.000634
Sep 28 12:26:05 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:26:05.504 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:26:05] "OPTIONS / HTTP/1.0" 200 134 0.000473
Sep 28 12:26:05 ctl02 nova-api[31814]: 2017-09-28 12:26:05.571 31814 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:26:05 ctl02 nova-api[31814]: 2017-09-28 12:26:05.573 31814 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:26:05 ctl02 nova-api[31814]: 2017-09-28 12:26:05.574 31814 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:26:05 ctl02 nova-api[31814]: 2017-09-28 12:26:05.574 31814 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:26:05 ctl02 nova-api[31814]: 2017-09-28 12:26:05.702 31814 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:26:05 ctl02 nova-api[31814]: 2017-09-28 12:26:05.704 31814 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:26:05 ctl02 nova-api[31814]: 2017-09-28 12:26:05.705 31814 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:26:05 ctl02 nova-api[31814]: 2017-09-28 12:26:05.705 31814 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:26:05 ctl02 nova-api[31814]: 2017-09-28 12:26:05.708 31814 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:26:05 ctl02 nova-api[31814]: 2017-09-28 12:26:05.709 31814 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:26:05 ctl02 nova-api[31814]: 2017-09-28 12:26:05.709 31814 ERROR nova Traceback (most recent call last):
Sep 28 12:26:05 ctl02 nova-api[31814]: 2017-09-28 12:26:05.709 31814 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:26:05 ctl02 nova-api[31814]: 2017-09-28 12:26:05.709 31814 ERROR nova     sys.exit(main())
Sep 28 12:26:05 ctl02 nova-api[31814]: 2017-09-28 12:26:05.709 31814 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:26:05 ctl02 nova-api[31814]: 2017-09-28 12:26:05.709 31814 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:26:05 ctl02 nova-api[31814]: 2017-09-28 12:26:05.709 31814 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:26:05 ctl02 nova-api[31814]: 2017-09-28 12:26:05.709 31814 ERROR nova     max_url_len=max_url_len)
Sep 28 12:26:05 ctl02 nova-api[31814]: 2017-09-28 12:26:05.709 31814 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:26:05 ctl02 nova-api[31814]: 2017-09-28 12:26:05.709 31814 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:26:05 ctl02 nova-api[31814]: 2017-09-28 12:26:05.709 31814 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:26:05 ctl02 nova-api[31814]: 2017-09-28 12:26:05.709 31814 ERROR nova     sock.listen(backlog)
Sep 28 12:26:05 ctl02 nova-api[31814]: 2017-09-28 12:26:05.709 31814 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:26:05 ctl02 nova-api[31814]: 2017-09-28 12:26:05.709 31814 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:26:05 ctl02 nova-api[31814]: 2017-09-28 12:26:05.709 31814 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:26:05 ctl02 nova-api[31814]: 2017-09-28 12:26:05.709 31814 ERROR nova
Sep 28 12:26:05 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:26:05 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:26:05 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:26:05 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x23447e6b)
Sep 28 12:26:06 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:26:06 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:26:06 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:26:06 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:26:06 ctl02 heat-api[13008]: 2017-09-28 12:26:06.375 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:26:06] "OPTIONS / HTTP/1.0" 200 134 0.000527
Sep 28 12:26:06 ctl02 neutron-server[30536]: 2017-09-28 12:26:06.468 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 1 dead agents out of 2:
Sep 28 12:26:06 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:26:06 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:23:57 cmp001
Sep 28 12:26:06 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x23447e6b)
Sep 28 12:26:07 ctl02 heat-api-cfn[13300]: 2017-09-28 12:26:07.321 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:26:07] "OPTIONS / HTTP/1.0" 200 134 0.000421
Sep 28 12:26:07 ctl02 nova-api[31832]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:26:07 ctl02 nova-api[31832]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:26:07 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x23447e6b)
Sep 28 12:26:08 ctl02 nova-api[31832]: 2017-09-28 12:26:08.009 31832 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:26:08 ctl02 nova-api[31832]: 2017-09-28 12:26:08.010 31832 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:26:08 ctl02 nova-api[31832]: 2017-09-28 12:26:08.010 31832 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:26:08 ctl02 nova-api[31832]: 2017-09-28 12:26:08.010 31832 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:26:08 ctl02 nova-api[31832]: 2017-09-28 12:26:08.010 31832 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:26:08 ctl02 nova-api[31832]: 2017-09-28 12:26:08.010 31832 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:26:08 ctl02 nova-api[31832]: 2017-09-28 12:26:08.010 31832 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:26:08 ctl02 nova-api[31832]: 2017-09-28 12:26:08.010 31832 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:26:08 ctl02 nova-api[31832]: 2017-09-28 12:26:08.010 31832 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:26:08 ctl02 nova-api[31832]: 2017-09-28 12:26:08.010 31832 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:26:08 ctl02 nova-api[31832]: 2017-09-28 12:26:08.010 31832 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:26:08 ctl02 nova-api[31832]: 2017-09-28 12:26:08.010 31832 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:26:08 ctl02 nova-api[31832]: 2017-09-28 12:26:08.010 31832 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:26:08 ctl02 nova-api[31832]: 2017-09-28 12:26:08.010 31832 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:26:08 ctl02 nova-api[31832]: 2017-09-28 12:26:08.010 31832 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:26:08 ctl02 nova-api[31832]: 2017-09-28 12:26:08.010 31832 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:26:08 ctl02 nova-api[31832]: 2017-09-28 12:26:08.010 31832 ERROR nova.wsgi     self.filename))
Sep 28 12:26:08 ctl02 nova-api[31832]: 2017-09-28 12:26:08.010 31832 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:26:08 ctl02 nova-api[31832]: 2017-09-28 12:26:08.010 31832 ERROR nova.wsgi
Sep 28 12:26:08 ctl02 nova-api[31832]: 2017-09-28 12:26:08.011 31832 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:26:08 ctl02 nova-api[31832]: 2017-09-28 12:26:08.143 31832 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:26:08 ctl02 nova-api[31832]: 2017-09-28 12:26:08.373 31832 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:26:08 ctl02 nova-api[31832]: 2017-09-28 12:26:08.375 31832 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:26:08 ctl02 nova-api[31832]: 2017-09-28 12:26:08.375 31832 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:26:08 ctl02 nova-api[31832]: 2017-09-28 12:26:08.375 31832 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:26:08 ctl02 nova-api[31832]: 2017-09-28 12:26:08.513 31832 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:26:08 ctl02 nova-api[31832]: 2017-09-28 12:26:08.514 31832 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:26:08 ctl02 nova-api[31832]: 2017-09-28 12:26:08.515 31832 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:26:08 ctl02 nova-api[31832]: 2017-09-28 12:26:08.515 31832 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:26:08 ctl02 nova-api[31832]: 2017-09-28 12:26:08.518 31832 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:26:08 ctl02 nova-api[31832]: 2017-09-28 12:26:08.518 31832 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:26:08 ctl02 nova-api[31832]: 2017-09-28 12:26:08.518 31832 ERROR nova Traceback (most recent call last):
Sep 28 12:26:08 ctl02 nova-api[31832]: 2017-09-28 12:26:08.518 31832 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:26:08 ctl02 nova-api[31832]: 2017-09-28 12:26:08.518 31832 ERROR nova     sys.exit(main())
Sep 28 12:26:08 ctl02 nova-api[31832]: 2017-09-28 12:26:08.518 31832 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:26:08 ctl02 nova-api[31832]: 2017-09-28 12:26:08.518 31832 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:26:08 ctl02 nova-api[31832]: 2017-09-28 12:26:08.518 31832 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:26:08 ctl02 nova-api[31832]: 2017-09-28 12:26:08.518 31832 ERROR nova     max_url_len=max_url_len)
Sep 28 12:26:08 ctl02 nova-api[31832]: 2017-09-28 12:26:08.518 31832 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:26:08 ctl02 nova-api[31832]: 2017-09-28 12:26:08.518 31832 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:26:08 ctl02 nova-api[31832]: 2017-09-28 12:26:08.518 31832 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:26:08 ctl02 nova-api[31832]: 2017-09-28 12:26:08.518 31832 ERROR nova     sock.listen(backlog)
Sep 28 12:26:08 ctl02 nova-api[31832]: 2017-09-28 12:26:08.518 31832 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:26:08 ctl02 nova-api[31832]: 2017-09-28 12:26:08.518 31832 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:26:08 ctl02 nova-api[31832]: 2017-09-28 12:26:08.518 31832 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:26:08 ctl02 nova-api[31832]: 2017-09-28 12:26:08.518 31832 ERROR nova
Sep 28 12:26:08 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:26:08 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:26:08 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:26:08 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:26:08 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:26:08 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:26:08 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:26:08 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x23447e6b)
Sep 28 12:26:08 ctl02 heat-api[13008]: 2017-09-28 12:26:08.957 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:26:08] "OPTIONS / HTTP/1.0" 200 134 0.000742
Sep 28 12:26:09 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:26:09.582 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:26:09] "OPTIONS / HTTP/1.0" 200 134 0.000461
Sep 28 12:26:09 ctl02 heat-api-cfn[13300]: 2017-09-28 12:26:09.661 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:26:09] "OPTIONS / HTTP/1.0" 200 134 0.000470
Sep 28 12:26:09 ctl02 glance-api[29183]: 2017-09-28 12:26:09.853 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:26:09] "OPTIONS / HTTP/1.0" 200 134 0.000632
Sep 28 12:26:09 ctl02 heat-api-cfn[13300]: 2017-09-28 12:26:09.866 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:26:09] "OPTIONS / HTTP/1.0" 200 134 0.000306
Sep 28 12:26:09 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x23447e6b)
Sep 28 12:26:10 ctl02 neutron-server[30536]: 2017-09-28 12:26:10.509 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:26:10] "OPTIONS / HTTP/1.0" 200 262 0.000455
Sep 28 12:26:10 ctl02 nova-api[31850]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:26:10 ctl02 nova-api[31850]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:26:10 ctl02 nova-api[31850]: 2017-09-28 12:26:10.747 31850 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:26:10 ctl02 nova-api[31850]: 2017-09-28 12:26:10.748 31850 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:26:10 ctl02 nova-api[31850]: 2017-09-28 12:26:10.748 31850 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:26:10 ctl02 nova-api[31850]: 2017-09-28 12:26:10.748 31850 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:26:10 ctl02 nova-api[31850]: 2017-09-28 12:26:10.748 31850 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:26:10 ctl02 nova-api[31850]: 2017-09-28 12:26:10.748 31850 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:26:10 ctl02 nova-api[31850]: 2017-09-28 12:26:10.748 31850 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:26:10 ctl02 nova-api[31850]: 2017-09-28 12:26:10.748 31850 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:26:10 ctl02 nova-api[31850]: 2017-09-28 12:26:10.748 31850 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:26:10 ctl02 nova-api[31850]: 2017-09-28 12:26:10.748 31850 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:26:10 ctl02 nova-api[31850]: 2017-09-28 12:26:10.748 31850 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:26:10 ctl02 nova-api[31850]: 2017-09-28 12:26:10.748 31850 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:26:10 ctl02 nova-api[31850]: 2017-09-28 12:26:10.748 31850 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:26:10 ctl02 nova-api[31850]: 2017-09-28 12:26:10.748 31850 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:26:10 ctl02 nova-api[31850]: 2017-09-28 12:26:10.748 31850 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:26:10 ctl02 nova-api[31850]: 2017-09-28 12:26:10.748 31850 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:26:10 ctl02 nova-api[31850]: 2017-09-28 12:26:10.748 31850 ERROR nova.wsgi     self.filename))
Sep 28 12:26:10 ctl02 nova-api[31850]: 2017-09-28 12:26:10.748 31850 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:26:10 ctl02 nova-api[31850]: 2017-09-28 12:26:10.748 31850 ERROR nova.wsgi
Sep 28 12:26:10 ctl02 nova-api[31850]: 2017-09-28 12:26:10.751 31850 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:26:10 ctl02 nova-api[31850]: 2017-09-28 12:26:10.878 31850 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:26:10 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:26:10 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:26:11 ctl02 neutron-server[30536]: 2017-09-28 12:26:11.101 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:26:11] "OPTIONS / HTTP/1.0" 200 262 0.000442
Sep 28 12:26:11 ctl02 nova-api[31850]: 2017-09-28 12:26:11.104 31850 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:26:11 ctl02 nova-api[31850]: 2017-09-28 12:26:11.107 31850 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:26:11 ctl02 nova-api[31850]: 2017-09-28 12:26:11.107 31850 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:26:11 ctl02 nova-api[31850]: 2017-09-28 12:26:11.107 31850 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:26:11 ctl02 nova-api[31850]: 2017-09-28 12:26:11.239 31850 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:26:11 ctl02 nova-api[31850]: 2017-09-28 12:26:11.241 31850 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:26:11 ctl02 nova-api[31850]: 2017-09-28 12:26:11.241 31850 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:26:11 ctl02 nova-api[31850]: 2017-09-28 12:26:11.241 31850 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:26:11 ctl02 nova-api[31850]: 2017-09-28 12:26:11.244 31850 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:26:11 ctl02 nova-api[31850]: 2017-09-28 12:26:11.245 31850 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:26:11 ctl02 nova-api[31850]: 2017-09-28 12:26:11.245 31850 ERROR nova Traceback (most recent call last):
Sep 28 12:26:11 ctl02 nova-api[31850]: 2017-09-28 12:26:11.245 31850 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:26:11 ctl02 nova-api[31850]: 2017-09-28 12:26:11.245 31850 ERROR nova     sys.exit(main())
Sep 28 12:26:11 ctl02 nova-api[31850]: 2017-09-28 12:26:11.245 31850 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:26:11 ctl02 nova-api[31850]: 2017-09-28 12:26:11.245 31850 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:26:11 ctl02 nova-api[31850]: 2017-09-28 12:26:11.245 31850 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:26:11 ctl02 nova-api[31850]: 2017-09-28 12:26:11.245 31850 ERROR nova     max_url_len=max_url_len)
Sep 28 12:26:11 ctl02 nova-api[31850]: 2017-09-28 12:26:11.245 31850 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:26:11 ctl02 nova-api[31850]: 2017-09-28 12:26:11.245 31850 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:26:11 ctl02 nova-api[31850]: 2017-09-28 12:26:11.245 31850 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:26:11 ctl02 nova-api[31850]: 2017-09-28 12:26:11.245 31850 ERROR nova     sock.listen(backlog)
Sep 28 12:26:11 ctl02 nova-api[31850]: 2017-09-28 12:26:11.245 31850 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:26:11 ctl02 nova-api[31850]: 2017-09-28 12:26:11.245 31850 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:26:11 ctl02 nova-api[31850]: 2017-09-28 12:26:11.245 31850 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:26:11 ctl02 nova-api[31850]: 2017-09-28 12:26:11.245 31850 ERROR nova
Sep 28 12:26:11 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:26:11 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:26:11 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:26:11 ctl02 neutron-server[30536]: 2017-09-28 12:26:11.574 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:26:11] "OPTIONS / HTTP/1.0" 200 262 0.000673
Sep 28 12:26:11 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:26:11 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:26:11 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:26:11 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:26:12 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:26:12.767 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:26:12] "OPTIONS / HTTP/1.0" 200 134 0.000504
Sep 28 12:26:12 ctl02 glance-api[29183]: 2017-09-28 12:26:12.979 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:26:12] "OPTIONS / HTTP/1.0" 200 134 0.000769
Sep 28 12:26:13 ctl02 nova-api[31872]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:26:13 ctl02 nova-api[31872]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:26:13 ctl02 nova-cert[4860]: 2017-09-28 12:26:13.475 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:26:13 ctl02 neutron-server[30536]: 2017-09-28 12:26:13.484 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:26:13 ctl02 nova-api[31872]: 2017-09-28 12:26:13.513 31872 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:26:13 ctl02 nova-api[31872]: 2017-09-28 12:26:13.514 31872 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:26:13 ctl02 nova-api[31872]: 2017-09-28 12:26:13.514 31872 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:26:13 ctl02 nova-api[31872]: 2017-09-28 12:26:13.514 31872 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:26:13 ctl02 nova-api[31872]: 2017-09-28 12:26:13.514 31872 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:26:13 ctl02 nova-api[31872]: 2017-09-28 12:26:13.514 31872 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:26:13 ctl02 nova-api[31872]: 2017-09-28 12:26:13.514 31872 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:26:13 ctl02 nova-api[31872]: 2017-09-28 12:26:13.514 31872 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:26:13 ctl02 nova-api[31872]: 2017-09-28 12:26:13.514 31872 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:26:13 ctl02 nova-api[31872]: 2017-09-28 12:26:13.514 31872 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:26:13 ctl02 nova-api[31872]: 2017-09-28 12:26:13.514 31872 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:26:13 ctl02 nova-api[31872]: 2017-09-28 12:26:13.514 31872 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:26:13 ctl02 nova-api[31872]: 2017-09-28 12:26:13.514 31872 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:26:13 ctl02 nova-api[31872]: 2017-09-28 12:26:13.514 31872 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:26:13 ctl02 nova-api[31872]: 2017-09-28 12:26:13.514 31872 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:26:13 ctl02 nova-api[31872]: 2017-09-28 12:26:13.514 31872 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:26:13 ctl02 nova-api[31872]: 2017-09-28 12:26:13.514 31872 ERROR nova.wsgi     self.filename))
Sep 28 12:26:13 ctl02 nova-api[31872]: 2017-09-28 12:26:13.514 31872 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:26:13 ctl02 nova-api[31872]: 2017-09-28 12:26:13.514 31872 ERROR nova.wsgi
Sep 28 12:26:13 ctl02 nova-api[31872]: 2017-09-28 12:26:13.515 31872 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:26:13 ctl02 nova-api[31872]: 2017-09-28 12:26:13.646 31872 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:26:13 ctl02 glance-api[29183]: 2017-09-28 12:26:13.870 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:26:13] "OPTIONS / HTTP/1.0" 200 134 0.000755
Sep 28 12:26:13 ctl02 nova-api[31872]: 2017-09-28 12:26:13.895 31872 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:26:13 ctl02 nova-api[31872]: 2017-09-28 12:26:13.897 31872 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:26:13 ctl02 nova-api[31872]: 2017-09-28 12:26:13.897 31872 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:26:13 ctl02 nova-api[31872]: 2017-09-28 12:26:13.898 31872 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:26:14 ctl02 nova-api[31872]: 2017-09-28 12:26:14.028 31872 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:26:14 ctl02 nova-api[31872]: 2017-09-28 12:26:14.030 31872 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:26:14 ctl02 nova-api[31872]: 2017-09-28 12:26:14.030 31872 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:26:14 ctl02 nova-api[31872]: 2017-09-28 12:26:14.031 31872 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:26:14 ctl02 nova-api[31872]: 2017-09-28 12:26:14.034 31872 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:26:14 ctl02 nova-api[31872]: 2017-09-28 12:26:14.034 31872 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:26:14 ctl02 nova-api[31872]: 2017-09-28 12:26:14.034 31872 ERROR nova Traceback (most recent call last):
Sep 28 12:26:14 ctl02 nova-api[31872]: 2017-09-28 12:26:14.034 31872 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:26:14 ctl02 nova-api[31872]: 2017-09-28 12:26:14.034 31872 ERROR nova     sys.exit(main())
Sep 28 12:26:14 ctl02 nova-api[31872]: 2017-09-28 12:26:14.034 31872 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:26:14 ctl02 nova-api[31872]: 2017-09-28 12:26:14.034 31872 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:26:14 ctl02 nova-api[31872]: 2017-09-28 12:26:14.034 31872 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:26:14 ctl02 nova-api[31872]: 2017-09-28 12:26:14.034 31872 ERROR nova     max_url_len=max_url_len)
Sep 28 12:26:14 ctl02 nova-api[31872]: 2017-09-28 12:26:14.034 31872 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:26:14 ctl02 nova-api[31872]: 2017-09-28 12:26:14.034 31872 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:26:14 ctl02 nova-api[31872]: 2017-09-28 12:26:14.034 31872 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:26:14 ctl02 nova-api[31872]: 2017-09-28 12:26:14.034 31872 ERROR nova     sock.listen(backlog)
Sep 28 12:26:14 ctl02 nova-api[31872]: 2017-09-28 12:26:14.034 31872 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:26:14 ctl02 nova-api[31872]: 2017-09-28 12:26:14.034 31872 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:26:14 ctl02 nova-api[31872]: 2017-09-28 12:26:14.034 31872 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:26:14 ctl02 nova-api[31872]: 2017-09-28 12:26:14.034 31872 ERROR nova
Sep 28 12:26:14 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:26:14 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:26:14 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:26:14 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:26:14 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:26:14 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:26:14 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:26:14 ctl02 nova-conductor[5056]: 2017-09-28 12:26:14.666 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:26:14 ctl02 nova-conductor[5056]: 2017-09-28 12:26:14.682 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:26:14 ctl02 nova-conductor[5056]: 2017-09-28 12:26:14.702 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:26:14 ctl02 nova-conductor[5056]: 2017-09-28 12:26:14.713 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:26:15 ctl02 heat-api[13008]: 2017-09-28 12:26:15.180 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:26:15] "OPTIONS / HTTP/1.0" 200 134 0.000555
Sep 28 12:26:15 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:26:15.215 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:26:15] "OPTIONS / HTTP/1.0" 200 134 0.000396
Sep 28 12:26:16 ctl02 nova-api[31891]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:26:16 ctl02 nova-api[31891]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:26:16 ctl02 nova-api[31891]: 2017-09-28 12:26:16.249 31891 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:26:16 ctl02 nova-api[31891]: 2017-09-28 12:26:16.251 31891 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:26:16 ctl02 nova-api[31891]: 2017-09-28 12:26:16.251 31891 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:26:16 ctl02 nova-api[31891]: 2017-09-28 12:26:16.251 31891 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:26:16 ctl02 nova-api[31891]: 2017-09-28 12:26:16.251 31891 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:26:16 ctl02 nova-api[31891]: 2017-09-28 12:26:16.251 31891 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:26:16 ctl02 nova-api[31891]: 2017-09-28 12:26:16.251 31891 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:26:16 ctl02 nova-api[31891]: 2017-09-28 12:26:16.251 31891 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:26:16 ctl02 nova-api[31891]: 2017-09-28 12:26:16.251 31891 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:26:16 ctl02 nova-api[31891]: 2017-09-28 12:26:16.251 31891 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:26:16 ctl02 nova-api[31891]: 2017-09-28 12:26:16.251 31891 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:26:16 ctl02 nova-api[31891]: 2017-09-28 12:26:16.251 31891 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:26:16 ctl02 nova-api[31891]: 2017-09-28 12:26:16.251 31891 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:26:16 ctl02 nova-api[31891]: 2017-09-28 12:26:16.251 31891 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:26:16 ctl02 nova-api[31891]: 2017-09-28 12:26:16.251 31891 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:26:16 ctl02 nova-api[31891]: 2017-09-28 12:26:16.251 31891 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:26:16 ctl02 nova-api[31891]: 2017-09-28 12:26:16.251 31891 ERROR nova.wsgi     self.filename))
Sep 28 12:26:16 ctl02 nova-api[31891]: 2017-09-28 12:26:16.251 31891 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:26:16 ctl02 nova-api[31891]: 2017-09-28 12:26:16.251 31891 ERROR nova.wsgi
Sep 28 12:26:16 ctl02 nova-api[31891]: 2017-09-28 12:26:16.252 31891 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:26:16 ctl02 heat-api[13008]: 2017-09-28 12:26:16.345 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:26:16] "OPTIONS / HTTP/1.0" 200 134 0.000533
Sep 28 12:26:16 ctl02 nova-api[31891]: 2017-09-28 12:26:16.386 31891 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:26:16 ctl02 nova-api[31891]: 2017-09-28 12:26:16.614 31891 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:26:16 ctl02 nova-api[31891]: 2017-09-28 12:26:16.616 31891 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:26:16 ctl02 nova-api[31891]: 2017-09-28 12:26:16.616 31891 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:26:16 ctl02 nova-api[31891]: 2017-09-28 12:26:16.616 31891 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:26:16 ctl02 nova-api[31891]: 2017-09-28 12:26:16.747 31891 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:26:16 ctl02 nova-api[31891]: 2017-09-28 12:26:16.749 31891 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:26:16 ctl02 nova-api[31891]: 2017-09-28 12:26:16.749 31891 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:26:16 ctl02 nova-api[31891]: 2017-09-28 12:26:16.749 31891 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:26:16 ctl02 nova-api[31891]: 2017-09-28 12:26:16.753 31891 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:26:16 ctl02 nova-api[31891]: 2017-09-28 12:26:16.753 31891 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:26:16 ctl02 nova-api[31891]: 2017-09-28 12:26:16.753 31891 ERROR nova Traceback (most recent call last):
Sep 28 12:26:16 ctl02 nova-api[31891]: 2017-09-28 12:26:16.753 31891 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:26:16 ctl02 nova-api[31891]: 2017-09-28 12:26:16.753 31891 ERROR nova     sys.exit(main())
Sep 28 12:26:16 ctl02 nova-api[31891]: 2017-09-28 12:26:16.753 31891 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:26:16 ctl02 nova-api[31891]: 2017-09-28 12:26:16.753 31891 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:26:16 ctl02 nova-api[31891]: 2017-09-28 12:26:16.753 31891 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:26:16 ctl02 nova-api[31891]: 2017-09-28 12:26:16.753 31891 ERROR nova     max_url_len=max_url_len)
Sep 28 12:26:16 ctl02 nova-api[31891]: 2017-09-28 12:26:16.753 31891 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:26:16 ctl02 nova-api[31891]: 2017-09-28 12:26:16.753 31891 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:26:16 ctl02 nova-api[31891]: 2017-09-28 12:26:16.753 31891 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:26:16 ctl02 nova-api[31891]: 2017-09-28 12:26:16.753 31891 ERROR nova     sock.listen(backlog)
Sep 28 12:26:16 ctl02 nova-api[31891]: 2017-09-28 12:26:16.753 31891 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:26:16 ctl02 nova-api[31891]: 2017-09-28 12:26:16.753 31891 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:26:16 ctl02 nova-api[31891]: 2017-09-28 12:26:16.753 31891 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:26:16 ctl02 nova-api[31891]: 2017-09-28 12:26:16.753 31891 ERROR nova
Sep 28 12:26:16 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:26:16 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:26:16 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:26:17 ctl02 heat-api-cfn[13300]: 2017-09-28 12:26:17.000 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:26:17] "OPTIONS / HTTP/1.0" 200 134 0.000542
Sep 28 12:26:17 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:26:17 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:26:17 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:26:17 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:26:18 ctl02 heat-api[13008]: 2017-09-28 12:26:18.646 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:26:18] "OPTIONS / HTTP/1.0" 200 134 0.000515
Sep 28 12:26:18 ctl02 nova-api[31909]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:26:18 ctl02 nova-api[31909]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:26:18 ctl02 nova-api[31909]: 2017-09-28 12:26:18.981 31909 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:26:18 ctl02 nova-api[31909]: 2017-09-28 12:26:18.982 31909 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:26:18 ctl02 nova-api[31909]: 2017-09-28 12:26:18.982 31909 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:26:18 ctl02 nova-api[31909]: 2017-09-28 12:26:18.982 31909 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:26:18 ctl02 nova-api[31909]: 2017-09-28 12:26:18.982 31909 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:26:18 ctl02 nova-api[31909]: 2017-09-28 12:26:18.982 31909 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:26:18 ctl02 nova-api[31909]: 2017-09-28 12:26:18.982 31909 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:26:18 ctl02 nova-api[31909]: 2017-09-28 12:26:18.982 31909 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:26:18 ctl02 nova-api[31909]: 2017-09-28 12:26:18.982 31909 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:26:18 ctl02 nova-api[31909]: 2017-09-28 12:26:18.982 31909 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:26:18 ctl02 nova-api[31909]: 2017-09-28 12:26:18.982 31909 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:26:18 ctl02 nova-api[31909]: 2017-09-28 12:26:18.982 31909 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:26:18 ctl02 nova-api[31909]: 2017-09-28 12:26:18.982 31909 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:26:18 ctl02 nova-api[31909]: 2017-09-28 12:26:18.982 31909 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:26:18 ctl02 nova-api[31909]: 2017-09-28 12:26:18.982 31909 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:26:18 ctl02 nova-api[31909]: 2017-09-28 12:26:18.982 31909 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:26:18 ctl02 nova-api[31909]: 2017-09-28 12:26:18.982 31909 ERROR nova.wsgi     self.filename))
Sep 28 12:26:18 ctl02 nova-api[31909]: 2017-09-28 12:26:18.982 31909 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:26:18 ctl02 nova-api[31909]: 2017-09-28 12:26:18.982 31909 ERROR nova.wsgi
Sep 28 12:26:18 ctl02 nova-api[31909]: 2017-09-28 12:26:18.983 31909 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:26:19 ctl02 nova-api[31909]: 2017-09-28 12:26:19.108 31909 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:26:19 ctl02 nova-api[31909]: 2017-09-28 12:26:19.330 31909 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:26:19 ctl02 nova-api[31909]: 2017-09-28 12:26:19.332 31909 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:26:19 ctl02 nova-api[31909]: 2017-09-28 12:26:19.332 31909 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:26:19 ctl02 nova-api[31909]: 2017-09-28 12:26:19.333 31909 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:26:19 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:26:19.364 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:26:19] "OPTIONS / HTTP/1.0" 200 134 0.000566
Sep 28 12:26:19 ctl02 heat-api-cfn[13300]: 2017-09-28 12:26:19.449 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:26:19] "OPTIONS / HTTP/1.0" 200 134 0.000457
Sep 28 12:26:19 ctl02 nova-api[31909]: 2017-09-28 12:26:19.464 31909 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:26:19 ctl02 nova-api[31909]: 2017-09-28 12:26:19.466 31909 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:26:19 ctl02 nova-api[31909]: 2017-09-28 12:26:19.466 31909 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:26:19 ctl02 nova-api[31909]: 2017-09-28 12:26:19.466 31909 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:26:19 ctl02 nova-api[31909]: 2017-09-28 12:26:19.469 31909 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:26:19 ctl02 nova-api[31909]: 2017-09-28 12:26:19.470 31909 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:26:19 ctl02 nova-api[31909]: 2017-09-28 12:26:19.470 31909 ERROR nova Traceback (most recent call last):
Sep 28 12:26:19 ctl02 nova-api[31909]: 2017-09-28 12:26:19.470 31909 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:26:19 ctl02 nova-api[31909]: 2017-09-28 12:26:19.470 31909 ERROR nova     sys.exit(main())
Sep 28 12:26:19 ctl02 nova-api[31909]: 2017-09-28 12:26:19.470 31909 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:26:19 ctl02 nova-api[31909]: 2017-09-28 12:26:19.470 31909 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:26:19 ctl02 nova-api[31909]: 2017-09-28 12:26:19.470 31909 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:26:19 ctl02 nova-api[31909]: 2017-09-28 12:26:19.470 31909 ERROR nova     max_url_len=max_url_len)
Sep 28 12:26:19 ctl02 nova-api[31909]: 2017-09-28 12:26:19.470 31909 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:26:19 ctl02 nova-api[31909]: 2017-09-28 12:26:19.470 31909 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:26:19 ctl02 nova-api[31909]: 2017-09-28 12:26:19.470 31909 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:26:19 ctl02 nova-api[31909]: 2017-09-28 12:26:19.470 31909 ERROR nova     sock.listen(backlog)
Sep 28 12:26:19 ctl02 nova-api[31909]: 2017-09-28 12:26:19.470 31909 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:26:19 ctl02 nova-api[31909]: 2017-09-28 12:26:19.470 31909 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:26:19 ctl02 nova-api[31909]: 2017-09-28 12:26:19.470 31909 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:26:19 ctl02 nova-api[31909]: 2017-09-28 12:26:19.470 31909 ERROR nova
Sep 28 12:26:19 ctl02 heat-api-cfn[13300]: 2017-09-28 12:26:19.514 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:26:19] "OPTIONS / HTTP/1.0" 200 134 0.000459
Sep 28 12:26:19 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:26:19 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:26:19 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:26:19 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:26:19 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:26:19 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:26:19 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:26:19 ctl02 glance-api[29183]: 2017-09-28 12:26:19.972 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:26:19] "OPTIONS / HTTP/1.0" 200 134 0.000745
Sep 28 12:26:20 ctl02 neutron-server[30536]: 2017-09-28 12:26:20.189 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:26:20] "OPTIONS / HTTP/1.0" 200 262 0.000516
Sep 28 12:26:21 ctl02 neutron-server[30536]: 2017-09-28 12:26:21.405 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:26:21] "OPTIONS / HTTP/1.0" 200 262 0.000464
Sep 28 12:26:21 ctl02 neutron-server[30536]: 2017-09-28 12:26:21.463 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 1 dead agents out of 2:
Sep 28 12:26:21 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:26:21 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:23:57 cmp001
Sep 28 12:26:21 ctl02 nova-api[31925]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:26:21 ctl02 nova-api[31925]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:26:21 ctl02 neutron-server[30536]: 2017-09-28 12:26:21.627 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:26:21] "OPTIONS / HTTP/1.0" 200 262 0.000515
Sep 28 12:26:21 ctl02 nova-api[31925]: 2017-09-28 12:26:21.758 31925 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:26:21 ctl02 nova-api[31925]: 2017-09-28 12:26:21.759 31925 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:26:21 ctl02 nova-api[31925]: 2017-09-28 12:26:21.759 31925 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:26:21 ctl02 nova-api[31925]: 2017-09-28 12:26:21.759 31925 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:26:21 ctl02 nova-api[31925]: 2017-09-28 12:26:21.759 31925 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:26:21 ctl02 nova-api[31925]: 2017-09-28 12:26:21.759 31925 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:26:21 ctl02 nova-api[31925]: 2017-09-28 12:26:21.759 31925 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:26:21 ctl02 nova-api[31925]: 2017-09-28 12:26:21.759 31925 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:26:21 ctl02 nova-api[31925]: 2017-09-28 12:26:21.759 31925 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:26:21 ctl02 nova-api[31925]: 2017-09-28 12:26:21.759 31925 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:26:21 ctl02 nova-api[31925]: 2017-09-28 12:26:21.759 31925 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:26:21 ctl02 nova-api[31925]: 2017-09-28 12:26:21.759 31925 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:26:21 ctl02 nova-api[31925]: 2017-09-28 12:26:21.759 31925 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:26:21 ctl02 nova-api[31925]: 2017-09-28 12:26:21.759 31925 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:26:21 ctl02 nova-api[31925]: 2017-09-28 12:26:21.759 31925 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:26:21 ctl02 nova-api[31925]: 2017-09-28 12:26:21.759 31925 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:26:21 ctl02 nova-api[31925]: 2017-09-28 12:26:21.759 31925 ERROR nova.wsgi     self.filename))
Sep 28 12:26:21 ctl02 nova-api[31925]: 2017-09-28 12:26:21.759 31925 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:26:21 ctl02 nova-api[31925]: 2017-09-28 12:26:21.759 31925 ERROR nova.wsgi
Sep 28 12:26:21 ctl02 nova-api[31925]: 2017-09-28 12:26:21.760 31925 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:26:21 ctl02 nova-api[31925]: 2017-09-28 12:26:21.885 31925 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:26:22 ctl02 nova-api[31925]: 2017-09-28 12:26:22.115 31925 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:26:22 ctl02 nova-api[31925]: 2017-09-28 12:26:22.118 31925 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:26:22 ctl02 nova-api[31925]: 2017-09-28 12:26:22.118 31925 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:26:22 ctl02 nova-api[31925]: 2017-09-28 12:26:22.118 31925 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:26:22 ctl02 nova-api[31925]: 2017-09-28 12:26:22.247 31925 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:26:22 ctl02 nova-api[31925]: 2017-09-28 12:26:22.249 31925 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:26:22 ctl02 nova-api[31925]: 2017-09-28 12:26:22.249 31925 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:26:22 ctl02 nova-api[31925]: 2017-09-28 12:26:22.249 31925 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:26:22 ctl02 nova-api[31925]: 2017-09-28 12:26:22.252 31925 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:26:22 ctl02 nova-api[31925]: 2017-09-28 12:26:22.252 31925 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:26:22 ctl02 nova-api[31925]: 2017-09-28 12:26:22.252 31925 ERROR nova Traceback (most recent call last):
Sep 28 12:26:22 ctl02 nova-api[31925]: 2017-09-28 12:26:22.252 31925 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:26:22 ctl02 nova-api[31925]: 2017-09-28 12:26:22.252 31925 ERROR nova     sys.exit(main())
Sep 28 12:26:22 ctl02 nova-api[31925]: 2017-09-28 12:26:22.252 31925 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:26:22 ctl02 nova-api[31925]: 2017-09-28 12:26:22.252 31925 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:26:22 ctl02 nova-api[31925]: 2017-09-28 12:26:22.252 31925 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:26:22 ctl02 nova-api[31925]: 2017-09-28 12:26:22.252 31925 ERROR nova     max_url_len=max_url_len)
Sep 28 12:26:22 ctl02 nova-api[31925]: 2017-09-28 12:26:22.252 31925 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:26:22 ctl02 nova-api[31925]: 2017-09-28 12:26:22.252 31925 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:26:22 ctl02 nova-api[31925]: 2017-09-28 12:26:22.252 31925 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:26:22 ctl02 nova-api[31925]: 2017-09-28 12:26:22.252 31925 ERROR nova     sock.listen(backlog)
Sep 28 12:26:22 ctl02 nova-api[31925]: 2017-09-28 12:26:22.252 31925 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:26:22 ctl02 nova-api[31925]: 2017-09-28 12:26:22.252 31925 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:26:22 ctl02 nova-api[31925]: 2017-09-28 12:26:22.252 31925 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:26:22 ctl02 nova-api[31925]: 2017-09-28 12:26:22.252 31925 ERROR nova
Sep 28 12:26:22 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:26:22 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:26:22 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:26:22 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:26:22.573 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:26:22] "OPTIONS / HTTP/1.0" 200 134 0.000508
Sep 28 12:26:22 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:26:22 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:26:22 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:26:22 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:26:23 ctl02 glance-api[29183]: 2017-09-28 12:26:23.354 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:26:23] "OPTIONS / HTTP/1.0" 200 134 0.000592
Sep 28 12:26:23 ctl02 nova-consoleauth[5433]: 2017-09-28 12:26:23.367 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:26:24 ctl02 glance-api[29183]: 2017-09-28 12:26:24.263 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:26:24] "OPTIONS / HTTP/1.0" 200 134 0.000708
Sep 28 12:26:24 ctl02 nova-api[31945]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:26:24 ctl02 nova-api[31945]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:26:24 ctl02 nova-api[31945]: 2017-09-28 12:26:24.513 31945 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:26:24 ctl02 nova-api[31945]: 2017-09-28 12:26:24.514 31945 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:26:24 ctl02 nova-api[31945]: 2017-09-28 12:26:24.514 31945 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:26:24 ctl02 nova-api[31945]: 2017-09-28 12:26:24.514 31945 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:26:24 ctl02 nova-api[31945]: 2017-09-28 12:26:24.514 31945 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:26:24 ctl02 nova-api[31945]: 2017-09-28 12:26:24.514 31945 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:26:24 ctl02 nova-api[31945]: 2017-09-28 12:26:24.514 31945 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:26:24 ctl02 nova-api[31945]: 2017-09-28 12:26:24.514 31945 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:26:24 ctl02 nova-api[31945]: 2017-09-28 12:26:24.514 31945 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:26:24 ctl02 nova-api[31945]: 2017-09-28 12:26:24.514 31945 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:26:24 ctl02 nova-api[31945]: 2017-09-28 12:26:24.514 31945 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:26:24 ctl02 nova-api[31945]: 2017-09-28 12:26:24.514 31945 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:26:24 ctl02 nova-api[31945]: 2017-09-28 12:26:24.514 31945 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:26:24 ctl02 nova-api[31945]: 2017-09-28 12:26:24.514 31945 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:26:24 ctl02 nova-api[31945]: 2017-09-28 12:26:24.514 31945 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:26:24 ctl02 nova-api[31945]: 2017-09-28 12:26:24.514 31945 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:26:24 ctl02 nova-api[31945]: 2017-09-28 12:26:24.514 31945 ERROR nova.wsgi     self.filename))
Sep 28 12:26:24 ctl02 nova-api[31945]: 2017-09-28 12:26:24.514 31945 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:26:24 ctl02 nova-api[31945]: 2017-09-28 12:26:24.514 31945 ERROR nova.wsgi
Sep 28 12:26:24 ctl02 nova-api[31945]: 2017-09-28 12:26:24.515 31945 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:26:24 ctl02 nova-api[31945]: 2017-09-28 12:26:24.641 31945 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:26:24 ctl02 nova-api[31945]: 2017-09-28 12:26:24.865 31945 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:26:24 ctl02 nova-api[31945]: 2017-09-28 12:26:24.868 31945 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:26:24 ctl02 nova-api[31945]: 2017-09-28 12:26:24.868 31945 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:26:24 ctl02 nova-api[31945]: 2017-09-28 12:26:24.868 31945 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:26:24 ctl02 nova-api[31945]: 2017-09-28 12:26:24.998 31945 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:26:25 ctl02 nova-api[31945]: 2017-09-28 12:26:25.000 31945 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:26:25 ctl02 nova-api[31945]: 2017-09-28 12:26:25.000 31945 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:26:25 ctl02 nova-api[31945]: 2017-09-28 12:26:25.000 31945 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:26:25 ctl02 nova-api[31945]: 2017-09-28 12:26:25.003 31945 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:26:25 ctl02 nova-api[31945]: 2017-09-28 12:26:25.004 31945 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:26:25 ctl02 nova-api[31945]: 2017-09-28 12:26:25.004 31945 ERROR nova Traceback (most recent call last):
Sep 28 12:26:25 ctl02 nova-api[31945]: 2017-09-28 12:26:25.004 31945 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:26:25 ctl02 nova-api[31945]: 2017-09-28 12:26:25.004 31945 ERROR nova     sys.exit(main())
Sep 28 12:26:25 ctl02 nova-api[31945]: 2017-09-28 12:26:25.004 31945 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:26:25 ctl02 nova-api[31945]: 2017-09-28 12:26:25.004 31945 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:26:25 ctl02 nova-api[31945]: 2017-09-28 12:26:25.004 31945 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:26:25 ctl02 nova-api[31945]: 2017-09-28 12:26:25.004 31945 ERROR nova     max_url_len=max_url_len)
Sep 28 12:26:25 ctl02 nova-api[31945]: 2017-09-28 12:26:25.004 31945 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:26:25 ctl02 nova-api[31945]: 2017-09-28 12:26:25.004 31945 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:26:25 ctl02 nova-api[31945]: 2017-09-28 12:26:25.004 31945 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:26:25 ctl02 nova-api[31945]: 2017-09-28 12:26:25.004 31945 ERROR nova     sock.listen(backlog)
Sep 28 12:26:25 ctl02 nova-api[31945]: 2017-09-28 12:26:25.004 31945 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:26:25 ctl02 nova-api[31945]: 2017-09-28 12:26:25.004 31945 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:26:25 ctl02 nova-api[31945]: 2017-09-28 12:26:25.004 31945 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:26:25 ctl02 nova-api[31945]: 2017-09-28 12:26:25.004 31945 ERROR nova
Sep 28 12:26:25 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:26:25 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:26:25 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:26:25 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:26:25.261 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:26:25] "OPTIONS / HTTP/1.0" 200 134 0.000578
Sep 28 12:26:25 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:26:25 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:26:25 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:26:25 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:26:25 ctl02 heat-api[13008]: 2017-09-28 12:26:25.482 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:26:25] "OPTIONS / HTTP/1.0" 200 134 0.000635
Sep 28 12:26:25 ctl02 heat-engine[12803]: 2017-09-28 12:26:25.791 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:26:25 ctl02 heat-engine[12803]: 2017-09-28 12:26:25.793 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:26:25 ctl02 heat-engine[12803]: 2017-09-28 12:26:25.796 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:26:25 ctl02 heat-engine[12803]: 2017-09-28 12:26:25.802 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:26:26 ctl02 heat-api[13008]: 2017-09-28 12:26:26.369 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:26:26] "OPTIONS / HTTP/1.0" 200 134 0.000625
Sep 28 12:26:26 ctl02 nova-scheduler[5620]: 2017-09-28 12:26:26.385 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:26:27 ctl02 nova-api[31963]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:26:27 ctl02 nova-api[31963]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:26:27 ctl02 heat-api-cfn[13300]: 2017-09-28 12:26:27.204 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:26:27] "OPTIONS / HTTP/1.0" 200 134 0.000578
Sep 28 12:26:27 ctl02 nova-api[31963]: 2017-09-28 12:26:27.330 31963 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:26:27 ctl02 nova-api[31963]: 2017-09-28 12:26:27.332 31963 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:26:27 ctl02 nova-api[31963]: 2017-09-28 12:26:27.332 31963 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:26:27 ctl02 nova-api[31963]: 2017-09-28 12:26:27.332 31963 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:26:27 ctl02 nova-api[31963]: 2017-09-28 12:26:27.332 31963 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:26:27 ctl02 nova-api[31963]: 2017-09-28 12:26:27.332 31963 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:26:27 ctl02 nova-api[31963]: 2017-09-28 12:26:27.332 31963 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:26:27 ctl02 nova-api[31963]: 2017-09-28 12:26:27.332 31963 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:26:27 ctl02 nova-api[31963]: 2017-09-28 12:26:27.332 31963 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:26:27 ctl02 nova-api[31963]: 2017-09-28 12:26:27.332 31963 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:26:27 ctl02 nova-api[31963]: 2017-09-28 12:26:27.332 31963 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:26:27 ctl02 nova-api[31963]: 2017-09-28 12:26:27.332 31963 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:26:27 ctl02 nova-api[31963]: 2017-09-28 12:26:27.332 31963 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:26:27 ctl02 nova-api[31963]: 2017-09-28 12:26:27.332 31963 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:26:27 ctl02 nova-api[31963]: 2017-09-28 12:26:27.332 31963 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:26:27 ctl02 nova-api[31963]: 2017-09-28 12:26:27.332 31963 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:26:27 ctl02 nova-api[31963]: 2017-09-28 12:26:27.332 31963 ERROR nova.wsgi     self.filename))
Sep 28 12:26:27 ctl02 nova-api[31963]: 2017-09-28 12:26:27.332 31963 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:26:27 ctl02 nova-api[31963]: 2017-09-28 12:26:27.332 31963 ERROR nova.wsgi
Sep 28 12:26:27 ctl02 nova-api[31963]: 2017-09-28 12:26:27.333 31963 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:26:27 ctl02 nova-api[31963]: 2017-09-28 12:26:27.469 31963 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:26:27 ctl02 nova-api[31963]: 2017-09-28 12:26:27.720 31963 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:26:27 ctl02 nova-api[31963]: 2017-09-28 12:26:27.722 31963 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:26:27 ctl02 nova-api[31963]: 2017-09-28 12:26:27.723 31963 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:26:27 ctl02 nova-api[31963]: 2017-09-28 12:26:27.723 31963 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:26:27 ctl02 nova-api[31963]: 2017-09-28 12:26:27.858 31963 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:26:27 ctl02 nova-api[31963]: 2017-09-28 12:26:27.860 31963 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:26:27 ctl02 nova-api[31963]: 2017-09-28 12:26:27.860 31963 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:26:27 ctl02 nova-api[31963]: 2017-09-28 12:26:27.860 31963 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:26:27 ctl02 nova-api[31963]: 2017-09-28 12:26:27.864 31963 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:26:27 ctl02 nova-api[31963]: 2017-09-28 12:26:27.864 31963 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:26:27 ctl02 nova-api[31963]: 2017-09-28 12:26:27.864 31963 ERROR nova Traceback (most recent call last):
Sep 28 12:26:27 ctl02 nova-api[31963]: 2017-09-28 12:26:27.864 31963 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:26:27 ctl02 nova-api[31963]: 2017-09-28 12:26:27.864 31963 ERROR nova     sys.exit(main())
Sep 28 12:26:27 ctl02 nova-api[31963]: 2017-09-28 12:26:27.864 31963 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:26:27 ctl02 nova-api[31963]: 2017-09-28 12:26:27.864 31963 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:26:27 ctl02 nova-api[31963]: 2017-09-28 12:26:27.864 31963 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:26:27 ctl02 nova-api[31963]: 2017-09-28 12:26:27.864 31963 ERROR nova     max_url_len=max_url_len)
Sep 28 12:26:27 ctl02 nova-api[31963]: 2017-09-28 12:26:27.864 31963 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:26:27 ctl02 nova-api[31963]: 2017-09-28 12:26:27.864 31963 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:26:27 ctl02 nova-api[31963]: 2017-09-28 12:26:27.864 31963 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:26:27 ctl02 nova-api[31963]: 2017-09-28 12:26:27.864 31963 ERROR nova     sock.listen(backlog)
Sep 28 12:26:27 ctl02 nova-api[31963]: 2017-09-28 12:26:27.864 31963 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:26:27 ctl02 nova-api[31963]: 2017-09-28 12:26:27.864 31963 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:26:27 ctl02 nova-api[31963]: 2017-09-28 12:26:27.864 31963 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:26:27 ctl02 nova-api[31963]: 2017-09-28 12:26:27.864 31963 ERROR nova
Sep 28 12:26:28 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:26:28 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:26:28 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:26:28 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:26:28 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:26:28 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdf5ef921)
Sep 28 12:26:28 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:26:28 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:26:28 ctl02 neutron-server[30536]: 2017-09-28 12:26:28.476 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:26:28 ctl02 heat-api[13008]: 2017-09-28 12:26:28.953 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:26:28] "OPTIONS / HTTP/1.0" 200 134 0.000623
Sep 28 12:26:29 ctl02 heat-api-cfn[13300]: 2017-09-28 12:26:29.239 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:26:29] "OPTIONS / HTTP/1.0" 200 134 0.000516
Sep 28 12:26:29 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:26:29.279 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:26:29] "OPTIONS / HTTP/1.0" 200 134 0.000675
Sep 28 12:26:29 ctl02 heat-api-cfn[13300]: 2017-09-28 12:26:29.322 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:26:29] "OPTIONS / HTTP/1.0" 200 134 0.000323
Sep 28 12:26:29 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdf5ef921)
Sep 28 12:26:29 ctl02 neutron-server[30536]: 2017-09-28 12:26:29.870 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:26:29] "OPTIONS / HTTP/1.0" 200 262 0.000622
Sep 28 12:26:30 ctl02 nova-api[31980]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:26:30 ctl02 nova-api[31980]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:26:30 ctl02 nova-api[31980]: 2017-09-28 12:26:30.269 31980 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:26:30 ctl02 glance-api[29183]: 2017-09-28 12:26:30.270 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:26:30] "OPTIONS / HTTP/1.0" 200 134 0.000628
Sep 28 12:26:30 ctl02 nova-api[31980]: 2017-09-28 12:26:30.271 31980 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:26:30 ctl02 nova-api[31980]: 2017-09-28 12:26:30.271 31980 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:26:30 ctl02 nova-api[31980]: 2017-09-28 12:26:30.271 31980 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:26:30 ctl02 nova-api[31980]: 2017-09-28 12:26:30.271 31980 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:26:30 ctl02 nova-api[31980]: 2017-09-28 12:26:30.271 31980 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:26:30 ctl02 nova-api[31980]: 2017-09-28 12:26:30.271 31980 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:26:30 ctl02 nova-api[31980]: 2017-09-28 12:26:30.271 31980 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:26:30 ctl02 nova-api[31980]: 2017-09-28 12:26:30.271 31980 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:26:30 ctl02 nova-api[31980]: 2017-09-28 12:26:30.271 31980 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:26:30 ctl02 nova-api[31980]: 2017-09-28 12:26:30.271 31980 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:26:30 ctl02 nova-api[31980]: 2017-09-28 12:26:30.271 31980 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:26:30 ctl02 nova-api[31980]: 2017-09-28 12:26:30.271 31980 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:26:30 ctl02 nova-api[31980]: 2017-09-28 12:26:30.271 31980 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:26:30 ctl02 nova-api[31980]: 2017-09-28 12:26:30.271 31980 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:26:30 ctl02 nova-api[31980]: 2017-09-28 12:26:30.271 31980 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:26:30 ctl02 nova-api[31980]: 2017-09-28 12:26:30.271 31980 ERROR nova.wsgi     self.filename))
Sep 28 12:26:30 ctl02 nova-api[31980]: 2017-09-28 12:26:30.271 31980 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:26:30 ctl02 nova-api[31980]: 2017-09-28 12:26:30.271 31980 ERROR nova.wsgi
Sep 28 12:26:30 ctl02 nova-api[31980]: 2017-09-28 12:26:30.272 31980 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:26:30 ctl02 nova-api[31980]: 2017-09-28 12:26:30.401 31980 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:26:30 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdf5ef921)
Sep 28 12:26:30 ctl02 nova-api[31980]: 2017-09-28 12:26:30.627 31980 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:26:30 ctl02 nova-api[31980]: 2017-09-28 12:26:30.629 31980 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:26:30 ctl02 nova-api[31980]: 2017-09-28 12:26:30.629 31980 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:26:30 ctl02 nova-api[31980]: 2017-09-28 12:26:30.629 31980 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:26:30 ctl02 nova-api[31980]: 2017-09-28 12:26:30.759 31980 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:26:30 ctl02 nova-api[31980]: 2017-09-28 12:26:30.761 31980 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:26:30 ctl02 nova-api[31980]: 2017-09-28 12:26:30.761 31980 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:26:30 ctl02 nova-api[31980]: 2017-09-28 12:26:30.761 31980 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:26:30 ctl02 nova-api[31980]: 2017-09-28 12:26:30.764 31980 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:26:30 ctl02 nova-api[31980]: 2017-09-28 12:26:30.765 31980 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:26:30 ctl02 nova-api[31980]: 2017-09-28 12:26:30.765 31980 ERROR nova Traceback (most recent call last):
Sep 28 12:26:30 ctl02 nova-api[31980]: 2017-09-28 12:26:30.765 31980 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:26:30 ctl02 nova-api[31980]: 2017-09-28 12:26:30.765 31980 ERROR nova     sys.exit(main())
Sep 28 12:26:30 ctl02 nova-api[31980]: 2017-09-28 12:26:30.765 31980 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:26:30 ctl02 nova-api[31980]: 2017-09-28 12:26:30.765 31980 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:26:30 ctl02 nova-api[31980]: 2017-09-28 12:26:30.765 31980 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:26:30 ctl02 nova-api[31980]: 2017-09-28 12:26:30.765 31980 ERROR nova     max_url_len=max_url_len)
Sep 28 12:26:30 ctl02 nova-api[31980]: 2017-09-28 12:26:30.765 31980 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:26:30 ctl02 nova-api[31980]: 2017-09-28 12:26:30.765 31980 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:26:30 ctl02 nova-api[31980]: 2017-09-28 12:26:30.765 31980 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:26:30 ctl02 nova-api[31980]: 2017-09-28 12:26:30.765 31980 ERROR nova     sock.listen(backlog)
Sep 28 12:26:30 ctl02 nova-api[31980]: 2017-09-28 12:26:30.765 31980 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:26:30 ctl02 nova-api[31980]: 2017-09-28 12:26:30.765 31980 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:26:30 ctl02 nova-api[31980]: 2017-09-28 12:26:30.765 31980 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:26:30 ctl02 nova-api[31980]: 2017-09-28 12:26:30.765 31980 ERROR nova
Sep 28 12:26:30 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:26:30 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:26:30 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:26:31 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:26:31 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:26:31 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:26:31 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:26:31 ctl02 neutron-server[30536]: 2017-09-28 12:26:31.309 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:26:31] "OPTIONS / HTTP/1.0" 200 262 0.000593
Sep 28 12:26:31 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdf5ef921)
Sep 28 12:26:31 ctl02 neutron-server[30536]: 2017-09-28 12:26:31.919 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:26:31] "OPTIONS / HTTP/1.0" 200 262 0.000548
Sep 28 12:26:32 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:26:32.336 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:26:32] "OPTIONS / HTTP/1.0" 200 134 0.000464
Sep 28 12:26:32 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdf5ef921)
Sep 28 12:26:32 ctl02 nova-api[31999]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:26:32 ctl02 nova-api[31999]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:26:33 ctl02 nova-api[31999]: 2017-09-28 12:26:33.018 31999 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:26:33 ctl02 nova-api[31999]: 2017-09-28 12:26:33.019 31999 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:26:33 ctl02 nova-api[31999]: 2017-09-28 12:26:33.019 31999 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:26:33 ctl02 nova-api[31999]: 2017-09-28 12:26:33.019 31999 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:26:33 ctl02 nova-api[31999]: 2017-09-28 12:26:33.019 31999 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:26:33 ctl02 nova-api[31999]: 2017-09-28 12:26:33.019 31999 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:26:33 ctl02 nova-api[31999]: 2017-09-28 12:26:33.019 31999 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:26:33 ctl02 nova-api[31999]: 2017-09-28 12:26:33.019 31999 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:26:33 ctl02 nova-api[31999]: 2017-09-28 12:26:33.019 31999 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:26:33 ctl02 nova-api[31999]: 2017-09-28 12:26:33.019 31999 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:26:33 ctl02 nova-api[31999]: 2017-09-28 12:26:33.019 31999 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:26:33 ctl02 nova-api[31999]: 2017-09-28 12:26:33.019 31999 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:26:33 ctl02 nova-api[31999]: 2017-09-28 12:26:33.019 31999 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:26:33 ctl02 nova-api[31999]: 2017-09-28 12:26:33.019 31999 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:26:33 ctl02 nova-api[31999]: 2017-09-28 12:26:33.019 31999 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:26:33 ctl02 nova-api[31999]: 2017-09-28 12:26:33.019 31999 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:26:33 ctl02 nova-api[31999]: 2017-09-28 12:26:33.019 31999 ERROR nova.wsgi     self.filename))
Sep 28 12:26:33 ctl02 nova-api[31999]: 2017-09-28 12:26:33.019 31999 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:26:33 ctl02 nova-api[31999]: 2017-09-28 12:26:33.019 31999 ERROR nova.wsgi
Sep 28 12:26:33 ctl02 nova-api[31999]: 2017-09-28 12:26:33.020 31999 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:26:33 ctl02 nova-api[31999]: 2017-09-28 12:26:33.152 31999 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:26:33 ctl02 nova-api[31999]: 2017-09-28 12:26:33.401 31999 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:26:33 ctl02 nova-api[31999]: 2017-09-28 12:26:33.403 31999 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:26:33 ctl02 nova-api[31999]: 2017-09-28 12:26:33.403 31999 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:26:33 ctl02 nova-api[31999]: 2017-09-28 12:26:33.404 31999 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:26:33 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdf5ef921)
Sep 28 12:26:33 ctl02 glance-api[29183]: 2017-09-28 12:26:33.411 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:26:33] "OPTIONS / HTTP/1.0" 200 134 0.000627
Sep 28 12:26:33 ctl02 nova-api[31999]: 2017-09-28 12:26:33.541 31999 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:26:33 ctl02 nova-api[31999]: 2017-09-28 12:26:33.543 31999 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:26:33 ctl02 nova-api[31999]: 2017-09-28 12:26:33.544 31999 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:26:33 ctl02 nova-api[31999]: 2017-09-28 12:26:33.544 31999 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:26:33 ctl02 nova-api[31999]: 2017-09-28 12:26:33.548 31999 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:26:33 ctl02 nova-api[31999]: 2017-09-28 12:26:33.548 31999 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:26:33 ctl02 nova-api[31999]: 2017-09-28 12:26:33.548 31999 ERROR nova Traceback (most recent call last):
Sep 28 12:26:33 ctl02 nova-api[31999]: 2017-09-28 12:26:33.548 31999 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:26:33 ctl02 nova-api[31999]: 2017-09-28 12:26:33.548 31999 ERROR nova     sys.exit(main())
Sep 28 12:26:33 ctl02 nova-api[31999]: 2017-09-28 12:26:33.548 31999 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:26:33 ctl02 nova-api[31999]: 2017-09-28 12:26:33.548 31999 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:26:33 ctl02 nova-api[31999]: 2017-09-28 12:26:33.548 31999 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:26:33 ctl02 nova-api[31999]: 2017-09-28 12:26:33.548 31999 ERROR nova     max_url_len=max_url_len)
Sep 28 12:26:33 ctl02 nova-api[31999]: 2017-09-28 12:26:33.548 31999 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:26:33 ctl02 nova-api[31999]: 2017-09-28 12:26:33.548 31999 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:26:33 ctl02 nova-api[31999]: 2017-09-28 12:26:33.548 31999 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:26:33 ctl02 nova-api[31999]: 2017-09-28 12:26:33.548 31999 ERROR nova     sock.listen(backlog)
Sep 28 12:26:33 ctl02 nova-api[31999]: 2017-09-28 12:26:33.548 31999 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:26:33 ctl02 nova-api[31999]: 2017-09-28 12:26:33.548 31999 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:26:33 ctl02 nova-api[31999]: 2017-09-28 12:26:33.548 31999 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:26:33 ctl02 nova-api[31999]: 2017-09-28 12:26:33.548 31999 ERROR nova
Sep 28 12:26:33 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:26:33 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:26:33 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:26:33 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:26:33 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:26:33 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:26:33 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:26:34 ctl02 glance-api[29183]: 2017-09-28 12:26:34.325 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:26:34] "OPTIONS / HTTP/1.0" 200 134 0.000651
Sep 28 12:26:34 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdf5ef921)
Sep 28 12:26:35 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:26:35.388 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:26:35] "OPTIONS / HTTP/1.0" 200 134 0.000537
Sep 28 12:26:35 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdf5ef921)
Sep 28 12:26:35 ctl02 nova-api[32017]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:26:35 ctl02 nova-api[32017]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:26:35 ctl02 heat-api[13008]: 2017-09-28 12:26:35.605 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:26:35] "OPTIONS / HTTP/1.0" 200 134 0.000621
Sep 28 12:26:35 ctl02 nova-api[32017]: 2017-09-28 12:26:35.786 32017 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:26:35 ctl02 nova-api[32017]: 2017-09-28 12:26:35.788 32017 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:26:35 ctl02 nova-api[32017]: 2017-09-28 12:26:35.788 32017 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:26:35 ctl02 nova-api[32017]: 2017-09-28 12:26:35.788 32017 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:26:35 ctl02 nova-api[32017]: 2017-09-28 12:26:35.788 32017 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:26:35 ctl02 nova-api[32017]: 2017-09-28 12:26:35.788 32017 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:26:35 ctl02 nova-api[32017]: 2017-09-28 12:26:35.788 32017 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:26:35 ctl02 nova-api[32017]: 2017-09-28 12:26:35.788 32017 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:26:35 ctl02 nova-api[32017]: 2017-09-28 12:26:35.788 32017 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:26:35 ctl02 nova-api[32017]: 2017-09-28 12:26:35.788 32017 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:26:35 ctl02 nova-api[32017]: 2017-09-28 12:26:35.788 32017 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:26:35 ctl02 nova-api[32017]: 2017-09-28 12:26:35.788 32017 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:26:35 ctl02 nova-api[32017]: 2017-09-28 12:26:35.788 32017 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:26:35 ctl02 nova-api[32017]: 2017-09-28 12:26:35.788 32017 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:26:35 ctl02 nova-api[32017]: 2017-09-28 12:26:35.788 32017 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:26:35 ctl02 nova-api[32017]: 2017-09-28 12:26:35.788 32017 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:26:35 ctl02 nova-api[32017]: 2017-09-28 12:26:35.788 32017 ERROR nova.wsgi     self.filename))
Sep 28 12:26:35 ctl02 nova-api[32017]: 2017-09-28 12:26:35.788 32017 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:26:35 ctl02 nova-api[32017]: 2017-09-28 12:26:35.788 32017 ERROR nova.wsgi
Sep 28 12:26:35 ctl02 nova-api[32017]: 2017-09-28 12:26:35.789 32017 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:26:35 ctl02 nova-api[32017]: 2017-09-28 12:26:35.921 32017 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:26:36 ctl02 nova-api[32017]: 2017-09-28 12:26:36.164 32017 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:26:36 ctl02 nova-api[32017]: 2017-09-28 12:26:36.167 32017 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:26:36 ctl02 nova-api[32017]: 2017-09-28 12:26:36.167 32017 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:26:36 ctl02 nova-api[32017]: 2017-09-28 12:26:36.167 32017 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:26:36 ctl02 nova-api[32017]: 2017-09-28 12:26:36.298 32017 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:26:36 ctl02 nova-api[32017]: 2017-09-28 12:26:36.300 32017 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:26:36 ctl02 nova-api[32017]: 2017-09-28 12:26:36.300 32017 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:26:36 ctl02 nova-api[32017]: 2017-09-28 12:26:36.300 32017 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:26:36 ctl02 nova-api[32017]: 2017-09-28 12:26:36.304 32017 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:26:36 ctl02 nova-api[32017]: 2017-09-28 12:26:36.304 32017 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:26:36 ctl02 nova-api[32017]: 2017-09-28 12:26:36.304 32017 ERROR nova Traceback (most recent call last):
Sep 28 12:26:36 ctl02 nova-api[32017]: 2017-09-28 12:26:36.304 32017 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:26:36 ctl02 nova-api[32017]: 2017-09-28 12:26:36.304 32017 ERROR nova     sys.exit(main())
Sep 28 12:26:36 ctl02 nova-api[32017]: 2017-09-28 12:26:36.304 32017 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:26:36 ctl02 nova-api[32017]: 2017-09-28 12:26:36.304 32017 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:26:36 ctl02 nova-api[32017]: 2017-09-28 12:26:36.304 32017 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:26:36 ctl02 nova-api[32017]: 2017-09-28 12:26:36.304 32017 ERROR nova     max_url_len=max_url_len)
Sep 28 12:26:36 ctl02 nova-api[32017]: 2017-09-28 12:26:36.304 32017 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:26:36 ctl02 nova-api[32017]: 2017-09-28 12:26:36.304 32017 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:26:36 ctl02 nova-api[32017]: 2017-09-28 12:26:36.304 32017 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:26:36 ctl02 nova-api[32017]: 2017-09-28 12:26:36.304 32017 ERROR nova     sock.listen(backlog)
Sep 28 12:26:36 ctl02 nova-api[32017]: 2017-09-28 12:26:36.304 32017 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:26:36 ctl02 nova-api[32017]: 2017-09-28 12:26:36.304 32017 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:26:36 ctl02 nova-api[32017]: 2017-09-28 12:26:36.304 32017 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:26:36 ctl02 nova-api[32017]: 2017-09-28 12:26:36.304 32017 ERROR nova
Sep 28 12:26:36 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdf5ef921)
Sep 28 12:26:36 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:26:36 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:26:36 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:26:36 ctl02 neutron-server[30536]: 2017-09-28 12:26:36.468 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 1 dead agents out of 2:
Sep 28 12:26:36 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:26:36 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:23:57 cmp001
Sep 28 12:26:36 ctl02 heat-api[13008]: 2017-09-28 12:26:36.564 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:26:36] "OPTIONS / HTTP/1.0" 200 134 0.000617
Sep 28 12:26:36 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:26:36 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:26:36 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:26:36 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:26:37 ctl02 heat-api-cfn[13300]: 2017-09-28 12:26:37.010 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:26:37] "OPTIONS / HTTP/1.0" 200 134 0.000443
Sep 28 12:26:37 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdf5ef921)
Sep 28 12:26:38 ctl02 nova-api[32035]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:26:38 ctl02 nova-api[32035]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:26:38 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdf5ef921)
Sep 28 12:26:38 ctl02 nova-api[32035]: 2017-09-28 12:26:38.476 32035 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:26:38 ctl02 nova-api[32035]: 2017-09-28 12:26:38.478 32035 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:26:38 ctl02 nova-api[32035]: 2017-09-28 12:26:38.478 32035 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:26:38 ctl02 nova-api[32035]: 2017-09-28 12:26:38.478 32035 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:26:38 ctl02 nova-api[32035]: 2017-09-28 12:26:38.478 32035 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:26:38 ctl02 nova-api[32035]: 2017-09-28 12:26:38.478 32035 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:26:38 ctl02 nova-api[32035]: 2017-09-28 12:26:38.478 32035 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:26:38 ctl02 nova-api[32035]: 2017-09-28 12:26:38.478 32035 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:26:38 ctl02 nova-api[32035]: 2017-09-28 12:26:38.478 32035 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:26:38 ctl02 nova-api[32035]: 2017-09-28 12:26:38.478 32035 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:26:38 ctl02 nova-api[32035]: 2017-09-28 12:26:38.478 32035 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:26:38 ctl02 nova-api[32035]: 2017-09-28 12:26:38.478 32035 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:26:38 ctl02 nova-api[32035]: 2017-09-28 12:26:38.478 32035 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:26:38 ctl02 nova-api[32035]: 2017-09-28 12:26:38.478 32035 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:26:38 ctl02 nova-api[32035]: 2017-09-28 12:26:38.478 32035 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:26:38 ctl02 nova-api[32035]: 2017-09-28 12:26:38.478 32035 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:26:38 ctl02 nova-api[32035]: 2017-09-28 12:26:38.478 32035 ERROR nova.wsgi     self.filename))
Sep 28 12:26:38 ctl02 nova-api[32035]: 2017-09-28 12:26:38.478 32035 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:26:38 ctl02 nova-api[32035]: 2017-09-28 12:26:38.478 32035 ERROR nova.wsgi
Sep 28 12:26:38 ctl02 nova-api[32035]: 2017-09-28 12:26:38.479 32035 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:26:38 ctl02 nova-api[32035]: 2017-09-28 12:26:38.607 32035 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:26:38 ctl02 heat-api[13008]: 2017-09-28 12:26:38.634 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:26:38] "OPTIONS / HTTP/1.0" 200 134 0.000506
Sep 28 12:26:38 ctl02 nova-api[32035]: 2017-09-28 12:26:38.836 32035 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:26:38 ctl02 nova-api[32035]: 2017-09-28 12:26:38.838 32035 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:26:38 ctl02 nova-api[32035]: 2017-09-28 12:26:38.838 32035 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:26:38 ctl02 nova-api[32035]: 2017-09-28 12:26:38.838 32035 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:26:38 ctl02 nova-api[32035]: 2017-09-28 12:26:38.970 32035 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:26:38 ctl02 nova-api[32035]: 2017-09-28 12:26:38.971 32035 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:26:38 ctl02 nova-api[32035]: 2017-09-28 12:26:38.972 32035 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:26:38 ctl02 nova-api[32035]: 2017-09-28 12:26:38.972 32035 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:26:38 ctl02 nova-api[32035]: 2017-09-28 12:26:38.975 32035 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:26:38 ctl02 nova-api[32035]: 2017-09-28 12:26:38.975 32035 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:26:38 ctl02 nova-api[32035]: 2017-09-28 12:26:38.975 32035 ERROR nova Traceback (most recent call last):
Sep 28 12:26:38 ctl02 nova-api[32035]: 2017-09-28 12:26:38.975 32035 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:26:38 ctl02 nova-api[32035]: 2017-09-28 12:26:38.975 32035 ERROR nova     sys.exit(main())
Sep 28 12:26:38 ctl02 nova-api[32035]: 2017-09-28 12:26:38.975 32035 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:26:38 ctl02 nova-api[32035]: 2017-09-28 12:26:38.975 32035 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:26:38 ctl02 nova-api[32035]: 2017-09-28 12:26:38.975 32035 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:26:38 ctl02 nova-api[32035]: 2017-09-28 12:26:38.975 32035 ERROR nova     max_url_len=max_url_len)
Sep 28 12:26:38 ctl02 nova-api[32035]: 2017-09-28 12:26:38.975 32035 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:26:38 ctl02 nova-api[32035]: 2017-09-28 12:26:38.975 32035 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:26:38 ctl02 nova-api[32035]: 2017-09-28 12:26:38.975 32035 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:26:38 ctl02 nova-api[32035]: 2017-09-28 12:26:38.975 32035 ERROR nova     sock.listen(backlog)
Sep 28 12:26:38 ctl02 nova-api[32035]: 2017-09-28 12:26:38.975 32035 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:26:38 ctl02 nova-api[32035]: 2017-09-28 12:26:38.975 32035 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:26:38 ctl02 nova-api[32035]: 2017-09-28 12:26:38.975 32035 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:26:38 ctl02 nova-api[32035]: 2017-09-28 12:26:38.975 32035 ERROR nova
Sep 28 12:26:39 ctl02 heat-api-cfn[13300]: 2017-09-28 12:26:39.003 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:26:39] "OPTIONS / HTTP/1.0" 200 134 0.000481
Sep 28 12:26:39 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:26:39.093 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:26:39] "OPTIONS / HTTP/1.0" 200 134 0.000420
Sep 28 12:26:39 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:26:39 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:26:39 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:26:39 ctl02 heat-api-cfn[13300]: 2017-09-28 12:26:39.155 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:26:39] "OPTIONS / HTTP/1.0" 200 134 0.000462
Sep 28 12:26:39 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:26:39 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:26:39 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:26:39 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:26:39 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:26:39 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:26:39 ctl02 neutron-server[30536]: 2017-09-28 12:26:39.638 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:26:39] "OPTIONS / HTTP/1.0" 200 262 0.000491
Sep 28 12:26:40 ctl02 glance-api[29183]: 2017-09-28 12:26:40.306 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:26:40] "OPTIONS / HTTP/1.0" 200 134 0.000584
Sep 28 12:26:41 ctl02 nova-api[32053]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:26:41 ctl02 nova-api[32053]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:26:41 ctl02 nova-api[32053]: 2017-09-28 12:26:41.277 32053 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:26:41 ctl02 nova-api[32053]: 2017-09-28 12:26:41.279 32053 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:26:41 ctl02 nova-api[32053]: 2017-09-28 12:26:41.279 32053 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:26:41 ctl02 nova-api[32053]: 2017-09-28 12:26:41.279 32053 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:26:41 ctl02 nova-api[32053]: 2017-09-28 12:26:41.279 32053 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:26:41 ctl02 nova-api[32053]: 2017-09-28 12:26:41.279 32053 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:26:41 ctl02 nova-api[32053]: 2017-09-28 12:26:41.279 32053 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:26:41 ctl02 nova-api[32053]: 2017-09-28 12:26:41.279 32053 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:26:41 ctl02 nova-api[32053]: 2017-09-28 12:26:41.279 32053 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:26:41 ctl02 nova-api[32053]: 2017-09-28 12:26:41.279 32053 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:26:41 ctl02 nova-api[32053]: 2017-09-28 12:26:41.279 32053 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:26:41 ctl02 nova-api[32053]: 2017-09-28 12:26:41.279 32053 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:26:41 ctl02 nova-api[32053]: 2017-09-28 12:26:41.279 32053 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:26:41 ctl02 nova-api[32053]: 2017-09-28 12:26:41.279 32053 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:26:41 ctl02 nova-api[32053]: 2017-09-28 12:26:41.279 32053 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:26:41 ctl02 nova-api[32053]: 2017-09-28 12:26:41.279 32053 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:26:41 ctl02 nova-api[32053]: 2017-09-28 12:26:41.279 32053 ERROR nova.wsgi     self.filename))
Sep 28 12:26:41 ctl02 nova-api[32053]: 2017-09-28 12:26:41.279 32053 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:26:41 ctl02 nova-api[32053]: 2017-09-28 12:26:41.279 32053 ERROR nova.wsgi
Sep 28 12:26:41 ctl02 nova-api[32053]: 2017-09-28 12:26:41.282 32053 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:26:41 ctl02 nova-api[32053]: 2017-09-28 12:26:41.418 32053 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:26:41 ctl02 neutron-server[30536]: 2017-09-28 12:26:41.473 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:26:41] "OPTIONS / HTTP/1.0" 200 262 0.000655
Sep 28 12:26:41 ctl02 nova-api[32053]: 2017-09-28 12:26:41.671 32053 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:26:41 ctl02 nova-api[32053]: 2017-09-28 12:26:41.673 32053 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:26:41 ctl02 nova-api[32053]: 2017-09-28 12:26:41.673 32053 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:26:41 ctl02 nova-api[32053]: 2017-09-28 12:26:41.673 32053 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:26:41 ctl02 neutron-server[30536]: 2017-09-28 12:26:41.746 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:26:41] "OPTIONS / HTTP/1.0" 200 262 0.000411
Sep 28 12:26:41 ctl02 nova-api[32053]: 2017-09-28 12:26:41.812 32053 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:26:41 ctl02 nova-api[32053]: 2017-09-28 12:26:41.814 32053 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:26:41 ctl02 nova-api[32053]: 2017-09-28 12:26:41.814 32053 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:26:41 ctl02 nova-api[32053]: 2017-09-28 12:26:41.814 32053 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:26:41 ctl02 nova-api[32053]: 2017-09-28 12:26:41.818 32053 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:26:41 ctl02 nova-api[32053]: 2017-09-28 12:26:41.818 32053 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:26:41 ctl02 nova-api[32053]: 2017-09-28 12:26:41.818 32053 ERROR nova Traceback (most recent call last):
Sep 28 12:26:41 ctl02 nova-api[32053]: 2017-09-28 12:26:41.818 32053 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:26:41 ctl02 nova-api[32053]: 2017-09-28 12:26:41.818 32053 ERROR nova     sys.exit(main())
Sep 28 12:26:41 ctl02 nova-api[32053]: 2017-09-28 12:26:41.818 32053 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:26:41 ctl02 nova-api[32053]: 2017-09-28 12:26:41.818 32053 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:26:41 ctl02 nova-api[32053]: 2017-09-28 12:26:41.818 32053 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:26:41 ctl02 nova-api[32053]: 2017-09-28 12:26:41.818 32053 ERROR nova     max_url_len=max_url_len)
Sep 28 12:26:41 ctl02 nova-api[32053]: 2017-09-28 12:26:41.818 32053 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:26:41 ctl02 nova-api[32053]: 2017-09-28 12:26:41.818 32053 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:26:41 ctl02 nova-api[32053]: 2017-09-28 12:26:41.818 32053 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:26:41 ctl02 nova-api[32053]: 2017-09-28 12:26:41.818 32053 ERROR nova     sock.listen(backlog)
Sep 28 12:26:41 ctl02 nova-api[32053]: 2017-09-28 12:26:41.818 32053 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:26:41 ctl02 nova-api[32053]: 2017-09-28 12:26:41.818 32053 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:26:41 ctl02 nova-api[32053]: 2017-09-28 12:26:41.818 32053 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:26:41 ctl02 nova-api[32053]: 2017-09-28 12:26:41.818 32053 ERROR nova
Sep 28 12:26:41 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:26:41 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:26:41 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:26:42 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:26:42 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:26:42 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:26:42 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:26:42 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:26:42.628 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:26:42] "OPTIONS / HTTP/1.0" 200 134 0.000477
Sep 28 12:26:43 ctl02 neutron-server[30536]: 2017-09-28 12:26:43.478 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:26:43 ctl02 glance-api[29183]: 2017-09-28 12:26:43.577 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:26:43] "OPTIONS / HTTP/1.0" 200 134 0.000720
Sep 28 12:26:43 ctl02 nova-api[32074]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:26:43 ctl02 nova-api[32074]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:26:43 ctl02 glance-api[29183]: 2017-09-28 12:26:43.968 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:26:43] "OPTIONS / HTTP/1.0" 200 134 0.000648
Sep 28 12:26:44 ctl02 nova-api[32074]: 2017-09-28 12:26:44.035 32074 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:26:44 ctl02 nova-api[32074]: 2017-09-28 12:26:44.037 32074 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:26:44 ctl02 nova-api[32074]: 2017-09-28 12:26:44.037 32074 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:26:44 ctl02 nova-api[32074]: 2017-09-28 12:26:44.037 32074 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:26:44 ctl02 nova-api[32074]: 2017-09-28 12:26:44.037 32074 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:26:44 ctl02 nova-api[32074]: 2017-09-28 12:26:44.037 32074 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:26:44 ctl02 nova-api[32074]: 2017-09-28 12:26:44.037 32074 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:26:44 ctl02 nova-api[32074]: 2017-09-28 12:26:44.037 32074 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:26:44 ctl02 nova-api[32074]: 2017-09-28 12:26:44.037 32074 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:26:44 ctl02 nova-api[32074]: 2017-09-28 12:26:44.037 32074 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:26:44 ctl02 nova-api[32074]: 2017-09-28 12:26:44.037 32074 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:26:44 ctl02 nova-api[32074]: 2017-09-28 12:26:44.037 32074 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:26:44 ctl02 nova-api[32074]: 2017-09-28 12:26:44.037 32074 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:26:44 ctl02 nova-api[32074]: 2017-09-28 12:26:44.037 32074 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:26:44 ctl02 nova-api[32074]: 2017-09-28 12:26:44.037 32074 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:26:44 ctl02 nova-api[32074]: 2017-09-28 12:26:44.037 32074 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:26:44 ctl02 nova-api[32074]: 2017-09-28 12:26:44.037 32074 ERROR nova.wsgi     self.filename))
Sep 28 12:26:44 ctl02 nova-api[32074]: 2017-09-28 12:26:44.037 32074 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:26:44 ctl02 nova-api[32074]: 2017-09-28 12:26:44.037 32074 ERROR nova.wsgi
Sep 28 12:26:44 ctl02 nova-api[32074]: 2017-09-28 12:26:44.038 32074 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:26:44 ctl02 nova-api[32074]: 2017-09-28 12:26:44.165 32074 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:26:44 ctl02 nova-api[32074]: 2017-09-28 12:26:44.398 32074 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:26:44 ctl02 nova-api[32074]: 2017-09-28 12:26:44.400 32074 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:26:44 ctl02 nova-api[32074]: 2017-09-28 12:26:44.400 32074 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:26:44 ctl02 nova-api[32074]: 2017-09-28 12:26:44.400 32074 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:26:44 ctl02 nova-api[32074]: 2017-09-28 12:26:44.534 32074 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:26:44 ctl02 nova-api[32074]: 2017-09-28 12:26:44.536 32074 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:26:44 ctl02 nova-api[32074]: 2017-09-28 12:26:44.536 32074 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:26:44 ctl02 nova-api[32074]: 2017-09-28 12:26:44.537 32074 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:26:44 ctl02 nova-api[32074]: 2017-09-28 12:26:44.540 32074 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:26:44 ctl02 nova-api[32074]: 2017-09-28 12:26:44.540 32074 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:26:44 ctl02 nova-api[32074]: 2017-09-28 12:26:44.540 32074 ERROR nova Traceback (most recent call last):
Sep 28 12:26:44 ctl02 nova-api[32074]: 2017-09-28 12:26:44.540 32074 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:26:44 ctl02 nova-api[32074]: 2017-09-28 12:26:44.540 32074 ERROR nova     sys.exit(main())
Sep 28 12:26:44 ctl02 nova-api[32074]: 2017-09-28 12:26:44.540 32074 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:26:44 ctl02 nova-api[32074]: 2017-09-28 12:26:44.540 32074 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:26:44 ctl02 nova-api[32074]: 2017-09-28 12:26:44.540 32074 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:26:44 ctl02 nova-api[32074]: 2017-09-28 12:26:44.540 32074 ERROR nova     max_url_len=max_url_len)
Sep 28 12:26:44 ctl02 nova-api[32074]: 2017-09-28 12:26:44.540 32074 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:26:44 ctl02 nova-api[32074]: 2017-09-28 12:26:44.540 32074 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:26:44 ctl02 nova-api[32074]: 2017-09-28 12:26:44.540 32074 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:26:44 ctl02 nova-api[32074]: 2017-09-28 12:26:44.540 32074 ERROR nova     sock.listen(backlog)
Sep 28 12:26:44 ctl02 nova-api[32074]: 2017-09-28 12:26:44.540 32074 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:26:44 ctl02 nova-api[32074]: 2017-09-28 12:26:44.540 32074 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:26:44 ctl02 nova-api[32074]: 2017-09-28 12:26:44.540 32074 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:26:44 ctl02 nova-api[32074]: 2017-09-28 12:26:44.540 32074 ERROR nova
Sep 28 12:26:44 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:26:44 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:26:44 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:26:44 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:26:44 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:26:44 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:26:44 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:26:45 ctl02 heat-api[13008]: 2017-09-28 12:26:45.379 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:26:45] "OPTIONS / HTTP/1.0" 200 134 0.000617
Sep 28 12:26:45 ctl02 nova-cert[4860]: 2017-09-28 12:26:45.513 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:26:45 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:26:45.583 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:26:45] "OPTIONS / HTTP/1.0" 200 134 0.000447
Sep 28 12:26:46 ctl02 nova-api[32094]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:26:46 ctl02 nova-api[32094]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:26:46 ctl02 heat-api-cfn[13300]: 2017-09-28 12:26:46.625 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:26:46] "OPTIONS / HTTP/1.0" 200 134 0.000519
Sep 28 12:26:46 ctl02 nova-conductor[5056]: 2017-09-28 12:26:46.677 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:26:46 ctl02 nova-conductor[5056]: 2017-09-28 12:26:46.690 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:26:46 ctl02 nova-conductor[5056]: 2017-09-28 12:26:46.710 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:26:46 ctl02 nova-conductor[5056]: 2017-09-28 12:26:46.721 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:26:46 ctl02 heat-api[13008]: 2017-09-28 12:26:46.757 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:26:46] "OPTIONS / HTTP/1.0" 200 134 0.000609
Sep 28 12:26:46 ctl02 nova-api[32094]: 2017-09-28 12:26:46.791 32094 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:26:46 ctl02 nova-api[32094]: 2017-09-28 12:26:46.793 32094 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:26:46 ctl02 nova-api[32094]: 2017-09-28 12:26:46.793 32094 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:26:46 ctl02 nova-api[32094]: 2017-09-28 12:26:46.793 32094 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:26:46 ctl02 nova-api[32094]: 2017-09-28 12:26:46.793 32094 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:26:46 ctl02 nova-api[32094]: 2017-09-28 12:26:46.793 32094 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:26:46 ctl02 nova-api[32094]: 2017-09-28 12:26:46.793 32094 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:26:46 ctl02 nova-api[32094]: 2017-09-28 12:26:46.793 32094 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:26:46 ctl02 nova-api[32094]: 2017-09-28 12:26:46.793 32094 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:26:46 ctl02 nova-api[32094]: 2017-09-28 12:26:46.793 32094 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:26:46 ctl02 nova-api[32094]: 2017-09-28 12:26:46.793 32094 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:26:46 ctl02 nova-api[32094]: 2017-09-28 12:26:46.793 32094 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:26:46 ctl02 nova-api[32094]: 2017-09-28 12:26:46.793 32094 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:26:46 ctl02 nova-api[32094]: 2017-09-28 12:26:46.793 32094 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:26:46 ctl02 nova-api[32094]: 2017-09-28 12:26:46.793 32094 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:26:46 ctl02 nova-api[32094]: 2017-09-28 12:26:46.793 32094 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:26:46 ctl02 nova-api[32094]: 2017-09-28 12:26:46.793 32094 ERROR nova.wsgi     self.filename))
Sep 28 12:26:46 ctl02 nova-api[32094]: 2017-09-28 12:26:46.793 32094 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:26:46 ctl02 nova-api[32094]: 2017-09-28 12:26:46.793 32094 ERROR nova.wsgi
Sep 28 12:26:46 ctl02 nova-api[32094]: 2017-09-28 12:26:46.795 32094 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:26:46 ctl02 nova-api[32094]: 2017-09-28 12:26:46.925 32094 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:26:47 ctl02 nova-api[32094]: 2017-09-28 12:26:47.168 32094 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:26:47 ctl02 nova-api[32094]: 2017-09-28 12:26:47.170 32094 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:26:47 ctl02 nova-api[32094]: 2017-09-28 12:26:47.170 32094 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:26:47 ctl02 nova-api[32094]: 2017-09-28 12:26:47.171 32094 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:26:47 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5b5b2c33)
Sep 28 12:26:47 ctl02 nova-api[32094]: 2017-09-28 12:26:47.301 32094 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:26:47 ctl02 nova-api[32094]: 2017-09-28 12:26:47.303 32094 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:26:47 ctl02 nova-api[32094]: 2017-09-28 12:26:47.303 32094 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:26:47 ctl02 nova-api[32094]: 2017-09-28 12:26:47.304 32094 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:26:47 ctl02 nova-api[32094]: 2017-09-28 12:26:47.307 32094 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:26:47 ctl02 nova-api[32094]: 2017-09-28 12:26:47.307 32094 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:26:47 ctl02 nova-api[32094]: 2017-09-28 12:26:47.307 32094 ERROR nova Traceback (most recent call last):
Sep 28 12:26:47 ctl02 nova-api[32094]: 2017-09-28 12:26:47.307 32094 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:26:47 ctl02 nova-api[32094]: 2017-09-28 12:26:47.307 32094 ERROR nova     sys.exit(main())
Sep 28 12:26:47 ctl02 nova-api[32094]: 2017-09-28 12:26:47.307 32094 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:26:47 ctl02 nova-api[32094]: 2017-09-28 12:26:47.307 32094 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:26:47 ctl02 nova-api[32094]: 2017-09-28 12:26:47.307 32094 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:26:47 ctl02 nova-api[32094]: 2017-09-28 12:26:47.307 32094 ERROR nova     max_url_len=max_url_len)
Sep 28 12:26:47 ctl02 nova-api[32094]: 2017-09-28 12:26:47.307 32094 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:26:47 ctl02 nova-api[32094]: 2017-09-28 12:26:47.307 32094 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:26:47 ctl02 nova-api[32094]: 2017-09-28 12:26:47.307 32094 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:26:47 ctl02 nova-api[32094]: 2017-09-28 12:26:47.307 32094 ERROR nova     sock.listen(backlog)
Sep 28 12:26:47 ctl02 nova-api[32094]: 2017-09-28 12:26:47.307 32094 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:26:47 ctl02 nova-api[32094]: 2017-09-28 12:26:47.307 32094 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:26:47 ctl02 nova-api[32094]: 2017-09-28 12:26:47.307 32094 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:26:47 ctl02 nova-api[32094]: 2017-09-28 12:26:47.307 32094 ERROR nova
Sep 28 12:26:47 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:26:47 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:26:47 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:26:47 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:26:47 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:26:47 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:26:47 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:26:48 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5b5b2c33)
Sep 28 12:26:48 ctl02 heat-api[13008]: 2017-09-28 12:26:48.699 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:26:48] "OPTIONS / HTTP/1.0" 200 134 0.000514
Sep 28 12:26:48 ctl02 heat-api-cfn[13300]: 2017-09-28 12:26:48.914 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:26:48] "OPTIONS / HTTP/1.0" 200 134 0.000443
Sep 28 12:26:49 ctl02 heat-api-cfn[13300]: 2017-09-28 12:26:49.110 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:26:49] "OPTIONS / HTTP/1.0" 200 134 0.000289
Sep 28 12:26:49 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5b5b2c33)
Sep 28 12:26:49 ctl02 nova-api[32111]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:26:49 ctl02 nova-api[32111]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:26:49 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:26:49.307 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:26:49] "OPTIONS / HTTP/1.0" 200 134 0.000417
Sep 28 12:26:49 ctl02 nova-api[32111]: 2017-09-28 12:26:49.476 32111 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:26:49 ctl02 nova-api[32111]: 2017-09-28 12:26:49.477 32111 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:26:49 ctl02 nova-api[32111]: 2017-09-28 12:26:49.477 32111 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:26:49 ctl02 nova-api[32111]: 2017-09-28 12:26:49.477 32111 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:26:49 ctl02 nova-api[32111]: 2017-09-28 12:26:49.477 32111 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:26:49 ctl02 nova-api[32111]: 2017-09-28 12:26:49.477 32111 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:26:49 ctl02 nova-api[32111]: 2017-09-28 12:26:49.477 32111 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:26:49 ctl02 nova-api[32111]: 2017-09-28 12:26:49.477 32111 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:26:49 ctl02 nova-api[32111]: 2017-09-28 12:26:49.477 32111 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:26:49 ctl02 nova-api[32111]: 2017-09-28 12:26:49.477 32111 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:26:49 ctl02 nova-api[32111]: 2017-09-28 12:26:49.477 32111 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:26:49 ctl02 nova-api[32111]: 2017-09-28 12:26:49.477 32111 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:26:49 ctl02 nova-api[32111]: 2017-09-28 12:26:49.477 32111 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:26:49 ctl02 nova-api[32111]: 2017-09-28 12:26:49.477 32111 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:26:49 ctl02 nova-api[32111]: 2017-09-28 12:26:49.477 32111 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:26:49 ctl02 nova-api[32111]: 2017-09-28 12:26:49.477 32111 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:26:49 ctl02 nova-api[32111]: 2017-09-28 12:26:49.477 32111 ERROR nova.wsgi     self.filename))
Sep 28 12:26:49 ctl02 nova-api[32111]: 2017-09-28 12:26:49.477 32111 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:26:49 ctl02 nova-api[32111]: 2017-09-28 12:26:49.477 32111 ERROR nova.wsgi
Sep 28 12:26:49 ctl02 nova-api[32111]: 2017-09-28 12:26:49.478 32111 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:26:49 ctl02 neutron-server[30536]: 2017-09-28 12:26:49.528 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:26:49] "OPTIONS / HTTP/1.0" 200 262 0.000518
Sep 28 12:26:49 ctl02 nova-api[32111]: 2017-09-28 12:26:49.609 32111 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:26:49 ctl02 nova-api[32111]: 2017-09-28 12:26:49.836 32111 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:26:49 ctl02 nova-api[32111]: 2017-09-28 12:26:49.838 32111 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:26:49 ctl02 nova-api[32111]: 2017-09-28 12:26:49.839 32111 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:26:49 ctl02 nova-api[32111]: 2017-09-28 12:26:49.839 32111 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:26:49 ctl02 nova-api[32111]: 2017-09-28 12:26:49.970 32111 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:26:49 ctl02 nova-api[32111]: 2017-09-28 12:26:49.973 32111 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:26:49 ctl02 nova-api[32111]: 2017-09-28 12:26:49.973 32111 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:26:49 ctl02 nova-api[32111]: 2017-09-28 12:26:49.973 32111 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:26:49 ctl02 nova-api[32111]: 2017-09-28 12:26:49.977 32111 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:26:49 ctl02 nova-api[32111]: 2017-09-28 12:26:49.977 32111 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:26:49 ctl02 nova-api[32111]: 2017-09-28 12:26:49.977 32111 ERROR nova Traceback (most recent call last):
Sep 28 12:26:49 ctl02 nova-api[32111]: 2017-09-28 12:26:49.977 32111 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:26:49 ctl02 nova-api[32111]: 2017-09-28 12:26:49.977 32111 ERROR nova     sys.exit(main())
Sep 28 12:26:49 ctl02 nova-api[32111]: 2017-09-28 12:26:49.977 32111 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:26:49 ctl02 nova-api[32111]: 2017-09-28 12:26:49.977 32111 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:26:49 ctl02 nova-api[32111]: 2017-09-28 12:26:49.977 32111 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:26:49 ctl02 nova-api[32111]: 2017-09-28 12:26:49.977 32111 ERROR nova     max_url_len=max_url_len)
Sep 28 12:26:49 ctl02 nova-api[32111]: 2017-09-28 12:26:49.977 32111 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:26:49 ctl02 nova-api[32111]: 2017-09-28 12:26:49.977 32111 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:26:49 ctl02 nova-api[32111]: 2017-09-28 12:26:49.977 32111 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:26:49 ctl02 nova-api[32111]: 2017-09-28 12:26:49.977 32111 ERROR nova     sock.listen(backlog)
Sep 28 12:26:49 ctl02 nova-api[32111]: 2017-09-28 12:26:49.977 32111 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:26:49 ctl02 nova-api[32111]: 2017-09-28 12:26:49.977 32111 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:26:49 ctl02 nova-api[32111]: 2017-09-28 12:26:49.977 32111 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:26:49 ctl02 nova-api[32111]: 2017-09-28 12:26:49.977 32111 ERROR nova
Sep 28 12:26:50 ctl02 glance-api[29183]: 2017-09-28 12:26:50.092 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:26:50] "OPTIONS / HTTP/1.0" 200 134 0.000572
Sep 28 12:26:50 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:26:50 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:26:50 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:26:50 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5b5b2c33)
Sep 28 12:26:50 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:26:50 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:26:50 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:26:50 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:26:51 ctl02 neutron-server[30536]: 2017-09-28 12:26:51.272 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:26:51] "OPTIONS / HTTP/1.0" 200 262 0.000455
Sep 28 12:26:51 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5b5b2c33)
Sep 28 12:26:51 ctl02 neutron-server[30536]: 2017-09-28 12:26:51.464 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 1 dead agents out of 2:
Sep 28 12:26:51 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:26:51 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:23:57 cmp001
Sep 28 12:26:51 ctl02 neutron-server[30536]: 2017-09-28 12:26:51.561 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:26:51] "OPTIONS / HTTP/1.0" 200 262 0.000457
Sep 28 12:26:52 ctl02 nova-api[32131]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:26:52 ctl02 nova-api[32131]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:26:52 ctl02 nova-api[32131]: 2017-09-28 12:26:52.219 32131 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:26:52 ctl02 nova-api[32131]: 2017-09-28 12:26:52.220 32131 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:26:52 ctl02 nova-api[32131]: 2017-09-28 12:26:52.220 32131 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:26:52 ctl02 nova-api[32131]: 2017-09-28 12:26:52.220 32131 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:26:52 ctl02 nova-api[32131]: 2017-09-28 12:26:52.220 32131 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:26:52 ctl02 nova-api[32131]: 2017-09-28 12:26:52.220 32131 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:26:52 ctl02 nova-api[32131]: 2017-09-28 12:26:52.220 32131 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:26:52 ctl02 nova-api[32131]: 2017-09-28 12:26:52.220 32131 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:26:52 ctl02 nova-api[32131]: 2017-09-28 12:26:52.220 32131 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:26:52 ctl02 nova-api[32131]: 2017-09-28 12:26:52.220 32131 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:26:52 ctl02 nova-api[32131]: 2017-09-28 12:26:52.220 32131 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:26:52 ctl02 nova-api[32131]: 2017-09-28 12:26:52.220 32131 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:26:52 ctl02 nova-api[32131]: 2017-09-28 12:26:52.220 32131 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:26:52 ctl02 nova-api[32131]: 2017-09-28 12:26:52.220 32131 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:26:52 ctl02 nova-api[32131]: 2017-09-28 12:26:52.220 32131 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:26:52 ctl02 nova-api[32131]: 2017-09-28 12:26:52.220 32131 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:26:52 ctl02 nova-api[32131]: 2017-09-28 12:26:52.220 32131 ERROR nova.wsgi     self.filename))
Sep 28 12:26:52 ctl02 nova-api[32131]: 2017-09-28 12:26:52.220 32131 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:26:52 ctl02 nova-api[32131]: 2017-09-28 12:26:52.220 32131 ERROR nova.wsgi
Sep 28 12:26:52 ctl02 nova-api[32131]: 2017-09-28 12:26:52.221 32131 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:26:52 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5b5b2c33)
Sep 28 12:26:52 ctl02 nova-api[32131]: 2017-09-28 12:26:52.348 32131 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:26:52 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:26:52.511 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:26:52] "OPTIONS / HTTP/1.0" 200 134 0.000533
Sep 28 12:26:52 ctl02 nova-api[32131]: 2017-09-28 12:26:52.576 32131 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:26:52 ctl02 nova-api[32131]: 2017-09-28 12:26:52.578 32131 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:26:52 ctl02 nova-api[32131]: 2017-09-28 12:26:52.578 32131 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:26:52 ctl02 nova-api[32131]: 2017-09-28 12:26:52.578 32131 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:26:52 ctl02 nova-api[32131]: 2017-09-28 12:26:52.707 32131 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:26:52 ctl02 nova-api[32131]: 2017-09-28 12:26:52.708 32131 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:26:52 ctl02 nova-api[32131]: 2017-09-28 12:26:52.709 32131 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:26:52 ctl02 nova-api[32131]: 2017-09-28 12:26:52.709 32131 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:26:52 ctl02 nova-api[32131]: 2017-09-28 12:26:52.712 32131 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:26:52 ctl02 nova-api[32131]: 2017-09-28 12:26:52.712 32131 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:26:52 ctl02 nova-api[32131]: 2017-09-28 12:26:52.712 32131 ERROR nova Traceback (most recent call last):
Sep 28 12:26:52 ctl02 nova-api[32131]: 2017-09-28 12:26:52.712 32131 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:26:52 ctl02 nova-api[32131]: 2017-09-28 12:26:52.712 32131 ERROR nova     sys.exit(main())
Sep 28 12:26:52 ctl02 nova-api[32131]: 2017-09-28 12:26:52.712 32131 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:26:52 ctl02 nova-api[32131]: 2017-09-28 12:26:52.712 32131 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:26:52 ctl02 nova-api[32131]: 2017-09-28 12:26:52.712 32131 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:26:52 ctl02 nova-api[32131]: 2017-09-28 12:26:52.712 32131 ERROR nova     max_url_len=max_url_len)
Sep 28 12:26:52 ctl02 nova-api[32131]: 2017-09-28 12:26:52.712 32131 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:26:52 ctl02 nova-api[32131]: 2017-09-28 12:26:52.712 32131 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:26:52 ctl02 nova-api[32131]: 2017-09-28 12:26:52.712 32131 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:26:52 ctl02 nova-api[32131]: 2017-09-28 12:26:52.712 32131 ERROR nova     sock.listen(backlog)
Sep 28 12:26:52 ctl02 nova-api[32131]: 2017-09-28 12:26:52.712 32131 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:26:52 ctl02 nova-api[32131]: 2017-09-28 12:26:52.712 32131 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:26:52 ctl02 nova-api[32131]: 2017-09-28 12:26:52.712 32131 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:26:52 ctl02 nova-api[32131]: 2017-09-28 12:26:52.712 32131 ERROR nova
Sep 28 12:26:52 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:26:52 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:26:52 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:26:53 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:26:53 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:26:53 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:26:53 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:26:53 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5b5b2c33)
Sep 28 12:26:53 ctl02 glance-api[29183]: 2017-09-28 12:26:53.836 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:26:53] "OPTIONS / HTTP/1.0" 200 134 0.000660
Sep 28 12:26:53 ctl02 glance-api[29183]: 2017-09-28 12:26:53.949 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:26:53] "OPTIONS / HTTP/1.0" 200 134 0.000531
Sep 28 12:26:54 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5b5b2c33)
Sep 28 12:26:54 ctl02 nova-api[32149]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:26:54 ctl02 nova-api[32149]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:26:54 ctl02 nova-api[32149]: 2017-09-28 12:26:54.959 32149 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:26:54 ctl02 nova-api[32149]: 2017-09-28 12:26:54.961 32149 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:26:54 ctl02 nova-api[32149]: 2017-09-28 12:26:54.961 32149 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:26:54 ctl02 nova-api[32149]: 2017-09-28 12:26:54.961 32149 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:26:54 ctl02 nova-api[32149]: 2017-09-28 12:26:54.961 32149 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:26:54 ctl02 nova-api[32149]: 2017-09-28 12:26:54.961 32149 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:26:54 ctl02 nova-api[32149]: 2017-09-28 12:26:54.961 32149 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:26:54 ctl02 nova-api[32149]: 2017-09-28 12:26:54.961 32149 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:26:54 ctl02 nova-api[32149]: 2017-09-28 12:26:54.961 32149 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:26:54 ctl02 nova-api[32149]: 2017-09-28 12:26:54.961 32149 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:26:54 ctl02 nova-api[32149]: 2017-09-28 12:26:54.961 32149 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:26:54 ctl02 nova-api[32149]: 2017-09-28 12:26:54.961 32149 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:26:54 ctl02 nova-api[32149]: 2017-09-28 12:26:54.961 32149 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:26:54 ctl02 nova-api[32149]: 2017-09-28 12:26:54.961 32149 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:26:54 ctl02 nova-api[32149]: 2017-09-28 12:26:54.961 32149 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:26:54 ctl02 nova-api[32149]: 2017-09-28 12:26:54.961 32149 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:26:54 ctl02 nova-api[32149]: 2017-09-28 12:26:54.961 32149 ERROR nova.wsgi     self.filename))
Sep 28 12:26:54 ctl02 nova-api[32149]: 2017-09-28 12:26:54.961 32149 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:26:54 ctl02 nova-api[32149]: 2017-09-28 12:26:54.961 32149 ERROR nova.wsgi
Sep 28 12:26:54 ctl02 nova-api[32149]: 2017-09-28 12:26:54.962 32149 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:26:55 ctl02 nova-api[32149]: 2017-09-28 12:26:55.087 32149 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:26:55 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5b5b2c33)
Sep 28 12:26:55 ctl02 nova-api[32149]: 2017-09-28 12:26:55.309 32149 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:26:55 ctl02 nova-api[32149]: 2017-09-28 12:26:55.311 32149 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:26:55 ctl02 nova-api[32149]: 2017-09-28 12:26:55.311 32149 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:26:55 ctl02 nova-api[32149]: 2017-09-28 12:26:55.311 32149 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:26:55 ctl02 nova-consoleauth[5433]: 2017-09-28 12:26:55.403 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:26:55 ctl02 nova-api[32149]: 2017-09-28 12:26:55.442 32149 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:26:55 ctl02 nova-api[32149]: 2017-09-28 12:26:55.444 32149 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:26:55 ctl02 nova-api[32149]: 2017-09-28 12:26:55.444 32149 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:26:55 ctl02 nova-api[32149]: 2017-09-28 12:26:55.444 32149 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:26:55 ctl02 nova-api[32149]: 2017-09-28 12:26:55.448 32149 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:26:55 ctl02 nova-api[32149]: 2017-09-28 12:26:55.448 32149 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:26:55 ctl02 nova-api[32149]: 2017-09-28 12:26:55.448 32149 ERROR nova Traceback (most recent call last):
Sep 28 12:26:55 ctl02 nova-api[32149]: 2017-09-28 12:26:55.448 32149 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:26:55 ctl02 nova-api[32149]: 2017-09-28 12:26:55.448 32149 ERROR nova     sys.exit(main())
Sep 28 12:26:55 ctl02 nova-api[32149]: 2017-09-28 12:26:55.448 32149 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:26:55 ctl02 nova-api[32149]: 2017-09-28 12:26:55.448 32149 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:26:55 ctl02 nova-api[32149]: 2017-09-28 12:26:55.448 32149 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:26:55 ctl02 nova-api[32149]: 2017-09-28 12:26:55.448 32149 ERROR nova     max_url_len=max_url_len)
Sep 28 12:26:55 ctl02 nova-api[32149]: 2017-09-28 12:26:55.448 32149 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:26:55 ctl02 nova-api[32149]: 2017-09-28 12:26:55.448 32149 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:26:55 ctl02 nova-api[32149]: 2017-09-28 12:26:55.448 32149 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:26:55 ctl02 nova-api[32149]: 2017-09-28 12:26:55.448 32149 ERROR nova     sock.listen(backlog)
Sep 28 12:26:55 ctl02 nova-api[32149]: 2017-09-28 12:26:55.448 32149 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:26:55 ctl02 nova-api[32149]: 2017-09-28 12:26:55.448 32149 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:26:55 ctl02 nova-api[32149]: 2017-09-28 12:26:55.448 32149 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:26:55 ctl02 nova-api[32149]: 2017-09-28 12:26:55.448 32149 ERROR nova
Sep 28 12:26:55 ctl02 heat-api[13008]: 2017-09-28 12:26:55.463 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:26:55] "OPTIONS / HTTP/1.0" 200 134 0.000569
Sep 28 12:26:55 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:26:55.490 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:26:55] "OPTIONS / HTTP/1.0" 200 134 0.000461
Sep 28 12:26:55 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:26:55 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:26:55 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:26:55 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:26:55 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:26:55 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:26:55 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:26:56 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5b5b2c33)
Sep 28 12:26:56 ctl02 heat-api-cfn[13300]: 2017-09-28 12:26:56.350 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:26:56] "OPTIONS / HTTP/1.0" 200 134 0.000544
Sep 28 12:26:56 ctl02 heat-api[13008]: 2017-09-28 12:26:56.789 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:26:56] "OPTIONS / HTTP/1.0" 200 134 0.000633
Sep 28 12:26:57 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5b5b2c33)
Sep 28 12:26:57 ctl02 nova-api[32167]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:26:57 ctl02 nova-api[32167]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:26:57 ctl02 nova-api[32167]: 2017-09-28 12:26:57.797 32167 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:26:57 ctl02 heat-engine[12803]: 2017-09-28 12:26:57.800 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:26:57 ctl02 heat-engine[12803]: 2017-09-28 12:26:57.802 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:26:57 ctl02 nova-api[32167]: 2017-09-28 12:26:57.799 32167 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:26:57 ctl02 nova-api[32167]: 2017-09-28 12:26:57.799 32167 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:26:57 ctl02 nova-api[32167]: 2017-09-28 12:26:57.799 32167 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:26:57 ctl02 nova-api[32167]: 2017-09-28 12:26:57.799 32167 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:26:57 ctl02 nova-api[32167]: 2017-09-28 12:26:57.799 32167 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:26:57 ctl02 nova-api[32167]: 2017-09-28 12:26:57.799 32167 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:26:57 ctl02 nova-api[32167]: 2017-09-28 12:26:57.799 32167 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:26:57 ctl02 nova-api[32167]: 2017-09-28 12:26:57.799 32167 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:26:57 ctl02 nova-api[32167]: 2017-09-28 12:26:57.799 32167 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:26:57 ctl02 nova-api[32167]: 2017-09-28 12:26:57.799 32167 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:26:57 ctl02 nova-api[32167]: 2017-09-28 12:26:57.799 32167 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:26:57 ctl02 nova-api[32167]: 2017-09-28 12:26:57.799 32167 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:26:57 ctl02 nova-api[32167]: 2017-09-28 12:26:57.799 32167 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:26:57 ctl02 nova-api[32167]: 2017-09-28 12:26:57.799 32167 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:26:57 ctl02 nova-api[32167]: 2017-09-28 12:26:57.799 32167 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:26:57 ctl02 nova-api[32167]: 2017-09-28 12:26:57.799 32167 ERROR nova.wsgi     self.filename))
Sep 28 12:26:57 ctl02 nova-api[32167]: 2017-09-28 12:26:57.799 32167 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:26:57 ctl02 nova-api[32167]: 2017-09-28 12:26:57.799 32167 ERROR nova.wsgi
Sep 28 12:26:57 ctl02 nova-api[32167]: 2017-09-28 12:26:57.804 32167 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:26:57 ctl02 heat-engine[12803]: 2017-09-28 12:26:57.804 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:26:57 ctl02 heat-engine[12803]: 2017-09-28 12:26:57.810 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:26:57 ctl02 nova-api[32167]: 2017-09-28 12:26:57.938 32167 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:26:58 ctl02 nova-api[32167]: 2017-09-28 12:26:58.182 32167 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:26:58 ctl02 nova-api[32167]: 2017-09-28 12:26:58.184 32167 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:26:58 ctl02 nova-api[32167]: 2017-09-28 12:26:58.184 32167 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:26:58 ctl02 nova-api[32167]: 2017-09-28 12:26:58.184 32167 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:26:58 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:26:58 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:26:58 ctl02 nova-api[32167]: 2017-09-28 12:26:58.316 32167 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:26:58 ctl02 nova-api[32167]: 2017-09-28 12:26:58.318 32167 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:26:58 ctl02 nova-api[32167]: 2017-09-28 12:26:58.318 32167 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:26:58 ctl02 nova-api[32167]: 2017-09-28 12:26:58.318 32167 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:26:58 ctl02 nova-api[32167]: 2017-09-28 12:26:58.322 32167 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:26:58 ctl02 nova-api[32167]: 2017-09-28 12:26:58.322 32167 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:26:58 ctl02 nova-api[32167]: 2017-09-28 12:26:58.322 32167 ERROR nova Traceback (most recent call last):
Sep 28 12:26:58 ctl02 nova-api[32167]: 2017-09-28 12:26:58.322 32167 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:26:58 ctl02 nova-api[32167]: 2017-09-28 12:26:58.322 32167 ERROR nova     sys.exit(main())
Sep 28 12:26:58 ctl02 nova-api[32167]: 2017-09-28 12:26:58.322 32167 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:26:58 ctl02 nova-api[32167]: 2017-09-28 12:26:58.322 32167 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:26:58 ctl02 nova-api[32167]: 2017-09-28 12:26:58.322 32167 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:26:58 ctl02 nova-api[32167]: 2017-09-28 12:26:58.322 32167 ERROR nova     max_url_len=max_url_len)
Sep 28 12:26:58 ctl02 nova-api[32167]: 2017-09-28 12:26:58.322 32167 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:26:58 ctl02 nova-api[32167]: 2017-09-28 12:26:58.322 32167 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:26:58 ctl02 nova-api[32167]: 2017-09-28 12:26:58.322 32167 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:26:58 ctl02 nova-api[32167]: 2017-09-28 12:26:58.322 32167 ERROR nova     sock.listen(backlog)
Sep 28 12:26:58 ctl02 nova-api[32167]: 2017-09-28 12:26:58.322 32167 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:26:58 ctl02 nova-api[32167]: 2017-09-28 12:26:58.322 32167 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:26:58 ctl02 nova-api[32167]: 2017-09-28 12:26:58.322 32167 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:26:58 ctl02 nova-api[32167]: 2017-09-28 12:26:58.322 32167 ERROR nova
Sep 28 12:26:58 ctl02 nova-scheduler[5620]: 2017-09-28 12:26:58.421 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:26:58 ctl02 neutron-server[30536]: 2017-09-28 12:26:58.481 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:26:58 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:26:58 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:26:58 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:26:58 ctl02 heat-api-cfn[13300]: 2017-09-28 12:26:58.623 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:26:58] "OPTIONS / HTTP/1.0" 200 134 0.000555
Sep 28 12:26:58 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:26:58 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:26:58 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:26:58 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:26:58 ctl02 heat-api[13008]: 2017-09-28 12:26:58.698 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:26:58] "OPTIONS / HTTP/1.0" 200 134 0.000626
Sep 28 12:26:58 ctl02 heat-api-cfn[13300]: 2017-09-28 12:26:58.842 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:26:58] "OPTIONS / HTTP/1.0" 200 134 0.000528
Sep 28 12:26:59 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:26:59.086 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:26:59] "OPTIONS / HTTP/1.0" 200 134 0.000445
Sep 28 12:26:59 ctl02 neutron-server[30536]: 2017-09-28 12:26:59.189 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:26:59] "OPTIONS / HTTP/1.0" 200 262 0.000494
Sep 28 12:27:00 ctl02 glance-api[29183]: 2017-09-28 12:27:00.276 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:27:00] "OPTIONS / HTTP/1.0" 200 134 0.000683
Sep 28 12:27:00 ctl02 nova-api[32190]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:27:00 ctl02 nova-api[32190]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:27:00 ctl02 nova-api[32190]: 2017-09-28 12:27:00.534 32190 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:27:00 ctl02 nova-api[32190]: 2017-09-28 12:27:00.536 32190 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:27:00 ctl02 nova-api[32190]: 2017-09-28 12:27:00.536 32190 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:27:00 ctl02 nova-api[32190]: 2017-09-28 12:27:00.536 32190 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:27:00 ctl02 nova-api[32190]: 2017-09-28 12:27:00.536 32190 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:27:00 ctl02 nova-api[32190]: 2017-09-28 12:27:00.536 32190 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:27:00 ctl02 nova-api[32190]: 2017-09-28 12:27:00.536 32190 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:27:00 ctl02 nova-api[32190]: 2017-09-28 12:27:00.536 32190 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:27:00 ctl02 nova-api[32190]: 2017-09-28 12:27:00.536 32190 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:27:00 ctl02 nova-api[32190]: 2017-09-28 12:27:00.536 32190 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:27:00 ctl02 nova-api[32190]: 2017-09-28 12:27:00.536 32190 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:27:00 ctl02 nova-api[32190]: 2017-09-28 12:27:00.536 32190 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:27:00 ctl02 nova-api[32190]: 2017-09-28 12:27:00.536 32190 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:27:00 ctl02 nova-api[32190]: 2017-09-28 12:27:00.536 32190 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:27:00 ctl02 nova-api[32190]: 2017-09-28 12:27:00.536 32190 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:27:00 ctl02 nova-api[32190]: 2017-09-28 12:27:00.536 32190 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:27:00 ctl02 nova-api[32190]: 2017-09-28 12:27:00.536 32190 ERROR nova.wsgi     self.filename))
Sep 28 12:27:00 ctl02 nova-api[32190]: 2017-09-28 12:27:00.536 32190 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:27:00 ctl02 nova-api[32190]: 2017-09-28 12:27:00.536 32190 ERROR nova.wsgi
Sep 28 12:27:00 ctl02 nova-api[32190]: 2017-09-28 12:27:00.538 32190 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:27:00 ctl02 nova-api[32190]: 2017-09-28 12:27:00.669 32190 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:27:00 ctl02 nova-api[32190]: 2017-09-28 12:27:00.919 32190 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:27:00 ctl02 nova-api[32190]: 2017-09-28 12:27:00.922 32190 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:27:00 ctl02 nova-api[32190]: 2017-09-28 12:27:00.922 32190 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:27:00 ctl02 nova-api[32190]: 2017-09-28 12:27:00.923 32190 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:27:01 ctl02 nova-api[32190]: 2017-09-28 12:27:01.056 32190 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:27:01 ctl02 nova-api[32190]: 2017-09-28 12:27:01.058 32190 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:27:01 ctl02 nova-api[32190]: 2017-09-28 12:27:01.058 32190 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:27:01 ctl02 nova-api[32190]: 2017-09-28 12:27:01.059 32190 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:27:01 ctl02 nova-api[32190]: 2017-09-28 12:27:01.062 32190 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:27:01 ctl02 nova-api[32190]: 2017-09-28 12:27:01.063 32190 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:27:01 ctl02 nova-api[32190]: 2017-09-28 12:27:01.063 32190 ERROR nova Traceback (most recent call last):
Sep 28 12:27:01 ctl02 nova-api[32190]: 2017-09-28 12:27:01.063 32190 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:27:01 ctl02 nova-api[32190]: 2017-09-28 12:27:01.063 32190 ERROR nova     sys.exit(main())
Sep 28 12:27:01 ctl02 nova-api[32190]: 2017-09-28 12:27:01.063 32190 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:27:01 ctl02 nova-api[32190]: 2017-09-28 12:27:01.063 32190 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:27:01 ctl02 nova-api[32190]: 2017-09-28 12:27:01.063 32190 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:27:01 ctl02 nova-api[32190]: 2017-09-28 12:27:01.063 32190 ERROR nova     max_url_len=max_url_len)
Sep 28 12:27:01 ctl02 nova-api[32190]: 2017-09-28 12:27:01.063 32190 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:27:01 ctl02 nova-api[32190]: 2017-09-28 12:27:01.063 32190 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:27:01 ctl02 nova-api[32190]: 2017-09-28 12:27:01.063 32190 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:27:01 ctl02 nova-api[32190]: 2017-09-28 12:27:01.063 32190 ERROR nova     sock.listen(backlog)
Sep 28 12:27:01 ctl02 nova-api[32190]: 2017-09-28 12:27:01.063 32190 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:27:01 ctl02 nova-api[32190]: 2017-09-28 12:27:01.063 32190 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:27:01 ctl02 nova-api[32190]: 2017-09-28 12:27:01.063 32190 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:27:01 ctl02 nova-api[32190]: 2017-09-28 12:27:01.063 32190 ERROR nova
Sep 28 12:27:01 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:27:01 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:27:01 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:27:01 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:27:01 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:27:01 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:27:01 ctl02 neutron-server[30536]: 2017-09-28 12:27:01.382 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:27:01] "OPTIONS / HTTP/1.0" 200 262 0.000569
Sep 28 12:27:01 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:27:01 ctl02 neutron-server[30536]: 2017-09-28 12:27:01.904 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:27:01] "OPTIONS / HTTP/1.0" 200 262 0.000548
Sep 28 12:27:02 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:27:02.533 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:27:02] "OPTIONS / HTTP/1.0" 200 134 0.000462
Sep 28 12:27:03 ctl02 nova-api[32208]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:27:03 ctl02 nova-api[32208]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:27:03 ctl02 nova-api[32208]: 2017-09-28 12:27:03.267 32208 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:27:03 ctl02 nova-api[32208]: 2017-09-28 12:27:03.269 32208 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:27:03 ctl02 nova-api[32208]: 2017-09-28 12:27:03.269 32208 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:27:03 ctl02 nova-api[32208]: 2017-09-28 12:27:03.269 32208 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:27:03 ctl02 nova-api[32208]: 2017-09-28 12:27:03.269 32208 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:27:03 ctl02 nova-api[32208]: 2017-09-28 12:27:03.269 32208 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:27:03 ctl02 nova-api[32208]: 2017-09-28 12:27:03.269 32208 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:27:03 ctl02 nova-api[32208]: 2017-09-28 12:27:03.269 32208 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:27:03 ctl02 nova-api[32208]: 2017-09-28 12:27:03.269 32208 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:27:03 ctl02 nova-api[32208]: 2017-09-28 12:27:03.269 32208 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:27:03 ctl02 nova-api[32208]: 2017-09-28 12:27:03.269 32208 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:27:03 ctl02 nova-api[32208]: 2017-09-28 12:27:03.269 32208 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:27:03 ctl02 nova-api[32208]: 2017-09-28 12:27:03.269 32208 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:27:03 ctl02 nova-api[32208]: 2017-09-28 12:27:03.269 32208 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:27:03 ctl02 nova-api[32208]: 2017-09-28 12:27:03.269 32208 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:27:03 ctl02 nova-api[32208]: 2017-09-28 12:27:03.269 32208 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:27:03 ctl02 nova-api[32208]: 2017-09-28 12:27:03.269 32208 ERROR nova.wsgi     self.filename))
Sep 28 12:27:03 ctl02 nova-api[32208]: 2017-09-28 12:27:03.269 32208 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:27:03 ctl02 nova-api[32208]: 2017-09-28 12:27:03.269 32208 ERROR nova.wsgi
Sep 28 12:27:03 ctl02 nova-api[32208]: 2017-09-28 12:27:03.271 32208 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:27:03 ctl02 nova-api[32208]: 2017-09-28 12:27:03.404 32208 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:27:03 ctl02 nova-api[32208]: 2017-09-28 12:27:03.649 32208 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:27:03 ctl02 nova-api[32208]: 2017-09-28 12:27:03.651 32208 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:27:03 ctl02 nova-api[32208]: 2017-09-28 12:27:03.652 32208 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:27:03 ctl02 nova-api[32208]: 2017-09-28 12:27:03.652 32208 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:27:03 ctl02 nova-api[32208]: 2017-09-28 12:27:03.784 32208 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:27:03 ctl02 nova-api[32208]: 2017-09-28 12:27:03.786 32208 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:27:03 ctl02 nova-api[32208]: 2017-09-28 12:27:03.787 32208 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:27:03 ctl02 nova-api[32208]: 2017-09-28 12:27:03.787 32208 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:27:03 ctl02 nova-api[32208]: 2017-09-28 12:27:03.790 32208 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:27:03 ctl02 nova-api[32208]: 2017-09-28 12:27:03.790 32208 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:27:03 ctl02 nova-api[32208]: 2017-09-28 12:27:03.790 32208 ERROR nova Traceback (most recent call last):
Sep 28 12:27:03 ctl02 nova-api[32208]: 2017-09-28 12:27:03.790 32208 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:27:03 ctl02 nova-api[32208]: 2017-09-28 12:27:03.790 32208 ERROR nova     sys.exit(main())
Sep 28 12:27:03 ctl02 nova-api[32208]: 2017-09-28 12:27:03.790 32208 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:27:03 ctl02 nova-api[32208]: 2017-09-28 12:27:03.790 32208 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:27:03 ctl02 nova-api[32208]: 2017-09-28 12:27:03.790 32208 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:27:03 ctl02 nova-api[32208]: 2017-09-28 12:27:03.790 32208 ERROR nova     max_url_len=max_url_len)
Sep 28 12:27:03 ctl02 nova-api[32208]: 2017-09-28 12:27:03.790 32208 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:27:03 ctl02 nova-api[32208]: 2017-09-28 12:27:03.790 32208 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:27:03 ctl02 nova-api[32208]: 2017-09-28 12:27:03.790 32208 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:27:03 ctl02 nova-api[32208]: 2017-09-28 12:27:03.790 32208 ERROR nova     sock.listen(backlog)
Sep 28 12:27:03 ctl02 nova-api[32208]: 2017-09-28 12:27:03.790 32208 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:27:03 ctl02 nova-api[32208]: 2017-09-28 12:27:03.790 32208 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:27:03 ctl02 nova-api[32208]: 2017-09-28 12:27:03.790 32208 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:27:03 ctl02 nova-api[32208]: 2017-09-28 12:27:03.790 32208 ERROR nova
Sep 28 12:27:03 ctl02 glance-api[29183]: 2017-09-28 12:27:03.850 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:27:03] "OPTIONS / HTTP/1.0" 200 134 0.000734
Sep 28 12:27:03 ctl02 glance-api[29183]: 2017-09-28 12:27:03.904 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:27:03] "OPTIONS / HTTP/1.0" 200 134 0.000707
Sep 28 12:27:03 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:27:03 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:27:03 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:27:04 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:27:04 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:27:04 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:27:04 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:27:05 ctl02 heat-api[13008]: 2017-09-28 12:27:05.339 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:27:05] "OPTIONS / HTTP/1.0" 200 134 0.000655
Sep 28 12:27:05 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:27:05.766 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:27:05] "OPTIONS / HTTP/1.0" 200 134 0.000518
Sep 28 12:27:05 ctl02 nova-api[32226]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:27:05 ctl02 nova-api[32226]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:27:06 ctl02 nova-api[32226]: 2017-09-28 12:27:06.010 32226 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:27:06 ctl02 nova-api[32226]: 2017-09-28 12:27:06.012 32226 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:27:06 ctl02 nova-api[32226]: 2017-09-28 12:27:06.012 32226 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:27:06 ctl02 nova-api[32226]: 2017-09-28 12:27:06.012 32226 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:27:06 ctl02 nova-api[32226]: 2017-09-28 12:27:06.012 32226 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:27:06 ctl02 nova-api[32226]: 2017-09-28 12:27:06.012 32226 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:27:06 ctl02 nova-api[32226]: 2017-09-28 12:27:06.012 32226 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:27:06 ctl02 nova-api[32226]: 2017-09-28 12:27:06.012 32226 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:27:06 ctl02 nova-api[32226]: 2017-09-28 12:27:06.012 32226 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:27:06 ctl02 nova-api[32226]: 2017-09-28 12:27:06.012 32226 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:27:06 ctl02 nova-api[32226]: 2017-09-28 12:27:06.012 32226 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:27:06 ctl02 nova-api[32226]: 2017-09-28 12:27:06.012 32226 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:27:06 ctl02 nova-api[32226]: 2017-09-28 12:27:06.012 32226 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:27:06 ctl02 nova-api[32226]: 2017-09-28 12:27:06.012 32226 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:27:06 ctl02 nova-api[32226]: 2017-09-28 12:27:06.012 32226 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:27:06 ctl02 nova-api[32226]: 2017-09-28 12:27:06.012 32226 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:27:06 ctl02 nova-api[32226]: 2017-09-28 12:27:06.012 32226 ERROR nova.wsgi     self.filename))
Sep 28 12:27:06 ctl02 nova-api[32226]: 2017-09-28 12:27:06.012 32226 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:27:06 ctl02 nova-api[32226]: 2017-09-28 12:27:06.012 32226 ERROR nova.wsgi
Sep 28 12:27:06 ctl02 nova-api[32226]: 2017-09-28 12:27:06.013 32226 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:27:06 ctl02 nova-api[32226]: 2017-09-28 12:27:06.144 32226 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:27:06 ctl02 heat-api-cfn[13300]: 2017-09-28 12:27:06.383 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:27:06] "OPTIONS / HTTP/1.0" 200 134 0.000543
Sep 28 12:27:06 ctl02 nova-api[32226]: 2017-09-28 12:27:06.393 32226 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:27:06 ctl02 nova-api[32226]: 2017-09-28 12:27:06.396 32226 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:27:06 ctl02 nova-api[32226]: 2017-09-28 12:27:06.396 32226 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:27:06 ctl02 nova-api[32226]: 2017-09-28 12:27:06.396 32226 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:27:06 ctl02 neutron-server[30536]: 2017-09-28 12:27:06.460 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 1 dead agents out of 2:
Sep 28 12:27:06 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:27:06 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:23:57 cmp001
Sep 28 12:27:06 ctl02 nova-api[32226]: 2017-09-28 12:27:06.535 32226 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:27:06 ctl02 nova-api[32226]: 2017-09-28 12:27:06.537 32226 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:27:06 ctl02 nova-api[32226]: 2017-09-28 12:27:06.537 32226 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:27:06 ctl02 nova-api[32226]: 2017-09-28 12:27:06.538 32226 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:27:06 ctl02 nova-api[32226]: 2017-09-28 12:27:06.541 32226 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:27:06 ctl02 nova-api[32226]: 2017-09-28 12:27:06.541 32226 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:27:06 ctl02 nova-api[32226]: 2017-09-28 12:27:06.541 32226 ERROR nova Traceback (most recent call last):
Sep 28 12:27:06 ctl02 nova-api[32226]: 2017-09-28 12:27:06.541 32226 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:27:06 ctl02 nova-api[32226]: 2017-09-28 12:27:06.541 32226 ERROR nova     sys.exit(main())
Sep 28 12:27:06 ctl02 nova-api[32226]: 2017-09-28 12:27:06.541 32226 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:27:06 ctl02 nova-api[32226]: 2017-09-28 12:27:06.541 32226 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:27:06 ctl02 nova-api[32226]: 2017-09-28 12:27:06.541 32226 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:27:06 ctl02 nova-api[32226]: 2017-09-28 12:27:06.541 32226 ERROR nova     max_url_len=max_url_len)
Sep 28 12:27:06 ctl02 nova-api[32226]: 2017-09-28 12:27:06.541 32226 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:27:06 ctl02 nova-api[32226]: 2017-09-28 12:27:06.541 32226 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:27:06 ctl02 nova-api[32226]: 2017-09-28 12:27:06.541 32226 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:27:06 ctl02 nova-api[32226]: 2017-09-28 12:27:06.541 32226 ERROR nova     sock.listen(backlog)
Sep 28 12:27:06 ctl02 nova-api[32226]: 2017-09-28 12:27:06.541 32226 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:27:06 ctl02 nova-api[32226]: 2017-09-28 12:27:06.541 32226 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:27:06 ctl02 nova-api[32226]: 2017-09-28 12:27:06.541 32226 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:27:06 ctl02 nova-api[32226]: 2017-09-28 12:27:06.541 32226 ERROR nova
Sep 28 12:27:06 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:27:06 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:27:06 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:27:06 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:27:06 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:27:06 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:27:06 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:27:06 ctl02 heat-api[13008]: 2017-09-28 12:27:06.930 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:27:06] "OPTIONS / HTTP/1.0" 200 134 0.000663
Sep 28 12:27:08 ctl02 nova-api[32244]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:27:08 ctl02 nova-api[32244]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:27:08 ctl02 heat-api-cfn[13300]: 2017-09-28 12:27:08.648 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:27:08] "OPTIONS / HTTP/1.0" 200 134 0.000538
Sep 28 12:27:08 ctl02 heat-api-cfn[13300]: 2017-09-28 12:27:08.765 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:27:08] "OPTIONS / HTTP/1.0" 200 134 0.000467
Sep 28 12:27:08 ctl02 nova-api[32244]: 2017-09-28 12:27:08.772 32244 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:27:08 ctl02 nova-api[32244]: 2017-09-28 12:27:08.773 32244 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:27:08 ctl02 nova-api[32244]: 2017-09-28 12:27:08.773 32244 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:27:08 ctl02 nova-api[32244]: 2017-09-28 12:27:08.773 32244 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:27:08 ctl02 nova-api[32244]: 2017-09-28 12:27:08.773 32244 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:27:08 ctl02 nova-api[32244]: 2017-09-28 12:27:08.773 32244 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:27:08 ctl02 nova-api[32244]: 2017-09-28 12:27:08.773 32244 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:27:08 ctl02 nova-api[32244]: 2017-09-28 12:27:08.773 32244 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:27:08 ctl02 nova-api[32244]: 2017-09-28 12:27:08.773 32244 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:27:08 ctl02 nova-api[32244]: 2017-09-28 12:27:08.773 32244 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:27:08 ctl02 nova-api[32244]: 2017-09-28 12:27:08.773 32244 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:27:08 ctl02 nova-api[32244]: 2017-09-28 12:27:08.773 32244 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:27:08 ctl02 nova-api[32244]: 2017-09-28 12:27:08.773 32244 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:27:08 ctl02 nova-api[32244]: 2017-09-28 12:27:08.773 32244 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:27:08 ctl02 nova-api[32244]: 2017-09-28 12:27:08.773 32244 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:27:08 ctl02 nova-api[32244]: 2017-09-28 12:27:08.773 32244 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:27:08 ctl02 nova-api[32244]: 2017-09-28 12:27:08.773 32244 ERROR nova.wsgi     self.filename))
Sep 28 12:27:08 ctl02 nova-api[32244]: 2017-09-28 12:27:08.773 32244 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:27:08 ctl02 nova-api[32244]: 2017-09-28 12:27:08.773 32244 ERROR nova.wsgi
Sep 28 12:27:08 ctl02 nova-api[32244]: 2017-09-28 12:27:08.774 32244 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:27:08 ctl02 heat-api[13008]: 2017-09-28 12:27:08.785 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:27:08] "OPTIONS / HTTP/1.0" 200 134 0.000555
Sep 28 12:27:08 ctl02 nova-api[32244]: 2017-09-28 12:27:08.914 32244 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:27:09 ctl02 nova-api[32244]: 2017-09-28 12:27:09.159 32244 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:27:09 ctl02 nova-api[32244]: 2017-09-28 12:27:09.161 32244 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:27:09 ctl02 nova-api[32244]: 2017-09-28 12:27:09.161 32244 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:27:09 ctl02 nova-api[32244]: 2017-09-28 12:27:09.162 32244 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:27:09 ctl02 neutron-server[30536]: 2017-09-28 12:27:09.196 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:27:09] "OPTIONS / HTTP/1.0" 200 262 0.000552
Sep 28 12:27:09 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:27:09.268 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:27:09] "OPTIONS / HTTP/1.0" 200 134 0.000501
Sep 28 12:27:09 ctl02 nova-api[32244]: 2017-09-28 12:27:09.296 32244 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:27:09 ctl02 nova-api[32244]: 2017-09-28 12:27:09.298 32244 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:27:09 ctl02 nova-api[32244]: 2017-09-28 12:27:09.299 32244 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:27:09 ctl02 nova-api[32244]: 2017-09-28 12:27:09.299 32244 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:27:09 ctl02 nova-api[32244]: 2017-09-28 12:27:09.302 32244 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:27:09 ctl02 nova-api[32244]: 2017-09-28 12:27:09.303 32244 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:27:09 ctl02 nova-api[32244]: 2017-09-28 12:27:09.303 32244 ERROR nova Traceback (most recent call last):
Sep 28 12:27:09 ctl02 nova-api[32244]: 2017-09-28 12:27:09.303 32244 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:27:09 ctl02 nova-api[32244]: 2017-09-28 12:27:09.303 32244 ERROR nova     sys.exit(main())
Sep 28 12:27:09 ctl02 nova-api[32244]: 2017-09-28 12:27:09.303 32244 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:27:09 ctl02 nova-api[32244]: 2017-09-28 12:27:09.303 32244 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:27:09 ctl02 nova-api[32244]: 2017-09-28 12:27:09.303 32244 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:27:09 ctl02 nova-api[32244]: 2017-09-28 12:27:09.303 32244 ERROR nova     max_url_len=max_url_len)
Sep 28 12:27:09 ctl02 nova-api[32244]: 2017-09-28 12:27:09.303 32244 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:27:09 ctl02 nova-api[32244]: 2017-09-28 12:27:09.303 32244 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:27:09 ctl02 nova-api[32244]: 2017-09-28 12:27:09.303 32244 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:27:09 ctl02 nova-api[32244]: 2017-09-28 12:27:09.303 32244 ERROR nova     sock.listen(backlog)
Sep 28 12:27:09 ctl02 nova-api[32244]: 2017-09-28 12:27:09.303 32244 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:27:09 ctl02 nova-api[32244]: 2017-09-28 12:27:09.303 32244 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:27:09 ctl02 nova-api[32244]: 2017-09-28 12:27:09.303 32244 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:27:09 ctl02 nova-api[32244]: 2017-09-28 12:27:09.303 32244 ERROR nova
Sep 28 12:27:09 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:27:09 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:27:09 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:27:09 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:27:09 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:27:09 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:27:09 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:27:10 ctl02 glance-api[29183]: 2017-09-28 12:27:10.168 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:27:10] "OPTIONS / HTTP/1.0" 200 134 0.000663
Sep 28 12:27:11 ctl02 neutron-server[30536]: 2017-09-28 12:27:11.341 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:27:11] "OPTIONS / HTTP/1.0" 200 262 0.000442
Sep 28 12:27:11 ctl02 nova-api[32260]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:27:11 ctl02 nova-api[32260]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:27:11 ctl02 nova-api[32260]: 2017-09-28 12:27:11.549 32260 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:27:11 ctl02 nova-api[32260]: 2017-09-28 12:27:11.551 32260 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:27:11 ctl02 nova-api[32260]: 2017-09-28 12:27:11.551 32260 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:27:11 ctl02 nova-api[32260]: 2017-09-28 12:27:11.551 32260 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:27:11 ctl02 nova-api[32260]: 2017-09-28 12:27:11.551 32260 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:27:11 ctl02 nova-api[32260]: 2017-09-28 12:27:11.551 32260 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:27:11 ctl02 nova-api[32260]: 2017-09-28 12:27:11.551 32260 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:27:11 ctl02 nova-api[32260]: 2017-09-28 12:27:11.551 32260 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:27:11 ctl02 nova-api[32260]: 2017-09-28 12:27:11.551 32260 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:27:11 ctl02 nova-api[32260]: 2017-09-28 12:27:11.551 32260 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:27:11 ctl02 nova-api[32260]: 2017-09-28 12:27:11.551 32260 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:27:11 ctl02 nova-api[32260]: 2017-09-28 12:27:11.551 32260 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:27:11 ctl02 nova-api[32260]: 2017-09-28 12:27:11.551 32260 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:27:11 ctl02 nova-api[32260]: 2017-09-28 12:27:11.551 32260 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:27:11 ctl02 nova-api[32260]: 2017-09-28 12:27:11.551 32260 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:27:11 ctl02 nova-api[32260]: 2017-09-28 12:27:11.551 32260 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:27:11 ctl02 nova-api[32260]: 2017-09-28 12:27:11.551 32260 ERROR nova.wsgi     self.filename))
Sep 28 12:27:11 ctl02 nova-api[32260]: 2017-09-28 12:27:11.551 32260 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:27:11 ctl02 nova-api[32260]: 2017-09-28 12:27:11.551 32260 ERROR nova.wsgi
Sep 28 12:27:11 ctl02 nova-api[32260]: 2017-09-28 12:27:11.553 32260 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:27:11 ctl02 nova-api[32260]: 2017-09-28 12:27:11.688 32260 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:27:11 ctl02 nova-api[32260]: 2017-09-28 12:27:11.937 32260 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:27:11 ctl02 nova-api[32260]: 2017-09-28 12:27:11.940 32260 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:27:11 ctl02 nova-api[32260]: 2017-09-28 12:27:11.940 32260 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:27:11 ctl02 nova-api[32260]: 2017-09-28 12:27:11.940 32260 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:27:11 ctl02 neutron-server[30536]: 2017-09-28 12:27:11.994 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:27:11] "OPTIONS / HTTP/1.0" 200 262 0.000540
Sep 28 12:27:12 ctl02 nova-api[32260]: 2017-09-28 12:27:12.074 32260 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:27:12 ctl02 nova-api[32260]: 2017-09-28 12:27:12.076 32260 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:27:12 ctl02 nova-api[32260]: 2017-09-28 12:27:12.076 32260 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:27:12 ctl02 nova-api[32260]: 2017-09-28 12:27:12.076 32260 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:27:12 ctl02 nova-api[32260]: 2017-09-28 12:27:12.080 32260 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:27:12 ctl02 nova-api[32260]: 2017-09-28 12:27:12.080 32260 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:27:12 ctl02 nova-api[32260]: 2017-09-28 12:27:12.080 32260 ERROR nova Traceback (most recent call last):
Sep 28 12:27:12 ctl02 nova-api[32260]: 2017-09-28 12:27:12.080 32260 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:27:12 ctl02 nova-api[32260]: 2017-09-28 12:27:12.080 32260 ERROR nova     sys.exit(main())
Sep 28 12:27:12 ctl02 nova-api[32260]: 2017-09-28 12:27:12.080 32260 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:27:12 ctl02 nova-api[32260]: 2017-09-28 12:27:12.080 32260 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:27:12 ctl02 nova-api[32260]: 2017-09-28 12:27:12.080 32260 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:27:12 ctl02 nova-api[32260]: 2017-09-28 12:27:12.080 32260 ERROR nova     max_url_len=max_url_len)
Sep 28 12:27:12 ctl02 nova-api[32260]: 2017-09-28 12:27:12.080 32260 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:27:12 ctl02 nova-api[32260]: 2017-09-28 12:27:12.080 32260 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:27:12 ctl02 nova-api[32260]: 2017-09-28 12:27:12.080 32260 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:27:12 ctl02 nova-api[32260]: 2017-09-28 12:27:12.080 32260 ERROR nova     sock.listen(backlog)
Sep 28 12:27:12 ctl02 nova-api[32260]: 2017-09-28 12:27:12.080 32260 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:27:12 ctl02 nova-api[32260]: 2017-09-28 12:27:12.080 32260 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:27:12 ctl02 nova-api[32260]: 2017-09-28 12:27:12.080 32260 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:27:12 ctl02 nova-api[32260]: 2017-09-28 12:27:12.080 32260 ERROR nova
Sep 28 12:27:12 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:27:12 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:27:12 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:27:12 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:27:12 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:27:12 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:27:12 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:27:12 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:27:12.711 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:27:12] "OPTIONS / HTTP/1.0" 200 134 0.000458
Sep 28 12:27:12 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcdd90130)
Sep 28 12:27:13 ctl02 neutron-server[30536]: 2017-09-28 12:27:13.482 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:27:13 ctl02 glance-api[29183]: 2017-09-28 12:27:13.595 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:27:13] "OPTIONS / HTTP/1.0" 200 134 0.000705
Sep 28 12:27:13 ctl02 glance-api[29183]: 2017-09-28 12:27:13.809 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:27:13] "OPTIONS / HTTP/1.0" 200 134 0.000912
Sep 28 12:27:13 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcdd90130)
Sep 28 12:27:14 ctl02 nova-api[32280]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:27:14 ctl02 nova-api[32280]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:27:14 ctl02 nova-api[32280]: 2017-09-28 12:27:14.284 32280 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:27:14 ctl02 nova-api[32280]: 2017-09-28 12:27:14.286 32280 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:27:14 ctl02 nova-api[32280]: 2017-09-28 12:27:14.286 32280 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:27:14 ctl02 nova-api[32280]: 2017-09-28 12:27:14.286 32280 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:27:14 ctl02 nova-api[32280]: 2017-09-28 12:27:14.286 32280 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:27:14 ctl02 nova-api[32280]: 2017-09-28 12:27:14.286 32280 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:27:14 ctl02 nova-api[32280]: 2017-09-28 12:27:14.286 32280 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:27:14 ctl02 nova-api[32280]: 2017-09-28 12:27:14.286 32280 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:27:14 ctl02 nova-api[32280]: 2017-09-28 12:27:14.286 32280 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:27:14 ctl02 nova-api[32280]: 2017-09-28 12:27:14.286 32280 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:27:14 ctl02 nova-api[32280]: 2017-09-28 12:27:14.286 32280 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:27:14 ctl02 nova-api[32280]: 2017-09-28 12:27:14.286 32280 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:27:14 ctl02 nova-api[32280]: 2017-09-28 12:27:14.286 32280 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:27:14 ctl02 nova-api[32280]: 2017-09-28 12:27:14.286 32280 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:27:14 ctl02 nova-api[32280]: 2017-09-28 12:27:14.286 32280 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:27:14 ctl02 nova-api[32280]: 2017-09-28 12:27:14.286 32280 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:27:14 ctl02 nova-api[32280]: 2017-09-28 12:27:14.286 32280 ERROR nova.wsgi     self.filename))
Sep 28 12:27:14 ctl02 nova-api[32280]: 2017-09-28 12:27:14.286 32280 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:27:14 ctl02 nova-api[32280]: 2017-09-28 12:27:14.286 32280 ERROR nova.wsgi
Sep 28 12:27:14 ctl02 nova-api[32280]: 2017-09-28 12:27:14.288 32280 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:27:14 ctl02 nova-api[32280]: 2017-09-28 12:27:14.423 32280 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:27:14 ctl02 nova-api[32280]: 2017-09-28 12:27:14.679 32280 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:27:14 ctl02 nova-api[32280]: 2017-09-28 12:27:14.682 32280 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:27:14 ctl02 nova-api[32280]: 2017-09-28 12:27:14.682 32280 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:27:14 ctl02 nova-api[32280]: 2017-09-28 12:27:14.683 32280 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:27:14 ctl02 nova-api[32280]: 2017-09-28 12:27:14.819 32280 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:27:14 ctl02 nova-api[32280]: 2017-09-28 12:27:14.822 32280 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:27:14 ctl02 nova-api[32280]: 2017-09-28 12:27:14.822 32280 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:27:14 ctl02 nova-api[32280]: 2017-09-28 12:27:14.823 32280 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:27:14 ctl02 nova-api[32280]: 2017-09-28 12:27:14.826 32280 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:27:14 ctl02 nova-api[32280]: 2017-09-28 12:27:14.827 32280 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:27:14 ctl02 nova-api[32280]: 2017-09-28 12:27:14.827 32280 ERROR nova Traceback (most recent call last):
Sep 28 12:27:14 ctl02 nova-api[32280]: 2017-09-28 12:27:14.827 32280 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:27:14 ctl02 nova-api[32280]: 2017-09-28 12:27:14.827 32280 ERROR nova     sys.exit(main())
Sep 28 12:27:14 ctl02 nova-api[32280]: 2017-09-28 12:27:14.827 32280 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:27:14 ctl02 nova-api[32280]: 2017-09-28 12:27:14.827 32280 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:27:14 ctl02 nova-api[32280]: 2017-09-28 12:27:14.827 32280 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:27:14 ctl02 nova-api[32280]: 2017-09-28 12:27:14.827 32280 ERROR nova     max_url_len=max_url_len)
Sep 28 12:27:14 ctl02 nova-api[32280]: 2017-09-28 12:27:14.827 32280 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:27:14 ctl02 nova-api[32280]: 2017-09-28 12:27:14.827 32280 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:27:14 ctl02 nova-api[32280]: 2017-09-28 12:27:14.827 32280 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:27:14 ctl02 nova-api[32280]: 2017-09-28 12:27:14.827 32280 ERROR nova     sock.listen(backlog)
Sep 28 12:27:14 ctl02 nova-api[32280]: 2017-09-28 12:27:14.827 32280 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:27:14 ctl02 nova-api[32280]: 2017-09-28 12:27:14.827 32280 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:27:14 ctl02 nova-api[32280]: 2017-09-28 12:27:14.827 32280 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:27:14 ctl02 nova-api[32280]: 2017-09-28 12:27:14.827 32280 ERROR nova
Sep 28 12:27:14 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:27:14 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:27:14 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:27:14 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcdd90130)
Sep 28 12:27:15 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:27:15 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:27:15 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:27:15 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:27:15 ctl02 heat-api[13008]: 2017-09-28 12:27:15.668 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:27:15] "OPTIONS / HTTP/1.0" 200 134 0.000660
Sep 28 12:27:15 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:27:15.957 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:27:15] "OPTIONS / HTTP/1.0" 200 134 0.000476
Sep 28 12:27:15 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcdd90130)
Sep 28 12:27:16 ctl02 heat-api[13008]: 2017-09-28 12:27:16.649 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:27:16] "OPTIONS / HTTP/1.0" 200 134 0.000613
Sep 28 12:27:16 ctl02 heat-api-cfn[13300]: 2017-09-28 12:27:16.684 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:27:16] "OPTIONS / HTTP/1.0" 200 134 0.000548
Sep 28 12:27:16 ctl02 nova-api[32298]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:27:16 ctl02 nova-api[32298]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:27:16 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcdd90130)
Sep 28 12:27:17 ctl02 nova-api[32298]: 2017-09-28 12:27:17.048 32298 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:27:17 ctl02 nova-api[32298]: 2017-09-28 12:27:17.050 32298 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:27:17 ctl02 nova-api[32298]: 2017-09-28 12:27:17.050 32298 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:27:17 ctl02 nova-api[32298]: 2017-09-28 12:27:17.050 32298 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:27:17 ctl02 nova-api[32298]: 2017-09-28 12:27:17.050 32298 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:27:17 ctl02 nova-api[32298]: 2017-09-28 12:27:17.050 32298 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:27:17 ctl02 nova-api[32298]: 2017-09-28 12:27:17.050 32298 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:27:17 ctl02 nova-api[32298]: 2017-09-28 12:27:17.050 32298 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:27:17 ctl02 nova-api[32298]: 2017-09-28 12:27:17.050 32298 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:27:17 ctl02 nova-api[32298]: 2017-09-28 12:27:17.050 32298 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:27:17 ctl02 nova-api[32298]: 2017-09-28 12:27:17.050 32298 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:27:17 ctl02 nova-api[32298]: 2017-09-28 12:27:17.050 32298 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:27:17 ctl02 nova-api[32298]: 2017-09-28 12:27:17.050 32298 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:27:17 ctl02 nova-api[32298]: 2017-09-28 12:27:17.050 32298 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:27:17 ctl02 nova-api[32298]: 2017-09-28 12:27:17.050 32298 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:27:17 ctl02 nova-api[32298]: 2017-09-28 12:27:17.050 32298 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:27:17 ctl02 nova-api[32298]: 2017-09-28 12:27:17.050 32298 ERROR nova.wsgi     self.filename))
Sep 28 12:27:17 ctl02 nova-api[32298]: 2017-09-28 12:27:17.050 32298 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:27:17 ctl02 nova-api[32298]: 2017-09-28 12:27:17.050 32298 ERROR nova.wsgi
Sep 28 12:27:17 ctl02 nova-api[32298]: 2017-09-28 12:27:17.051 32298 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:27:17 ctl02 nova-api[32298]: 2017-09-28 12:27:17.187 32298 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:27:17 ctl02 nova-api[32298]: 2017-09-28 12:27:17.450 32298 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:27:17 ctl02 nova-api[32298]: 2017-09-28 12:27:17.452 32298 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:27:17 ctl02 nova-api[32298]: 2017-09-28 12:27:17.453 32298 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:27:17 ctl02 nova-api[32298]: 2017-09-28 12:27:17.453 32298 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:27:17 ctl02 nova-cert[4860]: 2017-09-28 12:27:17.550 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:27:17 ctl02 nova-api[32298]: 2017-09-28 12:27:17.587 32298 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:27:17 ctl02 nova-api[32298]: 2017-09-28 12:27:17.589 32298 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:27:17 ctl02 nova-api[32298]: 2017-09-28 12:27:17.589 32298 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:27:17 ctl02 nova-api[32298]: 2017-09-28 12:27:17.589 32298 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:27:17 ctl02 nova-api[32298]: 2017-09-28 12:27:17.593 32298 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:27:17 ctl02 nova-api[32298]: 2017-09-28 12:27:17.593 32298 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:27:17 ctl02 nova-api[32298]: 2017-09-28 12:27:17.593 32298 ERROR nova Traceback (most recent call last):
Sep 28 12:27:17 ctl02 nova-api[32298]: 2017-09-28 12:27:17.593 32298 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:27:17 ctl02 nova-api[32298]: 2017-09-28 12:27:17.593 32298 ERROR nova     sys.exit(main())
Sep 28 12:27:17 ctl02 nova-api[32298]: 2017-09-28 12:27:17.593 32298 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:27:17 ctl02 nova-api[32298]: 2017-09-28 12:27:17.593 32298 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:27:17 ctl02 nova-api[32298]: 2017-09-28 12:27:17.593 32298 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:27:17 ctl02 nova-api[32298]: 2017-09-28 12:27:17.593 32298 ERROR nova     max_url_len=max_url_len)
Sep 28 12:27:17 ctl02 nova-api[32298]: 2017-09-28 12:27:17.593 32298 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:27:17 ctl02 nova-api[32298]: 2017-09-28 12:27:17.593 32298 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:27:17 ctl02 nova-api[32298]: 2017-09-28 12:27:17.593 32298 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:27:17 ctl02 nova-api[32298]: 2017-09-28 12:27:17.593 32298 ERROR nova     sock.listen(backlog)
Sep 28 12:27:17 ctl02 nova-api[32298]: 2017-09-28 12:27:17.593 32298 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:27:17 ctl02 nova-api[32298]: 2017-09-28 12:27:17.593 32298 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:27:17 ctl02 nova-api[32298]: 2017-09-28 12:27:17.593 32298 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:27:17 ctl02 nova-api[32298]: 2017-09-28 12:27:17.593 32298 ERROR nova
Sep 28 12:27:17 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:27:17 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:27:17 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:27:17 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:27:17 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:27:17 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:27:17 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:27:17 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcdd90130)
Sep 28 12:27:18 ctl02 heat-api[13008]: 2017-09-28 12:27:18.482 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:27:18] "OPTIONS / HTTP/1.0" 200 134 0.000665
Sep 28 12:27:18 ctl02 nova-conductor[5056]: 2017-09-28 12:27:18.690 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:27:18 ctl02 nova-conductor[5056]: 2017-09-28 12:27:18.698 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:27:18 ctl02 nova-conductor[5056]: 2017-09-28 12:27:18.719 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:27:18 ctl02 nova-conductor[5056]: 2017-09-28 12:27:18.729 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:27:18 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcdd90130)
Sep 28 12:27:19 ctl02 heat-api-cfn[13300]: 2017-09-28 12:27:18.999 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:27:18] "OPTIONS / HTTP/1.0" 200 134 0.000560
Sep 28 12:27:19 ctl02 heat-api-cfn[13300]: 2017-09-28 12:27:19.064 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:27:19] "OPTIONS / HTTP/1.0" 200 134 0.000466
Sep 28 12:27:19 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:27:19.235 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:27:19] "OPTIONS / HTTP/1.0" 200 134 0.000503
Sep 28 12:27:19 ctl02 neutron-server[30536]: 2017-09-28 12:27:19.428 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:27:19] "OPTIONS / HTTP/1.0" 200 262 0.000569
Sep 28 12:27:19 ctl02 nova-api[32315]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:27:19 ctl02 nova-api[32315]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:27:19 ctl02 nova-api[32315]: 2017-09-28 12:27:19.788 32315 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:27:19 ctl02 nova-api[32315]: 2017-09-28 12:27:19.790 32315 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:27:19 ctl02 nova-api[32315]: 2017-09-28 12:27:19.790 32315 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:27:19 ctl02 nova-api[32315]: 2017-09-28 12:27:19.790 32315 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:27:19 ctl02 nova-api[32315]: 2017-09-28 12:27:19.790 32315 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:27:19 ctl02 nova-api[32315]: 2017-09-28 12:27:19.790 32315 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:27:19 ctl02 nova-api[32315]: 2017-09-28 12:27:19.790 32315 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:27:19 ctl02 nova-api[32315]: 2017-09-28 12:27:19.790 32315 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:27:19 ctl02 nova-api[32315]: 2017-09-28 12:27:19.790 32315 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:27:19 ctl02 nova-api[32315]: 2017-09-28 12:27:19.790 32315 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:27:19 ctl02 nova-api[32315]: 2017-09-28 12:27:19.790 32315 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:27:19 ctl02 nova-api[32315]: 2017-09-28 12:27:19.790 32315 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:27:19 ctl02 nova-api[32315]: 2017-09-28 12:27:19.790 32315 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:27:19 ctl02 nova-api[32315]: 2017-09-28 12:27:19.790 32315 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:27:19 ctl02 nova-api[32315]: 2017-09-28 12:27:19.790 32315 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:27:19 ctl02 nova-api[32315]: 2017-09-28 12:27:19.790 32315 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:27:19 ctl02 nova-api[32315]: 2017-09-28 12:27:19.790 32315 ERROR nova.wsgi     self.filename))
Sep 28 12:27:19 ctl02 nova-api[32315]: 2017-09-28 12:27:19.790 32315 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:27:19 ctl02 nova-api[32315]: 2017-09-28 12:27:19.790 32315 ERROR nova.wsgi
Sep 28 12:27:19 ctl02 nova-api[32315]: 2017-09-28 12:27:19.791 32315 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:27:19 ctl02 nova-api[32315]: 2017-09-28 12:27:19.923 32315 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:27:19 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcdd90130)
Sep 28 12:27:20 ctl02 nova-api[32315]: 2017-09-28 12:27:20.169 32315 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:27:20 ctl02 nova-api[32315]: 2017-09-28 12:27:20.172 32315 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:27:20 ctl02 nova-api[32315]: 2017-09-28 12:27:20.172 32315 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:27:20 ctl02 nova-api[32315]: 2017-09-28 12:27:20.172 32315 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:27:20 ctl02 nova-api[32315]: 2017-09-28 12:27:20.304 32315 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:27:20 ctl02 nova-api[32315]: 2017-09-28 12:27:20.306 32315 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:27:20 ctl02 nova-api[32315]: 2017-09-28 12:27:20.306 32315 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:27:20 ctl02 nova-api[32315]: 2017-09-28 12:27:20.306 32315 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:27:20 ctl02 nova-api[32315]: 2017-09-28 12:27:20.309 32315 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:27:20 ctl02 nova-api[32315]: 2017-09-28 12:27:20.310 32315 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:27:20 ctl02 nova-api[32315]: 2017-09-28 12:27:20.310 32315 ERROR nova Traceback (most recent call last):
Sep 28 12:27:20 ctl02 nova-api[32315]: 2017-09-28 12:27:20.310 32315 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:27:20 ctl02 nova-api[32315]: 2017-09-28 12:27:20.310 32315 ERROR nova     sys.exit(main())
Sep 28 12:27:20 ctl02 nova-api[32315]: 2017-09-28 12:27:20.310 32315 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:27:20 ctl02 nova-api[32315]: 2017-09-28 12:27:20.310 32315 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:27:20 ctl02 nova-api[32315]: 2017-09-28 12:27:20.310 32315 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:27:20 ctl02 nova-api[32315]: 2017-09-28 12:27:20.310 32315 ERROR nova     max_url_len=max_url_len)
Sep 28 12:27:20 ctl02 nova-api[32315]: 2017-09-28 12:27:20.310 32315 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:27:20 ctl02 nova-api[32315]: 2017-09-28 12:27:20.310 32315 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:27:20 ctl02 nova-api[32315]: 2017-09-28 12:27:20.310 32315 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:27:20 ctl02 nova-api[32315]: 2017-09-28 12:27:20.310 32315 ERROR nova     sock.listen(backlog)
Sep 28 12:27:20 ctl02 nova-api[32315]: 2017-09-28 12:27:20.310 32315 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:27:20 ctl02 nova-api[32315]: 2017-09-28 12:27:20.310 32315 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:27:20 ctl02 nova-api[32315]: 2017-09-28 12:27:20.310 32315 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:27:20 ctl02 nova-api[32315]: 2017-09-28 12:27:20.310 32315 ERROR nova
Sep 28 12:27:20 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:27:20 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:27:20 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:27:20 ctl02 glance-api[29183]: 2017-09-28 12:27:20.481 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:27:20] "OPTIONS / HTTP/1.0" 200 134 0.000634
Sep 28 12:27:20 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:27:20 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:27:20 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:27:20 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:27:20 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcdd90130)
Sep 28 12:27:21 ctl02 neutron-server[30536]: 2017-09-28 12:27:21.105 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:27:21] "OPTIONS / HTTP/1.0" 200 262 0.000447
Sep 28 12:27:21 ctl02 neutron-server[30536]: 2017-09-28 12:27:21.456 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 1 dead agents out of 2:
Sep 28 12:27:21 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:27:21 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:23:57 cmp001
Sep 28 12:27:21 ctl02 neutron-server[30536]: 2017-09-28 12:27:21.629 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:27:21] "OPTIONS / HTTP/1.0" 200 262 0.000462
Sep 28 12:27:21 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcdd90130)
Sep 28 12:27:22 ctl02 nova-api[32335]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:27:22 ctl02 nova-api[32335]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:27:22 ctl02 nova-api[32335]: 2017-09-28 12:27:22.510 32335 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:27:22 ctl02 nova-api[32335]: 2017-09-28 12:27:22.512 32335 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:27:22 ctl02 nova-api[32335]: 2017-09-28 12:27:22.512 32335 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:27:22 ctl02 nova-api[32335]: 2017-09-28 12:27:22.512 32335 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:27:22 ctl02 nova-api[32335]: 2017-09-28 12:27:22.512 32335 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:27:22 ctl02 nova-api[32335]: 2017-09-28 12:27:22.512 32335 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:27:22 ctl02 nova-api[32335]: 2017-09-28 12:27:22.512 32335 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:27:22 ctl02 nova-api[32335]: 2017-09-28 12:27:22.512 32335 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:27:22 ctl02 nova-api[32335]: 2017-09-28 12:27:22.512 32335 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:27:22 ctl02 nova-api[32335]: 2017-09-28 12:27:22.512 32335 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:27:22 ctl02 nova-api[32335]: 2017-09-28 12:27:22.512 32335 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:27:22 ctl02 nova-api[32335]: 2017-09-28 12:27:22.512 32335 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:27:22 ctl02 nova-api[32335]: 2017-09-28 12:27:22.512 32335 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:27:22 ctl02 nova-api[32335]: 2017-09-28 12:27:22.512 32335 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:27:22 ctl02 nova-api[32335]: 2017-09-28 12:27:22.512 32335 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:27:22 ctl02 nova-api[32335]: 2017-09-28 12:27:22.512 32335 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:27:22 ctl02 nova-api[32335]: 2017-09-28 12:27:22.512 32335 ERROR nova.wsgi     self.filename))
Sep 28 12:27:22 ctl02 nova-api[32335]: 2017-09-28 12:27:22.512 32335 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:27:22 ctl02 nova-api[32335]: 2017-09-28 12:27:22.512 32335 ERROR nova.wsgi
Sep 28 12:27:22 ctl02 nova-api[32335]: 2017-09-28 12:27:22.513 32335 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:27:22 ctl02 nova-api[32335]: 2017-09-28 12:27:22.646 32335 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:27:22 ctl02 nova-api[32335]: 2017-09-28 12:27:22.895 32335 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:27:22 ctl02 nova-api[32335]: 2017-09-28 12:27:22.898 32335 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:27:22 ctl02 nova-api[32335]: 2017-09-28 12:27:22.898 32335 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:27:22 ctl02 nova-api[32335]: 2017-09-28 12:27:22.899 32335 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:27:22 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:27:22.957 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:27:22] "OPTIONS / HTTP/1.0" 200 134 0.000482
Sep 28 12:27:22 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcdd90130)
Sep 28 12:27:23 ctl02 nova-api[32335]: 2017-09-28 12:27:23.036 32335 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:27:23 ctl02 nova-api[32335]: 2017-09-28 12:27:23.039 32335 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:27:23 ctl02 nova-api[32335]: 2017-09-28 12:27:23.040 32335 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:27:23 ctl02 nova-api[32335]: 2017-09-28 12:27:23.040 32335 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:27:23 ctl02 nova-api[32335]: 2017-09-28 12:27:23.043 32335 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:27:23 ctl02 nova-api[32335]: 2017-09-28 12:27:23.044 32335 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:27:23 ctl02 nova-api[32335]: 2017-09-28 12:27:23.044 32335 ERROR nova Traceback (most recent call last):
Sep 28 12:27:23 ctl02 nova-api[32335]: 2017-09-28 12:27:23.044 32335 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:27:23 ctl02 nova-api[32335]: 2017-09-28 12:27:23.044 32335 ERROR nova     sys.exit(main())
Sep 28 12:27:23 ctl02 nova-api[32335]: 2017-09-28 12:27:23.044 32335 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:27:23 ctl02 nova-api[32335]: 2017-09-28 12:27:23.044 32335 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:27:23 ctl02 nova-api[32335]: 2017-09-28 12:27:23.044 32335 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:27:23 ctl02 nova-api[32335]: 2017-09-28 12:27:23.044 32335 ERROR nova     max_url_len=max_url_len)
Sep 28 12:27:23 ctl02 nova-api[32335]: 2017-09-28 12:27:23.044 32335 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:27:23 ctl02 nova-api[32335]: 2017-09-28 12:27:23.044 32335 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:27:23 ctl02 nova-api[32335]: 2017-09-28 12:27:23.044 32335 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:27:23 ctl02 nova-api[32335]: 2017-09-28 12:27:23.044 32335 ERROR nova     sock.listen(backlog)
Sep 28 12:27:23 ctl02 nova-api[32335]: 2017-09-28 12:27:23.044 32335 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:27:23 ctl02 nova-api[32335]: 2017-09-28 12:27:23.044 32335 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:27:23 ctl02 nova-api[32335]: 2017-09-28 12:27:23.044 32335 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:27:23 ctl02 nova-api[32335]: 2017-09-28 12:27:23.044 32335 ERROR nova
Sep 28 12:27:23 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:27:23 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:27:23 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:27:23 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:27:23 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:27:23 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:27:23 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:27:23 ctl02 glance-api[29183]: 2017-09-28 12:27:23.509 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:27:23] "OPTIONS / HTTP/1.0" 200 134 0.000613
Sep 28 12:27:23 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:27:23 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:27:24 ctl02 glance-api[29183]: 2017-09-28 12:27:24.207 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:27:24] "OPTIONS / HTTP/1.0" 200 134 0.000983
Sep 28 12:27:25 ctl02 nova-api[32353]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:27:25 ctl02 nova-api[32353]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:27:25 ctl02 nova-api[32353]: 2017-09-28 12:27:25.242 32353 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:27:25 ctl02 nova-api[32353]: 2017-09-28 12:27:25.244 32353 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:27:25 ctl02 nova-api[32353]: 2017-09-28 12:27:25.244 32353 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:27:25 ctl02 nova-api[32353]: 2017-09-28 12:27:25.244 32353 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:27:25 ctl02 nova-api[32353]: 2017-09-28 12:27:25.244 32353 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:27:25 ctl02 nova-api[32353]: 2017-09-28 12:27:25.244 32353 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:27:25 ctl02 nova-api[32353]: 2017-09-28 12:27:25.244 32353 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:27:25 ctl02 nova-api[32353]: 2017-09-28 12:27:25.244 32353 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:27:25 ctl02 nova-api[32353]: 2017-09-28 12:27:25.244 32353 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:27:25 ctl02 nova-api[32353]: 2017-09-28 12:27:25.244 32353 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:27:25 ctl02 nova-api[32353]: 2017-09-28 12:27:25.244 32353 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:27:25 ctl02 nova-api[32353]: 2017-09-28 12:27:25.244 32353 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:27:25 ctl02 nova-api[32353]: 2017-09-28 12:27:25.244 32353 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:27:25 ctl02 nova-api[32353]: 2017-09-28 12:27:25.244 32353 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:27:25 ctl02 nova-api[32353]: 2017-09-28 12:27:25.244 32353 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:27:25 ctl02 nova-api[32353]: 2017-09-28 12:27:25.244 32353 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:27:25 ctl02 nova-api[32353]: 2017-09-28 12:27:25.244 32353 ERROR nova.wsgi     self.filename))
Sep 28 12:27:25 ctl02 nova-api[32353]: 2017-09-28 12:27:25.244 32353 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:27:25 ctl02 nova-api[32353]: 2017-09-28 12:27:25.244 32353 ERROR nova.wsgi
Sep 28 12:27:25 ctl02 nova-api[32353]: 2017-09-28 12:27:25.245 32353 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:27:25 ctl02 heat-api[13008]: 2017-09-28 12:27:25.313 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:27:25] "OPTIONS / HTTP/1.0" 200 134 0.000660
Sep 28 12:27:25 ctl02 nova-api[32353]: 2017-09-28 12:27:25.378 32353 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:27:25 ctl02 nova-api[32353]: 2017-09-28 12:27:25.621 32353 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:27:25 ctl02 nova-api[32353]: 2017-09-28 12:27:25.623 32353 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:27:25 ctl02 nova-api[32353]: 2017-09-28 12:27:25.623 32353 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:27:25 ctl02 nova-api[32353]: 2017-09-28 12:27:25.623 32353 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:27:25 ctl02 nova-api[32353]: 2017-09-28 12:27:25.755 32353 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:27:25 ctl02 nova-api[32353]: 2017-09-28 12:27:25.757 32353 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:27:25 ctl02 nova-api[32353]: 2017-09-28 12:27:25.757 32353 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:27:25 ctl02 nova-api[32353]: 2017-09-28 12:27:25.757 32353 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:27:25 ctl02 nova-api[32353]: 2017-09-28 12:27:25.761 32353 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:27:25 ctl02 nova-api[32353]: 2017-09-28 12:27:25.761 32353 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:27:25 ctl02 nova-api[32353]: 2017-09-28 12:27:25.761 32353 ERROR nova Traceback (most recent call last):
Sep 28 12:27:25 ctl02 nova-api[32353]: 2017-09-28 12:27:25.761 32353 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:27:25 ctl02 nova-api[32353]: 2017-09-28 12:27:25.761 32353 ERROR nova     sys.exit(main())
Sep 28 12:27:25 ctl02 nova-api[32353]: 2017-09-28 12:27:25.761 32353 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:27:25 ctl02 nova-api[32353]: 2017-09-28 12:27:25.761 32353 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:27:25 ctl02 nova-api[32353]: 2017-09-28 12:27:25.761 32353 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:27:25 ctl02 nova-api[32353]: 2017-09-28 12:27:25.761 32353 ERROR nova     max_url_len=max_url_len)
Sep 28 12:27:25 ctl02 nova-api[32353]: 2017-09-28 12:27:25.761 32353 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:27:25 ctl02 nova-api[32353]: 2017-09-28 12:27:25.761 32353 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:27:25 ctl02 nova-api[32353]: 2017-09-28 12:27:25.761 32353 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:27:25 ctl02 nova-api[32353]: 2017-09-28 12:27:25.761 32353 ERROR nova     sock.listen(backlog)
Sep 28 12:27:25 ctl02 nova-api[32353]: 2017-09-28 12:27:25.761 32353 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:27:25 ctl02 nova-api[32353]: 2017-09-28 12:27:25.761 32353 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:27:25 ctl02 nova-api[32353]: 2017-09-28 12:27:25.761 32353 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:27:25 ctl02 nova-api[32353]: 2017-09-28 12:27:25.761 32353 ERROR nova
Sep 28 12:27:25 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:27:25 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:27:25 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:27:25 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:27:25.975 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:27:25] "OPTIONS / HTTP/1.0" 200 134 0.000506
Sep 28 12:27:26 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:27:26 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:27:26 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:27:26 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:27:26 ctl02 heat-api[13008]: 2017-09-28 12:27:26.663 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:27:26] "OPTIONS / HTTP/1.0" 200 134 0.000617
Sep 28 12:27:26 ctl02 heat-api-cfn[13300]: 2017-09-28 12:27:26.689 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:27:26] "OPTIONS / HTTP/1.0" 200 134 0.000503
Sep 28 12:27:27 ctl02 nova-consoleauth[5433]: 2017-09-28 12:27:27.440 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:27:27 ctl02 nova-api[32376]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:27:27 ctl02 nova-api[32376]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:27:28 ctl02 nova-api[32376]: 2017-09-28 12:27:28.097 32376 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:27:28 ctl02 nova-api[32376]: 2017-09-28 12:27:28.099 32376 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:27:28 ctl02 nova-api[32376]: 2017-09-28 12:27:28.099 32376 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:27:28 ctl02 nova-api[32376]: 2017-09-28 12:27:28.099 32376 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:27:28 ctl02 nova-api[32376]: 2017-09-28 12:27:28.099 32376 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:27:28 ctl02 nova-api[32376]: 2017-09-28 12:27:28.099 32376 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:27:28 ctl02 nova-api[32376]: 2017-09-28 12:27:28.099 32376 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:27:28 ctl02 nova-api[32376]: 2017-09-28 12:27:28.099 32376 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:27:28 ctl02 nova-api[32376]: 2017-09-28 12:27:28.099 32376 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:27:28 ctl02 nova-api[32376]: 2017-09-28 12:27:28.099 32376 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:27:28 ctl02 nova-api[32376]: 2017-09-28 12:27:28.099 32376 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:27:28 ctl02 nova-api[32376]: 2017-09-28 12:27:28.099 32376 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:27:28 ctl02 nova-api[32376]: 2017-09-28 12:27:28.099 32376 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:27:28 ctl02 nova-api[32376]: 2017-09-28 12:27:28.099 32376 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:27:28 ctl02 nova-api[32376]: 2017-09-28 12:27:28.099 32376 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:27:28 ctl02 nova-api[32376]: 2017-09-28 12:27:28.099 32376 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:27:28 ctl02 nova-api[32376]: 2017-09-28 12:27:28.099 32376 ERROR nova.wsgi     self.filename))
Sep 28 12:27:28 ctl02 nova-api[32376]: 2017-09-28 12:27:28.099 32376 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:27:28 ctl02 nova-api[32376]: 2017-09-28 12:27:28.099 32376 ERROR nova.wsgi
Sep 28 12:27:28 ctl02 nova-api[32376]: 2017-09-28 12:27:28.100 32376 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:27:28 ctl02 nova-api[32376]: 2017-09-28 12:27:28.235 32376 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:27:28 ctl02 neutron-server[30536]: 2017-09-28 12:27:28.483 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:27:28 ctl02 nova-api[32376]: 2017-09-28 12:27:28.491 32376 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:27:28 ctl02 nova-api[32376]: 2017-09-28 12:27:28.493 32376 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:27:28 ctl02 nova-api[32376]: 2017-09-28 12:27:28.493 32376 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:27:28 ctl02 nova-api[32376]: 2017-09-28 12:27:28.494 32376 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:27:28 ctl02 heat-api[13008]: 2017-09-28 12:27:28.529 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:27:28] "OPTIONS / HTTP/1.0" 200 134 0.000613
Sep 28 12:27:28 ctl02 nova-api[32376]: 2017-09-28 12:27:28.628 32376 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:27:28 ctl02 nova-api[32376]: 2017-09-28 12:27:28.631 32376 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:27:28 ctl02 nova-api[32376]: 2017-09-28 12:27:28.631 32376 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:27:28 ctl02 nova-api[32376]: 2017-09-28 12:27:28.631 32376 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:27:28 ctl02 nova-api[32376]: 2017-09-28 12:27:28.634 32376 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:27:28 ctl02 nova-api[32376]: 2017-09-28 12:27:28.635 32376 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:27:28 ctl02 nova-api[32376]: 2017-09-28 12:27:28.635 32376 ERROR nova Traceback (most recent call last):
Sep 28 12:27:28 ctl02 nova-api[32376]: 2017-09-28 12:27:28.635 32376 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:27:28 ctl02 nova-api[32376]: 2017-09-28 12:27:28.635 32376 ERROR nova     sys.exit(main())
Sep 28 12:27:28 ctl02 nova-api[32376]: 2017-09-28 12:27:28.635 32376 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:27:28 ctl02 nova-api[32376]: 2017-09-28 12:27:28.635 32376 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:27:28 ctl02 nova-api[32376]: 2017-09-28 12:27:28.635 32376 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:27:28 ctl02 nova-api[32376]: 2017-09-28 12:27:28.635 32376 ERROR nova     max_url_len=max_url_len)
Sep 28 12:27:28 ctl02 nova-api[32376]: 2017-09-28 12:27:28.635 32376 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:27:28 ctl02 nova-api[32376]: 2017-09-28 12:27:28.635 32376 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:27:28 ctl02 nova-api[32376]: 2017-09-28 12:27:28.635 32376 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:27:28 ctl02 nova-api[32376]: 2017-09-28 12:27:28.635 32376 ERROR nova     sock.listen(backlog)
Sep 28 12:27:28 ctl02 nova-api[32376]: 2017-09-28 12:27:28.635 32376 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:27:28 ctl02 nova-api[32376]: 2017-09-28 12:27:28.635 32376 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:27:28 ctl02 nova-api[32376]: 2017-09-28 12:27:28.635 32376 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:27:28 ctl02 nova-api[32376]: 2017-09-28 12:27:28.635 32376 ERROR nova
Sep 28 12:27:28 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:27:28 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:27:28 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:27:29 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:27:29 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:27:29 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:27:29 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:27:29 ctl02 heat-api-cfn[13300]: 2017-09-28 12:27:29.165 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:27:29] "OPTIONS / HTTP/1.0" 200 134 0.000523
Sep 28 12:27:29 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:27:29.199 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:27:29] "OPTIONS / HTTP/1.0" 200 134 0.000435
Sep 28 12:27:29 ctl02 neutron-server[30536]: 2017-09-28 12:27:29.279 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:27:29] "OPTIONS / HTTP/1.0" 200 262 0.000496
Sep 28 12:27:29 ctl02 heat-api-cfn[13300]: 2017-09-28 12:27:29.464 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:27:29] "OPTIONS / HTTP/1.0" 200 134 0.000458
Sep 28 12:27:29 ctl02 heat-engine[12803]: 2017-09-28 12:27:29.809 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:27:29 ctl02 heat-engine[12803]: 2017-09-28 12:27:29.813 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:27:29 ctl02 heat-engine[12803]: 2017-09-28 12:27:29.819 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:27:29 ctl02 heat-engine[12803]: 2017-09-28 12:27:29.822 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:27:30 ctl02 nova-scheduler[5620]: 2017-09-28 12:27:30.457 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:27:30 ctl02 neutron-server[30536]: 2017-09-28 12:27:30.749 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:27:30] "OPTIONS / HTTP/1.0" 200 262 0.000429
Sep 28 12:27:30 ctl02 nova-api[32394]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:27:30 ctl02 nova-api[32394]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:27:30 ctl02 glance-api[29183]: 2017-09-28 12:27:30.883 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:27:30] "OPTIONS / HTTP/1.0" 200 134 0.000609
Sep 28 12:27:30 ctl02 nova-api[32394]: 2017-09-28 12:27:30.977 32394 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:27:30 ctl02 nova-api[32394]: 2017-09-28 12:27:30.979 32394 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:27:30 ctl02 nova-api[32394]: 2017-09-28 12:27:30.979 32394 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:27:30 ctl02 nova-api[32394]: 2017-09-28 12:27:30.979 32394 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:27:30 ctl02 nova-api[32394]: 2017-09-28 12:27:30.979 32394 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:27:30 ctl02 nova-api[32394]: 2017-09-28 12:27:30.979 32394 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:27:30 ctl02 nova-api[32394]: 2017-09-28 12:27:30.979 32394 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:27:30 ctl02 nova-api[32394]: 2017-09-28 12:27:30.979 32394 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:27:30 ctl02 nova-api[32394]: 2017-09-28 12:27:30.979 32394 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:27:30 ctl02 nova-api[32394]: 2017-09-28 12:27:30.979 32394 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:27:30 ctl02 nova-api[32394]: 2017-09-28 12:27:30.979 32394 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:27:30 ctl02 nova-api[32394]: 2017-09-28 12:27:30.979 32394 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:27:30 ctl02 nova-api[32394]: 2017-09-28 12:27:30.979 32394 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:27:30 ctl02 nova-api[32394]: 2017-09-28 12:27:30.979 32394 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:27:30 ctl02 nova-api[32394]: 2017-09-28 12:27:30.979 32394 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:27:30 ctl02 nova-api[32394]: 2017-09-28 12:27:30.979 32394 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:27:30 ctl02 nova-api[32394]: 2017-09-28 12:27:30.979 32394 ERROR nova.wsgi     self.filename))
Sep 28 12:27:30 ctl02 nova-api[32394]: 2017-09-28 12:27:30.979 32394 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:27:30 ctl02 nova-api[32394]: 2017-09-28 12:27:30.979 32394 ERROR nova.wsgi
Sep 28 12:27:30 ctl02 nova-api[32394]: 2017-09-28 12:27:30.979 32394 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:27:31 ctl02 nova-api[32394]: 2017-09-28 12:27:31.109 32394 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:27:31 ctl02 nova-api[32394]: 2017-09-28 12:27:31.336 32394 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:27:31 ctl02 nova-api[32394]: 2017-09-28 12:27:31.338 32394 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:27:31 ctl02 nova-api[32394]: 2017-09-28 12:27:31.338 32394 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:27:31 ctl02 nova-api[32394]: 2017-09-28 12:27:31.338 32394 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:27:31 ctl02 nova-api[32394]: 2017-09-28 12:27:31.466 32394 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:27:31 ctl02 nova-api[32394]: 2017-09-28 12:27:31.468 32394 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:27:31 ctl02 nova-api[32394]: 2017-09-28 12:27:31.468 32394 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:27:31 ctl02 nova-api[32394]: 2017-09-28 12:27:31.469 32394 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:27:31 ctl02 nova-api[32394]: 2017-09-28 12:27:31.472 32394 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:27:31 ctl02 nova-api[32394]: 2017-09-28 12:27:31.472 32394 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:27:31 ctl02 nova-api[32394]: 2017-09-28 12:27:31.472 32394 ERROR nova Traceback (most recent call last):
Sep 28 12:27:31 ctl02 nova-api[32394]: 2017-09-28 12:27:31.472 32394 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:27:31 ctl02 nova-api[32394]: 2017-09-28 12:27:31.472 32394 ERROR nova     sys.exit(main())
Sep 28 12:27:31 ctl02 nova-api[32394]: 2017-09-28 12:27:31.472 32394 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:27:31 ctl02 nova-api[32394]: 2017-09-28 12:27:31.472 32394 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:27:31 ctl02 nova-api[32394]: 2017-09-28 12:27:31.472 32394 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:27:31 ctl02 nova-api[32394]: 2017-09-28 12:27:31.472 32394 ERROR nova     max_url_len=max_url_len)
Sep 28 12:27:31 ctl02 nova-api[32394]: 2017-09-28 12:27:31.472 32394 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:27:31 ctl02 nova-api[32394]: 2017-09-28 12:27:31.472 32394 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:27:31 ctl02 nova-api[32394]: 2017-09-28 12:27:31.472 32394 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:27:31 ctl02 nova-api[32394]: 2017-09-28 12:27:31.472 32394 ERROR nova     sock.listen(backlog)
Sep 28 12:27:31 ctl02 nova-api[32394]: 2017-09-28 12:27:31.472 32394 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:27:31 ctl02 nova-api[32394]: 2017-09-28 12:27:31.472 32394 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:27:31 ctl02 nova-api[32394]: 2017-09-28 12:27:31.472 32394 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:27:31 ctl02 nova-api[32394]: 2017-09-28 12:27:31.472 32394 ERROR nova
Sep 28 12:27:31 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:27:31 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:27:31 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:27:31 ctl02 neutron-server[30536]: 2017-09-28 12:27:31.795 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:27:31] "OPTIONS / HTTP/1.0" 200 262 0.000612
Sep 28 12:27:31 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:27:31 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:27:31 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:27:31 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:27:32 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:27:32.574 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:27:32] "OPTIONS / HTTP/1.0" 200 134 0.000452
Sep 28 12:27:33 ctl02 nova-api[32412]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:27:33 ctl02 nova-api[32412]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:27:33 ctl02 nova-api[32412]: 2017-09-28 12:27:33.766 32412 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:27:33 ctl02 nova-api[32412]: 2017-09-28 12:27:33.768 32412 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:27:33 ctl02 nova-api[32412]: 2017-09-28 12:27:33.768 32412 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:27:33 ctl02 nova-api[32412]: 2017-09-28 12:27:33.768 32412 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:27:33 ctl02 nova-api[32412]: 2017-09-28 12:27:33.768 32412 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:27:33 ctl02 nova-api[32412]: 2017-09-28 12:27:33.768 32412 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:27:33 ctl02 nova-api[32412]: 2017-09-28 12:27:33.768 32412 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:27:33 ctl02 nova-api[32412]: 2017-09-28 12:27:33.768 32412 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:27:33 ctl02 nova-api[32412]: 2017-09-28 12:27:33.768 32412 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:27:33 ctl02 nova-api[32412]: 2017-09-28 12:27:33.768 32412 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:27:33 ctl02 nova-api[32412]: 2017-09-28 12:27:33.768 32412 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:27:33 ctl02 nova-api[32412]: 2017-09-28 12:27:33.768 32412 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:27:33 ctl02 nova-api[32412]: 2017-09-28 12:27:33.768 32412 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:27:33 ctl02 nova-api[32412]: 2017-09-28 12:27:33.768 32412 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:27:33 ctl02 nova-api[32412]: 2017-09-28 12:27:33.768 32412 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:27:33 ctl02 nova-api[32412]: 2017-09-28 12:27:33.768 32412 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:27:33 ctl02 nova-api[32412]: 2017-09-28 12:27:33.768 32412 ERROR nova.wsgi     self.filename))
Sep 28 12:27:33 ctl02 nova-api[32412]: 2017-09-28 12:27:33.768 32412 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:27:33 ctl02 nova-api[32412]: 2017-09-28 12:27:33.768 32412 ERROR nova.wsgi
Sep 28 12:27:33 ctl02 nova-api[32412]: 2017-09-28 12:27:33.770 32412 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:27:33 ctl02 glance-api[29183]: 2017-09-28 12:27:33.772 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:27:33] "OPTIONS / HTTP/1.0" 200 134 0.000645
Sep 28 12:27:33 ctl02 nova-api[32412]: 2017-09-28 12:27:33.904 32412 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:27:34 ctl02 nova-api[32412]: 2017-09-28 12:27:34.150 32412 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:27:34 ctl02 nova-api[32412]: 2017-09-28 12:27:34.152 32412 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:27:34 ctl02 nova-api[32412]: 2017-09-28 12:27:34.153 32412 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:27:34 ctl02 nova-api[32412]: 2017-09-28 12:27:34.153 32412 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:27:34 ctl02 nova-api[32412]: 2017-09-28 12:27:34.285 32412 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:27:34 ctl02 nova-api[32412]: 2017-09-28 12:27:34.288 32412 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:27:34 ctl02 nova-api[32412]: 2017-09-28 12:27:34.289 32412 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:27:34 ctl02 nova-api[32412]: 2017-09-28 12:27:34.289 32412 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:27:34 ctl02 nova-api[32412]: 2017-09-28 12:27:34.293 32412 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:27:34 ctl02 nova-api[32412]: 2017-09-28 12:27:34.293 32412 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:27:34 ctl02 nova-api[32412]: 2017-09-28 12:27:34.293 32412 ERROR nova Traceback (most recent call last):
Sep 28 12:27:34 ctl02 nova-api[32412]: 2017-09-28 12:27:34.293 32412 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:27:34 ctl02 nova-api[32412]: 2017-09-28 12:27:34.293 32412 ERROR nova     sys.exit(main())
Sep 28 12:27:34 ctl02 nova-api[32412]: 2017-09-28 12:27:34.293 32412 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:27:34 ctl02 nova-api[32412]: 2017-09-28 12:27:34.293 32412 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:27:34 ctl02 nova-api[32412]: 2017-09-28 12:27:34.293 32412 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:27:34 ctl02 nova-api[32412]: 2017-09-28 12:27:34.293 32412 ERROR nova     max_url_len=max_url_len)
Sep 28 12:27:34 ctl02 nova-api[32412]: 2017-09-28 12:27:34.293 32412 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:27:34 ctl02 nova-api[32412]: 2017-09-28 12:27:34.293 32412 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:27:34 ctl02 nova-api[32412]: 2017-09-28 12:27:34.293 32412 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:27:34 ctl02 nova-api[32412]: 2017-09-28 12:27:34.293 32412 ERROR nova     sock.listen(backlog)
Sep 28 12:27:34 ctl02 nova-api[32412]: 2017-09-28 12:27:34.293 32412 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:27:34 ctl02 nova-api[32412]: 2017-09-28 12:27:34.293 32412 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:27:34 ctl02 nova-api[32412]: 2017-09-28 12:27:34.293 32412 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:27:34 ctl02 nova-api[32412]: 2017-09-28 12:27:34.293 32412 ERROR nova
Sep 28 12:27:34 ctl02 glance-api[29183]: 2017-09-28 12:27:34.404 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:27:34] "OPTIONS / HTTP/1.0" 200 134 0.000995
Sep 28 12:27:34 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:27:34 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:27:34 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:27:34 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:27:34 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:27:34 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:27:34 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:27:35 ctl02 heat-api[13008]: 2017-09-28 12:27:35.555 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:27:35] "OPTIONS / HTTP/1.0" 200 134 0.000553
Sep 28 12:27:36 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:27:36.077 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:27:36] "OPTIONS / HTTP/1.0" 200 134 0.000552
Sep 28 12:27:36 ctl02 nova-api[32430]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:27:36 ctl02 nova-api[32430]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:27:36 ctl02 heat-api[13008]: 2017-09-28 12:27:36.354 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:27:36] "OPTIONS / HTTP/1.0" 200 134 0.000787
Sep 28 12:27:36 ctl02 neutron-server[30536]: 2017-09-28 12:27:36.457 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 1 dead agents out of 2:
Sep 28 12:27:36 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:27:36 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:23:57 cmp001
Sep 28 12:27:36 ctl02 nova-api[32430]: 2017-09-28 12:27:36.465 32430 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:27:36 ctl02 nova-api[32430]: 2017-09-28 12:27:36.466 32430 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:27:36 ctl02 nova-api[32430]: 2017-09-28 12:27:36.466 32430 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:27:36 ctl02 nova-api[32430]: 2017-09-28 12:27:36.466 32430 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:27:36 ctl02 nova-api[32430]: 2017-09-28 12:27:36.466 32430 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:27:36 ctl02 nova-api[32430]: 2017-09-28 12:27:36.466 32430 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:27:36 ctl02 nova-api[32430]: 2017-09-28 12:27:36.466 32430 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:27:36 ctl02 nova-api[32430]: 2017-09-28 12:27:36.466 32430 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:27:36 ctl02 nova-api[32430]: 2017-09-28 12:27:36.466 32430 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:27:36 ctl02 nova-api[32430]: 2017-09-28 12:27:36.466 32430 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:27:36 ctl02 nova-api[32430]: 2017-09-28 12:27:36.466 32430 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:27:36 ctl02 nova-api[32430]: 2017-09-28 12:27:36.466 32430 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:27:36 ctl02 nova-api[32430]: 2017-09-28 12:27:36.466 32430 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:27:36 ctl02 nova-api[32430]: 2017-09-28 12:27:36.466 32430 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:27:36 ctl02 nova-api[32430]: 2017-09-28 12:27:36.466 32430 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:27:36 ctl02 nova-api[32430]: 2017-09-28 12:27:36.466 32430 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:27:36 ctl02 nova-api[32430]: 2017-09-28 12:27:36.466 32430 ERROR nova.wsgi     self.filename))
Sep 28 12:27:36 ctl02 nova-api[32430]: 2017-09-28 12:27:36.466 32430 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:27:36 ctl02 nova-api[32430]: 2017-09-28 12:27:36.466 32430 ERROR nova.wsgi
Sep 28 12:27:36 ctl02 nova-api[32430]: 2017-09-28 12:27:36.467 32430 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:27:36 ctl02 nova-api[32430]: 2017-09-28 12:27:36.593 32430 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:27:36 ctl02 nova-api[32430]: 2017-09-28 12:27:36.814 32430 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:27:36 ctl02 nova-api[32430]: 2017-09-28 12:27:36.816 32430 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:27:36 ctl02 nova-api[32430]: 2017-09-28 12:27:36.817 32430 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:27:36 ctl02 nova-api[32430]: 2017-09-28 12:27:36.817 32430 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:27:36 ctl02 nova-api[32430]: 2017-09-28 12:27:36.946 32430 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:27:36 ctl02 nova-api[32430]: 2017-09-28 12:27:36.948 32430 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:27:36 ctl02 nova-api[32430]: 2017-09-28 12:27:36.948 32430 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:27:36 ctl02 nova-api[32430]: 2017-09-28 12:27:36.948 32430 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:27:36 ctl02 nova-api[32430]: 2017-09-28 12:27:36.952 32430 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:27:36 ctl02 nova-api[32430]: 2017-09-28 12:27:36.952 32430 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:27:36 ctl02 nova-api[32430]: 2017-09-28 12:27:36.952 32430 ERROR nova Traceback (most recent call last):
Sep 28 12:27:36 ctl02 nova-api[32430]: 2017-09-28 12:27:36.952 32430 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:27:36 ctl02 nova-api[32430]: 2017-09-28 12:27:36.952 32430 ERROR nova     sys.exit(main())
Sep 28 12:27:36 ctl02 nova-api[32430]: 2017-09-28 12:27:36.952 32430 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:27:36 ctl02 nova-api[32430]: 2017-09-28 12:27:36.952 32430 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:27:36 ctl02 nova-api[32430]: 2017-09-28 12:27:36.952 32430 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:27:36 ctl02 nova-api[32430]: 2017-09-28 12:27:36.952 32430 ERROR nova     max_url_len=max_url_len)
Sep 28 12:27:36 ctl02 nova-api[32430]: 2017-09-28 12:27:36.952 32430 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:27:36 ctl02 nova-api[32430]: 2017-09-28 12:27:36.952 32430 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:27:36 ctl02 nova-api[32430]: 2017-09-28 12:27:36.952 32430 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:27:36 ctl02 nova-api[32430]: 2017-09-28 12:27:36.952 32430 ERROR nova     sock.listen(backlog)
Sep 28 12:27:36 ctl02 nova-api[32430]: 2017-09-28 12:27:36.952 32430 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:27:36 ctl02 nova-api[32430]: 2017-09-28 12:27:36.952 32430 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:27:36 ctl02 nova-api[32430]: 2017-09-28 12:27:36.952 32430 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:27:36 ctl02 nova-api[32430]: 2017-09-28 12:27:36.952 32430 ERROR nova
Sep 28 12:27:36 ctl02 heat-api-cfn[13300]: 2017-09-28 12:27:36.976 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:27:36] "OPTIONS / HTTP/1.0" 200 134 0.000659
Sep 28 12:27:37 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:27:37 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:27:37 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:27:37 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:27:37 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:27:37 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:27:37 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:27:38 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x340a1955)
Sep 28 12:27:38 ctl02 heat-api[13008]: 2017-09-28 12:27:38.900 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:27:38] "OPTIONS / HTTP/1.0" 200 134 0.000625
Sep 28 12:27:38 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:27:38.963 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:27:38] "OPTIONS / HTTP/1.0" 200 134 0.000441
Sep 28 12:27:39 ctl02 nova-api[32448]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:27:39 ctl02 nova-api[32448]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:27:39 ctl02 heat-api-cfn[13300]: 2017-09-28 12:27:39.119 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:27:39] "OPTIONS / HTTP/1.0" 200 134 0.000560
Sep 28 12:27:39 ctl02 neutron-server[30536]: 2017-09-28 12:27:39.217 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:27:39] "OPTIONS / HTTP/1.0" 200 262 0.000524
Sep 28 12:27:39 ctl02 nova-api[32448]: 2017-09-28 12:27:39.277 32448 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:27:39 ctl02 nova-api[32448]: 2017-09-28 12:27:39.278 32448 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:27:39 ctl02 nova-api[32448]: 2017-09-28 12:27:39.278 32448 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:27:39 ctl02 nova-api[32448]: 2017-09-28 12:27:39.278 32448 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:27:39 ctl02 nova-api[32448]: 2017-09-28 12:27:39.278 32448 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:27:39 ctl02 nova-api[32448]: 2017-09-28 12:27:39.278 32448 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:27:39 ctl02 nova-api[32448]: 2017-09-28 12:27:39.278 32448 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:27:39 ctl02 nova-api[32448]: 2017-09-28 12:27:39.278 32448 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:27:39 ctl02 nova-api[32448]: 2017-09-28 12:27:39.278 32448 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:27:39 ctl02 nova-api[32448]: 2017-09-28 12:27:39.278 32448 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:27:39 ctl02 nova-api[32448]: 2017-09-28 12:27:39.278 32448 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:27:39 ctl02 nova-api[32448]: 2017-09-28 12:27:39.278 32448 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:27:39 ctl02 nova-api[32448]: 2017-09-28 12:27:39.278 32448 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:27:39 ctl02 nova-api[32448]: 2017-09-28 12:27:39.278 32448 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:27:39 ctl02 nova-api[32448]: 2017-09-28 12:27:39.278 32448 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:27:39 ctl02 nova-api[32448]: 2017-09-28 12:27:39.278 32448 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:27:39 ctl02 nova-api[32448]: 2017-09-28 12:27:39.278 32448 ERROR nova.wsgi     self.filename))
Sep 28 12:27:39 ctl02 nova-api[32448]: 2017-09-28 12:27:39.278 32448 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:27:39 ctl02 nova-api[32448]: 2017-09-28 12:27:39.278 32448 ERROR nova.wsgi
Sep 28 12:27:39 ctl02 nova-api[32448]: 2017-09-28 12:27:39.279 32448 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:27:39 ctl02 nova-api[32448]: 2017-09-28 12:27:39.407 32448 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:27:39 ctl02 heat-api-cfn[13300]: 2017-09-28 12:27:39.565 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:27:39] "OPTIONS / HTTP/1.0" 200 134 0.000469
Sep 28 12:27:39 ctl02 nova-api[32448]: 2017-09-28 12:27:39.630 32448 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:27:39 ctl02 nova-api[32448]: 2017-09-28 12:27:39.633 32448 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:27:39 ctl02 nova-api[32448]: 2017-09-28 12:27:39.633 32448 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:27:39 ctl02 nova-api[32448]: 2017-09-28 12:27:39.633 32448 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:27:39 ctl02 nova-api[32448]: 2017-09-28 12:27:39.764 32448 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:27:39 ctl02 nova-api[32448]: 2017-09-28 12:27:39.766 32448 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:27:39 ctl02 nova-api[32448]: 2017-09-28 12:27:39.766 32448 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:27:39 ctl02 nova-api[32448]: 2017-09-28 12:27:39.766 32448 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:27:39 ctl02 nova-api[32448]: 2017-09-28 12:27:39.769 32448 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:27:39 ctl02 nova-api[32448]: 2017-09-28 12:27:39.770 32448 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:27:39 ctl02 nova-api[32448]: 2017-09-28 12:27:39.770 32448 ERROR nova Traceback (most recent call last):
Sep 28 12:27:39 ctl02 nova-api[32448]: 2017-09-28 12:27:39.770 32448 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:27:39 ctl02 nova-api[32448]: 2017-09-28 12:27:39.770 32448 ERROR nova     sys.exit(main())
Sep 28 12:27:39 ctl02 nova-api[32448]: 2017-09-28 12:27:39.770 32448 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:27:39 ctl02 nova-api[32448]: 2017-09-28 12:27:39.770 32448 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:27:39 ctl02 nova-api[32448]: 2017-09-28 12:27:39.770 32448 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:27:39 ctl02 nova-api[32448]: 2017-09-28 12:27:39.770 32448 ERROR nova     max_url_len=max_url_len)
Sep 28 12:27:39 ctl02 nova-api[32448]: 2017-09-28 12:27:39.770 32448 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:27:39 ctl02 nova-api[32448]: 2017-09-28 12:27:39.770 32448 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:27:39 ctl02 nova-api[32448]: 2017-09-28 12:27:39.770 32448 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:27:39 ctl02 nova-api[32448]: 2017-09-28 12:27:39.770 32448 ERROR nova     sock.listen(backlog)
Sep 28 12:27:39 ctl02 nova-api[32448]: 2017-09-28 12:27:39.770 32448 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:27:39 ctl02 nova-api[32448]: 2017-09-28 12:27:39.770 32448 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:27:39 ctl02 nova-api[32448]: 2017-09-28 12:27:39.770 32448 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:27:39 ctl02 nova-api[32448]: 2017-09-28 12:27:39.770 32448 ERROR nova
Sep 28 12:27:39 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x340a1955)
Sep 28 12:27:39 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:27:39 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:27:39 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:27:40 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:27:40 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:27:40 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:27:40 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:27:40 ctl02 neutron-server[30536]: 2017-09-28 12:27:40.628 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:27:40] "OPTIONS / HTTP/1.0" 200 262 0.000482
Sep 28 12:27:40 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x340a1955)
Sep 28 12:27:41 ctl02 glance-api[29183]: 2017-09-28 12:27:41.200 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:27:41] "OPTIONS / HTTP/1.0" 200 134 0.000631
Sep 28 12:27:41 ctl02 nova-api[32466]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:27:41 ctl02 nova-api[32466]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:27:41 ctl02 neutron-server[30536]: 2017-09-28 12:27:41.808 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:27:41] "OPTIONS / HTTP/1.0" 200 262 0.000530
Sep 28 12:27:41 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x340a1955)
Sep 28 12:27:41 ctl02 nova-api[32466]: 2017-09-28 12:27:41.963 32466 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:27:41 ctl02 nova-api[32466]: 2017-09-28 12:27:41.964 32466 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:27:41 ctl02 nova-api[32466]: 2017-09-28 12:27:41.964 32466 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:27:41 ctl02 nova-api[32466]: 2017-09-28 12:27:41.964 32466 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:27:41 ctl02 nova-api[32466]: 2017-09-28 12:27:41.964 32466 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:27:41 ctl02 nova-api[32466]: 2017-09-28 12:27:41.964 32466 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:27:41 ctl02 nova-api[32466]: 2017-09-28 12:27:41.964 32466 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:27:41 ctl02 nova-api[32466]: 2017-09-28 12:27:41.964 32466 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:27:41 ctl02 nova-api[32466]: 2017-09-28 12:27:41.964 32466 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:27:41 ctl02 nova-api[32466]: 2017-09-28 12:27:41.964 32466 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:27:41 ctl02 nova-api[32466]: 2017-09-28 12:27:41.964 32466 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:27:41 ctl02 nova-api[32466]: 2017-09-28 12:27:41.964 32466 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:27:41 ctl02 nova-api[32466]: 2017-09-28 12:27:41.964 32466 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:27:41 ctl02 nova-api[32466]: 2017-09-28 12:27:41.964 32466 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:27:41 ctl02 nova-api[32466]: 2017-09-28 12:27:41.964 32466 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:27:41 ctl02 nova-api[32466]: 2017-09-28 12:27:41.964 32466 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:27:41 ctl02 nova-api[32466]: 2017-09-28 12:27:41.964 32466 ERROR nova.wsgi     self.filename))
Sep 28 12:27:41 ctl02 nova-api[32466]: 2017-09-28 12:27:41.964 32466 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:27:41 ctl02 nova-api[32466]: 2017-09-28 12:27:41.964 32466 ERROR nova.wsgi
Sep 28 12:27:41 ctl02 nova-api[32466]: 2017-09-28 12:27:41.967 32466 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:27:42 ctl02 nova-api[32466]: 2017-09-28 12:27:42.095 32466 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:27:42 ctl02 nova-api[32466]: 2017-09-28 12:27:42.321 32466 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:27:42 ctl02 nova-api[32466]: 2017-09-28 12:27:42.324 32466 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:27:42 ctl02 nova-api[32466]: 2017-09-28 12:27:42.324 32466 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:27:42 ctl02 nova-api[32466]: 2017-09-28 12:27:42.325 32466 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:27:42 ctl02 nova-api[32466]: 2017-09-28 12:27:42.457 32466 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:27:42 ctl02 nova-api[32466]: 2017-09-28 12:27:42.459 32466 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:27:42 ctl02 nova-api[32466]: 2017-09-28 12:27:42.460 32466 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:27:42 ctl02 nova-api[32466]: 2017-09-28 12:27:42.460 32466 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:27:42 ctl02 nova-api[32466]: 2017-09-28 12:27:42.463 32466 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:27:42 ctl02 nova-api[32466]: 2017-09-28 12:27:42.464 32466 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:27:42 ctl02 nova-api[32466]: 2017-09-28 12:27:42.464 32466 ERROR nova Traceback (most recent call last):
Sep 28 12:27:42 ctl02 nova-api[32466]: 2017-09-28 12:27:42.464 32466 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:27:42 ctl02 nova-api[32466]: 2017-09-28 12:27:42.464 32466 ERROR nova     sys.exit(main())
Sep 28 12:27:42 ctl02 nova-api[32466]: 2017-09-28 12:27:42.464 32466 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:27:42 ctl02 nova-api[32466]: 2017-09-28 12:27:42.464 32466 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:27:42 ctl02 nova-api[32466]: 2017-09-28 12:27:42.464 32466 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:27:42 ctl02 nova-api[32466]: 2017-09-28 12:27:42.464 32466 ERROR nova     max_url_len=max_url_len)
Sep 28 12:27:42 ctl02 nova-api[32466]: 2017-09-28 12:27:42.464 32466 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:27:42 ctl02 nova-api[32466]: 2017-09-28 12:27:42.464 32466 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:27:42 ctl02 nova-api[32466]: 2017-09-28 12:27:42.464 32466 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:27:42 ctl02 nova-api[32466]: 2017-09-28 12:27:42.464 32466 ERROR nova     sock.listen(backlog)
Sep 28 12:27:42 ctl02 nova-api[32466]: 2017-09-28 12:27:42.464 32466 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:27:42 ctl02 nova-api[32466]: 2017-09-28 12:27:42.464 32466 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:27:42 ctl02 nova-api[32466]: 2017-09-28 12:27:42.464 32466 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:27:42 ctl02 nova-api[32466]: 2017-09-28 12:27:42.464 32466 ERROR nova
Sep 28 12:27:42 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:27:42 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:27:42 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:27:42 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:27:42 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:27:42 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:27:42 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x340a1955)
Sep 28 12:27:42 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:27:42.971 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:27:42] "OPTIONS / HTTP/1.0" 200 134 0.000569
Sep 28 12:27:42 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:27:43 ctl02 neutron-server[30536]: 2017-09-28 12:27:43.487 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:27:43 ctl02 glance-api[29183]: 2017-09-28 12:27:43.813 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:27:43] "OPTIONS / HTTP/1.0" 200 134 0.000573
Sep 28 12:27:43 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x340a1955)
Sep 28 12:27:44 ctl02 nova-api[32485]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:27:44 ctl02 nova-api[32485]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:27:44 ctl02 glance-api[29183]: 2017-09-28 12:27:44.740 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:27:44] "OPTIONS / HTTP/1.0" 200 134 0.000634
Sep 28 12:27:44 ctl02 nova-api[32485]: 2017-09-28 12:27:44.819 32485 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:27:44 ctl02 nova-api[32485]: 2017-09-28 12:27:44.820 32485 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:27:44 ctl02 nova-api[32485]: 2017-09-28 12:27:44.820 32485 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:27:44 ctl02 nova-api[32485]: 2017-09-28 12:27:44.820 32485 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:27:44 ctl02 nova-api[32485]: 2017-09-28 12:27:44.820 32485 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:27:44 ctl02 nova-api[32485]: 2017-09-28 12:27:44.820 32485 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:27:44 ctl02 nova-api[32485]: 2017-09-28 12:27:44.820 32485 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:27:44 ctl02 nova-api[32485]: 2017-09-28 12:27:44.820 32485 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:27:44 ctl02 nova-api[32485]: 2017-09-28 12:27:44.820 32485 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:27:44 ctl02 nova-api[32485]: 2017-09-28 12:27:44.820 32485 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:27:44 ctl02 nova-api[32485]: 2017-09-28 12:27:44.820 32485 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:27:44 ctl02 nova-api[32485]: 2017-09-28 12:27:44.820 32485 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:27:44 ctl02 nova-api[32485]: 2017-09-28 12:27:44.820 32485 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:27:44 ctl02 nova-api[32485]: 2017-09-28 12:27:44.820 32485 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:27:44 ctl02 nova-api[32485]: 2017-09-28 12:27:44.820 32485 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:27:44 ctl02 nova-api[32485]: 2017-09-28 12:27:44.820 32485 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:27:44 ctl02 nova-api[32485]: 2017-09-28 12:27:44.820 32485 ERROR nova.wsgi     self.filename))
Sep 28 12:27:44 ctl02 nova-api[32485]: 2017-09-28 12:27:44.820 32485 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:27:44 ctl02 nova-api[32485]: 2017-09-28 12:27:44.820 32485 ERROR nova.wsgi
Sep 28 12:27:44 ctl02 nova-api[32485]: 2017-09-28 12:27:44.821 32485 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:27:44 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x340a1955)
Sep 28 12:27:44 ctl02 nova-api[32485]: 2017-09-28 12:27:44.950 32485 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:27:45 ctl02 nova-api[32485]: 2017-09-28 12:27:45.170 32485 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:27:45 ctl02 nova-api[32485]: 2017-09-28 12:27:45.172 32485 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:27:45 ctl02 nova-api[32485]: 2017-09-28 12:27:45.172 32485 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:27:45 ctl02 nova-api[32485]: 2017-09-28 12:27:45.172 32485 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:27:45 ctl02 heat-api[13008]: 2017-09-28 12:27:45.276 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:27:45] "OPTIONS / HTTP/1.0" 200 134 0.000596
Sep 28 12:27:45 ctl02 nova-api[32485]: 2017-09-28 12:27:45.303 32485 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:27:45 ctl02 nova-api[32485]: 2017-09-28 12:27:45.305 32485 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:27:45 ctl02 nova-api[32485]: 2017-09-28 12:27:45.305 32485 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:27:45 ctl02 nova-api[32485]: 2017-09-28 12:27:45.305 32485 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:27:45 ctl02 nova-api[32485]: 2017-09-28 12:27:45.309 32485 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:27:45 ctl02 nova-api[32485]: 2017-09-28 12:27:45.309 32485 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:27:45 ctl02 nova-api[32485]: 2017-09-28 12:27:45.309 32485 ERROR nova Traceback (most recent call last):
Sep 28 12:27:45 ctl02 nova-api[32485]: 2017-09-28 12:27:45.309 32485 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:27:45 ctl02 nova-api[32485]: 2017-09-28 12:27:45.309 32485 ERROR nova     sys.exit(main())
Sep 28 12:27:45 ctl02 nova-api[32485]: 2017-09-28 12:27:45.309 32485 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:27:45 ctl02 nova-api[32485]: 2017-09-28 12:27:45.309 32485 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:27:45 ctl02 nova-api[32485]: 2017-09-28 12:27:45.309 32485 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:27:45 ctl02 nova-api[32485]: 2017-09-28 12:27:45.309 32485 ERROR nova     max_url_len=max_url_len)
Sep 28 12:27:45 ctl02 nova-api[32485]: 2017-09-28 12:27:45.309 32485 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:27:45 ctl02 nova-api[32485]: 2017-09-28 12:27:45.309 32485 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:27:45 ctl02 nova-api[32485]: 2017-09-28 12:27:45.309 32485 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:27:45 ctl02 nova-api[32485]: 2017-09-28 12:27:45.309 32485 ERROR nova     sock.listen(backlog)
Sep 28 12:27:45 ctl02 nova-api[32485]: 2017-09-28 12:27:45.309 32485 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:27:45 ctl02 nova-api[32485]: 2017-09-28 12:27:45.309 32485 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:27:45 ctl02 nova-api[32485]: 2017-09-28 12:27:45.309 32485 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:27:45 ctl02 nova-api[32485]: 2017-09-28 12:27:45.309 32485 ERROR nova
Sep 28 12:27:45 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:27:45 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:27:45 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:27:45 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:27:45 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:27:45 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:27:45 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:27:45 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x340a1955)
Sep 28 12:27:46 ctl02 heat-api[13008]: 2017-09-28 12:27:46.013 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:27:46] "OPTIONS / HTTP/1.0" 200 134 0.000566
Sep 28 12:27:46 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:27:46.181 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:27:46] "OPTIONS / HTTP/1.0" 200 134 0.000406
Sep 28 12:27:46 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x340a1955)
Sep 28 12:27:47 ctl02 heat-api-cfn[13300]: 2017-09-28 12:27:47.309 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:27:47] "OPTIONS / HTTP/1.0" 200 134 0.000446
Sep 28 12:27:47 ctl02 nova-api[32503]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:27:47 ctl02 nova-api[32503]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:27:47 ctl02 nova-api[32503]: 2017-09-28 12:27:47.515 32503 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:27:47 ctl02 nova-api[32503]: 2017-09-28 12:27:47.517 32503 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:27:47 ctl02 nova-api[32503]: 2017-09-28 12:27:47.517 32503 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:27:47 ctl02 nova-api[32503]: 2017-09-28 12:27:47.517 32503 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:27:47 ctl02 nova-api[32503]: 2017-09-28 12:27:47.517 32503 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:27:47 ctl02 nova-api[32503]: 2017-09-28 12:27:47.517 32503 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:27:47 ctl02 nova-api[32503]: 2017-09-28 12:27:47.517 32503 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:27:47 ctl02 nova-api[32503]: 2017-09-28 12:27:47.517 32503 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:27:47 ctl02 nova-api[32503]: 2017-09-28 12:27:47.517 32503 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:27:47 ctl02 nova-api[32503]: 2017-09-28 12:27:47.517 32503 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:27:47 ctl02 nova-api[32503]: 2017-09-28 12:27:47.517 32503 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:27:47 ctl02 nova-api[32503]: 2017-09-28 12:27:47.517 32503 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:27:47 ctl02 nova-api[32503]: 2017-09-28 12:27:47.517 32503 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:27:47 ctl02 nova-api[32503]: 2017-09-28 12:27:47.517 32503 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:27:47 ctl02 nova-api[32503]: 2017-09-28 12:27:47.517 32503 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:27:47 ctl02 nova-api[32503]: 2017-09-28 12:27:47.517 32503 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:27:47 ctl02 nova-api[32503]: 2017-09-28 12:27:47.517 32503 ERROR nova.wsgi     self.filename))
Sep 28 12:27:47 ctl02 nova-api[32503]: 2017-09-28 12:27:47.517 32503 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:27:47 ctl02 nova-api[32503]: 2017-09-28 12:27:47.517 32503 ERROR nova.wsgi
Sep 28 12:27:47 ctl02 nova-api[32503]: 2017-09-28 12:27:47.518 32503 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:27:47 ctl02 nova-api[32503]: 2017-09-28 12:27:47.645 32503 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:27:47 ctl02 nova-api[32503]: 2017-09-28 12:27:47.868 32503 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:27:47 ctl02 nova-api[32503]: 2017-09-28 12:27:47.870 32503 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:27:47 ctl02 nova-api[32503]: 2017-09-28 12:27:47.870 32503 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:27:47 ctl02 nova-api[32503]: 2017-09-28 12:27:47.870 32503 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:27:47 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x340a1955)
Sep 28 12:27:48 ctl02 nova-api[32503]: 2017-09-28 12:27:48.006 32503 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:27:48 ctl02 nova-api[32503]: 2017-09-28 12:27:48.009 32503 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:27:48 ctl02 nova-api[32503]: 2017-09-28 12:27:48.009 32503 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:27:48 ctl02 nova-api[32503]: 2017-09-28 12:27:48.010 32503 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:27:48 ctl02 nova-api[32503]: 2017-09-28 12:27:48.013 32503 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:27:48 ctl02 nova-api[32503]: 2017-09-28 12:27:48.014 32503 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:27:48 ctl02 nova-api[32503]: 2017-09-28 12:27:48.014 32503 ERROR nova Traceback (most recent call last):
Sep 28 12:27:48 ctl02 nova-api[32503]: 2017-09-28 12:27:48.014 32503 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:27:48 ctl02 nova-api[32503]: 2017-09-28 12:27:48.014 32503 ERROR nova     sys.exit(main())
Sep 28 12:27:48 ctl02 nova-api[32503]: 2017-09-28 12:27:48.014 32503 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:27:48 ctl02 nova-api[32503]: 2017-09-28 12:27:48.014 32503 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:27:48 ctl02 nova-api[32503]: 2017-09-28 12:27:48.014 32503 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:27:48 ctl02 nova-api[32503]: 2017-09-28 12:27:48.014 32503 ERROR nova     max_url_len=max_url_len)
Sep 28 12:27:48 ctl02 nova-api[32503]: 2017-09-28 12:27:48.014 32503 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:27:48 ctl02 nova-api[32503]: 2017-09-28 12:27:48.014 32503 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:27:48 ctl02 nova-api[32503]: 2017-09-28 12:27:48.014 32503 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:27:48 ctl02 nova-api[32503]: 2017-09-28 12:27:48.014 32503 ERROR nova     sock.listen(backlog)
Sep 28 12:27:48 ctl02 nova-api[32503]: 2017-09-28 12:27:48.014 32503 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:27:48 ctl02 nova-api[32503]: 2017-09-28 12:27:48.014 32503 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:27:48 ctl02 nova-api[32503]: 2017-09-28 12:27:48.014 32503 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:27:48 ctl02 nova-api[32503]: 2017-09-28 12:27:48.014 32503 ERROR nova
Sep 28 12:27:48 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:27:48 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:27:48 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:27:48 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:27:48 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:27:48 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:27:48 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:27:48 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:27:48.626 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:27:48] "OPTIONS / HTTP/1.0" 200 134 0.000486
Sep 28 12:27:48 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x340a1955)
Sep 28 12:27:49 ctl02 heat-api[13008]: 2017-09-28 12:27:49.023 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:27:49] "OPTIONS / HTTP/1.0" 200 134 0.000644
Sep 28 12:27:49 ctl02 heat-api-cfn[13300]: 2017-09-28 12:27:49.092 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:27:49] "OPTIONS / HTTP/1.0" 200 134 0.000484
Sep 28 12:27:49 ctl02 neutron-server[30536]: 2017-09-28 12:27:49.426 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:27:49] "OPTIONS / HTTP/1.0" 200 262 0.000521
Sep 28 12:27:49 ctl02 nova-cert[4860]: 2017-09-28 12:27:49.587 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:27:49 ctl02 heat-api-cfn[13300]: 2017-09-28 12:27:49.869 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:27:49] "OPTIONS / HTTP/1.0" 200 134 0.000570
Sep 28 12:27:49 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:27:49 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:27:50 ctl02 nova-api[32521]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:27:50 ctl02 nova-api[32521]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:27:50 ctl02 nova-api[32521]: 2017-09-28 12:27:50.298 32521 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:27:50 ctl02 nova-api[32521]: 2017-09-28 12:27:50.300 32521 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:27:50 ctl02 nova-api[32521]: 2017-09-28 12:27:50.300 32521 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:27:50 ctl02 nova-api[32521]: 2017-09-28 12:27:50.300 32521 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:27:50 ctl02 nova-api[32521]: 2017-09-28 12:27:50.300 32521 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:27:50 ctl02 nova-api[32521]: 2017-09-28 12:27:50.300 32521 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:27:50 ctl02 nova-api[32521]: 2017-09-28 12:27:50.300 32521 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:27:50 ctl02 nova-api[32521]: 2017-09-28 12:27:50.300 32521 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:27:50 ctl02 nova-api[32521]: 2017-09-28 12:27:50.300 32521 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:27:50 ctl02 nova-api[32521]: 2017-09-28 12:27:50.300 32521 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:27:50 ctl02 nova-api[32521]: 2017-09-28 12:27:50.300 32521 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:27:50 ctl02 nova-api[32521]: 2017-09-28 12:27:50.300 32521 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:27:50 ctl02 nova-api[32521]: 2017-09-28 12:27:50.300 32521 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:27:50 ctl02 nova-api[32521]: 2017-09-28 12:27:50.300 32521 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:27:50 ctl02 nova-api[32521]: 2017-09-28 12:27:50.300 32521 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:27:50 ctl02 nova-api[32521]: 2017-09-28 12:27:50.300 32521 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:27:50 ctl02 nova-api[32521]: 2017-09-28 12:27:50.300 32521 ERROR nova.wsgi     self.filename))
Sep 28 12:27:50 ctl02 nova-api[32521]: 2017-09-28 12:27:50.300 32521 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:27:50 ctl02 nova-api[32521]: 2017-09-28 12:27:50.300 32521 ERROR nova.wsgi
Sep 28 12:27:50 ctl02 nova-api[32521]: 2017-09-28 12:27:50.302 32521 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:27:50 ctl02 nova-api[32521]: 2017-09-28 12:27:50.436 32521 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:27:50 ctl02 neutron-server[30536]: 2017-09-28 12:27:50.659 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:27:50] "OPTIONS / HTTP/1.0" 200 262 0.000488
Sep 28 12:27:50 ctl02 nova-api[32521]: 2017-09-28 12:27:50.677 32521 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:27:50 ctl02 nova-api[32521]: 2017-09-28 12:27:50.680 32521 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:27:50 ctl02 nova-api[32521]: 2017-09-28 12:27:50.680 32521 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:27:50 ctl02 nova-api[32521]: 2017-09-28 12:27:50.681 32521 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:27:50 ctl02 nova-conductor[5056]: 2017-09-28 12:27:50.699 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:27:50 ctl02 nova-conductor[5056]: 2017-09-28 12:27:50.706 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:27:50 ctl02 nova-conductor[5056]: 2017-09-28 12:27:50.727 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:27:50 ctl02 nova-conductor[5056]: 2017-09-28 12:27:50.737 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:27:50 ctl02 nova-api[32521]: 2017-09-28 12:27:50.820 32521 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:27:50 ctl02 nova-api[32521]: 2017-09-28 12:27:50.822 32521 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:27:50 ctl02 nova-api[32521]: 2017-09-28 12:27:50.823 32521 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:27:50 ctl02 nova-api[32521]: 2017-09-28 12:27:50.823 32521 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:27:50 ctl02 nova-api[32521]: 2017-09-28 12:27:50.827 32521 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:27:50 ctl02 nova-api[32521]: 2017-09-28 12:27:50.828 32521 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:27:50 ctl02 nova-api[32521]: 2017-09-28 12:27:50.828 32521 ERROR nova Traceback (most recent call last):
Sep 28 12:27:50 ctl02 nova-api[32521]: 2017-09-28 12:27:50.828 32521 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:27:50 ctl02 nova-api[32521]: 2017-09-28 12:27:50.828 32521 ERROR nova     sys.exit(main())
Sep 28 12:27:50 ctl02 nova-api[32521]: 2017-09-28 12:27:50.828 32521 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:27:50 ctl02 nova-api[32521]: 2017-09-28 12:27:50.828 32521 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:27:50 ctl02 nova-api[32521]: 2017-09-28 12:27:50.828 32521 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:27:50 ctl02 nova-api[32521]: 2017-09-28 12:27:50.828 32521 ERROR nova     max_url_len=max_url_len)
Sep 28 12:27:50 ctl02 nova-api[32521]: 2017-09-28 12:27:50.828 32521 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:27:50 ctl02 nova-api[32521]: 2017-09-28 12:27:50.828 32521 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:27:50 ctl02 nova-api[32521]: 2017-09-28 12:27:50.828 32521 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:27:50 ctl02 nova-api[32521]: 2017-09-28 12:27:50.828 32521 ERROR nova     sock.listen(backlog)
Sep 28 12:27:50 ctl02 nova-api[32521]: 2017-09-28 12:27:50.828 32521 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:27:50 ctl02 nova-api[32521]: 2017-09-28 12:27:50.828 32521 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:27:50 ctl02 nova-api[32521]: 2017-09-28 12:27:50.828 32521 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:27:50 ctl02 nova-api[32521]: 2017-09-28 12:27:50.828 32521 ERROR nova
Sep 28 12:27:50 ctl02 glance-api[29183]: 2017-09-28 12:27:50.868 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:27:50] "OPTIONS / HTTP/1.0" 200 134 0.000665
Sep 28 12:27:50 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:27:50 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:27:50 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:27:51 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:27:51 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:27:51 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:27:51 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:27:51 ctl02 neutron-server[30536]: 2017-09-28 12:27:51.453 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 1 dead agents out of 2:
Sep 28 12:27:51 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:27:51 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:23:57 cmp001
Sep 28 12:27:51 ctl02 neutron-server[30536]: 2017-09-28 12:27:51.718 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:27:51] "OPTIONS / HTTP/1.0" 200 262 0.000464
Sep 28 12:27:52 ctl02 nova-api[32544]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:27:52 ctl02 nova-api[32544]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:27:52 ctl02 nova-api[32544]: 2017-09-28 12:27:52.973 32544 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:27:52 ctl02 nova-api[32544]: 2017-09-28 12:27:52.975 32544 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:27:52 ctl02 nova-api[32544]: 2017-09-28 12:27:52.975 32544 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:27:52 ctl02 nova-api[32544]: 2017-09-28 12:27:52.975 32544 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:27:52 ctl02 nova-api[32544]: 2017-09-28 12:27:52.975 32544 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:27:52 ctl02 nova-api[32544]: 2017-09-28 12:27:52.975 32544 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:27:52 ctl02 nova-api[32544]: 2017-09-28 12:27:52.975 32544 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:27:52 ctl02 nova-api[32544]: 2017-09-28 12:27:52.975 32544 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:27:52 ctl02 nova-api[32544]: 2017-09-28 12:27:52.975 32544 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:27:52 ctl02 nova-api[32544]: 2017-09-28 12:27:52.975 32544 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:27:52 ctl02 nova-api[32544]: 2017-09-28 12:27:52.975 32544 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:27:52 ctl02 nova-api[32544]: 2017-09-28 12:27:52.975 32544 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:27:52 ctl02 nova-api[32544]: 2017-09-28 12:27:52.975 32544 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:27:52 ctl02 nova-api[32544]: 2017-09-28 12:27:52.975 32544 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:27:52 ctl02 nova-api[32544]: 2017-09-28 12:27:52.975 32544 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:27:52 ctl02 nova-api[32544]: 2017-09-28 12:27:52.975 32544 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:27:52 ctl02 nova-api[32544]: 2017-09-28 12:27:52.975 32544 ERROR nova.wsgi     self.filename))
Sep 28 12:27:52 ctl02 nova-api[32544]: 2017-09-28 12:27:52.975 32544 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:27:52 ctl02 nova-api[32544]: 2017-09-28 12:27:52.975 32544 ERROR nova.wsgi
Sep 28 12:27:52 ctl02 nova-api[32544]: 2017-09-28 12:27:52.976 32544 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:27:53 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:27:53.019 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:27:53] "OPTIONS / HTTP/1.0" 200 134 0.000531
Sep 28 12:27:53 ctl02 nova-api[32544]: 2017-09-28 12:27:53.102 32544 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:27:53 ctl02 nova-api[32544]: 2017-09-28 12:27:53.324 32544 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:27:53 ctl02 nova-api[32544]: 2017-09-28 12:27:53.327 32544 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:27:53 ctl02 nova-api[32544]: 2017-09-28 12:27:53.327 32544 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:27:53 ctl02 nova-api[32544]: 2017-09-28 12:27:53.327 32544 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:27:53 ctl02 nova-api[32544]: 2017-09-28 12:27:53.458 32544 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:27:53 ctl02 nova-api[32544]: 2017-09-28 12:27:53.460 32544 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:27:53 ctl02 nova-api[32544]: 2017-09-28 12:27:53.460 32544 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:27:53 ctl02 nova-api[32544]: 2017-09-28 12:27:53.460 32544 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:27:53 ctl02 nova-api[32544]: 2017-09-28 12:27:53.463 32544 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:27:53 ctl02 nova-api[32544]: 2017-09-28 12:27:53.464 32544 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:27:53 ctl02 nova-api[32544]: 2017-09-28 12:27:53.464 32544 ERROR nova Traceback (most recent call last):
Sep 28 12:27:53 ctl02 nova-api[32544]: 2017-09-28 12:27:53.464 32544 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:27:53 ctl02 nova-api[32544]: 2017-09-28 12:27:53.464 32544 ERROR nova     sys.exit(main())
Sep 28 12:27:53 ctl02 nova-api[32544]: 2017-09-28 12:27:53.464 32544 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:27:53 ctl02 nova-api[32544]: 2017-09-28 12:27:53.464 32544 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:27:53 ctl02 nova-api[32544]: 2017-09-28 12:27:53.464 32544 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:27:53 ctl02 nova-api[32544]: 2017-09-28 12:27:53.464 32544 ERROR nova     max_url_len=max_url_len)
Sep 28 12:27:53 ctl02 nova-api[32544]: 2017-09-28 12:27:53.464 32544 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:27:53 ctl02 nova-api[32544]: 2017-09-28 12:27:53.464 32544 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:27:53 ctl02 nova-api[32544]: 2017-09-28 12:27:53.464 32544 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:27:53 ctl02 nova-api[32544]: 2017-09-28 12:27:53.464 32544 ERROR nova     sock.listen(backlog)
Sep 28 12:27:53 ctl02 nova-api[32544]: 2017-09-28 12:27:53.464 32544 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:27:53 ctl02 nova-api[32544]: 2017-09-28 12:27:53.464 32544 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:27:53 ctl02 nova-api[32544]: 2017-09-28 12:27:53.464 32544 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:27:53 ctl02 nova-api[32544]: 2017-09-28 12:27:53.464 32544 ERROR nova
Sep 28 12:27:53 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:27:53 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:27:53 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:27:53 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:27:53 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:27:53 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:27:53 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:27:54 ctl02 glance-api[29183]: 2017-09-28 12:27:54.171 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:27:54] "OPTIONS / HTTP/1.0" 200 134 0.001210
Sep 28 12:27:54 ctl02 glance-api[29183]: 2017-09-28 12:27:54.903 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:27:54] "OPTIONS / HTTP/1.0" 200 134 0.000580
Sep 28 12:27:55 ctl02 heat-api[13008]: 2017-09-28 12:27:55.451 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:27:55] "OPTIONS / HTTP/1.0" 200 134 0.000649
Sep 28 12:27:55 ctl02 nova-api[32562]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:27:55 ctl02 nova-api[32562]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:27:55 ctl02 nova-api[32562]: 2017-09-28 12:27:55.772 32562 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:27:55 ctl02 nova-api[32562]: 2017-09-28 12:27:55.774 32562 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:27:55 ctl02 nova-api[32562]: 2017-09-28 12:27:55.774 32562 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:27:55 ctl02 nova-api[32562]: 2017-09-28 12:27:55.774 32562 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:27:55 ctl02 nova-api[32562]: 2017-09-28 12:27:55.774 32562 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:27:55 ctl02 nova-api[32562]: 2017-09-28 12:27:55.774 32562 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:27:55 ctl02 nova-api[32562]: 2017-09-28 12:27:55.774 32562 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:27:55 ctl02 nova-api[32562]: 2017-09-28 12:27:55.774 32562 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:27:55 ctl02 nova-api[32562]: 2017-09-28 12:27:55.774 32562 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:27:55 ctl02 nova-api[32562]: 2017-09-28 12:27:55.774 32562 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:27:55 ctl02 nova-api[32562]: 2017-09-28 12:27:55.774 32562 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:27:55 ctl02 nova-api[32562]: 2017-09-28 12:27:55.774 32562 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:27:55 ctl02 nova-api[32562]: 2017-09-28 12:27:55.774 32562 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:27:55 ctl02 nova-api[32562]: 2017-09-28 12:27:55.774 32562 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:27:55 ctl02 nova-api[32562]: 2017-09-28 12:27:55.774 32562 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:27:55 ctl02 nova-api[32562]: 2017-09-28 12:27:55.774 32562 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:27:55 ctl02 nova-api[32562]: 2017-09-28 12:27:55.774 32562 ERROR nova.wsgi     self.filename))
Sep 28 12:27:55 ctl02 nova-api[32562]: 2017-09-28 12:27:55.774 32562 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:27:55 ctl02 nova-api[32562]: 2017-09-28 12:27:55.774 32562 ERROR nova.wsgi
Sep 28 12:27:55 ctl02 nova-api[32562]: 2017-09-28 12:27:55.778 32562 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:27:55 ctl02 nova-api[32562]: 2017-09-28 12:27:55.904 32562 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:27:55 ctl02 heat-api[13008]: 2017-09-28 12:27:55.945 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:27:55] "OPTIONS / HTTP/1.0" 200 134 0.000510
Sep 28 12:27:56 ctl02 nova-api[32562]: 2017-09-28 12:27:56.131 32562 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:27:56 ctl02 nova-api[32562]: 2017-09-28 12:27:56.134 32562 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:27:56 ctl02 nova-api[32562]: 2017-09-28 12:27:56.134 32562 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:27:56 ctl02 nova-api[32562]: 2017-09-28 12:27:56.134 32562 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:27:56 ctl02 nova-api[32562]: 2017-09-28 12:27:56.262 32562 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:27:56 ctl02 nova-api[32562]: 2017-09-28 12:27:56.264 32562 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:27:56 ctl02 nova-api[32562]: 2017-09-28 12:27:56.264 32562 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:27:56 ctl02 nova-api[32562]: 2017-09-28 12:27:56.265 32562 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:27:56 ctl02 nova-api[32562]: 2017-09-28 12:27:56.268 32562 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:27:56 ctl02 nova-api[32562]: 2017-09-28 12:27:56.268 32562 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:27:56 ctl02 nova-api[32562]: 2017-09-28 12:27:56.268 32562 ERROR nova Traceback (most recent call last):
Sep 28 12:27:56 ctl02 nova-api[32562]: 2017-09-28 12:27:56.268 32562 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:27:56 ctl02 nova-api[32562]: 2017-09-28 12:27:56.268 32562 ERROR nova     sys.exit(main())
Sep 28 12:27:56 ctl02 nova-api[32562]: 2017-09-28 12:27:56.268 32562 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:27:56 ctl02 nova-api[32562]: 2017-09-28 12:27:56.268 32562 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:27:56 ctl02 nova-api[32562]: 2017-09-28 12:27:56.268 32562 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:27:56 ctl02 nova-api[32562]: 2017-09-28 12:27:56.268 32562 ERROR nova     max_url_len=max_url_len)
Sep 28 12:27:56 ctl02 nova-api[32562]: 2017-09-28 12:27:56.268 32562 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:27:56 ctl02 nova-api[32562]: 2017-09-28 12:27:56.268 32562 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:27:56 ctl02 nova-api[32562]: 2017-09-28 12:27:56.268 32562 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:27:56 ctl02 nova-api[32562]: 2017-09-28 12:27:56.268 32562 ERROR nova     sock.listen(backlog)
Sep 28 12:27:56 ctl02 nova-api[32562]: 2017-09-28 12:27:56.268 32562 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:27:56 ctl02 nova-api[32562]: 2017-09-28 12:27:56.268 32562 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:27:56 ctl02 nova-api[32562]: 2017-09-28 12:27:56.268 32562 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:27:56 ctl02 nova-api[32562]: 2017-09-28 12:27:56.268 32562 ERROR nova
Sep 28 12:27:56 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:27:56.314 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:27:56] "OPTIONS / HTTP/1.0" 200 134 0.000432
Sep 28 12:27:56 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:27:56 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:27:56 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:27:56 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:27:56 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:27:56 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:27:56 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:27:57 ctl02 heat-api-cfn[13300]: 2017-09-28 12:27:57.710 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:27:57] "OPTIONS / HTTP/1.0" 200 134 0.000612
Sep 28 12:27:58 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:27:58.257 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:27:58] "OPTIONS / HTTP/1.0" 200 134 0.000396
Sep 28 12:27:58 ctl02 nova-api[32580]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:27:58 ctl02 nova-api[32580]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:27:58 ctl02 nova-api[32580]: 2017-09-28 12:27:58.474 32580 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:27:58 ctl02 nova-api[32580]: 2017-09-28 12:27:58.475 32580 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:27:58 ctl02 nova-api[32580]: 2017-09-28 12:27:58.475 32580 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:27:58 ctl02 nova-api[32580]: 2017-09-28 12:27:58.475 32580 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:27:58 ctl02 nova-api[32580]: 2017-09-28 12:27:58.475 32580 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:27:58 ctl02 nova-api[32580]: 2017-09-28 12:27:58.475 32580 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:27:58 ctl02 nova-api[32580]: 2017-09-28 12:27:58.475 32580 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:27:58 ctl02 nova-api[32580]: 2017-09-28 12:27:58.475 32580 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:27:58 ctl02 nova-api[32580]: 2017-09-28 12:27:58.475 32580 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:27:58 ctl02 nova-api[32580]: 2017-09-28 12:27:58.475 32580 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:27:58 ctl02 nova-api[32580]: 2017-09-28 12:27:58.475 32580 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:27:58 ctl02 nova-api[32580]: 2017-09-28 12:27:58.475 32580 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:27:58 ctl02 nova-api[32580]: 2017-09-28 12:27:58.475 32580 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:27:58 ctl02 nova-api[32580]: 2017-09-28 12:27:58.475 32580 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:27:58 ctl02 nova-api[32580]: 2017-09-28 12:27:58.475 32580 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:27:58 ctl02 nova-api[32580]: 2017-09-28 12:27:58.475 32580 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:27:58 ctl02 nova-api[32580]: 2017-09-28 12:27:58.475 32580 ERROR nova.wsgi     self.filename))
Sep 28 12:27:58 ctl02 nova-api[32580]: 2017-09-28 12:27:58.475 32580 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:27:58 ctl02 nova-api[32580]: 2017-09-28 12:27:58.475 32580 ERROR nova.wsgi
Sep 28 12:27:58 ctl02 nova-api[32580]: 2017-09-28 12:27:58.476 32580 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:27:58 ctl02 neutron-server[30536]: 2017-09-28 12:27:58.489 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:27:58 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfff9be46)
Sep 28 12:27:58 ctl02 nova-api[32580]: 2017-09-28 12:27:58.608 32580 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:27:58 ctl02 heat-api[13008]: 2017-09-28 12:27:58.769 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:27:58] "OPTIONS / HTTP/1.0" 200 134 0.000510
Sep 28 12:27:58 ctl02 nova-api[32580]: 2017-09-28 12:27:58.828 32580 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:27:58 ctl02 nova-api[32580]: 2017-09-28 12:27:58.830 32580 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:27:58 ctl02 nova-api[32580]: 2017-09-28 12:27:58.830 32580 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:27:58 ctl02 nova-api[32580]: 2017-09-28 12:27:58.830 32580 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:27:58 ctl02 nova-api[32580]: 2017-09-28 12:27:58.962 32580 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:27:58 ctl02 nova-api[32580]: 2017-09-28 12:27:58.964 32580 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:27:58 ctl02 nova-api[32580]: 2017-09-28 12:27:58.964 32580 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:27:58 ctl02 nova-api[32580]: 2017-09-28 12:27:58.965 32580 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:27:58 ctl02 nova-api[32580]: 2017-09-28 12:27:58.968 32580 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:27:58 ctl02 nova-api[32580]: 2017-09-28 12:27:58.968 32580 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:27:58 ctl02 nova-api[32580]: 2017-09-28 12:27:58.968 32580 ERROR nova Traceback (most recent call last):
Sep 28 12:27:58 ctl02 nova-api[32580]: 2017-09-28 12:27:58.968 32580 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:27:58 ctl02 nova-api[32580]: 2017-09-28 12:27:58.968 32580 ERROR nova     sys.exit(main())
Sep 28 12:27:58 ctl02 nova-api[32580]: 2017-09-28 12:27:58.968 32580 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:27:58 ctl02 nova-api[32580]: 2017-09-28 12:27:58.968 32580 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:27:58 ctl02 nova-api[32580]: 2017-09-28 12:27:58.968 32580 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:27:58 ctl02 nova-api[32580]: 2017-09-28 12:27:58.968 32580 ERROR nova     max_url_len=max_url_len)
Sep 28 12:27:58 ctl02 nova-api[32580]: 2017-09-28 12:27:58.968 32580 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:27:58 ctl02 nova-api[32580]: 2017-09-28 12:27:58.968 32580 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:27:58 ctl02 nova-api[32580]: 2017-09-28 12:27:58.968 32580 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:27:58 ctl02 nova-api[32580]: 2017-09-28 12:27:58.968 32580 ERROR nova     sock.listen(backlog)
Sep 28 12:27:58 ctl02 nova-api[32580]: 2017-09-28 12:27:58.968 32580 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:27:58 ctl02 nova-api[32580]: 2017-09-28 12:27:58.968 32580 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:27:58 ctl02 nova-api[32580]: 2017-09-28 12:27:58.968 32580 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:27:58 ctl02 nova-api[32580]: 2017-09-28 12:27:58.968 32580 ERROR nova
Sep 28 12:27:59 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:27:59 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:27:59 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:27:59 ctl02 neutron-server[30536]: 2017-09-28 12:27:59.163 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:27:59] "OPTIONS / HTTP/1.0" 200 262 0.000616
Sep 28 12:27:59 ctl02 heat-api-cfn[13300]: 2017-09-28 12:27:59.203 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:27:59] "OPTIONS / HTTP/1.0" 200 134 0.000509
Sep 28 12:27:59 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:27:59 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:27:59 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:27:59 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:27:59 ctl02 nova-consoleauth[5433]: 2017-09-28 12:27:59.474 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:27:59 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfff9be46)
Sep 28 12:28:00 ctl02 heat-api-cfn[13300]: 2017-09-28 12:28:00.119 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:28:00] "OPTIONS / HTTP/1.0" 200 134 0.000664
Sep 28 12:28:00 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfff9be46)
Sep 28 12:28:00 ctl02 neutron-server[30536]: 2017-09-28 12:28:00.922 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:28:00] "OPTIONS / HTTP/1.0" 200 262 0.000458
Sep 28 12:28:01 ctl02 nova-api[32598]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:28:01 ctl02 nova-api[32598]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:28:01 ctl02 glance-api[29183]: 2017-09-28 12:28:01.068 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:28:01] "OPTIONS / HTTP/1.0" 200 134 0.000606
Sep 28 12:28:01 ctl02 nova-api[32598]: 2017-09-28 12:28:01.241 32598 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:28:01 ctl02 nova-api[32598]: 2017-09-28 12:28:01.242 32598 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:28:01 ctl02 nova-api[32598]: 2017-09-28 12:28:01.242 32598 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:28:01 ctl02 nova-api[32598]: 2017-09-28 12:28:01.242 32598 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:28:01 ctl02 nova-api[32598]: 2017-09-28 12:28:01.242 32598 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:28:01 ctl02 nova-api[32598]: 2017-09-28 12:28:01.242 32598 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:28:01 ctl02 nova-api[32598]: 2017-09-28 12:28:01.242 32598 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:28:01 ctl02 nova-api[32598]: 2017-09-28 12:28:01.242 32598 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:28:01 ctl02 nova-api[32598]: 2017-09-28 12:28:01.242 32598 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:28:01 ctl02 nova-api[32598]: 2017-09-28 12:28:01.242 32598 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:28:01 ctl02 nova-api[32598]: 2017-09-28 12:28:01.242 32598 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:28:01 ctl02 nova-api[32598]: 2017-09-28 12:28:01.242 32598 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:28:01 ctl02 nova-api[32598]: 2017-09-28 12:28:01.242 32598 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:28:01 ctl02 nova-api[32598]: 2017-09-28 12:28:01.242 32598 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:28:01 ctl02 nova-api[32598]: 2017-09-28 12:28:01.242 32598 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:28:01 ctl02 nova-api[32598]: 2017-09-28 12:28:01.242 32598 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:28:01 ctl02 nova-api[32598]: 2017-09-28 12:28:01.242 32598 ERROR nova.wsgi     self.filename))
Sep 28 12:28:01 ctl02 nova-api[32598]: 2017-09-28 12:28:01.242 32598 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:28:01 ctl02 nova-api[32598]: 2017-09-28 12:28:01.242 32598 ERROR nova.wsgi
Sep 28 12:28:01 ctl02 nova-api[32598]: 2017-09-28 12:28:01.243 32598 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:28:01 ctl02 nova-api[32598]: 2017-09-28 12:28:01.370 32598 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:28:01 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfff9be46)
Sep 28 12:28:01 ctl02 nova-api[32598]: 2017-09-28 12:28:01.594 32598 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:28:01 ctl02 nova-api[32598]: 2017-09-28 12:28:01.597 32598 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:28:01 ctl02 nova-api[32598]: 2017-09-28 12:28:01.597 32598 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:28:01 ctl02 nova-api[32598]: 2017-09-28 12:28:01.597 32598 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:28:01 ctl02 nova-api[32598]: 2017-09-28 12:28:01.729 32598 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:28:01 ctl02 nova-api[32598]: 2017-09-28 12:28:01.731 32598 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:28:01 ctl02 nova-api[32598]: 2017-09-28 12:28:01.731 32598 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:28:01 ctl02 nova-api[32598]: 2017-09-28 12:28:01.732 32598 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:28:01 ctl02 nova-api[32598]: 2017-09-28 12:28:01.735 32598 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:28:01 ctl02 nova-api[32598]: 2017-09-28 12:28:01.735 32598 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:28:01 ctl02 nova-api[32598]: 2017-09-28 12:28:01.735 32598 ERROR nova Traceback (most recent call last):
Sep 28 12:28:01 ctl02 nova-api[32598]: 2017-09-28 12:28:01.735 32598 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:28:01 ctl02 nova-api[32598]: 2017-09-28 12:28:01.735 32598 ERROR nova     sys.exit(main())
Sep 28 12:28:01 ctl02 nova-api[32598]: 2017-09-28 12:28:01.735 32598 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:28:01 ctl02 nova-api[32598]: 2017-09-28 12:28:01.735 32598 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:28:01 ctl02 nova-api[32598]: 2017-09-28 12:28:01.735 32598 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:28:01 ctl02 nova-api[32598]: 2017-09-28 12:28:01.735 32598 ERROR nova     max_url_len=max_url_len)
Sep 28 12:28:01 ctl02 nova-api[32598]: 2017-09-28 12:28:01.735 32598 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:28:01 ctl02 nova-api[32598]: 2017-09-28 12:28:01.735 32598 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:28:01 ctl02 nova-api[32598]: 2017-09-28 12:28:01.735 32598 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:28:01 ctl02 nova-api[32598]: 2017-09-28 12:28:01.735 32598 ERROR nova     sock.listen(backlog)
Sep 28 12:28:01 ctl02 nova-api[32598]: 2017-09-28 12:28:01.735 32598 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:28:01 ctl02 nova-api[32598]: 2017-09-28 12:28:01.735 32598 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:28:01 ctl02 nova-api[32598]: 2017-09-28 12:28:01.735 32598 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:28:01 ctl02 nova-api[32598]: 2017-09-28 12:28:01.735 32598 ERROR nova
Sep 28 12:28:01 ctl02 heat-engine[12803]: 2017-09-28 12:28:01.818 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:28:01 ctl02 heat-engine[12803]: 2017-09-28 12:28:01.821 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:28:01 ctl02 heat-engine[12803]: 2017-09-28 12:28:01.827 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:28:01 ctl02 heat-engine[12803]: 2017-09-28 12:28:01.830 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:28:01 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:28:01 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:28:01 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:28:02 ctl02 neutron-server[30536]: 2017-09-28 12:28:02.104 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:28:02] "OPTIONS / HTTP/1.0" 200 262 0.000644
Sep 28 12:28:02 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:28:02 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:28:02 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:28:02 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:28:02 ctl02 nova-scheduler[5620]: 2017-09-28 12:28:02.501 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:28:02 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfff9be46)
Sep 28 12:28:03 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:28:03.084 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:28:03] "OPTIONS / HTTP/1.0" 200 134 0.000397
Sep 28 12:28:03 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfff9be46)
Sep 28 12:28:03 ctl02 nova-api[32616]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:28:03 ctl02 nova-api[32616]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:28:03 ctl02 nova-api[32616]: 2017-09-28 12:28:03.971 32616 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:28:03 ctl02 nova-api[32616]: 2017-09-28 12:28:03.972 32616 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:28:03 ctl02 nova-api[32616]: 2017-09-28 12:28:03.972 32616 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:28:03 ctl02 nova-api[32616]: 2017-09-28 12:28:03.972 32616 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:28:03 ctl02 nova-api[32616]: 2017-09-28 12:28:03.972 32616 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:28:03 ctl02 nova-api[32616]: 2017-09-28 12:28:03.972 32616 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:28:03 ctl02 nova-api[32616]: 2017-09-28 12:28:03.972 32616 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:28:03 ctl02 nova-api[32616]: 2017-09-28 12:28:03.972 32616 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:28:03 ctl02 nova-api[32616]: 2017-09-28 12:28:03.972 32616 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:28:03 ctl02 nova-api[32616]: 2017-09-28 12:28:03.972 32616 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:28:03 ctl02 nova-api[32616]: 2017-09-28 12:28:03.972 32616 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:28:03 ctl02 nova-api[32616]: 2017-09-28 12:28:03.972 32616 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:28:03 ctl02 nova-api[32616]: 2017-09-28 12:28:03.972 32616 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:28:03 ctl02 nova-api[32616]: 2017-09-28 12:28:03.972 32616 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:28:03 ctl02 nova-api[32616]: 2017-09-28 12:28:03.972 32616 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:28:03 ctl02 nova-api[32616]: 2017-09-28 12:28:03.972 32616 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:28:03 ctl02 nova-api[32616]: 2017-09-28 12:28:03.972 32616 ERROR nova.wsgi     self.filename))
Sep 28 12:28:03 ctl02 nova-api[32616]: 2017-09-28 12:28:03.972 32616 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:28:03 ctl02 nova-api[32616]: 2017-09-28 12:28:03.972 32616 ERROR nova.wsgi
Sep 28 12:28:03 ctl02 nova-api[32616]: 2017-09-28 12:28:03.973 32616 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:28:04 ctl02 nova-api[32616]: 2017-09-28 12:28:04.099 32616 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:28:04 ctl02 glance-api[29183]: 2017-09-28 12:28:04.200 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:28:04] "OPTIONS / HTTP/1.0" 200 134 0.000642
Sep 28 12:28:04 ctl02 nova-api[32616]: 2017-09-28 12:28:04.320 32616 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:28:04 ctl02 nova-api[32616]: 2017-09-28 12:28:04.322 32616 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:28:04 ctl02 nova-api[32616]: 2017-09-28 12:28:04.322 32616 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:28:04 ctl02 nova-api[32616]: 2017-09-28 12:28:04.322 32616 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:28:04 ctl02 nova-api[32616]: 2017-09-28 12:28:04.452 32616 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:28:04 ctl02 nova-api[32616]: 2017-09-28 12:28:04.454 32616 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:28:04 ctl02 nova-api[32616]: 2017-09-28 12:28:04.454 32616 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:28:04 ctl02 nova-api[32616]: 2017-09-28 12:28:04.455 32616 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:28:04 ctl02 nova-api[32616]: 2017-09-28 12:28:04.458 32616 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:28:04 ctl02 nova-api[32616]: 2017-09-28 12:28:04.458 32616 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:28:04 ctl02 nova-api[32616]: 2017-09-28 12:28:04.458 32616 ERROR nova Traceback (most recent call last):
Sep 28 12:28:04 ctl02 nova-api[32616]: 2017-09-28 12:28:04.458 32616 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:28:04 ctl02 nova-api[32616]: 2017-09-28 12:28:04.458 32616 ERROR nova     sys.exit(main())
Sep 28 12:28:04 ctl02 nova-api[32616]: 2017-09-28 12:28:04.458 32616 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:28:04 ctl02 nova-api[32616]: 2017-09-28 12:28:04.458 32616 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:28:04 ctl02 nova-api[32616]: 2017-09-28 12:28:04.458 32616 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:28:04 ctl02 nova-api[32616]: 2017-09-28 12:28:04.458 32616 ERROR nova     max_url_len=max_url_len)
Sep 28 12:28:04 ctl02 nova-api[32616]: 2017-09-28 12:28:04.458 32616 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:28:04 ctl02 nova-api[32616]: 2017-09-28 12:28:04.458 32616 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:28:04 ctl02 nova-api[32616]: 2017-09-28 12:28:04.458 32616 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:28:04 ctl02 nova-api[32616]: 2017-09-28 12:28:04.458 32616 ERROR nova     sock.listen(backlog)
Sep 28 12:28:04 ctl02 nova-api[32616]: 2017-09-28 12:28:04.458 32616 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:28:04 ctl02 nova-api[32616]: 2017-09-28 12:28:04.458 32616 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:28:04 ctl02 nova-api[32616]: 2017-09-28 12:28:04.458 32616 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:28:04 ctl02 nova-api[32616]: 2017-09-28 12:28:04.458 32616 ERROR nova
Sep 28 12:28:04 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfff9be46)
Sep 28 12:28:04 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:28:04 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:28:04 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:28:04 ctl02 glance-api[29183]: 2017-09-28 12:28:04.593 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:28:04] "OPTIONS / HTTP/1.0" 200 134 0.000750
Sep 28 12:28:04 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:28:04 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:28:04 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:28:04 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:28:05 ctl02 heat-api[13008]: 2017-09-28 12:28:05.475 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:28:05] "OPTIONS / HTTP/1.0" 200 134 0.000693
Sep 28 12:28:05 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfff9be46)
Sep 28 12:28:06 ctl02 heat-api[13008]: 2017-09-28 12:28:06.163 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:28:06] "OPTIONS / HTTP/1.0" 200 134 0.000749
Sep 28 12:28:06 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:28:06.282 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:28:06] "OPTIONS / HTTP/1.0" 200 134 0.000520
Sep 28 12:28:06 ctl02 neutron-server[30536]: 2017-09-28 12:28:06.449 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 1 dead agents out of 3:
Sep 28 12:28:06 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:28:06 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:23:57 cmp001
Sep 28 12:28:06 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfff9be46)
Sep 28 12:28:06 ctl02 nova-api[32634]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:28:06 ctl02 nova-api[32634]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:28:06 ctl02 nova-api[32634]: 2017-09-28 12:28:06.729 32634 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:28:06 ctl02 nova-api[32634]: 2017-09-28 12:28:06.730 32634 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:28:06 ctl02 nova-api[32634]: 2017-09-28 12:28:06.730 32634 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:28:06 ctl02 nova-api[32634]: 2017-09-28 12:28:06.730 32634 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:28:06 ctl02 nova-api[32634]: 2017-09-28 12:28:06.730 32634 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:28:06 ctl02 nova-api[32634]: 2017-09-28 12:28:06.730 32634 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:28:06 ctl02 nova-api[32634]: 2017-09-28 12:28:06.730 32634 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:28:06 ctl02 nova-api[32634]: 2017-09-28 12:28:06.730 32634 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:28:06 ctl02 nova-api[32634]: 2017-09-28 12:28:06.730 32634 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:28:06 ctl02 nova-api[32634]: 2017-09-28 12:28:06.730 32634 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:28:06 ctl02 nova-api[32634]: 2017-09-28 12:28:06.730 32634 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:28:06 ctl02 nova-api[32634]: 2017-09-28 12:28:06.730 32634 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:28:06 ctl02 nova-api[32634]: 2017-09-28 12:28:06.730 32634 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:28:06 ctl02 nova-api[32634]: 2017-09-28 12:28:06.730 32634 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:28:06 ctl02 nova-api[32634]: 2017-09-28 12:28:06.730 32634 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:28:06 ctl02 nova-api[32634]: 2017-09-28 12:28:06.730 32634 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:28:06 ctl02 nova-api[32634]: 2017-09-28 12:28:06.730 32634 ERROR nova.wsgi     self.filename))
Sep 28 12:28:06 ctl02 nova-api[32634]: 2017-09-28 12:28:06.730 32634 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:28:06 ctl02 nova-api[32634]: 2017-09-28 12:28:06.730 32634 ERROR nova.wsgi
Sep 28 12:28:06 ctl02 nova-api[32634]: 2017-09-28 12:28:06.731 32634 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:28:06 ctl02 nova-api[32634]: 2017-09-28 12:28:06.859 32634 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:28:07 ctl02 nova-api[32634]: 2017-09-28 12:28:07.081 32634 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:28:07 ctl02 nova-api[32634]: 2017-09-28 12:28:07.083 32634 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:28:07 ctl02 nova-api[32634]: 2017-09-28 12:28:07.084 32634 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:28:07 ctl02 nova-api[32634]: 2017-09-28 12:28:07.084 32634 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:28:07 ctl02 nova-api[32634]: 2017-09-28 12:28:07.214 32634 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:28:07 ctl02 nova-api[32634]: 2017-09-28 12:28:07.216 32634 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:28:07 ctl02 nova-api[32634]: 2017-09-28 12:28:07.216 32634 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:28:07 ctl02 nova-api[32634]: 2017-09-28 12:28:07.216 32634 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:28:07 ctl02 nova-api[32634]: 2017-09-28 12:28:07.219 32634 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:28:07 ctl02 nova-api[32634]: 2017-09-28 12:28:07.220 32634 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:28:07 ctl02 nova-api[32634]: 2017-09-28 12:28:07.220 32634 ERROR nova Traceback (most recent call last):
Sep 28 12:28:07 ctl02 nova-api[32634]: 2017-09-28 12:28:07.220 32634 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:28:07 ctl02 nova-api[32634]: 2017-09-28 12:28:07.220 32634 ERROR nova     sys.exit(main())
Sep 28 12:28:07 ctl02 nova-api[32634]: 2017-09-28 12:28:07.220 32634 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:28:07 ctl02 nova-api[32634]: 2017-09-28 12:28:07.220 32634 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:28:07 ctl02 nova-api[32634]: 2017-09-28 12:28:07.220 32634 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:28:07 ctl02 nova-api[32634]: 2017-09-28 12:28:07.220 32634 ERROR nova     max_url_len=max_url_len)
Sep 28 12:28:07 ctl02 nova-api[32634]: 2017-09-28 12:28:07.220 32634 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:28:07 ctl02 nova-api[32634]: 2017-09-28 12:28:07.220 32634 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:28:07 ctl02 nova-api[32634]: 2017-09-28 12:28:07.220 32634 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:28:07 ctl02 nova-api[32634]: 2017-09-28 12:28:07.220 32634 ERROR nova     sock.listen(backlog)
Sep 28 12:28:07 ctl02 nova-api[32634]: 2017-09-28 12:28:07.220 32634 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:28:07 ctl02 nova-api[32634]: 2017-09-28 12:28:07.220 32634 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:28:07 ctl02 nova-api[32634]: 2017-09-28 12:28:07.220 32634 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:28:07 ctl02 nova-api[32634]: 2017-09-28 12:28:07.220 32634 ERROR nova
Sep 28 12:28:07 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:28:07 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:28:07 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:28:07 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfff9be46)
Sep 28 12:28:07 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:28:07 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:28:07 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:28:07 ctl02 heat-api-cfn[13300]: 2017-09-28 12:28:07.643 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:28:07] "OPTIONS / HTTP/1.0" 200 134 0.000596
Sep 28 12:28:07 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:28:08 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:28:08.039 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:28:08] "OPTIONS / HTTP/1.0" 200 134 0.000385
Sep 28 12:28:08 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfff9be46)
Sep 28 12:28:08 ctl02 heat-api[13008]: 2017-09-28 12:28:08.720 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:28:08] "OPTIONS / HTTP/1.0" 200 134 0.000656
Sep 28 12:28:09 ctl02 neutron-server[30536]: 2017-09-28 12:28:09.034 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:28:09] "OPTIONS / HTTP/1.0" 200 262 0.000512
Sep 28 12:28:09 ctl02 nova-api[32652]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:28:09 ctl02 nova-api[32652]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:28:09 ctl02 heat-api-cfn[13300]: 2017-09-28 12:28:09.476 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:28:09] "OPTIONS / HTTP/1.0" 200 134 0.000442
Sep 28 12:28:09 ctl02 nova-api[32652]: 2017-09-28 12:28:09.502 32652 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:28:09 ctl02 nova-api[32652]: 2017-09-28 12:28:09.503 32652 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:28:09 ctl02 nova-api[32652]: 2017-09-28 12:28:09.503 32652 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:28:09 ctl02 nova-api[32652]: 2017-09-28 12:28:09.503 32652 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:28:09 ctl02 nova-api[32652]: 2017-09-28 12:28:09.503 32652 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:28:09 ctl02 nova-api[32652]: 2017-09-28 12:28:09.503 32652 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:28:09 ctl02 nova-api[32652]: 2017-09-28 12:28:09.503 32652 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:28:09 ctl02 nova-api[32652]: 2017-09-28 12:28:09.503 32652 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:28:09 ctl02 nova-api[32652]: 2017-09-28 12:28:09.503 32652 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:28:09 ctl02 nova-api[32652]: 2017-09-28 12:28:09.503 32652 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:28:09 ctl02 nova-api[32652]: 2017-09-28 12:28:09.503 32652 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:28:09 ctl02 nova-api[32652]: 2017-09-28 12:28:09.503 32652 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:28:09 ctl02 nova-api[32652]: 2017-09-28 12:28:09.503 32652 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:28:09 ctl02 nova-api[32652]: 2017-09-28 12:28:09.503 32652 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:28:09 ctl02 nova-api[32652]: 2017-09-28 12:28:09.503 32652 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:28:09 ctl02 nova-api[32652]: 2017-09-28 12:28:09.503 32652 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:28:09 ctl02 nova-api[32652]: 2017-09-28 12:28:09.503 32652 ERROR nova.wsgi     self.filename))
Sep 28 12:28:09 ctl02 nova-api[32652]: 2017-09-28 12:28:09.503 32652 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:28:09 ctl02 nova-api[32652]: 2017-09-28 12:28:09.503 32652 ERROR nova.wsgi
Sep 28 12:28:09 ctl02 nova-api[32652]: 2017-09-28 12:28:09.504 32652 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:28:09 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:28:09 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:28:09 ctl02 nova-api[32652]: 2017-09-28 12:28:09.631 32652 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:28:09 ctl02 nova-api[32652]: 2017-09-28 12:28:09.855 32652 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:28:09 ctl02 nova-api[32652]: 2017-09-28 12:28:09.857 32652 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:28:09 ctl02 nova-api[32652]: 2017-09-28 12:28:09.857 32652 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:28:09 ctl02 nova-api[32652]: 2017-09-28 12:28:09.857 32652 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:28:09 ctl02 nova-api[32652]: 2017-09-28 12:28:09.989 32652 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:28:09 ctl02 nova-api[32652]: 2017-09-28 12:28:09.991 32652 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:28:09 ctl02 nova-api[32652]: 2017-09-28 12:28:09.991 32652 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:28:09 ctl02 nova-api[32652]: 2017-09-28 12:28:09.991 32652 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:28:09 ctl02 nova-api[32652]: 2017-09-28 12:28:09.994 32652 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:28:09 ctl02 nova-api[32652]: 2017-09-28 12:28:09.994 32652 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:28:09 ctl02 nova-api[32652]: 2017-09-28 12:28:09.994 32652 ERROR nova Traceback (most recent call last):
Sep 28 12:28:09 ctl02 nova-api[32652]: 2017-09-28 12:28:09.994 32652 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:28:09 ctl02 nova-api[32652]: 2017-09-28 12:28:09.994 32652 ERROR nova     sys.exit(main())
Sep 28 12:28:09 ctl02 nova-api[32652]: 2017-09-28 12:28:09.994 32652 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:28:09 ctl02 nova-api[32652]: 2017-09-28 12:28:09.994 32652 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:28:09 ctl02 nova-api[32652]: 2017-09-28 12:28:09.994 32652 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:28:09 ctl02 nova-api[32652]: 2017-09-28 12:28:09.994 32652 ERROR nova     max_url_len=max_url_len)
Sep 28 12:28:09 ctl02 nova-api[32652]: 2017-09-28 12:28:09.994 32652 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:28:09 ctl02 nova-api[32652]: 2017-09-28 12:28:09.994 32652 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:28:09 ctl02 nova-api[32652]: 2017-09-28 12:28:09.994 32652 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:28:09 ctl02 nova-api[32652]: 2017-09-28 12:28:09.994 32652 ERROR nova     sock.listen(backlog)
Sep 28 12:28:09 ctl02 nova-api[32652]: 2017-09-28 12:28:09.994 32652 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:28:09 ctl02 nova-api[32652]: 2017-09-28 12:28:09.994 32652 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:28:09 ctl02 nova-api[32652]: 2017-09-28 12:28:09.994 32652 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:28:09 ctl02 nova-api[32652]: 2017-09-28 12:28:09.994 32652 ERROR nova
Sep 28 12:28:10 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:28:10 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:28:10 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:28:10 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:28:10 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:28:10 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:28:10 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:28:10 ctl02 heat-api-cfn[13300]: 2017-09-28 12:28:10.470 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:28:10] "OPTIONS / HTTP/1.0" 200 134 0.000687
Sep 28 12:28:10 ctl02 neutron-server[30536]: 2017-09-28 12:28:10.924 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:28:10] "OPTIONS / HTTP/1.0" 200 262 0.000472
Sep 28 12:28:11 ctl02 glance-api[29183]: 2017-09-28 12:28:11.132 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:28:11] "OPTIONS / HTTP/1.0" 200 134 0.000588
Sep 28 12:28:12 ctl02 nova-api[32674]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:28:12 ctl02 nova-api[32674]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:28:12 ctl02 nova-api[32674]: 2017-09-28 12:28:12.228 32674 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:28:12 ctl02 nova-api[32674]: 2017-09-28 12:28:12.230 32674 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:28:12 ctl02 nova-api[32674]: 2017-09-28 12:28:12.230 32674 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:28:12 ctl02 nova-api[32674]: 2017-09-28 12:28:12.230 32674 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:28:12 ctl02 nova-api[32674]: 2017-09-28 12:28:12.230 32674 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:28:12 ctl02 nova-api[32674]: 2017-09-28 12:28:12.230 32674 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:28:12 ctl02 nova-api[32674]: 2017-09-28 12:28:12.230 32674 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:28:12 ctl02 nova-api[32674]: 2017-09-28 12:28:12.230 32674 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:28:12 ctl02 nova-api[32674]: 2017-09-28 12:28:12.230 32674 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:28:12 ctl02 nova-api[32674]: 2017-09-28 12:28:12.230 32674 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:28:12 ctl02 nova-api[32674]: 2017-09-28 12:28:12.230 32674 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:28:12 ctl02 nova-api[32674]: 2017-09-28 12:28:12.230 32674 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:28:12 ctl02 nova-api[32674]: 2017-09-28 12:28:12.230 32674 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:28:12 ctl02 nova-api[32674]: 2017-09-28 12:28:12.230 32674 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:28:12 ctl02 nova-api[32674]: 2017-09-28 12:28:12.230 32674 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:28:12 ctl02 nova-api[32674]: 2017-09-28 12:28:12.230 32674 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:28:12 ctl02 nova-api[32674]: 2017-09-28 12:28:12.230 32674 ERROR nova.wsgi     self.filename))
Sep 28 12:28:12 ctl02 nova-api[32674]: 2017-09-28 12:28:12.230 32674 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:28:12 ctl02 nova-api[32674]: 2017-09-28 12:28:12.230 32674 ERROR nova.wsgi
Sep 28 12:28:12 ctl02 nova-api[32674]: 2017-09-28 12:28:12.231 32674 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:28:12 ctl02 neutron-server[30536]: 2017-09-28 12:28:12.333 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:28:12] "OPTIONS / HTTP/1.0" 200 262 0.000681
Sep 28 12:28:12 ctl02 nova-api[32674]: 2017-09-28 12:28:12.359 32674 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:28:12 ctl02 nova-api[32674]: 2017-09-28 12:28:12.585 32674 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:28:12 ctl02 nova-api[32674]: 2017-09-28 12:28:12.587 32674 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:28:12 ctl02 nova-api[32674]: 2017-09-28 12:28:12.587 32674 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:28:12 ctl02 nova-api[32674]: 2017-09-28 12:28:12.588 32674 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:28:12 ctl02 nova-api[32674]: 2017-09-28 12:28:12.718 32674 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:28:12 ctl02 nova-api[32674]: 2017-09-28 12:28:12.720 32674 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:28:12 ctl02 nova-api[32674]: 2017-09-28 12:28:12.720 32674 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:28:12 ctl02 nova-api[32674]: 2017-09-28 12:28:12.721 32674 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:28:12 ctl02 nova-api[32674]: 2017-09-28 12:28:12.724 32674 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:28:12 ctl02 nova-api[32674]: 2017-09-28 12:28:12.724 32674 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:28:12 ctl02 nova-api[32674]: 2017-09-28 12:28:12.724 32674 ERROR nova Traceback (most recent call last):
Sep 28 12:28:12 ctl02 nova-api[32674]: 2017-09-28 12:28:12.724 32674 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:28:12 ctl02 nova-api[32674]: 2017-09-28 12:28:12.724 32674 ERROR nova     sys.exit(main())
Sep 28 12:28:12 ctl02 nova-api[32674]: 2017-09-28 12:28:12.724 32674 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:28:12 ctl02 nova-api[32674]: 2017-09-28 12:28:12.724 32674 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:28:12 ctl02 nova-api[32674]: 2017-09-28 12:28:12.724 32674 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:28:12 ctl02 nova-api[32674]: 2017-09-28 12:28:12.724 32674 ERROR nova     max_url_len=max_url_len)
Sep 28 12:28:12 ctl02 nova-api[32674]: 2017-09-28 12:28:12.724 32674 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:28:12 ctl02 nova-api[32674]: 2017-09-28 12:28:12.724 32674 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:28:12 ctl02 nova-api[32674]: 2017-09-28 12:28:12.724 32674 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:28:12 ctl02 nova-api[32674]: 2017-09-28 12:28:12.724 32674 ERROR nova     sock.listen(backlog)
Sep 28 12:28:12 ctl02 nova-api[32674]: 2017-09-28 12:28:12.724 32674 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:28:12 ctl02 nova-api[32674]: 2017-09-28 12:28:12.724 32674 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:28:12 ctl02 nova-api[32674]: 2017-09-28 12:28:12.724 32674 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:28:12 ctl02 nova-api[32674]: 2017-09-28 12:28:12.724 32674 ERROR nova
Sep 28 12:28:12 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:28:12 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:28:12 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:28:13 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:28:13 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:28:13 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:28:13 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:28:13 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:28:13.157 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:28:13] "OPTIONS / HTTP/1.0" 200 134 0.000532
Sep 28 12:28:13 ctl02 glance-api[29183]: 2017-09-28 12:28:13.890 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:28:13] "OPTIONS / HTTP/1.0" 200 134 0.000646
Sep 28 12:28:14 ctl02 glance-api[29183]: 2017-09-28 12:28:14.336 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:28:14] "OPTIONS / HTTP/1.0" 200 134 0.000579
Sep 28 12:28:14 ctl02 nova-api[32693]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:28:14 ctl02 nova-api[32693]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:28:14 ctl02 nova-api[32693]: 2017-09-28 12:28:14.971 32693 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:28:14 ctl02 nova-api[32693]: 2017-09-28 12:28:14.973 32693 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:28:14 ctl02 nova-api[32693]: 2017-09-28 12:28:14.973 32693 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:28:14 ctl02 nova-api[32693]: 2017-09-28 12:28:14.973 32693 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:28:14 ctl02 nova-api[32693]: 2017-09-28 12:28:14.973 32693 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:28:14 ctl02 nova-api[32693]: 2017-09-28 12:28:14.973 32693 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:28:14 ctl02 nova-api[32693]: 2017-09-28 12:28:14.973 32693 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:28:14 ctl02 nova-api[32693]: 2017-09-28 12:28:14.973 32693 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:28:14 ctl02 nova-api[32693]: 2017-09-28 12:28:14.973 32693 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:28:14 ctl02 nova-api[32693]: 2017-09-28 12:28:14.973 32693 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:28:14 ctl02 nova-api[32693]: 2017-09-28 12:28:14.973 32693 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:28:14 ctl02 nova-api[32693]: 2017-09-28 12:28:14.973 32693 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:28:14 ctl02 nova-api[32693]: 2017-09-28 12:28:14.973 32693 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:28:14 ctl02 nova-api[32693]: 2017-09-28 12:28:14.973 32693 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:28:14 ctl02 nova-api[32693]: 2017-09-28 12:28:14.973 32693 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:28:14 ctl02 nova-api[32693]: 2017-09-28 12:28:14.973 32693 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:28:14 ctl02 nova-api[32693]: 2017-09-28 12:28:14.973 32693 ERROR nova.wsgi     self.filename))
Sep 28 12:28:14 ctl02 nova-api[32693]: 2017-09-28 12:28:14.973 32693 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:28:14 ctl02 nova-api[32693]: 2017-09-28 12:28:14.973 32693 ERROR nova.wsgi
Sep 28 12:28:14 ctl02 nova-api[32693]: 2017-09-28 12:28:14.975 32693 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:28:15 ctl02 nova-api[32693]: 2017-09-28 12:28:15.101 32693 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:28:15 ctl02 heat-api[13008]: 2017-09-28 12:28:15.167 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:28:15] "OPTIONS / HTTP/1.0" 200 134 0.000527
Sep 28 12:28:15 ctl02 nova-api[32693]: 2017-09-28 12:28:15.325 32693 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:28:15 ctl02 nova-api[32693]: 2017-09-28 12:28:15.327 32693 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:28:15 ctl02 nova-api[32693]: 2017-09-28 12:28:15.328 32693 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:28:15 ctl02 nova-api[32693]: 2017-09-28 12:28:15.328 32693 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:28:15 ctl02 nova-api[32693]: 2017-09-28 12:28:15.458 32693 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:28:15 ctl02 nova-api[32693]: 2017-09-28 12:28:15.460 32693 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:28:15 ctl02 nova-api[32693]: 2017-09-28 12:28:15.461 32693 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:28:15 ctl02 nova-api[32693]: 2017-09-28 12:28:15.461 32693 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:28:15 ctl02 nova-api[32693]: 2017-09-28 12:28:15.464 32693 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:28:15 ctl02 nova-api[32693]: 2017-09-28 12:28:15.465 32693 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:28:15 ctl02 nova-api[32693]: 2017-09-28 12:28:15.465 32693 ERROR nova Traceback (most recent call last):
Sep 28 12:28:15 ctl02 nova-api[32693]: 2017-09-28 12:28:15.465 32693 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:28:15 ctl02 nova-api[32693]: 2017-09-28 12:28:15.465 32693 ERROR nova     sys.exit(main())
Sep 28 12:28:15 ctl02 nova-api[32693]: 2017-09-28 12:28:15.465 32693 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:28:15 ctl02 nova-api[32693]: 2017-09-28 12:28:15.465 32693 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:28:15 ctl02 nova-api[32693]: 2017-09-28 12:28:15.465 32693 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:28:15 ctl02 nova-api[32693]: 2017-09-28 12:28:15.465 32693 ERROR nova     max_url_len=max_url_len)
Sep 28 12:28:15 ctl02 nova-api[32693]: 2017-09-28 12:28:15.465 32693 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:28:15 ctl02 nova-api[32693]: 2017-09-28 12:28:15.465 32693 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:28:15 ctl02 nova-api[32693]: 2017-09-28 12:28:15.465 32693 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:28:15 ctl02 nova-api[32693]: 2017-09-28 12:28:15.465 32693 ERROR nova     sock.listen(backlog)
Sep 28 12:28:15 ctl02 nova-api[32693]: 2017-09-28 12:28:15.465 32693 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:28:15 ctl02 nova-api[32693]: 2017-09-28 12:28:15.465 32693 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:28:15 ctl02 nova-api[32693]: 2017-09-28 12:28:15.465 32693 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:28:15 ctl02 nova-api[32693]: 2017-09-28 12:28:15.465 32693 ERROR nova
Sep 28 12:28:15 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:28:15 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:28:15 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:28:15 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:28:15 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:28:15 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:28:15 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:28:16 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:28:16.283 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:28:16] "OPTIONS / HTTP/1.0" 200 134 0.000419
Sep 28 12:28:16 ctl02 heat-api[13008]: 2017-09-28 12:28:16.516 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:28:16] "OPTIONS / HTTP/1.0" 200 134 0.000597
Sep 28 12:28:17 ctl02 nova-api[32710]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:28:17 ctl02 nova-api[32710]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:28:17 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:28:17.647 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:28:17] "OPTIONS / HTTP/1.0" 200 134 0.000428
Sep 28 12:28:17 ctl02 nova-api[32710]: 2017-09-28 12:28:17.721 32710 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:28:17 ctl02 nova-api[32710]: 2017-09-28 12:28:17.723 32710 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:28:17 ctl02 nova-api[32710]: 2017-09-28 12:28:17.723 32710 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:28:17 ctl02 nova-api[32710]: 2017-09-28 12:28:17.723 32710 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:28:17 ctl02 nova-api[32710]: 2017-09-28 12:28:17.723 32710 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:28:17 ctl02 nova-api[32710]: 2017-09-28 12:28:17.723 32710 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:28:17 ctl02 nova-api[32710]: 2017-09-28 12:28:17.723 32710 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:28:17 ctl02 nova-api[32710]: 2017-09-28 12:28:17.723 32710 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:28:17 ctl02 nova-api[32710]: 2017-09-28 12:28:17.723 32710 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:28:17 ctl02 nova-api[32710]: 2017-09-28 12:28:17.723 32710 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:28:17 ctl02 nova-api[32710]: 2017-09-28 12:28:17.723 32710 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:28:17 ctl02 nova-api[32710]: 2017-09-28 12:28:17.723 32710 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:28:17 ctl02 nova-api[32710]: 2017-09-28 12:28:17.723 32710 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:28:17 ctl02 nova-api[32710]: 2017-09-28 12:28:17.723 32710 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:28:17 ctl02 nova-api[32710]: 2017-09-28 12:28:17.723 32710 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:28:17 ctl02 nova-api[32710]: 2017-09-28 12:28:17.723 32710 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:28:17 ctl02 nova-api[32710]: 2017-09-28 12:28:17.723 32710 ERROR nova.wsgi     self.filename))
Sep 28 12:28:17 ctl02 nova-api[32710]: 2017-09-28 12:28:17.723 32710 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:28:17 ctl02 nova-api[32710]: 2017-09-28 12:28:17.723 32710 ERROR nova.wsgi
Sep 28 12:28:17 ctl02 nova-api[32710]: 2017-09-28 12:28:17.724 32710 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:28:17 ctl02 nova-api[32710]: 2017-09-28 12:28:17.850 32710 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:28:17 ctl02 heat-api-cfn[13300]: 2017-09-28 12:28:17.896 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:28:17] "OPTIONS / HTTP/1.0" 200 134 0.000433
Sep 28 12:28:17 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x563fbb11)
Sep 28 12:28:18 ctl02 nova-api[32710]: 2017-09-28 12:28:18.073 32710 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:28:18 ctl02 nova-api[32710]: 2017-09-28 12:28:18.075 32710 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:28:18 ctl02 nova-api[32710]: 2017-09-28 12:28:18.075 32710 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:28:18 ctl02 nova-api[32710]: 2017-09-28 12:28:18.076 32710 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:28:18 ctl02 nova-api[32710]: 2017-09-28 12:28:18.203 32710 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:28:18 ctl02 nova-api[32710]: 2017-09-28 12:28:18.205 32710 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:28:18 ctl02 nova-api[32710]: 2017-09-28 12:28:18.205 32710 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:28:18 ctl02 nova-api[32710]: 2017-09-28 12:28:18.205 32710 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:28:18 ctl02 nova-api[32710]: 2017-09-28 12:28:18.208 32710 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:28:18 ctl02 nova-api[32710]: 2017-09-28 12:28:18.209 32710 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:28:18 ctl02 nova-api[32710]: 2017-09-28 12:28:18.209 32710 ERROR nova Traceback (most recent call last):
Sep 28 12:28:18 ctl02 nova-api[32710]: 2017-09-28 12:28:18.209 32710 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:28:18 ctl02 nova-api[32710]: 2017-09-28 12:28:18.209 32710 ERROR nova     sys.exit(main())
Sep 28 12:28:18 ctl02 nova-api[32710]: 2017-09-28 12:28:18.209 32710 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:28:18 ctl02 nova-api[32710]: 2017-09-28 12:28:18.209 32710 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:28:18 ctl02 nova-api[32710]: 2017-09-28 12:28:18.209 32710 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:28:18 ctl02 nova-api[32710]: 2017-09-28 12:28:18.209 32710 ERROR nova     max_url_len=max_url_len)
Sep 28 12:28:18 ctl02 nova-api[32710]: 2017-09-28 12:28:18.209 32710 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:28:18 ctl02 nova-api[32710]: 2017-09-28 12:28:18.209 32710 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:28:18 ctl02 nova-api[32710]: 2017-09-28 12:28:18.209 32710 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:28:18 ctl02 nova-api[32710]: 2017-09-28 12:28:18.209 32710 ERROR nova     sock.listen(backlog)
Sep 28 12:28:18 ctl02 nova-api[32710]: 2017-09-28 12:28:18.209 32710 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:28:18 ctl02 nova-api[32710]: 2017-09-28 12:28:18.209 32710 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:28:18 ctl02 nova-api[32710]: 2017-09-28 12:28:18.209 32710 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:28:18 ctl02 nova-api[32710]: 2017-09-28 12:28:18.209 32710 ERROR nova
Sep 28 12:28:18 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:28:18 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:28:18 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:28:18 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:28:18 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:28:18 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:28:18 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:28:18 ctl02 neutron-server[30536]: 2017-09-28 12:28:18.728 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:28:18] "OPTIONS / HTTP/1.0" 200 262 0.000498
Sep 28 12:28:18 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x563fbb11)
Sep 28 12:28:19 ctl02 heat-api[13008]: 2017-09-28 12:28:19.039 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:28:19] "OPTIONS / HTTP/1.0" 200 134 0.000552
Sep 28 12:28:19 ctl02 heat-api-cfn[13300]: 2017-09-28 12:28:19.787 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:28:19] "OPTIONS / HTTP/1.0" 200 134 0.000433
Sep 28 12:28:19 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x563fbb11)
Sep 28 12:28:20 ctl02 nova-api[32729]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:28:20 ctl02 nova-api[32729]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:28:20 ctl02 nova-api[32729]: 2017-09-28 12:28:20.466 32729 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:28:20 ctl02 nova-api[32729]: 2017-09-28 12:28:20.467 32729 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:28:20 ctl02 nova-api[32729]: 2017-09-28 12:28:20.467 32729 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:28:20 ctl02 nova-api[32729]: 2017-09-28 12:28:20.467 32729 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:28:20 ctl02 nova-api[32729]: 2017-09-28 12:28:20.467 32729 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:28:20 ctl02 nova-api[32729]: 2017-09-28 12:28:20.467 32729 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:28:20 ctl02 nova-api[32729]: 2017-09-28 12:28:20.467 32729 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:28:20 ctl02 nova-api[32729]: 2017-09-28 12:28:20.467 32729 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:28:20 ctl02 nova-api[32729]: 2017-09-28 12:28:20.467 32729 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:28:20 ctl02 nova-api[32729]: 2017-09-28 12:28:20.467 32729 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:28:20 ctl02 nova-api[32729]: 2017-09-28 12:28:20.467 32729 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:28:20 ctl02 nova-api[32729]: 2017-09-28 12:28:20.467 32729 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:28:20 ctl02 nova-api[32729]: 2017-09-28 12:28:20.467 32729 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:28:20 ctl02 nova-api[32729]: 2017-09-28 12:28:20.467 32729 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:28:20 ctl02 nova-api[32729]: 2017-09-28 12:28:20.467 32729 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:28:20 ctl02 nova-api[32729]: 2017-09-28 12:28:20.467 32729 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:28:20 ctl02 nova-api[32729]: 2017-09-28 12:28:20.467 32729 ERROR nova.wsgi     self.filename))
Sep 28 12:28:20 ctl02 nova-api[32729]: 2017-09-28 12:28:20.467 32729 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:28:20 ctl02 nova-api[32729]: 2017-09-28 12:28:20.467 32729 ERROR nova.wsgi
Sep 28 12:28:20 ctl02 nova-api[32729]: 2017-09-28 12:28:20.468 32729 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:28:20 ctl02 heat-api-cfn[13300]: 2017-09-28 12:28:20.550 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:28:20] "OPTIONS / HTTP/1.0" 200 134 0.000450
Sep 28 12:28:20 ctl02 nova-api[32729]: 2017-09-28 12:28:20.598 32729 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:28:20 ctl02 neutron-server[30536]: 2017-09-28 12:28:20.745 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:28:20] "OPTIONS / HTTP/1.0" 200 262 0.000453
Sep 28 12:28:20 ctl02 glance-api[29183]: 2017-09-28 12:28:20.762 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:28:20] "OPTIONS / HTTP/1.0" 200 134 0.000577
Sep 28 12:28:20 ctl02 nova-api[32729]: 2017-09-28 12:28:20.821 32729 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:28:20 ctl02 nova-api[32729]: 2017-09-28 12:28:20.824 32729 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:28:20 ctl02 nova-api[32729]: 2017-09-28 12:28:20.824 32729 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:28:20 ctl02 nova-api[32729]: 2017-09-28 12:28:20.824 32729 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:28:20 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x563fbb11)
Sep 28 12:28:20 ctl02 nova-api[32729]: 2017-09-28 12:28:20.956 32729 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:28:20 ctl02 nova-api[32729]: 2017-09-28 12:28:20.959 32729 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:28:20 ctl02 nova-api[32729]: 2017-09-28 12:28:20.960 32729 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:28:20 ctl02 nova-api[32729]: 2017-09-28 12:28:20.960 32729 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:28:20 ctl02 nova-api[32729]: 2017-09-28 12:28:20.963 32729 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:28:20 ctl02 nova-api[32729]: 2017-09-28 12:28:20.963 32729 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:28:20 ctl02 nova-api[32729]: 2017-09-28 12:28:20.963 32729 ERROR nova Traceback (most recent call last):
Sep 28 12:28:20 ctl02 nova-api[32729]: 2017-09-28 12:28:20.963 32729 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:28:20 ctl02 nova-api[32729]: 2017-09-28 12:28:20.963 32729 ERROR nova     sys.exit(main())
Sep 28 12:28:20 ctl02 nova-api[32729]: 2017-09-28 12:28:20.963 32729 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:28:20 ctl02 nova-api[32729]: 2017-09-28 12:28:20.963 32729 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:28:20 ctl02 nova-api[32729]: 2017-09-28 12:28:20.963 32729 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:28:20 ctl02 nova-api[32729]: 2017-09-28 12:28:20.963 32729 ERROR nova     max_url_len=max_url_len)
Sep 28 12:28:20 ctl02 nova-api[32729]: 2017-09-28 12:28:20.963 32729 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:28:20 ctl02 nova-api[32729]: 2017-09-28 12:28:20.963 32729 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:28:20 ctl02 nova-api[32729]: 2017-09-28 12:28:20.963 32729 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:28:20 ctl02 nova-api[32729]: 2017-09-28 12:28:20.963 32729 ERROR nova     sock.listen(backlog)
Sep 28 12:28:20 ctl02 nova-api[32729]: 2017-09-28 12:28:20.963 32729 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:28:20 ctl02 nova-api[32729]: 2017-09-28 12:28:20.963 32729 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:28:20 ctl02 nova-api[32729]: 2017-09-28 12:28:20.963 32729 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:28:20 ctl02 nova-api[32729]: 2017-09-28 12:28:20.963 32729 ERROR nova
Sep 28 12:28:21 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:28:21 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:28:21 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:28:21 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:28:21 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:28:21 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:28:21 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:28:21 ctl02 neutron-server[30536]: 2017-09-28 12:28:21.445 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 1 dead agents out of 6:
Sep 28 12:28:21 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:28:21 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:23:57 cmp001
Sep 28 12:28:21 ctl02 nova-cert[4860]: 2017-09-28 12:28:21.625 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:28:21 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x563fbb11)
Sep 28 12:28:22 ctl02 neutron-server[30536]: 2017-09-28 12:28:22.215 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:28:22] "OPTIONS / HTTP/1.0" 200 262 0.000468
Sep 28 12:28:22 ctl02 nova-conductor[5056]: 2017-09-28 12:28:22.707 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:28:22 ctl02 nova-conductor[5056]: 2017-09-28 12:28:22.715 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:28:22 ctl02 nova-conductor[5056]: 2017-09-28 12:28:22.735 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:28:22 ctl02 nova-conductor[5056]: 2017-09-28 12:28:22.745 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:28:22 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x563fbb11)
Sep 28 12:28:23 ctl02 nova-api[32747]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:28:23 ctl02 nova-api[32747]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:28:23 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:28:23.145 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:28:23] "OPTIONS / HTTP/1.0" 200 134 0.000405
Sep 28 12:28:23 ctl02 nova-api[32747]: 2017-09-28 12:28:23.252 32747 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:28:23 ctl02 nova-api[32747]: 2017-09-28 12:28:23.253 32747 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:28:23 ctl02 nova-api[32747]: 2017-09-28 12:28:23.253 32747 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:28:23 ctl02 nova-api[32747]: 2017-09-28 12:28:23.253 32747 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:28:23 ctl02 nova-api[32747]: 2017-09-28 12:28:23.253 32747 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:28:23 ctl02 nova-api[32747]: 2017-09-28 12:28:23.253 32747 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:28:23 ctl02 nova-api[32747]: 2017-09-28 12:28:23.253 32747 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:28:23 ctl02 nova-api[32747]: 2017-09-28 12:28:23.253 32747 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:28:23 ctl02 nova-api[32747]: 2017-09-28 12:28:23.253 32747 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:28:23 ctl02 nova-api[32747]: 2017-09-28 12:28:23.253 32747 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:28:23 ctl02 nova-api[32747]: 2017-09-28 12:28:23.253 32747 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:28:23 ctl02 nova-api[32747]: 2017-09-28 12:28:23.253 32747 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:28:23 ctl02 nova-api[32747]: 2017-09-28 12:28:23.253 32747 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:28:23 ctl02 nova-api[32747]: 2017-09-28 12:28:23.253 32747 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:28:23 ctl02 nova-api[32747]: 2017-09-28 12:28:23.253 32747 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:28:23 ctl02 nova-api[32747]: 2017-09-28 12:28:23.253 32747 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:28:23 ctl02 nova-api[32747]: 2017-09-28 12:28:23.253 32747 ERROR nova.wsgi     self.filename))
Sep 28 12:28:23 ctl02 nova-api[32747]: 2017-09-28 12:28:23.253 32747 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:28:23 ctl02 nova-api[32747]: 2017-09-28 12:28:23.253 32747 ERROR nova.wsgi
Sep 28 12:28:23 ctl02 nova-api[32747]: 2017-09-28 12:28:23.254 32747 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:28:23 ctl02 nova-api[32747]: 2017-09-28 12:28:23.382 32747 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:28:23 ctl02 nova-api[32747]: 2017-09-28 12:28:23.615 32747 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:28:23 ctl02 nova-api[32747]: 2017-09-28 12:28:23.617 32747 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:28:23 ctl02 nova-api[32747]: 2017-09-28 12:28:23.617 32747 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:28:23 ctl02 nova-api[32747]: 2017-09-28 12:28:23.618 32747 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:28:23 ctl02 nova-api[32747]: 2017-09-28 12:28:23.748 32747 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:28:23 ctl02 nova-api[32747]: 2017-09-28 12:28:23.750 32747 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:28:23 ctl02 nova-api[32747]: 2017-09-28 12:28:23.750 32747 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:28:23 ctl02 nova-api[32747]: 2017-09-28 12:28:23.750 32747 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:28:23 ctl02 nova-api[32747]: 2017-09-28 12:28:23.754 32747 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:28:23 ctl02 nova-api[32747]: 2017-09-28 12:28:23.754 32747 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:28:23 ctl02 nova-api[32747]: 2017-09-28 12:28:23.754 32747 ERROR nova Traceback (most recent call last):
Sep 28 12:28:23 ctl02 nova-api[32747]: 2017-09-28 12:28:23.754 32747 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:28:23 ctl02 nova-api[32747]: 2017-09-28 12:28:23.754 32747 ERROR nova     sys.exit(main())
Sep 28 12:28:23 ctl02 nova-api[32747]: 2017-09-28 12:28:23.754 32747 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:28:23 ctl02 nova-api[32747]: 2017-09-28 12:28:23.754 32747 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:28:23 ctl02 nova-api[32747]: 2017-09-28 12:28:23.754 32747 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:28:23 ctl02 nova-api[32747]: 2017-09-28 12:28:23.754 32747 ERROR nova     max_url_len=max_url_len)
Sep 28 12:28:23 ctl02 nova-api[32747]: 2017-09-28 12:28:23.754 32747 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:28:23 ctl02 nova-api[32747]: 2017-09-28 12:28:23.754 32747 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:28:23 ctl02 nova-api[32747]: 2017-09-28 12:28:23.754 32747 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:28:23 ctl02 nova-api[32747]: 2017-09-28 12:28:23.754 32747 ERROR nova     sock.listen(backlog)
Sep 28 12:28:23 ctl02 nova-api[32747]: 2017-09-28 12:28:23.754 32747 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:28:23 ctl02 nova-api[32747]: 2017-09-28 12:28:23.754 32747 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:28:23 ctl02 nova-api[32747]: 2017-09-28 12:28:23.754 32747 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:28:23 ctl02 nova-api[32747]: 2017-09-28 12:28:23.754 32747 ERROR nova
Sep 28 12:28:23 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:28:23 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:28:23 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:28:23 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x563fbb11)
Sep 28 12:28:24 ctl02 glance-api[29183]: 2017-09-28 12:28:24.108 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:28:24] "OPTIONS / HTTP/1.0" 200 134 0.001130
Sep 28 12:28:24 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:28:24 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:28:24 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:28:24 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:28:24 ctl02 glance-api[29183]: 2017-09-28 12:28:24.519 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:28:24] "OPTIONS / HTTP/1.0" 200 134 0.000725
Sep 28 12:28:24 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x563fbb11)
Sep 28 12:28:25 ctl02 heat-api[13008]: 2017-09-28 12:28:25.025 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:28:25] "OPTIONS / HTTP/1.0" 200 134 0.000566
Sep 28 12:28:25 ctl02 nova-api[32765]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:28:25 ctl02 nova-api[32765]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:28:25 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x563fbb11)
Sep 28 12:28:26 ctl02 nova-api[32765]: 2017-09-28 12:28:26.020 32765 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:28:26 ctl02 nova-api[32765]: 2017-09-28 12:28:26.021 32765 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:28:26 ctl02 nova-api[32765]: 2017-09-28 12:28:26.021 32765 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:28:26 ctl02 nova-api[32765]: 2017-09-28 12:28:26.021 32765 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:28:26 ctl02 nova-api[32765]: 2017-09-28 12:28:26.021 32765 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:28:26 ctl02 nova-api[32765]: 2017-09-28 12:28:26.021 32765 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:28:26 ctl02 nova-api[32765]: 2017-09-28 12:28:26.021 32765 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:28:26 ctl02 nova-api[32765]: 2017-09-28 12:28:26.021 32765 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:28:26 ctl02 nova-api[32765]: 2017-09-28 12:28:26.021 32765 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:28:26 ctl02 nova-api[32765]: 2017-09-28 12:28:26.021 32765 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:28:26 ctl02 nova-api[32765]: 2017-09-28 12:28:26.021 32765 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:28:26 ctl02 nova-api[32765]: 2017-09-28 12:28:26.021 32765 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:28:26 ctl02 nova-api[32765]: 2017-09-28 12:28:26.021 32765 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:28:26 ctl02 nova-api[32765]: 2017-09-28 12:28:26.021 32765 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:28:26 ctl02 nova-api[32765]: 2017-09-28 12:28:26.021 32765 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:28:26 ctl02 nova-api[32765]: 2017-09-28 12:28:26.021 32765 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:28:26 ctl02 nova-api[32765]: 2017-09-28 12:28:26.021 32765 ERROR nova.wsgi     self.filename))
Sep 28 12:28:26 ctl02 nova-api[32765]: 2017-09-28 12:28:26.021 32765 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:28:26 ctl02 nova-api[32765]: 2017-09-28 12:28:26.021 32765 ERROR nova.wsgi
Sep 28 12:28:26 ctl02 nova-api[32765]: 2017-09-28 12:28:26.022 32765 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:28:26 ctl02 nova-api[32765]: 2017-09-28 12:28:26.152 32765 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:28:26 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:28:26.249 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:28:26] "OPTIONS / HTTP/1.0" 200 134 0.000416
Sep 28 12:28:26 ctl02 nova-api[32765]: 2017-09-28 12:28:26.385 32765 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:28:26 ctl02 nova-api[32765]: 2017-09-28 12:28:26.387 32765 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:28:26 ctl02 nova-api[32765]: 2017-09-28 12:28:26.387 32765 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:28:26 ctl02 nova-api[32765]: 2017-09-28 12:28:26.388 32765 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:28:26 ctl02 heat-api[13008]: 2017-09-28 12:28:26.482 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:28:26] "OPTIONS / HTTP/1.0" 200 134 0.000538
Sep 28 12:28:26 ctl02 nova-api[32765]: 2017-09-28 12:28:26.522 32765 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:28:26 ctl02 nova-api[32765]: 2017-09-28 12:28:26.524 32765 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:28:26 ctl02 nova-api[32765]: 2017-09-28 12:28:26.524 32765 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:28:26 ctl02 nova-api[32765]: 2017-09-28 12:28:26.524 32765 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:28:26 ctl02 nova-api[32765]: 2017-09-28 12:28:26.527 32765 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:28:26 ctl02 nova-api[32765]: 2017-09-28 12:28:26.528 32765 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:28:26 ctl02 nova-api[32765]: 2017-09-28 12:28:26.528 32765 ERROR nova Traceback (most recent call last):
Sep 28 12:28:26 ctl02 nova-api[32765]: 2017-09-28 12:28:26.528 32765 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:28:26 ctl02 nova-api[32765]: 2017-09-28 12:28:26.528 32765 ERROR nova     sys.exit(main())
Sep 28 12:28:26 ctl02 nova-api[32765]: 2017-09-28 12:28:26.528 32765 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:28:26 ctl02 nova-api[32765]: 2017-09-28 12:28:26.528 32765 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:28:26 ctl02 nova-api[32765]: 2017-09-28 12:28:26.528 32765 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:28:26 ctl02 nova-api[32765]: 2017-09-28 12:28:26.528 32765 ERROR nova     max_url_len=max_url_len)
Sep 28 12:28:26 ctl02 nova-api[32765]: 2017-09-28 12:28:26.528 32765 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:28:26 ctl02 nova-api[32765]: 2017-09-28 12:28:26.528 32765 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:28:26 ctl02 nova-api[32765]: 2017-09-28 12:28:26.528 32765 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:28:26 ctl02 nova-api[32765]: 2017-09-28 12:28:26.528 32765 ERROR nova     sock.listen(backlog)
Sep 28 12:28:26 ctl02 nova-api[32765]: 2017-09-28 12:28:26.528 32765 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:28:26 ctl02 nova-api[32765]: 2017-09-28 12:28:26.528 32765 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:28:26 ctl02 nova-api[32765]: 2017-09-28 12:28:26.528 32765 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:28:26 ctl02 nova-api[32765]: 2017-09-28 12:28:26.528 32765 ERROR nova
Sep 28 12:28:26 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:28:26 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:28:26 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:28:26 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:28:26 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:28:26 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:28:26 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:28:26 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x563fbb11)
Sep 28 12:28:27 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:28:27.740 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:28:27] "OPTIONS / HTTP/1.0" 200 134 0.000511
Sep 28 12:28:27 ctl02 heat-api-cfn[13300]: 2017-09-28 12:28:27.863 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:28:27] "OPTIONS / HTTP/1.0" 200 134 0.000566
Sep 28 12:28:27 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x563fbb11)
Sep 28 12:28:28 ctl02 nova-api[315]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:28:28 ctl02 nova-api[315]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:28:28 ctl02 nova-api[315]: 2017-09-28 12:28:28.732 315 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:28:28 ctl02 nova-api[315]: 2017-09-28 12:28:28.734 315 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:28:28 ctl02 nova-api[315]: 2017-09-28 12:28:28.734 315 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:28:28 ctl02 nova-api[315]: 2017-09-28 12:28:28.734 315 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:28:28 ctl02 nova-api[315]: 2017-09-28 12:28:28.734 315 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:28:28 ctl02 nova-api[315]: 2017-09-28 12:28:28.734 315 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:28:28 ctl02 nova-api[315]: 2017-09-28 12:28:28.734 315 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:28:28 ctl02 nova-api[315]: 2017-09-28 12:28:28.734 315 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:28:28 ctl02 nova-api[315]: 2017-09-28 12:28:28.734 315 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:28:28 ctl02 nova-api[315]: 2017-09-28 12:28:28.734 315 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:28:28 ctl02 nova-api[315]: 2017-09-28 12:28:28.734 315 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:28:28 ctl02 nova-api[315]: 2017-09-28 12:28:28.734 315 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:28:28 ctl02 nova-api[315]: 2017-09-28 12:28:28.734 315 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:28:28 ctl02 nova-api[315]: 2017-09-28 12:28:28.734 315 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:28:28 ctl02 nova-api[315]: 2017-09-28 12:28:28.734 315 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:28:28 ctl02 nova-api[315]: 2017-09-28 12:28:28.734 315 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:28:28 ctl02 nova-api[315]: 2017-09-28 12:28:28.734 315 ERROR nova.wsgi     self.filename))
Sep 28 12:28:28 ctl02 nova-api[315]: 2017-09-28 12:28:28.734 315 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:28:28 ctl02 nova-api[315]: 2017-09-28 12:28:28.734 315 ERROR nova.wsgi
Sep 28 12:28:28 ctl02 nova-api[315]: 2017-09-28 12:28:28.735 315 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:28:28 ctl02 nova-api[315]: 2017-09-28 12:28:28.860 315 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:28:28 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:28:28 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:28:29 ctl02 neutron-server[30536]: 2017-09-28 12:28:29.070 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:28:29] "OPTIONS / HTTP/1.0" 200 262 0.000449
Sep 28 12:28:29 ctl02 nova-api[315]: 2017-09-28 12:28:29.078 315 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:28:29 ctl02 nova-api[315]: 2017-09-28 12:28:29.080 315 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:28:29 ctl02 nova-api[315]: 2017-09-28 12:28:29.080 315 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:28:29 ctl02 nova-api[315]: 2017-09-28 12:28:29.080 315 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:28:29 ctl02 heat-api[13008]: 2017-09-28 12:28:29.168 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:28:29] "OPTIONS / HTTP/1.0" 200 134 0.000646
Sep 28 12:28:29 ctl02 nova-api[315]: 2017-09-28 12:28:29.208 315 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:28:29 ctl02 nova-api[315]: 2017-09-28 12:28:29.210 315 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:28:29 ctl02 nova-api[315]: 2017-09-28 12:28:29.210 315 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:28:29 ctl02 nova-api[315]: 2017-09-28 12:28:29.210 315 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:28:29 ctl02 nova-api[315]: 2017-09-28 12:28:29.213 315 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:28:29 ctl02 nova-api[315]: 2017-09-28 12:28:29.213 315 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:28:29 ctl02 nova-api[315]: 2017-09-28 12:28:29.213 315 ERROR nova Traceback (most recent call last):
Sep 28 12:28:29 ctl02 nova-api[315]: 2017-09-28 12:28:29.213 315 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:28:29 ctl02 nova-api[315]: 2017-09-28 12:28:29.213 315 ERROR nova     sys.exit(main())
Sep 28 12:28:29 ctl02 nova-api[315]: 2017-09-28 12:28:29.213 315 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:28:29 ctl02 nova-api[315]: 2017-09-28 12:28:29.213 315 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:28:29 ctl02 nova-api[315]: 2017-09-28 12:28:29.213 315 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:28:29 ctl02 nova-api[315]: 2017-09-28 12:28:29.213 315 ERROR nova     max_url_len=max_url_len)
Sep 28 12:28:29 ctl02 nova-api[315]: 2017-09-28 12:28:29.213 315 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:28:29 ctl02 nova-api[315]: 2017-09-28 12:28:29.213 315 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:28:29 ctl02 nova-api[315]: 2017-09-28 12:28:29.213 315 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:28:29 ctl02 nova-api[315]: 2017-09-28 12:28:29.213 315 ERROR nova     sock.listen(backlog)
Sep 28 12:28:29 ctl02 nova-api[315]: 2017-09-28 12:28:29.213 315 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:28:29 ctl02 nova-api[315]: 2017-09-28 12:28:29.213 315 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:28:29 ctl02 nova-api[315]: 2017-09-28 12:28:29.213 315 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:28:29 ctl02 nova-api[315]: 2017-09-28 12:28:29.213 315 ERROR nova
Sep 28 12:28:29 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:28:29 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:28:29 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:28:29 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:28:29 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:28:29 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:28:29 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:28:29 ctl02 heat-api-cfn[13300]: 2017-09-28 12:28:29.974 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:28:29] "OPTIONS / HTTP/1.0" 200 134 0.000462
Sep 28 12:28:30 ctl02 neutron-server[30536]: 2017-09-28 12:28:30.666 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:28:30] "OPTIONS / HTTP/1.0" 200 262 0.000460
Sep 28 12:28:30 ctl02 heat-api-cfn[13300]: 2017-09-28 12:28:30.724 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:28:30] "OPTIONS / HTTP/1.0" 200 134 0.000452
Sep 28 12:28:30 ctl02 glance-api[29183]: 2017-09-28 12:28:30.819 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:28:30] "OPTIONS / HTTP/1.0" 200 134 0.000614
Sep 28 12:28:31 ctl02 nova-api[338]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:28:31 ctl02 nova-api[338]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:28:31 ctl02 nova-api[338]: 2017-09-28 12:28:31.503 338 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:28:31 ctl02 nova-api[338]: 2017-09-28 12:28:31.505 338 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:28:31 ctl02 nova-api[338]: 2017-09-28 12:28:31.505 338 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:28:31 ctl02 nova-api[338]: 2017-09-28 12:28:31.505 338 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:28:31 ctl02 nova-api[338]: 2017-09-28 12:28:31.505 338 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:28:31 ctl02 nova-api[338]: 2017-09-28 12:28:31.505 338 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:28:31 ctl02 nova-api[338]: 2017-09-28 12:28:31.505 338 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:28:31 ctl02 nova-api[338]: 2017-09-28 12:28:31.505 338 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:28:31 ctl02 nova-api[338]: 2017-09-28 12:28:31.505 338 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:28:31 ctl02 nova-api[338]: 2017-09-28 12:28:31.505 338 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:28:31 ctl02 nova-api[338]: 2017-09-28 12:28:31.505 338 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:28:31 ctl02 nova-api[338]: 2017-09-28 12:28:31.505 338 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:28:31 ctl02 nova-api[338]: 2017-09-28 12:28:31.505 338 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:28:31 ctl02 nova-api[338]: 2017-09-28 12:28:31.505 338 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:28:31 ctl02 nova-api[338]: 2017-09-28 12:28:31.505 338 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:28:31 ctl02 nova-api[338]: 2017-09-28 12:28:31.505 338 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:28:31 ctl02 nova-api[338]: 2017-09-28 12:28:31.505 338 ERROR nova.wsgi     self.filename))
Sep 28 12:28:31 ctl02 nova-api[338]: 2017-09-28 12:28:31.505 338 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:28:31 ctl02 nova-api[338]: 2017-09-28 12:28:31.505 338 ERROR nova.wsgi
Sep 28 12:28:31 ctl02 nova-api[338]: 2017-09-28 12:28:31.507 338 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:28:31 ctl02 nova-consoleauth[5433]: 2017-09-28 12:28:31.510 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:28:31 ctl02 nova-api[338]: 2017-09-28 12:28:31.639 338 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:28:31 ctl02 nova-api[338]: 2017-09-28 12:28:31.869 338 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:28:31 ctl02 nova-api[338]: 2017-09-28 12:28:31.872 338 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:28:31 ctl02 nova-api[338]: 2017-09-28 12:28:31.873 338 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:28:31 ctl02 nova-api[338]: 2017-09-28 12:28:31.873 338 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:28:32 ctl02 nova-api[338]: 2017-09-28 12:28:32.006 338 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:28:32 ctl02 nova-api[338]: 2017-09-28 12:28:32.009 338 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:28:32 ctl02 nova-api[338]: 2017-09-28 12:28:32.009 338 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:28:32 ctl02 nova-api[338]: 2017-09-28 12:28:32.010 338 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:28:32 ctl02 nova-api[338]: 2017-09-28 12:28:32.013 338 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:28:32 ctl02 nova-api[338]: 2017-09-28 12:28:32.013 338 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:28:32 ctl02 nova-api[338]: 2017-09-28 12:28:32.013 338 ERROR nova Traceback (most recent call last):
Sep 28 12:28:32 ctl02 nova-api[338]: 2017-09-28 12:28:32.013 338 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:28:32 ctl02 nova-api[338]: 2017-09-28 12:28:32.013 338 ERROR nova     sys.exit(main())
Sep 28 12:28:32 ctl02 nova-api[338]: 2017-09-28 12:28:32.013 338 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:28:32 ctl02 nova-api[338]: 2017-09-28 12:28:32.013 338 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:28:32 ctl02 nova-api[338]: 2017-09-28 12:28:32.013 338 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:28:32 ctl02 nova-api[338]: 2017-09-28 12:28:32.013 338 ERROR nova     max_url_len=max_url_len)
Sep 28 12:28:32 ctl02 nova-api[338]: 2017-09-28 12:28:32.013 338 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:28:32 ctl02 nova-api[338]: 2017-09-28 12:28:32.013 338 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:28:32 ctl02 nova-api[338]: 2017-09-28 12:28:32.013 338 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:28:32 ctl02 nova-api[338]: 2017-09-28 12:28:32.013 338 ERROR nova     sock.listen(backlog)
Sep 28 12:28:32 ctl02 nova-api[338]: 2017-09-28 12:28:32.013 338 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:28:32 ctl02 nova-api[338]: 2017-09-28 12:28:32.013 338 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:28:32 ctl02 nova-api[338]: 2017-09-28 12:28:32.013 338 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:28:32 ctl02 nova-api[338]: 2017-09-28 12:28:32.013 338 ERROR nova
Sep 28 12:28:32 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:28:32 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:28:32 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:28:32 ctl02 neutron-server[30536]: 2017-09-28 12:28:32.374 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:28:32] "OPTIONS / HTTP/1.0" 200 262 0.000650
Sep 28 12:28:32 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:28:32 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:28:32 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:28:32 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:28:33 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:28:33.470 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:28:33] "OPTIONS / HTTP/1.0" 200 134 0.000417
Sep 28 12:28:33 ctl02 glance-api[29183]: 2017-09-28 12:28:33.761 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:28:33] "OPTIONS / HTTP/1.0" 200 134 0.000561
Sep 28 12:28:33 ctl02 heat-engine[12803]: 2017-09-28 12:28:33.827 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:28:33 ctl02 heat-engine[12803]: 2017-09-28 12:28:33.830 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:28:33 ctl02 heat-engine[12803]: 2017-09-28 12:28:33.835 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:28:33 ctl02 heat-engine[12803]: 2017-09-28 12:28:33.838 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:28:34 ctl02 nova-api[357]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:28:34 ctl02 nova-api[357]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:28:34 ctl02 nova-api[357]: 2017-09-28 12:28:34.218 357 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:28:34 ctl02 nova-api[357]: 2017-09-28 12:28:34.220 357 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:28:34 ctl02 nova-api[357]: 2017-09-28 12:28:34.220 357 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:28:34 ctl02 nova-api[357]: 2017-09-28 12:28:34.220 357 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:28:34 ctl02 nova-api[357]: 2017-09-28 12:28:34.220 357 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:28:34 ctl02 nova-api[357]: 2017-09-28 12:28:34.220 357 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:28:34 ctl02 nova-api[357]: 2017-09-28 12:28:34.220 357 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:28:34 ctl02 nova-api[357]: 2017-09-28 12:28:34.220 357 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:28:34 ctl02 nova-api[357]: 2017-09-28 12:28:34.220 357 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:28:34 ctl02 nova-api[357]: 2017-09-28 12:28:34.220 357 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:28:34 ctl02 nova-api[357]: 2017-09-28 12:28:34.220 357 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:28:34 ctl02 nova-api[357]: 2017-09-28 12:28:34.220 357 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:28:34 ctl02 nova-api[357]: 2017-09-28 12:28:34.220 357 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:28:34 ctl02 nova-api[357]: 2017-09-28 12:28:34.220 357 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:28:34 ctl02 nova-api[357]: 2017-09-28 12:28:34.220 357 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:28:34 ctl02 nova-api[357]: 2017-09-28 12:28:34.220 357 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:28:34 ctl02 nova-api[357]: 2017-09-28 12:28:34.220 357 ERROR nova.wsgi     self.filename))
Sep 28 12:28:34 ctl02 nova-api[357]: 2017-09-28 12:28:34.220 357 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:28:34 ctl02 nova-api[357]: 2017-09-28 12:28:34.220 357 ERROR nova.wsgi
Sep 28 12:28:34 ctl02 nova-api[357]: 2017-09-28 12:28:34.222 357 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:28:34 ctl02 nova-api[357]: 2017-09-28 12:28:34.348 357 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:28:34 ctl02 glance-api[29183]: 2017-09-28 12:28:34.425 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:28:34] "OPTIONS / HTTP/1.0" 200 134 0.000582
Sep 28 12:28:34 ctl02 nova-scheduler[5620]: 2017-09-28 12:28:34.537 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:28:34 ctl02 nova-api[357]: 2017-09-28 12:28:34.580 357 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:28:34 ctl02 nova-api[357]: 2017-09-28 12:28:34.583 357 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:28:34 ctl02 nova-api[357]: 2017-09-28 12:28:34.584 357 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:28:34 ctl02 nova-api[357]: 2017-09-28 12:28:34.584 357 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:28:34 ctl02 nova-api[357]: 2017-09-28 12:28:34.715 357 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:28:34 ctl02 nova-api[357]: 2017-09-28 12:28:34.717 357 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:28:34 ctl02 nova-api[357]: 2017-09-28 12:28:34.717 357 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:28:34 ctl02 nova-api[357]: 2017-09-28 12:28:34.718 357 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:28:34 ctl02 nova-api[357]: 2017-09-28 12:28:34.721 357 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:28:34 ctl02 nova-api[357]: 2017-09-28 12:28:34.721 357 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:28:34 ctl02 nova-api[357]: 2017-09-28 12:28:34.721 357 ERROR nova Traceback (most recent call last):
Sep 28 12:28:34 ctl02 nova-api[357]: 2017-09-28 12:28:34.721 357 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:28:34 ctl02 nova-api[357]: 2017-09-28 12:28:34.721 357 ERROR nova     sys.exit(main())
Sep 28 12:28:34 ctl02 nova-api[357]: 2017-09-28 12:28:34.721 357 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:28:34 ctl02 nova-api[357]: 2017-09-28 12:28:34.721 357 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:28:34 ctl02 nova-api[357]: 2017-09-28 12:28:34.721 357 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:28:34 ctl02 nova-api[357]: 2017-09-28 12:28:34.721 357 ERROR nova     max_url_len=max_url_len)
Sep 28 12:28:34 ctl02 nova-api[357]: 2017-09-28 12:28:34.721 357 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:28:34 ctl02 nova-api[357]: 2017-09-28 12:28:34.721 357 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:28:34 ctl02 nova-api[357]: 2017-09-28 12:28:34.721 357 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:28:34 ctl02 nova-api[357]: 2017-09-28 12:28:34.721 357 ERROR nova     sock.listen(backlog)
Sep 28 12:28:34 ctl02 nova-api[357]: 2017-09-28 12:28:34.721 357 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:28:34 ctl02 nova-api[357]: 2017-09-28 12:28:34.721 357 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:28:34 ctl02 nova-api[357]: 2017-09-28 12:28:34.721 357 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:28:34 ctl02 nova-api[357]: 2017-09-28 12:28:34.721 357 ERROR nova
Sep 28 12:28:34 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:28:34 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:28:34 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:28:34 ctl02 heat-api[13008]: 2017-09-28 12:28:34.923 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:28:34] "OPTIONS / HTTP/1.0" 200 134 0.000703
Sep 28 12:28:35 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:28:35 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:28:35 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:28:35 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:28:36 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:28:36.103 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:28:36] "OPTIONS / HTTP/1.0" 200 134 0.000401
Sep 28 12:28:36 ctl02 heat-api[13008]: 2017-09-28 12:28:36.305 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:28:36] "OPTIONS / HTTP/1.0" 200 134 0.000544
Sep 28 12:28:36 ctl02 neutron-server[30536]: 2017-09-28 12:28:36.441 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 2 dead agents out of 6:
Sep 28 12:28:36 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:28:36 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:23:57 cmp001
Sep 28 12:28:36 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:28:06 cmp002
Sep 28 12:28:36 ctl02 nova-api[375]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:28:36 ctl02 nova-api[375]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:28:36 ctl02 nova-api[375]: 2017-09-28 12:28:36.991 375 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:28:36 ctl02 nova-api[375]: 2017-09-28 12:28:36.993 375 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:28:36 ctl02 nova-api[375]: 2017-09-28 12:28:36.993 375 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:28:36 ctl02 nova-api[375]: 2017-09-28 12:28:36.993 375 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:28:36 ctl02 nova-api[375]: 2017-09-28 12:28:36.993 375 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:28:36 ctl02 nova-api[375]: 2017-09-28 12:28:36.993 375 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:28:36 ctl02 nova-api[375]: 2017-09-28 12:28:36.993 375 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:28:36 ctl02 nova-api[375]: 2017-09-28 12:28:36.993 375 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:28:36 ctl02 nova-api[375]: 2017-09-28 12:28:36.993 375 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:28:36 ctl02 nova-api[375]: 2017-09-28 12:28:36.993 375 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:28:36 ctl02 nova-api[375]: 2017-09-28 12:28:36.993 375 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:28:36 ctl02 nova-api[375]: 2017-09-28 12:28:36.993 375 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:28:36 ctl02 nova-api[375]: 2017-09-28 12:28:36.993 375 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:28:36 ctl02 nova-api[375]: 2017-09-28 12:28:36.993 375 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:28:36 ctl02 nova-api[375]: 2017-09-28 12:28:36.993 375 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:28:36 ctl02 nova-api[375]: 2017-09-28 12:28:36.993 375 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:28:36 ctl02 nova-api[375]: 2017-09-28 12:28:36.993 375 ERROR nova.wsgi     self.filename))
Sep 28 12:28:36 ctl02 nova-api[375]: 2017-09-28 12:28:36.993 375 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:28:36 ctl02 nova-api[375]: 2017-09-28 12:28:36.993 375 ERROR nova.wsgi
Sep 28 12:28:36 ctl02 nova-api[375]: 2017-09-28 12:28:36.995 375 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:28:37 ctl02 nova-api[375]: 2017-09-28 12:28:37.121 375 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:28:37 ctl02 nova-api[375]: 2017-09-28 12:28:37.342 375 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:28:37 ctl02 nova-api[375]: 2017-09-28 12:28:37.344 375 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:28:37 ctl02 nova-api[375]: 2017-09-28 12:28:37.345 375 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:28:37 ctl02 nova-api[375]: 2017-09-28 12:28:37.345 375 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:28:37 ctl02 nova-api[375]: 2017-09-28 12:28:37.474 375 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:28:37 ctl02 nova-api[375]: 2017-09-28 12:28:37.477 375 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:28:37 ctl02 nova-api[375]: 2017-09-28 12:28:37.477 375 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:28:37 ctl02 nova-api[375]: 2017-09-28 12:28:37.478 375 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:28:37 ctl02 nova-api[375]: 2017-09-28 12:28:37.481 375 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:28:37 ctl02 nova-api[375]: 2017-09-28 12:28:37.481 375 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:28:37 ctl02 nova-api[375]: 2017-09-28 12:28:37.481 375 ERROR nova Traceback (most recent call last):
Sep 28 12:28:37 ctl02 nova-api[375]: 2017-09-28 12:28:37.481 375 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:28:37 ctl02 nova-api[375]: 2017-09-28 12:28:37.481 375 ERROR nova     sys.exit(main())
Sep 28 12:28:37 ctl02 nova-api[375]: 2017-09-28 12:28:37.481 375 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:28:37 ctl02 nova-api[375]: 2017-09-28 12:28:37.481 375 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:28:37 ctl02 nova-api[375]: 2017-09-28 12:28:37.481 375 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:28:37 ctl02 nova-api[375]: 2017-09-28 12:28:37.481 375 ERROR nova     max_url_len=max_url_len)
Sep 28 12:28:37 ctl02 nova-api[375]: 2017-09-28 12:28:37.481 375 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:28:37 ctl02 nova-api[375]: 2017-09-28 12:28:37.481 375 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:28:37 ctl02 nova-api[375]: 2017-09-28 12:28:37.481 375 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:28:37 ctl02 nova-api[375]: 2017-09-28 12:28:37.481 375 ERROR nova     sock.listen(backlog)
Sep 28 12:28:37 ctl02 nova-api[375]: 2017-09-28 12:28:37.481 375 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:28:37 ctl02 nova-api[375]: 2017-09-28 12:28:37.481 375 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:28:37 ctl02 nova-api[375]: 2017-09-28 12:28:37.481 375 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:28:37 ctl02 nova-api[375]: 2017-09-28 12:28:37.481 375 ERROR nova
Sep 28 12:28:37 ctl02 heat-api-cfn[13300]: 2017-09-28 12:28:37.565 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:28:37] "OPTIONS / HTTP/1.0" 200 134 0.000485
Sep 28 12:28:37 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:28:37 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:28:37 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:28:37 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:28:37.671 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:28:37] "OPTIONS / HTTP/1.0" 200 134 0.000472
Sep 28 12:28:37 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:28:37 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:28:37 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:28:37 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:28:38 ctl02 neutron-server[30536]: 2017-09-28 12:28:38.831 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:28:38] "OPTIONS / HTTP/1.0" 200 262 0.000452
Sep 28 12:28:39 ctl02 heat-api[13008]: 2017-09-28 12:28:39.252 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:28:39] "OPTIONS / HTTP/1.0" 200 134 0.000593
Sep 28 12:28:39 ctl02 nova-api[393]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:28:39 ctl02 nova-api[393]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:28:39 ctl02 nova-api[393]: 2017-09-28 12:28:39.755 393 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:28:39 ctl02 nova-api[393]: 2017-09-28 12:28:39.756 393 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:28:39 ctl02 nova-api[393]: 2017-09-28 12:28:39.756 393 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:28:39 ctl02 nova-api[393]: 2017-09-28 12:28:39.756 393 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:28:39 ctl02 nova-api[393]: 2017-09-28 12:28:39.756 393 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:28:39 ctl02 nova-api[393]: 2017-09-28 12:28:39.756 393 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:28:39 ctl02 nova-api[393]: 2017-09-28 12:28:39.756 393 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:28:39 ctl02 nova-api[393]: 2017-09-28 12:28:39.756 393 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:28:39 ctl02 nova-api[393]: 2017-09-28 12:28:39.756 393 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:28:39 ctl02 nova-api[393]: 2017-09-28 12:28:39.756 393 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:28:39 ctl02 nova-api[393]: 2017-09-28 12:28:39.756 393 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:28:39 ctl02 nova-api[393]: 2017-09-28 12:28:39.756 393 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:28:39 ctl02 nova-api[393]: 2017-09-28 12:28:39.756 393 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:28:39 ctl02 nova-api[393]: 2017-09-28 12:28:39.756 393 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:28:39 ctl02 nova-api[393]: 2017-09-28 12:28:39.756 393 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:28:39 ctl02 nova-api[393]: 2017-09-28 12:28:39.756 393 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:28:39 ctl02 nova-api[393]: 2017-09-28 12:28:39.756 393 ERROR nova.wsgi     self.filename))
Sep 28 12:28:39 ctl02 nova-api[393]: 2017-09-28 12:28:39.756 393 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:28:39 ctl02 nova-api[393]: 2017-09-28 12:28:39.756 393 ERROR nova.wsgi
Sep 28 12:28:39 ctl02 nova-api[393]: 2017-09-28 12:28:39.757 393 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:28:39 ctl02 nova-api[393]: 2017-09-28 12:28:39.884 393 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:28:40 ctl02 nova-api[393]: 2017-09-28 12:28:40.109 393 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:28:40 ctl02 nova-api[393]: 2017-09-28 12:28:40.111 393 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:28:40 ctl02 nova-api[393]: 2017-09-28 12:28:40.111 393 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:28:40 ctl02 nova-api[393]: 2017-09-28 12:28:40.111 393 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:28:40 ctl02 nova-api[393]: 2017-09-28 12:28:40.240 393 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:28:40 ctl02 nova-api[393]: 2017-09-28 12:28:40.242 393 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:28:40 ctl02 nova-api[393]: 2017-09-28 12:28:40.242 393 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:28:40 ctl02 nova-api[393]: 2017-09-28 12:28:40.243 393 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:28:40 ctl02 nova-api[393]: 2017-09-28 12:28:40.246 393 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:28:40 ctl02 nova-api[393]: 2017-09-28 12:28:40.246 393 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:28:40 ctl02 nova-api[393]: 2017-09-28 12:28:40.246 393 ERROR nova Traceback (most recent call last):
Sep 28 12:28:40 ctl02 nova-api[393]: 2017-09-28 12:28:40.246 393 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:28:40 ctl02 nova-api[393]: 2017-09-28 12:28:40.246 393 ERROR nova     sys.exit(main())
Sep 28 12:28:40 ctl02 nova-api[393]: 2017-09-28 12:28:40.246 393 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:28:40 ctl02 nova-api[393]: 2017-09-28 12:28:40.246 393 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:28:40 ctl02 nova-api[393]: 2017-09-28 12:28:40.246 393 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:28:40 ctl02 nova-api[393]: 2017-09-28 12:28:40.246 393 ERROR nova     max_url_len=max_url_len)
Sep 28 12:28:40 ctl02 nova-api[393]: 2017-09-28 12:28:40.246 393 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:28:40 ctl02 nova-api[393]: 2017-09-28 12:28:40.246 393 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:28:40 ctl02 nova-api[393]: 2017-09-28 12:28:40.246 393 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:28:40 ctl02 nova-api[393]: 2017-09-28 12:28:40.246 393 ERROR nova     sock.listen(backlog)
Sep 28 12:28:40 ctl02 nova-api[393]: 2017-09-28 12:28:40.246 393 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:28:40 ctl02 nova-api[393]: 2017-09-28 12:28:40.246 393 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:28:40 ctl02 nova-api[393]: 2017-09-28 12:28:40.246 393 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:28:40 ctl02 nova-api[393]: 2017-09-28 12:28:40.246 393 ERROR nova
Sep 28 12:28:40 ctl02 heat-api-cfn[13300]: 2017-09-28 12:28:40.288 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:28:40] "OPTIONS / HTTP/1.0" 200 134 0.000607
Sep 28 12:28:40 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:28:40 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:28:40 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:28:40 ctl02 neutron-server[30536]: 2017-09-28 12:28:40.544 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:28:40] "OPTIONS / HTTP/1.0" 200 262 0.000634
Sep 28 12:28:40 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdfd30b65)
Sep 28 12:28:40 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:28:40 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:28:40 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:28:40 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:28:40 ctl02 glance-api[29183]: 2017-09-28 12:28:40.720 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:28:40] "OPTIONS / HTTP/1.0" 200 134 0.000679
Sep 28 12:28:40 ctl02 heat-api-cfn[13300]: 2017-09-28 12:28:40.927 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:28:40] "OPTIONS / HTTP/1.0" 200 134 0.000484
Sep 28 12:28:41 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdfd30b65)
Sep 28 12:28:42 ctl02 neutron-server[30536]: 2017-09-28 12:28:42.240 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:28:42] "OPTIONS / HTTP/1.0" 200 262 0.000471
Sep 28 12:28:42 ctl02 nova-api[411]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:28:42 ctl02 nova-api[411]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:28:42 ctl02 nova-api[411]: 2017-09-28 12:28:42.526 411 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:28:42 ctl02 nova-api[411]: 2017-09-28 12:28:42.528 411 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:28:42 ctl02 nova-api[411]: 2017-09-28 12:28:42.528 411 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:28:42 ctl02 nova-api[411]: 2017-09-28 12:28:42.528 411 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:28:42 ctl02 nova-api[411]: 2017-09-28 12:28:42.528 411 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:28:42 ctl02 nova-api[411]: 2017-09-28 12:28:42.528 411 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:28:42 ctl02 nova-api[411]: 2017-09-28 12:28:42.528 411 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:28:42 ctl02 nova-api[411]: 2017-09-28 12:28:42.528 411 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:28:42 ctl02 nova-api[411]: 2017-09-28 12:28:42.528 411 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:28:42 ctl02 nova-api[411]: 2017-09-28 12:28:42.528 411 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:28:42 ctl02 nova-api[411]: 2017-09-28 12:28:42.528 411 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:28:42 ctl02 nova-api[411]: 2017-09-28 12:28:42.528 411 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:28:42 ctl02 nova-api[411]: 2017-09-28 12:28:42.528 411 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:28:42 ctl02 nova-api[411]: 2017-09-28 12:28:42.528 411 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:28:42 ctl02 nova-api[411]: 2017-09-28 12:28:42.528 411 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:28:42 ctl02 nova-api[411]: 2017-09-28 12:28:42.528 411 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:28:42 ctl02 nova-api[411]: 2017-09-28 12:28:42.528 411 ERROR nova.wsgi     self.filename))
Sep 28 12:28:42 ctl02 nova-api[411]: 2017-09-28 12:28:42.528 411 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:28:42 ctl02 nova-api[411]: 2017-09-28 12:28:42.528 411 ERROR nova.wsgi
Sep 28 12:28:42 ctl02 nova-api[411]: 2017-09-28 12:28:42.530 411 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:28:42 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdfd30b65)
Sep 28 12:28:42 ctl02 nova-api[411]: 2017-09-28 12:28:42.664 411 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:28:42 ctl02 nova-api[411]: 2017-09-28 12:28:42.896 411 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:28:42 ctl02 nova-api[411]: 2017-09-28 12:28:42.899 411 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:28:42 ctl02 nova-api[411]: 2017-09-28 12:28:42.899 411 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:28:42 ctl02 nova-api[411]: 2017-09-28 12:28:42.900 411 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:28:43 ctl02 nova-api[411]: 2017-09-28 12:28:43.035 411 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:28:43 ctl02 nova-api[411]: 2017-09-28 12:28:43.038 411 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:28:43 ctl02 nova-api[411]: 2017-09-28 12:28:43.038 411 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:28:43 ctl02 nova-api[411]: 2017-09-28 12:28:43.038 411 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:28:43 ctl02 nova-api[411]: 2017-09-28 12:28:43.042 411 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:28:43 ctl02 nova-api[411]: 2017-09-28 12:28:43.042 411 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:28:43 ctl02 nova-api[411]: 2017-09-28 12:28:43.042 411 ERROR nova Traceback (most recent call last):
Sep 28 12:28:43 ctl02 nova-api[411]: 2017-09-28 12:28:43.042 411 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:28:43 ctl02 nova-api[411]: 2017-09-28 12:28:43.042 411 ERROR nova     sys.exit(main())
Sep 28 12:28:43 ctl02 nova-api[411]: 2017-09-28 12:28:43.042 411 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:28:43 ctl02 nova-api[411]: 2017-09-28 12:28:43.042 411 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:28:43 ctl02 nova-api[411]: 2017-09-28 12:28:43.042 411 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:28:43 ctl02 nova-api[411]: 2017-09-28 12:28:43.042 411 ERROR nova     max_url_len=max_url_len)
Sep 28 12:28:43 ctl02 nova-api[411]: 2017-09-28 12:28:43.042 411 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:28:43 ctl02 nova-api[411]: 2017-09-28 12:28:43.042 411 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:28:43 ctl02 nova-api[411]: 2017-09-28 12:28:43.042 411 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:28:43 ctl02 nova-api[411]: 2017-09-28 12:28:43.042 411 ERROR nova     sock.listen(backlog)
Sep 28 12:28:43 ctl02 nova-api[411]: 2017-09-28 12:28:43.042 411 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:28:43 ctl02 nova-api[411]: 2017-09-28 12:28:43.042 411 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:28:43 ctl02 nova-api[411]: 2017-09-28 12:28:43.042 411 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:28:43 ctl02 nova-api[411]: 2017-09-28 12:28:43.042 411 ERROR nova
Sep 28 12:28:43 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:28:43 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:28:43 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:28:43 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:28:43 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:28:43 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:28:43 ctl02 glance-api[29183]: 2017-09-28 12:28:43.392 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:28:43] "OPTIONS / HTTP/1.0" 200 134 0.000746
Sep 28 12:28:43 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:28:43 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdfd30b65)
Sep 28 12:28:43 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:28:43.679 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:28:43] "OPTIONS / HTTP/1.0" 200 134 0.000409
Sep 28 12:28:44 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdfd30b65)
Sep 28 12:28:44 ctl02 glance-api[29183]: 2017-09-28 12:28:44.655 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:28:44] "OPTIONS / HTTP/1.0" 200 134 0.000583
Sep 28 12:28:45 ctl02 nova-api[429]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:28:45 ctl02 nova-api[429]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:28:45 ctl02 nova-api[429]: 2017-09-28 12:28:45.227 429 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:28:45 ctl02 nova-api[429]: 2017-09-28 12:28:45.229 429 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:28:45 ctl02 nova-api[429]: 2017-09-28 12:28:45.229 429 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:28:45 ctl02 nova-api[429]: 2017-09-28 12:28:45.229 429 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:28:45 ctl02 nova-api[429]: 2017-09-28 12:28:45.229 429 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:28:45 ctl02 nova-api[429]: 2017-09-28 12:28:45.229 429 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:28:45 ctl02 nova-api[429]: 2017-09-28 12:28:45.229 429 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:28:45 ctl02 nova-api[429]: 2017-09-28 12:28:45.229 429 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:28:45 ctl02 nova-api[429]: 2017-09-28 12:28:45.229 429 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:28:45 ctl02 nova-api[429]: 2017-09-28 12:28:45.229 429 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:28:45 ctl02 nova-api[429]: 2017-09-28 12:28:45.229 429 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:28:45 ctl02 nova-api[429]: 2017-09-28 12:28:45.229 429 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:28:45 ctl02 nova-api[429]: 2017-09-28 12:28:45.229 429 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:28:45 ctl02 nova-api[429]: 2017-09-28 12:28:45.229 429 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:28:45 ctl02 nova-api[429]: 2017-09-28 12:28:45.229 429 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:28:45 ctl02 nova-api[429]: 2017-09-28 12:28:45.229 429 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:28:45 ctl02 nova-api[429]: 2017-09-28 12:28:45.229 429 ERROR nova.wsgi     self.filename))
Sep 28 12:28:45 ctl02 nova-api[429]: 2017-09-28 12:28:45.229 429 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:28:45 ctl02 nova-api[429]: 2017-09-28 12:28:45.229 429 ERROR nova.wsgi
Sep 28 12:28:45 ctl02 nova-api[429]: 2017-09-28 12:28:45.230 429 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:28:45 ctl02 heat-api[13008]: 2017-09-28 12:28:45.243 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:28:45] "OPTIONS / HTTP/1.0" 200 134 0.000572
Sep 28 12:28:45 ctl02 nova-api[429]: 2017-09-28 12:28:45.359 429 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:28:45 ctl02 nova-api[429]: 2017-09-28 12:28:45.584 429 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:28:45 ctl02 nova-api[429]: 2017-09-28 12:28:45.586 429 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:28:45 ctl02 nova-api[429]: 2017-09-28 12:28:45.586 429 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:28:45 ctl02 nova-api[429]: 2017-09-28 12:28:45.586 429 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:28:45 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdfd30b65)
Sep 28 12:28:45 ctl02 nova-api[429]: 2017-09-28 12:28:45.717 429 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:28:45 ctl02 nova-api[429]: 2017-09-28 12:28:45.719 429 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:28:45 ctl02 nova-api[429]: 2017-09-28 12:28:45.719 429 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:28:45 ctl02 nova-api[429]: 2017-09-28 12:28:45.719 429 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:28:45 ctl02 nova-api[429]: 2017-09-28 12:28:45.722 429 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:28:45 ctl02 nova-api[429]: 2017-09-28 12:28:45.723 429 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:28:45 ctl02 nova-api[429]: 2017-09-28 12:28:45.723 429 ERROR nova Traceback (most recent call last):
Sep 28 12:28:45 ctl02 nova-api[429]: 2017-09-28 12:28:45.723 429 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:28:45 ctl02 nova-api[429]: 2017-09-28 12:28:45.723 429 ERROR nova     sys.exit(main())
Sep 28 12:28:45 ctl02 nova-api[429]: 2017-09-28 12:28:45.723 429 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:28:45 ctl02 nova-api[429]: 2017-09-28 12:28:45.723 429 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:28:45 ctl02 nova-api[429]: 2017-09-28 12:28:45.723 429 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:28:45 ctl02 nova-api[429]: 2017-09-28 12:28:45.723 429 ERROR nova     max_url_len=max_url_len)
Sep 28 12:28:45 ctl02 nova-api[429]: 2017-09-28 12:28:45.723 429 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:28:45 ctl02 nova-api[429]: 2017-09-28 12:28:45.723 429 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:28:45 ctl02 nova-api[429]: 2017-09-28 12:28:45.723 429 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:28:45 ctl02 nova-api[429]: 2017-09-28 12:28:45.723 429 ERROR nova     sock.listen(backlog)
Sep 28 12:28:45 ctl02 nova-api[429]: 2017-09-28 12:28:45.723 429 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:28:45 ctl02 nova-api[429]: 2017-09-28 12:28:45.723 429 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:28:45 ctl02 nova-api[429]: 2017-09-28 12:28:45.723 429 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:28:45 ctl02 nova-api[429]: 2017-09-28 12:28:45.723 429 ERROR nova
Sep 28 12:28:45 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:28:45 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:28:45 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:28:46 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:28:46 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:28:46 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:28:46 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:28:46 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:28:46.428 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:28:46] "OPTIONS / HTTP/1.0" 200 134 0.000423
Sep 28 12:28:46 ctl02 heat-api[13008]: 2017-09-28 12:28:46.447 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:28:46] "OPTIONS / HTTP/1.0" 200 134 0.000547
Sep 28 12:28:46 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdfd30b65)
Sep 28 12:28:47 ctl02 heat-api-cfn[13300]: 2017-09-28 12:28:47.548 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:28:47] "OPTIONS / HTTP/1.0" 200 134 0.000593
Sep 28 12:28:47 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdfd30b65)
Sep 28 12:28:47 ctl02 nova-api[447]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:28:47 ctl02 nova-api[447]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:28:47 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:28:47.899 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:28:47] "OPTIONS / HTTP/1.0" 200 134 0.000554
Sep 28 12:28:48 ctl02 nova-api[447]: 2017-09-28 12:28:48.012 447 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:28:48 ctl02 nova-api[447]: 2017-09-28 12:28:48.013 447 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:28:48 ctl02 nova-api[447]: 2017-09-28 12:28:48.013 447 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:28:48 ctl02 nova-api[447]: 2017-09-28 12:28:48.013 447 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:28:48 ctl02 nova-api[447]: 2017-09-28 12:28:48.013 447 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:28:48 ctl02 nova-api[447]: 2017-09-28 12:28:48.013 447 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:28:48 ctl02 nova-api[447]: 2017-09-28 12:28:48.013 447 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:28:48 ctl02 nova-api[447]: 2017-09-28 12:28:48.013 447 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:28:48 ctl02 nova-api[447]: 2017-09-28 12:28:48.013 447 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:28:48 ctl02 nova-api[447]: 2017-09-28 12:28:48.013 447 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:28:48 ctl02 nova-api[447]: 2017-09-28 12:28:48.013 447 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:28:48 ctl02 nova-api[447]: 2017-09-28 12:28:48.013 447 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:28:48 ctl02 nova-api[447]: 2017-09-28 12:28:48.013 447 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:28:48 ctl02 nova-api[447]: 2017-09-28 12:28:48.013 447 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:28:48 ctl02 nova-api[447]: 2017-09-28 12:28:48.013 447 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:28:48 ctl02 nova-api[447]: 2017-09-28 12:28:48.013 447 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:28:48 ctl02 nova-api[447]: 2017-09-28 12:28:48.013 447 ERROR nova.wsgi     self.filename))
Sep 28 12:28:48 ctl02 nova-api[447]: 2017-09-28 12:28:48.013 447 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:28:48 ctl02 nova-api[447]: 2017-09-28 12:28:48.013 447 ERROR nova.wsgi
Sep 28 12:28:48 ctl02 nova-api[447]: 2017-09-28 12:28:48.016 447 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:28:48 ctl02 nova-api[447]: 2017-09-28 12:28:48.150 447 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:28:48 ctl02 nova-api[447]: 2017-09-28 12:28:48.395 447 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:28:48 ctl02 nova-api[447]: 2017-09-28 12:28:48.397 447 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:28:48 ctl02 nova-api[447]: 2017-09-28 12:28:48.398 447 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:28:48 ctl02 nova-api[447]: 2017-09-28 12:28:48.398 447 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:28:48 ctl02 nova-api[447]: 2017-09-28 12:28:48.537 447 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:28:48 ctl02 nova-api[447]: 2017-09-28 12:28:48.540 447 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:28:48 ctl02 nova-api[447]: 2017-09-28 12:28:48.540 447 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:28:48 ctl02 nova-api[447]: 2017-09-28 12:28:48.540 447 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:28:48 ctl02 nova-api[447]: 2017-09-28 12:28:48.544 447 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:28:48 ctl02 nova-api[447]: 2017-09-28 12:28:48.544 447 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:28:48 ctl02 nova-api[447]: 2017-09-28 12:28:48.544 447 ERROR nova Traceback (most recent call last):
Sep 28 12:28:48 ctl02 nova-api[447]: 2017-09-28 12:28:48.544 447 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:28:48 ctl02 nova-api[447]: 2017-09-28 12:28:48.544 447 ERROR nova     sys.exit(main())
Sep 28 12:28:48 ctl02 nova-api[447]: 2017-09-28 12:28:48.544 447 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:28:48 ctl02 nova-api[447]: 2017-09-28 12:28:48.544 447 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:28:48 ctl02 nova-api[447]: 2017-09-28 12:28:48.544 447 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:28:48 ctl02 nova-api[447]: 2017-09-28 12:28:48.544 447 ERROR nova     max_url_len=max_url_len)
Sep 28 12:28:48 ctl02 nova-api[447]: 2017-09-28 12:28:48.544 447 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:28:48 ctl02 nova-api[447]: 2017-09-28 12:28:48.544 447 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:28:48 ctl02 nova-api[447]: 2017-09-28 12:28:48.544 447 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:28:48 ctl02 nova-api[447]: 2017-09-28 12:28:48.544 447 ERROR nova     sock.listen(backlog)
Sep 28 12:28:48 ctl02 nova-api[447]: 2017-09-28 12:28:48.544 447 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:28:48 ctl02 nova-api[447]: 2017-09-28 12:28:48.544 447 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:28:48 ctl02 nova-api[447]: 2017-09-28 12:28:48.544 447 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:28:48 ctl02 nova-api[447]: 2017-09-28 12:28:48.544 447 ERROR nova
Sep 28 12:28:48 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdfd30b65)
Sep 28 12:28:48 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:28:48 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:28:48 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:28:48 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:28:48 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:28:48 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:28:48 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:28:49 ctl02 neutron-server[30536]: 2017-09-28 12:28:49.011 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:28:49] "OPTIONS / HTTP/1.0" 200 262 0.000527
Sep 28 12:28:49 ctl02 heat-api[13008]: 2017-09-28 12:28:49.036 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:28:49] "OPTIONS / HTTP/1.0" 200 134 0.000536
Sep 28 12:28:49 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdfd30b65)
Sep 28 12:28:50 ctl02 heat-api-cfn[13300]: 2017-09-28 12:28:50.513 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:28:50] "OPTIONS / HTTP/1.0" 200 134 0.000465
Sep 28 12:28:50 ctl02 nova-api[464]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:28:50 ctl02 nova-api[464]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:28:50 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdfd30b65)
Sep 28 12:28:50 ctl02 nova-api[464]: 2017-09-28 12:28:50.758 464 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:28:50 ctl02 nova-api[464]: 2017-09-28 12:28:50.760 464 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:28:50 ctl02 nova-api[464]: 2017-09-28 12:28:50.760 464 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:28:50 ctl02 nova-api[464]: 2017-09-28 12:28:50.760 464 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:28:50 ctl02 nova-api[464]: 2017-09-28 12:28:50.760 464 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:28:50 ctl02 nova-api[464]: 2017-09-28 12:28:50.760 464 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:28:50 ctl02 nova-api[464]: 2017-09-28 12:28:50.760 464 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:28:50 ctl02 nova-api[464]: 2017-09-28 12:28:50.760 464 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:28:50 ctl02 nova-api[464]: 2017-09-28 12:28:50.760 464 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:28:50 ctl02 nova-api[464]: 2017-09-28 12:28:50.760 464 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:28:50 ctl02 nova-api[464]: 2017-09-28 12:28:50.760 464 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:28:50 ctl02 nova-api[464]: 2017-09-28 12:28:50.760 464 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:28:50 ctl02 nova-api[464]: 2017-09-28 12:28:50.760 464 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:28:50 ctl02 nova-api[464]: 2017-09-28 12:28:50.760 464 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:28:50 ctl02 nova-api[464]: 2017-09-28 12:28:50.760 464 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:28:50 ctl02 nova-api[464]: 2017-09-28 12:28:50.760 464 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:28:50 ctl02 nova-api[464]: 2017-09-28 12:28:50.760 464 ERROR nova.wsgi     self.filename))
Sep 28 12:28:50 ctl02 nova-api[464]: 2017-09-28 12:28:50.760 464 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:28:50 ctl02 nova-api[464]: 2017-09-28 12:28:50.760 464 ERROR nova.wsgi
Sep 28 12:28:50 ctl02 nova-api[464]: 2017-09-28 12:28:50.762 464 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:28:50 ctl02 nova-api[464]: 2017-09-28 12:28:50.889 464 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:28:50 ctl02 neutron-server[30536]: 2017-09-28 12:28:50.918 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:28:50] "OPTIONS / HTTP/1.0" 200 262 0.000449
Sep 28 12:28:50 ctl02 glance-api[29183]: 2017-09-28 12:28:50.937 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:28:50] "OPTIONS / HTTP/1.0" 200 134 0.000563
Sep 28 12:28:51 ctl02 nova-api[464]: 2017-09-28 12:28:51.111 464 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:28:51 ctl02 nova-api[464]: 2017-09-28 12:28:51.114 464 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:28:51 ctl02 nova-api[464]: 2017-09-28 12:28:51.114 464 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:28:51 ctl02 nova-api[464]: 2017-09-28 12:28:51.114 464 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:28:51 ctl02 heat-api-cfn[13300]: 2017-09-28 12:28:51.165 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:28:51] "OPTIONS / HTTP/1.0" 200 134 0.000429
Sep 28 12:28:51 ctl02 nova-api[464]: 2017-09-28 12:28:51.245 464 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:28:51 ctl02 nova-api[464]: 2017-09-28 12:28:51.247 464 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:28:51 ctl02 nova-api[464]: 2017-09-28 12:28:51.248 464 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:28:51 ctl02 nova-api[464]: 2017-09-28 12:28:51.248 464 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:28:51 ctl02 nova-api[464]: 2017-09-28 12:28:51.251 464 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:28:51 ctl02 nova-api[464]: 2017-09-28 12:28:51.252 464 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:28:51 ctl02 nova-api[464]: 2017-09-28 12:28:51.252 464 ERROR nova Traceback (most recent call last):
Sep 28 12:28:51 ctl02 nova-api[464]: 2017-09-28 12:28:51.252 464 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:28:51 ctl02 nova-api[464]: 2017-09-28 12:28:51.252 464 ERROR nova     sys.exit(main())
Sep 28 12:28:51 ctl02 nova-api[464]: 2017-09-28 12:28:51.252 464 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:28:51 ctl02 nova-api[464]: 2017-09-28 12:28:51.252 464 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:28:51 ctl02 nova-api[464]: 2017-09-28 12:28:51.252 464 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:28:51 ctl02 nova-api[464]: 2017-09-28 12:28:51.252 464 ERROR nova     max_url_len=max_url_len)
Sep 28 12:28:51 ctl02 nova-api[464]: 2017-09-28 12:28:51.252 464 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:28:51 ctl02 nova-api[464]: 2017-09-28 12:28:51.252 464 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:28:51 ctl02 nova-api[464]: 2017-09-28 12:28:51.252 464 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:28:51 ctl02 nova-api[464]: 2017-09-28 12:28:51.252 464 ERROR nova     sock.listen(backlog)
Sep 28 12:28:51 ctl02 nova-api[464]: 2017-09-28 12:28:51.252 464 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:28:51 ctl02 nova-api[464]: 2017-09-28 12:28:51.252 464 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:28:51 ctl02 nova-api[464]: 2017-09-28 12:28:51.252 464 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:28:51 ctl02 nova-api[464]: 2017-09-28 12:28:51.252 464 ERROR nova
Sep 28 12:28:51 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:28:51 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:28:51 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:28:51 ctl02 neutron-server[30536]: 2017-09-28 12:28:51.437 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 4 dead agents out of 6:
Sep 28 12:28:51 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:28:51 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:28:08 cmp002
Sep 28 12:28:51 ctl02 neutron-server[30536]:       Metadata agent  2017-09-28 12:28:07 cmp002
Sep 28 12:28:51 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:23:57 cmp001
Sep 28 12:28:51 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:28:06 cmp002
Sep 28 12:28:51 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:28:51 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:28:51 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:28:51 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:28:51 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:28:51 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:28:52 ctl02 neutron-server[30536]: 2017-09-28 12:28:52.223 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:28:52] "OPTIONS / HTTP/1.0" 200 262 0.000448
Sep 28 12:28:53 ctl02 nova-api[490]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:28:53 ctl02 nova-api[490]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:28:53 ctl02 nova-api[490]: 2017-09-28 12:28:53.516 490 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:28:53 ctl02 nova-api[490]: 2017-09-28 12:28:53.517 490 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:28:53 ctl02 nova-api[490]: 2017-09-28 12:28:53.517 490 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:28:53 ctl02 nova-api[490]: 2017-09-28 12:28:53.517 490 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:28:53 ctl02 nova-api[490]: 2017-09-28 12:28:53.517 490 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:28:53 ctl02 nova-api[490]: 2017-09-28 12:28:53.517 490 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:28:53 ctl02 nova-api[490]: 2017-09-28 12:28:53.517 490 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:28:53 ctl02 nova-api[490]: 2017-09-28 12:28:53.517 490 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:28:53 ctl02 nova-api[490]: 2017-09-28 12:28:53.517 490 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:28:53 ctl02 nova-api[490]: 2017-09-28 12:28:53.517 490 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:28:53 ctl02 nova-api[490]: 2017-09-28 12:28:53.517 490 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:28:53 ctl02 nova-api[490]: 2017-09-28 12:28:53.517 490 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:28:53 ctl02 nova-api[490]: 2017-09-28 12:28:53.517 490 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:28:53 ctl02 nova-api[490]: 2017-09-28 12:28:53.517 490 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:28:53 ctl02 nova-api[490]: 2017-09-28 12:28:53.517 490 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:28:53 ctl02 nova-api[490]: 2017-09-28 12:28:53.517 490 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:28:53 ctl02 nova-api[490]: 2017-09-28 12:28:53.517 490 ERROR nova.wsgi     self.filename))
Sep 28 12:28:53 ctl02 nova-api[490]: 2017-09-28 12:28:53.517 490 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:28:53 ctl02 nova-api[490]: 2017-09-28 12:28:53.517 490 ERROR nova.wsgi
Sep 28 12:28:53 ctl02 nova-api[490]: 2017-09-28 12:28:53.520 490 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:28:53 ctl02 nova-api[490]: 2017-09-28 12:28:53.655 490 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:28:53 ctl02 nova-cert[4860]: 2017-09-28 12:28:53.662 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:28:53 ctl02 glance-api[29183]: 2017-09-28 12:28:53.705 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:28:53] "OPTIONS / HTTP/1.0" 200 134 0.000644
Sep 28 12:28:53 ctl02 nova-api[490]: 2017-09-28 12:28:53.907 490 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:28:53 ctl02 nova-api[490]: 2017-09-28 12:28:53.910 490 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:28:53 ctl02 nova-api[490]: 2017-09-28 12:28:53.910 490 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:28:53 ctl02 nova-api[490]: 2017-09-28 12:28:53.911 490 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:28:53 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:28:53.989 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:28:53] "OPTIONS / HTTP/1.0" 200 134 0.000509
Sep 28 12:28:54 ctl02 nova-api[490]: 2017-09-28 12:28:54.046 490 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:28:54 ctl02 nova-api[490]: 2017-09-28 12:28:54.049 490 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:28:54 ctl02 nova-api[490]: 2017-09-28 12:28:54.049 490 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:28:54 ctl02 nova-api[490]: 2017-09-28 12:28:54.050 490 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:28:54 ctl02 nova-api[490]: 2017-09-28 12:28:54.053 490 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:28:54 ctl02 nova-api[490]: 2017-09-28 12:28:54.054 490 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:28:54 ctl02 nova-api[490]: 2017-09-28 12:28:54.054 490 ERROR nova Traceback (most recent call last):
Sep 28 12:28:54 ctl02 nova-api[490]: 2017-09-28 12:28:54.054 490 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:28:54 ctl02 nova-api[490]: 2017-09-28 12:28:54.054 490 ERROR nova     sys.exit(main())
Sep 28 12:28:54 ctl02 nova-api[490]: 2017-09-28 12:28:54.054 490 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:28:54 ctl02 nova-api[490]: 2017-09-28 12:28:54.054 490 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:28:54 ctl02 nova-api[490]: 2017-09-28 12:28:54.054 490 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:28:54 ctl02 nova-api[490]: 2017-09-28 12:28:54.054 490 ERROR nova     max_url_len=max_url_len)
Sep 28 12:28:54 ctl02 nova-api[490]: 2017-09-28 12:28:54.054 490 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:28:54 ctl02 nova-api[490]: 2017-09-28 12:28:54.054 490 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:28:54 ctl02 nova-api[490]: 2017-09-28 12:28:54.054 490 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:28:54 ctl02 nova-api[490]: 2017-09-28 12:28:54.054 490 ERROR nova     sock.listen(backlog)
Sep 28 12:28:54 ctl02 nova-api[490]: 2017-09-28 12:28:54.054 490 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:28:54 ctl02 nova-api[490]: 2017-09-28 12:28:54.054 490 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:28:54 ctl02 nova-api[490]: 2017-09-28 12:28:54.054 490 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:28:54 ctl02 nova-api[490]: 2017-09-28 12:28:54.054 490 ERROR nova
Sep 28 12:28:54 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:28:54 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:28:54 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:28:54 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:28:54 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:28:54 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:28:54 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:28:54 ctl02 glance-api[29183]: 2017-09-28 12:28:54.710 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:28:54] "OPTIONS / HTTP/1.0" 200 134 0.000980
Sep 28 12:28:54 ctl02 nova-conductor[5056]: 2017-09-28 12:28:54.715 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:28:54 ctl02 nova-conductor[5056]: 2017-09-28 12:28:54.727 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:28:54 ctl02 nova-conductor[5056]: 2017-09-28 12:28:54.744 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:28:54 ctl02 nova-conductor[5056]: 2017-09-28 12:28:54.753 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:28:55 ctl02 heat-api[13008]: 2017-09-28 12:28:55.270 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:28:55] "OPTIONS / HTTP/1.0" 200 134 0.000587
Sep 28 12:28:56 ctl02 nova-api[508]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:28:56 ctl02 nova-api[508]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:28:56 ctl02 nova-api[508]: 2017-09-28 12:28:56.292 508 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:28:56 ctl02 nova-api[508]: 2017-09-28 12:28:56.293 508 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:28:56 ctl02 nova-api[508]: 2017-09-28 12:28:56.293 508 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:28:56 ctl02 nova-api[508]: 2017-09-28 12:28:56.293 508 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:28:56 ctl02 nova-api[508]: 2017-09-28 12:28:56.293 508 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:28:56 ctl02 nova-api[508]: 2017-09-28 12:28:56.293 508 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:28:56 ctl02 nova-api[508]: 2017-09-28 12:28:56.293 508 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:28:56 ctl02 nova-api[508]: 2017-09-28 12:28:56.293 508 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:28:56 ctl02 nova-api[508]: 2017-09-28 12:28:56.293 508 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:28:56 ctl02 nova-api[508]: 2017-09-28 12:28:56.293 508 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:28:56 ctl02 nova-api[508]: 2017-09-28 12:28:56.293 508 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:28:56 ctl02 nova-api[508]: 2017-09-28 12:28:56.293 508 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:28:56 ctl02 nova-api[508]: 2017-09-28 12:28:56.293 508 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:28:56 ctl02 nova-api[508]: 2017-09-28 12:28:56.293 508 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:28:56 ctl02 nova-api[508]: 2017-09-28 12:28:56.293 508 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:28:56 ctl02 nova-api[508]: 2017-09-28 12:28:56.293 508 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:28:56 ctl02 nova-api[508]: 2017-09-28 12:28:56.293 508 ERROR nova.wsgi     self.filename))
Sep 28 12:28:56 ctl02 nova-api[508]: 2017-09-28 12:28:56.293 508 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:28:56 ctl02 nova-api[508]: 2017-09-28 12:28:56.293 508 ERROR nova.wsgi
Sep 28 12:28:56 ctl02 nova-api[508]: 2017-09-28 12:28:56.294 508 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:28:56 ctl02 nova-api[508]: 2017-09-28 12:28:56.425 508 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:28:56 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:28:56.530 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:28:56] "OPTIONS / HTTP/1.0" 200 134 0.000485
Sep 28 12:28:56 ctl02 heat-api[13008]: 2017-09-28 12:28:56.638 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:28:56] "OPTIONS / HTTP/1.0" 200 134 0.000665
Sep 28 12:28:56 ctl02 nova-api[508]: 2017-09-28 12:28:56.675 508 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:28:56 ctl02 nova-api[508]: 2017-09-28 12:28:56.677 508 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:28:56 ctl02 nova-api[508]: 2017-09-28 12:28:56.677 508 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:28:56 ctl02 nova-api[508]: 2017-09-28 12:28:56.678 508 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:28:56 ctl02 nova-api[508]: 2017-09-28 12:28:56.810 508 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:28:56 ctl02 nova-api[508]: 2017-09-28 12:28:56.813 508 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:28:56 ctl02 nova-api[508]: 2017-09-28 12:28:56.813 508 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:28:56 ctl02 nova-api[508]: 2017-09-28 12:28:56.813 508 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:28:56 ctl02 nova-api[508]: 2017-09-28 12:28:56.816 508 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:28:56 ctl02 nova-api[508]: 2017-09-28 12:28:56.817 508 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:28:56 ctl02 nova-api[508]: 2017-09-28 12:28:56.817 508 ERROR nova Traceback (most recent call last):
Sep 28 12:28:56 ctl02 nova-api[508]: 2017-09-28 12:28:56.817 508 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:28:56 ctl02 nova-api[508]: 2017-09-28 12:28:56.817 508 ERROR nova     sys.exit(main())
Sep 28 12:28:56 ctl02 nova-api[508]: 2017-09-28 12:28:56.817 508 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:28:56 ctl02 nova-api[508]: 2017-09-28 12:28:56.817 508 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:28:56 ctl02 nova-api[508]: 2017-09-28 12:28:56.817 508 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:28:56 ctl02 nova-api[508]: 2017-09-28 12:28:56.817 508 ERROR nova     max_url_len=max_url_len)
Sep 28 12:28:56 ctl02 nova-api[508]: 2017-09-28 12:28:56.817 508 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:28:56 ctl02 nova-api[508]: 2017-09-28 12:28:56.817 508 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:28:56 ctl02 nova-api[508]: 2017-09-28 12:28:56.817 508 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:28:56 ctl02 nova-api[508]: 2017-09-28 12:28:56.817 508 ERROR nova     sock.listen(backlog)
Sep 28 12:28:56 ctl02 nova-api[508]: 2017-09-28 12:28:56.817 508 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:28:56 ctl02 nova-api[508]: 2017-09-28 12:28:56.817 508 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:28:56 ctl02 nova-api[508]: 2017-09-28 12:28:56.817 508 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:28:56 ctl02 nova-api[508]: 2017-09-28 12:28:56.817 508 ERROR nova
Sep 28 12:28:56 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:28:56 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:28:56 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:28:57 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:28:57 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:28:57 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:28:57 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:28:57 ctl02 heat-api-cfn[13300]: 2017-09-28 12:28:57.506 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:28:57] "OPTIONS / HTTP/1.0" 200 134 0.000495
Sep 28 12:28:57 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:28:57.751 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:28:57] "OPTIONS / HTTP/1.0" 200 134 0.000471
Sep 28 12:28:58 ctl02 nova-api[526]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:28:58 ctl02 nova-api[526]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:28:58 ctl02 heat-api[13008]: 2017-09-28 12:28:58.905 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:28:58] "OPTIONS / HTTP/1.0" 200 134 0.000605
Sep 28 12:28:59 ctl02 nova-api[526]: 2017-09-28 12:28:59.039 526 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:28:59 ctl02 nova-api[526]: 2017-09-28 12:28:59.041 526 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:28:59 ctl02 nova-api[526]: 2017-09-28 12:28:59.041 526 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:28:59 ctl02 nova-api[526]: 2017-09-28 12:28:59.041 526 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:28:59 ctl02 nova-api[526]: 2017-09-28 12:28:59.041 526 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:28:59 ctl02 nova-api[526]: 2017-09-28 12:28:59.041 526 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:28:59 ctl02 nova-api[526]: 2017-09-28 12:28:59.041 526 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:28:59 ctl02 nova-api[526]: 2017-09-28 12:28:59.041 526 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:28:59 ctl02 nova-api[526]: 2017-09-28 12:28:59.041 526 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:28:59 ctl02 nova-api[526]: 2017-09-28 12:28:59.041 526 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:28:59 ctl02 nova-api[526]: 2017-09-28 12:28:59.041 526 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:28:59 ctl02 nova-api[526]: 2017-09-28 12:28:59.041 526 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:28:59 ctl02 nova-api[526]: 2017-09-28 12:28:59.041 526 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:28:59 ctl02 nova-api[526]: 2017-09-28 12:28:59.041 526 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:28:59 ctl02 nova-api[526]: 2017-09-28 12:28:59.041 526 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:28:59 ctl02 nova-api[526]: 2017-09-28 12:28:59.041 526 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:28:59 ctl02 nova-api[526]: 2017-09-28 12:28:59.041 526 ERROR nova.wsgi     self.filename))
Sep 28 12:28:59 ctl02 nova-api[526]: 2017-09-28 12:28:59.041 526 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:28:59 ctl02 nova-api[526]: 2017-09-28 12:28:59.041 526 ERROR nova.wsgi
Sep 28 12:28:59 ctl02 nova-api[526]: 2017-09-28 12:28:59.043 526 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:28:59 ctl02 nova-api[526]: 2017-09-28 12:28:59.177 526 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:28:59 ctl02 neutron-server[30536]: 2017-09-28 12:28:59.413 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:28:59] "OPTIONS / HTTP/1.0" 200 262 0.000518
Sep 28 12:28:59 ctl02 nova-api[526]: 2017-09-28 12:28:59.427 526 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:28:59 ctl02 nova-api[526]: 2017-09-28 12:28:59.430 526 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:28:59 ctl02 nova-api[526]: 2017-09-28 12:28:59.431 526 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:28:59 ctl02 nova-api[526]: 2017-09-28 12:28:59.431 526 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:28:59 ctl02 nova-api[526]: 2017-09-28 12:28:59.564 526 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:28:59 ctl02 nova-api[526]: 2017-09-28 12:28:59.567 526 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:28:59 ctl02 nova-api[526]: 2017-09-28 12:28:59.568 526 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:28:59 ctl02 nova-api[526]: 2017-09-28 12:28:59.568 526 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:28:59 ctl02 nova-api[526]: 2017-09-28 12:28:59.571 526 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:28:59 ctl02 nova-api[526]: 2017-09-28 12:28:59.572 526 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:28:59 ctl02 nova-api[526]: 2017-09-28 12:28:59.572 526 ERROR nova Traceback (most recent call last):
Sep 28 12:28:59 ctl02 nova-api[526]: 2017-09-28 12:28:59.572 526 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:28:59 ctl02 nova-api[526]: 2017-09-28 12:28:59.572 526 ERROR nova     sys.exit(main())
Sep 28 12:28:59 ctl02 nova-api[526]: 2017-09-28 12:28:59.572 526 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:28:59 ctl02 nova-api[526]: 2017-09-28 12:28:59.572 526 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:28:59 ctl02 nova-api[526]: 2017-09-28 12:28:59.572 526 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:28:59 ctl02 nova-api[526]: 2017-09-28 12:28:59.572 526 ERROR nova     max_url_len=max_url_len)
Sep 28 12:28:59 ctl02 nova-api[526]: 2017-09-28 12:28:59.572 526 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:28:59 ctl02 nova-api[526]: 2017-09-28 12:28:59.572 526 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:28:59 ctl02 nova-api[526]: 2017-09-28 12:28:59.572 526 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:28:59 ctl02 nova-api[526]: 2017-09-28 12:28:59.572 526 ERROR nova     sock.listen(backlog)
Sep 28 12:28:59 ctl02 nova-api[526]: 2017-09-28 12:28:59.572 526 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:28:59 ctl02 nova-api[526]: 2017-09-28 12:28:59.572 526 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:28:59 ctl02 nova-api[526]: 2017-09-28 12:28:59.572 526 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:28:59 ctl02 nova-api[526]: 2017-09-28 12:28:59.572 526 ERROR nova
Sep 28 12:28:59 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:28:59 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:28:59 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:28:59 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:28:59 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:28:59 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:28:59 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:29:00 ctl02 heat-api-cfn[13300]: 2017-09-28 12:29:00.492 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:29:00] "OPTIONS / HTTP/1.0" 200 134 0.000555
Sep 28 12:29:00 ctl02 heat-api-cfn[13300]: 2017-09-28 12:29:00.925 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:29:00] "OPTIONS / HTTP/1.0" 200 134 0.000543
Sep 28 12:29:01 ctl02 neutron-server[30536]: 2017-09-28 12:29:01.124 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:29:01] "OPTIONS / HTTP/1.0" 200 262 0.000562
Sep 28 12:29:01 ctl02 glance-api[29183]: 2017-09-28 12:29:01.247 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:29:01] "OPTIONS / HTTP/1.0" 200 134 0.000635
Sep 28 12:29:01 ctl02 nova-api[543]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:29:01 ctl02 nova-api[543]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:29:01 ctl02 nova-api[543]: 2017-09-28 12:29:01.769 543 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:29:01 ctl02 nova-api[543]: 2017-09-28 12:29:01.770 543 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:29:01 ctl02 nova-api[543]: 2017-09-28 12:29:01.770 543 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:29:01 ctl02 nova-api[543]: 2017-09-28 12:29:01.770 543 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:29:01 ctl02 nova-api[543]: 2017-09-28 12:29:01.770 543 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:29:01 ctl02 nova-api[543]: 2017-09-28 12:29:01.770 543 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:29:01 ctl02 nova-api[543]: 2017-09-28 12:29:01.770 543 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:29:01 ctl02 nova-api[543]: 2017-09-28 12:29:01.770 543 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:29:01 ctl02 nova-api[543]: 2017-09-28 12:29:01.770 543 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:29:01 ctl02 nova-api[543]: 2017-09-28 12:29:01.770 543 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:29:01 ctl02 nova-api[543]: 2017-09-28 12:29:01.770 543 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:29:01 ctl02 nova-api[543]: 2017-09-28 12:29:01.770 543 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:29:01 ctl02 nova-api[543]: 2017-09-28 12:29:01.770 543 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:29:01 ctl02 nova-api[543]: 2017-09-28 12:29:01.770 543 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:29:01 ctl02 nova-api[543]: 2017-09-28 12:29:01.770 543 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:29:01 ctl02 nova-api[543]: 2017-09-28 12:29:01.770 543 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:29:01 ctl02 nova-api[543]: 2017-09-28 12:29:01.770 543 ERROR nova.wsgi     self.filename))
Sep 28 12:29:01 ctl02 nova-api[543]: 2017-09-28 12:29:01.770 543 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:29:01 ctl02 nova-api[543]: 2017-09-28 12:29:01.770 543 ERROR nova.wsgi
Sep 28 12:29:01 ctl02 nova-api[543]: 2017-09-28 12:29:01.771 543 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:29:01 ctl02 nova-api[543]: 2017-09-28 12:29:01.900 543 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:29:02 ctl02 nova-api[543]: 2017-09-28 12:29:02.121 543 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:29:02 ctl02 nova-api[543]: 2017-09-28 12:29:02.124 543 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:29:02 ctl02 nova-api[543]: 2017-09-28 12:29:02.124 543 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:29:02 ctl02 nova-api[543]: 2017-09-28 12:29:02.124 543 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:29:02 ctl02 neutron-server[30536]: 2017-09-28 12:29:02.208 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:29:02] "OPTIONS / HTTP/1.0" 200 262 0.000498
Sep 28 12:29:02 ctl02 nova-api[543]: 2017-09-28 12:29:02.266 543 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:29:02 ctl02 nova-api[543]: 2017-09-28 12:29:02.268 543 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:29:02 ctl02 nova-api[543]: 2017-09-28 12:29:02.269 543 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:29:02 ctl02 nova-api[543]: 2017-09-28 12:29:02.269 543 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:29:02 ctl02 nova-api[543]: 2017-09-28 12:29:02.273 543 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:29:02 ctl02 nova-api[543]: 2017-09-28 12:29:02.274 543 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:29:02 ctl02 nova-api[543]: 2017-09-28 12:29:02.274 543 ERROR nova Traceback (most recent call last):
Sep 28 12:29:02 ctl02 nova-api[543]: 2017-09-28 12:29:02.274 543 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:29:02 ctl02 nova-api[543]: 2017-09-28 12:29:02.274 543 ERROR nova     sys.exit(main())
Sep 28 12:29:02 ctl02 nova-api[543]: 2017-09-28 12:29:02.274 543 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:29:02 ctl02 nova-api[543]: 2017-09-28 12:29:02.274 543 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:29:02 ctl02 nova-api[543]: 2017-09-28 12:29:02.274 543 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:29:02 ctl02 nova-api[543]: 2017-09-28 12:29:02.274 543 ERROR nova     max_url_len=max_url_len)
Sep 28 12:29:02 ctl02 nova-api[543]: 2017-09-28 12:29:02.274 543 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:29:02 ctl02 nova-api[543]: 2017-09-28 12:29:02.274 543 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:29:02 ctl02 nova-api[543]: 2017-09-28 12:29:02.274 543 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:29:02 ctl02 nova-api[543]: 2017-09-28 12:29:02.274 543 ERROR nova     sock.listen(backlog)
Sep 28 12:29:02 ctl02 nova-api[543]: 2017-09-28 12:29:02.274 543 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:29:02 ctl02 nova-api[543]: 2017-09-28 12:29:02.274 543 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:29:02 ctl02 nova-api[543]: 2017-09-28 12:29:02.274 543 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:29:02 ctl02 nova-api[543]: 2017-09-28 12:29:02.274 543 ERROR nova
Sep 28 12:29:02 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:29:02 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:29:02 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:29:02 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:29:02 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:29:02 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:29:02 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:29:02 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3dd6d123)
Sep 28 12:29:03 ctl02 nova-consoleauth[5433]: 2017-09-28 12:29:03.545 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:29:03 ctl02 glance-api[29183]: 2017-09-28 12:29:03.664 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:29:03] "OPTIONS / HTTP/1.0" 200 134 0.000663
Sep 28 12:29:03 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3dd6d123)
Sep 28 12:29:04 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:29:04.200 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:29:04] "OPTIONS / HTTP/1.0" 200 134 0.000471
Sep 28 12:29:04 ctl02 nova-api[562]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:29:04 ctl02 nova-api[562]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:29:04 ctl02 glance-api[29183]: 2017-09-28 12:29:04.509 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:29:04] "OPTIONS / HTTP/1.0" 200 134 0.000676
Sep 28 12:29:04 ctl02 nova-api[562]: 2017-09-28 12:29:04.583 562 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:29:04 ctl02 nova-api[562]: 2017-09-28 12:29:04.584 562 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:29:04 ctl02 nova-api[562]: 2017-09-28 12:29:04.584 562 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:29:04 ctl02 nova-api[562]: 2017-09-28 12:29:04.584 562 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:29:04 ctl02 nova-api[562]: 2017-09-28 12:29:04.584 562 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:29:04 ctl02 nova-api[562]: 2017-09-28 12:29:04.584 562 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:29:04 ctl02 nova-api[562]: 2017-09-28 12:29:04.584 562 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:29:04 ctl02 nova-api[562]: 2017-09-28 12:29:04.584 562 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:29:04 ctl02 nova-api[562]: 2017-09-28 12:29:04.584 562 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:29:04 ctl02 nova-api[562]: 2017-09-28 12:29:04.584 562 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:29:04 ctl02 nova-api[562]: 2017-09-28 12:29:04.584 562 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:29:04 ctl02 nova-api[562]: 2017-09-28 12:29:04.584 562 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:29:04 ctl02 nova-api[562]: 2017-09-28 12:29:04.584 562 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:29:04 ctl02 nova-api[562]: 2017-09-28 12:29:04.584 562 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:29:04 ctl02 nova-api[562]: 2017-09-28 12:29:04.584 562 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:29:04 ctl02 nova-api[562]: 2017-09-28 12:29:04.584 562 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:29:04 ctl02 nova-api[562]: 2017-09-28 12:29:04.584 562 ERROR nova.wsgi     self.filename))
Sep 28 12:29:04 ctl02 nova-api[562]: 2017-09-28 12:29:04.584 562 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:29:04 ctl02 nova-api[562]: 2017-09-28 12:29:04.584 562 ERROR nova.wsgi
Sep 28 12:29:04 ctl02 nova-api[562]: 2017-09-28 12:29:04.585 562 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:29:04 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3dd6d123)
Sep 28 12:29:04 ctl02 nova-api[562]: 2017-09-28 12:29:04.725 562 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:29:04 ctl02 nova-api[562]: 2017-09-28 12:29:04.982 562 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:29:04 ctl02 nova-api[562]: 2017-09-28 12:29:04.985 562 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:29:04 ctl02 nova-api[562]: 2017-09-28 12:29:04.985 562 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:29:04 ctl02 nova-api[562]: 2017-09-28 12:29:04.985 562 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:29:05 ctl02 nova-api[562]: 2017-09-28 12:29:05.122 562 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:29:05 ctl02 nova-api[562]: 2017-09-28 12:29:05.124 562 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:29:05 ctl02 nova-api[562]: 2017-09-28 12:29:05.125 562 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:29:05 ctl02 nova-api[562]: 2017-09-28 12:29:05.125 562 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:29:05 ctl02 nova-api[562]: 2017-09-28 12:29:05.128 562 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:29:05 ctl02 nova-api[562]: 2017-09-28 12:29:05.129 562 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:29:05 ctl02 nova-api[562]: 2017-09-28 12:29:05.129 562 ERROR nova Traceback (most recent call last):
Sep 28 12:29:05 ctl02 nova-api[562]: 2017-09-28 12:29:05.129 562 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:29:05 ctl02 nova-api[562]: 2017-09-28 12:29:05.129 562 ERROR nova     sys.exit(main())
Sep 28 12:29:05 ctl02 nova-api[562]: 2017-09-28 12:29:05.129 562 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:29:05 ctl02 nova-api[562]: 2017-09-28 12:29:05.129 562 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:29:05 ctl02 nova-api[562]: 2017-09-28 12:29:05.129 562 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:29:05 ctl02 nova-api[562]: 2017-09-28 12:29:05.129 562 ERROR nova     max_url_len=max_url_len)
Sep 28 12:29:05 ctl02 nova-api[562]: 2017-09-28 12:29:05.129 562 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:29:05 ctl02 nova-api[562]: 2017-09-28 12:29:05.129 562 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:29:05 ctl02 nova-api[562]: 2017-09-28 12:29:05.129 562 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:29:05 ctl02 nova-api[562]: 2017-09-28 12:29:05.129 562 ERROR nova     sock.listen(backlog)
Sep 28 12:29:05 ctl02 nova-api[562]: 2017-09-28 12:29:05.129 562 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:29:05 ctl02 nova-api[562]: 2017-09-28 12:29:05.129 562 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:29:05 ctl02 nova-api[562]: 2017-09-28 12:29:05.129 562 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:29:05 ctl02 nova-api[562]: 2017-09-28 12:29:05.129 562 ERROR nova
Sep 28 12:29:05 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:29:05 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:29:05 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:29:05 ctl02 heat-api[13008]: 2017-09-28 12:29:05.434 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:29:05] "OPTIONS / HTTP/1.0" 200 134 0.000660
Sep 28 12:29:05 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:29:05 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:29:05 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:29:05 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:29:05 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3dd6d123)
Sep 28 12:29:05 ctl02 heat-engine[12803]: 2017-09-28 12:29:05.835 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:29:05 ctl02 heat-engine[12803]: 2017-09-28 12:29:05.843 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:29:05 ctl02 heat-engine[12803]: 2017-09-28 12:29:05.843 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:29:05 ctl02 heat-engine[12803]: 2017-09-28 12:29:05.846 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:29:06 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:29:06.234 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:29:06] "OPTIONS / HTTP/1.0" 200 134 0.000419
Sep 28 12:29:06 ctl02 neutron-server[30536]: 2017-09-28 12:29:06.434 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 5 dead agents out of 6:
Sep 28 12:29:06 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:29:06 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:28:08 cmp002
Sep 28 12:29:06 ctl02 neutron-server[30536]:       Metadata agent  2017-09-28 12:28:07 cmp002
Sep 28 12:29:06 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:23:57 cmp001
Sep 28 12:29:06 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:28:30 cmp002
Sep 28 12:29:06 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:28:06 cmp002
Sep 28 12:29:06 ctl02 nova-scheduler[5620]: 2017-09-28 12:29:06.576 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:29:06 ctl02 heat-api[13008]: 2017-09-28 12:29:06.597 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:29:06] "OPTIONS / HTTP/1.0" 200 134 0.000689
Sep 28 12:29:06 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3dd6d123)
Sep 28 12:29:07 ctl02 nova-api[580]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:29:07 ctl02 nova-api[580]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:29:07 ctl02 nova-api[580]: 2017-09-28 12:29:07.486 580 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:29:07 ctl02 nova-api[580]: 2017-09-28 12:29:07.487 580 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:29:07 ctl02 nova-api[580]: 2017-09-28 12:29:07.487 580 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:29:07 ctl02 nova-api[580]: 2017-09-28 12:29:07.487 580 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:29:07 ctl02 nova-api[580]: 2017-09-28 12:29:07.487 580 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:29:07 ctl02 nova-api[580]: 2017-09-28 12:29:07.487 580 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:29:07 ctl02 nova-api[580]: 2017-09-28 12:29:07.487 580 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:29:07 ctl02 nova-api[580]: 2017-09-28 12:29:07.487 580 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:29:07 ctl02 nova-api[580]: 2017-09-28 12:29:07.487 580 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:29:07 ctl02 nova-api[580]: 2017-09-28 12:29:07.487 580 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:29:07 ctl02 nova-api[580]: 2017-09-28 12:29:07.487 580 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:29:07 ctl02 nova-api[580]: 2017-09-28 12:29:07.487 580 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:29:07 ctl02 nova-api[580]: 2017-09-28 12:29:07.487 580 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:29:07 ctl02 nova-api[580]: 2017-09-28 12:29:07.487 580 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:29:07 ctl02 nova-api[580]: 2017-09-28 12:29:07.487 580 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:29:07 ctl02 nova-api[580]: 2017-09-28 12:29:07.487 580 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:29:07 ctl02 nova-api[580]: 2017-09-28 12:29:07.487 580 ERROR nova.wsgi     self.filename))
Sep 28 12:29:07 ctl02 nova-api[580]: 2017-09-28 12:29:07.487 580 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:29:07 ctl02 nova-api[580]: 2017-09-28 12:29:07.487 580 ERROR nova.wsgi
Sep 28 12:29:07 ctl02 nova-api[580]: 2017-09-28 12:29:07.488 580 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:29:07 ctl02 heat-api-cfn[13300]: 2017-09-28 12:29:07.532 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:29:07] "OPTIONS / HTTP/1.0" 200 134 0.000450
Sep 28 12:29:07 ctl02 nova-api[580]: 2017-09-28 12:29:07.615 580 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:29:07 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3dd6d123)
Sep 28 12:29:07 ctl02 nova-api[580]: 2017-09-28 12:29:07.843 580 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:29:07 ctl02 nova-api[580]: 2017-09-28 12:29:07.846 580 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:29:07 ctl02 nova-api[580]: 2017-09-28 12:29:07.847 580 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:29:07 ctl02 nova-api[580]: 2017-09-28 12:29:07.847 580 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:29:07 ctl02 nova-api[580]: 2017-09-28 12:29:07.977 580 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:29:07 ctl02 nova-api[580]: 2017-09-28 12:29:07.979 580 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:29:07 ctl02 nova-api[580]: 2017-09-28 12:29:07.979 580 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:29:07 ctl02 nova-api[580]: 2017-09-28 12:29:07.980 580 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:29:07 ctl02 nova-api[580]: 2017-09-28 12:29:07.983 580 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:29:07 ctl02 nova-api[580]: 2017-09-28 12:29:07.984 580 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:29:07 ctl02 nova-api[580]: 2017-09-28 12:29:07.984 580 ERROR nova Traceback (most recent call last):
Sep 28 12:29:07 ctl02 nova-api[580]: 2017-09-28 12:29:07.984 580 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:29:07 ctl02 nova-api[580]: 2017-09-28 12:29:07.984 580 ERROR nova     sys.exit(main())
Sep 28 12:29:07 ctl02 nova-api[580]: 2017-09-28 12:29:07.984 580 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:29:07 ctl02 nova-api[580]: 2017-09-28 12:29:07.984 580 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:29:07 ctl02 nova-api[580]: 2017-09-28 12:29:07.984 580 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:29:07 ctl02 nova-api[580]: 2017-09-28 12:29:07.984 580 ERROR nova     max_url_len=max_url_len)
Sep 28 12:29:07 ctl02 nova-api[580]: 2017-09-28 12:29:07.984 580 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:29:07 ctl02 nova-api[580]: 2017-09-28 12:29:07.984 580 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:29:07 ctl02 nova-api[580]: 2017-09-28 12:29:07.984 580 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:29:07 ctl02 nova-api[580]: 2017-09-28 12:29:07.984 580 ERROR nova     sock.listen(backlog)
Sep 28 12:29:07 ctl02 nova-api[580]: 2017-09-28 12:29:07.984 580 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:29:07 ctl02 nova-api[580]: 2017-09-28 12:29:07.984 580 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:29:07 ctl02 nova-api[580]: 2017-09-28 12:29:07.984 580 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:29:07 ctl02 nova-api[580]: 2017-09-28 12:29:07.984 580 ERROR nova
Sep 28 12:29:08 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:29:08.006 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:29:08] "OPTIONS / HTTP/1.0" 200 134 0.000559
Sep 28 12:29:08 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:29:08 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:29:08 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:29:08 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:29:08 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:29:08 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:29:08 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:29:08 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3dd6d123)
Sep 28 12:29:09 ctl02 neutron-server[30536]: 2017-09-28 12:29:09.181 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:29:09] "OPTIONS / HTTP/1.0" 200 262 0.000454
Sep 28 12:29:09 ctl02 heat-api[13008]: 2017-09-28 12:29:09.294 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:29:09] "OPTIONS / HTTP/1.0" 200 134 0.000499
Sep 28 12:29:09 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3dd6d123)
Sep 28 12:29:10 ctl02 nova-api[598]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:29:10 ctl02 nova-api[598]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:29:10 ctl02 nova-api[598]: 2017-09-28 12:29:10.260 598 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:29:10 ctl02 nova-api[598]: 2017-09-28 12:29:10.261 598 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:29:10 ctl02 nova-api[598]: 2017-09-28 12:29:10.261 598 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:29:10 ctl02 nova-api[598]: 2017-09-28 12:29:10.261 598 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:29:10 ctl02 nova-api[598]: 2017-09-28 12:29:10.261 598 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:29:10 ctl02 nova-api[598]: 2017-09-28 12:29:10.261 598 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:29:10 ctl02 nova-api[598]: 2017-09-28 12:29:10.261 598 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:29:10 ctl02 nova-api[598]: 2017-09-28 12:29:10.261 598 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:29:10 ctl02 nova-api[598]: 2017-09-28 12:29:10.261 598 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:29:10 ctl02 nova-api[598]: 2017-09-28 12:29:10.261 598 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:29:10 ctl02 nova-api[598]: 2017-09-28 12:29:10.261 598 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:29:10 ctl02 nova-api[598]: 2017-09-28 12:29:10.261 598 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:29:10 ctl02 nova-api[598]: 2017-09-28 12:29:10.261 598 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:29:10 ctl02 nova-api[598]: 2017-09-28 12:29:10.261 598 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:29:10 ctl02 nova-api[598]: 2017-09-28 12:29:10.261 598 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:29:10 ctl02 nova-api[598]: 2017-09-28 12:29:10.261 598 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:29:10 ctl02 nova-api[598]: 2017-09-28 12:29:10.261 598 ERROR nova.wsgi     self.filename))
Sep 28 12:29:10 ctl02 nova-api[598]: 2017-09-28 12:29:10.261 598 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:29:10 ctl02 nova-api[598]: 2017-09-28 12:29:10.261 598 ERROR nova.wsgi
Sep 28 12:29:10 ctl02 nova-api[598]: 2017-09-28 12:29:10.262 598 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:29:10 ctl02 nova-api[598]: 2017-09-28 12:29:10.390 598 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:29:10 ctl02 heat-api-cfn[13300]: 2017-09-28 12:29:10.542 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:29:10] "OPTIONS / HTTP/1.0" 200 134 0.000481
Sep 28 12:29:10 ctl02 nova-api[598]: 2017-09-28 12:29:10.615 598 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:29:10 ctl02 nova-api[598]: 2017-09-28 12:29:10.617 598 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:29:10 ctl02 nova-api[598]: 2017-09-28 12:29:10.617 598 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:29:10 ctl02 nova-api[598]: 2017-09-28 12:29:10.617 598 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:29:10 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3dd6d123)
Sep 28 12:29:10 ctl02 nova-api[598]: 2017-09-28 12:29:10.751 598 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:29:10 ctl02 nova-api[598]: 2017-09-28 12:29:10.753 598 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:29:10 ctl02 nova-api[598]: 2017-09-28 12:29:10.753 598 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:29:10 ctl02 nova-api[598]: 2017-09-28 12:29:10.753 598 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:29:10 ctl02 nova-api[598]: 2017-09-28 12:29:10.756 598 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:29:10 ctl02 nova-api[598]: 2017-09-28 12:29:10.757 598 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:29:10 ctl02 nova-api[598]: 2017-09-28 12:29:10.757 598 ERROR nova Traceback (most recent call last):
Sep 28 12:29:10 ctl02 nova-api[598]: 2017-09-28 12:29:10.757 598 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:29:10 ctl02 nova-api[598]: 2017-09-28 12:29:10.757 598 ERROR nova     sys.exit(main())
Sep 28 12:29:10 ctl02 nova-api[598]: 2017-09-28 12:29:10.757 598 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:29:10 ctl02 nova-api[598]: 2017-09-28 12:29:10.757 598 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:29:10 ctl02 nova-api[598]: 2017-09-28 12:29:10.757 598 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:29:10 ctl02 nova-api[598]: 2017-09-28 12:29:10.757 598 ERROR nova     max_url_len=max_url_len)
Sep 28 12:29:10 ctl02 nova-api[598]: 2017-09-28 12:29:10.757 598 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:29:10 ctl02 nova-api[598]: 2017-09-28 12:29:10.757 598 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:29:10 ctl02 nova-api[598]: 2017-09-28 12:29:10.757 598 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:29:10 ctl02 nova-api[598]: 2017-09-28 12:29:10.757 598 ERROR nova     sock.listen(backlog)
Sep 28 12:29:10 ctl02 nova-api[598]: 2017-09-28 12:29:10.757 598 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:29:10 ctl02 nova-api[598]: 2017-09-28 12:29:10.757 598 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:29:10 ctl02 nova-api[598]: 2017-09-28 12:29:10.757 598 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:29:10 ctl02 nova-api[598]: 2017-09-28 12:29:10.757 598 ERROR nova
Sep 28 12:29:10 ctl02 neutron-server[30536]: 2017-09-28 12:29:10.806 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:29:10] "OPTIONS / HTTP/1.0" 200 262 0.000464
Sep 28 12:29:10 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:29:10 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:29:10 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:29:10 ctl02 glance-api[29183]: 2017-09-28 12:29:10.905 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:29:10] "OPTIONS / HTTP/1.0" 200 134 0.000559
Sep 28 12:29:11 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:29:11 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:29:11 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:29:11 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:29:11 ctl02 heat-api-cfn[13300]: 2017-09-28 12:29:11.224 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:29:11] "OPTIONS / HTTP/1.0" 200 134 0.000527
Sep 28 12:29:11 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3dd6d123)
Sep 28 12:29:12 ctl02 neutron-server[30536]: 2017-09-28 12:29:12.287 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:29:12] "OPTIONS / HTTP/1.0" 200 262 0.000457
Sep 28 12:29:12 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3dd6d123)
Sep 28 12:29:12 ctl02 nova-api[616]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:29:12 ctl02 nova-api[616]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:29:12 ctl02 nova-api[616]: 2017-09-28 12:29:12.971 616 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:29:12 ctl02 nova-api[616]: 2017-09-28 12:29:12.973 616 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:29:12 ctl02 nova-api[616]: 2017-09-28 12:29:12.973 616 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:29:12 ctl02 nova-api[616]: 2017-09-28 12:29:12.973 616 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:29:12 ctl02 nova-api[616]: 2017-09-28 12:29:12.973 616 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:29:12 ctl02 nova-api[616]: 2017-09-28 12:29:12.973 616 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:29:12 ctl02 nova-api[616]: 2017-09-28 12:29:12.973 616 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:29:12 ctl02 nova-api[616]: 2017-09-28 12:29:12.973 616 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:29:12 ctl02 nova-api[616]: 2017-09-28 12:29:12.973 616 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:29:12 ctl02 nova-api[616]: 2017-09-28 12:29:12.973 616 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:29:12 ctl02 nova-api[616]: 2017-09-28 12:29:12.973 616 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:29:12 ctl02 nova-api[616]: 2017-09-28 12:29:12.973 616 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:29:12 ctl02 nova-api[616]: 2017-09-28 12:29:12.973 616 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:29:12 ctl02 nova-api[616]: 2017-09-28 12:29:12.973 616 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:29:12 ctl02 nova-api[616]: 2017-09-28 12:29:12.973 616 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:29:12 ctl02 nova-api[616]: 2017-09-28 12:29:12.973 616 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:29:12 ctl02 nova-api[616]: 2017-09-28 12:29:12.973 616 ERROR nova.wsgi     self.filename))
Sep 28 12:29:12 ctl02 nova-api[616]: 2017-09-28 12:29:12.973 616 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:29:12 ctl02 nova-api[616]: 2017-09-28 12:29:12.973 616 ERROR nova.wsgi
Sep 28 12:29:12 ctl02 nova-api[616]: 2017-09-28 12:29:12.974 616 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:29:13 ctl02 nova-api[616]: 2017-09-28 12:29:13.100 616 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:29:13 ctl02 nova-api[616]: 2017-09-28 12:29:13.322 616 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:29:13 ctl02 nova-api[616]: 2017-09-28 12:29:13.324 616 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:29:13 ctl02 nova-api[616]: 2017-09-28 12:29:13.324 616 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:29:13 ctl02 nova-api[616]: 2017-09-28 12:29:13.324 616 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:29:13 ctl02 glance-api[29183]: 2017-09-28 12:29:13.413 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:29:13] "OPTIONS / HTTP/1.0" 200 134 0.000590
Sep 28 12:29:13 ctl02 nova-api[616]: 2017-09-28 12:29:13.459 616 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:29:13 ctl02 nova-api[616]: 2017-09-28 12:29:13.461 616 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:29:13 ctl02 nova-api[616]: 2017-09-28 12:29:13.461 616 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:29:13 ctl02 nova-api[616]: 2017-09-28 12:29:13.461 616 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:29:13 ctl02 nova-api[616]: 2017-09-28 12:29:13.464 616 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:29:13 ctl02 nova-api[616]: 2017-09-28 12:29:13.465 616 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:29:13 ctl02 nova-api[616]: 2017-09-28 12:29:13.465 616 ERROR nova Traceback (most recent call last):
Sep 28 12:29:13 ctl02 nova-api[616]: 2017-09-28 12:29:13.465 616 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:29:13 ctl02 nova-api[616]: 2017-09-28 12:29:13.465 616 ERROR nova     sys.exit(main())
Sep 28 12:29:13 ctl02 nova-api[616]: 2017-09-28 12:29:13.465 616 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:29:13 ctl02 nova-api[616]: 2017-09-28 12:29:13.465 616 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:29:13 ctl02 nova-api[616]: 2017-09-28 12:29:13.465 616 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:29:13 ctl02 nova-api[616]: 2017-09-28 12:29:13.465 616 ERROR nova     max_url_len=max_url_len)
Sep 28 12:29:13 ctl02 nova-api[616]: 2017-09-28 12:29:13.465 616 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:29:13 ctl02 nova-api[616]: 2017-09-28 12:29:13.465 616 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:29:13 ctl02 nova-api[616]: 2017-09-28 12:29:13.465 616 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:29:13 ctl02 nova-api[616]: 2017-09-28 12:29:13.465 616 ERROR nova     sock.listen(backlog)
Sep 28 12:29:13 ctl02 nova-api[616]: 2017-09-28 12:29:13.465 616 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:29:13 ctl02 nova-api[616]: 2017-09-28 12:29:13.465 616 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:29:13 ctl02 nova-api[616]: 2017-09-28 12:29:13.465 616 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:29:13 ctl02 nova-api[616]: 2017-09-28 12:29:13.465 616 ERROR nova
Sep 28 12:29:13 ctl02 neutron-server[30536]: 2017-09-28 12:29:13.496 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:29:13 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:29:13 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:29:13 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:29:13 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:29:13 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:29:13 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:29:13 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:29:13 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:29:13 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:29:14 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:29:14.222 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:29:14] "OPTIONS / HTTP/1.0" 200 134 0.000715
Sep 28 12:29:14 ctl02 glance-api[29183]: 2017-09-28 12:29:14.663 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:29:14] "OPTIONS / HTTP/1.0" 200 134 0.000527
Sep 28 12:29:15 ctl02 heat-api[13008]: 2017-09-28 12:29:15.207 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:29:15] "OPTIONS / HTTP/1.0" 200 134 0.000760
Sep 28 12:29:15 ctl02 nova-api[641]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:29:15 ctl02 nova-api[641]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:29:15 ctl02 nova-api[641]: 2017-09-28 12:29:15.752 641 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:29:15 ctl02 nova-api[641]: 2017-09-28 12:29:15.753 641 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:29:15 ctl02 nova-api[641]: 2017-09-28 12:29:15.753 641 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:29:15 ctl02 nova-api[641]: 2017-09-28 12:29:15.753 641 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:29:15 ctl02 nova-api[641]: 2017-09-28 12:29:15.753 641 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:29:15 ctl02 nova-api[641]: 2017-09-28 12:29:15.753 641 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:29:15 ctl02 nova-api[641]: 2017-09-28 12:29:15.753 641 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:29:15 ctl02 nova-api[641]: 2017-09-28 12:29:15.753 641 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:29:15 ctl02 nova-api[641]: 2017-09-28 12:29:15.753 641 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:29:15 ctl02 nova-api[641]: 2017-09-28 12:29:15.753 641 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:29:15 ctl02 nova-api[641]: 2017-09-28 12:29:15.753 641 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:29:15 ctl02 nova-api[641]: 2017-09-28 12:29:15.753 641 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:29:15 ctl02 nova-api[641]: 2017-09-28 12:29:15.753 641 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:29:15 ctl02 nova-api[641]: 2017-09-28 12:29:15.753 641 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:29:15 ctl02 nova-api[641]: 2017-09-28 12:29:15.753 641 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:29:15 ctl02 nova-api[641]: 2017-09-28 12:29:15.753 641 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:29:15 ctl02 nova-api[641]: 2017-09-28 12:29:15.753 641 ERROR nova.wsgi     self.filename))
Sep 28 12:29:15 ctl02 nova-api[641]: 2017-09-28 12:29:15.753 641 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:29:15 ctl02 nova-api[641]: 2017-09-28 12:29:15.753 641 ERROR nova.wsgi
Sep 28 12:29:15 ctl02 nova-api[641]: 2017-09-28 12:29:15.755 641 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:29:15 ctl02 nova-api[641]: 2017-09-28 12:29:15.891 641 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:29:16 ctl02 nova-api[641]: 2017-09-28 12:29:16.147 641 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:29:16 ctl02 nova-api[641]: 2017-09-28 12:29:16.149 641 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:29:16 ctl02 nova-api[641]: 2017-09-28 12:29:16.149 641 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:29:16 ctl02 nova-api[641]: 2017-09-28 12:29:16.149 641 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:29:16 ctl02 nova-api[641]: 2017-09-28 12:29:16.282 641 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:29:16 ctl02 nova-api[641]: 2017-09-28 12:29:16.284 641 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:29:16 ctl02 nova-api[641]: 2017-09-28 12:29:16.285 641 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:29:16 ctl02 nova-api[641]: 2017-09-28 12:29:16.285 641 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:29:16 ctl02 nova-api[641]: 2017-09-28 12:29:16.288 641 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:29:16 ctl02 nova-api[641]: 2017-09-28 12:29:16.288 641 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:29:16 ctl02 nova-api[641]: 2017-09-28 12:29:16.288 641 ERROR nova Traceback (most recent call last):
Sep 28 12:29:16 ctl02 nova-api[641]: 2017-09-28 12:29:16.288 641 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:29:16 ctl02 nova-api[641]: 2017-09-28 12:29:16.288 641 ERROR nova     sys.exit(main())
Sep 28 12:29:16 ctl02 nova-api[641]: 2017-09-28 12:29:16.288 641 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:29:16 ctl02 nova-api[641]: 2017-09-28 12:29:16.288 641 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:29:16 ctl02 nova-api[641]: 2017-09-28 12:29:16.288 641 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:29:16 ctl02 nova-api[641]: 2017-09-28 12:29:16.288 641 ERROR nova     max_url_len=max_url_len)
Sep 28 12:29:16 ctl02 nova-api[641]: 2017-09-28 12:29:16.288 641 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:29:16 ctl02 nova-api[641]: 2017-09-28 12:29:16.288 641 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:29:16 ctl02 nova-api[641]: 2017-09-28 12:29:16.288 641 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:29:16 ctl02 nova-api[641]: 2017-09-28 12:29:16.288 641 ERROR nova     sock.listen(backlog)
Sep 28 12:29:16 ctl02 nova-api[641]: 2017-09-28 12:29:16.288 641 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:29:16 ctl02 nova-api[641]: 2017-09-28 12:29:16.288 641 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:29:16 ctl02 nova-api[641]: 2017-09-28 12:29:16.288 641 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:29:16 ctl02 nova-api[641]: 2017-09-28 12:29:16.288 641 ERROR nova
Sep 28 12:29:16 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:29:16 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:29:16 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:29:16 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:29:16.493 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:29:16] "OPTIONS / HTTP/1.0" 200 134 0.000468
Sep 28 12:29:16 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:29:16 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:29:16 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:29:16 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:29:16 ctl02 heat-api[13008]: 2017-09-28 12:29:16.920 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:29:16] "OPTIONS / HTTP/1.0" 200 134 0.000678
Sep 28 12:29:17 ctl02 heat-api-cfn[13300]: 2017-09-28 12:29:17.473 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:29:17] "OPTIONS / HTTP/1.0" 200 134 0.000538
Sep 28 12:29:17 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:29:17.629 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:29:17] "OPTIONS / HTTP/1.0" 200 134 0.000485
Sep 28 12:29:18 ctl02 nova-api[659]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:29:18 ctl02 nova-api[659]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:29:18 ctl02 nova-api[659]: 2017-09-28 12:29:18.542 659 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:29:18 ctl02 nova-api[659]: 2017-09-28 12:29:18.544 659 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:29:18 ctl02 nova-api[659]: 2017-09-28 12:29:18.544 659 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:29:18 ctl02 nova-api[659]: 2017-09-28 12:29:18.544 659 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:29:18 ctl02 nova-api[659]: 2017-09-28 12:29:18.544 659 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:29:18 ctl02 nova-api[659]: 2017-09-28 12:29:18.544 659 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:29:18 ctl02 nova-api[659]: 2017-09-28 12:29:18.544 659 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:29:18 ctl02 nova-api[659]: 2017-09-28 12:29:18.544 659 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:29:18 ctl02 nova-api[659]: 2017-09-28 12:29:18.544 659 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:29:18 ctl02 nova-api[659]: 2017-09-28 12:29:18.544 659 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:29:18 ctl02 nova-api[659]: 2017-09-28 12:29:18.544 659 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:29:18 ctl02 nova-api[659]: 2017-09-28 12:29:18.544 659 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:29:18 ctl02 nova-api[659]: 2017-09-28 12:29:18.544 659 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:29:18 ctl02 nova-api[659]: 2017-09-28 12:29:18.544 659 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:29:18 ctl02 nova-api[659]: 2017-09-28 12:29:18.544 659 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:29:18 ctl02 nova-api[659]: 2017-09-28 12:29:18.544 659 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:29:18 ctl02 nova-api[659]: 2017-09-28 12:29:18.544 659 ERROR nova.wsgi     self.filename))
Sep 28 12:29:18 ctl02 nova-api[659]: 2017-09-28 12:29:18.544 659 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:29:18 ctl02 nova-api[659]: 2017-09-28 12:29:18.544 659 ERROR nova.wsgi
Sep 28 12:29:18 ctl02 nova-api[659]: 2017-09-28 12:29:18.545 659 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:29:18 ctl02 nova-api[659]: 2017-09-28 12:29:18.681 659 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:29:18 ctl02 neutron-server[30536]: 2017-09-28 12:29:18.898 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:29:18] "OPTIONS / HTTP/1.0" 200 262 0.000585
Sep 28 12:29:18 ctl02 heat-api[13008]: 2017-09-28 12:29:18.900 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:29:18] "OPTIONS / HTTP/1.0" 200 134 0.000636
Sep 28 12:29:18 ctl02 nova-api[659]: 2017-09-28 12:29:18.938 659 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:29:18 ctl02 nova-api[659]: 2017-09-28 12:29:18.941 659 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:29:18 ctl02 nova-api[659]: 2017-09-28 12:29:18.941 659 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:29:18 ctl02 nova-api[659]: 2017-09-28 12:29:18.941 659 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:29:19 ctl02 nova-api[659]: 2017-09-28 12:29:19.073 659 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:29:19 ctl02 nova-api[659]: 2017-09-28 12:29:19.075 659 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:29:19 ctl02 nova-api[659]: 2017-09-28 12:29:19.075 659 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:29:19 ctl02 nova-api[659]: 2017-09-28 12:29:19.076 659 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:29:19 ctl02 nova-api[659]: 2017-09-28 12:29:19.079 659 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:29:19 ctl02 nova-api[659]: 2017-09-28 12:29:19.079 659 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:29:19 ctl02 nova-api[659]: 2017-09-28 12:29:19.079 659 ERROR nova Traceback (most recent call last):
Sep 28 12:29:19 ctl02 nova-api[659]: 2017-09-28 12:29:19.079 659 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:29:19 ctl02 nova-api[659]: 2017-09-28 12:29:19.079 659 ERROR nova     sys.exit(main())
Sep 28 12:29:19 ctl02 nova-api[659]: 2017-09-28 12:29:19.079 659 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:29:19 ctl02 nova-api[659]: 2017-09-28 12:29:19.079 659 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:29:19 ctl02 nova-api[659]: 2017-09-28 12:29:19.079 659 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:29:19 ctl02 nova-api[659]: 2017-09-28 12:29:19.079 659 ERROR nova     max_url_len=max_url_len)
Sep 28 12:29:19 ctl02 nova-api[659]: 2017-09-28 12:29:19.079 659 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:29:19 ctl02 nova-api[659]: 2017-09-28 12:29:19.079 659 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:29:19 ctl02 nova-api[659]: 2017-09-28 12:29:19.079 659 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:29:19 ctl02 nova-api[659]: 2017-09-28 12:29:19.079 659 ERROR nova     sock.listen(backlog)
Sep 28 12:29:19 ctl02 nova-api[659]: 2017-09-28 12:29:19.079 659 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:29:19 ctl02 nova-api[659]: 2017-09-28 12:29:19.079 659 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:29:19 ctl02 nova-api[659]: 2017-09-28 12:29:19.079 659 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:29:19 ctl02 nova-api[659]: 2017-09-28 12:29:19.079 659 ERROR nova
Sep 28 12:29:19 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:29:19 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:29:19 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:29:19 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:29:19 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:29:19 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:29:19 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:29:20 ctl02 heat-api-cfn[13300]: 2017-09-28 12:29:20.597 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:29:20] "OPTIONS / HTTP/1.0" 200 134 0.000544
Sep 28 12:29:20 ctl02 neutron-server[30536]: 2017-09-28 12:29:20.847 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:29:20] "OPTIONS / HTTP/1.0" 200 262 0.000545
Sep 28 12:29:20 ctl02 glance-api[29183]: 2017-09-28 12:29:20.907 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:29:20] "OPTIONS / HTTP/1.0" 200 134 0.000768
Sep 28 12:29:21 ctl02 heat-api-cfn[13300]: 2017-09-28 12:29:21.067 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:29:21] "OPTIONS / HTTP/1.0" 200 134 0.000510
Sep 28 12:29:21 ctl02 nova-api[677]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:29:21 ctl02 nova-api[677]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:29:21 ctl02 nova-api[677]: 2017-09-28 12:29:21.285 677 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:29:21 ctl02 nova-api[677]: 2017-09-28 12:29:21.287 677 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:29:21 ctl02 nova-api[677]: 2017-09-28 12:29:21.287 677 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:29:21 ctl02 nova-api[677]: 2017-09-28 12:29:21.287 677 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:29:21 ctl02 nova-api[677]: 2017-09-28 12:29:21.287 677 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:29:21 ctl02 nova-api[677]: 2017-09-28 12:29:21.287 677 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:29:21 ctl02 nova-api[677]: 2017-09-28 12:29:21.287 677 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:29:21 ctl02 nova-api[677]: 2017-09-28 12:29:21.287 677 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:29:21 ctl02 nova-api[677]: 2017-09-28 12:29:21.287 677 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:29:21 ctl02 nova-api[677]: 2017-09-28 12:29:21.287 677 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:29:21 ctl02 nova-api[677]: 2017-09-28 12:29:21.287 677 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:29:21 ctl02 nova-api[677]: 2017-09-28 12:29:21.287 677 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:29:21 ctl02 nova-api[677]: 2017-09-28 12:29:21.287 677 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:29:21 ctl02 nova-api[677]: 2017-09-28 12:29:21.287 677 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:29:21 ctl02 nova-api[677]: 2017-09-28 12:29:21.287 677 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:29:21 ctl02 nova-api[677]: 2017-09-28 12:29:21.287 677 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:29:21 ctl02 nova-api[677]: 2017-09-28 12:29:21.287 677 ERROR nova.wsgi     self.filename))
Sep 28 12:29:21 ctl02 nova-api[677]: 2017-09-28 12:29:21.287 677 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:29:21 ctl02 nova-api[677]: 2017-09-28 12:29:21.287 677 ERROR nova.wsgi
Sep 28 12:29:21 ctl02 nova-api[677]: 2017-09-28 12:29:21.289 677 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:29:21 ctl02 nova-api[677]: 2017-09-28 12:29:21.422 677 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:29:21 ctl02 neutron-server[30536]: 2017-09-28 12:29:21.430 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 5 dead agents out of 6:
Sep 28 12:29:21 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:29:21 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:28:08 cmp002
Sep 28 12:29:21 ctl02 neutron-server[30536]:       Metadata agent  2017-09-28 12:28:07 cmp002
Sep 28 12:29:21 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:23:57 cmp001
Sep 28 12:29:21 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:28:30 cmp002
Sep 28 12:29:21 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:28:06 cmp002
Sep 28 12:29:21 ctl02 nova-api[677]: 2017-09-28 12:29:21.671 677 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:29:21 ctl02 nova-api[677]: 2017-09-28 12:29:21.674 677 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:29:21 ctl02 nova-api[677]: 2017-09-28 12:29:21.678 677 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:29:21 ctl02 nova-api[677]: 2017-09-28 12:29:21.678 677 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:29:21 ctl02 nova-api[677]: 2017-09-28 12:29:21.812 677 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:29:21 ctl02 nova-api[677]: 2017-09-28 12:29:21.815 677 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:29:21 ctl02 nova-api[677]: 2017-09-28 12:29:21.815 677 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:29:21 ctl02 nova-api[677]: 2017-09-28 12:29:21.815 677 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:29:21 ctl02 nova-api[677]: 2017-09-28 12:29:21.819 677 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:29:21 ctl02 nova-api[677]: 2017-09-28 12:29:21.819 677 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:29:21 ctl02 nova-api[677]: 2017-09-28 12:29:21.819 677 ERROR nova Traceback (most recent call last):
Sep 28 12:29:21 ctl02 nova-api[677]: 2017-09-28 12:29:21.819 677 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:29:21 ctl02 nova-api[677]: 2017-09-28 12:29:21.819 677 ERROR nova     sys.exit(main())
Sep 28 12:29:21 ctl02 nova-api[677]: 2017-09-28 12:29:21.819 677 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:29:21 ctl02 nova-api[677]: 2017-09-28 12:29:21.819 677 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:29:21 ctl02 nova-api[677]: 2017-09-28 12:29:21.819 677 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:29:21 ctl02 nova-api[677]: 2017-09-28 12:29:21.819 677 ERROR nova     max_url_len=max_url_len)
Sep 28 12:29:21 ctl02 nova-api[677]: 2017-09-28 12:29:21.819 677 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:29:21 ctl02 nova-api[677]: 2017-09-28 12:29:21.819 677 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:29:21 ctl02 nova-api[677]: 2017-09-28 12:29:21.819 677 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:29:21 ctl02 nova-api[677]: 2017-09-28 12:29:21.819 677 ERROR nova     sock.listen(backlog)
Sep 28 12:29:21 ctl02 nova-api[677]: 2017-09-28 12:29:21.819 677 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:29:21 ctl02 nova-api[677]: 2017-09-28 12:29:21.819 677 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:29:21 ctl02 nova-api[677]: 2017-09-28 12:29:21.819 677 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:29:21 ctl02 nova-api[677]: 2017-09-28 12:29:21.819 677 ERROR nova
Sep 28 12:29:21 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:29:21 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:29:21 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:29:22 ctl02 neutron-server[30536]: 2017-09-28 12:29:22.082 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:29:22] "OPTIONS / HTTP/1.0" 200 262 0.000589
Sep 28 12:29:22 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:29:22 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:29:22 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:29:22 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:29:23 ctl02 glance-api[29183]: 2017-09-28 12:29:23.812 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:29:23] "OPTIONS / HTTP/1.0" 200 134 0.000594
Sep 28 12:29:23 ctl02 nova-api[695]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:29:23 ctl02 nova-api[695]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:29:24 ctl02 nova-api[695]: 2017-09-28 12:29:24.029 695 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:29:24 ctl02 nova-api[695]: 2017-09-28 12:29:24.030 695 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:29:24 ctl02 nova-api[695]: 2017-09-28 12:29:24.030 695 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:29:24 ctl02 nova-api[695]: 2017-09-28 12:29:24.030 695 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:29:24 ctl02 nova-api[695]: 2017-09-28 12:29:24.030 695 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:29:24 ctl02 nova-api[695]: 2017-09-28 12:29:24.030 695 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:29:24 ctl02 nova-api[695]: 2017-09-28 12:29:24.030 695 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:29:24 ctl02 nova-api[695]: 2017-09-28 12:29:24.030 695 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:29:24 ctl02 nova-api[695]: 2017-09-28 12:29:24.030 695 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:29:24 ctl02 nova-api[695]: 2017-09-28 12:29:24.030 695 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:29:24 ctl02 nova-api[695]: 2017-09-28 12:29:24.030 695 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:29:24 ctl02 nova-api[695]: 2017-09-28 12:29:24.030 695 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:29:24 ctl02 nova-api[695]: 2017-09-28 12:29:24.030 695 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:29:24 ctl02 nova-api[695]: 2017-09-28 12:29:24.030 695 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:29:24 ctl02 nova-api[695]: 2017-09-28 12:29:24.030 695 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:29:24 ctl02 nova-api[695]: 2017-09-28 12:29:24.030 695 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:29:24 ctl02 nova-api[695]: 2017-09-28 12:29:24.030 695 ERROR nova.wsgi     self.filename))
Sep 28 12:29:24 ctl02 nova-api[695]: 2017-09-28 12:29:24.030 695 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:29:24 ctl02 nova-api[695]: 2017-09-28 12:29:24.030 695 ERROR nova.wsgi
Sep 28 12:29:24 ctl02 nova-api[695]: 2017-09-28 12:29:24.031 695 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:29:24 ctl02 nova-api[695]: 2017-09-28 12:29:24.165 695 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:29:24 ctl02 glance-api[29183]: 2017-09-28 12:29:24.360 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:29:24] "OPTIONS / HTTP/1.0" 200 134 0.000870
Sep 28 12:29:24 ctl02 nova-api[695]: 2017-09-28 12:29:24.421 695 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:29:24 ctl02 nova-api[695]: 2017-09-28 12:29:24.423 695 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:29:24 ctl02 nova-api[695]: 2017-09-28 12:29:24.424 695 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:29:24 ctl02 nova-api[695]: 2017-09-28 12:29:24.424 695 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:29:24 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:29:24.444 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:29:24] "OPTIONS / HTTP/1.0" 200 134 0.000462
Sep 28 12:29:24 ctl02 nova-api[695]: 2017-09-28 12:29:24.555 695 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:29:24 ctl02 nova-api[695]: 2017-09-28 12:29:24.557 695 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:29:24 ctl02 nova-api[695]: 2017-09-28 12:29:24.557 695 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:29:24 ctl02 nova-api[695]: 2017-09-28 12:29:24.558 695 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:29:24 ctl02 nova-api[695]: 2017-09-28 12:29:24.561 695 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:29:24 ctl02 nova-api[695]: 2017-09-28 12:29:24.561 695 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:29:24 ctl02 nova-api[695]: 2017-09-28 12:29:24.561 695 ERROR nova Traceback (most recent call last):
Sep 28 12:29:24 ctl02 nova-api[695]: 2017-09-28 12:29:24.561 695 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:29:24 ctl02 nova-api[695]: 2017-09-28 12:29:24.561 695 ERROR nova     sys.exit(main())
Sep 28 12:29:24 ctl02 nova-api[695]: 2017-09-28 12:29:24.561 695 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:29:24 ctl02 nova-api[695]: 2017-09-28 12:29:24.561 695 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:29:24 ctl02 nova-api[695]: 2017-09-28 12:29:24.561 695 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:29:24 ctl02 nova-api[695]: 2017-09-28 12:29:24.561 695 ERROR nova     max_url_len=max_url_len)
Sep 28 12:29:24 ctl02 nova-api[695]: 2017-09-28 12:29:24.561 695 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:29:24 ctl02 nova-api[695]: 2017-09-28 12:29:24.561 695 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:29:24 ctl02 nova-api[695]: 2017-09-28 12:29:24.561 695 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:29:24 ctl02 nova-api[695]: 2017-09-28 12:29:24.561 695 ERROR nova     sock.listen(backlog)
Sep 28 12:29:24 ctl02 nova-api[695]: 2017-09-28 12:29:24.561 695 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:29:24 ctl02 nova-api[695]: 2017-09-28 12:29:24.561 695 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:29:24 ctl02 nova-api[695]: 2017-09-28 12:29:24.561 695 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:29:24 ctl02 nova-api[695]: 2017-09-28 12:29:24.561 695 ERROR nova
Sep 28 12:29:24 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:29:24 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:29:24 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:29:24 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:29:24 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:29:24 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:29:24 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:29:25 ctl02 heat-api[13008]: 2017-09-28 12:29:25.056 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:29:25] "OPTIONS / HTTP/1.0" 200 134 0.000665
Sep 28 12:29:25 ctl02 nova-cert[4860]: 2017-09-28 12:29:25.695 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:29:26 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:29:26.107 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:29:26] "OPTIONS / HTTP/1.0" 200 134 0.000596
Sep 28 12:29:26 ctl02 nova-api[713]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:29:26 ctl02 nova-api[713]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:29:26 ctl02 nova-conductor[5056]: 2017-09-28 12:29:26.725 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:29:26 ctl02 nova-conductor[5056]: 2017-09-28 12:29:26.735 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:29:26 ctl02 nova-conductor[5056]: 2017-09-28 12:29:26.752 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:29:26 ctl02 nova-conductor[5056]: 2017-09-28 12:29:26.761 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:29:26 ctl02 nova-api[713]: 2017-09-28 12:29:26.791 713 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:29:26 ctl02 nova-api[713]: 2017-09-28 12:29:26.792 713 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:29:26 ctl02 nova-api[713]: 2017-09-28 12:29:26.792 713 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:29:26 ctl02 nova-api[713]: 2017-09-28 12:29:26.792 713 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:29:26 ctl02 nova-api[713]: 2017-09-28 12:29:26.792 713 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:29:26 ctl02 nova-api[713]: 2017-09-28 12:29:26.792 713 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:29:26 ctl02 nova-api[713]: 2017-09-28 12:29:26.792 713 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:29:26 ctl02 nova-api[713]: 2017-09-28 12:29:26.792 713 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:29:26 ctl02 nova-api[713]: 2017-09-28 12:29:26.792 713 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:29:26 ctl02 nova-api[713]: 2017-09-28 12:29:26.792 713 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:29:26 ctl02 nova-api[713]: 2017-09-28 12:29:26.792 713 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:29:26 ctl02 nova-api[713]: 2017-09-28 12:29:26.792 713 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:29:26 ctl02 nova-api[713]: 2017-09-28 12:29:26.792 713 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:29:26 ctl02 nova-api[713]: 2017-09-28 12:29:26.792 713 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:29:26 ctl02 nova-api[713]: 2017-09-28 12:29:26.792 713 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:29:26 ctl02 nova-api[713]: 2017-09-28 12:29:26.792 713 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:29:26 ctl02 nova-api[713]: 2017-09-28 12:29:26.792 713 ERROR nova.wsgi     self.filename))
Sep 28 12:29:26 ctl02 nova-api[713]: 2017-09-28 12:29:26.792 713 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:29:26 ctl02 nova-api[713]: 2017-09-28 12:29:26.792 713 ERROR nova.wsgi
Sep 28 12:29:26 ctl02 nova-api[713]: 2017-09-28 12:29:26.794 713 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:29:26 ctl02 heat-api[13008]: 2017-09-28 12:29:26.855 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:29:26] "OPTIONS / HTTP/1.0" 200 134 0.000611
Sep 28 12:29:26 ctl02 nova-api[713]: 2017-09-28 12:29:26.932 713 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:29:27 ctl02 nova-api[713]: 2017-09-28 12:29:27.186 713 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:29:27 ctl02 nova-api[713]: 2017-09-28 12:29:27.188 713 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:29:27 ctl02 nova-api[713]: 2017-09-28 12:29:27.188 713 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:29:27 ctl02 nova-api[713]: 2017-09-28 12:29:27.189 713 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:29:27 ctl02 nova-api[713]: 2017-09-28 12:29:27.320 713 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:29:27 ctl02 nova-api[713]: 2017-09-28 12:29:27.322 713 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:29:27 ctl02 nova-api[713]: 2017-09-28 12:29:27.323 713 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:29:27 ctl02 nova-api[713]: 2017-09-28 12:29:27.323 713 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:29:27 ctl02 nova-api[713]: 2017-09-28 12:29:27.326 713 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:29:27 ctl02 nova-api[713]: 2017-09-28 12:29:27.326 713 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:29:27 ctl02 nova-api[713]: 2017-09-28 12:29:27.326 713 ERROR nova Traceback (most recent call last):
Sep 28 12:29:27 ctl02 nova-api[713]: 2017-09-28 12:29:27.326 713 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:29:27 ctl02 nova-api[713]: 2017-09-28 12:29:27.326 713 ERROR nova     sys.exit(main())
Sep 28 12:29:27 ctl02 nova-api[713]: 2017-09-28 12:29:27.326 713 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:29:27 ctl02 nova-api[713]: 2017-09-28 12:29:27.326 713 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:29:27 ctl02 nova-api[713]: 2017-09-28 12:29:27.326 713 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:29:27 ctl02 nova-api[713]: 2017-09-28 12:29:27.326 713 ERROR nova     max_url_len=max_url_len)
Sep 28 12:29:27 ctl02 nova-api[713]: 2017-09-28 12:29:27.326 713 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:29:27 ctl02 nova-api[713]: 2017-09-28 12:29:27.326 713 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:29:27 ctl02 nova-api[713]: 2017-09-28 12:29:27.326 713 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:29:27 ctl02 nova-api[713]: 2017-09-28 12:29:27.326 713 ERROR nova     sock.listen(backlog)
Sep 28 12:29:27 ctl02 nova-api[713]: 2017-09-28 12:29:27.326 713 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:29:27 ctl02 nova-api[713]: 2017-09-28 12:29:27.326 713 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:29:27 ctl02 nova-api[713]: 2017-09-28 12:29:27.326 713 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:29:27 ctl02 nova-api[713]: 2017-09-28 12:29:27.326 713 ERROR nova
Sep 28 12:29:27 ctl02 heat-api-cfn[13300]: 2017-09-28 12:29:27.441 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:29:27] "OPTIONS / HTTP/1.0" 200 134 0.000534
Sep 28 12:29:27 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:29:27 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:29:27 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:29:27 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:29:27 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:29:27 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:29:27 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:29:27 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:29:27.970 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:29:27] "OPTIONS / HTTP/1.0" 200 134 0.000415
Sep 28 12:29:28 ctl02 neutron-server[30536]: 2017-09-28 12:29:28.491 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:29:28 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x44b49a37)
Sep 28 12:29:28 ctl02 heat-api[13008]: 2017-09-28 12:29:28.756 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:29:28] "OPTIONS / HTTP/1.0" 200 134 0.000525
Sep 28 12:29:28 ctl02 neutron-server[30536]: 2017-09-28 12:29:28.829 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:29:28] "OPTIONS / HTTP/1.0" 200 262 0.000498
Sep 28 12:29:29 ctl02 nova-api[730]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:29:29 ctl02 nova-api[730]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:29:29 ctl02 nova-api[730]: 2017-09-28 12:29:29.493 730 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:29:29 ctl02 nova-api[730]: 2017-09-28 12:29:29.495 730 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:29:29 ctl02 nova-api[730]: 2017-09-28 12:29:29.495 730 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:29:29 ctl02 nova-api[730]: 2017-09-28 12:29:29.495 730 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:29:29 ctl02 nova-api[730]: 2017-09-28 12:29:29.495 730 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:29:29 ctl02 nova-api[730]: 2017-09-28 12:29:29.495 730 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:29:29 ctl02 nova-api[730]: 2017-09-28 12:29:29.495 730 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:29:29 ctl02 nova-api[730]: 2017-09-28 12:29:29.495 730 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:29:29 ctl02 nova-api[730]: 2017-09-28 12:29:29.495 730 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:29:29 ctl02 nova-api[730]: 2017-09-28 12:29:29.495 730 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:29:29 ctl02 nova-api[730]: 2017-09-28 12:29:29.495 730 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:29:29 ctl02 nova-api[730]: 2017-09-28 12:29:29.495 730 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:29:29 ctl02 nova-api[730]: 2017-09-28 12:29:29.495 730 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:29:29 ctl02 nova-api[730]: 2017-09-28 12:29:29.495 730 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:29:29 ctl02 nova-api[730]: 2017-09-28 12:29:29.495 730 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:29:29 ctl02 nova-api[730]: 2017-09-28 12:29:29.495 730 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:29:29 ctl02 nova-api[730]: 2017-09-28 12:29:29.495 730 ERROR nova.wsgi     self.filename))
Sep 28 12:29:29 ctl02 nova-api[730]: 2017-09-28 12:29:29.495 730 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:29:29 ctl02 nova-api[730]: 2017-09-28 12:29:29.495 730 ERROR nova.wsgi
Sep 28 12:29:29 ctl02 nova-api[730]: 2017-09-28 12:29:29.496 730 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:29:29 ctl02 nova-api[730]: 2017-09-28 12:29:29.625 730 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:29:29 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x44b49a37)
Sep 28 12:29:29 ctl02 nova-api[730]: 2017-09-28 12:29:29.850 730 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:29:29 ctl02 nova-api[730]: 2017-09-28 12:29:29.852 730 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:29:29 ctl02 nova-api[730]: 2017-09-28 12:29:29.853 730 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:29:29 ctl02 nova-api[730]: 2017-09-28 12:29:29.853 730 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:29:29 ctl02 nova-api[730]: 2017-09-28 12:29:29.987 730 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:29:29 ctl02 nova-api[730]: 2017-09-28 12:29:29.989 730 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:29:29 ctl02 nova-api[730]: 2017-09-28 12:29:29.990 730 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:29:29 ctl02 nova-api[730]: 2017-09-28 12:29:29.990 730 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:29:29 ctl02 nova-api[730]: 2017-09-28 12:29:29.993 730 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:29:29 ctl02 nova-api[730]: 2017-09-28 12:29:29.994 730 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:29:29 ctl02 nova-api[730]: 2017-09-28 12:29:29.994 730 ERROR nova Traceback (most recent call last):
Sep 28 12:29:29 ctl02 nova-api[730]: 2017-09-28 12:29:29.994 730 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:29:29 ctl02 nova-api[730]: 2017-09-28 12:29:29.994 730 ERROR nova     sys.exit(main())
Sep 28 12:29:29 ctl02 nova-api[730]: 2017-09-28 12:29:29.994 730 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:29:29 ctl02 nova-api[730]: 2017-09-28 12:29:29.994 730 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:29:29 ctl02 nova-api[730]: 2017-09-28 12:29:29.994 730 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:29:29 ctl02 nova-api[730]: 2017-09-28 12:29:29.994 730 ERROR nova     max_url_len=max_url_len)
Sep 28 12:29:29 ctl02 nova-api[730]: 2017-09-28 12:29:29.994 730 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:29:29 ctl02 nova-api[730]: 2017-09-28 12:29:29.994 730 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:29:29 ctl02 nova-api[730]: 2017-09-28 12:29:29.994 730 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:29:29 ctl02 nova-api[730]: 2017-09-28 12:29:29.994 730 ERROR nova     sock.listen(backlog)
Sep 28 12:29:29 ctl02 nova-api[730]: 2017-09-28 12:29:29.994 730 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:29:29 ctl02 nova-api[730]: 2017-09-28 12:29:29.994 730 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:29:29 ctl02 nova-api[730]: 2017-09-28 12:29:29.994 730 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:29:29 ctl02 nova-api[730]: 2017-09-28 12:29:29.994 730 ERROR nova
Sep 28 12:29:30 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:29:30 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:29:30 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:29:30 ctl02 neutron-server[30536]: 2017-09-28 12:29:30.190 30605 WARNING oslo_messaging._drivers.amqpdriver [req-d3524560-ff5b-4180-ad00-c4771aa9df4e - - - - -] reply_692b03e6d8d44d758b6be19b067c3aa3 doesn't exists, drop reply to 6094b3b21d314e07b6d72a5727b85189
Sep 28 12:29:30 ctl02 neutron-server[30536]: 2017-09-28 12:29:30.191 30605 INFO oslo_messaging._drivers.amqpdriver [req-d3524560-ff5b-4180-ad00-c4771aa9df4e - - - - -] The reply 6094b3b21d314e07b6d72a5727b85189 cannot be sent  reply_692b03e6d8d44d758b6be19b067c3aa3 reply queue don't exist after 60 sec abandoning...
Sep 28 12:29:30 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:29:30 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:29:30 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:29:30 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:29:30 ctl02 heat-api-cfn[13300]: 2017-09-28 12:29:30.591 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:29:30] "OPTIONS / HTTP/1.0" 200 134 0.000453
Sep 28 12:29:30 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x44b49a37)
Sep 28 12:29:30 ctl02 glance-api[29183]: 2017-09-28 12:29:30.670 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:29:30] "OPTIONS / HTTP/1.0" 200 134 0.000566
Sep 28 12:29:30 ctl02 neutron-server[30536]: 2017-09-28 12:29:30.733 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:29:30] "OPTIONS / HTTP/1.0" 200 262 0.000453
Sep 28 12:29:30 ctl02 heat-api-cfn[13300]: 2017-09-28 12:29:30.856 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:29:30] "OPTIONS / HTTP/1.0" 200 134 0.000470
Sep 28 12:29:31 ctl02 dhclient[600]: DHCPREQUEST of 192.168.11.25 on ens2 to 192.168.11.3 port 67 (xid=0x3415f07)
Sep 28 12:29:31 ctl02 dhclient[600]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 12:29:31 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 12:29:31 ctl02 ntp[819]:  * Stopping NTP server ntpd
Sep 28 12:29:31 ctl02 ntp[819]:    ...done.
Sep 28 12:29:31 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 12:29:31 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 12:29:31 ctl02 ntp[831]:  * Starting NTP server ntpd
Sep 28 12:29:31 ctl02 ntpd[838]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 12:29:31 ctl02 ntpd[838]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -c /var/lib/ntp/ntp.conf.dhcp -u 108:112
Sep 28 12:29:31 ctl02 ntp[831]:    ...done.
Sep 28 12:29:31 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 12:29:31 ctl02 ntpd[841]: proto: precision = 0.042 usec (-24)
Sep 28 12:29:31 ctl02 ntpd[841]: switching logging to file /var/log/ntp.log
Sep 28 12:29:31 ctl02 dhclient[600]: bound to 192.168.11.25 -- renewal in 278 seconds.
Sep 28 12:29:31 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x44b49a37)
Sep 28 12:29:32 ctl02 nova-api[754]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:29:32 ctl02 nova-api[754]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:29:32 ctl02 nova-api[754]: 2017-09-28 12:29:32.270 754 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:29:32 ctl02 nova-api[754]: 2017-09-28 12:29:32.272 754 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:29:32 ctl02 nova-api[754]: 2017-09-28 12:29:32.272 754 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:29:32 ctl02 nova-api[754]: 2017-09-28 12:29:32.272 754 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:29:32 ctl02 nova-api[754]: 2017-09-28 12:29:32.272 754 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:29:32 ctl02 nova-api[754]: 2017-09-28 12:29:32.272 754 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:29:32 ctl02 nova-api[754]: 2017-09-28 12:29:32.272 754 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:29:32 ctl02 nova-api[754]: 2017-09-28 12:29:32.272 754 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:29:32 ctl02 nova-api[754]: 2017-09-28 12:29:32.272 754 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:29:32 ctl02 nova-api[754]: 2017-09-28 12:29:32.272 754 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:29:32 ctl02 nova-api[754]: 2017-09-28 12:29:32.272 754 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:29:32 ctl02 nova-api[754]: 2017-09-28 12:29:32.272 754 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:29:32 ctl02 nova-api[754]: 2017-09-28 12:29:32.272 754 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:29:32 ctl02 nova-api[754]: 2017-09-28 12:29:32.272 754 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:29:32 ctl02 nova-api[754]: 2017-09-28 12:29:32.272 754 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:29:32 ctl02 nova-api[754]: 2017-09-28 12:29:32.272 754 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:29:32 ctl02 nova-api[754]: 2017-09-28 12:29:32.272 754 ERROR nova.wsgi     self.filename))
Sep 28 12:29:32 ctl02 nova-api[754]: 2017-09-28 12:29:32.272 754 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:29:32 ctl02 nova-api[754]: 2017-09-28 12:29:32.272 754 ERROR nova.wsgi
Sep 28 12:29:32 ctl02 nova-api[754]: 2017-09-28 12:29:32.273 754 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:29:32 ctl02 neutron-server[30536]: 2017-09-28 12:29:32.388 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:29:32] "OPTIONS / HTTP/1.0" 200 262 0.000458
Sep 28 12:29:32 ctl02 nova-api[754]: 2017-09-28 12:29:32.403 754 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:29:32 ctl02 nova-api[754]: 2017-09-28 12:29:32.627 754 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:29:32 ctl02 nova-api[754]: 2017-09-28 12:29:32.629 754 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:29:32 ctl02 nova-api[754]: 2017-09-28 12:29:32.629 754 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:29:32 ctl02 nova-api[754]: 2017-09-28 12:29:32.630 754 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:29:32 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x44b49a37)
Sep 28 12:29:32 ctl02 nova-api[754]: 2017-09-28 12:29:32.761 754 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:29:32 ctl02 nova-api[754]: 2017-09-28 12:29:32.763 754 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:29:32 ctl02 nova-api[754]: 2017-09-28 12:29:32.763 754 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:29:32 ctl02 nova-api[754]: 2017-09-28 12:29:32.763 754 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:29:32 ctl02 nova-api[754]: 2017-09-28 12:29:32.767 754 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:29:32 ctl02 nova-api[754]: 2017-09-28 12:29:32.767 754 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:29:32 ctl02 nova-api[754]: 2017-09-28 12:29:32.767 754 ERROR nova Traceback (most recent call last):
Sep 28 12:29:32 ctl02 nova-api[754]: 2017-09-28 12:29:32.767 754 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:29:32 ctl02 nova-api[754]: 2017-09-28 12:29:32.767 754 ERROR nova     sys.exit(main())
Sep 28 12:29:32 ctl02 nova-api[754]: 2017-09-28 12:29:32.767 754 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:29:32 ctl02 nova-api[754]: 2017-09-28 12:29:32.767 754 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:29:32 ctl02 nova-api[754]: 2017-09-28 12:29:32.767 754 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:29:32 ctl02 nova-api[754]: 2017-09-28 12:29:32.767 754 ERROR nova     max_url_len=max_url_len)
Sep 28 12:29:32 ctl02 nova-api[754]: 2017-09-28 12:29:32.767 754 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:29:32 ctl02 nova-api[754]: 2017-09-28 12:29:32.767 754 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:29:32 ctl02 nova-api[754]: 2017-09-28 12:29:32.767 754 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:29:32 ctl02 nova-api[754]: 2017-09-28 12:29:32.767 754 ERROR nova     sock.listen(backlog)
Sep 28 12:29:32 ctl02 nova-api[754]: 2017-09-28 12:29:32.767 754 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:29:32 ctl02 nova-api[754]: 2017-09-28 12:29:32.767 754 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:29:32 ctl02 nova-api[754]: 2017-09-28 12:29:32.767 754 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:29:32 ctl02 nova-api[754]: 2017-09-28 12:29:32.767 754 ERROR nova
Sep 28 12:29:32 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:29:32 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:29:32 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:29:33 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:29:33 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:29:33 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:29:33 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:29:33 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x44b49a37)
Sep 28 12:29:33 ctl02 glance-api[29183]: 2017-09-28 12:29:33.920 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:29:33] "OPTIONS / HTTP/1.0" 200 134 0.000554
Sep 28 12:29:34 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:29:34.089 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:29:34] "OPTIONS / HTTP/1.0" 200 134 0.000573
Sep 28 12:29:34 ctl02 glance-api[29183]: 2017-09-28 12:29:34.313 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:29:34] "OPTIONS / HTTP/1.0" 200 134 0.000562
Sep 28 12:29:34 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x44b49a37)
Sep 28 12:29:34 ctl02 nova-api[857]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:29:34 ctl02 nova-api[857]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:29:34 ctl02 nova-api[857]: 2017-09-28 12:29:34.987 857 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:29:34 ctl02 nova-api[857]: 2017-09-28 12:29:34.989 857 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:29:34 ctl02 nova-api[857]: 2017-09-28 12:29:34.989 857 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:29:34 ctl02 nova-api[857]: 2017-09-28 12:29:34.989 857 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:29:34 ctl02 nova-api[857]: 2017-09-28 12:29:34.989 857 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:29:34 ctl02 nova-api[857]: 2017-09-28 12:29:34.989 857 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:29:34 ctl02 nova-api[857]: 2017-09-28 12:29:34.989 857 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:29:34 ctl02 nova-api[857]: 2017-09-28 12:29:34.989 857 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:29:34 ctl02 nova-api[857]: 2017-09-28 12:29:34.989 857 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:29:34 ctl02 nova-api[857]: 2017-09-28 12:29:34.989 857 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:29:34 ctl02 nova-api[857]: 2017-09-28 12:29:34.989 857 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:29:34 ctl02 nova-api[857]: 2017-09-28 12:29:34.989 857 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:29:34 ctl02 nova-api[857]: 2017-09-28 12:29:34.989 857 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:29:34 ctl02 nova-api[857]: 2017-09-28 12:29:34.989 857 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:29:34 ctl02 nova-api[857]: 2017-09-28 12:29:34.989 857 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:29:34 ctl02 nova-api[857]: 2017-09-28 12:29:34.989 857 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:29:34 ctl02 nova-api[857]: 2017-09-28 12:29:34.989 857 ERROR nova.wsgi     self.filename))
Sep 28 12:29:34 ctl02 nova-api[857]: 2017-09-28 12:29:34.989 857 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:29:34 ctl02 nova-api[857]: 2017-09-28 12:29:34.989 857 ERROR nova.wsgi
Sep 28 12:29:34 ctl02 nova-api[857]: 2017-09-28 12:29:34.991 857 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:29:35 ctl02 nova-api[857]: 2017-09-28 12:29:35.118 857 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:29:35 ctl02 heat-api[13008]: 2017-09-28 12:29:35.235 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:29:35] "OPTIONS / HTTP/1.0" 200 134 0.000546
Sep 28 12:29:35 ctl02 nova-api[857]: 2017-09-28 12:29:35.342 857 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:29:35 ctl02 nova-api[857]: 2017-09-28 12:29:35.344 857 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:29:35 ctl02 nova-api[857]: 2017-09-28 12:29:35.344 857 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:29:35 ctl02 nova-api[857]: 2017-09-28 12:29:35.344 857 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:29:35 ctl02 nova-api[857]: 2017-09-28 12:29:35.476 857 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:29:35 ctl02 nova-api[857]: 2017-09-28 12:29:35.478 857 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:29:35 ctl02 nova-api[857]: 2017-09-28 12:29:35.479 857 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:29:35 ctl02 nova-api[857]: 2017-09-28 12:29:35.479 857 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:29:35 ctl02 nova-api[857]: 2017-09-28 12:29:35.482 857 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:29:35 ctl02 nova-api[857]: 2017-09-28 12:29:35.483 857 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:29:35 ctl02 nova-api[857]: 2017-09-28 12:29:35.483 857 ERROR nova Traceback (most recent call last):
Sep 28 12:29:35 ctl02 nova-api[857]: 2017-09-28 12:29:35.483 857 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:29:35 ctl02 nova-api[857]: 2017-09-28 12:29:35.483 857 ERROR nova     sys.exit(main())
Sep 28 12:29:35 ctl02 nova-api[857]: 2017-09-28 12:29:35.483 857 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:29:35 ctl02 nova-api[857]: 2017-09-28 12:29:35.483 857 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:29:35 ctl02 nova-api[857]: 2017-09-28 12:29:35.483 857 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:29:35 ctl02 nova-api[857]: 2017-09-28 12:29:35.483 857 ERROR nova     max_url_len=max_url_len)
Sep 28 12:29:35 ctl02 nova-api[857]: 2017-09-28 12:29:35.483 857 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:29:35 ctl02 nova-api[857]: 2017-09-28 12:29:35.483 857 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:29:35 ctl02 nova-api[857]: 2017-09-28 12:29:35.483 857 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:29:35 ctl02 nova-api[857]: 2017-09-28 12:29:35.483 857 ERROR nova     sock.listen(backlog)
Sep 28 12:29:35 ctl02 nova-api[857]: 2017-09-28 12:29:35.483 857 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:29:35 ctl02 nova-api[857]: 2017-09-28 12:29:35.483 857 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:29:35 ctl02 nova-api[857]: 2017-09-28 12:29:35.483 857 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:29:35 ctl02 nova-api[857]: 2017-09-28 12:29:35.483 857 ERROR nova
Sep 28 12:29:35 ctl02 nova-consoleauth[5433]: 2017-09-28 12:29:35.579 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:29:35 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:29:35 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:29:35 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:29:35 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x44b49a37)
Sep 28 12:29:35 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:29:35 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:29:35 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:29:35 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:29:36 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:29:36.204 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:29:36] "OPTIONS / HTTP/1.0" 200 134 0.000433
Sep 28 12:29:36 ctl02 neutron-server[30536]: 2017-09-28 12:29:36.426 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 5 dead agents out of 6:
Sep 28 12:29:36 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:29:36 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:28:08 cmp002
Sep 28 12:29:36 ctl02 neutron-server[30536]:       Metadata agent  2017-09-28 12:28:07 cmp002
Sep 28 12:29:36 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:23:57 cmp001
Sep 28 12:29:36 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:28:30 cmp002
Sep 28 12:29:36 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:28:06 cmp002
Sep 28 12:29:36 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x44b49a37)
Sep 28 12:29:36 ctl02 heat-api[13008]: 2017-09-28 12:29:36.703 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:29:36] "OPTIONS / HTTP/1.0" 200 134 0.000539
Sep 28 12:29:37 ctl02 nova-api[876]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:29:37 ctl02 nova-api[876]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:29:37 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x44b49a37)
Sep 28 12:29:37 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:29:37.762 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:29:37] "OPTIONS / HTTP/1.0" 200 134 0.000482
Sep 28 12:29:37 ctl02 nova-api[876]: 2017-09-28 12:29:37.768 876 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:29:37 ctl02 nova-api[876]: 2017-09-28 12:29:37.770 876 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:29:37 ctl02 nova-api[876]: 2017-09-28 12:29:37.770 876 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:29:37 ctl02 nova-api[876]: 2017-09-28 12:29:37.770 876 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:29:37 ctl02 nova-api[876]: 2017-09-28 12:29:37.770 876 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:29:37 ctl02 nova-api[876]: 2017-09-28 12:29:37.770 876 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:29:37 ctl02 nova-api[876]: 2017-09-28 12:29:37.770 876 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:29:37 ctl02 nova-api[876]: 2017-09-28 12:29:37.770 876 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:29:37 ctl02 nova-api[876]: 2017-09-28 12:29:37.770 876 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:29:37 ctl02 nova-api[876]: 2017-09-28 12:29:37.770 876 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:29:37 ctl02 nova-api[876]: 2017-09-28 12:29:37.770 876 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:29:37 ctl02 nova-api[876]: 2017-09-28 12:29:37.770 876 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:29:37 ctl02 nova-api[876]: 2017-09-28 12:29:37.770 876 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:29:37 ctl02 nova-api[876]: 2017-09-28 12:29:37.770 876 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:29:37 ctl02 nova-api[876]: 2017-09-28 12:29:37.770 876 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:29:37 ctl02 nova-api[876]: 2017-09-28 12:29:37.770 876 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:29:37 ctl02 nova-api[876]: 2017-09-28 12:29:37.770 876 ERROR nova.wsgi     self.filename))
Sep 28 12:29:37 ctl02 nova-api[876]: 2017-09-28 12:29:37.770 876 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:29:37 ctl02 nova-api[876]: 2017-09-28 12:29:37.770 876 ERROR nova.wsgi
Sep 28 12:29:37 ctl02 nova-api[876]: 2017-09-28 12:29:37.771 876 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:29:37 ctl02 heat-api-cfn[13300]: 2017-09-28 12:29:37.778 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:29:37] "OPTIONS / HTTP/1.0" 200 134 0.000511
Sep 28 12:29:37 ctl02 heat-engine[12803]: 2017-09-28 12:29:37.845 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:29:37 ctl02 heat-engine[12803]: 2017-09-28 12:29:37.852 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:29:37 ctl02 heat-engine[12803]: 2017-09-28 12:29:37.852 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:29:37 ctl02 heat-engine[12803]: 2017-09-28 12:29:37.855 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:29:37 ctl02 nova-api[876]: 2017-09-28 12:29:37.914 876 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:29:38 ctl02 nova-api[876]: 2017-09-28 12:29:38.149 876 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:29:38 ctl02 nova-api[876]: 2017-09-28 12:29:38.152 876 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:29:38 ctl02 nova-api[876]: 2017-09-28 12:29:38.152 876 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:29:38 ctl02 nova-api[876]: 2017-09-28 12:29:38.152 876 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:29:38 ctl02 nova-api[876]: 2017-09-28 12:29:38.286 876 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:29:38 ctl02 nova-api[876]: 2017-09-28 12:29:38.287 876 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:29:38 ctl02 nova-api[876]: 2017-09-28 12:29:38.288 876 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:29:38 ctl02 nova-api[876]: 2017-09-28 12:29:38.288 876 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:29:38 ctl02 nova-api[876]: 2017-09-28 12:29:38.291 876 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:29:38 ctl02 nova-api[876]: 2017-09-28 12:29:38.292 876 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:29:38 ctl02 nova-api[876]: 2017-09-28 12:29:38.292 876 ERROR nova Traceback (most recent call last):
Sep 28 12:29:38 ctl02 nova-api[876]: 2017-09-28 12:29:38.292 876 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:29:38 ctl02 nova-api[876]: 2017-09-28 12:29:38.292 876 ERROR nova     sys.exit(main())
Sep 28 12:29:38 ctl02 nova-api[876]: 2017-09-28 12:29:38.292 876 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:29:38 ctl02 nova-api[876]: 2017-09-28 12:29:38.292 876 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:29:38 ctl02 nova-api[876]: 2017-09-28 12:29:38.292 876 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:29:38 ctl02 nova-api[876]: 2017-09-28 12:29:38.292 876 ERROR nova     max_url_len=max_url_len)
Sep 28 12:29:38 ctl02 nova-api[876]: 2017-09-28 12:29:38.292 876 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:29:38 ctl02 nova-api[876]: 2017-09-28 12:29:38.292 876 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:29:38 ctl02 nova-api[876]: 2017-09-28 12:29:38.292 876 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:29:38 ctl02 nova-api[876]: 2017-09-28 12:29:38.292 876 ERROR nova     sock.listen(backlog)
Sep 28 12:29:38 ctl02 nova-api[876]: 2017-09-28 12:29:38.292 876 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:29:38 ctl02 nova-api[876]: 2017-09-28 12:29:38.292 876 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:29:38 ctl02 nova-api[876]: 2017-09-28 12:29:38.292 876 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:29:38 ctl02 nova-api[876]: 2017-09-28 12:29:38.292 876 ERROR nova
Sep 28 12:29:38 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:29:38 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:29:38 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:29:38 ctl02 nova-scheduler[5620]: 2017-09-28 12:29:38.612 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:29:38 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:29:38 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:29:38 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:29:38 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:29:38 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x44b49a37)
Sep 28 12:29:39 ctl02 heat-api[13008]: 2017-09-28 12:29:39.061 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:29:39] "OPTIONS / HTTP/1.0" 200 134 0.000577
Sep 28 12:29:39 ctl02 neutron-server[30536]: 2017-09-28 12:29:39.122 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:29:39] "OPTIONS / HTTP/1.0" 200 262 0.000470
Sep 28 12:29:39 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:29:39 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:29:39 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 12:29:39 ctl02 ntp[949]:  * Stopping NTP server ntpd
Sep 28 12:29:39 ctl02 ntp[949]:    ...done.
Sep 28 12:29:39 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 12:29:39 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 12:29:39 ctl02 ntp[960]:  * Starting NTP server ntpd
Sep 28 12:29:39 ctl02 ntpd[967]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 12:29:39 ctl02 ntpd[967]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 12:29:39 ctl02 ntp[960]:    ...done.
Sep 28 12:29:39 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 12:29:39 ctl02 ntpd[970]: proto: precision = 0.042 usec (-24)
Sep 28 12:29:39 ctl02 ntpd[970]: switching logging to file /var/log/ntp.log
Sep 28 12:29:40 ctl02 nova-api[894]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:29:40 ctl02 nova-api[894]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:29:40 ctl02 heat-api-cfn[13300]: 2017-09-28 12:29:40.451 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:29:40] "OPTIONS / HTTP/1.0" 200 134 0.000471
Sep 28 12:29:40 ctl02 nova-api[894]: 2017-09-28 12:29:40.504 894 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:29:40 ctl02 nova-api[894]: 2017-09-28 12:29:40.506 894 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:29:40 ctl02 nova-api[894]: 2017-09-28 12:29:40.506 894 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:29:40 ctl02 nova-api[894]: 2017-09-28 12:29:40.506 894 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:29:40 ctl02 nova-api[894]: 2017-09-28 12:29:40.506 894 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:29:40 ctl02 nova-api[894]: 2017-09-28 12:29:40.506 894 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:29:40 ctl02 nova-api[894]: 2017-09-28 12:29:40.506 894 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:29:40 ctl02 nova-api[894]: 2017-09-28 12:29:40.506 894 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:29:40 ctl02 nova-api[894]: 2017-09-28 12:29:40.506 894 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:29:40 ctl02 nova-api[894]: 2017-09-28 12:29:40.506 894 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:29:40 ctl02 nova-api[894]: 2017-09-28 12:29:40.506 894 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:29:40 ctl02 nova-api[894]: 2017-09-28 12:29:40.506 894 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:29:40 ctl02 nova-api[894]: 2017-09-28 12:29:40.506 894 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:29:40 ctl02 nova-api[894]: 2017-09-28 12:29:40.506 894 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:29:40 ctl02 nova-api[894]: 2017-09-28 12:29:40.506 894 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:29:40 ctl02 nova-api[894]: 2017-09-28 12:29:40.506 894 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:29:40 ctl02 nova-api[894]: 2017-09-28 12:29:40.506 894 ERROR nova.wsgi     self.filename))
Sep 28 12:29:40 ctl02 nova-api[894]: 2017-09-28 12:29:40.506 894 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:29:40 ctl02 nova-api[894]: 2017-09-28 12:29:40.506 894 ERROR nova.wsgi
Sep 28 12:29:40 ctl02 nova-api[894]: 2017-09-28 12:29:40.508 894 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:29:40 ctl02 heat-api-cfn[13300]: 2017-09-28 12:29:40.562 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:29:40] "OPTIONS / HTTP/1.0" 200 134 0.000449
Sep 28 12:29:40 ctl02 nova-api[894]: 2017-09-28 12:29:40.637 894 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:29:40 ctl02 nova-api[894]: 2017-09-28 12:29:40.854 894 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:29:40 ctl02 nova-api[894]: 2017-09-28 12:29:40.856 894 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:29:40 ctl02 nova-api[894]: 2017-09-28 12:29:40.856 894 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:29:40 ctl02 nova-api[894]: 2017-09-28 12:29:40.857 894 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:29:40 ctl02 glance-api[29183]: 2017-09-28 12:29:40.891 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:29:40] "OPTIONS / HTTP/1.0" 200 134 0.000571
Sep 28 12:29:40 ctl02 neutron-server[30536]: 2017-09-28 12:29:40.975 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:29:40] "OPTIONS / HTTP/1.0" 200 262 0.000453
Sep 28 12:29:40 ctl02 nova-api[894]: 2017-09-28 12:29:40.993 894 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:29:40 ctl02 nova-api[894]: 2017-09-28 12:29:40.994 894 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:29:40 ctl02 nova-api[894]: 2017-09-28 12:29:40.995 894 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:29:40 ctl02 nova-api[894]: 2017-09-28 12:29:40.995 894 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:29:40 ctl02 nova-api[894]: 2017-09-28 12:29:40.998 894 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:29:40 ctl02 nova-api[894]: 2017-09-28 12:29:40.999 894 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:29:40 ctl02 nova-api[894]: 2017-09-28 12:29:40.999 894 ERROR nova Traceback (most recent call last):
Sep 28 12:29:40 ctl02 nova-api[894]: 2017-09-28 12:29:40.999 894 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:29:41 ctl02 nova-api[894]: 2017-09-28 12:29:40.999 894 ERROR nova     sys.exit(main())
Sep 28 12:29:41 ctl02 nova-api[894]: 2017-09-28 12:29:40.999 894 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:29:41 ctl02 nova-api[894]: 2017-09-28 12:29:40.999 894 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:29:41 ctl02 nova-api[894]: 2017-09-28 12:29:40.999 894 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:29:41 ctl02 nova-api[894]: 2017-09-28 12:29:40.999 894 ERROR nova     max_url_len=max_url_len)
Sep 28 12:29:41 ctl02 nova-api[894]: 2017-09-28 12:29:40.999 894 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:29:41 ctl02 nova-api[894]: 2017-09-28 12:29:40.999 894 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:29:41 ctl02 nova-api[894]: 2017-09-28 12:29:40.999 894 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:29:41 ctl02 nova-api[894]: 2017-09-28 12:29:40.999 894 ERROR nova     sock.listen(backlog)
Sep 28 12:29:41 ctl02 nova-api[894]: 2017-09-28 12:29:40.999 894 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:29:41 ctl02 nova-api[894]: 2017-09-28 12:29:40.999 894 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:29:41 ctl02 nova-api[894]: 2017-09-28 12:29:40.999 894 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:29:41 ctl02 nova-api[894]: 2017-09-28 12:29:40.999 894 ERROR nova
Sep 28 12:29:41 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:29:41 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:29:41 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:29:41 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:29:41 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:29:41 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:29:41 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:29:42 ctl02 neutron-server[30536]: 2017-09-28 12:29:42.539 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:29:42] "OPTIONS / HTTP/1.0" 200 262 0.000474
Sep 28 12:29:43 ctl02 nova-api[983]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:29:43 ctl02 nova-api[983]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:29:43 ctl02 nova-api[983]: 2017-09-28 12:29:43.203 983 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:29:43 ctl02 nova-api[983]: 2017-09-28 12:29:43.204 983 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:29:43 ctl02 nova-api[983]: 2017-09-28 12:29:43.204 983 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:29:43 ctl02 nova-api[983]: 2017-09-28 12:29:43.204 983 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:29:43 ctl02 nova-api[983]: 2017-09-28 12:29:43.204 983 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:29:43 ctl02 nova-api[983]: 2017-09-28 12:29:43.204 983 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:29:43 ctl02 nova-api[983]: 2017-09-28 12:29:43.204 983 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:29:43 ctl02 nova-api[983]: 2017-09-28 12:29:43.204 983 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:29:43 ctl02 nova-api[983]: 2017-09-28 12:29:43.204 983 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:29:43 ctl02 nova-api[983]: 2017-09-28 12:29:43.204 983 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:29:43 ctl02 nova-api[983]: 2017-09-28 12:29:43.204 983 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:29:43 ctl02 nova-api[983]: 2017-09-28 12:29:43.204 983 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:29:43 ctl02 nova-api[983]: 2017-09-28 12:29:43.204 983 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:29:43 ctl02 nova-api[983]: 2017-09-28 12:29:43.204 983 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:29:43 ctl02 nova-api[983]: 2017-09-28 12:29:43.204 983 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:29:43 ctl02 nova-api[983]: 2017-09-28 12:29:43.204 983 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:29:43 ctl02 nova-api[983]: 2017-09-28 12:29:43.204 983 ERROR nova.wsgi     self.filename))
Sep 28 12:29:43 ctl02 nova-api[983]: 2017-09-28 12:29:43.204 983 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:29:43 ctl02 nova-api[983]: 2017-09-28 12:29:43.204 983 ERROR nova.wsgi
Sep 28 12:29:43 ctl02 nova-api[983]: 2017-09-28 12:29:43.205 983 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:29:43 ctl02 nova-api[983]: 2017-09-28 12:29:43.331 983 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:29:43 ctl02 neutron-server[30536]: 2017-09-28 12:29:43.488 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:29:43 ctl02 nova-api[983]: 2017-09-28 12:29:43.554 983 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:29:43 ctl02 nova-api[983]: 2017-09-28 12:29:43.556 983 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:29:43 ctl02 nova-api[983]: 2017-09-28 12:29:43.556 983 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:29:43 ctl02 nova-api[983]: 2017-09-28 12:29:43.557 983 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:29:43 ctl02 nova-api[983]: 2017-09-28 12:29:43.684 983 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:29:43 ctl02 nova-api[983]: 2017-09-28 12:29:43.686 983 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:29:43 ctl02 nova-api[983]: 2017-09-28 12:29:43.686 983 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:29:43 ctl02 nova-api[983]: 2017-09-28 12:29:43.686 983 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:29:43 ctl02 nova-api[983]: 2017-09-28 12:29:43.689 983 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:29:43 ctl02 nova-api[983]: 2017-09-28 12:29:43.689 983 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:29:43 ctl02 nova-api[983]: 2017-09-28 12:29:43.689 983 ERROR nova Traceback (most recent call last):
Sep 28 12:29:43 ctl02 nova-api[983]: 2017-09-28 12:29:43.689 983 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:29:43 ctl02 nova-api[983]: 2017-09-28 12:29:43.689 983 ERROR nova     sys.exit(main())
Sep 28 12:29:43 ctl02 nova-api[983]: 2017-09-28 12:29:43.689 983 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:29:43 ctl02 nova-api[983]: 2017-09-28 12:29:43.689 983 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:29:43 ctl02 nova-api[983]: 2017-09-28 12:29:43.689 983 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:29:43 ctl02 nova-api[983]: 2017-09-28 12:29:43.689 983 ERROR nova     max_url_len=max_url_len)
Sep 28 12:29:43 ctl02 nova-api[983]: 2017-09-28 12:29:43.689 983 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:29:43 ctl02 nova-api[983]: 2017-09-28 12:29:43.689 983 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:29:43 ctl02 nova-api[983]: 2017-09-28 12:29:43.689 983 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:29:43 ctl02 nova-api[983]: 2017-09-28 12:29:43.689 983 ERROR nova     sock.listen(backlog)
Sep 28 12:29:43 ctl02 nova-api[983]: 2017-09-28 12:29:43.689 983 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:29:43 ctl02 nova-api[983]: 2017-09-28 12:29:43.689 983 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:29:43 ctl02 nova-api[983]: 2017-09-28 12:29:43.689 983 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:29:43 ctl02 nova-api[983]: 2017-09-28 12:29:43.689 983 ERROR nova
Sep 28 12:29:43 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:29:43 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:29:43 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:29:44 ctl02 glance-api[29183]: 2017-09-28 12:29:44.023 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:29:44] "OPTIONS / HTTP/1.0" 200 134 0.000787
Sep 28 12:29:44 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:29:44 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:29:44 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:29:44 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:29:44 ctl02 glance-api[29183]: 2017-09-28 12:29:44.168 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:29:44] "OPTIONS / HTTP/1.0" 200 134 0.000777
Sep 28 12:29:44 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:29:44.442 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:29:44] "OPTIONS / HTTP/1.0" 200 134 0.000523
Sep 28 12:29:44 ctl02 heat-api[13008]: 2017-09-28 12:29:44.855 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:29:44] "OPTIONS / HTTP/1.0" 200 134 0.000653
Sep 28 12:29:45 ctl02 nova-api[1001]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:29:45 ctl02 nova-api[1001]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:29:45 ctl02 nova-api[1001]: 2017-09-28 12:29:45.976 1001 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:29:45 ctl02 nova-api[1001]: 2017-09-28 12:29:45.977 1001 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:29:45 ctl02 nova-api[1001]: 2017-09-28 12:29:45.977 1001 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:29:45 ctl02 nova-api[1001]: 2017-09-28 12:29:45.977 1001 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:29:45 ctl02 nova-api[1001]: 2017-09-28 12:29:45.977 1001 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:29:45 ctl02 nova-api[1001]: 2017-09-28 12:29:45.977 1001 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:29:45 ctl02 nova-api[1001]: 2017-09-28 12:29:45.977 1001 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:29:45 ctl02 nova-api[1001]: 2017-09-28 12:29:45.977 1001 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:29:45 ctl02 nova-api[1001]: 2017-09-28 12:29:45.977 1001 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:29:45 ctl02 nova-api[1001]: 2017-09-28 12:29:45.977 1001 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:29:45 ctl02 nova-api[1001]: 2017-09-28 12:29:45.977 1001 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:29:45 ctl02 nova-api[1001]: 2017-09-28 12:29:45.977 1001 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:29:45 ctl02 nova-api[1001]: 2017-09-28 12:29:45.977 1001 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:29:45 ctl02 nova-api[1001]: 2017-09-28 12:29:45.977 1001 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:29:45 ctl02 nova-api[1001]: 2017-09-28 12:29:45.977 1001 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:29:45 ctl02 nova-api[1001]: 2017-09-28 12:29:45.977 1001 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:29:45 ctl02 nova-api[1001]: 2017-09-28 12:29:45.977 1001 ERROR nova.wsgi     self.filename))
Sep 28 12:29:45 ctl02 nova-api[1001]: 2017-09-28 12:29:45.977 1001 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:29:45 ctl02 nova-api[1001]: 2017-09-28 12:29:45.977 1001 ERROR nova.wsgi
Sep 28 12:29:45 ctl02 nova-api[1001]: 2017-09-28 12:29:45.979 1001 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:29:46 ctl02 nova-api[1001]: 2017-09-28 12:29:46.107 1001 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:29:46 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:29:46.192 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:29:46] "OPTIONS / HTTP/1.0" 200 134 0.000510
Sep 28 12:29:46 ctl02 nova-api[1001]: 2017-09-28 12:29:46.354 1001 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:29:46 ctl02 nova-api[1001]: 2017-09-28 12:29:46.357 1001 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:29:46 ctl02 nova-api[1001]: 2017-09-28 12:29:46.357 1001 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:29:46 ctl02 nova-api[1001]: 2017-09-28 12:29:46.357 1001 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:29:46 ctl02 nova-api[1001]: 2017-09-28 12:29:46.491 1001 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:29:46 ctl02 nova-api[1001]: 2017-09-28 12:29:46.493 1001 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:29:46 ctl02 nova-api[1001]: 2017-09-28 12:29:46.493 1001 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:29:46 ctl02 nova-api[1001]: 2017-09-28 12:29:46.493 1001 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:29:46 ctl02 nova-api[1001]: 2017-09-28 12:29:46.497 1001 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:29:46 ctl02 nova-api[1001]: 2017-09-28 12:29:46.497 1001 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:29:46 ctl02 nova-api[1001]: 2017-09-28 12:29:46.497 1001 ERROR nova Traceback (most recent call last):
Sep 28 12:29:46 ctl02 nova-api[1001]: 2017-09-28 12:29:46.497 1001 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:29:46 ctl02 nova-api[1001]: 2017-09-28 12:29:46.497 1001 ERROR nova     sys.exit(main())
Sep 28 12:29:46 ctl02 nova-api[1001]: 2017-09-28 12:29:46.497 1001 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:29:46 ctl02 nova-api[1001]: 2017-09-28 12:29:46.497 1001 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:29:46 ctl02 nova-api[1001]: 2017-09-28 12:29:46.497 1001 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:29:46 ctl02 nova-api[1001]: 2017-09-28 12:29:46.497 1001 ERROR nova     max_url_len=max_url_len)
Sep 28 12:29:46 ctl02 nova-api[1001]: 2017-09-28 12:29:46.497 1001 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:29:46 ctl02 nova-api[1001]: 2017-09-28 12:29:46.497 1001 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:29:46 ctl02 nova-api[1001]: 2017-09-28 12:29:46.497 1001 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:29:46 ctl02 nova-api[1001]: 2017-09-28 12:29:46.497 1001 ERROR nova     sock.listen(backlog)
Sep 28 12:29:46 ctl02 nova-api[1001]: 2017-09-28 12:29:46.497 1001 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:29:46 ctl02 nova-api[1001]: 2017-09-28 12:29:46.497 1001 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:29:46 ctl02 nova-api[1001]: 2017-09-28 12:29:46.497 1001 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:29:46 ctl02 nova-api[1001]: 2017-09-28 12:29:46.497 1001 ERROR nova
Sep 28 12:29:46 ctl02 heat-api[13008]: 2017-09-28 12:29:46.605 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:29:46] "OPTIONS / HTTP/1.0" 200 134 0.000656
Sep 28 12:29:46 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:29:46 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:29:46 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:29:46 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:29:46 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:29:46 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:29:46 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:29:47 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:29:47.619 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:29:47] "OPTIONS / HTTP/1.0" 200 134 0.000521
Sep 28 12:29:47 ctl02 heat-api-cfn[13300]: 2017-09-28 12:29:47.779 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:29:47] "OPTIONS / HTTP/1.0" 200 134 0.000531
Sep 28 12:29:48 ctl02 nova-api[1019]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:29:48 ctl02 nova-api[1019]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:29:48 ctl02 heat-api[13008]: 2017-09-28 12:29:48.764 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:29:48] "OPTIONS / HTTP/1.0" 200 134 0.000622
Sep 28 12:29:48 ctl02 nova-api[1019]: 2017-09-28 12:29:48.794 1019 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:29:48 ctl02 nova-api[1019]: 2017-09-28 12:29:48.795 1019 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:29:48 ctl02 nova-api[1019]: 2017-09-28 12:29:48.795 1019 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:29:48 ctl02 nova-api[1019]: 2017-09-28 12:29:48.795 1019 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:29:48 ctl02 nova-api[1019]: 2017-09-28 12:29:48.795 1019 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:29:48 ctl02 nova-api[1019]: 2017-09-28 12:29:48.795 1019 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:29:48 ctl02 nova-api[1019]: 2017-09-28 12:29:48.795 1019 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:29:48 ctl02 nova-api[1019]: 2017-09-28 12:29:48.795 1019 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:29:48 ctl02 nova-api[1019]: 2017-09-28 12:29:48.795 1019 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:29:48 ctl02 nova-api[1019]: 2017-09-28 12:29:48.795 1019 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:29:48 ctl02 nova-api[1019]: 2017-09-28 12:29:48.795 1019 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:29:48 ctl02 nova-api[1019]: 2017-09-28 12:29:48.795 1019 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:29:48 ctl02 nova-api[1019]: 2017-09-28 12:29:48.795 1019 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:29:48 ctl02 nova-api[1019]: 2017-09-28 12:29:48.795 1019 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:29:48 ctl02 nova-api[1019]: 2017-09-28 12:29:48.795 1019 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:29:48 ctl02 nova-api[1019]: 2017-09-28 12:29:48.795 1019 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:29:48 ctl02 nova-api[1019]: 2017-09-28 12:29:48.795 1019 ERROR nova.wsgi     self.filename))
Sep 28 12:29:48 ctl02 nova-api[1019]: 2017-09-28 12:29:48.795 1019 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:29:48 ctl02 nova-api[1019]: 2017-09-28 12:29:48.795 1019 ERROR nova.wsgi
Sep 28 12:29:48 ctl02 nova-api[1019]: 2017-09-28 12:29:48.798 1019 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:29:48 ctl02 nova-api[1019]: 2017-09-28 12:29:48.931 1019 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:29:49 ctl02 nova-api[1019]: 2017-09-28 12:29:49.181 1019 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:29:49 ctl02 nova-api[1019]: 2017-09-28 12:29:49.183 1019 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:29:49 ctl02 nova-api[1019]: 2017-09-28 12:29:49.184 1019 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:29:49 ctl02 nova-api[1019]: 2017-09-28 12:29:49.184 1019 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:29:49 ctl02 nova-api[1019]: 2017-09-28 12:29:49.316 1019 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:29:49 ctl02 nova-api[1019]: 2017-09-28 12:29:49.319 1019 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:29:49 ctl02 nova-api[1019]: 2017-09-28 12:29:49.319 1019 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:29:49 ctl02 nova-api[1019]: 2017-09-28 12:29:49.320 1019 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:29:49 ctl02 neutron-server[30536]: 2017-09-28 12:29:49.323 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:29:49] "OPTIONS / HTTP/1.0" 200 262 0.000525
Sep 28 12:29:49 ctl02 nova-api[1019]: 2017-09-28 12:29:49.326 1019 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:29:49 ctl02 nova-api[1019]: 2017-09-28 12:29:49.327 1019 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:29:49 ctl02 nova-api[1019]: 2017-09-28 12:29:49.327 1019 ERROR nova Traceback (most recent call last):
Sep 28 12:29:49 ctl02 nova-api[1019]: 2017-09-28 12:29:49.327 1019 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:29:49 ctl02 nova-api[1019]: 2017-09-28 12:29:49.327 1019 ERROR nova     sys.exit(main())
Sep 28 12:29:49 ctl02 nova-api[1019]: 2017-09-28 12:29:49.327 1019 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:29:49 ctl02 nova-api[1019]: 2017-09-28 12:29:49.327 1019 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:29:49 ctl02 nova-api[1019]: 2017-09-28 12:29:49.327 1019 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:29:49 ctl02 nova-api[1019]: 2017-09-28 12:29:49.327 1019 ERROR nova     max_url_len=max_url_len)
Sep 28 12:29:49 ctl02 nova-api[1019]: 2017-09-28 12:29:49.327 1019 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:29:49 ctl02 nova-api[1019]: 2017-09-28 12:29:49.327 1019 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:29:49 ctl02 nova-api[1019]: 2017-09-28 12:29:49.327 1019 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:29:49 ctl02 nova-api[1019]: 2017-09-28 12:29:49.327 1019 ERROR nova     sock.listen(backlog)
Sep 28 12:29:49 ctl02 nova-api[1019]: 2017-09-28 12:29:49.327 1019 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:29:49 ctl02 nova-api[1019]: 2017-09-28 12:29:49.327 1019 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:29:49 ctl02 nova-api[1019]: 2017-09-28 12:29:49.327 1019 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:29:49 ctl02 nova-api[1019]: 2017-09-28 12:29:49.327 1019 ERROR nova
Sep 28 12:29:49 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:29:49 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:29:49 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:29:49 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:29:49 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:29:49 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:29:49 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:29:50 ctl02 heat-api-cfn[13300]: 2017-09-28 12:29:50.093 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:29:50] "OPTIONS / HTTP/1.0" 200 134 0.000453
Sep 28 12:29:50 ctl02 heat-api-cfn[13300]: 2017-09-28 12:29:50.209 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:29:50] "OPTIONS / HTTP/1.0" 200 134 0.000467
Sep 28 12:29:50 ctl02 neutron-server[30536]: 2017-09-28 12:29:50.780 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:29:50] "OPTIONS / HTTP/1.0" 200 262 0.000450
Sep 28 12:29:50 ctl02 glance-api[29183]: 2017-09-28 12:29:50.815 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:29:50] "OPTIONS / HTTP/1.0" 200 134 0.000656
Sep 28 12:29:51 ctl02 nova-api[1037]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:29:51 ctl02 nova-api[1037]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:29:51 ctl02 neutron-server[30536]: 2017-09-28 12:29:51.422 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 5 dead agents out of 6:
Sep 28 12:29:51 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:29:51 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:28:08 cmp002
Sep 28 12:29:51 ctl02 neutron-server[30536]:       Metadata agent  2017-09-28 12:28:07 cmp002
Sep 28 12:29:51 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:23:57 cmp001
Sep 28 12:29:51 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:28:30 cmp002
Sep 28 12:29:51 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:28:06 cmp002
Sep 28 12:29:51 ctl02 nova-api[1037]: 2017-09-28 12:29:51.479 1037 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:29:51 ctl02 nova-api[1037]: 2017-09-28 12:29:51.481 1037 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:29:51 ctl02 nova-api[1037]: 2017-09-28 12:29:51.481 1037 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:29:51 ctl02 nova-api[1037]: 2017-09-28 12:29:51.481 1037 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:29:51 ctl02 nova-api[1037]: 2017-09-28 12:29:51.481 1037 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:29:51 ctl02 nova-api[1037]: 2017-09-28 12:29:51.481 1037 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:29:51 ctl02 nova-api[1037]: 2017-09-28 12:29:51.481 1037 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:29:51 ctl02 nova-api[1037]: 2017-09-28 12:29:51.481 1037 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:29:51 ctl02 nova-api[1037]: 2017-09-28 12:29:51.481 1037 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:29:51 ctl02 nova-api[1037]: 2017-09-28 12:29:51.481 1037 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:29:51 ctl02 nova-api[1037]: 2017-09-28 12:29:51.481 1037 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:29:51 ctl02 nova-api[1037]: 2017-09-28 12:29:51.481 1037 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:29:51 ctl02 nova-api[1037]: 2017-09-28 12:29:51.481 1037 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:29:51 ctl02 nova-api[1037]: 2017-09-28 12:29:51.481 1037 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:29:51 ctl02 nova-api[1037]: 2017-09-28 12:29:51.481 1037 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:29:51 ctl02 nova-api[1037]: 2017-09-28 12:29:51.481 1037 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:29:51 ctl02 nova-api[1037]: 2017-09-28 12:29:51.481 1037 ERROR nova.wsgi     self.filename))
Sep 28 12:29:51 ctl02 nova-api[1037]: 2017-09-28 12:29:51.481 1037 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:29:51 ctl02 nova-api[1037]: 2017-09-28 12:29:51.481 1037 ERROR nova.wsgi
Sep 28 12:29:51 ctl02 nova-api[1037]: 2017-09-28 12:29:51.482 1037 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:29:51 ctl02 nova-api[1037]: 2017-09-28 12:29:51.607 1037 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:29:51 ctl02 nova-api[1037]: 2017-09-28 12:29:51.826 1037 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:29:51 ctl02 nova-api[1037]: 2017-09-28 12:29:51.829 1037 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:29:51 ctl02 nova-api[1037]: 2017-09-28 12:29:51.829 1037 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:29:51 ctl02 nova-api[1037]: 2017-09-28 12:29:51.829 1037 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:29:51 ctl02 nova-api[1037]: 2017-09-28 12:29:51.958 1037 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:29:51 ctl02 nova-api[1037]: 2017-09-28 12:29:51.960 1037 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:29:51 ctl02 nova-api[1037]: 2017-09-28 12:29:51.960 1037 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:29:51 ctl02 nova-api[1037]: 2017-09-28 12:29:51.961 1037 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:29:51 ctl02 nova-api[1037]: 2017-09-28 12:29:51.964 1037 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:29:51 ctl02 nova-api[1037]: 2017-09-28 12:29:51.964 1037 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:29:51 ctl02 nova-api[1037]: 2017-09-28 12:29:51.964 1037 ERROR nova Traceback (most recent call last):
Sep 28 12:29:51 ctl02 nova-api[1037]: 2017-09-28 12:29:51.964 1037 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:29:51 ctl02 nova-api[1037]: 2017-09-28 12:29:51.964 1037 ERROR nova     sys.exit(main())
Sep 28 12:29:51 ctl02 nova-api[1037]: 2017-09-28 12:29:51.964 1037 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:29:51 ctl02 nova-api[1037]: 2017-09-28 12:29:51.964 1037 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:29:51 ctl02 nova-api[1037]: 2017-09-28 12:29:51.964 1037 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:29:51 ctl02 nova-api[1037]: 2017-09-28 12:29:51.964 1037 ERROR nova     max_url_len=max_url_len)
Sep 28 12:29:51 ctl02 nova-api[1037]: 2017-09-28 12:29:51.964 1037 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:29:51 ctl02 nova-api[1037]: 2017-09-28 12:29:51.964 1037 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:29:51 ctl02 nova-api[1037]: 2017-09-28 12:29:51.964 1037 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:29:51 ctl02 nova-api[1037]: 2017-09-28 12:29:51.964 1037 ERROR nova     sock.listen(backlog)
Sep 28 12:29:51 ctl02 nova-api[1037]: 2017-09-28 12:29:51.964 1037 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:29:51 ctl02 nova-api[1037]: 2017-09-28 12:29:51.964 1037 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:29:51 ctl02 nova-api[1037]: 2017-09-28 12:29:51.964 1037 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:29:51 ctl02 nova-api[1037]: 2017-09-28 12:29:51.964 1037 ERROR nova
Sep 28 12:29:52 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:29:52 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:29:52 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:29:52 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:29:52 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:29:52 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:29:52 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:29:52 ctl02 neutron-server[30536]: 2017-09-28 12:29:52.625 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:29:52] "OPTIONS / HTTP/1.0" 200 262 0.000556
Sep 28 12:29:53 ctl02 glance-api[29183]: 2017-09-28 12:29:53.925 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:29:53] "OPTIONS / HTTP/1.0" 200 134 0.000650
Sep 28 12:29:54 ctl02 nova-api[1055]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:29:54 ctl02 nova-api[1055]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:29:54 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:29:54.164 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:29:54] "OPTIONS / HTTP/1.0" 200 134 0.000486
Sep 28 12:29:54 ctl02 glance-api[29183]: 2017-09-28 12:29:54.177 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:29:54] "OPTIONS / HTTP/1.0" 200 134 0.000647
Sep 28 12:29:54 ctl02 nova-api[1055]: 2017-09-28 12:29:54.294 1055 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:29:54 ctl02 nova-api[1055]: 2017-09-28 12:29:54.295 1055 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:29:54 ctl02 nova-api[1055]: 2017-09-28 12:29:54.295 1055 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:29:54 ctl02 nova-api[1055]: 2017-09-28 12:29:54.295 1055 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:29:54 ctl02 nova-api[1055]: 2017-09-28 12:29:54.295 1055 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:29:54 ctl02 nova-api[1055]: 2017-09-28 12:29:54.295 1055 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:29:54 ctl02 nova-api[1055]: 2017-09-28 12:29:54.295 1055 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:29:54 ctl02 nova-api[1055]: 2017-09-28 12:29:54.295 1055 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:29:54 ctl02 nova-api[1055]: 2017-09-28 12:29:54.295 1055 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:29:54 ctl02 nova-api[1055]: 2017-09-28 12:29:54.295 1055 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:29:54 ctl02 nova-api[1055]: 2017-09-28 12:29:54.295 1055 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:29:54 ctl02 nova-api[1055]: 2017-09-28 12:29:54.295 1055 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:29:54 ctl02 nova-api[1055]: 2017-09-28 12:29:54.295 1055 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:29:54 ctl02 nova-api[1055]: 2017-09-28 12:29:54.295 1055 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:29:54 ctl02 nova-api[1055]: 2017-09-28 12:29:54.295 1055 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:29:54 ctl02 nova-api[1055]: 2017-09-28 12:29:54.295 1055 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:29:54 ctl02 nova-api[1055]: 2017-09-28 12:29:54.295 1055 ERROR nova.wsgi     self.filename))
Sep 28 12:29:54 ctl02 nova-api[1055]: 2017-09-28 12:29:54.295 1055 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:29:54 ctl02 nova-api[1055]: 2017-09-28 12:29:54.295 1055 ERROR nova.wsgi
Sep 28 12:29:54 ctl02 nova-api[1055]: 2017-09-28 12:29:54.297 1055 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:29:54 ctl02 nova-api[1055]: 2017-09-28 12:29:54.438 1055 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:29:54 ctl02 nova-api[1055]: 2017-09-28 12:29:54.659 1055 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:29:54 ctl02 nova-api[1055]: 2017-09-28 12:29:54.661 1055 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:29:54 ctl02 nova-api[1055]: 2017-09-28 12:29:54.661 1055 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:29:54 ctl02 nova-api[1055]: 2017-09-28 12:29:54.661 1055 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:29:54 ctl02 nova-api[1055]: 2017-09-28 12:29:54.791 1055 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:29:54 ctl02 nova-api[1055]: 2017-09-28 12:29:54.792 1055 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:29:54 ctl02 nova-api[1055]: 2017-09-28 12:29:54.793 1055 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:29:54 ctl02 nova-api[1055]: 2017-09-28 12:29:54.793 1055 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:29:54 ctl02 nova-api[1055]: 2017-09-28 12:29:54.796 1055 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:29:54 ctl02 nova-api[1055]: 2017-09-28 12:29:54.796 1055 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:29:54 ctl02 nova-api[1055]: 2017-09-28 12:29:54.796 1055 ERROR nova Traceback (most recent call last):
Sep 28 12:29:54 ctl02 nova-api[1055]: 2017-09-28 12:29:54.796 1055 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:29:54 ctl02 nova-api[1055]: 2017-09-28 12:29:54.796 1055 ERROR nova     sys.exit(main())
Sep 28 12:29:54 ctl02 nova-api[1055]: 2017-09-28 12:29:54.796 1055 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:29:54 ctl02 nova-api[1055]: 2017-09-28 12:29:54.796 1055 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:29:54 ctl02 nova-api[1055]: 2017-09-28 12:29:54.796 1055 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:29:54 ctl02 nova-api[1055]: 2017-09-28 12:29:54.796 1055 ERROR nova     max_url_len=max_url_len)
Sep 28 12:29:54 ctl02 nova-api[1055]: 2017-09-28 12:29:54.796 1055 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:29:54 ctl02 nova-api[1055]: 2017-09-28 12:29:54.796 1055 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:29:54 ctl02 nova-api[1055]: 2017-09-28 12:29:54.796 1055 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:29:54 ctl02 nova-api[1055]: 2017-09-28 12:29:54.796 1055 ERROR nova     sock.listen(backlog)
Sep 28 12:29:54 ctl02 nova-api[1055]: 2017-09-28 12:29:54.796 1055 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:29:54 ctl02 nova-api[1055]: 2017-09-28 12:29:54.796 1055 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:29:54 ctl02 nova-api[1055]: 2017-09-28 12:29:54.796 1055 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:29:54 ctl02 nova-api[1055]: 2017-09-28 12:29:54.796 1055 ERROR nova
Sep 28 12:29:54 ctl02 heat-api[13008]: 2017-09-28 12:29:54.868 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:29:54] "OPTIONS / HTTP/1.0" 200 134 0.000729
Sep 28 12:29:54 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:29:54 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:29:54 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:29:55 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:29:55 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:29:55 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:29:55 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:29:56 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:29:56.468 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:29:56] "OPTIONS / HTTP/1.0" 200 134 0.000540
Sep 28 12:29:56 ctl02 heat-api[13008]: 2017-09-28 12:29:56.599 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:29:56] "OPTIONS / HTTP/1.0" 200 134 0.000650
Sep 28 12:29:56 ctl02 nova-api[1073]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:29:56 ctl02 nova-api[1073]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:29:57 ctl02 nova-api[1073]: 2017-09-28 12:29:57.010 1073 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:29:57 ctl02 nova-api[1073]: 2017-09-28 12:29:57.012 1073 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:29:57 ctl02 nova-api[1073]: 2017-09-28 12:29:57.012 1073 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:29:57 ctl02 nova-api[1073]: 2017-09-28 12:29:57.012 1073 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:29:57 ctl02 nova-api[1073]: 2017-09-28 12:29:57.012 1073 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:29:57 ctl02 nova-api[1073]: 2017-09-28 12:29:57.012 1073 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:29:57 ctl02 nova-api[1073]: 2017-09-28 12:29:57.012 1073 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:29:57 ctl02 nova-api[1073]: 2017-09-28 12:29:57.012 1073 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:29:57 ctl02 nova-api[1073]: 2017-09-28 12:29:57.012 1073 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:29:57 ctl02 nova-api[1073]: 2017-09-28 12:29:57.012 1073 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:29:57 ctl02 nova-api[1073]: 2017-09-28 12:29:57.012 1073 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:29:57 ctl02 nova-api[1073]: 2017-09-28 12:29:57.012 1073 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:29:57 ctl02 nova-api[1073]: 2017-09-28 12:29:57.012 1073 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:29:57 ctl02 nova-api[1073]: 2017-09-28 12:29:57.012 1073 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:29:57 ctl02 nova-api[1073]: 2017-09-28 12:29:57.012 1073 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:29:57 ctl02 nova-api[1073]: 2017-09-28 12:29:57.012 1073 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:29:57 ctl02 nova-api[1073]: 2017-09-28 12:29:57.012 1073 ERROR nova.wsgi     self.filename))
Sep 28 12:29:57 ctl02 nova-api[1073]: 2017-09-28 12:29:57.012 1073 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:29:57 ctl02 nova-api[1073]: 2017-09-28 12:29:57.012 1073 ERROR nova.wsgi
Sep 28 12:29:57 ctl02 nova-api[1073]: 2017-09-28 12:29:57.013 1073 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:29:57 ctl02 nova-api[1073]: 2017-09-28 12:29:57.145 1073 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:29:57 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:29:57.324 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:29:57] "OPTIONS / HTTP/1.0" 200 134 0.000539
Sep 28 12:29:57 ctl02 nova-api[1073]: 2017-09-28 12:29:57.389 1073 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:29:57 ctl02 nova-api[1073]: 2017-09-28 12:29:57.391 1073 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:29:57 ctl02 nova-api[1073]: 2017-09-28 12:29:57.392 1073 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:29:57 ctl02 nova-api[1073]: 2017-09-28 12:29:57.392 1073 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:29:57 ctl02 nova-api[1073]: 2017-09-28 12:29:57.524 1073 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:29:57 ctl02 nova-api[1073]: 2017-09-28 12:29:57.526 1073 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:29:57 ctl02 nova-api[1073]: 2017-09-28 12:29:57.526 1073 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:29:57 ctl02 nova-api[1073]: 2017-09-28 12:29:57.527 1073 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:29:57 ctl02 nova-api[1073]: 2017-09-28 12:29:57.530 1073 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:29:57 ctl02 nova-api[1073]: 2017-09-28 12:29:57.530 1073 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:29:57 ctl02 nova-api[1073]: 2017-09-28 12:29:57.530 1073 ERROR nova Traceback (most recent call last):
Sep 28 12:29:57 ctl02 nova-api[1073]: 2017-09-28 12:29:57.530 1073 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:29:57 ctl02 nova-api[1073]: 2017-09-28 12:29:57.530 1073 ERROR nova     sys.exit(main())
Sep 28 12:29:57 ctl02 nova-api[1073]: 2017-09-28 12:29:57.530 1073 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:29:57 ctl02 nova-api[1073]: 2017-09-28 12:29:57.530 1073 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:29:57 ctl02 nova-api[1073]: 2017-09-28 12:29:57.530 1073 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:29:57 ctl02 nova-api[1073]: 2017-09-28 12:29:57.530 1073 ERROR nova     max_url_len=max_url_len)
Sep 28 12:29:57 ctl02 nova-api[1073]: 2017-09-28 12:29:57.530 1073 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:29:57 ctl02 nova-api[1073]: 2017-09-28 12:29:57.530 1073 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:29:57 ctl02 nova-api[1073]: 2017-09-28 12:29:57.530 1073 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:29:57 ctl02 nova-api[1073]: 2017-09-28 12:29:57.530 1073 ERROR nova     sock.listen(backlog)
Sep 28 12:29:57 ctl02 nova-api[1073]: 2017-09-28 12:29:57.530 1073 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:29:57 ctl02 nova-api[1073]: 2017-09-28 12:29:57.530 1073 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:29:57 ctl02 nova-api[1073]: 2017-09-28 12:29:57.530 1073 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:29:57 ctl02 nova-api[1073]: 2017-09-28 12:29:57.530 1073 ERROR nova
Sep 28 12:29:57 ctl02 heat-api-cfn[13300]: 2017-09-28 12:29:57.688 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:29:57] "OPTIONS / HTTP/1.0" 200 134 0.000522
Sep 28 12:29:57 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:29:57 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:29:57 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:29:57 ctl02 nova-cert[4860]: 2017-09-28 12:29:57.733 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:29:57 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:29:57 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:29:57 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:29:57 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:29:58 ctl02 neutron-server[30536]: 2017-09-28 12:29:58.489 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:29:58 ctl02 nova-conductor[5056]: 2017-09-28 12:29:58.734 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:29:58 ctl02 nova-conductor[5056]: 2017-09-28 12:29:58.751 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:29:58 ctl02 nova-conductor[5056]: 2017-09-28 12:29:58.761 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:29:58 ctl02 nova-conductor[5056]: 2017-09-28 12:29:58.769 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:29:59 ctl02 heat-api[13008]: 2017-09-28 12:29:59.022 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:29:59] "OPTIONS / HTTP/1.0" 200 134 0.000631
Sep 28 12:29:59 ctl02 nova-api[1091]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:29:59 ctl02 nova-api[1091]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:29:59 ctl02 neutron-server[30536]: 2017-09-28 12:29:59.654 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:29:59] "OPTIONS / HTTP/1.0" 200 262 0.000502
Sep 28 12:29:59 ctl02 nova-api[1091]: 2017-09-28 12:29:59.788 1091 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:29:59 ctl02 nova-api[1091]: 2017-09-28 12:29:59.790 1091 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:29:59 ctl02 nova-api[1091]: 2017-09-28 12:29:59.790 1091 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:29:59 ctl02 nova-api[1091]: 2017-09-28 12:29:59.790 1091 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:29:59 ctl02 nova-api[1091]: 2017-09-28 12:29:59.790 1091 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:29:59 ctl02 nova-api[1091]: 2017-09-28 12:29:59.790 1091 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:29:59 ctl02 nova-api[1091]: 2017-09-28 12:29:59.790 1091 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:29:59 ctl02 nova-api[1091]: 2017-09-28 12:29:59.790 1091 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:29:59 ctl02 nova-api[1091]: 2017-09-28 12:29:59.790 1091 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:29:59 ctl02 nova-api[1091]: 2017-09-28 12:29:59.790 1091 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:29:59 ctl02 nova-api[1091]: 2017-09-28 12:29:59.790 1091 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:29:59 ctl02 nova-api[1091]: 2017-09-28 12:29:59.790 1091 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:29:59 ctl02 nova-api[1091]: 2017-09-28 12:29:59.790 1091 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:29:59 ctl02 nova-api[1091]: 2017-09-28 12:29:59.790 1091 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:29:59 ctl02 nova-api[1091]: 2017-09-28 12:29:59.790 1091 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:29:59 ctl02 nova-api[1091]: 2017-09-28 12:29:59.790 1091 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:29:59 ctl02 nova-api[1091]: 2017-09-28 12:29:59.790 1091 ERROR nova.wsgi     self.filename))
Sep 28 12:29:59 ctl02 nova-api[1091]: 2017-09-28 12:29:59.790 1091 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:29:59 ctl02 nova-api[1091]: 2017-09-28 12:29:59.790 1091 ERROR nova.wsgi
Sep 28 12:29:59 ctl02 nova-api[1091]: 2017-09-28 12:29:59.792 1091 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:29:59 ctl02 heat-api-cfn[13300]: 2017-09-28 12:29:59.875 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:29:59] "OPTIONS / HTTP/1.0" 200 134 0.000539
Sep 28 12:29:59 ctl02 nova-api[1091]: 2017-09-28 12:29:59.930 1091 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:30:00 ctl02 heat-api-cfn[13300]: 2017-09-28 12:30:00.088 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:30:00] "OPTIONS / HTTP/1.0" 200 134 0.000491
Sep 28 12:30:00 ctl02 nova-api[1091]: 2017-09-28 12:30:00.183 1091 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:30:00 ctl02 nova-api[1091]: 2017-09-28 12:30:00.186 1091 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:30:00 ctl02 nova-api[1091]: 2017-09-28 12:30:00.186 1091 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:30:00 ctl02 nova-api[1091]: 2017-09-28 12:30:00.187 1091 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:30:00 ctl02 nova-api[1091]: 2017-09-28 12:30:00.321 1091 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:30:00 ctl02 nova-api[1091]: 2017-09-28 12:30:00.324 1091 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:30:00 ctl02 nova-api[1091]: 2017-09-28 12:30:00.325 1091 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:30:00 ctl02 nova-api[1091]: 2017-09-28 12:30:00.325 1091 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:30:00 ctl02 nova-api[1091]: 2017-09-28 12:30:00.329 1091 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:30:00 ctl02 nova-api[1091]: 2017-09-28 12:30:00.329 1091 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:30:00 ctl02 nova-api[1091]: 2017-09-28 12:30:00.329 1091 ERROR nova Traceback (most recent call last):
Sep 28 12:30:00 ctl02 nova-api[1091]: 2017-09-28 12:30:00.329 1091 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:30:00 ctl02 nova-api[1091]: 2017-09-28 12:30:00.329 1091 ERROR nova     sys.exit(main())
Sep 28 12:30:00 ctl02 nova-api[1091]: 2017-09-28 12:30:00.329 1091 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:30:00 ctl02 nova-api[1091]: 2017-09-28 12:30:00.329 1091 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:30:00 ctl02 nova-api[1091]: 2017-09-28 12:30:00.329 1091 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:30:00 ctl02 nova-api[1091]: 2017-09-28 12:30:00.329 1091 ERROR nova     max_url_len=max_url_len)
Sep 28 12:30:00 ctl02 nova-api[1091]: 2017-09-28 12:30:00.329 1091 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:30:00 ctl02 nova-api[1091]: 2017-09-28 12:30:00.329 1091 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:30:00 ctl02 nova-api[1091]: 2017-09-28 12:30:00.329 1091 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:30:00 ctl02 nova-api[1091]: 2017-09-28 12:30:00.329 1091 ERROR nova     sock.listen(backlog)
Sep 28 12:30:00 ctl02 nova-api[1091]: 2017-09-28 12:30:00.329 1091 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:30:00 ctl02 nova-api[1091]: 2017-09-28 12:30:00.329 1091 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:30:00 ctl02 nova-api[1091]: 2017-09-28 12:30:00.329 1091 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:30:00 ctl02 nova-api[1091]: 2017-09-28 12:30:00.329 1091 ERROR nova
Sep 28 12:30:00 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:30:00 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:30:00 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:30:00 ctl02 glance-api[29183]: 2017-09-28 12:30:00.614 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:30:00] "OPTIONS / HTTP/1.0" 200 134 0.000715
Sep 28 12:30:00 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:30:00 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:30:00 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:30:00 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:30:00 ctl02 neutron-server[30536]: 2017-09-28 12:30:00.947 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:30:00] "OPTIONS / HTTP/1.0" 200 262 0.000522
Sep 28 12:30:01 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb47eac6b)
Sep 28 12:30:02 ctl02 nova-api[1109]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:30:02 ctl02 nova-api[1109]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:30:02 ctl02 nova-api[1109]: 2017-09-28 12:30:02.507 1109 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:30:02 ctl02 nova-api[1109]: 2017-09-28 12:30:02.508 1109 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:30:02 ctl02 nova-api[1109]: 2017-09-28 12:30:02.508 1109 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:30:02 ctl02 nova-api[1109]: 2017-09-28 12:30:02.508 1109 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:30:02 ctl02 nova-api[1109]: 2017-09-28 12:30:02.508 1109 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:30:02 ctl02 nova-api[1109]: 2017-09-28 12:30:02.508 1109 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:30:02 ctl02 nova-api[1109]: 2017-09-28 12:30:02.508 1109 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:30:02 ctl02 nova-api[1109]: 2017-09-28 12:30:02.508 1109 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:30:02 ctl02 nova-api[1109]: 2017-09-28 12:30:02.508 1109 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:30:02 ctl02 nova-api[1109]: 2017-09-28 12:30:02.508 1109 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:30:02 ctl02 nova-api[1109]: 2017-09-28 12:30:02.508 1109 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:30:02 ctl02 nova-api[1109]: 2017-09-28 12:30:02.508 1109 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:30:02 ctl02 nova-api[1109]: 2017-09-28 12:30:02.508 1109 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:30:02 ctl02 nova-api[1109]: 2017-09-28 12:30:02.508 1109 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:30:02 ctl02 nova-api[1109]: 2017-09-28 12:30:02.508 1109 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:30:02 ctl02 nova-api[1109]: 2017-09-28 12:30:02.508 1109 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:30:02 ctl02 nova-api[1109]: 2017-09-28 12:30:02.508 1109 ERROR nova.wsgi     self.filename))
Sep 28 12:30:02 ctl02 nova-api[1109]: 2017-09-28 12:30:02.508 1109 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:30:02 ctl02 nova-api[1109]: 2017-09-28 12:30:02.508 1109 ERROR nova.wsgi
Sep 28 12:30:02 ctl02 nova-api[1109]: 2017-09-28 12:30:02.511 1109 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:30:02 ctl02 neutron-server[30536]: 2017-09-28 12:30:02.641 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:30:02] "OPTIONS / HTTP/1.0" 200 262 0.000533
Sep 28 12:30:02 ctl02 nova-api[1109]: 2017-09-28 12:30:02.644 1109 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:30:02 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb47eac6b)
Sep 28 12:30:02 ctl02 nova-api[1109]: 2017-09-28 12:30:02.893 1109 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:30:02 ctl02 nova-api[1109]: 2017-09-28 12:30:02.896 1109 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:30:02 ctl02 nova-api[1109]: 2017-09-28 12:30:02.896 1109 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:30:02 ctl02 nova-api[1109]: 2017-09-28 12:30:02.897 1109 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:30:03 ctl02 nova-api[1109]: 2017-09-28 12:30:03.031 1109 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:30:03 ctl02 nova-api[1109]: 2017-09-28 12:30:03.034 1109 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:30:03 ctl02 nova-api[1109]: 2017-09-28 12:30:03.034 1109 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:30:03 ctl02 nova-api[1109]: 2017-09-28 12:30:03.034 1109 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:30:03 ctl02 nova-api[1109]: 2017-09-28 12:30:03.037 1109 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:30:03 ctl02 nova-api[1109]: 2017-09-28 12:30:03.038 1109 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:30:03 ctl02 nova-api[1109]: 2017-09-28 12:30:03.038 1109 ERROR nova Traceback (most recent call last):
Sep 28 12:30:03 ctl02 nova-api[1109]: 2017-09-28 12:30:03.038 1109 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:30:03 ctl02 nova-api[1109]: 2017-09-28 12:30:03.038 1109 ERROR nova     sys.exit(main())
Sep 28 12:30:03 ctl02 nova-api[1109]: 2017-09-28 12:30:03.038 1109 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:30:03 ctl02 nova-api[1109]: 2017-09-28 12:30:03.038 1109 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:30:03 ctl02 nova-api[1109]: 2017-09-28 12:30:03.038 1109 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:30:03 ctl02 nova-api[1109]: 2017-09-28 12:30:03.038 1109 ERROR nova     max_url_len=max_url_len)
Sep 28 12:30:03 ctl02 nova-api[1109]: 2017-09-28 12:30:03.038 1109 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:30:03 ctl02 nova-api[1109]: 2017-09-28 12:30:03.038 1109 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:30:03 ctl02 nova-api[1109]: 2017-09-28 12:30:03.038 1109 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:30:03 ctl02 nova-api[1109]: 2017-09-28 12:30:03.038 1109 ERROR nova     sock.listen(backlog)
Sep 28 12:30:03 ctl02 nova-api[1109]: 2017-09-28 12:30:03.038 1109 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:30:03 ctl02 nova-api[1109]: 2017-09-28 12:30:03.038 1109 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:30:03 ctl02 nova-api[1109]: 2017-09-28 12:30:03.038 1109 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:30:03 ctl02 nova-api[1109]: 2017-09-28 12:30:03.038 1109 ERROR nova
Sep 28 12:30:03 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:30:03 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:30:03 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:30:03 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:30:03 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:30:03 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:30:03 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:30:03 ctl02 glance-api[29183]: 2017-09-28 12:30:03.553 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:30:03] "OPTIONS / HTTP/1.0" 200 134 0.000637
Sep 28 12:30:03 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb47eac6b)
Sep 28 12:30:04 ctl02 glance-api[29183]: 2017-09-28 12:30:04.205 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:30:04] "OPTIONS / HTTP/1.0" 200 134 0.000767
Sep 28 12:30:04 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:30:04.207 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:30:04] "OPTIONS / HTTP/1.0" 200 134 0.000702
Sep 28 12:30:04 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb47eac6b)
Sep 28 12:30:05 ctl02 nova-api[1127]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:30:05 ctl02 nova-api[1127]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:30:05 ctl02 heat-api[13008]: 2017-09-28 12:30:05.152 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:30:05] "OPTIONS / HTTP/1.0" 200 134 0.000623
Sep 28 12:30:05 ctl02 nova-api[1127]: 2017-09-28 12:30:05.291 1127 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:30:05 ctl02 nova-api[1127]: 2017-09-28 12:30:05.293 1127 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:30:05 ctl02 nova-api[1127]: 2017-09-28 12:30:05.293 1127 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:30:05 ctl02 nova-api[1127]: 2017-09-28 12:30:05.293 1127 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:30:05 ctl02 nova-api[1127]: 2017-09-28 12:30:05.293 1127 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:30:05 ctl02 nova-api[1127]: 2017-09-28 12:30:05.293 1127 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:30:05 ctl02 nova-api[1127]: 2017-09-28 12:30:05.293 1127 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:30:05 ctl02 nova-api[1127]: 2017-09-28 12:30:05.293 1127 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:30:05 ctl02 nova-api[1127]: 2017-09-28 12:30:05.293 1127 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:30:05 ctl02 nova-api[1127]: 2017-09-28 12:30:05.293 1127 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:30:05 ctl02 nova-api[1127]: 2017-09-28 12:30:05.293 1127 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:30:05 ctl02 nova-api[1127]: 2017-09-28 12:30:05.293 1127 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:30:05 ctl02 nova-api[1127]: 2017-09-28 12:30:05.293 1127 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:30:05 ctl02 nova-api[1127]: 2017-09-28 12:30:05.293 1127 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:30:05 ctl02 nova-api[1127]: 2017-09-28 12:30:05.293 1127 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:30:05 ctl02 nova-api[1127]: 2017-09-28 12:30:05.293 1127 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:30:05 ctl02 nova-api[1127]: 2017-09-28 12:30:05.293 1127 ERROR nova.wsgi     self.filename))
Sep 28 12:30:05 ctl02 nova-api[1127]: 2017-09-28 12:30:05.293 1127 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:30:05 ctl02 nova-api[1127]: 2017-09-28 12:30:05.293 1127 ERROR nova.wsgi
Sep 28 12:30:05 ctl02 nova-api[1127]: 2017-09-28 12:30:05.295 1127 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:30:05 ctl02 nova-api[1127]: 2017-09-28 12:30:05.427 1127 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:30:05 ctl02 nova-api[1127]: 2017-09-28 12:30:05.679 1127 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:30:05 ctl02 nova-api[1127]: 2017-09-28 12:30:05.682 1127 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:30:05 ctl02 nova-api[1127]: 2017-09-28 12:30:05.683 1127 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:30:05 ctl02 nova-api[1127]: 2017-09-28 12:30:05.683 1127 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:30:05 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb47eac6b)
Sep 28 12:30:05 ctl02 nova-api[1127]: 2017-09-28 12:30:05.819 1127 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:30:05 ctl02 nova-api[1127]: 2017-09-28 12:30:05.822 1127 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:30:05 ctl02 nova-api[1127]: 2017-09-28 12:30:05.822 1127 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:30:05 ctl02 nova-api[1127]: 2017-09-28 12:30:05.823 1127 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:30:05 ctl02 nova-api[1127]: 2017-09-28 12:30:05.826 1127 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:30:05 ctl02 nova-api[1127]: 2017-09-28 12:30:05.827 1127 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:30:05 ctl02 nova-api[1127]: 2017-09-28 12:30:05.827 1127 ERROR nova Traceback (most recent call last):
Sep 28 12:30:05 ctl02 nova-api[1127]: 2017-09-28 12:30:05.827 1127 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:30:05 ctl02 nova-api[1127]: 2017-09-28 12:30:05.827 1127 ERROR nova     sys.exit(main())
Sep 28 12:30:05 ctl02 nova-api[1127]: 2017-09-28 12:30:05.827 1127 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:30:05 ctl02 nova-api[1127]: 2017-09-28 12:30:05.827 1127 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:30:05 ctl02 nova-api[1127]: 2017-09-28 12:30:05.827 1127 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:30:05 ctl02 nova-api[1127]: 2017-09-28 12:30:05.827 1127 ERROR nova     max_url_len=max_url_len)
Sep 28 12:30:05 ctl02 nova-api[1127]: 2017-09-28 12:30:05.827 1127 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:30:05 ctl02 nova-api[1127]: 2017-09-28 12:30:05.827 1127 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:30:05 ctl02 nova-api[1127]: 2017-09-28 12:30:05.827 1127 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:30:05 ctl02 nova-api[1127]: 2017-09-28 12:30:05.827 1127 ERROR nova     sock.listen(backlog)
Sep 28 12:30:05 ctl02 nova-api[1127]: 2017-09-28 12:30:05.827 1127 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:30:05 ctl02 nova-api[1127]: 2017-09-28 12:30:05.827 1127 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:30:05 ctl02 nova-api[1127]: 2017-09-28 12:30:05.827 1127 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:30:05 ctl02 nova-api[1127]: 2017-09-28 12:30:05.827 1127 ERROR nova
Sep 28 12:30:05 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:30:05 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:30:05 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:30:06 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:30:06 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:30:06 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:30:06 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:30:06 ctl02 heat-api[13008]: 2017-09-28 12:30:06.399 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:30:06] "OPTIONS / HTTP/1.0" 200 134 0.000629
Sep 28 12:30:06 ctl02 neutron-server[30536]: 2017-09-28 12:30:06.418 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 4 dead agents out of 6:
Sep 28 12:30:06 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:30:06 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:28:08 cmp002
Sep 28 12:30:06 ctl02 neutron-server[30536]:       Metadata agent  2017-09-28 12:28:07 cmp002
Sep 28 12:30:06 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:23:57 cmp001
Sep 28 12:30:06 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:28:30 cmp002
Sep 28 12:30:06 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb47eac6b)
Sep 28 12:30:06 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:30:06.812 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:30:06] "OPTIONS / HTTP/1.0" 200 134 0.000500
Sep 28 12:30:07 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:30:07.260 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:30:07] "OPTIONS / HTTP/1.0" 200 134 0.000496
Sep 28 12:30:07 ctl02 heat-api-cfn[13300]: 2017-09-28 12:30:07.572 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:30:07] "OPTIONS / HTTP/1.0" 200 134 0.000537
Sep 28 12:30:07 ctl02 nova-consoleauth[5433]: 2017-09-28 12:30:07.612 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:30:07 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb47eac6b)
Sep 28 12:30:07 ctl02 nova-api[1145]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:30:07 ctl02 nova-api[1145]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:30:08 ctl02 nova-api[1145]: 2017-09-28 12:30:08.042 1145 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:30:08 ctl02 nova-api[1145]: 2017-09-28 12:30:08.044 1145 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:30:08 ctl02 nova-api[1145]: 2017-09-28 12:30:08.044 1145 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:30:08 ctl02 nova-api[1145]: 2017-09-28 12:30:08.044 1145 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:30:08 ctl02 nova-api[1145]: 2017-09-28 12:30:08.044 1145 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:30:08 ctl02 nova-api[1145]: 2017-09-28 12:30:08.044 1145 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:30:08 ctl02 nova-api[1145]: 2017-09-28 12:30:08.044 1145 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:30:08 ctl02 nova-api[1145]: 2017-09-28 12:30:08.044 1145 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:30:08 ctl02 nova-api[1145]: 2017-09-28 12:30:08.044 1145 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:30:08 ctl02 nova-api[1145]: 2017-09-28 12:30:08.044 1145 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:30:08 ctl02 nova-api[1145]: 2017-09-28 12:30:08.044 1145 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:30:08 ctl02 nova-api[1145]: 2017-09-28 12:30:08.044 1145 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:30:08 ctl02 nova-api[1145]: 2017-09-28 12:30:08.044 1145 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:30:08 ctl02 nova-api[1145]: 2017-09-28 12:30:08.044 1145 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:30:08 ctl02 nova-api[1145]: 2017-09-28 12:30:08.044 1145 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:30:08 ctl02 nova-api[1145]: 2017-09-28 12:30:08.044 1145 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:30:08 ctl02 nova-api[1145]: 2017-09-28 12:30:08.044 1145 ERROR nova.wsgi     self.filename))
Sep 28 12:30:08 ctl02 nova-api[1145]: 2017-09-28 12:30:08.044 1145 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:30:08 ctl02 nova-api[1145]: 2017-09-28 12:30:08.044 1145 ERROR nova.wsgi
Sep 28 12:30:08 ctl02 nova-api[1145]: 2017-09-28 12:30:08.053 1145 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:30:08 ctl02 nova-api[1145]: 2017-09-28 12:30:08.185 1145 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:30:08 ctl02 nova-api[1145]: 2017-09-28 12:30:08.429 1145 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:30:08 ctl02 nova-api[1145]: 2017-09-28 12:30:08.432 1145 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:30:08 ctl02 nova-api[1145]: 2017-09-28 12:30:08.432 1145 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:30:08 ctl02 nova-api[1145]: 2017-09-28 12:30:08.433 1145 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:30:08 ctl02 nova-api[1145]: 2017-09-28 12:30:08.564 1145 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:30:08 ctl02 nova-api[1145]: 2017-09-28 12:30:08.567 1145 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:30:08 ctl02 nova-api[1145]: 2017-09-28 12:30:08.567 1145 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:30:08 ctl02 nova-api[1145]: 2017-09-28 12:30:08.568 1145 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:30:08 ctl02 nova-api[1145]: 2017-09-28 12:30:08.571 1145 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:30:08 ctl02 nova-api[1145]: 2017-09-28 12:30:08.572 1145 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:30:08 ctl02 nova-api[1145]: 2017-09-28 12:30:08.572 1145 ERROR nova Traceback (most recent call last):
Sep 28 12:30:08 ctl02 nova-api[1145]: 2017-09-28 12:30:08.572 1145 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:30:08 ctl02 nova-api[1145]: 2017-09-28 12:30:08.572 1145 ERROR nova     sys.exit(main())
Sep 28 12:30:08 ctl02 nova-api[1145]: 2017-09-28 12:30:08.572 1145 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:30:08 ctl02 nova-api[1145]: 2017-09-28 12:30:08.572 1145 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:30:08 ctl02 nova-api[1145]: 2017-09-28 12:30:08.572 1145 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:30:08 ctl02 nova-api[1145]: 2017-09-28 12:30:08.572 1145 ERROR nova     max_url_len=max_url_len)
Sep 28 12:30:08 ctl02 nova-api[1145]: 2017-09-28 12:30:08.572 1145 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:30:08 ctl02 nova-api[1145]: 2017-09-28 12:30:08.572 1145 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:30:08 ctl02 nova-api[1145]: 2017-09-28 12:30:08.572 1145 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:30:08 ctl02 nova-api[1145]: 2017-09-28 12:30:08.572 1145 ERROR nova     sock.listen(backlog)
Sep 28 12:30:08 ctl02 nova-api[1145]: 2017-09-28 12:30:08.572 1145 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:30:08 ctl02 nova-api[1145]: 2017-09-28 12:30:08.572 1145 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:30:08 ctl02 nova-api[1145]: 2017-09-28 12:30:08.572 1145 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:30:08 ctl02 nova-api[1145]: 2017-09-28 12:30:08.572 1145 ERROR nova
Sep 28 12:30:08 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:30:08 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:30:08 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:30:08 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb47eac6b)
Sep 28 12:30:08 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:30:08 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:30:08 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:30:08 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:30:08 ctl02 heat-api[13008]: 2017-09-28 12:30:08.921 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:30:08] "OPTIONS / HTTP/1.0" 200 134 0.000683
Sep 28 12:30:09 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb47eac6b)
Sep 28 12:30:09 ctl02 neutron-server[30536]: 2017-09-28 12:30:09.849 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:30:09] "OPTIONS / HTTP/1.0" 200 262 0.000478
Sep 28 12:30:09 ctl02 heat-engine[12803]: 2017-09-28 12:30:09.854 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:30:09 ctl02 heat-api-cfn[13300]: 2017-09-28 12:30:09.855 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:30:09] "OPTIONS / HTTP/1.0" 200 134 0.000452
Sep 28 12:30:09 ctl02 heat-engine[12803]: 2017-09-28 12:30:09.861 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:30:09 ctl02 heat-engine[12803]: 2017-09-28 12:30:09.862 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:30:09 ctl02 heat-engine[12803]: 2017-09-28 12:30:09.864 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:30:10 ctl02 heat-api-cfn[13300]: 2017-09-28 12:30:10.213 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:30:10] "OPTIONS / HTTP/1.0" 200 134 0.000424
Sep 28 12:30:10 ctl02 nova-api[1164]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:30:10 ctl02 nova-api[1164]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:30:10 ctl02 nova-scheduler[5620]: 2017-09-28 12:30:10.647 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:30:10 ctl02 nova-api[1164]: 2017-09-28 12:30:10.742 1164 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:30:10 ctl02 nova-api[1164]: 2017-09-28 12:30:10.743 1164 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:30:10 ctl02 nova-api[1164]: 2017-09-28 12:30:10.743 1164 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:30:10 ctl02 nova-api[1164]: 2017-09-28 12:30:10.743 1164 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:30:10 ctl02 nova-api[1164]: 2017-09-28 12:30:10.743 1164 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:30:10 ctl02 nova-api[1164]: 2017-09-28 12:30:10.743 1164 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:30:10 ctl02 nova-api[1164]: 2017-09-28 12:30:10.743 1164 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:30:10 ctl02 nova-api[1164]: 2017-09-28 12:30:10.743 1164 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:30:10 ctl02 nova-api[1164]: 2017-09-28 12:30:10.743 1164 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:30:10 ctl02 nova-api[1164]: 2017-09-28 12:30:10.743 1164 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:30:10 ctl02 nova-api[1164]: 2017-09-28 12:30:10.743 1164 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:30:10 ctl02 nova-api[1164]: 2017-09-28 12:30:10.743 1164 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:30:10 ctl02 nova-api[1164]: 2017-09-28 12:30:10.743 1164 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:30:10 ctl02 nova-api[1164]: 2017-09-28 12:30:10.743 1164 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:30:10 ctl02 nova-api[1164]: 2017-09-28 12:30:10.743 1164 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:30:10 ctl02 nova-api[1164]: 2017-09-28 12:30:10.743 1164 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:30:10 ctl02 nova-api[1164]: 2017-09-28 12:30:10.743 1164 ERROR nova.wsgi     self.filename))
Sep 28 12:30:10 ctl02 nova-api[1164]: 2017-09-28 12:30:10.743 1164 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:30:10 ctl02 nova-api[1164]: 2017-09-28 12:30:10.743 1164 ERROR nova.wsgi
Sep 28 12:30:10 ctl02 nova-api[1164]: 2017-09-28 12:30:10.744 1164 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:30:10 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb47eac6b)
Sep 28 12:30:10 ctl02 nova-api[1164]: 2017-09-28 12:30:10.871 1164 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:30:10 ctl02 neutron-server[30536]: 2017-09-28 12:30:10.889 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:30:10] "OPTIONS / HTTP/1.0" 200 262 0.000454
Sep 28 12:30:10 ctl02 glance-api[29183]: 2017-09-28 12:30:10.995 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:30:10] "OPTIONS / HTTP/1.0" 200 134 0.000562
Sep 28 12:30:11 ctl02 nova-api[1164]: 2017-09-28 12:30:11.099 1164 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:30:11 ctl02 nova-api[1164]: 2017-09-28 12:30:11.102 1164 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:30:11 ctl02 nova-api[1164]: 2017-09-28 12:30:11.102 1164 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:30:11 ctl02 nova-api[1164]: 2017-09-28 12:30:11.103 1164 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:30:11 ctl02 nova-api[1164]: 2017-09-28 12:30:11.233 1164 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:30:11 ctl02 nova-api[1164]: 2017-09-28 12:30:11.235 1164 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:30:11 ctl02 nova-api[1164]: 2017-09-28 12:30:11.236 1164 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:30:11 ctl02 nova-api[1164]: 2017-09-28 12:30:11.236 1164 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:30:11 ctl02 nova-api[1164]: 2017-09-28 12:30:11.240 1164 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:30:11 ctl02 nova-api[1164]: 2017-09-28 12:30:11.240 1164 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:30:11 ctl02 nova-api[1164]: 2017-09-28 12:30:11.240 1164 ERROR nova Traceback (most recent call last):
Sep 28 12:30:11 ctl02 nova-api[1164]: 2017-09-28 12:30:11.240 1164 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:30:11 ctl02 nova-api[1164]: 2017-09-28 12:30:11.240 1164 ERROR nova     sys.exit(main())
Sep 28 12:30:11 ctl02 nova-api[1164]: 2017-09-28 12:30:11.240 1164 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:30:11 ctl02 nova-api[1164]: 2017-09-28 12:30:11.240 1164 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:30:11 ctl02 nova-api[1164]: 2017-09-28 12:30:11.240 1164 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:30:11 ctl02 nova-api[1164]: 2017-09-28 12:30:11.240 1164 ERROR nova     max_url_len=max_url_len)
Sep 28 12:30:11 ctl02 nova-api[1164]: 2017-09-28 12:30:11.240 1164 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:30:11 ctl02 nova-api[1164]: 2017-09-28 12:30:11.240 1164 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:30:11 ctl02 nova-api[1164]: 2017-09-28 12:30:11.240 1164 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:30:11 ctl02 nova-api[1164]: 2017-09-28 12:30:11.240 1164 ERROR nova     sock.listen(backlog)
Sep 28 12:30:11 ctl02 nova-api[1164]: 2017-09-28 12:30:11.240 1164 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:30:11 ctl02 nova-api[1164]: 2017-09-28 12:30:11.240 1164 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:30:11 ctl02 nova-api[1164]: 2017-09-28 12:30:11.240 1164 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:30:11 ctl02 nova-api[1164]: 2017-09-28 12:30:11.240 1164 ERROR nova
Sep 28 12:30:11 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:30:11 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:30:11 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:30:11 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:30:11 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:30:11 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:30:11 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:30:11 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb47eac6b)
Sep 28 12:30:12 ctl02 neutron-server[30536]: 2017-09-28 12:30:12.518 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:30:12] "OPTIONS / HTTP/1.0" 200 262 0.000467
Sep 28 12:30:12 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:30:12 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:30:13 ctl02 glance-api[29183]: 2017-09-28 12:30:13.298 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:30:13] "OPTIONS / HTTP/1.0" 200 134 0.000560
Sep 28 12:30:13 ctl02 nova-api[1182]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:30:13 ctl02 nova-api[1182]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:30:13 ctl02 nova-api[1182]: 2017-09-28 12:30:13.489 1182 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:30:13 ctl02 nova-api[1182]: 2017-09-28 12:30:13.490 1182 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:30:13 ctl02 nova-api[1182]: 2017-09-28 12:30:13.490 1182 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:30:13 ctl02 nova-api[1182]: 2017-09-28 12:30:13.490 1182 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:30:13 ctl02 nova-api[1182]: 2017-09-28 12:30:13.490 1182 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:30:13 ctl02 nova-api[1182]: 2017-09-28 12:30:13.490 1182 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:30:13 ctl02 nova-api[1182]: 2017-09-28 12:30:13.490 1182 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:30:13 ctl02 nova-api[1182]: 2017-09-28 12:30:13.490 1182 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:30:13 ctl02 nova-api[1182]: 2017-09-28 12:30:13.490 1182 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:30:13 ctl02 nova-api[1182]: 2017-09-28 12:30:13.490 1182 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:30:13 ctl02 nova-api[1182]: 2017-09-28 12:30:13.490 1182 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:30:13 ctl02 nova-api[1182]: 2017-09-28 12:30:13.490 1182 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:30:13 ctl02 nova-api[1182]: 2017-09-28 12:30:13.490 1182 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:30:13 ctl02 nova-api[1182]: 2017-09-28 12:30:13.490 1182 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:30:13 ctl02 nova-api[1182]: 2017-09-28 12:30:13.490 1182 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:30:13 ctl02 nova-api[1182]: 2017-09-28 12:30:13.490 1182 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:30:13 ctl02 nova-api[1182]: 2017-09-28 12:30:13.490 1182 ERROR nova.wsgi     self.filename))
Sep 28 12:30:13 ctl02 nova-api[1182]: 2017-09-28 12:30:13.490 1182 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:30:13 ctl02 nova-api[1182]: 2017-09-28 12:30:13.490 1182 ERROR nova.wsgi
Sep 28 12:30:13 ctl02 nova-api[1182]: 2017-09-28 12:30:13.491 1182 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:30:13 ctl02 nova-api[1182]: 2017-09-28 12:30:13.622 1182 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:30:13 ctl02 glance-api[29183]: 2017-09-28 12:30:13.822 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:30:13] "OPTIONS / HTTP/1.0" 200 134 0.000604
Sep 28 12:30:13 ctl02 nova-api[1182]: 2017-09-28 12:30:13.846 1182 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:30:13 ctl02 nova-api[1182]: 2017-09-28 12:30:13.848 1182 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:30:13 ctl02 nova-api[1182]: 2017-09-28 12:30:13.848 1182 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:30:13 ctl02 nova-api[1182]: 2017-09-28 12:30:13.849 1182 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:30:13 ctl02 nova-api[1182]: 2017-09-28 12:30:13.981 1182 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:30:13 ctl02 nova-api[1182]: 2017-09-28 12:30:13.983 1182 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:30:13 ctl02 nova-api[1182]: 2017-09-28 12:30:13.983 1182 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:30:13 ctl02 nova-api[1182]: 2017-09-28 12:30:13.984 1182 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:30:13 ctl02 nova-api[1182]: 2017-09-28 12:30:13.987 1182 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:30:13 ctl02 nova-api[1182]: 2017-09-28 12:30:13.987 1182 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:30:13 ctl02 nova-api[1182]: 2017-09-28 12:30:13.987 1182 ERROR nova Traceback (most recent call last):
Sep 28 12:30:13 ctl02 nova-api[1182]: 2017-09-28 12:30:13.987 1182 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:30:13 ctl02 nova-api[1182]: 2017-09-28 12:30:13.987 1182 ERROR nova     sys.exit(main())
Sep 28 12:30:13 ctl02 nova-api[1182]: 2017-09-28 12:30:13.987 1182 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:30:13 ctl02 nova-api[1182]: 2017-09-28 12:30:13.987 1182 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:30:13 ctl02 nova-api[1182]: 2017-09-28 12:30:13.987 1182 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:30:13 ctl02 nova-api[1182]: 2017-09-28 12:30:13.987 1182 ERROR nova     max_url_len=max_url_len)
Sep 28 12:30:13 ctl02 nova-api[1182]: 2017-09-28 12:30:13.987 1182 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:30:13 ctl02 nova-api[1182]: 2017-09-28 12:30:13.987 1182 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:30:13 ctl02 nova-api[1182]: 2017-09-28 12:30:13.987 1182 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:30:13 ctl02 nova-api[1182]: 2017-09-28 12:30:13.987 1182 ERROR nova     sock.listen(backlog)
Sep 28 12:30:13 ctl02 nova-api[1182]: 2017-09-28 12:30:13.987 1182 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:30:13 ctl02 nova-api[1182]: 2017-09-28 12:30:13.987 1182 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:30:13 ctl02 nova-api[1182]: 2017-09-28 12:30:13.987 1182 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:30:13 ctl02 nova-api[1182]: 2017-09-28 12:30:13.987 1182 ERROR nova
Sep 28 12:30:14 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:30:14 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:30:14 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:30:14 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:30:14.364 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:30:14] "OPTIONS / HTTP/1.0" 200 134 0.000698
Sep 28 12:30:14 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:30:14 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:30:14 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:30:14 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:30:15 ctl02 heat-api[13008]: 2017-09-28 12:30:15.443 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:30:15] "OPTIONS / HTTP/1.0" 200 134 0.000700
Sep 28 12:30:16 ctl02 nova-api[1205]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:30:16 ctl02 nova-api[1205]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:30:16 ctl02 nova-api[1205]: 2017-09-28 12:30:16.287 1205 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:30:16 ctl02 nova-api[1205]: 2017-09-28 12:30:16.289 1205 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:30:16 ctl02 nova-api[1205]: 2017-09-28 12:30:16.289 1205 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:30:16 ctl02 nova-api[1205]: 2017-09-28 12:30:16.289 1205 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:30:16 ctl02 nova-api[1205]: 2017-09-28 12:30:16.289 1205 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:30:16 ctl02 nova-api[1205]: 2017-09-28 12:30:16.289 1205 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:30:16 ctl02 nova-api[1205]: 2017-09-28 12:30:16.289 1205 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:30:16 ctl02 nova-api[1205]: 2017-09-28 12:30:16.289 1205 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:30:16 ctl02 nova-api[1205]: 2017-09-28 12:30:16.289 1205 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:30:16 ctl02 nova-api[1205]: 2017-09-28 12:30:16.289 1205 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:30:16 ctl02 nova-api[1205]: 2017-09-28 12:30:16.289 1205 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:30:16 ctl02 nova-api[1205]: 2017-09-28 12:30:16.289 1205 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:30:16 ctl02 nova-api[1205]: 2017-09-28 12:30:16.289 1205 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:30:16 ctl02 nova-api[1205]: 2017-09-28 12:30:16.289 1205 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:30:16 ctl02 nova-api[1205]: 2017-09-28 12:30:16.289 1205 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:30:16 ctl02 nova-api[1205]: 2017-09-28 12:30:16.289 1205 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:30:16 ctl02 nova-api[1205]: 2017-09-28 12:30:16.289 1205 ERROR nova.wsgi     self.filename))
Sep 28 12:30:16 ctl02 nova-api[1205]: 2017-09-28 12:30:16.289 1205 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:30:16 ctl02 nova-api[1205]: 2017-09-28 12:30:16.289 1205 ERROR nova.wsgi
Sep 28 12:30:16 ctl02 nova-api[1205]: 2017-09-28 12:30:16.290 1205 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:30:16 ctl02 nova-api[1205]: 2017-09-28 12:30:16.423 1205 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:30:16 ctl02 nova-api[1205]: 2017-09-28 12:30:16.673 1205 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:30:16 ctl02 nova-api[1205]: 2017-09-28 12:30:16.675 1205 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:30:16 ctl02 nova-api[1205]: 2017-09-28 12:30:16.675 1205 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:30:16 ctl02 nova-api[1205]: 2017-09-28 12:30:16.676 1205 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:30:16 ctl02 heat-api[13008]: 2017-09-28 12:30:16.766 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:30:16] "OPTIONS / HTTP/1.0" 200 134 0.000617
Sep 28 12:30:16 ctl02 nova-api[1205]: 2017-09-28 12:30:16.810 1205 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:30:16 ctl02 nova-api[1205]: 2017-09-28 12:30:16.812 1205 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:30:16 ctl02 nova-api[1205]: 2017-09-28 12:30:16.813 1205 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:30:16 ctl02 nova-api[1205]: 2017-09-28 12:30:16.813 1205 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:30:16 ctl02 nova-api[1205]: 2017-09-28 12:30:16.817 1205 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:30:16 ctl02 nova-api[1205]: 2017-09-28 12:30:16.817 1205 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:30:16 ctl02 nova-api[1205]: 2017-09-28 12:30:16.817 1205 ERROR nova Traceback (most recent call last):
Sep 28 12:30:16 ctl02 nova-api[1205]: 2017-09-28 12:30:16.817 1205 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:30:16 ctl02 nova-api[1205]: 2017-09-28 12:30:16.817 1205 ERROR nova     sys.exit(main())
Sep 28 12:30:16 ctl02 nova-api[1205]: 2017-09-28 12:30:16.817 1205 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:30:16 ctl02 nova-api[1205]: 2017-09-28 12:30:16.817 1205 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:30:16 ctl02 nova-api[1205]: 2017-09-28 12:30:16.817 1205 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:30:16 ctl02 nova-api[1205]: 2017-09-28 12:30:16.817 1205 ERROR nova     max_url_len=max_url_len)
Sep 28 12:30:16 ctl02 nova-api[1205]: 2017-09-28 12:30:16.817 1205 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:30:16 ctl02 nova-api[1205]: 2017-09-28 12:30:16.817 1205 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:30:16 ctl02 nova-api[1205]: 2017-09-28 12:30:16.817 1205 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:30:16 ctl02 nova-api[1205]: 2017-09-28 12:30:16.817 1205 ERROR nova     sock.listen(backlog)
Sep 28 12:30:16 ctl02 nova-api[1205]: 2017-09-28 12:30:16.817 1205 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:30:16 ctl02 nova-api[1205]: 2017-09-28 12:30:16.817 1205 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:30:16 ctl02 nova-api[1205]: 2017-09-28 12:30:16.817 1205 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:30:16 ctl02 nova-api[1205]: 2017-09-28 12:30:16.817 1205 ERROR nova
Sep 28 12:30:16 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:30:16.855 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:30:16] "OPTIONS / HTTP/1.0" 200 134 0.000476
Sep 28 12:30:16 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:30:16 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:30:16 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:30:17 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:30:17 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:30:17 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:30:17 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:30:17 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:30:17.560 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:30:17] "OPTIONS / HTTP/1.0" 200 134 0.000406
Sep 28 12:30:17 ctl02 heat-api-cfn[13300]: 2017-09-28 12:30:17.810 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:30:17] "OPTIONS / HTTP/1.0" 200 134 0.000463
Sep 28 12:30:18 ctl02 heat-api[13008]: 2017-09-28 12:30:18.615 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:30:18] "OPTIONS / HTTP/1.0" 200 134 0.000546
Sep 28 12:30:18 ctl02 nova-api[1223]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:30:18 ctl02 nova-api[1223]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:30:18 ctl02 nova-api[1223]: 2017-09-28 12:30:18.964 1223 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:30:18 ctl02 nova-api[1223]: 2017-09-28 12:30:18.966 1223 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:30:18 ctl02 nova-api[1223]: 2017-09-28 12:30:18.966 1223 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:30:18 ctl02 nova-api[1223]: 2017-09-28 12:30:18.966 1223 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:30:18 ctl02 nova-api[1223]: 2017-09-28 12:30:18.966 1223 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:30:18 ctl02 nova-api[1223]: 2017-09-28 12:30:18.966 1223 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:30:18 ctl02 nova-api[1223]: 2017-09-28 12:30:18.966 1223 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:30:18 ctl02 nova-api[1223]: 2017-09-28 12:30:18.966 1223 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:30:18 ctl02 nova-api[1223]: 2017-09-28 12:30:18.966 1223 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:30:18 ctl02 nova-api[1223]: 2017-09-28 12:30:18.966 1223 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:30:18 ctl02 nova-api[1223]: 2017-09-28 12:30:18.966 1223 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:30:18 ctl02 nova-api[1223]: 2017-09-28 12:30:18.966 1223 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:30:18 ctl02 nova-api[1223]: 2017-09-28 12:30:18.966 1223 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:30:18 ctl02 nova-api[1223]: 2017-09-28 12:30:18.966 1223 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:30:18 ctl02 nova-api[1223]: 2017-09-28 12:30:18.966 1223 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:30:18 ctl02 nova-api[1223]: 2017-09-28 12:30:18.966 1223 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:30:18 ctl02 nova-api[1223]: 2017-09-28 12:30:18.966 1223 ERROR nova.wsgi     self.filename))
Sep 28 12:30:18 ctl02 nova-api[1223]: 2017-09-28 12:30:18.966 1223 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:30:18 ctl02 nova-api[1223]: 2017-09-28 12:30:18.966 1223 ERROR nova.wsgi
Sep 28 12:30:18 ctl02 nova-api[1223]: 2017-09-28 12:30:18.968 1223 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:30:19 ctl02 nova-api[1223]: 2017-09-28 12:30:19.094 1223 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:30:19 ctl02 nova-api[1223]: 2017-09-28 12:30:19.317 1223 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:30:19 ctl02 nova-api[1223]: 2017-09-28 12:30:19.320 1223 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:30:19 ctl02 nova-api[1223]: 2017-09-28 12:30:19.320 1223 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:30:19 ctl02 nova-api[1223]: 2017-09-28 12:30:19.321 1223 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:30:19 ctl02 nova-api[1223]: 2017-09-28 12:30:19.451 1223 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:30:19 ctl02 nova-api[1223]: 2017-09-28 12:30:19.453 1223 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:30:19 ctl02 nova-api[1223]: 2017-09-28 12:30:19.454 1223 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:30:19 ctl02 nova-api[1223]: 2017-09-28 12:30:19.454 1223 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:30:19 ctl02 nova-api[1223]: 2017-09-28 12:30:19.457 1223 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:30:19 ctl02 nova-api[1223]: 2017-09-28 12:30:19.458 1223 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:30:19 ctl02 nova-api[1223]: 2017-09-28 12:30:19.458 1223 ERROR nova Traceback (most recent call last):
Sep 28 12:30:19 ctl02 nova-api[1223]: 2017-09-28 12:30:19.458 1223 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:30:19 ctl02 nova-api[1223]: 2017-09-28 12:30:19.458 1223 ERROR nova     sys.exit(main())
Sep 28 12:30:19 ctl02 nova-api[1223]: 2017-09-28 12:30:19.458 1223 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:30:19 ctl02 nova-api[1223]: 2017-09-28 12:30:19.458 1223 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:30:19 ctl02 nova-api[1223]: 2017-09-28 12:30:19.458 1223 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:30:19 ctl02 nova-api[1223]: 2017-09-28 12:30:19.458 1223 ERROR nova     max_url_len=max_url_len)
Sep 28 12:30:19 ctl02 nova-api[1223]: 2017-09-28 12:30:19.458 1223 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:30:19 ctl02 nova-api[1223]: 2017-09-28 12:30:19.458 1223 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:30:19 ctl02 nova-api[1223]: 2017-09-28 12:30:19.458 1223 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:30:19 ctl02 nova-api[1223]: 2017-09-28 12:30:19.458 1223 ERROR nova     sock.listen(backlog)
Sep 28 12:30:19 ctl02 nova-api[1223]: 2017-09-28 12:30:19.458 1223 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:30:19 ctl02 nova-api[1223]: 2017-09-28 12:30:19.458 1223 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:30:19 ctl02 nova-api[1223]: 2017-09-28 12:30:19.458 1223 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:30:19 ctl02 nova-api[1223]: 2017-09-28 12:30:19.458 1223 ERROR nova
Sep 28 12:30:19 ctl02 neutron-server[30536]: 2017-09-28 12:30:19.581 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:30:19] "OPTIONS / HTTP/1.0" 200 262 0.000483
Sep 28 12:30:19 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:30:19 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:30:19 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:30:19 ctl02 heat-api-cfn[13300]: 2017-09-28 12:30:19.689 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:30:19] "OPTIONS / HTTP/1.0" 200 134 0.000441
Sep 28 12:30:19 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:30:19 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:30:19 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:30:19 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:30:20 ctl02 heat-api-cfn[13300]: 2017-09-28 12:30:20.272 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:30:20] "OPTIONS / HTTP/1.0" 200 134 0.000444
Sep 28 12:30:20 ctl02 neutron-server[30536]: 2017-09-28 12:30:20.613 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:30:20] "OPTIONS / HTTP/1.0" 200 262 0.000475
Sep 28 12:30:21 ctl02 glance-api[29183]: 2017-09-28 12:30:21.308 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:30:21] "OPTIONS / HTTP/1.0" 200 134 0.000669
Sep 28 12:30:21 ctl02 neutron-server[30536]: 2017-09-28 12:30:21.414 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 2 dead agents out of 6:
Sep 28 12:30:21 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:30:21 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:23:57 cmp001
Sep 28 12:30:21 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:28:30 cmp002
Sep 28 12:30:21 ctl02 nova-api[1241]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:30:21 ctl02 nova-api[1241]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:30:21 ctl02 nova-api[1241]: 2017-09-28 12:30:21.748 1241 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:30:21 ctl02 nova-api[1241]: 2017-09-28 12:30:21.750 1241 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:30:21 ctl02 nova-api[1241]: 2017-09-28 12:30:21.750 1241 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:30:21 ctl02 nova-api[1241]: 2017-09-28 12:30:21.750 1241 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:30:21 ctl02 nova-api[1241]: 2017-09-28 12:30:21.750 1241 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:30:21 ctl02 nova-api[1241]: 2017-09-28 12:30:21.750 1241 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:30:21 ctl02 nova-api[1241]: 2017-09-28 12:30:21.750 1241 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:30:21 ctl02 nova-api[1241]: 2017-09-28 12:30:21.750 1241 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:30:21 ctl02 nova-api[1241]: 2017-09-28 12:30:21.750 1241 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:30:21 ctl02 nova-api[1241]: 2017-09-28 12:30:21.750 1241 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:30:21 ctl02 nova-api[1241]: 2017-09-28 12:30:21.750 1241 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:30:21 ctl02 nova-api[1241]: 2017-09-28 12:30:21.750 1241 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:30:21 ctl02 nova-api[1241]: 2017-09-28 12:30:21.750 1241 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:30:21 ctl02 nova-api[1241]: 2017-09-28 12:30:21.750 1241 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:30:21 ctl02 nova-api[1241]: 2017-09-28 12:30:21.750 1241 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:30:21 ctl02 nova-api[1241]: 2017-09-28 12:30:21.750 1241 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:30:21 ctl02 nova-api[1241]: 2017-09-28 12:30:21.750 1241 ERROR nova.wsgi     self.filename))
Sep 28 12:30:21 ctl02 nova-api[1241]: 2017-09-28 12:30:21.750 1241 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:30:21 ctl02 nova-api[1241]: 2017-09-28 12:30:21.750 1241 ERROR nova.wsgi
Sep 28 12:30:21 ctl02 nova-api[1241]: 2017-09-28 12:30:21.751 1241 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:30:21 ctl02 nova-api[1241]: 2017-09-28 12:30:21.877 1241 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:30:22 ctl02 nova-api[1241]: 2017-09-28 12:30:22.103 1241 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:30:22 ctl02 nova-api[1241]: 2017-09-28 12:30:22.106 1241 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:30:22 ctl02 nova-api[1241]: 2017-09-28 12:30:22.106 1241 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:30:22 ctl02 nova-api[1241]: 2017-09-28 12:30:22.106 1241 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:30:22 ctl02 nova-api[1241]: 2017-09-28 12:30:22.234 1241 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:30:22 ctl02 nova-api[1241]: 2017-09-28 12:30:22.236 1241 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:30:22 ctl02 nova-api[1241]: 2017-09-28 12:30:22.236 1241 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:30:22 ctl02 nova-api[1241]: 2017-09-28 12:30:22.236 1241 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:30:22 ctl02 nova-api[1241]: 2017-09-28 12:30:22.239 1241 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:30:22 ctl02 nova-api[1241]: 2017-09-28 12:30:22.240 1241 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:30:22 ctl02 nova-api[1241]: 2017-09-28 12:30:22.240 1241 ERROR nova Traceback (most recent call last):
Sep 28 12:30:22 ctl02 nova-api[1241]: 2017-09-28 12:30:22.240 1241 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:30:22 ctl02 nova-api[1241]: 2017-09-28 12:30:22.240 1241 ERROR nova     sys.exit(main())
Sep 28 12:30:22 ctl02 nova-api[1241]: 2017-09-28 12:30:22.240 1241 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:30:22 ctl02 nova-api[1241]: 2017-09-28 12:30:22.240 1241 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:30:22 ctl02 nova-api[1241]: 2017-09-28 12:30:22.240 1241 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:30:22 ctl02 nova-api[1241]: 2017-09-28 12:30:22.240 1241 ERROR nova     max_url_len=max_url_len)
Sep 28 12:30:22 ctl02 nova-api[1241]: 2017-09-28 12:30:22.240 1241 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:30:22 ctl02 nova-api[1241]: 2017-09-28 12:30:22.240 1241 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:30:22 ctl02 nova-api[1241]: 2017-09-28 12:30:22.240 1241 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:30:22 ctl02 nova-api[1241]: 2017-09-28 12:30:22.240 1241 ERROR nova     sock.listen(backlog)
Sep 28 12:30:22 ctl02 nova-api[1241]: 2017-09-28 12:30:22.240 1241 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:30:22 ctl02 nova-api[1241]: 2017-09-28 12:30:22.240 1241 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:30:22 ctl02 nova-api[1241]: 2017-09-28 12:30:22.240 1241 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:30:22 ctl02 nova-api[1241]: 2017-09-28 12:30:22.240 1241 ERROR nova
Sep 28 12:30:22 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:30:22 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:30:22 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:30:22 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd3bedb01)
Sep 28 12:30:22 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:30:22 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:30:22 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:30:22 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:30:22 ctl02 neutron-server[30536]: 2017-09-28 12:30:22.874 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:30:22] "OPTIONS / HTTP/1.0" 200 262 0.000528
Sep 28 12:30:23 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd3bedb01)
Sep 28 12:30:23 ctl02 glance-api[29183]: 2017-09-28 12:30:23.563 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:30:23] "OPTIONS / HTTP/1.0" 200 134 0.001034
Sep 28 12:30:23 ctl02 glance-api[29183]: 2017-09-28 12:30:23.770 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:30:23] "OPTIONS / HTTP/1.0" 200 134 0.000611
Sep 28 12:30:24 ctl02 nova-api[1258]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:30:24 ctl02 nova-api[1258]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:30:24 ctl02 nova-api[1258]: 2017-09-28 12:30:24.533 1258 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:30:24 ctl02 nova-api[1258]: 2017-09-28 12:30:24.535 1258 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:30:24 ctl02 nova-api[1258]: 2017-09-28 12:30:24.535 1258 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:30:24 ctl02 nova-api[1258]: 2017-09-28 12:30:24.535 1258 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:30:24 ctl02 nova-api[1258]: 2017-09-28 12:30:24.535 1258 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:30:24 ctl02 nova-api[1258]: 2017-09-28 12:30:24.535 1258 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:30:24 ctl02 nova-api[1258]: 2017-09-28 12:30:24.535 1258 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:30:24 ctl02 nova-api[1258]: 2017-09-28 12:30:24.535 1258 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:30:24 ctl02 nova-api[1258]: 2017-09-28 12:30:24.535 1258 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:30:24 ctl02 nova-api[1258]: 2017-09-28 12:30:24.535 1258 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:30:24 ctl02 nova-api[1258]: 2017-09-28 12:30:24.535 1258 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:30:24 ctl02 nova-api[1258]: 2017-09-28 12:30:24.535 1258 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:30:24 ctl02 nova-api[1258]: 2017-09-28 12:30:24.535 1258 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:30:24 ctl02 nova-api[1258]: 2017-09-28 12:30:24.535 1258 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:30:24 ctl02 nova-api[1258]: 2017-09-28 12:30:24.535 1258 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:30:24 ctl02 nova-api[1258]: 2017-09-28 12:30:24.535 1258 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:30:24 ctl02 nova-api[1258]: 2017-09-28 12:30:24.535 1258 ERROR nova.wsgi     self.filename))
Sep 28 12:30:24 ctl02 nova-api[1258]: 2017-09-28 12:30:24.535 1258 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:30:24 ctl02 nova-api[1258]: 2017-09-28 12:30:24.535 1258 ERROR nova.wsgi
Sep 28 12:30:24 ctl02 nova-api[1258]: 2017-09-28 12:30:24.537 1258 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:30:24 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd3bedb01)
Sep 28 12:30:24 ctl02 nova-api[1258]: 2017-09-28 12:30:24.669 1258 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:30:24 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:30:24.683 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:30:24] "OPTIONS / HTTP/1.0" 200 134 0.000464
Sep 28 12:30:24 ctl02 nova-api[1258]: 2017-09-28 12:30:24.921 1258 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:30:24 ctl02 nova-api[1258]: 2017-09-28 12:30:24.925 1258 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:30:24 ctl02 nova-api[1258]: 2017-09-28 12:30:24.925 1258 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:30:24 ctl02 nova-api[1258]: 2017-09-28 12:30:24.925 1258 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:30:25 ctl02 nova-api[1258]: 2017-09-28 12:30:25.061 1258 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:30:25 ctl02 nova-api[1258]: 2017-09-28 12:30:25.064 1258 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:30:25 ctl02 nova-api[1258]: 2017-09-28 12:30:25.065 1258 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:30:25 ctl02 nova-api[1258]: 2017-09-28 12:30:25.065 1258 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:30:25 ctl02 nova-api[1258]: 2017-09-28 12:30:25.069 1258 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:30:25 ctl02 nova-api[1258]: 2017-09-28 12:30:25.070 1258 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:30:25 ctl02 nova-api[1258]: 2017-09-28 12:30:25.070 1258 ERROR nova Traceback (most recent call last):
Sep 28 12:30:25 ctl02 nova-api[1258]: 2017-09-28 12:30:25.070 1258 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:30:25 ctl02 nova-api[1258]: 2017-09-28 12:30:25.070 1258 ERROR nova     sys.exit(main())
Sep 28 12:30:25 ctl02 nova-api[1258]: 2017-09-28 12:30:25.070 1258 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:30:25 ctl02 nova-api[1258]: 2017-09-28 12:30:25.070 1258 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:30:25 ctl02 nova-api[1258]: 2017-09-28 12:30:25.070 1258 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:30:25 ctl02 nova-api[1258]: 2017-09-28 12:30:25.070 1258 ERROR nova     max_url_len=max_url_len)
Sep 28 12:30:25 ctl02 nova-api[1258]: 2017-09-28 12:30:25.070 1258 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:30:25 ctl02 nova-api[1258]: 2017-09-28 12:30:25.070 1258 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:30:25 ctl02 nova-api[1258]: 2017-09-28 12:30:25.070 1258 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:30:25 ctl02 nova-api[1258]: 2017-09-28 12:30:25.070 1258 ERROR nova     sock.listen(backlog)
Sep 28 12:30:25 ctl02 nova-api[1258]: 2017-09-28 12:30:25.070 1258 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:30:25 ctl02 nova-api[1258]: 2017-09-28 12:30:25.070 1258 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:30:25 ctl02 nova-api[1258]: 2017-09-28 12:30:25.070 1258 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:30:25 ctl02 nova-api[1258]: 2017-09-28 12:30:25.070 1258 ERROR nova
Sep 28 12:30:25 ctl02 heat-api[13008]: 2017-09-28 12:30:25.157 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:30:25] "OPTIONS / HTTP/1.0" 200 134 0.001121
Sep 28 12:30:25 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:30:25 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:30:25 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:30:25 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:30:25 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:30:25 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:30:25 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:30:25 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd3bedb01)
Sep 28 12:30:26 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd3bedb01)
Sep 28 12:30:26 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:30:26.620 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:30:26] "OPTIONS / HTTP/1.0" 200 134 0.000645
Sep 28 12:30:26 ctl02 heat-api[13008]: 2017-09-28 12:30:26.915 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:30:26] "OPTIONS / HTTP/1.0" 200 134 0.000660
Sep 28 12:30:27 ctl02 nova-api[1277]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:30:27 ctl02 nova-api[1277]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:30:27 ctl02 nova-api[1277]: 2017-09-28 12:30:27.270 1277 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:30:27 ctl02 nova-api[1277]: 2017-09-28 12:30:27.271 1277 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:30:27 ctl02 nova-api[1277]: 2017-09-28 12:30:27.271 1277 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:30:27 ctl02 nova-api[1277]: 2017-09-28 12:30:27.271 1277 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:30:27 ctl02 nova-api[1277]: 2017-09-28 12:30:27.271 1277 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:30:27 ctl02 nova-api[1277]: 2017-09-28 12:30:27.271 1277 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:30:27 ctl02 nova-api[1277]: 2017-09-28 12:30:27.271 1277 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:30:27 ctl02 nova-api[1277]: 2017-09-28 12:30:27.271 1277 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:30:27 ctl02 nova-api[1277]: 2017-09-28 12:30:27.271 1277 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:30:27 ctl02 nova-api[1277]: 2017-09-28 12:30:27.271 1277 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:30:27 ctl02 nova-api[1277]: 2017-09-28 12:30:27.271 1277 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:30:27 ctl02 nova-api[1277]: 2017-09-28 12:30:27.271 1277 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:30:27 ctl02 nova-api[1277]: 2017-09-28 12:30:27.271 1277 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:30:27 ctl02 nova-api[1277]: 2017-09-28 12:30:27.271 1277 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:30:27 ctl02 nova-api[1277]: 2017-09-28 12:30:27.271 1277 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:30:27 ctl02 nova-api[1277]: 2017-09-28 12:30:27.271 1277 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:30:27 ctl02 nova-api[1277]: 2017-09-28 12:30:27.271 1277 ERROR nova.wsgi     self.filename))
Sep 28 12:30:27 ctl02 nova-api[1277]: 2017-09-28 12:30:27.271 1277 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:30:27 ctl02 nova-api[1277]: 2017-09-28 12:30:27.271 1277 ERROR nova.wsgi
Sep 28 12:30:27 ctl02 nova-api[1277]: 2017-09-28 12:30:27.272 1277 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:30:27 ctl02 nova-api[1277]: 2017-09-28 12:30:27.406 1277 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:30:27 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:30:27.565 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:30:27] "OPTIONS / HTTP/1.0" 200 134 0.000623
Sep 28 12:30:27 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd3bedb01)
Sep 28 12:30:27 ctl02 nova-api[1277]: 2017-09-28 12:30:27.657 1277 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:30:27 ctl02 nova-api[1277]: 2017-09-28 12:30:27.659 1277 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:30:27 ctl02 nova-api[1277]: 2017-09-28 12:30:27.659 1277 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:30:27 ctl02 nova-api[1277]: 2017-09-28 12:30:27.660 1277 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:30:27 ctl02 nova-api[1277]: 2017-09-28 12:30:27.795 1277 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:30:27 ctl02 nova-api[1277]: 2017-09-28 12:30:27.797 1277 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:30:27 ctl02 nova-api[1277]: 2017-09-28 12:30:27.797 1277 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:30:27 ctl02 nova-api[1277]: 2017-09-28 12:30:27.798 1277 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:30:27 ctl02 nova-api[1277]: 2017-09-28 12:30:27.801 1277 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:30:27 ctl02 nova-api[1277]: 2017-09-28 12:30:27.801 1277 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:30:27 ctl02 nova-api[1277]: 2017-09-28 12:30:27.801 1277 ERROR nova Traceback (most recent call last):
Sep 28 12:30:27 ctl02 nova-api[1277]: 2017-09-28 12:30:27.801 1277 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:30:27 ctl02 nova-api[1277]: 2017-09-28 12:30:27.801 1277 ERROR nova     sys.exit(main())
Sep 28 12:30:27 ctl02 nova-api[1277]: 2017-09-28 12:30:27.801 1277 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:30:27 ctl02 nova-api[1277]: 2017-09-28 12:30:27.801 1277 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:30:27 ctl02 nova-api[1277]: 2017-09-28 12:30:27.801 1277 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:30:27 ctl02 nova-api[1277]: 2017-09-28 12:30:27.801 1277 ERROR nova     max_url_len=max_url_len)
Sep 28 12:30:27 ctl02 nova-api[1277]: 2017-09-28 12:30:27.801 1277 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:30:27 ctl02 nova-api[1277]: 2017-09-28 12:30:27.801 1277 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:30:27 ctl02 nova-api[1277]: 2017-09-28 12:30:27.801 1277 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:30:27 ctl02 nova-api[1277]: 2017-09-28 12:30:27.801 1277 ERROR nova     sock.listen(backlog)
Sep 28 12:30:27 ctl02 nova-api[1277]: 2017-09-28 12:30:27.801 1277 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:30:27 ctl02 nova-api[1277]: 2017-09-28 12:30:27.801 1277 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:30:27 ctl02 nova-api[1277]: 2017-09-28 12:30:27.801 1277 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:30:27 ctl02 nova-api[1277]: 2017-09-28 12:30:27.801 1277 ERROR nova
Sep 28 12:30:27 ctl02 heat-api-cfn[13300]: 2017-09-28 12:30:27.970 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:30:27] "OPTIONS / HTTP/1.0" 200 134 0.000576
Sep 28 12:30:27 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:30:27 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:30:27 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:30:28 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:30:28 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:30:28 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:30:28 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:30:28 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd3bedb01)
Sep 28 12:30:28 ctl02 heat-api[13008]: 2017-09-28 12:30:28.726 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:30:28] "OPTIONS / HTTP/1.0" 200 134 0.000681
Sep 28 12:30:29 ctl02 heat-api-cfn[13300]: 2017-09-28 12:30:29.350 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:30:29] "OPTIONS / HTTP/1.0" 200 134 0.000521
Sep 28 12:30:29 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd3bedb01)
Sep 28 12:30:29 ctl02 nova-cert[4860]: 2017-09-28 12:30:29.766 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:30:29 ctl02 nova-api[1295]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:30:29 ctl02 nova-api[1295]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:30:29 ctl02 neutron-server[30536]: 2017-09-28 12:30:29.927 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:30:29] "OPTIONS / HTTP/1.0" 200 262 0.000514
Sep 28 12:30:30 ctl02 nova-api[1295]: 2017-09-28 12:30:30.022 1295 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:30:30 ctl02 nova-api[1295]: 2017-09-28 12:30:30.024 1295 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:30:30 ctl02 nova-api[1295]: 2017-09-28 12:30:30.024 1295 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:30:30 ctl02 nova-api[1295]: 2017-09-28 12:30:30.024 1295 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:30:30 ctl02 nova-api[1295]: 2017-09-28 12:30:30.024 1295 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:30:30 ctl02 nova-api[1295]: 2017-09-28 12:30:30.024 1295 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:30:30 ctl02 nova-api[1295]: 2017-09-28 12:30:30.024 1295 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:30:30 ctl02 nova-api[1295]: 2017-09-28 12:30:30.024 1295 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:30:30 ctl02 nova-api[1295]: 2017-09-28 12:30:30.024 1295 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:30:30 ctl02 nova-api[1295]: 2017-09-28 12:30:30.024 1295 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:30:30 ctl02 nova-api[1295]: 2017-09-28 12:30:30.024 1295 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:30:30 ctl02 nova-api[1295]: 2017-09-28 12:30:30.024 1295 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:30:30 ctl02 nova-api[1295]: 2017-09-28 12:30:30.024 1295 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:30:30 ctl02 nova-api[1295]: 2017-09-28 12:30:30.024 1295 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:30:30 ctl02 nova-api[1295]: 2017-09-28 12:30:30.024 1295 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:30:30 ctl02 nova-api[1295]: 2017-09-28 12:30:30.024 1295 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:30:30 ctl02 nova-api[1295]: 2017-09-28 12:30:30.024 1295 ERROR nova.wsgi     self.filename))
Sep 28 12:30:30 ctl02 nova-api[1295]: 2017-09-28 12:30:30.024 1295 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:30:30 ctl02 nova-api[1295]: 2017-09-28 12:30:30.024 1295 ERROR nova.wsgi
Sep 28 12:30:30 ctl02 nova-api[1295]: 2017-09-28 12:30:30.025 1295 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:30:30 ctl02 nova-api[1295]: 2017-09-28 12:30:30.164 1295 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:30:30 ctl02 heat-api-cfn[13300]: 2017-09-28 12:30:30.362 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:30:30] "OPTIONS / HTTP/1.0" 200 134 0.000509
Sep 28 12:30:30 ctl02 nova-api[1295]: 2017-09-28 12:30:30.417 1295 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:30:30 ctl02 nova-api[1295]: 2017-09-28 12:30:30.420 1295 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:30:30 ctl02 nova-api[1295]: 2017-09-28 12:30:30.420 1295 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:30:30 ctl02 nova-api[1295]: 2017-09-28 12:30:30.420 1295 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:30:30 ctl02 nova-api[1295]: 2017-09-28 12:30:30.555 1295 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:30:30 ctl02 nova-api[1295]: 2017-09-28 12:30:30.557 1295 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:30:30 ctl02 nova-api[1295]: 2017-09-28 12:30:30.557 1295 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:30:30 ctl02 nova-api[1295]: 2017-09-28 12:30:30.558 1295 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:30:30 ctl02 nova-api[1295]: 2017-09-28 12:30:30.561 1295 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:30:30 ctl02 nova-api[1295]: 2017-09-28 12:30:30.561 1295 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:30:30 ctl02 nova-api[1295]: 2017-09-28 12:30:30.561 1295 ERROR nova Traceback (most recent call last):
Sep 28 12:30:30 ctl02 nova-api[1295]: 2017-09-28 12:30:30.561 1295 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:30:30 ctl02 nova-api[1295]: 2017-09-28 12:30:30.561 1295 ERROR nova     sys.exit(main())
Sep 28 12:30:30 ctl02 nova-api[1295]: 2017-09-28 12:30:30.561 1295 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:30:30 ctl02 nova-api[1295]: 2017-09-28 12:30:30.561 1295 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:30:30 ctl02 nova-api[1295]: 2017-09-28 12:30:30.561 1295 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:30:30 ctl02 nova-api[1295]: 2017-09-28 12:30:30.561 1295 ERROR nova     max_url_len=max_url_len)
Sep 28 12:30:30 ctl02 nova-api[1295]: 2017-09-28 12:30:30.561 1295 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:30:30 ctl02 nova-api[1295]: 2017-09-28 12:30:30.561 1295 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:30:30 ctl02 nova-api[1295]: 2017-09-28 12:30:30.561 1295 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:30:30 ctl02 nova-api[1295]: 2017-09-28 12:30:30.561 1295 ERROR nova     sock.listen(backlog)
Sep 28 12:30:30 ctl02 nova-api[1295]: 2017-09-28 12:30:30.561 1295 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:30:30 ctl02 nova-api[1295]: 2017-09-28 12:30:30.561 1295 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:30:30 ctl02 nova-api[1295]: 2017-09-28 12:30:30.561 1295 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:30:30 ctl02 nova-api[1295]: 2017-09-28 12:30:30.561 1295 ERROR nova
Sep 28 12:30:30 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd3bedb01)
Sep 28 12:30:30 ctl02 neutron-server[30536]: 2017-09-28 12:30:30.689 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:30:30] "OPTIONS / HTTP/1.0" 200 262 0.000577
Sep 28 12:30:30 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:30:30 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:30:30 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:30:30 ctl02 nova-conductor[5056]: 2017-09-28 12:30:30.743 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:30:30 ctl02 nova-conductor[5056]: 2017-09-28 12:30:30.760 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:30:30 ctl02 nova-conductor[5056]: 2017-09-28 12:30:30.769 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:30:30 ctl02 nova-conductor[5056]: 2017-09-28 12:30:30.777 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:30:30 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:30:30 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:30:30 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:30:30 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:30:30 ctl02 glance-api[29183]: 2017-09-28 12:30:30.923 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:30:30] "OPTIONS / HTTP/1.0" 200 134 0.000965
Sep 28 12:30:31 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd3bedb01)
Sep 28 12:30:32 ctl02 nova-api[1312]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:30:32 ctl02 nova-api[1312]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:30:32 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd3bedb01)
Sep 28 12:30:32 ctl02 nova-api[1312]: 2017-09-28 12:30:32.763 1312 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:30:32 ctl02 nova-api[1312]: 2017-09-28 12:30:32.765 1312 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:30:32 ctl02 nova-api[1312]: 2017-09-28 12:30:32.765 1312 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:30:32 ctl02 nova-api[1312]: 2017-09-28 12:30:32.765 1312 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:30:32 ctl02 nova-api[1312]: 2017-09-28 12:30:32.765 1312 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:30:32 ctl02 nova-api[1312]: 2017-09-28 12:30:32.765 1312 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:30:32 ctl02 nova-api[1312]: 2017-09-28 12:30:32.765 1312 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:30:32 ctl02 nova-api[1312]: 2017-09-28 12:30:32.765 1312 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:30:32 ctl02 nova-api[1312]: 2017-09-28 12:30:32.765 1312 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:30:32 ctl02 nova-api[1312]: 2017-09-28 12:30:32.765 1312 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:30:32 ctl02 nova-api[1312]: 2017-09-28 12:30:32.765 1312 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:30:32 ctl02 nova-api[1312]: 2017-09-28 12:30:32.765 1312 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:30:32 ctl02 nova-api[1312]: 2017-09-28 12:30:32.765 1312 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:30:32 ctl02 nova-api[1312]: 2017-09-28 12:30:32.765 1312 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:30:32 ctl02 nova-api[1312]: 2017-09-28 12:30:32.765 1312 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:30:32 ctl02 nova-api[1312]: 2017-09-28 12:30:32.765 1312 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:30:32 ctl02 nova-api[1312]: 2017-09-28 12:30:32.765 1312 ERROR nova.wsgi     self.filename))
Sep 28 12:30:32 ctl02 nova-api[1312]: 2017-09-28 12:30:32.765 1312 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:30:32 ctl02 nova-api[1312]: 2017-09-28 12:30:32.765 1312 ERROR nova.wsgi
Sep 28 12:30:32 ctl02 nova-api[1312]: 2017-09-28 12:30:32.766 1312 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:30:32 ctl02 neutron-server[30536]: 2017-09-28 12:30:32.779 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:30:32] "OPTIONS / HTTP/1.0" 200 262 0.000563
Sep 28 12:30:32 ctl02 nova-api[1312]: 2017-09-28 12:30:32.903 1312 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:30:33 ctl02 nova-api[1312]: 2017-09-28 12:30:33.158 1312 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:30:33 ctl02 nova-api[1312]: 2017-09-28 12:30:33.160 1312 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:30:33 ctl02 nova-api[1312]: 2017-09-28 12:30:33.161 1312 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:30:33 ctl02 nova-api[1312]: 2017-09-28 12:30:33.161 1312 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:30:33 ctl02 nova-api[1312]: 2017-09-28 12:30:33.293 1312 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:30:33 ctl02 nova-api[1312]: 2017-09-28 12:30:33.295 1312 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:30:33 ctl02 nova-api[1312]: 2017-09-28 12:30:33.295 1312 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:30:33 ctl02 nova-api[1312]: 2017-09-28 12:30:33.296 1312 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:30:33 ctl02 nova-api[1312]: 2017-09-28 12:30:33.299 1312 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:30:33 ctl02 nova-api[1312]: 2017-09-28 12:30:33.299 1312 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:30:33 ctl02 nova-api[1312]: 2017-09-28 12:30:33.299 1312 ERROR nova Traceback (most recent call last):
Sep 28 12:30:33 ctl02 nova-api[1312]: 2017-09-28 12:30:33.299 1312 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:30:33 ctl02 nova-api[1312]: 2017-09-28 12:30:33.299 1312 ERROR nova     sys.exit(main())
Sep 28 12:30:33 ctl02 nova-api[1312]: 2017-09-28 12:30:33.299 1312 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:30:33 ctl02 nova-api[1312]: 2017-09-28 12:30:33.299 1312 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:30:33 ctl02 nova-api[1312]: 2017-09-28 12:30:33.299 1312 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:30:33 ctl02 nova-api[1312]: 2017-09-28 12:30:33.299 1312 ERROR nova     max_url_len=max_url_len)
Sep 28 12:30:33 ctl02 nova-api[1312]: 2017-09-28 12:30:33.299 1312 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:30:33 ctl02 nova-api[1312]: 2017-09-28 12:30:33.299 1312 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:30:33 ctl02 nova-api[1312]: 2017-09-28 12:30:33.299 1312 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:30:33 ctl02 nova-api[1312]: 2017-09-28 12:30:33.299 1312 ERROR nova     sock.listen(backlog)
Sep 28 12:30:33 ctl02 nova-api[1312]: 2017-09-28 12:30:33.299 1312 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:30:33 ctl02 nova-api[1312]: 2017-09-28 12:30:33.299 1312 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:30:33 ctl02 nova-api[1312]: 2017-09-28 12:30:33.299 1312 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:30:33 ctl02 nova-api[1312]: 2017-09-28 12:30:33.299 1312 ERROR nova
Sep 28 12:30:33 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:30:33 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:30:33 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:30:33 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:30:33 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:30:33 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:30:33 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:30:33 ctl02 glance-api[29183]: 2017-09-28 12:30:33.636 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:30:33] "OPTIONS / HTTP/1.0" 200 134 0.000755
Sep 28 12:30:33 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:30:33 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:30:33 ctl02 glance-api[29183]: 2017-09-28 12:30:33.881 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:30:33] "OPTIONS / HTTP/1.0" 200 134 0.000634
Sep 28 12:30:34 ctl02 heat-api[13008]: 2017-09-28 12:30:34.993 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:30:34] "OPTIONS / HTTP/1.0" 200 134 0.000680
Sep 28 12:30:35 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:30:34.999 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:30:34] "OPTIONS / HTTP/1.0" 200 134 0.000485
Sep 28 12:30:35 ctl02 nova-api[1336]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:30:35 ctl02 nova-api[1336]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:30:35 ctl02 nova-api[1336]: 2017-09-28 12:30:35.519 1336 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:30:35 ctl02 nova-api[1336]: 2017-09-28 12:30:35.520 1336 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:30:35 ctl02 nova-api[1336]: 2017-09-28 12:30:35.520 1336 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:30:35 ctl02 nova-api[1336]: 2017-09-28 12:30:35.520 1336 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:30:35 ctl02 nova-api[1336]: 2017-09-28 12:30:35.520 1336 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:30:35 ctl02 nova-api[1336]: 2017-09-28 12:30:35.520 1336 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:30:35 ctl02 nova-api[1336]: 2017-09-28 12:30:35.520 1336 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:30:35 ctl02 nova-api[1336]: 2017-09-28 12:30:35.520 1336 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:30:35 ctl02 nova-api[1336]: 2017-09-28 12:30:35.520 1336 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:30:35 ctl02 nova-api[1336]: 2017-09-28 12:30:35.520 1336 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:30:35 ctl02 nova-api[1336]: 2017-09-28 12:30:35.520 1336 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:30:35 ctl02 nova-api[1336]: 2017-09-28 12:30:35.520 1336 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:30:35 ctl02 nova-api[1336]: 2017-09-28 12:30:35.520 1336 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:30:35 ctl02 nova-api[1336]: 2017-09-28 12:30:35.520 1336 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:30:35 ctl02 nova-api[1336]: 2017-09-28 12:30:35.520 1336 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:30:35 ctl02 nova-api[1336]: 2017-09-28 12:30:35.520 1336 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:30:35 ctl02 nova-api[1336]: 2017-09-28 12:30:35.520 1336 ERROR nova.wsgi     self.filename))
Sep 28 12:30:35 ctl02 nova-api[1336]: 2017-09-28 12:30:35.520 1336 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:30:35 ctl02 nova-api[1336]: 2017-09-28 12:30:35.520 1336 ERROR nova.wsgi
Sep 28 12:30:35 ctl02 nova-api[1336]: 2017-09-28 12:30:35.521 1336 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:30:35 ctl02 nova-api[1336]: 2017-09-28 12:30:35.654 1336 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:30:35 ctl02 nova-api[1336]: 2017-09-28 12:30:35.904 1336 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:30:35 ctl02 nova-api[1336]: 2017-09-28 12:30:35.907 1336 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:30:35 ctl02 nova-api[1336]: 2017-09-28 12:30:35.907 1336 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:30:35 ctl02 nova-api[1336]: 2017-09-28 12:30:35.907 1336 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:30:36 ctl02 nova-api[1336]: 2017-09-28 12:30:36.040 1336 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:30:36 ctl02 nova-api[1336]: 2017-09-28 12:30:36.042 1336 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:30:36 ctl02 nova-api[1336]: 2017-09-28 12:30:36.042 1336 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:30:36 ctl02 nova-api[1336]: 2017-09-28 12:30:36.043 1336 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:30:36 ctl02 nova-api[1336]: 2017-09-28 12:30:36.046 1336 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:30:36 ctl02 nova-api[1336]: 2017-09-28 12:30:36.046 1336 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:30:36 ctl02 nova-api[1336]: 2017-09-28 12:30:36.046 1336 ERROR nova Traceback (most recent call last):
Sep 28 12:30:36 ctl02 nova-api[1336]: 2017-09-28 12:30:36.046 1336 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:30:36 ctl02 nova-api[1336]: 2017-09-28 12:30:36.046 1336 ERROR nova     sys.exit(main())
Sep 28 12:30:36 ctl02 nova-api[1336]: 2017-09-28 12:30:36.046 1336 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:30:36 ctl02 nova-api[1336]: 2017-09-28 12:30:36.046 1336 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:30:36 ctl02 nova-api[1336]: 2017-09-28 12:30:36.046 1336 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:30:36 ctl02 nova-api[1336]: 2017-09-28 12:30:36.046 1336 ERROR nova     max_url_len=max_url_len)
Sep 28 12:30:36 ctl02 nova-api[1336]: 2017-09-28 12:30:36.046 1336 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:30:36 ctl02 nova-api[1336]: 2017-09-28 12:30:36.046 1336 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:30:36 ctl02 nova-api[1336]: 2017-09-28 12:30:36.046 1336 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:30:36 ctl02 nova-api[1336]: 2017-09-28 12:30:36.046 1336 ERROR nova     sock.listen(backlog)
Sep 28 12:30:36 ctl02 nova-api[1336]: 2017-09-28 12:30:36.046 1336 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:30:36 ctl02 nova-api[1336]: 2017-09-28 12:30:36.046 1336 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:30:36 ctl02 nova-api[1336]: 2017-09-28 12:30:36.046 1336 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:30:36 ctl02 nova-api[1336]: 2017-09-28 12:30:36.046 1336 ERROR nova
Sep 28 12:30:36 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:30:36 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:30:36 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:30:36 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:30:36 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:30:36 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:30:36 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:30:36 ctl02 neutron-server[30536]: 2017-09-28 12:30:36.411 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 2 dead agents out of 6:
Sep 28 12:30:36 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:30:36 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:23:57 cmp001
Sep 28 12:30:36 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:30:06 cmp002
Sep 28 12:30:36 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:30:36.565 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:30:36] "OPTIONS / HTTP/1.0" 200 134 0.000467
Sep 28 12:30:36 ctl02 heat-api[13008]: 2017-09-28 12:30:36.643 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:30:36] "OPTIONS / HTTP/1.0" 200 134 0.000629
Sep 28 12:30:37 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:30:37.164 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:30:37] "OPTIONS / HTTP/1.0" 200 134 0.000450
Sep 28 12:30:38 ctl02 nova-api[1353]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:30:38 ctl02 nova-api[1353]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:30:38 ctl02 nova-api[1353]: 2017-09-28 12:30:38.278 1353 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:30:38 ctl02 nova-api[1353]: 2017-09-28 12:30:38.279 1353 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:30:38 ctl02 nova-api[1353]: 2017-09-28 12:30:38.279 1353 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:30:38 ctl02 nova-api[1353]: 2017-09-28 12:30:38.279 1353 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:30:38 ctl02 nova-api[1353]: 2017-09-28 12:30:38.279 1353 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:30:38 ctl02 nova-api[1353]: 2017-09-28 12:30:38.279 1353 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:30:38 ctl02 nova-api[1353]: 2017-09-28 12:30:38.279 1353 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:30:38 ctl02 nova-api[1353]: 2017-09-28 12:30:38.279 1353 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:30:38 ctl02 nova-api[1353]: 2017-09-28 12:30:38.279 1353 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:30:38 ctl02 nova-api[1353]: 2017-09-28 12:30:38.279 1353 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:30:38 ctl02 nova-api[1353]: 2017-09-28 12:30:38.279 1353 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:30:38 ctl02 nova-api[1353]: 2017-09-28 12:30:38.279 1353 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:30:38 ctl02 nova-api[1353]: 2017-09-28 12:30:38.279 1353 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:30:38 ctl02 nova-api[1353]: 2017-09-28 12:30:38.279 1353 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:30:38 ctl02 nova-api[1353]: 2017-09-28 12:30:38.279 1353 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:30:38 ctl02 nova-api[1353]: 2017-09-28 12:30:38.279 1353 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:30:38 ctl02 nova-api[1353]: 2017-09-28 12:30:38.279 1353 ERROR nova.wsgi     self.filename))
Sep 28 12:30:38 ctl02 nova-api[1353]: 2017-09-28 12:30:38.279 1353 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:30:38 ctl02 nova-api[1353]: 2017-09-28 12:30:38.279 1353 ERROR nova.wsgi
Sep 28 12:30:38 ctl02 nova-api[1353]: 2017-09-28 12:30:38.280 1353 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:30:38 ctl02 heat-api-cfn[13300]: 2017-09-28 12:30:38.371 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:30:38] "OPTIONS / HTTP/1.0" 200 134 0.000569
Sep 28 12:30:38 ctl02 nova-api[1353]: 2017-09-28 12:30:38.415 1353 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:30:38 ctl02 heat-api[13008]: 2017-09-28 12:30:38.530 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:30:38] "OPTIONS / HTTP/1.0" 200 134 0.000679
Sep 28 12:30:38 ctl02 nova-api[1353]: 2017-09-28 12:30:38.662 1353 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:30:38 ctl02 nova-api[1353]: 2017-09-28 12:30:38.665 1353 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:30:38 ctl02 nova-api[1353]: 2017-09-28 12:30:38.665 1353 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:30:38 ctl02 nova-api[1353]: 2017-09-28 12:30:38.665 1353 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:30:38 ctl02 nova-api[1353]: 2017-09-28 12:30:38.798 1353 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:30:38 ctl02 nova-api[1353]: 2017-09-28 12:30:38.800 1353 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:30:38 ctl02 nova-api[1353]: 2017-09-28 12:30:38.800 1353 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:30:38 ctl02 nova-api[1353]: 2017-09-28 12:30:38.800 1353 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:30:38 ctl02 nova-api[1353]: 2017-09-28 12:30:38.803 1353 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:30:38 ctl02 nova-api[1353]: 2017-09-28 12:30:38.804 1353 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:30:38 ctl02 nova-api[1353]: 2017-09-28 12:30:38.804 1353 ERROR nova Traceback (most recent call last):
Sep 28 12:30:38 ctl02 nova-api[1353]: 2017-09-28 12:30:38.804 1353 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:30:38 ctl02 nova-api[1353]: 2017-09-28 12:30:38.804 1353 ERROR nova     sys.exit(main())
Sep 28 12:30:38 ctl02 nova-api[1353]: 2017-09-28 12:30:38.804 1353 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:30:38 ctl02 nova-api[1353]: 2017-09-28 12:30:38.804 1353 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:30:38 ctl02 nova-api[1353]: 2017-09-28 12:30:38.804 1353 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:30:38 ctl02 nova-api[1353]: 2017-09-28 12:30:38.804 1353 ERROR nova     max_url_len=max_url_len)
Sep 28 12:30:38 ctl02 nova-api[1353]: 2017-09-28 12:30:38.804 1353 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:30:38 ctl02 nova-api[1353]: 2017-09-28 12:30:38.804 1353 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:30:38 ctl02 nova-api[1353]: 2017-09-28 12:30:38.804 1353 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:30:38 ctl02 nova-api[1353]: 2017-09-28 12:30:38.804 1353 ERROR nova     sock.listen(backlog)
Sep 28 12:30:38 ctl02 nova-api[1353]: 2017-09-28 12:30:38.804 1353 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:30:38 ctl02 nova-api[1353]: 2017-09-28 12:30:38.804 1353 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:30:38 ctl02 nova-api[1353]: 2017-09-28 12:30:38.804 1353 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:30:38 ctl02 nova-api[1353]: 2017-09-28 12:30:38.804 1353 ERROR nova
Sep 28 12:30:38 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:30:38 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:30:38 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:30:39 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:30:39 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:30:39 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:30:39 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:30:39 ctl02 heat-api-cfn[13300]: 2017-09-28 12:30:39.484 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:30:39] "OPTIONS / HTTP/1.0" 200 134 0.000593
Sep 28 12:30:39 ctl02 neutron-server[30536]: 2017-09-28 12:30:39.563 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:30:39] "OPTIONS / HTTP/1.0" 200 262 0.000559
Sep 28 12:30:39 ctl02 nova-consoleauth[5433]: 2017-09-28 12:30:39.647 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:30:40 ctl02 heat-api-cfn[13300]: 2017-09-28 12:30:40.217 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:30:40] "OPTIONS / HTTP/1.0" 200 134 0.000572
Sep 28 12:30:40 ctl02 neutron-server[30536]: 2017-09-28 12:30:40.669 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:30:40] "OPTIONS / HTTP/1.0" 200 262 0.000466
Sep 28 12:30:40 ctl02 nova-api[1371]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:30:40 ctl02 nova-api[1371]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:30:40 ctl02 glance-api[29183]: 2017-09-28 12:30:40.984 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:30:40] "OPTIONS / HTTP/1.0" 200 134 0.000675
Sep 28 12:30:41 ctl02 nova-api[1371]: 2017-09-28 12:30:41.032 1371 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:30:41 ctl02 nova-api[1371]: 2017-09-28 12:30:41.033 1371 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:30:41 ctl02 nova-api[1371]: 2017-09-28 12:30:41.033 1371 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:30:41 ctl02 nova-api[1371]: 2017-09-28 12:30:41.033 1371 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:30:41 ctl02 nova-api[1371]: 2017-09-28 12:30:41.033 1371 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:30:41 ctl02 nova-api[1371]: 2017-09-28 12:30:41.033 1371 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:30:41 ctl02 nova-api[1371]: 2017-09-28 12:30:41.033 1371 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:30:41 ctl02 nova-api[1371]: 2017-09-28 12:30:41.033 1371 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:30:41 ctl02 nova-api[1371]: 2017-09-28 12:30:41.033 1371 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:30:41 ctl02 nova-api[1371]: 2017-09-28 12:30:41.033 1371 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:30:41 ctl02 nova-api[1371]: 2017-09-28 12:30:41.033 1371 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:30:41 ctl02 nova-api[1371]: 2017-09-28 12:30:41.033 1371 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:30:41 ctl02 nova-api[1371]: 2017-09-28 12:30:41.033 1371 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:30:41 ctl02 nova-api[1371]: 2017-09-28 12:30:41.033 1371 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:30:41 ctl02 nova-api[1371]: 2017-09-28 12:30:41.033 1371 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:30:41 ctl02 nova-api[1371]: 2017-09-28 12:30:41.033 1371 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:30:41 ctl02 nova-api[1371]: 2017-09-28 12:30:41.033 1371 ERROR nova.wsgi     self.filename))
Sep 28 12:30:41 ctl02 nova-api[1371]: 2017-09-28 12:30:41.033 1371 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:30:41 ctl02 nova-api[1371]: 2017-09-28 12:30:41.033 1371 ERROR nova.wsgi
Sep 28 12:30:41 ctl02 nova-api[1371]: 2017-09-28 12:30:41.034 1371 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:30:41 ctl02 nova-api[1371]: 2017-09-28 12:30:41.166 1371 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:30:41 ctl02 nova-api[1371]: 2017-09-28 12:30:41.416 1371 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:30:41 ctl02 nova-api[1371]: 2017-09-28 12:30:41.418 1371 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:30:41 ctl02 nova-api[1371]: 2017-09-28 12:30:41.419 1371 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:30:41 ctl02 nova-api[1371]: 2017-09-28 12:30:41.419 1371 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:30:41 ctl02 nova-api[1371]: 2017-09-28 12:30:41.550 1371 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:30:41 ctl02 nova-api[1371]: 2017-09-28 12:30:41.552 1371 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:30:41 ctl02 nova-api[1371]: 2017-09-28 12:30:41.552 1371 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:30:41 ctl02 nova-api[1371]: 2017-09-28 12:30:41.553 1371 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:30:41 ctl02 nova-api[1371]: 2017-09-28 12:30:41.556 1371 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:30:41 ctl02 nova-api[1371]: 2017-09-28 12:30:41.556 1371 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:30:41 ctl02 nova-api[1371]: 2017-09-28 12:30:41.556 1371 ERROR nova Traceback (most recent call last):
Sep 28 12:30:41 ctl02 nova-api[1371]: 2017-09-28 12:30:41.556 1371 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:30:41 ctl02 nova-api[1371]: 2017-09-28 12:30:41.556 1371 ERROR nova     sys.exit(main())
Sep 28 12:30:41 ctl02 nova-api[1371]: 2017-09-28 12:30:41.556 1371 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:30:41 ctl02 nova-api[1371]: 2017-09-28 12:30:41.556 1371 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:30:41 ctl02 nova-api[1371]: 2017-09-28 12:30:41.556 1371 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:30:41 ctl02 nova-api[1371]: 2017-09-28 12:30:41.556 1371 ERROR nova     max_url_len=max_url_len)
Sep 28 12:30:41 ctl02 nova-api[1371]: 2017-09-28 12:30:41.556 1371 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:30:41 ctl02 nova-api[1371]: 2017-09-28 12:30:41.556 1371 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:30:41 ctl02 nova-api[1371]: 2017-09-28 12:30:41.556 1371 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:30:41 ctl02 nova-api[1371]: 2017-09-28 12:30:41.556 1371 ERROR nova     sock.listen(backlog)
Sep 28 12:30:41 ctl02 nova-api[1371]: 2017-09-28 12:30:41.556 1371 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:30:41 ctl02 nova-api[1371]: 2017-09-28 12:30:41.556 1371 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:30:41 ctl02 nova-api[1371]: 2017-09-28 12:30:41.556 1371 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:30:41 ctl02 nova-api[1371]: 2017-09-28 12:30:41.556 1371 ERROR nova
Sep 28 12:30:41 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:30:41 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:30:41 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:30:41 ctl02 heat-engine[12803]: 2017-09-28 12:30:41.863 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:30:41 ctl02 heat-engine[12803]: 2017-09-28 12:30:41.870 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:30:41 ctl02 heat-engine[12803]: 2017-09-28 12:30:41.870 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:30:41 ctl02 heat-engine[12803]: 2017-09-28 12:30:41.874 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:30:41 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:30:41 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:30:41 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:30:41 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:30:42 ctl02 nova-scheduler[5620]: 2017-09-28 12:30:42.682 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:30:43 ctl02 neutron-server[30536]: 2017-09-28 12:30:43.081 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:30:43] "OPTIONS / HTTP/1.0" 200 262 0.000523
Sep 28 12:30:43 ctl02 nova-api[1390]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:30:43 ctl02 nova-api[1390]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:30:43 ctl02 glance-api[29183]: 2017-09-28 12:30:43.652 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:30:43] "OPTIONS / HTTP/1.0" 200 134 0.000567
Sep 28 12:30:43 ctl02 nova-api[1390]: 2017-09-28 12:30:43.738 1390 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:30:43 ctl02 nova-api[1390]: 2017-09-28 12:30:43.740 1390 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:30:43 ctl02 nova-api[1390]: 2017-09-28 12:30:43.740 1390 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:30:43 ctl02 nova-api[1390]: 2017-09-28 12:30:43.740 1390 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:30:43 ctl02 nova-api[1390]: 2017-09-28 12:30:43.740 1390 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:30:43 ctl02 nova-api[1390]: 2017-09-28 12:30:43.740 1390 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:30:43 ctl02 nova-api[1390]: 2017-09-28 12:30:43.740 1390 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:30:43 ctl02 nova-api[1390]: 2017-09-28 12:30:43.740 1390 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:30:43 ctl02 nova-api[1390]: 2017-09-28 12:30:43.740 1390 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:30:43 ctl02 nova-api[1390]: 2017-09-28 12:30:43.740 1390 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:30:43 ctl02 nova-api[1390]: 2017-09-28 12:30:43.740 1390 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:30:43 ctl02 nova-api[1390]: 2017-09-28 12:30:43.740 1390 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:30:43 ctl02 nova-api[1390]: 2017-09-28 12:30:43.740 1390 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:30:43 ctl02 nova-api[1390]: 2017-09-28 12:30:43.740 1390 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:30:43 ctl02 nova-api[1390]: 2017-09-28 12:30:43.740 1390 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:30:43 ctl02 nova-api[1390]: 2017-09-28 12:30:43.740 1390 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:30:43 ctl02 nova-api[1390]: 2017-09-28 12:30:43.740 1390 ERROR nova.wsgi     self.filename))
Sep 28 12:30:43 ctl02 nova-api[1390]: 2017-09-28 12:30:43.740 1390 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:30:43 ctl02 nova-api[1390]: 2017-09-28 12:30:43.740 1390 ERROR nova.wsgi
Sep 28 12:30:43 ctl02 nova-api[1390]: 2017-09-28 12:30:43.741 1390 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:30:43 ctl02 nova-api[1390]: 2017-09-28 12:30:43.868 1390 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:30:44 ctl02 glance-api[29183]: 2017-09-28 12:30:44.063 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:30:44] "OPTIONS / HTTP/1.0" 200 134 0.000610
Sep 28 12:30:44 ctl02 nova-api[1390]: 2017-09-28 12:30:44.096 1390 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:30:44 ctl02 nova-api[1390]: 2017-09-28 12:30:44.099 1390 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:30:44 ctl02 nova-api[1390]: 2017-09-28 12:30:44.099 1390 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:30:44 ctl02 nova-api[1390]: 2017-09-28 12:30:44.099 1390 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:30:44 ctl02 nova-api[1390]: 2017-09-28 12:30:44.226 1390 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:30:44 ctl02 nova-api[1390]: 2017-09-28 12:30:44.228 1390 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:30:44 ctl02 nova-api[1390]: 2017-09-28 12:30:44.228 1390 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:30:44 ctl02 nova-api[1390]: 2017-09-28 12:30:44.229 1390 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:30:44 ctl02 nova-api[1390]: 2017-09-28 12:30:44.232 1390 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:30:44 ctl02 nova-api[1390]: 2017-09-28 12:30:44.232 1390 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:30:44 ctl02 nova-api[1390]: 2017-09-28 12:30:44.232 1390 ERROR nova Traceback (most recent call last):
Sep 28 12:30:44 ctl02 nova-api[1390]: 2017-09-28 12:30:44.232 1390 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:30:44 ctl02 nova-api[1390]: 2017-09-28 12:30:44.232 1390 ERROR nova     sys.exit(main())
Sep 28 12:30:44 ctl02 nova-api[1390]: 2017-09-28 12:30:44.232 1390 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:30:44 ctl02 nova-api[1390]: 2017-09-28 12:30:44.232 1390 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:30:44 ctl02 nova-api[1390]: 2017-09-28 12:30:44.232 1390 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:30:44 ctl02 nova-api[1390]: 2017-09-28 12:30:44.232 1390 ERROR nova     max_url_len=max_url_len)
Sep 28 12:30:44 ctl02 nova-api[1390]: 2017-09-28 12:30:44.232 1390 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:30:44 ctl02 nova-api[1390]: 2017-09-28 12:30:44.232 1390 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:30:44 ctl02 nova-api[1390]: 2017-09-28 12:30:44.232 1390 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:30:44 ctl02 nova-api[1390]: 2017-09-28 12:30:44.232 1390 ERROR nova     sock.listen(backlog)
Sep 28 12:30:44 ctl02 nova-api[1390]: 2017-09-28 12:30:44.232 1390 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:30:44 ctl02 nova-api[1390]: 2017-09-28 12:30:44.232 1390 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:30:44 ctl02 nova-api[1390]: 2017-09-28 12:30:44.232 1390 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:30:44 ctl02 nova-api[1390]: 2017-09-28 12:30:44.232 1390 ERROR nova
Sep 28 12:30:44 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:30:44 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:30:44 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:30:44 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:30:44 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:30:44 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:30:44 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:30:45 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:30:45.107 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:30:45] "OPTIONS / HTTP/1.0" 200 134 0.000504
Sep 28 12:30:45 ctl02 heat-api[13008]: 2017-09-28 12:30:45.330 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:30:45] "OPTIONS / HTTP/1.0" 200 134 0.000626
Sep 28 12:30:46 ctl02 nova-api[1408]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:30:46 ctl02 nova-api[1408]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:30:46 ctl02 nova-api[1408]: 2017-09-28 12:30:46.523 1408 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:30:46 ctl02 nova-api[1408]: 2017-09-28 12:30:46.525 1408 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:30:46 ctl02 nova-api[1408]: 2017-09-28 12:30:46.525 1408 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:30:46 ctl02 nova-api[1408]: 2017-09-28 12:30:46.525 1408 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:30:46 ctl02 nova-api[1408]: 2017-09-28 12:30:46.525 1408 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:30:46 ctl02 nova-api[1408]: 2017-09-28 12:30:46.525 1408 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:30:46 ctl02 nova-api[1408]: 2017-09-28 12:30:46.525 1408 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:30:46 ctl02 nova-api[1408]: 2017-09-28 12:30:46.525 1408 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:30:46 ctl02 nova-api[1408]: 2017-09-28 12:30:46.525 1408 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:30:46 ctl02 nova-api[1408]: 2017-09-28 12:30:46.525 1408 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:30:46 ctl02 nova-api[1408]: 2017-09-28 12:30:46.525 1408 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:30:46 ctl02 nova-api[1408]: 2017-09-28 12:30:46.525 1408 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:30:46 ctl02 nova-api[1408]: 2017-09-28 12:30:46.525 1408 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:30:46 ctl02 nova-api[1408]: 2017-09-28 12:30:46.525 1408 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:30:46 ctl02 nova-api[1408]: 2017-09-28 12:30:46.525 1408 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:30:46 ctl02 nova-api[1408]: 2017-09-28 12:30:46.525 1408 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:30:46 ctl02 nova-api[1408]: 2017-09-28 12:30:46.525 1408 ERROR nova.wsgi     self.filename))
Sep 28 12:30:46 ctl02 nova-api[1408]: 2017-09-28 12:30:46.525 1408 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:30:46 ctl02 nova-api[1408]: 2017-09-28 12:30:46.525 1408 ERROR nova.wsgi
Sep 28 12:30:46 ctl02 nova-api[1408]: 2017-09-28 12:30:46.526 1408 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:30:46 ctl02 heat-api[13008]: 2017-09-28 12:30:46.599 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:30:46] "OPTIONS / HTTP/1.0" 200 134 0.000645
Sep 28 12:30:46 ctl02 nova-api[1408]: 2017-09-28 12:30:46.659 1408 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:30:46 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:30:46.794 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:30:46] "OPTIONS / HTTP/1.0" 200 134 0.000482
Sep 28 12:30:46 ctl02 nova-api[1408]: 2017-09-28 12:30:46.927 1408 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:30:46 ctl02 nova-api[1408]: 2017-09-28 12:30:46.929 1408 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:30:46 ctl02 nova-api[1408]: 2017-09-28 12:30:46.929 1408 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:30:46 ctl02 nova-api[1408]: 2017-09-28 12:30:46.930 1408 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:30:47 ctl02 nova-api[1408]: 2017-09-28 12:30:47.063 1408 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:30:47 ctl02 nova-api[1408]: 2017-09-28 12:30:47.065 1408 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:30:47 ctl02 nova-api[1408]: 2017-09-28 12:30:47.065 1408 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:30:47 ctl02 nova-api[1408]: 2017-09-28 12:30:47.065 1408 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:30:47 ctl02 nova-api[1408]: 2017-09-28 12:30:47.069 1408 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:30:47 ctl02 nova-api[1408]: 2017-09-28 12:30:47.069 1408 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:30:47 ctl02 nova-api[1408]: 2017-09-28 12:30:47.069 1408 ERROR nova Traceback (most recent call last):
Sep 28 12:30:47 ctl02 nova-api[1408]: 2017-09-28 12:30:47.069 1408 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:30:47 ctl02 nova-api[1408]: 2017-09-28 12:30:47.069 1408 ERROR nova     sys.exit(main())
Sep 28 12:30:47 ctl02 nova-api[1408]: 2017-09-28 12:30:47.069 1408 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:30:47 ctl02 nova-api[1408]: 2017-09-28 12:30:47.069 1408 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:30:47 ctl02 nova-api[1408]: 2017-09-28 12:30:47.069 1408 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:30:47 ctl02 nova-api[1408]: 2017-09-28 12:30:47.069 1408 ERROR nova     max_url_len=max_url_len)
Sep 28 12:30:47 ctl02 nova-api[1408]: 2017-09-28 12:30:47.069 1408 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:30:47 ctl02 nova-api[1408]: 2017-09-28 12:30:47.069 1408 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:30:47 ctl02 nova-api[1408]: 2017-09-28 12:30:47.069 1408 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:30:47 ctl02 nova-api[1408]: 2017-09-28 12:30:47.069 1408 ERROR nova     sock.listen(backlog)
Sep 28 12:30:47 ctl02 nova-api[1408]: 2017-09-28 12:30:47.069 1408 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:30:47 ctl02 nova-api[1408]: 2017-09-28 12:30:47.069 1408 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:30:47 ctl02 nova-api[1408]: 2017-09-28 12:30:47.069 1408 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:30:47 ctl02 nova-api[1408]: 2017-09-28 12:30:47.069 1408 ERROR nova
Sep 28 12:30:47 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:30:47 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:30:47 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:30:47 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:30:47.244 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:30:47] "OPTIONS / HTTP/1.0" 200 134 0.000456
Sep 28 12:30:47 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:30:47 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:30:47 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:30:47 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:30:48 ctl02 heat-api[13008]: 2017-09-28 12:30:48.499 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:30:48] "OPTIONS / HTTP/1.0" 200 134 0.000615
Sep 28 12:30:48 ctl02 heat-api-cfn[13300]: 2017-09-28 12:30:48.515 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:30:48] "OPTIONS / HTTP/1.0" 200 134 0.000490
Sep 28 12:30:49 ctl02 nova-api[1425]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:30:49 ctl02 nova-api[1425]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:30:49 ctl02 heat-api-cfn[13300]: 2017-09-28 12:30:49.243 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:30:49] "OPTIONS / HTTP/1.0" 200 134 0.000499
Sep 28 12:30:49 ctl02 nova-api[1425]: 2017-09-28 12:30:49.291 1425 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:30:49 ctl02 nova-api[1425]: 2017-09-28 12:30:49.293 1425 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:30:49 ctl02 nova-api[1425]: 2017-09-28 12:30:49.293 1425 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:30:49 ctl02 nova-api[1425]: 2017-09-28 12:30:49.293 1425 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:30:49 ctl02 nova-api[1425]: 2017-09-28 12:30:49.293 1425 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:30:49 ctl02 nova-api[1425]: 2017-09-28 12:30:49.293 1425 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:30:49 ctl02 nova-api[1425]: 2017-09-28 12:30:49.293 1425 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:30:49 ctl02 nova-api[1425]: 2017-09-28 12:30:49.293 1425 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:30:49 ctl02 nova-api[1425]: 2017-09-28 12:30:49.293 1425 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:30:49 ctl02 nova-api[1425]: 2017-09-28 12:30:49.293 1425 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:30:49 ctl02 nova-api[1425]: 2017-09-28 12:30:49.293 1425 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:30:49 ctl02 nova-api[1425]: 2017-09-28 12:30:49.293 1425 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:30:49 ctl02 nova-api[1425]: 2017-09-28 12:30:49.293 1425 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:30:49 ctl02 nova-api[1425]: 2017-09-28 12:30:49.293 1425 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:30:49 ctl02 nova-api[1425]: 2017-09-28 12:30:49.293 1425 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:30:49 ctl02 nova-api[1425]: 2017-09-28 12:30:49.293 1425 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:30:49 ctl02 nova-api[1425]: 2017-09-28 12:30:49.293 1425 ERROR nova.wsgi     self.filename))
Sep 28 12:30:49 ctl02 nova-api[1425]: 2017-09-28 12:30:49.293 1425 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:30:49 ctl02 nova-api[1425]: 2017-09-28 12:30:49.293 1425 ERROR nova.wsgi
Sep 28 12:30:49 ctl02 nova-api[1425]: 2017-09-28 12:30:49.294 1425 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:30:49 ctl02 neutron-server[30536]: 2017-09-28 12:30:49.297 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:30:49] "OPTIONS / HTTP/1.0" 200 262 0.000583
Sep 28 12:30:49 ctl02 nova-api[1425]: 2017-09-28 12:30:49.430 1425 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:30:49 ctl02 nova-api[1425]: 2017-09-28 12:30:49.682 1425 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:30:49 ctl02 nova-api[1425]: 2017-09-28 12:30:49.685 1425 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:30:49 ctl02 nova-api[1425]: 2017-09-28 12:30:49.685 1425 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:30:49 ctl02 nova-api[1425]: 2017-09-28 12:30:49.685 1425 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:30:49 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf772a48)
Sep 28 12:30:49 ctl02 nova-api[1425]: 2017-09-28 12:30:49.821 1425 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:30:49 ctl02 nova-api[1425]: 2017-09-28 12:30:49.824 1425 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:30:49 ctl02 nova-api[1425]: 2017-09-28 12:30:49.824 1425 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:30:49 ctl02 nova-api[1425]: 2017-09-28 12:30:49.825 1425 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:30:49 ctl02 nova-api[1425]: 2017-09-28 12:30:49.828 1425 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:30:49 ctl02 nova-api[1425]: 2017-09-28 12:30:49.829 1425 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:30:49 ctl02 nova-api[1425]: 2017-09-28 12:30:49.829 1425 ERROR nova Traceback (most recent call last):
Sep 28 12:30:49 ctl02 nova-api[1425]: 2017-09-28 12:30:49.829 1425 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:30:49 ctl02 nova-api[1425]: 2017-09-28 12:30:49.829 1425 ERROR nova     sys.exit(main())
Sep 28 12:30:49 ctl02 nova-api[1425]: 2017-09-28 12:30:49.829 1425 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:30:49 ctl02 nova-api[1425]: 2017-09-28 12:30:49.829 1425 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:30:49 ctl02 nova-api[1425]: 2017-09-28 12:30:49.829 1425 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:30:49 ctl02 nova-api[1425]: 2017-09-28 12:30:49.829 1425 ERROR nova     max_url_len=max_url_len)
Sep 28 12:30:49 ctl02 nova-api[1425]: 2017-09-28 12:30:49.829 1425 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:30:49 ctl02 nova-api[1425]: 2017-09-28 12:30:49.829 1425 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:30:49 ctl02 nova-api[1425]: 2017-09-28 12:30:49.829 1425 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:30:49 ctl02 nova-api[1425]: 2017-09-28 12:30:49.829 1425 ERROR nova     sock.listen(backlog)
Sep 28 12:30:49 ctl02 nova-api[1425]: 2017-09-28 12:30:49.829 1425 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:30:49 ctl02 nova-api[1425]: 2017-09-28 12:30:49.829 1425 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:30:49 ctl02 nova-api[1425]: 2017-09-28 12:30:49.829 1425 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:30:49 ctl02 nova-api[1425]: 2017-09-28 12:30:49.829 1425 ERROR nova
Sep 28 12:30:49 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:30:49 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:30:49 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:30:50 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:30:50 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:30:50 ctl02 heat-api-cfn[13300]: 2017-09-28 12:30:50.145 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:30:50] "OPTIONS / HTTP/1.0" 200 134 0.000566
Sep 28 12:30:50 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:30:50 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:30:50 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf772a48)
Sep 28 12:30:51 ctl02 neutron-server[30536]: 2017-09-28 12:30:51.019 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:30:51] "OPTIONS / HTTP/1.0" 200 262 0.000460
Sep 28 12:30:51 ctl02 glance-api[29183]: 2017-09-28 12:30:51.270 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:30:51] "OPTIONS / HTTP/1.0" 200 134 0.000554
Sep 28 12:30:51 ctl02 neutron-server[30536]: 2017-09-28 12:30:51.406 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 12:30:51 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:30:51 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:30:08 cmp002
Sep 28 12:30:51 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:23:57 cmp001
Sep 28 12:30:51 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:30:06 cmp002
Sep 28 12:30:51 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf772a48)
Sep 28 12:30:51 ctl02 nova-api[1444]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:30:51 ctl02 nova-api[1444]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:30:52 ctl02 nova-api[1444]: 2017-09-28 12:30:52.003 1444 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:30:52 ctl02 nova-api[1444]: 2017-09-28 12:30:52.004 1444 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:30:52 ctl02 nova-api[1444]: 2017-09-28 12:30:52.004 1444 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:30:52 ctl02 nova-api[1444]: 2017-09-28 12:30:52.004 1444 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:30:52 ctl02 nova-api[1444]: 2017-09-28 12:30:52.004 1444 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:30:52 ctl02 nova-api[1444]: 2017-09-28 12:30:52.004 1444 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:30:52 ctl02 nova-api[1444]: 2017-09-28 12:30:52.004 1444 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:30:52 ctl02 nova-api[1444]: 2017-09-28 12:30:52.004 1444 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:30:52 ctl02 nova-api[1444]: 2017-09-28 12:30:52.004 1444 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:30:52 ctl02 nova-api[1444]: 2017-09-28 12:30:52.004 1444 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:30:52 ctl02 nova-api[1444]: 2017-09-28 12:30:52.004 1444 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:30:52 ctl02 nova-api[1444]: 2017-09-28 12:30:52.004 1444 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:30:52 ctl02 nova-api[1444]: 2017-09-28 12:30:52.004 1444 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:30:52 ctl02 nova-api[1444]: 2017-09-28 12:30:52.004 1444 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:30:52 ctl02 nova-api[1444]: 2017-09-28 12:30:52.004 1444 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:30:52 ctl02 nova-api[1444]: 2017-09-28 12:30:52.004 1444 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:30:52 ctl02 nova-api[1444]: 2017-09-28 12:30:52.004 1444 ERROR nova.wsgi     self.filename))
Sep 28 12:30:52 ctl02 nova-api[1444]: 2017-09-28 12:30:52.004 1444 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:30:52 ctl02 nova-api[1444]: 2017-09-28 12:30:52.004 1444 ERROR nova.wsgi
Sep 28 12:30:52 ctl02 nova-api[1444]: 2017-09-28 12:30:52.005 1444 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:30:52 ctl02 nova-api[1444]: 2017-09-28 12:30:52.134 1444 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:30:52 ctl02 nova-api[1444]: 2017-09-28 12:30:52.356 1444 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:30:52 ctl02 nova-api[1444]: 2017-09-28 12:30:52.358 1444 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:30:52 ctl02 nova-api[1444]: 2017-09-28 12:30:52.358 1444 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:30:52 ctl02 nova-api[1444]: 2017-09-28 12:30:52.359 1444 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:30:52 ctl02 nova-api[1444]: 2017-09-28 12:30:52.490 1444 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:30:52 ctl02 nova-api[1444]: 2017-09-28 12:30:52.492 1444 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:30:52 ctl02 nova-api[1444]: 2017-09-28 12:30:52.492 1444 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:30:52 ctl02 nova-api[1444]: 2017-09-28 12:30:52.493 1444 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:30:52 ctl02 nova-api[1444]: 2017-09-28 12:30:52.496 1444 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:30:52 ctl02 nova-api[1444]: 2017-09-28 12:30:52.496 1444 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:30:52 ctl02 nova-api[1444]: 2017-09-28 12:30:52.496 1444 ERROR nova Traceback (most recent call last):
Sep 28 12:30:52 ctl02 nova-api[1444]: 2017-09-28 12:30:52.496 1444 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:30:52 ctl02 nova-api[1444]: 2017-09-28 12:30:52.496 1444 ERROR nova     sys.exit(main())
Sep 28 12:30:52 ctl02 nova-api[1444]: 2017-09-28 12:30:52.496 1444 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:30:52 ctl02 nova-api[1444]: 2017-09-28 12:30:52.496 1444 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:30:52 ctl02 nova-api[1444]: 2017-09-28 12:30:52.496 1444 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:30:52 ctl02 nova-api[1444]: 2017-09-28 12:30:52.496 1444 ERROR nova     max_url_len=max_url_len)
Sep 28 12:30:52 ctl02 nova-api[1444]: 2017-09-28 12:30:52.496 1444 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:30:52 ctl02 nova-api[1444]: 2017-09-28 12:30:52.496 1444 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:30:52 ctl02 nova-api[1444]: 2017-09-28 12:30:52.496 1444 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:30:52 ctl02 nova-api[1444]: 2017-09-28 12:30:52.496 1444 ERROR nova     sock.listen(backlog)
Sep 28 12:30:52 ctl02 nova-api[1444]: 2017-09-28 12:30:52.496 1444 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:30:52 ctl02 nova-api[1444]: 2017-09-28 12:30:52.496 1444 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:30:52 ctl02 nova-api[1444]: 2017-09-28 12:30:52.496 1444 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:30:52 ctl02 nova-api[1444]: 2017-09-28 12:30:52.496 1444 ERROR nova
Sep 28 12:30:52 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:30:52 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:30:52 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:30:52 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf772a48)
Sep 28 12:30:52 ctl02 neutron-server[30536]: 2017-09-28 12:30:52.793 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:30:52] "OPTIONS / HTTP/1.0" 200 262 0.000608
Sep 28 12:30:52 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:30:52 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:30:52 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:30:52 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:30:53 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf772a48)
Sep 28 12:30:53 ctl02 glance-api[29183]: 2017-09-28 12:30:53.937 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:30:53] "OPTIONS / HTTP/1.0" 200 134 0.000683
Sep 28 12:30:54 ctl02 glance-api[29183]: 2017-09-28 12:30:54.026 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:30:54] "OPTIONS / HTTP/1.0" 200 134 0.000612
Sep 28 12:30:54 ctl02 nova-api[1461]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:30:54 ctl02 nova-api[1461]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:30:54 ctl02 nova-api[1461]: 2017-09-28 12:30:54.775 1461 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:30:54 ctl02 nova-api[1461]: 2017-09-28 12:30:54.777 1461 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:30:54 ctl02 nova-api[1461]: 2017-09-28 12:30:54.777 1461 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:30:54 ctl02 nova-api[1461]: 2017-09-28 12:30:54.777 1461 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:30:54 ctl02 nova-api[1461]: 2017-09-28 12:30:54.777 1461 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:30:54 ctl02 nova-api[1461]: 2017-09-28 12:30:54.777 1461 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:30:54 ctl02 nova-api[1461]: 2017-09-28 12:30:54.777 1461 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:30:54 ctl02 nova-api[1461]: 2017-09-28 12:30:54.777 1461 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:30:54 ctl02 nova-api[1461]: 2017-09-28 12:30:54.777 1461 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:30:54 ctl02 nova-api[1461]: 2017-09-28 12:30:54.777 1461 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:30:54 ctl02 nova-api[1461]: 2017-09-28 12:30:54.777 1461 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:30:54 ctl02 nova-api[1461]: 2017-09-28 12:30:54.777 1461 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:30:54 ctl02 nova-api[1461]: 2017-09-28 12:30:54.777 1461 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:30:54 ctl02 nova-api[1461]: 2017-09-28 12:30:54.777 1461 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:30:54 ctl02 nova-api[1461]: 2017-09-28 12:30:54.777 1461 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:30:54 ctl02 nova-api[1461]: 2017-09-28 12:30:54.777 1461 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:30:54 ctl02 nova-api[1461]: 2017-09-28 12:30:54.777 1461 ERROR nova.wsgi     self.filename))
Sep 28 12:30:54 ctl02 nova-api[1461]: 2017-09-28 12:30:54.777 1461 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:30:54 ctl02 nova-api[1461]: 2017-09-28 12:30:54.777 1461 ERROR nova.wsgi
Sep 28 12:30:54 ctl02 nova-api[1461]: 2017-09-28 12:30:54.778 1461 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:30:54 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf772a48)
Sep 28 12:30:54 ctl02 nova-api[1461]: 2017-09-28 12:30:54.907 1461 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:30:55 ctl02 nova-api[1461]: 2017-09-28 12:30:55.136 1461 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:30:55 ctl02 nova-api[1461]: 2017-09-28 12:30:55.138 1461 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:30:55 ctl02 nova-api[1461]: 2017-09-28 12:30:55.139 1461 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:30:55 ctl02 nova-api[1461]: 2017-09-28 12:30:55.139 1461 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:30:55 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:30:55.194 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:30:55] "OPTIONS / HTTP/1.0" 200 134 0.000539
Sep 28 12:30:55 ctl02 nova-api[1461]: 2017-09-28 12:30:55.270 1461 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:30:55 ctl02 nova-api[1461]: 2017-09-28 12:30:55.271 1461 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:30:55 ctl02 nova-api[1461]: 2017-09-28 12:30:55.272 1461 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:30:55 ctl02 nova-api[1461]: 2017-09-28 12:30:55.272 1461 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:30:55 ctl02 nova-api[1461]: 2017-09-28 12:30:55.275 1461 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:30:55 ctl02 nova-api[1461]: 2017-09-28 12:30:55.275 1461 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:30:55 ctl02 nova-api[1461]: 2017-09-28 12:30:55.275 1461 ERROR nova Traceback (most recent call last):
Sep 28 12:30:55 ctl02 nova-api[1461]: 2017-09-28 12:30:55.275 1461 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:30:55 ctl02 nova-api[1461]: 2017-09-28 12:30:55.275 1461 ERROR nova     sys.exit(main())
Sep 28 12:30:55 ctl02 nova-api[1461]: 2017-09-28 12:30:55.275 1461 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:30:55 ctl02 nova-api[1461]: 2017-09-28 12:30:55.275 1461 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:30:55 ctl02 nova-api[1461]: 2017-09-28 12:30:55.275 1461 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:30:55 ctl02 nova-api[1461]: 2017-09-28 12:30:55.275 1461 ERROR nova     max_url_len=max_url_len)
Sep 28 12:30:55 ctl02 nova-api[1461]: 2017-09-28 12:30:55.275 1461 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:30:55 ctl02 nova-api[1461]: 2017-09-28 12:30:55.275 1461 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:30:55 ctl02 nova-api[1461]: 2017-09-28 12:30:55.275 1461 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:30:55 ctl02 nova-api[1461]: 2017-09-28 12:30:55.275 1461 ERROR nova     sock.listen(backlog)
Sep 28 12:30:55 ctl02 nova-api[1461]: 2017-09-28 12:30:55.275 1461 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:30:55 ctl02 nova-api[1461]: 2017-09-28 12:30:55.275 1461 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:30:55 ctl02 nova-api[1461]: 2017-09-28 12:30:55.275 1461 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:30:55 ctl02 nova-api[1461]: 2017-09-28 12:30:55.275 1461 ERROR nova
Sep 28 12:30:55 ctl02 heat-api[13008]: 2017-09-28 12:30:55.312 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:30:55] "OPTIONS / HTTP/1.0" 200 134 0.000714
Sep 28 12:30:55 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:30:55 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:30:55 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:30:55 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:30:55 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:30:55 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:30:55 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:30:55 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf772a48)
Sep 28 12:30:56 ctl02 heat-api[13008]: 2017-09-28 12:30:56.624 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:30:56] "OPTIONS / HTTP/1.0" 200 134 0.000561
Sep 28 12:30:56 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf772a48)
Sep 28 12:30:56 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:30:56.972 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:30:56] "OPTIONS / HTTP/1.0" 200 134 0.000501
Sep 28 12:30:57 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:30:57.026 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:30:57] "OPTIONS / HTTP/1.0" 200 134 0.000325
Sep 28 12:30:57 ctl02 nova-api[1480]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:30:57 ctl02 nova-api[1480]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:30:57 ctl02 nova-api[1480]: 2017-09-28 12:30:57.534 1480 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:30:57 ctl02 nova-api[1480]: 2017-09-28 12:30:57.535 1480 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:30:57 ctl02 nova-api[1480]: 2017-09-28 12:30:57.535 1480 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:30:57 ctl02 nova-api[1480]: 2017-09-28 12:30:57.535 1480 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:30:57 ctl02 nova-api[1480]: 2017-09-28 12:30:57.535 1480 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:30:57 ctl02 nova-api[1480]: 2017-09-28 12:30:57.535 1480 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:30:57 ctl02 nova-api[1480]: 2017-09-28 12:30:57.535 1480 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:30:57 ctl02 nova-api[1480]: 2017-09-28 12:30:57.535 1480 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:30:57 ctl02 nova-api[1480]: 2017-09-28 12:30:57.535 1480 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:30:57 ctl02 nova-api[1480]: 2017-09-28 12:30:57.535 1480 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:30:57 ctl02 nova-api[1480]: 2017-09-28 12:30:57.535 1480 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:30:57 ctl02 nova-api[1480]: 2017-09-28 12:30:57.535 1480 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:30:57 ctl02 nova-api[1480]: 2017-09-28 12:30:57.535 1480 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:30:57 ctl02 nova-api[1480]: 2017-09-28 12:30:57.535 1480 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:30:57 ctl02 nova-api[1480]: 2017-09-28 12:30:57.535 1480 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:30:57 ctl02 nova-api[1480]: 2017-09-28 12:30:57.535 1480 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:30:57 ctl02 nova-api[1480]: 2017-09-28 12:30:57.535 1480 ERROR nova.wsgi     self.filename))
Sep 28 12:30:57 ctl02 nova-api[1480]: 2017-09-28 12:30:57.535 1480 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:30:57 ctl02 nova-api[1480]: 2017-09-28 12:30:57.535 1480 ERROR nova.wsgi
Sep 28 12:30:57 ctl02 nova-api[1480]: 2017-09-28 12:30:57.536 1480 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:30:57 ctl02 nova-api[1480]: 2017-09-28 12:30:57.665 1480 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:30:57 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf772a48)
Sep 28 12:30:57 ctl02 nova-api[1480]: 2017-09-28 12:30:57.912 1480 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:30:57 ctl02 nova-api[1480]: 2017-09-28 12:30:57.914 1480 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:30:57 ctl02 nova-api[1480]: 2017-09-28 12:30:57.915 1480 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:30:57 ctl02 nova-api[1480]: 2017-09-28 12:30:57.915 1480 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:30:58 ctl02 nova-api[1480]: 2017-09-28 12:30:58.047 1480 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:30:58 ctl02 nova-api[1480]: 2017-09-28 12:30:58.049 1480 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:30:58 ctl02 nova-api[1480]: 2017-09-28 12:30:58.049 1480 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:30:58 ctl02 nova-api[1480]: 2017-09-28 12:30:58.049 1480 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:30:58 ctl02 nova-api[1480]: 2017-09-28 12:30:58.053 1480 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:30:58 ctl02 nova-api[1480]: 2017-09-28 12:30:58.053 1480 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:30:58 ctl02 nova-api[1480]: 2017-09-28 12:30:58.053 1480 ERROR nova Traceback (most recent call last):
Sep 28 12:30:58 ctl02 nova-api[1480]: 2017-09-28 12:30:58.053 1480 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:30:58 ctl02 nova-api[1480]: 2017-09-28 12:30:58.053 1480 ERROR nova     sys.exit(main())
Sep 28 12:30:58 ctl02 nova-api[1480]: 2017-09-28 12:30:58.053 1480 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:30:58 ctl02 nova-api[1480]: 2017-09-28 12:30:58.053 1480 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:30:58 ctl02 nova-api[1480]: 2017-09-28 12:30:58.053 1480 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:30:58 ctl02 nova-api[1480]: 2017-09-28 12:30:58.053 1480 ERROR nova     max_url_len=max_url_len)
Sep 28 12:30:58 ctl02 nova-api[1480]: 2017-09-28 12:30:58.053 1480 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:30:58 ctl02 nova-api[1480]: 2017-09-28 12:30:58.053 1480 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:30:58 ctl02 nova-api[1480]: 2017-09-28 12:30:58.053 1480 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:30:58 ctl02 nova-api[1480]: 2017-09-28 12:30:58.053 1480 ERROR nova     sock.listen(backlog)
Sep 28 12:30:58 ctl02 nova-api[1480]: 2017-09-28 12:30:58.053 1480 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:30:58 ctl02 nova-api[1480]: 2017-09-28 12:30:58.053 1480 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:30:58 ctl02 nova-api[1480]: 2017-09-28 12:30:58.053 1480 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:30:58 ctl02 nova-api[1480]: 2017-09-28 12:30:58.053 1480 ERROR nova
Sep 28 12:30:58 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:30:58 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:30:58 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:30:58 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:30:58 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:30:58 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:30:58 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:30:58 ctl02 heat-api-cfn[13300]: 2017-09-28 12:30:58.480 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:30:58] "OPTIONS / HTTP/1.0" 200 134 0.000573
Sep 28 12:30:58 ctl02 heat-api[13008]: 2017-09-28 12:30:58.621 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:30:58] "OPTIONS / HTTP/1.0" 200 134 0.000531
Sep 28 12:30:58 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf772a48)
Sep 28 12:30:59 ctl02 heat-api-cfn[13300]: 2017-09-28 12:30:59.136 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:30:59] "OPTIONS / HTTP/1.0" 200 134 0.000465
Sep 28 12:30:59 ctl02 neutron-server[30536]: 2017-09-28 12:30:59.319 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:30:59] "OPTIONS / HTTP/1.0" 200 262 0.000439
Sep 28 12:30:59 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf772a48)
Sep 28 12:30:59 ctl02 heat-api-cfn[13300]: 2017-09-28 12:30:59.886 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:30:59] "OPTIONS / HTTP/1.0" 200 134 0.000455
Sep 28 12:31:00 ctl02 nova-api[1498]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:31:00 ctl02 nova-api[1498]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:31:00 ctl02 nova-api[1498]: 2017-09-28 12:31:00.237 1498 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:31:00 ctl02 nova-api[1498]: 2017-09-28 12:31:00.238 1498 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:31:00 ctl02 nova-api[1498]: 2017-09-28 12:31:00.238 1498 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:31:00 ctl02 nova-api[1498]: 2017-09-28 12:31:00.238 1498 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:31:00 ctl02 nova-api[1498]: 2017-09-28 12:31:00.238 1498 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:31:00 ctl02 nova-api[1498]: 2017-09-28 12:31:00.238 1498 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:31:00 ctl02 nova-api[1498]: 2017-09-28 12:31:00.238 1498 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:31:00 ctl02 nova-api[1498]: 2017-09-28 12:31:00.238 1498 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:31:00 ctl02 nova-api[1498]: 2017-09-28 12:31:00.238 1498 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:31:00 ctl02 nova-api[1498]: 2017-09-28 12:31:00.238 1498 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:31:00 ctl02 nova-api[1498]: 2017-09-28 12:31:00.238 1498 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:31:00 ctl02 nova-api[1498]: 2017-09-28 12:31:00.238 1498 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:31:00 ctl02 nova-api[1498]: 2017-09-28 12:31:00.238 1498 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:31:00 ctl02 nova-api[1498]: 2017-09-28 12:31:00.238 1498 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:31:00 ctl02 nova-api[1498]: 2017-09-28 12:31:00.238 1498 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:31:00 ctl02 nova-api[1498]: 2017-09-28 12:31:00.238 1498 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:31:00 ctl02 nova-api[1498]: 2017-09-28 12:31:00.238 1498 ERROR nova.wsgi     self.filename))
Sep 28 12:31:00 ctl02 nova-api[1498]: 2017-09-28 12:31:00.238 1498 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:31:00 ctl02 nova-api[1498]: 2017-09-28 12:31:00.238 1498 ERROR nova.wsgi
Sep 28 12:31:00 ctl02 nova-api[1498]: 2017-09-28 12:31:00.239 1498 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:31:00 ctl02 nova-api[1498]: 2017-09-28 12:31:00.366 1498 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:31:00 ctl02 nova-api[1498]: 2017-09-28 12:31:00.585 1498 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:31:00 ctl02 nova-api[1498]: 2017-09-28 12:31:00.588 1498 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:31:00 ctl02 nova-api[1498]: 2017-09-28 12:31:00.597 1498 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:31:00 ctl02 nova-api[1498]: 2017-09-28 12:31:00.597 1498 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:31:00 ctl02 nova-api[1498]: 2017-09-28 12:31:00.727 1498 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:31:00 ctl02 nova-api[1498]: 2017-09-28 12:31:00.729 1498 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:31:00 ctl02 nova-api[1498]: 2017-09-28 12:31:00.729 1498 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:31:00 ctl02 nova-api[1498]: 2017-09-28 12:31:00.729 1498 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:31:00 ctl02 nova-api[1498]: 2017-09-28 12:31:00.732 1498 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:31:00 ctl02 nova-api[1498]: 2017-09-28 12:31:00.733 1498 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:31:00 ctl02 nova-api[1498]: 2017-09-28 12:31:00.733 1498 ERROR nova Traceback (most recent call last):
Sep 28 12:31:00 ctl02 nova-api[1498]: 2017-09-28 12:31:00.733 1498 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:31:00 ctl02 nova-api[1498]: 2017-09-28 12:31:00.733 1498 ERROR nova     sys.exit(main())
Sep 28 12:31:00 ctl02 nova-api[1498]: 2017-09-28 12:31:00.733 1498 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:31:00 ctl02 nova-api[1498]: 2017-09-28 12:31:00.733 1498 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:31:00 ctl02 nova-api[1498]: 2017-09-28 12:31:00.733 1498 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:31:00 ctl02 nova-api[1498]: 2017-09-28 12:31:00.733 1498 ERROR nova     max_url_len=max_url_len)
Sep 28 12:31:00 ctl02 nova-api[1498]: 2017-09-28 12:31:00.733 1498 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:31:00 ctl02 nova-api[1498]: 2017-09-28 12:31:00.733 1498 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:31:00 ctl02 nova-api[1498]: 2017-09-28 12:31:00.733 1498 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:31:00 ctl02 nova-api[1498]: 2017-09-28 12:31:00.733 1498 ERROR nova     sock.listen(backlog)
Sep 28 12:31:00 ctl02 nova-api[1498]: 2017-09-28 12:31:00.733 1498 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:31:00 ctl02 nova-api[1498]: 2017-09-28 12:31:00.733 1498 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:31:00 ctl02 nova-api[1498]: 2017-09-28 12:31:00.733 1498 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:31:00 ctl02 nova-api[1498]: 2017-09-28 12:31:00.733 1498 ERROR nova
Sep 28 12:31:00 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:31:00 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:31:00 ctl02 neutron-server[30536]: 2017-09-28 12:31:00.811 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:31:00] "OPTIONS / HTTP/1.0" 200 262 0.000450
Sep 28 12:31:00 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:31:00 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:31:00 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:31:00 ctl02 glance-api[29183]: 2017-09-28 12:31:00.919 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:31:00] "OPTIONS / HTTP/1.0" 200 134 0.000617
Sep 28 12:31:01 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:31:01 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:31:01 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:31:01 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:31:01 ctl02 nova-cert[4860]: 2017-09-28 12:31:01.803 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:31:02 ctl02 nova-conductor[5056]: 2017-09-28 12:31:02.752 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:31:02 ctl02 nova-conductor[5056]: 2017-09-28 12:31:02.769 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:31:02 ctl02 nova-conductor[5056]: 2017-09-28 12:31:02.781 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:31:02 ctl02 nova-conductor[5056]: 2017-09-28 12:31:02.786 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:31:02 ctl02 nova-api[1520]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:31:02 ctl02 nova-api[1520]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:31:02 ctl02 neutron-server[30536]: 2017-09-28 12:31:02.858 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:31:02] "OPTIONS / HTTP/1.0" 200 262 0.000463
Sep 28 12:31:02 ctl02 nova-api[1520]: 2017-09-28 12:31:02.996 1520 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:31:02 ctl02 nova-api[1520]: 2017-09-28 12:31:02.997 1520 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:31:02 ctl02 nova-api[1520]: 2017-09-28 12:31:02.997 1520 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:31:02 ctl02 nova-api[1520]: 2017-09-28 12:31:02.997 1520 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:31:02 ctl02 nova-api[1520]: 2017-09-28 12:31:02.997 1520 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:31:02 ctl02 nova-api[1520]: 2017-09-28 12:31:02.997 1520 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:31:02 ctl02 nova-api[1520]: 2017-09-28 12:31:02.997 1520 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:31:02 ctl02 nova-api[1520]: 2017-09-28 12:31:02.997 1520 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:31:02 ctl02 nova-api[1520]: 2017-09-28 12:31:02.997 1520 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:31:02 ctl02 nova-api[1520]: 2017-09-28 12:31:02.997 1520 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:31:02 ctl02 nova-api[1520]: 2017-09-28 12:31:02.997 1520 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:31:02 ctl02 nova-api[1520]: 2017-09-28 12:31:02.997 1520 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:31:02 ctl02 nova-api[1520]: 2017-09-28 12:31:02.997 1520 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:31:02 ctl02 nova-api[1520]: 2017-09-28 12:31:02.997 1520 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:31:02 ctl02 nova-api[1520]: 2017-09-28 12:31:02.997 1520 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:31:02 ctl02 nova-api[1520]: 2017-09-28 12:31:02.997 1520 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:31:02 ctl02 nova-api[1520]: 2017-09-28 12:31:02.997 1520 ERROR nova.wsgi     self.filename))
Sep 28 12:31:02 ctl02 nova-api[1520]: 2017-09-28 12:31:02.997 1520 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:31:02 ctl02 nova-api[1520]: 2017-09-28 12:31:02.997 1520 ERROR nova.wsgi
Sep 28 12:31:02 ctl02 nova-api[1520]: 2017-09-28 12:31:02.998 1520 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:31:03 ctl02 nova-api[1520]: 2017-09-28 12:31:03.125 1520 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:31:03 ctl02 nova-api[1520]: 2017-09-28 12:31:03.345 1520 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:31:03 ctl02 nova-api[1520]: 2017-09-28 12:31:03.347 1520 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:31:03 ctl02 nova-api[1520]: 2017-09-28 12:31:03.347 1520 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:31:03 ctl02 nova-api[1520]: 2017-09-28 12:31:03.347 1520 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:31:03 ctl02 nova-api[1520]: 2017-09-28 12:31:03.476 1520 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:31:03 ctl02 nova-api[1520]: 2017-09-28 12:31:03.477 1520 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:31:03 ctl02 nova-api[1520]: 2017-09-28 12:31:03.478 1520 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:31:03 ctl02 nova-api[1520]: 2017-09-28 12:31:03.478 1520 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:31:03 ctl02 nova-api[1520]: 2017-09-28 12:31:03.481 1520 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:31:03 ctl02 nova-api[1520]: 2017-09-28 12:31:03.481 1520 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:31:03 ctl02 nova-api[1520]: 2017-09-28 12:31:03.481 1520 ERROR nova Traceback (most recent call last):
Sep 28 12:31:03 ctl02 nova-api[1520]: 2017-09-28 12:31:03.481 1520 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:31:03 ctl02 nova-api[1520]: 2017-09-28 12:31:03.481 1520 ERROR nova     sys.exit(main())
Sep 28 12:31:03 ctl02 nova-api[1520]: 2017-09-28 12:31:03.481 1520 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:31:03 ctl02 nova-api[1520]: 2017-09-28 12:31:03.481 1520 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:31:03 ctl02 nova-api[1520]: 2017-09-28 12:31:03.481 1520 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:31:03 ctl02 nova-api[1520]: 2017-09-28 12:31:03.481 1520 ERROR nova     max_url_len=max_url_len)
Sep 28 12:31:03 ctl02 nova-api[1520]: 2017-09-28 12:31:03.481 1520 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:31:03 ctl02 nova-api[1520]: 2017-09-28 12:31:03.481 1520 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:31:03 ctl02 nova-api[1520]: 2017-09-28 12:31:03.481 1520 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:31:03 ctl02 nova-api[1520]: 2017-09-28 12:31:03.481 1520 ERROR nova     sock.listen(backlog)
Sep 28 12:31:03 ctl02 nova-api[1520]: 2017-09-28 12:31:03.481 1520 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:31:03 ctl02 nova-api[1520]: 2017-09-28 12:31:03.481 1520 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:31:03 ctl02 nova-api[1520]: 2017-09-28 12:31:03.481 1520 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:31:03 ctl02 nova-api[1520]: 2017-09-28 12:31:03.481 1520 ERROR nova
Sep 28 12:31:03 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:31:03 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:31:03 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:31:03 ctl02 glance-api[29183]: 2017-09-28 12:31:03.796 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:31:03] "OPTIONS / HTTP/1.0" 200 134 0.001285
Sep 28 12:31:03 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:31:03 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:31:03 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:31:03 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:31:04 ctl02 glance-api[29183]: 2017-09-28 12:31:04.185 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:31:04] "OPTIONS / HTTP/1.0" 200 134 0.000621
Sep 28 12:31:04 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:31:04.987 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:31:04] "OPTIONS / HTTP/1.0" 200 134 0.000485
Sep 28 12:31:05 ctl02 heat-api[13008]: 2017-09-28 12:31:05.323 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:31:05] "OPTIONS / HTTP/1.0" 200 134 0.000612
Sep 28 12:31:05 ctl02 nova-api[1539]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:31:05 ctl02 nova-api[1539]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:31:05 ctl02 nova-api[1539]: 2017-09-28 12:31:05.754 1539 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:31:05 ctl02 nova-api[1539]: 2017-09-28 12:31:05.761 1539 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:31:05 ctl02 nova-api[1539]: 2017-09-28 12:31:05.761 1539 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:31:05 ctl02 nova-api[1539]: 2017-09-28 12:31:05.761 1539 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:31:05 ctl02 nova-api[1539]: 2017-09-28 12:31:05.761 1539 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:31:05 ctl02 nova-api[1539]: 2017-09-28 12:31:05.761 1539 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:31:05 ctl02 nova-api[1539]: 2017-09-28 12:31:05.761 1539 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:31:05 ctl02 nova-api[1539]: 2017-09-28 12:31:05.761 1539 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:31:05 ctl02 nova-api[1539]: 2017-09-28 12:31:05.761 1539 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:31:05 ctl02 nova-api[1539]: 2017-09-28 12:31:05.761 1539 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:31:05 ctl02 nova-api[1539]: 2017-09-28 12:31:05.761 1539 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:31:05 ctl02 nova-api[1539]: 2017-09-28 12:31:05.761 1539 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:31:05 ctl02 nova-api[1539]: 2017-09-28 12:31:05.761 1539 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:31:05 ctl02 nova-api[1539]: 2017-09-28 12:31:05.761 1539 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:31:05 ctl02 nova-api[1539]: 2017-09-28 12:31:05.761 1539 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:31:05 ctl02 nova-api[1539]: 2017-09-28 12:31:05.761 1539 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:31:05 ctl02 nova-api[1539]: 2017-09-28 12:31:05.761 1539 ERROR nova.wsgi     self.filename))
Sep 28 12:31:05 ctl02 nova-api[1539]: 2017-09-28 12:31:05.761 1539 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:31:05 ctl02 nova-api[1539]: 2017-09-28 12:31:05.761 1539 ERROR nova.wsgi
Sep 28 12:31:05 ctl02 nova-api[1539]: 2017-09-28 12:31:05.762 1539 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:31:05 ctl02 nova-api[1539]: 2017-09-28 12:31:05.906 1539 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:31:06 ctl02 nova-api[1539]: 2017-09-28 12:31:06.133 1539 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:31:06 ctl02 nova-api[1539]: 2017-09-28 12:31:06.135 1539 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:31:06 ctl02 nova-api[1539]: 2017-09-28 12:31:06.135 1539 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:31:06 ctl02 nova-api[1539]: 2017-09-28 12:31:06.136 1539 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:31:06 ctl02 nova-api[1539]: 2017-09-28 12:31:06.266 1539 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:31:06 ctl02 nova-api[1539]: 2017-09-28 12:31:06.268 1539 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:31:06 ctl02 nova-api[1539]: 2017-09-28 12:31:06.268 1539 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:31:06 ctl02 nova-api[1539]: 2017-09-28 12:31:06.268 1539 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:31:06 ctl02 nova-api[1539]: 2017-09-28 12:31:06.271 1539 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:31:06 ctl02 nova-api[1539]: 2017-09-28 12:31:06.272 1539 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:31:06 ctl02 nova-api[1539]: 2017-09-28 12:31:06.272 1539 ERROR nova Traceback (most recent call last):
Sep 28 12:31:06 ctl02 nova-api[1539]: 2017-09-28 12:31:06.272 1539 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:31:06 ctl02 nova-api[1539]: 2017-09-28 12:31:06.272 1539 ERROR nova     sys.exit(main())
Sep 28 12:31:06 ctl02 nova-api[1539]: 2017-09-28 12:31:06.272 1539 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:31:06 ctl02 nova-api[1539]: 2017-09-28 12:31:06.272 1539 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:31:06 ctl02 nova-api[1539]: 2017-09-28 12:31:06.272 1539 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:31:06 ctl02 nova-api[1539]: 2017-09-28 12:31:06.272 1539 ERROR nova     max_url_len=max_url_len)
Sep 28 12:31:06 ctl02 nova-api[1539]: 2017-09-28 12:31:06.272 1539 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:31:06 ctl02 nova-api[1539]: 2017-09-28 12:31:06.272 1539 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:31:06 ctl02 nova-api[1539]: 2017-09-28 12:31:06.272 1539 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:31:06 ctl02 nova-api[1539]: 2017-09-28 12:31:06.272 1539 ERROR nova     sock.listen(backlog)
Sep 28 12:31:06 ctl02 nova-api[1539]: 2017-09-28 12:31:06.272 1539 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:31:06 ctl02 nova-api[1539]: 2017-09-28 12:31:06.272 1539 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:31:06 ctl02 nova-api[1539]: 2017-09-28 12:31:06.272 1539 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:31:06 ctl02 nova-api[1539]: 2017-09-28 12:31:06.272 1539 ERROR nova
Sep 28 12:31:06 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:31:06 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:31:06 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:31:06 ctl02 neutron-server[30536]: 2017-09-28 12:31:06.412 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 12:31:06 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:31:06 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:30:08 cmp002
Sep 28 12:31:06 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:23:57 cmp001
Sep 28 12:31:06 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:30:06 cmp002
Sep 28 12:31:06 ctl02 heat-api[13008]: 2017-09-28 12:31:06.542 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:31:06] "OPTIONS / HTTP/1.0" 200 134 0.000636
Sep 28 12:31:06 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:31:06 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:31:06 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:31:06 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:31:06 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:31:06.912 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:31:06] "OPTIONS / HTTP/1.0" 200 134 0.000410
Sep 28 12:31:07 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:31:07.217 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:31:07] "OPTIONS / HTTP/1.0" 200 134 0.000445
Sep 28 12:31:08 ctl02 heat-api-cfn[13300]: 2017-09-28 12:31:08.151 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:31:08] "OPTIONS / HTTP/1.0" 200 134 0.000554
Sep 28 12:31:08 ctl02 nova-api[1557]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:31:08 ctl02 nova-api[1557]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:31:08 ctl02 heat-api[13008]: 2017-09-28 12:31:08.349 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:31:08] "OPTIONS / HTTP/1.0" 200 134 0.000565
Sep 28 12:31:08 ctl02 nova-api[1557]: 2017-09-28 12:31:08.451 1557 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:31:08 ctl02 nova-api[1557]: 2017-09-28 12:31:08.452 1557 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:31:08 ctl02 nova-api[1557]: 2017-09-28 12:31:08.452 1557 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:31:08 ctl02 nova-api[1557]: 2017-09-28 12:31:08.452 1557 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:31:08 ctl02 nova-api[1557]: 2017-09-28 12:31:08.452 1557 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:31:08 ctl02 nova-api[1557]: 2017-09-28 12:31:08.452 1557 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:31:08 ctl02 nova-api[1557]: 2017-09-28 12:31:08.452 1557 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:31:08 ctl02 nova-api[1557]: 2017-09-28 12:31:08.452 1557 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:31:08 ctl02 nova-api[1557]: 2017-09-28 12:31:08.452 1557 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:31:08 ctl02 nova-api[1557]: 2017-09-28 12:31:08.452 1557 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:31:08 ctl02 nova-api[1557]: 2017-09-28 12:31:08.452 1557 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:31:08 ctl02 nova-api[1557]: 2017-09-28 12:31:08.452 1557 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:31:08 ctl02 nova-api[1557]: 2017-09-28 12:31:08.452 1557 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:31:08 ctl02 nova-api[1557]: 2017-09-28 12:31:08.452 1557 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:31:08 ctl02 nova-api[1557]: 2017-09-28 12:31:08.452 1557 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:31:08 ctl02 nova-api[1557]: 2017-09-28 12:31:08.452 1557 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:31:08 ctl02 nova-api[1557]: 2017-09-28 12:31:08.452 1557 ERROR nova.wsgi     self.filename))
Sep 28 12:31:08 ctl02 nova-api[1557]: 2017-09-28 12:31:08.452 1557 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:31:08 ctl02 nova-api[1557]: 2017-09-28 12:31:08.452 1557 ERROR nova.wsgi
Sep 28 12:31:08 ctl02 nova-api[1557]: 2017-09-28 12:31:08.453 1557 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:31:08 ctl02 nova-api[1557]: 2017-09-28 12:31:08.578 1557 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:31:08 ctl02 nova-api[1557]: 2017-09-28 12:31:08.798 1557 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:31:08 ctl02 nova-api[1557]: 2017-09-28 12:31:08.800 1557 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:31:08 ctl02 nova-api[1557]: 2017-09-28 12:31:08.800 1557 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:31:08 ctl02 nova-api[1557]: 2017-09-28 12:31:08.801 1557 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:31:08 ctl02 nova-api[1557]: 2017-09-28 12:31:08.930 1557 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:31:08 ctl02 nova-api[1557]: 2017-09-28 12:31:08.932 1557 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:31:08 ctl02 nova-api[1557]: 2017-09-28 12:31:08.933 1557 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:31:08 ctl02 nova-api[1557]: 2017-09-28 12:31:08.933 1557 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:31:08 ctl02 nova-api[1557]: 2017-09-28 12:31:08.936 1557 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:31:08 ctl02 nova-api[1557]: 2017-09-28 12:31:08.937 1557 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:31:08 ctl02 nova-api[1557]: 2017-09-28 12:31:08.937 1557 ERROR nova Traceback (most recent call last):
Sep 28 12:31:08 ctl02 nova-api[1557]: 2017-09-28 12:31:08.937 1557 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:31:08 ctl02 nova-api[1557]: 2017-09-28 12:31:08.937 1557 ERROR nova     sys.exit(main())
Sep 28 12:31:08 ctl02 nova-api[1557]: 2017-09-28 12:31:08.937 1557 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:31:08 ctl02 nova-api[1557]: 2017-09-28 12:31:08.937 1557 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:31:08 ctl02 nova-api[1557]: 2017-09-28 12:31:08.937 1557 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:31:08 ctl02 nova-api[1557]: 2017-09-28 12:31:08.937 1557 ERROR nova     max_url_len=max_url_len)
Sep 28 12:31:08 ctl02 nova-api[1557]: 2017-09-28 12:31:08.937 1557 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:31:08 ctl02 nova-api[1557]: 2017-09-28 12:31:08.937 1557 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:31:08 ctl02 nova-api[1557]: 2017-09-28 12:31:08.937 1557 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:31:08 ctl02 nova-api[1557]: 2017-09-28 12:31:08.937 1557 ERROR nova     sock.listen(backlog)
Sep 28 12:31:08 ctl02 nova-api[1557]: 2017-09-28 12:31:08.937 1557 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:31:08 ctl02 nova-api[1557]: 2017-09-28 12:31:08.937 1557 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:31:08 ctl02 nova-api[1557]: 2017-09-28 12:31:08.937 1557 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:31:08 ctl02 nova-api[1557]: 2017-09-28 12:31:08.937 1557 ERROR nova
Sep 28 12:31:09 ctl02 heat-api-cfn[13300]: 2017-09-28 12:31:09.027 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:31:09] "OPTIONS / HTTP/1.0" 200 134 0.000489
Sep 28 12:31:09 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:31:09 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:31:09 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:31:09 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:31:09 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:31:09 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:31:09 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:31:09 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6babdb56)
Sep 28 12:31:09 ctl02 neutron-server[30536]: 2017-09-28 12:31:09.598 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:31:09] "OPTIONS / HTTP/1.0" 200 262 0.000453
Sep 28 12:31:10 ctl02 heat-api-cfn[13300]: 2017-09-28 12:31:10.119 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:31:10] "OPTIONS / HTTP/1.0" 200 134 0.000461
Sep 28 12:31:10 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6babdb56)
Sep 28 12:31:10 ctl02 glance-api[29183]: 2017-09-28 12:31:10.620 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:31:10] "OPTIONS / HTTP/1.0" 200 134 0.000601
Sep 28 12:31:10 ctl02 neutron-server[30536]: 2017-09-28 12:31:10.714 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:31:10] "OPTIONS / HTTP/1.0" 200 262 0.000445
Sep 28 12:31:11 ctl02 nova-api[1575]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:31:11 ctl02 nova-api[1575]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:31:11 ctl02 nova-api[1575]: 2017-09-28 12:31:11.223 1575 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:31:11 ctl02 nova-api[1575]: 2017-09-28 12:31:11.225 1575 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:31:11 ctl02 nova-api[1575]: 2017-09-28 12:31:11.225 1575 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:31:11 ctl02 nova-api[1575]: 2017-09-28 12:31:11.225 1575 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:31:11 ctl02 nova-api[1575]: 2017-09-28 12:31:11.225 1575 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:31:11 ctl02 nova-api[1575]: 2017-09-28 12:31:11.225 1575 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:31:11 ctl02 nova-api[1575]: 2017-09-28 12:31:11.225 1575 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:31:11 ctl02 nova-api[1575]: 2017-09-28 12:31:11.225 1575 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:31:11 ctl02 nova-api[1575]: 2017-09-28 12:31:11.225 1575 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:31:11 ctl02 nova-api[1575]: 2017-09-28 12:31:11.225 1575 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:31:11 ctl02 nova-api[1575]: 2017-09-28 12:31:11.225 1575 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:31:11 ctl02 nova-api[1575]: 2017-09-28 12:31:11.225 1575 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:31:11 ctl02 nova-api[1575]: 2017-09-28 12:31:11.225 1575 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:31:11 ctl02 nova-api[1575]: 2017-09-28 12:31:11.225 1575 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:31:11 ctl02 nova-api[1575]: 2017-09-28 12:31:11.225 1575 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:31:11 ctl02 nova-api[1575]: 2017-09-28 12:31:11.225 1575 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:31:11 ctl02 nova-api[1575]: 2017-09-28 12:31:11.225 1575 ERROR nova.wsgi     self.filename))
Sep 28 12:31:11 ctl02 nova-api[1575]: 2017-09-28 12:31:11.225 1575 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:31:11 ctl02 nova-api[1575]: 2017-09-28 12:31:11.225 1575 ERROR nova.wsgi
Sep 28 12:31:11 ctl02 nova-api[1575]: 2017-09-28 12:31:11.227 1575 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:31:11 ctl02 nova-api[1575]: 2017-09-28 12:31:11.352 1575 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:31:11 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6babdb56)
Sep 28 12:31:11 ctl02 nova-api[1575]: 2017-09-28 12:31:11.571 1575 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:31:11 ctl02 nova-api[1575]: 2017-09-28 12:31:11.573 1575 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:31:11 ctl02 nova-api[1575]: 2017-09-28 12:31:11.574 1575 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:31:11 ctl02 nova-api[1575]: 2017-09-28 12:31:11.574 1575 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:31:11 ctl02 nova-consoleauth[5433]: 2017-09-28 12:31:11.683 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:31:11 ctl02 nova-api[1575]: 2017-09-28 12:31:11.711 1575 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:31:11 ctl02 nova-api[1575]: 2017-09-28 12:31:11.713 1575 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:31:11 ctl02 nova-api[1575]: 2017-09-28 12:31:11.713 1575 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:31:11 ctl02 nova-api[1575]: 2017-09-28 12:31:11.714 1575 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:31:11 ctl02 nova-api[1575]: 2017-09-28 12:31:11.717 1575 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:31:11 ctl02 nova-api[1575]: 2017-09-28 12:31:11.718 1575 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:31:11 ctl02 nova-api[1575]: 2017-09-28 12:31:11.718 1575 ERROR nova Traceback (most recent call last):
Sep 28 12:31:11 ctl02 nova-api[1575]: 2017-09-28 12:31:11.718 1575 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:31:11 ctl02 nova-api[1575]: 2017-09-28 12:31:11.718 1575 ERROR nova     sys.exit(main())
Sep 28 12:31:11 ctl02 nova-api[1575]: 2017-09-28 12:31:11.718 1575 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:31:11 ctl02 nova-api[1575]: 2017-09-28 12:31:11.718 1575 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:31:11 ctl02 nova-api[1575]: 2017-09-28 12:31:11.718 1575 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:31:11 ctl02 nova-api[1575]: 2017-09-28 12:31:11.718 1575 ERROR nova     max_url_len=max_url_len)
Sep 28 12:31:11 ctl02 nova-api[1575]: 2017-09-28 12:31:11.718 1575 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:31:11 ctl02 nova-api[1575]: 2017-09-28 12:31:11.718 1575 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:31:11 ctl02 nova-api[1575]: 2017-09-28 12:31:11.718 1575 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:31:11 ctl02 nova-api[1575]: 2017-09-28 12:31:11.718 1575 ERROR nova     sock.listen(backlog)
Sep 28 12:31:11 ctl02 nova-api[1575]: 2017-09-28 12:31:11.718 1575 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:31:11 ctl02 nova-api[1575]: 2017-09-28 12:31:11.718 1575 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:31:11 ctl02 nova-api[1575]: 2017-09-28 12:31:11.718 1575 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:31:11 ctl02 nova-api[1575]: 2017-09-28 12:31:11.718 1575 ERROR nova
Sep 28 12:31:11 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:31:11 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:31:11 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:31:12 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:31:12 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:31:12 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:31:12 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:31:12 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6babdb56)
Sep 28 12:31:12 ctl02 neutron-server[30536]: 2017-09-28 12:31:12.576 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:31:12] "OPTIONS / HTTP/1.0" 200 262 0.000535
Sep 28 12:31:13 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6babdb56)
Sep 28 12:31:13 ctl02 neutron-server[30536]: 2017-09-28 12:31:13.491 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:31:13 ctl02 glance-api[29183]: 2017-09-28 12:31:13.514 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:31:13] "OPTIONS / HTTP/1.0" 200 134 0.000627
Sep 28 12:31:13 ctl02 nova-api[1592]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:31:13 ctl02 nova-api[1592]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:31:13 ctl02 heat-engine[12803]: 2017-09-28 12:31:13.873 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:31:13 ctl02 heat-engine[12803]: 2017-09-28 12:31:13.879 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:31:13 ctl02 heat-engine[12803]: 2017-09-28 12:31:13.879 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:31:13 ctl02 heat-engine[12803]: 2017-09-28 12:31:13.882 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:31:14 ctl02 nova-api[1592]: 2017-09-28 12:31:14.039 1592 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:31:14 ctl02 nova-api[1592]: 2017-09-28 12:31:14.041 1592 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:31:14 ctl02 nova-api[1592]: 2017-09-28 12:31:14.041 1592 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:31:14 ctl02 nova-api[1592]: 2017-09-28 12:31:14.041 1592 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:31:14 ctl02 nova-api[1592]: 2017-09-28 12:31:14.041 1592 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:31:14 ctl02 nova-api[1592]: 2017-09-28 12:31:14.041 1592 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:31:14 ctl02 nova-api[1592]: 2017-09-28 12:31:14.041 1592 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:31:14 ctl02 nova-api[1592]: 2017-09-28 12:31:14.041 1592 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:31:14 ctl02 nova-api[1592]: 2017-09-28 12:31:14.041 1592 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:31:14 ctl02 nova-api[1592]: 2017-09-28 12:31:14.041 1592 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:31:14 ctl02 nova-api[1592]: 2017-09-28 12:31:14.041 1592 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:31:14 ctl02 nova-api[1592]: 2017-09-28 12:31:14.041 1592 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:31:14 ctl02 nova-api[1592]: 2017-09-28 12:31:14.041 1592 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:31:14 ctl02 nova-api[1592]: 2017-09-28 12:31:14.041 1592 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:31:14 ctl02 nova-api[1592]: 2017-09-28 12:31:14.041 1592 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:31:14 ctl02 nova-api[1592]: 2017-09-28 12:31:14.041 1592 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:31:14 ctl02 nova-api[1592]: 2017-09-28 12:31:14.041 1592 ERROR nova.wsgi     self.filename))
Sep 28 12:31:14 ctl02 nova-api[1592]: 2017-09-28 12:31:14.041 1592 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:31:14 ctl02 nova-api[1592]: 2017-09-28 12:31:14.041 1592 ERROR nova.wsgi
Sep 28 12:31:14 ctl02 nova-api[1592]: 2017-09-28 12:31:14.043 1592 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:31:14 ctl02 nova-api[1592]: 2017-09-28 12:31:14.176 1592 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:31:14 ctl02 glance-api[29183]: 2017-09-28 12:31:14.303 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:31:14] "OPTIONS / HTTP/1.0" 200 134 0.000631
Sep 28 12:31:14 ctl02 nova-api[1592]: 2017-09-28 12:31:14.424 1592 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:31:14 ctl02 nova-api[1592]: 2017-09-28 12:31:14.427 1592 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:31:14 ctl02 nova-api[1592]: 2017-09-28 12:31:14.427 1592 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:31:14 ctl02 nova-api[1592]: 2017-09-28 12:31:14.428 1592 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:31:14 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6babdb56)
Sep 28 12:31:14 ctl02 nova-api[1592]: 2017-09-28 12:31:14.563 1592 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:31:14 ctl02 nova-api[1592]: 2017-09-28 12:31:14.565 1592 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:31:14 ctl02 nova-api[1592]: 2017-09-28 12:31:14.565 1592 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:31:14 ctl02 nova-api[1592]: 2017-09-28 12:31:14.565 1592 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:31:14 ctl02 nova-api[1592]: 2017-09-28 12:31:14.569 1592 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:31:14 ctl02 nova-api[1592]: 2017-09-28 12:31:14.569 1592 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:31:14 ctl02 nova-api[1592]: 2017-09-28 12:31:14.569 1592 ERROR nova Traceback (most recent call last):
Sep 28 12:31:14 ctl02 nova-api[1592]: 2017-09-28 12:31:14.569 1592 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:31:14 ctl02 nova-api[1592]: 2017-09-28 12:31:14.569 1592 ERROR nova     sys.exit(main())
Sep 28 12:31:14 ctl02 nova-api[1592]: 2017-09-28 12:31:14.569 1592 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:31:14 ctl02 nova-api[1592]: 2017-09-28 12:31:14.569 1592 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:31:14 ctl02 nova-api[1592]: 2017-09-28 12:31:14.569 1592 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:31:14 ctl02 nova-api[1592]: 2017-09-28 12:31:14.569 1592 ERROR nova     max_url_len=max_url_len)
Sep 28 12:31:14 ctl02 nova-api[1592]: 2017-09-28 12:31:14.569 1592 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:31:14 ctl02 nova-api[1592]: 2017-09-28 12:31:14.569 1592 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:31:14 ctl02 nova-api[1592]: 2017-09-28 12:31:14.569 1592 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:31:14 ctl02 nova-api[1592]: 2017-09-28 12:31:14.569 1592 ERROR nova     sock.listen(backlog)
Sep 28 12:31:14 ctl02 nova-api[1592]: 2017-09-28 12:31:14.569 1592 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:31:14 ctl02 nova-api[1592]: 2017-09-28 12:31:14.569 1592 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:31:14 ctl02 nova-api[1592]: 2017-09-28 12:31:14.569 1592 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:31:14 ctl02 nova-api[1592]: 2017-09-28 12:31:14.569 1592 ERROR nova
Sep 28 12:31:14 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:31:14.627 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:31:14] "OPTIONS / HTTP/1.0" 200 134 0.000487
Sep 28 12:31:14 ctl02 nova-scheduler[5620]: 2017-09-28 12:31:14.720 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:31:14 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:31:14 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:31:14 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:31:14 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:31:14 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:31:14 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:31:14 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:31:15 ctl02 heat-api[13008]: 2017-09-28 12:31:15.085 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:31:15] "OPTIONS / HTTP/1.0" 200 134 0.000554
Sep 28 12:31:15 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6babdb56)
Sep 28 12:31:16 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6babdb56)
Sep 28 12:31:16 ctl02 heat-api[13008]: 2017-09-28 12:31:16.527 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:31:16] "OPTIONS / HTTP/1.0" 200 134 0.000516
Sep 28 12:31:16 ctl02 nova-api[1611]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:31:16 ctl02 nova-api[1611]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:31:16 ctl02 nova-api[1611]: 2017-09-28 12:31:16.708 1611 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:31:16 ctl02 nova-api[1611]: 2017-09-28 12:31:16.709 1611 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:31:16 ctl02 nova-api[1611]: 2017-09-28 12:31:16.709 1611 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:31:16 ctl02 nova-api[1611]: 2017-09-28 12:31:16.709 1611 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:31:16 ctl02 nova-api[1611]: 2017-09-28 12:31:16.709 1611 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:31:16 ctl02 nova-api[1611]: 2017-09-28 12:31:16.709 1611 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:31:16 ctl02 nova-api[1611]: 2017-09-28 12:31:16.709 1611 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:31:16 ctl02 nova-api[1611]: 2017-09-28 12:31:16.709 1611 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:31:16 ctl02 nova-api[1611]: 2017-09-28 12:31:16.709 1611 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:31:16 ctl02 nova-api[1611]: 2017-09-28 12:31:16.709 1611 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:31:16 ctl02 nova-api[1611]: 2017-09-28 12:31:16.709 1611 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:31:16 ctl02 nova-api[1611]: 2017-09-28 12:31:16.709 1611 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:31:16 ctl02 nova-api[1611]: 2017-09-28 12:31:16.709 1611 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:31:16 ctl02 nova-api[1611]: 2017-09-28 12:31:16.709 1611 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:31:16 ctl02 nova-api[1611]: 2017-09-28 12:31:16.709 1611 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:31:16 ctl02 nova-api[1611]: 2017-09-28 12:31:16.709 1611 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:31:16 ctl02 nova-api[1611]: 2017-09-28 12:31:16.709 1611 ERROR nova.wsgi     self.filename))
Sep 28 12:31:16 ctl02 nova-api[1611]: 2017-09-28 12:31:16.709 1611 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:31:16 ctl02 nova-api[1611]: 2017-09-28 12:31:16.709 1611 ERROR nova.wsgi
Sep 28 12:31:16 ctl02 nova-api[1611]: 2017-09-28 12:31:16.712 1611 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:31:16 ctl02 nova-api[1611]: 2017-09-28 12:31:16.837 1611 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:31:16 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:31:16.870 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:31:16] "OPTIONS / HTTP/1.0" 200 134 0.000502
Sep 28 12:31:17 ctl02 nova-api[1611]: 2017-09-28 12:31:17.056 1611 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:31:17 ctl02 nova-api[1611]: 2017-09-28 12:31:17.058 1611 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:31:17 ctl02 nova-api[1611]: 2017-09-28 12:31:17.059 1611 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:31:17 ctl02 nova-api[1611]: 2017-09-28 12:31:17.059 1611 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:31:17 ctl02 nova-api[1611]: 2017-09-28 12:31:17.188 1611 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:31:17 ctl02 nova-api[1611]: 2017-09-28 12:31:17.191 1611 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:31:17 ctl02 nova-api[1611]: 2017-09-28 12:31:17.191 1611 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:31:17 ctl02 nova-api[1611]: 2017-09-28 12:31:17.191 1611 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:31:17 ctl02 nova-api[1611]: 2017-09-28 12:31:17.195 1611 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:31:17 ctl02 nova-api[1611]: 2017-09-28 12:31:17.195 1611 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:31:17 ctl02 nova-api[1611]: 2017-09-28 12:31:17.195 1611 ERROR nova Traceback (most recent call last):
Sep 28 12:31:17 ctl02 nova-api[1611]: 2017-09-28 12:31:17.195 1611 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:31:17 ctl02 nova-api[1611]: 2017-09-28 12:31:17.195 1611 ERROR nova     sys.exit(main())
Sep 28 12:31:17 ctl02 nova-api[1611]: 2017-09-28 12:31:17.195 1611 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:31:17 ctl02 nova-api[1611]: 2017-09-28 12:31:17.195 1611 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:31:17 ctl02 nova-api[1611]: 2017-09-28 12:31:17.195 1611 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:31:17 ctl02 nova-api[1611]: 2017-09-28 12:31:17.195 1611 ERROR nova     max_url_len=max_url_len)
Sep 28 12:31:17 ctl02 nova-api[1611]: 2017-09-28 12:31:17.195 1611 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:31:17 ctl02 nova-api[1611]: 2017-09-28 12:31:17.195 1611 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:31:17 ctl02 nova-api[1611]: 2017-09-28 12:31:17.195 1611 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:31:17 ctl02 nova-api[1611]: 2017-09-28 12:31:17.195 1611 ERROR nova     sock.listen(backlog)
Sep 28 12:31:17 ctl02 nova-api[1611]: 2017-09-28 12:31:17.195 1611 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:31:17 ctl02 nova-api[1611]: 2017-09-28 12:31:17.195 1611 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:31:17 ctl02 nova-api[1611]: 2017-09-28 12:31:17.195 1611 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:31:17 ctl02 nova-api[1611]: 2017-09-28 12:31:17.195 1611 ERROR nova
Sep 28 12:31:17 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:31:17.320 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:31:17] "OPTIONS / HTTP/1.0" 200 134 0.000460
Sep 28 12:31:17 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:31:17 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:31:17 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:31:17 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6babdb56)
Sep 28 12:31:17 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:31:17 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:31:17 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:31:17 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:31:17 ctl02 heat-api-cfn[13300]: 2017-09-28 12:31:17.791 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:31:17] "OPTIONS / HTTP/1.0" 200 134 0.000813
Sep 28 12:31:18 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6babdb56)
Sep 28 12:31:18 ctl02 heat-api[13008]: 2017-09-28 12:31:18.618 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:31:18] "OPTIONS / HTTP/1.0" 200 134 0.000611
Sep 28 12:31:18 ctl02 heat-api-cfn[13300]: 2017-09-28 12:31:18.714 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:31:18] "OPTIONS / HTTP/1.0" 200 134 0.000528
Sep 28 12:31:19 ctl02 nova-api[1629]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:31:19 ctl02 nova-api[1629]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:31:19 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6babdb56)
Sep 28 12:31:19 ctl02 nova-api[1629]: 2017-09-28 12:31:19.541 1629 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:31:19 ctl02 nova-api[1629]: 2017-09-28 12:31:19.543 1629 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:31:19 ctl02 nova-api[1629]: 2017-09-28 12:31:19.543 1629 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:31:19 ctl02 nova-api[1629]: 2017-09-28 12:31:19.543 1629 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:31:19 ctl02 nova-api[1629]: 2017-09-28 12:31:19.543 1629 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:31:19 ctl02 nova-api[1629]: 2017-09-28 12:31:19.543 1629 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:31:19 ctl02 nova-api[1629]: 2017-09-28 12:31:19.543 1629 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:31:19 ctl02 nova-api[1629]: 2017-09-28 12:31:19.543 1629 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:31:19 ctl02 nova-api[1629]: 2017-09-28 12:31:19.543 1629 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:31:19 ctl02 nova-api[1629]: 2017-09-28 12:31:19.543 1629 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:31:19 ctl02 nova-api[1629]: 2017-09-28 12:31:19.543 1629 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:31:19 ctl02 nova-api[1629]: 2017-09-28 12:31:19.543 1629 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:31:19 ctl02 nova-api[1629]: 2017-09-28 12:31:19.543 1629 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:31:19 ctl02 nova-api[1629]: 2017-09-28 12:31:19.543 1629 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:31:19 ctl02 nova-api[1629]: 2017-09-28 12:31:19.543 1629 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:31:19 ctl02 nova-api[1629]: 2017-09-28 12:31:19.543 1629 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:31:19 ctl02 nova-api[1629]: 2017-09-28 12:31:19.543 1629 ERROR nova.wsgi     self.filename))
Sep 28 12:31:19 ctl02 nova-api[1629]: 2017-09-28 12:31:19.543 1629 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:31:19 ctl02 nova-api[1629]: 2017-09-28 12:31:19.543 1629 ERROR nova.wsgi
Sep 28 12:31:19 ctl02 nova-api[1629]: 2017-09-28 12:31:19.543 1629 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:31:19 ctl02 neutron-server[30536]: 2017-09-28 12:31:19.671 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:31:19] "OPTIONS / HTTP/1.0" 200 262 0.000529
Sep 28 12:31:19 ctl02 nova-api[1629]: 2017-09-28 12:31:19.676 1629 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:31:19 ctl02 nova-api[1629]: 2017-09-28 12:31:19.926 1629 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:31:19 ctl02 nova-api[1629]: 2017-09-28 12:31:19.928 1629 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:31:19 ctl02 nova-api[1629]: 2017-09-28 12:31:19.928 1629 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:31:19 ctl02 nova-api[1629]: 2017-09-28 12:31:19.929 1629 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:31:20 ctl02 nova-api[1629]: 2017-09-28 12:31:20.063 1629 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:31:20 ctl02 nova-api[1629]: 2017-09-28 12:31:20.065 1629 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:31:20 ctl02 nova-api[1629]: 2017-09-28 12:31:20.065 1629 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:31:20 ctl02 nova-api[1629]: 2017-09-28 12:31:20.066 1629 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:31:20 ctl02 nova-api[1629]: 2017-09-28 12:31:20.069 1629 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:31:20 ctl02 nova-api[1629]: 2017-09-28 12:31:20.069 1629 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:31:20 ctl02 nova-api[1629]: 2017-09-28 12:31:20.069 1629 ERROR nova Traceback (most recent call last):
Sep 28 12:31:20 ctl02 nova-api[1629]: 2017-09-28 12:31:20.069 1629 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:31:20 ctl02 nova-api[1629]: 2017-09-28 12:31:20.069 1629 ERROR nova     sys.exit(main())
Sep 28 12:31:20 ctl02 nova-api[1629]: 2017-09-28 12:31:20.069 1629 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:31:20 ctl02 nova-api[1629]: 2017-09-28 12:31:20.069 1629 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:31:20 ctl02 nova-api[1629]: 2017-09-28 12:31:20.069 1629 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:31:20 ctl02 nova-api[1629]: 2017-09-28 12:31:20.069 1629 ERROR nova     max_url_len=max_url_len)
Sep 28 12:31:20 ctl02 nova-api[1629]: 2017-09-28 12:31:20.069 1629 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:31:20 ctl02 nova-api[1629]: 2017-09-28 12:31:20.069 1629 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:31:20 ctl02 nova-api[1629]: 2017-09-28 12:31:20.069 1629 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:31:20 ctl02 nova-api[1629]: 2017-09-28 12:31:20.069 1629 ERROR nova     sock.listen(backlog)
Sep 28 12:31:20 ctl02 nova-api[1629]: 2017-09-28 12:31:20.069 1629 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:31:20 ctl02 nova-api[1629]: 2017-09-28 12:31:20.069 1629 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:31:20 ctl02 nova-api[1629]: 2017-09-28 12:31:20.069 1629 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:31:20 ctl02 nova-api[1629]: 2017-09-28 12:31:20.069 1629 ERROR nova
Sep 28 12:31:20 ctl02 heat-api-cfn[13300]: 2017-09-28 12:31:20.178 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:31:20] "OPTIONS / HTTP/1.0" 200 134 0.000533
Sep 28 12:31:20 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:31:20 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:31:20 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:31:20 ctl02 neutron-server[30536]: 2017-09-28 12:31:20.343 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:31:20] "OPTIONS / HTTP/1.0" 200 262 0.000590
Sep 28 12:31:20 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:31:20 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:31:20 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:31:20 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:31:20 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:31:20 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:31:20 ctl02 glance-api[29183]: 2017-09-28 12:31:20.766 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:31:20] "OPTIONS / HTTP/1.0" 200 134 0.000640
Sep 28 12:31:21 ctl02 neutron-server[30536]: 2017-09-28 12:31:21.408 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 4 dead agents out of 6:
Sep 28 12:31:21 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:31:21 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:30:08 cmp002
Sep 28 12:31:21 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:23:57 cmp001
Sep 28 12:31:21 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:30:40 cmp002
Sep 28 12:31:21 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:30:06 cmp002
Sep 28 12:31:22 ctl02 nova-api[1647]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:31:22 ctl02 nova-api[1647]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:31:22 ctl02 nova-api[1647]: 2017-09-28 12:31:22.253 1647 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:31:22 ctl02 nova-api[1647]: 2017-09-28 12:31:22.254 1647 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:31:22 ctl02 nova-api[1647]: 2017-09-28 12:31:22.254 1647 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:31:22 ctl02 nova-api[1647]: 2017-09-28 12:31:22.254 1647 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:31:22 ctl02 nova-api[1647]: 2017-09-28 12:31:22.254 1647 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:31:22 ctl02 nova-api[1647]: 2017-09-28 12:31:22.254 1647 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:31:22 ctl02 nova-api[1647]: 2017-09-28 12:31:22.254 1647 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:31:22 ctl02 nova-api[1647]: 2017-09-28 12:31:22.254 1647 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:31:22 ctl02 nova-api[1647]: 2017-09-28 12:31:22.254 1647 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:31:22 ctl02 nova-api[1647]: 2017-09-28 12:31:22.254 1647 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:31:22 ctl02 nova-api[1647]: 2017-09-28 12:31:22.254 1647 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:31:22 ctl02 nova-api[1647]: 2017-09-28 12:31:22.254 1647 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:31:22 ctl02 nova-api[1647]: 2017-09-28 12:31:22.254 1647 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:31:22 ctl02 nova-api[1647]: 2017-09-28 12:31:22.254 1647 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:31:22 ctl02 nova-api[1647]: 2017-09-28 12:31:22.254 1647 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:31:22 ctl02 nova-api[1647]: 2017-09-28 12:31:22.254 1647 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:31:22 ctl02 nova-api[1647]: 2017-09-28 12:31:22.254 1647 ERROR nova.wsgi     self.filename))
Sep 28 12:31:22 ctl02 nova-api[1647]: 2017-09-28 12:31:22.254 1647 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:31:22 ctl02 nova-api[1647]: 2017-09-28 12:31:22.254 1647 ERROR nova.wsgi
Sep 28 12:31:22 ctl02 nova-api[1647]: 2017-09-28 12:31:22.255 1647 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:31:22 ctl02 neutron-server[30536]: 2017-09-28 12:31:22.383 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:31:22] "OPTIONS / HTTP/1.0" 200 262 0.000606
Sep 28 12:31:22 ctl02 nova-api[1647]: 2017-09-28 12:31:22.384 1647 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:31:22 ctl02 nova-api[1647]: 2017-09-28 12:31:22.608 1647 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:31:22 ctl02 nova-api[1647]: 2017-09-28 12:31:22.610 1647 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:31:22 ctl02 nova-api[1647]: 2017-09-28 12:31:22.610 1647 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:31:22 ctl02 nova-api[1647]: 2017-09-28 12:31:22.610 1647 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:31:22 ctl02 nova-api[1647]: 2017-09-28 12:31:22.741 1647 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:31:22 ctl02 nova-api[1647]: 2017-09-28 12:31:22.743 1647 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:31:22 ctl02 nova-api[1647]: 2017-09-28 12:31:22.743 1647 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:31:22 ctl02 nova-api[1647]: 2017-09-28 12:31:22.743 1647 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:31:22 ctl02 nova-api[1647]: 2017-09-28 12:31:22.746 1647 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:31:22 ctl02 nova-api[1647]: 2017-09-28 12:31:22.747 1647 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:31:22 ctl02 nova-api[1647]: 2017-09-28 12:31:22.747 1647 ERROR nova Traceback (most recent call last):
Sep 28 12:31:22 ctl02 nova-api[1647]: 2017-09-28 12:31:22.747 1647 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:31:22 ctl02 nova-api[1647]: 2017-09-28 12:31:22.747 1647 ERROR nova     sys.exit(main())
Sep 28 12:31:22 ctl02 nova-api[1647]: 2017-09-28 12:31:22.747 1647 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:31:22 ctl02 nova-api[1647]: 2017-09-28 12:31:22.747 1647 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:31:22 ctl02 nova-api[1647]: 2017-09-28 12:31:22.747 1647 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:31:22 ctl02 nova-api[1647]: 2017-09-28 12:31:22.747 1647 ERROR nova     max_url_len=max_url_len)
Sep 28 12:31:22 ctl02 nova-api[1647]: 2017-09-28 12:31:22.747 1647 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:31:22 ctl02 nova-api[1647]: 2017-09-28 12:31:22.747 1647 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:31:22 ctl02 nova-api[1647]: 2017-09-28 12:31:22.747 1647 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:31:22 ctl02 nova-api[1647]: 2017-09-28 12:31:22.747 1647 ERROR nova     sock.listen(backlog)
Sep 28 12:31:22 ctl02 nova-api[1647]: 2017-09-28 12:31:22.747 1647 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:31:22 ctl02 nova-api[1647]: 2017-09-28 12:31:22.747 1647 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:31:22 ctl02 nova-api[1647]: 2017-09-28 12:31:22.747 1647 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:31:22 ctl02 nova-api[1647]: 2017-09-28 12:31:22.747 1647 ERROR nova
Sep 28 12:31:22 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:31:22 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:31:22 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:31:23 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:31:23 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:31:23 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:31:23 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:31:23 ctl02 glance-api[29183]: 2017-09-28 12:31:23.893 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:31:23] "OPTIONS / HTTP/1.0" 200 134 0.000590
Sep 28 12:31:24 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:31:24.541 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:31:24] "OPTIONS / HTTP/1.0" 200 134 0.000401
Sep 28 12:31:24 ctl02 glance-api[29183]: 2017-09-28 12:31:24.627 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:31:24] "OPTIONS / HTTP/1.0" 200 134 0.000555
Sep 28 12:31:24 ctl02 nova-api[1670]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:31:24 ctl02 nova-api[1670]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:31:24 ctl02 nova-api[1670]: 2017-09-28 12:31:24.990 1670 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:31:24 ctl02 nova-api[1670]: 2017-09-28 12:31:24.991 1670 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:31:24 ctl02 nova-api[1670]: 2017-09-28 12:31:24.991 1670 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:31:24 ctl02 nova-api[1670]: 2017-09-28 12:31:24.991 1670 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:31:24 ctl02 nova-api[1670]: 2017-09-28 12:31:24.991 1670 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:31:24 ctl02 nova-api[1670]: 2017-09-28 12:31:24.991 1670 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:31:24 ctl02 nova-api[1670]: 2017-09-28 12:31:24.991 1670 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:31:24 ctl02 nova-api[1670]: 2017-09-28 12:31:24.991 1670 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:31:24 ctl02 nova-api[1670]: 2017-09-28 12:31:24.991 1670 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:31:24 ctl02 nova-api[1670]: 2017-09-28 12:31:24.991 1670 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:31:24 ctl02 nova-api[1670]: 2017-09-28 12:31:24.991 1670 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:31:24 ctl02 nova-api[1670]: 2017-09-28 12:31:24.991 1670 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:31:24 ctl02 nova-api[1670]: 2017-09-28 12:31:24.991 1670 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:31:24 ctl02 nova-api[1670]: 2017-09-28 12:31:24.991 1670 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:31:24 ctl02 nova-api[1670]: 2017-09-28 12:31:24.991 1670 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:31:24 ctl02 nova-api[1670]: 2017-09-28 12:31:24.991 1670 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:31:24 ctl02 nova-api[1670]: 2017-09-28 12:31:24.991 1670 ERROR nova.wsgi     self.filename))
Sep 28 12:31:24 ctl02 nova-api[1670]: 2017-09-28 12:31:24.991 1670 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:31:24 ctl02 nova-api[1670]: 2017-09-28 12:31:24.991 1670 ERROR nova.wsgi
Sep 28 12:31:24 ctl02 nova-api[1670]: 2017-09-28 12:31:24.992 1670 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:31:25 ctl02 nova-api[1670]: 2017-09-28 12:31:25.121 1670 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:31:25 ctl02 nova-api[1670]: 2017-09-28 12:31:25.342 1670 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:31:25 ctl02 nova-api[1670]: 2017-09-28 12:31:25.344 1670 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:31:25 ctl02 nova-api[1670]: 2017-09-28 12:31:25.344 1670 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:31:25 ctl02 nova-api[1670]: 2017-09-28 12:31:25.345 1670 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:31:25 ctl02 heat-api[13008]: 2017-09-28 12:31:25.393 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:31:25] "OPTIONS / HTTP/1.0" 200 134 0.000556
Sep 28 12:31:25 ctl02 nova-api[1670]: 2017-09-28 12:31:25.476 1670 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:31:25 ctl02 nova-api[1670]: 2017-09-28 12:31:25.478 1670 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:31:25 ctl02 nova-api[1670]: 2017-09-28 12:31:25.478 1670 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:31:25 ctl02 nova-api[1670]: 2017-09-28 12:31:25.479 1670 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:31:25 ctl02 nova-api[1670]: 2017-09-28 12:31:25.482 1670 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:31:25 ctl02 nova-api[1670]: 2017-09-28 12:31:25.482 1670 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:31:25 ctl02 nova-api[1670]: 2017-09-28 12:31:25.482 1670 ERROR nova Traceback (most recent call last):
Sep 28 12:31:25 ctl02 nova-api[1670]: 2017-09-28 12:31:25.482 1670 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:31:25 ctl02 nova-api[1670]: 2017-09-28 12:31:25.482 1670 ERROR nova     sys.exit(main())
Sep 28 12:31:25 ctl02 nova-api[1670]: 2017-09-28 12:31:25.482 1670 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:31:25 ctl02 nova-api[1670]: 2017-09-28 12:31:25.482 1670 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:31:25 ctl02 nova-api[1670]: 2017-09-28 12:31:25.482 1670 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:31:25 ctl02 nova-api[1670]: 2017-09-28 12:31:25.482 1670 ERROR nova     max_url_len=max_url_len)
Sep 28 12:31:25 ctl02 nova-api[1670]: 2017-09-28 12:31:25.482 1670 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:31:25 ctl02 nova-api[1670]: 2017-09-28 12:31:25.482 1670 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:31:25 ctl02 nova-api[1670]: 2017-09-28 12:31:25.482 1670 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:31:25 ctl02 nova-api[1670]: 2017-09-28 12:31:25.482 1670 ERROR nova     sock.listen(backlog)
Sep 28 12:31:25 ctl02 nova-api[1670]: 2017-09-28 12:31:25.482 1670 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:31:25 ctl02 nova-api[1670]: 2017-09-28 12:31:25.482 1670 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:31:25 ctl02 nova-api[1670]: 2017-09-28 12:31:25.482 1670 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:31:25 ctl02 nova-api[1670]: 2017-09-28 12:31:25.482 1670 ERROR nova
Sep 28 12:31:25 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:31:25 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:31:25 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:31:25 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:31:25 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:31:25 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:31:25 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:31:26 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:31:26.569 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:31:26] "OPTIONS / HTTP/1.0" 200 134 0.000434
Sep 28 12:31:26 ctl02 heat-api[13008]: 2017-09-28 12:31:26.833 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:31:26] "OPTIONS / HTTP/1.0" 200 134 0.000601
Sep 28 12:31:27 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:31:27.216 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:31:27] "OPTIONS / HTTP/1.0" 200 134 0.000480
Sep 28 12:31:27 ctl02 nova-api[1687]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:31:27 ctl02 nova-api[1687]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:31:27 ctl02 heat-api-cfn[13300]: 2017-09-28 12:31:27.637 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:31:27] "OPTIONS / HTTP/1.0" 200 134 0.000560
Sep 28 12:31:27 ctl02 nova-api[1687]: 2017-09-28 12:31:27.825 1687 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:31:27 ctl02 nova-api[1687]: 2017-09-28 12:31:27.826 1687 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:31:27 ctl02 nova-api[1687]: 2017-09-28 12:31:27.826 1687 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:31:27 ctl02 nova-api[1687]: 2017-09-28 12:31:27.826 1687 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:31:27 ctl02 nova-api[1687]: 2017-09-28 12:31:27.826 1687 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:31:27 ctl02 nova-api[1687]: 2017-09-28 12:31:27.826 1687 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:31:27 ctl02 nova-api[1687]: 2017-09-28 12:31:27.826 1687 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:31:27 ctl02 nova-api[1687]: 2017-09-28 12:31:27.826 1687 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:31:27 ctl02 nova-api[1687]: 2017-09-28 12:31:27.826 1687 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:31:27 ctl02 nova-api[1687]: 2017-09-28 12:31:27.826 1687 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:31:27 ctl02 nova-api[1687]: 2017-09-28 12:31:27.826 1687 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:31:27 ctl02 nova-api[1687]: 2017-09-28 12:31:27.826 1687 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:31:27 ctl02 nova-api[1687]: 2017-09-28 12:31:27.826 1687 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:31:27 ctl02 nova-api[1687]: 2017-09-28 12:31:27.826 1687 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:31:27 ctl02 nova-api[1687]: 2017-09-28 12:31:27.826 1687 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:31:27 ctl02 nova-api[1687]: 2017-09-28 12:31:27.826 1687 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:31:27 ctl02 nova-api[1687]: 2017-09-28 12:31:27.826 1687 ERROR nova.wsgi     self.filename))
Sep 28 12:31:27 ctl02 nova-api[1687]: 2017-09-28 12:31:27.826 1687 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:31:27 ctl02 nova-api[1687]: 2017-09-28 12:31:27.826 1687 ERROR nova.wsgi
Sep 28 12:31:27 ctl02 nova-api[1687]: 2017-09-28 12:31:27.827 1687 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:31:27 ctl02 nova-api[1687]: 2017-09-28 12:31:27.969 1687 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:31:28 ctl02 nova-api[1687]: 2017-09-28 12:31:28.225 1687 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:31:28 ctl02 nova-api[1687]: 2017-09-28 12:31:28.227 1687 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:31:28 ctl02 nova-api[1687]: 2017-09-28 12:31:28.227 1687 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:31:28 ctl02 nova-api[1687]: 2017-09-28 12:31:28.228 1687 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:31:28 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf0e87a0a)
Sep 28 12:31:28 ctl02 nova-api[1687]: 2017-09-28 12:31:28.363 1687 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:31:28 ctl02 nova-api[1687]: 2017-09-28 12:31:28.365 1687 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:31:28 ctl02 nova-api[1687]: 2017-09-28 12:31:28.365 1687 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:31:28 ctl02 nova-api[1687]: 2017-09-28 12:31:28.365 1687 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:31:28 ctl02 nova-api[1687]: 2017-09-28 12:31:28.369 1687 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:31:28 ctl02 nova-api[1687]: 2017-09-28 12:31:28.369 1687 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:31:28 ctl02 nova-api[1687]: 2017-09-28 12:31:28.369 1687 ERROR nova Traceback (most recent call last):
Sep 28 12:31:28 ctl02 nova-api[1687]: 2017-09-28 12:31:28.369 1687 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:31:28 ctl02 nova-api[1687]: 2017-09-28 12:31:28.369 1687 ERROR nova     sys.exit(main())
Sep 28 12:31:28 ctl02 nova-api[1687]: 2017-09-28 12:31:28.369 1687 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:31:28 ctl02 nova-api[1687]: 2017-09-28 12:31:28.369 1687 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:31:28 ctl02 nova-api[1687]: 2017-09-28 12:31:28.369 1687 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:31:28 ctl02 nova-api[1687]: 2017-09-28 12:31:28.369 1687 ERROR nova     max_url_len=max_url_len)
Sep 28 12:31:28 ctl02 nova-api[1687]: 2017-09-28 12:31:28.369 1687 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:31:28 ctl02 nova-api[1687]: 2017-09-28 12:31:28.369 1687 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:31:28 ctl02 nova-api[1687]: 2017-09-28 12:31:28.369 1687 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:31:28 ctl02 nova-api[1687]: 2017-09-28 12:31:28.369 1687 ERROR nova     sock.listen(backlog)
Sep 28 12:31:28 ctl02 nova-api[1687]: 2017-09-28 12:31:28.369 1687 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:31:28 ctl02 nova-api[1687]: 2017-09-28 12:31:28.369 1687 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:31:28 ctl02 nova-api[1687]: 2017-09-28 12:31:28.369 1687 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:31:28 ctl02 nova-api[1687]: 2017-09-28 12:31:28.369 1687 ERROR nova
Sep 28 12:31:28 ctl02 neutron-server[30536]: 2017-09-28 12:31:28.496 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:31:28 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:31:28 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:31:28 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:31:28 ctl02 heat-api[13008]: 2017-09-28 12:31:28.815 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:31:28] "OPTIONS / HTTP/1.0" 200 134 0.000788
Sep 28 12:31:28 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:31:28 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:31:28 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:31:28 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:31:28 ctl02 heat-api-cfn[13300]: 2017-09-28 12:31:28.939 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:31:28] "OPTIONS / HTTP/1.0" 200 134 0.000622
Sep 28 12:31:29 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf0e87a0a)
Sep 28 12:31:29 ctl02 neutron-server[30536]: 2017-09-28 12:31:29.285 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:31:29] "OPTIONS / HTTP/1.0" 200 262 0.000513
Sep 28 12:31:30 ctl02 heat-api-cfn[13300]: 2017-09-28 12:31:30.133 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:31:30] "OPTIONS / HTTP/1.0" 200 134 0.000541
Sep 28 12:31:30 ctl02 neutron-server[30536]: 2017-09-28 12:31:30.206 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:31:30] "OPTIONS / HTTP/1.0" 200 262 0.000505
Sep 28 12:31:30 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf0e87a0a)
Sep 28 12:31:30 ctl02 nova-api[1705]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:31:30 ctl02 nova-api[1705]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:31:30 ctl02 nova-api[1705]: 2017-09-28 12:31:30.779 1705 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:31:30 ctl02 nova-api[1705]: 2017-09-28 12:31:30.780 1705 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:31:30 ctl02 nova-api[1705]: 2017-09-28 12:31:30.780 1705 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:31:30 ctl02 nova-api[1705]: 2017-09-28 12:31:30.780 1705 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:31:30 ctl02 nova-api[1705]: 2017-09-28 12:31:30.780 1705 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:31:30 ctl02 nova-api[1705]: 2017-09-28 12:31:30.780 1705 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:31:30 ctl02 nova-api[1705]: 2017-09-28 12:31:30.780 1705 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:31:30 ctl02 nova-api[1705]: 2017-09-28 12:31:30.780 1705 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:31:30 ctl02 nova-api[1705]: 2017-09-28 12:31:30.780 1705 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:31:30 ctl02 nova-api[1705]: 2017-09-28 12:31:30.780 1705 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:31:30 ctl02 nova-api[1705]: 2017-09-28 12:31:30.780 1705 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:31:30 ctl02 nova-api[1705]: 2017-09-28 12:31:30.780 1705 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:31:30 ctl02 nova-api[1705]: 2017-09-28 12:31:30.780 1705 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:31:30 ctl02 nova-api[1705]: 2017-09-28 12:31:30.780 1705 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:31:30 ctl02 nova-api[1705]: 2017-09-28 12:31:30.780 1705 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:31:30 ctl02 nova-api[1705]: 2017-09-28 12:31:30.780 1705 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:31:30 ctl02 nova-api[1705]: 2017-09-28 12:31:30.780 1705 ERROR nova.wsgi     self.filename))
Sep 28 12:31:30 ctl02 nova-api[1705]: 2017-09-28 12:31:30.780 1705 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:31:30 ctl02 nova-api[1705]: 2017-09-28 12:31:30.780 1705 ERROR nova.wsgi
Sep 28 12:31:30 ctl02 nova-api[1705]: 2017-09-28 12:31:30.781 1705 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:31:30 ctl02 nova-api[1705]: 2017-09-28 12:31:30.914 1705 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:31:30 ctl02 glance-api[29183]: 2017-09-28 12:31:30.939 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:31:30] "OPTIONS / HTTP/1.0" 200 134 0.000650
Sep 28 12:31:31 ctl02 nova-api[1705]: 2017-09-28 12:31:31.162 1705 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:31:31 ctl02 nova-api[1705]: 2017-09-28 12:31:31.164 1705 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:31:31 ctl02 nova-api[1705]: 2017-09-28 12:31:31.164 1705 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:31:31 ctl02 nova-api[1705]: 2017-09-28 12:31:31.165 1705 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:31:31 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf0e87a0a)
Sep 28 12:31:31 ctl02 nova-api[1705]: 2017-09-28 12:31:31.296 1705 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:31:31 ctl02 nova-api[1705]: 2017-09-28 12:31:31.298 1705 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:31:31 ctl02 nova-api[1705]: 2017-09-28 12:31:31.298 1705 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:31:31 ctl02 nova-api[1705]: 2017-09-28 12:31:31.298 1705 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:31:31 ctl02 nova-api[1705]: 2017-09-28 12:31:31.302 1705 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:31:31 ctl02 nova-api[1705]: 2017-09-28 12:31:31.302 1705 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:31:31 ctl02 nova-api[1705]: 2017-09-28 12:31:31.302 1705 ERROR nova Traceback (most recent call last):
Sep 28 12:31:31 ctl02 nova-api[1705]: 2017-09-28 12:31:31.302 1705 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:31:31 ctl02 nova-api[1705]: 2017-09-28 12:31:31.302 1705 ERROR nova     sys.exit(main())
Sep 28 12:31:31 ctl02 nova-api[1705]: 2017-09-28 12:31:31.302 1705 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:31:31 ctl02 nova-api[1705]: 2017-09-28 12:31:31.302 1705 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:31:31 ctl02 nova-api[1705]: 2017-09-28 12:31:31.302 1705 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:31:31 ctl02 nova-api[1705]: 2017-09-28 12:31:31.302 1705 ERROR nova     max_url_len=max_url_len)
Sep 28 12:31:31 ctl02 nova-api[1705]: 2017-09-28 12:31:31.302 1705 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:31:31 ctl02 nova-api[1705]: 2017-09-28 12:31:31.302 1705 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:31:31 ctl02 nova-api[1705]: 2017-09-28 12:31:31.302 1705 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:31:31 ctl02 nova-api[1705]: 2017-09-28 12:31:31.302 1705 ERROR nova     sock.listen(backlog)
Sep 28 12:31:31 ctl02 nova-api[1705]: 2017-09-28 12:31:31.302 1705 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:31:31 ctl02 nova-api[1705]: 2017-09-28 12:31:31.302 1705 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:31:31 ctl02 nova-api[1705]: 2017-09-28 12:31:31.302 1705 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:31:31 ctl02 nova-api[1705]: 2017-09-28 12:31:31.302 1705 ERROR nova
Sep 28 12:31:31 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:31:31 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:31:31 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:31:31 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:31:31 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:31:31 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:31:31 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:31:32 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf0e87a0a)
Sep 28 12:31:32 ctl02 neutron-server[30536]: 2017-09-28 12:31:32.516 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:31:32] "OPTIONS / HTTP/1.0" 200 262 0.000567
Sep 28 12:31:33 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf0e87a0a)
Sep 28 12:31:33 ctl02 nova-api[1724]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:31:33 ctl02 nova-api[1724]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:31:33 ctl02 nova-api[1724]: 2017-09-28 12:31:33.509 1724 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:31:33 ctl02 nova-api[1724]: 2017-09-28 12:31:33.511 1724 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:31:33 ctl02 nova-api[1724]: 2017-09-28 12:31:33.511 1724 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:31:33 ctl02 nova-api[1724]: 2017-09-28 12:31:33.511 1724 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:31:33 ctl02 nova-api[1724]: 2017-09-28 12:31:33.511 1724 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:31:33 ctl02 nova-api[1724]: 2017-09-28 12:31:33.511 1724 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:31:33 ctl02 nova-api[1724]: 2017-09-28 12:31:33.511 1724 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:31:33 ctl02 nova-api[1724]: 2017-09-28 12:31:33.511 1724 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:31:33 ctl02 nova-api[1724]: 2017-09-28 12:31:33.511 1724 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:31:33 ctl02 nova-api[1724]: 2017-09-28 12:31:33.511 1724 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:31:33 ctl02 nova-api[1724]: 2017-09-28 12:31:33.511 1724 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:31:33 ctl02 nova-api[1724]: 2017-09-28 12:31:33.511 1724 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:31:33 ctl02 nova-api[1724]: 2017-09-28 12:31:33.511 1724 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:31:33 ctl02 nova-api[1724]: 2017-09-28 12:31:33.511 1724 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:31:33 ctl02 nova-api[1724]: 2017-09-28 12:31:33.511 1724 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:31:33 ctl02 nova-api[1724]: 2017-09-28 12:31:33.511 1724 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:31:33 ctl02 nova-api[1724]: 2017-09-28 12:31:33.511 1724 ERROR nova.wsgi     self.filename))
Sep 28 12:31:33 ctl02 nova-api[1724]: 2017-09-28 12:31:33.511 1724 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:31:33 ctl02 nova-api[1724]: 2017-09-28 12:31:33.511 1724 ERROR nova.wsgi
Sep 28 12:31:33 ctl02 nova-api[1724]: 2017-09-28 12:31:33.512 1724 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:31:33 ctl02 glance-api[29183]: 2017-09-28 12:31:33.626 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:31:33] "OPTIONS / HTTP/1.0" 200 134 0.000549
Sep 28 12:31:33 ctl02 nova-api[1724]: 2017-09-28 12:31:33.639 1724 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:31:33 ctl02 nova-cert[4860]: 2017-09-28 12:31:33.839 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:31:33 ctl02 nova-api[1724]: 2017-09-28 12:31:33.860 1724 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:31:33 ctl02 nova-api[1724]: 2017-09-28 12:31:33.862 1724 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:31:33 ctl02 nova-api[1724]: 2017-09-28 12:31:33.862 1724 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:31:33 ctl02 nova-api[1724]: 2017-09-28 12:31:33.862 1724 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:31:33 ctl02 nova-api[1724]: 2017-09-28 12:31:33.990 1724 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:31:33 ctl02 nova-api[1724]: 2017-09-28 12:31:33.992 1724 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:31:33 ctl02 nova-api[1724]: 2017-09-28 12:31:33.992 1724 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:31:33 ctl02 nova-api[1724]: 2017-09-28 12:31:33.992 1724 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:31:33 ctl02 nova-api[1724]: 2017-09-28 12:31:33.995 1724 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:31:33 ctl02 nova-api[1724]: 2017-09-28 12:31:33.995 1724 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:31:33 ctl02 nova-api[1724]: 2017-09-28 12:31:33.995 1724 ERROR nova Traceback (most recent call last):
Sep 28 12:31:33 ctl02 nova-api[1724]: 2017-09-28 12:31:33.995 1724 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:31:33 ctl02 nova-api[1724]: 2017-09-28 12:31:33.995 1724 ERROR nova     sys.exit(main())
Sep 28 12:31:33 ctl02 nova-api[1724]: 2017-09-28 12:31:33.995 1724 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:31:33 ctl02 nova-api[1724]: 2017-09-28 12:31:33.995 1724 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:31:33 ctl02 nova-api[1724]: 2017-09-28 12:31:33.995 1724 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:31:33 ctl02 nova-api[1724]: 2017-09-28 12:31:33.995 1724 ERROR nova     max_url_len=max_url_len)
Sep 28 12:31:33 ctl02 nova-api[1724]: 2017-09-28 12:31:33.995 1724 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:31:33 ctl02 nova-api[1724]: 2017-09-28 12:31:33.995 1724 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:31:33 ctl02 nova-api[1724]: 2017-09-28 12:31:33.995 1724 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:31:33 ctl02 nova-api[1724]: 2017-09-28 12:31:33.995 1724 ERROR nova     sock.listen(backlog)
Sep 28 12:31:33 ctl02 nova-api[1724]: 2017-09-28 12:31:33.995 1724 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:31:33 ctl02 nova-api[1724]: 2017-09-28 12:31:33.995 1724 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:31:33 ctl02 nova-api[1724]: 2017-09-28 12:31:33.995 1724 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:31:33 ctl02 nova-api[1724]: 2017-09-28 12:31:33.995 1724 ERROR nova
Sep 28 12:31:34 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:31:34 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:31:34 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:31:34 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf0e87a0a)
Sep 28 12:31:34 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:31:34 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:31:34 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:31:34 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:31:34 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:31:34.727 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:31:34] "OPTIONS / HTTP/1.0" 200 134 0.000398
Sep 28 12:31:34 ctl02 glance-api[29183]: 2017-09-28 12:31:34.740 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:31:34] "OPTIONS / HTTP/1.0" 200 134 0.000545
Sep 28 12:31:34 ctl02 nova-conductor[5056]: 2017-09-28 12:31:34.761 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:31:34 ctl02 nova-conductor[5056]: 2017-09-28 12:31:34.778 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:31:34 ctl02 nova-conductor[5056]: 2017-09-28 12:31:34.789 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:31:34 ctl02 nova-conductor[5056]: 2017-09-28 12:31:34.794 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:31:35 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf0e87a0a)
Sep 28 12:31:35 ctl02 heat-api[13008]: 2017-09-28 12:31:35.726 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:31:35] "OPTIONS / HTTP/1.0" 200 134 0.000528
Sep 28 12:31:36 ctl02 nova-api[1741]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:31:36 ctl02 nova-api[1741]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:31:36 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf0e87a0a)
Sep 28 12:31:36 ctl02 nova-api[1741]: 2017-09-28 12:31:36.255 1741 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:31:36 ctl02 nova-api[1741]: 2017-09-28 12:31:36.256 1741 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:31:36 ctl02 nova-api[1741]: 2017-09-28 12:31:36.256 1741 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:31:36 ctl02 nova-api[1741]: 2017-09-28 12:31:36.256 1741 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:31:36 ctl02 nova-api[1741]: 2017-09-28 12:31:36.256 1741 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:31:36 ctl02 nova-api[1741]: 2017-09-28 12:31:36.256 1741 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:31:36 ctl02 nova-api[1741]: 2017-09-28 12:31:36.256 1741 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:31:36 ctl02 nova-api[1741]: 2017-09-28 12:31:36.256 1741 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:31:36 ctl02 nova-api[1741]: 2017-09-28 12:31:36.256 1741 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:31:36 ctl02 nova-api[1741]: 2017-09-28 12:31:36.256 1741 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:31:36 ctl02 nova-api[1741]: 2017-09-28 12:31:36.256 1741 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:31:36 ctl02 nova-api[1741]: 2017-09-28 12:31:36.256 1741 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:31:36 ctl02 nova-api[1741]: 2017-09-28 12:31:36.256 1741 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:31:36 ctl02 nova-api[1741]: 2017-09-28 12:31:36.256 1741 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:31:36 ctl02 nova-api[1741]: 2017-09-28 12:31:36.256 1741 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:31:36 ctl02 nova-api[1741]: 2017-09-28 12:31:36.256 1741 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:31:36 ctl02 nova-api[1741]: 2017-09-28 12:31:36.256 1741 ERROR nova.wsgi     self.filename))
Sep 28 12:31:36 ctl02 nova-api[1741]: 2017-09-28 12:31:36.256 1741 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:31:36 ctl02 nova-api[1741]: 2017-09-28 12:31:36.256 1741 ERROR nova.wsgi
Sep 28 12:31:36 ctl02 nova-api[1741]: 2017-09-28 12:31:36.257 1741 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:31:36 ctl02 nova-api[1741]: 2017-09-28 12:31:36.388 1741 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:31:36 ctl02 neutron-server[30536]: 2017-09-28 12:31:36.405 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 4 dead agents out of 6:
Sep 28 12:31:36 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:31:36 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:30:08 cmp002
Sep 28 12:31:36 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:23:57 cmp001
Sep 28 12:31:36 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:30:40 cmp002
Sep 28 12:31:36 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:30:06 cmp002
Sep 28 12:31:36 ctl02 nova-api[1741]: 2017-09-28 12:31:36.612 1741 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:31:36 ctl02 nova-api[1741]: 2017-09-28 12:31:36.614 1741 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:31:36 ctl02 nova-api[1741]: 2017-09-28 12:31:36.615 1741 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:31:36 ctl02 nova-api[1741]: 2017-09-28 12:31:36.615 1741 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:31:36 ctl02 nova-api[1741]: 2017-09-28 12:31:36.747 1741 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:31:36 ctl02 nova-api[1741]: 2017-09-28 12:31:36.749 1741 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:31:36 ctl02 nova-api[1741]: 2017-09-28 12:31:36.749 1741 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:31:36 ctl02 nova-api[1741]: 2017-09-28 12:31:36.749 1741 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:31:36 ctl02 nova-api[1741]: 2017-09-28 12:31:36.753 1741 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:31:36 ctl02 nova-api[1741]: 2017-09-28 12:31:36.753 1741 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:31:36 ctl02 nova-api[1741]: 2017-09-28 12:31:36.753 1741 ERROR nova Traceback (most recent call last):
Sep 28 12:31:36 ctl02 nova-api[1741]: 2017-09-28 12:31:36.753 1741 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:31:36 ctl02 nova-api[1741]: 2017-09-28 12:31:36.753 1741 ERROR nova     sys.exit(main())
Sep 28 12:31:36 ctl02 nova-api[1741]: 2017-09-28 12:31:36.753 1741 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:31:36 ctl02 nova-api[1741]: 2017-09-28 12:31:36.753 1741 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:31:36 ctl02 nova-api[1741]: 2017-09-28 12:31:36.753 1741 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:31:36 ctl02 nova-api[1741]: 2017-09-28 12:31:36.753 1741 ERROR nova     max_url_len=max_url_len)
Sep 28 12:31:36 ctl02 nova-api[1741]: 2017-09-28 12:31:36.753 1741 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:31:36 ctl02 nova-api[1741]: 2017-09-28 12:31:36.753 1741 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:31:36 ctl02 nova-api[1741]: 2017-09-28 12:31:36.753 1741 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:31:36 ctl02 nova-api[1741]: 2017-09-28 12:31:36.753 1741 ERROR nova     sock.listen(backlog)
Sep 28 12:31:36 ctl02 nova-api[1741]: 2017-09-28 12:31:36.753 1741 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:31:36 ctl02 nova-api[1741]: 2017-09-28 12:31:36.753 1741 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:31:36 ctl02 nova-api[1741]: 2017-09-28 12:31:36.753 1741 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:31:36 ctl02 nova-api[1741]: 2017-09-28 12:31:36.753 1741 ERROR nova
Sep 28 12:31:36 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:31:36 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:31:36 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:31:36 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:31:36.965 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:31:36] "OPTIONS / HTTP/1.0" 200 134 0.000466
Sep 28 12:31:37 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:31:37 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:31:37 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:31:37 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:31:37 ctl02 heat-api[13008]: 2017-09-28 12:31:37.151 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:31:37] "OPTIONS / HTTP/1.0" 200 134 0.000796
Sep 28 12:31:37 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf0e87a0a)
Sep 28 12:31:37 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:31:37.278 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:31:37] "OPTIONS / HTTP/1.0" 200 134 0.000347
Sep 28 12:31:37 ctl02 heat-api-cfn[13300]: 2017-09-28 12:31:37.491 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:31:37] "OPTIONS / HTTP/1.0" 200 134 0.000422
Sep 28 12:31:38 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf0e87a0a)
Sep 28 12:31:38 ctl02 heat-api-cfn[13300]: 2017-09-28 12:31:38.761 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:31:38] "OPTIONS / HTTP/1.0" 200 134 0.000490
Sep 28 12:31:38 ctl02 nova-api[1760]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:31:38 ctl02 nova-api[1760]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:31:39 ctl02 nova-api[1760]: 2017-09-28 12:31:39.025 1760 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:31:39 ctl02 nova-api[1760]: 2017-09-28 12:31:39.027 1760 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:31:39 ctl02 nova-api[1760]: 2017-09-28 12:31:39.027 1760 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:31:39 ctl02 nova-api[1760]: 2017-09-28 12:31:39.027 1760 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:31:39 ctl02 nova-api[1760]: 2017-09-28 12:31:39.027 1760 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:31:39 ctl02 nova-api[1760]: 2017-09-28 12:31:39.027 1760 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:31:39 ctl02 nova-api[1760]: 2017-09-28 12:31:39.027 1760 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:31:39 ctl02 nova-api[1760]: 2017-09-28 12:31:39.027 1760 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:31:39 ctl02 nova-api[1760]: 2017-09-28 12:31:39.027 1760 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:31:39 ctl02 nova-api[1760]: 2017-09-28 12:31:39.027 1760 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:31:39 ctl02 nova-api[1760]: 2017-09-28 12:31:39.027 1760 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:31:39 ctl02 nova-api[1760]: 2017-09-28 12:31:39.027 1760 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:31:39 ctl02 nova-api[1760]: 2017-09-28 12:31:39.027 1760 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:31:39 ctl02 nova-api[1760]: 2017-09-28 12:31:39.027 1760 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:31:39 ctl02 nova-api[1760]: 2017-09-28 12:31:39.027 1760 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:31:39 ctl02 nova-api[1760]: 2017-09-28 12:31:39.027 1760 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:31:39 ctl02 nova-api[1760]: 2017-09-28 12:31:39.027 1760 ERROR nova.wsgi     self.filename))
Sep 28 12:31:39 ctl02 nova-api[1760]: 2017-09-28 12:31:39.027 1760 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:31:39 ctl02 nova-api[1760]: 2017-09-28 12:31:39.027 1760 ERROR nova.wsgi
Sep 28 12:31:39 ctl02 nova-api[1760]: 2017-09-28 12:31:39.028 1760 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:31:39 ctl02 heat-api[13008]: 2017-09-28 12:31:39.111 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:31:39] "OPTIONS / HTTP/1.0" 200 134 0.000634
Sep 28 12:31:39 ctl02 nova-api[1760]: 2017-09-28 12:31:39.165 1760 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:31:39 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:31:39 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:31:39 ctl02 nova-api[1760]: 2017-09-28 12:31:39.391 1760 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:31:39 ctl02 nova-api[1760]: 2017-09-28 12:31:39.393 1760 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:31:39 ctl02 nova-api[1760]: 2017-09-28 12:31:39.394 1760 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:31:39 ctl02 nova-api[1760]: 2017-09-28 12:31:39.394 1760 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:31:39 ctl02 nova-api[1760]: 2017-09-28 12:31:39.523 1760 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:31:39 ctl02 nova-api[1760]: 2017-09-28 12:31:39.524 1760 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:31:39 ctl02 nova-api[1760]: 2017-09-28 12:31:39.525 1760 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:31:39 ctl02 nova-api[1760]: 2017-09-28 12:31:39.525 1760 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:31:39 ctl02 nova-api[1760]: 2017-09-28 12:31:39.528 1760 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:31:39 ctl02 nova-api[1760]: 2017-09-28 12:31:39.528 1760 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:31:39 ctl02 nova-api[1760]: 2017-09-28 12:31:39.528 1760 ERROR nova Traceback (most recent call last):
Sep 28 12:31:39 ctl02 nova-api[1760]: 2017-09-28 12:31:39.528 1760 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:31:39 ctl02 nova-api[1760]: 2017-09-28 12:31:39.528 1760 ERROR nova     sys.exit(main())
Sep 28 12:31:39 ctl02 nova-api[1760]: 2017-09-28 12:31:39.528 1760 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:31:39 ctl02 nova-api[1760]: 2017-09-28 12:31:39.528 1760 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:31:39 ctl02 nova-api[1760]: 2017-09-28 12:31:39.528 1760 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:31:39 ctl02 nova-api[1760]: 2017-09-28 12:31:39.528 1760 ERROR nova     max_url_len=max_url_len)
Sep 28 12:31:39 ctl02 nova-api[1760]: 2017-09-28 12:31:39.528 1760 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:31:39 ctl02 nova-api[1760]: 2017-09-28 12:31:39.528 1760 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:31:39 ctl02 nova-api[1760]: 2017-09-28 12:31:39.528 1760 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:31:39 ctl02 nova-api[1760]: 2017-09-28 12:31:39.528 1760 ERROR nova     sock.listen(backlog)
Sep 28 12:31:39 ctl02 nova-api[1760]: 2017-09-28 12:31:39.528 1760 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:31:39 ctl02 nova-api[1760]: 2017-09-28 12:31:39.528 1760 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:31:39 ctl02 nova-api[1760]: 2017-09-28 12:31:39.528 1760 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:31:39 ctl02 nova-api[1760]: 2017-09-28 12:31:39.528 1760 ERROR nova
Sep 28 12:31:39 ctl02 neutron-server[30536]: 2017-09-28 12:31:39.567 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:31:39] "OPTIONS / HTTP/1.0" 200 262 0.000472
Sep 28 12:31:39 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:31:39 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:31:39 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:31:39 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:31:39 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:31:39 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:31:39 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:31:39 ctl02 neutron-server[30536]: 2017-09-28 12:31:39.990 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:31:39] "OPTIONS / HTTP/1.0" 200 262 0.000507
Sep 28 12:31:40 ctl02 heat-api-cfn[13300]: 2017-09-28 12:31:40.010 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:31:40] "OPTIONS / HTTP/1.0" 200 134 0.000585
Sep 28 12:31:41 ctl02 glance-api[29183]: 2017-09-28 12:31:41.026 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:31:41] "OPTIONS / HTTP/1.0" 200 134 0.000563
Sep 28 12:31:41 ctl02 nova-api[1783]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:31:41 ctl02 nova-api[1783]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:31:41 ctl02 nova-api[1783]: 2017-09-28 12:31:41.715 1783 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:31:41 ctl02 nova-api[1783]: 2017-09-28 12:31:41.717 1783 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:31:41 ctl02 nova-api[1783]: 2017-09-28 12:31:41.717 1783 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:31:41 ctl02 nova-api[1783]: 2017-09-28 12:31:41.717 1783 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:31:41 ctl02 nova-api[1783]: 2017-09-28 12:31:41.717 1783 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:31:41 ctl02 nova-api[1783]: 2017-09-28 12:31:41.717 1783 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:31:41 ctl02 nova-api[1783]: 2017-09-28 12:31:41.717 1783 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:31:41 ctl02 nova-api[1783]: 2017-09-28 12:31:41.717 1783 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:31:41 ctl02 nova-api[1783]: 2017-09-28 12:31:41.717 1783 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:31:41 ctl02 nova-api[1783]: 2017-09-28 12:31:41.717 1783 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:31:41 ctl02 nova-api[1783]: 2017-09-28 12:31:41.717 1783 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:31:41 ctl02 nova-api[1783]: 2017-09-28 12:31:41.717 1783 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:31:41 ctl02 nova-api[1783]: 2017-09-28 12:31:41.717 1783 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:31:41 ctl02 nova-api[1783]: 2017-09-28 12:31:41.717 1783 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:31:41 ctl02 nova-api[1783]: 2017-09-28 12:31:41.717 1783 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:31:41 ctl02 nova-api[1783]: 2017-09-28 12:31:41.717 1783 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:31:41 ctl02 nova-api[1783]: 2017-09-28 12:31:41.717 1783 ERROR nova.wsgi     self.filename))
Sep 28 12:31:41 ctl02 nova-api[1783]: 2017-09-28 12:31:41.717 1783 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:31:41 ctl02 nova-api[1783]: 2017-09-28 12:31:41.717 1783 ERROR nova.wsgi
Sep 28 12:31:41 ctl02 nova-api[1783]: 2017-09-28 12:31:41.719 1783 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:31:41 ctl02 nova-api[1783]: 2017-09-28 12:31:41.845 1783 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:31:42 ctl02 nova-api[1783]: 2017-09-28 12:31:42.067 1783 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:31:42 ctl02 nova-api[1783]: 2017-09-28 12:31:42.070 1783 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:31:42 ctl02 nova-api[1783]: 2017-09-28 12:31:42.070 1783 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:31:42 ctl02 nova-api[1783]: 2017-09-28 12:31:42.071 1783 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:31:42 ctl02 nova-api[1783]: 2017-09-28 12:31:42.200 1783 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:31:42 ctl02 nova-api[1783]: 2017-09-28 12:31:42.203 1783 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:31:42 ctl02 nova-api[1783]: 2017-09-28 12:31:42.203 1783 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:31:42 ctl02 nova-api[1783]: 2017-09-28 12:31:42.203 1783 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:31:42 ctl02 nova-api[1783]: 2017-09-28 12:31:42.207 1783 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:31:42 ctl02 nova-api[1783]: 2017-09-28 12:31:42.207 1783 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:31:42 ctl02 nova-api[1783]: 2017-09-28 12:31:42.207 1783 ERROR nova Traceback (most recent call last):
Sep 28 12:31:42 ctl02 nova-api[1783]: 2017-09-28 12:31:42.207 1783 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:31:42 ctl02 nova-api[1783]: 2017-09-28 12:31:42.207 1783 ERROR nova     sys.exit(main())
Sep 28 12:31:42 ctl02 nova-api[1783]: 2017-09-28 12:31:42.207 1783 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:31:42 ctl02 nova-api[1783]: 2017-09-28 12:31:42.207 1783 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:31:42 ctl02 nova-api[1783]: 2017-09-28 12:31:42.207 1783 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:31:42 ctl02 nova-api[1783]: 2017-09-28 12:31:42.207 1783 ERROR nova     max_url_len=max_url_len)
Sep 28 12:31:42 ctl02 nova-api[1783]: 2017-09-28 12:31:42.207 1783 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:31:42 ctl02 nova-api[1783]: 2017-09-28 12:31:42.207 1783 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:31:42 ctl02 nova-api[1783]: 2017-09-28 12:31:42.207 1783 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:31:42 ctl02 nova-api[1783]: 2017-09-28 12:31:42.207 1783 ERROR nova     sock.listen(backlog)
Sep 28 12:31:42 ctl02 nova-api[1783]: 2017-09-28 12:31:42.207 1783 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:31:42 ctl02 nova-api[1783]: 2017-09-28 12:31:42.207 1783 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:31:42 ctl02 nova-api[1783]: 2017-09-28 12:31:42.207 1783 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:31:42 ctl02 nova-api[1783]: 2017-09-28 12:31:42.207 1783 ERROR nova
Sep 28 12:31:42 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:31:42 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:31:42 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:31:42 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:31:42 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:31:42 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:31:42 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:31:42 ctl02 neutron-server[30536]: 2017-09-28 12:31:42.648 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:31:42] "OPTIONS / HTTP/1.0" 200 262 0.001084
Sep 28 12:31:43 ctl02 neutron-server[30536]: 2017-09-28 12:31:43.505 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:31:43 ctl02 glance-api[29183]: 2017-09-28 12:31:43.683 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:31:43] "OPTIONS / HTTP/1.0" 200 134 0.000543
Sep 28 12:31:43 ctl02 nova-consoleauth[5433]: 2017-09-28 12:31:43.717 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:31:44 ctl02 nova-api[1800]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:31:44 ctl02 nova-api[1800]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:31:44 ctl02 nova-api[1800]: 2017-09-28 12:31:44.496 1800 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:31:44 ctl02 nova-api[1800]: 2017-09-28 12:31:44.498 1800 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:31:44 ctl02 nova-api[1800]: 2017-09-28 12:31:44.498 1800 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:31:44 ctl02 nova-api[1800]: 2017-09-28 12:31:44.498 1800 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:31:44 ctl02 nova-api[1800]: 2017-09-28 12:31:44.498 1800 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:31:44 ctl02 nova-api[1800]: 2017-09-28 12:31:44.498 1800 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:31:44 ctl02 nova-api[1800]: 2017-09-28 12:31:44.498 1800 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:31:44 ctl02 nova-api[1800]: 2017-09-28 12:31:44.498 1800 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:31:44 ctl02 nova-api[1800]: 2017-09-28 12:31:44.498 1800 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:31:44 ctl02 nova-api[1800]: 2017-09-28 12:31:44.498 1800 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:31:44 ctl02 nova-api[1800]: 2017-09-28 12:31:44.498 1800 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:31:44 ctl02 nova-api[1800]: 2017-09-28 12:31:44.498 1800 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:31:44 ctl02 nova-api[1800]: 2017-09-28 12:31:44.498 1800 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:31:44 ctl02 nova-api[1800]: 2017-09-28 12:31:44.498 1800 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:31:44 ctl02 nova-api[1800]: 2017-09-28 12:31:44.498 1800 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:31:44 ctl02 nova-api[1800]: 2017-09-28 12:31:44.498 1800 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:31:44 ctl02 nova-api[1800]: 2017-09-28 12:31:44.498 1800 ERROR nova.wsgi     self.filename))
Sep 28 12:31:44 ctl02 nova-api[1800]: 2017-09-28 12:31:44.498 1800 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:31:44 ctl02 nova-api[1800]: 2017-09-28 12:31:44.498 1800 ERROR nova.wsgi
Sep 28 12:31:44 ctl02 nova-api[1800]: 2017-09-28 12:31:44.499 1800 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:31:44 ctl02 nova-api[1800]: 2017-09-28 12:31:44.627 1800 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:31:44 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:31:44.641 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:31:44] "OPTIONS / HTTP/1.0" 200 134 0.000382
Sep 28 12:31:44 ctl02 nova-api[1800]: 2017-09-28 12:31:44.840 1800 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:31:44 ctl02 nova-api[1800]: 2017-09-28 12:31:44.842 1800 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:31:44 ctl02 nova-api[1800]: 2017-09-28 12:31:44.843 1800 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:31:44 ctl02 nova-api[1800]: 2017-09-28 12:31:44.843 1800 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:31:44 ctl02 nova-api[1800]: 2017-09-28 12:31:44.974 1800 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:31:44 ctl02 nova-api[1800]: 2017-09-28 12:31:44.976 1800 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:31:44 ctl02 nova-api[1800]: 2017-09-28 12:31:44.976 1800 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:31:44 ctl02 nova-api[1800]: 2017-09-28 12:31:44.976 1800 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:31:44 ctl02 nova-api[1800]: 2017-09-28 12:31:44.980 1800 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:31:44 ctl02 nova-api[1800]: 2017-09-28 12:31:44.980 1800 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:31:44 ctl02 nova-api[1800]: 2017-09-28 12:31:44.980 1800 ERROR nova Traceback (most recent call last):
Sep 28 12:31:44 ctl02 nova-api[1800]: 2017-09-28 12:31:44.980 1800 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:31:44 ctl02 nova-api[1800]: 2017-09-28 12:31:44.980 1800 ERROR nova     sys.exit(main())
Sep 28 12:31:44 ctl02 nova-api[1800]: 2017-09-28 12:31:44.980 1800 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:31:44 ctl02 nova-api[1800]: 2017-09-28 12:31:44.980 1800 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:31:44 ctl02 nova-api[1800]: 2017-09-28 12:31:44.980 1800 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:31:44 ctl02 nova-api[1800]: 2017-09-28 12:31:44.980 1800 ERROR nova     max_url_len=max_url_len)
Sep 28 12:31:44 ctl02 nova-api[1800]: 2017-09-28 12:31:44.980 1800 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:31:44 ctl02 nova-api[1800]: 2017-09-28 12:31:44.980 1800 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:31:44 ctl02 nova-api[1800]: 2017-09-28 12:31:44.980 1800 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:31:44 ctl02 nova-api[1800]: 2017-09-28 12:31:44.980 1800 ERROR nova     sock.listen(backlog)
Sep 28 12:31:44 ctl02 nova-api[1800]: 2017-09-28 12:31:44.980 1800 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:31:44 ctl02 nova-api[1800]: 2017-09-28 12:31:44.980 1800 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:31:44 ctl02 nova-api[1800]: 2017-09-28 12:31:44.980 1800 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:31:44 ctl02 nova-api[1800]: 2017-09-28 12:31:44.980 1800 ERROR nova
Sep 28 12:31:45 ctl02 glance-api[29183]: 2017-09-28 12:31:45.065 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:31:45] "OPTIONS / HTTP/1.0" 200 134 0.000584
Sep 28 12:31:45 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:31:45 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:31:45 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:31:45 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:31:45 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:31:45 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:31:45 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:31:45 ctl02 heat-api[13008]: 2017-09-28 12:31:45.851 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:31:45] "OPTIONS / HTTP/1.0" 200 134 0.000686
Sep 28 12:31:45 ctl02 heat-engine[12803]: 2017-09-28 12:31:45.887 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:31:45 ctl02 heat-engine[12803]: 2017-09-28 12:31:45.888 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:31:45 ctl02 heat-engine[12803]: 2017-09-28 12:31:45.889 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:31:45 ctl02 heat-engine[12803]: 2017-09-28 12:31:45.892 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:31:46 ctl02 nova-scheduler[5620]: 2017-09-28 12:31:46.757 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:31:47 ctl02 nova-api[1819]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:31:47 ctl02 nova-api[1819]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:31:47 ctl02 heat-api[13008]: 2017-09-28 12:31:47.119 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:31:47] "OPTIONS / HTTP/1.0" 200 134 0.000669
Sep 28 12:31:47 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:31:47.214 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:31:47] "OPTIONS / HTTP/1.0" 200 134 0.000483
Sep 28 12:31:47 ctl02 nova-api[1819]: 2017-09-28 12:31:47.291 1819 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:31:47 ctl02 nova-api[1819]: 2017-09-28 12:31:47.292 1819 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:31:47 ctl02 nova-api[1819]: 2017-09-28 12:31:47.292 1819 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:31:47 ctl02 nova-api[1819]: 2017-09-28 12:31:47.292 1819 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:31:47 ctl02 nova-api[1819]: 2017-09-28 12:31:47.292 1819 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:31:47 ctl02 nova-api[1819]: 2017-09-28 12:31:47.292 1819 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:31:47 ctl02 nova-api[1819]: 2017-09-28 12:31:47.292 1819 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:31:47 ctl02 nova-api[1819]: 2017-09-28 12:31:47.292 1819 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:31:47 ctl02 nova-api[1819]: 2017-09-28 12:31:47.292 1819 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:31:47 ctl02 nova-api[1819]: 2017-09-28 12:31:47.292 1819 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:31:47 ctl02 nova-api[1819]: 2017-09-28 12:31:47.292 1819 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:31:47 ctl02 nova-api[1819]: 2017-09-28 12:31:47.292 1819 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:31:47 ctl02 nova-api[1819]: 2017-09-28 12:31:47.292 1819 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:31:47 ctl02 nova-api[1819]: 2017-09-28 12:31:47.292 1819 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:31:47 ctl02 nova-api[1819]: 2017-09-28 12:31:47.292 1819 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:31:47 ctl02 nova-api[1819]: 2017-09-28 12:31:47.292 1819 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:31:47 ctl02 nova-api[1819]: 2017-09-28 12:31:47.292 1819 ERROR nova.wsgi     self.filename))
Sep 28 12:31:47 ctl02 nova-api[1819]: 2017-09-28 12:31:47.292 1819 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:31:47 ctl02 nova-api[1819]: 2017-09-28 12:31:47.292 1819 ERROR nova.wsgi
Sep 28 12:31:47 ctl02 nova-api[1819]: 2017-09-28 12:31:47.294 1819 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:31:47 ctl02 nova-api[1819]: 2017-09-28 12:31:47.428 1819 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:31:47 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:31:47.664 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:31:47] "OPTIONS / HTTP/1.0" 200 134 0.000465
Sep 28 12:31:47 ctl02 nova-api[1819]: 2017-09-28 12:31:47.683 1819 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:31:47 ctl02 nova-api[1819]: 2017-09-28 12:31:47.686 1819 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:31:47 ctl02 nova-api[1819]: 2017-09-28 12:31:47.686 1819 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:31:47 ctl02 nova-api[1819]: 2017-09-28 12:31:47.687 1819 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:31:47 ctl02 nova-api[1819]: 2017-09-28 12:31:47.826 1819 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:31:47 ctl02 nova-api[1819]: 2017-09-28 12:31:47.829 1819 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:31:47 ctl02 nova-api[1819]: 2017-09-28 12:31:47.829 1819 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:31:47 ctl02 nova-api[1819]: 2017-09-28 12:31:47.830 1819 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:31:47 ctl02 nova-api[1819]: 2017-09-28 12:31:47.833 1819 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:31:47 ctl02 nova-api[1819]: 2017-09-28 12:31:47.834 1819 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:31:47 ctl02 nova-api[1819]: 2017-09-28 12:31:47.834 1819 ERROR nova Traceback (most recent call last):
Sep 28 12:31:47 ctl02 nova-api[1819]: 2017-09-28 12:31:47.834 1819 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:31:47 ctl02 nova-api[1819]: 2017-09-28 12:31:47.834 1819 ERROR nova     sys.exit(main())
Sep 28 12:31:47 ctl02 nova-api[1819]: 2017-09-28 12:31:47.834 1819 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:31:47 ctl02 nova-api[1819]: 2017-09-28 12:31:47.834 1819 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:31:47 ctl02 nova-api[1819]: 2017-09-28 12:31:47.834 1819 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:31:47 ctl02 nova-api[1819]: 2017-09-28 12:31:47.834 1819 ERROR nova     max_url_len=max_url_len)
Sep 28 12:31:47 ctl02 nova-api[1819]: 2017-09-28 12:31:47.834 1819 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:31:47 ctl02 nova-api[1819]: 2017-09-28 12:31:47.834 1819 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:31:47 ctl02 nova-api[1819]: 2017-09-28 12:31:47.834 1819 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:31:47 ctl02 nova-api[1819]: 2017-09-28 12:31:47.834 1819 ERROR nova     sock.listen(backlog)
Sep 28 12:31:47 ctl02 nova-api[1819]: 2017-09-28 12:31:47.834 1819 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:31:47 ctl02 nova-api[1819]: 2017-09-28 12:31:47.834 1819 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:31:47 ctl02 nova-api[1819]: 2017-09-28 12:31:47.834 1819 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:31:47 ctl02 nova-api[1819]: 2017-09-28 12:31:47.834 1819 ERROR nova
Sep 28 12:31:47 ctl02 heat-api-cfn[13300]: 2017-09-28 12:31:47.881 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:31:47] "OPTIONS / HTTP/1.0" 200 134 0.000521
Sep 28 12:31:48 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:31:48 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:31:48 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:31:48 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:31:48 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:31:48 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:31:48 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:31:48 ctl02 heat-api-cfn[13300]: 2017-09-28 12:31:48.866 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:31:48] "OPTIONS / HTTP/1.0" 200 134 0.000593
Sep 28 12:31:48 ctl02 heat-api[13008]: 2017-09-28 12:31:48.938 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:31:48] "OPTIONS / HTTP/1.0" 200 134 0.000550
Sep 28 12:31:49 ctl02 nova-api[1837]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:31:49 ctl02 nova-api[1837]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:31:49 ctl02 neutron-server[30536]: 2017-09-28 12:31:49.933 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:31:49] "OPTIONS / HTTP/1.0" 200 262 0.000523
Sep 28 12:31:49 ctl02 nova-api[1837]: 2017-09-28 12:31:49.975 1837 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:31:49 ctl02 nova-api[1837]: 2017-09-28 12:31:49.976 1837 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:31:49 ctl02 nova-api[1837]: 2017-09-28 12:31:49.976 1837 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:31:49 ctl02 nova-api[1837]: 2017-09-28 12:31:49.976 1837 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:31:49 ctl02 nova-api[1837]: 2017-09-28 12:31:49.976 1837 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:31:49 ctl02 nova-api[1837]: 2017-09-28 12:31:49.976 1837 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:31:49 ctl02 nova-api[1837]: 2017-09-28 12:31:49.976 1837 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:31:49 ctl02 nova-api[1837]: 2017-09-28 12:31:49.976 1837 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:31:49 ctl02 nova-api[1837]: 2017-09-28 12:31:49.976 1837 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:31:49 ctl02 nova-api[1837]: 2017-09-28 12:31:49.976 1837 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:31:49 ctl02 nova-api[1837]: 2017-09-28 12:31:49.976 1837 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:31:49 ctl02 nova-api[1837]: 2017-09-28 12:31:49.976 1837 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:31:49 ctl02 nova-api[1837]: 2017-09-28 12:31:49.976 1837 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:31:49 ctl02 nova-api[1837]: 2017-09-28 12:31:49.976 1837 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:31:49 ctl02 nova-api[1837]: 2017-09-28 12:31:49.976 1837 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:31:49 ctl02 nova-api[1837]: 2017-09-28 12:31:49.976 1837 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:31:49 ctl02 nova-api[1837]: 2017-09-28 12:31:49.976 1837 ERROR nova.wsgi     self.filename))
Sep 28 12:31:49 ctl02 nova-api[1837]: 2017-09-28 12:31:49.976 1837 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:31:49 ctl02 nova-api[1837]: 2017-09-28 12:31:49.976 1837 ERROR nova.wsgi
Sep 28 12:31:49 ctl02 nova-api[1837]: 2017-09-28 12:31:49.979 1837 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:31:50 ctl02 nova-api[1837]: 2017-09-28 12:31:50.112 1837 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:31:50 ctl02 nova-api[1837]: 2017-09-28 12:31:50.359 1837 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:31:50 ctl02 nova-api[1837]: 2017-09-28 12:31:50.362 1837 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:31:50 ctl02 nova-api[1837]: 2017-09-28 12:31:50.362 1837 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:31:50 ctl02 nova-api[1837]: 2017-09-28 12:31:50.362 1837 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:31:50 ctl02 heat-api-cfn[13300]: 2017-09-28 12:31:50.379 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:31:50] "OPTIONS / HTTP/1.0" 200 134 0.000589
Sep 28 12:31:50 ctl02 neutron-server[30536]: 2017-09-28 12:31:50.383 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:31:50] "OPTIONS / HTTP/1.0" 200 262 0.000518
Sep 28 12:31:50 ctl02 nova-api[1837]: 2017-09-28 12:31:50.499 1837 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:31:50 ctl02 nova-api[1837]: 2017-09-28 12:31:50.501 1837 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:31:50 ctl02 nova-api[1837]: 2017-09-28 12:31:50.502 1837 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:31:50 ctl02 nova-api[1837]: 2017-09-28 12:31:50.502 1837 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:31:50 ctl02 nova-api[1837]: 2017-09-28 12:31:50.505 1837 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:31:50 ctl02 nova-api[1837]: 2017-09-28 12:31:50.506 1837 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:31:50 ctl02 nova-api[1837]: 2017-09-28 12:31:50.506 1837 ERROR nova Traceback (most recent call last):
Sep 28 12:31:50 ctl02 nova-api[1837]: 2017-09-28 12:31:50.506 1837 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:31:50 ctl02 nova-api[1837]: 2017-09-28 12:31:50.506 1837 ERROR nova     sys.exit(main())
Sep 28 12:31:50 ctl02 nova-api[1837]: 2017-09-28 12:31:50.506 1837 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:31:50 ctl02 nova-api[1837]: 2017-09-28 12:31:50.506 1837 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:31:50 ctl02 nova-api[1837]: 2017-09-28 12:31:50.506 1837 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:31:50 ctl02 nova-api[1837]: 2017-09-28 12:31:50.506 1837 ERROR nova     max_url_len=max_url_len)
Sep 28 12:31:50 ctl02 nova-api[1837]: 2017-09-28 12:31:50.506 1837 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:31:50 ctl02 nova-api[1837]: 2017-09-28 12:31:50.506 1837 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:31:50 ctl02 nova-api[1837]: 2017-09-28 12:31:50.506 1837 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:31:50 ctl02 nova-api[1837]: 2017-09-28 12:31:50.506 1837 ERROR nova     sock.listen(backlog)
Sep 28 12:31:50 ctl02 nova-api[1837]: 2017-09-28 12:31:50.506 1837 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:31:50 ctl02 nova-api[1837]: 2017-09-28 12:31:50.506 1837 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:31:50 ctl02 nova-api[1837]: 2017-09-28 12:31:50.506 1837 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:31:50 ctl02 nova-api[1837]: 2017-09-28 12:31:50.506 1837 ERROR nova
Sep 28 12:31:50 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:31:50 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:31:50 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:31:50 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:31:50 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:31:50 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:31:50 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:31:51 ctl02 glance-api[29183]: 2017-09-28 12:31:51.328 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:31:51] "OPTIONS / HTTP/1.0" 200 134 0.000678
Sep 28 12:31:51 ctl02 neutron-server[30536]: 2017-09-28 12:31:51.401 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 12:31:51 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:31:51 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:30:08 cmp002
Sep 28 12:31:51 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:30:40 cmp002
Sep 28 12:31:51 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:30:06 cmp002
Sep 28 12:31:52 ctl02 neutron-server[30536]: 2017-09-28 12:31:52.289 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:31:52] "OPTIONS / HTTP/1.0" 200 262 0.000519
Sep 28 12:31:52 ctl02 nova-api[1854]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:31:52 ctl02 nova-api[1854]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:31:52 ctl02 nova-api[1854]: 2017-09-28 12:31:52.771 1854 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:31:52 ctl02 nova-api[1854]: 2017-09-28 12:31:52.773 1854 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:31:52 ctl02 nova-api[1854]: 2017-09-28 12:31:52.773 1854 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:31:52 ctl02 nova-api[1854]: 2017-09-28 12:31:52.773 1854 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:31:52 ctl02 nova-api[1854]: 2017-09-28 12:31:52.773 1854 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:31:52 ctl02 nova-api[1854]: 2017-09-28 12:31:52.773 1854 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:31:52 ctl02 nova-api[1854]: 2017-09-28 12:31:52.773 1854 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:31:52 ctl02 nova-api[1854]: 2017-09-28 12:31:52.773 1854 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:31:52 ctl02 nova-api[1854]: 2017-09-28 12:31:52.773 1854 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:31:52 ctl02 nova-api[1854]: 2017-09-28 12:31:52.773 1854 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:31:52 ctl02 nova-api[1854]: 2017-09-28 12:31:52.773 1854 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:31:52 ctl02 nova-api[1854]: 2017-09-28 12:31:52.773 1854 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:31:52 ctl02 nova-api[1854]: 2017-09-28 12:31:52.773 1854 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:31:52 ctl02 nova-api[1854]: 2017-09-28 12:31:52.773 1854 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:31:52 ctl02 nova-api[1854]: 2017-09-28 12:31:52.773 1854 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:31:52 ctl02 nova-api[1854]: 2017-09-28 12:31:52.773 1854 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:31:52 ctl02 nova-api[1854]: 2017-09-28 12:31:52.773 1854 ERROR nova.wsgi     self.filename))
Sep 28 12:31:52 ctl02 nova-api[1854]: 2017-09-28 12:31:52.773 1854 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:31:52 ctl02 nova-api[1854]: 2017-09-28 12:31:52.773 1854 ERROR nova.wsgi
Sep 28 12:31:52 ctl02 nova-api[1854]: 2017-09-28 12:31:52.774 1854 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:31:52 ctl02 nova-api[1854]: 2017-09-28 12:31:52.904 1854 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:31:53 ctl02 nova-api[1854]: 2017-09-28 12:31:53.154 1854 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:31:53 ctl02 nova-api[1854]: 2017-09-28 12:31:53.156 1854 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:31:53 ctl02 nova-api[1854]: 2017-09-28 12:31:53.157 1854 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:31:53 ctl02 nova-api[1854]: 2017-09-28 12:31:53.157 1854 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:31:53 ctl02 nova-api[1854]: 2017-09-28 12:31:53.290 1854 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:31:53 ctl02 nova-api[1854]: 2017-09-28 12:31:53.292 1854 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:31:53 ctl02 nova-api[1854]: 2017-09-28 12:31:53.293 1854 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:31:53 ctl02 nova-api[1854]: 2017-09-28 12:31:53.293 1854 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:31:53 ctl02 nova-api[1854]: 2017-09-28 12:31:53.296 1854 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:31:53 ctl02 nova-api[1854]: 2017-09-28 12:31:53.296 1854 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:31:53 ctl02 nova-api[1854]: 2017-09-28 12:31:53.296 1854 ERROR nova Traceback (most recent call last):
Sep 28 12:31:53 ctl02 nova-api[1854]: 2017-09-28 12:31:53.296 1854 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:31:53 ctl02 nova-api[1854]: 2017-09-28 12:31:53.296 1854 ERROR nova     sys.exit(main())
Sep 28 12:31:53 ctl02 nova-api[1854]: 2017-09-28 12:31:53.296 1854 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:31:53 ctl02 nova-api[1854]: 2017-09-28 12:31:53.296 1854 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:31:53 ctl02 nova-api[1854]: 2017-09-28 12:31:53.296 1854 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:31:53 ctl02 nova-api[1854]: 2017-09-28 12:31:53.296 1854 ERROR nova     max_url_len=max_url_len)
Sep 28 12:31:53 ctl02 nova-api[1854]: 2017-09-28 12:31:53.296 1854 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:31:53 ctl02 nova-api[1854]: 2017-09-28 12:31:53.296 1854 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:31:53 ctl02 nova-api[1854]: 2017-09-28 12:31:53.296 1854 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:31:53 ctl02 nova-api[1854]: 2017-09-28 12:31:53.296 1854 ERROR nova     sock.listen(backlog)
Sep 28 12:31:53 ctl02 nova-api[1854]: 2017-09-28 12:31:53.296 1854 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:31:53 ctl02 nova-api[1854]: 2017-09-28 12:31:53.296 1854 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:31:53 ctl02 nova-api[1854]: 2017-09-28 12:31:53.296 1854 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:31:53 ctl02 nova-api[1854]: 2017-09-28 12:31:53.296 1854 ERROR nova
Sep 28 12:31:53 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:31:53 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:31:53 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:31:53 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:31:53 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:31:53 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:31:53 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:31:53 ctl02 glance-api[29183]: 2017-09-28 12:31:53.767 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:31:53] "OPTIONS / HTTP/1.0" 200 134 0.000709
Sep 28 12:31:54 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:31:54.415 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:31:54] "OPTIONS / HTTP/1.0" 200 134 0.000501
Sep 28 12:31:55 ctl02 glance-api[29183]: 2017-09-28 12:31:55.119 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:31:55] "OPTIONS / HTTP/1.0" 200 134 0.000997
Sep 28 12:31:55 ctl02 nova-api[1874]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:31:55 ctl02 nova-api[1874]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:31:55 ctl02 heat-api[13008]: 2017-09-28 12:31:55.507 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:31:55] "OPTIONS / HTTP/1.0" 200 134 0.000622
Sep 28 12:31:55 ctl02 nova-api[1874]: 2017-09-28 12:31:55.557 1874 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:31:55 ctl02 nova-api[1874]: 2017-09-28 12:31:55.559 1874 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:31:55 ctl02 nova-api[1874]: 2017-09-28 12:31:55.559 1874 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:31:55 ctl02 nova-api[1874]: 2017-09-28 12:31:55.559 1874 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:31:55 ctl02 nova-api[1874]: 2017-09-28 12:31:55.559 1874 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:31:55 ctl02 nova-api[1874]: 2017-09-28 12:31:55.559 1874 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:31:55 ctl02 nova-api[1874]: 2017-09-28 12:31:55.559 1874 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:31:55 ctl02 nova-api[1874]: 2017-09-28 12:31:55.559 1874 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:31:55 ctl02 nova-api[1874]: 2017-09-28 12:31:55.559 1874 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:31:55 ctl02 nova-api[1874]: 2017-09-28 12:31:55.559 1874 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:31:55 ctl02 nova-api[1874]: 2017-09-28 12:31:55.559 1874 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:31:55 ctl02 nova-api[1874]: 2017-09-28 12:31:55.559 1874 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:31:55 ctl02 nova-api[1874]: 2017-09-28 12:31:55.559 1874 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:31:55 ctl02 nova-api[1874]: 2017-09-28 12:31:55.559 1874 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:31:55 ctl02 nova-api[1874]: 2017-09-28 12:31:55.559 1874 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:31:55 ctl02 nova-api[1874]: 2017-09-28 12:31:55.559 1874 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:31:55 ctl02 nova-api[1874]: 2017-09-28 12:31:55.559 1874 ERROR nova.wsgi     self.filename))
Sep 28 12:31:55 ctl02 nova-api[1874]: 2017-09-28 12:31:55.559 1874 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:31:55 ctl02 nova-api[1874]: 2017-09-28 12:31:55.559 1874 ERROR nova.wsgi
Sep 28 12:31:55 ctl02 nova-api[1874]: 2017-09-28 12:31:55.562 1874 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:31:55 ctl02 nova-api[1874]: 2017-09-28 12:31:55.695 1874 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:31:55 ctl02 nova-api[1874]: 2017-09-28 12:31:55.943 1874 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:31:55 ctl02 nova-api[1874]: 2017-09-28 12:31:55.945 1874 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:31:55 ctl02 nova-api[1874]: 2017-09-28 12:31:55.945 1874 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:31:55 ctl02 nova-api[1874]: 2017-09-28 12:31:55.946 1874 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:31:56 ctl02 nova-api[1874]: 2017-09-28 12:31:56.080 1874 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:31:56 ctl02 nova-api[1874]: 2017-09-28 12:31:56.083 1874 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:31:56 ctl02 nova-api[1874]: 2017-09-28 12:31:56.084 1874 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:31:56 ctl02 nova-api[1874]: 2017-09-28 12:31:56.084 1874 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:31:56 ctl02 nova-api[1874]: 2017-09-28 12:31:56.088 1874 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:31:56 ctl02 nova-api[1874]: 2017-09-28 12:31:56.089 1874 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:31:56 ctl02 nova-api[1874]: 2017-09-28 12:31:56.089 1874 ERROR nova Traceback (most recent call last):
Sep 28 12:31:56 ctl02 nova-api[1874]: 2017-09-28 12:31:56.089 1874 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:31:56 ctl02 nova-api[1874]: 2017-09-28 12:31:56.089 1874 ERROR nova     sys.exit(main())
Sep 28 12:31:56 ctl02 nova-api[1874]: 2017-09-28 12:31:56.089 1874 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:31:56 ctl02 nova-api[1874]: 2017-09-28 12:31:56.089 1874 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:31:56 ctl02 nova-api[1874]: 2017-09-28 12:31:56.089 1874 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:31:56 ctl02 nova-api[1874]: 2017-09-28 12:31:56.089 1874 ERROR nova     max_url_len=max_url_len)
Sep 28 12:31:56 ctl02 nova-api[1874]: 2017-09-28 12:31:56.089 1874 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:31:56 ctl02 nova-api[1874]: 2017-09-28 12:31:56.089 1874 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:31:56 ctl02 nova-api[1874]: 2017-09-28 12:31:56.089 1874 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:31:56 ctl02 nova-api[1874]: 2017-09-28 12:31:56.089 1874 ERROR nova     sock.listen(backlog)
Sep 28 12:31:56 ctl02 nova-api[1874]: 2017-09-28 12:31:56.089 1874 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:31:56 ctl02 nova-api[1874]: 2017-09-28 12:31:56.089 1874 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:31:56 ctl02 nova-api[1874]: 2017-09-28 12:31:56.089 1874 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:31:56 ctl02 nova-api[1874]: 2017-09-28 12:31:56.089 1874 ERROR nova
Sep 28 12:31:56 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:31:56 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:31:56 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:31:56 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:31:56 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:31:56 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:31:56 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:31:56 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:31:56.878 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:31:56] "OPTIONS / HTTP/1.0" 200 134 0.000415
Sep 28 12:31:57 ctl02 heat-api[13008]: 2017-09-28 12:31:57.385 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:31:57] "OPTIONS / HTTP/1.0" 200 134 0.000522
Sep 28 12:31:57 ctl02 heat-api-cfn[13300]: 2017-09-28 12:31:57.547 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:31:57] "OPTIONS / HTTP/1.0" 200 134 0.000574
Sep 28 12:31:57 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:31:57.986 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:31:57] "OPTIONS / HTTP/1.0" 200 134 0.000413
Sep 28 12:31:58 ctl02 nova-api[1891]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:31:58 ctl02 nova-api[1891]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:31:58 ctl02 nova-api[1891]: 2017-09-28 12:31:58.214 1891 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:31:58 ctl02 nova-api[1891]: 2017-09-28 12:31:58.216 1891 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:31:58 ctl02 nova-api[1891]: 2017-09-28 12:31:58.216 1891 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:31:58 ctl02 nova-api[1891]: 2017-09-28 12:31:58.216 1891 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:31:58 ctl02 nova-api[1891]: 2017-09-28 12:31:58.216 1891 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:31:58 ctl02 nova-api[1891]: 2017-09-28 12:31:58.216 1891 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:31:58 ctl02 nova-api[1891]: 2017-09-28 12:31:58.216 1891 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:31:58 ctl02 nova-api[1891]: 2017-09-28 12:31:58.216 1891 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:31:58 ctl02 nova-api[1891]: 2017-09-28 12:31:58.216 1891 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:31:58 ctl02 nova-api[1891]: 2017-09-28 12:31:58.216 1891 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:31:58 ctl02 nova-api[1891]: 2017-09-28 12:31:58.216 1891 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:31:58 ctl02 nova-api[1891]: 2017-09-28 12:31:58.216 1891 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:31:58 ctl02 nova-api[1891]: 2017-09-28 12:31:58.216 1891 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:31:58 ctl02 nova-api[1891]: 2017-09-28 12:31:58.216 1891 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:31:58 ctl02 nova-api[1891]: 2017-09-28 12:31:58.216 1891 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:31:58 ctl02 nova-api[1891]: 2017-09-28 12:31:58.216 1891 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:31:58 ctl02 nova-api[1891]: 2017-09-28 12:31:58.216 1891 ERROR nova.wsgi     self.filename))
Sep 28 12:31:58 ctl02 nova-api[1891]: 2017-09-28 12:31:58.216 1891 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:31:58 ctl02 nova-api[1891]: 2017-09-28 12:31:58.216 1891 ERROR nova.wsgi
Sep 28 12:31:58 ctl02 nova-api[1891]: 2017-09-28 12:31:58.217 1891 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:31:58 ctl02 nova-api[1891]: 2017-09-28 12:31:58.343 1891 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:31:58 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcdd28a11)
Sep 28 12:31:58 ctl02 nova-api[1891]: 2017-09-28 12:31:58.564 1891 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:31:58 ctl02 nova-api[1891]: 2017-09-28 12:31:58.566 1891 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:31:58 ctl02 nova-api[1891]: 2017-09-28 12:31:58.566 1891 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:31:58 ctl02 nova-api[1891]: 2017-09-28 12:31:58.567 1891 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:31:58 ctl02 nova-api[1891]: 2017-09-28 12:31:58.697 1891 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:31:58 ctl02 nova-api[1891]: 2017-09-28 12:31:58.698 1891 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:31:58 ctl02 nova-api[1891]: 2017-09-28 12:31:58.699 1891 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:31:58 ctl02 nova-api[1891]: 2017-09-28 12:31:58.699 1891 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:31:58 ctl02 nova-api[1891]: 2017-09-28 12:31:58.702 1891 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:31:58 ctl02 nova-api[1891]: 2017-09-28 12:31:58.702 1891 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:31:58 ctl02 nova-api[1891]: 2017-09-28 12:31:58.702 1891 ERROR nova Traceback (most recent call last):
Sep 28 12:31:58 ctl02 nova-api[1891]: 2017-09-28 12:31:58.702 1891 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:31:58 ctl02 nova-api[1891]: 2017-09-28 12:31:58.702 1891 ERROR nova     sys.exit(main())
Sep 28 12:31:58 ctl02 nova-api[1891]: 2017-09-28 12:31:58.702 1891 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:31:58 ctl02 nova-api[1891]: 2017-09-28 12:31:58.702 1891 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:31:58 ctl02 nova-api[1891]: 2017-09-28 12:31:58.702 1891 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:31:58 ctl02 nova-api[1891]: 2017-09-28 12:31:58.702 1891 ERROR nova     max_url_len=max_url_len)
Sep 28 12:31:58 ctl02 nova-api[1891]: 2017-09-28 12:31:58.702 1891 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:31:58 ctl02 nova-api[1891]: 2017-09-28 12:31:58.702 1891 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:31:58 ctl02 nova-api[1891]: 2017-09-28 12:31:58.702 1891 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:31:58 ctl02 nova-api[1891]: 2017-09-28 12:31:58.702 1891 ERROR nova     sock.listen(backlog)
Sep 28 12:31:58 ctl02 nova-api[1891]: 2017-09-28 12:31:58.702 1891 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:31:58 ctl02 nova-api[1891]: 2017-09-28 12:31:58.702 1891 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:31:58 ctl02 nova-api[1891]: 2017-09-28 12:31:58.702 1891 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:31:58 ctl02 nova-api[1891]: 2017-09-28 12:31:58.702 1891 ERROR nova
Sep 28 12:31:58 ctl02 heat-api-cfn[13300]: 2017-09-28 12:31:58.716 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:31:58] "OPTIONS / HTTP/1.0" 200 134 0.000572
Sep 28 12:31:58 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:31:58 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:31:58 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:31:59 ctl02 heat-api[13008]: 2017-09-28 12:31:59.072 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:31:59] "OPTIONS / HTTP/1.0" 200 134 0.000809
Sep 28 12:31:59 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:31:59 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:31:59 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:31:59 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:31:59 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcdd28a11)
Sep 28 12:31:59 ctl02 neutron-server[30536]: 2017-09-28 12:31:59.683 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:31:59] "OPTIONS / HTTP/1.0" 200 262 0.000445
Sep 28 12:32:00 ctl02 heat-api-cfn[13300]: 2017-09-28 12:32:00.066 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:32:00] "OPTIONS / HTTP/1.0" 200 134 0.000436
Sep 28 12:32:00 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcdd28a11)
Sep 28 12:32:00 ctl02 neutron-server[30536]: 2017-09-28 12:32:00.719 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:32:00] "OPTIONS / HTTP/1.0" 200 262 0.000475
Sep 28 12:32:00 ctl02 nova-api[1910]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:32:00 ctl02 nova-api[1910]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:32:00 ctl02 nova-api[1910]: 2017-09-28 12:32:00.997 1910 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:32:01 ctl02 nova-api[1910]: 2017-09-28 12:32:00.999 1910 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:32:01 ctl02 nova-api[1910]: 2017-09-28 12:32:00.999 1910 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:32:01 ctl02 nova-api[1910]: 2017-09-28 12:32:00.999 1910 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:32:01 ctl02 nova-api[1910]: 2017-09-28 12:32:00.999 1910 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:32:01 ctl02 nova-api[1910]: 2017-09-28 12:32:00.999 1910 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:32:01 ctl02 nova-api[1910]: 2017-09-28 12:32:00.999 1910 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:32:01 ctl02 nova-api[1910]: 2017-09-28 12:32:00.999 1910 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:32:01 ctl02 nova-api[1910]: 2017-09-28 12:32:00.999 1910 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:32:01 ctl02 nova-api[1910]: 2017-09-28 12:32:00.999 1910 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:32:01 ctl02 nova-api[1910]: 2017-09-28 12:32:00.999 1910 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:32:01 ctl02 nova-api[1910]: 2017-09-28 12:32:00.999 1910 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:32:01 ctl02 nova-api[1910]: 2017-09-28 12:32:00.999 1910 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:32:01 ctl02 nova-api[1910]: 2017-09-28 12:32:00.999 1910 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:32:01 ctl02 nova-api[1910]: 2017-09-28 12:32:00.999 1910 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:32:01 ctl02 nova-api[1910]: 2017-09-28 12:32:00.999 1910 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:32:01 ctl02 nova-api[1910]: 2017-09-28 12:32:00.999 1910 ERROR nova.wsgi     self.filename))
Sep 28 12:32:01 ctl02 nova-api[1910]: 2017-09-28 12:32:00.999 1910 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:32:01 ctl02 nova-api[1910]: 2017-09-28 12:32:00.999 1910 ERROR nova.wsgi
Sep 28 12:32:01 ctl02 nova-api[1910]: 2017-09-28 12:32:01.001 1910 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:32:01 ctl02 nova-api[1910]: 2017-09-28 12:32:01.132 1910 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:32:01 ctl02 nova-api[1910]: 2017-09-28 12:32:01.356 1910 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:32:01 ctl02 nova-api[1910]: 2017-09-28 12:32:01.359 1910 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:32:01 ctl02 nova-api[1910]: 2017-09-28 12:32:01.359 1910 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:32:01 ctl02 nova-api[1910]: 2017-09-28 12:32:01.359 1910 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:32:01 ctl02 nova-api[1910]: 2017-09-28 12:32:01.491 1910 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:32:01 ctl02 nova-api[1910]: 2017-09-28 12:32:01.494 1910 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:32:01 ctl02 nova-api[1910]: 2017-09-28 12:32:01.494 1910 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:32:01 ctl02 nova-api[1910]: 2017-09-28 12:32:01.494 1910 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:32:01 ctl02 nova-api[1910]: 2017-09-28 12:32:01.498 1910 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:32:01 ctl02 nova-api[1910]: 2017-09-28 12:32:01.499 1910 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:32:01 ctl02 nova-api[1910]: 2017-09-28 12:32:01.499 1910 ERROR nova Traceback (most recent call last):
Sep 28 12:32:01 ctl02 nova-api[1910]: 2017-09-28 12:32:01.499 1910 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:32:01 ctl02 nova-api[1910]: 2017-09-28 12:32:01.499 1910 ERROR nova     sys.exit(main())
Sep 28 12:32:01 ctl02 nova-api[1910]: 2017-09-28 12:32:01.499 1910 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:32:01 ctl02 nova-api[1910]: 2017-09-28 12:32:01.499 1910 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:32:01 ctl02 nova-api[1910]: 2017-09-28 12:32:01.499 1910 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:32:01 ctl02 nova-api[1910]: 2017-09-28 12:32:01.499 1910 ERROR nova     max_url_len=max_url_len)
Sep 28 12:32:01 ctl02 nova-api[1910]: 2017-09-28 12:32:01.499 1910 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:32:01 ctl02 nova-api[1910]: 2017-09-28 12:32:01.499 1910 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:32:01 ctl02 nova-api[1910]: 2017-09-28 12:32:01.499 1910 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:32:01 ctl02 nova-api[1910]: 2017-09-28 12:32:01.499 1910 ERROR nova     sock.listen(backlog)
Sep 28 12:32:01 ctl02 nova-api[1910]: 2017-09-28 12:32:01.499 1910 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:32:01 ctl02 nova-api[1910]: 2017-09-28 12:32:01.499 1910 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:32:01 ctl02 nova-api[1910]: 2017-09-28 12:32:01.499 1910 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:32:01 ctl02 nova-api[1910]: 2017-09-28 12:32:01.499 1910 ERROR nova
Sep 28 12:32:01 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcdd28a11)
Sep 28 12:32:01 ctl02 glance-api[29183]: 2017-09-28 12:32:01.592 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:32:01] "OPTIONS / HTTP/1.0" 200 134 0.000590
Sep 28 12:32:01 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:32:01 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:32:01 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:32:01 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:32:01 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:32:01 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:32:01 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:32:02 ctl02 neutron-server[30536]: 2017-09-28 12:32:02.460 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:32:02] "OPTIONS / HTTP/1.0" 200 262 0.000473
Sep 28 12:32:02 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcdd28a11)
Sep 28 12:32:03 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcdd28a11)
Sep 28 12:32:03 ctl02 nova-api[1928]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:32:03 ctl02 nova-api[1928]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:32:03 ctl02 nova-api[1928]: 2017-09-28 12:32:03.711 1928 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:32:03 ctl02 nova-api[1928]: 2017-09-28 12:32:03.712 1928 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:32:03 ctl02 nova-api[1928]: 2017-09-28 12:32:03.712 1928 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:32:03 ctl02 nova-api[1928]: 2017-09-28 12:32:03.712 1928 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:32:03 ctl02 nova-api[1928]: 2017-09-28 12:32:03.712 1928 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:32:03 ctl02 nova-api[1928]: 2017-09-28 12:32:03.712 1928 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:32:03 ctl02 nova-api[1928]: 2017-09-28 12:32:03.712 1928 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:32:03 ctl02 nova-api[1928]: 2017-09-28 12:32:03.712 1928 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:32:03 ctl02 nova-api[1928]: 2017-09-28 12:32:03.712 1928 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:32:03 ctl02 nova-api[1928]: 2017-09-28 12:32:03.712 1928 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:32:03 ctl02 nova-api[1928]: 2017-09-28 12:32:03.712 1928 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:32:03 ctl02 nova-api[1928]: 2017-09-28 12:32:03.712 1928 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:32:03 ctl02 nova-api[1928]: 2017-09-28 12:32:03.712 1928 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:32:03 ctl02 nova-api[1928]: 2017-09-28 12:32:03.712 1928 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:32:03 ctl02 nova-api[1928]: 2017-09-28 12:32:03.712 1928 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:32:03 ctl02 nova-api[1928]: 2017-09-28 12:32:03.712 1928 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:32:03 ctl02 nova-api[1928]: 2017-09-28 12:32:03.712 1928 ERROR nova.wsgi     self.filename))
Sep 28 12:32:03 ctl02 nova-api[1928]: 2017-09-28 12:32:03.712 1928 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:32:03 ctl02 nova-api[1928]: 2017-09-28 12:32:03.712 1928 ERROR nova.wsgi
Sep 28 12:32:03 ctl02 nova-api[1928]: 2017-09-28 12:32:03.713 1928 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:32:03 ctl02 nova-api[1928]: 2017-09-28 12:32:03.838 1928 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:32:03 ctl02 glance-api[29183]: 2017-09-28 12:32:03.972 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:32:03] "OPTIONS / HTTP/1.0" 200 134 0.000591
Sep 28 12:32:04 ctl02 nova-api[1928]: 2017-09-28 12:32:04.060 1928 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:32:04 ctl02 nova-api[1928]: 2017-09-28 12:32:04.062 1928 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:32:04 ctl02 nova-api[1928]: 2017-09-28 12:32:04.062 1928 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:32:04 ctl02 nova-api[1928]: 2017-09-28 12:32:04.063 1928 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:32:04 ctl02 nova-api[1928]: 2017-09-28 12:32:04.191 1928 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:32:04 ctl02 nova-api[1928]: 2017-09-28 12:32:04.193 1928 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:32:04 ctl02 nova-api[1928]: 2017-09-28 12:32:04.193 1928 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:32:04 ctl02 nova-api[1928]: 2017-09-28 12:32:04.193 1928 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:32:04 ctl02 nova-api[1928]: 2017-09-28 12:32:04.196 1928 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:32:04 ctl02 nova-api[1928]: 2017-09-28 12:32:04.197 1928 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:32:04 ctl02 nova-api[1928]: 2017-09-28 12:32:04.197 1928 ERROR nova Traceback (most recent call last):
Sep 28 12:32:04 ctl02 nova-api[1928]: 2017-09-28 12:32:04.197 1928 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:32:04 ctl02 nova-api[1928]: 2017-09-28 12:32:04.197 1928 ERROR nova     sys.exit(main())
Sep 28 12:32:04 ctl02 nova-api[1928]: 2017-09-28 12:32:04.197 1928 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:32:04 ctl02 nova-api[1928]: 2017-09-28 12:32:04.197 1928 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:32:04 ctl02 nova-api[1928]: 2017-09-28 12:32:04.197 1928 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:32:04 ctl02 nova-api[1928]: 2017-09-28 12:32:04.197 1928 ERROR nova     max_url_len=max_url_len)
Sep 28 12:32:04 ctl02 nova-api[1928]: 2017-09-28 12:32:04.197 1928 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:32:04 ctl02 nova-api[1928]: 2017-09-28 12:32:04.197 1928 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:32:04 ctl02 nova-api[1928]: 2017-09-28 12:32:04.197 1928 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:32:04 ctl02 nova-api[1928]: 2017-09-28 12:32:04.197 1928 ERROR nova     sock.listen(backlog)
Sep 28 12:32:04 ctl02 nova-api[1928]: 2017-09-28 12:32:04.197 1928 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:32:04 ctl02 nova-api[1928]: 2017-09-28 12:32:04.197 1928 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:32:04 ctl02 nova-api[1928]: 2017-09-28 12:32:04.197 1928 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:32:04 ctl02 nova-api[1928]: 2017-09-28 12:32:04.197 1928 ERROR nova
Sep 28 12:32:04 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:32:04 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:32:04 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:32:04 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcdd28a11)
Sep 28 12:32:04 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:32:04.523 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:32:04] "OPTIONS / HTTP/1.0" 200 134 0.000587
Sep 28 12:32:04 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:32:04 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:32:04 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:32:04 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:32:04 ctl02 glance-api[29183]: 2017-09-28 12:32:04.930 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:32:04] "OPTIONS / HTTP/1.0" 200 134 0.000711
Sep 28 12:32:05 ctl02 heat-api[13008]: 2017-09-28 12:32:05.269 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:32:05] "OPTIONS / HTTP/1.0" 200 134 0.000659
Sep 28 12:32:05 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcdd28a11)
Sep 28 12:32:05 ctl02 nova-cert[4860]: 2017-09-28 12:32:05.873 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:32:06 ctl02 nova-api[1945]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:32:06 ctl02 nova-api[1945]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:32:06 ctl02 neutron-server[30536]: 2017-09-28 12:32:06.408 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 2 dead agents out of 6:
Sep 28 12:32:06 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:32:06 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:30:08 cmp002
Sep 28 12:32:06 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:30:40 cmp002
Sep 28 12:32:06 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcdd28a11)
Sep 28 12:32:06 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:32:06.534 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:32:06] "OPTIONS / HTTP/1.0" 200 134 0.000451
Sep 28 12:32:06 ctl02 nova-api[1945]: 2017-09-28 12:32:06.544 1945 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:32:06 ctl02 nova-api[1945]: 2017-09-28 12:32:06.546 1945 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:32:06 ctl02 nova-api[1945]: 2017-09-28 12:32:06.546 1945 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:32:06 ctl02 nova-api[1945]: 2017-09-28 12:32:06.546 1945 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:32:06 ctl02 nova-api[1945]: 2017-09-28 12:32:06.546 1945 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:32:06 ctl02 nova-api[1945]: 2017-09-28 12:32:06.546 1945 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:32:06 ctl02 nova-api[1945]: 2017-09-28 12:32:06.546 1945 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:32:06 ctl02 nova-api[1945]: 2017-09-28 12:32:06.546 1945 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:32:06 ctl02 nova-api[1945]: 2017-09-28 12:32:06.546 1945 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:32:06 ctl02 nova-api[1945]: 2017-09-28 12:32:06.546 1945 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:32:06 ctl02 nova-api[1945]: 2017-09-28 12:32:06.546 1945 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:32:06 ctl02 nova-api[1945]: 2017-09-28 12:32:06.546 1945 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:32:06 ctl02 nova-api[1945]: 2017-09-28 12:32:06.546 1945 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:32:06 ctl02 nova-api[1945]: 2017-09-28 12:32:06.546 1945 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:32:06 ctl02 nova-api[1945]: 2017-09-28 12:32:06.546 1945 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:32:06 ctl02 nova-api[1945]: 2017-09-28 12:32:06.546 1945 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:32:06 ctl02 nova-api[1945]: 2017-09-28 12:32:06.546 1945 ERROR nova.wsgi     self.filename))
Sep 28 12:32:06 ctl02 nova-api[1945]: 2017-09-28 12:32:06.546 1945 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:32:06 ctl02 nova-api[1945]: 2017-09-28 12:32:06.546 1945 ERROR nova.wsgi
Sep 28 12:32:06 ctl02 nova-api[1945]: 2017-09-28 12:32:06.547 1945 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:32:06 ctl02 nova-api[1945]: 2017-09-28 12:32:06.688 1945 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:32:06 ctl02 nova-conductor[5056]: 2017-09-28 12:32:06.769 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:32:06 ctl02 nova-conductor[5056]: 2017-09-28 12:32:06.787 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:32:06 ctl02 nova-conductor[5056]: 2017-09-28 12:32:06.797 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:32:06 ctl02 nova-conductor[5056]: 2017-09-28 12:32:06.802 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:32:06 ctl02 nova-api[1945]: 2017-09-28 12:32:06.952 1945 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:32:06 ctl02 nova-api[1945]: 2017-09-28 12:32:06.954 1945 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:32:06 ctl02 nova-api[1945]: 2017-09-28 12:32:06.954 1945 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:32:06 ctl02 nova-api[1945]: 2017-09-28 12:32:06.955 1945 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:32:07 ctl02 nova-api[1945]: 2017-09-28 12:32:07.090 1945 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:32:07 ctl02 nova-api[1945]: 2017-09-28 12:32:07.093 1945 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:32:07 ctl02 nova-api[1945]: 2017-09-28 12:32:07.094 1945 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:32:07 ctl02 nova-api[1945]: 2017-09-28 12:32:07.094 1945 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:32:07 ctl02 nova-api[1945]: 2017-09-28 12:32:07.098 1945 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:32:07 ctl02 nova-api[1945]: 2017-09-28 12:32:07.098 1945 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:32:07 ctl02 nova-api[1945]: 2017-09-28 12:32:07.098 1945 ERROR nova Traceback (most recent call last):
Sep 28 12:32:07 ctl02 nova-api[1945]: 2017-09-28 12:32:07.098 1945 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:32:07 ctl02 nova-api[1945]: 2017-09-28 12:32:07.098 1945 ERROR nova     sys.exit(main())
Sep 28 12:32:07 ctl02 nova-api[1945]: 2017-09-28 12:32:07.098 1945 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:32:07 ctl02 nova-api[1945]: 2017-09-28 12:32:07.098 1945 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:32:07 ctl02 nova-api[1945]: 2017-09-28 12:32:07.098 1945 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:32:07 ctl02 nova-api[1945]: 2017-09-28 12:32:07.098 1945 ERROR nova     max_url_len=max_url_len)
Sep 28 12:32:07 ctl02 nova-api[1945]: 2017-09-28 12:32:07.098 1945 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:32:07 ctl02 nova-api[1945]: 2017-09-28 12:32:07.098 1945 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:32:07 ctl02 nova-api[1945]: 2017-09-28 12:32:07.098 1945 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:32:07 ctl02 nova-api[1945]: 2017-09-28 12:32:07.098 1945 ERROR nova     sock.listen(backlog)
Sep 28 12:32:07 ctl02 nova-api[1945]: 2017-09-28 12:32:07.098 1945 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:32:07 ctl02 nova-api[1945]: 2017-09-28 12:32:07.098 1945 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:32:07 ctl02 nova-api[1945]: 2017-09-28 12:32:07.098 1945 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:32:07 ctl02 nova-api[1945]: 2017-09-28 12:32:07.098 1945 ERROR nova
Sep 28 12:32:07 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:32:07 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:32:07 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:32:07 ctl02 heat-api-cfn[13300]: 2017-09-28 12:32:07.290 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:32:07] "OPTIONS / HTTP/1.0" 200 134 0.000523
Sep 28 12:32:07 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:32:07 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:32:07 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:32:07 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:32:07 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcdd28a11)
Sep 28 12:32:07 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:32:07.720 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:32:07] "OPTIONS / HTTP/1.0" 200 134 0.000531
Sep 28 12:32:07 ctl02 heat-api[13008]: 2017-09-28 12:32:07.752 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:32:07] "OPTIONS / HTTP/1.0" 200 134 0.000648
Sep 28 12:32:08 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcdd28a11)
Sep 28 12:32:08 ctl02 heat-api-cfn[13300]: 2017-09-28 12:32:08.522 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:32:08] "OPTIONS / HTTP/1.0" 200 134 0.000595
Sep 28 12:32:09 ctl02 nova-api[1963]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:32:09 ctl02 nova-api[1963]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:32:09 ctl02 heat-api[13008]: 2017-09-28 12:32:09.090 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:32:09] "OPTIONS / HTTP/1.0" 200 134 0.000663
Sep 28 12:32:09 ctl02 nova-api[1963]: 2017-09-28 12:32:09.263 1963 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:32:09 ctl02 nova-api[1963]: 2017-09-28 12:32:09.264 1963 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:32:09 ctl02 nova-api[1963]: 2017-09-28 12:32:09.264 1963 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:32:09 ctl02 nova-api[1963]: 2017-09-28 12:32:09.264 1963 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:32:09 ctl02 nova-api[1963]: 2017-09-28 12:32:09.264 1963 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:32:09 ctl02 nova-api[1963]: 2017-09-28 12:32:09.264 1963 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:32:09 ctl02 nova-api[1963]: 2017-09-28 12:32:09.264 1963 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:32:09 ctl02 nova-api[1963]: 2017-09-28 12:32:09.264 1963 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:32:09 ctl02 nova-api[1963]: 2017-09-28 12:32:09.264 1963 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:32:09 ctl02 nova-api[1963]: 2017-09-28 12:32:09.264 1963 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:32:09 ctl02 nova-api[1963]: 2017-09-28 12:32:09.264 1963 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:32:09 ctl02 nova-api[1963]: 2017-09-28 12:32:09.264 1963 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:32:09 ctl02 nova-api[1963]: 2017-09-28 12:32:09.264 1963 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:32:09 ctl02 nova-api[1963]: 2017-09-28 12:32:09.264 1963 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:32:09 ctl02 nova-api[1963]: 2017-09-28 12:32:09.264 1963 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:32:09 ctl02 nova-api[1963]: 2017-09-28 12:32:09.264 1963 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:32:09 ctl02 nova-api[1963]: 2017-09-28 12:32:09.264 1963 ERROR nova.wsgi     self.filename))
Sep 28 12:32:09 ctl02 nova-api[1963]: 2017-09-28 12:32:09.264 1963 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:32:09 ctl02 nova-api[1963]: 2017-09-28 12:32:09.264 1963 ERROR nova.wsgi
Sep 28 12:32:09 ctl02 nova-api[1963]: 2017-09-28 12:32:09.265 1963 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:32:09 ctl02 nova-api[1963]: 2017-09-28 12:32:09.396 1963 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:32:09 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:32:09 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:32:09 ctl02 nova-api[1963]: 2017-09-28 12:32:09.648 1963 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:32:09 ctl02 nova-api[1963]: 2017-09-28 12:32:09.650 1963 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:32:09 ctl02 nova-api[1963]: 2017-09-28 12:32:09.650 1963 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:32:09 ctl02 nova-api[1963]: 2017-09-28 12:32:09.651 1963 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:32:09 ctl02 nova-api[1963]: 2017-09-28 12:32:09.783 1963 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:32:09 ctl02 nova-api[1963]: 2017-09-28 12:32:09.785 1963 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:32:09 ctl02 nova-api[1963]: 2017-09-28 12:32:09.785 1963 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:32:09 ctl02 nova-api[1963]: 2017-09-28 12:32:09.785 1963 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:32:09 ctl02 nova-api[1963]: 2017-09-28 12:32:09.789 1963 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:32:09 ctl02 nova-api[1963]: 2017-09-28 12:32:09.789 1963 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:32:09 ctl02 nova-api[1963]: 2017-09-28 12:32:09.789 1963 ERROR nova Traceback (most recent call last):
Sep 28 12:32:09 ctl02 nova-api[1963]: 2017-09-28 12:32:09.789 1963 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:32:09 ctl02 nova-api[1963]: 2017-09-28 12:32:09.789 1963 ERROR nova     sys.exit(main())
Sep 28 12:32:09 ctl02 nova-api[1963]: 2017-09-28 12:32:09.789 1963 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:32:09 ctl02 nova-api[1963]: 2017-09-28 12:32:09.789 1963 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:32:09 ctl02 nova-api[1963]: 2017-09-28 12:32:09.789 1963 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:32:09 ctl02 nova-api[1963]: 2017-09-28 12:32:09.789 1963 ERROR nova     max_url_len=max_url_len)
Sep 28 12:32:09 ctl02 nova-api[1963]: 2017-09-28 12:32:09.789 1963 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:32:09 ctl02 nova-api[1963]: 2017-09-28 12:32:09.789 1963 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:32:09 ctl02 nova-api[1963]: 2017-09-28 12:32:09.789 1963 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:32:09 ctl02 nova-api[1963]: 2017-09-28 12:32:09.789 1963 ERROR nova     sock.listen(backlog)
Sep 28 12:32:09 ctl02 nova-api[1963]: 2017-09-28 12:32:09.789 1963 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:32:09 ctl02 nova-api[1963]: 2017-09-28 12:32:09.789 1963 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:32:09 ctl02 nova-api[1963]: 2017-09-28 12:32:09.789 1963 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:32:09 ctl02 nova-api[1963]: 2017-09-28 12:32:09.789 1963 ERROR nova
Sep 28 12:32:09 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:32:09 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:32:09 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:32:10 ctl02 neutron-server[30536]: 2017-09-28 12:32:10.077 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:32:10] "OPTIONS / HTTP/1.0" 200 262 0.000568
Sep 28 12:32:10 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:32:10 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:32:10 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:32:10 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:32:10 ctl02 heat-api-cfn[13300]: 2017-09-28 12:32:10.267 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:32:10] "OPTIONS / HTTP/1.0" 200 134 0.000520
Sep 28 12:32:10 ctl02 neutron-server[30536]: 2017-09-28 12:32:10.710 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:32:10] "OPTIONS / HTTP/1.0" 200 262 0.000477
Sep 28 12:32:11 ctl02 glance-api[29183]: 2017-09-28 12:32:11.364 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:32:11] "OPTIONS / HTTP/1.0" 200 134 0.000559
Sep 28 12:32:11 ctl02 nova-api[1987]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:32:11 ctl02 nova-api[1987]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:32:12 ctl02 nova-api[1987]: 2017-09-28 12:32:12.011 1987 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:32:12 ctl02 nova-api[1987]: 2017-09-28 12:32:12.013 1987 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:32:12 ctl02 nova-api[1987]: 2017-09-28 12:32:12.013 1987 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:32:12 ctl02 nova-api[1987]: 2017-09-28 12:32:12.013 1987 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:32:12 ctl02 nova-api[1987]: 2017-09-28 12:32:12.013 1987 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:32:12 ctl02 nova-api[1987]: 2017-09-28 12:32:12.013 1987 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:32:12 ctl02 nova-api[1987]: 2017-09-28 12:32:12.013 1987 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:32:12 ctl02 nova-api[1987]: 2017-09-28 12:32:12.013 1987 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:32:12 ctl02 nova-api[1987]: 2017-09-28 12:32:12.013 1987 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:32:12 ctl02 nova-api[1987]: 2017-09-28 12:32:12.013 1987 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:32:12 ctl02 nova-api[1987]: 2017-09-28 12:32:12.013 1987 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:32:12 ctl02 nova-api[1987]: 2017-09-28 12:32:12.013 1987 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:32:12 ctl02 nova-api[1987]: 2017-09-28 12:32:12.013 1987 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:32:12 ctl02 nova-api[1987]: 2017-09-28 12:32:12.013 1987 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:32:12 ctl02 nova-api[1987]: 2017-09-28 12:32:12.013 1987 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:32:12 ctl02 nova-api[1987]: 2017-09-28 12:32:12.013 1987 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:32:12 ctl02 nova-api[1987]: 2017-09-28 12:32:12.013 1987 ERROR nova.wsgi     self.filename))
Sep 28 12:32:12 ctl02 nova-api[1987]: 2017-09-28 12:32:12.013 1987 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:32:12 ctl02 nova-api[1987]: 2017-09-28 12:32:12.013 1987 ERROR nova.wsgi
Sep 28 12:32:12 ctl02 nova-api[1987]: 2017-09-28 12:32:12.015 1987 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:32:12 ctl02 neutron-server[30536]: 2017-09-28 12:32:12.079 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:32:12] "OPTIONS / HTTP/1.0" 200 262 0.000547
Sep 28 12:32:12 ctl02 nova-api[1987]: 2017-09-28 12:32:12.151 1987 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:32:12 ctl02 nova-api[1987]: 2017-09-28 12:32:12.397 1987 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:32:12 ctl02 nova-api[1987]: 2017-09-28 12:32:12.400 1987 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:32:12 ctl02 nova-api[1987]: 2017-09-28 12:32:12.401 1987 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:32:12 ctl02 nova-api[1987]: 2017-09-28 12:32:12.401 1987 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:32:12 ctl02 nova-api[1987]: 2017-09-28 12:32:12.532 1987 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:32:12 ctl02 nova-api[1987]: 2017-09-28 12:32:12.535 1987 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:32:12 ctl02 nova-api[1987]: 2017-09-28 12:32:12.535 1987 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:32:12 ctl02 nova-api[1987]: 2017-09-28 12:32:12.535 1987 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:32:12 ctl02 nova-api[1987]: 2017-09-28 12:32:12.539 1987 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:32:12 ctl02 nova-api[1987]: 2017-09-28 12:32:12.539 1987 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:32:12 ctl02 nova-api[1987]: 2017-09-28 12:32:12.539 1987 ERROR nova Traceback (most recent call last):
Sep 28 12:32:12 ctl02 nova-api[1987]: 2017-09-28 12:32:12.539 1987 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:32:12 ctl02 nova-api[1987]: 2017-09-28 12:32:12.539 1987 ERROR nova     sys.exit(main())
Sep 28 12:32:12 ctl02 nova-api[1987]: 2017-09-28 12:32:12.539 1987 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:32:12 ctl02 nova-api[1987]: 2017-09-28 12:32:12.539 1987 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:32:12 ctl02 nova-api[1987]: 2017-09-28 12:32:12.539 1987 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:32:12 ctl02 nova-api[1987]: 2017-09-28 12:32:12.539 1987 ERROR nova     max_url_len=max_url_len)
Sep 28 12:32:12 ctl02 nova-api[1987]: 2017-09-28 12:32:12.539 1987 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:32:12 ctl02 nova-api[1987]: 2017-09-28 12:32:12.539 1987 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:32:12 ctl02 nova-api[1987]: 2017-09-28 12:32:12.539 1987 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:32:12 ctl02 nova-api[1987]: 2017-09-28 12:32:12.539 1987 ERROR nova     sock.listen(backlog)
Sep 28 12:32:12 ctl02 nova-api[1987]: 2017-09-28 12:32:12.539 1987 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:32:12 ctl02 nova-api[1987]: 2017-09-28 12:32:12.539 1987 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:32:12 ctl02 nova-api[1987]: 2017-09-28 12:32:12.539 1987 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:32:12 ctl02 nova-api[1987]: 2017-09-28 12:32:12.539 1987 ERROR nova
Sep 28 12:32:12 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:32:12 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:32:12 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:32:12 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:32:12 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:32:12 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:32:12 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:32:14 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:32:14.176 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:32:14] "OPTIONS / HTTP/1.0" 200 134 0.000449
Sep 28 12:32:14 ctl02 glance-api[29183]: 2017-09-28 12:32:14.337 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:32:14] "OPTIONS / HTTP/1.0" 200 134 0.000628
Sep 28 12:32:14 ctl02 nova-api[2003]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:32:14 ctl02 nova-api[2003]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:32:14 ctl02 nova-api[2003]: 2017-09-28 12:32:14.766 2003 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:32:14 ctl02 nova-api[2003]: 2017-09-28 12:32:14.767 2003 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:32:14 ctl02 nova-api[2003]: 2017-09-28 12:32:14.767 2003 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:32:14 ctl02 nova-api[2003]: 2017-09-28 12:32:14.767 2003 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:32:14 ctl02 nova-api[2003]: 2017-09-28 12:32:14.767 2003 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:32:14 ctl02 nova-api[2003]: 2017-09-28 12:32:14.767 2003 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:32:14 ctl02 nova-api[2003]: 2017-09-28 12:32:14.767 2003 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:32:14 ctl02 nova-api[2003]: 2017-09-28 12:32:14.767 2003 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:32:14 ctl02 nova-api[2003]: 2017-09-28 12:32:14.767 2003 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:32:14 ctl02 nova-api[2003]: 2017-09-28 12:32:14.767 2003 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:32:14 ctl02 nova-api[2003]: 2017-09-28 12:32:14.767 2003 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:32:14 ctl02 nova-api[2003]: 2017-09-28 12:32:14.767 2003 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:32:14 ctl02 nova-api[2003]: 2017-09-28 12:32:14.767 2003 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:32:14 ctl02 nova-api[2003]: 2017-09-28 12:32:14.767 2003 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:32:14 ctl02 nova-api[2003]: 2017-09-28 12:32:14.767 2003 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:32:14 ctl02 nova-api[2003]: 2017-09-28 12:32:14.767 2003 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:32:14 ctl02 nova-api[2003]: 2017-09-28 12:32:14.767 2003 ERROR nova.wsgi     self.filename))
Sep 28 12:32:14 ctl02 nova-api[2003]: 2017-09-28 12:32:14.767 2003 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:32:14 ctl02 nova-api[2003]: 2017-09-28 12:32:14.767 2003 ERROR nova.wsgi
Sep 28 12:32:14 ctl02 nova-api[2003]: 2017-09-28 12:32:14.768 2003 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:32:14 ctl02 nova-api[2003]: 2017-09-28 12:32:14.902 2003 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:32:15 ctl02 nova-api[2003]: 2017-09-28 12:32:15.151 2003 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:32:15 ctl02 nova-api[2003]: 2017-09-28 12:32:15.153 2003 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:32:15 ctl02 nova-api[2003]: 2017-09-28 12:32:15.153 2003 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:32:15 ctl02 nova-api[2003]: 2017-09-28 12:32:15.153 2003 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:32:15 ctl02 heat-api[13008]: 2017-09-28 12:32:15.157 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:32:15] "OPTIONS / HTTP/1.0" 200 134 0.000605
Sep 28 12:32:15 ctl02 nova-api[2003]: 2017-09-28 12:32:15.286 2003 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:32:15 ctl02 nova-api[2003]: 2017-09-28 12:32:15.288 2003 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:32:15 ctl02 nova-api[2003]: 2017-09-28 12:32:15.288 2003 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:32:15 ctl02 nova-api[2003]: 2017-09-28 12:32:15.289 2003 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:32:15 ctl02 nova-api[2003]: 2017-09-28 12:32:15.292 2003 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:32:15 ctl02 nova-api[2003]: 2017-09-28 12:32:15.292 2003 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:32:15 ctl02 nova-api[2003]: 2017-09-28 12:32:15.292 2003 ERROR nova Traceback (most recent call last):
Sep 28 12:32:15 ctl02 nova-api[2003]: 2017-09-28 12:32:15.292 2003 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:32:15 ctl02 nova-api[2003]: 2017-09-28 12:32:15.292 2003 ERROR nova     sys.exit(main())
Sep 28 12:32:15 ctl02 nova-api[2003]: 2017-09-28 12:32:15.292 2003 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:32:15 ctl02 nova-api[2003]: 2017-09-28 12:32:15.292 2003 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:32:15 ctl02 nova-api[2003]: 2017-09-28 12:32:15.292 2003 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:32:15 ctl02 nova-api[2003]: 2017-09-28 12:32:15.292 2003 ERROR nova     max_url_len=max_url_len)
Sep 28 12:32:15 ctl02 nova-api[2003]: 2017-09-28 12:32:15.292 2003 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:32:15 ctl02 nova-api[2003]: 2017-09-28 12:32:15.292 2003 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:32:15 ctl02 nova-api[2003]: 2017-09-28 12:32:15.292 2003 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:32:15 ctl02 nova-api[2003]: 2017-09-28 12:32:15.292 2003 ERROR nova     sock.listen(backlog)
Sep 28 12:32:15 ctl02 nova-api[2003]: 2017-09-28 12:32:15.292 2003 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:32:15 ctl02 nova-api[2003]: 2017-09-28 12:32:15.292 2003 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:32:15 ctl02 nova-api[2003]: 2017-09-28 12:32:15.292 2003 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:32:15 ctl02 nova-api[2003]: 2017-09-28 12:32:15.292 2003 ERROR nova
Sep 28 12:32:15 ctl02 glance-api[29183]: 2017-09-28 12:32:15.314 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:32:15] "OPTIONS / HTTP/1.0" 200 134 0.000906
Sep 28 12:32:15 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:32:15 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:32:15 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:32:15 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:32:15 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:32:15 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:32:15 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:32:15 ctl02 nova-consoleauth[5433]: 2017-09-28 12:32:15.753 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:32:16 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:32:16.345 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:32:16] "OPTIONS / HTTP/1.0" 200 134 0.000459
Sep 28 12:32:17 ctl02 nova-api[2022]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:32:17 ctl02 nova-api[2022]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:32:17 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:32:17.409 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:32:17] "OPTIONS / HTTP/1.0" 200 134 0.000465
Sep 28 12:32:17 ctl02 nova-api[2022]: 2017-09-28 12:32:17.526 2022 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:32:17 ctl02 nova-api[2022]: 2017-09-28 12:32:17.528 2022 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:32:17 ctl02 nova-api[2022]: 2017-09-28 12:32:17.528 2022 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:32:17 ctl02 nova-api[2022]: 2017-09-28 12:32:17.528 2022 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:32:17 ctl02 nova-api[2022]: 2017-09-28 12:32:17.528 2022 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:32:17 ctl02 nova-api[2022]: 2017-09-28 12:32:17.528 2022 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:32:17 ctl02 nova-api[2022]: 2017-09-28 12:32:17.528 2022 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:32:17 ctl02 nova-api[2022]: 2017-09-28 12:32:17.528 2022 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:32:17 ctl02 nova-api[2022]: 2017-09-28 12:32:17.528 2022 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:32:17 ctl02 nova-api[2022]: 2017-09-28 12:32:17.528 2022 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:32:17 ctl02 nova-api[2022]: 2017-09-28 12:32:17.528 2022 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:32:17 ctl02 nova-api[2022]: 2017-09-28 12:32:17.528 2022 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:32:17 ctl02 nova-api[2022]: 2017-09-28 12:32:17.528 2022 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:32:17 ctl02 nova-api[2022]: 2017-09-28 12:32:17.528 2022 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:32:17 ctl02 nova-api[2022]: 2017-09-28 12:32:17.528 2022 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:32:17 ctl02 nova-api[2022]: 2017-09-28 12:32:17.528 2022 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:32:17 ctl02 nova-api[2022]: 2017-09-28 12:32:17.528 2022 ERROR nova.wsgi     self.filename))
Sep 28 12:32:17 ctl02 nova-api[2022]: 2017-09-28 12:32:17.528 2022 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:32:17 ctl02 nova-api[2022]: 2017-09-28 12:32:17.528 2022 ERROR nova.wsgi
Sep 28 12:32:17 ctl02 nova-api[2022]: 2017-09-28 12:32:17.530 2022 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:32:17 ctl02 heat-api[13008]: 2017-09-28 12:32:17.627 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:32:17] "OPTIONS / HTTP/1.0" 200 134 0.000569
Sep 28 12:32:17 ctl02 heat-api-cfn[13300]: 2017-09-28 12:32:17.651 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:32:17] "OPTIONS / HTTP/1.0" 200 134 0.000443
Sep 28 12:32:17 ctl02 nova-api[2022]: 2017-09-28 12:32:17.659 2022 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:32:17 ctl02 heat-engine[12803]: 2017-09-28 12:32:17.896 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:32:17 ctl02 heat-engine[12803]: 2017-09-28 12:32:17.898 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:32:17 ctl02 nova-api[2022]: 2017-09-28 12:32:17.898 2022 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:32:17 ctl02 nova-api[2022]: 2017-09-28 12:32:17.900 2022 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:32:17 ctl02 nova-api[2022]: 2017-09-28 12:32:17.901 2022 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:32:17 ctl02 nova-api[2022]: 2017-09-28 12:32:17.901 2022 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:32:17 ctl02 heat-engine[12803]: 2017-09-28 12:32:17.901 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:32:17 ctl02 heat-engine[12803]: 2017-09-28 12:32:17.902 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:32:18 ctl02 nova-api[2022]: 2017-09-28 12:32:18.035 2022 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:32:18 ctl02 nova-api[2022]: 2017-09-28 12:32:18.038 2022 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:32:18 ctl02 nova-api[2022]: 2017-09-28 12:32:18.039 2022 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:32:18 ctl02 nova-api[2022]: 2017-09-28 12:32:18.039 2022 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:32:18 ctl02 nova-api[2022]: 2017-09-28 12:32:18.043 2022 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:32:18 ctl02 nova-api[2022]: 2017-09-28 12:32:18.043 2022 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:32:18 ctl02 nova-api[2022]: 2017-09-28 12:32:18.043 2022 ERROR nova Traceback (most recent call last):
Sep 28 12:32:18 ctl02 nova-api[2022]: 2017-09-28 12:32:18.043 2022 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:32:18 ctl02 nova-api[2022]: 2017-09-28 12:32:18.043 2022 ERROR nova     sys.exit(main())
Sep 28 12:32:18 ctl02 nova-api[2022]: 2017-09-28 12:32:18.043 2022 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:32:18 ctl02 nova-api[2022]: 2017-09-28 12:32:18.043 2022 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:32:18 ctl02 nova-api[2022]: 2017-09-28 12:32:18.043 2022 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:32:18 ctl02 nova-api[2022]: 2017-09-28 12:32:18.043 2022 ERROR nova     max_url_len=max_url_len)
Sep 28 12:32:18 ctl02 nova-api[2022]: 2017-09-28 12:32:18.043 2022 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:32:18 ctl02 nova-api[2022]: 2017-09-28 12:32:18.043 2022 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:32:18 ctl02 nova-api[2022]: 2017-09-28 12:32:18.043 2022 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:32:18 ctl02 nova-api[2022]: 2017-09-28 12:32:18.043 2022 ERROR nova     sock.listen(backlog)
Sep 28 12:32:18 ctl02 nova-api[2022]: 2017-09-28 12:32:18.043 2022 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:32:18 ctl02 nova-api[2022]: 2017-09-28 12:32:18.043 2022 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:32:18 ctl02 nova-api[2022]: 2017-09-28 12:32:18.043 2022 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:32:18 ctl02 nova-api[2022]: 2017-09-28 12:32:18.043 2022 ERROR nova
Sep 28 12:32:18 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:32:18 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:32:18 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:32:18 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:32:18 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:32:18 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:32:18 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:32:18 ctl02 nova-scheduler[5620]: 2017-09-28 12:32:18.794 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:32:18 ctl02 heat-api-cfn[13300]: 2017-09-28 12:32:18.862 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:32:18] "OPTIONS / HTTP/1.0" 200 134 0.000512
Sep 28 12:32:19 ctl02 heat-api[13008]: 2017-09-28 12:32:19.420 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:32:19] "OPTIONS / HTTP/1.0" 200 134 0.000784
Sep 28 12:32:19 ctl02 neutron-server[30536]: 2017-09-28 12:32:19.974 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:32:19] "OPTIONS / HTTP/1.0" 200 262 0.000507
Sep 28 12:32:20 ctl02 nova-api[2041]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:32:20 ctl02 nova-api[2041]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:32:20 ctl02 nova-api[2041]: 2017-09-28 12:32:20.245 2041 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:32:20 ctl02 nova-api[2041]: 2017-09-28 12:32:20.246 2041 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:32:20 ctl02 nova-api[2041]: 2017-09-28 12:32:20.246 2041 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:32:20 ctl02 nova-api[2041]: 2017-09-28 12:32:20.246 2041 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:32:20 ctl02 nova-api[2041]: 2017-09-28 12:32:20.246 2041 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:32:20 ctl02 nova-api[2041]: 2017-09-28 12:32:20.246 2041 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:32:20 ctl02 nova-api[2041]: 2017-09-28 12:32:20.246 2041 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:32:20 ctl02 nova-api[2041]: 2017-09-28 12:32:20.246 2041 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:32:20 ctl02 nova-api[2041]: 2017-09-28 12:32:20.246 2041 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:32:20 ctl02 nova-api[2041]: 2017-09-28 12:32:20.246 2041 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:32:20 ctl02 nova-api[2041]: 2017-09-28 12:32:20.246 2041 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:32:20 ctl02 nova-api[2041]: 2017-09-28 12:32:20.246 2041 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:32:20 ctl02 nova-api[2041]: 2017-09-28 12:32:20.246 2041 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:32:20 ctl02 nova-api[2041]: 2017-09-28 12:32:20.246 2041 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:32:20 ctl02 nova-api[2041]: 2017-09-28 12:32:20.246 2041 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:32:20 ctl02 nova-api[2041]: 2017-09-28 12:32:20.246 2041 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:32:20 ctl02 nova-api[2041]: 2017-09-28 12:32:20.246 2041 ERROR nova.wsgi     self.filename))
Sep 28 12:32:20 ctl02 nova-api[2041]: 2017-09-28 12:32:20.246 2041 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:32:20 ctl02 nova-api[2041]: 2017-09-28 12:32:20.246 2041 ERROR nova.wsgi
Sep 28 12:32:20 ctl02 nova-api[2041]: 2017-09-28 12:32:20.249 2041 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:32:20 ctl02 heat-api-cfn[13300]: 2017-09-28 12:32:20.257 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:32:20] "OPTIONS / HTTP/1.0" 200 134 0.000503
Sep 28 12:32:20 ctl02 nova-api[2041]: 2017-09-28 12:32:20.375 2041 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:32:20 ctl02 nova-api[2041]: 2017-09-28 12:32:20.600 2041 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:32:20 ctl02 nova-api[2041]: 2017-09-28 12:32:20.602 2041 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:32:20 ctl02 nova-api[2041]: 2017-09-28 12:32:20.602 2041 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:32:20 ctl02 nova-api[2041]: 2017-09-28 12:32:20.603 2041 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:32:20 ctl02 neutron-server[30536]: 2017-09-28 12:32:20.618 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:32:20] "OPTIONS / HTTP/1.0" 200 262 0.000510
Sep 28 12:32:20 ctl02 nova-api[2041]: 2017-09-28 12:32:20.732 2041 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:32:20 ctl02 nova-api[2041]: 2017-09-28 12:32:20.734 2041 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:32:20 ctl02 nova-api[2041]: 2017-09-28 12:32:20.734 2041 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:32:20 ctl02 nova-api[2041]: 2017-09-28 12:32:20.735 2041 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:32:20 ctl02 nova-api[2041]: 2017-09-28 12:32:20.738 2041 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:32:20 ctl02 nova-api[2041]: 2017-09-28 12:32:20.738 2041 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:32:20 ctl02 nova-api[2041]: 2017-09-28 12:32:20.738 2041 ERROR nova Traceback (most recent call last):
Sep 28 12:32:20 ctl02 nova-api[2041]: 2017-09-28 12:32:20.738 2041 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:32:20 ctl02 nova-api[2041]: 2017-09-28 12:32:20.738 2041 ERROR nova     sys.exit(main())
Sep 28 12:32:20 ctl02 nova-api[2041]: 2017-09-28 12:32:20.738 2041 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:32:20 ctl02 nova-api[2041]: 2017-09-28 12:32:20.738 2041 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:32:20 ctl02 nova-api[2041]: 2017-09-28 12:32:20.738 2041 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:32:20 ctl02 nova-api[2041]: 2017-09-28 12:32:20.738 2041 ERROR nova     max_url_len=max_url_len)
Sep 28 12:32:20 ctl02 nova-api[2041]: 2017-09-28 12:32:20.738 2041 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:32:20 ctl02 nova-api[2041]: 2017-09-28 12:32:20.738 2041 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:32:20 ctl02 nova-api[2041]: 2017-09-28 12:32:20.738 2041 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:32:20 ctl02 nova-api[2041]: 2017-09-28 12:32:20.738 2041 ERROR nova     sock.listen(backlog)
Sep 28 12:32:20 ctl02 nova-api[2041]: 2017-09-28 12:32:20.738 2041 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:32:20 ctl02 nova-api[2041]: 2017-09-28 12:32:20.738 2041 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:32:20 ctl02 nova-api[2041]: 2017-09-28 12:32:20.738 2041 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:32:20 ctl02 nova-api[2041]: 2017-09-28 12:32:20.738 2041 ERROR nova
Sep 28 12:32:20 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:32:20 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:32:20 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:32:21 ctl02 glance-api[29183]: 2017-09-28 12:32:21.125 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:32:21] "OPTIONS / HTTP/1.0" 200 134 0.000877
Sep 28 12:32:21 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:32:21 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:32:21 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:32:21 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:32:21 ctl02 neutron-server[30536]: 2017-09-28 12:32:21.406 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 1 dead agents out of 6:
Sep 28 12:32:21 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:32:21 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:30:40 cmp002
Sep 28 12:32:22 ctl02 neutron-server[30536]: 2017-09-28 12:32:22.408 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:32:22] "OPTIONS / HTTP/1.0" 200 262 0.000586
Sep 28 12:32:22 ctl02 nova-api[2058]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:32:22 ctl02 nova-api[2058]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:32:23 ctl02 nova-api[2058]: 2017-09-28 12:32:23.040 2058 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:32:23 ctl02 nova-api[2058]: 2017-09-28 12:32:23.042 2058 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:32:23 ctl02 nova-api[2058]: 2017-09-28 12:32:23.042 2058 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:32:23 ctl02 nova-api[2058]: 2017-09-28 12:32:23.042 2058 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:32:23 ctl02 nova-api[2058]: 2017-09-28 12:32:23.042 2058 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:32:23 ctl02 nova-api[2058]: 2017-09-28 12:32:23.042 2058 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:32:23 ctl02 nova-api[2058]: 2017-09-28 12:32:23.042 2058 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:32:23 ctl02 nova-api[2058]: 2017-09-28 12:32:23.042 2058 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:32:23 ctl02 nova-api[2058]: 2017-09-28 12:32:23.042 2058 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:32:23 ctl02 nova-api[2058]: 2017-09-28 12:32:23.042 2058 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:32:23 ctl02 nova-api[2058]: 2017-09-28 12:32:23.042 2058 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:32:23 ctl02 nova-api[2058]: 2017-09-28 12:32:23.042 2058 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:32:23 ctl02 nova-api[2058]: 2017-09-28 12:32:23.042 2058 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:32:23 ctl02 nova-api[2058]: 2017-09-28 12:32:23.042 2058 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:32:23 ctl02 nova-api[2058]: 2017-09-28 12:32:23.042 2058 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:32:23 ctl02 nova-api[2058]: 2017-09-28 12:32:23.042 2058 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:32:23 ctl02 nova-api[2058]: 2017-09-28 12:32:23.042 2058 ERROR nova.wsgi     self.filename))
Sep 28 12:32:23 ctl02 nova-api[2058]: 2017-09-28 12:32:23.042 2058 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:32:23 ctl02 nova-api[2058]: 2017-09-28 12:32:23.042 2058 ERROR nova.wsgi
Sep 28 12:32:23 ctl02 nova-api[2058]: 2017-09-28 12:32:23.043 2058 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:32:23 ctl02 nova-api[2058]: 2017-09-28 12:32:23.174 2058 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:32:23 ctl02 nova-api[2058]: 2017-09-28 12:32:23.422 2058 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:32:23 ctl02 nova-api[2058]: 2017-09-28 12:32:23.425 2058 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:32:23 ctl02 nova-api[2058]: 2017-09-28 12:32:23.425 2058 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:32:23 ctl02 nova-api[2058]: 2017-09-28 12:32:23.425 2058 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:32:23 ctl02 nova-api[2058]: 2017-09-28 12:32:23.559 2058 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:32:23 ctl02 nova-api[2058]: 2017-09-28 12:32:23.561 2058 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:32:23 ctl02 nova-api[2058]: 2017-09-28 12:32:23.562 2058 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:32:23 ctl02 nova-api[2058]: 2017-09-28 12:32:23.562 2058 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:32:23 ctl02 nova-api[2058]: 2017-09-28 12:32:23.565 2058 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:32:23 ctl02 nova-api[2058]: 2017-09-28 12:32:23.566 2058 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:32:23 ctl02 nova-api[2058]: 2017-09-28 12:32:23.566 2058 ERROR nova Traceback (most recent call last):
Sep 28 12:32:23 ctl02 nova-api[2058]: 2017-09-28 12:32:23.566 2058 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:32:23 ctl02 nova-api[2058]: 2017-09-28 12:32:23.566 2058 ERROR nova     sys.exit(main())
Sep 28 12:32:23 ctl02 nova-api[2058]: 2017-09-28 12:32:23.566 2058 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:32:23 ctl02 nova-api[2058]: 2017-09-28 12:32:23.566 2058 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:32:23 ctl02 nova-api[2058]: 2017-09-28 12:32:23.566 2058 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:32:23 ctl02 nova-api[2058]: 2017-09-28 12:32:23.566 2058 ERROR nova     max_url_len=max_url_len)
Sep 28 12:32:23 ctl02 nova-api[2058]: 2017-09-28 12:32:23.566 2058 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:32:23 ctl02 nova-api[2058]: 2017-09-28 12:32:23.566 2058 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:32:23 ctl02 nova-api[2058]: 2017-09-28 12:32:23.566 2058 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:32:23 ctl02 nova-api[2058]: 2017-09-28 12:32:23.566 2058 ERROR nova     sock.listen(backlog)
Sep 28 12:32:23 ctl02 nova-api[2058]: 2017-09-28 12:32:23.566 2058 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:32:23 ctl02 nova-api[2058]: 2017-09-28 12:32:23.566 2058 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:32:23 ctl02 nova-api[2058]: 2017-09-28 12:32:23.566 2058 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:32:23 ctl02 nova-api[2058]: 2017-09-28 12:32:23.566 2058 ERROR nova
Sep 28 12:32:23 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:32:23 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:32:23 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:32:23 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:32:23 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:32:23 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:32:23 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:32:24 ctl02 glance-api[29183]: 2017-09-28 12:32:24.131 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:32:24] "OPTIONS / HTTP/1.0" 200 134 0.000571
Sep 28 12:32:24 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:32:24.543 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:32:24] "OPTIONS / HTTP/1.0" 200 134 0.000504
Sep 28 12:32:24 ctl02 heat-api[13008]: 2017-09-28 12:32:24.769 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:32:24] "OPTIONS / HTTP/1.0" 200 134 0.000507
Sep 28 12:32:25 ctl02 glance-api[29183]: 2017-09-28 12:32:25.082 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:32:25] "OPTIONS / HTTP/1.0" 200 134 0.000599
Sep 28 12:32:25 ctl02 nova-api[2077]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:32:25 ctl02 nova-api[2077]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:32:25 ctl02 nova-api[2077]: 2017-09-28 12:32:25.717 2077 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:32:25 ctl02 nova-api[2077]: 2017-09-28 12:32:25.719 2077 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:32:25 ctl02 nova-api[2077]: 2017-09-28 12:32:25.719 2077 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:32:25 ctl02 nova-api[2077]: 2017-09-28 12:32:25.719 2077 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:32:25 ctl02 nova-api[2077]: 2017-09-28 12:32:25.719 2077 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:32:25 ctl02 nova-api[2077]: 2017-09-28 12:32:25.719 2077 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:32:25 ctl02 nova-api[2077]: 2017-09-28 12:32:25.719 2077 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:32:25 ctl02 nova-api[2077]: 2017-09-28 12:32:25.719 2077 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:32:25 ctl02 nova-api[2077]: 2017-09-28 12:32:25.719 2077 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:32:25 ctl02 nova-api[2077]: 2017-09-28 12:32:25.719 2077 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:32:25 ctl02 nova-api[2077]: 2017-09-28 12:32:25.719 2077 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:32:25 ctl02 nova-api[2077]: 2017-09-28 12:32:25.719 2077 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:32:25 ctl02 nova-api[2077]: 2017-09-28 12:32:25.719 2077 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:32:25 ctl02 nova-api[2077]: 2017-09-28 12:32:25.719 2077 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:32:25 ctl02 nova-api[2077]: 2017-09-28 12:32:25.719 2077 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:32:25 ctl02 nova-api[2077]: 2017-09-28 12:32:25.719 2077 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:32:25 ctl02 nova-api[2077]: 2017-09-28 12:32:25.719 2077 ERROR nova.wsgi     self.filename))
Sep 28 12:32:25 ctl02 nova-api[2077]: 2017-09-28 12:32:25.719 2077 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:32:25 ctl02 nova-api[2077]: 2017-09-28 12:32:25.719 2077 ERROR nova.wsgi
Sep 28 12:32:25 ctl02 nova-api[2077]: 2017-09-28 12:32:25.721 2077 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:32:25 ctl02 nova-api[2077]: 2017-09-28 12:32:25.848 2077 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:32:26 ctl02 nova-api[2077]: 2017-09-28 12:32:26.068 2077 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:32:26 ctl02 nova-api[2077]: 2017-09-28 12:32:26.070 2077 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:32:26 ctl02 nova-api[2077]: 2017-09-28 12:32:26.071 2077 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:32:26 ctl02 nova-api[2077]: 2017-09-28 12:32:26.071 2077 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:32:26 ctl02 nova-api[2077]: 2017-09-28 12:32:26.201 2077 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:32:26 ctl02 nova-api[2077]: 2017-09-28 12:32:26.203 2077 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:32:26 ctl02 nova-api[2077]: 2017-09-28 12:32:26.204 2077 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:32:26 ctl02 nova-api[2077]: 2017-09-28 12:32:26.204 2077 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:32:26 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:32:26.204 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:32:26] "OPTIONS / HTTP/1.0" 200 134 0.000421
Sep 28 12:32:26 ctl02 nova-api[2077]: 2017-09-28 12:32:26.207 2077 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:32:26 ctl02 nova-api[2077]: 2017-09-28 12:32:26.208 2077 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:32:26 ctl02 nova-api[2077]: 2017-09-28 12:32:26.208 2077 ERROR nova Traceback (most recent call last):
Sep 28 12:32:26 ctl02 nova-api[2077]: 2017-09-28 12:32:26.208 2077 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:32:26 ctl02 nova-api[2077]: 2017-09-28 12:32:26.208 2077 ERROR nova     sys.exit(main())
Sep 28 12:32:26 ctl02 nova-api[2077]: 2017-09-28 12:32:26.208 2077 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:32:26 ctl02 nova-api[2077]: 2017-09-28 12:32:26.208 2077 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:32:26 ctl02 nova-api[2077]: 2017-09-28 12:32:26.208 2077 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:32:26 ctl02 nova-api[2077]: 2017-09-28 12:32:26.208 2077 ERROR nova     max_url_len=max_url_len)
Sep 28 12:32:26 ctl02 nova-api[2077]: 2017-09-28 12:32:26.208 2077 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:32:26 ctl02 nova-api[2077]: 2017-09-28 12:32:26.208 2077 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:32:26 ctl02 nova-api[2077]: 2017-09-28 12:32:26.208 2077 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:32:26 ctl02 nova-api[2077]: 2017-09-28 12:32:26.208 2077 ERROR nova     sock.listen(backlog)
Sep 28 12:32:26 ctl02 nova-api[2077]: 2017-09-28 12:32:26.208 2077 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:32:26 ctl02 nova-api[2077]: 2017-09-28 12:32:26.208 2077 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:32:26 ctl02 nova-api[2077]: 2017-09-28 12:32:26.208 2077 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:32:26 ctl02 nova-api[2077]: 2017-09-28 12:32:26.208 2077 ERROR nova
Sep 28 12:32:26 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:32:26 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:32:26 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:32:26 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:32:26 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:32:26 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:32:26 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:32:27 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:32:27.518 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:32:27] "OPTIONS / HTTP/1.0" 200 134 0.000484
Sep 28 12:32:27 ctl02 heat-api[13008]: 2017-09-28 12:32:27.640 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:32:27] "OPTIONS / HTTP/1.0" 200 134 0.000733
Sep 28 12:32:28 ctl02 heat-api-cfn[13300]: 2017-09-28 12:32:28.040 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:32:28] "OPTIONS / HTTP/1.0" 200 134 0.000597
Sep 28 12:32:28 ctl02 nova-api[2095]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:32:28 ctl02 nova-api[2095]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:32:28 ctl02 nova-api[2095]: 2017-09-28 12:32:28.502 2095 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:32:28 ctl02 nova-api[2095]: 2017-09-28 12:32:28.504 2095 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:32:28 ctl02 nova-api[2095]: 2017-09-28 12:32:28.504 2095 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:32:28 ctl02 nova-api[2095]: 2017-09-28 12:32:28.504 2095 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:32:28 ctl02 nova-api[2095]: 2017-09-28 12:32:28.504 2095 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:32:28 ctl02 nova-api[2095]: 2017-09-28 12:32:28.504 2095 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:32:28 ctl02 nova-api[2095]: 2017-09-28 12:32:28.504 2095 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:32:28 ctl02 nova-api[2095]: 2017-09-28 12:32:28.504 2095 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:32:28 ctl02 nova-api[2095]: 2017-09-28 12:32:28.504 2095 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:32:28 ctl02 nova-api[2095]: 2017-09-28 12:32:28.504 2095 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:32:28 ctl02 nova-api[2095]: 2017-09-28 12:32:28.504 2095 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:32:28 ctl02 nova-api[2095]: 2017-09-28 12:32:28.504 2095 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:32:28 ctl02 nova-api[2095]: 2017-09-28 12:32:28.504 2095 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:32:28 ctl02 nova-api[2095]: 2017-09-28 12:32:28.504 2095 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:32:28 ctl02 nova-api[2095]: 2017-09-28 12:32:28.504 2095 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:32:28 ctl02 nova-api[2095]: 2017-09-28 12:32:28.504 2095 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:32:28 ctl02 nova-api[2095]: 2017-09-28 12:32:28.504 2095 ERROR nova.wsgi     self.filename))
Sep 28 12:32:28 ctl02 nova-api[2095]: 2017-09-28 12:32:28.504 2095 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:32:28 ctl02 nova-api[2095]: 2017-09-28 12:32:28.504 2095 ERROR nova.wsgi
Sep 28 12:32:28 ctl02 nova-api[2095]: 2017-09-28 12:32:28.505 2095 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:32:28 ctl02 nova-api[2095]: 2017-09-28 12:32:28.630 2095 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:32:28 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x46799e55)
Sep 28 12:32:28 ctl02 nova-api[2095]: 2017-09-28 12:32:28.850 2095 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:32:28 ctl02 nova-api[2095]: 2017-09-28 12:32:28.852 2095 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:32:28 ctl02 nova-api[2095]: 2017-09-28 12:32:28.852 2095 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:32:28 ctl02 nova-api[2095]: 2017-09-28 12:32:28.852 2095 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:32:28 ctl02 heat-api-cfn[13300]: 2017-09-28 12:32:28.964 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:32:28] "OPTIONS / HTTP/1.0" 200 134 0.000456
Sep 28 12:32:28 ctl02 nova-api[2095]: 2017-09-28 12:32:28.986 2095 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:32:28 ctl02 nova-api[2095]: 2017-09-28 12:32:28.988 2095 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:32:28 ctl02 nova-api[2095]: 2017-09-28 12:32:28.988 2095 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:32:28 ctl02 nova-api[2095]: 2017-09-28 12:32:28.989 2095 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:32:28 ctl02 nova-api[2095]: 2017-09-28 12:32:28.992 2095 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:32:28 ctl02 nova-api[2095]: 2017-09-28 12:32:28.993 2095 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:32:28 ctl02 nova-api[2095]: 2017-09-28 12:32:28.993 2095 ERROR nova Traceback (most recent call last):
Sep 28 12:32:28 ctl02 nova-api[2095]: 2017-09-28 12:32:28.993 2095 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:32:28 ctl02 nova-api[2095]: 2017-09-28 12:32:28.993 2095 ERROR nova     sys.exit(main())
Sep 28 12:32:28 ctl02 nova-api[2095]: 2017-09-28 12:32:28.993 2095 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:32:28 ctl02 nova-api[2095]: 2017-09-28 12:32:28.993 2095 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:32:28 ctl02 nova-api[2095]: 2017-09-28 12:32:28.993 2095 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:32:28 ctl02 nova-api[2095]: 2017-09-28 12:32:28.993 2095 ERROR nova     max_url_len=max_url_len)
Sep 28 12:32:28 ctl02 nova-api[2095]: 2017-09-28 12:32:28.993 2095 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:32:28 ctl02 nova-api[2095]: 2017-09-28 12:32:28.993 2095 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:32:28 ctl02 nova-api[2095]: 2017-09-28 12:32:28.993 2095 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:32:28 ctl02 nova-api[2095]: 2017-09-28 12:32:28.993 2095 ERROR nova     sock.listen(backlog)
Sep 28 12:32:28 ctl02 nova-api[2095]: 2017-09-28 12:32:28.993 2095 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:32:28 ctl02 nova-api[2095]: 2017-09-28 12:32:28.993 2095 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:32:28 ctl02 nova-api[2095]: 2017-09-28 12:32:28.993 2095 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:32:28 ctl02 nova-api[2095]: 2017-09-28 12:32:28.993 2095 ERROR nova
Sep 28 12:32:29 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:32:29 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:32:29 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:32:29 ctl02 heat-api[13008]: 2017-09-28 12:32:29.313 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:32:29] "OPTIONS / HTTP/1.0" 200 134 0.000750
Sep 28 12:32:29 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:32:29 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:32:29 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:32:29 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:32:29 ctl02 neutron-server[30536]: 2017-09-28 12:32:29.608 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:32:29] "OPTIONS / HTTP/1.0" 200 262 0.000480
Sep 28 12:32:29 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x46799e55)
Sep 28 12:32:30 ctl02 heat-api-cfn[13300]: 2017-09-28 12:32:30.620 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:32:30] "OPTIONS / HTTP/1.0" 200 134 0.000475
Sep 28 12:32:30 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x46799e55)
Sep 28 12:32:30 ctl02 neutron-server[30536]: 2017-09-28 12:32:30.834 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:32:30] "OPTIONS / HTTP/1.0" 200 262 0.000450
Sep 28 12:32:31 ctl02 nova-api[2114]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:32:31 ctl02 nova-api[2114]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:32:31 ctl02 glance-api[29183]: 2017-09-28 12:32:31.125 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:32:31] "OPTIONS / HTTP/1.0" 200 134 0.000601
Sep 28 12:32:31 ctl02 nova-api[2114]: 2017-09-28 12:32:31.218 2114 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:32:31 ctl02 nova-api[2114]: 2017-09-28 12:32:31.219 2114 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:32:31 ctl02 nova-api[2114]: 2017-09-28 12:32:31.219 2114 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:32:31 ctl02 nova-api[2114]: 2017-09-28 12:32:31.219 2114 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:32:31 ctl02 nova-api[2114]: 2017-09-28 12:32:31.219 2114 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:32:31 ctl02 nova-api[2114]: 2017-09-28 12:32:31.219 2114 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:32:31 ctl02 nova-api[2114]: 2017-09-28 12:32:31.219 2114 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:32:31 ctl02 nova-api[2114]: 2017-09-28 12:32:31.219 2114 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:32:31 ctl02 nova-api[2114]: 2017-09-28 12:32:31.219 2114 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:32:31 ctl02 nova-api[2114]: 2017-09-28 12:32:31.219 2114 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:32:31 ctl02 nova-api[2114]: 2017-09-28 12:32:31.219 2114 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:32:31 ctl02 nova-api[2114]: 2017-09-28 12:32:31.219 2114 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:32:31 ctl02 nova-api[2114]: 2017-09-28 12:32:31.219 2114 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:32:31 ctl02 nova-api[2114]: 2017-09-28 12:32:31.219 2114 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:32:31 ctl02 nova-api[2114]: 2017-09-28 12:32:31.219 2114 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:32:31 ctl02 nova-api[2114]: 2017-09-28 12:32:31.219 2114 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:32:31 ctl02 nova-api[2114]: 2017-09-28 12:32:31.219 2114 ERROR nova.wsgi     self.filename))
Sep 28 12:32:31 ctl02 nova-api[2114]: 2017-09-28 12:32:31.219 2114 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:32:31 ctl02 nova-api[2114]: 2017-09-28 12:32:31.219 2114 ERROR nova.wsgi
Sep 28 12:32:31 ctl02 nova-api[2114]: 2017-09-28 12:32:31.220 2114 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:32:31 ctl02 nova-api[2114]: 2017-09-28 12:32:31.347 2114 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:32:31 ctl02 nova-api[2114]: 2017-09-28 12:32:31.566 2114 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:32:31 ctl02 nova-api[2114]: 2017-09-28 12:32:31.569 2114 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:32:31 ctl02 nova-api[2114]: 2017-09-28 12:32:31.569 2114 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:32:31 ctl02 nova-api[2114]: 2017-09-28 12:32:31.569 2114 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:32:31 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x46799e55)
Sep 28 12:32:31 ctl02 nova-api[2114]: 2017-09-28 12:32:31.697 2114 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:32:31 ctl02 nova-api[2114]: 2017-09-28 12:32:31.699 2114 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:32:31 ctl02 nova-api[2114]: 2017-09-28 12:32:31.699 2114 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:32:31 ctl02 nova-api[2114]: 2017-09-28 12:32:31.700 2114 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:32:31 ctl02 nova-api[2114]: 2017-09-28 12:32:31.703 2114 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:32:31 ctl02 nova-api[2114]: 2017-09-28 12:32:31.703 2114 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:32:31 ctl02 nova-api[2114]: 2017-09-28 12:32:31.703 2114 ERROR nova Traceback (most recent call last):
Sep 28 12:32:31 ctl02 nova-api[2114]: 2017-09-28 12:32:31.703 2114 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:32:31 ctl02 nova-api[2114]: 2017-09-28 12:32:31.703 2114 ERROR nova     sys.exit(main())
Sep 28 12:32:31 ctl02 nova-api[2114]: 2017-09-28 12:32:31.703 2114 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:32:31 ctl02 nova-api[2114]: 2017-09-28 12:32:31.703 2114 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:32:31 ctl02 nova-api[2114]: 2017-09-28 12:32:31.703 2114 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:32:31 ctl02 nova-api[2114]: 2017-09-28 12:32:31.703 2114 ERROR nova     max_url_len=max_url_len)
Sep 28 12:32:31 ctl02 nova-api[2114]: 2017-09-28 12:32:31.703 2114 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:32:31 ctl02 nova-api[2114]: 2017-09-28 12:32:31.703 2114 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:32:31 ctl02 nova-api[2114]: 2017-09-28 12:32:31.703 2114 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:32:31 ctl02 nova-api[2114]: 2017-09-28 12:32:31.703 2114 ERROR nova     sock.listen(backlog)
Sep 28 12:32:31 ctl02 nova-api[2114]: 2017-09-28 12:32:31.703 2114 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:32:31 ctl02 nova-api[2114]: 2017-09-28 12:32:31.703 2114 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:32:31 ctl02 nova-api[2114]: 2017-09-28 12:32:31.703 2114 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:32:31 ctl02 nova-api[2114]: 2017-09-28 12:32:31.703 2114 ERROR nova
Sep 28 12:32:31 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:32:31 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:32:31 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:32:32 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:32:32 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:32:32 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:32:32 ctl02 neutron-server[30536]: 2017-09-28 12:32:32.143 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:32:32] "OPTIONS / HTTP/1.0" 200 262 0.000918
Sep 28 12:32:32 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:32:32 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x46799e55)
Sep 28 12:32:33 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x46799e55)
Sep 28 12:32:33 ctl02 nova-api[2132]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:32:33 ctl02 nova-api[2132]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:32:33 ctl02 nova-api[2132]: 2017-09-28 12:32:33.962 2132 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:32:33 ctl02 nova-api[2132]: 2017-09-28 12:32:33.963 2132 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:32:33 ctl02 nova-api[2132]: 2017-09-28 12:32:33.963 2132 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:32:33 ctl02 nova-api[2132]: 2017-09-28 12:32:33.963 2132 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:32:33 ctl02 nova-api[2132]: 2017-09-28 12:32:33.963 2132 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:32:33 ctl02 nova-api[2132]: 2017-09-28 12:32:33.963 2132 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:32:33 ctl02 nova-api[2132]: 2017-09-28 12:32:33.963 2132 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:32:33 ctl02 nova-api[2132]: 2017-09-28 12:32:33.963 2132 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:32:33 ctl02 nova-api[2132]: 2017-09-28 12:32:33.963 2132 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:32:33 ctl02 nova-api[2132]: 2017-09-28 12:32:33.963 2132 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:32:33 ctl02 nova-api[2132]: 2017-09-28 12:32:33.963 2132 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:32:33 ctl02 nova-api[2132]: 2017-09-28 12:32:33.963 2132 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:32:33 ctl02 nova-api[2132]: 2017-09-28 12:32:33.963 2132 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:32:33 ctl02 nova-api[2132]: 2017-09-28 12:32:33.963 2132 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:32:33 ctl02 nova-api[2132]: 2017-09-28 12:32:33.963 2132 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:32:33 ctl02 nova-api[2132]: 2017-09-28 12:32:33.963 2132 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:32:33 ctl02 nova-api[2132]: 2017-09-28 12:32:33.963 2132 ERROR nova.wsgi     self.filename))
Sep 28 12:32:33 ctl02 nova-api[2132]: 2017-09-28 12:32:33.963 2132 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:32:33 ctl02 nova-api[2132]: 2017-09-28 12:32:33.963 2132 ERROR nova.wsgi
Sep 28 12:32:33 ctl02 nova-api[2132]: 2017-09-28 12:32:33.964 2132 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:32:34 ctl02 nova-api[2132]: 2017-09-28 12:32:34.090 2132 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:32:34 ctl02 glance-api[29183]: 2017-09-28 12:32:34.287 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:32:34] "OPTIONS / HTTP/1.0" 200 134 0.000691
Sep 28 12:32:34 ctl02 nova-api[2132]: 2017-09-28 12:32:34.309 2132 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:32:34 ctl02 nova-api[2132]: 2017-09-28 12:32:34.311 2132 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:32:34 ctl02 nova-api[2132]: 2017-09-28 12:32:34.311 2132 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:32:34 ctl02 nova-api[2132]: 2017-09-28 12:32:34.311 2132 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:32:34 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:32:34.340 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:32:34] "OPTIONS / HTTP/1.0" 200 134 0.000574
Sep 28 12:32:34 ctl02 nova-api[2132]: 2017-09-28 12:32:34.440 2132 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:32:34 ctl02 nova-api[2132]: 2017-09-28 12:32:34.442 2132 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:32:34 ctl02 nova-api[2132]: 2017-09-28 12:32:34.442 2132 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:32:34 ctl02 nova-api[2132]: 2017-09-28 12:32:34.442 2132 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:32:34 ctl02 nova-api[2132]: 2017-09-28 12:32:34.446 2132 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:32:34 ctl02 nova-api[2132]: 2017-09-28 12:32:34.446 2132 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:32:34 ctl02 nova-api[2132]: 2017-09-28 12:32:34.446 2132 ERROR nova Traceback (most recent call last):
Sep 28 12:32:34 ctl02 nova-api[2132]: 2017-09-28 12:32:34.446 2132 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:32:34 ctl02 nova-api[2132]: 2017-09-28 12:32:34.446 2132 ERROR nova     sys.exit(main())
Sep 28 12:32:34 ctl02 nova-api[2132]: 2017-09-28 12:32:34.446 2132 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:32:34 ctl02 nova-api[2132]: 2017-09-28 12:32:34.446 2132 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:32:34 ctl02 nova-api[2132]: 2017-09-28 12:32:34.446 2132 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:32:34 ctl02 nova-api[2132]: 2017-09-28 12:32:34.446 2132 ERROR nova     max_url_len=max_url_len)
Sep 28 12:32:34 ctl02 nova-api[2132]: 2017-09-28 12:32:34.446 2132 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:32:34 ctl02 nova-api[2132]: 2017-09-28 12:32:34.446 2132 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:32:34 ctl02 nova-api[2132]: 2017-09-28 12:32:34.446 2132 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:32:34 ctl02 nova-api[2132]: 2017-09-28 12:32:34.446 2132 ERROR nova     sock.listen(backlog)
Sep 28 12:32:34 ctl02 nova-api[2132]: 2017-09-28 12:32:34.446 2132 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:32:34 ctl02 nova-api[2132]: 2017-09-28 12:32:34.446 2132 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:32:34 ctl02 nova-api[2132]: 2017-09-28 12:32:34.446 2132 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:32:34 ctl02 nova-api[2132]: 2017-09-28 12:32:34.446 2132 ERROR nova
Sep 28 12:32:34 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:32:34 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:32:34 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:32:34 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x46799e55)
Sep 28 12:32:34 ctl02 heat-api[13008]: 2017-09-28 12:32:34.734 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:32:34] "OPTIONS / HTTP/1.0" 200 134 0.000697
Sep 28 12:32:34 ctl02 glance-api[29183]: 2017-09-28 12:32:34.773 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:32:34] "OPTIONS / HTTP/1.0" 200 134 0.000616
Sep 28 12:32:34 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:32:34 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:32:34 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:32:34 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:32:35 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x46799e55)
Sep 28 12:32:36 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:32:36.135 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:32:36] "OPTIONS / HTTP/1.0" 200 134 0.000502
Sep 28 12:32:36 ctl02 neutron-server[30536]: 2017-09-28 12:32:36.403 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 12:32:36 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:32:36 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:31:58 cmp001
Sep 28 12:32:36 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:30:40 cmp002
Sep 28 12:32:36 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:32:06 cmp002
Sep 28 12:32:36 ctl02 nova-api[2150]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:32:36 ctl02 nova-api[2150]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:32:36 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x46799e55)
Sep 28 12:32:36 ctl02 nova-api[2150]: 2017-09-28 12:32:36.770 2150 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:32:36 ctl02 nova-api[2150]: 2017-09-28 12:32:36.771 2150 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:32:36 ctl02 nova-api[2150]: 2017-09-28 12:32:36.771 2150 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:32:36 ctl02 nova-api[2150]: 2017-09-28 12:32:36.771 2150 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:32:36 ctl02 nova-api[2150]: 2017-09-28 12:32:36.771 2150 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:32:36 ctl02 nova-api[2150]: 2017-09-28 12:32:36.771 2150 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:32:36 ctl02 nova-api[2150]: 2017-09-28 12:32:36.771 2150 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:32:36 ctl02 nova-api[2150]: 2017-09-28 12:32:36.771 2150 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:32:36 ctl02 nova-api[2150]: 2017-09-28 12:32:36.771 2150 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:32:36 ctl02 nova-api[2150]: 2017-09-28 12:32:36.771 2150 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:32:36 ctl02 nova-api[2150]: 2017-09-28 12:32:36.771 2150 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:32:36 ctl02 nova-api[2150]: 2017-09-28 12:32:36.771 2150 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:32:36 ctl02 nova-api[2150]: 2017-09-28 12:32:36.771 2150 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:32:36 ctl02 nova-api[2150]: 2017-09-28 12:32:36.771 2150 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:32:36 ctl02 nova-api[2150]: 2017-09-28 12:32:36.771 2150 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:32:36 ctl02 nova-api[2150]: 2017-09-28 12:32:36.771 2150 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:32:36 ctl02 nova-api[2150]: 2017-09-28 12:32:36.771 2150 ERROR nova.wsgi     self.filename))
Sep 28 12:32:36 ctl02 nova-api[2150]: 2017-09-28 12:32:36.771 2150 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:32:36 ctl02 nova-api[2150]: 2017-09-28 12:32:36.771 2150 ERROR nova.wsgi
Sep 28 12:32:36 ctl02 nova-api[2150]: 2017-09-28 12:32:36.772 2150 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:32:36 ctl02 nova-api[2150]: 2017-09-28 12:32:36.908 2150 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:32:37 ctl02 nova-api[2150]: 2017-09-28 12:32:37.160 2150 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:32:37 ctl02 nova-api[2150]: 2017-09-28 12:32:37.162 2150 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:32:37 ctl02 nova-api[2150]: 2017-09-28 12:32:37.162 2150 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:32:37 ctl02 nova-api[2150]: 2017-09-28 12:32:37.163 2150 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:32:37 ctl02 nova-api[2150]: 2017-09-28 12:32:37.295 2150 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:32:37 ctl02 nova-api[2150]: 2017-09-28 12:32:37.297 2150 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:32:37 ctl02 nova-api[2150]: 2017-09-28 12:32:37.298 2150 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:32:37 ctl02 nova-api[2150]: 2017-09-28 12:32:37.298 2150 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:32:37 ctl02 nova-api[2150]: 2017-09-28 12:32:37.301 2150 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:32:37 ctl02 nova-api[2150]: 2017-09-28 12:32:37.302 2150 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:32:37 ctl02 nova-api[2150]: 2017-09-28 12:32:37.302 2150 ERROR nova Traceback (most recent call last):
Sep 28 12:32:37 ctl02 nova-api[2150]: 2017-09-28 12:32:37.302 2150 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:32:37 ctl02 nova-api[2150]: 2017-09-28 12:32:37.302 2150 ERROR nova     sys.exit(main())
Sep 28 12:32:37 ctl02 nova-api[2150]: 2017-09-28 12:32:37.302 2150 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:32:37 ctl02 nova-api[2150]: 2017-09-28 12:32:37.302 2150 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:32:37 ctl02 nova-api[2150]: 2017-09-28 12:32:37.302 2150 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:32:37 ctl02 nova-api[2150]: 2017-09-28 12:32:37.302 2150 ERROR nova     max_url_len=max_url_len)
Sep 28 12:32:37 ctl02 nova-api[2150]: 2017-09-28 12:32:37.302 2150 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:32:37 ctl02 nova-api[2150]: 2017-09-28 12:32:37.302 2150 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:32:37 ctl02 nova-api[2150]: 2017-09-28 12:32:37.302 2150 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:32:37 ctl02 nova-api[2150]: 2017-09-28 12:32:37.302 2150 ERROR nova     sock.listen(backlog)
Sep 28 12:32:37 ctl02 nova-api[2150]: 2017-09-28 12:32:37.302 2150 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:32:37 ctl02 nova-api[2150]: 2017-09-28 12:32:37.302 2150 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:32:37 ctl02 nova-api[2150]: 2017-09-28 12:32:37.302 2150 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:32:37 ctl02 nova-api[2150]: 2017-09-28 12:32:37.302 2150 ERROR nova
Sep 28 12:32:37 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:32:37.380 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:32:37] "OPTIONS / HTTP/1.0" 200 134 0.000558
Sep 28 12:32:37 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:32:37 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:32:37 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:32:37 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:32:37 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:32:37 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:32:37 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x46799e55)
Sep 28 12:32:37 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:32:37 ctl02 heat-api[13008]: 2017-09-28 12:32:37.686 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:32:37] "OPTIONS / HTTP/1.0" 200 134 0.000622
Sep 28 12:32:37 ctl02 nova-cert[4860]: 2017-09-28 12:32:37.912 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:32:37 ctl02 heat-api-cfn[13300]: 2017-09-28 12:32:37.971 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:32:37] "OPTIONS / HTTP/1.0" 200 134 0.000550
Sep 28 12:32:38 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x46799e55)
Sep 28 12:32:38 ctl02 nova-conductor[5056]: 2017-09-28 12:32:38.777 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:32:38 ctl02 nova-conductor[5056]: 2017-09-28 12:32:38.797 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:32:38 ctl02 nova-conductor[5056]: 2017-09-28 12:32:38.806 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:32:38 ctl02 nova-conductor[5056]: 2017-09-28 12:32:38.810 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:32:38 ctl02 heat-api-cfn[13300]: 2017-09-28 12:32:38.860 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:32:38] "OPTIONS / HTTP/1.0" 200 134 0.000588
Sep 28 12:32:39 ctl02 nova-api[2168]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:32:39 ctl02 nova-api[2168]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:32:39 ctl02 nova-api[2168]: 2017-09-28 12:32:39.580 2168 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:32:39 ctl02 nova-api[2168]: 2017-09-28 12:32:39.582 2168 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:32:39 ctl02 nova-api[2168]: 2017-09-28 12:32:39.582 2168 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:32:39 ctl02 nova-api[2168]: 2017-09-28 12:32:39.582 2168 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:32:39 ctl02 nova-api[2168]: 2017-09-28 12:32:39.582 2168 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:32:39 ctl02 nova-api[2168]: 2017-09-28 12:32:39.582 2168 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:32:39 ctl02 nova-api[2168]: 2017-09-28 12:32:39.582 2168 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:32:39 ctl02 nova-api[2168]: 2017-09-28 12:32:39.582 2168 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:32:39 ctl02 nova-api[2168]: 2017-09-28 12:32:39.582 2168 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:32:39 ctl02 nova-api[2168]: 2017-09-28 12:32:39.582 2168 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:32:39 ctl02 nova-api[2168]: 2017-09-28 12:32:39.582 2168 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:32:39 ctl02 nova-api[2168]: 2017-09-28 12:32:39.582 2168 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:32:39 ctl02 nova-api[2168]: 2017-09-28 12:32:39.582 2168 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:32:39 ctl02 nova-api[2168]: 2017-09-28 12:32:39.582 2168 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:32:39 ctl02 nova-api[2168]: 2017-09-28 12:32:39.582 2168 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:32:39 ctl02 nova-api[2168]: 2017-09-28 12:32:39.582 2168 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:32:39 ctl02 nova-api[2168]: 2017-09-28 12:32:39.582 2168 ERROR nova.wsgi     self.filename))
Sep 28 12:32:39 ctl02 nova-api[2168]: 2017-09-28 12:32:39.582 2168 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:32:39 ctl02 nova-api[2168]: 2017-09-28 12:32:39.582 2168 ERROR nova.wsgi
Sep 28 12:32:39 ctl02 nova-api[2168]: 2017-09-28 12:32:39.584 2168 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:32:39 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:32:39 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:32:39 ctl02 heat-api[13008]: 2017-09-28 12:32:39.699 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:32:39] "OPTIONS / HTTP/1.0" 200 134 0.000923
Sep 28 12:32:39 ctl02 nova-api[2168]: 2017-09-28 12:32:39.726 2168 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:32:39 ctl02 neutron-server[30536]: 2017-09-28 12:32:39.864 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:32:39] "OPTIONS / HTTP/1.0" 200 262 0.000612
Sep 28 12:32:39 ctl02 nova-api[2168]: 2017-09-28 12:32:39.986 2168 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:32:39 ctl02 nova-api[2168]: 2017-09-28 12:32:39.989 2168 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:32:39 ctl02 nova-api[2168]: 2017-09-28 12:32:39.989 2168 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:32:39 ctl02 nova-api[2168]: 2017-09-28 12:32:39.989 2168 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:32:40 ctl02 nova-api[2168]: 2017-09-28 12:32:40.138 2168 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:32:40 ctl02 nova-api[2168]: 2017-09-28 12:32:40.141 2168 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:32:40 ctl02 nova-api[2168]: 2017-09-28 12:32:40.141 2168 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:32:40 ctl02 nova-api[2168]: 2017-09-28 12:32:40.141 2168 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:32:40 ctl02 nova-api[2168]: 2017-09-28 12:32:40.145 2168 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:32:40 ctl02 nova-api[2168]: 2017-09-28 12:32:40.146 2168 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:32:40 ctl02 nova-api[2168]: 2017-09-28 12:32:40.146 2168 ERROR nova Traceback (most recent call last):
Sep 28 12:32:40 ctl02 nova-api[2168]: 2017-09-28 12:32:40.146 2168 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:32:40 ctl02 nova-api[2168]: 2017-09-28 12:32:40.146 2168 ERROR nova     sys.exit(main())
Sep 28 12:32:40 ctl02 nova-api[2168]: 2017-09-28 12:32:40.146 2168 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:32:40 ctl02 nova-api[2168]: 2017-09-28 12:32:40.146 2168 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:32:40 ctl02 nova-api[2168]: 2017-09-28 12:32:40.146 2168 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:32:40 ctl02 nova-api[2168]: 2017-09-28 12:32:40.146 2168 ERROR nova     max_url_len=max_url_len)
Sep 28 12:32:40 ctl02 nova-api[2168]: 2017-09-28 12:32:40.146 2168 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:32:40 ctl02 nova-api[2168]: 2017-09-28 12:32:40.146 2168 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:32:40 ctl02 nova-api[2168]: 2017-09-28 12:32:40.146 2168 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:32:40 ctl02 nova-api[2168]: 2017-09-28 12:32:40.146 2168 ERROR nova     sock.listen(backlog)
Sep 28 12:32:40 ctl02 nova-api[2168]: 2017-09-28 12:32:40.146 2168 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:32:40 ctl02 nova-api[2168]: 2017-09-28 12:32:40.146 2168 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:32:40 ctl02 nova-api[2168]: 2017-09-28 12:32:40.146 2168 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:32:40 ctl02 nova-api[2168]: 2017-09-28 12:32:40.146 2168 ERROR nova
Sep 28 12:32:40 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:32:40 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:32:40 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:32:40 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:32:40 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:32:40 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:32:40 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:32:40 ctl02 neutron-server[30536]: 2017-09-28 12:32:40.724 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:32:40] "OPTIONS / HTTP/1.0" 200 262 0.000504
Sep 28 12:32:40 ctl02 heat-api-cfn[13300]: 2017-09-28 12:32:40.938 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:32:40] "OPTIONS / HTTP/1.0" 200 134 0.000588
Sep 28 12:32:41 ctl02 glance-api[29183]: 2017-09-28 12:32:41.462 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:32:41] "OPTIONS / HTTP/1.0" 200 134 0.000571
Sep 28 12:32:42 ctl02 nova-api[2189]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:32:42 ctl02 nova-api[2189]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:32:42 ctl02 neutron-server[30536]: 2017-09-28 12:32:42.380 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:32:42] "OPTIONS / HTTP/1.0" 200 262 0.000530
Sep 28 12:32:42 ctl02 nova-api[2189]: 2017-09-28 12:32:42.503 2189 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:32:42 ctl02 nova-api[2189]: 2017-09-28 12:32:42.505 2189 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:32:42 ctl02 nova-api[2189]: 2017-09-28 12:32:42.505 2189 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:32:42 ctl02 nova-api[2189]: 2017-09-28 12:32:42.505 2189 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:32:42 ctl02 nova-api[2189]: 2017-09-28 12:32:42.505 2189 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:32:42 ctl02 nova-api[2189]: 2017-09-28 12:32:42.505 2189 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:32:42 ctl02 nova-api[2189]: 2017-09-28 12:32:42.505 2189 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:32:42 ctl02 nova-api[2189]: 2017-09-28 12:32:42.505 2189 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:32:42 ctl02 nova-api[2189]: 2017-09-28 12:32:42.505 2189 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:32:42 ctl02 nova-api[2189]: 2017-09-28 12:32:42.505 2189 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:32:42 ctl02 nova-api[2189]: 2017-09-28 12:32:42.505 2189 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:32:42 ctl02 nova-api[2189]: 2017-09-28 12:32:42.505 2189 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:32:42 ctl02 nova-api[2189]: 2017-09-28 12:32:42.505 2189 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:32:42 ctl02 nova-api[2189]: 2017-09-28 12:32:42.505 2189 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:32:42 ctl02 nova-api[2189]: 2017-09-28 12:32:42.505 2189 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:32:42 ctl02 nova-api[2189]: 2017-09-28 12:32:42.505 2189 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:32:42 ctl02 nova-api[2189]: 2017-09-28 12:32:42.505 2189 ERROR nova.wsgi     self.filename))
Sep 28 12:32:42 ctl02 nova-api[2189]: 2017-09-28 12:32:42.505 2189 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:32:42 ctl02 nova-api[2189]: 2017-09-28 12:32:42.505 2189 ERROR nova.wsgi
Sep 28 12:32:42 ctl02 nova-api[2189]: 2017-09-28 12:32:42.506 2189 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:32:42 ctl02 nova-api[2189]: 2017-09-28 12:32:42.632 2189 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:32:42 ctl02 nova-api[2189]: 2017-09-28 12:32:42.853 2189 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:32:42 ctl02 nova-api[2189]: 2017-09-28 12:32:42.855 2189 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:32:42 ctl02 nova-api[2189]: 2017-09-28 12:32:42.855 2189 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:32:42 ctl02 nova-api[2189]: 2017-09-28 12:32:42.855 2189 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:32:42 ctl02 nova-api[2189]: 2017-09-28 12:32:42.986 2189 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:32:42 ctl02 nova-api[2189]: 2017-09-28 12:32:42.987 2189 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:32:42 ctl02 nova-api[2189]: 2017-09-28 12:32:42.988 2189 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:32:42 ctl02 nova-api[2189]: 2017-09-28 12:32:42.988 2189 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:32:42 ctl02 nova-api[2189]: 2017-09-28 12:32:42.991 2189 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:32:42 ctl02 nova-api[2189]: 2017-09-28 12:32:42.991 2189 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:32:42 ctl02 nova-api[2189]: 2017-09-28 12:32:42.991 2189 ERROR nova Traceback (most recent call last):
Sep 28 12:32:42 ctl02 nova-api[2189]: 2017-09-28 12:32:42.991 2189 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:32:42 ctl02 nova-api[2189]: 2017-09-28 12:32:42.991 2189 ERROR nova     sys.exit(main())
Sep 28 12:32:42 ctl02 nova-api[2189]: 2017-09-28 12:32:42.991 2189 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:32:42 ctl02 nova-api[2189]: 2017-09-28 12:32:42.991 2189 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:32:42 ctl02 nova-api[2189]: 2017-09-28 12:32:42.991 2189 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:32:42 ctl02 nova-api[2189]: 2017-09-28 12:32:42.991 2189 ERROR nova     max_url_len=max_url_len)
Sep 28 12:32:42 ctl02 nova-api[2189]: 2017-09-28 12:32:42.991 2189 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:32:42 ctl02 nova-api[2189]: 2017-09-28 12:32:42.991 2189 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:32:42 ctl02 nova-api[2189]: 2017-09-28 12:32:42.991 2189 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:32:42 ctl02 nova-api[2189]: 2017-09-28 12:32:42.991 2189 ERROR nova     sock.listen(backlog)
Sep 28 12:32:42 ctl02 nova-api[2189]: 2017-09-28 12:32:42.991 2189 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:32:42 ctl02 nova-api[2189]: 2017-09-28 12:32:42.991 2189 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:32:42 ctl02 nova-api[2189]: 2017-09-28 12:32:42.991 2189 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:32:42 ctl02 nova-api[2189]: 2017-09-28 12:32:42.991 2189 ERROR nova
Sep 28 12:32:43 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:32:43 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:32:43 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:32:43 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:32:43 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:32:43 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:32:43 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:32:44 ctl02 glance-api[29183]: 2017-09-28 12:32:44.308 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:32:44] "OPTIONS / HTTP/1.0" 200 134 0.000552
Sep 28 12:32:44 ctl02 glance-api[29183]: 2017-09-28 12:32:44.440 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:32:44] "OPTIONS / HTTP/1.0" 200 134 0.000406
Sep 28 12:32:44 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:32:44.465 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:32:44] "OPTIONS / HTTP/1.0" 200 134 0.000524
Sep 28 12:32:44 ctl02 heat-api[13008]: 2017-09-28 12:32:44.838 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:32:44] "OPTIONS / HTTP/1.0" 200 134 0.000540
Sep 28 12:32:45 ctl02 nova-api[2209]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:32:45 ctl02 nova-api[2209]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:32:45 ctl02 nova-api[2209]: 2017-09-28 12:32:45.237 2209 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:32:45 ctl02 nova-api[2209]: 2017-09-28 12:32:45.238 2209 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:32:45 ctl02 nova-api[2209]: 2017-09-28 12:32:45.238 2209 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:32:45 ctl02 nova-api[2209]: 2017-09-28 12:32:45.238 2209 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:32:45 ctl02 nova-api[2209]: 2017-09-28 12:32:45.238 2209 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:32:45 ctl02 nova-api[2209]: 2017-09-28 12:32:45.238 2209 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:32:45 ctl02 nova-api[2209]: 2017-09-28 12:32:45.238 2209 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:32:45 ctl02 nova-api[2209]: 2017-09-28 12:32:45.238 2209 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:32:45 ctl02 nova-api[2209]: 2017-09-28 12:32:45.238 2209 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:32:45 ctl02 nova-api[2209]: 2017-09-28 12:32:45.238 2209 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:32:45 ctl02 nova-api[2209]: 2017-09-28 12:32:45.238 2209 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:32:45 ctl02 nova-api[2209]: 2017-09-28 12:32:45.238 2209 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:32:45 ctl02 nova-api[2209]: 2017-09-28 12:32:45.238 2209 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:32:45 ctl02 nova-api[2209]: 2017-09-28 12:32:45.238 2209 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:32:45 ctl02 nova-api[2209]: 2017-09-28 12:32:45.238 2209 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:32:45 ctl02 nova-api[2209]: 2017-09-28 12:32:45.238 2209 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:32:45 ctl02 nova-api[2209]: 2017-09-28 12:32:45.238 2209 ERROR nova.wsgi     self.filename))
Sep 28 12:32:45 ctl02 nova-api[2209]: 2017-09-28 12:32:45.238 2209 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:32:45 ctl02 nova-api[2209]: 2017-09-28 12:32:45.238 2209 ERROR nova.wsgi
Sep 28 12:32:45 ctl02 nova-api[2209]: 2017-09-28 12:32:45.239 2209 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:32:45 ctl02 nova-api[2209]: 2017-09-28 12:32:45.365 2209 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:32:45 ctl02 nova-api[2209]: 2017-09-28 12:32:45.588 2209 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:32:45 ctl02 nova-api[2209]: 2017-09-28 12:32:45.590 2209 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:32:45 ctl02 nova-api[2209]: 2017-09-28 12:32:45.590 2209 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:32:45 ctl02 nova-api[2209]: 2017-09-28 12:32:45.590 2209 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:32:45 ctl02 nova-api[2209]: 2017-09-28 12:32:45.720 2209 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:32:45 ctl02 nova-api[2209]: 2017-09-28 12:32:45.721 2209 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:32:45 ctl02 nova-api[2209]: 2017-09-28 12:32:45.722 2209 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:32:45 ctl02 nova-api[2209]: 2017-09-28 12:32:45.722 2209 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:32:45 ctl02 nova-api[2209]: 2017-09-28 12:32:45.725 2209 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:32:45 ctl02 nova-api[2209]: 2017-09-28 12:32:45.725 2209 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:32:45 ctl02 nova-api[2209]: 2017-09-28 12:32:45.725 2209 ERROR nova Traceback (most recent call last):
Sep 28 12:32:45 ctl02 nova-api[2209]: 2017-09-28 12:32:45.725 2209 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:32:45 ctl02 nova-api[2209]: 2017-09-28 12:32:45.725 2209 ERROR nova     sys.exit(main())
Sep 28 12:32:45 ctl02 nova-api[2209]: 2017-09-28 12:32:45.725 2209 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:32:45 ctl02 nova-api[2209]: 2017-09-28 12:32:45.725 2209 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:32:45 ctl02 nova-api[2209]: 2017-09-28 12:32:45.725 2209 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:32:45 ctl02 nova-api[2209]: 2017-09-28 12:32:45.725 2209 ERROR nova     max_url_len=max_url_len)
Sep 28 12:32:45 ctl02 nova-api[2209]: 2017-09-28 12:32:45.725 2209 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:32:45 ctl02 nova-api[2209]: 2017-09-28 12:32:45.725 2209 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:32:45 ctl02 nova-api[2209]: 2017-09-28 12:32:45.725 2209 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:32:45 ctl02 nova-api[2209]: 2017-09-28 12:32:45.725 2209 ERROR nova     sock.listen(backlog)
Sep 28 12:32:45 ctl02 nova-api[2209]: 2017-09-28 12:32:45.725 2209 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:32:45 ctl02 nova-api[2209]: 2017-09-28 12:32:45.725 2209 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:32:45 ctl02 nova-api[2209]: 2017-09-28 12:32:45.725 2209 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:32:45 ctl02 nova-api[2209]: 2017-09-28 12:32:45.725 2209 ERROR nova
Sep 28 12:32:45 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:32:45 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:32:45 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:32:45 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:32:45.877 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:32:45] "OPTIONS / HTTP/1.0" 200 134 0.000492
Sep 28 12:32:46 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:32:46 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:32:46 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:32:46 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:32:47 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:32:47.457 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:32:47] "OPTIONS / HTTP/1.0" 200 134 0.000424
Sep 28 12:32:47 ctl02 heat-api[13008]: 2017-09-28 12:32:47.478 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:32:47] "OPTIONS / HTTP/1.0" 200 134 0.000521
Sep 28 12:32:47 ctl02 heat-api-cfn[13300]: 2017-09-28 12:32:47.660 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:32:47] "OPTIONS / HTTP/1.0" 200 134 0.000426
Sep 28 12:32:47 ctl02 nova-consoleauth[5433]: 2017-09-28 12:32:47.792 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:32:47 ctl02 nova-api[2228]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:32:47 ctl02 nova-api[2228]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:32:47 ctl02 nova-api[2228]: 2017-09-28 12:32:47.974 2228 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:32:47 ctl02 nova-api[2228]: 2017-09-28 12:32:47.975 2228 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:32:47 ctl02 nova-api[2228]: 2017-09-28 12:32:47.975 2228 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:32:47 ctl02 nova-api[2228]: 2017-09-28 12:32:47.975 2228 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:32:47 ctl02 nova-api[2228]: 2017-09-28 12:32:47.975 2228 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:32:47 ctl02 nova-api[2228]: 2017-09-28 12:32:47.975 2228 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:32:47 ctl02 nova-api[2228]: 2017-09-28 12:32:47.975 2228 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:32:47 ctl02 nova-api[2228]: 2017-09-28 12:32:47.975 2228 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:32:47 ctl02 nova-api[2228]: 2017-09-28 12:32:47.975 2228 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:32:47 ctl02 nova-api[2228]: 2017-09-28 12:32:47.975 2228 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:32:47 ctl02 nova-api[2228]: 2017-09-28 12:32:47.975 2228 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:32:47 ctl02 nova-api[2228]: 2017-09-28 12:32:47.975 2228 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:32:47 ctl02 nova-api[2228]: 2017-09-28 12:32:47.975 2228 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:32:47 ctl02 nova-api[2228]: 2017-09-28 12:32:47.975 2228 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:32:47 ctl02 nova-api[2228]: 2017-09-28 12:32:47.975 2228 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:32:47 ctl02 nova-api[2228]: 2017-09-28 12:32:47.975 2228 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:32:47 ctl02 nova-api[2228]: 2017-09-28 12:32:47.975 2228 ERROR nova.wsgi     self.filename))
Sep 28 12:32:47 ctl02 nova-api[2228]: 2017-09-28 12:32:47.975 2228 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:32:47 ctl02 nova-api[2228]: 2017-09-28 12:32:47.975 2228 ERROR nova.wsgi
Sep 28 12:32:47 ctl02 nova-api[2228]: 2017-09-28 12:32:47.977 2228 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:32:48 ctl02 nova-api[2228]: 2017-09-28 12:32:48.103 2228 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:32:48 ctl02 nova-api[2228]: 2017-09-28 12:32:48.324 2228 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:32:48 ctl02 nova-api[2228]: 2017-09-28 12:32:48.327 2228 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:32:48 ctl02 nova-api[2228]: 2017-09-28 12:32:48.327 2228 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:32:48 ctl02 nova-api[2228]: 2017-09-28 12:32:48.328 2228 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:32:48 ctl02 nova-api[2228]: 2017-09-28 12:32:48.458 2228 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:32:48 ctl02 nova-api[2228]: 2017-09-28 12:32:48.461 2228 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:32:48 ctl02 nova-api[2228]: 2017-09-28 12:32:48.461 2228 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:32:48 ctl02 nova-api[2228]: 2017-09-28 12:32:48.462 2228 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:32:48 ctl02 nova-api[2228]: 2017-09-28 12:32:48.465 2228 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:32:48 ctl02 nova-api[2228]: 2017-09-28 12:32:48.465 2228 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:32:48 ctl02 nova-api[2228]: 2017-09-28 12:32:48.465 2228 ERROR nova Traceback (most recent call last):
Sep 28 12:32:48 ctl02 nova-api[2228]: 2017-09-28 12:32:48.465 2228 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:32:48 ctl02 nova-api[2228]: 2017-09-28 12:32:48.465 2228 ERROR nova     sys.exit(main())
Sep 28 12:32:48 ctl02 nova-api[2228]: 2017-09-28 12:32:48.465 2228 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:32:48 ctl02 nova-api[2228]: 2017-09-28 12:32:48.465 2228 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:32:48 ctl02 nova-api[2228]: 2017-09-28 12:32:48.465 2228 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:32:48 ctl02 nova-api[2228]: 2017-09-28 12:32:48.465 2228 ERROR nova     max_url_len=max_url_len)
Sep 28 12:32:48 ctl02 nova-api[2228]: 2017-09-28 12:32:48.465 2228 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:32:48 ctl02 nova-api[2228]: 2017-09-28 12:32:48.465 2228 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:32:48 ctl02 nova-api[2228]: 2017-09-28 12:32:48.465 2228 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:32:48 ctl02 nova-api[2228]: 2017-09-28 12:32:48.465 2228 ERROR nova     sock.listen(backlog)
Sep 28 12:32:48 ctl02 nova-api[2228]: 2017-09-28 12:32:48.465 2228 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:32:48 ctl02 nova-api[2228]: 2017-09-28 12:32:48.465 2228 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:32:48 ctl02 nova-api[2228]: 2017-09-28 12:32:48.465 2228 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:32:48 ctl02 nova-api[2228]: 2017-09-28 12:32:48.465 2228 ERROR nova
Sep 28 12:32:48 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:32:48 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:32:48 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:32:48 ctl02 heat-api-cfn[13300]: 2017-09-28 12:32:48.775 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:32:48] "OPTIONS / HTTP/1.0" 200 134 0.000585
Sep 28 12:32:48 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:32:48 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:32:48 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:32:48 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:32:49 ctl02 heat-api[13008]: 2017-09-28 12:32:49.623 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:32:49] "OPTIONS / HTTP/1.0" 200 134 0.000612
Sep 28 12:32:49 ctl02 neutron-server[30536]: 2017-09-28 12:32:49.908 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:32:49] "OPTIONS / HTTP/1.0" 200 262 0.000533
Sep 28 12:32:49 ctl02 heat-engine[12803]: 2017-09-28 12:32:49.907 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:32:49 ctl02 heat-engine[12803]: 2017-09-28 12:32:49.905 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:32:49 ctl02 heat-engine[12803]: 2017-09-28 12:32:49.910 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:32:49 ctl02 heat-engine[12803]: 2017-09-28 12:32:49.911 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:32:50 ctl02 nova-api[2246]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:32:50 ctl02 nova-api[2246]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:32:50 ctl02 nova-api[2246]: 2017-09-28 12:32:50.791 2246 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:32:50 ctl02 nova-api[2246]: 2017-09-28 12:32:50.793 2246 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:32:50 ctl02 nova-api[2246]: 2017-09-28 12:32:50.793 2246 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:32:50 ctl02 nova-api[2246]: 2017-09-28 12:32:50.793 2246 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:32:50 ctl02 nova-api[2246]: 2017-09-28 12:32:50.793 2246 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:32:50 ctl02 nova-api[2246]: 2017-09-28 12:32:50.793 2246 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:32:50 ctl02 nova-api[2246]: 2017-09-28 12:32:50.793 2246 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:32:50 ctl02 nova-api[2246]: 2017-09-28 12:32:50.793 2246 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:32:50 ctl02 nova-api[2246]: 2017-09-28 12:32:50.793 2246 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:32:50 ctl02 nova-api[2246]: 2017-09-28 12:32:50.793 2246 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:32:50 ctl02 nova-api[2246]: 2017-09-28 12:32:50.793 2246 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:32:50 ctl02 nova-api[2246]: 2017-09-28 12:32:50.793 2246 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:32:50 ctl02 nova-api[2246]: 2017-09-28 12:32:50.793 2246 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:32:50 ctl02 nova-api[2246]: 2017-09-28 12:32:50.793 2246 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:32:50 ctl02 nova-api[2246]: 2017-09-28 12:32:50.793 2246 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:32:50 ctl02 nova-api[2246]: 2017-09-28 12:32:50.793 2246 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:32:50 ctl02 nova-api[2246]: 2017-09-28 12:32:50.793 2246 ERROR nova.wsgi     self.filename))
Sep 28 12:32:50 ctl02 nova-api[2246]: 2017-09-28 12:32:50.793 2246 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:32:50 ctl02 nova-api[2246]: 2017-09-28 12:32:50.793 2246 ERROR nova.wsgi
Sep 28 12:32:50 ctl02 nova-api[2246]: 2017-09-28 12:32:50.795 2246 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:32:50 ctl02 nova-scheduler[5620]: 2017-09-28 12:32:50.830 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:32:50 ctl02 nova-api[2246]: 2017-09-28 12:32:50.926 2246 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:32:50 ctl02 neutron-server[30536]: 2017-09-28 12:32:50.940 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:32:50] "OPTIONS / HTTP/1.0" 200 262 0.000484
Sep 28 12:32:51 ctl02 nova-api[2246]: 2017-09-28 12:32:51.181 2246 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:32:51 ctl02 nova-api[2246]: 2017-09-28 12:32:51.184 2246 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:32:51 ctl02 nova-api[2246]: 2017-09-28 12:32:51.184 2246 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:32:51 ctl02 nova-api[2246]: 2017-09-28 12:32:51.185 2246 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:32:51 ctl02 nova-api[2246]: 2017-09-28 12:32:51.319 2246 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:32:51 ctl02 nova-api[2246]: 2017-09-28 12:32:51.321 2246 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:32:51 ctl02 nova-api[2246]: 2017-09-28 12:32:51.322 2246 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:32:51 ctl02 nova-api[2246]: 2017-09-28 12:32:51.322 2246 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:32:51 ctl02 heat-api-cfn[13300]: 2017-09-28 12:32:51.322 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:32:51] "OPTIONS / HTTP/1.0" 200 134 0.000565
Sep 28 12:32:51 ctl02 nova-api[2246]: 2017-09-28 12:32:51.326 2246 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:32:51 ctl02 nova-api[2246]: 2017-09-28 12:32:51.326 2246 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:32:51 ctl02 nova-api[2246]: 2017-09-28 12:32:51.326 2246 ERROR nova Traceback (most recent call last):
Sep 28 12:32:51 ctl02 nova-api[2246]: 2017-09-28 12:32:51.326 2246 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:32:51 ctl02 nova-api[2246]: 2017-09-28 12:32:51.326 2246 ERROR nova     sys.exit(main())
Sep 28 12:32:51 ctl02 nova-api[2246]: 2017-09-28 12:32:51.326 2246 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:32:51 ctl02 nova-api[2246]: 2017-09-28 12:32:51.326 2246 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:32:51 ctl02 nova-api[2246]: 2017-09-28 12:32:51.326 2246 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:32:51 ctl02 nova-api[2246]: 2017-09-28 12:32:51.326 2246 ERROR nova     max_url_len=max_url_len)
Sep 28 12:32:51 ctl02 nova-api[2246]: 2017-09-28 12:32:51.326 2246 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:32:51 ctl02 nova-api[2246]: 2017-09-28 12:32:51.326 2246 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:32:51 ctl02 nova-api[2246]: 2017-09-28 12:32:51.326 2246 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:32:51 ctl02 nova-api[2246]: 2017-09-28 12:32:51.326 2246 ERROR nova     sock.listen(backlog)
Sep 28 12:32:51 ctl02 nova-api[2246]: 2017-09-28 12:32:51.326 2246 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:32:51 ctl02 nova-api[2246]: 2017-09-28 12:32:51.326 2246 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:32:51 ctl02 nova-api[2246]: 2017-09-28 12:32:51.326 2246 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:32:51 ctl02 nova-api[2246]: 2017-09-28 12:32:51.326 2246 ERROR nova
Sep 28 12:32:51 ctl02 neutron-server[30536]: 2017-09-28 12:32:51.399 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 12:32:51 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:32:51 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:32:08 cmp002
Sep 28 12:32:51 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:31:58 cmp001
Sep 28 12:32:51 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:32:06 cmp002
Sep 28 12:32:51 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:32:51 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:32:51 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:32:51 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:32:51 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:32:51 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:32:51 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:32:51 ctl02 glance-api[29183]: 2017-09-28 12:32:51.756 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:32:51] "OPTIONS / HTTP/1.0" 200 134 0.000677
Sep 28 12:32:52 ctl02 neutron-server[30536]: 2017-09-28 12:32:52.421 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:32:52] "OPTIONS / HTTP/1.0" 200 262 0.000442
Sep 28 12:32:53 ctl02 nova-api[2264]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:32:53 ctl02 nova-api[2264]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:32:53 ctl02 nova-api[2264]: 2017-09-28 12:32:53.477 2264 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:32:53 ctl02 nova-api[2264]: 2017-09-28 12:32:53.479 2264 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:32:53 ctl02 nova-api[2264]: 2017-09-28 12:32:53.479 2264 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:32:53 ctl02 nova-api[2264]: 2017-09-28 12:32:53.479 2264 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:32:53 ctl02 nova-api[2264]: 2017-09-28 12:32:53.479 2264 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:32:53 ctl02 nova-api[2264]: 2017-09-28 12:32:53.479 2264 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:32:53 ctl02 nova-api[2264]: 2017-09-28 12:32:53.479 2264 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:32:53 ctl02 nova-api[2264]: 2017-09-28 12:32:53.479 2264 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:32:53 ctl02 nova-api[2264]: 2017-09-28 12:32:53.479 2264 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:32:53 ctl02 nova-api[2264]: 2017-09-28 12:32:53.479 2264 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:32:53 ctl02 nova-api[2264]: 2017-09-28 12:32:53.479 2264 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:32:53 ctl02 nova-api[2264]: 2017-09-28 12:32:53.479 2264 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:32:53 ctl02 nova-api[2264]: 2017-09-28 12:32:53.479 2264 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:32:53 ctl02 nova-api[2264]: 2017-09-28 12:32:53.479 2264 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:32:53 ctl02 nova-api[2264]: 2017-09-28 12:32:53.479 2264 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:32:53 ctl02 nova-api[2264]: 2017-09-28 12:32:53.479 2264 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:32:53 ctl02 nova-api[2264]: 2017-09-28 12:32:53.479 2264 ERROR nova.wsgi     self.filename))
Sep 28 12:32:53 ctl02 nova-api[2264]: 2017-09-28 12:32:53.479 2264 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:32:53 ctl02 nova-api[2264]: 2017-09-28 12:32:53.479 2264 ERROR nova.wsgi
Sep 28 12:32:53 ctl02 nova-api[2264]: 2017-09-28 12:32:53.480 2264 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:32:53 ctl02 nova-api[2264]: 2017-09-28 12:32:53.606 2264 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:32:53 ctl02 nova-api[2264]: 2017-09-28 12:32:53.831 2264 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:32:53 ctl02 nova-api[2264]: 2017-09-28 12:32:53.833 2264 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:32:53 ctl02 nova-api[2264]: 2017-09-28 12:32:53.834 2264 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:32:53 ctl02 nova-api[2264]: 2017-09-28 12:32:53.834 2264 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:32:53 ctl02 nova-api[2264]: 2017-09-28 12:32:53.962 2264 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:32:53 ctl02 nova-api[2264]: 2017-09-28 12:32:53.964 2264 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:32:53 ctl02 nova-api[2264]: 2017-09-28 12:32:53.964 2264 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:32:53 ctl02 nova-api[2264]: 2017-09-28 12:32:53.964 2264 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:32:53 ctl02 nova-api[2264]: 2017-09-28 12:32:53.967 2264 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:32:53 ctl02 nova-api[2264]: 2017-09-28 12:32:53.968 2264 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:32:53 ctl02 nova-api[2264]: 2017-09-28 12:32:53.968 2264 ERROR nova Traceback (most recent call last):
Sep 28 12:32:53 ctl02 nova-api[2264]: 2017-09-28 12:32:53.968 2264 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:32:53 ctl02 nova-api[2264]: 2017-09-28 12:32:53.968 2264 ERROR nova     sys.exit(main())
Sep 28 12:32:53 ctl02 nova-api[2264]: 2017-09-28 12:32:53.968 2264 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:32:53 ctl02 nova-api[2264]: 2017-09-28 12:32:53.968 2264 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:32:53 ctl02 nova-api[2264]: 2017-09-28 12:32:53.968 2264 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:32:53 ctl02 nova-api[2264]: 2017-09-28 12:32:53.968 2264 ERROR nova     max_url_len=max_url_len)
Sep 28 12:32:53 ctl02 nova-api[2264]: 2017-09-28 12:32:53.968 2264 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:32:53 ctl02 nova-api[2264]: 2017-09-28 12:32:53.968 2264 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:32:53 ctl02 nova-api[2264]: 2017-09-28 12:32:53.968 2264 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:32:53 ctl02 nova-api[2264]: 2017-09-28 12:32:53.968 2264 ERROR nova     sock.listen(backlog)
Sep 28 12:32:53 ctl02 nova-api[2264]: 2017-09-28 12:32:53.968 2264 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:32:53 ctl02 nova-api[2264]: 2017-09-28 12:32:53.968 2264 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:32:53 ctl02 nova-api[2264]: 2017-09-28 12:32:53.968 2264 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:32:53 ctl02 nova-api[2264]: 2017-09-28 12:32:53.968 2264 ERROR nova
Sep 28 12:32:53 ctl02 glance-api[29183]: 2017-09-28 12:32:53.984 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:32:53] "OPTIONS / HTTP/1.0" 200 134 0.000601
Sep 28 12:32:54 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:32:54 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:32:54 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:32:54 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:32:54 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:32:54 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:32:54 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:32:54 ctl02 glance-api[29183]: 2017-09-28 12:32:54.515 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:32:54] "OPTIONS / HTTP/1.0" 200 134 0.001015
Sep 28 12:32:54 ctl02 heat-api[13008]: 2017-09-28 12:32:54.564 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:32:54] "OPTIONS / HTTP/1.0" 200 134 0.000677
Sep 28 12:32:54 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:32:54.578 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:32:54] "OPTIONS / HTTP/1.0" 200 134 0.000479
Sep 28 12:32:56 ctl02 nova-api[2282]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:32:56 ctl02 nova-api[2282]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:32:56 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:32:56.086 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:32:56] "OPTIONS / HTTP/1.0" 200 134 0.000483
Sep 28 12:32:56 ctl02 nova-api[2282]: 2017-09-28 12:32:56.246 2282 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:32:56 ctl02 nova-api[2282]: 2017-09-28 12:32:56.247 2282 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:32:56 ctl02 nova-api[2282]: 2017-09-28 12:32:56.247 2282 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:32:56 ctl02 nova-api[2282]: 2017-09-28 12:32:56.247 2282 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:32:56 ctl02 nova-api[2282]: 2017-09-28 12:32:56.247 2282 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:32:56 ctl02 nova-api[2282]: 2017-09-28 12:32:56.247 2282 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:32:56 ctl02 nova-api[2282]: 2017-09-28 12:32:56.247 2282 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:32:56 ctl02 nova-api[2282]: 2017-09-28 12:32:56.247 2282 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:32:56 ctl02 nova-api[2282]: 2017-09-28 12:32:56.247 2282 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:32:56 ctl02 nova-api[2282]: 2017-09-28 12:32:56.247 2282 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:32:56 ctl02 nova-api[2282]: 2017-09-28 12:32:56.247 2282 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:32:56 ctl02 nova-api[2282]: 2017-09-28 12:32:56.247 2282 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:32:56 ctl02 nova-api[2282]: 2017-09-28 12:32:56.247 2282 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:32:56 ctl02 nova-api[2282]: 2017-09-28 12:32:56.247 2282 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:32:56 ctl02 nova-api[2282]: 2017-09-28 12:32:56.247 2282 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:32:56 ctl02 nova-api[2282]: 2017-09-28 12:32:56.247 2282 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:32:56 ctl02 nova-api[2282]: 2017-09-28 12:32:56.247 2282 ERROR nova.wsgi     self.filename))
Sep 28 12:32:56 ctl02 nova-api[2282]: 2017-09-28 12:32:56.247 2282 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:32:56 ctl02 nova-api[2282]: 2017-09-28 12:32:56.247 2282 ERROR nova.wsgi
Sep 28 12:32:56 ctl02 nova-api[2282]: 2017-09-28 12:32:56.248 2282 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:32:56 ctl02 nova-api[2282]: 2017-09-28 12:32:56.372 2282 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:32:56 ctl02 nova-api[2282]: 2017-09-28 12:32:56.593 2282 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:32:56 ctl02 nova-api[2282]: 2017-09-28 12:32:56.595 2282 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:32:56 ctl02 nova-api[2282]: 2017-09-28 12:32:56.595 2282 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:32:56 ctl02 nova-api[2282]: 2017-09-28 12:32:56.595 2282 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:32:56 ctl02 nova-api[2282]: 2017-09-28 12:32:56.724 2282 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:32:56 ctl02 nova-api[2282]: 2017-09-28 12:32:56.726 2282 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:32:56 ctl02 nova-api[2282]: 2017-09-28 12:32:56.726 2282 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:32:56 ctl02 nova-api[2282]: 2017-09-28 12:32:56.727 2282 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:32:56 ctl02 nova-api[2282]: 2017-09-28 12:32:56.730 2282 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:32:56 ctl02 nova-api[2282]: 2017-09-28 12:32:56.730 2282 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:32:56 ctl02 nova-api[2282]: 2017-09-28 12:32:56.730 2282 ERROR nova Traceback (most recent call last):
Sep 28 12:32:56 ctl02 nova-api[2282]: 2017-09-28 12:32:56.730 2282 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:32:56 ctl02 nova-api[2282]: 2017-09-28 12:32:56.730 2282 ERROR nova     sys.exit(main())
Sep 28 12:32:56 ctl02 nova-api[2282]: 2017-09-28 12:32:56.730 2282 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:32:56 ctl02 nova-api[2282]: 2017-09-28 12:32:56.730 2282 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:32:56 ctl02 nova-api[2282]: 2017-09-28 12:32:56.730 2282 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:32:56 ctl02 nova-api[2282]: 2017-09-28 12:32:56.730 2282 ERROR nova     max_url_len=max_url_len)
Sep 28 12:32:56 ctl02 nova-api[2282]: 2017-09-28 12:32:56.730 2282 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:32:56 ctl02 nova-api[2282]: 2017-09-28 12:32:56.730 2282 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:32:56 ctl02 nova-api[2282]: 2017-09-28 12:32:56.730 2282 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:32:56 ctl02 nova-api[2282]: 2017-09-28 12:32:56.730 2282 ERROR nova     sock.listen(backlog)
Sep 28 12:32:56 ctl02 nova-api[2282]: 2017-09-28 12:32:56.730 2282 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:32:56 ctl02 nova-api[2282]: 2017-09-28 12:32:56.730 2282 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:32:56 ctl02 nova-api[2282]: 2017-09-28 12:32:56.730 2282 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:32:56 ctl02 nova-api[2282]: 2017-09-28 12:32:56.730 2282 ERROR nova
Sep 28 12:32:56 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:32:56 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:32:56 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:32:57 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:32:57 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:32:57 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:32:57 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:32:57.142 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:32:57] "OPTIONS / HTTP/1.0" 200 134 0.000558
Sep 28 12:32:57 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:32:57 ctl02 heat-api[13008]: 2017-09-28 12:32:57.649 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:32:57] "OPTIONS / HTTP/1.0" 200 134 0.000539
Sep 28 12:32:57 ctl02 heat-api-cfn[13300]: 2017-09-28 12:32:57.977 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:32:57] "OPTIONS / HTTP/1.0" 200 134 0.000435
Sep 28 12:32:58 ctl02 heat-api-cfn[13300]: 2017-09-28 12:32:58.460 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:32:58] "OPTIONS / HTTP/1.0" 200 134 0.000415
Sep 28 12:32:58 ctl02 nova-api[2300]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:32:58 ctl02 nova-api[2300]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:32:58 ctl02 nova-api[2300]: 2017-09-28 12:32:58.968 2300 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:32:58 ctl02 nova-api[2300]: 2017-09-28 12:32:58.970 2300 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:32:58 ctl02 nova-api[2300]: 2017-09-28 12:32:58.970 2300 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:32:58 ctl02 nova-api[2300]: 2017-09-28 12:32:58.970 2300 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:32:58 ctl02 nova-api[2300]: 2017-09-28 12:32:58.970 2300 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:32:58 ctl02 nova-api[2300]: 2017-09-28 12:32:58.970 2300 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:32:58 ctl02 nova-api[2300]: 2017-09-28 12:32:58.970 2300 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:32:58 ctl02 nova-api[2300]: 2017-09-28 12:32:58.970 2300 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:32:58 ctl02 nova-api[2300]: 2017-09-28 12:32:58.970 2300 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:32:58 ctl02 nova-api[2300]: 2017-09-28 12:32:58.970 2300 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:32:58 ctl02 nova-api[2300]: 2017-09-28 12:32:58.970 2300 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:32:58 ctl02 nova-api[2300]: 2017-09-28 12:32:58.970 2300 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:32:58 ctl02 nova-api[2300]: 2017-09-28 12:32:58.970 2300 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:32:58 ctl02 nova-api[2300]: 2017-09-28 12:32:58.970 2300 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:32:58 ctl02 nova-api[2300]: 2017-09-28 12:32:58.970 2300 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:32:58 ctl02 nova-api[2300]: 2017-09-28 12:32:58.970 2300 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:32:58 ctl02 nova-api[2300]: 2017-09-28 12:32:58.970 2300 ERROR nova.wsgi     self.filename))
Sep 28 12:32:58 ctl02 nova-api[2300]: 2017-09-28 12:32:58.970 2300 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:32:58 ctl02 nova-api[2300]: 2017-09-28 12:32:58.970 2300 ERROR nova.wsgi
Sep 28 12:32:58 ctl02 nova-api[2300]: 2017-09-28 12:32:58.972 2300 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:32:59 ctl02 nova-api[2300]: 2017-09-28 12:32:59.104 2300 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:32:59 ctl02 nova-api[2300]: 2017-09-28 12:32:59.327 2300 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:32:59 ctl02 nova-api[2300]: 2017-09-28 12:32:59.330 2300 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:32:59 ctl02 nova-api[2300]: 2017-09-28 12:32:59.330 2300 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:32:59 ctl02 nova-api[2300]: 2017-09-28 12:32:59.331 2300 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:32:59 ctl02 nova-api[2300]: 2017-09-28 12:32:59.463 2300 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:32:59 ctl02 nova-api[2300]: 2017-09-28 12:32:59.465 2300 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:32:59 ctl02 nova-api[2300]: 2017-09-28 12:32:59.465 2300 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:32:59 ctl02 nova-api[2300]: 2017-09-28 12:32:59.466 2300 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:32:59 ctl02 nova-api[2300]: 2017-09-28 12:32:59.469 2300 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:32:59 ctl02 nova-api[2300]: 2017-09-28 12:32:59.470 2300 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:32:59 ctl02 nova-api[2300]: 2017-09-28 12:32:59.470 2300 ERROR nova Traceback (most recent call last):
Sep 28 12:32:59 ctl02 nova-api[2300]: 2017-09-28 12:32:59.470 2300 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:32:59 ctl02 nova-api[2300]: 2017-09-28 12:32:59.470 2300 ERROR nova     sys.exit(main())
Sep 28 12:32:59 ctl02 nova-api[2300]: 2017-09-28 12:32:59.470 2300 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:32:59 ctl02 nova-api[2300]: 2017-09-28 12:32:59.470 2300 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:32:59 ctl02 nova-api[2300]: 2017-09-28 12:32:59.470 2300 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:32:59 ctl02 nova-api[2300]: 2017-09-28 12:32:59.470 2300 ERROR nova     max_url_len=max_url_len)
Sep 28 12:32:59 ctl02 nova-api[2300]: 2017-09-28 12:32:59.470 2300 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:32:59 ctl02 nova-api[2300]: 2017-09-28 12:32:59.470 2300 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:32:59 ctl02 nova-api[2300]: 2017-09-28 12:32:59.470 2300 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:32:59 ctl02 nova-api[2300]: 2017-09-28 12:32:59.470 2300 ERROR nova     sock.listen(backlog)
Sep 28 12:32:59 ctl02 nova-api[2300]: 2017-09-28 12:32:59.470 2300 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:32:59 ctl02 nova-api[2300]: 2017-09-28 12:32:59.470 2300 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:32:59 ctl02 nova-api[2300]: 2017-09-28 12:32:59.470 2300 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:32:59 ctl02 nova-api[2300]: 2017-09-28 12:32:59.470 2300 ERROR nova
Sep 28 12:32:59 ctl02 heat-api[13008]: 2017-09-28 12:32:59.586 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:32:59] "OPTIONS / HTTP/1.0" 200 134 0.000553
Sep 28 12:32:59 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:32:59 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:32:59 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:32:59 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:32:59 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:32:59 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:32:59 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:33:00 ctl02 neutron-server[30536]: 2017-09-28 12:33:00.215 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:33:00] "OPTIONS / HTTP/1.0" 200 262 0.000488
Sep 28 12:33:00 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5417667f)
Sep 28 12:33:00 ctl02 neutron-server[30536]: 2017-09-28 12:33:00.873 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:33:00] "OPTIONS / HTTP/1.0" 200 262 0.000451
Sep 28 12:33:01 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5417667f)
Sep 28 12:33:01 ctl02 heat-api-cfn[13300]: 2017-09-28 12:33:01.524 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:33:01] "OPTIONS / HTTP/1.0" 200 134 0.000443
Sep 28 12:33:01 ctl02 nova-api[2318]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:33:01 ctl02 nova-api[2318]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:33:01 ctl02 glance-api[29183]: 2017-09-28 12:33:01.691 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:33:01] "OPTIONS / HTTP/1.0" 200 134 0.000564
Sep 28 12:33:01 ctl02 nova-api[2318]: 2017-09-28 12:33:01.729 2318 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:33:01 ctl02 nova-api[2318]: 2017-09-28 12:33:01.731 2318 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:33:01 ctl02 nova-api[2318]: 2017-09-28 12:33:01.731 2318 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:33:01 ctl02 nova-api[2318]: 2017-09-28 12:33:01.731 2318 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:33:01 ctl02 nova-api[2318]: 2017-09-28 12:33:01.731 2318 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:33:01 ctl02 nova-api[2318]: 2017-09-28 12:33:01.731 2318 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:33:01 ctl02 nova-api[2318]: 2017-09-28 12:33:01.731 2318 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:33:01 ctl02 nova-api[2318]: 2017-09-28 12:33:01.731 2318 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:33:01 ctl02 nova-api[2318]: 2017-09-28 12:33:01.731 2318 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:33:01 ctl02 nova-api[2318]: 2017-09-28 12:33:01.731 2318 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:33:01 ctl02 nova-api[2318]: 2017-09-28 12:33:01.731 2318 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:33:01 ctl02 nova-api[2318]: 2017-09-28 12:33:01.731 2318 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:33:01 ctl02 nova-api[2318]: 2017-09-28 12:33:01.731 2318 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:33:01 ctl02 nova-api[2318]: 2017-09-28 12:33:01.731 2318 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:33:01 ctl02 nova-api[2318]: 2017-09-28 12:33:01.731 2318 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:33:01 ctl02 nova-api[2318]: 2017-09-28 12:33:01.731 2318 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:33:01 ctl02 nova-api[2318]: 2017-09-28 12:33:01.731 2318 ERROR nova.wsgi     self.filename))
Sep 28 12:33:01 ctl02 nova-api[2318]: 2017-09-28 12:33:01.731 2318 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:33:01 ctl02 nova-api[2318]: 2017-09-28 12:33:01.731 2318 ERROR nova.wsgi
Sep 28 12:33:01 ctl02 nova-api[2318]: 2017-09-28 12:33:01.733 2318 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:33:01 ctl02 nova-api[2318]: 2017-09-28 12:33:01.860 2318 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:33:02 ctl02 nova-api[2318]: 2017-09-28 12:33:02.081 2318 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:33:02 ctl02 nova-api[2318]: 2017-09-28 12:33:02.084 2318 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:33:02 ctl02 nova-api[2318]: 2017-09-28 12:33:02.085 2318 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:33:02 ctl02 nova-api[2318]: 2017-09-28 12:33:02.085 2318 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:33:02 ctl02 nova-api[2318]: 2017-09-28 12:33:02.215 2318 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:33:02 ctl02 nova-api[2318]: 2017-09-28 12:33:02.218 2318 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:33:02 ctl02 nova-api[2318]: 2017-09-28 12:33:02.218 2318 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:33:02 ctl02 nova-api[2318]: 2017-09-28 12:33:02.218 2318 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:33:02 ctl02 nova-api[2318]: 2017-09-28 12:33:02.222 2318 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:33:02 ctl02 nova-api[2318]: 2017-09-28 12:33:02.222 2318 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:33:02 ctl02 nova-api[2318]: 2017-09-28 12:33:02.222 2318 ERROR nova Traceback (most recent call last):
Sep 28 12:33:02 ctl02 nova-api[2318]: 2017-09-28 12:33:02.222 2318 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:33:02 ctl02 nova-api[2318]: 2017-09-28 12:33:02.222 2318 ERROR nova     sys.exit(main())
Sep 28 12:33:02 ctl02 nova-api[2318]: 2017-09-28 12:33:02.222 2318 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:33:02 ctl02 nova-api[2318]: 2017-09-28 12:33:02.222 2318 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:33:02 ctl02 nova-api[2318]: 2017-09-28 12:33:02.222 2318 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:33:02 ctl02 nova-api[2318]: 2017-09-28 12:33:02.222 2318 ERROR nova     max_url_len=max_url_len)
Sep 28 12:33:02 ctl02 nova-api[2318]: 2017-09-28 12:33:02.222 2318 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:33:02 ctl02 nova-api[2318]: 2017-09-28 12:33:02.222 2318 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:33:02 ctl02 nova-api[2318]: 2017-09-28 12:33:02.222 2318 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:33:02 ctl02 nova-api[2318]: 2017-09-28 12:33:02.222 2318 ERROR nova     sock.listen(backlog)
Sep 28 12:33:02 ctl02 nova-api[2318]: 2017-09-28 12:33:02.222 2318 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:33:02 ctl02 nova-api[2318]: 2017-09-28 12:33:02.222 2318 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:33:02 ctl02 nova-api[2318]: 2017-09-28 12:33:02.222 2318 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:33:02 ctl02 nova-api[2318]: 2017-09-28 12:33:02.222 2318 ERROR nova
Sep 28 12:33:02 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:33:02 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:33:02 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:33:02 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5417667f)
Sep 28 12:33:02 ctl02 neutron-server[30536]: 2017-09-28 12:33:02.583 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:33:02] "OPTIONS / HTTP/1.0" 200 262 0.000615
Sep 28 12:33:02 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:33:02 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:33:02 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:33:02 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:33:03 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5417667f)
Sep 28 12:33:03 ctl02 glance-api[29183]: 2017-09-28 12:33:03.714 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:33:03] "OPTIONS / HTTP/1.0" 200 134 0.000545
Sep 28 12:33:04 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:33:04.212 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:33:04] "OPTIONS / HTTP/1.0" 200 134 0.000404
Sep 28 12:33:04 ctl02 glance-api[29183]: 2017-09-28 12:33:04.237 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:33:04] "OPTIONS / HTTP/1.0" 200 134 0.000440
Sep 28 12:33:04 ctl02 nova-api[2335]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:33:04 ctl02 nova-api[2335]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:33:04 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5417667f)
Sep 28 12:33:04 ctl02 nova-api[2335]: 2017-09-28 12:33:04.456 2335 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:33:04 ctl02 nova-api[2335]: 2017-09-28 12:33:04.458 2335 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:33:04 ctl02 nova-api[2335]: 2017-09-28 12:33:04.458 2335 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:33:04 ctl02 nova-api[2335]: 2017-09-28 12:33:04.458 2335 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:33:04 ctl02 nova-api[2335]: 2017-09-28 12:33:04.458 2335 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:33:04 ctl02 nova-api[2335]: 2017-09-28 12:33:04.458 2335 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:33:04 ctl02 nova-api[2335]: 2017-09-28 12:33:04.458 2335 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:33:04 ctl02 nova-api[2335]: 2017-09-28 12:33:04.458 2335 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:33:04 ctl02 nova-api[2335]: 2017-09-28 12:33:04.458 2335 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:33:04 ctl02 nova-api[2335]: 2017-09-28 12:33:04.458 2335 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:33:04 ctl02 nova-api[2335]: 2017-09-28 12:33:04.458 2335 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:33:04 ctl02 nova-api[2335]: 2017-09-28 12:33:04.458 2335 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:33:04 ctl02 nova-api[2335]: 2017-09-28 12:33:04.458 2335 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:33:04 ctl02 nova-api[2335]: 2017-09-28 12:33:04.458 2335 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:33:04 ctl02 nova-api[2335]: 2017-09-28 12:33:04.458 2335 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:33:04 ctl02 nova-api[2335]: 2017-09-28 12:33:04.458 2335 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:33:04 ctl02 nova-api[2335]: 2017-09-28 12:33:04.458 2335 ERROR nova.wsgi     self.filename))
Sep 28 12:33:04 ctl02 nova-api[2335]: 2017-09-28 12:33:04.458 2335 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:33:04 ctl02 nova-api[2335]: 2017-09-28 12:33:04.458 2335 ERROR nova.wsgi
Sep 28 12:33:04 ctl02 nova-api[2335]: 2017-09-28 12:33:04.459 2335 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:33:04 ctl02 nova-api[2335]: 2017-09-28 12:33:04.586 2335 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:33:04 ctl02 nova-api[2335]: 2017-09-28 12:33:04.806 2335 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:33:04 ctl02 nova-api[2335]: 2017-09-28 12:33:04.808 2335 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:33:04 ctl02 nova-api[2335]: 2017-09-28 12:33:04.809 2335 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:33:04 ctl02 nova-api[2335]: 2017-09-28 12:33:04.809 2335 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:33:04 ctl02 heat-api[13008]: 2017-09-28 12:33:04.841 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:33:04] "OPTIONS / HTTP/1.0" 200 134 0.000556
Sep 28 12:33:04 ctl02 nova-api[2335]: 2017-09-28 12:33:04.939 2335 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:33:04 ctl02 nova-api[2335]: 2017-09-28 12:33:04.941 2335 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:33:04 ctl02 nova-api[2335]: 2017-09-28 12:33:04.941 2335 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:33:04 ctl02 nova-api[2335]: 2017-09-28 12:33:04.942 2335 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:33:04 ctl02 nova-api[2335]: 2017-09-28 12:33:04.945 2335 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:33:04 ctl02 nova-api[2335]: 2017-09-28 12:33:04.945 2335 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:33:04 ctl02 nova-api[2335]: 2017-09-28 12:33:04.945 2335 ERROR nova Traceback (most recent call last):
Sep 28 12:33:04 ctl02 nova-api[2335]: 2017-09-28 12:33:04.945 2335 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:33:04 ctl02 nova-api[2335]: 2017-09-28 12:33:04.945 2335 ERROR nova     sys.exit(main())
Sep 28 12:33:04 ctl02 nova-api[2335]: 2017-09-28 12:33:04.945 2335 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:33:04 ctl02 nova-api[2335]: 2017-09-28 12:33:04.945 2335 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:33:04 ctl02 nova-api[2335]: 2017-09-28 12:33:04.945 2335 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:33:04 ctl02 nova-api[2335]: 2017-09-28 12:33:04.945 2335 ERROR nova     max_url_len=max_url_len)
Sep 28 12:33:04 ctl02 nova-api[2335]: 2017-09-28 12:33:04.945 2335 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:33:04 ctl02 nova-api[2335]: 2017-09-28 12:33:04.945 2335 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:33:04 ctl02 nova-api[2335]: 2017-09-28 12:33:04.945 2335 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:33:04 ctl02 nova-api[2335]: 2017-09-28 12:33:04.945 2335 ERROR nova     sock.listen(backlog)
Sep 28 12:33:04 ctl02 nova-api[2335]: 2017-09-28 12:33:04.945 2335 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:33:04 ctl02 nova-api[2335]: 2017-09-28 12:33:04.945 2335 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:33:04 ctl02 nova-api[2335]: 2017-09-28 12:33:04.945 2335 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:33:04 ctl02 nova-api[2335]: 2017-09-28 12:33:04.945 2335 ERROR nova
Sep 28 12:33:05 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:33:05 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:33:05 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:33:05 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:33:05 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:33:05 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:33:05 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:33:05 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5417667f)
Sep 28 12:33:05 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:33:05.981 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:33:05] "OPTIONS / HTTP/1.0" 200 134 0.000481
Sep 28 12:33:06 ctl02 neutron-server[30536]: 2017-09-28 12:33:06.395 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 12:33:06 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:33:06 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:32:08 cmp002
Sep 28 12:33:06 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:31:58 cmp001
Sep 28 12:33:06 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:32:06 cmp002
Sep 28 12:33:06 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5417667f)
Sep 28 12:33:07 ctl02 nova-api[2354]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:33:07 ctl02 nova-api[2354]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:33:07 ctl02 nova-api[2354]: 2017-09-28 12:33:07.263 2354 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:33:07 ctl02 nova-api[2354]: 2017-09-28 12:33:07.264 2354 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:33:07 ctl02 nova-api[2354]: 2017-09-28 12:33:07.264 2354 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:33:07 ctl02 nova-api[2354]: 2017-09-28 12:33:07.264 2354 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:33:07 ctl02 nova-api[2354]: 2017-09-28 12:33:07.264 2354 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:33:07 ctl02 nova-api[2354]: 2017-09-28 12:33:07.264 2354 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:33:07 ctl02 nova-api[2354]: 2017-09-28 12:33:07.264 2354 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:33:07 ctl02 nova-api[2354]: 2017-09-28 12:33:07.264 2354 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:33:07 ctl02 nova-api[2354]: 2017-09-28 12:33:07.264 2354 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:33:07 ctl02 nova-api[2354]: 2017-09-28 12:33:07.264 2354 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:33:07 ctl02 nova-api[2354]: 2017-09-28 12:33:07.264 2354 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:33:07 ctl02 nova-api[2354]: 2017-09-28 12:33:07.264 2354 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:33:07 ctl02 nova-api[2354]: 2017-09-28 12:33:07.264 2354 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:33:07 ctl02 nova-api[2354]: 2017-09-28 12:33:07.264 2354 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:33:07 ctl02 nova-api[2354]: 2017-09-28 12:33:07.264 2354 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:33:07 ctl02 nova-api[2354]: 2017-09-28 12:33:07.264 2354 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:33:07 ctl02 nova-api[2354]: 2017-09-28 12:33:07.264 2354 ERROR nova.wsgi     self.filename))
Sep 28 12:33:07 ctl02 nova-api[2354]: 2017-09-28 12:33:07.264 2354 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:33:07 ctl02 nova-api[2354]: 2017-09-28 12:33:07.264 2354 ERROR nova.wsgi
Sep 28 12:33:07 ctl02 nova-api[2354]: 2017-09-28 12:33:07.265 2354 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:33:07 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:33:07.284 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:33:07] "OPTIONS / HTTP/1.0" 200 134 0.000462
Sep 28 12:33:07 ctl02 nova-api[2354]: 2017-09-28 12:33:07.397 2354 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:33:07 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5417667f)
Sep 28 12:33:07 ctl02 nova-api[2354]: 2017-09-28 12:33:07.653 2354 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:33:07 ctl02 nova-api[2354]: 2017-09-28 12:33:07.655 2354 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:33:07 ctl02 nova-api[2354]: 2017-09-28 12:33:07.655 2354 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:33:07 ctl02 nova-api[2354]: 2017-09-28 12:33:07.655 2354 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:33:07 ctl02 heat-api-cfn[13300]: 2017-09-28 12:33:07.761 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:33:07] "OPTIONS / HTTP/1.0" 200 134 0.000517
Sep 28 12:33:07 ctl02 nova-api[2354]: 2017-09-28 12:33:07.790 2354 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:33:07 ctl02 nova-api[2354]: 2017-09-28 12:33:07.793 2354 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:33:07 ctl02 nova-api[2354]: 2017-09-28 12:33:07.793 2354 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:33:07 ctl02 nova-api[2354]: 2017-09-28 12:33:07.793 2354 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:33:07 ctl02 nova-api[2354]: 2017-09-28 12:33:07.796 2354 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:33:07 ctl02 nova-api[2354]: 2017-09-28 12:33:07.797 2354 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:33:07 ctl02 nova-api[2354]: 2017-09-28 12:33:07.797 2354 ERROR nova Traceback (most recent call last):
Sep 28 12:33:07 ctl02 nova-api[2354]: 2017-09-28 12:33:07.797 2354 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:33:07 ctl02 nova-api[2354]: 2017-09-28 12:33:07.797 2354 ERROR nova     sys.exit(main())
Sep 28 12:33:07 ctl02 nova-api[2354]: 2017-09-28 12:33:07.797 2354 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:33:07 ctl02 nova-api[2354]: 2017-09-28 12:33:07.797 2354 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:33:07 ctl02 nova-api[2354]: 2017-09-28 12:33:07.797 2354 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:33:07 ctl02 nova-api[2354]: 2017-09-28 12:33:07.797 2354 ERROR nova     max_url_len=max_url_len)
Sep 28 12:33:07 ctl02 nova-api[2354]: 2017-09-28 12:33:07.797 2354 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:33:07 ctl02 nova-api[2354]: 2017-09-28 12:33:07.797 2354 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:33:07 ctl02 nova-api[2354]: 2017-09-28 12:33:07.797 2354 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:33:07 ctl02 nova-api[2354]: 2017-09-28 12:33:07.797 2354 ERROR nova     sock.listen(backlog)
Sep 28 12:33:07 ctl02 nova-api[2354]: 2017-09-28 12:33:07.797 2354 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:33:07 ctl02 nova-api[2354]: 2017-09-28 12:33:07.797 2354 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:33:07 ctl02 nova-api[2354]: 2017-09-28 12:33:07.797 2354 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:33:07 ctl02 nova-api[2354]: 2017-09-28 12:33:07.797 2354 ERROR nova
Sep 28 12:33:07 ctl02 heat-api[13008]: 2017-09-28 12:33:07.873 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:33:07] "OPTIONS / HTTP/1.0" 200 134 0.000593
Sep 28 12:33:07 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:33:07 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:33:07 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:33:08 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:33:08 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:33:08 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:33:08 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:33:08 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5417667f)
Sep 28 12:33:08 ctl02 heat-api-cfn[13300]: 2017-09-28 12:33:08.704 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:33:08] "OPTIONS / HTTP/1.0" 200 134 0.000541
Sep 28 12:33:09 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5417667f)
Sep 28 12:33:09 ctl02 nova-api[2372]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:33:09 ctl02 nova-api[2372]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:33:09 ctl02 heat-api[13008]: 2017-09-28 12:33:09.842 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:33:09] "OPTIONS / HTTP/1.0" 200 134 0.000658
Sep 28 12:33:09 ctl02 nova-cert[4860]: 2017-09-28 12:33:09.949 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:33:10 ctl02 nova-api[2372]: 2017-09-28 12:33:10.030 2372 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:33:10 ctl02 nova-api[2372]: 2017-09-28 12:33:10.032 2372 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:33:10 ctl02 nova-api[2372]: 2017-09-28 12:33:10.032 2372 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:33:10 ctl02 nova-api[2372]: 2017-09-28 12:33:10.032 2372 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:33:10 ctl02 nova-api[2372]: 2017-09-28 12:33:10.032 2372 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:33:10 ctl02 nova-api[2372]: 2017-09-28 12:33:10.032 2372 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:33:10 ctl02 nova-api[2372]: 2017-09-28 12:33:10.032 2372 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:33:10 ctl02 nova-api[2372]: 2017-09-28 12:33:10.032 2372 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:33:10 ctl02 nova-api[2372]: 2017-09-28 12:33:10.032 2372 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:33:10 ctl02 nova-api[2372]: 2017-09-28 12:33:10.032 2372 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:33:10 ctl02 nova-api[2372]: 2017-09-28 12:33:10.032 2372 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:33:10 ctl02 nova-api[2372]: 2017-09-28 12:33:10.032 2372 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:33:10 ctl02 nova-api[2372]: 2017-09-28 12:33:10.032 2372 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:33:10 ctl02 nova-api[2372]: 2017-09-28 12:33:10.032 2372 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:33:10 ctl02 nova-api[2372]: 2017-09-28 12:33:10.032 2372 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:33:10 ctl02 nova-api[2372]: 2017-09-28 12:33:10.032 2372 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:33:10 ctl02 nova-api[2372]: 2017-09-28 12:33:10.032 2372 ERROR nova.wsgi     self.filename))
Sep 28 12:33:10 ctl02 nova-api[2372]: 2017-09-28 12:33:10.032 2372 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:33:10 ctl02 nova-api[2372]: 2017-09-28 12:33:10.032 2372 ERROR nova.wsgi
Sep 28 12:33:10 ctl02 nova-api[2372]: 2017-09-28 12:33:10.033 2372 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:33:10 ctl02 nova-api[2372]: 2017-09-28 12:33:10.167 2372 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:33:10 ctl02 neutron-server[30536]: 2017-09-28 12:33:10.404 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:33:10] "OPTIONS / HTTP/1.0" 200 262 0.000528
Sep 28 12:33:10 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5417667f)
Sep 28 12:33:10 ctl02 nova-api[2372]: 2017-09-28 12:33:10.417 2372 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:33:10 ctl02 nova-api[2372]: 2017-09-28 12:33:10.420 2372 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:33:10 ctl02 nova-api[2372]: 2017-09-28 12:33:10.421 2372 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:33:10 ctl02 nova-api[2372]: 2017-09-28 12:33:10.421 2372 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:33:10 ctl02 nova-api[2372]: 2017-09-28 12:33:10.555 2372 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:33:10 ctl02 nova-api[2372]: 2017-09-28 12:33:10.558 2372 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:33:10 ctl02 nova-api[2372]: 2017-09-28 12:33:10.558 2372 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:33:10 ctl02 nova-api[2372]: 2017-09-28 12:33:10.559 2372 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:33:10 ctl02 nova-api[2372]: 2017-09-28 12:33:10.562 2372 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:33:10 ctl02 nova-api[2372]: 2017-09-28 12:33:10.562 2372 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:33:10 ctl02 nova-api[2372]: 2017-09-28 12:33:10.562 2372 ERROR nova Traceback (most recent call last):
Sep 28 12:33:10 ctl02 nova-api[2372]: 2017-09-28 12:33:10.562 2372 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:33:10 ctl02 nova-api[2372]: 2017-09-28 12:33:10.562 2372 ERROR nova     sys.exit(main())
Sep 28 12:33:10 ctl02 nova-api[2372]: 2017-09-28 12:33:10.562 2372 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:33:10 ctl02 nova-api[2372]: 2017-09-28 12:33:10.562 2372 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:33:10 ctl02 nova-api[2372]: 2017-09-28 12:33:10.562 2372 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:33:10 ctl02 nova-api[2372]: 2017-09-28 12:33:10.562 2372 ERROR nova     max_url_len=max_url_len)
Sep 28 12:33:10 ctl02 nova-api[2372]: 2017-09-28 12:33:10.562 2372 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:33:10 ctl02 nova-api[2372]: 2017-09-28 12:33:10.562 2372 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:33:10 ctl02 nova-api[2372]: 2017-09-28 12:33:10.562 2372 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:33:10 ctl02 nova-api[2372]: 2017-09-28 12:33:10.562 2372 ERROR nova     sock.listen(backlog)
Sep 28 12:33:10 ctl02 nova-api[2372]: 2017-09-28 12:33:10.562 2372 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:33:10 ctl02 nova-api[2372]: 2017-09-28 12:33:10.562 2372 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:33:10 ctl02 nova-api[2372]: 2017-09-28 12:33:10.562 2372 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:33:10 ctl02 nova-api[2372]: 2017-09-28 12:33:10.562 2372 ERROR nova
Sep 28 12:33:10 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:33:10 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:33:10 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:33:10 ctl02 nova-conductor[5056]: 2017-09-28 12:33:10.786 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:33:10 ctl02 nova-conductor[5056]: 2017-09-28 12:33:10.805 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:33:10 ctl02 nova-conductor[5056]: 2017-09-28 12:33:10.817 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:33:10 ctl02 nova-conductor[5056]: 2017-09-28 12:33:10.818 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:33:10 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:33:10 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:33:10 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:33:10 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:33:10 ctl02 neutron-server[30536]: 2017-09-28 12:33:10.904 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:33:10] "OPTIONS / HTTP/1.0" 200 262 0.000548
Sep 28 12:33:11 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:33:11 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:33:11 ctl02 glance-api[29183]: 2017-09-28 12:33:11.582 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:33:11] "OPTIONS / HTTP/1.0" 200 134 0.000643
Sep 28 12:33:11 ctl02 heat-api-cfn[13300]: 2017-09-28 12:33:11.627 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:33:11] "OPTIONS / HTTP/1.0" 200 134 0.000581
Sep 28 12:33:12 ctl02 neutron-server[30536]: 2017-09-28 12:33:12.357 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:33:12] "OPTIONS / HTTP/1.0" 200 262 0.000520
Sep 28 12:33:12 ctl02 nova-api[2389]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:33:12 ctl02 nova-api[2389]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:33:12 ctl02 nova-api[2389]: 2017-09-28 12:33:12.792 2389 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:33:12 ctl02 nova-api[2389]: 2017-09-28 12:33:12.793 2389 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:33:12 ctl02 nova-api[2389]: 2017-09-28 12:33:12.793 2389 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:33:12 ctl02 nova-api[2389]: 2017-09-28 12:33:12.793 2389 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:33:12 ctl02 nova-api[2389]: 2017-09-28 12:33:12.793 2389 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:33:12 ctl02 nova-api[2389]: 2017-09-28 12:33:12.793 2389 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:33:12 ctl02 nova-api[2389]: 2017-09-28 12:33:12.793 2389 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:33:12 ctl02 nova-api[2389]: 2017-09-28 12:33:12.793 2389 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:33:12 ctl02 nova-api[2389]: 2017-09-28 12:33:12.793 2389 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:33:12 ctl02 nova-api[2389]: 2017-09-28 12:33:12.793 2389 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:33:12 ctl02 nova-api[2389]: 2017-09-28 12:33:12.793 2389 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:33:12 ctl02 nova-api[2389]: 2017-09-28 12:33:12.793 2389 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:33:12 ctl02 nova-api[2389]: 2017-09-28 12:33:12.793 2389 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:33:12 ctl02 nova-api[2389]: 2017-09-28 12:33:12.793 2389 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:33:12 ctl02 nova-api[2389]: 2017-09-28 12:33:12.793 2389 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:33:12 ctl02 nova-api[2389]: 2017-09-28 12:33:12.793 2389 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:33:12 ctl02 nova-api[2389]: 2017-09-28 12:33:12.793 2389 ERROR nova.wsgi     self.filename))
Sep 28 12:33:12 ctl02 nova-api[2389]: 2017-09-28 12:33:12.793 2389 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:33:12 ctl02 nova-api[2389]: 2017-09-28 12:33:12.793 2389 ERROR nova.wsgi
Sep 28 12:33:12 ctl02 nova-api[2389]: 2017-09-28 12:33:12.794 2389 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:33:12 ctl02 nova-api[2389]: 2017-09-28 12:33:12.928 2389 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:33:13 ctl02 nova-api[2389]: 2017-09-28 12:33:13.173 2389 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:33:13 ctl02 nova-api[2389]: 2017-09-28 12:33:13.175 2389 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:33:13 ctl02 nova-api[2389]: 2017-09-28 12:33:13.175 2389 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:33:13 ctl02 nova-api[2389]: 2017-09-28 12:33:13.176 2389 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:33:13 ctl02 nova-api[2389]: 2017-09-28 12:33:13.306 2389 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:33:13 ctl02 nova-api[2389]: 2017-09-28 12:33:13.308 2389 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:33:13 ctl02 nova-api[2389]: 2017-09-28 12:33:13.308 2389 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:33:13 ctl02 nova-api[2389]: 2017-09-28 12:33:13.309 2389 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:33:13 ctl02 nova-api[2389]: 2017-09-28 12:33:13.312 2389 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:33:13 ctl02 nova-api[2389]: 2017-09-28 12:33:13.312 2389 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:33:13 ctl02 nova-api[2389]: 2017-09-28 12:33:13.312 2389 ERROR nova Traceback (most recent call last):
Sep 28 12:33:13 ctl02 nova-api[2389]: 2017-09-28 12:33:13.312 2389 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:33:13 ctl02 nova-api[2389]: 2017-09-28 12:33:13.312 2389 ERROR nova     sys.exit(main())
Sep 28 12:33:13 ctl02 nova-api[2389]: 2017-09-28 12:33:13.312 2389 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:33:13 ctl02 nova-api[2389]: 2017-09-28 12:33:13.312 2389 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:33:13 ctl02 nova-api[2389]: 2017-09-28 12:33:13.312 2389 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:33:13 ctl02 nova-api[2389]: 2017-09-28 12:33:13.312 2389 ERROR nova     max_url_len=max_url_len)
Sep 28 12:33:13 ctl02 nova-api[2389]: 2017-09-28 12:33:13.312 2389 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:33:13 ctl02 nova-api[2389]: 2017-09-28 12:33:13.312 2389 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:33:13 ctl02 nova-api[2389]: 2017-09-28 12:33:13.312 2389 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:33:13 ctl02 nova-api[2389]: 2017-09-28 12:33:13.312 2389 ERROR nova     sock.listen(backlog)
Sep 28 12:33:13 ctl02 nova-api[2389]: 2017-09-28 12:33:13.312 2389 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:33:13 ctl02 nova-api[2389]: 2017-09-28 12:33:13.312 2389 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:33:13 ctl02 nova-api[2389]: 2017-09-28 12:33:13.312 2389 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:33:13 ctl02 nova-api[2389]: 2017-09-28 12:33:13.312 2389 ERROR nova
Sep 28 12:33:13 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:33:13 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:33:13 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:33:13 ctl02 neutron-server[30536]: 2017-09-28 12:33:13.505 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:33:13 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:33:13 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:33:13 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:33:13 ctl02 glance-api[29183]: 2017-09-28 12:33:13.627 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:33:13] "OPTIONS / HTTP/1.0" 200 134 0.000735
Sep 28 12:33:13 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:33:14 ctl02 glance-api[29183]: 2017-09-28 12:33:14.240 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:33:14] "OPTIONS / HTTP/1.0" 200 134 0.001073
Sep 28 12:33:14 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:33:14.350 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:33:14] "OPTIONS / HTTP/1.0" 200 134 0.000476
Sep 28 12:33:15 ctl02 heat-api[13008]: 2017-09-28 12:33:15.219 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:33:15] "OPTIONS / HTTP/1.0" 200 134 0.000622
Sep 28 12:33:15 ctl02 nova-api[2411]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:33:15 ctl02 nova-api[2411]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:33:15 ctl02 nova-api[2411]: 2017-09-28 12:33:15.536 2411 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:33:15 ctl02 nova-api[2411]: 2017-09-28 12:33:15.537 2411 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:33:15 ctl02 nova-api[2411]: 2017-09-28 12:33:15.537 2411 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:33:15 ctl02 nova-api[2411]: 2017-09-28 12:33:15.537 2411 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:33:15 ctl02 nova-api[2411]: 2017-09-28 12:33:15.537 2411 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:33:15 ctl02 nova-api[2411]: 2017-09-28 12:33:15.537 2411 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:33:15 ctl02 nova-api[2411]: 2017-09-28 12:33:15.537 2411 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:33:15 ctl02 nova-api[2411]: 2017-09-28 12:33:15.537 2411 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:33:15 ctl02 nova-api[2411]: 2017-09-28 12:33:15.537 2411 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:33:15 ctl02 nova-api[2411]: 2017-09-28 12:33:15.537 2411 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:33:15 ctl02 nova-api[2411]: 2017-09-28 12:33:15.537 2411 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:33:15 ctl02 nova-api[2411]: 2017-09-28 12:33:15.537 2411 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:33:15 ctl02 nova-api[2411]: 2017-09-28 12:33:15.537 2411 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:33:15 ctl02 nova-api[2411]: 2017-09-28 12:33:15.537 2411 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:33:15 ctl02 nova-api[2411]: 2017-09-28 12:33:15.537 2411 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:33:15 ctl02 nova-api[2411]: 2017-09-28 12:33:15.537 2411 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:33:15 ctl02 nova-api[2411]: 2017-09-28 12:33:15.537 2411 ERROR nova.wsgi     self.filename))
Sep 28 12:33:15 ctl02 nova-api[2411]: 2017-09-28 12:33:15.537 2411 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:33:15 ctl02 nova-api[2411]: 2017-09-28 12:33:15.537 2411 ERROR nova.wsgi
Sep 28 12:33:15 ctl02 nova-api[2411]: 2017-09-28 12:33:15.538 2411 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:33:15 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:33:15.603 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:33:15] "OPTIONS / HTTP/1.0" 200 134 0.000512
Sep 28 12:33:15 ctl02 nova-api[2411]: 2017-09-28 12:33:15.673 2411 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:33:15 ctl02 nova-api[2411]: 2017-09-28 12:33:15.912 2411 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:33:15 ctl02 nova-api[2411]: 2017-09-28 12:33:15.915 2411 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:33:15 ctl02 nova-api[2411]: 2017-09-28 12:33:15.915 2411 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:33:15 ctl02 nova-api[2411]: 2017-09-28 12:33:15.915 2411 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:33:16 ctl02 nova-api[2411]: 2017-09-28 12:33:16.050 2411 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:33:16 ctl02 nova-api[2411]: 2017-09-28 12:33:16.052 2411 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:33:16 ctl02 nova-api[2411]: 2017-09-28 12:33:16.052 2411 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:33:16 ctl02 nova-api[2411]: 2017-09-28 12:33:16.052 2411 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:33:16 ctl02 nova-api[2411]: 2017-09-28 12:33:16.056 2411 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:33:16 ctl02 nova-api[2411]: 2017-09-28 12:33:16.056 2411 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:33:16 ctl02 nova-api[2411]: 2017-09-28 12:33:16.056 2411 ERROR nova Traceback (most recent call last):
Sep 28 12:33:16 ctl02 nova-api[2411]: 2017-09-28 12:33:16.056 2411 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:33:16 ctl02 nova-api[2411]: 2017-09-28 12:33:16.056 2411 ERROR nova     sys.exit(main())
Sep 28 12:33:16 ctl02 nova-api[2411]: 2017-09-28 12:33:16.056 2411 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:33:16 ctl02 nova-api[2411]: 2017-09-28 12:33:16.056 2411 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:33:16 ctl02 nova-api[2411]: 2017-09-28 12:33:16.056 2411 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:33:16 ctl02 nova-api[2411]: 2017-09-28 12:33:16.056 2411 ERROR nova     max_url_len=max_url_len)
Sep 28 12:33:16 ctl02 nova-api[2411]: 2017-09-28 12:33:16.056 2411 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:33:16 ctl02 nova-api[2411]: 2017-09-28 12:33:16.056 2411 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:33:16 ctl02 nova-api[2411]: 2017-09-28 12:33:16.056 2411 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:33:16 ctl02 nova-api[2411]: 2017-09-28 12:33:16.056 2411 ERROR nova     sock.listen(backlog)
Sep 28 12:33:16 ctl02 nova-api[2411]: 2017-09-28 12:33:16.056 2411 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:33:16 ctl02 nova-api[2411]: 2017-09-28 12:33:16.056 2411 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:33:16 ctl02 nova-api[2411]: 2017-09-28 12:33:16.056 2411 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:33:16 ctl02 nova-api[2411]: 2017-09-28 12:33:16.056 2411 ERROR nova
Sep 28 12:33:16 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:33:16 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:33:16 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:33:16 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:33:16 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:33:16 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:33:16 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:33:17 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:33:17.534 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:33:17] "OPTIONS / HTTP/1.0" 200 134 0.000485
Sep 28 12:33:17 ctl02 heat-api[13008]: 2017-09-28 12:33:17.541 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:33:17] "OPTIONS / HTTP/1.0" 200 134 0.000623
Sep 28 12:33:17 ctl02 heat-api-cfn[13300]: 2017-09-28 12:33:17.627 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:33:17] "OPTIONS / HTTP/1.0" 200 134 0.000487
Sep 28 12:33:18 ctl02 nova-api[2440]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:33:18 ctl02 nova-api[2440]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:33:18 ctl02 nova-api[2440]: 2017-09-28 12:33:18.269 2440 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:33:18 ctl02 nova-api[2440]: 2017-09-28 12:33:18.270 2440 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:33:18 ctl02 nova-api[2440]: 2017-09-28 12:33:18.270 2440 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:33:18 ctl02 nova-api[2440]: 2017-09-28 12:33:18.270 2440 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:33:18 ctl02 nova-api[2440]: 2017-09-28 12:33:18.270 2440 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:33:18 ctl02 nova-api[2440]: 2017-09-28 12:33:18.270 2440 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:33:18 ctl02 nova-api[2440]: 2017-09-28 12:33:18.270 2440 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:33:18 ctl02 nova-api[2440]: 2017-09-28 12:33:18.270 2440 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:33:18 ctl02 nova-api[2440]: 2017-09-28 12:33:18.270 2440 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:33:18 ctl02 nova-api[2440]: 2017-09-28 12:33:18.270 2440 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:33:18 ctl02 nova-api[2440]: 2017-09-28 12:33:18.270 2440 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:33:18 ctl02 nova-api[2440]: 2017-09-28 12:33:18.270 2440 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:33:18 ctl02 nova-api[2440]: 2017-09-28 12:33:18.270 2440 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:33:18 ctl02 nova-api[2440]: 2017-09-28 12:33:18.270 2440 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:33:18 ctl02 nova-api[2440]: 2017-09-28 12:33:18.270 2440 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:33:18 ctl02 nova-api[2440]: 2017-09-28 12:33:18.270 2440 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:33:18 ctl02 nova-api[2440]: 2017-09-28 12:33:18.270 2440 ERROR nova.wsgi     self.filename))
Sep 28 12:33:18 ctl02 nova-api[2440]: 2017-09-28 12:33:18.270 2440 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:33:18 ctl02 nova-api[2440]: 2017-09-28 12:33:18.270 2440 ERROR nova.wsgi
Sep 28 12:33:18 ctl02 nova-api[2440]: 2017-09-28 12:33:18.271 2440 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:33:18 ctl02 nova-api[2440]: 2017-09-28 12:33:18.403 2440 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:33:18 ctl02 heat-api-cfn[13300]: 2017-09-28 12:33:18.538 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:33:18] "OPTIONS / HTTP/1.0" 200 134 0.000505
Sep 28 12:33:18 ctl02 nova-api[2440]: 2017-09-28 12:33:18.647 2440 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:33:18 ctl02 nova-api[2440]: 2017-09-28 12:33:18.650 2440 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:33:18 ctl02 nova-api[2440]: 2017-09-28 12:33:18.650 2440 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:33:18 ctl02 nova-api[2440]: 2017-09-28 12:33:18.650 2440 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:33:18 ctl02 nova-api[2440]: 2017-09-28 12:33:18.784 2440 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:33:18 ctl02 nova-api[2440]: 2017-09-28 12:33:18.786 2440 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:33:18 ctl02 nova-api[2440]: 2017-09-28 12:33:18.786 2440 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:33:18 ctl02 nova-api[2440]: 2017-09-28 12:33:18.786 2440 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:33:18 ctl02 nova-api[2440]: 2017-09-28 12:33:18.789 2440 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:33:18 ctl02 nova-api[2440]: 2017-09-28 12:33:18.790 2440 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:33:18 ctl02 nova-api[2440]: 2017-09-28 12:33:18.790 2440 ERROR nova Traceback (most recent call last):
Sep 28 12:33:18 ctl02 nova-api[2440]: 2017-09-28 12:33:18.790 2440 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:33:18 ctl02 nova-api[2440]: 2017-09-28 12:33:18.790 2440 ERROR nova     sys.exit(main())
Sep 28 12:33:18 ctl02 nova-api[2440]: 2017-09-28 12:33:18.790 2440 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:33:18 ctl02 nova-api[2440]: 2017-09-28 12:33:18.790 2440 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:33:18 ctl02 nova-api[2440]: 2017-09-28 12:33:18.790 2440 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:33:18 ctl02 nova-api[2440]: 2017-09-28 12:33:18.790 2440 ERROR nova     max_url_len=max_url_len)
Sep 28 12:33:18 ctl02 nova-api[2440]: 2017-09-28 12:33:18.790 2440 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:33:18 ctl02 nova-api[2440]: 2017-09-28 12:33:18.790 2440 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:33:18 ctl02 nova-api[2440]: 2017-09-28 12:33:18.790 2440 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:33:18 ctl02 nova-api[2440]: 2017-09-28 12:33:18.790 2440 ERROR nova     sock.listen(backlog)
Sep 28 12:33:18 ctl02 nova-api[2440]: 2017-09-28 12:33:18.790 2440 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:33:18 ctl02 nova-api[2440]: 2017-09-28 12:33:18.790 2440 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:33:18 ctl02 nova-api[2440]: 2017-09-28 12:33:18.790 2440 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:33:18 ctl02 nova-api[2440]: 2017-09-28 12:33:18.790 2440 ERROR nova
Sep 28 12:33:18 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:33:18 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:33:18 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:33:19 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:33:19 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:33:19 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:33:19 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:33:19 ctl02 heat-api[13008]: 2017-09-28 12:33:19.779 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:33:19] "OPTIONS / HTTP/1.0" 200 134 0.000642
Sep 28 12:33:19 ctl02 nova-consoleauth[5433]: 2017-09-28 12:33:19.827 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:33:20 ctl02 neutron-server[30536]: 2017-09-28 12:33:20.232 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:33:20] "OPTIONS / HTTP/1.0" 200 262 0.000581
Sep 28 12:33:20 ctl02 neutron-server[30536]: 2017-09-28 12:33:20.802 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:33:20] "OPTIONS / HTTP/1.0" 200 262 0.000723
Sep 28 12:33:20 ctl02 nova-api[2458]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:33:20 ctl02 nova-api[2458]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:33:21 ctl02 nova-api[2458]: 2017-09-28 12:33:21.018 2458 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:33:21 ctl02 nova-api[2458]: 2017-09-28 12:33:21.020 2458 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:33:21 ctl02 nova-api[2458]: 2017-09-28 12:33:21.020 2458 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:33:21 ctl02 nova-api[2458]: 2017-09-28 12:33:21.020 2458 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:33:21 ctl02 nova-api[2458]: 2017-09-28 12:33:21.020 2458 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:33:21 ctl02 nova-api[2458]: 2017-09-28 12:33:21.020 2458 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:33:21 ctl02 nova-api[2458]: 2017-09-28 12:33:21.020 2458 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:33:21 ctl02 nova-api[2458]: 2017-09-28 12:33:21.020 2458 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:33:21 ctl02 nova-api[2458]: 2017-09-28 12:33:21.020 2458 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:33:21 ctl02 nova-api[2458]: 2017-09-28 12:33:21.020 2458 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:33:21 ctl02 nova-api[2458]: 2017-09-28 12:33:21.020 2458 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:33:21 ctl02 nova-api[2458]: 2017-09-28 12:33:21.020 2458 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:33:21 ctl02 nova-api[2458]: 2017-09-28 12:33:21.020 2458 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:33:21 ctl02 nova-api[2458]: 2017-09-28 12:33:21.020 2458 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:33:21 ctl02 nova-api[2458]: 2017-09-28 12:33:21.020 2458 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:33:21 ctl02 nova-api[2458]: 2017-09-28 12:33:21.020 2458 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:33:21 ctl02 nova-api[2458]: 2017-09-28 12:33:21.020 2458 ERROR nova.wsgi     self.filename))
Sep 28 12:33:21 ctl02 nova-api[2458]: 2017-09-28 12:33:21.020 2458 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:33:21 ctl02 nova-api[2458]: 2017-09-28 12:33:21.020 2458 ERROR nova.wsgi
Sep 28 12:33:21 ctl02 nova-api[2458]: 2017-09-28 12:33:21.021 2458 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:33:21 ctl02 nova-api[2458]: 2017-09-28 12:33:21.155 2458 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:33:21 ctl02 neutron-server[30536]: 2017-09-28 12:33:21.391 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 4 dead agents out of 6:
Sep 28 12:33:21 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:33:21 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:32:08 cmp002
Sep 28 12:33:21 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:31:58 cmp001
Sep 28 12:33:21 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:32:40 cmp002
Sep 28 12:33:21 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:32:06 cmp002
Sep 28 12:33:21 ctl02 nova-api[2458]: 2017-09-28 12:33:21.411 2458 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:33:21 ctl02 nova-api[2458]: 2017-09-28 12:33:21.413 2458 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:33:21 ctl02 nova-api[2458]: 2017-09-28 12:33:21.413 2458 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:33:21 ctl02 nova-api[2458]: 2017-09-28 12:33:21.413 2458 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:33:21 ctl02 glance-api[29183]: 2017-09-28 12:33:21.469 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:33:21] "OPTIONS / HTTP/1.0" 200 134 0.001160
Sep 28 12:33:21 ctl02 nova-api[2458]: 2017-09-28 12:33:21.552 2458 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:33:21 ctl02 nova-api[2458]: 2017-09-28 12:33:21.554 2458 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:33:21 ctl02 nova-api[2458]: 2017-09-28 12:33:21.554 2458 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:33:21 ctl02 nova-api[2458]: 2017-09-28 12:33:21.554 2458 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:33:21 ctl02 nova-api[2458]: 2017-09-28 12:33:21.558 2458 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:33:21 ctl02 nova-api[2458]: 2017-09-28 12:33:21.558 2458 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:33:21 ctl02 nova-api[2458]: 2017-09-28 12:33:21.558 2458 ERROR nova Traceback (most recent call last):
Sep 28 12:33:21 ctl02 nova-api[2458]: 2017-09-28 12:33:21.558 2458 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:33:21 ctl02 nova-api[2458]: 2017-09-28 12:33:21.558 2458 ERROR nova     sys.exit(main())
Sep 28 12:33:21 ctl02 nova-api[2458]: 2017-09-28 12:33:21.558 2458 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:33:21 ctl02 nova-api[2458]: 2017-09-28 12:33:21.558 2458 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:33:21 ctl02 nova-api[2458]: 2017-09-28 12:33:21.558 2458 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:33:21 ctl02 nova-api[2458]: 2017-09-28 12:33:21.558 2458 ERROR nova     max_url_len=max_url_len)
Sep 28 12:33:21 ctl02 nova-api[2458]: 2017-09-28 12:33:21.558 2458 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:33:21 ctl02 nova-api[2458]: 2017-09-28 12:33:21.558 2458 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:33:21 ctl02 nova-api[2458]: 2017-09-28 12:33:21.558 2458 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:33:21 ctl02 nova-api[2458]: 2017-09-28 12:33:21.558 2458 ERROR nova     sock.listen(backlog)
Sep 28 12:33:21 ctl02 nova-api[2458]: 2017-09-28 12:33:21.558 2458 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:33:21 ctl02 nova-api[2458]: 2017-09-28 12:33:21.558 2458 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:33:21 ctl02 nova-api[2458]: 2017-09-28 12:33:21.558 2458 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:33:21 ctl02 nova-api[2458]: 2017-09-28 12:33:21.558 2458 ERROR nova
Sep 28 12:33:21 ctl02 heat-api-cfn[13300]: 2017-09-28 12:33:21.586 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:33:21] "OPTIONS / HTTP/1.0" 200 134 0.000570
Sep 28 12:33:21 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:33:21 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:33:21 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:33:21 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:33:21 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:33:21 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:33:21 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:33:21 ctl02 heat-engine[12803]: 2017-09-28 12:33:21.917 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:33:21 ctl02 heat-engine[12803]: 2017-09-28 12:33:21.917 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:33:21 ctl02 heat-engine[12803]: 2017-09-28 12:33:21.919 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:33:21 ctl02 heat-engine[12803]: 2017-09-28 12:33:21.920 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:33:22 ctl02 neutron-server[30536]: 2017-09-28 12:33:22.391 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:33:22] "OPTIONS / HTTP/1.0" 200 262 0.000471
Sep 28 12:33:22 ctl02 nova-scheduler[5620]: 2017-09-28 12:33:22.868 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:33:23 ctl02 glance-api[29183]: 2017-09-28 12:33:23.243 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:33:23] "OPTIONS / HTTP/1.0" 200 134 0.000617
Sep 28 12:33:23 ctl02 nova-api[2475]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:33:23 ctl02 nova-api[2475]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:33:23 ctl02 nova-api[2475]: 2017-09-28 12:33:23.746 2475 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:33:23 ctl02 nova-api[2475]: 2017-09-28 12:33:23.747 2475 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:33:23 ctl02 nova-api[2475]: 2017-09-28 12:33:23.747 2475 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:33:23 ctl02 nova-api[2475]: 2017-09-28 12:33:23.747 2475 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:33:23 ctl02 nova-api[2475]: 2017-09-28 12:33:23.747 2475 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:33:23 ctl02 nova-api[2475]: 2017-09-28 12:33:23.747 2475 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:33:23 ctl02 nova-api[2475]: 2017-09-28 12:33:23.747 2475 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:33:23 ctl02 nova-api[2475]: 2017-09-28 12:33:23.747 2475 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:33:23 ctl02 nova-api[2475]: 2017-09-28 12:33:23.747 2475 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:33:23 ctl02 nova-api[2475]: 2017-09-28 12:33:23.747 2475 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:33:23 ctl02 nova-api[2475]: 2017-09-28 12:33:23.747 2475 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:33:23 ctl02 nova-api[2475]: 2017-09-28 12:33:23.747 2475 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:33:23 ctl02 nova-api[2475]: 2017-09-28 12:33:23.747 2475 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:33:23 ctl02 nova-api[2475]: 2017-09-28 12:33:23.747 2475 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:33:23 ctl02 nova-api[2475]: 2017-09-28 12:33:23.747 2475 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:33:23 ctl02 nova-api[2475]: 2017-09-28 12:33:23.747 2475 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:33:23 ctl02 nova-api[2475]: 2017-09-28 12:33:23.747 2475 ERROR nova.wsgi     self.filename))
Sep 28 12:33:23 ctl02 nova-api[2475]: 2017-09-28 12:33:23.747 2475 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:33:23 ctl02 nova-api[2475]: 2017-09-28 12:33:23.747 2475 ERROR nova.wsgi
Sep 28 12:33:23 ctl02 nova-api[2475]: 2017-09-28 12:33:23.748 2475 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:33:23 ctl02 nova-api[2475]: 2017-09-28 12:33:23.874 2475 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:33:23 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:33:23.969 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:33:23] "OPTIONS / HTTP/1.0" 200 134 0.000386
Sep 28 12:33:24 ctl02 nova-api[2475]: 2017-09-28 12:33:24.098 2475 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:33:24 ctl02 nova-api[2475]: 2017-09-28 12:33:24.100 2475 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:33:24 ctl02 nova-api[2475]: 2017-09-28 12:33:24.101 2475 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:33:24 ctl02 nova-api[2475]: 2017-09-28 12:33:24.101 2475 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:33:24 ctl02 nova-api[2475]: 2017-09-28 12:33:24.230 2475 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:33:24 ctl02 nova-api[2475]: 2017-09-28 12:33:24.232 2475 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:33:24 ctl02 nova-api[2475]: 2017-09-28 12:33:24.232 2475 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:33:24 ctl02 nova-api[2475]: 2017-09-28 12:33:24.233 2475 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:33:24 ctl02 nova-api[2475]: 2017-09-28 12:33:24.236 2475 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:33:24 ctl02 nova-api[2475]: 2017-09-28 12:33:24.236 2475 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:33:24 ctl02 nova-api[2475]: 2017-09-28 12:33:24.236 2475 ERROR nova Traceback (most recent call last):
Sep 28 12:33:24 ctl02 nova-api[2475]: 2017-09-28 12:33:24.236 2475 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:33:24 ctl02 nova-api[2475]: 2017-09-28 12:33:24.236 2475 ERROR nova     sys.exit(main())
Sep 28 12:33:24 ctl02 nova-api[2475]: 2017-09-28 12:33:24.236 2475 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:33:24 ctl02 nova-api[2475]: 2017-09-28 12:33:24.236 2475 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:33:24 ctl02 nova-api[2475]: 2017-09-28 12:33:24.236 2475 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:33:24 ctl02 nova-api[2475]: 2017-09-28 12:33:24.236 2475 ERROR nova     max_url_len=max_url_len)
Sep 28 12:33:24 ctl02 nova-api[2475]: 2017-09-28 12:33:24.236 2475 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:33:24 ctl02 nova-api[2475]: 2017-09-28 12:33:24.236 2475 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:33:24 ctl02 nova-api[2475]: 2017-09-28 12:33:24.236 2475 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:33:24 ctl02 nova-api[2475]: 2017-09-28 12:33:24.236 2475 ERROR nova     sock.listen(backlog)
Sep 28 12:33:24 ctl02 nova-api[2475]: 2017-09-28 12:33:24.236 2475 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:33:24 ctl02 nova-api[2475]: 2017-09-28 12:33:24.236 2475 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:33:24 ctl02 nova-api[2475]: 2017-09-28 12:33:24.236 2475 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:33:24 ctl02 nova-api[2475]: 2017-09-28 12:33:24.236 2475 ERROR nova
Sep 28 12:33:24 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:33:24 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:33:24 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:33:24 ctl02 glance-api[29183]: 2017-09-28 12:33:24.387 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:33:24] "OPTIONS / HTTP/1.0" 200 134 0.000583
Sep 28 12:33:24 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:33:24 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:33:24 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:33:24 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:33:25 ctl02 heat-api[13008]: 2017-09-28 12:33:25.050 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:33:25] "OPTIONS / HTTP/1.0" 200 134 0.000612
Sep 28 12:33:25 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:33:25.697 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:33:25] "OPTIONS / HTTP/1.0" 200 134 0.000504
Sep 28 12:33:26 ctl02 nova-api[2494]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:33:26 ctl02 nova-api[2494]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:33:26 ctl02 nova-api[2494]: 2017-09-28 12:33:26.566 2494 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:33:26 ctl02 nova-api[2494]: 2017-09-28 12:33:26.567 2494 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:33:26 ctl02 nova-api[2494]: 2017-09-28 12:33:26.567 2494 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:33:26 ctl02 nova-api[2494]: 2017-09-28 12:33:26.567 2494 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:33:26 ctl02 nova-api[2494]: 2017-09-28 12:33:26.567 2494 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:33:26 ctl02 nova-api[2494]: 2017-09-28 12:33:26.567 2494 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:33:26 ctl02 nova-api[2494]: 2017-09-28 12:33:26.567 2494 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:33:26 ctl02 nova-api[2494]: 2017-09-28 12:33:26.567 2494 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:33:26 ctl02 nova-api[2494]: 2017-09-28 12:33:26.567 2494 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:33:26 ctl02 nova-api[2494]: 2017-09-28 12:33:26.567 2494 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:33:26 ctl02 nova-api[2494]: 2017-09-28 12:33:26.567 2494 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:33:26 ctl02 nova-api[2494]: 2017-09-28 12:33:26.567 2494 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:33:26 ctl02 nova-api[2494]: 2017-09-28 12:33:26.567 2494 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:33:26 ctl02 nova-api[2494]: 2017-09-28 12:33:26.567 2494 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:33:26 ctl02 nova-api[2494]: 2017-09-28 12:33:26.567 2494 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:33:26 ctl02 nova-api[2494]: 2017-09-28 12:33:26.567 2494 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:33:26 ctl02 nova-api[2494]: 2017-09-28 12:33:26.567 2494 ERROR nova.wsgi     self.filename))
Sep 28 12:33:26 ctl02 nova-api[2494]: 2017-09-28 12:33:26.567 2494 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:33:26 ctl02 nova-api[2494]: 2017-09-28 12:33:26.567 2494 ERROR nova.wsgi
Sep 28 12:33:26 ctl02 nova-api[2494]: 2017-09-28 12:33:26.569 2494 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:33:26 ctl02 nova-api[2494]: 2017-09-28 12:33:26.696 2494 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:33:26 ctl02 nova-api[2494]: 2017-09-28 12:33:26.921 2494 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:33:26 ctl02 nova-api[2494]: 2017-09-28 12:33:26.924 2494 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:33:26 ctl02 nova-api[2494]: 2017-09-28 12:33:26.924 2494 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:33:26 ctl02 nova-api[2494]: 2017-09-28 12:33:26.925 2494 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:33:27 ctl02 nova-api[2494]: 2017-09-28 12:33:27.056 2494 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:33:27 ctl02 nova-api[2494]: 2017-09-28 12:33:27.058 2494 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:33:27 ctl02 nova-api[2494]: 2017-09-28 12:33:27.059 2494 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:33:27 ctl02 nova-api[2494]: 2017-09-28 12:33:27.059 2494 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:33:27 ctl02 nova-api[2494]: 2017-09-28 12:33:27.062 2494 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:33:27 ctl02 nova-api[2494]: 2017-09-28 12:33:27.063 2494 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:33:27 ctl02 nova-api[2494]: 2017-09-28 12:33:27.063 2494 ERROR nova Traceback (most recent call last):
Sep 28 12:33:27 ctl02 nova-api[2494]: 2017-09-28 12:33:27.063 2494 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:33:27 ctl02 nova-api[2494]: 2017-09-28 12:33:27.063 2494 ERROR nova     sys.exit(main())
Sep 28 12:33:27 ctl02 nova-api[2494]: 2017-09-28 12:33:27.063 2494 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:33:27 ctl02 nova-api[2494]: 2017-09-28 12:33:27.063 2494 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:33:27 ctl02 nova-api[2494]: 2017-09-28 12:33:27.063 2494 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:33:27 ctl02 nova-api[2494]: 2017-09-28 12:33:27.063 2494 ERROR nova     max_url_len=max_url_len)
Sep 28 12:33:27 ctl02 nova-api[2494]: 2017-09-28 12:33:27.063 2494 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:33:27 ctl02 nova-api[2494]: 2017-09-28 12:33:27.063 2494 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:33:27 ctl02 nova-api[2494]: 2017-09-28 12:33:27.063 2494 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:33:27 ctl02 nova-api[2494]: 2017-09-28 12:33:27.063 2494 ERROR nova     sock.listen(backlog)
Sep 28 12:33:27 ctl02 nova-api[2494]: 2017-09-28 12:33:27.063 2494 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:33:27 ctl02 nova-api[2494]: 2017-09-28 12:33:27.063 2494 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:33:27 ctl02 nova-api[2494]: 2017-09-28 12:33:27.063 2494 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:33:27 ctl02 nova-api[2494]: 2017-09-28 12:33:27.063 2494 ERROR nova
Sep 28 12:33:27 ctl02 heat-api[13008]: 2017-09-28 12:33:27.163 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:33:27] "OPTIONS / HTTP/1.0" 200 134 0.000528
Sep 28 12:33:27 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:33:27 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:33:27 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:33:27 ctl02 heat-api-cfn[13300]: 2017-09-28 12:33:27.239 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:33:27] "OPTIONS / HTTP/1.0" 200 134 0.000440
Sep 28 12:33:27 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:33:27.293 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:33:27] "OPTIONS / HTTP/1.0" 200 134 0.000415
Sep 28 12:33:27 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:33:27 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:33:27 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:33:27 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:33:27 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x239ddd09)
Sep 28 12:33:28 ctl02 heat-api-cfn[13300]: 2017-09-28 12:33:28.252 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:33:28] "OPTIONS / HTTP/1.0" 200 134 0.000540
Sep 28 12:33:28 ctl02 neutron-server[30536]: 2017-09-28 12:33:28.499 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:33:28 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x239ddd09)
Sep 28 12:33:29 ctl02 nova-api[2512]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:33:29 ctl02 nova-api[2512]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:33:29 ctl02 nova-api[2512]: 2017-09-28 12:33:29.266 2512 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:33:29 ctl02 nova-api[2512]: 2017-09-28 12:33:29.268 2512 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:33:29 ctl02 nova-api[2512]: 2017-09-28 12:33:29.268 2512 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:33:29 ctl02 nova-api[2512]: 2017-09-28 12:33:29.268 2512 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:33:29 ctl02 nova-api[2512]: 2017-09-28 12:33:29.268 2512 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:33:29 ctl02 nova-api[2512]: 2017-09-28 12:33:29.268 2512 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:33:29 ctl02 nova-api[2512]: 2017-09-28 12:33:29.268 2512 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:33:29 ctl02 nova-api[2512]: 2017-09-28 12:33:29.268 2512 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:33:29 ctl02 nova-api[2512]: 2017-09-28 12:33:29.268 2512 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:33:29 ctl02 nova-api[2512]: 2017-09-28 12:33:29.268 2512 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:33:29 ctl02 nova-api[2512]: 2017-09-28 12:33:29.268 2512 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:33:29 ctl02 nova-api[2512]: 2017-09-28 12:33:29.268 2512 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:33:29 ctl02 nova-api[2512]: 2017-09-28 12:33:29.268 2512 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:33:29 ctl02 nova-api[2512]: 2017-09-28 12:33:29.268 2512 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:33:29 ctl02 nova-api[2512]: 2017-09-28 12:33:29.268 2512 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:33:29 ctl02 nova-api[2512]: 2017-09-28 12:33:29.268 2512 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:33:29 ctl02 nova-api[2512]: 2017-09-28 12:33:29.268 2512 ERROR nova.wsgi     self.filename))
Sep 28 12:33:29 ctl02 nova-api[2512]: 2017-09-28 12:33:29.268 2512 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:33:29 ctl02 nova-api[2512]: 2017-09-28 12:33:29.268 2512 ERROR nova.wsgi
Sep 28 12:33:29 ctl02 nova-api[2512]: 2017-09-28 12:33:29.270 2512 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:33:29 ctl02 nova-api[2512]: 2017-09-28 12:33:29.401 2512 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:33:29 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x239ddd09)
Sep 28 12:33:29 ctl02 nova-api[2512]: 2017-09-28 12:33:29.648 2512 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:33:29 ctl02 nova-api[2512]: 2017-09-28 12:33:29.651 2512 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:33:29 ctl02 nova-api[2512]: 2017-09-28 12:33:29.651 2512 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:33:29 ctl02 nova-api[2512]: 2017-09-28 12:33:29.651 2512 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:33:29 ctl02 heat-api[13008]: 2017-09-28 12:33:29.685 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:33:29] "OPTIONS / HTTP/1.0" 200 134 0.000607
Sep 28 12:33:29 ctl02 nova-api[2512]: 2017-09-28 12:33:29.785 2512 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:33:29 ctl02 nova-api[2512]: 2017-09-28 12:33:29.788 2512 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:33:29 ctl02 nova-api[2512]: 2017-09-28 12:33:29.788 2512 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:33:29 ctl02 nova-api[2512]: 2017-09-28 12:33:29.789 2512 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:33:29 ctl02 nova-api[2512]: 2017-09-28 12:33:29.792 2512 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:33:29 ctl02 nova-api[2512]: 2017-09-28 12:33:29.793 2512 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:33:29 ctl02 nova-api[2512]: 2017-09-28 12:33:29.793 2512 ERROR nova Traceback (most recent call last):
Sep 28 12:33:29 ctl02 nova-api[2512]: 2017-09-28 12:33:29.793 2512 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:33:29 ctl02 nova-api[2512]: 2017-09-28 12:33:29.793 2512 ERROR nova     sys.exit(main())
Sep 28 12:33:29 ctl02 nova-api[2512]: 2017-09-28 12:33:29.793 2512 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:33:29 ctl02 nova-api[2512]: 2017-09-28 12:33:29.793 2512 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:33:29 ctl02 nova-api[2512]: 2017-09-28 12:33:29.793 2512 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:33:29 ctl02 nova-api[2512]: 2017-09-28 12:33:29.793 2512 ERROR nova     max_url_len=max_url_len)
Sep 28 12:33:29 ctl02 nova-api[2512]: 2017-09-28 12:33:29.793 2512 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:33:29 ctl02 nova-api[2512]: 2017-09-28 12:33:29.793 2512 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:33:29 ctl02 nova-api[2512]: 2017-09-28 12:33:29.793 2512 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:33:29 ctl02 nova-api[2512]: 2017-09-28 12:33:29.793 2512 ERROR nova     sock.listen(backlog)
Sep 28 12:33:29 ctl02 nova-api[2512]: 2017-09-28 12:33:29.793 2512 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:33:29 ctl02 nova-api[2512]: 2017-09-28 12:33:29.793 2512 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:33:29 ctl02 nova-api[2512]: 2017-09-28 12:33:29.793 2512 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:33:29 ctl02 nova-api[2512]: 2017-09-28 12:33:29.793 2512 ERROR nova
Sep 28 12:33:29 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:33:29 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:33:29 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:33:30 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:33:30 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:33:30 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:33:30 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:33:30 ctl02 neutron-server[30536]: 2017-09-28 12:33:30.454 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:33:30] "OPTIONS / HTTP/1.0" 200 262 0.000474
Sep 28 12:33:30 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x239ddd09)
Sep 28 12:33:31 ctl02 glance-api[29183]: 2017-09-28 12:33:31.078 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:33:31] "OPTIONS / HTTP/1.0" 200 134 0.000575
Sep 28 12:33:31 ctl02 neutron-server[30536]: 2017-09-28 12:33:31.168 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:33:31] "OPTIONS / HTTP/1.0" 200 262 0.000469
Sep 28 12:33:31 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x239ddd09)
Sep 28 12:33:31 ctl02 nova-api[2539]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:33:31 ctl02 nova-api[2539]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:33:31 ctl02 heat-api-cfn[13300]: 2017-09-28 12:33:31.941 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:33:31] "OPTIONS / HTTP/1.0" 200 134 0.000504
Sep 28 12:33:31 ctl02 nova-api[2539]: 2017-09-28 12:33:31.997 2539 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:33:31 ctl02 nova-api[2539]: 2017-09-28 12:33:31.998 2539 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:33:31 ctl02 nova-api[2539]: 2017-09-28 12:33:31.998 2539 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:33:31 ctl02 nova-api[2539]: 2017-09-28 12:33:31.998 2539 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:33:31 ctl02 nova-api[2539]: 2017-09-28 12:33:31.998 2539 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:33:31 ctl02 nova-api[2539]: 2017-09-28 12:33:31.998 2539 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:33:31 ctl02 nova-api[2539]: 2017-09-28 12:33:31.998 2539 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:33:32 ctl02 nova-api[2539]: 2017-09-28 12:33:31.998 2539 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:33:32 ctl02 nova-api[2539]: 2017-09-28 12:33:31.998 2539 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:33:32 ctl02 nova-api[2539]: 2017-09-28 12:33:31.998 2539 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:33:32 ctl02 nova-api[2539]: 2017-09-28 12:33:31.998 2539 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:33:32 ctl02 nova-api[2539]: 2017-09-28 12:33:31.998 2539 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:33:32 ctl02 nova-api[2539]: 2017-09-28 12:33:31.998 2539 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:33:32 ctl02 nova-api[2539]: 2017-09-28 12:33:31.998 2539 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:33:32 ctl02 nova-api[2539]: 2017-09-28 12:33:31.998 2539 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:33:32 ctl02 nova-api[2539]: 2017-09-28 12:33:31.998 2539 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:33:32 ctl02 nova-api[2539]: 2017-09-28 12:33:31.998 2539 ERROR nova.wsgi     self.filename))
Sep 28 12:33:32 ctl02 nova-api[2539]: 2017-09-28 12:33:31.998 2539 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:33:32 ctl02 nova-api[2539]: 2017-09-28 12:33:31.998 2539 ERROR nova.wsgi
Sep 28 12:33:32 ctl02 nova-api[2539]: 2017-09-28 12:33:31.999 2539 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:33:32 ctl02 nova-api[2539]: 2017-09-28 12:33:32.134 2539 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:33:32 ctl02 neutron-server[30536]: 2017-09-28 12:33:32.355 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:33:32] "OPTIONS / HTTP/1.0" 200 262 0.000504
Sep 28 12:33:32 ctl02 nova-api[2539]: 2017-09-28 12:33:32.382 2539 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:33:32 ctl02 nova-api[2539]: 2017-09-28 12:33:32.384 2539 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:33:32 ctl02 nova-api[2539]: 2017-09-28 12:33:32.384 2539 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:33:32 ctl02 nova-api[2539]: 2017-09-28 12:33:32.385 2539 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:33:32 ctl02 nova-api[2539]: 2017-09-28 12:33:32.517 2539 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:33:32 ctl02 nova-api[2539]: 2017-09-28 12:33:32.520 2539 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:33:32 ctl02 nova-api[2539]: 2017-09-28 12:33:32.521 2539 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:33:32 ctl02 nova-api[2539]: 2017-09-28 12:33:32.521 2539 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:33:32 ctl02 nova-api[2539]: 2017-09-28 12:33:32.524 2539 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:33:32 ctl02 nova-api[2539]: 2017-09-28 12:33:32.525 2539 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:33:32 ctl02 nova-api[2539]: 2017-09-28 12:33:32.525 2539 ERROR nova Traceback (most recent call last):
Sep 28 12:33:32 ctl02 nova-api[2539]: 2017-09-28 12:33:32.525 2539 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:33:32 ctl02 nova-api[2539]: 2017-09-28 12:33:32.525 2539 ERROR nova     sys.exit(main())
Sep 28 12:33:32 ctl02 nova-api[2539]: 2017-09-28 12:33:32.525 2539 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:33:32 ctl02 nova-api[2539]: 2017-09-28 12:33:32.525 2539 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:33:32 ctl02 nova-api[2539]: 2017-09-28 12:33:32.525 2539 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:33:32 ctl02 nova-api[2539]: 2017-09-28 12:33:32.525 2539 ERROR nova     max_url_len=max_url_len)
Sep 28 12:33:32 ctl02 nova-api[2539]: 2017-09-28 12:33:32.525 2539 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:33:32 ctl02 nova-api[2539]: 2017-09-28 12:33:32.525 2539 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:33:32 ctl02 nova-api[2539]: 2017-09-28 12:33:32.525 2539 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:33:32 ctl02 nova-api[2539]: 2017-09-28 12:33:32.525 2539 ERROR nova     sock.listen(backlog)
Sep 28 12:33:32 ctl02 nova-api[2539]: 2017-09-28 12:33:32.525 2539 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:33:32 ctl02 nova-api[2539]: 2017-09-28 12:33:32.525 2539 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:33:32 ctl02 nova-api[2539]: 2017-09-28 12:33:32.525 2539 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:33:32 ctl02 nova-api[2539]: 2017-09-28 12:33:32.525 2539 ERROR nova
Sep 28 12:33:32 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x239ddd09)
Sep 28 12:33:32 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:33:32 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:33:32 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:33:32 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:33:32 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:33:32 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:33:32 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:33:33 ctl02 glance-api[29183]: 2017-09-28 12:33:33.232 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:33:33] "OPTIONS / HTTP/1.0" 200 134 0.000657
Sep 28 12:33:33 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x239ddd09)
Sep 28 12:33:33 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:33:33.763 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:33:33] "OPTIONS / HTTP/1.0" 200 134 0.000406
Sep 28 12:33:34 ctl02 glance-api[29183]: 2017-09-28 12:33:34.477 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:33:34] "OPTIONS / HTTP/1.0" 200 134 0.000592
Sep 28 12:33:34 ctl02 nova-api[2557]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:33:34 ctl02 nova-api[2557]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:33:34 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x239ddd09)
Sep 28 12:33:34 ctl02 nova-api[2557]: 2017-09-28 12:33:34.740 2557 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:33:34 ctl02 nova-api[2557]: 2017-09-28 12:33:34.741 2557 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:33:34 ctl02 nova-api[2557]: 2017-09-28 12:33:34.741 2557 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:33:34 ctl02 nova-api[2557]: 2017-09-28 12:33:34.741 2557 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:33:34 ctl02 nova-api[2557]: 2017-09-28 12:33:34.741 2557 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:33:34 ctl02 nova-api[2557]: 2017-09-28 12:33:34.741 2557 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:33:34 ctl02 nova-api[2557]: 2017-09-28 12:33:34.741 2557 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:33:34 ctl02 nova-api[2557]: 2017-09-28 12:33:34.741 2557 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:33:34 ctl02 nova-api[2557]: 2017-09-28 12:33:34.741 2557 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:33:34 ctl02 nova-api[2557]: 2017-09-28 12:33:34.741 2557 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:33:34 ctl02 nova-api[2557]: 2017-09-28 12:33:34.741 2557 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:33:34 ctl02 nova-api[2557]: 2017-09-28 12:33:34.741 2557 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:33:34 ctl02 nova-api[2557]: 2017-09-28 12:33:34.741 2557 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:33:34 ctl02 nova-api[2557]: 2017-09-28 12:33:34.741 2557 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:33:34 ctl02 nova-api[2557]: 2017-09-28 12:33:34.741 2557 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:33:34 ctl02 nova-api[2557]: 2017-09-28 12:33:34.741 2557 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:33:34 ctl02 nova-api[2557]: 2017-09-28 12:33:34.741 2557 ERROR nova.wsgi     self.filename))
Sep 28 12:33:34 ctl02 nova-api[2557]: 2017-09-28 12:33:34.741 2557 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:33:34 ctl02 nova-api[2557]: 2017-09-28 12:33:34.741 2557 ERROR nova.wsgi
Sep 28 12:33:34 ctl02 nova-api[2557]: 2017-09-28 12:33:34.742 2557 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:33:34 ctl02 nova-api[2557]: 2017-09-28 12:33:34.871 2557 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:33:35 ctl02 nova-api[2557]: 2017-09-28 12:33:35.106 2557 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:33:35 ctl02 nova-api[2557]: 2017-09-28 12:33:35.108 2557 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:33:35 ctl02 nova-api[2557]: 2017-09-28 12:33:35.109 2557 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:33:35 ctl02 nova-api[2557]: 2017-09-28 12:33:35.109 2557 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:33:35 ctl02 nova-api[2557]: 2017-09-28 12:33:35.241 2557 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:33:35 ctl02 nova-api[2557]: 2017-09-28 12:33:35.244 2557 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:33:35 ctl02 nova-api[2557]: 2017-09-28 12:33:35.244 2557 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:33:35 ctl02 nova-api[2557]: 2017-09-28 12:33:35.244 2557 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:33:35 ctl02 nova-api[2557]: 2017-09-28 12:33:35.248 2557 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:33:35 ctl02 nova-api[2557]: 2017-09-28 12:33:35.248 2557 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:33:35 ctl02 nova-api[2557]: 2017-09-28 12:33:35.248 2557 ERROR nova Traceback (most recent call last):
Sep 28 12:33:35 ctl02 nova-api[2557]: 2017-09-28 12:33:35.248 2557 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:33:35 ctl02 nova-api[2557]: 2017-09-28 12:33:35.248 2557 ERROR nova     sys.exit(main())
Sep 28 12:33:35 ctl02 nova-api[2557]: 2017-09-28 12:33:35.248 2557 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:33:35 ctl02 nova-api[2557]: 2017-09-28 12:33:35.248 2557 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:33:35 ctl02 nova-api[2557]: 2017-09-28 12:33:35.248 2557 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:33:35 ctl02 nova-api[2557]: 2017-09-28 12:33:35.248 2557 ERROR nova     max_url_len=max_url_len)
Sep 28 12:33:35 ctl02 nova-api[2557]: 2017-09-28 12:33:35.248 2557 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:33:35 ctl02 nova-api[2557]: 2017-09-28 12:33:35.248 2557 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:33:35 ctl02 nova-api[2557]: 2017-09-28 12:33:35.248 2557 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:33:35 ctl02 nova-api[2557]: 2017-09-28 12:33:35.248 2557 ERROR nova     sock.listen(backlog)
Sep 28 12:33:35 ctl02 nova-api[2557]: 2017-09-28 12:33:35.248 2557 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:33:35 ctl02 nova-api[2557]: 2017-09-28 12:33:35.248 2557 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:33:35 ctl02 nova-api[2557]: 2017-09-28 12:33:35.248 2557 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:33:35 ctl02 nova-api[2557]: 2017-09-28 12:33:35.248 2557 ERROR nova
Sep 28 12:33:35 ctl02 heat-api[13008]: 2017-09-28 12:33:35.325 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:33:35] "OPTIONS / HTTP/1.0" 200 134 0.000615
Sep 28 12:33:35 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:33:35 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:33:35 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:33:35 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:33:35 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:33:35 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x239ddd09)
Sep 28 12:33:35 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:33:35 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:33:35 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:33:35.787 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:33:35] "OPTIONS / HTTP/1.0" 200 134 0.000461
Sep 28 12:33:36 ctl02 neutron-server[30536]: 2017-09-28 12:33:36.389 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 4 dead agents out of 6:
Sep 28 12:33:36 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:33:36 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:32:08 cmp002
Sep 28 12:33:36 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:31:58 cmp001
Sep 28 12:33:36 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:32:40 cmp002
Sep 28 12:33:36 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:32:06 cmp002
Sep 28 12:33:36 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x239ddd09)
Sep 28 12:33:37 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:33:37.088 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:33:37] "OPTIONS / HTTP/1.0" 200 134 0.000609
Sep 28 12:33:37 ctl02 heat-api-cfn[13300]: 2017-09-28 12:33:37.367 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:33:37] "OPTIONS / HTTP/1.0" 200 134 0.000494
Sep 28 12:33:37 ctl02 nova-api[2574]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:33:37 ctl02 nova-api[2574]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:33:37 ctl02 heat-api[13008]: 2017-09-28 12:33:37.388 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:33:37] "OPTIONS / HTTP/1.0" 200 134 0.000669
Sep 28 12:33:37 ctl02 nova-api[2574]: 2017-09-28 12:33:37.566 2574 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:33:37 ctl02 nova-api[2574]: 2017-09-28 12:33:37.568 2574 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:33:37 ctl02 nova-api[2574]: 2017-09-28 12:33:37.568 2574 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:33:37 ctl02 nova-api[2574]: 2017-09-28 12:33:37.568 2574 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:33:37 ctl02 nova-api[2574]: 2017-09-28 12:33:37.568 2574 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:33:37 ctl02 nova-api[2574]: 2017-09-28 12:33:37.568 2574 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:33:37 ctl02 nova-api[2574]: 2017-09-28 12:33:37.568 2574 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:33:37 ctl02 nova-api[2574]: 2017-09-28 12:33:37.568 2574 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:33:37 ctl02 nova-api[2574]: 2017-09-28 12:33:37.568 2574 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:33:37 ctl02 nova-api[2574]: 2017-09-28 12:33:37.568 2574 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:33:37 ctl02 nova-api[2574]: 2017-09-28 12:33:37.568 2574 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:33:37 ctl02 nova-api[2574]: 2017-09-28 12:33:37.568 2574 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:33:37 ctl02 nova-api[2574]: 2017-09-28 12:33:37.568 2574 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:33:37 ctl02 nova-api[2574]: 2017-09-28 12:33:37.568 2574 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:33:37 ctl02 nova-api[2574]: 2017-09-28 12:33:37.568 2574 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:33:37 ctl02 nova-api[2574]: 2017-09-28 12:33:37.568 2574 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:33:37 ctl02 nova-api[2574]: 2017-09-28 12:33:37.568 2574 ERROR nova.wsgi     self.filename))
Sep 28 12:33:37 ctl02 nova-api[2574]: 2017-09-28 12:33:37.568 2574 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:33:37 ctl02 nova-api[2574]: 2017-09-28 12:33:37.568 2574 ERROR nova.wsgi
Sep 28 12:33:37 ctl02 nova-api[2574]: 2017-09-28 12:33:37.569 2574 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:33:37 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x239ddd09)
Sep 28 12:33:37 ctl02 nova-api[2574]: 2017-09-28 12:33:37.703 2574 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:33:37 ctl02 nova-api[2574]: 2017-09-28 12:33:37.955 2574 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:33:37 ctl02 nova-api[2574]: 2017-09-28 12:33:37.957 2574 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:33:37 ctl02 nova-api[2574]: 2017-09-28 12:33:37.958 2574 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:33:37 ctl02 nova-api[2574]: 2017-09-28 12:33:37.958 2574 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:33:38 ctl02 nova-api[2574]: 2017-09-28 12:33:38.093 2574 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:33:38 ctl02 nova-api[2574]: 2017-09-28 12:33:38.095 2574 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:33:38 ctl02 nova-api[2574]: 2017-09-28 12:33:38.096 2574 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:33:38 ctl02 nova-api[2574]: 2017-09-28 12:33:38.096 2574 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:33:38 ctl02 nova-api[2574]: 2017-09-28 12:33:38.099 2574 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:33:38 ctl02 nova-api[2574]: 2017-09-28 12:33:38.100 2574 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:33:38 ctl02 nova-api[2574]: 2017-09-28 12:33:38.100 2574 ERROR nova Traceback (most recent call last):
Sep 28 12:33:38 ctl02 nova-api[2574]: 2017-09-28 12:33:38.100 2574 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:33:38 ctl02 nova-api[2574]: 2017-09-28 12:33:38.100 2574 ERROR nova     sys.exit(main())
Sep 28 12:33:38 ctl02 nova-api[2574]: 2017-09-28 12:33:38.100 2574 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:33:38 ctl02 nova-api[2574]: 2017-09-28 12:33:38.100 2574 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:33:38 ctl02 nova-api[2574]: 2017-09-28 12:33:38.100 2574 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:33:38 ctl02 nova-api[2574]: 2017-09-28 12:33:38.100 2574 ERROR nova     max_url_len=max_url_len)
Sep 28 12:33:38 ctl02 nova-api[2574]: 2017-09-28 12:33:38.100 2574 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:33:38 ctl02 nova-api[2574]: 2017-09-28 12:33:38.100 2574 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:33:38 ctl02 nova-api[2574]: 2017-09-28 12:33:38.100 2574 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:33:38 ctl02 nova-api[2574]: 2017-09-28 12:33:38.100 2574 ERROR nova     sock.listen(backlog)
Sep 28 12:33:38 ctl02 nova-api[2574]: 2017-09-28 12:33:38.100 2574 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:33:38 ctl02 nova-api[2574]: 2017-09-28 12:33:38.100 2574 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:33:38 ctl02 nova-api[2574]: 2017-09-28 12:33:38.100 2574 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:33:38 ctl02 nova-api[2574]: 2017-09-28 12:33:38.100 2574 ERROR nova
Sep 28 12:33:38 ctl02 heat-api-cfn[13300]: 2017-09-28 12:33:38.220 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:33:38] "OPTIONS / HTTP/1.0" 200 134 0.000505
Sep 28 12:33:38 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:33:38 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:33:38 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:33:38 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:33:38 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:33:38 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:33:38 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:33:38 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:33:38 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:33:39 ctl02 heat-api[13008]: 2017-09-28 12:33:39.558 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:33:39] "OPTIONS / HTTP/1.0" 200 134 0.000753
Sep 28 12:33:40 ctl02 nova-api[2593]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:33:40 ctl02 nova-api[2593]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:33:40 ctl02 nova-api[2593]: 2017-09-28 12:33:40.259 2593 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:33:40 ctl02 nova-api[2593]: 2017-09-28 12:33:40.260 2593 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:33:40 ctl02 nova-api[2593]: 2017-09-28 12:33:40.260 2593 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:33:40 ctl02 nova-api[2593]: 2017-09-28 12:33:40.260 2593 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:33:40 ctl02 nova-api[2593]: 2017-09-28 12:33:40.260 2593 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:33:40 ctl02 nova-api[2593]: 2017-09-28 12:33:40.260 2593 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:33:40 ctl02 nova-api[2593]: 2017-09-28 12:33:40.260 2593 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:33:40 ctl02 nova-api[2593]: 2017-09-28 12:33:40.260 2593 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:33:40 ctl02 nova-api[2593]: 2017-09-28 12:33:40.260 2593 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:33:40 ctl02 nova-api[2593]: 2017-09-28 12:33:40.260 2593 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:33:40 ctl02 nova-api[2593]: 2017-09-28 12:33:40.260 2593 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:33:40 ctl02 nova-api[2593]: 2017-09-28 12:33:40.260 2593 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:33:40 ctl02 nova-api[2593]: 2017-09-28 12:33:40.260 2593 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:33:40 ctl02 nova-api[2593]: 2017-09-28 12:33:40.260 2593 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:33:40 ctl02 nova-api[2593]: 2017-09-28 12:33:40.260 2593 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:33:40 ctl02 nova-api[2593]: 2017-09-28 12:33:40.260 2593 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:33:40 ctl02 nova-api[2593]: 2017-09-28 12:33:40.260 2593 ERROR nova.wsgi     self.filename))
Sep 28 12:33:40 ctl02 nova-api[2593]: 2017-09-28 12:33:40.260 2593 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:33:40 ctl02 nova-api[2593]: 2017-09-28 12:33:40.260 2593 ERROR nova.wsgi
Sep 28 12:33:40 ctl02 nova-api[2593]: 2017-09-28 12:33:40.261 2593 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:33:40 ctl02 neutron-server[30536]: 2017-09-28 12:33:40.263 30601 WARNING oslo_messaging._drivers.amqpdriver [req-6248483c-639d-4a4c-8c88-4ce4070ee389 - - - - -] reply_692b03e6d8d44d758b6be19b067c3aa3 doesn't exists, drop reply to 750b78a0703149c2a342d03835e4e7d5
Sep 28 12:33:40 ctl02 neutron-server[30536]: 2017-09-28 12:33:40.264 30601 INFO oslo_messaging._drivers.amqpdriver [req-6248483c-639d-4a4c-8c88-4ce4070ee389 - - - - -] The reply 750b78a0703149c2a342d03835e4e7d5 cannot be sent  reply_692b03e6d8d44d758b6be19b067c3aa3 reply queue don't exist after 60 sec abandoning...
Sep 28 12:33:40 ctl02 neutron-server[30536]: 2017-09-28 12:33:40.314 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:33:40] "OPTIONS / HTTP/1.0" 200 262 0.000467
Sep 28 12:33:40 ctl02 nova-api[2593]: 2017-09-28 12:33:40.388 2593 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:33:40 ctl02 nova-api[2593]: 2017-09-28 12:33:40.609 2593 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:33:40 ctl02 nova-api[2593]: 2017-09-28 12:33:40.611 2593 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:33:40 ctl02 nova-api[2593]: 2017-09-28 12:33:40.611 2593 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:33:40 ctl02 nova-api[2593]: 2017-09-28 12:33:40.611 2593 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:33:40 ctl02 nova-api[2593]: 2017-09-28 12:33:40.742 2593 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:33:40 ctl02 nova-api[2593]: 2017-09-28 12:33:40.744 2593 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:33:40 ctl02 nova-api[2593]: 2017-09-28 12:33:40.744 2593 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:33:40 ctl02 nova-api[2593]: 2017-09-28 12:33:40.744 2593 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:33:40 ctl02 nova-api[2593]: 2017-09-28 12:33:40.747 2593 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:33:40 ctl02 nova-api[2593]: 2017-09-28 12:33:40.747 2593 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:33:40 ctl02 nova-api[2593]: 2017-09-28 12:33:40.747 2593 ERROR nova Traceback (most recent call last):
Sep 28 12:33:40 ctl02 nova-api[2593]: 2017-09-28 12:33:40.747 2593 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:33:40 ctl02 nova-api[2593]: 2017-09-28 12:33:40.747 2593 ERROR nova     sys.exit(main())
Sep 28 12:33:40 ctl02 nova-api[2593]: 2017-09-28 12:33:40.747 2593 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:33:40 ctl02 nova-api[2593]: 2017-09-28 12:33:40.747 2593 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:33:40 ctl02 nova-api[2593]: 2017-09-28 12:33:40.747 2593 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:33:40 ctl02 nova-api[2593]: 2017-09-28 12:33:40.747 2593 ERROR nova     max_url_len=max_url_len)
Sep 28 12:33:40 ctl02 nova-api[2593]: 2017-09-28 12:33:40.747 2593 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:33:40 ctl02 nova-api[2593]: 2017-09-28 12:33:40.747 2593 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:33:40 ctl02 nova-api[2593]: 2017-09-28 12:33:40.747 2593 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:33:40 ctl02 nova-api[2593]: 2017-09-28 12:33:40.747 2593 ERROR nova     sock.listen(backlog)
Sep 28 12:33:40 ctl02 nova-api[2593]: 2017-09-28 12:33:40.747 2593 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:33:40 ctl02 nova-api[2593]: 2017-09-28 12:33:40.747 2593 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:33:40 ctl02 nova-api[2593]: 2017-09-28 12:33:40.747 2593 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:33:40 ctl02 nova-api[2593]: 2017-09-28 12:33:40.747 2593 ERROR nova
Sep 28 12:33:40 ctl02 glance-api[29183]: 2017-09-28 12:33:40.862 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:33:40] "OPTIONS / HTTP/1.0" 200 134 0.000579
Sep 28 12:33:40 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:33:40 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:33:40 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:33:41 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:33:41 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:33:41 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:33:41 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:33:41 ctl02 neutron-server[30536]: 2017-09-28 12:33:41.363 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:33:41] "OPTIONS / HTTP/1.0" 200 262 0.000467
Sep 28 12:33:41 ctl02 heat-api-cfn[13300]: 2017-09-28 12:33:41.729 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:33:41] "OPTIONS / HTTP/1.0" 200 134 0.000468
Sep 28 12:33:41 ctl02 nova-cert[4860]: 2017-09-28 12:33:41.988 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:33:42 ctl02 neutron-server[30536]: 2017-09-28 12:33:42.238 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:33:42] "OPTIONS / HTTP/1.0" 200 262 0.000468
Sep 28 12:33:42 ctl02 nova-conductor[5056]: 2017-09-28 12:33:42.794 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:33:42 ctl02 nova-conductor[5056]: 2017-09-28 12:33:42.814 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:33:42 ctl02 nova-api[2615]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:33:42 ctl02 nova-api[2615]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:33:42 ctl02 nova-conductor[5056]: 2017-09-28 12:33:42.825 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:33:42 ctl02 nova-conductor[5056]: 2017-09-28 12:33:42.826 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:33:43 ctl02 nova-api[2615]: 2017-09-28 12:33:43.017 2615 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:33:43 ctl02 nova-api[2615]: 2017-09-28 12:33:43.018 2615 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:33:43 ctl02 nova-api[2615]: 2017-09-28 12:33:43.018 2615 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:33:43 ctl02 nova-api[2615]: 2017-09-28 12:33:43.018 2615 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:33:43 ctl02 nova-api[2615]: 2017-09-28 12:33:43.018 2615 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:33:43 ctl02 nova-api[2615]: 2017-09-28 12:33:43.018 2615 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:33:43 ctl02 nova-api[2615]: 2017-09-28 12:33:43.018 2615 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:33:43 ctl02 nova-api[2615]: 2017-09-28 12:33:43.018 2615 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:33:43 ctl02 nova-api[2615]: 2017-09-28 12:33:43.018 2615 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:33:43 ctl02 nova-api[2615]: 2017-09-28 12:33:43.018 2615 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:33:43 ctl02 nova-api[2615]: 2017-09-28 12:33:43.018 2615 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:33:43 ctl02 nova-api[2615]: 2017-09-28 12:33:43.018 2615 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:33:43 ctl02 nova-api[2615]: 2017-09-28 12:33:43.018 2615 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:33:43 ctl02 nova-api[2615]: 2017-09-28 12:33:43.018 2615 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:33:43 ctl02 nova-api[2615]: 2017-09-28 12:33:43.018 2615 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:33:43 ctl02 nova-api[2615]: 2017-09-28 12:33:43.018 2615 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:33:43 ctl02 nova-api[2615]: 2017-09-28 12:33:43.018 2615 ERROR nova.wsgi     self.filename))
Sep 28 12:33:43 ctl02 nova-api[2615]: 2017-09-28 12:33:43.018 2615 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:33:43 ctl02 nova-api[2615]: 2017-09-28 12:33:43.018 2615 ERROR nova.wsgi
Sep 28 12:33:43 ctl02 nova-api[2615]: 2017-09-28 12:33:43.019 2615 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:33:43 ctl02 nova-api[2615]: 2017-09-28 12:33:43.156 2615 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:33:43 ctl02 glance-api[29183]: 2017-09-28 12:33:43.295 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:33:43] "OPTIONS / HTTP/1.0" 200 134 0.000616
Sep 28 12:33:43 ctl02 nova-api[2615]: 2017-09-28 12:33:43.405 2615 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:33:43 ctl02 nova-api[2615]: 2017-09-28 12:33:43.407 2615 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:33:43 ctl02 nova-api[2615]: 2017-09-28 12:33:43.407 2615 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:33:43 ctl02 nova-api[2615]: 2017-09-28 12:33:43.407 2615 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:33:43 ctl02 neutron-server[30536]: 2017-09-28 12:33:43.505 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:33:43 ctl02 nova-api[2615]: 2017-09-28 12:33:43.539 2615 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:33:43 ctl02 nova-api[2615]: 2017-09-28 12:33:43.541 2615 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:33:43 ctl02 nova-api[2615]: 2017-09-28 12:33:43.541 2615 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:33:43 ctl02 nova-api[2615]: 2017-09-28 12:33:43.542 2615 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:33:43 ctl02 nova-api[2615]: 2017-09-28 12:33:43.545 2615 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:33:43 ctl02 nova-api[2615]: 2017-09-28 12:33:43.545 2615 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:33:43 ctl02 nova-api[2615]: 2017-09-28 12:33:43.545 2615 ERROR nova Traceback (most recent call last):
Sep 28 12:33:43 ctl02 nova-api[2615]: 2017-09-28 12:33:43.545 2615 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:33:43 ctl02 nova-api[2615]: 2017-09-28 12:33:43.545 2615 ERROR nova     sys.exit(main())
Sep 28 12:33:43 ctl02 nova-api[2615]: 2017-09-28 12:33:43.545 2615 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:33:43 ctl02 nova-api[2615]: 2017-09-28 12:33:43.545 2615 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:33:43 ctl02 nova-api[2615]: 2017-09-28 12:33:43.545 2615 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:33:43 ctl02 nova-api[2615]: 2017-09-28 12:33:43.545 2615 ERROR nova     max_url_len=max_url_len)
Sep 28 12:33:43 ctl02 nova-api[2615]: 2017-09-28 12:33:43.545 2615 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:33:43 ctl02 nova-api[2615]: 2017-09-28 12:33:43.545 2615 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:33:43 ctl02 nova-api[2615]: 2017-09-28 12:33:43.545 2615 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:33:43 ctl02 nova-api[2615]: 2017-09-28 12:33:43.545 2615 ERROR nova     sock.listen(backlog)
Sep 28 12:33:43 ctl02 nova-api[2615]: 2017-09-28 12:33:43.545 2615 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:33:43 ctl02 nova-api[2615]: 2017-09-28 12:33:43.545 2615 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:33:43 ctl02 nova-api[2615]: 2017-09-28 12:33:43.545 2615 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:33:43 ctl02 nova-api[2615]: 2017-09-28 12:33:43.545 2615 ERROR nova
Sep 28 12:33:43 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:33:43 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:33:43 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:33:43 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:33:43 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:33:43 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:33:43 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:33:44 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:33:44.076 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:33:44] "OPTIONS / HTTP/1.0" 200 134 0.000402
Sep 28 12:33:44 ctl02 glance-api[29183]: 2017-09-28 12:33:44.491 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:33:44] "OPTIONS / HTTP/1.0" 200 134 0.000584
Sep 28 12:33:45 ctl02 nova-api[2643]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:33:45 ctl02 nova-api[2643]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:33:45 ctl02 heat-api[13008]: 2017-09-28 12:33:45.560 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:33:45] "OPTIONS / HTTP/1.0" 200 134 0.000556
Sep 28 12:33:45 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:33:45.576 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:33:45] "OPTIONS / HTTP/1.0" 200 134 0.000469
Sep 28 12:33:45 ctl02 nova-api[2643]: 2017-09-28 12:33:45.725 2643 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:33:45 ctl02 nova-api[2643]: 2017-09-28 12:33:45.726 2643 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:33:45 ctl02 nova-api[2643]: 2017-09-28 12:33:45.726 2643 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:33:45 ctl02 nova-api[2643]: 2017-09-28 12:33:45.726 2643 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:33:45 ctl02 nova-api[2643]: 2017-09-28 12:33:45.726 2643 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:33:45 ctl02 nova-api[2643]: 2017-09-28 12:33:45.726 2643 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:33:45 ctl02 nova-api[2643]: 2017-09-28 12:33:45.726 2643 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:33:45 ctl02 nova-api[2643]: 2017-09-28 12:33:45.726 2643 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:33:45 ctl02 nova-api[2643]: 2017-09-28 12:33:45.726 2643 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:33:45 ctl02 nova-api[2643]: 2017-09-28 12:33:45.726 2643 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:33:45 ctl02 nova-api[2643]: 2017-09-28 12:33:45.726 2643 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:33:45 ctl02 nova-api[2643]: 2017-09-28 12:33:45.726 2643 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:33:45 ctl02 nova-api[2643]: 2017-09-28 12:33:45.726 2643 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:33:45 ctl02 nova-api[2643]: 2017-09-28 12:33:45.726 2643 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:33:45 ctl02 nova-api[2643]: 2017-09-28 12:33:45.726 2643 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:33:45 ctl02 nova-api[2643]: 2017-09-28 12:33:45.726 2643 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:33:45 ctl02 nova-api[2643]: 2017-09-28 12:33:45.726 2643 ERROR nova.wsgi     self.filename))
Sep 28 12:33:45 ctl02 nova-api[2643]: 2017-09-28 12:33:45.726 2643 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:33:45 ctl02 nova-api[2643]: 2017-09-28 12:33:45.726 2643 ERROR nova.wsgi
Sep 28 12:33:45 ctl02 nova-api[2643]: 2017-09-28 12:33:45.727 2643 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:33:45 ctl02 nova-api[2643]: 2017-09-28 12:33:45.852 2643 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:33:46 ctl02 nova-api[2643]: 2017-09-28 12:33:46.073 2643 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:33:46 ctl02 nova-api[2643]: 2017-09-28 12:33:46.075 2643 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:33:46 ctl02 nova-api[2643]: 2017-09-28 12:33:46.075 2643 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:33:46 ctl02 nova-api[2643]: 2017-09-28 12:33:46.075 2643 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:33:46 ctl02 nova-api[2643]: 2017-09-28 12:33:46.205 2643 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:33:46 ctl02 nova-api[2643]: 2017-09-28 12:33:46.207 2643 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:33:46 ctl02 nova-api[2643]: 2017-09-28 12:33:46.207 2643 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:33:46 ctl02 nova-api[2643]: 2017-09-28 12:33:46.208 2643 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:33:46 ctl02 nova-api[2643]: 2017-09-28 12:33:46.211 2643 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:33:46 ctl02 nova-api[2643]: 2017-09-28 12:33:46.211 2643 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:33:46 ctl02 nova-api[2643]: 2017-09-28 12:33:46.211 2643 ERROR nova Traceback (most recent call last):
Sep 28 12:33:46 ctl02 nova-api[2643]: 2017-09-28 12:33:46.211 2643 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:33:46 ctl02 nova-api[2643]: 2017-09-28 12:33:46.211 2643 ERROR nova     sys.exit(main())
Sep 28 12:33:46 ctl02 nova-api[2643]: 2017-09-28 12:33:46.211 2643 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:33:46 ctl02 nova-api[2643]: 2017-09-28 12:33:46.211 2643 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:33:46 ctl02 nova-api[2643]: 2017-09-28 12:33:46.211 2643 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:33:46 ctl02 nova-api[2643]: 2017-09-28 12:33:46.211 2643 ERROR nova     max_url_len=max_url_len)
Sep 28 12:33:46 ctl02 nova-api[2643]: 2017-09-28 12:33:46.211 2643 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:33:46 ctl02 nova-api[2643]: 2017-09-28 12:33:46.211 2643 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:33:46 ctl02 nova-api[2643]: 2017-09-28 12:33:46.211 2643 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:33:46 ctl02 nova-api[2643]: 2017-09-28 12:33:46.211 2643 ERROR nova     sock.listen(backlog)
Sep 28 12:33:46 ctl02 nova-api[2643]: 2017-09-28 12:33:46.211 2643 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:33:46 ctl02 nova-api[2643]: 2017-09-28 12:33:46.211 2643 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:33:46 ctl02 nova-api[2643]: 2017-09-28 12:33:46.211 2643 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:33:46 ctl02 nova-api[2643]: 2017-09-28 12:33:46.211 2643 ERROR nova
Sep 28 12:33:46 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:33:46 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:33:46 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:33:46 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:33:46 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:33:46 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:33:46 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:33:46 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:33:46.935 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:33:46] "OPTIONS / HTTP/1.0" 200 134 0.000497
Sep 28 12:33:47 ctl02 heat-api-cfn[13300]: 2017-09-28 12:33:47.014 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:33:47] "OPTIONS / HTTP/1.0" 200 134 0.000528
Sep 28 12:33:47 ctl02 heat-api[13008]: 2017-09-28 12:33:47.555 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:33:47] "OPTIONS / HTTP/1.0" 200 134 0.000620
Sep 28 12:33:48 ctl02 nova-api[2661]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:33:48 ctl02 nova-api[2661]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:33:48 ctl02 nova-api[2661]: 2017-09-28 12:33:48.546 2661 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:33:48 ctl02 nova-api[2661]: 2017-09-28 12:33:48.548 2661 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:33:48 ctl02 nova-api[2661]: 2017-09-28 12:33:48.548 2661 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:33:48 ctl02 nova-api[2661]: 2017-09-28 12:33:48.548 2661 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:33:48 ctl02 nova-api[2661]: 2017-09-28 12:33:48.548 2661 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:33:48 ctl02 nova-api[2661]: 2017-09-28 12:33:48.548 2661 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:33:48 ctl02 nova-api[2661]: 2017-09-28 12:33:48.548 2661 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:33:48 ctl02 nova-api[2661]: 2017-09-28 12:33:48.548 2661 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:33:48 ctl02 nova-api[2661]: 2017-09-28 12:33:48.548 2661 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:33:48 ctl02 nova-api[2661]: 2017-09-28 12:33:48.548 2661 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:33:48 ctl02 nova-api[2661]: 2017-09-28 12:33:48.548 2661 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:33:48 ctl02 nova-api[2661]: 2017-09-28 12:33:48.548 2661 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:33:48 ctl02 nova-api[2661]: 2017-09-28 12:33:48.548 2661 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:33:48 ctl02 nova-api[2661]: 2017-09-28 12:33:48.548 2661 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:33:48 ctl02 nova-api[2661]: 2017-09-28 12:33:48.548 2661 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:33:48 ctl02 nova-api[2661]: 2017-09-28 12:33:48.548 2661 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:33:48 ctl02 nova-api[2661]: 2017-09-28 12:33:48.548 2661 ERROR nova.wsgi     self.filename))
Sep 28 12:33:48 ctl02 nova-api[2661]: 2017-09-28 12:33:48.548 2661 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:33:48 ctl02 nova-api[2661]: 2017-09-28 12:33:48.548 2661 ERROR nova.wsgi
Sep 28 12:33:48 ctl02 nova-api[2661]: 2017-09-28 12:33:48.550 2661 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:33:48 ctl02 heat-api-cfn[13300]: 2017-09-28 12:33:48.586 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:33:48] "OPTIONS / HTTP/1.0" 200 134 0.000759
Sep 28 12:33:48 ctl02 nova-api[2661]: 2017-09-28 12:33:48.683 2661 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:33:48 ctl02 nova-api[2661]: 2017-09-28 12:33:48.929 2661 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:33:48 ctl02 nova-api[2661]: 2017-09-28 12:33:48.932 2661 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:33:48 ctl02 nova-api[2661]: 2017-09-28 12:33:48.940 2661 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:33:48 ctl02 nova-api[2661]: 2017-09-28 12:33:48.940 2661 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:33:49 ctl02 nova-api[2661]: 2017-09-28 12:33:49.072 2661 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:33:49 ctl02 nova-api[2661]: 2017-09-28 12:33:49.074 2661 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:33:49 ctl02 nova-api[2661]: 2017-09-28 12:33:49.075 2661 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:33:49 ctl02 nova-api[2661]: 2017-09-28 12:33:49.075 2661 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:33:49 ctl02 nova-api[2661]: 2017-09-28 12:33:49.079 2661 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:33:49 ctl02 nova-api[2661]: 2017-09-28 12:33:49.079 2661 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:33:49 ctl02 nova-api[2661]: 2017-09-28 12:33:49.079 2661 ERROR nova Traceback (most recent call last):
Sep 28 12:33:49 ctl02 nova-api[2661]: 2017-09-28 12:33:49.079 2661 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:33:49 ctl02 nova-api[2661]: 2017-09-28 12:33:49.079 2661 ERROR nova     sys.exit(main())
Sep 28 12:33:49 ctl02 nova-api[2661]: 2017-09-28 12:33:49.079 2661 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:33:49 ctl02 nova-api[2661]: 2017-09-28 12:33:49.079 2661 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:33:49 ctl02 nova-api[2661]: 2017-09-28 12:33:49.079 2661 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:33:49 ctl02 nova-api[2661]: 2017-09-28 12:33:49.079 2661 ERROR nova     max_url_len=max_url_len)
Sep 28 12:33:49 ctl02 nova-api[2661]: 2017-09-28 12:33:49.079 2661 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:33:49 ctl02 nova-api[2661]: 2017-09-28 12:33:49.079 2661 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:33:49 ctl02 nova-api[2661]: 2017-09-28 12:33:49.079 2661 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:33:49 ctl02 nova-api[2661]: 2017-09-28 12:33:49.079 2661 ERROR nova     sock.listen(backlog)
Sep 28 12:33:49 ctl02 nova-api[2661]: 2017-09-28 12:33:49.079 2661 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:33:49 ctl02 nova-api[2661]: 2017-09-28 12:33:49.079 2661 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:33:49 ctl02 nova-api[2661]: 2017-09-28 12:33:49.079 2661 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:33:49 ctl02 nova-api[2661]: 2017-09-28 12:33:49.079 2661 ERROR nova
Sep 28 12:33:49 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:33:49 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:33:49 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:33:49 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:33:49 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:33:49 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:33:49 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:33:49 ctl02 heat-api[13008]: 2017-09-28 12:33:49.727 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:33:49] "OPTIONS / HTTP/1.0" 200 134 0.000555
Sep 28 12:33:50 ctl02 neutron-server[30536]: 2017-09-28 12:33:50.070 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:33:50] "OPTIONS / HTTP/1.0" 200 262 0.000544
Sep 28 12:33:50 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb3bad229)
Sep 28 12:33:51 ctl02 nova-api[2679]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:33:51 ctl02 nova-api[2679]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:33:51 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb3bad229)
Sep 28 12:33:51 ctl02 glance-api[29183]: 2017-09-28 12:33:51.145 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:33:51] "OPTIONS / HTTP/1.0" 200 134 0.000604
Sep 28 12:33:51 ctl02 nova-api[2679]: 2017-09-28 12:33:51.232 2679 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:33:51 ctl02 nova-api[2679]: 2017-09-28 12:33:51.234 2679 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:33:51 ctl02 nova-api[2679]: 2017-09-28 12:33:51.234 2679 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:33:51 ctl02 nova-api[2679]: 2017-09-28 12:33:51.234 2679 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:33:51 ctl02 nova-api[2679]: 2017-09-28 12:33:51.234 2679 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:33:51 ctl02 nova-api[2679]: 2017-09-28 12:33:51.234 2679 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:33:51 ctl02 nova-api[2679]: 2017-09-28 12:33:51.234 2679 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:33:51 ctl02 nova-api[2679]: 2017-09-28 12:33:51.234 2679 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:33:51 ctl02 nova-api[2679]: 2017-09-28 12:33:51.234 2679 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:33:51 ctl02 nova-api[2679]: 2017-09-28 12:33:51.234 2679 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:33:51 ctl02 nova-api[2679]: 2017-09-28 12:33:51.234 2679 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:33:51 ctl02 nova-api[2679]: 2017-09-28 12:33:51.234 2679 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:33:51 ctl02 nova-api[2679]: 2017-09-28 12:33:51.234 2679 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:33:51 ctl02 nova-api[2679]: 2017-09-28 12:33:51.234 2679 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:33:51 ctl02 nova-api[2679]: 2017-09-28 12:33:51.234 2679 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:33:51 ctl02 nova-api[2679]: 2017-09-28 12:33:51.234 2679 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:33:51 ctl02 nova-api[2679]: 2017-09-28 12:33:51.234 2679 ERROR nova.wsgi     self.filename))
Sep 28 12:33:51 ctl02 nova-api[2679]: 2017-09-28 12:33:51.234 2679 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:33:51 ctl02 nova-api[2679]: 2017-09-28 12:33:51.234 2679 ERROR nova.wsgi
Sep 28 12:33:51 ctl02 nova-api[2679]: 2017-09-28 12:33:51.235 2679 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:33:51 ctl02 nova-api[2679]: 2017-09-28 12:33:51.364 2679 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:33:51 ctl02 neutron-server[30536]: 2017-09-28 12:33:51.385 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 4 dead agents out of 6:
Sep 28 12:33:51 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:33:51 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:32:08 cmp002
Sep 28 12:33:51 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:31:58 cmp001
Sep 28 12:33:51 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:32:40 cmp002
Sep 28 12:33:51 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:32:06 cmp002
Sep 28 12:33:51 ctl02 nova-api[2679]: 2017-09-28 12:33:51.588 2679 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:33:51 ctl02 nova-api[2679]: 2017-09-28 12:33:51.590 2679 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:33:51 ctl02 nova-api[2679]: 2017-09-28 12:33:51.591 2679 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:33:51 ctl02 nova-api[2679]: 2017-09-28 12:33:51.591 2679 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:33:51 ctl02 heat-api-cfn[13300]: 2017-09-28 12:33:51.657 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:33:51] "OPTIONS / HTTP/1.0" 200 134 0.000448
Sep 28 12:33:51 ctl02 nova-api[2679]: 2017-09-28 12:33:51.722 2679 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:33:51 ctl02 nova-api[2679]: 2017-09-28 12:33:51.723 2679 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:33:51 ctl02 nova-api[2679]: 2017-09-28 12:33:51.724 2679 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:33:51 ctl02 nova-api[2679]: 2017-09-28 12:33:51.724 2679 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:33:51 ctl02 nova-api[2679]: 2017-09-28 12:33:51.727 2679 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:33:51 ctl02 nova-api[2679]: 2017-09-28 12:33:51.727 2679 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:33:51 ctl02 nova-api[2679]: 2017-09-28 12:33:51.727 2679 ERROR nova Traceback (most recent call last):
Sep 28 12:33:51 ctl02 nova-api[2679]: 2017-09-28 12:33:51.727 2679 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:33:51 ctl02 nova-api[2679]: 2017-09-28 12:33:51.727 2679 ERROR nova     sys.exit(main())
Sep 28 12:33:51 ctl02 nova-api[2679]: 2017-09-28 12:33:51.727 2679 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:33:51 ctl02 nova-api[2679]: 2017-09-28 12:33:51.727 2679 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:33:51 ctl02 nova-api[2679]: 2017-09-28 12:33:51.727 2679 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:33:51 ctl02 nova-api[2679]: 2017-09-28 12:33:51.727 2679 ERROR nova     max_url_len=max_url_len)
Sep 28 12:33:51 ctl02 nova-api[2679]: 2017-09-28 12:33:51.727 2679 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:33:51 ctl02 nova-api[2679]: 2017-09-28 12:33:51.727 2679 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:33:51 ctl02 nova-api[2679]: 2017-09-28 12:33:51.727 2679 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:33:51 ctl02 nova-api[2679]: 2017-09-28 12:33:51.727 2679 ERROR nova     sock.listen(backlog)
Sep 28 12:33:51 ctl02 nova-api[2679]: 2017-09-28 12:33:51.727 2679 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:33:51 ctl02 nova-api[2679]: 2017-09-28 12:33:51.727 2679 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:33:51 ctl02 nova-api[2679]: 2017-09-28 12:33:51.727 2679 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:33:51 ctl02 nova-api[2679]: 2017-09-28 12:33:51.727 2679 ERROR nova
Sep 28 12:33:51 ctl02 neutron-server[30536]: 2017-09-28 12:33:51.753 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:33:51] "OPTIONS / HTTP/1.0" 200 262 0.000457
Sep 28 12:33:51 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:33:51 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:33:51 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:33:51 ctl02 nova-consoleauth[5433]: 2017-09-28 12:33:51.862 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:33:51 ctl02 neutron-server[30536]: 2017-09-28 12:33:51.951 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:33:51] "OPTIONS / HTTP/1.0" 200 262 0.000537
Sep 28 12:33:52 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb3bad229)
Sep 28 12:33:52 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:33:52 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:33:52 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:33:52 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:33:53 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb3bad229)
Sep 28 12:33:53 ctl02 glance-api[29183]: 2017-09-28 12:33:53.547 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:33:53] "OPTIONS / HTTP/1.0" 200 134 0.000552
Sep 28 12:33:53 ctl02 nova-api[2697]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:33:53 ctl02 nova-api[2697]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:33:53 ctl02 heat-engine[12803]: 2017-09-28 12:33:53.926 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:33:53 ctl02 heat-engine[12803]: 2017-09-28 12:33:53.926 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:33:53 ctl02 heat-engine[12803]: 2017-09-28 12:33:53.927 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:33:53 ctl02 heat-engine[12803]: 2017-09-28 12:33:53.929 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:33:53 ctl02 nova-api[2697]: 2017-09-28 12:33:53.985 2697 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:33:53 ctl02 nova-api[2697]: 2017-09-28 12:33:53.986 2697 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:33:53 ctl02 nova-api[2697]: 2017-09-28 12:33:53.986 2697 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:33:53 ctl02 nova-api[2697]: 2017-09-28 12:33:53.986 2697 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:33:53 ctl02 nova-api[2697]: 2017-09-28 12:33:53.986 2697 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:33:53 ctl02 nova-api[2697]: 2017-09-28 12:33:53.986 2697 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:33:53 ctl02 nova-api[2697]: 2017-09-28 12:33:53.986 2697 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:33:53 ctl02 nova-api[2697]: 2017-09-28 12:33:53.986 2697 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:33:53 ctl02 nova-api[2697]: 2017-09-28 12:33:53.986 2697 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:33:53 ctl02 nova-api[2697]: 2017-09-28 12:33:53.986 2697 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:33:53 ctl02 nova-api[2697]: 2017-09-28 12:33:53.986 2697 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:33:53 ctl02 nova-api[2697]: 2017-09-28 12:33:53.986 2697 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:33:53 ctl02 nova-api[2697]: 2017-09-28 12:33:53.986 2697 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:33:53 ctl02 nova-api[2697]: 2017-09-28 12:33:53.986 2697 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:33:53 ctl02 nova-api[2697]: 2017-09-28 12:33:53.986 2697 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:33:53 ctl02 nova-api[2697]: 2017-09-28 12:33:53.986 2697 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:33:53 ctl02 nova-api[2697]: 2017-09-28 12:33:53.986 2697 ERROR nova.wsgi     self.filename))
Sep 28 12:33:53 ctl02 nova-api[2697]: 2017-09-28 12:33:53.986 2697 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:33:53 ctl02 nova-api[2697]: 2017-09-28 12:33:53.986 2697 ERROR nova.wsgi
Sep 28 12:33:53 ctl02 nova-api[2697]: 2017-09-28 12:33:53.987 2697 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:33:54 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb3bad229)
Sep 28 12:33:54 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:33:54.109 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:33:54] "OPTIONS / HTTP/1.0" 200 134 0.000406
Sep 28 12:33:54 ctl02 nova-api[2697]: 2017-09-28 12:33:54.114 2697 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:33:54 ctl02 nova-api[2697]: 2017-09-28 12:33:54.329 2697 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:33:54 ctl02 nova-api[2697]: 2017-09-28 12:33:54.331 2697 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:33:54 ctl02 nova-api[2697]: 2017-09-28 12:33:54.332 2697 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:33:54 ctl02 nova-api[2697]: 2017-09-28 12:33:54.332 2697 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:33:54 ctl02 nova-api[2697]: 2017-09-28 12:33:54.461 2697 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:33:54 ctl02 nova-api[2697]: 2017-09-28 12:33:54.462 2697 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:33:54 ctl02 nova-api[2697]: 2017-09-28 12:33:54.463 2697 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:33:54 ctl02 nova-api[2697]: 2017-09-28 12:33:54.463 2697 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:33:54 ctl02 nova-api[2697]: 2017-09-28 12:33:54.466 2697 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:33:54 ctl02 nova-api[2697]: 2017-09-28 12:33:54.466 2697 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:33:54 ctl02 nova-api[2697]: 2017-09-28 12:33:54.466 2697 ERROR nova Traceback (most recent call last):
Sep 28 12:33:54 ctl02 nova-api[2697]: 2017-09-28 12:33:54.466 2697 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:33:54 ctl02 nova-api[2697]: 2017-09-28 12:33:54.466 2697 ERROR nova     sys.exit(main())
Sep 28 12:33:54 ctl02 nova-api[2697]: 2017-09-28 12:33:54.466 2697 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:33:54 ctl02 nova-api[2697]: 2017-09-28 12:33:54.466 2697 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:33:54 ctl02 nova-api[2697]: 2017-09-28 12:33:54.466 2697 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:33:54 ctl02 nova-api[2697]: 2017-09-28 12:33:54.466 2697 ERROR nova     max_url_len=max_url_len)
Sep 28 12:33:54 ctl02 nova-api[2697]: 2017-09-28 12:33:54.466 2697 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:33:54 ctl02 nova-api[2697]: 2017-09-28 12:33:54.466 2697 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:33:54 ctl02 nova-api[2697]: 2017-09-28 12:33:54.466 2697 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:33:54 ctl02 nova-api[2697]: 2017-09-28 12:33:54.466 2697 ERROR nova     sock.listen(backlog)
Sep 28 12:33:54 ctl02 nova-api[2697]: 2017-09-28 12:33:54.466 2697 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:33:54 ctl02 nova-api[2697]: 2017-09-28 12:33:54.466 2697 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:33:54 ctl02 nova-api[2697]: 2017-09-28 12:33:54.466 2697 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:33:54 ctl02 nova-api[2697]: 2017-09-28 12:33:54.466 2697 ERROR nova
Sep 28 12:33:54 ctl02 glance-api[29183]: 2017-09-28 12:33:54.489 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:33:54] "OPTIONS / HTTP/1.0" 200 134 0.000584
Sep 28 12:33:54 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:33:54 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:33:54 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:33:54 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:33:54 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:33:54 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:33:54 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:33:54 ctl02 nova-scheduler[5620]: 2017-09-28 12:33:54.904 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:33:55 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb3bad229)
Sep 28 12:33:55 ctl02 heat-api[13008]: 2017-09-28 12:33:55.181 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:33:55] "OPTIONS / HTTP/1.0" 200 134 0.000543
Sep 28 12:33:55 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:33:55.564 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:33:55] "OPTIONS / HTTP/1.0" 200 134 0.000435
Sep 28 12:33:56 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb3bad229)
Sep 28 12:33:56 ctl02 nova-api[2715]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:33:56 ctl02 nova-api[2715]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:33:56 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:33:56.538 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:33:56] "OPTIONS / HTTP/1.0" 200 134 0.000410
Sep 28 12:33:56 ctl02 nova-api[2715]: 2017-09-28 12:33:56.711 2715 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:33:56 ctl02 nova-api[2715]: 2017-09-28 12:33:56.713 2715 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:33:56 ctl02 nova-api[2715]: 2017-09-28 12:33:56.713 2715 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:33:56 ctl02 nova-api[2715]: 2017-09-28 12:33:56.713 2715 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:33:56 ctl02 nova-api[2715]: 2017-09-28 12:33:56.713 2715 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:33:56 ctl02 nova-api[2715]: 2017-09-28 12:33:56.713 2715 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:33:56 ctl02 nova-api[2715]: 2017-09-28 12:33:56.713 2715 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:33:56 ctl02 nova-api[2715]: 2017-09-28 12:33:56.713 2715 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:33:56 ctl02 nova-api[2715]: 2017-09-28 12:33:56.713 2715 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:33:56 ctl02 nova-api[2715]: 2017-09-28 12:33:56.713 2715 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:33:56 ctl02 nova-api[2715]: 2017-09-28 12:33:56.713 2715 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:33:56 ctl02 nova-api[2715]: 2017-09-28 12:33:56.713 2715 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:33:56 ctl02 nova-api[2715]: 2017-09-28 12:33:56.713 2715 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:33:56 ctl02 nova-api[2715]: 2017-09-28 12:33:56.713 2715 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:33:56 ctl02 nova-api[2715]: 2017-09-28 12:33:56.713 2715 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:33:56 ctl02 nova-api[2715]: 2017-09-28 12:33:56.713 2715 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:33:56 ctl02 nova-api[2715]: 2017-09-28 12:33:56.713 2715 ERROR nova.wsgi     self.filename))
Sep 28 12:33:56 ctl02 nova-api[2715]: 2017-09-28 12:33:56.713 2715 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:33:56 ctl02 nova-api[2715]: 2017-09-28 12:33:56.713 2715 ERROR nova.wsgi
Sep 28 12:33:56 ctl02 nova-api[2715]: 2017-09-28 12:33:56.715 2715 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:33:56 ctl02 heat-api-cfn[13300]: 2017-09-28 12:33:56.825 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:33:56] "OPTIONS / HTTP/1.0" 200 134 0.000438
Sep 28 12:33:56 ctl02 nova-api[2715]: 2017-09-28 12:33:56.843 2715 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:33:57 ctl02 nova-api[2715]: 2017-09-28 12:33:57.063 2715 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:33:57 ctl02 nova-api[2715]: 2017-09-28 12:33:57.066 2715 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:33:57 ctl02 nova-api[2715]: 2017-09-28 12:33:57.066 2715 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:33:57 ctl02 nova-api[2715]: 2017-09-28 12:33:57.067 2715 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:33:57 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb3bad229)
Sep 28 12:33:57 ctl02 nova-api[2715]: 2017-09-28 12:33:57.196 2715 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:33:57 ctl02 nova-api[2715]: 2017-09-28 12:33:57.197 2715 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:33:57 ctl02 nova-api[2715]: 2017-09-28 12:33:57.198 2715 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:33:57 ctl02 nova-api[2715]: 2017-09-28 12:33:57.198 2715 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:33:57 ctl02 nova-api[2715]: 2017-09-28 12:33:57.201 2715 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:33:57 ctl02 nova-api[2715]: 2017-09-28 12:33:57.201 2715 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:33:57 ctl02 nova-api[2715]: 2017-09-28 12:33:57.201 2715 ERROR nova Traceback (most recent call last):
Sep 28 12:33:57 ctl02 nova-api[2715]: 2017-09-28 12:33:57.201 2715 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:33:57 ctl02 nova-api[2715]: 2017-09-28 12:33:57.201 2715 ERROR nova     sys.exit(main())
Sep 28 12:33:57 ctl02 nova-api[2715]: 2017-09-28 12:33:57.201 2715 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:33:57 ctl02 nova-api[2715]: 2017-09-28 12:33:57.201 2715 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:33:57 ctl02 nova-api[2715]: 2017-09-28 12:33:57.201 2715 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:33:57 ctl02 nova-api[2715]: 2017-09-28 12:33:57.201 2715 ERROR nova     max_url_len=max_url_len)
Sep 28 12:33:57 ctl02 nova-api[2715]: 2017-09-28 12:33:57.201 2715 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:33:57 ctl02 nova-api[2715]: 2017-09-28 12:33:57.201 2715 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:33:57 ctl02 nova-api[2715]: 2017-09-28 12:33:57.201 2715 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:33:57 ctl02 nova-api[2715]: 2017-09-28 12:33:57.201 2715 ERROR nova     sock.listen(backlog)
Sep 28 12:33:57 ctl02 nova-api[2715]: 2017-09-28 12:33:57.201 2715 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:33:57 ctl02 nova-api[2715]: 2017-09-28 12:33:57.201 2715 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:33:57 ctl02 nova-api[2715]: 2017-09-28 12:33:57.201 2715 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:33:57 ctl02 nova-api[2715]: 2017-09-28 12:33:57.201 2715 ERROR nova
Sep 28 12:33:57 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:33:57 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:33:57 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:33:57 ctl02 heat-api[13008]: 2017-09-28 12:33:57.506 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:33:57] "OPTIONS / HTTP/1.0" 200 134 0.000661
Sep 28 12:33:57 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:33:57 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:33:57 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:33:57 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:33:58 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb3bad229)
Sep 28 12:33:58 ctl02 heat-api-cfn[13300]: 2017-09-28 12:33:58.781 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:33:58] "OPTIONS / HTTP/1.0" 200 134 0.000512
Sep 28 12:33:59 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb3bad229)
Sep 28 12:33:59 ctl02 nova-api[2733]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:33:59 ctl02 nova-api[2733]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:33:59 ctl02 heat-api[13008]: 2017-09-28 12:33:59.540 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:33:59] "OPTIONS / HTTP/1.0" 200 134 0.000626
Sep 28 12:33:59 ctl02 nova-api[2733]: 2017-09-28 12:33:59.543 2733 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:33:59 ctl02 nova-api[2733]: 2017-09-28 12:33:59.545 2733 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:33:59 ctl02 nova-api[2733]: 2017-09-28 12:33:59.545 2733 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:33:59 ctl02 nova-api[2733]: 2017-09-28 12:33:59.545 2733 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:33:59 ctl02 nova-api[2733]: 2017-09-28 12:33:59.545 2733 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:33:59 ctl02 nova-api[2733]: 2017-09-28 12:33:59.545 2733 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:33:59 ctl02 nova-api[2733]: 2017-09-28 12:33:59.545 2733 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:33:59 ctl02 nova-api[2733]: 2017-09-28 12:33:59.545 2733 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:33:59 ctl02 nova-api[2733]: 2017-09-28 12:33:59.545 2733 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:33:59 ctl02 nova-api[2733]: 2017-09-28 12:33:59.545 2733 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:33:59 ctl02 nova-api[2733]: 2017-09-28 12:33:59.545 2733 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:33:59 ctl02 nova-api[2733]: 2017-09-28 12:33:59.545 2733 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:33:59 ctl02 nova-api[2733]: 2017-09-28 12:33:59.545 2733 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:33:59 ctl02 nova-api[2733]: 2017-09-28 12:33:59.545 2733 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:33:59 ctl02 nova-api[2733]: 2017-09-28 12:33:59.545 2733 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:33:59 ctl02 nova-api[2733]: 2017-09-28 12:33:59.545 2733 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:33:59 ctl02 nova-api[2733]: 2017-09-28 12:33:59.545 2733 ERROR nova.wsgi     self.filename))
Sep 28 12:33:59 ctl02 nova-api[2733]: 2017-09-28 12:33:59.545 2733 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:33:59 ctl02 nova-api[2733]: 2017-09-28 12:33:59.545 2733 ERROR nova.wsgi
Sep 28 12:33:59 ctl02 nova-api[2733]: 2017-09-28 12:33:59.548 2733 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:33:59 ctl02 nova-api[2733]: 2017-09-28 12:33:59.681 2733 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:33:59 ctl02 nova-api[2733]: 2017-09-28 12:33:59.930 2733 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:33:59 ctl02 nova-api[2733]: 2017-09-28 12:33:59.933 2733 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:33:59 ctl02 nova-api[2733]: 2017-09-28 12:33:59.934 2733 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:33:59 ctl02 nova-api[2733]: 2017-09-28 12:33:59.934 2733 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:34:00 ctl02 nova-api[2733]: 2017-09-28 12:34:00.068 2733 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:34:00 ctl02 nova-api[2733]: 2017-09-28 12:34:00.071 2733 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:34:00 ctl02 nova-api[2733]: 2017-09-28 12:34:00.071 2733 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:34:00 ctl02 nova-api[2733]: 2017-09-28 12:34:00.072 2733 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:34:00 ctl02 nova-api[2733]: 2017-09-28 12:34:00.075 2733 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:34:00 ctl02 nova-api[2733]: 2017-09-28 12:34:00.076 2733 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:34:00 ctl02 nova-api[2733]: 2017-09-28 12:34:00.076 2733 ERROR nova Traceback (most recent call last):
Sep 28 12:34:00 ctl02 nova-api[2733]: 2017-09-28 12:34:00.076 2733 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:34:00 ctl02 nova-api[2733]: 2017-09-28 12:34:00.076 2733 ERROR nova     sys.exit(main())
Sep 28 12:34:00 ctl02 nova-api[2733]: 2017-09-28 12:34:00.076 2733 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:34:00 ctl02 nova-api[2733]: 2017-09-28 12:34:00.076 2733 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:34:00 ctl02 nova-api[2733]: 2017-09-28 12:34:00.076 2733 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:34:00 ctl02 nova-api[2733]: 2017-09-28 12:34:00.076 2733 ERROR nova     max_url_len=max_url_len)
Sep 28 12:34:00 ctl02 nova-api[2733]: 2017-09-28 12:34:00.076 2733 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:34:00 ctl02 nova-api[2733]: 2017-09-28 12:34:00.076 2733 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:34:00 ctl02 nova-api[2733]: 2017-09-28 12:34:00.076 2733 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:34:00 ctl02 nova-api[2733]: 2017-09-28 12:34:00.076 2733 ERROR nova     sock.listen(backlog)
Sep 28 12:34:00 ctl02 nova-api[2733]: 2017-09-28 12:34:00.076 2733 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:34:00 ctl02 nova-api[2733]: 2017-09-28 12:34:00.076 2733 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:34:00 ctl02 nova-api[2733]: 2017-09-28 12:34:00.076 2733 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:34:00 ctl02 nova-api[2733]: 2017-09-28 12:34:00.076 2733 ERROR nova
Sep 28 12:34:00 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb3bad229)
Sep 28 12:34:00 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:34:00 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:34:00 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:34:00 ctl02 neutron-server[30536]: 2017-09-28 12:34:00.326 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:34:00] "OPTIONS / HTTP/1.0" 200 262 0.000546
Sep 28 12:34:00 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:34:00 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:34:00 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:34:00 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:34:01 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:34:01 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:34:01 ctl02 glance-api[29183]: 2017-09-28 12:34:01.353 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:34:01] "OPTIONS / HTTP/1.0" 200 134 0.000663
Sep 28 12:34:01 ctl02 neutron-server[30536]: 2017-09-28 12:34:01.577 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:34:01] "OPTIONS / HTTP/1.0" 200 262 0.000540
Sep 28 12:34:01 ctl02 heat-api-cfn[13300]: 2017-09-28 12:34:01.908 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:34:01] "OPTIONS / HTTP/1.0" 200 134 0.000685
Sep 28 12:34:02 ctl02 nova-api[2751]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:34:02 ctl02 nova-api[2751]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:34:02 ctl02 neutron-server[30536]: 2017-09-28 12:34:02.125 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:34:02] "OPTIONS / HTTP/1.0" 200 262 0.000518
Sep 28 12:34:02 ctl02 nova-api[2751]: 2017-09-28 12:34:02.269 2751 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:34:02 ctl02 nova-api[2751]: 2017-09-28 12:34:02.270 2751 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:34:02 ctl02 nova-api[2751]: 2017-09-28 12:34:02.270 2751 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:34:02 ctl02 nova-api[2751]: 2017-09-28 12:34:02.270 2751 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:34:02 ctl02 nova-api[2751]: 2017-09-28 12:34:02.270 2751 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:34:02 ctl02 nova-api[2751]: 2017-09-28 12:34:02.270 2751 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:34:02 ctl02 nova-api[2751]: 2017-09-28 12:34:02.270 2751 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:34:02 ctl02 nova-api[2751]: 2017-09-28 12:34:02.270 2751 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:34:02 ctl02 nova-api[2751]: 2017-09-28 12:34:02.270 2751 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:34:02 ctl02 nova-api[2751]: 2017-09-28 12:34:02.270 2751 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:34:02 ctl02 nova-api[2751]: 2017-09-28 12:34:02.270 2751 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:34:02 ctl02 nova-api[2751]: 2017-09-28 12:34:02.270 2751 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:34:02 ctl02 nova-api[2751]: 2017-09-28 12:34:02.270 2751 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:34:02 ctl02 nova-api[2751]: 2017-09-28 12:34:02.270 2751 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:34:02 ctl02 nova-api[2751]: 2017-09-28 12:34:02.270 2751 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:34:02 ctl02 nova-api[2751]: 2017-09-28 12:34:02.270 2751 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:34:02 ctl02 nova-api[2751]: 2017-09-28 12:34:02.270 2751 ERROR nova.wsgi     self.filename))
Sep 28 12:34:02 ctl02 nova-api[2751]: 2017-09-28 12:34:02.270 2751 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:34:02 ctl02 nova-api[2751]: 2017-09-28 12:34:02.270 2751 ERROR nova.wsgi
Sep 28 12:34:02 ctl02 nova-api[2751]: 2017-09-28 12:34:02.272 2751 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:34:02 ctl02 nova-api[2751]: 2017-09-28 12:34:02.405 2751 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:34:02 ctl02 nova-api[2751]: 2017-09-28 12:34:02.648 2751 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:34:02 ctl02 nova-api[2751]: 2017-09-28 12:34:02.651 2751 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:34:02 ctl02 nova-api[2751]: 2017-09-28 12:34:02.651 2751 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:34:02 ctl02 nova-api[2751]: 2017-09-28 12:34:02.652 2751 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:34:02 ctl02 nova-api[2751]: 2017-09-28 12:34:02.785 2751 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:34:02 ctl02 nova-api[2751]: 2017-09-28 12:34:02.787 2751 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:34:02 ctl02 nova-api[2751]: 2017-09-28 12:34:02.788 2751 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:34:02 ctl02 nova-api[2751]: 2017-09-28 12:34:02.788 2751 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:34:02 ctl02 nova-api[2751]: 2017-09-28 12:34:02.792 2751 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:34:02 ctl02 nova-api[2751]: 2017-09-28 12:34:02.792 2751 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:34:02 ctl02 nova-api[2751]: 2017-09-28 12:34:02.792 2751 ERROR nova Traceback (most recent call last):
Sep 28 12:34:02 ctl02 nova-api[2751]: 2017-09-28 12:34:02.792 2751 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:34:02 ctl02 nova-api[2751]: 2017-09-28 12:34:02.792 2751 ERROR nova     sys.exit(main())
Sep 28 12:34:02 ctl02 nova-api[2751]: 2017-09-28 12:34:02.792 2751 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:34:02 ctl02 nova-api[2751]: 2017-09-28 12:34:02.792 2751 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:34:02 ctl02 nova-api[2751]: 2017-09-28 12:34:02.792 2751 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:34:02 ctl02 nova-api[2751]: 2017-09-28 12:34:02.792 2751 ERROR nova     max_url_len=max_url_len)
Sep 28 12:34:02 ctl02 nova-api[2751]: 2017-09-28 12:34:02.792 2751 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:34:02 ctl02 nova-api[2751]: 2017-09-28 12:34:02.792 2751 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:34:02 ctl02 nova-api[2751]: 2017-09-28 12:34:02.792 2751 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:34:02 ctl02 nova-api[2751]: 2017-09-28 12:34:02.792 2751 ERROR nova     sock.listen(backlog)
Sep 28 12:34:02 ctl02 nova-api[2751]: 2017-09-28 12:34:02.792 2751 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:34:02 ctl02 nova-api[2751]: 2017-09-28 12:34:02.792 2751 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:34:02 ctl02 nova-api[2751]: 2017-09-28 12:34:02.792 2751 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:34:02 ctl02 nova-api[2751]: 2017-09-28 12:34:02.792 2751 ERROR nova
Sep 28 12:34:02 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:34:02 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:34:02 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:34:03 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:34:03 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:34:03 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:34:03 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:34:03 ctl02 glance-api[29183]: 2017-09-28 12:34:03.701 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:34:03] "OPTIONS / HTTP/1.0" 200 134 0.000661
Sep 28 12:34:04 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:34:04.244 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:34:04] "OPTIONS / HTTP/1.0" 200 134 0.000478
Sep 28 12:34:04 ctl02 glance-api[29183]: 2017-09-28 12:34:04.565 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:34:04] "OPTIONS / HTTP/1.0" 200 134 0.000667
Sep 28 12:34:04 ctl02 nova-api[2774]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:34:04 ctl02 nova-api[2774]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:34:04 ctl02 nova-api[2774]: 2017-09-28 12:34:04.982 2774 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:34:04 ctl02 nova-api[2774]: 2017-09-28 12:34:04.984 2774 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:34:04 ctl02 nova-api[2774]: 2017-09-28 12:34:04.984 2774 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:34:04 ctl02 nova-api[2774]: 2017-09-28 12:34:04.984 2774 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:34:04 ctl02 nova-api[2774]: 2017-09-28 12:34:04.984 2774 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:34:04 ctl02 nova-api[2774]: 2017-09-28 12:34:04.984 2774 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:34:04 ctl02 nova-api[2774]: 2017-09-28 12:34:04.984 2774 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:34:04 ctl02 nova-api[2774]: 2017-09-28 12:34:04.984 2774 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:34:04 ctl02 nova-api[2774]: 2017-09-28 12:34:04.984 2774 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:34:04 ctl02 nova-api[2774]: 2017-09-28 12:34:04.984 2774 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:34:04 ctl02 nova-api[2774]: 2017-09-28 12:34:04.984 2774 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:34:04 ctl02 nova-api[2774]: 2017-09-28 12:34:04.984 2774 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:34:04 ctl02 nova-api[2774]: 2017-09-28 12:34:04.984 2774 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:34:04 ctl02 nova-api[2774]: 2017-09-28 12:34:04.984 2774 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:34:04 ctl02 nova-api[2774]: 2017-09-28 12:34:04.984 2774 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:34:04 ctl02 nova-api[2774]: 2017-09-28 12:34:04.984 2774 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:34:04 ctl02 nova-api[2774]: 2017-09-28 12:34:04.984 2774 ERROR nova.wsgi     self.filename))
Sep 28 12:34:04 ctl02 nova-api[2774]: 2017-09-28 12:34:04.984 2774 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:34:04 ctl02 nova-api[2774]: 2017-09-28 12:34:04.984 2774 ERROR nova.wsgi
Sep 28 12:34:04 ctl02 nova-api[2774]: 2017-09-28 12:34:04.986 2774 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:34:05 ctl02 nova-api[2774]: 2017-09-28 12:34:05.117 2774 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:34:05 ctl02 nova-api[2774]: 2017-09-28 12:34:05.363 2774 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:34:05 ctl02 nova-api[2774]: 2017-09-28 12:34:05.367 2774 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:34:05 ctl02 nova-api[2774]: 2017-09-28 12:34:05.367 2774 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:34:05 ctl02 nova-api[2774]: 2017-09-28 12:34:05.367 2774 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:34:05 ctl02 heat-api[13008]: 2017-09-28 12:34:05.398 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:34:05] "OPTIONS / HTTP/1.0" 200 134 0.000582
Sep 28 12:34:05 ctl02 nova-api[2774]: 2017-09-28 12:34:05.501 2774 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:34:05 ctl02 nova-api[2774]: 2017-09-28 12:34:05.503 2774 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:34:05 ctl02 nova-api[2774]: 2017-09-28 12:34:05.504 2774 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:34:05 ctl02 nova-api[2774]: 2017-09-28 12:34:05.504 2774 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:34:05 ctl02 nova-api[2774]: 2017-09-28 12:34:05.508 2774 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:34:05 ctl02 nova-api[2774]: 2017-09-28 12:34:05.508 2774 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:34:05 ctl02 nova-api[2774]: 2017-09-28 12:34:05.508 2774 ERROR nova Traceback (most recent call last):
Sep 28 12:34:05 ctl02 nova-api[2774]: 2017-09-28 12:34:05.508 2774 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:34:05 ctl02 nova-api[2774]: 2017-09-28 12:34:05.508 2774 ERROR nova     sys.exit(main())
Sep 28 12:34:05 ctl02 nova-api[2774]: 2017-09-28 12:34:05.508 2774 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:34:05 ctl02 nova-api[2774]: 2017-09-28 12:34:05.508 2774 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:34:05 ctl02 nova-api[2774]: 2017-09-28 12:34:05.508 2774 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:34:05 ctl02 nova-api[2774]: 2017-09-28 12:34:05.508 2774 ERROR nova     max_url_len=max_url_len)
Sep 28 12:34:05 ctl02 nova-api[2774]: 2017-09-28 12:34:05.508 2774 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:34:05 ctl02 nova-api[2774]: 2017-09-28 12:34:05.508 2774 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:34:05 ctl02 nova-api[2774]: 2017-09-28 12:34:05.508 2774 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:34:05 ctl02 nova-api[2774]: 2017-09-28 12:34:05.508 2774 ERROR nova     sock.listen(backlog)
Sep 28 12:34:05 ctl02 nova-api[2774]: 2017-09-28 12:34:05.508 2774 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:34:05 ctl02 nova-api[2774]: 2017-09-28 12:34:05.508 2774 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:34:05 ctl02 nova-api[2774]: 2017-09-28 12:34:05.508 2774 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:34:05 ctl02 nova-api[2774]: 2017-09-28 12:34:05.508 2774 ERROR nova
Sep 28 12:34:05 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:34:05.660 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:34:05] "OPTIONS / HTTP/1.0" 200 134 0.000480
Sep 28 12:34:05 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:34:05 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:34:05 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:34:05 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:34:05 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:34:05 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:34:05 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:34:06 ctl02 neutron-server[30536]: 2017-09-28 12:34:06.383 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 2 dead agents out of 6:
Sep 28 12:34:06 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:34:06 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:32:08 cmp002
Sep 28 12:34:06 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:32:40 cmp002
Sep 28 12:34:06 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:34:06.848 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:34:06] "OPTIONS / HTTP/1.0" 200 134 0.000400
Sep 28 12:34:07 ctl02 heat-api-cfn[13300]: 2017-09-28 12:34:07.038 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:34:07] "OPTIONS / HTTP/1.0" 200 134 0.000539
Sep 28 12:34:07 ctl02 heat-api[13008]: 2017-09-28 12:34:07.542 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:34:07] "OPTIONS / HTTP/1.0" 200 134 0.000601
Sep 28 12:34:07 ctl02 nova-api[2792]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:34:07 ctl02 nova-api[2792]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:34:07 ctl02 nova-api[2792]: 2017-09-28 12:34:07.784 2792 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:34:07 ctl02 nova-api[2792]: 2017-09-28 12:34:07.785 2792 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:34:07 ctl02 nova-api[2792]: 2017-09-28 12:34:07.785 2792 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:34:07 ctl02 nova-api[2792]: 2017-09-28 12:34:07.785 2792 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:34:07 ctl02 nova-api[2792]: 2017-09-28 12:34:07.785 2792 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:34:07 ctl02 nova-api[2792]: 2017-09-28 12:34:07.785 2792 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:34:07 ctl02 nova-api[2792]: 2017-09-28 12:34:07.785 2792 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:34:07 ctl02 nova-api[2792]: 2017-09-28 12:34:07.785 2792 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:34:07 ctl02 nova-api[2792]: 2017-09-28 12:34:07.785 2792 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:34:07 ctl02 nova-api[2792]: 2017-09-28 12:34:07.785 2792 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:34:07 ctl02 nova-api[2792]: 2017-09-28 12:34:07.785 2792 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:34:07 ctl02 nova-api[2792]: 2017-09-28 12:34:07.785 2792 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:34:07 ctl02 nova-api[2792]: 2017-09-28 12:34:07.785 2792 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:34:07 ctl02 nova-api[2792]: 2017-09-28 12:34:07.785 2792 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:34:07 ctl02 nova-api[2792]: 2017-09-28 12:34:07.785 2792 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:34:07 ctl02 nova-api[2792]: 2017-09-28 12:34:07.785 2792 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:34:07 ctl02 nova-api[2792]: 2017-09-28 12:34:07.785 2792 ERROR nova.wsgi     self.filename))
Sep 28 12:34:07 ctl02 nova-api[2792]: 2017-09-28 12:34:07.785 2792 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:34:07 ctl02 nova-api[2792]: 2017-09-28 12:34:07.785 2792 ERROR nova.wsgi
Sep 28 12:34:07 ctl02 nova-api[2792]: 2017-09-28 12:34:07.786 2792 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:34:07 ctl02 nova-api[2792]: 2017-09-28 12:34:07.919 2792 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:34:08 ctl02 nova-api[2792]: 2017-09-28 12:34:08.172 2792 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:34:08 ctl02 nova-api[2792]: 2017-09-28 12:34:08.174 2792 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:34:08 ctl02 nova-api[2792]: 2017-09-28 12:34:08.174 2792 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:34:08 ctl02 nova-api[2792]: 2017-09-28 12:34:08.175 2792 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:34:08 ctl02 nova-api[2792]: 2017-09-28 12:34:08.306 2792 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:34:08 ctl02 nova-api[2792]: 2017-09-28 12:34:08.308 2792 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:34:08 ctl02 nova-api[2792]: 2017-09-28 12:34:08.308 2792 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:34:08 ctl02 nova-api[2792]: 2017-09-28 12:34:08.309 2792 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:34:08 ctl02 nova-api[2792]: 2017-09-28 12:34:08.312 2792 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:34:08 ctl02 nova-api[2792]: 2017-09-28 12:34:08.312 2792 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:34:08 ctl02 nova-api[2792]: 2017-09-28 12:34:08.312 2792 ERROR nova Traceback (most recent call last):
Sep 28 12:34:08 ctl02 nova-api[2792]: 2017-09-28 12:34:08.312 2792 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:34:08 ctl02 nova-api[2792]: 2017-09-28 12:34:08.312 2792 ERROR nova     sys.exit(main())
Sep 28 12:34:08 ctl02 nova-api[2792]: 2017-09-28 12:34:08.312 2792 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:34:08 ctl02 nova-api[2792]: 2017-09-28 12:34:08.312 2792 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:34:08 ctl02 nova-api[2792]: 2017-09-28 12:34:08.312 2792 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:34:08 ctl02 nova-api[2792]: 2017-09-28 12:34:08.312 2792 ERROR nova     max_url_len=max_url_len)
Sep 28 12:34:08 ctl02 nova-api[2792]: 2017-09-28 12:34:08.312 2792 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:34:08 ctl02 nova-api[2792]: 2017-09-28 12:34:08.312 2792 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:34:08 ctl02 nova-api[2792]: 2017-09-28 12:34:08.312 2792 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:34:08 ctl02 nova-api[2792]: 2017-09-28 12:34:08.312 2792 ERROR nova     sock.listen(backlog)
Sep 28 12:34:08 ctl02 nova-api[2792]: 2017-09-28 12:34:08.312 2792 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:34:08 ctl02 nova-api[2792]: 2017-09-28 12:34:08.312 2792 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:34:08 ctl02 nova-api[2792]: 2017-09-28 12:34:08.312 2792 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:34:08 ctl02 nova-api[2792]: 2017-09-28 12:34:08.312 2792 ERROR nova
Sep 28 12:34:08 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:34:08 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:34:08 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:34:08 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:34:08 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:34:08 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:34:08 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:34:08 ctl02 heat-api-cfn[13300]: 2017-09-28 12:34:08.865 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:34:08] "OPTIONS / HTTP/1.0" 200 134 0.000501
Sep 28 12:34:09 ctl02 heat-api[13008]: 2017-09-28 12:34:09.568 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:34:09] "OPTIONS / HTTP/1.0" 200 134 0.000686
Sep 28 12:34:09 ctl02 dhclient[600]: DHCPREQUEST of 192.168.11.25 on ens2 to 192.168.11.3 port 67 (xid=0x3415f07)
Sep 28 12:34:10 ctl02 dhclient[600]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 12:34:10 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 12:34:10 ctl02 ntp[2875]:  * Stopping NTP server ntpd
Sep 28 12:34:10 ctl02 ntp[2875]:    ...done.
Sep 28 12:34:10 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 12:34:10 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 12:34:10 ctl02 ntp[2885]:  * Starting NTP server ntpd
Sep 28 12:34:10 ctl02 ntpd[2893]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 12:34:10 ctl02 ntpd[2893]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -c /var/lib/ntp/ntp.conf.dhcp -u 108:112
Sep 28 12:34:10 ctl02 ntp[2885]:    ...done.
Sep 28 12:34:10 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 12:34:10 ctl02 neutron-server[30536]: 2017-09-28 12:34:10.183 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:34:10] "OPTIONS / HTTP/1.0" 200 262 0.000538
Sep 28 12:34:10 ctl02 ntpd[2896]: proto: precision = 0.045 usec (-24)
Sep 28 12:34:10 ctl02 ntpd[2896]: switching logging to file /var/log/ntp.log
Sep 28 12:34:10 ctl02 dhclient[600]: bound to 192.168.11.25 -- renewal in 234 seconds.
Sep 28 12:34:10 ctl02 nova-api[2810]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:34:10 ctl02 nova-api[2810]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:34:10 ctl02 nova-api[2810]: 2017-09-28 12:34:10.525 2810 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:34:10 ctl02 nova-api[2810]: 2017-09-28 12:34:10.526 2810 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:34:10 ctl02 nova-api[2810]: 2017-09-28 12:34:10.526 2810 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:34:10 ctl02 nova-api[2810]: 2017-09-28 12:34:10.526 2810 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:34:10 ctl02 nova-api[2810]: 2017-09-28 12:34:10.526 2810 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:34:10 ctl02 nova-api[2810]: 2017-09-28 12:34:10.526 2810 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:34:10 ctl02 nova-api[2810]: 2017-09-28 12:34:10.526 2810 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:34:10 ctl02 nova-api[2810]: 2017-09-28 12:34:10.526 2810 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:34:10 ctl02 nova-api[2810]: 2017-09-28 12:34:10.526 2810 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:34:10 ctl02 nova-api[2810]: 2017-09-28 12:34:10.526 2810 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:34:10 ctl02 nova-api[2810]: 2017-09-28 12:34:10.526 2810 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:34:10 ctl02 nova-api[2810]: 2017-09-28 12:34:10.526 2810 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:34:10 ctl02 nova-api[2810]: 2017-09-28 12:34:10.526 2810 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:34:10 ctl02 nova-api[2810]: 2017-09-28 12:34:10.526 2810 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:34:10 ctl02 nova-api[2810]: 2017-09-28 12:34:10.526 2810 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:34:10 ctl02 nova-api[2810]: 2017-09-28 12:34:10.526 2810 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:34:10 ctl02 nova-api[2810]: 2017-09-28 12:34:10.526 2810 ERROR nova.wsgi     self.filename))
Sep 28 12:34:10 ctl02 nova-api[2810]: 2017-09-28 12:34:10.526 2810 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:34:10 ctl02 nova-api[2810]: 2017-09-28 12:34:10.526 2810 ERROR nova.wsgi
Sep 28 12:34:10 ctl02 nova-api[2810]: 2017-09-28 12:34:10.528 2810 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:34:10 ctl02 nova-api[2810]: 2017-09-28 12:34:10.660 2810 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:34:10 ctl02 nova-api[2810]: 2017-09-28 12:34:10.906 2810 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:34:10 ctl02 nova-api[2810]: 2017-09-28 12:34:10.909 2810 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:34:10 ctl02 nova-api[2810]: 2017-09-28 12:34:10.909 2810 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:34:10 ctl02 nova-api[2810]: 2017-09-28 12:34:10.909 2810 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:34:11 ctl02 nova-api[2810]: 2017-09-28 12:34:11.041 2810 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:34:11 ctl02 nova-api[2810]: 2017-09-28 12:34:11.043 2810 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:34:11 ctl02 nova-api[2810]: 2017-09-28 12:34:11.043 2810 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:34:11 ctl02 nova-api[2810]: 2017-09-28 12:34:11.044 2810 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:34:11 ctl02 nova-api[2810]: 2017-09-28 12:34:11.047 2810 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:34:11 ctl02 nova-api[2810]: 2017-09-28 12:34:11.047 2810 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:34:11 ctl02 nova-api[2810]: 2017-09-28 12:34:11.047 2810 ERROR nova Traceback (most recent call last):
Sep 28 12:34:11 ctl02 nova-api[2810]: 2017-09-28 12:34:11.047 2810 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:34:11 ctl02 nova-api[2810]: 2017-09-28 12:34:11.047 2810 ERROR nova     sys.exit(main())
Sep 28 12:34:11 ctl02 nova-api[2810]: 2017-09-28 12:34:11.047 2810 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:34:11 ctl02 nova-api[2810]: 2017-09-28 12:34:11.047 2810 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:34:11 ctl02 nova-api[2810]: 2017-09-28 12:34:11.047 2810 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:34:11 ctl02 nova-api[2810]: 2017-09-28 12:34:11.047 2810 ERROR nova     max_url_len=max_url_len)
Sep 28 12:34:11 ctl02 nova-api[2810]: 2017-09-28 12:34:11.047 2810 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:34:11 ctl02 nova-api[2810]: 2017-09-28 12:34:11.047 2810 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:34:11 ctl02 nova-api[2810]: 2017-09-28 12:34:11.047 2810 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:34:11 ctl02 nova-api[2810]: 2017-09-28 12:34:11.047 2810 ERROR nova     sock.listen(backlog)
Sep 28 12:34:11 ctl02 nova-api[2810]: 2017-09-28 12:34:11.047 2810 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:34:11 ctl02 nova-api[2810]: 2017-09-28 12:34:11.047 2810 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:34:11 ctl02 nova-api[2810]: 2017-09-28 12:34:11.047 2810 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:34:11 ctl02 nova-api[2810]: 2017-09-28 12:34:11.047 2810 ERROR nova
Sep 28 12:34:11 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:34:11 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:34:11 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:34:11 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:34:11 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:34:11 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:34:11 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:34:11 ctl02 neutron-server[30536]: 2017-09-28 12:34:11.503 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:34:11] "OPTIONS / HTTP/1.0" 200 262 0.000552
Sep 28 12:34:11 ctl02 glance-api[29183]: 2017-09-28 12:34:11.610 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:34:11] "OPTIONS / HTTP/1.0" 200 134 0.000778
Sep 28 12:34:11 ctl02 heat-api-cfn[13300]: 2017-09-28 12:34:11.737 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:34:11] "OPTIONS / HTTP/1.0" 200 134 0.000527
Sep 28 12:34:11 ctl02 neutron-server[30536]: 2017-09-28 12:34:11.758 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:34:11] "OPTIONS / HTTP/1.0" 200 262 0.000509
Sep 28 12:34:13 ctl02 nova-api[2911]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:34:13 ctl02 nova-api[2911]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:34:13 ctl02 nova-api[2911]: 2017-09-28 12:34:13.277 2911 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:34:13 ctl02 nova-api[2911]: 2017-09-28 12:34:13.278 2911 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:34:13 ctl02 nova-api[2911]: 2017-09-28 12:34:13.278 2911 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:34:13 ctl02 nova-api[2911]: 2017-09-28 12:34:13.278 2911 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:34:13 ctl02 nova-api[2911]: 2017-09-28 12:34:13.278 2911 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:34:13 ctl02 nova-api[2911]: 2017-09-28 12:34:13.278 2911 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:34:13 ctl02 nova-api[2911]: 2017-09-28 12:34:13.278 2911 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:34:13 ctl02 nova-api[2911]: 2017-09-28 12:34:13.278 2911 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:34:13 ctl02 nova-api[2911]: 2017-09-28 12:34:13.278 2911 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:34:13 ctl02 nova-api[2911]: 2017-09-28 12:34:13.278 2911 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:34:13 ctl02 nova-api[2911]: 2017-09-28 12:34:13.278 2911 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:34:13 ctl02 nova-api[2911]: 2017-09-28 12:34:13.278 2911 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:34:13 ctl02 nova-api[2911]: 2017-09-28 12:34:13.278 2911 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:34:13 ctl02 nova-api[2911]: 2017-09-28 12:34:13.278 2911 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:34:13 ctl02 nova-api[2911]: 2017-09-28 12:34:13.278 2911 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:34:13 ctl02 nova-api[2911]: 2017-09-28 12:34:13.278 2911 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:34:13 ctl02 nova-api[2911]: 2017-09-28 12:34:13.278 2911 ERROR nova.wsgi     self.filename))
Sep 28 12:34:13 ctl02 nova-api[2911]: 2017-09-28 12:34:13.278 2911 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:34:13 ctl02 nova-api[2911]: 2017-09-28 12:34:13.278 2911 ERROR nova.wsgi
Sep 28 12:34:13 ctl02 nova-api[2911]: 2017-09-28 12:34:13.281 2911 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:34:13 ctl02 nova-api[2911]: 2017-09-28 12:34:13.412 2911 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:34:13 ctl02 nova-api[2911]: 2017-09-28 12:34:13.658 2911 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:34:13 ctl02 nova-api[2911]: 2017-09-28 12:34:13.661 2911 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:34:13 ctl02 nova-api[2911]: 2017-09-28 12:34:13.661 2911 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:34:13 ctl02 glance-api[29183]: 2017-09-28 12:34:13.661 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:34:13] "OPTIONS / HTTP/1.0" 200 134 0.000658
Sep 28 12:34:13 ctl02 nova-api[2911]: 2017-09-28 12:34:13.662 2911 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:34:13 ctl02 nova-api[2911]: 2017-09-28 12:34:13.793 2911 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:34:13 ctl02 nova-api[2911]: 2017-09-28 12:34:13.795 2911 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:34:13 ctl02 nova-api[2911]: 2017-09-28 12:34:13.796 2911 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:34:13 ctl02 nova-api[2911]: 2017-09-28 12:34:13.796 2911 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:34:13 ctl02 nova-api[2911]: 2017-09-28 12:34:13.800 2911 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:34:13 ctl02 nova-api[2911]: 2017-09-28 12:34:13.800 2911 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:34:13 ctl02 nova-api[2911]: 2017-09-28 12:34:13.800 2911 ERROR nova Traceback (most recent call last):
Sep 28 12:34:13 ctl02 nova-api[2911]: 2017-09-28 12:34:13.800 2911 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:34:13 ctl02 nova-api[2911]: 2017-09-28 12:34:13.800 2911 ERROR nova     sys.exit(main())
Sep 28 12:34:13 ctl02 nova-api[2911]: 2017-09-28 12:34:13.800 2911 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:34:13 ctl02 nova-api[2911]: 2017-09-28 12:34:13.800 2911 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:34:13 ctl02 nova-api[2911]: 2017-09-28 12:34:13.800 2911 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:34:13 ctl02 nova-api[2911]: 2017-09-28 12:34:13.800 2911 ERROR nova     max_url_len=max_url_len)
Sep 28 12:34:13 ctl02 nova-api[2911]: 2017-09-28 12:34:13.800 2911 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:34:13 ctl02 nova-api[2911]: 2017-09-28 12:34:13.800 2911 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:34:13 ctl02 nova-api[2911]: 2017-09-28 12:34:13.800 2911 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:34:13 ctl02 nova-api[2911]: 2017-09-28 12:34:13.800 2911 ERROR nova     sock.listen(backlog)
Sep 28 12:34:13 ctl02 nova-api[2911]: 2017-09-28 12:34:13.800 2911 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:34:13 ctl02 nova-api[2911]: 2017-09-28 12:34:13.800 2911 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:34:13 ctl02 nova-api[2911]: 2017-09-28 12:34:13.800 2911 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:34:13 ctl02 nova-api[2911]: 2017-09-28 12:34:13.800 2911 ERROR nova
Sep 28 12:34:13 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:34:13 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:34:13 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:34:14 ctl02 nova-cert[4860]: 2017-09-28 12:34:14.023 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:34:14 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:34:14 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:34:14 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:34:14 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:34:14 ctl02 glance-api[29183]: 2017-09-28 12:34:14.248 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:34:14] "OPTIONS / HTTP/1.0" 200 134 0.000648
Sep 28 12:34:14 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:34:14.285 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:34:14] "OPTIONS / HTTP/1.0" 200 134 0.000543
Sep 28 12:34:14 ctl02 nova-conductor[5056]: 2017-09-28 12:34:14.802 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:34:14 ctl02 nova-conductor[5056]: 2017-09-28 12:34:14.822 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:34:14 ctl02 nova-conductor[5056]: 2017-09-28 12:34:14.833 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:34:14 ctl02 nova-conductor[5056]: 2017-09-28 12:34:14.834 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:34:15 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:34:15.461 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:34:15] "OPTIONS / HTTP/1.0" 200 134 0.000537
Sep 28 12:34:15 ctl02 heat-api[13008]: 2017-09-28 12:34:15.516 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:34:15] "OPTIONS / HTTP/1.0" 200 134 0.000711
Sep 28 12:34:15 ctl02 nova-api[2928]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:34:15 ctl02 nova-api[2928]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:34:16 ctl02 nova-api[2928]: 2017-09-28 12:34:16.024 2928 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:34:16 ctl02 nova-api[2928]: 2017-09-28 12:34:16.025 2928 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:34:16 ctl02 nova-api[2928]: 2017-09-28 12:34:16.025 2928 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:34:16 ctl02 nova-api[2928]: 2017-09-28 12:34:16.025 2928 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:34:16 ctl02 nova-api[2928]: 2017-09-28 12:34:16.025 2928 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:34:16 ctl02 nova-api[2928]: 2017-09-28 12:34:16.025 2928 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:34:16 ctl02 nova-api[2928]: 2017-09-28 12:34:16.025 2928 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:34:16 ctl02 nova-api[2928]: 2017-09-28 12:34:16.025 2928 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:34:16 ctl02 nova-api[2928]: 2017-09-28 12:34:16.025 2928 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:34:16 ctl02 nova-api[2928]: 2017-09-28 12:34:16.025 2928 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:34:16 ctl02 nova-api[2928]: 2017-09-28 12:34:16.025 2928 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:34:16 ctl02 nova-api[2928]: 2017-09-28 12:34:16.025 2928 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:34:16 ctl02 nova-api[2928]: 2017-09-28 12:34:16.025 2928 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:34:16 ctl02 nova-api[2928]: 2017-09-28 12:34:16.025 2928 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:34:16 ctl02 nova-api[2928]: 2017-09-28 12:34:16.025 2928 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:34:16 ctl02 nova-api[2928]: 2017-09-28 12:34:16.025 2928 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:34:16 ctl02 nova-api[2928]: 2017-09-28 12:34:16.025 2928 ERROR nova.wsgi     self.filename))
Sep 28 12:34:16 ctl02 nova-api[2928]: 2017-09-28 12:34:16.025 2928 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:34:16 ctl02 nova-api[2928]: 2017-09-28 12:34:16.025 2928 ERROR nova.wsgi
Sep 28 12:34:16 ctl02 nova-api[2928]: 2017-09-28 12:34:16.026 2928 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:34:16 ctl02 nova-api[2928]: 2017-09-28 12:34:16.152 2928 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:34:16 ctl02 nova-api[2928]: 2017-09-28 12:34:16.374 2928 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:34:16 ctl02 nova-api[2928]: 2017-09-28 12:34:16.376 2928 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:34:16 ctl02 nova-api[2928]: 2017-09-28 12:34:16.377 2928 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:34:16 ctl02 nova-api[2928]: 2017-09-28 12:34:16.377 2928 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:34:16 ctl02 nova-api[2928]: 2017-09-28 12:34:16.507 2928 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:34:16 ctl02 nova-api[2928]: 2017-09-28 12:34:16.508 2928 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:34:16 ctl02 nova-api[2928]: 2017-09-28 12:34:16.509 2928 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:34:16 ctl02 nova-api[2928]: 2017-09-28 12:34:16.509 2928 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:34:16 ctl02 nova-api[2928]: 2017-09-28 12:34:16.512 2928 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:34:16 ctl02 nova-api[2928]: 2017-09-28 12:34:16.513 2928 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:34:16 ctl02 nova-api[2928]: 2017-09-28 12:34:16.513 2928 ERROR nova Traceback (most recent call last):
Sep 28 12:34:16 ctl02 nova-api[2928]: 2017-09-28 12:34:16.513 2928 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:34:16 ctl02 nova-api[2928]: 2017-09-28 12:34:16.513 2928 ERROR nova     sys.exit(main())
Sep 28 12:34:16 ctl02 nova-api[2928]: 2017-09-28 12:34:16.513 2928 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:34:16 ctl02 nova-api[2928]: 2017-09-28 12:34:16.513 2928 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:34:16 ctl02 nova-api[2928]: 2017-09-28 12:34:16.513 2928 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:34:16 ctl02 nova-api[2928]: 2017-09-28 12:34:16.513 2928 ERROR nova     max_url_len=max_url_len)
Sep 28 12:34:16 ctl02 nova-api[2928]: 2017-09-28 12:34:16.513 2928 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:34:16 ctl02 nova-api[2928]: 2017-09-28 12:34:16.513 2928 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:34:16 ctl02 nova-api[2928]: 2017-09-28 12:34:16.513 2928 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:34:16 ctl02 nova-api[2928]: 2017-09-28 12:34:16.513 2928 ERROR nova     sock.listen(backlog)
Sep 28 12:34:16 ctl02 nova-api[2928]: 2017-09-28 12:34:16.513 2928 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:34:16 ctl02 nova-api[2928]: 2017-09-28 12:34:16.513 2928 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:34:16 ctl02 nova-api[2928]: 2017-09-28 12:34:16.513 2928 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:34:16 ctl02 nova-api[2928]: 2017-09-28 12:34:16.513 2928 ERROR nova
Sep 28 12:34:16 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:34:16 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:34:16 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:34:16 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:34:16 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:34:16 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:34:16 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:34:17 ctl02 heat-api-cfn[13300]: 2017-09-28 12:34:17.115 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:34:17] "OPTIONS / HTTP/1.0" 200 134 0.000548
Sep 28 12:34:17 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:34:17.249 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:34:17] "OPTIONS / HTTP/1.0" 200 134 0.000485
Sep 28 12:34:17 ctl02 heat-api[13008]: 2017-09-28 12:34:17.650 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:34:17] "OPTIONS / HTTP/1.0" 200 134 0.000619
Sep 28 12:34:18 ctl02 nova-api[2947]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:34:18 ctl02 nova-api[2947]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:34:18 ctl02 nova-api[2947]: 2017-09-28 12:34:18.771 2947 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:34:18 ctl02 nova-api[2947]: 2017-09-28 12:34:18.773 2947 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:34:18 ctl02 nova-api[2947]: 2017-09-28 12:34:18.773 2947 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:34:18 ctl02 nova-api[2947]: 2017-09-28 12:34:18.773 2947 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:34:18 ctl02 nova-api[2947]: 2017-09-28 12:34:18.773 2947 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:34:18 ctl02 nova-api[2947]: 2017-09-28 12:34:18.773 2947 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:34:18 ctl02 nova-api[2947]: 2017-09-28 12:34:18.773 2947 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:34:18 ctl02 nova-api[2947]: 2017-09-28 12:34:18.773 2947 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:34:18 ctl02 nova-api[2947]: 2017-09-28 12:34:18.773 2947 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:34:18 ctl02 nova-api[2947]: 2017-09-28 12:34:18.773 2947 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:34:18 ctl02 nova-api[2947]: 2017-09-28 12:34:18.773 2947 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:34:18 ctl02 nova-api[2947]: 2017-09-28 12:34:18.773 2947 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:34:18 ctl02 nova-api[2947]: 2017-09-28 12:34:18.773 2947 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:34:18 ctl02 nova-api[2947]: 2017-09-28 12:34:18.773 2947 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:34:18 ctl02 nova-api[2947]: 2017-09-28 12:34:18.773 2947 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:34:18 ctl02 nova-api[2947]: 2017-09-28 12:34:18.773 2947 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:34:18 ctl02 nova-api[2947]: 2017-09-28 12:34:18.773 2947 ERROR nova.wsgi     self.filename))
Sep 28 12:34:18 ctl02 nova-api[2947]: 2017-09-28 12:34:18.773 2947 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:34:18 ctl02 nova-api[2947]: 2017-09-28 12:34:18.773 2947 ERROR nova.wsgi
Sep 28 12:34:18 ctl02 nova-api[2947]: 2017-09-28 12:34:18.775 2947 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:34:18 ctl02 nova-api[2947]: 2017-09-28 12:34:18.907 2947 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:34:19 ctl02 heat-api-cfn[13300]: 2017-09-28 12:34:19.119 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:34:19] "OPTIONS / HTTP/1.0" 200 134 0.000477
Sep 28 12:34:19 ctl02 nova-api[2947]: 2017-09-28 12:34:19.151 2947 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:34:19 ctl02 nova-api[2947]: 2017-09-28 12:34:19.154 2947 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:34:19 ctl02 nova-api[2947]: 2017-09-28 12:34:19.154 2947 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:34:19 ctl02 nova-api[2947]: 2017-09-28 12:34:19.155 2947 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:34:19 ctl02 nova-api[2947]: 2017-09-28 12:34:19.283 2947 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:34:19 ctl02 nova-api[2947]: 2017-09-28 12:34:19.286 2947 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:34:19 ctl02 nova-api[2947]: 2017-09-28 12:34:19.286 2947 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:34:19 ctl02 nova-api[2947]: 2017-09-28 12:34:19.286 2947 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:34:19 ctl02 nova-api[2947]: 2017-09-28 12:34:19.290 2947 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:34:19 ctl02 nova-api[2947]: 2017-09-28 12:34:19.290 2947 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:34:19 ctl02 nova-api[2947]: 2017-09-28 12:34:19.290 2947 ERROR nova Traceback (most recent call last):
Sep 28 12:34:19 ctl02 nova-api[2947]: 2017-09-28 12:34:19.290 2947 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:34:19 ctl02 nova-api[2947]: 2017-09-28 12:34:19.290 2947 ERROR nova     sys.exit(main())
Sep 28 12:34:19 ctl02 nova-api[2947]: 2017-09-28 12:34:19.290 2947 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:34:19 ctl02 nova-api[2947]: 2017-09-28 12:34:19.290 2947 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:34:19 ctl02 nova-api[2947]: 2017-09-28 12:34:19.290 2947 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:34:19 ctl02 nova-api[2947]: 2017-09-28 12:34:19.290 2947 ERROR nova     max_url_len=max_url_len)
Sep 28 12:34:19 ctl02 nova-api[2947]: 2017-09-28 12:34:19.290 2947 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:34:19 ctl02 nova-api[2947]: 2017-09-28 12:34:19.290 2947 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:34:19 ctl02 nova-api[2947]: 2017-09-28 12:34:19.290 2947 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:34:19 ctl02 nova-api[2947]: 2017-09-28 12:34:19.290 2947 ERROR nova     sock.listen(backlog)
Sep 28 12:34:19 ctl02 nova-api[2947]: 2017-09-28 12:34:19.290 2947 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:34:19 ctl02 nova-api[2947]: 2017-09-28 12:34:19.290 2947 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:34:19 ctl02 nova-api[2947]: 2017-09-28 12:34:19.290 2947 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:34:19 ctl02 nova-api[2947]: 2017-09-28 12:34:19.290 2947 ERROR nova
Sep 28 12:34:19 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:34:19 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:34:19 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:34:19 ctl02 heat-api[13008]: 2017-09-28 12:34:19.585 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:34:19] "OPTIONS / HTTP/1.0" 200 134 0.000592
Sep 28 12:34:19 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:34:19 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:34:19 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:34:19 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:34:20 ctl02 neutron-server[30536]: 2017-09-28 12:34:20.066 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:34:20] "OPTIONS / HTTP/1.0" 200 262 0.000503
Sep 28 12:34:20 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa97ff117)
Sep 28 12:34:21 ctl02 nova-api[2966]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:34:21 ctl02 nova-api[2966]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:34:21 ctl02 neutron-server[30536]: 2017-09-28 12:34:21.379 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 1 dead agents out of 6:
Sep 28 12:34:21 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:34:21 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:32:40 cmp002
Sep 28 12:34:21 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa97ff117)
Sep 28 12:34:21 ctl02 neutron-server[30536]: 2017-09-28 12:34:21.456 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:34:21] "OPTIONS / HTTP/1.0" 200 262 0.000502
Sep 28 12:34:21 ctl02 glance-api[29183]: 2017-09-28 12:34:21.463 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:34:21] "OPTIONS / HTTP/1.0" 200 134 0.000646
Sep 28 12:34:21 ctl02 nova-api[2966]: 2017-09-28 12:34:21.488 2966 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:34:21 ctl02 nova-api[2966]: 2017-09-28 12:34:21.489 2966 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:34:21 ctl02 nova-api[2966]: 2017-09-28 12:34:21.489 2966 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:34:21 ctl02 nova-api[2966]: 2017-09-28 12:34:21.489 2966 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:34:21 ctl02 nova-api[2966]: 2017-09-28 12:34:21.489 2966 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:34:21 ctl02 nova-api[2966]: 2017-09-28 12:34:21.489 2966 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:34:21 ctl02 nova-api[2966]: 2017-09-28 12:34:21.489 2966 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:34:21 ctl02 nova-api[2966]: 2017-09-28 12:34:21.489 2966 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:34:21 ctl02 nova-api[2966]: 2017-09-28 12:34:21.489 2966 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:34:21 ctl02 nova-api[2966]: 2017-09-28 12:34:21.489 2966 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:34:21 ctl02 nova-api[2966]: 2017-09-28 12:34:21.489 2966 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:34:21 ctl02 nova-api[2966]: 2017-09-28 12:34:21.489 2966 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:34:21 ctl02 nova-api[2966]: 2017-09-28 12:34:21.489 2966 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:34:21 ctl02 nova-api[2966]: 2017-09-28 12:34:21.489 2966 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:34:21 ctl02 nova-api[2966]: 2017-09-28 12:34:21.489 2966 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:34:21 ctl02 nova-api[2966]: 2017-09-28 12:34:21.489 2966 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:34:21 ctl02 nova-api[2966]: 2017-09-28 12:34:21.489 2966 ERROR nova.wsgi     self.filename))
Sep 28 12:34:21 ctl02 nova-api[2966]: 2017-09-28 12:34:21.489 2966 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:34:21 ctl02 nova-api[2966]: 2017-09-28 12:34:21.489 2966 ERROR nova.wsgi
Sep 28 12:34:21 ctl02 nova-api[2966]: 2017-09-28 12:34:21.492 2966 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:34:21 ctl02 nova-api[2966]: 2017-09-28 12:34:21.624 2966 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:34:21 ctl02 neutron-server[30536]: 2017-09-28 12:34:21.841 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:34:21] "OPTIONS / HTTP/1.0" 200 262 0.000516
Sep 28 12:34:21 ctl02 nova-api[2966]: 2017-09-28 12:34:21.866 2966 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:34:21 ctl02 nova-api[2966]: 2017-09-28 12:34:21.868 2966 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:34:21 ctl02 nova-api[2966]: 2017-09-28 12:34:21.869 2966 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:34:21 ctl02 nova-api[2966]: 2017-09-28 12:34:21.869 2966 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:34:22 ctl02 nova-api[2966]: 2017-09-28 12:34:22.002 2966 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:34:22 ctl02 nova-api[2966]: 2017-09-28 12:34:22.005 2966 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:34:22 ctl02 nova-api[2966]: 2017-09-28 12:34:22.005 2966 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:34:22 ctl02 nova-api[2966]: 2017-09-28 12:34:22.006 2966 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:34:22 ctl02 nova-api[2966]: 2017-09-28 12:34:22.009 2966 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:34:22 ctl02 nova-api[2966]: 2017-09-28 12:34:22.010 2966 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:34:22 ctl02 nova-api[2966]: 2017-09-28 12:34:22.010 2966 ERROR nova Traceback (most recent call last):
Sep 28 12:34:22 ctl02 nova-api[2966]: 2017-09-28 12:34:22.010 2966 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:34:22 ctl02 nova-api[2966]: 2017-09-28 12:34:22.010 2966 ERROR nova     sys.exit(main())
Sep 28 12:34:22 ctl02 nova-api[2966]: 2017-09-28 12:34:22.010 2966 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:34:22 ctl02 nova-api[2966]: 2017-09-28 12:34:22.010 2966 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:34:22 ctl02 nova-api[2966]: 2017-09-28 12:34:22.010 2966 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:34:22 ctl02 nova-api[2966]: 2017-09-28 12:34:22.010 2966 ERROR nova     max_url_len=max_url_len)
Sep 28 12:34:22 ctl02 nova-api[2966]: 2017-09-28 12:34:22.010 2966 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:34:22 ctl02 nova-api[2966]: 2017-09-28 12:34:22.010 2966 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:34:22 ctl02 nova-api[2966]: 2017-09-28 12:34:22.010 2966 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:34:22 ctl02 nova-api[2966]: 2017-09-28 12:34:22.010 2966 ERROR nova     sock.listen(backlog)
Sep 28 12:34:22 ctl02 nova-api[2966]: 2017-09-28 12:34:22.010 2966 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:34:22 ctl02 nova-api[2966]: 2017-09-28 12:34:22.010 2966 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:34:22 ctl02 nova-api[2966]: 2017-09-28 12:34:22.010 2966 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:34:22 ctl02 nova-api[2966]: 2017-09-28 12:34:22.010 2966 ERROR nova
Sep 28 12:34:22 ctl02 heat-api-cfn[13300]: 2017-09-28 12:34:22.088 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:34:22] "OPTIONS / HTTP/1.0" 200 134 0.000541
Sep 28 12:34:22 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:34:22 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:34:22 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:34:22 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:34:22 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:34:22 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:34:22 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:34:22 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa97ff117)
Sep 28 12:34:23 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa97ff117)
Sep 28 12:34:23 ctl02 glance-api[29183]: 2017-09-28 12:34:23.677 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:34:23] "OPTIONS / HTTP/1.0" 200 134 0.000651
Sep 28 12:34:23 ctl02 nova-consoleauth[5433]: 2017-09-28 12:34:23.900 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:34:24 ctl02 nova-api[2984]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:34:24 ctl02 nova-api[2984]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:34:24 ctl02 glance-api[29183]: 2017-09-28 12:34:24.113 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:34:24] "OPTIONS / HTTP/1.0" 200 134 0.000674
Sep 28 12:34:24 ctl02 nova-api[2984]: 2017-09-28 12:34:24.277 2984 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:34:24 ctl02 nova-api[2984]: 2017-09-28 12:34:24.279 2984 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:34:24 ctl02 nova-api[2984]: 2017-09-28 12:34:24.279 2984 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:34:24 ctl02 nova-api[2984]: 2017-09-28 12:34:24.279 2984 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:34:24 ctl02 nova-api[2984]: 2017-09-28 12:34:24.279 2984 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:34:24 ctl02 nova-api[2984]: 2017-09-28 12:34:24.279 2984 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:34:24 ctl02 nova-api[2984]: 2017-09-28 12:34:24.279 2984 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:34:24 ctl02 nova-api[2984]: 2017-09-28 12:34:24.279 2984 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:34:24 ctl02 nova-api[2984]: 2017-09-28 12:34:24.279 2984 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:34:24 ctl02 nova-api[2984]: 2017-09-28 12:34:24.279 2984 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:34:24 ctl02 nova-api[2984]: 2017-09-28 12:34:24.279 2984 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:34:24 ctl02 nova-api[2984]: 2017-09-28 12:34:24.279 2984 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:34:24 ctl02 nova-api[2984]: 2017-09-28 12:34:24.279 2984 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:34:24 ctl02 nova-api[2984]: 2017-09-28 12:34:24.279 2984 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:34:24 ctl02 nova-api[2984]: 2017-09-28 12:34:24.279 2984 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:34:24 ctl02 nova-api[2984]: 2017-09-28 12:34:24.279 2984 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:34:24 ctl02 nova-api[2984]: 2017-09-28 12:34:24.279 2984 ERROR nova.wsgi     self.filename))
Sep 28 12:34:24 ctl02 nova-api[2984]: 2017-09-28 12:34:24.279 2984 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:34:24 ctl02 nova-api[2984]: 2017-09-28 12:34:24.279 2984 ERROR nova.wsgi
Sep 28 12:34:24 ctl02 nova-api[2984]: 2017-09-28 12:34:24.280 2984 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:34:24 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa97ff117)
Sep 28 12:34:24 ctl02 nova-api[2984]: 2017-09-28 12:34:24.414 2984 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:34:24 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:34:24.455 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:34:24] "OPTIONS / HTTP/1.0" 200 134 0.000458
Sep 28 12:34:24 ctl02 nova-api[2984]: 2017-09-28 12:34:24.665 2984 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:34:24 ctl02 nova-api[2984]: 2017-09-28 12:34:24.667 2984 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:34:24 ctl02 nova-api[2984]: 2017-09-28 12:34:24.668 2984 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:34:24 ctl02 nova-api[2984]: 2017-09-28 12:34:24.668 2984 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:34:24 ctl02 nova-api[2984]: 2017-09-28 12:34:24.799 2984 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:34:24 ctl02 nova-api[2984]: 2017-09-28 12:34:24.802 2984 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:34:24 ctl02 nova-api[2984]: 2017-09-28 12:34:24.802 2984 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:34:24 ctl02 nova-api[2984]: 2017-09-28 12:34:24.802 2984 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:34:24 ctl02 nova-api[2984]: 2017-09-28 12:34:24.805 2984 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:34:24 ctl02 nova-api[2984]: 2017-09-28 12:34:24.806 2984 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:34:24 ctl02 nova-api[2984]: 2017-09-28 12:34:24.806 2984 ERROR nova Traceback (most recent call last):
Sep 28 12:34:24 ctl02 nova-api[2984]: 2017-09-28 12:34:24.806 2984 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:34:24 ctl02 nova-api[2984]: 2017-09-28 12:34:24.806 2984 ERROR nova     sys.exit(main())
Sep 28 12:34:24 ctl02 nova-api[2984]: 2017-09-28 12:34:24.806 2984 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:34:24 ctl02 nova-api[2984]: 2017-09-28 12:34:24.806 2984 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:34:24 ctl02 nova-api[2984]: 2017-09-28 12:34:24.806 2984 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:34:24 ctl02 nova-api[2984]: 2017-09-28 12:34:24.806 2984 ERROR nova     max_url_len=max_url_len)
Sep 28 12:34:24 ctl02 nova-api[2984]: 2017-09-28 12:34:24.806 2984 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:34:24 ctl02 nova-api[2984]: 2017-09-28 12:34:24.806 2984 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:34:24 ctl02 nova-api[2984]: 2017-09-28 12:34:24.806 2984 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:34:24 ctl02 nova-api[2984]: 2017-09-28 12:34:24.806 2984 ERROR nova     sock.listen(backlog)
Sep 28 12:34:24 ctl02 nova-api[2984]: 2017-09-28 12:34:24.806 2984 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:34:24 ctl02 nova-api[2984]: 2017-09-28 12:34:24.806 2984 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:34:24 ctl02 nova-api[2984]: 2017-09-28 12:34:24.806 2984 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:34:24 ctl02 nova-api[2984]: 2017-09-28 12:34:24.806 2984 ERROR nova
Sep 28 12:34:24 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:34:24 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:34:24 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:34:25 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:34:25 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:34:25 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:34:25 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:34:25 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:34:25.177 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:34:25] "OPTIONS / HTTP/1.0" 200 134 0.000481
Sep 28 12:34:25 ctl02 heat-api[13008]: 2017-09-28 12:34:25.275 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:34:25] "OPTIONS / HTTP/1.0" 200 134 0.000597
Sep 28 12:34:25 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa97ff117)
Sep 28 12:34:25 ctl02 heat-engine[12803]: 2017-09-28 12:34:25.936 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:34:25 ctl02 heat-engine[12803]: 2017-09-28 12:34:25.938 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:34:25 ctl02 heat-engine[12803]: 2017-09-28 12:34:25.938 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:34:25 ctl02 heat-engine[12803]: 2017-09-28 12:34:25.943 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:34:26 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa97ff117)
Sep 28 12:34:26 ctl02 nova-api[3001]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:34:26 ctl02 nova-api[3001]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:34:26 ctl02 nova-scheduler[5620]: 2017-09-28 12:34:26.943 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:34:27 ctl02 nova-api[3001]: 2017-09-28 12:34:27.006 3001 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:34:27 ctl02 nova-api[3001]: 2017-09-28 12:34:27.008 3001 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:34:27 ctl02 nova-api[3001]: 2017-09-28 12:34:27.008 3001 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:34:27 ctl02 nova-api[3001]: 2017-09-28 12:34:27.008 3001 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:34:27 ctl02 nova-api[3001]: 2017-09-28 12:34:27.008 3001 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:34:27 ctl02 nova-api[3001]: 2017-09-28 12:34:27.008 3001 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:34:27 ctl02 nova-api[3001]: 2017-09-28 12:34:27.008 3001 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:34:27 ctl02 nova-api[3001]: 2017-09-28 12:34:27.008 3001 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:34:27 ctl02 nova-api[3001]: 2017-09-28 12:34:27.008 3001 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:34:27 ctl02 nova-api[3001]: 2017-09-28 12:34:27.008 3001 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:34:27 ctl02 nova-api[3001]: 2017-09-28 12:34:27.008 3001 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:34:27 ctl02 nova-api[3001]: 2017-09-28 12:34:27.008 3001 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:34:27 ctl02 nova-api[3001]: 2017-09-28 12:34:27.008 3001 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:34:27 ctl02 nova-api[3001]: 2017-09-28 12:34:27.008 3001 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:34:27 ctl02 nova-api[3001]: 2017-09-28 12:34:27.008 3001 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:34:27 ctl02 nova-api[3001]: 2017-09-28 12:34:27.008 3001 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:34:27 ctl02 nova-api[3001]: 2017-09-28 12:34:27.008 3001 ERROR nova.wsgi     self.filename))
Sep 28 12:34:27 ctl02 nova-api[3001]: 2017-09-28 12:34:27.008 3001 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:34:27 ctl02 nova-api[3001]: 2017-09-28 12:34:27.008 3001 ERROR nova.wsgi
Sep 28 12:34:27 ctl02 nova-api[3001]: 2017-09-28 12:34:27.010 3001 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:34:27 ctl02 heat-api-cfn[13300]: 2017-09-28 12:34:27.099 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:34:27] "OPTIONS / HTTP/1.0" 200 134 0.000554
Sep 28 12:34:27 ctl02 nova-api[3001]: 2017-09-28 12:34:27.140 3001 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:34:27 ctl02 nova-api[3001]: 2017-09-28 12:34:27.365 3001 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:34:27 ctl02 nova-api[3001]: 2017-09-28 12:34:27.367 3001 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:34:27 ctl02 nova-api[3001]: 2017-09-28 12:34:27.368 3001 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:34:27 ctl02 nova-api[3001]: 2017-09-28 12:34:27.368 3001 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:34:27 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa97ff117)
Sep 28 12:34:27 ctl02 nova-api[3001]: 2017-09-28 12:34:27.500 3001 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:34:27 ctl02 nova-api[3001]: 2017-09-28 12:34:27.503 3001 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:34:27 ctl02 nova-api[3001]: 2017-09-28 12:34:27.503 3001 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:34:27 ctl02 nova-api[3001]: 2017-09-28 12:34:27.504 3001 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:34:27 ctl02 nova-api[3001]: 2017-09-28 12:34:27.507 3001 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:34:27 ctl02 nova-api[3001]: 2017-09-28 12:34:27.508 3001 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:34:27 ctl02 nova-api[3001]: 2017-09-28 12:34:27.508 3001 ERROR nova Traceback (most recent call last):
Sep 28 12:34:27 ctl02 nova-api[3001]: 2017-09-28 12:34:27.508 3001 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:34:27 ctl02 nova-api[3001]: 2017-09-28 12:34:27.508 3001 ERROR nova     sys.exit(main())
Sep 28 12:34:27 ctl02 nova-api[3001]: 2017-09-28 12:34:27.508 3001 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:34:27 ctl02 nova-api[3001]: 2017-09-28 12:34:27.508 3001 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:34:27 ctl02 nova-api[3001]: 2017-09-28 12:34:27.508 3001 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:34:27 ctl02 nova-api[3001]: 2017-09-28 12:34:27.508 3001 ERROR nova     max_url_len=max_url_len)
Sep 28 12:34:27 ctl02 nova-api[3001]: 2017-09-28 12:34:27.508 3001 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:34:27 ctl02 nova-api[3001]: 2017-09-28 12:34:27.508 3001 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:34:27 ctl02 nova-api[3001]: 2017-09-28 12:34:27.508 3001 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:34:27 ctl02 nova-api[3001]: 2017-09-28 12:34:27.508 3001 ERROR nova     sock.listen(backlog)
Sep 28 12:34:27 ctl02 nova-api[3001]: 2017-09-28 12:34:27.508 3001 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:34:27 ctl02 nova-api[3001]: 2017-09-28 12:34:27.508 3001 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:34:27 ctl02 nova-api[3001]: 2017-09-28 12:34:27.508 3001 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:34:27 ctl02 nova-api[3001]: 2017-09-28 12:34:27.508 3001 ERROR nova
Sep 28 12:34:27 ctl02 heat-api[13008]: 2017-09-28 12:34:27.563 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:34:27] "OPTIONS / HTTP/1.0" 200 134 0.000824
Sep 28 12:34:27 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:34:27.588 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:34:27] "OPTIONS / HTTP/1.0" 200 134 0.000537
Sep 28 12:34:27 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:34:27 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:34:27 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:34:27 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:34:27 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:34:27 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:34:27 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:34:28 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa97ff117)
Sep 28 12:34:28 ctl02 heat-api-cfn[13300]: 2017-09-28 12:34:28.849 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:34:28] "OPTIONS / HTTP/1.0" 200 134 0.000440
Sep 28 12:34:29 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa97ff117)
Sep 28 12:34:29 ctl02 nova-api[3020]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:34:29 ctl02 nova-api[3020]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:34:29 ctl02 nova-api[3020]: 2017-09-28 12:34:29.773 3020 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:34:29 ctl02 nova-api[3020]: 2017-09-28 12:34:29.775 3020 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:34:29 ctl02 nova-api[3020]: 2017-09-28 12:34:29.775 3020 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:34:29 ctl02 nova-api[3020]: 2017-09-28 12:34:29.775 3020 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:34:29 ctl02 nova-api[3020]: 2017-09-28 12:34:29.775 3020 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:34:29 ctl02 nova-api[3020]: 2017-09-28 12:34:29.775 3020 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:34:29 ctl02 nova-api[3020]: 2017-09-28 12:34:29.775 3020 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:34:29 ctl02 nova-api[3020]: 2017-09-28 12:34:29.775 3020 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:34:29 ctl02 nova-api[3020]: 2017-09-28 12:34:29.775 3020 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:34:29 ctl02 nova-api[3020]: 2017-09-28 12:34:29.775 3020 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:34:29 ctl02 nova-api[3020]: 2017-09-28 12:34:29.775 3020 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:34:29 ctl02 nova-api[3020]: 2017-09-28 12:34:29.775 3020 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:34:29 ctl02 nova-api[3020]: 2017-09-28 12:34:29.775 3020 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:34:29 ctl02 nova-api[3020]: 2017-09-28 12:34:29.775 3020 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:34:29 ctl02 nova-api[3020]: 2017-09-28 12:34:29.775 3020 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:34:29 ctl02 nova-api[3020]: 2017-09-28 12:34:29.775 3020 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:34:29 ctl02 nova-api[3020]: 2017-09-28 12:34:29.775 3020 ERROR nova.wsgi     self.filename))
Sep 28 12:34:29 ctl02 nova-api[3020]: 2017-09-28 12:34:29.775 3020 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:34:29 ctl02 nova-api[3020]: 2017-09-28 12:34:29.775 3020 ERROR nova.wsgi
Sep 28 12:34:29 ctl02 nova-api[3020]: 2017-09-28 12:34:29.776 3020 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:34:29 ctl02 heat-api[13008]: 2017-09-28 12:34:29.811 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:34:29] "OPTIONS / HTTP/1.0" 200 134 0.000556
Sep 28 12:34:29 ctl02 nova-api[3020]: 2017-09-28 12:34:29.905 3020 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:34:30 ctl02 nova-api[3020]: 2017-09-28 12:34:30.130 3020 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:34:30 ctl02 nova-api[3020]: 2017-09-28 12:34:30.133 3020 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:34:30 ctl02 nova-api[3020]: 2017-09-28 12:34:30.133 3020 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:34:30 ctl02 nova-api[3020]: 2017-09-28 12:34:30.134 3020 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:34:30 ctl02 neutron-server[30536]: 2017-09-28 12:34:30.240 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:34:30] "OPTIONS / HTTP/1.0" 200 262 0.000469
Sep 28 12:34:30 ctl02 nova-api[3020]: 2017-09-28 12:34:30.266 3020 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:34:30 ctl02 nova-api[3020]: 2017-09-28 12:34:30.269 3020 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:34:30 ctl02 nova-api[3020]: 2017-09-28 12:34:30.269 3020 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:34:30 ctl02 nova-api[3020]: 2017-09-28 12:34:30.270 3020 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:34:30 ctl02 nova-api[3020]: 2017-09-28 12:34:30.273 3020 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:34:30 ctl02 nova-api[3020]: 2017-09-28 12:34:30.273 3020 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:34:30 ctl02 nova-api[3020]: 2017-09-28 12:34:30.273 3020 ERROR nova Traceback (most recent call last):
Sep 28 12:34:30 ctl02 nova-api[3020]: 2017-09-28 12:34:30.273 3020 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:34:30 ctl02 nova-api[3020]: 2017-09-28 12:34:30.273 3020 ERROR nova     sys.exit(main())
Sep 28 12:34:30 ctl02 nova-api[3020]: 2017-09-28 12:34:30.273 3020 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:34:30 ctl02 nova-api[3020]: 2017-09-28 12:34:30.273 3020 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:34:30 ctl02 nova-api[3020]: 2017-09-28 12:34:30.273 3020 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:34:30 ctl02 nova-api[3020]: 2017-09-28 12:34:30.273 3020 ERROR nova     max_url_len=max_url_len)
Sep 28 12:34:30 ctl02 nova-api[3020]: 2017-09-28 12:34:30.273 3020 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:34:30 ctl02 nova-api[3020]: 2017-09-28 12:34:30.273 3020 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:34:30 ctl02 nova-api[3020]: 2017-09-28 12:34:30.273 3020 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:34:30 ctl02 nova-api[3020]: 2017-09-28 12:34:30.273 3020 ERROR nova     sock.listen(backlog)
Sep 28 12:34:30 ctl02 nova-api[3020]: 2017-09-28 12:34:30.273 3020 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:34:30 ctl02 nova-api[3020]: 2017-09-28 12:34:30.273 3020 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:34:30 ctl02 nova-api[3020]: 2017-09-28 12:34:30.273 3020 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:34:30 ctl02 nova-api[3020]: 2017-09-28 12:34:30.273 3020 ERROR nova
Sep 28 12:34:30 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:34:30 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:34:30 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:34:30 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa97ff117)
Sep 28 12:34:30 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:34:30 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:34:30 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:34:30 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:34:31 ctl02 glance-api[29183]: 2017-09-28 12:34:31.288 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:34:31] "OPTIONS / HTTP/1.0" 200 134 0.000574
Sep 28 12:34:31 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:34:31 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:34:31 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 12:34:31 ctl02 ntp[3093]:  * Stopping NTP server ntpd
Sep 28 12:34:31 ctl02 ntp[3093]:    ...done.
Sep 28 12:34:31 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 12:34:31 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 12:34:31 ctl02 ntp[3104]:  * Starting NTP server ntpd
Sep 28 12:34:31 ctl02 ntpd[3111]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 12:34:31 ctl02 ntpd[3111]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 12:34:31 ctl02 neutron-server[30536]: 2017-09-28 12:34:31.499 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:34:31] "OPTIONS / HTTP/1.0" 200 262 0.000522
Sep 28 12:34:31 ctl02 ntp[3104]:    ...done.
Sep 28 12:34:31 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 12:34:31 ctl02 ntpd[3114]: proto: precision = 0.042 usec (-24)
Sep 28 12:34:31 ctl02 ntpd[3114]: switching logging to file /var/log/ntp.log
Sep 28 12:34:31 ctl02 heat-api-cfn[13300]: 2017-09-28 12:34:31.942 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:34:31] "OPTIONS / HTTP/1.0" 200 134 0.000496
Sep 28 12:34:32 ctl02 neutron-server[30536]: 2017-09-28 12:34:32.045 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:34:32] "OPTIONS / HTTP/1.0" 200 262 0.000576
Sep 28 12:34:32 ctl02 nova-api[3038]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:34:32 ctl02 nova-api[3038]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:34:32 ctl02 nova-api[3038]: 2017-09-28 12:34:32.526 3038 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:34:32 ctl02 nova-api[3038]: 2017-09-28 12:34:32.527 3038 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:34:32 ctl02 nova-api[3038]: 2017-09-28 12:34:32.527 3038 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:34:32 ctl02 nova-api[3038]: 2017-09-28 12:34:32.527 3038 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:34:32 ctl02 nova-api[3038]: 2017-09-28 12:34:32.527 3038 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:34:32 ctl02 nova-api[3038]: 2017-09-28 12:34:32.527 3038 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:34:32 ctl02 nova-api[3038]: 2017-09-28 12:34:32.527 3038 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:34:32 ctl02 nova-api[3038]: 2017-09-28 12:34:32.527 3038 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:34:32 ctl02 nova-api[3038]: 2017-09-28 12:34:32.527 3038 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:34:32 ctl02 nova-api[3038]: 2017-09-28 12:34:32.527 3038 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:34:32 ctl02 nova-api[3038]: 2017-09-28 12:34:32.527 3038 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:34:32 ctl02 nova-api[3038]: 2017-09-28 12:34:32.527 3038 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:34:32 ctl02 nova-api[3038]: 2017-09-28 12:34:32.527 3038 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:34:32 ctl02 nova-api[3038]: 2017-09-28 12:34:32.527 3038 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:34:32 ctl02 nova-api[3038]: 2017-09-28 12:34:32.527 3038 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:34:32 ctl02 nova-api[3038]: 2017-09-28 12:34:32.527 3038 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:34:32 ctl02 nova-api[3038]: 2017-09-28 12:34:32.527 3038 ERROR nova.wsgi     self.filename))
Sep 28 12:34:32 ctl02 nova-api[3038]: 2017-09-28 12:34:32.527 3038 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:34:32 ctl02 nova-api[3038]: 2017-09-28 12:34:32.527 3038 ERROR nova.wsgi
Sep 28 12:34:32 ctl02 nova-api[3038]: 2017-09-28 12:34:32.528 3038 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:34:32 ctl02 nova-api[3038]: 2017-09-28 12:34:32.654 3038 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:34:32 ctl02 nova-api[3038]: 2017-09-28 12:34:32.881 3038 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:34:32 ctl02 nova-api[3038]: 2017-09-28 12:34:32.883 3038 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:34:32 ctl02 nova-api[3038]: 2017-09-28 12:34:32.884 3038 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:34:32 ctl02 nova-api[3038]: 2017-09-28 12:34:32.884 3038 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:34:33 ctl02 nova-api[3038]: 2017-09-28 12:34:33.013 3038 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:34:33 ctl02 nova-api[3038]: 2017-09-28 12:34:33.015 3038 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:34:33 ctl02 nova-api[3038]: 2017-09-28 12:34:33.015 3038 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:34:33 ctl02 nova-api[3038]: 2017-09-28 12:34:33.015 3038 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:34:33 ctl02 nova-api[3038]: 2017-09-28 12:34:33.018 3038 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:34:33 ctl02 nova-api[3038]: 2017-09-28 12:34:33.019 3038 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:34:33 ctl02 nova-api[3038]: 2017-09-28 12:34:33.019 3038 ERROR nova Traceback (most recent call last):
Sep 28 12:34:33 ctl02 nova-api[3038]: 2017-09-28 12:34:33.019 3038 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:34:33 ctl02 nova-api[3038]: 2017-09-28 12:34:33.019 3038 ERROR nova     sys.exit(main())
Sep 28 12:34:33 ctl02 nova-api[3038]: 2017-09-28 12:34:33.019 3038 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:34:33 ctl02 nova-api[3038]: 2017-09-28 12:34:33.019 3038 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:34:33 ctl02 nova-api[3038]: 2017-09-28 12:34:33.019 3038 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:34:33 ctl02 nova-api[3038]: 2017-09-28 12:34:33.019 3038 ERROR nova     max_url_len=max_url_len)
Sep 28 12:34:33 ctl02 nova-api[3038]: 2017-09-28 12:34:33.019 3038 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:34:33 ctl02 nova-api[3038]: 2017-09-28 12:34:33.019 3038 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:34:33 ctl02 nova-api[3038]: 2017-09-28 12:34:33.019 3038 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:34:33 ctl02 nova-api[3038]: 2017-09-28 12:34:33.019 3038 ERROR nova     sock.listen(backlog)
Sep 28 12:34:33 ctl02 nova-api[3038]: 2017-09-28 12:34:33.019 3038 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:34:33 ctl02 nova-api[3038]: 2017-09-28 12:34:33.019 3038 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:34:33 ctl02 nova-api[3038]: 2017-09-28 12:34:33.019 3038 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:34:33 ctl02 nova-api[3038]: 2017-09-28 12:34:33.019 3038 ERROR nova
Sep 28 12:34:33 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:34:33 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:34:33 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:34:33 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:34:33 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:34:33 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:34:33 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:34:33 ctl02 glance-api[29183]: 2017-09-28 12:34:33.574 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:34:33] "OPTIONS / HTTP/1.0" 200 134 0.000671
Sep 28 12:34:33 ctl02 glance-api[29183]: 2017-09-28 12:34:33.845 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:34:33] "OPTIONS / HTTP/1.0" 200 134 0.000642
Sep 28 12:34:34 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:34:34.157 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:34:34] "OPTIONS / HTTP/1.0" 200 134 0.000462
Sep 28 12:34:35 ctl02 nova-api[3126]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:34:35 ctl02 nova-api[3126]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:34:35 ctl02 heat-api[13008]: 2017-09-28 12:34:35.245 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:34:35] "OPTIONS / HTTP/1.0" 200 134 0.000672
Sep 28 12:34:35 ctl02 nova-api[3126]: 2017-09-28 12:34:35.287 3126 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:34:35 ctl02 nova-api[3126]: 2017-09-28 12:34:35.288 3126 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:34:35 ctl02 nova-api[3126]: 2017-09-28 12:34:35.288 3126 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:34:35 ctl02 nova-api[3126]: 2017-09-28 12:34:35.288 3126 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:34:35 ctl02 nova-api[3126]: 2017-09-28 12:34:35.288 3126 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:34:35 ctl02 nova-api[3126]: 2017-09-28 12:34:35.288 3126 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:34:35 ctl02 nova-api[3126]: 2017-09-28 12:34:35.288 3126 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:34:35 ctl02 nova-api[3126]: 2017-09-28 12:34:35.288 3126 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:34:35 ctl02 nova-api[3126]: 2017-09-28 12:34:35.288 3126 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:34:35 ctl02 nova-api[3126]: 2017-09-28 12:34:35.288 3126 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:34:35 ctl02 nova-api[3126]: 2017-09-28 12:34:35.288 3126 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:34:35 ctl02 nova-api[3126]: 2017-09-28 12:34:35.288 3126 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:34:35 ctl02 nova-api[3126]: 2017-09-28 12:34:35.288 3126 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:34:35 ctl02 nova-api[3126]: 2017-09-28 12:34:35.288 3126 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:34:35 ctl02 nova-api[3126]: 2017-09-28 12:34:35.288 3126 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:34:35 ctl02 nova-api[3126]: 2017-09-28 12:34:35.288 3126 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:34:35 ctl02 nova-api[3126]: 2017-09-28 12:34:35.288 3126 ERROR nova.wsgi     self.filename))
Sep 28 12:34:35 ctl02 nova-api[3126]: 2017-09-28 12:34:35.288 3126 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:34:35 ctl02 nova-api[3126]: 2017-09-28 12:34:35.288 3126 ERROR nova.wsgi
Sep 28 12:34:35 ctl02 nova-api[3126]: 2017-09-28 12:34:35.289 3126 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:34:35 ctl02 nova-api[3126]: 2017-09-28 12:34:35.421 3126 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:34:35 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:34:35.491 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:34:35] "OPTIONS / HTTP/1.0" 200 134 0.000492
Sep 28 12:34:35 ctl02 nova-api[3126]: 2017-09-28 12:34:35.675 3126 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:34:35 ctl02 nova-api[3126]: 2017-09-28 12:34:35.677 3126 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:34:35 ctl02 nova-api[3126]: 2017-09-28 12:34:35.677 3126 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:34:35 ctl02 nova-api[3126]: 2017-09-28 12:34:35.678 3126 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:34:35 ctl02 nova-api[3126]: 2017-09-28 12:34:35.811 3126 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:34:35 ctl02 nova-api[3126]: 2017-09-28 12:34:35.813 3126 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:34:35 ctl02 nova-api[3126]: 2017-09-28 12:34:35.813 3126 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:34:35 ctl02 nova-api[3126]: 2017-09-28 12:34:35.813 3126 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:34:35 ctl02 nova-api[3126]: 2017-09-28 12:34:35.817 3126 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:34:35 ctl02 nova-api[3126]: 2017-09-28 12:34:35.817 3126 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:34:35 ctl02 nova-api[3126]: 2017-09-28 12:34:35.817 3126 ERROR nova Traceback (most recent call last):
Sep 28 12:34:35 ctl02 nova-api[3126]: 2017-09-28 12:34:35.817 3126 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:34:35 ctl02 nova-api[3126]: 2017-09-28 12:34:35.817 3126 ERROR nova     sys.exit(main())
Sep 28 12:34:35 ctl02 nova-api[3126]: 2017-09-28 12:34:35.817 3126 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:34:35 ctl02 nova-api[3126]: 2017-09-28 12:34:35.817 3126 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:34:35 ctl02 nova-api[3126]: 2017-09-28 12:34:35.817 3126 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:34:35 ctl02 nova-api[3126]: 2017-09-28 12:34:35.817 3126 ERROR nova     max_url_len=max_url_len)
Sep 28 12:34:35 ctl02 nova-api[3126]: 2017-09-28 12:34:35.817 3126 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:34:35 ctl02 nova-api[3126]: 2017-09-28 12:34:35.817 3126 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:34:35 ctl02 nova-api[3126]: 2017-09-28 12:34:35.817 3126 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:34:35 ctl02 nova-api[3126]: 2017-09-28 12:34:35.817 3126 ERROR nova     sock.listen(backlog)
Sep 28 12:34:35 ctl02 nova-api[3126]: 2017-09-28 12:34:35.817 3126 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:34:35 ctl02 nova-api[3126]: 2017-09-28 12:34:35.817 3126 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:34:35 ctl02 nova-api[3126]: 2017-09-28 12:34:35.817 3126 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:34:35 ctl02 nova-api[3126]: 2017-09-28 12:34:35.817 3126 ERROR nova
Sep 28 12:34:35 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:34:35 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:34:35 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:34:36 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:34:36 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:34:36 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:34:36 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:34:36 ctl02 neutron-server[30536]: 2017-09-28 12:34:36.376 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 1 dead agents out of 6:
Sep 28 12:34:36 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:34:36 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:32:40 cmp002
Sep 28 12:34:37 ctl02 heat-api-cfn[13300]: 2017-09-28 12:34:37.117 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:34:37] "OPTIONS / HTTP/1.0" 200 134 0.000446
Sep 28 12:34:37 ctl02 heat-api[13008]: 2017-09-28 12:34:37.317 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:34:37] "OPTIONS / HTTP/1.0" 200 134 0.000708
Sep 28 12:34:37 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:34:37.498 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:34:37] "OPTIONS / HTTP/1.0" 200 134 0.000570
Sep 28 12:34:37 ctl02 nova-api[3144]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:34:37 ctl02 nova-api[3144]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:34:37 ctl02 nova-api[3144]: 2017-09-28 12:34:37.994 3144 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:34:37 ctl02 nova-api[3144]: 2017-09-28 12:34:37.995 3144 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:34:37 ctl02 nova-api[3144]: 2017-09-28 12:34:37.995 3144 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:34:37 ctl02 nova-api[3144]: 2017-09-28 12:34:37.995 3144 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:34:37 ctl02 nova-api[3144]: 2017-09-28 12:34:37.995 3144 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:34:37 ctl02 nova-api[3144]: 2017-09-28 12:34:37.995 3144 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:34:37 ctl02 nova-api[3144]: 2017-09-28 12:34:37.995 3144 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:34:37 ctl02 nova-api[3144]: 2017-09-28 12:34:37.995 3144 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:34:37 ctl02 nova-api[3144]: 2017-09-28 12:34:37.995 3144 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:34:37 ctl02 nova-api[3144]: 2017-09-28 12:34:37.995 3144 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:34:37 ctl02 nova-api[3144]: 2017-09-28 12:34:37.995 3144 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:34:37 ctl02 nova-api[3144]: 2017-09-28 12:34:37.995 3144 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:34:37 ctl02 nova-api[3144]: 2017-09-28 12:34:37.995 3144 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:34:37 ctl02 nova-api[3144]: 2017-09-28 12:34:37.995 3144 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:34:37 ctl02 nova-api[3144]: 2017-09-28 12:34:37.995 3144 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:34:37 ctl02 nova-api[3144]: 2017-09-28 12:34:37.995 3144 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:34:37 ctl02 nova-api[3144]: 2017-09-28 12:34:37.995 3144 ERROR nova.wsgi     self.filename))
Sep 28 12:34:37 ctl02 nova-api[3144]: 2017-09-28 12:34:37.995 3144 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:34:37 ctl02 nova-api[3144]: 2017-09-28 12:34:37.995 3144 ERROR nova.wsgi
Sep 28 12:34:37 ctl02 nova-api[3144]: 2017-09-28 12:34:37.996 3144 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:34:38 ctl02 nova-api[3144]: 2017-09-28 12:34:38.127 3144 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:34:38 ctl02 nova-api[3144]: 2017-09-28 12:34:38.347 3144 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:34:38 ctl02 nova-api[3144]: 2017-09-28 12:34:38.349 3144 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:34:38 ctl02 nova-api[3144]: 2017-09-28 12:34:38.350 3144 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:34:38 ctl02 nova-api[3144]: 2017-09-28 12:34:38.350 3144 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:34:38 ctl02 nova-api[3144]: 2017-09-28 12:34:38.481 3144 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:34:38 ctl02 nova-api[3144]: 2017-09-28 12:34:38.483 3144 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:34:38 ctl02 nova-api[3144]: 2017-09-28 12:34:38.483 3144 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:34:38 ctl02 nova-api[3144]: 2017-09-28 12:34:38.483 3144 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:34:38 ctl02 nova-api[3144]: 2017-09-28 12:34:38.486 3144 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:34:38 ctl02 nova-api[3144]: 2017-09-28 12:34:38.487 3144 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:34:38 ctl02 nova-api[3144]: 2017-09-28 12:34:38.487 3144 ERROR nova Traceback (most recent call last):
Sep 28 12:34:38 ctl02 nova-api[3144]: 2017-09-28 12:34:38.487 3144 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:34:38 ctl02 nova-api[3144]: 2017-09-28 12:34:38.487 3144 ERROR nova     sys.exit(main())
Sep 28 12:34:38 ctl02 nova-api[3144]: 2017-09-28 12:34:38.487 3144 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:34:38 ctl02 nova-api[3144]: 2017-09-28 12:34:38.487 3144 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:34:38 ctl02 nova-api[3144]: 2017-09-28 12:34:38.487 3144 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:34:38 ctl02 nova-api[3144]: 2017-09-28 12:34:38.487 3144 ERROR nova     max_url_len=max_url_len)
Sep 28 12:34:38 ctl02 nova-api[3144]: 2017-09-28 12:34:38.487 3144 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:34:38 ctl02 nova-api[3144]: 2017-09-28 12:34:38.487 3144 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:34:38 ctl02 nova-api[3144]: 2017-09-28 12:34:38.487 3144 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:34:38 ctl02 nova-api[3144]: 2017-09-28 12:34:38.487 3144 ERROR nova     sock.listen(backlog)
Sep 28 12:34:38 ctl02 nova-api[3144]: 2017-09-28 12:34:38.487 3144 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:34:38 ctl02 nova-api[3144]: 2017-09-28 12:34:38.487 3144 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:34:38 ctl02 nova-api[3144]: 2017-09-28 12:34:38.487 3144 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:34:38 ctl02 nova-api[3144]: 2017-09-28 12:34:38.487 3144 ERROR nova
Sep 28 12:34:38 ctl02 heat-api-cfn[13300]: 2017-09-28 12:34:38.574 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:34:38] "OPTIONS / HTTP/1.0" 200 134 0.000425
Sep 28 12:34:38 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:34:38 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:34:38 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:34:38 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:34:38 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:34:38 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:34:38 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:34:39 ctl02 heat-api[13008]: 2017-09-28 12:34:39.749 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:34:39] "OPTIONS / HTTP/1.0" 200 134 0.000571
Sep 28 12:34:40 ctl02 neutron-server[30536]: 2017-09-28 12:34:40.401 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:34:40] "OPTIONS / HTTP/1.0" 200 262 0.000476
Sep 28 12:34:40 ctl02 nova-api[3163]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:34:40 ctl02 nova-api[3163]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:34:40 ctl02 nova-api[3163]: 2017-09-28 12:34:40.755 3163 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:34:40 ctl02 nova-api[3163]: 2017-09-28 12:34:40.757 3163 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:34:40 ctl02 nova-api[3163]: 2017-09-28 12:34:40.757 3163 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:34:40 ctl02 nova-api[3163]: 2017-09-28 12:34:40.757 3163 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:34:40 ctl02 nova-api[3163]: 2017-09-28 12:34:40.757 3163 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:34:40 ctl02 nova-api[3163]: 2017-09-28 12:34:40.757 3163 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:34:40 ctl02 nova-api[3163]: 2017-09-28 12:34:40.757 3163 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:34:40 ctl02 nova-api[3163]: 2017-09-28 12:34:40.757 3163 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:34:40 ctl02 nova-api[3163]: 2017-09-28 12:34:40.757 3163 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:34:40 ctl02 nova-api[3163]: 2017-09-28 12:34:40.757 3163 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:34:40 ctl02 nova-api[3163]: 2017-09-28 12:34:40.757 3163 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:34:40 ctl02 nova-api[3163]: 2017-09-28 12:34:40.757 3163 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:34:40 ctl02 nova-api[3163]: 2017-09-28 12:34:40.757 3163 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:34:40 ctl02 nova-api[3163]: 2017-09-28 12:34:40.757 3163 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:34:40 ctl02 nova-api[3163]: 2017-09-28 12:34:40.757 3163 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:34:40 ctl02 nova-api[3163]: 2017-09-28 12:34:40.757 3163 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:34:40 ctl02 nova-api[3163]: 2017-09-28 12:34:40.757 3163 ERROR nova.wsgi     self.filename))
Sep 28 12:34:40 ctl02 nova-api[3163]: 2017-09-28 12:34:40.757 3163 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:34:40 ctl02 nova-api[3163]: 2017-09-28 12:34:40.757 3163 ERROR nova.wsgi
Sep 28 12:34:40 ctl02 nova-api[3163]: 2017-09-28 12:34:40.758 3163 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:34:40 ctl02 nova-api[3163]: 2017-09-28 12:34:40.888 3163 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:34:41 ctl02 nova-api[3163]: 2017-09-28 12:34:41.113 3163 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:34:41 ctl02 nova-api[3163]: 2017-09-28 12:34:41.115 3163 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:34:41 ctl02 nova-api[3163]: 2017-09-28 12:34:41.115 3163 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:34:41 ctl02 nova-api[3163]: 2017-09-28 12:34:41.115 3163 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:34:41 ctl02 nova-api[3163]: 2017-09-28 12:34:41.248 3163 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:34:41 ctl02 nova-api[3163]: 2017-09-28 12:34:41.249 3163 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:34:41 ctl02 nova-api[3163]: 2017-09-28 12:34:41.250 3163 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:34:41 ctl02 nova-api[3163]: 2017-09-28 12:34:41.250 3163 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:34:41 ctl02 nova-api[3163]: 2017-09-28 12:34:41.253 3163 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:34:41 ctl02 nova-api[3163]: 2017-09-28 12:34:41.253 3163 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:34:41 ctl02 nova-api[3163]: 2017-09-28 12:34:41.253 3163 ERROR nova Traceback (most recent call last):
Sep 28 12:34:41 ctl02 nova-api[3163]: 2017-09-28 12:34:41.253 3163 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:34:41 ctl02 nova-api[3163]: 2017-09-28 12:34:41.253 3163 ERROR nova     sys.exit(main())
Sep 28 12:34:41 ctl02 nova-api[3163]: 2017-09-28 12:34:41.253 3163 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:34:41 ctl02 nova-api[3163]: 2017-09-28 12:34:41.253 3163 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:34:41 ctl02 nova-api[3163]: 2017-09-28 12:34:41.253 3163 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:34:41 ctl02 nova-api[3163]: 2017-09-28 12:34:41.253 3163 ERROR nova     max_url_len=max_url_len)
Sep 28 12:34:41 ctl02 nova-api[3163]: 2017-09-28 12:34:41.253 3163 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:34:41 ctl02 nova-api[3163]: 2017-09-28 12:34:41.253 3163 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:34:41 ctl02 nova-api[3163]: 2017-09-28 12:34:41.253 3163 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:34:41 ctl02 nova-api[3163]: 2017-09-28 12:34:41.253 3163 ERROR nova     sock.listen(backlog)
Sep 28 12:34:41 ctl02 nova-api[3163]: 2017-09-28 12:34:41.253 3163 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:34:41 ctl02 nova-api[3163]: 2017-09-28 12:34:41.253 3163 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:34:41 ctl02 nova-api[3163]: 2017-09-28 12:34:41.253 3163 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:34:41 ctl02 nova-api[3163]: 2017-09-28 12:34:41.253 3163 ERROR nova
Sep 28 12:34:41 ctl02 neutron-server[30536]: 2017-09-28 12:34:41.306 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:34:41] "OPTIONS / HTTP/1.0" 200 262 0.000461
Sep 28 12:34:41 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:34:41 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:34:41 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:34:41 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:34:41 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:34:41 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:34:41 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:34:41 ctl02 glance-api[29183]: 2017-09-28 12:34:41.675 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:34:41] "OPTIONS / HTTP/1.0" 200 134 0.000677
Sep 28 12:34:41 ctl02 heat-api-cfn[13300]: 2017-09-28 12:34:41.987 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:34:41] "OPTIONS / HTTP/1.0" 200 134 0.000452
Sep 28 12:34:42 ctl02 neutron-server[30536]: 2017-09-28 12:34:42.031 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:34:42] "OPTIONS / HTTP/1.0" 200 262 0.000456
Sep 28 12:34:43 ctl02 glance-api[29183]: 2017-09-28 12:34:43.288 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:34:43] "OPTIONS / HTTP/1.0" 200 134 0.000578
Sep 28 12:34:43 ctl02 nova-api[3181]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:34:43 ctl02 nova-api[3181]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:34:43 ctl02 nova-api[3181]: 2017-09-28 12:34:43.494 3181 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:34:43 ctl02 nova-api[3181]: 2017-09-28 12:34:43.496 3181 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:34:43 ctl02 nova-api[3181]: 2017-09-28 12:34:43.496 3181 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:34:43 ctl02 nova-api[3181]: 2017-09-28 12:34:43.496 3181 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:34:43 ctl02 nova-api[3181]: 2017-09-28 12:34:43.496 3181 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:34:43 ctl02 nova-api[3181]: 2017-09-28 12:34:43.496 3181 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:34:43 ctl02 nova-api[3181]: 2017-09-28 12:34:43.496 3181 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:34:43 ctl02 nova-api[3181]: 2017-09-28 12:34:43.496 3181 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:34:43 ctl02 nova-api[3181]: 2017-09-28 12:34:43.496 3181 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:34:43 ctl02 nova-api[3181]: 2017-09-28 12:34:43.496 3181 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:34:43 ctl02 nova-api[3181]: 2017-09-28 12:34:43.496 3181 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:34:43 ctl02 nova-api[3181]: 2017-09-28 12:34:43.496 3181 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:34:43 ctl02 nova-api[3181]: 2017-09-28 12:34:43.496 3181 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:34:43 ctl02 nova-api[3181]: 2017-09-28 12:34:43.496 3181 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:34:43 ctl02 nova-api[3181]: 2017-09-28 12:34:43.496 3181 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:34:43 ctl02 nova-api[3181]: 2017-09-28 12:34:43.496 3181 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:34:43 ctl02 nova-api[3181]: 2017-09-28 12:34:43.496 3181 ERROR nova.wsgi     self.filename))
Sep 28 12:34:43 ctl02 nova-api[3181]: 2017-09-28 12:34:43.496 3181 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:34:43 ctl02 nova-api[3181]: 2017-09-28 12:34:43.496 3181 ERROR nova.wsgi
Sep 28 12:34:43 ctl02 nova-api[3181]: 2017-09-28 12:34:43.498 3181 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:34:43 ctl02 nova-api[3181]: 2017-09-28 12:34:43.625 3181 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:34:43 ctl02 glance-api[29183]: 2017-09-28 12:34:43.650 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:34:43] "OPTIONS / HTTP/1.0" 200 134 0.000557
Sep 28 12:34:43 ctl02 nova-api[3181]: 2017-09-28 12:34:43.849 3181 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:34:43 ctl02 nova-api[3181]: 2017-09-28 12:34:43.851 3181 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:34:43 ctl02 nova-api[3181]: 2017-09-28 12:34:43.852 3181 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:34:43 ctl02 nova-api[3181]: 2017-09-28 12:34:43.852 3181 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:34:43 ctl02 nova-api[3181]: 2017-09-28 12:34:43.982 3181 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:34:43 ctl02 nova-api[3181]: 2017-09-28 12:34:43.984 3181 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:34:43 ctl02 nova-api[3181]: 2017-09-28 12:34:43.985 3181 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:34:43 ctl02 nova-api[3181]: 2017-09-28 12:34:43.985 3181 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:34:43 ctl02 nova-api[3181]: 2017-09-28 12:34:43.988 3181 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:34:43 ctl02 nova-api[3181]: 2017-09-28 12:34:43.989 3181 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:34:43 ctl02 nova-api[3181]: 2017-09-28 12:34:43.989 3181 ERROR nova Traceback (most recent call last):
Sep 28 12:34:43 ctl02 nova-api[3181]: 2017-09-28 12:34:43.989 3181 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:34:43 ctl02 nova-api[3181]: 2017-09-28 12:34:43.989 3181 ERROR nova     sys.exit(main())
Sep 28 12:34:43 ctl02 nova-api[3181]: 2017-09-28 12:34:43.989 3181 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:34:43 ctl02 nova-api[3181]: 2017-09-28 12:34:43.989 3181 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:34:43 ctl02 nova-api[3181]: 2017-09-28 12:34:43.989 3181 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:34:43 ctl02 nova-api[3181]: 2017-09-28 12:34:43.989 3181 ERROR nova     max_url_len=max_url_len)
Sep 28 12:34:43 ctl02 nova-api[3181]: 2017-09-28 12:34:43.989 3181 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:34:43 ctl02 nova-api[3181]: 2017-09-28 12:34:43.989 3181 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:34:43 ctl02 nova-api[3181]: 2017-09-28 12:34:43.989 3181 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:34:43 ctl02 nova-api[3181]: 2017-09-28 12:34:43.989 3181 ERROR nova     sock.listen(backlog)
Sep 28 12:34:43 ctl02 nova-api[3181]: 2017-09-28 12:34:43.989 3181 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:34:43 ctl02 nova-api[3181]: 2017-09-28 12:34:43.989 3181 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:34:43 ctl02 nova-api[3181]: 2017-09-28 12:34:43.989 3181 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:34:43 ctl02 nova-api[3181]: 2017-09-28 12:34:43.989 3181 ERROR nova
Sep 28 12:34:44 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:34:44 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:34:44 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:34:44 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:34:44.346 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:34:44] "OPTIONS / HTTP/1.0" 200 134 0.000590
Sep 28 12:34:44 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:34:44 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:34:44 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:34:44 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:34:45 ctl02 heat-api[13008]: 2017-09-28 12:34:45.057 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:34:45] "OPTIONS / HTTP/1.0" 200 134 0.000551
Sep 28 12:34:45 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:34:45.114 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:34:45] "OPTIONS / HTTP/1.0" 200 134 0.000407
Sep 28 12:34:46 ctl02 nova-cert[4860]: 2017-09-28 12:34:46.060 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:34:46 ctl02 nova-api[3199]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:34:46 ctl02 nova-api[3199]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:34:46 ctl02 nova-api[3199]: 2017-09-28 12:34:46.249 3199 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:34:46 ctl02 nova-api[3199]: 2017-09-28 12:34:46.251 3199 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:34:46 ctl02 nova-api[3199]: 2017-09-28 12:34:46.251 3199 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:34:46 ctl02 nova-api[3199]: 2017-09-28 12:34:46.251 3199 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:34:46 ctl02 nova-api[3199]: 2017-09-28 12:34:46.251 3199 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:34:46 ctl02 nova-api[3199]: 2017-09-28 12:34:46.251 3199 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:34:46 ctl02 nova-api[3199]: 2017-09-28 12:34:46.251 3199 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:34:46 ctl02 nova-api[3199]: 2017-09-28 12:34:46.251 3199 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:34:46 ctl02 nova-api[3199]: 2017-09-28 12:34:46.251 3199 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:34:46 ctl02 nova-api[3199]: 2017-09-28 12:34:46.251 3199 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:34:46 ctl02 nova-api[3199]: 2017-09-28 12:34:46.251 3199 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:34:46 ctl02 nova-api[3199]: 2017-09-28 12:34:46.251 3199 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:34:46 ctl02 nova-api[3199]: 2017-09-28 12:34:46.251 3199 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:34:46 ctl02 nova-api[3199]: 2017-09-28 12:34:46.251 3199 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:34:46 ctl02 nova-api[3199]: 2017-09-28 12:34:46.251 3199 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:34:46 ctl02 nova-api[3199]: 2017-09-28 12:34:46.251 3199 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:34:46 ctl02 nova-api[3199]: 2017-09-28 12:34:46.251 3199 ERROR nova.wsgi     self.filename))
Sep 28 12:34:46 ctl02 nova-api[3199]: 2017-09-28 12:34:46.251 3199 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:34:46 ctl02 nova-api[3199]: 2017-09-28 12:34:46.251 3199 ERROR nova.wsgi
Sep 28 12:34:46 ctl02 nova-api[3199]: 2017-09-28 12:34:46.252 3199 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:34:46 ctl02 nova-api[3199]: 2017-09-28 12:34:46.377 3199 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:34:46 ctl02 nova-api[3199]: 2017-09-28 12:34:46.604 3199 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:34:46 ctl02 nova-api[3199]: 2017-09-28 12:34:46.606 3199 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:34:46 ctl02 nova-api[3199]: 2017-09-28 12:34:46.606 3199 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:34:46 ctl02 nova-api[3199]: 2017-09-28 12:34:46.607 3199 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:34:46 ctl02 nova-api[3199]: 2017-09-28 12:34:46.736 3199 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:34:46 ctl02 nova-api[3199]: 2017-09-28 12:34:46.738 3199 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:34:46 ctl02 nova-api[3199]: 2017-09-28 12:34:46.738 3199 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:34:46 ctl02 nova-api[3199]: 2017-09-28 12:34:46.738 3199 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:34:46 ctl02 nova-api[3199]: 2017-09-28 12:34:46.741 3199 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:34:46 ctl02 nova-api[3199]: 2017-09-28 12:34:46.741 3199 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:34:46 ctl02 nova-api[3199]: 2017-09-28 12:34:46.741 3199 ERROR nova Traceback (most recent call last):
Sep 28 12:34:46 ctl02 nova-api[3199]: 2017-09-28 12:34:46.741 3199 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:34:46 ctl02 nova-api[3199]: 2017-09-28 12:34:46.741 3199 ERROR nova     sys.exit(main())
Sep 28 12:34:46 ctl02 nova-api[3199]: 2017-09-28 12:34:46.741 3199 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:34:46 ctl02 nova-api[3199]: 2017-09-28 12:34:46.741 3199 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:34:46 ctl02 nova-api[3199]: 2017-09-28 12:34:46.741 3199 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:34:46 ctl02 nova-api[3199]: 2017-09-28 12:34:46.741 3199 ERROR nova     max_url_len=max_url_len)
Sep 28 12:34:46 ctl02 nova-api[3199]: 2017-09-28 12:34:46.741 3199 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:34:46 ctl02 nova-api[3199]: 2017-09-28 12:34:46.741 3199 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:34:46 ctl02 nova-api[3199]: 2017-09-28 12:34:46.741 3199 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:34:46 ctl02 nova-api[3199]: 2017-09-28 12:34:46.741 3199 ERROR nova     sock.listen(backlog)
Sep 28 12:34:46 ctl02 nova-api[3199]: 2017-09-28 12:34:46.741 3199 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:34:46 ctl02 nova-api[3199]: 2017-09-28 12:34:46.741 3199 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:34:46 ctl02 nova-api[3199]: 2017-09-28 12:34:46.741 3199 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:34:46 ctl02 nova-api[3199]: 2017-09-28 12:34:46.741 3199 ERROR nova
Sep 28 12:34:46 ctl02 nova-conductor[5056]: 2017-09-28 12:34:46.811 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:34:46 ctl02 nova-conductor[5056]: 2017-09-28 12:34:46.831 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:34:46 ctl02 nova-conductor[5056]: 2017-09-28 12:34:46.842 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:34:46 ctl02 nova-conductor[5056]: 2017-09-28 12:34:46.842 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:34:46 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:34:46 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:34:46 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:34:47 ctl02 heat-api-cfn[13300]: 2017-09-28 12:34:47.093 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:34:47] "OPTIONS / HTTP/1.0" 200 134 0.000599
Sep 28 12:34:47 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:34:47 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:34:47 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:34:47 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:34:47 ctl02 heat-api[13008]: 2017-09-28 12:34:47.250 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:34:47] "OPTIONS / HTTP/1.0" 200 134 0.000600
Sep 28 12:34:47 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:34:47.668 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:34:47] "OPTIONS / HTTP/1.0" 200 134 0.000475
Sep 28 12:34:48 ctl02 heat-api-cfn[13300]: 2017-09-28 12:34:48.553 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:34:48] "OPTIONS / HTTP/1.0" 200 134 0.000588
Sep 28 12:34:48 ctl02 nova-api[3217]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:34:48 ctl02 nova-api[3217]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:34:48 ctl02 nova-api[3217]: 2017-09-28 12:34:48.971 3217 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:34:48 ctl02 nova-api[3217]: 2017-09-28 12:34:48.972 3217 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:34:48 ctl02 nova-api[3217]: 2017-09-28 12:34:48.972 3217 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:34:48 ctl02 nova-api[3217]: 2017-09-28 12:34:48.972 3217 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:34:48 ctl02 nova-api[3217]: 2017-09-28 12:34:48.972 3217 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:34:48 ctl02 nova-api[3217]: 2017-09-28 12:34:48.972 3217 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:34:48 ctl02 nova-api[3217]: 2017-09-28 12:34:48.972 3217 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:34:48 ctl02 nova-api[3217]: 2017-09-28 12:34:48.972 3217 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:34:48 ctl02 nova-api[3217]: 2017-09-28 12:34:48.972 3217 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:34:48 ctl02 nova-api[3217]: 2017-09-28 12:34:48.972 3217 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:34:48 ctl02 nova-api[3217]: 2017-09-28 12:34:48.972 3217 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:34:48 ctl02 nova-api[3217]: 2017-09-28 12:34:48.972 3217 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:34:48 ctl02 nova-api[3217]: 2017-09-28 12:34:48.972 3217 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:34:48 ctl02 nova-api[3217]: 2017-09-28 12:34:48.972 3217 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:34:48 ctl02 nova-api[3217]: 2017-09-28 12:34:48.972 3217 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:34:48 ctl02 nova-api[3217]: 2017-09-28 12:34:48.972 3217 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:34:48 ctl02 nova-api[3217]: 2017-09-28 12:34:48.972 3217 ERROR nova.wsgi     self.filename))
Sep 28 12:34:48 ctl02 nova-api[3217]: 2017-09-28 12:34:48.972 3217 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:34:48 ctl02 nova-api[3217]: 2017-09-28 12:34:48.972 3217 ERROR nova.wsgi
Sep 28 12:34:48 ctl02 nova-api[3217]: 2017-09-28 12:34:48.973 3217 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:34:49 ctl02 nova-api[3217]: 2017-09-28 12:34:49.099 3217 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:34:49 ctl02 nova-api[3217]: 2017-09-28 12:34:49.321 3217 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:34:49 ctl02 nova-api[3217]: 2017-09-28 12:34:49.323 3217 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:34:49 ctl02 nova-api[3217]: 2017-09-28 12:34:49.324 3217 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:34:49 ctl02 nova-api[3217]: 2017-09-28 12:34:49.324 3217 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:34:49 ctl02 heat-api[13008]: 2017-09-28 12:34:49.382 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:34:49] "OPTIONS / HTTP/1.0" 200 134 0.000525
Sep 28 12:34:49 ctl02 nova-api[3217]: 2017-09-28 12:34:49.454 3217 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:34:49 ctl02 nova-api[3217]: 2017-09-28 12:34:49.457 3217 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:34:49 ctl02 nova-api[3217]: 2017-09-28 12:34:49.457 3217 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:34:49 ctl02 nova-api[3217]: 2017-09-28 12:34:49.457 3217 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:34:49 ctl02 nova-api[3217]: 2017-09-28 12:34:49.460 3217 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:34:49 ctl02 nova-api[3217]: 2017-09-28 12:34:49.461 3217 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:34:49 ctl02 nova-api[3217]: 2017-09-28 12:34:49.461 3217 ERROR nova Traceback (most recent call last):
Sep 28 12:34:49 ctl02 nova-api[3217]: 2017-09-28 12:34:49.461 3217 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:34:49 ctl02 nova-api[3217]: 2017-09-28 12:34:49.461 3217 ERROR nova     sys.exit(main())
Sep 28 12:34:49 ctl02 nova-api[3217]: 2017-09-28 12:34:49.461 3217 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:34:49 ctl02 nova-api[3217]: 2017-09-28 12:34:49.461 3217 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:34:49 ctl02 nova-api[3217]: 2017-09-28 12:34:49.461 3217 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:34:49 ctl02 nova-api[3217]: 2017-09-28 12:34:49.461 3217 ERROR nova     max_url_len=max_url_len)
Sep 28 12:34:49 ctl02 nova-api[3217]: 2017-09-28 12:34:49.461 3217 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:34:49 ctl02 nova-api[3217]: 2017-09-28 12:34:49.461 3217 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:34:49 ctl02 nova-api[3217]: 2017-09-28 12:34:49.461 3217 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:34:49 ctl02 nova-api[3217]: 2017-09-28 12:34:49.461 3217 ERROR nova     sock.listen(backlog)
Sep 28 12:34:49 ctl02 nova-api[3217]: 2017-09-28 12:34:49.461 3217 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:34:49 ctl02 nova-api[3217]: 2017-09-28 12:34:49.461 3217 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:34:49 ctl02 nova-api[3217]: 2017-09-28 12:34:49.461 3217 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:34:49 ctl02 nova-api[3217]: 2017-09-28 12:34:49.461 3217 ERROR nova
Sep 28 12:34:49 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:34:49 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:34:49 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:34:49 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:34:49 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:34:49 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:34:49 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:34:50 ctl02 neutron-server[30536]: 2017-09-28 12:34:50.145 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:34:50] "OPTIONS / HTTP/1.0" 200 262 0.000442
Sep 28 12:34:50 ctl02 neutron-server[30536]: 2017-09-28 12:34:50.991 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:34:50] "OPTIONS / HTTP/1.0" 200 262 0.000459
Sep 28 12:34:51 ctl02 nova-api[3235]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:34:51 ctl02 nova-api[3235]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:34:51 ctl02 nova-api[3235]: 2017-09-28 12:34:51.753 3235 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:34:51 ctl02 nova-api[3235]: 2017-09-28 12:34:51.754 3235 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:34:51 ctl02 nova-api[3235]: 2017-09-28 12:34:51.754 3235 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:34:51 ctl02 nova-api[3235]: 2017-09-28 12:34:51.754 3235 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:34:51 ctl02 nova-api[3235]: 2017-09-28 12:34:51.754 3235 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:34:51 ctl02 nova-api[3235]: 2017-09-28 12:34:51.754 3235 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:34:51 ctl02 nova-api[3235]: 2017-09-28 12:34:51.754 3235 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:34:51 ctl02 nova-api[3235]: 2017-09-28 12:34:51.754 3235 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:34:51 ctl02 nova-api[3235]: 2017-09-28 12:34:51.754 3235 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:34:51 ctl02 nova-api[3235]: 2017-09-28 12:34:51.754 3235 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:34:51 ctl02 nova-api[3235]: 2017-09-28 12:34:51.754 3235 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:34:51 ctl02 nova-api[3235]: 2017-09-28 12:34:51.754 3235 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:34:51 ctl02 nova-api[3235]: 2017-09-28 12:34:51.754 3235 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:34:51 ctl02 nova-api[3235]: 2017-09-28 12:34:51.754 3235 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:34:51 ctl02 nova-api[3235]: 2017-09-28 12:34:51.754 3235 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:34:51 ctl02 nova-api[3235]: 2017-09-28 12:34:51.754 3235 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:34:51 ctl02 nova-api[3235]: 2017-09-28 12:34:51.754 3235 ERROR nova.wsgi     self.filename))
Sep 28 12:34:51 ctl02 nova-api[3235]: 2017-09-28 12:34:51.754 3235 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:34:51 ctl02 nova-api[3235]: 2017-09-28 12:34:51.754 3235 ERROR nova.wsgi
Sep 28 12:34:51 ctl02 nova-api[3235]: 2017-09-28 12:34:51.755 3235 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:34:51 ctl02 nova-api[3235]: 2017-09-28 12:34:51.887 3235 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:34:51 ctl02 glance-api[29183]: 2017-09-28 12:34:51.962 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:34:51] "OPTIONS / HTTP/1.0" 200 134 0.000595
Sep 28 12:34:52 ctl02 heat-api-cfn[13300]: 2017-09-28 12:34:52.100 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:34:52] "OPTIONS / HTTP/1.0" 200 134 0.000490
Sep 28 12:34:52 ctl02 nova-api[3235]: 2017-09-28 12:34:52.118 3235 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:34:52 ctl02 nova-api[3235]: 2017-09-28 12:34:52.120 3235 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:34:52 ctl02 nova-api[3235]: 2017-09-28 12:34:52.120 3235 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:34:52 ctl02 nova-api[3235]: 2017-09-28 12:34:52.120 3235 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:34:52 ctl02 neutron-server[30536]: 2017-09-28 12:34:52.173 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:34:52] "OPTIONS / HTTP/1.0" 200 262 0.000970
Sep 28 12:34:52 ctl02 nova-api[3235]: 2017-09-28 12:34:52.251 3235 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:34:52 ctl02 nova-api[3235]: 2017-09-28 12:34:52.253 3235 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:34:52 ctl02 nova-api[3235]: 2017-09-28 12:34:52.254 3235 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:34:52 ctl02 nova-api[3235]: 2017-09-28 12:34:52.254 3235 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:34:52 ctl02 nova-api[3235]: 2017-09-28 12:34:52.257 3235 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:34:52 ctl02 nova-api[3235]: 2017-09-28 12:34:52.257 3235 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:34:52 ctl02 nova-api[3235]: 2017-09-28 12:34:52.257 3235 ERROR nova Traceback (most recent call last):
Sep 28 12:34:52 ctl02 nova-api[3235]: 2017-09-28 12:34:52.257 3235 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:34:52 ctl02 nova-api[3235]: 2017-09-28 12:34:52.257 3235 ERROR nova     sys.exit(main())
Sep 28 12:34:52 ctl02 nova-api[3235]: 2017-09-28 12:34:52.257 3235 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:34:52 ctl02 nova-api[3235]: 2017-09-28 12:34:52.257 3235 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:34:52 ctl02 nova-api[3235]: 2017-09-28 12:34:52.257 3235 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:34:52 ctl02 nova-api[3235]: 2017-09-28 12:34:52.257 3235 ERROR nova     max_url_len=max_url_len)
Sep 28 12:34:52 ctl02 nova-api[3235]: 2017-09-28 12:34:52.257 3235 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:34:52 ctl02 nova-api[3235]: 2017-09-28 12:34:52.257 3235 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:34:52 ctl02 nova-api[3235]: 2017-09-28 12:34:52.257 3235 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:34:52 ctl02 nova-api[3235]: 2017-09-28 12:34:52.257 3235 ERROR nova     sock.listen(backlog)
Sep 28 12:34:52 ctl02 nova-api[3235]: 2017-09-28 12:34:52.257 3235 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:34:52 ctl02 nova-api[3235]: 2017-09-28 12:34:52.257 3235 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:34:52 ctl02 nova-api[3235]: 2017-09-28 12:34:52.257 3235 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:34:52 ctl02 nova-api[3235]: 2017-09-28 12:34:52.257 3235 ERROR nova
Sep 28 12:34:52 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:34:52 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:34:52 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:34:52 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x77b0632e)
Sep 28 12:34:52 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:34:52 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:34:52 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:34:52 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:34:52 ctl02 glance-api[29183]: 2017-09-28 12:34:52.939 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:34:52] "OPTIONS / HTTP/1.0" 200 134 0.000568
Sep 28 12:34:53 ctl02 glance-api[29183]: 2017-09-28 12:34:53.374 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:34:53] "OPTIONS / HTTP/1.0" 200 134 0.000585
Sep 28 12:34:53 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x77b0632e)
Sep 28 12:34:54 ctl02 nova-api[3253]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:34:54 ctl02 nova-api[3253]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:34:54 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x77b0632e)
Sep 28 12:34:54 ctl02 nova-api[3253]: 2017-09-28 12:34:54.509 3253 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:34:54 ctl02 nova-api[3253]: 2017-09-28 12:34:54.511 3253 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:34:54 ctl02 nova-api[3253]: 2017-09-28 12:34:54.511 3253 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:34:54 ctl02 nova-api[3253]: 2017-09-28 12:34:54.511 3253 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:34:54 ctl02 nova-api[3253]: 2017-09-28 12:34:54.511 3253 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:34:54 ctl02 nova-api[3253]: 2017-09-28 12:34:54.511 3253 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:34:54 ctl02 nova-api[3253]: 2017-09-28 12:34:54.511 3253 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:34:54 ctl02 nova-api[3253]: 2017-09-28 12:34:54.511 3253 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:34:54 ctl02 nova-api[3253]: 2017-09-28 12:34:54.511 3253 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:34:54 ctl02 nova-api[3253]: 2017-09-28 12:34:54.511 3253 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:34:54 ctl02 nova-api[3253]: 2017-09-28 12:34:54.511 3253 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:34:54 ctl02 nova-api[3253]: 2017-09-28 12:34:54.511 3253 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:34:54 ctl02 nova-api[3253]: 2017-09-28 12:34:54.511 3253 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:34:54 ctl02 nova-api[3253]: 2017-09-28 12:34:54.511 3253 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:34:54 ctl02 nova-api[3253]: 2017-09-28 12:34:54.511 3253 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:34:54 ctl02 nova-api[3253]: 2017-09-28 12:34:54.511 3253 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:34:54 ctl02 nova-api[3253]: 2017-09-28 12:34:54.511 3253 ERROR nova.wsgi     self.filename))
Sep 28 12:34:54 ctl02 nova-api[3253]: 2017-09-28 12:34:54.511 3253 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:34:54 ctl02 nova-api[3253]: 2017-09-28 12:34:54.511 3253 ERROR nova.wsgi
Sep 28 12:34:54 ctl02 nova-api[3253]: 2017-09-28 12:34:54.513 3253 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:34:54 ctl02 nova-api[3253]: 2017-09-28 12:34:54.640 3253 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:34:54 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:34:54.686 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:34:54] "OPTIONS / HTTP/1.0" 200 134 0.000375
Sep 28 12:34:54 ctl02 nova-api[3253]: 2017-09-28 12:34:54.859 3253 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:34:54 ctl02 nova-api[3253]: 2017-09-28 12:34:54.861 3253 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:34:54 ctl02 nova-api[3253]: 2017-09-28 12:34:54.861 3253 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:34:54 ctl02 nova-api[3253]: 2017-09-28 12:34:54.861 3253 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:34:54 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:34:54.873 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:34:54] "OPTIONS / HTTP/1.0" 200 134 0.000382
Sep 28 12:34:54 ctl02 nova-api[3253]: 2017-09-28 12:34:54.993 3253 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:34:54 ctl02 nova-api[3253]: 2017-09-28 12:34:54.995 3253 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:34:54 ctl02 nova-api[3253]: 2017-09-28 12:34:54.995 3253 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:34:54 ctl02 nova-api[3253]: 2017-09-28 12:34:54.995 3253 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:34:54 ctl02 nova-api[3253]: 2017-09-28 12:34:54.999 3253 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:34:54 ctl02 nova-api[3253]: 2017-09-28 12:34:54.999 3253 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:34:55 ctl02 nova-api[3253]: 2017-09-28 12:34:54.999 3253 ERROR nova Traceback (most recent call last):
Sep 28 12:34:55 ctl02 nova-api[3253]: 2017-09-28 12:34:54.999 3253 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:34:55 ctl02 nova-api[3253]: 2017-09-28 12:34:54.999 3253 ERROR nova     sys.exit(main())
Sep 28 12:34:55 ctl02 nova-api[3253]: 2017-09-28 12:34:54.999 3253 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:34:55 ctl02 nova-api[3253]: 2017-09-28 12:34:54.999 3253 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:34:55 ctl02 nova-api[3253]: 2017-09-28 12:34:54.999 3253 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:34:55 ctl02 nova-api[3253]: 2017-09-28 12:34:54.999 3253 ERROR nova     max_url_len=max_url_len)
Sep 28 12:34:55 ctl02 nova-api[3253]: 2017-09-28 12:34:54.999 3253 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:34:55 ctl02 nova-api[3253]: 2017-09-28 12:34:54.999 3253 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:34:55 ctl02 nova-api[3253]: 2017-09-28 12:34:54.999 3253 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:34:55 ctl02 nova-api[3253]: 2017-09-28 12:34:54.999 3253 ERROR nova     sock.listen(backlog)
Sep 28 12:34:55 ctl02 nova-api[3253]: 2017-09-28 12:34:54.999 3253 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:34:55 ctl02 nova-api[3253]: 2017-09-28 12:34:54.999 3253 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:34:55 ctl02 nova-api[3253]: 2017-09-28 12:34:54.999 3253 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:34:55 ctl02 nova-api[3253]: 2017-09-28 12:34:54.999 3253 ERROR nova
Sep 28 12:34:55 ctl02 heat-api[13008]: 2017-09-28 12:34:55.040 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:34:55] "OPTIONS / HTTP/1.0" 200 134 0.000564
Sep 28 12:34:55 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:34:55 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:34:55 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:34:55 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:34:55 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:34:55 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:34:55 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:34:55 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x77b0632e)
Sep 28 12:34:55 ctl02 nova-consoleauth[5433]: 2017-09-28 12:34:55.935 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:34:56 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x77b0632e)
Sep 28 12:34:57 ctl02 nova-api[3271]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:34:57 ctl02 nova-api[3271]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:34:57 ctl02 heat-api-cfn[13300]: 2017-09-28 12:34:57.143 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:34:57] "OPTIONS / HTTP/1.0" 200 134 0.000594
Sep 28 12:34:57 ctl02 nova-api[3271]: 2017-09-28 12:34:57.271 3271 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:34:57 ctl02 nova-api[3271]: 2017-09-28 12:34:57.273 3271 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:34:57 ctl02 nova-api[3271]: 2017-09-28 12:34:57.273 3271 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:34:57 ctl02 nova-api[3271]: 2017-09-28 12:34:57.273 3271 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:34:57 ctl02 nova-api[3271]: 2017-09-28 12:34:57.273 3271 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:34:57 ctl02 nova-api[3271]: 2017-09-28 12:34:57.273 3271 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:34:57 ctl02 nova-api[3271]: 2017-09-28 12:34:57.273 3271 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:34:57 ctl02 nova-api[3271]: 2017-09-28 12:34:57.273 3271 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:34:57 ctl02 nova-api[3271]: 2017-09-28 12:34:57.273 3271 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:34:57 ctl02 nova-api[3271]: 2017-09-28 12:34:57.273 3271 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:34:57 ctl02 nova-api[3271]: 2017-09-28 12:34:57.273 3271 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:34:57 ctl02 nova-api[3271]: 2017-09-28 12:34:57.273 3271 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:34:57 ctl02 nova-api[3271]: 2017-09-28 12:34:57.273 3271 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:34:57 ctl02 nova-api[3271]: 2017-09-28 12:34:57.273 3271 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:34:57 ctl02 nova-api[3271]: 2017-09-28 12:34:57.273 3271 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:34:57 ctl02 nova-api[3271]: 2017-09-28 12:34:57.273 3271 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:34:57 ctl02 nova-api[3271]: 2017-09-28 12:34:57.273 3271 ERROR nova.wsgi     self.filename))
Sep 28 12:34:57 ctl02 nova-api[3271]: 2017-09-28 12:34:57.273 3271 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:34:57 ctl02 nova-api[3271]: 2017-09-28 12:34:57.273 3271 ERROR nova.wsgi
Sep 28 12:34:57 ctl02 nova-api[3271]: 2017-09-28 12:34:57.274 3271 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:34:57 ctl02 nova-api[3271]: 2017-09-28 12:34:57.402 3271 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:34:57 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x77b0632e)
Sep 28 12:34:57 ctl02 heat-api[13008]: 2017-09-28 12:34:57.601 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:34:57] "OPTIONS / HTTP/1.0" 200 134 0.000623
Sep 28 12:34:57 ctl02 nova-api[3271]: 2017-09-28 12:34:57.652 3271 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:34:57 ctl02 nova-api[3271]: 2017-09-28 12:34:57.654 3271 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:34:57 ctl02 nova-api[3271]: 2017-09-28 12:34:57.654 3271 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:34:57 ctl02 nova-api[3271]: 2017-09-28 12:34:57.654 3271 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:34:57 ctl02 nova-api[3271]: 2017-09-28 12:34:57.787 3271 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:34:57 ctl02 nova-api[3271]: 2017-09-28 12:34:57.789 3271 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:34:57 ctl02 nova-api[3271]: 2017-09-28 12:34:57.789 3271 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:34:57 ctl02 nova-api[3271]: 2017-09-28 12:34:57.790 3271 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:34:57 ctl02 nova-api[3271]: 2017-09-28 12:34:57.793 3271 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:34:57 ctl02 nova-api[3271]: 2017-09-28 12:34:57.793 3271 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:34:57 ctl02 nova-api[3271]: 2017-09-28 12:34:57.793 3271 ERROR nova Traceback (most recent call last):
Sep 28 12:34:57 ctl02 nova-api[3271]: 2017-09-28 12:34:57.793 3271 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:34:57 ctl02 nova-api[3271]: 2017-09-28 12:34:57.793 3271 ERROR nova     sys.exit(main())
Sep 28 12:34:57 ctl02 nova-api[3271]: 2017-09-28 12:34:57.793 3271 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:34:57 ctl02 nova-api[3271]: 2017-09-28 12:34:57.793 3271 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:34:57 ctl02 nova-api[3271]: 2017-09-28 12:34:57.793 3271 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:34:57 ctl02 nova-api[3271]: 2017-09-28 12:34:57.793 3271 ERROR nova     max_url_len=max_url_len)
Sep 28 12:34:57 ctl02 nova-api[3271]: 2017-09-28 12:34:57.793 3271 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:34:57 ctl02 nova-api[3271]: 2017-09-28 12:34:57.793 3271 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:34:57 ctl02 nova-api[3271]: 2017-09-28 12:34:57.793 3271 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:34:57 ctl02 nova-api[3271]: 2017-09-28 12:34:57.793 3271 ERROR nova     sock.listen(backlog)
Sep 28 12:34:57 ctl02 nova-api[3271]: 2017-09-28 12:34:57.793 3271 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:34:57 ctl02 nova-api[3271]: 2017-09-28 12:34:57.793 3271 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:34:57 ctl02 nova-api[3271]: 2017-09-28 12:34:57.793 3271 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:34:57 ctl02 nova-api[3271]: 2017-09-28 12:34:57.793 3271 ERROR nova
Sep 28 12:34:57 ctl02 heat-engine[12803]: 2017-09-28 12:34:57.945 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:34:57 ctl02 heat-engine[12803]: 2017-09-28 12:34:57.948 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:34:57 ctl02 heat-engine[12803]: 2017-09-28 12:34:57.952 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:34:57 ctl02 heat-engine[12803]: 2017-09-28 12:34:57.956 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:34:57 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:34:57.958 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:34:57] "OPTIONS / HTTP/1.0" 200 134 0.000415
Sep 28 12:34:57 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:34:57 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:34:57 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:34:58 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:34:58 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:34:58 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:34:58 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:34:58 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x77b0632e)
Sep 28 12:34:58 ctl02 heat-api-cfn[13300]: 2017-09-28 12:34:58.800 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:34:58] "OPTIONS / HTTP/1.0" 200 134 0.000551
Sep 28 12:34:58 ctl02 nova-scheduler[5620]: 2017-09-28 12:34:58.978 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:34:59 ctl02 heat-api[13008]: 2017-09-28 12:34:59.287 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:34:59] "OPTIONS / HTTP/1.0" 200 134 0.000523
Sep 28 12:34:59 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x77b0632e)
Sep 28 12:34:59 ctl02 nova-api[3289]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:34:59 ctl02 nova-api[3289]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:34:59 ctl02 neutron-server[30536]: 2017-09-28 12:34:59.855 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:34:59] "OPTIONS / HTTP/1.0" 200 262 0.000831
Sep 28 12:35:00 ctl02 nova-api[3289]: 2017-09-28 12:35:00.015 3289 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:35:00 ctl02 nova-api[3289]: 2017-09-28 12:35:00.016 3289 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:35:00 ctl02 nova-api[3289]: 2017-09-28 12:35:00.016 3289 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:35:00 ctl02 nova-api[3289]: 2017-09-28 12:35:00.016 3289 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:35:00 ctl02 nova-api[3289]: 2017-09-28 12:35:00.016 3289 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:35:00 ctl02 nova-api[3289]: 2017-09-28 12:35:00.016 3289 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:35:00 ctl02 nova-api[3289]: 2017-09-28 12:35:00.016 3289 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:35:00 ctl02 nova-api[3289]: 2017-09-28 12:35:00.016 3289 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:35:00 ctl02 nova-api[3289]: 2017-09-28 12:35:00.016 3289 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:35:00 ctl02 nova-api[3289]: 2017-09-28 12:35:00.016 3289 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:35:00 ctl02 nova-api[3289]: 2017-09-28 12:35:00.016 3289 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:35:00 ctl02 nova-api[3289]: 2017-09-28 12:35:00.016 3289 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:35:00 ctl02 nova-api[3289]: 2017-09-28 12:35:00.016 3289 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:35:00 ctl02 nova-api[3289]: 2017-09-28 12:35:00.016 3289 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:35:00 ctl02 nova-api[3289]: 2017-09-28 12:35:00.016 3289 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:35:00 ctl02 nova-api[3289]: 2017-09-28 12:35:00.016 3289 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:35:00 ctl02 nova-api[3289]: 2017-09-28 12:35:00.016 3289 ERROR nova.wsgi     self.filename))
Sep 28 12:35:00 ctl02 nova-api[3289]: 2017-09-28 12:35:00.016 3289 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:35:00 ctl02 nova-api[3289]: 2017-09-28 12:35:00.016 3289 ERROR nova.wsgi
Sep 28 12:35:00 ctl02 nova-api[3289]: 2017-09-28 12:35:00.017 3289 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:35:00 ctl02 nova-api[3289]: 2017-09-28 12:35:00.151 3289 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:35:00 ctl02 nova-api[3289]: 2017-09-28 12:35:00.404 3289 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:35:00 ctl02 nova-api[3289]: 2017-09-28 12:35:00.407 3289 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:35:00 ctl02 nova-api[3289]: 2017-09-28 12:35:00.408 3289 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:35:00 ctl02 nova-api[3289]: 2017-09-28 12:35:00.408 3289 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:35:00 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x77b0632e)
Sep 28 12:35:00 ctl02 nova-api[3289]: 2017-09-28 12:35:00.543 3289 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:35:00 ctl02 nova-api[3289]: 2017-09-28 12:35:00.547 3289 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:35:00 ctl02 nova-api[3289]: 2017-09-28 12:35:00.547 3289 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:35:00 ctl02 nova-api[3289]: 2017-09-28 12:35:00.549 3289 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:35:00 ctl02 nova-api[3289]: 2017-09-28 12:35:00.552 3289 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:35:00 ctl02 nova-api[3289]: 2017-09-28 12:35:00.553 3289 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:35:00 ctl02 nova-api[3289]: 2017-09-28 12:35:00.553 3289 ERROR nova Traceback (most recent call last):
Sep 28 12:35:00 ctl02 nova-api[3289]: 2017-09-28 12:35:00.553 3289 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:35:00 ctl02 nova-api[3289]: 2017-09-28 12:35:00.553 3289 ERROR nova     sys.exit(main())
Sep 28 12:35:00 ctl02 nova-api[3289]: 2017-09-28 12:35:00.553 3289 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:35:00 ctl02 nova-api[3289]: 2017-09-28 12:35:00.553 3289 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:35:00 ctl02 nova-api[3289]: 2017-09-28 12:35:00.553 3289 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:35:00 ctl02 nova-api[3289]: 2017-09-28 12:35:00.553 3289 ERROR nova     max_url_len=max_url_len)
Sep 28 12:35:00 ctl02 nova-api[3289]: 2017-09-28 12:35:00.553 3289 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:35:00 ctl02 nova-api[3289]: 2017-09-28 12:35:00.553 3289 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:35:00 ctl02 nova-api[3289]: 2017-09-28 12:35:00.553 3289 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:35:00 ctl02 nova-api[3289]: 2017-09-28 12:35:00.553 3289 ERROR nova     sock.listen(backlog)
Sep 28 12:35:00 ctl02 nova-api[3289]: 2017-09-28 12:35:00.553 3289 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:35:00 ctl02 nova-api[3289]: 2017-09-28 12:35:00.553 3289 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:35:00 ctl02 nova-api[3289]: 2017-09-28 12:35:00.553 3289 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:35:00 ctl02 nova-api[3289]: 2017-09-28 12:35:00.553 3289 ERROR nova
Sep 28 12:35:00 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:35:00 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:35:00 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:35:00 ctl02 neutron-server[30536]: 2017-09-28 12:35:00.851 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:35:00] "OPTIONS / HTTP/1.0" 200 262 0.000627
Sep 28 12:35:00 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:35:00 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:35:00 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:35:00 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:35:01 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x77b0632e)
Sep 28 12:35:01 ctl02 neutron-server[30536]: 2017-09-28 12:35:01.882 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:35:01] "OPTIONS / HTTP/1.0" 200 262 0.000494
Sep 28 12:35:01 ctl02 heat-api-cfn[13300]: 2017-09-28 12:35:01.900 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:35:01] "OPTIONS / HTTP/1.0" 200 134 0.000424
Sep 28 12:35:02 ctl02 glance-api[29183]: 2017-09-28 12:35:02.019 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:35:02] "OPTIONS / HTTP/1.0" 200 134 0.000920
Sep 28 12:35:02 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x77b0632e)
Sep 28 12:35:02 ctl02 nova-api[3307]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:35:02 ctl02 nova-api[3307]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:35:02 ctl02 nova-api[3307]: 2017-09-28 12:35:02.776 3307 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:35:02 ctl02 nova-api[3307]: 2017-09-28 12:35:02.778 3307 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:35:02 ctl02 nova-api[3307]: 2017-09-28 12:35:02.778 3307 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:35:02 ctl02 nova-api[3307]: 2017-09-28 12:35:02.778 3307 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:35:02 ctl02 nova-api[3307]: 2017-09-28 12:35:02.778 3307 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:35:02 ctl02 nova-api[3307]: 2017-09-28 12:35:02.778 3307 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:35:02 ctl02 nova-api[3307]: 2017-09-28 12:35:02.778 3307 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:35:02 ctl02 nova-api[3307]: 2017-09-28 12:35:02.778 3307 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:35:02 ctl02 nova-api[3307]: 2017-09-28 12:35:02.778 3307 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:35:02 ctl02 nova-api[3307]: 2017-09-28 12:35:02.778 3307 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:35:02 ctl02 nova-api[3307]: 2017-09-28 12:35:02.778 3307 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:35:02 ctl02 nova-api[3307]: 2017-09-28 12:35:02.778 3307 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:35:02 ctl02 nova-api[3307]: 2017-09-28 12:35:02.778 3307 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:35:02 ctl02 nova-api[3307]: 2017-09-28 12:35:02.778 3307 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:35:02 ctl02 nova-api[3307]: 2017-09-28 12:35:02.778 3307 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:35:02 ctl02 nova-api[3307]: 2017-09-28 12:35:02.778 3307 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:35:02 ctl02 nova-api[3307]: 2017-09-28 12:35:02.778 3307 ERROR nova.wsgi     self.filename))
Sep 28 12:35:02 ctl02 nova-api[3307]: 2017-09-28 12:35:02.778 3307 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:35:02 ctl02 nova-api[3307]: 2017-09-28 12:35:02.778 3307 ERROR nova.wsgi
Sep 28 12:35:02 ctl02 nova-api[3307]: 2017-09-28 12:35:02.780 3307 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:35:02 ctl02 nova-api[3307]: 2017-09-28 12:35:02.913 3307 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:35:02 ctl02 glance-api[29183]: 2017-09-28 12:35:02.981 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:35:02] "OPTIONS / HTTP/1.0" 200 134 0.000618
Sep 28 12:35:03 ctl02 glance-api[29183]: 2017-09-28 12:35:03.051 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:35:03] "OPTIONS / HTTP/1.0" 200 134 0.000630
Sep 28 12:35:03 ctl02 nova-api[3307]: 2017-09-28 12:35:03.169 3307 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:35:03 ctl02 nova-api[3307]: 2017-09-28 12:35:03.172 3307 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:35:03 ctl02 nova-api[3307]: 2017-09-28 12:35:03.172 3307 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:35:03 ctl02 nova-api[3307]: 2017-09-28 12:35:03.173 3307 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:35:03 ctl02 nova-api[3307]: 2017-09-28 12:35:03.308 3307 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:35:03 ctl02 nova-api[3307]: 2017-09-28 12:35:03.311 3307 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:35:03 ctl02 nova-api[3307]: 2017-09-28 12:35:03.311 3307 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:35:03 ctl02 nova-api[3307]: 2017-09-28 12:35:03.312 3307 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:35:03 ctl02 nova-api[3307]: 2017-09-28 12:35:03.315 3307 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:35:03 ctl02 nova-api[3307]: 2017-09-28 12:35:03.315 3307 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:35:03 ctl02 nova-api[3307]: 2017-09-28 12:35:03.315 3307 ERROR nova Traceback (most recent call last):
Sep 28 12:35:03 ctl02 nova-api[3307]: 2017-09-28 12:35:03.315 3307 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:35:03 ctl02 nova-api[3307]: 2017-09-28 12:35:03.315 3307 ERROR nova     sys.exit(main())
Sep 28 12:35:03 ctl02 nova-api[3307]: 2017-09-28 12:35:03.315 3307 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:35:03 ctl02 nova-api[3307]: 2017-09-28 12:35:03.315 3307 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:35:03 ctl02 nova-api[3307]: 2017-09-28 12:35:03.315 3307 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:35:03 ctl02 nova-api[3307]: 2017-09-28 12:35:03.315 3307 ERROR nova     max_url_len=max_url_len)
Sep 28 12:35:03 ctl02 nova-api[3307]: 2017-09-28 12:35:03.315 3307 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:35:03 ctl02 nova-api[3307]: 2017-09-28 12:35:03.315 3307 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:35:03 ctl02 nova-api[3307]: 2017-09-28 12:35:03.315 3307 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:35:03 ctl02 nova-api[3307]: 2017-09-28 12:35:03.315 3307 ERROR nova     sock.listen(backlog)
Sep 28 12:35:03 ctl02 nova-api[3307]: 2017-09-28 12:35:03.315 3307 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:35:03 ctl02 nova-api[3307]: 2017-09-28 12:35:03.315 3307 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:35:03 ctl02 nova-api[3307]: 2017-09-28 12:35:03.315 3307 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:35:03 ctl02 nova-api[3307]: 2017-09-28 12:35:03.315 3307 ERROR nova
Sep 28 12:35:03 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:35:03 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:35:03 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:35:03 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:35:03 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:35:03 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:35:03 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:35:03 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:35:03 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:35:04 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:35:04.654 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:35:04] "OPTIONS / HTTP/1.0" 200 134 0.000430
Sep 28 12:35:04 ctl02 heat-api[13008]: 2017-09-28 12:35:04.879 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:35:04] "OPTIONS / HTTP/1.0" 200 134 0.000542
Sep 28 12:35:05 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:35:05.099 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:35:05] "OPTIONS / HTTP/1.0" 200 134 0.000395
Sep 28 12:35:05 ctl02 nova-api[3330]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:35:05 ctl02 nova-api[3330]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:35:05 ctl02 nova-api[3330]: 2017-09-28 12:35:05.503 3330 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:35:05 ctl02 nova-api[3330]: 2017-09-28 12:35:05.505 3330 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:35:05 ctl02 nova-api[3330]: 2017-09-28 12:35:05.505 3330 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:35:05 ctl02 nova-api[3330]: 2017-09-28 12:35:05.505 3330 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:35:05 ctl02 nova-api[3330]: 2017-09-28 12:35:05.505 3330 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:35:05 ctl02 nova-api[3330]: 2017-09-28 12:35:05.505 3330 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:35:05 ctl02 nova-api[3330]: 2017-09-28 12:35:05.505 3330 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:35:05 ctl02 nova-api[3330]: 2017-09-28 12:35:05.505 3330 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:35:05 ctl02 nova-api[3330]: 2017-09-28 12:35:05.505 3330 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:35:05 ctl02 nova-api[3330]: 2017-09-28 12:35:05.505 3330 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:35:05 ctl02 nova-api[3330]: 2017-09-28 12:35:05.505 3330 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:35:05 ctl02 nova-api[3330]: 2017-09-28 12:35:05.505 3330 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:35:05 ctl02 nova-api[3330]: 2017-09-28 12:35:05.505 3330 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:35:05 ctl02 nova-api[3330]: 2017-09-28 12:35:05.505 3330 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:35:05 ctl02 nova-api[3330]: 2017-09-28 12:35:05.505 3330 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:35:05 ctl02 nova-api[3330]: 2017-09-28 12:35:05.505 3330 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:35:05 ctl02 nova-api[3330]: 2017-09-28 12:35:05.505 3330 ERROR nova.wsgi     self.filename))
Sep 28 12:35:05 ctl02 nova-api[3330]: 2017-09-28 12:35:05.505 3330 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:35:05 ctl02 nova-api[3330]: 2017-09-28 12:35:05.505 3330 ERROR nova.wsgi
Sep 28 12:35:05 ctl02 nova-api[3330]: 2017-09-28 12:35:05.506 3330 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:35:05 ctl02 nova-api[3330]: 2017-09-28 12:35:05.634 3330 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:35:05 ctl02 nova-api[3330]: 2017-09-28 12:35:05.856 3330 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:35:05 ctl02 nova-api[3330]: 2017-09-28 12:35:05.858 3330 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:35:05 ctl02 nova-api[3330]: 2017-09-28 12:35:05.859 3330 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:35:05 ctl02 nova-api[3330]: 2017-09-28 12:35:05.859 3330 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:35:05 ctl02 nova-api[3330]: 2017-09-28 12:35:05.989 3330 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:35:05 ctl02 nova-api[3330]: 2017-09-28 12:35:05.991 3330 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:35:05 ctl02 nova-api[3330]: 2017-09-28 12:35:05.991 3330 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:35:05 ctl02 nova-api[3330]: 2017-09-28 12:35:05.991 3330 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:35:05 ctl02 nova-api[3330]: 2017-09-28 12:35:05.994 3330 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:35:05 ctl02 nova-api[3330]: 2017-09-28 12:35:05.995 3330 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:35:05 ctl02 nova-api[3330]: 2017-09-28 12:35:05.995 3330 ERROR nova Traceback (most recent call last):
Sep 28 12:35:05 ctl02 nova-api[3330]: 2017-09-28 12:35:05.995 3330 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:35:05 ctl02 nova-api[3330]: 2017-09-28 12:35:05.995 3330 ERROR nova     sys.exit(main())
Sep 28 12:35:05 ctl02 nova-api[3330]: 2017-09-28 12:35:05.995 3330 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:35:05 ctl02 nova-api[3330]: 2017-09-28 12:35:05.995 3330 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:35:05 ctl02 nova-api[3330]: 2017-09-28 12:35:05.995 3330 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:35:05 ctl02 nova-api[3330]: 2017-09-28 12:35:05.995 3330 ERROR nova     max_url_len=max_url_len)
Sep 28 12:35:05 ctl02 nova-api[3330]: 2017-09-28 12:35:05.995 3330 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:35:05 ctl02 nova-api[3330]: 2017-09-28 12:35:05.995 3330 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:35:05 ctl02 nova-api[3330]: 2017-09-28 12:35:05.995 3330 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:35:05 ctl02 nova-api[3330]: 2017-09-28 12:35:05.995 3330 ERROR nova     sock.listen(backlog)
Sep 28 12:35:05 ctl02 nova-api[3330]: 2017-09-28 12:35:05.995 3330 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:35:05 ctl02 nova-api[3330]: 2017-09-28 12:35:05.995 3330 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:35:05 ctl02 nova-api[3330]: 2017-09-28 12:35:05.995 3330 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:35:05 ctl02 nova-api[3330]: 2017-09-28 12:35:05.995 3330 ERROR nova
Sep 28 12:35:06 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:35:06 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:35:06 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:35:06 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:35:06 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:35:06 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:35:06 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:35:07 ctl02 heat-api[13008]: 2017-09-28 12:35:07.340 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:35:07] "OPTIONS / HTTP/1.0" 200 134 0.000640
Sep 28 12:35:07 ctl02 heat-api-cfn[13300]: 2017-09-28 12:35:07.475 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:35:07] "OPTIONS / HTTP/1.0" 200 134 0.000454
Sep 28 12:35:08 ctl02 nova-api[3348]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:35:08 ctl02 nova-api[3348]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:35:08 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:35:08.106 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:35:08] "OPTIONS / HTTP/1.0" 200 134 0.000408
Sep 28 12:35:08 ctl02 nova-api[3348]: 2017-09-28 12:35:08.273 3348 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:35:08 ctl02 nova-api[3348]: 2017-09-28 12:35:08.275 3348 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:35:08 ctl02 nova-api[3348]: 2017-09-28 12:35:08.275 3348 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:35:08 ctl02 nova-api[3348]: 2017-09-28 12:35:08.275 3348 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:35:08 ctl02 nova-api[3348]: 2017-09-28 12:35:08.275 3348 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:35:08 ctl02 nova-api[3348]: 2017-09-28 12:35:08.275 3348 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:35:08 ctl02 nova-api[3348]: 2017-09-28 12:35:08.275 3348 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:35:08 ctl02 nova-api[3348]: 2017-09-28 12:35:08.275 3348 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:35:08 ctl02 nova-api[3348]: 2017-09-28 12:35:08.275 3348 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:35:08 ctl02 nova-api[3348]: 2017-09-28 12:35:08.275 3348 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:35:08 ctl02 nova-api[3348]: 2017-09-28 12:35:08.275 3348 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:35:08 ctl02 nova-api[3348]: 2017-09-28 12:35:08.275 3348 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:35:08 ctl02 nova-api[3348]: 2017-09-28 12:35:08.275 3348 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:35:08 ctl02 nova-api[3348]: 2017-09-28 12:35:08.275 3348 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:35:08 ctl02 nova-api[3348]: 2017-09-28 12:35:08.275 3348 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:35:08 ctl02 nova-api[3348]: 2017-09-28 12:35:08.275 3348 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:35:08 ctl02 nova-api[3348]: 2017-09-28 12:35:08.275 3348 ERROR nova.wsgi     self.filename))
Sep 28 12:35:08 ctl02 nova-api[3348]: 2017-09-28 12:35:08.275 3348 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:35:08 ctl02 nova-api[3348]: 2017-09-28 12:35:08.275 3348 ERROR nova.wsgi
Sep 28 12:35:08 ctl02 nova-api[3348]: 2017-09-28 12:35:08.276 3348 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:35:08 ctl02 nova-api[3348]: 2017-09-28 12:35:08.401 3348 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:35:08 ctl02 nova-api[3348]: 2017-09-28 12:35:08.626 3348 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:35:08 ctl02 nova-api[3348]: 2017-09-28 12:35:08.628 3348 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:35:08 ctl02 nova-api[3348]: 2017-09-28 12:35:08.628 3348 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:35:08 ctl02 nova-api[3348]: 2017-09-28 12:35:08.628 3348 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:35:08 ctl02 nova-api[3348]: 2017-09-28 12:35:08.760 3348 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:35:08 ctl02 nova-api[3348]: 2017-09-28 12:35:08.761 3348 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:35:08 ctl02 nova-api[3348]: 2017-09-28 12:35:08.762 3348 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:35:08 ctl02 nova-api[3348]: 2017-09-28 12:35:08.762 3348 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:35:08 ctl02 nova-api[3348]: 2017-09-28 12:35:08.765 3348 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:35:08 ctl02 nova-api[3348]: 2017-09-28 12:35:08.765 3348 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:35:08 ctl02 nova-api[3348]: 2017-09-28 12:35:08.765 3348 ERROR nova Traceback (most recent call last):
Sep 28 12:35:08 ctl02 nova-api[3348]: 2017-09-28 12:35:08.765 3348 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:35:08 ctl02 nova-api[3348]: 2017-09-28 12:35:08.765 3348 ERROR nova     sys.exit(main())
Sep 28 12:35:08 ctl02 nova-api[3348]: 2017-09-28 12:35:08.765 3348 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:35:08 ctl02 nova-api[3348]: 2017-09-28 12:35:08.765 3348 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:35:08 ctl02 nova-api[3348]: 2017-09-28 12:35:08.765 3348 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:35:08 ctl02 nova-api[3348]: 2017-09-28 12:35:08.765 3348 ERROR nova     max_url_len=max_url_len)
Sep 28 12:35:08 ctl02 nova-api[3348]: 2017-09-28 12:35:08.765 3348 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:35:08 ctl02 nova-api[3348]: 2017-09-28 12:35:08.765 3348 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:35:08 ctl02 nova-api[3348]: 2017-09-28 12:35:08.765 3348 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:35:08 ctl02 nova-api[3348]: 2017-09-28 12:35:08.765 3348 ERROR nova     sock.listen(backlog)
Sep 28 12:35:08 ctl02 nova-api[3348]: 2017-09-28 12:35:08.765 3348 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:35:08 ctl02 nova-api[3348]: 2017-09-28 12:35:08.765 3348 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:35:08 ctl02 nova-api[3348]: 2017-09-28 12:35:08.765 3348 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:35:08 ctl02 nova-api[3348]: 2017-09-28 12:35:08.765 3348 ERROR nova
Sep 28 12:35:08 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:35:08 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:35:08 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:35:09 ctl02 heat-api-cfn[13300]: 2017-09-28 12:35:09.077 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:35:09] "OPTIONS / HTTP/1.0" 200 134 0.000525
Sep 28 12:35:09 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:35:09 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:35:09 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:35:09 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:35:09 ctl02 heat-api[13008]: 2017-09-28 12:35:09.266 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:35:09] "OPTIONS / HTTP/1.0" 200 134 0.000644
Sep 28 12:35:09 ctl02 neutron-server[30536]: 2017-09-28 12:35:09.826 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:35:09] "OPTIONS / HTTP/1.0" 200 262 0.000497
Sep 28 12:35:10 ctl02 neutron-server[30536]: 2017-09-28 12:35:10.474 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:35:10] "OPTIONS / HTTP/1.0" 200 262 0.000562
Sep 28 12:35:10 ctl02 nova-api[3365]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:35:10 ctl02 nova-api[3365]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:35:11 ctl02 nova-api[3365]: 2017-09-28 12:35:11.052 3365 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:35:11 ctl02 nova-api[3365]: 2017-09-28 12:35:11.053 3365 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:35:11 ctl02 nova-api[3365]: 2017-09-28 12:35:11.053 3365 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:35:11 ctl02 nova-api[3365]: 2017-09-28 12:35:11.053 3365 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:35:11 ctl02 nova-api[3365]: 2017-09-28 12:35:11.053 3365 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:35:11 ctl02 nova-api[3365]: 2017-09-28 12:35:11.053 3365 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:35:11 ctl02 nova-api[3365]: 2017-09-28 12:35:11.053 3365 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:35:11 ctl02 nova-api[3365]: 2017-09-28 12:35:11.053 3365 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:35:11 ctl02 nova-api[3365]: 2017-09-28 12:35:11.053 3365 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:35:11 ctl02 nova-api[3365]: 2017-09-28 12:35:11.053 3365 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:35:11 ctl02 nova-api[3365]: 2017-09-28 12:35:11.053 3365 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:35:11 ctl02 nova-api[3365]: 2017-09-28 12:35:11.053 3365 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:35:11 ctl02 nova-api[3365]: 2017-09-28 12:35:11.053 3365 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:35:11 ctl02 nova-api[3365]: 2017-09-28 12:35:11.053 3365 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:35:11 ctl02 nova-api[3365]: 2017-09-28 12:35:11.053 3365 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:35:11 ctl02 nova-api[3365]: 2017-09-28 12:35:11.053 3365 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:35:11 ctl02 nova-api[3365]: 2017-09-28 12:35:11.053 3365 ERROR nova.wsgi     self.filename))
Sep 28 12:35:11 ctl02 nova-api[3365]: 2017-09-28 12:35:11.053 3365 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:35:11 ctl02 nova-api[3365]: 2017-09-28 12:35:11.053 3365 ERROR nova.wsgi
Sep 28 12:35:11 ctl02 nova-api[3365]: 2017-09-28 12:35:11.056 3365 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:35:11 ctl02 nova-api[3365]: 2017-09-28 12:35:11.190 3365 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:35:11 ctl02 nova-api[3365]: 2017-09-28 12:35:11.439 3365 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:35:11 ctl02 nova-api[3365]: 2017-09-28 12:35:11.442 3365 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:35:11 ctl02 nova-api[3365]: 2017-09-28 12:35:11.442 3365 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:35:11 ctl02 nova-api[3365]: 2017-09-28 12:35:11.443 3365 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:35:11 ctl02 nova-api[3365]: 2017-09-28 12:35:11.578 3365 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:35:11 ctl02 nova-api[3365]: 2017-09-28 12:35:11.581 3365 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:35:11 ctl02 nova-api[3365]: 2017-09-28 12:35:11.581 3365 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:35:11 ctl02 nova-api[3365]: 2017-09-28 12:35:11.581 3365 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:35:11 ctl02 nova-api[3365]: 2017-09-28 12:35:11.585 3365 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:35:11 ctl02 nova-api[3365]: 2017-09-28 12:35:11.585 3365 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:35:11 ctl02 nova-api[3365]: 2017-09-28 12:35:11.585 3365 ERROR nova Traceback (most recent call last):
Sep 28 12:35:11 ctl02 nova-api[3365]: 2017-09-28 12:35:11.585 3365 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:35:11 ctl02 nova-api[3365]: 2017-09-28 12:35:11.585 3365 ERROR nova     sys.exit(main())
Sep 28 12:35:11 ctl02 nova-api[3365]: 2017-09-28 12:35:11.585 3365 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:35:11 ctl02 nova-api[3365]: 2017-09-28 12:35:11.585 3365 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:35:11 ctl02 nova-api[3365]: 2017-09-28 12:35:11.585 3365 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:35:11 ctl02 nova-api[3365]: 2017-09-28 12:35:11.585 3365 ERROR nova     max_url_len=max_url_len)
Sep 28 12:35:11 ctl02 nova-api[3365]: 2017-09-28 12:35:11.585 3365 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:35:11 ctl02 nova-api[3365]: 2017-09-28 12:35:11.585 3365 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:35:11 ctl02 nova-api[3365]: 2017-09-28 12:35:11.585 3365 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:35:11 ctl02 nova-api[3365]: 2017-09-28 12:35:11.585 3365 ERROR nova     sock.listen(backlog)
Sep 28 12:35:11 ctl02 nova-api[3365]: 2017-09-28 12:35:11.585 3365 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:35:11 ctl02 nova-api[3365]: 2017-09-28 12:35:11.585 3365 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:35:11 ctl02 nova-api[3365]: 2017-09-28 12:35:11.585 3365 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:35:11 ctl02 nova-api[3365]: 2017-09-28 12:35:11.585 3365 ERROR nova
Sep 28 12:35:11 ctl02 neutron-server[30536]: 2017-09-28 12:35:11.666 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:35:11] "OPTIONS / HTTP/1.0" 200 262 0.000471
Sep 28 12:35:11 ctl02 heat-api-cfn[13300]: 2017-09-28 12:35:11.737 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:35:11] "OPTIONS / HTTP/1.0" 200 134 0.000464
Sep 28 12:35:11 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:35:11 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:35:11 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:35:11 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:35:11 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:35:11 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:35:11 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:35:12 ctl02 glance-api[29183]: 2017-09-28 12:35:12.185 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:35:12] "OPTIONS / HTTP/1.0" 200 134 0.000678
Sep 28 12:35:12 ctl02 glance-api[29183]: 2017-09-28 12:35:12.754 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:35:12] "OPTIONS / HTTP/1.0" 200 134 0.000644
Sep 28 12:35:12 ctl02 glance-api[29183]: 2017-09-28 12:35:12.920 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:35:12] "OPTIONS / HTTP/1.0" 200 134 0.000544
Sep 28 12:35:13 ctl02 nova-api[3384]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:35:13 ctl02 nova-api[3384]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:35:13 ctl02 nova-api[3384]: 2017-09-28 12:35:13.774 3384 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:35:13 ctl02 nova-api[3384]: 2017-09-28 12:35:13.775 3384 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:35:13 ctl02 nova-api[3384]: 2017-09-28 12:35:13.775 3384 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:35:13 ctl02 nova-api[3384]: 2017-09-28 12:35:13.775 3384 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:35:13 ctl02 nova-api[3384]: 2017-09-28 12:35:13.775 3384 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:35:13 ctl02 nova-api[3384]: 2017-09-28 12:35:13.775 3384 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:35:13 ctl02 nova-api[3384]: 2017-09-28 12:35:13.775 3384 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:35:13 ctl02 nova-api[3384]: 2017-09-28 12:35:13.775 3384 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:35:13 ctl02 nova-api[3384]: 2017-09-28 12:35:13.775 3384 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:35:13 ctl02 nova-api[3384]: 2017-09-28 12:35:13.775 3384 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:35:13 ctl02 nova-api[3384]: 2017-09-28 12:35:13.775 3384 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:35:13 ctl02 nova-api[3384]: 2017-09-28 12:35:13.775 3384 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:35:13 ctl02 nova-api[3384]: 2017-09-28 12:35:13.775 3384 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:35:13 ctl02 nova-api[3384]: 2017-09-28 12:35:13.775 3384 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:35:13 ctl02 nova-api[3384]: 2017-09-28 12:35:13.775 3384 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:35:13 ctl02 nova-api[3384]: 2017-09-28 12:35:13.775 3384 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:35:13 ctl02 nova-api[3384]: 2017-09-28 12:35:13.775 3384 ERROR nova.wsgi     self.filename))
Sep 28 12:35:13 ctl02 nova-api[3384]: 2017-09-28 12:35:13.775 3384 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:35:13 ctl02 nova-api[3384]: 2017-09-28 12:35:13.775 3384 ERROR nova.wsgi
Sep 28 12:35:13 ctl02 nova-api[3384]: 2017-09-28 12:35:13.776 3384 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:35:13 ctl02 nova-api[3384]: 2017-09-28 12:35:13.904 3384 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:35:14 ctl02 nova-api[3384]: 2017-09-28 12:35:14.133 3384 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:35:14 ctl02 nova-api[3384]: 2017-09-28 12:35:14.135 3384 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:35:14 ctl02 nova-api[3384]: 2017-09-28 12:35:14.135 3384 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:35:14 ctl02 nova-api[3384]: 2017-09-28 12:35:14.135 3384 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:35:14 ctl02 nova-api[3384]: 2017-09-28 12:35:14.265 3384 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:35:14 ctl02 nova-api[3384]: 2017-09-28 12:35:14.266 3384 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:35:14 ctl02 nova-api[3384]: 2017-09-28 12:35:14.267 3384 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:35:14 ctl02 nova-api[3384]: 2017-09-28 12:35:14.267 3384 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:35:14 ctl02 nova-api[3384]: 2017-09-28 12:35:14.270 3384 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:35:14 ctl02 nova-api[3384]: 2017-09-28 12:35:14.270 3384 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:35:14 ctl02 nova-api[3384]: 2017-09-28 12:35:14.270 3384 ERROR nova Traceback (most recent call last):
Sep 28 12:35:14 ctl02 nova-api[3384]: 2017-09-28 12:35:14.270 3384 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:35:14 ctl02 nova-api[3384]: 2017-09-28 12:35:14.270 3384 ERROR nova     sys.exit(main())
Sep 28 12:35:14 ctl02 nova-api[3384]: 2017-09-28 12:35:14.270 3384 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:35:14 ctl02 nova-api[3384]: 2017-09-28 12:35:14.270 3384 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:35:14 ctl02 nova-api[3384]: 2017-09-28 12:35:14.270 3384 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:35:14 ctl02 nova-api[3384]: 2017-09-28 12:35:14.270 3384 ERROR nova     max_url_len=max_url_len)
Sep 28 12:35:14 ctl02 nova-api[3384]: 2017-09-28 12:35:14.270 3384 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:35:14 ctl02 nova-api[3384]: 2017-09-28 12:35:14.270 3384 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:35:14 ctl02 nova-api[3384]: 2017-09-28 12:35:14.270 3384 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:35:14 ctl02 nova-api[3384]: 2017-09-28 12:35:14.270 3384 ERROR nova     sock.listen(backlog)
Sep 28 12:35:14 ctl02 nova-api[3384]: 2017-09-28 12:35:14.270 3384 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:35:14 ctl02 nova-api[3384]: 2017-09-28 12:35:14.270 3384 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:35:14 ctl02 nova-api[3384]: 2017-09-28 12:35:14.270 3384 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:35:14 ctl02 nova-api[3384]: 2017-09-28 12:35:14.270 3384 ERROR nova
Sep 28 12:35:14 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:35:14 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:35:14 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:35:14 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:35:14 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:35:14 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:35:14 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:35:14 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:35:14.758 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:35:14] "OPTIONS / HTTP/1.0" 200 134 0.000619
Sep 28 12:35:15 ctl02 heat-api[13008]: 2017-09-28 12:35:15.162 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:35:15] "OPTIONS / HTTP/1.0" 200 134 0.000530
Sep 28 12:35:15 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:35:15.228 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:35:15] "OPTIONS / HTTP/1.0" 200 134 0.000427
Sep 28 12:35:16 ctl02 nova-api[3402]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:35:16 ctl02 nova-api[3402]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:35:16 ctl02 nova-api[3402]: 2017-09-28 12:35:16.514 3402 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:35:16 ctl02 nova-api[3402]: 2017-09-28 12:35:16.515 3402 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:35:16 ctl02 nova-api[3402]: 2017-09-28 12:35:16.515 3402 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:35:16 ctl02 nova-api[3402]: 2017-09-28 12:35:16.515 3402 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:35:16 ctl02 nova-api[3402]: 2017-09-28 12:35:16.515 3402 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:35:16 ctl02 nova-api[3402]: 2017-09-28 12:35:16.515 3402 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:35:16 ctl02 nova-api[3402]: 2017-09-28 12:35:16.515 3402 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:35:16 ctl02 nova-api[3402]: 2017-09-28 12:35:16.515 3402 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:35:16 ctl02 nova-api[3402]: 2017-09-28 12:35:16.515 3402 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:35:16 ctl02 nova-api[3402]: 2017-09-28 12:35:16.515 3402 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:35:16 ctl02 nova-api[3402]: 2017-09-28 12:35:16.515 3402 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:35:16 ctl02 nova-api[3402]: 2017-09-28 12:35:16.515 3402 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:35:16 ctl02 nova-api[3402]: 2017-09-28 12:35:16.515 3402 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:35:16 ctl02 nova-api[3402]: 2017-09-28 12:35:16.515 3402 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:35:16 ctl02 nova-api[3402]: 2017-09-28 12:35:16.515 3402 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:35:16 ctl02 nova-api[3402]: 2017-09-28 12:35:16.515 3402 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:35:16 ctl02 nova-api[3402]: 2017-09-28 12:35:16.515 3402 ERROR nova.wsgi     self.filename))
Sep 28 12:35:16 ctl02 nova-api[3402]: 2017-09-28 12:35:16.515 3402 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:35:16 ctl02 nova-api[3402]: 2017-09-28 12:35:16.515 3402 ERROR nova.wsgi
Sep 28 12:35:16 ctl02 nova-api[3402]: 2017-09-28 12:35:16.517 3402 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:35:16 ctl02 nova-api[3402]: 2017-09-28 12:35:16.645 3402 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:35:16 ctl02 nova-api[3402]: 2017-09-28 12:35:16.866 3402 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:35:16 ctl02 nova-api[3402]: 2017-09-28 12:35:16.868 3402 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:35:16 ctl02 nova-api[3402]: 2017-09-28 12:35:16.868 3402 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:35:16 ctl02 nova-api[3402]: 2017-09-28 12:35:16.869 3402 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:35:16 ctl02 nova-api[3402]: 2017-09-28 12:35:16.998 3402 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:35:17 ctl02 nova-api[3402]: 2017-09-28 12:35:17.000 3402 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:35:17 ctl02 nova-api[3402]: 2017-09-28 12:35:17.001 3402 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:35:17 ctl02 nova-api[3402]: 2017-09-28 12:35:17.001 3402 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:35:17 ctl02 nova-api[3402]: 2017-09-28 12:35:17.004 3402 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:35:17 ctl02 nova-api[3402]: 2017-09-28 12:35:17.005 3402 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:35:17 ctl02 nova-api[3402]: 2017-09-28 12:35:17.005 3402 ERROR nova Traceback (most recent call last):
Sep 28 12:35:17 ctl02 nova-api[3402]: 2017-09-28 12:35:17.005 3402 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:35:17 ctl02 nova-api[3402]: 2017-09-28 12:35:17.005 3402 ERROR nova     sys.exit(main())
Sep 28 12:35:17 ctl02 nova-api[3402]: 2017-09-28 12:35:17.005 3402 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:35:17 ctl02 nova-api[3402]: 2017-09-28 12:35:17.005 3402 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:35:17 ctl02 nova-api[3402]: 2017-09-28 12:35:17.005 3402 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:35:17 ctl02 nova-api[3402]: 2017-09-28 12:35:17.005 3402 ERROR nova     max_url_len=max_url_len)
Sep 28 12:35:17 ctl02 nova-api[3402]: 2017-09-28 12:35:17.005 3402 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:35:17 ctl02 nova-api[3402]: 2017-09-28 12:35:17.005 3402 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:35:17 ctl02 nova-api[3402]: 2017-09-28 12:35:17.005 3402 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:35:17 ctl02 nova-api[3402]: 2017-09-28 12:35:17.005 3402 ERROR nova     sock.listen(backlog)
Sep 28 12:35:17 ctl02 nova-api[3402]: 2017-09-28 12:35:17.005 3402 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:35:17 ctl02 nova-api[3402]: 2017-09-28 12:35:17.005 3402 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:35:17 ctl02 nova-api[3402]: 2017-09-28 12:35:17.005 3402 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:35:17 ctl02 nova-api[3402]: 2017-09-28 12:35:17.005 3402 ERROR nova
Sep 28 12:35:17 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:35:17 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:35:17 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:35:17 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcd721960)
Sep 28 12:35:17 ctl02 heat-api[13008]: 2017-09-28 12:35:17.253 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:35:17] "OPTIONS / HTTP/1.0" 200 134 0.000702
Sep 28 12:35:17 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:35:17 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:35:17 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:35:17 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:35:17 ctl02 heat-api-cfn[13300]: 2017-09-28 12:35:17.857 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:35:17] "OPTIONS / HTTP/1.0" 200 134 0.000453
Sep 28 12:35:17 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:35:17.876 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:35:17] "OPTIONS / HTTP/1.0" 200 134 0.000389
Sep 28 12:35:18 ctl02 nova-cert[4860]: 2017-09-28 12:35:18.095 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:35:18 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcd721960)
Sep 28 12:35:18 ctl02 nova-conductor[5056]: 2017-09-28 12:35:18.818 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:35:18 ctl02 nova-conductor[5056]: 2017-09-28 12:35:18.840 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:35:18 ctl02 nova-conductor[5056]: 2017-09-28 12:35:18.849 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:35:18 ctl02 nova-conductor[5056]: 2017-09-28 12:35:18.850 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:35:19 ctl02 nova-api[3420]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:35:19 ctl02 nova-api[3420]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:35:19 ctl02 heat-api-cfn[13300]: 2017-09-28 12:35:19.193 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:35:19] "OPTIONS / HTTP/1.0" 200 134 0.000471
Sep 28 12:35:19 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcd721960)
Sep 28 12:35:19 ctl02 nova-api[3420]: 2017-09-28 12:35:19.240 3420 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:35:19 ctl02 nova-api[3420]: 2017-09-28 12:35:19.241 3420 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:35:19 ctl02 nova-api[3420]: 2017-09-28 12:35:19.241 3420 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:35:19 ctl02 nova-api[3420]: 2017-09-28 12:35:19.241 3420 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:35:19 ctl02 nova-api[3420]: 2017-09-28 12:35:19.241 3420 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:35:19 ctl02 nova-api[3420]: 2017-09-28 12:35:19.241 3420 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:35:19 ctl02 nova-api[3420]: 2017-09-28 12:35:19.241 3420 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:35:19 ctl02 nova-api[3420]: 2017-09-28 12:35:19.241 3420 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:35:19 ctl02 nova-api[3420]: 2017-09-28 12:35:19.241 3420 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:35:19 ctl02 nova-api[3420]: 2017-09-28 12:35:19.241 3420 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:35:19 ctl02 nova-api[3420]: 2017-09-28 12:35:19.241 3420 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:35:19 ctl02 nova-api[3420]: 2017-09-28 12:35:19.241 3420 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:35:19 ctl02 nova-api[3420]: 2017-09-28 12:35:19.241 3420 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:35:19 ctl02 nova-api[3420]: 2017-09-28 12:35:19.241 3420 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:35:19 ctl02 nova-api[3420]: 2017-09-28 12:35:19.241 3420 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:35:19 ctl02 nova-api[3420]: 2017-09-28 12:35:19.241 3420 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:35:19 ctl02 nova-api[3420]: 2017-09-28 12:35:19.241 3420 ERROR nova.wsgi     self.filename))
Sep 28 12:35:19 ctl02 nova-api[3420]: 2017-09-28 12:35:19.241 3420 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:35:19 ctl02 nova-api[3420]: 2017-09-28 12:35:19.241 3420 ERROR nova.wsgi
Sep 28 12:35:19 ctl02 nova-api[3420]: 2017-09-28 12:35:19.242 3420 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:35:19 ctl02 heat-api[13008]: 2017-09-28 12:35:19.346 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:35:19] "OPTIONS / HTTP/1.0" 200 134 0.000555
Sep 28 12:35:19 ctl02 nova-api[3420]: 2017-09-28 12:35:19.375 3420 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:35:19 ctl02 nova-api[3420]: 2017-09-28 12:35:19.603 3420 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:35:19 ctl02 nova-api[3420]: 2017-09-28 12:35:19.605 3420 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:35:19 ctl02 nova-api[3420]: 2017-09-28 12:35:19.605 3420 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:35:19 ctl02 nova-api[3420]: 2017-09-28 12:35:19.606 3420 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:35:19 ctl02 nova-api[3420]: 2017-09-28 12:35:19.743 3420 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:35:19 ctl02 nova-api[3420]: 2017-09-28 12:35:19.745 3420 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:35:19 ctl02 nova-api[3420]: 2017-09-28 12:35:19.745 3420 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:35:19 ctl02 nova-api[3420]: 2017-09-28 12:35:19.745 3420 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:35:19 ctl02 nova-api[3420]: 2017-09-28 12:35:19.748 3420 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:35:19 ctl02 nova-api[3420]: 2017-09-28 12:35:19.749 3420 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:35:19 ctl02 nova-api[3420]: 2017-09-28 12:35:19.749 3420 ERROR nova Traceback (most recent call last):
Sep 28 12:35:19 ctl02 nova-api[3420]: 2017-09-28 12:35:19.749 3420 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:35:19 ctl02 nova-api[3420]: 2017-09-28 12:35:19.749 3420 ERROR nova     sys.exit(main())
Sep 28 12:35:19 ctl02 nova-api[3420]: 2017-09-28 12:35:19.749 3420 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:35:19 ctl02 nova-api[3420]: 2017-09-28 12:35:19.749 3420 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:35:19 ctl02 nova-api[3420]: 2017-09-28 12:35:19.749 3420 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:35:19 ctl02 nova-api[3420]: 2017-09-28 12:35:19.749 3420 ERROR nova     max_url_len=max_url_len)
Sep 28 12:35:19 ctl02 nova-api[3420]: 2017-09-28 12:35:19.749 3420 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:35:19 ctl02 nova-api[3420]: 2017-09-28 12:35:19.749 3420 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:35:19 ctl02 nova-api[3420]: 2017-09-28 12:35:19.749 3420 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:35:19 ctl02 nova-api[3420]: 2017-09-28 12:35:19.749 3420 ERROR nova     sock.listen(backlog)
Sep 28 12:35:19 ctl02 nova-api[3420]: 2017-09-28 12:35:19.749 3420 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:35:19 ctl02 nova-api[3420]: 2017-09-28 12:35:19.749 3420 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:35:19 ctl02 nova-api[3420]: 2017-09-28 12:35:19.749 3420 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:35:19 ctl02 nova-api[3420]: 2017-09-28 12:35:19.749 3420 ERROR nova
Sep 28 12:35:19 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:35:19 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:35:19 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:35:19 ctl02 neutron-server[30536]: 2017-09-28 12:35:19.892 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:35:19] "OPTIONS / HTTP/1.0" 200 262 0.000456
Sep 28 12:35:20 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:35:20 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:35:20 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:35:20 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:35:20 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcd721960)
Sep 28 12:35:20 ctl02 neutron-server[30536]: 2017-09-28 12:35:20.377 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:35:20] "OPTIONS / HTTP/1.0" 200 262 0.000484
Sep 28 12:35:21 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcd721960)
Sep 28 12:35:21 ctl02 neutron-server[30536]: 2017-09-28 12:35:21.365 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 12:35:21 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:35:21 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:34:46 cmp002
Sep 28 12:35:21 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:34:38 cmp001
Sep 28 12:35:21 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:34:50 cmp002
Sep 28 12:35:21 ctl02 neutron-server[30536]: 2017-09-28 12:35:21.670 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:35:21] "OPTIONS / HTTP/1.0" 200 262 0.000554
Sep 28 12:35:21 ctl02 nova-api[3438]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:35:21 ctl02 nova-api[3438]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:35:21 ctl02 heat-api-cfn[13300]: 2017-09-28 12:35:21.862 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:35:21] "OPTIONS / HTTP/1.0" 200 134 0.000454
Sep 28 12:35:21 ctl02 glance-api[29183]: 2017-09-28 12:35:21.883 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:35:21] "OPTIONS / HTTP/1.0" 200 134 0.000589
Sep 28 12:35:21 ctl02 nova-api[3438]: 2017-09-28 12:35:21.991 3438 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:35:21 ctl02 nova-api[3438]: 2017-09-28 12:35:21.992 3438 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:35:21 ctl02 nova-api[3438]: 2017-09-28 12:35:21.992 3438 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:35:21 ctl02 nova-api[3438]: 2017-09-28 12:35:21.992 3438 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:35:21 ctl02 nova-api[3438]: 2017-09-28 12:35:21.992 3438 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:35:21 ctl02 nova-api[3438]: 2017-09-28 12:35:21.992 3438 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:35:21 ctl02 nova-api[3438]: 2017-09-28 12:35:21.992 3438 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:35:21 ctl02 nova-api[3438]: 2017-09-28 12:35:21.992 3438 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:35:21 ctl02 nova-api[3438]: 2017-09-28 12:35:21.992 3438 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:35:21 ctl02 nova-api[3438]: 2017-09-28 12:35:21.992 3438 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:35:21 ctl02 nova-api[3438]: 2017-09-28 12:35:21.992 3438 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:35:21 ctl02 nova-api[3438]: 2017-09-28 12:35:21.992 3438 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:35:21 ctl02 nova-api[3438]: 2017-09-28 12:35:21.992 3438 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:35:21 ctl02 nova-api[3438]: 2017-09-28 12:35:21.992 3438 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:35:21 ctl02 nova-api[3438]: 2017-09-28 12:35:21.992 3438 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:35:21 ctl02 nova-api[3438]: 2017-09-28 12:35:21.992 3438 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:35:21 ctl02 nova-api[3438]: 2017-09-28 12:35:21.992 3438 ERROR nova.wsgi     self.filename))
Sep 28 12:35:21 ctl02 nova-api[3438]: 2017-09-28 12:35:21.992 3438 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:35:21 ctl02 nova-api[3438]: 2017-09-28 12:35:21.992 3438 ERROR nova.wsgi
Sep 28 12:35:21 ctl02 nova-api[3438]: 2017-09-28 12:35:21.993 3438 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:35:22 ctl02 nova-api[3438]: 2017-09-28 12:35:22.119 3438 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:35:22 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcd721960)
Sep 28 12:35:22 ctl02 nova-api[3438]: 2017-09-28 12:35:22.347 3438 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:35:22 ctl02 nova-api[3438]: 2017-09-28 12:35:22.349 3438 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:35:22 ctl02 nova-api[3438]: 2017-09-28 12:35:22.349 3438 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:35:22 ctl02 nova-api[3438]: 2017-09-28 12:35:22.349 3438 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:35:22 ctl02 nova-api[3438]: 2017-09-28 12:35:22.477 3438 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:35:22 ctl02 nova-api[3438]: 2017-09-28 12:35:22.479 3438 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:35:22 ctl02 nova-api[3438]: 2017-09-28 12:35:22.479 3438 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:35:22 ctl02 nova-api[3438]: 2017-09-28 12:35:22.479 3438 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:35:22 ctl02 nova-api[3438]: 2017-09-28 12:35:22.483 3438 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:35:22 ctl02 nova-api[3438]: 2017-09-28 12:35:22.483 3438 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:35:22 ctl02 nova-api[3438]: 2017-09-28 12:35:22.483 3438 ERROR nova Traceback (most recent call last):
Sep 28 12:35:22 ctl02 nova-api[3438]: 2017-09-28 12:35:22.483 3438 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:35:22 ctl02 nova-api[3438]: 2017-09-28 12:35:22.483 3438 ERROR nova     sys.exit(main())
Sep 28 12:35:22 ctl02 nova-api[3438]: 2017-09-28 12:35:22.483 3438 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:35:22 ctl02 nova-api[3438]: 2017-09-28 12:35:22.483 3438 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:35:22 ctl02 nova-api[3438]: 2017-09-28 12:35:22.483 3438 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:35:22 ctl02 nova-api[3438]: 2017-09-28 12:35:22.483 3438 ERROR nova     max_url_len=max_url_len)
Sep 28 12:35:22 ctl02 nova-api[3438]: 2017-09-28 12:35:22.483 3438 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:35:22 ctl02 nova-api[3438]: 2017-09-28 12:35:22.483 3438 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:35:22 ctl02 nova-api[3438]: 2017-09-28 12:35:22.483 3438 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:35:22 ctl02 nova-api[3438]: 2017-09-28 12:35:22.483 3438 ERROR nova     sock.listen(backlog)
Sep 28 12:35:22 ctl02 nova-api[3438]: 2017-09-28 12:35:22.483 3438 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:35:22 ctl02 nova-api[3438]: 2017-09-28 12:35:22.483 3438 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:35:22 ctl02 nova-api[3438]: 2017-09-28 12:35:22.483 3438 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:35:22 ctl02 nova-api[3438]: 2017-09-28 12:35:22.483 3438 ERROR nova
Sep 28 12:35:22 ctl02 glance-api[29183]: 2017-09-28 12:35:22.539 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:35:22] "OPTIONS / HTTP/1.0" 200 134 0.000704
Sep 28 12:35:22 ctl02 glance-api[29183]: 2017-09-28 12:35:22.560 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:35:22] "OPTIONS / HTTP/1.0" 200 134 0.000472
Sep 28 12:35:22 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:35:22 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:35:22 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:35:22 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:35:22 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:35:22 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:35:22 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:35:23 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcd721960)
Sep 28 12:35:24 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcd721960)
Sep 28 12:35:24 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:35:24.565 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:35:24] "OPTIONS / HTTP/1.0" 200 134 0.000501
Sep 28 12:35:24 ctl02 nova-api[3456]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:35:24 ctl02 nova-api[3456]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:35:24 ctl02 nova-api[3456]: 2017-09-28 12:35:24.821 3456 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:35:24 ctl02 nova-api[3456]: 2017-09-28 12:35:24.823 3456 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:35:24 ctl02 nova-api[3456]: 2017-09-28 12:35:24.823 3456 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:35:24 ctl02 nova-api[3456]: 2017-09-28 12:35:24.823 3456 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:35:24 ctl02 nova-api[3456]: 2017-09-28 12:35:24.823 3456 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:35:24 ctl02 nova-api[3456]: 2017-09-28 12:35:24.823 3456 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:35:24 ctl02 nova-api[3456]: 2017-09-28 12:35:24.823 3456 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:35:24 ctl02 nova-api[3456]: 2017-09-28 12:35:24.823 3456 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:35:24 ctl02 nova-api[3456]: 2017-09-28 12:35:24.823 3456 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:35:24 ctl02 nova-api[3456]: 2017-09-28 12:35:24.823 3456 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:35:24 ctl02 nova-api[3456]: 2017-09-28 12:35:24.823 3456 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:35:24 ctl02 nova-api[3456]: 2017-09-28 12:35:24.823 3456 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:35:24 ctl02 nova-api[3456]: 2017-09-28 12:35:24.823 3456 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:35:24 ctl02 nova-api[3456]: 2017-09-28 12:35:24.823 3456 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:35:24 ctl02 nova-api[3456]: 2017-09-28 12:35:24.823 3456 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:35:24 ctl02 nova-api[3456]: 2017-09-28 12:35:24.823 3456 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:35:24 ctl02 nova-api[3456]: 2017-09-28 12:35:24.823 3456 ERROR nova.wsgi     self.filename))
Sep 28 12:35:24 ctl02 nova-api[3456]: 2017-09-28 12:35:24.823 3456 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:35:24 ctl02 nova-api[3456]: 2017-09-28 12:35:24.823 3456 ERROR nova.wsgi
Sep 28 12:35:24 ctl02 nova-api[3456]: 2017-09-28 12:35:24.823 3456 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:35:24 ctl02 nova-api[3456]: 2017-09-28 12:35:24.955 3456 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:35:25 ctl02 heat-api[13008]: 2017-09-28 12:35:25.180 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:35:25] "OPTIONS / HTTP/1.0" 200 134 0.000611
Sep 28 12:35:25 ctl02 nova-api[3456]: 2017-09-28 12:35:25.186 3456 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:35:25 ctl02 nova-api[3456]: 2017-09-28 12:35:25.188 3456 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:35:25 ctl02 nova-api[3456]: 2017-09-28 12:35:25.189 3456 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:35:25 ctl02 nova-api[3456]: 2017-09-28 12:35:25.189 3456 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:35:25 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcd721960)
Sep 28 12:35:25 ctl02 nova-api[3456]: 2017-09-28 12:35:25.321 3456 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:35:25 ctl02 nova-api[3456]: 2017-09-28 12:35:25.323 3456 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:35:25 ctl02 nova-api[3456]: 2017-09-28 12:35:25.323 3456 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:35:25 ctl02 nova-api[3456]: 2017-09-28 12:35:25.323 3456 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:35:25 ctl02 nova-api[3456]: 2017-09-28 12:35:25.326 3456 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:35:25 ctl02 nova-api[3456]: 2017-09-28 12:35:25.327 3456 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:35:25 ctl02 nova-api[3456]: 2017-09-28 12:35:25.327 3456 ERROR nova Traceback (most recent call last):
Sep 28 12:35:25 ctl02 nova-api[3456]: 2017-09-28 12:35:25.327 3456 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:35:25 ctl02 nova-api[3456]: 2017-09-28 12:35:25.327 3456 ERROR nova     sys.exit(main())
Sep 28 12:35:25 ctl02 nova-api[3456]: 2017-09-28 12:35:25.327 3456 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:35:25 ctl02 nova-api[3456]: 2017-09-28 12:35:25.327 3456 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:35:25 ctl02 nova-api[3456]: 2017-09-28 12:35:25.327 3456 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:35:25 ctl02 nova-api[3456]: 2017-09-28 12:35:25.327 3456 ERROR nova     max_url_len=max_url_len)
Sep 28 12:35:25 ctl02 nova-api[3456]: 2017-09-28 12:35:25.327 3456 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:35:25 ctl02 nova-api[3456]: 2017-09-28 12:35:25.327 3456 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:35:25 ctl02 nova-api[3456]: 2017-09-28 12:35:25.327 3456 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:35:25 ctl02 nova-api[3456]: 2017-09-28 12:35:25.327 3456 ERROR nova     sock.listen(backlog)
Sep 28 12:35:25 ctl02 nova-api[3456]: 2017-09-28 12:35:25.327 3456 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:35:25 ctl02 nova-api[3456]: 2017-09-28 12:35:25.327 3456 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:35:25 ctl02 nova-api[3456]: 2017-09-28 12:35:25.327 3456 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:35:25 ctl02 nova-api[3456]: 2017-09-28 12:35:25.327 3456 ERROR nova
Sep 28 12:35:25 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:35:25.363 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:35:25] "OPTIONS / HTTP/1.0" 200 134 0.000473
Sep 28 12:35:25 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:35:25 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:35:25 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:35:25 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:35:25 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:35:25 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:35:25 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:35:26 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcd721960)
Sep 28 12:35:27 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcd721960)
Sep 28 12:35:27 ctl02 heat-api[13008]: 2017-09-28 12:35:27.252 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:35:27] "OPTIONS / HTTP/1.0" 200 134 0.000718
Sep 28 12:35:27 ctl02 nova-api[3474]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:35:27 ctl02 nova-api[3474]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:35:27 ctl02 nova-api[3474]: 2017-09-28 12:35:27.532 3474 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:35:27 ctl02 nova-api[3474]: 2017-09-28 12:35:27.534 3474 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:35:27 ctl02 nova-api[3474]: 2017-09-28 12:35:27.534 3474 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:35:27 ctl02 nova-api[3474]: 2017-09-28 12:35:27.534 3474 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:35:27 ctl02 nova-api[3474]: 2017-09-28 12:35:27.534 3474 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:35:27 ctl02 nova-api[3474]: 2017-09-28 12:35:27.534 3474 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:35:27 ctl02 nova-api[3474]: 2017-09-28 12:35:27.534 3474 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:35:27 ctl02 nova-api[3474]: 2017-09-28 12:35:27.534 3474 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:35:27 ctl02 nova-api[3474]: 2017-09-28 12:35:27.534 3474 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:35:27 ctl02 nova-api[3474]: 2017-09-28 12:35:27.534 3474 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:35:27 ctl02 nova-api[3474]: 2017-09-28 12:35:27.534 3474 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:35:27 ctl02 nova-api[3474]: 2017-09-28 12:35:27.534 3474 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:35:27 ctl02 nova-api[3474]: 2017-09-28 12:35:27.534 3474 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:35:27 ctl02 nova-api[3474]: 2017-09-28 12:35:27.534 3474 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:35:27 ctl02 nova-api[3474]: 2017-09-28 12:35:27.534 3474 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:35:27 ctl02 nova-api[3474]: 2017-09-28 12:35:27.534 3474 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:35:27 ctl02 nova-api[3474]: 2017-09-28 12:35:27.534 3474 ERROR nova.wsgi     self.filename))
Sep 28 12:35:27 ctl02 nova-api[3474]: 2017-09-28 12:35:27.534 3474 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:35:27 ctl02 nova-api[3474]: 2017-09-28 12:35:27.534 3474 ERROR nova.wsgi
Sep 28 12:35:27 ctl02 nova-api[3474]: 2017-09-28 12:35:27.535 3474 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:35:27 ctl02 nova-api[3474]: 2017-09-28 12:35:27.668 3474 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:35:27 ctl02 heat-api-cfn[13300]: 2017-09-28 12:35:27.693 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:35:27] "OPTIONS / HTTP/1.0" 200 134 0.000546
Sep 28 12:35:27 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:35:27.845 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:35:27] "OPTIONS / HTTP/1.0" 200 134 0.000475
Sep 28 12:35:27 ctl02 nova-api[3474]: 2017-09-28 12:35:27.919 3474 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:35:27 ctl02 nova-api[3474]: 2017-09-28 12:35:27.922 3474 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:35:27 ctl02 nova-api[3474]: 2017-09-28 12:35:27.922 3474 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:35:27 ctl02 nova-api[3474]: 2017-09-28 12:35:27.922 3474 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:35:27 ctl02 nova-consoleauth[5433]: 2017-09-28 12:35:27.969 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:35:28 ctl02 nova-api[3474]: 2017-09-28 12:35:28.062 3474 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:35:28 ctl02 nova-api[3474]: 2017-09-28 12:35:28.064 3474 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:35:28 ctl02 nova-api[3474]: 2017-09-28 12:35:28.064 3474 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:35:28 ctl02 nova-api[3474]: 2017-09-28 12:35:28.065 3474 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:35:28 ctl02 nova-api[3474]: 2017-09-28 12:35:28.068 3474 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:35:28 ctl02 nova-api[3474]: 2017-09-28 12:35:28.068 3474 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:35:28 ctl02 nova-api[3474]: 2017-09-28 12:35:28.068 3474 ERROR nova Traceback (most recent call last):
Sep 28 12:35:28 ctl02 nova-api[3474]: 2017-09-28 12:35:28.068 3474 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:35:28 ctl02 nova-api[3474]: 2017-09-28 12:35:28.068 3474 ERROR nova     sys.exit(main())
Sep 28 12:35:28 ctl02 nova-api[3474]: 2017-09-28 12:35:28.068 3474 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:35:28 ctl02 nova-api[3474]: 2017-09-28 12:35:28.068 3474 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:35:28 ctl02 nova-api[3474]: 2017-09-28 12:35:28.068 3474 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:35:28 ctl02 nova-api[3474]: 2017-09-28 12:35:28.068 3474 ERROR nova     max_url_len=max_url_len)
Sep 28 12:35:28 ctl02 nova-api[3474]: 2017-09-28 12:35:28.068 3474 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:35:28 ctl02 nova-api[3474]: 2017-09-28 12:35:28.068 3474 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:35:28 ctl02 nova-api[3474]: 2017-09-28 12:35:28.068 3474 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:35:28 ctl02 nova-api[3474]: 2017-09-28 12:35:28.068 3474 ERROR nova     sock.listen(backlog)
Sep 28 12:35:28 ctl02 nova-api[3474]: 2017-09-28 12:35:28.068 3474 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:35:28 ctl02 nova-api[3474]: 2017-09-28 12:35:28.068 3474 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:35:28 ctl02 nova-api[3474]: 2017-09-28 12:35:28.068 3474 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:35:28 ctl02 nova-api[3474]: 2017-09-28 12:35:28.068 3474 ERROR nova
Sep 28 12:35:28 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:35:28 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:35:28 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:35:28 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:35:28 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:35:28 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:35:28 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:35:28 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:35:28 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:35:29 ctl02 heat-api-cfn[13300]: 2017-09-28 12:35:29.006 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:35:29] "OPTIONS / HTTP/1.0" 200 134 0.000553
Sep 28 12:35:29 ctl02 heat-api[13008]: 2017-09-28 12:35:29.333 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:35:29] "OPTIONS / HTTP/1.0" 200 134 0.000604
Sep 28 12:35:29 ctl02 neutron-server[30536]: 2017-09-28 12:35:29.719 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:35:29] "OPTIONS / HTTP/1.0" 200 262 0.000514
Sep 28 12:35:29 ctl02 heat-engine[12803]: 2017-09-28 12:35:29.953 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:35:29 ctl02 heat-engine[12803]: 2017-09-28 12:35:29.958 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:35:29 ctl02 heat-engine[12803]: 2017-09-28 12:35:29.961 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:35:29 ctl02 heat-engine[12803]: 2017-09-28 12:35:29.964 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:35:29 ctl02 neutron-server[30536]: 2017-09-28 12:35:29.982 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:35:29] "OPTIONS / HTTP/1.0" 200 262 0.000487
Sep 28 12:35:30 ctl02 nova-api[3496]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:35:30 ctl02 nova-api[3496]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:35:30 ctl02 nova-api[3496]: 2017-09-28 12:35:30.303 3496 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:35:30 ctl02 nova-api[3496]: 2017-09-28 12:35:30.305 3496 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:35:30 ctl02 nova-api[3496]: 2017-09-28 12:35:30.305 3496 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:35:30 ctl02 nova-api[3496]: 2017-09-28 12:35:30.305 3496 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:35:30 ctl02 nova-api[3496]: 2017-09-28 12:35:30.305 3496 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:35:30 ctl02 nova-api[3496]: 2017-09-28 12:35:30.305 3496 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:35:30 ctl02 nova-api[3496]: 2017-09-28 12:35:30.305 3496 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:35:30 ctl02 nova-api[3496]: 2017-09-28 12:35:30.305 3496 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:35:30 ctl02 nova-api[3496]: 2017-09-28 12:35:30.305 3496 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:35:30 ctl02 nova-api[3496]: 2017-09-28 12:35:30.305 3496 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:35:30 ctl02 nova-api[3496]: 2017-09-28 12:35:30.305 3496 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:35:30 ctl02 nova-api[3496]: 2017-09-28 12:35:30.305 3496 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:35:30 ctl02 nova-api[3496]: 2017-09-28 12:35:30.305 3496 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:35:30 ctl02 nova-api[3496]: 2017-09-28 12:35:30.305 3496 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:35:30 ctl02 nova-api[3496]: 2017-09-28 12:35:30.305 3496 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:35:30 ctl02 nova-api[3496]: 2017-09-28 12:35:30.305 3496 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:35:30 ctl02 nova-api[3496]: 2017-09-28 12:35:30.305 3496 ERROR nova.wsgi     self.filename))
Sep 28 12:35:30 ctl02 nova-api[3496]: 2017-09-28 12:35:30.305 3496 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:35:30 ctl02 nova-api[3496]: 2017-09-28 12:35:30.305 3496 ERROR nova.wsgi
Sep 28 12:35:30 ctl02 nova-api[3496]: 2017-09-28 12:35:30.307 3496 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:35:30 ctl02 nova-api[3496]: 2017-09-28 12:35:30.444 3496 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:35:30 ctl02 nova-api[3496]: 2017-09-28 12:35:30.697 3496 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:35:30 ctl02 nova-api[3496]: 2017-09-28 12:35:30.700 3496 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:35:30 ctl02 nova-api[3496]: 2017-09-28 12:35:30.709 3496 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:35:30 ctl02 nova-api[3496]: 2017-09-28 12:35:30.710 3496 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:35:30 ctl02 nova-api[3496]: 2017-09-28 12:35:30.849 3496 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:35:30 ctl02 nova-api[3496]: 2017-09-28 12:35:30.852 3496 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:35:30 ctl02 nova-api[3496]: 2017-09-28 12:35:30.852 3496 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:35:30 ctl02 nova-api[3496]: 2017-09-28 12:35:30.852 3496 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:35:30 ctl02 nova-api[3496]: 2017-09-28 12:35:30.856 3496 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:35:30 ctl02 nova-api[3496]: 2017-09-28 12:35:30.856 3496 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:35:30 ctl02 nova-api[3496]: 2017-09-28 12:35:30.856 3496 ERROR nova Traceback (most recent call last):
Sep 28 12:35:30 ctl02 nova-api[3496]: 2017-09-28 12:35:30.856 3496 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:35:30 ctl02 nova-api[3496]: 2017-09-28 12:35:30.856 3496 ERROR nova     sys.exit(main())
Sep 28 12:35:30 ctl02 nova-api[3496]: 2017-09-28 12:35:30.856 3496 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:35:30 ctl02 nova-api[3496]: 2017-09-28 12:35:30.856 3496 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:35:30 ctl02 nova-api[3496]: 2017-09-28 12:35:30.856 3496 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:35:30 ctl02 nova-api[3496]: 2017-09-28 12:35:30.856 3496 ERROR nova     max_url_len=max_url_len)
Sep 28 12:35:30 ctl02 nova-api[3496]: 2017-09-28 12:35:30.856 3496 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:35:30 ctl02 nova-api[3496]: 2017-09-28 12:35:30.856 3496 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:35:30 ctl02 nova-api[3496]: 2017-09-28 12:35:30.856 3496 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:35:30 ctl02 nova-api[3496]: 2017-09-28 12:35:30.856 3496 ERROR nova     sock.listen(backlog)
Sep 28 12:35:30 ctl02 nova-api[3496]: 2017-09-28 12:35:30.856 3496 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:35:30 ctl02 nova-api[3496]: 2017-09-28 12:35:30.856 3496 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:35:30 ctl02 nova-api[3496]: 2017-09-28 12:35:30.856 3496 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:35:30 ctl02 nova-api[3496]: 2017-09-28 12:35:30.856 3496 ERROR nova
Sep 28 12:35:31 ctl02 nova-scheduler[5620]: 2017-09-28 12:35:31.018 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:35:31 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:35:31 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:35:31 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:35:31 ctl02 neutron-server[30536]: 2017-09-28 12:35:31.282 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:35:31] "OPTIONS / HTTP/1.0" 200 262 0.000565
Sep 28 12:35:31 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:35:31 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:35:31 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:35:31 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:35:31 ctl02 heat-api-cfn[13300]: 2017-09-28 12:35:31.885 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:35:31] "OPTIONS / HTTP/1.0" 200 134 0.000791
Sep 28 12:35:32 ctl02 glance-api[29183]: 2017-09-28 12:35:32.258 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:35:32] "OPTIONS / HTTP/1.0" 200 134 0.000610
Sep 28 12:35:32 ctl02 glance-api[29183]: 2017-09-28 12:35:32.268 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:35:32] "OPTIONS / HTTP/1.0" 200 134 0.000409
Sep 28 12:35:32 ctl02 glance-api[29183]: 2017-09-28 12:35:32.515 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:35:32] "OPTIONS / HTTP/1.0" 200 134 0.000644
Sep 28 12:35:33 ctl02 nova-api[3515]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:35:33 ctl02 nova-api[3515]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:35:33 ctl02 nova-api[3515]: 2017-09-28 12:35:33.270 3515 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:35:33 ctl02 nova-api[3515]: 2017-09-28 12:35:33.272 3515 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:35:33 ctl02 nova-api[3515]: 2017-09-28 12:35:33.272 3515 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:35:33 ctl02 nova-api[3515]: 2017-09-28 12:35:33.272 3515 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:35:33 ctl02 nova-api[3515]: 2017-09-28 12:35:33.272 3515 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:35:33 ctl02 nova-api[3515]: 2017-09-28 12:35:33.272 3515 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:35:33 ctl02 nova-api[3515]: 2017-09-28 12:35:33.272 3515 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:35:33 ctl02 nova-api[3515]: 2017-09-28 12:35:33.272 3515 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:35:33 ctl02 nova-api[3515]: 2017-09-28 12:35:33.272 3515 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:35:33 ctl02 nova-api[3515]: 2017-09-28 12:35:33.272 3515 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:35:33 ctl02 nova-api[3515]: 2017-09-28 12:35:33.272 3515 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:35:33 ctl02 nova-api[3515]: 2017-09-28 12:35:33.272 3515 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:35:33 ctl02 nova-api[3515]: 2017-09-28 12:35:33.272 3515 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:35:33 ctl02 nova-api[3515]: 2017-09-28 12:35:33.272 3515 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:35:33 ctl02 nova-api[3515]: 2017-09-28 12:35:33.272 3515 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:35:33 ctl02 nova-api[3515]: 2017-09-28 12:35:33.272 3515 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:35:33 ctl02 nova-api[3515]: 2017-09-28 12:35:33.272 3515 ERROR nova.wsgi     self.filename))
Sep 28 12:35:33 ctl02 nova-api[3515]: 2017-09-28 12:35:33.272 3515 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:35:33 ctl02 nova-api[3515]: 2017-09-28 12:35:33.272 3515 ERROR nova.wsgi
Sep 28 12:35:33 ctl02 nova-api[3515]: 2017-09-28 12:35:33.274 3515 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:35:33 ctl02 nova-api[3515]: 2017-09-28 12:35:33.407 3515 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:35:33 ctl02 nova-api[3515]: 2017-09-28 12:35:33.656 3515 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:35:33 ctl02 nova-api[3515]: 2017-09-28 12:35:33.659 3515 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:35:33 ctl02 nova-api[3515]: 2017-09-28 12:35:33.659 3515 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:35:33 ctl02 nova-api[3515]: 2017-09-28 12:35:33.660 3515 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:35:33 ctl02 nova-api[3515]: 2017-09-28 12:35:33.796 3515 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:35:33 ctl02 nova-api[3515]: 2017-09-28 12:35:33.800 3515 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:35:33 ctl02 nova-api[3515]: 2017-09-28 12:35:33.800 3515 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:35:33 ctl02 nova-api[3515]: 2017-09-28 12:35:33.800 3515 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:35:33 ctl02 nova-api[3515]: 2017-09-28 12:35:33.804 3515 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:35:33 ctl02 nova-api[3515]: 2017-09-28 12:35:33.805 3515 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:35:33 ctl02 nova-api[3515]: 2017-09-28 12:35:33.805 3515 ERROR nova Traceback (most recent call last):
Sep 28 12:35:33 ctl02 nova-api[3515]: 2017-09-28 12:35:33.805 3515 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:35:33 ctl02 nova-api[3515]: 2017-09-28 12:35:33.805 3515 ERROR nova     sys.exit(main())
Sep 28 12:35:33 ctl02 nova-api[3515]: 2017-09-28 12:35:33.805 3515 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:35:33 ctl02 nova-api[3515]: 2017-09-28 12:35:33.805 3515 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:35:33 ctl02 nova-api[3515]: 2017-09-28 12:35:33.805 3515 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:35:33 ctl02 nova-api[3515]: 2017-09-28 12:35:33.805 3515 ERROR nova     max_url_len=max_url_len)
Sep 28 12:35:33 ctl02 nova-api[3515]: 2017-09-28 12:35:33.805 3515 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:35:33 ctl02 nova-api[3515]: 2017-09-28 12:35:33.805 3515 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:35:33 ctl02 nova-api[3515]: 2017-09-28 12:35:33.805 3515 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:35:33 ctl02 nova-api[3515]: 2017-09-28 12:35:33.805 3515 ERROR nova     sock.listen(backlog)
Sep 28 12:35:33 ctl02 nova-api[3515]: 2017-09-28 12:35:33.805 3515 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:35:33 ctl02 nova-api[3515]: 2017-09-28 12:35:33.805 3515 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:35:33 ctl02 nova-api[3515]: 2017-09-28 12:35:33.805 3515 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:35:33 ctl02 nova-api[3515]: 2017-09-28 12:35:33.805 3515 ERROR nova
Sep 28 12:35:33 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:35:33 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:35:33 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:35:34 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:35:34 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:35:34 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:35:34 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:35:34 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:35:34.787 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:35:34] "OPTIONS / HTTP/1.0" 200 134 0.000533
Sep 28 12:35:35 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:35:35.262 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:35:35] "OPTIONS / HTTP/1.0" 200 134 0.000462
Sep 28 12:35:35 ctl02 heat-api[13008]: 2017-09-28 12:35:35.344 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:35:35] "OPTIONS / HTTP/1.0" 200 134 0.000530
Sep 28 12:35:35 ctl02 nova-api[3533]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:35:35 ctl02 nova-api[3533]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:35:36 ctl02 nova-api[3533]: 2017-09-28 12:35:36.048 3533 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:35:36 ctl02 nova-api[3533]: 2017-09-28 12:35:36.050 3533 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:35:36 ctl02 nova-api[3533]: 2017-09-28 12:35:36.050 3533 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:35:36 ctl02 nova-api[3533]: 2017-09-28 12:35:36.050 3533 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:35:36 ctl02 nova-api[3533]: 2017-09-28 12:35:36.050 3533 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:35:36 ctl02 nova-api[3533]: 2017-09-28 12:35:36.050 3533 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:35:36 ctl02 nova-api[3533]: 2017-09-28 12:35:36.050 3533 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:35:36 ctl02 nova-api[3533]: 2017-09-28 12:35:36.050 3533 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:35:36 ctl02 nova-api[3533]: 2017-09-28 12:35:36.050 3533 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:35:36 ctl02 nova-api[3533]: 2017-09-28 12:35:36.050 3533 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:35:36 ctl02 nova-api[3533]: 2017-09-28 12:35:36.050 3533 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:35:36 ctl02 nova-api[3533]: 2017-09-28 12:35:36.050 3533 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:35:36 ctl02 nova-api[3533]: 2017-09-28 12:35:36.050 3533 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:35:36 ctl02 nova-api[3533]: 2017-09-28 12:35:36.050 3533 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:35:36 ctl02 nova-api[3533]: 2017-09-28 12:35:36.050 3533 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:35:36 ctl02 nova-api[3533]: 2017-09-28 12:35:36.050 3533 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:35:36 ctl02 nova-api[3533]: 2017-09-28 12:35:36.050 3533 ERROR nova.wsgi     self.filename))
Sep 28 12:35:36 ctl02 nova-api[3533]: 2017-09-28 12:35:36.050 3533 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:35:36 ctl02 nova-api[3533]: 2017-09-28 12:35:36.050 3533 ERROR nova.wsgi
Sep 28 12:35:36 ctl02 nova-api[3533]: 2017-09-28 12:35:36.052 3533 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:35:36 ctl02 nova-api[3533]: 2017-09-28 12:35:36.184 3533 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:35:36 ctl02 neutron-server[30536]: 2017-09-28 12:35:36.362 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 4 dead agents out of 6:
Sep 28 12:35:36 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:35:36 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:34:46 cmp002
Sep 28 12:35:36 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:34:38 cmp001
Sep 28 12:35:36 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:34:50 cmp002
Sep 28 12:35:36 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:35:06 cmp002
Sep 28 12:35:36 ctl02 nova-api[3533]: 2017-09-28 12:35:36.433 3533 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:35:36 ctl02 nova-api[3533]: 2017-09-28 12:35:36.435 3533 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:35:36 ctl02 nova-api[3533]: 2017-09-28 12:35:36.436 3533 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:35:36 ctl02 nova-api[3533]: 2017-09-28 12:35:36.436 3533 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:35:36 ctl02 nova-api[3533]: 2017-09-28 12:35:36.573 3533 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:35:36 ctl02 nova-api[3533]: 2017-09-28 12:35:36.576 3533 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:35:36 ctl02 nova-api[3533]: 2017-09-28 12:35:36.576 3533 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:35:36 ctl02 nova-api[3533]: 2017-09-28 12:35:36.577 3533 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:35:36 ctl02 nova-api[3533]: 2017-09-28 12:35:36.580 3533 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:35:36 ctl02 nova-api[3533]: 2017-09-28 12:35:36.581 3533 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:35:36 ctl02 nova-api[3533]: 2017-09-28 12:35:36.581 3533 ERROR nova Traceback (most recent call last):
Sep 28 12:35:36 ctl02 nova-api[3533]: 2017-09-28 12:35:36.581 3533 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:35:36 ctl02 nova-api[3533]: 2017-09-28 12:35:36.581 3533 ERROR nova     sys.exit(main())
Sep 28 12:35:36 ctl02 nova-api[3533]: 2017-09-28 12:35:36.581 3533 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:35:36 ctl02 nova-api[3533]: 2017-09-28 12:35:36.581 3533 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:35:36 ctl02 nova-api[3533]: 2017-09-28 12:35:36.581 3533 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:35:36 ctl02 nova-api[3533]: 2017-09-28 12:35:36.581 3533 ERROR nova     max_url_len=max_url_len)
Sep 28 12:35:36 ctl02 nova-api[3533]: 2017-09-28 12:35:36.581 3533 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:35:36 ctl02 nova-api[3533]: 2017-09-28 12:35:36.581 3533 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:35:36 ctl02 nova-api[3533]: 2017-09-28 12:35:36.581 3533 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:35:36 ctl02 nova-api[3533]: 2017-09-28 12:35:36.581 3533 ERROR nova     sock.listen(backlog)
Sep 28 12:35:36 ctl02 nova-api[3533]: 2017-09-28 12:35:36.581 3533 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:35:36 ctl02 nova-api[3533]: 2017-09-28 12:35:36.581 3533 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:35:36 ctl02 nova-api[3533]: 2017-09-28 12:35:36.581 3533 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:35:36 ctl02 nova-api[3533]: 2017-09-28 12:35:36.581 3533 ERROR nova
Sep 28 12:35:36 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:35:36 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:35:36 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:35:36 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:35:36 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:35:36 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:35:36 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:35:37 ctl02 heat-api-cfn[13300]: 2017-09-28 12:35:37.387 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:35:37] "OPTIONS / HTTP/1.0" 200 134 0.000448
Sep 28 12:35:37 ctl02 heat-api[13008]: 2017-09-28 12:35:37.516 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:35:37] "OPTIONS / HTTP/1.0" 200 134 0.000520
Sep 28 12:35:38 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:35:38.243 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:35:38] "OPTIONS / HTTP/1.0" 200 134 0.000462
Sep 28 12:35:38 ctl02 nova-api[3551]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:35:38 ctl02 nova-api[3551]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:35:38 ctl02 heat-api-cfn[13300]: 2017-09-28 12:35:38.689 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:35:38] "OPTIONS / HTTP/1.0" 200 134 0.000530
Sep 28 12:35:38 ctl02 nova-api[3551]: 2017-09-28 12:35:38.756 3551 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:35:38 ctl02 nova-api[3551]: 2017-09-28 12:35:38.757 3551 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:35:38 ctl02 nova-api[3551]: 2017-09-28 12:35:38.757 3551 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:35:38 ctl02 nova-api[3551]: 2017-09-28 12:35:38.757 3551 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:35:38 ctl02 nova-api[3551]: 2017-09-28 12:35:38.757 3551 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:35:38 ctl02 nova-api[3551]: 2017-09-28 12:35:38.757 3551 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:35:38 ctl02 nova-api[3551]: 2017-09-28 12:35:38.757 3551 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:35:38 ctl02 nova-api[3551]: 2017-09-28 12:35:38.757 3551 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:35:38 ctl02 nova-api[3551]: 2017-09-28 12:35:38.757 3551 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:35:38 ctl02 nova-api[3551]: 2017-09-28 12:35:38.757 3551 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:35:38 ctl02 nova-api[3551]: 2017-09-28 12:35:38.757 3551 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:35:38 ctl02 nova-api[3551]: 2017-09-28 12:35:38.757 3551 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:35:38 ctl02 nova-api[3551]: 2017-09-28 12:35:38.757 3551 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:35:38 ctl02 nova-api[3551]: 2017-09-28 12:35:38.757 3551 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:35:38 ctl02 nova-api[3551]: 2017-09-28 12:35:38.757 3551 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:35:38 ctl02 nova-api[3551]: 2017-09-28 12:35:38.757 3551 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:35:38 ctl02 nova-api[3551]: 2017-09-28 12:35:38.757 3551 ERROR nova.wsgi     self.filename))
Sep 28 12:35:38 ctl02 nova-api[3551]: 2017-09-28 12:35:38.757 3551 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:35:38 ctl02 nova-api[3551]: 2017-09-28 12:35:38.757 3551 ERROR nova.wsgi
Sep 28 12:35:38 ctl02 nova-api[3551]: 2017-09-28 12:35:38.758 3551 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:35:38 ctl02 nova-api[3551]: 2017-09-28 12:35:38.890 3551 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:35:39 ctl02 heat-api[13008]: 2017-09-28 12:35:39.066 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:35:39] "OPTIONS / HTTP/1.0" 200 134 0.000548
Sep 28 12:35:39 ctl02 nova-api[3551]: 2017-09-28 12:35:39.136 3551 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:35:39 ctl02 nova-api[3551]: 2017-09-28 12:35:39.138 3551 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:35:39 ctl02 nova-api[3551]: 2017-09-28 12:35:39.138 3551 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:35:39 ctl02 nova-api[3551]: 2017-09-28 12:35:39.138 3551 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:35:39 ctl02 nova-api[3551]: 2017-09-28 12:35:39.273 3551 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:35:39 ctl02 nova-api[3551]: 2017-09-28 12:35:39.275 3551 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:35:39 ctl02 nova-api[3551]: 2017-09-28 12:35:39.275 3551 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:35:39 ctl02 nova-api[3551]: 2017-09-28 12:35:39.276 3551 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:35:39 ctl02 nova-api[3551]: 2017-09-28 12:35:39.279 3551 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:35:39 ctl02 nova-api[3551]: 2017-09-28 12:35:39.279 3551 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:35:39 ctl02 nova-api[3551]: 2017-09-28 12:35:39.279 3551 ERROR nova Traceback (most recent call last):
Sep 28 12:35:39 ctl02 nova-api[3551]: 2017-09-28 12:35:39.279 3551 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:35:39 ctl02 nova-api[3551]: 2017-09-28 12:35:39.279 3551 ERROR nova     sys.exit(main())
Sep 28 12:35:39 ctl02 nova-api[3551]: 2017-09-28 12:35:39.279 3551 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:35:39 ctl02 nova-api[3551]: 2017-09-28 12:35:39.279 3551 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:35:39 ctl02 nova-api[3551]: 2017-09-28 12:35:39.279 3551 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:35:39 ctl02 nova-api[3551]: 2017-09-28 12:35:39.279 3551 ERROR nova     max_url_len=max_url_len)
Sep 28 12:35:39 ctl02 nova-api[3551]: 2017-09-28 12:35:39.279 3551 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:35:39 ctl02 nova-api[3551]: 2017-09-28 12:35:39.279 3551 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:35:39 ctl02 nova-api[3551]: 2017-09-28 12:35:39.279 3551 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:35:39 ctl02 nova-api[3551]: 2017-09-28 12:35:39.279 3551 ERROR nova     sock.listen(backlog)
Sep 28 12:35:39 ctl02 nova-api[3551]: 2017-09-28 12:35:39.279 3551 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:35:39 ctl02 nova-api[3551]: 2017-09-28 12:35:39.279 3551 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:35:39 ctl02 nova-api[3551]: 2017-09-28 12:35:39.279 3551 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:35:39 ctl02 nova-api[3551]: 2017-09-28 12:35:39.279 3551 ERROR nova
Sep 28 12:35:39 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:35:39 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:35:39 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:35:39 ctl02 neutron-server[30536]: 2017-09-28 12:35:39.545 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:35:39] "OPTIONS / HTTP/1.0" 200 262 0.000624
Sep 28 12:35:39 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:35:39 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:35:39 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:35:39 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:35:40 ctl02 neutron-server[30536]: 2017-09-28 12:35:40.253 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:35:40] "OPTIONS / HTTP/1.0" 200 262 0.000553
Sep 28 12:35:41 ctl02 neutron-server[30536]: 2017-09-28 12:35:41.023 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:35:41] "OPTIONS / HTTP/1.0" 200 262 0.000508
Sep 28 12:35:41 ctl02 nova-api[3568]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:35:41 ctl02 nova-api[3568]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:35:41 ctl02 nova-api[3568]: 2017-09-28 12:35:41.556 3568 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:35:41 ctl02 nova-api[3568]: 2017-09-28 12:35:41.558 3568 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:35:41 ctl02 nova-api[3568]: 2017-09-28 12:35:41.558 3568 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:35:41 ctl02 nova-api[3568]: 2017-09-28 12:35:41.558 3568 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:35:41 ctl02 nova-api[3568]: 2017-09-28 12:35:41.558 3568 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:35:41 ctl02 nova-api[3568]: 2017-09-28 12:35:41.558 3568 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:35:41 ctl02 nova-api[3568]: 2017-09-28 12:35:41.558 3568 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:35:41 ctl02 nova-api[3568]: 2017-09-28 12:35:41.558 3568 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:35:41 ctl02 nova-api[3568]: 2017-09-28 12:35:41.558 3568 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:35:41 ctl02 nova-api[3568]: 2017-09-28 12:35:41.558 3568 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:35:41 ctl02 nova-api[3568]: 2017-09-28 12:35:41.558 3568 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:35:41 ctl02 nova-api[3568]: 2017-09-28 12:35:41.558 3568 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:35:41 ctl02 nova-api[3568]: 2017-09-28 12:35:41.558 3568 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:35:41 ctl02 nova-api[3568]: 2017-09-28 12:35:41.558 3568 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:35:41 ctl02 nova-api[3568]: 2017-09-28 12:35:41.558 3568 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:35:41 ctl02 nova-api[3568]: 2017-09-28 12:35:41.558 3568 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:35:41 ctl02 nova-api[3568]: 2017-09-28 12:35:41.558 3568 ERROR nova.wsgi     self.filename))
Sep 28 12:35:41 ctl02 nova-api[3568]: 2017-09-28 12:35:41.558 3568 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:35:41 ctl02 nova-api[3568]: 2017-09-28 12:35:41.558 3568 ERROR nova.wsgi
Sep 28 12:35:41 ctl02 nova-api[3568]: 2017-09-28 12:35:41.559 3568 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:35:41 ctl02 nova-api[3568]: 2017-09-28 12:35:41.693 3568 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:35:41 ctl02 glance-api[29183]: 2017-09-28 12:35:41.915 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:35:41] "OPTIONS / HTTP/1.0" 200 134 0.000643
Sep 28 12:35:41 ctl02 nova-api[3568]: 2017-09-28 12:35:41.936 3568 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:35:41 ctl02 nova-api[3568]: 2017-09-28 12:35:41.938 3568 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:35:41 ctl02 nova-api[3568]: 2017-09-28 12:35:41.939 3568 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:35:41 ctl02 nova-api[3568]: 2017-09-28 12:35:41.939 3568 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:35:42 ctl02 nova-api[3568]: 2017-09-28 12:35:42.068 3568 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:35:42 ctl02 nova-api[3568]: 2017-09-28 12:35:42.070 3568 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:35:42 ctl02 nova-api[3568]: 2017-09-28 12:35:42.070 3568 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:35:42 ctl02 nova-api[3568]: 2017-09-28 12:35:42.070 3568 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:35:42 ctl02 nova-api[3568]: 2017-09-28 12:35:42.073 3568 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:35:42 ctl02 nova-api[3568]: 2017-09-28 12:35:42.074 3568 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:35:42 ctl02 nova-api[3568]: 2017-09-28 12:35:42.074 3568 ERROR nova Traceback (most recent call last):
Sep 28 12:35:42 ctl02 nova-api[3568]: 2017-09-28 12:35:42.074 3568 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:35:42 ctl02 nova-api[3568]: 2017-09-28 12:35:42.074 3568 ERROR nova     sys.exit(main())
Sep 28 12:35:42 ctl02 nova-api[3568]: 2017-09-28 12:35:42.074 3568 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:35:42 ctl02 nova-api[3568]: 2017-09-28 12:35:42.074 3568 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:35:42 ctl02 nova-api[3568]: 2017-09-28 12:35:42.074 3568 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:35:42 ctl02 nova-api[3568]: 2017-09-28 12:35:42.074 3568 ERROR nova     max_url_len=max_url_len)
Sep 28 12:35:42 ctl02 nova-api[3568]: 2017-09-28 12:35:42.074 3568 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:35:42 ctl02 nova-api[3568]: 2017-09-28 12:35:42.074 3568 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:35:42 ctl02 nova-api[3568]: 2017-09-28 12:35:42.074 3568 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:35:42 ctl02 nova-api[3568]: 2017-09-28 12:35:42.074 3568 ERROR nova     sock.listen(backlog)
Sep 28 12:35:42 ctl02 nova-api[3568]: 2017-09-28 12:35:42.074 3568 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:35:42 ctl02 nova-api[3568]: 2017-09-28 12:35:42.074 3568 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:35:42 ctl02 nova-api[3568]: 2017-09-28 12:35:42.074 3568 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:35:42 ctl02 nova-api[3568]: 2017-09-28 12:35:42.074 3568 ERROR nova
Sep 28 12:35:42 ctl02 heat-api-cfn[13300]: 2017-09-28 12:35:42.189 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:35:42] "OPTIONS / HTTP/1.0" 200 134 0.000470
Sep 28 12:35:42 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:35:42 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:35:42 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:35:42 ctl02 glance-api[29183]: 2017-09-28 12:35:42.259 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:35:42] "OPTIONS / HTTP/1.0" 200 134 0.000598
Sep 28 12:35:42 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:35:42 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:35:42 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:35:42 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:35:42 ctl02 glance-api[29183]: 2017-09-28 12:35:42.647 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:35:42] "OPTIONS / HTTP/1.0" 200 134 0.000574
Sep 28 12:35:43 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4770fc31)
Sep 28 12:35:43 ctl02 neutron-server[30536]: 2017-09-28 12:35:43.504 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:35:44 ctl02 nova-api[3587]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:35:44 ctl02 nova-api[3587]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:35:44 ctl02 nova-api[3587]: 2017-09-28 12:35:44.210 3587 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:35:44 ctl02 nova-api[3587]: 2017-09-28 12:35:44.211 3587 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:35:44 ctl02 nova-api[3587]: 2017-09-28 12:35:44.211 3587 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:35:44 ctl02 nova-api[3587]: 2017-09-28 12:35:44.211 3587 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:35:44 ctl02 nova-api[3587]: 2017-09-28 12:35:44.211 3587 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:35:44 ctl02 nova-api[3587]: 2017-09-28 12:35:44.211 3587 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:35:44 ctl02 nova-api[3587]: 2017-09-28 12:35:44.211 3587 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:35:44 ctl02 nova-api[3587]: 2017-09-28 12:35:44.211 3587 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:35:44 ctl02 nova-api[3587]: 2017-09-28 12:35:44.211 3587 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:35:44 ctl02 nova-api[3587]: 2017-09-28 12:35:44.211 3587 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:35:44 ctl02 nova-api[3587]: 2017-09-28 12:35:44.211 3587 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:35:44 ctl02 nova-api[3587]: 2017-09-28 12:35:44.211 3587 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:35:44 ctl02 nova-api[3587]: 2017-09-28 12:35:44.211 3587 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:35:44 ctl02 nova-api[3587]: 2017-09-28 12:35:44.211 3587 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:35:44 ctl02 nova-api[3587]: 2017-09-28 12:35:44.211 3587 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:35:44 ctl02 nova-api[3587]: 2017-09-28 12:35:44.211 3587 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:35:44 ctl02 nova-api[3587]: 2017-09-28 12:35:44.211 3587 ERROR nova.wsgi     self.filename))
Sep 28 12:35:44 ctl02 nova-api[3587]: 2017-09-28 12:35:44.211 3587 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:35:44 ctl02 nova-api[3587]: 2017-09-28 12:35:44.211 3587 ERROR nova.wsgi
Sep 28 12:35:44 ctl02 nova-api[3587]: 2017-09-28 12:35:44.214 3587 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:35:44 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4770fc31)
Sep 28 12:35:44 ctl02 nova-api[3587]: 2017-09-28 12:35:44.343 3587 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:35:44 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:35:44.478 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:35:44] "OPTIONS / HTTP/1.0" 200 134 0.000425
Sep 28 12:35:44 ctl02 nova-api[3587]: 2017-09-28 12:35:44.565 3587 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:35:44 ctl02 nova-api[3587]: 2017-09-28 12:35:44.567 3587 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:35:44 ctl02 nova-api[3587]: 2017-09-28 12:35:44.567 3587 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:35:44 ctl02 nova-api[3587]: 2017-09-28 12:35:44.568 3587 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:35:44 ctl02 nova-api[3587]: 2017-09-28 12:35:44.697 3587 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:35:44 ctl02 nova-api[3587]: 2017-09-28 12:35:44.699 3587 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:35:44 ctl02 nova-api[3587]: 2017-09-28 12:35:44.700 3587 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:35:44 ctl02 nova-api[3587]: 2017-09-28 12:35:44.700 3587 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:35:44 ctl02 nova-api[3587]: 2017-09-28 12:35:44.703 3587 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:35:44 ctl02 nova-api[3587]: 2017-09-28 12:35:44.704 3587 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:35:44 ctl02 nova-api[3587]: 2017-09-28 12:35:44.704 3587 ERROR nova Traceback (most recent call last):
Sep 28 12:35:44 ctl02 nova-api[3587]: 2017-09-28 12:35:44.704 3587 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:35:44 ctl02 nova-api[3587]: 2017-09-28 12:35:44.704 3587 ERROR nova     sys.exit(main())
Sep 28 12:35:44 ctl02 nova-api[3587]: 2017-09-28 12:35:44.704 3587 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:35:44 ctl02 nova-api[3587]: 2017-09-28 12:35:44.704 3587 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:35:44 ctl02 nova-api[3587]: 2017-09-28 12:35:44.704 3587 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:35:44 ctl02 nova-api[3587]: 2017-09-28 12:35:44.704 3587 ERROR nova     max_url_len=max_url_len)
Sep 28 12:35:44 ctl02 nova-api[3587]: 2017-09-28 12:35:44.704 3587 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:35:44 ctl02 nova-api[3587]: 2017-09-28 12:35:44.704 3587 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:35:44 ctl02 nova-api[3587]: 2017-09-28 12:35:44.704 3587 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:35:44 ctl02 nova-api[3587]: 2017-09-28 12:35:44.704 3587 ERROR nova     sock.listen(backlog)
Sep 28 12:35:44 ctl02 nova-api[3587]: 2017-09-28 12:35:44.704 3587 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:35:44 ctl02 nova-api[3587]: 2017-09-28 12:35:44.704 3587 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:35:44 ctl02 nova-api[3587]: 2017-09-28 12:35:44.704 3587 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:35:44 ctl02 nova-api[3587]: 2017-09-28 12:35:44.704 3587 ERROR nova
Sep 28 12:35:44 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:35:44 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:35:44 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:35:45 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:35:45 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:35:45 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:35:45 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:35:45 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4770fc31)
Sep 28 12:35:45 ctl02 heat-api[13008]: 2017-09-28 12:35:45.331 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:35:45] "OPTIONS / HTTP/1.0" 200 134 0.000523
Sep 28 12:35:45 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:35:45.461 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:35:45] "OPTIONS / HTTP/1.0" 200 134 0.000391
Sep 28 12:35:46 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4770fc31)
Sep 28 12:35:46 ctl02 nova-api[3605]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:35:46 ctl02 nova-api[3605]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:35:46 ctl02 nova-api[3605]: 2017-09-28 12:35:46.987 3605 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:35:46 ctl02 nova-api[3605]: 2017-09-28 12:35:46.989 3605 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:35:46 ctl02 nova-api[3605]: 2017-09-28 12:35:46.989 3605 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:35:46 ctl02 nova-api[3605]: 2017-09-28 12:35:46.989 3605 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:35:46 ctl02 nova-api[3605]: 2017-09-28 12:35:46.989 3605 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:35:46 ctl02 nova-api[3605]: 2017-09-28 12:35:46.989 3605 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:35:46 ctl02 nova-api[3605]: 2017-09-28 12:35:46.989 3605 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:35:46 ctl02 nova-api[3605]: 2017-09-28 12:35:46.989 3605 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:35:46 ctl02 nova-api[3605]: 2017-09-28 12:35:46.989 3605 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:35:46 ctl02 nova-api[3605]: 2017-09-28 12:35:46.989 3605 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:35:46 ctl02 nova-api[3605]: 2017-09-28 12:35:46.989 3605 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:35:46 ctl02 nova-api[3605]: 2017-09-28 12:35:46.989 3605 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:35:46 ctl02 nova-api[3605]: 2017-09-28 12:35:46.989 3605 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:35:46 ctl02 nova-api[3605]: 2017-09-28 12:35:46.989 3605 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:35:46 ctl02 nova-api[3605]: 2017-09-28 12:35:46.989 3605 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:35:46 ctl02 nova-api[3605]: 2017-09-28 12:35:46.989 3605 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:35:46 ctl02 nova-api[3605]: 2017-09-28 12:35:46.989 3605 ERROR nova.wsgi     self.filename))
Sep 28 12:35:46 ctl02 nova-api[3605]: 2017-09-28 12:35:46.989 3605 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:35:46 ctl02 nova-api[3605]: 2017-09-28 12:35:46.989 3605 ERROR nova.wsgi
Sep 28 12:35:46 ctl02 nova-api[3605]: 2017-09-28 12:35:46.990 3605 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:35:47 ctl02 nova-api[3605]: 2017-09-28 12:35:47.117 3605 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:35:47 ctl02 heat-api[13008]: 2017-09-28 12:35:47.218 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:35:47] "OPTIONS / HTTP/1.0" 200 134 0.000566
Sep 28 12:35:47 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4770fc31)
Sep 28 12:35:47 ctl02 nova-api[3605]: 2017-09-28 12:35:47.347 3605 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:35:47 ctl02 nova-api[3605]: 2017-09-28 12:35:47.349 3605 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:35:47 ctl02 nova-api[3605]: 2017-09-28 12:35:47.349 3605 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:35:47 ctl02 nova-api[3605]: 2017-09-28 12:35:47.349 3605 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:35:47 ctl02 nova-api[3605]: 2017-09-28 12:35:47.479 3605 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:35:47 ctl02 nova-api[3605]: 2017-09-28 12:35:47.481 3605 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:35:47 ctl02 nova-api[3605]: 2017-09-28 12:35:47.481 3605 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:35:47 ctl02 nova-api[3605]: 2017-09-28 12:35:47.482 3605 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:35:47 ctl02 nova-api[3605]: 2017-09-28 12:35:47.485 3605 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:35:47 ctl02 nova-api[3605]: 2017-09-28 12:35:47.485 3605 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:35:47 ctl02 nova-api[3605]: 2017-09-28 12:35:47.485 3605 ERROR nova Traceback (most recent call last):
Sep 28 12:35:47 ctl02 nova-api[3605]: 2017-09-28 12:35:47.485 3605 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:35:47 ctl02 nova-api[3605]: 2017-09-28 12:35:47.485 3605 ERROR nova     sys.exit(main())
Sep 28 12:35:47 ctl02 nova-api[3605]: 2017-09-28 12:35:47.485 3605 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:35:47 ctl02 nova-api[3605]: 2017-09-28 12:35:47.485 3605 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:35:47 ctl02 nova-api[3605]: 2017-09-28 12:35:47.485 3605 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:35:47 ctl02 nova-api[3605]: 2017-09-28 12:35:47.485 3605 ERROR nova     max_url_len=max_url_len)
Sep 28 12:35:47 ctl02 nova-api[3605]: 2017-09-28 12:35:47.485 3605 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:35:47 ctl02 nova-api[3605]: 2017-09-28 12:35:47.485 3605 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:35:47 ctl02 nova-api[3605]: 2017-09-28 12:35:47.485 3605 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:35:47 ctl02 nova-api[3605]: 2017-09-28 12:35:47.485 3605 ERROR nova     sock.listen(backlog)
Sep 28 12:35:47 ctl02 nova-api[3605]: 2017-09-28 12:35:47.485 3605 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:35:47 ctl02 nova-api[3605]: 2017-09-28 12:35:47.485 3605 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:35:47 ctl02 nova-api[3605]: 2017-09-28 12:35:47.485 3605 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:35:47 ctl02 nova-api[3605]: 2017-09-28 12:35:47.485 3605 ERROR nova
Sep 28 12:35:47 ctl02 heat-api-cfn[13300]: 2017-09-28 12:35:47.513 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:35:47] "OPTIONS / HTTP/1.0" 200 134 0.000524
Sep 28 12:35:47 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:35:47 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:35:47 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:35:47 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:35:47 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:35:47 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:35:47 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:35:48 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4770fc31)
Sep 28 12:35:48 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:35:48.618 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:35:48] "OPTIONS / HTTP/1.0" 200 134 0.000403
Sep 28 12:35:49 ctl02 heat-api-cfn[13300]: 2017-09-28 12:35:49.047 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:35:49] "OPTIONS / HTTP/1.0" 200 134 0.000418
Sep 28 12:35:49 ctl02 heat-api[13008]: 2017-09-28 12:35:49.190 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:35:49] "OPTIONS / HTTP/1.0" 200 134 0.000529
Sep 28 12:35:49 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4770fc31)
Sep 28 12:35:49 ctl02 neutron-server[30536]: 2017-09-28 12:35:49.480 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:35:49] "OPTIONS / HTTP/1.0" 200 262 0.000481
Sep 28 12:35:49 ctl02 nova-api[3623]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:35:49 ctl02 nova-api[3623]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:35:49 ctl02 nova-api[3623]: 2017-09-28 12:35:49.720 3623 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:35:49 ctl02 nova-api[3623]: 2017-09-28 12:35:49.722 3623 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:35:49 ctl02 nova-api[3623]: 2017-09-28 12:35:49.722 3623 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:35:49 ctl02 nova-api[3623]: 2017-09-28 12:35:49.722 3623 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:35:49 ctl02 nova-api[3623]: 2017-09-28 12:35:49.722 3623 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:35:49 ctl02 nova-api[3623]: 2017-09-28 12:35:49.722 3623 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:35:49 ctl02 nova-api[3623]: 2017-09-28 12:35:49.722 3623 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:35:49 ctl02 nova-api[3623]: 2017-09-28 12:35:49.722 3623 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:35:49 ctl02 nova-api[3623]: 2017-09-28 12:35:49.722 3623 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:35:49 ctl02 nova-api[3623]: 2017-09-28 12:35:49.722 3623 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:35:49 ctl02 nova-api[3623]: 2017-09-28 12:35:49.722 3623 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:35:49 ctl02 nova-api[3623]: 2017-09-28 12:35:49.722 3623 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:35:49 ctl02 nova-api[3623]: 2017-09-28 12:35:49.722 3623 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:35:49 ctl02 nova-api[3623]: 2017-09-28 12:35:49.722 3623 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:35:49 ctl02 nova-api[3623]: 2017-09-28 12:35:49.722 3623 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:35:49 ctl02 nova-api[3623]: 2017-09-28 12:35:49.722 3623 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:35:49 ctl02 nova-api[3623]: 2017-09-28 12:35:49.722 3623 ERROR nova.wsgi     self.filename))
Sep 28 12:35:49 ctl02 nova-api[3623]: 2017-09-28 12:35:49.722 3623 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:35:49 ctl02 nova-api[3623]: 2017-09-28 12:35:49.722 3623 ERROR nova.wsgi
Sep 28 12:35:49 ctl02 nova-api[3623]: 2017-09-28 12:35:49.723 3623 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:35:49 ctl02 nova-api[3623]: 2017-09-28 12:35:49.851 3623 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:35:50 ctl02 nova-api[3623]: 2017-09-28 12:35:50.080 3623 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:35:50 ctl02 nova-api[3623]: 2017-09-28 12:35:50.082 3623 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:35:50 ctl02 nova-api[3623]: 2017-09-28 12:35:50.082 3623 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:35:50 ctl02 nova-api[3623]: 2017-09-28 12:35:50.083 3623 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:35:50 ctl02 nova-cert[4860]: 2017-09-28 12:35:50.132 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:35:50 ctl02 nova-api[3623]: 2017-09-28 12:35:50.213 3623 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:35:50 ctl02 nova-api[3623]: 2017-09-28 12:35:50.215 3623 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:35:50 ctl02 nova-api[3623]: 2017-09-28 12:35:50.215 3623 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:35:50 ctl02 nova-api[3623]: 2017-09-28 12:35:50.215 3623 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:35:50 ctl02 nova-api[3623]: 2017-09-28 12:35:50.218 3623 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:35:50 ctl02 nova-api[3623]: 2017-09-28 12:35:50.219 3623 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:35:50 ctl02 nova-api[3623]: 2017-09-28 12:35:50.219 3623 ERROR nova Traceback (most recent call last):
Sep 28 12:35:50 ctl02 nova-api[3623]: 2017-09-28 12:35:50.219 3623 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:35:50 ctl02 nova-api[3623]: 2017-09-28 12:35:50.219 3623 ERROR nova     sys.exit(main())
Sep 28 12:35:50 ctl02 nova-api[3623]: 2017-09-28 12:35:50.219 3623 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:35:50 ctl02 nova-api[3623]: 2017-09-28 12:35:50.219 3623 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:35:50 ctl02 nova-api[3623]: 2017-09-28 12:35:50.219 3623 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:35:50 ctl02 nova-api[3623]: 2017-09-28 12:35:50.219 3623 ERROR nova     max_url_len=max_url_len)
Sep 28 12:35:50 ctl02 nova-api[3623]: 2017-09-28 12:35:50.219 3623 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:35:50 ctl02 nova-api[3623]: 2017-09-28 12:35:50.219 3623 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:35:50 ctl02 nova-api[3623]: 2017-09-28 12:35:50.219 3623 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:35:50 ctl02 nova-api[3623]: 2017-09-28 12:35:50.219 3623 ERROR nova     sock.listen(backlog)
Sep 28 12:35:50 ctl02 nova-api[3623]: 2017-09-28 12:35:50.219 3623 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:35:50 ctl02 nova-api[3623]: 2017-09-28 12:35:50.219 3623 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:35:50 ctl02 nova-api[3623]: 2017-09-28 12:35:50.219 3623 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:35:50 ctl02 nova-api[3623]: 2017-09-28 12:35:50.219 3623 ERROR nova
Sep 28 12:35:50 ctl02 neutron-server[30536]: 2017-09-28 12:35:50.261 30605 WARNING oslo_messaging._drivers.amqpdriver [req-f5bade4a-9238-48d9-b148-571abd2f7028 - - - - -] reply_692b03e6d8d44d758b6be19b067c3aa3 doesn't exists, drop reply to fdd0a42deb444f348d5fa9254ce6a670
Sep 28 12:35:50 ctl02 neutron-server[30536]: 2017-09-28 12:35:50.262 30605 INFO oslo_messaging._drivers.amqpdriver [req-f5bade4a-9238-48d9-b148-571abd2f7028 - - - - -] The reply fdd0a42deb444f348d5fa9254ce6a670 cannot be sent  reply_692b03e6d8d44d758b6be19b067c3aa3 reply queue don't exist after 60 sec abandoning...
Sep 28 12:35:50 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4770fc31)
Sep 28 12:35:50 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:35:50 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:35:50 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:35:50 ctl02 neutron-server[30536]: 2017-09-28 12:35:50.625 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:35:50] "OPTIONS / HTTP/1.0" 200 262 0.000628
Sep 28 12:35:50 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:35:50 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:35:50 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:35:50 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:35:50 ctl02 nova-conductor[5056]: 2017-09-28 12:35:50.827 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:35:50 ctl02 nova-conductor[5056]: 2017-09-28 12:35:50.849 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:35:50 ctl02 nova-conductor[5056]: 2017-09-28 12:35:50.857 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:35:50 ctl02 nova-conductor[5056]: 2017-09-28 12:35:50.862 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:35:51 ctl02 neutron-server[30536]: 2017-09-28 12:35:51.196 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:35:51] "OPTIONS / HTTP/1.0" 200 262 0.000489
Sep 28 12:35:51 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4770fc31)
Sep 28 12:35:51 ctl02 neutron-server[30536]: 2017-09-28 12:35:51.357 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 4 dead agents out of 6:
Sep 28 12:35:51 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:35:51 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:34:46 cmp002
Sep 28 12:35:51 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:34:38 cmp001
Sep 28 12:35:51 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:34:50 cmp002
Sep 28 12:35:51 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:35:06 cmp002
Sep 28 12:35:51 ctl02 glance-api[29183]: 2017-09-28 12:35:51.941 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:35:51] "OPTIONS / HTTP/1.0" 200 134 0.000563
Sep 28 12:35:52 ctl02 heat-api-cfn[13300]: 2017-09-28 12:35:52.275 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:35:52] "OPTIONS / HTTP/1.0" 200 134 0.000448
Sep 28 12:35:52 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4770fc31)
Sep 28 12:35:52 ctl02 nova-api[3641]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:35:52 ctl02 nova-api[3641]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:35:52 ctl02 glance-api[29183]: 2017-09-28 12:35:52.509 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:35:52] "OPTIONS / HTTP/1.0" 200 134 0.000547
Sep 28 12:35:52 ctl02 nova-api[3641]: 2017-09-28 12:35:52.525 3641 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:35:52 ctl02 nova-api[3641]: 2017-09-28 12:35:52.526 3641 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:35:52 ctl02 nova-api[3641]: 2017-09-28 12:35:52.526 3641 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:35:52 ctl02 nova-api[3641]: 2017-09-28 12:35:52.526 3641 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:35:52 ctl02 nova-api[3641]: 2017-09-28 12:35:52.526 3641 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:35:52 ctl02 nova-api[3641]: 2017-09-28 12:35:52.526 3641 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:35:52 ctl02 nova-api[3641]: 2017-09-28 12:35:52.526 3641 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:35:52 ctl02 nova-api[3641]: 2017-09-28 12:35:52.526 3641 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:35:52 ctl02 nova-api[3641]: 2017-09-28 12:35:52.526 3641 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:35:52 ctl02 nova-api[3641]: 2017-09-28 12:35:52.526 3641 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:35:52 ctl02 nova-api[3641]: 2017-09-28 12:35:52.526 3641 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:35:52 ctl02 nova-api[3641]: 2017-09-28 12:35:52.526 3641 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:35:52 ctl02 nova-api[3641]: 2017-09-28 12:35:52.526 3641 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:35:52 ctl02 nova-api[3641]: 2017-09-28 12:35:52.526 3641 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:35:52 ctl02 nova-api[3641]: 2017-09-28 12:35:52.526 3641 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:35:52 ctl02 nova-api[3641]: 2017-09-28 12:35:52.526 3641 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:35:52 ctl02 nova-api[3641]: 2017-09-28 12:35:52.526 3641 ERROR nova.wsgi     self.filename))
Sep 28 12:35:52 ctl02 nova-api[3641]: 2017-09-28 12:35:52.526 3641 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:35:52 ctl02 nova-api[3641]: 2017-09-28 12:35:52.526 3641 ERROR nova.wsgi
Sep 28 12:35:52 ctl02 nova-api[3641]: 2017-09-28 12:35:52.529 3641 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:35:52 ctl02 glance-api[29183]: 2017-09-28 12:35:52.614 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:35:52] "OPTIONS / HTTP/1.0" 200 134 0.000565
Sep 28 12:35:52 ctl02 nova-api[3641]: 2017-09-28 12:35:52.658 3641 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:35:52 ctl02 nova-api[3641]: 2017-09-28 12:35:52.878 3641 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:35:52 ctl02 nova-api[3641]: 2017-09-28 12:35:52.881 3641 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:35:52 ctl02 nova-api[3641]: 2017-09-28 12:35:52.881 3641 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:35:52 ctl02 nova-api[3641]: 2017-09-28 12:35:52.882 3641 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:35:53 ctl02 nova-api[3641]: 2017-09-28 12:35:53.010 3641 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:35:53 ctl02 nova-api[3641]: 2017-09-28 12:35:53.013 3641 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:35:53 ctl02 nova-api[3641]: 2017-09-28 12:35:53.013 3641 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:35:53 ctl02 nova-api[3641]: 2017-09-28 12:35:53.013 3641 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:35:53 ctl02 nova-api[3641]: 2017-09-28 12:35:53.017 3641 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:35:53 ctl02 nova-api[3641]: 2017-09-28 12:35:53.017 3641 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:35:53 ctl02 nova-api[3641]: 2017-09-28 12:35:53.017 3641 ERROR nova Traceback (most recent call last):
Sep 28 12:35:53 ctl02 nova-api[3641]: 2017-09-28 12:35:53.017 3641 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:35:53 ctl02 nova-api[3641]: 2017-09-28 12:35:53.017 3641 ERROR nova     sys.exit(main())
Sep 28 12:35:53 ctl02 nova-api[3641]: 2017-09-28 12:35:53.017 3641 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:35:53 ctl02 nova-api[3641]: 2017-09-28 12:35:53.017 3641 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:35:53 ctl02 nova-api[3641]: 2017-09-28 12:35:53.017 3641 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:35:53 ctl02 nova-api[3641]: 2017-09-28 12:35:53.017 3641 ERROR nova     max_url_len=max_url_len)
Sep 28 12:35:53 ctl02 nova-api[3641]: 2017-09-28 12:35:53.017 3641 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:35:53 ctl02 nova-api[3641]: 2017-09-28 12:35:53.017 3641 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:35:53 ctl02 nova-api[3641]: 2017-09-28 12:35:53.017 3641 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:35:53 ctl02 nova-api[3641]: 2017-09-28 12:35:53.017 3641 ERROR nova     sock.listen(backlog)
Sep 28 12:35:53 ctl02 nova-api[3641]: 2017-09-28 12:35:53.017 3641 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:35:53 ctl02 nova-api[3641]: 2017-09-28 12:35:53.017 3641 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:35:53 ctl02 nova-api[3641]: 2017-09-28 12:35:53.017 3641 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:35:53 ctl02 nova-api[3641]: 2017-09-28 12:35:53.017 3641 ERROR nova
Sep 28 12:35:53 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:35:53 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:35:53 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:35:53 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4770fc31)
Sep 28 12:35:53 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:35:53 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:35:53 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:35:53 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:35:54 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:35:54 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:35:54 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:35:54.443 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:35:54] "OPTIONS / HTTP/1.0" 200 134 0.000570
Sep 28 12:35:55 ctl02 nova-api[3659]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:35:55 ctl02 nova-api[3659]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:35:55 ctl02 nova-api[3659]: 2017-09-28 12:35:55.254 3659 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:35:55 ctl02 nova-api[3659]: 2017-09-28 12:35:55.255 3659 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:35:55 ctl02 nova-api[3659]: 2017-09-28 12:35:55.255 3659 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:35:55 ctl02 nova-api[3659]: 2017-09-28 12:35:55.255 3659 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:35:55 ctl02 nova-api[3659]: 2017-09-28 12:35:55.255 3659 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:35:55 ctl02 nova-api[3659]: 2017-09-28 12:35:55.255 3659 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:35:55 ctl02 nova-api[3659]: 2017-09-28 12:35:55.255 3659 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:35:55 ctl02 nova-api[3659]: 2017-09-28 12:35:55.255 3659 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:35:55 ctl02 nova-api[3659]: 2017-09-28 12:35:55.255 3659 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:35:55 ctl02 nova-api[3659]: 2017-09-28 12:35:55.255 3659 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:35:55 ctl02 nova-api[3659]: 2017-09-28 12:35:55.255 3659 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:35:55 ctl02 nova-api[3659]: 2017-09-28 12:35:55.255 3659 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:35:55 ctl02 nova-api[3659]: 2017-09-28 12:35:55.255 3659 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:35:55 ctl02 nova-api[3659]: 2017-09-28 12:35:55.255 3659 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:35:55 ctl02 nova-api[3659]: 2017-09-28 12:35:55.255 3659 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:35:55 ctl02 nova-api[3659]: 2017-09-28 12:35:55.255 3659 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:35:55 ctl02 nova-api[3659]: 2017-09-28 12:35:55.255 3659 ERROR nova.wsgi     self.filename))
Sep 28 12:35:55 ctl02 nova-api[3659]: 2017-09-28 12:35:55.255 3659 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:35:55 ctl02 nova-api[3659]: 2017-09-28 12:35:55.255 3659 ERROR nova.wsgi
Sep 28 12:35:55 ctl02 nova-api[3659]: 2017-09-28 12:35:55.256 3659 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:35:55 ctl02 nova-api[3659]: 2017-09-28 12:35:55.385 3659 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:35:55 ctl02 heat-api[13008]: 2017-09-28 12:35:55.576 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:35:55] "OPTIONS / HTTP/1.0" 200 134 0.000768
Sep 28 12:35:55 ctl02 nova-api[3659]: 2017-09-28 12:35:55.611 3659 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:35:55 ctl02 nova-api[3659]: 2017-09-28 12:35:55.613 3659 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:35:55 ctl02 nova-api[3659]: 2017-09-28 12:35:55.614 3659 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:35:55 ctl02 nova-api[3659]: 2017-09-28 12:35:55.614 3659 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:35:55 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:35:55.619 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:35:55] "OPTIONS / HTTP/1.0" 200 134 0.000587
Sep 28 12:35:55 ctl02 nova-api[3659]: 2017-09-28 12:35:55.748 3659 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:35:55 ctl02 nova-api[3659]: 2017-09-28 12:35:55.750 3659 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:35:55 ctl02 nova-api[3659]: 2017-09-28 12:35:55.750 3659 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:35:55 ctl02 nova-api[3659]: 2017-09-28 12:35:55.750 3659 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:35:55 ctl02 nova-api[3659]: 2017-09-28 12:35:55.753 3659 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:35:55 ctl02 nova-api[3659]: 2017-09-28 12:35:55.754 3659 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:35:55 ctl02 nova-api[3659]: 2017-09-28 12:35:55.754 3659 ERROR nova Traceback (most recent call last):
Sep 28 12:35:55 ctl02 nova-api[3659]: 2017-09-28 12:35:55.754 3659 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:35:55 ctl02 nova-api[3659]: 2017-09-28 12:35:55.754 3659 ERROR nova     sys.exit(main())
Sep 28 12:35:55 ctl02 nova-api[3659]: 2017-09-28 12:35:55.754 3659 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:35:55 ctl02 nova-api[3659]: 2017-09-28 12:35:55.754 3659 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:35:55 ctl02 nova-api[3659]: 2017-09-28 12:35:55.754 3659 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:35:55 ctl02 nova-api[3659]: 2017-09-28 12:35:55.754 3659 ERROR nova     max_url_len=max_url_len)
Sep 28 12:35:55 ctl02 nova-api[3659]: 2017-09-28 12:35:55.754 3659 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:35:55 ctl02 nova-api[3659]: 2017-09-28 12:35:55.754 3659 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:35:55 ctl02 nova-api[3659]: 2017-09-28 12:35:55.754 3659 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:35:55 ctl02 nova-api[3659]: 2017-09-28 12:35:55.754 3659 ERROR nova     sock.listen(backlog)
Sep 28 12:35:55 ctl02 nova-api[3659]: 2017-09-28 12:35:55.754 3659 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:35:55 ctl02 nova-api[3659]: 2017-09-28 12:35:55.754 3659 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:35:55 ctl02 nova-api[3659]: 2017-09-28 12:35:55.754 3659 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:35:55 ctl02 nova-api[3659]: 2017-09-28 12:35:55.754 3659 ERROR nova
Sep 28 12:35:55 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:35:55 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:35:55 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:35:56 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:35:56 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:35:56 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:35:56 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:35:56 ctl02 heat-api[13008]: 2017-09-28 12:35:56.881 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:35:56] "OPTIONS / HTTP/1.0" 200 134 0.000589
Sep 28 12:35:57 ctl02 heat-api-cfn[13300]: 2017-09-28 12:35:57.671 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:35:57] "OPTIONS / HTTP/1.0" 200 134 0.000446
Sep 28 12:35:57 ctl02 nova-api[3682]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:35:57 ctl02 nova-api[3682]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:35:58 ctl02 nova-api[3682]: 2017-09-28 12:35:58.003 3682 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:35:58 ctl02 nova-api[3682]: 2017-09-28 12:35:58.004 3682 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:35:58 ctl02 nova-api[3682]: 2017-09-28 12:35:58.004 3682 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:35:58 ctl02 nova-api[3682]: 2017-09-28 12:35:58.004 3682 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:35:58 ctl02 nova-api[3682]: 2017-09-28 12:35:58.004 3682 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:35:58 ctl02 nova-api[3682]: 2017-09-28 12:35:58.004 3682 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:35:58 ctl02 nova-api[3682]: 2017-09-28 12:35:58.004 3682 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:35:58 ctl02 nova-api[3682]: 2017-09-28 12:35:58.004 3682 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:35:58 ctl02 nova-api[3682]: 2017-09-28 12:35:58.004 3682 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:35:58 ctl02 nova-api[3682]: 2017-09-28 12:35:58.004 3682 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:35:58 ctl02 nova-api[3682]: 2017-09-28 12:35:58.004 3682 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:35:58 ctl02 nova-api[3682]: 2017-09-28 12:35:58.004 3682 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:35:58 ctl02 nova-api[3682]: 2017-09-28 12:35:58.004 3682 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:35:58 ctl02 nova-api[3682]: 2017-09-28 12:35:58.004 3682 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:35:58 ctl02 nova-api[3682]: 2017-09-28 12:35:58.004 3682 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:35:58 ctl02 nova-api[3682]: 2017-09-28 12:35:58.004 3682 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:35:58 ctl02 nova-api[3682]: 2017-09-28 12:35:58.004 3682 ERROR nova.wsgi     self.filename))
Sep 28 12:35:58 ctl02 nova-api[3682]: 2017-09-28 12:35:58.004 3682 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:35:58 ctl02 nova-api[3682]: 2017-09-28 12:35:58.004 3682 ERROR nova.wsgi
Sep 28 12:35:58 ctl02 nova-api[3682]: 2017-09-28 12:35:58.006 3682 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:35:58 ctl02 nova-api[3682]: 2017-09-28 12:35:58.133 3682 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:35:58 ctl02 nova-api[3682]: 2017-09-28 12:35:58.355 3682 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:35:58 ctl02 nova-api[3682]: 2017-09-28 12:35:58.358 3682 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:35:58 ctl02 nova-api[3682]: 2017-09-28 12:35:58.358 3682 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:35:58 ctl02 nova-api[3682]: 2017-09-28 12:35:58.359 3682 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:35:58 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:35:58.442 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:35:58] "OPTIONS / HTTP/1.0" 200 134 0.000423
Sep 28 12:35:58 ctl02 nova-api[3682]: 2017-09-28 12:35:58.488 3682 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:35:58 ctl02 nova-api[3682]: 2017-09-28 12:35:58.490 3682 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:35:58 ctl02 nova-api[3682]: 2017-09-28 12:35:58.491 3682 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:35:58 ctl02 nova-api[3682]: 2017-09-28 12:35:58.491 3682 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:35:58 ctl02 nova-api[3682]: 2017-09-28 12:35:58.494 3682 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:35:58 ctl02 nova-api[3682]: 2017-09-28 12:35:58.495 3682 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:35:58 ctl02 nova-api[3682]: 2017-09-28 12:35:58.495 3682 ERROR nova Traceback (most recent call last):
Sep 28 12:35:58 ctl02 nova-api[3682]: 2017-09-28 12:35:58.495 3682 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:35:58 ctl02 nova-api[3682]: 2017-09-28 12:35:58.495 3682 ERROR nova     sys.exit(main())
Sep 28 12:35:58 ctl02 nova-api[3682]: 2017-09-28 12:35:58.495 3682 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:35:58 ctl02 nova-api[3682]: 2017-09-28 12:35:58.495 3682 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:35:58 ctl02 nova-api[3682]: 2017-09-28 12:35:58.495 3682 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:35:58 ctl02 nova-api[3682]: 2017-09-28 12:35:58.495 3682 ERROR nova     max_url_len=max_url_len)
Sep 28 12:35:58 ctl02 nova-api[3682]: 2017-09-28 12:35:58.495 3682 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:35:58 ctl02 nova-api[3682]: 2017-09-28 12:35:58.495 3682 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:35:58 ctl02 nova-api[3682]: 2017-09-28 12:35:58.495 3682 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:35:58 ctl02 nova-api[3682]: 2017-09-28 12:35:58.495 3682 ERROR nova     sock.listen(backlog)
Sep 28 12:35:58 ctl02 nova-api[3682]: 2017-09-28 12:35:58.495 3682 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:35:58 ctl02 nova-api[3682]: 2017-09-28 12:35:58.495 3682 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:35:58 ctl02 nova-api[3682]: 2017-09-28 12:35:58.495 3682 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:35:58 ctl02 nova-api[3682]: 2017-09-28 12:35:58.495 3682 ERROR nova
Sep 28 12:35:58 ctl02 neutron-server[30536]: 2017-09-28 12:35:58.500 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:35:58 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:35:58 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:35:58 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:35:58 ctl02 heat-api-cfn[13300]: 2017-09-28 12:35:58.652 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:35:58] "OPTIONS / HTTP/1.0" 200 134 0.000446
Sep 28 12:35:58 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:35:58 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:35:58 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:35:58 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:35:59 ctl02 heat-api[13008]: 2017-09-28 12:35:59.380 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:35:59] "OPTIONS / HTTP/1.0" 200 134 0.000605
Sep 28 12:35:59 ctl02 neutron-server[30536]: 2017-09-28 12:35:59.854 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:35:59] "OPTIONS / HTTP/1.0" 200 262 0.000468
Sep 28 12:36:00 ctl02 nova-consoleauth[5433]: 2017-09-28 12:36:00.005 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:36:00 ctl02 neutron-server[30536]: 2017-09-28 12:36:00.267 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:36:00] "OPTIONS / HTTP/1.0" 200 262 0.000464
Sep 28 12:36:00 ctl02 nova-api[3700]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:36:00 ctl02 nova-api[3700]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:36:00 ctl02 nova-api[3700]: 2017-09-28 12:36:00.716 3700 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:36:00 ctl02 nova-api[3700]: 2017-09-28 12:36:00.718 3700 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:36:00 ctl02 nova-api[3700]: 2017-09-28 12:36:00.718 3700 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:36:00 ctl02 nova-api[3700]: 2017-09-28 12:36:00.718 3700 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:36:00 ctl02 nova-api[3700]: 2017-09-28 12:36:00.718 3700 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:36:00 ctl02 nova-api[3700]: 2017-09-28 12:36:00.718 3700 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:36:00 ctl02 nova-api[3700]: 2017-09-28 12:36:00.718 3700 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:36:00 ctl02 nova-api[3700]: 2017-09-28 12:36:00.718 3700 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:36:00 ctl02 nova-api[3700]: 2017-09-28 12:36:00.718 3700 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:36:00 ctl02 nova-api[3700]: 2017-09-28 12:36:00.718 3700 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:36:00 ctl02 nova-api[3700]: 2017-09-28 12:36:00.718 3700 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:36:00 ctl02 nova-api[3700]: 2017-09-28 12:36:00.718 3700 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:36:00 ctl02 nova-api[3700]: 2017-09-28 12:36:00.718 3700 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:36:00 ctl02 nova-api[3700]: 2017-09-28 12:36:00.718 3700 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:36:00 ctl02 nova-api[3700]: 2017-09-28 12:36:00.718 3700 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:36:00 ctl02 nova-api[3700]: 2017-09-28 12:36:00.718 3700 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:36:00 ctl02 nova-api[3700]: 2017-09-28 12:36:00.718 3700 ERROR nova.wsgi     self.filename))
Sep 28 12:36:00 ctl02 nova-api[3700]: 2017-09-28 12:36:00.718 3700 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:36:00 ctl02 nova-api[3700]: 2017-09-28 12:36:00.718 3700 ERROR nova.wsgi
Sep 28 12:36:00 ctl02 nova-api[3700]: 2017-09-28 12:36:00.720 3700 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:36:00 ctl02 nova-api[3700]: 2017-09-28 12:36:00.846 3700 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:36:01 ctl02 nova-api[3700]: 2017-09-28 12:36:01.073 3700 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:36:01 ctl02 nova-api[3700]: 2017-09-28 12:36:01.075 3700 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:36:01 ctl02 nova-api[3700]: 2017-09-28 12:36:01.075 3700 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:36:01 ctl02 nova-api[3700]: 2017-09-28 12:36:01.075 3700 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:36:01 ctl02 neutron-server[30536]: 2017-09-28 12:36:01.144 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:36:01] "OPTIONS / HTTP/1.0" 200 262 0.000490
Sep 28 12:36:01 ctl02 nova-api[3700]: 2017-09-28 12:36:01.206 3700 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:36:01 ctl02 nova-api[3700]: 2017-09-28 12:36:01.208 3700 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:36:01 ctl02 nova-api[3700]: 2017-09-28 12:36:01.208 3700 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:36:01 ctl02 nova-api[3700]: 2017-09-28 12:36:01.209 3700 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:36:01 ctl02 nova-api[3700]: 2017-09-28 12:36:01.212 3700 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:36:01 ctl02 nova-api[3700]: 2017-09-28 12:36:01.212 3700 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:36:01 ctl02 nova-api[3700]: 2017-09-28 12:36:01.212 3700 ERROR nova Traceback (most recent call last):
Sep 28 12:36:01 ctl02 nova-api[3700]: 2017-09-28 12:36:01.212 3700 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:36:01 ctl02 nova-api[3700]: 2017-09-28 12:36:01.212 3700 ERROR nova     sys.exit(main())
Sep 28 12:36:01 ctl02 nova-api[3700]: 2017-09-28 12:36:01.212 3700 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:36:01 ctl02 nova-api[3700]: 2017-09-28 12:36:01.212 3700 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:36:01 ctl02 nova-api[3700]: 2017-09-28 12:36:01.212 3700 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:36:01 ctl02 nova-api[3700]: 2017-09-28 12:36:01.212 3700 ERROR nova     max_url_len=max_url_len)
Sep 28 12:36:01 ctl02 nova-api[3700]: 2017-09-28 12:36:01.212 3700 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:36:01 ctl02 nova-api[3700]: 2017-09-28 12:36:01.212 3700 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:36:01 ctl02 nova-api[3700]: 2017-09-28 12:36:01.212 3700 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:36:01 ctl02 nova-api[3700]: 2017-09-28 12:36:01.212 3700 ERROR nova     sock.listen(backlog)
Sep 28 12:36:01 ctl02 nova-api[3700]: 2017-09-28 12:36:01.212 3700 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:36:01 ctl02 nova-api[3700]: 2017-09-28 12:36:01.212 3700 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:36:01 ctl02 nova-api[3700]: 2017-09-28 12:36:01.212 3700 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:36:01 ctl02 nova-api[3700]: 2017-09-28 12:36:01.212 3700 ERROR nova
Sep 28 12:36:01 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:36:01 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:36:01 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:36:01 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:36:01 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:36:01 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:36:01 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:36:01 ctl02 heat-api-cfn[13300]: 2017-09-28 12:36:01.949 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:36:01] "OPTIONS / HTTP/1.0" 200 134 0.000438
Sep 28 12:36:01 ctl02 heat-engine[12803]: 2017-09-28 12:36:01.962 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:36:01 ctl02 heat-engine[12803]: 2017-09-28 12:36:01.966 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:36:01 ctl02 heat-engine[12803]: 2017-09-28 12:36:01.971 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:36:01 ctl02 heat-engine[12803]: 2017-09-28 12:36:01.973 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:36:02 ctl02 glance-api[29183]: 2017-09-28 12:36:02.078 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:36:02] "OPTIONS / HTTP/1.0" 200 134 0.000572
Sep 28 12:36:02 ctl02 glance-api[29183]: 2017-09-28 12:36:02.277 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:36:02] "OPTIONS / HTTP/1.0" 200 134 0.000597
Sep 28 12:36:02 ctl02 glance-api[29183]: 2017-09-28 12:36:02.634 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:36:02] "OPTIONS / HTTP/1.0" 200 134 0.000659
Sep 28 12:36:03 ctl02 nova-scheduler[5620]: 2017-09-28 12:36:03.056 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:36:03 ctl02 nova-api[3718]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:36:03 ctl02 nova-api[3718]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:36:03 ctl02 nova-api[3718]: 2017-09-28 12:36:03.521 3718 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:36:03 ctl02 nova-api[3718]: 2017-09-28 12:36:03.522 3718 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:36:03 ctl02 nova-api[3718]: 2017-09-28 12:36:03.522 3718 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:36:03 ctl02 nova-api[3718]: 2017-09-28 12:36:03.522 3718 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:36:03 ctl02 nova-api[3718]: 2017-09-28 12:36:03.522 3718 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:36:03 ctl02 nova-api[3718]: 2017-09-28 12:36:03.522 3718 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:36:03 ctl02 nova-api[3718]: 2017-09-28 12:36:03.522 3718 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:36:03 ctl02 nova-api[3718]: 2017-09-28 12:36:03.522 3718 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:36:03 ctl02 nova-api[3718]: 2017-09-28 12:36:03.522 3718 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:36:03 ctl02 nova-api[3718]: 2017-09-28 12:36:03.522 3718 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:36:03 ctl02 nova-api[3718]: 2017-09-28 12:36:03.522 3718 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:36:03 ctl02 nova-api[3718]: 2017-09-28 12:36:03.522 3718 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:36:03 ctl02 nova-api[3718]: 2017-09-28 12:36:03.522 3718 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:36:03 ctl02 nova-api[3718]: 2017-09-28 12:36:03.522 3718 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:36:03 ctl02 nova-api[3718]: 2017-09-28 12:36:03.522 3718 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:36:03 ctl02 nova-api[3718]: 2017-09-28 12:36:03.522 3718 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:36:03 ctl02 nova-api[3718]: 2017-09-28 12:36:03.522 3718 ERROR nova.wsgi     self.filename))
Sep 28 12:36:03 ctl02 nova-api[3718]: 2017-09-28 12:36:03.522 3718 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:36:03 ctl02 nova-api[3718]: 2017-09-28 12:36:03.522 3718 ERROR nova.wsgi
Sep 28 12:36:03 ctl02 nova-api[3718]: 2017-09-28 12:36:03.523 3718 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:36:03 ctl02 nova-api[3718]: 2017-09-28 12:36:03.648 3718 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:36:03 ctl02 nova-api[3718]: 2017-09-28 12:36:03.867 3718 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:36:03 ctl02 nova-api[3718]: 2017-09-28 12:36:03.869 3718 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:36:03 ctl02 nova-api[3718]: 2017-09-28 12:36:03.869 3718 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:36:03 ctl02 nova-api[3718]: 2017-09-28 12:36:03.870 3718 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:36:03 ctl02 nova-api[3718]: 2017-09-28 12:36:03.998 3718 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:36:04 ctl02 nova-api[3718]: 2017-09-28 12:36:04.000 3718 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:36:04 ctl02 nova-api[3718]: 2017-09-28 12:36:04.000 3718 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:36:04 ctl02 nova-api[3718]: 2017-09-28 12:36:04.000 3718 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:36:04 ctl02 nova-api[3718]: 2017-09-28 12:36:04.003 3718 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:36:04 ctl02 nova-api[3718]: 2017-09-28 12:36:04.004 3718 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:36:04 ctl02 nova-api[3718]: 2017-09-28 12:36:04.004 3718 ERROR nova Traceback (most recent call last):
Sep 28 12:36:04 ctl02 nova-api[3718]: 2017-09-28 12:36:04.004 3718 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:36:04 ctl02 nova-api[3718]: 2017-09-28 12:36:04.004 3718 ERROR nova     sys.exit(main())
Sep 28 12:36:04 ctl02 nova-api[3718]: 2017-09-28 12:36:04.004 3718 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:36:04 ctl02 nova-api[3718]: 2017-09-28 12:36:04.004 3718 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:36:04 ctl02 nova-api[3718]: 2017-09-28 12:36:04.004 3718 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:36:04 ctl02 nova-api[3718]: 2017-09-28 12:36:04.004 3718 ERROR nova     max_url_len=max_url_len)
Sep 28 12:36:04 ctl02 nova-api[3718]: 2017-09-28 12:36:04.004 3718 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:36:04 ctl02 nova-api[3718]: 2017-09-28 12:36:04.004 3718 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:36:04 ctl02 nova-api[3718]: 2017-09-28 12:36:04.004 3718 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:36:04 ctl02 nova-api[3718]: 2017-09-28 12:36:04.004 3718 ERROR nova     sock.listen(backlog)
Sep 28 12:36:04 ctl02 nova-api[3718]: 2017-09-28 12:36:04.004 3718 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:36:04 ctl02 nova-api[3718]: 2017-09-28 12:36:04.004 3718 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:36:04 ctl02 nova-api[3718]: 2017-09-28 12:36:04.004 3718 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:36:04 ctl02 nova-api[3718]: 2017-09-28 12:36:04.004 3718 ERROR nova
Sep 28 12:36:04 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:36:04 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:36:04 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:36:04 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:36:04 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:36:04 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:36:04 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:36:04 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:36:04.583 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:36:04] "OPTIONS / HTTP/1.0" 200 134 0.000416
Sep 28 12:36:05 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:36:05.807 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:36:05] "OPTIONS / HTTP/1.0" 200 134 0.000523
Sep 28 12:36:05 ctl02 heat-api[13008]: 2017-09-28 12:36:05.881 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:36:05] "OPTIONS / HTTP/1.0" 200 134 0.000667
Sep 28 12:36:06 ctl02 nova-api[3735]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:36:06 ctl02 nova-api[3735]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:36:06 ctl02 neutron-server[30536]: 2017-09-28 12:36:06.118 30603 WARNING oslo_messaging._drivers.amqpdriver [req-d8cfb1e1-dad0-49ff-a4e4-1952c7b56969 - - - - -] reply_a13a20a54b91453780e36bdf20a855d2 doesn't exists, drop reply to 644f00840c1d43ffbdb48becf508dc71
Sep 28 12:36:06 ctl02 neutron-server[30536]: 2017-09-28 12:36:06.119 30603 INFO oslo_messaging._drivers.amqpdriver [req-d8cfb1e1-dad0-49ff-a4e4-1952c7b56969 - - - - -] The reply 644f00840c1d43ffbdb48becf508dc71 cannot be sent  reply_a13a20a54b91453780e36bdf20a855d2 reply queue don't exist after 60 sec abandoning...
Sep 28 12:36:06 ctl02 nova-api[3735]: 2017-09-28 12:36:06.241 3735 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:36:06 ctl02 nova-api[3735]: 2017-09-28 12:36:06.242 3735 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:36:06 ctl02 nova-api[3735]: 2017-09-28 12:36:06.242 3735 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:36:06 ctl02 nova-api[3735]: 2017-09-28 12:36:06.242 3735 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:36:06 ctl02 nova-api[3735]: 2017-09-28 12:36:06.242 3735 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:36:06 ctl02 nova-api[3735]: 2017-09-28 12:36:06.242 3735 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:36:06 ctl02 nova-api[3735]: 2017-09-28 12:36:06.242 3735 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:36:06 ctl02 nova-api[3735]: 2017-09-28 12:36:06.242 3735 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:36:06 ctl02 nova-api[3735]: 2017-09-28 12:36:06.242 3735 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:36:06 ctl02 nova-api[3735]: 2017-09-28 12:36:06.242 3735 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:36:06 ctl02 nova-api[3735]: 2017-09-28 12:36:06.242 3735 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:36:06 ctl02 nova-api[3735]: 2017-09-28 12:36:06.242 3735 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:36:06 ctl02 nova-api[3735]: 2017-09-28 12:36:06.242 3735 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:36:06 ctl02 nova-api[3735]: 2017-09-28 12:36:06.242 3735 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:36:06 ctl02 nova-api[3735]: 2017-09-28 12:36:06.242 3735 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:36:06 ctl02 nova-api[3735]: 2017-09-28 12:36:06.242 3735 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:36:06 ctl02 nova-api[3735]: 2017-09-28 12:36:06.242 3735 ERROR nova.wsgi     self.filename))
Sep 28 12:36:06 ctl02 nova-api[3735]: 2017-09-28 12:36:06.242 3735 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:36:06 ctl02 nova-api[3735]: 2017-09-28 12:36:06.242 3735 ERROR nova.wsgi
Sep 28 12:36:06 ctl02 nova-api[3735]: 2017-09-28 12:36:06.243 3735 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:36:06 ctl02 neutron-server[30536]: 2017-09-28 12:36:06.363 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 4 dead agents out of 6:
Sep 28 12:36:06 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:36:06 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:34:46 cmp002
Sep 28 12:36:06 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:34:38 cmp001
Sep 28 12:36:06 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:34:50 cmp002
Sep 28 12:36:06 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:35:06 cmp002
Sep 28 12:36:06 ctl02 nova-api[3735]: 2017-09-28 12:36:06.382 3735 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:36:06 ctl02 nova-api[3735]: 2017-09-28 12:36:06.629 3735 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:36:06 ctl02 nova-api[3735]: 2017-09-28 12:36:06.631 3735 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:36:06 ctl02 nova-api[3735]: 2017-09-28 12:36:06.631 3735 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:36:06 ctl02 nova-api[3735]: 2017-09-28 12:36:06.632 3735 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:36:06 ctl02 nova-api[3735]: 2017-09-28 12:36:06.767 3735 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:36:06 ctl02 nova-api[3735]: 2017-09-28 12:36:06.769 3735 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:36:06 ctl02 nova-api[3735]: 2017-09-28 12:36:06.769 3735 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:36:06 ctl02 nova-api[3735]: 2017-09-28 12:36:06.769 3735 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:36:06 ctl02 nova-api[3735]: 2017-09-28 12:36:06.773 3735 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:36:06 ctl02 nova-api[3735]: 2017-09-28 12:36:06.773 3735 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:36:06 ctl02 nova-api[3735]: 2017-09-28 12:36:06.773 3735 ERROR nova Traceback (most recent call last):
Sep 28 12:36:06 ctl02 nova-api[3735]: 2017-09-28 12:36:06.773 3735 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:36:06 ctl02 nova-api[3735]: 2017-09-28 12:36:06.773 3735 ERROR nova     sys.exit(main())
Sep 28 12:36:06 ctl02 nova-api[3735]: 2017-09-28 12:36:06.773 3735 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:36:06 ctl02 nova-api[3735]: 2017-09-28 12:36:06.773 3735 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:36:06 ctl02 nova-api[3735]: 2017-09-28 12:36:06.773 3735 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:36:06 ctl02 nova-api[3735]: 2017-09-28 12:36:06.773 3735 ERROR nova     max_url_len=max_url_len)
Sep 28 12:36:06 ctl02 nova-api[3735]: 2017-09-28 12:36:06.773 3735 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:36:06 ctl02 nova-api[3735]: 2017-09-28 12:36:06.773 3735 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:36:06 ctl02 nova-api[3735]: 2017-09-28 12:36:06.773 3735 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:36:06 ctl02 nova-api[3735]: 2017-09-28 12:36:06.773 3735 ERROR nova     sock.listen(backlog)
Sep 28 12:36:06 ctl02 nova-api[3735]: 2017-09-28 12:36:06.773 3735 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:36:06 ctl02 nova-api[3735]: 2017-09-28 12:36:06.773 3735 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:36:06 ctl02 nova-api[3735]: 2017-09-28 12:36:06.773 3735 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:36:06 ctl02 nova-api[3735]: 2017-09-28 12:36:06.773 3735 ERROR nova
Sep 28 12:36:06 ctl02 heat-api[13008]: 2017-09-28 12:36:06.832 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:36:06] "OPTIONS / HTTP/1.0" 200 134 0.000661
Sep 28 12:36:06 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:36:06 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:36:06 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:36:07 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:36:07 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:36:07 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:36:07 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:36:07 ctl02 heat-api-cfn[13300]: 2017-09-28 12:36:07.849 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:36:07] "OPTIONS / HTTP/1.0" 200 134 0.000513
Sep 28 12:36:08 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:36:08.522 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:36:08] "OPTIONS / HTTP/1.0" 200 134 0.000454
Sep 28 12:36:08 ctl02 heat-api-cfn[13300]: 2017-09-28 12:36:08.718 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:36:08] "OPTIONS / HTTP/1.0" 200 134 0.000458
Sep 28 12:36:08 ctl02 nova-api[3753]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:36:08 ctl02 nova-api[3753]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:36:09 ctl02 nova-api[3753]: 2017-09-28 12:36:09.018 3753 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:36:09 ctl02 nova-api[3753]: 2017-09-28 12:36:09.019 3753 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:36:09 ctl02 nova-api[3753]: 2017-09-28 12:36:09.019 3753 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:36:09 ctl02 nova-api[3753]: 2017-09-28 12:36:09.019 3753 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:36:09 ctl02 nova-api[3753]: 2017-09-28 12:36:09.019 3753 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:36:09 ctl02 nova-api[3753]: 2017-09-28 12:36:09.019 3753 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:36:09 ctl02 nova-api[3753]: 2017-09-28 12:36:09.019 3753 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:36:09 ctl02 nova-api[3753]: 2017-09-28 12:36:09.019 3753 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:36:09 ctl02 nova-api[3753]: 2017-09-28 12:36:09.019 3753 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:36:09 ctl02 nova-api[3753]: 2017-09-28 12:36:09.019 3753 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:36:09 ctl02 nova-api[3753]: 2017-09-28 12:36:09.019 3753 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:36:09 ctl02 nova-api[3753]: 2017-09-28 12:36:09.019 3753 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:36:09 ctl02 nova-api[3753]: 2017-09-28 12:36:09.019 3753 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:36:09 ctl02 nova-api[3753]: 2017-09-28 12:36:09.019 3753 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:36:09 ctl02 nova-api[3753]: 2017-09-28 12:36:09.019 3753 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:36:09 ctl02 nova-api[3753]: 2017-09-28 12:36:09.019 3753 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:36:09 ctl02 nova-api[3753]: 2017-09-28 12:36:09.019 3753 ERROR nova.wsgi     self.filename))
Sep 28 12:36:09 ctl02 nova-api[3753]: 2017-09-28 12:36:09.019 3753 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:36:09 ctl02 nova-api[3753]: 2017-09-28 12:36:09.019 3753 ERROR nova.wsgi
Sep 28 12:36:09 ctl02 nova-api[3753]: 2017-09-28 12:36:09.022 3753 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:36:09 ctl02 heat-api[13008]: 2017-09-28 12:36:09.043 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:36:09] "OPTIONS / HTTP/1.0" 200 134 0.000634
Sep 28 12:36:09 ctl02 nova-api[3753]: 2017-09-28 12:36:09.153 3753 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:36:09 ctl02 nova-api[3753]: 2017-09-28 12:36:09.400 3753 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:36:09 ctl02 nova-api[3753]: 2017-09-28 12:36:09.402 3753 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:36:09 ctl02 nova-api[3753]: 2017-09-28 12:36:09.402 3753 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:36:09 ctl02 nova-api[3753]: 2017-09-28 12:36:09.402 3753 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:36:09 ctl02 nova-api[3753]: 2017-09-28 12:36:09.535 3753 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:36:09 ctl02 nova-api[3753]: 2017-09-28 12:36:09.537 3753 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:36:09 ctl02 nova-api[3753]: 2017-09-28 12:36:09.537 3753 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:36:09 ctl02 nova-api[3753]: 2017-09-28 12:36:09.537 3753 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:36:09 ctl02 nova-api[3753]: 2017-09-28 12:36:09.541 3753 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:36:09 ctl02 nova-api[3753]: 2017-09-28 12:36:09.541 3753 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:36:09 ctl02 nova-api[3753]: 2017-09-28 12:36:09.541 3753 ERROR nova Traceback (most recent call last):
Sep 28 12:36:09 ctl02 nova-api[3753]: 2017-09-28 12:36:09.541 3753 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:36:09 ctl02 nova-api[3753]: 2017-09-28 12:36:09.541 3753 ERROR nova     sys.exit(main())
Sep 28 12:36:09 ctl02 nova-api[3753]: 2017-09-28 12:36:09.541 3753 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:36:09 ctl02 nova-api[3753]: 2017-09-28 12:36:09.541 3753 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:36:09 ctl02 nova-api[3753]: 2017-09-28 12:36:09.541 3753 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:36:09 ctl02 nova-api[3753]: 2017-09-28 12:36:09.541 3753 ERROR nova     max_url_len=max_url_len)
Sep 28 12:36:09 ctl02 nova-api[3753]: 2017-09-28 12:36:09.541 3753 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:36:09 ctl02 nova-api[3753]: 2017-09-28 12:36:09.541 3753 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:36:09 ctl02 nova-api[3753]: 2017-09-28 12:36:09.541 3753 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:36:09 ctl02 nova-api[3753]: 2017-09-28 12:36:09.541 3753 ERROR nova     sock.listen(backlog)
Sep 28 12:36:09 ctl02 nova-api[3753]: 2017-09-28 12:36:09.541 3753 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:36:09 ctl02 nova-api[3753]: 2017-09-28 12:36:09.541 3753 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:36:09 ctl02 nova-api[3753]: 2017-09-28 12:36:09.541 3753 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:36:09 ctl02 nova-api[3753]: 2017-09-28 12:36:09.541 3753 ERROR nova
Sep 28 12:36:09 ctl02 neutron-server[30536]: 2017-09-28 12:36:09.591 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:36:09] "OPTIONS / HTTP/1.0" 200 262 0.000535
Sep 28 12:36:09 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:36:09 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:36:09 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:36:09 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:36:09 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:36:09 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:36:09 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:36:10 ctl02 neutron-server[30536]: 2017-09-28 12:36:10.464 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:36:10] "OPTIONS / HTTP/1.0" 200 262 0.000585
Sep 28 12:36:11 ctl02 neutron-server[30536]: 2017-09-28 12:36:11.328 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:36:11] "OPTIONS / HTTP/1.0" 200 262 0.000560
Sep 28 12:36:11 ctl02 nova-api[3773]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:36:11 ctl02 nova-api[3773]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:36:11 ctl02 heat-api-cfn[13300]: 2017-09-28 12:36:11.668 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:36:11] "OPTIONS / HTTP/1.0" 200 134 0.000568
Sep 28 12:36:11 ctl02 nova-api[3773]: 2017-09-28 12:36:11.766 3773 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:36:11 ctl02 nova-api[3773]: 2017-09-28 12:36:11.768 3773 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:36:11 ctl02 nova-api[3773]: 2017-09-28 12:36:11.768 3773 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:36:11 ctl02 nova-api[3773]: 2017-09-28 12:36:11.768 3773 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:36:11 ctl02 nova-api[3773]: 2017-09-28 12:36:11.768 3773 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:36:11 ctl02 nova-api[3773]: 2017-09-28 12:36:11.768 3773 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:36:11 ctl02 nova-api[3773]: 2017-09-28 12:36:11.768 3773 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:36:11 ctl02 nova-api[3773]: 2017-09-28 12:36:11.768 3773 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:36:11 ctl02 nova-api[3773]: 2017-09-28 12:36:11.768 3773 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:36:11 ctl02 nova-api[3773]: 2017-09-28 12:36:11.768 3773 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:36:11 ctl02 nova-api[3773]: 2017-09-28 12:36:11.768 3773 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:36:11 ctl02 nova-api[3773]: 2017-09-28 12:36:11.768 3773 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:36:11 ctl02 nova-api[3773]: 2017-09-28 12:36:11.768 3773 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:36:11 ctl02 nova-api[3773]: 2017-09-28 12:36:11.768 3773 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:36:11 ctl02 nova-api[3773]: 2017-09-28 12:36:11.768 3773 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:36:11 ctl02 nova-api[3773]: 2017-09-28 12:36:11.768 3773 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:36:11 ctl02 nova-api[3773]: 2017-09-28 12:36:11.768 3773 ERROR nova.wsgi     self.filename))
Sep 28 12:36:11 ctl02 nova-api[3773]: 2017-09-28 12:36:11.768 3773 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:36:11 ctl02 nova-api[3773]: 2017-09-28 12:36:11.768 3773 ERROR nova.wsgi
Sep 28 12:36:11 ctl02 nova-api[3773]: 2017-09-28 12:36:11.769 3773 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:36:11 ctl02 nova-api[3773]: 2017-09-28 12:36:11.900 3773 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:36:12 ctl02 nova-api[3773]: 2017-09-28 12:36:12.146 3773 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:36:12 ctl02 nova-api[3773]: 2017-09-28 12:36:12.148 3773 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:36:12 ctl02 nova-api[3773]: 2017-09-28 12:36:12.161 3773 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:36:12 ctl02 nova-api[3773]: 2017-09-28 12:36:12.161 3773 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:36:12 ctl02 glance-api[29183]: 2017-09-28 12:36:12.220 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:36:12] "OPTIONS / HTTP/1.0" 200 134 0.001002
Sep 28 12:36:12 ctl02 nova-api[3773]: 2017-09-28 12:36:12.296 3773 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:36:12 ctl02 nova-api[3773]: 2017-09-28 12:36:12.299 3773 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:36:12 ctl02 nova-api[3773]: 2017-09-28 12:36:12.299 3773 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:36:12 ctl02 nova-api[3773]: 2017-09-28 12:36:12.300 3773 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:36:12 ctl02 nova-api[3773]: 2017-09-28 12:36:12.303 3773 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:36:12 ctl02 nova-api[3773]: 2017-09-28 12:36:12.304 3773 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:36:12 ctl02 nova-api[3773]: 2017-09-28 12:36:12.304 3773 ERROR nova Traceback (most recent call last):
Sep 28 12:36:12 ctl02 nova-api[3773]: 2017-09-28 12:36:12.304 3773 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:36:12 ctl02 nova-api[3773]: 2017-09-28 12:36:12.304 3773 ERROR nova     sys.exit(main())
Sep 28 12:36:12 ctl02 nova-api[3773]: 2017-09-28 12:36:12.304 3773 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:36:12 ctl02 nova-api[3773]: 2017-09-28 12:36:12.304 3773 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:36:12 ctl02 nova-api[3773]: 2017-09-28 12:36:12.304 3773 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:36:12 ctl02 nova-api[3773]: 2017-09-28 12:36:12.304 3773 ERROR nova     max_url_len=max_url_len)
Sep 28 12:36:12 ctl02 nova-api[3773]: 2017-09-28 12:36:12.304 3773 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:36:12 ctl02 nova-api[3773]: 2017-09-28 12:36:12.304 3773 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:36:12 ctl02 nova-api[3773]: 2017-09-28 12:36:12.304 3773 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:36:12 ctl02 nova-api[3773]: 2017-09-28 12:36:12.304 3773 ERROR nova     sock.listen(backlog)
Sep 28 12:36:12 ctl02 nova-api[3773]: 2017-09-28 12:36:12.304 3773 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:36:12 ctl02 nova-api[3773]: 2017-09-28 12:36:12.304 3773 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:36:12 ctl02 nova-api[3773]: 2017-09-28 12:36:12.304 3773 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:36:12 ctl02 nova-api[3773]: 2017-09-28 12:36:12.304 3773 ERROR nova
Sep 28 12:36:12 ctl02 glance-api[29183]: 2017-09-28 12:36:12.396 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:36:12] "OPTIONS / HTTP/1.0" 200 134 0.000511
Sep 28 12:36:12 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:36:12 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:36:12 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:36:12 ctl02 glance-api[29183]: 2017-09-28 12:36:12.572 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:36:12] "OPTIONS / HTTP/1.0" 200 134 0.000879
Sep 28 12:36:12 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:36:12 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:36:12 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:36:12 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:36:13 ctl02 neutron-server[30536]: 2017-09-28 12:36:13.498 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:36:14 ctl02 nova-api[3791]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:36:14 ctl02 nova-api[3791]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:36:14 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:36:14.385 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:36:14] "OPTIONS / HTTP/1.0" 200 134 0.000523
Sep 28 12:36:14 ctl02 nova-api[3791]: 2017-09-28 12:36:14.454 3791 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:36:14 ctl02 nova-api[3791]: 2017-09-28 12:36:14.456 3791 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:36:14 ctl02 nova-api[3791]: 2017-09-28 12:36:14.456 3791 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:36:14 ctl02 nova-api[3791]: 2017-09-28 12:36:14.456 3791 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:36:14 ctl02 nova-api[3791]: 2017-09-28 12:36:14.456 3791 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:36:14 ctl02 nova-api[3791]: 2017-09-28 12:36:14.456 3791 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:36:14 ctl02 nova-api[3791]: 2017-09-28 12:36:14.456 3791 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:36:14 ctl02 nova-api[3791]: 2017-09-28 12:36:14.456 3791 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:36:14 ctl02 nova-api[3791]: 2017-09-28 12:36:14.456 3791 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:36:14 ctl02 nova-api[3791]: 2017-09-28 12:36:14.456 3791 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:36:14 ctl02 nova-api[3791]: 2017-09-28 12:36:14.456 3791 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:36:14 ctl02 nova-api[3791]: 2017-09-28 12:36:14.456 3791 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:36:14 ctl02 nova-api[3791]: 2017-09-28 12:36:14.456 3791 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:36:14 ctl02 nova-api[3791]: 2017-09-28 12:36:14.456 3791 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:36:14 ctl02 nova-api[3791]: 2017-09-28 12:36:14.456 3791 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:36:14 ctl02 nova-api[3791]: 2017-09-28 12:36:14.456 3791 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:36:14 ctl02 nova-api[3791]: 2017-09-28 12:36:14.456 3791 ERROR nova.wsgi     self.filename))
Sep 28 12:36:14 ctl02 nova-api[3791]: 2017-09-28 12:36:14.456 3791 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:36:14 ctl02 nova-api[3791]: 2017-09-28 12:36:14.456 3791 ERROR nova.wsgi
Sep 28 12:36:14 ctl02 nova-api[3791]: 2017-09-28 12:36:14.456 3791 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:36:14 ctl02 nova-api[3791]: 2017-09-28 12:36:14.586 3791 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:36:14 ctl02 nova-api[3791]: 2017-09-28 12:36:14.839 3791 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:36:14 ctl02 nova-api[3791]: 2017-09-28 12:36:14.841 3791 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:36:14 ctl02 nova-api[3791]: 2017-09-28 12:36:14.841 3791 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:36:14 ctl02 nova-api[3791]: 2017-09-28 12:36:14.842 3791 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:36:14 ctl02 nova-api[3791]: 2017-09-28 12:36:14.975 3791 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:36:14 ctl02 nova-api[3791]: 2017-09-28 12:36:14.977 3791 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:36:14 ctl02 nova-api[3791]: 2017-09-28 12:36:14.977 3791 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:36:14 ctl02 nova-api[3791]: 2017-09-28 12:36:14.978 3791 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:36:14 ctl02 nova-api[3791]: 2017-09-28 12:36:14.981 3791 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:36:14 ctl02 nova-api[3791]: 2017-09-28 12:36:14.981 3791 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:36:14 ctl02 nova-api[3791]: 2017-09-28 12:36:14.981 3791 ERROR nova Traceback (most recent call last):
Sep 28 12:36:14 ctl02 nova-api[3791]: 2017-09-28 12:36:14.981 3791 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:36:14 ctl02 nova-api[3791]: 2017-09-28 12:36:14.981 3791 ERROR nova     sys.exit(main())
Sep 28 12:36:14 ctl02 nova-api[3791]: 2017-09-28 12:36:14.981 3791 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:36:14 ctl02 nova-api[3791]: 2017-09-28 12:36:14.981 3791 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:36:14 ctl02 nova-api[3791]: 2017-09-28 12:36:14.981 3791 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:36:14 ctl02 nova-api[3791]: 2017-09-28 12:36:14.981 3791 ERROR nova     max_url_len=max_url_len)
Sep 28 12:36:14 ctl02 nova-api[3791]: 2017-09-28 12:36:14.981 3791 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:36:14 ctl02 nova-api[3791]: 2017-09-28 12:36:14.981 3791 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:36:14 ctl02 nova-api[3791]: 2017-09-28 12:36:14.981 3791 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:36:14 ctl02 nova-api[3791]: 2017-09-28 12:36:14.981 3791 ERROR nova     sock.listen(backlog)
Sep 28 12:36:14 ctl02 nova-api[3791]: 2017-09-28 12:36:14.981 3791 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:36:14 ctl02 nova-api[3791]: 2017-09-28 12:36:14.981 3791 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:36:14 ctl02 nova-api[3791]: 2017-09-28 12:36:14.981 3791 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:36:14 ctl02 nova-api[3791]: 2017-09-28 12:36:14.981 3791 ERROR nova
Sep 28 12:36:15 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:36:15 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:36:15 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:36:15 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:36:15 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:36:15 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:36:15 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:36:15 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:36:15.653 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:36:15] "OPTIONS / HTTP/1.0" 200 134 0.000408
Sep 28 12:36:15 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x43ab5814)
Sep 28 12:36:16 ctl02 heat-api[13008]: 2017-09-28 12:36:16.216 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:36:16] "OPTIONS / HTTP/1.0" 200 134 0.000706
Sep 28 12:36:16 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x43ab5814)
Sep 28 12:36:17 ctl02 heat-api[13008]: 2017-09-28 12:36:17.055 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:36:17] "OPTIONS / HTTP/1.0" 200 134 0.000554
Sep 28 12:36:17 ctl02 nova-api[3808]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:36:17 ctl02 nova-api[3808]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:36:17 ctl02 nova-api[3808]: 2017-09-28 12:36:17.243 3808 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:36:17 ctl02 nova-api[3808]: 2017-09-28 12:36:17.244 3808 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:36:17 ctl02 nova-api[3808]: 2017-09-28 12:36:17.244 3808 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:36:17 ctl02 nova-api[3808]: 2017-09-28 12:36:17.244 3808 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:36:17 ctl02 nova-api[3808]: 2017-09-28 12:36:17.244 3808 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:36:17 ctl02 nova-api[3808]: 2017-09-28 12:36:17.244 3808 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:36:17 ctl02 nova-api[3808]: 2017-09-28 12:36:17.244 3808 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:36:17 ctl02 nova-api[3808]: 2017-09-28 12:36:17.244 3808 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:36:17 ctl02 nova-api[3808]: 2017-09-28 12:36:17.244 3808 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:36:17 ctl02 nova-api[3808]: 2017-09-28 12:36:17.244 3808 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:36:17 ctl02 nova-api[3808]: 2017-09-28 12:36:17.244 3808 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:36:17 ctl02 nova-api[3808]: 2017-09-28 12:36:17.244 3808 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:36:17 ctl02 nova-api[3808]: 2017-09-28 12:36:17.244 3808 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:36:17 ctl02 nova-api[3808]: 2017-09-28 12:36:17.244 3808 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:36:17 ctl02 nova-api[3808]: 2017-09-28 12:36:17.244 3808 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:36:17 ctl02 nova-api[3808]: 2017-09-28 12:36:17.244 3808 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:36:17 ctl02 nova-api[3808]: 2017-09-28 12:36:17.244 3808 ERROR nova.wsgi     self.filename))
Sep 28 12:36:17 ctl02 nova-api[3808]: 2017-09-28 12:36:17.244 3808 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:36:17 ctl02 nova-api[3808]: 2017-09-28 12:36:17.244 3808 ERROR nova.wsgi
Sep 28 12:36:17 ctl02 nova-api[3808]: 2017-09-28 12:36:17.250 3808 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:36:17 ctl02 nova-api[3808]: 2017-09-28 12:36:17.378 3808 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:36:17 ctl02 nova-api[3808]: 2017-09-28 12:36:17.602 3808 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:36:17 ctl02 nova-api[3808]: 2017-09-28 12:36:17.604 3808 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:36:17 ctl02 nova-api[3808]: 2017-09-28 12:36:17.604 3808 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:36:17 ctl02 nova-api[3808]: 2017-09-28 12:36:17.605 3808 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:36:17 ctl02 nova-api[3808]: 2017-09-28 12:36:17.735 3808 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:36:17 ctl02 nova-api[3808]: 2017-09-28 12:36:17.736 3808 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:36:17 ctl02 nova-api[3808]: 2017-09-28 12:36:17.737 3808 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:36:17 ctl02 nova-api[3808]: 2017-09-28 12:36:17.737 3808 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:36:17 ctl02 nova-api[3808]: 2017-09-28 12:36:17.740 3808 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:36:17 ctl02 nova-api[3808]: 2017-09-28 12:36:17.740 3808 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:36:17 ctl02 nova-api[3808]: 2017-09-28 12:36:17.740 3808 ERROR nova Traceback (most recent call last):
Sep 28 12:36:17 ctl02 nova-api[3808]: 2017-09-28 12:36:17.740 3808 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:36:17 ctl02 nova-api[3808]: 2017-09-28 12:36:17.740 3808 ERROR nova     sys.exit(main())
Sep 28 12:36:17 ctl02 nova-api[3808]: 2017-09-28 12:36:17.740 3808 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:36:17 ctl02 nova-api[3808]: 2017-09-28 12:36:17.740 3808 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:36:17 ctl02 nova-api[3808]: 2017-09-28 12:36:17.740 3808 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:36:17 ctl02 nova-api[3808]: 2017-09-28 12:36:17.740 3808 ERROR nova     max_url_len=max_url_len)
Sep 28 12:36:17 ctl02 nova-api[3808]: 2017-09-28 12:36:17.740 3808 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:36:17 ctl02 nova-api[3808]: 2017-09-28 12:36:17.740 3808 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:36:17 ctl02 nova-api[3808]: 2017-09-28 12:36:17.740 3808 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:36:17 ctl02 nova-api[3808]: 2017-09-28 12:36:17.740 3808 ERROR nova     sock.listen(backlog)
Sep 28 12:36:17 ctl02 nova-api[3808]: 2017-09-28 12:36:17.740 3808 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:36:17 ctl02 nova-api[3808]: 2017-09-28 12:36:17.740 3808 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:36:17 ctl02 nova-api[3808]: 2017-09-28 12:36:17.740 3808 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:36:17 ctl02 nova-api[3808]: 2017-09-28 12:36:17.740 3808 ERROR nova
Sep 28 12:36:17 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:36:17 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:36:17 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:36:17 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x43ab5814)
Sep 28 12:36:18 ctl02 heat-api-cfn[13300]: 2017-09-28 12:36:18.049 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:36:18] "OPTIONS / HTTP/1.0" 200 134 0.000589
Sep 28 12:36:18 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:36:18 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:36:18 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:36:18 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:36:18 ctl02 heat-api-cfn[13300]: 2017-09-28 12:36:18.498 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:36:18] "OPTIONS / HTTP/1.0" 200 134 0.000527
Sep 28 12:36:18 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:36:18.650 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:36:18] "OPTIONS / HTTP/1.0" 200 134 0.000475
Sep 28 12:36:18 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x43ab5814)
Sep 28 12:36:19 ctl02 heat-api[13008]: 2017-09-28 12:36:19.171 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:36:19] "OPTIONS / HTTP/1.0" 200 134 0.000639
Sep 28 12:36:19 ctl02 neutron-server[30536]: 2017-09-28 12:36:19.731 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:36:19] "OPTIONS / HTTP/1.0" 200 262 0.000535
Sep 28 12:36:19 ctl02 nova-api[3827]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:36:19 ctl02 nova-api[3827]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:36:19 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x43ab5814)
Sep 28 12:36:20 ctl02 nova-api[3827]: 2017-09-28 12:36:20.032 3827 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:36:20 ctl02 nova-api[3827]: 2017-09-28 12:36:20.034 3827 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:36:20 ctl02 nova-api[3827]: 2017-09-28 12:36:20.034 3827 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:36:20 ctl02 nova-api[3827]: 2017-09-28 12:36:20.034 3827 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:36:20 ctl02 nova-api[3827]: 2017-09-28 12:36:20.034 3827 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:36:20 ctl02 nova-api[3827]: 2017-09-28 12:36:20.034 3827 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:36:20 ctl02 nova-api[3827]: 2017-09-28 12:36:20.034 3827 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:36:20 ctl02 nova-api[3827]: 2017-09-28 12:36:20.034 3827 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:36:20 ctl02 nova-api[3827]: 2017-09-28 12:36:20.034 3827 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:36:20 ctl02 nova-api[3827]: 2017-09-28 12:36:20.034 3827 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:36:20 ctl02 nova-api[3827]: 2017-09-28 12:36:20.034 3827 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:36:20 ctl02 nova-api[3827]: 2017-09-28 12:36:20.034 3827 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:36:20 ctl02 nova-api[3827]: 2017-09-28 12:36:20.034 3827 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:36:20 ctl02 nova-api[3827]: 2017-09-28 12:36:20.034 3827 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:36:20 ctl02 nova-api[3827]: 2017-09-28 12:36:20.034 3827 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:36:20 ctl02 nova-api[3827]: 2017-09-28 12:36:20.034 3827 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:36:20 ctl02 nova-api[3827]: 2017-09-28 12:36:20.034 3827 ERROR nova.wsgi     self.filename))
Sep 28 12:36:20 ctl02 nova-api[3827]: 2017-09-28 12:36:20.034 3827 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:36:20 ctl02 nova-api[3827]: 2017-09-28 12:36:20.034 3827 ERROR nova.wsgi
Sep 28 12:36:20 ctl02 nova-api[3827]: 2017-09-28 12:36:20.035 3827 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:36:20 ctl02 nova-api[3827]: 2017-09-28 12:36:20.166 3827 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:36:20 ctl02 nova-api[3827]: 2017-09-28 12:36:20.414 3827 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:36:20 ctl02 nova-api[3827]: 2017-09-28 12:36:20.416 3827 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:36:20 ctl02 nova-api[3827]: 2017-09-28 12:36:20.417 3827 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:36:20 ctl02 nova-api[3827]: 2017-09-28 12:36:20.417 3827 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:36:20 ctl02 nova-api[3827]: 2017-09-28 12:36:20.549 3827 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:36:20 ctl02 nova-api[3827]: 2017-09-28 12:36:20.552 3827 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:36:20 ctl02 nova-api[3827]: 2017-09-28 12:36:20.554 3827 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:36:20 ctl02 nova-api[3827]: 2017-09-28 12:36:20.554 3827 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:36:20 ctl02 nova-api[3827]: 2017-09-28 12:36:20.557 3827 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:36:20 ctl02 nova-api[3827]: 2017-09-28 12:36:20.558 3827 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:36:20 ctl02 nova-api[3827]: 2017-09-28 12:36:20.558 3827 ERROR nova Traceback (most recent call last):
Sep 28 12:36:20 ctl02 nova-api[3827]: 2017-09-28 12:36:20.558 3827 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:36:20 ctl02 nova-api[3827]: 2017-09-28 12:36:20.558 3827 ERROR nova     sys.exit(main())
Sep 28 12:36:20 ctl02 nova-api[3827]: 2017-09-28 12:36:20.558 3827 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:36:20 ctl02 nova-api[3827]: 2017-09-28 12:36:20.558 3827 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:36:20 ctl02 nova-api[3827]: 2017-09-28 12:36:20.558 3827 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:36:20 ctl02 nova-api[3827]: 2017-09-28 12:36:20.558 3827 ERROR nova     max_url_len=max_url_len)
Sep 28 12:36:20 ctl02 nova-api[3827]: 2017-09-28 12:36:20.558 3827 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:36:20 ctl02 nova-api[3827]: 2017-09-28 12:36:20.558 3827 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:36:20 ctl02 nova-api[3827]: 2017-09-28 12:36:20.558 3827 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:36:20 ctl02 nova-api[3827]: 2017-09-28 12:36:20.558 3827 ERROR nova     sock.listen(backlog)
Sep 28 12:36:20 ctl02 nova-api[3827]: 2017-09-28 12:36:20.558 3827 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:36:20 ctl02 nova-api[3827]: 2017-09-28 12:36:20.558 3827 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:36:20 ctl02 nova-api[3827]: 2017-09-28 12:36:20.558 3827 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:36:20 ctl02 nova-api[3827]: 2017-09-28 12:36:20.558 3827 ERROR nova
Sep 28 12:36:20 ctl02 neutron-server[30536]: 2017-09-28 12:36:20.618 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:36:20] "OPTIONS / HTTP/1.0" 200 262 0.000524
Sep 28 12:36:20 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:36:20 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:36:20 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:36:20 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:36:20 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:36:20 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x43ab5814)
Sep 28 12:36:20 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:36:20 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:36:21 ctl02 neutron-server[30536]: 2017-09-28 12:36:21.207 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:36:21] "OPTIONS / HTTP/1.0" 200 262 0.000524
Sep 28 12:36:21 ctl02 heat-api-cfn[13300]: 2017-09-28 12:36:21.313 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:36:21] "OPTIONS / HTTP/1.0" 200 134 0.000548
Sep 28 12:36:21 ctl02 neutron-server[30536]: 2017-09-28 12:36:21.360 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 4 dead agents out of 6:
Sep 28 12:36:21 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:36:21 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:34:46 cmp002
Sep 28 12:36:21 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:34:38 cmp001
Sep 28 12:36:21 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:34:50 cmp002
Sep 28 12:36:21 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:35:06 cmp002
Sep 28 12:36:21 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x43ab5814)
Sep 28 12:36:22 ctl02 glance-api[29183]: 2017-09-28 12:36:22.108 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:36:22] "OPTIONS / HTTP/1.0" 200 134 0.000659
Sep 28 12:36:22 ctl02 nova-cert[4860]: 2017-09-28 12:36:22.168 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:36:22 ctl02 glance-api[29183]: 2017-09-28 12:36:22.308 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:36:22] "OPTIONS / HTTP/1.0" 200 134 0.001146
Sep 28 12:36:22 ctl02 glance-api[29183]: 2017-09-28 12:36:22.578 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:36:22] "OPTIONS / HTTP/1.0" 200 134 0.000555
Sep 28 12:36:22 ctl02 nova-api[3845]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:36:22 ctl02 nova-api[3845]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:36:22 ctl02 nova-api[3845]: 2017-09-28 12:36:22.775 3845 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:36:22 ctl02 nova-api[3845]: 2017-09-28 12:36:22.776 3845 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:36:22 ctl02 nova-api[3845]: 2017-09-28 12:36:22.776 3845 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:36:22 ctl02 nova-api[3845]: 2017-09-28 12:36:22.776 3845 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:36:22 ctl02 nova-api[3845]: 2017-09-28 12:36:22.776 3845 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:36:22 ctl02 nova-api[3845]: 2017-09-28 12:36:22.776 3845 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:36:22 ctl02 nova-api[3845]: 2017-09-28 12:36:22.776 3845 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:36:22 ctl02 nova-api[3845]: 2017-09-28 12:36:22.776 3845 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:36:22 ctl02 nova-api[3845]: 2017-09-28 12:36:22.776 3845 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:36:22 ctl02 nova-api[3845]: 2017-09-28 12:36:22.776 3845 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:36:22 ctl02 nova-api[3845]: 2017-09-28 12:36:22.776 3845 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:36:22 ctl02 nova-api[3845]: 2017-09-28 12:36:22.776 3845 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:36:22 ctl02 nova-api[3845]: 2017-09-28 12:36:22.776 3845 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:36:22 ctl02 nova-api[3845]: 2017-09-28 12:36:22.776 3845 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:36:22 ctl02 nova-api[3845]: 2017-09-28 12:36:22.776 3845 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:36:22 ctl02 nova-api[3845]: 2017-09-28 12:36:22.776 3845 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:36:22 ctl02 nova-api[3845]: 2017-09-28 12:36:22.776 3845 ERROR nova.wsgi     self.filename))
Sep 28 12:36:22 ctl02 nova-api[3845]: 2017-09-28 12:36:22.776 3845 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:36:22 ctl02 nova-api[3845]: 2017-09-28 12:36:22.776 3845 ERROR nova.wsgi
Sep 28 12:36:22 ctl02 nova-api[3845]: 2017-09-28 12:36:22.777 3845 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:36:22 ctl02 nova-conductor[5056]: 2017-09-28 12:36:22.835 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:36:22 ctl02 nova-conductor[5056]: 2017-09-28 12:36:22.857 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:36:22 ctl02 nova-conductor[5056]: 2017-09-28 12:36:22.865 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:36:22 ctl02 nova-conductor[5056]: 2017-09-28 12:36:22.870 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:36:22 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x43ab5814)
Sep 28 12:36:22 ctl02 nova-api[3845]: 2017-09-28 12:36:22.907 3845 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:36:23 ctl02 nova-api[3845]: 2017-09-28 12:36:23.127 3845 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:36:23 ctl02 nova-api[3845]: 2017-09-28 12:36:23.129 3845 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:36:23 ctl02 nova-api[3845]: 2017-09-28 12:36:23.129 3845 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:36:23 ctl02 nova-api[3845]: 2017-09-28 12:36:23.129 3845 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:36:23 ctl02 nova-api[3845]: 2017-09-28 12:36:23.261 3845 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:36:23 ctl02 nova-api[3845]: 2017-09-28 12:36:23.262 3845 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:36:23 ctl02 nova-api[3845]: 2017-09-28 12:36:23.263 3845 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:36:23 ctl02 nova-api[3845]: 2017-09-28 12:36:23.263 3845 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:36:23 ctl02 nova-api[3845]: 2017-09-28 12:36:23.266 3845 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:36:23 ctl02 nova-api[3845]: 2017-09-28 12:36:23.266 3845 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:36:23 ctl02 nova-api[3845]: 2017-09-28 12:36:23.266 3845 ERROR nova Traceback (most recent call last):
Sep 28 12:36:23 ctl02 nova-api[3845]: 2017-09-28 12:36:23.266 3845 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:36:23 ctl02 nova-api[3845]: 2017-09-28 12:36:23.266 3845 ERROR nova     sys.exit(main())
Sep 28 12:36:23 ctl02 nova-api[3845]: 2017-09-28 12:36:23.266 3845 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:36:23 ctl02 nova-api[3845]: 2017-09-28 12:36:23.266 3845 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:36:23 ctl02 nova-api[3845]: 2017-09-28 12:36:23.266 3845 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:36:23 ctl02 nova-api[3845]: 2017-09-28 12:36:23.266 3845 ERROR nova     max_url_len=max_url_len)
Sep 28 12:36:23 ctl02 nova-api[3845]: 2017-09-28 12:36:23.266 3845 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:36:23 ctl02 nova-api[3845]: 2017-09-28 12:36:23.266 3845 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:36:23 ctl02 nova-api[3845]: 2017-09-28 12:36:23.266 3845 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:36:23 ctl02 nova-api[3845]: 2017-09-28 12:36:23.266 3845 ERROR nova     sock.listen(backlog)
Sep 28 12:36:23 ctl02 nova-api[3845]: 2017-09-28 12:36:23.266 3845 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:36:23 ctl02 nova-api[3845]: 2017-09-28 12:36:23.266 3845 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:36:23 ctl02 nova-api[3845]: 2017-09-28 12:36:23.266 3845 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:36:23 ctl02 nova-api[3845]: 2017-09-28 12:36:23.266 3845 ERROR nova
Sep 28 12:36:23 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:36:23 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:36:23 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:36:23 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:36:23 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:36:23 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:36:23 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:36:23 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x43ab5814)
Sep 28 12:36:24 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:36:24.151 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:36:24] "OPTIONS / HTTP/1.0" 200 134 0.000382
Sep 28 12:36:24 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x43ab5814)
Sep 28 12:36:25 ctl02 nova-api[3863]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:36:25 ctl02 nova-api[3863]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:36:25 ctl02 nova-api[3863]: 2017-09-28 12:36:25.477 3863 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:36:25 ctl02 nova-api[3863]: 2017-09-28 12:36:25.478 3863 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:36:25 ctl02 nova-api[3863]: 2017-09-28 12:36:25.478 3863 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:36:25 ctl02 nova-api[3863]: 2017-09-28 12:36:25.478 3863 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:36:25 ctl02 nova-api[3863]: 2017-09-28 12:36:25.478 3863 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:36:25 ctl02 nova-api[3863]: 2017-09-28 12:36:25.478 3863 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:36:25 ctl02 nova-api[3863]: 2017-09-28 12:36:25.478 3863 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:36:25 ctl02 nova-api[3863]: 2017-09-28 12:36:25.478 3863 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:36:25 ctl02 nova-api[3863]: 2017-09-28 12:36:25.478 3863 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:36:25 ctl02 nova-api[3863]: 2017-09-28 12:36:25.478 3863 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:36:25 ctl02 nova-api[3863]: 2017-09-28 12:36:25.478 3863 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:36:25 ctl02 nova-api[3863]: 2017-09-28 12:36:25.478 3863 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:36:25 ctl02 nova-api[3863]: 2017-09-28 12:36:25.478 3863 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:36:25 ctl02 nova-api[3863]: 2017-09-28 12:36:25.478 3863 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:36:25 ctl02 nova-api[3863]: 2017-09-28 12:36:25.478 3863 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:36:25 ctl02 nova-api[3863]: 2017-09-28 12:36:25.478 3863 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:36:25 ctl02 nova-api[3863]: 2017-09-28 12:36:25.478 3863 ERROR nova.wsgi     self.filename))
Sep 28 12:36:25 ctl02 nova-api[3863]: 2017-09-28 12:36:25.478 3863 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:36:25 ctl02 nova-api[3863]: 2017-09-28 12:36:25.478 3863 ERROR nova.wsgi
Sep 28 12:36:25 ctl02 nova-api[3863]: 2017-09-28 12:36:25.479 3863 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:36:25 ctl02 nova-api[3863]: 2017-09-28 12:36:25.606 3863 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:36:25 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:36:25.671 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:36:25] "OPTIONS / HTTP/1.0" 200 134 0.000424
Sep 28 12:36:25 ctl02 nova-api[3863]: 2017-09-28 12:36:25.825 3863 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:36:25 ctl02 nova-api[3863]: 2017-09-28 12:36:25.827 3863 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:36:25 ctl02 nova-api[3863]: 2017-09-28 12:36:25.827 3863 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:36:25 ctl02 nova-api[3863]: 2017-09-28 12:36:25.827 3863 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:36:25 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x43ab5814)
Sep 28 12:36:25 ctl02 nova-api[3863]: 2017-09-28 12:36:25.956 3863 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:36:25 ctl02 nova-api[3863]: 2017-09-28 12:36:25.957 3863 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:36:25 ctl02 nova-api[3863]: 2017-09-28 12:36:25.958 3863 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:36:25 ctl02 nova-api[3863]: 2017-09-28 12:36:25.958 3863 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:36:25 ctl02 nova-api[3863]: 2017-09-28 12:36:25.961 3863 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:36:25 ctl02 nova-api[3863]: 2017-09-28 12:36:25.961 3863 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:36:25 ctl02 nova-api[3863]: 2017-09-28 12:36:25.961 3863 ERROR nova Traceback (most recent call last):
Sep 28 12:36:25 ctl02 nova-api[3863]: 2017-09-28 12:36:25.961 3863 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:36:25 ctl02 nova-api[3863]: 2017-09-28 12:36:25.961 3863 ERROR nova     sys.exit(main())
Sep 28 12:36:25 ctl02 nova-api[3863]: 2017-09-28 12:36:25.961 3863 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:36:25 ctl02 nova-api[3863]: 2017-09-28 12:36:25.961 3863 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:36:25 ctl02 nova-api[3863]: 2017-09-28 12:36:25.961 3863 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:36:25 ctl02 nova-api[3863]: 2017-09-28 12:36:25.961 3863 ERROR nova     max_url_len=max_url_len)
Sep 28 12:36:25 ctl02 nova-api[3863]: 2017-09-28 12:36:25.961 3863 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:36:25 ctl02 nova-api[3863]: 2017-09-28 12:36:25.961 3863 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:36:25 ctl02 nova-api[3863]: 2017-09-28 12:36:25.961 3863 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:36:25 ctl02 nova-api[3863]: 2017-09-28 12:36:25.961 3863 ERROR nova     sock.listen(backlog)
Sep 28 12:36:25 ctl02 nova-api[3863]: 2017-09-28 12:36:25.961 3863 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:36:25 ctl02 nova-api[3863]: 2017-09-28 12:36:25.961 3863 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:36:25 ctl02 nova-api[3863]: 2017-09-28 12:36:25.961 3863 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:36:25 ctl02 nova-api[3863]: 2017-09-28 12:36:25.961 3863 ERROR nova
Sep 28 12:36:26 ctl02 heat-api[13008]: 2017-09-28 12:36:26.085 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:36:26] "OPTIONS / HTTP/1.0" 200 134 0.000530
Sep 28 12:36:26 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:36:26 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:36:26 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:36:26 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:36:26 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:36:26 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:36:26 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:36:26 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:36:26 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:36:27 ctl02 heat-api[13008]: 2017-09-28 12:36:27.231 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:36:27] "OPTIONS / HTTP/1.0" 200 134 0.000569
Sep 28 12:36:28 ctl02 nova-api[3881]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:36:28 ctl02 nova-api[3881]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:36:28 ctl02 nova-api[3881]: 2017-09-28 12:36:28.259 3881 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:36:28 ctl02 nova-api[3881]: 2017-09-28 12:36:28.261 3881 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:36:28 ctl02 nova-api[3881]: 2017-09-28 12:36:28.261 3881 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:36:28 ctl02 nova-api[3881]: 2017-09-28 12:36:28.261 3881 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:36:28 ctl02 nova-api[3881]: 2017-09-28 12:36:28.261 3881 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:36:28 ctl02 nova-api[3881]: 2017-09-28 12:36:28.261 3881 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:36:28 ctl02 nova-api[3881]: 2017-09-28 12:36:28.261 3881 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:36:28 ctl02 nova-api[3881]: 2017-09-28 12:36:28.261 3881 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:36:28 ctl02 nova-api[3881]: 2017-09-28 12:36:28.261 3881 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:36:28 ctl02 nova-api[3881]: 2017-09-28 12:36:28.261 3881 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:36:28 ctl02 nova-api[3881]: 2017-09-28 12:36:28.261 3881 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:36:28 ctl02 nova-api[3881]: 2017-09-28 12:36:28.261 3881 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:36:28 ctl02 nova-api[3881]: 2017-09-28 12:36:28.261 3881 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:36:28 ctl02 nova-api[3881]: 2017-09-28 12:36:28.261 3881 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:36:28 ctl02 nova-api[3881]: 2017-09-28 12:36:28.261 3881 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:36:28 ctl02 nova-api[3881]: 2017-09-28 12:36:28.261 3881 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:36:28 ctl02 nova-api[3881]: 2017-09-28 12:36:28.261 3881 ERROR nova.wsgi     self.filename))
Sep 28 12:36:28 ctl02 nova-api[3881]: 2017-09-28 12:36:28.261 3881 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:36:28 ctl02 nova-api[3881]: 2017-09-28 12:36:28.261 3881 ERROR nova.wsgi
Sep 28 12:36:28 ctl02 nova-api[3881]: 2017-09-28 12:36:28.262 3881 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:36:28 ctl02 heat-api-cfn[13300]: 2017-09-28 12:36:28.376 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:36:28] "OPTIONS / HTTP/1.0" 200 134 0.000518
Sep 28 12:36:28 ctl02 nova-api[3881]: 2017-09-28 12:36:28.394 3881 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:36:28 ctl02 neutron-server[30536]: 2017-09-28 12:36:28.494 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:36:28 ctl02 nova-api[3881]: 2017-09-28 12:36:28.643 3881 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:36:28 ctl02 nova-api[3881]: 2017-09-28 12:36:28.646 3881 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:36:28 ctl02 nova-api[3881]: 2017-09-28 12:36:28.646 3881 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:36:28 ctl02 nova-api[3881]: 2017-09-28 12:36:28.646 3881 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:36:28 ctl02 heat-api-cfn[13300]: 2017-09-28 12:36:28.746 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:36:28] "OPTIONS / HTTP/1.0" 200 134 0.000541
Sep 28 12:36:28 ctl02 nova-api[3881]: 2017-09-28 12:36:28.776 3881 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:36:28 ctl02 nova-api[3881]: 2017-09-28 12:36:28.778 3881 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:36:28 ctl02 nova-api[3881]: 2017-09-28 12:36:28.779 3881 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:36:28 ctl02 nova-api[3881]: 2017-09-28 12:36:28.779 3881 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:36:28 ctl02 nova-api[3881]: 2017-09-28 12:36:28.782 3881 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:36:28 ctl02 nova-api[3881]: 2017-09-28 12:36:28.782 3881 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:36:28 ctl02 nova-api[3881]: 2017-09-28 12:36:28.782 3881 ERROR nova Traceback (most recent call last):
Sep 28 12:36:28 ctl02 nova-api[3881]: 2017-09-28 12:36:28.782 3881 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:36:28 ctl02 nova-api[3881]: 2017-09-28 12:36:28.782 3881 ERROR nova     sys.exit(main())
Sep 28 12:36:28 ctl02 nova-api[3881]: 2017-09-28 12:36:28.782 3881 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:36:28 ctl02 nova-api[3881]: 2017-09-28 12:36:28.782 3881 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:36:28 ctl02 nova-api[3881]: 2017-09-28 12:36:28.782 3881 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:36:28 ctl02 nova-api[3881]: 2017-09-28 12:36:28.782 3881 ERROR nova     max_url_len=max_url_len)
Sep 28 12:36:28 ctl02 nova-api[3881]: 2017-09-28 12:36:28.782 3881 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:36:28 ctl02 nova-api[3881]: 2017-09-28 12:36:28.782 3881 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:36:28 ctl02 nova-api[3881]: 2017-09-28 12:36:28.782 3881 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:36:28 ctl02 nova-api[3881]: 2017-09-28 12:36:28.782 3881 ERROR nova     sock.listen(backlog)
Sep 28 12:36:28 ctl02 nova-api[3881]: 2017-09-28 12:36:28.782 3881 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:36:28 ctl02 nova-api[3881]: 2017-09-28 12:36:28.782 3881 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:36:28 ctl02 nova-api[3881]: 2017-09-28 12:36:28.782 3881 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:36:28 ctl02 nova-api[3881]: 2017-09-28 12:36:28.782 3881 ERROR nova
Sep 28 12:36:28 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:36:28.814 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:36:28] "OPTIONS / HTTP/1.0" 200 134 0.000467
Sep 28 12:36:28 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:36:28 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:36:28 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:36:29 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:36:29 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:36:29 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:36:29 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:36:29 ctl02 heat-api[13008]: 2017-09-28 12:36:29.343 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:36:29] "OPTIONS / HTTP/1.0" 200 134 0.000635
Sep 28 12:36:29 ctl02 neutron-server[30536]: 2017-09-28 12:36:29.917 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:36:29] "OPTIONS / HTTP/1.0" 200 262 0.000531
Sep 28 12:36:30 ctl02 neutron-server[30536]: 2017-09-28 12:36:30.676 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:36:30] "OPTIONS / HTTP/1.0" 200 262 0.000557
Sep 28 12:36:30 ctl02 nova-api[3904]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:36:30 ctl02 nova-api[3904]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:36:31 ctl02 nova-api[3904]: 2017-09-28 12:36:31.038 3904 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:36:31 ctl02 nova-api[3904]: 2017-09-28 12:36:31.040 3904 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:36:31 ctl02 nova-api[3904]: 2017-09-28 12:36:31.040 3904 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:36:31 ctl02 nova-api[3904]: 2017-09-28 12:36:31.040 3904 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:36:31 ctl02 nova-api[3904]: 2017-09-28 12:36:31.040 3904 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:36:31 ctl02 nova-api[3904]: 2017-09-28 12:36:31.040 3904 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:36:31 ctl02 nova-api[3904]: 2017-09-28 12:36:31.040 3904 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:36:31 ctl02 nova-api[3904]: 2017-09-28 12:36:31.040 3904 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:36:31 ctl02 nova-api[3904]: 2017-09-28 12:36:31.040 3904 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:36:31 ctl02 nova-api[3904]: 2017-09-28 12:36:31.040 3904 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:36:31 ctl02 nova-api[3904]: 2017-09-28 12:36:31.040 3904 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:36:31 ctl02 nova-api[3904]: 2017-09-28 12:36:31.040 3904 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:36:31 ctl02 nova-api[3904]: 2017-09-28 12:36:31.040 3904 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:36:31 ctl02 nova-api[3904]: 2017-09-28 12:36:31.040 3904 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:36:31 ctl02 nova-api[3904]: 2017-09-28 12:36:31.040 3904 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:36:31 ctl02 nova-api[3904]: 2017-09-28 12:36:31.040 3904 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:36:31 ctl02 nova-api[3904]: 2017-09-28 12:36:31.040 3904 ERROR nova.wsgi     self.filename))
Sep 28 12:36:31 ctl02 nova-api[3904]: 2017-09-28 12:36:31.040 3904 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:36:31 ctl02 nova-api[3904]: 2017-09-28 12:36:31.040 3904 ERROR nova.wsgi
Sep 28 12:36:31 ctl02 nova-api[3904]: 2017-09-28 12:36:31.042 3904 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:36:31 ctl02 heat-api-cfn[13300]: 2017-09-28 12:36:31.120 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:36:31] "OPTIONS / HTTP/1.0" 200 134 0.000499
Sep 28 12:36:31 ctl02 neutron-server[30536]: 2017-09-28 12:36:31.125 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:36:31] "OPTIONS / HTTP/1.0" 200 262 0.000543
Sep 28 12:36:31 ctl02 nova-api[3904]: 2017-09-28 12:36:31.176 3904 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:36:31 ctl02 nova-api[3904]: 2017-09-28 12:36:31.426 3904 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:36:31 ctl02 nova-api[3904]: 2017-09-28 12:36:31.428 3904 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:36:31 ctl02 nova-api[3904]: 2017-09-28 12:36:31.428 3904 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:36:31 ctl02 nova-api[3904]: 2017-09-28 12:36:31.429 3904 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:36:31 ctl02 nova-api[3904]: 2017-09-28 12:36:31.563 3904 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:36:31 ctl02 nova-api[3904]: 2017-09-28 12:36:31.565 3904 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:36:31 ctl02 nova-api[3904]: 2017-09-28 12:36:31.565 3904 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:36:31 ctl02 nova-api[3904]: 2017-09-28 12:36:31.565 3904 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:36:31 ctl02 nova-api[3904]: 2017-09-28 12:36:31.568 3904 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:36:31 ctl02 nova-api[3904]: 2017-09-28 12:36:31.569 3904 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:36:31 ctl02 nova-api[3904]: 2017-09-28 12:36:31.569 3904 ERROR nova Traceback (most recent call last):
Sep 28 12:36:31 ctl02 nova-api[3904]: 2017-09-28 12:36:31.569 3904 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:36:31 ctl02 nova-api[3904]: 2017-09-28 12:36:31.569 3904 ERROR nova     sys.exit(main())
Sep 28 12:36:31 ctl02 nova-api[3904]: 2017-09-28 12:36:31.569 3904 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:36:31 ctl02 nova-api[3904]: 2017-09-28 12:36:31.569 3904 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:36:31 ctl02 nova-api[3904]: 2017-09-28 12:36:31.569 3904 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:36:31 ctl02 nova-api[3904]: 2017-09-28 12:36:31.569 3904 ERROR nova     max_url_len=max_url_len)
Sep 28 12:36:31 ctl02 nova-api[3904]: 2017-09-28 12:36:31.569 3904 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:36:31 ctl02 nova-api[3904]: 2017-09-28 12:36:31.569 3904 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:36:31 ctl02 nova-api[3904]: 2017-09-28 12:36:31.569 3904 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:36:31 ctl02 nova-api[3904]: 2017-09-28 12:36:31.569 3904 ERROR nova     sock.listen(backlog)
Sep 28 12:36:31 ctl02 nova-api[3904]: 2017-09-28 12:36:31.569 3904 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:36:31 ctl02 nova-api[3904]: 2017-09-28 12:36:31.569 3904 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:36:31 ctl02 nova-api[3904]: 2017-09-28 12:36:31.569 3904 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:36:31 ctl02 nova-api[3904]: 2017-09-28 12:36:31.569 3904 ERROR nova
Sep 28 12:36:31 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:36:31 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:36:31 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:36:31 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:36:31 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:36:31 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:36:31 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:36:32 ctl02 glance-api[29183]: 2017-09-28 12:36:32.013 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:36:32] "OPTIONS / HTTP/1.0" 200 134 0.000703
Sep 28 12:36:32 ctl02 nova-consoleauth[5433]: 2017-09-28 12:36:32.042 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:36:32 ctl02 glance-api[29183]: 2017-09-28 12:36:32.263 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:36:32] "OPTIONS / HTTP/1.0" 200 134 0.000647
Sep 28 12:36:32 ctl02 glance-api[29183]: 2017-09-28 12:36:32.818 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:36:32] "OPTIONS / HTTP/1.0" 200 134 0.000629
Sep 28 12:36:33 ctl02 nova-api[3921]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:36:33 ctl02 nova-api[3921]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:36:33 ctl02 nova-api[3921]: 2017-09-28 12:36:33.745 3921 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:36:33 ctl02 nova-api[3921]: 2017-09-28 12:36:33.746 3921 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:36:33 ctl02 nova-api[3921]: 2017-09-28 12:36:33.746 3921 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:36:33 ctl02 nova-api[3921]: 2017-09-28 12:36:33.746 3921 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:36:33 ctl02 nova-api[3921]: 2017-09-28 12:36:33.746 3921 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:36:33 ctl02 nova-api[3921]: 2017-09-28 12:36:33.746 3921 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:36:33 ctl02 nova-api[3921]: 2017-09-28 12:36:33.746 3921 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:36:33 ctl02 nova-api[3921]: 2017-09-28 12:36:33.746 3921 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:36:33 ctl02 nova-api[3921]: 2017-09-28 12:36:33.746 3921 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:36:33 ctl02 nova-api[3921]: 2017-09-28 12:36:33.746 3921 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:36:33 ctl02 nova-api[3921]: 2017-09-28 12:36:33.746 3921 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:36:33 ctl02 nova-api[3921]: 2017-09-28 12:36:33.746 3921 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:36:33 ctl02 nova-api[3921]: 2017-09-28 12:36:33.746 3921 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:36:33 ctl02 nova-api[3921]: 2017-09-28 12:36:33.746 3921 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:36:33 ctl02 nova-api[3921]: 2017-09-28 12:36:33.746 3921 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:36:33 ctl02 nova-api[3921]: 2017-09-28 12:36:33.746 3921 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:36:33 ctl02 nova-api[3921]: 2017-09-28 12:36:33.746 3921 ERROR nova.wsgi     self.filename))
Sep 28 12:36:33 ctl02 nova-api[3921]: 2017-09-28 12:36:33.746 3921 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:36:33 ctl02 nova-api[3921]: 2017-09-28 12:36:33.746 3921 ERROR nova.wsgi
Sep 28 12:36:33 ctl02 nova-api[3921]: 2017-09-28 12:36:33.747 3921 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:36:33 ctl02 nova-api[3921]: 2017-09-28 12:36:33.873 3921 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:36:33 ctl02 heat-engine[12803]: 2017-09-28 12:36:33.970 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:36:33 ctl02 heat-engine[12803]: 2017-09-28 12:36:33.975 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:36:33 ctl02 heat-engine[12803]: 2017-09-28 12:36:33.980 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:36:33 ctl02 heat-engine[12803]: 2017-09-28 12:36:33.981 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:36:34 ctl02 nova-api[3921]: 2017-09-28 12:36:34.094 3921 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:36:34 ctl02 nova-api[3921]: 2017-09-28 12:36:34.096 3921 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:36:34 ctl02 nova-api[3921]: 2017-09-28 12:36:34.097 3921 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:36:34 ctl02 nova-api[3921]: 2017-09-28 12:36:34.097 3921 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:36:34 ctl02 nova-api[3921]: 2017-09-28 12:36:34.229 3921 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:36:34 ctl02 nova-api[3921]: 2017-09-28 12:36:34.231 3921 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:36:34 ctl02 nova-api[3921]: 2017-09-28 12:36:34.231 3921 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:36:34 ctl02 nova-api[3921]: 2017-09-28 12:36:34.231 3921 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:36:34 ctl02 nova-api[3921]: 2017-09-28 12:36:34.235 3921 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:36:34 ctl02 nova-api[3921]: 2017-09-28 12:36:34.235 3921 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:36:34 ctl02 nova-api[3921]: 2017-09-28 12:36:34.235 3921 ERROR nova Traceback (most recent call last):
Sep 28 12:36:34 ctl02 nova-api[3921]: 2017-09-28 12:36:34.235 3921 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:36:34 ctl02 nova-api[3921]: 2017-09-28 12:36:34.235 3921 ERROR nova     sys.exit(main())
Sep 28 12:36:34 ctl02 nova-api[3921]: 2017-09-28 12:36:34.235 3921 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:36:34 ctl02 nova-api[3921]: 2017-09-28 12:36:34.235 3921 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:36:34 ctl02 nova-api[3921]: 2017-09-28 12:36:34.235 3921 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:36:34 ctl02 nova-api[3921]: 2017-09-28 12:36:34.235 3921 ERROR nova     max_url_len=max_url_len)
Sep 28 12:36:34 ctl02 nova-api[3921]: 2017-09-28 12:36:34.235 3921 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:36:34 ctl02 nova-api[3921]: 2017-09-28 12:36:34.235 3921 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:36:34 ctl02 nova-api[3921]: 2017-09-28 12:36:34.235 3921 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:36:34 ctl02 nova-api[3921]: 2017-09-28 12:36:34.235 3921 ERROR nova     sock.listen(backlog)
Sep 28 12:36:34 ctl02 nova-api[3921]: 2017-09-28 12:36:34.235 3921 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:36:34 ctl02 nova-api[3921]: 2017-09-28 12:36:34.235 3921 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:36:34 ctl02 nova-api[3921]: 2017-09-28 12:36:34.235 3921 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:36:34 ctl02 nova-api[3921]: 2017-09-28 12:36:34.235 3921 ERROR nova
Sep 28 12:36:34 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:36:34 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:36:34 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:36:34 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:36:34.383 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:36:34] "OPTIONS / HTTP/1.0" 200 134 0.000510
Sep 28 12:36:34 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:36:34 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:36:34 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:36:34 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:36:35 ctl02 nova-scheduler[5620]: 2017-09-28 12:36:35.093 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:36:35 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:36:35.757 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:36:35] "OPTIONS / HTTP/1.0" 200 134 0.000382
Sep 28 12:36:35 ctl02 heat-api[13008]: 2017-09-28 12:36:35.802 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:36:35] "OPTIONS / HTTP/1.0" 200 134 0.000543
Sep 28 12:36:36 ctl02 nova-api[3940]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:36:36 ctl02 nova-api[3940]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:36:36 ctl02 neutron-server[30536]: 2017-09-28 12:36:36.358 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 4 dead agents out of 6:
Sep 28 12:36:36 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:36:36 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:34:46 cmp002
Sep 28 12:36:36 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:34:38 cmp001
Sep 28 12:36:36 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:34:50 cmp002
Sep 28 12:36:36 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:35:06 cmp002
Sep 28 12:36:36 ctl02 nova-api[3940]: 2017-09-28 12:36:36.530 3940 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:36:36 ctl02 nova-api[3940]: 2017-09-28 12:36:36.532 3940 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:36:36 ctl02 nova-api[3940]: 2017-09-28 12:36:36.532 3940 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:36:36 ctl02 nova-api[3940]: 2017-09-28 12:36:36.532 3940 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:36:36 ctl02 nova-api[3940]: 2017-09-28 12:36:36.532 3940 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:36:36 ctl02 nova-api[3940]: 2017-09-28 12:36:36.532 3940 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:36:36 ctl02 nova-api[3940]: 2017-09-28 12:36:36.532 3940 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:36:36 ctl02 nova-api[3940]: 2017-09-28 12:36:36.532 3940 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:36:36 ctl02 nova-api[3940]: 2017-09-28 12:36:36.532 3940 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:36:36 ctl02 nova-api[3940]: 2017-09-28 12:36:36.532 3940 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:36:36 ctl02 nova-api[3940]: 2017-09-28 12:36:36.532 3940 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:36:36 ctl02 nova-api[3940]: 2017-09-28 12:36:36.532 3940 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:36:36 ctl02 nova-api[3940]: 2017-09-28 12:36:36.532 3940 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:36:36 ctl02 nova-api[3940]: 2017-09-28 12:36:36.532 3940 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:36:36 ctl02 nova-api[3940]: 2017-09-28 12:36:36.532 3940 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:36:36 ctl02 nova-api[3940]: 2017-09-28 12:36:36.532 3940 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:36:36 ctl02 nova-api[3940]: 2017-09-28 12:36:36.532 3940 ERROR nova.wsgi     self.filename))
Sep 28 12:36:36 ctl02 nova-api[3940]: 2017-09-28 12:36:36.532 3940 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:36:36 ctl02 nova-api[3940]: 2017-09-28 12:36:36.532 3940 ERROR nova.wsgi
Sep 28 12:36:36 ctl02 nova-api[3940]: 2017-09-28 12:36:36.533 3940 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:36:36 ctl02 nova-api[3940]: 2017-09-28 12:36:36.668 3940 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:36:36 ctl02 nova-api[3940]: 2017-09-28 12:36:36.916 3940 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:36:36 ctl02 nova-api[3940]: 2017-09-28 12:36:36.918 3940 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:36:36 ctl02 nova-api[3940]: 2017-09-28 12:36:36.918 3940 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:36:36 ctl02 nova-api[3940]: 2017-09-28 12:36:36.919 3940 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:36:37 ctl02 nova-api[3940]: 2017-09-28 12:36:37.053 3940 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:36:37 ctl02 nova-api[3940]: 2017-09-28 12:36:37.055 3940 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:36:37 ctl02 nova-api[3940]: 2017-09-28 12:36:37.055 3940 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:36:37 ctl02 nova-api[3940]: 2017-09-28 12:36:37.055 3940 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:36:37 ctl02 nova-api[3940]: 2017-09-28 12:36:37.059 3940 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:36:37 ctl02 nova-api[3940]: 2017-09-28 12:36:37.059 3940 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:36:37 ctl02 nova-api[3940]: 2017-09-28 12:36:37.059 3940 ERROR nova Traceback (most recent call last):
Sep 28 12:36:37 ctl02 nova-api[3940]: 2017-09-28 12:36:37.059 3940 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:36:37 ctl02 nova-api[3940]: 2017-09-28 12:36:37.059 3940 ERROR nova     sys.exit(main())
Sep 28 12:36:37 ctl02 nova-api[3940]: 2017-09-28 12:36:37.059 3940 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:36:37 ctl02 nova-api[3940]: 2017-09-28 12:36:37.059 3940 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:36:37 ctl02 nova-api[3940]: 2017-09-28 12:36:37.059 3940 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:36:37 ctl02 nova-api[3940]: 2017-09-28 12:36:37.059 3940 ERROR nova     max_url_len=max_url_len)
Sep 28 12:36:37 ctl02 nova-api[3940]: 2017-09-28 12:36:37.059 3940 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:36:37 ctl02 nova-api[3940]: 2017-09-28 12:36:37.059 3940 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:36:37 ctl02 nova-api[3940]: 2017-09-28 12:36:37.059 3940 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:36:37 ctl02 nova-api[3940]: 2017-09-28 12:36:37.059 3940 ERROR nova     sock.listen(backlog)
Sep 28 12:36:37 ctl02 nova-api[3940]: 2017-09-28 12:36:37.059 3940 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:36:37 ctl02 nova-api[3940]: 2017-09-28 12:36:37.059 3940 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:36:37 ctl02 nova-api[3940]: 2017-09-28 12:36:37.059 3940 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:36:37 ctl02 nova-api[3940]: 2017-09-28 12:36:37.059 3940 ERROR nova
Sep 28 12:36:37 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:36:37 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:36:37 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:36:37 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa47bc15b)
Sep 28 12:36:37 ctl02 heat-api[13008]: 2017-09-28 12:36:37.352 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:36:37] "OPTIONS / HTTP/1.0" 200 134 0.000718
Sep 28 12:36:37 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:36:37 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:36:37 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:36:37 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:36:38 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa47bc15b)
Sep 28 12:36:38 ctl02 heat-api-cfn[13300]: 2017-09-28 12:36:38.482 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:36:38] "OPTIONS / HTTP/1.0" 200 134 0.000501
Sep 28 12:36:38 ctl02 heat-api-cfn[13300]: 2017-09-28 12:36:38.536 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:36:38] "OPTIONS / HTTP/1.0" 200 134 0.000306
Sep 28 12:36:39 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:36:39.065 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:36:39] "OPTIONS / HTTP/1.0" 200 134 0.000453
Sep 28 12:36:39 ctl02 nova-api[3958]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:36:39 ctl02 nova-api[3958]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:36:39 ctl02 nova-api[3958]: 2017-09-28 12:36:39.293 3958 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:36:39 ctl02 nova-api[3958]: 2017-09-28 12:36:39.294 3958 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:36:39 ctl02 nova-api[3958]: 2017-09-28 12:36:39.294 3958 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:36:39 ctl02 nova-api[3958]: 2017-09-28 12:36:39.294 3958 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:36:39 ctl02 nova-api[3958]: 2017-09-28 12:36:39.294 3958 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:36:39 ctl02 nova-api[3958]: 2017-09-28 12:36:39.294 3958 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:36:39 ctl02 nova-api[3958]: 2017-09-28 12:36:39.294 3958 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:36:39 ctl02 nova-api[3958]: 2017-09-28 12:36:39.294 3958 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:36:39 ctl02 nova-api[3958]: 2017-09-28 12:36:39.294 3958 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:36:39 ctl02 nova-api[3958]: 2017-09-28 12:36:39.294 3958 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:36:39 ctl02 nova-api[3958]: 2017-09-28 12:36:39.294 3958 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:36:39 ctl02 nova-api[3958]: 2017-09-28 12:36:39.294 3958 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:36:39 ctl02 nova-api[3958]: 2017-09-28 12:36:39.294 3958 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:36:39 ctl02 nova-api[3958]: 2017-09-28 12:36:39.294 3958 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:36:39 ctl02 nova-api[3958]: 2017-09-28 12:36:39.294 3958 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:36:39 ctl02 nova-api[3958]: 2017-09-28 12:36:39.294 3958 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:36:39 ctl02 nova-api[3958]: 2017-09-28 12:36:39.294 3958 ERROR nova.wsgi     self.filename))
Sep 28 12:36:39 ctl02 nova-api[3958]: 2017-09-28 12:36:39.294 3958 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:36:39 ctl02 nova-api[3958]: 2017-09-28 12:36:39.294 3958 ERROR nova.wsgi
Sep 28 12:36:39 ctl02 nova-api[3958]: 2017-09-28 12:36:39.295 3958 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:36:39 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa47bc15b)
Sep 28 12:36:39 ctl02 nova-api[3958]: 2017-09-28 12:36:39.429 3958 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:36:39 ctl02 heat-api[13008]: 2017-09-28 12:36:39.611 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:36:39] "OPTIONS / HTTP/1.0" 200 134 0.000618
Sep 28 12:36:39 ctl02 nova-api[3958]: 2017-09-28 12:36:39.681 3958 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:36:39 ctl02 nova-api[3958]: 2017-09-28 12:36:39.683 3958 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:36:39 ctl02 nova-api[3958]: 2017-09-28 12:36:39.684 3958 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:36:39 ctl02 nova-api[3958]: 2017-09-28 12:36:39.684 3958 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:36:39 ctl02 nova-api[3958]: 2017-09-28 12:36:39.820 3958 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:36:39 ctl02 nova-api[3958]: 2017-09-28 12:36:39.823 3958 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:36:39 ctl02 nova-api[3958]: 2017-09-28 12:36:39.823 3958 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:36:39 ctl02 nova-api[3958]: 2017-09-28 12:36:39.823 3958 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:36:39 ctl02 nova-api[3958]: 2017-09-28 12:36:39.826 3958 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:36:39 ctl02 nova-api[3958]: 2017-09-28 12:36:39.827 3958 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:36:39 ctl02 nova-api[3958]: 2017-09-28 12:36:39.827 3958 ERROR nova Traceback (most recent call last):
Sep 28 12:36:39 ctl02 nova-api[3958]: 2017-09-28 12:36:39.827 3958 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:36:39 ctl02 nova-api[3958]: 2017-09-28 12:36:39.827 3958 ERROR nova     sys.exit(main())
Sep 28 12:36:39 ctl02 nova-api[3958]: 2017-09-28 12:36:39.827 3958 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:36:39 ctl02 nova-api[3958]: 2017-09-28 12:36:39.827 3958 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:36:39 ctl02 nova-api[3958]: 2017-09-28 12:36:39.827 3958 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:36:39 ctl02 nova-api[3958]: 2017-09-28 12:36:39.827 3958 ERROR nova     max_url_len=max_url_len)
Sep 28 12:36:39 ctl02 nova-api[3958]: 2017-09-28 12:36:39.827 3958 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:36:39 ctl02 nova-api[3958]: 2017-09-28 12:36:39.827 3958 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:36:39 ctl02 nova-api[3958]: 2017-09-28 12:36:39.827 3958 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:36:39 ctl02 nova-api[3958]: 2017-09-28 12:36:39.827 3958 ERROR nova     sock.listen(backlog)
Sep 28 12:36:39 ctl02 nova-api[3958]: 2017-09-28 12:36:39.827 3958 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:36:39 ctl02 nova-api[3958]: 2017-09-28 12:36:39.827 3958 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:36:39 ctl02 nova-api[3958]: 2017-09-28 12:36:39.827 3958 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:36:39 ctl02 nova-api[3958]: 2017-09-28 12:36:39.827 3958 ERROR nova
Sep 28 12:36:39 ctl02 neutron-server[30536]: 2017-09-28 12:36:39.839 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:36:39] "OPTIONS / HTTP/1.0" 200 262 0.000551
Sep 28 12:36:39 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:36:39 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:36:39 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:36:40 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:36:40 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:36:40 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:36:40 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:36:40 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa47bc15b)
Sep 28 12:36:40 ctl02 neutron-server[30536]: 2017-09-28 12:36:40.526 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:36:40] "OPTIONS / HTTP/1.0" 200 262 0.000477
Sep 28 12:36:41 ctl02 neutron-server[30536]: 2017-09-28 12:36:41.092 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:36:41] "OPTIONS / HTTP/1.0" 200 262 0.000499
Sep 28 12:36:41 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa47bc15b)
Sep 28 12:36:41 ctl02 heat-api-cfn[13300]: 2017-09-28 12:36:41.486 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:36:41] "OPTIONS / HTTP/1.0" 200 134 0.000429
Sep 28 12:36:41 ctl02 glance-api[29183]: 2017-09-28 12:36:41.795 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:36:41] "OPTIONS / HTTP/1.0" 200 134 0.000544
Sep 28 12:36:41 ctl02 nova-api[3976]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:36:41 ctl02 nova-api[3976]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:36:41 ctl02 nova-api[3976]: 2017-09-28 12:36:41.968 3976 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:36:41 ctl02 nova-api[3976]: 2017-09-28 12:36:41.969 3976 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:36:41 ctl02 nova-api[3976]: 2017-09-28 12:36:41.969 3976 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:36:41 ctl02 nova-api[3976]: 2017-09-28 12:36:41.969 3976 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:36:41 ctl02 nova-api[3976]: 2017-09-28 12:36:41.969 3976 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:36:41 ctl02 nova-api[3976]: 2017-09-28 12:36:41.969 3976 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:36:41 ctl02 nova-api[3976]: 2017-09-28 12:36:41.969 3976 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:36:41 ctl02 nova-api[3976]: 2017-09-28 12:36:41.969 3976 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:36:41 ctl02 nova-api[3976]: 2017-09-28 12:36:41.969 3976 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:36:41 ctl02 nova-api[3976]: 2017-09-28 12:36:41.969 3976 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:36:41 ctl02 nova-api[3976]: 2017-09-28 12:36:41.969 3976 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:36:41 ctl02 nova-api[3976]: 2017-09-28 12:36:41.969 3976 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:36:41 ctl02 nova-api[3976]: 2017-09-28 12:36:41.969 3976 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:36:41 ctl02 nova-api[3976]: 2017-09-28 12:36:41.969 3976 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:36:41 ctl02 nova-api[3976]: 2017-09-28 12:36:41.969 3976 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:36:41 ctl02 nova-api[3976]: 2017-09-28 12:36:41.969 3976 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:36:41 ctl02 nova-api[3976]: 2017-09-28 12:36:41.969 3976 ERROR nova.wsgi     self.filename))
Sep 28 12:36:41 ctl02 nova-api[3976]: 2017-09-28 12:36:41.969 3976 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:36:41 ctl02 nova-api[3976]: 2017-09-28 12:36:41.969 3976 ERROR nova.wsgi
Sep 28 12:36:41 ctl02 nova-api[3976]: 2017-09-28 12:36:41.970 3976 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:36:42 ctl02 glance-api[29183]: 2017-09-28 12:36:42.022 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:36:42] "OPTIONS / HTTP/1.0" 200 134 0.000562
Sep 28 12:36:42 ctl02 nova-api[3976]: 2017-09-28 12:36:42.100 3976 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:36:42 ctl02 nova-api[3976]: 2017-09-28 12:36:42.318 3976 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:36:42 ctl02 nova-api[3976]: 2017-09-28 12:36:42.320 3976 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:36:42 ctl02 nova-api[3976]: 2017-09-28 12:36:42.320 3976 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:36:42 ctl02 nova-api[3976]: 2017-09-28 12:36:42.321 3976 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:36:42 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa47bc15b)
Sep 28 12:36:42 ctl02 nova-api[3976]: 2017-09-28 12:36:42.451 3976 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:36:42 ctl02 nova-api[3976]: 2017-09-28 12:36:42.452 3976 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:36:42 ctl02 nova-api[3976]: 2017-09-28 12:36:42.453 3976 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:36:42 ctl02 nova-api[3976]: 2017-09-28 12:36:42.453 3976 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:36:42 ctl02 nova-api[3976]: 2017-09-28 12:36:42.456 3976 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:36:42 ctl02 nova-api[3976]: 2017-09-28 12:36:42.456 3976 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:36:42 ctl02 nova-api[3976]: 2017-09-28 12:36:42.456 3976 ERROR nova Traceback (most recent call last):
Sep 28 12:36:42 ctl02 nova-api[3976]: 2017-09-28 12:36:42.456 3976 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:36:42 ctl02 nova-api[3976]: 2017-09-28 12:36:42.456 3976 ERROR nova     sys.exit(main())
Sep 28 12:36:42 ctl02 nova-api[3976]: 2017-09-28 12:36:42.456 3976 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:36:42 ctl02 nova-api[3976]: 2017-09-28 12:36:42.456 3976 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:36:42 ctl02 nova-api[3976]: 2017-09-28 12:36:42.456 3976 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:36:42 ctl02 nova-api[3976]: 2017-09-28 12:36:42.456 3976 ERROR nova     max_url_len=max_url_len)
Sep 28 12:36:42 ctl02 nova-api[3976]: 2017-09-28 12:36:42.456 3976 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:36:42 ctl02 nova-api[3976]: 2017-09-28 12:36:42.456 3976 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:36:42 ctl02 nova-api[3976]: 2017-09-28 12:36:42.456 3976 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:36:42 ctl02 nova-api[3976]: 2017-09-28 12:36:42.456 3976 ERROR nova     sock.listen(backlog)
Sep 28 12:36:42 ctl02 nova-api[3976]: 2017-09-28 12:36:42.456 3976 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:36:42 ctl02 nova-api[3976]: 2017-09-28 12:36:42.456 3976 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:36:42 ctl02 nova-api[3976]: 2017-09-28 12:36:42.456 3976 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:36:42 ctl02 nova-api[3976]: 2017-09-28 12:36:42.456 3976 ERROR nova
Sep 28 12:36:42 ctl02 glance-api[29183]: 2017-09-28 12:36:42.562 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:36:42] "OPTIONS / HTTP/1.0" 200 134 0.000567
Sep 28 12:36:42 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:36:42 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:36:42 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:36:42 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:36:42 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:36:42 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:36:42 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:36:43 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa47bc15b)
Sep 28 12:36:44 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa47bc15b)
Sep 28 12:36:44 ctl02 nova-api[3994]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:36:44 ctl02 nova-api[3994]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:36:44 ctl02 nova-api[3994]: 2017-09-28 12:36:44.707 3994 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:36:44 ctl02 nova-api[3994]: 2017-09-28 12:36:44.708 3994 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:36:44 ctl02 nova-api[3994]: 2017-09-28 12:36:44.708 3994 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:36:44 ctl02 nova-api[3994]: 2017-09-28 12:36:44.708 3994 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:36:44 ctl02 nova-api[3994]: 2017-09-28 12:36:44.708 3994 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:36:44 ctl02 nova-api[3994]: 2017-09-28 12:36:44.708 3994 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:36:44 ctl02 nova-api[3994]: 2017-09-28 12:36:44.708 3994 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:36:44 ctl02 nova-api[3994]: 2017-09-28 12:36:44.708 3994 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:36:44 ctl02 nova-api[3994]: 2017-09-28 12:36:44.708 3994 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:36:44 ctl02 nova-api[3994]: 2017-09-28 12:36:44.708 3994 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:36:44 ctl02 nova-api[3994]: 2017-09-28 12:36:44.708 3994 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:36:44 ctl02 nova-api[3994]: 2017-09-28 12:36:44.708 3994 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:36:44 ctl02 nova-api[3994]: 2017-09-28 12:36:44.708 3994 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:36:44 ctl02 nova-api[3994]: 2017-09-28 12:36:44.708 3994 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:36:44 ctl02 nova-api[3994]: 2017-09-28 12:36:44.708 3994 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:36:44 ctl02 nova-api[3994]: 2017-09-28 12:36:44.708 3994 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:36:44 ctl02 nova-api[3994]: 2017-09-28 12:36:44.708 3994 ERROR nova.wsgi     self.filename))
Sep 28 12:36:44 ctl02 nova-api[3994]: 2017-09-28 12:36:44.708 3994 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:36:44 ctl02 nova-api[3994]: 2017-09-28 12:36:44.708 3994 ERROR nova.wsgi
Sep 28 12:36:44 ctl02 nova-api[3994]: 2017-09-28 12:36:44.709 3994 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:36:44 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:36:44.764 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:36:44] "OPTIONS / HTTP/1.0" 200 134 0.000366
Sep 28 12:36:44 ctl02 nova-api[3994]: 2017-09-28 12:36:44.835 3994 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:36:45 ctl02 nova-api[3994]: 2017-09-28 12:36:45.058 3994 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:36:45 ctl02 nova-api[3994]: 2017-09-28 12:36:45.060 3994 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:36:45 ctl02 nova-api[3994]: 2017-09-28 12:36:45.060 3994 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:36:45 ctl02 nova-api[3994]: 2017-09-28 12:36:45.061 3994 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:36:45 ctl02 nova-api[3994]: 2017-09-28 12:36:45.191 3994 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:36:45 ctl02 nova-api[3994]: 2017-09-28 12:36:45.193 3994 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:36:45 ctl02 nova-api[3994]: 2017-09-28 12:36:45.193 3994 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:36:45 ctl02 nova-api[3994]: 2017-09-28 12:36:45.194 3994 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:36:45 ctl02 nova-api[3994]: 2017-09-28 12:36:45.197 3994 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:36:45 ctl02 nova-api[3994]: 2017-09-28 12:36:45.197 3994 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:36:45 ctl02 nova-api[3994]: 2017-09-28 12:36:45.197 3994 ERROR nova Traceback (most recent call last):
Sep 28 12:36:45 ctl02 nova-api[3994]: 2017-09-28 12:36:45.197 3994 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:36:45 ctl02 nova-api[3994]: 2017-09-28 12:36:45.197 3994 ERROR nova     sys.exit(main())
Sep 28 12:36:45 ctl02 nova-api[3994]: 2017-09-28 12:36:45.197 3994 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:36:45 ctl02 nova-api[3994]: 2017-09-28 12:36:45.197 3994 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:36:45 ctl02 nova-api[3994]: 2017-09-28 12:36:45.197 3994 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:36:45 ctl02 nova-api[3994]: 2017-09-28 12:36:45.197 3994 ERROR nova     max_url_len=max_url_len)
Sep 28 12:36:45 ctl02 nova-api[3994]: 2017-09-28 12:36:45.197 3994 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:36:45 ctl02 nova-api[3994]: 2017-09-28 12:36:45.197 3994 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:36:45 ctl02 nova-api[3994]: 2017-09-28 12:36:45.197 3994 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:36:45 ctl02 nova-api[3994]: 2017-09-28 12:36:45.197 3994 ERROR nova     sock.listen(backlog)
Sep 28 12:36:45 ctl02 nova-api[3994]: 2017-09-28 12:36:45.197 3994 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:36:45 ctl02 nova-api[3994]: 2017-09-28 12:36:45.197 3994 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:36:45 ctl02 nova-api[3994]: 2017-09-28 12:36:45.197 3994 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:36:45 ctl02 nova-api[3994]: 2017-09-28 12:36:45.197 3994 ERROR nova
Sep 28 12:36:45 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa47bc15b)
Sep 28 12:36:45 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:36:45 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:36:45 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:36:45 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:36:45 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:36:45 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:36:45 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:36:45.643 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:36:45] "OPTIONS / HTTP/1.0" 200 134 0.000550
Sep 28 12:36:45 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:36:45 ctl02 heat-api[13008]: 2017-09-28 12:36:45.826 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:36:45] "OPTIONS / HTTP/1.0" 200 134 0.000508
Sep 28 12:36:46 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa47bc15b)
Sep 28 12:36:47 ctl02 heat-api[13008]: 2017-09-28 12:36:47.259 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:36:47] "OPTIONS / HTTP/1.0" 200 134 0.000526
Sep 28 12:36:47 ctl02 nova-api[4012]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:36:47 ctl02 nova-api[4012]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:36:47 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa47bc15b)
Sep 28 12:36:47 ctl02 nova-api[4012]: 2017-09-28 12:36:47.460 4012 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:36:47 ctl02 nova-api[4012]: 2017-09-28 12:36:47.461 4012 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:36:47 ctl02 nova-api[4012]: 2017-09-28 12:36:47.461 4012 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:36:47 ctl02 nova-api[4012]: 2017-09-28 12:36:47.461 4012 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:36:47 ctl02 nova-api[4012]: 2017-09-28 12:36:47.461 4012 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:36:47 ctl02 nova-api[4012]: 2017-09-28 12:36:47.461 4012 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:36:47 ctl02 nova-api[4012]: 2017-09-28 12:36:47.461 4012 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:36:47 ctl02 nova-api[4012]: 2017-09-28 12:36:47.461 4012 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:36:47 ctl02 nova-api[4012]: 2017-09-28 12:36:47.461 4012 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:36:47 ctl02 nova-api[4012]: 2017-09-28 12:36:47.461 4012 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:36:47 ctl02 nova-api[4012]: 2017-09-28 12:36:47.461 4012 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:36:47 ctl02 nova-api[4012]: 2017-09-28 12:36:47.461 4012 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:36:47 ctl02 nova-api[4012]: 2017-09-28 12:36:47.461 4012 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:36:47 ctl02 nova-api[4012]: 2017-09-28 12:36:47.461 4012 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:36:47 ctl02 nova-api[4012]: 2017-09-28 12:36:47.461 4012 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:36:47 ctl02 nova-api[4012]: 2017-09-28 12:36:47.461 4012 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:36:47 ctl02 nova-api[4012]: 2017-09-28 12:36:47.461 4012 ERROR nova.wsgi     self.filename))
Sep 28 12:36:47 ctl02 nova-api[4012]: 2017-09-28 12:36:47.461 4012 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:36:47 ctl02 nova-api[4012]: 2017-09-28 12:36:47.461 4012 ERROR nova.wsgi
Sep 28 12:36:47 ctl02 nova-api[4012]: 2017-09-28 12:36:47.462 4012 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:36:47 ctl02 nova-api[4012]: 2017-09-28 12:36:47.589 4012 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:36:47 ctl02 nova-api[4012]: 2017-09-28 12:36:47.807 4012 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:36:47 ctl02 nova-api[4012]: 2017-09-28 12:36:47.809 4012 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:36:47 ctl02 nova-api[4012]: 2017-09-28 12:36:47.809 4012 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:36:47 ctl02 nova-api[4012]: 2017-09-28 12:36:47.809 4012 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:36:47 ctl02 nova-api[4012]: 2017-09-28 12:36:47.938 4012 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:36:47 ctl02 nova-api[4012]: 2017-09-28 12:36:47.940 4012 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:36:47 ctl02 nova-api[4012]: 2017-09-28 12:36:47.940 4012 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:36:47 ctl02 nova-api[4012]: 2017-09-28 12:36:47.941 4012 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:36:47 ctl02 nova-api[4012]: 2017-09-28 12:36:47.944 4012 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:36:47 ctl02 nova-api[4012]: 2017-09-28 12:36:47.944 4012 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:36:47 ctl02 nova-api[4012]: 2017-09-28 12:36:47.944 4012 ERROR nova Traceback (most recent call last):
Sep 28 12:36:47 ctl02 nova-api[4012]: 2017-09-28 12:36:47.944 4012 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:36:47 ctl02 nova-api[4012]: 2017-09-28 12:36:47.944 4012 ERROR nova     sys.exit(main())
Sep 28 12:36:47 ctl02 nova-api[4012]: 2017-09-28 12:36:47.944 4012 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:36:47 ctl02 nova-api[4012]: 2017-09-28 12:36:47.944 4012 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:36:47 ctl02 nova-api[4012]: 2017-09-28 12:36:47.944 4012 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:36:47 ctl02 nova-api[4012]: 2017-09-28 12:36:47.944 4012 ERROR nova     max_url_len=max_url_len)
Sep 28 12:36:47 ctl02 nova-api[4012]: 2017-09-28 12:36:47.944 4012 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:36:47 ctl02 nova-api[4012]: 2017-09-28 12:36:47.944 4012 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:36:47 ctl02 nova-api[4012]: 2017-09-28 12:36:47.944 4012 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:36:47 ctl02 nova-api[4012]: 2017-09-28 12:36:47.944 4012 ERROR nova     sock.listen(backlog)
Sep 28 12:36:47 ctl02 nova-api[4012]: 2017-09-28 12:36:47.944 4012 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:36:47 ctl02 nova-api[4012]: 2017-09-28 12:36:47.944 4012 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:36:47 ctl02 nova-api[4012]: 2017-09-28 12:36:47.944 4012 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:36:47 ctl02 nova-api[4012]: 2017-09-28 12:36:47.944 4012 ERROR nova
Sep 28 12:36:48 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:36:48 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:36:48 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:36:48 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:36:48 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:36:48 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:36:48 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:36:48 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:36:48 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:36:48 ctl02 heat-api-cfn[13300]: 2017-09-28 12:36:48.447 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:36:48] "OPTIONS / HTTP/1.0" 200 134 0.000516
Sep 28 12:36:48 ctl02 heat-api-cfn[13300]: 2017-09-28 12:36:48.876 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:36:48] "OPTIONS / HTTP/1.0" 200 134 0.000463
Sep 28 12:36:49 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:36:49.377 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:36:49] "OPTIONS / HTTP/1.0" 200 134 0.000382
Sep 28 12:36:49 ctl02 heat-api[13008]: 2017-09-28 12:36:49.451 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:36:49] "OPTIONS / HTTP/1.0" 200 134 0.000518
Sep 28 12:36:50 ctl02 nova-api[4035]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:36:50 ctl02 nova-api[4035]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:36:50 ctl02 neutron-server[30536]: 2017-09-28 12:36:50.114 30605 WARNING oslo_messaging._drivers.amqpdriver [req-b6db2397-9bac-44da-a837-fcff46e847a1 - - - - -] reply_692b03e6d8d44d758b6be19b067c3aa3 doesn't exists, drop reply to e2cffe668e01417082e47b957e072727
Sep 28 12:36:50 ctl02 neutron-server[30536]: 2017-09-28 12:36:50.211 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:36:50] "OPTIONS / HTTP/1.0" 200 262 0.000448
Sep 28 12:36:50 ctl02 nova-api[4035]: 2017-09-28 12:36:50.243 4035 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:36:50 ctl02 nova-api[4035]: 2017-09-28 12:36:50.244 4035 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:36:50 ctl02 nova-api[4035]: 2017-09-28 12:36:50.244 4035 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:36:50 ctl02 nova-api[4035]: 2017-09-28 12:36:50.244 4035 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:36:50 ctl02 nova-api[4035]: 2017-09-28 12:36:50.244 4035 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:36:50 ctl02 nova-api[4035]: 2017-09-28 12:36:50.244 4035 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:36:50 ctl02 nova-api[4035]: 2017-09-28 12:36:50.244 4035 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:36:50 ctl02 nova-api[4035]: 2017-09-28 12:36:50.244 4035 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:36:50 ctl02 nova-api[4035]: 2017-09-28 12:36:50.244 4035 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:36:50 ctl02 nova-api[4035]: 2017-09-28 12:36:50.244 4035 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:36:50 ctl02 nova-api[4035]: 2017-09-28 12:36:50.244 4035 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:36:50 ctl02 nova-api[4035]: 2017-09-28 12:36:50.244 4035 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:36:50 ctl02 nova-api[4035]: 2017-09-28 12:36:50.244 4035 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:36:50 ctl02 nova-api[4035]: 2017-09-28 12:36:50.244 4035 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:36:50 ctl02 nova-api[4035]: 2017-09-28 12:36:50.244 4035 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:36:50 ctl02 nova-api[4035]: 2017-09-28 12:36:50.244 4035 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:36:50 ctl02 nova-api[4035]: 2017-09-28 12:36:50.244 4035 ERROR nova.wsgi     self.filename))
Sep 28 12:36:50 ctl02 nova-api[4035]: 2017-09-28 12:36:50.244 4035 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:36:50 ctl02 nova-api[4035]: 2017-09-28 12:36:50.244 4035 ERROR nova.wsgi
Sep 28 12:36:50 ctl02 nova-api[4035]: 2017-09-28 12:36:50.245 4035 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:36:50 ctl02 neutron-server[30536]: 2017-09-28 12:36:50.324 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:36:50] "OPTIONS / HTTP/1.0" 200 262 0.000514
Sep 28 12:36:50 ctl02 nova-api[4035]: 2017-09-28 12:36:50.373 4035 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:36:50 ctl02 nova-api[4035]: 2017-09-28 12:36:50.595 4035 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:36:50 ctl02 nova-api[4035]: 2017-09-28 12:36:50.597 4035 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:36:50 ctl02 nova-api[4035]: 2017-09-28 12:36:50.597 4035 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:36:50 ctl02 nova-api[4035]: 2017-09-28 12:36:50.598 4035 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:36:50 ctl02 nova-api[4035]: 2017-09-28 12:36:50.726 4035 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:36:50 ctl02 nova-api[4035]: 2017-09-28 12:36:50.728 4035 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:36:50 ctl02 nova-api[4035]: 2017-09-28 12:36:50.728 4035 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:36:50 ctl02 nova-api[4035]: 2017-09-28 12:36:50.729 4035 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:36:50 ctl02 nova-api[4035]: 2017-09-28 12:36:50.732 4035 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:36:50 ctl02 nova-api[4035]: 2017-09-28 12:36:50.732 4035 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:36:50 ctl02 nova-api[4035]: 2017-09-28 12:36:50.732 4035 ERROR nova Traceback (most recent call last):
Sep 28 12:36:50 ctl02 nova-api[4035]: 2017-09-28 12:36:50.732 4035 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:36:50 ctl02 nova-api[4035]: 2017-09-28 12:36:50.732 4035 ERROR nova     sys.exit(main())
Sep 28 12:36:50 ctl02 nova-api[4035]: 2017-09-28 12:36:50.732 4035 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:36:50 ctl02 nova-api[4035]: 2017-09-28 12:36:50.732 4035 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:36:50 ctl02 nova-api[4035]: 2017-09-28 12:36:50.732 4035 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:36:50 ctl02 nova-api[4035]: 2017-09-28 12:36:50.732 4035 ERROR nova     max_url_len=max_url_len)
Sep 28 12:36:50 ctl02 nova-api[4035]: 2017-09-28 12:36:50.732 4035 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:36:50 ctl02 nova-api[4035]: 2017-09-28 12:36:50.732 4035 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:36:50 ctl02 nova-api[4035]: 2017-09-28 12:36:50.732 4035 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:36:50 ctl02 nova-api[4035]: 2017-09-28 12:36:50.732 4035 ERROR nova     sock.listen(backlog)
Sep 28 12:36:50 ctl02 nova-api[4035]: 2017-09-28 12:36:50.732 4035 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:36:50 ctl02 nova-api[4035]: 2017-09-28 12:36:50.732 4035 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:36:50 ctl02 nova-api[4035]: 2017-09-28 12:36:50.732 4035 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:36:50 ctl02 nova-api[4035]: 2017-09-28 12:36:50.732 4035 ERROR nova
Sep 28 12:36:50 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:36:50 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:36:50 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:36:51 ctl02 neutron-server[30536]: 2017-09-28 12:36:51.012 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:36:51] "OPTIONS / HTTP/1.0" 200 262 0.000518
Sep 28 12:36:51 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:36:51 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:36:51 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:36:51 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:36:51 ctl02 neutron-server[30536]: 2017-09-28 12:36:51.354 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 1 dead agents out of 6:
Sep 28 12:36:51 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:36:51 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:35:06 cmp002
Sep 28 12:36:51 ctl02 heat-api-cfn[13300]: 2017-09-28 12:36:51.688 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:36:51] "OPTIONS / HTTP/1.0" 200 134 0.000403
Sep 28 12:36:51 ctl02 glance-api[29183]: 2017-09-28 12:36:51.811 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:36:51] "OPTIONS / HTTP/1.0" 200 134 0.000568
Sep 28 12:36:52 ctl02 glance-api[29183]: 2017-09-28 12:36:52.266 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:36:52] "OPTIONS / HTTP/1.0" 200 134 0.000528
Sep 28 12:36:52 ctl02 glance-api[29183]: 2017-09-28 12:36:52.344 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:36:52] "OPTIONS / HTTP/1.0" 200 134 0.000417
Sep 28 12:36:52 ctl02 nova-api[4053]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:36:52 ctl02 nova-api[4053]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:36:52 ctl02 nova-api[4053]: 2017-09-28 12:36:52.973 4053 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:36:52 ctl02 nova-api[4053]: 2017-09-28 12:36:52.975 4053 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:36:52 ctl02 nova-api[4053]: 2017-09-28 12:36:52.975 4053 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:36:52 ctl02 nova-api[4053]: 2017-09-28 12:36:52.975 4053 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:36:52 ctl02 nova-api[4053]: 2017-09-28 12:36:52.975 4053 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:36:52 ctl02 nova-api[4053]: 2017-09-28 12:36:52.975 4053 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:36:52 ctl02 nova-api[4053]: 2017-09-28 12:36:52.975 4053 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:36:52 ctl02 nova-api[4053]: 2017-09-28 12:36:52.975 4053 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:36:52 ctl02 nova-api[4053]: 2017-09-28 12:36:52.975 4053 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:36:52 ctl02 nova-api[4053]: 2017-09-28 12:36:52.975 4053 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:36:52 ctl02 nova-api[4053]: 2017-09-28 12:36:52.975 4053 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:36:52 ctl02 nova-api[4053]: 2017-09-28 12:36:52.975 4053 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:36:52 ctl02 nova-api[4053]: 2017-09-28 12:36:52.975 4053 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:36:52 ctl02 nova-api[4053]: 2017-09-28 12:36:52.975 4053 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:36:52 ctl02 nova-api[4053]: 2017-09-28 12:36:52.975 4053 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:36:52 ctl02 nova-api[4053]: 2017-09-28 12:36:52.975 4053 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:36:52 ctl02 nova-api[4053]: 2017-09-28 12:36:52.975 4053 ERROR nova.wsgi     self.filename))
Sep 28 12:36:52 ctl02 nova-api[4053]: 2017-09-28 12:36:52.975 4053 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:36:52 ctl02 nova-api[4053]: 2017-09-28 12:36:52.975 4053 ERROR nova.wsgi
Sep 28 12:36:52 ctl02 nova-api[4053]: 2017-09-28 12:36:52.977 4053 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:36:53 ctl02 nova-api[4053]: 2017-09-28 12:36:53.104 4053 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:36:53 ctl02 nova-api[4053]: 2017-09-28 12:36:53.330 4053 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:36:53 ctl02 nova-api[4053]: 2017-09-28 12:36:53.333 4053 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:36:53 ctl02 nova-api[4053]: 2017-09-28 12:36:53.333 4053 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:36:53 ctl02 nova-api[4053]: 2017-09-28 12:36:53.334 4053 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:36:53 ctl02 nova-api[4053]: 2017-09-28 12:36:53.465 4053 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:36:53 ctl02 nova-api[4053]: 2017-09-28 12:36:53.468 4053 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:36:53 ctl02 nova-api[4053]: 2017-09-28 12:36:53.468 4053 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:36:53 ctl02 nova-api[4053]: 2017-09-28 12:36:53.468 4053 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:36:53 ctl02 nova-api[4053]: 2017-09-28 12:36:53.472 4053 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:36:53 ctl02 nova-api[4053]: 2017-09-28 12:36:53.472 4053 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:36:53 ctl02 nova-api[4053]: 2017-09-28 12:36:53.472 4053 ERROR nova Traceback (most recent call last):
Sep 28 12:36:53 ctl02 nova-api[4053]: 2017-09-28 12:36:53.472 4053 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:36:53 ctl02 nova-api[4053]: 2017-09-28 12:36:53.472 4053 ERROR nova     sys.exit(main())
Sep 28 12:36:53 ctl02 nova-api[4053]: 2017-09-28 12:36:53.472 4053 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:36:53 ctl02 nova-api[4053]: 2017-09-28 12:36:53.472 4053 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:36:53 ctl02 nova-api[4053]: 2017-09-28 12:36:53.472 4053 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:36:53 ctl02 nova-api[4053]: 2017-09-28 12:36:53.472 4053 ERROR nova     max_url_len=max_url_len)
Sep 28 12:36:53 ctl02 nova-api[4053]: 2017-09-28 12:36:53.472 4053 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:36:53 ctl02 nova-api[4053]: 2017-09-28 12:36:53.472 4053 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:36:53 ctl02 nova-api[4053]: 2017-09-28 12:36:53.472 4053 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:36:53 ctl02 nova-api[4053]: 2017-09-28 12:36:53.472 4053 ERROR nova     sock.listen(backlog)
Sep 28 12:36:53 ctl02 nova-api[4053]: 2017-09-28 12:36:53.472 4053 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:36:53 ctl02 nova-api[4053]: 2017-09-28 12:36:53.472 4053 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:36:53 ctl02 nova-api[4053]: 2017-09-28 12:36:53.472 4053 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:36:53 ctl02 nova-api[4053]: 2017-09-28 12:36:53.472 4053 ERROR nova
Sep 28 12:36:53 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:36:53 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:36:53 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:36:53 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:36:53 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:36:53 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:36:53 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:36:54 ctl02 nova-cert[4860]: 2017-09-28 12:36:54.205 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:36:54 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:36:54.463 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:36:54] "OPTIONS / HTTP/1.0" 200 134 0.000373
Sep 28 12:36:54 ctl02 nova-conductor[5056]: 2017-09-28 12:36:54.843 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:36:54 ctl02 nova-conductor[5056]: 2017-09-28 12:36:54.866 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:36:54 ctl02 nova-conductor[5056]: 2017-09-28 12:36:54.873 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:36:54 ctl02 nova-conductor[5056]: 2017-09-28 12:36:54.878 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:36:55 ctl02 nova-api[4071]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:36:55 ctl02 nova-api[4071]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:36:55 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:36:55.696 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:36:55] "OPTIONS / HTTP/1.0" 200 134 0.000431
Sep 28 12:36:55 ctl02 heat-api[13008]: 2017-09-28 12:36:55.709 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:36:55] "OPTIONS / HTTP/1.0" 200 134 0.000558
Sep 28 12:36:55 ctl02 nova-api[4071]: 2017-09-28 12:36:55.770 4071 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:36:55 ctl02 nova-api[4071]: 2017-09-28 12:36:55.771 4071 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:36:55 ctl02 nova-api[4071]: 2017-09-28 12:36:55.771 4071 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:36:55 ctl02 nova-api[4071]: 2017-09-28 12:36:55.771 4071 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:36:55 ctl02 nova-api[4071]: 2017-09-28 12:36:55.771 4071 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:36:55 ctl02 nova-api[4071]: 2017-09-28 12:36:55.771 4071 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:36:55 ctl02 nova-api[4071]: 2017-09-28 12:36:55.771 4071 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:36:55 ctl02 nova-api[4071]: 2017-09-28 12:36:55.771 4071 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:36:55 ctl02 nova-api[4071]: 2017-09-28 12:36:55.771 4071 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:36:55 ctl02 nova-api[4071]: 2017-09-28 12:36:55.771 4071 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:36:55 ctl02 nova-api[4071]: 2017-09-28 12:36:55.771 4071 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:36:55 ctl02 nova-api[4071]: 2017-09-28 12:36:55.771 4071 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:36:55 ctl02 nova-api[4071]: 2017-09-28 12:36:55.771 4071 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:36:55 ctl02 nova-api[4071]: 2017-09-28 12:36:55.771 4071 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:36:55 ctl02 nova-api[4071]: 2017-09-28 12:36:55.771 4071 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:36:55 ctl02 nova-api[4071]: 2017-09-28 12:36:55.771 4071 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:36:55 ctl02 nova-api[4071]: 2017-09-28 12:36:55.771 4071 ERROR nova.wsgi     self.filename))
Sep 28 12:36:55 ctl02 nova-api[4071]: 2017-09-28 12:36:55.771 4071 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:36:55 ctl02 nova-api[4071]: 2017-09-28 12:36:55.771 4071 ERROR nova.wsgi
Sep 28 12:36:55 ctl02 nova-api[4071]: 2017-09-28 12:36:55.772 4071 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:36:55 ctl02 nova-api[4071]: 2017-09-28 12:36:55.903 4071 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:36:56 ctl02 nova-api[4071]: 2017-09-28 12:36:56.138 4071 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:36:56 ctl02 nova-api[4071]: 2017-09-28 12:36:56.140 4071 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:36:56 ctl02 nova-api[4071]: 2017-09-28 12:36:56.141 4071 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:36:56 ctl02 nova-api[4071]: 2017-09-28 12:36:56.141 4071 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:36:56 ctl02 nova-api[4071]: 2017-09-28 12:36:56.270 4071 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:36:56 ctl02 nova-api[4071]: 2017-09-28 12:36:56.272 4071 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:36:56 ctl02 nova-api[4071]: 2017-09-28 12:36:56.272 4071 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:36:56 ctl02 nova-api[4071]: 2017-09-28 12:36:56.273 4071 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:36:56 ctl02 nova-api[4071]: 2017-09-28 12:36:56.276 4071 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:36:56 ctl02 nova-api[4071]: 2017-09-28 12:36:56.276 4071 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:36:56 ctl02 nova-api[4071]: 2017-09-28 12:36:56.276 4071 ERROR nova Traceback (most recent call last):
Sep 28 12:36:56 ctl02 nova-api[4071]: 2017-09-28 12:36:56.276 4071 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:36:56 ctl02 nova-api[4071]: 2017-09-28 12:36:56.276 4071 ERROR nova     sys.exit(main())
Sep 28 12:36:56 ctl02 nova-api[4071]: 2017-09-28 12:36:56.276 4071 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:36:56 ctl02 nova-api[4071]: 2017-09-28 12:36:56.276 4071 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:36:56 ctl02 nova-api[4071]: 2017-09-28 12:36:56.276 4071 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:36:56 ctl02 nova-api[4071]: 2017-09-28 12:36:56.276 4071 ERROR nova     max_url_len=max_url_len)
Sep 28 12:36:56 ctl02 nova-api[4071]: 2017-09-28 12:36:56.276 4071 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:36:56 ctl02 nova-api[4071]: 2017-09-28 12:36:56.276 4071 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:36:56 ctl02 nova-api[4071]: 2017-09-28 12:36:56.276 4071 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:36:56 ctl02 nova-api[4071]: 2017-09-28 12:36:56.276 4071 ERROR nova     sock.listen(backlog)
Sep 28 12:36:56 ctl02 nova-api[4071]: 2017-09-28 12:36:56.276 4071 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:36:56 ctl02 nova-api[4071]: 2017-09-28 12:36:56.276 4071 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:36:56 ctl02 nova-api[4071]: 2017-09-28 12:36:56.276 4071 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:36:56 ctl02 nova-api[4071]: 2017-09-28 12:36:56.276 4071 ERROR nova
Sep 28 12:36:56 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:36:56 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:36:56 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:36:56 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:36:56 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:36:56 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:36:56 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:36:57 ctl02 heat-api[13008]: 2017-09-28 12:36:57.392 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:36:57] "OPTIONS / HTTP/1.0" 200 134 0.000615
Sep 28 12:36:58 ctl02 heat-api-cfn[13300]: 2017-09-28 12:36:58.099 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:36:58] "OPTIONS / HTTP/1.0" 200 134 0.000441
Sep 28 12:36:58 ctl02 nova-api[4089]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:36:58 ctl02 nova-api[4089]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:36:58 ctl02 nova-api[4089]: 2017-09-28 12:36:58.474 4089 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:36:58 ctl02 nova-api[4089]: 2017-09-28 12:36:58.475 4089 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:36:58 ctl02 nova-api[4089]: 2017-09-28 12:36:58.475 4089 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:36:58 ctl02 nova-api[4089]: 2017-09-28 12:36:58.475 4089 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:36:58 ctl02 nova-api[4089]: 2017-09-28 12:36:58.475 4089 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:36:58 ctl02 nova-api[4089]: 2017-09-28 12:36:58.475 4089 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:36:58 ctl02 nova-api[4089]: 2017-09-28 12:36:58.475 4089 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:36:58 ctl02 nova-api[4089]: 2017-09-28 12:36:58.475 4089 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:36:58 ctl02 nova-api[4089]: 2017-09-28 12:36:58.475 4089 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:36:58 ctl02 nova-api[4089]: 2017-09-28 12:36:58.475 4089 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:36:58 ctl02 nova-api[4089]: 2017-09-28 12:36:58.475 4089 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:36:58 ctl02 nova-api[4089]: 2017-09-28 12:36:58.475 4089 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:36:58 ctl02 nova-api[4089]: 2017-09-28 12:36:58.475 4089 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:36:58 ctl02 nova-api[4089]: 2017-09-28 12:36:58.475 4089 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:36:58 ctl02 nova-api[4089]: 2017-09-28 12:36:58.475 4089 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:36:58 ctl02 nova-api[4089]: 2017-09-28 12:36:58.475 4089 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:36:58 ctl02 nova-api[4089]: 2017-09-28 12:36:58.475 4089 ERROR nova.wsgi     self.filename))
Sep 28 12:36:58 ctl02 nova-api[4089]: 2017-09-28 12:36:58.475 4089 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:36:58 ctl02 nova-api[4089]: 2017-09-28 12:36:58.475 4089 ERROR nova.wsgi
Sep 28 12:36:58 ctl02 nova-api[4089]: 2017-09-28 12:36:58.478 4089 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:36:58 ctl02 nova-api[4089]: 2017-09-28 12:36:58.608 4089 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:36:58 ctl02 nova-api[4089]: 2017-09-28 12:36:58.859 4089 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:36:58 ctl02 nova-api[4089]: 2017-09-28 12:36:58.862 4089 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:36:58 ctl02 nova-api[4089]: 2017-09-28 12:36:58.862 4089 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:36:58 ctl02 nova-api[4089]: 2017-09-28 12:36:58.863 4089 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:36:58 ctl02 nova-api[4089]: 2017-09-28 12:36:58.997 4089 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:36:59 ctl02 nova-api[4089]: 2017-09-28 12:36:59.000 4089 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:36:59 ctl02 nova-api[4089]: 2017-09-28 12:36:59.000 4089 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:36:59 ctl02 nova-api[4089]: 2017-09-28 12:36:59.000 4089 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:36:59 ctl02 nova-api[4089]: 2017-09-28 12:36:59.004 4089 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:36:59 ctl02 nova-api[4089]: 2017-09-28 12:36:59.004 4089 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:36:59 ctl02 nova-api[4089]: 2017-09-28 12:36:59.004 4089 ERROR nova Traceback (most recent call last):
Sep 28 12:36:59 ctl02 nova-api[4089]: 2017-09-28 12:36:59.004 4089 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:36:59 ctl02 nova-api[4089]: 2017-09-28 12:36:59.004 4089 ERROR nova     sys.exit(main())
Sep 28 12:36:59 ctl02 nova-api[4089]: 2017-09-28 12:36:59.004 4089 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:36:59 ctl02 nova-api[4089]: 2017-09-28 12:36:59.004 4089 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:36:59 ctl02 nova-api[4089]: 2017-09-28 12:36:59.004 4089 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:36:59 ctl02 nova-api[4089]: 2017-09-28 12:36:59.004 4089 ERROR nova     max_url_len=max_url_len)
Sep 28 12:36:59 ctl02 nova-api[4089]: 2017-09-28 12:36:59.004 4089 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:36:59 ctl02 nova-api[4089]: 2017-09-28 12:36:59.004 4089 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:36:59 ctl02 nova-api[4089]: 2017-09-28 12:36:59.004 4089 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:36:59 ctl02 nova-api[4089]: 2017-09-28 12:36:59.004 4089 ERROR nova     sock.listen(backlog)
Sep 28 12:36:59 ctl02 nova-api[4089]: 2017-09-28 12:36:59.004 4089 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:36:59 ctl02 nova-api[4089]: 2017-09-28 12:36:59.004 4089 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:36:59 ctl02 nova-api[4089]: 2017-09-28 12:36:59.004 4089 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:36:59 ctl02 nova-api[4089]: 2017-09-28 12:36:59.004 4089 ERROR nova
Sep 28 12:36:59 ctl02 heat-api-cfn[13300]: 2017-09-28 12:36:59.105 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:36:59] "OPTIONS / HTTP/1.0" 200 134 0.000489
Sep 28 12:36:59 ctl02 heat-api[13008]: 2017-09-28 12:36:59.127 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:36:59] "OPTIONS / HTTP/1.0" 200 134 0.000615
Sep 28 12:36:59 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:36:59 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:36:59 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:36:59 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:36:59 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:36:59 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:36:59 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:36:59 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:36:59.398 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:36:59] "OPTIONS / HTTP/1.0" 200 134 0.000517
Sep 28 12:37:00 ctl02 neutron-server[30536]: 2017-09-28 12:37:00.005 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:37:00] "OPTIONS / HTTP/1.0" 200 262 0.000606
Sep 28 12:37:00 ctl02 neutron-server[30536]: 2017-09-28 12:37:00.359 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:37:00] "OPTIONS / HTTP/1.0" 200 262 0.000553
Sep 28 12:37:01 ctl02 nova-api[4107]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:37:01 ctl02 nova-api[4107]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:37:01 ctl02 neutron-server[30536]: 2017-09-28 12:37:01.175 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:37:01] "OPTIONS / HTTP/1.0" 200 262 0.000475
Sep 28 12:37:01 ctl02 nova-api[4107]: 2017-09-28 12:37:01.258 4107 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:37:01 ctl02 nova-api[4107]: 2017-09-28 12:37:01.259 4107 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:37:01 ctl02 nova-api[4107]: 2017-09-28 12:37:01.259 4107 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:37:01 ctl02 nova-api[4107]: 2017-09-28 12:37:01.259 4107 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:37:01 ctl02 nova-api[4107]: 2017-09-28 12:37:01.259 4107 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:37:01 ctl02 nova-api[4107]: 2017-09-28 12:37:01.259 4107 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:37:01 ctl02 nova-api[4107]: 2017-09-28 12:37:01.259 4107 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:37:01 ctl02 nova-api[4107]: 2017-09-28 12:37:01.259 4107 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:37:01 ctl02 nova-api[4107]: 2017-09-28 12:37:01.259 4107 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:37:01 ctl02 nova-api[4107]: 2017-09-28 12:37:01.259 4107 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:37:01 ctl02 nova-api[4107]: 2017-09-28 12:37:01.259 4107 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:37:01 ctl02 nova-api[4107]: 2017-09-28 12:37:01.259 4107 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:37:01 ctl02 nova-api[4107]: 2017-09-28 12:37:01.259 4107 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:37:01 ctl02 nova-api[4107]: 2017-09-28 12:37:01.259 4107 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:37:01 ctl02 nova-api[4107]: 2017-09-28 12:37:01.259 4107 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:37:01 ctl02 nova-api[4107]: 2017-09-28 12:37:01.259 4107 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:37:01 ctl02 nova-api[4107]: 2017-09-28 12:37:01.259 4107 ERROR nova.wsgi     self.filename))
Sep 28 12:37:01 ctl02 nova-api[4107]: 2017-09-28 12:37:01.259 4107 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:37:01 ctl02 nova-api[4107]: 2017-09-28 12:37:01.259 4107 ERROR nova.wsgi
Sep 28 12:37:01 ctl02 nova-api[4107]: 2017-09-28 12:37:01.260 4107 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:37:01 ctl02 nova-api[4107]: 2017-09-28 12:37:01.387 4107 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:37:01 ctl02 nova-api[4107]: 2017-09-28 12:37:01.609 4107 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:37:01 ctl02 nova-api[4107]: 2017-09-28 12:37:01.612 4107 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:37:01 ctl02 nova-api[4107]: 2017-09-28 12:37:01.612 4107 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:37:01 ctl02 nova-api[4107]: 2017-09-28 12:37:01.612 4107 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:37:01 ctl02 nova-api[4107]: 2017-09-28 12:37:01.745 4107 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:37:01 ctl02 nova-api[4107]: 2017-09-28 12:37:01.747 4107 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:37:01 ctl02 nova-api[4107]: 2017-09-28 12:37:01.747 4107 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:37:01 ctl02 nova-api[4107]: 2017-09-28 12:37:01.747 4107 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:37:01 ctl02 nova-api[4107]: 2017-09-28 12:37:01.750 4107 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:37:01 ctl02 nova-api[4107]: 2017-09-28 12:37:01.751 4107 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:37:01 ctl02 nova-api[4107]: 2017-09-28 12:37:01.751 4107 ERROR nova Traceback (most recent call last):
Sep 28 12:37:01 ctl02 nova-api[4107]: 2017-09-28 12:37:01.751 4107 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:37:01 ctl02 nova-api[4107]: 2017-09-28 12:37:01.751 4107 ERROR nova     sys.exit(main())
Sep 28 12:37:01 ctl02 nova-api[4107]: 2017-09-28 12:37:01.751 4107 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:37:01 ctl02 nova-api[4107]: 2017-09-28 12:37:01.751 4107 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:37:01 ctl02 nova-api[4107]: 2017-09-28 12:37:01.751 4107 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:37:01 ctl02 nova-api[4107]: 2017-09-28 12:37:01.751 4107 ERROR nova     max_url_len=max_url_len)
Sep 28 12:37:01 ctl02 nova-api[4107]: 2017-09-28 12:37:01.751 4107 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:37:01 ctl02 nova-api[4107]: 2017-09-28 12:37:01.751 4107 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:37:01 ctl02 nova-api[4107]: 2017-09-28 12:37:01.751 4107 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:37:01 ctl02 nova-api[4107]: 2017-09-28 12:37:01.751 4107 ERROR nova     sock.listen(backlog)
Sep 28 12:37:01 ctl02 nova-api[4107]: 2017-09-28 12:37:01.751 4107 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:37:01 ctl02 nova-api[4107]: 2017-09-28 12:37:01.751 4107 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:37:01 ctl02 nova-api[4107]: 2017-09-28 12:37:01.751 4107 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:37:01 ctl02 nova-api[4107]: 2017-09-28 12:37:01.751 4107 ERROR nova
Sep 28 12:37:01 ctl02 glance-api[29183]: 2017-09-28 12:37:01.823 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:37:01] "OPTIONS / HTTP/1.0" 200 134 0.000601
Sep 28 12:37:01 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:37:01 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:37:01 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:37:01 ctl02 glance-api[29183]: 2017-09-28 12:37:01.946 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:37:01] "OPTIONS / HTTP/1.0" 200 134 0.000738
Sep 28 12:37:02 ctl02 heat-api-cfn[13300]: 2017-09-28 12:37:02.080 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:37:02] "OPTIONS / HTTP/1.0" 200 134 0.000522
Sep 28 12:37:02 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:37:02 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:37:02 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:37:02 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:37:02 ctl02 glance-api[29183]: 2017-09-28 12:37:02.622 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:37:02] "OPTIONS / HTTP/1.0" 200 134 0.000631
Sep 28 12:37:03 ctl02 nova-api[4125]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:37:03 ctl02 nova-api[4125]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:37:03 ctl02 nova-api[4125]: 2017-09-28 12:37:03.956 4125 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:37:03 ctl02 nova-api[4125]: 2017-09-28 12:37:03.957 4125 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:37:03 ctl02 nova-api[4125]: 2017-09-28 12:37:03.957 4125 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:37:03 ctl02 nova-api[4125]: 2017-09-28 12:37:03.957 4125 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:37:03 ctl02 nova-api[4125]: 2017-09-28 12:37:03.957 4125 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:37:03 ctl02 nova-api[4125]: 2017-09-28 12:37:03.957 4125 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:37:03 ctl02 nova-api[4125]: 2017-09-28 12:37:03.957 4125 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:37:03 ctl02 nova-api[4125]: 2017-09-28 12:37:03.957 4125 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:37:03 ctl02 nova-api[4125]: 2017-09-28 12:37:03.957 4125 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:37:03 ctl02 nova-api[4125]: 2017-09-28 12:37:03.957 4125 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:37:03 ctl02 nova-api[4125]: 2017-09-28 12:37:03.957 4125 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:37:03 ctl02 nova-api[4125]: 2017-09-28 12:37:03.957 4125 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:37:03 ctl02 nova-api[4125]: 2017-09-28 12:37:03.957 4125 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:37:03 ctl02 nova-api[4125]: 2017-09-28 12:37:03.957 4125 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:37:03 ctl02 nova-api[4125]: 2017-09-28 12:37:03.957 4125 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:37:03 ctl02 nova-api[4125]: 2017-09-28 12:37:03.957 4125 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:37:03 ctl02 nova-api[4125]: 2017-09-28 12:37:03.957 4125 ERROR nova.wsgi     self.filename))
Sep 28 12:37:03 ctl02 nova-api[4125]: 2017-09-28 12:37:03.957 4125 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:37:03 ctl02 nova-api[4125]: 2017-09-28 12:37:03.957 4125 ERROR nova.wsgi
Sep 28 12:37:03 ctl02 nova-api[4125]: 2017-09-28 12:37:03.958 4125 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:37:04 ctl02 nova-consoleauth[5433]: 2017-09-28 12:37:04.077 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:37:04 ctl02 nova-api[4125]: 2017-09-28 12:37:04.088 4125 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:37:04 ctl02 nova-api[4125]: 2017-09-28 12:37:04.303 4125 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:37:04 ctl02 nova-api[4125]: 2017-09-28 12:37:04.306 4125 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:37:04 ctl02 nova-api[4125]: 2017-09-28 12:37:04.306 4125 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:37:04 ctl02 nova-api[4125]: 2017-09-28 12:37:04.306 4125 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:37:04 ctl02 nova-api[4125]: 2017-09-28 12:37:04.437 4125 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:37:04 ctl02 nova-api[4125]: 2017-09-28 12:37:04.438 4125 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:37:04 ctl02 nova-api[4125]: 2017-09-28 12:37:04.439 4125 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:37:04 ctl02 nova-api[4125]: 2017-09-28 12:37:04.439 4125 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:37:04 ctl02 nova-api[4125]: 2017-09-28 12:37:04.442 4125 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:37:04 ctl02 nova-api[4125]: 2017-09-28 12:37:04.442 4125 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:37:04 ctl02 nova-api[4125]: 2017-09-28 12:37:04.442 4125 ERROR nova Traceback (most recent call last):
Sep 28 12:37:04 ctl02 nova-api[4125]: 2017-09-28 12:37:04.442 4125 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:37:04 ctl02 nova-api[4125]: 2017-09-28 12:37:04.442 4125 ERROR nova     sys.exit(main())
Sep 28 12:37:04 ctl02 nova-api[4125]: 2017-09-28 12:37:04.442 4125 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:37:04 ctl02 nova-api[4125]: 2017-09-28 12:37:04.442 4125 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:37:04 ctl02 nova-api[4125]: 2017-09-28 12:37:04.442 4125 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:37:04 ctl02 nova-api[4125]: 2017-09-28 12:37:04.442 4125 ERROR nova     max_url_len=max_url_len)
Sep 28 12:37:04 ctl02 nova-api[4125]: 2017-09-28 12:37:04.442 4125 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:37:04 ctl02 nova-api[4125]: 2017-09-28 12:37:04.442 4125 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:37:04 ctl02 nova-api[4125]: 2017-09-28 12:37:04.442 4125 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:37:04 ctl02 nova-api[4125]: 2017-09-28 12:37:04.442 4125 ERROR nova     sock.listen(backlog)
Sep 28 12:37:04 ctl02 nova-api[4125]: 2017-09-28 12:37:04.442 4125 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:37:04 ctl02 nova-api[4125]: 2017-09-28 12:37:04.442 4125 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:37:04 ctl02 nova-api[4125]: 2017-09-28 12:37:04.442 4125 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:37:04 ctl02 nova-api[4125]: 2017-09-28 12:37:04.442 4125 ERROR nova
Sep 28 12:37:04 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:37:04 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:37:04 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:37:04 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:37:04.592 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:37:04] "OPTIONS / HTTP/1.0" 200 134 0.000373
Sep 28 12:37:04 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:37:04 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:37:04 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:37:04 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:37:05 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:37:05.734 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:37:05] "OPTIONS / HTTP/1.0" 200 134 0.000398
Sep 28 12:37:05 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6364254f)
Sep 28 12:37:05 ctl02 neutron-server[30536]: 2017-09-28 12:37:05.952 30603 WARNING oslo_messaging._drivers.amqpdriver [req-53c3b419-6eb5-4153-ab74-f2e7fd849ed6 - - - - -] reply_a13a20a54b91453780e36bdf20a855d2 doesn't exists, drop reply to 6787d6c461814fe8b1b84625062009e8
Sep 28 12:37:05 ctl02 heat-engine[12803]: 2017-09-28 12:37:05.982 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:37:05 ctl02 heat-engine[12803]: 2017-09-28 12:37:05.983 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:37:05 ctl02 heat-engine[12803]: 2017-09-28 12:37:05.989 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:37:05 ctl02 heat-engine[12803]: 2017-09-28 12:37:05.989 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:37:06 ctl02 heat-api[13008]: 2017-09-28 12:37:06.053 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:37:06] "OPTIONS / HTTP/1.0" 200 134 0.000535
Sep 28 12:37:06 ctl02 nova-api[4143]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:37:06 ctl02 nova-api[4143]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:37:06 ctl02 nova-api[4143]: 2017-09-28 12:37:06.778 4143 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:37:06 ctl02 nova-api[4143]: 2017-09-28 12:37:06.779 4143 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:37:06 ctl02 nova-api[4143]: 2017-09-28 12:37:06.779 4143 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:37:06 ctl02 nova-api[4143]: 2017-09-28 12:37:06.779 4143 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:37:06 ctl02 nova-api[4143]: 2017-09-28 12:37:06.779 4143 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:37:06 ctl02 nova-api[4143]: 2017-09-28 12:37:06.779 4143 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:37:06 ctl02 nova-api[4143]: 2017-09-28 12:37:06.779 4143 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:37:06 ctl02 nova-api[4143]: 2017-09-28 12:37:06.779 4143 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:37:06 ctl02 nova-api[4143]: 2017-09-28 12:37:06.779 4143 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:37:06 ctl02 nova-api[4143]: 2017-09-28 12:37:06.779 4143 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:37:06 ctl02 nova-api[4143]: 2017-09-28 12:37:06.779 4143 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:37:06 ctl02 nova-api[4143]: 2017-09-28 12:37:06.779 4143 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:37:06 ctl02 nova-api[4143]: 2017-09-28 12:37:06.779 4143 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:37:06 ctl02 nova-api[4143]: 2017-09-28 12:37:06.779 4143 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:37:06 ctl02 nova-api[4143]: 2017-09-28 12:37:06.779 4143 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:37:06 ctl02 nova-api[4143]: 2017-09-28 12:37:06.779 4143 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:37:06 ctl02 nova-api[4143]: 2017-09-28 12:37:06.779 4143 ERROR nova.wsgi     self.filename))
Sep 28 12:37:06 ctl02 nova-api[4143]: 2017-09-28 12:37:06.779 4143 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:37:06 ctl02 nova-api[4143]: 2017-09-28 12:37:06.779 4143 ERROR nova.wsgi
Sep 28 12:37:06 ctl02 nova-api[4143]: 2017-09-28 12:37:06.780 4143 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:37:06 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6364254f)
Sep 28 12:37:06 ctl02 nova-api[4143]: 2017-09-28 12:37:06.909 4143 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:37:07 ctl02 nova-scheduler[5620]: 2017-09-28 12:37:07.130 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:37:07 ctl02 nova-api[4143]: 2017-09-28 12:37:07.140 4143 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:37:07 ctl02 nova-api[4143]: 2017-09-28 12:37:07.144 4143 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:37:07 ctl02 nova-api[4143]: 2017-09-28 12:37:07.144 4143 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:37:07 ctl02 nova-api[4143]: 2017-09-28 12:37:07.145 4143 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:37:07 ctl02 nova-api[4143]: 2017-09-28 12:37:07.292 4143 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:37:07 ctl02 nova-api[4143]: 2017-09-28 12:37:07.295 4143 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:37:07 ctl02 nova-api[4143]: 2017-09-28 12:37:07.295 4143 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:37:07 ctl02 nova-api[4143]: 2017-09-28 12:37:07.296 4143 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:37:07 ctl02 nova-api[4143]: 2017-09-28 12:37:07.299 4143 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:37:07 ctl02 nova-api[4143]: 2017-09-28 12:37:07.299 4143 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:37:07 ctl02 nova-api[4143]: 2017-09-28 12:37:07.299 4143 ERROR nova Traceback (most recent call last):
Sep 28 12:37:07 ctl02 nova-api[4143]: 2017-09-28 12:37:07.299 4143 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:37:07 ctl02 nova-api[4143]: 2017-09-28 12:37:07.299 4143 ERROR nova     sys.exit(main())
Sep 28 12:37:07 ctl02 nova-api[4143]: 2017-09-28 12:37:07.299 4143 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:37:07 ctl02 nova-api[4143]: 2017-09-28 12:37:07.299 4143 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:37:07 ctl02 nova-api[4143]: 2017-09-28 12:37:07.299 4143 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:37:07 ctl02 nova-api[4143]: 2017-09-28 12:37:07.299 4143 ERROR nova     max_url_len=max_url_len)
Sep 28 12:37:07 ctl02 nova-api[4143]: 2017-09-28 12:37:07.299 4143 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:37:07 ctl02 nova-api[4143]: 2017-09-28 12:37:07.299 4143 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:37:07 ctl02 nova-api[4143]: 2017-09-28 12:37:07.299 4143 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:37:07 ctl02 nova-api[4143]: 2017-09-28 12:37:07.299 4143 ERROR nova     sock.listen(backlog)
Sep 28 12:37:07 ctl02 nova-api[4143]: 2017-09-28 12:37:07.299 4143 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:37:07 ctl02 nova-api[4143]: 2017-09-28 12:37:07.299 4143 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:37:07 ctl02 nova-api[4143]: 2017-09-28 12:37:07.299 4143 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:37:07 ctl02 nova-api[4143]: 2017-09-28 12:37:07.299 4143 ERROR nova
Sep 28 12:37:07 ctl02 heat-api[13008]: 2017-09-28 12:37:07.405 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:37:07] "OPTIONS / HTTP/1.0" 200 134 0.000709
Sep 28 12:37:07 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:37:07 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:37:07 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:37:07 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:37:07 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:37:07 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:37:07 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:37:07 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6364254f)
Sep 28 12:37:08 ctl02 heat-api-cfn[13300]: 2017-09-28 12:37:08.141 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:37:08] "OPTIONS / HTTP/1.0" 200 134 0.000424
Sep 28 12:37:08 ctl02 heat-api[13008]: 2017-09-28 12:37:08.754 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:37:08] "OPTIONS / HTTP/1.0" 200 134 0.000686
Sep 28 12:37:08 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6364254f)
Sep 28 12:37:08 ctl02 heat-api-cfn[13300]: 2017-09-28 12:37:08.912 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:37:08] "OPTIONS / HTTP/1.0" 200 134 0.000425
Sep 28 12:37:09 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:37:09.033 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:37:09] "OPTIONS / HTTP/1.0" 200 134 0.000417
Sep 28 12:37:09 ctl02 nova-api[4161]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:37:09 ctl02 nova-api[4161]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:37:09 ctl02 nova-api[4161]: 2017-09-28 12:37:09.438 4161 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:37:09 ctl02 nova-api[4161]: 2017-09-28 12:37:09.439 4161 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:37:09 ctl02 nova-api[4161]: 2017-09-28 12:37:09.439 4161 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:37:09 ctl02 nova-api[4161]: 2017-09-28 12:37:09.439 4161 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:37:09 ctl02 nova-api[4161]: 2017-09-28 12:37:09.439 4161 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:37:09 ctl02 nova-api[4161]: 2017-09-28 12:37:09.439 4161 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:37:09 ctl02 nova-api[4161]: 2017-09-28 12:37:09.439 4161 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:37:09 ctl02 nova-api[4161]: 2017-09-28 12:37:09.439 4161 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:37:09 ctl02 nova-api[4161]: 2017-09-28 12:37:09.439 4161 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:37:09 ctl02 nova-api[4161]: 2017-09-28 12:37:09.439 4161 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:37:09 ctl02 nova-api[4161]: 2017-09-28 12:37:09.439 4161 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:37:09 ctl02 nova-api[4161]: 2017-09-28 12:37:09.439 4161 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:37:09 ctl02 nova-api[4161]: 2017-09-28 12:37:09.439 4161 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:37:09 ctl02 nova-api[4161]: 2017-09-28 12:37:09.439 4161 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:37:09 ctl02 nova-api[4161]: 2017-09-28 12:37:09.439 4161 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:37:09 ctl02 nova-api[4161]: 2017-09-28 12:37:09.439 4161 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:37:09 ctl02 nova-api[4161]: 2017-09-28 12:37:09.439 4161 ERROR nova.wsgi     self.filename))
Sep 28 12:37:09 ctl02 nova-api[4161]: 2017-09-28 12:37:09.439 4161 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:37:09 ctl02 nova-api[4161]: 2017-09-28 12:37:09.439 4161 ERROR nova.wsgi
Sep 28 12:37:09 ctl02 nova-api[4161]: 2017-09-28 12:37:09.440 4161 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:37:09 ctl02 nova-api[4161]: 2017-09-28 12:37:09.566 4161 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:37:09 ctl02 neutron-server[30536]: 2017-09-28 12:37:09.774 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:37:09] "OPTIONS / HTTP/1.0" 200 262 0.000431
Sep 28 12:37:09 ctl02 nova-api[4161]: 2017-09-28 12:37:09.784 4161 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:37:09 ctl02 nova-api[4161]: 2017-09-28 12:37:09.787 4161 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:37:09 ctl02 nova-api[4161]: 2017-09-28 12:37:09.787 4161 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:37:09 ctl02 nova-api[4161]: 2017-09-28 12:37:09.787 4161 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:37:09 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6364254f)
Sep 28 12:37:09 ctl02 nova-api[4161]: 2017-09-28 12:37:09.916 4161 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:37:09 ctl02 nova-api[4161]: 2017-09-28 12:37:09.918 4161 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:37:09 ctl02 nova-api[4161]: 2017-09-28 12:37:09.918 4161 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:37:09 ctl02 nova-api[4161]: 2017-09-28 12:37:09.918 4161 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:37:09 ctl02 nova-api[4161]: 2017-09-28 12:37:09.922 4161 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:37:09 ctl02 nova-api[4161]: 2017-09-28 12:37:09.922 4161 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:37:09 ctl02 nova-api[4161]: 2017-09-28 12:37:09.922 4161 ERROR nova Traceback (most recent call last):
Sep 28 12:37:09 ctl02 nova-api[4161]: 2017-09-28 12:37:09.922 4161 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:37:09 ctl02 nova-api[4161]: 2017-09-28 12:37:09.922 4161 ERROR nova     sys.exit(main())
Sep 28 12:37:09 ctl02 nova-api[4161]: 2017-09-28 12:37:09.922 4161 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:37:09 ctl02 nova-api[4161]: 2017-09-28 12:37:09.922 4161 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:37:09 ctl02 nova-api[4161]: 2017-09-28 12:37:09.922 4161 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:37:09 ctl02 nova-api[4161]: 2017-09-28 12:37:09.922 4161 ERROR nova     max_url_len=max_url_len)
Sep 28 12:37:09 ctl02 nova-api[4161]: 2017-09-28 12:37:09.922 4161 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:37:09 ctl02 nova-api[4161]: 2017-09-28 12:37:09.922 4161 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:37:09 ctl02 nova-api[4161]: 2017-09-28 12:37:09.922 4161 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:37:09 ctl02 nova-api[4161]: 2017-09-28 12:37:09.922 4161 ERROR nova     sock.listen(backlog)
Sep 28 12:37:09 ctl02 nova-api[4161]: 2017-09-28 12:37:09.922 4161 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:37:09 ctl02 nova-api[4161]: 2017-09-28 12:37:09.922 4161 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:37:09 ctl02 nova-api[4161]: 2017-09-28 12:37:09.922 4161 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:37:09 ctl02 nova-api[4161]: 2017-09-28 12:37:09.922 4161 ERROR nova
Sep 28 12:37:10 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:37:10 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:37:10 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:37:10 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:37:10 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:37:10 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:37:10 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:37:10 ctl02 neutron-server[30536]: 2017-09-28 12:37:10.458 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:37:10] "OPTIONS / HTTP/1.0" 200 262 0.000523
Sep 28 12:37:10 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6364254f)
Sep 28 12:37:11 ctl02 neutron-server[30536]: 2017-09-28 12:37:11.301 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:37:11] "OPTIONS / HTTP/1.0" 200 262 0.000458
Sep 28 12:37:11 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6364254f)
Sep 28 12:37:11 ctl02 glance-api[29183]: 2017-09-28 12:37:11.990 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:37:11] "OPTIONS / HTTP/1.0" 200 134 0.000555
Sep 28 12:37:12 ctl02 nova-api[4179]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:37:12 ctl02 nova-api[4179]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:37:12 ctl02 glance-api[29183]: 2017-09-28 12:37:12.189 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:37:12] "OPTIONS / HTTP/1.0" 200 134 0.000573
Sep 28 12:37:12 ctl02 nova-api[4179]: 2017-09-28 12:37:12.210 4179 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:37:12 ctl02 nova-api[4179]: 2017-09-28 12:37:12.211 4179 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:37:12 ctl02 nova-api[4179]: 2017-09-28 12:37:12.211 4179 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:37:12 ctl02 nova-api[4179]: 2017-09-28 12:37:12.211 4179 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:37:12 ctl02 nova-api[4179]: 2017-09-28 12:37:12.211 4179 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:37:12 ctl02 nova-api[4179]: 2017-09-28 12:37:12.211 4179 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:37:12 ctl02 nova-api[4179]: 2017-09-28 12:37:12.211 4179 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:37:12 ctl02 nova-api[4179]: 2017-09-28 12:37:12.211 4179 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:37:12 ctl02 nova-api[4179]: 2017-09-28 12:37:12.211 4179 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:37:12 ctl02 nova-api[4179]: 2017-09-28 12:37:12.211 4179 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:37:12 ctl02 nova-api[4179]: 2017-09-28 12:37:12.211 4179 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:37:12 ctl02 nova-api[4179]: 2017-09-28 12:37:12.211 4179 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:37:12 ctl02 nova-api[4179]: 2017-09-28 12:37:12.211 4179 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:37:12 ctl02 nova-api[4179]: 2017-09-28 12:37:12.211 4179 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:37:12 ctl02 nova-api[4179]: 2017-09-28 12:37:12.211 4179 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:37:12 ctl02 nova-api[4179]: 2017-09-28 12:37:12.211 4179 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:37:12 ctl02 nova-api[4179]: 2017-09-28 12:37:12.211 4179 ERROR nova.wsgi     self.filename))
Sep 28 12:37:12 ctl02 nova-api[4179]: 2017-09-28 12:37:12.211 4179 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:37:12 ctl02 nova-api[4179]: 2017-09-28 12:37:12.211 4179 ERROR nova.wsgi
Sep 28 12:37:12 ctl02 nova-api[4179]: 2017-09-28 12:37:12.212 4179 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:37:12 ctl02 nova-api[4179]: 2017-09-28 12:37:12.339 4179 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:37:12 ctl02 heat-api-cfn[13300]: 2017-09-28 12:37:12.454 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:37:12] "OPTIONS / HTTP/1.0" 200 134 0.000454
Sep 28 12:37:12 ctl02 nova-api[4179]: 2017-09-28 12:37:12.552 4179 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:37:12 ctl02 nova-api[4179]: 2017-09-28 12:37:12.554 4179 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:37:12 ctl02 nova-api[4179]: 2017-09-28 12:37:12.554 4179 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:37:12 ctl02 nova-api[4179]: 2017-09-28 12:37:12.555 4179 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:37:12 ctl02 nova-api[4179]: 2017-09-28 12:37:12.683 4179 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:37:12 ctl02 nova-api[4179]: 2017-09-28 12:37:12.685 4179 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:37:12 ctl02 nova-api[4179]: 2017-09-28 12:37:12.685 4179 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:37:12 ctl02 nova-api[4179]: 2017-09-28 12:37:12.686 4179 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:37:12 ctl02 nova-api[4179]: 2017-09-28 12:37:12.689 4179 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:37:12 ctl02 nova-api[4179]: 2017-09-28 12:37:12.689 4179 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:37:12 ctl02 nova-api[4179]: 2017-09-28 12:37:12.689 4179 ERROR nova Traceback (most recent call last):
Sep 28 12:37:12 ctl02 nova-api[4179]: 2017-09-28 12:37:12.689 4179 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:37:12 ctl02 nova-api[4179]: 2017-09-28 12:37:12.689 4179 ERROR nova     sys.exit(main())
Sep 28 12:37:12 ctl02 nova-api[4179]: 2017-09-28 12:37:12.689 4179 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:37:12 ctl02 nova-api[4179]: 2017-09-28 12:37:12.689 4179 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:37:12 ctl02 nova-api[4179]: 2017-09-28 12:37:12.689 4179 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:37:12 ctl02 nova-api[4179]: 2017-09-28 12:37:12.689 4179 ERROR nova     max_url_len=max_url_len)
Sep 28 12:37:12 ctl02 nova-api[4179]: 2017-09-28 12:37:12.689 4179 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:37:12 ctl02 nova-api[4179]: 2017-09-28 12:37:12.689 4179 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:37:12 ctl02 nova-api[4179]: 2017-09-28 12:37:12.689 4179 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:37:12 ctl02 nova-api[4179]: 2017-09-28 12:37:12.689 4179 ERROR nova     sock.listen(backlog)
Sep 28 12:37:12 ctl02 nova-api[4179]: 2017-09-28 12:37:12.689 4179 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:37:12 ctl02 nova-api[4179]: 2017-09-28 12:37:12.689 4179 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:37:12 ctl02 nova-api[4179]: 2017-09-28 12:37:12.689 4179 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:37:12 ctl02 nova-api[4179]: 2017-09-28 12:37:12.689 4179 ERROR nova
Sep 28 12:37:12 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:37:12 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:37:12 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:37:12 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6364254f)
Sep 28 12:37:12 ctl02 glance-api[29183]: 2017-09-28 12:37:12.992 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:37:12] "OPTIONS / HTTP/1.0" 200 134 0.000652
Sep 28 12:37:13 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:37:13 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:37:13 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:37:13 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:37:13 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6364254f)
Sep 28 12:37:14 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:37:14.653 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:37:14] "OPTIONS / HTTP/1.0" 200 134 0.000481
Sep 28 12:37:14 ctl02 nova-api[4197]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:37:14 ctl02 nova-api[4197]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:37:14 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6364254f)
Sep 28 12:37:14 ctl02 nova-api[4197]: 2017-09-28 12:37:14.935 4197 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:37:14 ctl02 nova-api[4197]: 2017-09-28 12:37:14.936 4197 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:37:14 ctl02 nova-api[4197]: 2017-09-28 12:37:14.936 4197 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:37:14 ctl02 nova-api[4197]: 2017-09-28 12:37:14.936 4197 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:37:14 ctl02 nova-api[4197]: 2017-09-28 12:37:14.936 4197 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:37:14 ctl02 nova-api[4197]: 2017-09-28 12:37:14.936 4197 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:37:14 ctl02 nova-api[4197]: 2017-09-28 12:37:14.936 4197 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:37:14 ctl02 nova-api[4197]: 2017-09-28 12:37:14.936 4197 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:37:14 ctl02 nova-api[4197]: 2017-09-28 12:37:14.936 4197 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:37:14 ctl02 nova-api[4197]: 2017-09-28 12:37:14.936 4197 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:37:14 ctl02 nova-api[4197]: 2017-09-28 12:37:14.936 4197 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:37:14 ctl02 nova-api[4197]: 2017-09-28 12:37:14.936 4197 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:37:14 ctl02 nova-api[4197]: 2017-09-28 12:37:14.936 4197 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:37:14 ctl02 nova-api[4197]: 2017-09-28 12:37:14.936 4197 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:37:14 ctl02 nova-api[4197]: 2017-09-28 12:37:14.936 4197 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:37:14 ctl02 nova-api[4197]: 2017-09-28 12:37:14.936 4197 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:37:14 ctl02 nova-api[4197]: 2017-09-28 12:37:14.936 4197 ERROR nova.wsgi     self.filename))
Sep 28 12:37:14 ctl02 nova-api[4197]: 2017-09-28 12:37:14.936 4197 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:37:14 ctl02 nova-api[4197]: 2017-09-28 12:37:14.936 4197 ERROR nova.wsgi
Sep 28 12:37:14 ctl02 nova-api[4197]: 2017-09-28 12:37:14.938 4197 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:37:15 ctl02 nova-api[4197]: 2017-09-28 12:37:15.076 4197 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:37:15 ctl02 nova-api[4197]: 2017-09-28 12:37:15.343 4197 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:37:15 ctl02 nova-api[4197]: 2017-09-28 12:37:15.346 4197 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:37:15 ctl02 nova-api[4197]: 2017-09-28 12:37:15.346 4197 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:37:15 ctl02 nova-api[4197]: 2017-09-28 12:37:15.347 4197 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:37:15 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:37:15.422 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:37:15] "OPTIONS / HTTP/1.0" 200 134 0.000442
Sep 28 12:37:15 ctl02 nova-api[4197]: 2017-09-28 12:37:15.485 4197 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:37:15 ctl02 nova-api[4197]: 2017-09-28 12:37:15.488 4197 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:37:15 ctl02 nova-api[4197]: 2017-09-28 12:37:15.488 4197 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:37:15 ctl02 nova-api[4197]: 2017-09-28 12:37:15.489 4197 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:37:15 ctl02 nova-api[4197]: 2017-09-28 12:37:15.492 4197 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:37:15 ctl02 nova-api[4197]: 2017-09-28 12:37:15.493 4197 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:37:15 ctl02 nova-api[4197]: 2017-09-28 12:37:15.493 4197 ERROR nova Traceback (most recent call last):
Sep 28 12:37:15 ctl02 nova-api[4197]: 2017-09-28 12:37:15.493 4197 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:37:15 ctl02 nova-api[4197]: 2017-09-28 12:37:15.493 4197 ERROR nova     sys.exit(main())
Sep 28 12:37:15 ctl02 nova-api[4197]: 2017-09-28 12:37:15.493 4197 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:37:15 ctl02 nova-api[4197]: 2017-09-28 12:37:15.493 4197 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:37:15 ctl02 nova-api[4197]: 2017-09-28 12:37:15.493 4197 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:37:15 ctl02 nova-api[4197]: 2017-09-28 12:37:15.493 4197 ERROR nova     max_url_len=max_url_len)
Sep 28 12:37:15 ctl02 nova-api[4197]: 2017-09-28 12:37:15.493 4197 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:37:15 ctl02 nova-api[4197]: 2017-09-28 12:37:15.493 4197 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:37:15 ctl02 nova-api[4197]: 2017-09-28 12:37:15.493 4197 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:37:15 ctl02 nova-api[4197]: 2017-09-28 12:37:15.493 4197 ERROR nova     sock.listen(backlog)
Sep 28 12:37:15 ctl02 nova-api[4197]: 2017-09-28 12:37:15.493 4197 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:37:15 ctl02 nova-api[4197]: 2017-09-28 12:37:15.493 4197 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:37:15 ctl02 nova-api[4197]: 2017-09-28 12:37:15.493 4197 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:37:15 ctl02 nova-api[4197]: 2017-09-28 12:37:15.493 4197 ERROR nova
Sep 28 12:37:15 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:37:15 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:37:15 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:37:15 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:37:15 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:37:15 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:37:15 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:37:15 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6364254f)
Sep 28 12:37:16 ctl02 heat-api[13008]: 2017-09-28 12:37:16.157 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:37:16] "OPTIONS / HTTP/1.0" 200 134 0.000503
Sep 28 12:37:16 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:37:16 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:37:17 ctl02 nova-api[4215]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:37:17 ctl02 nova-api[4215]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:37:17 ctl02 heat-api[13008]: 2017-09-28 12:37:17.618 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:37:17] "OPTIONS / HTTP/1.0" 200 134 0.000547
Sep 28 12:37:17 ctl02 nova-api[4215]: 2017-09-28 12:37:17.756 4215 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:37:17 ctl02 nova-api[4215]: 2017-09-28 12:37:17.757 4215 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:37:17 ctl02 nova-api[4215]: 2017-09-28 12:37:17.757 4215 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:37:17 ctl02 nova-api[4215]: 2017-09-28 12:37:17.757 4215 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:37:17 ctl02 nova-api[4215]: 2017-09-28 12:37:17.757 4215 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:37:17 ctl02 nova-api[4215]: 2017-09-28 12:37:17.757 4215 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:37:17 ctl02 nova-api[4215]: 2017-09-28 12:37:17.757 4215 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:37:17 ctl02 nova-api[4215]: 2017-09-28 12:37:17.757 4215 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:37:17 ctl02 nova-api[4215]: 2017-09-28 12:37:17.757 4215 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:37:17 ctl02 nova-api[4215]: 2017-09-28 12:37:17.757 4215 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:37:17 ctl02 nova-api[4215]: 2017-09-28 12:37:17.757 4215 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:37:17 ctl02 nova-api[4215]: 2017-09-28 12:37:17.757 4215 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:37:17 ctl02 nova-api[4215]: 2017-09-28 12:37:17.757 4215 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:37:17 ctl02 nova-api[4215]: 2017-09-28 12:37:17.757 4215 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:37:17 ctl02 nova-api[4215]: 2017-09-28 12:37:17.757 4215 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:37:17 ctl02 nova-api[4215]: 2017-09-28 12:37:17.757 4215 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:37:17 ctl02 nova-api[4215]: 2017-09-28 12:37:17.757 4215 ERROR nova.wsgi     self.filename))
Sep 28 12:37:17 ctl02 nova-api[4215]: 2017-09-28 12:37:17.757 4215 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:37:17 ctl02 nova-api[4215]: 2017-09-28 12:37:17.757 4215 ERROR nova.wsgi
Sep 28 12:37:17 ctl02 nova-api[4215]: 2017-09-28 12:37:17.760 4215 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:37:17 ctl02 nova-api[4215]: 2017-09-28 12:37:17.882 4215 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:37:18 ctl02 nova-api[4215]: 2017-09-28 12:37:18.093 4215 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:37:18 ctl02 nova-api[4215]: 2017-09-28 12:37:18.096 4215 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:37:18 ctl02 nova-api[4215]: 2017-09-28 12:37:18.096 4215 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:37:18 ctl02 nova-api[4215]: 2017-09-28 12:37:18.097 4215 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:37:18 ctl02 nova-api[4215]: 2017-09-28 12:37:18.226 4215 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:37:18 ctl02 nova-api[4215]: 2017-09-28 12:37:18.228 4215 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:37:18 ctl02 nova-api[4215]: 2017-09-28 12:37:18.228 4215 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:37:18 ctl02 nova-api[4215]: 2017-09-28 12:37:18.229 4215 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:37:18 ctl02 nova-api[4215]: 2017-09-28 12:37:18.232 4215 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:37:18 ctl02 nova-api[4215]: 2017-09-28 12:37:18.233 4215 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:37:18 ctl02 nova-api[4215]: 2017-09-28 12:37:18.233 4215 ERROR nova Traceback (most recent call last):
Sep 28 12:37:18 ctl02 nova-api[4215]: 2017-09-28 12:37:18.233 4215 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:37:18 ctl02 nova-api[4215]: 2017-09-28 12:37:18.233 4215 ERROR nova     sys.exit(main())
Sep 28 12:37:18 ctl02 nova-api[4215]: 2017-09-28 12:37:18.233 4215 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:37:18 ctl02 nova-api[4215]: 2017-09-28 12:37:18.233 4215 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:37:18 ctl02 nova-api[4215]: 2017-09-28 12:37:18.233 4215 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:37:18 ctl02 nova-api[4215]: 2017-09-28 12:37:18.233 4215 ERROR nova     max_url_len=max_url_len)
Sep 28 12:37:18 ctl02 nova-api[4215]: 2017-09-28 12:37:18.233 4215 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:37:18 ctl02 nova-api[4215]: 2017-09-28 12:37:18.233 4215 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:37:18 ctl02 nova-api[4215]: 2017-09-28 12:37:18.233 4215 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:37:18 ctl02 nova-api[4215]: 2017-09-28 12:37:18.233 4215 ERROR nova     sock.listen(backlog)
Sep 28 12:37:18 ctl02 nova-api[4215]: 2017-09-28 12:37:18.233 4215 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:37:18 ctl02 nova-api[4215]: 2017-09-28 12:37:18.233 4215 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:37:18 ctl02 nova-api[4215]: 2017-09-28 12:37:18.233 4215 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:37:18 ctl02 nova-api[4215]: 2017-09-28 12:37:18.233 4215 ERROR nova
Sep 28 12:37:18 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:37:18 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:37:18 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:37:18 ctl02 heat-api-cfn[13300]: 2017-09-28 12:37:18.437 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:37:18] "OPTIONS / HTTP/1.0" 200 134 0.000452
Sep 28 12:37:18 ctl02 heat-api[13008]: 2017-09-28 12:37:18.470 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:37:18] "OPTIONS / HTTP/1.0" 200 134 0.000539
Sep 28 12:37:18 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:37:18 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:37:18 ctl02 heat-api-cfn[13300]: 2017-09-28 12:37:18.650 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:37:18] "OPTIONS / HTTP/1.0" 200 134 0.000511
Sep 28 12:37:18 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:37:18 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:37:18 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:37:18.725 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:37:18] "OPTIONS / HTTP/1.0" 200 134 0.000376
Sep 28 12:37:20 ctl02 neutron-server[30536]: 2017-09-28 12:37:20.070 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:37:20] "OPTIONS / HTTP/1.0" 200 262 0.000525
Sep 28 12:37:20 ctl02 neutron-server[30536]: 2017-09-28 12:37:20.343 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:37:20] "OPTIONS / HTTP/1.0" 200 262 0.000544
Sep 28 12:37:20 ctl02 nova-api[4238]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:37:20 ctl02 nova-api[4238]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:37:20 ctl02 nova-api[4238]: 2017-09-28 12:37:20.538 4238 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:37:20 ctl02 nova-api[4238]: 2017-09-28 12:37:20.539 4238 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:37:20 ctl02 nova-api[4238]: 2017-09-28 12:37:20.539 4238 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:37:20 ctl02 nova-api[4238]: 2017-09-28 12:37:20.539 4238 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:37:20 ctl02 nova-api[4238]: 2017-09-28 12:37:20.539 4238 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:37:20 ctl02 nova-api[4238]: 2017-09-28 12:37:20.539 4238 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:37:20 ctl02 nova-api[4238]: 2017-09-28 12:37:20.539 4238 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:37:20 ctl02 nova-api[4238]: 2017-09-28 12:37:20.539 4238 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:37:20 ctl02 nova-api[4238]: 2017-09-28 12:37:20.539 4238 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:37:20 ctl02 nova-api[4238]: 2017-09-28 12:37:20.539 4238 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:37:20 ctl02 nova-api[4238]: 2017-09-28 12:37:20.539 4238 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:37:20 ctl02 nova-api[4238]: 2017-09-28 12:37:20.539 4238 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:37:20 ctl02 nova-api[4238]: 2017-09-28 12:37:20.539 4238 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:37:20 ctl02 nova-api[4238]: 2017-09-28 12:37:20.539 4238 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:37:20 ctl02 nova-api[4238]: 2017-09-28 12:37:20.539 4238 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:37:20 ctl02 nova-api[4238]: 2017-09-28 12:37:20.539 4238 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:37:20 ctl02 nova-api[4238]: 2017-09-28 12:37:20.539 4238 ERROR nova.wsgi     self.filename))
Sep 28 12:37:20 ctl02 nova-api[4238]: 2017-09-28 12:37:20.539 4238 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:37:20 ctl02 nova-api[4238]: 2017-09-28 12:37:20.539 4238 ERROR nova.wsgi
Sep 28 12:37:20 ctl02 nova-api[4238]: 2017-09-28 12:37:20.541 4238 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:37:20 ctl02 nova-api[4238]: 2017-09-28 12:37:20.674 4238 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:37:20 ctl02 nova-api[4238]: 2017-09-28 12:37:20.920 4238 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:37:20 ctl02 nova-api[4238]: 2017-09-28 12:37:20.922 4238 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:37:20 ctl02 nova-api[4238]: 2017-09-28 12:37:20.922 4238 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:37:20 ctl02 nova-api[4238]: 2017-09-28 12:37:20.923 4238 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:37:21 ctl02 nova-api[4238]: 2017-09-28 12:37:21.055 4238 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:37:21 ctl02 nova-api[4238]: 2017-09-28 12:37:21.057 4238 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:37:21 ctl02 nova-api[4238]: 2017-09-28 12:37:21.057 4238 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:37:21 ctl02 nova-api[4238]: 2017-09-28 12:37:21.057 4238 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:37:21 ctl02 nova-api[4238]: 2017-09-28 12:37:21.060 4238 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:37:21 ctl02 nova-api[4238]: 2017-09-28 12:37:21.061 4238 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:37:21 ctl02 nova-api[4238]: 2017-09-28 12:37:21.061 4238 ERROR nova Traceback (most recent call last):
Sep 28 12:37:21 ctl02 nova-api[4238]: 2017-09-28 12:37:21.061 4238 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:37:21 ctl02 nova-api[4238]: 2017-09-28 12:37:21.061 4238 ERROR nova     sys.exit(main())
Sep 28 12:37:21 ctl02 nova-api[4238]: 2017-09-28 12:37:21.061 4238 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:37:21 ctl02 nova-api[4238]: 2017-09-28 12:37:21.061 4238 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:37:21 ctl02 nova-api[4238]: 2017-09-28 12:37:21.061 4238 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:37:21 ctl02 nova-api[4238]: 2017-09-28 12:37:21.061 4238 ERROR nova     max_url_len=max_url_len)
Sep 28 12:37:21 ctl02 nova-api[4238]: 2017-09-28 12:37:21.061 4238 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:37:21 ctl02 nova-api[4238]: 2017-09-28 12:37:21.061 4238 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:37:21 ctl02 nova-api[4238]: 2017-09-28 12:37:21.061 4238 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:37:21 ctl02 nova-api[4238]: 2017-09-28 12:37:21.061 4238 ERROR nova     sock.listen(backlog)
Sep 28 12:37:21 ctl02 nova-api[4238]: 2017-09-28 12:37:21.061 4238 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:37:21 ctl02 nova-api[4238]: 2017-09-28 12:37:21.061 4238 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:37:21 ctl02 nova-api[4238]: 2017-09-28 12:37:21.061 4238 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:37:21 ctl02 nova-api[4238]: 2017-09-28 12:37:21.061 4238 ERROR nova
Sep 28 12:37:21 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:37:21 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:37:21 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:37:21 ctl02 neutron-server[30536]: 2017-09-28 12:37:21.356 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 2 dead agents out of 6:
Sep 28 12:37:21 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:37:21 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:36:48 cmp001
Sep 28 12:37:21 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:36:50 cmp002
Sep 28 12:37:21 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:37:21 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:37:21 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:37:21 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:37:21 ctl02 neutron-server[30536]: 2017-09-28 12:37:21.578 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:37:21] "OPTIONS / HTTP/1.0" 200 262 0.000529
Sep 28 12:37:22 ctl02 glance-api[29183]: 2017-09-28 12:37:22.169 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:37:22] "OPTIONS / HTTP/1.0" 200 134 0.001032
Sep 28 12:37:22 ctl02 glance-api[29183]: 2017-09-28 12:37:22.396 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:37:22] "OPTIONS / HTTP/1.0" 200 134 0.000622
Sep 28 12:37:22 ctl02 heat-api-cfn[13300]: 2017-09-28 12:37:22.629 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:37:22] "OPTIONS / HTTP/1.0" 200 134 0.000458
Sep 28 12:37:22 ctl02 glance-api[29183]: 2017-09-28 12:37:22.742 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:37:22] "OPTIONS / HTTP/1.0" 200 134 0.000618
Sep 28 12:37:23 ctl02 nova-api[4255]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:37:23 ctl02 nova-api[4255]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:37:23 ctl02 nova-api[4255]: 2017-09-28 12:37:23.246 4255 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:37:23 ctl02 nova-api[4255]: 2017-09-28 12:37:23.248 4255 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:37:23 ctl02 nova-api[4255]: 2017-09-28 12:37:23.248 4255 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:37:23 ctl02 nova-api[4255]: 2017-09-28 12:37:23.248 4255 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:37:23 ctl02 nova-api[4255]: 2017-09-28 12:37:23.248 4255 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:37:23 ctl02 nova-api[4255]: 2017-09-28 12:37:23.248 4255 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:37:23 ctl02 nova-api[4255]: 2017-09-28 12:37:23.248 4255 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:37:23 ctl02 nova-api[4255]: 2017-09-28 12:37:23.248 4255 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:37:23 ctl02 nova-api[4255]: 2017-09-28 12:37:23.248 4255 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:37:23 ctl02 nova-api[4255]: 2017-09-28 12:37:23.248 4255 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:37:23 ctl02 nova-api[4255]: 2017-09-28 12:37:23.248 4255 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:37:23 ctl02 nova-api[4255]: 2017-09-28 12:37:23.248 4255 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:37:23 ctl02 nova-api[4255]: 2017-09-28 12:37:23.248 4255 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:37:23 ctl02 nova-api[4255]: 2017-09-28 12:37:23.248 4255 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:37:23 ctl02 nova-api[4255]: 2017-09-28 12:37:23.248 4255 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:37:23 ctl02 nova-api[4255]: 2017-09-28 12:37:23.248 4255 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:37:23 ctl02 nova-api[4255]: 2017-09-28 12:37:23.248 4255 ERROR nova.wsgi     self.filename))
Sep 28 12:37:23 ctl02 nova-api[4255]: 2017-09-28 12:37:23.248 4255 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:37:23 ctl02 nova-api[4255]: 2017-09-28 12:37:23.248 4255 ERROR nova.wsgi
Sep 28 12:37:23 ctl02 nova-api[4255]: 2017-09-28 12:37:23.249 4255 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:37:23 ctl02 nova-api[4255]: 2017-09-28 12:37:23.378 4255 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:37:23 ctl02 nova-api[4255]: 2017-09-28 12:37:23.602 4255 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:37:23 ctl02 nova-api[4255]: 2017-09-28 12:37:23.604 4255 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:37:23 ctl02 nova-api[4255]: 2017-09-28 12:37:23.605 4255 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:37:23 ctl02 nova-api[4255]: 2017-09-28 12:37:23.605 4255 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:37:23 ctl02 nova-api[4255]: 2017-09-28 12:37:23.736 4255 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:37:23 ctl02 nova-api[4255]: 2017-09-28 12:37:23.738 4255 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:37:23 ctl02 nova-api[4255]: 2017-09-28 12:37:23.738 4255 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:37:23 ctl02 nova-api[4255]: 2017-09-28 12:37:23.739 4255 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:37:23 ctl02 nova-api[4255]: 2017-09-28 12:37:23.742 4255 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:37:23 ctl02 nova-api[4255]: 2017-09-28 12:37:23.742 4255 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:37:23 ctl02 nova-api[4255]: 2017-09-28 12:37:23.742 4255 ERROR nova Traceback (most recent call last):
Sep 28 12:37:23 ctl02 nova-api[4255]: 2017-09-28 12:37:23.742 4255 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:37:23 ctl02 nova-api[4255]: 2017-09-28 12:37:23.742 4255 ERROR nova     sys.exit(main())
Sep 28 12:37:23 ctl02 nova-api[4255]: 2017-09-28 12:37:23.742 4255 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:37:23 ctl02 nova-api[4255]: 2017-09-28 12:37:23.742 4255 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:37:23 ctl02 nova-api[4255]: 2017-09-28 12:37:23.742 4255 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:37:23 ctl02 nova-api[4255]: 2017-09-28 12:37:23.742 4255 ERROR nova     max_url_len=max_url_len)
Sep 28 12:37:23 ctl02 nova-api[4255]: 2017-09-28 12:37:23.742 4255 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:37:23 ctl02 nova-api[4255]: 2017-09-28 12:37:23.742 4255 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:37:23 ctl02 nova-api[4255]: 2017-09-28 12:37:23.742 4255 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:37:23 ctl02 nova-api[4255]: 2017-09-28 12:37:23.742 4255 ERROR nova     sock.listen(backlog)
Sep 28 12:37:23 ctl02 nova-api[4255]: 2017-09-28 12:37:23.742 4255 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:37:23 ctl02 nova-api[4255]: 2017-09-28 12:37:23.742 4255 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:37:23 ctl02 nova-api[4255]: 2017-09-28 12:37:23.742 4255 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:37:23 ctl02 nova-api[4255]: 2017-09-28 12:37:23.742 4255 ERROR nova
Sep 28 12:37:23 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:37:23 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:37:23 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:37:24 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:37:24 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:37:24 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:37:24 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:37:24 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:37:24.698 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:37:24] "OPTIONS / HTTP/1.0" 200 134 0.000457
Sep 28 12:37:25 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3ebd216a)
Sep 28 12:37:25 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:37:25.157 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:37:25] "OPTIONS / HTTP/1.0" 200 134 0.000383
Sep 28 12:37:25 ctl02 nova-api[4273]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:37:25 ctl02 nova-api[4273]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:37:25 ctl02 heat-api[13008]: 2017-09-28 12:37:25.955 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:37:25] "OPTIONS / HTTP/1.0" 200 134 0.000601
Sep 28 12:37:26 ctl02 nova-api[4273]: 2017-09-28 12:37:26.027 4273 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:37:26 ctl02 nova-api[4273]: 2017-09-28 12:37:26.029 4273 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:37:26 ctl02 nova-api[4273]: 2017-09-28 12:37:26.029 4273 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:37:26 ctl02 nova-api[4273]: 2017-09-28 12:37:26.029 4273 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:37:26 ctl02 nova-api[4273]: 2017-09-28 12:37:26.029 4273 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:37:26 ctl02 nova-api[4273]: 2017-09-28 12:37:26.029 4273 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:37:26 ctl02 nova-api[4273]: 2017-09-28 12:37:26.029 4273 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:37:26 ctl02 nova-api[4273]: 2017-09-28 12:37:26.029 4273 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:37:26 ctl02 nova-api[4273]: 2017-09-28 12:37:26.029 4273 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:37:26 ctl02 nova-api[4273]: 2017-09-28 12:37:26.029 4273 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:37:26 ctl02 nova-api[4273]: 2017-09-28 12:37:26.029 4273 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:37:26 ctl02 nova-api[4273]: 2017-09-28 12:37:26.029 4273 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:37:26 ctl02 nova-api[4273]: 2017-09-28 12:37:26.029 4273 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:37:26 ctl02 nova-api[4273]: 2017-09-28 12:37:26.029 4273 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:37:26 ctl02 nova-api[4273]: 2017-09-28 12:37:26.029 4273 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:37:26 ctl02 nova-api[4273]: 2017-09-28 12:37:26.029 4273 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:37:26 ctl02 nova-api[4273]: 2017-09-28 12:37:26.029 4273 ERROR nova.wsgi     self.filename))
Sep 28 12:37:26 ctl02 nova-api[4273]: 2017-09-28 12:37:26.029 4273 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:37:26 ctl02 nova-api[4273]: 2017-09-28 12:37:26.029 4273 ERROR nova.wsgi
Sep 28 12:37:26 ctl02 nova-api[4273]: 2017-09-28 12:37:26.030 4273 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:37:26 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3ebd216a)
Sep 28 12:37:26 ctl02 nova-api[4273]: 2017-09-28 12:37:26.160 4273 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:37:26 ctl02 nova-cert[4860]: 2017-09-28 12:37:26.241 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:37:26 ctl02 nova-api[4273]: 2017-09-28 12:37:26.403 4273 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:37:26 ctl02 nova-api[4273]: 2017-09-28 12:37:26.405 4273 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:37:26 ctl02 nova-api[4273]: 2017-09-28 12:37:26.406 4273 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:37:26 ctl02 nova-api[4273]: 2017-09-28 12:37:26.406 4273 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:37:26 ctl02 nova-api[4273]: 2017-09-28 12:37:26.536 4273 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:37:26 ctl02 nova-api[4273]: 2017-09-28 12:37:26.538 4273 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:37:26 ctl02 nova-api[4273]: 2017-09-28 12:37:26.538 4273 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:37:26 ctl02 nova-api[4273]: 2017-09-28 12:37:26.538 4273 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:37:26 ctl02 nova-api[4273]: 2017-09-28 12:37:26.542 4273 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:37:26 ctl02 nova-api[4273]: 2017-09-28 12:37:26.542 4273 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:37:26 ctl02 nova-api[4273]: 2017-09-28 12:37:26.542 4273 ERROR nova Traceback (most recent call last):
Sep 28 12:37:26 ctl02 nova-api[4273]: 2017-09-28 12:37:26.542 4273 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:37:26 ctl02 nova-api[4273]: 2017-09-28 12:37:26.542 4273 ERROR nova     sys.exit(main())
Sep 28 12:37:26 ctl02 nova-api[4273]: 2017-09-28 12:37:26.542 4273 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:37:26 ctl02 nova-api[4273]: 2017-09-28 12:37:26.542 4273 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:37:26 ctl02 nova-api[4273]: 2017-09-28 12:37:26.542 4273 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:37:26 ctl02 nova-api[4273]: 2017-09-28 12:37:26.542 4273 ERROR nova     max_url_len=max_url_len)
Sep 28 12:37:26 ctl02 nova-api[4273]: 2017-09-28 12:37:26.542 4273 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:37:26 ctl02 nova-api[4273]: 2017-09-28 12:37:26.542 4273 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:37:26 ctl02 nova-api[4273]: 2017-09-28 12:37:26.542 4273 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:37:26 ctl02 nova-api[4273]: 2017-09-28 12:37:26.542 4273 ERROR nova     sock.listen(backlog)
Sep 28 12:37:26 ctl02 nova-api[4273]: 2017-09-28 12:37:26.542 4273 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:37:26 ctl02 nova-api[4273]: 2017-09-28 12:37:26.542 4273 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:37:26 ctl02 nova-api[4273]: 2017-09-28 12:37:26.542 4273 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:37:26 ctl02 nova-api[4273]: 2017-09-28 12:37:26.542 4273 ERROR nova
Sep 28 12:37:26 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:37:26 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:37:26 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:37:26 ctl02 nova-conductor[5056]: 2017-09-28 12:37:26.851 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:37:26 ctl02 nova-conductor[5056]: 2017-09-28 12:37:26.875 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:37:26 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:37:26 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:37:26 ctl02 nova-conductor[5056]: 2017-09-28 12:37:26.882 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:37:26 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:37:26 ctl02 nova-conductor[5056]: 2017-09-28 12:37:26.887 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:37:26 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:37:27 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3ebd216a)
Sep 28 12:37:27 ctl02 heat-api[13008]: 2017-09-28 12:37:27.437 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:37:27] "OPTIONS / HTTP/1.0" 200 134 0.000518
Sep 28 12:37:28 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3ebd216a)
Sep 28 12:37:28 ctl02 heat-api[13008]: 2017-09-28 12:37:28.368 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:37:28] "OPTIONS / HTTP/1.0" 200 134 0.000636
Sep 28 12:37:28 ctl02 heat-api-cfn[13300]: 2017-09-28 12:37:28.373 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:37:28] "OPTIONS / HTTP/1.0" 200 134 0.000414
Sep 28 12:37:28 ctl02 heat-api-cfn[13300]: 2017-09-28 12:37:28.491 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:37:28] "OPTIONS / HTTP/1.0" 200 134 0.000362
Sep 28 12:37:28 ctl02 nova-api[4292]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:37:28 ctl02 nova-api[4292]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:37:28 ctl02 nova-api[4292]: 2017-09-28 12:37:28.726 4292 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:37:28 ctl02 nova-api[4292]: 2017-09-28 12:37:28.727 4292 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:37:28 ctl02 nova-api[4292]: 2017-09-28 12:37:28.727 4292 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:37:28 ctl02 nova-api[4292]: 2017-09-28 12:37:28.727 4292 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:37:28 ctl02 nova-api[4292]: 2017-09-28 12:37:28.727 4292 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:37:28 ctl02 nova-api[4292]: 2017-09-28 12:37:28.727 4292 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:37:28 ctl02 nova-api[4292]: 2017-09-28 12:37:28.727 4292 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:37:28 ctl02 nova-api[4292]: 2017-09-28 12:37:28.727 4292 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:37:28 ctl02 nova-api[4292]: 2017-09-28 12:37:28.727 4292 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:37:28 ctl02 nova-api[4292]: 2017-09-28 12:37:28.727 4292 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:37:28 ctl02 nova-api[4292]: 2017-09-28 12:37:28.727 4292 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:37:28 ctl02 nova-api[4292]: 2017-09-28 12:37:28.727 4292 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:37:28 ctl02 nova-api[4292]: 2017-09-28 12:37:28.727 4292 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:37:28 ctl02 nova-api[4292]: 2017-09-28 12:37:28.727 4292 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:37:28 ctl02 nova-api[4292]: 2017-09-28 12:37:28.727 4292 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:37:28 ctl02 nova-api[4292]: 2017-09-28 12:37:28.727 4292 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:37:28 ctl02 nova-api[4292]: 2017-09-28 12:37:28.727 4292 ERROR nova.wsgi     self.filename))
Sep 28 12:37:28 ctl02 nova-api[4292]: 2017-09-28 12:37:28.727 4292 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:37:28 ctl02 nova-api[4292]: 2017-09-28 12:37:28.727 4292 ERROR nova.wsgi
Sep 28 12:37:28 ctl02 nova-api[4292]: 2017-09-28 12:37:28.728 4292 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:37:28 ctl02 nova-api[4292]: 2017-09-28 12:37:28.858 4292 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:37:28 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:37:28.863 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:37:28] "OPTIONS / HTTP/1.0" 200 134 0.000405
Sep 28 12:37:29 ctl02 nova-api[4292]: 2017-09-28 12:37:29.092 4292 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:37:29 ctl02 nova-api[4292]: 2017-09-28 12:37:29.094 4292 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:37:29 ctl02 nova-api[4292]: 2017-09-28 12:37:29.094 4292 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:37:29 ctl02 nova-api[4292]: 2017-09-28 12:37:29.095 4292 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:37:29 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3ebd216a)
Sep 28 12:37:29 ctl02 nova-api[4292]: 2017-09-28 12:37:29.227 4292 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:37:29 ctl02 nova-api[4292]: 2017-09-28 12:37:29.229 4292 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:37:29 ctl02 nova-api[4292]: 2017-09-28 12:37:29.229 4292 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:37:29 ctl02 nova-api[4292]: 2017-09-28 12:37:29.230 4292 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:37:29 ctl02 nova-api[4292]: 2017-09-28 12:37:29.233 4292 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:37:29 ctl02 nova-api[4292]: 2017-09-28 12:37:29.233 4292 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:37:29 ctl02 nova-api[4292]: 2017-09-28 12:37:29.233 4292 ERROR nova Traceback (most recent call last):
Sep 28 12:37:29 ctl02 nova-api[4292]: 2017-09-28 12:37:29.233 4292 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:37:29 ctl02 nova-api[4292]: 2017-09-28 12:37:29.233 4292 ERROR nova     sys.exit(main())
Sep 28 12:37:29 ctl02 nova-api[4292]: 2017-09-28 12:37:29.233 4292 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:37:29 ctl02 nova-api[4292]: 2017-09-28 12:37:29.233 4292 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:37:29 ctl02 nova-api[4292]: 2017-09-28 12:37:29.233 4292 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:37:29 ctl02 nova-api[4292]: 2017-09-28 12:37:29.233 4292 ERROR nova     max_url_len=max_url_len)
Sep 28 12:37:29 ctl02 nova-api[4292]: 2017-09-28 12:37:29.233 4292 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:37:29 ctl02 nova-api[4292]: 2017-09-28 12:37:29.233 4292 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:37:29 ctl02 nova-api[4292]: 2017-09-28 12:37:29.233 4292 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:37:29 ctl02 nova-api[4292]: 2017-09-28 12:37:29.233 4292 ERROR nova     sock.listen(backlog)
Sep 28 12:37:29 ctl02 nova-api[4292]: 2017-09-28 12:37:29.233 4292 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:37:29 ctl02 nova-api[4292]: 2017-09-28 12:37:29.233 4292 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:37:29 ctl02 nova-api[4292]: 2017-09-28 12:37:29.233 4292 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:37:29 ctl02 nova-api[4292]: 2017-09-28 12:37:29.233 4292 ERROR nova
Sep 28 12:37:29 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:37:29 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:37:29 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:37:29 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:37:29 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:37:29 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:37:29 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:37:30 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3ebd216a)
Sep 28 12:37:30 ctl02 neutron-server[30536]: 2017-09-28 12:37:30.301 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:37:30] "OPTIONS / HTTP/1.0" 200 262 0.000615
Sep 28 12:37:30 ctl02 neutron-server[30536]: 2017-09-28 12:37:30.611 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:37:30] "OPTIONS / HTTP/1.0" 200 262 0.000559
Sep 28 12:37:31 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3ebd216a)
Sep 28 12:37:31 ctl02 nova-api[4311]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:37:31 ctl02 nova-api[4311]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:37:31 ctl02 neutron-server[30536]: 2017-09-28 12:37:31.384 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:37:31] "OPTIONS / HTTP/1.0" 200 262 0.000577
Sep 28 12:37:31 ctl02 nova-api[4311]: 2017-09-28 12:37:31.484 4311 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:37:31 ctl02 nova-api[4311]: 2017-09-28 12:37:31.486 4311 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:37:31 ctl02 nova-api[4311]: 2017-09-28 12:37:31.486 4311 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:37:31 ctl02 nova-api[4311]: 2017-09-28 12:37:31.486 4311 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:37:31 ctl02 nova-api[4311]: 2017-09-28 12:37:31.486 4311 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:37:31 ctl02 nova-api[4311]: 2017-09-28 12:37:31.486 4311 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:37:31 ctl02 nova-api[4311]: 2017-09-28 12:37:31.486 4311 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:37:31 ctl02 nova-api[4311]: 2017-09-28 12:37:31.486 4311 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:37:31 ctl02 nova-api[4311]: 2017-09-28 12:37:31.486 4311 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:37:31 ctl02 nova-api[4311]: 2017-09-28 12:37:31.486 4311 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:37:31 ctl02 nova-api[4311]: 2017-09-28 12:37:31.486 4311 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:37:31 ctl02 nova-api[4311]: 2017-09-28 12:37:31.486 4311 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:37:31 ctl02 nova-api[4311]: 2017-09-28 12:37:31.486 4311 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:37:31 ctl02 nova-api[4311]: 2017-09-28 12:37:31.486 4311 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:37:31 ctl02 nova-api[4311]: 2017-09-28 12:37:31.486 4311 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:37:31 ctl02 nova-api[4311]: 2017-09-28 12:37:31.486 4311 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:37:31 ctl02 nova-api[4311]: 2017-09-28 12:37:31.486 4311 ERROR nova.wsgi     self.filename))
Sep 28 12:37:31 ctl02 nova-api[4311]: 2017-09-28 12:37:31.486 4311 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:37:31 ctl02 nova-api[4311]: 2017-09-28 12:37:31.486 4311 ERROR nova.wsgi
Sep 28 12:37:31 ctl02 nova-api[4311]: 2017-09-28 12:37:31.487 4311 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:37:31 ctl02 nova-api[4311]: 2017-09-28 12:37:31.618 4311 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:37:31 ctl02 nova-api[4311]: 2017-09-28 12:37:31.856 4311 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:37:31 ctl02 nova-api[4311]: 2017-09-28 12:37:31.858 4311 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:37:31 ctl02 nova-api[4311]: 2017-09-28 12:37:31.858 4311 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:37:31 ctl02 nova-api[4311]: 2017-09-28 12:37:31.858 4311 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:37:31 ctl02 nova-api[4311]: 2017-09-28 12:37:31.990 4311 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:37:31 ctl02 nova-api[4311]: 2017-09-28 12:37:31.993 4311 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:37:31 ctl02 nova-api[4311]: 2017-09-28 12:37:31.993 4311 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:37:31 ctl02 nova-api[4311]: 2017-09-28 12:37:31.993 4311 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:37:31 ctl02 nova-api[4311]: 2017-09-28 12:37:31.996 4311 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:37:31 ctl02 nova-api[4311]: 2017-09-28 12:37:31.997 4311 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:37:31 ctl02 nova-api[4311]: 2017-09-28 12:37:31.997 4311 ERROR nova Traceback (most recent call last):
Sep 28 12:37:31 ctl02 nova-api[4311]: 2017-09-28 12:37:31.997 4311 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:37:31 ctl02 nova-api[4311]: 2017-09-28 12:37:31.997 4311 ERROR nova     sys.exit(main())
Sep 28 12:37:31 ctl02 nova-api[4311]: 2017-09-28 12:37:31.997 4311 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:37:31 ctl02 nova-api[4311]: 2017-09-28 12:37:31.997 4311 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:37:31 ctl02 nova-api[4311]: 2017-09-28 12:37:31.997 4311 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:37:31 ctl02 nova-api[4311]: 2017-09-28 12:37:31.997 4311 ERROR nova     max_url_len=max_url_len)
Sep 28 12:37:31 ctl02 nova-api[4311]: 2017-09-28 12:37:31.997 4311 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:37:31 ctl02 nova-api[4311]: 2017-09-28 12:37:31.997 4311 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:37:31 ctl02 nova-api[4311]: 2017-09-28 12:37:31.997 4311 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:37:31 ctl02 nova-api[4311]: 2017-09-28 12:37:31.997 4311 ERROR nova     sock.listen(backlog)
Sep 28 12:37:31 ctl02 nova-api[4311]: 2017-09-28 12:37:31.997 4311 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:37:31 ctl02 nova-api[4311]: 2017-09-28 12:37:31.997 4311 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:37:31 ctl02 nova-api[4311]: 2017-09-28 12:37:31.997 4311 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:37:31 ctl02 nova-api[4311]: 2017-09-28 12:37:31.997 4311 ERROR nova
Sep 28 12:37:32 ctl02 glance-api[29183]: 2017-09-28 12:37:32.049 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:37:32] "OPTIONS / HTTP/1.0" 200 134 0.000624
Sep 28 12:37:32 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3ebd216a)
Sep 28 12:37:32 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:37:32 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:37:32 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:37:32 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:37:32 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:37:32 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:37:32 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:37:32 ctl02 glance-api[29183]: 2017-09-28 12:37:32.403 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:37:32] "OPTIONS / HTTP/1.0" 200 134 0.000697
Sep 28 12:37:32 ctl02 glance-api[29183]: 2017-09-28 12:37:32.411 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:37:32] "OPTIONS / HTTP/1.0" 200 134 0.000876
Sep 28 12:37:33 ctl02 heat-api-cfn[13300]: 2017-09-28 12:37:33.003 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:37:33] "OPTIONS / HTTP/1.0" 200 134 0.000477
Sep 28 12:37:33 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3ebd216a)
Sep 28 12:37:34 ctl02 nova-api[4328]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:37:34 ctl02 nova-api[4328]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:37:34 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3ebd216a)
Sep 28 12:37:34 ctl02 nova-api[4328]: 2017-09-28 12:37:34.265 4328 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:37:34 ctl02 nova-api[4328]: 2017-09-28 12:37:34.267 4328 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:37:34 ctl02 nova-api[4328]: 2017-09-28 12:37:34.267 4328 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:37:34 ctl02 nova-api[4328]: 2017-09-28 12:37:34.267 4328 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:37:34 ctl02 nova-api[4328]: 2017-09-28 12:37:34.267 4328 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:37:34 ctl02 nova-api[4328]: 2017-09-28 12:37:34.267 4328 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:37:34 ctl02 nova-api[4328]: 2017-09-28 12:37:34.267 4328 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:37:34 ctl02 nova-api[4328]: 2017-09-28 12:37:34.267 4328 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:37:34 ctl02 nova-api[4328]: 2017-09-28 12:37:34.267 4328 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:37:34 ctl02 nova-api[4328]: 2017-09-28 12:37:34.267 4328 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:37:34 ctl02 nova-api[4328]: 2017-09-28 12:37:34.267 4328 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:37:34 ctl02 nova-api[4328]: 2017-09-28 12:37:34.267 4328 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:37:34 ctl02 nova-api[4328]: 2017-09-28 12:37:34.267 4328 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:37:34 ctl02 nova-api[4328]: 2017-09-28 12:37:34.267 4328 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:37:34 ctl02 nova-api[4328]: 2017-09-28 12:37:34.267 4328 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:37:34 ctl02 nova-api[4328]: 2017-09-28 12:37:34.267 4328 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:37:34 ctl02 nova-api[4328]: 2017-09-28 12:37:34.267 4328 ERROR nova.wsgi     self.filename))
Sep 28 12:37:34 ctl02 nova-api[4328]: 2017-09-28 12:37:34.267 4328 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:37:34 ctl02 nova-api[4328]: 2017-09-28 12:37:34.267 4328 ERROR nova.wsgi
Sep 28 12:37:34 ctl02 nova-api[4328]: 2017-09-28 12:37:34.268 4328 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:37:34 ctl02 nova-api[4328]: 2017-09-28 12:37:34.397 4328 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:37:34 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:37:34.439 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:37:34] "OPTIONS / HTTP/1.0" 200 134 0.000367
Sep 28 12:37:34 ctl02 nova-api[4328]: 2017-09-28 12:37:34.622 4328 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:37:34 ctl02 nova-api[4328]: 2017-09-28 12:37:34.624 4328 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:37:34 ctl02 nova-api[4328]: 2017-09-28 12:37:34.624 4328 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:37:34 ctl02 nova-api[4328]: 2017-09-28 12:37:34.625 4328 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:37:34 ctl02 nova-api[4328]: 2017-09-28 12:37:34.756 4328 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:37:34 ctl02 nova-api[4328]: 2017-09-28 12:37:34.758 4328 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:37:34 ctl02 nova-api[4328]: 2017-09-28 12:37:34.758 4328 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:37:34 ctl02 nova-api[4328]: 2017-09-28 12:37:34.758 4328 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:37:34 ctl02 nova-api[4328]: 2017-09-28 12:37:34.762 4328 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:37:34 ctl02 nova-api[4328]: 2017-09-28 12:37:34.762 4328 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:37:34 ctl02 nova-api[4328]: 2017-09-28 12:37:34.762 4328 ERROR nova Traceback (most recent call last):
Sep 28 12:37:34 ctl02 nova-api[4328]: 2017-09-28 12:37:34.762 4328 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:37:34 ctl02 nova-api[4328]: 2017-09-28 12:37:34.762 4328 ERROR nova     sys.exit(main())
Sep 28 12:37:34 ctl02 nova-api[4328]: 2017-09-28 12:37:34.762 4328 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:37:34 ctl02 nova-api[4328]: 2017-09-28 12:37:34.762 4328 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:37:34 ctl02 nova-api[4328]: 2017-09-28 12:37:34.762 4328 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:37:34 ctl02 nova-api[4328]: 2017-09-28 12:37:34.762 4328 ERROR nova     max_url_len=max_url_len)
Sep 28 12:37:34 ctl02 nova-api[4328]: 2017-09-28 12:37:34.762 4328 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:37:34 ctl02 nova-api[4328]: 2017-09-28 12:37:34.762 4328 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:37:34 ctl02 nova-api[4328]: 2017-09-28 12:37:34.762 4328 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:37:34 ctl02 nova-api[4328]: 2017-09-28 12:37:34.762 4328 ERROR nova     sock.listen(backlog)
Sep 28 12:37:34 ctl02 nova-api[4328]: 2017-09-28 12:37:34.762 4328 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:37:34 ctl02 nova-api[4328]: 2017-09-28 12:37:34.762 4328 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:37:34 ctl02 nova-api[4328]: 2017-09-28 12:37:34.762 4328 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:37:34 ctl02 nova-api[4328]: 2017-09-28 12:37:34.762 4328 ERROR nova
Sep 28 12:37:34 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:37:34 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:37:34 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:37:35 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3ebd216a)
Sep 28 12:37:35 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:37:35 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:37:35 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:37:35 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:37:35 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:37:35.268 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:37:35] "OPTIONS / HTTP/1.0" 200 134 0.000604
Sep 28 12:37:35 ctl02 heat-api[13008]: 2017-09-28 12:37:35.892 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:37:35] "OPTIONS / HTTP/1.0" 200 134 0.000570
Sep 28 12:37:36 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:37:36 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:37:36 ctl02 nova-consoleauth[5433]: 2017-09-28 12:37:36.111 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:37:36 ctl02 neutron-server[30536]: 2017-09-28 12:37:36.353 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 4 dead agents out of 6:
Sep 28 12:37:36 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:37:36 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:36:56 cmp002
Sep 28 12:37:36 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:36:48 cmp001
Sep 28 12:37:36 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:36:50 cmp002
Sep 28 12:37:36 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:37:06 cmp002
Sep 28 12:37:36 ctl02 nova-api[4346]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:37:36 ctl02 nova-api[4346]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:37:36 ctl02 nova-api[4346]: 2017-09-28 12:37:36.997 4346 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:37:36 ctl02 nova-api[4346]: 2017-09-28 12:37:36.998 4346 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:37:36 ctl02 nova-api[4346]: 2017-09-28 12:37:36.998 4346 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:37:36 ctl02 nova-api[4346]: 2017-09-28 12:37:36.998 4346 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:37:36 ctl02 nova-api[4346]: 2017-09-28 12:37:36.998 4346 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:37:36 ctl02 nova-api[4346]: 2017-09-28 12:37:36.998 4346 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:37:36 ctl02 nova-api[4346]: 2017-09-28 12:37:36.998 4346 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:37:36 ctl02 nova-api[4346]: 2017-09-28 12:37:36.998 4346 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:37:36 ctl02 nova-api[4346]: 2017-09-28 12:37:36.998 4346 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:37:36 ctl02 nova-api[4346]: 2017-09-28 12:37:36.998 4346 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:37:37 ctl02 nova-api[4346]: 2017-09-28 12:37:36.998 4346 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:37:37 ctl02 nova-api[4346]: 2017-09-28 12:37:36.998 4346 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:37:37 ctl02 nova-api[4346]: 2017-09-28 12:37:36.998 4346 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:37:37 ctl02 nova-api[4346]: 2017-09-28 12:37:36.998 4346 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:37:37 ctl02 nova-api[4346]: 2017-09-28 12:37:36.998 4346 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:37:37 ctl02 nova-api[4346]: 2017-09-28 12:37:36.998 4346 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:37:37 ctl02 nova-api[4346]: 2017-09-28 12:37:36.998 4346 ERROR nova.wsgi     self.filename))
Sep 28 12:37:37 ctl02 nova-api[4346]: 2017-09-28 12:37:36.998 4346 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:37:37 ctl02 nova-api[4346]: 2017-09-28 12:37:36.998 4346 ERROR nova.wsgi
Sep 28 12:37:37 ctl02 nova-api[4346]: 2017-09-28 12:37:36.999 4346 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:37:37 ctl02 nova-api[4346]: 2017-09-28 12:37:37.130 4346 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:37:37 ctl02 nova-api[4346]: 2017-09-28 12:37:37.350 4346 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:37:37 ctl02 nova-api[4346]: 2017-09-28 12:37:37.352 4346 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:37:37 ctl02 nova-api[4346]: 2017-09-28 12:37:37.352 4346 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:37:37 ctl02 nova-api[4346]: 2017-09-28 12:37:37.353 4346 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:37:37 ctl02 heat-api[13008]: 2017-09-28 12:37:37.483 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:37:37] "OPTIONS / HTTP/1.0" 200 134 0.000545
Sep 28 12:37:37 ctl02 nova-api[4346]: 2017-09-28 12:37:37.486 4346 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:37:37 ctl02 nova-api[4346]: 2017-09-28 12:37:37.488 4346 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:37:37 ctl02 nova-api[4346]: 2017-09-28 12:37:37.488 4346 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:37:37 ctl02 nova-api[4346]: 2017-09-28 12:37:37.489 4346 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:37:37 ctl02 nova-api[4346]: 2017-09-28 12:37:37.492 4346 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:37:37 ctl02 nova-api[4346]: 2017-09-28 12:37:37.492 4346 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:37:37 ctl02 nova-api[4346]: 2017-09-28 12:37:37.492 4346 ERROR nova Traceback (most recent call last):
Sep 28 12:37:37 ctl02 nova-api[4346]: 2017-09-28 12:37:37.492 4346 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:37:37 ctl02 nova-api[4346]: 2017-09-28 12:37:37.492 4346 ERROR nova     sys.exit(main())
Sep 28 12:37:37 ctl02 nova-api[4346]: 2017-09-28 12:37:37.492 4346 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:37:37 ctl02 nova-api[4346]: 2017-09-28 12:37:37.492 4346 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:37:37 ctl02 nova-api[4346]: 2017-09-28 12:37:37.492 4346 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:37:37 ctl02 nova-api[4346]: 2017-09-28 12:37:37.492 4346 ERROR nova     max_url_len=max_url_len)
Sep 28 12:37:37 ctl02 nova-api[4346]: 2017-09-28 12:37:37.492 4346 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:37:37 ctl02 nova-api[4346]: 2017-09-28 12:37:37.492 4346 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:37:37 ctl02 nova-api[4346]: 2017-09-28 12:37:37.492 4346 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:37:37 ctl02 nova-api[4346]: 2017-09-28 12:37:37.492 4346 ERROR nova     sock.listen(backlog)
Sep 28 12:37:37 ctl02 nova-api[4346]: 2017-09-28 12:37:37.492 4346 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:37:37 ctl02 nova-api[4346]: 2017-09-28 12:37:37.492 4346 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:37:37 ctl02 nova-api[4346]: 2017-09-28 12:37:37.492 4346 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:37:37 ctl02 nova-api[4346]: 2017-09-28 12:37:37.492 4346 ERROR nova
Sep 28 12:37:37 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:37:37 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:37:37 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:37:37 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:37:37 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:37:37 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:37:37 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:37:37 ctl02 heat-engine[12803]: 2017-09-28 12:37:37.992 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:37:37 ctl02 heat-engine[12803]: 2017-09-28 12:37:37.997 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:37:37 ctl02 heat-engine[12803]: 2017-09-28 12:37:37.998 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:37:37 ctl02 heat-engine[12803]: 2017-09-28 12:37:37.998 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:37:38 ctl02 heat-api[13008]: 2017-09-28 12:37:38.310 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:37:38] "OPTIONS / HTTP/1.0" 200 134 0.000543
Sep 28 12:37:38 ctl02 heat-api-cfn[13300]: 2017-09-28 12:37:38.337 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:37:38] "OPTIONS / HTTP/1.0" 200 134 0.000414
Sep 28 12:37:38 ctl02 heat-api-cfn[13300]: 2017-09-28 12:37:38.492 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:37:38] "OPTIONS / HTTP/1.0" 200 134 0.000444
Sep 28 12:37:39 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:37:39.048 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:37:39] "OPTIONS / HTTP/1.0" 200 134 0.000442
Sep 28 12:37:39 ctl02 nova-scheduler[5620]: 2017-09-28 12:37:39.167 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:37:39 ctl02 nova-api[4370]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:37:39 ctl02 nova-api[4370]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:37:39 ctl02 nova-api[4370]: 2017-09-28 12:37:39.729 4370 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:37:39 ctl02 nova-api[4370]: 2017-09-28 12:37:39.731 4370 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:37:39 ctl02 nova-api[4370]: 2017-09-28 12:37:39.731 4370 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:37:39 ctl02 nova-api[4370]: 2017-09-28 12:37:39.731 4370 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:37:39 ctl02 nova-api[4370]: 2017-09-28 12:37:39.731 4370 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:37:39 ctl02 nova-api[4370]: 2017-09-28 12:37:39.731 4370 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:37:39 ctl02 nova-api[4370]: 2017-09-28 12:37:39.731 4370 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:37:39 ctl02 nova-api[4370]: 2017-09-28 12:37:39.731 4370 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:37:39 ctl02 nova-api[4370]: 2017-09-28 12:37:39.731 4370 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:37:39 ctl02 nova-api[4370]: 2017-09-28 12:37:39.731 4370 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:37:39 ctl02 nova-api[4370]: 2017-09-28 12:37:39.731 4370 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:37:39 ctl02 nova-api[4370]: 2017-09-28 12:37:39.731 4370 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:37:39 ctl02 nova-api[4370]: 2017-09-28 12:37:39.731 4370 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:37:39 ctl02 nova-api[4370]: 2017-09-28 12:37:39.731 4370 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:37:39 ctl02 nova-api[4370]: 2017-09-28 12:37:39.731 4370 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:37:39 ctl02 nova-api[4370]: 2017-09-28 12:37:39.731 4370 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:37:39 ctl02 nova-api[4370]: 2017-09-28 12:37:39.731 4370 ERROR nova.wsgi     self.filename))
Sep 28 12:37:39 ctl02 nova-api[4370]: 2017-09-28 12:37:39.731 4370 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:37:39 ctl02 nova-api[4370]: 2017-09-28 12:37:39.731 4370 ERROR nova.wsgi
Sep 28 12:37:39 ctl02 nova-api[4370]: 2017-09-28 12:37:39.732 4370 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:37:39 ctl02 nova-api[4370]: 2017-09-28 12:37:39.862 4370 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:37:40 ctl02 nova-api[4370]: 2017-09-28 12:37:40.086 4370 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:37:40 ctl02 nova-api[4370]: 2017-09-28 12:37:40.088 4370 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:37:40 ctl02 nova-api[4370]: 2017-09-28 12:37:40.088 4370 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:37:40 ctl02 nova-api[4370]: 2017-09-28 12:37:40.089 4370 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:37:40 ctl02 nova-api[4370]: 2017-09-28 12:37:40.221 4370 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:37:40 ctl02 nova-api[4370]: 2017-09-28 12:37:40.223 4370 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:37:40 ctl02 nova-api[4370]: 2017-09-28 12:37:40.223 4370 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:37:40 ctl02 nova-api[4370]: 2017-09-28 12:37:40.224 4370 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:37:40 ctl02 nova-api[4370]: 2017-09-28 12:37:40.227 4370 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:37:40 ctl02 nova-api[4370]: 2017-09-28 12:37:40.227 4370 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:37:40 ctl02 nova-api[4370]: 2017-09-28 12:37:40.227 4370 ERROR nova Traceback (most recent call last):
Sep 28 12:37:40 ctl02 nova-api[4370]: 2017-09-28 12:37:40.227 4370 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:37:40 ctl02 nova-api[4370]: 2017-09-28 12:37:40.227 4370 ERROR nova     sys.exit(main())
Sep 28 12:37:40 ctl02 nova-api[4370]: 2017-09-28 12:37:40.227 4370 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:37:40 ctl02 nova-api[4370]: 2017-09-28 12:37:40.227 4370 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:37:40 ctl02 nova-api[4370]: 2017-09-28 12:37:40.227 4370 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:37:40 ctl02 nova-api[4370]: 2017-09-28 12:37:40.227 4370 ERROR nova     max_url_len=max_url_len)
Sep 28 12:37:40 ctl02 nova-api[4370]: 2017-09-28 12:37:40.227 4370 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:37:40 ctl02 nova-api[4370]: 2017-09-28 12:37:40.227 4370 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:37:40 ctl02 nova-api[4370]: 2017-09-28 12:37:40.227 4370 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:37:40 ctl02 nova-api[4370]: 2017-09-28 12:37:40.227 4370 ERROR nova     sock.listen(backlog)
Sep 28 12:37:40 ctl02 nova-api[4370]: 2017-09-28 12:37:40.227 4370 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:37:40 ctl02 nova-api[4370]: 2017-09-28 12:37:40.227 4370 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:37:40 ctl02 nova-api[4370]: 2017-09-28 12:37:40.227 4370 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:37:40 ctl02 nova-api[4370]: 2017-09-28 12:37:40.227 4370 ERROR nova
Sep 28 12:37:40 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:37:40 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:37:40 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:37:40 ctl02 neutron-server[30536]: 2017-09-28 12:37:40.376 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:37:40] "OPTIONS / HTTP/1.0" 200 262 0.000551
Sep 28 12:37:40 ctl02 neutron-server[30536]: 2017-09-28 12:37:40.435 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:37:40] "OPTIONS / HTTP/1.0" 200 262 0.000410
Sep 28 12:37:40 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:37:40 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:37:40 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:37:40 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:37:41 ctl02 neutron-server[30536]: 2017-09-28 12:37:41.369 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:37:41] "OPTIONS / HTTP/1.0" 200 262 0.000464
Sep 28 12:37:41 ctl02 glance-api[29183]: 2017-09-28 12:37:41.882 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:37:41] "OPTIONS / HTTP/1.0" 200 134 0.000628
Sep 28 12:37:42 ctl02 glance-api[29183]: 2017-09-28 12:37:42.166 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:37:42] "OPTIONS / HTTP/1.0" 200 134 0.000638
Sep 28 12:37:42 ctl02 nova-api[4388]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:37:42 ctl02 nova-api[4388]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:37:42 ctl02 nova-api[4388]: 2017-09-28 12:37:42.550 4388 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:37:42 ctl02 nova-api[4388]: 2017-09-28 12:37:42.551 4388 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:37:42 ctl02 nova-api[4388]: 2017-09-28 12:37:42.551 4388 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:37:42 ctl02 nova-api[4388]: 2017-09-28 12:37:42.551 4388 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:37:42 ctl02 nova-api[4388]: 2017-09-28 12:37:42.551 4388 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:37:42 ctl02 nova-api[4388]: 2017-09-28 12:37:42.551 4388 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:37:42 ctl02 nova-api[4388]: 2017-09-28 12:37:42.551 4388 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:37:42 ctl02 nova-api[4388]: 2017-09-28 12:37:42.551 4388 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:37:42 ctl02 nova-api[4388]: 2017-09-28 12:37:42.551 4388 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:37:42 ctl02 nova-api[4388]: 2017-09-28 12:37:42.551 4388 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:37:42 ctl02 nova-api[4388]: 2017-09-28 12:37:42.551 4388 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:37:42 ctl02 nova-api[4388]: 2017-09-28 12:37:42.551 4388 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:37:42 ctl02 nova-api[4388]: 2017-09-28 12:37:42.551 4388 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:37:42 ctl02 nova-api[4388]: 2017-09-28 12:37:42.551 4388 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:37:42 ctl02 nova-api[4388]: 2017-09-28 12:37:42.551 4388 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:37:42 ctl02 nova-api[4388]: 2017-09-28 12:37:42.551 4388 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:37:42 ctl02 nova-api[4388]: 2017-09-28 12:37:42.551 4388 ERROR nova.wsgi     self.filename))
Sep 28 12:37:42 ctl02 nova-api[4388]: 2017-09-28 12:37:42.551 4388 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:37:42 ctl02 nova-api[4388]: 2017-09-28 12:37:42.551 4388 ERROR nova.wsgi
Sep 28 12:37:42 ctl02 nova-api[4388]: 2017-09-28 12:37:42.554 4388 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:37:42 ctl02 glance-api[29183]: 2017-09-28 12:37:42.575 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:37:42] "OPTIONS / HTTP/1.0" 200 134 0.000569
Sep 28 12:37:42 ctl02 nova-api[4388]: 2017-09-28 12:37:42.685 4388 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:37:42 ctl02 heat-api-cfn[13300]: 2017-09-28 12:37:42.768 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:37:42] "OPTIONS / HTTP/1.0" 200 134 0.000495
Sep 28 12:37:42 ctl02 nova-api[4388]: 2017-09-28 12:37:42.909 4388 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:37:42 ctl02 nova-api[4388]: 2017-09-28 12:37:42.912 4388 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:37:42 ctl02 nova-api[4388]: 2017-09-28 12:37:42.912 4388 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:37:42 ctl02 nova-api[4388]: 2017-09-28 12:37:42.913 4388 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:37:43 ctl02 nova-api[4388]: 2017-09-28 12:37:43.046 4388 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:37:43 ctl02 nova-api[4388]: 2017-09-28 12:37:43.048 4388 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:37:43 ctl02 nova-api[4388]: 2017-09-28 12:37:43.049 4388 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:37:43 ctl02 nova-api[4388]: 2017-09-28 12:37:43.049 4388 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:37:43 ctl02 nova-api[4388]: 2017-09-28 12:37:43.052 4388 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:37:43 ctl02 nova-api[4388]: 2017-09-28 12:37:43.053 4388 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:37:43 ctl02 nova-api[4388]: 2017-09-28 12:37:43.053 4388 ERROR nova Traceback (most recent call last):
Sep 28 12:37:43 ctl02 nova-api[4388]: 2017-09-28 12:37:43.053 4388 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:37:43 ctl02 nova-api[4388]: 2017-09-28 12:37:43.053 4388 ERROR nova     sys.exit(main())
Sep 28 12:37:43 ctl02 nova-api[4388]: 2017-09-28 12:37:43.053 4388 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:37:43 ctl02 nova-api[4388]: 2017-09-28 12:37:43.053 4388 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:37:43 ctl02 nova-api[4388]: 2017-09-28 12:37:43.053 4388 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:37:43 ctl02 nova-api[4388]: 2017-09-28 12:37:43.053 4388 ERROR nova     max_url_len=max_url_len)
Sep 28 12:37:43 ctl02 nova-api[4388]: 2017-09-28 12:37:43.053 4388 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:37:43 ctl02 nova-api[4388]: 2017-09-28 12:37:43.053 4388 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:37:43 ctl02 nova-api[4388]: 2017-09-28 12:37:43.053 4388 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:37:43 ctl02 nova-api[4388]: 2017-09-28 12:37:43.053 4388 ERROR nova     sock.listen(backlog)
Sep 28 12:37:43 ctl02 nova-api[4388]: 2017-09-28 12:37:43.053 4388 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:37:43 ctl02 nova-api[4388]: 2017-09-28 12:37:43.053 4388 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:37:43 ctl02 nova-api[4388]: 2017-09-28 12:37:43.053 4388 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:37:43 ctl02 nova-api[4388]: 2017-09-28 12:37:43.053 4388 ERROR nova
Sep 28 12:37:43 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:37:43 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:37:43 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:37:43 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:37:43 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:37:43 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:37:43 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:37:43 ctl02 neutron-server[30536]: 2017-09-28 12:37:43.496 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:37:44 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:37:44.618 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:37:44] "OPTIONS / HTTP/1.0" 200 134 0.000412
Sep 28 12:37:45 ctl02 nova-api[4406]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:37:45 ctl02 nova-api[4406]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:37:45 ctl02 nova-api[4406]: 2017-09-28 12:37:45.252 4406 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:37:45 ctl02 nova-api[4406]: 2017-09-28 12:37:45.253 4406 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:37:45 ctl02 nova-api[4406]: 2017-09-28 12:37:45.253 4406 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:37:45 ctl02 nova-api[4406]: 2017-09-28 12:37:45.253 4406 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:37:45 ctl02 nova-api[4406]: 2017-09-28 12:37:45.253 4406 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:37:45 ctl02 nova-api[4406]: 2017-09-28 12:37:45.253 4406 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:37:45 ctl02 nova-api[4406]: 2017-09-28 12:37:45.253 4406 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:37:45 ctl02 nova-api[4406]: 2017-09-28 12:37:45.253 4406 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:37:45 ctl02 nova-api[4406]: 2017-09-28 12:37:45.253 4406 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:37:45 ctl02 nova-api[4406]: 2017-09-28 12:37:45.253 4406 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:37:45 ctl02 nova-api[4406]: 2017-09-28 12:37:45.253 4406 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:37:45 ctl02 nova-api[4406]: 2017-09-28 12:37:45.253 4406 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:37:45 ctl02 nova-api[4406]: 2017-09-28 12:37:45.253 4406 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:37:45 ctl02 nova-api[4406]: 2017-09-28 12:37:45.253 4406 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:37:45 ctl02 nova-api[4406]: 2017-09-28 12:37:45.253 4406 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:37:45 ctl02 nova-api[4406]: 2017-09-28 12:37:45.253 4406 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:37:45 ctl02 nova-api[4406]: 2017-09-28 12:37:45.253 4406 ERROR nova.wsgi     self.filename))
Sep 28 12:37:45 ctl02 nova-api[4406]: 2017-09-28 12:37:45.253 4406 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:37:45 ctl02 nova-api[4406]: 2017-09-28 12:37:45.253 4406 ERROR nova.wsgi
Sep 28 12:37:45 ctl02 nova-api[4406]: 2017-09-28 12:37:45.254 4406 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:37:45 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:37:45.334 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:37:45] "OPTIONS / HTTP/1.0" 200 134 0.000339
Sep 28 12:37:45 ctl02 nova-api[4406]: 2017-09-28 12:37:45.385 4406 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:37:45 ctl02 nova-api[4406]: 2017-09-28 12:37:45.607 4406 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:37:45 ctl02 nova-api[4406]: 2017-09-28 12:37:45.609 4406 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:37:45 ctl02 nova-api[4406]: 2017-09-28 12:37:45.610 4406 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:37:45 ctl02 nova-api[4406]: 2017-09-28 12:37:45.610 4406 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:37:45 ctl02 nova-api[4406]: 2017-09-28 12:37:45.743 4406 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:37:45 ctl02 nova-api[4406]: 2017-09-28 12:37:45.746 4406 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:37:45 ctl02 nova-api[4406]: 2017-09-28 12:37:45.746 4406 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:37:45 ctl02 nova-api[4406]: 2017-09-28 12:37:45.746 4406 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:37:45 ctl02 nova-api[4406]: 2017-09-28 12:37:45.750 4406 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:37:45 ctl02 nova-api[4406]: 2017-09-28 12:37:45.750 4406 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:37:45 ctl02 nova-api[4406]: 2017-09-28 12:37:45.750 4406 ERROR nova Traceback (most recent call last):
Sep 28 12:37:45 ctl02 nova-api[4406]: 2017-09-28 12:37:45.750 4406 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:37:45 ctl02 nova-api[4406]: 2017-09-28 12:37:45.750 4406 ERROR nova     sys.exit(main())
Sep 28 12:37:45 ctl02 nova-api[4406]: 2017-09-28 12:37:45.750 4406 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:37:45 ctl02 nova-api[4406]: 2017-09-28 12:37:45.750 4406 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:37:45 ctl02 nova-api[4406]: 2017-09-28 12:37:45.750 4406 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:37:45 ctl02 nova-api[4406]: 2017-09-28 12:37:45.750 4406 ERROR nova     max_url_len=max_url_len)
Sep 28 12:37:45 ctl02 nova-api[4406]: 2017-09-28 12:37:45.750 4406 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:37:45 ctl02 nova-api[4406]: 2017-09-28 12:37:45.750 4406 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:37:45 ctl02 nova-api[4406]: 2017-09-28 12:37:45.750 4406 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:37:45 ctl02 nova-api[4406]: 2017-09-28 12:37:45.750 4406 ERROR nova     sock.listen(backlog)
Sep 28 12:37:45 ctl02 nova-api[4406]: 2017-09-28 12:37:45.750 4406 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:37:45 ctl02 nova-api[4406]: 2017-09-28 12:37:45.750 4406 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:37:45 ctl02 nova-api[4406]: 2017-09-28 12:37:45.750 4406 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:37:45 ctl02 nova-api[4406]: 2017-09-28 12:37:45.750 4406 ERROR nova
Sep 28 12:37:45 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:37:45 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:37:45 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:37:46 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:37:46 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:37:46 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:37:46 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:37:46 ctl02 heat-api[13008]: 2017-09-28 12:37:46.210 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:37:46] "OPTIONS / HTTP/1.0" 200 134 0.000544
Sep 28 12:37:47 ctl02 heat-api[13008]: 2017-09-28 12:37:47.467 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:37:47] "OPTIONS / HTTP/1.0" 200 134 0.000510
Sep 28 12:37:47 ctl02 nova-api[4424]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:37:47 ctl02 nova-api[4424]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:37:47 ctl02 nova-api[4424]: 2017-09-28 12:37:47.967 4424 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:37:47 ctl02 nova-api[4424]: 2017-09-28 12:37:47.968 4424 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:37:47 ctl02 nova-api[4424]: 2017-09-28 12:37:47.968 4424 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:37:47 ctl02 nova-api[4424]: 2017-09-28 12:37:47.968 4424 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:37:47 ctl02 nova-api[4424]: 2017-09-28 12:37:47.968 4424 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:37:47 ctl02 nova-api[4424]: 2017-09-28 12:37:47.968 4424 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:37:47 ctl02 nova-api[4424]: 2017-09-28 12:37:47.968 4424 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:37:47 ctl02 nova-api[4424]: 2017-09-28 12:37:47.968 4424 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:37:47 ctl02 nova-api[4424]: 2017-09-28 12:37:47.968 4424 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:37:47 ctl02 nova-api[4424]: 2017-09-28 12:37:47.968 4424 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:37:47 ctl02 nova-api[4424]: 2017-09-28 12:37:47.968 4424 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:37:47 ctl02 nova-api[4424]: 2017-09-28 12:37:47.968 4424 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:37:47 ctl02 nova-api[4424]: 2017-09-28 12:37:47.968 4424 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:37:47 ctl02 nova-api[4424]: 2017-09-28 12:37:47.968 4424 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:37:47 ctl02 nova-api[4424]: 2017-09-28 12:37:47.968 4424 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:37:47 ctl02 nova-api[4424]: 2017-09-28 12:37:47.968 4424 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:37:47 ctl02 nova-api[4424]: 2017-09-28 12:37:47.968 4424 ERROR nova.wsgi     self.filename))
Sep 28 12:37:47 ctl02 nova-api[4424]: 2017-09-28 12:37:47.968 4424 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:37:47 ctl02 nova-api[4424]: 2017-09-28 12:37:47.968 4424 ERROR nova.wsgi
Sep 28 12:37:47 ctl02 nova-api[4424]: 2017-09-28 12:37:47.971 4424 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:37:48 ctl02 heat-api-cfn[13300]: 2017-09-28 12:37:48.085 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:37:48] "OPTIONS / HTTP/1.0" 200 134 0.000449
Sep 28 12:37:48 ctl02 nova-api[4424]: 2017-09-28 12:37:48.098 4424 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:37:48 ctl02 nova-api[4424]: 2017-09-28 12:37:48.320 4424 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:37:48 ctl02 nova-api[4424]: 2017-09-28 12:37:48.322 4424 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:37:48 ctl02 nova-api[4424]: 2017-09-28 12:37:48.322 4424 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:37:48 ctl02 nova-api[4424]: 2017-09-28 12:37:48.322 4424 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:37:48 ctl02 nova-api[4424]: 2017-09-28 12:37:48.452 4424 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:37:48 ctl02 nova-api[4424]: 2017-09-28 12:37:48.454 4424 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:37:48 ctl02 nova-api[4424]: 2017-09-28 12:37:48.455 4424 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:37:48 ctl02 nova-api[4424]: 2017-09-28 12:37:48.455 4424 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:37:48 ctl02 nova-api[4424]: 2017-09-28 12:37:48.458 4424 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:37:48 ctl02 nova-api[4424]: 2017-09-28 12:37:48.459 4424 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:37:48 ctl02 nova-api[4424]: 2017-09-28 12:37:48.459 4424 ERROR nova Traceback (most recent call last):
Sep 28 12:37:48 ctl02 nova-api[4424]: 2017-09-28 12:37:48.459 4424 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:37:48 ctl02 nova-api[4424]: 2017-09-28 12:37:48.459 4424 ERROR nova     sys.exit(main())
Sep 28 12:37:48 ctl02 nova-api[4424]: 2017-09-28 12:37:48.459 4424 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:37:48 ctl02 nova-api[4424]: 2017-09-28 12:37:48.459 4424 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:37:48 ctl02 nova-api[4424]: 2017-09-28 12:37:48.459 4424 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:37:48 ctl02 nova-api[4424]: 2017-09-28 12:37:48.459 4424 ERROR nova     max_url_len=max_url_len)
Sep 28 12:37:48 ctl02 nova-api[4424]: 2017-09-28 12:37:48.459 4424 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:37:48 ctl02 nova-api[4424]: 2017-09-28 12:37:48.459 4424 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:37:48 ctl02 nova-api[4424]: 2017-09-28 12:37:48.459 4424 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:37:48 ctl02 nova-api[4424]: 2017-09-28 12:37:48.459 4424 ERROR nova     sock.listen(backlog)
Sep 28 12:37:48 ctl02 nova-api[4424]: 2017-09-28 12:37:48.459 4424 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:37:48 ctl02 nova-api[4424]: 2017-09-28 12:37:48.459 4424 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:37:48 ctl02 nova-api[4424]: 2017-09-28 12:37:48.459 4424 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:37:48 ctl02 nova-api[4424]: 2017-09-28 12:37:48.459 4424 ERROR nova
Sep 28 12:37:48 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:37:48 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:37:48 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:37:48 ctl02 heat-api[13008]: 2017-09-28 12:37:48.637 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:37:48] "OPTIONS / HTTP/1.0" 200 134 0.000546
Sep 28 12:37:48 ctl02 heat-api-cfn[13300]: 2017-09-28 12:37:48.832 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:37:48] "OPTIONS / HTTP/1.0" 200 134 0.000640
Sep 28 12:37:48 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:37:48 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:37:48 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:37:48 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:37:49 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:37:49.178 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:37:49] "OPTIONS / HTTP/1.0" 200 134 0.000522
Sep 28 12:37:50 ctl02 nova-api[4441]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:37:50 ctl02 nova-api[4441]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:37:50 ctl02 neutron-server[30536]: 2017-09-28 12:37:50.636 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:37:50] "OPTIONS / HTTP/1.0" 200 262 0.000491
Sep 28 12:37:50 ctl02 neutron-server[30536]: 2017-09-28 12:37:50.678 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:37:50] "OPTIONS / HTTP/1.0" 200 262 0.000486
Sep 28 12:37:50 ctl02 nova-api[4441]: 2017-09-28 12:37:50.737 4441 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:37:50 ctl02 nova-api[4441]: 2017-09-28 12:37:50.739 4441 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:37:50 ctl02 nova-api[4441]: 2017-09-28 12:37:50.739 4441 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:37:50 ctl02 nova-api[4441]: 2017-09-28 12:37:50.739 4441 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:37:50 ctl02 nova-api[4441]: 2017-09-28 12:37:50.739 4441 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:37:50 ctl02 nova-api[4441]: 2017-09-28 12:37:50.739 4441 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:37:50 ctl02 nova-api[4441]: 2017-09-28 12:37:50.739 4441 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:37:50 ctl02 nova-api[4441]: 2017-09-28 12:37:50.739 4441 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:37:50 ctl02 nova-api[4441]: 2017-09-28 12:37:50.739 4441 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:37:50 ctl02 nova-api[4441]: 2017-09-28 12:37:50.739 4441 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:37:50 ctl02 nova-api[4441]: 2017-09-28 12:37:50.739 4441 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:37:50 ctl02 nova-api[4441]: 2017-09-28 12:37:50.739 4441 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:37:50 ctl02 nova-api[4441]: 2017-09-28 12:37:50.739 4441 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:37:50 ctl02 nova-api[4441]: 2017-09-28 12:37:50.739 4441 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:37:50 ctl02 nova-api[4441]: 2017-09-28 12:37:50.739 4441 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:37:50 ctl02 nova-api[4441]: 2017-09-28 12:37:50.739 4441 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:37:50 ctl02 nova-api[4441]: 2017-09-28 12:37:50.739 4441 ERROR nova.wsgi     self.filename))
Sep 28 12:37:50 ctl02 nova-api[4441]: 2017-09-28 12:37:50.739 4441 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:37:50 ctl02 nova-api[4441]: 2017-09-28 12:37:50.739 4441 ERROR nova.wsgi
Sep 28 12:37:50 ctl02 nova-api[4441]: 2017-09-28 12:37:50.741 4441 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:37:50 ctl02 nova-api[4441]: 2017-09-28 12:37:50.869 4441 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:37:51 ctl02 nova-api[4441]: 2017-09-28 12:37:51.097 4441 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:37:51 ctl02 nova-api[4441]: 2017-09-28 12:37:51.099 4441 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:37:51 ctl02 nova-api[4441]: 2017-09-28 12:37:51.100 4441 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:37:51 ctl02 nova-api[4441]: 2017-09-28 12:37:51.100 4441 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:37:51 ctl02 nova-api[4441]: 2017-09-28 12:37:51.235 4441 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:37:51 ctl02 nova-api[4441]: 2017-09-28 12:37:51.237 4441 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:37:51 ctl02 nova-api[4441]: 2017-09-28 12:37:51.238 4441 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:37:51 ctl02 nova-api[4441]: 2017-09-28 12:37:51.238 4441 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:37:51 ctl02 nova-api[4441]: 2017-09-28 12:37:51.241 4441 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:37:51 ctl02 nova-api[4441]: 2017-09-28 12:37:51.242 4441 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:37:51 ctl02 nova-api[4441]: 2017-09-28 12:37:51.242 4441 ERROR nova Traceback (most recent call last):
Sep 28 12:37:51 ctl02 nova-api[4441]: 2017-09-28 12:37:51.242 4441 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:37:51 ctl02 nova-api[4441]: 2017-09-28 12:37:51.242 4441 ERROR nova     sys.exit(main())
Sep 28 12:37:51 ctl02 nova-api[4441]: 2017-09-28 12:37:51.242 4441 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:37:51 ctl02 nova-api[4441]: 2017-09-28 12:37:51.242 4441 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:37:51 ctl02 nova-api[4441]: 2017-09-28 12:37:51.242 4441 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:37:51 ctl02 nova-api[4441]: 2017-09-28 12:37:51.242 4441 ERROR nova     max_url_len=max_url_len)
Sep 28 12:37:51 ctl02 nova-api[4441]: 2017-09-28 12:37:51.242 4441 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:37:51 ctl02 nova-api[4441]: 2017-09-28 12:37:51.242 4441 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:37:51 ctl02 nova-api[4441]: 2017-09-28 12:37:51.242 4441 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:37:51 ctl02 nova-api[4441]: 2017-09-28 12:37:51.242 4441 ERROR nova     sock.listen(backlog)
Sep 28 12:37:51 ctl02 nova-api[4441]: 2017-09-28 12:37:51.242 4441 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:37:51 ctl02 nova-api[4441]: 2017-09-28 12:37:51.242 4441 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:37:51 ctl02 nova-api[4441]: 2017-09-28 12:37:51.242 4441 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:37:51 ctl02 nova-api[4441]: 2017-09-28 12:37:51.242 4441 ERROR nova
Sep 28 12:37:51 ctl02 neutron-server[30536]: 2017-09-28 12:37:51.350 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 4 dead agents out of 6:
Sep 28 12:37:51 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:37:51 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:36:56 cmp002
Sep 28 12:37:51 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:36:48 cmp001
Sep 28 12:37:51 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:36:50 cmp002
Sep 28 12:37:51 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:37:06 cmp002
Sep 28 12:37:51 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:37:51 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:37:51 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:37:51 ctl02 neutron-server[30536]: 2017-09-28 12:37:51.591 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:37:51] "OPTIONS / HTTP/1.0" 200 262 0.000640
Sep 28 12:37:51 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:37:51 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:37:51 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:37:51 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:37:51 ctl02 glance-api[29183]: 2017-09-28 12:37:51.956 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:37:51] "OPTIONS / HTTP/1.0" 200 134 0.000693
Sep 28 12:37:52 ctl02 glance-api[29183]: 2017-09-28 12:37:52.329 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:37:52] "OPTIONS / HTTP/1.0" 200 134 0.000547
Sep 28 12:37:52 ctl02 glance-api[29183]: 2017-09-28 12:37:52.464 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:37:52] "OPTIONS / HTTP/1.0" 200 134 0.000449
Sep 28 12:37:52 ctl02 heat-api-cfn[13300]: 2017-09-28 12:37:52.506 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:37:52] "OPTIONS / HTTP/1.0" 200 134 0.000559
Sep 28 12:37:53 ctl02 nova-api[4460]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:37:53 ctl02 nova-api[4460]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:37:53 ctl02 nova-api[4460]: 2017-09-28 12:37:53.501 4460 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:37:53 ctl02 nova-api[4460]: 2017-09-28 12:37:53.502 4460 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:37:53 ctl02 nova-api[4460]: 2017-09-28 12:37:53.502 4460 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:37:53 ctl02 nova-api[4460]: 2017-09-28 12:37:53.502 4460 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:37:53 ctl02 nova-api[4460]: 2017-09-28 12:37:53.502 4460 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:37:53 ctl02 nova-api[4460]: 2017-09-28 12:37:53.502 4460 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:37:53 ctl02 nova-api[4460]: 2017-09-28 12:37:53.502 4460 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:37:53 ctl02 nova-api[4460]: 2017-09-28 12:37:53.502 4460 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:37:53 ctl02 nova-api[4460]: 2017-09-28 12:37:53.502 4460 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:37:53 ctl02 nova-api[4460]: 2017-09-28 12:37:53.502 4460 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:37:53 ctl02 nova-api[4460]: 2017-09-28 12:37:53.502 4460 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:37:53 ctl02 nova-api[4460]: 2017-09-28 12:37:53.502 4460 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:37:53 ctl02 nova-api[4460]: 2017-09-28 12:37:53.502 4460 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:37:53 ctl02 nova-api[4460]: 2017-09-28 12:37:53.502 4460 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:37:53 ctl02 nova-api[4460]: 2017-09-28 12:37:53.502 4460 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:37:53 ctl02 nova-api[4460]: 2017-09-28 12:37:53.502 4460 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:37:53 ctl02 nova-api[4460]: 2017-09-28 12:37:53.502 4460 ERROR nova.wsgi     self.filename))
Sep 28 12:37:53 ctl02 nova-api[4460]: 2017-09-28 12:37:53.502 4460 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:37:53 ctl02 nova-api[4460]: 2017-09-28 12:37:53.502 4460 ERROR nova.wsgi
Sep 28 12:37:53 ctl02 nova-api[4460]: 2017-09-28 12:37:53.503 4460 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:37:53 ctl02 nova-api[4460]: 2017-09-28 12:37:53.629 4460 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:37:53 ctl02 nova-api[4460]: 2017-09-28 12:37:53.846 4460 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:37:53 ctl02 nova-api[4460]: 2017-09-28 12:37:53.848 4460 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:37:53 ctl02 nova-api[4460]: 2017-09-28 12:37:53.848 4460 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:37:53 ctl02 nova-api[4460]: 2017-09-28 12:37:53.849 4460 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:37:53 ctl02 nova-api[4460]: 2017-09-28 12:37:53.978 4460 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:37:53 ctl02 nova-api[4460]: 2017-09-28 12:37:53.980 4460 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:37:53 ctl02 nova-api[4460]: 2017-09-28 12:37:53.980 4460 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:37:53 ctl02 nova-api[4460]: 2017-09-28 12:37:53.980 4460 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:37:53 ctl02 nova-api[4460]: 2017-09-28 12:37:53.984 4460 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:37:53 ctl02 nova-api[4460]: 2017-09-28 12:37:53.984 4460 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:37:53 ctl02 nova-api[4460]: 2017-09-28 12:37:53.984 4460 ERROR nova Traceback (most recent call last):
Sep 28 12:37:53 ctl02 nova-api[4460]: 2017-09-28 12:37:53.984 4460 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:37:53 ctl02 nova-api[4460]: 2017-09-28 12:37:53.984 4460 ERROR nova     sys.exit(main())
Sep 28 12:37:53 ctl02 nova-api[4460]: 2017-09-28 12:37:53.984 4460 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:37:53 ctl02 nova-api[4460]: 2017-09-28 12:37:53.984 4460 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:37:53 ctl02 nova-api[4460]: 2017-09-28 12:37:53.984 4460 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:37:53 ctl02 nova-api[4460]: 2017-09-28 12:37:53.984 4460 ERROR nova     max_url_len=max_url_len)
Sep 28 12:37:53 ctl02 nova-api[4460]: 2017-09-28 12:37:53.984 4460 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:37:53 ctl02 nova-api[4460]: 2017-09-28 12:37:53.984 4460 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:37:53 ctl02 nova-api[4460]: 2017-09-28 12:37:53.984 4460 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:37:53 ctl02 nova-api[4460]: 2017-09-28 12:37:53.984 4460 ERROR nova     sock.listen(backlog)
Sep 28 12:37:53 ctl02 nova-api[4460]: 2017-09-28 12:37:53.984 4460 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:37:53 ctl02 nova-api[4460]: 2017-09-28 12:37:53.984 4460 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:37:53 ctl02 nova-api[4460]: 2017-09-28 12:37:53.984 4460 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:37:53 ctl02 nova-api[4460]: 2017-09-28 12:37:53.984 4460 ERROR nova
Sep 28 12:37:54 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:37:54 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:37:54 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:37:54 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:37:54 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:37:54 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:37:54 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:37:54 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:37:54.436 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:37:54] "OPTIONS / HTTP/1.0" 200 134 0.000460
Sep 28 12:37:55 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:37:55.356 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:37:55] "OPTIONS / HTTP/1.0" 200 134 0.000394
Sep 28 12:37:56 ctl02 nova-api[4478]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:37:56 ctl02 nova-api[4478]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:37:56 ctl02 neutron-server[30536]: 2017-09-28 12:37:56.207 30602 WARNING oslo_messaging._drivers.amqpdriver [req-9ab51703-16bb-4bb7-8bbc-3fe47316893c - - - - -] reply_74787a9d28524b7f9c3c98994688cba9 doesn't exists, drop reply to 4c402144b0fd4f8fb6017f7eb068df97
Sep 28 12:37:56 ctl02 neutron-server[30536]: 2017-09-28 12:37:56.207 30602 INFO oslo_messaging._drivers.amqpdriver [req-9ab51703-16bb-4bb7-8bbc-3fe47316893c - - - - -] The reply 4c402144b0fd4f8fb6017f7eb068df97 cannot be sent  reply_74787a9d28524b7f9c3c98994688cba9 reply queue don't exist after 60 sec abandoning...
Sep 28 12:37:56 ctl02 nova-api[4478]: 2017-09-28 12:37:56.241 4478 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:37:56 ctl02 nova-api[4478]: 2017-09-28 12:37:56.243 4478 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:37:56 ctl02 nova-api[4478]: 2017-09-28 12:37:56.243 4478 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:37:56 ctl02 nova-api[4478]: 2017-09-28 12:37:56.243 4478 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:37:56 ctl02 nova-api[4478]: 2017-09-28 12:37:56.243 4478 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:37:56 ctl02 nova-api[4478]: 2017-09-28 12:37:56.243 4478 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:37:56 ctl02 nova-api[4478]: 2017-09-28 12:37:56.243 4478 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:37:56 ctl02 nova-api[4478]: 2017-09-28 12:37:56.243 4478 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:37:56 ctl02 nova-api[4478]: 2017-09-28 12:37:56.243 4478 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:37:56 ctl02 nova-api[4478]: 2017-09-28 12:37:56.243 4478 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:37:56 ctl02 nova-api[4478]: 2017-09-28 12:37:56.243 4478 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:37:56 ctl02 nova-api[4478]: 2017-09-28 12:37:56.243 4478 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:37:56 ctl02 nova-api[4478]: 2017-09-28 12:37:56.243 4478 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:37:56 ctl02 nova-api[4478]: 2017-09-28 12:37:56.243 4478 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:37:56 ctl02 nova-api[4478]: 2017-09-28 12:37:56.243 4478 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:37:56 ctl02 nova-api[4478]: 2017-09-28 12:37:56.243 4478 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:37:56 ctl02 nova-api[4478]: 2017-09-28 12:37:56.243 4478 ERROR nova.wsgi     self.filename))
Sep 28 12:37:56 ctl02 nova-api[4478]: 2017-09-28 12:37:56.243 4478 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:37:56 ctl02 nova-api[4478]: 2017-09-28 12:37:56.243 4478 ERROR nova.wsgi
Sep 28 12:37:56 ctl02 nova-api[4478]: 2017-09-28 12:37:56.244 4478 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:37:56 ctl02 nova-api[4478]: 2017-09-28 12:37:56.377 4478 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:37:56 ctl02 heat-api[13008]: 2017-09-28 12:37:56.397 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:37:56] "OPTIONS / HTTP/1.0" 200 134 0.000542
Sep 28 12:37:56 ctl02 nova-api[4478]: 2017-09-28 12:37:56.603 4478 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:37:56 ctl02 nova-api[4478]: 2017-09-28 12:37:56.606 4478 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:37:56 ctl02 nova-api[4478]: 2017-09-28 12:37:56.606 4478 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:37:56 ctl02 nova-api[4478]: 2017-09-28 12:37:56.607 4478 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:37:56 ctl02 nova-api[4478]: 2017-09-28 12:37:56.740 4478 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:37:56 ctl02 nova-api[4478]: 2017-09-28 12:37:56.742 4478 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:37:56 ctl02 nova-api[4478]: 2017-09-28 12:37:56.742 4478 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:37:56 ctl02 nova-api[4478]: 2017-09-28 12:37:56.743 4478 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:37:56 ctl02 nova-api[4478]: 2017-09-28 12:37:56.746 4478 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:37:56 ctl02 nova-api[4478]: 2017-09-28 12:37:56.747 4478 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:37:56 ctl02 nova-api[4478]: 2017-09-28 12:37:56.747 4478 ERROR nova Traceback (most recent call last):
Sep 28 12:37:56 ctl02 nova-api[4478]: 2017-09-28 12:37:56.747 4478 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:37:56 ctl02 nova-api[4478]: 2017-09-28 12:37:56.747 4478 ERROR nova     sys.exit(main())
Sep 28 12:37:56 ctl02 nova-api[4478]: 2017-09-28 12:37:56.747 4478 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:37:56 ctl02 nova-api[4478]: 2017-09-28 12:37:56.747 4478 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:37:56 ctl02 nova-api[4478]: 2017-09-28 12:37:56.747 4478 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:37:56 ctl02 nova-api[4478]: 2017-09-28 12:37:56.747 4478 ERROR nova     max_url_len=max_url_len)
Sep 28 12:37:56 ctl02 nova-api[4478]: 2017-09-28 12:37:56.747 4478 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:37:56 ctl02 nova-api[4478]: 2017-09-28 12:37:56.747 4478 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:37:56 ctl02 nova-api[4478]: 2017-09-28 12:37:56.747 4478 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:37:56 ctl02 nova-api[4478]: 2017-09-28 12:37:56.747 4478 ERROR nova     sock.listen(backlog)
Sep 28 12:37:56 ctl02 nova-api[4478]: 2017-09-28 12:37:56.747 4478 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:37:56 ctl02 nova-api[4478]: 2017-09-28 12:37:56.747 4478 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:37:56 ctl02 nova-api[4478]: 2017-09-28 12:37:56.747 4478 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:37:56 ctl02 nova-api[4478]: 2017-09-28 12:37:56.747 4478 ERROR nova
Sep 28 12:37:56 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:37:56 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:37:56 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:37:57 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:37:57 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:37:57 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:37:57 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:37:57 ctl02 heat-api[13008]: 2017-09-28 12:37:57.187 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:37:57] "OPTIONS / HTTP/1.0" 200 134 0.000686
Sep 28 12:37:57 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdac8f538)
Sep 28 12:37:58 ctl02 heat-api-cfn[13300]: 2017-09-28 12:37:58.131 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:37:58] "OPTIONS / HTTP/1.0" 200 134 0.000446
Sep 28 12:37:58 ctl02 nova-cert[4860]: 2017-09-28 12:37:58.281 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:37:58 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdac8f538)
Sep 28 12:37:58 ctl02 heat-api[13008]: 2017-09-28 12:37:58.489 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:37:58] "OPTIONS / HTTP/1.0" 200 134 0.000495
Sep 28 12:37:58 ctl02 neutron-server[30536]: 2017-09-28 12:37:58.504 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:37:58 ctl02 heat-api-cfn[13300]: 2017-09-28 12:37:58.799 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:37:58] "OPTIONS / HTTP/1.0" 200 134 0.000408
Sep 28 12:37:58 ctl02 nova-api[4497]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:37:58 ctl02 nova-api[4497]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:37:58 ctl02 nova-conductor[5056]: 2017-09-28 12:37:58.862 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:37:58 ctl02 nova-conductor[5056]: 2017-09-28 12:37:58.884 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:37:58 ctl02 nova-conductor[5056]: 2017-09-28 12:37:58.890 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:37:58 ctl02 nova-conductor[5056]: 2017-09-28 12:37:58.898 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:37:58 ctl02 nova-api[4497]: 2017-09-28 12:37:58.970 4497 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:37:58 ctl02 nova-api[4497]: 2017-09-28 12:37:58.971 4497 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:37:58 ctl02 nova-api[4497]: 2017-09-28 12:37:58.971 4497 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:37:58 ctl02 nova-api[4497]: 2017-09-28 12:37:58.971 4497 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:37:58 ctl02 nova-api[4497]: 2017-09-28 12:37:58.971 4497 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:37:58 ctl02 nova-api[4497]: 2017-09-28 12:37:58.971 4497 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:37:58 ctl02 nova-api[4497]: 2017-09-28 12:37:58.971 4497 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:37:58 ctl02 nova-api[4497]: 2017-09-28 12:37:58.971 4497 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:37:58 ctl02 nova-api[4497]: 2017-09-28 12:37:58.971 4497 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:37:58 ctl02 nova-api[4497]: 2017-09-28 12:37:58.971 4497 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:37:58 ctl02 nova-api[4497]: 2017-09-28 12:37:58.971 4497 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:37:58 ctl02 nova-api[4497]: 2017-09-28 12:37:58.971 4497 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:37:58 ctl02 nova-api[4497]: 2017-09-28 12:37:58.971 4497 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:37:58 ctl02 nova-api[4497]: 2017-09-28 12:37:58.971 4497 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:37:58 ctl02 nova-api[4497]: 2017-09-28 12:37:58.971 4497 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:37:58 ctl02 nova-api[4497]: 2017-09-28 12:37:58.971 4497 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:37:58 ctl02 nova-api[4497]: 2017-09-28 12:37:58.971 4497 ERROR nova.wsgi     self.filename))
Sep 28 12:37:58 ctl02 nova-api[4497]: 2017-09-28 12:37:58.971 4497 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:37:58 ctl02 nova-api[4497]: 2017-09-28 12:37:58.971 4497 ERROR nova.wsgi
Sep 28 12:37:58 ctl02 nova-api[4497]: 2017-09-28 12:37:58.972 4497 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:37:59 ctl02 nova-api[4497]: 2017-09-28 12:37:59.098 4497 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:37:59 ctl02 nova-api[4497]: 2017-09-28 12:37:59.310 4497 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:37:59 ctl02 nova-api[4497]: 2017-09-28 12:37:59.312 4497 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:37:59 ctl02 nova-api[4497]: 2017-09-28 12:37:59.313 4497 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:37:59 ctl02 nova-api[4497]: 2017-09-28 12:37:59.313 4497 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:37:59 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdac8f538)
Sep 28 12:37:59 ctl02 nova-api[4497]: 2017-09-28 12:37:59.441 4497 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:37:59 ctl02 nova-api[4497]: 2017-09-28 12:37:59.443 4497 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:37:59 ctl02 nova-api[4497]: 2017-09-28 12:37:59.443 4497 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:37:59 ctl02 nova-api[4497]: 2017-09-28 12:37:59.443 4497 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:37:59 ctl02 nova-api[4497]: 2017-09-28 12:37:59.446 4497 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:37:59 ctl02 nova-api[4497]: 2017-09-28 12:37:59.447 4497 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:37:59 ctl02 nova-api[4497]: 2017-09-28 12:37:59.447 4497 ERROR nova Traceback (most recent call last):
Sep 28 12:37:59 ctl02 nova-api[4497]: 2017-09-28 12:37:59.447 4497 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:37:59 ctl02 nova-api[4497]: 2017-09-28 12:37:59.447 4497 ERROR nova     sys.exit(main())
Sep 28 12:37:59 ctl02 nova-api[4497]: 2017-09-28 12:37:59.447 4497 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:37:59 ctl02 nova-api[4497]: 2017-09-28 12:37:59.447 4497 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:37:59 ctl02 nova-api[4497]: 2017-09-28 12:37:59.447 4497 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:37:59 ctl02 nova-api[4497]: 2017-09-28 12:37:59.447 4497 ERROR nova     max_url_len=max_url_len)
Sep 28 12:37:59 ctl02 nova-api[4497]: 2017-09-28 12:37:59.447 4497 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:37:59 ctl02 nova-api[4497]: 2017-09-28 12:37:59.447 4497 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:37:59 ctl02 nova-api[4497]: 2017-09-28 12:37:59.447 4497 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:37:59 ctl02 nova-api[4497]: 2017-09-28 12:37:59.447 4497 ERROR nova     sock.listen(backlog)
Sep 28 12:37:59 ctl02 nova-api[4497]: 2017-09-28 12:37:59.447 4497 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:37:59 ctl02 nova-api[4497]: 2017-09-28 12:37:59.447 4497 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:37:59 ctl02 nova-api[4497]: 2017-09-28 12:37:59.447 4497 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:37:59 ctl02 nova-api[4497]: 2017-09-28 12:37:59.447 4497 ERROR nova
Sep 28 12:37:59 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:37:59.481 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:37:59] "OPTIONS / HTTP/1.0" 200 134 0.000373
Sep 28 12:37:59 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:37:59 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:37:59 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:37:59 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:37:59 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:37:59 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:37:59 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:38:00 ctl02 neutron-server[30536]: 2017-09-28 12:38:00.290 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:38:00] "OPTIONS / HTTP/1.0" 200 262 0.000456
Sep 28 12:38:00 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdac8f538)
Sep 28 12:38:00 ctl02 neutron-server[30536]: 2017-09-28 12:38:00.544 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:38:00] "OPTIONS / HTTP/1.0" 200 262 0.000472
Sep 28 12:38:01 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdac8f538)
Sep 28 12:38:01 ctl02 nova-api[4514]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:38:01 ctl02 nova-api[4514]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:38:01 ctl02 neutron-server[30536]: 2017-09-28 12:38:01.701 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:38:01] "OPTIONS / HTTP/1.0" 200 262 0.000453
Sep 28 12:38:01 ctl02 nova-api[4514]: 2017-09-28 12:38:01.718 4514 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:38:01 ctl02 nova-api[4514]: 2017-09-28 12:38:01.719 4514 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:38:01 ctl02 nova-api[4514]: 2017-09-28 12:38:01.719 4514 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:38:01 ctl02 nova-api[4514]: 2017-09-28 12:38:01.719 4514 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:38:01 ctl02 nova-api[4514]: 2017-09-28 12:38:01.719 4514 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:38:01 ctl02 nova-api[4514]: 2017-09-28 12:38:01.719 4514 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:38:01 ctl02 nova-api[4514]: 2017-09-28 12:38:01.719 4514 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:38:01 ctl02 nova-api[4514]: 2017-09-28 12:38:01.719 4514 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:38:01 ctl02 nova-api[4514]: 2017-09-28 12:38:01.719 4514 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:38:01 ctl02 nova-api[4514]: 2017-09-28 12:38:01.719 4514 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:38:01 ctl02 nova-api[4514]: 2017-09-28 12:38:01.719 4514 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:38:01 ctl02 nova-api[4514]: 2017-09-28 12:38:01.719 4514 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:38:01 ctl02 nova-api[4514]: 2017-09-28 12:38:01.719 4514 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:38:01 ctl02 nova-api[4514]: 2017-09-28 12:38:01.719 4514 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:38:01 ctl02 nova-api[4514]: 2017-09-28 12:38:01.719 4514 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:38:01 ctl02 nova-api[4514]: 2017-09-28 12:38:01.719 4514 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:38:01 ctl02 nova-api[4514]: 2017-09-28 12:38:01.719 4514 ERROR nova.wsgi     self.filename))
Sep 28 12:38:01 ctl02 nova-api[4514]: 2017-09-28 12:38:01.719 4514 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:38:01 ctl02 nova-api[4514]: 2017-09-28 12:38:01.719 4514 ERROR nova.wsgi
Sep 28 12:38:01 ctl02 nova-api[4514]: 2017-09-28 12:38:01.722 4514 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:38:01 ctl02 nova-api[4514]: 2017-09-28 12:38:01.850 4514 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:38:02 ctl02 nova-api[4514]: 2017-09-28 12:38:02.074 4514 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:38:02 ctl02 nova-api[4514]: 2017-09-28 12:38:02.077 4514 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:38:02 ctl02 nova-api[4514]: 2017-09-28 12:38:02.077 4514 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:38:02 ctl02 nova-api[4514]: 2017-09-28 12:38:02.077 4514 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:38:02 ctl02 nova-api[4514]: 2017-09-28 12:38:02.209 4514 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:38:02 ctl02 nova-api[4514]: 2017-09-28 12:38:02.211 4514 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:38:02 ctl02 nova-api[4514]: 2017-09-28 12:38:02.211 4514 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:38:02 ctl02 nova-api[4514]: 2017-09-28 12:38:02.212 4514 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:38:02 ctl02 nova-api[4514]: 2017-09-28 12:38:02.215 4514 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:38:02 ctl02 nova-api[4514]: 2017-09-28 12:38:02.215 4514 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:38:02 ctl02 nova-api[4514]: 2017-09-28 12:38:02.215 4514 ERROR nova Traceback (most recent call last):
Sep 28 12:38:02 ctl02 nova-api[4514]: 2017-09-28 12:38:02.215 4514 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:38:02 ctl02 nova-api[4514]: 2017-09-28 12:38:02.215 4514 ERROR nova     sys.exit(main())
Sep 28 12:38:02 ctl02 nova-api[4514]: 2017-09-28 12:38:02.215 4514 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:38:02 ctl02 nova-api[4514]: 2017-09-28 12:38:02.215 4514 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:38:02 ctl02 nova-api[4514]: 2017-09-28 12:38:02.215 4514 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:38:02 ctl02 nova-api[4514]: 2017-09-28 12:38:02.215 4514 ERROR nova     max_url_len=max_url_len)
Sep 28 12:38:02 ctl02 nova-api[4514]: 2017-09-28 12:38:02.215 4514 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:38:02 ctl02 nova-api[4514]: 2017-09-28 12:38:02.215 4514 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:38:02 ctl02 nova-api[4514]: 2017-09-28 12:38:02.215 4514 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:38:02 ctl02 nova-api[4514]: 2017-09-28 12:38:02.215 4514 ERROR nova     sock.listen(backlog)
Sep 28 12:38:02 ctl02 nova-api[4514]: 2017-09-28 12:38:02.215 4514 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:38:02 ctl02 nova-api[4514]: 2017-09-28 12:38:02.215 4514 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:38:02 ctl02 nova-api[4514]: 2017-09-28 12:38:02.215 4514 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:38:02 ctl02 nova-api[4514]: 2017-09-28 12:38:02.215 4514 ERROR nova
Sep 28 12:38:02 ctl02 glance-api[29183]: 2017-09-28 12:38:02.307 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:38:02] "OPTIONS / HTTP/1.0" 200 134 0.000551
Sep 28 12:38:02 ctl02 glance-api[29183]: 2017-09-28 12:38:02.353 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:38:02] "OPTIONS / HTTP/1.0" 200 134 0.000763
Sep 28 12:38:02 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:38:02 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:38:02 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:38:02 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdac8f538)
Sep 28 12:38:02 ctl02 heat-api-cfn[13300]: 2017-09-28 12:38:02.610 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:38:02] "OPTIONS / HTTP/1.0" 200 134 0.000593
Sep 28 12:38:02 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:38:02 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:38:02 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:38:02 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:38:02 ctl02 glance-api[29183]: 2017-09-28 12:38:02.746 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:38:02] "OPTIONS / HTTP/1.0" 200 134 0.000584
Sep 28 12:38:03 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdac8f538)
Sep 28 12:38:04 ctl02 nova-api[4533]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:38:04 ctl02 nova-api[4533]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:38:04 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdac8f538)
Sep 28 12:38:04 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:38:04.412 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:38:04] "OPTIONS / HTTP/1.0" 200 134 0.000480
Sep 28 12:38:04 ctl02 nova-api[4533]: 2017-09-28 12:38:04.505 4533 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:38:04 ctl02 nova-api[4533]: 2017-09-28 12:38:04.507 4533 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:38:04 ctl02 nova-api[4533]: 2017-09-28 12:38:04.507 4533 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:38:04 ctl02 nova-api[4533]: 2017-09-28 12:38:04.507 4533 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:38:04 ctl02 nova-api[4533]: 2017-09-28 12:38:04.507 4533 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:38:04 ctl02 nova-api[4533]: 2017-09-28 12:38:04.507 4533 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:38:04 ctl02 nova-api[4533]: 2017-09-28 12:38:04.507 4533 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:38:04 ctl02 nova-api[4533]: 2017-09-28 12:38:04.507 4533 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:38:04 ctl02 nova-api[4533]: 2017-09-28 12:38:04.507 4533 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:38:04 ctl02 nova-api[4533]: 2017-09-28 12:38:04.507 4533 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:38:04 ctl02 nova-api[4533]: 2017-09-28 12:38:04.507 4533 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:38:04 ctl02 nova-api[4533]: 2017-09-28 12:38:04.507 4533 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:38:04 ctl02 nova-api[4533]: 2017-09-28 12:38:04.507 4533 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:38:04 ctl02 nova-api[4533]: 2017-09-28 12:38:04.507 4533 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:38:04 ctl02 nova-api[4533]: 2017-09-28 12:38:04.507 4533 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:38:04 ctl02 nova-api[4533]: 2017-09-28 12:38:04.507 4533 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:38:04 ctl02 nova-api[4533]: 2017-09-28 12:38:04.507 4533 ERROR nova.wsgi     self.filename))
Sep 28 12:38:04 ctl02 nova-api[4533]: 2017-09-28 12:38:04.507 4533 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:38:04 ctl02 nova-api[4533]: 2017-09-28 12:38:04.507 4533 ERROR nova.wsgi
Sep 28 12:38:04 ctl02 nova-api[4533]: 2017-09-28 12:38:04.508 4533 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:38:04 ctl02 nova-api[4533]: 2017-09-28 12:38:04.643 4533 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:38:04 ctl02 dhclient[600]: DHCPREQUEST of 192.168.11.25 on ens2 to 192.168.11.3 port 67 (xid=0x3415f07)
Sep 28 12:38:04 ctl02 dhclient[600]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 12:38:04 ctl02 nova-api[4533]: 2017-09-28 12:38:04.888 4533 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:38:04 ctl02 nova-api[4533]: 2017-09-28 12:38:04.890 4533 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:38:04 ctl02 nova-api[4533]: 2017-09-28 12:38:04.890 4533 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:38:04 ctl02 nova-api[4533]: 2017-09-28 12:38:04.890 4533 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:38:04 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 12:38:04 ctl02 ntp[4599]:  * Stopping NTP server ntpd
Sep 28 12:38:04 ctl02 ntp[4599]:    ...done.
Sep 28 12:38:04 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 12:38:04 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 12:38:04 ctl02 ntp[4610]:  * Starting NTP server ntpd
Sep 28 12:38:04 ctl02 ntpd[4617]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 12:38:04 ctl02 ntpd[4617]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -c /var/lib/ntp/ntp.conf.dhcp -u 108:112
Sep 28 12:38:04 ctl02 ntp[4610]:    ...done.
Sep 28 12:38:04 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 12:38:04 ctl02 ntpd[4620]: proto: precision = 0.042 usec (-24)
Sep 28 12:38:04 ctl02 ntpd[4620]: switching logging to file /var/log/ntp.log
Sep 28 12:38:05 ctl02 nova-api[4533]: 2017-09-28 12:38:05.026 4533 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:38:05 ctl02 nova-api[4533]: 2017-09-28 12:38:05.028 4533 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:38:05 ctl02 dhclient[600]: bound to 192.168.11.25 -- renewal in 259 seconds.
Sep 28 12:38:05 ctl02 nova-api[4533]: 2017-09-28 12:38:05.028 4533 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:38:05 ctl02 nova-api[4533]: 2017-09-28 12:38:05.029 4533 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:38:05 ctl02 nova-api[4533]: 2017-09-28 12:38:05.032 4533 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:38:05 ctl02 nova-api[4533]: 2017-09-28 12:38:05.032 4533 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:38:05 ctl02 nova-api[4533]: 2017-09-28 12:38:05.032 4533 ERROR nova Traceback (most recent call last):
Sep 28 12:38:05 ctl02 nova-api[4533]: 2017-09-28 12:38:05.032 4533 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:38:05 ctl02 nova-api[4533]: 2017-09-28 12:38:05.032 4533 ERROR nova     sys.exit(main())
Sep 28 12:38:05 ctl02 nova-api[4533]: 2017-09-28 12:38:05.032 4533 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:38:05 ctl02 nova-api[4533]: 2017-09-28 12:38:05.032 4533 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:38:05 ctl02 nova-api[4533]: 2017-09-28 12:38:05.032 4533 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:38:05 ctl02 nova-api[4533]: 2017-09-28 12:38:05.032 4533 ERROR nova     max_url_len=max_url_len)
Sep 28 12:38:05 ctl02 nova-api[4533]: 2017-09-28 12:38:05.032 4533 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:38:05 ctl02 nova-api[4533]: 2017-09-28 12:38:05.032 4533 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:38:05 ctl02 nova-api[4533]: 2017-09-28 12:38:05.032 4533 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:38:05 ctl02 nova-api[4533]: 2017-09-28 12:38:05.032 4533 ERROR nova     sock.listen(backlog)
Sep 28 12:38:05 ctl02 nova-api[4533]: 2017-09-28 12:38:05.032 4533 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:38:05 ctl02 nova-api[4533]: 2017-09-28 12:38:05.032 4533 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:38:05 ctl02 nova-api[4533]: 2017-09-28 12:38:05.032 4533 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:38:05 ctl02 nova-api[4533]: 2017-09-28 12:38:05.032 4533 ERROR nova
Sep 28 12:38:05 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:38:05 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:38:05 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:38:05 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdac8f538)
Sep 28 12:38:05 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:38:05 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:38:05 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:38:05 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:38:05 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:38:05.659 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:38:05] "OPTIONS / HTTP/1.0" 200 134 0.000485
Sep 28 12:38:06 ctl02 neutron-server[30536]: 2017-09-28 12:38:06.346 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 4 dead agents out of 6:
Sep 28 12:38:06 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:38:06 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:36:56 cmp002
Sep 28 12:38:06 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:36:48 cmp001
Sep 28 12:38:06 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:36:50 cmp002
Sep 28 12:38:06 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:37:06 cmp002
Sep 28 12:38:06 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdac8f538)
Sep 28 12:38:06 ctl02 heat-api[13008]: 2017-09-28 12:38:06.781 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:38:06] "OPTIONS / HTTP/1.0" 200 134 0.000693
Sep 28 12:38:07 ctl02 nova-api[4633]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:38:07 ctl02 nova-api[4633]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:38:07 ctl02 heat-api[13008]: 2017-09-28 12:38:07.219 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:38:07] "OPTIONS / HTTP/1.0" 200 134 0.000630
Sep 28 12:38:07 ctl02 nova-api[4633]: 2017-09-28 12:38:07.278 4633 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:38:07 ctl02 nova-api[4633]: 2017-09-28 12:38:07.279 4633 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:38:07 ctl02 nova-api[4633]: 2017-09-28 12:38:07.279 4633 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:38:07 ctl02 nova-api[4633]: 2017-09-28 12:38:07.279 4633 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:38:07 ctl02 nova-api[4633]: 2017-09-28 12:38:07.279 4633 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:38:07 ctl02 nova-api[4633]: 2017-09-28 12:38:07.279 4633 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:38:07 ctl02 nova-api[4633]: 2017-09-28 12:38:07.279 4633 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:38:07 ctl02 nova-api[4633]: 2017-09-28 12:38:07.279 4633 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:38:07 ctl02 nova-api[4633]: 2017-09-28 12:38:07.279 4633 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:38:07 ctl02 nova-api[4633]: 2017-09-28 12:38:07.279 4633 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:38:07 ctl02 nova-api[4633]: 2017-09-28 12:38:07.279 4633 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:38:07 ctl02 nova-api[4633]: 2017-09-28 12:38:07.279 4633 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:38:07 ctl02 nova-api[4633]: 2017-09-28 12:38:07.279 4633 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:38:07 ctl02 nova-api[4633]: 2017-09-28 12:38:07.279 4633 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:38:07 ctl02 nova-api[4633]: 2017-09-28 12:38:07.279 4633 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:38:07 ctl02 nova-api[4633]: 2017-09-28 12:38:07.279 4633 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:38:07 ctl02 nova-api[4633]: 2017-09-28 12:38:07.279 4633 ERROR nova.wsgi     self.filename))
Sep 28 12:38:07 ctl02 nova-api[4633]: 2017-09-28 12:38:07.279 4633 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:38:07 ctl02 nova-api[4633]: 2017-09-28 12:38:07.279 4633 ERROR nova.wsgi
Sep 28 12:38:07 ctl02 nova-api[4633]: 2017-09-28 12:38:07.280 4633 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:38:07 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdac8f538)
Sep 28 12:38:07 ctl02 nova-api[4633]: 2017-09-28 12:38:07.408 4633 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:38:07 ctl02 nova-api[4633]: 2017-09-28 12:38:07.649 4633 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:38:07 ctl02 nova-api[4633]: 2017-09-28 12:38:07.651 4633 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:38:07 ctl02 nova-api[4633]: 2017-09-28 12:38:07.652 4633 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:38:07 ctl02 nova-api[4633]: 2017-09-28 12:38:07.652 4633 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:38:07 ctl02 nova-api[4633]: 2017-09-28 12:38:07.784 4633 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:38:07 ctl02 nova-api[4633]: 2017-09-28 12:38:07.786 4633 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:38:07 ctl02 nova-api[4633]: 2017-09-28 12:38:07.786 4633 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:38:07 ctl02 nova-api[4633]: 2017-09-28 12:38:07.786 4633 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:38:07 ctl02 nova-api[4633]: 2017-09-28 12:38:07.789 4633 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:38:07 ctl02 nova-api[4633]: 2017-09-28 12:38:07.790 4633 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:38:07 ctl02 nova-api[4633]: 2017-09-28 12:38:07.790 4633 ERROR nova Traceback (most recent call last):
Sep 28 12:38:07 ctl02 nova-api[4633]: 2017-09-28 12:38:07.790 4633 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:38:07 ctl02 nova-api[4633]: 2017-09-28 12:38:07.790 4633 ERROR nova     sys.exit(main())
Sep 28 12:38:07 ctl02 nova-api[4633]: 2017-09-28 12:38:07.790 4633 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:38:07 ctl02 nova-api[4633]: 2017-09-28 12:38:07.790 4633 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:38:07 ctl02 nova-api[4633]: 2017-09-28 12:38:07.790 4633 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:38:07 ctl02 nova-api[4633]: 2017-09-28 12:38:07.790 4633 ERROR nova     max_url_len=max_url_len)
Sep 28 12:38:07 ctl02 nova-api[4633]: 2017-09-28 12:38:07.790 4633 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:38:07 ctl02 nova-api[4633]: 2017-09-28 12:38:07.790 4633 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:38:07 ctl02 nova-api[4633]: 2017-09-28 12:38:07.790 4633 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:38:07 ctl02 nova-api[4633]: 2017-09-28 12:38:07.790 4633 ERROR nova     sock.listen(backlog)
Sep 28 12:38:07 ctl02 nova-api[4633]: 2017-09-28 12:38:07.790 4633 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:38:07 ctl02 nova-api[4633]: 2017-09-28 12:38:07.790 4633 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:38:07 ctl02 nova-api[4633]: 2017-09-28 12:38:07.790 4633 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:38:07 ctl02 nova-api[4633]: 2017-09-28 12:38:07.790 4633 ERROR nova
Sep 28 12:38:07 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:38:07 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:38:07 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:38:08 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:38:08 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:38:08 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:38:08 ctl02 nova-consoleauth[5433]: 2017-09-28 12:38:08.145 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:38:08 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:38:08 ctl02 heat-api-cfn[13300]: 2017-09-28 12:38:08.266 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:38:08] "OPTIONS / HTTP/1.0" 200 134 0.000437
Sep 28 12:38:08 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:38:08 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:38:08 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 12:38:08 ctl02 ntp[4706]:  * Stopping NTP server ntpd
Sep 28 12:38:08 ctl02 ntp[4706]:    ...done.
Sep 28 12:38:08 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 12:38:08 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 12:38:08 ctl02 ntp[4717]:  * Starting NTP server ntpd
Sep 28 12:38:08 ctl02 ntpd[4724]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 12:38:08 ctl02 ntpd[4724]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 12:38:08 ctl02 ntp[4717]:    ...done.
Sep 28 12:38:08 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 12:38:08 ctl02 ntpd[4727]: proto: precision = 0.042 usec (-24)
Sep 28 12:38:08 ctl02 ntpd[4727]: switching logging to file /var/log/ntp.log
Sep 28 12:38:08 ctl02 heat-api-cfn[13300]: 2017-09-28 12:38:08.658 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:38:08] "OPTIONS / HTTP/1.0" 200 134 0.000469
Sep 28 12:38:08 ctl02 heat-api[13008]: 2017-09-28 12:38:08.739 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:38:08] "OPTIONS / HTTP/1.0" 200 134 0.000685
Sep 28 12:38:09 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:38:09.223 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:38:09] "OPTIONS / HTTP/1.0" 200 134 0.000485
Sep 28 12:38:09 ctl02 nova-api[4651]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:38:09 ctl02 nova-api[4651]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:38:10 ctl02 nova-api[4651]: 2017-09-28 12:38:10.001 4651 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:38:10 ctl02 heat-engine[12803]: 2017-09-28 12:38:10.001 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:38:10 ctl02 nova-api[4651]: 2017-09-28 12:38:10.003 4651 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:38:10 ctl02 nova-api[4651]: 2017-09-28 12:38:10.003 4651 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:38:10 ctl02 nova-api[4651]: 2017-09-28 12:38:10.003 4651 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:38:10 ctl02 nova-api[4651]: 2017-09-28 12:38:10.003 4651 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:38:10 ctl02 nova-api[4651]: 2017-09-28 12:38:10.003 4651 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:38:10 ctl02 nova-api[4651]: 2017-09-28 12:38:10.003 4651 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:38:10 ctl02 nova-api[4651]: 2017-09-28 12:38:10.003 4651 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:38:10 ctl02 nova-api[4651]: 2017-09-28 12:38:10.003 4651 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:38:10 ctl02 nova-api[4651]: 2017-09-28 12:38:10.003 4651 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:38:10 ctl02 nova-api[4651]: 2017-09-28 12:38:10.003 4651 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:38:10 ctl02 nova-api[4651]: 2017-09-28 12:38:10.003 4651 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:38:10 ctl02 nova-api[4651]: 2017-09-28 12:38:10.003 4651 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:38:10 ctl02 nova-api[4651]: 2017-09-28 12:38:10.003 4651 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:38:10 ctl02 nova-api[4651]: 2017-09-28 12:38:10.003 4651 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:38:10 ctl02 nova-api[4651]: 2017-09-28 12:38:10.003 4651 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:38:10 ctl02 nova-api[4651]: 2017-09-28 12:38:10.003 4651 ERROR nova.wsgi     self.filename))
Sep 28 12:38:10 ctl02 nova-api[4651]: 2017-09-28 12:38:10.003 4651 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:38:10 ctl02 nova-api[4651]: 2017-09-28 12:38:10.003 4651 ERROR nova.wsgi
Sep 28 12:38:10 ctl02 nova-api[4651]: 2017-09-28 12:38:10.004 4651 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:38:10 ctl02 heat-engine[12803]: 2017-09-28 12:38:10.005 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:38:10 ctl02 heat-engine[12803]: 2017-09-28 12:38:10.006 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:38:10 ctl02 heat-engine[12803]: 2017-09-28 12:38:10.010 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:38:10 ctl02 nova-api[4651]: 2017-09-28 12:38:10.135 4651 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:38:10 ctl02 nova-api[4651]: 2017-09-28 12:38:10.402 4651 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:38:10 ctl02 nova-api[4651]: 2017-09-28 12:38:10.404 4651 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:38:10 ctl02 nova-api[4651]: 2017-09-28 12:38:10.404 4651 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:38:10 ctl02 nova-api[4651]: 2017-09-28 12:38:10.405 4651 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:38:10 ctl02 nova-api[4651]: 2017-09-28 12:38:10.535 4651 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:38:10 ctl02 nova-api[4651]: 2017-09-28 12:38:10.537 4651 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:38:10 ctl02 nova-api[4651]: 2017-09-28 12:38:10.537 4651 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:38:10 ctl02 nova-api[4651]: 2017-09-28 12:38:10.537 4651 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:38:10 ctl02 nova-api[4651]: 2017-09-28 12:38:10.540 4651 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:38:10 ctl02 nova-api[4651]: 2017-09-28 12:38:10.541 4651 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:38:10 ctl02 nova-api[4651]: 2017-09-28 12:38:10.541 4651 ERROR nova Traceback (most recent call last):
Sep 28 12:38:10 ctl02 nova-api[4651]: 2017-09-28 12:38:10.541 4651 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:38:10 ctl02 nova-api[4651]: 2017-09-28 12:38:10.541 4651 ERROR nova     sys.exit(main())
Sep 28 12:38:10 ctl02 nova-api[4651]: 2017-09-28 12:38:10.541 4651 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:38:10 ctl02 nova-api[4651]: 2017-09-28 12:38:10.541 4651 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:38:10 ctl02 nova-api[4651]: 2017-09-28 12:38:10.541 4651 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:38:10 ctl02 nova-api[4651]: 2017-09-28 12:38:10.541 4651 ERROR nova     max_url_len=max_url_len)
Sep 28 12:38:10 ctl02 nova-api[4651]: 2017-09-28 12:38:10.541 4651 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:38:10 ctl02 nova-api[4651]: 2017-09-28 12:38:10.541 4651 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:38:10 ctl02 nova-api[4651]: 2017-09-28 12:38:10.541 4651 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:38:10 ctl02 nova-api[4651]: 2017-09-28 12:38:10.541 4651 ERROR nova     sock.listen(backlog)
Sep 28 12:38:10 ctl02 nova-api[4651]: 2017-09-28 12:38:10.541 4651 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:38:10 ctl02 nova-api[4651]: 2017-09-28 12:38:10.541 4651 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:38:10 ctl02 nova-api[4651]: 2017-09-28 12:38:10.541 4651 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:38:10 ctl02 nova-api[4651]: 2017-09-28 12:38:10.541 4651 ERROR nova
Sep 28 12:38:10 ctl02 neutron-server[30536]: 2017-09-28 12:38:10.578 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:38:10] "OPTIONS / HTTP/1.0" 200 262 0.000570
Sep 28 12:38:10 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:38:10 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:38:10 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:38:10 ctl02 neutron-server[30536]: 2017-09-28 12:38:10.752 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:38:10] "OPTIONS / HTTP/1.0" 200 262 0.000577
Sep 28 12:38:10 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:38:10 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:38:10 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:38:10 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:38:11 ctl02 nova-scheduler[5620]: 2017-09-28 12:38:11.231 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:38:11 ctl02 neutron-server[30536]: 2017-09-28 12:38:11.547 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:38:11] "OPTIONS / HTTP/1.0" 200 262 0.000510
Sep 28 12:38:11 ctl02 glance-api[29183]: 2017-09-28 12:38:11.969 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:38:11] "OPTIONS / HTTP/1.0" 200 134 0.000748
Sep 28 12:38:12 ctl02 glance-api[29183]: 2017-09-28 12:38:12.097 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:38:12] "OPTIONS / HTTP/1.0" 200 134 0.000630
Sep 28 12:38:12 ctl02 nova-api[4740]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:38:12 ctl02 nova-api[4740]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:38:12 ctl02 heat-api-cfn[13300]: 2017-09-28 12:38:12.764 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:38:12] "OPTIONS / HTTP/1.0" 200 134 0.000527
Sep 28 12:38:12 ctl02 nova-api[4740]: 2017-09-28 12:38:12.819 4740 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:38:12 ctl02 nova-api[4740]: 2017-09-28 12:38:12.821 4740 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:38:12 ctl02 nova-api[4740]: 2017-09-28 12:38:12.821 4740 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:38:12 ctl02 nova-api[4740]: 2017-09-28 12:38:12.821 4740 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:38:12 ctl02 nova-api[4740]: 2017-09-28 12:38:12.821 4740 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:38:12 ctl02 nova-api[4740]: 2017-09-28 12:38:12.821 4740 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:38:12 ctl02 nova-api[4740]: 2017-09-28 12:38:12.821 4740 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:38:12 ctl02 nova-api[4740]: 2017-09-28 12:38:12.821 4740 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:38:12 ctl02 nova-api[4740]: 2017-09-28 12:38:12.821 4740 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:38:12 ctl02 nova-api[4740]: 2017-09-28 12:38:12.821 4740 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:38:12 ctl02 nova-api[4740]: 2017-09-28 12:38:12.821 4740 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:38:12 ctl02 nova-api[4740]: 2017-09-28 12:38:12.821 4740 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:38:12 ctl02 nova-api[4740]: 2017-09-28 12:38:12.821 4740 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:38:12 ctl02 nova-api[4740]: 2017-09-28 12:38:12.821 4740 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:38:12 ctl02 nova-api[4740]: 2017-09-28 12:38:12.821 4740 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:38:12 ctl02 nova-api[4740]: 2017-09-28 12:38:12.821 4740 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:38:12 ctl02 nova-api[4740]: 2017-09-28 12:38:12.821 4740 ERROR nova.wsgi     self.filename))
Sep 28 12:38:12 ctl02 nova-api[4740]: 2017-09-28 12:38:12.821 4740 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:38:12 ctl02 nova-api[4740]: 2017-09-28 12:38:12.821 4740 ERROR nova.wsgi
Sep 28 12:38:12 ctl02 nova-api[4740]: 2017-09-28 12:38:12.823 4740 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:38:12 ctl02 glance-api[29183]: 2017-09-28 12:38:12.917 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:38:12] "OPTIONS / HTTP/1.0" 200 134 0.000640
Sep 28 12:38:12 ctl02 nova-api[4740]: 2017-09-28 12:38:12.958 4740 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:38:13 ctl02 nova-api[4740]: 2017-09-28 12:38:13.203 4740 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:38:13 ctl02 nova-api[4740]: 2017-09-28 12:38:13.206 4740 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:38:13 ctl02 nova-api[4740]: 2017-09-28 12:38:13.206 4740 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:38:13 ctl02 nova-api[4740]: 2017-09-28 12:38:13.206 4740 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:38:13 ctl02 nova-api[4740]: 2017-09-28 12:38:13.341 4740 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:38:13 ctl02 nova-api[4740]: 2017-09-28 12:38:13.343 4740 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:38:13 ctl02 nova-api[4740]: 2017-09-28 12:38:13.343 4740 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:38:13 ctl02 nova-api[4740]: 2017-09-28 12:38:13.343 4740 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:38:13 ctl02 nova-api[4740]: 2017-09-28 12:38:13.347 4740 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:38:13 ctl02 nova-api[4740]: 2017-09-28 12:38:13.347 4740 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:38:13 ctl02 nova-api[4740]: 2017-09-28 12:38:13.347 4740 ERROR nova Traceback (most recent call last):
Sep 28 12:38:13 ctl02 nova-api[4740]: 2017-09-28 12:38:13.347 4740 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:38:13 ctl02 nova-api[4740]: 2017-09-28 12:38:13.347 4740 ERROR nova     sys.exit(main())
Sep 28 12:38:13 ctl02 nova-api[4740]: 2017-09-28 12:38:13.347 4740 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:38:13 ctl02 nova-api[4740]: 2017-09-28 12:38:13.347 4740 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:38:13 ctl02 nova-api[4740]: 2017-09-28 12:38:13.347 4740 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:38:13 ctl02 nova-api[4740]: 2017-09-28 12:38:13.347 4740 ERROR nova     max_url_len=max_url_len)
Sep 28 12:38:13 ctl02 nova-api[4740]: 2017-09-28 12:38:13.347 4740 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:38:13 ctl02 nova-api[4740]: 2017-09-28 12:38:13.347 4740 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:38:13 ctl02 nova-api[4740]: 2017-09-28 12:38:13.347 4740 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:38:13 ctl02 nova-api[4740]: 2017-09-28 12:38:13.347 4740 ERROR nova     sock.listen(backlog)
Sep 28 12:38:13 ctl02 nova-api[4740]: 2017-09-28 12:38:13.347 4740 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:38:13 ctl02 nova-api[4740]: 2017-09-28 12:38:13.347 4740 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:38:13 ctl02 nova-api[4740]: 2017-09-28 12:38:13.347 4740 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:38:13 ctl02 nova-api[4740]: 2017-09-28 12:38:13.347 4740 ERROR nova
Sep 28 12:38:13 ctl02 neutron-server[30536]: 2017-09-28 12:38:13.499 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:38:13 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:38:13 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:38:13 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:38:13 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:38:13 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:38:13 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:38:13 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:38:14 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:38:14.324 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:38:14] "OPTIONS / HTTP/1.0" 200 134 0.000459
Sep 28 12:38:15 ctl02 nova-api[4757]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:38:15 ctl02 nova-api[4757]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:38:15 ctl02 nova-api[4757]: 2017-09-28 12:38:15.488 4757 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:38:15 ctl02 nova-api[4757]: 2017-09-28 12:38:15.490 4757 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:38:15 ctl02 nova-api[4757]: 2017-09-28 12:38:15.490 4757 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:38:15 ctl02 nova-api[4757]: 2017-09-28 12:38:15.490 4757 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:38:15 ctl02 nova-api[4757]: 2017-09-28 12:38:15.490 4757 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:38:15 ctl02 nova-api[4757]: 2017-09-28 12:38:15.490 4757 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:38:15 ctl02 nova-api[4757]: 2017-09-28 12:38:15.490 4757 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:38:15 ctl02 nova-api[4757]: 2017-09-28 12:38:15.490 4757 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:38:15 ctl02 nova-api[4757]: 2017-09-28 12:38:15.490 4757 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:38:15 ctl02 nova-api[4757]: 2017-09-28 12:38:15.490 4757 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:38:15 ctl02 nova-api[4757]: 2017-09-28 12:38:15.490 4757 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:38:15 ctl02 nova-api[4757]: 2017-09-28 12:38:15.490 4757 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:38:15 ctl02 nova-api[4757]: 2017-09-28 12:38:15.490 4757 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:38:15 ctl02 nova-api[4757]: 2017-09-28 12:38:15.490 4757 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:38:15 ctl02 nova-api[4757]: 2017-09-28 12:38:15.490 4757 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:38:15 ctl02 nova-api[4757]: 2017-09-28 12:38:15.490 4757 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:38:15 ctl02 nova-api[4757]: 2017-09-28 12:38:15.490 4757 ERROR nova.wsgi     self.filename))
Sep 28 12:38:15 ctl02 nova-api[4757]: 2017-09-28 12:38:15.490 4757 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:38:15 ctl02 nova-api[4757]: 2017-09-28 12:38:15.490 4757 ERROR nova.wsgi
Sep 28 12:38:15 ctl02 nova-api[4757]: 2017-09-28 12:38:15.492 4757 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:38:15 ctl02 nova-api[4757]: 2017-09-28 12:38:15.621 4757 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:38:15 ctl02 nova-api[4757]: 2017-09-28 12:38:15.851 4757 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:38:15 ctl02 nova-api[4757]: 2017-09-28 12:38:15.853 4757 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:38:15 ctl02 nova-api[4757]: 2017-09-28 12:38:15.854 4757 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:38:15 ctl02 nova-api[4757]: 2017-09-28 12:38:15.854 4757 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:38:15 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:38:15.914 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:38:15] "OPTIONS / HTTP/1.0" 200 134 0.000465
Sep 28 12:38:15 ctl02 nova-api[4757]: 2017-09-28 12:38:15.986 4757 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:38:15 ctl02 nova-api[4757]: 2017-09-28 12:38:15.989 4757 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:38:15 ctl02 nova-api[4757]: 2017-09-28 12:38:15.989 4757 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:38:15 ctl02 nova-api[4757]: 2017-09-28 12:38:15.990 4757 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:38:15 ctl02 nova-api[4757]: 2017-09-28 12:38:15.993 4757 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:38:15 ctl02 nova-api[4757]: 2017-09-28 12:38:15.994 4757 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:38:15 ctl02 nova-api[4757]: 2017-09-28 12:38:15.994 4757 ERROR nova Traceback (most recent call last):
Sep 28 12:38:15 ctl02 nova-api[4757]: 2017-09-28 12:38:15.994 4757 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:38:15 ctl02 nova-api[4757]: 2017-09-28 12:38:15.994 4757 ERROR nova     sys.exit(main())
Sep 28 12:38:15 ctl02 nova-api[4757]: 2017-09-28 12:38:15.994 4757 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:38:15 ctl02 nova-api[4757]: 2017-09-28 12:38:15.994 4757 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:38:15 ctl02 nova-api[4757]: 2017-09-28 12:38:15.994 4757 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:38:15 ctl02 nova-api[4757]: 2017-09-28 12:38:15.994 4757 ERROR nova     max_url_len=max_url_len)
Sep 28 12:38:15 ctl02 nova-api[4757]: 2017-09-28 12:38:15.994 4757 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:38:15 ctl02 nova-api[4757]: 2017-09-28 12:38:15.994 4757 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:38:15 ctl02 nova-api[4757]: 2017-09-28 12:38:15.994 4757 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:38:15 ctl02 nova-api[4757]: 2017-09-28 12:38:15.994 4757 ERROR nova     sock.listen(backlog)
Sep 28 12:38:15 ctl02 nova-api[4757]: 2017-09-28 12:38:15.994 4757 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:38:15 ctl02 nova-api[4757]: 2017-09-28 12:38:15.994 4757 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:38:15 ctl02 nova-api[4757]: 2017-09-28 12:38:15.994 4757 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:38:15 ctl02 nova-api[4757]: 2017-09-28 12:38:15.994 4757 ERROR nova
Sep 28 12:38:16 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:38:16 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:38:16 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:38:16 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:38:16 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:38:16 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:38:16 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:38:16 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcd887102)
Sep 28 12:38:16 ctl02 heat-api[13008]: 2017-09-28 12:38:16.703 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:38:16] "OPTIONS / HTTP/1.0" 200 134 0.000635
Sep 28 12:38:17 ctl02 heat-api[13008]: 2017-09-28 12:38:17.286 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:38:17] "OPTIONS / HTTP/1.0" 200 134 0.000662
Sep 28 12:38:17 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcd887102)
Sep 28 12:38:18 ctl02 nova-api[4776]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:38:18 ctl02 nova-api[4776]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:38:18 ctl02 nova-api[4776]: 2017-09-28 12:38:18.295 4776 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:38:18 ctl02 nova-api[4776]: 2017-09-28 12:38:18.297 4776 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:38:18 ctl02 nova-api[4776]: 2017-09-28 12:38:18.297 4776 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:38:18 ctl02 nova-api[4776]: 2017-09-28 12:38:18.297 4776 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:38:18 ctl02 nova-api[4776]: 2017-09-28 12:38:18.297 4776 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:38:18 ctl02 nova-api[4776]: 2017-09-28 12:38:18.297 4776 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:38:18 ctl02 nova-api[4776]: 2017-09-28 12:38:18.297 4776 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:38:18 ctl02 nova-api[4776]: 2017-09-28 12:38:18.297 4776 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:38:18 ctl02 nova-api[4776]: 2017-09-28 12:38:18.297 4776 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:38:18 ctl02 nova-api[4776]: 2017-09-28 12:38:18.297 4776 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:38:18 ctl02 nova-api[4776]: 2017-09-28 12:38:18.297 4776 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:38:18 ctl02 nova-api[4776]: 2017-09-28 12:38:18.297 4776 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:38:18 ctl02 nova-api[4776]: 2017-09-28 12:38:18.297 4776 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:38:18 ctl02 nova-api[4776]: 2017-09-28 12:38:18.297 4776 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:38:18 ctl02 nova-api[4776]: 2017-09-28 12:38:18.297 4776 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:38:18 ctl02 nova-api[4776]: 2017-09-28 12:38:18.297 4776 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:38:18 ctl02 nova-api[4776]: 2017-09-28 12:38:18.297 4776 ERROR nova.wsgi     self.filename))
Sep 28 12:38:18 ctl02 nova-api[4776]: 2017-09-28 12:38:18.297 4776 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:38:18 ctl02 nova-api[4776]: 2017-09-28 12:38:18.297 4776 ERROR nova.wsgi
Sep 28 12:38:18 ctl02 nova-api[4776]: 2017-09-28 12:38:18.298 4776 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:38:18 ctl02 nova-api[4776]: 2017-09-28 12:38:18.433 4776 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:38:18 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcd887102)
Sep 28 12:38:18 ctl02 heat-api-cfn[13300]: 2017-09-28 12:38:18.536 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:38:18] "OPTIONS / HTTP/1.0" 200 134 0.000549
Sep 28 12:38:18 ctl02 heat-api-cfn[13300]: 2017-09-28 12:38:18.596 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:38:18] "OPTIONS / HTTP/1.0" 200 134 0.000547
Sep 28 12:38:18 ctl02 nova-api[4776]: 2017-09-28 12:38:18.694 4776 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:38:18 ctl02 nova-api[4776]: 2017-09-28 12:38:18.697 4776 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:38:18 ctl02 nova-api[4776]: 2017-09-28 12:38:18.697 4776 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:38:18 ctl02 nova-api[4776]: 2017-09-28 12:38:18.697 4776 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:38:18 ctl02 heat-api[13008]: 2017-09-28 12:38:18.772 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:38:18] "OPTIONS / HTTP/1.0" 200 134 0.000689
Sep 28 12:38:18 ctl02 nova-api[4776]: 2017-09-28 12:38:18.830 4776 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:38:18 ctl02 nova-api[4776]: 2017-09-28 12:38:18.832 4776 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:38:18 ctl02 nova-api[4776]: 2017-09-28 12:38:18.832 4776 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:38:18 ctl02 nova-api[4776]: 2017-09-28 12:38:18.832 4776 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:38:18 ctl02 nova-api[4776]: 2017-09-28 12:38:18.836 4776 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:38:18 ctl02 nova-api[4776]: 2017-09-28 12:38:18.836 4776 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:38:18 ctl02 nova-api[4776]: 2017-09-28 12:38:18.836 4776 ERROR nova Traceback (most recent call last):
Sep 28 12:38:18 ctl02 nova-api[4776]: 2017-09-28 12:38:18.836 4776 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:38:18 ctl02 nova-api[4776]: 2017-09-28 12:38:18.836 4776 ERROR nova     sys.exit(main())
Sep 28 12:38:18 ctl02 nova-api[4776]: 2017-09-28 12:38:18.836 4776 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:38:18 ctl02 nova-api[4776]: 2017-09-28 12:38:18.836 4776 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:38:18 ctl02 nova-api[4776]: 2017-09-28 12:38:18.836 4776 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:38:18 ctl02 nova-api[4776]: 2017-09-28 12:38:18.836 4776 ERROR nova     max_url_len=max_url_len)
Sep 28 12:38:18 ctl02 nova-api[4776]: 2017-09-28 12:38:18.836 4776 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:38:18 ctl02 nova-api[4776]: 2017-09-28 12:38:18.836 4776 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:38:18 ctl02 nova-api[4776]: 2017-09-28 12:38:18.836 4776 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:38:18 ctl02 nova-api[4776]: 2017-09-28 12:38:18.836 4776 ERROR nova     sock.listen(backlog)
Sep 28 12:38:18 ctl02 nova-api[4776]: 2017-09-28 12:38:18.836 4776 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:38:18 ctl02 nova-api[4776]: 2017-09-28 12:38:18.836 4776 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:38:18 ctl02 nova-api[4776]: 2017-09-28 12:38:18.836 4776 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:38:18 ctl02 nova-api[4776]: 2017-09-28 12:38:18.836 4776 ERROR nova
Sep 28 12:38:19 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:38:19 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:38:19 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:38:19 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:38:19 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:38:19 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:38:19 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:38:19 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:38:19.399 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:38:19] "OPTIONS / HTTP/1.0" 200 134 0.000422
Sep 28 12:38:19 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcd887102)
Sep 28 12:38:20 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcd887102)
Sep 28 12:38:20 ctl02 neutron-server[30536]: 2017-09-28 12:38:20.679 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:38:20] "OPTIONS / HTTP/1.0" 200 262 0.000571
Sep 28 12:38:20 ctl02 neutron-server[30536]: 2017-09-28 12:38:20.717 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:38:20] "OPTIONS / HTTP/1.0" 200 262 0.000450
Sep 28 12:38:20 ctl02 nova-api[4793]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:38:20 ctl02 nova-api[4793]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:38:20 ctl02 nova-api[4793]: 2017-09-28 12:38:20.996 4793 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:38:20 ctl02 nova-api[4793]: 2017-09-28 12:38:20.997 4793 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:38:20 ctl02 nova-api[4793]: 2017-09-28 12:38:20.997 4793 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:38:20 ctl02 nova-api[4793]: 2017-09-28 12:38:20.997 4793 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:38:20 ctl02 nova-api[4793]: 2017-09-28 12:38:20.997 4793 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:38:20 ctl02 nova-api[4793]: 2017-09-28 12:38:20.997 4793 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:38:20 ctl02 nova-api[4793]: 2017-09-28 12:38:20.997 4793 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:38:20 ctl02 nova-api[4793]: 2017-09-28 12:38:20.997 4793 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:38:20 ctl02 nova-api[4793]: 2017-09-28 12:38:20.997 4793 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:38:21 ctl02 nova-api[4793]: 2017-09-28 12:38:20.997 4793 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:38:21 ctl02 nova-api[4793]: 2017-09-28 12:38:20.997 4793 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:38:21 ctl02 nova-api[4793]: 2017-09-28 12:38:20.997 4793 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:38:21 ctl02 nova-api[4793]: 2017-09-28 12:38:20.997 4793 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:38:21 ctl02 nova-api[4793]: 2017-09-28 12:38:20.997 4793 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:38:21 ctl02 nova-api[4793]: 2017-09-28 12:38:20.997 4793 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:38:21 ctl02 nova-api[4793]: 2017-09-28 12:38:20.997 4793 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:38:21 ctl02 nova-api[4793]: 2017-09-28 12:38:20.997 4793 ERROR nova.wsgi     self.filename))
Sep 28 12:38:21 ctl02 nova-api[4793]: 2017-09-28 12:38:20.997 4793 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:38:21 ctl02 nova-api[4793]: 2017-09-28 12:38:20.997 4793 ERROR nova.wsgi
Sep 28 12:38:21 ctl02 nova-api[4793]: 2017-09-28 12:38:20.999 4793 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:38:21 ctl02 nova-api[4793]: 2017-09-28 12:38:21.135 4793 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:38:21 ctl02 neutron-server[30536]: 2017-09-28 12:38:21.337 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:38:21] "OPTIONS / HTTP/1.0" 200 262 0.000763
Sep 28 12:38:21 ctl02 neutron-server[30536]: 2017-09-28 12:38:21.343 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 4 dead agents out of 6:
Sep 28 12:38:21 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:38:21 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:36:56 cmp002
Sep 28 12:38:21 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:36:48 cmp001
Sep 28 12:38:21 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:36:50 cmp002
Sep 28 12:38:21 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:37:06 cmp002
Sep 28 12:38:21 ctl02 nova-api[4793]: 2017-09-28 12:38:21.389 4793 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:38:21 ctl02 nova-api[4793]: 2017-09-28 12:38:21.391 4793 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:38:21 ctl02 nova-api[4793]: 2017-09-28 12:38:21.392 4793 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:38:21 ctl02 nova-api[4793]: 2017-09-28 12:38:21.392 4793 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:38:21 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcd887102)
Sep 28 12:38:21 ctl02 nova-api[4793]: 2017-09-28 12:38:21.527 4793 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:38:21 ctl02 nova-api[4793]: 2017-09-28 12:38:21.530 4793 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:38:21 ctl02 nova-api[4793]: 2017-09-28 12:38:21.530 4793 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:38:21 ctl02 nova-api[4793]: 2017-09-28 12:38:21.530 4793 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:38:21 ctl02 nova-api[4793]: 2017-09-28 12:38:21.534 4793 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:38:21 ctl02 nova-api[4793]: 2017-09-28 12:38:21.534 4793 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:38:21 ctl02 nova-api[4793]: 2017-09-28 12:38:21.534 4793 ERROR nova Traceback (most recent call last):
Sep 28 12:38:21 ctl02 nova-api[4793]: 2017-09-28 12:38:21.534 4793 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:38:21 ctl02 nova-api[4793]: 2017-09-28 12:38:21.534 4793 ERROR nova     sys.exit(main())
Sep 28 12:38:21 ctl02 nova-api[4793]: 2017-09-28 12:38:21.534 4793 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:38:21 ctl02 nova-api[4793]: 2017-09-28 12:38:21.534 4793 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:38:21 ctl02 nova-api[4793]: 2017-09-28 12:38:21.534 4793 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:38:21 ctl02 nova-api[4793]: 2017-09-28 12:38:21.534 4793 ERROR nova     max_url_len=max_url_len)
Sep 28 12:38:21 ctl02 nova-api[4793]: 2017-09-28 12:38:21.534 4793 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:38:21 ctl02 nova-api[4793]: 2017-09-28 12:38:21.534 4793 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:38:21 ctl02 nova-api[4793]: 2017-09-28 12:38:21.534 4793 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:38:21 ctl02 nova-api[4793]: 2017-09-28 12:38:21.534 4793 ERROR nova     sock.listen(backlog)
Sep 28 12:38:21 ctl02 nova-api[4793]: 2017-09-28 12:38:21.534 4793 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:38:21 ctl02 nova-api[4793]: 2017-09-28 12:38:21.534 4793 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:38:21 ctl02 nova-api[4793]: 2017-09-28 12:38:21.534 4793 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:38:21 ctl02 nova-api[4793]: 2017-09-28 12:38:21.534 4793 ERROR nova
Sep 28 12:38:21 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:38:21 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:38:21 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:38:21 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:38:21 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:38:21 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:38:21 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:38:22 ctl02 glance-api[29183]: 2017-09-28 12:38:22.110 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:38:22] "OPTIONS / HTTP/1.0" 200 134 0.001057
Sep 28 12:38:22 ctl02 glance-api[29183]: 2017-09-28 12:38:22.132 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:38:22] "OPTIONS / HTTP/1.0" 200 134 0.000611
Sep 28 12:38:22 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcd887102)
Sep 28 12:38:22 ctl02 heat-api-cfn[13300]: 2017-09-28 12:38:22.865 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:38:22] "OPTIONS / HTTP/1.0" 200 134 0.000484
Sep 28 12:38:23 ctl02 glance-api[29183]: 2017-09-28 12:38:23.045 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:38:23] "OPTIONS / HTTP/1.0" 200 134 0.000638
Sep 28 12:38:23 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcd887102)
Sep 28 12:38:23 ctl02 nova-api[4812]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:38:23 ctl02 nova-api[4812]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:38:23 ctl02 nova-api[4812]: 2017-09-28 12:38:23.784 4812 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:38:23 ctl02 nova-api[4812]: 2017-09-28 12:38:23.786 4812 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:38:23 ctl02 nova-api[4812]: 2017-09-28 12:38:23.786 4812 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:38:23 ctl02 nova-api[4812]: 2017-09-28 12:38:23.786 4812 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:38:23 ctl02 nova-api[4812]: 2017-09-28 12:38:23.786 4812 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:38:23 ctl02 nova-api[4812]: 2017-09-28 12:38:23.786 4812 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:38:23 ctl02 nova-api[4812]: 2017-09-28 12:38:23.786 4812 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:38:23 ctl02 nova-api[4812]: 2017-09-28 12:38:23.786 4812 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:38:23 ctl02 nova-api[4812]: 2017-09-28 12:38:23.786 4812 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:38:23 ctl02 nova-api[4812]: 2017-09-28 12:38:23.786 4812 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:38:23 ctl02 nova-api[4812]: 2017-09-28 12:38:23.786 4812 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:38:23 ctl02 nova-api[4812]: 2017-09-28 12:38:23.786 4812 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:38:23 ctl02 nova-api[4812]: 2017-09-28 12:38:23.786 4812 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:38:23 ctl02 nova-api[4812]: 2017-09-28 12:38:23.786 4812 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:38:23 ctl02 nova-api[4812]: 2017-09-28 12:38:23.786 4812 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:38:23 ctl02 nova-api[4812]: 2017-09-28 12:38:23.786 4812 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:38:23 ctl02 nova-api[4812]: 2017-09-28 12:38:23.786 4812 ERROR nova.wsgi     self.filename))
Sep 28 12:38:23 ctl02 nova-api[4812]: 2017-09-28 12:38:23.786 4812 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:38:23 ctl02 nova-api[4812]: 2017-09-28 12:38:23.786 4812 ERROR nova.wsgi
Sep 28 12:38:23 ctl02 nova-api[4812]: 2017-09-28 12:38:23.787 4812 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:38:23 ctl02 nova-api[4812]: 2017-09-28 12:38:23.921 4812 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:38:23 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:38:23.984 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:38:23] "OPTIONS / HTTP/1.0" 200 134 0.000460
Sep 28 12:38:24 ctl02 nova-api[4812]: 2017-09-28 12:38:24.173 4812 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:38:24 ctl02 nova-api[4812]: 2017-09-28 12:38:24.176 4812 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:38:24 ctl02 nova-api[4812]: 2017-09-28 12:38:24.176 4812 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:38:24 ctl02 nova-api[4812]: 2017-09-28 12:38:24.176 4812 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:38:24 ctl02 nova-api[4812]: 2017-09-28 12:38:24.310 4812 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:38:24 ctl02 nova-api[4812]: 2017-09-28 12:38:24.312 4812 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:38:24 ctl02 nova-api[4812]: 2017-09-28 12:38:24.312 4812 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:38:24 ctl02 nova-api[4812]: 2017-09-28 12:38:24.313 4812 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:38:24 ctl02 nova-api[4812]: 2017-09-28 12:38:24.316 4812 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:38:24 ctl02 nova-api[4812]: 2017-09-28 12:38:24.317 4812 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:38:24 ctl02 nova-api[4812]: 2017-09-28 12:38:24.317 4812 ERROR nova Traceback (most recent call last):
Sep 28 12:38:24 ctl02 nova-api[4812]: 2017-09-28 12:38:24.317 4812 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:38:24 ctl02 nova-api[4812]: 2017-09-28 12:38:24.317 4812 ERROR nova     sys.exit(main())
Sep 28 12:38:24 ctl02 nova-api[4812]: 2017-09-28 12:38:24.317 4812 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:38:24 ctl02 nova-api[4812]: 2017-09-28 12:38:24.317 4812 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:38:24 ctl02 nova-api[4812]: 2017-09-28 12:38:24.317 4812 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:38:24 ctl02 nova-api[4812]: 2017-09-28 12:38:24.317 4812 ERROR nova     max_url_len=max_url_len)
Sep 28 12:38:24 ctl02 nova-api[4812]: 2017-09-28 12:38:24.317 4812 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:38:24 ctl02 nova-api[4812]: 2017-09-28 12:38:24.317 4812 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:38:24 ctl02 nova-api[4812]: 2017-09-28 12:38:24.317 4812 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:38:24 ctl02 nova-api[4812]: 2017-09-28 12:38:24.317 4812 ERROR nova     sock.listen(backlog)
Sep 28 12:38:24 ctl02 nova-api[4812]: 2017-09-28 12:38:24.317 4812 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:38:24 ctl02 nova-api[4812]: 2017-09-28 12:38:24.317 4812 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:38:24 ctl02 nova-api[4812]: 2017-09-28 12:38:24.317 4812 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:38:24 ctl02 nova-api[4812]: 2017-09-28 12:38:24.317 4812 ERROR nova
Sep 28 12:38:24 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:38:24 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:38:24 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:38:24 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcd887102)
Sep 28 12:38:24 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:38:24 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:38:24 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:38:24 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:38:25 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcd887102)
Sep 28 12:38:25 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:38:25.913 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:38:25] "OPTIONS / HTTP/1.0" 200 134 0.000409
Sep 28 12:38:26 ctl02 nova-api[4830]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:38:26 ctl02 nova-api[4830]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:38:26 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xcd887102)
Sep 28 12:38:26 ctl02 heat-api[13008]: 2017-09-28 12:38:26.532 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:38:26] "OPTIONS / HTTP/1.0" 200 134 0.000607
Sep 28 12:38:26 ctl02 nova-api[4830]: 2017-09-28 12:38:26.532 4830 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:38:26 ctl02 nova-api[4830]: 2017-09-28 12:38:26.534 4830 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:38:26 ctl02 nova-api[4830]: 2017-09-28 12:38:26.534 4830 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:38:26 ctl02 nova-api[4830]: 2017-09-28 12:38:26.534 4830 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:38:26 ctl02 nova-api[4830]: 2017-09-28 12:38:26.534 4830 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:38:26 ctl02 nova-api[4830]: 2017-09-28 12:38:26.534 4830 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:38:26 ctl02 nova-api[4830]: 2017-09-28 12:38:26.534 4830 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:38:26 ctl02 nova-api[4830]: 2017-09-28 12:38:26.534 4830 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:38:26 ctl02 nova-api[4830]: 2017-09-28 12:38:26.534 4830 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:38:26 ctl02 nova-api[4830]: 2017-09-28 12:38:26.534 4830 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:38:26 ctl02 nova-api[4830]: 2017-09-28 12:38:26.534 4830 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:38:26 ctl02 nova-api[4830]: 2017-09-28 12:38:26.534 4830 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:38:26 ctl02 nova-api[4830]: 2017-09-28 12:38:26.534 4830 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:38:26 ctl02 nova-api[4830]: 2017-09-28 12:38:26.534 4830 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:38:26 ctl02 nova-api[4830]: 2017-09-28 12:38:26.534 4830 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:38:26 ctl02 nova-api[4830]: 2017-09-28 12:38:26.534 4830 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:38:26 ctl02 nova-api[4830]: 2017-09-28 12:38:26.534 4830 ERROR nova.wsgi     self.filename))
Sep 28 12:38:26 ctl02 nova-api[4830]: 2017-09-28 12:38:26.534 4830 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:38:26 ctl02 nova-api[4830]: 2017-09-28 12:38:26.534 4830 ERROR nova.wsgi
Sep 28 12:38:26 ctl02 nova-api[4830]: 2017-09-28 12:38:26.535 4830 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:38:26 ctl02 nova-api[4830]: 2017-09-28 12:38:26.670 4830 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:38:26 ctl02 nova-api[4830]: 2017-09-28 12:38:26.924 4830 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:38:26 ctl02 nova-api[4830]: 2017-09-28 12:38:26.926 4830 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:38:26 ctl02 nova-api[4830]: 2017-09-28 12:38:26.926 4830 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:38:26 ctl02 nova-api[4830]: 2017-09-28 12:38:26.927 4830 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:38:27 ctl02 nova-api[4830]: 2017-09-28 12:38:27.061 4830 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:38:27 ctl02 nova-api[4830]: 2017-09-28 12:38:27.063 4830 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:38:27 ctl02 nova-api[4830]: 2017-09-28 12:38:27.063 4830 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:38:27 ctl02 nova-api[4830]: 2017-09-28 12:38:27.063 4830 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:38:27 ctl02 nova-api[4830]: 2017-09-28 12:38:27.067 4830 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:38:27 ctl02 nova-api[4830]: 2017-09-28 12:38:27.067 4830 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:38:27 ctl02 nova-api[4830]: 2017-09-28 12:38:27.067 4830 ERROR nova Traceback (most recent call last):
Sep 28 12:38:27 ctl02 nova-api[4830]: 2017-09-28 12:38:27.067 4830 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:38:27 ctl02 nova-api[4830]: 2017-09-28 12:38:27.067 4830 ERROR nova     sys.exit(main())
Sep 28 12:38:27 ctl02 nova-api[4830]: 2017-09-28 12:38:27.067 4830 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:38:27 ctl02 nova-api[4830]: 2017-09-28 12:38:27.067 4830 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:38:27 ctl02 nova-api[4830]: 2017-09-28 12:38:27.067 4830 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:38:27 ctl02 nova-api[4830]: 2017-09-28 12:38:27.067 4830 ERROR nova     max_url_len=max_url_len)
Sep 28 12:38:27 ctl02 nova-api[4830]: 2017-09-28 12:38:27.067 4830 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:38:27 ctl02 nova-api[4830]: 2017-09-28 12:38:27.067 4830 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:38:27 ctl02 nova-api[4830]: 2017-09-28 12:38:27.067 4830 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:38:27 ctl02 nova-api[4830]: 2017-09-28 12:38:27.067 4830 ERROR nova     sock.listen(backlog)
Sep 28 12:38:27 ctl02 nova-api[4830]: 2017-09-28 12:38:27.067 4830 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:38:27 ctl02 nova-api[4830]: 2017-09-28 12:38:27.067 4830 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:38:27 ctl02 nova-api[4830]: 2017-09-28 12:38:27.067 4830 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:38:27 ctl02 nova-api[4830]: 2017-09-28 12:38:27.067 4830 ERROR nova
Sep 28 12:38:27 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:38:27 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:38:27 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:38:27 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:38:27 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:38:27 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:38:27 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:38:27 ctl02 heat-api[13008]: 2017-09-28 12:38:27.486 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:38:27] "OPTIONS / HTTP/1.0" 200 134 0.000619
Sep 28 12:38:27 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:38:27 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:38:28 ctl02 neutron-server[30536]: 2017-09-28 12:38:28.494 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:38:28 ctl02 heat-api-cfn[13300]: 2017-09-28 12:38:28.497 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:38:28] "OPTIONS / HTTP/1.0" 200 134 0.000448
Sep 28 12:38:28 ctl02 heat-api-cfn[13300]: 2017-09-28 12:38:28.861 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:38:28] "OPTIONS / HTTP/1.0" 200 134 0.000341
Sep 28 12:38:29 ctl02 heat-api[13008]: 2017-09-28 12:38:29.054 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:38:29] "OPTIONS / HTTP/1.0" 200 134 0.000582
Sep 28 12:38:29 ctl02 nova-api[4848]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:38:29 ctl02 nova-api[4848]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:38:29 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:38:29.220 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:38:29] "OPTIONS / HTTP/1.0" 200 134 0.000426
Sep 28 12:38:29 ctl02 nova-api[4848]: 2017-09-28 12:38:29.254 4848 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:38:29 ctl02 nova-api[4848]: 2017-09-28 12:38:29.255 4848 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:38:29 ctl02 nova-api[4848]: 2017-09-28 12:38:29.255 4848 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:38:29 ctl02 nova-api[4848]: 2017-09-28 12:38:29.255 4848 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:38:29 ctl02 nova-api[4848]: 2017-09-28 12:38:29.255 4848 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:38:29 ctl02 nova-api[4848]: 2017-09-28 12:38:29.255 4848 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:38:29 ctl02 nova-api[4848]: 2017-09-28 12:38:29.255 4848 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:38:29 ctl02 nova-api[4848]: 2017-09-28 12:38:29.255 4848 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:38:29 ctl02 nova-api[4848]: 2017-09-28 12:38:29.255 4848 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:38:29 ctl02 nova-api[4848]: 2017-09-28 12:38:29.255 4848 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:38:29 ctl02 nova-api[4848]: 2017-09-28 12:38:29.255 4848 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:38:29 ctl02 nova-api[4848]: 2017-09-28 12:38:29.255 4848 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:38:29 ctl02 nova-api[4848]: 2017-09-28 12:38:29.255 4848 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:38:29 ctl02 nova-api[4848]: 2017-09-28 12:38:29.255 4848 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:38:29 ctl02 nova-api[4848]: 2017-09-28 12:38:29.255 4848 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:38:29 ctl02 nova-api[4848]: 2017-09-28 12:38:29.255 4848 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:38:29 ctl02 nova-api[4848]: 2017-09-28 12:38:29.255 4848 ERROR nova.wsgi     self.filename))
Sep 28 12:38:29 ctl02 nova-api[4848]: 2017-09-28 12:38:29.255 4848 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:38:29 ctl02 nova-api[4848]: 2017-09-28 12:38:29.255 4848 ERROR nova.wsgi
Sep 28 12:38:29 ctl02 nova-api[4848]: 2017-09-28 12:38:29.256 4848 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:38:29 ctl02 nova-api[4848]: 2017-09-28 12:38:29.389 4848 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:38:29 ctl02 nova-api[4848]: 2017-09-28 12:38:29.631 4848 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:38:29 ctl02 nova-api[4848]: 2017-09-28 12:38:29.633 4848 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:38:29 ctl02 nova-api[4848]: 2017-09-28 12:38:29.634 4848 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:38:29 ctl02 nova-api[4848]: 2017-09-28 12:38:29.634 4848 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:38:29 ctl02 nova-api[4848]: 2017-09-28 12:38:29.767 4848 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:38:29 ctl02 nova-api[4848]: 2017-09-28 12:38:29.769 4848 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:38:29 ctl02 nova-api[4848]: 2017-09-28 12:38:29.769 4848 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:38:29 ctl02 nova-api[4848]: 2017-09-28 12:38:29.769 4848 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:38:29 ctl02 nova-api[4848]: 2017-09-28 12:38:29.773 4848 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:38:29 ctl02 nova-api[4848]: 2017-09-28 12:38:29.773 4848 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:38:29 ctl02 nova-api[4848]: 2017-09-28 12:38:29.773 4848 ERROR nova Traceback (most recent call last):
Sep 28 12:38:29 ctl02 nova-api[4848]: 2017-09-28 12:38:29.773 4848 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:38:29 ctl02 nova-api[4848]: 2017-09-28 12:38:29.773 4848 ERROR nova     sys.exit(main())
Sep 28 12:38:29 ctl02 nova-api[4848]: 2017-09-28 12:38:29.773 4848 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:38:29 ctl02 nova-api[4848]: 2017-09-28 12:38:29.773 4848 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:38:29 ctl02 nova-api[4848]: 2017-09-28 12:38:29.773 4848 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:38:29 ctl02 nova-api[4848]: 2017-09-28 12:38:29.773 4848 ERROR nova     max_url_len=max_url_len)
Sep 28 12:38:29 ctl02 nova-api[4848]: 2017-09-28 12:38:29.773 4848 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:38:29 ctl02 nova-api[4848]: 2017-09-28 12:38:29.773 4848 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:38:29 ctl02 nova-api[4848]: 2017-09-28 12:38:29.773 4848 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:38:29 ctl02 nova-api[4848]: 2017-09-28 12:38:29.773 4848 ERROR nova     sock.listen(backlog)
Sep 28 12:38:29 ctl02 nova-api[4848]: 2017-09-28 12:38:29.773 4848 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:38:29 ctl02 nova-api[4848]: 2017-09-28 12:38:29.773 4848 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:38:29 ctl02 nova-api[4848]: 2017-09-28 12:38:29.773 4848 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:38:29 ctl02 nova-api[4848]: 2017-09-28 12:38:29.773 4848 ERROR nova
Sep 28 12:38:29 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:38:29 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:38:29 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:38:30 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:38:30 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:38:30 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:38:30 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:38:30 ctl02 nova-cert[4860]: 2017-09-28 12:38:30.321 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:38:30 ctl02 nova-conductor[5056]: 2017-09-28 12:38:30.871 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:38:30 ctl02 nova-conductor[5056]: 2017-09-28 12:38:30.893 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:38:30 ctl02 nova-conductor[5056]: 2017-09-28 12:38:30.899 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:38:30 ctl02 nova-conductor[5056]: 2017-09-28 12:38:30.907 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:38:31 ctl02 neutron-server[30536]: 2017-09-28 12:38:31.063 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:38:31] "OPTIONS / HTTP/1.0" 200 262 0.000626
Sep 28 12:38:31 ctl02 neutron-server[30536]: 2017-09-28 12:38:31.106 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:38:31] "OPTIONS / HTTP/1.0" 200 262 0.000544
Sep 28 12:38:31 ctl02 neutron-server[30536]: 2017-09-28 12:38:31.291 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:38:31] "OPTIONS / HTTP/1.0" 200 262 0.000467
Sep 28 12:38:31 ctl02 glance-api[29183]: 2017-09-28 12:38:31.777 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:38:31] "OPTIONS / HTTP/1.0" 200 134 0.000658
Sep 28 12:38:31 ctl02 nova-api[4872]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:38:31 ctl02 nova-api[4872]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:38:32 ctl02 nova-api[4872]: 2017-09-28 12:38:32.002 4872 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:38:32 ctl02 nova-api[4872]: 2017-09-28 12:38:32.003 4872 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:38:32 ctl02 nova-api[4872]: 2017-09-28 12:38:32.003 4872 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:38:32 ctl02 nova-api[4872]: 2017-09-28 12:38:32.003 4872 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:38:32 ctl02 nova-api[4872]: 2017-09-28 12:38:32.003 4872 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:38:32 ctl02 nova-api[4872]: 2017-09-28 12:38:32.003 4872 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:38:32 ctl02 nova-api[4872]: 2017-09-28 12:38:32.003 4872 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:38:32 ctl02 nova-api[4872]: 2017-09-28 12:38:32.003 4872 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:38:32 ctl02 nova-api[4872]: 2017-09-28 12:38:32.003 4872 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:38:32 ctl02 nova-api[4872]: 2017-09-28 12:38:32.003 4872 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:38:32 ctl02 nova-api[4872]: 2017-09-28 12:38:32.003 4872 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:38:32 ctl02 nova-api[4872]: 2017-09-28 12:38:32.003 4872 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:38:32 ctl02 nova-api[4872]: 2017-09-28 12:38:32.003 4872 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:38:32 ctl02 nova-api[4872]: 2017-09-28 12:38:32.003 4872 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:38:32 ctl02 nova-api[4872]: 2017-09-28 12:38:32.003 4872 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:38:32 ctl02 nova-api[4872]: 2017-09-28 12:38:32.003 4872 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:38:32 ctl02 nova-api[4872]: 2017-09-28 12:38:32.003 4872 ERROR nova.wsgi     self.filename))
Sep 28 12:38:32 ctl02 nova-api[4872]: 2017-09-28 12:38:32.003 4872 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:38:32 ctl02 nova-api[4872]: 2017-09-28 12:38:32.003 4872 ERROR nova.wsgi
Sep 28 12:38:32 ctl02 nova-api[4872]: 2017-09-28 12:38:32.004 4872 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:38:32 ctl02 nova-api[4872]: 2017-09-28 12:38:32.136 4872 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:38:32 ctl02 glance-api[29183]: 2017-09-28 12:38:32.345 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:38:32] "OPTIONS / HTTP/1.0" 200 134 0.000750
Sep 28 12:38:32 ctl02 nova-api[4872]: 2017-09-28 12:38:32.389 4872 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:38:32 ctl02 nova-api[4872]: 2017-09-28 12:38:32.392 4872 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:38:32 ctl02 nova-api[4872]: 2017-09-28 12:38:32.392 4872 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:38:32 ctl02 nova-api[4872]: 2017-09-28 12:38:32.392 4872 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:38:32 ctl02 nova-api[4872]: 2017-09-28 12:38:32.523 4872 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:38:32 ctl02 nova-api[4872]: 2017-09-28 12:38:32.526 4872 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:38:32 ctl02 nova-api[4872]: 2017-09-28 12:38:32.526 4872 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:38:32 ctl02 nova-api[4872]: 2017-09-28 12:38:32.526 4872 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:38:32 ctl02 nova-api[4872]: 2017-09-28 12:38:32.529 4872 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:38:32 ctl02 nova-api[4872]: 2017-09-28 12:38:32.530 4872 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:38:32 ctl02 nova-api[4872]: 2017-09-28 12:38:32.530 4872 ERROR nova Traceback (most recent call last):
Sep 28 12:38:32 ctl02 nova-api[4872]: 2017-09-28 12:38:32.530 4872 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:38:32 ctl02 nova-api[4872]: 2017-09-28 12:38:32.530 4872 ERROR nova     sys.exit(main())
Sep 28 12:38:32 ctl02 nova-api[4872]: 2017-09-28 12:38:32.530 4872 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:38:32 ctl02 nova-api[4872]: 2017-09-28 12:38:32.530 4872 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:38:32 ctl02 nova-api[4872]: 2017-09-28 12:38:32.530 4872 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:38:32 ctl02 nova-api[4872]: 2017-09-28 12:38:32.530 4872 ERROR nova     max_url_len=max_url_len)
Sep 28 12:38:32 ctl02 nova-api[4872]: 2017-09-28 12:38:32.530 4872 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:38:32 ctl02 nova-api[4872]: 2017-09-28 12:38:32.530 4872 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:38:32 ctl02 nova-api[4872]: 2017-09-28 12:38:32.530 4872 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:38:32 ctl02 nova-api[4872]: 2017-09-28 12:38:32.530 4872 ERROR nova     sock.listen(backlog)
Sep 28 12:38:32 ctl02 nova-api[4872]: 2017-09-28 12:38:32.530 4872 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:38:32 ctl02 nova-api[4872]: 2017-09-28 12:38:32.530 4872 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:38:32 ctl02 nova-api[4872]: 2017-09-28 12:38:32.530 4872 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:38:32 ctl02 nova-api[4872]: 2017-09-28 12:38:32.530 4872 ERROR nova
Sep 28 12:38:32 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:38:32 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:38:32 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:38:32 ctl02 heat-api-cfn[13300]: 2017-09-28 12:38:32.726 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:38:32] "OPTIONS / HTTP/1.0" 200 134 0.000472
Sep 28 12:38:32 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:38:32 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:38:32 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:38:32 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:38:33 ctl02 glance-api[29183]: 2017-09-28 12:38:33.128 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:38:33] "OPTIONS / HTTP/1.0" 200 134 0.000736
Sep 28 12:38:34 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:38:34.240 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:38:34] "OPTIONS / HTTP/1.0" 200 134 0.000436
Sep 28 12:38:34 ctl02 nova-api[4889]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:38:34 ctl02 nova-api[4889]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:38:34 ctl02 nova-api[4889]: 2017-09-28 12:38:34.759 4889 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:38:34 ctl02 nova-api[4889]: 2017-09-28 12:38:34.761 4889 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:38:34 ctl02 nova-api[4889]: 2017-09-28 12:38:34.761 4889 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:38:34 ctl02 nova-api[4889]: 2017-09-28 12:38:34.761 4889 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:38:34 ctl02 nova-api[4889]: 2017-09-28 12:38:34.761 4889 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:38:34 ctl02 nova-api[4889]: 2017-09-28 12:38:34.761 4889 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:38:34 ctl02 nova-api[4889]: 2017-09-28 12:38:34.761 4889 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:38:34 ctl02 nova-api[4889]: 2017-09-28 12:38:34.761 4889 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:38:34 ctl02 nova-api[4889]: 2017-09-28 12:38:34.761 4889 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:38:34 ctl02 nova-api[4889]: 2017-09-28 12:38:34.761 4889 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:38:34 ctl02 nova-api[4889]: 2017-09-28 12:38:34.761 4889 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:38:34 ctl02 nova-api[4889]: 2017-09-28 12:38:34.761 4889 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:38:34 ctl02 nova-api[4889]: 2017-09-28 12:38:34.761 4889 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:38:34 ctl02 nova-api[4889]: 2017-09-28 12:38:34.761 4889 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:38:34 ctl02 nova-api[4889]: 2017-09-28 12:38:34.761 4889 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:38:34 ctl02 nova-api[4889]: 2017-09-28 12:38:34.761 4889 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:38:34 ctl02 nova-api[4889]: 2017-09-28 12:38:34.761 4889 ERROR nova.wsgi     self.filename))
Sep 28 12:38:34 ctl02 nova-api[4889]: 2017-09-28 12:38:34.761 4889 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:38:34 ctl02 nova-api[4889]: 2017-09-28 12:38:34.761 4889 ERROR nova.wsgi
Sep 28 12:38:34 ctl02 nova-api[4889]: 2017-09-28 12:38:34.763 4889 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:38:34 ctl02 nova-api[4889]: 2017-09-28 12:38:34.896 4889 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:38:35 ctl02 nova-api[4889]: 2017-09-28 12:38:35.141 4889 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:38:35 ctl02 nova-api[4889]: 2017-09-28 12:38:35.143 4889 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:38:35 ctl02 nova-api[4889]: 2017-09-28 12:38:35.144 4889 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:38:35 ctl02 nova-api[4889]: 2017-09-28 12:38:35.144 4889 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:38:35 ctl02 nova-api[4889]: 2017-09-28 12:38:35.278 4889 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:38:35 ctl02 nova-api[4889]: 2017-09-28 12:38:35.280 4889 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:38:35 ctl02 nova-api[4889]: 2017-09-28 12:38:35.281 4889 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:38:35 ctl02 nova-api[4889]: 2017-09-28 12:38:35.281 4889 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:38:35 ctl02 nova-api[4889]: 2017-09-28 12:38:35.285 4889 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:38:35 ctl02 nova-api[4889]: 2017-09-28 12:38:35.285 4889 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:38:35 ctl02 nova-api[4889]: 2017-09-28 12:38:35.285 4889 ERROR nova Traceback (most recent call last):
Sep 28 12:38:35 ctl02 nova-api[4889]: 2017-09-28 12:38:35.285 4889 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:38:35 ctl02 nova-api[4889]: 2017-09-28 12:38:35.285 4889 ERROR nova     sys.exit(main())
Sep 28 12:38:35 ctl02 nova-api[4889]: 2017-09-28 12:38:35.285 4889 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:38:35 ctl02 nova-api[4889]: 2017-09-28 12:38:35.285 4889 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:38:35 ctl02 nova-api[4889]: 2017-09-28 12:38:35.285 4889 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:38:35 ctl02 nova-api[4889]: 2017-09-28 12:38:35.285 4889 ERROR nova     max_url_len=max_url_len)
Sep 28 12:38:35 ctl02 nova-api[4889]: 2017-09-28 12:38:35.285 4889 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:38:35 ctl02 nova-api[4889]: 2017-09-28 12:38:35.285 4889 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:38:35 ctl02 nova-api[4889]: 2017-09-28 12:38:35.285 4889 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:38:35 ctl02 nova-api[4889]: 2017-09-28 12:38:35.285 4889 ERROR nova     sock.listen(backlog)
Sep 28 12:38:35 ctl02 nova-api[4889]: 2017-09-28 12:38:35.285 4889 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:38:35 ctl02 nova-api[4889]: 2017-09-28 12:38:35.285 4889 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:38:35 ctl02 nova-api[4889]: 2017-09-28 12:38:35.285 4889 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:38:35 ctl02 nova-api[4889]: 2017-09-28 12:38:35.285 4889 ERROR nova
Sep 28 12:38:35 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:38:35 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:38:35 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:38:35 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:38:35 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:38:35 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:38:35 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:38:36 ctl02 heat-api[13008]: 2017-09-28 12:38:36.298 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:38:36] "OPTIONS / HTTP/1.0" 200 134 0.000629
Sep 28 12:38:36 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:38:36.308 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:38:36] "OPTIONS / HTTP/1.0" 200 134 0.000450
Sep 28 12:38:36 ctl02 neutron-server[30536]: 2017-09-28 12:38:36.338 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 4 dead agents out of 6:
Sep 28 12:38:36 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:38:36 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:36:56 cmp002
Sep 28 12:38:36 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:36:48 cmp001
Sep 28 12:38:36 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:36:50 cmp002
Sep 28 12:38:36 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:37:06 cmp002
Sep 28 12:38:37 ctl02 nova-api[4908]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:38:37 ctl02 nova-api[4908]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:38:37 ctl02 heat-api[13008]: 2017-09-28 12:38:37.467 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:38:37] "OPTIONS / HTTP/1.0" 200 134 0.000735
Sep 28 12:38:37 ctl02 nova-api[4908]: 2017-09-28 12:38:37.503 4908 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:38:37 ctl02 nova-api[4908]: 2017-09-28 12:38:37.505 4908 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:38:37 ctl02 nova-api[4908]: 2017-09-28 12:38:37.505 4908 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:38:37 ctl02 nova-api[4908]: 2017-09-28 12:38:37.505 4908 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:38:37 ctl02 nova-api[4908]: 2017-09-28 12:38:37.505 4908 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:38:37 ctl02 nova-api[4908]: 2017-09-28 12:38:37.505 4908 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:38:37 ctl02 nova-api[4908]: 2017-09-28 12:38:37.505 4908 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:38:37 ctl02 nova-api[4908]: 2017-09-28 12:38:37.505 4908 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:38:37 ctl02 nova-api[4908]: 2017-09-28 12:38:37.505 4908 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:38:37 ctl02 nova-api[4908]: 2017-09-28 12:38:37.505 4908 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:38:37 ctl02 nova-api[4908]: 2017-09-28 12:38:37.505 4908 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:38:37 ctl02 nova-api[4908]: 2017-09-28 12:38:37.505 4908 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:38:37 ctl02 nova-api[4908]: 2017-09-28 12:38:37.505 4908 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:38:37 ctl02 nova-api[4908]: 2017-09-28 12:38:37.505 4908 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:38:37 ctl02 nova-api[4908]: 2017-09-28 12:38:37.505 4908 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:38:37 ctl02 nova-api[4908]: 2017-09-28 12:38:37.505 4908 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:38:37 ctl02 nova-api[4908]: 2017-09-28 12:38:37.505 4908 ERROR nova.wsgi     self.filename))
Sep 28 12:38:37 ctl02 nova-api[4908]: 2017-09-28 12:38:37.505 4908 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:38:37 ctl02 nova-api[4908]: 2017-09-28 12:38:37.505 4908 ERROR nova.wsgi
Sep 28 12:38:37 ctl02 nova-api[4908]: 2017-09-28 12:38:37.506 4908 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:38:37 ctl02 nova-api[4908]: 2017-09-28 12:38:37.636 4908 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:38:37 ctl02 nova-api[4908]: 2017-09-28 12:38:37.859 4908 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:38:37 ctl02 nova-api[4908]: 2017-09-28 12:38:37.861 4908 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:38:37 ctl02 nova-api[4908]: 2017-09-28 12:38:37.862 4908 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:38:37 ctl02 nova-api[4908]: 2017-09-28 12:38:37.862 4908 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:38:37 ctl02 nova-api[4908]: 2017-09-28 12:38:37.994 4908 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:38:37 ctl02 nova-api[4908]: 2017-09-28 12:38:37.995 4908 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:38:37 ctl02 nova-api[4908]: 2017-09-28 12:38:37.996 4908 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:38:37 ctl02 nova-api[4908]: 2017-09-28 12:38:37.996 4908 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:38:37 ctl02 nova-api[4908]: 2017-09-28 12:38:37.999 4908 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:38:38 ctl02 nova-api[4908]: 2017-09-28 12:38:37.999 4908 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:38:38 ctl02 nova-api[4908]: 2017-09-28 12:38:37.999 4908 ERROR nova Traceback (most recent call last):
Sep 28 12:38:38 ctl02 nova-api[4908]: 2017-09-28 12:38:37.999 4908 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:38:38 ctl02 nova-api[4908]: 2017-09-28 12:38:37.999 4908 ERROR nova     sys.exit(main())
Sep 28 12:38:38 ctl02 nova-api[4908]: 2017-09-28 12:38:37.999 4908 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:38:38 ctl02 nova-api[4908]: 2017-09-28 12:38:37.999 4908 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:38:38 ctl02 nova-api[4908]: 2017-09-28 12:38:37.999 4908 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:38:38 ctl02 nova-api[4908]: 2017-09-28 12:38:37.999 4908 ERROR nova     max_url_len=max_url_len)
Sep 28 12:38:38 ctl02 nova-api[4908]: 2017-09-28 12:38:37.999 4908 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:38:38 ctl02 nova-api[4908]: 2017-09-28 12:38:37.999 4908 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:38:38 ctl02 nova-api[4908]: 2017-09-28 12:38:37.999 4908 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:38:38 ctl02 nova-api[4908]: 2017-09-28 12:38:37.999 4908 ERROR nova     sock.listen(backlog)
Sep 28 12:38:38 ctl02 nova-api[4908]: 2017-09-28 12:38:37.999 4908 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:38:38 ctl02 nova-api[4908]: 2017-09-28 12:38:37.999 4908 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:38:38 ctl02 nova-api[4908]: 2017-09-28 12:38:37.999 4908 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:38:38 ctl02 nova-api[4908]: 2017-09-28 12:38:37.999 4908 ERROR nova
Sep 28 12:38:38 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:38:38 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:38:38 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:38:38 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:38:38 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:38:38 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:38:38 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:38:38 ctl02 heat-api[13008]: 2017-09-28 12:38:38.700 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:38:38] "OPTIONS / HTTP/1.0" 200 134 0.000707
Sep 28 12:38:38 ctl02 heat-api-cfn[13300]: 2017-09-28 12:38:38.736 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:38:38] "OPTIONS / HTTP/1.0" 200 134 0.000485
Sep 28 12:38:39 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:38:39.031 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:38:39] "OPTIONS / HTTP/1.0" 200 134 0.000453
Sep 28 12:38:39 ctl02 heat-api-cfn[13300]: 2017-09-28 12:38:39.053 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:38:39] "OPTIONS / HTTP/1.0" 200 134 0.000528
Sep 28 12:38:40 ctl02 nova-api[4926]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:38:40 ctl02 nova-api[4926]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:38:40 ctl02 nova-consoleauth[5433]: 2017-09-28 12:38:40.182 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:38:40 ctl02 nova-api[4926]: 2017-09-28 12:38:40.287 4926 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:38:40 ctl02 nova-api[4926]: 2017-09-28 12:38:40.289 4926 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:38:40 ctl02 nova-api[4926]: 2017-09-28 12:38:40.289 4926 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:38:40 ctl02 nova-api[4926]: 2017-09-28 12:38:40.289 4926 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:38:40 ctl02 nova-api[4926]: 2017-09-28 12:38:40.289 4926 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:38:40 ctl02 nova-api[4926]: 2017-09-28 12:38:40.289 4926 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:38:40 ctl02 nova-api[4926]: 2017-09-28 12:38:40.289 4926 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:38:40 ctl02 nova-api[4926]: 2017-09-28 12:38:40.289 4926 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:38:40 ctl02 nova-api[4926]: 2017-09-28 12:38:40.289 4926 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:38:40 ctl02 nova-api[4926]: 2017-09-28 12:38:40.289 4926 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:38:40 ctl02 nova-api[4926]: 2017-09-28 12:38:40.289 4926 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:38:40 ctl02 nova-api[4926]: 2017-09-28 12:38:40.289 4926 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:38:40 ctl02 nova-api[4926]: 2017-09-28 12:38:40.289 4926 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:38:40 ctl02 nova-api[4926]: 2017-09-28 12:38:40.289 4926 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:38:40 ctl02 nova-api[4926]: 2017-09-28 12:38:40.289 4926 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:38:40 ctl02 nova-api[4926]: 2017-09-28 12:38:40.289 4926 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:38:40 ctl02 nova-api[4926]: 2017-09-28 12:38:40.289 4926 ERROR nova.wsgi     self.filename))
Sep 28 12:38:40 ctl02 nova-api[4926]: 2017-09-28 12:38:40.289 4926 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:38:40 ctl02 nova-api[4926]: 2017-09-28 12:38:40.289 4926 ERROR nova.wsgi
Sep 28 12:38:40 ctl02 nova-api[4926]: 2017-09-28 12:38:40.290 4926 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:38:40 ctl02 nova-api[4926]: 2017-09-28 12:38:40.424 4926 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:38:40 ctl02 nova-api[4926]: 2017-09-28 12:38:40.674 4926 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:38:40 ctl02 nova-api[4926]: 2017-09-28 12:38:40.677 4926 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:38:40 ctl02 nova-api[4926]: 2017-09-28 12:38:40.677 4926 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:38:40 ctl02 nova-api[4926]: 2017-09-28 12:38:40.677 4926 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:38:40 ctl02 neutron-server[30536]: 2017-09-28 12:38:40.726 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:38:40] "OPTIONS / HTTP/1.0" 200 262 0.000565
Sep 28 12:38:40 ctl02 nova-api[4926]: 2017-09-28 12:38:40.813 4926 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:38:40 ctl02 nova-api[4926]: 2017-09-28 12:38:40.816 4926 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:38:40 ctl02 nova-api[4926]: 2017-09-28 12:38:40.816 4926 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:38:40 ctl02 nova-api[4926]: 2017-09-28 12:38:40.816 4926 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:38:40 ctl02 nova-api[4926]: 2017-09-28 12:38:40.819 4926 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:38:40 ctl02 nova-api[4926]: 2017-09-28 12:38:40.820 4926 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:38:40 ctl02 nova-api[4926]: 2017-09-28 12:38:40.820 4926 ERROR nova Traceback (most recent call last):
Sep 28 12:38:40 ctl02 nova-api[4926]: 2017-09-28 12:38:40.820 4926 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:38:40 ctl02 nova-api[4926]: 2017-09-28 12:38:40.820 4926 ERROR nova     sys.exit(main())
Sep 28 12:38:40 ctl02 nova-api[4926]: 2017-09-28 12:38:40.820 4926 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:38:40 ctl02 nova-api[4926]: 2017-09-28 12:38:40.820 4926 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:38:40 ctl02 nova-api[4926]: 2017-09-28 12:38:40.820 4926 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:38:40 ctl02 nova-api[4926]: 2017-09-28 12:38:40.820 4926 ERROR nova     max_url_len=max_url_len)
Sep 28 12:38:40 ctl02 nova-api[4926]: 2017-09-28 12:38:40.820 4926 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:38:40 ctl02 nova-api[4926]: 2017-09-28 12:38:40.820 4926 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:38:40 ctl02 nova-api[4926]: 2017-09-28 12:38:40.820 4926 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:38:40 ctl02 nova-api[4926]: 2017-09-28 12:38:40.820 4926 ERROR nova     sock.listen(backlog)
Sep 28 12:38:40 ctl02 nova-api[4926]: 2017-09-28 12:38:40.820 4926 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:38:40 ctl02 nova-api[4926]: 2017-09-28 12:38:40.820 4926 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:38:40 ctl02 nova-api[4926]: 2017-09-28 12:38:40.820 4926 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:38:40 ctl02 nova-api[4926]: 2017-09-28 12:38:40.820 4926 ERROR nova
Sep 28 12:38:40 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:38:40 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:38:40 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:38:41 ctl02 neutron-server[30536]: 2017-09-28 12:38:41.012 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:38:41] "OPTIONS / HTTP/1.0" 200 262 0.000536
Sep 28 12:38:41 ctl02 neutron-server[30536]: 2017-09-28 12:38:41.046 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:38:41] "OPTIONS / HTTP/1.0" 200 262 0.000284
Sep 28 12:38:41 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:38:41 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:38:41 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:38:41 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:38:41 ctl02 glance-api[29183]: 2017-09-28 12:38:41.596 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:38:41] "OPTIONS / HTTP/1.0" 200 134 0.000619
Sep 28 12:38:41 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc9bbd34c)
Sep 28 12:38:42 ctl02 heat-engine[12803]: 2017-09-28 12:38:42.010 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:38:42 ctl02 heat-engine[12803]: 2017-09-28 12:38:42.015 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:38:42 ctl02 heat-engine[12803]: 2017-09-28 12:38:42.014 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:38:42 ctl02 heat-engine[12803]: 2017-09-28 12:38:42.019 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:38:42 ctl02 glance-api[29183]: 2017-09-28 12:38:42.537 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:38:42] "OPTIONS / HTTP/1.0" 200 134 0.000561
Sep 28 12:38:42 ctl02 heat-api-cfn[13300]: 2017-09-28 12:38:42.538 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:38:42] "OPTIONS / HTTP/1.0" 200 134 0.000411
Sep 28 12:38:42 ctl02 nova-api[4943]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:38:42 ctl02 nova-api[4943]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:38:42 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc9bbd34c)
Sep 28 12:38:43 ctl02 nova-api[4943]: 2017-09-28 12:38:43.033 4943 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:38:43 ctl02 nova-api[4943]: 2017-09-28 12:38:43.035 4943 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:38:43 ctl02 nova-api[4943]: 2017-09-28 12:38:43.035 4943 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:38:43 ctl02 nova-api[4943]: 2017-09-28 12:38:43.035 4943 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:38:43 ctl02 nova-api[4943]: 2017-09-28 12:38:43.035 4943 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:38:43 ctl02 nova-api[4943]: 2017-09-28 12:38:43.035 4943 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:38:43 ctl02 nova-api[4943]: 2017-09-28 12:38:43.035 4943 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:38:43 ctl02 nova-api[4943]: 2017-09-28 12:38:43.035 4943 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:38:43 ctl02 nova-api[4943]: 2017-09-28 12:38:43.035 4943 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:38:43 ctl02 nova-api[4943]: 2017-09-28 12:38:43.035 4943 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:38:43 ctl02 nova-api[4943]: 2017-09-28 12:38:43.035 4943 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:38:43 ctl02 nova-api[4943]: 2017-09-28 12:38:43.035 4943 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:38:43 ctl02 nova-api[4943]: 2017-09-28 12:38:43.035 4943 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:38:43 ctl02 nova-api[4943]: 2017-09-28 12:38:43.035 4943 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:38:43 ctl02 nova-api[4943]: 2017-09-28 12:38:43.035 4943 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:38:43 ctl02 nova-api[4943]: 2017-09-28 12:38:43.035 4943 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:38:43 ctl02 nova-api[4943]: 2017-09-28 12:38:43.035 4943 ERROR nova.wsgi     self.filename))
Sep 28 12:38:43 ctl02 nova-api[4943]: 2017-09-28 12:38:43.035 4943 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:38:43 ctl02 nova-api[4943]: 2017-09-28 12:38:43.035 4943 ERROR nova.wsgi
Sep 28 12:38:43 ctl02 nova-api[4943]: 2017-09-28 12:38:43.036 4943 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:38:43 ctl02 nova-api[4943]: 2017-09-28 12:38:43.167 4943 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:38:43 ctl02 nova-scheduler[5620]: 2017-09-28 12:38:43.269 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:38:43 ctl02 nova-api[4943]: 2017-09-28 12:38:43.399 4943 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:38:43 ctl02 nova-api[4943]: 2017-09-28 12:38:43.401 4943 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:38:43 ctl02 nova-api[4943]: 2017-09-28 12:38:43.401 4943 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:38:43 ctl02 nova-api[4943]: 2017-09-28 12:38:43.401 4943 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:38:43 ctl02 glance-api[29183]: 2017-09-28 12:38:43.480 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:38:43] "OPTIONS / HTTP/1.0" 200 134 0.000548
Sep 28 12:38:43 ctl02 neutron-server[30536]: 2017-09-28 12:38:43.497 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:38:43 ctl02 nova-api[4943]: 2017-09-28 12:38:43.540 4943 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:38:43 ctl02 nova-api[4943]: 2017-09-28 12:38:43.543 4943 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:38:43 ctl02 nova-api[4943]: 2017-09-28 12:38:43.543 4943 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:38:43 ctl02 nova-api[4943]: 2017-09-28 12:38:43.544 4943 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:38:43 ctl02 nova-api[4943]: 2017-09-28 12:38:43.547 4943 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:38:43 ctl02 nova-api[4943]: 2017-09-28 12:38:43.548 4943 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:38:43 ctl02 nova-api[4943]: 2017-09-28 12:38:43.548 4943 ERROR nova Traceback (most recent call last):
Sep 28 12:38:43 ctl02 nova-api[4943]: 2017-09-28 12:38:43.548 4943 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:38:43 ctl02 nova-api[4943]: 2017-09-28 12:38:43.548 4943 ERROR nova     sys.exit(main())
Sep 28 12:38:43 ctl02 nova-api[4943]: 2017-09-28 12:38:43.548 4943 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:38:43 ctl02 nova-api[4943]: 2017-09-28 12:38:43.548 4943 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:38:43 ctl02 nova-api[4943]: 2017-09-28 12:38:43.548 4943 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:38:43 ctl02 nova-api[4943]: 2017-09-28 12:38:43.548 4943 ERROR nova     max_url_len=max_url_len)
Sep 28 12:38:43 ctl02 nova-api[4943]: 2017-09-28 12:38:43.548 4943 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:38:43 ctl02 nova-api[4943]: 2017-09-28 12:38:43.548 4943 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:38:43 ctl02 nova-api[4943]: 2017-09-28 12:38:43.548 4943 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:38:43 ctl02 nova-api[4943]: 2017-09-28 12:38:43.548 4943 ERROR nova     sock.listen(backlog)
Sep 28 12:38:43 ctl02 nova-api[4943]: 2017-09-28 12:38:43.548 4943 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:38:43 ctl02 nova-api[4943]: 2017-09-28 12:38:43.548 4943 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:38:43 ctl02 nova-api[4943]: 2017-09-28 12:38:43.548 4943 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:38:43 ctl02 nova-api[4943]: 2017-09-28 12:38:43.548 4943 ERROR nova
Sep 28 12:38:43 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:38:43 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:38:43 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:38:43 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:38:43 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:38:43 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:38:43 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:38:43 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc9bbd34c)
Sep 28 12:38:44 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:38:44.190 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:38:44] "OPTIONS / HTTP/1.0" 200 134 0.000368
Sep 28 12:38:44 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc9bbd34c)
Sep 28 12:38:45 ctl02 nova-api[4962]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:38:45 ctl02 nova-api[4962]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:38:45 ctl02 nova-api[4962]: 2017-09-28 12:38:45.714 4962 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:38:45 ctl02 nova-api[4962]: 2017-09-28 12:38:45.715 4962 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:38:45 ctl02 nova-api[4962]: 2017-09-28 12:38:45.715 4962 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:38:45 ctl02 nova-api[4962]: 2017-09-28 12:38:45.715 4962 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:38:45 ctl02 nova-api[4962]: 2017-09-28 12:38:45.715 4962 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:38:45 ctl02 nova-api[4962]: 2017-09-28 12:38:45.715 4962 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:38:45 ctl02 nova-api[4962]: 2017-09-28 12:38:45.715 4962 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:38:45 ctl02 nova-api[4962]: 2017-09-28 12:38:45.715 4962 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:38:45 ctl02 nova-api[4962]: 2017-09-28 12:38:45.715 4962 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:38:45 ctl02 nova-api[4962]: 2017-09-28 12:38:45.715 4962 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:38:45 ctl02 nova-api[4962]: 2017-09-28 12:38:45.715 4962 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:38:45 ctl02 nova-api[4962]: 2017-09-28 12:38:45.715 4962 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:38:45 ctl02 nova-api[4962]: 2017-09-28 12:38:45.715 4962 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:38:45 ctl02 nova-api[4962]: 2017-09-28 12:38:45.715 4962 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:38:45 ctl02 nova-api[4962]: 2017-09-28 12:38:45.715 4962 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:38:45 ctl02 nova-api[4962]: 2017-09-28 12:38:45.715 4962 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:38:45 ctl02 nova-api[4962]: 2017-09-28 12:38:45.715 4962 ERROR nova.wsgi     self.filename))
Sep 28 12:38:45 ctl02 nova-api[4962]: 2017-09-28 12:38:45.715 4962 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:38:45 ctl02 nova-api[4962]: 2017-09-28 12:38:45.715 4962 ERROR nova.wsgi
Sep 28 12:38:45 ctl02 nova-api[4962]: 2017-09-28 12:38:45.716 4962 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:38:45 ctl02 nova-api[4962]: 2017-09-28 12:38:45.843 4962 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:38:45 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc9bbd34c)
Sep 28 12:38:46 ctl02 nova-api[4962]: 2017-09-28 12:38:46.067 4962 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:38:46 ctl02 nova-api[4962]: 2017-09-28 12:38:46.069 4962 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:38:46 ctl02 nova-api[4962]: 2017-09-28 12:38:46.069 4962 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:38:46 ctl02 nova-api[4962]: 2017-09-28 12:38:46.069 4962 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:38:46 ctl02 heat-api[13008]: 2017-09-28 12:38:46.082 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:38:46] "OPTIONS / HTTP/1.0" 200 134 0.000542
Sep 28 12:38:46 ctl02 nova-api[4962]: 2017-09-28 12:38:46.200 4962 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:38:46 ctl02 nova-api[4962]: 2017-09-28 12:38:46.202 4962 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:38:46 ctl02 nova-api[4962]: 2017-09-28 12:38:46.202 4962 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:38:46 ctl02 nova-api[4962]: 2017-09-28 12:38:46.203 4962 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:38:46 ctl02 nova-api[4962]: 2017-09-28 12:38:46.206 4962 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:38:46 ctl02 nova-api[4962]: 2017-09-28 12:38:46.206 4962 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:38:46 ctl02 nova-api[4962]: 2017-09-28 12:38:46.206 4962 ERROR nova Traceback (most recent call last):
Sep 28 12:38:46 ctl02 nova-api[4962]: 2017-09-28 12:38:46.206 4962 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:38:46 ctl02 nova-api[4962]: 2017-09-28 12:38:46.206 4962 ERROR nova     sys.exit(main())
Sep 28 12:38:46 ctl02 nova-api[4962]: 2017-09-28 12:38:46.206 4962 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:38:46 ctl02 nova-api[4962]: 2017-09-28 12:38:46.206 4962 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:38:46 ctl02 nova-api[4962]: 2017-09-28 12:38:46.206 4962 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:38:46 ctl02 nova-api[4962]: 2017-09-28 12:38:46.206 4962 ERROR nova     max_url_len=max_url_len)
Sep 28 12:38:46 ctl02 nova-api[4962]: 2017-09-28 12:38:46.206 4962 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:38:46 ctl02 nova-api[4962]: 2017-09-28 12:38:46.206 4962 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:38:46 ctl02 nova-api[4962]: 2017-09-28 12:38:46.206 4962 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:38:46 ctl02 nova-api[4962]: 2017-09-28 12:38:46.206 4962 ERROR nova     sock.listen(backlog)
Sep 28 12:38:46 ctl02 nova-api[4962]: 2017-09-28 12:38:46.206 4962 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:38:46 ctl02 nova-api[4962]: 2017-09-28 12:38:46.206 4962 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:38:46 ctl02 nova-api[4962]: 2017-09-28 12:38:46.206 4962 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:38:46 ctl02 nova-api[4962]: 2017-09-28 12:38:46.206 4962 ERROR nova
Sep 28 12:38:46 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:38:46.332 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:38:46] "OPTIONS / HTTP/1.0" 200 134 0.000487
Sep 28 12:38:46 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:38:46 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:38:46 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:38:46 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:38:46 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:38:46 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:38:46 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:38:46 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc9bbd34c)
Sep 28 12:38:47 ctl02 heat-api[13008]: 2017-09-28 12:38:47.497 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:38:47] "OPTIONS / HTTP/1.0" 200 134 0.000562
Sep 28 12:38:47 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc9bbd34c)
Sep 28 12:38:48 ctl02 nova-api[4979]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:38:48 ctl02 nova-api[4979]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:38:48 ctl02 nova-api[4979]: 2017-09-28 12:38:48.503 4979 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:38:48 ctl02 nova-api[4979]: 2017-09-28 12:38:48.504 4979 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:38:48 ctl02 nova-api[4979]: 2017-09-28 12:38:48.504 4979 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:38:48 ctl02 nova-api[4979]: 2017-09-28 12:38:48.504 4979 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:38:48 ctl02 nova-api[4979]: 2017-09-28 12:38:48.504 4979 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:38:48 ctl02 nova-api[4979]: 2017-09-28 12:38:48.504 4979 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:38:48 ctl02 nova-api[4979]: 2017-09-28 12:38:48.504 4979 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:38:48 ctl02 nova-api[4979]: 2017-09-28 12:38:48.504 4979 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:38:48 ctl02 nova-api[4979]: 2017-09-28 12:38:48.504 4979 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:38:48 ctl02 nova-api[4979]: 2017-09-28 12:38:48.504 4979 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:38:48 ctl02 nova-api[4979]: 2017-09-28 12:38:48.504 4979 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:38:48 ctl02 nova-api[4979]: 2017-09-28 12:38:48.504 4979 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:38:48 ctl02 nova-api[4979]: 2017-09-28 12:38:48.504 4979 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:38:48 ctl02 nova-api[4979]: 2017-09-28 12:38:48.504 4979 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:38:48 ctl02 nova-api[4979]: 2017-09-28 12:38:48.504 4979 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:38:48 ctl02 nova-api[4979]: 2017-09-28 12:38:48.504 4979 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:38:48 ctl02 nova-api[4979]: 2017-09-28 12:38:48.504 4979 ERROR nova.wsgi     self.filename))
Sep 28 12:38:48 ctl02 nova-api[4979]: 2017-09-28 12:38:48.504 4979 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:38:48 ctl02 nova-api[4979]: 2017-09-28 12:38:48.504 4979 ERROR nova.wsgi
Sep 28 12:38:48 ctl02 nova-api[4979]: 2017-09-28 12:38:48.505 4979 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:38:48 ctl02 nova-api[4979]: 2017-09-28 12:38:48.636 4979 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:38:48 ctl02 heat-api-cfn[13300]: 2017-09-28 12:38:48.684 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:38:48] "OPTIONS / HTTP/1.0" 200 134 0.000446
Sep 28 12:38:48 ctl02 heat-api-cfn[13300]: 2017-09-28 12:38:48.717 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:38:48] "OPTIONS / HTTP/1.0" 200 134 0.000280
Sep 28 12:38:48 ctl02 heat-api[13008]: 2017-09-28 12:38:48.804 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:38:48] "OPTIONS / HTTP/1.0" 200 134 0.000640
Sep 28 12:38:48 ctl02 nova-api[4979]: 2017-09-28 12:38:48.899 4979 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:38:48 ctl02 nova-api[4979]: 2017-09-28 12:38:48.902 4979 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:38:48 ctl02 nova-api[4979]: 2017-09-28 12:38:48.902 4979 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:38:48 ctl02 nova-api[4979]: 2017-09-28 12:38:48.902 4979 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:38:48 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc9bbd34c)
Sep 28 12:38:49 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:38:49.027 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:38:49] "OPTIONS / HTTP/1.0" 200 134 0.000471
Sep 28 12:38:49 ctl02 nova-api[4979]: 2017-09-28 12:38:49.037 4979 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:38:49 ctl02 nova-api[4979]: 2017-09-28 12:38:49.039 4979 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:38:49 ctl02 nova-api[4979]: 2017-09-28 12:38:49.039 4979 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:38:49 ctl02 nova-api[4979]: 2017-09-28 12:38:49.039 4979 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:38:49 ctl02 nova-api[4979]: 2017-09-28 12:38:49.043 4979 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:38:49 ctl02 nova-api[4979]: 2017-09-28 12:38:49.043 4979 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:38:49 ctl02 nova-api[4979]: 2017-09-28 12:38:49.043 4979 ERROR nova Traceback (most recent call last):
Sep 28 12:38:49 ctl02 nova-api[4979]: 2017-09-28 12:38:49.043 4979 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:38:49 ctl02 nova-api[4979]: 2017-09-28 12:38:49.043 4979 ERROR nova     sys.exit(main())
Sep 28 12:38:49 ctl02 nova-api[4979]: 2017-09-28 12:38:49.043 4979 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:38:49 ctl02 nova-api[4979]: 2017-09-28 12:38:49.043 4979 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:38:49 ctl02 nova-api[4979]: 2017-09-28 12:38:49.043 4979 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:38:49 ctl02 nova-api[4979]: 2017-09-28 12:38:49.043 4979 ERROR nova     max_url_len=max_url_len)
Sep 28 12:38:49 ctl02 nova-api[4979]: 2017-09-28 12:38:49.043 4979 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:38:49 ctl02 nova-api[4979]: 2017-09-28 12:38:49.043 4979 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:38:49 ctl02 nova-api[4979]: 2017-09-28 12:38:49.043 4979 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:38:49 ctl02 nova-api[4979]: 2017-09-28 12:38:49.043 4979 ERROR nova     sock.listen(backlog)
Sep 28 12:38:49 ctl02 nova-api[4979]: 2017-09-28 12:38:49.043 4979 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:38:49 ctl02 nova-api[4979]: 2017-09-28 12:38:49.043 4979 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:38:49 ctl02 nova-api[4979]: 2017-09-28 12:38:49.043 4979 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:38:49 ctl02 nova-api[4979]: 2017-09-28 12:38:49.043 4979 ERROR nova
Sep 28 12:38:49 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:38:49 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:38:49 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:38:49 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:38:49 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:38:49 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:38:49 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:38:49 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc9bbd34c)
Sep 28 12:38:50 ctl02 neutron-server[30536]: 2017-09-28 12:38:50.693 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:38:50] "OPTIONS / HTTP/1.0" 200 262 0.000460
Sep 28 12:38:50 ctl02 neutron-server[30536]: 2017-09-28 12:38:50.744 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:38:50] "OPTIONS / HTTP/1.0" 200 262 0.000279
Sep 28 12:38:50 ctl02 neutron-server[30536]: 2017-09-28 12:38:50.950 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:38:50] "OPTIONS / HTTP/1.0" 200 262 0.000277
Sep 28 12:38:50 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc9bbd34c)
Sep 28 12:38:51 ctl02 nova-api[4997]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:38:51 ctl02 nova-api[4997]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:38:51 ctl02 nova-api[4997]: 2017-09-28 12:38:51.231 4997 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:38:51 ctl02 nova-api[4997]: 2017-09-28 12:38:51.233 4997 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:38:51 ctl02 nova-api[4997]: 2017-09-28 12:38:51.233 4997 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:38:51 ctl02 nova-api[4997]: 2017-09-28 12:38:51.233 4997 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:38:51 ctl02 nova-api[4997]: 2017-09-28 12:38:51.233 4997 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:38:51 ctl02 nova-api[4997]: 2017-09-28 12:38:51.233 4997 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:38:51 ctl02 nova-api[4997]: 2017-09-28 12:38:51.233 4997 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:38:51 ctl02 nova-api[4997]: 2017-09-28 12:38:51.233 4997 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:38:51 ctl02 nova-api[4997]: 2017-09-28 12:38:51.233 4997 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:38:51 ctl02 nova-api[4997]: 2017-09-28 12:38:51.233 4997 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:38:51 ctl02 nova-api[4997]: 2017-09-28 12:38:51.233 4997 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:38:51 ctl02 nova-api[4997]: 2017-09-28 12:38:51.233 4997 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:38:51 ctl02 nova-api[4997]: 2017-09-28 12:38:51.233 4997 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:38:51 ctl02 nova-api[4997]: 2017-09-28 12:38:51.233 4997 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:38:51 ctl02 nova-api[4997]: 2017-09-28 12:38:51.233 4997 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:38:51 ctl02 nova-api[4997]: 2017-09-28 12:38:51.233 4997 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:38:51 ctl02 nova-api[4997]: 2017-09-28 12:38:51.233 4997 ERROR nova.wsgi     self.filename))
Sep 28 12:38:51 ctl02 nova-api[4997]: 2017-09-28 12:38:51.233 4997 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:38:51 ctl02 nova-api[4997]: 2017-09-28 12:38:51.233 4997 ERROR nova.wsgi
Sep 28 12:38:51 ctl02 nova-api[4997]: 2017-09-28 12:38:51.233 4997 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:38:51 ctl02 neutron-server[30536]: 2017-09-28 12:38:51.335 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 2 dead agents out of 6:
Sep 28 12:38:51 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:38:51 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:36:56 cmp002
Sep 28 12:38:51 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:37:06 cmp002
Sep 28 12:38:51 ctl02 glance-api[29183]: 2017-09-28 12:38:51.336 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:38:51] "OPTIONS / HTTP/1.0" 200 134 0.000557
Sep 28 12:38:51 ctl02 nova-api[4997]: 2017-09-28 12:38:51.365 4997 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:38:51 ctl02 nova-api[4997]: 2017-09-28 12:38:51.588 4997 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:38:51 ctl02 nova-api[4997]: 2017-09-28 12:38:51.590 4997 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:38:51 ctl02 nova-api[4997]: 2017-09-28 12:38:51.590 4997 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:38:51 ctl02 nova-api[4997]: 2017-09-28 12:38:51.591 4997 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:38:51 ctl02 nova-api[4997]: 2017-09-28 12:38:51.722 4997 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:38:51 ctl02 nova-api[4997]: 2017-09-28 12:38:51.729 4997 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:38:51 ctl02 nova-api[4997]: 2017-09-28 12:38:51.730 4997 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:38:51 ctl02 nova-api[4997]: 2017-09-28 12:38:51.730 4997 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:38:51 ctl02 nova-api[4997]: 2017-09-28 12:38:51.733 4997 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:38:51 ctl02 nova-api[4997]: 2017-09-28 12:38:51.734 4997 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:38:51 ctl02 nova-api[4997]: 2017-09-28 12:38:51.734 4997 ERROR nova Traceback (most recent call last):
Sep 28 12:38:51 ctl02 nova-api[4997]: 2017-09-28 12:38:51.734 4997 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:38:51 ctl02 nova-api[4997]: 2017-09-28 12:38:51.734 4997 ERROR nova     sys.exit(main())
Sep 28 12:38:51 ctl02 nova-api[4997]: 2017-09-28 12:38:51.734 4997 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:38:51 ctl02 nova-api[4997]: 2017-09-28 12:38:51.734 4997 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:38:51 ctl02 nova-api[4997]: 2017-09-28 12:38:51.734 4997 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:38:51 ctl02 nova-api[4997]: 2017-09-28 12:38:51.734 4997 ERROR nova     max_url_len=max_url_len)
Sep 28 12:38:51 ctl02 nova-api[4997]: 2017-09-28 12:38:51.734 4997 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:38:51 ctl02 nova-api[4997]: 2017-09-28 12:38:51.734 4997 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:38:51 ctl02 nova-api[4997]: 2017-09-28 12:38:51.734 4997 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:38:51 ctl02 nova-api[4997]: 2017-09-28 12:38:51.734 4997 ERROR nova     sock.listen(backlog)
Sep 28 12:38:51 ctl02 nova-api[4997]: 2017-09-28 12:38:51.734 4997 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:38:51 ctl02 nova-api[4997]: 2017-09-28 12:38:51.734 4997 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:38:51 ctl02 nova-api[4997]: 2017-09-28 12:38:51.734 4997 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:38:51 ctl02 nova-api[4997]: 2017-09-28 12:38:51.734 4997 ERROR nova
Sep 28 12:38:51 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:38:51 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:38:51 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:38:51 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc9bbd34c)
Sep 28 12:38:52 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:38:52 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:38:52 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:38:52 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:38:52 ctl02 heat-api-cfn[13300]: 2017-09-28 12:38:52.179 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:38:52] "OPTIONS / HTTP/1.0" 200 134 0.000544
Sep 28 12:38:52 ctl02 glance-api[29183]: 2017-09-28 12:38:52.294 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:38:52] "OPTIONS / HTTP/1.0" 200 134 0.000604
Sep 28 12:38:52 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:38:52 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:38:53 ctl02 glance-api[29183]: 2017-09-28 12:38:53.133 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:38:53] "OPTIONS / HTTP/1.0" 200 134 0.000562
Sep 28 12:38:53 ctl02 nova-api[5016]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:38:53 ctl02 nova-api[5016]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:38:53 ctl02 nova-api[5016]: 2017-09-28 12:38:53.981 5016 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:38:53 ctl02 nova-api[5016]: 2017-09-28 12:38:53.982 5016 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:38:53 ctl02 nova-api[5016]: 2017-09-28 12:38:53.982 5016 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:38:53 ctl02 nova-api[5016]: 2017-09-28 12:38:53.982 5016 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:38:53 ctl02 nova-api[5016]: 2017-09-28 12:38:53.982 5016 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:38:53 ctl02 nova-api[5016]: 2017-09-28 12:38:53.982 5016 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:38:53 ctl02 nova-api[5016]: 2017-09-28 12:38:53.982 5016 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:38:53 ctl02 nova-api[5016]: 2017-09-28 12:38:53.982 5016 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:38:53 ctl02 nova-api[5016]: 2017-09-28 12:38:53.982 5016 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:38:53 ctl02 nova-api[5016]: 2017-09-28 12:38:53.982 5016 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:38:53 ctl02 nova-api[5016]: 2017-09-28 12:38:53.982 5016 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:38:53 ctl02 nova-api[5016]: 2017-09-28 12:38:53.982 5016 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:38:53 ctl02 nova-api[5016]: 2017-09-28 12:38:53.982 5016 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:38:53 ctl02 nova-api[5016]: 2017-09-28 12:38:53.982 5016 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:38:53 ctl02 nova-api[5016]: 2017-09-28 12:38:53.982 5016 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:38:53 ctl02 nova-api[5016]: 2017-09-28 12:38:53.982 5016 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:38:53 ctl02 nova-api[5016]: 2017-09-28 12:38:53.982 5016 ERROR nova.wsgi     self.filename))
Sep 28 12:38:53 ctl02 nova-api[5016]: 2017-09-28 12:38:53.982 5016 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:38:53 ctl02 nova-api[5016]: 2017-09-28 12:38:53.982 5016 ERROR nova.wsgi
Sep 28 12:38:53 ctl02 nova-api[5016]: 2017-09-28 12:38:53.983 5016 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:38:53 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:38:53.986 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:38:53] "OPTIONS / HTTP/1.0" 200 134 0.000385
Sep 28 12:38:54 ctl02 nova-api[5016]: 2017-09-28 12:38:54.114 5016 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:38:54 ctl02 nova-api[5016]: 2017-09-28 12:38:54.337 5016 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:38:54 ctl02 nova-api[5016]: 2017-09-28 12:38:54.339 5016 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:38:54 ctl02 nova-api[5016]: 2017-09-28 12:38:54.339 5016 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:38:54 ctl02 nova-api[5016]: 2017-09-28 12:38:54.339 5016 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:38:54 ctl02 nova-api[5016]: 2017-09-28 12:38:54.471 5016 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:38:54 ctl02 nova-api[5016]: 2017-09-28 12:38:54.473 5016 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:38:54 ctl02 nova-api[5016]: 2017-09-28 12:38:54.473 5016 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:38:54 ctl02 nova-api[5016]: 2017-09-28 12:38:54.473 5016 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:38:54 ctl02 nova-api[5016]: 2017-09-28 12:38:54.476 5016 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:38:54 ctl02 nova-api[5016]: 2017-09-28 12:38:54.477 5016 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:38:54 ctl02 nova-api[5016]: 2017-09-28 12:38:54.477 5016 ERROR nova Traceback (most recent call last):
Sep 28 12:38:54 ctl02 nova-api[5016]: 2017-09-28 12:38:54.477 5016 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:38:54 ctl02 nova-api[5016]: 2017-09-28 12:38:54.477 5016 ERROR nova     sys.exit(main())
Sep 28 12:38:54 ctl02 nova-api[5016]: 2017-09-28 12:38:54.477 5016 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:38:54 ctl02 nova-api[5016]: 2017-09-28 12:38:54.477 5016 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:38:54 ctl02 nova-api[5016]: 2017-09-28 12:38:54.477 5016 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:38:54 ctl02 nova-api[5016]: 2017-09-28 12:38:54.477 5016 ERROR nova     max_url_len=max_url_len)
Sep 28 12:38:54 ctl02 nova-api[5016]: 2017-09-28 12:38:54.477 5016 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:38:54 ctl02 nova-api[5016]: 2017-09-28 12:38:54.477 5016 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:38:54 ctl02 nova-api[5016]: 2017-09-28 12:38:54.477 5016 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:38:54 ctl02 nova-api[5016]: 2017-09-28 12:38:54.477 5016 ERROR nova     sock.listen(backlog)
Sep 28 12:38:54 ctl02 nova-api[5016]: 2017-09-28 12:38:54.477 5016 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:38:54 ctl02 nova-api[5016]: 2017-09-28 12:38:54.477 5016 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:38:54 ctl02 nova-api[5016]: 2017-09-28 12:38:54.477 5016 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:38:54 ctl02 nova-api[5016]: 2017-09-28 12:38:54.477 5016 ERROR nova
Sep 28 12:38:54 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:38:54 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:38:54 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:38:54 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:38:54 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:38:54 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:38:54 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:38:55 ctl02 heat-api[13008]: 2017-09-28 12:38:55.799 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:38:55] "OPTIONS / HTTP/1.0" 200 134 0.000649
Sep 28 12:38:56 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:38:56.256 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:38:56] "OPTIONS / HTTP/1.0" 200 134 0.000449
Sep 28 12:38:56 ctl02 nova-api[5039]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:38:56 ctl02 nova-api[5039]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:38:56 ctl02 nova-api[5039]: 2017-09-28 12:38:56.743 5039 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:38:56 ctl02 nova-api[5039]: 2017-09-28 12:38:56.744 5039 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:38:56 ctl02 nova-api[5039]: 2017-09-28 12:38:56.744 5039 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:38:56 ctl02 nova-api[5039]: 2017-09-28 12:38:56.744 5039 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:38:56 ctl02 nova-api[5039]: 2017-09-28 12:38:56.744 5039 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:38:56 ctl02 nova-api[5039]: 2017-09-28 12:38:56.744 5039 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:38:56 ctl02 nova-api[5039]: 2017-09-28 12:38:56.744 5039 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:38:56 ctl02 nova-api[5039]: 2017-09-28 12:38:56.744 5039 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:38:56 ctl02 nova-api[5039]: 2017-09-28 12:38:56.744 5039 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:38:56 ctl02 nova-api[5039]: 2017-09-28 12:38:56.744 5039 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:38:56 ctl02 nova-api[5039]: 2017-09-28 12:38:56.744 5039 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:38:56 ctl02 nova-api[5039]: 2017-09-28 12:38:56.744 5039 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:38:56 ctl02 nova-api[5039]: 2017-09-28 12:38:56.744 5039 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:38:56 ctl02 nova-api[5039]: 2017-09-28 12:38:56.744 5039 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:38:56 ctl02 nova-api[5039]: 2017-09-28 12:38:56.744 5039 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:38:56 ctl02 nova-api[5039]: 2017-09-28 12:38:56.744 5039 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:38:56 ctl02 nova-api[5039]: 2017-09-28 12:38:56.744 5039 ERROR nova.wsgi     self.filename))
Sep 28 12:38:56 ctl02 nova-api[5039]: 2017-09-28 12:38:56.744 5039 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:38:56 ctl02 nova-api[5039]: 2017-09-28 12:38:56.744 5039 ERROR nova.wsgi
Sep 28 12:38:56 ctl02 nova-api[5039]: 2017-09-28 12:38:56.782 5039 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:38:56 ctl02 nova-api[5039]: 2017-09-28 12:38:56.909 5039 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:38:57 ctl02 nova-api[5039]: 2017-09-28 12:38:57.131 5039 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:38:57 ctl02 nova-api[5039]: 2017-09-28 12:38:57.133 5039 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:38:57 ctl02 nova-api[5039]: 2017-09-28 12:38:57.133 5039 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:38:57 ctl02 nova-api[5039]: 2017-09-28 12:38:57.133 5039 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:38:57 ctl02 nova-api[5039]: 2017-09-28 12:38:57.262 5039 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:38:57 ctl02 nova-api[5039]: 2017-09-28 12:38:57.264 5039 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:38:57 ctl02 nova-api[5039]: 2017-09-28 12:38:57.264 5039 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:38:57 ctl02 nova-api[5039]: 2017-09-28 12:38:57.264 5039 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:38:57 ctl02 nova-api[5039]: 2017-09-28 12:38:57.268 5039 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:38:57 ctl02 nova-api[5039]: 2017-09-28 12:38:57.268 5039 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:38:57 ctl02 nova-api[5039]: 2017-09-28 12:38:57.268 5039 ERROR nova Traceback (most recent call last):
Sep 28 12:38:57 ctl02 nova-api[5039]: 2017-09-28 12:38:57.268 5039 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:38:57 ctl02 nova-api[5039]: 2017-09-28 12:38:57.268 5039 ERROR nova     sys.exit(main())
Sep 28 12:38:57 ctl02 nova-api[5039]: 2017-09-28 12:38:57.268 5039 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:38:57 ctl02 nova-api[5039]: 2017-09-28 12:38:57.268 5039 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:38:57 ctl02 nova-api[5039]: 2017-09-28 12:38:57.268 5039 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:38:57 ctl02 nova-api[5039]: 2017-09-28 12:38:57.268 5039 ERROR nova     max_url_len=max_url_len)
Sep 28 12:38:57 ctl02 nova-api[5039]: 2017-09-28 12:38:57.268 5039 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:38:57 ctl02 nova-api[5039]: 2017-09-28 12:38:57.268 5039 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:38:57 ctl02 nova-api[5039]: 2017-09-28 12:38:57.268 5039 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:38:57 ctl02 nova-api[5039]: 2017-09-28 12:38:57.268 5039 ERROR nova     sock.listen(backlog)
Sep 28 12:38:57 ctl02 nova-api[5039]: 2017-09-28 12:38:57.268 5039 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:38:57 ctl02 nova-api[5039]: 2017-09-28 12:38:57.268 5039 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:38:57 ctl02 nova-api[5039]: 2017-09-28 12:38:57.268 5039 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:38:57 ctl02 nova-api[5039]: 2017-09-28 12:38:57.268 5039 ERROR nova
Sep 28 12:38:57 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:38:57 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:38:57 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:38:57 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:38:57 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:38:57 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:38:57 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:38:57 ctl02 heat-api[13008]: 2017-09-28 12:38:57.882 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:38:57] "OPTIONS / HTTP/1.0" 200 134 0.000560
Sep 28 12:38:58 ctl02 heat-api-cfn[13300]: 2017-09-28 12:38:58.925 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:38:58] "OPTIONS / HTTP/1.0" 200 134 0.000446
Sep 28 12:38:59 ctl02 heat-api-cfn[13300]: 2017-09-28 12:38:59.003 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:38:59] "OPTIONS / HTTP/1.0" 200 134 0.000286
Sep 28 12:38:59 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:38:59.154 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:38:59] "OPTIONS / HTTP/1.0" 200 134 0.000420
Sep 28 12:38:59 ctl02 heat-api[13008]: 2017-09-28 12:38:59.196 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:38:59] "OPTIONS / HTTP/1.0" 200 134 0.000503
Sep 28 12:38:59 ctl02 nova-api[5057]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:38:59 ctl02 nova-api[5057]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:38:59 ctl02 nova-api[5057]: 2017-09-28 12:38:59.498 5057 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:38:59 ctl02 nova-api[5057]: 2017-09-28 12:38:59.500 5057 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:38:59 ctl02 nova-api[5057]: 2017-09-28 12:38:59.500 5057 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:38:59 ctl02 nova-api[5057]: 2017-09-28 12:38:59.500 5057 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:38:59 ctl02 nova-api[5057]: 2017-09-28 12:38:59.500 5057 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:38:59 ctl02 nova-api[5057]: 2017-09-28 12:38:59.500 5057 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:38:59 ctl02 nova-api[5057]: 2017-09-28 12:38:59.500 5057 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:38:59 ctl02 nova-api[5057]: 2017-09-28 12:38:59.500 5057 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:38:59 ctl02 nova-api[5057]: 2017-09-28 12:38:59.500 5057 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:38:59 ctl02 nova-api[5057]: 2017-09-28 12:38:59.500 5057 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:38:59 ctl02 nova-api[5057]: 2017-09-28 12:38:59.500 5057 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:38:59 ctl02 nova-api[5057]: 2017-09-28 12:38:59.500 5057 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:38:59 ctl02 nova-api[5057]: 2017-09-28 12:38:59.500 5057 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:38:59 ctl02 nova-api[5057]: 2017-09-28 12:38:59.500 5057 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:38:59 ctl02 nova-api[5057]: 2017-09-28 12:38:59.500 5057 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:38:59 ctl02 nova-api[5057]: 2017-09-28 12:38:59.500 5057 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:38:59 ctl02 nova-api[5057]: 2017-09-28 12:38:59.500 5057 ERROR nova.wsgi     self.filename))
Sep 28 12:38:59 ctl02 nova-api[5057]: 2017-09-28 12:38:59.500 5057 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:38:59 ctl02 nova-api[5057]: 2017-09-28 12:38:59.500 5057 ERROR nova.wsgi
Sep 28 12:38:59 ctl02 nova-api[5057]: 2017-09-28 12:38:59.501 5057 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:38:59 ctl02 nova-api[5057]: 2017-09-28 12:38:59.628 5057 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:38:59 ctl02 nova-api[5057]: 2017-09-28 12:38:59.853 5057 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:38:59 ctl02 nova-api[5057]: 2017-09-28 12:38:59.855 5057 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:38:59 ctl02 nova-api[5057]: 2017-09-28 12:38:59.855 5057 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:38:59 ctl02 nova-api[5057]: 2017-09-28 12:38:59.856 5057 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:38:59 ctl02 nova-api[5057]: 2017-09-28 12:38:59.984 5057 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:38:59 ctl02 nova-api[5057]: 2017-09-28 12:38:59.986 5057 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:38:59 ctl02 nova-api[5057]: 2017-09-28 12:38:59.987 5057 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:38:59 ctl02 nova-api[5057]: 2017-09-28 12:38:59.987 5057 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:38:59 ctl02 nova-api[5057]: 2017-09-28 12:38:59.990 5057 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:38:59 ctl02 nova-api[5057]: 2017-09-28 12:38:59.991 5057 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:38:59 ctl02 nova-api[5057]: 2017-09-28 12:38:59.991 5057 ERROR nova Traceback (most recent call last):
Sep 28 12:38:59 ctl02 nova-api[5057]: 2017-09-28 12:38:59.991 5057 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:38:59 ctl02 nova-api[5057]: 2017-09-28 12:38:59.991 5057 ERROR nova     sys.exit(main())
Sep 28 12:38:59 ctl02 nova-api[5057]: 2017-09-28 12:38:59.991 5057 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:38:59 ctl02 nova-api[5057]: 2017-09-28 12:38:59.991 5057 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:38:59 ctl02 nova-api[5057]: 2017-09-28 12:38:59.991 5057 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:38:59 ctl02 nova-api[5057]: 2017-09-28 12:38:59.991 5057 ERROR nova     max_url_len=max_url_len)
Sep 28 12:38:59 ctl02 nova-api[5057]: 2017-09-28 12:38:59.991 5057 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:38:59 ctl02 nova-api[5057]: 2017-09-28 12:38:59.991 5057 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:38:59 ctl02 nova-api[5057]: 2017-09-28 12:38:59.991 5057 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:38:59 ctl02 nova-api[5057]: 2017-09-28 12:38:59.991 5057 ERROR nova     sock.listen(backlog)
Sep 28 12:38:59 ctl02 nova-api[5057]: 2017-09-28 12:38:59.991 5057 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:38:59 ctl02 nova-api[5057]: 2017-09-28 12:38:59.991 5057 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:38:59 ctl02 nova-api[5057]: 2017-09-28 12:38:59.991 5057 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:38:59 ctl02 nova-api[5057]: 2017-09-28 12:38:59.991 5057 ERROR nova
Sep 28 12:39:00 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:39:00 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:39:00 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:39:00 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:39:00 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:39:00 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:39:00 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:39:00 ctl02 neutron-server[30536]: 2017-09-28 12:39:00.684 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:39:00] "OPTIONS / HTTP/1.0" 200 262 0.000497
Sep 28 12:39:00 ctl02 neutron-server[30536]: 2017-09-28 12:39:00.779 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:39:00] "OPTIONS / HTTP/1.0" 200 262 0.000449
Sep 28 12:39:01 ctl02 neutron-server[30536]: 2017-09-28 12:39:01.127 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:39:01] "OPTIONS / HTTP/1.0" 200 262 0.000449
Sep 28 12:39:01 ctl02 glance-api[29183]: 2017-09-28 12:39:01.673 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:39:01] "OPTIONS / HTTP/1.0" 200 134 0.000563
Sep 28 12:39:02 ctl02 nova-api[5075]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:39:02 ctl02 nova-api[5075]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:39:02 ctl02 glance-api[29183]: 2017-09-28 12:39:02.163 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:39:02] "OPTIONS / HTTP/1.0" 200 134 0.000818
Sep 28 12:39:02 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdad7a08)
Sep 28 12:39:02 ctl02 nova-api[5075]: 2017-09-28 12:39:02.243 5075 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:39:02 ctl02 nova-api[5075]: 2017-09-28 12:39:02.245 5075 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:39:02 ctl02 nova-api[5075]: 2017-09-28 12:39:02.245 5075 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:39:02 ctl02 nova-api[5075]: 2017-09-28 12:39:02.245 5075 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:39:02 ctl02 nova-api[5075]: 2017-09-28 12:39:02.245 5075 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:39:02 ctl02 nova-api[5075]: 2017-09-28 12:39:02.245 5075 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:39:02 ctl02 nova-api[5075]: 2017-09-28 12:39:02.245 5075 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:39:02 ctl02 nova-api[5075]: 2017-09-28 12:39:02.245 5075 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:39:02 ctl02 nova-api[5075]: 2017-09-28 12:39:02.245 5075 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:39:02 ctl02 nova-api[5075]: 2017-09-28 12:39:02.245 5075 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:39:02 ctl02 nova-api[5075]: 2017-09-28 12:39:02.245 5075 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:39:02 ctl02 nova-api[5075]: 2017-09-28 12:39:02.245 5075 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:39:02 ctl02 nova-api[5075]: 2017-09-28 12:39:02.245 5075 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:39:02 ctl02 nova-api[5075]: 2017-09-28 12:39:02.245 5075 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:39:02 ctl02 nova-api[5075]: 2017-09-28 12:39:02.245 5075 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:39:02 ctl02 nova-api[5075]: 2017-09-28 12:39:02.245 5075 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:39:02 ctl02 nova-api[5075]: 2017-09-28 12:39:02.245 5075 ERROR nova.wsgi     self.filename))
Sep 28 12:39:02 ctl02 nova-api[5075]: 2017-09-28 12:39:02.245 5075 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:39:02 ctl02 nova-api[5075]: 2017-09-28 12:39:02.245 5075 ERROR nova.wsgi
Sep 28 12:39:02 ctl02 nova-api[5075]: 2017-09-28 12:39:02.245 5075 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:39:02 ctl02 heat-api-cfn[13300]: 2017-09-28 12:39:02.304 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:39:02] "OPTIONS / HTTP/1.0" 200 134 0.000655
Sep 28 12:39:02 ctl02 nova-cert[4860]: 2017-09-28 12:39:02.359 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:39:02 ctl02 nova-api[5075]: 2017-09-28 12:39:02.373 5075 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:39:02 ctl02 nova-api[5075]: 2017-09-28 12:39:02.597 5075 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:39:02 ctl02 nova-api[5075]: 2017-09-28 12:39:02.599 5075 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:39:02 ctl02 nova-api[5075]: 2017-09-28 12:39:02.600 5075 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:39:02 ctl02 nova-api[5075]: 2017-09-28 12:39:02.600 5075 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:39:02 ctl02 nova-api[5075]: 2017-09-28 12:39:02.731 5075 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:39:02 ctl02 nova-api[5075]: 2017-09-28 12:39:02.733 5075 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:39:02 ctl02 nova-api[5075]: 2017-09-28 12:39:02.733 5075 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:39:02 ctl02 nova-api[5075]: 2017-09-28 12:39:02.733 5075 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:39:02 ctl02 nova-api[5075]: 2017-09-28 12:39:02.736 5075 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:39:02 ctl02 nova-api[5075]: 2017-09-28 12:39:02.737 5075 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:39:02 ctl02 nova-api[5075]: 2017-09-28 12:39:02.737 5075 ERROR nova Traceback (most recent call last):
Sep 28 12:39:02 ctl02 nova-api[5075]: 2017-09-28 12:39:02.737 5075 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:39:02 ctl02 nova-api[5075]: 2017-09-28 12:39:02.737 5075 ERROR nova     sys.exit(main())
Sep 28 12:39:02 ctl02 nova-api[5075]: 2017-09-28 12:39:02.737 5075 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:39:02 ctl02 nova-api[5075]: 2017-09-28 12:39:02.737 5075 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:39:02 ctl02 nova-api[5075]: 2017-09-28 12:39:02.737 5075 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:39:02 ctl02 nova-api[5075]: 2017-09-28 12:39:02.737 5075 ERROR nova     max_url_len=max_url_len)
Sep 28 12:39:02 ctl02 nova-api[5075]: 2017-09-28 12:39:02.737 5075 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:39:02 ctl02 nova-api[5075]: 2017-09-28 12:39:02.737 5075 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:39:02 ctl02 nova-api[5075]: 2017-09-28 12:39:02.737 5075 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:39:02 ctl02 nova-api[5075]: 2017-09-28 12:39:02.737 5075 ERROR nova     sock.listen(backlog)
Sep 28 12:39:02 ctl02 nova-api[5075]: 2017-09-28 12:39:02.737 5075 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:39:02 ctl02 nova-api[5075]: 2017-09-28 12:39:02.737 5075 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:39:02 ctl02 nova-api[5075]: 2017-09-28 12:39:02.737 5075 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:39:02 ctl02 nova-api[5075]: 2017-09-28 12:39:02.737 5075 ERROR nova
Sep 28 12:39:02 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:39:02 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:39:02 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:39:02 ctl02 nova-conductor[5056]: 2017-09-28 12:39:02.880 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:39:02 ctl02 nova-conductor[5056]: 2017-09-28 12:39:02.903 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:39:02 ctl02 nova-conductor[5056]: 2017-09-28 12:39:02.908 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:39:02 ctl02 nova-conductor[5056]: 2017-09-28 12:39:02.916 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:39:03 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:39:03 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:39:03 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:39:03 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:39:03 ctl02 glance-api[29183]: 2017-09-28 12:39:03.150 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:39:03] "OPTIONS / HTTP/1.0" 200 134 0.000688
Sep 28 12:39:03 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdad7a08)
Sep 28 12:39:03 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:39:03.639 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:39:03] "OPTIONS / HTTP/1.0" 200 134 0.000477
Sep 28 12:39:04 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdad7a08)
Sep 28 12:39:04 ctl02 nova-api[5094]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:39:04 ctl02 nova-api[5094]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:39:04 ctl02 nova-api[5094]: 2017-09-28 12:39:04.985 5094 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:39:04 ctl02 nova-api[5094]: 2017-09-28 12:39:04.986 5094 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:39:04 ctl02 nova-api[5094]: 2017-09-28 12:39:04.986 5094 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:39:04 ctl02 nova-api[5094]: 2017-09-28 12:39:04.986 5094 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:39:04 ctl02 nova-api[5094]: 2017-09-28 12:39:04.986 5094 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:39:04 ctl02 nova-api[5094]: 2017-09-28 12:39:04.986 5094 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:39:04 ctl02 nova-api[5094]: 2017-09-28 12:39:04.986 5094 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:39:04 ctl02 nova-api[5094]: 2017-09-28 12:39:04.986 5094 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:39:04 ctl02 nova-api[5094]: 2017-09-28 12:39:04.986 5094 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:39:04 ctl02 nova-api[5094]: 2017-09-28 12:39:04.986 5094 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:39:04 ctl02 nova-api[5094]: 2017-09-28 12:39:04.986 5094 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:39:04 ctl02 nova-api[5094]: 2017-09-28 12:39:04.986 5094 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:39:04 ctl02 nova-api[5094]: 2017-09-28 12:39:04.986 5094 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:39:04 ctl02 nova-api[5094]: 2017-09-28 12:39:04.986 5094 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:39:04 ctl02 nova-api[5094]: 2017-09-28 12:39:04.986 5094 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:39:04 ctl02 nova-api[5094]: 2017-09-28 12:39:04.986 5094 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:39:04 ctl02 nova-api[5094]: 2017-09-28 12:39:04.986 5094 ERROR nova.wsgi     self.filename))
Sep 28 12:39:04 ctl02 nova-api[5094]: 2017-09-28 12:39:04.986 5094 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:39:04 ctl02 nova-api[5094]: 2017-09-28 12:39:04.986 5094 ERROR nova.wsgi
Sep 28 12:39:04 ctl02 nova-api[5094]: 2017-09-28 12:39:04.987 5094 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:39:05 ctl02 nova-api[5094]: 2017-09-28 12:39:05.121 5094 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:39:05 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdad7a08)
Sep 28 12:39:05 ctl02 nova-api[5094]: 2017-09-28 12:39:05.346 5094 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:39:05 ctl02 nova-api[5094]: 2017-09-28 12:39:05.348 5094 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:39:05 ctl02 nova-api[5094]: 2017-09-28 12:39:05.348 5094 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:39:05 ctl02 nova-api[5094]: 2017-09-28 12:39:05.349 5094 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:39:05 ctl02 nova-api[5094]: 2017-09-28 12:39:05.481 5094 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:39:05 ctl02 nova-api[5094]: 2017-09-28 12:39:05.483 5094 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:39:05 ctl02 nova-api[5094]: 2017-09-28 12:39:05.483 5094 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:39:05 ctl02 nova-api[5094]: 2017-09-28 12:39:05.484 5094 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:39:05 ctl02 nova-api[5094]: 2017-09-28 12:39:05.487 5094 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:39:05 ctl02 nova-api[5094]: 2017-09-28 12:39:05.487 5094 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:39:05 ctl02 nova-api[5094]: 2017-09-28 12:39:05.487 5094 ERROR nova Traceback (most recent call last):
Sep 28 12:39:05 ctl02 nova-api[5094]: 2017-09-28 12:39:05.487 5094 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:39:05 ctl02 nova-api[5094]: 2017-09-28 12:39:05.487 5094 ERROR nova     sys.exit(main())
Sep 28 12:39:05 ctl02 nova-api[5094]: 2017-09-28 12:39:05.487 5094 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:39:05 ctl02 nova-api[5094]: 2017-09-28 12:39:05.487 5094 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:39:05 ctl02 nova-api[5094]: 2017-09-28 12:39:05.487 5094 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:39:05 ctl02 nova-api[5094]: 2017-09-28 12:39:05.487 5094 ERROR nova     max_url_len=max_url_len)
Sep 28 12:39:05 ctl02 nova-api[5094]: 2017-09-28 12:39:05.487 5094 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:39:05 ctl02 nova-api[5094]: 2017-09-28 12:39:05.487 5094 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:39:05 ctl02 nova-api[5094]: 2017-09-28 12:39:05.487 5094 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:39:05 ctl02 nova-api[5094]: 2017-09-28 12:39:05.487 5094 ERROR nova     sock.listen(backlog)
Sep 28 12:39:05 ctl02 nova-api[5094]: 2017-09-28 12:39:05.487 5094 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:39:05 ctl02 nova-api[5094]: 2017-09-28 12:39:05.487 5094 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:39:05 ctl02 nova-api[5094]: 2017-09-28 12:39:05.487 5094 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:39:05 ctl02 nova-api[5094]: 2017-09-28 12:39:05.487 5094 ERROR nova
Sep 28 12:39:05 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:39:05 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:39:05 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:39:05 ctl02 heat-api[13008]: 2017-09-28 12:39:05.841 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:39:05] "OPTIONS / HTTP/1.0" 200 134 0.000745
Sep 28 12:39:05 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:39:05 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:39:05 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:39:05 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:39:06 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:39:06.018 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:39:06] "OPTIONS / HTTP/1.0" 200 134 0.000384
Sep 28 12:39:06 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdad7a08)
Sep 28 12:39:07 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdad7a08)
Sep 28 12:39:07 ctl02 nova-api[5111]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:39:07 ctl02 nova-api[5111]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:39:07 ctl02 heat-api[13008]: 2017-09-28 12:39:07.750 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:39:07] "OPTIONS / HTTP/1.0" 200 134 0.000530
Sep 28 12:39:07 ctl02 nova-api[5111]: 2017-09-28 12:39:07.759 5111 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:39:07 ctl02 nova-api[5111]: 2017-09-28 12:39:07.760 5111 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:39:07 ctl02 nova-api[5111]: 2017-09-28 12:39:07.760 5111 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:39:07 ctl02 nova-api[5111]: 2017-09-28 12:39:07.760 5111 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:39:07 ctl02 nova-api[5111]: 2017-09-28 12:39:07.760 5111 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:39:07 ctl02 nova-api[5111]: 2017-09-28 12:39:07.760 5111 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:39:07 ctl02 nova-api[5111]: 2017-09-28 12:39:07.760 5111 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:39:07 ctl02 nova-api[5111]: 2017-09-28 12:39:07.760 5111 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:39:07 ctl02 nova-api[5111]: 2017-09-28 12:39:07.760 5111 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:39:07 ctl02 nova-api[5111]: 2017-09-28 12:39:07.760 5111 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:39:07 ctl02 nova-api[5111]: 2017-09-28 12:39:07.760 5111 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:39:07 ctl02 nova-api[5111]: 2017-09-28 12:39:07.760 5111 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:39:07 ctl02 nova-api[5111]: 2017-09-28 12:39:07.760 5111 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:39:07 ctl02 nova-api[5111]: 2017-09-28 12:39:07.760 5111 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:39:07 ctl02 nova-api[5111]: 2017-09-28 12:39:07.760 5111 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:39:07 ctl02 nova-api[5111]: 2017-09-28 12:39:07.760 5111 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:39:07 ctl02 nova-api[5111]: 2017-09-28 12:39:07.760 5111 ERROR nova.wsgi     self.filename))
Sep 28 12:39:07 ctl02 nova-api[5111]: 2017-09-28 12:39:07.760 5111 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:39:07 ctl02 nova-api[5111]: 2017-09-28 12:39:07.760 5111 ERROR nova.wsgi
Sep 28 12:39:07 ctl02 nova-api[5111]: 2017-09-28 12:39:07.761 5111 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:39:07 ctl02 nova-api[5111]: 2017-09-28 12:39:07.890 5111 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:39:08 ctl02 nova-api[5111]: 2017-09-28 12:39:08.115 5111 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:39:08 ctl02 nova-api[5111]: 2017-09-28 12:39:08.117 5111 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:39:08 ctl02 nova-api[5111]: 2017-09-28 12:39:08.117 5111 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:39:08 ctl02 nova-api[5111]: 2017-09-28 12:39:08.118 5111 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:39:08 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdad7a08)
Sep 28 12:39:08 ctl02 nova-api[5111]: 2017-09-28 12:39:08.250 5111 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:39:08 ctl02 nova-api[5111]: 2017-09-28 12:39:08.252 5111 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:39:08 ctl02 nova-api[5111]: 2017-09-28 12:39:08.253 5111 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:39:08 ctl02 nova-api[5111]: 2017-09-28 12:39:08.253 5111 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:39:08 ctl02 nova-api[5111]: 2017-09-28 12:39:08.256 5111 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:39:08 ctl02 nova-api[5111]: 2017-09-28 12:39:08.256 5111 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:39:08 ctl02 nova-api[5111]: 2017-09-28 12:39:08.256 5111 ERROR nova Traceback (most recent call last):
Sep 28 12:39:08 ctl02 nova-api[5111]: 2017-09-28 12:39:08.256 5111 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:39:08 ctl02 nova-api[5111]: 2017-09-28 12:39:08.256 5111 ERROR nova     sys.exit(main())
Sep 28 12:39:08 ctl02 nova-api[5111]: 2017-09-28 12:39:08.256 5111 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:39:08 ctl02 nova-api[5111]: 2017-09-28 12:39:08.256 5111 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:39:08 ctl02 nova-api[5111]: 2017-09-28 12:39:08.256 5111 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:39:08 ctl02 nova-api[5111]: 2017-09-28 12:39:08.256 5111 ERROR nova     max_url_len=max_url_len)
Sep 28 12:39:08 ctl02 nova-api[5111]: 2017-09-28 12:39:08.256 5111 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:39:08 ctl02 nova-api[5111]: 2017-09-28 12:39:08.256 5111 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:39:08 ctl02 nova-api[5111]: 2017-09-28 12:39:08.256 5111 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:39:08 ctl02 nova-api[5111]: 2017-09-28 12:39:08.256 5111 ERROR nova     sock.listen(backlog)
Sep 28 12:39:08 ctl02 nova-api[5111]: 2017-09-28 12:39:08.256 5111 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:39:08 ctl02 nova-api[5111]: 2017-09-28 12:39:08.256 5111 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:39:08 ctl02 nova-api[5111]: 2017-09-28 12:39:08.256 5111 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:39:08 ctl02 nova-api[5111]: 2017-09-28 12:39:08.256 5111 ERROR nova
Sep 28 12:39:08 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:39:08 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:39:08 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:39:08 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:39:08 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:39:08 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:39:08 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:39:08 ctl02 heat-api-cfn[13300]: 2017-09-28 12:39:08.679 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:39:08] "OPTIONS / HTTP/1.0" 200 134 0.000710
Sep 28 12:39:08 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:39:08.958 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:39:08] "OPTIONS / HTTP/1.0" 200 134 0.000495
Sep 28 12:39:09 ctl02 heat-api-cfn[13300]: 2017-09-28 12:39:09.006 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:39:09] "OPTIONS / HTTP/1.0" 200 134 0.000640
Sep 28 12:39:09 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdad7a08)
Sep 28 12:39:09 ctl02 heat-api[13008]: 2017-09-28 12:39:09.282 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:39:09] "OPTIONS / HTTP/1.0" 200 134 0.000675
Sep 28 12:39:10 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdad7a08)
Sep 28 12:39:10 ctl02 neutron-server[30536]: 2017-09-28 12:39:10.301 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:39:10] "OPTIONS / HTTP/1.0" 200 262 0.000444
Sep 28 12:39:10 ctl02 nova-api[5129]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:39:10 ctl02 nova-api[5129]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:39:10 ctl02 nova-api[5129]: 2017-09-28 12:39:10.507 5129 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:39:10 ctl02 nova-api[5129]: 2017-09-28 12:39:10.508 5129 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:39:10 ctl02 nova-api[5129]: 2017-09-28 12:39:10.508 5129 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:39:10 ctl02 nova-api[5129]: 2017-09-28 12:39:10.508 5129 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:39:10 ctl02 nova-api[5129]: 2017-09-28 12:39:10.508 5129 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:39:10 ctl02 nova-api[5129]: 2017-09-28 12:39:10.508 5129 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:39:10 ctl02 nova-api[5129]: 2017-09-28 12:39:10.508 5129 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:39:10 ctl02 nova-api[5129]: 2017-09-28 12:39:10.508 5129 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:39:10 ctl02 nova-api[5129]: 2017-09-28 12:39:10.508 5129 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:39:10 ctl02 nova-api[5129]: 2017-09-28 12:39:10.508 5129 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:39:10 ctl02 nova-api[5129]: 2017-09-28 12:39:10.508 5129 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:39:10 ctl02 nova-api[5129]: 2017-09-28 12:39:10.508 5129 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:39:10 ctl02 nova-api[5129]: 2017-09-28 12:39:10.508 5129 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:39:10 ctl02 nova-api[5129]: 2017-09-28 12:39:10.508 5129 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:39:10 ctl02 nova-api[5129]: 2017-09-28 12:39:10.508 5129 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:39:10 ctl02 nova-api[5129]: 2017-09-28 12:39:10.508 5129 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:39:10 ctl02 nova-api[5129]: 2017-09-28 12:39:10.508 5129 ERROR nova.wsgi     self.filename))
Sep 28 12:39:10 ctl02 nova-api[5129]: 2017-09-28 12:39:10.508 5129 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:39:10 ctl02 nova-api[5129]: 2017-09-28 12:39:10.508 5129 ERROR nova.wsgi
Sep 28 12:39:10 ctl02 nova-api[5129]: 2017-09-28 12:39:10.509 5129 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:39:10 ctl02 nova-api[5129]: 2017-09-28 12:39:10.646 5129 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:39:10 ctl02 nova-api[5129]: 2017-09-28 12:39:10.904 5129 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:39:10 ctl02 nova-api[5129]: 2017-09-28 12:39:10.907 5129 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:39:10 ctl02 nova-api[5129]: 2017-09-28 12:39:10.907 5129 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:39:10 ctl02 nova-api[5129]: 2017-09-28 12:39:10.907 5129 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:39:10 ctl02 neutron-server[30536]: 2017-09-28 12:39:10.954 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:39:10] "OPTIONS / HTTP/1.0" 200 262 0.000496
Sep 28 12:39:11 ctl02 nova-api[5129]: 2017-09-28 12:39:11.047 5129 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:39:11 ctl02 nova-api[5129]: 2017-09-28 12:39:11.049 5129 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:39:11 ctl02 nova-api[5129]: 2017-09-28 12:39:11.049 5129 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:39:11 ctl02 nova-api[5129]: 2017-09-28 12:39:11.050 5129 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:39:11 ctl02 nova-api[5129]: 2017-09-28 12:39:11.053 5129 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:39:11 ctl02 nova-api[5129]: 2017-09-28 12:39:11.053 5129 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:39:11 ctl02 nova-api[5129]: 2017-09-28 12:39:11.053 5129 ERROR nova Traceback (most recent call last):
Sep 28 12:39:11 ctl02 nova-api[5129]: 2017-09-28 12:39:11.053 5129 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:39:11 ctl02 nova-api[5129]: 2017-09-28 12:39:11.053 5129 ERROR nova     sys.exit(main())
Sep 28 12:39:11 ctl02 nova-api[5129]: 2017-09-28 12:39:11.053 5129 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:39:11 ctl02 nova-api[5129]: 2017-09-28 12:39:11.053 5129 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:39:11 ctl02 nova-api[5129]: 2017-09-28 12:39:11.053 5129 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:39:11 ctl02 nova-api[5129]: 2017-09-28 12:39:11.053 5129 ERROR nova     max_url_len=max_url_len)
Sep 28 12:39:11 ctl02 nova-api[5129]: 2017-09-28 12:39:11.053 5129 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:39:11 ctl02 nova-api[5129]: 2017-09-28 12:39:11.053 5129 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:39:11 ctl02 nova-api[5129]: 2017-09-28 12:39:11.053 5129 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:39:11 ctl02 nova-api[5129]: 2017-09-28 12:39:11.053 5129 ERROR nova     sock.listen(backlog)
Sep 28 12:39:11 ctl02 nova-api[5129]: 2017-09-28 12:39:11.053 5129 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:39:11 ctl02 nova-api[5129]: 2017-09-28 12:39:11.053 5129 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:39:11 ctl02 nova-api[5129]: 2017-09-28 12:39:11.053 5129 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:39:11 ctl02 nova-api[5129]: 2017-09-28 12:39:11.053 5129 ERROR nova
Sep 28 12:39:11 ctl02 neutron-server[30536]: 2017-09-28 12:39:11.180 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:39:11] "OPTIONS / HTTP/1.0" 200 262 0.000549
Sep 28 12:39:11 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:39:11 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:39:11 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:39:11 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdad7a08)
Sep 28 12:39:11 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:39:11 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:39:11 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:39:11 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:39:11 ctl02 glance-api[29183]: 2017-09-28 12:39:11.574 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:39:11] "OPTIONS / HTTP/1.0" 200 134 0.000673
Sep 28 12:39:11 ctl02 glance-api[29183]: 2017-09-28 12:39:11.937 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:39:11] "OPTIONS / HTTP/1.0" 200 134 0.000646
Sep 28 12:39:11 ctl02 heat-api-cfn[13300]: 2017-09-28 12:39:11.986 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:39:11] "OPTIONS / HTTP/1.0" 200 134 0.000542
Sep 28 12:39:12 ctl02 nova-consoleauth[5433]: 2017-09-28 12:39:12.219 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:39:12 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdad7a08)
Sep 28 12:39:13 ctl02 nova-api[5148]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:39:13 ctl02 nova-api[5148]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:39:13 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:39:13 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:39:13 ctl02 glance-api[29183]: 2017-09-28 12:39:13.236 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:39:13] "OPTIONS / HTTP/1.0" 200 134 0.000641
Sep 28 12:39:13 ctl02 nova-api[5148]: 2017-09-28 12:39:13.282 5148 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:39:13 ctl02 nova-api[5148]: 2017-09-28 12:39:13.283 5148 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:39:13 ctl02 nova-api[5148]: 2017-09-28 12:39:13.283 5148 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:39:13 ctl02 nova-api[5148]: 2017-09-28 12:39:13.283 5148 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:39:13 ctl02 nova-api[5148]: 2017-09-28 12:39:13.283 5148 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:39:13 ctl02 nova-api[5148]: 2017-09-28 12:39:13.283 5148 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:39:13 ctl02 nova-api[5148]: 2017-09-28 12:39:13.283 5148 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:39:13 ctl02 nova-api[5148]: 2017-09-28 12:39:13.283 5148 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:39:13 ctl02 nova-api[5148]: 2017-09-28 12:39:13.283 5148 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:39:13 ctl02 nova-api[5148]: 2017-09-28 12:39:13.283 5148 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:39:13 ctl02 nova-api[5148]: 2017-09-28 12:39:13.283 5148 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:39:13 ctl02 nova-api[5148]: 2017-09-28 12:39:13.283 5148 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:39:13 ctl02 nova-api[5148]: 2017-09-28 12:39:13.283 5148 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:39:13 ctl02 nova-api[5148]: 2017-09-28 12:39:13.283 5148 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:39:13 ctl02 nova-api[5148]: 2017-09-28 12:39:13.283 5148 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:39:13 ctl02 nova-api[5148]: 2017-09-28 12:39:13.283 5148 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:39:13 ctl02 nova-api[5148]: 2017-09-28 12:39:13.283 5148 ERROR nova.wsgi     self.filename))
Sep 28 12:39:13 ctl02 nova-api[5148]: 2017-09-28 12:39:13.283 5148 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:39:13 ctl02 nova-api[5148]: 2017-09-28 12:39:13.283 5148 ERROR nova.wsgi
Sep 28 12:39:13 ctl02 nova-api[5148]: 2017-09-28 12:39:13.284 5148 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:39:13 ctl02 nova-api[5148]: 2017-09-28 12:39:13.414 5148 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:39:13 ctl02 nova-api[5148]: 2017-09-28 12:39:13.647 5148 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:39:13 ctl02 nova-api[5148]: 2017-09-28 12:39:13.650 5148 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:39:13 ctl02 nova-api[5148]: 2017-09-28 12:39:13.650 5148 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:39:13 ctl02 nova-api[5148]: 2017-09-28 12:39:13.650 5148 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:39:13 ctl02 nova-api[5148]: 2017-09-28 12:39:13.782 5148 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:39:13 ctl02 nova-api[5148]: 2017-09-28 12:39:13.784 5148 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:39:13 ctl02 nova-api[5148]: 2017-09-28 12:39:13.784 5148 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:39:13 ctl02 nova-api[5148]: 2017-09-28 12:39:13.784 5148 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:39:13 ctl02 nova-api[5148]: 2017-09-28 12:39:13.788 5148 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:39:13 ctl02 nova-api[5148]: 2017-09-28 12:39:13.788 5148 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:39:13 ctl02 nova-api[5148]: 2017-09-28 12:39:13.788 5148 ERROR nova Traceback (most recent call last):
Sep 28 12:39:13 ctl02 nova-api[5148]: 2017-09-28 12:39:13.788 5148 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:39:13 ctl02 nova-api[5148]: 2017-09-28 12:39:13.788 5148 ERROR nova     sys.exit(main())
Sep 28 12:39:13 ctl02 nova-api[5148]: 2017-09-28 12:39:13.788 5148 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:39:13 ctl02 nova-api[5148]: 2017-09-28 12:39:13.788 5148 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:39:13 ctl02 nova-api[5148]: 2017-09-28 12:39:13.788 5148 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:39:13 ctl02 nova-api[5148]: 2017-09-28 12:39:13.788 5148 ERROR nova     max_url_len=max_url_len)
Sep 28 12:39:13 ctl02 nova-api[5148]: 2017-09-28 12:39:13.788 5148 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:39:13 ctl02 nova-api[5148]: 2017-09-28 12:39:13.788 5148 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:39:13 ctl02 nova-api[5148]: 2017-09-28 12:39:13.788 5148 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:39:13 ctl02 nova-api[5148]: 2017-09-28 12:39:13.788 5148 ERROR nova     sock.listen(backlog)
Sep 28 12:39:13 ctl02 nova-api[5148]: 2017-09-28 12:39:13.788 5148 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:39:13 ctl02 nova-api[5148]: 2017-09-28 12:39:13.788 5148 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:39:13 ctl02 nova-api[5148]: 2017-09-28 12:39:13.788 5148 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:39:13 ctl02 nova-api[5148]: 2017-09-28 12:39:13.788 5148 ERROR nova
Sep 28 12:39:13 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:39:13 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:39:13 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:39:14 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:39:14.010 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:39:14] "OPTIONS / HTTP/1.0" 200 134 0.000408
Sep 28 12:39:14 ctl02 heat-engine[12803]: 2017-09-28 12:39:14.018 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:39:14 ctl02 heat-engine[12803]: 2017-09-28 12:39:14.024 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:39:14 ctl02 heat-engine[12803]: 2017-09-28 12:39:14.024 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:39:14 ctl02 heat-engine[12803]: 2017-09-28 12:39:14.027 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:39:14 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:39:14 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:39:14 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:39:14 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:39:15 ctl02 nova-scheduler[5620]: 2017-09-28 12:39:15.305 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:39:15 ctl02 heat-api[13008]: 2017-09-28 12:39:15.534 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:39:15] "OPTIONS / HTTP/1.0" 200 134 0.000582
Sep 28 12:39:15 ctl02 nova-api[5171]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:39:15 ctl02 nova-api[5171]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:39:16 ctl02 nova-api[5171]: 2017-09-28 12:39:16.037 5171 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:39:16 ctl02 nova-api[5171]: 2017-09-28 12:39:16.038 5171 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:39:16 ctl02 nova-api[5171]: 2017-09-28 12:39:16.038 5171 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:39:16 ctl02 nova-api[5171]: 2017-09-28 12:39:16.038 5171 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:39:16 ctl02 nova-api[5171]: 2017-09-28 12:39:16.038 5171 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:39:16 ctl02 nova-api[5171]: 2017-09-28 12:39:16.038 5171 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:39:16 ctl02 nova-api[5171]: 2017-09-28 12:39:16.038 5171 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:39:16 ctl02 nova-api[5171]: 2017-09-28 12:39:16.038 5171 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:39:16 ctl02 nova-api[5171]: 2017-09-28 12:39:16.038 5171 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:39:16 ctl02 nova-api[5171]: 2017-09-28 12:39:16.038 5171 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:39:16 ctl02 nova-api[5171]: 2017-09-28 12:39:16.038 5171 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:39:16 ctl02 nova-api[5171]: 2017-09-28 12:39:16.038 5171 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:39:16 ctl02 nova-api[5171]: 2017-09-28 12:39:16.038 5171 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:39:16 ctl02 nova-api[5171]: 2017-09-28 12:39:16.038 5171 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:39:16 ctl02 nova-api[5171]: 2017-09-28 12:39:16.038 5171 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:39:16 ctl02 nova-api[5171]: 2017-09-28 12:39:16.038 5171 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:39:16 ctl02 nova-api[5171]: 2017-09-28 12:39:16.038 5171 ERROR nova.wsgi     self.filename))
Sep 28 12:39:16 ctl02 nova-api[5171]: 2017-09-28 12:39:16.038 5171 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:39:16 ctl02 nova-api[5171]: 2017-09-28 12:39:16.038 5171 ERROR nova.wsgi
Sep 28 12:39:16 ctl02 nova-api[5171]: 2017-09-28 12:39:16.039 5171 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:39:16 ctl02 nova-api[5171]: 2017-09-28 12:39:16.173 5171 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:39:16 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:39:16.369 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:39:16] "OPTIONS / HTTP/1.0" 200 134 0.000446
Sep 28 12:39:16 ctl02 nova-api[5171]: 2017-09-28 12:39:16.422 5171 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:39:16 ctl02 nova-api[5171]: 2017-09-28 12:39:16.424 5171 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:39:16 ctl02 nova-api[5171]: 2017-09-28 12:39:16.425 5171 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:39:16 ctl02 nova-api[5171]: 2017-09-28 12:39:16.425 5171 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:39:16 ctl02 nova-api[5171]: 2017-09-28 12:39:16.557 5171 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:39:16 ctl02 nova-api[5171]: 2017-09-28 12:39:16.559 5171 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:39:16 ctl02 nova-api[5171]: 2017-09-28 12:39:16.559 5171 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:39:16 ctl02 nova-api[5171]: 2017-09-28 12:39:16.560 5171 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:39:16 ctl02 nova-api[5171]: 2017-09-28 12:39:16.563 5171 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:39:16 ctl02 nova-api[5171]: 2017-09-28 12:39:16.563 5171 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:39:16 ctl02 nova-api[5171]: 2017-09-28 12:39:16.563 5171 ERROR nova Traceback (most recent call last):
Sep 28 12:39:16 ctl02 nova-api[5171]: 2017-09-28 12:39:16.563 5171 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:39:16 ctl02 nova-api[5171]: 2017-09-28 12:39:16.563 5171 ERROR nova     sys.exit(main())
Sep 28 12:39:16 ctl02 nova-api[5171]: 2017-09-28 12:39:16.563 5171 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:39:16 ctl02 nova-api[5171]: 2017-09-28 12:39:16.563 5171 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:39:16 ctl02 nova-api[5171]: 2017-09-28 12:39:16.563 5171 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:39:16 ctl02 nova-api[5171]: 2017-09-28 12:39:16.563 5171 ERROR nova     max_url_len=max_url_len)
Sep 28 12:39:16 ctl02 nova-api[5171]: 2017-09-28 12:39:16.563 5171 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:39:16 ctl02 nova-api[5171]: 2017-09-28 12:39:16.563 5171 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:39:16 ctl02 nova-api[5171]: 2017-09-28 12:39:16.563 5171 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:39:16 ctl02 nova-api[5171]: 2017-09-28 12:39:16.563 5171 ERROR nova     sock.listen(backlog)
Sep 28 12:39:16 ctl02 nova-api[5171]: 2017-09-28 12:39:16.563 5171 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:39:16 ctl02 nova-api[5171]: 2017-09-28 12:39:16.563 5171 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:39:16 ctl02 nova-api[5171]: 2017-09-28 12:39:16.563 5171 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:39:16 ctl02 nova-api[5171]: 2017-09-28 12:39:16.563 5171 ERROR nova
Sep 28 12:39:16 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:39:16 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:39:16 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:39:16 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:39:16 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:39:16 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:39:16 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:39:17 ctl02 heat-api[13008]: 2017-09-28 12:39:17.705 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:39:17] "OPTIONS / HTTP/1.0" 200 134 0.000680
Sep 28 12:39:18 ctl02 heat-api-cfn[13300]: 2017-09-28 12:39:18.515 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:39:18] "OPTIONS / HTTP/1.0" 200 134 0.000509
Sep 28 12:39:18 ctl02 nova-api[5189]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:39:18 ctl02 nova-api[5189]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:39:18 ctl02 heat-api-cfn[13300]: 2017-09-28 12:39:18.618 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:39:18] "OPTIONS / HTTP/1.0" 200 134 0.000513
Sep 28 12:39:18 ctl02 nova-api[5189]: 2017-09-28 12:39:18.794 5189 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:39:18 ctl02 nova-api[5189]: 2017-09-28 12:39:18.796 5189 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:39:18 ctl02 nova-api[5189]: 2017-09-28 12:39:18.796 5189 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:39:18 ctl02 nova-api[5189]: 2017-09-28 12:39:18.796 5189 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:39:18 ctl02 nova-api[5189]: 2017-09-28 12:39:18.796 5189 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:39:18 ctl02 nova-api[5189]: 2017-09-28 12:39:18.796 5189 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:39:18 ctl02 nova-api[5189]: 2017-09-28 12:39:18.796 5189 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:39:18 ctl02 nova-api[5189]: 2017-09-28 12:39:18.796 5189 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:39:18 ctl02 nova-api[5189]: 2017-09-28 12:39:18.796 5189 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:39:18 ctl02 nova-api[5189]: 2017-09-28 12:39:18.796 5189 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:39:18 ctl02 nova-api[5189]: 2017-09-28 12:39:18.796 5189 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:39:18 ctl02 nova-api[5189]: 2017-09-28 12:39:18.796 5189 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:39:18 ctl02 nova-api[5189]: 2017-09-28 12:39:18.796 5189 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:39:18 ctl02 nova-api[5189]: 2017-09-28 12:39:18.796 5189 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:39:18 ctl02 nova-api[5189]: 2017-09-28 12:39:18.796 5189 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:39:18 ctl02 nova-api[5189]: 2017-09-28 12:39:18.796 5189 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:39:18 ctl02 nova-api[5189]: 2017-09-28 12:39:18.796 5189 ERROR nova.wsgi     self.filename))
Sep 28 12:39:18 ctl02 nova-api[5189]: 2017-09-28 12:39:18.796 5189 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:39:18 ctl02 nova-api[5189]: 2017-09-28 12:39:18.796 5189 ERROR nova.wsgi
Sep 28 12:39:18 ctl02 nova-api[5189]: 2017-09-28 12:39:18.797 5189 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:39:18 ctl02 nova-api[5189]: 2017-09-28 12:39:18.930 5189 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:39:19 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:39:19.144 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:39:19] "OPTIONS / HTTP/1.0" 200 134 0.000473
Sep 28 12:39:19 ctl02 nova-api[5189]: 2017-09-28 12:39:19.190 5189 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:39:19 ctl02 nova-api[5189]: 2017-09-28 12:39:19.192 5189 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:39:19 ctl02 nova-api[5189]: 2017-09-28 12:39:19.192 5189 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:39:19 ctl02 nova-api[5189]: 2017-09-28 12:39:19.193 5189 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:39:19 ctl02 heat-api[13008]: 2017-09-28 12:39:19.325 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:39:19] "OPTIONS / HTTP/1.0" 200 134 0.000643
Sep 28 12:39:19 ctl02 nova-api[5189]: 2017-09-28 12:39:19.325 5189 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:39:19 ctl02 nova-api[5189]: 2017-09-28 12:39:19.327 5189 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:39:19 ctl02 nova-api[5189]: 2017-09-28 12:39:19.328 5189 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:39:19 ctl02 nova-api[5189]: 2017-09-28 12:39:19.328 5189 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:39:19 ctl02 nova-api[5189]: 2017-09-28 12:39:19.331 5189 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:39:19 ctl02 nova-api[5189]: 2017-09-28 12:39:19.332 5189 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:39:19 ctl02 nova-api[5189]: 2017-09-28 12:39:19.332 5189 ERROR nova Traceback (most recent call last):
Sep 28 12:39:19 ctl02 nova-api[5189]: 2017-09-28 12:39:19.332 5189 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:39:19 ctl02 nova-api[5189]: 2017-09-28 12:39:19.332 5189 ERROR nova     sys.exit(main())
Sep 28 12:39:19 ctl02 nova-api[5189]: 2017-09-28 12:39:19.332 5189 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:39:19 ctl02 nova-api[5189]: 2017-09-28 12:39:19.332 5189 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:39:19 ctl02 nova-api[5189]: 2017-09-28 12:39:19.332 5189 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:39:19 ctl02 nova-api[5189]: 2017-09-28 12:39:19.332 5189 ERROR nova     max_url_len=max_url_len)
Sep 28 12:39:19 ctl02 nova-api[5189]: 2017-09-28 12:39:19.332 5189 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:39:19 ctl02 nova-api[5189]: 2017-09-28 12:39:19.332 5189 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:39:19 ctl02 nova-api[5189]: 2017-09-28 12:39:19.332 5189 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:39:19 ctl02 nova-api[5189]: 2017-09-28 12:39:19.332 5189 ERROR nova     sock.listen(backlog)
Sep 28 12:39:19 ctl02 nova-api[5189]: 2017-09-28 12:39:19.332 5189 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:39:19 ctl02 nova-api[5189]: 2017-09-28 12:39:19.332 5189 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:39:19 ctl02 nova-api[5189]: 2017-09-28 12:39:19.332 5189 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:39:19 ctl02 nova-api[5189]: 2017-09-28 12:39:19.332 5189 ERROR nova
Sep 28 12:39:19 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:39:19 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:39:19 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:39:19 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:39:19 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:39:19 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:39:19 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:39:20 ctl02 neutron-server[30536]: 2017-09-28 12:39:20.574 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:39:20] "OPTIONS / HTTP/1.0" 200 262 0.000487
Sep 28 12:39:20 ctl02 neutron-server[30536]: 2017-09-28 12:39:20.655 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:39:20] "OPTIONS / HTTP/1.0" 200 262 0.000289
Sep 28 12:39:21 ctl02 neutron-server[30536]: 2017-09-28 12:39:21.260 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:39:21] "OPTIONS / HTTP/1.0" 200 262 0.000533
Sep 28 12:39:21 ctl02 nova-api[5207]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:39:21 ctl02 nova-api[5207]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:39:21 ctl02 glance-api[29183]: 2017-09-28 12:39:21.475 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:39:21] "OPTIONS / HTTP/1.0" 200 134 0.000604
Sep 28 12:39:21 ctl02 nova-api[5207]: 2017-09-28 12:39:21.518 5207 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:39:21 ctl02 nova-api[5207]: 2017-09-28 12:39:21.520 5207 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:39:21 ctl02 nova-api[5207]: 2017-09-28 12:39:21.520 5207 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:39:21 ctl02 nova-api[5207]: 2017-09-28 12:39:21.520 5207 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:39:21 ctl02 nova-api[5207]: 2017-09-28 12:39:21.520 5207 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:39:21 ctl02 nova-api[5207]: 2017-09-28 12:39:21.520 5207 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:39:21 ctl02 nova-api[5207]: 2017-09-28 12:39:21.520 5207 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:39:21 ctl02 nova-api[5207]: 2017-09-28 12:39:21.520 5207 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:39:21 ctl02 nova-api[5207]: 2017-09-28 12:39:21.520 5207 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:39:21 ctl02 nova-api[5207]: 2017-09-28 12:39:21.520 5207 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:39:21 ctl02 nova-api[5207]: 2017-09-28 12:39:21.520 5207 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:39:21 ctl02 nova-api[5207]: 2017-09-28 12:39:21.520 5207 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:39:21 ctl02 nova-api[5207]: 2017-09-28 12:39:21.520 5207 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:39:21 ctl02 nova-api[5207]: 2017-09-28 12:39:21.520 5207 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:39:21 ctl02 nova-api[5207]: 2017-09-28 12:39:21.520 5207 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:39:21 ctl02 nova-api[5207]: 2017-09-28 12:39:21.520 5207 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:39:21 ctl02 nova-api[5207]: 2017-09-28 12:39:21.520 5207 ERROR nova.wsgi     self.filename))
Sep 28 12:39:21 ctl02 nova-api[5207]: 2017-09-28 12:39:21.520 5207 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:39:21 ctl02 nova-api[5207]: 2017-09-28 12:39:21.520 5207 ERROR nova.wsgi
Sep 28 12:39:21 ctl02 nova-api[5207]: 2017-09-28 12:39:21.521 5207 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:39:21 ctl02 nova-api[5207]: 2017-09-28 12:39:21.653 5207 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:39:21 ctl02 nova-api[5207]: 2017-09-28 12:39:21.903 5207 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:39:21 ctl02 nova-api[5207]: 2017-09-28 12:39:21.905 5207 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:39:21 ctl02 nova-api[5207]: 2017-09-28 12:39:21.905 5207 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:39:21 ctl02 nova-api[5207]: 2017-09-28 12:39:21.906 5207 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:39:22 ctl02 nova-api[5207]: 2017-09-28 12:39:22.038 5207 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:39:22 ctl02 nova-api[5207]: 2017-09-28 12:39:22.040 5207 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:39:22 ctl02 nova-api[5207]: 2017-09-28 12:39:22.041 5207 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:39:22 ctl02 nova-api[5207]: 2017-09-28 12:39:22.041 5207 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:39:22 ctl02 nova-api[5207]: 2017-09-28 12:39:22.044 5207 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:39:22 ctl02 nova-api[5207]: 2017-09-28 12:39:22.045 5207 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:39:22 ctl02 nova-api[5207]: 2017-09-28 12:39:22.045 5207 ERROR nova Traceback (most recent call last):
Sep 28 12:39:22 ctl02 nova-api[5207]: 2017-09-28 12:39:22.045 5207 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:39:22 ctl02 nova-api[5207]: 2017-09-28 12:39:22.045 5207 ERROR nova     sys.exit(main())
Sep 28 12:39:22 ctl02 nova-api[5207]: 2017-09-28 12:39:22.045 5207 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:39:22 ctl02 nova-api[5207]: 2017-09-28 12:39:22.045 5207 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:39:22 ctl02 nova-api[5207]: 2017-09-28 12:39:22.045 5207 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:39:22 ctl02 nova-api[5207]: 2017-09-28 12:39:22.045 5207 ERROR nova     max_url_len=max_url_len)
Sep 28 12:39:22 ctl02 nova-api[5207]: 2017-09-28 12:39:22.045 5207 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:39:22 ctl02 nova-api[5207]: 2017-09-28 12:39:22.045 5207 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:39:22 ctl02 nova-api[5207]: 2017-09-28 12:39:22.045 5207 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:39:22 ctl02 nova-api[5207]: 2017-09-28 12:39:22.045 5207 ERROR nova     sock.listen(backlog)
Sep 28 12:39:22 ctl02 nova-api[5207]: 2017-09-28 12:39:22.045 5207 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:39:22 ctl02 nova-api[5207]: 2017-09-28 12:39:22.045 5207 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:39:22 ctl02 nova-api[5207]: 2017-09-28 12:39:22.045 5207 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:39:22 ctl02 nova-api[5207]: 2017-09-28 12:39:22.045 5207 ERROR nova
Sep 28 12:39:22 ctl02 glance-api[29183]: 2017-09-28 12:39:22.075 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:39:22] "OPTIONS / HTTP/1.0" 200 134 0.000739
Sep 28 12:39:22 ctl02 heat-api-cfn[13300]: 2017-09-28 12:39:22.080 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:39:22] "OPTIONS / HTTP/1.0" 200 134 0.000501
Sep 28 12:39:22 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:39:22 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:39:22 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:39:22 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:39:22 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:39:22 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:39:22 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:39:23 ctl02 glance-api[29183]: 2017-09-28 12:39:23.006 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:39:23] "OPTIONS / HTTP/1.0" 200 134 0.001053
Sep 28 12:39:23 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1add829)
Sep 28 12:39:23 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:39:23.731 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:39:23] "OPTIONS / HTTP/1.0" 200 134 0.000392
Sep 28 12:39:24 ctl02 nova-api[5228]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:39:24 ctl02 nova-api[5228]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:39:24 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1add829)
Sep 28 12:39:24 ctl02 nova-api[5228]: 2017-09-28 12:39:24.270 5228 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:39:24 ctl02 nova-api[5228]: 2017-09-28 12:39:24.271 5228 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:39:24 ctl02 nova-api[5228]: 2017-09-28 12:39:24.271 5228 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:39:24 ctl02 nova-api[5228]: 2017-09-28 12:39:24.271 5228 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:39:24 ctl02 nova-api[5228]: 2017-09-28 12:39:24.271 5228 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:39:24 ctl02 nova-api[5228]: 2017-09-28 12:39:24.271 5228 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:39:24 ctl02 nova-api[5228]: 2017-09-28 12:39:24.271 5228 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:39:24 ctl02 nova-api[5228]: 2017-09-28 12:39:24.271 5228 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:39:24 ctl02 nova-api[5228]: 2017-09-28 12:39:24.271 5228 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:39:24 ctl02 nova-api[5228]: 2017-09-28 12:39:24.271 5228 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:39:24 ctl02 nova-api[5228]: 2017-09-28 12:39:24.271 5228 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:39:24 ctl02 nova-api[5228]: 2017-09-28 12:39:24.271 5228 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:39:24 ctl02 nova-api[5228]: 2017-09-28 12:39:24.271 5228 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:39:24 ctl02 nova-api[5228]: 2017-09-28 12:39:24.271 5228 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:39:24 ctl02 nova-api[5228]: 2017-09-28 12:39:24.271 5228 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:39:24 ctl02 nova-api[5228]: 2017-09-28 12:39:24.271 5228 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:39:24 ctl02 nova-api[5228]: 2017-09-28 12:39:24.271 5228 ERROR nova.wsgi     self.filename))
Sep 28 12:39:24 ctl02 nova-api[5228]: 2017-09-28 12:39:24.271 5228 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:39:24 ctl02 nova-api[5228]: 2017-09-28 12:39:24.271 5228 ERROR nova.wsgi
Sep 28 12:39:24 ctl02 nova-api[5228]: 2017-09-28 12:39:24.272 5228 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:39:24 ctl02 nova-api[5228]: 2017-09-28 12:39:24.405 5228 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:39:24 ctl02 nova-api[5228]: 2017-09-28 12:39:24.656 5228 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:39:24 ctl02 nova-api[5228]: 2017-09-28 12:39:24.659 5228 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:39:24 ctl02 nova-api[5228]: 2017-09-28 12:39:24.659 5228 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:39:24 ctl02 nova-api[5228]: 2017-09-28 12:39:24.660 5228 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:39:24 ctl02 nova-api[5228]: 2017-09-28 12:39:24.795 5228 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:39:24 ctl02 nova-api[5228]: 2017-09-28 12:39:24.797 5228 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:39:24 ctl02 nova-api[5228]: 2017-09-28 12:39:24.798 5228 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:39:24 ctl02 nova-api[5228]: 2017-09-28 12:39:24.798 5228 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:39:24 ctl02 nova-api[5228]: 2017-09-28 12:39:24.801 5228 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:39:24 ctl02 nova-api[5228]: 2017-09-28 12:39:24.802 5228 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:39:24 ctl02 nova-api[5228]: 2017-09-28 12:39:24.802 5228 ERROR nova Traceback (most recent call last):
Sep 28 12:39:24 ctl02 nova-api[5228]: 2017-09-28 12:39:24.802 5228 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:39:24 ctl02 nova-api[5228]: 2017-09-28 12:39:24.802 5228 ERROR nova     sys.exit(main())
Sep 28 12:39:24 ctl02 nova-api[5228]: 2017-09-28 12:39:24.802 5228 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:39:24 ctl02 nova-api[5228]: 2017-09-28 12:39:24.802 5228 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:39:24 ctl02 nova-api[5228]: 2017-09-28 12:39:24.802 5228 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:39:24 ctl02 nova-api[5228]: 2017-09-28 12:39:24.802 5228 ERROR nova     max_url_len=max_url_len)
Sep 28 12:39:24 ctl02 nova-api[5228]: 2017-09-28 12:39:24.802 5228 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:39:24 ctl02 nova-api[5228]: 2017-09-28 12:39:24.802 5228 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:39:24 ctl02 nova-api[5228]: 2017-09-28 12:39:24.802 5228 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:39:24 ctl02 nova-api[5228]: 2017-09-28 12:39:24.802 5228 ERROR nova     sock.listen(backlog)
Sep 28 12:39:24 ctl02 nova-api[5228]: 2017-09-28 12:39:24.802 5228 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:39:24 ctl02 nova-api[5228]: 2017-09-28 12:39:24.802 5228 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:39:24 ctl02 nova-api[5228]: 2017-09-28 12:39:24.802 5228 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:39:24 ctl02 nova-api[5228]: 2017-09-28 12:39:24.802 5228 ERROR nova
Sep 28 12:39:24 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:39:24 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:39:24 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:39:25 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1add829)
Sep 28 12:39:25 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:39:25 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:39:25 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:39:25 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:39:25 ctl02 heat-api[13008]: 2017-09-28 12:39:25.900 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:39:25] "OPTIONS / HTTP/1.0" 200 134 0.000622
Sep 28 12:39:26 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1add829)
Sep 28 12:39:26 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:39:26.221 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:39:26] "OPTIONS / HTTP/1.0" 200 134 0.000441
Sep 28 12:39:26 ctl02 nova-api[5247]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:39:26 ctl02 nova-api[5247]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:39:27 ctl02 nova-api[5247]: 2017-09-28 12:39:27.017 5247 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:39:27 ctl02 nova-api[5247]: 2017-09-28 12:39:27.019 5247 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:39:27 ctl02 nova-api[5247]: 2017-09-28 12:39:27.019 5247 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:39:27 ctl02 nova-api[5247]: 2017-09-28 12:39:27.019 5247 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:39:27 ctl02 nova-api[5247]: 2017-09-28 12:39:27.019 5247 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:39:27 ctl02 nova-api[5247]: 2017-09-28 12:39:27.019 5247 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:39:27 ctl02 nova-api[5247]: 2017-09-28 12:39:27.019 5247 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:39:27 ctl02 nova-api[5247]: 2017-09-28 12:39:27.019 5247 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:39:27 ctl02 nova-api[5247]: 2017-09-28 12:39:27.019 5247 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:39:27 ctl02 nova-api[5247]: 2017-09-28 12:39:27.019 5247 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:39:27 ctl02 nova-api[5247]: 2017-09-28 12:39:27.019 5247 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:39:27 ctl02 nova-api[5247]: 2017-09-28 12:39:27.019 5247 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:39:27 ctl02 nova-api[5247]: 2017-09-28 12:39:27.019 5247 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:39:27 ctl02 nova-api[5247]: 2017-09-28 12:39:27.019 5247 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:39:27 ctl02 nova-api[5247]: 2017-09-28 12:39:27.019 5247 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:39:27 ctl02 nova-api[5247]: 2017-09-28 12:39:27.019 5247 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:39:27 ctl02 nova-api[5247]: 2017-09-28 12:39:27.019 5247 ERROR nova.wsgi     self.filename))
Sep 28 12:39:27 ctl02 nova-api[5247]: 2017-09-28 12:39:27.019 5247 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:39:27 ctl02 nova-api[5247]: 2017-09-28 12:39:27.019 5247 ERROR nova.wsgi
Sep 28 12:39:27 ctl02 nova-api[5247]: 2017-09-28 12:39:27.020 5247 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:39:27 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1add829)
Sep 28 12:39:27 ctl02 nova-api[5247]: 2017-09-28 12:39:27.153 5247 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:39:27 ctl02 nova-api[5247]: 2017-09-28 12:39:27.407 5247 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:39:27 ctl02 nova-api[5247]: 2017-09-28 12:39:27.409 5247 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:39:27 ctl02 nova-api[5247]: 2017-09-28 12:39:27.410 5247 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:39:27 ctl02 nova-api[5247]: 2017-09-28 12:39:27.410 5247 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:39:27 ctl02 nova-api[5247]: 2017-09-28 12:39:27.544 5247 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:39:27 ctl02 nova-api[5247]: 2017-09-28 12:39:27.546 5247 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:39:27 ctl02 nova-api[5247]: 2017-09-28 12:39:27.546 5247 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:39:27 ctl02 nova-api[5247]: 2017-09-28 12:39:27.546 5247 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:39:27 ctl02 nova-api[5247]: 2017-09-28 12:39:27.550 5247 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:39:27 ctl02 nova-api[5247]: 2017-09-28 12:39:27.550 5247 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:39:27 ctl02 nova-api[5247]: 2017-09-28 12:39:27.550 5247 ERROR nova Traceback (most recent call last):
Sep 28 12:39:27 ctl02 nova-api[5247]: 2017-09-28 12:39:27.550 5247 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:39:27 ctl02 nova-api[5247]: 2017-09-28 12:39:27.550 5247 ERROR nova     sys.exit(main())
Sep 28 12:39:27 ctl02 nova-api[5247]: 2017-09-28 12:39:27.550 5247 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:39:27 ctl02 nova-api[5247]: 2017-09-28 12:39:27.550 5247 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:39:27 ctl02 nova-api[5247]: 2017-09-28 12:39:27.550 5247 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:39:27 ctl02 nova-api[5247]: 2017-09-28 12:39:27.550 5247 ERROR nova     max_url_len=max_url_len)
Sep 28 12:39:27 ctl02 nova-api[5247]: 2017-09-28 12:39:27.550 5247 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:39:27 ctl02 nova-api[5247]: 2017-09-28 12:39:27.550 5247 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:39:27 ctl02 nova-api[5247]: 2017-09-28 12:39:27.550 5247 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:39:27 ctl02 nova-api[5247]: 2017-09-28 12:39:27.550 5247 ERROR nova     sock.listen(backlog)
Sep 28 12:39:27 ctl02 nova-api[5247]: 2017-09-28 12:39:27.550 5247 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:39:27 ctl02 nova-api[5247]: 2017-09-28 12:39:27.550 5247 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:39:27 ctl02 nova-api[5247]: 2017-09-28 12:39:27.550 5247 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:39:27 ctl02 nova-api[5247]: 2017-09-28 12:39:27.550 5247 ERROR nova
Sep 28 12:39:27 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:39:27 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:39:27 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:39:27 ctl02 heat-api[13008]: 2017-09-28 12:39:27.859 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:39:27] "OPTIONS / HTTP/1.0" 200 134 0.000688
Sep 28 12:39:27 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:39:27 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:39:27 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:39:27 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:39:28 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1add829)
Sep 28 12:39:28 ctl02 heat-api-cfn[13300]: 2017-09-28 12:39:28.534 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:39:28] "OPTIONS / HTTP/1.0" 200 134 0.000475
Sep 28 12:39:28 ctl02 heat-api-cfn[13300]: 2017-09-28 12:39:28.647 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:39:28] "OPTIONS / HTTP/1.0" 200 134 0.000367
Sep 28 12:39:29 ctl02 heat-api[13008]: 2017-09-28 12:39:29.076 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:39:29] "OPTIONS / HTTP/1.0" 200 134 0.000604
Sep 28 12:39:29 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1add829)
Sep 28 12:39:29 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:39:29.162 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:39:29] "OPTIONS / HTTP/1.0" 200 134 0.000379
Sep 28 12:39:29 ctl02 nova-api[5264]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:39:29 ctl02 nova-api[5264]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:39:29 ctl02 nova-api[5264]: 2017-09-28 12:39:29.778 5264 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:39:29 ctl02 nova-api[5264]: 2017-09-28 12:39:29.780 5264 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:39:29 ctl02 nova-api[5264]: 2017-09-28 12:39:29.780 5264 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:39:29 ctl02 nova-api[5264]: 2017-09-28 12:39:29.780 5264 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:39:29 ctl02 nova-api[5264]: 2017-09-28 12:39:29.780 5264 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:39:29 ctl02 nova-api[5264]: 2017-09-28 12:39:29.780 5264 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:39:29 ctl02 nova-api[5264]: 2017-09-28 12:39:29.780 5264 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:39:29 ctl02 nova-api[5264]: 2017-09-28 12:39:29.780 5264 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:39:29 ctl02 nova-api[5264]: 2017-09-28 12:39:29.780 5264 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:39:29 ctl02 nova-api[5264]: 2017-09-28 12:39:29.780 5264 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:39:29 ctl02 nova-api[5264]: 2017-09-28 12:39:29.780 5264 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:39:29 ctl02 nova-api[5264]: 2017-09-28 12:39:29.780 5264 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:39:29 ctl02 nova-api[5264]: 2017-09-28 12:39:29.780 5264 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:39:29 ctl02 nova-api[5264]: 2017-09-28 12:39:29.780 5264 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:39:29 ctl02 nova-api[5264]: 2017-09-28 12:39:29.780 5264 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:39:29 ctl02 nova-api[5264]: 2017-09-28 12:39:29.780 5264 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:39:29 ctl02 nova-api[5264]: 2017-09-28 12:39:29.780 5264 ERROR nova.wsgi     self.filename))
Sep 28 12:39:29 ctl02 nova-api[5264]: 2017-09-28 12:39:29.780 5264 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:39:29 ctl02 nova-api[5264]: 2017-09-28 12:39:29.780 5264 ERROR nova.wsgi
Sep 28 12:39:29 ctl02 nova-api[5264]: 2017-09-28 12:39:29.781 5264 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:39:29 ctl02 nova-api[5264]: 2017-09-28 12:39:29.912 5264 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:39:30 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1add829)
Sep 28 12:39:30 ctl02 nova-api[5264]: 2017-09-28 12:39:30.168 5264 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:39:30 ctl02 nova-api[5264]: 2017-09-28 12:39:30.171 5264 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:39:30 ctl02 nova-api[5264]: 2017-09-28 12:39:30.171 5264 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:39:30 ctl02 nova-api[5264]: 2017-09-28 12:39:30.171 5264 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:39:30 ctl02 nova-api[5264]: 2017-09-28 12:39:30.306 5264 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:39:30 ctl02 nova-api[5264]: 2017-09-28 12:39:30.308 5264 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:39:30 ctl02 nova-api[5264]: 2017-09-28 12:39:30.309 5264 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:39:30 ctl02 nova-api[5264]: 2017-09-28 12:39:30.309 5264 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:39:30 ctl02 nova-api[5264]: 2017-09-28 12:39:30.312 5264 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:39:30 ctl02 nova-api[5264]: 2017-09-28 12:39:30.313 5264 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:39:30 ctl02 nova-api[5264]: 2017-09-28 12:39:30.313 5264 ERROR nova Traceback (most recent call last):
Sep 28 12:39:30 ctl02 nova-api[5264]: 2017-09-28 12:39:30.313 5264 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:39:30 ctl02 nova-api[5264]: 2017-09-28 12:39:30.313 5264 ERROR nova     sys.exit(main())
Sep 28 12:39:30 ctl02 nova-api[5264]: 2017-09-28 12:39:30.313 5264 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:39:30 ctl02 nova-api[5264]: 2017-09-28 12:39:30.313 5264 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:39:30 ctl02 nova-api[5264]: 2017-09-28 12:39:30.313 5264 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:39:30 ctl02 nova-api[5264]: 2017-09-28 12:39:30.313 5264 ERROR nova     max_url_len=max_url_len)
Sep 28 12:39:30 ctl02 nova-api[5264]: 2017-09-28 12:39:30.313 5264 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:39:30 ctl02 nova-api[5264]: 2017-09-28 12:39:30.313 5264 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:39:30 ctl02 nova-api[5264]: 2017-09-28 12:39:30.313 5264 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:39:30 ctl02 nova-api[5264]: 2017-09-28 12:39:30.313 5264 ERROR nova     sock.listen(backlog)
Sep 28 12:39:30 ctl02 nova-api[5264]: 2017-09-28 12:39:30.313 5264 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:39:30 ctl02 nova-api[5264]: 2017-09-28 12:39:30.313 5264 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:39:30 ctl02 nova-api[5264]: 2017-09-28 12:39:30.313 5264 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:39:30 ctl02 nova-api[5264]: 2017-09-28 12:39:30.313 5264 ERROR nova
Sep 28 12:39:30 ctl02 neutron-server[30536]: 2017-09-28 12:39:30.405 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:39:30] "OPTIONS / HTTP/1.0" 200 262 0.000529
Sep 28 12:39:30 ctl02 neutron-server[30536]: 2017-09-28 12:39:30.420 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:39:30] "OPTIONS / HTTP/1.0" 200 262 0.000521
Sep 28 12:39:30 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:39:30 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:39:30 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:39:30 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:39:30 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:39:30 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:39:30 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:39:31 ctl02 neutron-server[30536]: 2017-09-28 12:39:31.112 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:39:31] "OPTIONS / HTTP/1.0" 200 262 0.000526
Sep 28 12:39:31 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1add829)
Sep 28 12:39:31 ctl02 glance-api[29183]: 2017-09-28 12:39:31.706 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:39:31] "OPTIONS / HTTP/1.0" 200 134 0.001015
Sep 28 12:39:31 ctl02 glance-api[29183]: 2017-09-28 12:39:31.748 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:39:31] "OPTIONS / HTTP/1.0" 200 134 0.000597
Sep 28 12:39:31 ctl02 heat-api-cfn[13300]: 2017-09-28 12:39:31.812 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:39:31] "OPTIONS / HTTP/1.0" 200 134 0.000449
Sep 28 12:39:32 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1add829)
Sep 28 12:39:32 ctl02 nova-api[5283]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:39:32 ctl02 nova-api[5283]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:39:32 ctl02 nova-api[5283]: 2017-09-28 12:39:32.537 5283 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:39:32 ctl02 nova-api[5283]: 2017-09-28 12:39:32.538 5283 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:39:32 ctl02 nova-api[5283]: 2017-09-28 12:39:32.538 5283 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:39:32 ctl02 nova-api[5283]: 2017-09-28 12:39:32.538 5283 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:39:32 ctl02 nova-api[5283]: 2017-09-28 12:39:32.538 5283 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:39:32 ctl02 nova-api[5283]: 2017-09-28 12:39:32.538 5283 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:39:32 ctl02 nova-api[5283]: 2017-09-28 12:39:32.538 5283 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:39:32 ctl02 nova-api[5283]: 2017-09-28 12:39:32.538 5283 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:39:32 ctl02 nova-api[5283]: 2017-09-28 12:39:32.538 5283 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:39:32 ctl02 nova-api[5283]: 2017-09-28 12:39:32.538 5283 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:39:32 ctl02 nova-api[5283]: 2017-09-28 12:39:32.538 5283 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:39:32 ctl02 nova-api[5283]: 2017-09-28 12:39:32.538 5283 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:39:32 ctl02 nova-api[5283]: 2017-09-28 12:39:32.538 5283 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:39:32 ctl02 nova-api[5283]: 2017-09-28 12:39:32.538 5283 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:39:32 ctl02 nova-api[5283]: 2017-09-28 12:39:32.538 5283 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:39:32 ctl02 nova-api[5283]: 2017-09-28 12:39:32.538 5283 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:39:32 ctl02 nova-api[5283]: 2017-09-28 12:39:32.538 5283 ERROR nova.wsgi     self.filename))
Sep 28 12:39:32 ctl02 nova-api[5283]: 2017-09-28 12:39:32.538 5283 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:39:32 ctl02 nova-api[5283]: 2017-09-28 12:39:32.538 5283 ERROR nova.wsgi
Sep 28 12:39:32 ctl02 nova-api[5283]: 2017-09-28 12:39:32.539 5283 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:39:32 ctl02 nova-api[5283]: 2017-09-28 12:39:32.677 5283 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:39:32 ctl02 nova-api[5283]: 2017-09-28 12:39:32.936 5283 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:39:32 ctl02 nova-api[5283]: 2017-09-28 12:39:32.939 5283 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:39:32 ctl02 nova-api[5283]: 2017-09-28 12:39:32.939 5283 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:39:32 ctl02 nova-api[5283]: 2017-09-28 12:39:32.939 5283 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:39:32 ctl02 glance-api[29183]: 2017-09-28 12:39:32.988 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:39:32] "OPTIONS / HTTP/1.0" 200 134 0.000986
Sep 28 12:39:33 ctl02 nova-api[5283]: 2017-09-28 12:39:33.077 5283 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:39:33 ctl02 nova-api[5283]: 2017-09-28 12:39:33.079 5283 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:39:33 ctl02 nova-api[5283]: 2017-09-28 12:39:33.079 5283 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:39:33 ctl02 nova-api[5283]: 2017-09-28 12:39:33.079 5283 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:39:33 ctl02 nova-api[5283]: 2017-09-28 12:39:33.083 5283 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:39:33 ctl02 nova-api[5283]: 2017-09-28 12:39:33.083 5283 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:39:33 ctl02 nova-api[5283]: 2017-09-28 12:39:33.083 5283 ERROR nova Traceback (most recent call last):
Sep 28 12:39:33 ctl02 nova-api[5283]: 2017-09-28 12:39:33.083 5283 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:39:33 ctl02 nova-api[5283]: 2017-09-28 12:39:33.083 5283 ERROR nova     sys.exit(main())
Sep 28 12:39:33 ctl02 nova-api[5283]: 2017-09-28 12:39:33.083 5283 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:39:33 ctl02 nova-api[5283]: 2017-09-28 12:39:33.083 5283 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:39:33 ctl02 nova-api[5283]: 2017-09-28 12:39:33.083 5283 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:39:33 ctl02 nova-api[5283]: 2017-09-28 12:39:33.083 5283 ERROR nova     max_url_len=max_url_len)
Sep 28 12:39:33 ctl02 nova-api[5283]: 2017-09-28 12:39:33.083 5283 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:39:33 ctl02 nova-api[5283]: 2017-09-28 12:39:33.083 5283 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:39:33 ctl02 nova-api[5283]: 2017-09-28 12:39:33.083 5283 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:39:33 ctl02 nova-api[5283]: 2017-09-28 12:39:33.083 5283 ERROR nova     sock.listen(backlog)
Sep 28 12:39:33 ctl02 nova-api[5283]: 2017-09-28 12:39:33.083 5283 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:39:33 ctl02 nova-api[5283]: 2017-09-28 12:39:33.083 5283 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:39:33 ctl02 nova-api[5283]: 2017-09-28 12:39:33.083 5283 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:39:33 ctl02 nova-api[5283]: 2017-09-28 12:39:33.083 5283 ERROR nova
Sep 28 12:39:33 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x1add829)
Sep 28 12:39:33 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:39:33 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:39:33 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:39:33 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:39:33 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:39:33 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:39:33 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:39:33 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:39:33.670 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:39:33] "OPTIONS / HTTP/1.0" 200 134 0.000634
Sep 28 12:39:34 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:39:34 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:39:34 ctl02 nova-cert[4860]: 2017-09-28 12:39:34.394 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:39:34 ctl02 nova-conductor[5056]: 2017-09-28 12:39:34.888 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:39:34 ctl02 nova-conductor[5056]: 2017-09-28 12:39:34.913 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:39:34 ctl02 nova-conductor[5056]: 2017-09-28 12:39:34.917 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:39:34 ctl02 nova-conductor[5056]: 2017-09-28 12:39:34.924 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:39:35 ctl02 nova-api[5300]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:39:35 ctl02 nova-api[5300]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:39:35 ctl02 nova-api[5300]: 2017-09-28 12:39:35.275 5300 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:39:35 ctl02 nova-api[5300]: 2017-09-28 12:39:35.276 5300 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:39:35 ctl02 nova-api[5300]: 2017-09-28 12:39:35.276 5300 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:39:35 ctl02 nova-api[5300]: 2017-09-28 12:39:35.276 5300 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:39:35 ctl02 nova-api[5300]: 2017-09-28 12:39:35.276 5300 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:39:35 ctl02 nova-api[5300]: 2017-09-28 12:39:35.276 5300 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:39:35 ctl02 nova-api[5300]: 2017-09-28 12:39:35.276 5300 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:39:35 ctl02 nova-api[5300]: 2017-09-28 12:39:35.276 5300 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:39:35 ctl02 nova-api[5300]: 2017-09-28 12:39:35.276 5300 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:39:35 ctl02 nova-api[5300]: 2017-09-28 12:39:35.276 5300 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:39:35 ctl02 nova-api[5300]: 2017-09-28 12:39:35.276 5300 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:39:35 ctl02 nova-api[5300]: 2017-09-28 12:39:35.276 5300 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:39:35 ctl02 nova-api[5300]: 2017-09-28 12:39:35.276 5300 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:39:35 ctl02 nova-api[5300]: 2017-09-28 12:39:35.276 5300 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:39:35 ctl02 nova-api[5300]: 2017-09-28 12:39:35.276 5300 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:39:35 ctl02 nova-api[5300]: 2017-09-28 12:39:35.276 5300 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:39:35 ctl02 nova-api[5300]: 2017-09-28 12:39:35.276 5300 ERROR nova.wsgi     self.filename))
Sep 28 12:39:35 ctl02 nova-api[5300]: 2017-09-28 12:39:35.276 5300 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:39:35 ctl02 nova-api[5300]: 2017-09-28 12:39:35.276 5300 ERROR nova.wsgi
Sep 28 12:39:35 ctl02 nova-api[5300]: 2017-09-28 12:39:35.277 5300 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:39:35 ctl02 nova-api[5300]: 2017-09-28 12:39:35.408 5300 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:39:35 ctl02 nova-api[5300]: 2017-09-28 12:39:35.655 5300 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:39:35 ctl02 nova-api[5300]: 2017-09-28 12:39:35.658 5300 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:39:35 ctl02 nova-api[5300]: 2017-09-28 12:39:35.658 5300 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:39:35 ctl02 nova-api[5300]: 2017-09-28 12:39:35.658 5300 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:39:35 ctl02 nova-api[5300]: 2017-09-28 12:39:35.791 5300 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:39:35 ctl02 nova-api[5300]: 2017-09-28 12:39:35.793 5300 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:39:35 ctl02 nova-api[5300]: 2017-09-28 12:39:35.793 5300 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:39:35 ctl02 nova-api[5300]: 2017-09-28 12:39:35.794 5300 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:39:35 ctl02 nova-api[5300]: 2017-09-28 12:39:35.797 5300 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:39:35 ctl02 nova-api[5300]: 2017-09-28 12:39:35.797 5300 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:39:35 ctl02 nova-api[5300]: 2017-09-28 12:39:35.797 5300 ERROR nova Traceback (most recent call last):
Sep 28 12:39:35 ctl02 nova-api[5300]: 2017-09-28 12:39:35.797 5300 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:39:35 ctl02 nova-api[5300]: 2017-09-28 12:39:35.797 5300 ERROR nova     sys.exit(main())
Sep 28 12:39:35 ctl02 nova-api[5300]: 2017-09-28 12:39:35.797 5300 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:39:35 ctl02 nova-api[5300]: 2017-09-28 12:39:35.797 5300 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:39:35 ctl02 nova-api[5300]: 2017-09-28 12:39:35.797 5300 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:39:35 ctl02 nova-api[5300]: 2017-09-28 12:39:35.797 5300 ERROR nova     max_url_len=max_url_len)
Sep 28 12:39:35 ctl02 nova-api[5300]: 2017-09-28 12:39:35.797 5300 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:39:35 ctl02 nova-api[5300]: 2017-09-28 12:39:35.797 5300 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:39:35 ctl02 nova-api[5300]: 2017-09-28 12:39:35.797 5300 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:39:35 ctl02 nova-api[5300]: 2017-09-28 12:39:35.797 5300 ERROR nova     sock.listen(backlog)
Sep 28 12:39:35 ctl02 nova-api[5300]: 2017-09-28 12:39:35.797 5300 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:39:35 ctl02 nova-api[5300]: 2017-09-28 12:39:35.797 5300 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:39:35 ctl02 nova-api[5300]: 2017-09-28 12:39:35.797 5300 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:39:35 ctl02 nova-api[5300]: 2017-09-28 12:39:35.797 5300 ERROR nova
Sep 28 12:39:35 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:39:35 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:39:35 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:39:35 ctl02 heat-api[13008]: 2017-09-28 12:39:35.974 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:39:35] "OPTIONS / HTTP/1.0" 200 134 0.000598
Sep 28 12:39:36 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:39:36 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:39:36 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:39:36 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:39:36 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:39:36.191 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:39:36] "OPTIONS / HTTP/1.0" 200 134 0.000466
Sep 28 12:39:36 ctl02 neutron-server[30536]: 2017-09-28 12:39:36.324 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 12:39:36 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:39:36 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:38:56 cmp002
Sep 28 12:39:36 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:38:58 cmp001
Sep 28 12:39:36 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:39:06 cmp002
Sep 28 12:39:37 ctl02 heat-api[13008]: 2017-09-28 12:39:37.802 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:39:37] "OPTIONS / HTTP/1.0" 200 134 0.000501
Sep 28 12:39:37 ctl02 nova-api[5325]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:39:37 ctl02 nova-api[5325]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:39:37 ctl02 nova-api[5325]: 2017-09-28 12:39:37.989 5325 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:39:37 ctl02 nova-api[5325]: 2017-09-28 12:39:37.990 5325 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:39:37 ctl02 nova-api[5325]: 2017-09-28 12:39:37.990 5325 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:39:37 ctl02 nova-api[5325]: 2017-09-28 12:39:37.990 5325 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:39:37 ctl02 nova-api[5325]: 2017-09-28 12:39:37.990 5325 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:39:37 ctl02 nova-api[5325]: 2017-09-28 12:39:37.990 5325 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:39:37 ctl02 nova-api[5325]: 2017-09-28 12:39:37.990 5325 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:39:37 ctl02 nova-api[5325]: 2017-09-28 12:39:37.990 5325 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:39:37 ctl02 nova-api[5325]: 2017-09-28 12:39:37.990 5325 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:39:37 ctl02 nova-api[5325]: 2017-09-28 12:39:37.990 5325 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:39:37 ctl02 nova-api[5325]: 2017-09-28 12:39:37.990 5325 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:39:37 ctl02 nova-api[5325]: 2017-09-28 12:39:37.990 5325 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:39:37 ctl02 nova-api[5325]: 2017-09-28 12:39:37.990 5325 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:39:37 ctl02 nova-api[5325]: 2017-09-28 12:39:37.990 5325 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:39:37 ctl02 nova-api[5325]: 2017-09-28 12:39:37.990 5325 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:39:37 ctl02 nova-api[5325]: 2017-09-28 12:39:37.990 5325 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:39:37 ctl02 nova-api[5325]: 2017-09-28 12:39:37.990 5325 ERROR nova.wsgi     self.filename))
Sep 28 12:39:37 ctl02 nova-api[5325]: 2017-09-28 12:39:37.990 5325 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:39:37 ctl02 nova-api[5325]: 2017-09-28 12:39:37.990 5325 ERROR nova.wsgi
Sep 28 12:39:37 ctl02 nova-api[5325]: 2017-09-28 12:39:37.991 5325 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:39:38 ctl02 nova-api[5325]: 2017-09-28 12:39:38.119 5325 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:39:38 ctl02 heat-api-cfn[13300]: 2017-09-28 12:39:38.223 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:39:38] "OPTIONS / HTTP/1.0" 200 134 0.000469
Sep 28 12:39:38 ctl02 nova-api[5325]: 2017-09-28 12:39:38.342 5325 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:39:38 ctl02 nova-api[5325]: 2017-09-28 12:39:38.344 5325 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:39:38 ctl02 nova-api[5325]: 2017-09-28 12:39:38.344 5325 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:39:38 ctl02 nova-api[5325]: 2017-09-28 12:39:38.345 5325 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:39:38 ctl02 nova-api[5325]: 2017-09-28 12:39:38.476 5325 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:39:38 ctl02 nova-api[5325]: 2017-09-28 12:39:38.478 5325 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:39:38 ctl02 nova-api[5325]: 2017-09-28 12:39:38.478 5325 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:39:38 ctl02 nova-api[5325]: 2017-09-28 12:39:38.479 5325 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:39:38 ctl02 nova-api[5325]: 2017-09-28 12:39:38.482 5325 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:39:38 ctl02 nova-api[5325]: 2017-09-28 12:39:38.482 5325 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:39:38 ctl02 nova-api[5325]: 2017-09-28 12:39:38.482 5325 ERROR nova Traceback (most recent call last):
Sep 28 12:39:38 ctl02 nova-api[5325]: 2017-09-28 12:39:38.482 5325 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:39:38 ctl02 nova-api[5325]: 2017-09-28 12:39:38.482 5325 ERROR nova     sys.exit(main())
Sep 28 12:39:38 ctl02 nova-api[5325]: 2017-09-28 12:39:38.482 5325 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:39:38 ctl02 nova-api[5325]: 2017-09-28 12:39:38.482 5325 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:39:38 ctl02 nova-api[5325]: 2017-09-28 12:39:38.482 5325 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:39:38 ctl02 nova-api[5325]: 2017-09-28 12:39:38.482 5325 ERROR nova     max_url_len=max_url_len)
Sep 28 12:39:38 ctl02 nova-api[5325]: 2017-09-28 12:39:38.482 5325 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:39:38 ctl02 nova-api[5325]: 2017-09-28 12:39:38.482 5325 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:39:38 ctl02 nova-api[5325]: 2017-09-28 12:39:38.482 5325 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:39:38 ctl02 nova-api[5325]: 2017-09-28 12:39:38.482 5325 ERROR nova     sock.listen(backlog)
Sep 28 12:39:38 ctl02 nova-api[5325]: 2017-09-28 12:39:38.482 5325 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:39:38 ctl02 nova-api[5325]: 2017-09-28 12:39:38.482 5325 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:39:38 ctl02 nova-api[5325]: 2017-09-28 12:39:38.482 5325 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:39:38 ctl02 nova-api[5325]: 2017-09-28 12:39:38.482 5325 ERROR nova
Sep 28 12:39:38 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:39:38 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:39:38 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:39:38 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:39:38.838 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:39:38] "OPTIONS / HTTP/1.0" 200 134 0.000514
Sep 28 12:39:38 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:39:38 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:39:38 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:39:38 ctl02 heat-api-cfn[13300]: 2017-09-28 12:39:38.899 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:39:38] "OPTIONS / HTTP/1.0" 200 134 0.000594
Sep 28 12:39:38 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:39:39 ctl02 heat-api[13008]: 2017-09-28 12:39:39.173 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:39:39] "OPTIONS / HTTP/1.0" 200 134 0.000585
Sep 28 12:39:40 ctl02 neutron-server[30536]: 2017-09-28 12:39:40.418 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:39:40] "OPTIONS / HTTP/1.0" 200 262 0.000454
Sep 28 12:39:40 ctl02 nova-api[5343]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:39:40 ctl02 nova-api[5343]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:39:40 ctl02 neutron-server[30536]: 2017-09-28 12:39:40.678 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:39:40] "OPTIONS / HTTP/1.0" 200 262 0.000481
Sep 28 12:39:40 ctl02 nova-api[5343]: 2017-09-28 12:39:40.754 5343 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:39:40 ctl02 nova-api[5343]: 2017-09-28 12:39:40.756 5343 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:39:40 ctl02 nova-api[5343]: 2017-09-28 12:39:40.756 5343 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:39:40 ctl02 nova-api[5343]: 2017-09-28 12:39:40.756 5343 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:39:40 ctl02 nova-api[5343]: 2017-09-28 12:39:40.756 5343 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:39:40 ctl02 nova-api[5343]: 2017-09-28 12:39:40.756 5343 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:39:40 ctl02 nova-api[5343]: 2017-09-28 12:39:40.756 5343 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:39:40 ctl02 nova-api[5343]: 2017-09-28 12:39:40.756 5343 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:39:40 ctl02 nova-api[5343]: 2017-09-28 12:39:40.756 5343 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:39:40 ctl02 nova-api[5343]: 2017-09-28 12:39:40.756 5343 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:39:40 ctl02 nova-api[5343]: 2017-09-28 12:39:40.756 5343 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:39:40 ctl02 nova-api[5343]: 2017-09-28 12:39:40.756 5343 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:39:40 ctl02 nova-api[5343]: 2017-09-28 12:39:40.756 5343 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:39:40 ctl02 nova-api[5343]: 2017-09-28 12:39:40.756 5343 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:39:40 ctl02 nova-api[5343]: 2017-09-28 12:39:40.756 5343 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:39:40 ctl02 nova-api[5343]: 2017-09-28 12:39:40.756 5343 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:39:40 ctl02 nova-api[5343]: 2017-09-28 12:39:40.756 5343 ERROR nova.wsgi     self.filename))
Sep 28 12:39:40 ctl02 nova-api[5343]: 2017-09-28 12:39:40.756 5343 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:39:40 ctl02 nova-api[5343]: 2017-09-28 12:39:40.756 5343 ERROR nova.wsgi
Sep 28 12:39:40 ctl02 nova-api[5343]: 2017-09-28 12:39:40.757 5343 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:39:40 ctl02 nova-api[5343]: 2017-09-28 12:39:40.887 5343 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:39:40 ctl02 neutron-server[30536]: 2017-09-28 12:39:40.937 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:39:40] "OPTIONS / HTTP/1.0" 200 262 0.000462
Sep 28 12:39:41 ctl02 nova-api[5343]: 2017-09-28 12:39:41.121 5343 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:39:41 ctl02 nova-api[5343]: 2017-09-28 12:39:41.124 5343 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:39:41 ctl02 nova-api[5343]: 2017-09-28 12:39:41.125 5343 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:39:41 ctl02 nova-api[5343]: 2017-09-28 12:39:41.125 5343 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:39:41 ctl02 nova-api[5343]: 2017-09-28 12:39:41.258 5343 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:39:41 ctl02 nova-api[5343]: 2017-09-28 12:39:41.260 5343 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:39:41 ctl02 nova-api[5343]: 2017-09-28 12:39:41.261 5343 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:39:41 ctl02 nova-api[5343]: 2017-09-28 12:39:41.261 5343 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:39:41 ctl02 nova-api[5343]: 2017-09-28 12:39:41.265 5343 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:39:41 ctl02 nova-api[5343]: 2017-09-28 12:39:41.265 5343 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:39:41 ctl02 nova-api[5343]: 2017-09-28 12:39:41.265 5343 ERROR nova Traceback (most recent call last):
Sep 28 12:39:41 ctl02 nova-api[5343]: 2017-09-28 12:39:41.265 5343 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:39:41 ctl02 nova-api[5343]: 2017-09-28 12:39:41.265 5343 ERROR nova     sys.exit(main())
Sep 28 12:39:41 ctl02 nova-api[5343]: 2017-09-28 12:39:41.265 5343 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:39:41 ctl02 nova-api[5343]: 2017-09-28 12:39:41.265 5343 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:39:41 ctl02 nova-api[5343]: 2017-09-28 12:39:41.265 5343 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:39:41 ctl02 nova-api[5343]: 2017-09-28 12:39:41.265 5343 ERROR nova     max_url_len=max_url_len)
Sep 28 12:39:41 ctl02 nova-api[5343]: 2017-09-28 12:39:41.265 5343 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:39:41 ctl02 nova-api[5343]: 2017-09-28 12:39:41.265 5343 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:39:41 ctl02 nova-api[5343]: 2017-09-28 12:39:41.265 5343 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:39:41 ctl02 nova-api[5343]: 2017-09-28 12:39:41.265 5343 ERROR nova     sock.listen(backlog)
Sep 28 12:39:41 ctl02 nova-api[5343]: 2017-09-28 12:39:41.265 5343 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:39:41 ctl02 nova-api[5343]: 2017-09-28 12:39:41.265 5343 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:39:41 ctl02 nova-api[5343]: 2017-09-28 12:39:41.265 5343 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:39:41 ctl02 nova-api[5343]: 2017-09-28 12:39:41.265 5343 ERROR nova
Sep 28 12:39:41 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:39:41 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:39:41 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:39:41 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:39:41 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:39:41 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:39:41 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:39:41 ctl02 glance-api[29183]: 2017-09-28 12:39:41.872 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:39:41] "OPTIONS / HTTP/1.0" 200 134 0.000643
Sep 28 12:39:41 ctl02 glance-api[29183]: 2017-09-28 12:39:41.985 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:39:41] "OPTIONS / HTTP/1.0" 200 134 0.000561
Sep 28 12:39:42 ctl02 heat-api-cfn[13300]: 2017-09-28 12:39:42.179 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:39:42] "OPTIONS / HTTP/1.0" 200 134 0.000448
Sep 28 12:39:42 ctl02 glance-api[29183]: 2017-09-28 12:39:42.790 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:39:42] "OPTIONS / HTTP/1.0" 200 134 0.000554
Sep 28 12:39:43 ctl02 nova-api[5360]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:39:43 ctl02 nova-api[5360]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:39:43 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:39:43.478 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:39:43] "OPTIONS / HTTP/1.0" 200 134 0.000481
Sep 28 12:39:43 ctl02 neutron-server[30536]: 2017-09-28 12:39:43.491 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:39:43 ctl02 nova-api[5360]: 2017-09-28 12:39:43.507 5360 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:39:43 ctl02 nova-api[5360]: 2017-09-28 12:39:43.509 5360 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:39:43 ctl02 nova-api[5360]: 2017-09-28 12:39:43.509 5360 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:39:43 ctl02 nova-api[5360]: 2017-09-28 12:39:43.509 5360 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:39:43 ctl02 nova-api[5360]: 2017-09-28 12:39:43.509 5360 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:39:43 ctl02 nova-api[5360]: 2017-09-28 12:39:43.509 5360 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:39:43 ctl02 nova-api[5360]: 2017-09-28 12:39:43.509 5360 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:39:43 ctl02 nova-api[5360]: 2017-09-28 12:39:43.509 5360 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:39:43 ctl02 nova-api[5360]: 2017-09-28 12:39:43.509 5360 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:39:43 ctl02 nova-api[5360]: 2017-09-28 12:39:43.509 5360 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:39:43 ctl02 nova-api[5360]: 2017-09-28 12:39:43.509 5360 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:39:43 ctl02 nova-api[5360]: 2017-09-28 12:39:43.509 5360 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:39:43 ctl02 nova-api[5360]: 2017-09-28 12:39:43.509 5360 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:39:43 ctl02 nova-api[5360]: 2017-09-28 12:39:43.509 5360 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:39:43 ctl02 nova-api[5360]: 2017-09-28 12:39:43.509 5360 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:39:43 ctl02 nova-api[5360]: 2017-09-28 12:39:43.509 5360 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:39:43 ctl02 nova-api[5360]: 2017-09-28 12:39:43.509 5360 ERROR nova.wsgi     self.filename))
Sep 28 12:39:43 ctl02 nova-api[5360]: 2017-09-28 12:39:43.509 5360 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:39:43 ctl02 nova-api[5360]: 2017-09-28 12:39:43.509 5360 ERROR nova.wsgi
Sep 28 12:39:43 ctl02 nova-api[5360]: 2017-09-28 12:39:43.511 5360 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:39:43 ctl02 nova-api[5360]: 2017-09-28 12:39:43.643 5360 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:39:43 ctl02 nova-api[5360]: 2017-09-28 12:39:43.865 5360 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:39:43 ctl02 nova-api[5360]: 2017-09-28 12:39:43.868 5360 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:39:43 ctl02 nova-api[5360]: 2017-09-28 12:39:43.869 5360 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:39:43 ctl02 nova-api[5360]: 2017-09-28 12:39:43.869 5360 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:39:44 ctl02 nova-api[5360]: 2017-09-28 12:39:44.001 5360 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:39:44 ctl02 nova-api[5360]: 2017-09-28 12:39:44.003 5360 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:39:44 ctl02 nova-api[5360]: 2017-09-28 12:39:44.004 5360 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:39:44 ctl02 nova-api[5360]: 2017-09-28 12:39:44.004 5360 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:39:44 ctl02 nova-api[5360]: 2017-09-28 12:39:44.007 5360 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:39:44 ctl02 nova-api[5360]: 2017-09-28 12:39:44.008 5360 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:39:44 ctl02 nova-api[5360]: 2017-09-28 12:39:44.008 5360 ERROR nova Traceback (most recent call last):
Sep 28 12:39:44 ctl02 nova-api[5360]: 2017-09-28 12:39:44.008 5360 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:39:44 ctl02 nova-api[5360]: 2017-09-28 12:39:44.008 5360 ERROR nova     sys.exit(main())
Sep 28 12:39:44 ctl02 nova-api[5360]: 2017-09-28 12:39:44.008 5360 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:39:44 ctl02 nova-api[5360]: 2017-09-28 12:39:44.008 5360 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:39:44 ctl02 nova-api[5360]: 2017-09-28 12:39:44.008 5360 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:39:44 ctl02 nova-api[5360]: 2017-09-28 12:39:44.008 5360 ERROR nova     max_url_len=max_url_len)
Sep 28 12:39:44 ctl02 nova-api[5360]: 2017-09-28 12:39:44.008 5360 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:39:44 ctl02 nova-api[5360]: 2017-09-28 12:39:44.008 5360 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:39:44 ctl02 nova-api[5360]: 2017-09-28 12:39:44.008 5360 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:39:44 ctl02 nova-api[5360]: 2017-09-28 12:39:44.008 5360 ERROR nova     sock.listen(backlog)
Sep 28 12:39:44 ctl02 nova-api[5360]: 2017-09-28 12:39:44.008 5360 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:39:44 ctl02 nova-api[5360]: 2017-09-28 12:39:44.008 5360 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:39:44 ctl02 nova-api[5360]: 2017-09-28 12:39:44.008 5360 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:39:44 ctl02 nova-api[5360]: 2017-09-28 12:39:44.008 5360 ERROR nova
Sep 28 12:39:44 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:39:44 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:39:44 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:39:44 ctl02 nova-consoleauth[5433]: 2017-09-28 12:39:44.253 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:39:44 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:39:44 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:39:44 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:39:44 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:39:45 ctl02 heat-api[13008]: 2017-09-28 12:39:45.659 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:39:45] "OPTIONS / HTTP/1.0" 200 134 0.000528
Sep 28 12:39:46 ctl02 heat-engine[12803]: 2017-09-28 12:39:46.027 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:39:46 ctl02 heat-engine[12803]: 2017-09-28 12:39:46.032 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:39:46 ctl02 heat-engine[12803]: 2017-09-28 12:39:46.032 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:39:46 ctl02 heat-engine[12803]: 2017-09-28 12:39:46.040 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:39:46 ctl02 nova-api[5379]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:39:46 ctl02 nova-api[5379]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:39:46 ctl02 nova-api[5379]: 2017-09-28 12:39:46.230 5379 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:39:46 ctl02 nova-api[5379]: 2017-09-28 12:39:46.232 5379 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:39:46 ctl02 nova-api[5379]: 2017-09-28 12:39:46.232 5379 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:39:46 ctl02 nova-api[5379]: 2017-09-28 12:39:46.232 5379 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:39:46 ctl02 nova-api[5379]: 2017-09-28 12:39:46.232 5379 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:39:46 ctl02 nova-api[5379]: 2017-09-28 12:39:46.232 5379 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:39:46 ctl02 nova-api[5379]: 2017-09-28 12:39:46.232 5379 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:39:46 ctl02 nova-api[5379]: 2017-09-28 12:39:46.232 5379 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:39:46 ctl02 nova-api[5379]: 2017-09-28 12:39:46.232 5379 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:39:46 ctl02 nova-api[5379]: 2017-09-28 12:39:46.232 5379 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:39:46 ctl02 nova-api[5379]: 2017-09-28 12:39:46.232 5379 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:39:46 ctl02 nova-api[5379]: 2017-09-28 12:39:46.232 5379 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:39:46 ctl02 nova-api[5379]: 2017-09-28 12:39:46.232 5379 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:39:46 ctl02 nova-api[5379]: 2017-09-28 12:39:46.232 5379 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:39:46 ctl02 nova-api[5379]: 2017-09-28 12:39:46.232 5379 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:39:46 ctl02 nova-api[5379]: 2017-09-28 12:39:46.232 5379 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:39:46 ctl02 nova-api[5379]: 2017-09-28 12:39:46.232 5379 ERROR nova.wsgi     self.filename))
Sep 28 12:39:46 ctl02 nova-api[5379]: 2017-09-28 12:39:46.232 5379 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:39:46 ctl02 nova-api[5379]: 2017-09-28 12:39:46.232 5379 ERROR nova.wsgi
Sep 28 12:39:46 ctl02 nova-api[5379]: 2017-09-28 12:39:46.233 5379 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:39:46 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:39:46.245 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:39:46] "OPTIONS / HTTP/1.0" 200 134 0.000366
Sep 28 12:39:46 ctl02 nova-api[5379]: 2017-09-28 12:39:46.362 5379 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:39:46 ctl02 nova-api[5379]: 2017-09-28 12:39:46.584 5379 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:39:46 ctl02 nova-api[5379]: 2017-09-28 12:39:46.586 5379 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:39:46 ctl02 nova-api[5379]: 2017-09-28 12:39:46.586 5379 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:39:46 ctl02 nova-api[5379]: 2017-09-28 12:39:46.586 5379 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:39:46 ctl02 nova-api[5379]: 2017-09-28 12:39:46.718 5379 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:39:46 ctl02 nova-api[5379]: 2017-09-28 12:39:46.719 5379 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:39:46 ctl02 nova-api[5379]: 2017-09-28 12:39:46.720 5379 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:39:46 ctl02 nova-api[5379]: 2017-09-28 12:39:46.720 5379 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:39:46 ctl02 nova-api[5379]: 2017-09-28 12:39:46.724 5379 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:39:46 ctl02 nova-api[5379]: 2017-09-28 12:39:46.724 5379 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:39:46 ctl02 nova-api[5379]: 2017-09-28 12:39:46.724 5379 ERROR nova Traceback (most recent call last):
Sep 28 12:39:46 ctl02 nova-api[5379]: 2017-09-28 12:39:46.724 5379 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:39:46 ctl02 nova-api[5379]: 2017-09-28 12:39:46.724 5379 ERROR nova     sys.exit(main())
Sep 28 12:39:46 ctl02 nova-api[5379]: 2017-09-28 12:39:46.724 5379 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:39:46 ctl02 nova-api[5379]: 2017-09-28 12:39:46.724 5379 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:39:46 ctl02 nova-api[5379]: 2017-09-28 12:39:46.724 5379 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:39:46 ctl02 nova-api[5379]: 2017-09-28 12:39:46.724 5379 ERROR nova     max_url_len=max_url_len)
Sep 28 12:39:46 ctl02 nova-api[5379]: 2017-09-28 12:39:46.724 5379 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:39:46 ctl02 nova-api[5379]: 2017-09-28 12:39:46.724 5379 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:39:46 ctl02 nova-api[5379]: 2017-09-28 12:39:46.724 5379 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:39:46 ctl02 nova-api[5379]: 2017-09-28 12:39:46.724 5379 ERROR nova     sock.listen(backlog)
Sep 28 12:39:46 ctl02 nova-api[5379]: 2017-09-28 12:39:46.724 5379 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:39:46 ctl02 nova-api[5379]: 2017-09-28 12:39:46.724 5379 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:39:46 ctl02 nova-api[5379]: 2017-09-28 12:39:46.724 5379 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:39:46 ctl02 nova-api[5379]: 2017-09-28 12:39:46.724 5379 ERROR nova
Sep 28 12:39:46 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:39:46 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:39:46 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:39:47 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:39:47 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:39:47 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:39:47 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:39:47 ctl02 nova-scheduler[5620]: 2017-09-28 12:39:47.344 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:39:47 ctl02 heat-api[13008]: 2017-09-28 12:39:47.542 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:39:47] "OPTIONS / HTTP/1.0" 200 134 0.000540
Sep 28 12:39:48 ctl02 heat-api-cfn[13300]: 2017-09-28 12:39:48.469 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:39:48] "OPTIONS / HTTP/1.0" 200 134 0.000449
Sep 28 12:39:48 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:39:48.569 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:39:48] "OPTIONS / HTTP/1.0" 200 134 0.000345
Sep 28 12:39:48 ctl02 nova-api[5398]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:39:48 ctl02 nova-api[5398]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:39:48 ctl02 heat-api[13008]: 2017-09-28 12:39:48.854 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:39:48] "OPTIONS / HTTP/1.0" 200 134 0.000548
Sep 28 12:39:49 ctl02 nova-api[5398]: 2017-09-28 12:39:49.007 5398 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:39:49 ctl02 nova-api[5398]: 2017-09-28 12:39:49.009 5398 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:39:49 ctl02 nova-api[5398]: 2017-09-28 12:39:49.009 5398 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:39:49 ctl02 nova-api[5398]: 2017-09-28 12:39:49.009 5398 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:39:49 ctl02 nova-api[5398]: 2017-09-28 12:39:49.009 5398 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:39:49 ctl02 nova-api[5398]: 2017-09-28 12:39:49.009 5398 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:39:49 ctl02 nova-api[5398]: 2017-09-28 12:39:49.009 5398 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:39:49 ctl02 nova-api[5398]: 2017-09-28 12:39:49.009 5398 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:39:49 ctl02 nova-api[5398]: 2017-09-28 12:39:49.009 5398 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:39:49 ctl02 nova-api[5398]: 2017-09-28 12:39:49.009 5398 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:39:49 ctl02 nova-api[5398]: 2017-09-28 12:39:49.009 5398 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:39:49 ctl02 nova-api[5398]: 2017-09-28 12:39:49.009 5398 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:39:49 ctl02 nova-api[5398]: 2017-09-28 12:39:49.009 5398 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:39:49 ctl02 nova-api[5398]: 2017-09-28 12:39:49.009 5398 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:39:49 ctl02 nova-api[5398]: 2017-09-28 12:39:49.009 5398 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:39:49 ctl02 nova-api[5398]: 2017-09-28 12:39:49.009 5398 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:39:49 ctl02 nova-api[5398]: 2017-09-28 12:39:49.009 5398 ERROR nova.wsgi     self.filename))
Sep 28 12:39:49 ctl02 nova-api[5398]: 2017-09-28 12:39:49.009 5398 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:39:49 ctl02 nova-api[5398]: 2017-09-28 12:39:49.009 5398 ERROR nova.wsgi
Sep 28 12:39:49 ctl02 nova-api[5398]: 2017-09-28 12:39:49.011 5398 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:39:49 ctl02 nova-api[5398]: 2017-09-28 12:39:49.140 5398 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:39:49 ctl02 heat-api-cfn[13300]: 2017-09-28 12:39:49.279 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:39:49] "OPTIONS / HTTP/1.0" 200 134 0.000543
Sep 28 12:39:49 ctl02 nova-api[5398]: 2017-09-28 12:39:49.362 5398 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:39:49 ctl02 nova-api[5398]: 2017-09-28 12:39:49.365 5398 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:39:49 ctl02 nova-api[5398]: 2017-09-28 12:39:49.365 5398 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:39:49 ctl02 nova-api[5398]: 2017-09-28 12:39:49.366 5398 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:39:49 ctl02 nova-api[5398]: 2017-09-28 12:39:49.495 5398 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:39:49 ctl02 nova-api[5398]: 2017-09-28 12:39:49.497 5398 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:39:49 ctl02 nova-api[5398]: 2017-09-28 12:39:49.498 5398 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:39:49 ctl02 nova-api[5398]: 2017-09-28 12:39:49.498 5398 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:39:49 ctl02 nova-api[5398]: 2017-09-28 12:39:49.501 5398 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:39:49 ctl02 nova-api[5398]: 2017-09-28 12:39:49.502 5398 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:39:49 ctl02 nova-api[5398]: 2017-09-28 12:39:49.502 5398 ERROR nova Traceback (most recent call last):
Sep 28 12:39:49 ctl02 nova-api[5398]: 2017-09-28 12:39:49.502 5398 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:39:49 ctl02 nova-api[5398]: 2017-09-28 12:39:49.502 5398 ERROR nova     sys.exit(main())
Sep 28 12:39:49 ctl02 nova-api[5398]: 2017-09-28 12:39:49.502 5398 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:39:49 ctl02 nova-api[5398]: 2017-09-28 12:39:49.502 5398 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:39:49 ctl02 nova-api[5398]: 2017-09-28 12:39:49.502 5398 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:39:49 ctl02 nova-api[5398]: 2017-09-28 12:39:49.502 5398 ERROR nova     max_url_len=max_url_len)
Sep 28 12:39:49 ctl02 nova-api[5398]: 2017-09-28 12:39:49.502 5398 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:39:49 ctl02 nova-api[5398]: 2017-09-28 12:39:49.502 5398 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:39:49 ctl02 nova-api[5398]: 2017-09-28 12:39:49.502 5398 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:39:49 ctl02 nova-api[5398]: 2017-09-28 12:39:49.502 5398 ERROR nova     sock.listen(backlog)
Sep 28 12:39:49 ctl02 nova-api[5398]: 2017-09-28 12:39:49.502 5398 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:39:49 ctl02 nova-api[5398]: 2017-09-28 12:39:49.502 5398 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:39:49 ctl02 nova-api[5398]: 2017-09-28 12:39:49.502 5398 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:39:49 ctl02 nova-api[5398]: 2017-09-28 12:39:49.502 5398 ERROR nova
Sep 28 12:39:49 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:39:49 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:39:49 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:39:49 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:39:49 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:39:49 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:39:49 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:39:50 ctl02 neutron-server[30536]: 2017-09-28 12:39:50.306 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:39:50] "OPTIONS / HTTP/1.0" 200 262 0.000466
Sep 28 12:39:50 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6f041706)
Sep 28 12:39:50 ctl02 neutron-server[30536]: 2017-09-28 12:39:50.610 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:39:50] "OPTIONS / HTTP/1.0" 200 262 0.000480
Sep 28 12:39:51 ctl02 neutron-server[30536]: 2017-09-28 12:39:51.036 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:39:51] "OPTIONS / HTTP/1.0" 200 262 0.000718
Sep 28 12:39:51 ctl02 neutron-server[30536]: 2017-09-28 12:39:51.321 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 4 dead agents out of 6:
Sep 28 12:39:51 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:39:51 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:38:56 cmp002
Sep 28 12:39:51 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:38:58 cmp001
Sep 28 12:39:51 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:39:10 cmp002
Sep 28 12:39:51 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:39:06 cmp002
Sep 28 12:39:51 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6f041706)
Sep 28 12:39:51 ctl02 nova-api[5416]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:39:51 ctl02 nova-api[5416]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:39:51 ctl02 nova-api[5416]: 2017-09-28 12:39:51.762 5416 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:39:51 ctl02 nova-api[5416]: 2017-09-28 12:39:51.764 5416 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:39:51 ctl02 nova-api[5416]: 2017-09-28 12:39:51.764 5416 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:39:51 ctl02 nova-api[5416]: 2017-09-28 12:39:51.764 5416 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:39:51 ctl02 nova-api[5416]: 2017-09-28 12:39:51.764 5416 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:39:51 ctl02 nova-api[5416]: 2017-09-28 12:39:51.764 5416 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:39:51 ctl02 nova-api[5416]: 2017-09-28 12:39:51.764 5416 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:39:51 ctl02 nova-api[5416]: 2017-09-28 12:39:51.764 5416 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:39:51 ctl02 nova-api[5416]: 2017-09-28 12:39:51.764 5416 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:39:51 ctl02 nova-api[5416]: 2017-09-28 12:39:51.764 5416 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:39:51 ctl02 nova-api[5416]: 2017-09-28 12:39:51.764 5416 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:39:51 ctl02 nova-api[5416]: 2017-09-28 12:39:51.764 5416 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:39:51 ctl02 nova-api[5416]: 2017-09-28 12:39:51.764 5416 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:39:51 ctl02 nova-api[5416]: 2017-09-28 12:39:51.764 5416 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:39:51 ctl02 nova-api[5416]: 2017-09-28 12:39:51.764 5416 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:39:51 ctl02 nova-api[5416]: 2017-09-28 12:39:51.764 5416 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:39:51 ctl02 nova-api[5416]: 2017-09-28 12:39:51.764 5416 ERROR nova.wsgi     self.filename))
Sep 28 12:39:51 ctl02 nova-api[5416]: 2017-09-28 12:39:51.764 5416 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:39:51 ctl02 nova-api[5416]: 2017-09-28 12:39:51.764 5416 ERROR nova.wsgi
Sep 28 12:39:51 ctl02 nova-api[5416]: 2017-09-28 12:39:51.766 5416 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:39:51 ctl02 glance-api[29183]: 2017-09-28 12:39:51.866 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:39:51] "OPTIONS / HTTP/1.0" 200 134 0.000647
Sep 28 12:39:51 ctl02 nova-api[5416]: 2017-09-28 12:39:51.915 5416 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:39:51 ctl02 heat-api-cfn[13300]: 2017-09-28 12:39:51.923 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:39:51] "OPTIONS / HTTP/1.0" 200 134 0.000417
Sep 28 12:39:52 ctl02 glance-api[29183]: 2017-09-28 12:39:52.053 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:39:52] "OPTIONS / HTTP/1.0" 200 134 0.000627
Sep 28 12:39:52 ctl02 nova-api[5416]: 2017-09-28 12:39:52.151 5416 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:39:52 ctl02 nova-api[5416]: 2017-09-28 12:39:52.154 5416 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:39:52 ctl02 nova-api[5416]: 2017-09-28 12:39:52.154 5416 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:39:52 ctl02 nova-api[5416]: 2017-09-28 12:39:52.154 5416 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:39:52 ctl02 nova-api[5416]: 2017-09-28 12:39:52.287 5416 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:39:52 ctl02 nova-api[5416]: 2017-09-28 12:39:52.289 5416 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:39:52 ctl02 nova-api[5416]: 2017-09-28 12:39:52.289 5416 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:39:52 ctl02 nova-api[5416]: 2017-09-28 12:39:52.289 5416 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:39:52 ctl02 nova-api[5416]: 2017-09-28 12:39:52.293 5416 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:39:52 ctl02 nova-api[5416]: 2017-09-28 12:39:52.293 5416 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:39:52 ctl02 nova-api[5416]: 2017-09-28 12:39:52.293 5416 ERROR nova Traceback (most recent call last):
Sep 28 12:39:52 ctl02 nova-api[5416]: 2017-09-28 12:39:52.293 5416 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:39:52 ctl02 nova-api[5416]: 2017-09-28 12:39:52.293 5416 ERROR nova     sys.exit(main())
Sep 28 12:39:52 ctl02 nova-api[5416]: 2017-09-28 12:39:52.293 5416 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:39:52 ctl02 nova-api[5416]: 2017-09-28 12:39:52.293 5416 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:39:52 ctl02 nova-api[5416]: 2017-09-28 12:39:52.293 5416 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:39:52 ctl02 nova-api[5416]: 2017-09-28 12:39:52.293 5416 ERROR nova     max_url_len=max_url_len)
Sep 28 12:39:52 ctl02 nova-api[5416]: 2017-09-28 12:39:52.293 5416 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:39:52 ctl02 nova-api[5416]: 2017-09-28 12:39:52.293 5416 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:39:52 ctl02 nova-api[5416]: 2017-09-28 12:39:52.293 5416 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:39:52 ctl02 nova-api[5416]: 2017-09-28 12:39:52.293 5416 ERROR nova     sock.listen(backlog)
Sep 28 12:39:52 ctl02 nova-api[5416]: 2017-09-28 12:39:52.293 5416 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:39:52 ctl02 nova-api[5416]: 2017-09-28 12:39:52.293 5416 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:39:52 ctl02 nova-api[5416]: 2017-09-28 12:39:52.293 5416 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:39:52 ctl02 nova-api[5416]: 2017-09-28 12:39:52.293 5416 ERROR nova
Sep 28 12:39:52 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6f041706)
Sep 28 12:39:52 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:39:52 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:39:52 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:39:52 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:39:52 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:39:52 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:39:52 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:39:52 ctl02 glance-api[29183]: 2017-09-28 12:39:52.777 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:39:52] "OPTIONS / HTTP/1.0" 200 134 0.000579
Sep 28 12:39:53 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:39:53.399 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:39:53] "OPTIONS / HTTP/1.0" 200 134 0.000363
Sep 28 12:39:53 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6f041706)
Sep 28 12:39:54 ctl02 nova-api[5435]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:39:54 ctl02 nova-api[5435]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:39:54 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6f041706)
Sep 28 12:39:54 ctl02 nova-api[5435]: 2017-09-28 12:39:54.479 5435 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:39:54 ctl02 nova-api[5435]: 2017-09-28 12:39:54.480 5435 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:39:54 ctl02 nova-api[5435]: 2017-09-28 12:39:54.480 5435 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:39:54 ctl02 nova-api[5435]: 2017-09-28 12:39:54.480 5435 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:39:54 ctl02 nova-api[5435]: 2017-09-28 12:39:54.480 5435 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:39:54 ctl02 nova-api[5435]: 2017-09-28 12:39:54.480 5435 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:39:54 ctl02 nova-api[5435]: 2017-09-28 12:39:54.480 5435 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:39:54 ctl02 nova-api[5435]: 2017-09-28 12:39:54.480 5435 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:39:54 ctl02 nova-api[5435]: 2017-09-28 12:39:54.480 5435 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:39:54 ctl02 nova-api[5435]: 2017-09-28 12:39:54.480 5435 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:39:54 ctl02 nova-api[5435]: 2017-09-28 12:39:54.480 5435 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:39:54 ctl02 nova-api[5435]: 2017-09-28 12:39:54.480 5435 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:39:54 ctl02 nova-api[5435]: 2017-09-28 12:39:54.480 5435 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:39:54 ctl02 nova-api[5435]: 2017-09-28 12:39:54.480 5435 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:39:54 ctl02 nova-api[5435]: 2017-09-28 12:39:54.480 5435 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:39:54 ctl02 nova-api[5435]: 2017-09-28 12:39:54.480 5435 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:39:54 ctl02 nova-api[5435]: 2017-09-28 12:39:54.480 5435 ERROR nova.wsgi     self.filename))
Sep 28 12:39:54 ctl02 nova-api[5435]: 2017-09-28 12:39:54.480 5435 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:39:54 ctl02 nova-api[5435]: 2017-09-28 12:39:54.480 5435 ERROR nova.wsgi
Sep 28 12:39:54 ctl02 nova-api[5435]: 2017-09-28 12:39:54.481 5435 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:39:54 ctl02 nova-api[5435]: 2017-09-28 12:39:54.611 5435 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:39:54 ctl02 nova-api[5435]: 2017-09-28 12:39:54.835 5435 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:39:54 ctl02 nova-api[5435]: 2017-09-28 12:39:54.837 5435 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:39:54 ctl02 nova-api[5435]: 2017-09-28 12:39:54.837 5435 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:39:54 ctl02 nova-api[5435]: 2017-09-28 12:39:54.837 5435 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:39:54 ctl02 nova-api[5435]: 2017-09-28 12:39:54.967 5435 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:39:54 ctl02 nova-api[5435]: 2017-09-28 12:39:54.969 5435 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:39:54 ctl02 nova-api[5435]: 2017-09-28 12:39:54.969 5435 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:39:54 ctl02 nova-api[5435]: 2017-09-28 12:39:54.970 5435 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:39:54 ctl02 nova-api[5435]: 2017-09-28 12:39:54.973 5435 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:39:54 ctl02 nova-api[5435]: 2017-09-28 12:39:54.973 5435 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:39:54 ctl02 nova-api[5435]: 2017-09-28 12:39:54.973 5435 ERROR nova Traceback (most recent call last):
Sep 28 12:39:54 ctl02 nova-api[5435]: 2017-09-28 12:39:54.973 5435 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:39:54 ctl02 nova-api[5435]: 2017-09-28 12:39:54.973 5435 ERROR nova     sys.exit(main())
Sep 28 12:39:54 ctl02 nova-api[5435]: 2017-09-28 12:39:54.973 5435 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:39:54 ctl02 nova-api[5435]: 2017-09-28 12:39:54.973 5435 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:39:54 ctl02 nova-api[5435]: 2017-09-28 12:39:54.973 5435 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:39:54 ctl02 nova-api[5435]: 2017-09-28 12:39:54.973 5435 ERROR nova     max_url_len=max_url_len)
Sep 28 12:39:54 ctl02 nova-api[5435]: 2017-09-28 12:39:54.973 5435 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:39:54 ctl02 nova-api[5435]: 2017-09-28 12:39:54.973 5435 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:39:54 ctl02 nova-api[5435]: 2017-09-28 12:39:54.973 5435 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:39:54 ctl02 nova-api[5435]: 2017-09-28 12:39:54.973 5435 ERROR nova     sock.listen(backlog)
Sep 28 12:39:54 ctl02 nova-api[5435]: 2017-09-28 12:39:54.973 5435 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:39:54 ctl02 nova-api[5435]: 2017-09-28 12:39:54.973 5435 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:39:54 ctl02 nova-api[5435]: 2017-09-28 12:39:54.973 5435 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:39:54 ctl02 nova-api[5435]: 2017-09-28 12:39:54.973 5435 ERROR nova
Sep 28 12:39:55 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:39:55 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:39:55 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:39:55 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:39:55 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:39:55 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:39:55 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:39:55 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6f041706)
Sep 28 12:39:55 ctl02 heat-api[13008]: 2017-09-28 12:39:55.922 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:39:55] "OPTIONS / HTTP/1.0" 200 134 0.000570
Sep 28 12:39:56 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:39:56.122 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:39:56] "OPTIONS / HTTP/1.0" 200 134 0.000381
Sep 28 12:39:56 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6f041706)
Sep 28 12:39:57 ctl02 nova-api[5453]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:39:57 ctl02 nova-api[5453]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:39:57 ctl02 nova-api[5453]: 2017-09-28 12:39:57.251 5453 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:39:57 ctl02 nova-api[5453]: 2017-09-28 12:39:57.253 5453 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:39:57 ctl02 nova-api[5453]: 2017-09-28 12:39:57.253 5453 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:39:57 ctl02 nova-api[5453]: 2017-09-28 12:39:57.253 5453 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:39:57 ctl02 nova-api[5453]: 2017-09-28 12:39:57.253 5453 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:39:57 ctl02 nova-api[5453]: 2017-09-28 12:39:57.253 5453 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:39:57 ctl02 nova-api[5453]: 2017-09-28 12:39:57.253 5453 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:39:57 ctl02 nova-api[5453]: 2017-09-28 12:39:57.253 5453 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:39:57 ctl02 nova-api[5453]: 2017-09-28 12:39:57.253 5453 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:39:57 ctl02 nova-api[5453]: 2017-09-28 12:39:57.253 5453 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:39:57 ctl02 nova-api[5453]: 2017-09-28 12:39:57.253 5453 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:39:57 ctl02 nova-api[5453]: 2017-09-28 12:39:57.253 5453 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:39:57 ctl02 nova-api[5453]: 2017-09-28 12:39:57.253 5453 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:39:57 ctl02 nova-api[5453]: 2017-09-28 12:39:57.253 5453 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:39:57 ctl02 nova-api[5453]: 2017-09-28 12:39:57.253 5453 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:39:57 ctl02 nova-api[5453]: 2017-09-28 12:39:57.253 5453 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:39:57 ctl02 nova-api[5453]: 2017-09-28 12:39:57.253 5453 ERROR nova.wsgi     self.filename))
Sep 28 12:39:57 ctl02 nova-api[5453]: 2017-09-28 12:39:57.253 5453 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:39:57 ctl02 nova-api[5453]: 2017-09-28 12:39:57.253 5453 ERROR nova.wsgi
Sep 28 12:39:57 ctl02 nova-api[5453]: 2017-09-28 12:39:57.254 5453 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:39:57 ctl02 nova-api[5453]: 2017-09-28 12:39:57.384 5453 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:39:57 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6f041706)
Sep 28 12:39:57 ctl02 nova-api[5453]: 2017-09-28 12:39:57.618 5453 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:39:57 ctl02 nova-api[5453]: 2017-09-28 12:39:57.620 5453 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:39:57 ctl02 nova-api[5453]: 2017-09-28 12:39:57.621 5453 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:39:57 ctl02 nova-api[5453]: 2017-09-28 12:39:57.621 5453 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:39:57 ctl02 nova-api[5453]: 2017-09-28 12:39:57.751 5453 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:39:57 ctl02 nova-api[5453]: 2017-09-28 12:39:57.753 5453 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:39:57 ctl02 nova-api[5453]: 2017-09-28 12:39:57.753 5453 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:39:57 ctl02 nova-api[5453]: 2017-09-28 12:39:57.753 5453 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:39:57 ctl02 nova-api[5453]: 2017-09-28 12:39:57.757 5453 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:39:57 ctl02 nova-api[5453]: 2017-09-28 12:39:57.757 5453 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:39:57 ctl02 nova-api[5453]: 2017-09-28 12:39:57.757 5453 ERROR nova Traceback (most recent call last):
Sep 28 12:39:57 ctl02 nova-api[5453]: 2017-09-28 12:39:57.757 5453 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:39:57 ctl02 nova-api[5453]: 2017-09-28 12:39:57.757 5453 ERROR nova     sys.exit(main())
Sep 28 12:39:57 ctl02 nova-api[5453]: 2017-09-28 12:39:57.757 5453 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:39:57 ctl02 nova-api[5453]: 2017-09-28 12:39:57.757 5453 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:39:57 ctl02 nova-api[5453]: 2017-09-28 12:39:57.757 5453 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:39:57 ctl02 nova-api[5453]: 2017-09-28 12:39:57.757 5453 ERROR nova     max_url_len=max_url_len)
Sep 28 12:39:57 ctl02 nova-api[5453]: 2017-09-28 12:39:57.757 5453 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:39:57 ctl02 nova-api[5453]: 2017-09-28 12:39:57.757 5453 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:39:57 ctl02 nova-api[5453]: 2017-09-28 12:39:57.757 5453 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:39:57 ctl02 nova-api[5453]: 2017-09-28 12:39:57.757 5453 ERROR nova     sock.listen(backlog)
Sep 28 12:39:57 ctl02 nova-api[5453]: 2017-09-28 12:39:57.757 5453 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:39:57 ctl02 nova-api[5453]: 2017-09-28 12:39:57.757 5453 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:39:57 ctl02 nova-api[5453]: 2017-09-28 12:39:57.757 5453 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:39:57 ctl02 nova-api[5453]: 2017-09-28 12:39:57.757 5453 ERROR nova
Sep 28 12:39:57 ctl02 heat-api[13008]: 2017-09-28 12:39:57.773 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:39:57] "OPTIONS / HTTP/1.0" 200 134 0.000555
Sep 28 12:39:57 ctl02 neutron-server[30536]: 2017-09-28 12:39:57.844 30602 WARNING oslo_messaging._drivers.amqpdriver [req-19e643e8-67de-4d91-b0a5-9da9e4e1a1f3 - - - - -] reply_01ed9623b6f1416cb0b0d6e759ffbaf3 doesn't exists, drop reply to 81408070d7034bcf95e4785d1541881d
Sep 28 12:39:57 ctl02 neutron-server[30536]: 2017-09-28 12:39:57.845 30602 INFO oslo_messaging._drivers.amqpdriver [req-19e643e8-67de-4d91-b0a5-9da9e4e1a1f3 - - - - -] The reply 81408070d7034bcf95e4785d1541881d cannot be sent  reply_01ed9623b6f1416cb0b0d6e759ffbaf3 reply queue don't exist after 60 sec abandoning...
Sep 28 12:39:57 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:39:57 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:39:57 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:39:58 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:39:58 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:39:58 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:39:58 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:39:58 ctl02 heat-api-cfn[13300]: 2017-09-28 12:39:58.189 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:39:58] "OPTIONS / HTTP/1.0" 200 134 0.000565
Sep 28 12:39:58 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:39:58.211 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:39:58] "OPTIONS / HTTP/1.0" 200 134 0.000498
Sep 28 12:39:58 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6f041706)
Sep 28 12:39:58 ctl02 neutron-server[30536]: 2017-09-28 12:39:58.498 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:39:58 ctl02 heat-api[13008]: 2017-09-28 12:39:58.564 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:39:58] "OPTIONS / HTTP/1.0" 200 134 0.000724
Sep 28 12:39:59 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6f041706)
Sep 28 12:39:59 ctl02 heat-api-cfn[13300]: 2017-09-28 12:39:59.484 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:39:59] "OPTIONS / HTTP/1.0" 200 134 0.000509
Sep 28 12:39:59 ctl02 nova-api[5470]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:39:59 ctl02 nova-api[5470]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:40:00 ctl02 neutron-server[30536]: 2017-09-28 12:40:00.027 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:40:00] "OPTIONS / HTTP/1.0" 200 262 0.000530
Sep 28 12:40:00 ctl02 nova-api[5470]: 2017-09-28 12:40:00.049 5470 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:40:00 ctl02 nova-api[5470]: 2017-09-28 12:40:00.051 5470 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:40:00 ctl02 nova-api[5470]: 2017-09-28 12:40:00.051 5470 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:40:00 ctl02 nova-api[5470]: 2017-09-28 12:40:00.051 5470 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:40:00 ctl02 nova-api[5470]: 2017-09-28 12:40:00.051 5470 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:40:00 ctl02 nova-api[5470]: 2017-09-28 12:40:00.051 5470 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:40:00 ctl02 nova-api[5470]: 2017-09-28 12:40:00.051 5470 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:40:00 ctl02 nova-api[5470]: 2017-09-28 12:40:00.051 5470 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:40:00 ctl02 nova-api[5470]: 2017-09-28 12:40:00.051 5470 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:40:00 ctl02 nova-api[5470]: 2017-09-28 12:40:00.051 5470 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:40:00 ctl02 nova-api[5470]: 2017-09-28 12:40:00.051 5470 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:40:00 ctl02 nova-api[5470]: 2017-09-28 12:40:00.051 5470 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:40:00 ctl02 nova-api[5470]: 2017-09-28 12:40:00.051 5470 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:40:00 ctl02 nova-api[5470]: 2017-09-28 12:40:00.051 5470 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:40:00 ctl02 nova-api[5470]: 2017-09-28 12:40:00.051 5470 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:40:00 ctl02 nova-api[5470]: 2017-09-28 12:40:00.051 5470 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:40:00 ctl02 nova-api[5470]: 2017-09-28 12:40:00.051 5470 ERROR nova.wsgi     self.filename))
Sep 28 12:40:00 ctl02 nova-api[5470]: 2017-09-28 12:40:00.051 5470 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:40:00 ctl02 nova-api[5470]: 2017-09-28 12:40:00.051 5470 ERROR nova.wsgi
Sep 28 12:40:00 ctl02 nova-api[5470]: 2017-09-28 12:40:00.053 5470 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:40:00 ctl02 nova-api[5470]: 2017-09-28 12:40:00.185 5470 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:40:00 ctl02 neutron-server[30536]: 2017-09-28 12:40:00.330 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:40:00] "OPTIONS / HTTP/1.0" 200 262 0.000508
Sep 28 12:40:00 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6f041706)
Sep 28 12:40:00 ctl02 nova-api[5470]: 2017-09-28 12:40:00.433 5470 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:40:00 ctl02 nova-api[5470]: 2017-09-28 12:40:00.436 5470 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:40:00 ctl02 nova-api[5470]: 2017-09-28 12:40:00.436 5470 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:40:00 ctl02 nova-api[5470]: 2017-09-28 12:40:00.436 5470 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:40:00 ctl02 nova-api[5470]: 2017-09-28 12:40:00.567 5470 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:40:00 ctl02 nova-api[5470]: 2017-09-28 12:40:00.569 5470 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:40:00 ctl02 nova-api[5470]: 2017-09-28 12:40:00.569 5470 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:40:00 ctl02 nova-api[5470]: 2017-09-28 12:40:00.570 5470 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:40:00 ctl02 nova-api[5470]: 2017-09-28 12:40:00.573 5470 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:40:00 ctl02 nova-api[5470]: 2017-09-28 12:40:00.573 5470 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:40:00 ctl02 nova-api[5470]: 2017-09-28 12:40:00.573 5470 ERROR nova Traceback (most recent call last):
Sep 28 12:40:00 ctl02 nova-api[5470]: 2017-09-28 12:40:00.573 5470 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:40:00 ctl02 nova-api[5470]: 2017-09-28 12:40:00.573 5470 ERROR nova     sys.exit(main())
Sep 28 12:40:00 ctl02 nova-api[5470]: 2017-09-28 12:40:00.573 5470 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:40:00 ctl02 nova-api[5470]: 2017-09-28 12:40:00.573 5470 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:40:00 ctl02 nova-api[5470]: 2017-09-28 12:40:00.573 5470 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:40:00 ctl02 nova-api[5470]: 2017-09-28 12:40:00.573 5470 ERROR nova     max_url_len=max_url_len)
Sep 28 12:40:00 ctl02 nova-api[5470]: 2017-09-28 12:40:00.573 5470 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:40:00 ctl02 nova-api[5470]: 2017-09-28 12:40:00.573 5470 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:40:00 ctl02 nova-api[5470]: 2017-09-28 12:40:00.573 5470 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:40:00 ctl02 nova-api[5470]: 2017-09-28 12:40:00.573 5470 ERROR nova     sock.listen(backlog)
Sep 28 12:40:00 ctl02 nova-api[5470]: 2017-09-28 12:40:00.573 5470 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:40:00 ctl02 nova-api[5470]: 2017-09-28 12:40:00.573 5470 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:40:00 ctl02 nova-api[5470]: 2017-09-28 12:40:00.573 5470 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:40:00 ctl02 nova-api[5470]: 2017-09-28 12:40:00.573 5470 ERROR nova
Sep 28 12:40:00 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:40:00 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:40:00 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:40:00 ctl02 neutron-server[30536]: 2017-09-28 12:40:00.829 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:40:00] "OPTIONS / HTTP/1.0" 200 262 0.000572
Sep 28 12:40:00 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:40:00 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:40:00 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:40:00 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:40:01 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:40:01 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:40:01 ctl02 glance-api[29183]: 2017-09-28 12:40:01.798 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:40:01] "OPTIONS / HTTP/1.0" 200 134 0.000624
Sep 28 12:40:01 ctl02 glance-api[29183]: 2017-09-28 12:40:01.969 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:40:01] "OPTIONS / HTTP/1.0" 200 134 0.000587
Sep 28 12:40:02 ctl02 heat-api-cfn[13300]: 2017-09-28 12:40:02.274 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:40:02] "OPTIONS / HTTP/1.0" 200 134 0.000543
Sep 28 12:40:02 ctl02 nova-api[5489]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:40:02 ctl02 nova-api[5489]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:40:02 ctl02 nova-api[5489]: 2017-09-28 12:40:02.747 5489 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:40:02 ctl02 nova-api[5489]: 2017-09-28 12:40:02.748 5489 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:40:02 ctl02 nova-api[5489]: 2017-09-28 12:40:02.748 5489 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:40:02 ctl02 nova-api[5489]: 2017-09-28 12:40:02.748 5489 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:40:02 ctl02 nova-api[5489]: 2017-09-28 12:40:02.748 5489 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:40:02 ctl02 nova-api[5489]: 2017-09-28 12:40:02.748 5489 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:40:02 ctl02 nova-api[5489]: 2017-09-28 12:40:02.748 5489 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:40:02 ctl02 nova-api[5489]: 2017-09-28 12:40:02.748 5489 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:40:02 ctl02 nova-api[5489]: 2017-09-28 12:40:02.748 5489 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:40:02 ctl02 nova-api[5489]: 2017-09-28 12:40:02.748 5489 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:40:02 ctl02 nova-api[5489]: 2017-09-28 12:40:02.748 5489 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:40:02 ctl02 nova-api[5489]: 2017-09-28 12:40:02.748 5489 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:40:02 ctl02 nova-api[5489]: 2017-09-28 12:40:02.748 5489 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:40:02 ctl02 nova-api[5489]: 2017-09-28 12:40:02.748 5489 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:40:02 ctl02 nova-api[5489]: 2017-09-28 12:40:02.748 5489 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:40:02 ctl02 nova-api[5489]: 2017-09-28 12:40:02.748 5489 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:40:02 ctl02 nova-api[5489]: 2017-09-28 12:40:02.748 5489 ERROR nova.wsgi     self.filename))
Sep 28 12:40:02 ctl02 nova-api[5489]: 2017-09-28 12:40:02.748 5489 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:40:02 ctl02 nova-api[5489]: 2017-09-28 12:40:02.748 5489 ERROR nova.wsgi
Sep 28 12:40:02 ctl02 nova-api[5489]: 2017-09-28 12:40:02.749 5489 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:40:02 ctl02 glance-api[29183]: 2017-09-28 12:40:02.766 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:40:02] "OPTIONS / HTTP/1.0" 200 134 0.000551
Sep 28 12:40:02 ctl02 nova-api[5489]: 2017-09-28 12:40:02.882 5489 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:40:03 ctl02 nova-api[5489]: 2017-09-28 12:40:03.107 5489 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:40:03 ctl02 nova-api[5489]: 2017-09-28 12:40:03.109 5489 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:40:03 ctl02 nova-api[5489]: 2017-09-28 12:40:03.109 5489 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:40:03 ctl02 nova-api[5489]: 2017-09-28 12:40:03.109 5489 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:40:03 ctl02 nova-api[5489]: 2017-09-28 12:40:03.241 5489 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:40:03 ctl02 nova-api[5489]: 2017-09-28 12:40:03.243 5489 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:40:03 ctl02 nova-api[5489]: 2017-09-28 12:40:03.243 5489 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:40:03 ctl02 nova-api[5489]: 2017-09-28 12:40:03.244 5489 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:40:03 ctl02 nova-api[5489]: 2017-09-28 12:40:03.247 5489 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:40:03 ctl02 nova-api[5489]: 2017-09-28 12:40:03.247 5489 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:40:03 ctl02 nova-api[5489]: 2017-09-28 12:40:03.247 5489 ERROR nova Traceback (most recent call last):
Sep 28 12:40:03 ctl02 nova-api[5489]: 2017-09-28 12:40:03.247 5489 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:40:03 ctl02 nova-api[5489]: 2017-09-28 12:40:03.247 5489 ERROR nova     sys.exit(main())
Sep 28 12:40:03 ctl02 nova-api[5489]: 2017-09-28 12:40:03.247 5489 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:40:03 ctl02 nova-api[5489]: 2017-09-28 12:40:03.247 5489 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:40:03 ctl02 nova-api[5489]: 2017-09-28 12:40:03.247 5489 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:40:03 ctl02 nova-api[5489]: 2017-09-28 12:40:03.247 5489 ERROR nova     max_url_len=max_url_len)
Sep 28 12:40:03 ctl02 nova-api[5489]: 2017-09-28 12:40:03.247 5489 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:40:03 ctl02 nova-api[5489]: 2017-09-28 12:40:03.247 5489 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:40:03 ctl02 nova-api[5489]: 2017-09-28 12:40:03.247 5489 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:40:03 ctl02 nova-api[5489]: 2017-09-28 12:40:03.247 5489 ERROR nova     sock.listen(backlog)
Sep 28 12:40:03 ctl02 nova-api[5489]: 2017-09-28 12:40:03.247 5489 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:40:03 ctl02 nova-api[5489]: 2017-09-28 12:40:03.247 5489 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:40:03 ctl02 nova-api[5489]: 2017-09-28 12:40:03.247 5489 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:40:03 ctl02 nova-api[5489]: 2017-09-28 12:40:03.247 5489 ERROR nova
Sep 28 12:40:03 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:40:03.334 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:40:03] "OPTIONS / HTTP/1.0" 200 134 0.000370
Sep 28 12:40:03 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:40:03 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:40:03 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:40:03 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:40:03 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:40:03 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:40:03 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:40:05 ctl02 nova-api[5512]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:40:05 ctl02 nova-api[5512]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:40:05 ctl02 heat-api[13008]: 2017-09-28 12:40:05.555 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:40:05] "OPTIONS / HTTP/1.0" 200 134 0.000527
Sep 28 12:40:05 ctl02 nova-api[5512]: 2017-09-28 12:40:05.570 5512 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:40:05 ctl02 nova-api[5512]: 2017-09-28 12:40:05.572 5512 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:40:05 ctl02 nova-api[5512]: 2017-09-28 12:40:05.572 5512 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:40:05 ctl02 nova-api[5512]: 2017-09-28 12:40:05.572 5512 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:40:05 ctl02 nova-api[5512]: 2017-09-28 12:40:05.572 5512 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:40:05 ctl02 nova-api[5512]: 2017-09-28 12:40:05.572 5512 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:40:05 ctl02 nova-api[5512]: 2017-09-28 12:40:05.572 5512 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:40:05 ctl02 nova-api[5512]: 2017-09-28 12:40:05.572 5512 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:40:05 ctl02 nova-api[5512]: 2017-09-28 12:40:05.572 5512 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:40:05 ctl02 nova-api[5512]: 2017-09-28 12:40:05.572 5512 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:40:05 ctl02 nova-api[5512]: 2017-09-28 12:40:05.572 5512 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:40:05 ctl02 nova-api[5512]: 2017-09-28 12:40:05.572 5512 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:40:05 ctl02 nova-api[5512]: 2017-09-28 12:40:05.572 5512 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:40:05 ctl02 nova-api[5512]: 2017-09-28 12:40:05.572 5512 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:40:05 ctl02 nova-api[5512]: 2017-09-28 12:40:05.572 5512 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:40:05 ctl02 nova-api[5512]: 2017-09-28 12:40:05.572 5512 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:40:05 ctl02 nova-api[5512]: 2017-09-28 12:40:05.572 5512 ERROR nova.wsgi     self.filename))
Sep 28 12:40:05 ctl02 nova-api[5512]: 2017-09-28 12:40:05.572 5512 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:40:05 ctl02 nova-api[5512]: 2017-09-28 12:40:05.572 5512 ERROR nova.wsgi
Sep 28 12:40:05 ctl02 nova-api[5512]: 2017-09-28 12:40:05.574 5512 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:40:05 ctl02 nova-api[5512]: 2017-09-28 12:40:05.708 5512 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:40:05 ctl02 nova-api[5512]: 2017-09-28 12:40:05.935 5512 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:40:05 ctl02 nova-api[5512]: 2017-09-28 12:40:05.937 5512 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:40:05 ctl02 nova-api[5512]: 2017-09-28 12:40:05.937 5512 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:40:05 ctl02 nova-api[5512]: 2017-09-28 12:40:05.938 5512 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:40:06 ctl02 neutron-server[30536]: 2017-09-28 12:40:06.027 30603 WARNING oslo_messaging._drivers.amqpdriver [req-a0ac9cfd-05de-47c3-b73c-7cd1c60182b1 - - - - -] reply_a13a20a54b91453780e36bdf20a855d2 doesn't exists, drop reply to 186e6981df42468c9e4f3fbf35ffdcfc
Sep 28 12:40:06 ctl02 neutron-server[30536]: 2017-09-28 12:40:06.027 30603 INFO oslo_messaging._drivers.amqpdriver [req-a0ac9cfd-05de-47c3-b73c-7cd1c60182b1 - - - - -] The reply 186e6981df42468c9e4f3fbf35ffdcfc cannot be sent  reply_a13a20a54b91453780e36bdf20a855d2 reply queue don't exist after 60 sec abandoning...
Sep 28 12:40:06 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:40:06.049 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:40:06] "OPTIONS / HTTP/1.0" 200 134 0.000394
Sep 28 12:40:06 ctl02 nova-api[5512]: 2017-09-28 12:40:06.069 5512 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:40:06 ctl02 nova-api[5512]: 2017-09-28 12:40:06.071 5512 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:40:06 ctl02 nova-api[5512]: 2017-09-28 12:40:06.071 5512 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:40:06 ctl02 nova-api[5512]: 2017-09-28 12:40:06.071 5512 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:40:06 ctl02 nova-api[5512]: 2017-09-28 12:40:06.074 5512 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:40:06 ctl02 nova-api[5512]: 2017-09-28 12:40:06.075 5512 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:40:06 ctl02 nova-api[5512]: 2017-09-28 12:40:06.075 5512 ERROR nova Traceback (most recent call last):
Sep 28 12:40:06 ctl02 nova-api[5512]: 2017-09-28 12:40:06.075 5512 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:40:06 ctl02 nova-api[5512]: 2017-09-28 12:40:06.075 5512 ERROR nova     sys.exit(main())
Sep 28 12:40:06 ctl02 nova-api[5512]: 2017-09-28 12:40:06.075 5512 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:40:06 ctl02 nova-api[5512]: 2017-09-28 12:40:06.075 5512 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:40:06 ctl02 nova-api[5512]: 2017-09-28 12:40:06.075 5512 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:40:06 ctl02 nova-api[5512]: 2017-09-28 12:40:06.075 5512 ERROR nova     max_url_len=max_url_len)
Sep 28 12:40:06 ctl02 nova-api[5512]: 2017-09-28 12:40:06.075 5512 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:40:06 ctl02 nova-api[5512]: 2017-09-28 12:40:06.075 5512 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:40:06 ctl02 nova-api[5512]: 2017-09-28 12:40:06.075 5512 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:40:06 ctl02 nova-api[5512]: 2017-09-28 12:40:06.075 5512 ERROR nova     sock.listen(backlog)
Sep 28 12:40:06 ctl02 nova-api[5512]: 2017-09-28 12:40:06.075 5512 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:40:06 ctl02 nova-api[5512]: 2017-09-28 12:40:06.075 5512 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:40:06 ctl02 nova-api[5512]: 2017-09-28 12:40:06.075 5512 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:40:06 ctl02 nova-api[5512]: 2017-09-28 12:40:06.075 5512 ERROR nova
Sep 28 12:40:06 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:40:06 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:40:06 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:40:06 ctl02 neutron-server[30536]: 2017-09-28 12:40:06.318 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 4 dead agents out of 6:
Sep 28 12:40:06 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:40:06 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:38:56 cmp002
Sep 28 12:40:06 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:38:58 cmp001
Sep 28 12:40:06 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:39:10 cmp002
Sep 28 12:40:06 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:39:06 cmp002
Sep 28 12:40:06 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:40:06 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:40:06 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:40:06 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:40:06 ctl02 nova-cert[4860]: 2017-09-28 12:40:06.429 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:40:06 ctl02 nova-conductor[5056]: 2017-09-28 12:40:06.897 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:40:06 ctl02 nova-conductor[5056]: 2017-09-28 12:40:06.921 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:40:06 ctl02 nova-conductor[5056]: 2017-09-28 12:40:06.929 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:40:06 ctl02 nova-conductor[5056]: 2017-09-28 12:40:06.932 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:40:07 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:40:07.976 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:40:07] "OPTIONS / HTTP/1.0" 200 134 0.000378
Sep 28 12:40:08 ctl02 heat-api[13008]: 2017-09-28 12:40:08.031 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:40:08] "OPTIONS / HTTP/1.0" 200 134 0.000529
Sep 28 12:40:08 ctl02 nova-api[5530]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:40:08 ctl02 nova-api[5530]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:40:08 ctl02 nova-api[5530]: 2017-09-28 12:40:08.221 5530 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:40:08 ctl02 nova-api[5530]: 2017-09-28 12:40:08.222 5530 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:40:08 ctl02 nova-api[5530]: 2017-09-28 12:40:08.222 5530 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:40:08 ctl02 nova-api[5530]: 2017-09-28 12:40:08.222 5530 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:40:08 ctl02 nova-api[5530]: 2017-09-28 12:40:08.222 5530 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:40:08 ctl02 nova-api[5530]: 2017-09-28 12:40:08.222 5530 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:40:08 ctl02 nova-api[5530]: 2017-09-28 12:40:08.222 5530 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:40:08 ctl02 nova-api[5530]: 2017-09-28 12:40:08.222 5530 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:40:08 ctl02 nova-api[5530]: 2017-09-28 12:40:08.222 5530 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:40:08 ctl02 nova-api[5530]: 2017-09-28 12:40:08.222 5530 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:40:08 ctl02 nova-api[5530]: 2017-09-28 12:40:08.222 5530 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:40:08 ctl02 nova-api[5530]: 2017-09-28 12:40:08.222 5530 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:40:08 ctl02 nova-api[5530]: 2017-09-28 12:40:08.222 5530 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:40:08 ctl02 nova-api[5530]: 2017-09-28 12:40:08.222 5530 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:40:08 ctl02 nova-api[5530]: 2017-09-28 12:40:08.222 5530 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:40:08 ctl02 nova-api[5530]: 2017-09-28 12:40:08.222 5530 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:40:08 ctl02 nova-api[5530]: 2017-09-28 12:40:08.222 5530 ERROR nova.wsgi     self.filename))
Sep 28 12:40:08 ctl02 nova-api[5530]: 2017-09-28 12:40:08.222 5530 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:40:08 ctl02 nova-api[5530]: 2017-09-28 12:40:08.222 5530 ERROR nova.wsgi
Sep 28 12:40:08 ctl02 nova-api[5530]: 2017-09-28 12:40:08.223 5530 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:40:08 ctl02 nova-api[5530]: 2017-09-28 12:40:08.352 5530 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:40:08 ctl02 heat-api-cfn[13300]: 2017-09-28 12:40:08.378 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:40:08] "OPTIONS / HTTP/1.0" 200 134 0.000434
Sep 28 12:40:08 ctl02 heat-api[13008]: 2017-09-28 12:40:08.574 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:40:08] "OPTIONS / HTTP/1.0" 200 134 0.000528
Sep 28 12:40:08 ctl02 nova-api[5530]: 2017-09-28 12:40:08.577 5530 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:40:08 ctl02 nova-api[5530]: 2017-09-28 12:40:08.579 5530 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:40:08 ctl02 nova-api[5530]: 2017-09-28 12:40:08.579 5530 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:40:08 ctl02 nova-api[5530]: 2017-09-28 12:40:08.579 5530 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:40:08 ctl02 nova-api[5530]: 2017-09-28 12:40:08.712 5530 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:40:08 ctl02 nova-api[5530]: 2017-09-28 12:40:08.714 5530 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:40:08 ctl02 nova-api[5530]: 2017-09-28 12:40:08.714 5530 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:40:08 ctl02 nova-api[5530]: 2017-09-28 12:40:08.714 5530 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:40:08 ctl02 nova-api[5530]: 2017-09-28 12:40:08.717 5530 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:40:08 ctl02 nova-api[5530]: 2017-09-28 12:40:08.718 5530 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:40:08 ctl02 nova-api[5530]: 2017-09-28 12:40:08.718 5530 ERROR nova Traceback (most recent call last):
Sep 28 12:40:08 ctl02 nova-api[5530]: 2017-09-28 12:40:08.718 5530 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:40:08 ctl02 nova-api[5530]: 2017-09-28 12:40:08.718 5530 ERROR nova     sys.exit(main())
Sep 28 12:40:08 ctl02 nova-api[5530]: 2017-09-28 12:40:08.718 5530 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:40:08 ctl02 nova-api[5530]: 2017-09-28 12:40:08.718 5530 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:40:08 ctl02 nova-api[5530]: 2017-09-28 12:40:08.718 5530 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:40:08 ctl02 nova-api[5530]: 2017-09-28 12:40:08.718 5530 ERROR nova     max_url_len=max_url_len)
Sep 28 12:40:08 ctl02 nova-api[5530]: 2017-09-28 12:40:08.718 5530 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:40:08 ctl02 nova-api[5530]: 2017-09-28 12:40:08.718 5530 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:40:08 ctl02 nova-api[5530]: 2017-09-28 12:40:08.718 5530 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:40:08 ctl02 nova-api[5530]: 2017-09-28 12:40:08.718 5530 ERROR nova     sock.listen(backlog)
Sep 28 12:40:08 ctl02 nova-api[5530]: 2017-09-28 12:40:08.718 5530 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:40:08 ctl02 nova-api[5530]: 2017-09-28 12:40:08.718 5530 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:40:08 ctl02 nova-api[5530]: 2017-09-28 12:40:08.718 5530 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:40:08 ctl02 nova-api[5530]: 2017-09-28 12:40:08.718 5530 ERROR nova
Sep 28 12:40:08 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:40:08 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:40:08 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:40:09 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:40:09 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:40:09 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:40:09 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:40:09 ctl02 heat-api-cfn[13300]: 2017-09-28 12:40:09.340 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:40:09] "OPTIONS / HTTP/1.0" 200 134 0.000445
Sep 28 12:40:09 ctl02 neutron-server[30536]: 2017-09-28 12:40:09.776 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:40:09] "OPTIONS / HTTP/1.0" 200 262 0.000476
Sep 28 12:40:10 ctl02 neutron-server[30536]: 2017-09-28 12:40:10.051 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:40:10] "OPTIONS / HTTP/1.0" 200 262 0.000413
Sep 28 12:40:10 ctl02 nova-api[5548]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:40:10 ctl02 nova-api[5548]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:40:10 ctl02 neutron-server[30536]: 2017-09-28 12:40:10.913 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:40:10] "OPTIONS / HTTP/1.0" 200 262 0.000625
Sep 28 12:40:11 ctl02 nova-api[5548]: 2017-09-28 12:40:11.008 5548 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:40:11 ctl02 nova-api[5548]: 2017-09-28 12:40:11.009 5548 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:40:11 ctl02 nova-api[5548]: 2017-09-28 12:40:11.009 5548 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:40:11 ctl02 nova-api[5548]: 2017-09-28 12:40:11.009 5548 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:40:11 ctl02 nova-api[5548]: 2017-09-28 12:40:11.009 5548 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:40:11 ctl02 nova-api[5548]: 2017-09-28 12:40:11.009 5548 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:40:11 ctl02 nova-api[5548]: 2017-09-28 12:40:11.009 5548 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:40:11 ctl02 nova-api[5548]: 2017-09-28 12:40:11.009 5548 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:40:11 ctl02 nova-api[5548]: 2017-09-28 12:40:11.009 5548 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:40:11 ctl02 nova-api[5548]: 2017-09-28 12:40:11.009 5548 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:40:11 ctl02 nova-api[5548]: 2017-09-28 12:40:11.009 5548 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:40:11 ctl02 nova-api[5548]: 2017-09-28 12:40:11.009 5548 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:40:11 ctl02 nova-api[5548]: 2017-09-28 12:40:11.009 5548 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:40:11 ctl02 nova-api[5548]: 2017-09-28 12:40:11.009 5548 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:40:11 ctl02 nova-api[5548]: 2017-09-28 12:40:11.009 5548 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:40:11 ctl02 nova-api[5548]: 2017-09-28 12:40:11.009 5548 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:40:11 ctl02 nova-api[5548]: 2017-09-28 12:40:11.009 5548 ERROR nova.wsgi     self.filename))
Sep 28 12:40:11 ctl02 nova-api[5548]: 2017-09-28 12:40:11.009 5548 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:40:11 ctl02 nova-api[5548]: 2017-09-28 12:40:11.009 5548 ERROR nova.wsgi
Sep 28 12:40:11 ctl02 nova-api[5548]: 2017-09-28 12:40:11.012 5548 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:40:11 ctl02 nova-api[5548]: 2017-09-28 12:40:11.142 5548 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:40:11 ctl02 nova-api[5548]: 2017-09-28 12:40:11.371 5548 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:40:11 ctl02 nova-api[5548]: 2017-09-28 12:40:11.387 5548 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:40:11 ctl02 nova-api[5548]: 2017-09-28 12:40:11.387 5548 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:40:11 ctl02 nova-api[5548]: 2017-09-28 12:40:11.388 5548 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:40:11 ctl02 glance-api[29183]: 2017-09-28 12:40:11.441 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:40:11] "OPTIONS / HTTP/1.0" 200 134 0.000556
Sep 28 12:40:11 ctl02 nova-api[5548]: 2017-09-28 12:40:11.519 5548 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:40:11 ctl02 nova-api[5548]: 2017-09-28 12:40:11.521 5548 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:40:11 ctl02 nova-api[5548]: 2017-09-28 12:40:11.522 5548 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:40:11 ctl02 nova-api[5548]: 2017-09-28 12:40:11.522 5548 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:40:11 ctl02 nova-api[5548]: 2017-09-28 12:40:11.525 5548 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:40:11 ctl02 nova-api[5548]: 2017-09-28 12:40:11.526 5548 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:40:11 ctl02 nova-api[5548]: 2017-09-28 12:40:11.526 5548 ERROR nova Traceback (most recent call last):
Sep 28 12:40:11 ctl02 nova-api[5548]: 2017-09-28 12:40:11.526 5548 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:40:11 ctl02 nova-api[5548]: 2017-09-28 12:40:11.526 5548 ERROR nova     sys.exit(main())
Sep 28 12:40:11 ctl02 nova-api[5548]: 2017-09-28 12:40:11.526 5548 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:40:11 ctl02 nova-api[5548]: 2017-09-28 12:40:11.526 5548 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:40:11 ctl02 nova-api[5548]: 2017-09-28 12:40:11.526 5548 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:40:11 ctl02 nova-api[5548]: 2017-09-28 12:40:11.526 5548 ERROR nova     max_url_len=max_url_len)
Sep 28 12:40:11 ctl02 nova-api[5548]: 2017-09-28 12:40:11.526 5548 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:40:11 ctl02 nova-api[5548]: 2017-09-28 12:40:11.526 5548 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:40:11 ctl02 nova-api[5548]: 2017-09-28 12:40:11.526 5548 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:40:11 ctl02 nova-api[5548]: 2017-09-28 12:40:11.526 5548 ERROR nova     sock.listen(backlog)
Sep 28 12:40:11 ctl02 nova-api[5548]: 2017-09-28 12:40:11.526 5548 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:40:11 ctl02 nova-api[5548]: 2017-09-28 12:40:11.526 5548 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:40:11 ctl02 nova-api[5548]: 2017-09-28 12:40:11.526 5548 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:40:11 ctl02 nova-api[5548]: 2017-09-28 12:40:11.526 5548 ERROR nova
Sep 28 12:40:11 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:40:11 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:40:11 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:40:11 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:40:11 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:40:11 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:40:11 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:40:11 ctl02 glance-api[29183]: 2017-09-28 12:40:11.971 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:40:11] "OPTIONS / HTTP/1.0" 200 134 0.001054
Sep 28 12:40:12 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe15ae804)
Sep 28 12:40:12 ctl02 heat-api-cfn[13300]: 2017-09-28 12:40:12.487 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:40:12] "OPTIONS / HTTP/1.0" 200 134 0.000825
Sep 28 12:40:12 ctl02 glance-api[29183]: 2017-09-28 12:40:12.497 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:40:12] "OPTIONS / HTTP/1.0" 200 134 0.000672
Sep 28 12:40:13 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:40:13.226 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:40:13] "OPTIONS / HTTP/1.0" 200 134 0.000623
Sep 28 12:40:13 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe15ae804)
Sep 28 12:40:13 ctl02 neutron-server[30536]: 2017-09-28 12:40:13.496 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:40:13 ctl02 nova-api[5566]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:40:13 ctl02 nova-api[5566]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:40:13 ctl02 nova-api[5566]: 2017-09-28 12:40:13.793 5566 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:40:13 ctl02 nova-api[5566]: 2017-09-28 12:40:13.794 5566 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:40:13 ctl02 nova-api[5566]: 2017-09-28 12:40:13.794 5566 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:40:13 ctl02 nova-api[5566]: 2017-09-28 12:40:13.794 5566 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:40:13 ctl02 nova-api[5566]: 2017-09-28 12:40:13.794 5566 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:40:13 ctl02 nova-api[5566]: 2017-09-28 12:40:13.794 5566 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:40:13 ctl02 nova-api[5566]: 2017-09-28 12:40:13.794 5566 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:40:13 ctl02 nova-api[5566]: 2017-09-28 12:40:13.794 5566 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:40:13 ctl02 nova-api[5566]: 2017-09-28 12:40:13.794 5566 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:40:13 ctl02 nova-api[5566]: 2017-09-28 12:40:13.794 5566 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:40:13 ctl02 nova-api[5566]: 2017-09-28 12:40:13.794 5566 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:40:13 ctl02 nova-api[5566]: 2017-09-28 12:40:13.794 5566 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:40:13 ctl02 nova-api[5566]: 2017-09-28 12:40:13.794 5566 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:40:13 ctl02 nova-api[5566]: 2017-09-28 12:40:13.794 5566 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:40:13 ctl02 nova-api[5566]: 2017-09-28 12:40:13.794 5566 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:40:13 ctl02 nova-api[5566]: 2017-09-28 12:40:13.794 5566 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:40:13 ctl02 nova-api[5566]: 2017-09-28 12:40:13.794 5566 ERROR nova.wsgi     self.filename))
Sep 28 12:40:13 ctl02 nova-api[5566]: 2017-09-28 12:40:13.794 5566 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:40:13 ctl02 nova-api[5566]: 2017-09-28 12:40:13.794 5566 ERROR nova.wsgi
Sep 28 12:40:13 ctl02 nova-api[5566]: 2017-09-28 12:40:13.797 5566 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:40:13 ctl02 nova-api[5566]: 2017-09-28 12:40:13.931 5566 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:40:14 ctl02 nova-api[5566]: 2017-09-28 12:40:14.181 5566 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:40:14 ctl02 nova-api[5566]: 2017-09-28 12:40:14.184 5566 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:40:14 ctl02 nova-api[5566]: 2017-09-28 12:40:14.184 5566 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:40:14 ctl02 nova-api[5566]: 2017-09-28 12:40:14.185 5566 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:40:14 ctl02 nova-api[5566]: 2017-09-28 12:40:14.321 5566 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:40:14 ctl02 nova-api[5566]: 2017-09-28 12:40:14.324 5566 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:40:14 ctl02 nova-api[5566]: 2017-09-28 12:40:14.324 5566 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:40:14 ctl02 nova-api[5566]: 2017-09-28 12:40:14.325 5566 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:40:14 ctl02 nova-api[5566]: 2017-09-28 12:40:14.328 5566 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:40:14 ctl02 nova-api[5566]: 2017-09-28 12:40:14.329 5566 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:40:14 ctl02 nova-api[5566]: 2017-09-28 12:40:14.329 5566 ERROR nova Traceback (most recent call last):
Sep 28 12:40:14 ctl02 nova-api[5566]: 2017-09-28 12:40:14.329 5566 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:40:14 ctl02 nova-api[5566]: 2017-09-28 12:40:14.329 5566 ERROR nova     sys.exit(main())
Sep 28 12:40:14 ctl02 nova-api[5566]: 2017-09-28 12:40:14.329 5566 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:40:14 ctl02 nova-api[5566]: 2017-09-28 12:40:14.329 5566 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:40:14 ctl02 nova-api[5566]: 2017-09-28 12:40:14.329 5566 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:40:14 ctl02 nova-api[5566]: 2017-09-28 12:40:14.329 5566 ERROR nova     max_url_len=max_url_len)
Sep 28 12:40:14 ctl02 nova-api[5566]: 2017-09-28 12:40:14.329 5566 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:40:14 ctl02 nova-api[5566]: 2017-09-28 12:40:14.329 5566 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:40:14 ctl02 nova-api[5566]: 2017-09-28 12:40:14.329 5566 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:40:14 ctl02 nova-api[5566]: 2017-09-28 12:40:14.329 5566 ERROR nova     sock.listen(backlog)
Sep 28 12:40:14 ctl02 nova-api[5566]: 2017-09-28 12:40:14.329 5566 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:40:14 ctl02 nova-api[5566]: 2017-09-28 12:40:14.329 5566 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:40:14 ctl02 nova-api[5566]: 2017-09-28 12:40:14.329 5566 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:40:14 ctl02 nova-api[5566]: 2017-09-28 12:40:14.329 5566 ERROR nova
Sep 28 12:40:14 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe15ae804)
Sep 28 12:40:14 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:40:14 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:40:14 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:40:14 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:40:14 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:40:14 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:40:14 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:40:15 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe15ae804)
Sep 28 12:40:15 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:40:15.763 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:40:15] "OPTIONS / HTTP/1.0" 200 134 0.000480
Sep 28 12:40:15 ctl02 heat-api[13008]: 2017-09-28 12:40:15.785 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:40:15] "OPTIONS / HTTP/1.0" 200 134 0.000603
Sep 28 12:40:16 ctl02 nova-consoleauth[5433]: 2017-09-28 12:40:16.290 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:40:16 ctl02 nova-api[5583]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:40:16 ctl02 nova-api[5583]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:40:16 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe15ae804)
Sep 28 12:40:16 ctl02 nova-api[5583]: 2017-09-28 12:40:16.513 5583 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:40:16 ctl02 nova-api[5583]: 2017-09-28 12:40:16.515 5583 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:40:16 ctl02 nova-api[5583]: 2017-09-28 12:40:16.515 5583 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:40:16 ctl02 nova-api[5583]: 2017-09-28 12:40:16.515 5583 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:40:16 ctl02 nova-api[5583]: 2017-09-28 12:40:16.515 5583 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:40:16 ctl02 nova-api[5583]: 2017-09-28 12:40:16.515 5583 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:40:16 ctl02 nova-api[5583]: 2017-09-28 12:40:16.515 5583 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:40:16 ctl02 nova-api[5583]: 2017-09-28 12:40:16.515 5583 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:40:16 ctl02 nova-api[5583]: 2017-09-28 12:40:16.515 5583 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:40:16 ctl02 nova-api[5583]: 2017-09-28 12:40:16.515 5583 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:40:16 ctl02 nova-api[5583]: 2017-09-28 12:40:16.515 5583 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:40:16 ctl02 nova-api[5583]: 2017-09-28 12:40:16.515 5583 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:40:16 ctl02 nova-api[5583]: 2017-09-28 12:40:16.515 5583 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:40:16 ctl02 nova-api[5583]: 2017-09-28 12:40:16.515 5583 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:40:16 ctl02 nova-api[5583]: 2017-09-28 12:40:16.515 5583 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:40:16 ctl02 nova-api[5583]: 2017-09-28 12:40:16.515 5583 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:40:16 ctl02 nova-api[5583]: 2017-09-28 12:40:16.515 5583 ERROR nova.wsgi     self.filename))
Sep 28 12:40:16 ctl02 nova-api[5583]: 2017-09-28 12:40:16.515 5583 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:40:16 ctl02 nova-api[5583]: 2017-09-28 12:40:16.515 5583 ERROR nova.wsgi
Sep 28 12:40:16 ctl02 nova-api[5583]: 2017-09-28 12:40:16.525 5583 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:40:16 ctl02 nova-api[5583]: 2017-09-28 12:40:16.660 5583 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:40:16 ctl02 nova-api[5583]: 2017-09-28 12:40:16.919 5583 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:40:16 ctl02 nova-api[5583]: 2017-09-28 12:40:16.922 5583 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:40:16 ctl02 nova-api[5583]: 2017-09-28 12:40:16.922 5583 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:40:16 ctl02 nova-api[5583]: 2017-09-28 12:40:16.922 5583 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:40:17 ctl02 nova-api[5583]: 2017-09-28 12:40:17.056 5583 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:40:17 ctl02 nova-api[5583]: 2017-09-28 12:40:17.059 5583 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:40:17 ctl02 nova-api[5583]: 2017-09-28 12:40:17.059 5583 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:40:17 ctl02 nova-api[5583]: 2017-09-28 12:40:17.060 5583 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:40:17 ctl02 nova-api[5583]: 2017-09-28 12:40:17.063 5583 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:40:17 ctl02 nova-api[5583]: 2017-09-28 12:40:17.063 5583 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:40:17 ctl02 nova-api[5583]: 2017-09-28 12:40:17.063 5583 ERROR nova Traceback (most recent call last):
Sep 28 12:40:17 ctl02 nova-api[5583]: 2017-09-28 12:40:17.063 5583 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:40:17 ctl02 nova-api[5583]: 2017-09-28 12:40:17.063 5583 ERROR nova     sys.exit(main())
Sep 28 12:40:17 ctl02 nova-api[5583]: 2017-09-28 12:40:17.063 5583 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:40:17 ctl02 nova-api[5583]: 2017-09-28 12:40:17.063 5583 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:40:17 ctl02 nova-api[5583]: 2017-09-28 12:40:17.063 5583 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:40:17 ctl02 nova-api[5583]: 2017-09-28 12:40:17.063 5583 ERROR nova     max_url_len=max_url_len)
Sep 28 12:40:17 ctl02 nova-api[5583]: 2017-09-28 12:40:17.063 5583 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:40:17 ctl02 nova-api[5583]: 2017-09-28 12:40:17.063 5583 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:40:17 ctl02 nova-api[5583]: 2017-09-28 12:40:17.063 5583 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:40:17 ctl02 nova-api[5583]: 2017-09-28 12:40:17.063 5583 ERROR nova     sock.listen(backlog)
Sep 28 12:40:17 ctl02 nova-api[5583]: 2017-09-28 12:40:17.063 5583 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:40:17 ctl02 nova-api[5583]: 2017-09-28 12:40:17.063 5583 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:40:17 ctl02 nova-api[5583]: 2017-09-28 12:40:17.063 5583 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:40:17 ctl02 nova-api[5583]: 2017-09-28 12:40:17.063 5583 ERROR nova
Sep 28 12:40:17 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:40:17 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:40:17 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:40:17 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe15ae804)
Sep 28 12:40:17 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:40:17 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:40:17 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:40:17 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:40:17 ctl02 heat-api[13008]: 2017-09-28 12:40:17.669 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:40:17] "OPTIONS / HTTP/1.0" 200 134 0.000645
Sep 28 12:40:17 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:40:17.966 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:40:17] "OPTIONS / HTTP/1.0" 200 134 0.000499
Sep 28 12:40:18 ctl02 heat-engine[12803]: 2017-09-28 12:40:18.041 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:40:18 ctl02 heat-engine[12803]: 2017-09-28 12:40:18.041 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:40:18 ctl02 heat-engine[12803]: 2017-09-28 12:40:18.036 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:40:18 ctl02 heat-engine[12803]: 2017-09-28 12:40:18.048 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:40:18 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe15ae804)
Sep 28 12:40:18 ctl02 heat-api-cfn[13300]: 2017-09-28 12:40:18.637 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:40:18] "OPTIONS / HTTP/1.0" 200 134 0.000523
Sep 28 12:40:18 ctl02 heat-api[13008]: 2017-09-28 12:40:18.745 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:40:18] "OPTIONS / HTTP/1.0" 200 134 0.000618
Sep 28 12:40:19 ctl02 nova-api[5602]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:40:19 ctl02 nova-api[5602]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:40:19 ctl02 nova-api[5602]: 2017-09-28 12:40:19.290 5602 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:40:19 ctl02 nova-api[5602]: 2017-09-28 12:40:19.292 5602 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:40:19 ctl02 nova-api[5602]: 2017-09-28 12:40:19.292 5602 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:40:19 ctl02 nova-api[5602]: 2017-09-28 12:40:19.292 5602 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:40:19 ctl02 nova-api[5602]: 2017-09-28 12:40:19.292 5602 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:40:19 ctl02 nova-api[5602]: 2017-09-28 12:40:19.292 5602 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:40:19 ctl02 nova-api[5602]: 2017-09-28 12:40:19.292 5602 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:40:19 ctl02 nova-api[5602]: 2017-09-28 12:40:19.292 5602 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:40:19 ctl02 nova-api[5602]: 2017-09-28 12:40:19.292 5602 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:40:19 ctl02 nova-api[5602]: 2017-09-28 12:40:19.292 5602 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:40:19 ctl02 nova-api[5602]: 2017-09-28 12:40:19.292 5602 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:40:19 ctl02 nova-api[5602]: 2017-09-28 12:40:19.292 5602 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:40:19 ctl02 nova-api[5602]: 2017-09-28 12:40:19.292 5602 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:40:19 ctl02 nova-api[5602]: 2017-09-28 12:40:19.292 5602 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:40:19 ctl02 nova-api[5602]: 2017-09-28 12:40:19.292 5602 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:40:19 ctl02 nova-api[5602]: 2017-09-28 12:40:19.292 5602 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:40:19 ctl02 nova-api[5602]: 2017-09-28 12:40:19.292 5602 ERROR nova.wsgi     self.filename))
Sep 28 12:40:19 ctl02 nova-api[5602]: 2017-09-28 12:40:19.292 5602 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:40:19 ctl02 nova-api[5602]: 2017-09-28 12:40:19.292 5602 ERROR nova.wsgi
Sep 28 12:40:19 ctl02 nova-api[5602]: 2017-09-28 12:40:19.292 5602 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:40:19 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe15ae804)
Sep 28 12:40:19 ctl02 nova-scheduler[5620]: 2017-09-28 12:40:19.381 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:40:19 ctl02 nova-api[5602]: 2017-09-28 12:40:19.428 5602 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:40:19 ctl02 neutron-server[30536]: 2017-09-28 12:40:19.506 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:40:19] "OPTIONS / HTTP/1.0" 200 262 0.000567
Sep 28 12:40:19 ctl02 heat-api-cfn[13300]: 2017-09-28 12:40:19.541 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:40:19] "OPTIONS / HTTP/1.0" 200 134 0.000488
Sep 28 12:40:19 ctl02 nova-api[5602]: 2017-09-28 12:40:19.679 5602 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:40:19 ctl02 nova-api[5602]: 2017-09-28 12:40:19.681 5602 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:40:19 ctl02 nova-api[5602]: 2017-09-28 12:40:19.681 5602 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:40:19 ctl02 nova-api[5602]: 2017-09-28 12:40:19.682 5602 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:40:19 ctl02 nova-api[5602]: 2017-09-28 12:40:19.815 5602 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:40:19 ctl02 nova-api[5602]: 2017-09-28 12:40:19.817 5602 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:40:19 ctl02 nova-api[5602]: 2017-09-28 12:40:19.817 5602 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:40:19 ctl02 nova-api[5602]: 2017-09-28 12:40:19.817 5602 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:40:19 ctl02 nova-api[5602]: 2017-09-28 12:40:19.821 5602 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:40:19 ctl02 nova-api[5602]: 2017-09-28 12:40:19.821 5602 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:40:19 ctl02 nova-api[5602]: 2017-09-28 12:40:19.821 5602 ERROR nova Traceback (most recent call last):
Sep 28 12:40:19 ctl02 nova-api[5602]: 2017-09-28 12:40:19.821 5602 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:40:19 ctl02 nova-api[5602]: 2017-09-28 12:40:19.821 5602 ERROR nova     sys.exit(main())
Sep 28 12:40:19 ctl02 nova-api[5602]: 2017-09-28 12:40:19.821 5602 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:40:19 ctl02 nova-api[5602]: 2017-09-28 12:40:19.821 5602 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:40:19 ctl02 nova-api[5602]: 2017-09-28 12:40:19.821 5602 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:40:19 ctl02 nova-api[5602]: 2017-09-28 12:40:19.821 5602 ERROR nova     max_url_len=max_url_len)
Sep 28 12:40:19 ctl02 nova-api[5602]: 2017-09-28 12:40:19.821 5602 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:40:19 ctl02 nova-api[5602]: 2017-09-28 12:40:19.821 5602 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:40:19 ctl02 nova-api[5602]: 2017-09-28 12:40:19.821 5602 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:40:19 ctl02 nova-api[5602]: 2017-09-28 12:40:19.821 5602 ERROR nova     sock.listen(backlog)
Sep 28 12:40:19 ctl02 nova-api[5602]: 2017-09-28 12:40:19.821 5602 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:40:19 ctl02 nova-api[5602]: 2017-09-28 12:40:19.821 5602 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:40:19 ctl02 nova-api[5602]: 2017-09-28 12:40:19.821 5602 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:40:19 ctl02 nova-api[5602]: 2017-09-28 12:40:19.821 5602 ERROR nova
Sep 28 12:40:19 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:40:19 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:40:19 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:40:20 ctl02 neutron-server[30536]: 2017-09-28 12:40:20.080 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:40:20] "OPTIONS / HTTP/1.0" 200 262 0.000560
Sep 28 12:40:20 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:40:20 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:40:20 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:40:20 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:40:20 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe15ae804)
Sep 28 12:40:21 ctl02 glance-api[29183]: 2017-09-28 12:40:21.063 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:40:21] "OPTIONS / HTTP/1.0" 200 134 0.000694
Sep 28 12:40:21 ctl02 neutron-server[30536]: 2017-09-28 12:40:21.244 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:40:21] "OPTIONS / HTTP/1.0" 200 262 0.000568
Sep 28 12:40:21 ctl02 neutron-server[30536]: 2017-09-28 12:40:21.315 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 4 dead agents out of 6:
Sep 28 12:40:21 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:40:21 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:38:56 cmp002
Sep 28 12:40:21 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:38:58 cmp001
Sep 28 12:40:21 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:39:10 cmp002
Sep 28 12:40:21 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:39:06 cmp002
Sep 28 12:40:21 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe15ae804)
Sep 28 12:40:21 ctl02 glance-api[29183]: 2017-09-28 12:40:21.674 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:40:21] "OPTIONS / HTTP/1.0" 200 134 0.000641
Sep 28 12:40:21 ctl02 nova-api[5621]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:40:21 ctl02 nova-api[5621]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:40:22 ctl02 nova-api[5621]: 2017-09-28 12:40:22.009 5621 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:40:22 ctl02 nova-api[5621]: 2017-09-28 12:40:22.011 5621 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:40:22 ctl02 nova-api[5621]: 2017-09-28 12:40:22.011 5621 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:40:22 ctl02 nova-api[5621]: 2017-09-28 12:40:22.011 5621 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:40:22 ctl02 nova-api[5621]: 2017-09-28 12:40:22.011 5621 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:40:22 ctl02 nova-api[5621]: 2017-09-28 12:40:22.011 5621 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:40:22 ctl02 nova-api[5621]: 2017-09-28 12:40:22.011 5621 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:40:22 ctl02 nova-api[5621]: 2017-09-28 12:40:22.011 5621 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:40:22 ctl02 nova-api[5621]: 2017-09-28 12:40:22.011 5621 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:40:22 ctl02 nova-api[5621]: 2017-09-28 12:40:22.011 5621 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:40:22 ctl02 nova-api[5621]: 2017-09-28 12:40:22.011 5621 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:40:22 ctl02 nova-api[5621]: 2017-09-28 12:40:22.011 5621 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:40:22 ctl02 nova-api[5621]: 2017-09-28 12:40:22.011 5621 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:40:22 ctl02 nova-api[5621]: 2017-09-28 12:40:22.011 5621 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:40:22 ctl02 nova-api[5621]: 2017-09-28 12:40:22.011 5621 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:40:22 ctl02 nova-api[5621]: 2017-09-28 12:40:22.011 5621 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:40:22 ctl02 nova-api[5621]: 2017-09-28 12:40:22.011 5621 ERROR nova.wsgi     self.filename))
Sep 28 12:40:22 ctl02 nova-api[5621]: 2017-09-28 12:40:22.011 5621 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:40:22 ctl02 nova-api[5621]: 2017-09-28 12:40:22.011 5621 ERROR nova.wsgi
Sep 28 12:40:22 ctl02 nova-api[5621]: 2017-09-28 12:40:22.012 5621 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:40:22 ctl02 nova-api[5621]: 2017-09-28 12:40:22.137 5621 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:40:22 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xe15ae804)
Sep 28 12:40:22 ctl02 nova-api[5621]: 2017-09-28 12:40:22.360 5621 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:40:22 ctl02 nova-api[5621]: 2017-09-28 12:40:22.362 5621 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:40:22 ctl02 nova-api[5621]: 2017-09-28 12:40:22.362 5621 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:40:22 ctl02 nova-api[5621]: 2017-09-28 12:40:22.362 5621 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:40:22 ctl02 heat-api-cfn[13300]: 2017-09-28 12:40:22.431 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:40:22] "OPTIONS / HTTP/1.0" 200 134 0.000553
Sep 28 12:40:22 ctl02 nova-api[5621]: 2017-09-28 12:40:22.492 5621 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:40:22 ctl02 nova-api[5621]: 2017-09-28 12:40:22.494 5621 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:40:22 ctl02 nova-api[5621]: 2017-09-28 12:40:22.494 5621 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:40:22 ctl02 nova-api[5621]: 2017-09-28 12:40:22.494 5621 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:40:22 ctl02 nova-api[5621]: 2017-09-28 12:40:22.497 5621 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:40:22 ctl02 nova-api[5621]: 2017-09-28 12:40:22.497 5621 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:40:22 ctl02 nova-api[5621]: 2017-09-28 12:40:22.497 5621 ERROR nova Traceback (most recent call last):
Sep 28 12:40:22 ctl02 nova-api[5621]: 2017-09-28 12:40:22.497 5621 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:40:22 ctl02 nova-api[5621]: 2017-09-28 12:40:22.497 5621 ERROR nova     sys.exit(main())
Sep 28 12:40:22 ctl02 nova-api[5621]: 2017-09-28 12:40:22.497 5621 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:40:22 ctl02 nova-api[5621]: 2017-09-28 12:40:22.497 5621 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:40:22 ctl02 nova-api[5621]: 2017-09-28 12:40:22.497 5621 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:40:22 ctl02 nova-api[5621]: 2017-09-28 12:40:22.497 5621 ERROR nova     max_url_len=max_url_len)
Sep 28 12:40:22 ctl02 nova-api[5621]: 2017-09-28 12:40:22.497 5621 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:40:22 ctl02 nova-api[5621]: 2017-09-28 12:40:22.497 5621 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:40:22 ctl02 nova-api[5621]: 2017-09-28 12:40:22.497 5621 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:40:22 ctl02 nova-api[5621]: 2017-09-28 12:40:22.497 5621 ERROR nova     sock.listen(backlog)
Sep 28 12:40:22 ctl02 nova-api[5621]: 2017-09-28 12:40:22.497 5621 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:40:22 ctl02 nova-api[5621]: 2017-09-28 12:40:22.497 5621 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:40:22 ctl02 nova-api[5621]: 2017-09-28 12:40:22.497 5621 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:40:22 ctl02 nova-api[5621]: 2017-09-28 12:40:22.497 5621 ERROR nova
Sep 28 12:40:22 ctl02 glance-api[29183]: 2017-09-28 12:40:22.615 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:40:22] "OPTIONS / HTTP/1.0" 200 134 0.000665
Sep 28 12:40:22 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:40:22 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:40:22 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:40:22 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:40:22.843 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:40:22] "OPTIONS / HTTP/1.0" 200 134 0.000531
Sep 28 12:40:22 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:40:22 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:40:22 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:40:22 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:40:23 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:40:23 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:40:24 ctl02 nova-api[5639]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:40:24 ctl02 nova-api[5639]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:40:24 ctl02 nova-api[5639]: 2017-09-28 12:40:24.792 5639 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:40:24 ctl02 nova-api[5639]: 2017-09-28 12:40:24.794 5639 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:40:24 ctl02 nova-api[5639]: 2017-09-28 12:40:24.794 5639 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:40:24 ctl02 nova-api[5639]: 2017-09-28 12:40:24.794 5639 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:40:24 ctl02 nova-api[5639]: 2017-09-28 12:40:24.794 5639 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:40:24 ctl02 nova-api[5639]: 2017-09-28 12:40:24.794 5639 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:40:24 ctl02 nova-api[5639]: 2017-09-28 12:40:24.794 5639 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:40:24 ctl02 nova-api[5639]: 2017-09-28 12:40:24.794 5639 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:40:24 ctl02 nova-api[5639]: 2017-09-28 12:40:24.794 5639 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:40:24 ctl02 nova-api[5639]: 2017-09-28 12:40:24.794 5639 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:40:24 ctl02 nova-api[5639]: 2017-09-28 12:40:24.794 5639 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:40:24 ctl02 nova-api[5639]: 2017-09-28 12:40:24.794 5639 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:40:24 ctl02 nova-api[5639]: 2017-09-28 12:40:24.794 5639 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:40:24 ctl02 nova-api[5639]: 2017-09-28 12:40:24.794 5639 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:40:24 ctl02 nova-api[5639]: 2017-09-28 12:40:24.794 5639 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:40:24 ctl02 nova-api[5639]: 2017-09-28 12:40:24.794 5639 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:40:24 ctl02 nova-api[5639]: 2017-09-28 12:40:24.794 5639 ERROR nova.wsgi     self.filename))
Sep 28 12:40:24 ctl02 nova-api[5639]: 2017-09-28 12:40:24.794 5639 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:40:24 ctl02 nova-api[5639]: 2017-09-28 12:40:24.794 5639 ERROR nova.wsgi
Sep 28 12:40:24 ctl02 nova-api[5639]: 2017-09-28 12:40:24.795 5639 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:40:24 ctl02 nova-api[5639]: 2017-09-28 12:40:24.929 5639 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:40:25 ctl02 nova-api[5639]: 2017-09-28 12:40:25.180 5639 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:40:25 ctl02 nova-api[5639]: 2017-09-28 12:40:25.183 5639 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:40:25 ctl02 nova-api[5639]: 2017-09-28 12:40:25.184 5639 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:40:25 ctl02 nova-api[5639]: 2017-09-28 12:40:25.184 5639 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:40:25 ctl02 nova-api[5639]: 2017-09-28 12:40:25.318 5639 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:40:25 ctl02 nova-api[5639]: 2017-09-28 12:40:25.320 5639 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:40:25 ctl02 nova-api[5639]: 2017-09-28 12:40:25.320 5639 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:40:25 ctl02 nova-api[5639]: 2017-09-28 12:40:25.320 5639 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:40:25 ctl02 nova-api[5639]: 2017-09-28 12:40:25.324 5639 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:40:25 ctl02 nova-api[5639]: 2017-09-28 12:40:25.324 5639 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:40:25 ctl02 nova-api[5639]: 2017-09-28 12:40:25.324 5639 ERROR nova Traceback (most recent call last):
Sep 28 12:40:25 ctl02 nova-api[5639]: 2017-09-28 12:40:25.324 5639 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:40:25 ctl02 nova-api[5639]: 2017-09-28 12:40:25.324 5639 ERROR nova     sys.exit(main())
Sep 28 12:40:25 ctl02 nova-api[5639]: 2017-09-28 12:40:25.324 5639 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:40:25 ctl02 nova-api[5639]: 2017-09-28 12:40:25.324 5639 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:40:25 ctl02 nova-api[5639]: 2017-09-28 12:40:25.324 5639 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:40:25 ctl02 nova-api[5639]: 2017-09-28 12:40:25.324 5639 ERROR nova     max_url_len=max_url_len)
Sep 28 12:40:25 ctl02 nova-api[5639]: 2017-09-28 12:40:25.324 5639 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:40:25 ctl02 nova-api[5639]: 2017-09-28 12:40:25.324 5639 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:40:25 ctl02 nova-api[5639]: 2017-09-28 12:40:25.324 5639 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:40:25 ctl02 nova-api[5639]: 2017-09-28 12:40:25.324 5639 ERROR nova     sock.listen(backlog)
Sep 28 12:40:25 ctl02 nova-api[5639]: 2017-09-28 12:40:25.324 5639 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:40:25 ctl02 nova-api[5639]: 2017-09-28 12:40:25.324 5639 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:40:25 ctl02 nova-api[5639]: 2017-09-28 12:40:25.324 5639 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:40:25 ctl02 nova-api[5639]: 2017-09-28 12:40:25.324 5639 ERROR nova
Sep 28 12:40:25 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:40:25 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:40:25 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:40:25 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:40:25 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:40:25 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:40:25 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:40:25 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:40:25.746 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:40:25] "OPTIONS / HTTP/1.0" 200 134 0.000500
Sep 28 12:40:25 ctl02 heat-api[13008]: 2017-09-28 12:40:25.853 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:40:25] "OPTIONS / HTTP/1.0" 200 134 0.000614
Sep 28 12:40:27 ctl02 heat-api[13008]: 2017-09-28 12:40:27.286 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:40:27] "OPTIONS / HTTP/1.0" 200 134 0.000639
Sep 28 12:40:27 ctl02 nova-api[5662]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:40:27 ctl02 nova-api[5662]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:40:27 ctl02 nova-api[5662]: 2017-09-28 12:40:27.527 5662 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:40:27 ctl02 nova-api[5662]: 2017-09-28 12:40:27.529 5662 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:40:27 ctl02 nova-api[5662]: 2017-09-28 12:40:27.529 5662 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:40:27 ctl02 nova-api[5662]: 2017-09-28 12:40:27.529 5662 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:40:27 ctl02 nova-api[5662]: 2017-09-28 12:40:27.529 5662 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:40:27 ctl02 nova-api[5662]: 2017-09-28 12:40:27.529 5662 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:40:27 ctl02 nova-api[5662]: 2017-09-28 12:40:27.529 5662 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:40:27 ctl02 nova-api[5662]: 2017-09-28 12:40:27.529 5662 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:40:27 ctl02 nova-api[5662]: 2017-09-28 12:40:27.529 5662 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:40:27 ctl02 nova-api[5662]: 2017-09-28 12:40:27.529 5662 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:40:27 ctl02 nova-api[5662]: 2017-09-28 12:40:27.529 5662 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:40:27 ctl02 nova-api[5662]: 2017-09-28 12:40:27.529 5662 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:40:27 ctl02 nova-api[5662]: 2017-09-28 12:40:27.529 5662 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:40:27 ctl02 nova-api[5662]: 2017-09-28 12:40:27.529 5662 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:40:27 ctl02 nova-api[5662]: 2017-09-28 12:40:27.529 5662 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:40:27 ctl02 nova-api[5662]: 2017-09-28 12:40:27.529 5662 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:40:27 ctl02 nova-api[5662]: 2017-09-28 12:40:27.529 5662 ERROR nova.wsgi     self.filename))
Sep 28 12:40:27 ctl02 nova-api[5662]: 2017-09-28 12:40:27.529 5662 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:40:27 ctl02 nova-api[5662]: 2017-09-28 12:40:27.529 5662 ERROR nova.wsgi
Sep 28 12:40:27 ctl02 nova-api[5662]: 2017-09-28 12:40:27.530 5662 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:40:27 ctl02 nova-api[5662]: 2017-09-28 12:40:27.663 5662 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:40:27 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:40:27.826 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:40:27] "OPTIONS / HTTP/1.0" 200 134 0.000459
Sep 28 12:40:27 ctl02 nova-api[5662]: 2017-09-28 12:40:27.910 5662 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:40:27 ctl02 nova-api[5662]: 2017-09-28 12:40:27.913 5662 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:40:27 ctl02 nova-api[5662]: 2017-09-28 12:40:27.913 5662 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:40:27 ctl02 nova-api[5662]: 2017-09-28 12:40:27.913 5662 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:40:28 ctl02 nova-api[5662]: 2017-09-28 12:40:28.045 5662 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:40:28 ctl02 nova-api[5662]: 2017-09-28 12:40:28.047 5662 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:40:28 ctl02 nova-api[5662]: 2017-09-28 12:40:28.047 5662 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:40:28 ctl02 nova-api[5662]: 2017-09-28 12:40:28.048 5662 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:40:28 ctl02 nova-api[5662]: 2017-09-28 12:40:28.051 5662 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:40:28 ctl02 nova-api[5662]: 2017-09-28 12:40:28.051 5662 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:40:28 ctl02 nova-api[5662]: 2017-09-28 12:40:28.051 5662 ERROR nova Traceback (most recent call last):
Sep 28 12:40:28 ctl02 nova-api[5662]: 2017-09-28 12:40:28.051 5662 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:40:28 ctl02 nova-api[5662]: 2017-09-28 12:40:28.051 5662 ERROR nova     sys.exit(main())
Sep 28 12:40:28 ctl02 nova-api[5662]: 2017-09-28 12:40:28.051 5662 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:40:28 ctl02 nova-api[5662]: 2017-09-28 12:40:28.051 5662 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:40:28 ctl02 nova-api[5662]: 2017-09-28 12:40:28.051 5662 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:40:28 ctl02 nova-api[5662]: 2017-09-28 12:40:28.051 5662 ERROR nova     max_url_len=max_url_len)
Sep 28 12:40:28 ctl02 nova-api[5662]: 2017-09-28 12:40:28.051 5662 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:40:28 ctl02 nova-api[5662]: 2017-09-28 12:40:28.051 5662 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:40:28 ctl02 nova-api[5662]: 2017-09-28 12:40:28.051 5662 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:40:28 ctl02 nova-api[5662]: 2017-09-28 12:40:28.051 5662 ERROR nova     sock.listen(backlog)
Sep 28 12:40:28 ctl02 nova-api[5662]: 2017-09-28 12:40:28.051 5662 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:40:28 ctl02 nova-api[5662]: 2017-09-28 12:40:28.051 5662 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:40:28 ctl02 nova-api[5662]: 2017-09-28 12:40:28.051 5662 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:40:28 ctl02 nova-api[5662]: 2017-09-28 12:40:28.051 5662 ERROR nova
Sep 28 12:40:28 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:40:28 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:40:28 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:40:28 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:40:28 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:40:28 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:40:28 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:40:28 ctl02 neutron-server[30536]: 2017-09-28 12:40:28.496 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:40:28 ctl02 heat-api-cfn[13300]: 2017-09-28 12:40:28.620 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:40:28] "OPTIONS / HTTP/1.0" 200 134 0.000722
Sep 28 12:40:29 ctl02 heat-api[13008]: 2017-09-28 12:40:29.054 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:40:29] "OPTIONS / HTTP/1.0" 200 134 0.001006
Sep 28 12:40:29 ctl02 neutron-server[30536]: 2017-09-28 12:40:29.586 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:40:29] "OPTIONS / HTTP/1.0" 200 262 0.000493
Sep 28 12:40:29 ctl02 heat-api-cfn[13300]: 2017-09-28 12:40:29.833 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:40:29] "OPTIONS / HTTP/1.0" 200 134 0.000597
Sep 28 12:40:30 ctl02 nova-api[5679]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:40:30 ctl02 nova-api[5679]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:40:30 ctl02 neutron-server[30536]: 2017-09-28 12:40:30.113 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:40:30] "OPTIONS / HTTP/1.0" 200 262 0.000467
Sep 28 12:40:30 ctl02 nova-api[5679]: 2017-09-28 12:40:30.259 5679 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:40:30 ctl02 nova-api[5679]: 2017-09-28 12:40:30.260 5679 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:40:30 ctl02 nova-api[5679]: 2017-09-28 12:40:30.260 5679 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:40:30 ctl02 nova-api[5679]: 2017-09-28 12:40:30.260 5679 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:40:30 ctl02 nova-api[5679]: 2017-09-28 12:40:30.260 5679 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:40:30 ctl02 nova-api[5679]: 2017-09-28 12:40:30.260 5679 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:40:30 ctl02 nova-api[5679]: 2017-09-28 12:40:30.260 5679 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:40:30 ctl02 nova-api[5679]: 2017-09-28 12:40:30.260 5679 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:40:30 ctl02 nova-api[5679]: 2017-09-28 12:40:30.260 5679 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:40:30 ctl02 nova-api[5679]: 2017-09-28 12:40:30.260 5679 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:40:30 ctl02 nova-api[5679]: 2017-09-28 12:40:30.260 5679 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:40:30 ctl02 nova-api[5679]: 2017-09-28 12:40:30.260 5679 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:40:30 ctl02 nova-api[5679]: 2017-09-28 12:40:30.260 5679 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:40:30 ctl02 nova-api[5679]: 2017-09-28 12:40:30.260 5679 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:40:30 ctl02 nova-api[5679]: 2017-09-28 12:40:30.260 5679 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:40:30 ctl02 nova-api[5679]: 2017-09-28 12:40:30.260 5679 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:40:30 ctl02 nova-api[5679]: 2017-09-28 12:40:30.260 5679 ERROR nova.wsgi     self.filename))
Sep 28 12:40:30 ctl02 nova-api[5679]: 2017-09-28 12:40:30.260 5679 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:40:30 ctl02 nova-api[5679]: 2017-09-28 12:40:30.260 5679 ERROR nova.wsgi
Sep 28 12:40:30 ctl02 nova-api[5679]: 2017-09-28 12:40:30.261 5679 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:40:30 ctl02 nova-api[5679]: 2017-09-28 12:40:30.391 5679 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:40:30 ctl02 nova-api[5679]: 2017-09-28 12:40:30.625 5679 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:40:30 ctl02 nova-api[5679]: 2017-09-28 12:40:30.627 5679 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:40:30 ctl02 nova-api[5679]: 2017-09-28 12:40:30.628 5679 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:40:30 ctl02 nova-api[5679]: 2017-09-28 12:40:30.628 5679 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:40:30 ctl02 nova-api[5679]: 2017-09-28 12:40:30.759 5679 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:40:30 ctl02 nova-api[5679]: 2017-09-28 12:40:30.761 5679 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:40:30 ctl02 nova-api[5679]: 2017-09-28 12:40:30.761 5679 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:40:30 ctl02 nova-api[5679]: 2017-09-28 12:40:30.762 5679 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:40:30 ctl02 nova-api[5679]: 2017-09-28 12:40:30.765 5679 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:40:30 ctl02 nova-api[5679]: 2017-09-28 12:40:30.765 5679 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:40:30 ctl02 nova-api[5679]: 2017-09-28 12:40:30.765 5679 ERROR nova Traceback (most recent call last):
Sep 28 12:40:30 ctl02 nova-api[5679]: 2017-09-28 12:40:30.765 5679 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:40:30 ctl02 nova-api[5679]: 2017-09-28 12:40:30.765 5679 ERROR nova     sys.exit(main())
Sep 28 12:40:30 ctl02 nova-api[5679]: 2017-09-28 12:40:30.765 5679 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:40:30 ctl02 nova-api[5679]: 2017-09-28 12:40:30.765 5679 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:40:30 ctl02 nova-api[5679]: 2017-09-28 12:40:30.765 5679 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:40:30 ctl02 nova-api[5679]: 2017-09-28 12:40:30.765 5679 ERROR nova     max_url_len=max_url_len)
Sep 28 12:40:30 ctl02 nova-api[5679]: 2017-09-28 12:40:30.765 5679 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:40:30 ctl02 nova-api[5679]: 2017-09-28 12:40:30.765 5679 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:40:30 ctl02 nova-api[5679]: 2017-09-28 12:40:30.765 5679 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:40:30 ctl02 nova-api[5679]: 2017-09-28 12:40:30.765 5679 ERROR nova     sock.listen(backlog)
Sep 28 12:40:30 ctl02 nova-api[5679]: 2017-09-28 12:40:30.765 5679 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:40:30 ctl02 nova-api[5679]: 2017-09-28 12:40:30.765 5679 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:40:30 ctl02 nova-api[5679]: 2017-09-28 12:40:30.765 5679 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:40:30 ctl02 nova-api[5679]: 2017-09-28 12:40:30.765 5679 ERROR nova
Sep 28 12:40:30 ctl02 glance-api[29183]: 2017-09-28 12:40:30.807 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:40:30] "OPTIONS / HTTP/1.0" 200 134 0.000797
Sep 28 12:40:30 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:40:30 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:40:30 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:40:31 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:40:31 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:40:31 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:40:31 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:40:31 ctl02 neutron-server[30536]: 2017-09-28 12:40:31.172 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:40:31] "OPTIONS / HTTP/1.0" 200 262 0.000491
Sep 28 12:40:31 ctl02 glance-api[29183]: 2017-09-28 12:40:31.391 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:40:31] "OPTIONS / HTTP/1.0" 200 134 0.000568
Sep 28 12:40:31 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x58d4b06a)
Sep 28 12:40:32 ctl02 glance-api[29183]: 2017-09-28 12:40:32.589 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:40:32] "OPTIONS / HTTP/1.0" 200 134 0.000635
Sep 28 12:40:32 ctl02 heat-api-cfn[13300]: 2017-09-28 12:40:32.680 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:40:32] "OPTIONS / HTTP/1.0" 200 134 0.000479
Sep 28 12:40:32 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:40:32.681 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:40:32] "OPTIONS / HTTP/1.0" 200 134 0.000587
Sep 28 12:40:32 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x58d4b06a)
Sep 28 12:40:32 ctl02 nova-api[5698]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:40:32 ctl02 nova-api[5698]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:40:33 ctl02 nova-api[5698]: 2017-09-28 12:40:33.022 5698 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:40:33 ctl02 nova-api[5698]: 2017-09-28 12:40:33.023 5698 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:40:33 ctl02 nova-api[5698]: 2017-09-28 12:40:33.023 5698 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:40:33 ctl02 nova-api[5698]: 2017-09-28 12:40:33.023 5698 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:40:33 ctl02 nova-api[5698]: 2017-09-28 12:40:33.023 5698 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:40:33 ctl02 nova-api[5698]: 2017-09-28 12:40:33.023 5698 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:40:33 ctl02 nova-api[5698]: 2017-09-28 12:40:33.023 5698 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:40:33 ctl02 nova-api[5698]: 2017-09-28 12:40:33.023 5698 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:40:33 ctl02 nova-api[5698]: 2017-09-28 12:40:33.023 5698 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:40:33 ctl02 nova-api[5698]: 2017-09-28 12:40:33.023 5698 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:40:33 ctl02 nova-api[5698]: 2017-09-28 12:40:33.023 5698 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:40:33 ctl02 nova-api[5698]: 2017-09-28 12:40:33.023 5698 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:40:33 ctl02 nova-api[5698]: 2017-09-28 12:40:33.023 5698 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:40:33 ctl02 nova-api[5698]: 2017-09-28 12:40:33.023 5698 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:40:33 ctl02 nova-api[5698]: 2017-09-28 12:40:33.023 5698 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:40:33 ctl02 nova-api[5698]: 2017-09-28 12:40:33.023 5698 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:40:33 ctl02 nova-api[5698]: 2017-09-28 12:40:33.023 5698 ERROR nova.wsgi     self.filename))
Sep 28 12:40:33 ctl02 nova-api[5698]: 2017-09-28 12:40:33.023 5698 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:40:33 ctl02 nova-api[5698]: 2017-09-28 12:40:33.023 5698 ERROR nova.wsgi
Sep 28 12:40:33 ctl02 nova-api[5698]: 2017-09-28 12:40:33.025 5698 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:40:33 ctl02 nova-api[5698]: 2017-09-28 12:40:33.162 5698 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:40:33 ctl02 nova-api[5698]: 2017-09-28 12:40:33.415 5698 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:40:33 ctl02 nova-api[5698]: 2017-09-28 12:40:33.418 5698 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:40:33 ctl02 nova-api[5698]: 2017-09-28 12:40:33.418 5698 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:40:33 ctl02 nova-api[5698]: 2017-09-28 12:40:33.419 5698 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:40:33 ctl02 nova-api[5698]: 2017-09-28 12:40:33.554 5698 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:40:33 ctl02 nova-api[5698]: 2017-09-28 12:40:33.556 5698 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:40:33 ctl02 nova-api[5698]: 2017-09-28 12:40:33.557 5698 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:40:33 ctl02 nova-api[5698]: 2017-09-28 12:40:33.557 5698 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:40:33 ctl02 nova-api[5698]: 2017-09-28 12:40:33.560 5698 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:40:33 ctl02 nova-api[5698]: 2017-09-28 12:40:33.561 5698 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:40:33 ctl02 nova-api[5698]: 2017-09-28 12:40:33.561 5698 ERROR nova Traceback (most recent call last):
Sep 28 12:40:33 ctl02 nova-api[5698]: 2017-09-28 12:40:33.561 5698 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:40:33 ctl02 nova-api[5698]: 2017-09-28 12:40:33.561 5698 ERROR nova     sys.exit(main())
Sep 28 12:40:33 ctl02 nova-api[5698]: 2017-09-28 12:40:33.561 5698 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:40:33 ctl02 nova-api[5698]: 2017-09-28 12:40:33.561 5698 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:40:33 ctl02 nova-api[5698]: 2017-09-28 12:40:33.561 5698 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:40:33 ctl02 nova-api[5698]: 2017-09-28 12:40:33.561 5698 ERROR nova     max_url_len=max_url_len)
Sep 28 12:40:33 ctl02 nova-api[5698]: 2017-09-28 12:40:33.561 5698 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:40:33 ctl02 nova-api[5698]: 2017-09-28 12:40:33.561 5698 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:40:33 ctl02 nova-api[5698]: 2017-09-28 12:40:33.561 5698 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:40:33 ctl02 nova-api[5698]: 2017-09-28 12:40:33.561 5698 ERROR nova     sock.listen(backlog)
Sep 28 12:40:33 ctl02 nova-api[5698]: 2017-09-28 12:40:33.561 5698 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:40:33 ctl02 nova-api[5698]: 2017-09-28 12:40:33.561 5698 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:40:33 ctl02 nova-api[5698]: 2017-09-28 12:40:33.561 5698 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:40:33 ctl02 nova-api[5698]: 2017-09-28 12:40:33.561 5698 ERROR nova
Sep 28 12:40:33 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:40:33 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:40:33 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:40:33 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x58d4b06a)
Sep 28 12:40:33 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:40:33 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:40:33 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:40:33 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:40:34 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x58d4b06a)
Sep 28 12:40:35 ctl02 heat-api[13008]: 2017-09-28 12:40:35.549 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:40:35] "OPTIONS / HTTP/1.0" 200 134 0.000627
Sep 28 12:40:35 ctl02 nova-api[5716]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:40:35 ctl02 nova-api[5716]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:40:35 ctl02 nova-api[5716]: 2017-09-28 12:40:35.780 5716 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:40:35 ctl02 nova-api[5716]: 2017-09-28 12:40:35.781 5716 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:40:35 ctl02 nova-api[5716]: 2017-09-28 12:40:35.781 5716 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:40:35 ctl02 nova-api[5716]: 2017-09-28 12:40:35.781 5716 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:40:35 ctl02 nova-api[5716]: 2017-09-28 12:40:35.781 5716 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:40:35 ctl02 nova-api[5716]: 2017-09-28 12:40:35.781 5716 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:40:35 ctl02 nova-api[5716]: 2017-09-28 12:40:35.781 5716 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:40:35 ctl02 nova-api[5716]: 2017-09-28 12:40:35.781 5716 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:40:35 ctl02 nova-api[5716]: 2017-09-28 12:40:35.781 5716 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:40:35 ctl02 nova-api[5716]: 2017-09-28 12:40:35.781 5716 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:40:35 ctl02 nova-api[5716]: 2017-09-28 12:40:35.781 5716 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:40:35 ctl02 nova-api[5716]: 2017-09-28 12:40:35.781 5716 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:40:35 ctl02 nova-api[5716]: 2017-09-28 12:40:35.781 5716 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:40:35 ctl02 nova-api[5716]: 2017-09-28 12:40:35.781 5716 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:40:35 ctl02 nova-api[5716]: 2017-09-28 12:40:35.781 5716 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:40:35 ctl02 nova-api[5716]: 2017-09-28 12:40:35.781 5716 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:40:35 ctl02 nova-api[5716]: 2017-09-28 12:40:35.781 5716 ERROR nova.wsgi     self.filename))
Sep 28 12:40:35 ctl02 nova-api[5716]: 2017-09-28 12:40:35.781 5716 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:40:35 ctl02 nova-api[5716]: 2017-09-28 12:40:35.781 5716 ERROR nova.wsgi
Sep 28 12:40:35 ctl02 nova-api[5716]: 2017-09-28 12:40:35.782 5716 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:40:35 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x58d4b06a)
Sep 28 12:40:35 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:40:35.833 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:40:35] "OPTIONS / HTTP/1.0" 200 134 0.000426
Sep 28 12:40:35 ctl02 nova-api[5716]: 2017-09-28 12:40:35.918 5716 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:40:36 ctl02 nova-api[5716]: 2017-09-28 12:40:36.167 5716 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:40:36 ctl02 nova-api[5716]: 2017-09-28 12:40:36.170 5716 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:40:36 ctl02 nova-api[5716]: 2017-09-28 12:40:36.170 5716 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:40:36 ctl02 nova-api[5716]: 2017-09-28 12:40:36.170 5716 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:40:36 ctl02 nova-api[5716]: 2017-09-28 12:40:36.305 5716 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:40:36 ctl02 nova-api[5716]: 2017-09-28 12:40:36.307 5716 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:40:36 ctl02 nova-api[5716]: 2017-09-28 12:40:36.307 5716 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:40:36 ctl02 nova-api[5716]: 2017-09-28 12:40:36.308 5716 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:40:36 ctl02 neutron-server[30536]: 2017-09-28 12:40:36.310 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 4 dead agents out of 6:
Sep 28 12:40:36 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:40:36 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:38:56 cmp002
Sep 28 12:40:36 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:38:58 cmp001
Sep 28 12:40:36 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:39:10 cmp002
Sep 28 12:40:36 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:39:06 cmp002
Sep 28 12:40:36 ctl02 nova-api[5716]: 2017-09-28 12:40:36.311 5716 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:40:36 ctl02 nova-api[5716]: 2017-09-28 12:40:36.312 5716 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:40:36 ctl02 nova-api[5716]: 2017-09-28 12:40:36.312 5716 ERROR nova Traceback (most recent call last):
Sep 28 12:40:36 ctl02 nova-api[5716]: 2017-09-28 12:40:36.312 5716 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:40:36 ctl02 nova-api[5716]: 2017-09-28 12:40:36.312 5716 ERROR nova     sys.exit(main())
Sep 28 12:40:36 ctl02 nova-api[5716]: 2017-09-28 12:40:36.312 5716 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:40:36 ctl02 nova-api[5716]: 2017-09-28 12:40:36.312 5716 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:40:36 ctl02 nova-api[5716]: 2017-09-28 12:40:36.312 5716 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:40:36 ctl02 nova-api[5716]: 2017-09-28 12:40:36.312 5716 ERROR nova     max_url_len=max_url_len)
Sep 28 12:40:36 ctl02 nova-api[5716]: 2017-09-28 12:40:36.312 5716 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:40:36 ctl02 nova-api[5716]: 2017-09-28 12:40:36.312 5716 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:40:36 ctl02 nova-api[5716]: 2017-09-28 12:40:36.312 5716 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:40:36 ctl02 nova-api[5716]: 2017-09-28 12:40:36.312 5716 ERROR nova     sock.listen(backlog)
Sep 28 12:40:36 ctl02 nova-api[5716]: 2017-09-28 12:40:36.312 5716 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:40:36 ctl02 nova-api[5716]: 2017-09-28 12:40:36.312 5716 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:40:36 ctl02 nova-api[5716]: 2017-09-28 12:40:36.312 5716 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:40:36 ctl02 nova-api[5716]: 2017-09-28 12:40:36.312 5716 ERROR nova
Sep 28 12:40:36 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:40:36 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:40:36 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:40:36 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:40:36 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:40:36 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:40:36 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:40:36 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x58d4b06a)
Sep 28 12:40:37 ctl02 heat-api[13008]: 2017-09-28 12:40:37.433 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:40:37] "OPTIONS / HTTP/1.0" 200 134 0.000623
Sep 28 12:40:37 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x58d4b06a)
Sep 28 12:40:38 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:40:38.078 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:40:38] "OPTIONS / HTTP/1.0" 200 134 0.000465
Sep 28 12:40:38 ctl02 heat-api-cfn[13300]: 2017-09-28 12:40:38.318 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:40:38] "OPTIONS / HTTP/1.0" 200 134 0.000508
Sep 28 12:40:38 ctl02 nova-api[5734]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:40:38 ctl02 nova-api[5734]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:40:38 ctl02 nova-cert[4860]: 2017-09-28 12:40:38.466 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:40:38 ctl02 nova-api[5734]: 2017-09-28 12:40:38.545 5734 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:40:38 ctl02 nova-api[5734]: 2017-09-28 12:40:38.546 5734 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:40:38 ctl02 nova-api[5734]: 2017-09-28 12:40:38.546 5734 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:40:38 ctl02 nova-api[5734]: 2017-09-28 12:40:38.546 5734 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:40:38 ctl02 nova-api[5734]: 2017-09-28 12:40:38.546 5734 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:40:38 ctl02 nova-api[5734]: 2017-09-28 12:40:38.546 5734 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:40:38 ctl02 nova-api[5734]: 2017-09-28 12:40:38.546 5734 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:40:38 ctl02 nova-api[5734]: 2017-09-28 12:40:38.546 5734 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:40:38 ctl02 nova-api[5734]: 2017-09-28 12:40:38.546 5734 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:40:38 ctl02 nova-api[5734]: 2017-09-28 12:40:38.546 5734 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:40:38 ctl02 nova-api[5734]: 2017-09-28 12:40:38.546 5734 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:40:38 ctl02 nova-api[5734]: 2017-09-28 12:40:38.546 5734 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:40:38 ctl02 nova-api[5734]: 2017-09-28 12:40:38.546 5734 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:40:38 ctl02 nova-api[5734]: 2017-09-28 12:40:38.546 5734 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:40:38 ctl02 nova-api[5734]: 2017-09-28 12:40:38.546 5734 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:40:38 ctl02 nova-api[5734]: 2017-09-28 12:40:38.546 5734 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:40:38 ctl02 nova-api[5734]: 2017-09-28 12:40:38.546 5734 ERROR nova.wsgi     self.filename))
Sep 28 12:40:38 ctl02 nova-api[5734]: 2017-09-28 12:40:38.546 5734 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:40:38 ctl02 nova-api[5734]: 2017-09-28 12:40:38.546 5734 ERROR nova.wsgi
Sep 28 12:40:38 ctl02 nova-api[5734]: 2017-09-28 12:40:38.547 5734 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:40:38 ctl02 nova-api[5734]: 2017-09-28 12:40:38.681 5734 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:40:38 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x58d4b06a)
Sep 28 12:40:38 ctl02 nova-conductor[5056]: 2017-09-28 12:40:38.907 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:40:38 ctl02 nova-api[5734]: 2017-09-28 12:40:38.928 5734 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:40:38 ctl02 nova-conductor[5056]: 2017-09-28 12:40:38.930 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:40:38 ctl02 nova-api[5734]: 2017-09-28 12:40:38.931 5734 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:40:38 ctl02 nova-api[5734]: 2017-09-28 12:40:38.932 5734 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:40:38 ctl02 nova-api[5734]: 2017-09-28 12:40:38.932 5734 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:40:38 ctl02 heat-api[13008]: 2017-09-28 12:40:38.932 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:40:38] "OPTIONS / HTTP/1.0" 200 134 0.000614
Sep 28 12:40:38 ctl02 nova-conductor[5056]: 2017-09-28 12:40:38.938 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:40:38 ctl02 nova-conductor[5056]: 2017-09-28 12:40:38.943 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:40:39 ctl02 nova-api[5734]: 2017-09-28 12:40:39.065 5734 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:40:39 ctl02 nova-api[5734]: 2017-09-28 12:40:39.067 5734 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:40:39 ctl02 nova-api[5734]: 2017-09-28 12:40:39.067 5734 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:40:39 ctl02 nova-api[5734]: 2017-09-28 12:40:39.068 5734 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:40:39 ctl02 nova-api[5734]: 2017-09-28 12:40:39.071 5734 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:40:39 ctl02 nova-api[5734]: 2017-09-28 12:40:39.071 5734 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:40:39 ctl02 nova-api[5734]: 2017-09-28 12:40:39.071 5734 ERROR nova Traceback (most recent call last):
Sep 28 12:40:39 ctl02 nova-api[5734]: 2017-09-28 12:40:39.071 5734 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:40:39 ctl02 nova-api[5734]: 2017-09-28 12:40:39.071 5734 ERROR nova     sys.exit(main())
Sep 28 12:40:39 ctl02 nova-api[5734]: 2017-09-28 12:40:39.071 5734 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:40:39 ctl02 nova-api[5734]: 2017-09-28 12:40:39.071 5734 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:40:39 ctl02 nova-api[5734]: 2017-09-28 12:40:39.071 5734 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:40:39 ctl02 nova-api[5734]: 2017-09-28 12:40:39.071 5734 ERROR nova     max_url_len=max_url_len)
Sep 28 12:40:39 ctl02 nova-api[5734]: 2017-09-28 12:40:39.071 5734 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:40:39 ctl02 nova-api[5734]: 2017-09-28 12:40:39.071 5734 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:40:39 ctl02 nova-api[5734]: 2017-09-28 12:40:39.071 5734 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:40:39 ctl02 nova-api[5734]: 2017-09-28 12:40:39.071 5734 ERROR nova     sock.listen(backlog)
Sep 28 12:40:39 ctl02 nova-api[5734]: 2017-09-28 12:40:39.071 5734 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:40:39 ctl02 nova-api[5734]: 2017-09-28 12:40:39.071 5734 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:40:39 ctl02 nova-api[5734]: 2017-09-28 12:40:39.071 5734 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:40:39 ctl02 nova-api[5734]: 2017-09-28 12:40:39.071 5734 ERROR nova
Sep 28 12:40:39 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:40:39 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:40:39 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:40:39 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:40:39 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:40:39 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:40:39 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:40:39 ctl02 heat-api-cfn[13300]: 2017-09-28 12:40:39.715 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:40:39] "OPTIONS / HTTP/1.0" 200 134 0.000431
Sep 28 12:40:39 ctl02 neutron-server[30536]: 2017-09-28 12:40:39.797 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:40:39] "OPTIONS / HTTP/1.0" 200 262 0.000425
Sep 28 12:40:39 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x58d4b06a)
Sep 28 12:40:39 ctl02 neutron-server[30536]: 2017-09-28 12:40:39.965 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:40:39] "OPTIONS / HTTP/1.0" 200 262 0.000451
Sep 28 12:40:40 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x58d4b06a)
Sep 28 12:40:40 ctl02 neutron-server[30536]: 2017-09-28 12:40:40.887 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:40:40] "OPTIONS / HTTP/1.0" 200 262 0.000440
Sep 28 12:40:41 ctl02 nova-api[5751]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:40:41 ctl02 nova-api[5751]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:40:41 ctl02 glance-api[29183]: 2017-09-28 12:40:41.141 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:40:41] "OPTIONS / HTTP/1.0" 200 134 0.000585
Sep 28 12:40:41 ctl02 nova-api[5751]: 2017-09-28 12:40:41.263 5751 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:40:41 ctl02 nova-api[5751]: 2017-09-28 12:40:41.264 5751 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:40:41 ctl02 nova-api[5751]: 2017-09-28 12:40:41.264 5751 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:40:41 ctl02 nova-api[5751]: 2017-09-28 12:40:41.264 5751 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:40:41 ctl02 nova-api[5751]: 2017-09-28 12:40:41.264 5751 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:40:41 ctl02 nova-api[5751]: 2017-09-28 12:40:41.264 5751 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:40:41 ctl02 nova-api[5751]: 2017-09-28 12:40:41.264 5751 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:40:41 ctl02 nova-api[5751]: 2017-09-28 12:40:41.264 5751 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:40:41 ctl02 nova-api[5751]: 2017-09-28 12:40:41.264 5751 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:40:41 ctl02 nova-api[5751]: 2017-09-28 12:40:41.264 5751 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:40:41 ctl02 nova-api[5751]: 2017-09-28 12:40:41.264 5751 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:40:41 ctl02 nova-api[5751]: 2017-09-28 12:40:41.264 5751 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:40:41 ctl02 nova-api[5751]: 2017-09-28 12:40:41.264 5751 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:40:41 ctl02 nova-api[5751]: 2017-09-28 12:40:41.264 5751 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:40:41 ctl02 nova-api[5751]: 2017-09-28 12:40:41.264 5751 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:40:41 ctl02 nova-api[5751]: 2017-09-28 12:40:41.264 5751 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:40:41 ctl02 nova-api[5751]: 2017-09-28 12:40:41.264 5751 ERROR nova.wsgi     self.filename))
Sep 28 12:40:41 ctl02 nova-api[5751]: 2017-09-28 12:40:41.264 5751 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:40:41 ctl02 nova-api[5751]: 2017-09-28 12:40:41.264 5751 ERROR nova.wsgi
Sep 28 12:40:41 ctl02 nova-api[5751]: 2017-09-28 12:40:41.267 5751 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:40:41 ctl02 nova-api[5751]: 2017-09-28 12:40:41.395 5751 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:40:41 ctl02 glance-api[29183]: 2017-09-28 12:40:41.581 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:40:41] "OPTIONS / HTTP/1.0" 200 134 0.000585
Sep 28 12:40:41 ctl02 nova-api[5751]: 2017-09-28 12:40:41.625 5751 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:40:41 ctl02 nova-api[5751]: 2017-09-28 12:40:41.627 5751 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:40:41 ctl02 nova-api[5751]: 2017-09-28 12:40:41.628 5751 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:40:41 ctl02 nova-api[5751]: 2017-09-28 12:40:41.628 5751 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:40:41 ctl02 nova-api[5751]: 2017-09-28 12:40:41.759 5751 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:40:41 ctl02 nova-api[5751]: 2017-09-28 12:40:41.762 5751 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:40:41 ctl02 nova-api[5751]: 2017-09-28 12:40:41.762 5751 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:40:41 ctl02 nova-api[5751]: 2017-09-28 12:40:41.763 5751 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:40:41 ctl02 nova-api[5751]: 2017-09-28 12:40:41.766 5751 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:40:41 ctl02 nova-api[5751]: 2017-09-28 12:40:41.766 5751 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:40:41 ctl02 nova-api[5751]: 2017-09-28 12:40:41.766 5751 ERROR nova Traceback (most recent call last):
Sep 28 12:40:41 ctl02 nova-api[5751]: 2017-09-28 12:40:41.766 5751 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:40:41 ctl02 nova-api[5751]: 2017-09-28 12:40:41.766 5751 ERROR nova     sys.exit(main())
Sep 28 12:40:41 ctl02 nova-api[5751]: 2017-09-28 12:40:41.766 5751 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:40:41 ctl02 nova-api[5751]: 2017-09-28 12:40:41.766 5751 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:40:41 ctl02 nova-api[5751]: 2017-09-28 12:40:41.766 5751 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:40:41 ctl02 nova-api[5751]: 2017-09-28 12:40:41.766 5751 ERROR nova     max_url_len=max_url_len)
Sep 28 12:40:41 ctl02 nova-api[5751]: 2017-09-28 12:40:41.766 5751 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:40:41 ctl02 nova-api[5751]: 2017-09-28 12:40:41.766 5751 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:40:41 ctl02 nova-api[5751]: 2017-09-28 12:40:41.766 5751 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:40:41 ctl02 nova-api[5751]: 2017-09-28 12:40:41.766 5751 ERROR nova     sock.listen(backlog)
Sep 28 12:40:41 ctl02 nova-api[5751]: 2017-09-28 12:40:41.766 5751 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:40:41 ctl02 nova-api[5751]: 2017-09-28 12:40:41.766 5751 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:40:41 ctl02 nova-api[5751]: 2017-09-28 12:40:41.766 5751 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:40:41 ctl02 nova-api[5751]: 2017-09-28 12:40:41.766 5751 ERROR nova
Sep 28 12:40:41 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x58d4b06a)
Sep 28 12:40:41 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:40:41 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:40:41 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:40:42 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:40:42 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:40:42 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:40:42 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:40:42 ctl02 glance-api[29183]: 2017-09-28 12:40:42.438 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:40:42] "OPTIONS / HTTP/1.0" 200 134 0.001009
Sep 28 12:40:42 ctl02 heat-api-cfn[13300]: 2017-09-28 12:40:42.561 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:40:42] "OPTIONS / HTTP/1.0" 200 134 0.000695
Sep 28 12:40:42 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:40:42 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:40:43 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:40:43.021 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:40:43] "OPTIONS / HTTP/1.0" 200 134 0.000626
Sep 28 12:40:43 ctl02 neutron-server[30536]: 2017-09-28 12:40:43.494 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:40:43 ctl02 nova-api[5770]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:40:43 ctl02 nova-api[5770]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:40:44 ctl02 nova-api[5770]: 2017-09-28 12:40:44.046 5770 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:40:44 ctl02 nova-api[5770]: 2017-09-28 12:40:44.047 5770 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:40:44 ctl02 nova-api[5770]: 2017-09-28 12:40:44.047 5770 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:40:44 ctl02 nova-api[5770]: 2017-09-28 12:40:44.047 5770 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:40:44 ctl02 nova-api[5770]: 2017-09-28 12:40:44.047 5770 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:40:44 ctl02 nova-api[5770]: 2017-09-28 12:40:44.047 5770 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:40:44 ctl02 nova-api[5770]: 2017-09-28 12:40:44.047 5770 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:40:44 ctl02 nova-api[5770]: 2017-09-28 12:40:44.047 5770 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:40:44 ctl02 nova-api[5770]: 2017-09-28 12:40:44.047 5770 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:40:44 ctl02 nova-api[5770]: 2017-09-28 12:40:44.047 5770 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:40:44 ctl02 nova-api[5770]: 2017-09-28 12:40:44.047 5770 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:40:44 ctl02 nova-api[5770]: 2017-09-28 12:40:44.047 5770 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:40:44 ctl02 nova-api[5770]: 2017-09-28 12:40:44.047 5770 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:40:44 ctl02 nova-api[5770]: 2017-09-28 12:40:44.047 5770 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:40:44 ctl02 nova-api[5770]: 2017-09-28 12:40:44.047 5770 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:40:44 ctl02 nova-api[5770]: 2017-09-28 12:40:44.047 5770 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:40:44 ctl02 nova-api[5770]: 2017-09-28 12:40:44.047 5770 ERROR nova.wsgi     self.filename))
Sep 28 12:40:44 ctl02 nova-api[5770]: 2017-09-28 12:40:44.047 5770 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:40:44 ctl02 nova-api[5770]: 2017-09-28 12:40:44.047 5770 ERROR nova.wsgi
Sep 28 12:40:44 ctl02 nova-api[5770]: 2017-09-28 12:40:44.048 5770 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:40:44 ctl02 nova-api[5770]: 2017-09-28 12:40:44.184 5770 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:40:44 ctl02 nova-api[5770]: 2017-09-28 12:40:44.440 5770 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:40:44 ctl02 nova-api[5770]: 2017-09-28 12:40:44.443 5770 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:40:44 ctl02 nova-api[5770]: 2017-09-28 12:40:44.443 5770 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:40:44 ctl02 nova-api[5770]: 2017-09-28 12:40:44.443 5770 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:40:44 ctl02 nova-api[5770]: 2017-09-28 12:40:44.581 5770 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:40:44 ctl02 nova-api[5770]: 2017-09-28 12:40:44.583 5770 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:40:44 ctl02 nova-api[5770]: 2017-09-28 12:40:44.583 5770 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:40:44 ctl02 nova-api[5770]: 2017-09-28 12:40:44.584 5770 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:40:44 ctl02 nova-api[5770]: 2017-09-28 12:40:44.587 5770 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:40:44 ctl02 nova-api[5770]: 2017-09-28 12:40:44.588 5770 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:40:44 ctl02 nova-api[5770]: 2017-09-28 12:40:44.588 5770 ERROR nova Traceback (most recent call last):
Sep 28 12:40:44 ctl02 nova-api[5770]: 2017-09-28 12:40:44.588 5770 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:40:44 ctl02 nova-api[5770]: 2017-09-28 12:40:44.588 5770 ERROR nova     sys.exit(main())
Sep 28 12:40:44 ctl02 nova-api[5770]: 2017-09-28 12:40:44.588 5770 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:40:44 ctl02 nova-api[5770]: 2017-09-28 12:40:44.588 5770 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:40:44 ctl02 nova-api[5770]: 2017-09-28 12:40:44.588 5770 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:40:44 ctl02 nova-api[5770]: 2017-09-28 12:40:44.588 5770 ERROR nova     max_url_len=max_url_len)
Sep 28 12:40:44 ctl02 nova-api[5770]: 2017-09-28 12:40:44.588 5770 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:40:44 ctl02 nova-api[5770]: 2017-09-28 12:40:44.588 5770 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:40:44 ctl02 nova-api[5770]: 2017-09-28 12:40:44.588 5770 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:40:44 ctl02 nova-api[5770]: 2017-09-28 12:40:44.588 5770 ERROR nova     sock.listen(backlog)
Sep 28 12:40:44 ctl02 nova-api[5770]: 2017-09-28 12:40:44.588 5770 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:40:44 ctl02 nova-api[5770]: 2017-09-28 12:40:44.588 5770 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:40:44 ctl02 nova-api[5770]: 2017-09-28 12:40:44.588 5770 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:40:44 ctl02 nova-api[5770]: 2017-09-28 12:40:44.588 5770 ERROR nova
Sep 28 12:40:44 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:40:44 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:40:44 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:40:44 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:40:44 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:40:44 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:40:44 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:40:45 ctl02 heat-api[13008]: 2017-09-28 12:40:45.512 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:40:45] "OPTIONS / HTTP/1.0" 200 134 0.000981
Sep 28 12:40:45 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:40:45.889 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:40:45] "OPTIONS / HTTP/1.0" 200 134 0.000625
Sep 28 12:40:46 ctl02 nova-api[5792]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:40:46 ctl02 nova-api[5792]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:40:46 ctl02 nova-api[5792]: 2017-09-28 12:40:46.775 5792 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:40:46 ctl02 nova-api[5792]: 2017-09-28 12:40:46.776 5792 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:40:46 ctl02 nova-api[5792]: 2017-09-28 12:40:46.776 5792 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:40:46 ctl02 nova-api[5792]: 2017-09-28 12:40:46.776 5792 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:40:46 ctl02 nova-api[5792]: 2017-09-28 12:40:46.776 5792 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:40:46 ctl02 nova-api[5792]: 2017-09-28 12:40:46.776 5792 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:40:46 ctl02 nova-api[5792]: 2017-09-28 12:40:46.776 5792 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:40:46 ctl02 nova-api[5792]: 2017-09-28 12:40:46.776 5792 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:40:46 ctl02 nova-api[5792]: 2017-09-28 12:40:46.776 5792 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:40:46 ctl02 nova-api[5792]: 2017-09-28 12:40:46.776 5792 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:40:46 ctl02 nova-api[5792]: 2017-09-28 12:40:46.776 5792 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:40:46 ctl02 nova-api[5792]: 2017-09-28 12:40:46.776 5792 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:40:46 ctl02 nova-api[5792]: 2017-09-28 12:40:46.776 5792 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:40:46 ctl02 nova-api[5792]: 2017-09-28 12:40:46.776 5792 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:40:46 ctl02 nova-api[5792]: 2017-09-28 12:40:46.776 5792 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:40:46 ctl02 nova-api[5792]: 2017-09-28 12:40:46.776 5792 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:40:46 ctl02 nova-api[5792]: 2017-09-28 12:40:46.776 5792 ERROR nova.wsgi     self.filename))
Sep 28 12:40:46 ctl02 nova-api[5792]: 2017-09-28 12:40:46.776 5792 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:40:46 ctl02 nova-api[5792]: 2017-09-28 12:40:46.776 5792 ERROR nova.wsgi
Sep 28 12:40:46 ctl02 nova-api[5792]: 2017-09-28 12:40:46.777 5792 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:40:46 ctl02 nova-api[5792]: 2017-09-28 12:40:46.915 5792 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:40:47 ctl02 nova-api[5792]: 2017-09-28 12:40:47.162 5792 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:40:47 ctl02 nova-api[5792]: 2017-09-28 12:40:47.164 5792 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:40:47 ctl02 nova-api[5792]: 2017-09-28 12:40:47.164 5792 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:40:47 ctl02 nova-api[5792]: 2017-09-28 12:40:47.165 5792 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:40:47 ctl02 nova-api[5792]: 2017-09-28 12:40:47.299 5792 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:40:47 ctl02 nova-api[5792]: 2017-09-28 12:40:47.302 5792 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:40:47 ctl02 nova-api[5792]: 2017-09-28 12:40:47.302 5792 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:40:47 ctl02 nova-api[5792]: 2017-09-28 12:40:47.302 5792 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:40:47 ctl02 nova-api[5792]: 2017-09-28 12:40:47.305 5792 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:40:47 ctl02 nova-api[5792]: 2017-09-28 12:40:47.306 5792 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:40:47 ctl02 nova-api[5792]: 2017-09-28 12:40:47.306 5792 ERROR nova Traceback (most recent call last):
Sep 28 12:40:47 ctl02 nova-api[5792]: 2017-09-28 12:40:47.306 5792 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:40:47 ctl02 nova-api[5792]: 2017-09-28 12:40:47.306 5792 ERROR nova     sys.exit(main())
Sep 28 12:40:47 ctl02 nova-api[5792]: 2017-09-28 12:40:47.306 5792 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:40:47 ctl02 nova-api[5792]: 2017-09-28 12:40:47.306 5792 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:40:47 ctl02 nova-api[5792]: 2017-09-28 12:40:47.306 5792 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:40:47 ctl02 nova-api[5792]: 2017-09-28 12:40:47.306 5792 ERROR nova     max_url_len=max_url_len)
Sep 28 12:40:47 ctl02 nova-api[5792]: 2017-09-28 12:40:47.306 5792 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:40:47 ctl02 nova-api[5792]: 2017-09-28 12:40:47.306 5792 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:40:47 ctl02 nova-api[5792]: 2017-09-28 12:40:47.306 5792 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:40:47 ctl02 nova-api[5792]: 2017-09-28 12:40:47.306 5792 ERROR nova     sock.listen(backlog)
Sep 28 12:40:47 ctl02 nova-api[5792]: 2017-09-28 12:40:47.306 5792 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:40:47 ctl02 nova-api[5792]: 2017-09-28 12:40:47.306 5792 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:40:47 ctl02 nova-api[5792]: 2017-09-28 12:40:47.306 5792 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:40:47 ctl02 nova-api[5792]: 2017-09-28 12:40:47.306 5792 ERROR nova
Sep 28 12:40:47 ctl02 heat-api[13008]: 2017-09-28 12:40:47.309 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:40:47] "OPTIONS / HTTP/1.0" 200 134 0.000585
Sep 28 12:40:47 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:40:47 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:40:47 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:40:47 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:40:47 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:40:47 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:40:47 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:40:48 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:40:48.182 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:40:48] "OPTIONS / HTTP/1.0" 200 134 0.000423
Sep 28 12:40:48 ctl02 nova-consoleauth[5433]: 2017-09-28 12:40:48.326 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:40:48 ctl02 heat-api-cfn[13300]: 2017-09-28 12:40:48.398 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:40:48] "OPTIONS / HTTP/1.0" 200 134 0.000541
Sep 28 12:40:49 ctl02 heat-api[13008]: 2017-09-28 12:40:49.050 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:40:49] "OPTIONS / HTTP/1.0" 200 134 0.000630
Sep 28 12:40:49 ctl02 nova-api[5812]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:40:49 ctl02 nova-api[5812]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:40:49 ctl02 nova-api[5812]: 2017-09-28 12:40:49.554 5812 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:40:49 ctl02 nova-api[5812]: 2017-09-28 12:40:49.556 5812 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:40:49 ctl02 nova-api[5812]: 2017-09-28 12:40:49.556 5812 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:40:49 ctl02 nova-api[5812]: 2017-09-28 12:40:49.556 5812 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:40:49 ctl02 nova-api[5812]: 2017-09-28 12:40:49.556 5812 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:40:49 ctl02 nova-api[5812]: 2017-09-28 12:40:49.556 5812 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:40:49 ctl02 nova-api[5812]: 2017-09-28 12:40:49.556 5812 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:40:49 ctl02 nova-api[5812]: 2017-09-28 12:40:49.556 5812 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:40:49 ctl02 nova-api[5812]: 2017-09-28 12:40:49.556 5812 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:40:49 ctl02 nova-api[5812]: 2017-09-28 12:40:49.556 5812 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:40:49 ctl02 nova-api[5812]: 2017-09-28 12:40:49.556 5812 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:40:49 ctl02 nova-api[5812]: 2017-09-28 12:40:49.556 5812 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:40:49 ctl02 nova-api[5812]: 2017-09-28 12:40:49.556 5812 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:40:49 ctl02 nova-api[5812]: 2017-09-28 12:40:49.556 5812 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:40:49 ctl02 nova-api[5812]: 2017-09-28 12:40:49.556 5812 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:40:49 ctl02 nova-api[5812]: 2017-09-28 12:40:49.556 5812 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:40:49 ctl02 nova-api[5812]: 2017-09-28 12:40:49.556 5812 ERROR nova.wsgi     self.filename))
Sep 28 12:40:49 ctl02 nova-api[5812]: 2017-09-28 12:40:49.556 5812 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:40:49 ctl02 nova-api[5812]: 2017-09-28 12:40:49.556 5812 ERROR nova.wsgi
Sep 28 12:40:49 ctl02 nova-api[5812]: 2017-09-28 12:40:49.558 5812 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:40:49 ctl02 nova-api[5812]: 2017-09-28 12:40:49.700 5812 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:40:49 ctl02 neutron-server[30536]: 2017-09-28 12:40:49.889 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:40:49] "OPTIONS / HTTP/1.0" 200 262 0.000586
Sep 28 12:40:49 ctl02 nova-api[5812]: 2017-09-28 12:40:49.929 5812 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:40:49 ctl02 nova-api[5812]: 2017-09-28 12:40:49.931 5812 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:40:49 ctl02 nova-api[5812]: 2017-09-28 12:40:49.931 5812 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:40:49 ctl02 nova-api[5812]: 2017-09-28 12:40:49.931 5812 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:40:49 ctl02 heat-api-cfn[13300]: 2017-09-28 12:40:49.961 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:40:49] "OPTIONS / HTTP/1.0" 200 134 0.000515
Sep 28 12:40:50 ctl02 heat-engine[12803]: 2017-09-28 12:40:50.050 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:40:50 ctl02 heat-engine[12803]: 2017-09-28 12:40:50.050 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:40:50 ctl02 heat-engine[12803]: 2017-09-28 12:40:50.054 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:40:50 ctl02 heat-engine[12803]: 2017-09-28 12:40:50.057 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:40:50 ctl02 nova-api[5812]: 2017-09-28 12:40:50.075 5812 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:40:50 ctl02 nova-api[5812]: 2017-09-28 12:40:50.078 5812 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:40:50 ctl02 nova-api[5812]: 2017-09-28 12:40:50.078 5812 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:40:50 ctl02 nova-api[5812]: 2017-09-28 12:40:50.078 5812 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:40:50 ctl02 nova-api[5812]: 2017-09-28 12:40:50.082 5812 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:40:50 ctl02 nova-api[5812]: 2017-09-28 12:40:50.082 5812 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:40:50 ctl02 nova-api[5812]: 2017-09-28 12:40:50.082 5812 ERROR nova Traceback (most recent call last):
Sep 28 12:40:50 ctl02 nova-api[5812]: 2017-09-28 12:40:50.082 5812 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:40:50 ctl02 nova-api[5812]: 2017-09-28 12:40:50.082 5812 ERROR nova     sys.exit(main())
Sep 28 12:40:50 ctl02 nova-api[5812]: 2017-09-28 12:40:50.082 5812 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:40:50 ctl02 nova-api[5812]: 2017-09-28 12:40:50.082 5812 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:40:50 ctl02 nova-api[5812]: 2017-09-28 12:40:50.082 5812 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:40:50 ctl02 nova-api[5812]: 2017-09-28 12:40:50.082 5812 ERROR nova     max_url_len=max_url_len)
Sep 28 12:40:50 ctl02 nova-api[5812]: 2017-09-28 12:40:50.082 5812 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:40:50 ctl02 nova-api[5812]: 2017-09-28 12:40:50.082 5812 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:40:50 ctl02 nova-api[5812]: 2017-09-28 12:40:50.082 5812 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:40:50 ctl02 nova-api[5812]: 2017-09-28 12:40:50.082 5812 ERROR nova     sock.listen(backlog)
Sep 28 12:40:50 ctl02 nova-api[5812]: 2017-09-28 12:40:50.082 5812 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:40:50 ctl02 nova-api[5812]: 2017-09-28 12:40:50.082 5812 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:40:50 ctl02 nova-api[5812]: 2017-09-28 12:40:50.082 5812 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:40:50 ctl02 nova-api[5812]: 2017-09-28 12:40:50.082 5812 ERROR nova
Sep 28 12:40:50 ctl02 neutron-server[30536]: 2017-09-28 12:40:50.211 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:40:50] "OPTIONS / HTTP/1.0" 200 262 0.000495
Sep 28 12:40:50 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:40:50 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:40:50 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:40:50 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:40:50 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:40:50 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:40:50 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:40:50 ctl02 neutron-server[30536]: 2017-09-28 12:40:50.559 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:40:50] "OPTIONS / HTTP/1.0" 200 262 0.000440
Sep 28 12:40:51 ctl02 glance-api[29183]: 2017-09-28 12:40:51.213 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:40:51] "OPTIONS / HTTP/1.0" 200 134 0.000589
Sep 28 12:40:51 ctl02 neutron-server[30536]: 2017-09-28 12:40:51.306 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 4 dead agents out of 6:
Sep 28 12:40:51 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:40:51 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:38:56 cmp002
Sep 28 12:40:51 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:38:58 cmp001
Sep 28 12:40:51 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:39:10 cmp002
Sep 28 12:40:51 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:39:06 cmp002
Sep 28 12:40:51 ctl02 nova-scheduler[5620]: 2017-09-28 12:40:51.417 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:40:51 ctl02 glance-api[29183]: 2017-09-28 12:40:51.546 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:40:51] "OPTIONS / HTTP/1.0" 200 134 0.000572
Sep 28 12:40:52 ctl02 nova-api[5829]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:40:52 ctl02 nova-api[5829]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:40:52 ctl02 nova-api[5829]: 2017-09-28 12:40:52.231 5829 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:40:52 ctl02 nova-api[5829]: 2017-09-28 12:40:52.233 5829 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:40:52 ctl02 nova-api[5829]: 2017-09-28 12:40:52.233 5829 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:40:52 ctl02 nova-api[5829]: 2017-09-28 12:40:52.233 5829 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:40:52 ctl02 nova-api[5829]: 2017-09-28 12:40:52.233 5829 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:40:52 ctl02 nova-api[5829]: 2017-09-28 12:40:52.233 5829 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:40:52 ctl02 nova-api[5829]: 2017-09-28 12:40:52.233 5829 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:40:52 ctl02 nova-api[5829]: 2017-09-28 12:40:52.233 5829 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:40:52 ctl02 nova-api[5829]: 2017-09-28 12:40:52.233 5829 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:40:52 ctl02 nova-api[5829]: 2017-09-28 12:40:52.233 5829 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:40:52 ctl02 nova-api[5829]: 2017-09-28 12:40:52.233 5829 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:40:52 ctl02 nova-api[5829]: 2017-09-28 12:40:52.233 5829 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:40:52 ctl02 nova-api[5829]: 2017-09-28 12:40:52.233 5829 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:40:52 ctl02 nova-api[5829]: 2017-09-28 12:40:52.233 5829 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:40:52 ctl02 nova-api[5829]: 2017-09-28 12:40:52.233 5829 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:40:52 ctl02 nova-api[5829]: 2017-09-28 12:40:52.233 5829 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:40:52 ctl02 nova-api[5829]: 2017-09-28 12:40:52.233 5829 ERROR nova.wsgi     self.filename))
Sep 28 12:40:52 ctl02 nova-api[5829]: 2017-09-28 12:40:52.233 5829 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:40:52 ctl02 nova-api[5829]: 2017-09-28 12:40:52.233 5829 ERROR nova.wsgi
Sep 28 12:40:52 ctl02 nova-api[5829]: 2017-09-28 12:40:52.235 5829 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:40:52 ctl02 nova-api[5829]: 2017-09-28 12:40:52.367 5829 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:40:52 ctl02 heat-api-cfn[13300]: 2017-09-28 12:40:52.410 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:40:52] "OPTIONS / HTTP/1.0" 200 134 0.000558
Sep 28 12:40:52 ctl02 nova-api[5829]: 2017-09-28 12:40:52.593 5829 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:40:52 ctl02 nova-api[5829]: 2017-09-28 12:40:52.595 5829 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:40:52 ctl02 nova-api[5829]: 2017-09-28 12:40:52.596 5829 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:40:52 ctl02 nova-api[5829]: 2017-09-28 12:40:52.596 5829 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:40:52 ctl02 glance-api[29183]: 2017-09-28 12:40:52.652 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:40:52] "OPTIONS / HTTP/1.0" 200 134 0.000563
Sep 28 12:40:52 ctl02 nova-api[5829]: 2017-09-28 12:40:52.742 5829 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:40:52 ctl02 nova-api[5829]: 2017-09-28 12:40:52.744 5829 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:40:52 ctl02 nova-api[5829]: 2017-09-28 12:40:52.745 5829 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:40:52 ctl02 nova-api[5829]: 2017-09-28 12:40:52.745 5829 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:40:52 ctl02 nova-api[5829]: 2017-09-28 12:40:52.749 5829 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:40:52 ctl02 nova-api[5829]: 2017-09-28 12:40:52.749 5829 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:40:52 ctl02 nova-api[5829]: 2017-09-28 12:40:52.749 5829 ERROR nova Traceback (most recent call last):
Sep 28 12:40:52 ctl02 nova-api[5829]: 2017-09-28 12:40:52.749 5829 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:40:52 ctl02 nova-api[5829]: 2017-09-28 12:40:52.749 5829 ERROR nova     sys.exit(main())
Sep 28 12:40:52 ctl02 nova-api[5829]: 2017-09-28 12:40:52.749 5829 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:40:52 ctl02 nova-api[5829]: 2017-09-28 12:40:52.749 5829 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:40:52 ctl02 nova-api[5829]: 2017-09-28 12:40:52.749 5829 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:40:52 ctl02 nova-api[5829]: 2017-09-28 12:40:52.749 5829 ERROR nova     max_url_len=max_url_len)
Sep 28 12:40:52 ctl02 nova-api[5829]: 2017-09-28 12:40:52.749 5829 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:40:52 ctl02 nova-api[5829]: 2017-09-28 12:40:52.749 5829 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:40:52 ctl02 nova-api[5829]: 2017-09-28 12:40:52.749 5829 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:40:52 ctl02 nova-api[5829]: 2017-09-28 12:40:52.749 5829 ERROR nova     sock.listen(backlog)
Sep 28 12:40:52 ctl02 nova-api[5829]: 2017-09-28 12:40:52.749 5829 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:40:52 ctl02 nova-api[5829]: 2017-09-28 12:40:52.749 5829 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:40:52 ctl02 nova-api[5829]: 2017-09-28 12:40:52.749 5829 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:40:52 ctl02 nova-api[5829]: 2017-09-28 12:40:52.749 5829 ERROR nova
Sep 28 12:40:52 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:40:52.833 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:40:52] "OPTIONS / HTTP/1.0" 200 134 0.000443
Sep 28 12:40:52 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:40:52 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:40:52 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:40:53 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:40:53 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:40:53 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:40:53 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:40:54 ctl02 nova-api[5848]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:40:54 ctl02 nova-api[5848]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:40:54 ctl02 nova-api[5848]: 2017-09-28 12:40:54.994 5848 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:40:54 ctl02 nova-api[5848]: 2017-09-28 12:40:54.995 5848 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:40:54 ctl02 nova-api[5848]: 2017-09-28 12:40:54.995 5848 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:40:54 ctl02 nova-api[5848]: 2017-09-28 12:40:54.995 5848 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:40:54 ctl02 nova-api[5848]: 2017-09-28 12:40:54.995 5848 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:40:54 ctl02 nova-api[5848]: 2017-09-28 12:40:54.995 5848 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:40:54 ctl02 nova-api[5848]: 2017-09-28 12:40:54.995 5848 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:40:54 ctl02 nova-api[5848]: 2017-09-28 12:40:54.995 5848 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:40:54 ctl02 nova-api[5848]: 2017-09-28 12:40:54.995 5848 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:40:54 ctl02 nova-api[5848]: 2017-09-28 12:40:54.995 5848 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:40:54 ctl02 nova-api[5848]: 2017-09-28 12:40:54.995 5848 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:40:54 ctl02 nova-api[5848]: 2017-09-28 12:40:54.995 5848 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:40:54 ctl02 nova-api[5848]: 2017-09-28 12:40:54.995 5848 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:40:54 ctl02 nova-api[5848]: 2017-09-28 12:40:54.995 5848 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:40:54 ctl02 nova-api[5848]: 2017-09-28 12:40:54.995 5848 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:40:54 ctl02 nova-api[5848]: 2017-09-28 12:40:54.995 5848 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:40:54 ctl02 nova-api[5848]: 2017-09-28 12:40:54.995 5848 ERROR nova.wsgi     self.filename))
Sep 28 12:40:54 ctl02 nova-api[5848]: 2017-09-28 12:40:54.995 5848 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:40:54 ctl02 nova-api[5848]: 2017-09-28 12:40:54.995 5848 ERROR nova.wsgi
Sep 28 12:40:54 ctl02 nova-api[5848]: 2017-09-28 12:40:54.998 5848 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:40:55 ctl02 nova-api[5848]: 2017-09-28 12:40:55.129 5848 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:40:55 ctl02 heat-api[13008]: 2017-09-28 12:40:55.320 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:40:55] "OPTIONS / HTTP/1.0" 200 134 0.000567
Sep 28 12:40:55 ctl02 nova-api[5848]: 2017-09-28 12:40:55.368 5848 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:40:55 ctl02 nova-api[5848]: 2017-09-28 12:40:55.371 5848 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:40:55 ctl02 nova-api[5848]: 2017-09-28 12:40:55.372 5848 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:40:55 ctl02 nova-api[5848]: 2017-09-28 12:40:55.372 5848 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:40:55 ctl02 nova-api[5848]: 2017-09-28 12:40:55.504 5848 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:40:55 ctl02 nova-api[5848]: 2017-09-28 12:40:55.506 5848 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:40:55 ctl02 nova-api[5848]: 2017-09-28 12:40:55.507 5848 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:40:55 ctl02 nova-api[5848]: 2017-09-28 12:40:55.507 5848 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:40:55 ctl02 nova-api[5848]: 2017-09-28 12:40:55.511 5848 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:40:55 ctl02 nova-api[5848]: 2017-09-28 12:40:55.511 5848 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:40:55 ctl02 nova-api[5848]: 2017-09-28 12:40:55.511 5848 ERROR nova Traceback (most recent call last):
Sep 28 12:40:55 ctl02 nova-api[5848]: 2017-09-28 12:40:55.511 5848 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:40:55 ctl02 nova-api[5848]: 2017-09-28 12:40:55.511 5848 ERROR nova     sys.exit(main())
Sep 28 12:40:55 ctl02 nova-api[5848]: 2017-09-28 12:40:55.511 5848 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:40:55 ctl02 nova-api[5848]: 2017-09-28 12:40:55.511 5848 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:40:55 ctl02 nova-api[5848]: 2017-09-28 12:40:55.511 5848 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:40:55 ctl02 nova-api[5848]: 2017-09-28 12:40:55.511 5848 ERROR nova     max_url_len=max_url_len)
Sep 28 12:40:55 ctl02 nova-api[5848]: 2017-09-28 12:40:55.511 5848 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:40:55 ctl02 nova-api[5848]: 2017-09-28 12:40:55.511 5848 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:40:55 ctl02 nova-api[5848]: 2017-09-28 12:40:55.511 5848 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:40:55 ctl02 nova-api[5848]: 2017-09-28 12:40:55.511 5848 ERROR nova     sock.listen(backlog)
Sep 28 12:40:55 ctl02 nova-api[5848]: 2017-09-28 12:40:55.511 5848 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:40:55 ctl02 nova-api[5848]: 2017-09-28 12:40:55.511 5848 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:40:55 ctl02 nova-api[5848]: 2017-09-28 12:40:55.511 5848 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:40:55 ctl02 nova-api[5848]: 2017-09-28 12:40:55.511 5848 ERROR nova
Sep 28 12:40:55 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:40:55 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:40:55 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:40:55 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:40:55.801 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:40:55] "OPTIONS / HTTP/1.0" 200 134 0.000431
Sep 28 12:40:55 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:40:55 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:40:55 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:40:55 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:40:57 ctl02 heat-api[13008]: 2017-09-28 12:40:57.330 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:40:57] "OPTIONS / HTTP/1.0" 200 134 0.000548
Sep 28 12:40:57 ctl02 nova-api[5865]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:40:57 ctl02 nova-api[5865]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:40:57 ctl02 nova-api[5865]: 2017-09-28 12:40:57.753 5865 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:40:57 ctl02 nova-api[5865]: 2017-09-28 12:40:57.755 5865 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:40:57 ctl02 nova-api[5865]: 2017-09-28 12:40:57.755 5865 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:40:57 ctl02 nova-api[5865]: 2017-09-28 12:40:57.755 5865 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:40:57 ctl02 nova-api[5865]: 2017-09-28 12:40:57.755 5865 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:40:57 ctl02 nova-api[5865]: 2017-09-28 12:40:57.755 5865 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:40:57 ctl02 nova-api[5865]: 2017-09-28 12:40:57.755 5865 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:40:57 ctl02 nova-api[5865]: 2017-09-28 12:40:57.755 5865 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:40:57 ctl02 nova-api[5865]: 2017-09-28 12:40:57.755 5865 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:40:57 ctl02 nova-api[5865]: 2017-09-28 12:40:57.755 5865 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:40:57 ctl02 nova-api[5865]: 2017-09-28 12:40:57.755 5865 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:40:57 ctl02 nova-api[5865]: 2017-09-28 12:40:57.755 5865 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:40:57 ctl02 nova-api[5865]: 2017-09-28 12:40:57.755 5865 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:40:57 ctl02 nova-api[5865]: 2017-09-28 12:40:57.755 5865 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:40:57 ctl02 nova-api[5865]: 2017-09-28 12:40:57.755 5865 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:40:57 ctl02 nova-api[5865]: 2017-09-28 12:40:57.755 5865 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:40:57 ctl02 nova-api[5865]: 2017-09-28 12:40:57.755 5865 ERROR nova.wsgi     self.filename))
Sep 28 12:40:57 ctl02 nova-api[5865]: 2017-09-28 12:40:57.755 5865 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:40:57 ctl02 nova-api[5865]: 2017-09-28 12:40:57.755 5865 ERROR nova.wsgi
Sep 28 12:40:57 ctl02 nova-api[5865]: 2017-09-28 12:40:57.756 5865 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:40:57 ctl02 nova-api[5865]: 2017-09-28 12:40:57.887 5865 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:40:58 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:40:58.035 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:40:58] "OPTIONS / HTTP/1.0" 200 134 0.000439
Sep 28 12:40:58 ctl02 nova-api[5865]: 2017-09-28 12:40:58.127 5865 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:40:58 ctl02 nova-api[5865]: 2017-09-28 12:40:58.129 5865 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:40:58 ctl02 nova-api[5865]: 2017-09-28 12:40:58.130 5865 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:40:58 ctl02 nova-api[5865]: 2017-09-28 12:40:58.130 5865 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:40:58 ctl02 nova-api[5865]: 2017-09-28 12:40:58.266 5865 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:40:58 ctl02 nova-api[5865]: 2017-09-28 12:40:58.268 5865 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:40:58 ctl02 nova-api[5865]: 2017-09-28 12:40:58.268 5865 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:40:58 ctl02 nova-api[5865]: 2017-09-28 12:40:58.268 5865 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:40:58 ctl02 nova-api[5865]: 2017-09-28 12:40:58.271 5865 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:40:58 ctl02 nova-api[5865]: 2017-09-28 12:40:58.272 5865 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:40:58 ctl02 nova-api[5865]: 2017-09-28 12:40:58.272 5865 ERROR nova Traceback (most recent call last):
Sep 28 12:40:58 ctl02 nova-api[5865]: 2017-09-28 12:40:58.272 5865 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:40:58 ctl02 nova-api[5865]: 2017-09-28 12:40:58.272 5865 ERROR nova     sys.exit(main())
Sep 28 12:40:58 ctl02 nova-api[5865]: 2017-09-28 12:40:58.272 5865 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:40:58 ctl02 nova-api[5865]: 2017-09-28 12:40:58.272 5865 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:40:58 ctl02 nova-api[5865]: 2017-09-28 12:40:58.272 5865 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:40:58 ctl02 nova-api[5865]: 2017-09-28 12:40:58.272 5865 ERROR nova     max_url_len=max_url_len)
Sep 28 12:40:58 ctl02 nova-api[5865]: 2017-09-28 12:40:58.272 5865 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:40:58 ctl02 nova-api[5865]: 2017-09-28 12:40:58.272 5865 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:40:58 ctl02 nova-api[5865]: 2017-09-28 12:40:58.272 5865 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:40:58 ctl02 nova-api[5865]: 2017-09-28 12:40:58.272 5865 ERROR nova     sock.listen(backlog)
Sep 28 12:40:58 ctl02 nova-api[5865]: 2017-09-28 12:40:58.272 5865 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:40:58 ctl02 nova-api[5865]: 2017-09-28 12:40:58.272 5865 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:40:58 ctl02 nova-api[5865]: 2017-09-28 12:40:58.272 5865 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:40:58 ctl02 nova-api[5865]: 2017-09-28 12:40:58.272 5865 ERROR nova
Sep 28 12:40:58 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:40:58 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:40:58 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:40:58 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:40:58 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:40:58 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:40:58 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:40:58 ctl02 heat-api-cfn[13300]: 2017-09-28 12:40:58.716 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:40:58] "OPTIONS / HTTP/1.0" 200 134 0.000507
Sep 28 12:40:59 ctl02 heat-api[13008]: 2017-09-28 12:40:59.332 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:40:59] "OPTIONS / HTTP/1.0" 200 134 0.000658
Sep 28 12:41:00 ctl02 heat-api-cfn[13300]: 2017-09-28 12:41:00.103 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:41:00] "OPTIONS / HTTP/1.0" 200 134 0.000452
Sep 28 12:41:00 ctl02 neutron-server[30536]: 2017-09-28 12:41:00.139 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:41:00] "OPTIONS / HTTP/1.0" 200 262 0.000502
Sep 28 12:41:00 ctl02 neutron-server[30536]: 2017-09-28 12:41:00.160 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:41:00] "OPTIONS / HTTP/1.0" 200 262 0.000328
Sep 28 12:41:00 ctl02 nova-api[5884]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:41:00 ctl02 nova-api[5884]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:41:00 ctl02 nova-api[5884]: 2017-09-28 12:41:00.521 5884 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:41:00 ctl02 nova-api[5884]: 2017-09-28 12:41:00.522 5884 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:41:00 ctl02 nova-api[5884]: 2017-09-28 12:41:00.522 5884 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:41:00 ctl02 nova-api[5884]: 2017-09-28 12:41:00.522 5884 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:41:00 ctl02 nova-api[5884]: 2017-09-28 12:41:00.522 5884 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:41:00 ctl02 nova-api[5884]: 2017-09-28 12:41:00.522 5884 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:41:00 ctl02 nova-api[5884]: 2017-09-28 12:41:00.522 5884 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:41:00 ctl02 nova-api[5884]: 2017-09-28 12:41:00.522 5884 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:41:00 ctl02 nova-api[5884]: 2017-09-28 12:41:00.522 5884 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:41:00 ctl02 nova-api[5884]: 2017-09-28 12:41:00.522 5884 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:41:00 ctl02 nova-api[5884]: 2017-09-28 12:41:00.522 5884 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:41:00 ctl02 nova-api[5884]: 2017-09-28 12:41:00.522 5884 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:41:00 ctl02 nova-api[5884]: 2017-09-28 12:41:00.522 5884 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:41:00 ctl02 nova-api[5884]: 2017-09-28 12:41:00.522 5884 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:41:00 ctl02 nova-api[5884]: 2017-09-28 12:41:00.522 5884 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:41:00 ctl02 nova-api[5884]: 2017-09-28 12:41:00.522 5884 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:41:00 ctl02 nova-api[5884]: 2017-09-28 12:41:00.522 5884 ERROR nova.wsgi     self.filename))
Sep 28 12:41:00 ctl02 nova-api[5884]: 2017-09-28 12:41:00.522 5884 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:41:00 ctl02 nova-api[5884]: 2017-09-28 12:41:00.522 5884 ERROR nova.wsgi
Sep 28 12:41:00 ctl02 nova-api[5884]: 2017-09-28 12:41:00.523 5884 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:41:00 ctl02 nova-api[5884]: 2017-09-28 12:41:00.653 5884 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:41:00 ctl02 neutron-server[30536]: 2017-09-28 12:41:00.844 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:41:00] "OPTIONS / HTTP/1.0" 200 262 0.000689
Sep 28 12:41:00 ctl02 nova-api[5884]: 2017-09-28 12:41:00.877 5884 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:41:00 ctl02 nova-api[5884]: 2017-09-28 12:41:00.879 5884 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:41:00 ctl02 nova-api[5884]: 2017-09-28 12:41:00.879 5884 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:41:00 ctl02 nova-api[5884]: 2017-09-28 12:41:00.880 5884 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:41:00 ctl02 glance-api[29183]: 2017-09-28 12:41:00.898 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:41:00] "OPTIONS / HTTP/1.0" 200 134 0.000561
Sep 28 12:41:01 ctl02 nova-api[5884]: 2017-09-28 12:41:01.015 5884 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:41:01 ctl02 nova-api[5884]: 2017-09-28 12:41:01.016 5884 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:41:01 ctl02 nova-api[5884]: 2017-09-28 12:41:01.017 5884 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:41:01 ctl02 nova-api[5884]: 2017-09-28 12:41:01.017 5884 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:41:01 ctl02 nova-api[5884]: 2017-09-28 12:41:01.020 5884 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:41:01 ctl02 nova-api[5884]: 2017-09-28 12:41:01.020 5884 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:41:01 ctl02 nova-api[5884]: 2017-09-28 12:41:01.020 5884 ERROR nova Traceback (most recent call last):
Sep 28 12:41:01 ctl02 nova-api[5884]: 2017-09-28 12:41:01.020 5884 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:41:01 ctl02 nova-api[5884]: 2017-09-28 12:41:01.020 5884 ERROR nova     sys.exit(main())
Sep 28 12:41:01 ctl02 nova-api[5884]: 2017-09-28 12:41:01.020 5884 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:41:01 ctl02 nova-api[5884]: 2017-09-28 12:41:01.020 5884 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:41:01 ctl02 nova-api[5884]: 2017-09-28 12:41:01.020 5884 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:41:01 ctl02 nova-api[5884]: 2017-09-28 12:41:01.020 5884 ERROR nova     max_url_len=max_url_len)
Sep 28 12:41:01 ctl02 nova-api[5884]: 2017-09-28 12:41:01.020 5884 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:41:01 ctl02 nova-api[5884]: 2017-09-28 12:41:01.020 5884 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:41:01 ctl02 nova-api[5884]: 2017-09-28 12:41:01.020 5884 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:41:01 ctl02 nova-api[5884]: 2017-09-28 12:41:01.020 5884 ERROR nova     sock.listen(backlog)
Sep 28 12:41:01 ctl02 nova-api[5884]: 2017-09-28 12:41:01.020 5884 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:41:01 ctl02 nova-api[5884]: 2017-09-28 12:41:01.020 5884 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:41:01 ctl02 nova-api[5884]: 2017-09-28 12:41:01.020 5884 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:41:01 ctl02 nova-api[5884]: 2017-09-28 12:41:01.020 5884 ERROR nova
Sep 28 12:41:01 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:41:01 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:41:01 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:41:01 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:41:01 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:41:01 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:41:01 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:41:01 ctl02 glance-api[29183]: 2017-09-28 12:41:01.726 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:41:01] "OPTIONS / HTTP/1.0" 200 134 0.000603
Sep 28 12:41:02 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:41:02.683 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:41:02] "OPTIONS / HTTP/1.0" 200 134 0.000424
Sep 28 12:41:02 ctl02 heat-api-cfn[13300]: 2017-09-28 12:41:02.720 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:41:02] "OPTIONS / HTTP/1.0" 200 134 0.000487
Sep 28 12:41:02 ctl02 glance-api[29183]: 2017-09-28 12:41:02.791 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:41:02] "OPTIONS / HTTP/1.0" 200 134 0.000940
Sep 28 12:41:03 ctl02 nova-api[5901]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:41:03 ctl02 nova-api[5901]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:41:03 ctl02 nova-api[5901]: 2017-09-28 12:41:03.262 5901 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:41:03 ctl02 nova-api[5901]: 2017-09-28 12:41:03.263 5901 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:41:03 ctl02 nova-api[5901]: 2017-09-28 12:41:03.263 5901 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:41:03 ctl02 nova-api[5901]: 2017-09-28 12:41:03.263 5901 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:41:03 ctl02 nova-api[5901]: 2017-09-28 12:41:03.263 5901 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:41:03 ctl02 nova-api[5901]: 2017-09-28 12:41:03.263 5901 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:41:03 ctl02 nova-api[5901]: 2017-09-28 12:41:03.263 5901 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:41:03 ctl02 nova-api[5901]: 2017-09-28 12:41:03.263 5901 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:41:03 ctl02 nova-api[5901]: 2017-09-28 12:41:03.263 5901 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:41:03 ctl02 nova-api[5901]: 2017-09-28 12:41:03.263 5901 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:41:03 ctl02 nova-api[5901]: 2017-09-28 12:41:03.263 5901 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:41:03 ctl02 nova-api[5901]: 2017-09-28 12:41:03.263 5901 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:41:03 ctl02 nova-api[5901]: 2017-09-28 12:41:03.263 5901 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:41:03 ctl02 nova-api[5901]: 2017-09-28 12:41:03.263 5901 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:41:03 ctl02 nova-api[5901]: 2017-09-28 12:41:03.263 5901 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:41:03 ctl02 nova-api[5901]: 2017-09-28 12:41:03.263 5901 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:41:03 ctl02 nova-api[5901]: 2017-09-28 12:41:03.263 5901 ERROR nova.wsgi     self.filename))
Sep 28 12:41:03 ctl02 nova-api[5901]: 2017-09-28 12:41:03.263 5901 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:41:03 ctl02 nova-api[5901]: 2017-09-28 12:41:03.263 5901 ERROR nova.wsgi
Sep 28 12:41:03 ctl02 nova-api[5901]: 2017-09-28 12:41:03.264 5901 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:41:03 ctl02 nova-api[5901]: 2017-09-28 12:41:03.394 5901 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:41:03 ctl02 nova-api[5901]: 2017-09-28 12:41:03.630 5901 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:41:03 ctl02 nova-api[5901]: 2017-09-28 12:41:03.633 5901 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:41:03 ctl02 nova-api[5901]: 2017-09-28 12:41:03.633 5901 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:41:03 ctl02 nova-api[5901]: 2017-09-28 12:41:03.633 5901 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:41:03 ctl02 nova-api[5901]: 2017-09-28 12:41:03.765 5901 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:41:03 ctl02 nova-api[5901]: 2017-09-28 12:41:03.766 5901 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:41:03 ctl02 nova-api[5901]: 2017-09-28 12:41:03.767 5901 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:41:03 ctl02 nova-api[5901]: 2017-09-28 12:41:03.767 5901 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:41:03 ctl02 nova-api[5901]: 2017-09-28 12:41:03.770 5901 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:41:03 ctl02 nova-api[5901]: 2017-09-28 12:41:03.770 5901 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:41:03 ctl02 nova-api[5901]: 2017-09-28 12:41:03.770 5901 ERROR nova Traceback (most recent call last):
Sep 28 12:41:03 ctl02 nova-api[5901]: 2017-09-28 12:41:03.770 5901 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:41:03 ctl02 nova-api[5901]: 2017-09-28 12:41:03.770 5901 ERROR nova     sys.exit(main())
Sep 28 12:41:03 ctl02 nova-api[5901]: 2017-09-28 12:41:03.770 5901 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:41:03 ctl02 nova-api[5901]: 2017-09-28 12:41:03.770 5901 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:41:03 ctl02 nova-api[5901]: 2017-09-28 12:41:03.770 5901 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:41:03 ctl02 nova-api[5901]: 2017-09-28 12:41:03.770 5901 ERROR nova     max_url_len=max_url_len)
Sep 28 12:41:03 ctl02 nova-api[5901]: 2017-09-28 12:41:03.770 5901 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:41:03 ctl02 nova-api[5901]: 2017-09-28 12:41:03.770 5901 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:41:03 ctl02 nova-api[5901]: 2017-09-28 12:41:03.770 5901 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:41:03 ctl02 nova-api[5901]: 2017-09-28 12:41:03.770 5901 ERROR nova     sock.listen(backlog)
Sep 28 12:41:03 ctl02 nova-api[5901]: 2017-09-28 12:41:03.770 5901 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:41:03 ctl02 nova-api[5901]: 2017-09-28 12:41:03.770 5901 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:41:03 ctl02 nova-api[5901]: 2017-09-28 12:41:03.770 5901 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:41:03 ctl02 nova-api[5901]: 2017-09-28 12:41:03.770 5901 ERROR nova
Sep 28 12:41:03 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf60a2a7d)
Sep 28 12:41:03 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:41:03 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:41:03 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:41:04 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:41:04 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:41:04 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:41:04 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:41:04 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf60a2a7d)
Sep 28 12:41:05 ctl02 heat-api[13008]: 2017-09-28 12:41:05.288 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:41:05] "OPTIONS / HTTP/1.0" 200 134 0.000582
Sep 28 12:41:05 ctl02 nova-api[5919]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:41:05 ctl02 nova-api[5919]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:41:05 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf60a2a7d)
Sep 28 12:41:05 ctl02 nova-api[5919]: 2017-09-28 12:41:05.988 5919 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:41:05 ctl02 nova-api[5919]: 2017-09-28 12:41:05.989 5919 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:41:05 ctl02 nova-api[5919]: 2017-09-28 12:41:05.989 5919 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:41:05 ctl02 nova-api[5919]: 2017-09-28 12:41:05.989 5919 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:41:05 ctl02 nova-api[5919]: 2017-09-28 12:41:05.989 5919 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:41:05 ctl02 nova-api[5919]: 2017-09-28 12:41:05.989 5919 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:41:05 ctl02 nova-api[5919]: 2017-09-28 12:41:05.989 5919 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:41:05 ctl02 nova-api[5919]: 2017-09-28 12:41:05.989 5919 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:41:05 ctl02 nova-api[5919]: 2017-09-28 12:41:05.989 5919 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:41:05 ctl02 nova-api[5919]: 2017-09-28 12:41:05.989 5919 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:41:05 ctl02 nova-api[5919]: 2017-09-28 12:41:05.989 5919 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:41:05 ctl02 nova-api[5919]: 2017-09-28 12:41:05.989 5919 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:41:05 ctl02 nova-api[5919]: 2017-09-28 12:41:05.989 5919 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:41:05 ctl02 nova-api[5919]: 2017-09-28 12:41:05.989 5919 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:41:05 ctl02 nova-api[5919]: 2017-09-28 12:41:05.989 5919 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:41:05 ctl02 nova-api[5919]: 2017-09-28 12:41:05.989 5919 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:41:05 ctl02 nova-api[5919]: 2017-09-28 12:41:05.989 5919 ERROR nova.wsgi     self.filename))
Sep 28 12:41:05 ctl02 nova-api[5919]: 2017-09-28 12:41:05.989 5919 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:41:05 ctl02 nova-api[5919]: 2017-09-28 12:41:05.989 5919 ERROR nova.wsgi
Sep 28 12:41:05 ctl02 nova-api[5919]: 2017-09-28 12:41:05.992 5919 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:41:06 ctl02 nova-api[5919]: 2017-09-28 12:41:06.133 5919 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.131 30598 ERROR oslo_db.sqlalchemy.exc_filters [req-91c24138-f659-404e-a913-d8ce55abef35 - - - - -] DBAPIError exception wrapped from (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpoo
Sep 28 12:41:06 ctl02 neutron-server[30536]: ls_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`']
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.131 30598 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.131 30598 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.131 30598 ERROR oslo_db.sqlalchemy.exc_filters     context)
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.131 30598 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.131 30598 ERROR oslo_db.sqlalchemy.exc_filters     cursor.execute(statement, parameters)
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.131 30598 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.131 30598 ERROR oslo_db.sqlalchemy.exc_filters     result = self._query(query)
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.131 30598 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.131 30598 ERROR oslo_db.sqlalchemy.exc_filters     conn.query(q)
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.131 30598 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.131 30598 ERROR oslo_db.sqlalchemy.exc_filters     self._affected_rows = self._read_query_result(unbuffered=unbuffered)
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.131 30598 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.131 30598 ERROR oslo_db.sqlalchemy.exc_filters     result.read()
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.131 30598 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.131 30598 ERROR oslo_db.sqlalchemy.exc_filters     first_packet = self.connection._read_packet()
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.131 30598 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.131 30598 ERROR oslo_db.sqlalchemy.exc_filters     packet.check_error()
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.131 30598 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.131 30598 ERROR oslo_db.sqlalchemy.exc_filters     err.raise_mysql_exception(self._data)
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.131 30598 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.131 30598 ERROR oslo_db.sqlalchemy.exc_filters     _check_mysql_exception(errinfo)
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.131 30598 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.131 30598 ERROR oslo_db.sqlalchemy.exc_filters     raise InternalError(errno, errorvalue)
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.131 30598 ERROR oslo_db.sqlalchemy.exc_filters InternalError: (1054, u"Unknown column 'subnets.tenant_id' in 'field list'")
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.131 30598 ERROR oslo_db.sqlalchemy.exc_filters
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher [req-91c24138-f659-404e-a913-d8ce55abef35 - - - - -] Exception during message handling: (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpoo
Sep 28 12:41:06 ctl02 neutron-server[30536]: ls_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`']
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher Traceback (most recent call last):
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher     incoming.message))
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher     return self._do_dispatch(endpoint, method, ctxt, args)
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher     result = func(ctxt, **new_args)
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher     networks = self._get_active_networks(context, **kwargs)
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher     plugin.auto_schedule_networks(context, host)
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher     self.network_scheduler.auto_schedule_networks(self, context, host)
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher     subnets = plugin.get_subnets(context, fields=fields)
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher     marker, page_reverse)
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher     page_reverse=page_reverse)
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher     items = [dict_func(c, fields) for c in query]
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher     return self._execute_and_instances(context)
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher     result = conn.execute(querycontext.statement, self._params)
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher     return meth(self, multiparams, params)
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher     return connection._execute_clauseelement(self, multiparams, params)
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher     compiled_sql, distilled_params
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher     context)
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher     util.raise_from_cause(newraise, exc_info)
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher     reraise(type(exception), exception, tb=exc_tb)
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher     context)
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher     cursor.execute(statement, parameters)
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher     result = self._query(query)
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher     conn.query(q)
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher     self._affected_rows = self._read_query_result(unbuffered=unbuffered)
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher     result.read()
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher     first_packet = self.connection._read_packet()
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher     packet.check_error()
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher     err.raise_mysql_exception(self._data)
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher     _check_mysql_exception(errinfo)
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher     raise InternalError(errno, errorvalue)
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher DBError: (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallo
Sep 28 12:41:06 ctl02 neutron-server[30536]: cationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`']
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.152 30598 ERROR oslo_messaging.rpc.dispatcher
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.170 30598 ERROR oslo_messaging._drivers.common [req-91c24138-f659-404e-a913-d8ce55abef35 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:06 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.171 30598 ERROR oslo_messaging._drivers.common [req-91c24138-f659-404e-a913-d8ce55abef35 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:06 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:06 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:06 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:06 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:06 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:41:06.193 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:41:06] "OPTIONS / HTTP/1.0" 200 134 0.000435
Sep 28 12:41:06 ctl02 neutron-server[30536]: 2017-09-28 12:41:06.302 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 1 dead agents out of 6:
Sep 28 12:41:06 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:41:06 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:39:10 cmp002
Sep 28 12:41:06 ctl02 nova-api[5919]: 2017-09-28 12:41:06.375 5919 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:41:06 ctl02 nova-api[5919]: 2017-09-28 12:41:06.377 5919 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:41:06 ctl02 nova-api[5919]: 2017-09-28 12:41:06.377 5919 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:41:06 ctl02 nova-api[5919]: 2017-09-28 12:41:06.378 5919 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:41:06 ctl02 nova-api[5919]: 2017-09-28 12:41:06.509 5919 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:41:06 ctl02 nova-api[5919]: 2017-09-28 12:41:06.511 5919 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:41:06 ctl02 nova-api[5919]: 2017-09-28 12:41:06.512 5919 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:41:06 ctl02 nova-api[5919]: 2017-09-28 12:41:06.512 5919 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:41:06 ctl02 nova-api[5919]: 2017-09-28 12:41:06.516 5919 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:41:06 ctl02 nova-api[5919]: 2017-09-28 12:41:06.516 5919 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:41:06 ctl02 nova-api[5919]: 2017-09-28 12:41:06.516 5919 ERROR nova Traceback (most recent call last):
Sep 28 12:41:06 ctl02 nova-api[5919]: 2017-09-28 12:41:06.516 5919 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:41:06 ctl02 nova-api[5919]: 2017-09-28 12:41:06.516 5919 ERROR nova     sys.exit(main())
Sep 28 12:41:06 ctl02 nova-api[5919]: 2017-09-28 12:41:06.516 5919 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:41:06 ctl02 nova-api[5919]: 2017-09-28 12:41:06.516 5919 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:41:06 ctl02 nova-api[5919]: 2017-09-28 12:41:06.516 5919 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:41:06 ctl02 nova-api[5919]: 2017-09-28 12:41:06.516 5919 ERROR nova     max_url_len=max_url_len)
Sep 28 12:41:06 ctl02 nova-api[5919]: 2017-09-28 12:41:06.516 5919 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:41:06 ctl02 nova-api[5919]: 2017-09-28 12:41:06.516 5919 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:41:06 ctl02 nova-api[5919]: 2017-09-28 12:41:06.516 5919 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:41:06 ctl02 nova-api[5919]: 2017-09-28 12:41:06.516 5919 ERROR nova     sock.listen(backlog)
Sep 28 12:41:06 ctl02 nova-api[5919]: 2017-09-28 12:41:06.516 5919 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:41:06 ctl02 nova-api[5919]: 2017-09-28 12:41:06.516 5919 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:41:06 ctl02 nova-api[5919]: 2017-09-28 12:41:06.516 5919 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:41:06 ctl02 nova-api[5919]: 2017-09-28 12:41:06.516 5919 ERROR nova
Sep 28 12:41:06 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:41:06 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:41:06 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:41:06 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf60a2a7d)
Sep 28 12:41:06 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:41:06 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:41:06 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:41:06 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:41:07 ctl02 heat-api[13008]: 2017-09-28 12:41:07.187 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:41:07] "OPTIONS / HTTP/1.0" 200 134 0.000543
Sep 28 12:41:07 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf60a2a7d)
Sep 28 12:41:08 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:41:08.393 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:41:08] "OPTIONS / HTTP/1.0" 200 134 0.000473
Sep 28 12:41:08 ctl02 nova-api[5938]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:41:08 ctl02 nova-api[5938]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:41:08 ctl02 heat-api-cfn[13300]: 2017-09-28 12:41:08.784 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:41:08] "OPTIONS / HTTP/1.0" 200 134 0.000503
Sep 28 12:41:08 ctl02 nova-api[5938]: 2017-09-28 12:41:08.799 5938 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:41:08 ctl02 nova-api[5938]: 2017-09-28 12:41:08.800 5938 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:41:08 ctl02 nova-api[5938]: 2017-09-28 12:41:08.800 5938 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:41:08 ctl02 nova-api[5938]: 2017-09-28 12:41:08.800 5938 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:41:08 ctl02 nova-api[5938]: 2017-09-28 12:41:08.800 5938 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:41:08 ctl02 nova-api[5938]: 2017-09-28 12:41:08.800 5938 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:41:08 ctl02 nova-api[5938]: 2017-09-28 12:41:08.800 5938 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:41:08 ctl02 nova-api[5938]: 2017-09-28 12:41:08.800 5938 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:41:08 ctl02 nova-api[5938]: 2017-09-28 12:41:08.800 5938 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:41:08 ctl02 nova-api[5938]: 2017-09-28 12:41:08.800 5938 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:41:08 ctl02 nova-api[5938]: 2017-09-28 12:41:08.800 5938 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:41:08 ctl02 nova-api[5938]: 2017-09-28 12:41:08.800 5938 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:41:08 ctl02 nova-api[5938]: 2017-09-28 12:41:08.800 5938 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:41:08 ctl02 nova-api[5938]: 2017-09-28 12:41:08.800 5938 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:41:08 ctl02 nova-api[5938]: 2017-09-28 12:41:08.800 5938 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:41:08 ctl02 nova-api[5938]: 2017-09-28 12:41:08.800 5938 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:41:08 ctl02 nova-api[5938]: 2017-09-28 12:41:08.800 5938 ERROR nova.wsgi     self.filename))
Sep 28 12:41:08 ctl02 nova-api[5938]: 2017-09-28 12:41:08.800 5938 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:41:08 ctl02 nova-api[5938]: 2017-09-28 12:41:08.800 5938 ERROR nova.wsgi
Sep 28 12:41:08 ctl02 nova-api[5938]: 2017-09-28 12:41:08.801 5938 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:41:08 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf60a2a7d)
Sep 28 12:41:08 ctl02 nova-api[5938]: 2017-09-28 12:41:08.936 5938 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:41:09 ctl02 heat-api[13008]: 2017-09-28 12:41:09.165 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:41:09] "OPTIONS / HTTP/1.0" 200 134 0.000658
Sep 28 12:41:09 ctl02 nova-api[5938]: 2017-09-28 12:41:09.186 5938 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:41:09 ctl02 nova-api[5938]: 2017-09-28 12:41:09.188 5938 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:41:09 ctl02 nova-api[5938]: 2017-09-28 12:41:09.188 5938 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:41:09 ctl02 nova-api[5938]: 2017-09-28 12:41:09.188 5938 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:41:09 ctl02 nova-api[5938]: 2017-09-28 12:41:09.321 5938 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:41:09 ctl02 nova-api[5938]: 2017-09-28 12:41:09.323 5938 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:41:09 ctl02 nova-api[5938]: 2017-09-28 12:41:09.323 5938 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:41:09 ctl02 nova-api[5938]: 2017-09-28 12:41:09.323 5938 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:41:09 ctl02 nova-api[5938]: 2017-09-28 12:41:09.327 5938 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:41:09 ctl02 nova-api[5938]: 2017-09-28 12:41:09.327 5938 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:41:09 ctl02 nova-api[5938]: 2017-09-28 12:41:09.327 5938 ERROR nova Traceback (most recent call last):
Sep 28 12:41:09 ctl02 nova-api[5938]: 2017-09-28 12:41:09.327 5938 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:41:09 ctl02 nova-api[5938]: 2017-09-28 12:41:09.327 5938 ERROR nova     sys.exit(main())
Sep 28 12:41:09 ctl02 nova-api[5938]: 2017-09-28 12:41:09.327 5938 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:41:09 ctl02 nova-api[5938]: 2017-09-28 12:41:09.327 5938 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:41:09 ctl02 nova-api[5938]: 2017-09-28 12:41:09.327 5938 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:41:09 ctl02 nova-api[5938]: 2017-09-28 12:41:09.327 5938 ERROR nova     max_url_len=max_url_len)
Sep 28 12:41:09 ctl02 nova-api[5938]: 2017-09-28 12:41:09.327 5938 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:41:09 ctl02 nova-api[5938]: 2017-09-28 12:41:09.327 5938 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:41:09 ctl02 nova-api[5938]: 2017-09-28 12:41:09.327 5938 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:41:09 ctl02 nova-api[5938]: 2017-09-28 12:41:09.327 5938 ERROR nova     sock.listen(backlog)
Sep 28 12:41:09 ctl02 nova-api[5938]: 2017-09-28 12:41:09.327 5938 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:41:09 ctl02 nova-api[5938]: 2017-09-28 12:41:09.327 5938 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:41:09 ctl02 nova-api[5938]: 2017-09-28 12:41:09.327 5938 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:41:09 ctl02 nova-api[5938]: 2017-09-28 12:41:09.327 5938 ERROR nova
Sep 28 12:41:09 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:41:09 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:41:09 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:41:09 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:41:09 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:41:09 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:41:09 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:41:09 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf60a2a7d)
Sep 28 12:41:10 ctl02 heat-api-cfn[13300]: 2017-09-28 12:41:10.040 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:41:10] "OPTIONS / HTTP/1.0" 200 134 0.000787
Sep 28 12:41:10 ctl02 neutron-server[30536]: 2017-09-28 12:41:10.052 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:41:10] "OPTIONS / HTTP/1.0" 200 262 0.000771
Sep 28 12:41:10 ctl02 neutron-server[30536]: 2017-09-28 12:41:10.257 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:41:10] "OPTIONS / HTTP/1.0" 200 262 0.000511
Sep 28 12:41:10 ctl02 nova-cert[4860]: 2017-09-28 12:41:10.507 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:41:10 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf60a2a7d)
Sep 28 12:41:10 ctl02 glance-api[29183]: 2017-09-28 12:41:10.845 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:41:10] "OPTIONS / HTTP/1.0" 200 134 0.000633
Sep 28 12:41:10 ctl02 nova-conductor[5056]: 2017-09-28 12:41:10.916 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:41:10 ctl02 nova-conductor[5056]: 2017-09-28 12:41:10.938 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:41:10 ctl02 nova-conductor[5056]: 2017-09-28 12:41:10.946 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:41:10 ctl02 nova-conductor[5056]: 2017-09-28 12:41:10.952 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:41:11 ctl02 neutron-server[30536]: 2017-09-28 12:41:11.114 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:41:11] "OPTIONS / HTTP/1.0" 200 262 0.000566
Sep 28 12:41:11 ctl02 nova-api[5956]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:41:11 ctl02 nova-api[5956]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:41:11 ctl02 glance-api[29183]: 2017-09-28 12:41:11.474 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:41:11] "OPTIONS / HTTP/1.0" 200 134 0.000611
Sep 28 12:41:11 ctl02 nova-api[5956]: 2017-09-28 12:41:11.557 5956 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:41:11 ctl02 nova-api[5956]: 2017-09-28 12:41:11.559 5956 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:41:11 ctl02 nova-api[5956]: 2017-09-28 12:41:11.559 5956 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:41:11 ctl02 nova-api[5956]: 2017-09-28 12:41:11.559 5956 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:41:11 ctl02 nova-api[5956]: 2017-09-28 12:41:11.559 5956 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:41:11 ctl02 nova-api[5956]: 2017-09-28 12:41:11.559 5956 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:41:11 ctl02 nova-api[5956]: 2017-09-28 12:41:11.559 5956 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:41:11 ctl02 nova-api[5956]: 2017-09-28 12:41:11.559 5956 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:41:11 ctl02 nova-api[5956]: 2017-09-28 12:41:11.559 5956 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:41:11 ctl02 nova-api[5956]: 2017-09-28 12:41:11.559 5956 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:41:11 ctl02 nova-api[5956]: 2017-09-28 12:41:11.559 5956 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:41:11 ctl02 nova-api[5956]: 2017-09-28 12:41:11.559 5956 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:41:11 ctl02 nova-api[5956]: 2017-09-28 12:41:11.559 5956 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:41:11 ctl02 nova-api[5956]: 2017-09-28 12:41:11.559 5956 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:41:11 ctl02 nova-api[5956]: 2017-09-28 12:41:11.559 5956 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:41:11 ctl02 nova-api[5956]: 2017-09-28 12:41:11.559 5956 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:41:11 ctl02 nova-api[5956]: 2017-09-28 12:41:11.559 5956 ERROR nova.wsgi     self.filename))
Sep 28 12:41:11 ctl02 nova-api[5956]: 2017-09-28 12:41:11.559 5956 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:41:11 ctl02 nova-api[5956]: 2017-09-28 12:41:11.559 5956 ERROR nova.wsgi
Sep 28 12:41:11 ctl02 nova-api[5956]: 2017-09-28 12:41:11.560 5956 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:41:11 ctl02 nova-api[5956]: 2017-09-28 12:41:11.697 5956 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:41:11 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf60a2a7d)
Sep 28 12:41:11 ctl02 nova-api[5956]: 2017-09-28 12:41:11.926 5956 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:41:11 ctl02 nova-api[5956]: 2017-09-28 12:41:11.929 5956 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:41:11 ctl02 nova-api[5956]: 2017-09-28 12:41:11.929 5956 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:41:11 ctl02 nova-api[5956]: 2017-09-28 12:41:11.929 5956 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:41:12 ctl02 nova-api[5956]: 2017-09-28 12:41:12.066 5956 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:41:12 ctl02 nova-api[5956]: 2017-09-28 12:41:12.068 5956 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:41:12 ctl02 nova-api[5956]: 2017-09-28 12:41:12.068 5956 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:41:12 ctl02 nova-api[5956]: 2017-09-28 12:41:12.069 5956 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:41:12 ctl02 nova-api[5956]: 2017-09-28 12:41:12.072 5956 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:41:12 ctl02 nova-api[5956]: 2017-09-28 12:41:12.072 5956 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:41:12 ctl02 nova-api[5956]: 2017-09-28 12:41:12.072 5956 ERROR nova Traceback (most recent call last):
Sep 28 12:41:12 ctl02 nova-api[5956]: 2017-09-28 12:41:12.072 5956 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:41:12 ctl02 nova-api[5956]: 2017-09-28 12:41:12.072 5956 ERROR nova     sys.exit(main())
Sep 28 12:41:12 ctl02 nova-api[5956]: 2017-09-28 12:41:12.072 5956 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:41:12 ctl02 nova-api[5956]: 2017-09-28 12:41:12.072 5956 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:41:12 ctl02 nova-api[5956]: 2017-09-28 12:41:12.072 5956 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:41:12 ctl02 nova-api[5956]: 2017-09-28 12:41:12.072 5956 ERROR nova     max_url_len=max_url_len)
Sep 28 12:41:12 ctl02 nova-api[5956]: 2017-09-28 12:41:12.072 5956 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:41:12 ctl02 nova-api[5956]: 2017-09-28 12:41:12.072 5956 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:41:12 ctl02 nova-api[5956]: 2017-09-28 12:41:12.072 5956 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:41:12 ctl02 nova-api[5956]: 2017-09-28 12:41:12.072 5956 ERROR nova     sock.listen(backlog)
Sep 28 12:41:12 ctl02 nova-api[5956]: 2017-09-28 12:41:12.072 5956 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:41:12 ctl02 nova-api[5956]: 2017-09-28 12:41:12.072 5956 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:41:12 ctl02 nova-api[5956]: 2017-09-28 12:41:12.072 5956 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:41:12 ctl02 nova-api[5956]: 2017-09-28 12:41:12.072 5956 ERROR nova
Sep 28 12:41:12 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:41:12 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:41:12 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:41:12 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:41:12 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:41:12 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:41:12 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:41:12 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:41:12.436 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:41:12] "OPTIONS / HTTP/1.0" 200 134 0.000534
Sep 28 12:41:12 ctl02 heat-api-cfn[13300]: 2017-09-28 12:41:12.538 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:41:12] "OPTIONS / HTTP/1.0" 200 134 0.000635
Sep 28 12:41:12 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf60a2a7d)
Sep 28 12:41:12 ctl02 glance-api[29183]: 2017-09-28 12:41:12.978 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:41:12] "OPTIONS / HTTP/1.0" 200 134 0.000632
Sep 28 12:41:13 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf60a2a7d)
Sep 28 12:41:14 ctl02 nova-api[5973]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:41:14 ctl02 nova-api[5973]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:41:14 ctl02 nova-api[5973]: 2017-09-28 12:41:14.275 5973 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:41:14 ctl02 nova-api[5973]: 2017-09-28 12:41:14.277 5973 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:41:14 ctl02 nova-api[5973]: 2017-09-28 12:41:14.277 5973 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:41:14 ctl02 nova-api[5973]: 2017-09-28 12:41:14.277 5973 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:41:14 ctl02 nova-api[5973]: 2017-09-28 12:41:14.277 5973 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:41:14 ctl02 nova-api[5973]: 2017-09-28 12:41:14.277 5973 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:41:14 ctl02 nova-api[5973]: 2017-09-28 12:41:14.277 5973 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:41:14 ctl02 nova-api[5973]: 2017-09-28 12:41:14.277 5973 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:41:14 ctl02 nova-api[5973]: 2017-09-28 12:41:14.277 5973 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:41:14 ctl02 nova-api[5973]: 2017-09-28 12:41:14.277 5973 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:41:14 ctl02 nova-api[5973]: 2017-09-28 12:41:14.277 5973 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:41:14 ctl02 nova-api[5973]: 2017-09-28 12:41:14.277 5973 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:41:14 ctl02 nova-api[5973]: 2017-09-28 12:41:14.277 5973 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:41:14 ctl02 nova-api[5973]: 2017-09-28 12:41:14.277 5973 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:41:14 ctl02 nova-api[5973]: 2017-09-28 12:41:14.277 5973 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:41:14 ctl02 nova-api[5973]: 2017-09-28 12:41:14.277 5973 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:41:14 ctl02 nova-api[5973]: 2017-09-28 12:41:14.277 5973 ERROR nova.wsgi     self.filename))
Sep 28 12:41:14 ctl02 nova-api[5973]: 2017-09-28 12:41:14.277 5973 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:41:14 ctl02 nova-api[5973]: 2017-09-28 12:41:14.277 5973 ERROR nova.wsgi
Sep 28 12:41:14 ctl02 nova-api[5973]: 2017-09-28 12:41:14.279 5973 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:41:14 ctl02 nova-api[5973]: 2017-09-28 12:41:14.413 5973 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:41:14 ctl02 nova-api[5973]: 2017-09-28 12:41:14.644 5973 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:41:14 ctl02 nova-api[5973]: 2017-09-28 12:41:14.647 5973 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:41:14 ctl02 nova-api[5973]: 2017-09-28 12:41:14.648 5973 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:41:14 ctl02 nova-api[5973]: 2017-09-28 12:41:14.648 5973 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:41:14 ctl02 nova-api[5973]: 2017-09-28 12:41:14.782 5973 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:41:14 ctl02 nova-api[5973]: 2017-09-28 12:41:14.785 5973 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:41:14 ctl02 nova-api[5973]: 2017-09-28 12:41:14.785 5973 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:41:14 ctl02 nova-api[5973]: 2017-09-28 12:41:14.785 5973 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:41:14 ctl02 nova-api[5973]: 2017-09-28 12:41:14.789 5973 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:41:14 ctl02 nova-api[5973]: 2017-09-28 12:41:14.789 5973 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:41:14 ctl02 nova-api[5973]: 2017-09-28 12:41:14.789 5973 ERROR nova Traceback (most recent call last):
Sep 28 12:41:14 ctl02 nova-api[5973]: 2017-09-28 12:41:14.789 5973 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:41:14 ctl02 nova-api[5973]: 2017-09-28 12:41:14.789 5973 ERROR nova     sys.exit(main())
Sep 28 12:41:14 ctl02 nova-api[5973]: 2017-09-28 12:41:14.789 5973 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:41:14 ctl02 nova-api[5973]: 2017-09-28 12:41:14.789 5973 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:41:14 ctl02 nova-api[5973]: 2017-09-28 12:41:14.789 5973 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:41:14 ctl02 nova-api[5973]: 2017-09-28 12:41:14.789 5973 ERROR nova     max_url_len=max_url_len)
Sep 28 12:41:14 ctl02 nova-api[5973]: 2017-09-28 12:41:14.789 5973 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:41:14 ctl02 nova-api[5973]: 2017-09-28 12:41:14.789 5973 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:41:14 ctl02 nova-api[5973]: 2017-09-28 12:41:14.789 5973 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:41:14 ctl02 nova-api[5973]: 2017-09-28 12:41:14.789 5973 ERROR nova     sock.listen(backlog)
Sep 28 12:41:14 ctl02 nova-api[5973]: 2017-09-28 12:41:14.789 5973 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:41:14 ctl02 nova-api[5973]: 2017-09-28 12:41:14.789 5973 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:41:14 ctl02 nova-api[5973]: 2017-09-28 12:41:14.789 5973 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:41:14 ctl02 nova-api[5973]: 2017-09-28 12:41:14.789 5973 ERROR nova
Sep 28 12:41:14 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:41:14 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:41:14 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:41:14 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:41:14 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:41:15 ctl02 heat-api[13008]: 2017-09-28 12:41:15.034 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:41:15] "OPTIONS / HTTP/1.0" 200 134 0.000618
Sep 28 12:41:15 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:41:15 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:41:15 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:41:15 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:41:16 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:41:16.135 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:41:16] "OPTIONS / HTTP/1.0" 200 134 0.000477
Sep 28 12:41:16 ctl02 nova-api[5997]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:41:16 ctl02 nova-api[5997]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:41:16 ctl02 nova-api[5997]: 2017-09-28 12:41:16.996 5997 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:41:16 ctl02 nova-api[5997]: 2017-09-28 12:41:16.998 5997 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:41:16 ctl02 nova-api[5997]: 2017-09-28 12:41:16.998 5997 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:41:16 ctl02 nova-api[5997]: 2017-09-28 12:41:16.998 5997 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:41:16 ctl02 nova-api[5997]: 2017-09-28 12:41:16.998 5997 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:41:16 ctl02 nova-api[5997]: 2017-09-28 12:41:16.998 5997 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:41:16 ctl02 nova-api[5997]: 2017-09-28 12:41:16.998 5997 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:41:16 ctl02 nova-api[5997]: 2017-09-28 12:41:16.998 5997 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:41:16 ctl02 nova-api[5997]: 2017-09-28 12:41:16.998 5997 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:41:16 ctl02 nova-api[5997]: 2017-09-28 12:41:16.998 5997 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:41:16 ctl02 nova-api[5997]: 2017-09-28 12:41:16.998 5997 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:41:16 ctl02 nova-api[5997]: 2017-09-28 12:41:16.998 5997 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:41:17 ctl02 nova-api[5997]: 2017-09-28 12:41:16.998 5997 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:41:17 ctl02 nova-api[5997]: 2017-09-28 12:41:16.998 5997 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:41:17 ctl02 nova-api[5997]: 2017-09-28 12:41:16.998 5997 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:41:17 ctl02 nova-api[5997]: 2017-09-28 12:41:16.998 5997 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:41:17 ctl02 nova-api[5997]: 2017-09-28 12:41:16.998 5997 ERROR nova.wsgi     self.filename))
Sep 28 12:41:17 ctl02 nova-api[5997]: 2017-09-28 12:41:16.998 5997 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:41:17 ctl02 nova-api[5997]: 2017-09-28 12:41:16.998 5997 ERROR nova.wsgi
Sep 28 12:41:17 ctl02 nova-api[5997]: 2017-09-28 12:41:16.999 5997 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:41:17 ctl02 heat-api[13008]: 2017-09-28 12:41:17.108 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:41:17] "OPTIONS / HTTP/1.0" 200 134 0.000703
Sep 28 12:41:17 ctl02 nova-api[5997]: 2017-09-28 12:41:17.130 5997 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:41:17 ctl02 nova-api[5997]: 2017-09-28 12:41:17.358 5997 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:41:17 ctl02 nova-api[5997]: 2017-09-28 12:41:17.360 5997 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:41:17 ctl02 nova-api[5997]: 2017-09-28 12:41:17.360 5997 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:41:17 ctl02 nova-api[5997]: 2017-09-28 12:41:17.361 5997 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:41:17 ctl02 nova-api[5997]: 2017-09-28 12:41:17.495 5997 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:41:17 ctl02 nova-api[5997]: 2017-09-28 12:41:17.497 5997 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:41:17 ctl02 nova-api[5997]: 2017-09-28 12:41:17.498 5997 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:41:17 ctl02 nova-api[5997]: 2017-09-28 12:41:17.498 5997 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:41:17 ctl02 nova-api[5997]: 2017-09-28 12:41:17.501 5997 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:41:17 ctl02 nova-api[5997]: 2017-09-28 12:41:17.501 5997 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:41:17 ctl02 nova-api[5997]: 2017-09-28 12:41:17.501 5997 ERROR nova Traceback (most recent call last):
Sep 28 12:41:17 ctl02 nova-api[5997]: 2017-09-28 12:41:17.501 5997 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:41:17 ctl02 nova-api[5997]: 2017-09-28 12:41:17.501 5997 ERROR nova     sys.exit(main())
Sep 28 12:41:17 ctl02 nova-api[5997]: 2017-09-28 12:41:17.501 5997 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:41:17 ctl02 nova-api[5997]: 2017-09-28 12:41:17.501 5997 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:41:17 ctl02 nova-api[5997]: 2017-09-28 12:41:17.501 5997 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:41:17 ctl02 nova-api[5997]: 2017-09-28 12:41:17.501 5997 ERROR nova     max_url_len=max_url_len)
Sep 28 12:41:17 ctl02 nova-api[5997]: 2017-09-28 12:41:17.501 5997 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:41:17 ctl02 nova-api[5997]: 2017-09-28 12:41:17.501 5997 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:41:17 ctl02 nova-api[5997]: 2017-09-28 12:41:17.501 5997 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:41:17 ctl02 nova-api[5997]: 2017-09-28 12:41:17.501 5997 ERROR nova     sock.listen(backlog)
Sep 28 12:41:17 ctl02 nova-api[5997]: 2017-09-28 12:41:17.501 5997 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:41:17 ctl02 nova-api[5997]: 2017-09-28 12:41:17.501 5997 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:41:17 ctl02 nova-api[5997]: 2017-09-28 12:41:17.501 5997 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:41:17 ctl02 nova-api[5997]: 2017-09-28 12:41:17.501 5997 ERROR nova
Sep 28 12:41:17 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:41:17 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:41:17 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:41:17 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:41:17 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:41:17 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:41:17 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:41:18 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:41:18.000 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:41:18] "OPTIONS / HTTP/1.0" 200 134 0.000430
Sep 28 12:41:18 ctl02 heat-api-cfn[13300]: 2017-09-28 12:41:18.478 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:41:18] "OPTIONS / HTTP/1.0" 200 134 0.000606
Sep 28 12:41:18 ctl02 heat-api[13008]: 2017-09-28 12:41:18.951 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:41:18] "OPTIONS / HTTP/1.0" 200 134 0.000683
Sep 28 12:41:19 ctl02 nova-api[6015]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:41:19 ctl02 nova-api[6015]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:41:19 ctl02 nova-api[6015]: 2017-09-28 12:41:19.748 6015 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:41:19 ctl02 nova-api[6015]: 2017-09-28 12:41:19.750 6015 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:41:19 ctl02 nova-api[6015]: 2017-09-28 12:41:19.750 6015 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:41:19 ctl02 nova-api[6015]: 2017-09-28 12:41:19.750 6015 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:41:19 ctl02 nova-api[6015]: 2017-09-28 12:41:19.750 6015 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:41:19 ctl02 nova-api[6015]: 2017-09-28 12:41:19.750 6015 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:41:19 ctl02 nova-api[6015]: 2017-09-28 12:41:19.750 6015 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:41:19 ctl02 nova-api[6015]: 2017-09-28 12:41:19.750 6015 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:41:19 ctl02 nova-api[6015]: 2017-09-28 12:41:19.750 6015 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:41:19 ctl02 nova-api[6015]: 2017-09-28 12:41:19.750 6015 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:41:19 ctl02 nova-api[6015]: 2017-09-28 12:41:19.750 6015 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:41:19 ctl02 nova-api[6015]: 2017-09-28 12:41:19.750 6015 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:41:19 ctl02 nova-api[6015]: 2017-09-28 12:41:19.750 6015 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:41:19 ctl02 nova-api[6015]: 2017-09-28 12:41:19.750 6015 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:41:19 ctl02 nova-api[6015]: 2017-09-28 12:41:19.750 6015 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:41:19 ctl02 nova-api[6015]: 2017-09-28 12:41:19.750 6015 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:41:19 ctl02 nova-api[6015]: 2017-09-28 12:41:19.750 6015 ERROR nova.wsgi     self.filename))
Sep 28 12:41:19 ctl02 nova-api[6015]: 2017-09-28 12:41:19.750 6015 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:41:19 ctl02 nova-api[6015]: 2017-09-28 12:41:19.750 6015 ERROR nova.wsgi
Sep 28 12:41:19 ctl02 nova-api[6015]: 2017-09-28 12:41:19.750 6015 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:41:19 ctl02 nova-api[6015]: 2017-09-28 12:41:19.880 6015 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:41:20 ctl02 neutron-server[30536]: 2017-09-28 12:41:20.079 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:41:20] "OPTIONS / HTTP/1.0" 200 262 0.000629
Sep 28 12:41:20 ctl02 nova-api[6015]: 2017-09-28 12:41:20.106 6015 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:41:20 ctl02 nova-api[6015]: 2017-09-28 12:41:20.108 6015 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:41:20 ctl02 nova-api[6015]: 2017-09-28 12:41:20.108 6015 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:41:20 ctl02 nova-api[6015]: 2017-09-28 12:41:20.108 6015 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:41:20 ctl02 heat-api-cfn[13300]: 2017-09-28 12:41:20.149 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:41:20] "OPTIONS / HTTP/1.0" 200 134 0.000530
Sep 28 12:41:20 ctl02 nova-api[6015]: 2017-09-28 12:41:20.239 6015 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:41:20 ctl02 nova-api[6015]: 2017-09-28 12:41:20.241 6015 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:41:20 ctl02 nova-api[6015]: 2017-09-28 12:41:20.241 6015 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:41:20 ctl02 nova-api[6015]: 2017-09-28 12:41:20.241 6015 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:41:20 ctl02 nova-api[6015]: 2017-09-28 12:41:20.245 6015 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:41:20 ctl02 nova-api[6015]: 2017-09-28 12:41:20.245 6015 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:41:20 ctl02 nova-api[6015]: 2017-09-28 12:41:20.245 6015 ERROR nova Traceback (most recent call last):
Sep 28 12:41:20 ctl02 nova-api[6015]: 2017-09-28 12:41:20.245 6015 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:41:20 ctl02 nova-api[6015]: 2017-09-28 12:41:20.245 6015 ERROR nova     sys.exit(main())
Sep 28 12:41:20 ctl02 nova-api[6015]: 2017-09-28 12:41:20.245 6015 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:41:20 ctl02 nova-api[6015]: 2017-09-28 12:41:20.245 6015 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:41:20 ctl02 nova-api[6015]: 2017-09-28 12:41:20.245 6015 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:41:20 ctl02 nova-api[6015]: 2017-09-28 12:41:20.245 6015 ERROR nova     max_url_len=max_url_len)
Sep 28 12:41:20 ctl02 nova-api[6015]: 2017-09-28 12:41:20.245 6015 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:41:20 ctl02 nova-api[6015]: 2017-09-28 12:41:20.245 6015 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:41:20 ctl02 nova-api[6015]: 2017-09-28 12:41:20.245 6015 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:41:20 ctl02 nova-api[6015]: 2017-09-28 12:41:20.245 6015 ERROR nova     sock.listen(backlog)
Sep 28 12:41:20 ctl02 nova-api[6015]: 2017-09-28 12:41:20.245 6015 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:41:20 ctl02 nova-api[6015]: 2017-09-28 12:41:20.245 6015 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:41:20 ctl02 nova-api[6015]: 2017-09-28 12:41:20.245 6015 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:41:20 ctl02 nova-api[6015]: 2017-09-28 12:41:20.245 6015 ERROR nova
Sep 28 12:41:20 ctl02 neutron-server[30536]: 2017-09-28 12:41:20.249 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:41:20] "OPTIONS / HTTP/1.0" 200 262 0.000605
Sep 28 12:41:20 ctl02 nova-consoleauth[5433]: 2017-09-28 12:41:20.363 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:41:20 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:41:20 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:41:20 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:41:20 ctl02 glance-api[29183]: 2017-09-28 12:41:20.544 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:41:20] "OPTIONS / HTTP/1.0" 200 134 0.001189
Sep 28 12:41:20 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:41:20 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:41:20 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:41:20 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:41:21 ctl02 neutron-server[30536]: 2017-09-28 12:41:21.385 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:41:21] "OPTIONS / HTTP/1.0" 200 262 0.000526
Sep 28 12:41:21 ctl02 glance-api[29183]: 2017-09-28 12:41:21.453 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:41:21] "OPTIONS / HTTP/1.0" 200 134 0.000549
Sep 28 12:41:22 ctl02 heat-engine[12803]: 2017-09-28 12:41:22.058 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:41:22 ctl02 heat-engine[12803]: 2017-09-28 12:41:22.059 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:41:22 ctl02 heat-engine[12803]: 2017-09-28 12:41:22.063 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:41:22 ctl02 heat-engine[12803]: 2017-09-28 12:41:22.069 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:41:22 ctl02 nova-api[6032]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:41:22 ctl02 nova-api[6032]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:41:22 ctl02 nova-api[6032]: 2017-09-28 12:41:22.536 6032 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:41:22 ctl02 nova-api[6032]: 2017-09-28 12:41:22.538 6032 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:41:22 ctl02 nova-api[6032]: 2017-09-28 12:41:22.538 6032 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:41:22 ctl02 nova-api[6032]: 2017-09-28 12:41:22.538 6032 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:41:22 ctl02 nova-api[6032]: 2017-09-28 12:41:22.538 6032 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:41:22 ctl02 nova-api[6032]: 2017-09-28 12:41:22.538 6032 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:41:22 ctl02 nova-api[6032]: 2017-09-28 12:41:22.538 6032 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:41:22 ctl02 nova-api[6032]: 2017-09-28 12:41:22.538 6032 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:41:22 ctl02 nova-api[6032]: 2017-09-28 12:41:22.538 6032 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:41:22 ctl02 nova-api[6032]: 2017-09-28 12:41:22.538 6032 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:41:22 ctl02 nova-api[6032]: 2017-09-28 12:41:22.538 6032 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:41:22 ctl02 nova-api[6032]: 2017-09-28 12:41:22.538 6032 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:41:22 ctl02 nova-api[6032]: 2017-09-28 12:41:22.538 6032 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:41:22 ctl02 nova-api[6032]: 2017-09-28 12:41:22.538 6032 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:41:22 ctl02 nova-api[6032]: 2017-09-28 12:41:22.538 6032 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:41:22 ctl02 nova-api[6032]: 2017-09-28 12:41:22.538 6032 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:41:22 ctl02 nova-api[6032]: 2017-09-28 12:41:22.538 6032 ERROR nova.wsgi     self.filename))
Sep 28 12:41:22 ctl02 nova-api[6032]: 2017-09-28 12:41:22.538 6032 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:41:22 ctl02 nova-api[6032]: 2017-09-28 12:41:22.538 6032 ERROR nova.wsgi
Sep 28 12:41:22 ctl02 nova-api[6032]: 2017-09-28 12:41:22.540 6032 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:41:22 ctl02 glance-api[29183]: 2017-09-28 12:41:22.624 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:41:22] "OPTIONS / HTTP/1.0" 200 134 0.000574
Sep 28 12:41:22 ctl02 nova-api[6032]: 2017-09-28 12:41:22.671 6032 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:41:22 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:41:22.810 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:41:22] "OPTIONS / HTTP/1.0" 200 134 0.000396
Sep 28 12:41:22 ctl02 heat-api-cfn[13300]: 2017-09-28 12:41:22.872 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:41:22] "OPTIONS / HTTP/1.0" 200 134 0.000479
Sep 28 12:41:22 ctl02 nova-api[6032]: 2017-09-28 12:41:22.910 6032 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:41:22 ctl02 nova-api[6032]: 2017-09-28 12:41:22.913 6032 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:41:22 ctl02 nova-api[6032]: 2017-09-28 12:41:22.913 6032 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:41:22 ctl02 nova-api[6032]: 2017-09-28 12:41:22.913 6032 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:41:23 ctl02 nova-api[6032]: 2017-09-28 12:41:23.048 6032 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:41:23 ctl02 nova-api[6032]: 2017-09-28 12:41:23.050 6032 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:41:23 ctl02 nova-api[6032]: 2017-09-28 12:41:23.050 6032 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:41:23 ctl02 nova-api[6032]: 2017-09-28 12:41:23.050 6032 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:41:23 ctl02 nova-api[6032]: 2017-09-28 12:41:23.054 6032 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:41:23 ctl02 nova-api[6032]: 2017-09-28 12:41:23.054 6032 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:41:23 ctl02 nova-api[6032]: 2017-09-28 12:41:23.054 6032 ERROR nova Traceback (most recent call last):
Sep 28 12:41:23 ctl02 nova-api[6032]: 2017-09-28 12:41:23.054 6032 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:41:23 ctl02 nova-api[6032]: 2017-09-28 12:41:23.054 6032 ERROR nova     sys.exit(main())
Sep 28 12:41:23 ctl02 nova-api[6032]: 2017-09-28 12:41:23.054 6032 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:41:23 ctl02 nova-api[6032]: 2017-09-28 12:41:23.054 6032 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:41:23 ctl02 nova-api[6032]: 2017-09-28 12:41:23.054 6032 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:41:23 ctl02 nova-api[6032]: 2017-09-28 12:41:23.054 6032 ERROR nova     max_url_len=max_url_len)
Sep 28 12:41:23 ctl02 nova-api[6032]: 2017-09-28 12:41:23.054 6032 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:41:23 ctl02 nova-api[6032]: 2017-09-28 12:41:23.054 6032 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:41:23 ctl02 nova-api[6032]: 2017-09-28 12:41:23.054 6032 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:41:23 ctl02 nova-api[6032]: 2017-09-28 12:41:23.054 6032 ERROR nova     sock.listen(backlog)
Sep 28 12:41:23 ctl02 nova-api[6032]: 2017-09-28 12:41:23.054 6032 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:41:23 ctl02 nova-api[6032]: 2017-09-28 12:41:23.054 6032 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:41:23 ctl02 nova-api[6032]: 2017-09-28 12:41:23.054 6032 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:41:23 ctl02 nova-api[6032]: 2017-09-28 12:41:23.054 6032 ERROR nova
Sep 28 12:41:23 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:41:23 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:41:23 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:41:23 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:41:23 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:41:23 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:41:23 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:41:23 ctl02 nova-scheduler[5620]: 2017-09-28 12:41:23.455 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:41:25 ctl02 nova-api[6051]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:41:25 ctl02 nova-api[6051]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:41:25 ctl02 nova-api[6051]: 2017-09-28 12:41:25.256 6051 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:41:25 ctl02 nova-api[6051]: 2017-09-28 12:41:25.257 6051 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:41:25 ctl02 nova-api[6051]: 2017-09-28 12:41:25.257 6051 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:41:25 ctl02 nova-api[6051]: 2017-09-28 12:41:25.257 6051 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:41:25 ctl02 nova-api[6051]: 2017-09-28 12:41:25.257 6051 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:41:25 ctl02 nova-api[6051]: 2017-09-28 12:41:25.257 6051 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:41:25 ctl02 nova-api[6051]: 2017-09-28 12:41:25.257 6051 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:41:25 ctl02 nova-api[6051]: 2017-09-28 12:41:25.257 6051 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:41:25 ctl02 nova-api[6051]: 2017-09-28 12:41:25.257 6051 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:41:25 ctl02 nova-api[6051]: 2017-09-28 12:41:25.257 6051 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:41:25 ctl02 nova-api[6051]: 2017-09-28 12:41:25.257 6051 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:41:25 ctl02 nova-api[6051]: 2017-09-28 12:41:25.257 6051 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:41:25 ctl02 nova-api[6051]: 2017-09-28 12:41:25.257 6051 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:41:25 ctl02 nova-api[6051]: 2017-09-28 12:41:25.257 6051 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:41:25 ctl02 nova-api[6051]: 2017-09-28 12:41:25.257 6051 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:41:25 ctl02 nova-api[6051]: 2017-09-28 12:41:25.257 6051 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:41:25 ctl02 nova-api[6051]: 2017-09-28 12:41:25.257 6051 ERROR nova.wsgi     self.filename))
Sep 28 12:41:25 ctl02 nova-api[6051]: 2017-09-28 12:41:25.257 6051 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:41:25 ctl02 nova-api[6051]: 2017-09-28 12:41:25.257 6051 ERROR nova.wsgi
Sep 28 12:41:25 ctl02 nova-api[6051]: 2017-09-28 12:41:25.258 6051 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:41:25 ctl02 heat-api[13008]: 2017-09-28 12:41:25.274 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:41:25] "OPTIONS / HTTP/1.0" 200 134 0.000542
Sep 28 12:41:25 ctl02 nova-api[6051]: 2017-09-28 12:41:25.388 6051 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:41:25 ctl02 nova-api[6051]: 2017-09-28 12:41:25.624 6051 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:41:25 ctl02 nova-api[6051]: 2017-09-28 12:41:25.627 6051 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:41:25 ctl02 nova-api[6051]: 2017-09-28 12:41:25.627 6051 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:41:25 ctl02 nova-api[6051]: 2017-09-28 12:41:25.627 6051 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:41:25 ctl02 nova-api[6051]: 2017-09-28 12:41:25.759 6051 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:41:25 ctl02 nova-api[6051]: 2017-09-28 12:41:25.761 6051 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:41:25 ctl02 nova-api[6051]: 2017-09-28 12:41:25.761 6051 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:41:25 ctl02 nova-api[6051]: 2017-09-28 12:41:25.762 6051 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:41:25 ctl02 nova-api[6051]: 2017-09-28 12:41:25.765 6051 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:41:25 ctl02 nova-api[6051]: 2017-09-28 12:41:25.765 6051 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:41:25 ctl02 nova-api[6051]: 2017-09-28 12:41:25.765 6051 ERROR nova Traceback (most recent call last):
Sep 28 12:41:25 ctl02 nova-api[6051]: 2017-09-28 12:41:25.765 6051 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:41:25 ctl02 nova-api[6051]: 2017-09-28 12:41:25.765 6051 ERROR nova     sys.exit(main())
Sep 28 12:41:25 ctl02 nova-api[6051]: 2017-09-28 12:41:25.765 6051 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:41:25 ctl02 nova-api[6051]: 2017-09-28 12:41:25.765 6051 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:41:25 ctl02 nova-api[6051]: 2017-09-28 12:41:25.765 6051 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:41:25 ctl02 nova-api[6051]: 2017-09-28 12:41:25.765 6051 ERROR nova     max_url_len=max_url_len)
Sep 28 12:41:25 ctl02 nova-api[6051]: 2017-09-28 12:41:25.765 6051 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:41:25 ctl02 nova-api[6051]: 2017-09-28 12:41:25.765 6051 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:41:25 ctl02 nova-api[6051]: 2017-09-28 12:41:25.765 6051 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:41:25 ctl02 nova-api[6051]: 2017-09-28 12:41:25.765 6051 ERROR nova     sock.listen(backlog)
Sep 28 12:41:25 ctl02 nova-api[6051]: 2017-09-28 12:41:25.765 6051 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:41:25 ctl02 nova-api[6051]: 2017-09-28 12:41:25.765 6051 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:41:25 ctl02 nova-api[6051]: 2017-09-28 12:41:25.765 6051 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:41:25 ctl02 nova-api[6051]: 2017-09-28 12:41:25.765 6051 ERROR nova
Sep 28 12:41:25 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:41:25 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:41:25 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:41:26 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:41:26 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:41:26 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:41:26 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:41:26 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:41:26.432 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:41:26] "OPTIONS / HTTP/1.0" 200 134 0.000424
Sep 28 12:41:26 ctl02 heat-api[13008]: 2017-09-28 12:41:26.947 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:41:26] "OPTIONS / HTTP/1.0" 200 134 0.000553
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.668 30536 ERROR oslo_messaging.rpc.dispatcher [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Exception during message handling: (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vi
Sep 28 12:41:27 ctl02 neutron-server[30536]: f_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability
Sep 28 12:41:27 ctl02 neutron-server[30536]: _zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipal
Sep 28 12:41:27 ctl02 neutron-server[30536]: locations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id']
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.668 30536 ERROR oslo_messaging.rpc.dispatcher Traceback (most recent call last):
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.668 30536 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.668 30536 ERROR oslo_messaging.rpc.dispatcher     incoming.message))
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.668 30536 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.668 30536 ERROR oslo_messaging.rpc.dispatcher     return self._do_dispatch(endpoint, method, ctxt, args)
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.668 30536 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.668 30536 ERROR oslo_messaging.rpc.dispatcher     result = func(ctxt, **new_args)
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.668 30536 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.668 30536 ERROR oslo_messaging.rpc.dispatcher     router_ids=None)
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.668 30536 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.668 30536 ERROR oslo_messaging.rpc.dispatcher     self, context, host, router_ids)
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.668 30536 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.668 30536 ERROR oslo_messaging.rpc.dispatcher     plugin, context, l3_agent)
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.668 30536 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.668 30536 ERROR oslo_messaging.rpc.dispatcher     agent)
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.668 30536 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.668 30536 ERROR oslo_messaging.rpc.dispatcher     return plugin.get_ha_routers_l3_agents_count(context)
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.668 30536 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.668 30536 ERROR oslo_messaging.rpc.dispatcher     for router, agent_count in query]
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.668 30536 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.668 30536 ERROR oslo_messaging.rpc.dispatcher     return self._execute_and_instances(context)
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.668 30536 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.668 30536 ERROR oslo_messaging.rpc.dispatcher     result = conn.execute(querycontext.statement, self._params)
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.668 30536 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.668 30536 ERROR oslo_messaging.rpc.dispatcher     return meth(self, multiparams, params)
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.668 30536 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.668 30536 ERROR oslo_messaging.rpc.dispatcher     return connection._execute_clauseelement(self, multiparams, params)
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.668 30536 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.668 30536 ERROR oslo_messaging.rpc.dispatcher     compiled_sql, distilled_params
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.668 30536 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.668 30536 ERROR oslo_messaging.rpc.dispatcher     context)
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.668 30536 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.668 30536 ERROR oslo_messaging.rpc.dispatcher     util.raise_from_cause(newraise, exc_info)
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.668 30536 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.668 30536 ERROR oslo_messaging.rpc.dispatcher     reraise(type(exception), exception, tb=exc_tb)
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.668 30536 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.668 30536 ERROR oslo_messaging.rpc.dispatcher     context)
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.668 30536 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.668 30536 ERROR oslo_messaging.rpc.dispatcher     cursor.execute(statement, parameters)
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.668 30536 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.668 30536 ERROR oslo_messaging.rpc.dispatcher     result = self._query(query)
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.668 30536 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.668 30536 ERROR oslo_messaging.rpc.dispatcher     conn.query(q)
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.668 30536 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.668 30536 ERROR oslo_messaging.rpc.dispatcher     self._affected_rows = self._read_query_result(unbuffered=unbuffered)
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.668 30536 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.668 30536 ERROR oslo_messaging.rpc.dispatcher     result.read()
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.668 30536 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.668 30536 ERROR oslo_messaging.rpc.dispatcher     first_packet = self.connection._read_packet()
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.668 30536 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.668 30536 ERROR oslo_messaging.rpc.dispatcher     packet.check_error()
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.668 30536 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.668 30536 ERROR oslo_messaging.rpc.dispatcher     err.raise_mysql_exception(self._data)
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.668 30536 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.668 30536 ERROR oslo_messaging.rpc.dispatcher     _check_mysql_exception(errinfo)
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.668 30536 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.668 30536 ERROR oslo_messaging.rpc.dispatcher     raise errorclass(errno, errorvalue)
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.668 30536 ERROR oslo_messaging.rpc.dispatcher ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port
Sep 28 12:41:27 ctl02 neutron-server[30536]: _id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.cr
Sep 28 12:41:27 ctl02 neutron-server[30536]: eated_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattr
Sep 28 12:41:27 ctl02 neutron-server[30536]: ibutes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id']
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.668 30536 ERROR oslo_messaging.rpc.dispatcher
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.682 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:27 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:27 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:27 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.682 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:27 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:27 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:27 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:27 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:27 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:27 ctl02 nova-api[6069]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:41:27 ctl02 nova-api[6069]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.936 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:27 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:27 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:27 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:27 ctl02 neutron-server[30536]: 2017-09-28 12:41:27.936 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:27 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:27 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:27 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:27 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:27 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:28 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:41:28.011 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:41:28] "OPTIONS / HTTP/1.0" 200 134 0.000409
Sep 28 12:41:28 ctl02 nova-api[6069]: 2017-09-28 12:41:28.017 6069 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:41:28 ctl02 nova-api[6069]: 2017-09-28 12:41:28.019 6069 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:41:28 ctl02 nova-api[6069]: 2017-09-28 12:41:28.019 6069 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:41:28 ctl02 nova-api[6069]: 2017-09-28 12:41:28.019 6069 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:41:28 ctl02 nova-api[6069]: 2017-09-28 12:41:28.019 6069 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:41:28 ctl02 nova-api[6069]: 2017-09-28 12:41:28.019 6069 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:41:28 ctl02 nova-api[6069]: 2017-09-28 12:41:28.019 6069 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:41:28 ctl02 nova-api[6069]: 2017-09-28 12:41:28.019 6069 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:41:28 ctl02 nova-api[6069]: 2017-09-28 12:41:28.019 6069 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:41:28 ctl02 nova-api[6069]: 2017-09-28 12:41:28.019 6069 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:41:28 ctl02 nova-api[6069]: 2017-09-28 12:41:28.019 6069 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:41:28 ctl02 nova-api[6069]: 2017-09-28 12:41:28.019 6069 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:41:28 ctl02 nova-api[6069]: 2017-09-28 12:41:28.019 6069 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:41:28 ctl02 nova-api[6069]: 2017-09-28 12:41:28.019 6069 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:41:28 ctl02 nova-api[6069]: 2017-09-28 12:41:28.019 6069 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:41:28 ctl02 nova-api[6069]: 2017-09-28 12:41:28.019 6069 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:41:28 ctl02 nova-api[6069]: 2017-09-28 12:41:28.019 6069 ERROR nova.wsgi     self.filename))
Sep 28 12:41:28 ctl02 nova-api[6069]: 2017-09-28 12:41:28.019 6069 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:41:28 ctl02 nova-api[6069]: 2017-09-28 12:41:28.019 6069 ERROR nova.wsgi
Sep 28 12:41:28 ctl02 nova-api[6069]: 2017-09-28 12:41:28.020 6069 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:41:28 ctl02 nova-api[6069]: 2017-09-28 12:41:28.154 6069 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:41:28 ctl02 neutron-server[30536]: 2017-09-28 12:41:28.190 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:28 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:28 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:28 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:28 ctl02 neutron-server[30536]: 2017-09-28 12:41:28.190 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:28 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:28 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:28 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:28 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:28 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:28 ctl02 nova-api[6069]: 2017-09-28 12:41:28.378 6069 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:41:28 ctl02 nova-api[6069]: 2017-09-28 12:41:28.380 6069 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:41:28 ctl02 nova-api[6069]: 2017-09-28 12:41:28.381 6069 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:41:28 ctl02 nova-api[6069]: 2017-09-28 12:41:28.381 6069 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:41:28 ctl02 neutron-server[30536]: 2017-09-28 12:41:28.444 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:28 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:28 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:28 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:28 ctl02 neutron-server[30536]: 2017-09-28 12:41:28.445 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:28 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:28 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:28 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:28 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:28 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:28 ctl02 nova-api[6069]: 2017-09-28 12:41:28.515 6069 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:41:28 ctl02 nova-api[6069]: 2017-09-28 12:41:28.517 6069 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:41:28 ctl02 nova-api[6069]: 2017-09-28 12:41:28.517 6069 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:41:28 ctl02 nova-api[6069]: 2017-09-28 12:41:28.517 6069 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:41:28 ctl02 nova-api[6069]: 2017-09-28 12:41:28.520 6069 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:41:28 ctl02 nova-api[6069]: 2017-09-28 12:41:28.521 6069 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:41:28 ctl02 nova-api[6069]: 2017-09-28 12:41:28.521 6069 ERROR nova Traceback (most recent call last):
Sep 28 12:41:28 ctl02 nova-api[6069]: 2017-09-28 12:41:28.521 6069 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:41:28 ctl02 nova-api[6069]: 2017-09-28 12:41:28.521 6069 ERROR nova     sys.exit(main())
Sep 28 12:41:28 ctl02 nova-api[6069]: 2017-09-28 12:41:28.521 6069 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:41:28 ctl02 nova-api[6069]: 2017-09-28 12:41:28.521 6069 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:41:28 ctl02 nova-api[6069]: 2017-09-28 12:41:28.521 6069 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:41:28 ctl02 nova-api[6069]: 2017-09-28 12:41:28.521 6069 ERROR nova     max_url_len=max_url_len)
Sep 28 12:41:28 ctl02 nova-api[6069]: 2017-09-28 12:41:28.521 6069 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:41:28 ctl02 nova-api[6069]: 2017-09-28 12:41:28.521 6069 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:41:28 ctl02 nova-api[6069]: 2017-09-28 12:41:28.521 6069 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:41:28 ctl02 nova-api[6069]: 2017-09-28 12:41:28.521 6069 ERROR nova     sock.listen(backlog)
Sep 28 12:41:28 ctl02 nova-api[6069]: 2017-09-28 12:41:28.521 6069 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:41:28 ctl02 nova-api[6069]: 2017-09-28 12:41:28.521 6069 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:41:28 ctl02 nova-api[6069]: 2017-09-28 12:41:28.521 6069 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:41:28 ctl02 nova-api[6069]: 2017-09-28 12:41:28.521 6069 ERROR nova
Sep 28 12:41:28 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:41:28 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:41:28 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:41:28 ctl02 neutron-server[30536]: 2017-09-28 12:41:28.698 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:28 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:28 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:28 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:28 ctl02 neutron-server[30536]: 2017-09-28 12:41:28.699 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:28 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:28 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:28 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:28 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:28 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:28 ctl02 heat-api-cfn[13300]: 2017-09-28 12:41:28.854 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:41:28] "OPTIONS / HTTP/1.0" 200 134 0.000523
Sep 28 12:41:28 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:41:28 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:41:28 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:41:28 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:41:28 ctl02 neutron-server[30536]: 2017-09-28 12:41:28.953 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:28 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:28 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:28 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:28 ctl02 neutron-server[30536]: 2017-09-28 12:41:28.953 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:28 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:28 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:28 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:28 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:28 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:29 ctl02 heat-api[13008]: 2017-09-28 12:41:29.119 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:41:29] "OPTIONS / HTTP/1.0" 200 134 0.000562
Sep 28 12:41:29 ctl02 neutron-server[30536]: 2017-09-28 12:41:29.206 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:29 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:29 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:29 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:29 ctl02 neutron-server[30536]: 2017-09-28 12:41:29.207 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:29 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:29 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:29 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:29 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:29 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:29 ctl02 neutron-server[30536]: 2017-09-28 12:41:29.460 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:29 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:29 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:29 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:29 ctl02 neutron-server[30536]: 2017-09-28 12:41:29.460 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:29 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:29 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:29 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:29 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:29 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:29 ctl02 neutron-server[30536]: 2017-09-28 12:41:29.714 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:29 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:29 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:29 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:29 ctl02 neutron-server[30536]: 2017-09-28 12:41:29.714 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:29 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:29 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:29 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:29 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:29 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:29 ctl02 neutron-server[30536]: 2017-09-28 12:41:29.868 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:41:29] "OPTIONS / HTTP/1.0" 200 262 0.000458
Sep 28 12:41:29 ctl02 heat-api-cfn[13300]: 2017-09-28 12:41:29.947 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:41:29] "OPTIONS / HTTP/1.0" 200 134 0.000462
Sep 28 12:41:29 ctl02 neutron-server[30536]: 2017-09-28 12:41:29.967 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:29 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:29 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:29 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:29 ctl02 neutron-server[30536]: 2017-09-28 12:41:29.968 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:29 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:29 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:29 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:29 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:29 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:30 ctl02 neutron-server[30536]: 2017-09-28 12:41:30.221 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:30 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:30 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:30 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:30 ctl02 neutron-server[30536]: 2017-09-28 12:41:30.222 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:30 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:30 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:30 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:30 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:30 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:30 ctl02 neutron-server[30536]: 2017-09-28 12:41:30.475 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:30 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:30 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:30 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:30 ctl02 neutron-server[30536]: 2017-09-28 12:41:30.475 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:30 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:30 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:30 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:30 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:30 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:30 ctl02 neutron-server[30536]: 2017-09-28 12:41:30.562 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:41:30] "OPTIONS / HTTP/1.0" 200 262 0.000435
Sep 28 12:41:30 ctl02 nova-api[6086]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:41:30 ctl02 nova-api[6086]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:41:30 ctl02 glance-api[29183]: 2017-09-28 12:41:30.727 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:41:30] "OPTIONS / HTTP/1.0" 200 134 0.000612
Sep 28 12:41:30 ctl02 neutron-server[30536]: 2017-09-28 12:41:30.728 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:30 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:30 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:30 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:30 ctl02 neutron-server[30536]: 2017-09-28 12:41:30.729 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:30 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:30 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:30 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:30 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:30 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:30 ctl02 nova-api[6086]: 2017-09-28 12:41:30.746 6086 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:41:30 ctl02 nova-api[6086]: 2017-09-28 12:41:30.748 6086 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:41:30 ctl02 nova-api[6086]: 2017-09-28 12:41:30.748 6086 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:41:30 ctl02 nova-api[6086]: 2017-09-28 12:41:30.748 6086 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:41:30 ctl02 nova-api[6086]: 2017-09-28 12:41:30.748 6086 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:41:30 ctl02 nova-api[6086]: 2017-09-28 12:41:30.748 6086 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:41:30 ctl02 nova-api[6086]: 2017-09-28 12:41:30.748 6086 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:41:30 ctl02 nova-api[6086]: 2017-09-28 12:41:30.748 6086 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:41:30 ctl02 nova-api[6086]: 2017-09-28 12:41:30.748 6086 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:41:30 ctl02 nova-api[6086]: 2017-09-28 12:41:30.748 6086 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:41:30 ctl02 nova-api[6086]: 2017-09-28 12:41:30.748 6086 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:41:30 ctl02 nova-api[6086]: 2017-09-28 12:41:30.748 6086 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:41:30 ctl02 nova-api[6086]: 2017-09-28 12:41:30.748 6086 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:41:30 ctl02 nova-api[6086]: 2017-09-28 12:41:30.748 6086 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:41:30 ctl02 nova-api[6086]: 2017-09-28 12:41:30.748 6086 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:41:30 ctl02 nova-api[6086]: 2017-09-28 12:41:30.748 6086 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:41:30 ctl02 nova-api[6086]: 2017-09-28 12:41:30.748 6086 ERROR nova.wsgi     self.filename))
Sep 28 12:41:30 ctl02 nova-api[6086]: 2017-09-28 12:41:30.748 6086 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:41:30 ctl02 nova-api[6086]: 2017-09-28 12:41:30.748 6086 ERROR nova.wsgi
Sep 28 12:41:30 ctl02 nova-api[6086]: 2017-09-28 12:41:30.749 6086 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:41:30 ctl02 nova-api[6086]: 2017-09-28 12:41:30.876 6086 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:41:30 ctl02 neutron-server[30536]: 2017-09-28 12:41:30.983 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:30 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:30 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:30 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:30 ctl02 neutron-server[30536]: 2017-09-28 12:41:30.983 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:30 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:30 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:30 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:30 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:30 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:31 ctl02 neutron-server[30536]: 2017-09-28 12:41:31.018 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:41:31] "OPTIONS / HTTP/1.0" 200 262 0.000452
Sep 28 12:41:31 ctl02 nova-api[6086]: 2017-09-28 12:41:31.103 6086 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:41:31 ctl02 nova-api[6086]: 2017-09-28 12:41:31.105 6086 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:41:31 ctl02 nova-api[6086]: 2017-09-28 12:41:31.105 6086 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:41:31 ctl02 nova-api[6086]: 2017-09-28 12:41:31.105 6086 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:41:31 ctl02 nova-api[6086]: 2017-09-28 12:41:31.236 6086 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:41:31 ctl02 neutron-server[30536]: 2017-09-28 12:41:31.237 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:31 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:31 ctl02 nova-api[6086]: 2017-09-28 12:41:31.238 6086 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:41:31 ctl02 nova-api[6086]: 2017-09-28 12:41:31.238 6086 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:41:31 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:31 ctl02 nova-api[6086]: 2017-09-28 12:41:31.239 6086 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:41:31 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:31 ctl02 neutron-server[30536]: 2017-09-28 12:41:31.238 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:31 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:31 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:31 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:31 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:31 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:31 ctl02 nova-api[6086]: 2017-09-28 12:41:31.242 6086 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:41:31 ctl02 nova-api[6086]: 2017-09-28 12:41:31.242 6086 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:41:31 ctl02 nova-api[6086]: 2017-09-28 12:41:31.242 6086 ERROR nova Traceback (most recent call last):
Sep 28 12:41:31 ctl02 nova-api[6086]: 2017-09-28 12:41:31.242 6086 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:41:31 ctl02 nova-api[6086]: 2017-09-28 12:41:31.242 6086 ERROR nova     sys.exit(main())
Sep 28 12:41:31 ctl02 nova-api[6086]: 2017-09-28 12:41:31.242 6086 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:41:31 ctl02 nova-api[6086]: 2017-09-28 12:41:31.242 6086 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:41:31 ctl02 nova-api[6086]: 2017-09-28 12:41:31.242 6086 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:41:31 ctl02 nova-api[6086]: 2017-09-28 12:41:31.242 6086 ERROR nova     max_url_len=max_url_len)
Sep 28 12:41:31 ctl02 nova-api[6086]: 2017-09-28 12:41:31.242 6086 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:41:31 ctl02 nova-api[6086]: 2017-09-28 12:41:31.242 6086 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:41:31 ctl02 nova-api[6086]: 2017-09-28 12:41:31.242 6086 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:41:31 ctl02 nova-api[6086]: 2017-09-28 12:41:31.242 6086 ERROR nova     sock.listen(backlog)
Sep 28 12:41:31 ctl02 nova-api[6086]: 2017-09-28 12:41:31.242 6086 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:41:31 ctl02 nova-api[6086]: 2017-09-28 12:41:31.242 6086 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:41:31 ctl02 nova-api[6086]: 2017-09-28 12:41:31.242 6086 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:41:31 ctl02 nova-api[6086]: 2017-09-28 12:41:31.242 6086 ERROR nova
Sep 28 12:41:31 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:41:31 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:41:31 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:41:31 ctl02 neutron-server[30536]: 2017-09-28 12:41:31.491 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:31 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:31 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:31 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:31 ctl02 neutron-server[30536]: 2017-09-28 12:41:31.492 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:31 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:31 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:31 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:31 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:31 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:31 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:41:31 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:41:31 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:41:31 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:41:31 ctl02 glance-api[29183]: 2017-09-28 12:41:31.680 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:41:31] "OPTIONS / HTTP/1.0" 200 134 0.000586
Sep 28 12:41:31 ctl02 neutron-server[30536]: 2017-09-28 12:41:31.746 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:31 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:31 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:31 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:31 ctl02 neutron-server[30536]: 2017-09-28 12:41:31.747 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:31 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:31 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:31 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:31 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:31 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:32 ctl02 neutron-server[30536]: 2017-09-28 12:41:32.000 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:32 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:32 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:32 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:32 ctl02 neutron-server[30536]: 2017-09-28 12:41:32.000 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:32 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:32 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:32 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:32 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:32 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:32 ctl02 neutron-server[30536]: 2017-09-28 12:41:32.254 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:32 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:32 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:32 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:32 ctl02 neutron-server[30536]: 2017-09-28 12:41:32.255 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:32 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:32 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:32 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:32 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:32 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:32 ctl02 neutron-server[30536]: 2017-09-28 12:41:32.508 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:32 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:32 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:32 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:32 ctl02 neutron-server[30536]: 2017-09-28 12:41:32.508 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:32 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:32 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:32 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:32 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:32 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:32 ctl02 heat-api-cfn[13300]: 2017-09-28 12:41:32.530 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:41:32] "OPTIONS / HTTP/1.0" 200 134 0.000445
Sep 28 12:41:32 ctl02 glance-api[29183]: 2017-09-28 12:41:32.596 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:41:32] "OPTIONS / HTTP/1.0" 200 134 0.000635
Sep 28 12:41:32 ctl02 neutron-server[30536]: 2017-09-28 12:41:32.762 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:32 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:32 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:32 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:32 ctl02 neutron-server[30536]: 2017-09-28 12:41:32.763 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:32 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:32 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:32 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:32 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:32 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:32 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:41:32.822 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:41:32] "OPTIONS / HTTP/1.0" 200 134 0.000389
Sep 28 12:41:32 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6989322e)
Sep 28 12:41:33 ctl02 neutron-server[30536]: 2017-09-28 12:41:33.018 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:33 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:33 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:33 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:33 ctl02 neutron-server[30536]: 2017-09-28 12:41:33.019 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:33 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:33 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:33 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:33 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:33 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:33 ctl02 neutron-server[30536]: 2017-09-28 12:41:33.272 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:33 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:33 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:33 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:33 ctl02 neutron-server[30536]: 2017-09-28 12:41:33.272 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:33 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:33 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:33 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:33 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:33 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:33 ctl02 nova-api[6105]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:41:33 ctl02 nova-api[6105]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:41:33 ctl02 nova-api[6105]: 2017-09-28 12:41:33.519 6105 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:41:33 ctl02 nova-api[6105]: 2017-09-28 12:41:33.520 6105 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:41:33 ctl02 nova-api[6105]: 2017-09-28 12:41:33.520 6105 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:41:33 ctl02 nova-api[6105]: 2017-09-28 12:41:33.520 6105 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:41:33 ctl02 nova-api[6105]: 2017-09-28 12:41:33.520 6105 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:41:33 ctl02 nova-api[6105]: 2017-09-28 12:41:33.520 6105 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:41:33 ctl02 nova-api[6105]: 2017-09-28 12:41:33.520 6105 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:41:33 ctl02 nova-api[6105]: 2017-09-28 12:41:33.520 6105 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:41:33 ctl02 nova-api[6105]: 2017-09-28 12:41:33.520 6105 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:41:33 ctl02 nova-api[6105]: 2017-09-28 12:41:33.520 6105 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:41:33 ctl02 nova-api[6105]: 2017-09-28 12:41:33.520 6105 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:41:33 ctl02 nova-api[6105]: 2017-09-28 12:41:33.520 6105 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:41:33 ctl02 nova-api[6105]: 2017-09-28 12:41:33.520 6105 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:41:33 ctl02 nova-api[6105]: 2017-09-28 12:41:33.520 6105 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:41:33 ctl02 nova-api[6105]: 2017-09-28 12:41:33.520 6105 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:41:33 ctl02 nova-api[6105]: 2017-09-28 12:41:33.520 6105 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:41:33 ctl02 nova-api[6105]: 2017-09-28 12:41:33.520 6105 ERROR nova.wsgi     self.filename))
Sep 28 12:41:33 ctl02 nova-api[6105]: 2017-09-28 12:41:33.520 6105 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:41:33 ctl02 nova-api[6105]: 2017-09-28 12:41:33.520 6105 ERROR nova.wsgi
Sep 28 12:41:33 ctl02 nova-api[6105]: 2017-09-28 12:41:33.521 6105 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:41:33 ctl02 neutron-server[30536]: 2017-09-28 12:41:33.525 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:33 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:33 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:33 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:33 ctl02 neutron-server[30536]: 2017-09-28 12:41:33.526 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:33 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:33 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:33 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:33 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:33 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:33 ctl02 nova-api[6105]: 2017-09-28 12:41:33.651 6105 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:41:33 ctl02 neutron-server[30536]: 2017-09-28 12:41:33.780 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:33 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:33 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:33 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:33 ctl02 neutron-server[30536]: 2017-09-28 12:41:33.780 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:33 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:33 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:33 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:33 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:33 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:33 ctl02 nova-api[6105]: 2017-09-28 12:41:33.871 6105 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:41:33 ctl02 nova-api[6105]: 2017-09-28 12:41:33.873 6105 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:41:33 ctl02 nova-api[6105]: 2017-09-28 12:41:33.873 6105 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:41:33 ctl02 nova-api[6105]: 2017-09-28 12:41:33.874 6105 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:41:33 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6989322e)
Sep 28 12:41:34 ctl02 nova-api[6105]: 2017-09-28 12:41:34.013 6105 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:41:34 ctl02 nova-api[6105]: 2017-09-28 12:41:34.015 6105 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:41:34 ctl02 nova-api[6105]: 2017-09-28 12:41:34.015 6105 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:41:34 ctl02 nova-api[6105]: 2017-09-28 12:41:34.015 6105 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:41:34 ctl02 nova-api[6105]: 2017-09-28 12:41:34.019 6105 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:41:34 ctl02 nova-api[6105]: 2017-09-28 12:41:34.019 6105 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:41:34 ctl02 nova-api[6105]: 2017-09-28 12:41:34.019 6105 ERROR nova Traceback (most recent call last):
Sep 28 12:41:34 ctl02 nova-api[6105]: 2017-09-28 12:41:34.019 6105 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:41:34 ctl02 nova-api[6105]: 2017-09-28 12:41:34.019 6105 ERROR nova     sys.exit(main())
Sep 28 12:41:34 ctl02 nova-api[6105]: 2017-09-28 12:41:34.019 6105 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:41:34 ctl02 nova-api[6105]: 2017-09-28 12:41:34.019 6105 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:41:34 ctl02 nova-api[6105]: 2017-09-28 12:41:34.019 6105 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:41:34 ctl02 nova-api[6105]: 2017-09-28 12:41:34.019 6105 ERROR nova     max_url_len=max_url_len)
Sep 28 12:41:34 ctl02 nova-api[6105]: 2017-09-28 12:41:34.019 6105 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:41:34 ctl02 nova-api[6105]: 2017-09-28 12:41:34.019 6105 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:41:34 ctl02 nova-api[6105]: 2017-09-28 12:41:34.019 6105 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:41:34 ctl02 nova-api[6105]: 2017-09-28 12:41:34.019 6105 ERROR nova     sock.listen(backlog)
Sep 28 12:41:34 ctl02 nova-api[6105]: 2017-09-28 12:41:34.019 6105 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:41:34 ctl02 nova-api[6105]: 2017-09-28 12:41:34.019 6105 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:41:34 ctl02 nova-api[6105]: 2017-09-28 12:41:34.019 6105 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:41:34 ctl02 nova-api[6105]: 2017-09-28 12:41:34.019 6105 ERROR nova
Sep 28 12:41:34 ctl02 neutron-server[30536]: 2017-09-28 12:41:34.033 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:34 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:34 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:34 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:34 ctl02 neutron-server[30536]: 2017-09-28 12:41:34.034 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:34 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:34 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:34 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:34 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:34 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:34 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:41:34 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:41:34 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:41:34 ctl02 neutron-server[30536]: 2017-09-28 12:41:34.287 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:34 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:34 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:34 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:34 ctl02 neutron-server[30536]: 2017-09-28 12:41:34.288 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:34 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:34 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:34 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:34 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:34 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:34 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:41:34 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:41:34 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:41:34 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:41:34 ctl02 neutron-server[30536]: 2017-09-28 12:41:34.541 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:34 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:34 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:34 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:34 ctl02 neutron-server[30536]: 2017-09-28 12:41:34.542 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:34 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:34 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:34 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:34 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:34 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:34 ctl02 neutron-server[30536]: 2017-09-28 12:41:34.795 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:34 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:34 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:34 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:34 ctl02 neutron-server[30536]: 2017-09-28 12:41:34.795 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:34 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:34 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:34 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:34 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:34 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:34 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6989322e)
Sep 28 12:41:35 ctl02 neutron-server[30536]: 2017-09-28 12:41:35.048 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:35 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:35 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:35 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:35 ctl02 neutron-server[30536]: 2017-09-28 12:41:35.048 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:35 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:35 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:35 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:35 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:35 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:35 ctl02 neutron-server[30536]: 2017-09-28 12:41:35.301 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:35 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:35 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:35 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:35 ctl02 neutron-server[30536]: 2017-09-28 12:41:35.302 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:35 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:35 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:35 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:35 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:35 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:35 ctl02 heat-api[13008]: 2017-09-28 12:41:35.320 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:41:35] "OPTIONS / HTTP/1.0" 200 134 0.000529
Sep 28 12:41:35 ctl02 neutron-server[30536]: 2017-09-28 12:41:35.556 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:35 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:35 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:35 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:35 ctl02 neutron-server[30536]: 2017-09-28 12:41:35.556 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:35 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:35 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:35 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:35 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:35 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:35 ctl02 neutron-server[30536]: 2017-09-28 12:41:35.810 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:35 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:35 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:35 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:35 ctl02 neutron-server[30536]: 2017-09-28 12:41:35.810 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:35 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:35 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:35 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:35 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:35 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:35 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6989322e)
Sep 28 12:41:36 ctl02 nova-api[6122]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:41:36 ctl02 nova-api[6122]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.063 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:36 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:36 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:36 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.064 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:36 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:36 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:36 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:36 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:36 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:36 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:41:36.195 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:41:36] "OPTIONS / HTTP/1.0" 200 134 0.000457
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.196 30601 ERROR oslo_db.sqlalchemy.exc_filters [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] DBAPIError exception wrapped from (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpoo
Sep 28 12:41:36 ctl02 neutron-server[30536]: ls_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`']
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.196 30601 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.196 30601 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.196 30601 ERROR oslo_db.sqlalchemy.exc_filters     context)
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.196 30601 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.196 30601 ERROR oslo_db.sqlalchemy.exc_filters     cursor.execute(statement, parameters)
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.196 30601 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.196 30601 ERROR oslo_db.sqlalchemy.exc_filters     result = self._query(query)
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.196 30601 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.196 30601 ERROR oslo_db.sqlalchemy.exc_filters     conn.query(q)
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.196 30601 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.196 30601 ERROR oslo_db.sqlalchemy.exc_filters     self._affected_rows = self._read_query_result(unbuffered=unbuffered)
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.196 30601 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.196 30601 ERROR oslo_db.sqlalchemy.exc_filters     result.read()
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.196 30601 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.196 30601 ERROR oslo_db.sqlalchemy.exc_filters     first_packet = self.connection._read_packet()
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.196 30601 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.196 30601 ERROR oslo_db.sqlalchemy.exc_filters     packet.check_error()
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.196 30601 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.196 30601 ERROR oslo_db.sqlalchemy.exc_filters     err.raise_mysql_exception(self._data)
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.196 30601 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.196 30601 ERROR oslo_db.sqlalchemy.exc_filters     _check_mysql_exception(errinfo)
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.196 30601 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.196 30601 ERROR oslo_db.sqlalchemy.exc_filters     raise InternalError(errno, errorvalue)
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.196 30601 ERROR oslo_db.sqlalchemy.exc_filters InternalError: (1054, u"Unknown column 'subnets.tenant_id' in 'field list'")
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.196 30601 ERROR oslo_db.sqlalchemy.exc_filters
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Exception during message handling: (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpoo
Sep 28 12:41:36 ctl02 neutron-server[30536]: ls_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`']
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher Traceback (most recent call last):
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher     incoming.message))
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher     return self._do_dispatch(endpoint, method, ctxt, args)
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher     result = func(ctxt, **new_args)
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher     networks = self._get_active_networks(context, **kwargs)
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher     plugin.auto_schedule_networks(context, host)
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher     self.network_scheduler.auto_schedule_networks(self, context, host)
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher     subnets = plugin.get_subnets(context, fields=fields)
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher     marker, page_reverse)
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher     page_reverse=page_reverse)
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher     items = [dict_func(c, fields) for c in query]
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher     return self._execute_and_instances(context)
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher     result = conn.execute(querycontext.statement, self._params)
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher     return meth(self, multiparams, params)
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher     return connection._execute_clauseelement(self, multiparams, params)
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher     compiled_sql, distilled_params
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher     context)
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher     util.raise_from_cause(newraise, exc_info)
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher     reraise(type(exception), exception, tb=exc_tb)
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher     context)
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher     cursor.execute(statement, parameters)
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher     result = self._query(query)
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher     conn.query(q)
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher     self._affected_rows = self._read_query_result(unbuffered=unbuffered)
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher     result.read()
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher     first_packet = self.connection._read_packet()
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher     packet.check_error()
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher     err.raise_mysql_exception(self._data)
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher     _check_mysql_exception(errinfo)
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher     raise InternalError(errno, errorvalue)
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher DBError: (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallo
Sep 28 12:41:36 ctl02 neutron-server[30536]: cationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`']
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.199 30601 ERROR oslo_messaging.rpc.dispatcher
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.203 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:36 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.203 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:36 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:36 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:36 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:36 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:36 ctl02 nova-api[6122]: 2017-09-28 12:41:36.235 6122 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:41:36 ctl02 nova-api[6122]: 2017-09-28 12:41:36.237 6122 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:41:36 ctl02 nova-api[6122]: 2017-09-28 12:41:36.237 6122 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:41:36 ctl02 nova-api[6122]: 2017-09-28 12:41:36.237 6122 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:41:36 ctl02 nova-api[6122]: 2017-09-28 12:41:36.237 6122 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:41:36 ctl02 nova-api[6122]: 2017-09-28 12:41:36.237 6122 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:41:36 ctl02 nova-api[6122]: 2017-09-28 12:41:36.237 6122 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:41:36 ctl02 nova-api[6122]: 2017-09-28 12:41:36.237 6122 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:41:36 ctl02 nova-api[6122]: 2017-09-28 12:41:36.237 6122 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:41:36 ctl02 nova-api[6122]: 2017-09-28 12:41:36.237 6122 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:41:36 ctl02 nova-api[6122]: 2017-09-28 12:41:36.237 6122 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:41:36 ctl02 nova-api[6122]: 2017-09-28 12:41:36.237 6122 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:41:36 ctl02 nova-api[6122]: 2017-09-28 12:41:36.237 6122 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:41:36 ctl02 nova-api[6122]: 2017-09-28 12:41:36.237 6122 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:41:36 ctl02 nova-api[6122]: 2017-09-28 12:41:36.237 6122 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:41:36 ctl02 nova-api[6122]: 2017-09-28 12:41:36.237 6122 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:41:36 ctl02 nova-api[6122]: 2017-09-28 12:41:36.237 6122 ERROR nova.wsgi     self.filename))
Sep 28 12:41:36 ctl02 nova-api[6122]: 2017-09-28 12:41:36.237 6122 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:41:36 ctl02 nova-api[6122]: 2017-09-28 12:41:36.237 6122 ERROR nova.wsgi
Sep 28 12:41:36 ctl02 nova-api[6122]: 2017-09-28 12:41:36.238 6122 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.303 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 1 dead agents out of 6:
Sep 28 12:41:36 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:41:36 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:40:56 cmp002
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.317 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:36 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:36 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:36 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.318 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:36 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:36 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:36 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:36 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:36 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:36 ctl02 nova-api[6122]: 2017-09-28 12:41:36.370 6122 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.456 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:36 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.457 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:36 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:36 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:36 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:36 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.572 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:36 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:36 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:36 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.572 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:36 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:36 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:36 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:36 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:36 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:36 ctl02 nova-api[6122]: 2017-09-28 12:41:36.583 6122 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:41:36 ctl02 nova-api[6122]: 2017-09-28 12:41:36.585 6122 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:41:36 ctl02 nova-api[6122]: 2017-09-28 12:41:36.585 6122 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:41:36 ctl02 nova-api[6122]: 2017-09-28 12:41:36.586 6122 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.710 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:36 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.710 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:36 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:36 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:36 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:36 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:36 ctl02 nova-api[6122]: 2017-09-28 12:41:36.718 6122 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:41:36 ctl02 nova-api[6122]: 2017-09-28 12:41:36.720 6122 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:41:36 ctl02 nova-api[6122]: 2017-09-28 12:41:36.720 6122 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:41:36 ctl02 nova-api[6122]: 2017-09-28 12:41:36.720 6122 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:41:36 ctl02 nova-api[6122]: 2017-09-28 12:41:36.724 6122 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:41:36 ctl02 nova-api[6122]: 2017-09-28 12:41:36.724 6122 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:41:36 ctl02 nova-api[6122]: 2017-09-28 12:41:36.724 6122 ERROR nova Traceback (most recent call last):
Sep 28 12:41:36 ctl02 nova-api[6122]: 2017-09-28 12:41:36.724 6122 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:41:36 ctl02 nova-api[6122]: 2017-09-28 12:41:36.724 6122 ERROR nova     sys.exit(main())
Sep 28 12:41:36 ctl02 nova-api[6122]: 2017-09-28 12:41:36.724 6122 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:41:36 ctl02 nova-api[6122]: 2017-09-28 12:41:36.724 6122 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:41:36 ctl02 nova-api[6122]: 2017-09-28 12:41:36.724 6122 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:41:36 ctl02 nova-api[6122]: 2017-09-28 12:41:36.724 6122 ERROR nova     max_url_len=max_url_len)
Sep 28 12:41:36 ctl02 nova-api[6122]: 2017-09-28 12:41:36.724 6122 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:41:36 ctl02 nova-api[6122]: 2017-09-28 12:41:36.724 6122 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:41:36 ctl02 nova-api[6122]: 2017-09-28 12:41:36.724 6122 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:41:36 ctl02 nova-api[6122]: 2017-09-28 12:41:36.724 6122 ERROR nova     sock.listen(backlog)
Sep 28 12:41:36 ctl02 nova-api[6122]: 2017-09-28 12:41:36.724 6122 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:41:36 ctl02 nova-api[6122]: 2017-09-28 12:41:36.724 6122 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:41:36 ctl02 nova-api[6122]: 2017-09-28 12:41:36.724 6122 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:41:36 ctl02 nova-api[6122]: 2017-09-28 12:41:36.724 6122 ERROR nova
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.826 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:36 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:36 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:36 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.826 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:36 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:36 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:36 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:36 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:36 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:36 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:41:36 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:41:36 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:41:36 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6989322e)
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.964 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:36 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:36 ctl02 neutron-server[30536]: 2017-09-28 12:41:36.964 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:36 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:36 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:36 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:36 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:37 ctl02 heat-api[13008]: 2017-09-28 12:41:37.050 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:41:37] "OPTIONS / HTTP/1.0" 200 134 0.000587
Sep 28 12:41:37 ctl02 neutron-server[30536]: 2017-09-28 12:41:37.080 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:37 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:37 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:37 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:37 ctl02 neutron-server[30536]: 2017-09-28 12:41:37.080 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:37 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:37 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:37 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:37 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:37 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:37 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:41:37 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:41:37 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:41:37 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:41:37 ctl02 neutron-server[30536]: 2017-09-28 12:41:37.217 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:37 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:37 ctl02 neutron-server[30536]: 2017-09-28 12:41:37.218 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:37 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:37 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:37 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:37 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:37 ctl02 neutron-server[30536]: 2017-09-28 12:41:37.333 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:37 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:37 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:37 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:37 ctl02 neutron-server[30536]: 2017-09-28 12:41:37.334 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:37 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:37 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:37 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:37 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:37 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:37 ctl02 neutron-server[30536]: 2017-09-28 12:41:37.471 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:37 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:37 ctl02 neutron-server[30536]: 2017-09-28 12:41:37.472 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:37 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:37 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:37 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:37 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:37 ctl02 neutron-server[30536]: 2017-09-28 12:41:37.587 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:37 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:37 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:37 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:37 ctl02 neutron-server[30536]: 2017-09-28 12:41:37.587 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:37 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:37 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:37 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:37 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:37 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:37 ctl02 neutron-server[30536]: 2017-09-28 12:41:37.725 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:37 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:37 ctl02 neutron-server[30536]: 2017-09-28 12:41:37.726 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:37 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:37 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:37 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:37 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:37 ctl02 neutron-server[30536]: 2017-09-28 12:41:37.840 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:37 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:37 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:37 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:37 ctl02 neutron-server[30536]: 2017-09-28 12:41:37.841 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:37 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:37 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:37 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:37 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:37 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:37 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:41:37.896 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:41:37] "OPTIONS / HTTP/1.0" 200 134 0.000398
Sep 28 12:41:37 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6989322e)
Sep 28 12:41:37 ctl02 neutron-server[30536]: 2017-09-28 12:41:37.980 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:37 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:37 ctl02 neutron-server[30536]: 2017-09-28 12:41:37.980 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:37 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:37 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:37 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:37 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:38 ctl02 neutron-server[30536]: 2017-09-28 12:41:38.094 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:38 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:38 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:38 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:38 ctl02 neutron-server[30536]: 2017-09-28 12:41:38.095 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:38 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:38 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:38 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:38 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:38 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:38 ctl02 neutron-server[30536]: 2017-09-28 12:41:38.234 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:38 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:38 ctl02 neutron-server[30536]: 2017-09-28 12:41:38.234 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:38 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:38 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:38 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:38 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:38 ctl02 neutron-server[30536]: 2017-09-28 12:41:38.348 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:38 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:38 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:38 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:38 ctl02 neutron-server[30536]: 2017-09-28 12:41:38.349 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:38 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:38 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:38 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:38 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:38 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:38 ctl02 neutron-server[30536]: 2017-09-28 12:41:38.487 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:38 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:38 ctl02 neutron-server[30536]: 2017-09-28 12:41:38.488 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:38 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:38 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:38 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:38 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:38 ctl02 heat-api-cfn[13300]: 2017-09-28 12:41:38.503 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:41:38] "OPTIONS / HTTP/1.0" 200 134 0.000462
Sep 28 12:41:38 ctl02 neutron-server[30536]: 2017-09-28 12:41:38.602 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:38 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:38 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:38 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:38 ctl02 neutron-server[30536]: 2017-09-28 12:41:38.603 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:38 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:38 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:38 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:38 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:38 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:38 ctl02 neutron-server[30536]: 2017-09-28 12:41:38.741 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:38 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:38 ctl02 neutron-server[30536]: 2017-09-28 12:41:38.742 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:38 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:38 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:38 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:38 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:38 ctl02 nova-api[6141]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:41:38 ctl02 nova-api[6141]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:41:38 ctl02 neutron-server[30536]: 2017-09-28 12:41:38.857 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:38 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:38 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:38 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:38 ctl02 neutron-server[30536]: 2017-09-28 12:41:38.858 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:38 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:38 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:38 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:38 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:38 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:38 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6989322e)
Sep 28 12:41:38 ctl02 nova-api[6141]: 2017-09-28 12:41:38.987 6141 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:41:38 ctl02 nova-api[6141]: 2017-09-28 12:41:38.989 6141 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:41:38 ctl02 nova-api[6141]: 2017-09-28 12:41:38.989 6141 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:41:38 ctl02 nova-api[6141]: 2017-09-28 12:41:38.989 6141 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:41:38 ctl02 nova-api[6141]: 2017-09-28 12:41:38.989 6141 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:41:38 ctl02 nova-api[6141]: 2017-09-28 12:41:38.989 6141 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:41:38 ctl02 nova-api[6141]: 2017-09-28 12:41:38.989 6141 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:41:38 ctl02 nova-api[6141]: 2017-09-28 12:41:38.989 6141 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:41:38 ctl02 nova-api[6141]: 2017-09-28 12:41:38.989 6141 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:41:38 ctl02 nova-api[6141]: 2017-09-28 12:41:38.989 6141 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:41:38 ctl02 nova-api[6141]: 2017-09-28 12:41:38.989 6141 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:41:38 ctl02 nova-api[6141]: 2017-09-28 12:41:38.989 6141 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:41:38 ctl02 nova-api[6141]: 2017-09-28 12:41:38.989 6141 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:41:38 ctl02 nova-api[6141]: 2017-09-28 12:41:38.989 6141 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:41:38 ctl02 nova-api[6141]: 2017-09-28 12:41:38.989 6141 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:41:38 ctl02 nova-api[6141]: 2017-09-28 12:41:38.989 6141 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:41:38 ctl02 nova-api[6141]: 2017-09-28 12:41:38.989 6141 ERROR nova.wsgi     self.filename))
Sep 28 12:41:38 ctl02 nova-api[6141]: 2017-09-28 12:41:38.989 6141 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:41:38 ctl02 nova-api[6141]: 2017-09-28 12:41:38.989 6141 ERROR nova.wsgi
Sep 28 12:41:38 ctl02 nova-api[6141]: 2017-09-28 12:41:38.990 6141 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:41:38 ctl02 neutron-server[30536]: 2017-09-28 12:41:38.995 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:38 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:38 ctl02 neutron-server[30536]: 2017-09-28 12:41:38.996 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:38 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:38 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:38 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:38 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:39 ctl02 heat-api[13008]: 2017-09-28 12:41:39.100 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:41:39] "OPTIONS / HTTP/1.0" 200 134 0.000695
Sep 28 12:41:39 ctl02 neutron-server[30536]: 2017-09-28 12:41:39.112 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:39 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:39 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:39 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:39 ctl02 neutron-server[30536]: 2017-09-28 12:41:39.113 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:39 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:39 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:39 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:39 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:39 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:39 ctl02 nova-api[6141]: 2017-09-28 12:41:39.122 6141 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:41:39 ctl02 neutron-server[30536]: 2017-09-28 12:41:39.249 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:39 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:39 ctl02 neutron-server[30536]: 2017-09-28 12:41:39.251 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:39 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:39 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:39 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:39 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:39 ctl02 nova-api[6141]: 2017-09-28 12:41:39.345 6141 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:41:39 ctl02 nova-api[6141]: 2017-09-28 12:41:39.347 6141 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:41:39 ctl02 nova-api[6141]: 2017-09-28 12:41:39.347 6141 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:41:39 ctl02 nova-api[6141]: 2017-09-28 12:41:39.348 6141 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:41:39 ctl02 neutron-server[30536]: 2017-09-28 12:41:39.366 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:39 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:39 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:39 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:39 ctl02 neutron-server[30536]: 2017-09-28 12:41:39.367 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:39 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:39 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:39 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:39 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:39 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:39 ctl02 nova-api[6141]: 2017-09-28 12:41:39.478 6141 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:41:39 ctl02 nova-api[6141]: 2017-09-28 12:41:39.480 6141 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:41:39 ctl02 nova-api[6141]: 2017-09-28 12:41:39.480 6141 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:41:39 ctl02 nova-api[6141]: 2017-09-28 12:41:39.480 6141 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:41:39 ctl02 nova-api[6141]: 2017-09-28 12:41:39.483 6141 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:41:39 ctl02 nova-api[6141]: 2017-09-28 12:41:39.484 6141 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:41:39 ctl02 nova-api[6141]: 2017-09-28 12:41:39.484 6141 ERROR nova Traceback (most recent call last):
Sep 28 12:41:39 ctl02 nova-api[6141]: 2017-09-28 12:41:39.484 6141 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:41:39 ctl02 nova-api[6141]: 2017-09-28 12:41:39.484 6141 ERROR nova     sys.exit(main())
Sep 28 12:41:39 ctl02 nova-api[6141]: 2017-09-28 12:41:39.484 6141 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:41:39 ctl02 nova-api[6141]: 2017-09-28 12:41:39.484 6141 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:41:39 ctl02 nova-api[6141]: 2017-09-28 12:41:39.484 6141 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:41:39 ctl02 nova-api[6141]: 2017-09-28 12:41:39.484 6141 ERROR nova     max_url_len=max_url_len)
Sep 28 12:41:39 ctl02 nova-api[6141]: 2017-09-28 12:41:39.484 6141 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:41:39 ctl02 nova-api[6141]: 2017-09-28 12:41:39.484 6141 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:41:39 ctl02 nova-api[6141]: 2017-09-28 12:41:39.484 6141 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:41:39 ctl02 nova-api[6141]: 2017-09-28 12:41:39.484 6141 ERROR nova     sock.listen(backlog)
Sep 28 12:41:39 ctl02 nova-api[6141]: 2017-09-28 12:41:39.484 6141 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:41:39 ctl02 nova-api[6141]: 2017-09-28 12:41:39.484 6141 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:41:39 ctl02 nova-api[6141]: 2017-09-28 12:41:39.484 6141 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:41:39 ctl02 nova-api[6141]: 2017-09-28 12:41:39.484 6141 ERROR nova
Sep 28 12:41:39 ctl02 neutron-server[30536]: 2017-09-28 12:41:39.505 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:39 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:39 ctl02 neutron-server[30536]: 2017-09-28 12:41:39.507 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:39 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:39 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:39 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:39 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:39 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:41:39 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:41:39 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:41:39 ctl02 neutron-server[30536]: 2017-09-28 12:41:39.620 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:39 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:39 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:39 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:39 ctl02 neutron-server[30536]: 2017-09-28 12:41:39.621 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:39 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:39 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:39 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:39 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:39 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:39 ctl02 neutron-server[30536]: 2017-09-28 12:41:39.762 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:39 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:39 ctl02 neutron-server[30536]: 2017-09-28 12:41:39.763 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:39 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:39 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:39 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:39 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:39 ctl02 neutron-server[30536]: 2017-09-28 12:41:39.857 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:41:39] "OPTIONS / HTTP/1.0" 200 262 0.000604
Sep 28 12:41:39 ctl02 neutron-server[30536]: 2017-09-28 12:41:39.875 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:39 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:39 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:39 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:41:39 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:39 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:41:39 ctl02 neutron-server[30536]: 2017-09-28 12:41:39.875 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:39 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:41:39 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:39 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:39 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:39 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:39 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:39 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:41:39 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6989322e)
Sep 28 12:41:40 ctl02 neutron-server[30536]: 2017-09-28 12:41:40.018 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:40 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:40 ctl02 neutron-server[30536]: 2017-09-28 12:41:40.019 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:40 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:40 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:40 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:40 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:40 ctl02 heat-api-cfn[13300]: 2017-09-28 12:41:40.053 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:41:40] "OPTIONS / HTTP/1.0" 200 134 0.000462
Sep 28 12:41:40 ctl02 neutron-server[30536]: 2017-09-28 12:41:40.129 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:40 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:40 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:40 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:40 ctl02 neutron-server[30536]: 2017-09-28 12:41:40.129 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:40 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:40 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:40 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:40 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:40 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:40 ctl02 neutron-server[30536]: 2017-09-28 12:41:40.272 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:40 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:40 ctl02 neutron-server[30536]: 2017-09-28 12:41:40.272 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:40 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:40 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:40 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:40 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:40 ctl02 neutron-server[30536]: 2017-09-28 12:41:40.385 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:40 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:40 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:40 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:40 ctl02 neutron-server[30536]: 2017-09-28 12:41:40.385 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:40 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:40 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:40 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:40 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:40 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:40 ctl02 neutron-server[30536]: 2017-09-28 12:41:40.525 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:40 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:40 ctl02 neutron-server[30536]: 2017-09-28 12:41:40.526 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:40 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:40 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:40 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:40 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:40 ctl02 neutron-server[30536]: 2017-09-28 12:41:40.640 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:40 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:40 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:40 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:40 ctl02 neutron-server[30536]: 2017-09-28 12:41:40.640 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:40 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:40 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:40 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:40 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:40 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:40 ctl02 neutron-server[30536]: 2017-09-28 12:41:40.766 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:41:40] "OPTIONS / HTTP/1.0" 200 262 0.000508
Sep 28 12:41:40 ctl02 neutron-server[30536]: 2017-09-28 12:41:40.779 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:40 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:40 ctl02 neutron-server[30536]: 2017-09-28 12:41:40.779 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:40 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:40 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:40 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:40 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:40 ctl02 neutron-server[30536]: 2017-09-28 12:41:40.895 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:40 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:40 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:40 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:40 ctl02 neutron-server[30536]: 2017-09-28 12:41:40.895 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:40 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:40 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:40 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:40 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:40 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:40 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6989322e)
Sep 28 12:41:40 ctl02 neutron-server[30536]: 2017-09-28 12:41:40.955 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:41:40] "OPTIONS / HTTP/1.0" 200 262 0.000644
Sep 28 12:41:41 ctl02 neutron-server[30536]: 2017-09-28 12:41:41.032 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:41 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:41 ctl02 neutron-server[30536]: 2017-09-28 12:41:41.033 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:41 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:41 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:41 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:41 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:41 ctl02 glance-api[29183]: 2017-09-28 12:41:41.098 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:41:41] "OPTIONS / HTTP/1.0" 200 134 0.000716
Sep 28 12:41:41 ctl02 neutron-server[30536]: 2017-09-28 12:41:41.149 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:41 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:41 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:41 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:41 ctl02 neutron-server[30536]: 2017-09-28 12:41:41.150 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:41 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:41 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:41 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:41 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:41 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:41 ctl02 neutron-server[30536]: 2017-09-28 12:41:41.286 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:41 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:41 ctl02 neutron-server[30536]: 2017-09-28 12:41:41.286 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:41 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:41 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:41 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:41 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:41 ctl02 neutron-server[30536]: 2017-09-28 12:41:41.403 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:41 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:41 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:41 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:41 ctl02 neutron-server[30536]: 2017-09-28 12:41:41.403 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:41 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:41 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:41 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:41 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:41 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:41 ctl02 glance-api[29183]: 2017-09-28 12:41:41.421 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:41:41] "OPTIONS / HTTP/1.0" 200 134 0.000551
Sep 28 12:41:41 ctl02 neutron-server[30536]: 2017-09-28 12:41:41.539 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:41 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:41 ctl02 neutron-server[30536]: 2017-09-28 12:41:41.540 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:41 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:41 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:41 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:41 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:41 ctl02 nova-api[6158]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:41:41 ctl02 nova-api[6158]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:41:41 ctl02 neutron-server[30536]: 2017-09-28 12:41:41.657 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:41 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:41 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:41 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:41 ctl02 neutron-server[30536]: 2017-09-28 12:41:41.657 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:41 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:41 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:41 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:41 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:41 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:41 ctl02 neutron-server[30536]: 2017-09-28 12:41:41.794 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:41 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:41 ctl02 neutron-server[30536]: 2017-09-28 12:41:41.795 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:41 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:41 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:41 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:41 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:41 ctl02 nova-api[6158]: 2017-09-28 12:41:41.806 6158 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:41:41 ctl02 nova-api[6158]: 2017-09-28 12:41:41.808 6158 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:41:41 ctl02 nova-api[6158]: 2017-09-28 12:41:41.808 6158 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:41:41 ctl02 nova-api[6158]: 2017-09-28 12:41:41.808 6158 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:41:41 ctl02 nova-api[6158]: 2017-09-28 12:41:41.808 6158 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:41:41 ctl02 nova-api[6158]: 2017-09-28 12:41:41.808 6158 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:41:41 ctl02 nova-api[6158]: 2017-09-28 12:41:41.808 6158 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:41:41 ctl02 nova-api[6158]: 2017-09-28 12:41:41.808 6158 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:41:41 ctl02 nova-api[6158]: 2017-09-28 12:41:41.808 6158 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:41:41 ctl02 nova-api[6158]: 2017-09-28 12:41:41.808 6158 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:41:41 ctl02 nova-api[6158]: 2017-09-28 12:41:41.808 6158 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:41:41 ctl02 nova-api[6158]: 2017-09-28 12:41:41.808 6158 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:41:41 ctl02 nova-api[6158]: 2017-09-28 12:41:41.808 6158 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:41:41 ctl02 nova-api[6158]: 2017-09-28 12:41:41.808 6158 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:41:41 ctl02 nova-api[6158]: 2017-09-28 12:41:41.808 6158 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:41:41 ctl02 nova-api[6158]: 2017-09-28 12:41:41.808 6158 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:41:41 ctl02 nova-api[6158]: 2017-09-28 12:41:41.808 6158 ERROR nova.wsgi     self.filename))
Sep 28 12:41:41 ctl02 nova-api[6158]: 2017-09-28 12:41:41.808 6158 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:41:41 ctl02 nova-api[6158]: 2017-09-28 12:41:41.808 6158 ERROR nova.wsgi
Sep 28 12:41:41 ctl02 nova-api[6158]: 2017-09-28 12:41:41.809 6158 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:41:41 ctl02 neutron-server[30536]: 2017-09-28 12:41:41.911 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:41 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:41 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:41 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:41 ctl02 neutron-server[30536]: 2017-09-28 12:41:41.911 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:41 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:41 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:41 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:41 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:41 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:41 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6989322e)
Sep 28 12:41:41 ctl02 nova-api[6158]: 2017-09-28 12:41:41.940 6158 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:41:42 ctl02 neutron-server[30536]: 2017-09-28 12:41:42.050 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:42 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:42 ctl02 neutron-server[30536]: 2017-09-28 12:41:42.050 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:42 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:42 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:42 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:42 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:42 ctl02 neutron-server[30536]: 2017-09-28 12:41:42.164 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:42 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:42 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:42 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:42 ctl02 neutron-server[30536]: 2017-09-28 12:41:42.165 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:42 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:42 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:42 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:42 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:42 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:42 ctl02 nova-api[6158]: 2017-09-28 12:41:42.180 6158 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:41:42 ctl02 nova-api[6158]: 2017-09-28 12:41:42.182 6158 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:41:42 ctl02 nova-api[6158]: 2017-09-28 12:41:42.182 6158 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:41:42 ctl02 nova-api[6158]: 2017-09-28 12:41:42.182 6158 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:41:42 ctl02 heat-api-cfn[13300]: 2017-09-28 12:41:42.272 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:41:42] "OPTIONS / HTTP/1.0" 200 134 0.000488
Sep 28 12:41:42 ctl02 neutron-server[30536]: 2017-09-28 12:41:42.313 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:42 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:42 ctl02 neutron-server[30536]: 2017-09-28 12:41:42.314 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:42 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:42 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:42 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:42 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:42 ctl02 nova-api[6158]: 2017-09-28 12:41:42.333 6158 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:41:42 ctl02 nova-api[6158]: 2017-09-28 12:41:42.335 6158 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:41:42 ctl02 nova-api[6158]: 2017-09-28 12:41:42.335 6158 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:41:42 ctl02 nova-api[6158]: 2017-09-28 12:41:42.335 6158 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:41:42 ctl02 nova-api[6158]: 2017-09-28 12:41:42.338 6158 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:41:42 ctl02 nova-api[6158]: 2017-09-28 12:41:42.338 6158 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:41:42 ctl02 nova-api[6158]: 2017-09-28 12:41:42.338 6158 ERROR nova Traceback (most recent call last):
Sep 28 12:41:42 ctl02 nova-api[6158]: 2017-09-28 12:41:42.338 6158 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:41:42 ctl02 nova-api[6158]: 2017-09-28 12:41:42.338 6158 ERROR nova     sys.exit(main())
Sep 28 12:41:42 ctl02 nova-api[6158]: 2017-09-28 12:41:42.338 6158 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:41:42 ctl02 nova-api[6158]: 2017-09-28 12:41:42.338 6158 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:41:42 ctl02 nova-api[6158]: 2017-09-28 12:41:42.338 6158 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:41:42 ctl02 nova-api[6158]: 2017-09-28 12:41:42.338 6158 ERROR nova     max_url_len=max_url_len)
Sep 28 12:41:42 ctl02 nova-api[6158]: 2017-09-28 12:41:42.338 6158 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:41:42 ctl02 nova-api[6158]: 2017-09-28 12:41:42.338 6158 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:41:42 ctl02 nova-api[6158]: 2017-09-28 12:41:42.338 6158 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:41:42 ctl02 nova-api[6158]: 2017-09-28 12:41:42.338 6158 ERROR nova     sock.listen(backlog)
Sep 28 12:41:42 ctl02 nova-api[6158]: 2017-09-28 12:41:42.338 6158 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:41:42 ctl02 nova-api[6158]: 2017-09-28 12:41:42.338 6158 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:41:42 ctl02 nova-api[6158]: 2017-09-28 12:41:42.338 6158 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:41:42 ctl02 nova-api[6158]: 2017-09-28 12:41:42.338 6158 ERROR nova
Sep 28 12:41:42 ctl02 neutron-server[30536]: 2017-09-28 12:41:42.418 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:42 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:42 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:42 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:42 ctl02 neutron-server[30536]: 2017-09-28 12:41:42.418 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:42 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:42 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:42 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:42 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:42 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:42 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:41:42 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:41:42 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:41:42 ctl02 nova-cert[4860]: 2017-09-28 12:41:42.547 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:41:42 ctl02 neutron-server[30536]: 2017-09-28 12:41:42.566 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:42 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:42 ctl02 neutron-server[30536]: 2017-09-28 12:41:42.567 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:42 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:42 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:42 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:42 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:42 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:41:42 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:41:42 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:41:42 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:41:42 ctl02 neutron-server[30536]: 2017-09-28 12:41:42.671 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:42 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:42 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:42 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:42 ctl02 neutron-server[30536]: 2017-09-28 12:41:42.671 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:42 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:42 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:42 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:42 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:42 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:42 ctl02 neutron-server[30536]: 2017-09-28 12:41:42.819 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:42 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:42 ctl02 neutron-server[30536]: 2017-09-28 12:41:42.820 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:42 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:42 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:42 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:42 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:42 ctl02 glance-api[29183]: 2017-09-28 12:41:42.914 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:41:42] "OPTIONS / HTTP/1.0" 200 134 0.000595
Sep 28 12:41:42 ctl02 neutron-server[30536]: 2017-09-28 12:41:42.924 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:42 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:42 ctl02 nova-conductor[5056]: 2017-09-28 12:41:42.925 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:41:42 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:42 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:42 ctl02 neutron-server[30536]: 2017-09-28 12:41:42.925 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:42 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:42 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:42 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:42 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:42 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:42 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6989322e)
Sep 28 12:41:42 ctl02 nova-conductor[5056]: 2017-09-28 12:41:42.946 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:41:42 ctl02 nova-conductor[5056]: 2017-09-28 12:41:42.965 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:41:42 ctl02 nova-conductor[5056]: 2017-09-28 12:41:42.967 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:41:43 ctl02 neutron-server[30536]: 2017-09-28 12:41:43.072 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:43 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:43 ctl02 neutron-server[30536]: 2017-09-28 12:41:43.073 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:43 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:43 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:43 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:43 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:43 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:41:43.090 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:41:43] "OPTIONS / HTTP/1.0" 200 134 0.000362
Sep 28 12:41:43 ctl02 neutron-server[30536]: 2017-09-28 12:41:43.178 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:43 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:43 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:43 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:43 ctl02 neutron-server[30536]: 2017-09-28 12:41:43.178 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:43 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:43 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:43 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:43 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:43 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:43 ctl02 neutron-server[30536]: 2017-09-28 12:41:43.326 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:43 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:43 ctl02 neutron-server[30536]: 2017-09-28 12:41:43.327 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:43 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:43 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:43 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:43 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:43 ctl02 neutron-server[30536]: 2017-09-28 12:41:43.435 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:43 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:43 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:43 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:43 ctl02 neutron-server[30536]: 2017-09-28 12:41:43.436 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:43 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:43 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:43 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:43 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:43 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:43 ctl02 neutron-server[30536]: 2017-09-28 12:41:43.580 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:43 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:43 ctl02 neutron-server[30536]: 2017-09-28 12:41:43.581 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:43 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:43 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:43 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:43 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:43 ctl02 neutron-server[30536]: 2017-09-28 12:41:43.691 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:43 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:43 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:43 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:43 ctl02 neutron-server[30536]: 2017-09-28 12:41:43.693 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:43 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:43 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:43 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:43 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:43 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:43 ctl02 neutron-server[30536]: 2017-09-28 12:41:43.835 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:43 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:43 ctl02 neutron-server[30536]: 2017-09-28 12:41:43.836 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:43 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:43 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:43 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:43 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:43 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:41:43 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:41:43 ctl02 neutron-server[30536]: 2017-09-28 12:41:43.950 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:43 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:43 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:43 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:43 ctl02 neutron-server[30536]: 2017-09-28 12:41:43.952 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:43 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:43 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:43 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:43 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:43 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:44 ctl02 neutron-server[30536]: 2017-09-28 12:41:44.089 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:44 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:44 ctl02 neutron-server[30536]: 2017-09-28 12:41:44.090 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:44 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:44 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:44 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:44 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:44 ctl02 neutron-server[30536]: 2017-09-28 12:41:44.207 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:44 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:44 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:44 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:44 ctl02 neutron-server[30536]: 2017-09-28 12:41:44.209 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:44 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:44 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:44 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:44 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:44 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:44 ctl02 neutron-server[30536]: 2017-09-28 12:41:44.343 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:44 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:44 ctl02 neutron-server[30536]: 2017-09-28 12:41:44.344 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:44 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:44 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:44 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:44 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:44 ctl02 nova-api[6177]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:41:44 ctl02 nova-api[6177]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:41:44 ctl02 neutron-server[30536]: 2017-09-28 12:41:44.465 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:44 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:44 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:44 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:44 ctl02 neutron-server[30536]: 2017-09-28 12:41:44.467 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:44 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:44 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:44 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:44 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:44 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:44 ctl02 nova-api[6177]: 2017-09-28 12:41:44.559 6177 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:41:44 ctl02 nova-api[6177]: 2017-09-28 12:41:44.561 6177 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:41:44 ctl02 nova-api[6177]: 2017-09-28 12:41:44.561 6177 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:41:44 ctl02 nova-api[6177]: 2017-09-28 12:41:44.561 6177 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:41:44 ctl02 nova-api[6177]: 2017-09-28 12:41:44.561 6177 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:41:44 ctl02 nova-api[6177]: 2017-09-28 12:41:44.561 6177 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:41:44 ctl02 nova-api[6177]: 2017-09-28 12:41:44.561 6177 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:41:44 ctl02 nova-api[6177]: 2017-09-28 12:41:44.561 6177 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:41:44 ctl02 nova-api[6177]: 2017-09-28 12:41:44.561 6177 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:41:44 ctl02 nova-api[6177]: 2017-09-28 12:41:44.561 6177 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:41:44 ctl02 nova-api[6177]: 2017-09-28 12:41:44.561 6177 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:41:44 ctl02 nova-api[6177]: 2017-09-28 12:41:44.561 6177 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:41:44 ctl02 nova-api[6177]: 2017-09-28 12:41:44.561 6177 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:41:44 ctl02 nova-api[6177]: 2017-09-28 12:41:44.561 6177 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:41:44 ctl02 nova-api[6177]: 2017-09-28 12:41:44.561 6177 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:41:44 ctl02 nova-api[6177]: 2017-09-28 12:41:44.561 6177 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:41:44 ctl02 nova-api[6177]: 2017-09-28 12:41:44.561 6177 ERROR nova.wsgi     self.filename))
Sep 28 12:41:44 ctl02 nova-api[6177]: 2017-09-28 12:41:44.561 6177 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:41:44 ctl02 nova-api[6177]: 2017-09-28 12:41:44.561 6177 ERROR nova.wsgi
Sep 28 12:41:44 ctl02 nova-api[6177]: 2017-09-28 12:41:44.562 6177 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:41:44 ctl02 neutron-server[30536]: 2017-09-28 12:41:44.597 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:44 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:44 ctl02 neutron-server[30536]: 2017-09-28 12:41:44.598 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:44 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:44 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:44 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:44 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:44 ctl02 nova-api[6177]: 2017-09-28 12:41:44.694 6177 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:41:44 ctl02 neutron-server[30536]: 2017-09-28 12:41:44.722 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:44 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:44 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:44 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:44 ctl02 neutron-server[30536]: 2017-09-28 12:41:44.724 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:44 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:44 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:44 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:44 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:44 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:44 ctl02 neutron-server[30536]: 2017-09-28 12:41:44.851 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:44 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:44 ctl02 neutron-server[30536]: 2017-09-28 12:41:44.851 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:44 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:44 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:44 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:44 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:44 ctl02 nova-api[6177]: 2017-09-28 12:41:44.945 6177 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:41:44 ctl02 nova-api[6177]: 2017-09-28 12:41:44.947 6177 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:41:44 ctl02 nova-api[6177]: 2017-09-28 12:41:44.948 6177 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:41:44 ctl02 nova-api[6177]: 2017-09-28 12:41:44.948 6177 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:41:44 ctl02 neutron-server[30536]: 2017-09-28 12:41:44.978 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:44 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:44 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:44 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:44 ctl02 neutron-server[30536]: 2017-09-28 12:41:44.980 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:44 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:44 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:44 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:44 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:44 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:45 ctl02 nova-api[6177]: 2017-09-28 12:41:45.090 6177 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:41:45 ctl02 nova-api[6177]: 2017-09-28 12:41:45.092 6177 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:41:45 ctl02 nova-api[6177]: 2017-09-28 12:41:45.092 6177 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:41:45 ctl02 nova-api[6177]: 2017-09-28 12:41:45.093 6177 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:41:45 ctl02 nova-api[6177]: 2017-09-28 12:41:45.097 6177 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:41:45 ctl02 nova-api[6177]: 2017-09-28 12:41:45.097 6177 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:41:45 ctl02 nova-api[6177]: 2017-09-28 12:41:45.097 6177 ERROR nova Traceback (most recent call last):
Sep 28 12:41:45 ctl02 nova-api[6177]: 2017-09-28 12:41:45.097 6177 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:41:45 ctl02 nova-api[6177]: 2017-09-28 12:41:45.097 6177 ERROR nova     sys.exit(main())
Sep 28 12:41:45 ctl02 nova-api[6177]: 2017-09-28 12:41:45.097 6177 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:41:45 ctl02 nova-api[6177]: 2017-09-28 12:41:45.097 6177 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:41:45 ctl02 nova-api[6177]: 2017-09-28 12:41:45.097 6177 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:41:45 ctl02 nova-api[6177]: 2017-09-28 12:41:45.097 6177 ERROR nova     max_url_len=max_url_len)
Sep 28 12:41:45 ctl02 nova-api[6177]: 2017-09-28 12:41:45.097 6177 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:41:45 ctl02 nova-api[6177]: 2017-09-28 12:41:45.097 6177 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:41:45 ctl02 nova-api[6177]: 2017-09-28 12:41:45.097 6177 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:41:45 ctl02 nova-api[6177]: 2017-09-28 12:41:45.097 6177 ERROR nova     sock.listen(backlog)
Sep 28 12:41:45 ctl02 nova-api[6177]: 2017-09-28 12:41:45.097 6177 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:41:45 ctl02 nova-api[6177]: 2017-09-28 12:41:45.097 6177 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:41:45 ctl02 nova-api[6177]: 2017-09-28 12:41:45.097 6177 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:41:45 ctl02 nova-api[6177]: 2017-09-28 12:41:45.097 6177 ERROR nova
Sep 28 12:41:45 ctl02 neutron-server[30536]: 2017-09-28 12:41:45.106 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:45 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:45 ctl02 neutron-server[30536]: 2017-09-28 12:41:45.106 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:45 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:45 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:45 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:45 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:45 ctl02 neutron-server[30536]: 2017-09-28 12:41:45.234 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:45 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:45 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:45 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:45 ctl02 neutron-server[30536]: 2017-09-28 12:41:45.236 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:45 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:45 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:45 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:45 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:45 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:45 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:41:45 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:41:45 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:41:45 ctl02 neutron-server[30536]: 2017-09-28 12:41:45.359 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:45 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:45 ctl02 neutron-server[30536]: 2017-09-28 12:41:45.360 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:45 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:45 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:45 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:45 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:45 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:41:45 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:41:45 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:41:45 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:41:45 ctl02 neutron-server[30536]: 2017-09-28 12:41:45.491 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:45 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:45 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:45 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:45 ctl02 neutron-server[30536]: 2017-09-28 12:41:45.492 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:45 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:45 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:45 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:45 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:45 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:45 ctl02 heat-api[13008]: 2017-09-28 12:41:45.537 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:41:45] "OPTIONS / HTTP/1.0" 200 134 0.000618
Sep 28 12:41:45 ctl02 neutron-server[30536]: 2017-09-28 12:41:45.613 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:45 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:45 ctl02 neutron-server[30536]: 2017-09-28 12:41:45.613 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:45 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:45 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:45 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:45 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:45 ctl02 neutron-server[30536]: 2017-09-28 12:41:45.749 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:45 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:45 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:45 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:45 ctl02 neutron-server[30536]: 2017-09-28 12:41:45.751 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:45 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:45 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:45 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:45 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:45 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:45 ctl02 neutron-server[30536]: 2017-09-28 12:41:45.866 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:45 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:45 ctl02 neutron-server[30536]: 2017-09-28 12:41:45.866 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:45 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:45 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:45 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:45 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:46 ctl02 neutron-server[30536]: 2017-09-28 12:41:46.007 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:46 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:46 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:46 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:46 ctl02 neutron-server[30536]: 2017-09-28 12:41:46.010 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:46 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:46 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:46 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:46 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:46 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:46 ctl02 neutron-server[30536]: 2017-09-28 12:41:46.119 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:46 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:46 ctl02 neutron-server[30536]: 2017-09-28 12:41:46.120 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:46 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:46 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:46 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:46 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:46 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:41:46.142 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:41:46] "OPTIONS / HTTP/1.0" 200 134 0.000408
Sep 28 12:41:46 ctl02 neutron-server[30536]: 2017-09-28 12:41:46.266 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:46 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:46 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:46 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:46 ctl02 neutron-server[30536]: 2017-09-28 12:41:46.269 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:46 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:46 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:46 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:46 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:46 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:46 ctl02 neutron-server[30536]: 2017-09-28 12:41:46.372 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:46 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:46 ctl02 neutron-server[30536]: 2017-09-28 12:41:46.373 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:46 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:46 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:46 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:46 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:46 ctl02 neutron-server[30536]: 2017-09-28 12:41:46.524 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:46 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:46 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:46 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:46 ctl02 neutron-server[30536]: 2017-09-28 12:41:46.527 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:46 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:46 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:46 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:46 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:46 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:46 ctl02 neutron-server[30536]: 2017-09-28 12:41:46.626 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:46 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:46 ctl02 neutron-server[30536]: 2017-09-28 12:41:46.626 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:46 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:46 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:46 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:46 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:46 ctl02 neutron-server[30536]: 2017-09-28 12:41:46.782 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:46 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:46 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:46 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:46 ctl02 neutron-server[30536]: 2017-09-28 12:41:46.784 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:46 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:46 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:46 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:46 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:46 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:46 ctl02 neutron-server[30536]: 2017-09-28 12:41:46.879 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:46 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:46 ctl02 neutron-server[30536]: 2017-09-28 12:41:46.879 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:46 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:46 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:46 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:46 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:46 ctl02 heat-api[13008]: 2017-09-28 12:41:46.954 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:41:46] "OPTIONS / HTTP/1.0" 200 134 0.000542
Sep 28 12:41:47 ctl02 neutron-server[30536]: 2017-09-28 12:41:47.045 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:47 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:47 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:47 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:47 ctl02 neutron-server[30536]: 2017-09-28 12:41:47.047 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:47 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:47 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:47 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:47 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:47 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:47 ctl02 neutron-server[30536]: 2017-09-28 12:41:47.132 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:47 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:47 ctl02 neutron-server[30536]: 2017-09-28 12:41:47.132 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:47 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:47 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:47 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:47 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:47 ctl02 nova-api[6199]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:41:47 ctl02 nova-api[6199]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:41:47 ctl02 neutron-server[30536]: 2017-09-28 12:41:47.303 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:47 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:47 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:47 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:47 ctl02 neutron-server[30536]: 2017-09-28 12:41:47.305 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:47 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:47 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:47 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:47 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:47 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:47 ctl02 nova-api[6199]: 2017-09-28 12:41:47.326 6199 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:41:47 ctl02 nova-api[6199]: 2017-09-28 12:41:47.327 6199 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:41:47 ctl02 nova-api[6199]: 2017-09-28 12:41:47.327 6199 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:41:47 ctl02 nova-api[6199]: 2017-09-28 12:41:47.327 6199 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:41:47 ctl02 nova-api[6199]: 2017-09-28 12:41:47.327 6199 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:41:47 ctl02 nova-api[6199]: 2017-09-28 12:41:47.327 6199 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:41:47 ctl02 nova-api[6199]: 2017-09-28 12:41:47.327 6199 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:41:47 ctl02 nova-api[6199]: 2017-09-28 12:41:47.327 6199 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:41:47 ctl02 nova-api[6199]: 2017-09-28 12:41:47.327 6199 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:41:47 ctl02 nova-api[6199]: 2017-09-28 12:41:47.327 6199 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:41:47 ctl02 nova-api[6199]: 2017-09-28 12:41:47.327 6199 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:41:47 ctl02 nova-api[6199]: 2017-09-28 12:41:47.327 6199 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:41:47 ctl02 nova-api[6199]: 2017-09-28 12:41:47.327 6199 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:41:47 ctl02 nova-api[6199]: 2017-09-28 12:41:47.327 6199 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:41:47 ctl02 nova-api[6199]: 2017-09-28 12:41:47.327 6199 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:41:47 ctl02 nova-api[6199]: 2017-09-28 12:41:47.327 6199 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:41:47 ctl02 nova-api[6199]: 2017-09-28 12:41:47.327 6199 ERROR nova.wsgi     self.filename))
Sep 28 12:41:47 ctl02 nova-api[6199]: 2017-09-28 12:41:47.327 6199 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:41:47 ctl02 nova-api[6199]: 2017-09-28 12:41:47.327 6199 ERROR nova.wsgi
Sep 28 12:41:47 ctl02 nova-api[6199]: 2017-09-28 12:41:47.328 6199 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:41:47 ctl02 neutron-server[30536]: 2017-09-28 12:41:47.386 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:47 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:47 ctl02 neutron-server[30536]: 2017-09-28 12:41:47.387 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:47 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:47 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:47 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:47 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:47 ctl02 nova-api[6199]: 2017-09-28 12:41:47.461 6199 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:41:47 ctl02 neutron-server[30536]: 2017-09-28 12:41:47.559 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:47 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:47 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:47 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:47 ctl02 neutron-server[30536]: 2017-09-28 12:41:47.561 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:47 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:47 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:47 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:47 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:47 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:47 ctl02 neutron-server[30536]: 2017-09-28 12:41:47.640 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:47 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:47 ctl02 neutron-server[30536]: 2017-09-28 12:41:47.640 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:47 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:47 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:47 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:47 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:47 ctl02 nova-api[6199]: 2017-09-28 12:41:47.709 6199 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:41:47 ctl02 nova-api[6199]: 2017-09-28 12:41:47.711 6199 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:41:47 ctl02 nova-api[6199]: 2017-09-28 12:41:47.711 6199 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:41:47 ctl02 nova-api[6199]: 2017-09-28 12:41:47.711 6199 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:41:47 ctl02 neutron-server[30536]: 2017-09-28 12:41:47.817 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:47 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:47 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:47 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:47 ctl02 neutron-server[30536]: 2017-09-28 12:41:47.819 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:47 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:47 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:47 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:47 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:47 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:47 ctl02 nova-api[6199]: 2017-09-28 12:41:47.844 6199 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:41:47 ctl02 nova-api[6199]: 2017-09-28 12:41:47.846 6199 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:41:47 ctl02 nova-api[6199]: 2017-09-28 12:41:47.846 6199 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:41:47 ctl02 nova-api[6199]: 2017-09-28 12:41:47.847 6199 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:41:47 ctl02 nova-api[6199]: 2017-09-28 12:41:47.850 6199 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:41:47 ctl02 nova-api[6199]: 2017-09-28 12:41:47.850 6199 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:41:47 ctl02 nova-api[6199]: 2017-09-28 12:41:47.850 6199 ERROR nova Traceback (most recent call last):
Sep 28 12:41:47 ctl02 nova-api[6199]: 2017-09-28 12:41:47.850 6199 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:41:47 ctl02 nova-api[6199]: 2017-09-28 12:41:47.850 6199 ERROR nova     sys.exit(main())
Sep 28 12:41:47 ctl02 nova-api[6199]: 2017-09-28 12:41:47.850 6199 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:41:47 ctl02 nova-api[6199]: 2017-09-28 12:41:47.850 6199 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:41:47 ctl02 nova-api[6199]: 2017-09-28 12:41:47.850 6199 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:41:47 ctl02 nova-api[6199]: 2017-09-28 12:41:47.850 6199 ERROR nova     max_url_len=max_url_len)
Sep 28 12:41:47 ctl02 nova-api[6199]: 2017-09-28 12:41:47.850 6199 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:41:47 ctl02 nova-api[6199]: 2017-09-28 12:41:47.850 6199 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:41:47 ctl02 nova-api[6199]: 2017-09-28 12:41:47.850 6199 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:41:47 ctl02 nova-api[6199]: 2017-09-28 12:41:47.850 6199 ERROR nova     sock.listen(backlog)
Sep 28 12:41:47 ctl02 nova-api[6199]: 2017-09-28 12:41:47.850 6199 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:41:47 ctl02 nova-api[6199]: 2017-09-28 12:41:47.850 6199 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:41:47 ctl02 nova-api[6199]: 2017-09-28 12:41:47.850 6199 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:41:47 ctl02 nova-api[6199]: 2017-09-28 12:41:47.850 6199 ERROR nova
Sep 28 12:41:47 ctl02 neutron-server[30536]: 2017-09-28 12:41:47.893 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:47 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:47 ctl02 neutron-server[30536]: 2017-09-28 12:41:47.894 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:47 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:47 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:47 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:47 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:48 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:41:48 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:41:48 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:41:48 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:41:48.039 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:41:48] "OPTIONS / HTTP/1.0" 200 134 0.000432
Sep 28 12:41:48 ctl02 neutron-server[30536]: 2017-09-28 12:41:48.074 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:48 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:48 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:48 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:48 ctl02 neutron-server[30536]: 2017-09-28 12:41:48.077 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:48 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:48 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:48 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:48 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:48 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:48 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:41:48 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:41:48 ctl02 neutron-server[30536]: 2017-09-28 12:41:48.146 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:48 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:48 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:41:48 ctl02 neutron-server[30536]: 2017-09-28 12:41:48.147 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:48 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:48 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:48 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:48 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:48 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:41:48 ctl02 neutron-server[30536]: 2017-09-28 12:41:48.332 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:48 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:48 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:48 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:48 ctl02 neutron-server[30536]: 2017-09-28 12:41:48.332 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:48 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:48 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:48 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:48 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:48 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:48 ctl02 neutron-server[30536]: 2017-09-28 12:41:48.400 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:48 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:48 ctl02 neutron-server[30536]: 2017-09-28 12:41:48.401 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:48 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:48 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:48 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:48 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:48 ctl02 neutron-server[30536]: 2017-09-28 12:41:48.586 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:48 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:48 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:48 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:48 ctl02 neutron-server[30536]: 2017-09-28 12:41:48.586 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:48 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:48 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:48 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:48 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:48 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:48 ctl02 neutron-server[30536]: 2017-09-28 12:41:48.654 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:48 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:48 ctl02 neutron-server[30536]: 2017-09-28 12:41:48.654 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:48 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:48 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:48 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:48 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:48 ctl02 heat-api-cfn[13300]: 2017-09-28 12:41:48.780 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:41:48] "OPTIONS / HTTP/1.0" 200 134 0.000451
Sep 28 12:41:48 ctl02 neutron-server[30536]: 2017-09-28 12:41:48.839 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:48 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:48 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:48 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:48 ctl02 neutron-server[30536]: 2017-09-28 12:41:48.840 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:48 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:48 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:48 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:48 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:48 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:48 ctl02 neutron-server[30536]: 2017-09-28 12:41:48.908 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:48 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:48 ctl02 neutron-server[30536]: 2017-09-28 12:41:48.908 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:48 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:48 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:48 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:48 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:49 ctl02 neutron-server[30536]: 2017-09-28 12:41:49.094 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:49 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:49 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:49 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:49 ctl02 neutron-server[30536]: 2017-09-28 12:41:49.094 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:49 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:49 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:49 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:49 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:49 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:49 ctl02 neutron-server[30536]: 2017-09-28 12:41:49.161 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:49 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:49 ctl02 neutron-server[30536]: 2017-09-28 12:41:49.161 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:49 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:49 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:49 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:49 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:49 ctl02 heat-api[13008]: 2017-09-28 12:41:49.254 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:41:49] "OPTIONS / HTTP/1.0" 200 134 0.000548
Sep 28 12:41:49 ctl02 neutron-server[30536]: 2017-09-28 12:41:49.347 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:49 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:49 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:49 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:49 ctl02 neutron-server[30536]: 2017-09-28 12:41:49.348 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:49 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:49 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:49 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:49 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:49 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:49 ctl02 neutron-server[30536]: 2017-09-28 12:41:49.414 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:49 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:49 ctl02 neutron-server[30536]: 2017-09-28 12:41:49.415 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:49 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:49 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:49 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:49 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:49 ctl02 neutron-server[30536]: 2017-09-28 12:41:49.601 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:49 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:49 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:49 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:49 ctl02 neutron-server[30536]: 2017-09-28 12:41:49.602 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:49 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:49 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:49 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:49 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:49 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:49 ctl02 neutron-server[30536]: 2017-09-28 12:41:49.668 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:49 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:49 ctl02 neutron-server[30536]: 2017-09-28 12:41:49.669 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:49 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:49 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:49 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:49 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:49 ctl02 neutron-server[30536]: 2017-09-28 12:41:49.710 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:41:49] "OPTIONS / HTTP/1.0" 200 262 0.000480
Sep 28 12:41:49 ctl02 neutron-server[30536]: 2017-09-28 12:41:49.855 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:49 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:49 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:49 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:49 ctl02 neutron-server[30536]: 2017-09-28 12:41:49.855 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:49 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:49 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:49 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:49 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:49 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:49 ctl02 heat-api-cfn[13300]: 2017-09-28 12:41:49.896 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:41:49] "OPTIONS / HTTP/1.0" 200 134 0.000425
Sep 28 12:41:49 ctl02 nova-api[6218]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:41:49 ctl02 nova-api[6218]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:41:49 ctl02 neutron-server[30536]: 2017-09-28 12:41:49.922 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:49 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:49 ctl02 neutron-server[30536]: 2017-09-28 12:41:49.922 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:49 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:49 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:49 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:49 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:50 ctl02 nova-api[6218]: 2017-09-28 12:41:50.073 6218 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:41:50 ctl02 nova-api[6218]: 2017-09-28 12:41:50.074 6218 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:41:50 ctl02 nova-api[6218]: 2017-09-28 12:41:50.074 6218 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:41:50 ctl02 nova-api[6218]: 2017-09-28 12:41:50.074 6218 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:41:50 ctl02 nova-api[6218]: 2017-09-28 12:41:50.074 6218 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:41:50 ctl02 nova-api[6218]: 2017-09-28 12:41:50.074 6218 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:41:50 ctl02 nova-api[6218]: 2017-09-28 12:41:50.074 6218 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:41:50 ctl02 nova-api[6218]: 2017-09-28 12:41:50.074 6218 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:41:50 ctl02 nova-api[6218]: 2017-09-28 12:41:50.074 6218 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:41:50 ctl02 nova-api[6218]: 2017-09-28 12:41:50.074 6218 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:41:50 ctl02 nova-api[6218]: 2017-09-28 12:41:50.074 6218 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:41:50 ctl02 nova-api[6218]: 2017-09-28 12:41:50.074 6218 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:41:50 ctl02 nova-api[6218]: 2017-09-28 12:41:50.074 6218 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:41:50 ctl02 nova-api[6218]: 2017-09-28 12:41:50.074 6218 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:41:50 ctl02 nova-api[6218]: 2017-09-28 12:41:50.074 6218 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:41:50 ctl02 nova-api[6218]: 2017-09-28 12:41:50.074 6218 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:41:50 ctl02 nova-api[6218]: 2017-09-28 12:41:50.074 6218 ERROR nova.wsgi     self.filename))
Sep 28 12:41:50 ctl02 nova-api[6218]: 2017-09-28 12:41:50.074 6218 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:41:50 ctl02 nova-api[6218]: 2017-09-28 12:41:50.074 6218 ERROR nova.wsgi
Sep 28 12:41:50 ctl02 nova-api[6218]: 2017-09-28 12:41:50.075 6218 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:41:50 ctl02 neutron-server[30536]: 2017-09-28 12:41:50.108 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:50 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:50 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:50 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:50 ctl02 neutron-server[30536]: 2017-09-28 12:41:50.109 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:50 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:50 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:50 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:50 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:50 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:50 ctl02 neutron-server[30536]: 2017-09-28 12:41:50.177 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:50 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:50 ctl02 neutron-server[30536]: 2017-09-28 12:41:50.178 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:50 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:50 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:50 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:50 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:50 ctl02 nova-api[6218]: 2017-09-28 12:41:50.205 6218 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:41:50 ctl02 neutron-server[30536]: 2017-09-28 12:41:50.362 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:50 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:50 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:50 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:50 ctl02 neutron-server[30536]: 2017-09-28 12:41:50.363 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:50 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:50 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:50 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:50 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:50 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:50 ctl02 nova-api[6218]: 2017-09-28 12:41:50.429 6218 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:41:50 ctl02 neutron-server[30536]: 2017-09-28 12:41:50.431 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:50 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:50 ctl02 nova-api[6218]: 2017-09-28 12:41:50.431 6218 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:41:50 ctl02 nova-api[6218]: 2017-09-28 12:41:50.432 6218 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:41:50 ctl02 nova-api[6218]: 2017-09-28 12:41:50.432 6218 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:41:50 ctl02 neutron-server[30536]: 2017-09-28 12:41:50.433 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:50 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:50 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:50 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:50 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:50 ctl02 nova-api[6218]: 2017-09-28 12:41:50.563 6218 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:41:50 ctl02 nova-api[6218]: 2017-09-28 12:41:50.565 6218 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:41:50 ctl02 nova-api[6218]: 2017-09-28 12:41:50.565 6218 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:41:50 ctl02 nova-api[6218]: 2017-09-28 12:41:50.566 6218 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:41:50 ctl02 nova-api[6218]: 2017-09-28 12:41:50.569 6218 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:41:50 ctl02 nova-api[6218]: 2017-09-28 12:41:50.569 6218 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:41:50 ctl02 nova-api[6218]: 2017-09-28 12:41:50.569 6218 ERROR nova Traceback (most recent call last):
Sep 28 12:41:50 ctl02 nova-api[6218]: 2017-09-28 12:41:50.569 6218 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:41:50 ctl02 nova-api[6218]: 2017-09-28 12:41:50.569 6218 ERROR nova     sys.exit(main())
Sep 28 12:41:50 ctl02 nova-api[6218]: 2017-09-28 12:41:50.569 6218 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:41:50 ctl02 nova-api[6218]: 2017-09-28 12:41:50.569 6218 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:41:50 ctl02 nova-api[6218]: 2017-09-28 12:41:50.569 6218 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:41:50 ctl02 nova-api[6218]: 2017-09-28 12:41:50.569 6218 ERROR nova     max_url_len=max_url_len)
Sep 28 12:41:50 ctl02 nova-api[6218]: 2017-09-28 12:41:50.569 6218 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:41:50 ctl02 nova-api[6218]: 2017-09-28 12:41:50.569 6218 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:41:50 ctl02 nova-api[6218]: 2017-09-28 12:41:50.569 6218 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:41:50 ctl02 nova-api[6218]: 2017-09-28 12:41:50.569 6218 ERROR nova     sock.listen(backlog)
Sep 28 12:41:50 ctl02 nova-api[6218]: 2017-09-28 12:41:50.569 6218 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:41:50 ctl02 nova-api[6218]: 2017-09-28 12:41:50.569 6218 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:41:50 ctl02 nova-api[6218]: 2017-09-28 12:41:50.569 6218 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:41:50 ctl02 nova-api[6218]: 2017-09-28 12:41:50.569 6218 ERROR nova
Sep 28 12:41:50 ctl02 neutron-server[30536]: 2017-09-28 12:41:50.616 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:50 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:50 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:50 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:50 ctl02 neutron-server[30536]: 2017-09-28 12:41:50.616 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:50 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:50 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:50 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:50 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:50 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:50 ctl02 neutron-server[30536]: 2017-09-28 12:41:50.687 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:50 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:50 ctl02 neutron-server[30536]: 2017-09-28 12:41:50.687 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:50 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:50 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:50 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:50 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:50 ctl02 glance-api[29183]: 2017-09-28 12:41:50.701 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:41:50] "OPTIONS / HTTP/1.0" 200 134 0.000619
Sep 28 12:41:50 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:41:50 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:41:50 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:41:50 ctl02 neutron-server[30536]: 2017-09-28 12:41:50.758 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:41:50] "OPTIONS / HTTP/1.0" 200 262 0.000469
Sep 28 12:41:50 ctl02 neutron-server[30536]: 2017-09-28 12:41:50.870 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:50 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:50 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:50 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:50 ctl02 neutron-server[30536]: 2017-09-28 12:41:50.870 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:50 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:50 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:50 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:50 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:50 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:50 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:41:50 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:41:50 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:41:50 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:41:50 ctl02 neutron-server[30536]: 2017-09-28 12:41:50.913 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:41:50] "OPTIONS / HTTP/1.0" 200 262 0.000481
Sep 28 12:41:50 ctl02 neutron-server[30536]: 2017-09-28 12:41:50.940 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:50 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:50 ctl02 neutron-server[30536]: 2017-09-28 12:41:50.940 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:50 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:50 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:50 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:50 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:51 ctl02 neutron-server[30536]: 2017-09-28 12:41:51.123 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:51 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:51 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:51 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:51 ctl02 neutron-server[30536]: 2017-09-28 12:41:51.124 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:51 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:51 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:51 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:51 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:51 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:51 ctl02 neutron-server[30536]: 2017-09-28 12:41:51.201 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:51 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:51 ctl02 neutron-server[30536]: 2017-09-28 12:41:51.202 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:51 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:51 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:51 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:51 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:51 ctl02 neutron-server[30536]: 2017-09-28 12:41:51.298 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 12:41:51 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:41:51 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:40:56 cmp002
Sep 28 12:41:51 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:41:20 cmp002
Sep 28 12:41:51 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:41:16 cmp002
Sep 28 12:41:51 ctl02 neutron-server[30536]: 2017-09-28 12:41:51.376 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:51 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:51 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:51 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:51 ctl02 neutron-server[30536]: 2017-09-28 12:41:51.377 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:51 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:51 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:51 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:51 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:51 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:51 ctl02 neutron-server[30536]: 2017-09-28 12:41:51.455 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:51 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:51 ctl02 neutron-server[30536]: 2017-09-28 12:41:51.456 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:51 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:51 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:51 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:51 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:51 ctl02 glance-api[29183]: 2017-09-28 12:41:51.624 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:41:51] "OPTIONS / HTTP/1.0" 200 134 0.000721
Sep 28 12:41:51 ctl02 neutron-server[30536]: 2017-09-28 12:41:51.630 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:51 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:51 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:51 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:51 ctl02 neutron-server[30536]: 2017-09-28 12:41:51.630 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:51 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:51 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:51 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:51 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:51 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:51 ctl02 neutron-server[30536]: 2017-09-28 12:41:51.709 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:51 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:51 ctl02 neutron-server[30536]: 2017-09-28 12:41:51.710 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:51 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:51 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:51 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:51 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:51 ctl02 neutron-server[30536]: 2017-09-28 12:41:51.884 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:51 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:51 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:51 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:51 ctl02 neutron-server[30536]: 2017-09-28 12:41:51.884 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:51 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:51 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:51 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:51 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:51 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:51 ctl02 neutron-server[30536]: 2017-09-28 12:41:51.964 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:51 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:51 ctl02 neutron-server[30536]: 2017-09-28 12:41:51.965 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:51 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:51 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:51 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:51 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:52 ctl02 neutron-server[30536]: 2017-09-28 12:41:52.150 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:52 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:52 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:52 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:52 ctl02 neutron-server[30536]: 2017-09-28 12:41:52.151 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:52 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:52 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:52 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:52 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:52 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:52 ctl02 neutron-server[30536]: 2017-09-28 12:41:52.218 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:52 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:52 ctl02 neutron-server[30536]: 2017-09-28 12:41:52.219 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:52 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:52 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:52 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:52 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:52 ctl02 heat-api-cfn[13300]: 2017-09-28 12:41:52.341 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:41:52] "OPTIONS / HTTP/1.0" 200 134 0.000431
Sep 28 12:41:52 ctl02 nova-consoleauth[5433]: 2017-09-28 12:41:52.398 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:41:52 ctl02 neutron-server[30536]: 2017-09-28 12:41:52.404 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:52 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:52 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:52 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:52 ctl02 neutron-server[30536]: 2017-09-28 12:41:52.404 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:52 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:52 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:52 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:52 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:52 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:52 ctl02 neutron-server[30536]: 2017-09-28 12:41:52.474 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:52 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:52 ctl02 neutron-server[30536]: 2017-09-28 12:41:52.475 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:52 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:52 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:52 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:52 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:52 ctl02 glance-api[29183]: 2017-09-28 12:41:52.521 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:41:52] "OPTIONS / HTTP/1.0" 200 134 0.000580
Sep 28 12:41:52 ctl02 nova-api[6235]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:41:52 ctl02 nova-api[6235]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:41:52 ctl02 neutron-server[30536]: 2017-09-28 12:41:52.657 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:52 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:52 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:52 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:52 ctl02 neutron-server[30536]: 2017-09-28 12:41:52.657 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:52 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:52 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:52 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:52 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:52 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:52 ctl02 nova-api[6235]: 2017-09-28 12:41:52.724 6235 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:41:52 ctl02 nova-api[6235]: 2017-09-28 12:41:52.725 6235 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:41:52 ctl02 nova-api[6235]: 2017-09-28 12:41:52.725 6235 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:41:52 ctl02 nova-api[6235]: 2017-09-28 12:41:52.725 6235 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:41:52 ctl02 nova-api[6235]: 2017-09-28 12:41:52.725 6235 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:41:52 ctl02 nova-api[6235]: 2017-09-28 12:41:52.725 6235 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:41:52 ctl02 nova-api[6235]: 2017-09-28 12:41:52.725 6235 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:41:52 ctl02 nova-api[6235]: 2017-09-28 12:41:52.725 6235 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:41:52 ctl02 nova-api[6235]: 2017-09-28 12:41:52.725 6235 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:41:52 ctl02 nova-api[6235]: 2017-09-28 12:41:52.725 6235 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:41:52 ctl02 nova-api[6235]: 2017-09-28 12:41:52.725 6235 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:41:52 ctl02 nova-api[6235]: 2017-09-28 12:41:52.725 6235 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:41:52 ctl02 nova-api[6235]: 2017-09-28 12:41:52.725 6235 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:41:52 ctl02 nova-api[6235]: 2017-09-28 12:41:52.725 6235 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:41:52 ctl02 nova-api[6235]: 2017-09-28 12:41:52.725 6235 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:41:52 ctl02 nova-api[6235]: 2017-09-28 12:41:52.725 6235 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:41:52 ctl02 nova-api[6235]: 2017-09-28 12:41:52.725 6235 ERROR nova.wsgi     self.filename))
Sep 28 12:41:52 ctl02 nova-api[6235]: 2017-09-28 12:41:52.725 6235 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:41:52 ctl02 nova-api[6235]: 2017-09-28 12:41:52.725 6235 ERROR nova.wsgi
Sep 28 12:41:52 ctl02 nova-api[6235]: 2017-09-28 12:41:52.726 6235 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:41:52 ctl02 neutron-server[30536]: 2017-09-28 12:41:52.730 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:52 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:52 ctl02 neutron-server[30536]: 2017-09-28 12:41:52.732 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:52 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:52 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:52 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:52 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:52 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:41:52.803 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:41:52] "OPTIONS / HTTP/1.0" 200 134 0.000373
Sep 28 12:41:52 ctl02 nova-api[6235]: 2017-09-28 12:41:52.854 6235 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:41:52 ctl02 neutron-server[30536]: 2017-09-28 12:41:52.910 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:52 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:52 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:52 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:52 ctl02 neutron-server[30536]: 2017-09-28 12:41:52.911 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:52 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:52 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:52 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:52 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:52 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:52 ctl02 neutron-server[30536]: 2017-09-28 12:41:52.987 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:52 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:52 ctl02 neutron-server[30536]: 2017-09-28 12:41:52.987 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:52 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:52 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:52 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:52 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:53 ctl02 nova-api[6235]: 2017-09-28 12:41:53.079 6235 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:41:53 ctl02 nova-api[6235]: 2017-09-28 12:41:53.081 6235 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:41:53 ctl02 nova-api[6235]: 2017-09-28 12:41:53.081 6235 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:41:53 ctl02 nova-api[6235]: 2017-09-28 12:41:53.081 6235 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:41:53 ctl02 neutron-server[30536]: 2017-09-28 12:41:53.164 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:53 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:53 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:53 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:53 ctl02 neutron-server[30536]: 2017-09-28 12:41:53.164 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:53 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:53 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:53 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:53 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:53 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:53 ctl02 nova-api[6235]: 2017-09-28 12:41:53.213 6235 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:41:53 ctl02 nova-api[6235]: 2017-09-28 12:41:53.214 6235 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:41:53 ctl02 nova-api[6235]: 2017-09-28 12:41:53.215 6235 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:41:53 ctl02 nova-api[6235]: 2017-09-28 12:41:53.215 6235 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:41:53 ctl02 nova-api[6235]: 2017-09-28 12:41:53.218 6235 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:41:53 ctl02 nova-api[6235]: 2017-09-28 12:41:53.218 6235 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:41:53 ctl02 nova-api[6235]: 2017-09-28 12:41:53.218 6235 ERROR nova Traceback (most recent call last):
Sep 28 12:41:53 ctl02 nova-api[6235]: 2017-09-28 12:41:53.218 6235 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:41:53 ctl02 nova-api[6235]: 2017-09-28 12:41:53.218 6235 ERROR nova     sys.exit(main())
Sep 28 12:41:53 ctl02 nova-api[6235]: 2017-09-28 12:41:53.218 6235 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:41:53 ctl02 nova-api[6235]: 2017-09-28 12:41:53.218 6235 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:41:53 ctl02 nova-api[6235]: 2017-09-28 12:41:53.218 6235 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:41:53 ctl02 nova-api[6235]: 2017-09-28 12:41:53.218 6235 ERROR nova     max_url_len=max_url_len)
Sep 28 12:41:53 ctl02 nova-api[6235]: 2017-09-28 12:41:53.218 6235 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:41:53 ctl02 nova-api[6235]: 2017-09-28 12:41:53.218 6235 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:41:53 ctl02 nova-api[6235]: 2017-09-28 12:41:53.218 6235 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:41:53 ctl02 nova-api[6235]: 2017-09-28 12:41:53.218 6235 ERROR nova     sock.listen(backlog)
Sep 28 12:41:53 ctl02 nova-api[6235]: 2017-09-28 12:41:53.218 6235 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:41:53 ctl02 nova-api[6235]: 2017-09-28 12:41:53.218 6235 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:41:53 ctl02 nova-api[6235]: 2017-09-28 12:41:53.218 6235 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:41:53 ctl02 nova-api[6235]: 2017-09-28 12:41:53.218 6235 ERROR nova
Sep 28 12:41:53 ctl02 neutron-server[30536]: 2017-09-28 12:41:53.243 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:53 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:53 ctl02 neutron-server[30536]: 2017-09-28 12:41:53.243 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:53 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:53 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:53 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:53 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:53 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:41:53 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:41:53 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:41:53 ctl02 neutron-server[30536]: 2017-09-28 12:41:53.418 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:53 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:53 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:53 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:53 ctl02 neutron-server[30536]: 2017-09-28 12:41:53.418 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:53 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:53 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:53 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:53 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:53 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:53 ctl02 neutron-server[30536]: 2017-09-28 12:41:53.497 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:53 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:53 ctl02 neutron-server[30536]: 2017-09-28 12:41:53.497 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:53 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:53 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:53 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:53 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:53 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:41:53 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:41:53 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:41:53 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:41:53 ctl02 neutron-server[30536]: 2017-09-28 12:41:53.671 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:53 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:53 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:53 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:53 ctl02 neutron-server[30536]: 2017-09-28 12:41:53.672 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:53 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:53 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:53 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:53 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:53 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:53 ctl02 neutron-server[30536]: 2017-09-28 12:41:53.751 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:53 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:53 ctl02 neutron-server[30536]: 2017-09-28 12:41:53.751 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:53 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:53 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:53 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:53 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:53 ctl02 neutron-server[30536]: 2017-09-28 12:41:53.925 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:53 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:53 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:53 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:53 ctl02 neutron-server[30536]: 2017-09-28 12:41:53.926 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:53 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:53 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:53 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:53 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:53 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:54 ctl02 neutron-server[30536]: 2017-09-28 12:41:54.006 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:54 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:54 ctl02 neutron-server[30536]: 2017-09-28 12:41:54.007 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:54 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:54 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:54 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:54 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:54 ctl02 heat-engine[12803]: 2017-09-28 12:41:54.067 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:41:54 ctl02 heat-engine[12803]: 2017-09-28 12:41:54.072 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:41:54 ctl02 heat-engine[12803]: 2017-09-28 12:41:54.076 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:41:54 ctl02 heat-engine[12803]: 2017-09-28 12:41:54.080 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:41:54 ctl02 neutron-server[30536]: 2017-09-28 12:41:54.179 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:54 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:54 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:54 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:54 ctl02 neutron-server[30536]: 2017-09-28 12:41:54.180 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:54 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:54 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:54 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:54 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:54 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:54 ctl02 neutron-server[30536]: 2017-09-28 12:41:54.260 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:54 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:54 ctl02 neutron-server[30536]: 2017-09-28 12:41:54.260 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:54 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:54 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:54 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:54 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:54 ctl02 neutron-server[30536]: 2017-09-28 12:41:54.436 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:54 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:54 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:54 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:54 ctl02 neutron-server[30536]: 2017-09-28 12:41:54.436 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:54 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:54 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:54 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:54 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:54 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:54 ctl02 neutron-server[30536]: 2017-09-28 12:41:54.513 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:54 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:54 ctl02 neutron-server[30536]: 2017-09-28 12:41:54.514 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:54 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:54 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:54 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:54 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:54 ctl02 neutron-server[30536]: 2017-09-28 12:41:54.689 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:54 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:54 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:54 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:54 ctl02 neutron-server[30536]: 2017-09-28 12:41:54.690 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:54 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:54 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:54 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:54 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:54 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:54 ctl02 neutron-server[30536]: 2017-09-28 12:41:54.767 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:54 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:54 ctl02 neutron-server[30536]: 2017-09-28 12:41:54.767 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:54 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:54 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:54 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:54 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:54 ctl02 neutron-server[30536]: 2017-09-28 12:41:54.946 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:54 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:54 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:54 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:54 ctl02 neutron-server[30536]: 2017-09-28 12:41:54.947 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:54 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:54 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:54 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:54 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:54 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:55 ctl02 neutron-server[30536]: 2017-09-28 12:41:55.020 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:55 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:55 ctl02 neutron-server[30536]: 2017-09-28 12:41:55.021 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:55 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:55 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:55 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:55 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:55 ctl02 neutron-server[30536]: 2017-09-28 12:41:55.200 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:55 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:55 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:55 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:55 ctl02 neutron-server[30536]: 2017-09-28 12:41:55.200 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:55 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:55 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:55 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:55 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:55 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:55 ctl02 neutron-server[30536]: 2017-09-28 12:41:55.273 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:55 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:55 ctl02 neutron-server[30536]: 2017-09-28 12:41:55.273 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:55 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:55 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:55 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:55 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:55 ctl02 nova-api[6254]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:41:55 ctl02 nova-api[6254]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:41:55 ctl02 neutron-server[30536]: 2017-09-28 12:41:55.453 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:55 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:55 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:55 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:55 ctl02 neutron-server[30536]: 2017-09-28 12:41:55.454 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:55 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:55 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:55 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:55 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:55 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:55 ctl02 nova-scheduler[5620]: 2017-09-28 12:41:55.490 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:41:55 ctl02 neutron-server[30536]: 2017-09-28 12:41:55.526 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:55 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:55 ctl02 neutron-server[30536]: 2017-09-28 12:41:55.527 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:55 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:55 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:55 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:55 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:55 ctl02 nova-api[6254]: 2017-09-28 12:41:55.529 6254 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:41:55 ctl02 nova-api[6254]: 2017-09-28 12:41:55.531 6254 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:41:55 ctl02 nova-api[6254]: 2017-09-28 12:41:55.531 6254 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:41:55 ctl02 nova-api[6254]: 2017-09-28 12:41:55.531 6254 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:41:55 ctl02 nova-api[6254]: 2017-09-28 12:41:55.531 6254 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:41:55 ctl02 nova-api[6254]: 2017-09-28 12:41:55.531 6254 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:41:55 ctl02 nova-api[6254]: 2017-09-28 12:41:55.531 6254 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:41:55 ctl02 nova-api[6254]: 2017-09-28 12:41:55.531 6254 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:41:55 ctl02 nova-api[6254]: 2017-09-28 12:41:55.531 6254 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:41:55 ctl02 nova-api[6254]: 2017-09-28 12:41:55.531 6254 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:41:55 ctl02 nova-api[6254]: 2017-09-28 12:41:55.531 6254 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:41:55 ctl02 nova-api[6254]: 2017-09-28 12:41:55.531 6254 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:41:55 ctl02 nova-api[6254]: 2017-09-28 12:41:55.531 6254 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:41:55 ctl02 nova-api[6254]: 2017-09-28 12:41:55.531 6254 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:41:55 ctl02 nova-api[6254]: 2017-09-28 12:41:55.531 6254 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:41:55 ctl02 nova-api[6254]: 2017-09-28 12:41:55.531 6254 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:41:55 ctl02 nova-api[6254]: 2017-09-28 12:41:55.531 6254 ERROR nova.wsgi     self.filename))
Sep 28 12:41:55 ctl02 nova-api[6254]: 2017-09-28 12:41:55.531 6254 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:41:55 ctl02 nova-api[6254]: 2017-09-28 12:41:55.531 6254 ERROR nova.wsgi
Sep 28 12:41:55 ctl02 nova-api[6254]: 2017-09-28 12:41:55.532 6254 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:41:55 ctl02 heat-api[13008]: 2017-09-28 12:41:55.630 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:41:55] "OPTIONS / HTTP/1.0" 200 134 0.000506
Sep 28 12:41:55 ctl02 nova-api[6254]: 2017-09-28 12:41:55.662 6254 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:41:55 ctl02 neutron-server[30536]: 2017-09-28 12:41:55.707 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:55 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:55 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:55 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:55 ctl02 neutron-server[30536]: 2017-09-28 12:41:55.707 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:55 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:55 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:55 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:55 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:55 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:55 ctl02 neutron-server[30536]: 2017-09-28 12:41:55.779 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:55 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:55 ctl02 neutron-server[30536]: 2017-09-28 12:41:55.780 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:55 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:55 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:55 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:55 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:55 ctl02 nova-api[6254]: 2017-09-28 12:41:55.899 6254 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:41:55 ctl02 nova-api[6254]: 2017-09-28 12:41:55.901 6254 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:41:55 ctl02 nova-api[6254]: 2017-09-28 12:41:55.902 6254 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:41:55 ctl02 nova-api[6254]: 2017-09-28 12:41:55.902 6254 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:41:55 ctl02 neutron-server[30536]: 2017-09-28 12:41:55.960 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:55 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:55 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:55 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:55 ctl02 neutron-server[30536]: 2017-09-28 12:41:55.961 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:55 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:55 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:55 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:55 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:55 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:56 ctl02 neutron-server[30536]: 2017-09-28 12:41:56.032 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:56 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:56 ctl02 neutron-server[30536]: 2017-09-28 12:41:56.033 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:56 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:56 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:56 ctl02 nova-api[6254]: 2017-09-28 12:41:56.033 6254 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:41:56 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:56 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:56 ctl02 nova-api[6254]: 2017-09-28 12:41:56.035 6254 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:41:56 ctl02 nova-api[6254]: 2017-09-28 12:41:56.035 6254 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:41:56 ctl02 nova-api[6254]: 2017-09-28 12:41:56.036 6254 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:41:56 ctl02 nova-api[6254]: 2017-09-28 12:41:56.039 6254 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:41:56 ctl02 nova-api[6254]: 2017-09-28 12:41:56.039 6254 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:41:56 ctl02 nova-api[6254]: 2017-09-28 12:41:56.039 6254 ERROR nova Traceback (most recent call last):
Sep 28 12:41:56 ctl02 nova-api[6254]: 2017-09-28 12:41:56.039 6254 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:41:56 ctl02 nova-api[6254]: 2017-09-28 12:41:56.039 6254 ERROR nova     sys.exit(main())
Sep 28 12:41:56 ctl02 nova-api[6254]: 2017-09-28 12:41:56.039 6254 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:41:56 ctl02 nova-api[6254]: 2017-09-28 12:41:56.039 6254 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:41:56 ctl02 nova-api[6254]: 2017-09-28 12:41:56.039 6254 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:41:56 ctl02 nova-api[6254]: 2017-09-28 12:41:56.039 6254 ERROR nova     max_url_len=max_url_len)
Sep 28 12:41:56 ctl02 nova-api[6254]: 2017-09-28 12:41:56.039 6254 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:41:56 ctl02 nova-api[6254]: 2017-09-28 12:41:56.039 6254 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:41:56 ctl02 nova-api[6254]: 2017-09-28 12:41:56.039 6254 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:41:56 ctl02 nova-api[6254]: 2017-09-28 12:41:56.039 6254 ERROR nova     sock.listen(backlog)
Sep 28 12:41:56 ctl02 nova-api[6254]: 2017-09-28 12:41:56.039 6254 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:41:56 ctl02 nova-api[6254]: 2017-09-28 12:41:56.039 6254 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:41:56 ctl02 nova-api[6254]: 2017-09-28 12:41:56.039 6254 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:41:56 ctl02 nova-api[6254]: 2017-09-28 12:41:56.039 6254 ERROR nova
Sep 28 12:41:56 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:41:56 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:41:56 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:41:56 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:41:56.212 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:41:56] "OPTIONS / HTTP/1.0" 200 134 0.000367
Sep 28 12:41:56 ctl02 neutron-server[30536]: 2017-09-28 12:41:56.214 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:56 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:56 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:56 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:56 ctl02 neutron-server[30536]: 2017-09-28 12:41:56.214 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:56 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:56 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:56 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:56 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:56 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:56 ctl02 neutron-server[30536]: 2017-09-28 12:41:56.286 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:56 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:56 ctl02 neutron-server[30536]: 2017-09-28 12:41:56.286 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:56 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:56 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:56 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:56 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:56 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:41:56 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:41:56 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:41:56 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:41:56 ctl02 neutron-server[30536]: 2017-09-28 12:41:56.467 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:56 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:56 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:56 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:56 ctl02 neutron-server[30536]: 2017-09-28 12:41:56.468 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:56 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:56 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:56 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:56 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:56 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:56 ctl02 neutron-server[30536]: 2017-09-28 12:41:56.539 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:56 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:56 ctl02 neutron-server[30536]: 2017-09-28 12:41:56.539 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:56 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:56 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:56 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:56 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:56 ctl02 neutron-server[30536]: 2017-09-28 12:41:56.721 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:56 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:56 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:56 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:56 ctl02 neutron-server[30536]: 2017-09-28 12:41:56.722 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:56 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:56 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:56 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:56 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:56 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:56 ctl02 neutron-server[30536]: 2017-09-28 12:41:56.792 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:56 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:56 ctl02 neutron-server[30536]: 2017-09-28 12:41:56.793 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:56 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:56 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:56 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:56 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:57 ctl02 neutron-server[30536]: 2017-09-28 12:41:57.047 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:57 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:57 ctl02 neutron-server[30536]: 2017-09-28 12:41:57.084 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:57 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:57 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:57 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:57 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:57 ctl02 neutron-server[30536]: 2017-09-28 12:41:56.977 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:57 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:57 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:57 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:57 ctl02 neutron-server[30536]: 2017-09-28 12:41:57.086 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:57 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:57 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:57 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:57 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:57 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:57 ctl02 heat-api[13008]: 2017-09-28 12:41:57.185 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:41:57] "OPTIONS / HTTP/1.0" 200 134 0.000516
Sep 28 12:41:57 ctl02 neutron-server[30536]: 2017-09-28 12:41:57.339 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:57 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:57 ctl02 neutron-server[30536]: 2017-09-28 12:41:57.339 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:57 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:57 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:57 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:57 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:57 ctl02 neutron-server[30536]: 2017-09-28 12:41:57.342 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:57 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:57 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:57 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:57 ctl02 neutron-server[30536]: 2017-09-28 12:41:57.342 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:57 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:57 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:57 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:57 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:57 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:57 ctl02 neutron-server[30536]: 2017-09-28 12:41:57.596 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:57 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:57 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:57 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:57 ctl02 neutron-server[30536]: 2017-09-28 12:41:57.596 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:57 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:57 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:57 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:57 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:57 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:57 ctl02 neutron-server[30536]: 2017-09-28 12:41:57.598 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:57 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:57 ctl02 neutron-server[30536]: 2017-09-28 12:41:57.599 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:57 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:57 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:57 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:57 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:57 ctl02 neutron-server[30536]: 2017-09-28 12:41:57.852 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:57 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:57 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:57 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:57 ctl02 neutron-server[30536]: 2017-09-28 12:41:57.853 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:57 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:57 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:57 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:57 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:57 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:57 ctl02 neutron-server[30536]: 2017-09-28 12:41:57.854 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:57 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:57 ctl02 neutron-server[30536]: 2017-09-28 12:41:57.855 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:57 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:57 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:57 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:57 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:58 ctl02 nova-api[6272]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:41:58 ctl02 nova-api[6272]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:41:58 ctl02 neutron-server[30536]: 2017-09-28 12:41:58.108 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:58 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:58 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:58 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:58 ctl02 neutron-server[30536]: 2017-09-28 12:41:58.109 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:58 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:58 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:58 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:58 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:58 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:58 ctl02 neutron-server[30536]: 2017-09-28 12:41:58.110 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:58 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:58 ctl02 neutron-server[30536]: 2017-09-28 12:41:58.111 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:58 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:58 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:58 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:58 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:58 ctl02 nova-api[6272]: 2017-09-28 12:41:58.275 6272 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:41:58 ctl02 nova-api[6272]: 2017-09-28 12:41:58.276 6272 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:41:58 ctl02 nova-api[6272]: 2017-09-28 12:41:58.276 6272 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:41:58 ctl02 nova-api[6272]: 2017-09-28 12:41:58.276 6272 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:41:58 ctl02 nova-api[6272]: 2017-09-28 12:41:58.276 6272 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:41:58 ctl02 nova-api[6272]: 2017-09-28 12:41:58.276 6272 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:41:58 ctl02 nova-api[6272]: 2017-09-28 12:41:58.276 6272 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:41:58 ctl02 nova-api[6272]: 2017-09-28 12:41:58.276 6272 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:41:58 ctl02 nova-api[6272]: 2017-09-28 12:41:58.276 6272 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:41:58 ctl02 nova-api[6272]: 2017-09-28 12:41:58.276 6272 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:41:58 ctl02 nova-api[6272]: 2017-09-28 12:41:58.276 6272 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:41:58 ctl02 nova-api[6272]: 2017-09-28 12:41:58.276 6272 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:41:58 ctl02 nova-api[6272]: 2017-09-28 12:41:58.276 6272 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:41:58 ctl02 nova-api[6272]: 2017-09-28 12:41:58.276 6272 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:41:58 ctl02 nova-api[6272]: 2017-09-28 12:41:58.276 6272 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:41:58 ctl02 nova-api[6272]: 2017-09-28 12:41:58.276 6272 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:41:58 ctl02 nova-api[6272]: 2017-09-28 12:41:58.276 6272 ERROR nova.wsgi     self.filename))
Sep 28 12:41:58 ctl02 nova-api[6272]: 2017-09-28 12:41:58.276 6272 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:41:58 ctl02 nova-api[6272]: 2017-09-28 12:41:58.276 6272 ERROR nova.wsgi
Sep 28 12:41:58 ctl02 nova-api[6272]: 2017-09-28 12:41:58.277 6272 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:41:58 ctl02 neutron-server[30536]: 2017-09-28 12:41:58.363 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:58 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:58 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:58 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:58 ctl02 neutron-server[30536]: 2017-09-28 12:41:58.363 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:58 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:58 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:58 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:58 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:58 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:58 ctl02 neutron-server[30536]: 2017-09-28 12:41:58.365 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:58 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:58 ctl02 neutron-server[30536]: 2017-09-28 12:41:58.366 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:58 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:58 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:58 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:58 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:58 ctl02 nova-api[6272]: 2017-09-28 12:41:58.413 6272 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:41:58 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:41:58.440 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:41:58] "OPTIONS / HTTP/1.0" 200 134 0.000371
Sep 28 12:41:58 ctl02 neutron-server[30536]: 2017-09-28 12:41:58.487 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:41:58 ctl02 neutron-server[30536]: 2017-09-28 12:41:58.620 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:58 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:58 ctl02 neutron-server[30536]: 2017-09-28 12:41:58.622 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:58 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:58 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:58 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:58 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:58 ctl02 neutron-server[30536]: 2017-09-28 12:41:58.625 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:58 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:58 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:58 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:58 ctl02 neutron-server[30536]: 2017-09-28 12:41:58.626 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:58 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:58 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:58 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:58 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:58 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:58 ctl02 heat-api-cfn[13300]: 2017-09-28 12:41:58.671 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:41:58] "OPTIONS / HTTP/1.0" 200 134 0.000541
Sep 28 12:41:58 ctl02 nova-api[6272]: 2017-09-28 12:41:58.675 6272 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:41:58 ctl02 nova-api[6272]: 2017-09-28 12:41:58.678 6272 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:41:58 ctl02 nova-api[6272]: 2017-09-28 12:41:58.678 6272 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:41:58 ctl02 nova-api[6272]: 2017-09-28 12:41:58.678 6272 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:41:58 ctl02 nova-api[6272]: 2017-09-28 12:41:58.811 6272 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:41:58 ctl02 nova-api[6272]: 2017-09-28 12:41:58.813 6272 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:41:58 ctl02 nova-api[6272]: 2017-09-28 12:41:58.814 6272 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:41:58 ctl02 nova-api[6272]: 2017-09-28 12:41:58.814 6272 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:41:58 ctl02 nova-api[6272]: 2017-09-28 12:41:58.817 6272 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:41:58 ctl02 nova-api[6272]: 2017-09-28 12:41:58.818 6272 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:41:58 ctl02 nova-api[6272]: 2017-09-28 12:41:58.818 6272 ERROR nova Traceback (most recent call last):
Sep 28 12:41:58 ctl02 nova-api[6272]: 2017-09-28 12:41:58.818 6272 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:41:58 ctl02 nova-api[6272]: 2017-09-28 12:41:58.818 6272 ERROR nova     sys.exit(main())
Sep 28 12:41:58 ctl02 nova-api[6272]: 2017-09-28 12:41:58.818 6272 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:41:58 ctl02 nova-api[6272]: 2017-09-28 12:41:58.818 6272 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:41:58 ctl02 nova-api[6272]: 2017-09-28 12:41:58.818 6272 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:41:58 ctl02 nova-api[6272]: 2017-09-28 12:41:58.818 6272 ERROR nova     max_url_len=max_url_len)
Sep 28 12:41:58 ctl02 nova-api[6272]: 2017-09-28 12:41:58.818 6272 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:41:58 ctl02 nova-api[6272]: 2017-09-28 12:41:58.818 6272 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:41:58 ctl02 nova-api[6272]: 2017-09-28 12:41:58.818 6272 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:41:58 ctl02 nova-api[6272]: 2017-09-28 12:41:58.818 6272 ERROR nova     sock.listen(backlog)
Sep 28 12:41:58 ctl02 nova-api[6272]: 2017-09-28 12:41:58.818 6272 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:41:58 ctl02 nova-api[6272]: 2017-09-28 12:41:58.818 6272 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:41:58 ctl02 nova-api[6272]: 2017-09-28 12:41:58.818 6272 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:41:58 ctl02 nova-api[6272]: 2017-09-28 12:41:58.818 6272 ERROR nova
Sep 28 12:41:58 ctl02 neutron-server[30536]: 2017-09-28 12:41:58.877 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:58 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:58 ctl02 neutron-server[30536]: 2017-09-28 12:41:58.878 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:58 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:58 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:58 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:58 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:58 ctl02 neutron-server[30536]: 2017-09-28 12:41:58.881 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:58 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:58 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:58 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:58 ctl02 neutron-server[30536]: 2017-09-28 12:41:58.882 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:58 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:58 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:58 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:58 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:58 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:58 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:41:58 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:41:58 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:41:59 ctl02 heat-api[13008]: 2017-09-28 12:41:59.041 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:41:59] "OPTIONS / HTTP/1.0" 200 134 0.000614
Sep 28 12:41:59 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:41:59 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:41:59 ctl02 neutron-server[30536]: 2017-09-28 12:41:59.131 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:59 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:59 ctl02 neutron-server[30536]: 2017-09-28 12:41:59.132 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:59 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:41:59 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:59 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:59 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:59 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:59 ctl02 neutron-server[30536]: 2017-09-28 12:41:59.135 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:59 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:59 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:59 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:59 ctl02 neutron-server[30536]: 2017-09-28 12:41:59.136 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:59 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:59 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:59 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:59 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:59 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:59 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:41:59 ctl02 neutron-server[30536]: 2017-09-28 12:41:59.322 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:41:59] "OPTIONS / HTTP/1.0" 200 262 0.000605
Sep 28 12:41:59 ctl02 neutron-server[30536]: 2017-09-28 12:41:59.385 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:59 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:59 ctl02 neutron-server[30536]: 2017-09-28 12:41:59.385 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:59 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:59 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:59 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:59 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:59 ctl02 neutron-server[30536]: 2017-09-28 12:41:59.389 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:59 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:59 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:59 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:59 ctl02 neutron-server[30536]: 2017-09-28 12:41:59.390 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:59 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:59 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:59 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:59 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:59 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:59 ctl02 neutron-server[30536]: 2017-09-28 12:41:59.638 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:59 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:59 ctl02 neutron-server[30536]: 2017-09-28 12:41:59.639 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:59 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:59 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:59 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:59 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:59 ctl02 neutron-server[30536]: 2017-09-28 12:41:59.644 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:59 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:59 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:59 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:59 ctl02 neutron-server[30536]: 2017-09-28 12:41:59.644 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:59 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:59 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:59 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:59 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:59 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:41:59 ctl02 heat-api-cfn[13300]: 2017-09-28 12:41:59.829 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:41:59] "OPTIONS / HTTP/1.0" 200 134 0.000493
Sep 28 12:41:59 ctl02 neutron-server[30536]: 2017-09-28 12:41:59.891 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:41:59 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:41:59 ctl02 neutron-server[30536]: 2017-09-28 12:41:59.892 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:41:59 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:41:59 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:41:59 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:41:59 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:41:59 ctl02 neutron-server[30536]: 2017-09-28 12:41:59.897 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:41:59 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:41:59 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:41:59 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:41:59 ctl02 neutron-server[30536]: 2017-09-28 12:41:59.898 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:41:59 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:41:59 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:41:59 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:41:59 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:41:59 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:00 ctl02 neutron-server[30536]: 2017-09-28 12:42:00.144 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:00 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:00 ctl02 neutron-server[30536]: 2017-09-28 12:42:00.145 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:00 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:00 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:00 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:00 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:00 ctl02 neutron-server[30536]: 2017-09-28 12:42:00.151 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:00 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:00 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:00 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:00 ctl02 neutron-server[30536]: 2017-09-28 12:42:00.151 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:00 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:00 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:00 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:00 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:00 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:00 ctl02 neutron-server[30536]: 2017-09-28 12:42:00.399 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:00 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:00 ctl02 neutron-server[30536]: 2017-09-28 12:42:00.399 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:00 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:00 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:00 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:00 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:00 ctl02 neutron-server[30536]: 2017-09-28 12:42:00.404 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:42:00] "OPTIONS / HTTP/1.0" 200 262 0.000497
Sep 28 12:42:00 ctl02 neutron-server[30536]: 2017-09-28 12:42:00.405 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:00 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:00 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:00 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:00 ctl02 neutron-server[30536]: 2017-09-28 12:42:00.405 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:00 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:00 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:00 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:00 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:00 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:00 ctl02 glance-api[29183]: 2017-09-28 12:42:00.651 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:42:00] "OPTIONS / HTTP/1.0" 200 134 0.000611
Sep 28 12:42:00 ctl02 neutron-server[30536]: 2017-09-28 12:42:00.652 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:00 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:00 ctl02 neutron-server[30536]: 2017-09-28 12:42:00.653 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:00 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:00 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:00 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:00 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:00 ctl02 neutron-server[30536]: 2017-09-28 12:42:00.659 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:00 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:00 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:00 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:00 ctl02 neutron-server[30536]: 2017-09-28 12:42:00.660 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:00 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:00 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:00 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:00 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:00 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:00 ctl02 nova-api[6290]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:42:00 ctl02 nova-api[6290]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:42:00 ctl02 neutron-server[30536]: 2017-09-28 12:42:00.906 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:00 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:00 ctl02 neutron-server[30536]: 2017-09-28 12:42:00.906 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:00 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:00 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:00 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:00 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:00 ctl02 neutron-server[30536]: 2017-09-28 12:42:00.913 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:00 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:00 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:00 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:00 ctl02 neutron-server[30536]: 2017-09-28 12:42:00.914 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:00 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:00 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:00 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:00 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:00 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:00 ctl02 neutron-server[30536]: 2017-09-28 12:42:00.934 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:42:00] "OPTIONS / HTTP/1.0" 200 262 0.000509
Sep 28 12:42:01 ctl02 nova-api[6290]: 2017-09-28 12:42:01.044 6290 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:42:01 ctl02 nova-api[6290]: 2017-09-28 12:42:01.046 6290 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:42:01 ctl02 nova-api[6290]: 2017-09-28 12:42:01.046 6290 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:42:01 ctl02 nova-api[6290]: 2017-09-28 12:42:01.046 6290 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:42:01 ctl02 nova-api[6290]: 2017-09-28 12:42:01.046 6290 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:42:01 ctl02 nova-api[6290]: 2017-09-28 12:42:01.046 6290 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:42:01 ctl02 nova-api[6290]: 2017-09-28 12:42:01.046 6290 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:42:01 ctl02 nova-api[6290]: 2017-09-28 12:42:01.046 6290 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:42:01 ctl02 nova-api[6290]: 2017-09-28 12:42:01.046 6290 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:42:01 ctl02 nova-api[6290]: 2017-09-28 12:42:01.046 6290 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:42:01 ctl02 nova-api[6290]: 2017-09-28 12:42:01.046 6290 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:42:01 ctl02 nova-api[6290]: 2017-09-28 12:42:01.046 6290 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:42:01 ctl02 nova-api[6290]: 2017-09-28 12:42:01.046 6290 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:42:01 ctl02 nova-api[6290]: 2017-09-28 12:42:01.046 6290 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:42:01 ctl02 nova-api[6290]: 2017-09-28 12:42:01.046 6290 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:42:01 ctl02 nova-api[6290]: 2017-09-28 12:42:01.046 6290 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:42:01 ctl02 nova-api[6290]: 2017-09-28 12:42:01.046 6290 ERROR nova.wsgi     self.filename))
Sep 28 12:42:01 ctl02 nova-api[6290]: 2017-09-28 12:42:01.046 6290 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:42:01 ctl02 nova-api[6290]: 2017-09-28 12:42:01.046 6290 ERROR nova.wsgi
Sep 28 12:42:01 ctl02 nova-api[6290]: 2017-09-28 12:42:01.047 6290 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:42:01 ctl02 neutron-server[30536]: 2017-09-28 12:42:01.160 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:01 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:01 ctl02 neutron-server[30536]: 2017-09-28 12:42:01.160 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:01 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:01 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:01 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:01 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:01 ctl02 neutron-server[30536]: 2017-09-28 12:42:01.167 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:01 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:01 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:01 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:01 ctl02 neutron-server[30536]: 2017-09-28 12:42:01.168 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:01 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:01 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:01 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:01 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:01 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:01 ctl02 nova-api[6290]: 2017-09-28 12:42:01.179 6290 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:42:01 ctl02 glance-api[29183]: 2017-09-28 12:42:01.372 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:42:01] "OPTIONS / HTTP/1.0" 200 134 0.000705
Sep 28 12:42:01 ctl02 neutron-server[30536]: 2017-09-28 12:42:01.414 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:01 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:01 ctl02 neutron-server[30536]: 2017-09-28 12:42:01.414 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:01 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:01 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:01 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:01 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:01 ctl02 nova-api[6290]: 2017-09-28 12:42:01.421 6290 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:42:01 ctl02 neutron-server[30536]: 2017-09-28 12:42:01.421 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:01 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:01 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:01 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:01 ctl02 neutron-server[30536]: 2017-09-28 12:42:01.423 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:01 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:01 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:01 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:01 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:01 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:01 ctl02 nova-api[6290]: 2017-09-28 12:42:01.423 6290 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:42:01 ctl02 nova-api[6290]: 2017-09-28 12:42:01.423 6290 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:42:01 ctl02 nova-api[6290]: 2017-09-28 12:42:01.424 6290 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:42:01 ctl02 nova-api[6290]: 2017-09-28 12:42:01.557 6290 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:42:01 ctl02 nova-api[6290]: 2017-09-28 12:42:01.559 6290 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:42:01 ctl02 nova-api[6290]: 2017-09-28 12:42:01.559 6290 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:42:01 ctl02 nova-api[6290]: 2017-09-28 12:42:01.559 6290 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:42:01 ctl02 nova-api[6290]: 2017-09-28 12:42:01.563 6290 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:42:01 ctl02 nova-api[6290]: 2017-09-28 12:42:01.563 6290 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:42:01 ctl02 nova-api[6290]: 2017-09-28 12:42:01.563 6290 ERROR nova Traceback (most recent call last):
Sep 28 12:42:01 ctl02 nova-api[6290]: 2017-09-28 12:42:01.563 6290 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:42:01 ctl02 nova-api[6290]: 2017-09-28 12:42:01.563 6290 ERROR nova     sys.exit(main())
Sep 28 12:42:01 ctl02 nova-api[6290]: 2017-09-28 12:42:01.563 6290 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:42:01 ctl02 nova-api[6290]: 2017-09-28 12:42:01.563 6290 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:42:01 ctl02 nova-api[6290]: 2017-09-28 12:42:01.563 6290 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:42:01 ctl02 nova-api[6290]: 2017-09-28 12:42:01.563 6290 ERROR nova     max_url_len=max_url_len)
Sep 28 12:42:01 ctl02 nova-api[6290]: 2017-09-28 12:42:01.563 6290 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:42:01 ctl02 nova-api[6290]: 2017-09-28 12:42:01.563 6290 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:42:01 ctl02 nova-api[6290]: 2017-09-28 12:42:01.563 6290 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:42:01 ctl02 nova-api[6290]: 2017-09-28 12:42:01.563 6290 ERROR nova     sock.listen(backlog)
Sep 28 12:42:01 ctl02 nova-api[6290]: 2017-09-28 12:42:01.563 6290 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:42:01 ctl02 nova-api[6290]: 2017-09-28 12:42:01.563 6290 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:42:01 ctl02 nova-api[6290]: 2017-09-28 12:42:01.563 6290 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:42:01 ctl02 nova-api[6290]: 2017-09-28 12:42:01.563 6290 ERROR nova
Sep 28 12:42:01 ctl02 neutron-server[30536]: 2017-09-28 12:42:01.668 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:01 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:01 ctl02 neutron-server[30536]: 2017-09-28 12:42:01.669 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:01 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:01 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:01 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:01 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:01 ctl02 neutron-server[30536]: 2017-09-28 12:42:01.677 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:01 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:01 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:01 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:01 ctl02 neutron-server[30536]: 2017-09-28 12:42:01.677 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:01 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:01 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:01 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:01 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:01 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:01 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:42:01 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:42:01 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:42:01 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:42:01 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:42:01 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:42:01 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:42:01 ctl02 neutron-server[30536]: 2017-09-28 12:42:01.922 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:01 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:01 ctl02 neutron-server[30536]: 2017-09-28 12:42:01.922 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:01 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:01 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:01 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:01 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:01 ctl02 neutron-server[30536]: 2017-09-28 12:42:01.931 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:01 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:01 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:01 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:01 ctl02 neutron-server[30536]: 2017-09-28 12:42:01.931 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:01 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:01 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:01 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:01 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:01 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:02 ctl02 neutron-server[30536]: 2017-09-28 12:42:02.176 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:02 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:02 ctl02 neutron-server[30536]: 2017-09-28 12:42:02.185 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:02 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:02 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:02 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:02 ctl02 neutron-server[30536]: 2017-09-28 12:42:02.204 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:02 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:02 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:02 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:02 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:02 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:02 ctl02 neutron-server[30536]: 2017-09-28 12:42:02.204 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:02 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:02 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:02 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:02 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:02 ctl02 neutron-server[30536]: 2017-09-28 12:42:02.458 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:02 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:02 ctl02 neutron-server[30536]: 2017-09-28 12:42:02.458 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:02 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:02 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:02 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:02 ctl02 neutron-server[30536]: 2017-09-28 12:42:02.458 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:02 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:02 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:02 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:02 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:02 ctl02 neutron-server[30536]: 2017-09-28 12:42:02.458 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:02 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:02 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:02 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:02 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:02 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:02 ctl02 heat-api-cfn[13300]: 2017-09-28 12:42:02.625 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:42:02] "OPTIONS / HTTP/1.0" 200 134 0.000703
Sep 28 12:42:02 ctl02 neutron-server[30536]: 2017-09-28 12:42:02.713 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:02 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:02 ctl02 neutron-server[30536]: 2017-09-28 12:42:02.713 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:02 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:02 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:02 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:02 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:02 ctl02 neutron-server[30536]: 2017-09-28 12:42:02.713 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:02 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:02 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:02 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:02 ctl02 neutron-server[30536]: 2017-09-28 12:42:02.714 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:02 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:02 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:02 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:02 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:02 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:02 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:42:02.758 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:42:02] "OPTIONS / HTTP/1.0" 200 134 0.000602
Sep 28 12:42:02 ctl02 glance-api[29183]: 2017-09-28 12:42:02.788 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:42:02] "OPTIONS / HTTP/1.0" 200 134 0.000622
Sep 28 12:42:02 ctl02 neutron-server[30536]: 2017-09-28 12:42:02.968 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:02 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:02 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:02 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:02 ctl02 neutron-server[30536]: 2017-09-28 12:42:02.968 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:02 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:02 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:02 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:02 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:02 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:02 ctl02 neutron-server[30536]: 2017-09-28 12:42:02.968 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:02 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:02 ctl02 neutron-server[30536]: 2017-09-28 12:42:02.969 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:02 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:02 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:02 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:02 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:03 ctl02 neutron-server[30536]: 2017-09-28 12:42:03.221 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:03 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:03 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:03 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:03 ctl02 neutron-server[30536]: 2017-09-28 12:42:03.222 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:03 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:03 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:03 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:03 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:03 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:03 ctl02 neutron-server[30536]: 2017-09-28 12:42:03.223 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:03 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:03 ctl02 neutron-server[30536]: 2017-09-28 12:42:03.224 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:03 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:03 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:03 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:03 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:03 ctl02 neutron-server[30536]: 2017-09-28 12:42:03.475 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:03 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:03 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:03 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:03 ctl02 neutron-server[30536]: 2017-09-28 12:42:03.476 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:03 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:03 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:03 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:03 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:03 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:03 ctl02 neutron-server[30536]: 2017-09-28 12:42:03.477 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:03 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:03 ctl02 neutron-server[30536]: 2017-09-28 12:42:03.478 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:03 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:03 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:03 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:03 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:03 ctl02 nova-api[6308]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:42:03 ctl02 nova-api[6308]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:42:03 ctl02 neutron-server[30536]: 2017-09-28 12:42:03.729 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:03 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:03 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:03 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:03 ctl02 neutron-server[30536]: 2017-09-28 12:42:03.729 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:03 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:03 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:03 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:03 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:03 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:03 ctl02 neutron-server[30536]: 2017-09-28 12:42:03.731 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:03 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:03 ctl02 neutron-server[30536]: 2017-09-28 12:42:03.732 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:03 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:03 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:03 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:03 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:03 ctl02 nova-api[6308]: 2017-09-28 12:42:03.856 6308 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:42:03 ctl02 nova-api[6308]: 2017-09-28 12:42:03.857 6308 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:42:03 ctl02 nova-api[6308]: 2017-09-28 12:42:03.857 6308 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:42:03 ctl02 nova-api[6308]: 2017-09-28 12:42:03.857 6308 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:42:03 ctl02 nova-api[6308]: 2017-09-28 12:42:03.857 6308 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:42:03 ctl02 nova-api[6308]: 2017-09-28 12:42:03.857 6308 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:42:03 ctl02 nova-api[6308]: 2017-09-28 12:42:03.857 6308 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:42:03 ctl02 nova-api[6308]: 2017-09-28 12:42:03.857 6308 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:42:03 ctl02 nova-api[6308]: 2017-09-28 12:42:03.857 6308 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:42:03 ctl02 nova-api[6308]: 2017-09-28 12:42:03.857 6308 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:42:03 ctl02 nova-api[6308]: 2017-09-28 12:42:03.857 6308 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:42:03 ctl02 nova-api[6308]: 2017-09-28 12:42:03.857 6308 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:42:03 ctl02 nova-api[6308]: 2017-09-28 12:42:03.857 6308 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:42:03 ctl02 nova-api[6308]: 2017-09-28 12:42:03.857 6308 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:42:03 ctl02 nova-api[6308]: 2017-09-28 12:42:03.857 6308 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:42:03 ctl02 nova-api[6308]: 2017-09-28 12:42:03.857 6308 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:42:03 ctl02 nova-api[6308]: 2017-09-28 12:42:03.857 6308 ERROR nova.wsgi     self.filename))
Sep 28 12:42:03 ctl02 nova-api[6308]: 2017-09-28 12:42:03.857 6308 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:42:03 ctl02 nova-api[6308]: 2017-09-28 12:42:03.857 6308 ERROR nova.wsgi
Sep 28 12:42:03 ctl02 nova-api[6308]: 2017-09-28 12:42:03.858 6308 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:42:03 ctl02 neutron-server[30536]: 2017-09-28 12:42:03.983 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:03 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:03 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:03 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:03 ctl02 neutron-server[30536]: 2017-09-28 12:42:03.983 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:03 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:03 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:03 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:03 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:03 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:03 ctl02 neutron-server[30536]: 2017-09-28 12:42:03.986 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:03 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:03 ctl02 neutron-server[30536]: 2017-09-28 12:42:03.987 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:03 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:03 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:03 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:03 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:03 ctl02 nova-api[6308]: 2017-09-28 12:42:03.993 6308 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:42:04 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x251f273d)
Sep 28 12:42:04 ctl02 neutron-server[30536]: 2017-09-28 12:42:04.237 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:04 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:04 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:04 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:04 ctl02 neutron-server[30536]: 2017-09-28 12:42:04.238 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:04 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:04 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:04 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:04 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:04 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:04 ctl02 nova-api[6308]: 2017-09-28 12:42:04.238 6308 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:42:04 ctl02 neutron-server[30536]: 2017-09-28 12:42:04.241 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:04 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:04 ctl02 nova-api[6308]: 2017-09-28 12:42:04.241 6308 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:42:04 ctl02 nova-api[6308]: 2017-09-28 12:42:04.241 6308 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:42:04 ctl02 nova-api[6308]: 2017-09-28 12:42:04.242 6308 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:42:04 ctl02 neutron-server[30536]: 2017-09-28 12:42:04.242 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:04 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:04 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:04 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:04 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:04 ctl02 nova-api[6308]: 2017-09-28 12:42:04.378 6308 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:42:04 ctl02 nova-api[6308]: 2017-09-28 12:42:04.380 6308 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:42:04 ctl02 nova-api[6308]: 2017-09-28 12:42:04.380 6308 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:42:04 ctl02 nova-api[6308]: 2017-09-28 12:42:04.381 6308 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:42:04 ctl02 nova-api[6308]: 2017-09-28 12:42:04.384 6308 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:42:04 ctl02 nova-api[6308]: 2017-09-28 12:42:04.385 6308 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:42:04 ctl02 nova-api[6308]: 2017-09-28 12:42:04.385 6308 ERROR nova Traceback (most recent call last):
Sep 28 12:42:04 ctl02 nova-api[6308]: 2017-09-28 12:42:04.385 6308 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:42:04 ctl02 nova-api[6308]: 2017-09-28 12:42:04.385 6308 ERROR nova     sys.exit(main())
Sep 28 12:42:04 ctl02 nova-api[6308]: 2017-09-28 12:42:04.385 6308 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:42:04 ctl02 nova-api[6308]: 2017-09-28 12:42:04.385 6308 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:42:04 ctl02 nova-api[6308]: 2017-09-28 12:42:04.385 6308 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:42:04 ctl02 nova-api[6308]: 2017-09-28 12:42:04.385 6308 ERROR nova     max_url_len=max_url_len)
Sep 28 12:42:04 ctl02 nova-api[6308]: 2017-09-28 12:42:04.385 6308 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:42:04 ctl02 nova-api[6308]: 2017-09-28 12:42:04.385 6308 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:42:04 ctl02 nova-api[6308]: 2017-09-28 12:42:04.385 6308 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:42:04 ctl02 nova-api[6308]: 2017-09-28 12:42:04.385 6308 ERROR nova     sock.listen(backlog)
Sep 28 12:42:04 ctl02 nova-api[6308]: 2017-09-28 12:42:04.385 6308 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:42:04 ctl02 nova-api[6308]: 2017-09-28 12:42:04.385 6308 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:42:04 ctl02 nova-api[6308]: 2017-09-28 12:42:04.385 6308 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:42:04 ctl02 nova-api[6308]: 2017-09-28 12:42:04.385 6308 ERROR nova
Sep 28 12:42:04 ctl02 neutron-server[30536]: 2017-09-28 12:42:04.491 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:04 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:04 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:04 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:04 ctl02 neutron-server[30536]: 2017-09-28 12:42:04.492 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:04 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:04 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:04 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:04 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:04 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:04 ctl02 neutron-server[30536]: 2017-09-28 12:42:04.496 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:04 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:04 ctl02 neutron-server[30536]: 2017-09-28 12:42:04.497 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:04 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:04 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:04 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:04 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:04 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:42:04 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:42:04 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:42:04 ctl02 neutron-server[30536]: 2017-09-28 12:42:04.745 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:04 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:04 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:04 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:04 ctl02 neutron-server[30536]: 2017-09-28 12:42:04.746 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:04 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:04 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:04 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:04 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:04 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:04 ctl02 neutron-server[30536]: 2017-09-28 12:42:04.751 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:04 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:04 ctl02 neutron-server[30536]: 2017-09-28 12:42:04.751 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:04 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:04 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:04 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:04 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:04 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:42:04 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:42:04 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:42:04 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:42:05 ctl02 neutron-server[30536]: 2017-09-28 12:42:04.999 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:05 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:05 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:05 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:05 ctl02 neutron-server[30536]: 2017-09-28 12:42:05.000 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:05 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:05 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:05 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:05 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:05 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:05 ctl02 neutron-server[30536]: 2017-09-28 12:42:05.004 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:05 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:05 ctl02 neutron-server[30536]: 2017-09-28 12:42:05.005 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:05 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:05 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:05 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:05 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:05 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x251f273d)
Sep 28 12:42:05 ctl02 neutron-server[30536]: 2017-09-28 12:42:05.253 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:05 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:05 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:05 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:05 ctl02 neutron-server[30536]: 2017-09-28 12:42:05.254 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:05 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:05 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:05 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:05 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:05 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:05 ctl02 neutron-server[30536]: 2017-09-28 12:42:05.259 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:05 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:05 ctl02 neutron-server[30536]: 2017-09-28 12:42:05.260 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:05 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:05 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:05 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:05 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:05 ctl02 neutron-server[30536]: 2017-09-28 12:42:05.507 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:05 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:05 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:05 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:05 ctl02 neutron-server[30536]: 2017-09-28 12:42:05.508 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:05 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:05 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:05 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:05 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:05 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:05 ctl02 neutron-server[30536]: 2017-09-28 12:42:05.513 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:05 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:05 ctl02 neutron-server[30536]: 2017-09-28 12:42:05.514 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:05 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:05 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:05 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:05 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:05 ctl02 neutron-server[30536]: 2017-09-28 12:42:05.761 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:05 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:05 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:05 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:05 ctl02 neutron-server[30536]: 2017-09-28 12:42:05.762 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:05 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:05 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:05 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:05 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:05 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:05 ctl02 neutron-server[30536]: 2017-09-28 12:42:05.767 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:05 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:05 ctl02 neutron-server[30536]: 2017-09-28 12:42:05.767 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:05 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:05 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:05 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:05 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:05 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:42:05.876 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:42:05] "OPTIONS / HTTP/1.0" 200 134 0.000454
Sep 28 12:42:05 ctl02 heat-api[13008]: 2017-09-28 12:42:05.944 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:42:05] "OPTIONS / HTTP/1.0" 200 134 0.000593
Sep 28 12:42:06 ctl02 neutron-server[30536]: 2017-09-28 12:42:06.015 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:06 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:06 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:06 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:06 ctl02 neutron-server[30536]: 2017-09-28 12:42:06.016 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:06 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:06 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:06 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:06 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:06 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:06 ctl02 neutron-server[30536]: 2017-09-28 12:42:06.020 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:06 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:06 ctl02 neutron-server[30536]: 2017-09-28 12:42:06.021 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:06 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:06 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:06 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:06 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:06 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x251f273d)
Sep 28 12:42:06 ctl02 neutron-server[30536]: 2017-09-28 12:42:06.270 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:06 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:06 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:06 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:06 ctl02 neutron-server[30536]: 2017-09-28 12:42:06.271 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:06 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:06 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:06 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:06 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:06 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:06 ctl02 neutron-server[30536]: 2017-09-28 12:42:06.274 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:06 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:06 ctl02 neutron-server[30536]: 2017-09-28 12:42:06.274 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:06 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:06 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:06 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:06 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:06 ctl02 neutron-server[30536]: 2017-09-28 12:42:06.293 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 4 dead agents out of 6:
Sep 28 12:42:06 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:42:06 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:40:56 cmp002
Sep 28 12:42:06 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:41:28 cmp001
Sep 28 12:42:06 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:41:20 cmp002
Sep 28 12:42:06 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:41:16 cmp002
Sep 28 12:42:06 ctl02 neutron-server[30536]: 2017-09-28 12:42:06.524 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:06 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:06 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:06 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:06 ctl02 neutron-server[30536]: 2017-09-28 12:42:06.524 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:06 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:06 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:06 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:06 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:06 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:06 ctl02 neutron-server[30536]: 2017-09-28 12:42:06.527 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:06 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:06 ctl02 neutron-server[30536]: 2017-09-28 12:42:06.528 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:06 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:06 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:06 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:06 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:06 ctl02 nova-api[6326]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:42:06 ctl02 nova-api[6326]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:42:06 ctl02 nova-api[6326]: 2017-09-28 12:42:06.761 6326 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:42:06 ctl02 nova-api[6326]: 2017-09-28 12:42:06.763 6326 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:42:06 ctl02 nova-api[6326]: 2017-09-28 12:42:06.763 6326 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:42:06 ctl02 nova-api[6326]: 2017-09-28 12:42:06.763 6326 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:42:06 ctl02 nova-api[6326]: 2017-09-28 12:42:06.763 6326 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:42:06 ctl02 nova-api[6326]: 2017-09-28 12:42:06.763 6326 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:42:06 ctl02 nova-api[6326]: 2017-09-28 12:42:06.763 6326 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:42:06 ctl02 nova-api[6326]: 2017-09-28 12:42:06.763 6326 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:42:06 ctl02 nova-api[6326]: 2017-09-28 12:42:06.763 6326 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:42:06 ctl02 nova-api[6326]: 2017-09-28 12:42:06.763 6326 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:42:06 ctl02 nova-api[6326]: 2017-09-28 12:42:06.763 6326 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:42:06 ctl02 nova-api[6326]: 2017-09-28 12:42:06.763 6326 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:42:06 ctl02 nova-api[6326]: 2017-09-28 12:42:06.763 6326 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:42:06 ctl02 nova-api[6326]: 2017-09-28 12:42:06.763 6326 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:42:06 ctl02 nova-api[6326]: 2017-09-28 12:42:06.763 6326 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:42:06 ctl02 nova-api[6326]: 2017-09-28 12:42:06.763 6326 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:42:06 ctl02 nova-api[6326]: 2017-09-28 12:42:06.763 6326 ERROR nova.wsgi     self.filename))
Sep 28 12:42:06 ctl02 nova-api[6326]: 2017-09-28 12:42:06.763 6326 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:42:06 ctl02 nova-api[6326]: 2017-09-28 12:42:06.763 6326 ERROR nova.wsgi
Sep 28 12:42:06 ctl02 nova-api[6326]: 2017-09-28 12:42:06.764 6326 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:42:06 ctl02 neutron-server[30536]: 2017-09-28 12:42:06.777 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:06 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:06 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:06 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:06 ctl02 neutron-server[30536]: 2017-09-28 12:42:06.778 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:06 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:06 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:06 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:06 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:06 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:06 ctl02 neutron-server[30536]: 2017-09-28 12:42:06.781 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:06 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:06 ctl02 neutron-server[30536]: 2017-09-28 12:42:06.781 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:06 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:06 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:06 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:06 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:06 ctl02 nova-api[6326]: 2017-09-28 12:42:06.894 6326 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:42:06 ctl02 heat-api[13008]: 2017-09-28 12:42:06.923 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:42:06] "OPTIONS / HTTP/1.0" 200 134 0.000588
Sep 28 12:42:07 ctl02 neutron-server[30536]: 2017-09-28 12:42:07.031 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:07 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:07 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:07 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:07 ctl02 neutron-server[30536]: 2017-09-28 12:42:07.031 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:07 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:07 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:07 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:07 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:07 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:07 ctl02 neutron-server[30536]: 2017-09-28 12:42:07.034 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:07 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:07 ctl02 neutron-server[30536]: 2017-09-28 12:42:07.035 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:07 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:07 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:07 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:07 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:07 ctl02 nova-api[6326]: 2017-09-28 12:42:07.127 6326 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:42:07 ctl02 nova-api[6326]: 2017-09-28 12:42:07.129 6326 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:42:07 ctl02 nova-api[6326]: 2017-09-28 12:42:07.130 6326 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:42:07 ctl02 nova-api[6326]: 2017-09-28 12:42:07.130 6326 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:42:07 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x251f273d)
Sep 28 12:42:07 ctl02 nova-api[6326]: 2017-09-28 12:42:07.260 6326 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:42:07 ctl02 nova-api[6326]: 2017-09-28 12:42:07.262 6326 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:42:07 ctl02 nova-api[6326]: 2017-09-28 12:42:07.262 6326 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:42:07 ctl02 nova-api[6326]: 2017-09-28 12:42:07.262 6326 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:42:07 ctl02 nova-api[6326]: 2017-09-28 12:42:07.266 6326 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:42:07 ctl02 nova-api[6326]: 2017-09-28 12:42:07.266 6326 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:42:07 ctl02 nova-api[6326]: 2017-09-28 12:42:07.266 6326 ERROR nova Traceback (most recent call last):
Sep 28 12:42:07 ctl02 nova-api[6326]: 2017-09-28 12:42:07.266 6326 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:42:07 ctl02 nova-api[6326]: 2017-09-28 12:42:07.266 6326 ERROR nova     sys.exit(main())
Sep 28 12:42:07 ctl02 nova-api[6326]: 2017-09-28 12:42:07.266 6326 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:42:07 ctl02 nova-api[6326]: 2017-09-28 12:42:07.266 6326 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:42:07 ctl02 nova-api[6326]: 2017-09-28 12:42:07.266 6326 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:42:07 ctl02 nova-api[6326]: 2017-09-28 12:42:07.266 6326 ERROR nova     max_url_len=max_url_len)
Sep 28 12:42:07 ctl02 nova-api[6326]: 2017-09-28 12:42:07.266 6326 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:42:07 ctl02 nova-api[6326]: 2017-09-28 12:42:07.266 6326 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:42:07 ctl02 nova-api[6326]: 2017-09-28 12:42:07.266 6326 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:42:07 ctl02 nova-api[6326]: 2017-09-28 12:42:07.266 6326 ERROR nova     sock.listen(backlog)
Sep 28 12:42:07 ctl02 nova-api[6326]: 2017-09-28 12:42:07.266 6326 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:42:07 ctl02 nova-api[6326]: 2017-09-28 12:42:07.266 6326 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:42:07 ctl02 nova-api[6326]: 2017-09-28 12:42:07.266 6326 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:42:07 ctl02 nova-api[6326]: 2017-09-28 12:42:07.266 6326 ERROR nova
Sep 28 12:42:07 ctl02 neutron-server[30536]: 2017-09-28 12:42:07.285 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:07 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:07 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:07 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:07 ctl02 neutron-server[30536]: 2017-09-28 12:42:07.286 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:07 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:07 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:07 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:07 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:07 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:07 ctl02 neutron-server[30536]: 2017-09-28 12:42:07.287 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:07 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:07 ctl02 neutron-server[30536]: 2017-09-28 12:42:07.288 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:07 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:07 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:07 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:07 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:07 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:42:07 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:42:07 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:42:07 ctl02 neutron-server[30536]: 2017-09-28 12:42:07.539 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:07 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:07 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:07 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:07 ctl02 neutron-server[30536]: 2017-09-28 12:42:07.539 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:07 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:07 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:07 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:07 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:07 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:07 ctl02 neutron-server[30536]: 2017-09-28 12:42:07.541 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:07 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:07 ctl02 neutron-server[30536]: 2017-09-28 12:42:07.541 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:07 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:07 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:07 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:07 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:07 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:42:07 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:42:07 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:42:07 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:42:07 ctl02 neutron-server[30536]: 2017-09-28 12:42:07.792 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:07 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:07 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:07 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:07 ctl02 neutron-server[30536]: 2017-09-28 12:42:07.793 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:07 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:07 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:07 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:07 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:07 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:07 ctl02 neutron-server[30536]: 2017-09-28 12:42:07.794 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:07 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:07 ctl02 neutron-server[30536]: 2017-09-28 12:42:07.795 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:07 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:07 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:07 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:07 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:08 ctl02 neutron-server[30536]: 2017-09-28 12:42:08.046 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:08 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:08 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:08 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:08 ctl02 neutron-server[30536]: 2017-09-28 12:42:08.047 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:08 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:08 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:08 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:08 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:08 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:08 ctl02 neutron-server[30536]: 2017-09-28 12:42:08.048 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:08 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:08 ctl02 neutron-server[30536]: 2017-09-28 12:42:08.049 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:08 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:08 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:08 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:08 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:08 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x251f273d)
Sep 28 12:42:08 ctl02 neutron-server[30536]: 2017-09-28 12:42:08.301 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:08 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:08 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:08 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:08 ctl02 neutron-server[30536]: 2017-09-28 12:42:08.301 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:08 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:08 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:08 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:08 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:08 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:08 ctl02 neutron-server[30536]: 2017-09-28 12:42:08.302 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:08 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:08 ctl02 neutron-server[30536]: 2017-09-28 12:42:08.303 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:08 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:08 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:08 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:08 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:08 ctl02 heat-api-cfn[13300]: 2017-09-28 12:42:08.450 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:42:08] "OPTIONS / HTTP/1.0" 200 134 0.000451
Sep 28 12:42:08 ctl02 neutron-server[30536]: 2017-09-28 12:42:08.555 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:08 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:08 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:08 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:08 ctl02 neutron-server[30536]: 2017-09-28 12:42:08.555 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:08 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:08 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:08 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:08 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:08 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:08 ctl02 neutron-server[30536]: 2017-09-28 12:42:08.556 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:08 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:08 ctl02 neutron-server[30536]: 2017-09-28 12:42:08.556 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:08 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:08 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:08 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:08 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:08 ctl02 neutron-server[30536]: 2017-09-28 12:42:08.808 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:08 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:08 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:08 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:08 ctl02 neutron-server[30536]: 2017-09-28 12:42:08.809 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:08 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:08 ctl02 neutron-server[30536]: 2017-09-28 12:42:08.809 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:08 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:08 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:08 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:08 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:08 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:08 ctl02 neutron-server[30536]: 2017-09-28 12:42:08.809 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:08 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:08 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:08 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:08 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:08 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:42:08.835 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:42:08] "OPTIONS / HTTP/1.0" 200 134 0.000456
Sep 28 12:42:08 ctl02 heat-api[13008]: 2017-09-28 12:42:08.966 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:42:08] "OPTIONS / HTTP/1.0" 200 134 0.000595
Sep 28 12:42:09 ctl02 neutron-server[30536]: 2017-09-28 12:42:09.062 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:09 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:09 ctl02 neutron-server[30536]: 2017-09-28 12:42:09.062 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:09 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:09 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:09 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:09 ctl02 neutron-server[30536]: 2017-09-28 12:42:09.062 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:09 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:09 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:09 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:09 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:09 ctl02 neutron-server[30536]: 2017-09-28 12:42:09.063 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:09 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:09 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:09 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:09 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:09 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:09 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x251f273d)
Sep 28 12:42:09 ctl02 nova-api[6343]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:42:09 ctl02 nova-api[6343]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:42:09 ctl02 neutron-server[30536]: 2017-09-28 12:42:09.315 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:09 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:09 ctl02 neutron-server[30536]: 2017-09-28 12:42:09.316 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:09 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:09 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:09 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:09 ctl02 neutron-server[30536]: 2017-09-28 12:42:09.316 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:09 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:09 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:09 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:09 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:09 ctl02 neutron-server[30536]: 2017-09-28 12:42:09.316 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:09 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:09 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:09 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:09 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:09 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:09 ctl02 neutron-server[30536]: 2017-09-28 12:42:09.349 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:42:09] "OPTIONS / HTTP/1.0" 200 262 0.000525
Sep 28 12:42:09 ctl02 nova-api[6343]: 2017-09-28 12:42:09.504 6343 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:42:09 ctl02 nova-api[6343]: 2017-09-28 12:42:09.505 6343 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:42:09 ctl02 nova-api[6343]: 2017-09-28 12:42:09.505 6343 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:42:09 ctl02 nova-api[6343]: 2017-09-28 12:42:09.505 6343 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:42:09 ctl02 nova-api[6343]: 2017-09-28 12:42:09.505 6343 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:42:09 ctl02 nova-api[6343]: 2017-09-28 12:42:09.505 6343 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:42:09 ctl02 nova-api[6343]: 2017-09-28 12:42:09.505 6343 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:42:09 ctl02 nova-api[6343]: 2017-09-28 12:42:09.505 6343 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:42:09 ctl02 nova-api[6343]: 2017-09-28 12:42:09.505 6343 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:42:09 ctl02 nova-api[6343]: 2017-09-28 12:42:09.505 6343 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:42:09 ctl02 nova-api[6343]: 2017-09-28 12:42:09.505 6343 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:42:09 ctl02 nova-api[6343]: 2017-09-28 12:42:09.505 6343 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:42:09 ctl02 nova-api[6343]: 2017-09-28 12:42:09.505 6343 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:42:09 ctl02 nova-api[6343]: 2017-09-28 12:42:09.505 6343 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:42:09 ctl02 nova-api[6343]: 2017-09-28 12:42:09.505 6343 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:42:09 ctl02 nova-api[6343]: 2017-09-28 12:42:09.505 6343 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:42:09 ctl02 nova-api[6343]: 2017-09-28 12:42:09.505 6343 ERROR nova.wsgi     self.filename))
Sep 28 12:42:09 ctl02 nova-api[6343]: 2017-09-28 12:42:09.505 6343 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:42:09 ctl02 nova-api[6343]: 2017-09-28 12:42:09.505 6343 ERROR nova.wsgi
Sep 28 12:42:09 ctl02 nova-api[6343]: 2017-09-28 12:42:09.506 6343 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:42:09 ctl02 neutron-server[30536]: 2017-09-28 12:42:09.569 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:09 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:09 ctl02 neutron-server[30536]: 2017-09-28 12:42:09.570 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:09 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:09 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:09 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:09 ctl02 neutron-server[30536]: 2017-09-28 12:42:09.570 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:09 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:09 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:09 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:09 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:09 ctl02 neutron-server[30536]: 2017-09-28 12:42:09.570 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:09 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:09 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:09 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:09 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:09 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:09 ctl02 nova-api[6343]: 2017-09-28 12:42:09.637 6343 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:42:09 ctl02 neutron-server[30536]: 2017-09-28 12:42:09.823 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:09 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:09 ctl02 neutron-server[30536]: 2017-09-28 12:42:09.823 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:09 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:09 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:09 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:09 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:09 ctl02 neutron-server[30536]: 2017-09-28 12:42:09.824 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:09 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:09 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:09 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:09 ctl02 neutron-server[30536]: 2017-09-28 12:42:09.824 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:09 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:09 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:09 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:09 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:09 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:09 ctl02 nova-api[6343]: 2017-09-28 12:42:09.883 6343 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:42:09 ctl02 nova-api[6343]: 2017-09-28 12:42:09.885 6343 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:42:09 ctl02 nova-api[6343]: 2017-09-28 12:42:09.885 6343 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:42:09 ctl02 nova-api[6343]: 2017-09-28 12:42:09.886 6343 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:42:09 ctl02 heat-api-cfn[13300]: 2017-09-28 12:42:09.985 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:42:09] "OPTIONS / HTTP/1.0" 200 134 0.000557
Sep 28 12:42:10 ctl02 nova-api[6343]: 2017-09-28 12:42:10.028 6343 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:42:10 ctl02 nova-api[6343]: 2017-09-28 12:42:10.030 6343 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:42:10 ctl02 nova-api[6343]: 2017-09-28 12:42:10.030 6343 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:42:10 ctl02 nova-api[6343]: 2017-09-28 12:42:10.031 6343 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:42:10 ctl02 nova-api[6343]: 2017-09-28 12:42:10.034 6343 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:42:10 ctl02 nova-api[6343]: 2017-09-28 12:42:10.035 6343 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:42:10 ctl02 nova-api[6343]: 2017-09-28 12:42:10.035 6343 ERROR nova Traceback (most recent call last):
Sep 28 12:42:10 ctl02 nova-api[6343]: 2017-09-28 12:42:10.035 6343 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:42:10 ctl02 nova-api[6343]: 2017-09-28 12:42:10.035 6343 ERROR nova     sys.exit(main())
Sep 28 12:42:10 ctl02 nova-api[6343]: 2017-09-28 12:42:10.035 6343 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:42:10 ctl02 nova-api[6343]: 2017-09-28 12:42:10.035 6343 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:42:10 ctl02 nova-api[6343]: 2017-09-28 12:42:10.035 6343 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:42:10 ctl02 nova-api[6343]: 2017-09-28 12:42:10.035 6343 ERROR nova     max_url_len=max_url_len)
Sep 28 12:42:10 ctl02 nova-api[6343]: 2017-09-28 12:42:10.035 6343 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:42:10 ctl02 nova-api[6343]: 2017-09-28 12:42:10.035 6343 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:42:10 ctl02 nova-api[6343]: 2017-09-28 12:42:10.035 6343 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:42:10 ctl02 nova-api[6343]: 2017-09-28 12:42:10.035 6343 ERROR nova     sock.listen(backlog)
Sep 28 12:42:10 ctl02 nova-api[6343]: 2017-09-28 12:42:10.035 6343 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:42:10 ctl02 nova-api[6343]: 2017-09-28 12:42:10.035 6343 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:42:10 ctl02 nova-api[6343]: 2017-09-28 12:42:10.035 6343 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:42:10 ctl02 nova-api[6343]: 2017-09-28 12:42:10.035 6343 ERROR nova
Sep 28 12:42:10 ctl02 neutron-server[30536]: 2017-09-28 12:42:10.076 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:10 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:10 ctl02 neutron-server[30536]: 2017-09-28 12:42:10.077 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:10 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:10 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:10 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:10 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:10 ctl02 neutron-server[30536]: 2017-09-28 12:42:10.078 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:10 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:10 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:10 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:10 ctl02 neutron-server[30536]: 2017-09-28 12:42:10.078 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:10 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:10 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:10 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:10 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:10 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:10 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x251f273d)
Sep 28 12:42:10 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:42:10 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:42:10 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:42:10 ctl02 glance-api[29183]: 2017-09-28 12:42:10.282 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:42:10] "OPTIONS / HTTP/1.0" 200 134 0.000567
Sep 28 12:42:10 ctl02 neutron-server[30536]: 2017-09-28 12:42:10.330 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:10 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:10 ctl02 neutron-server[30536]: 2017-09-28 12:42:10.330 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:10 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:10 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:10 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:10 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:10 ctl02 neutron-server[30536]: 2017-09-28 12:42:10.332 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:10 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:10 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:10 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:10 ctl02 neutron-server[30536]: 2017-09-28 12:42:10.332 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:10 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:10 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:10 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:10 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:10 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:10 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:42:10 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:42:10 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:42:10 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:42:10 ctl02 neutron-server[30536]: 2017-09-28 12:42:10.583 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:10 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:10 ctl02 neutron-server[30536]: 2017-09-28 12:42:10.583 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:10 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:10 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:10 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:10 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:10 ctl02 neutron-server[30536]: 2017-09-28 12:42:10.585 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:10 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:10 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:10 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:10 ctl02 neutron-server[30536]: 2017-09-28 12:42:10.586 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:10 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:10 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:10 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:10 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:10 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:10 ctl02 neutron-server[30536]: 2017-09-28 12:42:10.696 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:42:10] "OPTIONS / HTTP/1.0" 200 262 0.000532
Sep 28 12:42:10 ctl02 neutron-server[30536]: 2017-09-28 12:42:10.734 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:42:10] "OPTIONS / HTTP/1.0" 200 262 0.000286
Sep 28 12:42:10 ctl02 neutron-server[30536]: 2017-09-28 12:42:10.835 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:10 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:10 ctl02 neutron-server[30536]: 2017-09-28 12:42:10.836 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:10 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:10 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:10 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:10 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:10 ctl02 neutron-server[30536]: 2017-09-28 12:42:10.840 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:10 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:10 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:10 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:10 ctl02 neutron-server[30536]: 2017-09-28 12:42:10.840 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:10 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:10 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:10 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:10 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:10 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:11 ctl02 neutron-server[30536]: 2017-09-28 12:42:11.089 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:11 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:11 ctl02 neutron-server[30536]: 2017-09-28 12:42:11.089 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:11 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:11 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:11 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:11 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:11 ctl02 neutron-server[30536]: 2017-09-28 12:42:11.094 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:11 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:11 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:11 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:11 ctl02 neutron-server[30536]: 2017-09-28 12:42:11.094 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:11 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:11 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:11 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:11 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:11 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:11 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x251f273d)
Sep 28 12:42:11 ctl02 neutron-server[30536]: 2017-09-28 12:42:11.342 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:11 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:11 ctl02 neutron-server[30536]: 2017-09-28 12:42:11.342 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:11 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:11 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:11 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:11 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:11 ctl02 neutron-server[30536]: 2017-09-28 12:42:11.347 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:11 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:11 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:11 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:11 ctl02 neutron-server[30536]: 2017-09-28 12:42:11.347 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:11 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:11 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:11 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:11 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:11 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:11 ctl02 glance-api[29183]: 2017-09-28 12:42:11.449 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:42:11] "OPTIONS / HTTP/1.0" 200 134 0.000553
Sep 28 12:42:11 ctl02 neutron-server[30536]: 2017-09-28 12:42:11.595 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:11 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:11 ctl02 neutron-server[30536]: 2017-09-28 12:42:11.596 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:11 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:11 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:11 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:11 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:11 ctl02 neutron-server[30536]: 2017-09-28 12:42:11.600 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:11 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:11 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:11 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:11 ctl02 neutron-server[30536]: 2017-09-28 12:42:11.601 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:11 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:11 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:11 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:11 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:11 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:11 ctl02 neutron-server[30536]: 2017-09-28 12:42:11.849 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:11 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:11 ctl02 neutron-server[30536]: 2017-09-28 12:42:11.849 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:11 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:11 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:11 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:11 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:11 ctl02 neutron-server[30536]: 2017-09-28 12:42:11.853 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:11 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:11 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:11 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:11 ctl02 neutron-server[30536]: 2017-09-28 12:42:11.854 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:11 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:11 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:11 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:11 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:11 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:12 ctl02 nova-api[6362]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:42:12 ctl02 nova-api[6362]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:42:12 ctl02 neutron-server[30536]: 2017-09-28 12:42:12.102 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:12 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:12 ctl02 neutron-server[30536]: 2017-09-28 12:42:12.102 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:12 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:12 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:12 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:12 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:12 ctl02 neutron-server[30536]: 2017-09-28 12:42:12.106 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:12 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:12 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:12 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:12 ctl02 neutron-server[30536]: 2017-09-28 12:42:12.107 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:12 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:12 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:12 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:12 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:12 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:12 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x251f273d)
Sep 28 12:42:12 ctl02 nova-api[6362]: 2017-09-28 12:42:12.226 6362 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:42:12 ctl02 nova-api[6362]: 2017-09-28 12:42:12.227 6362 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:42:12 ctl02 nova-api[6362]: 2017-09-28 12:42:12.227 6362 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:42:12 ctl02 nova-api[6362]: 2017-09-28 12:42:12.227 6362 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:42:12 ctl02 nova-api[6362]: 2017-09-28 12:42:12.227 6362 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:42:12 ctl02 nova-api[6362]: 2017-09-28 12:42:12.227 6362 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:42:12 ctl02 nova-api[6362]: 2017-09-28 12:42:12.227 6362 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:42:12 ctl02 nova-api[6362]: 2017-09-28 12:42:12.227 6362 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:42:12 ctl02 nova-api[6362]: 2017-09-28 12:42:12.227 6362 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:42:12 ctl02 nova-api[6362]: 2017-09-28 12:42:12.227 6362 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:42:12 ctl02 nova-api[6362]: 2017-09-28 12:42:12.227 6362 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:42:12 ctl02 nova-api[6362]: 2017-09-28 12:42:12.227 6362 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:42:12 ctl02 nova-api[6362]: 2017-09-28 12:42:12.227 6362 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:42:12 ctl02 nova-api[6362]: 2017-09-28 12:42:12.227 6362 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:42:12 ctl02 nova-api[6362]: 2017-09-28 12:42:12.227 6362 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:42:12 ctl02 nova-api[6362]: 2017-09-28 12:42:12.227 6362 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:42:12 ctl02 nova-api[6362]: 2017-09-28 12:42:12.227 6362 ERROR nova.wsgi     self.filename))
Sep 28 12:42:12 ctl02 nova-api[6362]: 2017-09-28 12:42:12.227 6362 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:42:12 ctl02 nova-api[6362]: 2017-09-28 12:42:12.227 6362 ERROR nova.wsgi
Sep 28 12:42:12 ctl02 nova-api[6362]: 2017-09-28 12:42:12.228 6362 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:42:12 ctl02 nova-api[6362]: 2017-09-28 12:42:12.356 6362 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:42:12 ctl02 neutron-server[30536]: 2017-09-28 12:42:12.358 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:12 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:12 ctl02 neutron-server[30536]: 2017-09-28 12:42:12.365 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:12 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:12 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:12 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:12 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:12 ctl02 neutron-server[30536]: 2017-09-28 12:42:12.360 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:12 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:12 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:12 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:12 ctl02 neutron-server[30536]: 2017-09-28 12:42:12.366 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:12 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:12 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:12 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:12 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:12 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:12 ctl02 glance-api[29183]: 2017-09-28 12:42:12.535 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:42:12] "OPTIONS / HTTP/1.0" 200 134 0.000565
Sep 28 12:42:12 ctl02 nova-api[6362]: 2017-09-28 12:42:12.582 6362 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:42:12 ctl02 nova-api[6362]: 2017-09-28 12:42:12.584 6362 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:42:12 ctl02 nova-api[6362]: 2017-09-28 12:42:12.584 6362 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:42:12 ctl02 nova-api[6362]: 2017-09-28 12:42:12.584 6362 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:42:12 ctl02 neutron-server[30536]: 2017-09-28 12:42:12.619 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:12 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:12 ctl02 neutron-server[30536]: 2017-09-28 12:42:12.620 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:12 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:12 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:12 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:12 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:12 ctl02 neutron-server[30536]: 2017-09-28 12:42:12.620 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:12 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:12 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:12 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:12 ctl02 neutron-server[30536]: 2017-09-28 12:42:12.621 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:12 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:12 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:12 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:12 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:12 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:12 ctl02 heat-api-cfn[13300]: 2017-09-28 12:42:12.668 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:42:12] "OPTIONS / HTTP/1.0" 200 134 0.000466
Sep 28 12:42:12 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:42:12.681 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:42:12] "OPTIONS / HTTP/1.0" 200 134 0.000371
Sep 28 12:42:12 ctl02 nova-api[6362]: 2017-09-28 12:42:12.722 6362 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:42:12 ctl02 nova-api[6362]: 2017-09-28 12:42:12.724 6362 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:42:12 ctl02 nova-api[6362]: 2017-09-28 12:42:12.724 6362 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:42:12 ctl02 nova-api[6362]: 2017-09-28 12:42:12.724 6362 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:42:12 ctl02 nova-api[6362]: 2017-09-28 12:42:12.727 6362 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:42:12 ctl02 nova-api[6362]: 2017-09-28 12:42:12.728 6362 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:42:12 ctl02 nova-api[6362]: 2017-09-28 12:42:12.728 6362 ERROR nova Traceback (most recent call last):
Sep 28 12:42:12 ctl02 nova-api[6362]: 2017-09-28 12:42:12.728 6362 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:42:12 ctl02 nova-api[6362]: 2017-09-28 12:42:12.728 6362 ERROR nova     sys.exit(main())
Sep 28 12:42:12 ctl02 nova-api[6362]: 2017-09-28 12:42:12.728 6362 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:42:12 ctl02 nova-api[6362]: 2017-09-28 12:42:12.728 6362 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:42:12 ctl02 nova-api[6362]: 2017-09-28 12:42:12.728 6362 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:42:12 ctl02 nova-api[6362]: 2017-09-28 12:42:12.728 6362 ERROR nova     max_url_len=max_url_len)
Sep 28 12:42:12 ctl02 nova-api[6362]: 2017-09-28 12:42:12.728 6362 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:42:12 ctl02 nova-api[6362]: 2017-09-28 12:42:12.728 6362 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:42:12 ctl02 nova-api[6362]: 2017-09-28 12:42:12.728 6362 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:42:12 ctl02 nova-api[6362]: 2017-09-28 12:42:12.728 6362 ERROR nova     sock.listen(backlog)
Sep 28 12:42:12 ctl02 nova-api[6362]: 2017-09-28 12:42:12.728 6362 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:42:12 ctl02 nova-api[6362]: 2017-09-28 12:42:12.728 6362 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:42:12 ctl02 nova-api[6362]: 2017-09-28 12:42:12.728 6362 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:42:12 ctl02 nova-api[6362]: 2017-09-28 12:42:12.728 6362 ERROR nova
Sep 28 12:42:12 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:42:12 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:42:12 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:42:12 ctl02 neutron-server[30536]: 2017-09-28 12:42:12.872 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:12 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:12 ctl02 neutron-server[30536]: 2017-09-28 12:42:12.873 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:12 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:12 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:12 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:12 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:12 ctl02 neutron-server[30536]: 2017-09-28 12:42:12.873 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:12 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:12 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:12 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:12 ctl02 neutron-server[30536]: 2017-09-28 12:42:12.874 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:12 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:12 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:12 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:12 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:12 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:13 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:42:13 ctl02 neutron-server[30536]: 2017-09-28 12:42:13.126 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:13 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:42:13 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:13 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:42:13 ctl02 neutron-server[30536]: 2017-09-28 12:42:13.126 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:13 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:13 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:13 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:13 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:13 ctl02 neutron-server[30536]: 2017-09-28 12:42:13.128 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:13 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:13 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:13 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:13 ctl02 neutron-server[30536]: 2017-09-28 12:42:13.128 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:13 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:13 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:13 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:13 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:13 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:42:13 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:13 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x251f273d)
Sep 28 12:42:13 ctl02 neutron-server[30536]: 2017-09-28 12:42:13.379 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:13 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:13 ctl02 neutron-server[30536]: 2017-09-28 12:42:13.380 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:13 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:13 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:13 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:13 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:13 ctl02 neutron-server[30536]: 2017-09-28 12:42:13.381 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:13 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:13 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:13 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:13 ctl02 neutron-server[30536]: 2017-09-28 12:42:13.381 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:13 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:13 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:13 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:13 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:13 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:13 ctl02 neutron-server[30536]: 2017-09-28 12:42:13.483 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:42:13 ctl02 neutron-server[30536]: 2017-09-28 12:42:13.633 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:13 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:13 ctl02 neutron-server[30536]: 2017-09-28 12:42:13.633 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:13 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:13 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:13 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:13 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:13 ctl02 neutron-server[30536]: 2017-09-28 12:42:13.634 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:13 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:13 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:13 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:13 ctl02 neutron-server[30536]: 2017-09-28 12:42:13.634 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:13 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:13 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:13 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:13 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:13 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:13 ctl02 neutron-server[30536]: 2017-09-28 12:42:13.887 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:13 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:13 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:13 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:13 ctl02 neutron-server[30536]: 2017-09-28 12:42:13.888 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:13 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:13 ctl02 neutron-server[30536]: 2017-09-28 12:42:13.888 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:13 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:13 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:13 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:13 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:13 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:13 ctl02 neutron-server[30536]: 2017-09-28 12:42:13.888 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:13 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:13 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:13 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:13 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:14 ctl02 neutron-server[30536]: 2017-09-28 12:42:14.141 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:14 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:14 ctl02 neutron-server[30536]: 2017-09-28 12:42:14.141 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:14 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:14 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:14 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:14 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:14 ctl02 neutron-server[30536]: 2017-09-28 12:42:14.142 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:14 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:14 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:14 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:14 ctl02 neutron-server[30536]: 2017-09-28 12:42:14.142 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:14 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:14 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:14 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:14 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:14 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:14 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x251f273d)
Sep 28 12:42:14 ctl02 neutron-server[30536]: 2017-09-28 12:42:14.394 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:14 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:14 ctl02 neutron-server[30536]: 2017-09-28 12:42:14.395 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:14 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:14 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:14 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:14 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:14 ctl02 neutron-server[30536]: 2017-09-28 12:42:14.397 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:14 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:14 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:14 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:14 ctl02 neutron-server[30536]: 2017-09-28 12:42:14.398 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:14 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:14 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:14 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:14 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:14 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:14 ctl02 nova-cert[4860]: 2017-09-28 12:42:14.584 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:42:14 ctl02 neutron-server[30536]: 2017-09-28 12:42:14.647 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:14 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:14 ctl02 neutron-server[30536]: 2017-09-28 12:42:14.648 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:14 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:14 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:14 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:14 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:14 ctl02 neutron-server[30536]: 2017-09-28 12:42:14.652 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:14 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:14 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:14 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:14 ctl02 neutron-server[30536]: 2017-09-28 12:42:14.652 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:14 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:14 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:14 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:14 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:14 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:14 ctl02 nova-api[6379]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:42:14 ctl02 nova-api[6379]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:42:14 ctl02 neutron-server[30536]: 2017-09-28 12:42:14.908 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:14 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:14 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:14 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:14 ctl02 neutron-server[30536]: 2017-09-28 12:42:14.908 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:14 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:14 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:14 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:14 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:14 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:14 ctl02 neutron-server[30536]: 2017-09-28 12:42:14.910 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:14 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:14 ctl02 neutron-server[30536]: 2017-09-28 12:42:14.910 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:14 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:14 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:14 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:14 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:14 ctl02 nova-conductor[5056]: 2017-09-28 12:42:14.933 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:42:14 ctl02 nova-conductor[5056]: 2017-09-28 12:42:14.953 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:42:14 ctl02 nova-conductor[5056]: 2017-09-28 12:42:14.976 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:42:14 ctl02 nova-conductor[5056]: 2017-09-28 12:42:14.977 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:42:15 ctl02 nova-api[6379]: 2017-09-28 12:42:15.011 6379 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:42:15 ctl02 nova-api[6379]: 2017-09-28 12:42:15.013 6379 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:42:15 ctl02 nova-api[6379]: 2017-09-28 12:42:15.013 6379 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:42:15 ctl02 nova-api[6379]: 2017-09-28 12:42:15.013 6379 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:42:15 ctl02 nova-api[6379]: 2017-09-28 12:42:15.013 6379 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:42:15 ctl02 nova-api[6379]: 2017-09-28 12:42:15.013 6379 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:42:15 ctl02 nova-api[6379]: 2017-09-28 12:42:15.013 6379 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:42:15 ctl02 nova-api[6379]: 2017-09-28 12:42:15.013 6379 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:42:15 ctl02 nova-api[6379]: 2017-09-28 12:42:15.013 6379 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:42:15 ctl02 nova-api[6379]: 2017-09-28 12:42:15.013 6379 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:42:15 ctl02 nova-api[6379]: 2017-09-28 12:42:15.013 6379 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:42:15 ctl02 nova-api[6379]: 2017-09-28 12:42:15.013 6379 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:42:15 ctl02 nova-api[6379]: 2017-09-28 12:42:15.013 6379 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:42:15 ctl02 nova-api[6379]: 2017-09-28 12:42:15.013 6379 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:42:15 ctl02 nova-api[6379]: 2017-09-28 12:42:15.013 6379 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:42:15 ctl02 nova-api[6379]: 2017-09-28 12:42:15.013 6379 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:42:15 ctl02 nova-api[6379]: 2017-09-28 12:42:15.013 6379 ERROR nova.wsgi     self.filename))
Sep 28 12:42:15 ctl02 nova-api[6379]: 2017-09-28 12:42:15.013 6379 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:42:15 ctl02 nova-api[6379]: 2017-09-28 12:42:15.013 6379 ERROR nova.wsgi
Sep 28 12:42:15 ctl02 nova-api[6379]: 2017-09-28 12:42:15.014 6379 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:42:15 ctl02 nova-api[6379]: 2017-09-28 12:42:15.150 6379 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:42:15 ctl02 neutron-server[30536]: 2017-09-28 12:42:15.168 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:15 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:15 ctl02 neutron-server[30536]: 2017-09-28 12:42:15.169 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:15 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:15 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:15 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:15 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:15 ctl02 neutron-server[30536]: 2017-09-28 12:42:15.171 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:15 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:15 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:15 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:15 ctl02 neutron-server[30536]: 2017-09-28 12:42:15.172 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:15 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:15 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:15 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:15 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:15 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:15 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:42:15 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:42:15 ctl02 nova-api[6379]: 2017-09-28 12:42:15.382 6379 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:42:15 ctl02 nova-api[6379]: 2017-09-28 12:42:15.384 6379 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:42:15 ctl02 nova-api[6379]: 2017-09-28 12:42:15.385 6379 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:42:15 ctl02 nova-api[6379]: 2017-09-28 12:42:15.385 6379 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:42:15 ctl02 neutron-server[30536]: 2017-09-28 12:42:15.429 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:15 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:15 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:15 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:15 ctl02 neutron-server[30536]: 2017-09-28 12:42:15.429 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:15 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:15 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:15 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:15 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:15 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:15 ctl02 neutron-server[30536]: 2017-09-28 12:42:15.433 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:15 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:15 ctl02 neutron-server[30536]: 2017-09-28 12:42:15.433 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:15 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:15 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:15 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:15 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:15 ctl02 nova-api[6379]: 2017-09-28 12:42:15.519 6379 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:42:15 ctl02 nova-api[6379]: 2017-09-28 12:42:15.521 6379 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:42:15 ctl02 nova-api[6379]: 2017-09-28 12:42:15.521 6379 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:42:15 ctl02 nova-api[6379]: 2017-09-28 12:42:15.521 6379 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:42:15 ctl02 nova-api[6379]: 2017-09-28 12:42:15.525 6379 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:42:15 ctl02 nova-api[6379]: 2017-09-28 12:42:15.525 6379 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:42:15 ctl02 nova-api[6379]: 2017-09-28 12:42:15.525 6379 ERROR nova Traceback (most recent call last):
Sep 28 12:42:15 ctl02 nova-api[6379]: 2017-09-28 12:42:15.525 6379 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:42:15 ctl02 nova-api[6379]: 2017-09-28 12:42:15.525 6379 ERROR nova     sys.exit(main())
Sep 28 12:42:15 ctl02 nova-api[6379]: 2017-09-28 12:42:15.525 6379 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:42:15 ctl02 nova-api[6379]: 2017-09-28 12:42:15.525 6379 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:42:15 ctl02 nova-api[6379]: 2017-09-28 12:42:15.525 6379 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:42:15 ctl02 nova-api[6379]: 2017-09-28 12:42:15.525 6379 ERROR nova     max_url_len=max_url_len)
Sep 28 12:42:15 ctl02 nova-api[6379]: 2017-09-28 12:42:15.525 6379 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:42:15 ctl02 nova-api[6379]: 2017-09-28 12:42:15.525 6379 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:42:15 ctl02 nova-api[6379]: 2017-09-28 12:42:15.525 6379 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:42:15 ctl02 nova-api[6379]: 2017-09-28 12:42:15.525 6379 ERROR nova     sock.listen(backlog)
Sep 28 12:42:15 ctl02 nova-api[6379]: 2017-09-28 12:42:15.525 6379 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:42:15 ctl02 nova-api[6379]: 2017-09-28 12:42:15.525 6379 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:42:15 ctl02 nova-api[6379]: 2017-09-28 12:42:15.525 6379 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:42:15 ctl02 nova-api[6379]: 2017-09-28 12:42:15.525 6379 ERROR nova
Sep 28 12:42:15 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:42:15 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:42:15 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:42:15 ctl02 neutron-server[30536]: 2017-09-28 12:42:15.688 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:15 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:15 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:15 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:15 ctl02 neutron-server[30536]: 2017-09-28 12:42:15.688 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:15 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:15 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:15 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:15 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:15 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:15 ctl02 neutron-server[30536]: 2017-09-28 12:42:15.688 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:15 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:15 ctl02 neutron-server[30536]: 2017-09-28 12:42:15.689 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:15 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:15 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:15 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:15 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:15 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:42:15 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:42:15 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:42:15 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:42:15 ctl02 neutron-server[30536]: 2017-09-28 12:42:15.942 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:15 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:15 ctl02 neutron-server[30536]: 2017-09-28 12:42:15.944 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:15 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:15 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:15 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:15 ctl02 neutron-server[30536]: 2017-09-28 12:42:15.946 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:15 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:15 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:15 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:15 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:15 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:15 ctl02 neutron-server[30536]: 2017-09-28 12:42:15.948 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:15 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:15 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:15 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:15 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:16 ctl02 heat-api[13008]: 2017-09-28 12:42:16.053 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:42:16] "OPTIONS / HTTP/1.0" 200 134 0.000586
Sep 28 12:42:16 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:42:16.090 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:42:16] "OPTIONS / HTTP/1.0" 200 134 0.000389
Sep 28 12:42:16 ctl02 neutron-server[30536]: 2017-09-28 12:42:16.203 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:16 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:16 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:16 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:16 ctl02 neutron-server[30536]: 2017-09-28 12:42:16.205 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:16 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:16 ctl02 neutron-server[30536]: 2017-09-28 12:42:16.206 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:16 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:16 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:16 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:16 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:16 ctl02 neutron-server[30536]: 2017-09-28 12:42:16.207 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:16 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:16 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:16 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:16 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:16 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:16 ctl02 neutron-server[30536]: 2017-09-28 12:42:16.462 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:16 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:16 ctl02 neutron-server[30536]: 2017-09-28 12:42:16.464 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:16 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:16 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:16 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:16 ctl02 neutron-server[30536]: 2017-09-28 12:42:16.465 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:16 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:16 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:16 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:16 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:16 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:16 ctl02 neutron-server[30536]: 2017-09-28 12:42:16.467 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:16 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:16 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:16 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:16 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:16 ctl02 neutron-server[30536]: 2017-09-28 12:42:16.721 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:16 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:16 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:16 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:16 ctl02 neutron-server[30536]: 2017-09-28 12:42:16.723 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:16 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:16 ctl02 neutron-server[30536]: 2017-09-28 12:42:16.724 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:16 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:16 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:16 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:16 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:16 ctl02 neutron-server[30536]: 2017-09-28 12:42:16.726 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:16 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:16 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:16 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:16 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:16 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:16 ctl02 heat-api[13008]: 2017-09-28 12:42:16.914 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:42:16] "OPTIONS / HTTP/1.0" 200 134 0.000563
Sep 28 12:42:16 ctl02 neutron-server[30536]: 2017-09-28 12:42:16.979 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:16 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:16 ctl02 neutron-server[30536]: 2017-09-28 12:42:16.981 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:16 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:16 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:16 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:16 ctl02 neutron-server[30536]: 2017-09-28 12:42:16.982 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:16 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:16 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:16 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:16 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:16 ctl02 neutron-server[30536]: 2017-09-28 12:42:16.984 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:16 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:16 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:16 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:16 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:16 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:17 ctl02 neutron-server[30536]: 2017-09-28 12:42:17.238 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:17 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:17 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:17 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:17 ctl02 neutron-server[30536]: 2017-09-28 12:42:17.240 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:17 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:17 ctl02 neutron-server[30536]: 2017-09-28 12:42:17.241 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:17 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:17 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:17 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:17 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:17 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:17 ctl02 neutron-server[30536]: 2017-09-28 12:42:17.243 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:17 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:17 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:17 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:17 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:17 ctl02 neutron-server[30536]: 2017-09-28 12:42:17.497 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:17 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:17 ctl02 neutron-server[30536]: 2017-09-28 12:42:17.515 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:17 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:17 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:17 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:17 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:17 ctl02 neutron-server[30536]: 2017-09-28 12:42:17.497 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:17 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:17 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:17 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:17 ctl02 neutron-server[30536]: 2017-09-28 12:42:17.518 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:17 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:17 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:17 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:17 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:17 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:17 ctl02 nova-api[6403]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:42:17 ctl02 nova-api[6403]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:42:17 ctl02 nova-api[6403]: 2017-09-28 12:42:17.742 6403 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:42:17 ctl02 nova-api[6403]: 2017-09-28 12:42:17.743 6403 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:42:17 ctl02 nova-api[6403]: 2017-09-28 12:42:17.743 6403 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:42:17 ctl02 nova-api[6403]: 2017-09-28 12:42:17.743 6403 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:42:17 ctl02 nova-api[6403]: 2017-09-28 12:42:17.743 6403 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:42:17 ctl02 nova-api[6403]: 2017-09-28 12:42:17.743 6403 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:42:17 ctl02 nova-api[6403]: 2017-09-28 12:42:17.743 6403 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:42:17 ctl02 nova-api[6403]: 2017-09-28 12:42:17.743 6403 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:42:17 ctl02 nova-api[6403]: 2017-09-28 12:42:17.743 6403 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:42:17 ctl02 nova-api[6403]: 2017-09-28 12:42:17.743 6403 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:42:17 ctl02 nova-api[6403]: 2017-09-28 12:42:17.743 6403 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:42:17 ctl02 nova-api[6403]: 2017-09-28 12:42:17.743 6403 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:42:17 ctl02 nova-api[6403]: 2017-09-28 12:42:17.743 6403 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:42:17 ctl02 nova-api[6403]: 2017-09-28 12:42:17.743 6403 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:42:17 ctl02 nova-api[6403]: 2017-09-28 12:42:17.743 6403 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:42:17 ctl02 nova-api[6403]: 2017-09-28 12:42:17.743 6403 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:42:17 ctl02 nova-api[6403]: 2017-09-28 12:42:17.743 6403 ERROR nova.wsgi     self.filename))
Sep 28 12:42:17 ctl02 nova-api[6403]: 2017-09-28 12:42:17.743 6403 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:42:17 ctl02 nova-api[6403]: 2017-09-28 12:42:17.743 6403 ERROR nova.wsgi
Sep 28 12:42:17 ctl02 nova-api[6403]: 2017-09-28 12:42:17.744 6403 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:42:17 ctl02 neutron-server[30536]: 2017-09-28 12:42:17.772 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:17 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:17 ctl02 neutron-server[30536]: 2017-09-28 12:42:17.773 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:17 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:17 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:17 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:17 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:17 ctl02 neutron-server[30536]: 2017-09-28 12:42:17.775 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:17 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:17 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:17 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:17 ctl02 neutron-server[30536]: 2017-09-28 12:42:17.777 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:17 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:17 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:17 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:17 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:17 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:17 ctl02 nova-api[6403]: 2017-09-28 12:42:17.872 6403 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:42:18 ctl02 neutron-server[30536]: 2017-09-28 12:42:18.029 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:18 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:18 ctl02 neutron-server[30536]: 2017-09-28 12:42:18.030 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:18 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:18 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:18 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:18 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:18 ctl02 neutron-server[30536]: 2017-09-28 12:42:18.033 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:18 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:18 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:18 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:18 ctl02 neutron-server[30536]: 2017-09-28 12:42:18.034 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:18 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:18 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:18 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:18 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:18 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:18 ctl02 nova-api[6403]: 2017-09-28 12:42:18.101 6403 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:42:18 ctl02 nova-api[6403]: 2017-09-28 12:42:18.103 6403 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:42:18 ctl02 nova-api[6403]: 2017-09-28 12:42:18.103 6403 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:42:18 ctl02 nova-api[6403]: 2017-09-28 12:42:18.104 6403 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:42:18 ctl02 nova-api[6403]: 2017-09-28 12:42:18.233 6403 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:42:18 ctl02 nova-api[6403]: 2017-09-28 12:42:18.235 6403 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:42:18 ctl02 nova-api[6403]: 2017-09-28 12:42:18.235 6403 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:42:18 ctl02 nova-api[6403]: 2017-09-28 12:42:18.235 6403 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:42:18 ctl02 nova-api[6403]: 2017-09-28 12:42:18.239 6403 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:42:18 ctl02 nova-api[6403]: 2017-09-28 12:42:18.239 6403 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:42:18 ctl02 nova-api[6403]: 2017-09-28 12:42:18.239 6403 ERROR nova Traceback (most recent call last):
Sep 28 12:42:18 ctl02 nova-api[6403]: 2017-09-28 12:42:18.239 6403 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:42:18 ctl02 nova-api[6403]: 2017-09-28 12:42:18.239 6403 ERROR nova     sys.exit(main())
Sep 28 12:42:18 ctl02 nova-api[6403]: 2017-09-28 12:42:18.239 6403 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:42:18 ctl02 nova-api[6403]: 2017-09-28 12:42:18.239 6403 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:42:18 ctl02 nova-api[6403]: 2017-09-28 12:42:18.239 6403 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:42:18 ctl02 nova-api[6403]: 2017-09-28 12:42:18.239 6403 ERROR nova     max_url_len=max_url_len)
Sep 28 12:42:18 ctl02 nova-api[6403]: 2017-09-28 12:42:18.239 6403 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:42:18 ctl02 nova-api[6403]: 2017-09-28 12:42:18.239 6403 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:42:18 ctl02 nova-api[6403]: 2017-09-28 12:42:18.239 6403 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:42:18 ctl02 nova-api[6403]: 2017-09-28 12:42:18.239 6403 ERROR nova     sock.listen(backlog)
Sep 28 12:42:18 ctl02 nova-api[6403]: 2017-09-28 12:42:18.239 6403 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:42:18 ctl02 nova-api[6403]: 2017-09-28 12:42:18.239 6403 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:42:18 ctl02 nova-api[6403]: 2017-09-28 12:42:18.239 6403 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:42:18 ctl02 nova-api[6403]: 2017-09-28 12:42:18.239 6403 ERROR nova
Sep 28 12:42:18 ctl02 neutron-server[30536]: 2017-09-28 12:42:18.286 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:18 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:18 ctl02 neutron-server[30536]: 2017-09-28 12:42:18.287 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:18 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:18 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:18 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:18 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:18 ctl02 neutron-server[30536]: 2017-09-28 12:42:18.289 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:18 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:18 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:18 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:18 ctl02 neutron-server[30536]: 2017-09-28 12:42:18.291 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:18 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:18 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:18 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:18 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:18 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:18 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:42:18 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:42:18 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:42:18 ctl02 neutron-server[30536]: 2017-09-28 12:42:18.543 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:18 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:18 ctl02 neutron-server[30536]: 2017-09-28 12:42:18.544 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:18 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:18 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:18 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:18 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:18 ctl02 neutron-server[30536]: 2017-09-28 12:42:18.546 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:18 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:18 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:18 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:18 ctl02 neutron-server[30536]: 2017-09-28 12:42:18.547 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:18 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:18 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:18 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:18 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:18 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:18 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:42:18.577 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:42:18] "OPTIONS / HTTP/1.0" 200 134 0.000418
Sep 28 12:42:18 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:42:18 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:42:18 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:42:18 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:42:18 ctl02 heat-api[13008]: 2017-09-28 12:42:18.704 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:42:18] "OPTIONS / HTTP/1.0" 200 134 0.000611
Sep 28 12:42:18 ctl02 heat-api-cfn[13300]: 2017-09-28 12:42:18.739 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:42:18] "OPTIONS / HTTP/1.0" 200 134 0.000473
Sep 28 12:42:18 ctl02 neutron-server[30536]: 2017-09-28 12:42:18.799 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:18 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:18 ctl02 neutron-server[30536]: 2017-09-28 12:42:18.799 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:18 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:18 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:18 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:18 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:18 ctl02 neutron-server[30536]: 2017-09-28 12:42:18.801 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:18 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:18 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:18 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:18 ctl02 neutron-server[30536]: 2017-09-28 12:42:18.802 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:18 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:18 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:18 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:18 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:18 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:19 ctl02 neutron-server[30536]: 2017-09-28 12:42:19.054 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:19 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:19 ctl02 neutron-server[30536]: 2017-09-28 12:42:19.054 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:19 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:19 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:19 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:19 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:19 ctl02 neutron-server[30536]: 2017-09-28 12:42:19.056 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:19 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:19 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:19 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:19 ctl02 neutron-server[30536]: 2017-09-28 12:42:19.057 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:19 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:19 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:19 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:19 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:19 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:19 ctl02 neutron-server[30536]: 2017-09-28 12:42:19.309 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:19 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:19 ctl02 neutron-server[30536]: 2017-09-28 12:42:19.310 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:19 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:19 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:19 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:19 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:19 ctl02 neutron-server[30536]: 2017-09-28 12:42:19.311 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:19 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:19 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:19 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:19 ctl02 neutron-server[30536]: 2017-09-28 12:42:19.312 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:19 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:19 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:19 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:19 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:19 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:19 ctl02 neutron-server[30536]: 2017-09-28 12:42:19.427 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:42:19] "OPTIONS / HTTP/1.0" 200 262 0.000593
Sep 28 12:42:19 ctl02 neutron-server[30536]: 2017-09-28 12:42:19.564 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:19 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:19 ctl02 neutron-server[30536]: 2017-09-28 12:42:19.565 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:19 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:19 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:19 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:19 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:19 ctl02 neutron-server[30536]: 2017-09-28 12:42:19.567 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:19 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:19 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:19 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:19 ctl02 neutron-server[30536]: 2017-09-28 12:42:19.567 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:19 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:19 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:19 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:19 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:19 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:19 ctl02 heat-api-cfn[13300]: 2017-09-28 12:42:19.597 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:42:19] "OPTIONS / HTTP/1.0" 200 134 0.000478
Sep 28 12:42:19 ctl02 neutron-server[30536]: 2017-09-28 12:42:19.820 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:19 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:19 ctl02 neutron-server[30536]: 2017-09-28 12:42:19.820 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:19 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:19 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:19 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:19 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:19 ctl02 neutron-server[30536]: 2017-09-28 12:42:19.820 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:19 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:19 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:19 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:19 ctl02 neutron-server[30536]: 2017-09-28 12:42:19.821 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:19 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:19 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:19 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:19 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:19 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:20 ctl02 neutron-server[30536]: 2017-09-28 12:42:20.074 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:20 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:20 ctl02 neutron-server[30536]: 2017-09-28 12:42:20.074 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:20 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:20 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:20 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:20 ctl02 neutron-server[30536]: 2017-09-28 12:42:20.074 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:20 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:20 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:20 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:20 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:20 ctl02 neutron-server[30536]: 2017-09-28 12:42:20.074 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:20 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:20 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:20 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:20 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:20 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:20 ctl02 nova-api[6421]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:42:20 ctl02 nova-api[6421]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:42:20 ctl02 neutron-server[30536]: 2017-09-28 12:42:20.327 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:20 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:20 ctl02 neutron-server[30536]: 2017-09-28 12:42:20.327 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:20 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:20 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:20 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:20 ctl02 neutron-server[30536]: 2017-09-28 12:42:20.328 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:20 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:20 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:20 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:20 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:20 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:20 ctl02 neutron-server[30536]: 2017-09-28 12:42:20.328 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:20 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:20 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:20 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:20 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:20 ctl02 nova-api[6421]: 2017-09-28 12:42:20.472 6421 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:42:20 ctl02 nova-api[6421]: 2017-09-28 12:42:20.474 6421 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:42:20 ctl02 nova-api[6421]: 2017-09-28 12:42:20.474 6421 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:42:20 ctl02 nova-api[6421]: 2017-09-28 12:42:20.474 6421 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:42:20 ctl02 nova-api[6421]: 2017-09-28 12:42:20.474 6421 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:42:20 ctl02 nova-api[6421]: 2017-09-28 12:42:20.474 6421 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:42:20 ctl02 nova-api[6421]: 2017-09-28 12:42:20.474 6421 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:42:20 ctl02 nova-api[6421]: 2017-09-28 12:42:20.474 6421 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:42:20 ctl02 nova-api[6421]: 2017-09-28 12:42:20.474 6421 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:42:20 ctl02 nova-api[6421]: 2017-09-28 12:42:20.474 6421 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:42:20 ctl02 nova-api[6421]: 2017-09-28 12:42:20.474 6421 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:42:20 ctl02 nova-api[6421]: 2017-09-28 12:42:20.474 6421 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:42:20 ctl02 nova-api[6421]: 2017-09-28 12:42:20.474 6421 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:42:20 ctl02 nova-api[6421]: 2017-09-28 12:42:20.474 6421 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:42:20 ctl02 nova-api[6421]: 2017-09-28 12:42:20.474 6421 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:42:20 ctl02 nova-api[6421]: 2017-09-28 12:42:20.474 6421 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:42:20 ctl02 nova-api[6421]: 2017-09-28 12:42:20.474 6421 ERROR nova.wsgi     self.filename))
Sep 28 12:42:20 ctl02 nova-api[6421]: 2017-09-28 12:42:20.474 6421 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:42:20 ctl02 nova-api[6421]: 2017-09-28 12:42:20.474 6421 ERROR nova.wsgi
Sep 28 12:42:20 ctl02 nova-api[6421]: 2017-09-28 12:42:20.475 6421 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:42:20 ctl02 neutron-server[30536]: 2017-09-28 12:42:20.582 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:20 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:20 ctl02 neutron-server[30536]: 2017-09-28 12:42:20.582 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:20 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:20 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:20 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:20 ctl02 neutron-server[30536]: 2017-09-28 12:42:20.582 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:20 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:20 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:20 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:20 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:20 ctl02 neutron-server[30536]: 2017-09-28 12:42:20.582 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:20 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:20 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:20 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:20 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:20 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:20 ctl02 nova-api[6421]: 2017-09-28 12:42:20.601 6421 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:42:20 ctl02 glance-api[29183]: 2017-09-28 12:42:20.619 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:42:20] "OPTIONS / HTTP/1.0" 200 134 0.000550
Sep 28 12:42:20 ctl02 neutron-server[30536]: 2017-09-28 12:42:20.640 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:42:20] "OPTIONS / HTTP/1.0" 200 262 0.000549
Sep 28 12:42:20 ctl02 nova-api[6421]: 2017-09-28 12:42:20.828 6421 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:42:20 ctl02 nova-api[6421]: 2017-09-28 12:42:20.830 6421 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:42:20 ctl02 nova-api[6421]: 2017-09-28 12:42:20.830 6421 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:42:20 ctl02 nova-api[6421]: 2017-09-28 12:42:20.830 6421 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:42:20 ctl02 neutron-server[30536]: 2017-09-28 12:42:20.835 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:20 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:20 ctl02 neutron-server[30536]: 2017-09-28 12:42:20.835 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:20 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:20 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:20 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:20 ctl02 neutron-server[30536]: 2017-09-28 12:42:20.836 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:20 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:20 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:20 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:20 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:20 ctl02 neutron-server[30536]: 2017-09-28 12:42:20.836 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:20 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:20 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:20 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:20 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:20 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:20 ctl02 nova-api[6421]: 2017-09-28 12:42:20.963 6421 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:42:20 ctl02 nova-api[6421]: 2017-09-28 12:42:20.965 6421 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:42:20 ctl02 nova-api[6421]: 2017-09-28 12:42:20.965 6421 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:42:20 ctl02 nova-api[6421]: 2017-09-28 12:42:20.965 6421 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:42:20 ctl02 nova-api[6421]: 2017-09-28 12:42:20.969 6421 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:42:20 ctl02 nova-api[6421]: 2017-09-28 12:42:20.969 6421 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:42:20 ctl02 nova-api[6421]: 2017-09-28 12:42:20.969 6421 ERROR nova Traceback (most recent call last):
Sep 28 12:42:20 ctl02 nova-api[6421]: 2017-09-28 12:42:20.969 6421 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:42:20 ctl02 nova-api[6421]: 2017-09-28 12:42:20.969 6421 ERROR nova     sys.exit(main())
Sep 28 12:42:20 ctl02 nova-api[6421]: 2017-09-28 12:42:20.969 6421 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:42:20 ctl02 nova-api[6421]: 2017-09-28 12:42:20.969 6421 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:42:20 ctl02 nova-api[6421]: 2017-09-28 12:42:20.969 6421 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:42:20 ctl02 nova-api[6421]: 2017-09-28 12:42:20.969 6421 ERROR nova     max_url_len=max_url_len)
Sep 28 12:42:20 ctl02 nova-api[6421]: 2017-09-28 12:42:20.969 6421 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:42:20 ctl02 nova-api[6421]: 2017-09-28 12:42:20.969 6421 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:42:20 ctl02 nova-api[6421]: 2017-09-28 12:42:20.969 6421 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:42:20 ctl02 nova-api[6421]: 2017-09-28 12:42:20.969 6421 ERROR nova     sock.listen(backlog)
Sep 28 12:42:20 ctl02 nova-api[6421]: 2017-09-28 12:42:20.969 6421 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:42:20 ctl02 nova-api[6421]: 2017-09-28 12:42:20.969 6421 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:42:20 ctl02 nova-api[6421]: 2017-09-28 12:42:20.969 6421 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:42:20 ctl02 nova-api[6421]: 2017-09-28 12:42:20.969 6421 ERROR nova
Sep 28 12:42:20 ctl02 neutron-server[30536]: 2017-09-28 12:42:20.970 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:42:20] "OPTIONS / HTTP/1.0" 200 262 0.000521
Sep 28 12:42:21 ctl02 neutron-server[30536]: 2017-09-28 12:42:21.089 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:21 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:21 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:21 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:21 ctl02 neutron-server[30536]: 2017-09-28 12:42:21.089 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:21 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:21 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:21 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:21 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:21 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:21 ctl02 neutron-server[30536]: 2017-09-28 12:42:21.089 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:21 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:21 ctl02 neutron-server[30536]: 2017-09-28 12:42:21.090 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:21 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:21 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:21 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:21 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:21 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:42:21 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:42:21 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:42:21 ctl02 glance-api[29183]: 2017-09-28 12:42:21.198 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:42:21] "OPTIONS / HTTP/1.0" 200 134 0.000584
Sep 28 12:42:21 ctl02 neutron-server[30536]: 2017-09-28 12:42:21.289 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 4 dead agents out of 6:
Sep 28 12:42:21 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:42:21 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:40:56 cmp002
Sep 28 12:42:21 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:41:28 cmp001
Sep 28 12:42:21 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:41:20 cmp002
Sep 28 12:42:21 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:41:16 cmp002
Sep 28 12:42:21 ctl02 neutron-server[30536]: 2017-09-28 12:42:21.344 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:21 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:21 ctl02 neutron-server[30536]: 2017-09-28 12:42:21.345 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:21 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:21 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:21 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:21 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:21 ctl02 neutron-server[30536]: 2017-09-28 12:42:21.345 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:21 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:21 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:21 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:21 ctl02 neutron-server[30536]: 2017-09-28 12:42:21.345 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:21 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:21 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:21 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:21 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:21 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:21 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:42:21 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:42:21 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:42:21 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:42:21 ctl02 neutron-server[30536]: 2017-09-28 12:42:21.598 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:21 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:21 ctl02 neutron-server[30536]: 2017-09-28 12:42:21.598 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:21 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:21 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:21 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:21 ctl02 neutron-server[30536]: 2017-09-28 12:42:21.599 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:21 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:21 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:21 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:21 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:21 ctl02 neutron-server[30536]: 2017-09-28 12:42:21.599 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:21 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:21 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:21 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:21 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:21 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:21 ctl02 neutron-server[30536]: 2017-09-28 12:42:21.855 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:21 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:21 ctl02 neutron-server[30536]: 2017-09-28 12:42:21.856 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:21 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:21 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:21 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:21 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:21 ctl02 neutron-server[30536]: 2017-09-28 12:42:21.859 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:21 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:21 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:21 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:21 ctl02 neutron-server[30536]: 2017-09-28 12:42:21.860 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:21 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:21 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:21 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:21 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:21 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:22 ctl02 neutron-server[30536]: 2017-09-28 12:42:22.112 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:22 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:22 ctl02 neutron-server[30536]: 2017-09-28 12:42:22.113 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:22 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:22 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:22 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:22 ctl02 neutron-server[30536]: 2017-09-28 12:42:22.113 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:22 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:22 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:22 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:22 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:22 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:22 ctl02 neutron-server[30536]: 2017-09-28 12:42:22.116 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:22 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:22 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:22 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:22 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:22 ctl02 neutron-server[30536]: 2017-09-28 12:42:22.366 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:22 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:22 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:22 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:22 ctl02 neutron-server[30536]: 2017-09-28 12:42:22.367 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:22 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:22 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:22 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:22 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:22 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:22 ctl02 neutron-server[30536]: 2017-09-28 12:42:22.370 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:22 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:22 ctl02 neutron-server[30536]: 2017-09-28 12:42:22.370 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:22 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:22 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:22 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:22 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:22 ctl02 neutron-server[30536]: 2017-09-28 12:42:22.620 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:22 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:22 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:22 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:22 ctl02 neutron-server[30536]: 2017-09-28 12:42:22.620 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:22 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:22 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:22 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:22 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:22 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:22 ctl02 neutron-server[30536]: 2017-09-28 12:42:22.624 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:22 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:22 ctl02 neutron-server[30536]: 2017-09-28 12:42:22.625 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:22 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:22 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:22 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:22 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:22 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:42:22.799 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:42:22] "OPTIONS / HTTP/1.0" 200 134 0.000365
Sep 28 12:42:22 ctl02 glance-api[29183]: 2017-09-28 12:42:22.821 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:42:22] "OPTIONS / HTTP/1.0" 200 134 0.000548
Sep 28 12:42:22 ctl02 neutron-server[30536]: 2017-09-28 12:42:22.873 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:22 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:22 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:22 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:22 ctl02 neutron-server[30536]: 2017-09-28 12:42:22.874 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:22 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:22 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:22 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:22 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:22 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:22 ctl02 neutron-server[30536]: 2017-09-28 12:42:22.879 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:22 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:22 ctl02 neutron-server[30536]: 2017-09-28 12:42:22.880 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:22 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:22 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:22 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:22 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:23 ctl02 heat-api-cfn[13300]: 2017-09-28 12:42:23.038 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:42:23] "OPTIONS / HTTP/1.0" 200 134 0.000429
Sep 28 12:42:23 ctl02 nova-api[6439]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:42:23 ctl02 nova-api[6439]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:42:23 ctl02 neutron-server[30536]: 2017-09-28 12:42:23.127 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:23 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:23 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:23 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:23 ctl02 neutron-server[30536]: 2017-09-28 12:42:23.128 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:23 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:23 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:23 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:23 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:23 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:23 ctl02 neutron-server[30536]: 2017-09-28 12:42:23.134 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:23 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:23 ctl02 neutron-server[30536]: 2017-09-28 12:42:23.135 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:23 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:23 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:23 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:23 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:23 ctl02 nova-api[6439]: 2017-09-28 12:42:23.243 6439 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:42:23 ctl02 nova-api[6439]: 2017-09-28 12:42:23.245 6439 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:42:23 ctl02 nova-api[6439]: 2017-09-28 12:42:23.245 6439 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:42:23 ctl02 nova-api[6439]: 2017-09-28 12:42:23.245 6439 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:42:23 ctl02 nova-api[6439]: 2017-09-28 12:42:23.245 6439 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:42:23 ctl02 nova-api[6439]: 2017-09-28 12:42:23.245 6439 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:42:23 ctl02 nova-api[6439]: 2017-09-28 12:42:23.245 6439 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:42:23 ctl02 nova-api[6439]: 2017-09-28 12:42:23.245 6439 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:42:23 ctl02 nova-api[6439]: 2017-09-28 12:42:23.245 6439 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:42:23 ctl02 nova-api[6439]: 2017-09-28 12:42:23.245 6439 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:42:23 ctl02 nova-api[6439]: 2017-09-28 12:42:23.245 6439 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:42:23 ctl02 nova-api[6439]: 2017-09-28 12:42:23.245 6439 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:42:23 ctl02 nova-api[6439]: 2017-09-28 12:42:23.245 6439 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:42:23 ctl02 nova-api[6439]: 2017-09-28 12:42:23.245 6439 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:42:23 ctl02 nova-api[6439]: 2017-09-28 12:42:23.245 6439 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:42:23 ctl02 nova-api[6439]: 2017-09-28 12:42:23.245 6439 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:42:23 ctl02 nova-api[6439]: 2017-09-28 12:42:23.245 6439 ERROR nova.wsgi     self.filename))
Sep 28 12:42:23 ctl02 nova-api[6439]: 2017-09-28 12:42:23.245 6439 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:42:23 ctl02 nova-api[6439]: 2017-09-28 12:42:23.245 6439 ERROR nova.wsgi
Sep 28 12:42:23 ctl02 nova-api[6439]: 2017-09-28 12:42:23.246 6439 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:42:23 ctl02 nova-api[6439]: 2017-09-28 12:42:23.375 6439 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:42:23 ctl02 neutron-server[30536]: 2017-09-28 12:42:23.381 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:23 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:23 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:23 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:23 ctl02 neutron-server[30536]: 2017-09-28 12:42:23.382 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:23 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:23 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:23 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:23 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:23 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:23 ctl02 neutron-server[30536]: 2017-09-28 12:42:23.389 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:23 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:23 ctl02 neutron-server[30536]: 2017-09-28 12:42:23.390 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:23 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:23 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:23 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:23 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:23 ctl02 nova-api[6439]: 2017-09-28 12:42:23.593 6439 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:42:23 ctl02 nova-api[6439]: 2017-09-28 12:42:23.595 6439 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:42:23 ctl02 nova-api[6439]: 2017-09-28 12:42:23.596 6439 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:42:23 ctl02 nova-api[6439]: 2017-09-28 12:42:23.596 6439 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:42:23 ctl02 neutron-server[30536]: 2017-09-28 12:42:23.635 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:23 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:23 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:23 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:23 ctl02 neutron-server[30536]: 2017-09-28 12:42:23.635 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:23 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:23 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:23 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:23 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:23 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:23 ctl02 neutron-server[30536]: 2017-09-28 12:42:23.644 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:23 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:23 ctl02 neutron-server[30536]: 2017-09-28 12:42:23.645 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:23 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:23 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:23 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:23 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:23 ctl02 nova-api[6439]: 2017-09-28 12:42:23.727 6439 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:42:23 ctl02 nova-api[6439]: 2017-09-28 12:42:23.729 6439 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:42:23 ctl02 nova-api[6439]: 2017-09-28 12:42:23.730 6439 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:42:23 ctl02 nova-api[6439]: 2017-09-28 12:42:23.730 6439 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:42:23 ctl02 dhclient[600]: DHCPREQUEST of 192.168.11.25 on ens2 to 192.168.11.3 port 67 (xid=0x3415f07)
Sep 28 12:42:23 ctl02 nova-api[6439]: 2017-09-28 12:42:23.733 6439 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:42:23 ctl02 nova-api[6439]: 2017-09-28 12:42:23.734 6439 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:42:23 ctl02 nova-api[6439]: 2017-09-28 12:42:23.734 6439 ERROR nova Traceback (most recent call last):
Sep 28 12:42:23 ctl02 nova-api[6439]: 2017-09-28 12:42:23.734 6439 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:42:23 ctl02 nova-api[6439]: 2017-09-28 12:42:23.734 6439 ERROR nova     sys.exit(main())
Sep 28 12:42:23 ctl02 nova-api[6439]: 2017-09-28 12:42:23.734 6439 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:42:23 ctl02 nova-api[6439]: 2017-09-28 12:42:23.734 6439 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:42:23 ctl02 nova-api[6439]: 2017-09-28 12:42:23.734 6439 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:42:23 ctl02 nova-api[6439]: 2017-09-28 12:42:23.734 6439 ERROR nova     max_url_len=max_url_len)
Sep 28 12:42:23 ctl02 nova-api[6439]: 2017-09-28 12:42:23.734 6439 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:42:23 ctl02 nova-api[6439]: 2017-09-28 12:42:23.734 6439 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:42:23 ctl02 nova-api[6439]: 2017-09-28 12:42:23.734 6439 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:42:23 ctl02 nova-api[6439]: 2017-09-28 12:42:23.734 6439 ERROR nova     sock.listen(backlog)
Sep 28 12:42:23 ctl02 nova-api[6439]: 2017-09-28 12:42:23.734 6439 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:42:23 ctl02 nova-api[6439]: 2017-09-28 12:42:23.734 6439 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:42:23 ctl02 nova-api[6439]: 2017-09-28 12:42:23.734 6439 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:42:23 ctl02 nova-api[6439]: 2017-09-28 12:42:23.734 6439 ERROR nova
Sep 28 12:42:23 ctl02 dhclient[600]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 12:42:23 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:42:23 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:42:23 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:42:23 ctl02 neutron-server[30536]: 2017-09-28 12:42:23.889 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:23 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:23 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 12:42:23 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:23 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:23 ctl02 neutron-server[30536]: 2017-09-28 12:42:23.889 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:23 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:23 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:23 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:23 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:23 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:23 ctl02 ntp[6506]:  * Stopping NTP server ntpd
Sep 28 12:42:23 ctl02 ntp[6506]:    ...done.
Sep 28 12:42:23 ctl02 neutron-server[30536]: 2017-09-28 12:42:23.898 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:23 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:23 ctl02 neutron-server[30536]: 2017-09-28 12:42:23.899 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:23 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:23 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:23 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 12:42:23 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:23 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:23 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 12:42:23 ctl02 ntp[6516]:  * Starting NTP server ntpd
Sep 28 12:42:23 ctl02 ntpd[6524]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 12:42:23 ctl02 ntpd[6524]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -c /var/lib/ntp/ntp.conf.dhcp -u 108:112
Sep 28 12:42:23 ctl02 ntp[6516]:    ...done.
Sep 28 12:42:23 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 12:42:23 ctl02 ntpd[6527]: proto: precision = 0.043 usec (-24)
Sep 28 12:42:23 ctl02 ntpd[6527]: switching logging to file /var/log/ntp.log
Sep 28 12:42:23 ctl02 dhclient[600]: bound to 192.168.11.25 -- renewal in 300 seconds.
Sep 28 12:42:24 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:42:24 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:42:24 ctl02 neutron-server[30536]: 2017-09-28 12:42:24.142 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:24 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:24 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:42:24 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:24 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:24 ctl02 neutron-server[30536]: 2017-09-28 12:42:24.143 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:24 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:24 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:24 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:24 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:24 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:24 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:42:24 ctl02 neutron-server[30536]: 2017-09-28 12:42:24.151 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:24 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:24 ctl02 neutron-server[30536]: 2017-09-28 12:42:24.152 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:24 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:24 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:24 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:24 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:24 ctl02 neutron-server[30536]: 2017-09-28 12:42:24.396 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:24 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:24 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:24 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:24 ctl02 neutron-server[30536]: 2017-09-28 12:42:24.397 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:24 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:24 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:24 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:24 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:24 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:24 ctl02 neutron-server[30536]: 2017-09-28 12:42:24.404 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:24 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:24 ctl02 neutron-server[30536]: 2017-09-28 12:42:24.405 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:24 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:24 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:24 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:24 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:24 ctl02 nova-consoleauth[5433]: 2017-09-28 12:42:24.436 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:42:24 ctl02 neutron-server[30536]: 2017-09-28 12:42:24.650 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:24 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:24 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:24 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:24 ctl02 neutron-server[30536]: 2017-09-28 12:42:24.651 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:24 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:24 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:24 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:24 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:24 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:24 ctl02 neutron-server[30536]: 2017-09-28 12:42:24.658 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:24 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:24 ctl02 neutron-server[30536]: 2017-09-28 12:42:24.658 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:24 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:24 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:24 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:24 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:24 ctl02 neutron-server[30536]: 2017-09-28 12:42:24.905 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:24 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:24 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:24 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:24 ctl02 neutron-server[30536]: 2017-09-28 12:42:24.906 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:24 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:24 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:24 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:24 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:24 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:24 ctl02 neutron-server[30536]: 2017-09-28 12:42:24.911 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:24 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:24 ctl02 neutron-server[30536]: 2017-09-28 12:42:24.911 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:24 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:24 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:24 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:24 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:25 ctl02 neutron-server[30536]: 2017-09-28 12:42:25.160 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:25 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:25 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:25 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:25 ctl02 neutron-server[30536]: 2017-09-28 12:42:25.161 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:25 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:25 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:25 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:25 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:25 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:25 ctl02 neutron-server[30536]: 2017-09-28 12:42:25.164 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:25 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:25 ctl02 neutron-server[30536]: 2017-09-28 12:42:25.164 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:25 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:25 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:25 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:25 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:25 ctl02 neutron-server[30536]: 2017-09-28 12:42:25.414 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:25 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:25 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:25 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:25 ctl02 neutron-server[30536]: 2017-09-28 12:42:25.415 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:25 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:25 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:25 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:25 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:25 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:25 ctl02 neutron-server[30536]: 2017-09-28 12:42:25.417 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:25 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:25 ctl02 neutron-server[30536]: 2017-09-28 12:42:25.418 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:25 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:25 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:25 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:25 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:25 ctl02 neutron-server[30536]: 2017-09-28 12:42:25.668 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:25 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:25 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:25 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:25 ctl02 neutron-server[30536]: 2017-09-28 12:42:25.668 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:25 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:25 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:25 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:25 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:25 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:25 ctl02 neutron-server[30536]: 2017-09-28 12:42:25.671 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:25 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:25 ctl02 neutron-server[30536]: 2017-09-28 12:42:25.672 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:25 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:25 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:25 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:25 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:25 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:42:25.711 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:42:25] "OPTIONS / HTTP/1.0" 200 134 0.000393
Sep 28 12:42:25 ctl02 heat-api[13008]: 2017-09-28 12:42:25.846 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:42:25] "OPTIONS / HTTP/1.0" 200 134 0.000593
Sep 28 12:42:25 ctl02 nova-api[6539]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:42:25 ctl02 nova-api[6539]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:42:25 ctl02 neutron-server[30536]: 2017-09-28 12:42:25.922 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:25 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:25 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:25 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:25 ctl02 neutron-server[30536]: 2017-09-28 12:42:25.922 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:25 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:25 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:25 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:25 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:25 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:25 ctl02 neutron-server[30536]: 2017-09-28 12:42:25.924 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:25 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:25 ctl02 neutron-server[30536]: 2017-09-28 12:42:25.924 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:25 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:25 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:25 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:25 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:26 ctl02 nova-api[6539]: 2017-09-28 12:42:26.038 6539 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:42:26 ctl02 nova-api[6539]: 2017-09-28 12:42:26.039 6539 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:42:26 ctl02 nova-api[6539]: 2017-09-28 12:42:26.039 6539 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:42:26 ctl02 nova-api[6539]: 2017-09-28 12:42:26.039 6539 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:42:26 ctl02 nova-api[6539]: 2017-09-28 12:42:26.039 6539 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:42:26 ctl02 nova-api[6539]: 2017-09-28 12:42:26.039 6539 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:42:26 ctl02 nova-api[6539]: 2017-09-28 12:42:26.039 6539 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:42:26 ctl02 nova-api[6539]: 2017-09-28 12:42:26.039 6539 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:42:26 ctl02 nova-api[6539]: 2017-09-28 12:42:26.039 6539 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:42:26 ctl02 nova-api[6539]: 2017-09-28 12:42:26.039 6539 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:42:26 ctl02 nova-api[6539]: 2017-09-28 12:42:26.039 6539 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:42:26 ctl02 nova-api[6539]: 2017-09-28 12:42:26.039 6539 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:42:26 ctl02 nova-api[6539]: 2017-09-28 12:42:26.039 6539 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:42:26 ctl02 nova-api[6539]: 2017-09-28 12:42:26.039 6539 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:42:26 ctl02 nova-api[6539]: 2017-09-28 12:42:26.039 6539 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:42:26 ctl02 nova-api[6539]: 2017-09-28 12:42:26.039 6539 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:42:26 ctl02 nova-api[6539]: 2017-09-28 12:42:26.039 6539 ERROR nova.wsgi     self.filename))
Sep 28 12:42:26 ctl02 nova-api[6539]: 2017-09-28 12:42:26.039 6539 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:42:26 ctl02 nova-api[6539]: 2017-09-28 12:42:26.039 6539 ERROR nova.wsgi
Sep 28 12:42:26 ctl02 nova-api[6539]: 2017-09-28 12:42:26.040 6539 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:42:26 ctl02 heat-engine[12803]: 2017-09-28 12:42:26.075 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:42:26 ctl02 heat-engine[12803]: 2017-09-28 12:42:26.080 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:42:26 ctl02 heat-engine[12803]: 2017-09-28 12:42:26.085 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:42:26 ctl02 heat-engine[12803]: 2017-09-28 12:42:26.087 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:42:26 ctl02 nova-api[6539]: 2017-09-28 12:42:26.175 6539 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:42:26 ctl02 neutron-server[30536]: 2017-09-28 12:42:26.177 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:26 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:26 ctl02 neutron-server[30536]: 2017-09-28 12:42:26.178 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:26 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:26 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:26 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:26 ctl02 neutron-server[30536]: 2017-09-28 12:42:26.178 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:26 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:26 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:26 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:26 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:26 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:26 ctl02 neutron-server[30536]: 2017-09-28 12:42:26.178 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:26 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:26 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:26 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:26 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:26 ctl02 nova-api[6539]: 2017-09-28 12:42:26.407 6539 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:42:26 ctl02 nova-api[6539]: 2017-09-28 12:42:26.409 6539 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:42:26 ctl02 nova-api[6539]: 2017-09-28 12:42:26.409 6539 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:42:26 ctl02 nova-api[6539]: 2017-09-28 12:42:26.410 6539 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:42:26 ctl02 neutron-server[30536]: 2017-09-28 12:42:26.432 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:26 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:26 ctl02 neutron-server[30536]: 2017-09-28 12:42:26.432 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:26 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:26 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:26 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:26 ctl02 neutron-server[30536]: 2017-09-28 12:42:26.432 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:26 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:26 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:26 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:26 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:26 ctl02 neutron-server[30536]: 2017-09-28 12:42:26.432 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:26 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:26 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:26 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:26 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:26 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:26 ctl02 nova-api[6539]: 2017-09-28 12:42:26.542 6539 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:42:26 ctl02 nova-api[6539]: 2017-09-28 12:42:26.544 6539 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:42:26 ctl02 nova-api[6539]: 2017-09-28 12:42:26.544 6539 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:42:26 ctl02 nova-api[6539]: 2017-09-28 12:42:26.544 6539 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:42:26 ctl02 nova-api[6539]: 2017-09-28 12:42:26.548 6539 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:42:26 ctl02 nova-api[6539]: 2017-09-28 12:42:26.548 6539 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:42:26 ctl02 nova-api[6539]: 2017-09-28 12:42:26.548 6539 ERROR nova Traceback (most recent call last):
Sep 28 12:42:26 ctl02 nova-api[6539]: 2017-09-28 12:42:26.548 6539 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:42:26 ctl02 nova-api[6539]: 2017-09-28 12:42:26.548 6539 ERROR nova     sys.exit(main())
Sep 28 12:42:26 ctl02 nova-api[6539]: 2017-09-28 12:42:26.548 6539 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:42:26 ctl02 nova-api[6539]: 2017-09-28 12:42:26.548 6539 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:42:26 ctl02 nova-api[6539]: 2017-09-28 12:42:26.548 6539 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:42:26 ctl02 nova-api[6539]: 2017-09-28 12:42:26.548 6539 ERROR nova     max_url_len=max_url_len)
Sep 28 12:42:26 ctl02 nova-api[6539]: 2017-09-28 12:42:26.548 6539 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:42:26 ctl02 nova-api[6539]: 2017-09-28 12:42:26.548 6539 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:42:26 ctl02 nova-api[6539]: 2017-09-28 12:42:26.548 6539 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:42:26 ctl02 nova-api[6539]: 2017-09-28 12:42:26.548 6539 ERROR nova     sock.listen(backlog)
Sep 28 12:42:26 ctl02 nova-api[6539]: 2017-09-28 12:42:26.548 6539 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:42:26 ctl02 nova-api[6539]: 2017-09-28 12:42:26.548 6539 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:42:26 ctl02 nova-api[6539]: 2017-09-28 12:42:26.548 6539 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:42:26 ctl02 nova-api[6539]: 2017-09-28 12:42:26.548 6539 ERROR nova
Sep 28 12:42:26 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:42:26 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:42:26 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:42:26 ctl02 neutron-server[30536]: 2017-09-28 12:42:26.685 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:26 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:26 ctl02 neutron-server[30536]: 2017-09-28 12:42:26.685 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:26 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:26 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:26 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:26 ctl02 neutron-server[30536]: 2017-09-28 12:42:26.686 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:26 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:26 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:26 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:26 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:26 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:26 ctl02 neutron-server[30536]: 2017-09-28 12:42:26.686 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:26 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:26 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:26 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:26 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:26 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:42:26 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:42:26 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:42:26 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:42:26 ctl02 neutron-server[30536]: 2017-09-28 12:42:26.939 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:26 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:26 ctl02 neutron-server[30536]: 2017-09-28 12:42:26.939 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:26 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:26 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:26 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:26 ctl02 neutron-server[30536]: 2017-09-28 12:42:26.940 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:26 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:26 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:26 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:26 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:26 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:26 ctl02 neutron-server[30536]: 2017-09-28 12:42:26.942 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:26 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:26 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:26 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:26 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:27 ctl02 heat-api[13008]: 2017-09-28 12:42:27.193 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:42:27] "OPTIONS / HTTP/1.0" 200 134 0.000573
Sep 28 12:42:27 ctl02 neutron-server[30536]: 2017-09-28 12:42:27.193 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:27 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:27 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:27 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:27 ctl02 neutron-server[30536]: 2017-09-28 12:42:27.194 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:27 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:27 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:27 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:27 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:27 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:27 ctl02 neutron-server[30536]: 2017-09-28 12:42:27.196 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:27 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:27 ctl02 neutron-server[30536]: 2017-09-28 12:42:27.197 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:27 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:27 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:27 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:27 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:27 ctl02 neutron-server[30536]: 2017-09-28 12:42:27.448 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:27 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:27 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:27 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:27 ctl02 neutron-server[30536]: 2017-09-28 12:42:27.448 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:27 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:27 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:27 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:27 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:27 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:27 ctl02 neutron-server[30536]: 2017-09-28 12:42:27.451 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:27 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:27 ctl02 neutron-server[30536]: 2017-09-28 12:42:27.452 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:27 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:27 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:27 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:27 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:27 ctl02 nova-scheduler[5620]: 2017-09-28 12:42:27.525 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:42:27 ctl02 neutron-server[30536]: 2017-09-28 12:42:27.702 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:42:27 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:42:27 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:42:27 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:42:27 ctl02 neutron-server[30536]: 2017-09-28 12:42:27.702 30536 ERROR oslo_messaging._drivers.common [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:42:27 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:42:27 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:42:27 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:42:27 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:42:27 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:42:27 ctl02 neutron-server[30536]: 2017-09-28 12:42:27.705 30536 WARNING oslo_messaging._drivers.amqpdriver [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] reply_692b03e6d8d44d758b6be19b067c3aa3 doesn't exists, drop reply to 8c2db15bc40d4c5ab550fe45eb6e272a
Sep 28 12:42:27 ctl02 neutron-server[30536]: 2017-09-28 12:42:27.705 30536 INFO oslo_messaging._drivers.amqpdriver [req-6271a64f-642d-4dff-8cbc-3a282a26cd2d - - - - -] The reply 8c2db15bc40d4c5ab550fe45eb6e272a cannot be sent  reply_692b03e6d8d44d758b6be19b067c3aa3 reply queue don't exist after 60 sec abandoning...
Sep 28 12:42:27 ctl02 neutron-server[30536]: 2017-09-28 12:42:27.705 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:27 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:27 ctl02 neutron-server[30536]: 2017-09-28 12:42:27.706 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:27 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:27 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:27 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:27 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:27 ctl02 neutron-server[30536]: 2017-09-28 12:42:27.960 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:27 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:27 ctl02 neutron-server[30536]: 2017-09-28 12:42:27.961 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:27 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:27 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:27 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:27 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:28 ctl02 neutron-server[30536]: 2017-09-28 12:42:28.215 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:28 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:28 ctl02 neutron-server[30536]: 2017-09-28 12:42:28.216 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:28 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:28 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:28 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:28 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:28 ctl02 neutron-server[30536]: 2017-09-28 12:42:28.471 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:28 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:28 ctl02 neutron-server[30536]: 2017-09-28 12:42:28.473 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:28 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:28 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:28 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:28 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:28 ctl02 neutron-server[30536]: 2017-09-28 12:42:28.480 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:42:28 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:42:28.486 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:42:28] "OPTIONS / HTTP/1.0" 200 134 0.000387
Sep 28 12:42:28 ctl02 nova-api[6556]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:42:28 ctl02 nova-api[6556]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:42:28 ctl02 heat-api[13008]: 2017-09-28 12:42:28.721 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:42:28] "OPTIONS / HTTP/1.0" 200 134 0.000566
Sep 28 12:42:28 ctl02 neutron-server[30536]: 2017-09-28 12:42:28.728 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:28 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:28 ctl02 neutron-server[30536]: 2017-09-28 12:42:28.728 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:28 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:28 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:28 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:28 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:28 ctl02 nova-api[6556]: 2017-09-28 12:42:28.745 6556 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:42:28 ctl02 nova-api[6556]: 2017-09-28 12:42:28.746 6556 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:42:28 ctl02 nova-api[6556]: 2017-09-28 12:42:28.746 6556 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:42:28 ctl02 nova-api[6556]: 2017-09-28 12:42:28.746 6556 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:42:28 ctl02 nova-api[6556]: 2017-09-28 12:42:28.746 6556 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:42:28 ctl02 nova-api[6556]: 2017-09-28 12:42:28.746 6556 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:42:28 ctl02 nova-api[6556]: 2017-09-28 12:42:28.746 6556 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:42:28 ctl02 nova-api[6556]: 2017-09-28 12:42:28.746 6556 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:42:28 ctl02 nova-api[6556]: 2017-09-28 12:42:28.746 6556 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:42:28 ctl02 nova-api[6556]: 2017-09-28 12:42:28.746 6556 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:42:28 ctl02 nova-api[6556]: 2017-09-28 12:42:28.746 6556 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:42:28 ctl02 nova-api[6556]: 2017-09-28 12:42:28.746 6556 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:42:28 ctl02 nova-api[6556]: 2017-09-28 12:42:28.746 6556 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:42:28 ctl02 nova-api[6556]: 2017-09-28 12:42:28.746 6556 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:42:28 ctl02 nova-api[6556]: 2017-09-28 12:42:28.746 6556 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:42:28 ctl02 nova-api[6556]: 2017-09-28 12:42:28.746 6556 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:42:28 ctl02 nova-api[6556]: 2017-09-28 12:42:28.746 6556 ERROR nova.wsgi     self.filename))
Sep 28 12:42:28 ctl02 nova-api[6556]: 2017-09-28 12:42:28.746 6556 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:42:28 ctl02 nova-api[6556]: 2017-09-28 12:42:28.746 6556 ERROR nova.wsgi
Sep 28 12:42:28 ctl02 nova-api[6556]: 2017-09-28 12:42:28.747 6556 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:42:28 ctl02 nova-api[6556]: 2017-09-28 12:42:28.879 6556 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:42:28 ctl02 neutron-server[30536]: 2017-09-28 12:42:28.981 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:28 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:28 ctl02 neutron-server[30536]: 2017-09-28 12:42:28.988 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:28 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:28 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:28 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:28 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:29 ctl02 heat-api-cfn[13300]: 2017-09-28 12:42:29.051 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:42:29] "OPTIONS / HTTP/1.0" 200 134 0.000477
Sep 28 12:42:29 ctl02 nova-api[6556]: 2017-09-28 12:42:29.113 6556 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:42:29 ctl02 nova-api[6556]: 2017-09-28 12:42:29.115 6556 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:42:29 ctl02 nova-api[6556]: 2017-09-28 12:42:29.116 6556 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:42:29 ctl02 nova-api[6556]: 2017-09-28 12:42:29.116 6556 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:42:29 ctl02 neutron-server[30536]: 2017-09-28 12:42:29.242 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:29 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:29 ctl02 neutron-server[30536]: 2017-09-28 12:42:29.242 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:29 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:29 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:29 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:29 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:29 ctl02 nova-api[6556]: 2017-09-28 12:42:29.251 6556 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:42:29 ctl02 nova-api[6556]: 2017-09-28 12:42:29.253 6556 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:42:29 ctl02 nova-api[6556]: 2017-09-28 12:42:29.253 6556 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:42:29 ctl02 nova-api[6556]: 2017-09-28 12:42:29.253 6556 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:42:29 ctl02 nova-api[6556]: 2017-09-28 12:42:29.257 6556 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:42:29 ctl02 nova-api[6556]: 2017-09-28 12:42:29.257 6556 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:42:29 ctl02 nova-api[6556]: 2017-09-28 12:42:29.257 6556 ERROR nova Traceback (most recent call last):
Sep 28 12:42:29 ctl02 nova-api[6556]: 2017-09-28 12:42:29.257 6556 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:42:29 ctl02 nova-api[6556]: 2017-09-28 12:42:29.257 6556 ERROR nova     sys.exit(main())
Sep 28 12:42:29 ctl02 nova-api[6556]: 2017-09-28 12:42:29.257 6556 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:42:29 ctl02 nova-api[6556]: 2017-09-28 12:42:29.257 6556 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:42:29 ctl02 nova-api[6556]: 2017-09-28 12:42:29.257 6556 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:42:29 ctl02 nova-api[6556]: 2017-09-28 12:42:29.257 6556 ERROR nova     max_url_len=max_url_len)
Sep 28 12:42:29 ctl02 nova-api[6556]: 2017-09-28 12:42:29.257 6556 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:42:29 ctl02 nova-api[6556]: 2017-09-28 12:42:29.257 6556 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:42:29 ctl02 nova-api[6556]: 2017-09-28 12:42:29.257 6556 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:42:29 ctl02 nova-api[6556]: 2017-09-28 12:42:29.257 6556 ERROR nova     sock.listen(backlog)
Sep 28 12:42:29 ctl02 nova-api[6556]: 2017-09-28 12:42:29.257 6556 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:42:29 ctl02 nova-api[6556]: 2017-09-28 12:42:29.257 6556 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:42:29 ctl02 nova-api[6556]: 2017-09-28 12:42:29.257 6556 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:42:29 ctl02 nova-api[6556]: 2017-09-28 12:42:29.257 6556 ERROR nova
Sep 28 12:42:29 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:42:29 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:42:29 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:42:29 ctl02 heat-api-cfn[13300]: 2017-09-28 12:42:29.444 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:42:29] "OPTIONS / HTTP/1.0" 200 134 0.000499
Sep 28 12:42:29 ctl02 neutron-server[30536]: 2017-09-28 12:42:29.495 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:29 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:29 ctl02 neutron-server[30536]: 2017-09-28 12:42:29.496 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:29 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:29 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:29 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:29 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:29 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:42:29 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:42:29 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:42:29 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:42:29 ctl02 neutron-server[30536]: 2017-09-28 12:42:29.749 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:29 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:29 ctl02 neutron-server[30536]: 2017-09-28 12:42:29.750 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:29 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:29 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:29 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:29 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:29 ctl02 neutron-server[30536]: 2017-09-28 12:42:29.767 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:42:29] "OPTIONS / HTTP/1.0" 200 262 0.000499
Sep 28 12:42:30 ctl02 neutron-server[30536]: 2017-09-28 12:42:30.003 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:30 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:30 ctl02 neutron-server[30536]: 2017-09-28 12:42:30.003 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:30 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:30 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:30 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:30 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:30 ctl02 neutron-server[30536]: 2017-09-28 12:42:30.257 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:30 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:30 ctl02 neutron-server[30536]: 2017-09-28 12:42:30.257 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:30 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:30 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:30 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:30 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:30 ctl02 neutron-server[30536]: 2017-09-28 12:42:30.511 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:30 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:30 ctl02 neutron-server[30536]: 2017-09-28 12:42:30.511 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:30 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:30 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:30 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:30 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:30 ctl02 neutron-server[30536]: 2017-09-28 12:42:30.528 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:42:30] "OPTIONS / HTTP/1.0" 200 262 0.000471
Sep 28 12:42:30 ctl02 neutron-server[30536]: 2017-09-28 12:42:30.764 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:30 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:30 ctl02 neutron-server[30536]: 2017-09-28 12:42:30.764 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:30 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:30 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:30 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:30 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:30 ctl02 glance-api[29183]: 2017-09-28 12:42:30.823 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:42:30] "OPTIONS / HTTP/1.0" 200 134 0.000620
Sep 28 12:42:30 ctl02 glance-api[29183]: 2017-09-28 12:42:30.973 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:42:30] "OPTIONS / HTTP/1.0" 200 134 0.000476
Sep 28 12:42:31 ctl02 neutron-server[30536]: 2017-09-28 12:42:31.017 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:31 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:31 ctl02 neutron-server[30536]: 2017-09-28 12:42:31.018 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:31 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:31 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:31 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:31 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:31 ctl02 neutron-server[30536]: 2017-09-28 12:42:31.150 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:42:31] "OPTIONS / HTTP/1.0" 200 262 0.000485
Sep 28 12:42:31 ctl02 neutron-server[30536]: 2017-09-28 12:42:31.271 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:31 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:31 ctl02 neutron-server[30536]: 2017-09-28 12:42:31.271 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:31 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:31 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:31 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:31 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:31 ctl02 nova-api[6574]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:42:31 ctl02 nova-api[6574]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:42:31 ctl02 nova-api[6574]: 2017-09-28 12:42:31.480 6574 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:42:31 ctl02 nova-api[6574]: 2017-09-28 12:42:31.481 6574 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:42:31 ctl02 nova-api[6574]: 2017-09-28 12:42:31.481 6574 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:42:31 ctl02 nova-api[6574]: 2017-09-28 12:42:31.481 6574 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:42:31 ctl02 nova-api[6574]: 2017-09-28 12:42:31.481 6574 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:42:31 ctl02 nova-api[6574]: 2017-09-28 12:42:31.481 6574 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:42:31 ctl02 nova-api[6574]: 2017-09-28 12:42:31.481 6574 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:42:31 ctl02 nova-api[6574]: 2017-09-28 12:42:31.481 6574 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:42:31 ctl02 nova-api[6574]: 2017-09-28 12:42:31.481 6574 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:42:31 ctl02 nova-api[6574]: 2017-09-28 12:42:31.481 6574 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:42:31 ctl02 nova-api[6574]: 2017-09-28 12:42:31.481 6574 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:42:31 ctl02 nova-api[6574]: 2017-09-28 12:42:31.481 6574 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:42:31 ctl02 nova-api[6574]: 2017-09-28 12:42:31.481 6574 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:42:31 ctl02 nova-api[6574]: 2017-09-28 12:42:31.481 6574 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:42:31 ctl02 nova-api[6574]: 2017-09-28 12:42:31.481 6574 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:42:31 ctl02 nova-api[6574]: 2017-09-28 12:42:31.481 6574 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:42:31 ctl02 nova-api[6574]: 2017-09-28 12:42:31.481 6574 ERROR nova.wsgi     self.filename))
Sep 28 12:42:31 ctl02 nova-api[6574]: 2017-09-28 12:42:31.481 6574 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:42:31 ctl02 nova-api[6574]: 2017-09-28 12:42:31.481 6574 ERROR nova.wsgi
Sep 28 12:42:31 ctl02 nova-api[6574]: 2017-09-28 12:42:31.482 6574 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:42:31 ctl02 neutron-server[30536]: 2017-09-28 12:42:31.524 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:31 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:31 ctl02 neutron-server[30536]: 2017-09-28 12:42:31.525 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:31 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:31 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:31 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:31 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:31 ctl02 nova-api[6574]: 2017-09-28 12:42:31.613 6574 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:42:31 ctl02 neutron-server[30536]: 2017-09-28 12:42:31.778 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:31 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:31 ctl02 neutron-server[30536]: 2017-09-28 12:42:31.778 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:31 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:31 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:31 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:31 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:31 ctl02 nova-api[6574]: 2017-09-28 12:42:31.848 6574 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:42:31 ctl02 nova-api[6574]: 2017-09-28 12:42:31.850 6574 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:42:31 ctl02 nova-api[6574]: 2017-09-28 12:42:31.850 6574 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:42:31 ctl02 nova-api[6574]: 2017-09-28 12:42:31.850 6574 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:42:31 ctl02 nova-api[6574]: 2017-09-28 12:42:31.982 6574 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:42:31 ctl02 nova-api[6574]: 2017-09-28 12:42:31.984 6574 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:42:31 ctl02 nova-api[6574]: 2017-09-28 12:42:31.984 6574 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:42:31 ctl02 nova-api[6574]: 2017-09-28 12:42:31.984 6574 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:42:31 ctl02 nova-api[6574]: 2017-09-28 12:42:31.987 6574 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:42:31 ctl02 nova-api[6574]: 2017-09-28 12:42:31.988 6574 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:42:31 ctl02 nova-api[6574]: 2017-09-28 12:42:31.988 6574 ERROR nova Traceback (most recent call last):
Sep 28 12:42:31 ctl02 nova-api[6574]: 2017-09-28 12:42:31.988 6574 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:42:31 ctl02 nova-api[6574]: 2017-09-28 12:42:31.988 6574 ERROR nova     sys.exit(main())
Sep 28 12:42:31 ctl02 nova-api[6574]: 2017-09-28 12:42:31.988 6574 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:42:31 ctl02 nova-api[6574]: 2017-09-28 12:42:31.988 6574 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:42:31 ctl02 nova-api[6574]: 2017-09-28 12:42:31.988 6574 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:42:31 ctl02 nova-api[6574]: 2017-09-28 12:42:31.988 6574 ERROR nova     max_url_len=max_url_len)
Sep 28 12:42:31 ctl02 nova-api[6574]: 2017-09-28 12:42:31.988 6574 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:42:31 ctl02 nova-api[6574]: 2017-09-28 12:42:31.988 6574 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:42:31 ctl02 nova-api[6574]: 2017-09-28 12:42:31.988 6574 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:42:31 ctl02 nova-api[6574]: 2017-09-28 12:42:31.988 6574 ERROR nova     sock.listen(backlog)
Sep 28 12:42:31 ctl02 nova-api[6574]: 2017-09-28 12:42:31.988 6574 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:42:31 ctl02 nova-api[6574]: 2017-09-28 12:42:31.988 6574 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:42:31 ctl02 nova-api[6574]: 2017-09-28 12:42:31.988 6574 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:42:31 ctl02 nova-api[6574]: 2017-09-28 12:42:31.988 6574 ERROR nova
Sep 28 12:42:32 ctl02 neutron-server[30536]: 2017-09-28 12:42:32.031 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:32 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:32 ctl02 neutron-server[30536]: 2017-09-28 12:42:32.032 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:32 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:32 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:32 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:32 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:32 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:42:32 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:42:32 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:42:32 ctl02 neutron-server[30536]: 2017-09-28 12:42:32.285 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:32 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:32 ctl02 neutron-server[30536]: 2017-09-28 12:42:32.286 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:32 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:32 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:32 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:32 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:32 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:42:32 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:42:32 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:42:32 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:42:32 ctl02 neutron-server[30536]: 2017-09-28 12:42:32.539 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:32 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:32 ctl02 neutron-server[30536]: 2017-09-28 12:42:32.539 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:32 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:32 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:32 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:32 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:32 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:42:32.608 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:42:32] "OPTIONS / HTTP/1.0" 200 134 0.000413
Sep 28 12:42:32 ctl02 glance-api[29183]: 2017-09-28 12:42:32.781 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:42:32] "OPTIONS / HTTP/1.0" 200 134 0.000606
Sep 28 12:42:32 ctl02 neutron-server[30536]: 2017-09-28 12:42:32.792 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:32 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:32 ctl02 neutron-server[30536]: 2017-09-28 12:42:32.793 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:32 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:32 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:32 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:32 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:33 ctl02 neutron-server[30536]: 2017-09-28 12:42:33.046 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:33 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:33 ctl02 neutron-server[30536]: 2017-09-28 12:42:33.046 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:33 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:33 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:33 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:33 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:33 ctl02 heat-api-cfn[13300]: 2017-09-28 12:42:33.221 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:42:33] "OPTIONS / HTTP/1.0" 200 134 0.000493
Sep 28 12:42:33 ctl02 neutron-server[30536]: 2017-09-28 12:42:33.299 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:33 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:33 ctl02 neutron-server[30536]: 2017-09-28 12:42:33.300 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:33 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:33 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:33 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:33 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:33 ctl02 neutron-server[30536]: 2017-09-28 12:42:33.552 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:33 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:33 ctl02 neutron-server[30536]: 2017-09-28 12:42:33.553 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:33 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:33 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:33 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:33 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:33 ctl02 neutron-server[30536]: 2017-09-28 12:42:33.806 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:33 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:33 ctl02 neutron-server[30536]: 2017-09-28 12:42:33.806 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:33 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:33 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:33 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:33 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:34 ctl02 neutron-server[30536]: 2017-09-28 12:42:34.059 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:34 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:34 ctl02 neutron-server[30536]: 2017-09-28 12:42:34.067 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:34 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:34 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:34 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:34 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:34 ctl02 nova-api[6592]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:42:34 ctl02 nova-api[6592]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:42:34 ctl02 nova-api[6592]: 2017-09-28 12:42:34.264 6592 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:42:34 ctl02 nova-api[6592]: 2017-09-28 12:42:34.265 6592 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:42:34 ctl02 nova-api[6592]: 2017-09-28 12:42:34.265 6592 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:42:34 ctl02 nova-api[6592]: 2017-09-28 12:42:34.265 6592 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:42:34 ctl02 nova-api[6592]: 2017-09-28 12:42:34.265 6592 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:42:34 ctl02 nova-api[6592]: 2017-09-28 12:42:34.265 6592 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:42:34 ctl02 nova-api[6592]: 2017-09-28 12:42:34.265 6592 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:42:34 ctl02 nova-api[6592]: 2017-09-28 12:42:34.265 6592 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:42:34 ctl02 nova-api[6592]: 2017-09-28 12:42:34.265 6592 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:42:34 ctl02 nova-api[6592]: 2017-09-28 12:42:34.265 6592 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:42:34 ctl02 nova-api[6592]: 2017-09-28 12:42:34.265 6592 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:42:34 ctl02 nova-api[6592]: 2017-09-28 12:42:34.265 6592 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:42:34 ctl02 nova-api[6592]: 2017-09-28 12:42:34.265 6592 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:42:34 ctl02 nova-api[6592]: 2017-09-28 12:42:34.265 6592 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:42:34 ctl02 nova-api[6592]: 2017-09-28 12:42:34.265 6592 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:42:34 ctl02 nova-api[6592]: 2017-09-28 12:42:34.265 6592 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:42:34 ctl02 nova-api[6592]: 2017-09-28 12:42:34.265 6592 ERROR nova.wsgi     self.filename))
Sep 28 12:42:34 ctl02 nova-api[6592]: 2017-09-28 12:42:34.265 6592 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:42:34 ctl02 nova-api[6592]: 2017-09-28 12:42:34.265 6592 ERROR nova.wsgi
Sep 28 12:42:34 ctl02 nova-api[6592]: 2017-09-28 12:42:34.267 6592 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:42:34 ctl02 neutron-server[30536]: 2017-09-28 12:42:34.320 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:34 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:34 ctl02 neutron-server[30536]: 2017-09-28 12:42:34.320 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:34 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:34 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:34 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:34 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:34 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xca900425)
Sep 28 12:42:34 ctl02 nova-api[6592]: 2017-09-28 12:42:34.399 6592 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:42:34 ctl02 neutron-server[30536]: 2017-09-28 12:42:34.574 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:34 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:34 ctl02 neutron-server[30536]: 2017-09-28 12:42:34.576 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:34 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:34 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:34 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:34 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:34 ctl02 nova-api[6592]: 2017-09-28 12:42:34.633 6592 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:42:34 ctl02 nova-api[6592]: 2017-09-28 12:42:34.635 6592 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:42:34 ctl02 nova-api[6592]: 2017-09-28 12:42:34.635 6592 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:42:34 ctl02 nova-api[6592]: 2017-09-28 12:42:34.636 6592 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:42:34 ctl02 nova-api[6592]: 2017-09-28 12:42:34.766 6592 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:42:34 ctl02 nova-api[6592]: 2017-09-28 12:42:34.768 6592 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:42:34 ctl02 nova-api[6592]: 2017-09-28 12:42:34.768 6592 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:42:34 ctl02 nova-api[6592]: 2017-09-28 12:42:34.769 6592 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:42:34 ctl02 nova-api[6592]: 2017-09-28 12:42:34.772 6592 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:42:34 ctl02 nova-api[6592]: 2017-09-28 12:42:34.772 6592 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:42:34 ctl02 nova-api[6592]: 2017-09-28 12:42:34.772 6592 ERROR nova Traceback (most recent call last):
Sep 28 12:42:34 ctl02 nova-api[6592]: 2017-09-28 12:42:34.772 6592 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:42:34 ctl02 nova-api[6592]: 2017-09-28 12:42:34.772 6592 ERROR nova     sys.exit(main())
Sep 28 12:42:34 ctl02 nova-api[6592]: 2017-09-28 12:42:34.772 6592 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:42:34 ctl02 nova-api[6592]: 2017-09-28 12:42:34.772 6592 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:42:34 ctl02 nova-api[6592]: 2017-09-28 12:42:34.772 6592 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:42:34 ctl02 nova-api[6592]: 2017-09-28 12:42:34.772 6592 ERROR nova     max_url_len=max_url_len)
Sep 28 12:42:34 ctl02 nova-api[6592]: 2017-09-28 12:42:34.772 6592 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:42:34 ctl02 nova-api[6592]: 2017-09-28 12:42:34.772 6592 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:42:34 ctl02 nova-api[6592]: 2017-09-28 12:42:34.772 6592 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:42:34 ctl02 nova-api[6592]: 2017-09-28 12:42:34.772 6592 ERROR nova     sock.listen(backlog)
Sep 28 12:42:34 ctl02 nova-api[6592]: 2017-09-28 12:42:34.772 6592 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:42:34 ctl02 nova-api[6592]: 2017-09-28 12:42:34.772 6592 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:42:34 ctl02 nova-api[6592]: 2017-09-28 12:42:34.772 6592 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:42:34 ctl02 nova-api[6592]: 2017-09-28 12:42:34.772 6592 ERROR nova
Sep 28 12:42:34 ctl02 neutron-server[30536]: 2017-09-28 12:42:34.829 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:34 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:34 ctl02 neutron-server[30536]: 2017-09-28 12:42:34.830 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:34 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:34 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:34 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:34 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:34 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:42:34 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:42:34 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:42:35 ctl02 neutron-server[30536]: 2017-09-28 12:42:35.083 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:35 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:35 ctl02 neutron-server[30536]: 2017-09-28 12:42:35.084 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:35 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:35 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:35 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:35 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:35 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:42:35 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:42:35 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:42:35 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:42:35 ctl02 neutron-server[30536]: 2017-09-28 12:42:35.337 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:35 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:35 ctl02 neutron-server[30536]: 2017-09-28 12:42:35.338 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:35 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:35 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:35 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:35 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:35 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xca900425)
Sep 28 12:42:35 ctl02 neutron-server[30536]: 2017-09-28 12:42:35.591 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:35 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:35 ctl02 neutron-server[30536]: 2017-09-28 12:42:35.592 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:35 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:35 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:35 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:35 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:35 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:42:35.682 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:42:35] "OPTIONS / HTTP/1.0" 200 134 0.000446
Sep 28 12:42:35 ctl02 neutron-server[30536]: 2017-09-28 12:42:35.847 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:35 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:35 ctl02 neutron-server[30536]: 2017-09-28 12:42:35.847 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:35 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:35 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:35 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:35 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:36 ctl02 heat-api[13008]: 2017-09-28 12:42:36.082 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:42:36] "OPTIONS / HTTP/1.0" 200 134 0.000540
Sep 28 12:42:36 ctl02 neutron-server[30536]: 2017-09-28 12:42:36.099 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:36 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:36 ctl02 neutron-server[30536]: 2017-09-28 12:42:36.100 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:36 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:36 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:36 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:36 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:36 ctl02 neutron-server[30536]: 2017-09-28 12:42:36.285 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 4 dead agents out of 6:
Sep 28 12:42:36 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:42:36 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:40:56 cmp002
Sep 28 12:42:36 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:41:28 cmp001
Sep 28 12:42:36 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:41:20 cmp002
Sep 28 12:42:36 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:41:16 cmp002
Sep 28 12:42:36 ctl02 neutron-server[30536]: 2017-09-28 12:42:36.353 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 12:42:36 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 12:42:36 ctl02 neutron-server[30536]: 2017-09-28 12:42:36.354 30601 ERROR oslo_messaging._drivers.common [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 12:42:36 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 12:42:36 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 12:42:36 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 12:42:36 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 12:42:36 ctl02 neutron-server[30536]: 2017-09-28 12:42:36.357 30601 WARNING oslo_messaging._drivers.amqpdriver [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] reply_a13a20a54b91453780e36bdf20a855d2 doesn't exists, drop reply to e5722a3e2adc48e2a51edea568e6be14
Sep 28 12:42:36 ctl02 neutron-server[30536]: 2017-09-28 12:42:36.358 30601 INFO oslo_messaging._drivers.amqpdriver [req-55b7e682-ecc9-4291-8622-9e5f80589793 - - - - -] The reply e5722a3e2adc48e2a51edea568e6be14 cannot be sent  reply_a13a20a54b91453780e36bdf20a855d2 reply queue don't exist after 60 sec abandoning...
Sep 28 12:42:36 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xca900425)
Sep 28 12:42:36 ctl02 nova-api[6610]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:42:36 ctl02 nova-api[6610]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:42:36 ctl02 nova-api[6610]: 2017-09-28 12:42:36.988 6610 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:42:36 ctl02 nova-api[6610]: 2017-09-28 12:42:36.990 6610 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:42:36 ctl02 nova-api[6610]: 2017-09-28 12:42:36.990 6610 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:42:36 ctl02 nova-api[6610]: 2017-09-28 12:42:36.990 6610 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:42:36 ctl02 nova-api[6610]: 2017-09-28 12:42:36.990 6610 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:42:36 ctl02 nova-api[6610]: 2017-09-28 12:42:36.990 6610 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:42:36 ctl02 nova-api[6610]: 2017-09-28 12:42:36.990 6610 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:42:36 ctl02 nova-api[6610]: 2017-09-28 12:42:36.990 6610 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:42:36 ctl02 nova-api[6610]: 2017-09-28 12:42:36.990 6610 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:42:36 ctl02 nova-api[6610]: 2017-09-28 12:42:36.990 6610 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:42:36 ctl02 nova-api[6610]: 2017-09-28 12:42:36.990 6610 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:42:36 ctl02 nova-api[6610]: 2017-09-28 12:42:36.990 6610 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:42:36 ctl02 nova-api[6610]: 2017-09-28 12:42:36.990 6610 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:42:36 ctl02 nova-api[6610]: 2017-09-28 12:42:36.990 6610 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:42:36 ctl02 nova-api[6610]: 2017-09-28 12:42:36.990 6610 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:42:36 ctl02 nova-api[6610]: 2017-09-28 12:42:36.990 6610 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:42:36 ctl02 nova-api[6610]: 2017-09-28 12:42:36.990 6610 ERROR nova.wsgi     self.filename))
Sep 28 12:42:36 ctl02 nova-api[6610]: 2017-09-28 12:42:36.990 6610 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:42:36 ctl02 nova-api[6610]: 2017-09-28 12:42:36.990 6610 ERROR nova.wsgi
Sep 28 12:42:36 ctl02 nova-api[6610]: 2017-09-28 12:42:36.991 6610 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:42:37 ctl02 nova-api[6610]: 2017-09-28 12:42:37.119 6610 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:42:37 ctl02 heat-api[13008]: 2017-09-28 12:42:37.212 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:42:37] "OPTIONS / HTTP/1.0" 200 134 0.000542
Sep 28 12:42:37 ctl02 nova-api[6610]: 2017-09-28 12:42:37.339 6610 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:42:37 ctl02 nova-api[6610]: 2017-09-28 12:42:37.341 6610 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:42:37 ctl02 nova-api[6610]: 2017-09-28 12:42:37.341 6610 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:42:37 ctl02 nova-api[6610]: 2017-09-28 12:42:37.342 6610 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:42:37 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xca900425)
Sep 28 12:42:37 ctl02 nova-api[6610]: 2017-09-28 12:42:37.475 6610 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:42:37 ctl02 nova-api[6610]: 2017-09-28 12:42:37.477 6610 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:42:37 ctl02 nova-api[6610]: 2017-09-28 12:42:37.477 6610 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:42:37 ctl02 nova-api[6610]: 2017-09-28 12:42:37.477 6610 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:42:37 ctl02 nova-api[6610]: 2017-09-28 12:42:37.480 6610 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:42:37 ctl02 nova-api[6610]: 2017-09-28 12:42:37.481 6610 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:42:37 ctl02 nova-api[6610]: 2017-09-28 12:42:37.481 6610 ERROR nova Traceback (most recent call last):
Sep 28 12:42:37 ctl02 nova-api[6610]: 2017-09-28 12:42:37.481 6610 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:42:37 ctl02 nova-api[6610]: 2017-09-28 12:42:37.481 6610 ERROR nova     sys.exit(main())
Sep 28 12:42:37 ctl02 nova-api[6610]: 2017-09-28 12:42:37.481 6610 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:42:37 ctl02 nova-api[6610]: 2017-09-28 12:42:37.481 6610 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:42:37 ctl02 nova-api[6610]: 2017-09-28 12:42:37.481 6610 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:42:37 ctl02 nova-api[6610]: 2017-09-28 12:42:37.481 6610 ERROR nova     max_url_len=max_url_len)
Sep 28 12:42:37 ctl02 nova-api[6610]: 2017-09-28 12:42:37.481 6610 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:42:37 ctl02 nova-api[6610]: 2017-09-28 12:42:37.481 6610 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:42:37 ctl02 nova-api[6610]: 2017-09-28 12:42:37.481 6610 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:42:37 ctl02 nova-api[6610]: 2017-09-28 12:42:37.481 6610 ERROR nova     sock.listen(backlog)
Sep 28 12:42:37 ctl02 nova-api[6610]: 2017-09-28 12:42:37.481 6610 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:42:37 ctl02 nova-api[6610]: 2017-09-28 12:42:37.481 6610 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:42:37 ctl02 nova-api[6610]: 2017-09-28 12:42:37.481 6610 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:42:37 ctl02 nova-api[6610]: 2017-09-28 12:42:37.481 6610 ERROR nova
Sep 28 12:42:37 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:42:37 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:42:37 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:42:37 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:42:37 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:42:37 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:42:37 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:42:38 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xca900425)
Sep 28 12:42:38 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:42:38.757 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:42:38] "OPTIONS / HTTP/1.0" 200 134 0.000366
Sep 28 12:42:39 ctl02 heat-api[13008]: 2017-09-28 12:42:39.106 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:42:39] "OPTIONS / HTTP/1.0" 200 134 0.000525
Sep 28 12:42:39 ctl02 heat-api-cfn[13300]: 2017-09-28 12:42:39.372 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:42:39] "OPTIONS / HTTP/1.0" 200 134 0.000438
Sep 28 12:42:39 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xca900425)
Sep 28 12:42:39 ctl02 nova-api[6629]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:42:39 ctl02 nova-api[6629]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:42:39 ctl02 nova-api[6629]: 2017-09-28 12:42:39.732 6629 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:42:39 ctl02 nova-api[6629]: 2017-09-28 12:42:39.734 6629 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:42:39 ctl02 nova-api[6629]: 2017-09-28 12:42:39.734 6629 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:42:39 ctl02 nova-api[6629]: 2017-09-28 12:42:39.734 6629 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:42:39 ctl02 nova-api[6629]: 2017-09-28 12:42:39.734 6629 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:42:39 ctl02 nova-api[6629]: 2017-09-28 12:42:39.734 6629 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:42:39 ctl02 nova-api[6629]: 2017-09-28 12:42:39.734 6629 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:42:39 ctl02 nova-api[6629]: 2017-09-28 12:42:39.734 6629 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:42:39 ctl02 nova-api[6629]: 2017-09-28 12:42:39.734 6629 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:42:39 ctl02 nova-api[6629]: 2017-09-28 12:42:39.734 6629 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:42:39 ctl02 nova-api[6629]: 2017-09-28 12:42:39.734 6629 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:42:39 ctl02 nova-api[6629]: 2017-09-28 12:42:39.734 6629 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:42:39 ctl02 nova-api[6629]: 2017-09-28 12:42:39.734 6629 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:42:39 ctl02 nova-api[6629]: 2017-09-28 12:42:39.734 6629 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:42:39 ctl02 nova-api[6629]: 2017-09-28 12:42:39.734 6629 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:42:39 ctl02 nova-api[6629]: 2017-09-28 12:42:39.734 6629 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:42:39 ctl02 nova-api[6629]: 2017-09-28 12:42:39.734 6629 ERROR nova.wsgi     self.filename))
Sep 28 12:42:39 ctl02 nova-api[6629]: 2017-09-28 12:42:39.734 6629 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:42:39 ctl02 nova-api[6629]: 2017-09-28 12:42:39.734 6629 ERROR nova.wsgi
Sep 28 12:42:39 ctl02 nova-api[6629]: 2017-09-28 12:42:39.735 6629 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:42:39 ctl02 heat-api-cfn[13300]: 2017-09-28 12:42:39.788 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:42:39] "OPTIONS / HTTP/1.0" 200 134 0.000477
Sep 28 12:42:39 ctl02 nova-api[6629]: 2017-09-28 12:42:39.862 6629 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:42:39 ctl02 neutron-server[30536]: 2017-09-28 12:42:39.867 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:42:39] "OPTIONS / HTTP/1.0" 200 262 0.000425
Sep 28 12:42:40 ctl02 nova-api[6629]: 2017-09-28 12:42:40.086 6629 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:42:40 ctl02 nova-api[6629]: 2017-09-28 12:42:40.089 6629 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:42:40 ctl02 nova-api[6629]: 2017-09-28 12:42:40.090 6629 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:42:40 ctl02 nova-api[6629]: 2017-09-28 12:42:40.090 6629 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:42:40 ctl02 nova-api[6629]: 2017-09-28 12:42:40.220 6629 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:42:40 ctl02 nova-api[6629]: 2017-09-28 12:42:40.222 6629 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:42:40 ctl02 nova-api[6629]: 2017-09-28 12:42:40.222 6629 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:42:40 ctl02 nova-api[6629]: 2017-09-28 12:42:40.223 6629 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:42:40 ctl02 nova-api[6629]: 2017-09-28 12:42:40.226 6629 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:42:40 ctl02 nova-api[6629]: 2017-09-28 12:42:40.227 6629 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:42:40 ctl02 nova-api[6629]: 2017-09-28 12:42:40.227 6629 ERROR nova Traceback (most recent call last):
Sep 28 12:42:40 ctl02 nova-api[6629]: 2017-09-28 12:42:40.227 6629 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:42:40 ctl02 nova-api[6629]: 2017-09-28 12:42:40.227 6629 ERROR nova     sys.exit(main())
Sep 28 12:42:40 ctl02 nova-api[6629]: 2017-09-28 12:42:40.227 6629 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:42:40 ctl02 nova-api[6629]: 2017-09-28 12:42:40.227 6629 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:42:40 ctl02 nova-api[6629]: 2017-09-28 12:42:40.227 6629 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:42:40 ctl02 nova-api[6629]: 2017-09-28 12:42:40.227 6629 ERROR nova     max_url_len=max_url_len)
Sep 28 12:42:40 ctl02 nova-api[6629]: 2017-09-28 12:42:40.227 6629 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:42:40 ctl02 nova-api[6629]: 2017-09-28 12:42:40.227 6629 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:42:40 ctl02 nova-api[6629]: 2017-09-28 12:42:40.227 6629 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:42:40 ctl02 nova-api[6629]: 2017-09-28 12:42:40.227 6629 ERROR nova     sock.listen(backlog)
Sep 28 12:42:40 ctl02 nova-api[6629]: 2017-09-28 12:42:40.227 6629 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:42:40 ctl02 nova-api[6629]: 2017-09-28 12:42:40.227 6629 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:42:40 ctl02 nova-api[6629]: 2017-09-28 12:42:40.227 6629 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:42:40 ctl02 nova-api[6629]: 2017-09-28 12:42:40.227 6629 ERROR nova
Sep 28 12:42:40 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:42:40 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:42:40 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:42:40 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xca900425)
Sep 28 12:42:40 ctl02 neutron-server[30536]: 2017-09-28 12:42:40.512 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:42:40] "OPTIONS / HTTP/1.0" 200 262 0.000511
Sep 28 12:42:40 ctl02 glance-api[29183]: 2017-09-28 12:42:40.564 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:42:40] "OPTIONS / HTTP/1.0" 200 134 0.000639
Sep 28 12:42:40 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:42:40 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:42:40 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:42:40 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:42:40 ctl02 glance-api[29183]: 2017-09-28 12:42:40.840 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:42:40] "OPTIONS / HTTP/1.0" 200 134 0.000910
Sep 28 12:42:41 ctl02 neutron-server[30536]: 2017-09-28 12:42:41.137 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:42:41] "OPTIONS / HTTP/1.0" 200 262 0.000648
Sep 28 12:42:41 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xca900425)
Sep 28 12:42:42 ctl02 nova-api[6648]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:42:42 ctl02 nova-api[6648]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:42:42 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xca900425)
Sep 28 12:42:42 ctl02 glance-api[29183]: 2017-09-28 12:42:42.470 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:42:42] "OPTIONS / HTTP/1.0" 200 134 0.000557
Sep 28 12:42:42 ctl02 nova-api[6648]: 2017-09-28 12:42:42.486 6648 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:42:42 ctl02 nova-api[6648]: 2017-09-28 12:42:42.488 6648 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:42:42 ctl02 nova-api[6648]: 2017-09-28 12:42:42.488 6648 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:42:42 ctl02 nova-api[6648]: 2017-09-28 12:42:42.488 6648 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:42:42 ctl02 nova-api[6648]: 2017-09-28 12:42:42.488 6648 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:42:42 ctl02 nova-api[6648]: 2017-09-28 12:42:42.488 6648 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:42:42 ctl02 nova-api[6648]: 2017-09-28 12:42:42.488 6648 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:42:42 ctl02 nova-api[6648]: 2017-09-28 12:42:42.488 6648 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:42:42 ctl02 nova-api[6648]: 2017-09-28 12:42:42.488 6648 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:42:42 ctl02 nova-api[6648]: 2017-09-28 12:42:42.488 6648 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:42:42 ctl02 nova-api[6648]: 2017-09-28 12:42:42.488 6648 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:42:42 ctl02 nova-api[6648]: 2017-09-28 12:42:42.488 6648 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:42:42 ctl02 nova-api[6648]: 2017-09-28 12:42:42.488 6648 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:42:42 ctl02 nova-api[6648]: 2017-09-28 12:42:42.488 6648 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:42:42 ctl02 nova-api[6648]: 2017-09-28 12:42:42.488 6648 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:42:42 ctl02 nova-api[6648]: 2017-09-28 12:42:42.488 6648 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:42:42 ctl02 nova-api[6648]: 2017-09-28 12:42:42.488 6648 ERROR nova.wsgi     self.filename))
Sep 28 12:42:42 ctl02 nova-api[6648]: 2017-09-28 12:42:42.488 6648 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:42:42 ctl02 nova-api[6648]: 2017-09-28 12:42:42.488 6648 ERROR nova.wsgi
Sep 28 12:42:42 ctl02 nova-api[6648]: 2017-09-28 12:42:42.489 6648 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:42:42 ctl02 nova-api[6648]: 2017-09-28 12:42:42.616 6648 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:42:42 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:42:42.803 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:42:42] "OPTIONS / HTTP/1.0" 200 134 0.000378
Sep 28 12:42:42 ctl02 nova-api[6648]: 2017-09-28 12:42:42.845 6648 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:42:42 ctl02 nova-api[6648]: 2017-09-28 12:42:42.847 6648 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:42:42 ctl02 nova-api[6648]: 2017-09-28 12:42:42.847 6648 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:42:42 ctl02 nova-api[6648]: 2017-09-28 12:42:42.847 6648 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:42:42 ctl02 nova-api[6648]: 2017-09-28 12:42:42.977 6648 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:42:42 ctl02 nova-api[6648]: 2017-09-28 12:42:42.979 6648 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:42:42 ctl02 nova-api[6648]: 2017-09-28 12:42:42.979 6648 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:42:42 ctl02 nova-api[6648]: 2017-09-28 12:42:42.979 6648 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:42:42 ctl02 nova-api[6648]: 2017-09-28 12:42:42.982 6648 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:42:42 ctl02 nova-api[6648]: 2017-09-28 12:42:42.982 6648 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:42:42 ctl02 nova-api[6648]: 2017-09-28 12:42:42.982 6648 ERROR nova Traceback (most recent call last):
Sep 28 12:42:42 ctl02 nova-api[6648]: 2017-09-28 12:42:42.982 6648 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:42:42 ctl02 nova-api[6648]: 2017-09-28 12:42:42.982 6648 ERROR nova     sys.exit(main())
Sep 28 12:42:42 ctl02 nova-api[6648]: 2017-09-28 12:42:42.982 6648 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:42:42 ctl02 nova-api[6648]: 2017-09-28 12:42:42.982 6648 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:42:42 ctl02 nova-api[6648]: 2017-09-28 12:42:42.982 6648 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:42:42 ctl02 nova-api[6648]: 2017-09-28 12:42:42.982 6648 ERROR nova     max_url_len=max_url_len)
Sep 28 12:42:42 ctl02 nova-api[6648]: 2017-09-28 12:42:42.982 6648 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:42:42 ctl02 nova-api[6648]: 2017-09-28 12:42:42.982 6648 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:42:42 ctl02 nova-api[6648]: 2017-09-28 12:42:42.982 6648 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:42:42 ctl02 nova-api[6648]: 2017-09-28 12:42:42.982 6648 ERROR nova     sock.listen(backlog)
Sep 28 12:42:42 ctl02 nova-api[6648]: 2017-09-28 12:42:42.982 6648 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:42:42 ctl02 nova-api[6648]: 2017-09-28 12:42:42.982 6648 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:42:42 ctl02 nova-api[6648]: 2017-09-28 12:42:42.982 6648 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:42:42 ctl02 nova-api[6648]: 2017-09-28 12:42:42.982 6648 ERROR nova
Sep 28 12:42:43 ctl02 heat-api-cfn[13300]: 2017-09-28 12:42:43.015 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:42:43] "OPTIONS / HTTP/1.0" 200 134 0.000426
Sep 28 12:42:43 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:42:43 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:42:43 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:42:43 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:42:43 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:42:43 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:42:43 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:42:43 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xca900425)
Sep 28 12:42:43 ctl02 neutron-server[30536]: 2017-09-28 12:42:43.475 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:42:44 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xca900425)
Sep 28 12:42:45 ctl02 nova-api[6666]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:42:45 ctl02 nova-api[6666]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:42:45 ctl02 nova-api[6666]: 2017-09-28 12:42:45.241 6666 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:42:45 ctl02 nova-api[6666]: 2017-09-28 12:42:45.242 6666 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:42:45 ctl02 nova-api[6666]: 2017-09-28 12:42:45.242 6666 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:42:45 ctl02 nova-api[6666]: 2017-09-28 12:42:45.242 6666 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:42:45 ctl02 nova-api[6666]: 2017-09-28 12:42:45.242 6666 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:42:45 ctl02 nova-api[6666]: 2017-09-28 12:42:45.242 6666 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:42:45 ctl02 nova-api[6666]: 2017-09-28 12:42:45.242 6666 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:42:45 ctl02 nova-api[6666]: 2017-09-28 12:42:45.242 6666 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:42:45 ctl02 nova-api[6666]: 2017-09-28 12:42:45.242 6666 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:42:45 ctl02 nova-api[6666]: 2017-09-28 12:42:45.242 6666 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:42:45 ctl02 nova-api[6666]: 2017-09-28 12:42:45.242 6666 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:42:45 ctl02 nova-api[6666]: 2017-09-28 12:42:45.242 6666 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:42:45 ctl02 nova-api[6666]: 2017-09-28 12:42:45.242 6666 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:42:45 ctl02 nova-api[6666]: 2017-09-28 12:42:45.242 6666 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:42:45 ctl02 nova-api[6666]: 2017-09-28 12:42:45.242 6666 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:42:45 ctl02 nova-api[6666]: 2017-09-28 12:42:45.242 6666 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:42:45 ctl02 nova-api[6666]: 2017-09-28 12:42:45.242 6666 ERROR nova.wsgi     self.filename))
Sep 28 12:42:45 ctl02 nova-api[6666]: 2017-09-28 12:42:45.242 6666 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:42:45 ctl02 nova-api[6666]: 2017-09-28 12:42:45.242 6666 ERROR nova.wsgi
Sep 28 12:42:45 ctl02 nova-api[6666]: 2017-09-28 12:42:45.243 6666 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:42:45 ctl02 nova-api[6666]: 2017-09-28 12:42:45.370 6666 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:42:45 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:42:45 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:42:45 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 12:42:45 ctl02 ntp[6723]:  * Stopping NTP server ntpd
Sep 28 12:42:45 ctl02 ntp[6723]:    ...done.
Sep 28 12:42:45 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 12:42:45 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 12:42:45 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:42:45.494 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:42:45] "OPTIONS / HTTP/1.0" 200 134 0.000369
Sep 28 12:42:45 ctl02 ntp[6734]:  * Starting NTP server ntpd
Sep 28 12:42:45 ctl02 ntpd[6741]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 12:42:45 ctl02 ntpd[6741]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 12:42:45 ctl02 ntp[6734]:    ...done.
Sep 28 12:42:45 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 12:42:45 ctl02 ntpd[6744]: proto: precision = 0.042 usec (-24)
Sep 28 12:42:45 ctl02 ntpd[6744]: switching logging to file /var/log/ntp.log
Sep 28 12:42:45 ctl02 nova-api[6666]: 2017-09-28 12:42:45.590 6666 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:42:45 ctl02 nova-api[6666]: 2017-09-28 12:42:45.592 6666 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:42:45 ctl02 nova-api[6666]: 2017-09-28 12:42:45.592 6666 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:42:45 ctl02 nova-api[6666]: 2017-09-28 12:42:45.593 6666 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:42:45 ctl02 nova-api[6666]: 2017-09-28 12:42:45.726 6666 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:42:45 ctl02 nova-api[6666]: 2017-09-28 12:42:45.727 6666 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:42:45 ctl02 nova-api[6666]: 2017-09-28 12:42:45.728 6666 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:42:45 ctl02 nova-api[6666]: 2017-09-28 12:42:45.728 6666 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:42:45 ctl02 nova-api[6666]: 2017-09-28 12:42:45.731 6666 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:42:45 ctl02 nova-api[6666]: 2017-09-28 12:42:45.731 6666 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:42:45 ctl02 nova-api[6666]: 2017-09-28 12:42:45.731 6666 ERROR nova Traceback (most recent call last):
Sep 28 12:42:45 ctl02 nova-api[6666]: 2017-09-28 12:42:45.731 6666 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:42:45 ctl02 nova-api[6666]: 2017-09-28 12:42:45.731 6666 ERROR nova     sys.exit(main())
Sep 28 12:42:45 ctl02 nova-api[6666]: 2017-09-28 12:42:45.731 6666 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:42:45 ctl02 nova-api[6666]: 2017-09-28 12:42:45.731 6666 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:42:45 ctl02 nova-api[6666]: 2017-09-28 12:42:45.731 6666 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:42:45 ctl02 nova-api[6666]: 2017-09-28 12:42:45.731 6666 ERROR nova     max_url_len=max_url_len)
Sep 28 12:42:45 ctl02 nova-api[6666]: 2017-09-28 12:42:45.731 6666 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:42:45 ctl02 nova-api[6666]: 2017-09-28 12:42:45.731 6666 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:42:45 ctl02 nova-api[6666]: 2017-09-28 12:42:45.731 6666 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:42:45 ctl02 nova-api[6666]: 2017-09-28 12:42:45.731 6666 ERROR nova     sock.listen(backlog)
Sep 28 12:42:45 ctl02 nova-api[6666]: 2017-09-28 12:42:45.731 6666 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:42:45 ctl02 nova-api[6666]: 2017-09-28 12:42:45.731 6666 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:42:45 ctl02 nova-api[6666]: 2017-09-28 12:42:45.731 6666 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:42:45 ctl02 nova-api[6666]: 2017-09-28 12:42:45.731 6666 ERROR nova
Sep 28 12:42:45 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:42:45 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:42:45 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:42:46 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:42:46 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:42:46 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:42:46 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:42:46 ctl02 heat-api[13008]: 2017-09-28 12:42:46.353 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:42:46] "OPTIONS / HTTP/1.0" 200 134 0.000580
Sep 28 12:42:46 ctl02 nova-cert[4860]: 2017-09-28 12:42:46.619 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:42:46 ctl02 heat-api[13008]: 2017-09-28 12:42:46.893 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:42:46] "OPTIONS / HTTP/1.0" 200 134 0.000555
Sep 28 12:42:46 ctl02 nova-conductor[5056]: 2017-09-28 12:42:46.941 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:42:46 ctl02 nova-conductor[5056]: 2017-09-28 12:42:46.961 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:42:46 ctl02 nova-conductor[5056]: 2017-09-28 12:42:46.986 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:42:46 ctl02 nova-conductor[5056]: 2017-09-28 12:42:46.986 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:42:47 ctl02 nova-api[6755]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:42:47 ctl02 nova-api[6755]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:42:48 ctl02 nova-api[6755]: 2017-09-28 12:42:48.058 6755 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:42:48 ctl02 nova-api[6755]: 2017-09-28 12:42:48.059 6755 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:42:48 ctl02 nova-api[6755]: 2017-09-28 12:42:48.059 6755 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:42:48 ctl02 nova-api[6755]: 2017-09-28 12:42:48.059 6755 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:42:48 ctl02 nova-api[6755]: 2017-09-28 12:42:48.059 6755 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:42:48 ctl02 nova-api[6755]: 2017-09-28 12:42:48.059 6755 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:42:48 ctl02 nova-api[6755]: 2017-09-28 12:42:48.059 6755 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:42:48 ctl02 nova-api[6755]: 2017-09-28 12:42:48.059 6755 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:42:48 ctl02 nova-api[6755]: 2017-09-28 12:42:48.059 6755 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:42:48 ctl02 nova-api[6755]: 2017-09-28 12:42:48.059 6755 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:42:48 ctl02 nova-api[6755]: 2017-09-28 12:42:48.059 6755 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:42:48 ctl02 nova-api[6755]: 2017-09-28 12:42:48.059 6755 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:42:48 ctl02 nova-api[6755]: 2017-09-28 12:42:48.059 6755 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:42:48 ctl02 nova-api[6755]: 2017-09-28 12:42:48.059 6755 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:42:48 ctl02 nova-api[6755]: 2017-09-28 12:42:48.059 6755 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:42:48 ctl02 nova-api[6755]: 2017-09-28 12:42:48.059 6755 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:42:48 ctl02 nova-api[6755]: 2017-09-28 12:42:48.059 6755 ERROR nova.wsgi     self.filename))
Sep 28 12:42:48 ctl02 nova-api[6755]: 2017-09-28 12:42:48.059 6755 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:42:48 ctl02 nova-api[6755]: 2017-09-28 12:42:48.059 6755 ERROR nova.wsgi
Sep 28 12:42:48 ctl02 nova-api[6755]: 2017-09-28 12:42:48.060 6755 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:42:48 ctl02 nova-api[6755]: 2017-09-28 12:42:48.192 6755 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:42:48 ctl02 nova-api[6755]: 2017-09-28 12:42:48.442 6755 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:42:48 ctl02 nova-api[6755]: 2017-09-28 12:42:48.444 6755 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:42:48 ctl02 nova-api[6755]: 2017-09-28 12:42:48.445 6755 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:42:48 ctl02 nova-api[6755]: 2017-09-28 12:42:48.445 6755 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:42:48 ctl02 nova-api[6755]: 2017-09-28 12:42:48.578 6755 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:42:48 ctl02 nova-api[6755]: 2017-09-28 12:42:48.580 6755 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:42:48 ctl02 nova-api[6755]: 2017-09-28 12:42:48.581 6755 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:42:48 ctl02 nova-api[6755]: 2017-09-28 12:42:48.581 6755 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:42:48 ctl02 nova-api[6755]: 2017-09-28 12:42:48.584 6755 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:42:48 ctl02 nova-api[6755]: 2017-09-28 12:42:48.585 6755 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:42:48 ctl02 nova-api[6755]: 2017-09-28 12:42:48.585 6755 ERROR nova Traceback (most recent call last):
Sep 28 12:42:48 ctl02 nova-api[6755]: 2017-09-28 12:42:48.585 6755 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:42:48 ctl02 nova-api[6755]: 2017-09-28 12:42:48.585 6755 ERROR nova     sys.exit(main())
Sep 28 12:42:48 ctl02 nova-api[6755]: 2017-09-28 12:42:48.585 6755 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:42:48 ctl02 nova-api[6755]: 2017-09-28 12:42:48.585 6755 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:42:48 ctl02 nova-api[6755]: 2017-09-28 12:42:48.585 6755 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:42:48 ctl02 nova-api[6755]: 2017-09-28 12:42:48.585 6755 ERROR nova     max_url_len=max_url_len)
Sep 28 12:42:48 ctl02 nova-api[6755]: 2017-09-28 12:42:48.585 6755 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:42:48 ctl02 nova-api[6755]: 2017-09-28 12:42:48.585 6755 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:42:48 ctl02 nova-api[6755]: 2017-09-28 12:42:48.585 6755 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:42:48 ctl02 nova-api[6755]: 2017-09-28 12:42:48.585 6755 ERROR nova     sock.listen(backlog)
Sep 28 12:42:48 ctl02 nova-api[6755]: 2017-09-28 12:42:48.585 6755 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:42:48 ctl02 nova-api[6755]: 2017-09-28 12:42:48.585 6755 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:42:48 ctl02 nova-api[6755]: 2017-09-28 12:42:48.585 6755 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:42:48 ctl02 nova-api[6755]: 2017-09-28 12:42:48.585 6755 ERROR nova
Sep 28 12:42:48 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:42:48 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:42:48 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:42:48 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:42:48.857 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:42:48] "OPTIONS / HTTP/1.0" 200 134 0.000468
Sep 28 12:42:48 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:42:48 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:42:48 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:42:48 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:42:49 ctl02 heat-api[13008]: 2017-09-28 12:42:49.116 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:42:49] "OPTIONS / HTTP/1.0" 200 134 0.000549
Sep 28 12:42:49 ctl02 heat-api-cfn[13300]: 2017-09-28 12:42:49.357 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:42:49] "OPTIONS / HTTP/1.0" 200 134 0.000451
Sep 28 12:42:49 ctl02 heat-api-cfn[13300]: 2017-09-28 12:42:49.645 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:42:49] "OPTIONS / HTTP/1.0" 200 134 0.000415
Sep 28 12:42:49 ctl02 neutron-server[30536]: 2017-09-28 12:42:49.852 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:42:49] "OPTIONS / HTTP/1.0" 200 262 0.000453
Sep 28 12:42:50 ctl02 neutron-server[30536]: 2017-09-28 12:42:50.363 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:42:50] "OPTIONS / HTTP/1.0" 200 262 0.000487
Sep 28 12:42:50 ctl02 nova-api[6773]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:42:50 ctl02 nova-api[6773]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:42:50 ctl02 glance-api[29183]: 2017-09-28 12:42:50.647 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:42:50] "OPTIONS / HTTP/1.0" 200 134 0.000591
Sep 28 12:42:50 ctl02 nova-api[6773]: 2017-09-28 12:42:50.733 6773 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:42:50 ctl02 nova-api[6773]: 2017-09-28 12:42:50.735 6773 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:42:50 ctl02 nova-api[6773]: 2017-09-28 12:42:50.735 6773 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:42:50 ctl02 nova-api[6773]: 2017-09-28 12:42:50.735 6773 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:42:50 ctl02 nova-api[6773]: 2017-09-28 12:42:50.735 6773 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:42:50 ctl02 nova-api[6773]: 2017-09-28 12:42:50.735 6773 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:42:50 ctl02 nova-api[6773]: 2017-09-28 12:42:50.735 6773 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:42:50 ctl02 nova-api[6773]: 2017-09-28 12:42:50.735 6773 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:42:50 ctl02 nova-api[6773]: 2017-09-28 12:42:50.735 6773 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:42:50 ctl02 nova-api[6773]: 2017-09-28 12:42:50.735 6773 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:42:50 ctl02 nova-api[6773]: 2017-09-28 12:42:50.735 6773 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:42:50 ctl02 nova-api[6773]: 2017-09-28 12:42:50.735 6773 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:42:50 ctl02 nova-api[6773]: 2017-09-28 12:42:50.735 6773 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:42:50 ctl02 nova-api[6773]: 2017-09-28 12:42:50.735 6773 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:42:50 ctl02 nova-api[6773]: 2017-09-28 12:42:50.735 6773 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:42:50 ctl02 nova-api[6773]: 2017-09-28 12:42:50.735 6773 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:42:50 ctl02 nova-api[6773]: 2017-09-28 12:42:50.735 6773 ERROR nova.wsgi     self.filename))
Sep 28 12:42:50 ctl02 nova-api[6773]: 2017-09-28 12:42:50.735 6773 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:42:50 ctl02 nova-api[6773]: 2017-09-28 12:42:50.735 6773 ERROR nova.wsgi
Sep 28 12:42:50 ctl02 nova-api[6773]: 2017-09-28 12:42:50.736 6773 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:42:50 ctl02 glance-api[29183]: 2017-09-28 12:42:50.739 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:42:50] "OPTIONS / HTTP/1.0" 200 134 0.000559
Sep 28 12:42:50 ctl02 neutron-server[30536]: 2017-09-28 12:42:50.828 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:42:50] "OPTIONS / HTTP/1.0" 200 262 0.000468
Sep 28 12:42:50 ctl02 nova-api[6773]: 2017-09-28 12:42:50.865 6773 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:42:51 ctl02 nova-api[6773]: 2017-09-28 12:42:51.089 6773 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:42:51 ctl02 nova-api[6773]: 2017-09-28 12:42:51.092 6773 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:42:51 ctl02 nova-api[6773]: 2017-09-28 12:42:51.092 6773 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:42:51 ctl02 nova-api[6773]: 2017-09-28 12:42:51.092 6773 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:42:51 ctl02 nova-api[6773]: 2017-09-28 12:42:51.223 6773 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:42:51 ctl02 nova-api[6773]: 2017-09-28 12:42:51.225 6773 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:42:51 ctl02 nova-api[6773]: 2017-09-28 12:42:51.225 6773 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:42:51 ctl02 nova-api[6773]: 2017-09-28 12:42:51.226 6773 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:42:51 ctl02 nova-api[6773]: 2017-09-28 12:42:51.229 6773 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:42:51 ctl02 nova-api[6773]: 2017-09-28 12:42:51.229 6773 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:42:51 ctl02 nova-api[6773]: 2017-09-28 12:42:51.229 6773 ERROR nova Traceback (most recent call last):
Sep 28 12:42:51 ctl02 nova-api[6773]: 2017-09-28 12:42:51.229 6773 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:42:51 ctl02 nova-api[6773]: 2017-09-28 12:42:51.229 6773 ERROR nova     sys.exit(main())
Sep 28 12:42:51 ctl02 nova-api[6773]: 2017-09-28 12:42:51.229 6773 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:42:51 ctl02 nova-api[6773]: 2017-09-28 12:42:51.229 6773 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:42:51 ctl02 nova-api[6773]: 2017-09-28 12:42:51.229 6773 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:42:51 ctl02 nova-api[6773]: 2017-09-28 12:42:51.229 6773 ERROR nova     max_url_len=max_url_len)
Sep 28 12:42:51 ctl02 nova-api[6773]: 2017-09-28 12:42:51.229 6773 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:42:51 ctl02 nova-api[6773]: 2017-09-28 12:42:51.229 6773 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:42:51 ctl02 nova-api[6773]: 2017-09-28 12:42:51.229 6773 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:42:51 ctl02 nova-api[6773]: 2017-09-28 12:42:51.229 6773 ERROR nova     sock.listen(backlog)
Sep 28 12:42:51 ctl02 nova-api[6773]: 2017-09-28 12:42:51.229 6773 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:42:51 ctl02 nova-api[6773]: 2017-09-28 12:42:51.229 6773 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:42:51 ctl02 nova-api[6773]: 2017-09-28 12:42:51.229 6773 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:42:51 ctl02 nova-api[6773]: 2017-09-28 12:42:51.229 6773 ERROR nova
Sep 28 12:42:51 ctl02 neutron-server[30536]: 2017-09-28 12:42:51.282 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 4 dead agents out of 6:
Sep 28 12:42:51 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:42:51 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:40:56 cmp002
Sep 28 12:42:51 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:41:28 cmp001
Sep 28 12:42:51 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:41:20 cmp002
Sep 28 12:42:51 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:41:16 cmp002
Sep 28 12:42:51 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:42:51 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:42:51 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:42:51 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:42:51 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:42:51 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:42:51 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:42:52 ctl02 glance-api[29183]: 2017-09-28 12:42:52.630 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:42:52] "OPTIONS / HTTP/1.0" 200 134 0.000596
Sep 28 12:42:52 ctl02 heat-api-cfn[13300]: 2017-09-28 12:42:52.655 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:42:52] "OPTIONS / HTTP/1.0" 200 134 0.000423
Sep 28 12:42:53 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:42:53.168 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:42:53] "OPTIONS / HTTP/1.0" 200 134 0.000389
Sep 28 12:42:53 ctl02 nova-api[6790]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:42:53 ctl02 nova-api[6790]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:42:53 ctl02 nova-api[6790]: 2017-09-28 12:42:53.499 6790 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:42:53 ctl02 nova-api[6790]: 2017-09-28 12:42:53.501 6790 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:42:53 ctl02 nova-api[6790]: 2017-09-28 12:42:53.501 6790 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:42:53 ctl02 nova-api[6790]: 2017-09-28 12:42:53.501 6790 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:42:53 ctl02 nova-api[6790]: 2017-09-28 12:42:53.501 6790 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:42:53 ctl02 nova-api[6790]: 2017-09-28 12:42:53.501 6790 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:42:53 ctl02 nova-api[6790]: 2017-09-28 12:42:53.501 6790 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:42:53 ctl02 nova-api[6790]: 2017-09-28 12:42:53.501 6790 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:42:53 ctl02 nova-api[6790]: 2017-09-28 12:42:53.501 6790 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:42:53 ctl02 nova-api[6790]: 2017-09-28 12:42:53.501 6790 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:42:53 ctl02 nova-api[6790]: 2017-09-28 12:42:53.501 6790 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:42:53 ctl02 nova-api[6790]: 2017-09-28 12:42:53.501 6790 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:42:53 ctl02 nova-api[6790]: 2017-09-28 12:42:53.501 6790 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:42:53 ctl02 nova-api[6790]: 2017-09-28 12:42:53.501 6790 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:42:53 ctl02 nova-api[6790]: 2017-09-28 12:42:53.501 6790 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:42:53 ctl02 nova-api[6790]: 2017-09-28 12:42:53.501 6790 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:42:53 ctl02 nova-api[6790]: 2017-09-28 12:42:53.501 6790 ERROR nova.wsgi     self.filename))
Sep 28 12:42:53 ctl02 nova-api[6790]: 2017-09-28 12:42:53.501 6790 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:42:53 ctl02 nova-api[6790]: 2017-09-28 12:42:53.501 6790 ERROR nova.wsgi
Sep 28 12:42:53 ctl02 nova-api[6790]: 2017-09-28 12:42:53.502 6790 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:42:53 ctl02 nova-api[6790]: 2017-09-28 12:42:53.636 6790 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:42:53 ctl02 nova-api[6790]: 2017-09-28 12:42:53.865 6790 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:42:53 ctl02 nova-api[6790]: 2017-09-28 12:42:53.867 6790 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:42:53 ctl02 nova-api[6790]: 2017-09-28 12:42:53.867 6790 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:42:53 ctl02 nova-api[6790]: 2017-09-28 12:42:53.867 6790 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:42:54 ctl02 nova-api[6790]: 2017-09-28 12:42:53.999 6790 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:42:54 ctl02 nova-api[6790]: 2017-09-28 12:42:54.001 6790 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:42:54 ctl02 nova-api[6790]: 2017-09-28 12:42:54.002 6790 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:42:54 ctl02 nova-api[6790]: 2017-09-28 12:42:54.002 6790 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:42:54 ctl02 nova-api[6790]: 2017-09-28 12:42:54.005 6790 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:42:54 ctl02 nova-api[6790]: 2017-09-28 12:42:54.005 6790 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:42:54 ctl02 nova-api[6790]: 2017-09-28 12:42:54.005 6790 ERROR nova Traceback (most recent call last):
Sep 28 12:42:54 ctl02 nova-api[6790]: 2017-09-28 12:42:54.005 6790 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:42:54 ctl02 nova-api[6790]: 2017-09-28 12:42:54.005 6790 ERROR nova     sys.exit(main())
Sep 28 12:42:54 ctl02 nova-api[6790]: 2017-09-28 12:42:54.005 6790 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:42:54 ctl02 nova-api[6790]: 2017-09-28 12:42:54.005 6790 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:42:54 ctl02 nova-api[6790]: 2017-09-28 12:42:54.005 6790 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:42:54 ctl02 nova-api[6790]: 2017-09-28 12:42:54.005 6790 ERROR nova     max_url_len=max_url_len)
Sep 28 12:42:54 ctl02 nova-api[6790]: 2017-09-28 12:42:54.005 6790 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:42:54 ctl02 nova-api[6790]: 2017-09-28 12:42:54.005 6790 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:42:54 ctl02 nova-api[6790]: 2017-09-28 12:42:54.005 6790 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:42:54 ctl02 nova-api[6790]: 2017-09-28 12:42:54.005 6790 ERROR nova     sock.listen(backlog)
Sep 28 12:42:54 ctl02 nova-api[6790]: 2017-09-28 12:42:54.005 6790 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:42:54 ctl02 nova-api[6790]: 2017-09-28 12:42:54.005 6790 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:42:54 ctl02 nova-api[6790]: 2017-09-28 12:42:54.005 6790 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:42:54 ctl02 nova-api[6790]: 2017-09-28 12:42:54.005 6790 ERROR nova
Sep 28 12:42:54 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:42:54 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:42:54 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:42:54 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:42:54 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:42:54 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:42:54 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:42:55 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:42:55.219 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:42:55] "OPTIONS / HTTP/1.0" 200 134 0.000384
Sep 28 12:42:55 ctl02 heat-api[13008]: 2017-09-28 12:42:55.966 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:42:55] "OPTIONS / HTTP/1.0" 200 134 0.000679
Sep 28 12:42:56 ctl02 nova-api[6809]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:42:56 ctl02 nova-api[6809]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:42:56 ctl02 nova-api[6809]: 2017-09-28 12:42:56.233 6809 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:42:56 ctl02 nova-api[6809]: 2017-09-28 12:42:56.235 6809 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:42:56 ctl02 nova-api[6809]: 2017-09-28 12:42:56.235 6809 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:42:56 ctl02 nova-api[6809]: 2017-09-28 12:42:56.235 6809 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:42:56 ctl02 nova-api[6809]: 2017-09-28 12:42:56.235 6809 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:42:56 ctl02 nova-api[6809]: 2017-09-28 12:42:56.235 6809 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:42:56 ctl02 nova-api[6809]: 2017-09-28 12:42:56.235 6809 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:42:56 ctl02 nova-api[6809]: 2017-09-28 12:42:56.235 6809 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:42:56 ctl02 nova-api[6809]: 2017-09-28 12:42:56.235 6809 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:42:56 ctl02 nova-api[6809]: 2017-09-28 12:42:56.235 6809 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:42:56 ctl02 nova-api[6809]: 2017-09-28 12:42:56.235 6809 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:42:56 ctl02 nova-api[6809]: 2017-09-28 12:42:56.235 6809 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:42:56 ctl02 nova-api[6809]: 2017-09-28 12:42:56.235 6809 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:42:56 ctl02 nova-api[6809]: 2017-09-28 12:42:56.235 6809 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:42:56 ctl02 nova-api[6809]: 2017-09-28 12:42:56.235 6809 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:42:56 ctl02 nova-api[6809]: 2017-09-28 12:42:56.235 6809 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:42:56 ctl02 nova-api[6809]: 2017-09-28 12:42:56.235 6809 ERROR nova.wsgi     self.filename))
Sep 28 12:42:56 ctl02 nova-api[6809]: 2017-09-28 12:42:56.235 6809 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:42:56 ctl02 nova-api[6809]: 2017-09-28 12:42:56.235 6809 ERROR nova.wsgi
Sep 28 12:42:56 ctl02 nova-api[6809]: 2017-09-28 12:42:56.235 6809 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:42:56 ctl02 nova-api[6809]: 2017-09-28 12:42:56.363 6809 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:42:56 ctl02 nova-consoleauth[5433]: 2017-09-28 12:42:56.470 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:42:56 ctl02 nova-api[6809]: 2017-09-28 12:42:56.614 6809 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:42:56 ctl02 nova-api[6809]: 2017-09-28 12:42:56.616 6809 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:42:56 ctl02 nova-api[6809]: 2017-09-28 12:42:56.617 6809 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:42:56 ctl02 nova-api[6809]: 2017-09-28 12:42:56.617 6809 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:42:56 ctl02 heat-api[13008]: 2017-09-28 12:42:56.678 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:42:56] "OPTIONS / HTTP/1.0" 200 134 0.000613
Sep 28 12:42:56 ctl02 nova-api[6809]: 2017-09-28 12:42:56.760 6809 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:42:56 ctl02 nova-api[6809]: 2017-09-28 12:42:56.762 6809 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:42:56 ctl02 nova-api[6809]: 2017-09-28 12:42:56.762 6809 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:42:56 ctl02 nova-api[6809]: 2017-09-28 12:42:56.762 6809 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:42:56 ctl02 nova-api[6809]: 2017-09-28 12:42:56.765 6809 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:42:56 ctl02 nova-api[6809]: 2017-09-28 12:42:56.766 6809 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:42:56 ctl02 nova-api[6809]: 2017-09-28 12:42:56.766 6809 ERROR nova Traceback (most recent call last):
Sep 28 12:42:56 ctl02 nova-api[6809]: 2017-09-28 12:42:56.766 6809 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:42:56 ctl02 nova-api[6809]: 2017-09-28 12:42:56.766 6809 ERROR nova     sys.exit(main())
Sep 28 12:42:56 ctl02 nova-api[6809]: 2017-09-28 12:42:56.766 6809 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:42:56 ctl02 nova-api[6809]: 2017-09-28 12:42:56.766 6809 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:42:56 ctl02 nova-api[6809]: 2017-09-28 12:42:56.766 6809 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:42:56 ctl02 nova-api[6809]: 2017-09-28 12:42:56.766 6809 ERROR nova     max_url_len=max_url_len)
Sep 28 12:42:56 ctl02 nova-api[6809]: 2017-09-28 12:42:56.766 6809 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:42:56 ctl02 nova-api[6809]: 2017-09-28 12:42:56.766 6809 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:42:56 ctl02 nova-api[6809]: 2017-09-28 12:42:56.766 6809 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:42:56 ctl02 nova-api[6809]: 2017-09-28 12:42:56.766 6809 ERROR nova     sock.listen(backlog)
Sep 28 12:42:56 ctl02 nova-api[6809]: 2017-09-28 12:42:56.766 6809 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:42:56 ctl02 nova-api[6809]: 2017-09-28 12:42:56.766 6809 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:42:56 ctl02 nova-api[6809]: 2017-09-28 12:42:56.766 6809 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:42:56 ctl02 nova-api[6809]: 2017-09-28 12:42:56.766 6809 ERROR nova
Sep 28 12:42:56 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:42:56 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:42:56 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:42:57 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:42:57 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:42:57 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:42:57 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:42:58 ctl02 heat-engine[12803]: 2017-09-28 12:42:58.085 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:42:58 ctl02 heat-engine[12803]: 2017-09-28 12:42:58.090 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:42:58 ctl02 heat-engine[12803]: 2017-09-28 12:42:58.096 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:42:58 ctl02 heat-engine[12803]: 2017-09-28 12:42:58.104 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:42:58 ctl02 neutron-server[30536]: 2017-09-28 12:42:58.478 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:42:58 ctl02 nova-api[6827]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:42:58 ctl02 nova-api[6827]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:42:58 ctl02 heat-api[13008]: 2017-09-28 12:42:58.969 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:42:58] "OPTIONS / HTTP/1.0" 200 134 0.000621
Sep 28 12:42:59 ctl02 nova-api[6827]: 2017-09-28 12:42:59.051 6827 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:42:59 ctl02 nova-api[6827]: 2017-09-28 12:42:59.053 6827 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:42:59 ctl02 nova-api[6827]: 2017-09-28 12:42:59.053 6827 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:42:59 ctl02 nova-api[6827]: 2017-09-28 12:42:59.053 6827 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:42:59 ctl02 nova-api[6827]: 2017-09-28 12:42:59.053 6827 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:42:59 ctl02 nova-api[6827]: 2017-09-28 12:42:59.053 6827 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:42:59 ctl02 nova-api[6827]: 2017-09-28 12:42:59.053 6827 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:42:59 ctl02 nova-api[6827]: 2017-09-28 12:42:59.053 6827 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:42:59 ctl02 nova-api[6827]: 2017-09-28 12:42:59.053 6827 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:42:59 ctl02 nova-api[6827]: 2017-09-28 12:42:59.053 6827 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:42:59 ctl02 nova-api[6827]: 2017-09-28 12:42:59.053 6827 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:42:59 ctl02 nova-api[6827]: 2017-09-28 12:42:59.053 6827 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:42:59 ctl02 nova-api[6827]: 2017-09-28 12:42:59.053 6827 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:42:59 ctl02 nova-api[6827]: 2017-09-28 12:42:59.053 6827 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:42:59 ctl02 nova-api[6827]: 2017-09-28 12:42:59.053 6827 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:42:59 ctl02 nova-api[6827]: 2017-09-28 12:42:59.053 6827 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:42:59 ctl02 nova-api[6827]: 2017-09-28 12:42:59.053 6827 ERROR nova.wsgi     self.filename))
Sep 28 12:42:59 ctl02 nova-api[6827]: 2017-09-28 12:42:59.053 6827 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:42:59 ctl02 nova-api[6827]: 2017-09-28 12:42:59.053 6827 ERROR nova.wsgi
Sep 28 12:42:59 ctl02 nova-api[6827]: 2017-09-28 12:42:59.054 6827 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:42:59 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:42:59.138 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:42:59] "OPTIONS / HTTP/1.0" 200 134 0.000443
Sep 28 12:42:59 ctl02 nova-api[6827]: 2017-09-28 12:42:59.192 6827 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:42:59 ctl02 nova-api[6827]: 2017-09-28 12:42:59.445 6827 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:42:59 ctl02 nova-api[6827]: 2017-09-28 12:42:59.447 6827 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:42:59 ctl02 nova-api[6827]: 2017-09-28 12:42:59.448 6827 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:42:59 ctl02 nova-api[6827]: 2017-09-28 12:42:59.448 6827 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:42:59 ctl02 heat-api-cfn[13300]: 2017-09-28 12:42:59.533 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:42:59] "OPTIONS / HTTP/1.0" 200 134 0.000578
Sep 28 12:42:59 ctl02 nova-scheduler[5620]: 2017-09-28 12:42:59.561 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:42:59 ctl02 nova-api[6827]: 2017-09-28 12:42:59.596 6827 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:42:59 ctl02 nova-api[6827]: 2017-09-28 12:42:59.598 6827 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:42:59 ctl02 nova-api[6827]: 2017-09-28 12:42:59.599 6827 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:42:59 ctl02 nova-api[6827]: 2017-09-28 12:42:59.599 6827 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:42:59 ctl02 nova-api[6827]: 2017-09-28 12:42:59.603 6827 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:42:59 ctl02 nova-api[6827]: 2017-09-28 12:42:59.604 6827 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:42:59 ctl02 nova-api[6827]: 2017-09-28 12:42:59.604 6827 ERROR nova Traceback (most recent call last):
Sep 28 12:42:59 ctl02 nova-api[6827]: 2017-09-28 12:42:59.604 6827 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:42:59 ctl02 nova-api[6827]: 2017-09-28 12:42:59.604 6827 ERROR nova     sys.exit(main())
Sep 28 12:42:59 ctl02 nova-api[6827]: 2017-09-28 12:42:59.604 6827 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:42:59 ctl02 nova-api[6827]: 2017-09-28 12:42:59.604 6827 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:42:59 ctl02 nova-api[6827]: 2017-09-28 12:42:59.604 6827 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:42:59 ctl02 nova-api[6827]: 2017-09-28 12:42:59.604 6827 ERROR nova     max_url_len=max_url_len)
Sep 28 12:42:59 ctl02 nova-api[6827]: 2017-09-28 12:42:59.604 6827 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:42:59 ctl02 nova-api[6827]: 2017-09-28 12:42:59.604 6827 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:42:59 ctl02 nova-api[6827]: 2017-09-28 12:42:59.604 6827 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:42:59 ctl02 nova-api[6827]: 2017-09-28 12:42:59.604 6827 ERROR nova     sock.listen(backlog)
Sep 28 12:42:59 ctl02 nova-api[6827]: 2017-09-28 12:42:59.604 6827 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:42:59 ctl02 nova-api[6827]: 2017-09-28 12:42:59.604 6827 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:42:59 ctl02 nova-api[6827]: 2017-09-28 12:42:59.604 6827 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:42:59 ctl02 nova-api[6827]: 2017-09-28 12:42:59.604 6827 ERROR nova
Sep 28 12:42:59 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:42:59 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:42:59 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:42:59 ctl02 neutron-server[30536]: 2017-09-28 12:42:59.769 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:42:59] "OPTIONS / HTTP/1.0" 200 262 0.000635
Sep 28 12:42:59 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:42:59 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:42:59 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:42:59 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:42:59 ctl02 heat-api-cfn[13300]: 2017-09-28 12:42:59.926 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:42:59] "OPTIONS / HTTP/1.0" 200 134 0.000570
Sep 28 12:43:00 ctl02 neutron-server[30536]: 2017-09-28 12:43:00.491 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:43:00] "OPTIONS / HTTP/1.0" 200 262 0.000570
Sep 28 12:43:00 ctl02 neutron-server[30536]: 2017-09-28 12:43:00.530 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:43:00] "OPTIONS / HTTP/1.0" 200 262 0.000582
Sep 28 12:43:00 ctl02 glance-api[29183]: 2017-09-28 12:43:00.636 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:43:00] "OPTIONS / HTTP/1.0" 200 134 0.000653
Sep 28 12:43:01 ctl02 glance-api[29183]: 2017-09-28 12:43:01.004 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:43:01] "OPTIONS / HTTP/1.0" 200 134 0.000728
Sep 28 12:43:01 ctl02 nova-api[6845]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:43:01 ctl02 nova-api[6845]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:43:01 ctl02 nova-api[6845]: 2017-09-28 12:43:01.783 6845 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:43:01 ctl02 nova-api[6845]: 2017-09-28 12:43:01.785 6845 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:43:01 ctl02 nova-api[6845]: 2017-09-28 12:43:01.785 6845 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:43:01 ctl02 nova-api[6845]: 2017-09-28 12:43:01.785 6845 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:43:01 ctl02 nova-api[6845]: 2017-09-28 12:43:01.785 6845 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:43:01 ctl02 nova-api[6845]: 2017-09-28 12:43:01.785 6845 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:43:01 ctl02 nova-api[6845]: 2017-09-28 12:43:01.785 6845 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:43:01 ctl02 nova-api[6845]: 2017-09-28 12:43:01.785 6845 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:43:01 ctl02 nova-api[6845]: 2017-09-28 12:43:01.785 6845 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:43:01 ctl02 nova-api[6845]: 2017-09-28 12:43:01.785 6845 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:43:01 ctl02 nova-api[6845]: 2017-09-28 12:43:01.785 6845 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:43:01 ctl02 nova-api[6845]: 2017-09-28 12:43:01.785 6845 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:43:01 ctl02 nova-api[6845]: 2017-09-28 12:43:01.785 6845 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:43:01 ctl02 nova-api[6845]: 2017-09-28 12:43:01.785 6845 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:43:01 ctl02 nova-api[6845]: 2017-09-28 12:43:01.785 6845 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:43:01 ctl02 nova-api[6845]: 2017-09-28 12:43:01.785 6845 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:43:01 ctl02 nova-api[6845]: 2017-09-28 12:43:01.785 6845 ERROR nova.wsgi     self.filename))
Sep 28 12:43:01 ctl02 nova-api[6845]: 2017-09-28 12:43:01.785 6845 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:43:01 ctl02 nova-api[6845]: 2017-09-28 12:43:01.785 6845 ERROR nova.wsgi
Sep 28 12:43:01 ctl02 nova-api[6845]: 2017-09-28 12:43:01.786 6845 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:43:01 ctl02 nova-api[6845]: 2017-09-28 12:43:01.918 6845 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:43:02 ctl02 nova-api[6845]: 2017-09-28 12:43:02.161 6845 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:43:02 ctl02 nova-api[6845]: 2017-09-28 12:43:02.163 6845 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:43:02 ctl02 nova-api[6845]: 2017-09-28 12:43:02.163 6845 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:43:02 ctl02 nova-api[6845]: 2017-09-28 12:43:02.163 6845 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:43:02 ctl02 nova-api[6845]: 2017-09-28 12:43:02.295 6845 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:43:02 ctl02 nova-api[6845]: 2017-09-28 12:43:02.297 6845 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:43:02 ctl02 nova-api[6845]: 2017-09-28 12:43:02.297 6845 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:43:02 ctl02 nova-api[6845]: 2017-09-28 12:43:02.298 6845 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:43:02 ctl02 nova-api[6845]: 2017-09-28 12:43:02.301 6845 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:43:02 ctl02 nova-api[6845]: 2017-09-28 12:43:02.301 6845 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:43:02 ctl02 nova-api[6845]: 2017-09-28 12:43:02.301 6845 ERROR nova Traceback (most recent call last):
Sep 28 12:43:02 ctl02 nova-api[6845]: 2017-09-28 12:43:02.301 6845 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:43:02 ctl02 nova-api[6845]: 2017-09-28 12:43:02.301 6845 ERROR nova     sys.exit(main())
Sep 28 12:43:02 ctl02 nova-api[6845]: 2017-09-28 12:43:02.301 6845 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:43:02 ctl02 nova-api[6845]: 2017-09-28 12:43:02.301 6845 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:43:02 ctl02 nova-api[6845]: 2017-09-28 12:43:02.301 6845 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:43:02 ctl02 nova-api[6845]: 2017-09-28 12:43:02.301 6845 ERROR nova     max_url_len=max_url_len)
Sep 28 12:43:02 ctl02 nova-api[6845]: 2017-09-28 12:43:02.301 6845 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:43:02 ctl02 nova-api[6845]: 2017-09-28 12:43:02.301 6845 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:43:02 ctl02 nova-api[6845]: 2017-09-28 12:43:02.301 6845 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:43:02 ctl02 nova-api[6845]: 2017-09-28 12:43:02.301 6845 ERROR nova     sock.listen(backlog)
Sep 28 12:43:02 ctl02 nova-api[6845]: 2017-09-28 12:43:02.301 6845 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:43:02 ctl02 nova-api[6845]: 2017-09-28 12:43:02.301 6845 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:43:02 ctl02 nova-api[6845]: 2017-09-28 12:43:02.301 6845 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:43:02 ctl02 nova-api[6845]: 2017-09-28 12:43:02.301 6845 ERROR nova
Sep 28 12:43:02 ctl02 glance-api[29183]: 2017-09-28 12:43:02.333 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:43:02] "OPTIONS / HTTP/1.0" 200 134 0.000655
Sep 28 12:43:02 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:43:02 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:43:02 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:43:02 ctl02 heat-api-cfn[13300]: 2017-09-28 12:43:02.606 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:43:02] "OPTIONS / HTTP/1.0" 200 134 0.000525
Sep 28 12:43:02 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:43:02 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:43:02 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:43:02 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:43:03 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:43:03.265 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:43:03] "OPTIONS / HTTP/1.0" 200 134 0.000498
Sep 28 12:43:04 ctl02 nova-api[6863]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:43:04 ctl02 nova-api[6863]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:43:04 ctl02 nova-api[6863]: 2017-09-28 12:43:04.529 6863 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:43:04 ctl02 nova-api[6863]: 2017-09-28 12:43:04.531 6863 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:43:04 ctl02 nova-api[6863]: 2017-09-28 12:43:04.531 6863 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:43:04 ctl02 nova-api[6863]: 2017-09-28 12:43:04.531 6863 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:43:04 ctl02 nova-api[6863]: 2017-09-28 12:43:04.531 6863 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:43:04 ctl02 nova-api[6863]: 2017-09-28 12:43:04.531 6863 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:43:04 ctl02 nova-api[6863]: 2017-09-28 12:43:04.531 6863 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:43:04 ctl02 nova-api[6863]: 2017-09-28 12:43:04.531 6863 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:43:04 ctl02 nova-api[6863]: 2017-09-28 12:43:04.531 6863 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:43:04 ctl02 nova-api[6863]: 2017-09-28 12:43:04.531 6863 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:43:04 ctl02 nova-api[6863]: 2017-09-28 12:43:04.531 6863 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:43:04 ctl02 nova-api[6863]: 2017-09-28 12:43:04.531 6863 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:43:04 ctl02 nova-api[6863]: 2017-09-28 12:43:04.531 6863 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:43:04 ctl02 nova-api[6863]: 2017-09-28 12:43:04.531 6863 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:43:04 ctl02 nova-api[6863]: 2017-09-28 12:43:04.531 6863 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:43:04 ctl02 nova-api[6863]: 2017-09-28 12:43:04.531 6863 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:43:04 ctl02 nova-api[6863]: 2017-09-28 12:43:04.531 6863 ERROR nova.wsgi     self.filename))
Sep 28 12:43:04 ctl02 nova-api[6863]: 2017-09-28 12:43:04.531 6863 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:43:04 ctl02 nova-api[6863]: 2017-09-28 12:43:04.531 6863 ERROR nova.wsgi
Sep 28 12:43:04 ctl02 nova-api[6863]: 2017-09-28 12:43:04.532 6863 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:43:04 ctl02 nova-api[6863]: 2017-09-28 12:43:04.667 6863 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:43:04 ctl02 nova-api[6863]: 2017-09-28 12:43:04.912 6863 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:43:04 ctl02 nova-api[6863]: 2017-09-28 12:43:04.914 6863 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:43:04 ctl02 nova-api[6863]: 2017-09-28 12:43:04.914 6863 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:43:04 ctl02 nova-api[6863]: 2017-09-28 12:43:04.914 6863 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:43:04 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:43:04.961 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:43:04] "OPTIONS / HTTP/1.0" 200 134 0.000467
Sep 28 12:43:05 ctl02 nova-api[6863]: 2017-09-28 12:43:05.047 6863 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:43:05 ctl02 nova-api[6863]: 2017-09-28 12:43:05.049 6863 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:43:05 ctl02 nova-api[6863]: 2017-09-28 12:43:05.049 6863 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:43:05 ctl02 nova-api[6863]: 2017-09-28 12:43:05.049 6863 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:43:05 ctl02 nova-api[6863]: 2017-09-28 12:43:05.052 6863 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:43:05 ctl02 nova-api[6863]: 2017-09-28 12:43:05.053 6863 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:43:05 ctl02 nova-api[6863]: 2017-09-28 12:43:05.053 6863 ERROR nova Traceback (most recent call last):
Sep 28 12:43:05 ctl02 nova-api[6863]: 2017-09-28 12:43:05.053 6863 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:43:05 ctl02 nova-api[6863]: 2017-09-28 12:43:05.053 6863 ERROR nova     sys.exit(main())
Sep 28 12:43:05 ctl02 nova-api[6863]: 2017-09-28 12:43:05.053 6863 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:43:05 ctl02 nova-api[6863]: 2017-09-28 12:43:05.053 6863 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:43:05 ctl02 nova-api[6863]: 2017-09-28 12:43:05.053 6863 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:43:05 ctl02 nova-api[6863]: 2017-09-28 12:43:05.053 6863 ERROR nova     max_url_len=max_url_len)
Sep 28 12:43:05 ctl02 nova-api[6863]: 2017-09-28 12:43:05.053 6863 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:43:05 ctl02 nova-api[6863]: 2017-09-28 12:43:05.053 6863 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:43:05 ctl02 nova-api[6863]: 2017-09-28 12:43:05.053 6863 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:43:05 ctl02 nova-api[6863]: 2017-09-28 12:43:05.053 6863 ERROR nova     sock.listen(backlog)
Sep 28 12:43:05 ctl02 nova-api[6863]: 2017-09-28 12:43:05.053 6863 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:43:05 ctl02 nova-api[6863]: 2017-09-28 12:43:05.053 6863 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:43:05 ctl02 nova-api[6863]: 2017-09-28 12:43:05.053 6863 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:43:05 ctl02 nova-api[6863]: 2017-09-28 12:43:05.053 6863 ERROR nova
Sep 28 12:43:05 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:43:05 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:43:05 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:43:05 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:43:05 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:43:05 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:43:05 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:43:05 ctl02 heat-api[13008]: 2017-09-28 12:43:05.598 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:43:05] "OPTIONS / HTTP/1.0" 200 134 0.000957
Sep 28 12:43:06 ctl02 neutron-server[30536]: 2017-09-28 12:43:06.278 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 12:43:06 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:43:06 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:41:28 cmp001
Sep 28 12:43:06 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:41:20 cmp002
Sep 28 12:43:06 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:41:16 cmp002
Sep 28 12:43:07 ctl02 heat-api[13008]: 2017-09-28 12:43:07.020 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:43:07] "OPTIONS / HTTP/1.0" 200 134 0.000536
Sep 28 12:43:07 ctl02 nova-api[6880]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:43:07 ctl02 nova-api[6880]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:43:07 ctl02 nova-api[6880]: 2017-09-28 12:43:07.301 6880 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:43:07 ctl02 nova-api[6880]: 2017-09-28 12:43:07.303 6880 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:43:07 ctl02 nova-api[6880]: 2017-09-28 12:43:07.303 6880 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:43:07 ctl02 nova-api[6880]: 2017-09-28 12:43:07.303 6880 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:43:07 ctl02 nova-api[6880]: 2017-09-28 12:43:07.303 6880 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:43:07 ctl02 nova-api[6880]: 2017-09-28 12:43:07.303 6880 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:43:07 ctl02 nova-api[6880]: 2017-09-28 12:43:07.303 6880 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:43:07 ctl02 nova-api[6880]: 2017-09-28 12:43:07.303 6880 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:43:07 ctl02 nova-api[6880]: 2017-09-28 12:43:07.303 6880 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:43:07 ctl02 nova-api[6880]: 2017-09-28 12:43:07.303 6880 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:43:07 ctl02 nova-api[6880]: 2017-09-28 12:43:07.303 6880 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:43:07 ctl02 nova-api[6880]: 2017-09-28 12:43:07.303 6880 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:43:07 ctl02 nova-api[6880]: 2017-09-28 12:43:07.303 6880 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:43:07 ctl02 nova-api[6880]: 2017-09-28 12:43:07.303 6880 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:43:07 ctl02 nova-api[6880]: 2017-09-28 12:43:07.303 6880 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:43:07 ctl02 nova-api[6880]: 2017-09-28 12:43:07.303 6880 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:43:07 ctl02 nova-api[6880]: 2017-09-28 12:43:07.303 6880 ERROR nova.wsgi     self.filename))
Sep 28 12:43:07 ctl02 nova-api[6880]: 2017-09-28 12:43:07.303 6880 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:43:07 ctl02 nova-api[6880]: 2017-09-28 12:43:07.303 6880 ERROR nova.wsgi
Sep 28 12:43:07 ctl02 nova-api[6880]: 2017-09-28 12:43:07.304 6880 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:43:07 ctl02 nova-api[6880]: 2017-09-28 12:43:07.437 6880 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:43:07 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x51ec3a02)
Sep 28 12:43:07 ctl02 nova-api[6880]: 2017-09-28 12:43:07.690 6880 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:43:07 ctl02 nova-api[6880]: 2017-09-28 12:43:07.693 6880 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:43:07 ctl02 nova-api[6880]: 2017-09-28 12:43:07.693 6880 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:43:07 ctl02 nova-api[6880]: 2017-09-28 12:43:07.693 6880 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:43:07 ctl02 nova-api[6880]: 2017-09-28 12:43:07.826 6880 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:43:07 ctl02 nova-api[6880]: 2017-09-28 12:43:07.828 6880 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:43:07 ctl02 nova-api[6880]: 2017-09-28 12:43:07.828 6880 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:43:07 ctl02 nova-api[6880]: 2017-09-28 12:43:07.828 6880 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:43:07 ctl02 nova-api[6880]: 2017-09-28 12:43:07.832 6880 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:43:07 ctl02 nova-api[6880]: 2017-09-28 12:43:07.832 6880 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:43:07 ctl02 nova-api[6880]: 2017-09-28 12:43:07.832 6880 ERROR nova Traceback (most recent call last):
Sep 28 12:43:07 ctl02 nova-api[6880]: 2017-09-28 12:43:07.832 6880 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:43:07 ctl02 nova-api[6880]: 2017-09-28 12:43:07.832 6880 ERROR nova     sys.exit(main())
Sep 28 12:43:07 ctl02 nova-api[6880]: 2017-09-28 12:43:07.832 6880 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:43:07 ctl02 nova-api[6880]: 2017-09-28 12:43:07.832 6880 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:43:07 ctl02 nova-api[6880]: 2017-09-28 12:43:07.832 6880 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:43:07 ctl02 nova-api[6880]: 2017-09-28 12:43:07.832 6880 ERROR nova     max_url_len=max_url_len)
Sep 28 12:43:07 ctl02 nova-api[6880]: 2017-09-28 12:43:07.832 6880 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:43:07 ctl02 nova-api[6880]: 2017-09-28 12:43:07.832 6880 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:43:07 ctl02 nova-api[6880]: 2017-09-28 12:43:07.832 6880 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:43:07 ctl02 nova-api[6880]: 2017-09-28 12:43:07.832 6880 ERROR nova     sock.listen(backlog)
Sep 28 12:43:07 ctl02 nova-api[6880]: 2017-09-28 12:43:07.832 6880 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:43:07 ctl02 nova-api[6880]: 2017-09-28 12:43:07.832 6880 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:43:07 ctl02 nova-api[6880]: 2017-09-28 12:43:07.832 6880 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:43:07 ctl02 nova-api[6880]: 2017-09-28 12:43:07.832 6880 ERROR nova
Sep 28 12:43:08 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:43:08 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:43:08 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:43:08 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:43:08 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:43:08 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:43:08 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:43:08 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x51ec3a02)
Sep 28 12:43:08 ctl02 heat-api[13008]: 2017-09-28 12:43:08.692 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:43:08] "OPTIONS / HTTP/1.0" 200 134 0.000635
Sep 28 12:43:09 ctl02 heat-api-cfn[13300]: 2017-09-28 12:43:09.242 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:43:09] "OPTIONS / HTTP/1.0" 200 134 0.000480
Sep 28 12:43:09 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:43:09.428 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:43:09] "OPTIONS / HTTP/1.0" 200 134 0.000463
Sep 28 12:43:09 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x51ec3a02)
Sep 28 12:43:09 ctl02 neutron-server[30536]: 2017-09-28 12:43:09.657 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:43:09] "OPTIONS / HTTP/1.0" 200 262 0.000535
Sep 28 12:43:09 ctl02 heat-api-cfn[13300]: 2017-09-28 12:43:09.806 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:43:09] "OPTIONS / HTTP/1.0" 200 134 0.000454
Sep 28 12:43:09 ctl02 nova-api[6899]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:43:09 ctl02 nova-api[6899]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:43:10 ctl02 nova-api[6899]: 2017-09-28 12:43:10.030 6899 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:43:10 ctl02 nova-api[6899]: 2017-09-28 12:43:10.031 6899 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:43:10 ctl02 nova-api[6899]: 2017-09-28 12:43:10.031 6899 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:43:10 ctl02 nova-api[6899]: 2017-09-28 12:43:10.031 6899 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:43:10 ctl02 nova-api[6899]: 2017-09-28 12:43:10.031 6899 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:43:10 ctl02 nova-api[6899]: 2017-09-28 12:43:10.031 6899 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:43:10 ctl02 nova-api[6899]: 2017-09-28 12:43:10.031 6899 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:43:10 ctl02 nova-api[6899]: 2017-09-28 12:43:10.031 6899 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:43:10 ctl02 nova-api[6899]: 2017-09-28 12:43:10.031 6899 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:43:10 ctl02 nova-api[6899]: 2017-09-28 12:43:10.031 6899 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:43:10 ctl02 nova-api[6899]: 2017-09-28 12:43:10.031 6899 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:43:10 ctl02 nova-api[6899]: 2017-09-28 12:43:10.031 6899 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:43:10 ctl02 nova-api[6899]: 2017-09-28 12:43:10.031 6899 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:43:10 ctl02 nova-api[6899]: 2017-09-28 12:43:10.031 6899 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:43:10 ctl02 nova-api[6899]: 2017-09-28 12:43:10.031 6899 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:43:10 ctl02 nova-api[6899]: 2017-09-28 12:43:10.031 6899 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:43:10 ctl02 nova-api[6899]: 2017-09-28 12:43:10.031 6899 ERROR nova.wsgi     self.filename))
Sep 28 12:43:10 ctl02 nova-api[6899]: 2017-09-28 12:43:10.031 6899 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:43:10 ctl02 nova-api[6899]: 2017-09-28 12:43:10.031 6899 ERROR nova.wsgi
Sep 28 12:43:10 ctl02 nova-api[6899]: 2017-09-28 12:43:10.032 6899 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:43:10 ctl02 nova-api[6899]: 2017-09-28 12:43:10.162 6899 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:43:10 ctl02 neutron-server[30536]: 2017-09-28 12:43:10.280 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:43:10] "OPTIONS / HTTP/1.0" 200 262 0.000572
Sep 28 12:43:10 ctl02 nova-api[6899]: 2017-09-28 12:43:10.405 6899 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:43:10 ctl02 nova-api[6899]: 2017-09-28 12:43:10.408 6899 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:43:10 ctl02 nova-api[6899]: 2017-09-28 12:43:10.409 6899 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:43:10 ctl02 nova-api[6899]: 2017-09-28 12:43:10.409 6899 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:43:10 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x51ec3a02)
Sep 28 12:43:10 ctl02 nova-api[6899]: 2017-09-28 12:43:10.541 6899 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:43:10 ctl02 nova-api[6899]: 2017-09-28 12:43:10.543 6899 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:43:10 ctl02 nova-api[6899]: 2017-09-28 12:43:10.544 6899 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:43:10 ctl02 nova-api[6899]: 2017-09-28 12:43:10.544 6899 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:43:10 ctl02 nova-api[6899]: 2017-09-28 12:43:10.547 6899 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:43:10 ctl02 nova-api[6899]: 2017-09-28 12:43:10.548 6899 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:43:10 ctl02 nova-api[6899]: 2017-09-28 12:43:10.548 6899 ERROR nova Traceback (most recent call last):
Sep 28 12:43:10 ctl02 nova-api[6899]: 2017-09-28 12:43:10.548 6899 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:43:10 ctl02 nova-api[6899]: 2017-09-28 12:43:10.548 6899 ERROR nova     sys.exit(main())
Sep 28 12:43:10 ctl02 nova-api[6899]: 2017-09-28 12:43:10.548 6899 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:43:10 ctl02 nova-api[6899]: 2017-09-28 12:43:10.548 6899 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:43:10 ctl02 nova-api[6899]: 2017-09-28 12:43:10.548 6899 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:43:10 ctl02 nova-api[6899]: 2017-09-28 12:43:10.548 6899 ERROR nova     max_url_len=max_url_len)
Sep 28 12:43:10 ctl02 nova-api[6899]: 2017-09-28 12:43:10.548 6899 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:43:10 ctl02 nova-api[6899]: 2017-09-28 12:43:10.548 6899 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:43:10 ctl02 nova-api[6899]: 2017-09-28 12:43:10.548 6899 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:43:10 ctl02 nova-api[6899]: 2017-09-28 12:43:10.548 6899 ERROR nova     sock.listen(backlog)
Sep 28 12:43:10 ctl02 nova-api[6899]: 2017-09-28 12:43:10.548 6899 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:43:10 ctl02 nova-api[6899]: 2017-09-28 12:43:10.548 6899 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:43:10 ctl02 nova-api[6899]: 2017-09-28 12:43:10.548 6899 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:43:10 ctl02 nova-api[6899]: 2017-09-28 12:43:10.548 6899 ERROR nova
Sep 28 12:43:10 ctl02 neutron-server[30536]: 2017-09-28 12:43:10.604 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:43:10] "OPTIONS / HTTP/1.0" 200 262 0.000536
Sep 28 12:43:10 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:43:10 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:43:10 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:43:10 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:43:10 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:43:10 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:43:10 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:43:11 ctl02 glance-api[29183]: 2017-09-28 12:43:11.014 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:43:11] "OPTIONS / HTTP/1.0" 200 134 0.000577
Sep 28 12:43:11 ctl02 glance-api[29183]: 2017-09-28 12:43:11.094 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:43:11] "OPTIONS / HTTP/1.0" 200 134 0.000532
Sep 28 12:43:11 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x51ec3a02)
Sep 28 12:43:12 ctl02 glance-api[29183]: 2017-09-28 12:43:12.186 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:43:12] "OPTIONS / HTTP/1.0" 200 134 0.000543
Sep 28 12:43:12 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x51ec3a02)
Sep 28 12:43:12 ctl02 nova-api[6917]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:43:12 ctl02 nova-api[6917]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:43:12 ctl02 nova-api[6917]: 2017-09-28 12:43:12.748 6917 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:43:12 ctl02 nova-api[6917]: 2017-09-28 12:43:12.749 6917 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:43:12 ctl02 nova-api[6917]: 2017-09-28 12:43:12.749 6917 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:43:12 ctl02 nova-api[6917]: 2017-09-28 12:43:12.749 6917 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:43:12 ctl02 nova-api[6917]: 2017-09-28 12:43:12.749 6917 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:43:12 ctl02 nova-api[6917]: 2017-09-28 12:43:12.749 6917 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:43:12 ctl02 nova-api[6917]: 2017-09-28 12:43:12.749 6917 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:43:12 ctl02 nova-api[6917]: 2017-09-28 12:43:12.749 6917 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:43:12 ctl02 nova-api[6917]: 2017-09-28 12:43:12.749 6917 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:43:12 ctl02 nova-api[6917]: 2017-09-28 12:43:12.749 6917 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:43:12 ctl02 nova-api[6917]: 2017-09-28 12:43:12.749 6917 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:43:12 ctl02 nova-api[6917]: 2017-09-28 12:43:12.749 6917 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:43:12 ctl02 nova-api[6917]: 2017-09-28 12:43:12.749 6917 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:43:12 ctl02 nova-api[6917]: 2017-09-28 12:43:12.749 6917 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:43:12 ctl02 nova-api[6917]: 2017-09-28 12:43:12.749 6917 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:43:12 ctl02 nova-api[6917]: 2017-09-28 12:43:12.749 6917 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:43:12 ctl02 nova-api[6917]: 2017-09-28 12:43:12.749 6917 ERROR nova.wsgi     self.filename))
Sep 28 12:43:12 ctl02 nova-api[6917]: 2017-09-28 12:43:12.749 6917 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:43:12 ctl02 nova-api[6917]: 2017-09-28 12:43:12.749 6917 ERROR nova.wsgi
Sep 28 12:43:12 ctl02 nova-api[6917]: 2017-09-28 12:43:12.750 6917 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:43:12 ctl02 nova-api[6917]: 2017-09-28 12:43:12.878 6917 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:43:12 ctl02 heat-api-cfn[13300]: 2017-09-28 12:43:12.906 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:43:12] "OPTIONS / HTTP/1.0" 200 134 0.000513
Sep 28 12:43:13 ctl02 nova-api[6917]: 2017-09-28 12:43:13.105 6917 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:43:13 ctl02 nova-api[6917]: 2017-09-28 12:43:13.107 6917 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:43:13 ctl02 nova-api[6917]: 2017-09-28 12:43:13.107 6917 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:43:13 ctl02 nova-api[6917]: 2017-09-28 12:43:13.107 6917 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:43:13 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:43:13.131 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:43:13] "OPTIONS / HTTP/1.0" 200 134 0.000372
Sep 28 12:43:13 ctl02 nova-api[6917]: 2017-09-28 12:43:13.238 6917 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:43:13 ctl02 nova-api[6917]: 2017-09-28 12:43:13.240 6917 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:43:13 ctl02 nova-api[6917]: 2017-09-28 12:43:13.240 6917 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:43:13 ctl02 nova-api[6917]: 2017-09-28 12:43:13.240 6917 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:43:13 ctl02 nova-api[6917]: 2017-09-28 12:43:13.243 6917 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:43:13 ctl02 nova-api[6917]: 2017-09-28 12:43:13.244 6917 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:43:13 ctl02 nova-api[6917]: 2017-09-28 12:43:13.244 6917 ERROR nova Traceback (most recent call last):
Sep 28 12:43:13 ctl02 nova-api[6917]: 2017-09-28 12:43:13.244 6917 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:43:13 ctl02 nova-api[6917]: 2017-09-28 12:43:13.244 6917 ERROR nova     sys.exit(main())
Sep 28 12:43:13 ctl02 nova-api[6917]: 2017-09-28 12:43:13.244 6917 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:43:13 ctl02 nova-api[6917]: 2017-09-28 12:43:13.244 6917 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:43:13 ctl02 nova-api[6917]: 2017-09-28 12:43:13.244 6917 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:43:13 ctl02 nova-api[6917]: 2017-09-28 12:43:13.244 6917 ERROR nova     max_url_len=max_url_len)
Sep 28 12:43:13 ctl02 nova-api[6917]: 2017-09-28 12:43:13.244 6917 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:43:13 ctl02 nova-api[6917]: 2017-09-28 12:43:13.244 6917 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:43:13 ctl02 nova-api[6917]: 2017-09-28 12:43:13.244 6917 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:43:13 ctl02 nova-api[6917]: 2017-09-28 12:43:13.244 6917 ERROR nova     sock.listen(backlog)
Sep 28 12:43:13 ctl02 nova-api[6917]: 2017-09-28 12:43:13.244 6917 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:43:13 ctl02 nova-api[6917]: 2017-09-28 12:43:13.244 6917 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:43:13 ctl02 nova-api[6917]: 2017-09-28 12:43:13.244 6917 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:43:13 ctl02 nova-api[6917]: 2017-09-28 12:43:13.244 6917 ERROR nova
Sep 28 12:43:13 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:43:13 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:43:13 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:43:13 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x51ec3a02)
Sep 28 12:43:13 ctl02 neutron-server[30536]: 2017-09-28 12:43:13.491 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:43:13 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:43:13 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:43:13 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:43:13 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:43:14 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x51ec3a02)
Sep 28 12:43:15 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:43:15.277 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:43:15] "OPTIONS / HTTP/1.0" 200 134 0.000469
Sep 28 12:43:15 ctl02 nova-api[6935]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:43:15 ctl02 nova-api[6935]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:43:15 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x51ec3a02)
Sep 28 12:43:15 ctl02 nova-api[6935]: 2017-09-28 12:43:15.508 6935 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:43:15 ctl02 nova-api[6935]: 2017-09-28 12:43:15.510 6935 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:43:15 ctl02 nova-api[6935]: 2017-09-28 12:43:15.510 6935 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:43:15 ctl02 nova-api[6935]: 2017-09-28 12:43:15.510 6935 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:43:15 ctl02 nova-api[6935]: 2017-09-28 12:43:15.510 6935 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:43:15 ctl02 nova-api[6935]: 2017-09-28 12:43:15.510 6935 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:43:15 ctl02 nova-api[6935]: 2017-09-28 12:43:15.510 6935 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:43:15 ctl02 nova-api[6935]: 2017-09-28 12:43:15.510 6935 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:43:15 ctl02 nova-api[6935]: 2017-09-28 12:43:15.510 6935 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:43:15 ctl02 nova-api[6935]: 2017-09-28 12:43:15.510 6935 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:43:15 ctl02 nova-api[6935]: 2017-09-28 12:43:15.510 6935 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:43:15 ctl02 nova-api[6935]: 2017-09-28 12:43:15.510 6935 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:43:15 ctl02 nova-api[6935]: 2017-09-28 12:43:15.510 6935 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:43:15 ctl02 nova-api[6935]: 2017-09-28 12:43:15.510 6935 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:43:15 ctl02 nova-api[6935]: 2017-09-28 12:43:15.510 6935 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:43:15 ctl02 nova-api[6935]: 2017-09-28 12:43:15.510 6935 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:43:15 ctl02 nova-api[6935]: 2017-09-28 12:43:15.510 6935 ERROR nova.wsgi     self.filename))
Sep 28 12:43:15 ctl02 nova-api[6935]: 2017-09-28 12:43:15.510 6935 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:43:15 ctl02 nova-api[6935]: 2017-09-28 12:43:15.510 6935 ERROR nova.wsgi
Sep 28 12:43:15 ctl02 nova-api[6935]: 2017-09-28 12:43:15.510 6935 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:43:15 ctl02 heat-api[13008]: 2017-09-28 12:43:15.541 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:43:15] "OPTIONS / HTTP/1.0" 200 134 0.000565
Sep 28 12:43:15 ctl02 nova-api[6935]: 2017-09-28 12:43:15.647 6935 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:43:15 ctl02 nova-api[6935]: 2017-09-28 12:43:15.896 6935 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:43:15 ctl02 nova-api[6935]: 2017-09-28 12:43:15.898 6935 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:43:15 ctl02 nova-api[6935]: 2017-09-28 12:43:15.899 6935 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:43:15 ctl02 nova-api[6935]: 2017-09-28 12:43:15.899 6935 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:43:16 ctl02 nova-api[6935]: 2017-09-28 12:43:16.035 6935 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:43:16 ctl02 nova-api[6935]: 2017-09-28 12:43:16.037 6935 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:43:16 ctl02 nova-api[6935]: 2017-09-28 12:43:16.037 6935 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:43:16 ctl02 nova-api[6935]: 2017-09-28 12:43:16.037 6935 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:43:16 ctl02 nova-api[6935]: 2017-09-28 12:43:16.041 6935 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:43:16 ctl02 nova-api[6935]: 2017-09-28 12:43:16.041 6935 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:43:16 ctl02 nova-api[6935]: 2017-09-28 12:43:16.041 6935 ERROR nova Traceback (most recent call last):
Sep 28 12:43:16 ctl02 nova-api[6935]: 2017-09-28 12:43:16.041 6935 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:43:16 ctl02 nova-api[6935]: 2017-09-28 12:43:16.041 6935 ERROR nova     sys.exit(main())
Sep 28 12:43:16 ctl02 nova-api[6935]: 2017-09-28 12:43:16.041 6935 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:43:16 ctl02 nova-api[6935]: 2017-09-28 12:43:16.041 6935 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:43:16 ctl02 nova-api[6935]: 2017-09-28 12:43:16.041 6935 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:43:16 ctl02 nova-api[6935]: 2017-09-28 12:43:16.041 6935 ERROR nova     max_url_len=max_url_len)
Sep 28 12:43:16 ctl02 nova-api[6935]: 2017-09-28 12:43:16.041 6935 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:43:16 ctl02 nova-api[6935]: 2017-09-28 12:43:16.041 6935 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:43:16 ctl02 nova-api[6935]: 2017-09-28 12:43:16.041 6935 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:43:16 ctl02 nova-api[6935]: 2017-09-28 12:43:16.041 6935 ERROR nova     sock.listen(backlog)
Sep 28 12:43:16 ctl02 nova-api[6935]: 2017-09-28 12:43:16.041 6935 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:43:16 ctl02 nova-api[6935]: 2017-09-28 12:43:16.041 6935 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:43:16 ctl02 nova-api[6935]: 2017-09-28 12:43:16.041 6935 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:43:16 ctl02 nova-api[6935]: 2017-09-28 12:43:16.041 6935 ERROR nova
Sep 28 12:43:16 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:43:16 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:43:16 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:43:16 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:43:16 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:43:16 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:43:16 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:43:16 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x51ec3a02)
Sep 28 12:43:17 ctl02 heat-api[13008]: 2017-09-28 12:43:17.205 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:43:17] "OPTIONS / HTTP/1.0" 200 134 0.000547
Sep 28 12:43:17 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x51ec3a02)
Sep 28 12:43:18 ctl02 nova-api[6953]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:43:18 ctl02 nova-api[6953]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:43:18 ctl02 nova-api[6953]: 2017-09-28 12:43:18.219 6953 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:43:18 ctl02 nova-api[6953]: 2017-09-28 12:43:18.221 6953 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:43:18 ctl02 nova-api[6953]: 2017-09-28 12:43:18.221 6953 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:43:18 ctl02 nova-api[6953]: 2017-09-28 12:43:18.221 6953 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:43:18 ctl02 nova-api[6953]: 2017-09-28 12:43:18.221 6953 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:43:18 ctl02 nova-api[6953]: 2017-09-28 12:43:18.221 6953 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:43:18 ctl02 nova-api[6953]: 2017-09-28 12:43:18.221 6953 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:43:18 ctl02 nova-api[6953]: 2017-09-28 12:43:18.221 6953 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:43:18 ctl02 nova-api[6953]: 2017-09-28 12:43:18.221 6953 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:43:18 ctl02 nova-api[6953]: 2017-09-28 12:43:18.221 6953 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:43:18 ctl02 nova-api[6953]: 2017-09-28 12:43:18.221 6953 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:43:18 ctl02 nova-api[6953]: 2017-09-28 12:43:18.221 6953 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:43:18 ctl02 nova-api[6953]: 2017-09-28 12:43:18.221 6953 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:43:18 ctl02 nova-api[6953]: 2017-09-28 12:43:18.221 6953 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:43:18 ctl02 nova-api[6953]: 2017-09-28 12:43:18.221 6953 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:43:18 ctl02 nova-api[6953]: 2017-09-28 12:43:18.221 6953 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:43:18 ctl02 nova-api[6953]: 2017-09-28 12:43:18.221 6953 ERROR nova.wsgi     self.filename))
Sep 28 12:43:18 ctl02 nova-api[6953]: 2017-09-28 12:43:18.221 6953 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:43:18 ctl02 nova-api[6953]: 2017-09-28 12:43:18.221 6953 ERROR nova.wsgi
Sep 28 12:43:18 ctl02 nova-api[6953]: 2017-09-28 12:43:18.222 6953 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:43:18 ctl02 nova-api[6953]: 2017-09-28 12:43:18.348 6953 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:43:18 ctl02 heat-api[13008]: 2017-09-28 12:43:18.358 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:43:18] "OPTIONS / HTTP/1.0" 200 134 0.000538
Sep 28 12:43:18 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:43:18 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:43:18 ctl02 neutron-server[30536]: 2017-09-28 12:43:18.515 30598 WARNING oslo_messaging._drivers.amqpdriver [req-650aa763-5dc9-463f-baad-9cc681c08f49 - - - - -] reply_478d4506adbd4b429e6571775a54699c doesn't exists, drop reply to f9a398706d2d4d4cbff14c9dc0b259c2
Sep 28 12:43:18 ctl02 neutron-server[30536]: 2017-09-28 12:43:18.515 30598 INFO oslo_messaging._drivers.amqpdriver [req-650aa763-5dc9-463f-baad-9cc681c08f49 - - - - -] The reply f9a398706d2d4d4cbff14c9dc0b259c2 cannot be sent  reply_478d4506adbd4b429e6571775a54699c reply queue don't exist after 60 sec abandoning...
Sep 28 12:43:18 ctl02 nova-api[6953]: 2017-09-28 12:43:18.574 6953 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:43:18 ctl02 nova-api[6953]: 2017-09-28 12:43:18.576 6953 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:43:18 ctl02 nova-api[6953]: 2017-09-28 12:43:18.577 6953 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:43:18 ctl02 nova-api[6953]: 2017-09-28 12:43:18.577 6953 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:43:18 ctl02 nova-cert[4860]: 2017-09-28 12:43:18.653 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:43:18 ctl02 nova-api[6953]: 2017-09-28 12:43:18.707 6953 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:43:18 ctl02 nova-api[6953]: 2017-09-28 12:43:18.709 6953 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:43:18 ctl02 nova-api[6953]: 2017-09-28 12:43:18.709 6953 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:43:18 ctl02 nova-api[6953]: 2017-09-28 12:43:18.709 6953 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:43:18 ctl02 nova-api[6953]: 2017-09-28 12:43:18.712 6953 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:43:18 ctl02 nova-api[6953]: 2017-09-28 12:43:18.712 6953 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:43:18 ctl02 nova-api[6953]: 2017-09-28 12:43:18.712 6953 ERROR nova Traceback (most recent call last):
Sep 28 12:43:18 ctl02 nova-api[6953]: 2017-09-28 12:43:18.712 6953 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:43:18 ctl02 nova-api[6953]: 2017-09-28 12:43:18.712 6953 ERROR nova     sys.exit(main())
Sep 28 12:43:18 ctl02 nova-api[6953]: 2017-09-28 12:43:18.712 6953 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:43:18 ctl02 nova-api[6953]: 2017-09-28 12:43:18.712 6953 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:43:18 ctl02 nova-api[6953]: 2017-09-28 12:43:18.712 6953 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:43:18 ctl02 nova-api[6953]: 2017-09-28 12:43:18.712 6953 ERROR nova     max_url_len=max_url_len)
Sep 28 12:43:18 ctl02 nova-api[6953]: 2017-09-28 12:43:18.712 6953 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:43:18 ctl02 nova-api[6953]: 2017-09-28 12:43:18.712 6953 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:43:18 ctl02 nova-api[6953]: 2017-09-28 12:43:18.712 6953 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:43:18 ctl02 nova-api[6953]: 2017-09-28 12:43:18.712 6953 ERROR nova     sock.listen(backlog)
Sep 28 12:43:18 ctl02 nova-api[6953]: 2017-09-28 12:43:18.712 6953 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:43:18 ctl02 nova-api[6953]: 2017-09-28 12:43:18.712 6953 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:43:18 ctl02 nova-api[6953]: 2017-09-28 12:43:18.712 6953 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:43:18 ctl02 nova-api[6953]: 2017-09-28 12:43:18.712 6953 ERROR nova
Sep 28 12:43:18 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:43:18 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:43:18 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:43:18 ctl02 nova-conductor[5056]: 2017-09-28 12:43:18.949 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:43:18 ctl02 nova-conductor[5056]: 2017-09-28 12:43:18.969 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:43:18 ctl02 nova-conductor[5056]: 2017-09-28 12:43:18.994 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:43:18 ctl02 nova-conductor[5056]: 2017-09-28 12:43:18.994 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:43:19 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:43:19 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:43:19 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:43:19 ctl02 heat-api-cfn[13300]: 2017-09-28 12:43:19.143 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:43:19] "OPTIONS / HTTP/1.0" 200 134 0.000901
Sep 28 12:43:19 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:43:19 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:43:19.148 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:43:19] "OPTIONS / HTTP/1.0" 200 134 0.000508
Sep 28 12:43:19 ctl02 neutron-server[30536]: 2017-09-28 12:43:19.705 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:43:19] "OPTIONS / HTTP/1.0" 200 262 0.000513
Sep 28 12:43:19 ctl02 heat-api-cfn[13300]: 2017-09-28 12:43:19.835 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:43:19] "OPTIONS / HTTP/1.0" 200 134 0.000447
Sep 28 12:43:20 ctl02 neutron-server[30536]: 2017-09-28 12:43:20.508 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:43:20] "OPTIONS / HTTP/1.0" 200 262 0.000543
Sep 28 12:43:20 ctl02 neutron-server[30536]: 2017-09-28 12:43:20.811 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:43:20] "OPTIONS / HTTP/1.0" 200 262 0.000491
Sep 28 12:43:20 ctl02 nova-api[6977]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:43:20 ctl02 nova-api[6977]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:43:20 ctl02 glance-api[29183]: 2017-09-28 12:43:20.918 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:43:20] "OPTIONS / HTTP/1.0" 200 134 0.000697
Sep 28 12:43:21 ctl02 nova-api[6977]: 2017-09-28 12:43:21.042 6977 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:43:21 ctl02 nova-api[6977]: 2017-09-28 12:43:21.044 6977 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:43:21 ctl02 nova-api[6977]: 2017-09-28 12:43:21.044 6977 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:43:21 ctl02 nova-api[6977]: 2017-09-28 12:43:21.044 6977 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:43:21 ctl02 nova-api[6977]: 2017-09-28 12:43:21.044 6977 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:43:21 ctl02 nova-api[6977]: 2017-09-28 12:43:21.044 6977 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:43:21 ctl02 nova-api[6977]: 2017-09-28 12:43:21.044 6977 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:43:21 ctl02 nova-api[6977]: 2017-09-28 12:43:21.044 6977 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:43:21 ctl02 nova-api[6977]: 2017-09-28 12:43:21.044 6977 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:43:21 ctl02 nova-api[6977]: 2017-09-28 12:43:21.044 6977 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:43:21 ctl02 nova-api[6977]: 2017-09-28 12:43:21.044 6977 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:43:21 ctl02 nova-api[6977]: 2017-09-28 12:43:21.044 6977 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:43:21 ctl02 nova-api[6977]: 2017-09-28 12:43:21.044 6977 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:43:21 ctl02 nova-api[6977]: 2017-09-28 12:43:21.044 6977 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:43:21 ctl02 nova-api[6977]: 2017-09-28 12:43:21.044 6977 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:43:21 ctl02 nova-api[6977]: 2017-09-28 12:43:21.044 6977 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:43:21 ctl02 nova-api[6977]: 2017-09-28 12:43:21.044 6977 ERROR nova.wsgi     self.filename))
Sep 28 12:43:21 ctl02 nova-api[6977]: 2017-09-28 12:43:21.044 6977 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:43:21 ctl02 nova-api[6977]: 2017-09-28 12:43:21.044 6977 ERROR nova.wsgi
Sep 28 12:43:21 ctl02 nova-api[6977]: 2017-09-28 12:43:21.045 6977 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:43:21 ctl02 nova-api[6977]: 2017-09-28 12:43:21.181 6977 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:43:21 ctl02 neutron-server[30536]: 2017-09-28 12:43:21.283 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 1 dead agents out of 6:
Sep 28 12:43:21 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:43:21 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:41:28 cmp001
Sep 28 12:43:21 ctl02 glance-api[29183]: 2017-09-28 12:43:21.409 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:43:21] "OPTIONS / HTTP/1.0" 200 134 0.000650
Sep 28 12:43:21 ctl02 nova-api[6977]: 2017-09-28 12:43:21.432 6977 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:43:21 ctl02 nova-api[6977]: 2017-09-28 12:43:21.434 6977 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:43:21 ctl02 nova-api[6977]: 2017-09-28 12:43:21.435 6977 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:43:21 ctl02 nova-api[6977]: 2017-09-28 12:43:21.435 6977 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:43:21 ctl02 nova-api[6977]: 2017-09-28 12:43:21.570 6977 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:43:21 ctl02 nova-api[6977]: 2017-09-28 12:43:21.572 6977 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:43:21 ctl02 nova-api[6977]: 2017-09-28 12:43:21.572 6977 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:43:21 ctl02 nova-api[6977]: 2017-09-28 12:43:21.573 6977 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:43:21 ctl02 nova-api[6977]: 2017-09-28 12:43:21.576 6977 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:43:21 ctl02 nova-api[6977]: 2017-09-28 12:43:21.577 6977 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:43:21 ctl02 nova-api[6977]: 2017-09-28 12:43:21.577 6977 ERROR nova Traceback (most recent call last):
Sep 28 12:43:21 ctl02 nova-api[6977]: 2017-09-28 12:43:21.577 6977 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:43:21 ctl02 nova-api[6977]: 2017-09-28 12:43:21.577 6977 ERROR nova     sys.exit(main())
Sep 28 12:43:21 ctl02 nova-api[6977]: 2017-09-28 12:43:21.577 6977 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:43:21 ctl02 nova-api[6977]: 2017-09-28 12:43:21.577 6977 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:43:21 ctl02 nova-api[6977]: 2017-09-28 12:43:21.577 6977 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:43:21 ctl02 nova-api[6977]: 2017-09-28 12:43:21.577 6977 ERROR nova     max_url_len=max_url_len)
Sep 28 12:43:21 ctl02 nova-api[6977]: 2017-09-28 12:43:21.577 6977 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:43:21 ctl02 nova-api[6977]: 2017-09-28 12:43:21.577 6977 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:43:21 ctl02 nova-api[6977]: 2017-09-28 12:43:21.577 6977 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:43:21 ctl02 nova-api[6977]: 2017-09-28 12:43:21.577 6977 ERROR nova     sock.listen(backlog)
Sep 28 12:43:21 ctl02 nova-api[6977]: 2017-09-28 12:43:21.577 6977 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:43:21 ctl02 nova-api[6977]: 2017-09-28 12:43:21.577 6977 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:43:21 ctl02 nova-api[6977]: 2017-09-28 12:43:21.577 6977 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:43:21 ctl02 nova-api[6977]: 2017-09-28 12:43:21.577 6977 ERROR nova
Sep 28 12:43:21 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:43:21 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:43:21 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:43:21 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:43:21 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:43:21 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:43:21 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:43:22 ctl02 glance-api[29183]: 2017-09-28 12:43:22.193 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:43:22] "OPTIONS / HTTP/1.0" 200 134 0.000628
Sep 28 12:43:23 ctl02 heat-api-cfn[13300]: 2017-09-28 12:43:23.003 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:43:23] "OPTIONS / HTTP/1.0" 200 134 0.000492
Sep 28 12:43:23 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:43:23.515 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:43:23] "OPTIONS / HTTP/1.0" 200 134 0.000492
Sep 28 12:43:23 ctl02 nova-api[6994]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:43:23 ctl02 nova-api[6994]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:43:23 ctl02 nova-api[6994]: 2017-09-28 12:43:23.781 6994 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:43:23 ctl02 nova-api[6994]: 2017-09-28 12:43:23.783 6994 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:43:23 ctl02 nova-api[6994]: 2017-09-28 12:43:23.783 6994 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:43:23 ctl02 nova-api[6994]: 2017-09-28 12:43:23.783 6994 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:43:23 ctl02 nova-api[6994]: 2017-09-28 12:43:23.783 6994 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:43:23 ctl02 nova-api[6994]: 2017-09-28 12:43:23.783 6994 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:43:23 ctl02 nova-api[6994]: 2017-09-28 12:43:23.783 6994 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:43:23 ctl02 nova-api[6994]: 2017-09-28 12:43:23.783 6994 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:43:23 ctl02 nova-api[6994]: 2017-09-28 12:43:23.783 6994 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:43:23 ctl02 nova-api[6994]: 2017-09-28 12:43:23.783 6994 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:43:23 ctl02 nova-api[6994]: 2017-09-28 12:43:23.783 6994 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:43:23 ctl02 nova-api[6994]: 2017-09-28 12:43:23.783 6994 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:43:23 ctl02 nova-api[6994]: 2017-09-28 12:43:23.783 6994 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:43:23 ctl02 nova-api[6994]: 2017-09-28 12:43:23.783 6994 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:43:23 ctl02 nova-api[6994]: 2017-09-28 12:43:23.783 6994 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:43:23 ctl02 nova-api[6994]: 2017-09-28 12:43:23.783 6994 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:43:23 ctl02 nova-api[6994]: 2017-09-28 12:43:23.783 6994 ERROR nova.wsgi     self.filename))
Sep 28 12:43:23 ctl02 nova-api[6994]: 2017-09-28 12:43:23.783 6994 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:43:23 ctl02 nova-api[6994]: 2017-09-28 12:43:23.783 6994 ERROR nova.wsgi
Sep 28 12:43:23 ctl02 nova-api[6994]: 2017-09-28 12:43:23.784 6994 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:43:23 ctl02 nova-api[6994]: 2017-09-28 12:43:23.919 6994 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:43:24 ctl02 nova-api[6994]: 2017-09-28 12:43:24.171 6994 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:43:24 ctl02 nova-api[6994]: 2017-09-28 12:43:24.173 6994 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:43:24 ctl02 nova-api[6994]: 2017-09-28 12:43:24.173 6994 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:43:24 ctl02 nova-api[6994]: 2017-09-28 12:43:24.174 6994 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:43:24 ctl02 nova-api[6994]: 2017-09-28 12:43:24.307 6994 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:43:24 ctl02 nova-api[6994]: 2017-09-28 12:43:24.309 6994 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:43:24 ctl02 nova-api[6994]: 2017-09-28 12:43:24.309 6994 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:43:24 ctl02 nova-api[6994]: 2017-09-28 12:43:24.309 6994 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:43:24 ctl02 nova-api[6994]: 2017-09-28 12:43:24.313 6994 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:43:24 ctl02 nova-api[6994]: 2017-09-28 12:43:24.313 6994 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:43:24 ctl02 nova-api[6994]: 2017-09-28 12:43:24.313 6994 ERROR nova Traceback (most recent call last):
Sep 28 12:43:24 ctl02 nova-api[6994]: 2017-09-28 12:43:24.313 6994 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:43:24 ctl02 nova-api[6994]: 2017-09-28 12:43:24.313 6994 ERROR nova     sys.exit(main())
Sep 28 12:43:24 ctl02 nova-api[6994]: 2017-09-28 12:43:24.313 6994 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:43:24 ctl02 nova-api[6994]: 2017-09-28 12:43:24.313 6994 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:43:24 ctl02 nova-api[6994]: 2017-09-28 12:43:24.313 6994 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:43:24 ctl02 nova-api[6994]: 2017-09-28 12:43:24.313 6994 ERROR nova     max_url_len=max_url_len)
Sep 28 12:43:24 ctl02 nova-api[6994]: 2017-09-28 12:43:24.313 6994 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:43:24 ctl02 nova-api[6994]: 2017-09-28 12:43:24.313 6994 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:43:24 ctl02 nova-api[6994]: 2017-09-28 12:43:24.313 6994 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:43:24 ctl02 nova-api[6994]: 2017-09-28 12:43:24.313 6994 ERROR nova     sock.listen(backlog)
Sep 28 12:43:24 ctl02 nova-api[6994]: 2017-09-28 12:43:24.313 6994 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:43:24 ctl02 nova-api[6994]: 2017-09-28 12:43:24.313 6994 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:43:24 ctl02 nova-api[6994]: 2017-09-28 12:43:24.313 6994 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:43:24 ctl02 nova-api[6994]: 2017-09-28 12:43:24.313 6994 ERROR nova
Sep 28 12:43:24 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:43:24 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:43:24 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:43:24 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:43:24 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:43:24 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:43:24 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:43:25 ctl02 heat-api[13008]: 2017-09-28 12:43:25.536 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:43:25] "OPTIONS / HTTP/1.0" 200 134 0.000549
Sep 28 12:43:25 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:43:25.601 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:43:25] "OPTIONS / HTTP/1.0" 200 134 0.000361
Sep 28 12:43:26 ctl02 nova-api[7012]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:43:26 ctl02 nova-api[7012]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:43:26 ctl02 nova-api[7012]: 2017-09-28 12:43:26.479 7012 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:43:26 ctl02 nova-api[7012]: 2017-09-28 12:43:26.480 7012 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:43:26 ctl02 nova-api[7012]: 2017-09-28 12:43:26.480 7012 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:43:26 ctl02 nova-api[7012]: 2017-09-28 12:43:26.480 7012 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:43:26 ctl02 nova-api[7012]: 2017-09-28 12:43:26.480 7012 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:43:26 ctl02 nova-api[7012]: 2017-09-28 12:43:26.480 7012 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:43:26 ctl02 nova-api[7012]: 2017-09-28 12:43:26.480 7012 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:43:26 ctl02 nova-api[7012]: 2017-09-28 12:43:26.480 7012 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:43:26 ctl02 nova-api[7012]: 2017-09-28 12:43:26.480 7012 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:43:26 ctl02 nova-api[7012]: 2017-09-28 12:43:26.480 7012 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:43:26 ctl02 nova-api[7012]: 2017-09-28 12:43:26.480 7012 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:43:26 ctl02 nova-api[7012]: 2017-09-28 12:43:26.480 7012 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:43:26 ctl02 nova-api[7012]: 2017-09-28 12:43:26.480 7012 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:43:26 ctl02 nova-api[7012]: 2017-09-28 12:43:26.480 7012 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:43:26 ctl02 nova-api[7012]: 2017-09-28 12:43:26.480 7012 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:43:26 ctl02 nova-api[7012]: 2017-09-28 12:43:26.480 7012 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:43:26 ctl02 nova-api[7012]: 2017-09-28 12:43:26.480 7012 ERROR nova.wsgi     self.filename))
Sep 28 12:43:26 ctl02 nova-api[7012]: 2017-09-28 12:43:26.480 7012 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:43:26 ctl02 nova-api[7012]: 2017-09-28 12:43:26.480 7012 ERROR nova.wsgi
Sep 28 12:43:26 ctl02 nova-api[7012]: 2017-09-28 12:43:26.481 7012 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:43:26 ctl02 nova-api[7012]: 2017-09-28 12:43:26.611 7012 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:43:26 ctl02 nova-api[7012]: 2017-09-28 12:43:26.839 7012 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:43:26 ctl02 nova-api[7012]: 2017-09-28 12:43:26.841 7012 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:43:26 ctl02 nova-api[7012]: 2017-09-28 12:43:26.841 7012 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:43:26 ctl02 nova-api[7012]: 2017-09-28 12:43:26.842 7012 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:43:26 ctl02 nova-api[7012]: 2017-09-28 12:43:26.974 7012 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:43:26 ctl02 nova-api[7012]: 2017-09-28 12:43:26.976 7012 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:43:26 ctl02 nova-api[7012]: 2017-09-28 12:43:26.976 7012 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:43:26 ctl02 nova-api[7012]: 2017-09-28 12:43:26.977 7012 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:43:26 ctl02 nova-api[7012]: 2017-09-28 12:43:26.980 7012 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:43:26 ctl02 nova-api[7012]: 2017-09-28 12:43:26.980 7012 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:43:26 ctl02 nova-api[7012]: 2017-09-28 12:43:26.980 7012 ERROR nova Traceback (most recent call last):
Sep 28 12:43:26 ctl02 nova-api[7012]: 2017-09-28 12:43:26.980 7012 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:43:26 ctl02 nova-api[7012]: 2017-09-28 12:43:26.980 7012 ERROR nova     sys.exit(main())
Sep 28 12:43:26 ctl02 nova-api[7012]: 2017-09-28 12:43:26.980 7012 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:43:26 ctl02 nova-api[7012]: 2017-09-28 12:43:26.980 7012 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:43:26 ctl02 nova-api[7012]: 2017-09-28 12:43:26.980 7012 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:43:26 ctl02 nova-api[7012]: 2017-09-28 12:43:26.980 7012 ERROR nova     max_url_len=max_url_len)
Sep 28 12:43:26 ctl02 nova-api[7012]: 2017-09-28 12:43:26.980 7012 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:43:26 ctl02 nova-api[7012]: 2017-09-28 12:43:26.980 7012 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:43:26 ctl02 nova-api[7012]: 2017-09-28 12:43:26.980 7012 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:43:26 ctl02 nova-api[7012]: 2017-09-28 12:43:26.980 7012 ERROR nova     sock.listen(backlog)
Sep 28 12:43:26 ctl02 nova-api[7012]: 2017-09-28 12:43:26.980 7012 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:43:26 ctl02 nova-api[7012]: 2017-09-28 12:43:26.980 7012 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:43:26 ctl02 nova-api[7012]: 2017-09-28 12:43:26.980 7012 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:43:26 ctl02 nova-api[7012]: 2017-09-28 12:43:26.980 7012 ERROR nova
Sep 28 12:43:27 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:43:27 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:43:27 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:43:27 ctl02 heat-api[13008]: 2017-09-28 12:43:27.375 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:43:27] "OPTIONS / HTTP/1.0" 200 134 0.000711
Sep 28 12:43:27 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:43:27 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:43:27 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:43:27 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:43:28 ctl02 heat-api[13008]: 2017-09-28 12:43:28.187 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:43:28] "OPTIONS / HTTP/1.0" 200 134 0.000547
Sep 28 12:43:28 ctl02 nova-consoleauth[5433]: 2017-09-28 12:43:28.507 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:43:29 ctl02 nova-api[7031]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:43:29 ctl02 nova-api[7031]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:43:29 ctl02 nova-api[7031]: 2017-09-28 12:43:29.242 7031 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:43:29 ctl02 nova-api[7031]: 2017-09-28 12:43:29.244 7031 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:43:29 ctl02 nova-api[7031]: 2017-09-28 12:43:29.244 7031 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:43:29 ctl02 nova-api[7031]: 2017-09-28 12:43:29.244 7031 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:43:29 ctl02 nova-api[7031]: 2017-09-28 12:43:29.244 7031 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:43:29 ctl02 nova-api[7031]: 2017-09-28 12:43:29.244 7031 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:43:29 ctl02 nova-api[7031]: 2017-09-28 12:43:29.244 7031 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:43:29 ctl02 nova-api[7031]: 2017-09-28 12:43:29.244 7031 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:43:29 ctl02 nova-api[7031]: 2017-09-28 12:43:29.244 7031 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:43:29 ctl02 nova-api[7031]: 2017-09-28 12:43:29.244 7031 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:43:29 ctl02 nova-api[7031]: 2017-09-28 12:43:29.244 7031 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:43:29 ctl02 nova-api[7031]: 2017-09-28 12:43:29.244 7031 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:43:29 ctl02 nova-api[7031]: 2017-09-28 12:43:29.244 7031 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:43:29 ctl02 nova-api[7031]: 2017-09-28 12:43:29.244 7031 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:43:29 ctl02 nova-api[7031]: 2017-09-28 12:43:29.244 7031 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:43:29 ctl02 nova-api[7031]: 2017-09-28 12:43:29.244 7031 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:43:29 ctl02 nova-api[7031]: 2017-09-28 12:43:29.244 7031 ERROR nova.wsgi     self.filename))
Sep 28 12:43:29 ctl02 nova-api[7031]: 2017-09-28 12:43:29.244 7031 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:43:29 ctl02 nova-api[7031]: 2017-09-28 12:43:29.244 7031 ERROR nova.wsgi
Sep 28 12:43:29 ctl02 nova-api[7031]: 2017-09-28 12:43:29.246 7031 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:43:29 ctl02 nova-api[7031]: 2017-09-28 12:43:29.372 7031 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:43:29 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:43:29.391 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:43:29] "OPTIONS / HTTP/1.0" 200 134 0.000359
Sep 28 12:43:29 ctl02 heat-api-cfn[13300]: 2017-09-28 12:43:29.444 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:43:29] "OPTIONS / HTTP/1.0" 200 134 0.000450
Sep 28 12:43:29 ctl02 nova-api[7031]: 2017-09-28 12:43:29.602 7031 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:43:29 ctl02 nova-api[7031]: 2017-09-28 12:43:29.604 7031 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:43:29 ctl02 nova-api[7031]: 2017-09-28 12:43:29.604 7031 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:43:29 ctl02 nova-api[7031]: 2017-09-28 12:43:29.604 7031 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:43:29 ctl02 nova-api[7031]: 2017-09-28 12:43:29.735 7031 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:43:29 ctl02 nova-api[7031]: 2017-09-28 12:43:29.737 7031 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:43:29 ctl02 nova-api[7031]: 2017-09-28 12:43:29.738 7031 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:43:29 ctl02 nova-api[7031]: 2017-09-28 12:43:29.738 7031 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:43:29 ctl02 nova-api[7031]: 2017-09-28 12:43:29.741 7031 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:43:29 ctl02 nova-api[7031]: 2017-09-28 12:43:29.742 7031 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:43:29 ctl02 nova-api[7031]: 2017-09-28 12:43:29.742 7031 ERROR nova Traceback (most recent call last):
Sep 28 12:43:29 ctl02 nova-api[7031]: 2017-09-28 12:43:29.742 7031 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:43:29 ctl02 nova-api[7031]: 2017-09-28 12:43:29.742 7031 ERROR nova     sys.exit(main())
Sep 28 12:43:29 ctl02 nova-api[7031]: 2017-09-28 12:43:29.742 7031 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:43:29 ctl02 nova-api[7031]: 2017-09-28 12:43:29.742 7031 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:43:29 ctl02 nova-api[7031]: 2017-09-28 12:43:29.742 7031 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:43:29 ctl02 nova-api[7031]: 2017-09-28 12:43:29.742 7031 ERROR nova     max_url_len=max_url_len)
Sep 28 12:43:29 ctl02 nova-api[7031]: 2017-09-28 12:43:29.742 7031 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:43:29 ctl02 nova-api[7031]: 2017-09-28 12:43:29.742 7031 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:43:29 ctl02 nova-api[7031]: 2017-09-28 12:43:29.742 7031 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:43:29 ctl02 nova-api[7031]: 2017-09-28 12:43:29.742 7031 ERROR nova     sock.listen(backlog)
Sep 28 12:43:29 ctl02 nova-api[7031]: 2017-09-28 12:43:29.742 7031 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:43:29 ctl02 nova-api[7031]: 2017-09-28 12:43:29.742 7031 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:43:29 ctl02 nova-api[7031]: 2017-09-28 12:43:29.742 7031 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:43:29 ctl02 nova-api[7031]: 2017-09-28 12:43:29.742 7031 ERROR nova
Sep 28 12:43:29 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:43:29 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:43:29 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:43:29 ctl02 neutron-server[30536]: 2017-09-28 12:43:29.931 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:43:29] "OPTIONS / HTTP/1.0" 200 262 0.000489
Sep 28 12:43:30 ctl02 heat-engine[12803]: 2017-09-28 12:43:30.094 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:43:30 ctl02 heat-engine[12803]: 2017-09-28 12:43:30.099 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:43:30 ctl02 heat-engine[12803]: 2017-09-28 12:43:30.104 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:43:30 ctl02 heat-engine[12803]: 2017-09-28 12:43:30.112 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:43:30 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:43:30 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:43:30 ctl02 neutron-server[30536]: 2017-09-28 12:43:30.127 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:43:30] "OPTIONS / HTTP/1.0" 200 262 0.000496
Sep 28 12:43:30 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:43:30 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:43:30 ctl02 heat-api-cfn[13300]: 2017-09-28 12:43:30.213 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:43:30] "OPTIONS / HTTP/1.0" 200 134 0.000520
Sep 28 12:43:30 ctl02 glance-api[29183]: 2017-09-28 12:43:30.616 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:43:30] "OPTIONS / HTTP/1.0" 200 134 0.000561
Sep 28 12:43:30 ctl02 neutron-server[30536]: 2017-09-28 12:43:30.630 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:43:30] "OPTIONS / HTTP/1.0" 200 262 0.000463
Sep 28 12:43:31 ctl02 glance-api[29183]: 2017-09-28 12:43:31.432 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:43:31] "OPTIONS / HTTP/1.0" 200 134 0.000569
Sep 28 12:43:31 ctl02 nova-scheduler[5620]: 2017-09-28 12:43:31.598 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:43:31 ctl02 nova-api[7049]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:43:31 ctl02 nova-api[7049]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:43:31 ctl02 nova-api[7049]: 2017-09-28 12:43:31.963 7049 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:43:31 ctl02 nova-api[7049]: 2017-09-28 12:43:31.964 7049 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:43:31 ctl02 nova-api[7049]: 2017-09-28 12:43:31.964 7049 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:43:31 ctl02 nova-api[7049]: 2017-09-28 12:43:31.964 7049 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:43:31 ctl02 nova-api[7049]: 2017-09-28 12:43:31.964 7049 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:43:31 ctl02 nova-api[7049]: 2017-09-28 12:43:31.964 7049 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:43:31 ctl02 nova-api[7049]: 2017-09-28 12:43:31.964 7049 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:43:31 ctl02 nova-api[7049]: 2017-09-28 12:43:31.964 7049 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:43:31 ctl02 nova-api[7049]: 2017-09-28 12:43:31.964 7049 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:43:31 ctl02 nova-api[7049]: 2017-09-28 12:43:31.964 7049 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:43:31 ctl02 nova-api[7049]: 2017-09-28 12:43:31.964 7049 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:43:31 ctl02 nova-api[7049]: 2017-09-28 12:43:31.964 7049 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:43:31 ctl02 nova-api[7049]: 2017-09-28 12:43:31.964 7049 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:43:31 ctl02 nova-api[7049]: 2017-09-28 12:43:31.964 7049 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:43:31 ctl02 nova-api[7049]: 2017-09-28 12:43:31.964 7049 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:43:31 ctl02 nova-api[7049]: 2017-09-28 12:43:31.964 7049 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:43:31 ctl02 nova-api[7049]: 2017-09-28 12:43:31.964 7049 ERROR nova.wsgi     self.filename))
Sep 28 12:43:31 ctl02 nova-api[7049]: 2017-09-28 12:43:31.964 7049 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:43:31 ctl02 nova-api[7049]: 2017-09-28 12:43:31.964 7049 ERROR nova.wsgi
Sep 28 12:43:31 ctl02 nova-api[7049]: 2017-09-28 12:43:31.965 7049 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:43:32 ctl02 nova-api[7049]: 2017-09-28 12:43:32.091 7049 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:43:32 ctl02 nova-api[7049]: 2017-09-28 12:43:32.313 7049 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:43:32 ctl02 nova-api[7049]: 2017-09-28 12:43:32.315 7049 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:43:32 ctl02 nova-api[7049]: 2017-09-28 12:43:32.315 7049 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:43:32 ctl02 nova-api[7049]: 2017-09-28 12:43:32.315 7049 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:43:32 ctl02 glance-api[29183]: 2017-09-28 12:43:32.387 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:43:32] "OPTIONS / HTTP/1.0" 200 134 0.000541
Sep 28 12:43:32 ctl02 nova-api[7049]: 2017-09-28 12:43:32.445 7049 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:43:32 ctl02 nova-api[7049]: 2017-09-28 12:43:32.447 7049 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:43:32 ctl02 nova-api[7049]: 2017-09-28 12:43:32.447 7049 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:43:32 ctl02 nova-api[7049]: 2017-09-28 12:43:32.447 7049 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:43:32 ctl02 nova-api[7049]: 2017-09-28 12:43:32.450 7049 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:43:32 ctl02 nova-api[7049]: 2017-09-28 12:43:32.451 7049 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:43:32 ctl02 nova-api[7049]: 2017-09-28 12:43:32.451 7049 ERROR nova Traceback (most recent call last):
Sep 28 12:43:32 ctl02 nova-api[7049]: 2017-09-28 12:43:32.451 7049 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:43:32 ctl02 nova-api[7049]: 2017-09-28 12:43:32.451 7049 ERROR nova     sys.exit(main())
Sep 28 12:43:32 ctl02 nova-api[7049]: 2017-09-28 12:43:32.451 7049 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:43:32 ctl02 nova-api[7049]: 2017-09-28 12:43:32.451 7049 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:43:32 ctl02 nova-api[7049]: 2017-09-28 12:43:32.451 7049 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:43:32 ctl02 nova-api[7049]: 2017-09-28 12:43:32.451 7049 ERROR nova     max_url_len=max_url_len)
Sep 28 12:43:32 ctl02 nova-api[7049]: 2017-09-28 12:43:32.451 7049 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:43:32 ctl02 nova-api[7049]: 2017-09-28 12:43:32.451 7049 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:43:32 ctl02 nova-api[7049]: 2017-09-28 12:43:32.451 7049 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:43:32 ctl02 nova-api[7049]: 2017-09-28 12:43:32.451 7049 ERROR nova     sock.listen(backlog)
Sep 28 12:43:32 ctl02 nova-api[7049]: 2017-09-28 12:43:32.451 7049 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:43:32 ctl02 nova-api[7049]: 2017-09-28 12:43:32.451 7049 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:43:32 ctl02 nova-api[7049]: 2017-09-28 12:43:32.451 7049 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:43:32 ctl02 nova-api[7049]: 2017-09-28 12:43:32.451 7049 ERROR nova
Sep 28 12:43:32 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:43:32 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:43:32 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:43:32 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:43:32 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:43:32 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:43:32 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:43:32 ctl02 heat-api-cfn[13300]: 2017-09-28 12:43:32.939 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:43:32] "OPTIONS / HTTP/1.0" 200 134 0.000604
Sep 28 12:43:33 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:43:33.805 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:43:33] "OPTIONS / HTTP/1.0" 200 134 0.000351
Sep 28 12:43:34 ctl02 nova-api[7066]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:43:34 ctl02 nova-api[7066]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:43:34 ctl02 nova-api[7066]: 2017-09-28 12:43:34.776 7066 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:43:34 ctl02 nova-api[7066]: 2017-09-28 12:43:34.778 7066 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:43:34 ctl02 nova-api[7066]: 2017-09-28 12:43:34.778 7066 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:43:34 ctl02 nova-api[7066]: 2017-09-28 12:43:34.778 7066 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:43:34 ctl02 nova-api[7066]: 2017-09-28 12:43:34.778 7066 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:43:34 ctl02 nova-api[7066]: 2017-09-28 12:43:34.778 7066 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:43:34 ctl02 nova-api[7066]: 2017-09-28 12:43:34.778 7066 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:43:34 ctl02 nova-api[7066]: 2017-09-28 12:43:34.778 7066 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:43:34 ctl02 nova-api[7066]: 2017-09-28 12:43:34.778 7066 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:43:34 ctl02 nova-api[7066]: 2017-09-28 12:43:34.778 7066 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:43:34 ctl02 nova-api[7066]: 2017-09-28 12:43:34.778 7066 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:43:34 ctl02 nova-api[7066]: 2017-09-28 12:43:34.778 7066 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:43:34 ctl02 nova-api[7066]: 2017-09-28 12:43:34.778 7066 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:43:34 ctl02 nova-api[7066]: 2017-09-28 12:43:34.778 7066 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:43:34 ctl02 nova-api[7066]: 2017-09-28 12:43:34.778 7066 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:43:34 ctl02 nova-api[7066]: 2017-09-28 12:43:34.778 7066 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:43:34 ctl02 nova-api[7066]: 2017-09-28 12:43:34.778 7066 ERROR nova.wsgi     self.filename))
Sep 28 12:43:34 ctl02 nova-api[7066]: 2017-09-28 12:43:34.778 7066 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:43:34 ctl02 nova-api[7066]: 2017-09-28 12:43:34.778 7066 ERROR nova.wsgi
Sep 28 12:43:34 ctl02 nova-api[7066]: 2017-09-28 12:43:34.780 7066 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:43:34 ctl02 nova-api[7066]: 2017-09-28 12:43:34.912 7066 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:43:35 ctl02 nova-api[7066]: 2017-09-28 12:43:35.156 7066 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:43:35 ctl02 nova-api[7066]: 2017-09-28 12:43:35.160 7066 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:43:35 ctl02 nova-api[7066]: 2017-09-28 12:43:35.160 7066 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:43:35 ctl02 nova-api[7066]: 2017-09-28 12:43:35.160 7066 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:43:35 ctl02 nova-api[7066]: 2017-09-28 12:43:35.299 7066 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:43:35 ctl02 nova-api[7066]: 2017-09-28 12:43:35.301 7066 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:43:35 ctl02 nova-api[7066]: 2017-09-28 12:43:35.302 7066 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:43:35 ctl02 nova-api[7066]: 2017-09-28 12:43:35.302 7066 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:43:35 ctl02 nova-api[7066]: 2017-09-28 12:43:35.306 7066 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:43:35 ctl02 nova-api[7066]: 2017-09-28 12:43:35.307 7066 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:43:35 ctl02 nova-api[7066]: 2017-09-28 12:43:35.307 7066 ERROR nova Traceback (most recent call last):
Sep 28 12:43:35 ctl02 nova-api[7066]: 2017-09-28 12:43:35.307 7066 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:43:35 ctl02 nova-api[7066]: 2017-09-28 12:43:35.307 7066 ERROR nova     sys.exit(main())
Sep 28 12:43:35 ctl02 nova-api[7066]: 2017-09-28 12:43:35.307 7066 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:43:35 ctl02 nova-api[7066]: 2017-09-28 12:43:35.307 7066 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:43:35 ctl02 nova-api[7066]: 2017-09-28 12:43:35.307 7066 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:43:35 ctl02 nova-api[7066]: 2017-09-28 12:43:35.307 7066 ERROR nova     max_url_len=max_url_len)
Sep 28 12:43:35 ctl02 nova-api[7066]: 2017-09-28 12:43:35.307 7066 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:43:35 ctl02 nova-api[7066]: 2017-09-28 12:43:35.307 7066 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:43:35 ctl02 nova-api[7066]: 2017-09-28 12:43:35.307 7066 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:43:35 ctl02 nova-api[7066]: 2017-09-28 12:43:35.307 7066 ERROR nova     sock.listen(backlog)
Sep 28 12:43:35 ctl02 nova-api[7066]: 2017-09-28 12:43:35.307 7066 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:43:35 ctl02 nova-api[7066]: 2017-09-28 12:43:35.307 7066 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:43:35 ctl02 nova-api[7066]: 2017-09-28 12:43:35.307 7066 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:43:35 ctl02 nova-api[7066]: 2017-09-28 12:43:35.307 7066 ERROR nova
Sep 28 12:43:35 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:43:35 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:43:35 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:43:35 ctl02 heat-api[13008]: 2017-09-28 12:43:35.461 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:43:35] "OPTIONS / HTTP/1.0" 200 134 0.000543
Sep 28 12:43:35 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:43:35 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:43:35 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:43:35 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:43:35 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:43:35.895 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:43:35] "OPTIONS / HTTP/1.0" 200 134 0.000497
Sep 28 12:43:36 ctl02 neutron-server[30536]: 2017-09-28 12:43:36.279 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 1 dead agents out of 6:
Sep 28 12:43:36 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:43:36 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:42:56 cmp002
Sep 28 12:43:37 ctl02 nova-api[7085]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:43:37 ctl02 nova-api[7085]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:43:37 ctl02 nova-api[7085]: 2017-09-28 12:43:37.484 7085 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:43:37 ctl02 nova-api[7085]: 2017-09-28 12:43:37.486 7085 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:43:37 ctl02 nova-api[7085]: 2017-09-28 12:43:37.486 7085 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:43:37 ctl02 nova-api[7085]: 2017-09-28 12:43:37.486 7085 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:43:37 ctl02 nova-api[7085]: 2017-09-28 12:43:37.486 7085 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:43:37 ctl02 nova-api[7085]: 2017-09-28 12:43:37.486 7085 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:43:37 ctl02 nova-api[7085]: 2017-09-28 12:43:37.486 7085 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:43:37 ctl02 nova-api[7085]: 2017-09-28 12:43:37.486 7085 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:43:37 ctl02 nova-api[7085]: 2017-09-28 12:43:37.486 7085 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:43:37 ctl02 nova-api[7085]: 2017-09-28 12:43:37.486 7085 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:43:37 ctl02 nova-api[7085]: 2017-09-28 12:43:37.486 7085 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:43:37 ctl02 nova-api[7085]: 2017-09-28 12:43:37.486 7085 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:43:37 ctl02 nova-api[7085]: 2017-09-28 12:43:37.486 7085 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:43:37 ctl02 nova-api[7085]: 2017-09-28 12:43:37.486 7085 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:43:37 ctl02 nova-api[7085]: 2017-09-28 12:43:37.486 7085 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:43:37 ctl02 nova-api[7085]: 2017-09-28 12:43:37.486 7085 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:43:37 ctl02 nova-api[7085]: 2017-09-28 12:43:37.486 7085 ERROR nova.wsgi     self.filename))
Sep 28 12:43:37 ctl02 nova-api[7085]: 2017-09-28 12:43:37.486 7085 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:43:37 ctl02 nova-api[7085]: 2017-09-28 12:43:37.486 7085 ERROR nova.wsgi
Sep 28 12:43:37 ctl02 nova-api[7085]: 2017-09-28 12:43:37.487 7085 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:43:37 ctl02 heat-api[13008]: 2017-09-28 12:43:37.520 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:43:37] "OPTIONS / HTTP/1.0" 200 134 0.000584
Sep 28 12:43:37 ctl02 nova-api[7085]: 2017-09-28 12:43:37.614 7085 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:43:37 ctl02 nova-api[7085]: 2017-09-28 12:43:37.846 7085 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:43:37 ctl02 nova-api[7085]: 2017-09-28 12:43:37.849 7085 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:43:37 ctl02 nova-api[7085]: 2017-09-28 12:43:37.849 7085 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:43:37 ctl02 nova-api[7085]: 2017-09-28 12:43:37.849 7085 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:43:37 ctl02 nova-api[7085]: 2017-09-28 12:43:37.978 7085 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:43:37 ctl02 nova-api[7085]: 2017-09-28 12:43:37.979 7085 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:43:37 ctl02 nova-api[7085]: 2017-09-28 12:43:37.980 7085 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:43:37 ctl02 nova-api[7085]: 2017-09-28 12:43:37.980 7085 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:43:37 ctl02 nova-api[7085]: 2017-09-28 12:43:37.983 7085 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:43:37 ctl02 nova-api[7085]: 2017-09-28 12:43:37.983 7085 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:43:37 ctl02 nova-api[7085]: 2017-09-28 12:43:37.983 7085 ERROR nova Traceback (most recent call last):
Sep 28 12:43:37 ctl02 nova-api[7085]: 2017-09-28 12:43:37.983 7085 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:43:37 ctl02 nova-api[7085]: 2017-09-28 12:43:37.983 7085 ERROR nova     sys.exit(main())
Sep 28 12:43:37 ctl02 nova-api[7085]: 2017-09-28 12:43:37.983 7085 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:43:37 ctl02 nova-api[7085]: 2017-09-28 12:43:37.983 7085 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:43:37 ctl02 nova-api[7085]: 2017-09-28 12:43:37.983 7085 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:43:37 ctl02 nova-api[7085]: 2017-09-28 12:43:37.983 7085 ERROR nova     max_url_len=max_url_len)
Sep 28 12:43:37 ctl02 nova-api[7085]: 2017-09-28 12:43:37.983 7085 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:43:37 ctl02 nova-api[7085]: 2017-09-28 12:43:37.983 7085 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:43:37 ctl02 nova-api[7085]: 2017-09-28 12:43:37.983 7085 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:43:37 ctl02 nova-api[7085]: 2017-09-28 12:43:37.983 7085 ERROR nova     sock.listen(backlog)
Sep 28 12:43:37 ctl02 nova-api[7085]: 2017-09-28 12:43:37.983 7085 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:43:37 ctl02 nova-api[7085]: 2017-09-28 12:43:37.983 7085 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:43:37 ctl02 nova-api[7085]: 2017-09-28 12:43:37.983 7085 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:43:37 ctl02 nova-api[7085]: 2017-09-28 12:43:37.983 7085 ERROR nova
Sep 28 12:43:38 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:43:38 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:43:38 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:43:38 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:43:38 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:43:38 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:43:38 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:43:38 ctl02 heat-api[13008]: 2017-09-28 12:43:38.531 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:43:38] "OPTIONS / HTTP/1.0" 200 134 0.000567
Sep 28 12:43:39 ctl02 heat-api-cfn[13300]: 2017-09-28 12:43:39.279 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:43:39] "OPTIONS / HTTP/1.0" 200 134 0.000468
Sep 28 12:43:39 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:43:39.291 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:43:39] "OPTIONS / HTTP/1.0" 200 134 0.000367
Sep 28 12:43:39 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x47190c21)
Sep 28 12:43:40 ctl02 heat-api-cfn[13300]: 2017-09-28 12:43:40.010 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:43:40] "OPTIONS / HTTP/1.0" 200 134 0.000448
Sep 28 12:43:40 ctl02 neutron-server[30536]: 2017-09-28 12:43:40.020 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:43:40] "OPTIONS / HTTP/1.0" 200 262 0.000451
Sep 28 12:43:40 ctl02 nova-api[7103]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:43:40 ctl02 nova-api[7103]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:43:40 ctl02 nova-api[7103]: 2017-09-28 12:43:40.246 7103 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:43:40 ctl02 nova-api[7103]: 2017-09-28 12:43:40.248 7103 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:43:40 ctl02 nova-api[7103]: 2017-09-28 12:43:40.248 7103 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:43:40 ctl02 nova-api[7103]: 2017-09-28 12:43:40.248 7103 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:43:40 ctl02 nova-api[7103]: 2017-09-28 12:43:40.248 7103 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:43:40 ctl02 nova-api[7103]: 2017-09-28 12:43:40.248 7103 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:43:40 ctl02 nova-api[7103]: 2017-09-28 12:43:40.248 7103 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:43:40 ctl02 nova-api[7103]: 2017-09-28 12:43:40.248 7103 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:43:40 ctl02 nova-api[7103]: 2017-09-28 12:43:40.248 7103 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:43:40 ctl02 nova-api[7103]: 2017-09-28 12:43:40.248 7103 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:43:40 ctl02 nova-api[7103]: 2017-09-28 12:43:40.248 7103 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:43:40 ctl02 nova-api[7103]: 2017-09-28 12:43:40.248 7103 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:43:40 ctl02 nova-api[7103]: 2017-09-28 12:43:40.248 7103 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:43:40 ctl02 nova-api[7103]: 2017-09-28 12:43:40.248 7103 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:43:40 ctl02 nova-api[7103]: 2017-09-28 12:43:40.248 7103 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:43:40 ctl02 nova-api[7103]: 2017-09-28 12:43:40.248 7103 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:43:40 ctl02 nova-api[7103]: 2017-09-28 12:43:40.248 7103 ERROR nova.wsgi     self.filename))
Sep 28 12:43:40 ctl02 nova-api[7103]: 2017-09-28 12:43:40.248 7103 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:43:40 ctl02 nova-api[7103]: 2017-09-28 12:43:40.248 7103 ERROR nova.wsgi
Sep 28 12:43:40 ctl02 nova-api[7103]: 2017-09-28 12:43:40.249 7103 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:43:40 ctl02 neutron-server[30536]: 2017-09-28 12:43:40.315 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:43:40] "OPTIONS / HTTP/1.0" 200 262 0.000444
Sep 28 12:43:40 ctl02 nova-api[7103]: 2017-09-28 12:43:40.381 7103 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:43:40 ctl02 neutron-server[30536]: 2017-09-28 12:43:40.475 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:43:40] "OPTIONS / HTTP/1.0" 200 262 0.000466
Sep 28 12:43:40 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x47190c21)
Sep 28 12:43:40 ctl02 nova-api[7103]: 2017-09-28 12:43:40.608 7103 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:43:40 ctl02 nova-api[7103]: 2017-09-28 12:43:40.611 7103 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:43:40 ctl02 nova-api[7103]: 2017-09-28 12:43:40.611 7103 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:43:40 ctl02 nova-api[7103]: 2017-09-28 12:43:40.611 7103 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:43:40 ctl02 nova-api[7103]: 2017-09-28 12:43:40.746 7103 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:43:40 ctl02 nova-api[7103]: 2017-09-28 12:43:40.748 7103 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:43:40 ctl02 nova-api[7103]: 2017-09-28 12:43:40.748 7103 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:43:40 ctl02 nova-api[7103]: 2017-09-28 12:43:40.748 7103 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:43:40 ctl02 nova-api[7103]: 2017-09-28 12:43:40.752 7103 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:43:40 ctl02 nova-api[7103]: 2017-09-28 12:43:40.752 7103 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:43:40 ctl02 nova-api[7103]: 2017-09-28 12:43:40.752 7103 ERROR nova Traceback (most recent call last):
Sep 28 12:43:40 ctl02 nova-api[7103]: 2017-09-28 12:43:40.752 7103 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:43:40 ctl02 nova-api[7103]: 2017-09-28 12:43:40.752 7103 ERROR nova     sys.exit(main())
Sep 28 12:43:40 ctl02 nova-api[7103]: 2017-09-28 12:43:40.752 7103 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:43:40 ctl02 nova-api[7103]: 2017-09-28 12:43:40.752 7103 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:43:40 ctl02 nova-api[7103]: 2017-09-28 12:43:40.752 7103 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:43:40 ctl02 nova-api[7103]: 2017-09-28 12:43:40.752 7103 ERROR nova     max_url_len=max_url_len)
Sep 28 12:43:40 ctl02 nova-api[7103]: 2017-09-28 12:43:40.752 7103 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:43:40 ctl02 nova-api[7103]: 2017-09-28 12:43:40.752 7103 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:43:40 ctl02 nova-api[7103]: 2017-09-28 12:43:40.752 7103 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:43:40 ctl02 nova-api[7103]: 2017-09-28 12:43:40.752 7103 ERROR nova     sock.listen(backlog)
Sep 28 12:43:40 ctl02 nova-api[7103]: 2017-09-28 12:43:40.752 7103 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:43:40 ctl02 nova-api[7103]: 2017-09-28 12:43:40.752 7103 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:43:40 ctl02 nova-api[7103]: 2017-09-28 12:43:40.752 7103 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:43:40 ctl02 nova-api[7103]: 2017-09-28 12:43:40.752 7103 ERROR nova
Sep 28 12:43:40 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:43:40 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:43:40 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:43:40 ctl02 glance-api[29183]: 2017-09-28 12:43:40.949 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:43:40] "OPTIONS / HTTP/1.0" 200 134 0.000609
Sep 28 12:43:41 ctl02 glance-api[29183]: 2017-09-28 12:43:41.074 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:43:41] "OPTIONS / HTTP/1.0" 200 134 0.000778
Sep 28 12:43:41 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:43:41 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:43:41 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:43:41 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:43:41 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x47190c21)
Sep 28 12:43:42 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x47190c21)
Sep 28 12:43:42 ctl02 glance-api[29183]: 2017-09-28 12:43:42.580 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:43:42] "OPTIONS / HTTP/1.0" 200 134 0.000673
Sep 28 12:43:42 ctl02 heat-api-cfn[13300]: 2017-09-28 12:43:42.652 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:43:42] "OPTIONS / HTTP/1.0" 200 134 0.000562
Sep 28 12:43:42 ctl02 nova-api[7121]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:43:42 ctl02 nova-api[7121]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:43:43 ctl02 nova-api[7121]: 2017-09-28 12:43:43.017 7121 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:43:43 ctl02 nova-api[7121]: 2017-09-28 12:43:43.018 7121 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:43:43 ctl02 nova-api[7121]: 2017-09-28 12:43:43.018 7121 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:43:43 ctl02 nova-api[7121]: 2017-09-28 12:43:43.018 7121 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:43:43 ctl02 nova-api[7121]: 2017-09-28 12:43:43.018 7121 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:43:43 ctl02 nova-api[7121]: 2017-09-28 12:43:43.018 7121 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:43:43 ctl02 nova-api[7121]: 2017-09-28 12:43:43.018 7121 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:43:43 ctl02 nova-api[7121]: 2017-09-28 12:43:43.018 7121 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:43:43 ctl02 nova-api[7121]: 2017-09-28 12:43:43.018 7121 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:43:43 ctl02 nova-api[7121]: 2017-09-28 12:43:43.018 7121 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:43:43 ctl02 nova-api[7121]: 2017-09-28 12:43:43.018 7121 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:43:43 ctl02 nova-api[7121]: 2017-09-28 12:43:43.018 7121 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:43:43 ctl02 nova-api[7121]: 2017-09-28 12:43:43.018 7121 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:43:43 ctl02 nova-api[7121]: 2017-09-28 12:43:43.018 7121 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:43:43 ctl02 nova-api[7121]: 2017-09-28 12:43:43.018 7121 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:43:43 ctl02 nova-api[7121]: 2017-09-28 12:43:43.018 7121 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:43:43 ctl02 nova-api[7121]: 2017-09-28 12:43:43.018 7121 ERROR nova.wsgi     self.filename))
Sep 28 12:43:43 ctl02 nova-api[7121]: 2017-09-28 12:43:43.018 7121 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:43:43 ctl02 nova-api[7121]: 2017-09-28 12:43:43.018 7121 ERROR nova.wsgi
Sep 28 12:43:43 ctl02 nova-api[7121]: 2017-09-28 12:43:43.020 7121 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:43:43 ctl02 nova-api[7121]: 2017-09-28 12:43:43.150 7121 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:43:43 ctl02 nova-api[7121]: 2017-09-28 12:43:43.379 7121 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:43:43 ctl02 nova-api[7121]: 2017-09-28 12:43:43.381 7121 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:43:43 ctl02 nova-api[7121]: 2017-09-28 12:43:43.381 7121 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:43:43 ctl02 nova-api[7121]: 2017-09-28 12:43:43.381 7121 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:43:43 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x47190c21)
Sep 28 12:43:43 ctl02 nova-api[7121]: 2017-09-28 12:43:43.513 7121 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:43:43 ctl02 nova-api[7121]: 2017-09-28 12:43:43.515 7121 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:43:43 ctl02 nova-api[7121]: 2017-09-28 12:43:43.515 7121 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:43:43 ctl02 nova-api[7121]: 2017-09-28 12:43:43.515 7121 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:43:43 ctl02 nova-api[7121]: 2017-09-28 12:43:43.518 7121 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:43:43 ctl02 nova-api[7121]: 2017-09-28 12:43:43.519 7121 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:43:43 ctl02 nova-api[7121]: 2017-09-28 12:43:43.519 7121 ERROR nova Traceback (most recent call last):
Sep 28 12:43:43 ctl02 nova-api[7121]: 2017-09-28 12:43:43.519 7121 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:43:43 ctl02 nova-api[7121]: 2017-09-28 12:43:43.519 7121 ERROR nova     sys.exit(main())
Sep 28 12:43:43 ctl02 nova-api[7121]: 2017-09-28 12:43:43.519 7121 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:43:43 ctl02 nova-api[7121]: 2017-09-28 12:43:43.519 7121 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:43:43 ctl02 nova-api[7121]: 2017-09-28 12:43:43.519 7121 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:43:43 ctl02 nova-api[7121]: 2017-09-28 12:43:43.519 7121 ERROR nova     max_url_len=max_url_len)
Sep 28 12:43:43 ctl02 nova-api[7121]: 2017-09-28 12:43:43.519 7121 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:43:43 ctl02 nova-api[7121]: 2017-09-28 12:43:43.519 7121 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:43:43 ctl02 nova-api[7121]: 2017-09-28 12:43:43.519 7121 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:43:43 ctl02 nova-api[7121]: 2017-09-28 12:43:43.519 7121 ERROR nova     sock.listen(backlog)
Sep 28 12:43:43 ctl02 nova-api[7121]: 2017-09-28 12:43:43.519 7121 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:43:43 ctl02 nova-api[7121]: 2017-09-28 12:43:43.519 7121 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:43:43 ctl02 nova-api[7121]: 2017-09-28 12:43:43.519 7121 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:43:43 ctl02 nova-api[7121]: 2017-09-28 12:43:43.519 7121 ERROR nova
Sep 28 12:43:43 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:43:43 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:43:43 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:43:43 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:43:43.803 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:43:43] "OPTIONS / HTTP/1.0" 200 134 0.000431
Sep 28 12:43:43 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:43:43 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:43:43 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:43:43 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:43:44 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x47190c21)
Sep 28 12:43:45 ctl02 heat-api[13008]: 2017-09-28 12:43:45.350 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:43:45] "OPTIONS / HTTP/1.0" 200 134 0.000545
Sep 28 12:43:45 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x47190c21)
Sep 28 12:43:45 ctl02 nova-api[7139]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:43:45 ctl02 nova-api[7139]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:43:45 ctl02 nova-api[7139]: 2017-09-28 12:43:45.738 7139 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:43:45 ctl02 nova-api[7139]: 2017-09-28 12:43:45.740 7139 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:43:45 ctl02 nova-api[7139]: 2017-09-28 12:43:45.740 7139 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:43:45 ctl02 nova-api[7139]: 2017-09-28 12:43:45.740 7139 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:43:45 ctl02 nova-api[7139]: 2017-09-28 12:43:45.740 7139 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:43:45 ctl02 nova-api[7139]: 2017-09-28 12:43:45.740 7139 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:43:45 ctl02 nova-api[7139]: 2017-09-28 12:43:45.740 7139 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:43:45 ctl02 nova-api[7139]: 2017-09-28 12:43:45.740 7139 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:43:45 ctl02 nova-api[7139]: 2017-09-28 12:43:45.740 7139 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:43:45 ctl02 nova-api[7139]: 2017-09-28 12:43:45.740 7139 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:43:45 ctl02 nova-api[7139]: 2017-09-28 12:43:45.740 7139 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:43:45 ctl02 nova-api[7139]: 2017-09-28 12:43:45.740 7139 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:43:45 ctl02 nova-api[7139]: 2017-09-28 12:43:45.740 7139 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:43:45 ctl02 nova-api[7139]: 2017-09-28 12:43:45.740 7139 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:43:45 ctl02 nova-api[7139]: 2017-09-28 12:43:45.740 7139 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:43:45 ctl02 nova-api[7139]: 2017-09-28 12:43:45.740 7139 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:43:45 ctl02 nova-api[7139]: 2017-09-28 12:43:45.740 7139 ERROR nova.wsgi     self.filename))
Sep 28 12:43:45 ctl02 nova-api[7139]: 2017-09-28 12:43:45.740 7139 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:43:45 ctl02 nova-api[7139]: 2017-09-28 12:43:45.740 7139 ERROR nova.wsgi
Sep 28 12:43:45 ctl02 nova-api[7139]: 2017-09-28 12:43:45.742 7139 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:43:45 ctl02 nova-api[7139]: 2017-09-28 12:43:45.868 7139 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:43:46 ctl02 nova-api[7139]: 2017-09-28 12:43:46.087 7139 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:43:46 ctl02 nova-api[7139]: 2017-09-28 12:43:46.089 7139 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:43:46 ctl02 nova-api[7139]: 2017-09-28 12:43:46.090 7139 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:43:46 ctl02 nova-api[7139]: 2017-09-28 12:43:46.090 7139 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:43:46 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:43:46.144 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:43:46] "OPTIONS / HTTP/1.0" 200 134 0.000376
Sep 28 12:43:46 ctl02 nova-api[7139]: 2017-09-28 12:43:46.221 7139 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:43:46 ctl02 nova-api[7139]: 2017-09-28 12:43:46.223 7139 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:43:46 ctl02 nova-api[7139]: 2017-09-28 12:43:46.223 7139 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:43:46 ctl02 nova-api[7139]: 2017-09-28 12:43:46.224 7139 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:43:46 ctl02 nova-api[7139]: 2017-09-28 12:43:46.227 7139 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:43:46 ctl02 nova-api[7139]: 2017-09-28 12:43:46.227 7139 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:43:46 ctl02 nova-api[7139]: 2017-09-28 12:43:46.227 7139 ERROR nova Traceback (most recent call last):
Sep 28 12:43:46 ctl02 nova-api[7139]: 2017-09-28 12:43:46.227 7139 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:43:46 ctl02 nova-api[7139]: 2017-09-28 12:43:46.227 7139 ERROR nova     sys.exit(main())
Sep 28 12:43:46 ctl02 nova-api[7139]: 2017-09-28 12:43:46.227 7139 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:43:46 ctl02 nova-api[7139]: 2017-09-28 12:43:46.227 7139 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:43:46 ctl02 nova-api[7139]: 2017-09-28 12:43:46.227 7139 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:43:46 ctl02 nova-api[7139]: 2017-09-28 12:43:46.227 7139 ERROR nova     max_url_len=max_url_len)
Sep 28 12:43:46 ctl02 nova-api[7139]: 2017-09-28 12:43:46.227 7139 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:43:46 ctl02 nova-api[7139]: 2017-09-28 12:43:46.227 7139 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:43:46 ctl02 nova-api[7139]: 2017-09-28 12:43:46.227 7139 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:43:46 ctl02 nova-api[7139]: 2017-09-28 12:43:46.227 7139 ERROR nova     sock.listen(backlog)
Sep 28 12:43:46 ctl02 nova-api[7139]: 2017-09-28 12:43:46.227 7139 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:43:46 ctl02 nova-api[7139]: 2017-09-28 12:43:46.227 7139 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:43:46 ctl02 nova-api[7139]: 2017-09-28 12:43:46.227 7139 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:43:46 ctl02 nova-api[7139]: 2017-09-28 12:43:46.227 7139 ERROR nova
Sep 28 12:43:46 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:43:46 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:43:46 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:43:46 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x47190c21)
Sep 28 12:43:46 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:43:46 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:43:46 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:43:46 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:43:47 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x47190c21)
Sep 28 12:43:47 ctl02 heat-api[13008]: 2017-09-28 12:43:47.686 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:43:47] "OPTIONS / HTTP/1.0" 200 134 0.000547
Sep 28 12:43:48 ctl02 nova-api[7157]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:43:48 ctl02 nova-api[7157]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:43:48 ctl02 nova-api[7157]: 2017-09-28 12:43:48.461 7157 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:43:48 ctl02 nova-api[7157]: 2017-09-28 12:43:48.462 7157 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:43:48 ctl02 nova-api[7157]: 2017-09-28 12:43:48.462 7157 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:43:48 ctl02 nova-api[7157]: 2017-09-28 12:43:48.462 7157 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:43:48 ctl02 nova-api[7157]: 2017-09-28 12:43:48.462 7157 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:43:48 ctl02 nova-api[7157]: 2017-09-28 12:43:48.462 7157 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:43:48 ctl02 nova-api[7157]: 2017-09-28 12:43:48.462 7157 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:43:48 ctl02 nova-api[7157]: 2017-09-28 12:43:48.462 7157 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:43:48 ctl02 nova-api[7157]: 2017-09-28 12:43:48.462 7157 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:43:48 ctl02 nova-api[7157]: 2017-09-28 12:43:48.462 7157 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:43:48 ctl02 nova-api[7157]: 2017-09-28 12:43:48.462 7157 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:43:48 ctl02 nova-api[7157]: 2017-09-28 12:43:48.462 7157 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:43:48 ctl02 nova-api[7157]: 2017-09-28 12:43:48.462 7157 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:43:48 ctl02 nova-api[7157]: 2017-09-28 12:43:48.462 7157 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:43:48 ctl02 nova-api[7157]: 2017-09-28 12:43:48.462 7157 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:43:48 ctl02 nova-api[7157]: 2017-09-28 12:43:48.462 7157 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:43:48 ctl02 nova-api[7157]: 2017-09-28 12:43:48.462 7157 ERROR nova.wsgi     self.filename))
Sep 28 12:43:48 ctl02 nova-api[7157]: 2017-09-28 12:43:48.462 7157 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:43:48 ctl02 nova-api[7157]: 2017-09-28 12:43:48.462 7157 ERROR nova.wsgi
Sep 28 12:43:48 ctl02 nova-api[7157]: 2017-09-28 12:43:48.464 7157 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:43:48 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x47190c21)
Sep 28 12:43:48 ctl02 nova-api[7157]: 2017-09-28 12:43:48.591 7157 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:43:48 ctl02 nova-api[7157]: 2017-09-28 12:43:48.811 7157 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:43:48 ctl02 nova-api[7157]: 2017-09-28 12:43:48.814 7157 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:43:48 ctl02 nova-api[7157]: 2017-09-28 12:43:48.814 7157 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:43:48 ctl02 nova-api[7157]: 2017-09-28 12:43:48.815 7157 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:43:48 ctl02 heat-api[13008]: 2017-09-28 12:43:48.825 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:43:48] "OPTIONS / HTTP/1.0" 200 134 0.000632
Sep 28 12:43:48 ctl02 nova-api[7157]: 2017-09-28 12:43:48.944 7157 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:43:48 ctl02 nova-api[7157]: 2017-09-28 12:43:48.946 7157 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:43:48 ctl02 nova-api[7157]: 2017-09-28 12:43:48.947 7157 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:43:48 ctl02 nova-api[7157]: 2017-09-28 12:43:48.947 7157 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:43:48 ctl02 nova-api[7157]: 2017-09-28 12:43:48.950 7157 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:43:48 ctl02 nova-api[7157]: 2017-09-28 12:43:48.951 7157 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:43:48 ctl02 nova-api[7157]: 2017-09-28 12:43:48.951 7157 ERROR nova Traceback (most recent call last):
Sep 28 12:43:48 ctl02 nova-api[7157]: 2017-09-28 12:43:48.951 7157 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:43:48 ctl02 nova-api[7157]: 2017-09-28 12:43:48.951 7157 ERROR nova     sys.exit(main())
Sep 28 12:43:48 ctl02 nova-api[7157]: 2017-09-28 12:43:48.951 7157 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:43:48 ctl02 nova-api[7157]: 2017-09-28 12:43:48.951 7157 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:43:48 ctl02 nova-api[7157]: 2017-09-28 12:43:48.951 7157 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:43:48 ctl02 nova-api[7157]: 2017-09-28 12:43:48.951 7157 ERROR nova     max_url_len=max_url_len)
Sep 28 12:43:48 ctl02 nova-api[7157]: 2017-09-28 12:43:48.951 7157 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:43:48 ctl02 nova-api[7157]: 2017-09-28 12:43:48.951 7157 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:43:48 ctl02 nova-api[7157]: 2017-09-28 12:43:48.951 7157 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:43:48 ctl02 nova-api[7157]: 2017-09-28 12:43:48.951 7157 ERROR nova     sock.listen(backlog)
Sep 28 12:43:48 ctl02 nova-api[7157]: 2017-09-28 12:43:48.951 7157 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:43:48 ctl02 nova-api[7157]: 2017-09-28 12:43:48.951 7157 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:43:48 ctl02 nova-api[7157]: 2017-09-28 12:43:48.951 7157 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:43:48 ctl02 nova-api[7157]: 2017-09-28 12:43:48.951 7157 ERROR nova
Sep 28 12:43:48 ctl02 heat-api-cfn[13300]: 2017-09-28 12:43:48.988 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:43:48] "OPTIONS / HTTP/1.0" 200 134 0.000574
Sep 28 12:43:49 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:43:49 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:43:49 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:43:49 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:43:49.124 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:43:49] "OPTIONS / HTTP/1.0" 200 134 0.000548
Sep 28 12:43:49 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:43:49 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:43:49 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:43:49 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:43:49 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x47190c21)
Sep 28 12:43:49 ctl02 heat-api-cfn[13300]: 2017-09-28 12:43:49.627 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:43:49] "OPTIONS / HTTP/1.0" 200 134 0.000533
Sep 28 12:43:50 ctl02 neutron-server[30536]: 2017-09-28 12:43:50.342 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:43:50] "OPTIONS / HTTP/1.0" 200 262 0.000521
Sep 28 12:43:50 ctl02 neutron-server[30536]: 2017-09-28 12:43:50.447 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:43:50] "OPTIONS / HTTP/1.0" 200 262 0.000309
Sep 28 12:43:50 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:43:50 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:43:50 ctl02 neutron-server[30536]: 2017-09-28 12:43:50.554 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:43:50] "OPTIONS / HTTP/1.0" 200 262 0.000336
Sep 28 12:43:50 ctl02 glance-api[29183]: 2017-09-28 12:43:50.650 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:43:50] "OPTIONS / HTTP/1.0" 200 134 0.000549
Sep 28 12:43:50 ctl02 nova-cert[4860]: 2017-09-28 12:43:50.690 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:43:50 ctl02 nova-conductor[5056]: 2017-09-28 12:43:50.957 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:43:50 ctl02 nova-conductor[5056]: 2017-09-28 12:43:50.978 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:43:51 ctl02 nova-conductor[5056]: 2017-09-28 12:43:51.001 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:43:51 ctl02 nova-conductor[5056]: 2017-09-28 12:43:51.006 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:43:51 ctl02 nova-api[7175]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:43:51 ctl02 nova-api[7175]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:43:51 ctl02 neutron-server[30536]: 2017-09-28 12:43:51.285 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 2 dead agents out of 6:
Sep 28 12:43:51 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:43:51 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:42:56 cmp002
Sep 28 12:43:51 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:43:20 cmp002
Sep 28 12:43:51 ctl02 nova-api[7175]: 2017-09-28 12:43:51.340 7175 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:43:51 ctl02 nova-api[7175]: 2017-09-28 12:43:51.342 7175 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:43:51 ctl02 nova-api[7175]: 2017-09-28 12:43:51.342 7175 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:43:51 ctl02 nova-api[7175]: 2017-09-28 12:43:51.342 7175 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:43:51 ctl02 nova-api[7175]: 2017-09-28 12:43:51.342 7175 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:43:51 ctl02 nova-api[7175]: 2017-09-28 12:43:51.342 7175 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:43:51 ctl02 nova-api[7175]: 2017-09-28 12:43:51.342 7175 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:43:51 ctl02 nova-api[7175]: 2017-09-28 12:43:51.342 7175 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:43:51 ctl02 nova-api[7175]: 2017-09-28 12:43:51.342 7175 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:43:51 ctl02 nova-api[7175]: 2017-09-28 12:43:51.342 7175 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:43:51 ctl02 nova-api[7175]: 2017-09-28 12:43:51.342 7175 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:43:51 ctl02 nova-api[7175]: 2017-09-28 12:43:51.342 7175 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:43:51 ctl02 nova-api[7175]: 2017-09-28 12:43:51.342 7175 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:43:51 ctl02 nova-api[7175]: 2017-09-28 12:43:51.342 7175 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:43:51 ctl02 nova-api[7175]: 2017-09-28 12:43:51.342 7175 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:43:51 ctl02 nova-api[7175]: 2017-09-28 12:43:51.342 7175 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:43:51 ctl02 nova-api[7175]: 2017-09-28 12:43:51.342 7175 ERROR nova.wsgi     self.filename))
Sep 28 12:43:51 ctl02 nova-api[7175]: 2017-09-28 12:43:51.342 7175 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:43:51 ctl02 nova-api[7175]: 2017-09-28 12:43:51.342 7175 ERROR nova.wsgi
Sep 28 12:43:51 ctl02 nova-api[7175]: 2017-09-28 12:43:51.343 7175 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:43:51 ctl02 glance-api[29183]: 2017-09-28 12:43:51.428 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:43:51] "OPTIONS / HTTP/1.0" 200 134 0.000892
Sep 28 12:43:51 ctl02 nova-api[7175]: 2017-09-28 12:43:51.479 7175 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:43:51 ctl02 nova-api[7175]: 2017-09-28 12:43:51.734 7175 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:43:51 ctl02 nova-api[7175]: 2017-09-28 12:43:51.737 7175 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:43:51 ctl02 nova-api[7175]: 2017-09-28 12:43:51.737 7175 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:43:51 ctl02 nova-api[7175]: 2017-09-28 12:43:51.737 7175 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:43:51 ctl02 nova-api[7175]: 2017-09-28 12:43:51.870 7175 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:43:51 ctl02 nova-api[7175]: 2017-09-28 12:43:51.873 7175 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:43:51 ctl02 nova-api[7175]: 2017-09-28 12:43:51.873 7175 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:43:51 ctl02 nova-api[7175]: 2017-09-28 12:43:51.874 7175 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:43:51 ctl02 nova-api[7175]: 2017-09-28 12:43:51.877 7175 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:43:51 ctl02 nova-api[7175]: 2017-09-28 12:43:51.878 7175 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:43:51 ctl02 nova-api[7175]: 2017-09-28 12:43:51.878 7175 ERROR nova Traceback (most recent call last):
Sep 28 12:43:51 ctl02 nova-api[7175]: 2017-09-28 12:43:51.878 7175 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:43:51 ctl02 nova-api[7175]: 2017-09-28 12:43:51.878 7175 ERROR nova     sys.exit(main())
Sep 28 12:43:51 ctl02 nova-api[7175]: 2017-09-28 12:43:51.878 7175 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:43:51 ctl02 nova-api[7175]: 2017-09-28 12:43:51.878 7175 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:43:51 ctl02 nova-api[7175]: 2017-09-28 12:43:51.878 7175 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:43:51 ctl02 nova-api[7175]: 2017-09-28 12:43:51.878 7175 ERROR nova     max_url_len=max_url_len)
Sep 28 12:43:51 ctl02 nova-api[7175]: 2017-09-28 12:43:51.878 7175 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:43:51 ctl02 nova-api[7175]: 2017-09-28 12:43:51.878 7175 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:43:51 ctl02 nova-api[7175]: 2017-09-28 12:43:51.878 7175 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:43:51 ctl02 nova-api[7175]: 2017-09-28 12:43:51.878 7175 ERROR nova     sock.listen(backlog)
Sep 28 12:43:51 ctl02 nova-api[7175]: 2017-09-28 12:43:51.878 7175 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:43:51 ctl02 nova-api[7175]: 2017-09-28 12:43:51.878 7175 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:43:51 ctl02 nova-api[7175]: 2017-09-28 12:43:51.878 7175 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:43:51 ctl02 nova-api[7175]: 2017-09-28 12:43:51.878 7175 ERROR nova
Sep 28 12:43:52 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:43:52 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:43:52 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:43:52 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:43:52 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:43:52 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:43:52 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:43:52 ctl02 glance-api[29183]: 2017-09-28 12:43:52.607 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:43:52] "OPTIONS / HTTP/1.0" 200 134 0.000644
Sep 28 12:43:52 ctl02 heat-api-cfn[13300]: 2017-09-28 12:43:52.616 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:43:52] "OPTIONS / HTTP/1.0" 200 134 0.000479
Sep 28 12:43:53 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:43:53.700 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:43:53] "OPTIONS / HTTP/1.0" 200 134 0.000500
Sep 28 12:43:54 ctl02 nova-api[7198]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:43:54 ctl02 nova-api[7198]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:43:54 ctl02 nova-api[7198]: 2017-09-28 12:43:54.285 7198 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:43:54 ctl02 nova-api[7198]: 2017-09-28 12:43:54.286 7198 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:43:54 ctl02 nova-api[7198]: 2017-09-28 12:43:54.286 7198 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:43:54 ctl02 nova-api[7198]: 2017-09-28 12:43:54.286 7198 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:43:54 ctl02 nova-api[7198]: 2017-09-28 12:43:54.286 7198 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:43:54 ctl02 nova-api[7198]: 2017-09-28 12:43:54.286 7198 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:43:54 ctl02 nova-api[7198]: 2017-09-28 12:43:54.286 7198 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:43:54 ctl02 nova-api[7198]: 2017-09-28 12:43:54.286 7198 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:43:54 ctl02 nova-api[7198]: 2017-09-28 12:43:54.286 7198 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:43:54 ctl02 nova-api[7198]: 2017-09-28 12:43:54.286 7198 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:43:54 ctl02 nova-api[7198]: 2017-09-28 12:43:54.286 7198 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:43:54 ctl02 nova-api[7198]: 2017-09-28 12:43:54.286 7198 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:43:54 ctl02 nova-api[7198]: 2017-09-28 12:43:54.286 7198 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:43:54 ctl02 nova-api[7198]: 2017-09-28 12:43:54.286 7198 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:43:54 ctl02 nova-api[7198]: 2017-09-28 12:43:54.286 7198 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:43:54 ctl02 nova-api[7198]: 2017-09-28 12:43:54.286 7198 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:43:54 ctl02 nova-api[7198]: 2017-09-28 12:43:54.286 7198 ERROR nova.wsgi     self.filename))
Sep 28 12:43:54 ctl02 nova-api[7198]: 2017-09-28 12:43:54.286 7198 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:43:54 ctl02 nova-api[7198]: 2017-09-28 12:43:54.286 7198 ERROR nova.wsgi
Sep 28 12:43:54 ctl02 nova-api[7198]: 2017-09-28 12:43:54.287 7198 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:43:54 ctl02 nova-api[7198]: 2017-09-28 12:43:54.420 7198 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:43:54 ctl02 nova-api[7198]: 2017-09-28 12:43:54.673 7198 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:43:54 ctl02 nova-api[7198]: 2017-09-28 12:43:54.675 7198 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:43:54 ctl02 nova-api[7198]: 2017-09-28 12:43:54.675 7198 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:43:54 ctl02 nova-api[7198]: 2017-09-28 12:43:54.676 7198 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:43:54 ctl02 nova-api[7198]: 2017-09-28 12:43:54.809 7198 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:43:54 ctl02 nova-api[7198]: 2017-09-28 12:43:54.811 7198 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:43:54 ctl02 nova-api[7198]: 2017-09-28 12:43:54.811 7198 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:43:54 ctl02 nova-api[7198]: 2017-09-28 12:43:54.811 7198 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:43:54 ctl02 nova-api[7198]: 2017-09-28 12:43:54.814 7198 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:43:54 ctl02 nova-api[7198]: 2017-09-28 12:43:54.815 7198 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:43:54 ctl02 nova-api[7198]: 2017-09-28 12:43:54.815 7198 ERROR nova Traceback (most recent call last):
Sep 28 12:43:54 ctl02 nova-api[7198]: 2017-09-28 12:43:54.815 7198 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:43:54 ctl02 nova-api[7198]: 2017-09-28 12:43:54.815 7198 ERROR nova     sys.exit(main())
Sep 28 12:43:54 ctl02 nova-api[7198]: 2017-09-28 12:43:54.815 7198 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:43:54 ctl02 nova-api[7198]: 2017-09-28 12:43:54.815 7198 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:43:54 ctl02 nova-api[7198]: 2017-09-28 12:43:54.815 7198 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:43:54 ctl02 nova-api[7198]: 2017-09-28 12:43:54.815 7198 ERROR nova     max_url_len=max_url_len)
Sep 28 12:43:54 ctl02 nova-api[7198]: 2017-09-28 12:43:54.815 7198 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:43:54 ctl02 nova-api[7198]: 2017-09-28 12:43:54.815 7198 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:43:54 ctl02 nova-api[7198]: 2017-09-28 12:43:54.815 7198 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:43:54 ctl02 nova-api[7198]: 2017-09-28 12:43:54.815 7198 ERROR nova     sock.listen(backlog)
Sep 28 12:43:54 ctl02 nova-api[7198]: 2017-09-28 12:43:54.815 7198 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:43:54 ctl02 nova-api[7198]: 2017-09-28 12:43:54.815 7198 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:43:54 ctl02 nova-api[7198]: 2017-09-28 12:43:54.815 7198 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:43:54 ctl02 nova-api[7198]: 2017-09-28 12:43:54.815 7198 ERROR nova
Sep 28 12:43:54 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:43:54 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:43:54 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:43:55 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:43:55 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:43:55 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:43:55 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:43:55 ctl02 heat-api[13008]: 2017-09-28 12:43:55.343 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:43:55] "OPTIONS / HTTP/1.0" 200 134 0.000623
Sep 28 12:43:56 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:43:56.335 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:43:56] "OPTIONS / HTTP/1.0" 200 134 0.000469
Sep 28 12:43:56 ctl02 nova-api[7216]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:43:56 ctl02 nova-api[7216]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:43:57 ctl02 nova-api[7216]: 2017-09-28 12:43:57.021 7216 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:43:57 ctl02 nova-api[7216]: 2017-09-28 12:43:57.022 7216 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:43:57 ctl02 nova-api[7216]: 2017-09-28 12:43:57.022 7216 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:43:57 ctl02 nova-api[7216]: 2017-09-28 12:43:57.022 7216 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:43:57 ctl02 nova-api[7216]: 2017-09-28 12:43:57.022 7216 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:43:57 ctl02 nova-api[7216]: 2017-09-28 12:43:57.022 7216 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:43:57 ctl02 nova-api[7216]: 2017-09-28 12:43:57.022 7216 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:43:57 ctl02 nova-api[7216]: 2017-09-28 12:43:57.022 7216 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:43:57 ctl02 nova-api[7216]: 2017-09-28 12:43:57.022 7216 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:43:57 ctl02 nova-api[7216]: 2017-09-28 12:43:57.022 7216 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:43:57 ctl02 nova-api[7216]: 2017-09-28 12:43:57.022 7216 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:43:57 ctl02 nova-api[7216]: 2017-09-28 12:43:57.022 7216 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:43:57 ctl02 nova-api[7216]: 2017-09-28 12:43:57.022 7216 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:43:57 ctl02 nova-api[7216]: 2017-09-28 12:43:57.022 7216 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:43:57 ctl02 nova-api[7216]: 2017-09-28 12:43:57.022 7216 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:43:57 ctl02 nova-api[7216]: 2017-09-28 12:43:57.022 7216 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:43:57 ctl02 nova-api[7216]: 2017-09-28 12:43:57.022 7216 ERROR nova.wsgi     self.filename))
Sep 28 12:43:57 ctl02 nova-api[7216]: 2017-09-28 12:43:57.022 7216 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:43:57 ctl02 nova-api[7216]: 2017-09-28 12:43:57.022 7216 ERROR nova.wsgi
Sep 28 12:43:57 ctl02 nova-api[7216]: 2017-09-28 12:43:57.025 7216 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:43:57 ctl02 nova-api[7216]: 2017-09-28 12:43:57.158 7216 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:43:57 ctl02 heat-api[13008]: 2017-09-28 12:43:57.371 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:43:57] "OPTIONS / HTTP/1.0" 200 134 0.000648
Sep 28 12:43:57 ctl02 nova-api[7216]: 2017-09-28 12:43:57.411 7216 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:43:57 ctl02 nova-api[7216]: 2017-09-28 12:43:57.414 7216 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:43:57 ctl02 nova-api[7216]: 2017-09-28 12:43:57.414 7216 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:43:57 ctl02 nova-api[7216]: 2017-09-28 12:43:57.414 7216 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:43:57 ctl02 nova-api[7216]: 2017-09-28 12:43:57.548 7216 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:43:57 ctl02 nova-api[7216]: 2017-09-28 12:43:57.551 7216 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:43:57 ctl02 nova-api[7216]: 2017-09-28 12:43:57.551 7216 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:43:57 ctl02 nova-api[7216]: 2017-09-28 12:43:57.552 7216 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:43:57 ctl02 nova-api[7216]: 2017-09-28 12:43:57.555 7216 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:43:57 ctl02 nova-api[7216]: 2017-09-28 12:43:57.556 7216 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:43:57 ctl02 nova-api[7216]: 2017-09-28 12:43:57.556 7216 ERROR nova Traceback (most recent call last):
Sep 28 12:43:57 ctl02 nova-api[7216]: 2017-09-28 12:43:57.556 7216 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:43:57 ctl02 nova-api[7216]: 2017-09-28 12:43:57.556 7216 ERROR nova     sys.exit(main())
Sep 28 12:43:57 ctl02 nova-api[7216]: 2017-09-28 12:43:57.556 7216 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:43:57 ctl02 nova-api[7216]: 2017-09-28 12:43:57.556 7216 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:43:57 ctl02 nova-api[7216]: 2017-09-28 12:43:57.556 7216 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:43:57 ctl02 nova-api[7216]: 2017-09-28 12:43:57.556 7216 ERROR nova     max_url_len=max_url_len)
Sep 28 12:43:57 ctl02 nova-api[7216]: 2017-09-28 12:43:57.556 7216 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:43:57 ctl02 nova-api[7216]: 2017-09-28 12:43:57.556 7216 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:43:57 ctl02 nova-api[7216]: 2017-09-28 12:43:57.556 7216 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:43:57 ctl02 nova-api[7216]: 2017-09-28 12:43:57.556 7216 ERROR nova     sock.listen(backlog)
Sep 28 12:43:57 ctl02 nova-api[7216]: 2017-09-28 12:43:57.556 7216 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:43:57 ctl02 nova-api[7216]: 2017-09-28 12:43:57.556 7216 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:43:57 ctl02 nova-api[7216]: 2017-09-28 12:43:57.556 7216 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:43:57 ctl02 nova-api[7216]: 2017-09-28 12:43:57.556 7216 ERROR nova
Sep 28 12:43:57 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:43:57 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:43:57 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:43:57 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:43:57 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:43:57 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:43:57 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:43:58 ctl02 heat-api-cfn[13300]: 2017-09-28 12:43:58.894 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:43:58] "OPTIONS / HTTP/1.0" 200 134 0.000704
Sep 28 12:43:59 ctl02 heat-api[13008]: 2017-09-28 12:43:59.019 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:43:59] "OPTIONS / HTTP/1.0" 200 134 0.000647
Sep 28 12:43:59 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:43:59.190 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:43:59] "OPTIONS / HTTP/1.0" 200 134 0.000430
Sep 28 12:43:59 ctl02 heat-api-cfn[13300]: 2017-09-28 12:43:59.238 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:43:59] "OPTIONS / HTTP/1.0" 200 134 0.000473
Sep 28 12:43:59 ctl02 nova-api[7233]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:43:59 ctl02 nova-api[7233]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:43:59 ctl02 nova-api[7233]: 2017-09-28 12:43:59.790 7233 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:43:59 ctl02 nova-api[7233]: 2017-09-28 12:43:59.791 7233 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:43:59 ctl02 nova-api[7233]: 2017-09-28 12:43:59.791 7233 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:43:59 ctl02 nova-api[7233]: 2017-09-28 12:43:59.791 7233 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:43:59 ctl02 nova-api[7233]: 2017-09-28 12:43:59.791 7233 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:43:59 ctl02 nova-api[7233]: 2017-09-28 12:43:59.791 7233 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:43:59 ctl02 nova-api[7233]: 2017-09-28 12:43:59.791 7233 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:43:59 ctl02 nova-api[7233]: 2017-09-28 12:43:59.791 7233 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:43:59 ctl02 nova-api[7233]: 2017-09-28 12:43:59.791 7233 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:43:59 ctl02 nova-api[7233]: 2017-09-28 12:43:59.791 7233 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:43:59 ctl02 nova-api[7233]: 2017-09-28 12:43:59.791 7233 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:43:59 ctl02 nova-api[7233]: 2017-09-28 12:43:59.791 7233 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:43:59 ctl02 nova-api[7233]: 2017-09-28 12:43:59.791 7233 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:43:59 ctl02 nova-api[7233]: 2017-09-28 12:43:59.791 7233 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:43:59 ctl02 nova-api[7233]: 2017-09-28 12:43:59.791 7233 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:43:59 ctl02 nova-api[7233]: 2017-09-28 12:43:59.791 7233 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:43:59 ctl02 nova-api[7233]: 2017-09-28 12:43:59.791 7233 ERROR nova.wsgi     self.filename))
Sep 28 12:43:59 ctl02 nova-api[7233]: 2017-09-28 12:43:59.791 7233 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:43:59 ctl02 nova-api[7233]: 2017-09-28 12:43:59.791 7233 ERROR nova.wsgi
Sep 28 12:43:59 ctl02 nova-api[7233]: 2017-09-28 12:43:59.792 7233 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:43:59 ctl02 nova-api[7233]: 2017-09-28 12:43:59.924 7233 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:44:00 ctl02 neutron-server[30536]: 2017-09-28 12:44:00.062 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:44:00] "OPTIONS / HTTP/1.0" 200 262 0.000550
Sep 28 12:44:00 ctl02 nova-api[7233]: 2017-09-28 12:44:00.174 7233 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:44:00 ctl02 nova-api[7233]: 2017-09-28 12:44:00.176 7233 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:44:00 ctl02 nova-api[7233]: 2017-09-28 12:44:00.176 7233 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:44:00 ctl02 nova-api[7233]: 2017-09-28 12:44:00.177 7233 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:44:00 ctl02 neutron-server[30536]: 2017-09-28 12:44:00.186 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:44:00] "OPTIONS / HTTP/1.0" 200 262 0.000554
Sep 28 12:44:00 ctl02 nova-api[7233]: 2017-09-28 12:44:00.309 7233 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:44:00 ctl02 nova-api[7233]: 2017-09-28 12:44:00.312 7233 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:44:00 ctl02 nova-api[7233]: 2017-09-28 12:44:00.312 7233 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:44:00 ctl02 nova-api[7233]: 2017-09-28 12:44:00.312 7233 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:44:00 ctl02 nova-api[7233]: 2017-09-28 12:44:00.315 7233 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:44:00 ctl02 nova-api[7233]: 2017-09-28 12:44:00.316 7233 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:44:00 ctl02 nova-api[7233]: 2017-09-28 12:44:00.316 7233 ERROR nova Traceback (most recent call last):
Sep 28 12:44:00 ctl02 nova-api[7233]: 2017-09-28 12:44:00.316 7233 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:44:00 ctl02 nova-api[7233]: 2017-09-28 12:44:00.316 7233 ERROR nova     sys.exit(main())
Sep 28 12:44:00 ctl02 nova-api[7233]: 2017-09-28 12:44:00.316 7233 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:44:00 ctl02 nova-api[7233]: 2017-09-28 12:44:00.316 7233 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:44:00 ctl02 nova-api[7233]: 2017-09-28 12:44:00.316 7233 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:44:00 ctl02 nova-api[7233]: 2017-09-28 12:44:00.316 7233 ERROR nova     max_url_len=max_url_len)
Sep 28 12:44:00 ctl02 nova-api[7233]: 2017-09-28 12:44:00.316 7233 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:44:00 ctl02 nova-api[7233]: 2017-09-28 12:44:00.316 7233 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:44:00 ctl02 nova-api[7233]: 2017-09-28 12:44:00.316 7233 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:44:00 ctl02 nova-api[7233]: 2017-09-28 12:44:00.316 7233 ERROR nova     sock.listen(backlog)
Sep 28 12:44:00 ctl02 nova-api[7233]: 2017-09-28 12:44:00.316 7233 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:44:00 ctl02 nova-api[7233]: 2017-09-28 12:44:00.316 7233 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:44:00 ctl02 nova-api[7233]: 2017-09-28 12:44:00.316 7233 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:44:00 ctl02 nova-api[7233]: 2017-09-28 12:44:00.316 7233 ERROR nova
Sep 28 12:44:00 ctl02 neutron-server[30536]: 2017-09-28 12:44:00.384 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:44:00] "OPTIONS / HTTP/1.0" 200 262 0.000572
Sep 28 12:44:00 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:44:00 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:44:00 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:44:00 ctl02 nova-consoleauth[5433]: 2017-09-28 12:44:00.544 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:44:00 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:44:00 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:44:00 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:44:00 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:44:00 ctl02 glance-api[29183]: 2017-09-28 12:44:00.918 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:44:00] "OPTIONS / HTTP/1.0" 200 134 0.000659
Sep 28 12:44:01 ctl02 glance-api[29183]: 2017-09-28 12:44:01.617 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:44:01] "OPTIONS / HTTP/1.0" 200 134 0.000605
Sep 28 12:44:02 ctl02 heat-engine[12803]: 2017-09-28 12:44:02.103 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:44:02 ctl02 heat-engine[12803]: 2017-09-28 12:44:02.113 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:44:02 ctl02 heat-engine[12803]: 2017-09-28 12:44:02.113 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:44:02 ctl02 heat-engine[12803]: 2017-09-28 12:44:02.121 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:44:02 ctl02 nova-api[7252]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:44:02 ctl02 nova-api[7252]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:44:02 ctl02 heat-api-cfn[13300]: 2017-09-28 12:44:02.492 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:44:02] "OPTIONS / HTTP/1.0" 200 134 0.000992
Sep 28 12:44:02 ctl02 nova-api[7252]: 2017-09-28 12:44:02.507 7252 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:44:02 ctl02 nova-api[7252]: 2017-09-28 12:44:02.508 7252 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:44:02 ctl02 nova-api[7252]: 2017-09-28 12:44:02.508 7252 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:44:02 ctl02 nova-api[7252]: 2017-09-28 12:44:02.508 7252 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:44:02 ctl02 nova-api[7252]: 2017-09-28 12:44:02.508 7252 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:44:02 ctl02 nova-api[7252]: 2017-09-28 12:44:02.508 7252 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:44:02 ctl02 nova-api[7252]: 2017-09-28 12:44:02.508 7252 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:44:02 ctl02 nova-api[7252]: 2017-09-28 12:44:02.508 7252 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:44:02 ctl02 nova-api[7252]: 2017-09-28 12:44:02.508 7252 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:44:02 ctl02 nova-api[7252]: 2017-09-28 12:44:02.508 7252 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:44:02 ctl02 nova-api[7252]: 2017-09-28 12:44:02.508 7252 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:44:02 ctl02 nova-api[7252]: 2017-09-28 12:44:02.508 7252 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:44:02 ctl02 nova-api[7252]: 2017-09-28 12:44:02.508 7252 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:44:02 ctl02 nova-api[7252]: 2017-09-28 12:44:02.508 7252 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:44:02 ctl02 nova-api[7252]: 2017-09-28 12:44:02.508 7252 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:44:02 ctl02 nova-api[7252]: 2017-09-28 12:44:02.508 7252 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:44:02 ctl02 nova-api[7252]: 2017-09-28 12:44:02.508 7252 ERROR nova.wsgi     self.filename))
Sep 28 12:44:02 ctl02 nova-api[7252]: 2017-09-28 12:44:02.508 7252 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:44:02 ctl02 nova-api[7252]: 2017-09-28 12:44:02.508 7252 ERROR nova.wsgi
Sep 28 12:44:02 ctl02 nova-api[7252]: 2017-09-28 12:44:02.509 7252 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:44:02 ctl02 nova-api[7252]: 2017-09-28 12:44:02.641 7252 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:44:02 ctl02 glance-api[29183]: 2017-09-28 12:44:02.759 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:44:02] "OPTIONS / HTTP/1.0" 200 134 0.000701
Sep 28 12:44:02 ctl02 nova-api[7252]: 2017-09-28 12:44:02.888 7252 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:44:02 ctl02 nova-api[7252]: 2017-09-28 12:44:02.890 7252 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:44:02 ctl02 nova-api[7252]: 2017-09-28 12:44:02.891 7252 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:44:02 ctl02 nova-api[7252]: 2017-09-28 12:44:02.891 7252 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:44:03 ctl02 nova-api[7252]: 2017-09-28 12:44:03.023 7252 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:44:03 ctl02 nova-api[7252]: 2017-09-28 12:44:03.025 7252 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:44:03 ctl02 nova-api[7252]: 2017-09-28 12:44:03.025 7252 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:44:03 ctl02 nova-api[7252]: 2017-09-28 12:44:03.025 7252 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:44:03 ctl02 nova-api[7252]: 2017-09-28 12:44:03.028 7252 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:44:03 ctl02 nova-api[7252]: 2017-09-28 12:44:03.029 7252 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:44:03 ctl02 nova-api[7252]: 2017-09-28 12:44:03.029 7252 ERROR nova Traceback (most recent call last):
Sep 28 12:44:03 ctl02 nova-api[7252]: 2017-09-28 12:44:03.029 7252 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:44:03 ctl02 nova-api[7252]: 2017-09-28 12:44:03.029 7252 ERROR nova     sys.exit(main())
Sep 28 12:44:03 ctl02 nova-api[7252]: 2017-09-28 12:44:03.029 7252 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:44:03 ctl02 nova-api[7252]: 2017-09-28 12:44:03.029 7252 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:44:03 ctl02 nova-api[7252]: 2017-09-28 12:44:03.029 7252 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:44:03 ctl02 nova-api[7252]: 2017-09-28 12:44:03.029 7252 ERROR nova     max_url_len=max_url_len)
Sep 28 12:44:03 ctl02 nova-api[7252]: 2017-09-28 12:44:03.029 7252 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:44:03 ctl02 nova-api[7252]: 2017-09-28 12:44:03.029 7252 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:44:03 ctl02 nova-api[7252]: 2017-09-28 12:44:03.029 7252 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:44:03 ctl02 nova-api[7252]: 2017-09-28 12:44:03.029 7252 ERROR nova     sock.listen(backlog)
Sep 28 12:44:03 ctl02 nova-api[7252]: 2017-09-28 12:44:03.029 7252 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:44:03 ctl02 nova-api[7252]: 2017-09-28 12:44:03.029 7252 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:44:03 ctl02 nova-api[7252]: 2017-09-28 12:44:03.029 7252 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:44:03 ctl02 nova-api[7252]: 2017-09-28 12:44:03.029 7252 ERROR nova
Sep 28 12:44:03 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:44:03 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:44:03 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:44:03 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:44:03 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:44:03 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:44:03 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:44:03 ctl02 nova-scheduler[5620]: 2017-09-28 12:44:03.638 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:44:03 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:44:03.772 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:44:03] "OPTIONS / HTTP/1.0" 200 134 0.000423
Sep 28 12:44:05 ctl02 nova-api[7270]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:44:05 ctl02 nova-api[7270]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:44:05 ctl02 nova-api[7270]: 2017-09-28 12:44:05.231 7270 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:44:05 ctl02 nova-api[7270]: 2017-09-28 12:44:05.232 7270 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:44:05 ctl02 nova-api[7270]: 2017-09-28 12:44:05.232 7270 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:44:05 ctl02 nova-api[7270]: 2017-09-28 12:44:05.232 7270 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:44:05 ctl02 nova-api[7270]: 2017-09-28 12:44:05.232 7270 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:44:05 ctl02 nova-api[7270]: 2017-09-28 12:44:05.232 7270 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:44:05 ctl02 nova-api[7270]: 2017-09-28 12:44:05.232 7270 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:44:05 ctl02 nova-api[7270]: 2017-09-28 12:44:05.232 7270 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:44:05 ctl02 nova-api[7270]: 2017-09-28 12:44:05.232 7270 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:44:05 ctl02 nova-api[7270]: 2017-09-28 12:44:05.232 7270 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:44:05 ctl02 nova-api[7270]: 2017-09-28 12:44:05.232 7270 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:44:05 ctl02 nova-api[7270]: 2017-09-28 12:44:05.232 7270 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:44:05 ctl02 nova-api[7270]: 2017-09-28 12:44:05.232 7270 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:44:05 ctl02 nova-api[7270]: 2017-09-28 12:44:05.232 7270 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:44:05 ctl02 nova-api[7270]: 2017-09-28 12:44:05.232 7270 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:44:05 ctl02 nova-api[7270]: 2017-09-28 12:44:05.232 7270 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:44:05 ctl02 nova-api[7270]: 2017-09-28 12:44:05.232 7270 ERROR nova.wsgi     self.filename))
Sep 28 12:44:05 ctl02 nova-api[7270]: 2017-09-28 12:44:05.232 7270 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:44:05 ctl02 nova-api[7270]: 2017-09-28 12:44:05.232 7270 ERROR nova.wsgi
Sep 28 12:44:05 ctl02 nova-api[7270]: 2017-09-28 12:44:05.233 7270 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:44:05 ctl02 heat-api[13008]: 2017-09-28 12:44:05.335 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:44:05] "OPTIONS / HTTP/1.0" 200 134 0.000548
Sep 28 12:44:05 ctl02 nova-api[7270]: 2017-09-28 12:44:05.366 7270 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:44:05 ctl02 nova-api[7270]: 2017-09-28 12:44:05.626 7270 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:44:05 ctl02 nova-api[7270]: 2017-09-28 12:44:05.628 7270 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:44:05 ctl02 nova-api[7270]: 2017-09-28 12:44:05.628 7270 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:44:05 ctl02 nova-api[7270]: 2017-09-28 12:44:05.628 7270 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:44:05 ctl02 nova-api[7270]: 2017-09-28 12:44:05.762 7270 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:44:05 ctl02 nova-api[7270]: 2017-09-28 12:44:05.764 7270 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:44:05 ctl02 nova-api[7270]: 2017-09-28 12:44:05.765 7270 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:44:05 ctl02 nova-api[7270]: 2017-09-28 12:44:05.765 7270 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:44:05 ctl02 nova-api[7270]: 2017-09-28 12:44:05.768 7270 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:44:05 ctl02 nova-api[7270]: 2017-09-28 12:44:05.768 7270 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:44:05 ctl02 nova-api[7270]: 2017-09-28 12:44:05.768 7270 ERROR nova Traceback (most recent call last):
Sep 28 12:44:05 ctl02 nova-api[7270]: 2017-09-28 12:44:05.768 7270 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:44:05 ctl02 nova-api[7270]: 2017-09-28 12:44:05.768 7270 ERROR nova     sys.exit(main())
Sep 28 12:44:05 ctl02 nova-api[7270]: 2017-09-28 12:44:05.768 7270 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:44:05 ctl02 nova-api[7270]: 2017-09-28 12:44:05.768 7270 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:44:05 ctl02 nova-api[7270]: 2017-09-28 12:44:05.768 7270 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:44:05 ctl02 nova-api[7270]: 2017-09-28 12:44:05.768 7270 ERROR nova     max_url_len=max_url_len)
Sep 28 12:44:05 ctl02 nova-api[7270]: 2017-09-28 12:44:05.768 7270 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:44:05 ctl02 nova-api[7270]: 2017-09-28 12:44:05.768 7270 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:44:05 ctl02 nova-api[7270]: 2017-09-28 12:44:05.768 7270 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:44:05 ctl02 nova-api[7270]: 2017-09-28 12:44:05.768 7270 ERROR nova     sock.listen(backlog)
Sep 28 12:44:05 ctl02 nova-api[7270]: 2017-09-28 12:44:05.768 7270 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:44:05 ctl02 nova-api[7270]: 2017-09-28 12:44:05.768 7270 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:44:05 ctl02 nova-api[7270]: 2017-09-28 12:44:05.768 7270 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:44:05 ctl02 nova-api[7270]: 2017-09-28 12:44:05.768 7270 ERROR nova
Sep 28 12:44:05 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:44:05 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:44:05 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:44:06 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:44:06 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:44:06 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:44:06 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:44:06 ctl02 neutron-server[30536]: 2017-09-28 12:44:06.282 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 12:44:06 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:44:06 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:42:56 cmp002
Sep 28 12:44:06 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:43:28 cmp001
Sep 28 12:44:06 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:43:20 cmp002
Sep 28 12:44:06 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:44:06.364 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:44:06] "OPTIONS / HTTP/1.0" 200 134 0.000392
Sep 28 12:44:07 ctl02 heat-api[13008]: 2017-09-28 12:44:07.441 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:44:07] "OPTIONS / HTTP/1.0" 200 134 0.000541
Sep 28 12:44:07 ctl02 nova-api[7288]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:44:07 ctl02 nova-api[7288]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:44:08 ctl02 nova-api[7288]: 2017-09-28 12:44:08.007 7288 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:44:08 ctl02 nova-api[7288]: 2017-09-28 12:44:08.009 7288 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:44:08 ctl02 nova-api[7288]: 2017-09-28 12:44:08.009 7288 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:44:08 ctl02 nova-api[7288]: 2017-09-28 12:44:08.009 7288 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:44:08 ctl02 nova-api[7288]: 2017-09-28 12:44:08.009 7288 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:44:08 ctl02 nova-api[7288]: 2017-09-28 12:44:08.009 7288 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:44:08 ctl02 nova-api[7288]: 2017-09-28 12:44:08.009 7288 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:44:08 ctl02 nova-api[7288]: 2017-09-28 12:44:08.009 7288 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:44:08 ctl02 nova-api[7288]: 2017-09-28 12:44:08.009 7288 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:44:08 ctl02 nova-api[7288]: 2017-09-28 12:44:08.009 7288 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:44:08 ctl02 nova-api[7288]: 2017-09-28 12:44:08.009 7288 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:44:08 ctl02 nova-api[7288]: 2017-09-28 12:44:08.009 7288 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:44:08 ctl02 nova-api[7288]: 2017-09-28 12:44:08.009 7288 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:44:08 ctl02 nova-api[7288]: 2017-09-28 12:44:08.009 7288 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:44:08 ctl02 nova-api[7288]: 2017-09-28 12:44:08.009 7288 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:44:08 ctl02 nova-api[7288]: 2017-09-28 12:44:08.009 7288 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:44:08 ctl02 nova-api[7288]: 2017-09-28 12:44:08.009 7288 ERROR nova.wsgi     self.filename))
Sep 28 12:44:08 ctl02 nova-api[7288]: 2017-09-28 12:44:08.009 7288 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:44:08 ctl02 nova-api[7288]: 2017-09-28 12:44:08.009 7288 ERROR nova.wsgi
Sep 28 12:44:08 ctl02 nova-api[7288]: 2017-09-28 12:44:08.011 7288 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:44:08 ctl02 nova-api[7288]: 2017-09-28 12:44:08.146 7288 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:44:08 ctl02 nova-api[7288]: 2017-09-28 12:44:08.399 7288 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:44:08 ctl02 nova-api[7288]: 2017-09-28 12:44:08.402 7288 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:44:08 ctl02 nova-api[7288]: 2017-09-28 12:44:08.402 7288 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:44:08 ctl02 nova-api[7288]: 2017-09-28 12:44:08.402 7288 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:44:08 ctl02 nova-api[7288]: 2017-09-28 12:44:08.539 7288 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:44:08 ctl02 nova-api[7288]: 2017-09-28 12:44:08.541 7288 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:44:08 ctl02 nova-api[7288]: 2017-09-28 12:44:08.542 7288 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:44:08 ctl02 nova-api[7288]: 2017-09-28 12:44:08.542 7288 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:44:08 ctl02 nova-api[7288]: 2017-09-28 12:44:08.545 7288 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:44:08 ctl02 nova-api[7288]: 2017-09-28 12:44:08.546 7288 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:44:08 ctl02 nova-api[7288]: 2017-09-28 12:44:08.546 7288 ERROR nova Traceback (most recent call last):
Sep 28 12:44:08 ctl02 nova-api[7288]: 2017-09-28 12:44:08.546 7288 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:44:08 ctl02 nova-api[7288]: 2017-09-28 12:44:08.546 7288 ERROR nova     sys.exit(main())
Sep 28 12:44:08 ctl02 nova-api[7288]: 2017-09-28 12:44:08.546 7288 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:44:08 ctl02 nova-api[7288]: 2017-09-28 12:44:08.546 7288 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:44:08 ctl02 nova-api[7288]: 2017-09-28 12:44:08.546 7288 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:44:08 ctl02 nova-api[7288]: 2017-09-28 12:44:08.546 7288 ERROR nova     max_url_len=max_url_len)
Sep 28 12:44:08 ctl02 nova-api[7288]: 2017-09-28 12:44:08.546 7288 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:44:08 ctl02 nova-api[7288]: 2017-09-28 12:44:08.546 7288 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:44:08 ctl02 nova-api[7288]: 2017-09-28 12:44:08.546 7288 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:44:08 ctl02 nova-api[7288]: 2017-09-28 12:44:08.546 7288 ERROR nova     sock.listen(backlog)
Sep 28 12:44:08 ctl02 nova-api[7288]: 2017-09-28 12:44:08.546 7288 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:44:08 ctl02 nova-api[7288]: 2017-09-28 12:44:08.546 7288 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:44:08 ctl02 nova-api[7288]: 2017-09-28 12:44:08.546 7288 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:44:08 ctl02 nova-api[7288]: 2017-09-28 12:44:08.546 7288 ERROR nova
Sep 28 12:44:08 ctl02 heat-api-cfn[13300]: 2017-09-28 12:44:08.610 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:44:08] "OPTIONS / HTTP/1.0" 200 134 0.000516
Sep 28 12:44:08 ctl02 heat-api[13008]: 2017-09-28 12:44:08.653 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:44:08] "OPTIONS / HTTP/1.0" 200 134 0.000567
Sep 28 12:44:08 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:44:08 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:44:08 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:44:08 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:44:08 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:44:08 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:44:08 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:44:09 ctl02 heat-api-cfn[13300]: 2017-09-28 12:44:09.158 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:44:09] "OPTIONS / HTTP/1.0" 200 134 0.000497
Sep 28 12:44:09 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:44:09.476 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:44:09] "OPTIONS / HTTP/1.0" 200 134 0.000471
Sep 28 12:44:09 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3a66074a)
Sep 28 12:44:09 ctl02 neutron-server[30536]: 2017-09-28 12:44:09.855 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:44:09] "OPTIONS / HTTP/1.0" 200 262 0.000519
Sep 28 12:44:10 ctl02 neutron-server[30536]: 2017-09-28 12:44:10.144 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:44:10] "OPTIONS / HTTP/1.0" 200 262 0.000497
Sep 28 12:44:10 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3a66074a)
Sep 28 12:44:10 ctl02 neutron-server[30536]: 2017-09-28 12:44:10.513 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:44:10] "OPTIONS / HTTP/1.0" 200 262 0.000500
Sep 28 12:44:10 ctl02 nova-api[7306]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:44:10 ctl02 nova-api[7306]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:44:10 ctl02 nova-api[7306]: 2017-09-28 12:44:10.768 7306 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:44:10 ctl02 nova-api[7306]: 2017-09-28 12:44:10.769 7306 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:44:10 ctl02 nova-api[7306]: 2017-09-28 12:44:10.769 7306 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:44:10 ctl02 nova-api[7306]: 2017-09-28 12:44:10.769 7306 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:44:10 ctl02 nova-api[7306]: 2017-09-28 12:44:10.769 7306 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:44:10 ctl02 nova-api[7306]: 2017-09-28 12:44:10.769 7306 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:44:10 ctl02 nova-api[7306]: 2017-09-28 12:44:10.769 7306 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:44:10 ctl02 nova-api[7306]: 2017-09-28 12:44:10.769 7306 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:44:10 ctl02 nova-api[7306]: 2017-09-28 12:44:10.769 7306 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:44:10 ctl02 nova-api[7306]: 2017-09-28 12:44:10.769 7306 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:44:10 ctl02 nova-api[7306]: 2017-09-28 12:44:10.769 7306 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:44:10 ctl02 nova-api[7306]: 2017-09-28 12:44:10.769 7306 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:44:10 ctl02 nova-api[7306]: 2017-09-28 12:44:10.769 7306 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:44:10 ctl02 nova-api[7306]: 2017-09-28 12:44:10.769 7306 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:44:10 ctl02 nova-api[7306]: 2017-09-28 12:44:10.769 7306 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:44:10 ctl02 nova-api[7306]: 2017-09-28 12:44:10.769 7306 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:44:10 ctl02 nova-api[7306]: 2017-09-28 12:44:10.769 7306 ERROR nova.wsgi     self.filename))
Sep 28 12:44:10 ctl02 nova-api[7306]: 2017-09-28 12:44:10.769 7306 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:44:10 ctl02 nova-api[7306]: 2017-09-28 12:44:10.769 7306 ERROR nova.wsgi
Sep 28 12:44:10 ctl02 nova-api[7306]: 2017-09-28 12:44:10.772 7306 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:44:10 ctl02 nova-api[7306]: 2017-09-28 12:44:10.904 7306 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:44:11 ctl02 glance-api[29183]: 2017-09-28 12:44:11.111 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:44:11] "OPTIONS / HTTP/1.0" 200 134 0.000641
Sep 28 12:44:11 ctl02 nova-api[7306]: 2017-09-28 12:44:11.162 7306 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:44:11 ctl02 nova-api[7306]: 2017-09-28 12:44:11.165 7306 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:44:11 ctl02 nova-api[7306]: 2017-09-28 12:44:11.165 7306 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:44:11 ctl02 nova-api[7306]: 2017-09-28 12:44:11.165 7306 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:44:11 ctl02 glance-api[29183]: 2017-09-28 12:44:11.266 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:44:11] "OPTIONS / HTTP/1.0" 200 134 0.000552
Sep 28 12:44:11 ctl02 nova-api[7306]: 2017-09-28 12:44:11.304 7306 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:44:11 ctl02 nova-api[7306]: 2017-09-28 12:44:11.306 7306 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:44:11 ctl02 nova-api[7306]: 2017-09-28 12:44:11.306 7306 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:44:11 ctl02 nova-api[7306]: 2017-09-28 12:44:11.306 7306 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:44:11 ctl02 nova-api[7306]: 2017-09-28 12:44:11.310 7306 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:44:11 ctl02 nova-api[7306]: 2017-09-28 12:44:11.310 7306 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:44:11 ctl02 nova-api[7306]: 2017-09-28 12:44:11.310 7306 ERROR nova Traceback (most recent call last):
Sep 28 12:44:11 ctl02 nova-api[7306]: 2017-09-28 12:44:11.310 7306 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:44:11 ctl02 nova-api[7306]: 2017-09-28 12:44:11.310 7306 ERROR nova     sys.exit(main())
Sep 28 12:44:11 ctl02 nova-api[7306]: 2017-09-28 12:44:11.310 7306 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:44:11 ctl02 nova-api[7306]: 2017-09-28 12:44:11.310 7306 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:44:11 ctl02 nova-api[7306]: 2017-09-28 12:44:11.310 7306 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:44:11 ctl02 nova-api[7306]: 2017-09-28 12:44:11.310 7306 ERROR nova     max_url_len=max_url_len)
Sep 28 12:44:11 ctl02 nova-api[7306]: 2017-09-28 12:44:11.310 7306 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:44:11 ctl02 nova-api[7306]: 2017-09-28 12:44:11.310 7306 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:44:11 ctl02 nova-api[7306]: 2017-09-28 12:44:11.310 7306 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:44:11 ctl02 nova-api[7306]: 2017-09-28 12:44:11.310 7306 ERROR nova     sock.listen(backlog)
Sep 28 12:44:11 ctl02 nova-api[7306]: 2017-09-28 12:44:11.310 7306 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:44:11 ctl02 nova-api[7306]: 2017-09-28 12:44:11.310 7306 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:44:11 ctl02 nova-api[7306]: 2017-09-28 12:44:11.310 7306 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:44:11 ctl02 nova-api[7306]: 2017-09-28 12:44:11.310 7306 ERROR nova
Sep 28 12:44:11 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:44:11 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:44:11 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:44:11 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3a66074a)
Sep 28 12:44:11 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:44:11 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:44:11 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:44:11 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:44:12 ctl02 glance-api[29183]: 2017-09-28 12:44:12.385 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:44:12] "OPTIONS / HTTP/1.0" 200 134 0.000548
Sep 28 12:44:12 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3a66074a)
Sep 28 12:44:12 ctl02 heat-api-cfn[13300]: 2017-09-28 12:44:12.817 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:44:12] "OPTIONS / HTTP/1.0" 200 134 0.000431
Sep 28 12:44:13 ctl02 nova-api[7324]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:44:13 ctl02 nova-api[7324]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:44:13 ctl02 nova-api[7324]: 2017-09-28 12:44:13.497 7324 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:44:13 ctl02 nova-api[7324]: 2017-09-28 12:44:13.499 7324 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:44:13 ctl02 nova-api[7324]: 2017-09-28 12:44:13.499 7324 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:44:13 ctl02 nova-api[7324]: 2017-09-28 12:44:13.499 7324 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:44:13 ctl02 nova-api[7324]: 2017-09-28 12:44:13.499 7324 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:44:13 ctl02 nova-api[7324]: 2017-09-28 12:44:13.499 7324 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:44:13 ctl02 nova-api[7324]: 2017-09-28 12:44:13.499 7324 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:44:13 ctl02 nova-api[7324]: 2017-09-28 12:44:13.499 7324 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:44:13 ctl02 nova-api[7324]: 2017-09-28 12:44:13.499 7324 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:44:13 ctl02 nova-api[7324]: 2017-09-28 12:44:13.499 7324 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:44:13 ctl02 nova-api[7324]: 2017-09-28 12:44:13.499 7324 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:44:13 ctl02 nova-api[7324]: 2017-09-28 12:44:13.499 7324 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:44:13 ctl02 nova-api[7324]: 2017-09-28 12:44:13.499 7324 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:44:13 ctl02 nova-api[7324]: 2017-09-28 12:44:13.499 7324 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:44:13 ctl02 nova-api[7324]: 2017-09-28 12:44:13.499 7324 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:44:13 ctl02 nova-api[7324]: 2017-09-28 12:44:13.499 7324 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:44:13 ctl02 nova-api[7324]: 2017-09-28 12:44:13.499 7324 ERROR nova.wsgi     self.filename))
Sep 28 12:44:13 ctl02 nova-api[7324]: 2017-09-28 12:44:13.499 7324 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:44:13 ctl02 nova-api[7324]: 2017-09-28 12:44:13.499 7324 ERROR nova.wsgi
Sep 28 12:44:13 ctl02 nova-api[7324]: 2017-09-28 12:44:13.500 7324 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:44:13 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3a66074a)
Sep 28 12:44:13 ctl02 nova-api[7324]: 2017-09-28 12:44:13.633 7324 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:44:13 ctl02 nova-api[7324]: 2017-09-28 12:44:13.881 7324 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:44:13 ctl02 nova-api[7324]: 2017-09-28 12:44:13.883 7324 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:44:13 ctl02 nova-api[7324]: 2017-09-28 12:44:13.883 7324 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:44:13 ctl02 nova-api[7324]: 2017-09-28 12:44:13.884 7324 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:44:14 ctl02 nova-api[7324]: 2017-09-28 12:44:14.018 7324 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:44:14 ctl02 nova-api[7324]: 2017-09-28 12:44:14.020 7324 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:44:14 ctl02 nova-api[7324]: 2017-09-28 12:44:14.020 7324 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:44:14 ctl02 nova-api[7324]: 2017-09-28 12:44:14.021 7324 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:44:14 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:44:14.023 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:44:14] "OPTIONS / HTTP/1.0" 200 134 0.000466
Sep 28 12:44:14 ctl02 nova-api[7324]: 2017-09-28 12:44:14.025 7324 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:44:14 ctl02 nova-api[7324]: 2017-09-28 12:44:14.026 7324 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:44:14 ctl02 nova-api[7324]: 2017-09-28 12:44:14.026 7324 ERROR nova Traceback (most recent call last):
Sep 28 12:44:14 ctl02 nova-api[7324]: 2017-09-28 12:44:14.026 7324 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:44:14 ctl02 nova-api[7324]: 2017-09-28 12:44:14.026 7324 ERROR nova     sys.exit(main())
Sep 28 12:44:14 ctl02 nova-api[7324]: 2017-09-28 12:44:14.026 7324 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:44:14 ctl02 nova-api[7324]: 2017-09-28 12:44:14.026 7324 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:44:14 ctl02 nova-api[7324]: 2017-09-28 12:44:14.026 7324 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:44:14 ctl02 nova-api[7324]: 2017-09-28 12:44:14.026 7324 ERROR nova     max_url_len=max_url_len)
Sep 28 12:44:14 ctl02 nova-api[7324]: 2017-09-28 12:44:14.026 7324 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:44:14 ctl02 nova-api[7324]: 2017-09-28 12:44:14.026 7324 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:44:14 ctl02 nova-api[7324]: 2017-09-28 12:44:14.026 7324 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:44:14 ctl02 nova-api[7324]: 2017-09-28 12:44:14.026 7324 ERROR nova     sock.listen(backlog)
Sep 28 12:44:14 ctl02 nova-api[7324]: 2017-09-28 12:44:14.026 7324 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:44:14 ctl02 nova-api[7324]: 2017-09-28 12:44:14.026 7324 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:44:14 ctl02 nova-api[7324]: 2017-09-28 12:44:14.026 7324 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:44:14 ctl02 nova-api[7324]: 2017-09-28 12:44:14.026 7324 ERROR nova
Sep 28 12:44:14 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:44:14 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:44:14 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:44:14 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:44:14 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:44:14 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:44:14 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:44:14 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3a66074a)
Sep 28 12:44:15 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3a66074a)
Sep 28 12:44:15 ctl02 heat-api[13008]: 2017-09-28 12:44:15.530 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:44:15] "OPTIONS / HTTP/1.0" 200 134 0.000593
Sep 28 12:44:16 ctl02 nova-api[7342]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:44:16 ctl02 nova-api[7342]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:44:16 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:44:16.163 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:44:16] "OPTIONS / HTTP/1.0" 200 134 0.000519
Sep 28 12:44:16 ctl02 nova-api[7342]: 2017-09-28 12:44:16.290 7342 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:44:16 ctl02 nova-api[7342]: 2017-09-28 12:44:16.291 7342 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:44:16 ctl02 nova-api[7342]: 2017-09-28 12:44:16.291 7342 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:44:16 ctl02 nova-api[7342]: 2017-09-28 12:44:16.291 7342 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:44:16 ctl02 nova-api[7342]: 2017-09-28 12:44:16.291 7342 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:44:16 ctl02 nova-api[7342]: 2017-09-28 12:44:16.291 7342 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:44:16 ctl02 nova-api[7342]: 2017-09-28 12:44:16.291 7342 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:44:16 ctl02 nova-api[7342]: 2017-09-28 12:44:16.291 7342 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:44:16 ctl02 nova-api[7342]: 2017-09-28 12:44:16.291 7342 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:44:16 ctl02 nova-api[7342]: 2017-09-28 12:44:16.291 7342 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:44:16 ctl02 nova-api[7342]: 2017-09-28 12:44:16.291 7342 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:44:16 ctl02 nova-api[7342]: 2017-09-28 12:44:16.291 7342 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:44:16 ctl02 nova-api[7342]: 2017-09-28 12:44:16.291 7342 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:44:16 ctl02 nova-api[7342]: 2017-09-28 12:44:16.291 7342 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:44:16 ctl02 nova-api[7342]: 2017-09-28 12:44:16.291 7342 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:44:16 ctl02 nova-api[7342]: 2017-09-28 12:44:16.291 7342 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:44:16 ctl02 nova-api[7342]: 2017-09-28 12:44:16.291 7342 ERROR nova.wsgi     self.filename))
Sep 28 12:44:16 ctl02 nova-api[7342]: 2017-09-28 12:44:16.291 7342 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:44:16 ctl02 nova-api[7342]: 2017-09-28 12:44:16.291 7342 ERROR nova.wsgi
Sep 28 12:44:16 ctl02 nova-api[7342]: 2017-09-28 12:44:16.292 7342 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:44:16 ctl02 nova-api[7342]: 2017-09-28 12:44:16.426 7342 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:44:16 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3a66074a)
Sep 28 12:44:16 ctl02 nova-api[7342]: 2017-09-28 12:44:16.679 7342 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:44:16 ctl02 nova-api[7342]: 2017-09-28 12:44:16.681 7342 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:44:16 ctl02 nova-api[7342]: 2017-09-28 12:44:16.682 7342 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:44:16 ctl02 nova-api[7342]: 2017-09-28 12:44:16.682 7342 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:44:16 ctl02 nova-api[7342]: 2017-09-28 12:44:16.818 7342 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:44:16 ctl02 nova-api[7342]: 2017-09-28 12:44:16.820 7342 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:44:16 ctl02 nova-api[7342]: 2017-09-28 12:44:16.820 7342 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:44:16 ctl02 nova-api[7342]: 2017-09-28 12:44:16.820 7342 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:44:16 ctl02 nova-api[7342]: 2017-09-28 12:44:16.824 7342 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:44:16 ctl02 nova-api[7342]: 2017-09-28 12:44:16.824 7342 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:44:16 ctl02 nova-api[7342]: 2017-09-28 12:44:16.824 7342 ERROR nova Traceback (most recent call last):
Sep 28 12:44:16 ctl02 nova-api[7342]: 2017-09-28 12:44:16.824 7342 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:44:16 ctl02 nova-api[7342]: 2017-09-28 12:44:16.824 7342 ERROR nova     sys.exit(main())
Sep 28 12:44:16 ctl02 nova-api[7342]: 2017-09-28 12:44:16.824 7342 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:44:16 ctl02 nova-api[7342]: 2017-09-28 12:44:16.824 7342 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:44:16 ctl02 nova-api[7342]: 2017-09-28 12:44:16.824 7342 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:44:16 ctl02 nova-api[7342]: 2017-09-28 12:44:16.824 7342 ERROR nova     max_url_len=max_url_len)
Sep 28 12:44:16 ctl02 nova-api[7342]: 2017-09-28 12:44:16.824 7342 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:44:16 ctl02 nova-api[7342]: 2017-09-28 12:44:16.824 7342 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:44:16 ctl02 nova-api[7342]: 2017-09-28 12:44:16.824 7342 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:44:16 ctl02 nova-api[7342]: 2017-09-28 12:44:16.824 7342 ERROR nova     sock.listen(backlog)
Sep 28 12:44:16 ctl02 nova-api[7342]: 2017-09-28 12:44:16.824 7342 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:44:16 ctl02 nova-api[7342]: 2017-09-28 12:44:16.824 7342 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:44:16 ctl02 nova-api[7342]: 2017-09-28 12:44:16.824 7342 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:44:16 ctl02 nova-api[7342]: 2017-09-28 12:44:16.824 7342 ERROR nova
Sep 28 12:44:16 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:44:16 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:44:16 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:44:17 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:44:17 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:44:17 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:44:17 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:44:17 ctl02 heat-api[13008]: 2017-09-28 12:44:17.453 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:44:17] "OPTIONS / HTTP/1.0" 200 134 0.000514
Sep 28 12:44:17 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3a66074a)
Sep 28 12:44:18 ctl02 heat-api-cfn[13300]: 2017-09-28 12:44:18.417 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:44:18] "OPTIONS / HTTP/1.0" 200 134 0.000455
Sep 28 12:44:18 ctl02 heat-api[13008]: 2017-09-28 12:44:18.495 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:44:18] "OPTIONS / HTTP/1.0" 200 134 0.000517
Sep 28 12:44:18 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3a66074a)
Sep 28 12:44:18 ctl02 nova-api[7360]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:44:18 ctl02 nova-api[7360]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:44:18 ctl02 nova-api[7360]: 2017-09-28 12:44:18.974 7360 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:44:18 ctl02 nova-api[7360]: 2017-09-28 12:44:18.976 7360 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:44:18 ctl02 nova-api[7360]: 2017-09-28 12:44:18.976 7360 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:44:18 ctl02 nova-api[7360]: 2017-09-28 12:44:18.976 7360 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:44:18 ctl02 nova-api[7360]: 2017-09-28 12:44:18.976 7360 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:44:18 ctl02 nova-api[7360]: 2017-09-28 12:44:18.976 7360 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:44:18 ctl02 nova-api[7360]: 2017-09-28 12:44:18.976 7360 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:44:18 ctl02 nova-api[7360]: 2017-09-28 12:44:18.976 7360 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:44:18 ctl02 nova-api[7360]: 2017-09-28 12:44:18.976 7360 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:44:18 ctl02 nova-api[7360]: 2017-09-28 12:44:18.976 7360 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:44:18 ctl02 nova-api[7360]: 2017-09-28 12:44:18.976 7360 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:44:18 ctl02 nova-api[7360]: 2017-09-28 12:44:18.976 7360 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:44:18 ctl02 nova-api[7360]: 2017-09-28 12:44:18.976 7360 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:44:18 ctl02 nova-api[7360]: 2017-09-28 12:44:18.976 7360 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:44:18 ctl02 nova-api[7360]: 2017-09-28 12:44:18.976 7360 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:44:18 ctl02 nova-api[7360]: 2017-09-28 12:44:18.976 7360 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:44:18 ctl02 nova-api[7360]: 2017-09-28 12:44:18.976 7360 ERROR nova.wsgi     self.filename))
Sep 28 12:44:18 ctl02 nova-api[7360]: 2017-09-28 12:44:18.976 7360 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:44:18 ctl02 nova-api[7360]: 2017-09-28 12:44:18.976 7360 ERROR nova.wsgi
Sep 28 12:44:18 ctl02 nova-api[7360]: 2017-09-28 12:44:18.977 7360 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:44:19 ctl02 heat-api-cfn[13300]: 2017-09-28 12:44:19.067 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:44:19] "OPTIONS / HTTP/1.0" 200 134 0.000464
Sep 28 12:44:19 ctl02 nova-api[7360]: 2017-09-28 12:44:19.106 7360 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:44:19 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:44:19.173 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:44:19] "OPTIONS / HTTP/1.0" 200 134 0.000384
Sep 28 12:44:19 ctl02 nova-api[7360]: 2017-09-28 12:44:19.328 7360 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:44:19 ctl02 nova-api[7360]: 2017-09-28 12:44:19.330 7360 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:44:19 ctl02 nova-api[7360]: 2017-09-28 12:44:19.330 7360 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:44:19 ctl02 nova-api[7360]: 2017-09-28 12:44:19.331 7360 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:44:19 ctl02 nova-api[7360]: 2017-09-28 12:44:19.460 7360 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:44:19 ctl02 nova-api[7360]: 2017-09-28 12:44:19.462 7360 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:44:19 ctl02 nova-api[7360]: 2017-09-28 12:44:19.462 7360 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:44:19 ctl02 nova-api[7360]: 2017-09-28 12:44:19.462 7360 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:44:19 ctl02 nova-api[7360]: 2017-09-28 12:44:19.466 7360 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:44:19 ctl02 nova-api[7360]: 2017-09-28 12:44:19.467 7360 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:44:19 ctl02 nova-api[7360]: 2017-09-28 12:44:19.467 7360 ERROR nova Traceback (most recent call last):
Sep 28 12:44:19 ctl02 nova-api[7360]: 2017-09-28 12:44:19.467 7360 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:44:19 ctl02 nova-api[7360]: 2017-09-28 12:44:19.467 7360 ERROR nova     sys.exit(main())
Sep 28 12:44:19 ctl02 nova-api[7360]: 2017-09-28 12:44:19.467 7360 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:44:19 ctl02 nova-api[7360]: 2017-09-28 12:44:19.467 7360 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:44:19 ctl02 nova-api[7360]: 2017-09-28 12:44:19.467 7360 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:44:19 ctl02 nova-api[7360]: 2017-09-28 12:44:19.467 7360 ERROR nova     max_url_len=max_url_len)
Sep 28 12:44:19 ctl02 nova-api[7360]: 2017-09-28 12:44:19.467 7360 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:44:19 ctl02 nova-api[7360]: 2017-09-28 12:44:19.467 7360 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:44:19 ctl02 nova-api[7360]: 2017-09-28 12:44:19.467 7360 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:44:19 ctl02 nova-api[7360]: 2017-09-28 12:44:19.467 7360 ERROR nova     sock.listen(backlog)
Sep 28 12:44:19 ctl02 nova-api[7360]: 2017-09-28 12:44:19.467 7360 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:44:19 ctl02 nova-api[7360]: 2017-09-28 12:44:19.467 7360 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:44:19 ctl02 nova-api[7360]: 2017-09-28 12:44:19.467 7360 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:44:19 ctl02 nova-api[7360]: 2017-09-28 12:44:19.467 7360 ERROR nova
Sep 28 12:44:19 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3a66074a)
Sep 28 12:44:19 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:44:19 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:44:19 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:44:19 ctl02 neutron-server[30536]: 2017-09-28 12:44:19.787 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:44:19] "OPTIONS / HTTP/1.0" 200 262 0.000502
Sep 28 12:44:19 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:44:19 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:44:19 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:44:19 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:44:20 ctl02 neutron-server[30536]: 2017-09-28 12:44:20.085 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:44:20] "OPTIONS / HTTP/1.0" 200 262 0.000442
Sep 28 12:44:20 ctl02 neutron-server[30536]: 2017-09-28 12:44:20.404 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:44:20] "OPTIONS / HTTP/1.0" 200 262 0.000442
Sep 28 12:44:20 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:44:20 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:44:20 ctl02 glance-api[29183]: 2017-09-28 12:44:20.873 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:44:20] "OPTIONS / HTTP/1.0" 200 134 0.000546
Sep 28 12:44:21 ctl02 glance-api[29183]: 2017-09-28 12:44:21.212 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:44:21] "OPTIONS / HTTP/1.0" 200 134 0.000535
Sep 28 12:44:21 ctl02 neutron-server[30536]: 2017-09-28 12:44:21.278 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 12:44:21 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:44:21 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:42:56 cmp002
Sep 28 12:44:21 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:43:28 cmp001
Sep 28 12:44:21 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:43:20 cmp002
Sep 28 12:44:21 ctl02 nova-api[7378]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:44:21 ctl02 nova-api[7378]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:44:21 ctl02 nova-api[7378]: 2017-09-28 12:44:21.738 7378 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:44:21 ctl02 nova-api[7378]: 2017-09-28 12:44:21.739 7378 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:44:21 ctl02 nova-api[7378]: 2017-09-28 12:44:21.739 7378 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:44:21 ctl02 nova-api[7378]: 2017-09-28 12:44:21.739 7378 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:44:21 ctl02 nova-api[7378]: 2017-09-28 12:44:21.739 7378 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:44:21 ctl02 nova-api[7378]: 2017-09-28 12:44:21.739 7378 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:44:21 ctl02 nova-api[7378]: 2017-09-28 12:44:21.739 7378 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:44:21 ctl02 nova-api[7378]: 2017-09-28 12:44:21.739 7378 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:44:21 ctl02 nova-api[7378]: 2017-09-28 12:44:21.739 7378 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:44:21 ctl02 nova-api[7378]: 2017-09-28 12:44:21.739 7378 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:44:21 ctl02 nova-api[7378]: 2017-09-28 12:44:21.739 7378 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:44:21 ctl02 nova-api[7378]: 2017-09-28 12:44:21.739 7378 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:44:21 ctl02 nova-api[7378]: 2017-09-28 12:44:21.739 7378 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:44:21 ctl02 nova-api[7378]: 2017-09-28 12:44:21.739 7378 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:44:21 ctl02 nova-api[7378]: 2017-09-28 12:44:21.739 7378 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:44:21 ctl02 nova-api[7378]: 2017-09-28 12:44:21.739 7378 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:44:21 ctl02 nova-api[7378]: 2017-09-28 12:44:21.739 7378 ERROR nova.wsgi     self.filename))
Sep 28 12:44:21 ctl02 nova-api[7378]: 2017-09-28 12:44:21.739 7378 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:44:21 ctl02 nova-api[7378]: 2017-09-28 12:44:21.739 7378 ERROR nova.wsgi
Sep 28 12:44:21 ctl02 nova-api[7378]: 2017-09-28 12:44:21.742 7378 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:44:21 ctl02 nova-api[7378]: 2017-09-28 12:44:21.872 7378 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:44:22 ctl02 glance-api[29183]: 2017-09-28 12:44:22.091 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:44:22] "OPTIONS / HTTP/1.0" 200 134 0.000597
Sep 28 12:44:22 ctl02 nova-api[7378]: 2017-09-28 12:44:22.101 7378 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:44:22 ctl02 nova-api[7378]: 2017-09-28 12:44:22.103 7378 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:44:22 ctl02 nova-api[7378]: 2017-09-28 12:44:22.104 7378 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:44:22 ctl02 nova-api[7378]: 2017-09-28 12:44:22.104 7378 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:44:22 ctl02 nova-api[7378]: 2017-09-28 12:44:22.248 7378 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:44:22 ctl02 nova-api[7378]: 2017-09-28 12:44:22.250 7378 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:44:22 ctl02 nova-api[7378]: 2017-09-28 12:44:22.250 7378 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:44:22 ctl02 nova-api[7378]: 2017-09-28 12:44:22.250 7378 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:44:22 ctl02 nova-api[7378]: 2017-09-28 12:44:22.254 7378 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:44:22 ctl02 nova-api[7378]: 2017-09-28 12:44:22.254 7378 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:44:22 ctl02 nova-api[7378]: 2017-09-28 12:44:22.254 7378 ERROR nova Traceback (most recent call last):
Sep 28 12:44:22 ctl02 nova-api[7378]: 2017-09-28 12:44:22.254 7378 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:44:22 ctl02 nova-api[7378]: 2017-09-28 12:44:22.254 7378 ERROR nova     sys.exit(main())
Sep 28 12:44:22 ctl02 nova-api[7378]: 2017-09-28 12:44:22.254 7378 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:44:22 ctl02 nova-api[7378]: 2017-09-28 12:44:22.254 7378 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:44:22 ctl02 nova-api[7378]: 2017-09-28 12:44:22.254 7378 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:44:22 ctl02 nova-api[7378]: 2017-09-28 12:44:22.254 7378 ERROR nova     max_url_len=max_url_len)
Sep 28 12:44:22 ctl02 nova-api[7378]: 2017-09-28 12:44:22.254 7378 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:44:22 ctl02 nova-api[7378]: 2017-09-28 12:44:22.254 7378 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:44:22 ctl02 nova-api[7378]: 2017-09-28 12:44:22.254 7378 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:44:22 ctl02 nova-api[7378]: 2017-09-28 12:44:22.254 7378 ERROR nova     sock.listen(backlog)
Sep 28 12:44:22 ctl02 nova-api[7378]: 2017-09-28 12:44:22.254 7378 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:44:22 ctl02 nova-api[7378]: 2017-09-28 12:44:22.254 7378 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:44:22 ctl02 nova-api[7378]: 2017-09-28 12:44:22.254 7378 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:44:22 ctl02 nova-api[7378]: 2017-09-28 12:44:22.254 7378 ERROR nova
Sep 28 12:44:22 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:44:22 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:44:22 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:44:22 ctl02 heat-api-cfn[13300]: 2017-09-28 12:44:22.527 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:44:22] "OPTIONS / HTTP/1.0" 200 134 0.000604
Sep 28 12:44:22 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:44:22 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:44:22 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:44:22 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:44:22 ctl02 nova-cert[4860]: 2017-09-28 12:44:22.725 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:44:22 ctl02 nova-conductor[5056]: 2017-09-28 12:44:22.966 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:44:22 ctl02 nova-conductor[5056]: 2017-09-28 12:44:22.986 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:44:23 ctl02 nova-conductor[5056]: 2017-09-28 12:44:23.010 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:44:23 ctl02 nova-conductor[5056]: 2017-09-28 12:44:23.015 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:44:23 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:44:23.865 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:44:23] "OPTIONS / HTTP/1.0" 200 134 0.000464
Sep 28 12:44:24 ctl02 nova-api[7400]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:44:24 ctl02 nova-api[7400]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:44:24 ctl02 nova-api[7400]: 2017-09-28 12:44:24.536 7400 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:44:24 ctl02 nova-api[7400]: 2017-09-28 12:44:24.538 7400 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:44:24 ctl02 nova-api[7400]: 2017-09-28 12:44:24.538 7400 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:44:24 ctl02 nova-api[7400]: 2017-09-28 12:44:24.538 7400 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:44:24 ctl02 nova-api[7400]: 2017-09-28 12:44:24.538 7400 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:44:24 ctl02 nova-api[7400]: 2017-09-28 12:44:24.538 7400 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:44:24 ctl02 nova-api[7400]: 2017-09-28 12:44:24.538 7400 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:44:24 ctl02 nova-api[7400]: 2017-09-28 12:44:24.538 7400 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:44:24 ctl02 nova-api[7400]: 2017-09-28 12:44:24.538 7400 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:44:24 ctl02 nova-api[7400]: 2017-09-28 12:44:24.538 7400 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:44:24 ctl02 nova-api[7400]: 2017-09-28 12:44:24.538 7400 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:44:24 ctl02 nova-api[7400]: 2017-09-28 12:44:24.538 7400 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:44:24 ctl02 nova-api[7400]: 2017-09-28 12:44:24.538 7400 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:44:24 ctl02 nova-api[7400]: 2017-09-28 12:44:24.538 7400 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:44:24 ctl02 nova-api[7400]: 2017-09-28 12:44:24.538 7400 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:44:24 ctl02 nova-api[7400]: 2017-09-28 12:44:24.538 7400 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:44:24 ctl02 nova-api[7400]: 2017-09-28 12:44:24.538 7400 ERROR nova.wsgi     self.filename))
Sep 28 12:44:24 ctl02 nova-api[7400]: 2017-09-28 12:44:24.538 7400 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:44:24 ctl02 nova-api[7400]: 2017-09-28 12:44:24.538 7400 ERROR nova.wsgi
Sep 28 12:44:24 ctl02 nova-api[7400]: 2017-09-28 12:44:24.539 7400 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:44:24 ctl02 nova-api[7400]: 2017-09-28 12:44:24.673 7400 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:44:24 ctl02 nova-api[7400]: 2017-09-28 12:44:24.920 7400 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:44:24 ctl02 nova-api[7400]: 2017-09-28 12:44:24.923 7400 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:44:24 ctl02 nova-api[7400]: 2017-09-28 12:44:24.923 7400 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:44:24 ctl02 nova-api[7400]: 2017-09-28 12:44:24.923 7400 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:44:25 ctl02 nova-api[7400]: 2017-09-28 12:44:25.055 7400 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:44:25 ctl02 nova-api[7400]: 2017-09-28 12:44:25.057 7400 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:44:25 ctl02 nova-api[7400]: 2017-09-28 12:44:25.058 7400 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:44:25 ctl02 nova-api[7400]: 2017-09-28 12:44:25.058 7400 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:44:25 ctl02 nova-api[7400]: 2017-09-28 12:44:25.061 7400 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:44:25 ctl02 nova-api[7400]: 2017-09-28 12:44:25.062 7400 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:44:25 ctl02 nova-api[7400]: 2017-09-28 12:44:25.062 7400 ERROR nova Traceback (most recent call last):
Sep 28 12:44:25 ctl02 nova-api[7400]: 2017-09-28 12:44:25.062 7400 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:44:25 ctl02 nova-api[7400]: 2017-09-28 12:44:25.062 7400 ERROR nova     sys.exit(main())
Sep 28 12:44:25 ctl02 nova-api[7400]: 2017-09-28 12:44:25.062 7400 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:44:25 ctl02 nova-api[7400]: 2017-09-28 12:44:25.062 7400 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:44:25 ctl02 nova-api[7400]: 2017-09-28 12:44:25.062 7400 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:44:25 ctl02 nova-api[7400]: 2017-09-28 12:44:25.062 7400 ERROR nova     max_url_len=max_url_len)
Sep 28 12:44:25 ctl02 nova-api[7400]: 2017-09-28 12:44:25.062 7400 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:44:25 ctl02 nova-api[7400]: 2017-09-28 12:44:25.062 7400 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:44:25 ctl02 nova-api[7400]: 2017-09-28 12:44:25.062 7400 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:44:25 ctl02 nova-api[7400]: 2017-09-28 12:44:25.062 7400 ERROR nova     sock.listen(backlog)
Sep 28 12:44:25 ctl02 nova-api[7400]: 2017-09-28 12:44:25.062 7400 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:44:25 ctl02 nova-api[7400]: 2017-09-28 12:44:25.062 7400 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:44:25 ctl02 nova-api[7400]: 2017-09-28 12:44:25.062 7400 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:44:25 ctl02 nova-api[7400]: 2017-09-28 12:44:25.062 7400 ERROR nova
Sep 28 12:44:25 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:44:25 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:44:25 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:44:25 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:44:25 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:44:25 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:44:25 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:44:25 ctl02 heat-api[13008]: 2017-09-28 12:44:25.732 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:44:25] "OPTIONS / HTTP/1.0" 200 134 0.000621
Sep 28 12:44:25 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:44:25.976 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:44:25] "OPTIONS / HTTP/1.0" 200 134 0.000475
Sep 28 12:44:27 ctl02 nova-api[7418]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:44:27 ctl02 nova-api[7418]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:44:27 ctl02 nova-api[7418]: 2017-09-28 12:44:27.302 7418 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:44:27 ctl02 nova-api[7418]: 2017-09-28 12:44:27.304 7418 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:44:27 ctl02 nova-api[7418]: 2017-09-28 12:44:27.304 7418 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:44:27 ctl02 nova-api[7418]: 2017-09-28 12:44:27.304 7418 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:44:27 ctl02 nova-api[7418]: 2017-09-28 12:44:27.304 7418 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:44:27 ctl02 nova-api[7418]: 2017-09-28 12:44:27.304 7418 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:44:27 ctl02 nova-api[7418]: 2017-09-28 12:44:27.304 7418 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:44:27 ctl02 nova-api[7418]: 2017-09-28 12:44:27.304 7418 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:44:27 ctl02 nova-api[7418]: 2017-09-28 12:44:27.304 7418 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:44:27 ctl02 nova-api[7418]: 2017-09-28 12:44:27.304 7418 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:44:27 ctl02 nova-api[7418]: 2017-09-28 12:44:27.304 7418 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:44:27 ctl02 nova-api[7418]: 2017-09-28 12:44:27.304 7418 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:44:27 ctl02 nova-api[7418]: 2017-09-28 12:44:27.304 7418 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:44:27 ctl02 nova-api[7418]: 2017-09-28 12:44:27.304 7418 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:44:27 ctl02 nova-api[7418]: 2017-09-28 12:44:27.304 7418 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:44:27 ctl02 nova-api[7418]: 2017-09-28 12:44:27.304 7418 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:44:27 ctl02 nova-api[7418]: 2017-09-28 12:44:27.304 7418 ERROR nova.wsgi     self.filename))
Sep 28 12:44:27 ctl02 nova-api[7418]: 2017-09-28 12:44:27.304 7418 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:44:27 ctl02 nova-api[7418]: 2017-09-28 12:44:27.304 7418 ERROR nova.wsgi
Sep 28 12:44:27 ctl02 nova-api[7418]: 2017-09-28 12:44:27.306 7418 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:44:27 ctl02 nova-api[7418]: 2017-09-28 12:44:27.441 7418 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:44:27 ctl02 heat-api[13008]: 2017-09-28 12:44:27.647 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:44:27] "OPTIONS / HTTP/1.0" 200 134 0.000650
Sep 28 12:44:27 ctl02 nova-api[7418]: 2017-09-28 12:44:27.697 7418 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:44:27 ctl02 nova-api[7418]: 2017-09-28 12:44:27.700 7418 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:44:27 ctl02 nova-api[7418]: 2017-09-28 12:44:27.700 7418 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:44:27 ctl02 nova-api[7418]: 2017-09-28 12:44:27.701 7418 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:44:27 ctl02 nova-api[7418]: 2017-09-28 12:44:27.835 7418 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:44:27 ctl02 nova-api[7418]: 2017-09-28 12:44:27.838 7418 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:44:27 ctl02 nova-api[7418]: 2017-09-28 12:44:27.838 7418 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:44:27 ctl02 nova-api[7418]: 2017-09-28 12:44:27.839 7418 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:44:27 ctl02 nova-api[7418]: 2017-09-28 12:44:27.842 7418 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:44:27 ctl02 nova-api[7418]: 2017-09-28 12:44:27.843 7418 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:44:27 ctl02 nova-api[7418]: 2017-09-28 12:44:27.843 7418 ERROR nova Traceback (most recent call last):
Sep 28 12:44:27 ctl02 nova-api[7418]: 2017-09-28 12:44:27.843 7418 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:44:27 ctl02 nova-api[7418]: 2017-09-28 12:44:27.843 7418 ERROR nova     sys.exit(main())
Sep 28 12:44:27 ctl02 nova-api[7418]: 2017-09-28 12:44:27.843 7418 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:44:27 ctl02 nova-api[7418]: 2017-09-28 12:44:27.843 7418 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:44:27 ctl02 nova-api[7418]: 2017-09-28 12:44:27.843 7418 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:44:27 ctl02 nova-api[7418]: 2017-09-28 12:44:27.843 7418 ERROR nova     max_url_len=max_url_len)
Sep 28 12:44:27 ctl02 nova-api[7418]: 2017-09-28 12:44:27.843 7418 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:44:27 ctl02 nova-api[7418]: 2017-09-28 12:44:27.843 7418 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:44:27 ctl02 nova-api[7418]: 2017-09-28 12:44:27.843 7418 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:44:27 ctl02 nova-api[7418]: 2017-09-28 12:44:27.843 7418 ERROR nova     sock.listen(backlog)
Sep 28 12:44:27 ctl02 nova-api[7418]: 2017-09-28 12:44:27.843 7418 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:44:27 ctl02 nova-api[7418]: 2017-09-28 12:44:27.843 7418 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:44:27 ctl02 nova-api[7418]: 2017-09-28 12:44:27.843 7418 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:44:27 ctl02 nova-api[7418]: 2017-09-28 12:44:27.843 7418 ERROR nova
Sep 28 12:44:28 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:44:28 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:44:28 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:44:28 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:44:28 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:44:28 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:44:28 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:44:28 ctl02 heat-api-cfn[13300]: 2017-09-28 12:44:28.419 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:44:28] "OPTIONS / HTTP/1.0" 200 134 0.000498
Sep 28 12:44:28 ctl02 neutron-server[30536]: 2017-09-28 12:44:28.483 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:44:28 ctl02 heat-api[13008]: 2017-09-28 12:44:28.875 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:44:28] "OPTIONS / HTTP/1.0" 200 134 0.000599
Sep 28 12:44:29 ctl02 heat-api-cfn[13300]: 2017-09-28 12:44:29.149 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:44:29] "OPTIONS / HTTP/1.0" 200 134 0.000509
Sep 28 12:44:29 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:44:29.239 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:44:29] "OPTIONS / HTTP/1.0" 200 134 0.000467
Sep 28 12:44:29 ctl02 nova-api[7437]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:44:29 ctl02 nova-api[7437]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:44:29 ctl02 neutron-server[30536]: 2017-09-28 12:44:29.945 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:44:29] "OPTIONS / HTTP/1.0" 200 262 0.000549
Sep 28 12:44:30 ctl02 nova-api[7437]: 2017-09-28 12:44:30.028 7437 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:44:30 ctl02 nova-api[7437]: 2017-09-28 12:44:30.030 7437 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:44:30 ctl02 nova-api[7437]: 2017-09-28 12:44:30.030 7437 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:44:30 ctl02 nova-api[7437]: 2017-09-28 12:44:30.030 7437 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:44:30 ctl02 nova-api[7437]: 2017-09-28 12:44:30.030 7437 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:44:30 ctl02 nova-api[7437]: 2017-09-28 12:44:30.030 7437 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:44:30 ctl02 nova-api[7437]: 2017-09-28 12:44:30.030 7437 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:44:30 ctl02 nova-api[7437]: 2017-09-28 12:44:30.030 7437 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:44:30 ctl02 nova-api[7437]: 2017-09-28 12:44:30.030 7437 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:44:30 ctl02 nova-api[7437]: 2017-09-28 12:44:30.030 7437 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:44:30 ctl02 nova-api[7437]: 2017-09-28 12:44:30.030 7437 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:44:30 ctl02 nova-api[7437]: 2017-09-28 12:44:30.030 7437 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:44:30 ctl02 nova-api[7437]: 2017-09-28 12:44:30.030 7437 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:44:30 ctl02 nova-api[7437]: 2017-09-28 12:44:30.030 7437 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:44:30 ctl02 nova-api[7437]: 2017-09-28 12:44:30.030 7437 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:44:30 ctl02 nova-api[7437]: 2017-09-28 12:44:30.030 7437 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:44:30 ctl02 nova-api[7437]: 2017-09-28 12:44:30.030 7437 ERROR nova.wsgi     self.filename))
Sep 28 12:44:30 ctl02 nova-api[7437]: 2017-09-28 12:44:30.030 7437 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:44:30 ctl02 nova-api[7437]: 2017-09-28 12:44:30.030 7437 ERROR nova.wsgi
Sep 28 12:44:30 ctl02 nova-api[7437]: 2017-09-28 12:44:30.031 7437 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:44:30 ctl02 nova-api[7437]: 2017-09-28 12:44:30.166 7437 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:44:30 ctl02 neutron-server[30536]: 2017-09-28 12:44:30.380 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:44:30] "OPTIONS / HTTP/1.0" 200 262 0.000548
Sep 28 12:44:30 ctl02 nova-api[7437]: 2017-09-28 12:44:30.417 7437 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:44:30 ctl02 nova-api[7437]: 2017-09-28 12:44:30.420 7437 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:44:30 ctl02 nova-api[7437]: 2017-09-28 12:44:30.420 7437 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:44:30 ctl02 nova-api[7437]: 2017-09-28 12:44:30.420 7437 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:44:30 ctl02 neutron-server[30536]: 2017-09-28 12:44:30.499 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:44:30] "OPTIONS / HTTP/1.0" 200 262 0.000579
Sep 28 12:44:30 ctl02 nova-api[7437]: 2017-09-28 12:44:30.554 7437 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:44:30 ctl02 nova-api[7437]: 2017-09-28 12:44:30.556 7437 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:44:30 ctl02 nova-api[7437]: 2017-09-28 12:44:30.556 7437 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:44:30 ctl02 nova-api[7437]: 2017-09-28 12:44:30.557 7437 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:44:30 ctl02 nova-api[7437]: 2017-09-28 12:44:30.560 7437 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:44:30 ctl02 nova-api[7437]: 2017-09-28 12:44:30.560 7437 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:44:30 ctl02 nova-api[7437]: 2017-09-28 12:44:30.560 7437 ERROR nova Traceback (most recent call last):
Sep 28 12:44:30 ctl02 nova-api[7437]: 2017-09-28 12:44:30.560 7437 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:44:30 ctl02 nova-api[7437]: 2017-09-28 12:44:30.560 7437 ERROR nova     sys.exit(main())
Sep 28 12:44:30 ctl02 nova-api[7437]: 2017-09-28 12:44:30.560 7437 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:44:30 ctl02 nova-api[7437]: 2017-09-28 12:44:30.560 7437 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:44:30 ctl02 nova-api[7437]: 2017-09-28 12:44:30.560 7437 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:44:30 ctl02 nova-api[7437]: 2017-09-28 12:44:30.560 7437 ERROR nova     max_url_len=max_url_len)
Sep 28 12:44:30 ctl02 nova-api[7437]: 2017-09-28 12:44:30.560 7437 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:44:30 ctl02 nova-api[7437]: 2017-09-28 12:44:30.560 7437 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:44:30 ctl02 nova-api[7437]: 2017-09-28 12:44:30.560 7437 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:44:30 ctl02 nova-api[7437]: 2017-09-28 12:44:30.560 7437 ERROR nova     sock.listen(backlog)
Sep 28 12:44:30 ctl02 nova-api[7437]: 2017-09-28 12:44:30.560 7437 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:44:30 ctl02 nova-api[7437]: 2017-09-28 12:44:30.560 7437 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:44:30 ctl02 nova-api[7437]: 2017-09-28 12:44:30.560 7437 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:44:30 ctl02 nova-api[7437]: 2017-09-28 12:44:30.560 7437 ERROR nova
Sep 28 12:44:30 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:44:30 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:44:30 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:44:30 ctl02 glance-api[29183]: 2017-09-28 12:44:30.838 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:44:30] "OPTIONS / HTTP/1.0" 200 134 0.000985
Sep 28 12:44:30 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:44:30 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:44:30 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:44:30 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:44:31 ctl02 glance-api[29183]: 2017-09-28 12:44:31.301 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:44:31] "OPTIONS / HTTP/1.0" 200 134 0.000535
Sep 28 12:44:31 ctl02 glance-api[29183]: 2017-09-28 12:44:31.940 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:44:31] "OPTIONS / HTTP/1.0" 200 134 0.000573
Sep 28 12:44:32 ctl02 nova-api[7455]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:44:32 ctl02 nova-api[7455]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:44:32 ctl02 nova-consoleauth[5433]: 2017-09-28 12:44:32.583 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:44:32 ctl02 heat-api-cfn[13300]: 2017-09-28 12:44:32.594 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:44:32] "OPTIONS / HTTP/1.0" 200 134 0.000492
Sep 28 12:44:32 ctl02 nova-api[7455]: 2017-09-28 12:44:32.748 7455 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:44:32 ctl02 nova-api[7455]: 2017-09-28 12:44:32.750 7455 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:44:32 ctl02 nova-api[7455]: 2017-09-28 12:44:32.750 7455 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:44:32 ctl02 nova-api[7455]: 2017-09-28 12:44:32.750 7455 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:44:32 ctl02 nova-api[7455]: 2017-09-28 12:44:32.750 7455 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:44:32 ctl02 nova-api[7455]: 2017-09-28 12:44:32.750 7455 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:44:32 ctl02 nova-api[7455]: 2017-09-28 12:44:32.750 7455 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:44:32 ctl02 nova-api[7455]: 2017-09-28 12:44:32.750 7455 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:44:32 ctl02 nova-api[7455]: 2017-09-28 12:44:32.750 7455 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:44:32 ctl02 nova-api[7455]: 2017-09-28 12:44:32.750 7455 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:44:32 ctl02 nova-api[7455]: 2017-09-28 12:44:32.750 7455 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:44:32 ctl02 nova-api[7455]: 2017-09-28 12:44:32.750 7455 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:44:32 ctl02 nova-api[7455]: 2017-09-28 12:44:32.750 7455 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:44:32 ctl02 nova-api[7455]: 2017-09-28 12:44:32.750 7455 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:44:32 ctl02 nova-api[7455]: 2017-09-28 12:44:32.750 7455 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:44:32 ctl02 nova-api[7455]: 2017-09-28 12:44:32.750 7455 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:44:32 ctl02 nova-api[7455]: 2017-09-28 12:44:32.750 7455 ERROR nova.wsgi     self.filename))
Sep 28 12:44:32 ctl02 nova-api[7455]: 2017-09-28 12:44:32.750 7455 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:44:32 ctl02 nova-api[7455]: 2017-09-28 12:44:32.750 7455 ERROR nova.wsgi
Sep 28 12:44:32 ctl02 nova-api[7455]: 2017-09-28 12:44:32.751 7455 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:44:32 ctl02 nova-api[7455]: 2017-09-28 12:44:32.884 7455 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:44:33 ctl02 nova-api[7455]: 2017-09-28 12:44:33.112 7455 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:44:33 ctl02 nova-api[7455]: 2017-09-28 12:44:33.114 7455 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:44:33 ctl02 nova-api[7455]: 2017-09-28 12:44:33.115 7455 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:44:33 ctl02 nova-api[7455]: 2017-09-28 12:44:33.115 7455 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:44:33 ctl02 nova-api[7455]: 2017-09-28 12:44:33.249 7455 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:44:33 ctl02 nova-api[7455]: 2017-09-28 12:44:33.251 7455 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:44:33 ctl02 nova-api[7455]: 2017-09-28 12:44:33.251 7455 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:44:33 ctl02 nova-api[7455]: 2017-09-28 12:44:33.252 7455 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:44:33 ctl02 nova-api[7455]: 2017-09-28 12:44:33.255 7455 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:44:33 ctl02 nova-api[7455]: 2017-09-28 12:44:33.255 7455 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:44:33 ctl02 nova-api[7455]: 2017-09-28 12:44:33.255 7455 ERROR nova Traceback (most recent call last):
Sep 28 12:44:33 ctl02 nova-api[7455]: 2017-09-28 12:44:33.255 7455 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:44:33 ctl02 nova-api[7455]: 2017-09-28 12:44:33.255 7455 ERROR nova     sys.exit(main())
Sep 28 12:44:33 ctl02 nova-api[7455]: 2017-09-28 12:44:33.255 7455 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:44:33 ctl02 nova-api[7455]: 2017-09-28 12:44:33.255 7455 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:44:33 ctl02 nova-api[7455]: 2017-09-28 12:44:33.255 7455 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:44:33 ctl02 nova-api[7455]: 2017-09-28 12:44:33.255 7455 ERROR nova     max_url_len=max_url_len)
Sep 28 12:44:33 ctl02 nova-api[7455]: 2017-09-28 12:44:33.255 7455 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:44:33 ctl02 nova-api[7455]: 2017-09-28 12:44:33.255 7455 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:44:33 ctl02 nova-api[7455]: 2017-09-28 12:44:33.255 7455 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:44:33 ctl02 nova-api[7455]: 2017-09-28 12:44:33.255 7455 ERROR nova     sock.listen(backlog)
Sep 28 12:44:33 ctl02 nova-api[7455]: 2017-09-28 12:44:33.255 7455 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:44:33 ctl02 nova-api[7455]: 2017-09-28 12:44:33.255 7455 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:44:33 ctl02 nova-api[7455]: 2017-09-28 12:44:33.255 7455 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:44:33 ctl02 nova-api[7455]: 2017-09-28 12:44:33.255 7455 ERROR nova
Sep 28 12:44:33 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:44:33 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:44:33 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:44:33 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:44:33 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:44:33 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:44:33 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:44:34 ctl02 heat-engine[12803]: 2017-09-28 12:44:34.112 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:44:34 ctl02 heat-engine[12803]: 2017-09-28 12:44:34.121 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:44:34 ctl02 heat-engine[12803]: 2017-09-28 12:44:34.121 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:44:34 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:44:34.123 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:44:34] "OPTIONS / HTTP/1.0" 200 134 0.000357
Sep 28 12:44:34 ctl02 heat-engine[12803]: 2017-09-28 12:44:34.133 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:44:35 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb0f21f76)
Sep 28 12:44:35 ctl02 nova-api[7473]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:44:35 ctl02 nova-api[7473]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:44:35 ctl02 nova-api[7473]: 2017-09-28 12:44:35.493 7473 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:44:35 ctl02 nova-api[7473]: 2017-09-28 12:44:35.495 7473 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:44:35 ctl02 nova-api[7473]: 2017-09-28 12:44:35.495 7473 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:44:35 ctl02 nova-api[7473]: 2017-09-28 12:44:35.495 7473 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:44:35 ctl02 nova-api[7473]: 2017-09-28 12:44:35.495 7473 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:44:35 ctl02 nova-api[7473]: 2017-09-28 12:44:35.495 7473 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:44:35 ctl02 nova-api[7473]: 2017-09-28 12:44:35.495 7473 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:44:35 ctl02 nova-api[7473]: 2017-09-28 12:44:35.495 7473 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:44:35 ctl02 nova-api[7473]: 2017-09-28 12:44:35.495 7473 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:44:35 ctl02 nova-api[7473]: 2017-09-28 12:44:35.495 7473 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:44:35 ctl02 nova-api[7473]: 2017-09-28 12:44:35.495 7473 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:44:35 ctl02 nova-api[7473]: 2017-09-28 12:44:35.495 7473 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:44:35 ctl02 nova-api[7473]: 2017-09-28 12:44:35.495 7473 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:44:35 ctl02 nova-api[7473]: 2017-09-28 12:44:35.495 7473 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:44:35 ctl02 nova-api[7473]: 2017-09-28 12:44:35.495 7473 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:44:35 ctl02 nova-api[7473]: 2017-09-28 12:44:35.495 7473 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:44:35 ctl02 nova-api[7473]: 2017-09-28 12:44:35.495 7473 ERROR nova.wsgi     self.filename))
Sep 28 12:44:35 ctl02 nova-api[7473]: 2017-09-28 12:44:35.495 7473 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:44:35 ctl02 nova-api[7473]: 2017-09-28 12:44:35.495 7473 ERROR nova.wsgi
Sep 28 12:44:35 ctl02 nova-api[7473]: 2017-09-28 12:44:35.495 7473 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:44:35 ctl02 nova-api[7473]: 2017-09-28 12:44:35.625 7473 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:44:35 ctl02 nova-scheduler[5620]: 2017-09-28 12:44:35.674 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:44:35 ctl02 nova-api[7473]: 2017-09-28 12:44:35.850 7473 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:44:35 ctl02 nova-api[7473]: 2017-09-28 12:44:35.852 7473 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:44:35 ctl02 nova-api[7473]: 2017-09-28 12:44:35.852 7473 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:44:35 ctl02 nova-api[7473]: 2017-09-28 12:44:35.853 7473 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:44:35 ctl02 nova-api[7473]: 2017-09-28 12:44:35.984 7473 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:44:35 ctl02 nova-api[7473]: 2017-09-28 12:44:35.986 7473 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:44:35 ctl02 nova-api[7473]: 2017-09-28 12:44:35.986 7473 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:44:35 ctl02 nova-api[7473]: 2017-09-28 12:44:35.987 7473 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:44:35 ctl02 nova-api[7473]: 2017-09-28 12:44:35.991 7473 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:44:35 ctl02 nova-api[7473]: 2017-09-28 12:44:35.991 7473 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:44:35 ctl02 nova-api[7473]: 2017-09-28 12:44:35.991 7473 ERROR nova Traceback (most recent call last):
Sep 28 12:44:35 ctl02 nova-api[7473]: 2017-09-28 12:44:35.991 7473 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:44:35 ctl02 nova-api[7473]: 2017-09-28 12:44:35.991 7473 ERROR nova     sys.exit(main())
Sep 28 12:44:35 ctl02 nova-api[7473]: 2017-09-28 12:44:35.991 7473 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:44:35 ctl02 nova-api[7473]: 2017-09-28 12:44:35.991 7473 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:44:35 ctl02 nova-api[7473]: 2017-09-28 12:44:35.991 7473 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:44:35 ctl02 nova-api[7473]: 2017-09-28 12:44:35.991 7473 ERROR nova     max_url_len=max_url_len)
Sep 28 12:44:35 ctl02 nova-api[7473]: 2017-09-28 12:44:35.991 7473 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:44:35 ctl02 nova-api[7473]: 2017-09-28 12:44:35.991 7473 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:44:35 ctl02 nova-api[7473]: 2017-09-28 12:44:35.991 7473 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:44:35 ctl02 nova-api[7473]: 2017-09-28 12:44:35.991 7473 ERROR nova     sock.listen(backlog)
Sep 28 12:44:35 ctl02 nova-api[7473]: 2017-09-28 12:44:35.991 7473 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:44:35 ctl02 nova-api[7473]: 2017-09-28 12:44:35.991 7473 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:44:35 ctl02 nova-api[7473]: 2017-09-28 12:44:35.991 7473 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:44:35 ctl02 nova-api[7473]: 2017-09-28 12:44:35.991 7473 ERROR nova
Sep 28 12:44:36 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb0f21f76)
Sep 28 12:44:36 ctl02 heat-api[13008]: 2017-09-28 12:44:36.090 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:44:36] "OPTIONS / HTTP/1.0" 200 134 0.000555
Sep 28 12:44:36 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:44:36.122 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:44:36] "OPTIONS / HTTP/1.0" 200 134 0.000452
Sep 28 12:44:36 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:44:36 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:44:36 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:44:36 ctl02 neutron-server[30536]: 2017-09-28 12:44:36.274 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 4 dead agents out of 6:
Sep 28 12:44:36 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:44:36 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:42:56 cmp002
Sep 28 12:44:36 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:43:28 cmp001
Sep 28 12:44:36 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:43:20 cmp002
Sep 28 12:44:36 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:43:56 cmp002
Sep 28 12:44:36 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:44:36 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:44:36 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:44:36 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:44:37 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb0f21f76)
Sep 28 12:44:37 ctl02 heat-api[13008]: 2017-09-28 12:44:37.864 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:44:37] "OPTIONS / HTTP/1.0" 200 134 0.000615
Sep 28 12:44:38 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb0f21f76)
Sep 28 12:44:38 ctl02 nova-api[7491]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:44:38 ctl02 nova-api[7491]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:44:38 ctl02 heat-api-cfn[13300]: 2017-09-28 12:44:38.226 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:44:38] "OPTIONS / HTTP/1.0" 200 134 0.000503
Sep 28 12:44:38 ctl02 nova-api[7491]: 2017-09-28 12:44:38.292 7491 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:44:38 ctl02 nova-api[7491]: 2017-09-28 12:44:38.293 7491 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:44:38 ctl02 nova-api[7491]: 2017-09-28 12:44:38.293 7491 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:44:38 ctl02 nova-api[7491]: 2017-09-28 12:44:38.293 7491 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:44:38 ctl02 nova-api[7491]: 2017-09-28 12:44:38.293 7491 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:44:38 ctl02 nova-api[7491]: 2017-09-28 12:44:38.293 7491 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:44:38 ctl02 nova-api[7491]: 2017-09-28 12:44:38.293 7491 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:44:38 ctl02 nova-api[7491]: 2017-09-28 12:44:38.293 7491 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:44:38 ctl02 nova-api[7491]: 2017-09-28 12:44:38.293 7491 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:44:38 ctl02 nova-api[7491]: 2017-09-28 12:44:38.293 7491 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:44:38 ctl02 nova-api[7491]: 2017-09-28 12:44:38.293 7491 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:44:38 ctl02 nova-api[7491]: 2017-09-28 12:44:38.293 7491 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:44:38 ctl02 nova-api[7491]: 2017-09-28 12:44:38.293 7491 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:44:38 ctl02 nova-api[7491]: 2017-09-28 12:44:38.293 7491 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:44:38 ctl02 nova-api[7491]: 2017-09-28 12:44:38.293 7491 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:44:38 ctl02 nova-api[7491]: 2017-09-28 12:44:38.293 7491 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:44:38 ctl02 nova-api[7491]: 2017-09-28 12:44:38.293 7491 ERROR nova.wsgi     self.filename))
Sep 28 12:44:38 ctl02 nova-api[7491]: 2017-09-28 12:44:38.293 7491 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:44:38 ctl02 nova-api[7491]: 2017-09-28 12:44:38.293 7491 ERROR nova.wsgi
Sep 28 12:44:38 ctl02 nova-api[7491]: 2017-09-28 12:44:38.296 7491 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:44:38 ctl02 nova-api[7491]: 2017-09-28 12:44:38.429 7491 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:44:38 ctl02 heat-api[13008]: 2017-09-28 12:44:38.527 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:44:38] "OPTIONS / HTTP/1.0" 200 134 0.000665
Sep 28 12:44:38 ctl02 nova-api[7491]: 2017-09-28 12:44:38.685 7491 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:44:38 ctl02 nova-api[7491]: 2017-09-28 12:44:38.687 7491 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:44:38 ctl02 nova-api[7491]: 2017-09-28 12:44:38.687 7491 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:44:38 ctl02 nova-api[7491]: 2017-09-28 12:44:38.688 7491 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:44:38 ctl02 nova-api[7491]: 2017-09-28 12:44:38.825 7491 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:44:38 ctl02 nova-api[7491]: 2017-09-28 12:44:38.827 7491 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:44:38 ctl02 nova-api[7491]: 2017-09-28 12:44:38.827 7491 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:44:38 ctl02 nova-api[7491]: 2017-09-28 12:44:38.827 7491 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:44:38 ctl02 nova-api[7491]: 2017-09-28 12:44:38.831 7491 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:44:38 ctl02 nova-api[7491]: 2017-09-28 12:44:38.831 7491 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:44:38 ctl02 nova-api[7491]: 2017-09-28 12:44:38.831 7491 ERROR nova Traceback (most recent call last):
Sep 28 12:44:38 ctl02 nova-api[7491]: 2017-09-28 12:44:38.831 7491 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:44:38 ctl02 nova-api[7491]: 2017-09-28 12:44:38.831 7491 ERROR nova     sys.exit(main())
Sep 28 12:44:38 ctl02 nova-api[7491]: 2017-09-28 12:44:38.831 7491 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:44:38 ctl02 nova-api[7491]: 2017-09-28 12:44:38.831 7491 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:44:38 ctl02 nova-api[7491]: 2017-09-28 12:44:38.831 7491 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:44:38 ctl02 nova-api[7491]: 2017-09-28 12:44:38.831 7491 ERROR nova     max_url_len=max_url_len)
Sep 28 12:44:38 ctl02 nova-api[7491]: 2017-09-28 12:44:38.831 7491 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:44:38 ctl02 nova-api[7491]: 2017-09-28 12:44:38.831 7491 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:44:38 ctl02 nova-api[7491]: 2017-09-28 12:44:38.831 7491 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:44:38 ctl02 nova-api[7491]: 2017-09-28 12:44:38.831 7491 ERROR nova     sock.listen(backlog)
Sep 28 12:44:38 ctl02 nova-api[7491]: 2017-09-28 12:44:38.831 7491 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:44:38 ctl02 nova-api[7491]: 2017-09-28 12:44:38.831 7491 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:44:38 ctl02 nova-api[7491]: 2017-09-28 12:44:38.831 7491 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:44:38 ctl02 nova-api[7491]: 2017-09-28 12:44:38.831 7491 ERROR nova
Sep 28 12:44:39 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:44:39 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:44:39 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:44:39 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb0f21f76)
Sep 28 12:44:39 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:44:39 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:44:39 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:44:39.137 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:44:39] "OPTIONS / HTTP/1.0" 200 134 0.000449
Sep 28 12:44:39 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:44:39 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:44:39 ctl02 heat-api-cfn[13300]: 2017-09-28 12:44:39.388 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:44:39] "OPTIONS / HTTP/1.0" 200 134 0.000494
Sep 28 12:44:39 ctl02 neutron-server[30536]: 2017-09-28 12:44:39.684 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:44:39] "OPTIONS / HTTP/1.0" 200 262 0.000557
Sep 28 12:44:40 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb0f21f76)
Sep 28 12:44:40 ctl02 glance-api[29183]: 2017-09-28 12:44:40.464 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:44:40] "OPTIONS / HTTP/1.0" 200 134 0.000643
Sep 28 12:44:40 ctl02 neutron-server[30536]: 2017-09-28 12:44:40.576 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:44:40] "OPTIONS / HTTP/1.0" 200 262 0.000491
Sep 28 12:44:40 ctl02 neutron-server[30536]: 2017-09-28 12:44:40.800 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:44:40] "OPTIONS / HTTP/1.0" 200 262 0.000646
Sep 28 12:44:40 ctl02 nova-api[7509]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:44:40 ctl02 nova-api[7509]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:44:41 ctl02 nova-api[7509]: 2017-09-28 12:44:41.018 7509 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:44:41 ctl02 nova-api[7509]: 2017-09-28 12:44:41.020 7509 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:44:41 ctl02 nova-api[7509]: 2017-09-28 12:44:41.020 7509 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:44:41 ctl02 nova-api[7509]: 2017-09-28 12:44:41.020 7509 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:44:41 ctl02 nova-api[7509]: 2017-09-28 12:44:41.020 7509 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:44:41 ctl02 nova-api[7509]: 2017-09-28 12:44:41.020 7509 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:44:41 ctl02 nova-api[7509]: 2017-09-28 12:44:41.020 7509 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:44:41 ctl02 nova-api[7509]: 2017-09-28 12:44:41.020 7509 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:44:41 ctl02 nova-api[7509]: 2017-09-28 12:44:41.020 7509 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:44:41 ctl02 nova-api[7509]: 2017-09-28 12:44:41.020 7509 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:44:41 ctl02 nova-api[7509]: 2017-09-28 12:44:41.020 7509 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:44:41 ctl02 nova-api[7509]: 2017-09-28 12:44:41.020 7509 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:44:41 ctl02 nova-api[7509]: 2017-09-28 12:44:41.020 7509 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:44:41 ctl02 nova-api[7509]: 2017-09-28 12:44:41.020 7509 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:44:41 ctl02 nova-api[7509]: 2017-09-28 12:44:41.020 7509 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:44:41 ctl02 nova-api[7509]: 2017-09-28 12:44:41.020 7509 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:44:41 ctl02 nova-api[7509]: 2017-09-28 12:44:41.020 7509 ERROR nova.wsgi     self.filename))
Sep 28 12:44:41 ctl02 nova-api[7509]: 2017-09-28 12:44:41.020 7509 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:44:41 ctl02 nova-api[7509]: 2017-09-28 12:44:41.020 7509 ERROR nova.wsgi
Sep 28 12:44:41 ctl02 nova-api[7509]: 2017-09-28 12:44:41.022 7509 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:44:41 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb0f21f76)
Sep 28 12:44:41 ctl02 nova-api[7509]: 2017-09-28 12:44:41.149 7509 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:44:41 ctl02 glance-api[29183]: 2017-09-28 12:44:41.291 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:44:41] "OPTIONS / HTTP/1.0" 200 134 0.000563
Sep 28 12:44:41 ctl02 nova-api[7509]: 2017-09-28 12:44:41.372 7509 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:44:41 ctl02 nova-api[7509]: 2017-09-28 12:44:41.375 7509 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:44:41 ctl02 nova-api[7509]: 2017-09-28 12:44:41.375 7509 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:44:41 ctl02 nova-api[7509]: 2017-09-28 12:44:41.376 7509 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:44:41 ctl02 nova-api[7509]: 2017-09-28 12:44:41.505 7509 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:44:41 ctl02 nova-api[7509]: 2017-09-28 12:44:41.508 7509 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:44:41 ctl02 nova-api[7509]: 2017-09-28 12:44:41.508 7509 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:44:41 ctl02 nova-api[7509]: 2017-09-28 12:44:41.508 7509 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:44:41 ctl02 nova-api[7509]: 2017-09-28 12:44:41.512 7509 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:44:41 ctl02 nova-api[7509]: 2017-09-28 12:44:41.512 7509 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:44:41 ctl02 nova-api[7509]: 2017-09-28 12:44:41.512 7509 ERROR nova Traceback (most recent call last):
Sep 28 12:44:41 ctl02 nova-api[7509]: 2017-09-28 12:44:41.512 7509 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:44:41 ctl02 nova-api[7509]: 2017-09-28 12:44:41.512 7509 ERROR nova     sys.exit(main())
Sep 28 12:44:41 ctl02 nova-api[7509]: 2017-09-28 12:44:41.512 7509 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:44:41 ctl02 nova-api[7509]: 2017-09-28 12:44:41.512 7509 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:44:41 ctl02 nova-api[7509]: 2017-09-28 12:44:41.512 7509 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:44:41 ctl02 nova-api[7509]: 2017-09-28 12:44:41.512 7509 ERROR nova     max_url_len=max_url_len)
Sep 28 12:44:41 ctl02 nova-api[7509]: 2017-09-28 12:44:41.512 7509 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:44:41 ctl02 nova-api[7509]: 2017-09-28 12:44:41.512 7509 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:44:41 ctl02 nova-api[7509]: 2017-09-28 12:44:41.512 7509 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:44:41 ctl02 nova-api[7509]: 2017-09-28 12:44:41.512 7509 ERROR nova     sock.listen(backlog)
Sep 28 12:44:41 ctl02 nova-api[7509]: 2017-09-28 12:44:41.512 7509 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:44:41 ctl02 nova-api[7509]: 2017-09-28 12:44:41.512 7509 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:44:41 ctl02 nova-api[7509]: 2017-09-28 12:44:41.512 7509 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:44:41 ctl02 nova-api[7509]: 2017-09-28 12:44:41.512 7509 ERROR nova
Sep 28 12:44:41 ctl02 glance-api[29183]: 2017-09-28 12:44:41.605 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:44:41] "OPTIONS / HTTP/1.0" 200 134 0.000544
Sep 28 12:44:41 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:44:41 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:44:41 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:44:41 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:44:41 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:44:41 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:44:41 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:44:42 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb0f21f76)
Sep 28 12:44:42 ctl02 heat-api-cfn[13300]: 2017-09-28 12:44:42.268 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:44:42] "OPTIONS / HTTP/1.0" 200 134 0.000442
Sep 28 12:44:43 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb0f21f76)
Sep 28 12:44:43 ctl02 neutron-server[30536]: 2017-09-28 12:44:43.489 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:44:43 ctl02 nova-api[7527]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:44:43 ctl02 nova-api[7527]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:44:43 ctl02 nova-api[7527]: 2017-09-28 12:44:43.732 7527 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:44:43 ctl02 nova-api[7527]: 2017-09-28 12:44:43.733 7527 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:44:43 ctl02 nova-api[7527]: 2017-09-28 12:44:43.733 7527 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:44:43 ctl02 nova-api[7527]: 2017-09-28 12:44:43.733 7527 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:44:43 ctl02 nova-api[7527]: 2017-09-28 12:44:43.733 7527 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:44:43 ctl02 nova-api[7527]: 2017-09-28 12:44:43.733 7527 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:44:43 ctl02 nova-api[7527]: 2017-09-28 12:44:43.733 7527 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:44:43 ctl02 nova-api[7527]: 2017-09-28 12:44:43.733 7527 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:44:43 ctl02 nova-api[7527]: 2017-09-28 12:44:43.733 7527 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:44:43 ctl02 nova-api[7527]: 2017-09-28 12:44:43.733 7527 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:44:43 ctl02 nova-api[7527]: 2017-09-28 12:44:43.733 7527 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:44:43 ctl02 nova-api[7527]: 2017-09-28 12:44:43.733 7527 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:44:43 ctl02 nova-api[7527]: 2017-09-28 12:44:43.733 7527 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:44:43 ctl02 nova-api[7527]: 2017-09-28 12:44:43.733 7527 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:44:43 ctl02 nova-api[7527]: 2017-09-28 12:44:43.733 7527 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:44:43 ctl02 nova-api[7527]: 2017-09-28 12:44:43.733 7527 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:44:43 ctl02 nova-api[7527]: 2017-09-28 12:44:43.733 7527 ERROR nova.wsgi     self.filename))
Sep 28 12:44:43 ctl02 nova-api[7527]: 2017-09-28 12:44:43.733 7527 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:44:43 ctl02 nova-api[7527]: 2017-09-28 12:44:43.733 7527 ERROR nova.wsgi
Sep 28 12:44:43 ctl02 nova-api[7527]: 2017-09-28 12:44:43.735 7527 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:44:43 ctl02 nova-api[7527]: 2017-09-28 12:44:43.866 7527 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:44:44 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb0f21f76)
Sep 28 12:44:44 ctl02 nova-api[7527]: 2017-09-28 12:44:44.094 7527 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:44:44 ctl02 nova-api[7527]: 2017-09-28 12:44:44.097 7527 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:44:44 ctl02 nova-api[7527]: 2017-09-28 12:44:44.097 7527 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:44:44 ctl02 nova-api[7527]: 2017-09-28 12:44:44.097 7527 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:44:44 ctl02 nova-api[7527]: 2017-09-28 12:44:44.233 7527 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:44:44 ctl02 nova-api[7527]: 2017-09-28 12:44:44.234 7527 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:44:44 ctl02 nova-api[7527]: 2017-09-28 12:44:44.235 7527 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:44:44 ctl02 nova-api[7527]: 2017-09-28 12:44:44.235 7527 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:44:44 ctl02 nova-api[7527]: 2017-09-28 12:44:44.238 7527 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:44:44 ctl02 nova-api[7527]: 2017-09-28 12:44:44.239 7527 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:44:44 ctl02 nova-api[7527]: 2017-09-28 12:44:44.239 7527 ERROR nova Traceback (most recent call last):
Sep 28 12:44:44 ctl02 nova-api[7527]: 2017-09-28 12:44:44.239 7527 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:44:44 ctl02 nova-api[7527]: 2017-09-28 12:44:44.239 7527 ERROR nova     sys.exit(main())
Sep 28 12:44:44 ctl02 nova-api[7527]: 2017-09-28 12:44:44.239 7527 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:44:44 ctl02 nova-api[7527]: 2017-09-28 12:44:44.239 7527 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:44:44 ctl02 nova-api[7527]: 2017-09-28 12:44:44.239 7527 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:44:44 ctl02 nova-api[7527]: 2017-09-28 12:44:44.239 7527 ERROR nova     max_url_len=max_url_len)
Sep 28 12:44:44 ctl02 nova-api[7527]: 2017-09-28 12:44:44.239 7527 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:44:44 ctl02 nova-api[7527]: 2017-09-28 12:44:44.239 7527 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:44:44 ctl02 nova-api[7527]: 2017-09-28 12:44:44.239 7527 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:44:44 ctl02 nova-api[7527]: 2017-09-28 12:44:44.239 7527 ERROR nova     sock.listen(backlog)
Sep 28 12:44:44 ctl02 nova-api[7527]: 2017-09-28 12:44:44.239 7527 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:44:44 ctl02 nova-api[7527]: 2017-09-28 12:44:44.239 7527 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:44:44 ctl02 nova-api[7527]: 2017-09-28 12:44:44.239 7527 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:44:44 ctl02 nova-api[7527]: 2017-09-28 12:44:44.239 7527 ERROR nova
Sep 28 12:44:44 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:44:44.303 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:44:44] "OPTIONS / HTTP/1.0" 200 134 0.000358
Sep 28 12:44:44 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:44:44 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:44:44 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:44:44 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:44:44 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:44:44 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:44:44 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:44:45 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb0f21f76)
Sep 28 12:44:46 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:44:46 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:44:46 ctl02 heat-api[13008]: 2017-09-28 12:44:46.060 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:44:46] "OPTIONS / HTTP/1.0" 200 134 0.000558
Sep 28 12:44:46 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:44:46.105 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:44:46] "OPTIONS / HTTP/1.0" 200 134 0.000440
Sep 28 12:44:46 ctl02 nova-api[7545]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:44:46 ctl02 nova-api[7545]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:44:46 ctl02 nova-api[7545]: 2017-09-28 12:44:46.504 7545 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:44:46 ctl02 nova-api[7545]: 2017-09-28 12:44:46.506 7545 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:44:46 ctl02 nova-api[7545]: 2017-09-28 12:44:46.506 7545 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:44:46 ctl02 nova-api[7545]: 2017-09-28 12:44:46.506 7545 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:44:46 ctl02 nova-api[7545]: 2017-09-28 12:44:46.506 7545 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:44:46 ctl02 nova-api[7545]: 2017-09-28 12:44:46.506 7545 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:44:46 ctl02 nova-api[7545]: 2017-09-28 12:44:46.506 7545 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:44:46 ctl02 nova-api[7545]: 2017-09-28 12:44:46.506 7545 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:44:46 ctl02 nova-api[7545]: 2017-09-28 12:44:46.506 7545 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:44:46 ctl02 nova-api[7545]: 2017-09-28 12:44:46.506 7545 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:44:46 ctl02 nova-api[7545]: 2017-09-28 12:44:46.506 7545 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:44:46 ctl02 nova-api[7545]: 2017-09-28 12:44:46.506 7545 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:44:46 ctl02 nova-api[7545]: 2017-09-28 12:44:46.506 7545 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:44:46 ctl02 nova-api[7545]: 2017-09-28 12:44:46.506 7545 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:44:46 ctl02 nova-api[7545]: 2017-09-28 12:44:46.506 7545 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:44:46 ctl02 nova-api[7545]: 2017-09-28 12:44:46.506 7545 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:44:46 ctl02 nova-api[7545]: 2017-09-28 12:44:46.506 7545 ERROR nova.wsgi     self.filename))
Sep 28 12:44:46 ctl02 nova-api[7545]: 2017-09-28 12:44:46.506 7545 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:44:46 ctl02 nova-api[7545]: 2017-09-28 12:44:46.506 7545 ERROR nova.wsgi
Sep 28 12:44:46 ctl02 nova-api[7545]: 2017-09-28 12:44:46.507 7545 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:44:46 ctl02 nova-api[7545]: 2017-09-28 12:44:46.639 7545 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:44:46 ctl02 nova-api[7545]: 2017-09-28 12:44:46.884 7545 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:44:46 ctl02 nova-api[7545]: 2017-09-28 12:44:46.886 7545 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:44:46 ctl02 nova-api[7545]: 2017-09-28 12:44:46.886 7545 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:44:46 ctl02 nova-api[7545]: 2017-09-28 12:44:46.887 7545 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:44:47 ctl02 nova-api[7545]: 2017-09-28 12:44:47.021 7545 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:44:47 ctl02 nova-api[7545]: 2017-09-28 12:44:47.023 7545 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:44:47 ctl02 nova-api[7545]: 2017-09-28 12:44:47.023 7545 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:44:47 ctl02 nova-api[7545]: 2017-09-28 12:44:47.024 7545 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:44:47 ctl02 nova-api[7545]: 2017-09-28 12:44:47.027 7545 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:44:47 ctl02 nova-api[7545]: 2017-09-28 12:44:47.027 7545 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:44:47 ctl02 nova-api[7545]: 2017-09-28 12:44:47.027 7545 ERROR nova Traceback (most recent call last):
Sep 28 12:44:47 ctl02 nova-api[7545]: 2017-09-28 12:44:47.027 7545 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:44:47 ctl02 nova-api[7545]: 2017-09-28 12:44:47.027 7545 ERROR nova     sys.exit(main())
Sep 28 12:44:47 ctl02 nova-api[7545]: 2017-09-28 12:44:47.027 7545 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:44:47 ctl02 nova-api[7545]: 2017-09-28 12:44:47.027 7545 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:44:47 ctl02 nova-api[7545]: 2017-09-28 12:44:47.027 7545 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:44:47 ctl02 nova-api[7545]: 2017-09-28 12:44:47.027 7545 ERROR nova     max_url_len=max_url_len)
Sep 28 12:44:47 ctl02 nova-api[7545]: 2017-09-28 12:44:47.027 7545 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:44:47 ctl02 nova-api[7545]: 2017-09-28 12:44:47.027 7545 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:44:47 ctl02 nova-api[7545]: 2017-09-28 12:44:47.027 7545 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:44:47 ctl02 nova-api[7545]: 2017-09-28 12:44:47.027 7545 ERROR nova     sock.listen(backlog)
Sep 28 12:44:47 ctl02 nova-api[7545]: 2017-09-28 12:44:47.027 7545 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:44:47 ctl02 nova-api[7545]: 2017-09-28 12:44:47.027 7545 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:44:47 ctl02 nova-api[7545]: 2017-09-28 12:44:47.027 7545 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:44:47 ctl02 nova-api[7545]: 2017-09-28 12:44:47.027 7545 ERROR nova
Sep 28 12:44:47 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:44:47 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:44:47 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:44:47 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:44:47 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:44:47 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:44:47 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:44:47 ctl02 heat-api[13008]: 2017-09-28 12:44:47.499 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:44:47] "OPTIONS / HTTP/1.0" 200 134 0.000573
Sep 28 12:44:47 ctl02 heat-api-cfn[13300]: 2017-09-28 12:44:47.864 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:44:47] "OPTIONS / HTTP/1.0" 200 134 0.000486
Sep 28 12:44:48 ctl02 heat-api[13008]: 2017-09-28 12:44:48.173 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:44:48] "OPTIONS / HTTP/1.0" 200 134 0.000630
Sep 28 12:44:49 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:44:49.029 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:44:49] "OPTIONS / HTTP/1.0" 200 134 0.000387
Sep 28 12:44:49 ctl02 nova-api[7569]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:44:49 ctl02 nova-api[7569]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:44:49 ctl02 heat-api-cfn[13300]: 2017-09-28 12:44:49.110 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:44:49] "OPTIONS / HTTP/1.0" 200 134 0.000457
Sep 28 12:44:49 ctl02 nova-api[7569]: 2017-09-28 12:44:49.272 7569 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:44:49 ctl02 nova-api[7569]: 2017-09-28 12:44:49.274 7569 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:44:49 ctl02 nova-api[7569]: 2017-09-28 12:44:49.274 7569 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:44:49 ctl02 nova-api[7569]: 2017-09-28 12:44:49.274 7569 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:44:49 ctl02 nova-api[7569]: 2017-09-28 12:44:49.274 7569 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:44:49 ctl02 nova-api[7569]: 2017-09-28 12:44:49.274 7569 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:44:49 ctl02 nova-api[7569]: 2017-09-28 12:44:49.274 7569 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:44:49 ctl02 nova-api[7569]: 2017-09-28 12:44:49.274 7569 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:44:49 ctl02 nova-api[7569]: 2017-09-28 12:44:49.274 7569 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:44:49 ctl02 nova-api[7569]: 2017-09-28 12:44:49.274 7569 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:44:49 ctl02 nova-api[7569]: 2017-09-28 12:44:49.274 7569 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:44:49 ctl02 nova-api[7569]: 2017-09-28 12:44:49.274 7569 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:44:49 ctl02 nova-api[7569]: 2017-09-28 12:44:49.274 7569 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:44:49 ctl02 nova-api[7569]: 2017-09-28 12:44:49.274 7569 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:44:49 ctl02 nova-api[7569]: 2017-09-28 12:44:49.274 7569 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:44:49 ctl02 nova-api[7569]: 2017-09-28 12:44:49.274 7569 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:44:49 ctl02 nova-api[7569]: 2017-09-28 12:44:49.274 7569 ERROR nova.wsgi     self.filename))
Sep 28 12:44:49 ctl02 nova-api[7569]: 2017-09-28 12:44:49.274 7569 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:44:49 ctl02 nova-api[7569]: 2017-09-28 12:44:49.274 7569 ERROR nova.wsgi
Sep 28 12:44:49 ctl02 nova-api[7569]: 2017-09-28 12:44:49.275 7569 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:44:49 ctl02 neutron-server[30536]: 2017-09-28 12:44:49.330 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:44:49] "OPTIONS / HTTP/1.0" 200 262 0.000470
Sep 28 12:44:49 ctl02 nova-api[7569]: 2017-09-28 12:44:49.410 7569 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:44:49 ctl02 nova-api[7569]: 2017-09-28 12:44:49.629 7569 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:44:49 ctl02 nova-api[7569]: 2017-09-28 12:44:49.631 7569 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:44:49 ctl02 nova-api[7569]: 2017-09-28 12:44:49.632 7569 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:44:49 ctl02 nova-api[7569]: 2017-09-28 12:44:49.632 7569 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:44:49 ctl02 nova-api[7569]: 2017-09-28 12:44:49.764 7569 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:44:49 ctl02 nova-api[7569]: 2017-09-28 12:44:49.766 7569 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:44:49 ctl02 nova-api[7569]: 2017-09-28 12:44:49.766 7569 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:44:49 ctl02 nova-api[7569]: 2017-09-28 12:44:49.766 7569 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:44:49 ctl02 nova-api[7569]: 2017-09-28 12:44:49.769 7569 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:44:49 ctl02 nova-api[7569]: 2017-09-28 12:44:49.770 7569 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:44:49 ctl02 nova-api[7569]: 2017-09-28 12:44:49.770 7569 ERROR nova Traceback (most recent call last):
Sep 28 12:44:49 ctl02 nova-api[7569]: 2017-09-28 12:44:49.770 7569 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:44:49 ctl02 nova-api[7569]: 2017-09-28 12:44:49.770 7569 ERROR nova     sys.exit(main())
Sep 28 12:44:49 ctl02 nova-api[7569]: 2017-09-28 12:44:49.770 7569 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:44:49 ctl02 nova-api[7569]: 2017-09-28 12:44:49.770 7569 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:44:49 ctl02 nova-api[7569]: 2017-09-28 12:44:49.770 7569 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:44:49 ctl02 nova-api[7569]: 2017-09-28 12:44:49.770 7569 ERROR nova     max_url_len=max_url_len)
Sep 28 12:44:49 ctl02 nova-api[7569]: 2017-09-28 12:44:49.770 7569 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:44:49 ctl02 nova-api[7569]: 2017-09-28 12:44:49.770 7569 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:44:49 ctl02 nova-api[7569]: 2017-09-28 12:44:49.770 7569 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:44:49 ctl02 nova-api[7569]: 2017-09-28 12:44:49.770 7569 ERROR nova     sock.listen(backlog)
Sep 28 12:44:49 ctl02 nova-api[7569]: 2017-09-28 12:44:49.770 7569 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:44:49 ctl02 nova-api[7569]: 2017-09-28 12:44:49.770 7569 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:44:49 ctl02 nova-api[7569]: 2017-09-28 12:44:49.770 7569 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:44:49 ctl02 nova-api[7569]: 2017-09-28 12:44:49.770 7569 ERROR nova
Sep 28 12:44:49 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:44:49 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:44:49 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:44:50 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:44:50 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:44:50 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:44:50 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:44:50 ctl02 glance-api[29183]: 2017-09-28 12:44:50.214 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:44:50] "OPTIONS / HTTP/1.0" 200 134 0.000533
Sep 28 12:44:50 ctl02 neutron-server[30536]: 2017-09-28 12:44:50.268 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:44:50] "OPTIONS / HTTP/1.0" 200 262 0.000426
Sep 28 12:44:50 ctl02 neutron-server[30536]: 2017-09-28 12:44:50.458 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:44:50] "OPTIONS / HTTP/1.0" 200 262 0.000477
Sep 28 12:44:51 ctl02 neutron-server[30536]: 2017-09-28 12:44:51.270 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 4 dead agents out of 6:
Sep 28 12:44:51 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:44:51 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:42:56 cmp002
Sep 28 12:44:51 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:43:28 cmp001
Sep 28 12:44:51 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:43:20 cmp002
Sep 28 12:44:51 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:43:56 cmp002
Sep 28 12:44:51 ctl02 glance-api[29183]: 2017-09-28 12:44:51.495 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:44:51] "OPTIONS / HTTP/1.0" 200 134 0.000549
Sep 28 12:44:51 ctl02 glance-api[29183]: 2017-09-28 12:44:51.503 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:44:51] "OPTIONS / HTTP/1.0" 200 134 0.000382
Sep 28 12:44:51 ctl02 nova-api[7587]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:44:51 ctl02 nova-api[7587]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:44:51 ctl02 nova-api[7587]: 2017-09-28 12:44:51.954 7587 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:44:51 ctl02 nova-api[7587]: 2017-09-28 12:44:51.956 7587 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:44:51 ctl02 nova-api[7587]: 2017-09-28 12:44:51.956 7587 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:44:51 ctl02 nova-api[7587]: 2017-09-28 12:44:51.956 7587 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:44:51 ctl02 nova-api[7587]: 2017-09-28 12:44:51.956 7587 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:44:51 ctl02 nova-api[7587]: 2017-09-28 12:44:51.956 7587 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:44:51 ctl02 nova-api[7587]: 2017-09-28 12:44:51.956 7587 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:44:51 ctl02 nova-api[7587]: 2017-09-28 12:44:51.956 7587 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:44:51 ctl02 nova-api[7587]: 2017-09-28 12:44:51.956 7587 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:44:51 ctl02 nova-api[7587]: 2017-09-28 12:44:51.956 7587 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:44:51 ctl02 nova-api[7587]: 2017-09-28 12:44:51.956 7587 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:44:51 ctl02 nova-api[7587]: 2017-09-28 12:44:51.956 7587 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:44:51 ctl02 nova-api[7587]: 2017-09-28 12:44:51.956 7587 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:44:51 ctl02 nova-api[7587]: 2017-09-28 12:44:51.956 7587 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:44:51 ctl02 nova-api[7587]: 2017-09-28 12:44:51.956 7587 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:44:51 ctl02 nova-api[7587]: 2017-09-28 12:44:51.956 7587 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:44:51 ctl02 nova-api[7587]: 2017-09-28 12:44:51.956 7587 ERROR nova.wsgi     self.filename))
Sep 28 12:44:51 ctl02 nova-api[7587]: 2017-09-28 12:44:51.956 7587 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:44:51 ctl02 nova-api[7587]: 2017-09-28 12:44:51.956 7587 ERROR nova.wsgi
Sep 28 12:44:51 ctl02 nova-api[7587]: 2017-09-28 12:44:51.957 7587 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:44:52 ctl02 nova-api[7587]: 2017-09-28 12:44:52.083 7587 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:44:52 ctl02 heat-api-cfn[13300]: 2017-09-28 12:44:52.110 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:44:52] "OPTIONS / HTTP/1.0" 200 134 0.000538
Sep 28 12:44:52 ctl02 nova-api[7587]: 2017-09-28 12:44:52.303 7587 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:44:52 ctl02 nova-api[7587]: 2017-09-28 12:44:52.305 7587 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:44:52 ctl02 nova-api[7587]: 2017-09-28 12:44:52.305 7587 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:44:52 ctl02 nova-api[7587]: 2017-09-28 12:44:52.306 7587 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:44:52 ctl02 nova-api[7587]: 2017-09-28 12:44:52.436 7587 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:44:52 ctl02 nova-api[7587]: 2017-09-28 12:44:52.439 7587 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:44:52 ctl02 nova-api[7587]: 2017-09-28 12:44:52.439 7587 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:44:52 ctl02 nova-api[7587]: 2017-09-28 12:44:52.439 7587 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:44:52 ctl02 nova-api[7587]: 2017-09-28 12:44:52.443 7587 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:44:52 ctl02 nova-api[7587]: 2017-09-28 12:44:52.443 7587 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:44:52 ctl02 nova-api[7587]: 2017-09-28 12:44:52.443 7587 ERROR nova Traceback (most recent call last):
Sep 28 12:44:52 ctl02 nova-api[7587]: 2017-09-28 12:44:52.443 7587 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:44:52 ctl02 nova-api[7587]: 2017-09-28 12:44:52.443 7587 ERROR nova     sys.exit(main())
Sep 28 12:44:52 ctl02 nova-api[7587]: 2017-09-28 12:44:52.443 7587 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:44:52 ctl02 nova-api[7587]: 2017-09-28 12:44:52.443 7587 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:44:52 ctl02 nova-api[7587]: 2017-09-28 12:44:52.443 7587 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:44:52 ctl02 nova-api[7587]: 2017-09-28 12:44:52.443 7587 ERROR nova     max_url_len=max_url_len)
Sep 28 12:44:52 ctl02 nova-api[7587]: 2017-09-28 12:44:52.443 7587 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:44:52 ctl02 nova-api[7587]: 2017-09-28 12:44:52.443 7587 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:44:52 ctl02 nova-api[7587]: 2017-09-28 12:44:52.443 7587 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:44:52 ctl02 nova-api[7587]: 2017-09-28 12:44:52.443 7587 ERROR nova     sock.listen(backlog)
Sep 28 12:44:52 ctl02 nova-api[7587]: 2017-09-28 12:44:52.443 7587 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:44:52 ctl02 nova-api[7587]: 2017-09-28 12:44:52.443 7587 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:44:52 ctl02 nova-api[7587]: 2017-09-28 12:44:52.443 7587 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:44:52 ctl02 nova-api[7587]: 2017-09-28 12:44:52.443 7587 ERROR nova
Sep 28 12:44:52 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:44:52 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:44:52 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:44:52 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:44:52 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:44:52 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:44:52 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:44:54 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:44:54.516 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:44:54] "OPTIONS / HTTP/1.0" 200 134 0.000456
Sep 28 12:44:54 ctl02 nova-api[7605]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:44:54 ctl02 nova-api[7605]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:44:54 ctl02 nova-cert[4860]: 2017-09-28 12:44:54.764 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:44:54 ctl02 nova-api[7605]: 2017-09-28 12:44:54.789 7605 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:44:54 ctl02 nova-api[7605]: 2017-09-28 12:44:54.790 7605 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:44:54 ctl02 nova-api[7605]: 2017-09-28 12:44:54.790 7605 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:44:54 ctl02 nova-api[7605]: 2017-09-28 12:44:54.790 7605 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:44:54 ctl02 nova-api[7605]: 2017-09-28 12:44:54.790 7605 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:44:54 ctl02 nova-api[7605]: 2017-09-28 12:44:54.790 7605 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:44:54 ctl02 nova-api[7605]: 2017-09-28 12:44:54.790 7605 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:44:54 ctl02 nova-api[7605]: 2017-09-28 12:44:54.790 7605 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:44:54 ctl02 nova-api[7605]: 2017-09-28 12:44:54.790 7605 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:44:54 ctl02 nova-api[7605]: 2017-09-28 12:44:54.790 7605 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:44:54 ctl02 nova-api[7605]: 2017-09-28 12:44:54.790 7605 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:44:54 ctl02 nova-api[7605]: 2017-09-28 12:44:54.790 7605 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:44:54 ctl02 nova-api[7605]: 2017-09-28 12:44:54.790 7605 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:44:54 ctl02 nova-api[7605]: 2017-09-28 12:44:54.790 7605 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:44:54 ctl02 nova-api[7605]: 2017-09-28 12:44:54.790 7605 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:44:54 ctl02 nova-api[7605]: 2017-09-28 12:44:54.790 7605 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:44:54 ctl02 nova-api[7605]: 2017-09-28 12:44:54.790 7605 ERROR nova.wsgi     self.filename))
Sep 28 12:44:54 ctl02 nova-api[7605]: 2017-09-28 12:44:54.790 7605 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:44:54 ctl02 nova-api[7605]: 2017-09-28 12:44:54.790 7605 ERROR nova.wsgi
Sep 28 12:44:54 ctl02 nova-api[7605]: 2017-09-28 12:44:54.793 7605 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:44:54 ctl02 nova-api[7605]: 2017-09-28 12:44:54.942 7605 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:44:54 ctl02 nova-conductor[5056]: 2017-09-28 12:44:54.974 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:44:54 ctl02 nova-conductor[5056]: 2017-09-28 12:44:54.995 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:44:55 ctl02 nova-conductor[5056]: 2017-09-28 12:44:55.017 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:44:55 ctl02 nova-conductor[5056]: 2017-09-28 12:44:55.023 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:44:55 ctl02 nova-api[7605]: 2017-09-28 12:44:55.180 7605 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:44:55 ctl02 nova-api[7605]: 2017-09-28 12:44:55.183 7605 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:44:55 ctl02 nova-api[7605]: 2017-09-28 12:44:55.183 7605 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:44:55 ctl02 nova-api[7605]: 2017-09-28 12:44:55.183 7605 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:44:55 ctl02 nova-api[7605]: 2017-09-28 12:44:55.315 7605 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:44:55 ctl02 nova-api[7605]: 2017-09-28 12:44:55.317 7605 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:44:55 ctl02 nova-api[7605]: 2017-09-28 12:44:55.317 7605 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:44:55 ctl02 nova-api[7605]: 2017-09-28 12:44:55.318 7605 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:44:55 ctl02 nova-api[7605]: 2017-09-28 12:44:55.321 7605 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:44:55 ctl02 nova-api[7605]: 2017-09-28 12:44:55.321 7605 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:44:55 ctl02 nova-api[7605]: 2017-09-28 12:44:55.321 7605 ERROR nova Traceback (most recent call last):
Sep 28 12:44:55 ctl02 nova-api[7605]: 2017-09-28 12:44:55.321 7605 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:44:55 ctl02 nova-api[7605]: 2017-09-28 12:44:55.321 7605 ERROR nova     sys.exit(main())
Sep 28 12:44:55 ctl02 nova-api[7605]: 2017-09-28 12:44:55.321 7605 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:44:55 ctl02 nova-api[7605]: 2017-09-28 12:44:55.321 7605 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:44:55 ctl02 nova-api[7605]: 2017-09-28 12:44:55.321 7605 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:44:55 ctl02 nova-api[7605]: 2017-09-28 12:44:55.321 7605 ERROR nova     max_url_len=max_url_len)
Sep 28 12:44:55 ctl02 nova-api[7605]: 2017-09-28 12:44:55.321 7605 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:44:55 ctl02 nova-api[7605]: 2017-09-28 12:44:55.321 7605 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:44:55 ctl02 nova-api[7605]: 2017-09-28 12:44:55.321 7605 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:44:55 ctl02 nova-api[7605]: 2017-09-28 12:44:55.321 7605 ERROR nova     sock.listen(backlog)
Sep 28 12:44:55 ctl02 nova-api[7605]: 2017-09-28 12:44:55.321 7605 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:44:55 ctl02 nova-api[7605]: 2017-09-28 12:44:55.321 7605 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:44:55 ctl02 nova-api[7605]: 2017-09-28 12:44:55.321 7605 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:44:55 ctl02 nova-api[7605]: 2017-09-28 12:44:55.321 7605 ERROR nova
Sep 28 12:44:55 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:44:55 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:44:55 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:44:55 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:44:55 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:44:55 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:44:55 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:44:55 ctl02 heat-api[13008]: 2017-09-28 12:44:55.701 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:44:55] "OPTIONS / HTTP/1.0" 200 134 0.000614
Sep 28 12:44:56 ctl02 neutron-server[30536]: 2017-09-28 12:44:56.097 30601 WARNING oslo_messaging._drivers.amqpdriver [req-a841cd80-a216-4a5f-9a9b-6c6e3009f73f - - - - -] reply_a13a20a54b91453780e36bdf20a855d2 doesn't exists, drop reply to 26ccadda79ae4f9ba6a39deaf6f5b45b
Sep 28 12:44:56 ctl02 neutron-server[30536]: 2017-09-28 12:44:56.098 30601 INFO oslo_messaging._drivers.amqpdriver [req-a841cd80-a216-4a5f-9a9b-6c6e3009f73f - - - - -] The reply 26ccadda79ae4f9ba6a39deaf6f5b45b cannot be sent  reply_a13a20a54b91453780e36bdf20a855d2 reply queue don't exist after 60 sec abandoning...
Sep 28 12:44:56 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:44:56.481 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:44:56] "OPTIONS / HTTP/1.0" 200 134 0.000458
Sep 28 12:44:57 ctl02 nova-api[7623]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:44:57 ctl02 nova-api[7623]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:44:57 ctl02 heat-api[13008]: 2017-09-28 12:44:57.506 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:44:57] "OPTIONS / HTTP/1.0" 200 134 0.000623
Sep 28 12:44:57 ctl02 heat-api-cfn[13300]: 2017-09-28 12:44:57.530 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:44:57] "OPTIONS / HTTP/1.0" 200 134 0.000779
Sep 28 12:44:57 ctl02 nova-api[7623]: 2017-09-28 12:44:57.569 7623 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:44:57 ctl02 nova-api[7623]: 2017-09-28 12:44:57.571 7623 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:44:57 ctl02 nova-api[7623]: 2017-09-28 12:44:57.571 7623 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:44:57 ctl02 nova-api[7623]: 2017-09-28 12:44:57.571 7623 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:44:57 ctl02 nova-api[7623]: 2017-09-28 12:44:57.571 7623 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:44:57 ctl02 nova-api[7623]: 2017-09-28 12:44:57.571 7623 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:44:57 ctl02 nova-api[7623]: 2017-09-28 12:44:57.571 7623 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:44:57 ctl02 nova-api[7623]: 2017-09-28 12:44:57.571 7623 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:44:57 ctl02 nova-api[7623]: 2017-09-28 12:44:57.571 7623 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:44:57 ctl02 nova-api[7623]: 2017-09-28 12:44:57.571 7623 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:44:57 ctl02 nova-api[7623]: 2017-09-28 12:44:57.571 7623 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:44:57 ctl02 nova-api[7623]: 2017-09-28 12:44:57.571 7623 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:44:57 ctl02 nova-api[7623]: 2017-09-28 12:44:57.571 7623 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:44:57 ctl02 nova-api[7623]: 2017-09-28 12:44:57.571 7623 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:44:57 ctl02 nova-api[7623]: 2017-09-28 12:44:57.571 7623 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:44:57 ctl02 nova-api[7623]: 2017-09-28 12:44:57.571 7623 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:44:57 ctl02 nova-api[7623]: 2017-09-28 12:44:57.571 7623 ERROR nova.wsgi     self.filename))
Sep 28 12:44:57 ctl02 nova-api[7623]: 2017-09-28 12:44:57.571 7623 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:44:57 ctl02 nova-api[7623]: 2017-09-28 12:44:57.571 7623 ERROR nova.wsgi
Sep 28 12:44:57 ctl02 nova-api[7623]: 2017-09-28 12:44:57.572 7623 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:44:57 ctl02 nova-api[7623]: 2017-09-28 12:44:57.709 7623 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:44:57 ctl02 heat-api[13008]: 2017-09-28 12:44:57.892 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:44:57] "OPTIONS / HTTP/1.0" 200 134 0.000632
Sep 28 12:44:57 ctl02 nova-api[7623]: 2017-09-28 12:44:57.959 7623 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:44:57 ctl02 nova-api[7623]: 2017-09-28 12:44:57.962 7623 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:44:57 ctl02 nova-api[7623]: 2017-09-28 12:44:57.962 7623 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:44:57 ctl02 nova-api[7623]: 2017-09-28 12:44:57.962 7623 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:44:58 ctl02 nova-api[7623]: 2017-09-28 12:44:58.099 7623 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:44:58 ctl02 nova-api[7623]: 2017-09-28 12:44:58.101 7623 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:44:58 ctl02 nova-api[7623]: 2017-09-28 12:44:58.101 7623 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:44:58 ctl02 nova-api[7623]: 2017-09-28 12:44:58.101 7623 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:44:58 ctl02 nova-api[7623]: 2017-09-28 12:44:58.105 7623 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:44:58 ctl02 nova-api[7623]: 2017-09-28 12:44:58.105 7623 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:44:58 ctl02 nova-api[7623]: 2017-09-28 12:44:58.105 7623 ERROR nova Traceback (most recent call last):
Sep 28 12:44:58 ctl02 nova-api[7623]: 2017-09-28 12:44:58.105 7623 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:44:58 ctl02 nova-api[7623]: 2017-09-28 12:44:58.105 7623 ERROR nova     sys.exit(main())
Sep 28 12:44:58 ctl02 nova-api[7623]: 2017-09-28 12:44:58.105 7623 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:44:58 ctl02 nova-api[7623]: 2017-09-28 12:44:58.105 7623 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:44:58 ctl02 nova-api[7623]: 2017-09-28 12:44:58.105 7623 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:44:58 ctl02 nova-api[7623]: 2017-09-28 12:44:58.105 7623 ERROR nova     max_url_len=max_url_len)
Sep 28 12:44:58 ctl02 nova-api[7623]: 2017-09-28 12:44:58.105 7623 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:44:58 ctl02 nova-api[7623]: 2017-09-28 12:44:58.105 7623 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:44:58 ctl02 nova-api[7623]: 2017-09-28 12:44:58.105 7623 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:44:58 ctl02 nova-api[7623]: 2017-09-28 12:44:58.105 7623 ERROR nova     sock.listen(backlog)
Sep 28 12:44:58 ctl02 nova-api[7623]: 2017-09-28 12:44:58.105 7623 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:44:58 ctl02 nova-api[7623]: 2017-09-28 12:44:58.105 7623 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:44:58 ctl02 nova-api[7623]: 2017-09-28 12:44:58.105 7623 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:44:58 ctl02 nova-api[7623]: 2017-09-28 12:44:58.105 7623 ERROR nova
Sep 28 12:44:58 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:44:58 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:44:58 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:44:58 ctl02 neutron-server[30536]: 2017-09-28 12:44:58.496 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:44:58 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:44:58 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:44:58 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:44:58 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:44:58 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:44:58.656 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:44:58] "OPTIONS / HTTP/1.0" 200 134 0.000532
Sep 28 12:44:58 ctl02 heat-api-cfn[13300]: 2017-09-28 12:44:58.830 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:44:58] "OPTIONS / HTTP/1.0" 200 134 0.000506
Sep 28 12:44:59 ctl02 neutron-server[30536]: 2017-09-28 12:44:59.060 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:44:59] "OPTIONS / HTTP/1.0" 200 262 0.000546
Sep 28 12:45:00 ctl02 nova-api[7641]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:45:00 ctl02 nova-api[7641]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:45:00 ctl02 neutron-server[30536]: 2017-09-28 12:45:00.408 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:45:00] "OPTIONS / HTTP/1.0" 200 262 0.000518
Sep 28 12:45:00 ctl02 glance-api[29183]: 2017-09-28 12:45:00.422 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:45:00] "OPTIONS / HTTP/1.0" 200 134 0.000752
Sep 28 12:45:00 ctl02 nova-api[7641]: 2017-09-28 12:45:00.562 7641 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:45:00 ctl02 nova-api[7641]: 2017-09-28 12:45:00.564 7641 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:45:00 ctl02 nova-api[7641]: 2017-09-28 12:45:00.564 7641 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:45:00 ctl02 nova-api[7641]: 2017-09-28 12:45:00.564 7641 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:45:00 ctl02 nova-api[7641]: 2017-09-28 12:45:00.564 7641 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:45:00 ctl02 nova-api[7641]: 2017-09-28 12:45:00.564 7641 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:45:00 ctl02 nova-api[7641]: 2017-09-28 12:45:00.564 7641 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:45:00 ctl02 nova-api[7641]: 2017-09-28 12:45:00.564 7641 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:45:00 ctl02 nova-api[7641]: 2017-09-28 12:45:00.564 7641 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:45:00 ctl02 nova-api[7641]: 2017-09-28 12:45:00.564 7641 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:45:00 ctl02 nova-api[7641]: 2017-09-28 12:45:00.564 7641 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:45:00 ctl02 nova-api[7641]: 2017-09-28 12:45:00.564 7641 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:45:00 ctl02 nova-api[7641]: 2017-09-28 12:45:00.564 7641 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:45:00 ctl02 nova-api[7641]: 2017-09-28 12:45:00.564 7641 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:45:00 ctl02 nova-api[7641]: 2017-09-28 12:45:00.564 7641 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:45:00 ctl02 nova-api[7641]: 2017-09-28 12:45:00.564 7641 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:45:00 ctl02 nova-api[7641]: 2017-09-28 12:45:00.564 7641 ERROR nova.wsgi     self.filename))
Sep 28 12:45:00 ctl02 nova-api[7641]: 2017-09-28 12:45:00.564 7641 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:45:00 ctl02 nova-api[7641]: 2017-09-28 12:45:00.564 7641 ERROR nova.wsgi
Sep 28 12:45:00 ctl02 nova-api[7641]: 2017-09-28 12:45:00.566 7641 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:45:00 ctl02 nova-api[7641]: 2017-09-28 12:45:00.708 7641 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:45:00 ctl02 neutron-server[30536]: 2017-09-28 12:45:00.736 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:45:00] "OPTIONS / HTTP/1.0" 200 262 0.000442
Sep 28 12:45:00 ctl02 nova-api[7641]: 2017-09-28 12:45:00.931 7641 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:45:00 ctl02 nova-api[7641]: 2017-09-28 12:45:00.933 7641 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:45:00 ctl02 nova-api[7641]: 2017-09-28 12:45:00.934 7641 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:45:00 ctl02 nova-api[7641]: 2017-09-28 12:45:00.934 7641 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:45:01 ctl02 nova-api[7641]: 2017-09-28 12:45:01.067 7641 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:45:01 ctl02 nova-api[7641]: 2017-09-28 12:45:01.069 7641 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:45:01 ctl02 nova-api[7641]: 2017-09-28 12:45:01.069 7641 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:45:01 ctl02 nova-api[7641]: 2017-09-28 12:45:01.069 7641 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:45:01 ctl02 nova-api[7641]: 2017-09-28 12:45:01.073 7641 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:45:01 ctl02 nova-api[7641]: 2017-09-28 12:45:01.073 7641 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:45:01 ctl02 nova-api[7641]: 2017-09-28 12:45:01.073 7641 ERROR nova Traceback (most recent call last):
Sep 28 12:45:01 ctl02 nova-api[7641]: 2017-09-28 12:45:01.073 7641 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:45:01 ctl02 nova-api[7641]: 2017-09-28 12:45:01.073 7641 ERROR nova     sys.exit(main())
Sep 28 12:45:01 ctl02 nova-api[7641]: 2017-09-28 12:45:01.073 7641 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:45:01 ctl02 nova-api[7641]: 2017-09-28 12:45:01.073 7641 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:45:01 ctl02 nova-api[7641]: 2017-09-28 12:45:01.073 7641 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:45:01 ctl02 nova-api[7641]: 2017-09-28 12:45:01.073 7641 ERROR nova     max_url_len=max_url_len)
Sep 28 12:45:01 ctl02 nova-api[7641]: 2017-09-28 12:45:01.073 7641 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:45:01 ctl02 nova-api[7641]: 2017-09-28 12:45:01.073 7641 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:45:01 ctl02 nova-api[7641]: 2017-09-28 12:45:01.073 7641 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:45:01 ctl02 nova-api[7641]: 2017-09-28 12:45:01.073 7641 ERROR nova     sock.listen(backlog)
Sep 28 12:45:01 ctl02 nova-api[7641]: 2017-09-28 12:45:01.073 7641 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:45:01 ctl02 nova-api[7641]: 2017-09-28 12:45:01.073 7641 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:45:01 ctl02 nova-api[7641]: 2017-09-28 12:45:01.073 7641 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:45:01 ctl02 nova-api[7641]: 2017-09-28 12:45:01.073 7641 ERROR nova
Sep 28 12:45:01 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:45:01 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:45:01 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:45:01 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:45:01 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:45:01 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:45:01 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:45:01 ctl02 glance-api[29183]: 2017-09-28 12:45:01.738 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:45:01] "OPTIONS / HTTP/1.0" 200 134 0.001016
Sep 28 12:45:01 ctl02 glance-api[29183]: 2017-09-28 12:45:01.776 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:45:01] "OPTIONS / HTTP/1.0" 200 134 0.000985
Sep 28 12:45:02 ctl02 heat-api-cfn[13300]: 2017-09-28 12:45:02.195 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:45:02] "OPTIONS / HTTP/1.0" 200 134 0.000536
Sep 28 12:45:03 ctl02 nova-api[7659]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:45:03 ctl02 nova-api[7659]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:45:03 ctl02 nova-api[7659]: 2017-09-28 12:45:03.273 7659 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:45:03 ctl02 nova-api[7659]: 2017-09-28 12:45:03.274 7659 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:45:03 ctl02 nova-api[7659]: 2017-09-28 12:45:03.274 7659 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:45:03 ctl02 nova-api[7659]: 2017-09-28 12:45:03.274 7659 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:45:03 ctl02 nova-api[7659]: 2017-09-28 12:45:03.274 7659 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:45:03 ctl02 nova-api[7659]: 2017-09-28 12:45:03.274 7659 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:45:03 ctl02 nova-api[7659]: 2017-09-28 12:45:03.274 7659 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:45:03 ctl02 nova-api[7659]: 2017-09-28 12:45:03.274 7659 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:45:03 ctl02 nova-api[7659]: 2017-09-28 12:45:03.274 7659 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:45:03 ctl02 nova-api[7659]: 2017-09-28 12:45:03.274 7659 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:45:03 ctl02 nova-api[7659]: 2017-09-28 12:45:03.274 7659 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:45:03 ctl02 nova-api[7659]: 2017-09-28 12:45:03.274 7659 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:45:03 ctl02 nova-api[7659]: 2017-09-28 12:45:03.274 7659 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:45:03 ctl02 nova-api[7659]: 2017-09-28 12:45:03.274 7659 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:45:03 ctl02 nova-api[7659]: 2017-09-28 12:45:03.274 7659 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:45:03 ctl02 nova-api[7659]: 2017-09-28 12:45:03.274 7659 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:45:03 ctl02 nova-api[7659]: 2017-09-28 12:45:03.274 7659 ERROR nova.wsgi     self.filename))
Sep 28 12:45:03 ctl02 nova-api[7659]: 2017-09-28 12:45:03.274 7659 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:45:03 ctl02 nova-api[7659]: 2017-09-28 12:45:03.274 7659 ERROR nova.wsgi
Sep 28 12:45:03 ctl02 nova-api[7659]: 2017-09-28 12:45:03.275 7659 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:45:03 ctl02 nova-api[7659]: 2017-09-28 12:45:03.407 7659 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:45:03 ctl02 nova-api[7659]: 2017-09-28 12:45:03.656 7659 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:45:03 ctl02 nova-api[7659]: 2017-09-28 12:45:03.659 7659 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:45:03 ctl02 nova-api[7659]: 2017-09-28 12:45:03.659 7659 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:45:03 ctl02 nova-api[7659]: 2017-09-28 12:45:03.659 7659 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:45:03 ctl02 nova-api[7659]: 2017-09-28 12:45:03.792 7659 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:45:03 ctl02 nova-api[7659]: 2017-09-28 12:45:03.794 7659 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:45:03 ctl02 nova-api[7659]: 2017-09-28 12:45:03.794 7659 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:45:03 ctl02 nova-api[7659]: 2017-09-28 12:45:03.794 7659 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:45:03 ctl02 nova-api[7659]: 2017-09-28 12:45:03.798 7659 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:45:03 ctl02 nova-api[7659]: 2017-09-28 12:45:03.798 7659 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:45:03 ctl02 nova-api[7659]: 2017-09-28 12:45:03.798 7659 ERROR nova Traceback (most recent call last):
Sep 28 12:45:03 ctl02 nova-api[7659]: 2017-09-28 12:45:03.798 7659 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:45:03 ctl02 nova-api[7659]: 2017-09-28 12:45:03.798 7659 ERROR nova     sys.exit(main())
Sep 28 12:45:03 ctl02 nova-api[7659]: 2017-09-28 12:45:03.798 7659 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:45:03 ctl02 nova-api[7659]: 2017-09-28 12:45:03.798 7659 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:45:03 ctl02 nova-api[7659]: 2017-09-28 12:45:03.798 7659 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:45:03 ctl02 nova-api[7659]: 2017-09-28 12:45:03.798 7659 ERROR nova     max_url_len=max_url_len)
Sep 28 12:45:03 ctl02 nova-api[7659]: 2017-09-28 12:45:03.798 7659 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:45:03 ctl02 nova-api[7659]: 2017-09-28 12:45:03.798 7659 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:45:03 ctl02 nova-api[7659]: 2017-09-28 12:45:03.798 7659 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:45:03 ctl02 nova-api[7659]: 2017-09-28 12:45:03.798 7659 ERROR nova     sock.listen(backlog)
Sep 28 12:45:03 ctl02 nova-api[7659]: 2017-09-28 12:45:03.798 7659 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:45:03 ctl02 nova-api[7659]: 2017-09-28 12:45:03.798 7659 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:45:03 ctl02 nova-api[7659]: 2017-09-28 12:45:03.798 7659 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:45:03 ctl02 nova-api[7659]: 2017-09-28 12:45:03.798 7659 ERROR nova
Sep 28 12:45:03 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:45:03 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:45:03 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:45:04 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:45:04 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:45:04 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:45:04 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:45:04 ctl02 nova-consoleauth[5433]: 2017-09-28 12:45:04.620 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:45:04 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:45:04.667 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:45:04] "OPTIONS / HTTP/1.0" 200 134 0.000349
Sep 28 12:45:05 ctl02 heat-api[13008]: 2017-09-28 12:45:05.825 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:45:05] "OPTIONS / HTTP/1.0" 200 134 0.000513
Sep 28 12:45:05 ctl02 nova-api[7676]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:45:05 ctl02 nova-api[7676]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:45:06 ctl02 nova-api[7676]: 2017-09-28 12:45:06.001 7676 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:45:06 ctl02 nova-api[7676]: 2017-09-28 12:45:06.002 7676 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:45:06 ctl02 nova-api[7676]: 2017-09-28 12:45:06.002 7676 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:45:06 ctl02 nova-api[7676]: 2017-09-28 12:45:06.002 7676 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:45:06 ctl02 nova-api[7676]: 2017-09-28 12:45:06.002 7676 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:45:06 ctl02 nova-api[7676]: 2017-09-28 12:45:06.002 7676 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:45:06 ctl02 nova-api[7676]: 2017-09-28 12:45:06.002 7676 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:45:06 ctl02 nova-api[7676]: 2017-09-28 12:45:06.002 7676 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:45:06 ctl02 nova-api[7676]: 2017-09-28 12:45:06.002 7676 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:45:06 ctl02 nova-api[7676]: 2017-09-28 12:45:06.002 7676 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:45:06 ctl02 nova-api[7676]: 2017-09-28 12:45:06.002 7676 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:45:06 ctl02 nova-api[7676]: 2017-09-28 12:45:06.002 7676 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:45:06 ctl02 nova-api[7676]: 2017-09-28 12:45:06.002 7676 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:45:06 ctl02 nova-api[7676]: 2017-09-28 12:45:06.002 7676 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:45:06 ctl02 nova-api[7676]: 2017-09-28 12:45:06.002 7676 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:45:06 ctl02 nova-api[7676]: 2017-09-28 12:45:06.002 7676 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:45:06 ctl02 nova-api[7676]: 2017-09-28 12:45:06.002 7676 ERROR nova.wsgi     self.filename))
Sep 28 12:45:06 ctl02 nova-api[7676]: 2017-09-28 12:45:06.002 7676 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:45:06 ctl02 nova-api[7676]: 2017-09-28 12:45:06.002 7676 ERROR nova.wsgi
Sep 28 12:45:06 ctl02 nova-api[7676]: 2017-09-28 12:45:06.003 7676 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:45:06 ctl02 heat-engine[12803]: 2017-09-28 12:45:06.121 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:45:06 ctl02 heat-engine[12803]: 2017-09-28 12:45:06.131 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:45:06 ctl02 heat-engine[12803]: 2017-09-28 12:45:06.132 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:45:06 ctl02 nova-api[7676]: 2017-09-28 12:45:06.136 7676 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:45:06 ctl02 heat-engine[12803]: 2017-09-28 12:45:06.142 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:45:06 ctl02 neutron-server[30536]: 2017-09-28 12:45:06.267 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 12:45:06 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:45:06 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:43:28 cmp001
Sep 28 12:45:06 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:43:20 cmp002
Sep 28 12:45:06 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:43:56 cmp002
Sep 28 12:45:06 ctl02 nova-api[7676]: 2017-09-28 12:45:06.364 7676 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:45:06 ctl02 nova-api[7676]: 2017-09-28 12:45:06.366 7676 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:45:06 ctl02 nova-api[7676]: 2017-09-28 12:45:06.366 7676 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:45:06 ctl02 nova-api[7676]: 2017-09-28 12:45:06.366 7676 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:45:06 ctl02 nova-api[7676]: 2017-09-28 12:45:06.499 7676 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:45:06 ctl02 nova-api[7676]: 2017-09-28 12:45:06.501 7676 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:45:06 ctl02 nova-api[7676]: 2017-09-28 12:45:06.501 7676 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:45:06 ctl02 nova-api[7676]: 2017-09-28 12:45:06.501 7676 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:45:06 ctl02 nova-api[7676]: 2017-09-28 12:45:06.505 7676 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:45:06 ctl02 nova-api[7676]: 2017-09-28 12:45:06.505 7676 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:45:06 ctl02 nova-api[7676]: 2017-09-28 12:45:06.505 7676 ERROR nova Traceback (most recent call last):
Sep 28 12:45:06 ctl02 nova-api[7676]: 2017-09-28 12:45:06.505 7676 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:45:06 ctl02 nova-api[7676]: 2017-09-28 12:45:06.505 7676 ERROR nova     sys.exit(main())
Sep 28 12:45:06 ctl02 nova-api[7676]: 2017-09-28 12:45:06.505 7676 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:45:06 ctl02 nova-api[7676]: 2017-09-28 12:45:06.505 7676 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:45:06 ctl02 nova-api[7676]: 2017-09-28 12:45:06.505 7676 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:45:06 ctl02 nova-api[7676]: 2017-09-28 12:45:06.505 7676 ERROR nova     max_url_len=max_url_len)
Sep 28 12:45:06 ctl02 nova-api[7676]: 2017-09-28 12:45:06.505 7676 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:45:06 ctl02 nova-api[7676]: 2017-09-28 12:45:06.505 7676 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:45:06 ctl02 nova-api[7676]: 2017-09-28 12:45:06.505 7676 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:45:06 ctl02 nova-api[7676]: 2017-09-28 12:45:06.505 7676 ERROR nova     sock.listen(backlog)
Sep 28 12:45:06 ctl02 nova-api[7676]: 2017-09-28 12:45:06.505 7676 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:45:06 ctl02 nova-api[7676]: 2017-09-28 12:45:06.505 7676 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:45:06 ctl02 nova-api[7676]: 2017-09-28 12:45:06.505 7676 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:45:06 ctl02 nova-api[7676]: 2017-09-28 12:45:06.505 7676 ERROR nova
Sep 28 12:45:06 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:45:06 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:45:06 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:45:06 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:45:06.743 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:45:06] "OPTIONS / HTTP/1.0" 200 134 0.000543
Sep 28 12:45:06 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:45:06 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:45:06 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:45:06 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:45:07 ctl02 heat-api[13008]: 2017-09-28 12:45:07.188 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:45:07] "OPTIONS / HTTP/1.0" 200 134 0.000535
Sep 28 12:45:07 ctl02 heat-api-cfn[13300]: 2017-09-28 12:45:07.500 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:45:07] "OPTIONS / HTTP/1.0" 200 134 0.000467
Sep 28 12:45:07 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x14443763)
Sep 28 12:45:07 ctl02 nova-scheduler[5620]: 2017-09-28 12:45:07.709 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:45:07 ctl02 heat-api[13008]: 2017-09-28 12:45:07.746 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:45:07] "OPTIONS / HTTP/1.0" 200 134 0.000551
Sep 28 12:45:08 ctl02 heat-api-cfn[13300]: 2017-09-28 12:45:08.455 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:45:08] "OPTIONS / HTTP/1.0" 200 134 0.000419
Sep 28 12:45:08 ctl02 nova-api[7695]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:45:08 ctl02 nova-api[7695]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:45:08 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x14443763)
Sep 28 12:45:08 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:45:08.669 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:45:08] "OPTIONS / HTTP/1.0" 200 134 0.000420
Sep 28 12:45:08 ctl02 nova-api[7695]: 2017-09-28 12:45:08.778 7695 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:45:08 ctl02 nova-api[7695]: 2017-09-28 12:45:08.779 7695 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:45:08 ctl02 nova-api[7695]: 2017-09-28 12:45:08.779 7695 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:45:08 ctl02 nova-api[7695]: 2017-09-28 12:45:08.779 7695 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:45:08 ctl02 nova-api[7695]: 2017-09-28 12:45:08.779 7695 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:45:08 ctl02 nova-api[7695]: 2017-09-28 12:45:08.779 7695 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:45:08 ctl02 nova-api[7695]: 2017-09-28 12:45:08.779 7695 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:45:08 ctl02 nova-api[7695]: 2017-09-28 12:45:08.779 7695 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:45:08 ctl02 nova-api[7695]: 2017-09-28 12:45:08.779 7695 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:45:08 ctl02 nova-api[7695]: 2017-09-28 12:45:08.779 7695 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:45:08 ctl02 nova-api[7695]: 2017-09-28 12:45:08.779 7695 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:45:08 ctl02 nova-api[7695]: 2017-09-28 12:45:08.779 7695 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:45:08 ctl02 nova-api[7695]: 2017-09-28 12:45:08.779 7695 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:45:08 ctl02 nova-api[7695]: 2017-09-28 12:45:08.779 7695 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:45:08 ctl02 nova-api[7695]: 2017-09-28 12:45:08.779 7695 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:45:08 ctl02 nova-api[7695]: 2017-09-28 12:45:08.779 7695 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:45:08 ctl02 nova-api[7695]: 2017-09-28 12:45:08.779 7695 ERROR nova.wsgi     self.filename))
Sep 28 12:45:08 ctl02 nova-api[7695]: 2017-09-28 12:45:08.779 7695 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:45:08 ctl02 nova-api[7695]: 2017-09-28 12:45:08.779 7695 ERROR nova.wsgi
Sep 28 12:45:08 ctl02 nova-api[7695]: 2017-09-28 12:45:08.781 7695 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:45:08 ctl02 nova-api[7695]: 2017-09-28 12:45:08.913 7695 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:45:09 ctl02 nova-api[7695]: 2017-09-28 12:45:09.160 7695 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:45:09 ctl02 nova-api[7695]: 2017-09-28 12:45:09.163 7695 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:45:09 ctl02 nova-api[7695]: 2017-09-28 12:45:09.163 7695 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:45:09 ctl02 nova-api[7695]: 2017-09-28 12:45:09.163 7695 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:45:09 ctl02 neutron-server[30536]: 2017-09-28 12:45:09.268 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:45:09] "OPTIONS / HTTP/1.0" 200 262 0.000539
Sep 28 12:45:09 ctl02 nova-api[7695]: 2017-09-28 12:45:09.303 7695 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:45:09 ctl02 nova-api[7695]: 2017-09-28 12:45:09.305 7695 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:45:09 ctl02 nova-api[7695]: 2017-09-28 12:45:09.305 7695 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:45:09 ctl02 nova-api[7695]: 2017-09-28 12:45:09.306 7695 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:45:09 ctl02 nova-api[7695]: 2017-09-28 12:45:09.310 7695 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:45:09 ctl02 nova-api[7695]: 2017-09-28 12:45:09.310 7695 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:45:09 ctl02 nova-api[7695]: 2017-09-28 12:45:09.310 7695 ERROR nova Traceback (most recent call last):
Sep 28 12:45:09 ctl02 nova-api[7695]: 2017-09-28 12:45:09.310 7695 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:45:09 ctl02 nova-api[7695]: 2017-09-28 12:45:09.310 7695 ERROR nova     sys.exit(main())
Sep 28 12:45:09 ctl02 nova-api[7695]: 2017-09-28 12:45:09.310 7695 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:45:09 ctl02 nova-api[7695]: 2017-09-28 12:45:09.310 7695 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:45:09 ctl02 nova-api[7695]: 2017-09-28 12:45:09.310 7695 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:45:09 ctl02 nova-api[7695]: 2017-09-28 12:45:09.310 7695 ERROR nova     max_url_len=max_url_len)
Sep 28 12:45:09 ctl02 nova-api[7695]: 2017-09-28 12:45:09.310 7695 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:45:09 ctl02 nova-api[7695]: 2017-09-28 12:45:09.310 7695 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:45:09 ctl02 nova-api[7695]: 2017-09-28 12:45:09.310 7695 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:45:09 ctl02 nova-api[7695]: 2017-09-28 12:45:09.310 7695 ERROR nova     sock.listen(backlog)
Sep 28 12:45:09 ctl02 nova-api[7695]: 2017-09-28 12:45:09.310 7695 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:45:09 ctl02 nova-api[7695]: 2017-09-28 12:45:09.310 7695 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:45:09 ctl02 nova-api[7695]: 2017-09-28 12:45:09.310 7695 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:45:09 ctl02 nova-api[7695]: 2017-09-28 12:45:09.310 7695 ERROR nova
Sep 28 12:45:09 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:45:09 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:45:09 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:45:09 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x14443763)
Sep 28 12:45:09 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:45:09 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:45:09 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:45:09 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:45:10 ctl02 neutron-server[30536]: 2017-09-28 12:45:10.535 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:45:10] "OPTIONS / HTTP/1.0" 200 262 0.000451
Sep 28 12:45:10 ctl02 glance-api[29183]: 2017-09-28 12:45:10.557 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:45:10] "OPTIONS / HTTP/1.0" 200 134 0.000584
Sep 28 12:45:10 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x14443763)
Sep 28 12:45:11 ctl02 neutron-server[30536]: 2017-09-28 12:45:11.002 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:45:11] "OPTIONS / HTTP/1.0" 200 262 0.000624
Sep 28 12:45:11 ctl02 nova-api[7713]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:45:11 ctl02 nova-api[7713]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:45:11 ctl02 nova-api[7713]: 2017-09-28 12:45:11.526 7713 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:45:11 ctl02 nova-api[7713]: 2017-09-28 12:45:11.527 7713 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:45:11 ctl02 nova-api[7713]: 2017-09-28 12:45:11.527 7713 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:45:11 ctl02 nova-api[7713]: 2017-09-28 12:45:11.527 7713 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:45:11 ctl02 nova-api[7713]: 2017-09-28 12:45:11.527 7713 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:45:11 ctl02 nova-api[7713]: 2017-09-28 12:45:11.527 7713 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:45:11 ctl02 nova-api[7713]: 2017-09-28 12:45:11.527 7713 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:45:11 ctl02 nova-api[7713]: 2017-09-28 12:45:11.527 7713 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:45:11 ctl02 nova-api[7713]: 2017-09-28 12:45:11.527 7713 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:45:11 ctl02 nova-api[7713]: 2017-09-28 12:45:11.527 7713 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:45:11 ctl02 nova-api[7713]: 2017-09-28 12:45:11.527 7713 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:45:11 ctl02 nova-api[7713]: 2017-09-28 12:45:11.527 7713 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:45:11 ctl02 nova-api[7713]: 2017-09-28 12:45:11.527 7713 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:45:11 ctl02 nova-api[7713]: 2017-09-28 12:45:11.527 7713 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:45:11 ctl02 nova-api[7713]: 2017-09-28 12:45:11.527 7713 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:45:11 ctl02 nova-api[7713]: 2017-09-28 12:45:11.527 7713 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:45:11 ctl02 nova-api[7713]: 2017-09-28 12:45:11.527 7713 ERROR nova.wsgi     self.filename))
Sep 28 12:45:11 ctl02 nova-api[7713]: 2017-09-28 12:45:11.527 7713 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:45:11 ctl02 nova-api[7713]: 2017-09-28 12:45:11.527 7713 ERROR nova.wsgi
Sep 28 12:45:11 ctl02 nova-api[7713]: 2017-09-28 12:45:11.528 7713 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:45:11 ctl02 glance-api[29183]: 2017-09-28 12:45:11.540 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:45:11] "OPTIONS / HTTP/1.0" 200 134 0.000624
Sep 28 12:45:11 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x14443763)
Sep 28 12:45:11 ctl02 nova-api[7713]: 2017-09-28 12:45:11.665 7713 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:45:11 ctl02 nova-api[7713]: 2017-09-28 12:45:11.896 7713 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:45:11 ctl02 nova-api[7713]: 2017-09-28 12:45:11.899 7713 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:45:11 ctl02 nova-api[7713]: 2017-09-28 12:45:11.899 7713 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:45:11 ctl02 nova-api[7713]: 2017-09-28 12:45:11.900 7713 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:45:12 ctl02 glance-api[29183]: 2017-09-28 12:45:12.022 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:45:12] "OPTIONS / HTTP/1.0" 200 134 0.000622
Sep 28 12:45:12 ctl02 nova-api[7713]: 2017-09-28 12:45:12.035 7713 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:45:12 ctl02 nova-api[7713]: 2017-09-28 12:45:12.038 7713 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:45:12 ctl02 nova-api[7713]: 2017-09-28 12:45:12.038 7713 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:45:12 ctl02 nova-api[7713]: 2017-09-28 12:45:12.038 7713 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:45:12 ctl02 nova-api[7713]: 2017-09-28 12:45:12.042 7713 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:45:12 ctl02 nova-api[7713]: 2017-09-28 12:45:12.042 7713 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:45:12 ctl02 nova-api[7713]: 2017-09-28 12:45:12.042 7713 ERROR nova Traceback (most recent call last):
Sep 28 12:45:12 ctl02 nova-api[7713]: 2017-09-28 12:45:12.042 7713 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:45:12 ctl02 nova-api[7713]: 2017-09-28 12:45:12.042 7713 ERROR nova     sys.exit(main())
Sep 28 12:45:12 ctl02 nova-api[7713]: 2017-09-28 12:45:12.042 7713 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:45:12 ctl02 nova-api[7713]: 2017-09-28 12:45:12.042 7713 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:45:12 ctl02 nova-api[7713]: 2017-09-28 12:45:12.042 7713 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:45:12 ctl02 nova-api[7713]: 2017-09-28 12:45:12.042 7713 ERROR nova     max_url_len=max_url_len)
Sep 28 12:45:12 ctl02 nova-api[7713]: 2017-09-28 12:45:12.042 7713 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:45:12 ctl02 nova-api[7713]: 2017-09-28 12:45:12.042 7713 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:45:12 ctl02 nova-api[7713]: 2017-09-28 12:45:12.042 7713 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:45:12 ctl02 nova-api[7713]: 2017-09-28 12:45:12.042 7713 ERROR nova     sock.listen(backlog)
Sep 28 12:45:12 ctl02 nova-api[7713]: 2017-09-28 12:45:12.042 7713 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:45:12 ctl02 nova-api[7713]: 2017-09-28 12:45:12.042 7713 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:45:12 ctl02 nova-api[7713]: 2017-09-28 12:45:12.042 7713 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:45:12 ctl02 nova-api[7713]: 2017-09-28 12:45:12.042 7713 ERROR nova
Sep 28 12:45:12 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:45:12 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:45:12 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:45:12 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:45:12 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:45:12 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:45:12 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:45:12 ctl02 heat-api-cfn[13300]: 2017-09-28 12:45:12.477 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:45:12] "OPTIONS / HTTP/1.0" 200 134 0.000429
Sep 28 12:45:12 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x14443763)
Sep 28 12:45:13 ctl02 neutron-server[30536]: 2017-09-28 12:45:13.491 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:45:13 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x14443763)
Sep 28 12:45:14 ctl02 nova-api[7731]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:45:14 ctl02 nova-api[7731]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:45:14 ctl02 nova-api[7731]: 2017-09-28 12:45:14.288 7731 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:45:14 ctl02 nova-api[7731]: 2017-09-28 12:45:14.290 7731 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:45:14 ctl02 nova-api[7731]: 2017-09-28 12:45:14.290 7731 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:45:14 ctl02 nova-api[7731]: 2017-09-28 12:45:14.290 7731 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:45:14 ctl02 nova-api[7731]: 2017-09-28 12:45:14.290 7731 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:45:14 ctl02 nova-api[7731]: 2017-09-28 12:45:14.290 7731 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:45:14 ctl02 nova-api[7731]: 2017-09-28 12:45:14.290 7731 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:45:14 ctl02 nova-api[7731]: 2017-09-28 12:45:14.290 7731 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:45:14 ctl02 nova-api[7731]: 2017-09-28 12:45:14.290 7731 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:45:14 ctl02 nova-api[7731]: 2017-09-28 12:45:14.290 7731 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:45:14 ctl02 nova-api[7731]: 2017-09-28 12:45:14.290 7731 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:45:14 ctl02 nova-api[7731]: 2017-09-28 12:45:14.290 7731 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:45:14 ctl02 nova-api[7731]: 2017-09-28 12:45:14.290 7731 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:45:14 ctl02 nova-api[7731]: 2017-09-28 12:45:14.290 7731 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:45:14 ctl02 nova-api[7731]: 2017-09-28 12:45:14.290 7731 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:45:14 ctl02 nova-api[7731]: 2017-09-28 12:45:14.290 7731 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:45:14 ctl02 nova-api[7731]: 2017-09-28 12:45:14.290 7731 ERROR nova.wsgi     self.filename))
Sep 28 12:45:14 ctl02 nova-api[7731]: 2017-09-28 12:45:14.290 7731 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:45:14 ctl02 nova-api[7731]: 2017-09-28 12:45:14.290 7731 ERROR nova.wsgi
Sep 28 12:45:14 ctl02 nova-api[7731]: 2017-09-28 12:45:14.291 7731 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:45:14 ctl02 nova-api[7731]: 2017-09-28 12:45:14.426 7731 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:45:14 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:45:14.483 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:45:14] "OPTIONS / HTTP/1.0" 200 134 0.000467
Sep 28 12:45:14 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x14443763)
Sep 28 12:45:14 ctl02 nova-api[7731]: 2017-09-28 12:45:14.678 7731 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:45:14 ctl02 nova-api[7731]: 2017-09-28 12:45:14.680 7731 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:45:14 ctl02 nova-api[7731]: 2017-09-28 12:45:14.681 7731 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:45:14 ctl02 nova-api[7731]: 2017-09-28 12:45:14.681 7731 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:45:14 ctl02 nova-api[7731]: 2017-09-28 12:45:14.815 7731 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:45:14 ctl02 nova-api[7731]: 2017-09-28 12:45:14.817 7731 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:45:14 ctl02 nova-api[7731]: 2017-09-28 12:45:14.817 7731 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:45:14 ctl02 nova-api[7731]: 2017-09-28 12:45:14.818 7731 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:45:14 ctl02 nova-api[7731]: 2017-09-28 12:45:14.821 7731 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:45:14 ctl02 nova-api[7731]: 2017-09-28 12:45:14.821 7731 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:45:14 ctl02 nova-api[7731]: 2017-09-28 12:45:14.821 7731 ERROR nova Traceback (most recent call last):
Sep 28 12:45:14 ctl02 nova-api[7731]: 2017-09-28 12:45:14.821 7731 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:45:14 ctl02 nova-api[7731]: 2017-09-28 12:45:14.821 7731 ERROR nova     sys.exit(main())
Sep 28 12:45:14 ctl02 nova-api[7731]: 2017-09-28 12:45:14.821 7731 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:45:14 ctl02 nova-api[7731]: 2017-09-28 12:45:14.821 7731 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:45:14 ctl02 nova-api[7731]: 2017-09-28 12:45:14.821 7731 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:45:14 ctl02 nova-api[7731]: 2017-09-28 12:45:14.821 7731 ERROR nova     max_url_len=max_url_len)
Sep 28 12:45:14 ctl02 nova-api[7731]: 2017-09-28 12:45:14.821 7731 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:45:14 ctl02 nova-api[7731]: 2017-09-28 12:45:14.821 7731 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:45:14 ctl02 nova-api[7731]: 2017-09-28 12:45:14.821 7731 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:45:14 ctl02 nova-api[7731]: 2017-09-28 12:45:14.821 7731 ERROR nova     sock.listen(backlog)
Sep 28 12:45:14 ctl02 nova-api[7731]: 2017-09-28 12:45:14.821 7731 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:45:14 ctl02 nova-api[7731]: 2017-09-28 12:45:14.821 7731 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:45:14 ctl02 nova-api[7731]: 2017-09-28 12:45:14.821 7731 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:45:14 ctl02 nova-api[7731]: 2017-09-28 12:45:14.821 7731 ERROR nova
Sep 28 12:45:14 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:45:14 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:45:14 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:45:15 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:45:15 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:45:15 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:45:15 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:45:15 ctl02 heat-api[13008]: 2017-09-28 12:45:15.567 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:45:15] "OPTIONS / HTTP/1.0" 200 134 0.000535
Sep 28 12:45:15 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x14443763)
Sep 28 12:45:16 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x14443763)
Sep 28 12:45:16 ctl02 nova-api[7748]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:45:16 ctl02 nova-api[7748]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:45:16 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:45:16.980 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:45:16] "OPTIONS / HTTP/1.0" 200 134 0.000532
Sep 28 12:45:17 ctl02 nova-api[7748]: 2017-09-28 12:45:17.034 7748 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:45:17 ctl02 nova-api[7748]: 2017-09-28 12:45:17.036 7748 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:45:17 ctl02 nova-api[7748]: 2017-09-28 12:45:17.036 7748 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:45:17 ctl02 nova-api[7748]: 2017-09-28 12:45:17.036 7748 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:45:17 ctl02 nova-api[7748]: 2017-09-28 12:45:17.036 7748 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:45:17 ctl02 nova-api[7748]: 2017-09-28 12:45:17.036 7748 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:45:17 ctl02 nova-api[7748]: 2017-09-28 12:45:17.036 7748 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:45:17 ctl02 nova-api[7748]: 2017-09-28 12:45:17.036 7748 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:45:17 ctl02 nova-api[7748]: 2017-09-28 12:45:17.036 7748 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:45:17 ctl02 nova-api[7748]: 2017-09-28 12:45:17.036 7748 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:45:17 ctl02 nova-api[7748]: 2017-09-28 12:45:17.036 7748 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:45:17 ctl02 nova-api[7748]: 2017-09-28 12:45:17.036 7748 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:45:17 ctl02 nova-api[7748]: 2017-09-28 12:45:17.036 7748 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:45:17 ctl02 nova-api[7748]: 2017-09-28 12:45:17.036 7748 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:45:17 ctl02 nova-api[7748]: 2017-09-28 12:45:17.036 7748 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:45:17 ctl02 nova-api[7748]: 2017-09-28 12:45:17.036 7748 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:45:17 ctl02 nova-api[7748]: 2017-09-28 12:45:17.036 7748 ERROR nova.wsgi     self.filename))
Sep 28 12:45:17 ctl02 nova-api[7748]: 2017-09-28 12:45:17.036 7748 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:45:17 ctl02 nova-api[7748]: 2017-09-28 12:45:17.036 7748 ERROR nova.wsgi
Sep 28 12:45:17 ctl02 nova-api[7748]: 2017-09-28 12:45:17.037 7748 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:45:17 ctl02 heat-api[13008]: 2017-09-28 12:45:17.170 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:45:17] "OPTIONS / HTTP/1.0" 200 134 0.000530
Sep 28 12:45:17 ctl02 nova-api[7748]: 2017-09-28 12:45:17.171 7748 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:45:17 ctl02 heat-api-cfn[13300]: 2017-09-28 12:45:17.229 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:45:17] "OPTIONS / HTTP/1.0" 200 134 0.000629
Sep 28 12:45:17 ctl02 nova-api[7748]: 2017-09-28 12:45:17.396 7748 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:45:17 ctl02 nova-api[7748]: 2017-09-28 12:45:17.398 7748 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:45:17 ctl02 nova-api[7748]: 2017-09-28 12:45:17.398 7748 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:45:17 ctl02 nova-api[7748]: 2017-09-28 12:45:17.399 7748 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:45:17 ctl02 nova-api[7748]: 2017-09-28 12:45:17.530 7748 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:45:17 ctl02 nova-api[7748]: 2017-09-28 12:45:17.533 7748 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:45:17 ctl02 nova-api[7748]: 2017-09-28 12:45:17.533 7748 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:45:17 ctl02 nova-api[7748]: 2017-09-28 12:45:17.533 7748 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:45:17 ctl02 nova-api[7748]: 2017-09-28 12:45:17.537 7748 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:45:17 ctl02 nova-api[7748]: 2017-09-28 12:45:17.537 7748 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:45:17 ctl02 nova-api[7748]: 2017-09-28 12:45:17.537 7748 ERROR nova Traceback (most recent call last):
Sep 28 12:45:17 ctl02 nova-api[7748]: 2017-09-28 12:45:17.537 7748 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:45:17 ctl02 nova-api[7748]: 2017-09-28 12:45:17.537 7748 ERROR nova     sys.exit(main())
Sep 28 12:45:17 ctl02 nova-api[7748]: 2017-09-28 12:45:17.537 7748 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:45:17 ctl02 nova-api[7748]: 2017-09-28 12:45:17.537 7748 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:45:17 ctl02 nova-api[7748]: 2017-09-28 12:45:17.537 7748 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:45:17 ctl02 nova-api[7748]: 2017-09-28 12:45:17.537 7748 ERROR nova     max_url_len=max_url_len)
Sep 28 12:45:17 ctl02 nova-api[7748]: 2017-09-28 12:45:17.537 7748 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:45:17 ctl02 nova-api[7748]: 2017-09-28 12:45:17.537 7748 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:45:17 ctl02 nova-api[7748]: 2017-09-28 12:45:17.537 7748 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:45:17 ctl02 nova-api[7748]: 2017-09-28 12:45:17.537 7748 ERROR nova     sock.listen(backlog)
Sep 28 12:45:17 ctl02 nova-api[7748]: 2017-09-28 12:45:17.537 7748 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:45:17 ctl02 nova-api[7748]: 2017-09-28 12:45:17.537 7748 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:45:17 ctl02 nova-api[7748]: 2017-09-28 12:45:17.537 7748 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:45:17 ctl02 nova-api[7748]: 2017-09-28 12:45:17.537 7748 ERROR nova
Sep 28 12:45:17 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x14443763)
Sep 28 12:45:17 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:45:17 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:45:17 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:45:17 ctl02 heat-api[13008]: 2017-09-28 12:45:17.780 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:45:17] "OPTIONS / HTTP/1.0" 200 134 0.000795
Sep 28 12:45:17 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:45:17 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:45:17 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:45:17 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:45:18 ctl02 heat-api-cfn[13300]: 2017-09-28 12:45:18.069 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:45:18] "OPTIONS / HTTP/1.0" 200 134 0.000511
Sep 28 12:45:18 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:45:18 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:45:19 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:45:19.037 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:45:19] "OPTIONS / HTTP/1.0" 200 134 0.000415
Sep 28 12:45:19 ctl02 nova-api[7768]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:45:19 ctl02 nova-api[7768]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:45:19 ctl02 neutron-server[30536]: 2017-09-28 12:45:19.593 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:45:19] "OPTIONS / HTTP/1.0" 200 262 0.000468
Sep 28 12:45:19 ctl02 nova-api[7768]: 2017-09-28 12:45:19.751 7768 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:45:19 ctl02 nova-api[7768]: 2017-09-28 12:45:19.753 7768 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:45:19 ctl02 nova-api[7768]: 2017-09-28 12:45:19.753 7768 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:45:19 ctl02 nova-api[7768]: 2017-09-28 12:45:19.753 7768 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:45:19 ctl02 nova-api[7768]: 2017-09-28 12:45:19.753 7768 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:45:19 ctl02 nova-api[7768]: 2017-09-28 12:45:19.753 7768 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:45:19 ctl02 nova-api[7768]: 2017-09-28 12:45:19.753 7768 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:45:19 ctl02 nova-api[7768]: 2017-09-28 12:45:19.753 7768 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:45:19 ctl02 nova-api[7768]: 2017-09-28 12:45:19.753 7768 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:45:19 ctl02 nova-api[7768]: 2017-09-28 12:45:19.753 7768 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:45:19 ctl02 nova-api[7768]: 2017-09-28 12:45:19.753 7768 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:45:19 ctl02 nova-api[7768]: 2017-09-28 12:45:19.753 7768 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:45:19 ctl02 nova-api[7768]: 2017-09-28 12:45:19.753 7768 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:45:19 ctl02 nova-api[7768]: 2017-09-28 12:45:19.753 7768 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:45:19 ctl02 nova-api[7768]: 2017-09-28 12:45:19.753 7768 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:45:19 ctl02 nova-api[7768]: 2017-09-28 12:45:19.753 7768 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:45:19 ctl02 nova-api[7768]: 2017-09-28 12:45:19.753 7768 ERROR nova.wsgi     self.filename))
Sep 28 12:45:19 ctl02 nova-api[7768]: 2017-09-28 12:45:19.753 7768 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:45:19 ctl02 nova-api[7768]: 2017-09-28 12:45:19.753 7768 ERROR nova.wsgi
Sep 28 12:45:19 ctl02 nova-api[7768]: 2017-09-28 12:45:19.755 7768 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:45:19 ctl02 nova-api[7768]: 2017-09-28 12:45:19.884 7768 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:45:20 ctl02 nova-api[7768]: 2017-09-28 12:45:20.110 7768 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:45:20 ctl02 nova-api[7768]: 2017-09-28 12:45:20.113 7768 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:45:20 ctl02 nova-api[7768]: 2017-09-28 12:45:20.113 7768 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:45:20 ctl02 nova-api[7768]: 2017-09-28 12:45:20.113 7768 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:45:20 ctl02 nova-api[7768]: 2017-09-28 12:45:20.247 7768 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:45:20 ctl02 nova-api[7768]: 2017-09-28 12:45:20.249 7768 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:45:20 ctl02 nova-api[7768]: 2017-09-28 12:45:20.249 7768 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:45:20 ctl02 nova-api[7768]: 2017-09-28 12:45:20.250 7768 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:45:20 ctl02 nova-api[7768]: 2017-09-28 12:45:20.253 7768 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:45:20 ctl02 nova-api[7768]: 2017-09-28 12:45:20.253 7768 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:45:20 ctl02 nova-api[7768]: 2017-09-28 12:45:20.253 7768 ERROR nova Traceback (most recent call last):
Sep 28 12:45:20 ctl02 nova-api[7768]: 2017-09-28 12:45:20.253 7768 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:45:20 ctl02 nova-api[7768]: 2017-09-28 12:45:20.253 7768 ERROR nova     sys.exit(main())
Sep 28 12:45:20 ctl02 nova-api[7768]: 2017-09-28 12:45:20.253 7768 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:45:20 ctl02 nova-api[7768]: 2017-09-28 12:45:20.253 7768 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:45:20 ctl02 nova-api[7768]: 2017-09-28 12:45:20.253 7768 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:45:20 ctl02 nova-api[7768]: 2017-09-28 12:45:20.253 7768 ERROR nova     max_url_len=max_url_len)
Sep 28 12:45:20 ctl02 nova-api[7768]: 2017-09-28 12:45:20.253 7768 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:45:20 ctl02 nova-api[7768]: 2017-09-28 12:45:20.253 7768 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:45:20 ctl02 nova-api[7768]: 2017-09-28 12:45:20.253 7768 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:45:20 ctl02 nova-api[7768]: 2017-09-28 12:45:20.253 7768 ERROR nova     sock.listen(backlog)
Sep 28 12:45:20 ctl02 nova-api[7768]: 2017-09-28 12:45:20.253 7768 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:45:20 ctl02 nova-api[7768]: 2017-09-28 12:45:20.253 7768 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:45:20 ctl02 nova-api[7768]: 2017-09-28 12:45:20.253 7768 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:45:20 ctl02 nova-api[7768]: 2017-09-28 12:45:20.253 7768 ERROR nova
Sep 28 12:45:20 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:45:20 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:45:20 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:45:20 ctl02 glance-api[29183]: 2017-09-28 12:45:20.431 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:45:20] "OPTIONS / HTTP/1.0" 200 134 0.000611
Sep 28 12:45:20 ctl02 neutron-server[30536]: 2017-09-28 12:45:20.580 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:45:20] "OPTIONS / HTTP/1.0" 200 262 0.000587
Sep 28 12:45:20 ctl02 neutron-server[30536]: 2017-09-28 12:45:20.609 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:45:20] "OPTIONS / HTTP/1.0" 200 262 0.000477
Sep 28 12:45:20 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:45:20 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:45:20 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:45:20 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:45:21 ctl02 glance-api[29183]: 2017-09-28 12:45:21.245 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:45:21] "OPTIONS / HTTP/1.0" 200 134 0.000611
Sep 28 12:45:21 ctl02 neutron-server[30536]: 2017-09-28 12:45:21.262 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 2 dead agents out of 6:
Sep 28 12:45:21 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:45:21 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:43:28 cmp001
Sep 28 12:45:21 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:43:56 cmp002
Sep 28 12:45:21 ctl02 glance-api[29183]: 2017-09-28 12:45:21.849 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:45:21] "OPTIONS / HTTP/1.0" 200 134 0.000521
Sep 28 12:45:22 ctl02 nova-api[7791]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:45:22 ctl02 nova-api[7791]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:45:22 ctl02 heat-api-cfn[13300]: 2017-09-28 12:45:22.431 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:45:22] "OPTIONS / HTTP/1.0" 200 134 0.000451
Sep 28 12:45:22 ctl02 nova-api[7791]: 2017-09-28 12:45:22.464 7791 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:45:22 ctl02 nova-api[7791]: 2017-09-28 12:45:22.466 7791 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:45:22 ctl02 nova-api[7791]: 2017-09-28 12:45:22.466 7791 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:45:22 ctl02 nova-api[7791]: 2017-09-28 12:45:22.466 7791 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:45:22 ctl02 nova-api[7791]: 2017-09-28 12:45:22.466 7791 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:45:22 ctl02 nova-api[7791]: 2017-09-28 12:45:22.466 7791 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:45:22 ctl02 nova-api[7791]: 2017-09-28 12:45:22.466 7791 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:45:22 ctl02 nova-api[7791]: 2017-09-28 12:45:22.466 7791 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:45:22 ctl02 nova-api[7791]: 2017-09-28 12:45:22.466 7791 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:45:22 ctl02 nova-api[7791]: 2017-09-28 12:45:22.466 7791 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:45:22 ctl02 nova-api[7791]: 2017-09-28 12:45:22.466 7791 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:45:22 ctl02 nova-api[7791]: 2017-09-28 12:45:22.466 7791 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:45:22 ctl02 nova-api[7791]: 2017-09-28 12:45:22.466 7791 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:45:22 ctl02 nova-api[7791]: 2017-09-28 12:45:22.466 7791 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:45:22 ctl02 nova-api[7791]: 2017-09-28 12:45:22.466 7791 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:45:22 ctl02 nova-api[7791]: 2017-09-28 12:45:22.466 7791 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:45:22 ctl02 nova-api[7791]: 2017-09-28 12:45:22.466 7791 ERROR nova.wsgi     self.filename))
Sep 28 12:45:22 ctl02 nova-api[7791]: 2017-09-28 12:45:22.466 7791 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:45:22 ctl02 nova-api[7791]: 2017-09-28 12:45:22.466 7791 ERROR nova.wsgi
Sep 28 12:45:22 ctl02 nova-api[7791]: 2017-09-28 12:45:22.468 7791 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:45:22 ctl02 nova-api[7791]: 2017-09-28 12:45:22.595 7791 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:45:22 ctl02 nova-api[7791]: 2017-09-28 12:45:22.818 7791 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:45:22 ctl02 nova-api[7791]: 2017-09-28 12:45:22.820 7791 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:45:22 ctl02 nova-api[7791]: 2017-09-28 12:45:22.820 7791 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:45:22 ctl02 nova-api[7791]: 2017-09-28 12:45:22.821 7791 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:45:22 ctl02 nova-api[7791]: 2017-09-28 12:45:22.949 7791 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:45:22 ctl02 nova-api[7791]: 2017-09-28 12:45:22.951 7791 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:45:22 ctl02 nova-api[7791]: 2017-09-28 12:45:22.951 7791 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:45:22 ctl02 nova-api[7791]: 2017-09-28 12:45:22.951 7791 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:45:22 ctl02 nova-api[7791]: 2017-09-28 12:45:22.954 7791 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:45:22 ctl02 nova-api[7791]: 2017-09-28 12:45:22.955 7791 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:45:22 ctl02 nova-api[7791]: 2017-09-28 12:45:22.955 7791 ERROR nova Traceback (most recent call last):
Sep 28 12:45:22 ctl02 nova-api[7791]: 2017-09-28 12:45:22.955 7791 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:45:22 ctl02 nova-api[7791]: 2017-09-28 12:45:22.955 7791 ERROR nova     sys.exit(main())
Sep 28 12:45:22 ctl02 nova-api[7791]: 2017-09-28 12:45:22.955 7791 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:45:22 ctl02 nova-api[7791]: 2017-09-28 12:45:22.955 7791 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:45:22 ctl02 nova-api[7791]: 2017-09-28 12:45:22.955 7791 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:45:22 ctl02 nova-api[7791]: 2017-09-28 12:45:22.955 7791 ERROR nova     max_url_len=max_url_len)
Sep 28 12:45:22 ctl02 nova-api[7791]: 2017-09-28 12:45:22.955 7791 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:45:22 ctl02 nova-api[7791]: 2017-09-28 12:45:22.955 7791 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:45:22 ctl02 nova-api[7791]: 2017-09-28 12:45:22.955 7791 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:45:22 ctl02 nova-api[7791]: 2017-09-28 12:45:22.955 7791 ERROR nova     sock.listen(backlog)
Sep 28 12:45:22 ctl02 nova-api[7791]: 2017-09-28 12:45:22.955 7791 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:45:22 ctl02 nova-api[7791]: 2017-09-28 12:45:22.955 7791 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:45:22 ctl02 nova-api[7791]: 2017-09-28 12:45:22.955 7791 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:45:22 ctl02 nova-api[7791]: 2017-09-28 12:45:22.955 7791 ERROR nova
Sep 28 12:45:23 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:45:23 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:45:23 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:45:23 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:45:23 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:45:23 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:45:23 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:45:24 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:45:24.776 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:45:24] "OPTIONS / HTTP/1.0" 200 134 0.000345
Sep 28 12:45:25 ctl02 nova-api[7808]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:45:25 ctl02 nova-api[7808]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:45:25 ctl02 nova-api[7808]: 2017-09-28 12:45:25.263 7808 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:45:25 ctl02 nova-api[7808]: 2017-09-28 12:45:25.264 7808 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:45:25 ctl02 nova-api[7808]: 2017-09-28 12:45:25.264 7808 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:45:25 ctl02 nova-api[7808]: 2017-09-28 12:45:25.264 7808 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:45:25 ctl02 nova-api[7808]: 2017-09-28 12:45:25.264 7808 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:45:25 ctl02 nova-api[7808]: 2017-09-28 12:45:25.264 7808 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:45:25 ctl02 nova-api[7808]: 2017-09-28 12:45:25.264 7808 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:45:25 ctl02 nova-api[7808]: 2017-09-28 12:45:25.264 7808 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:45:25 ctl02 nova-api[7808]: 2017-09-28 12:45:25.264 7808 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:45:25 ctl02 nova-api[7808]: 2017-09-28 12:45:25.264 7808 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:45:25 ctl02 nova-api[7808]: 2017-09-28 12:45:25.264 7808 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:45:25 ctl02 nova-api[7808]: 2017-09-28 12:45:25.264 7808 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:45:25 ctl02 nova-api[7808]: 2017-09-28 12:45:25.264 7808 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:45:25 ctl02 nova-api[7808]: 2017-09-28 12:45:25.264 7808 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:45:25 ctl02 nova-api[7808]: 2017-09-28 12:45:25.264 7808 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:45:25 ctl02 nova-api[7808]: 2017-09-28 12:45:25.264 7808 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:45:25 ctl02 nova-api[7808]: 2017-09-28 12:45:25.264 7808 ERROR nova.wsgi     self.filename))
Sep 28 12:45:25 ctl02 nova-api[7808]: 2017-09-28 12:45:25.264 7808 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:45:25 ctl02 nova-api[7808]: 2017-09-28 12:45:25.264 7808 ERROR nova.wsgi
Sep 28 12:45:25 ctl02 nova-api[7808]: 2017-09-28 12:45:25.265 7808 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:45:25 ctl02 nova-api[7808]: 2017-09-28 12:45:25.399 7808 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:45:25 ctl02 nova-api[7808]: 2017-09-28 12:45:25.634 7808 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:45:25 ctl02 nova-api[7808]: 2017-09-28 12:45:25.636 7808 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:45:25 ctl02 nova-api[7808]: 2017-09-28 12:45:25.637 7808 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:45:25 ctl02 nova-api[7808]: 2017-09-28 12:45:25.637 7808 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:45:25 ctl02 nova-api[7808]: 2017-09-28 12:45:25.767 7808 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:45:25 ctl02 nova-api[7808]: 2017-09-28 12:45:25.769 7808 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:45:25 ctl02 nova-api[7808]: 2017-09-28 12:45:25.769 7808 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:45:25 ctl02 nova-api[7808]: 2017-09-28 12:45:25.770 7808 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:45:25 ctl02 nova-api[7808]: 2017-09-28 12:45:25.773 7808 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:45:25 ctl02 nova-api[7808]: 2017-09-28 12:45:25.774 7808 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:45:25 ctl02 nova-api[7808]: 2017-09-28 12:45:25.774 7808 ERROR nova Traceback (most recent call last):
Sep 28 12:45:25 ctl02 nova-api[7808]: 2017-09-28 12:45:25.774 7808 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:45:25 ctl02 nova-api[7808]: 2017-09-28 12:45:25.774 7808 ERROR nova     sys.exit(main())
Sep 28 12:45:25 ctl02 nova-api[7808]: 2017-09-28 12:45:25.774 7808 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:45:25 ctl02 nova-api[7808]: 2017-09-28 12:45:25.774 7808 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:45:25 ctl02 nova-api[7808]: 2017-09-28 12:45:25.774 7808 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:45:25 ctl02 nova-api[7808]: 2017-09-28 12:45:25.774 7808 ERROR nova     max_url_len=max_url_len)
Sep 28 12:45:25 ctl02 nova-api[7808]: 2017-09-28 12:45:25.774 7808 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:45:25 ctl02 nova-api[7808]: 2017-09-28 12:45:25.774 7808 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:45:25 ctl02 nova-api[7808]: 2017-09-28 12:45:25.774 7808 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:45:25 ctl02 nova-api[7808]: 2017-09-28 12:45:25.774 7808 ERROR nova     sock.listen(backlog)
Sep 28 12:45:25 ctl02 nova-api[7808]: 2017-09-28 12:45:25.774 7808 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:45:25 ctl02 nova-api[7808]: 2017-09-28 12:45:25.774 7808 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:45:25 ctl02 nova-api[7808]: 2017-09-28 12:45:25.774 7808 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:45:25 ctl02 nova-api[7808]: 2017-09-28 12:45:25.774 7808 ERROR nova
Sep 28 12:45:25 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:45:25 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:45:25 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:45:25 ctl02 heat-api[13008]: 2017-09-28 12:45:25.930 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:45:25] "OPTIONS / HTTP/1.0" 200 134 0.000692
Sep 28 12:45:26 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:45:26 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:45:26 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:45:26 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:45:26 ctl02 nova-cert[4860]: 2017-09-28 12:45:26.806 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:45:26 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:45:26.862 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:45:26] "OPTIONS / HTTP/1.0" 200 134 0.000355
Sep 28 12:45:26 ctl02 nova-conductor[5056]: 2017-09-28 12:45:26.983 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:45:27 ctl02 nova-conductor[5056]: 2017-09-28 12:45:27.008 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:45:27 ctl02 nova-conductor[5056]: 2017-09-28 12:45:27.026 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:45:27 ctl02 nova-conductor[5056]: 2017-09-28 12:45:27.031 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:45:27 ctl02 heat-api[13008]: 2017-09-28 12:45:27.060 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:45:27] "OPTIONS / HTTP/1.0" 200 134 0.000518
Sep 28 12:45:27 ctl02 heat-api-cfn[13300]: 2017-09-28 12:45:27.134 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:45:27] "OPTIONS / HTTP/1.0" 200 134 0.000412
Sep 28 12:45:27 ctl02 heat-api-cfn[13300]: 2017-09-28 12:45:27.717 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:45:27] "OPTIONS / HTTP/1.0" 200 134 0.000514
Sep 28 12:45:27 ctl02 nova-api[7827]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:45:27 ctl02 nova-api[7827]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:45:27 ctl02 heat-api[13008]: 2017-09-28 12:45:27.909 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:45:27] "OPTIONS / HTTP/1.0" 200 134 0.000587
Sep 28 12:45:27 ctl02 nova-api[7827]: 2017-09-28 12:45:27.987 7827 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:45:27 ctl02 nova-api[7827]: 2017-09-28 12:45:27.988 7827 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:45:27 ctl02 nova-api[7827]: 2017-09-28 12:45:27.988 7827 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:45:27 ctl02 nova-api[7827]: 2017-09-28 12:45:27.988 7827 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:45:27 ctl02 nova-api[7827]: 2017-09-28 12:45:27.988 7827 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:45:27 ctl02 nova-api[7827]: 2017-09-28 12:45:27.988 7827 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:45:27 ctl02 nova-api[7827]: 2017-09-28 12:45:27.988 7827 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:45:27 ctl02 nova-api[7827]: 2017-09-28 12:45:27.988 7827 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:45:27 ctl02 nova-api[7827]: 2017-09-28 12:45:27.988 7827 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:45:27 ctl02 nova-api[7827]: 2017-09-28 12:45:27.988 7827 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:45:27 ctl02 nova-api[7827]: 2017-09-28 12:45:27.988 7827 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:45:27 ctl02 nova-api[7827]: 2017-09-28 12:45:27.988 7827 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:45:27 ctl02 nova-api[7827]: 2017-09-28 12:45:27.988 7827 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:45:27 ctl02 nova-api[7827]: 2017-09-28 12:45:27.988 7827 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:45:27 ctl02 nova-api[7827]: 2017-09-28 12:45:27.988 7827 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:45:27 ctl02 nova-api[7827]: 2017-09-28 12:45:27.988 7827 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:45:27 ctl02 nova-api[7827]: 2017-09-28 12:45:27.988 7827 ERROR nova.wsgi     self.filename))
Sep 28 12:45:27 ctl02 nova-api[7827]: 2017-09-28 12:45:27.988 7827 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:45:27 ctl02 nova-api[7827]: 2017-09-28 12:45:27.988 7827 ERROR nova.wsgi
Sep 28 12:45:27 ctl02 nova-api[7827]: 2017-09-28 12:45:27.989 7827 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:45:28 ctl02 nova-api[7827]: 2017-09-28 12:45:28.115 7827 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:45:28 ctl02 nova-api[7827]: 2017-09-28 12:45:28.343 7827 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:45:28 ctl02 nova-api[7827]: 2017-09-28 12:45:28.345 7827 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:45:28 ctl02 nova-api[7827]: 2017-09-28 12:45:28.345 7827 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:45:28 ctl02 nova-api[7827]: 2017-09-28 12:45:28.346 7827 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:45:28 ctl02 nova-api[7827]: 2017-09-28 12:45:28.474 7827 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:45:28 ctl02 nova-api[7827]: 2017-09-28 12:45:28.476 7827 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:45:28 ctl02 nova-api[7827]: 2017-09-28 12:45:28.476 7827 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:45:28 ctl02 nova-api[7827]: 2017-09-28 12:45:28.477 7827 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:45:28 ctl02 nova-api[7827]: 2017-09-28 12:45:28.480 7827 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:45:28 ctl02 nova-api[7827]: 2017-09-28 12:45:28.480 7827 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:45:28 ctl02 nova-api[7827]: 2017-09-28 12:45:28.480 7827 ERROR nova Traceback (most recent call last):
Sep 28 12:45:28 ctl02 nova-api[7827]: 2017-09-28 12:45:28.480 7827 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:45:28 ctl02 nova-api[7827]: 2017-09-28 12:45:28.480 7827 ERROR nova     sys.exit(main())
Sep 28 12:45:28 ctl02 nova-api[7827]: 2017-09-28 12:45:28.480 7827 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:45:28 ctl02 nova-api[7827]: 2017-09-28 12:45:28.480 7827 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:45:28 ctl02 nova-api[7827]: 2017-09-28 12:45:28.480 7827 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:45:28 ctl02 nova-api[7827]: 2017-09-28 12:45:28.480 7827 ERROR nova     max_url_len=max_url_len)
Sep 28 12:45:28 ctl02 nova-api[7827]: 2017-09-28 12:45:28.480 7827 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:45:28 ctl02 nova-api[7827]: 2017-09-28 12:45:28.480 7827 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:45:28 ctl02 nova-api[7827]: 2017-09-28 12:45:28.480 7827 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:45:28 ctl02 nova-api[7827]: 2017-09-28 12:45:28.480 7827 ERROR nova     sock.listen(backlog)
Sep 28 12:45:28 ctl02 nova-api[7827]: 2017-09-28 12:45:28.480 7827 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:45:28 ctl02 nova-api[7827]: 2017-09-28 12:45:28.480 7827 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:45:28 ctl02 nova-api[7827]: 2017-09-28 12:45:28.480 7827 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:45:28 ctl02 nova-api[7827]: 2017-09-28 12:45:28.480 7827 ERROR nova
Sep 28 12:45:28 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:45:28 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:45:28 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:45:28 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:45:28 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:45:28 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:45:28 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:45:29 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:45:29.032 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:45:29] "OPTIONS / HTTP/1.0" 200 134 0.000366
Sep 28 12:45:29 ctl02 neutron-server[30536]: 2017-09-28 12:45:29.822 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:45:29] "OPTIONS / HTTP/1.0" 200 262 0.000469
Sep 28 12:45:30 ctl02 neutron-server[30536]: 2017-09-28 12:45:30.523 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:45:30] "OPTIONS / HTTP/1.0" 200 262 0.000422
Sep 28 12:45:30 ctl02 nova-api[7844]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:45:30 ctl02 nova-api[7844]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:45:30 ctl02 neutron-server[30536]: 2017-09-28 12:45:30.653 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:45:30] "OPTIONS / HTTP/1.0" 200 262 0.000530
Sep 28 12:45:30 ctl02 glance-api[29183]: 2017-09-28 12:45:30.735 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:45:30] "OPTIONS / HTTP/1.0" 200 134 0.000582
Sep 28 12:45:30 ctl02 nova-api[7844]: 2017-09-28 12:45:30.748 7844 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:45:30 ctl02 nova-api[7844]: 2017-09-28 12:45:30.750 7844 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:45:30 ctl02 nova-api[7844]: 2017-09-28 12:45:30.750 7844 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:45:30 ctl02 nova-api[7844]: 2017-09-28 12:45:30.750 7844 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:45:30 ctl02 nova-api[7844]: 2017-09-28 12:45:30.750 7844 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:45:30 ctl02 nova-api[7844]: 2017-09-28 12:45:30.750 7844 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:45:30 ctl02 nova-api[7844]: 2017-09-28 12:45:30.750 7844 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:45:30 ctl02 nova-api[7844]: 2017-09-28 12:45:30.750 7844 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:45:30 ctl02 nova-api[7844]: 2017-09-28 12:45:30.750 7844 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:45:30 ctl02 nova-api[7844]: 2017-09-28 12:45:30.750 7844 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:45:30 ctl02 nova-api[7844]: 2017-09-28 12:45:30.750 7844 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:45:30 ctl02 nova-api[7844]: 2017-09-28 12:45:30.750 7844 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:45:30 ctl02 nova-api[7844]: 2017-09-28 12:45:30.750 7844 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:45:30 ctl02 nova-api[7844]: 2017-09-28 12:45:30.750 7844 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:45:30 ctl02 nova-api[7844]: 2017-09-28 12:45:30.750 7844 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:45:30 ctl02 nova-api[7844]: 2017-09-28 12:45:30.750 7844 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:45:30 ctl02 nova-api[7844]: 2017-09-28 12:45:30.750 7844 ERROR nova.wsgi     self.filename))
Sep 28 12:45:30 ctl02 nova-api[7844]: 2017-09-28 12:45:30.750 7844 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:45:30 ctl02 nova-api[7844]: 2017-09-28 12:45:30.750 7844 ERROR nova.wsgi
Sep 28 12:45:30 ctl02 nova-api[7844]: 2017-09-28 12:45:30.752 7844 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:45:30 ctl02 nova-api[7844]: 2017-09-28 12:45:30.882 7844 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:45:31 ctl02 nova-api[7844]: 2017-09-28 12:45:31.131 7844 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:45:31 ctl02 nova-api[7844]: 2017-09-28 12:45:31.134 7844 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:45:31 ctl02 nova-api[7844]: 2017-09-28 12:45:31.135 7844 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:45:31 ctl02 nova-api[7844]: 2017-09-28 12:45:31.135 7844 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:45:31 ctl02 nova-api[7844]: 2017-09-28 12:45:31.272 7844 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:45:31 ctl02 nova-api[7844]: 2017-09-28 12:45:31.274 7844 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:45:31 ctl02 nova-api[7844]: 2017-09-28 12:45:31.275 7844 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:45:31 ctl02 nova-api[7844]: 2017-09-28 12:45:31.275 7844 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:45:31 ctl02 nova-api[7844]: 2017-09-28 12:45:31.279 7844 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:45:31 ctl02 nova-api[7844]: 2017-09-28 12:45:31.279 7844 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:45:31 ctl02 nova-api[7844]: 2017-09-28 12:45:31.279 7844 ERROR nova Traceback (most recent call last):
Sep 28 12:45:31 ctl02 nova-api[7844]: 2017-09-28 12:45:31.279 7844 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:45:31 ctl02 nova-api[7844]: 2017-09-28 12:45:31.279 7844 ERROR nova     sys.exit(main())
Sep 28 12:45:31 ctl02 nova-api[7844]: 2017-09-28 12:45:31.279 7844 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:45:31 ctl02 nova-api[7844]: 2017-09-28 12:45:31.279 7844 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:45:31 ctl02 nova-api[7844]: 2017-09-28 12:45:31.279 7844 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:45:31 ctl02 nova-api[7844]: 2017-09-28 12:45:31.279 7844 ERROR nova     max_url_len=max_url_len)
Sep 28 12:45:31 ctl02 nova-api[7844]: 2017-09-28 12:45:31.279 7844 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:45:31 ctl02 nova-api[7844]: 2017-09-28 12:45:31.279 7844 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:45:31 ctl02 nova-api[7844]: 2017-09-28 12:45:31.279 7844 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:45:31 ctl02 nova-api[7844]: 2017-09-28 12:45:31.279 7844 ERROR nova     sock.listen(backlog)
Sep 28 12:45:31 ctl02 nova-api[7844]: 2017-09-28 12:45:31.279 7844 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:45:31 ctl02 nova-api[7844]: 2017-09-28 12:45:31.279 7844 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:45:31 ctl02 nova-api[7844]: 2017-09-28 12:45:31.279 7844 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:45:31 ctl02 nova-api[7844]: 2017-09-28 12:45:31.279 7844 ERROR nova
Sep 28 12:45:31 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:45:31 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:45:31 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:45:31 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:45:31 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:45:31 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:45:31 ctl02 glance-api[29183]: 2017-09-28 12:45:31.643 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:45:31] "OPTIONS / HTTP/1.0" 200 134 0.000706
Sep 28 12:45:31 ctl02 glance-api[29183]: 2017-09-28 12:45:31.690 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:45:31] "OPTIONS / HTTP/1.0" 200 134 0.000540
Sep 28 12:45:31 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:45:32 ctl02 heat-api-cfn[13300]: 2017-09-28 12:45:32.256 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:45:32] "OPTIONS / HTTP/1.0" 200 134 0.000460
Sep 28 12:45:33 ctl02 nova-api[7863]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:45:33 ctl02 nova-api[7863]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:45:33 ctl02 nova-api[7863]: 2017-09-28 12:45:33.527 7863 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:45:33 ctl02 nova-api[7863]: 2017-09-28 12:45:33.529 7863 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:45:33 ctl02 nova-api[7863]: 2017-09-28 12:45:33.529 7863 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:45:33 ctl02 nova-api[7863]: 2017-09-28 12:45:33.529 7863 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:45:33 ctl02 nova-api[7863]: 2017-09-28 12:45:33.529 7863 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:45:33 ctl02 nova-api[7863]: 2017-09-28 12:45:33.529 7863 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:45:33 ctl02 nova-api[7863]: 2017-09-28 12:45:33.529 7863 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:45:33 ctl02 nova-api[7863]: 2017-09-28 12:45:33.529 7863 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:45:33 ctl02 nova-api[7863]: 2017-09-28 12:45:33.529 7863 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:45:33 ctl02 nova-api[7863]: 2017-09-28 12:45:33.529 7863 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:45:33 ctl02 nova-api[7863]: 2017-09-28 12:45:33.529 7863 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:45:33 ctl02 nova-api[7863]: 2017-09-28 12:45:33.529 7863 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:45:33 ctl02 nova-api[7863]: 2017-09-28 12:45:33.529 7863 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:45:33 ctl02 nova-api[7863]: 2017-09-28 12:45:33.529 7863 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:45:33 ctl02 nova-api[7863]: 2017-09-28 12:45:33.529 7863 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:45:33 ctl02 nova-api[7863]: 2017-09-28 12:45:33.529 7863 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:45:33 ctl02 nova-api[7863]: 2017-09-28 12:45:33.529 7863 ERROR nova.wsgi     self.filename))
Sep 28 12:45:33 ctl02 nova-api[7863]: 2017-09-28 12:45:33.529 7863 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:45:33 ctl02 nova-api[7863]: 2017-09-28 12:45:33.529 7863 ERROR nova.wsgi
Sep 28 12:45:33 ctl02 nova-api[7863]: 2017-09-28 12:45:33.529 7863 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:45:33 ctl02 nova-api[7863]: 2017-09-28 12:45:33.657 7863 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:45:33 ctl02 nova-api[7863]: 2017-09-28 12:45:33.887 7863 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:45:33 ctl02 nova-api[7863]: 2017-09-28 12:45:33.889 7863 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:45:33 ctl02 nova-api[7863]: 2017-09-28 12:45:33.889 7863 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:45:33 ctl02 nova-api[7863]: 2017-09-28 12:45:33.889 7863 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:45:34 ctl02 nova-api[7863]: 2017-09-28 12:45:34.019 7863 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:45:34 ctl02 nova-api[7863]: 2017-09-28 12:45:34.021 7863 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:45:34 ctl02 nova-api[7863]: 2017-09-28 12:45:34.021 7863 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:45:34 ctl02 nova-api[7863]: 2017-09-28 12:45:34.021 7863 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:45:34 ctl02 nova-api[7863]: 2017-09-28 12:45:34.025 7863 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:45:34 ctl02 nova-api[7863]: 2017-09-28 12:45:34.025 7863 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:45:34 ctl02 nova-api[7863]: 2017-09-28 12:45:34.025 7863 ERROR nova Traceback (most recent call last):
Sep 28 12:45:34 ctl02 nova-api[7863]: 2017-09-28 12:45:34.025 7863 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:45:34 ctl02 nova-api[7863]: 2017-09-28 12:45:34.025 7863 ERROR nova     sys.exit(main())
Sep 28 12:45:34 ctl02 nova-api[7863]: 2017-09-28 12:45:34.025 7863 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:45:34 ctl02 nova-api[7863]: 2017-09-28 12:45:34.025 7863 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:45:34 ctl02 nova-api[7863]: 2017-09-28 12:45:34.025 7863 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:45:34 ctl02 nova-api[7863]: 2017-09-28 12:45:34.025 7863 ERROR nova     max_url_len=max_url_len)
Sep 28 12:45:34 ctl02 nova-api[7863]: 2017-09-28 12:45:34.025 7863 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:45:34 ctl02 nova-api[7863]: 2017-09-28 12:45:34.025 7863 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:45:34 ctl02 nova-api[7863]: 2017-09-28 12:45:34.025 7863 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:45:34 ctl02 nova-api[7863]: 2017-09-28 12:45:34.025 7863 ERROR nova     sock.listen(backlog)
Sep 28 12:45:34 ctl02 nova-api[7863]: 2017-09-28 12:45:34.025 7863 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:45:34 ctl02 nova-api[7863]: 2017-09-28 12:45:34.025 7863 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:45:34 ctl02 nova-api[7863]: 2017-09-28 12:45:34.025 7863 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:45:34 ctl02 nova-api[7863]: 2017-09-28 12:45:34.025 7863 ERROR nova
Sep 28 12:45:34 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:45:34 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:45:34 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:45:34 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:45:34 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:45:34 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:45:34 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:45:34 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:45:34.533 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:45:34] "OPTIONS / HTTP/1.0" 200 134 0.000412
Sep 28 12:45:35 ctl02 heat-api[13008]: 2017-09-28 12:45:35.706 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:45:35] "OPTIONS / HTTP/1.0" 200 134 0.000526
Sep 28 12:45:36 ctl02 nova-api[7881]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:45:36 ctl02 nova-api[7881]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:45:36 ctl02 nova-api[7881]: 2017-09-28 12:45:36.228 7881 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:45:36 ctl02 nova-api[7881]: 2017-09-28 12:45:36.229 7881 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:45:36 ctl02 nova-api[7881]: 2017-09-28 12:45:36.229 7881 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:45:36 ctl02 nova-api[7881]: 2017-09-28 12:45:36.229 7881 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:45:36 ctl02 nova-api[7881]: 2017-09-28 12:45:36.229 7881 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:45:36 ctl02 nova-api[7881]: 2017-09-28 12:45:36.229 7881 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:45:36 ctl02 nova-api[7881]: 2017-09-28 12:45:36.229 7881 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:45:36 ctl02 nova-api[7881]: 2017-09-28 12:45:36.229 7881 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:45:36 ctl02 nova-api[7881]: 2017-09-28 12:45:36.229 7881 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:45:36 ctl02 nova-api[7881]: 2017-09-28 12:45:36.229 7881 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:45:36 ctl02 nova-api[7881]: 2017-09-28 12:45:36.229 7881 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:45:36 ctl02 nova-api[7881]: 2017-09-28 12:45:36.229 7881 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:45:36 ctl02 nova-api[7881]: 2017-09-28 12:45:36.229 7881 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:45:36 ctl02 nova-api[7881]: 2017-09-28 12:45:36.229 7881 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:45:36 ctl02 nova-api[7881]: 2017-09-28 12:45:36.229 7881 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:45:36 ctl02 nova-api[7881]: 2017-09-28 12:45:36.229 7881 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:45:36 ctl02 nova-api[7881]: 2017-09-28 12:45:36.229 7881 ERROR nova.wsgi     self.filename))
Sep 28 12:45:36 ctl02 nova-api[7881]: 2017-09-28 12:45:36.229 7881 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:45:36 ctl02 nova-api[7881]: 2017-09-28 12:45:36.229 7881 ERROR nova.wsgi
Sep 28 12:45:36 ctl02 nova-api[7881]: 2017-09-28 12:45:36.230 7881 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:45:36 ctl02 neutron-server[30536]: 2017-09-28 12:45:36.259 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 2 dead agents out of 6:
Sep 28 12:45:36 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:45:36 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:44:56 cmp002
Sep 28 12:45:36 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:43:56 cmp002
Sep 28 12:45:36 ctl02 nova-api[7881]: 2017-09-28 12:45:36.358 7881 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:45:36 ctl02 nova-api[7881]: 2017-09-28 12:45:36.582 7881 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:45:36 ctl02 nova-api[7881]: 2017-09-28 12:45:36.584 7881 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:45:36 ctl02 nova-api[7881]: 2017-09-28 12:45:36.584 7881 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:45:36 ctl02 nova-api[7881]: 2017-09-28 12:45:36.585 7881 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:45:36 ctl02 nova-consoleauth[5433]: 2017-09-28 12:45:36.656 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:45:36 ctl02 nova-api[7881]: 2017-09-28 12:45:36.716 7881 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:45:36 ctl02 nova-api[7881]: 2017-09-28 12:45:36.717 7881 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:45:36 ctl02 nova-api[7881]: 2017-09-28 12:45:36.718 7881 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:45:36 ctl02 nova-api[7881]: 2017-09-28 12:45:36.718 7881 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:45:36 ctl02 nova-api[7881]: 2017-09-28 12:45:36.722 7881 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:45:36 ctl02 nova-api[7881]: 2017-09-28 12:45:36.722 7881 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:45:36 ctl02 nova-api[7881]: 2017-09-28 12:45:36.722 7881 ERROR nova Traceback (most recent call last):
Sep 28 12:45:36 ctl02 nova-api[7881]: 2017-09-28 12:45:36.722 7881 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:45:36 ctl02 nova-api[7881]: 2017-09-28 12:45:36.722 7881 ERROR nova     sys.exit(main())
Sep 28 12:45:36 ctl02 nova-api[7881]: 2017-09-28 12:45:36.722 7881 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:45:36 ctl02 nova-api[7881]: 2017-09-28 12:45:36.722 7881 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:45:36 ctl02 nova-api[7881]: 2017-09-28 12:45:36.722 7881 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:45:36 ctl02 nova-api[7881]: 2017-09-28 12:45:36.722 7881 ERROR nova     max_url_len=max_url_len)
Sep 28 12:45:36 ctl02 nova-api[7881]: 2017-09-28 12:45:36.722 7881 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:45:36 ctl02 nova-api[7881]: 2017-09-28 12:45:36.722 7881 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:45:36 ctl02 nova-api[7881]: 2017-09-28 12:45:36.722 7881 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:45:36 ctl02 nova-api[7881]: 2017-09-28 12:45:36.722 7881 ERROR nova     sock.listen(backlog)
Sep 28 12:45:36 ctl02 nova-api[7881]: 2017-09-28 12:45:36.722 7881 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:45:36 ctl02 nova-api[7881]: 2017-09-28 12:45:36.722 7881 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:45:36 ctl02 nova-api[7881]: 2017-09-28 12:45:36.722 7881 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:45:36 ctl02 nova-api[7881]: 2017-09-28 12:45:36.722 7881 ERROR nova
Sep 28 12:45:36 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:45:36 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:45:36 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:45:36 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:45:36.922 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:45:36] "OPTIONS / HTTP/1.0" 200 134 0.000405
Sep 28 12:45:36 ctl02 heat-api-cfn[13300]: 2017-09-28 12:45:36.943 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:45:36] "OPTIONS / HTTP/1.0" 200 134 0.000455
Sep 28 12:45:37 ctl02 heat-api[13008]: 2017-09-28 12:45:37.006 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:45:37] "OPTIONS / HTTP/1.0" 200 134 0.000740
Sep 28 12:45:37 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:45:37 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:45:37 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:45:37 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:45:37 ctl02 heat-api[13008]: 2017-09-28 12:45:37.534 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:45:37] "OPTIONS / HTTP/1.0" 200 134 0.000551
Sep 28 12:45:37 ctl02 heat-api-cfn[13300]: 2017-09-28 12:45:37.952 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:45:37] "OPTIONS / HTTP/1.0" 200 134 0.000456
Sep 28 12:45:38 ctl02 heat-engine[12803]: 2017-09-28 12:45:38.129 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:45:38 ctl02 heat-engine[12803]: 2017-09-28 12:45:38.139 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:45:38 ctl02 heat-engine[12803]: 2017-09-28 12:45:38.141 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:45:38 ctl02 heat-engine[12803]: 2017-09-28 12:45:38.153 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:45:38 ctl02 nova-api[7899]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:45:38 ctl02 nova-api[7899]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:45:38 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:45:38.843 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:45:38] "OPTIONS / HTTP/1.0" 200 134 0.000400
Sep 28 12:45:38 ctl02 nova-api[7899]: 2017-09-28 12:45:38.987 7899 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:45:38 ctl02 nova-api[7899]: 2017-09-28 12:45:38.988 7899 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:45:38 ctl02 nova-api[7899]: 2017-09-28 12:45:38.988 7899 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:45:38 ctl02 nova-api[7899]: 2017-09-28 12:45:38.988 7899 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:45:38 ctl02 nova-api[7899]: 2017-09-28 12:45:38.988 7899 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:45:38 ctl02 nova-api[7899]: 2017-09-28 12:45:38.988 7899 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:45:38 ctl02 nova-api[7899]: 2017-09-28 12:45:38.988 7899 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:45:38 ctl02 nova-api[7899]: 2017-09-28 12:45:38.988 7899 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:45:38 ctl02 nova-api[7899]: 2017-09-28 12:45:38.988 7899 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:45:38 ctl02 nova-api[7899]: 2017-09-28 12:45:38.988 7899 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:45:38 ctl02 nova-api[7899]: 2017-09-28 12:45:38.988 7899 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:45:38 ctl02 nova-api[7899]: 2017-09-28 12:45:38.988 7899 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:45:38 ctl02 nova-api[7899]: 2017-09-28 12:45:38.988 7899 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:45:38 ctl02 nova-api[7899]: 2017-09-28 12:45:38.988 7899 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:45:38 ctl02 nova-api[7899]: 2017-09-28 12:45:38.988 7899 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:45:38 ctl02 nova-api[7899]: 2017-09-28 12:45:38.988 7899 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:45:38 ctl02 nova-api[7899]: 2017-09-28 12:45:38.988 7899 ERROR nova.wsgi     self.filename))
Sep 28 12:45:38 ctl02 nova-api[7899]: 2017-09-28 12:45:38.988 7899 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:45:38 ctl02 nova-api[7899]: 2017-09-28 12:45:38.988 7899 ERROR nova.wsgi
Sep 28 12:45:38 ctl02 nova-api[7899]: 2017-09-28 12:45:38.989 7899 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:45:39 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xbaf96602)
Sep 28 12:45:39 ctl02 nova-api[7899]: 2017-09-28 12:45:39.118 7899 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:45:39 ctl02 nova-api[7899]: 2017-09-28 12:45:39.349 7899 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:45:39 ctl02 nova-api[7899]: 2017-09-28 12:45:39.352 7899 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:45:39 ctl02 nova-api[7899]: 2017-09-28 12:45:39.352 7899 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:45:39 ctl02 nova-api[7899]: 2017-09-28 12:45:39.352 7899 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:45:39 ctl02 nova-api[7899]: 2017-09-28 12:45:39.487 7899 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:45:39 ctl02 nova-api[7899]: 2017-09-28 12:45:39.489 7899 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:45:39 ctl02 nova-api[7899]: 2017-09-28 12:45:39.489 7899 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:45:39 ctl02 nova-api[7899]: 2017-09-28 12:45:39.490 7899 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:45:39 ctl02 nova-api[7899]: 2017-09-28 12:45:39.493 7899 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:45:39 ctl02 nova-api[7899]: 2017-09-28 12:45:39.493 7899 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:45:39 ctl02 nova-api[7899]: 2017-09-28 12:45:39.493 7899 ERROR nova Traceback (most recent call last):
Sep 28 12:45:39 ctl02 nova-api[7899]: 2017-09-28 12:45:39.493 7899 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:45:39 ctl02 nova-api[7899]: 2017-09-28 12:45:39.493 7899 ERROR nova     sys.exit(main())
Sep 28 12:45:39 ctl02 nova-api[7899]: 2017-09-28 12:45:39.493 7899 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:45:39 ctl02 nova-api[7899]: 2017-09-28 12:45:39.493 7899 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:45:39 ctl02 nova-api[7899]: 2017-09-28 12:45:39.493 7899 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:45:39 ctl02 nova-api[7899]: 2017-09-28 12:45:39.493 7899 ERROR nova     max_url_len=max_url_len)
Sep 28 12:45:39 ctl02 nova-api[7899]: 2017-09-28 12:45:39.493 7899 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:45:39 ctl02 nova-api[7899]: 2017-09-28 12:45:39.493 7899 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:45:39 ctl02 nova-api[7899]: 2017-09-28 12:45:39.493 7899 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:45:39 ctl02 nova-api[7899]: 2017-09-28 12:45:39.493 7899 ERROR nova     sock.listen(backlog)
Sep 28 12:45:39 ctl02 nova-api[7899]: 2017-09-28 12:45:39.493 7899 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:45:39 ctl02 nova-api[7899]: 2017-09-28 12:45:39.493 7899 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:45:39 ctl02 nova-api[7899]: 2017-09-28 12:45:39.493 7899 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:45:39 ctl02 nova-api[7899]: 2017-09-28 12:45:39.493 7899 ERROR nova
Sep 28 12:45:39 ctl02 neutron-server[30536]: 2017-09-28 12:45:39.498 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:45:39] "OPTIONS / HTTP/1.0" 200 262 0.000545
Sep 28 12:45:39 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:45:39 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:45:39 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:45:39 ctl02 nova-scheduler[5620]: 2017-09-28 12:45:39.747 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:45:39 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:45:39 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:45:39 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:45:39 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:45:40 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xbaf96602)
Sep 28 12:45:40 ctl02 glance-api[29183]: 2017-09-28 12:45:40.346 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:45:40] "OPTIONS / HTTP/1.0" 200 134 0.000568
Sep 28 12:45:40 ctl02 neutron-server[30536]: 2017-09-28 12:45:40.915 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:45:40] "OPTIONS / HTTP/1.0" 200 262 0.000569
Sep 28 12:45:41 ctl02 neutron-server[30536]: 2017-09-28 12:45:41.053 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:45:41] "OPTIONS / HTTP/1.0" 200 262 0.000496
Sep 28 12:45:41 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xbaf96602)
Sep 28 12:45:41 ctl02 nova-api[7917]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:45:41 ctl02 nova-api[7917]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:45:41 ctl02 glance-api[29183]: 2017-09-28 12:45:41.729 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:45:41] "OPTIONS / HTTP/1.0" 200 134 0.000551
Sep 28 12:45:41 ctl02 nova-api[7917]: 2017-09-28 12:45:41.730 7917 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:45:41 ctl02 nova-api[7917]: 2017-09-28 12:45:41.765 7917 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:45:41 ctl02 nova-api[7917]: 2017-09-28 12:45:41.765 7917 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:45:41 ctl02 nova-api[7917]: 2017-09-28 12:45:41.765 7917 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:45:41 ctl02 nova-api[7917]: 2017-09-28 12:45:41.765 7917 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:45:41 ctl02 nova-api[7917]: 2017-09-28 12:45:41.765 7917 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:45:41 ctl02 nova-api[7917]: 2017-09-28 12:45:41.765 7917 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:45:41 ctl02 nova-api[7917]: 2017-09-28 12:45:41.765 7917 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:45:41 ctl02 nova-api[7917]: 2017-09-28 12:45:41.765 7917 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:45:41 ctl02 nova-api[7917]: 2017-09-28 12:45:41.765 7917 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:45:41 ctl02 nova-api[7917]: 2017-09-28 12:45:41.765 7917 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:45:41 ctl02 nova-api[7917]: 2017-09-28 12:45:41.765 7917 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:45:41 ctl02 nova-api[7917]: 2017-09-28 12:45:41.765 7917 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:45:41 ctl02 nova-api[7917]: 2017-09-28 12:45:41.765 7917 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:45:41 ctl02 nova-api[7917]: 2017-09-28 12:45:41.765 7917 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:45:41 ctl02 nova-api[7917]: 2017-09-28 12:45:41.765 7917 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:45:41 ctl02 nova-api[7917]: 2017-09-28 12:45:41.765 7917 ERROR nova.wsgi     self.filename))
Sep 28 12:45:41 ctl02 nova-api[7917]: 2017-09-28 12:45:41.765 7917 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:45:41 ctl02 nova-api[7917]: 2017-09-28 12:45:41.765 7917 ERROR nova.wsgi
Sep 28 12:45:41 ctl02 nova-api[7917]: 2017-09-28 12:45:41.768 7917 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:45:41 ctl02 glance-api[29183]: 2017-09-28 12:45:41.888 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:45:41] "OPTIONS / HTTP/1.0" 200 134 0.000614
Sep 28 12:45:41 ctl02 nova-api[7917]: 2017-09-28 12:45:41.919 7917 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:45:42 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xbaf96602)
Sep 28 12:45:42 ctl02 nova-api[7917]: 2017-09-28 12:45:42.149 7917 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:45:42 ctl02 nova-api[7917]: 2017-09-28 12:45:42.151 7917 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:45:42 ctl02 nova-api[7917]: 2017-09-28 12:45:42.151 7917 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:45:42 ctl02 nova-api[7917]: 2017-09-28 12:45:42.151 7917 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:45:42 ctl02 nova-api[7917]: 2017-09-28 12:45:42.285 7917 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:45:42 ctl02 nova-api[7917]: 2017-09-28 12:45:42.287 7917 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:45:42 ctl02 nova-api[7917]: 2017-09-28 12:45:42.287 7917 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:45:42 ctl02 nova-api[7917]: 2017-09-28 12:45:42.288 7917 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:45:42 ctl02 nova-api[7917]: 2017-09-28 12:45:42.291 7917 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:45:42 ctl02 nova-api[7917]: 2017-09-28 12:45:42.292 7917 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:45:42 ctl02 nova-api[7917]: 2017-09-28 12:45:42.292 7917 ERROR nova Traceback (most recent call last):
Sep 28 12:45:42 ctl02 nova-api[7917]: 2017-09-28 12:45:42.292 7917 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:45:42 ctl02 nova-api[7917]: 2017-09-28 12:45:42.292 7917 ERROR nova     sys.exit(main())
Sep 28 12:45:42 ctl02 nova-api[7917]: 2017-09-28 12:45:42.292 7917 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:45:42 ctl02 nova-api[7917]: 2017-09-28 12:45:42.292 7917 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:45:42 ctl02 nova-api[7917]: 2017-09-28 12:45:42.292 7917 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:45:42 ctl02 nova-api[7917]: 2017-09-28 12:45:42.292 7917 ERROR nova     max_url_len=max_url_len)
Sep 28 12:45:42 ctl02 nova-api[7917]: 2017-09-28 12:45:42.292 7917 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:45:42 ctl02 nova-api[7917]: 2017-09-28 12:45:42.292 7917 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:45:42 ctl02 nova-api[7917]: 2017-09-28 12:45:42.292 7917 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:45:42 ctl02 nova-api[7917]: 2017-09-28 12:45:42.292 7917 ERROR nova     sock.listen(backlog)
Sep 28 12:45:42 ctl02 nova-api[7917]: 2017-09-28 12:45:42.292 7917 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:45:42 ctl02 nova-api[7917]: 2017-09-28 12:45:42.292 7917 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:45:42 ctl02 nova-api[7917]: 2017-09-28 12:45:42.292 7917 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:45:42 ctl02 nova-api[7917]: 2017-09-28 12:45:42.292 7917 ERROR nova
Sep 28 12:45:42 ctl02 heat-api-cfn[13300]: 2017-09-28 12:45:42.423 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:45:42] "OPTIONS / HTTP/1.0" 200 134 0.000539
Sep 28 12:45:42 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:45:42 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:45:42 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:45:42 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:45:42 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:45:42 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:45:42 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:45:43 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xbaf96602)
Sep 28 12:45:44 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xbaf96602)
Sep 28 12:45:44 ctl02 nova-api[7935]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:45:44 ctl02 nova-api[7935]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:45:44 ctl02 nova-api[7935]: 2017-09-28 12:45:44.480 7935 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:45:44 ctl02 nova-api[7935]: 2017-09-28 12:45:44.481 7935 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:45:44 ctl02 nova-api[7935]: 2017-09-28 12:45:44.481 7935 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:45:44 ctl02 nova-api[7935]: 2017-09-28 12:45:44.481 7935 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:45:44 ctl02 nova-api[7935]: 2017-09-28 12:45:44.481 7935 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:45:44 ctl02 nova-api[7935]: 2017-09-28 12:45:44.481 7935 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:45:44 ctl02 nova-api[7935]: 2017-09-28 12:45:44.481 7935 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:45:44 ctl02 nova-api[7935]: 2017-09-28 12:45:44.481 7935 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:45:44 ctl02 nova-api[7935]: 2017-09-28 12:45:44.481 7935 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:45:44 ctl02 nova-api[7935]: 2017-09-28 12:45:44.481 7935 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:45:44 ctl02 nova-api[7935]: 2017-09-28 12:45:44.481 7935 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:45:44 ctl02 nova-api[7935]: 2017-09-28 12:45:44.481 7935 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:45:44 ctl02 nova-api[7935]: 2017-09-28 12:45:44.481 7935 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:45:44 ctl02 nova-api[7935]: 2017-09-28 12:45:44.481 7935 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:45:44 ctl02 nova-api[7935]: 2017-09-28 12:45:44.481 7935 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:45:44 ctl02 nova-api[7935]: 2017-09-28 12:45:44.481 7935 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:45:44 ctl02 nova-api[7935]: 2017-09-28 12:45:44.481 7935 ERROR nova.wsgi     self.filename))
Sep 28 12:45:44 ctl02 nova-api[7935]: 2017-09-28 12:45:44.481 7935 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:45:44 ctl02 nova-api[7935]: 2017-09-28 12:45:44.481 7935 ERROR nova.wsgi
Sep 28 12:45:44 ctl02 nova-api[7935]: 2017-09-28 12:45:44.482 7935 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:45:44 ctl02 nova-api[7935]: 2017-09-28 12:45:44.609 7935 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:45:44 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:45:44.774 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:45:44] "OPTIONS / HTTP/1.0" 200 134 0.000478
Sep 28 12:45:44 ctl02 nova-api[7935]: 2017-09-28 12:45:44.833 7935 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:45:44 ctl02 nova-api[7935]: 2017-09-28 12:45:44.835 7935 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:45:44 ctl02 nova-api[7935]: 2017-09-28 12:45:44.835 7935 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:45:44 ctl02 nova-api[7935]: 2017-09-28 12:45:44.836 7935 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:45:44 ctl02 nova-api[7935]: 2017-09-28 12:45:44.965 7935 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:45:44 ctl02 nova-api[7935]: 2017-09-28 12:45:44.967 7935 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:45:44 ctl02 nova-api[7935]: 2017-09-28 12:45:44.967 7935 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:45:44 ctl02 nova-api[7935]: 2017-09-28 12:45:44.967 7935 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:45:44 ctl02 nova-api[7935]: 2017-09-28 12:45:44.970 7935 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:45:44 ctl02 nova-api[7935]: 2017-09-28 12:45:44.971 7935 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:45:44 ctl02 nova-api[7935]: 2017-09-28 12:45:44.971 7935 ERROR nova Traceback (most recent call last):
Sep 28 12:45:44 ctl02 nova-api[7935]: 2017-09-28 12:45:44.971 7935 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:45:44 ctl02 nova-api[7935]: 2017-09-28 12:45:44.971 7935 ERROR nova     sys.exit(main())
Sep 28 12:45:44 ctl02 nova-api[7935]: 2017-09-28 12:45:44.971 7935 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:45:44 ctl02 nova-api[7935]: 2017-09-28 12:45:44.971 7935 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:45:44 ctl02 nova-api[7935]: 2017-09-28 12:45:44.971 7935 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:45:44 ctl02 nova-api[7935]: 2017-09-28 12:45:44.971 7935 ERROR nova     max_url_len=max_url_len)
Sep 28 12:45:44 ctl02 nova-api[7935]: 2017-09-28 12:45:44.971 7935 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:45:44 ctl02 nova-api[7935]: 2017-09-28 12:45:44.971 7935 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:45:44 ctl02 nova-api[7935]: 2017-09-28 12:45:44.971 7935 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:45:44 ctl02 nova-api[7935]: 2017-09-28 12:45:44.971 7935 ERROR nova     sock.listen(backlog)
Sep 28 12:45:44 ctl02 nova-api[7935]: 2017-09-28 12:45:44.971 7935 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:45:44 ctl02 nova-api[7935]: 2017-09-28 12:45:44.971 7935 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:45:44 ctl02 nova-api[7935]: 2017-09-28 12:45:44.971 7935 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:45:44 ctl02 nova-api[7935]: 2017-09-28 12:45:44.971 7935 ERROR nova
Sep 28 12:45:45 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xbaf96602)
Sep 28 12:45:45 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:45:45 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:45:45 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:45:45 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:45:45 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:45:45 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:45:45 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:45:45 ctl02 heat-api[13008]: 2017-09-28 12:45:45.708 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:45:45] "OPTIONS / HTTP/1.0" 200 134 0.000572
Sep 28 12:45:46 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xbaf96602)
Sep 28 12:45:46 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:45:46.631 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:45:46] "OPTIONS / HTTP/1.0" 200 134 0.000502
Sep 28 12:45:47 ctl02 nova-api[7953]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:45:47 ctl02 nova-api[7953]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:45:47 ctl02 heat-api[13008]: 2017-09-28 12:45:47.079 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:45:47] "OPTIONS / HTTP/1.0" 200 134 0.000540
Sep 28 12:45:47 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xbaf96602)
Sep 28 12:45:47 ctl02 heat-api-cfn[13300]: 2017-09-28 12:45:47.108 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:45:47] "OPTIONS / HTTP/1.0" 200 134 0.000446
Sep 28 12:45:47 ctl02 nova-api[7953]: 2017-09-28 12:45:47.229 7953 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:45:47 ctl02 nova-api[7953]: 2017-09-28 12:45:47.231 7953 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:45:47 ctl02 nova-api[7953]: 2017-09-28 12:45:47.231 7953 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:45:47 ctl02 nova-api[7953]: 2017-09-28 12:45:47.231 7953 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:45:47 ctl02 nova-api[7953]: 2017-09-28 12:45:47.231 7953 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:45:47 ctl02 nova-api[7953]: 2017-09-28 12:45:47.231 7953 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:45:47 ctl02 nova-api[7953]: 2017-09-28 12:45:47.231 7953 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:45:47 ctl02 nova-api[7953]: 2017-09-28 12:45:47.231 7953 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:45:47 ctl02 nova-api[7953]: 2017-09-28 12:45:47.231 7953 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:45:47 ctl02 nova-api[7953]: 2017-09-28 12:45:47.231 7953 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:45:47 ctl02 nova-api[7953]: 2017-09-28 12:45:47.231 7953 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:45:47 ctl02 nova-api[7953]: 2017-09-28 12:45:47.231 7953 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:45:47 ctl02 nova-api[7953]: 2017-09-28 12:45:47.231 7953 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:45:47 ctl02 nova-api[7953]: 2017-09-28 12:45:47.231 7953 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:45:47 ctl02 nova-api[7953]: 2017-09-28 12:45:47.231 7953 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:45:47 ctl02 nova-api[7953]: 2017-09-28 12:45:47.231 7953 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:45:47 ctl02 nova-api[7953]: 2017-09-28 12:45:47.231 7953 ERROR nova.wsgi     self.filename))
Sep 28 12:45:47 ctl02 nova-api[7953]: 2017-09-28 12:45:47.231 7953 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:45:47 ctl02 nova-api[7953]: 2017-09-28 12:45:47.231 7953 ERROR nova.wsgi
Sep 28 12:45:47 ctl02 nova-api[7953]: 2017-09-28 12:45:47.232 7953 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:45:47 ctl02 nova-api[7953]: 2017-09-28 12:45:47.360 7953 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:45:47 ctl02 heat-api[13008]: 2017-09-28 12:45:47.366 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:45:47] "OPTIONS / HTTP/1.0" 200 134 0.000518
Sep 28 12:45:47 ctl02 nova-api[7953]: 2017-09-28 12:45:47.583 7953 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:45:47 ctl02 nova-api[7953]: 2017-09-28 12:45:47.586 7953 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:45:47 ctl02 nova-api[7953]: 2017-09-28 12:45:47.586 7953 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:45:47 ctl02 nova-api[7953]: 2017-09-28 12:45:47.586 7953 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:45:47 ctl02 heat-api-cfn[13300]: 2017-09-28 12:45:47.701 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:45:47] "OPTIONS / HTTP/1.0" 200 134 0.000439
Sep 28 12:45:47 ctl02 nova-api[7953]: 2017-09-28 12:45:47.717 7953 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:45:47 ctl02 nova-api[7953]: 2017-09-28 12:45:47.719 7953 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:45:47 ctl02 nova-api[7953]: 2017-09-28 12:45:47.719 7953 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:45:47 ctl02 nova-api[7953]: 2017-09-28 12:45:47.719 7953 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:45:47 ctl02 nova-api[7953]: 2017-09-28 12:45:47.722 7953 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:45:47 ctl02 nova-api[7953]: 2017-09-28 12:45:47.722 7953 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:45:47 ctl02 nova-api[7953]: 2017-09-28 12:45:47.722 7953 ERROR nova Traceback (most recent call last):
Sep 28 12:45:47 ctl02 nova-api[7953]: 2017-09-28 12:45:47.722 7953 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:45:47 ctl02 nova-api[7953]: 2017-09-28 12:45:47.722 7953 ERROR nova     sys.exit(main())
Sep 28 12:45:47 ctl02 nova-api[7953]: 2017-09-28 12:45:47.722 7953 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:45:47 ctl02 nova-api[7953]: 2017-09-28 12:45:47.722 7953 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:45:47 ctl02 nova-api[7953]: 2017-09-28 12:45:47.722 7953 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:45:47 ctl02 nova-api[7953]: 2017-09-28 12:45:47.722 7953 ERROR nova     max_url_len=max_url_len)
Sep 28 12:45:47 ctl02 nova-api[7953]: 2017-09-28 12:45:47.722 7953 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:45:47 ctl02 nova-api[7953]: 2017-09-28 12:45:47.722 7953 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:45:47 ctl02 nova-api[7953]: 2017-09-28 12:45:47.722 7953 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:45:47 ctl02 nova-api[7953]: 2017-09-28 12:45:47.722 7953 ERROR nova     sock.listen(backlog)
Sep 28 12:45:47 ctl02 nova-api[7953]: 2017-09-28 12:45:47.722 7953 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:45:47 ctl02 nova-api[7953]: 2017-09-28 12:45:47.722 7953 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:45:47 ctl02 nova-api[7953]: 2017-09-28 12:45:47.722 7953 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:45:47 ctl02 nova-api[7953]: 2017-09-28 12:45:47.722 7953 ERROR nova
Sep 28 12:45:47 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:45:47 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:45:47 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:45:48 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xbaf96602)
Sep 28 12:45:48 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:45:48 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:45:48 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:45:48 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:45:48 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:45:48.597 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:45:48] "OPTIONS / HTTP/1.0" 200 134 0.000468
Sep 28 12:45:49 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xbaf96602)
Sep 28 12:45:49 ctl02 neutron-server[30536]: 2017-09-28 12:45:49.283 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:45:49] "OPTIONS / HTTP/1.0" 200 262 0.000562
Sep 28 12:45:49 ctl02 nova-api[7971]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:45:49 ctl02 nova-api[7971]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:45:49 ctl02 nova-api[7971]: 2017-09-28 12:45:49.987 7971 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:45:49 ctl02 nova-api[7971]: 2017-09-28 12:45:49.988 7971 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:45:49 ctl02 nova-api[7971]: 2017-09-28 12:45:49.988 7971 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:45:49 ctl02 nova-api[7971]: 2017-09-28 12:45:49.988 7971 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:45:49 ctl02 nova-api[7971]: 2017-09-28 12:45:49.988 7971 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:45:49 ctl02 nova-api[7971]: 2017-09-28 12:45:49.988 7971 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:45:49 ctl02 nova-api[7971]: 2017-09-28 12:45:49.988 7971 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:45:49 ctl02 nova-api[7971]: 2017-09-28 12:45:49.988 7971 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:45:49 ctl02 nova-api[7971]: 2017-09-28 12:45:49.988 7971 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:45:49 ctl02 nova-api[7971]: 2017-09-28 12:45:49.988 7971 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:45:49 ctl02 nova-api[7971]: 2017-09-28 12:45:49.988 7971 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:45:49 ctl02 nova-api[7971]: 2017-09-28 12:45:49.988 7971 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:45:49 ctl02 nova-api[7971]: 2017-09-28 12:45:49.988 7971 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:45:49 ctl02 nova-api[7971]: 2017-09-28 12:45:49.988 7971 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:45:49 ctl02 nova-api[7971]: 2017-09-28 12:45:49.988 7971 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:45:49 ctl02 nova-api[7971]: 2017-09-28 12:45:49.988 7971 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:45:49 ctl02 nova-api[7971]: 2017-09-28 12:45:49.988 7971 ERROR nova.wsgi     self.filename))
Sep 28 12:45:49 ctl02 nova-api[7971]: 2017-09-28 12:45:49.988 7971 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:45:49 ctl02 nova-api[7971]: 2017-09-28 12:45:49.988 7971 ERROR nova.wsgi
Sep 28 12:45:49 ctl02 nova-api[7971]: 2017-09-28 12:45:49.989 7971 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:45:50 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:45:50 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:45:50 ctl02 nova-api[7971]: 2017-09-28 12:45:50.121 7971 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:45:50 ctl02 nova-api[7971]: 2017-09-28 12:45:50.368 7971 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:45:50 ctl02 nova-api[7971]: 2017-09-28 12:45:50.371 7971 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:45:50 ctl02 nova-api[7971]: 2017-09-28 12:45:50.371 7971 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:45:50 ctl02 nova-api[7971]: 2017-09-28 12:45:50.371 7971 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:45:50 ctl02 nova-api[7971]: 2017-09-28 12:45:50.504 7971 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:45:50 ctl02 nova-api[7971]: 2017-09-28 12:45:50.506 7971 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:45:50 ctl02 nova-api[7971]: 2017-09-28 12:45:50.506 7971 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:45:50 ctl02 nova-api[7971]: 2017-09-28 12:45:50.506 7971 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:45:50 ctl02 nova-api[7971]: 2017-09-28 12:45:50.509 7971 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:45:50 ctl02 nova-api[7971]: 2017-09-28 12:45:50.510 7971 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:45:50 ctl02 nova-api[7971]: 2017-09-28 12:45:50.510 7971 ERROR nova Traceback (most recent call last):
Sep 28 12:45:50 ctl02 nova-api[7971]: 2017-09-28 12:45:50.510 7971 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:45:50 ctl02 nova-api[7971]: 2017-09-28 12:45:50.510 7971 ERROR nova     sys.exit(main())
Sep 28 12:45:50 ctl02 nova-api[7971]: 2017-09-28 12:45:50.510 7971 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:45:50 ctl02 nova-api[7971]: 2017-09-28 12:45:50.510 7971 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:45:50 ctl02 nova-api[7971]: 2017-09-28 12:45:50.510 7971 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:45:50 ctl02 nova-api[7971]: 2017-09-28 12:45:50.510 7971 ERROR nova     max_url_len=max_url_len)
Sep 28 12:45:50 ctl02 nova-api[7971]: 2017-09-28 12:45:50.510 7971 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:45:50 ctl02 nova-api[7971]: 2017-09-28 12:45:50.510 7971 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:45:50 ctl02 nova-api[7971]: 2017-09-28 12:45:50.510 7971 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:45:50 ctl02 nova-api[7971]: 2017-09-28 12:45:50.510 7971 ERROR nova     sock.listen(backlog)
Sep 28 12:45:50 ctl02 nova-api[7971]: 2017-09-28 12:45:50.510 7971 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:45:50 ctl02 nova-api[7971]: 2017-09-28 12:45:50.510 7971 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:45:50 ctl02 nova-api[7971]: 2017-09-28 12:45:50.510 7971 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:45:50 ctl02 nova-api[7971]: 2017-09-28 12:45:50.510 7971 ERROR nova
Sep 28 12:45:50 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:45:50 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:45:50 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:45:50 ctl02 glance-api[29183]: 2017-09-28 12:45:50.735 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:45:50] "OPTIONS / HTTP/1.0" 200 134 0.000667
Sep 28 12:45:50 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:45:50 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:45:50 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:45:50 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:45:51 ctl02 neutron-server[30536]: 2017-09-28 12:45:51.120 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:45:51] "OPTIONS / HTTP/1.0" 200 262 0.000518
Sep 28 12:45:51 ctl02 neutron-server[30536]: 2017-09-28 12:45:51.257 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 12:45:51 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:45:51 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:44:56 cmp002
Sep 28 12:45:51 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:45:20 cmp002
Sep 28 12:45:51 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:43:56 cmp002
Sep 28 12:45:51 ctl02 neutron-server[30536]: 2017-09-28 12:45:51.439 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:45:51] "OPTIONS / HTTP/1.0" 200 262 0.000598
Sep 28 12:45:51 ctl02 glance-api[29183]: 2017-09-28 12:45:51.583 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:45:51] "OPTIONS / HTTP/1.0" 200 134 0.000618
Sep 28 12:45:51 ctl02 glance-api[29183]: 2017-09-28 12:45:51.949 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:45:51] "OPTIONS / HTTP/1.0" 200 134 0.000571
Sep 28 12:45:52 ctl02 heat-api-cfn[13300]: 2017-09-28 12:45:52.039 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:45:52] "OPTIONS / HTTP/1.0" 200 134 0.000497
Sep 28 12:45:52 ctl02 nova-api[7994]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:45:52 ctl02 nova-api[7994]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:45:52 ctl02 nova-api[7994]: 2017-09-28 12:45:52.780 7994 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:45:52 ctl02 nova-api[7994]: 2017-09-28 12:45:52.782 7994 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:45:52 ctl02 nova-api[7994]: 2017-09-28 12:45:52.782 7994 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:45:52 ctl02 nova-api[7994]: 2017-09-28 12:45:52.782 7994 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:45:52 ctl02 nova-api[7994]: 2017-09-28 12:45:52.782 7994 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:45:52 ctl02 nova-api[7994]: 2017-09-28 12:45:52.782 7994 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:45:52 ctl02 nova-api[7994]: 2017-09-28 12:45:52.782 7994 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:45:52 ctl02 nova-api[7994]: 2017-09-28 12:45:52.782 7994 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:45:52 ctl02 nova-api[7994]: 2017-09-28 12:45:52.782 7994 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:45:52 ctl02 nova-api[7994]: 2017-09-28 12:45:52.782 7994 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:45:52 ctl02 nova-api[7994]: 2017-09-28 12:45:52.782 7994 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:45:52 ctl02 nova-api[7994]: 2017-09-28 12:45:52.782 7994 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:45:52 ctl02 nova-api[7994]: 2017-09-28 12:45:52.782 7994 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:45:52 ctl02 nova-api[7994]: 2017-09-28 12:45:52.782 7994 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:45:52 ctl02 nova-api[7994]: 2017-09-28 12:45:52.782 7994 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:45:52 ctl02 nova-api[7994]: 2017-09-28 12:45:52.782 7994 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:45:52 ctl02 nova-api[7994]: 2017-09-28 12:45:52.782 7994 ERROR nova.wsgi     self.filename))
Sep 28 12:45:52 ctl02 nova-api[7994]: 2017-09-28 12:45:52.782 7994 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:45:52 ctl02 nova-api[7994]: 2017-09-28 12:45:52.782 7994 ERROR nova.wsgi
Sep 28 12:45:52 ctl02 nova-api[7994]: 2017-09-28 12:45:52.784 7994 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:45:52 ctl02 nova-api[7994]: 2017-09-28 12:45:52.919 7994 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:45:53 ctl02 nova-api[7994]: 2017-09-28 12:45:53.165 7994 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:45:53 ctl02 nova-api[7994]: 2017-09-28 12:45:53.168 7994 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:45:53 ctl02 nova-api[7994]: 2017-09-28 12:45:53.168 7994 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:45:53 ctl02 nova-api[7994]: 2017-09-28 12:45:53.169 7994 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:45:53 ctl02 nova-api[7994]: 2017-09-28 12:45:53.302 7994 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:45:53 ctl02 nova-api[7994]: 2017-09-28 12:45:53.305 7994 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:45:53 ctl02 nova-api[7994]: 2017-09-28 12:45:53.305 7994 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:45:53 ctl02 nova-api[7994]: 2017-09-28 12:45:53.306 7994 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:45:53 ctl02 nova-api[7994]: 2017-09-28 12:45:53.309 7994 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:45:53 ctl02 nova-api[7994]: 2017-09-28 12:45:53.310 7994 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:45:53 ctl02 nova-api[7994]: 2017-09-28 12:45:53.310 7994 ERROR nova Traceback (most recent call last):
Sep 28 12:45:53 ctl02 nova-api[7994]: 2017-09-28 12:45:53.310 7994 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:45:53 ctl02 nova-api[7994]: 2017-09-28 12:45:53.310 7994 ERROR nova     sys.exit(main())
Sep 28 12:45:53 ctl02 nova-api[7994]: 2017-09-28 12:45:53.310 7994 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:45:53 ctl02 nova-api[7994]: 2017-09-28 12:45:53.310 7994 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:45:53 ctl02 nova-api[7994]: 2017-09-28 12:45:53.310 7994 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:45:53 ctl02 nova-api[7994]: 2017-09-28 12:45:53.310 7994 ERROR nova     max_url_len=max_url_len)
Sep 28 12:45:53 ctl02 nova-api[7994]: 2017-09-28 12:45:53.310 7994 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:45:53 ctl02 nova-api[7994]: 2017-09-28 12:45:53.310 7994 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:45:53 ctl02 nova-api[7994]: 2017-09-28 12:45:53.310 7994 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:45:53 ctl02 nova-api[7994]: 2017-09-28 12:45:53.310 7994 ERROR nova     sock.listen(backlog)
Sep 28 12:45:53 ctl02 nova-api[7994]: 2017-09-28 12:45:53.310 7994 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:45:53 ctl02 nova-api[7994]: 2017-09-28 12:45:53.310 7994 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:45:53 ctl02 nova-api[7994]: 2017-09-28 12:45:53.310 7994 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:45:53 ctl02 nova-api[7994]: 2017-09-28 12:45:53.310 7994 ERROR nova
Sep 28 12:45:53 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:45:53 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:45:53 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:45:53 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:45:53 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:45:53 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:45:53 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:45:54 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:45:54.932 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:45:54] "OPTIONS / HTTP/1.0" 200 134 0.000465
Sep 28 12:45:55 ctl02 nova-api[8012]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:45:55 ctl02 nova-api[8012]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:45:55 ctl02 nova-api[8012]: 2017-09-28 12:45:55.513 8012 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:45:55 ctl02 nova-api[8012]: 2017-09-28 12:45:55.515 8012 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:45:55 ctl02 nova-api[8012]: 2017-09-28 12:45:55.515 8012 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:45:55 ctl02 nova-api[8012]: 2017-09-28 12:45:55.515 8012 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:45:55 ctl02 nova-api[8012]: 2017-09-28 12:45:55.515 8012 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:45:55 ctl02 nova-api[8012]: 2017-09-28 12:45:55.515 8012 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:45:55 ctl02 nova-api[8012]: 2017-09-28 12:45:55.515 8012 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:45:55 ctl02 nova-api[8012]: 2017-09-28 12:45:55.515 8012 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:45:55 ctl02 nova-api[8012]: 2017-09-28 12:45:55.515 8012 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:45:55 ctl02 nova-api[8012]: 2017-09-28 12:45:55.515 8012 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:45:55 ctl02 nova-api[8012]: 2017-09-28 12:45:55.515 8012 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:45:55 ctl02 nova-api[8012]: 2017-09-28 12:45:55.515 8012 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:45:55 ctl02 nova-api[8012]: 2017-09-28 12:45:55.515 8012 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:45:55 ctl02 nova-api[8012]: 2017-09-28 12:45:55.515 8012 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:45:55 ctl02 nova-api[8012]: 2017-09-28 12:45:55.515 8012 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:45:55 ctl02 nova-api[8012]: 2017-09-28 12:45:55.515 8012 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:45:55 ctl02 nova-api[8012]: 2017-09-28 12:45:55.515 8012 ERROR nova.wsgi     self.filename))
Sep 28 12:45:55 ctl02 nova-api[8012]: 2017-09-28 12:45:55.515 8012 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:45:55 ctl02 nova-api[8012]: 2017-09-28 12:45:55.515 8012 ERROR nova.wsgi
Sep 28 12:45:55 ctl02 nova-api[8012]: 2017-09-28 12:45:55.517 8012 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:45:55 ctl02 nova-api[8012]: 2017-09-28 12:45:55.647 8012 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:45:55 ctl02 nova-api[8012]: 2017-09-28 12:45:55.885 8012 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:45:55 ctl02 nova-api[8012]: 2017-09-28 12:45:55.888 8012 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:45:55 ctl02 nova-api[8012]: 2017-09-28 12:45:55.888 8012 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:45:55 ctl02 nova-api[8012]: 2017-09-28 12:45:55.889 8012 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:45:56 ctl02 nova-api[8012]: 2017-09-28 12:45:56.020 8012 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:45:56 ctl02 nova-api[8012]: 2017-09-28 12:45:56.023 8012 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:45:56 ctl02 nova-api[8012]: 2017-09-28 12:45:56.023 8012 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:45:56 ctl02 nova-api[8012]: 2017-09-28 12:45:56.023 8012 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:45:56 ctl02 heat-api[13008]: 2017-09-28 12:45:56.025 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:45:56] "OPTIONS / HTTP/1.0" 200 134 0.000659
Sep 28 12:45:56 ctl02 nova-api[8012]: 2017-09-28 12:45:56.027 8012 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:45:56 ctl02 nova-api[8012]: 2017-09-28 12:45:56.027 8012 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:45:56 ctl02 nova-api[8012]: 2017-09-28 12:45:56.027 8012 ERROR nova Traceback (most recent call last):
Sep 28 12:45:56 ctl02 nova-api[8012]: 2017-09-28 12:45:56.027 8012 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:45:56 ctl02 nova-api[8012]: 2017-09-28 12:45:56.027 8012 ERROR nova     sys.exit(main())
Sep 28 12:45:56 ctl02 nova-api[8012]: 2017-09-28 12:45:56.027 8012 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:45:56 ctl02 nova-api[8012]: 2017-09-28 12:45:56.027 8012 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:45:56 ctl02 nova-api[8012]: 2017-09-28 12:45:56.027 8012 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:45:56 ctl02 nova-api[8012]: 2017-09-28 12:45:56.027 8012 ERROR nova     max_url_len=max_url_len)
Sep 28 12:45:56 ctl02 nova-api[8012]: 2017-09-28 12:45:56.027 8012 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:45:56 ctl02 nova-api[8012]: 2017-09-28 12:45:56.027 8012 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:45:56 ctl02 nova-api[8012]: 2017-09-28 12:45:56.027 8012 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:45:56 ctl02 nova-api[8012]: 2017-09-28 12:45:56.027 8012 ERROR nova     sock.listen(backlog)
Sep 28 12:45:56 ctl02 nova-api[8012]: 2017-09-28 12:45:56.027 8012 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:45:56 ctl02 nova-api[8012]: 2017-09-28 12:45:56.027 8012 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:45:56 ctl02 nova-api[8012]: 2017-09-28 12:45:56.027 8012 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:45:56 ctl02 nova-api[8012]: 2017-09-28 12:45:56.027 8012 ERROR nova
Sep 28 12:45:56 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:45:56 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:45:56 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:45:56 ctl02 neutron-server[30536]: 2017-09-28 12:45:56.249 30600 WARNING oslo_messaging._drivers.amqpdriver [req-9ab51703-16bb-4bb7-8bbc-3fe47316893c - - - - -] reply_74787a9d28524b7f9c3c98994688cba9 doesn't exists, drop reply to 814f3320b8b94628ab40023582c04724
Sep 28 12:45:56 ctl02 neutron-server[30536]: 2017-09-28 12:45:56.251 30600 INFO oslo_messaging._drivers.amqpdriver [req-9ab51703-16bb-4bb7-8bbc-3fe47316893c - - - - -] The reply 814f3320b8b94628ab40023582c04724 cannot be sent  reply_74787a9d28524b7f9c3c98994688cba9 reply queue don't exist after 60 sec abandoning...
Sep 28 12:45:56 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:45:56 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:45:56 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:45:56 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:45:56 ctl02 heat-api[13008]: 2017-09-28 12:45:56.689 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:45:56] "OPTIONS / HTTP/1.0" 200 134 0.000543
Sep 28 12:45:56 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:45:56.741 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:45:56] "OPTIONS / HTTP/1.0" 200 134 0.000460
Sep 28 12:45:57 ctl02 heat-api[13008]: 2017-09-28 12:45:57.303 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:45:57] "OPTIONS / HTTP/1.0" 200 134 0.000705
Sep 28 12:45:57 ctl02 heat-api-cfn[13300]: 2017-09-28 12:45:57.456 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:45:57] "OPTIONS / HTTP/1.0" 200 134 0.000422
Sep 28 12:45:57 ctl02 heat-api-cfn[13300]: 2017-09-28 12:45:57.943 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:45:57] "OPTIONS / HTTP/1.0" 200 134 0.000324
Sep 28 12:45:58 ctl02 nova-api[8030]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:45:58 ctl02 nova-api[8030]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:45:58 ctl02 nova-api[8030]: 2017-09-28 12:45:58.224 8030 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:45:58 ctl02 nova-api[8030]: 2017-09-28 12:45:58.225 8030 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:45:58 ctl02 nova-api[8030]: 2017-09-28 12:45:58.225 8030 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:45:58 ctl02 nova-api[8030]: 2017-09-28 12:45:58.225 8030 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:45:58 ctl02 nova-api[8030]: 2017-09-28 12:45:58.225 8030 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:45:58 ctl02 nova-api[8030]: 2017-09-28 12:45:58.225 8030 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:45:58 ctl02 nova-api[8030]: 2017-09-28 12:45:58.225 8030 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:45:58 ctl02 nova-api[8030]: 2017-09-28 12:45:58.225 8030 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:45:58 ctl02 nova-api[8030]: 2017-09-28 12:45:58.225 8030 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:45:58 ctl02 nova-api[8030]: 2017-09-28 12:45:58.225 8030 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:45:58 ctl02 nova-api[8030]: 2017-09-28 12:45:58.225 8030 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:45:58 ctl02 nova-api[8030]: 2017-09-28 12:45:58.225 8030 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:45:58 ctl02 nova-api[8030]: 2017-09-28 12:45:58.225 8030 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:45:58 ctl02 nova-api[8030]: 2017-09-28 12:45:58.225 8030 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:45:58 ctl02 nova-api[8030]: 2017-09-28 12:45:58.225 8030 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:45:58 ctl02 nova-api[8030]: 2017-09-28 12:45:58.225 8030 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:45:58 ctl02 nova-api[8030]: 2017-09-28 12:45:58.225 8030 ERROR nova.wsgi     self.filename))
Sep 28 12:45:58 ctl02 nova-api[8030]: 2017-09-28 12:45:58.225 8030 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:45:58 ctl02 nova-api[8030]: 2017-09-28 12:45:58.225 8030 ERROR nova.wsgi
Sep 28 12:45:58 ctl02 nova-api[8030]: 2017-09-28 12:45:58.226 8030 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:45:58 ctl02 nova-api[8030]: 2017-09-28 12:45:58.352 8030 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:45:58 ctl02 nova-api[8030]: 2017-09-28 12:45:58.574 8030 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:45:58 ctl02 nova-api[8030]: 2017-09-28 12:45:58.577 8030 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:45:58 ctl02 nova-api[8030]: 2017-09-28 12:45:58.577 8030 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:45:58 ctl02 nova-api[8030]: 2017-09-28 12:45:58.577 8030 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:45:58 ctl02 nova-api[8030]: 2017-09-28 12:45:58.707 8030 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:45:58 ctl02 nova-api[8030]: 2017-09-28 12:45:58.709 8030 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:45:58 ctl02 nova-api[8030]: 2017-09-28 12:45:58.709 8030 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:45:58 ctl02 nova-api[8030]: 2017-09-28 12:45:58.710 8030 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:45:58 ctl02 nova-api[8030]: 2017-09-28 12:45:58.713 8030 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:45:58 ctl02 nova-api[8030]: 2017-09-28 12:45:58.713 8030 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:45:58 ctl02 nova-api[8030]: 2017-09-28 12:45:58.713 8030 ERROR nova Traceback (most recent call last):
Sep 28 12:45:58 ctl02 nova-api[8030]: 2017-09-28 12:45:58.713 8030 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:45:58 ctl02 nova-api[8030]: 2017-09-28 12:45:58.713 8030 ERROR nova     sys.exit(main())
Sep 28 12:45:58 ctl02 nova-api[8030]: 2017-09-28 12:45:58.713 8030 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:45:58 ctl02 nova-api[8030]: 2017-09-28 12:45:58.713 8030 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:45:58 ctl02 nova-api[8030]: 2017-09-28 12:45:58.713 8030 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:45:58 ctl02 nova-api[8030]: 2017-09-28 12:45:58.713 8030 ERROR nova     max_url_len=max_url_len)
Sep 28 12:45:58 ctl02 nova-api[8030]: 2017-09-28 12:45:58.713 8030 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:45:58 ctl02 nova-api[8030]: 2017-09-28 12:45:58.713 8030 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:45:58 ctl02 nova-api[8030]: 2017-09-28 12:45:58.713 8030 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:45:58 ctl02 nova-api[8030]: 2017-09-28 12:45:58.713 8030 ERROR nova     sock.listen(backlog)
Sep 28 12:45:58 ctl02 nova-api[8030]: 2017-09-28 12:45:58.713 8030 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:45:58 ctl02 nova-api[8030]: 2017-09-28 12:45:58.713 8030 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:45:58 ctl02 nova-api[8030]: 2017-09-28 12:45:58.713 8030 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:45:58 ctl02 nova-api[8030]: 2017-09-28 12:45:58.713 8030 ERROR nova
Sep 28 12:45:58 ctl02 nova-cert[4860]: 2017-09-28 12:45:58.845 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:45:58 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:45:58 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:45:58 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:45:58 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:45:58.850 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:45:58] "OPTIONS / HTTP/1.0" 200 134 0.000457
Sep 28 12:45:58 ctl02 nova-conductor[5056]: 2017-09-28 12:45:58.991 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:45:59 ctl02 nova-conductor[5056]: 2017-09-28 12:45:59.017 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:45:59 ctl02 nova-conductor[5056]: 2017-09-28 12:45:59.034 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:45:59 ctl02 nova-conductor[5056]: 2017-09-28 12:45:59.040 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:45:59 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:45:59 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:45:59 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:45:59 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:45:59 ctl02 neutron-server[30536]: 2017-09-28 12:45:59.545 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:45:59] "OPTIONS / HTTP/1.0" 200 262 0.000502
Sep 28 12:46:00 ctl02 glance-api[29183]: 2017-09-28 12:46:00.533 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:46:00] "OPTIONS / HTTP/1.0" 200 134 0.000983
Sep 28 12:46:00 ctl02 nova-api[8048]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:46:00 ctl02 nova-api[8048]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:46:01 ctl02 nova-api[8048]: 2017-09-28 12:46:01.057 8048 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:46:01 ctl02 nova-api[8048]: 2017-09-28 12:46:01.059 8048 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:46:01 ctl02 nova-api[8048]: 2017-09-28 12:46:01.059 8048 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:46:01 ctl02 nova-api[8048]: 2017-09-28 12:46:01.059 8048 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:46:01 ctl02 nova-api[8048]: 2017-09-28 12:46:01.059 8048 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:46:01 ctl02 nova-api[8048]: 2017-09-28 12:46:01.059 8048 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:46:01 ctl02 nova-api[8048]: 2017-09-28 12:46:01.059 8048 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:46:01 ctl02 nova-api[8048]: 2017-09-28 12:46:01.059 8048 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:46:01 ctl02 nova-api[8048]: 2017-09-28 12:46:01.059 8048 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:46:01 ctl02 nova-api[8048]: 2017-09-28 12:46:01.059 8048 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:46:01 ctl02 nova-api[8048]: 2017-09-28 12:46:01.059 8048 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:46:01 ctl02 nova-api[8048]: 2017-09-28 12:46:01.059 8048 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:46:01 ctl02 nova-api[8048]: 2017-09-28 12:46:01.059 8048 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:46:01 ctl02 nova-api[8048]: 2017-09-28 12:46:01.059 8048 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:46:01 ctl02 nova-api[8048]: 2017-09-28 12:46:01.059 8048 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:46:01 ctl02 nova-api[8048]: 2017-09-28 12:46:01.059 8048 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:46:01 ctl02 nova-api[8048]: 2017-09-28 12:46:01.059 8048 ERROR nova.wsgi     self.filename))
Sep 28 12:46:01 ctl02 nova-api[8048]: 2017-09-28 12:46:01.059 8048 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:46:01 ctl02 nova-api[8048]: 2017-09-28 12:46:01.059 8048 ERROR nova.wsgi
Sep 28 12:46:01 ctl02 nova-api[8048]: 2017-09-28 12:46:01.061 8048 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:46:01 ctl02 neutron-server[30536]: 2017-09-28 12:46:01.062 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:46:01] "OPTIONS / HTTP/1.0" 200 262 0.000539
Sep 28 12:46:01 ctl02 nova-api[8048]: 2017-09-28 12:46:01.204 8048 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:46:01 ctl02 glance-api[29183]: 2017-09-28 12:46:01.432 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:46:01] "OPTIONS / HTTP/1.0" 200 134 0.000716
Sep 28 12:46:01 ctl02 neutron-server[30536]: 2017-09-28 12:46:01.449 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:46:01] "OPTIONS / HTTP/1.0" 200 262 0.000529
Sep 28 12:46:01 ctl02 nova-api[8048]: 2017-09-28 12:46:01.464 8048 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:46:01 ctl02 nova-api[8048]: 2017-09-28 12:46:01.466 8048 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:46:01 ctl02 nova-api[8048]: 2017-09-28 12:46:01.466 8048 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:46:01 ctl02 nova-api[8048]: 2017-09-28 12:46:01.467 8048 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:46:01 ctl02 nova-api[8048]: 2017-09-28 12:46:01.610 8048 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:46:01 ctl02 nova-api[8048]: 2017-09-28 12:46:01.613 8048 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:46:01 ctl02 nova-api[8048]: 2017-09-28 12:46:01.613 8048 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:46:01 ctl02 nova-api[8048]: 2017-09-28 12:46:01.613 8048 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:46:01 ctl02 nova-api[8048]: 2017-09-28 12:46:01.617 8048 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:46:01 ctl02 nova-api[8048]: 2017-09-28 12:46:01.617 8048 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:46:01 ctl02 nova-api[8048]: 2017-09-28 12:46:01.617 8048 ERROR nova Traceback (most recent call last):
Sep 28 12:46:01 ctl02 nova-api[8048]: 2017-09-28 12:46:01.617 8048 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:46:01 ctl02 nova-api[8048]: 2017-09-28 12:46:01.617 8048 ERROR nova     sys.exit(main())
Sep 28 12:46:01 ctl02 nova-api[8048]: 2017-09-28 12:46:01.617 8048 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:46:01 ctl02 nova-api[8048]: 2017-09-28 12:46:01.617 8048 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:46:01 ctl02 nova-api[8048]: 2017-09-28 12:46:01.617 8048 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:46:01 ctl02 nova-api[8048]: 2017-09-28 12:46:01.617 8048 ERROR nova     max_url_len=max_url_len)
Sep 28 12:46:01 ctl02 nova-api[8048]: 2017-09-28 12:46:01.617 8048 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:46:01 ctl02 nova-api[8048]: 2017-09-28 12:46:01.617 8048 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:46:01 ctl02 nova-api[8048]: 2017-09-28 12:46:01.617 8048 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:46:01 ctl02 nova-api[8048]: 2017-09-28 12:46:01.617 8048 ERROR nova     sock.listen(backlog)
Sep 28 12:46:01 ctl02 nova-api[8048]: 2017-09-28 12:46:01.617 8048 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:46:01 ctl02 nova-api[8048]: 2017-09-28 12:46:01.617 8048 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:46:01 ctl02 nova-api[8048]: 2017-09-28 12:46:01.617 8048 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:46:01 ctl02 nova-api[8048]: 2017-09-28 12:46:01.617 8048 ERROR nova
Sep 28 12:46:01 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:46:01 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:46:01 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:46:01 ctl02 heat-api-cfn[13300]: 2017-09-28 12:46:01.967 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:46:01] "OPTIONS / HTTP/1.0" 200 134 0.000634
Sep 28 12:46:02 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:46:02 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:46:02 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:46:02 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:46:02 ctl02 glance-api[29183]: 2017-09-28 12:46:02.320 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:46:02] "OPTIONS / HTTP/1.0" 200 134 0.000622
Sep 28 12:46:03 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfcd07f5e)
Sep 28 12:46:03 ctl02 nova-api[8066]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:46:03 ctl02 nova-api[8066]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:46:04 ctl02 nova-api[8066]: 2017-09-28 12:46:04.003 8066 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:46:04 ctl02 nova-api[8066]: 2017-09-28 12:46:04.005 8066 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:46:04 ctl02 nova-api[8066]: 2017-09-28 12:46:04.005 8066 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:46:04 ctl02 nova-api[8066]: 2017-09-28 12:46:04.005 8066 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:46:04 ctl02 nova-api[8066]: 2017-09-28 12:46:04.005 8066 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:46:04 ctl02 nova-api[8066]: 2017-09-28 12:46:04.005 8066 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:46:04 ctl02 nova-api[8066]: 2017-09-28 12:46:04.005 8066 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:46:04 ctl02 nova-api[8066]: 2017-09-28 12:46:04.005 8066 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:46:04 ctl02 nova-api[8066]: 2017-09-28 12:46:04.005 8066 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:46:04 ctl02 nova-api[8066]: 2017-09-28 12:46:04.005 8066 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:46:04 ctl02 nova-api[8066]: 2017-09-28 12:46:04.005 8066 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:46:04 ctl02 nova-api[8066]: 2017-09-28 12:46:04.005 8066 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:46:04 ctl02 nova-api[8066]: 2017-09-28 12:46:04.005 8066 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:46:04 ctl02 nova-api[8066]: 2017-09-28 12:46:04.005 8066 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:46:04 ctl02 nova-api[8066]: 2017-09-28 12:46:04.005 8066 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:46:04 ctl02 nova-api[8066]: 2017-09-28 12:46:04.005 8066 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:46:04 ctl02 nova-api[8066]: 2017-09-28 12:46:04.005 8066 ERROR nova.wsgi     self.filename))
Sep 28 12:46:04 ctl02 nova-api[8066]: 2017-09-28 12:46:04.005 8066 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:46:04 ctl02 nova-api[8066]: 2017-09-28 12:46:04.005 8066 ERROR nova.wsgi
Sep 28 12:46:04 ctl02 nova-api[8066]: 2017-09-28 12:46:04.006 8066 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:46:04 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfcd07f5e)
Sep 28 12:46:04 ctl02 nova-api[8066]: 2017-09-28 12:46:04.134 8066 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:46:04 ctl02 nova-api[8066]: 2017-09-28 12:46:04.362 8066 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:46:04 ctl02 nova-api[8066]: 2017-09-28 12:46:04.364 8066 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:46:04 ctl02 nova-api[8066]: 2017-09-28 12:46:04.364 8066 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:46:04 ctl02 nova-api[8066]: 2017-09-28 12:46:04.365 8066 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:46:04 ctl02 nova-api[8066]: 2017-09-28 12:46:04.500 8066 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:46:04 ctl02 nova-api[8066]: 2017-09-28 12:46:04.501 8066 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:46:04 ctl02 nova-api[8066]: 2017-09-28 12:46:04.502 8066 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:46:04 ctl02 nova-api[8066]: 2017-09-28 12:46:04.502 8066 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:46:04 ctl02 nova-api[8066]: 2017-09-28 12:46:04.505 8066 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:46:04 ctl02 nova-api[8066]: 2017-09-28 12:46:04.505 8066 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:46:04 ctl02 nova-api[8066]: 2017-09-28 12:46:04.505 8066 ERROR nova Traceback (most recent call last):
Sep 28 12:46:04 ctl02 nova-api[8066]: 2017-09-28 12:46:04.505 8066 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:46:04 ctl02 nova-api[8066]: 2017-09-28 12:46:04.505 8066 ERROR nova     sys.exit(main())
Sep 28 12:46:04 ctl02 nova-api[8066]: 2017-09-28 12:46:04.505 8066 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:46:04 ctl02 nova-api[8066]: 2017-09-28 12:46:04.505 8066 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:46:04 ctl02 nova-api[8066]: 2017-09-28 12:46:04.505 8066 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:46:04 ctl02 nova-api[8066]: 2017-09-28 12:46:04.505 8066 ERROR nova     max_url_len=max_url_len)
Sep 28 12:46:04 ctl02 nova-api[8066]: 2017-09-28 12:46:04.505 8066 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:46:04 ctl02 nova-api[8066]: 2017-09-28 12:46:04.505 8066 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:46:04 ctl02 nova-api[8066]: 2017-09-28 12:46:04.505 8066 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:46:04 ctl02 nova-api[8066]: 2017-09-28 12:46:04.505 8066 ERROR nova     sock.listen(backlog)
Sep 28 12:46:04 ctl02 nova-api[8066]: 2017-09-28 12:46:04.505 8066 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:46:04 ctl02 nova-api[8066]: 2017-09-28 12:46:04.505 8066 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:46:04 ctl02 nova-api[8066]: 2017-09-28 12:46:04.505 8066 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:46:04 ctl02 nova-api[8066]: 2017-09-28 12:46:04.505 8066 ERROR nova
Sep 28 12:46:04 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:46:04 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:46:04 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:46:04 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:46:04.870 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:46:04] "OPTIONS / HTTP/1.0" 200 134 0.000510
Sep 28 12:46:04 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:46:04 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:46:04 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:46:04 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:46:05 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfcd07f5e)
Sep 28 12:46:05 ctl02 heat-api[13008]: 2017-09-28 12:46:05.720 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:46:05] "OPTIONS / HTTP/1.0" 200 134 0.000577
Sep 28 12:46:06 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfcd07f5e)
Sep 28 12:46:06 ctl02 neutron-server[30536]: 2017-09-28 12:46:06.253 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 12:46:06 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:46:06 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:44:56 cmp002
Sep 28 12:46:06 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:45:28 cmp001
Sep 28 12:46:06 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:45:20 cmp002
Sep 28 12:46:06 ctl02 nova-api[8084]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:46:06 ctl02 nova-api[8084]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:46:06 ctl02 heat-api[13008]: 2017-09-28 12:46:06.649 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:46:06] "OPTIONS / HTTP/1.0" 200 134 0.000569
Sep 28 12:46:06 ctl02 nova-api[8084]: 2017-09-28 12:46:06.764 8084 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:46:06 ctl02 nova-api[8084]: 2017-09-28 12:46:06.766 8084 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:46:06 ctl02 nova-api[8084]: 2017-09-28 12:46:06.766 8084 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:46:06 ctl02 nova-api[8084]: 2017-09-28 12:46:06.766 8084 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:46:06 ctl02 nova-api[8084]: 2017-09-28 12:46:06.766 8084 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:46:06 ctl02 nova-api[8084]: 2017-09-28 12:46:06.766 8084 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:46:06 ctl02 nova-api[8084]: 2017-09-28 12:46:06.766 8084 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:46:06 ctl02 nova-api[8084]: 2017-09-28 12:46:06.766 8084 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:46:06 ctl02 nova-api[8084]: 2017-09-28 12:46:06.766 8084 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:46:06 ctl02 nova-api[8084]: 2017-09-28 12:46:06.766 8084 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:46:06 ctl02 nova-api[8084]: 2017-09-28 12:46:06.766 8084 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:46:06 ctl02 nova-api[8084]: 2017-09-28 12:46:06.766 8084 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:46:06 ctl02 nova-api[8084]: 2017-09-28 12:46:06.766 8084 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:46:06 ctl02 nova-api[8084]: 2017-09-28 12:46:06.766 8084 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:46:06 ctl02 nova-api[8084]: 2017-09-28 12:46:06.766 8084 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:46:06 ctl02 nova-api[8084]: 2017-09-28 12:46:06.766 8084 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:46:06 ctl02 nova-api[8084]: 2017-09-28 12:46:06.766 8084 ERROR nova.wsgi     self.filename))
Sep 28 12:46:06 ctl02 nova-api[8084]: 2017-09-28 12:46:06.766 8084 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:46:06 ctl02 nova-api[8084]: 2017-09-28 12:46:06.766 8084 ERROR nova.wsgi
Sep 28 12:46:06 ctl02 nova-api[8084]: 2017-09-28 12:46:06.767 8084 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:46:06 ctl02 nova-api[8084]: 2017-09-28 12:46:06.895 8084 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:46:06 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:46:06.939 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:46:06] "OPTIONS / HTTP/1.0" 200 134 0.000467
Sep 28 12:46:07 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfcd07f5e)
Sep 28 12:46:07 ctl02 heat-api[13008]: 2017-09-28 12:46:07.107 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:46:07] "OPTIONS / HTTP/1.0" 200 134 0.000865
Sep 28 12:46:07 ctl02 nova-api[8084]: 2017-09-28 12:46:07.126 8084 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:46:07 ctl02 nova-api[8084]: 2017-09-28 12:46:07.129 8084 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:46:07 ctl02 nova-api[8084]: 2017-09-28 12:46:07.129 8084 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:46:07 ctl02 nova-api[8084]: 2017-09-28 12:46:07.129 8084 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:46:07 ctl02 nova-api[8084]: 2017-09-28 12:46:07.266 8084 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:46:07 ctl02 nova-api[8084]: 2017-09-28 12:46:07.267 8084 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:46:07 ctl02 nova-api[8084]: 2017-09-28 12:46:07.268 8084 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:46:07 ctl02 nova-api[8084]: 2017-09-28 12:46:07.268 8084 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:46:07 ctl02 nova-api[8084]: 2017-09-28 12:46:07.271 8084 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:46:07 ctl02 nova-api[8084]: 2017-09-28 12:46:07.272 8084 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:46:07 ctl02 nova-api[8084]: 2017-09-28 12:46:07.272 8084 ERROR nova Traceback (most recent call last):
Sep 28 12:46:07 ctl02 nova-api[8084]: 2017-09-28 12:46:07.272 8084 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:46:07 ctl02 nova-api[8084]: 2017-09-28 12:46:07.272 8084 ERROR nova     sys.exit(main())
Sep 28 12:46:07 ctl02 nova-api[8084]: 2017-09-28 12:46:07.272 8084 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:46:07 ctl02 nova-api[8084]: 2017-09-28 12:46:07.272 8084 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:46:07 ctl02 nova-api[8084]: 2017-09-28 12:46:07.272 8084 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:46:07 ctl02 nova-api[8084]: 2017-09-28 12:46:07.272 8084 ERROR nova     max_url_len=max_url_len)
Sep 28 12:46:07 ctl02 nova-api[8084]: 2017-09-28 12:46:07.272 8084 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:46:07 ctl02 nova-api[8084]: 2017-09-28 12:46:07.272 8084 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:46:07 ctl02 nova-api[8084]: 2017-09-28 12:46:07.272 8084 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:46:07 ctl02 nova-api[8084]: 2017-09-28 12:46:07.272 8084 ERROR nova     sock.listen(backlog)
Sep 28 12:46:07 ctl02 nova-api[8084]: 2017-09-28 12:46:07.272 8084 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:46:07 ctl02 nova-api[8084]: 2017-09-28 12:46:07.272 8084 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:46:07 ctl02 nova-api[8084]: 2017-09-28 12:46:07.272 8084 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:46:07 ctl02 nova-api[8084]: 2017-09-28 12:46:07.272 8084 ERROR nova
Sep 28 12:46:07 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:46:07 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:46:07 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:46:07 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:46:07 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:46:07 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:46:07 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:46:07 ctl02 heat-api-cfn[13300]: 2017-09-28 12:46:07.764 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:46:07] "OPTIONS / HTTP/1.0" 200 134 0.000480
Sep 28 12:46:07 ctl02 heat-api-cfn[13300]: 2017-09-28 12:46:07.885 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:46:07] "OPTIONS / HTTP/1.0" 200 134 0.000452
Sep 28 12:46:08 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfcd07f5e)
Sep 28 12:46:08 ctl02 nova-consoleauth[5433]: 2017-09-28 12:46:08.690 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:46:09 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfcd07f5e)
Sep 28 12:46:09 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:46:09.124 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:46:09] "OPTIONS / HTTP/1.0" 200 134 0.000465
Sep 28 12:46:09 ctl02 nova-api[8101]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:46:09 ctl02 nova-api[8101]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:46:09 ctl02 nova-api[8101]: 2017-09-28 12:46:09.477 8101 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:46:09 ctl02 nova-api[8101]: 2017-09-28 12:46:09.478 8101 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:46:09 ctl02 nova-api[8101]: 2017-09-28 12:46:09.478 8101 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:46:09 ctl02 nova-api[8101]: 2017-09-28 12:46:09.478 8101 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:46:09 ctl02 nova-api[8101]: 2017-09-28 12:46:09.478 8101 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:46:09 ctl02 nova-api[8101]: 2017-09-28 12:46:09.478 8101 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:46:09 ctl02 nova-api[8101]: 2017-09-28 12:46:09.478 8101 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:46:09 ctl02 nova-api[8101]: 2017-09-28 12:46:09.478 8101 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:46:09 ctl02 nova-api[8101]: 2017-09-28 12:46:09.478 8101 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:46:09 ctl02 nova-api[8101]: 2017-09-28 12:46:09.478 8101 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:46:09 ctl02 nova-api[8101]: 2017-09-28 12:46:09.478 8101 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:46:09 ctl02 nova-api[8101]: 2017-09-28 12:46:09.478 8101 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:46:09 ctl02 nova-api[8101]: 2017-09-28 12:46:09.478 8101 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:46:09 ctl02 nova-api[8101]: 2017-09-28 12:46:09.478 8101 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:46:09 ctl02 nova-api[8101]: 2017-09-28 12:46:09.478 8101 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:46:09 ctl02 nova-api[8101]: 2017-09-28 12:46:09.478 8101 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:46:09 ctl02 nova-api[8101]: 2017-09-28 12:46:09.478 8101 ERROR nova.wsgi     self.filename))
Sep 28 12:46:09 ctl02 nova-api[8101]: 2017-09-28 12:46:09.478 8101 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:46:09 ctl02 nova-api[8101]: 2017-09-28 12:46:09.478 8101 ERROR nova.wsgi
Sep 28 12:46:09 ctl02 nova-api[8101]: 2017-09-28 12:46:09.481 8101 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:46:09 ctl02 nova-api[8101]: 2017-09-28 12:46:09.609 8101 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:46:09 ctl02 nova-api[8101]: 2017-09-28 12:46:09.828 8101 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:46:09 ctl02 nova-api[8101]: 2017-09-28 12:46:09.830 8101 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:46:09 ctl02 nova-api[8101]: 2017-09-28 12:46:09.831 8101 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:46:09 ctl02 nova-api[8101]: 2017-09-28 12:46:09.831 8101 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:46:09 ctl02 neutron-server[30536]: 2017-09-28 12:46:09.936 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:46:09] "OPTIONS / HTTP/1.0" 200 262 0.000461
Sep 28 12:46:09 ctl02 nova-api[8101]: 2017-09-28 12:46:09.962 8101 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:46:09 ctl02 nova-api[8101]: 2017-09-28 12:46:09.965 8101 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:46:09 ctl02 nova-api[8101]: 2017-09-28 12:46:09.965 8101 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:46:09 ctl02 nova-api[8101]: 2017-09-28 12:46:09.965 8101 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:46:09 ctl02 nova-api[8101]: 2017-09-28 12:46:09.969 8101 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:46:09 ctl02 nova-api[8101]: 2017-09-28 12:46:09.969 8101 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:46:09 ctl02 nova-api[8101]: 2017-09-28 12:46:09.969 8101 ERROR nova Traceback (most recent call last):
Sep 28 12:46:09 ctl02 nova-api[8101]: 2017-09-28 12:46:09.969 8101 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:46:09 ctl02 nova-api[8101]: 2017-09-28 12:46:09.969 8101 ERROR nova     sys.exit(main())
Sep 28 12:46:09 ctl02 nova-api[8101]: 2017-09-28 12:46:09.969 8101 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:46:09 ctl02 nova-api[8101]: 2017-09-28 12:46:09.969 8101 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:46:09 ctl02 nova-api[8101]: 2017-09-28 12:46:09.969 8101 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:46:09 ctl02 nova-api[8101]: 2017-09-28 12:46:09.969 8101 ERROR nova     max_url_len=max_url_len)
Sep 28 12:46:09 ctl02 nova-api[8101]: 2017-09-28 12:46:09.969 8101 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:46:09 ctl02 nova-api[8101]: 2017-09-28 12:46:09.969 8101 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:46:09 ctl02 nova-api[8101]: 2017-09-28 12:46:09.969 8101 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:46:09 ctl02 nova-api[8101]: 2017-09-28 12:46:09.969 8101 ERROR nova     sock.listen(backlog)
Sep 28 12:46:09 ctl02 nova-api[8101]: 2017-09-28 12:46:09.969 8101 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:46:09 ctl02 nova-api[8101]: 2017-09-28 12:46:09.969 8101 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:46:09 ctl02 nova-api[8101]: 2017-09-28 12:46:09.969 8101 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:46:09 ctl02 nova-api[8101]: 2017-09-28 12:46:09.969 8101 ERROR nova
Sep 28 12:46:10 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfcd07f5e)
Sep 28 12:46:10 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:46:10 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:46:10 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:46:10 ctl02 heat-engine[12803]: 2017-09-28 12:46:10.137 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:46:10 ctl02 heat-engine[12803]: 2017-09-28 12:46:10.148 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:46:10 ctl02 heat-engine[12803]: 2017-09-28 12:46:10.149 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:46:10 ctl02 heat-engine[12803]: 2017-09-28 12:46:10.161 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:46:10 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:46:10 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:46:10 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:46:10 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:46:10 ctl02 glance-api[29183]: 2017-09-28 12:46:10.599 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:46:10] "OPTIONS / HTTP/1.0" 200 134 0.000957
Sep 28 12:46:11 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfcd07f5e)
Sep 28 12:46:11 ctl02 neutron-server[30536]: 2017-09-28 12:46:11.147 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:46:11] "OPTIONS / HTTP/1.0" 200 262 0.000518
Sep 28 12:46:11 ctl02 glance-api[29183]: 2017-09-28 12:46:11.198 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:46:11] "OPTIONS / HTTP/1.0" 200 134 0.000539
Sep 28 12:46:11 ctl02 neutron-server[30536]: 2017-09-28 12:46:11.565 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:46:11] "OPTIONS / HTTP/1.0" 200 262 0.000716
Sep 28 12:46:11 ctl02 nova-scheduler[5620]: 2017-09-28 12:46:11.790 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:46:11 ctl02 heat-api-cfn[13300]: 2017-09-28 12:46:11.894 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:46:11] "OPTIONS / HTTP/1.0" 200 134 0.000510
Sep 28 12:46:12 ctl02 glance-api[29183]: 2017-09-28 12:46:12.047 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:46:12] "OPTIONS / HTTP/1.0" 200 134 0.000613
Sep 28 12:46:12 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfcd07f5e)
Sep 28 12:46:12 ctl02 nova-api[8120]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:46:12 ctl02 nova-api[8120]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:46:12 ctl02 nova-api[8120]: 2017-09-28 12:46:12.310 8120 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:46:12 ctl02 nova-api[8120]: 2017-09-28 12:46:12.312 8120 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:46:12 ctl02 nova-api[8120]: 2017-09-28 12:46:12.312 8120 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:46:12 ctl02 nova-api[8120]: 2017-09-28 12:46:12.312 8120 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:46:12 ctl02 nova-api[8120]: 2017-09-28 12:46:12.312 8120 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:46:12 ctl02 nova-api[8120]: 2017-09-28 12:46:12.312 8120 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:46:12 ctl02 nova-api[8120]: 2017-09-28 12:46:12.312 8120 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:46:12 ctl02 nova-api[8120]: 2017-09-28 12:46:12.312 8120 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:46:12 ctl02 nova-api[8120]: 2017-09-28 12:46:12.312 8120 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:46:12 ctl02 nova-api[8120]: 2017-09-28 12:46:12.312 8120 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:46:12 ctl02 nova-api[8120]: 2017-09-28 12:46:12.312 8120 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:46:12 ctl02 nova-api[8120]: 2017-09-28 12:46:12.312 8120 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:46:12 ctl02 nova-api[8120]: 2017-09-28 12:46:12.312 8120 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:46:12 ctl02 nova-api[8120]: 2017-09-28 12:46:12.312 8120 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:46:12 ctl02 nova-api[8120]: 2017-09-28 12:46:12.312 8120 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:46:12 ctl02 nova-api[8120]: 2017-09-28 12:46:12.312 8120 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:46:12 ctl02 nova-api[8120]: 2017-09-28 12:46:12.312 8120 ERROR nova.wsgi     self.filename))
Sep 28 12:46:12 ctl02 nova-api[8120]: 2017-09-28 12:46:12.312 8120 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:46:12 ctl02 nova-api[8120]: 2017-09-28 12:46:12.312 8120 ERROR nova.wsgi
Sep 28 12:46:12 ctl02 nova-api[8120]: 2017-09-28 12:46:12.313 8120 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:46:12 ctl02 nova-api[8120]: 2017-09-28 12:46:12.444 8120 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:46:12 ctl02 nova-api[8120]: 2017-09-28 12:46:12.692 8120 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:46:12 ctl02 nova-api[8120]: 2017-09-28 12:46:12.694 8120 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:46:12 ctl02 nova-api[8120]: 2017-09-28 12:46:12.694 8120 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:46:12 ctl02 nova-api[8120]: 2017-09-28 12:46:12.695 8120 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:46:12 ctl02 nova-api[8120]: 2017-09-28 12:46:12.829 8120 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:46:12 ctl02 nova-api[8120]: 2017-09-28 12:46:12.831 8120 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:46:12 ctl02 nova-api[8120]: 2017-09-28 12:46:12.831 8120 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:46:12 ctl02 nova-api[8120]: 2017-09-28 12:46:12.832 8120 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:46:12 ctl02 nova-api[8120]: 2017-09-28 12:46:12.835 8120 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:46:12 ctl02 nova-api[8120]: 2017-09-28 12:46:12.835 8120 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:46:12 ctl02 nova-api[8120]: 2017-09-28 12:46:12.835 8120 ERROR nova Traceback (most recent call last):
Sep 28 12:46:12 ctl02 nova-api[8120]: 2017-09-28 12:46:12.835 8120 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:46:12 ctl02 nova-api[8120]: 2017-09-28 12:46:12.835 8120 ERROR nova     sys.exit(main())
Sep 28 12:46:12 ctl02 nova-api[8120]: 2017-09-28 12:46:12.835 8120 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:46:12 ctl02 nova-api[8120]: 2017-09-28 12:46:12.835 8120 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:46:12 ctl02 nova-api[8120]: 2017-09-28 12:46:12.835 8120 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:46:12 ctl02 nova-api[8120]: 2017-09-28 12:46:12.835 8120 ERROR nova     max_url_len=max_url_len)
Sep 28 12:46:12 ctl02 nova-api[8120]: 2017-09-28 12:46:12.835 8120 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:46:12 ctl02 nova-api[8120]: 2017-09-28 12:46:12.835 8120 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:46:12 ctl02 nova-api[8120]: 2017-09-28 12:46:12.835 8120 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:46:12 ctl02 nova-api[8120]: 2017-09-28 12:46:12.835 8120 ERROR nova     sock.listen(backlog)
Sep 28 12:46:12 ctl02 nova-api[8120]: 2017-09-28 12:46:12.835 8120 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:46:12 ctl02 nova-api[8120]: 2017-09-28 12:46:12.835 8120 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:46:12 ctl02 nova-api[8120]: 2017-09-28 12:46:12.835 8120 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:46:12 ctl02 nova-api[8120]: 2017-09-28 12:46:12.835 8120 ERROR nova
Sep 28 12:46:13 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:46:13 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:46:13 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:46:13 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfcd07f5e)
Sep 28 12:46:13 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:46:13 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:46:13 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:46:13 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:46:14 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:46:14 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:46:14 ctl02 nova-api[8136]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:46:14 ctl02 nova-api[8136]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:46:15 ctl02 nova-api[8136]: 2017-09-28 12:46:15.018 8136 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:46:15 ctl02 nova-api[8136]: 2017-09-28 12:46:15.020 8136 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:46:15 ctl02 nova-api[8136]: 2017-09-28 12:46:15.020 8136 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:46:15 ctl02 nova-api[8136]: 2017-09-28 12:46:15.020 8136 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:46:15 ctl02 nova-api[8136]: 2017-09-28 12:46:15.020 8136 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:46:15 ctl02 nova-api[8136]: 2017-09-28 12:46:15.020 8136 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:46:15 ctl02 nova-api[8136]: 2017-09-28 12:46:15.020 8136 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:46:15 ctl02 nova-api[8136]: 2017-09-28 12:46:15.020 8136 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:46:15 ctl02 nova-api[8136]: 2017-09-28 12:46:15.020 8136 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:46:15 ctl02 nova-api[8136]: 2017-09-28 12:46:15.020 8136 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:46:15 ctl02 nova-api[8136]: 2017-09-28 12:46:15.020 8136 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:46:15 ctl02 nova-api[8136]: 2017-09-28 12:46:15.020 8136 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:46:15 ctl02 nova-api[8136]: 2017-09-28 12:46:15.020 8136 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:46:15 ctl02 nova-api[8136]: 2017-09-28 12:46:15.020 8136 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:46:15 ctl02 nova-api[8136]: 2017-09-28 12:46:15.020 8136 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:46:15 ctl02 nova-api[8136]: 2017-09-28 12:46:15.020 8136 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:46:15 ctl02 nova-api[8136]: 2017-09-28 12:46:15.020 8136 ERROR nova.wsgi     self.filename))
Sep 28 12:46:15 ctl02 nova-api[8136]: 2017-09-28 12:46:15.020 8136 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:46:15 ctl02 nova-api[8136]: 2017-09-28 12:46:15.020 8136 ERROR nova.wsgi
Sep 28 12:46:15 ctl02 nova-api[8136]: 2017-09-28 12:46:15.021 8136 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:46:15 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:46:15.110 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:46:15] "OPTIONS / HTTP/1.0" 200 134 0.000520
Sep 28 12:46:15 ctl02 nova-api[8136]: 2017-09-28 12:46:15.156 8136 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:46:15 ctl02 nova-api[8136]: 2017-09-28 12:46:15.407 8136 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:46:15 ctl02 nova-api[8136]: 2017-09-28 12:46:15.409 8136 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:46:15 ctl02 nova-api[8136]: 2017-09-28 12:46:15.409 8136 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:46:15 ctl02 nova-api[8136]: 2017-09-28 12:46:15.409 8136 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:46:15 ctl02 nova-api[8136]: 2017-09-28 12:46:15.544 8136 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:46:15 ctl02 nova-api[8136]: 2017-09-28 12:46:15.546 8136 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:46:15 ctl02 nova-api[8136]: 2017-09-28 12:46:15.546 8136 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:46:15 ctl02 nova-api[8136]: 2017-09-28 12:46:15.547 8136 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:46:15 ctl02 nova-api[8136]: 2017-09-28 12:46:15.550 8136 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:46:15 ctl02 nova-api[8136]: 2017-09-28 12:46:15.550 8136 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:46:15 ctl02 nova-api[8136]: 2017-09-28 12:46:15.550 8136 ERROR nova Traceback (most recent call last):
Sep 28 12:46:15 ctl02 nova-api[8136]: 2017-09-28 12:46:15.550 8136 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:46:15 ctl02 nova-api[8136]: 2017-09-28 12:46:15.550 8136 ERROR nova     sys.exit(main())
Sep 28 12:46:15 ctl02 nova-api[8136]: 2017-09-28 12:46:15.550 8136 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:46:15 ctl02 nova-api[8136]: 2017-09-28 12:46:15.550 8136 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:46:15 ctl02 nova-api[8136]: 2017-09-28 12:46:15.550 8136 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:46:15 ctl02 nova-api[8136]: 2017-09-28 12:46:15.550 8136 ERROR nova     max_url_len=max_url_len)
Sep 28 12:46:15 ctl02 nova-api[8136]: 2017-09-28 12:46:15.550 8136 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:46:15 ctl02 nova-api[8136]: 2017-09-28 12:46:15.550 8136 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:46:15 ctl02 nova-api[8136]: 2017-09-28 12:46:15.550 8136 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:46:15 ctl02 nova-api[8136]: 2017-09-28 12:46:15.550 8136 ERROR nova     sock.listen(backlog)
Sep 28 12:46:15 ctl02 nova-api[8136]: 2017-09-28 12:46:15.550 8136 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:46:15 ctl02 nova-api[8136]: 2017-09-28 12:46:15.550 8136 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:46:15 ctl02 nova-api[8136]: 2017-09-28 12:46:15.550 8136 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:46:15 ctl02 nova-api[8136]: 2017-09-28 12:46:15.550 8136 ERROR nova
Sep 28 12:46:15 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:46:15 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:46:15 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:46:15 ctl02 heat-api[13008]: 2017-09-28 12:46:15.875 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:46:15] "OPTIONS / HTTP/1.0" 200 134 0.000623
Sep 28 12:46:15 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:46:15 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:46:15 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:46:15 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:46:16 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:46:16.602 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:46:16] "OPTIONS / HTTP/1.0" 200 134 0.000355
Sep 28 12:46:17 ctl02 heat-api[13008]: 2017-09-28 12:46:17.028 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:46:17] "OPTIONS / HTTP/1.0" 200 134 0.000520
Sep 28 12:46:17 ctl02 heat-api[13008]: 2017-09-28 12:46:17.304 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:46:17] "OPTIONS / HTTP/1.0" 200 134 0.000399
Sep 28 12:46:17 ctl02 heat-api-cfn[13300]: 2017-09-28 12:46:17.500 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:46:17] "OPTIONS / HTTP/1.0" 200 134 0.000441
Sep 28 12:46:17 ctl02 nova-api[8161]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:46:17 ctl02 nova-api[8161]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:46:17 ctl02 heat-api-cfn[13300]: 2017-09-28 12:46:17.652 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:46:17] "OPTIONS / HTTP/1.0" 200 134 0.000466
Sep 28 12:46:17 ctl02 nova-api[8161]: 2017-09-28 12:46:17.750 8161 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:46:17 ctl02 nova-api[8161]: 2017-09-28 12:46:17.751 8161 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:46:17 ctl02 nova-api[8161]: 2017-09-28 12:46:17.751 8161 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:46:17 ctl02 nova-api[8161]: 2017-09-28 12:46:17.751 8161 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:46:17 ctl02 nova-api[8161]: 2017-09-28 12:46:17.751 8161 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:46:17 ctl02 nova-api[8161]: 2017-09-28 12:46:17.751 8161 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:46:17 ctl02 nova-api[8161]: 2017-09-28 12:46:17.751 8161 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:46:17 ctl02 nova-api[8161]: 2017-09-28 12:46:17.751 8161 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:46:17 ctl02 nova-api[8161]: 2017-09-28 12:46:17.751 8161 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:46:17 ctl02 nova-api[8161]: 2017-09-28 12:46:17.751 8161 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:46:17 ctl02 nova-api[8161]: 2017-09-28 12:46:17.751 8161 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:46:17 ctl02 nova-api[8161]: 2017-09-28 12:46:17.751 8161 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:46:17 ctl02 nova-api[8161]: 2017-09-28 12:46:17.751 8161 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:46:17 ctl02 nova-api[8161]: 2017-09-28 12:46:17.751 8161 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:46:17 ctl02 nova-api[8161]: 2017-09-28 12:46:17.751 8161 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:46:17 ctl02 nova-api[8161]: 2017-09-28 12:46:17.751 8161 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:46:17 ctl02 nova-api[8161]: 2017-09-28 12:46:17.751 8161 ERROR nova.wsgi     self.filename))
Sep 28 12:46:17 ctl02 nova-api[8161]: 2017-09-28 12:46:17.751 8161 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:46:17 ctl02 nova-api[8161]: 2017-09-28 12:46:17.751 8161 ERROR nova.wsgi
Sep 28 12:46:17 ctl02 nova-api[8161]: 2017-09-28 12:46:17.752 8161 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:46:17 ctl02 nova-api[8161]: 2017-09-28 12:46:17.878 8161 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:46:18 ctl02 nova-api[8161]: 2017-09-28 12:46:18.102 8161 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:46:18 ctl02 nova-api[8161]: 2017-09-28 12:46:18.105 8161 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:46:18 ctl02 nova-api[8161]: 2017-09-28 12:46:18.105 8161 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:46:18 ctl02 nova-api[8161]: 2017-09-28 12:46:18.105 8161 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:46:18 ctl02 nova-api[8161]: 2017-09-28 12:46:18.236 8161 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:46:18 ctl02 nova-api[8161]: 2017-09-28 12:46:18.238 8161 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:46:18 ctl02 nova-api[8161]: 2017-09-28 12:46:18.238 8161 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:46:18 ctl02 nova-api[8161]: 2017-09-28 12:46:18.239 8161 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:46:18 ctl02 nova-api[8161]: 2017-09-28 12:46:18.242 8161 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:46:18 ctl02 nova-api[8161]: 2017-09-28 12:46:18.242 8161 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:46:18 ctl02 nova-api[8161]: 2017-09-28 12:46:18.242 8161 ERROR nova Traceback (most recent call last):
Sep 28 12:46:18 ctl02 nova-api[8161]: 2017-09-28 12:46:18.242 8161 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:46:18 ctl02 nova-api[8161]: 2017-09-28 12:46:18.242 8161 ERROR nova     sys.exit(main())
Sep 28 12:46:18 ctl02 nova-api[8161]: 2017-09-28 12:46:18.242 8161 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:46:18 ctl02 nova-api[8161]: 2017-09-28 12:46:18.242 8161 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:46:18 ctl02 nova-api[8161]: 2017-09-28 12:46:18.242 8161 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:46:18 ctl02 nova-api[8161]: 2017-09-28 12:46:18.242 8161 ERROR nova     max_url_len=max_url_len)
Sep 28 12:46:18 ctl02 nova-api[8161]: 2017-09-28 12:46:18.242 8161 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:46:18 ctl02 nova-api[8161]: 2017-09-28 12:46:18.242 8161 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:46:18 ctl02 nova-api[8161]: 2017-09-28 12:46:18.242 8161 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:46:18 ctl02 nova-api[8161]: 2017-09-28 12:46:18.242 8161 ERROR nova     sock.listen(backlog)
Sep 28 12:46:18 ctl02 nova-api[8161]: 2017-09-28 12:46:18.242 8161 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:46:18 ctl02 nova-api[8161]: 2017-09-28 12:46:18.242 8161 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:46:18 ctl02 nova-api[8161]: 2017-09-28 12:46:18.242 8161 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:46:18 ctl02 nova-api[8161]: 2017-09-28 12:46:18.242 8161 ERROR nova
Sep 28 12:46:18 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:46:18 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:46:18 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:46:18 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:46:18 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:46:18 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:46:18 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:46:19 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:46:19.096 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:46:19] "OPTIONS / HTTP/1.0" 200 134 0.000468
Sep 28 12:46:20 ctl02 neutron-server[30536]: 2017-09-28 12:46:20.156 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:46:20] "OPTIONS / HTTP/1.0" 200 262 0.000511
Sep 28 12:46:20 ctl02 glance-api[29183]: 2017-09-28 12:46:20.253 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:46:20] "OPTIONS / HTTP/1.0" 200 134 0.000546
Sep 28 12:46:20 ctl02 nova-api[8178]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:46:20 ctl02 nova-api[8178]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:46:20 ctl02 nova-api[8178]: 2017-09-28 12:46:20.464 8178 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:46:20 ctl02 nova-api[8178]: 2017-09-28 12:46:20.465 8178 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:46:20 ctl02 nova-api[8178]: 2017-09-28 12:46:20.465 8178 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:46:20 ctl02 nova-api[8178]: 2017-09-28 12:46:20.465 8178 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:46:20 ctl02 nova-api[8178]: 2017-09-28 12:46:20.465 8178 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:46:20 ctl02 nova-api[8178]: 2017-09-28 12:46:20.465 8178 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:46:20 ctl02 nova-api[8178]: 2017-09-28 12:46:20.465 8178 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:46:20 ctl02 nova-api[8178]: 2017-09-28 12:46:20.465 8178 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:46:20 ctl02 nova-api[8178]: 2017-09-28 12:46:20.465 8178 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:46:20 ctl02 nova-api[8178]: 2017-09-28 12:46:20.465 8178 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:46:20 ctl02 nova-api[8178]: 2017-09-28 12:46:20.465 8178 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:46:20 ctl02 nova-api[8178]: 2017-09-28 12:46:20.465 8178 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:46:20 ctl02 nova-api[8178]: 2017-09-28 12:46:20.465 8178 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:46:20 ctl02 nova-api[8178]: 2017-09-28 12:46:20.465 8178 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:46:20 ctl02 nova-api[8178]: 2017-09-28 12:46:20.465 8178 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:46:20 ctl02 nova-api[8178]: 2017-09-28 12:46:20.465 8178 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:46:20 ctl02 nova-api[8178]: 2017-09-28 12:46:20.465 8178 ERROR nova.wsgi     self.filename))
Sep 28 12:46:20 ctl02 nova-api[8178]: 2017-09-28 12:46:20.465 8178 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:46:20 ctl02 nova-api[8178]: 2017-09-28 12:46:20.465 8178 ERROR nova.wsgi
Sep 28 12:46:20 ctl02 nova-api[8178]: 2017-09-28 12:46:20.466 8178 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:46:20 ctl02 nova-api[8178]: 2017-09-28 12:46:20.591 8178 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:46:20 ctl02 nova-api[8178]: 2017-09-28 12:46:20.812 8178 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:46:20 ctl02 nova-api[8178]: 2017-09-28 12:46:20.814 8178 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:46:20 ctl02 nova-api[8178]: 2017-09-28 12:46:20.814 8178 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:46:20 ctl02 nova-api[8178]: 2017-09-28 12:46:20.815 8178 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:46:20 ctl02 glance-api[29183]: 2017-09-28 12:46:20.933 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:46:20] "OPTIONS / HTTP/1.0" 200 134 0.000699
Sep 28 12:46:20 ctl02 nova-api[8178]: 2017-09-28 12:46:20.943 8178 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:46:20 ctl02 nova-api[8178]: 2017-09-28 12:46:20.945 8178 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:46:20 ctl02 nova-api[8178]: 2017-09-28 12:46:20.945 8178 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:46:20 ctl02 nova-api[8178]: 2017-09-28 12:46:20.945 8178 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:46:20 ctl02 nova-api[8178]: 2017-09-28 12:46:20.949 8178 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:46:20 ctl02 nova-api[8178]: 2017-09-28 12:46:20.949 8178 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:46:20 ctl02 nova-api[8178]: 2017-09-28 12:46:20.949 8178 ERROR nova Traceback (most recent call last):
Sep 28 12:46:20 ctl02 nova-api[8178]: 2017-09-28 12:46:20.949 8178 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:46:20 ctl02 nova-api[8178]: 2017-09-28 12:46:20.949 8178 ERROR nova     sys.exit(main())
Sep 28 12:46:20 ctl02 nova-api[8178]: 2017-09-28 12:46:20.949 8178 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:46:20 ctl02 nova-api[8178]: 2017-09-28 12:46:20.949 8178 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:46:20 ctl02 nova-api[8178]: 2017-09-28 12:46:20.949 8178 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:46:20 ctl02 nova-api[8178]: 2017-09-28 12:46:20.949 8178 ERROR nova     max_url_len=max_url_len)
Sep 28 12:46:20 ctl02 nova-api[8178]: 2017-09-28 12:46:20.949 8178 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:46:20 ctl02 nova-api[8178]: 2017-09-28 12:46:20.949 8178 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:46:20 ctl02 nova-api[8178]: 2017-09-28 12:46:20.949 8178 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:46:20 ctl02 nova-api[8178]: 2017-09-28 12:46:20.949 8178 ERROR nova     sock.listen(backlog)
Sep 28 12:46:20 ctl02 nova-api[8178]: 2017-09-28 12:46:20.949 8178 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:46:20 ctl02 nova-api[8178]: 2017-09-28 12:46:20.949 8178 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:46:20 ctl02 nova-api[8178]: 2017-09-28 12:46:20.949 8178 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:46:20 ctl02 nova-api[8178]: 2017-09-28 12:46:20.949 8178 ERROR nova
Sep 28 12:46:21 ctl02 neutron-server[30536]: 2017-09-28 12:46:21.003 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:46:21] "OPTIONS / HTTP/1.0" 200 262 0.000566
Sep 28 12:46:21 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:46:21 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:46:21 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:46:21 ctl02 neutron-server[30536]: 2017-09-28 12:46:21.250 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 12:46:21 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:46:21 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:44:56 cmp002
Sep 28 12:46:21 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:45:28 cmp001
Sep 28 12:46:21 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:45:20 cmp002
Sep 28 12:46:21 ctl02 neutron-server[30536]: 2017-09-28 12:46:21.369 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:46:21] "OPTIONS / HTTP/1.0" 200 262 0.000679
Sep 28 12:46:21 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:46:21 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:46:21 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:46:21 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:46:21 ctl02 heat-api-cfn[13300]: 2017-09-28 12:46:21.856 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:46:21] "OPTIONS / HTTP/1.0" 200 134 0.000472
Sep 28 12:46:21 ctl02 glance-api[29183]: 2017-09-28 12:46:21.892 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:46:21] "OPTIONS / HTTP/1.0" 200 134 0.000643
Sep 28 12:46:23 ctl02 nova-api[8197]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:46:23 ctl02 nova-api[8197]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:46:23 ctl02 nova-api[8197]: 2017-09-28 12:46:23.230 8197 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:46:23 ctl02 nova-api[8197]: 2017-09-28 12:46:23.232 8197 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:46:23 ctl02 nova-api[8197]: 2017-09-28 12:46:23.232 8197 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:46:23 ctl02 nova-api[8197]: 2017-09-28 12:46:23.232 8197 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:46:23 ctl02 nova-api[8197]: 2017-09-28 12:46:23.232 8197 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:46:23 ctl02 nova-api[8197]: 2017-09-28 12:46:23.232 8197 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:46:23 ctl02 nova-api[8197]: 2017-09-28 12:46:23.232 8197 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:46:23 ctl02 nova-api[8197]: 2017-09-28 12:46:23.232 8197 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:46:23 ctl02 nova-api[8197]: 2017-09-28 12:46:23.232 8197 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:46:23 ctl02 nova-api[8197]: 2017-09-28 12:46:23.232 8197 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:46:23 ctl02 nova-api[8197]: 2017-09-28 12:46:23.232 8197 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:46:23 ctl02 nova-api[8197]: 2017-09-28 12:46:23.232 8197 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:46:23 ctl02 nova-api[8197]: 2017-09-28 12:46:23.232 8197 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:46:23 ctl02 nova-api[8197]: 2017-09-28 12:46:23.232 8197 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:46:23 ctl02 nova-api[8197]: 2017-09-28 12:46:23.232 8197 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:46:23 ctl02 nova-api[8197]: 2017-09-28 12:46:23.232 8197 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:46:23 ctl02 nova-api[8197]: 2017-09-28 12:46:23.232 8197 ERROR nova.wsgi     self.filename))
Sep 28 12:46:23 ctl02 nova-api[8197]: 2017-09-28 12:46:23.232 8197 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:46:23 ctl02 nova-api[8197]: 2017-09-28 12:46:23.232 8197 ERROR nova.wsgi
Sep 28 12:46:23 ctl02 nova-api[8197]: 2017-09-28 12:46:23.232 8197 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:46:23 ctl02 nova-api[8197]: 2017-09-28 12:46:23.359 8197 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:46:23 ctl02 nova-api[8197]: 2017-09-28 12:46:23.581 8197 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:46:23 ctl02 nova-api[8197]: 2017-09-28 12:46:23.583 8197 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:46:23 ctl02 nova-api[8197]: 2017-09-28 12:46:23.583 8197 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:46:23 ctl02 nova-api[8197]: 2017-09-28 12:46:23.583 8197 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:46:23 ctl02 nova-api[8197]: 2017-09-28 12:46:23.713 8197 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:46:23 ctl02 nova-api[8197]: 2017-09-28 12:46:23.715 8197 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:46:23 ctl02 nova-api[8197]: 2017-09-28 12:46:23.715 8197 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:46:23 ctl02 nova-api[8197]: 2017-09-28 12:46:23.715 8197 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:46:23 ctl02 nova-api[8197]: 2017-09-28 12:46:23.718 8197 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:46:23 ctl02 nova-api[8197]: 2017-09-28 12:46:23.719 8197 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:46:23 ctl02 nova-api[8197]: 2017-09-28 12:46:23.719 8197 ERROR nova Traceback (most recent call last):
Sep 28 12:46:23 ctl02 nova-api[8197]: 2017-09-28 12:46:23.719 8197 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:46:23 ctl02 nova-api[8197]: 2017-09-28 12:46:23.719 8197 ERROR nova     sys.exit(main())
Sep 28 12:46:23 ctl02 nova-api[8197]: 2017-09-28 12:46:23.719 8197 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:46:23 ctl02 nova-api[8197]: 2017-09-28 12:46:23.719 8197 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:46:23 ctl02 nova-api[8197]: 2017-09-28 12:46:23.719 8197 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:46:23 ctl02 nova-api[8197]: 2017-09-28 12:46:23.719 8197 ERROR nova     max_url_len=max_url_len)
Sep 28 12:46:23 ctl02 nova-api[8197]: 2017-09-28 12:46:23.719 8197 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:46:23 ctl02 nova-api[8197]: 2017-09-28 12:46:23.719 8197 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:46:23 ctl02 nova-api[8197]: 2017-09-28 12:46:23.719 8197 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:46:23 ctl02 nova-api[8197]: 2017-09-28 12:46:23.719 8197 ERROR nova     sock.listen(backlog)
Sep 28 12:46:23 ctl02 nova-api[8197]: 2017-09-28 12:46:23.719 8197 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:46:23 ctl02 nova-api[8197]: 2017-09-28 12:46:23.719 8197 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:46:23 ctl02 nova-api[8197]: 2017-09-28 12:46:23.719 8197 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:46:23 ctl02 nova-api[8197]: 2017-09-28 12:46:23.719 8197 ERROR nova
Sep 28 12:46:23 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:46:23 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:46:23 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:46:24 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:46:24 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:46:24 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:46:24 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:46:25 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:46:25.204 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:46:25] "OPTIONS / HTTP/1.0" 200 134 0.000490
Sep 28 12:46:25 ctl02 nova-api[8214]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:46:25 ctl02 nova-api[8214]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:46:25 ctl02 heat-api[13008]: 2017-09-28 12:46:25.972 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:46:25] "OPTIONS / HTTP/1.0" 200 134 0.000593
Sep 28 12:46:25 ctl02 nova-api[8214]: 2017-09-28 12:46:25.992 8214 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:46:25 ctl02 nova-api[8214]: 2017-09-28 12:46:25.994 8214 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:46:25 ctl02 nova-api[8214]: 2017-09-28 12:46:25.994 8214 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:46:25 ctl02 nova-api[8214]: 2017-09-28 12:46:25.994 8214 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:46:25 ctl02 nova-api[8214]: 2017-09-28 12:46:25.994 8214 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:46:25 ctl02 nova-api[8214]: 2017-09-28 12:46:25.994 8214 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:46:25 ctl02 nova-api[8214]: 2017-09-28 12:46:25.994 8214 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:46:25 ctl02 nova-api[8214]: 2017-09-28 12:46:25.994 8214 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:46:25 ctl02 nova-api[8214]: 2017-09-28 12:46:25.994 8214 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:46:25 ctl02 nova-api[8214]: 2017-09-28 12:46:25.994 8214 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:46:25 ctl02 nova-api[8214]: 2017-09-28 12:46:25.994 8214 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:46:25 ctl02 nova-api[8214]: 2017-09-28 12:46:25.994 8214 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:46:25 ctl02 nova-api[8214]: 2017-09-28 12:46:25.994 8214 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:46:25 ctl02 nova-api[8214]: 2017-09-28 12:46:25.994 8214 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:46:25 ctl02 nova-api[8214]: 2017-09-28 12:46:25.994 8214 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:46:25 ctl02 nova-api[8214]: 2017-09-28 12:46:25.994 8214 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:46:25 ctl02 nova-api[8214]: 2017-09-28 12:46:25.994 8214 ERROR nova.wsgi     self.filename))
Sep 28 12:46:25 ctl02 nova-api[8214]: 2017-09-28 12:46:25.994 8214 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:46:25 ctl02 nova-api[8214]: 2017-09-28 12:46:25.994 8214 ERROR nova.wsgi
Sep 28 12:46:25 ctl02 nova-api[8214]: 2017-09-28 12:46:25.995 8214 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:46:26 ctl02 nova-api[8214]: 2017-09-28 12:46:26.122 8214 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:46:26 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:46:26.296 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:46:26] "OPTIONS / HTTP/1.0" 200 134 0.000404
Sep 28 12:46:26 ctl02 nova-api[8214]: 2017-09-28 12:46:26.355 8214 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:46:26 ctl02 nova-api[8214]: 2017-09-28 12:46:26.357 8214 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:46:26 ctl02 nova-api[8214]: 2017-09-28 12:46:26.357 8214 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:46:26 ctl02 nova-api[8214]: 2017-09-28 12:46:26.357 8214 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:46:26 ctl02 nova-api[8214]: 2017-09-28 12:46:26.487 8214 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:46:26 ctl02 nova-api[8214]: 2017-09-28 12:46:26.489 8214 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:46:26 ctl02 nova-api[8214]: 2017-09-28 12:46:26.489 8214 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:46:26 ctl02 nova-api[8214]: 2017-09-28 12:46:26.489 8214 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:46:26 ctl02 nova-api[8214]: 2017-09-28 12:46:26.493 8214 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:46:26 ctl02 nova-api[8214]: 2017-09-28 12:46:26.493 8214 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:46:26 ctl02 nova-api[8214]: 2017-09-28 12:46:26.493 8214 ERROR nova Traceback (most recent call last):
Sep 28 12:46:26 ctl02 nova-api[8214]: 2017-09-28 12:46:26.493 8214 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:46:26 ctl02 nova-api[8214]: 2017-09-28 12:46:26.493 8214 ERROR nova     sys.exit(main())
Sep 28 12:46:26 ctl02 nova-api[8214]: 2017-09-28 12:46:26.493 8214 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:46:26 ctl02 nova-api[8214]: 2017-09-28 12:46:26.493 8214 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:46:26 ctl02 nova-api[8214]: 2017-09-28 12:46:26.493 8214 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:46:26 ctl02 nova-api[8214]: 2017-09-28 12:46:26.493 8214 ERROR nova     max_url_len=max_url_len)
Sep 28 12:46:26 ctl02 nova-api[8214]: 2017-09-28 12:46:26.493 8214 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:46:26 ctl02 nova-api[8214]: 2017-09-28 12:46:26.493 8214 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:46:26 ctl02 nova-api[8214]: 2017-09-28 12:46:26.493 8214 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:46:26 ctl02 nova-api[8214]: 2017-09-28 12:46:26.493 8214 ERROR nova     sock.listen(backlog)
Sep 28 12:46:26 ctl02 nova-api[8214]: 2017-09-28 12:46:26.493 8214 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:46:26 ctl02 nova-api[8214]: 2017-09-28 12:46:26.493 8214 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:46:26 ctl02 nova-api[8214]: 2017-09-28 12:46:26.493 8214 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:46:26 ctl02 nova-api[8214]: 2017-09-28 12:46:26.493 8214 ERROR nova
Sep 28 12:46:26 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:46:26 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:46:26 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:46:26 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:46:26 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:46:26 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:46:26 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:46:27 ctl02 heat-api[13008]: 2017-09-28 12:46:27.306 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:46:27] "OPTIONS / HTTP/1.0" 200 134 0.000522
Sep 28 12:46:27 ctl02 heat-api[13008]: 2017-09-28 12:46:27.373 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:46:27] "OPTIONS / HTTP/1.0" 200 134 0.000393
Sep 28 12:46:27 ctl02 heat-api-cfn[13300]: 2017-09-28 12:46:27.685 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:46:27] "OPTIONS / HTTP/1.0" 200 134 0.000660
Sep 28 12:46:27 ctl02 heat-api-cfn[13300]: 2017-09-28 12:46:27.844 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:46:27] "OPTIONS / HTTP/1.0" 200 134 0.000456
Sep 28 12:46:28 ctl02 nova-api[8234]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:46:28 ctl02 nova-api[8234]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:46:28 ctl02 nova-api[8234]: 2017-09-28 12:46:28.718 8234 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:46:28 ctl02 nova-api[8234]: 2017-09-28 12:46:28.720 8234 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:46:28 ctl02 nova-api[8234]: 2017-09-28 12:46:28.720 8234 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:46:28 ctl02 nova-api[8234]: 2017-09-28 12:46:28.720 8234 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:46:28 ctl02 nova-api[8234]: 2017-09-28 12:46:28.720 8234 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:46:28 ctl02 nova-api[8234]: 2017-09-28 12:46:28.720 8234 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:46:28 ctl02 nova-api[8234]: 2017-09-28 12:46:28.720 8234 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:46:28 ctl02 nova-api[8234]: 2017-09-28 12:46:28.720 8234 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:46:28 ctl02 nova-api[8234]: 2017-09-28 12:46:28.720 8234 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:46:28 ctl02 nova-api[8234]: 2017-09-28 12:46:28.720 8234 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:46:28 ctl02 nova-api[8234]: 2017-09-28 12:46:28.720 8234 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:46:28 ctl02 nova-api[8234]: 2017-09-28 12:46:28.720 8234 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:46:28 ctl02 nova-api[8234]: 2017-09-28 12:46:28.720 8234 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:46:28 ctl02 nova-api[8234]: 2017-09-28 12:46:28.720 8234 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:46:28 ctl02 nova-api[8234]: 2017-09-28 12:46:28.720 8234 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:46:28 ctl02 nova-api[8234]: 2017-09-28 12:46:28.720 8234 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:46:28 ctl02 nova-api[8234]: 2017-09-28 12:46:28.720 8234 ERROR nova.wsgi     self.filename))
Sep 28 12:46:28 ctl02 nova-api[8234]: 2017-09-28 12:46:28.720 8234 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:46:28 ctl02 nova-api[8234]: 2017-09-28 12:46:28.720 8234 ERROR nova.wsgi
Sep 28 12:46:28 ctl02 nova-api[8234]: 2017-09-28 12:46:28.721 8234 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:46:28 ctl02 nova-api[8234]: 2017-09-28 12:46:28.848 8234 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:46:29 ctl02 nova-api[8234]: 2017-09-28 12:46:29.070 8234 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:46:29 ctl02 nova-api[8234]: 2017-09-28 12:46:29.072 8234 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:46:29 ctl02 nova-api[8234]: 2017-09-28 12:46:29.072 8234 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:46:29 ctl02 nova-api[8234]: 2017-09-28 12:46:29.073 8234 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:46:29 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:46:29.096 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:46:29] "OPTIONS / HTTP/1.0" 200 134 0.000533
Sep 28 12:46:29 ctl02 nova-api[8234]: 2017-09-28 12:46:29.204 8234 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:46:29 ctl02 nova-api[8234]: 2017-09-28 12:46:29.206 8234 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:46:29 ctl02 nova-api[8234]: 2017-09-28 12:46:29.206 8234 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:46:29 ctl02 nova-api[8234]: 2017-09-28 12:46:29.207 8234 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:46:29 ctl02 nova-api[8234]: 2017-09-28 12:46:29.210 8234 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:46:29 ctl02 nova-api[8234]: 2017-09-28 12:46:29.210 8234 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:46:29 ctl02 nova-api[8234]: 2017-09-28 12:46:29.210 8234 ERROR nova Traceback (most recent call last):
Sep 28 12:46:29 ctl02 nova-api[8234]: 2017-09-28 12:46:29.210 8234 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:46:29 ctl02 nova-api[8234]: 2017-09-28 12:46:29.210 8234 ERROR nova     sys.exit(main())
Sep 28 12:46:29 ctl02 nova-api[8234]: 2017-09-28 12:46:29.210 8234 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:46:29 ctl02 nova-api[8234]: 2017-09-28 12:46:29.210 8234 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:46:29 ctl02 nova-api[8234]: 2017-09-28 12:46:29.210 8234 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:46:29 ctl02 nova-api[8234]: 2017-09-28 12:46:29.210 8234 ERROR nova     max_url_len=max_url_len)
Sep 28 12:46:29 ctl02 nova-api[8234]: 2017-09-28 12:46:29.210 8234 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:46:29 ctl02 nova-api[8234]: 2017-09-28 12:46:29.210 8234 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:46:29 ctl02 nova-api[8234]: 2017-09-28 12:46:29.210 8234 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:46:29 ctl02 nova-api[8234]: 2017-09-28 12:46:29.210 8234 ERROR nova     sock.listen(backlog)
Sep 28 12:46:29 ctl02 nova-api[8234]: 2017-09-28 12:46:29.210 8234 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:46:29 ctl02 nova-api[8234]: 2017-09-28 12:46:29.210 8234 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:46:29 ctl02 nova-api[8234]: 2017-09-28 12:46:29.210 8234 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:46:29 ctl02 nova-api[8234]: 2017-09-28 12:46:29.210 8234 ERROR nova
Sep 28 12:46:29 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:46:29 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:46:29 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:46:29 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:46:29 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:46:29 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:46:29 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:46:30 ctl02 neutron-server[30536]: 2017-09-28 12:46:30.161 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:46:30] "OPTIONS / HTTP/1.0" 200 262 0.000640
Sep 28 12:46:30 ctl02 glance-api[29183]: 2017-09-28 12:46:30.428 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:46:30] "OPTIONS / HTTP/1.0" 200 134 0.000638
Sep 28 12:46:30 ctl02 glance-api[29183]: 2017-09-28 12:46:30.729 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:46:30] "OPTIONS / HTTP/1.0" 200 134 0.000608
Sep 28 12:46:30 ctl02 nova-cert[4860]: 2017-09-28 12:46:30.881 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:46:30 ctl02 nova-conductor[5056]: 2017-09-28 12:46:30.997 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:46:31 ctl02 nova-conductor[5056]: 2017-09-28 12:46:31.025 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:46:31 ctl02 nova-conductor[5056]: 2017-09-28 12:46:31.047 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:46:31 ctl02 nova-conductor[5056]: 2017-09-28 12:46:31.048 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:46:31 ctl02 neutron-server[30536]: 2017-09-28 12:46:31.174 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:46:31] "OPTIONS / HTTP/1.0" 200 262 0.000472
Sep 28 12:46:31 ctl02 neutron-server[30536]: 2017-09-28 12:46:31.184 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:46:31] "OPTIONS / HTTP/1.0" 200 262 0.000271
Sep 28 12:46:31 ctl02 nova-api[8252]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:46:31 ctl02 nova-api[8252]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:46:31 ctl02 nova-api[8252]: 2017-09-28 12:46:31.537 8252 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:46:31 ctl02 nova-api[8252]: 2017-09-28 12:46:31.538 8252 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:46:31 ctl02 nova-api[8252]: 2017-09-28 12:46:31.538 8252 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:46:31 ctl02 nova-api[8252]: 2017-09-28 12:46:31.538 8252 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:46:31 ctl02 nova-api[8252]: 2017-09-28 12:46:31.538 8252 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:46:31 ctl02 nova-api[8252]: 2017-09-28 12:46:31.538 8252 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:46:31 ctl02 nova-api[8252]: 2017-09-28 12:46:31.538 8252 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:46:31 ctl02 nova-api[8252]: 2017-09-28 12:46:31.538 8252 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:46:31 ctl02 nova-api[8252]: 2017-09-28 12:46:31.538 8252 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:46:31 ctl02 nova-api[8252]: 2017-09-28 12:46:31.538 8252 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:46:31 ctl02 nova-api[8252]: 2017-09-28 12:46:31.538 8252 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:46:31 ctl02 nova-api[8252]: 2017-09-28 12:46:31.538 8252 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:46:31 ctl02 nova-api[8252]: 2017-09-28 12:46:31.538 8252 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:46:31 ctl02 nova-api[8252]: 2017-09-28 12:46:31.538 8252 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:46:31 ctl02 nova-api[8252]: 2017-09-28 12:46:31.538 8252 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:46:31 ctl02 nova-api[8252]: 2017-09-28 12:46:31.538 8252 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:46:31 ctl02 nova-api[8252]: 2017-09-28 12:46:31.538 8252 ERROR nova.wsgi     self.filename))
Sep 28 12:46:31 ctl02 nova-api[8252]: 2017-09-28 12:46:31.538 8252 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:46:31 ctl02 nova-api[8252]: 2017-09-28 12:46:31.538 8252 ERROR nova.wsgi
Sep 28 12:46:31 ctl02 nova-api[8252]: 2017-09-28 12:46:31.541 8252 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:46:31 ctl02 heat-api-cfn[13300]: 2017-09-28 12:46:31.667 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:46:31] "OPTIONS / HTTP/1.0" 200 134 0.000657
Sep 28 12:46:31 ctl02 nova-api[8252]: 2017-09-28 12:46:31.670 8252 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:46:31 ctl02 nova-api[8252]: 2017-09-28 12:46:31.896 8252 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:46:31 ctl02 nova-api[8252]: 2017-09-28 12:46:31.899 8252 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:46:31 ctl02 nova-api[8252]: 2017-09-28 12:46:31.900 8252 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:46:31 ctl02 nova-api[8252]: 2017-09-28 12:46:31.900 8252 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:46:31 ctl02 glance-api[29183]: 2017-09-28 12:46:31.981 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:46:31] "OPTIONS / HTTP/1.0" 200 134 0.000570
Sep 28 12:46:32 ctl02 nova-api[8252]: 2017-09-28 12:46:32.033 8252 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:46:32 ctl02 nova-api[8252]: 2017-09-28 12:46:32.035 8252 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:46:32 ctl02 nova-api[8252]: 2017-09-28 12:46:32.035 8252 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:46:32 ctl02 nova-api[8252]: 2017-09-28 12:46:32.036 8252 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:46:32 ctl02 nova-api[8252]: 2017-09-28 12:46:32.039 8252 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:46:32 ctl02 nova-api[8252]: 2017-09-28 12:46:32.039 8252 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:46:32 ctl02 nova-api[8252]: 2017-09-28 12:46:32.039 8252 ERROR nova Traceback (most recent call last):
Sep 28 12:46:32 ctl02 nova-api[8252]: 2017-09-28 12:46:32.039 8252 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:46:32 ctl02 nova-api[8252]: 2017-09-28 12:46:32.039 8252 ERROR nova     sys.exit(main())
Sep 28 12:46:32 ctl02 nova-api[8252]: 2017-09-28 12:46:32.039 8252 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:46:32 ctl02 nova-api[8252]: 2017-09-28 12:46:32.039 8252 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:46:32 ctl02 nova-api[8252]: 2017-09-28 12:46:32.039 8252 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:46:32 ctl02 nova-api[8252]: 2017-09-28 12:46:32.039 8252 ERROR nova     max_url_len=max_url_len)
Sep 28 12:46:32 ctl02 nova-api[8252]: 2017-09-28 12:46:32.039 8252 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:46:32 ctl02 nova-api[8252]: 2017-09-28 12:46:32.039 8252 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:46:32 ctl02 nova-api[8252]: 2017-09-28 12:46:32.039 8252 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:46:32 ctl02 nova-api[8252]: 2017-09-28 12:46:32.039 8252 ERROR nova     sock.listen(backlog)
Sep 28 12:46:32 ctl02 nova-api[8252]: 2017-09-28 12:46:32.039 8252 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:46:32 ctl02 nova-api[8252]: 2017-09-28 12:46:32.039 8252 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:46:32 ctl02 nova-api[8252]: 2017-09-28 12:46:32.039 8252 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:46:32 ctl02 nova-api[8252]: 2017-09-28 12:46:32.039 8252 ERROR nova
Sep 28 12:46:32 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:46:32 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:46:32 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:46:32 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:46:32 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:46:32 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:46:32 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:46:34 ctl02 nova-api[8270]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:46:34 ctl02 nova-api[8270]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:46:34 ctl02 nova-api[8270]: 2017-09-28 12:46:34.218 8270 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:46:34 ctl02 nova-api[8270]: 2017-09-28 12:46:34.220 8270 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:46:34 ctl02 nova-api[8270]: 2017-09-28 12:46:34.220 8270 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:46:34 ctl02 nova-api[8270]: 2017-09-28 12:46:34.220 8270 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:46:34 ctl02 nova-api[8270]: 2017-09-28 12:46:34.220 8270 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:46:34 ctl02 nova-api[8270]: 2017-09-28 12:46:34.220 8270 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:46:34 ctl02 nova-api[8270]: 2017-09-28 12:46:34.220 8270 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:46:34 ctl02 nova-api[8270]: 2017-09-28 12:46:34.220 8270 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:46:34 ctl02 nova-api[8270]: 2017-09-28 12:46:34.220 8270 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:46:34 ctl02 nova-api[8270]: 2017-09-28 12:46:34.220 8270 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:46:34 ctl02 nova-api[8270]: 2017-09-28 12:46:34.220 8270 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:46:34 ctl02 nova-api[8270]: 2017-09-28 12:46:34.220 8270 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:46:34 ctl02 nova-api[8270]: 2017-09-28 12:46:34.220 8270 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:46:34 ctl02 nova-api[8270]: 2017-09-28 12:46:34.220 8270 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:46:34 ctl02 nova-api[8270]: 2017-09-28 12:46:34.220 8270 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:46:34 ctl02 nova-api[8270]: 2017-09-28 12:46:34.220 8270 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:46:34 ctl02 nova-api[8270]: 2017-09-28 12:46:34.220 8270 ERROR nova.wsgi     self.filename))
Sep 28 12:46:34 ctl02 nova-api[8270]: 2017-09-28 12:46:34.220 8270 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:46:34 ctl02 nova-api[8270]: 2017-09-28 12:46:34.220 8270 ERROR nova.wsgi
Sep 28 12:46:34 ctl02 nova-api[8270]: 2017-09-28 12:46:34.220 8270 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:46:34 ctl02 nova-api[8270]: 2017-09-28 12:46:34.345 8270 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:46:34 ctl02 nova-api[8270]: 2017-09-28 12:46:34.568 8270 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:46:34 ctl02 nova-api[8270]: 2017-09-28 12:46:34.570 8270 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:46:34 ctl02 nova-api[8270]: 2017-09-28 12:46:34.570 8270 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:46:34 ctl02 nova-api[8270]: 2017-09-28 12:46:34.570 8270 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:46:34 ctl02 nova-api[8270]: 2017-09-28 12:46:34.700 8270 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:46:34 ctl02 nova-api[8270]: 2017-09-28 12:46:34.702 8270 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:46:34 ctl02 nova-api[8270]: 2017-09-28 12:46:34.702 8270 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:46:34 ctl02 nova-api[8270]: 2017-09-28 12:46:34.702 8270 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:46:34 ctl02 nova-api[8270]: 2017-09-28 12:46:34.705 8270 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:46:34 ctl02 nova-api[8270]: 2017-09-28 12:46:34.705 8270 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:46:34 ctl02 nova-api[8270]: 2017-09-28 12:46:34.705 8270 ERROR nova Traceback (most recent call last):
Sep 28 12:46:34 ctl02 nova-api[8270]: 2017-09-28 12:46:34.705 8270 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:46:34 ctl02 nova-api[8270]: 2017-09-28 12:46:34.705 8270 ERROR nova     sys.exit(main())
Sep 28 12:46:34 ctl02 nova-api[8270]: 2017-09-28 12:46:34.705 8270 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:46:34 ctl02 nova-api[8270]: 2017-09-28 12:46:34.705 8270 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:46:34 ctl02 nova-api[8270]: 2017-09-28 12:46:34.705 8270 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:46:34 ctl02 nova-api[8270]: 2017-09-28 12:46:34.705 8270 ERROR nova     max_url_len=max_url_len)
Sep 28 12:46:34 ctl02 nova-api[8270]: 2017-09-28 12:46:34.705 8270 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:46:34 ctl02 nova-api[8270]: 2017-09-28 12:46:34.705 8270 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:46:34 ctl02 nova-api[8270]: 2017-09-28 12:46:34.705 8270 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:46:34 ctl02 nova-api[8270]: 2017-09-28 12:46:34.705 8270 ERROR nova     sock.listen(backlog)
Sep 28 12:46:34 ctl02 nova-api[8270]: 2017-09-28 12:46:34.705 8270 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:46:34 ctl02 nova-api[8270]: 2017-09-28 12:46:34.705 8270 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:46:34 ctl02 nova-api[8270]: 2017-09-28 12:46:34.705 8270 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:46:34 ctl02 nova-api[8270]: 2017-09-28 12:46:34.705 8270 ERROR nova
Sep 28 12:46:34 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb8d2d70a)
Sep 28 12:46:34 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:46:34 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:46:34 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:46:34 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:46:34.922 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:46:34] "OPTIONS / HTTP/1.0" 200 134 0.000547
Sep 28 12:46:35 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:46:35 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:46:35 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:46:35 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:46:35 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb8d2d70a)
Sep 28 12:46:35 ctl02 heat-api[13008]: 2017-09-28 12:46:35.813 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:46:35] "OPTIONS / HTTP/1.0" 200 134 0.000528
Sep 28 12:46:36 ctl02 neutron-server[30536]: 2017-09-28 12:46:36.246 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 12:46:36 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:46:36 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:44:56 cmp002
Sep 28 12:46:36 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:45:28 cmp001
Sep 28 12:46:36 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:45:20 cmp002
Sep 28 12:46:36 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:46:36.278 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:46:36] "OPTIONS / HTTP/1.0" 200 134 0.000381
Sep 28 12:46:36 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb8d2d70a)
Sep 28 12:46:36 ctl02 nova-api[8288]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:46:36 ctl02 nova-api[8288]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:46:36 ctl02 nova-api[8288]: 2017-09-28 12:46:36.959 8288 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:46:36 ctl02 nova-api[8288]: 2017-09-28 12:46:36.960 8288 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:46:36 ctl02 nova-api[8288]: 2017-09-28 12:46:36.960 8288 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:46:36 ctl02 nova-api[8288]: 2017-09-28 12:46:36.960 8288 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:46:36 ctl02 nova-api[8288]: 2017-09-28 12:46:36.960 8288 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:46:36 ctl02 nova-api[8288]: 2017-09-28 12:46:36.960 8288 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:46:36 ctl02 nova-api[8288]: 2017-09-28 12:46:36.960 8288 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:46:36 ctl02 nova-api[8288]: 2017-09-28 12:46:36.960 8288 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:46:36 ctl02 nova-api[8288]: 2017-09-28 12:46:36.960 8288 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:46:36 ctl02 nova-api[8288]: 2017-09-28 12:46:36.960 8288 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:46:36 ctl02 nova-api[8288]: 2017-09-28 12:46:36.960 8288 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:46:36 ctl02 nova-api[8288]: 2017-09-28 12:46:36.960 8288 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:46:36 ctl02 nova-api[8288]: 2017-09-28 12:46:36.960 8288 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:46:36 ctl02 nova-api[8288]: 2017-09-28 12:46:36.960 8288 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:46:36 ctl02 nova-api[8288]: 2017-09-28 12:46:36.960 8288 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:46:36 ctl02 nova-api[8288]: 2017-09-28 12:46:36.960 8288 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:46:36 ctl02 nova-api[8288]: 2017-09-28 12:46:36.960 8288 ERROR nova.wsgi     self.filename))
Sep 28 12:46:36 ctl02 nova-api[8288]: 2017-09-28 12:46:36.960 8288 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:46:36 ctl02 nova-api[8288]: 2017-09-28 12:46:36.960 8288 ERROR nova.wsgi
Sep 28 12:46:36 ctl02 nova-api[8288]: 2017-09-28 12:46:36.961 8288 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:46:37 ctl02 heat-api[13008]: 2017-09-28 12:46:37.032 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:46:37] "OPTIONS / HTTP/1.0" 200 134 0.000592
Sep 28 12:46:37 ctl02 nova-api[8288]: 2017-09-28 12:46:37.092 8288 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:46:37 ctl02 heat-api[13008]: 2017-09-28 12:46:37.235 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:46:37] "OPTIONS / HTTP/1.0" 200 134 0.000539
Sep 28 12:46:37 ctl02 nova-api[8288]: 2017-09-28 12:46:37.317 8288 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:46:37 ctl02 nova-api[8288]: 2017-09-28 12:46:37.319 8288 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:46:37 ctl02 nova-api[8288]: 2017-09-28 12:46:37.319 8288 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:46:37 ctl02 nova-api[8288]: 2017-09-28 12:46:37.319 8288 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:46:37 ctl02 nova-api[8288]: 2017-09-28 12:46:37.450 8288 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:46:37 ctl02 nova-api[8288]: 2017-09-28 12:46:37.452 8288 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:46:37 ctl02 nova-api[8288]: 2017-09-28 12:46:37.453 8288 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:46:37 ctl02 nova-api[8288]: 2017-09-28 12:46:37.453 8288 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:46:37 ctl02 nova-api[8288]: 2017-09-28 12:46:37.457 8288 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:46:37 ctl02 nova-api[8288]: 2017-09-28 12:46:37.457 8288 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:46:37 ctl02 nova-api[8288]: 2017-09-28 12:46:37.457 8288 ERROR nova Traceback (most recent call last):
Sep 28 12:46:37 ctl02 nova-api[8288]: 2017-09-28 12:46:37.457 8288 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:46:37 ctl02 nova-api[8288]: 2017-09-28 12:46:37.457 8288 ERROR nova     sys.exit(main())
Sep 28 12:46:37 ctl02 nova-api[8288]: 2017-09-28 12:46:37.457 8288 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:46:37 ctl02 nova-api[8288]: 2017-09-28 12:46:37.457 8288 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:46:37 ctl02 nova-api[8288]: 2017-09-28 12:46:37.457 8288 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:46:37 ctl02 nova-api[8288]: 2017-09-28 12:46:37.457 8288 ERROR nova     max_url_len=max_url_len)
Sep 28 12:46:37 ctl02 nova-api[8288]: 2017-09-28 12:46:37.457 8288 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:46:37 ctl02 nova-api[8288]: 2017-09-28 12:46:37.457 8288 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:46:37 ctl02 nova-api[8288]: 2017-09-28 12:46:37.457 8288 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:46:37 ctl02 nova-api[8288]: 2017-09-28 12:46:37.457 8288 ERROR nova     sock.listen(backlog)
Sep 28 12:46:37 ctl02 nova-api[8288]: 2017-09-28 12:46:37.457 8288 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:46:37 ctl02 nova-api[8288]: 2017-09-28 12:46:37.457 8288 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:46:37 ctl02 nova-api[8288]: 2017-09-28 12:46:37.457 8288 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:46:37 ctl02 nova-api[8288]: 2017-09-28 12:46:37.457 8288 ERROR nova
Sep 28 12:46:37 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:46:37 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:46:37 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:46:37 ctl02 heat-api-cfn[13300]: 2017-09-28 12:46:37.711 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:46:37] "OPTIONS / HTTP/1.0" 200 134 0.000576
Sep 28 12:46:37 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb8d2d70a)
Sep 28 12:46:37 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:46:37 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:46:37 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:46:37 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:46:38 ctl02 heat-api-cfn[13300]: 2017-09-28 12:46:38.111 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:46:38] "OPTIONS / HTTP/1.0" 200 134 0.000444
Sep 28 12:46:38 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb8d2d70a)
Sep 28 12:46:39 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:46:39.112 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:46:39] "OPTIONS / HTTP/1.0" 200 134 0.000394
Sep 28 12:46:39 ctl02 nova-api[8306]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:46:39 ctl02 nova-api[8306]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:46:39 ctl02 nova-api[8306]: 2017-09-28 12:46:39.726 8306 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:46:39 ctl02 nova-api[8306]: 2017-09-28 12:46:39.727 8306 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:46:39 ctl02 nova-api[8306]: 2017-09-28 12:46:39.727 8306 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:46:39 ctl02 nova-api[8306]: 2017-09-28 12:46:39.727 8306 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:46:39 ctl02 nova-api[8306]: 2017-09-28 12:46:39.727 8306 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:46:39 ctl02 nova-api[8306]: 2017-09-28 12:46:39.727 8306 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:46:39 ctl02 nova-api[8306]: 2017-09-28 12:46:39.727 8306 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:46:39 ctl02 nova-api[8306]: 2017-09-28 12:46:39.727 8306 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:46:39 ctl02 nova-api[8306]: 2017-09-28 12:46:39.727 8306 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:46:39 ctl02 nova-api[8306]: 2017-09-28 12:46:39.727 8306 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:46:39 ctl02 nova-api[8306]: 2017-09-28 12:46:39.727 8306 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:46:39 ctl02 nova-api[8306]: 2017-09-28 12:46:39.727 8306 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:46:39 ctl02 nova-api[8306]: 2017-09-28 12:46:39.727 8306 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:46:39 ctl02 nova-api[8306]: 2017-09-28 12:46:39.727 8306 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:46:39 ctl02 nova-api[8306]: 2017-09-28 12:46:39.727 8306 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:46:39 ctl02 nova-api[8306]: 2017-09-28 12:46:39.727 8306 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:46:39 ctl02 nova-api[8306]: 2017-09-28 12:46:39.727 8306 ERROR nova.wsgi     self.filename))
Sep 28 12:46:39 ctl02 nova-api[8306]: 2017-09-28 12:46:39.727 8306 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:46:39 ctl02 nova-api[8306]: 2017-09-28 12:46:39.727 8306 ERROR nova.wsgi
Sep 28 12:46:39 ctl02 nova-api[8306]: 2017-09-28 12:46:39.728 8306 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:46:39 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb8d2d70a)
Sep 28 12:46:39 ctl02 nova-api[8306]: 2017-09-28 12:46:39.856 8306 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:46:40 ctl02 neutron-server[30536]: 2017-09-28 12:46:40.022 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:46:40] "OPTIONS / HTTP/1.0" 200 262 0.000465
Sep 28 12:46:40 ctl02 nova-api[8306]: 2017-09-28 12:46:40.082 8306 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:46:40 ctl02 nova-api[8306]: 2017-09-28 12:46:40.084 8306 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:46:40 ctl02 nova-api[8306]: 2017-09-28 12:46:40.084 8306 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:46:40 ctl02 nova-api[8306]: 2017-09-28 12:46:40.084 8306 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:46:40 ctl02 nova-api[8306]: 2017-09-28 12:46:40.217 8306 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:46:40 ctl02 nova-api[8306]: 2017-09-28 12:46:40.219 8306 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:46:40 ctl02 nova-api[8306]: 2017-09-28 12:46:40.219 8306 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:46:40 ctl02 nova-api[8306]: 2017-09-28 12:46:40.219 8306 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:46:40 ctl02 nova-api[8306]: 2017-09-28 12:46:40.223 8306 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:46:40 ctl02 nova-api[8306]: 2017-09-28 12:46:40.223 8306 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:46:40 ctl02 nova-api[8306]: 2017-09-28 12:46:40.223 8306 ERROR nova Traceback (most recent call last):
Sep 28 12:46:40 ctl02 nova-api[8306]: 2017-09-28 12:46:40.223 8306 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:46:40 ctl02 nova-api[8306]: 2017-09-28 12:46:40.223 8306 ERROR nova     sys.exit(main())
Sep 28 12:46:40 ctl02 nova-api[8306]: 2017-09-28 12:46:40.223 8306 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:46:40 ctl02 nova-api[8306]: 2017-09-28 12:46:40.223 8306 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:46:40 ctl02 nova-api[8306]: 2017-09-28 12:46:40.223 8306 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:46:40 ctl02 nova-api[8306]: 2017-09-28 12:46:40.223 8306 ERROR nova     max_url_len=max_url_len)
Sep 28 12:46:40 ctl02 nova-api[8306]: 2017-09-28 12:46:40.223 8306 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:46:40 ctl02 nova-api[8306]: 2017-09-28 12:46:40.223 8306 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:46:40 ctl02 nova-api[8306]: 2017-09-28 12:46:40.223 8306 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:46:40 ctl02 nova-api[8306]: 2017-09-28 12:46:40.223 8306 ERROR nova     sock.listen(backlog)
Sep 28 12:46:40 ctl02 nova-api[8306]: 2017-09-28 12:46:40.223 8306 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:46:40 ctl02 nova-api[8306]: 2017-09-28 12:46:40.223 8306 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:46:40 ctl02 nova-api[8306]: 2017-09-28 12:46:40.223 8306 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:46:40 ctl02 nova-api[8306]: 2017-09-28 12:46:40.223 8306 ERROR nova
Sep 28 12:46:40 ctl02 glance-api[29183]: 2017-09-28 12:46:40.295 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:46:40] "OPTIONS / HTTP/1.0" 200 134 0.000543
Sep 28 12:46:40 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:46:40 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:46:40 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:46:40 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:46:40 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:46:40 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:46:40 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:46:40 ctl02 glance-api[29183]: 2017-09-28 12:46:40.667 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:46:40] "OPTIONS / HTTP/1.0" 200 134 0.000728
Sep 28 12:46:40 ctl02 nova-consoleauth[5433]: 2017-09-28 12:46:40.726 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:46:40 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb8d2d70a)
Sep 28 12:46:41 ctl02 neutron-server[30536]: 2017-09-28 12:46:41.349 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:46:41] "OPTIONS / HTTP/1.0" 200 262 0.000432
Sep 28 12:46:41 ctl02 neutron-server[30536]: 2017-09-28 12:46:41.371 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:46:41] "OPTIONS / HTTP/1.0" 200 262 0.000284
Sep 28 12:46:41 ctl02 heat-api-cfn[13300]: 2017-09-28 12:46:41.524 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:46:41] "OPTIONS / HTTP/1.0" 200 134 0.000459
Sep 28 12:46:41 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb8d2d70a)
Sep 28 12:46:42 ctl02 heat-engine[12803]: 2017-09-28 12:46:42.147 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:46:42 ctl02 heat-engine[12803]: 2017-09-28 12:46:42.156 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:46:42 ctl02 heat-engine[12803]: 2017-09-28 12:46:42.157 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:46:42 ctl02 heat-engine[12803]: 2017-09-28 12:46:42.170 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:46:42 ctl02 glance-api[29183]: 2017-09-28 12:46:42.200 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:46:42] "OPTIONS / HTTP/1.0" 200 134 0.000755
Sep 28 12:46:42 ctl02 nova-api[8324]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:46:42 ctl02 nova-api[8324]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:46:42 ctl02 nova-api[8324]: 2017-09-28 12:46:42.489 8324 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:46:42 ctl02 nova-api[8324]: 2017-09-28 12:46:42.490 8324 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:46:42 ctl02 nova-api[8324]: 2017-09-28 12:46:42.490 8324 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:46:42 ctl02 nova-api[8324]: 2017-09-28 12:46:42.490 8324 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:46:42 ctl02 nova-api[8324]: 2017-09-28 12:46:42.490 8324 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:46:42 ctl02 nova-api[8324]: 2017-09-28 12:46:42.490 8324 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:46:42 ctl02 nova-api[8324]: 2017-09-28 12:46:42.490 8324 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:46:42 ctl02 nova-api[8324]: 2017-09-28 12:46:42.490 8324 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:46:42 ctl02 nova-api[8324]: 2017-09-28 12:46:42.490 8324 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:46:42 ctl02 nova-api[8324]: 2017-09-28 12:46:42.490 8324 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:46:42 ctl02 nova-api[8324]: 2017-09-28 12:46:42.490 8324 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:46:42 ctl02 nova-api[8324]: 2017-09-28 12:46:42.490 8324 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:46:42 ctl02 nova-api[8324]: 2017-09-28 12:46:42.490 8324 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:46:42 ctl02 nova-api[8324]: 2017-09-28 12:46:42.490 8324 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:46:42 ctl02 nova-api[8324]: 2017-09-28 12:46:42.490 8324 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:46:42 ctl02 nova-api[8324]: 2017-09-28 12:46:42.490 8324 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:46:42 ctl02 nova-api[8324]: 2017-09-28 12:46:42.490 8324 ERROR nova.wsgi     self.filename))
Sep 28 12:46:42 ctl02 nova-api[8324]: 2017-09-28 12:46:42.490 8324 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:46:42 ctl02 nova-api[8324]: 2017-09-28 12:46:42.490 8324 ERROR nova.wsgi
Sep 28 12:46:42 ctl02 nova-api[8324]: 2017-09-28 12:46:42.492 8324 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:46:42 ctl02 nova-api[8324]: 2017-09-28 12:46:42.622 8324 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:46:42 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb8d2d70a)
Sep 28 12:46:42 ctl02 nova-api[8324]: 2017-09-28 12:46:42.848 8324 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:46:42 ctl02 nova-api[8324]: 2017-09-28 12:46:42.850 8324 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:46:42 ctl02 nova-api[8324]: 2017-09-28 12:46:42.850 8324 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:46:42 ctl02 nova-api[8324]: 2017-09-28 12:46:42.850 8324 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:46:42 ctl02 nova-api[8324]: 2017-09-28 12:46:42.981 8324 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:46:42 ctl02 nova-api[8324]: 2017-09-28 12:46:42.983 8324 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:46:42 ctl02 nova-api[8324]: 2017-09-28 12:46:42.983 8324 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:46:42 ctl02 nova-api[8324]: 2017-09-28 12:46:42.983 8324 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:46:42 ctl02 nova-api[8324]: 2017-09-28 12:46:42.986 8324 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:46:42 ctl02 nova-api[8324]: 2017-09-28 12:46:42.987 8324 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:46:42 ctl02 nova-api[8324]: 2017-09-28 12:46:42.987 8324 ERROR nova Traceback (most recent call last):
Sep 28 12:46:42 ctl02 nova-api[8324]: 2017-09-28 12:46:42.987 8324 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:46:42 ctl02 nova-api[8324]: 2017-09-28 12:46:42.987 8324 ERROR nova     sys.exit(main())
Sep 28 12:46:42 ctl02 nova-api[8324]: 2017-09-28 12:46:42.987 8324 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:46:42 ctl02 nova-api[8324]: 2017-09-28 12:46:42.987 8324 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:46:42 ctl02 nova-api[8324]: 2017-09-28 12:46:42.987 8324 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:46:42 ctl02 nova-api[8324]: 2017-09-28 12:46:42.987 8324 ERROR nova     max_url_len=max_url_len)
Sep 28 12:46:42 ctl02 nova-api[8324]: 2017-09-28 12:46:42.987 8324 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:46:42 ctl02 nova-api[8324]: 2017-09-28 12:46:42.987 8324 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:46:42 ctl02 nova-api[8324]: 2017-09-28 12:46:42.987 8324 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:46:42 ctl02 nova-api[8324]: 2017-09-28 12:46:42.987 8324 ERROR nova     sock.listen(backlog)
Sep 28 12:46:42 ctl02 nova-api[8324]: 2017-09-28 12:46:42.987 8324 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:46:42 ctl02 nova-api[8324]: 2017-09-28 12:46:42.987 8324 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:46:42 ctl02 nova-api[8324]: 2017-09-28 12:46:42.987 8324 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:46:42 ctl02 nova-api[8324]: 2017-09-28 12:46:42.987 8324 ERROR nova
Sep 28 12:46:43 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:46:43 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:46:43 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:46:43 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:46:43 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:46:43 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:46:43 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:46:43 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb8d2d70a)
Sep 28 12:46:43 ctl02 nova-scheduler[5620]: 2017-09-28 12:46:43.827 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:46:44 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb8d2d70a)
Sep 28 12:46:45 ctl02 nova-api[8342]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:46:45 ctl02 nova-api[8342]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:46:45 ctl02 nova-api[8342]: 2017-09-28 12:46:45.255 8342 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:46:45 ctl02 nova-api[8342]: 2017-09-28 12:46:45.257 8342 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:46:45 ctl02 nova-api[8342]: 2017-09-28 12:46:45.257 8342 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:46:45 ctl02 nova-api[8342]: 2017-09-28 12:46:45.257 8342 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:46:45 ctl02 nova-api[8342]: 2017-09-28 12:46:45.257 8342 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:46:45 ctl02 nova-api[8342]: 2017-09-28 12:46:45.257 8342 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:46:45 ctl02 nova-api[8342]: 2017-09-28 12:46:45.257 8342 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:46:45 ctl02 nova-api[8342]: 2017-09-28 12:46:45.257 8342 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:46:45 ctl02 nova-api[8342]: 2017-09-28 12:46:45.257 8342 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:46:45 ctl02 nova-api[8342]: 2017-09-28 12:46:45.257 8342 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:46:45 ctl02 nova-api[8342]: 2017-09-28 12:46:45.257 8342 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:46:45 ctl02 nova-api[8342]: 2017-09-28 12:46:45.257 8342 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:46:45 ctl02 nova-api[8342]: 2017-09-28 12:46:45.257 8342 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:46:45 ctl02 nova-api[8342]: 2017-09-28 12:46:45.257 8342 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:46:45 ctl02 nova-api[8342]: 2017-09-28 12:46:45.257 8342 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:46:45 ctl02 nova-api[8342]: 2017-09-28 12:46:45.257 8342 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:46:45 ctl02 nova-api[8342]: 2017-09-28 12:46:45.257 8342 ERROR nova.wsgi     self.filename))
Sep 28 12:46:45 ctl02 nova-api[8342]: 2017-09-28 12:46:45.257 8342 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:46:45 ctl02 nova-api[8342]: 2017-09-28 12:46:45.257 8342 ERROR nova.wsgi
Sep 28 12:46:45 ctl02 nova-api[8342]: 2017-09-28 12:46:45.258 8342 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:46:45 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:46:45.274 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:46:45] "OPTIONS / HTTP/1.0" 200 134 0.000384
Sep 28 12:46:45 ctl02 nova-api[8342]: 2017-09-28 12:46:45.385 8342 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:46:45 ctl02 nova-api[8342]: 2017-09-28 12:46:45.608 8342 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:46:45 ctl02 nova-api[8342]: 2017-09-28 12:46:45.610 8342 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:46:45 ctl02 nova-api[8342]: 2017-09-28 12:46:45.610 8342 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:46:45 ctl02 nova-api[8342]: 2017-09-28 12:46:45.610 8342 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:46:45 ctl02 nova-api[8342]: 2017-09-28 12:46:45.741 8342 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:46:45 ctl02 nova-api[8342]: 2017-09-28 12:46:45.743 8342 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:46:45 ctl02 nova-api[8342]: 2017-09-28 12:46:45.743 8342 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:46:45 ctl02 nova-api[8342]: 2017-09-28 12:46:45.743 8342 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:46:45 ctl02 nova-api[8342]: 2017-09-28 12:46:45.746 8342 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:46:45 ctl02 nova-api[8342]: 2017-09-28 12:46:45.747 8342 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:46:45 ctl02 nova-api[8342]: 2017-09-28 12:46:45.747 8342 ERROR nova Traceback (most recent call last):
Sep 28 12:46:45 ctl02 nova-api[8342]: 2017-09-28 12:46:45.747 8342 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:46:45 ctl02 nova-api[8342]: 2017-09-28 12:46:45.747 8342 ERROR nova     sys.exit(main())
Sep 28 12:46:45 ctl02 nova-api[8342]: 2017-09-28 12:46:45.747 8342 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:46:45 ctl02 nova-api[8342]: 2017-09-28 12:46:45.747 8342 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:46:45 ctl02 nova-api[8342]: 2017-09-28 12:46:45.747 8342 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:46:45 ctl02 nova-api[8342]: 2017-09-28 12:46:45.747 8342 ERROR nova     max_url_len=max_url_len)
Sep 28 12:46:45 ctl02 nova-api[8342]: 2017-09-28 12:46:45.747 8342 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:46:45 ctl02 nova-api[8342]: 2017-09-28 12:46:45.747 8342 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:46:45 ctl02 nova-api[8342]: 2017-09-28 12:46:45.747 8342 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:46:45 ctl02 nova-api[8342]: 2017-09-28 12:46:45.747 8342 ERROR nova     sock.listen(backlog)
Sep 28 12:46:45 ctl02 nova-api[8342]: 2017-09-28 12:46:45.747 8342 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:46:45 ctl02 nova-api[8342]: 2017-09-28 12:46:45.747 8342 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:46:45 ctl02 nova-api[8342]: 2017-09-28 12:46:45.747 8342 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:46:45 ctl02 nova-api[8342]: 2017-09-28 12:46:45.747 8342 ERROR nova
Sep 28 12:46:45 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:46:45 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:46:45 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:46:45 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:46:45 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:46:46 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:46:46 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:46:46 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:46:46 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:46:46 ctl02 heat-api[13008]: 2017-09-28 12:46:46.211 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:46:46] "OPTIONS / HTTP/1.0" 200 134 0.000895
Sep 28 12:46:46 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:46:46.401 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:46:46] "OPTIONS / HTTP/1.0" 200 134 0.000373
Sep 28 12:46:47 ctl02 heat-api[13008]: 2017-09-28 12:46:47.218 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:46:47] "OPTIONS / HTTP/1.0" 200 134 0.000524
Sep 28 12:46:47 ctl02 heat-api[13008]: 2017-09-28 12:46:47.277 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:46:47] "OPTIONS / HTTP/1.0" 200 134 0.000357
Sep 28 12:46:47 ctl02 nova-api[8365]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:46:47 ctl02 nova-api[8365]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:46:47 ctl02 heat-api-cfn[13300]: 2017-09-28 12:46:47.820 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:46:47] "OPTIONS / HTTP/1.0" 200 134 0.000471
Sep 28 12:46:47 ctl02 heat-api-cfn[13300]: 2017-09-28 12:46:47.939 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:46:47] "OPTIONS / HTTP/1.0" 200 134 0.000461
Sep 28 12:46:47 ctl02 nova-api[8365]: 2017-09-28 12:46:47.972 8365 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:46:47 ctl02 nova-api[8365]: 2017-09-28 12:46:47.974 8365 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:46:47 ctl02 nova-api[8365]: 2017-09-28 12:46:47.974 8365 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:46:47 ctl02 nova-api[8365]: 2017-09-28 12:46:47.974 8365 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:46:47 ctl02 nova-api[8365]: 2017-09-28 12:46:47.974 8365 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:46:47 ctl02 nova-api[8365]: 2017-09-28 12:46:47.974 8365 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:46:47 ctl02 nova-api[8365]: 2017-09-28 12:46:47.974 8365 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:46:47 ctl02 nova-api[8365]: 2017-09-28 12:46:47.974 8365 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:46:47 ctl02 nova-api[8365]: 2017-09-28 12:46:47.974 8365 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:46:47 ctl02 nova-api[8365]: 2017-09-28 12:46:47.974 8365 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:46:47 ctl02 nova-api[8365]: 2017-09-28 12:46:47.974 8365 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:46:47 ctl02 nova-api[8365]: 2017-09-28 12:46:47.974 8365 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:46:47 ctl02 nova-api[8365]: 2017-09-28 12:46:47.974 8365 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:46:47 ctl02 nova-api[8365]: 2017-09-28 12:46:47.974 8365 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:46:47 ctl02 nova-api[8365]: 2017-09-28 12:46:47.974 8365 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:46:47 ctl02 nova-api[8365]: 2017-09-28 12:46:47.974 8365 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:46:47 ctl02 nova-api[8365]: 2017-09-28 12:46:47.974 8365 ERROR nova.wsgi     self.filename))
Sep 28 12:46:47 ctl02 nova-api[8365]: 2017-09-28 12:46:47.974 8365 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:46:47 ctl02 nova-api[8365]: 2017-09-28 12:46:47.974 8365 ERROR nova.wsgi
Sep 28 12:46:47 ctl02 nova-api[8365]: 2017-09-28 12:46:47.975 8365 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:46:48 ctl02 nova-api[8365]: 2017-09-28 12:46:48.100 8365 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:46:48 ctl02 nova-api[8365]: 2017-09-28 12:46:48.322 8365 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:46:48 ctl02 nova-api[8365]: 2017-09-28 12:46:48.325 8365 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:46:48 ctl02 nova-api[8365]: 2017-09-28 12:46:48.325 8365 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:46:48 ctl02 nova-api[8365]: 2017-09-28 12:46:48.325 8365 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:46:48 ctl02 nova-api[8365]: 2017-09-28 12:46:48.454 8365 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:46:48 ctl02 nova-api[8365]: 2017-09-28 12:46:48.456 8365 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:46:48 ctl02 nova-api[8365]: 2017-09-28 12:46:48.456 8365 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:46:48 ctl02 nova-api[8365]: 2017-09-28 12:46:48.457 8365 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:46:48 ctl02 nova-api[8365]: 2017-09-28 12:46:48.460 8365 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:46:48 ctl02 nova-api[8365]: 2017-09-28 12:46:48.460 8365 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:46:48 ctl02 nova-api[8365]: 2017-09-28 12:46:48.460 8365 ERROR nova Traceback (most recent call last):
Sep 28 12:46:48 ctl02 nova-api[8365]: 2017-09-28 12:46:48.460 8365 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:46:48 ctl02 nova-api[8365]: 2017-09-28 12:46:48.460 8365 ERROR nova     sys.exit(main())
Sep 28 12:46:48 ctl02 nova-api[8365]: 2017-09-28 12:46:48.460 8365 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:46:48 ctl02 nova-api[8365]: 2017-09-28 12:46:48.460 8365 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:46:48 ctl02 nova-api[8365]: 2017-09-28 12:46:48.460 8365 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:46:48 ctl02 nova-api[8365]: 2017-09-28 12:46:48.460 8365 ERROR nova     max_url_len=max_url_len)
Sep 28 12:46:48 ctl02 nova-api[8365]: 2017-09-28 12:46:48.460 8365 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:46:48 ctl02 nova-api[8365]: 2017-09-28 12:46:48.460 8365 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:46:48 ctl02 nova-api[8365]: 2017-09-28 12:46:48.460 8365 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:46:48 ctl02 nova-api[8365]: 2017-09-28 12:46:48.460 8365 ERROR nova     sock.listen(backlog)
Sep 28 12:46:48 ctl02 nova-api[8365]: 2017-09-28 12:46:48.460 8365 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:46:48 ctl02 nova-api[8365]: 2017-09-28 12:46:48.460 8365 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:46:48 ctl02 nova-api[8365]: 2017-09-28 12:46:48.460 8365 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:46:48 ctl02 nova-api[8365]: 2017-09-28 12:46:48.460 8365 ERROR nova
Sep 28 12:46:48 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:46:48 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:46:48 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:46:48 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:46:48 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:46:48 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:46:48 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:46:49 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:46:49.087 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:46:49] "OPTIONS / HTTP/1.0" 200 134 0.000371
Sep 28 12:46:49 ctl02 neutron-server[30536]: 2017-09-28 12:46:49.863 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:46:49] "OPTIONS / HTTP/1.0" 200 262 0.000592
Sep 28 12:46:50 ctl02 glance-api[29183]: 2017-09-28 12:46:50.566 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:46:50] "OPTIONS / HTTP/1.0" 200 134 0.000597
Sep 28 12:46:50 ctl02 nova-api[8383]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:46:50 ctl02 nova-api[8383]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:46:50 ctl02 glance-api[29183]: 2017-09-28 12:46:50.675 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:46:50] "OPTIONS / HTTP/1.0" 200 134 0.000536
Sep 28 12:46:50 ctl02 nova-api[8383]: 2017-09-28 12:46:50.762 8383 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:46:50 ctl02 nova-api[8383]: 2017-09-28 12:46:50.763 8383 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:46:50 ctl02 nova-api[8383]: 2017-09-28 12:46:50.763 8383 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:46:50 ctl02 nova-api[8383]: 2017-09-28 12:46:50.763 8383 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:46:50 ctl02 nova-api[8383]: 2017-09-28 12:46:50.763 8383 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:46:50 ctl02 nova-api[8383]: 2017-09-28 12:46:50.763 8383 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:46:50 ctl02 nova-api[8383]: 2017-09-28 12:46:50.763 8383 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:46:50 ctl02 nova-api[8383]: 2017-09-28 12:46:50.763 8383 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:46:50 ctl02 nova-api[8383]: 2017-09-28 12:46:50.763 8383 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:46:50 ctl02 nova-api[8383]: 2017-09-28 12:46:50.763 8383 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:46:50 ctl02 nova-api[8383]: 2017-09-28 12:46:50.763 8383 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:46:50 ctl02 nova-api[8383]: 2017-09-28 12:46:50.763 8383 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:46:50 ctl02 nova-api[8383]: 2017-09-28 12:46:50.763 8383 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:46:50 ctl02 nova-api[8383]: 2017-09-28 12:46:50.763 8383 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:46:50 ctl02 nova-api[8383]: 2017-09-28 12:46:50.763 8383 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:46:50 ctl02 nova-api[8383]: 2017-09-28 12:46:50.763 8383 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:46:50 ctl02 nova-api[8383]: 2017-09-28 12:46:50.763 8383 ERROR nova.wsgi     self.filename))
Sep 28 12:46:50 ctl02 nova-api[8383]: 2017-09-28 12:46:50.763 8383 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:46:50 ctl02 nova-api[8383]: 2017-09-28 12:46:50.763 8383 ERROR nova.wsgi
Sep 28 12:46:50 ctl02 nova-api[8383]: 2017-09-28 12:46:50.764 8383 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:46:50 ctl02 nova-api[8383]: 2017-09-28 12:46:50.890 8383 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:46:51 ctl02 nova-api[8383]: 2017-09-28 12:46:51.119 8383 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:46:51 ctl02 nova-api[8383]: 2017-09-28 12:46:51.121 8383 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:46:51 ctl02 nova-api[8383]: 2017-09-28 12:46:51.121 8383 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:46:51 ctl02 nova-api[8383]: 2017-09-28 12:46:51.122 8383 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:46:51 ctl02 neutron-server[30536]: 2017-09-28 12:46:51.144 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:46:51] "OPTIONS / HTTP/1.0" 200 262 0.000469
Sep 28 12:46:51 ctl02 neutron-server[30536]: 2017-09-28 12:46:51.242 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 4 dead agents out of 6:
Sep 28 12:46:51 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:46:51 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:44:56 cmp002
Sep 28 12:46:51 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:45:28 cmp001
Sep 28 12:46:51 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:45:20 cmp002
Sep 28 12:46:51 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:46:16 cmp002
Sep 28 12:46:51 ctl02 nova-api[8383]: 2017-09-28 12:46:51.259 8383 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:46:51 ctl02 nova-api[8383]: 2017-09-28 12:46:51.261 8383 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:46:51 ctl02 nova-api[8383]: 2017-09-28 12:46:51.261 8383 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:46:51 ctl02 nova-api[8383]: 2017-09-28 12:46:51.261 8383 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:46:51 ctl02 nova-api[8383]: 2017-09-28 12:46:51.265 8383 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:46:51 ctl02 nova-api[8383]: 2017-09-28 12:46:51.265 8383 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:46:51 ctl02 nova-api[8383]: 2017-09-28 12:46:51.265 8383 ERROR nova Traceback (most recent call last):
Sep 28 12:46:51 ctl02 nova-api[8383]: 2017-09-28 12:46:51.265 8383 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:46:51 ctl02 nova-api[8383]: 2017-09-28 12:46:51.265 8383 ERROR nova     sys.exit(main())
Sep 28 12:46:51 ctl02 nova-api[8383]: 2017-09-28 12:46:51.265 8383 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:46:51 ctl02 nova-api[8383]: 2017-09-28 12:46:51.265 8383 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:46:51 ctl02 nova-api[8383]: 2017-09-28 12:46:51.265 8383 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:46:51 ctl02 nova-api[8383]: 2017-09-28 12:46:51.265 8383 ERROR nova     max_url_len=max_url_len)
Sep 28 12:46:51 ctl02 nova-api[8383]: 2017-09-28 12:46:51.265 8383 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:46:51 ctl02 nova-api[8383]: 2017-09-28 12:46:51.265 8383 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:46:51 ctl02 nova-api[8383]: 2017-09-28 12:46:51.265 8383 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:46:51 ctl02 nova-api[8383]: 2017-09-28 12:46:51.265 8383 ERROR nova     sock.listen(backlog)
Sep 28 12:46:51 ctl02 nova-api[8383]: 2017-09-28 12:46:51.265 8383 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:46:51 ctl02 nova-api[8383]: 2017-09-28 12:46:51.265 8383 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:46:51 ctl02 nova-api[8383]: 2017-09-28 12:46:51.265 8383 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:46:51 ctl02 nova-api[8383]: 2017-09-28 12:46:51.265 8383 ERROR nova
Sep 28 12:46:51 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:46:51 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:46:51 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:46:51 ctl02 neutron-server[30536]: 2017-09-28 12:46:51.425 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:46:51] "OPTIONS / HTTP/1.0" 200 262 0.000466
Sep 28 12:46:51 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:46:51 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:46:51 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:46:51 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:46:51 ctl02 heat-api-cfn[13300]: 2017-09-28 12:46:51.739 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:46:51] "OPTIONS / HTTP/1.0" 200 134 0.000445
Sep 28 12:46:51 ctl02 glance-api[29183]: 2017-09-28 12:46:51.836 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:46:51] "OPTIONS / HTTP/1.0" 200 134 0.000712
Sep 28 12:46:53 ctl02 nova-api[8401]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:46:53 ctl02 nova-api[8401]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:46:53 ctl02 nova-api[8401]: 2017-09-28 12:46:53.519 8401 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:46:53 ctl02 nova-api[8401]: 2017-09-28 12:46:53.520 8401 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:46:53 ctl02 nova-api[8401]: 2017-09-28 12:46:53.520 8401 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:46:53 ctl02 nova-api[8401]: 2017-09-28 12:46:53.520 8401 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:46:53 ctl02 nova-api[8401]: 2017-09-28 12:46:53.520 8401 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:46:53 ctl02 nova-api[8401]: 2017-09-28 12:46:53.520 8401 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:46:53 ctl02 nova-api[8401]: 2017-09-28 12:46:53.520 8401 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:46:53 ctl02 nova-api[8401]: 2017-09-28 12:46:53.520 8401 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:46:53 ctl02 nova-api[8401]: 2017-09-28 12:46:53.520 8401 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:46:53 ctl02 nova-api[8401]: 2017-09-28 12:46:53.520 8401 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:46:53 ctl02 nova-api[8401]: 2017-09-28 12:46:53.520 8401 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:46:53 ctl02 nova-api[8401]: 2017-09-28 12:46:53.520 8401 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:46:53 ctl02 nova-api[8401]: 2017-09-28 12:46:53.520 8401 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:46:53 ctl02 nova-api[8401]: 2017-09-28 12:46:53.520 8401 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:46:53 ctl02 nova-api[8401]: 2017-09-28 12:46:53.520 8401 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:46:53 ctl02 nova-api[8401]: 2017-09-28 12:46:53.520 8401 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:46:53 ctl02 nova-api[8401]: 2017-09-28 12:46:53.520 8401 ERROR nova.wsgi     self.filename))
Sep 28 12:46:53 ctl02 nova-api[8401]: 2017-09-28 12:46:53.520 8401 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:46:53 ctl02 nova-api[8401]: 2017-09-28 12:46:53.520 8401 ERROR nova.wsgi
Sep 28 12:46:53 ctl02 nova-api[8401]: 2017-09-28 12:46:53.522 8401 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:46:53 ctl02 nova-api[8401]: 2017-09-28 12:46:53.657 8401 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:46:53 ctl02 nova-api[8401]: 2017-09-28 12:46:53.909 8401 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:46:53 ctl02 nova-api[8401]: 2017-09-28 12:46:53.912 8401 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:46:53 ctl02 nova-api[8401]: 2017-09-28 12:46:53.912 8401 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:46:53 ctl02 nova-api[8401]: 2017-09-28 12:46:53.913 8401 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:46:54 ctl02 nova-api[8401]: 2017-09-28 12:46:54.046 8401 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:46:54 ctl02 nova-api[8401]: 2017-09-28 12:46:54.049 8401 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:46:54 ctl02 nova-api[8401]: 2017-09-28 12:46:54.050 8401 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:46:54 ctl02 nova-api[8401]: 2017-09-28 12:46:54.050 8401 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:46:54 ctl02 nova-api[8401]: 2017-09-28 12:46:54.053 8401 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:46:54 ctl02 nova-api[8401]: 2017-09-28 12:46:54.054 8401 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:46:54 ctl02 nova-api[8401]: 2017-09-28 12:46:54.054 8401 ERROR nova Traceback (most recent call last):
Sep 28 12:46:54 ctl02 nova-api[8401]: 2017-09-28 12:46:54.054 8401 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:46:54 ctl02 nova-api[8401]: 2017-09-28 12:46:54.054 8401 ERROR nova     sys.exit(main())
Sep 28 12:46:54 ctl02 nova-api[8401]: 2017-09-28 12:46:54.054 8401 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:46:54 ctl02 nova-api[8401]: 2017-09-28 12:46:54.054 8401 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:46:54 ctl02 nova-api[8401]: 2017-09-28 12:46:54.054 8401 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:46:54 ctl02 nova-api[8401]: 2017-09-28 12:46:54.054 8401 ERROR nova     max_url_len=max_url_len)
Sep 28 12:46:54 ctl02 nova-api[8401]: 2017-09-28 12:46:54.054 8401 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:46:54 ctl02 nova-api[8401]: 2017-09-28 12:46:54.054 8401 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:46:54 ctl02 nova-api[8401]: 2017-09-28 12:46:54.054 8401 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:46:54 ctl02 nova-api[8401]: 2017-09-28 12:46:54.054 8401 ERROR nova     sock.listen(backlog)
Sep 28 12:46:54 ctl02 nova-api[8401]: 2017-09-28 12:46:54.054 8401 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:46:54 ctl02 nova-api[8401]: 2017-09-28 12:46:54.054 8401 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:46:54 ctl02 nova-api[8401]: 2017-09-28 12:46:54.054 8401 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:46:54 ctl02 nova-api[8401]: 2017-09-28 12:46:54.054 8401 ERROR nova
Sep 28 12:46:54 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:46:54 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:46:54 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:46:54 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:46:54 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:46:54 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:46:54 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:46:55 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:46:55.102 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:46:55] "OPTIONS / HTTP/1.0" 200 134 0.000428
Sep 28 12:46:55 ctl02 heat-api[13008]: 2017-09-28 12:46:55.910 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:46:55] "OPTIONS / HTTP/1.0" 200 134 0.000622
Sep 28 12:46:56 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:46:56.033 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:46:56] "OPTIONS / HTTP/1.0" 200 134 0.000434
Sep 28 12:46:56 ctl02 nova-api[8419]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:46:56 ctl02 nova-api[8419]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:46:56 ctl02 nova-api[8419]: 2017-09-28 12:46:56.272 8419 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:46:56 ctl02 nova-api[8419]: 2017-09-28 12:46:56.274 8419 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:46:56 ctl02 nova-api[8419]: 2017-09-28 12:46:56.274 8419 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:46:56 ctl02 nova-api[8419]: 2017-09-28 12:46:56.274 8419 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:46:56 ctl02 nova-api[8419]: 2017-09-28 12:46:56.274 8419 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:46:56 ctl02 nova-api[8419]: 2017-09-28 12:46:56.274 8419 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:46:56 ctl02 nova-api[8419]: 2017-09-28 12:46:56.274 8419 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:46:56 ctl02 nova-api[8419]: 2017-09-28 12:46:56.274 8419 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:46:56 ctl02 nova-api[8419]: 2017-09-28 12:46:56.274 8419 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:46:56 ctl02 nova-api[8419]: 2017-09-28 12:46:56.274 8419 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:46:56 ctl02 nova-api[8419]: 2017-09-28 12:46:56.274 8419 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:46:56 ctl02 nova-api[8419]: 2017-09-28 12:46:56.274 8419 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:46:56 ctl02 nova-api[8419]: 2017-09-28 12:46:56.274 8419 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:46:56 ctl02 nova-api[8419]: 2017-09-28 12:46:56.274 8419 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:46:56 ctl02 nova-api[8419]: 2017-09-28 12:46:56.274 8419 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:46:56 ctl02 nova-api[8419]: 2017-09-28 12:46:56.274 8419 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:46:56 ctl02 nova-api[8419]: 2017-09-28 12:46:56.274 8419 ERROR nova.wsgi     self.filename))
Sep 28 12:46:56 ctl02 nova-api[8419]: 2017-09-28 12:46:56.274 8419 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:46:56 ctl02 nova-api[8419]: 2017-09-28 12:46:56.274 8419 ERROR nova.wsgi
Sep 28 12:46:56 ctl02 nova-api[8419]: 2017-09-28 12:46:56.283 8419 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:46:56 ctl02 nova-api[8419]: 2017-09-28 12:46:56.415 8419 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:46:56 ctl02 nova-api[8419]: 2017-09-28 12:46:56.664 8419 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:46:56 ctl02 nova-api[8419]: 2017-09-28 12:46:56.667 8419 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:46:56 ctl02 nova-api[8419]: 2017-09-28 12:46:56.667 8419 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:46:56 ctl02 nova-api[8419]: 2017-09-28 12:46:56.667 8419 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:46:56 ctl02 nova-api[8419]: 2017-09-28 12:46:56.800 8419 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:46:56 ctl02 nova-api[8419]: 2017-09-28 12:46:56.802 8419 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:46:56 ctl02 nova-api[8419]: 2017-09-28 12:46:56.802 8419 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:46:56 ctl02 nova-api[8419]: 2017-09-28 12:46:56.802 8419 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:46:56 ctl02 nova-api[8419]: 2017-09-28 12:46:56.806 8419 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:46:56 ctl02 nova-api[8419]: 2017-09-28 12:46:56.806 8419 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:46:56 ctl02 nova-api[8419]: 2017-09-28 12:46:56.806 8419 ERROR nova Traceback (most recent call last):
Sep 28 12:46:56 ctl02 nova-api[8419]: 2017-09-28 12:46:56.806 8419 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:46:56 ctl02 nova-api[8419]: 2017-09-28 12:46:56.806 8419 ERROR nova     sys.exit(main())
Sep 28 12:46:56 ctl02 nova-api[8419]: 2017-09-28 12:46:56.806 8419 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:46:56 ctl02 nova-api[8419]: 2017-09-28 12:46:56.806 8419 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:46:56 ctl02 nova-api[8419]: 2017-09-28 12:46:56.806 8419 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:46:56 ctl02 nova-api[8419]: 2017-09-28 12:46:56.806 8419 ERROR nova     max_url_len=max_url_len)
Sep 28 12:46:56 ctl02 nova-api[8419]: 2017-09-28 12:46:56.806 8419 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:46:56 ctl02 nova-api[8419]: 2017-09-28 12:46:56.806 8419 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:46:56 ctl02 nova-api[8419]: 2017-09-28 12:46:56.806 8419 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:46:56 ctl02 nova-api[8419]: 2017-09-28 12:46:56.806 8419 ERROR nova     sock.listen(backlog)
Sep 28 12:46:56 ctl02 nova-api[8419]: 2017-09-28 12:46:56.806 8419 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:46:56 ctl02 nova-api[8419]: 2017-09-28 12:46:56.806 8419 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:46:56 ctl02 nova-api[8419]: 2017-09-28 12:46:56.806 8419 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:46:56 ctl02 nova-api[8419]: 2017-09-28 12:46:56.806 8419 ERROR nova
Sep 28 12:46:56 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:46:56 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:46:56 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:46:57 ctl02 heat-api[13008]: 2017-09-28 12:46:57.034 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:46:57] "OPTIONS / HTTP/1.0" 200 134 0.000694
Sep 28 12:46:57 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:46:57 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:46:57 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:46:57 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:46:57 ctl02 heat-api[13008]: 2017-09-28 12:46:57.432 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:46:57] "OPTIONS / HTTP/1.0" 200 134 0.000642
Sep 28 12:46:57 ctl02 heat-api-cfn[13300]: 2017-09-28 12:46:57.709 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:46:57] "OPTIONS / HTTP/1.0" 200 134 0.000481
Sep 28 12:46:57 ctl02 heat-api-cfn[13300]: 2017-09-28 12:46:57.847 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:46:57] "OPTIONS / HTTP/1.0" 200 134 0.000471
Sep 28 12:46:58 ctl02 neutron-server[30536]: 2017-09-28 12:46:58.502 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:46:58 ctl02 nova-api[8437]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:46:58 ctl02 nova-api[8437]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:46:58 ctl02 nova-api[8437]: 2017-09-28 12:46:58.981 8437 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:46:58 ctl02 nova-api[8437]: 2017-09-28 12:46:58.982 8437 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:46:58 ctl02 nova-api[8437]: 2017-09-28 12:46:58.982 8437 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:46:58 ctl02 nova-api[8437]: 2017-09-28 12:46:58.982 8437 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:46:58 ctl02 nova-api[8437]: 2017-09-28 12:46:58.982 8437 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:46:58 ctl02 nova-api[8437]: 2017-09-28 12:46:58.982 8437 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:46:58 ctl02 nova-api[8437]: 2017-09-28 12:46:58.982 8437 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:46:58 ctl02 nova-api[8437]: 2017-09-28 12:46:58.982 8437 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:46:58 ctl02 nova-api[8437]: 2017-09-28 12:46:58.982 8437 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:46:58 ctl02 nova-api[8437]: 2017-09-28 12:46:58.982 8437 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:46:58 ctl02 nova-api[8437]: 2017-09-28 12:46:58.982 8437 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:46:58 ctl02 nova-api[8437]: 2017-09-28 12:46:58.982 8437 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:46:58 ctl02 nova-api[8437]: 2017-09-28 12:46:58.982 8437 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:46:58 ctl02 nova-api[8437]: 2017-09-28 12:46:58.982 8437 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:46:58 ctl02 nova-api[8437]: 2017-09-28 12:46:58.982 8437 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:46:58 ctl02 nova-api[8437]: 2017-09-28 12:46:58.982 8437 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:46:58 ctl02 nova-api[8437]: 2017-09-28 12:46:58.982 8437 ERROR nova.wsgi     self.filename))
Sep 28 12:46:58 ctl02 nova-api[8437]: 2017-09-28 12:46:58.982 8437 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:46:58 ctl02 nova-api[8437]: 2017-09-28 12:46:58.982 8437 ERROR nova.wsgi
Sep 28 12:46:58 ctl02 nova-api[8437]: 2017-09-28 12:46:58.983 8437 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:46:59 ctl02 nova-api[8437]: 2017-09-28 12:46:59.110 8437 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:46:59 ctl02 nova-api[8437]: 2017-09-28 12:46:59.334 8437 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:46:59 ctl02 nova-api[8437]: 2017-09-28 12:46:59.337 8437 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:46:59 ctl02 nova-api[8437]: 2017-09-28 12:46:59.337 8437 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:46:59 ctl02 nova-api[8437]: 2017-09-28 12:46:59.337 8437 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:46:59 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:46:59.461 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:46:59] "OPTIONS / HTTP/1.0" 200 134 0.000410
Sep 28 12:46:59 ctl02 nova-api[8437]: 2017-09-28 12:46:59.466 8437 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:46:59 ctl02 nova-api[8437]: 2017-09-28 12:46:59.468 8437 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:46:59 ctl02 nova-api[8437]: 2017-09-28 12:46:59.469 8437 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:46:59 ctl02 nova-api[8437]: 2017-09-28 12:46:59.469 8437 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:46:59 ctl02 nova-api[8437]: 2017-09-28 12:46:59.472 8437 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:46:59 ctl02 nova-api[8437]: 2017-09-28 12:46:59.472 8437 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:46:59 ctl02 nova-api[8437]: 2017-09-28 12:46:59.472 8437 ERROR nova Traceback (most recent call last):
Sep 28 12:46:59 ctl02 nova-api[8437]: 2017-09-28 12:46:59.472 8437 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:46:59 ctl02 nova-api[8437]: 2017-09-28 12:46:59.472 8437 ERROR nova     sys.exit(main())
Sep 28 12:46:59 ctl02 nova-api[8437]: 2017-09-28 12:46:59.472 8437 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:46:59 ctl02 nova-api[8437]: 2017-09-28 12:46:59.472 8437 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:46:59 ctl02 nova-api[8437]: 2017-09-28 12:46:59.472 8437 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:46:59 ctl02 nova-api[8437]: 2017-09-28 12:46:59.472 8437 ERROR nova     max_url_len=max_url_len)
Sep 28 12:46:59 ctl02 nova-api[8437]: 2017-09-28 12:46:59.472 8437 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:46:59 ctl02 nova-api[8437]: 2017-09-28 12:46:59.472 8437 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:46:59 ctl02 nova-api[8437]: 2017-09-28 12:46:59.472 8437 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:46:59 ctl02 nova-api[8437]: 2017-09-28 12:46:59.472 8437 ERROR nova     sock.listen(backlog)
Sep 28 12:46:59 ctl02 nova-api[8437]: 2017-09-28 12:46:59.472 8437 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:46:59 ctl02 nova-api[8437]: 2017-09-28 12:46:59.472 8437 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:46:59 ctl02 nova-api[8437]: 2017-09-28 12:46:59.472 8437 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:46:59 ctl02 nova-api[8437]: 2017-09-28 12:46:59.472 8437 ERROR nova
Sep 28 12:46:59 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:46:59 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:46:59 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:46:59 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:46:59 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:46:59 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:46:59 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:46:59 ctl02 neutron-server[30536]: 2017-09-28 12:46:59.954 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:46:59] "OPTIONS / HTTP/1.0" 200 262 0.000570
Sep 28 12:47:00 ctl02 glance-api[29183]: 2017-09-28 12:47:00.490 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:47:00] "OPTIONS / HTTP/1.0" 200 134 0.000560
Sep 28 12:47:00 ctl02 neutron-server[30536]: 2017-09-28 12:47:00.908 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:47:00] "OPTIONS / HTTP/1.0" 200 262 0.000493
Sep 28 12:47:01 ctl02 glance-api[29183]: 2017-09-28 12:47:01.009 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:47:01] "OPTIONS / HTTP/1.0" 200 134 0.000602
Sep 28 12:47:01 ctl02 neutron-server[30536]: 2017-09-28 12:47:01.207 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:47:01] "OPTIONS / HTTP/1.0" 200 262 0.000418
Sep 28 12:47:01 ctl02 nova-api[8455]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:47:01 ctl02 nova-api[8455]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:47:01 ctl02 glance-api[29183]: 2017-09-28 12:47:01.595 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:47:01] "OPTIONS / HTTP/1.0" 200 134 0.000632
Sep 28 12:47:01 ctl02 nova-api[8455]: 2017-09-28 12:47:01.743 8455 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:47:01 ctl02 nova-api[8455]: 2017-09-28 12:47:01.745 8455 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:47:01 ctl02 nova-api[8455]: 2017-09-28 12:47:01.745 8455 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:47:01 ctl02 nova-api[8455]: 2017-09-28 12:47:01.745 8455 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:47:01 ctl02 nova-api[8455]: 2017-09-28 12:47:01.745 8455 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:47:01 ctl02 nova-api[8455]: 2017-09-28 12:47:01.745 8455 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:47:01 ctl02 nova-api[8455]: 2017-09-28 12:47:01.745 8455 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:47:01 ctl02 nova-api[8455]: 2017-09-28 12:47:01.745 8455 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:47:01 ctl02 nova-api[8455]: 2017-09-28 12:47:01.745 8455 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:47:01 ctl02 nova-api[8455]: 2017-09-28 12:47:01.745 8455 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:47:01 ctl02 nova-api[8455]: 2017-09-28 12:47:01.745 8455 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:47:01 ctl02 nova-api[8455]: 2017-09-28 12:47:01.745 8455 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:47:01 ctl02 nova-api[8455]: 2017-09-28 12:47:01.745 8455 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:47:01 ctl02 nova-api[8455]: 2017-09-28 12:47:01.745 8455 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:47:01 ctl02 nova-api[8455]: 2017-09-28 12:47:01.745 8455 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:47:01 ctl02 nova-api[8455]: 2017-09-28 12:47:01.745 8455 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:47:01 ctl02 nova-api[8455]: 2017-09-28 12:47:01.745 8455 ERROR nova.wsgi     self.filename))
Sep 28 12:47:01 ctl02 nova-api[8455]: 2017-09-28 12:47:01.745 8455 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:47:01 ctl02 nova-api[8455]: 2017-09-28 12:47:01.745 8455 ERROR nova.wsgi
Sep 28 12:47:01 ctl02 nova-api[8455]: 2017-09-28 12:47:01.746 8455 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:47:01 ctl02 heat-api-cfn[13300]: 2017-09-28 12:47:01.752 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:47:01] "OPTIONS / HTTP/1.0" 200 134 0.000524
Sep 28 12:47:01 ctl02 nova-api[8455]: 2017-09-28 12:47:01.874 8455 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:47:02 ctl02 nova-api[8455]: 2017-09-28 12:47:02.097 8455 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:47:02 ctl02 nova-api[8455]: 2017-09-28 12:47:02.099 8455 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:47:02 ctl02 nova-api[8455]: 2017-09-28 12:47:02.100 8455 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:47:02 ctl02 nova-api[8455]: 2017-09-28 12:47:02.100 8455 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:47:02 ctl02 nova-api[8455]: 2017-09-28 12:47:02.233 8455 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:47:02 ctl02 nova-api[8455]: 2017-09-28 12:47:02.235 8455 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:47:02 ctl02 nova-api[8455]: 2017-09-28 12:47:02.235 8455 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:47:02 ctl02 nova-api[8455]: 2017-09-28 12:47:02.236 8455 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:47:02 ctl02 nova-api[8455]: 2017-09-28 12:47:02.239 8455 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:47:02 ctl02 nova-api[8455]: 2017-09-28 12:47:02.239 8455 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:47:02 ctl02 nova-api[8455]: 2017-09-28 12:47:02.239 8455 ERROR nova Traceback (most recent call last):
Sep 28 12:47:02 ctl02 nova-api[8455]: 2017-09-28 12:47:02.239 8455 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:47:02 ctl02 nova-api[8455]: 2017-09-28 12:47:02.239 8455 ERROR nova     sys.exit(main())
Sep 28 12:47:02 ctl02 nova-api[8455]: 2017-09-28 12:47:02.239 8455 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:47:02 ctl02 nova-api[8455]: 2017-09-28 12:47:02.239 8455 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:47:02 ctl02 nova-api[8455]: 2017-09-28 12:47:02.239 8455 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:47:02 ctl02 nova-api[8455]: 2017-09-28 12:47:02.239 8455 ERROR nova     max_url_len=max_url_len)
Sep 28 12:47:02 ctl02 nova-api[8455]: 2017-09-28 12:47:02.239 8455 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:47:02 ctl02 nova-api[8455]: 2017-09-28 12:47:02.239 8455 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:47:02 ctl02 nova-api[8455]: 2017-09-28 12:47:02.239 8455 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:47:02 ctl02 nova-api[8455]: 2017-09-28 12:47:02.239 8455 ERROR nova     sock.listen(backlog)
Sep 28 12:47:02 ctl02 nova-api[8455]: 2017-09-28 12:47:02.239 8455 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:47:02 ctl02 nova-api[8455]: 2017-09-28 12:47:02.239 8455 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:47:02 ctl02 nova-api[8455]: 2017-09-28 12:47:02.239 8455 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:47:02 ctl02 nova-api[8455]: 2017-09-28 12:47:02.239 8455 ERROR nova
Sep 28 12:47:02 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:47:02 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:47:02 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:47:02 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:47:02 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:47:02 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:47:02 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:47:02 ctl02 nova-cert[4860]: 2017-09-28 12:47:02.916 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:47:03 ctl02 nova-conductor[5056]: 2017-09-28 12:47:03.005 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:47:03 ctl02 nova-conductor[5056]: 2017-09-28 12:47:03.033 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:47:03 ctl02 nova-conductor[5056]: 2017-09-28 12:47:03.055 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:47:03 ctl02 nova-conductor[5056]: 2017-09-28 12:47:03.056 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:47:04 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2c271c09)
Sep 28 12:47:04 ctl02 nova-api[8473]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:47:04 ctl02 nova-api[8473]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:47:04 ctl02 nova-api[8473]: 2017-09-28 12:47:04.451 8473 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:47:04 ctl02 nova-api[8473]: 2017-09-28 12:47:04.452 8473 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:47:04 ctl02 nova-api[8473]: 2017-09-28 12:47:04.452 8473 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:47:04 ctl02 nova-api[8473]: 2017-09-28 12:47:04.452 8473 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:47:04 ctl02 nova-api[8473]: 2017-09-28 12:47:04.452 8473 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:47:04 ctl02 nova-api[8473]: 2017-09-28 12:47:04.452 8473 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:47:04 ctl02 nova-api[8473]: 2017-09-28 12:47:04.452 8473 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:47:04 ctl02 nova-api[8473]: 2017-09-28 12:47:04.452 8473 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:47:04 ctl02 nova-api[8473]: 2017-09-28 12:47:04.452 8473 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:47:04 ctl02 nova-api[8473]: 2017-09-28 12:47:04.452 8473 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:47:04 ctl02 nova-api[8473]: 2017-09-28 12:47:04.452 8473 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:47:04 ctl02 nova-api[8473]: 2017-09-28 12:47:04.452 8473 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:47:04 ctl02 nova-api[8473]: 2017-09-28 12:47:04.452 8473 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:47:04 ctl02 nova-api[8473]: 2017-09-28 12:47:04.452 8473 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:47:04 ctl02 nova-api[8473]: 2017-09-28 12:47:04.452 8473 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:47:04 ctl02 nova-api[8473]: 2017-09-28 12:47:04.452 8473 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:47:04 ctl02 nova-api[8473]: 2017-09-28 12:47:04.452 8473 ERROR nova.wsgi     self.filename))
Sep 28 12:47:04 ctl02 nova-api[8473]: 2017-09-28 12:47:04.452 8473 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:47:04 ctl02 nova-api[8473]: 2017-09-28 12:47:04.452 8473 ERROR nova.wsgi
Sep 28 12:47:04 ctl02 nova-api[8473]: 2017-09-28 12:47:04.453 8473 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:47:04 ctl02 nova-api[8473]: 2017-09-28 12:47:04.578 8473 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:47:04 ctl02 nova-api[8473]: 2017-09-28 12:47:04.800 8473 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:47:04 ctl02 nova-api[8473]: 2017-09-28 12:47:04.802 8473 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:47:04 ctl02 nova-api[8473]: 2017-09-28 12:47:04.802 8473 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:47:04 ctl02 nova-api[8473]: 2017-09-28 12:47:04.802 8473 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:47:04 ctl02 nova-api[8473]: 2017-09-28 12:47:04.931 8473 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:47:04 ctl02 nova-api[8473]: 2017-09-28 12:47:04.932 8473 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:47:04 ctl02 nova-api[8473]: 2017-09-28 12:47:04.933 8473 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:47:04 ctl02 nova-api[8473]: 2017-09-28 12:47:04.933 8473 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:47:04 ctl02 nova-api[8473]: 2017-09-28 12:47:04.936 8473 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:47:04 ctl02 nova-api[8473]: 2017-09-28 12:47:04.936 8473 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:47:04 ctl02 nova-api[8473]: 2017-09-28 12:47:04.936 8473 ERROR nova Traceback (most recent call last):
Sep 28 12:47:04 ctl02 nova-api[8473]: 2017-09-28 12:47:04.936 8473 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:47:04 ctl02 nova-api[8473]: 2017-09-28 12:47:04.936 8473 ERROR nova     sys.exit(main())
Sep 28 12:47:04 ctl02 nova-api[8473]: 2017-09-28 12:47:04.936 8473 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:47:04 ctl02 nova-api[8473]: 2017-09-28 12:47:04.936 8473 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:47:04 ctl02 nova-api[8473]: 2017-09-28 12:47:04.936 8473 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:47:04 ctl02 nova-api[8473]: 2017-09-28 12:47:04.936 8473 ERROR nova     max_url_len=max_url_len)
Sep 28 12:47:04 ctl02 nova-api[8473]: 2017-09-28 12:47:04.936 8473 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:47:04 ctl02 nova-api[8473]: 2017-09-28 12:47:04.936 8473 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:47:04 ctl02 nova-api[8473]: 2017-09-28 12:47:04.936 8473 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:47:04 ctl02 nova-api[8473]: 2017-09-28 12:47:04.936 8473 ERROR nova     sock.listen(backlog)
Sep 28 12:47:04 ctl02 nova-api[8473]: 2017-09-28 12:47:04.936 8473 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:47:04 ctl02 nova-api[8473]: 2017-09-28 12:47:04.936 8473 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:47:04 ctl02 nova-api[8473]: 2017-09-28 12:47:04.936 8473 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:47:04 ctl02 nova-api[8473]: 2017-09-28 12:47:04.936 8473 ERROR nova
Sep 28 12:47:05 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:47:05 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:47:05 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:47:05 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2c271c09)
Sep 28 12:47:05 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:47:05 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:47:05 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:47:05 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:47:05 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:47:05.426 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:47:05] "OPTIONS / HTTP/1.0" 200 134 0.000514
Sep 28 12:47:05 ctl02 heat-api[13008]: 2017-09-28 12:47:05.868 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:47:05] "OPTIONS / HTTP/1.0" 200 134 0.000781
Sep 28 12:47:06 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2c271c09)
Sep 28 12:47:06 ctl02 neutron-server[30536]: 2017-09-28 12:47:06.239 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 12:47:06 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:47:06 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:45:28 cmp001
Sep 28 12:47:06 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:45:20 cmp002
Sep 28 12:47:06 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:46:16 cmp002
Sep 28 12:47:06 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:47:06.351 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:47:06] "OPTIONS / HTTP/1.0" 200 134 0.000488
Sep 28 12:47:07 ctl02 nova-api[8491]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:47:07 ctl02 nova-api[8491]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:47:07 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2c271c09)
Sep 28 12:47:07 ctl02 nova-api[8491]: 2017-09-28 12:47:07.219 8491 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:47:07 ctl02 nova-api[8491]: 2017-09-28 12:47:07.221 8491 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:47:07 ctl02 nova-api[8491]: 2017-09-28 12:47:07.221 8491 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:47:07 ctl02 nova-api[8491]: 2017-09-28 12:47:07.221 8491 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:47:07 ctl02 nova-api[8491]: 2017-09-28 12:47:07.221 8491 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:47:07 ctl02 nova-api[8491]: 2017-09-28 12:47:07.221 8491 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:47:07 ctl02 nova-api[8491]: 2017-09-28 12:47:07.221 8491 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:47:07 ctl02 nova-api[8491]: 2017-09-28 12:47:07.221 8491 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:47:07 ctl02 nova-api[8491]: 2017-09-28 12:47:07.221 8491 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:47:07 ctl02 nova-api[8491]: 2017-09-28 12:47:07.221 8491 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:47:07 ctl02 nova-api[8491]: 2017-09-28 12:47:07.221 8491 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:47:07 ctl02 nova-api[8491]: 2017-09-28 12:47:07.221 8491 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:47:07 ctl02 nova-api[8491]: 2017-09-28 12:47:07.221 8491 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:47:07 ctl02 nova-api[8491]: 2017-09-28 12:47:07.221 8491 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:47:07 ctl02 nova-api[8491]: 2017-09-28 12:47:07.221 8491 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:47:07 ctl02 nova-api[8491]: 2017-09-28 12:47:07.221 8491 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:47:07 ctl02 nova-api[8491]: 2017-09-28 12:47:07.221 8491 ERROR nova.wsgi     self.filename))
Sep 28 12:47:07 ctl02 nova-api[8491]: 2017-09-28 12:47:07.221 8491 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:47:07 ctl02 nova-api[8491]: 2017-09-28 12:47:07.221 8491 ERROR nova.wsgi
Sep 28 12:47:07 ctl02 nova-api[8491]: 2017-09-28 12:47:07.222 8491 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:47:07 ctl02 heat-api[13008]: 2017-09-28 12:47:07.339 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:47:07] "OPTIONS / HTTP/1.0" 200 134 0.000725
Sep 28 12:47:07 ctl02 nova-api[8491]: 2017-09-28 12:47:07.348 8491 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:47:07 ctl02 heat-api-cfn[13300]: 2017-09-28 12:47:07.362 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:47:07] "OPTIONS / HTTP/1.0" 200 134 0.000542
Sep 28 12:47:07 ctl02 heat-api[13008]: 2017-09-28 12:47:07.466 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:47:07] "OPTIONS / HTTP/1.0" 200 134 0.000632
Sep 28 12:47:07 ctl02 nova-api[8491]: 2017-09-28 12:47:07.574 8491 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:47:07 ctl02 nova-api[8491]: 2017-09-28 12:47:07.576 8491 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:47:07 ctl02 nova-api[8491]: 2017-09-28 12:47:07.576 8491 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:47:07 ctl02 nova-api[8491]: 2017-09-28 12:47:07.577 8491 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:47:07 ctl02 nova-api[8491]: 2017-09-28 12:47:07.706 8491 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:47:07 ctl02 nova-api[8491]: 2017-09-28 12:47:07.708 8491 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:47:07 ctl02 nova-api[8491]: 2017-09-28 12:47:07.708 8491 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:47:07 ctl02 nova-api[8491]: 2017-09-28 12:47:07.709 8491 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:47:07 ctl02 nova-api[8491]: 2017-09-28 12:47:07.712 8491 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:47:07 ctl02 nova-api[8491]: 2017-09-28 12:47:07.712 8491 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:47:07 ctl02 nova-api[8491]: 2017-09-28 12:47:07.712 8491 ERROR nova Traceback (most recent call last):
Sep 28 12:47:07 ctl02 nova-api[8491]: 2017-09-28 12:47:07.712 8491 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:47:07 ctl02 nova-api[8491]: 2017-09-28 12:47:07.712 8491 ERROR nova     sys.exit(main())
Sep 28 12:47:07 ctl02 nova-api[8491]: 2017-09-28 12:47:07.712 8491 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:47:07 ctl02 nova-api[8491]: 2017-09-28 12:47:07.712 8491 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:47:07 ctl02 nova-api[8491]: 2017-09-28 12:47:07.712 8491 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:47:07 ctl02 nova-api[8491]: 2017-09-28 12:47:07.712 8491 ERROR nova     max_url_len=max_url_len)
Sep 28 12:47:07 ctl02 nova-api[8491]: 2017-09-28 12:47:07.712 8491 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:47:07 ctl02 nova-api[8491]: 2017-09-28 12:47:07.712 8491 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:47:07 ctl02 nova-api[8491]: 2017-09-28 12:47:07.712 8491 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:47:07 ctl02 nova-api[8491]: 2017-09-28 12:47:07.712 8491 ERROR nova     sock.listen(backlog)
Sep 28 12:47:07 ctl02 nova-api[8491]: 2017-09-28 12:47:07.712 8491 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:47:07 ctl02 nova-api[8491]: 2017-09-28 12:47:07.712 8491 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:47:07 ctl02 nova-api[8491]: 2017-09-28 12:47:07.712 8491 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:47:07 ctl02 nova-api[8491]: 2017-09-28 12:47:07.712 8491 ERROR nova
Sep 28 12:47:07 ctl02 heat-api-cfn[13300]: 2017-09-28 12:47:07.820 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:47:07] "OPTIONS / HTTP/1.0" 200 134 0.000567
Sep 28 12:47:07 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:47:07 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:47:07 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:47:08 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:47:08 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:47:08 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:47:08 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:47:08 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2c271c09)
Sep 28 12:47:09 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2c271c09)
Sep 28 12:47:09 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:47:09.519 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:47:09] "OPTIONS / HTTP/1.0" 200 134 0.000381
Sep 28 12:47:09 ctl02 nova-api[8509]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:47:09 ctl02 nova-api[8509]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:47:09 ctl02 neutron-server[30536]: 2017-09-28 12:47:09.931 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:47:09] "OPTIONS / HTTP/1.0" 200 262 0.000523
Sep 28 12:47:10 ctl02 nova-api[8509]: 2017-09-28 12:47:09.999 8509 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:47:10 ctl02 nova-api[8509]: 2017-09-28 12:47:10.001 8509 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:47:10 ctl02 nova-api[8509]: 2017-09-28 12:47:10.001 8509 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:47:10 ctl02 nova-api[8509]: 2017-09-28 12:47:10.001 8509 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:47:10 ctl02 nova-api[8509]: 2017-09-28 12:47:10.001 8509 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:47:10 ctl02 nova-api[8509]: 2017-09-28 12:47:10.001 8509 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:47:10 ctl02 nova-api[8509]: 2017-09-28 12:47:10.001 8509 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:47:10 ctl02 nova-api[8509]: 2017-09-28 12:47:10.001 8509 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:47:10 ctl02 nova-api[8509]: 2017-09-28 12:47:10.001 8509 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:47:10 ctl02 nova-api[8509]: 2017-09-28 12:47:10.001 8509 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:47:10 ctl02 nova-api[8509]: 2017-09-28 12:47:10.001 8509 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:47:10 ctl02 nova-api[8509]: 2017-09-28 12:47:10.001 8509 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:47:10 ctl02 nova-api[8509]: 2017-09-28 12:47:10.001 8509 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:47:10 ctl02 nova-api[8509]: 2017-09-28 12:47:10.001 8509 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:47:10 ctl02 nova-api[8509]: 2017-09-28 12:47:10.001 8509 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:47:10 ctl02 nova-api[8509]: 2017-09-28 12:47:10.001 8509 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:47:10 ctl02 nova-api[8509]: 2017-09-28 12:47:10.001 8509 ERROR nova.wsgi     self.filename))
Sep 28 12:47:10 ctl02 nova-api[8509]: 2017-09-28 12:47:10.001 8509 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:47:10 ctl02 nova-api[8509]: 2017-09-28 12:47:10.001 8509 ERROR nova.wsgi
Sep 28 12:47:10 ctl02 nova-api[8509]: 2017-09-28 12:47:10.003 8509 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:47:10 ctl02 nova-api[8509]: 2017-09-28 12:47:10.134 8509 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:47:10 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2c271c09)
Sep 28 12:47:10 ctl02 nova-api[8509]: 2017-09-28 12:47:10.368 8509 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:47:10 ctl02 nova-api[8509]: 2017-09-28 12:47:10.370 8509 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:47:10 ctl02 nova-api[8509]: 2017-09-28 12:47:10.370 8509 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:47:10 ctl02 nova-api[8509]: 2017-09-28 12:47:10.371 8509 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:47:10 ctl02 glance-api[29183]: 2017-09-28 12:47:10.440 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:47:10] "OPTIONS / HTTP/1.0" 200 134 0.000605
Sep 28 12:47:10 ctl02 nova-api[8509]: 2017-09-28 12:47:10.518 8509 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:47:10 ctl02 nova-api[8509]: 2017-09-28 12:47:10.520 8509 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:47:10 ctl02 nova-api[8509]: 2017-09-28 12:47:10.520 8509 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:47:10 ctl02 nova-api[8509]: 2017-09-28 12:47:10.520 8509 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:47:10 ctl02 nova-api[8509]: 2017-09-28 12:47:10.524 8509 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:47:10 ctl02 nova-api[8509]: 2017-09-28 12:47:10.524 8509 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:47:10 ctl02 nova-api[8509]: 2017-09-28 12:47:10.524 8509 ERROR nova Traceback (most recent call last):
Sep 28 12:47:10 ctl02 nova-api[8509]: 2017-09-28 12:47:10.524 8509 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:47:10 ctl02 nova-api[8509]: 2017-09-28 12:47:10.524 8509 ERROR nova     sys.exit(main())
Sep 28 12:47:10 ctl02 nova-api[8509]: 2017-09-28 12:47:10.524 8509 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:47:10 ctl02 nova-api[8509]: 2017-09-28 12:47:10.524 8509 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:47:10 ctl02 nova-api[8509]: 2017-09-28 12:47:10.524 8509 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:47:10 ctl02 nova-api[8509]: 2017-09-28 12:47:10.524 8509 ERROR nova     max_url_len=max_url_len)
Sep 28 12:47:10 ctl02 nova-api[8509]: 2017-09-28 12:47:10.524 8509 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:47:10 ctl02 nova-api[8509]: 2017-09-28 12:47:10.524 8509 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:47:10 ctl02 nova-api[8509]: 2017-09-28 12:47:10.524 8509 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:47:10 ctl02 nova-api[8509]: 2017-09-28 12:47:10.524 8509 ERROR nova     sock.listen(backlog)
Sep 28 12:47:10 ctl02 nova-api[8509]: 2017-09-28 12:47:10.524 8509 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:47:10 ctl02 nova-api[8509]: 2017-09-28 12:47:10.524 8509 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:47:10 ctl02 nova-api[8509]: 2017-09-28 12:47:10.524 8509 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:47:10 ctl02 nova-api[8509]: 2017-09-28 12:47:10.524 8509 ERROR nova
Sep 28 12:47:10 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:47:10 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:47:10 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:47:10 ctl02 glance-api[29183]: 2017-09-28 12:47:10.865 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:47:10] "OPTIONS / HTTP/1.0" 200 134 0.001130
Sep 28 12:47:10 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:47:10 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:47:10 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:47:10 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:47:11 ctl02 neutron-server[30536]: 2017-09-28 12:47:11.095 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:47:11] "OPTIONS / HTTP/1.0" 200 262 0.000524
Sep 28 12:47:11 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2c271c09)
Sep 28 12:47:11 ctl02 glance-api[29183]: 2017-09-28 12:47:11.212 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:47:11] "OPTIONS / HTTP/1.0" 200 134 0.000552
Sep 28 12:47:11 ctl02 neutron-server[30536]: 2017-09-28 12:47:11.439 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:47:11] "OPTIONS / HTTP/1.0" 200 262 0.000732
Sep 28 12:47:11 ctl02 heat-api-cfn[13300]: 2017-09-28 12:47:11.649 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:47:11] "OPTIONS / HTTP/1.0" 200 134 0.000442
Sep 28 12:47:12 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2c271c09)
Sep 28 12:47:12 ctl02 nova-api[8527]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:47:12 ctl02 nova-api[8527]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:47:12 ctl02 nova-api[8527]: 2017-09-28 12:47:12.753 8527 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:47:12 ctl02 nova-api[8527]: 2017-09-28 12:47:12.754 8527 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:47:12 ctl02 nova-api[8527]: 2017-09-28 12:47:12.754 8527 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:47:12 ctl02 nova-api[8527]: 2017-09-28 12:47:12.754 8527 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:47:12 ctl02 nova-api[8527]: 2017-09-28 12:47:12.754 8527 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:47:12 ctl02 nova-api[8527]: 2017-09-28 12:47:12.754 8527 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:47:12 ctl02 nova-api[8527]: 2017-09-28 12:47:12.754 8527 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:47:12 ctl02 nova-api[8527]: 2017-09-28 12:47:12.754 8527 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:47:12 ctl02 nova-api[8527]: 2017-09-28 12:47:12.754 8527 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:47:12 ctl02 nova-api[8527]: 2017-09-28 12:47:12.754 8527 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:47:12 ctl02 nova-api[8527]: 2017-09-28 12:47:12.754 8527 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:47:12 ctl02 nova-api[8527]: 2017-09-28 12:47:12.754 8527 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:47:12 ctl02 nova-api[8527]: 2017-09-28 12:47:12.754 8527 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:47:12 ctl02 nova-api[8527]: 2017-09-28 12:47:12.754 8527 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:47:12 ctl02 nova-api[8527]: 2017-09-28 12:47:12.754 8527 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:47:12 ctl02 nova-api[8527]: 2017-09-28 12:47:12.754 8527 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:47:12 ctl02 nova-api[8527]: 2017-09-28 12:47:12.754 8527 ERROR nova.wsgi     self.filename))
Sep 28 12:47:12 ctl02 nova-api[8527]: 2017-09-28 12:47:12.754 8527 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:47:12 ctl02 nova-api[8527]: 2017-09-28 12:47:12.754 8527 ERROR nova.wsgi
Sep 28 12:47:12 ctl02 nova-api[8527]: 2017-09-28 12:47:12.756 8527 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:47:12 ctl02 nova-consoleauth[5433]: 2017-09-28 12:47:12.762 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:47:12 ctl02 nova-api[8527]: 2017-09-28 12:47:12.885 8527 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:47:13 ctl02 nova-api[8527]: 2017-09-28 12:47:13.109 8527 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:47:13 ctl02 nova-api[8527]: 2017-09-28 12:47:13.111 8527 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:47:13 ctl02 nova-api[8527]: 2017-09-28 12:47:13.112 8527 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:47:13 ctl02 nova-api[8527]: 2017-09-28 12:47:13.112 8527 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:47:13 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2c271c09)
Sep 28 12:47:13 ctl02 nova-api[8527]: 2017-09-28 12:47:13.243 8527 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:47:13 ctl02 nova-api[8527]: 2017-09-28 12:47:13.247 8527 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:47:13 ctl02 nova-api[8527]: 2017-09-28 12:47:13.247 8527 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:47:13 ctl02 nova-api[8527]: 2017-09-28 12:47:13.247 8527 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:47:13 ctl02 nova-api[8527]: 2017-09-28 12:47:13.251 8527 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:47:13 ctl02 nova-api[8527]: 2017-09-28 12:47:13.251 8527 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:47:13 ctl02 nova-api[8527]: 2017-09-28 12:47:13.251 8527 ERROR nova Traceback (most recent call last):
Sep 28 12:47:13 ctl02 nova-api[8527]: 2017-09-28 12:47:13.251 8527 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:47:13 ctl02 nova-api[8527]: 2017-09-28 12:47:13.251 8527 ERROR nova     sys.exit(main())
Sep 28 12:47:13 ctl02 nova-api[8527]: 2017-09-28 12:47:13.251 8527 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:47:13 ctl02 nova-api[8527]: 2017-09-28 12:47:13.251 8527 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:47:13 ctl02 nova-api[8527]: 2017-09-28 12:47:13.251 8527 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:47:13 ctl02 nova-api[8527]: 2017-09-28 12:47:13.251 8527 ERROR nova     max_url_len=max_url_len)
Sep 28 12:47:13 ctl02 nova-api[8527]: 2017-09-28 12:47:13.251 8527 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:47:13 ctl02 nova-api[8527]: 2017-09-28 12:47:13.251 8527 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:47:13 ctl02 nova-api[8527]: 2017-09-28 12:47:13.251 8527 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:47:13 ctl02 nova-api[8527]: 2017-09-28 12:47:13.251 8527 ERROR nova     sock.listen(backlog)
Sep 28 12:47:13 ctl02 nova-api[8527]: 2017-09-28 12:47:13.251 8527 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:47:13 ctl02 nova-api[8527]: 2017-09-28 12:47:13.251 8527 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:47:13 ctl02 nova-api[8527]: 2017-09-28 12:47:13.251 8527 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:47:13 ctl02 nova-api[8527]: 2017-09-28 12:47:13.251 8527 ERROR nova
Sep 28 12:47:13 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:47:13 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:47:13 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:47:13 ctl02 neutron-server[30536]: 2017-09-28 12:47:13.501 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:47:13 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:47:13 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:47:13 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:47:13 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:47:14 ctl02 heat-engine[12803]: 2017-09-28 12:47:14.156 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:47:14 ctl02 heat-engine[12803]: 2017-09-28 12:47:14.164 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:47:14 ctl02 heat-engine[12803]: 2017-09-28 12:47:14.164 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:47:14 ctl02 heat-engine[12803]: 2017-09-28 12:47:14.177 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:47:14 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2c271c09)
Sep 28 12:47:15 ctl02 nova-api[8545]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:47:15 ctl02 nova-api[8545]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:47:15 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:47:15 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:47:15 ctl02 nova-api[8545]: 2017-09-28 12:47:15.356 8545 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:47:15 ctl02 nova-api[8545]: 2017-09-28 12:47:15.358 8545 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:47:15 ctl02 nova-api[8545]: 2017-09-28 12:47:15.358 8545 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:47:15 ctl02 nova-api[8545]: 2017-09-28 12:47:15.358 8545 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:47:15 ctl02 nova-api[8545]: 2017-09-28 12:47:15.358 8545 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:47:15 ctl02 nova-api[8545]: 2017-09-28 12:47:15.358 8545 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:47:15 ctl02 nova-api[8545]: 2017-09-28 12:47:15.358 8545 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:47:15 ctl02 nova-api[8545]: 2017-09-28 12:47:15.358 8545 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:47:15 ctl02 nova-api[8545]: 2017-09-28 12:47:15.358 8545 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:47:15 ctl02 nova-api[8545]: 2017-09-28 12:47:15.358 8545 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:47:15 ctl02 nova-api[8545]: 2017-09-28 12:47:15.358 8545 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:47:15 ctl02 nova-api[8545]: 2017-09-28 12:47:15.358 8545 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:47:15 ctl02 nova-api[8545]: 2017-09-28 12:47:15.358 8545 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:47:15 ctl02 nova-api[8545]: 2017-09-28 12:47:15.358 8545 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:47:15 ctl02 nova-api[8545]: 2017-09-28 12:47:15.358 8545 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:47:15 ctl02 nova-api[8545]: 2017-09-28 12:47:15.358 8545 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:47:15 ctl02 nova-api[8545]: 2017-09-28 12:47:15.358 8545 ERROR nova.wsgi     self.filename))
Sep 28 12:47:15 ctl02 nova-api[8545]: 2017-09-28 12:47:15.358 8545 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:47:15 ctl02 nova-api[8545]: 2017-09-28 12:47:15.358 8545 ERROR nova.wsgi
Sep 28 12:47:15 ctl02 nova-api[8545]: 2017-09-28 12:47:15.359 8545 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:47:15 ctl02 nova-api[8545]: 2017-09-28 12:47:15.490 8545 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:47:15 ctl02 heat-api[13008]: 2017-09-28 12:47:15.640 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:47:15] "OPTIONS / HTTP/1.0" 200 134 0.000728
Sep 28 12:47:15 ctl02 nova-api[8545]: 2017-09-28 12:47:15.721 8545 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:47:15 ctl02 nova-api[8545]: 2017-09-28 12:47:15.723 8545 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:47:15 ctl02 nova-api[8545]: 2017-09-28 12:47:15.723 8545 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:47:15 ctl02 nova-api[8545]: 2017-09-28 12:47:15.724 8545 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:47:15 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:47:15.741 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:47:15] "OPTIONS / HTTP/1.0" 200 134 0.000379
Sep 28 12:47:15 ctl02 nova-api[8545]: 2017-09-28 12:47:15.855 8545 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:47:15 ctl02 nova-api[8545]: 2017-09-28 12:47:15.857 8545 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:47:15 ctl02 nova-api[8545]: 2017-09-28 12:47:15.857 8545 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:47:15 ctl02 nova-api[8545]: 2017-09-28 12:47:15.858 8545 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:47:15 ctl02 nova-api[8545]: 2017-09-28 12:47:15.861 8545 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:47:15 ctl02 nova-api[8545]: 2017-09-28 12:47:15.861 8545 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:47:15 ctl02 nova-api[8545]: 2017-09-28 12:47:15.861 8545 ERROR nova Traceback (most recent call last):
Sep 28 12:47:15 ctl02 nova-api[8545]: 2017-09-28 12:47:15.861 8545 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:47:15 ctl02 nova-api[8545]: 2017-09-28 12:47:15.861 8545 ERROR nova     sys.exit(main())
Sep 28 12:47:15 ctl02 nova-api[8545]: 2017-09-28 12:47:15.861 8545 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:47:15 ctl02 nova-api[8545]: 2017-09-28 12:47:15.861 8545 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:47:15 ctl02 nova-api[8545]: 2017-09-28 12:47:15.861 8545 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:47:15 ctl02 nova-api[8545]: 2017-09-28 12:47:15.861 8545 ERROR nova     max_url_len=max_url_len)
Sep 28 12:47:15 ctl02 nova-api[8545]: 2017-09-28 12:47:15.861 8545 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:47:15 ctl02 nova-api[8545]: 2017-09-28 12:47:15.861 8545 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:47:15 ctl02 nova-api[8545]: 2017-09-28 12:47:15.861 8545 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:47:15 ctl02 nova-api[8545]: 2017-09-28 12:47:15.861 8545 ERROR nova     sock.listen(backlog)
Sep 28 12:47:15 ctl02 nova-api[8545]: 2017-09-28 12:47:15.861 8545 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:47:15 ctl02 nova-api[8545]: 2017-09-28 12:47:15.861 8545 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:47:15 ctl02 nova-api[8545]: 2017-09-28 12:47:15.861 8545 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:47:15 ctl02 nova-api[8545]: 2017-09-28 12:47:15.861 8545 ERROR nova
Sep 28 12:47:15 ctl02 nova-scheduler[5620]: 2017-09-28 12:47:15.862 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:47:16 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:47:16 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:47:16 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:47:16 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:47:16 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:47:16 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:47:16 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:47:16 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:47:16.414 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:47:16] "OPTIONS / HTTP/1.0" 200 134 0.000355
Sep 28 12:47:17 ctl02 heat-api-cfn[13300]: 2017-09-28 12:47:17.015 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:47:17] "OPTIONS / HTTP/1.0" 200 134 0.000435
Sep 28 12:47:17 ctl02 heat-api[13008]: 2017-09-28 12:47:17.382 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:47:17] "OPTIONS / HTTP/1.0" 200 134 0.000536
Sep 28 12:47:17 ctl02 heat-api[13008]: 2017-09-28 12:47:17.455 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:47:17] "OPTIONS / HTTP/1.0" 200 134 0.000368
Sep 28 12:47:17 ctl02 heat-api-cfn[13300]: 2017-09-28 12:47:17.781 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:47:17] "OPTIONS / HTTP/1.0" 200 134 0.000403
Sep 28 12:47:17 ctl02 nova-api[8568]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:47:17 ctl02 nova-api[8568]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:47:17 ctl02 nova-api[8568]: 2017-09-28 12:47:17.964 8568 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:47:17 ctl02 nova-api[8568]: 2017-09-28 12:47:17.966 8568 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:47:17 ctl02 nova-api[8568]: 2017-09-28 12:47:17.966 8568 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:47:17 ctl02 nova-api[8568]: 2017-09-28 12:47:17.966 8568 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:47:17 ctl02 nova-api[8568]: 2017-09-28 12:47:17.966 8568 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:47:17 ctl02 nova-api[8568]: 2017-09-28 12:47:17.966 8568 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:47:17 ctl02 nova-api[8568]: 2017-09-28 12:47:17.966 8568 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:47:17 ctl02 nova-api[8568]: 2017-09-28 12:47:17.966 8568 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:47:17 ctl02 nova-api[8568]: 2017-09-28 12:47:17.966 8568 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:47:17 ctl02 nova-api[8568]: 2017-09-28 12:47:17.966 8568 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:47:17 ctl02 nova-api[8568]: 2017-09-28 12:47:17.966 8568 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:47:17 ctl02 nova-api[8568]: 2017-09-28 12:47:17.966 8568 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:47:17 ctl02 nova-api[8568]: 2017-09-28 12:47:17.966 8568 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:47:17 ctl02 nova-api[8568]: 2017-09-28 12:47:17.966 8568 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:47:17 ctl02 nova-api[8568]: 2017-09-28 12:47:17.966 8568 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:47:17 ctl02 nova-api[8568]: 2017-09-28 12:47:17.966 8568 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:47:17 ctl02 nova-api[8568]: 2017-09-28 12:47:17.966 8568 ERROR nova.wsgi     self.filename))
Sep 28 12:47:17 ctl02 nova-api[8568]: 2017-09-28 12:47:17.966 8568 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:47:17 ctl02 nova-api[8568]: 2017-09-28 12:47:17.966 8568 ERROR nova.wsgi
Sep 28 12:47:17 ctl02 nova-api[8568]: 2017-09-28 12:47:17.968 8568 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:47:18 ctl02 nova-api[8568]: 2017-09-28 12:47:18.095 8568 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:47:18 ctl02 nova-api[8568]: 2017-09-28 12:47:18.318 8568 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:47:18 ctl02 nova-api[8568]: 2017-09-28 12:47:18.320 8568 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:47:18 ctl02 nova-api[8568]: 2017-09-28 12:47:18.321 8568 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:47:18 ctl02 nova-api[8568]: 2017-09-28 12:47:18.321 8568 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:47:18 ctl02 nova-api[8568]: 2017-09-28 12:47:18.451 8568 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:47:18 ctl02 nova-api[8568]: 2017-09-28 12:47:18.453 8568 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:47:18 ctl02 nova-api[8568]: 2017-09-28 12:47:18.454 8568 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:47:18 ctl02 nova-api[8568]: 2017-09-28 12:47:18.454 8568 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:47:18 ctl02 nova-api[8568]: 2017-09-28 12:47:18.457 8568 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:47:18 ctl02 nova-api[8568]: 2017-09-28 12:47:18.458 8568 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:47:18 ctl02 nova-api[8568]: 2017-09-28 12:47:18.458 8568 ERROR nova Traceback (most recent call last):
Sep 28 12:47:18 ctl02 nova-api[8568]: 2017-09-28 12:47:18.458 8568 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:47:18 ctl02 nova-api[8568]: 2017-09-28 12:47:18.458 8568 ERROR nova     sys.exit(main())
Sep 28 12:47:18 ctl02 nova-api[8568]: 2017-09-28 12:47:18.458 8568 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:47:18 ctl02 nova-api[8568]: 2017-09-28 12:47:18.458 8568 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:47:18 ctl02 nova-api[8568]: 2017-09-28 12:47:18.458 8568 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:47:18 ctl02 nova-api[8568]: 2017-09-28 12:47:18.458 8568 ERROR nova     max_url_len=max_url_len)
Sep 28 12:47:18 ctl02 nova-api[8568]: 2017-09-28 12:47:18.458 8568 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:47:18 ctl02 nova-api[8568]: 2017-09-28 12:47:18.458 8568 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:47:18 ctl02 nova-api[8568]: 2017-09-28 12:47:18.458 8568 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:47:18 ctl02 nova-api[8568]: 2017-09-28 12:47:18.458 8568 ERROR nova     sock.listen(backlog)
Sep 28 12:47:18 ctl02 nova-api[8568]: 2017-09-28 12:47:18.458 8568 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:47:18 ctl02 nova-api[8568]: 2017-09-28 12:47:18.458 8568 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:47:18 ctl02 nova-api[8568]: 2017-09-28 12:47:18.458 8568 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:47:18 ctl02 nova-api[8568]: 2017-09-28 12:47:18.458 8568 ERROR nova
Sep 28 12:47:18 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:47:18 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:47:18 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:47:18 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:47:18 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:47:18 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:47:18 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:47:19 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:47:19.860 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:47:19] "OPTIONS / HTTP/1.0" 200 134 0.000374
Sep 28 12:47:20 ctl02 glance-api[29183]: 2017-09-28 12:47:20.225 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:47:20] "OPTIONS / HTTP/1.0" 200 134 0.000544
Sep 28 12:47:20 ctl02 neutron-server[30536]: 2017-09-28 12:47:20.284 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:47:20] "OPTIONS / HTTP/1.0" 200 262 0.000460
Sep 28 12:47:20 ctl02 nova-api[8585]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:47:20 ctl02 nova-api[8585]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:47:20 ctl02 nova-api[8585]: 2017-09-28 12:47:20.720 8585 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:47:20 ctl02 nova-api[8585]: 2017-09-28 12:47:20.722 8585 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:47:20 ctl02 nova-api[8585]: 2017-09-28 12:47:20.722 8585 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:47:20 ctl02 nova-api[8585]: 2017-09-28 12:47:20.722 8585 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:47:20 ctl02 nova-api[8585]: 2017-09-28 12:47:20.722 8585 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:47:20 ctl02 nova-api[8585]: 2017-09-28 12:47:20.722 8585 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:47:20 ctl02 nova-api[8585]: 2017-09-28 12:47:20.722 8585 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:47:20 ctl02 nova-api[8585]: 2017-09-28 12:47:20.722 8585 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:47:20 ctl02 nova-api[8585]: 2017-09-28 12:47:20.722 8585 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:47:20 ctl02 nova-api[8585]: 2017-09-28 12:47:20.722 8585 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:47:20 ctl02 nova-api[8585]: 2017-09-28 12:47:20.722 8585 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:47:20 ctl02 nova-api[8585]: 2017-09-28 12:47:20.722 8585 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:47:20 ctl02 nova-api[8585]: 2017-09-28 12:47:20.722 8585 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:47:20 ctl02 nova-api[8585]: 2017-09-28 12:47:20.722 8585 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:47:20 ctl02 nova-api[8585]: 2017-09-28 12:47:20.722 8585 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:47:20 ctl02 nova-api[8585]: 2017-09-28 12:47:20.722 8585 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:47:20 ctl02 nova-api[8585]: 2017-09-28 12:47:20.722 8585 ERROR nova.wsgi     self.filename))
Sep 28 12:47:20 ctl02 nova-api[8585]: 2017-09-28 12:47:20.722 8585 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:47:20 ctl02 nova-api[8585]: 2017-09-28 12:47:20.722 8585 ERROR nova.wsgi
Sep 28 12:47:20 ctl02 nova-api[8585]: 2017-09-28 12:47:20.723 8585 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:47:20 ctl02 nova-api[8585]: 2017-09-28 12:47:20.849 8585 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:47:20 ctl02 glance-api[29183]: 2017-09-28 12:47:20.934 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:47:20] "OPTIONS / HTTP/1.0" 200 134 0.000579
Sep 28 12:47:21 ctl02 nova-api[8585]: 2017-09-28 12:47:21.073 8585 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:47:21 ctl02 nova-api[8585]: 2017-09-28 12:47:21.075 8585 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:47:21 ctl02 nova-api[8585]: 2017-09-28 12:47:21.075 8585 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:47:21 ctl02 nova-api[8585]: 2017-09-28 12:47:21.075 8585 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:47:21 ctl02 nova-api[8585]: 2017-09-28 12:47:21.206 8585 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:47:21 ctl02 nova-api[8585]: 2017-09-28 12:47:21.207 8585 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:47:21 ctl02 nova-api[8585]: 2017-09-28 12:47:21.208 8585 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:47:21 ctl02 nova-api[8585]: 2017-09-28 12:47:21.208 8585 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:47:21 ctl02 nova-api[8585]: 2017-09-28 12:47:21.211 8585 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:47:21 ctl02 nova-api[8585]: 2017-09-28 12:47:21.211 8585 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:47:21 ctl02 nova-api[8585]: 2017-09-28 12:47:21.211 8585 ERROR nova Traceback (most recent call last):
Sep 28 12:47:21 ctl02 nova-api[8585]: 2017-09-28 12:47:21.211 8585 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:47:21 ctl02 nova-api[8585]: 2017-09-28 12:47:21.211 8585 ERROR nova     sys.exit(main())
Sep 28 12:47:21 ctl02 nova-api[8585]: 2017-09-28 12:47:21.211 8585 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:47:21 ctl02 nova-api[8585]: 2017-09-28 12:47:21.211 8585 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:47:21 ctl02 nova-api[8585]: 2017-09-28 12:47:21.211 8585 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:47:21 ctl02 nova-api[8585]: 2017-09-28 12:47:21.211 8585 ERROR nova     max_url_len=max_url_len)
Sep 28 12:47:21 ctl02 nova-api[8585]: 2017-09-28 12:47:21.211 8585 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:47:21 ctl02 nova-api[8585]: 2017-09-28 12:47:21.211 8585 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:47:21 ctl02 nova-api[8585]: 2017-09-28 12:47:21.211 8585 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:47:21 ctl02 nova-api[8585]: 2017-09-28 12:47:21.211 8585 ERROR nova     sock.listen(backlog)
Sep 28 12:47:21 ctl02 nova-api[8585]: 2017-09-28 12:47:21.211 8585 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:47:21 ctl02 nova-api[8585]: 2017-09-28 12:47:21.211 8585 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:47:21 ctl02 nova-api[8585]: 2017-09-28 12:47:21.211 8585 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:47:21 ctl02 nova-api[8585]: 2017-09-28 12:47:21.211 8585 ERROR nova
Sep 28 12:47:21 ctl02 neutron-server[30536]: 2017-09-28 12:47:21.235 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 2 dead agents out of 6:
Sep 28 12:47:21 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:47:21 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:45:28 cmp001
Sep 28 12:47:21 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:46:16 cmp002
Sep 28 12:47:21 ctl02 neutron-server[30536]: 2017-09-28 12:47:21.286 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:47:21] "OPTIONS / HTTP/1.0" 200 262 0.000451
Sep 28 12:47:21 ctl02 neutron-server[30536]: 2017-09-28 12:47:21.308 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:47:21] "OPTIONS / HTTP/1.0" 200 262 0.000465
Sep 28 12:47:21 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:47:21 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:47:21 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:47:21 ctl02 glance-api[29183]: 2017-09-28 12:47:21.455 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:47:21] "OPTIONS / HTTP/1.0" 200 134 0.000616
Sep 28 12:47:21 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:47:21 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:47:21 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:47:21 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:47:21 ctl02 heat-api-cfn[13300]: 2017-09-28 12:47:21.870 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:47:21] "OPTIONS / HTTP/1.0" 200 134 0.000454
Sep 28 12:47:23 ctl02 nova-api[8604]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:47:23 ctl02 nova-api[8604]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:47:23 ctl02 nova-api[8604]: 2017-09-28 12:47:23.485 8604 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:47:23 ctl02 nova-api[8604]: 2017-09-28 12:47:23.486 8604 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:47:23 ctl02 nova-api[8604]: 2017-09-28 12:47:23.486 8604 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:47:23 ctl02 nova-api[8604]: 2017-09-28 12:47:23.486 8604 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:47:23 ctl02 nova-api[8604]: 2017-09-28 12:47:23.486 8604 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:47:23 ctl02 nova-api[8604]: 2017-09-28 12:47:23.486 8604 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:47:23 ctl02 nova-api[8604]: 2017-09-28 12:47:23.486 8604 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:47:23 ctl02 nova-api[8604]: 2017-09-28 12:47:23.486 8604 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:47:23 ctl02 nova-api[8604]: 2017-09-28 12:47:23.486 8604 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:47:23 ctl02 nova-api[8604]: 2017-09-28 12:47:23.486 8604 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:47:23 ctl02 nova-api[8604]: 2017-09-28 12:47:23.486 8604 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:47:23 ctl02 nova-api[8604]: 2017-09-28 12:47:23.486 8604 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:47:23 ctl02 nova-api[8604]: 2017-09-28 12:47:23.486 8604 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:47:23 ctl02 nova-api[8604]: 2017-09-28 12:47:23.486 8604 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:47:23 ctl02 nova-api[8604]: 2017-09-28 12:47:23.486 8604 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:47:23 ctl02 nova-api[8604]: 2017-09-28 12:47:23.486 8604 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:47:23 ctl02 nova-api[8604]: 2017-09-28 12:47:23.486 8604 ERROR nova.wsgi     self.filename))
Sep 28 12:47:23 ctl02 nova-api[8604]: 2017-09-28 12:47:23.486 8604 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:47:23 ctl02 nova-api[8604]: 2017-09-28 12:47:23.486 8604 ERROR nova.wsgi
Sep 28 12:47:23 ctl02 nova-api[8604]: 2017-09-28 12:47:23.489 8604 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:47:23 ctl02 nova-api[8604]: 2017-09-28 12:47:23.615 8604 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:47:23 ctl02 nova-api[8604]: 2017-09-28 12:47:23.843 8604 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:47:23 ctl02 nova-api[8604]: 2017-09-28 12:47:23.845 8604 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:47:23 ctl02 nova-api[8604]: 2017-09-28 12:47:23.846 8604 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:47:23 ctl02 nova-api[8604]: 2017-09-28 12:47:23.846 8604 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:47:23 ctl02 dhclient[600]: DHCPREQUEST of 192.168.11.25 on ens2 to 192.168.11.3 port 67 (xid=0x3415f07)
Sep 28 12:47:23 ctl02 dhclient[600]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 12:47:23 ctl02 nova-api[8604]: 2017-09-28 12:47:23.987 8604 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:47:23 ctl02 nova-api[8604]: 2017-09-28 12:47:23.989 8604 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:47:23 ctl02 nova-api[8604]: 2017-09-28 12:47:23.989 8604 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:47:23 ctl02 nova-api[8604]: 2017-09-28 12:47:23.990 8604 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:47:23 ctl02 nova-api[8604]: 2017-09-28 12:47:23.994 8604 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:47:24 ctl02 nova-api[8604]: 2017-09-28 12:47:23.994 8604 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:47:24 ctl02 nova-api[8604]: 2017-09-28 12:47:23.994 8604 ERROR nova Traceback (most recent call last):
Sep 28 12:47:24 ctl02 nova-api[8604]: 2017-09-28 12:47:23.994 8604 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:47:24 ctl02 nova-api[8604]: 2017-09-28 12:47:23.994 8604 ERROR nova     sys.exit(main())
Sep 28 12:47:24 ctl02 nova-api[8604]: 2017-09-28 12:47:23.994 8604 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:47:24 ctl02 nova-api[8604]: 2017-09-28 12:47:23.994 8604 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:47:24 ctl02 nova-api[8604]: 2017-09-28 12:47:23.994 8604 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:47:24 ctl02 nova-api[8604]: 2017-09-28 12:47:23.994 8604 ERROR nova     max_url_len=max_url_len)
Sep 28 12:47:24 ctl02 nova-api[8604]: 2017-09-28 12:47:23.994 8604 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:47:24 ctl02 nova-api[8604]: 2017-09-28 12:47:23.994 8604 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:47:24 ctl02 nova-api[8604]: 2017-09-28 12:47:23.994 8604 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:47:24 ctl02 nova-api[8604]: 2017-09-28 12:47:23.994 8604 ERROR nova     sock.listen(backlog)
Sep 28 12:47:24 ctl02 nova-api[8604]: 2017-09-28 12:47:23.994 8604 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:47:24 ctl02 nova-api[8604]: 2017-09-28 12:47:23.994 8604 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:47:24 ctl02 nova-api[8604]: 2017-09-28 12:47:23.994 8604 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:47:24 ctl02 nova-api[8604]: 2017-09-28 12:47:23.994 8604 ERROR nova
Sep 28 12:47:24 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 12:47:24 ctl02 ntp[8670]:  * Stopping NTP server ntpd
Sep 28 12:47:24 ctl02 ntp[8670]:    ...done.
Sep 28 12:47:24 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 12:47:24 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 12:47:24 ctl02 ntp[8681]:  * Starting NTP server ntpd
Sep 28 12:47:24 ctl02 ntpd[8688]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 12:47:24 ctl02 ntpd[8688]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -c /var/lib/ntp/ntp.conf.dhcp -u 108:112
Sep 28 12:47:24 ctl02 ntp[8681]:    ...done.
Sep 28 12:47:24 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 12:47:24 ctl02 ntpd[8691]: proto: precision = 0.043 usec (-24)
Sep 28 12:47:24 ctl02 ntpd[8691]: switching logging to file /var/log/ntp.log
Sep 28 12:47:24 ctl02 dhclient[600]: bound to 192.168.11.25 -- renewal in 272 seconds.
Sep 28 12:47:24 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:47:24 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:47:24 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:47:24 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:47:24 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:47:24 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:47:24 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:47:25 ctl02 heat-api[13008]: 2017-09-28 12:47:25.315 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:47:25] "OPTIONS / HTTP/1.0" 200 134 0.000682
Sep 28 12:47:25 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:47:25.950 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:47:25] "OPTIONS / HTTP/1.0" 200 134 0.000474
Sep 28 12:47:26 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:47:26.066 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:47:26] "OPTIONS / HTTP/1.0" 200 134 0.000310
Sep 28 12:47:26 ctl02 nova-api[8704]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:47:26 ctl02 nova-api[8704]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:47:26 ctl02 nova-api[8704]: 2017-09-28 12:47:26.250 8704 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:47:26 ctl02 nova-api[8704]: 2017-09-28 12:47:26.252 8704 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:47:26 ctl02 nova-api[8704]: 2017-09-28 12:47:26.252 8704 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:47:26 ctl02 nova-api[8704]: 2017-09-28 12:47:26.252 8704 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:47:26 ctl02 nova-api[8704]: 2017-09-28 12:47:26.252 8704 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:47:26 ctl02 nova-api[8704]: 2017-09-28 12:47:26.252 8704 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:47:26 ctl02 nova-api[8704]: 2017-09-28 12:47:26.252 8704 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:47:26 ctl02 nova-api[8704]: 2017-09-28 12:47:26.252 8704 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:47:26 ctl02 nova-api[8704]: 2017-09-28 12:47:26.252 8704 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:47:26 ctl02 nova-api[8704]: 2017-09-28 12:47:26.252 8704 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:47:26 ctl02 nova-api[8704]: 2017-09-28 12:47:26.252 8704 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:47:26 ctl02 nova-api[8704]: 2017-09-28 12:47:26.252 8704 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:47:26 ctl02 nova-api[8704]: 2017-09-28 12:47:26.252 8704 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:47:26 ctl02 nova-api[8704]: 2017-09-28 12:47:26.252 8704 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:47:26 ctl02 nova-api[8704]: 2017-09-28 12:47:26.252 8704 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:47:26 ctl02 nova-api[8704]: 2017-09-28 12:47:26.252 8704 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:47:26 ctl02 nova-api[8704]: 2017-09-28 12:47:26.252 8704 ERROR nova.wsgi     self.filename))
Sep 28 12:47:26 ctl02 nova-api[8704]: 2017-09-28 12:47:26.252 8704 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:47:26 ctl02 nova-api[8704]: 2017-09-28 12:47:26.252 8704 ERROR nova.wsgi
Sep 28 12:47:26 ctl02 nova-api[8704]: 2017-09-28 12:47:26.253 8704 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:47:26 ctl02 nova-api[8704]: 2017-09-28 12:47:26.384 8704 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:47:26 ctl02 nova-api[8704]: 2017-09-28 12:47:26.614 8704 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:47:26 ctl02 nova-api[8704]: 2017-09-28 12:47:26.616 8704 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:47:26 ctl02 nova-api[8704]: 2017-09-28 12:47:26.617 8704 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:47:26 ctl02 nova-api[8704]: 2017-09-28 12:47:26.617 8704 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:47:26 ctl02 nova-api[8704]: 2017-09-28 12:47:26.750 8704 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:47:26 ctl02 nova-api[8704]: 2017-09-28 12:47:26.752 8704 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:47:26 ctl02 nova-api[8704]: 2017-09-28 12:47:26.752 8704 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:47:26 ctl02 nova-api[8704]: 2017-09-28 12:47:26.752 8704 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:47:26 ctl02 nova-api[8704]: 2017-09-28 12:47:26.756 8704 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:47:26 ctl02 nova-api[8704]: 2017-09-28 12:47:26.756 8704 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:47:26 ctl02 nova-api[8704]: 2017-09-28 12:47:26.756 8704 ERROR nova Traceback (most recent call last):
Sep 28 12:47:26 ctl02 nova-api[8704]: 2017-09-28 12:47:26.756 8704 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:47:26 ctl02 nova-api[8704]: 2017-09-28 12:47:26.756 8704 ERROR nova     sys.exit(main())
Sep 28 12:47:26 ctl02 nova-api[8704]: 2017-09-28 12:47:26.756 8704 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:47:26 ctl02 nova-api[8704]: 2017-09-28 12:47:26.756 8704 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:47:26 ctl02 nova-api[8704]: 2017-09-28 12:47:26.756 8704 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:47:26 ctl02 nova-api[8704]: 2017-09-28 12:47:26.756 8704 ERROR nova     max_url_len=max_url_len)
Sep 28 12:47:26 ctl02 nova-api[8704]: 2017-09-28 12:47:26.756 8704 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:47:26 ctl02 nova-api[8704]: 2017-09-28 12:47:26.756 8704 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:47:26 ctl02 nova-api[8704]: 2017-09-28 12:47:26.756 8704 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:47:26 ctl02 nova-api[8704]: 2017-09-28 12:47:26.756 8704 ERROR nova     sock.listen(backlog)
Sep 28 12:47:26 ctl02 nova-api[8704]: 2017-09-28 12:47:26.756 8704 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:47:26 ctl02 nova-api[8704]: 2017-09-28 12:47:26.756 8704 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:47:26 ctl02 nova-api[8704]: 2017-09-28 12:47:26.756 8704 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:47:26 ctl02 nova-api[8704]: 2017-09-28 12:47:26.756 8704 ERROR nova
Sep 28 12:47:26 ctl02 heat-api-cfn[13300]: 2017-09-28 12:47:26.816 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:47:26] "OPTIONS / HTTP/1.0" 200 134 0.000556
Sep 28 12:47:26 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:47:26 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:47:26 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:47:27 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:47:27 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:47:27 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:47:27 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:47:27 ctl02 heat-api[13008]: 2017-09-28 12:47:27.772 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:47:27] "OPTIONS / HTTP/1.0" 200 134 0.000710
Sep 28 12:47:27 ctl02 heat-api[13008]: 2017-09-28 12:47:27.778 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:47:27] "OPTIONS / HTTP/1.0" 200 134 0.000461
Sep 28 12:47:27 ctl02 heat-api-cfn[13300]: 2017-09-28 12:47:27.915 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:47:27] "OPTIONS / HTTP/1.0" 200 134 0.000585
Sep 28 12:47:28 ctl02 nova-api[8722]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:47:28 ctl02 nova-api[8722]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:47:29 ctl02 nova-api[8722]: 2017-09-28 12:47:29.079 8722 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:47:29 ctl02 nova-api[8722]: 2017-09-28 12:47:29.081 8722 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:47:29 ctl02 nova-api[8722]: 2017-09-28 12:47:29.081 8722 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:47:29 ctl02 nova-api[8722]: 2017-09-28 12:47:29.081 8722 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:47:29 ctl02 nova-api[8722]: 2017-09-28 12:47:29.081 8722 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:47:29 ctl02 nova-api[8722]: 2017-09-28 12:47:29.081 8722 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:47:29 ctl02 nova-api[8722]: 2017-09-28 12:47:29.081 8722 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:47:29 ctl02 nova-api[8722]: 2017-09-28 12:47:29.081 8722 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:47:29 ctl02 nova-api[8722]: 2017-09-28 12:47:29.081 8722 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:47:29 ctl02 nova-api[8722]: 2017-09-28 12:47:29.081 8722 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:47:29 ctl02 nova-api[8722]: 2017-09-28 12:47:29.081 8722 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:47:29 ctl02 nova-api[8722]: 2017-09-28 12:47:29.081 8722 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:47:29 ctl02 nova-api[8722]: 2017-09-28 12:47:29.081 8722 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:47:29 ctl02 nova-api[8722]: 2017-09-28 12:47:29.081 8722 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:47:29 ctl02 nova-api[8722]: 2017-09-28 12:47:29.081 8722 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:47:29 ctl02 nova-api[8722]: 2017-09-28 12:47:29.081 8722 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:47:29 ctl02 nova-api[8722]: 2017-09-28 12:47:29.081 8722 ERROR nova.wsgi     self.filename))
Sep 28 12:47:29 ctl02 nova-api[8722]: 2017-09-28 12:47:29.081 8722 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:47:29 ctl02 nova-api[8722]: 2017-09-28 12:47:29.081 8722 ERROR nova.wsgi
Sep 28 12:47:29 ctl02 nova-api[8722]: 2017-09-28 12:47:29.088 8722 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:47:29 ctl02 nova-api[8722]: 2017-09-28 12:47:29.236 8722 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:47:29 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5e49b065)
Sep 28 12:47:29 ctl02 nova-api[8722]: 2017-09-28 12:47:29.464 8722 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:47:29 ctl02 nova-api[8722]: 2017-09-28 12:47:29.466 8722 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:47:29 ctl02 nova-api[8722]: 2017-09-28 12:47:29.466 8722 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:47:29 ctl02 nova-api[8722]: 2017-09-28 12:47:29.467 8722 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:47:29 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:47:29.507 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:47:29] "OPTIONS / HTTP/1.0" 200 134 0.000370
Sep 28 12:47:29 ctl02 nova-api[8722]: 2017-09-28 12:47:29.600 8722 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:47:29 ctl02 nova-api[8722]: 2017-09-28 12:47:29.602 8722 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:47:29 ctl02 nova-api[8722]: 2017-09-28 12:47:29.602 8722 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:47:29 ctl02 nova-api[8722]: 2017-09-28 12:47:29.602 8722 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:47:29 ctl02 nova-api[8722]: 2017-09-28 12:47:29.605 8722 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:47:29 ctl02 nova-api[8722]: 2017-09-28 12:47:29.606 8722 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:47:29 ctl02 nova-api[8722]: 2017-09-28 12:47:29.606 8722 ERROR nova Traceback (most recent call last):
Sep 28 12:47:29 ctl02 nova-api[8722]: 2017-09-28 12:47:29.606 8722 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:47:29 ctl02 nova-api[8722]: 2017-09-28 12:47:29.606 8722 ERROR nova     sys.exit(main())
Sep 28 12:47:29 ctl02 nova-api[8722]: 2017-09-28 12:47:29.606 8722 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:47:29 ctl02 nova-api[8722]: 2017-09-28 12:47:29.606 8722 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:47:29 ctl02 nova-api[8722]: 2017-09-28 12:47:29.606 8722 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:47:29 ctl02 nova-api[8722]: 2017-09-28 12:47:29.606 8722 ERROR nova     max_url_len=max_url_len)
Sep 28 12:47:29 ctl02 nova-api[8722]: 2017-09-28 12:47:29.606 8722 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:47:29 ctl02 nova-api[8722]: 2017-09-28 12:47:29.606 8722 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:47:29 ctl02 nova-api[8722]: 2017-09-28 12:47:29.606 8722 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:47:29 ctl02 nova-api[8722]: 2017-09-28 12:47:29.606 8722 ERROR nova     sock.listen(backlog)
Sep 28 12:47:29 ctl02 nova-api[8722]: 2017-09-28 12:47:29.606 8722 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:47:29 ctl02 nova-api[8722]: 2017-09-28 12:47:29.606 8722 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:47:29 ctl02 nova-api[8722]: 2017-09-28 12:47:29.606 8722 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:47:29 ctl02 nova-api[8722]: 2017-09-28 12:47:29.606 8722 ERROR nova
Sep 28 12:47:29 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:47:29 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:47:29 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:47:29 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:47:29 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:47:29 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:47:29 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:47:30 ctl02 glance-api[29183]: 2017-09-28 12:47:30.286 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:47:30] "OPTIONS / HTTP/1.0" 200 134 0.000637
Sep 28 12:47:30 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5e49b065)
Sep 28 12:47:30 ctl02 neutron-server[30536]: 2017-09-28 12:47:30.466 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:47:30] "OPTIONS / HTTP/1.0" 200 262 0.000545
Sep 28 12:47:30 ctl02 glance-api[29183]: 2017-09-28 12:47:30.717 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:47:30] "OPTIONS / HTTP/1.0" 200 134 0.000649
Sep 28 12:47:30 ctl02 neutron-server[30536]: 2017-09-28 12:47:30.966 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:47:30] "OPTIONS / HTTP/1.0" 200 262 0.000595
Sep 28 12:47:30 ctl02 neutron-server[30536]: 2017-09-28 12:47:30.981 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:47:30] "OPTIONS / HTTP/1.0" 200 262 0.000451
Sep 28 12:47:31 ctl02 glance-api[29183]: 2017-09-28 12:47:31.306 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:47:31] "OPTIONS / HTTP/1.0" 200 134 0.000659
Sep 28 12:47:31 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5e49b065)
Sep 28 12:47:31 ctl02 nova-api[8739]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:47:31 ctl02 nova-api[8739]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:47:31 ctl02 heat-api-cfn[13300]: 2017-09-28 12:47:31.722 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:47:31] "OPTIONS / HTTP/1.0" 200 134 0.000519
Sep 28 12:47:31 ctl02 nova-api[8739]: 2017-09-28 12:47:31.781 8739 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:47:31 ctl02 nova-api[8739]: 2017-09-28 12:47:31.782 8739 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:47:31 ctl02 nova-api[8739]: 2017-09-28 12:47:31.782 8739 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:47:31 ctl02 nova-api[8739]: 2017-09-28 12:47:31.782 8739 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:47:31 ctl02 nova-api[8739]: 2017-09-28 12:47:31.782 8739 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:47:31 ctl02 nova-api[8739]: 2017-09-28 12:47:31.782 8739 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:47:31 ctl02 nova-api[8739]: 2017-09-28 12:47:31.782 8739 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:47:31 ctl02 nova-api[8739]: 2017-09-28 12:47:31.782 8739 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:47:31 ctl02 nova-api[8739]: 2017-09-28 12:47:31.782 8739 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:47:31 ctl02 nova-api[8739]: 2017-09-28 12:47:31.782 8739 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:47:31 ctl02 nova-api[8739]: 2017-09-28 12:47:31.782 8739 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:47:31 ctl02 nova-api[8739]: 2017-09-28 12:47:31.782 8739 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:47:31 ctl02 nova-api[8739]: 2017-09-28 12:47:31.782 8739 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:47:31 ctl02 nova-api[8739]: 2017-09-28 12:47:31.782 8739 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:47:31 ctl02 nova-api[8739]: 2017-09-28 12:47:31.782 8739 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:47:31 ctl02 nova-api[8739]: 2017-09-28 12:47:31.782 8739 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:47:31 ctl02 nova-api[8739]: 2017-09-28 12:47:31.782 8739 ERROR nova.wsgi     self.filename))
Sep 28 12:47:31 ctl02 nova-api[8739]: 2017-09-28 12:47:31.782 8739 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:47:31 ctl02 nova-api[8739]: 2017-09-28 12:47:31.782 8739 ERROR nova.wsgi
Sep 28 12:47:31 ctl02 nova-api[8739]: 2017-09-28 12:47:31.783 8739 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:47:31 ctl02 nova-api[8739]: 2017-09-28 12:47:31.916 8739 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:47:32 ctl02 nova-api[8739]: 2017-09-28 12:47:32.167 8739 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:47:32 ctl02 nova-api[8739]: 2017-09-28 12:47:32.170 8739 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:47:32 ctl02 nova-api[8739]: 2017-09-28 12:47:32.170 8739 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:47:32 ctl02 nova-api[8739]: 2017-09-28 12:47:32.170 8739 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:47:32 ctl02 nova-api[8739]: 2017-09-28 12:47:32.303 8739 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:47:32 ctl02 nova-api[8739]: 2017-09-28 12:47:32.306 8739 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:47:32 ctl02 nova-api[8739]: 2017-09-28 12:47:32.306 8739 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:47:32 ctl02 nova-api[8739]: 2017-09-28 12:47:32.306 8739 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:47:32 ctl02 nova-api[8739]: 2017-09-28 12:47:32.309 8739 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:47:32 ctl02 nova-api[8739]: 2017-09-28 12:47:32.310 8739 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:47:32 ctl02 nova-api[8739]: 2017-09-28 12:47:32.310 8739 ERROR nova Traceback (most recent call last):
Sep 28 12:47:32 ctl02 nova-api[8739]: 2017-09-28 12:47:32.310 8739 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:47:32 ctl02 nova-api[8739]: 2017-09-28 12:47:32.310 8739 ERROR nova     sys.exit(main())
Sep 28 12:47:32 ctl02 nova-api[8739]: 2017-09-28 12:47:32.310 8739 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:47:32 ctl02 nova-api[8739]: 2017-09-28 12:47:32.310 8739 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:47:32 ctl02 nova-api[8739]: 2017-09-28 12:47:32.310 8739 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:47:32 ctl02 nova-api[8739]: 2017-09-28 12:47:32.310 8739 ERROR nova     max_url_len=max_url_len)
Sep 28 12:47:32 ctl02 nova-api[8739]: 2017-09-28 12:47:32.310 8739 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:47:32 ctl02 nova-api[8739]: 2017-09-28 12:47:32.310 8739 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:47:32 ctl02 nova-api[8739]: 2017-09-28 12:47:32.310 8739 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:47:32 ctl02 nova-api[8739]: 2017-09-28 12:47:32.310 8739 ERROR nova     sock.listen(backlog)
Sep 28 12:47:32 ctl02 nova-api[8739]: 2017-09-28 12:47:32.310 8739 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:47:32 ctl02 nova-api[8739]: 2017-09-28 12:47:32.310 8739 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:47:32 ctl02 nova-api[8739]: 2017-09-28 12:47:32.310 8739 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:47:32 ctl02 nova-api[8739]: 2017-09-28 12:47:32.310 8739 ERROR nova
Sep 28 12:47:32 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5e49b065)
Sep 28 12:47:32 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:47:32 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:47:32 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:47:32 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:47:32 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:47:32 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:47:32 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:47:33 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5e49b065)
Sep 28 12:47:34 ctl02 nova-api[8758]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:47:34 ctl02 nova-api[8758]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:47:34 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5e49b065)
Sep 28 12:47:34 ctl02 nova-api[8758]: 2017-09-28 12:47:34.521 8758 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:47:34 ctl02 nova-api[8758]: 2017-09-28 12:47:34.523 8758 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:47:34 ctl02 nova-api[8758]: 2017-09-28 12:47:34.523 8758 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:47:34 ctl02 nova-api[8758]: 2017-09-28 12:47:34.523 8758 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:47:34 ctl02 nova-api[8758]: 2017-09-28 12:47:34.523 8758 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:47:34 ctl02 nova-api[8758]: 2017-09-28 12:47:34.523 8758 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:47:34 ctl02 nova-api[8758]: 2017-09-28 12:47:34.523 8758 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:47:34 ctl02 nova-api[8758]: 2017-09-28 12:47:34.523 8758 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:47:34 ctl02 nova-api[8758]: 2017-09-28 12:47:34.523 8758 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:47:34 ctl02 nova-api[8758]: 2017-09-28 12:47:34.523 8758 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:47:34 ctl02 nova-api[8758]: 2017-09-28 12:47:34.523 8758 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:47:34 ctl02 nova-api[8758]: 2017-09-28 12:47:34.523 8758 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:47:34 ctl02 nova-api[8758]: 2017-09-28 12:47:34.523 8758 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:47:34 ctl02 nova-api[8758]: 2017-09-28 12:47:34.523 8758 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:47:34 ctl02 nova-api[8758]: 2017-09-28 12:47:34.523 8758 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:47:34 ctl02 nova-api[8758]: 2017-09-28 12:47:34.523 8758 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:47:34 ctl02 nova-api[8758]: 2017-09-28 12:47:34.523 8758 ERROR nova.wsgi     self.filename))
Sep 28 12:47:34 ctl02 nova-api[8758]: 2017-09-28 12:47:34.523 8758 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:47:34 ctl02 nova-api[8758]: 2017-09-28 12:47:34.523 8758 ERROR nova.wsgi
Sep 28 12:47:34 ctl02 nova-api[8758]: 2017-09-28 12:47:34.525 8758 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:47:34 ctl02 nova-api[8758]: 2017-09-28 12:47:34.659 8758 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:47:34 ctl02 nova-api[8758]: 2017-09-28 12:47:34.908 8758 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:47:34 ctl02 nova-api[8758]: 2017-09-28 12:47:34.911 8758 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:47:34 ctl02 nova-api[8758]: 2017-09-28 12:47:34.912 8758 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:47:34 ctl02 nova-api[8758]: 2017-09-28 12:47:34.912 8758 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:47:34 ctl02 nova-cert[4860]: 2017-09-28 12:47:34.951 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:47:34 ctl02 heat-api[13008]: 2017-09-28 12:47:34.983 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:47:34] "OPTIONS / HTTP/1.0" 200 134 0.000607
Sep 28 12:47:35 ctl02 nova-conductor[5056]: 2017-09-28 12:47:35.013 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:47:35 ctl02 nova-conductor[5056]: 2017-09-28 12:47:35.041 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:47:35 ctl02 nova-api[8758]: 2017-09-28 12:47:35.049 8758 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:47:35 ctl02 nova-api[8758]: 2017-09-28 12:47:35.051 8758 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:47:35 ctl02 nova-api[8758]: 2017-09-28 12:47:35.051 8758 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:47:35 ctl02 nova-api[8758]: 2017-09-28 12:47:35.052 8758 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:47:35 ctl02 nova-api[8758]: 2017-09-28 12:47:35.055 8758 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:47:35 ctl02 nova-api[8758]: 2017-09-28 12:47:35.055 8758 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:47:35 ctl02 nova-api[8758]: 2017-09-28 12:47:35.055 8758 ERROR nova Traceback (most recent call last):
Sep 28 12:47:35 ctl02 nova-api[8758]: 2017-09-28 12:47:35.055 8758 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:47:35 ctl02 nova-api[8758]: 2017-09-28 12:47:35.055 8758 ERROR nova     sys.exit(main())
Sep 28 12:47:35 ctl02 nova-api[8758]: 2017-09-28 12:47:35.055 8758 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:47:35 ctl02 nova-api[8758]: 2017-09-28 12:47:35.055 8758 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:47:35 ctl02 nova-api[8758]: 2017-09-28 12:47:35.055 8758 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:47:35 ctl02 nova-api[8758]: 2017-09-28 12:47:35.055 8758 ERROR nova     max_url_len=max_url_len)
Sep 28 12:47:35 ctl02 nova-api[8758]: 2017-09-28 12:47:35.055 8758 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:47:35 ctl02 nova-api[8758]: 2017-09-28 12:47:35.055 8758 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:47:35 ctl02 nova-api[8758]: 2017-09-28 12:47:35.055 8758 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:47:35 ctl02 nova-api[8758]: 2017-09-28 12:47:35.055 8758 ERROR nova     sock.listen(backlog)
Sep 28 12:47:35 ctl02 nova-api[8758]: 2017-09-28 12:47:35.055 8758 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:47:35 ctl02 nova-api[8758]: 2017-09-28 12:47:35.055 8758 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:47:35 ctl02 nova-api[8758]: 2017-09-28 12:47:35.055 8758 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:47:35 ctl02 nova-api[8758]: 2017-09-28 12:47:35.055 8758 ERROR nova
Sep 28 12:47:35 ctl02 nova-conductor[5056]: 2017-09-28 12:47:35.064 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:47:35 ctl02 nova-conductor[5056]: 2017-09-28 12:47:35.064 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:47:35 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:47:35 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:47:35 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:47:35 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:47:35 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:47:35 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:47:35 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:47:35 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5e49b065)
Sep 28 12:47:35 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:47:35.671 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:47:35] "OPTIONS / HTTP/1.0" 200 134 0.000389
Sep 28 12:47:35 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:47:35.729 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:47:35] "OPTIONS / HTTP/1.0" 200 134 0.000387
Sep 28 12:47:36 ctl02 neutron-server[30536]: 2017-09-28 12:47:36.231 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 2 dead agents out of 6:
Sep 28 12:47:36 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:47:36 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:46:56 cmp002
Sep 28 12:47:36 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:46:16 cmp002
Sep 28 12:47:36 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5e49b065)
Sep 28 12:47:36 ctl02 heat-api-cfn[13300]: 2017-09-28 12:47:36.615 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:47:36] "OPTIONS / HTTP/1.0" 200 134 0.000426
Sep 28 12:47:37 ctl02 nova-api[8776]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:47:37 ctl02 nova-api[8776]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:47:37 ctl02 nova-api[8776]: 2017-09-28 12:47:37.258 8776 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:47:37 ctl02 nova-api[8776]: 2017-09-28 12:47:37.260 8776 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:47:37 ctl02 nova-api[8776]: 2017-09-28 12:47:37.260 8776 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:47:37 ctl02 nova-api[8776]: 2017-09-28 12:47:37.260 8776 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:47:37 ctl02 nova-api[8776]: 2017-09-28 12:47:37.260 8776 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:47:37 ctl02 nova-api[8776]: 2017-09-28 12:47:37.260 8776 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:47:37 ctl02 nova-api[8776]: 2017-09-28 12:47:37.260 8776 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:47:37 ctl02 nova-api[8776]: 2017-09-28 12:47:37.260 8776 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:47:37 ctl02 nova-api[8776]: 2017-09-28 12:47:37.260 8776 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:47:37 ctl02 nova-api[8776]: 2017-09-28 12:47:37.260 8776 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:47:37 ctl02 nova-api[8776]: 2017-09-28 12:47:37.260 8776 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:47:37 ctl02 nova-api[8776]: 2017-09-28 12:47:37.260 8776 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:47:37 ctl02 nova-api[8776]: 2017-09-28 12:47:37.260 8776 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:47:37 ctl02 nova-api[8776]: 2017-09-28 12:47:37.260 8776 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:47:37 ctl02 nova-api[8776]: 2017-09-28 12:47:37.260 8776 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:47:37 ctl02 nova-api[8776]: 2017-09-28 12:47:37.260 8776 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:47:37 ctl02 nova-api[8776]: 2017-09-28 12:47:37.260 8776 ERROR nova.wsgi     self.filename))
Sep 28 12:47:37 ctl02 nova-api[8776]: 2017-09-28 12:47:37.260 8776 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:47:37 ctl02 nova-api[8776]: 2017-09-28 12:47:37.260 8776 ERROR nova.wsgi
Sep 28 12:47:37 ctl02 nova-api[8776]: 2017-09-28 12:47:37.262 8776 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:47:37 ctl02 nova-api[8776]: 2017-09-28 12:47:37.388 8776 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:47:37 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5e49b065)
Sep 28 12:47:37 ctl02 heat-api[13008]: 2017-09-28 12:47:37.581 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:47:37] "OPTIONS / HTTP/1.0" 200 134 0.000624
Sep 28 12:47:37 ctl02 nova-api[8776]: 2017-09-28 12:47:37.616 8776 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:47:37 ctl02 nova-api[8776]: 2017-09-28 12:47:37.619 8776 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:47:37 ctl02 nova-api[8776]: 2017-09-28 12:47:37.619 8776 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:47:37 ctl02 nova-api[8776]: 2017-09-28 12:47:37.619 8776 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:47:37 ctl02 heat-api[13008]: 2017-09-28 12:47:37.712 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:47:37] "OPTIONS / HTTP/1.0" 200 134 0.000565
Sep 28 12:47:37 ctl02 nova-api[8776]: 2017-09-28 12:47:37.756 8776 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:47:37 ctl02 nova-api[8776]: 2017-09-28 12:47:37.758 8776 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:47:37 ctl02 nova-api[8776]: 2017-09-28 12:47:37.758 8776 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:47:37 ctl02 nova-api[8776]: 2017-09-28 12:47:37.759 8776 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:47:37 ctl02 nova-api[8776]: 2017-09-28 12:47:37.762 8776 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:47:37 ctl02 nova-api[8776]: 2017-09-28 12:47:37.762 8776 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:47:37 ctl02 nova-api[8776]: 2017-09-28 12:47:37.762 8776 ERROR nova Traceback (most recent call last):
Sep 28 12:47:37 ctl02 nova-api[8776]: 2017-09-28 12:47:37.762 8776 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:47:37 ctl02 nova-api[8776]: 2017-09-28 12:47:37.762 8776 ERROR nova     sys.exit(main())
Sep 28 12:47:37 ctl02 nova-api[8776]: 2017-09-28 12:47:37.762 8776 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:47:37 ctl02 nova-api[8776]: 2017-09-28 12:47:37.762 8776 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:47:37 ctl02 nova-api[8776]: 2017-09-28 12:47:37.762 8776 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:47:37 ctl02 nova-api[8776]: 2017-09-28 12:47:37.762 8776 ERROR nova     max_url_len=max_url_len)
Sep 28 12:47:37 ctl02 nova-api[8776]: 2017-09-28 12:47:37.762 8776 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:47:37 ctl02 nova-api[8776]: 2017-09-28 12:47:37.762 8776 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:47:37 ctl02 nova-api[8776]: 2017-09-28 12:47:37.762 8776 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:47:37 ctl02 nova-api[8776]: 2017-09-28 12:47:37.762 8776 ERROR nova     sock.listen(backlog)
Sep 28 12:47:37 ctl02 nova-api[8776]: 2017-09-28 12:47:37.762 8776 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:47:37 ctl02 nova-api[8776]: 2017-09-28 12:47:37.762 8776 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:47:37 ctl02 nova-api[8776]: 2017-09-28 12:47:37.762 8776 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:47:37 ctl02 nova-api[8776]: 2017-09-28 12:47:37.762 8776 ERROR nova
Sep 28 12:47:37 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:47:37 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:47:37 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:47:38 ctl02 heat-api-cfn[13300]: 2017-09-28 12:47:38.106 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:47:38] "OPTIONS / HTTP/1.0" 200 134 0.000576
Sep 28 12:47:38 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:47:38 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:47:38 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:47:38 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:47:38 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5e49b065)
Sep 28 12:47:39 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5e49b065)
Sep 28 12:47:39 ctl02 nova-api[8794]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:47:39 ctl02 nova-api[8794]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:47:39 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:47:39.835 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:47:39] "OPTIONS / HTTP/1.0" 200 134 0.000486
Sep 28 12:47:39 ctl02 nova-api[8794]: 2017-09-28 12:47:39.989 8794 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:47:39 ctl02 nova-api[8794]: 2017-09-28 12:47:39.991 8794 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:47:39 ctl02 nova-api[8794]: 2017-09-28 12:47:39.991 8794 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:47:39 ctl02 nova-api[8794]: 2017-09-28 12:47:39.991 8794 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:47:39 ctl02 nova-api[8794]: 2017-09-28 12:47:39.991 8794 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:47:39 ctl02 nova-api[8794]: 2017-09-28 12:47:39.991 8794 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:47:39 ctl02 nova-api[8794]: 2017-09-28 12:47:39.991 8794 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:47:39 ctl02 nova-api[8794]: 2017-09-28 12:47:39.991 8794 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:47:39 ctl02 nova-api[8794]: 2017-09-28 12:47:39.991 8794 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:47:39 ctl02 nova-api[8794]: 2017-09-28 12:47:39.991 8794 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:47:39 ctl02 nova-api[8794]: 2017-09-28 12:47:39.991 8794 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:47:39 ctl02 nova-api[8794]: 2017-09-28 12:47:39.991 8794 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:47:39 ctl02 nova-api[8794]: 2017-09-28 12:47:39.991 8794 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:47:39 ctl02 nova-api[8794]: 2017-09-28 12:47:39.991 8794 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:47:39 ctl02 nova-api[8794]: 2017-09-28 12:47:39.991 8794 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:47:39 ctl02 nova-api[8794]: 2017-09-28 12:47:39.991 8794 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:47:39 ctl02 nova-api[8794]: 2017-09-28 12:47:39.991 8794 ERROR nova.wsgi     self.filename))
Sep 28 12:47:39 ctl02 nova-api[8794]: 2017-09-28 12:47:39.991 8794 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:47:39 ctl02 nova-api[8794]: 2017-09-28 12:47:39.991 8794 ERROR nova.wsgi
Sep 28 12:47:39 ctl02 nova-api[8794]: 2017-09-28 12:47:39.991 8794 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:47:40 ctl02 nova-api[8794]: 2017-09-28 12:47:40.118 8794 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:47:40 ctl02 nova-api[8794]: 2017-09-28 12:47:40.341 8794 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:47:40 ctl02 nova-api[8794]: 2017-09-28 12:47:40.343 8794 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:47:40 ctl02 nova-api[8794]: 2017-09-28 12:47:40.343 8794 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:47:40 ctl02 nova-api[8794]: 2017-09-28 12:47:40.344 8794 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:47:40 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:47:40 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:47:40 ctl02 nova-api[8794]: 2017-09-28 12:47:40.475 8794 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:47:40 ctl02 nova-api[8794]: 2017-09-28 12:47:40.476 8794 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:47:40 ctl02 nova-api[8794]: 2017-09-28 12:47:40.477 8794 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:47:40 ctl02 nova-api[8794]: 2017-09-28 12:47:40.477 8794 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:47:40 ctl02 nova-api[8794]: 2017-09-28 12:47:40.480 8794 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:47:40 ctl02 nova-api[8794]: 2017-09-28 12:47:40.480 8794 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:47:40 ctl02 nova-api[8794]: 2017-09-28 12:47:40.480 8794 ERROR nova Traceback (most recent call last):
Sep 28 12:47:40 ctl02 nova-api[8794]: 2017-09-28 12:47:40.480 8794 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:47:40 ctl02 nova-api[8794]: 2017-09-28 12:47:40.480 8794 ERROR nova     sys.exit(main())
Sep 28 12:47:40 ctl02 nova-api[8794]: 2017-09-28 12:47:40.480 8794 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:47:40 ctl02 nova-api[8794]: 2017-09-28 12:47:40.480 8794 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:47:40 ctl02 nova-api[8794]: 2017-09-28 12:47:40.480 8794 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:47:40 ctl02 nova-api[8794]: 2017-09-28 12:47:40.480 8794 ERROR nova     max_url_len=max_url_len)
Sep 28 12:47:40 ctl02 nova-api[8794]: 2017-09-28 12:47:40.480 8794 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:47:40 ctl02 nova-api[8794]: 2017-09-28 12:47:40.480 8794 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:47:40 ctl02 nova-api[8794]: 2017-09-28 12:47:40.480 8794 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:47:40 ctl02 nova-api[8794]: 2017-09-28 12:47:40.480 8794 ERROR nova     sock.listen(backlog)
Sep 28 12:47:40 ctl02 nova-api[8794]: 2017-09-28 12:47:40.480 8794 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:47:40 ctl02 nova-api[8794]: 2017-09-28 12:47:40.480 8794 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:47:40 ctl02 nova-api[8794]: 2017-09-28 12:47:40.480 8794 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:47:40 ctl02 nova-api[8794]: 2017-09-28 12:47:40.480 8794 ERROR nova
Sep 28 12:47:40 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 12:47:40 ctl02 ntp[8851]:  * Stopping NTP server ntpd
Sep 28 12:47:40 ctl02 ntp[8851]:    ...done.
Sep 28 12:47:40 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 12:47:40 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 12:47:40 ctl02 ntp[8862]:  * Starting NTP server ntpd
Sep 28 12:47:40 ctl02 ntpd[8869]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 12:47:40 ctl02 ntpd[8869]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 12:47:40 ctl02 ntp[8862]:    ...done.
Sep 28 12:47:40 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 12:47:40 ctl02 ntpd[8872]: proto: precision = 0.043 usec (-24)
Sep 28 12:47:40 ctl02 ntpd[8872]: switching logging to file /var/log/ntp.log
Sep 28 12:47:40 ctl02 glance-api[29183]: 2017-09-28 12:47:40.596 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:47:40] "OPTIONS / HTTP/1.0" 200 134 0.000591
Sep 28 12:47:40 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:47:40 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:47:40 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:47:40 ctl02 neutron-server[30536]: 2017-09-28 12:47:40.651 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:47:40] "OPTIONS / HTTP/1.0" 200 262 0.000599
Sep 28 12:47:40 ctl02 neutron-server[30536]: 2017-09-28 12:47:40.796 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:47:40] "OPTIONS / HTTP/1.0" 200 262 0.000586
Sep 28 12:47:40 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:47:40 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:47:40 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:47:40 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:47:40 ctl02 glance-api[29183]: 2017-09-28 12:47:40.956 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:47:40] "OPTIONS / HTTP/1.0" 200 134 0.000701
Sep 28 12:47:41 ctl02 neutron-server[30536]: 2017-09-28 12:47:41.268 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:47:41] "OPTIONS / HTTP/1.0" 200 262 0.000440
Sep 28 12:47:41 ctl02 glance-api[29183]: 2017-09-28 12:47:41.637 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:47:41] "OPTIONS / HTTP/1.0" 200 134 0.000718
Sep 28 12:47:42 ctl02 heat-api-cfn[13300]: 2017-09-28 12:47:42.085 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:47:42] "OPTIONS / HTTP/1.0" 200 134 0.000443
Sep 28 12:47:42 ctl02 nova-api[8883]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:47:42 ctl02 nova-api[8883]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:47:42 ctl02 nova-api[8883]: 2017-09-28 12:47:42.752 8883 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:47:42 ctl02 nova-api[8883]: 2017-09-28 12:47:42.753 8883 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:47:42 ctl02 nova-api[8883]: 2017-09-28 12:47:42.753 8883 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:47:42 ctl02 nova-api[8883]: 2017-09-28 12:47:42.753 8883 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:47:42 ctl02 nova-api[8883]: 2017-09-28 12:47:42.753 8883 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:47:42 ctl02 nova-api[8883]: 2017-09-28 12:47:42.753 8883 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:47:42 ctl02 nova-api[8883]: 2017-09-28 12:47:42.753 8883 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:47:42 ctl02 nova-api[8883]: 2017-09-28 12:47:42.753 8883 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:47:42 ctl02 nova-api[8883]: 2017-09-28 12:47:42.753 8883 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:47:42 ctl02 nova-api[8883]: 2017-09-28 12:47:42.753 8883 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:47:42 ctl02 nova-api[8883]: 2017-09-28 12:47:42.753 8883 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:47:42 ctl02 nova-api[8883]: 2017-09-28 12:47:42.753 8883 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:47:42 ctl02 nova-api[8883]: 2017-09-28 12:47:42.753 8883 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:47:42 ctl02 nova-api[8883]: 2017-09-28 12:47:42.753 8883 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:47:42 ctl02 nova-api[8883]: 2017-09-28 12:47:42.753 8883 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:47:42 ctl02 nova-api[8883]: 2017-09-28 12:47:42.753 8883 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:47:42 ctl02 nova-api[8883]: 2017-09-28 12:47:42.753 8883 ERROR nova.wsgi     self.filename))
Sep 28 12:47:42 ctl02 nova-api[8883]: 2017-09-28 12:47:42.753 8883 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:47:42 ctl02 nova-api[8883]: 2017-09-28 12:47:42.753 8883 ERROR nova.wsgi
Sep 28 12:47:42 ctl02 nova-api[8883]: 2017-09-28 12:47:42.756 8883 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:47:42 ctl02 nova-api[8883]: 2017-09-28 12:47:42.883 8883 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:47:43 ctl02 nova-api[8883]: 2017-09-28 12:47:43.110 8883 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:47:43 ctl02 nova-api[8883]: 2017-09-28 12:47:43.113 8883 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:47:43 ctl02 nova-api[8883]: 2017-09-28 12:47:43.113 8883 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:47:43 ctl02 nova-api[8883]: 2017-09-28 12:47:43.114 8883 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:47:43 ctl02 nova-api[8883]: 2017-09-28 12:47:43.250 8883 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:47:43 ctl02 nova-api[8883]: 2017-09-28 12:47:43.253 8883 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:47:43 ctl02 nova-api[8883]: 2017-09-28 12:47:43.253 8883 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:47:43 ctl02 nova-api[8883]: 2017-09-28 12:47:43.253 8883 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:47:43 ctl02 nova-api[8883]: 2017-09-28 12:47:43.257 8883 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:47:43 ctl02 nova-api[8883]: 2017-09-28 12:47:43.257 8883 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:47:43 ctl02 nova-api[8883]: 2017-09-28 12:47:43.257 8883 ERROR nova Traceback (most recent call last):
Sep 28 12:47:43 ctl02 nova-api[8883]: 2017-09-28 12:47:43.257 8883 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:47:43 ctl02 nova-api[8883]: 2017-09-28 12:47:43.257 8883 ERROR nova     sys.exit(main())
Sep 28 12:47:43 ctl02 nova-api[8883]: 2017-09-28 12:47:43.257 8883 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:47:43 ctl02 nova-api[8883]: 2017-09-28 12:47:43.257 8883 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:47:43 ctl02 nova-api[8883]: 2017-09-28 12:47:43.257 8883 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:47:43 ctl02 nova-api[8883]: 2017-09-28 12:47:43.257 8883 ERROR nova     max_url_len=max_url_len)
Sep 28 12:47:43 ctl02 nova-api[8883]: 2017-09-28 12:47:43.257 8883 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:47:43 ctl02 nova-api[8883]: 2017-09-28 12:47:43.257 8883 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:47:43 ctl02 nova-api[8883]: 2017-09-28 12:47:43.257 8883 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:47:43 ctl02 nova-api[8883]: 2017-09-28 12:47:43.257 8883 ERROR nova     sock.listen(backlog)
Sep 28 12:47:43 ctl02 nova-api[8883]: 2017-09-28 12:47:43.257 8883 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:47:43 ctl02 nova-api[8883]: 2017-09-28 12:47:43.257 8883 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:47:43 ctl02 nova-api[8883]: 2017-09-28 12:47:43.257 8883 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:47:43 ctl02 nova-api[8883]: 2017-09-28 12:47:43.257 8883 ERROR nova
Sep 28 12:47:43 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:47:43 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:47:43 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:47:43 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:47:43 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:47:43 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:47:43 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:47:44 ctl02 nova-consoleauth[5433]: 2017-09-28 12:47:44.797 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:47:45 ctl02 heat-api[13008]: 2017-09-28 12:47:45.323 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:47:45] "OPTIONS / HTTP/1.0" 200 134 0.000627
Sep 28 12:47:45 ctl02 nova-api[8901]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:47:45 ctl02 nova-api[8901]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:47:45 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:47:45.470 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:47:45] "OPTIONS / HTTP/1.0" 200 134 0.000456
Sep 28 12:47:45 ctl02 nova-api[8901]: 2017-09-28 12:47:45.538 8901 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:47:45 ctl02 nova-api[8901]: 2017-09-28 12:47:45.539 8901 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:47:45 ctl02 nova-api[8901]: 2017-09-28 12:47:45.539 8901 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:47:45 ctl02 nova-api[8901]: 2017-09-28 12:47:45.539 8901 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:47:45 ctl02 nova-api[8901]: 2017-09-28 12:47:45.539 8901 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:47:45 ctl02 nova-api[8901]: 2017-09-28 12:47:45.539 8901 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:47:45 ctl02 nova-api[8901]: 2017-09-28 12:47:45.539 8901 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:47:45 ctl02 nova-api[8901]: 2017-09-28 12:47:45.539 8901 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:47:45 ctl02 nova-api[8901]: 2017-09-28 12:47:45.539 8901 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:47:45 ctl02 nova-api[8901]: 2017-09-28 12:47:45.539 8901 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:47:45 ctl02 nova-api[8901]: 2017-09-28 12:47:45.539 8901 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:47:45 ctl02 nova-api[8901]: 2017-09-28 12:47:45.539 8901 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:47:45 ctl02 nova-api[8901]: 2017-09-28 12:47:45.539 8901 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:47:45 ctl02 nova-api[8901]: 2017-09-28 12:47:45.539 8901 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:47:45 ctl02 nova-api[8901]: 2017-09-28 12:47:45.539 8901 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:47:45 ctl02 nova-api[8901]: 2017-09-28 12:47:45.539 8901 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:47:45 ctl02 nova-api[8901]: 2017-09-28 12:47:45.539 8901 ERROR nova.wsgi     self.filename))
Sep 28 12:47:45 ctl02 nova-api[8901]: 2017-09-28 12:47:45.539 8901 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:47:45 ctl02 nova-api[8901]: 2017-09-28 12:47:45.539 8901 ERROR nova.wsgi
Sep 28 12:47:45 ctl02 nova-api[8901]: 2017-09-28 12:47:45.540 8901 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:47:45 ctl02 nova-api[8901]: 2017-09-28 12:47:45.675 8901 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:47:45 ctl02 nova-api[8901]: 2017-09-28 12:47:45.927 8901 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:47:45 ctl02 nova-api[8901]: 2017-09-28 12:47:45.929 8901 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:47:45 ctl02 nova-api[8901]: 2017-09-28 12:47:45.930 8901 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:47:45 ctl02 nova-api[8901]: 2017-09-28 12:47:45.930 8901 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:47:46 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:47:46.010 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:47:46] "OPTIONS / HTTP/1.0" 200 134 0.000514
Sep 28 12:47:46 ctl02 nova-api[8901]: 2017-09-28 12:47:46.064 8901 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:47:46 ctl02 nova-api[8901]: 2017-09-28 12:47:46.066 8901 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:47:46 ctl02 nova-api[8901]: 2017-09-28 12:47:46.067 8901 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:47:46 ctl02 nova-api[8901]: 2017-09-28 12:47:46.067 8901 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:47:46 ctl02 nova-api[8901]: 2017-09-28 12:47:46.070 8901 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:47:46 ctl02 nova-api[8901]: 2017-09-28 12:47:46.071 8901 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:47:46 ctl02 nova-api[8901]: 2017-09-28 12:47:46.071 8901 ERROR nova Traceback (most recent call last):
Sep 28 12:47:46 ctl02 nova-api[8901]: 2017-09-28 12:47:46.071 8901 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:47:46 ctl02 nova-api[8901]: 2017-09-28 12:47:46.071 8901 ERROR nova     sys.exit(main())
Sep 28 12:47:46 ctl02 nova-api[8901]: 2017-09-28 12:47:46.071 8901 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:47:46 ctl02 nova-api[8901]: 2017-09-28 12:47:46.071 8901 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:47:46 ctl02 nova-api[8901]: 2017-09-28 12:47:46.071 8901 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:47:46 ctl02 nova-api[8901]: 2017-09-28 12:47:46.071 8901 ERROR nova     max_url_len=max_url_len)
Sep 28 12:47:46 ctl02 nova-api[8901]: 2017-09-28 12:47:46.071 8901 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:47:46 ctl02 nova-api[8901]: 2017-09-28 12:47:46.071 8901 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:47:46 ctl02 nova-api[8901]: 2017-09-28 12:47:46.071 8901 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:47:46 ctl02 nova-api[8901]: 2017-09-28 12:47:46.071 8901 ERROR nova     sock.listen(backlog)
Sep 28 12:47:46 ctl02 nova-api[8901]: 2017-09-28 12:47:46.071 8901 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:47:46 ctl02 nova-api[8901]: 2017-09-28 12:47:46.071 8901 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:47:46 ctl02 nova-api[8901]: 2017-09-28 12:47:46.071 8901 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:47:46 ctl02 nova-api[8901]: 2017-09-28 12:47:46.071 8901 ERROR nova
Sep 28 12:47:46 ctl02 heat-engine[12803]: 2017-09-28 12:47:46.168 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:47:46 ctl02 heat-engine[12803]: 2017-09-28 12:47:46.172 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:47:46 ctl02 heat-engine[12803]: 2017-09-28 12:47:46.178 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:47:46 ctl02 heat-engine[12803]: 2017-09-28 12:47:46.185 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:47:46 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:47:46 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:47:46 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:47:46 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:47:46 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:47:46 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:47:46 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:47:46 ctl02 heat-api-cfn[13300]: 2017-09-28 12:47:46.827 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:47:46] "OPTIONS / HTTP/1.0" 200 134 0.000506
Sep 28 12:47:47 ctl02 heat-api[13008]: 2017-09-28 12:47:47.811 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:47:47] "OPTIONS / HTTP/1.0" 200 134 0.000650
Sep 28 12:47:47 ctl02 nova-scheduler[5620]: 2017-09-28 12:47:47.900 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:47:47 ctl02 heat-api[13008]: 2017-09-28 12:47:47.978 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:47:47] "OPTIONS / HTTP/1.0" 200 134 0.000475
Sep 28 12:47:48 ctl02 nova-api[8919]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:47:48 ctl02 nova-api[8919]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:47:48 ctl02 nova-api[8919]: 2017-09-28 12:47:48.274 8919 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:47:48 ctl02 nova-api[8919]: 2017-09-28 12:47:48.275 8919 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:47:48 ctl02 nova-api[8919]: 2017-09-28 12:47:48.275 8919 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:47:48 ctl02 nova-api[8919]: 2017-09-28 12:47:48.275 8919 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:47:48 ctl02 nova-api[8919]: 2017-09-28 12:47:48.275 8919 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:47:48 ctl02 nova-api[8919]: 2017-09-28 12:47:48.275 8919 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:47:48 ctl02 nova-api[8919]: 2017-09-28 12:47:48.275 8919 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:47:48 ctl02 nova-api[8919]: 2017-09-28 12:47:48.275 8919 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:47:48 ctl02 nova-api[8919]: 2017-09-28 12:47:48.275 8919 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:47:48 ctl02 nova-api[8919]: 2017-09-28 12:47:48.275 8919 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:47:48 ctl02 nova-api[8919]: 2017-09-28 12:47:48.275 8919 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:47:48 ctl02 nova-api[8919]: 2017-09-28 12:47:48.275 8919 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:47:48 ctl02 nova-api[8919]: 2017-09-28 12:47:48.275 8919 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:47:48 ctl02 nova-api[8919]: 2017-09-28 12:47:48.275 8919 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:47:48 ctl02 nova-api[8919]: 2017-09-28 12:47:48.275 8919 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:47:48 ctl02 nova-api[8919]: 2017-09-28 12:47:48.275 8919 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:47:48 ctl02 nova-api[8919]: 2017-09-28 12:47:48.275 8919 ERROR nova.wsgi     self.filename))
Sep 28 12:47:48 ctl02 nova-api[8919]: 2017-09-28 12:47:48.275 8919 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:47:48 ctl02 nova-api[8919]: 2017-09-28 12:47:48.275 8919 ERROR nova.wsgi
Sep 28 12:47:48 ctl02 nova-api[8919]: 2017-09-28 12:47:48.276 8919 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:47:48 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8fcaca37)
Sep 28 12:47:48 ctl02 heat-api-cfn[13300]: 2017-09-28 12:47:48.399 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:47:48] "OPTIONS / HTTP/1.0" 200 134 0.000483
Sep 28 12:47:48 ctl02 nova-api[8919]: 2017-09-28 12:47:48.411 8919 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:47:48 ctl02 nova-api[8919]: 2017-09-28 12:47:48.662 8919 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:47:48 ctl02 nova-api[8919]: 2017-09-28 12:47:48.664 8919 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:47:48 ctl02 nova-api[8919]: 2017-09-28 12:47:48.664 8919 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:47:48 ctl02 nova-api[8919]: 2017-09-28 12:47:48.665 8919 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:47:48 ctl02 nova-api[8919]: 2017-09-28 12:47:48.798 8919 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:47:48 ctl02 nova-api[8919]: 2017-09-28 12:47:48.800 8919 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:47:48 ctl02 nova-api[8919]: 2017-09-28 12:47:48.800 8919 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:47:48 ctl02 nova-api[8919]: 2017-09-28 12:47:48.800 8919 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:47:48 ctl02 nova-api[8919]: 2017-09-28 12:47:48.804 8919 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:47:48 ctl02 nova-api[8919]: 2017-09-28 12:47:48.804 8919 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:47:48 ctl02 nova-api[8919]: 2017-09-28 12:47:48.804 8919 ERROR nova Traceback (most recent call last):
Sep 28 12:47:48 ctl02 nova-api[8919]: 2017-09-28 12:47:48.804 8919 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:47:48 ctl02 nova-api[8919]: 2017-09-28 12:47:48.804 8919 ERROR nova     sys.exit(main())
Sep 28 12:47:48 ctl02 nova-api[8919]: 2017-09-28 12:47:48.804 8919 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:47:48 ctl02 nova-api[8919]: 2017-09-28 12:47:48.804 8919 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:47:48 ctl02 nova-api[8919]: 2017-09-28 12:47:48.804 8919 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:47:48 ctl02 nova-api[8919]: 2017-09-28 12:47:48.804 8919 ERROR nova     max_url_len=max_url_len)
Sep 28 12:47:48 ctl02 nova-api[8919]: 2017-09-28 12:47:48.804 8919 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:47:48 ctl02 nova-api[8919]: 2017-09-28 12:47:48.804 8919 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:47:48 ctl02 nova-api[8919]: 2017-09-28 12:47:48.804 8919 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:47:48 ctl02 nova-api[8919]: 2017-09-28 12:47:48.804 8919 ERROR nova     sock.listen(backlog)
Sep 28 12:47:48 ctl02 nova-api[8919]: 2017-09-28 12:47:48.804 8919 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:47:48 ctl02 nova-api[8919]: 2017-09-28 12:47:48.804 8919 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:47:48 ctl02 nova-api[8919]: 2017-09-28 12:47:48.804 8919 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:47:48 ctl02 nova-api[8919]: 2017-09-28 12:47:48.804 8919 ERROR nova
Sep 28 12:47:48 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:47:48 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:47:48 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:47:49 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:47:49 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:47:49 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:47:49 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:47:49 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8fcaca37)
Sep 28 12:47:49 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:47:49.447 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:47:49] "OPTIONS / HTTP/1.0" 200 134 0.000430
Sep 28 12:47:50 ctl02 glance-api[29183]: 2017-09-28 12:47:50.314 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:47:50] "OPTIONS / HTTP/1.0" 200 134 0.000642
Sep 28 12:47:50 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8fcaca37)
Sep 28 12:47:50 ctl02 glance-api[29183]: 2017-09-28 12:47:50.723 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:47:50] "OPTIONS / HTTP/1.0" 200 134 0.000636
Sep 28 12:47:50 ctl02 neutron-server[30536]: 2017-09-28 12:47:50.827 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:47:50] "OPTIONS / HTTP/1.0" 200 262 0.000517
Sep 28 12:47:50 ctl02 nova-api[8937]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:47:50 ctl02 nova-api[8937]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:47:50 ctl02 neutron-server[30536]: 2017-09-28 12:47:50.961 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:47:50] "OPTIONS / HTTP/1.0" 200 262 0.000526
Sep 28 12:47:51 ctl02 nova-api[8937]: 2017-09-28 12:47:51.064 8937 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:47:51 ctl02 nova-api[8937]: 2017-09-28 12:47:51.066 8937 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:47:51 ctl02 nova-api[8937]: 2017-09-28 12:47:51.066 8937 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:47:51 ctl02 nova-api[8937]: 2017-09-28 12:47:51.066 8937 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:47:51 ctl02 nova-api[8937]: 2017-09-28 12:47:51.066 8937 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:47:51 ctl02 nova-api[8937]: 2017-09-28 12:47:51.066 8937 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:47:51 ctl02 nova-api[8937]: 2017-09-28 12:47:51.066 8937 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:47:51 ctl02 nova-api[8937]: 2017-09-28 12:47:51.066 8937 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:47:51 ctl02 nova-api[8937]: 2017-09-28 12:47:51.066 8937 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:47:51 ctl02 nova-api[8937]: 2017-09-28 12:47:51.066 8937 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:47:51 ctl02 nova-api[8937]: 2017-09-28 12:47:51.066 8937 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:47:51 ctl02 nova-api[8937]: 2017-09-28 12:47:51.066 8937 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:47:51 ctl02 nova-api[8937]: 2017-09-28 12:47:51.066 8937 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:47:51 ctl02 nova-api[8937]: 2017-09-28 12:47:51.066 8937 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:47:51 ctl02 nova-api[8937]: 2017-09-28 12:47:51.066 8937 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:47:51 ctl02 nova-api[8937]: 2017-09-28 12:47:51.066 8937 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:47:51 ctl02 nova-api[8937]: 2017-09-28 12:47:51.066 8937 ERROR nova.wsgi     self.filename))
Sep 28 12:47:51 ctl02 nova-api[8937]: 2017-09-28 12:47:51.066 8937 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:47:51 ctl02 nova-api[8937]: 2017-09-28 12:47:51.066 8937 ERROR nova.wsgi
Sep 28 12:47:51 ctl02 nova-api[8937]: 2017-09-28 12:47:51.067 8937 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:47:51 ctl02 nova-api[8937]: 2017-09-28 12:47:51.203 8937 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:47:51 ctl02 neutron-server[30536]: 2017-09-28 12:47:51.227 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 12:47:51 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:47:51 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:46:56 cmp002
Sep 28 12:47:51 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:47:20 cmp002
Sep 28 12:47:51 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:46:16 cmp002
Sep 28 12:47:51 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8fcaca37)
Sep 28 12:47:51 ctl02 neutron-server[30536]: 2017-09-28 12:47:51.449 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:47:51] "OPTIONS / HTTP/1.0" 200 262 0.000523
Sep 28 12:47:51 ctl02 nova-api[8937]: 2017-09-28 12:47:51.458 8937 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:47:51 ctl02 nova-api[8937]: 2017-09-28 12:47:51.461 8937 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:47:51 ctl02 nova-api[8937]: 2017-09-28 12:47:51.461 8937 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:47:51 ctl02 nova-api[8937]: 2017-09-28 12:47:51.462 8937 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:47:51 ctl02 glance-api[29183]: 2017-09-28 12:47:51.477 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:47:51] "OPTIONS / HTTP/1.0" 200 134 0.000643
Sep 28 12:47:51 ctl02 nova-api[8937]: 2017-09-28 12:47:51.600 8937 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:47:51 ctl02 nova-api[8937]: 2017-09-28 12:47:51.602 8937 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:47:51 ctl02 nova-api[8937]: 2017-09-28 12:47:51.602 8937 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:47:51 ctl02 nova-api[8937]: 2017-09-28 12:47:51.602 8937 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:47:51 ctl02 nova-api[8937]: 2017-09-28 12:47:51.606 8937 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:47:51 ctl02 nova-api[8937]: 2017-09-28 12:47:51.606 8937 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:47:51 ctl02 nova-api[8937]: 2017-09-28 12:47:51.606 8937 ERROR nova Traceback (most recent call last):
Sep 28 12:47:51 ctl02 nova-api[8937]: 2017-09-28 12:47:51.606 8937 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:47:51 ctl02 nova-api[8937]: 2017-09-28 12:47:51.606 8937 ERROR nova     sys.exit(main())
Sep 28 12:47:51 ctl02 nova-api[8937]: 2017-09-28 12:47:51.606 8937 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:47:51 ctl02 nova-api[8937]: 2017-09-28 12:47:51.606 8937 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:47:51 ctl02 nova-api[8937]: 2017-09-28 12:47:51.606 8937 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:47:51 ctl02 nova-api[8937]: 2017-09-28 12:47:51.606 8937 ERROR nova     max_url_len=max_url_len)
Sep 28 12:47:51 ctl02 nova-api[8937]: 2017-09-28 12:47:51.606 8937 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:47:51 ctl02 nova-api[8937]: 2017-09-28 12:47:51.606 8937 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:47:51 ctl02 nova-api[8937]: 2017-09-28 12:47:51.606 8937 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:47:51 ctl02 nova-api[8937]: 2017-09-28 12:47:51.606 8937 ERROR nova     sock.listen(backlog)
Sep 28 12:47:51 ctl02 nova-api[8937]: 2017-09-28 12:47:51.606 8937 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:47:51 ctl02 nova-api[8937]: 2017-09-28 12:47:51.606 8937 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:47:51 ctl02 nova-api[8937]: 2017-09-28 12:47:51.606 8937 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:47:51 ctl02 nova-api[8937]: 2017-09-28 12:47:51.606 8937 ERROR nova
Sep 28 12:47:51 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:47:51 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:47:51 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:47:52 ctl02 heat-api-cfn[13300]: 2017-09-28 12:47:52.040 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:47:52] "OPTIONS / HTTP/1.0" 200 134 0.000743
Sep 28 12:47:52 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:47:52 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:47:52 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:47:52 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:47:52 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8fcaca37)
Sep 28 12:47:53 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8fcaca37)
Sep 28 12:47:53 ctl02 nova-api[8955]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:47:53 ctl02 nova-api[8955]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:47:54 ctl02 nova-api[8955]: 2017-09-28 12:47:54.052 8955 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:47:54 ctl02 nova-api[8955]: 2017-09-28 12:47:54.054 8955 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:47:54 ctl02 nova-api[8955]: 2017-09-28 12:47:54.054 8955 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:47:54 ctl02 nova-api[8955]: 2017-09-28 12:47:54.054 8955 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:47:54 ctl02 nova-api[8955]: 2017-09-28 12:47:54.054 8955 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:47:54 ctl02 nova-api[8955]: 2017-09-28 12:47:54.054 8955 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:47:54 ctl02 nova-api[8955]: 2017-09-28 12:47:54.054 8955 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:47:54 ctl02 nova-api[8955]: 2017-09-28 12:47:54.054 8955 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:47:54 ctl02 nova-api[8955]: 2017-09-28 12:47:54.054 8955 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:47:54 ctl02 nova-api[8955]: 2017-09-28 12:47:54.054 8955 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:47:54 ctl02 nova-api[8955]: 2017-09-28 12:47:54.054 8955 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:47:54 ctl02 nova-api[8955]: 2017-09-28 12:47:54.054 8955 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:47:54 ctl02 nova-api[8955]: 2017-09-28 12:47:54.054 8955 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:47:54 ctl02 nova-api[8955]: 2017-09-28 12:47:54.054 8955 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:47:54 ctl02 nova-api[8955]: 2017-09-28 12:47:54.054 8955 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:47:54 ctl02 nova-api[8955]: 2017-09-28 12:47:54.054 8955 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:47:54 ctl02 nova-api[8955]: 2017-09-28 12:47:54.054 8955 ERROR nova.wsgi     self.filename))
Sep 28 12:47:54 ctl02 nova-api[8955]: 2017-09-28 12:47:54.054 8955 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:47:54 ctl02 nova-api[8955]: 2017-09-28 12:47:54.054 8955 ERROR nova.wsgi
Sep 28 12:47:54 ctl02 nova-api[8955]: 2017-09-28 12:47:54.055 8955 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:47:54 ctl02 nova-api[8955]: 2017-09-28 12:47:54.190 8955 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:47:54 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8fcaca37)
Sep 28 12:47:54 ctl02 nova-api[8955]: 2017-09-28 12:47:54.440 8955 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:47:54 ctl02 nova-api[8955]: 2017-09-28 12:47:54.443 8955 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:47:54 ctl02 nova-api[8955]: 2017-09-28 12:47:54.443 8955 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:47:54 ctl02 nova-api[8955]: 2017-09-28 12:47:54.443 8955 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:47:54 ctl02 nova-api[8955]: 2017-09-28 12:47:54.576 8955 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:47:54 ctl02 nova-api[8955]: 2017-09-28 12:47:54.578 8955 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:47:54 ctl02 nova-api[8955]: 2017-09-28 12:47:54.579 8955 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:47:54 ctl02 nova-api[8955]: 2017-09-28 12:47:54.579 8955 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:47:54 ctl02 nova-api[8955]: 2017-09-28 12:47:54.582 8955 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:47:54 ctl02 nova-api[8955]: 2017-09-28 12:47:54.583 8955 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:47:54 ctl02 nova-api[8955]: 2017-09-28 12:47:54.583 8955 ERROR nova Traceback (most recent call last):
Sep 28 12:47:54 ctl02 nova-api[8955]: 2017-09-28 12:47:54.583 8955 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:47:54 ctl02 nova-api[8955]: 2017-09-28 12:47:54.583 8955 ERROR nova     sys.exit(main())
Sep 28 12:47:54 ctl02 nova-api[8955]: 2017-09-28 12:47:54.583 8955 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:47:54 ctl02 nova-api[8955]: 2017-09-28 12:47:54.583 8955 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:47:54 ctl02 nova-api[8955]: 2017-09-28 12:47:54.583 8955 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:47:54 ctl02 nova-api[8955]: 2017-09-28 12:47:54.583 8955 ERROR nova     max_url_len=max_url_len)
Sep 28 12:47:54 ctl02 nova-api[8955]: 2017-09-28 12:47:54.583 8955 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:47:54 ctl02 nova-api[8955]: 2017-09-28 12:47:54.583 8955 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:47:54 ctl02 nova-api[8955]: 2017-09-28 12:47:54.583 8955 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:47:54 ctl02 nova-api[8955]: 2017-09-28 12:47:54.583 8955 ERROR nova     sock.listen(backlog)
Sep 28 12:47:54 ctl02 nova-api[8955]: 2017-09-28 12:47:54.583 8955 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:47:54 ctl02 nova-api[8955]: 2017-09-28 12:47:54.583 8955 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:47:54 ctl02 nova-api[8955]: 2017-09-28 12:47:54.583 8955 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:47:54 ctl02 nova-api[8955]: 2017-09-28 12:47:54.583 8955 ERROR nova
Sep 28 12:47:54 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:47:54 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:47:54 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:47:54 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:47:54 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:47:54 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:47:54 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:47:55 ctl02 heat-api[13008]: 2017-09-28 12:47:55.275 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:47:55] "OPTIONS / HTTP/1.0" 200 134 0.000666
Sep 28 12:47:55 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8fcaca37)
Sep 28 12:47:55 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:47:55.473 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:47:55] "OPTIONS / HTTP/1.0" 200 134 0.000435
Sep 28 12:47:55 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:47:55.985 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:47:55] "OPTIONS / HTTP/1.0" 200 134 0.000437
Sep 28 12:47:56 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8fcaca37)
Sep 28 12:47:56 ctl02 nova-api[8973]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:47:56 ctl02 nova-api[8973]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:47:56 ctl02 nova-api[8973]: 2017-09-28 12:47:56.788 8973 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:47:56 ctl02 nova-api[8973]: 2017-09-28 12:47:56.790 8973 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:47:56 ctl02 nova-api[8973]: 2017-09-28 12:47:56.790 8973 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:47:56 ctl02 nova-api[8973]: 2017-09-28 12:47:56.790 8973 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:47:56 ctl02 nova-api[8973]: 2017-09-28 12:47:56.790 8973 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:47:56 ctl02 nova-api[8973]: 2017-09-28 12:47:56.790 8973 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:47:56 ctl02 nova-api[8973]: 2017-09-28 12:47:56.790 8973 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:47:56 ctl02 nova-api[8973]: 2017-09-28 12:47:56.790 8973 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:47:56 ctl02 nova-api[8973]: 2017-09-28 12:47:56.790 8973 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:47:56 ctl02 nova-api[8973]: 2017-09-28 12:47:56.790 8973 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:47:56 ctl02 nova-api[8973]: 2017-09-28 12:47:56.790 8973 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:47:56 ctl02 nova-api[8973]: 2017-09-28 12:47:56.790 8973 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:47:56 ctl02 nova-api[8973]: 2017-09-28 12:47:56.790 8973 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:47:56 ctl02 nova-api[8973]: 2017-09-28 12:47:56.790 8973 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:47:56 ctl02 nova-api[8973]: 2017-09-28 12:47:56.790 8973 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:47:56 ctl02 nova-api[8973]: 2017-09-28 12:47:56.790 8973 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:47:56 ctl02 nova-api[8973]: 2017-09-28 12:47:56.790 8973 ERROR nova.wsgi     self.filename))
Sep 28 12:47:56 ctl02 nova-api[8973]: 2017-09-28 12:47:56.790 8973 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:47:56 ctl02 nova-api[8973]: 2017-09-28 12:47:56.790 8973 ERROR nova.wsgi
Sep 28 12:47:56 ctl02 nova-api[8973]: 2017-09-28 12:47:56.792 8973 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:47:56 ctl02 nova-api[8973]: 2017-09-28 12:47:56.926 8973 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:47:57 ctl02 heat-api-cfn[13300]: 2017-09-28 12:47:57.140 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:47:57] "OPTIONS / HTTP/1.0" 200 134 0.000577
Sep 28 12:47:57 ctl02 nova-api[8973]: 2017-09-28 12:47:57.177 8973 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:47:57 ctl02 nova-api[8973]: 2017-09-28 12:47:57.180 8973 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:47:57 ctl02 nova-api[8973]: 2017-09-28 12:47:57.180 8973 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:47:57 ctl02 nova-api[8973]: 2017-09-28 12:47:57.181 8973 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:47:57 ctl02 nova-api[8973]: 2017-09-28 12:47:57.315 8973 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:47:57 ctl02 nova-api[8973]: 2017-09-28 12:47:57.318 8973 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:47:57 ctl02 nova-api[8973]: 2017-09-28 12:47:57.318 8973 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:47:57 ctl02 nova-api[8973]: 2017-09-28 12:47:57.319 8973 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:47:57 ctl02 nova-api[8973]: 2017-09-28 12:47:57.322 8973 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:47:57 ctl02 nova-api[8973]: 2017-09-28 12:47:57.323 8973 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:47:57 ctl02 nova-api[8973]: 2017-09-28 12:47:57.323 8973 ERROR nova Traceback (most recent call last):
Sep 28 12:47:57 ctl02 nova-api[8973]: 2017-09-28 12:47:57.323 8973 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:47:57 ctl02 nova-api[8973]: 2017-09-28 12:47:57.323 8973 ERROR nova     sys.exit(main())
Sep 28 12:47:57 ctl02 nova-api[8973]: 2017-09-28 12:47:57.323 8973 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:47:57 ctl02 nova-api[8973]: 2017-09-28 12:47:57.323 8973 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:47:57 ctl02 nova-api[8973]: 2017-09-28 12:47:57.323 8973 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:47:57 ctl02 nova-api[8973]: 2017-09-28 12:47:57.323 8973 ERROR nova     max_url_len=max_url_len)
Sep 28 12:47:57 ctl02 nova-api[8973]: 2017-09-28 12:47:57.323 8973 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:47:57 ctl02 nova-api[8973]: 2017-09-28 12:47:57.323 8973 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:47:57 ctl02 nova-api[8973]: 2017-09-28 12:47:57.323 8973 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:47:57 ctl02 nova-api[8973]: 2017-09-28 12:47:57.323 8973 ERROR nova     sock.listen(backlog)
Sep 28 12:47:57 ctl02 nova-api[8973]: 2017-09-28 12:47:57.323 8973 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:47:57 ctl02 nova-api[8973]: 2017-09-28 12:47:57.323 8973 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:47:57 ctl02 nova-api[8973]: 2017-09-28 12:47:57.323 8973 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:47:57 ctl02 nova-api[8973]: 2017-09-28 12:47:57.323 8973 ERROR nova
Sep 28 12:47:57 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8fcaca37)
Sep 28 12:47:57 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:47:57 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:47:57 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:47:57 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:47:57 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:47:57 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:47:57 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:47:58 ctl02 heat-api[13008]: 2017-09-28 12:47:58.048 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:47:58] "OPTIONS / HTTP/1.0" 200 134 0.000645
Sep 28 12:47:58 ctl02 heat-api-cfn[13300]: 2017-09-28 12:47:58.091 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:47:58] "OPTIONS / HTTP/1.0" 200 134 0.000487
Sep 28 12:47:58 ctl02 heat-api[13008]: 2017-09-28 12:47:58.098 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:47:58] "OPTIONS / HTTP/1.0" 200 134 0.000484
Sep 28 12:47:58 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8fcaca37)
Sep 28 12:47:58 ctl02 neutron-server[30536]: 2017-09-28 12:47:58.506 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:47:59 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:47:59.270 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:47:59] "OPTIONS / HTTP/1.0" 200 134 0.000503
Sep 28 12:47:59 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:47:59 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:47:59 ctl02 nova-api[8989]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:47:59 ctl02 nova-api[8989]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:47:59 ctl02 nova-api[8989]: 2017-09-28 12:47:59.566 8989 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:47:59 ctl02 nova-api[8989]: 2017-09-28 12:47:59.568 8989 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:47:59 ctl02 nova-api[8989]: 2017-09-28 12:47:59.568 8989 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:47:59 ctl02 nova-api[8989]: 2017-09-28 12:47:59.568 8989 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:47:59 ctl02 nova-api[8989]: 2017-09-28 12:47:59.568 8989 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:47:59 ctl02 nova-api[8989]: 2017-09-28 12:47:59.568 8989 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:47:59 ctl02 nova-api[8989]: 2017-09-28 12:47:59.568 8989 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:47:59 ctl02 nova-api[8989]: 2017-09-28 12:47:59.568 8989 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:47:59 ctl02 nova-api[8989]: 2017-09-28 12:47:59.568 8989 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:47:59 ctl02 nova-api[8989]: 2017-09-28 12:47:59.568 8989 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:47:59 ctl02 nova-api[8989]: 2017-09-28 12:47:59.568 8989 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:47:59 ctl02 nova-api[8989]: 2017-09-28 12:47:59.568 8989 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:47:59 ctl02 nova-api[8989]: 2017-09-28 12:47:59.568 8989 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:47:59 ctl02 nova-api[8989]: 2017-09-28 12:47:59.568 8989 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:47:59 ctl02 nova-api[8989]: 2017-09-28 12:47:59.568 8989 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:47:59 ctl02 nova-api[8989]: 2017-09-28 12:47:59.568 8989 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:47:59 ctl02 nova-api[8989]: 2017-09-28 12:47:59.568 8989 ERROR nova.wsgi     self.filename))
Sep 28 12:47:59 ctl02 nova-api[8989]: 2017-09-28 12:47:59.568 8989 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:47:59 ctl02 nova-api[8989]: 2017-09-28 12:47:59.568 8989 ERROR nova.wsgi
Sep 28 12:47:59 ctl02 nova-api[8989]: 2017-09-28 12:47:59.570 8989 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:47:59 ctl02 nova-api[8989]: 2017-09-28 12:47:59.709 8989 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:47:59 ctl02 nova-api[8989]: 2017-09-28 12:47:59.957 8989 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:47:59 ctl02 nova-api[8989]: 2017-09-28 12:47:59.960 8989 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:47:59 ctl02 nova-api[8989]: 2017-09-28 12:47:59.961 8989 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:47:59 ctl02 nova-api[8989]: 2017-09-28 12:47:59.961 8989 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:48:00 ctl02 nova-api[8989]: 2017-09-28 12:48:00.099 8989 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:48:00 ctl02 nova-api[8989]: 2017-09-28 12:48:00.101 8989 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:48:00 ctl02 nova-api[8989]: 2017-09-28 12:48:00.102 8989 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:48:00 ctl02 nova-api[8989]: 2017-09-28 12:48:00.102 8989 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:48:00 ctl02 nova-api[8989]: 2017-09-28 12:48:00.105 8989 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:48:00 ctl02 nova-api[8989]: 2017-09-28 12:48:00.106 8989 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:48:00 ctl02 nova-api[8989]: 2017-09-28 12:48:00.106 8989 ERROR nova Traceback (most recent call last):
Sep 28 12:48:00 ctl02 nova-api[8989]: 2017-09-28 12:48:00.106 8989 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:48:00 ctl02 nova-api[8989]: 2017-09-28 12:48:00.106 8989 ERROR nova     sys.exit(main())
Sep 28 12:48:00 ctl02 nova-api[8989]: 2017-09-28 12:48:00.106 8989 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:48:00 ctl02 nova-api[8989]: 2017-09-28 12:48:00.106 8989 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:48:00 ctl02 nova-api[8989]: 2017-09-28 12:48:00.106 8989 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:48:00 ctl02 nova-api[8989]: 2017-09-28 12:48:00.106 8989 ERROR nova     max_url_len=max_url_len)
Sep 28 12:48:00 ctl02 nova-api[8989]: 2017-09-28 12:48:00.106 8989 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:48:00 ctl02 nova-api[8989]: 2017-09-28 12:48:00.106 8989 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:48:00 ctl02 nova-api[8989]: 2017-09-28 12:48:00.106 8989 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:48:00 ctl02 nova-api[8989]: 2017-09-28 12:48:00.106 8989 ERROR nova     sock.listen(backlog)
Sep 28 12:48:00 ctl02 nova-api[8989]: 2017-09-28 12:48:00.106 8989 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:48:00 ctl02 nova-api[8989]: 2017-09-28 12:48:00.106 8989 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:48:00 ctl02 nova-api[8989]: 2017-09-28 12:48:00.106 8989 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:48:00 ctl02 nova-api[8989]: 2017-09-28 12:48:00.106 8989 ERROR nova
Sep 28 12:48:00 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:48:00 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:48:00 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:48:00 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:48:00 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:48:00 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:48:00 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:48:00 ctl02 glance-api[29183]: 2017-09-28 12:48:00.685 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:48:00] "OPTIONS / HTTP/1.0" 200 134 0.000648
Sep 28 12:48:00 ctl02 neutron-server[30536]: 2017-09-28 12:48:00.756 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:48:00] "OPTIONS / HTTP/1.0" 200 262 0.000558
Sep 28 12:48:00 ctl02 glance-api[29183]: 2017-09-28 12:48:00.819 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:48:00] "OPTIONS / HTTP/1.0" 200 134 0.000686
Sep 28 12:48:00 ctl02 neutron-server[30536]: 2017-09-28 12:48:00.995 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:48:00] "OPTIONS / HTTP/1.0" 200 262 0.000536
Sep 28 12:48:01 ctl02 neutron-server[30536]: 2017-09-28 12:48:01.682 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:48:01] "OPTIONS / HTTP/1.0" 200 262 0.000521
Sep 28 12:48:01 ctl02 glance-api[29183]: 2017-09-28 12:48:01.742 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:48:01] "OPTIONS / HTTP/1.0" 200 134 0.000617
Sep 28 12:48:02 ctl02 nova-api[9014]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:48:02 ctl02 nova-api[9014]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:48:02 ctl02 nova-api[9014]: 2017-09-28 12:48:02.285 9014 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:48:02 ctl02 heat-api-cfn[13300]: 2017-09-28 12:48:02.285 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:48:02] "OPTIONS / HTTP/1.0" 200 134 0.000501
Sep 28 12:48:02 ctl02 nova-api[9014]: 2017-09-28 12:48:02.286 9014 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:48:02 ctl02 nova-api[9014]: 2017-09-28 12:48:02.286 9014 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:48:02 ctl02 nova-api[9014]: 2017-09-28 12:48:02.286 9014 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:48:02 ctl02 nova-api[9014]: 2017-09-28 12:48:02.286 9014 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:48:02 ctl02 nova-api[9014]: 2017-09-28 12:48:02.286 9014 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:48:02 ctl02 nova-api[9014]: 2017-09-28 12:48:02.286 9014 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:48:02 ctl02 nova-api[9014]: 2017-09-28 12:48:02.286 9014 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:48:02 ctl02 nova-api[9014]: 2017-09-28 12:48:02.286 9014 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:48:02 ctl02 nova-api[9014]: 2017-09-28 12:48:02.286 9014 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:48:02 ctl02 nova-api[9014]: 2017-09-28 12:48:02.286 9014 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:48:02 ctl02 nova-api[9014]: 2017-09-28 12:48:02.286 9014 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:48:02 ctl02 nova-api[9014]: 2017-09-28 12:48:02.286 9014 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:48:02 ctl02 nova-api[9014]: 2017-09-28 12:48:02.286 9014 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:48:02 ctl02 nova-api[9014]: 2017-09-28 12:48:02.286 9014 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:48:02 ctl02 nova-api[9014]: 2017-09-28 12:48:02.286 9014 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:48:02 ctl02 nova-api[9014]: 2017-09-28 12:48:02.286 9014 ERROR nova.wsgi     self.filename))
Sep 28 12:48:02 ctl02 nova-api[9014]: 2017-09-28 12:48:02.286 9014 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:48:02 ctl02 nova-api[9014]: 2017-09-28 12:48:02.286 9014 ERROR nova.wsgi
Sep 28 12:48:02 ctl02 nova-api[9014]: 2017-09-28 12:48:02.287 9014 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:48:02 ctl02 nova-api[9014]: 2017-09-28 12:48:02.416 9014 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:48:02 ctl02 nova-api[9014]: 2017-09-28 12:48:02.666 9014 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:48:02 ctl02 nova-api[9014]: 2017-09-28 12:48:02.668 9014 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:48:02 ctl02 nova-api[9014]: 2017-09-28 12:48:02.669 9014 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:48:02 ctl02 nova-api[9014]: 2017-09-28 12:48:02.669 9014 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:48:02 ctl02 nova-api[9014]: 2017-09-28 12:48:02.802 9014 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:48:02 ctl02 nova-api[9014]: 2017-09-28 12:48:02.804 9014 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:48:02 ctl02 nova-api[9014]: 2017-09-28 12:48:02.805 9014 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:48:02 ctl02 nova-api[9014]: 2017-09-28 12:48:02.805 9014 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:48:02 ctl02 nova-api[9014]: 2017-09-28 12:48:02.809 9014 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:48:02 ctl02 nova-api[9014]: 2017-09-28 12:48:02.809 9014 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:48:02 ctl02 nova-api[9014]: 2017-09-28 12:48:02.809 9014 ERROR nova Traceback (most recent call last):
Sep 28 12:48:02 ctl02 nova-api[9014]: 2017-09-28 12:48:02.809 9014 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:48:02 ctl02 nova-api[9014]: 2017-09-28 12:48:02.809 9014 ERROR nova     sys.exit(main())
Sep 28 12:48:02 ctl02 nova-api[9014]: 2017-09-28 12:48:02.809 9014 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:48:02 ctl02 nova-api[9014]: 2017-09-28 12:48:02.809 9014 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:48:02 ctl02 nova-api[9014]: 2017-09-28 12:48:02.809 9014 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:48:02 ctl02 nova-api[9014]: 2017-09-28 12:48:02.809 9014 ERROR nova     max_url_len=max_url_len)
Sep 28 12:48:02 ctl02 nova-api[9014]: 2017-09-28 12:48:02.809 9014 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:48:02 ctl02 nova-api[9014]: 2017-09-28 12:48:02.809 9014 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:48:02 ctl02 nova-api[9014]: 2017-09-28 12:48:02.809 9014 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:48:02 ctl02 nova-api[9014]: 2017-09-28 12:48:02.809 9014 ERROR nova     sock.listen(backlog)
Sep 28 12:48:02 ctl02 nova-api[9014]: 2017-09-28 12:48:02.809 9014 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:48:02 ctl02 nova-api[9014]: 2017-09-28 12:48:02.809 9014 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:48:02 ctl02 nova-api[9014]: 2017-09-28 12:48:02.809 9014 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:48:02 ctl02 nova-api[9014]: 2017-09-28 12:48:02.809 9014 ERROR nova
Sep 28 12:48:02 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:48:02 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:48:02 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:48:03 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:48:03 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:48:03 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:48:03 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:48:04 ctl02 nova-api[9032]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:48:04 ctl02 nova-api[9032]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:48:05 ctl02 nova-api[9032]: 2017-09-28 12:48:05.044 9032 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:48:05 ctl02 nova-api[9032]: 2017-09-28 12:48:05.046 9032 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:48:05 ctl02 nova-api[9032]: 2017-09-28 12:48:05.046 9032 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:48:05 ctl02 nova-api[9032]: 2017-09-28 12:48:05.046 9032 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:48:05 ctl02 nova-api[9032]: 2017-09-28 12:48:05.046 9032 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:48:05 ctl02 nova-api[9032]: 2017-09-28 12:48:05.046 9032 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:48:05 ctl02 nova-api[9032]: 2017-09-28 12:48:05.046 9032 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:48:05 ctl02 nova-api[9032]: 2017-09-28 12:48:05.046 9032 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:48:05 ctl02 nova-api[9032]: 2017-09-28 12:48:05.046 9032 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:48:05 ctl02 nova-api[9032]: 2017-09-28 12:48:05.046 9032 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:48:05 ctl02 nova-api[9032]: 2017-09-28 12:48:05.046 9032 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:48:05 ctl02 nova-api[9032]: 2017-09-28 12:48:05.046 9032 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:48:05 ctl02 nova-api[9032]: 2017-09-28 12:48:05.046 9032 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:48:05 ctl02 nova-api[9032]: 2017-09-28 12:48:05.046 9032 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:48:05 ctl02 nova-api[9032]: 2017-09-28 12:48:05.046 9032 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:48:05 ctl02 nova-api[9032]: 2017-09-28 12:48:05.046 9032 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:48:05 ctl02 nova-api[9032]: 2017-09-28 12:48:05.046 9032 ERROR nova.wsgi     self.filename))
Sep 28 12:48:05 ctl02 nova-api[9032]: 2017-09-28 12:48:05.046 9032 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:48:05 ctl02 nova-api[9032]: 2017-09-28 12:48:05.046 9032 ERROR nova.wsgi
Sep 28 12:48:05 ctl02 nova-api[9032]: 2017-09-28 12:48:05.048 9032 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:48:05 ctl02 nova-api[9032]: 2017-09-28 12:48:05.185 9032 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:48:05 ctl02 nova-api[9032]: 2017-09-28 12:48:05.435 9032 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:48:05 ctl02 heat-api[13008]: 2017-09-28 12:48:05.439 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:48:05] "OPTIONS / HTTP/1.0" 200 134 0.000603
Sep 28 12:48:05 ctl02 nova-api[9032]: 2017-09-28 12:48:05.440 9032 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:48:05 ctl02 nova-api[9032]: 2017-09-28 12:48:05.440 9032 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:48:05 ctl02 nova-api[9032]: 2017-09-28 12:48:05.441 9032 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:48:05 ctl02 nova-api[9032]: 2017-09-28 12:48:05.577 9032 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:48:05 ctl02 nova-api[9032]: 2017-09-28 12:48:05.579 9032 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:48:05 ctl02 nova-api[9032]: 2017-09-28 12:48:05.579 9032 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:48:05 ctl02 nova-api[9032]: 2017-09-28 12:48:05.579 9032 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:48:05 ctl02 nova-api[9032]: 2017-09-28 12:48:05.582 9032 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:48:05 ctl02 nova-api[9032]: 2017-09-28 12:48:05.583 9032 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:48:05 ctl02 nova-api[9032]: 2017-09-28 12:48:05.583 9032 ERROR nova Traceback (most recent call last):
Sep 28 12:48:05 ctl02 nova-api[9032]: 2017-09-28 12:48:05.583 9032 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:48:05 ctl02 nova-api[9032]: 2017-09-28 12:48:05.583 9032 ERROR nova     sys.exit(main())
Sep 28 12:48:05 ctl02 nova-api[9032]: 2017-09-28 12:48:05.583 9032 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:48:05 ctl02 nova-api[9032]: 2017-09-28 12:48:05.583 9032 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:48:05 ctl02 nova-api[9032]: 2017-09-28 12:48:05.583 9032 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:48:05 ctl02 nova-api[9032]: 2017-09-28 12:48:05.583 9032 ERROR nova     max_url_len=max_url_len)
Sep 28 12:48:05 ctl02 nova-api[9032]: 2017-09-28 12:48:05.583 9032 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:48:05 ctl02 nova-api[9032]: 2017-09-28 12:48:05.583 9032 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:48:05 ctl02 nova-api[9032]: 2017-09-28 12:48:05.583 9032 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:48:05 ctl02 nova-api[9032]: 2017-09-28 12:48:05.583 9032 ERROR nova     sock.listen(backlog)
Sep 28 12:48:05 ctl02 nova-api[9032]: 2017-09-28 12:48:05.583 9032 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:48:05 ctl02 nova-api[9032]: 2017-09-28 12:48:05.583 9032 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:48:05 ctl02 nova-api[9032]: 2017-09-28 12:48:05.583 9032 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:48:05 ctl02 nova-api[9032]: 2017-09-28 12:48:05.583 9032 ERROR nova
Sep 28 12:48:05 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:48:05.625 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:48:05] "OPTIONS / HTTP/1.0" 200 134 0.000475
Sep 28 12:48:05 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:48:05 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:48:05 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:48:05 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:48:05.779 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:48:05] "OPTIONS / HTTP/1.0" 200 134 0.000563
Sep 28 12:48:05 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:48:05 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:48:05 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:48:05 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:48:06 ctl02 neutron-server[30536]: 2017-09-28 12:48:06.224 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 4 dead agents out of 6:
Sep 28 12:48:06 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:48:06 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:46:56 cmp002
Sep 28 12:48:06 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:47:28 cmp001
Sep 28 12:48:06 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:47:20 cmp002
Sep 28 12:48:06 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:46:16 cmp002
Sep 28 12:48:06 ctl02 heat-api-cfn[13300]: 2017-09-28 12:48:06.756 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:48:06] "OPTIONS / HTTP/1.0" 200 134 0.000541
Sep 28 12:48:06 ctl02 nova-cert[4860]: 2017-09-28 12:48:06.989 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:48:07 ctl02 nova-conductor[5056]: 2017-09-28 12:48:07.022 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:48:07 ctl02 nova-conductor[5056]: 2017-09-28 12:48:07.050 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:48:07 ctl02 nova-conductor[5056]: 2017-09-28 12:48:07.072 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:48:07 ctl02 nova-conductor[5056]: 2017-09-28 12:48:07.072 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:48:07 ctl02 nova-api[9050]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:48:07 ctl02 nova-api[9050]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:48:07 ctl02 nova-api[9050]: 2017-09-28 12:48:07.798 9050 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:48:07 ctl02 nova-api[9050]: 2017-09-28 12:48:07.799 9050 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:48:07 ctl02 nova-api[9050]: 2017-09-28 12:48:07.799 9050 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:48:07 ctl02 nova-api[9050]: 2017-09-28 12:48:07.799 9050 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:48:07 ctl02 nova-api[9050]: 2017-09-28 12:48:07.799 9050 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:48:07 ctl02 nova-api[9050]: 2017-09-28 12:48:07.799 9050 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:48:07 ctl02 nova-api[9050]: 2017-09-28 12:48:07.799 9050 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:48:07 ctl02 nova-api[9050]: 2017-09-28 12:48:07.799 9050 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:48:07 ctl02 nova-api[9050]: 2017-09-28 12:48:07.799 9050 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:48:07 ctl02 nova-api[9050]: 2017-09-28 12:48:07.799 9050 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:48:07 ctl02 nova-api[9050]: 2017-09-28 12:48:07.799 9050 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:48:07 ctl02 nova-api[9050]: 2017-09-28 12:48:07.799 9050 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:48:07 ctl02 nova-api[9050]: 2017-09-28 12:48:07.799 9050 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:48:07 ctl02 nova-api[9050]: 2017-09-28 12:48:07.799 9050 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:48:07 ctl02 nova-api[9050]: 2017-09-28 12:48:07.799 9050 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:48:07 ctl02 nova-api[9050]: 2017-09-28 12:48:07.799 9050 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:48:07 ctl02 nova-api[9050]: 2017-09-28 12:48:07.799 9050 ERROR nova.wsgi     self.filename))
Sep 28 12:48:07 ctl02 nova-api[9050]: 2017-09-28 12:48:07.799 9050 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:48:07 ctl02 nova-api[9050]: 2017-09-28 12:48:07.799 9050 ERROR nova.wsgi
Sep 28 12:48:07 ctl02 nova-api[9050]: 2017-09-28 12:48:07.800 9050 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:48:07 ctl02 heat-api-cfn[13300]: 2017-09-28 12:48:07.859 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:48:07] "OPTIONS / HTTP/1.0" 200 134 0.000494
Sep 28 12:48:07 ctl02 nova-api[9050]: 2017-09-28 12:48:07.932 9050 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:48:08 ctl02 heat-api[13008]: 2017-09-28 12:48:08.101 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:48:08] "OPTIONS / HTTP/1.0" 200 134 0.000611
Sep 28 12:48:08 ctl02 nova-api[9050]: 2017-09-28 12:48:08.184 9050 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:48:08 ctl02 nova-api[9050]: 2017-09-28 12:48:08.186 9050 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:48:08 ctl02 nova-api[9050]: 2017-09-28 12:48:08.186 9050 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:48:08 ctl02 nova-api[9050]: 2017-09-28 12:48:08.187 9050 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:48:08 ctl02 nova-api[9050]: 2017-09-28 12:48:08.319 9050 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:48:08 ctl02 nova-api[9050]: 2017-09-28 12:48:08.321 9050 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:48:08 ctl02 nova-api[9050]: 2017-09-28 12:48:08.321 9050 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:48:08 ctl02 nova-api[9050]: 2017-09-28 12:48:08.321 9050 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:48:08 ctl02 nova-api[9050]: 2017-09-28 12:48:08.325 9050 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:48:08 ctl02 nova-api[9050]: 2017-09-28 12:48:08.325 9050 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:48:08 ctl02 nova-api[9050]: 2017-09-28 12:48:08.325 9050 ERROR nova Traceback (most recent call last):
Sep 28 12:48:08 ctl02 nova-api[9050]: 2017-09-28 12:48:08.325 9050 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:48:08 ctl02 nova-api[9050]: 2017-09-28 12:48:08.325 9050 ERROR nova     sys.exit(main())
Sep 28 12:48:08 ctl02 nova-api[9050]: 2017-09-28 12:48:08.325 9050 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:48:08 ctl02 nova-api[9050]: 2017-09-28 12:48:08.325 9050 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:48:08 ctl02 nova-api[9050]: 2017-09-28 12:48:08.325 9050 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:48:08 ctl02 nova-api[9050]: 2017-09-28 12:48:08.325 9050 ERROR nova     max_url_len=max_url_len)
Sep 28 12:48:08 ctl02 nova-api[9050]: 2017-09-28 12:48:08.325 9050 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:48:08 ctl02 nova-api[9050]: 2017-09-28 12:48:08.325 9050 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:48:08 ctl02 nova-api[9050]: 2017-09-28 12:48:08.325 9050 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:48:08 ctl02 nova-api[9050]: 2017-09-28 12:48:08.325 9050 ERROR nova     sock.listen(backlog)
Sep 28 12:48:08 ctl02 nova-api[9050]: 2017-09-28 12:48:08.325 9050 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:48:08 ctl02 nova-api[9050]: 2017-09-28 12:48:08.325 9050 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:48:08 ctl02 nova-api[9050]: 2017-09-28 12:48:08.325 9050 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:48:08 ctl02 nova-api[9050]: 2017-09-28 12:48:08.325 9050 ERROR nova
Sep 28 12:48:08 ctl02 heat-api[13008]: 2017-09-28 12:48:08.418 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:48:08] "OPTIONS / HTTP/1.0" 200 134 0.000622
Sep 28 12:48:08 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:48:08 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:48:08 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:48:08 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:48:08 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:48:08 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:48:08 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:48:09 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:48:09.042 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:48:09] "OPTIONS / HTTP/1.0" 200 134 0.000445
Sep 28 12:48:10 ctl02 nova-api[9067]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:48:10 ctl02 nova-api[9067]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:48:10 ctl02 glance-api[29183]: 2017-09-28 12:48:10.381 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:48:10] "OPTIONS / HTTP/1.0" 200 134 0.000623
Sep 28 12:48:10 ctl02 nova-api[9067]: 2017-09-28 12:48:10.497 9067 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:48:10 ctl02 nova-api[9067]: 2017-09-28 12:48:10.498 9067 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:48:10 ctl02 nova-api[9067]: 2017-09-28 12:48:10.498 9067 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:48:10 ctl02 nova-api[9067]: 2017-09-28 12:48:10.498 9067 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:48:10 ctl02 nova-api[9067]: 2017-09-28 12:48:10.498 9067 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:48:10 ctl02 nova-api[9067]: 2017-09-28 12:48:10.498 9067 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:48:10 ctl02 nova-api[9067]: 2017-09-28 12:48:10.498 9067 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:48:10 ctl02 nova-api[9067]: 2017-09-28 12:48:10.498 9067 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:48:10 ctl02 nova-api[9067]: 2017-09-28 12:48:10.498 9067 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:48:10 ctl02 nova-api[9067]: 2017-09-28 12:48:10.498 9067 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:48:10 ctl02 nova-api[9067]: 2017-09-28 12:48:10.498 9067 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:48:10 ctl02 nova-api[9067]: 2017-09-28 12:48:10.498 9067 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:48:10 ctl02 nova-api[9067]: 2017-09-28 12:48:10.498 9067 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:48:10 ctl02 nova-api[9067]: 2017-09-28 12:48:10.498 9067 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:48:10 ctl02 nova-api[9067]: 2017-09-28 12:48:10.498 9067 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:48:10 ctl02 nova-api[9067]: 2017-09-28 12:48:10.498 9067 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:48:10 ctl02 nova-api[9067]: 2017-09-28 12:48:10.498 9067 ERROR nova.wsgi     self.filename))
Sep 28 12:48:10 ctl02 nova-api[9067]: 2017-09-28 12:48:10.498 9067 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:48:10 ctl02 nova-api[9067]: 2017-09-28 12:48:10.498 9067 ERROR nova.wsgi
Sep 28 12:48:10 ctl02 nova-api[9067]: 2017-09-28 12:48:10.499 9067 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:48:10 ctl02 neutron-server[30536]: 2017-09-28 12:48:10.532 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:48:10] "OPTIONS / HTTP/1.0" 200 262 0.000549
Sep 28 12:48:10 ctl02 nova-api[9067]: 2017-09-28 12:48:10.632 9067 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:48:10 ctl02 neutron-server[30536]: 2017-09-28 12:48:10.746 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:48:10] "OPTIONS / HTTP/1.0" 200 262 0.000533
Sep 28 12:48:10 ctl02 glance-api[29183]: 2017-09-28 12:48:10.828 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:48:10] "OPTIONS / HTTP/1.0" 200 134 0.000641
Sep 28 12:48:10 ctl02 nova-api[9067]: 2017-09-28 12:48:10.883 9067 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:48:10 ctl02 nova-api[9067]: 2017-09-28 12:48:10.886 9067 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:48:10 ctl02 nova-api[9067]: 2017-09-28 12:48:10.886 9067 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:48:10 ctl02 nova-api[9067]: 2017-09-28 12:48:10.886 9067 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:48:11 ctl02 nova-api[9067]: 2017-09-28 12:48:11.017 9067 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:48:11 ctl02 nova-api[9067]: 2017-09-28 12:48:11.019 9067 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:48:11 ctl02 nova-api[9067]: 2017-09-28 12:48:11.019 9067 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:48:11 ctl02 nova-api[9067]: 2017-09-28 12:48:11.020 9067 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:48:11 ctl02 nova-api[9067]: 2017-09-28 12:48:11.023 9067 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:48:11 ctl02 nova-api[9067]: 2017-09-28 12:48:11.023 9067 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:48:11 ctl02 nova-api[9067]: 2017-09-28 12:48:11.023 9067 ERROR nova Traceback (most recent call last):
Sep 28 12:48:11 ctl02 nova-api[9067]: 2017-09-28 12:48:11.023 9067 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:48:11 ctl02 nova-api[9067]: 2017-09-28 12:48:11.023 9067 ERROR nova     sys.exit(main())
Sep 28 12:48:11 ctl02 nova-api[9067]: 2017-09-28 12:48:11.023 9067 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:48:11 ctl02 nova-api[9067]: 2017-09-28 12:48:11.023 9067 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:48:11 ctl02 nova-api[9067]: 2017-09-28 12:48:11.023 9067 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:48:11 ctl02 nova-api[9067]: 2017-09-28 12:48:11.023 9067 ERROR nova     max_url_len=max_url_len)
Sep 28 12:48:11 ctl02 nova-api[9067]: 2017-09-28 12:48:11.023 9067 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:48:11 ctl02 nova-api[9067]: 2017-09-28 12:48:11.023 9067 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:48:11 ctl02 nova-api[9067]: 2017-09-28 12:48:11.023 9067 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:48:11 ctl02 nova-api[9067]: 2017-09-28 12:48:11.023 9067 ERROR nova     sock.listen(backlog)
Sep 28 12:48:11 ctl02 nova-api[9067]: 2017-09-28 12:48:11.023 9067 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:48:11 ctl02 nova-api[9067]: 2017-09-28 12:48:11.023 9067 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:48:11 ctl02 nova-api[9067]: 2017-09-28 12:48:11.023 9067 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:48:11 ctl02 nova-api[9067]: 2017-09-28 12:48:11.023 9067 ERROR nova
Sep 28 12:48:11 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:48:11 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:48:11 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:48:11 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:48:11 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:48:11 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:48:11 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:48:11 ctl02 heat-api-cfn[13300]: 2017-09-28 12:48:11.931 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:48:11] "OPTIONS / HTTP/1.0" 200 134 0.000442
Sep 28 12:48:11 ctl02 glance-api[29183]: 2017-09-28 12:48:11.956 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:48:11] "OPTIONS / HTTP/1.0" 200 134 0.000591
Sep 28 12:48:12 ctl02 neutron-server[30536]: 2017-09-28 12:48:12.080 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:48:12] "OPTIONS / HTTP/1.0" 200 262 0.000498
Sep 28 12:48:13 ctl02 nova-api[9086]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:48:13 ctl02 nova-api[9086]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:48:13 ctl02 nova-api[9086]: 2017-09-28 12:48:13.230 9086 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:48:13 ctl02 nova-api[9086]: 2017-09-28 12:48:13.231 9086 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:48:13 ctl02 nova-api[9086]: 2017-09-28 12:48:13.231 9086 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:48:13 ctl02 nova-api[9086]: 2017-09-28 12:48:13.231 9086 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:48:13 ctl02 nova-api[9086]: 2017-09-28 12:48:13.231 9086 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:48:13 ctl02 nova-api[9086]: 2017-09-28 12:48:13.231 9086 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:48:13 ctl02 nova-api[9086]: 2017-09-28 12:48:13.231 9086 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:48:13 ctl02 nova-api[9086]: 2017-09-28 12:48:13.231 9086 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:48:13 ctl02 nova-api[9086]: 2017-09-28 12:48:13.231 9086 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:48:13 ctl02 nova-api[9086]: 2017-09-28 12:48:13.231 9086 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:48:13 ctl02 nova-api[9086]: 2017-09-28 12:48:13.231 9086 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:48:13 ctl02 nova-api[9086]: 2017-09-28 12:48:13.231 9086 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:48:13 ctl02 nova-api[9086]: 2017-09-28 12:48:13.231 9086 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:48:13 ctl02 nova-api[9086]: 2017-09-28 12:48:13.231 9086 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:48:13 ctl02 nova-api[9086]: 2017-09-28 12:48:13.231 9086 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:48:13 ctl02 nova-api[9086]: 2017-09-28 12:48:13.231 9086 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:48:13 ctl02 nova-api[9086]: 2017-09-28 12:48:13.231 9086 ERROR nova.wsgi     self.filename))
Sep 28 12:48:13 ctl02 nova-api[9086]: 2017-09-28 12:48:13.231 9086 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:48:13 ctl02 nova-api[9086]: 2017-09-28 12:48:13.231 9086 ERROR nova.wsgi
Sep 28 12:48:13 ctl02 nova-api[9086]: 2017-09-28 12:48:13.232 9086 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:48:13 ctl02 nova-api[9086]: 2017-09-28 12:48:13.358 9086 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:48:13 ctl02 neutron-server[30536]: 2017-09-28 12:48:13.517 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:48:13 ctl02 nova-api[9086]: 2017-09-28 12:48:13.578 9086 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:48:13 ctl02 nova-api[9086]: 2017-09-28 12:48:13.580 9086 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:48:13 ctl02 nova-api[9086]: 2017-09-28 12:48:13.580 9086 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:48:13 ctl02 nova-api[9086]: 2017-09-28 12:48:13.580 9086 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:48:13 ctl02 nova-api[9086]: 2017-09-28 12:48:13.709 9086 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:48:13 ctl02 nova-api[9086]: 2017-09-28 12:48:13.710 9086 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:48:13 ctl02 nova-api[9086]: 2017-09-28 12:48:13.710 9086 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:48:13 ctl02 nova-api[9086]: 2017-09-28 12:48:13.711 9086 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:48:13 ctl02 nova-api[9086]: 2017-09-28 12:48:13.714 9086 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:48:13 ctl02 nova-api[9086]: 2017-09-28 12:48:13.714 9086 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:48:13 ctl02 nova-api[9086]: 2017-09-28 12:48:13.714 9086 ERROR nova Traceback (most recent call last):
Sep 28 12:48:13 ctl02 nova-api[9086]: 2017-09-28 12:48:13.714 9086 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:48:13 ctl02 nova-api[9086]: 2017-09-28 12:48:13.714 9086 ERROR nova     sys.exit(main())
Sep 28 12:48:13 ctl02 nova-api[9086]: 2017-09-28 12:48:13.714 9086 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:48:13 ctl02 nova-api[9086]: 2017-09-28 12:48:13.714 9086 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:48:13 ctl02 nova-api[9086]: 2017-09-28 12:48:13.714 9086 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:48:13 ctl02 nova-api[9086]: 2017-09-28 12:48:13.714 9086 ERROR nova     max_url_len=max_url_len)
Sep 28 12:48:13 ctl02 nova-api[9086]: 2017-09-28 12:48:13.714 9086 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:48:13 ctl02 nova-api[9086]: 2017-09-28 12:48:13.714 9086 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:48:13 ctl02 nova-api[9086]: 2017-09-28 12:48:13.714 9086 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:48:13 ctl02 nova-api[9086]: 2017-09-28 12:48:13.714 9086 ERROR nova     sock.listen(backlog)
Sep 28 12:48:13 ctl02 nova-api[9086]: 2017-09-28 12:48:13.714 9086 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:48:13 ctl02 nova-api[9086]: 2017-09-28 12:48:13.714 9086 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:48:13 ctl02 nova-api[9086]: 2017-09-28 12:48:13.714 9086 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:48:13 ctl02 nova-api[9086]: 2017-09-28 12:48:13.714 9086 ERROR nova
Sep 28 12:48:13 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:48:13 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:48:13 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:48:13 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x72353e22)
Sep 28 12:48:14 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:48:14 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:48:14 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:48:14 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:48:14 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x72353e22)
Sep 28 12:48:15 ctl02 heat-api[13008]: 2017-09-28 12:48:15.075 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:48:15] "OPTIONS / HTTP/1.0" 200 134 0.000620
Sep 28 12:48:15 ctl02 nova-api[9104]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:48:15 ctl02 nova-api[9104]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:48:15 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x72353e22)
Sep 28 12:48:15 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:48:15.942 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:48:15] "OPTIONS / HTTP/1.0" 200 134 0.000492
Sep 28 12:48:16 ctl02 nova-api[9104]: 2017-09-28 12:48:16.028 9104 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:48:16 ctl02 nova-api[9104]: 2017-09-28 12:48:16.030 9104 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:48:16 ctl02 nova-api[9104]: 2017-09-28 12:48:16.030 9104 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:48:16 ctl02 nova-api[9104]: 2017-09-28 12:48:16.030 9104 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:48:16 ctl02 nova-api[9104]: 2017-09-28 12:48:16.030 9104 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:48:16 ctl02 nova-api[9104]: 2017-09-28 12:48:16.030 9104 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:48:16 ctl02 nova-api[9104]: 2017-09-28 12:48:16.030 9104 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:48:16 ctl02 nova-api[9104]: 2017-09-28 12:48:16.030 9104 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:48:16 ctl02 nova-api[9104]: 2017-09-28 12:48:16.030 9104 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:48:16 ctl02 nova-api[9104]: 2017-09-28 12:48:16.030 9104 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:48:16 ctl02 nova-api[9104]: 2017-09-28 12:48:16.030 9104 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:48:16 ctl02 nova-api[9104]: 2017-09-28 12:48:16.030 9104 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:48:16 ctl02 nova-api[9104]: 2017-09-28 12:48:16.030 9104 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:48:16 ctl02 nova-api[9104]: 2017-09-28 12:48:16.030 9104 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:48:16 ctl02 nova-api[9104]: 2017-09-28 12:48:16.030 9104 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:48:16 ctl02 nova-api[9104]: 2017-09-28 12:48:16.030 9104 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:48:16 ctl02 nova-api[9104]: 2017-09-28 12:48:16.030 9104 ERROR nova.wsgi     self.filename))
Sep 28 12:48:16 ctl02 nova-api[9104]: 2017-09-28 12:48:16.030 9104 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:48:16 ctl02 nova-api[9104]: 2017-09-28 12:48:16.030 9104 ERROR nova.wsgi
Sep 28 12:48:16 ctl02 nova-api[9104]: 2017-09-28 12:48:16.032 9104 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:48:16 ctl02 nova-api[9104]: 2017-09-28 12:48:16.168 9104 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:48:16 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:48:16.178 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:48:16] "OPTIONS / HTTP/1.0" 200 134 0.000487
Sep 28 12:48:16 ctl02 nova-api[9104]: 2017-09-28 12:48:16.421 9104 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:48:16 ctl02 nova-api[9104]: 2017-09-28 12:48:16.423 9104 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:48:16 ctl02 nova-api[9104]: 2017-09-28 12:48:16.423 9104 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:48:16 ctl02 nova-api[9104]: 2017-09-28 12:48:16.423 9104 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:48:16 ctl02 heat-api-cfn[13300]: 2017-09-28 12:48:16.513 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:48:16] "OPTIONS / HTTP/1.0" 200 134 0.000532
Sep 28 12:48:16 ctl02 nova-api[9104]: 2017-09-28 12:48:16.557 9104 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:48:16 ctl02 nova-api[9104]: 2017-09-28 12:48:16.559 9104 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:48:16 ctl02 nova-api[9104]: 2017-09-28 12:48:16.559 9104 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:48:16 ctl02 nova-api[9104]: 2017-09-28 12:48:16.559 9104 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:48:16 ctl02 nova-api[9104]: 2017-09-28 12:48:16.563 9104 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:48:16 ctl02 nova-api[9104]: 2017-09-28 12:48:16.563 9104 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:48:16 ctl02 nova-api[9104]: 2017-09-28 12:48:16.563 9104 ERROR nova Traceback (most recent call last):
Sep 28 12:48:16 ctl02 nova-api[9104]: 2017-09-28 12:48:16.563 9104 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:48:16 ctl02 nova-api[9104]: 2017-09-28 12:48:16.563 9104 ERROR nova     sys.exit(main())
Sep 28 12:48:16 ctl02 nova-api[9104]: 2017-09-28 12:48:16.563 9104 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:48:16 ctl02 nova-api[9104]: 2017-09-28 12:48:16.563 9104 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:48:16 ctl02 nova-api[9104]: 2017-09-28 12:48:16.563 9104 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:48:16 ctl02 nova-api[9104]: 2017-09-28 12:48:16.563 9104 ERROR nova     max_url_len=max_url_len)
Sep 28 12:48:16 ctl02 nova-api[9104]: 2017-09-28 12:48:16.563 9104 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:48:16 ctl02 nova-api[9104]: 2017-09-28 12:48:16.563 9104 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:48:16 ctl02 nova-api[9104]: 2017-09-28 12:48:16.563 9104 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:48:16 ctl02 nova-api[9104]: 2017-09-28 12:48:16.563 9104 ERROR nova     sock.listen(backlog)
Sep 28 12:48:16 ctl02 nova-api[9104]: 2017-09-28 12:48:16.563 9104 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:48:16 ctl02 nova-api[9104]: 2017-09-28 12:48:16.563 9104 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:48:16 ctl02 nova-api[9104]: 2017-09-28 12:48:16.563 9104 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:48:16 ctl02 nova-api[9104]: 2017-09-28 12:48:16.563 9104 ERROR nova
Sep 28 12:48:16 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:48:16 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:48:16 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:48:16 ctl02 nova-consoleauth[5433]: 2017-09-28 12:48:16.835 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:48:16 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:48:16 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:48:16 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:48:16 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:48:16 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x72353e22)
Sep 28 12:48:17 ctl02 heat-api-cfn[13300]: 2017-09-28 12:48:17.879 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:48:17] "OPTIONS / HTTP/1.0" 200 134 0.000494
Sep 28 12:48:17 ctl02 heat-api[13008]: 2017-09-28 12:48:17.903 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:48:17] "OPTIONS / HTTP/1.0" 200 134 0.000610
Sep 28 12:48:17 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x72353e22)
Sep 28 12:48:18 ctl02 heat-engine[12803]: 2017-09-28 12:48:18.181 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:48:18 ctl02 heat-engine[12803]: 2017-09-28 12:48:18.181 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:48:18 ctl02 heat-engine[12803]: 2017-09-28 12:48:18.187 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:48:18 ctl02 heat-engine[12803]: 2017-09-28 12:48:18.193 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:48:18 ctl02 heat-api[13008]: 2017-09-28 12:48:18.319 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:48:18] "OPTIONS / HTTP/1.0" 200 134 0.000608
Sep 28 12:48:18 ctl02 nova-api[9122]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:48:18 ctl02 nova-api[9122]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:48:18 ctl02 nova-api[9122]: 2017-09-28 12:48:18.759 9122 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:48:18 ctl02 nova-api[9122]: 2017-09-28 12:48:18.761 9122 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:48:18 ctl02 nova-api[9122]: 2017-09-28 12:48:18.761 9122 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:48:18 ctl02 nova-api[9122]: 2017-09-28 12:48:18.761 9122 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:48:18 ctl02 nova-api[9122]: 2017-09-28 12:48:18.761 9122 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:48:18 ctl02 nova-api[9122]: 2017-09-28 12:48:18.761 9122 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:48:18 ctl02 nova-api[9122]: 2017-09-28 12:48:18.761 9122 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:48:18 ctl02 nova-api[9122]: 2017-09-28 12:48:18.761 9122 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:48:18 ctl02 nova-api[9122]: 2017-09-28 12:48:18.761 9122 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:48:18 ctl02 nova-api[9122]: 2017-09-28 12:48:18.761 9122 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:48:18 ctl02 nova-api[9122]: 2017-09-28 12:48:18.761 9122 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:48:18 ctl02 nova-api[9122]: 2017-09-28 12:48:18.761 9122 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:48:18 ctl02 nova-api[9122]: 2017-09-28 12:48:18.761 9122 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:48:18 ctl02 nova-api[9122]: 2017-09-28 12:48:18.761 9122 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:48:18 ctl02 nova-api[9122]: 2017-09-28 12:48:18.761 9122 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:48:18 ctl02 nova-api[9122]: 2017-09-28 12:48:18.761 9122 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:48:18 ctl02 nova-api[9122]: 2017-09-28 12:48:18.761 9122 ERROR nova.wsgi     self.filename))
Sep 28 12:48:18 ctl02 nova-api[9122]: 2017-09-28 12:48:18.761 9122 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:48:18 ctl02 nova-api[9122]: 2017-09-28 12:48:18.761 9122 ERROR nova.wsgi
Sep 28 12:48:18 ctl02 nova-api[9122]: 2017-09-28 12:48:18.762 9122 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:48:18 ctl02 nova-api[9122]: 2017-09-28 12:48:18.893 9122 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:48:18 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x72353e22)
Sep 28 12:48:18 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:48:18.995 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:48:18] "OPTIONS / HTTP/1.0" 200 134 0.000439
Sep 28 12:48:19 ctl02 nova-api[9122]: 2017-09-28 12:48:19.142 9122 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:48:19 ctl02 nova-api[9122]: 2017-09-28 12:48:19.144 9122 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:48:19 ctl02 nova-api[9122]: 2017-09-28 12:48:19.144 9122 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:48:19 ctl02 nova-api[9122]: 2017-09-28 12:48:19.144 9122 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:48:19 ctl02 nova-api[9122]: 2017-09-28 12:48:19.278 9122 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:48:19 ctl02 nova-api[9122]: 2017-09-28 12:48:19.280 9122 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:48:19 ctl02 nova-api[9122]: 2017-09-28 12:48:19.280 9122 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:48:19 ctl02 nova-api[9122]: 2017-09-28 12:48:19.280 9122 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:48:19 ctl02 nova-api[9122]: 2017-09-28 12:48:19.284 9122 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:48:19 ctl02 nova-api[9122]: 2017-09-28 12:48:19.284 9122 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:48:19 ctl02 nova-api[9122]: 2017-09-28 12:48:19.284 9122 ERROR nova Traceback (most recent call last):
Sep 28 12:48:19 ctl02 nova-api[9122]: 2017-09-28 12:48:19.284 9122 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:48:19 ctl02 nova-api[9122]: 2017-09-28 12:48:19.284 9122 ERROR nova     sys.exit(main())
Sep 28 12:48:19 ctl02 nova-api[9122]: 2017-09-28 12:48:19.284 9122 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:48:19 ctl02 nova-api[9122]: 2017-09-28 12:48:19.284 9122 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:48:19 ctl02 nova-api[9122]: 2017-09-28 12:48:19.284 9122 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:48:19 ctl02 nova-api[9122]: 2017-09-28 12:48:19.284 9122 ERROR nova     max_url_len=max_url_len)
Sep 28 12:48:19 ctl02 nova-api[9122]: 2017-09-28 12:48:19.284 9122 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:48:19 ctl02 nova-api[9122]: 2017-09-28 12:48:19.284 9122 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:48:19 ctl02 nova-api[9122]: 2017-09-28 12:48:19.284 9122 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:48:19 ctl02 nova-api[9122]: 2017-09-28 12:48:19.284 9122 ERROR nova     sock.listen(backlog)
Sep 28 12:48:19 ctl02 nova-api[9122]: 2017-09-28 12:48:19.284 9122 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:48:19 ctl02 nova-api[9122]: 2017-09-28 12:48:19.284 9122 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:48:19 ctl02 nova-api[9122]: 2017-09-28 12:48:19.284 9122 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:48:19 ctl02 nova-api[9122]: 2017-09-28 12:48:19.284 9122 ERROR nova
Sep 28 12:48:19 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:48:19 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:48:19 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:48:19 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:48:19 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:48:19 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:48:19 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:48:19 ctl02 nova-scheduler[5620]: 2017-09-28 12:48:19.938 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:48:19 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x72353e22)
Sep 28 12:48:20 ctl02 glance-api[29183]: 2017-09-28 12:48:20.009 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:48:20] "OPTIONS / HTTP/1.0" 200 134 0.000902
Sep 28 12:48:20 ctl02 neutron-server[30536]: 2017-09-28 12:48:20.253 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:48:20] "OPTIONS / HTTP/1.0" 200 262 0.000478
Sep 28 12:48:20 ctl02 glance-api[29183]: 2017-09-28 12:48:20.779 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:48:20] "OPTIONS / HTTP/1.0" 200 134 0.000578
Sep 28 12:48:20 ctl02 neutron-server[30536]: 2017-09-28 12:48:20.932 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:48:20] "OPTIONS / HTTP/1.0" 200 262 0.000448
Sep 28 12:48:20 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x72353e22)
Sep 28 12:48:21 ctl02 neutron-server[30536]: 2017-09-28 12:48:21.223 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 12:48:21 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:48:21 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:46:56 cmp002
Sep 28 12:48:21 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:47:28 cmp001
Sep 28 12:48:21 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:47:20 cmp002
Sep 28 12:48:21 ctl02 nova-api[9140]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:48:21 ctl02 nova-api[9140]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:48:21 ctl02 nova-api[9140]: 2017-09-28 12:48:21.500 9140 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:48:21 ctl02 nova-api[9140]: 2017-09-28 12:48:21.501 9140 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:48:21 ctl02 nova-api[9140]: 2017-09-28 12:48:21.501 9140 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:48:21 ctl02 nova-api[9140]: 2017-09-28 12:48:21.501 9140 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:48:21 ctl02 nova-api[9140]: 2017-09-28 12:48:21.501 9140 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:48:21 ctl02 nova-api[9140]: 2017-09-28 12:48:21.501 9140 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:48:21 ctl02 nova-api[9140]: 2017-09-28 12:48:21.501 9140 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:48:21 ctl02 nova-api[9140]: 2017-09-28 12:48:21.501 9140 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:48:21 ctl02 nova-api[9140]: 2017-09-28 12:48:21.501 9140 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:48:21 ctl02 nova-api[9140]: 2017-09-28 12:48:21.501 9140 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:48:21 ctl02 nova-api[9140]: 2017-09-28 12:48:21.501 9140 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:48:21 ctl02 nova-api[9140]: 2017-09-28 12:48:21.501 9140 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:48:21 ctl02 nova-api[9140]: 2017-09-28 12:48:21.501 9140 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:48:21 ctl02 nova-api[9140]: 2017-09-28 12:48:21.501 9140 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:48:21 ctl02 nova-api[9140]: 2017-09-28 12:48:21.501 9140 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:48:21 ctl02 nova-api[9140]: 2017-09-28 12:48:21.501 9140 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:48:21 ctl02 nova-api[9140]: 2017-09-28 12:48:21.501 9140 ERROR nova.wsgi     self.filename))
Sep 28 12:48:21 ctl02 nova-api[9140]: 2017-09-28 12:48:21.501 9140 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:48:21 ctl02 nova-api[9140]: 2017-09-28 12:48:21.501 9140 ERROR nova.wsgi
Sep 28 12:48:21 ctl02 nova-api[9140]: 2017-09-28 12:48:21.502 9140 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:48:21 ctl02 nova-api[9140]: 2017-09-28 12:48:21.629 9140 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:48:21 ctl02 heat-api-cfn[13300]: 2017-09-28 12:48:21.765 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:48:21] "OPTIONS / HTTP/1.0" 200 134 0.000460
Sep 28 12:48:21 ctl02 nova-api[9140]: 2017-09-28 12:48:21.854 9140 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:48:21 ctl02 nova-api[9140]: 2017-09-28 12:48:21.856 9140 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:48:21 ctl02 nova-api[9140]: 2017-09-28 12:48:21.856 9140 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:48:21 ctl02 nova-api[9140]: 2017-09-28 12:48:21.856 9140 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:48:21 ctl02 glance-api[29183]: 2017-09-28 12:48:21.894 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:48:21] "OPTIONS / HTTP/1.0" 200 134 0.000541
Sep 28 12:48:21 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x72353e22)
Sep 28 12:48:21 ctl02 nova-api[9140]: 2017-09-28 12:48:21.988 9140 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:48:21 ctl02 nova-api[9140]: 2017-09-28 12:48:21.990 9140 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:48:21 ctl02 nova-api[9140]: 2017-09-28 12:48:21.990 9140 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:48:21 ctl02 nova-api[9140]: 2017-09-28 12:48:21.990 9140 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:48:21 ctl02 nova-api[9140]: 2017-09-28 12:48:21.994 9140 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:48:21 ctl02 nova-api[9140]: 2017-09-28 12:48:21.994 9140 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:48:21 ctl02 nova-api[9140]: 2017-09-28 12:48:21.994 9140 ERROR nova Traceback (most recent call last):
Sep 28 12:48:21 ctl02 nova-api[9140]: 2017-09-28 12:48:21.994 9140 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:48:21 ctl02 nova-api[9140]: 2017-09-28 12:48:21.994 9140 ERROR nova     sys.exit(main())
Sep 28 12:48:21 ctl02 nova-api[9140]: 2017-09-28 12:48:21.994 9140 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:48:21 ctl02 nova-api[9140]: 2017-09-28 12:48:21.994 9140 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:48:21 ctl02 nova-api[9140]: 2017-09-28 12:48:21.994 9140 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:48:21 ctl02 nova-api[9140]: 2017-09-28 12:48:21.994 9140 ERROR nova     max_url_len=max_url_len)
Sep 28 12:48:21 ctl02 nova-api[9140]: 2017-09-28 12:48:21.994 9140 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:48:21 ctl02 nova-api[9140]: 2017-09-28 12:48:21.994 9140 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:48:21 ctl02 nova-api[9140]: 2017-09-28 12:48:21.994 9140 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:48:21 ctl02 nova-api[9140]: 2017-09-28 12:48:21.994 9140 ERROR nova     sock.listen(backlog)
Sep 28 12:48:21 ctl02 nova-api[9140]: 2017-09-28 12:48:21.994 9140 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:48:21 ctl02 nova-api[9140]: 2017-09-28 12:48:21.994 9140 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:48:21 ctl02 nova-api[9140]: 2017-09-28 12:48:21.994 9140 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:48:21 ctl02 nova-api[9140]: 2017-09-28 12:48:21.994 9140 ERROR nova
Sep 28 12:48:22 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:48:22 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:48:22 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:48:22 ctl02 neutron-server[30536]: 2017-09-28 12:48:22.203 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:48:22] "OPTIONS / HTTP/1.0" 200 262 0.000492
Sep 28 12:48:22 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:48:22 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:48:22 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:48:22 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:48:22 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x72353e22)
Sep 28 12:48:23 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x72353e22)
Sep 28 12:48:24 ctl02 nova-api[9158]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:48:24 ctl02 nova-api[9158]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:48:24 ctl02 nova-api[9158]: 2017-09-28 12:48:24.228 9158 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:48:24 ctl02 nova-api[9158]: 2017-09-28 12:48:24.230 9158 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:48:24 ctl02 nova-api[9158]: 2017-09-28 12:48:24.230 9158 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:48:24 ctl02 nova-api[9158]: 2017-09-28 12:48:24.230 9158 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:48:24 ctl02 nova-api[9158]: 2017-09-28 12:48:24.230 9158 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:48:24 ctl02 nova-api[9158]: 2017-09-28 12:48:24.230 9158 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:48:24 ctl02 nova-api[9158]: 2017-09-28 12:48:24.230 9158 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:48:24 ctl02 nova-api[9158]: 2017-09-28 12:48:24.230 9158 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:48:24 ctl02 nova-api[9158]: 2017-09-28 12:48:24.230 9158 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:48:24 ctl02 nova-api[9158]: 2017-09-28 12:48:24.230 9158 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:48:24 ctl02 nova-api[9158]: 2017-09-28 12:48:24.230 9158 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:48:24 ctl02 nova-api[9158]: 2017-09-28 12:48:24.230 9158 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:48:24 ctl02 nova-api[9158]: 2017-09-28 12:48:24.230 9158 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:48:24 ctl02 nova-api[9158]: 2017-09-28 12:48:24.230 9158 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:48:24 ctl02 nova-api[9158]: 2017-09-28 12:48:24.230 9158 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:48:24 ctl02 nova-api[9158]: 2017-09-28 12:48:24.230 9158 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:48:24 ctl02 nova-api[9158]: 2017-09-28 12:48:24.230 9158 ERROR nova.wsgi     self.filename))
Sep 28 12:48:24 ctl02 nova-api[9158]: 2017-09-28 12:48:24.230 9158 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:48:24 ctl02 nova-api[9158]: 2017-09-28 12:48:24.230 9158 ERROR nova.wsgi
Sep 28 12:48:24 ctl02 nova-api[9158]: 2017-09-28 12:48:24.232 9158 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:48:24 ctl02 nova-api[9158]: 2017-09-28 12:48:24.358 9158 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:48:24 ctl02 nova-api[9158]: 2017-09-28 12:48:24.579 9158 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:48:24 ctl02 nova-api[9158]: 2017-09-28 12:48:24.581 9158 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:48:24 ctl02 nova-api[9158]: 2017-09-28 12:48:24.581 9158 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:48:24 ctl02 nova-api[9158]: 2017-09-28 12:48:24.582 9158 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:48:24 ctl02 nova-api[9158]: 2017-09-28 12:48:24.712 9158 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:48:24 ctl02 nova-api[9158]: 2017-09-28 12:48:24.713 9158 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:48:24 ctl02 nova-api[9158]: 2017-09-28 12:48:24.714 9158 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:48:24 ctl02 nova-api[9158]: 2017-09-28 12:48:24.714 9158 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:48:24 ctl02 nova-api[9158]: 2017-09-28 12:48:24.717 9158 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:48:24 ctl02 nova-api[9158]: 2017-09-28 12:48:24.717 9158 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:48:24 ctl02 nova-api[9158]: 2017-09-28 12:48:24.717 9158 ERROR nova Traceback (most recent call last):
Sep 28 12:48:24 ctl02 nova-api[9158]: 2017-09-28 12:48:24.717 9158 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:48:24 ctl02 nova-api[9158]: 2017-09-28 12:48:24.717 9158 ERROR nova     sys.exit(main())
Sep 28 12:48:24 ctl02 nova-api[9158]: 2017-09-28 12:48:24.717 9158 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:48:24 ctl02 nova-api[9158]: 2017-09-28 12:48:24.717 9158 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:48:24 ctl02 nova-api[9158]: 2017-09-28 12:48:24.717 9158 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:48:24 ctl02 nova-api[9158]: 2017-09-28 12:48:24.717 9158 ERROR nova     max_url_len=max_url_len)
Sep 28 12:48:24 ctl02 nova-api[9158]: 2017-09-28 12:48:24.717 9158 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:48:24 ctl02 nova-api[9158]: 2017-09-28 12:48:24.717 9158 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:48:24 ctl02 nova-api[9158]: 2017-09-28 12:48:24.717 9158 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:48:24 ctl02 nova-api[9158]: 2017-09-28 12:48:24.717 9158 ERROR nova     sock.listen(backlog)
Sep 28 12:48:24 ctl02 nova-api[9158]: 2017-09-28 12:48:24.717 9158 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:48:24 ctl02 nova-api[9158]: 2017-09-28 12:48:24.717 9158 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:48:24 ctl02 nova-api[9158]: 2017-09-28 12:48:24.717 9158 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:48:24 ctl02 nova-api[9158]: 2017-09-28 12:48:24.717 9158 ERROR nova
Sep 28 12:48:24 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:48:24 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:48:24 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:48:24 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:48:24 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:48:25 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:48:25 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:48:25 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:48:25 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:48:25 ctl02 heat-api[13008]: 2017-09-28 12:48:25.442 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:48:25] "OPTIONS / HTTP/1.0" 200 134 0.000555
Sep 28 12:48:26 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:48:26.225 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:48:26] "OPTIONS / HTTP/1.0" 200 134 0.000396
Sep 28 12:48:26 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:48:26.226 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:48:26] "OPTIONS / HTTP/1.0" 200 134 0.000241
Sep 28 12:48:26 ctl02 heat-api-cfn[13300]: 2017-09-28 12:48:26.475 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:48:26] "OPTIONS / HTTP/1.0" 200 134 0.000412
Sep 28 12:48:26 ctl02 nova-api[9181]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:48:26 ctl02 nova-api[9181]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:48:26 ctl02 nova-api[9181]: 2017-09-28 12:48:26.962 9181 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:48:26 ctl02 nova-api[9181]: 2017-09-28 12:48:26.964 9181 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:48:26 ctl02 nova-api[9181]: 2017-09-28 12:48:26.964 9181 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:48:26 ctl02 nova-api[9181]: 2017-09-28 12:48:26.964 9181 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:48:26 ctl02 nova-api[9181]: 2017-09-28 12:48:26.964 9181 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:48:26 ctl02 nova-api[9181]: 2017-09-28 12:48:26.964 9181 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:48:26 ctl02 nova-api[9181]: 2017-09-28 12:48:26.964 9181 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:48:26 ctl02 nova-api[9181]: 2017-09-28 12:48:26.964 9181 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:48:26 ctl02 nova-api[9181]: 2017-09-28 12:48:26.964 9181 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:48:26 ctl02 nova-api[9181]: 2017-09-28 12:48:26.964 9181 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:48:26 ctl02 nova-api[9181]: 2017-09-28 12:48:26.964 9181 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:48:26 ctl02 nova-api[9181]: 2017-09-28 12:48:26.964 9181 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:48:26 ctl02 nova-api[9181]: 2017-09-28 12:48:26.964 9181 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:48:26 ctl02 nova-api[9181]: 2017-09-28 12:48:26.964 9181 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:48:26 ctl02 nova-api[9181]: 2017-09-28 12:48:26.964 9181 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:48:26 ctl02 nova-api[9181]: 2017-09-28 12:48:26.964 9181 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:48:26 ctl02 nova-api[9181]: 2017-09-28 12:48:26.964 9181 ERROR nova.wsgi     self.filename))
Sep 28 12:48:26 ctl02 nova-api[9181]: 2017-09-28 12:48:26.964 9181 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:48:26 ctl02 nova-api[9181]: 2017-09-28 12:48:26.964 9181 ERROR nova.wsgi
Sep 28 12:48:26 ctl02 nova-api[9181]: 2017-09-28 12:48:26.964 9181 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:48:27 ctl02 nova-api[9181]: 2017-09-28 12:48:27.090 9181 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:48:27 ctl02 nova-api[9181]: 2017-09-28 12:48:27.312 9181 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:48:27 ctl02 nova-api[9181]: 2017-09-28 12:48:27.314 9181 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:48:27 ctl02 nova-api[9181]: 2017-09-28 12:48:27.314 9181 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:48:27 ctl02 nova-api[9181]: 2017-09-28 12:48:27.314 9181 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:48:27 ctl02 nova-api[9181]: 2017-09-28 12:48:27.444 9181 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:48:27 ctl02 nova-api[9181]: 2017-09-28 12:48:27.446 9181 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:48:27 ctl02 nova-api[9181]: 2017-09-28 12:48:27.446 9181 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:48:27 ctl02 nova-api[9181]: 2017-09-28 12:48:27.446 9181 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:48:27 ctl02 nova-api[9181]: 2017-09-28 12:48:27.450 9181 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:48:27 ctl02 nova-api[9181]: 2017-09-28 12:48:27.450 9181 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:48:27 ctl02 nova-api[9181]: 2017-09-28 12:48:27.450 9181 ERROR nova Traceback (most recent call last):
Sep 28 12:48:27 ctl02 nova-api[9181]: 2017-09-28 12:48:27.450 9181 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:48:27 ctl02 nova-api[9181]: 2017-09-28 12:48:27.450 9181 ERROR nova     sys.exit(main())
Sep 28 12:48:27 ctl02 nova-api[9181]: 2017-09-28 12:48:27.450 9181 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:48:27 ctl02 nova-api[9181]: 2017-09-28 12:48:27.450 9181 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:48:27 ctl02 nova-api[9181]: 2017-09-28 12:48:27.450 9181 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:48:27 ctl02 nova-api[9181]: 2017-09-28 12:48:27.450 9181 ERROR nova     max_url_len=max_url_len)
Sep 28 12:48:27 ctl02 nova-api[9181]: 2017-09-28 12:48:27.450 9181 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:48:27 ctl02 nova-api[9181]: 2017-09-28 12:48:27.450 9181 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:48:27 ctl02 nova-api[9181]: 2017-09-28 12:48:27.450 9181 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:48:27 ctl02 nova-api[9181]: 2017-09-28 12:48:27.450 9181 ERROR nova     sock.listen(backlog)
Sep 28 12:48:27 ctl02 nova-api[9181]: 2017-09-28 12:48:27.450 9181 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:48:27 ctl02 nova-api[9181]: 2017-09-28 12:48:27.450 9181 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:48:27 ctl02 nova-api[9181]: 2017-09-28 12:48:27.450 9181 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:48:27 ctl02 nova-api[9181]: 2017-09-28 12:48:27.450 9181 ERROR nova
Sep 28 12:48:27 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:48:27 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:48:27 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:48:27 ctl02 heat-api-cfn[13300]: 2017-09-28 12:48:27.617 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:48:27] "OPTIONS / HTTP/1.0" 200 134 0.000466
Sep 28 12:48:27 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:48:27 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:48:27 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:48:27 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:48:28 ctl02 heat-api[13008]: 2017-09-28 12:48:28.078 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:48:28] "OPTIONS / HTTP/1.0" 200 134 0.000524
Sep 28 12:48:28 ctl02 heat-api[13008]: 2017-09-28 12:48:28.174 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:48:28] "OPTIONS / HTTP/1.0" 200 134 0.000832
Sep 28 12:48:29 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:48:29.370 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:48:29] "OPTIONS / HTTP/1.0" 200 134 0.000376
Sep 28 12:48:29 ctl02 nova-api[9199]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:48:29 ctl02 nova-api[9199]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:48:29 ctl02 nova-api[9199]: 2017-09-28 12:48:29.731 9199 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:48:29 ctl02 nova-api[9199]: 2017-09-28 12:48:29.733 9199 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:48:29 ctl02 nova-api[9199]: 2017-09-28 12:48:29.733 9199 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:48:29 ctl02 nova-api[9199]: 2017-09-28 12:48:29.733 9199 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:48:29 ctl02 nova-api[9199]: 2017-09-28 12:48:29.733 9199 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:48:29 ctl02 nova-api[9199]: 2017-09-28 12:48:29.733 9199 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:48:29 ctl02 nova-api[9199]: 2017-09-28 12:48:29.733 9199 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:48:29 ctl02 nova-api[9199]: 2017-09-28 12:48:29.733 9199 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:48:29 ctl02 nova-api[9199]: 2017-09-28 12:48:29.733 9199 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:48:29 ctl02 nova-api[9199]: 2017-09-28 12:48:29.733 9199 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:48:29 ctl02 nova-api[9199]: 2017-09-28 12:48:29.733 9199 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:48:29 ctl02 nova-api[9199]: 2017-09-28 12:48:29.733 9199 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:48:29 ctl02 nova-api[9199]: 2017-09-28 12:48:29.733 9199 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:48:29 ctl02 nova-api[9199]: 2017-09-28 12:48:29.733 9199 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:48:29 ctl02 nova-api[9199]: 2017-09-28 12:48:29.733 9199 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:48:29 ctl02 nova-api[9199]: 2017-09-28 12:48:29.733 9199 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:48:29 ctl02 nova-api[9199]: 2017-09-28 12:48:29.733 9199 ERROR nova.wsgi     self.filename))
Sep 28 12:48:29 ctl02 nova-api[9199]: 2017-09-28 12:48:29.733 9199 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:48:29 ctl02 nova-api[9199]: 2017-09-28 12:48:29.733 9199 ERROR nova.wsgi
Sep 28 12:48:29 ctl02 nova-api[9199]: 2017-09-28 12:48:29.734 9199 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:48:29 ctl02 glance-api[29183]: 2017-09-28 12:48:29.847 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:48:29] "OPTIONS / HTTP/1.0" 200 134 0.000579
Sep 28 12:48:29 ctl02 nova-api[9199]: 2017-09-28 12:48:29.864 9199 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:48:30 ctl02 nova-api[9199]: 2017-09-28 12:48:30.086 9199 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:48:30 ctl02 nova-api[9199]: 2017-09-28 12:48:30.088 9199 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:48:30 ctl02 nova-api[9199]: 2017-09-28 12:48:30.088 9199 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:48:30 ctl02 nova-api[9199]: 2017-09-28 12:48:30.088 9199 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:48:30 ctl02 nova-api[9199]: 2017-09-28 12:48:30.219 9199 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:48:30 ctl02 nova-api[9199]: 2017-09-28 12:48:30.221 9199 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:48:30 ctl02 nova-api[9199]: 2017-09-28 12:48:30.221 9199 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:48:30 ctl02 nova-api[9199]: 2017-09-28 12:48:30.221 9199 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:48:30 ctl02 nova-api[9199]: 2017-09-28 12:48:30.224 9199 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:48:30 ctl02 nova-api[9199]: 2017-09-28 12:48:30.224 9199 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:48:30 ctl02 nova-api[9199]: 2017-09-28 12:48:30.224 9199 ERROR nova Traceback (most recent call last):
Sep 28 12:48:30 ctl02 nova-api[9199]: 2017-09-28 12:48:30.224 9199 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:48:30 ctl02 nova-api[9199]: 2017-09-28 12:48:30.224 9199 ERROR nova     sys.exit(main())
Sep 28 12:48:30 ctl02 nova-api[9199]: 2017-09-28 12:48:30.224 9199 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:48:30 ctl02 nova-api[9199]: 2017-09-28 12:48:30.224 9199 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:48:30 ctl02 nova-api[9199]: 2017-09-28 12:48:30.224 9199 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:48:30 ctl02 nova-api[9199]: 2017-09-28 12:48:30.224 9199 ERROR nova     max_url_len=max_url_len)
Sep 28 12:48:30 ctl02 nova-api[9199]: 2017-09-28 12:48:30.224 9199 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:48:30 ctl02 nova-api[9199]: 2017-09-28 12:48:30.224 9199 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:48:30 ctl02 nova-api[9199]: 2017-09-28 12:48:30.224 9199 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:48:30 ctl02 nova-api[9199]: 2017-09-28 12:48:30.224 9199 ERROR nova     sock.listen(backlog)
Sep 28 12:48:30 ctl02 nova-api[9199]: 2017-09-28 12:48:30.224 9199 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:48:30 ctl02 nova-api[9199]: 2017-09-28 12:48:30.224 9199 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:48:30 ctl02 nova-api[9199]: 2017-09-28 12:48:30.224 9199 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:48:30 ctl02 nova-api[9199]: 2017-09-28 12:48:30.224 9199 ERROR nova
Sep 28 12:48:30 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:48:30 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:48:30 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:48:30 ctl02 neutron-server[30536]: 2017-09-28 12:48:30.543 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:48:30] "OPTIONS / HTTP/1.0" 200 262 0.000579
Sep 28 12:48:30 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:48:30 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:48:30 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:48:30 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:48:31 ctl02 neutron-server[30536]: 2017-09-28 12:48:31.000 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:48:31] "OPTIONS / HTTP/1.0" 200 262 0.000532
Sep 28 12:48:31 ctl02 glance-api[29183]: 2017-09-28 12:48:31.143 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:48:31] "OPTIONS / HTTP/1.0" 200 134 0.000578
Sep 28 12:48:31 ctl02 glance-api[29183]: 2017-09-28 12:48:31.589 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:48:31] "OPTIONS / HTTP/1.0" 200 134 0.000591
Sep 28 12:48:31 ctl02 heat-api-cfn[13300]: 2017-09-28 12:48:31.820 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:48:31] "OPTIONS / HTTP/1.0" 200 134 0.000444
Sep 28 12:48:32 ctl02 nova-api[9217]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:48:32 ctl02 nova-api[9217]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:48:32 ctl02 neutron-server[30536]: 2017-09-28 12:48:32.367 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:48:32] "OPTIONS / HTTP/1.0" 200 262 0.000505
Sep 28 12:48:32 ctl02 nova-api[9217]: 2017-09-28 12:48:32.489 9217 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:48:32 ctl02 nova-api[9217]: 2017-09-28 12:48:32.490 9217 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:48:32 ctl02 nova-api[9217]: 2017-09-28 12:48:32.490 9217 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:48:32 ctl02 nova-api[9217]: 2017-09-28 12:48:32.490 9217 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:48:32 ctl02 nova-api[9217]: 2017-09-28 12:48:32.490 9217 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:48:32 ctl02 nova-api[9217]: 2017-09-28 12:48:32.490 9217 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:48:32 ctl02 nova-api[9217]: 2017-09-28 12:48:32.490 9217 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:48:32 ctl02 nova-api[9217]: 2017-09-28 12:48:32.490 9217 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:48:32 ctl02 nova-api[9217]: 2017-09-28 12:48:32.490 9217 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:48:32 ctl02 nova-api[9217]: 2017-09-28 12:48:32.490 9217 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:48:32 ctl02 nova-api[9217]: 2017-09-28 12:48:32.490 9217 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:48:32 ctl02 nova-api[9217]: 2017-09-28 12:48:32.490 9217 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:48:32 ctl02 nova-api[9217]: 2017-09-28 12:48:32.490 9217 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:48:32 ctl02 nova-api[9217]: 2017-09-28 12:48:32.490 9217 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:48:32 ctl02 nova-api[9217]: 2017-09-28 12:48:32.490 9217 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:48:32 ctl02 nova-api[9217]: 2017-09-28 12:48:32.490 9217 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:48:32 ctl02 nova-api[9217]: 2017-09-28 12:48:32.490 9217 ERROR nova.wsgi     self.filename))
Sep 28 12:48:32 ctl02 nova-api[9217]: 2017-09-28 12:48:32.490 9217 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:48:32 ctl02 nova-api[9217]: 2017-09-28 12:48:32.490 9217 ERROR nova.wsgi
Sep 28 12:48:32 ctl02 nova-api[9217]: 2017-09-28 12:48:32.491 9217 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:48:32 ctl02 nova-api[9217]: 2017-09-28 12:48:32.617 9217 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:48:32 ctl02 nova-api[9217]: 2017-09-28 12:48:32.840 9217 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:48:32 ctl02 nova-api[9217]: 2017-09-28 12:48:32.842 9217 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:48:32 ctl02 nova-api[9217]: 2017-09-28 12:48:32.842 9217 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:48:32 ctl02 nova-api[9217]: 2017-09-28 12:48:32.843 9217 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:48:32 ctl02 nova-api[9217]: 2017-09-28 12:48:32.972 9217 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:48:32 ctl02 nova-api[9217]: 2017-09-28 12:48:32.974 9217 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:48:32 ctl02 nova-api[9217]: 2017-09-28 12:48:32.974 9217 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:48:32 ctl02 nova-api[9217]: 2017-09-28 12:48:32.974 9217 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:48:32 ctl02 nova-api[9217]: 2017-09-28 12:48:32.978 9217 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:48:32 ctl02 nova-api[9217]: 2017-09-28 12:48:32.978 9217 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:48:32 ctl02 nova-api[9217]: 2017-09-28 12:48:32.978 9217 ERROR nova Traceback (most recent call last):
Sep 28 12:48:32 ctl02 nova-api[9217]: 2017-09-28 12:48:32.978 9217 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:48:32 ctl02 nova-api[9217]: 2017-09-28 12:48:32.978 9217 ERROR nova     sys.exit(main())
Sep 28 12:48:32 ctl02 nova-api[9217]: 2017-09-28 12:48:32.978 9217 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:48:32 ctl02 nova-api[9217]: 2017-09-28 12:48:32.978 9217 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:48:32 ctl02 nova-api[9217]: 2017-09-28 12:48:32.978 9217 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:48:32 ctl02 nova-api[9217]: 2017-09-28 12:48:32.978 9217 ERROR nova     max_url_len=max_url_len)
Sep 28 12:48:32 ctl02 nova-api[9217]: 2017-09-28 12:48:32.978 9217 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:48:32 ctl02 nova-api[9217]: 2017-09-28 12:48:32.978 9217 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:48:32 ctl02 nova-api[9217]: 2017-09-28 12:48:32.978 9217 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:48:32 ctl02 nova-api[9217]: 2017-09-28 12:48:32.978 9217 ERROR nova     sock.listen(backlog)
Sep 28 12:48:32 ctl02 nova-api[9217]: 2017-09-28 12:48:32.978 9217 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:48:32 ctl02 nova-api[9217]: 2017-09-28 12:48:32.978 9217 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:48:32 ctl02 nova-api[9217]: 2017-09-28 12:48:32.978 9217 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:48:32 ctl02 nova-api[9217]: 2017-09-28 12:48:32.978 9217 ERROR nova
Sep 28 12:48:33 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:48:33 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:48:33 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:48:33 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:48:33 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:48:33 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:48:33 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:48:35 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x37a70928)
Sep 28 12:48:35 ctl02 heat-api[13008]: 2017-09-28 12:48:35.078 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:48:35] "OPTIONS / HTTP/1.0" 200 134 0.000552
Sep 28 12:48:35 ctl02 nova-api[9235]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:48:35 ctl02 nova-api[9235]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:48:35 ctl02 nova-api[9235]: 2017-09-28 12:48:35.262 9235 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:48:35 ctl02 nova-api[9235]: 2017-09-28 12:48:35.263 9235 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:48:35 ctl02 nova-api[9235]: 2017-09-28 12:48:35.263 9235 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:48:35 ctl02 nova-api[9235]: 2017-09-28 12:48:35.263 9235 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:48:35 ctl02 nova-api[9235]: 2017-09-28 12:48:35.263 9235 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:48:35 ctl02 nova-api[9235]: 2017-09-28 12:48:35.263 9235 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:48:35 ctl02 nova-api[9235]: 2017-09-28 12:48:35.263 9235 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:48:35 ctl02 nova-api[9235]: 2017-09-28 12:48:35.263 9235 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:48:35 ctl02 nova-api[9235]: 2017-09-28 12:48:35.263 9235 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:48:35 ctl02 nova-api[9235]: 2017-09-28 12:48:35.263 9235 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:48:35 ctl02 nova-api[9235]: 2017-09-28 12:48:35.263 9235 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:48:35 ctl02 nova-api[9235]: 2017-09-28 12:48:35.263 9235 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:48:35 ctl02 nova-api[9235]: 2017-09-28 12:48:35.263 9235 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:48:35 ctl02 nova-api[9235]: 2017-09-28 12:48:35.263 9235 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:48:35 ctl02 nova-api[9235]: 2017-09-28 12:48:35.263 9235 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:48:35 ctl02 nova-api[9235]: 2017-09-28 12:48:35.263 9235 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:48:35 ctl02 nova-api[9235]: 2017-09-28 12:48:35.263 9235 ERROR nova.wsgi     self.filename))
Sep 28 12:48:35 ctl02 nova-api[9235]: 2017-09-28 12:48:35.263 9235 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:48:35 ctl02 nova-api[9235]: 2017-09-28 12:48:35.263 9235 ERROR nova.wsgi
Sep 28 12:48:35 ctl02 nova-api[9235]: 2017-09-28 12:48:35.264 9235 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:48:35 ctl02 nova-api[9235]: 2017-09-28 12:48:35.396 9235 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:48:35 ctl02 nova-api[9235]: 2017-09-28 12:48:35.626 9235 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:48:35 ctl02 nova-api[9235]: 2017-09-28 12:48:35.628 9235 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:48:35 ctl02 nova-api[9235]: 2017-09-28 12:48:35.628 9235 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:48:35 ctl02 nova-api[9235]: 2017-09-28 12:48:35.628 9235 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:48:35 ctl02 nova-api[9235]: 2017-09-28 12:48:35.760 9235 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:48:35 ctl02 nova-api[9235]: 2017-09-28 12:48:35.761 9235 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:48:35 ctl02 nova-api[9235]: 2017-09-28 12:48:35.762 9235 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:48:35 ctl02 nova-api[9235]: 2017-09-28 12:48:35.762 9235 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:48:35 ctl02 nova-api[9235]: 2017-09-28 12:48:35.765 9235 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:48:35 ctl02 nova-api[9235]: 2017-09-28 12:48:35.766 9235 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:48:35 ctl02 nova-api[9235]: 2017-09-28 12:48:35.766 9235 ERROR nova Traceback (most recent call last):
Sep 28 12:48:35 ctl02 nova-api[9235]: 2017-09-28 12:48:35.766 9235 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:48:35 ctl02 nova-api[9235]: 2017-09-28 12:48:35.766 9235 ERROR nova     sys.exit(main())
Sep 28 12:48:35 ctl02 nova-api[9235]: 2017-09-28 12:48:35.766 9235 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:48:35 ctl02 nova-api[9235]: 2017-09-28 12:48:35.766 9235 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:48:35 ctl02 nova-api[9235]: 2017-09-28 12:48:35.766 9235 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:48:35 ctl02 nova-api[9235]: 2017-09-28 12:48:35.766 9235 ERROR nova     max_url_len=max_url_len)
Sep 28 12:48:35 ctl02 nova-api[9235]: 2017-09-28 12:48:35.766 9235 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:48:35 ctl02 nova-api[9235]: 2017-09-28 12:48:35.766 9235 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:48:35 ctl02 nova-api[9235]: 2017-09-28 12:48:35.766 9235 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:48:35 ctl02 nova-api[9235]: 2017-09-28 12:48:35.766 9235 ERROR nova     sock.listen(backlog)
Sep 28 12:48:35 ctl02 nova-api[9235]: 2017-09-28 12:48:35.766 9235 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:48:35 ctl02 nova-api[9235]: 2017-09-28 12:48:35.766 9235 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:48:35 ctl02 nova-api[9235]: 2017-09-28 12:48:35.766 9235 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:48:35 ctl02 nova-api[9235]: 2017-09-28 12:48:35.766 9235 ERROR nova
Sep 28 12:48:35 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:48:35 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:48:35 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:48:36 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:48:36.022 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:48:36] "OPTIONS / HTTP/1.0" 200 134 0.000405
Sep 28 12:48:36 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x37a70928)
Sep 28 12:48:36 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:48:36.053 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:48:36] "OPTIONS / HTTP/1.0" 200 134 0.000270
Sep 28 12:48:36 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:48:36 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:48:36 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:48:36 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:48:36 ctl02 neutron-server[30536]: 2017-09-28 12:48:36.219 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 12:48:36 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:48:36 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:46:56 cmp002
Sep 28 12:48:36 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:47:28 cmp001
Sep 28 12:48:36 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:47:20 cmp002
Sep 28 12:48:36 ctl02 heat-api-cfn[13300]: 2017-09-28 12:48:36.705 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:48:36] "OPTIONS / HTTP/1.0" 200 134 0.000463
Sep 28 12:48:37 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x37a70928)
Sep 28 12:48:37 ctl02 nova-api[9254]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:48:37 ctl02 nova-api[9254]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:48:37 ctl02 heat-api-cfn[13300]: 2017-09-28 12:48:37.874 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:48:37] "OPTIONS / HTTP/1.0" 200 134 0.000443
Sep 28 12:48:37 ctl02 nova-api[9254]: 2017-09-28 12:48:37.992 9254 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:48:37 ctl02 nova-api[9254]: 2017-09-28 12:48:37.994 9254 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:48:37 ctl02 nova-api[9254]: 2017-09-28 12:48:37.994 9254 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:48:37 ctl02 nova-api[9254]: 2017-09-28 12:48:37.994 9254 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:48:37 ctl02 nova-api[9254]: 2017-09-28 12:48:37.994 9254 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:48:37 ctl02 nova-api[9254]: 2017-09-28 12:48:37.994 9254 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:48:37 ctl02 nova-api[9254]: 2017-09-28 12:48:37.994 9254 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:48:37 ctl02 nova-api[9254]: 2017-09-28 12:48:37.994 9254 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:48:37 ctl02 nova-api[9254]: 2017-09-28 12:48:37.994 9254 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:48:37 ctl02 nova-api[9254]: 2017-09-28 12:48:37.994 9254 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:48:37 ctl02 nova-api[9254]: 2017-09-28 12:48:37.994 9254 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:48:37 ctl02 nova-api[9254]: 2017-09-28 12:48:37.994 9254 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:48:37 ctl02 nova-api[9254]: 2017-09-28 12:48:37.994 9254 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:48:37 ctl02 nova-api[9254]: 2017-09-28 12:48:37.994 9254 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:48:37 ctl02 nova-api[9254]: 2017-09-28 12:48:37.994 9254 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:48:37 ctl02 nova-api[9254]: 2017-09-28 12:48:37.994 9254 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:48:37 ctl02 nova-api[9254]: 2017-09-28 12:48:37.994 9254 ERROR nova.wsgi     self.filename))
Sep 28 12:48:37 ctl02 nova-api[9254]: 2017-09-28 12:48:37.994 9254 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:48:37 ctl02 nova-api[9254]: 2017-09-28 12:48:37.994 9254 ERROR nova.wsgi
Sep 28 12:48:37 ctl02 nova-api[9254]: 2017-09-28 12:48:37.994 9254 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:48:38 ctl02 heat-api[13008]: 2017-09-28 12:48:38.012 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:48:38] "OPTIONS / HTTP/1.0" 200 134 0.000589
Sep 28 12:48:38 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x37a70928)
Sep 28 12:48:38 ctl02 nova-api[9254]: 2017-09-28 12:48:38.125 9254 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:48:38 ctl02 heat-api[13008]: 2017-09-28 12:48:38.268 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:48:38] "OPTIONS / HTTP/1.0" 200 134 0.000561
Sep 28 12:48:38 ctl02 nova-api[9254]: 2017-09-28 12:48:38.357 9254 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:48:38 ctl02 nova-api[9254]: 2017-09-28 12:48:38.359 9254 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:48:38 ctl02 nova-api[9254]: 2017-09-28 12:48:38.359 9254 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:48:38 ctl02 nova-api[9254]: 2017-09-28 12:48:38.359 9254 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:48:38 ctl02 nova-api[9254]: 2017-09-28 12:48:38.492 9254 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:48:38 ctl02 nova-api[9254]: 2017-09-28 12:48:38.494 9254 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:48:38 ctl02 nova-api[9254]: 2017-09-28 12:48:38.494 9254 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:48:38 ctl02 nova-api[9254]: 2017-09-28 12:48:38.494 9254 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:48:38 ctl02 nova-api[9254]: 2017-09-28 12:48:38.497 9254 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:48:38 ctl02 nova-api[9254]: 2017-09-28 12:48:38.498 9254 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:48:38 ctl02 nova-api[9254]: 2017-09-28 12:48:38.498 9254 ERROR nova Traceback (most recent call last):
Sep 28 12:48:38 ctl02 nova-api[9254]: 2017-09-28 12:48:38.498 9254 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:48:38 ctl02 nova-api[9254]: 2017-09-28 12:48:38.498 9254 ERROR nova     sys.exit(main())
Sep 28 12:48:38 ctl02 nova-api[9254]: 2017-09-28 12:48:38.498 9254 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:48:38 ctl02 nova-api[9254]: 2017-09-28 12:48:38.498 9254 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:48:38 ctl02 nova-api[9254]: 2017-09-28 12:48:38.498 9254 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:48:38 ctl02 nova-api[9254]: 2017-09-28 12:48:38.498 9254 ERROR nova     max_url_len=max_url_len)
Sep 28 12:48:38 ctl02 nova-api[9254]: 2017-09-28 12:48:38.498 9254 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:48:38 ctl02 nova-api[9254]: 2017-09-28 12:48:38.498 9254 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:48:38 ctl02 nova-api[9254]: 2017-09-28 12:48:38.498 9254 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:48:38 ctl02 nova-api[9254]: 2017-09-28 12:48:38.498 9254 ERROR nova     sock.listen(backlog)
Sep 28 12:48:38 ctl02 nova-api[9254]: 2017-09-28 12:48:38.498 9254 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:48:38 ctl02 nova-api[9254]: 2017-09-28 12:48:38.498 9254 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:48:38 ctl02 nova-api[9254]: 2017-09-28 12:48:38.498 9254 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:48:38 ctl02 nova-api[9254]: 2017-09-28 12:48:38.498 9254 ERROR nova
Sep 28 12:48:38 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:48:38 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:48:38 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:48:38 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:48:38 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:48:38 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:48:38 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:48:39 ctl02 nova-cert[4860]: 2017-09-28 12:48:39.028 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:48:39 ctl02 nova-conductor[5056]: 2017-09-28 12:48:39.029 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:48:39 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x37a70928)
Sep 28 12:48:39 ctl02 nova-conductor[5056]: 2017-09-28 12:48:39.059 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:48:39 ctl02 nova-conductor[5056]: 2017-09-28 12:48:39.080 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:48:39 ctl02 nova-conductor[5056]: 2017-09-28 12:48:39.081 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:48:39 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:48:39.462 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:48:39] "OPTIONS / HTTP/1.0" 200 134 0.000433
Sep 28 12:48:40 ctl02 glance-api[29183]: 2017-09-28 12:48:40.042 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:48:40] "OPTIONS / HTTP/1.0" 200 134 0.000640
Sep 28 12:48:40 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x37a70928)
Sep 28 12:48:40 ctl02 neutron-server[30536]: 2017-09-28 12:48:40.370 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:48:40] "OPTIONS / HTTP/1.0" 200 262 0.000520
Sep 28 12:48:40 ctl02 nova-api[9272]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:48:40 ctl02 nova-api[9272]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:48:40 ctl02 nova-api[9272]: 2017-09-28 12:48:40.795 9272 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:48:40 ctl02 nova-api[9272]: 2017-09-28 12:48:40.797 9272 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:48:40 ctl02 nova-api[9272]: 2017-09-28 12:48:40.797 9272 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:48:40 ctl02 nova-api[9272]: 2017-09-28 12:48:40.797 9272 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:48:40 ctl02 nova-api[9272]: 2017-09-28 12:48:40.797 9272 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:48:40 ctl02 nova-api[9272]: 2017-09-28 12:48:40.797 9272 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:48:40 ctl02 nova-api[9272]: 2017-09-28 12:48:40.797 9272 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:48:40 ctl02 nova-api[9272]: 2017-09-28 12:48:40.797 9272 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:48:40 ctl02 nova-api[9272]: 2017-09-28 12:48:40.797 9272 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:48:40 ctl02 nova-api[9272]: 2017-09-28 12:48:40.797 9272 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:48:40 ctl02 nova-api[9272]: 2017-09-28 12:48:40.797 9272 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:48:40 ctl02 nova-api[9272]: 2017-09-28 12:48:40.797 9272 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:48:40 ctl02 nova-api[9272]: 2017-09-28 12:48:40.797 9272 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:48:40 ctl02 nova-api[9272]: 2017-09-28 12:48:40.797 9272 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:48:40 ctl02 nova-api[9272]: 2017-09-28 12:48:40.797 9272 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:48:40 ctl02 nova-api[9272]: 2017-09-28 12:48:40.797 9272 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:48:40 ctl02 nova-api[9272]: 2017-09-28 12:48:40.797 9272 ERROR nova.wsgi     self.filename))
Sep 28 12:48:40 ctl02 nova-api[9272]: 2017-09-28 12:48:40.797 9272 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:48:40 ctl02 nova-api[9272]: 2017-09-28 12:48:40.797 9272 ERROR nova.wsgi
Sep 28 12:48:40 ctl02 nova-api[9272]: 2017-09-28 12:48:40.799 9272 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:48:40 ctl02 nova-api[9272]: 2017-09-28 12:48:40.929 9272 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:48:41 ctl02 glance-api[29183]: 2017-09-28 12:48:41.014 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:48:41] "OPTIONS / HTTP/1.0" 200 134 0.000834
Sep 28 12:48:41 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x37a70928)
Sep 28 12:48:41 ctl02 nova-api[9272]: 2017-09-28 12:48:41.169 9272 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:48:41 ctl02 nova-api[9272]: 2017-09-28 12:48:41.171 9272 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:48:41 ctl02 nova-api[9272]: 2017-09-28 12:48:41.171 9272 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:48:41 ctl02 nova-api[9272]: 2017-09-28 12:48:41.171 9272 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:48:41 ctl02 neutron-server[30536]: 2017-09-28 12:48:41.252 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:48:41] "OPTIONS / HTTP/1.0" 200 262 0.000506
Sep 28 12:48:41 ctl02 nova-api[9272]: 2017-09-28 12:48:41.308 9272 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:48:41 ctl02 nova-api[9272]: 2017-09-28 12:48:41.310 9272 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:48:41 ctl02 nova-api[9272]: 2017-09-28 12:48:41.310 9272 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:48:41 ctl02 nova-api[9272]: 2017-09-28 12:48:41.310 9272 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:48:41 ctl02 nova-api[9272]: 2017-09-28 12:48:41.314 9272 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:48:41 ctl02 nova-api[9272]: 2017-09-28 12:48:41.314 9272 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:48:41 ctl02 nova-api[9272]: 2017-09-28 12:48:41.314 9272 ERROR nova Traceback (most recent call last):
Sep 28 12:48:41 ctl02 nova-api[9272]: 2017-09-28 12:48:41.314 9272 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:48:41 ctl02 nova-api[9272]: 2017-09-28 12:48:41.314 9272 ERROR nova     sys.exit(main())
Sep 28 12:48:41 ctl02 nova-api[9272]: 2017-09-28 12:48:41.314 9272 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:48:41 ctl02 nova-api[9272]: 2017-09-28 12:48:41.314 9272 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:48:41 ctl02 nova-api[9272]: 2017-09-28 12:48:41.314 9272 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:48:41 ctl02 nova-api[9272]: 2017-09-28 12:48:41.314 9272 ERROR nova     max_url_len=max_url_len)
Sep 28 12:48:41 ctl02 nova-api[9272]: 2017-09-28 12:48:41.314 9272 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:48:41 ctl02 nova-api[9272]: 2017-09-28 12:48:41.314 9272 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:48:41 ctl02 nova-api[9272]: 2017-09-28 12:48:41.314 9272 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:48:41 ctl02 nova-api[9272]: 2017-09-28 12:48:41.314 9272 ERROR nova     sock.listen(backlog)
Sep 28 12:48:41 ctl02 nova-api[9272]: 2017-09-28 12:48:41.314 9272 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:48:41 ctl02 nova-api[9272]: 2017-09-28 12:48:41.314 9272 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:48:41 ctl02 nova-api[9272]: 2017-09-28 12:48:41.314 9272 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:48:41 ctl02 nova-api[9272]: 2017-09-28 12:48:41.314 9272 ERROR nova
Sep 28 12:48:41 ctl02 heat-api-cfn[13300]: 2017-09-28 12:48:41.458 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:48:41] "OPTIONS / HTTP/1.0" 200 134 0.000458
Sep 28 12:48:41 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:48:41 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:48:41 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:48:41 ctl02 glance-api[29183]: 2017-09-28 12:48:41.535 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:48:41] "OPTIONS / HTTP/1.0" 200 134 0.000606
Sep 28 12:48:41 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:48:41 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:48:41 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:48:41 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:48:42 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x37a70928)
Sep 28 12:48:42 ctl02 neutron-server[30536]: 2017-09-28 12:48:42.311 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:48:42] "OPTIONS / HTTP/1.0" 200 262 0.000473
Sep 28 12:48:43 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x37a70928)
Sep 28 12:48:43 ctl02 nova-api[9290]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:48:43 ctl02 nova-api[9290]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:48:43 ctl02 nova-api[9290]: 2017-09-28 12:48:43.513 9290 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:48:43 ctl02 nova-api[9290]: 2017-09-28 12:48:43.515 9290 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:48:43 ctl02 nova-api[9290]: 2017-09-28 12:48:43.515 9290 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:48:43 ctl02 nova-api[9290]: 2017-09-28 12:48:43.515 9290 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:48:43 ctl02 nova-api[9290]: 2017-09-28 12:48:43.515 9290 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:48:43 ctl02 nova-api[9290]: 2017-09-28 12:48:43.515 9290 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:48:43 ctl02 nova-api[9290]: 2017-09-28 12:48:43.515 9290 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:48:43 ctl02 nova-api[9290]: 2017-09-28 12:48:43.515 9290 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:48:43 ctl02 nova-api[9290]: 2017-09-28 12:48:43.515 9290 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:48:43 ctl02 nova-api[9290]: 2017-09-28 12:48:43.515 9290 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:48:43 ctl02 nova-api[9290]: 2017-09-28 12:48:43.515 9290 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:48:43 ctl02 nova-api[9290]: 2017-09-28 12:48:43.515 9290 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:48:43 ctl02 nova-api[9290]: 2017-09-28 12:48:43.515 9290 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:48:43 ctl02 nova-api[9290]: 2017-09-28 12:48:43.515 9290 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:48:43 ctl02 nova-api[9290]: 2017-09-28 12:48:43.515 9290 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:48:43 ctl02 nova-api[9290]: 2017-09-28 12:48:43.515 9290 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:48:43 ctl02 nova-api[9290]: 2017-09-28 12:48:43.515 9290 ERROR nova.wsgi     self.filename))
Sep 28 12:48:43 ctl02 nova-api[9290]: 2017-09-28 12:48:43.515 9290 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:48:43 ctl02 nova-api[9290]: 2017-09-28 12:48:43.515 9290 ERROR nova.wsgi
Sep 28 12:48:43 ctl02 nova-api[9290]: 2017-09-28 12:48:43.516 9290 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:48:43 ctl02 nova-api[9290]: 2017-09-28 12:48:43.643 9290 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:48:43 ctl02 nova-api[9290]: 2017-09-28 12:48:43.869 9290 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:48:43 ctl02 nova-api[9290]: 2017-09-28 12:48:43.871 9290 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:48:43 ctl02 nova-api[9290]: 2017-09-28 12:48:43.871 9290 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:48:43 ctl02 nova-api[9290]: 2017-09-28 12:48:43.871 9290 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:48:44 ctl02 nova-api[9290]: 2017-09-28 12:48:44.004 9290 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:48:44 ctl02 nova-api[9290]: 2017-09-28 12:48:44.005 9290 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:48:44 ctl02 nova-api[9290]: 2017-09-28 12:48:44.006 9290 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:48:44 ctl02 nova-api[9290]: 2017-09-28 12:48:44.006 9290 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:48:44 ctl02 nova-api[9290]: 2017-09-28 12:48:44.009 9290 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:48:44 ctl02 nova-api[9290]: 2017-09-28 12:48:44.009 9290 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:48:44 ctl02 nova-api[9290]: 2017-09-28 12:48:44.009 9290 ERROR nova Traceback (most recent call last):
Sep 28 12:48:44 ctl02 nova-api[9290]: 2017-09-28 12:48:44.009 9290 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:48:44 ctl02 nova-api[9290]: 2017-09-28 12:48:44.009 9290 ERROR nova     sys.exit(main())
Sep 28 12:48:44 ctl02 nova-api[9290]: 2017-09-28 12:48:44.009 9290 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:48:44 ctl02 nova-api[9290]: 2017-09-28 12:48:44.009 9290 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:48:44 ctl02 nova-api[9290]: 2017-09-28 12:48:44.009 9290 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:48:44 ctl02 nova-api[9290]: 2017-09-28 12:48:44.009 9290 ERROR nova     max_url_len=max_url_len)
Sep 28 12:48:44 ctl02 nova-api[9290]: 2017-09-28 12:48:44.009 9290 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:48:44 ctl02 nova-api[9290]: 2017-09-28 12:48:44.009 9290 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:48:44 ctl02 nova-api[9290]: 2017-09-28 12:48:44.009 9290 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:48:44 ctl02 nova-api[9290]: 2017-09-28 12:48:44.009 9290 ERROR nova     sock.listen(backlog)
Sep 28 12:48:44 ctl02 nova-api[9290]: 2017-09-28 12:48:44.009 9290 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:48:44 ctl02 nova-api[9290]: 2017-09-28 12:48:44.009 9290 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:48:44 ctl02 nova-api[9290]: 2017-09-28 12:48:44.009 9290 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:48:44 ctl02 nova-api[9290]: 2017-09-28 12:48:44.009 9290 ERROR nova
Sep 28 12:48:44 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x37a70928)
Sep 28 12:48:44 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:48:44 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:48:44 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:48:44 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:48:44 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:48:44 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:48:44 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:48:44 ctl02 heat-api[13008]: 2017-09-28 12:48:44.936 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:48:44] "OPTIONS / HTTP/1.0" 200 134 0.000607
Sep 28 12:48:45 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x37a70928)
Sep 28 12:48:45 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:48:45.740 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:48:45] "OPTIONS / HTTP/1.0" 200 134 0.000507
Sep 28 12:48:46 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:48:46 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:48:46 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:48:46.081 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:48:46] "OPTIONS / HTTP/1.0" 200 134 0.000428
Sep 28 12:48:46 ctl02 nova-api[9308]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:48:46 ctl02 nova-api[9308]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:48:46 ctl02 nova-api[9308]: 2017-09-28 12:48:46.260 9308 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:48:46 ctl02 nova-api[9308]: 2017-09-28 12:48:46.262 9308 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:48:46 ctl02 nova-api[9308]: 2017-09-28 12:48:46.262 9308 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:48:46 ctl02 nova-api[9308]: 2017-09-28 12:48:46.262 9308 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:48:46 ctl02 nova-api[9308]: 2017-09-28 12:48:46.262 9308 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:48:46 ctl02 nova-api[9308]: 2017-09-28 12:48:46.262 9308 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:48:46 ctl02 nova-api[9308]: 2017-09-28 12:48:46.262 9308 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:48:46 ctl02 nova-api[9308]: 2017-09-28 12:48:46.262 9308 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:48:46 ctl02 nova-api[9308]: 2017-09-28 12:48:46.262 9308 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:48:46 ctl02 nova-api[9308]: 2017-09-28 12:48:46.262 9308 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:48:46 ctl02 nova-api[9308]: 2017-09-28 12:48:46.262 9308 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:48:46 ctl02 nova-api[9308]: 2017-09-28 12:48:46.262 9308 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:48:46 ctl02 nova-api[9308]: 2017-09-28 12:48:46.262 9308 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:48:46 ctl02 nova-api[9308]: 2017-09-28 12:48:46.262 9308 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:48:46 ctl02 nova-api[9308]: 2017-09-28 12:48:46.262 9308 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:48:46 ctl02 nova-api[9308]: 2017-09-28 12:48:46.262 9308 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:48:46 ctl02 nova-api[9308]: 2017-09-28 12:48:46.262 9308 ERROR nova.wsgi     self.filename))
Sep 28 12:48:46 ctl02 nova-api[9308]: 2017-09-28 12:48:46.262 9308 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:48:46 ctl02 nova-api[9308]: 2017-09-28 12:48:46.262 9308 ERROR nova.wsgi
Sep 28 12:48:46 ctl02 nova-api[9308]: 2017-09-28 12:48:46.263 9308 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:48:46 ctl02 nova-api[9308]: 2017-09-28 12:48:46.392 9308 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:48:46 ctl02 nova-api[9308]: 2017-09-28 12:48:46.619 9308 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:48:46 ctl02 nova-api[9308]: 2017-09-28 12:48:46.621 9308 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:48:46 ctl02 nova-api[9308]: 2017-09-28 12:48:46.621 9308 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:48:46 ctl02 nova-api[9308]: 2017-09-28 12:48:46.622 9308 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:48:46 ctl02 heat-api-cfn[13300]: 2017-09-28 12:48:46.723 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:48:46] "OPTIONS / HTTP/1.0" 200 134 0.000559
Sep 28 12:48:46 ctl02 nova-api[9308]: 2017-09-28 12:48:46.755 9308 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:48:46 ctl02 nova-api[9308]: 2017-09-28 12:48:46.757 9308 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:48:46 ctl02 nova-api[9308]: 2017-09-28 12:48:46.757 9308 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:48:46 ctl02 nova-api[9308]: 2017-09-28 12:48:46.757 9308 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:48:46 ctl02 nova-api[9308]: 2017-09-28 12:48:46.760 9308 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:48:46 ctl02 nova-api[9308]: 2017-09-28 12:48:46.761 9308 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:48:46 ctl02 nova-api[9308]: 2017-09-28 12:48:46.761 9308 ERROR nova Traceback (most recent call last):
Sep 28 12:48:46 ctl02 nova-api[9308]: 2017-09-28 12:48:46.761 9308 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:48:46 ctl02 nova-api[9308]: 2017-09-28 12:48:46.761 9308 ERROR nova     sys.exit(main())
Sep 28 12:48:46 ctl02 nova-api[9308]: 2017-09-28 12:48:46.761 9308 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:48:46 ctl02 nova-api[9308]: 2017-09-28 12:48:46.761 9308 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:48:46 ctl02 nova-api[9308]: 2017-09-28 12:48:46.761 9308 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:48:46 ctl02 nova-api[9308]: 2017-09-28 12:48:46.761 9308 ERROR nova     max_url_len=max_url_len)
Sep 28 12:48:46 ctl02 nova-api[9308]: 2017-09-28 12:48:46.761 9308 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:48:46 ctl02 nova-api[9308]: 2017-09-28 12:48:46.761 9308 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:48:46 ctl02 nova-api[9308]: 2017-09-28 12:48:46.761 9308 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:48:46 ctl02 nova-api[9308]: 2017-09-28 12:48:46.761 9308 ERROR nova     sock.listen(backlog)
Sep 28 12:48:46 ctl02 nova-api[9308]: 2017-09-28 12:48:46.761 9308 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:48:46 ctl02 nova-api[9308]: 2017-09-28 12:48:46.761 9308 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:48:46 ctl02 nova-api[9308]: 2017-09-28 12:48:46.761 9308 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:48:46 ctl02 nova-api[9308]: 2017-09-28 12:48:46.761 9308 ERROR nova
Sep 28 12:48:46 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:48:46 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:48:46 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:48:47 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:48:47 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:48:47 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:48:47 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:48:47 ctl02 heat-api-cfn[13300]: 2017-09-28 12:48:47.849 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:48:47] "OPTIONS / HTTP/1.0" 200 134 0.000490
Sep 28 12:48:48 ctl02 heat-api[13008]: 2017-09-28 12:48:48.191 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:48:48] "OPTIONS / HTTP/1.0" 200 134 0.000621
Sep 28 12:48:48 ctl02 heat-api[13008]: 2017-09-28 12:48:48.649 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:48:48] "OPTIONS / HTTP/1.0" 200 134 0.000619
Sep 28 12:48:48 ctl02 nova-api[9331]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:48:48 ctl02 nova-api[9331]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:48:48 ctl02 nova-consoleauth[5433]: 2017-09-28 12:48:48.869 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:48:49 ctl02 nova-api[9331]: 2017-09-28 12:48:49.045 9331 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:48:49 ctl02 nova-api[9331]: 2017-09-28 12:48:49.046 9331 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:48:49 ctl02 nova-api[9331]: 2017-09-28 12:48:49.046 9331 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:48:49 ctl02 nova-api[9331]: 2017-09-28 12:48:49.046 9331 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:48:49 ctl02 nova-api[9331]: 2017-09-28 12:48:49.046 9331 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:48:49 ctl02 nova-api[9331]: 2017-09-28 12:48:49.046 9331 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:48:49 ctl02 nova-api[9331]: 2017-09-28 12:48:49.046 9331 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:48:49 ctl02 nova-api[9331]: 2017-09-28 12:48:49.046 9331 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:48:49 ctl02 nova-api[9331]: 2017-09-28 12:48:49.046 9331 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:48:49 ctl02 nova-api[9331]: 2017-09-28 12:48:49.046 9331 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:48:49 ctl02 nova-api[9331]: 2017-09-28 12:48:49.046 9331 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:48:49 ctl02 nova-api[9331]: 2017-09-28 12:48:49.046 9331 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:48:49 ctl02 nova-api[9331]: 2017-09-28 12:48:49.046 9331 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:48:49 ctl02 nova-api[9331]: 2017-09-28 12:48:49.046 9331 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:48:49 ctl02 nova-api[9331]: 2017-09-28 12:48:49.046 9331 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:48:49 ctl02 nova-api[9331]: 2017-09-28 12:48:49.046 9331 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:48:49 ctl02 nova-api[9331]: 2017-09-28 12:48:49.046 9331 ERROR nova.wsgi     self.filename))
Sep 28 12:48:49 ctl02 nova-api[9331]: 2017-09-28 12:48:49.046 9331 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:48:49 ctl02 nova-api[9331]: 2017-09-28 12:48:49.046 9331 ERROR nova.wsgi
Sep 28 12:48:49 ctl02 nova-api[9331]: 2017-09-28 12:48:49.047 9331 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:48:49 ctl02 nova-api[9331]: 2017-09-28 12:48:49.185 9331 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:48:49 ctl02 nova-api[9331]: 2017-09-28 12:48:49.438 9331 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:48:49 ctl02 nova-api[9331]: 2017-09-28 12:48:49.441 9331 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:48:49 ctl02 nova-api[9331]: 2017-09-28 12:48:49.441 9331 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:48:49 ctl02 nova-api[9331]: 2017-09-28 12:48:49.441 9331 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:48:49 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:48:49.442 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:48:49] "OPTIONS / HTTP/1.0" 200 134 0.000511
Sep 28 12:48:49 ctl02 nova-api[9331]: 2017-09-28 12:48:49.576 9331 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:48:49 ctl02 nova-api[9331]: 2017-09-28 12:48:49.578 9331 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:48:49 ctl02 nova-api[9331]: 2017-09-28 12:48:49.578 9331 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:48:49 ctl02 nova-api[9331]: 2017-09-28 12:48:49.578 9331 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:48:49 ctl02 nova-api[9331]: 2017-09-28 12:48:49.582 9331 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:48:49 ctl02 nova-api[9331]: 2017-09-28 12:48:49.582 9331 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:48:49 ctl02 nova-api[9331]: 2017-09-28 12:48:49.582 9331 ERROR nova Traceback (most recent call last):
Sep 28 12:48:49 ctl02 nova-api[9331]: 2017-09-28 12:48:49.582 9331 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:48:49 ctl02 nova-api[9331]: 2017-09-28 12:48:49.582 9331 ERROR nova     sys.exit(main())
Sep 28 12:48:49 ctl02 nova-api[9331]: 2017-09-28 12:48:49.582 9331 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:48:49 ctl02 nova-api[9331]: 2017-09-28 12:48:49.582 9331 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:48:49 ctl02 nova-api[9331]: 2017-09-28 12:48:49.582 9331 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:48:49 ctl02 nova-api[9331]: 2017-09-28 12:48:49.582 9331 ERROR nova     max_url_len=max_url_len)
Sep 28 12:48:49 ctl02 nova-api[9331]: 2017-09-28 12:48:49.582 9331 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:48:49 ctl02 nova-api[9331]: 2017-09-28 12:48:49.582 9331 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:48:49 ctl02 nova-api[9331]: 2017-09-28 12:48:49.582 9331 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:48:49 ctl02 nova-api[9331]: 2017-09-28 12:48:49.582 9331 ERROR nova     sock.listen(backlog)
Sep 28 12:48:49 ctl02 nova-api[9331]: 2017-09-28 12:48:49.582 9331 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:48:49 ctl02 nova-api[9331]: 2017-09-28 12:48:49.582 9331 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:48:49 ctl02 nova-api[9331]: 2017-09-28 12:48:49.582 9331 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:48:49 ctl02 nova-api[9331]: 2017-09-28 12:48:49.582 9331 ERROR nova
Sep 28 12:48:49 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:48:49 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:48:49 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:48:49 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:48:49 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:48:49 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:48:49 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:48:50 ctl02 glance-api[29183]: 2017-09-28 12:48:50.029 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:48:50] "OPTIONS / HTTP/1.0" 200 134 0.000606
Sep 28 12:48:50 ctl02 heat-engine[12803]: 2017-09-28 12:48:50.189 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:48:50 ctl02 heat-engine[12803]: 2017-09-28 12:48:50.189 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:48:50 ctl02 heat-engine[12803]: 2017-09-28 12:48:50.194 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:48:50 ctl02 heat-engine[12803]: 2017-09-28 12:48:50.200 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:48:50 ctl02 neutron-server[30536]: 2017-09-28 12:48:50.278 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:48:50] "OPTIONS / HTTP/1.0" 200 262 0.000465
Sep 28 12:48:50 ctl02 glance-api[29183]: 2017-09-28 12:48:50.930 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:48:50] "OPTIONS / HTTP/1.0" 200 134 0.000526
Sep 28 12:48:51 ctl02 neutron-server[30536]: 2017-09-28 12:48:51.180 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:48:51] "OPTIONS / HTTP/1.0" 200 262 0.000465
Sep 28 12:48:51 ctl02 heat-api-cfn[13300]: 2017-09-28 12:48:51.204 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:48:51] "OPTIONS / HTTP/1.0" 200 134 0.000557
Sep 28 12:48:51 ctl02 neutron-server[30536]: 2017-09-28 12:48:51.215 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 4 dead agents out of 6:
Sep 28 12:48:51 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:48:51 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:46:56 cmp002
Sep 28 12:48:51 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:47:28 cmp001
Sep 28 12:48:51 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:47:20 cmp002
Sep 28 12:48:51 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:48:16 cmp002
Sep 28 12:48:51 ctl02 glance-api[29183]: 2017-09-28 12:48:51.511 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:48:51] "OPTIONS / HTTP/1.0" 200 134 0.000482
Sep 28 12:48:51 ctl02 nova-api[9348]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:48:51 ctl02 nova-api[9348]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:48:51 ctl02 nova-api[9348]: 2017-09-28 12:48:51.781 9348 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:48:51 ctl02 nova-api[9348]: 2017-09-28 12:48:51.782 9348 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:48:51 ctl02 nova-api[9348]: 2017-09-28 12:48:51.782 9348 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:48:51 ctl02 nova-api[9348]: 2017-09-28 12:48:51.782 9348 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:48:51 ctl02 nova-api[9348]: 2017-09-28 12:48:51.782 9348 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:48:51 ctl02 nova-api[9348]: 2017-09-28 12:48:51.782 9348 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:48:51 ctl02 nova-api[9348]: 2017-09-28 12:48:51.782 9348 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:48:51 ctl02 nova-api[9348]: 2017-09-28 12:48:51.782 9348 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:48:51 ctl02 nova-api[9348]: 2017-09-28 12:48:51.782 9348 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:48:51 ctl02 nova-api[9348]: 2017-09-28 12:48:51.782 9348 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:48:51 ctl02 nova-api[9348]: 2017-09-28 12:48:51.782 9348 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:48:51 ctl02 nova-api[9348]: 2017-09-28 12:48:51.782 9348 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:48:51 ctl02 nova-api[9348]: 2017-09-28 12:48:51.782 9348 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:48:51 ctl02 nova-api[9348]: 2017-09-28 12:48:51.782 9348 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:48:51 ctl02 nova-api[9348]: 2017-09-28 12:48:51.782 9348 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:48:51 ctl02 nova-api[9348]: 2017-09-28 12:48:51.782 9348 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:48:51 ctl02 nova-api[9348]: 2017-09-28 12:48:51.782 9348 ERROR nova.wsgi     self.filename))
Sep 28 12:48:51 ctl02 nova-api[9348]: 2017-09-28 12:48:51.782 9348 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:48:51 ctl02 nova-api[9348]: 2017-09-28 12:48:51.782 9348 ERROR nova.wsgi
Sep 28 12:48:51 ctl02 nova-api[9348]: 2017-09-28 12:48:51.783 9348 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:48:51 ctl02 nova-api[9348]: 2017-09-28 12:48:51.919 9348 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:48:51 ctl02 nova-scheduler[5620]: 2017-09-28 12:48:51.974 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:48:52 ctl02 nova-api[9348]: 2017-09-28 12:48:52.166 9348 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:48:52 ctl02 nova-api[9348]: 2017-09-28 12:48:52.168 9348 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:48:52 ctl02 nova-api[9348]: 2017-09-28 12:48:52.183 9348 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:48:52 ctl02 nova-api[9348]: 2017-09-28 12:48:52.183 9348 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:48:52 ctl02 nova-api[9348]: 2017-09-28 12:48:52.315 9348 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:48:52 ctl02 nova-api[9348]: 2017-09-28 12:48:52.317 9348 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:48:52 ctl02 nova-api[9348]: 2017-09-28 12:48:52.317 9348 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:48:52 ctl02 nova-api[9348]: 2017-09-28 12:48:52.318 9348 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:48:52 ctl02 nova-api[9348]: 2017-09-28 12:48:52.321 9348 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:48:52 ctl02 nova-api[9348]: 2017-09-28 12:48:52.321 9348 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:48:52 ctl02 nova-api[9348]: 2017-09-28 12:48:52.321 9348 ERROR nova Traceback (most recent call last):
Sep 28 12:48:52 ctl02 nova-api[9348]: 2017-09-28 12:48:52.321 9348 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:48:52 ctl02 nova-api[9348]: 2017-09-28 12:48:52.321 9348 ERROR nova     sys.exit(main())
Sep 28 12:48:52 ctl02 nova-api[9348]: 2017-09-28 12:48:52.321 9348 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:48:52 ctl02 nova-api[9348]: 2017-09-28 12:48:52.321 9348 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:48:52 ctl02 nova-api[9348]: 2017-09-28 12:48:52.321 9348 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:48:52 ctl02 nova-api[9348]: 2017-09-28 12:48:52.321 9348 ERROR nova     max_url_len=max_url_len)
Sep 28 12:48:52 ctl02 nova-api[9348]: 2017-09-28 12:48:52.321 9348 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:48:52 ctl02 nova-api[9348]: 2017-09-28 12:48:52.321 9348 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:48:52 ctl02 nova-api[9348]: 2017-09-28 12:48:52.321 9348 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:48:52 ctl02 nova-api[9348]: 2017-09-28 12:48:52.321 9348 ERROR nova     sock.listen(backlog)
Sep 28 12:48:52 ctl02 nova-api[9348]: 2017-09-28 12:48:52.321 9348 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:48:52 ctl02 nova-api[9348]: 2017-09-28 12:48:52.321 9348 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:48:52 ctl02 nova-api[9348]: 2017-09-28 12:48:52.321 9348 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:48:52 ctl02 nova-api[9348]: 2017-09-28 12:48:52.321 9348 ERROR nova
Sep 28 12:48:52 ctl02 neutron-server[30536]: 2017-09-28 12:48:52.410 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:48:52] "OPTIONS / HTTP/1.0" 200 262 0.000516
Sep 28 12:48:52 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:48:52 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:48:52 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:48:52 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:48:52 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:48:52 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:48:52 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:48:54 ctl02 nova-api[9367]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:48:54 ctl02 nova-api[9367]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:48:54 ctl02 nova-api[9367]: 2017-09-28 12:48:54.515 9367 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:48:54 ctl02 nova-api[9367]: 2017-09-28 12:48:54.516 9367 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:48:54 ctl02 nova-api[9367]: 2017-09-28 12:48:54.516 9367 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:48:54 ctl02 nova-api[9367]: 2017-09-28 12:48:54.516 9367 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:48:54 ctl02 nova-api[9367]: 2017-09-28 12:48:54.516 9367 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:48:54 ctl02 nova-api[9367]: 2017-09-28 12:48:54.516 9367 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:48:54 ctl02 nova-api[9367]: 2017-09-28 12:48:54.516 9367 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:48:54 ctl02 nova-api[9367]: 2017-09-28 12:48:54.516 9367 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:48:54 ctl02 nova-api[9367]: 2017-09-28 12:48:54.516 9367 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:48:54 ctl02 nova-api[9367]: 2017-09-28 12:48:54.516 9367 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:48:54 ctl02 nova-api[9367]: 2017-09-28 12:48:54.516 9367 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:48:54 ctl02 nova-api[9367]: 2017-09-28 12:48:54.516 9367 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:48:54 ctl02 nova-api[9367]: 2017-09-28 12:48:54.516 9367 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:48:54 ctl02 nova-api[9367]: 2017-09-28 12:48:54.516 9367 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:48:54 ctl02 nova-api[9367]: 2017-09-28 12:48:54.516 9367 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:48:54 ctl02 nova-api[9367]: 2017-09-28 12:48:54.516 9367 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:48:54 ctl02 nova-api[9367]: 2017-09-28 12:48:54.516 9367 ERROR nova.wsgi     self.filename))
Sep 28 12:48:54 ctl02 nova-api[9367]: 2017-09-28 12:48:54.516 9367 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:48:54 ctl02 nova-api[9367]: 2017-09-28 12:48:54.516 9367 ERROR nova.wsgi
Sep 28 12:48:54 ctl02 nova-api[9367]: 2017-09-28 12:48:54.517 9367 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:48:54 ctl02 heat-api[13008]: 2017-09-28 12:48:54.566 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:48:54] "OPTIONS / HTTP/1.0" 200 134 0.000608
Sep 28 12:48:54 ctl02 nova-api[9367]: 2017-09-28 12:48:54.650 9367 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:48:54 ctl02 nova-api[9367]: 2017-09-28 12:48:54.901 9367 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:48:54 ctl02 nova-api[9367]: 2017-09-28 12:48:54.904 9367 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:48:54 ctl02 nova-api[9367]: 2017-09-28 12:48:54.905 9367 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:48:54 ctl02 nova-api[9367]: 2017-09-28 12:48:54.905 9367 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:48:55 ctl02 nova-api[9367]: 2017-09-28 12:48:55.038 9367 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:48:55 ctl02 nova-api[9367]: 2017-09-28 12:48:55.041 9367 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:48:55 ctl02 nova-api[9367]: 2017-09-28 12:48:55.041 9367 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:48:55 ctl02 nova-api[9367]: 2017-09-28 12:48:55.041 9367 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:48:55 ctl02 nova-api[9367]: 2017-09-28 12:48:55.045 9367 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:48:55 ctl02 nova-api[9367]: 2017-09-28 12:48:55.045 9367 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:48:55 ctl02 nova-api[9367]: 2017-09-28 12:48:55.045 9367 ERROR nova Traceback (most recent call last):
Sep 28 12:48:55 ctl02 nova-api[9367]: 2017-09-28 12:48:55.045 9367 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:48:55 ctl02 nova-api[9367]: 2017-09-28 12:48:55.045 9367 ERROR nova     sys.exit(main())
Sep 28 12:48:55 ctl02 nova-api[9367]: 2017-09-28 12:48:55.045 9367 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:48:55 ctl02 nova-api[9367]: 2017-09-28 12:48:55.045 9367 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:48:55 ctl02 nova-api[9367]: 2017-09-28 12:48:55.045 9367 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:48:55 ctl02 nova-api[9367]: 2017-09-28 12:48:55.045 9367 ERROR nova     max_url_len=max_url_len)
Sep 28 12:48:55 ctl02 nova-api[9367]: 2017-09-28 12:48:55.045 9367 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:48:55 ctl02 nova-api[9367]: 2017-09-28 12:48:55.045 9367 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:48:55 ctl02 nova-api[9367]: 2017-09-28 12:48:55.045 9367 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:48:55 ctl02 nova-api[9367]: 2017-09-28 12:48:55.045 9367 ERROR nova     sock.listen(backlog)
Sep 28 12:48:55 ctl02 nova-api[9367]: 2017-09-28 12:48:55.045 9367 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:48:55 ctl02 nova-api[9367]: 2017-09-28 12:48:55.045 9367 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:48:55 ctl02 nova-api[9367]: 2017-09-28 12:48:55.045 9367 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:48:55 ctl02 nova-api[9367]: 2017-09-28 12:48:55.045 9367 ERROR nova
Sep 28 12:48:55 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:48:55 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:48:55 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:48:55 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:48:55 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:48:55 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:48:55 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:48:55 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:48:55.894 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:48:55] "OPTIONS / HTTP/1.0" 200 134 0.000439
Sep 28 12:48:56 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:48:56.247 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:48:56] "OPTIONS / HTTP/1.0" 200 134 0.000425
Sep 28 12:48:56 ctl02 heat-api-cfn[13300]: 2017-09-28 12:48:56.668 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:48:56] "OPTIONS / HTTP/1.0" 200 134 0.000469
Sep 28 12:48:57 ctl02 nova-api[9385]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:48:57 ctl02 nova-api[9385]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:48:57 ctl02 nova-api[9385]: 2017-09-28 12:48:57.259 9385 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:48:57 ctl02 nova-api[9385]: 2017-09-28 12:48:57.260 9385 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:48:57 ctl02 nova-api[9385]: 2017-09-28 12:48:57.260 9385 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:48:57 ctl02 nova-api[9385]: 2017-09-28 12:48:57.260 9385 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:48:57 ctl02 nova-api[9385]: 2017-09-28 12:48:57.260 9385 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:48:57 ctl02 nova-api[9385]: 2017-09-28 12:48:57.260 9385 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:48:57 ctl02 nova-api[9385]: 2017-09-28 12:48:57.260 9385 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:48:57 ctl02 nova-api[9385]: 2017-09-28 12:48:57.260 9385 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:48:57 ctl02 nova-api[9385]: 2017-09-28 12:48:57.260 9385 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:48:57 ctl02 nova-api[9385]: 2017-09-28 12:48:57.260 9385 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:48:57 ctl02 nova-api[9385]: 2017-09-28 12:48:57.260 9385 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:48:57 ctl02 nova-api[9385]: 2017-09-28 12:48:57.260 9385 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:48:57 ctl02 nova-api[9385]: 2017-09-28 12:48:57.260 9385 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:48:57 ctl02 nova-api[9385]: 2017-09-28 12:48:57.260 9385 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:48:57 ctl02 nova-api[9385]: 2017-09-28 12:48:57.260 9385 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:48:57 ctl02 nova-api[9385]: 2017-09-28 12:48:57.260 9385 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:48:57 ctl02 nova-api[9385]: 2017-09-28 12:48:57.260 9385 ERROR nova.wsgi     self.filename))
Sep 28 12:48:57 ctl02 nova-api[9385]: 2017-09-28 12:48:57.260 9385 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:48:57 ctl02 nova-api[9385]: 2017-09-28 12:48:57.260 9385 ERROR nova.wsgi
Sep 28 12:48:57 ctl02 nova-api[9385]: 2017-09-28 12:48:57.272 9385 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:48:57 ctl02 nova-api[9385]: 2017-09-28 12:48:57.405 9385 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:48:57 ctl02 heat-api-cfn[13300]: 2017-09-28 12:48:57.550 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:48:57] "OPTIONS / HTTP/1.0" 200 134 0.000517
Sep 28 12:48:57 ctl02 nova-api[9385]: 2017-09-28 12:48:57.641 9385 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:48:57 ctl02 nova-api[9385]: 2017-09-28 12:48:57.643 9385 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:48:57 ctl02 nova-api[9385]: 2017-09-28 12:48:57.644 9385 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:48:57 ctl02 nova-api[9385]: 2017-09-28 12:48:57.644 9385 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:48:57 ctl02 nova-api[9385]: 2017-09-28 12:48:57.777 9385 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:48:57 ctl02 nova-api[9385]: 2017-09-28 12:48:57.780 9385 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:48:57 ctl02 nova-api[9385]: 2017-09-28 12:48:57.780 9385 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:48:57 ctl02 nova-api[9385]: 2017-09-28 12:48:57.781 9385 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:48:57 ctl02 nova-api[9385]: 2017-09-28 12:48:57.784 9385 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:48:57 ctl02 nova-api[9385]: 2017-09-28 12:48:57.785 9385 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:48:57 ctl02 nova-api[9385]: 2017-09-28 12:48:57.785 9385 ERROR nova Traceback (most recent call last):
Sep 28 12:48:57 ctl02 nova-api[9385]: 2017-09-28 12:48:57.785 9385 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:48:57 ctl02 nova-api[9385]: 2017-09-28 12:48:57.785 9385 ERROR nova     sys.exit(main())
Sep 28 12:48:57 ctl02 nova-api[9385]: 2017-09-28 12:48:57.785 9385 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:48:57 ctl02 nova-api[9385]: 2017-09-28 12:48:57.785 9385 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:48:57 ctl02 nova-api[9385]: 2017-09-28 12:48:57.785 9385 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:48:57 ctl02 nova-api[9385]: 2017-09-28 12:48:57.785 9385 ERROR nova     max_url_len=max_url_len)
Sep 28 12:48:57 ctl02 nova-api[9385]: 2017-09-28 12:48:57.785 9385 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:48:57 ctl02 nova-api[9385]: 2017-09-28 12:48:57.785 9385 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:48:57 ctl02 nova-api[9385]: 2017-09-28 12:48:57.785 9385 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:48:57 ctl02 nova-api[9385]: 2017-09-28 12:48:57.785 9385 ERROR nova     sock.listen(backlog)
Sep 28 12:48:57 ctl02 nova-api[9385]: 2017-09-28 12:48:57.785 9385 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:48:57 ctl02 nova-api[9385]: 2017-09-28 12:48:57.785 9385 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:48:57 ctl02 nova-api[9385]: 2017-09-28 12:48:57.785 9385 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:48:57 ctl02 nova-api[9385]: 2017-09-28 12:48:57.785 9385 ERROR nova
Sep 28 12:48:57 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:48:57 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:48:57 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:48:58 ctl02 heat-api[13008]: 2017-09-28 12:48:58.121 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:48:58] "OPTIONS / HTTP/1.0" 200 134 0.000600
Sep 28 12:48:58 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:48:58 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:48:58 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:48:58 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:48:58 ctl02 neutron-server[30536]: 2017-09-28 12:48:58.518 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:48:58 ctl02 heat-api[13008]: 2017-09-28 12:48:58.963 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:48:58] "OPTIONS / HTTP/1.0" 200 134 0.000636
Sep 28 12:48:59 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x55412905)
Sep 28 12:48:59 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:48:59.517 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:48:59] "OPTIONS / HTTP/1.0" 200 134 0.000411
Sep 28 12:48:59 ctl02 nova-api[9403]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:48:59 ctl02 nova-api[9403]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:48:59 ctl02 glance-api[29183]: 2017-09-28 12:48:59.893 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:48:59] "OPTIONS / HTTP/1.0" 200 134 0.000925
Sep 28 12:48:59 ctl02 nova-api[9403]: 2017-09-28 12:48:59.985 9403 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:48:59 ctl02 nova-api[9403]: 2017-09-28 12:48:59.986 9403 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:48:59 ctl02 nova-api[9403]: 2017-09-28 12:48:59.986 9403 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:48:59 ctl02 nova-api[9403]: 2017-09-28 12:48:59.986 9403 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:48:59 ctl02 nova-api[9403]: 2017-09-28 12:48:59.986 9403 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:48:59 ctl02 nova-api[9403]: 2017-09-28 12:48:59.986 9403 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:48:59 ctl02 nova-api[9403]: 2017-09-28 12:48:59.986 9403 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:48:59 ctl02 nova-api[9403]: 2017-09-28 12:48:59.986 9403 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:48:59 ctl02 nova-api[9403]: 2017-09-28 12:48:59.986 9403 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:48:59 ctl02 nova-api[9403]: 2017-09-28 12:48:59.986 9403 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:48:59 ctl02 nova-api[9403]: 2017-09-28 12:48:59.986 9403 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:48:59 ctl02 nova-api[9403]: 2017-09-28 12:48:59.986 9403 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:48:59 ctl02 nova-api[9403]: 2017-09-28 12:48:59.986 9403 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:48:59 ctl02 nova-api[9403]: 2017-09-28 12:48:59.986 9403 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:48:59 ctl02 nova-api[9403]: 2017-09-28 12:48:59.986 9403 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:48:59 ctl02 nova-api[9403]: 2017-09-28 12:48:59.986 9403 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:48:59 ctl02 nova-api[9403]: 2017-09-28 12:48:59.986 9403 ERROR nova.wsgi     self.filename))
Sep 28 12:48:59 ctl02 nova-api[9403]: 2017-09-28 12:48:59.986 9403 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:48:59 ctl02 nova-api[9403]: 2017-09-28 12:48:59.986 9403 ERROR nova.wsgi
Sep 28 12:48:59 ctl02 nova-api[9403]: 2017-09-28 12:48:59.987 9403 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:49:00 ctl02 nova-api[9403]: 2017-09-28 12:49:00.115 9403 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:49:00 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x55412905)
Sep 28 12:49:00 ctl02 neutron-server[30536]: 2017-09-28 12:49:00.336 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:49:00] "OPTIONS / HTTP/1.0" 200 262 0.000552
Sep 28 12:49:00 ctl02 nova-api[9403]: 2017-09-28 12:49:00.356 9403 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:49:00 ctl02 nova-api[9403]: 2017-09-28 12:49:00.358 9403 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:49:00 ctl02 nova-api[9403]: 2017-09-28 12:49:00.359 9403 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:49:00 ctl02 nova-api[9403]: 2017-09-28 12:49:00.359 9403 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:49:00 ctl02 nova-api[9403]: 2017-09-28 12:49:00.498 9403 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:49:00 ctl02 nova-api[9403]: 2017-09-28 12:49:00.500 9403 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:49:00 ctl02 nova-api[9403]: 2017-09-28 12:49:00.500 9403 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:49:00 ctl02 nova-api[9403]: 2017-09-28 12:49:00.501 9403 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:49:00 ctl02 nova-api[9403]: 2017-09-28 12:49:00.504 9403 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:49:00 ctl02 nova-api[9403]: 2017-09-28 12:49:00.504 9403 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:49:00 ctl02 nova-api[9403]: 2017-09-28 12:49:00.504 9403 ERROR nova Traceback (most recent call last):
Sep 28 12:49:00 ctl02 nova-api[9403]: 2017-09-28 12:49:00.504 9403 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:49:00 ctl02 nova-api[9403]: 2017-09-28 12:49:00.504 9403 ERROR nova     sys.exit(main())
Sep 28 12:49:00 ctl02 nova-api[9403]: 2017-09-28 12:49:00.504 9403 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:49:00 ctl02 nova-api[9403]: 2017-09-28 12:49:00.504 9403 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:49:00 ctl02 nova-api[9403]: 2017-09-28 12:49:00.504 9403 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:49:00 ctl02 nova-api[9403]: 2017-09-28 12:49:00.504 9403 ERROR nova     max_url_len=max_url_len)
Sep 28 12:49:00 ctl02 nova-api[9403]: 2017-09-28 12:49:00.504 9403 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:49:00 ctl02 nova-api[9403]: 2017-09-28 12:49:00.504 9403 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:49:00 ctl02 nova-api[9403]: 2017-09-28 12:49:00.504 9403 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:49:00 ctl02 nova-api[9403]: 2017-09-28 12:49:00.504 9403 ERROR nova     sock.listen(backlog)
Sep 28 12:49:00 ctl02 nova-api[9403]: 2017-09-28 12:49:00.504 9403 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:49:00 ctl02 nova-api[9403]: 2017-09-28 12:49:00.504 9403 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:49:00 ctl02 nova-api[9403]: 2017-09-28 12:49:00.504 9403 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:49:00 ctl02 nova-api[9403]: 2017-09-28 12:49:00.504 9403 ERROR nova
Sep 28 12:49:00 ctl02 glance-api[29183]: 2017-09-28 12:49:00.535 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:49:00] "OPTIONS / HTTP/1.0" 200 134 0.000609
Sep 28 12:49:00 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:49:00 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:49:00 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:49:00 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:49:00 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:49:00 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:49:00 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:49:00 ctl02 neutron-server[30536]: 2017-09-28 12:49:00.953 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:49:00] "OPTIONS / HTTP/1.0" 200 262 0.000576
Sep 28 12:49:01 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x55412905)
Sep 28 12:49:01 ctl02 heat-api-cfn[13300]: 2017-09-28 12:49:01.158 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:49:01] "OPTIONS / HTTP/1.0" 200 134 0.000451
Sep 28 12:49:01 ctl02 glance-api[29183]: 2017-09-28 12:49:01.275 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:49:01] "OPTIONS / HTTP/1.0" 200 134 0.000609
Sep 28 12:49:02 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x55412905)
Sep 28 12:49:02 ctl02 neutron-server[30536]: 2017-09-28 12:49:02.485 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:49:02] "OPTIONS / HTTP/1.0" 200 262 0.000475
Sep 28 12:49:02 ctl02 nova-api[9421]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:49:02 ctl02 nova-api[9421]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:49:02 ctl02 nova-api[9421]: 2017-09-28 12:49:02.803 9421 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:49:02 ctl02 nova-api[9421]: 2017-09-28 12:49:02.805 9421 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:49:02 ctl02 nova-api[9421]: 2017-09-28 12:49:02.805 9421 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:49:02 ctl02 nova-api[9421]: 2017-09-28 12:49:02.805 9421 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:49:02 ctl02 nova-api[9421]: 2017-09-28 12:49:02.805 9421 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:49:02 ctl02 nova-api[9421]: 2017-09-28 12:49:02.805 9421 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:49:02 ctl02 nova-api[9421]: 2017-09-28 12:49:02.805 9421 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:49:02 ctl02 nova-api[9421]: 2017-09-28 12:49:02.805 9421 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:49:02 ctl02 nova-api[9421]: 2017-09-28 12:49:02.805 9421 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:49:02 ctl02 nova-api[9421]: 2017-09-28 12:49:02.805 9421 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:49:02 ctl02 nova-api[9421]: 2017-09-28 12:49:02.805 9421 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:49:02 ctl02 nova-api[9421]: 2017-09-28 12:49:02.805 9421 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:49:02 ctl02 nova-api[9421]: 2017-09-28 12:49:02.805 9421 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:49:02 ctl02 nova-api[9421]: 2017-09-28 12:49:02.805 9421 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:49:02 ctl02 nova-api[9421]: 2017-09-28 12:49:02.805 9421 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:49:02 ctl02 nova-api[9421]: 2017-09-28 12:49:02.805 9421 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:49:02 ctl02 nova-api[9421]: 2017-09-28 12:49:02.805 9421 ERROR nova.wsgi     self.filename))
Sep 28 12:49:02 ctl02 nova-api[9421]: 2017-09-28 12:49:02.805 9421 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:49:02 ctl02 nova-api[9421]: 2017-09-28 12:49:02.805 9421 ERROR nova.wsgi
Sep 28 12:49:02 ctl02 nova-api[9421]: 2017-09-28 12:49:02.806 9421 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:49:02 ctl02 nova-api[9421]: 2017-09-28 12:49:02.938 9421 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:49:03 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x55412905)
Sep 28 12:49:03 ctl02 nova-api[9421]: 2017-09-28 12:49:03.178 9421 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:49:03 ctl02 nova-api[9421]: 2017-09-28 12:49:03.181 9421 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:49:03 ctl02 nova-api[9421]: 2017-09-28 12:49:03.181 9421 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:49:03 ctl02 nova-api[9421]: 2017-09-28 12:49:03.181 9421 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:49:03 ctl02 nova-api[9421]: 2017-09-28 12:49:03.317 9421 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:49:03 ctl02 nova-api[9421]: 2017-09-28 12:49:03.319 9421 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:49:03 ctl02 nova-api[9421]: 2017-09-28 12:49:03.319 9421 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:49:03 ctl02 nova-api[9421]: 2017-09-28 12:49:03.320 9421 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:49:03 ctl02 nova-api[9421]: 2017-09-28 12:49:03.323 9421 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:49:03 ctl02 nova-api[9421]: 2017-09-28 12:49:03.323 9421 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:49:03 ctl02 nova-api[9421]: 2017-09-28 12:49:03.323 9421 ERROR nova Traceback (most recent call last):
Sep 28 12:49:03 ctl02 nova-api[9421]: 2017-09-28 12:49:03.323 9421 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:49:03 ctl02 nova-api[9421]: 2017-09-28 12:49:03.323 9421 ERROR nova     sys.exit(main())
Sep 28 12:49:03 ctl02 nova-api[9421]: 2017-09-28 12:49:03.323 9421 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:49:03 ctl02 nova-api[9421]: 2017-09-28 12:49:03.323 9421 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:49:03 ctl02 nova-api[9421]: 2017-09-28 12:49:03.323 9421 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:49:03 ctl02 nova-api[9421]: 2017-09-28 12:49:03.323 9421 ERROR nova     max_url_len=max_url_len)
Sep 28 12:49:03 ctl02 nova-api[9421]: 2017-09-28 12:49:03.323 9421 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:49:03 ctl02 nova-api[9421]: 2017-09-28 12:49:03.323 9421 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:49:03 ctl02 nova-api[9421]: 2017-09-28 12:49:03.323 9421 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:49:03 ctl02 nova-api[9421]: 2017-09-28 12:49:03.323 9421 ERROR nova     sock.listen(backlog)
Sep 28 12:49:03 ctl02 nova-api[9421]: 2017-09-28 12:49:03.323 9421 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:49:03 ctl02 nova-api[9421]: 2017-09-28 12:49:03.323 9421 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:49:03 ctl02 nova-api[9421]: 2017-09-28 12:49:03.323 9421 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:49:03 ctl02 nova-api[9421]: 2017-09-28 12:49:03.323 9421 ERROR nova
Sep 28 12:49:03 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:49:03 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:49:03 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:49:03 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:49:03 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:49:03 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:49:03 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:49:04 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x55412905)
Sep 28 12:49:04 ctl02 heat-api[13008]: 2017-09-28 12:49:04.260 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:49:04] "OPTIONS / HTTP/1.0" 200 134 0.000634
Sep 28 12:49:05 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x55412905)
Sep 28 12:49:05 ctl02 nova-api[9438]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:49:05 ctl02 nova-api[9438]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:49:05 ctl02 nova-api[9438]: 2017-09-28 12:49:05.522 9438 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:49:05 ctl02 nova-api[9438]: 2017-09-28 12:49:05.523 9438 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:49:05 ctl02 nova-api[9438]: 2017-09-28 12:49:05.523 9438 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:49:05 ctl02 nova-api[9438]: 2017-09-28 12:49:05.523 9438 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:49:05 ctl02 nova-api[9438]: 2017-09-28 12:49:05.523 9438 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:49:05 ctl02 nova-api[9438]: 2017-09-28 12:49:05.523 9438 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:49:05 ctl02 nova-api[9438]: 2017-09-28 12:49:05.523 9438 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:49:05 ctl02 nova-api[9438]: 2017-09-28 12:49:05.523 9438 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:49:05 ctl02 nova-api[9438]: 2017-09-28 12:49:05.523 9438 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:49:05 ctl02 nova-api[9438]: 2017-09-28 12:49:05.523 9438 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:49:05 ctl02 nova-api[9438]: 2017-09-28 12:49:05.523 9438 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:49:05 ctl02 nova-api[9438]: 2017-09-28 12:49:05.523 9438 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:49:05 ctl02 nova-api[9438]: 2017-09-28 12:49:05.523 9438 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:49:05 ctl02 nova-api[9438]: 2017-09-28 12:49:05.523 9438 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:49:05 ctl02 nova-api[9438]: 2017-09-28 12:49:05.523 9438 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:49:05 ctl02 nova-api[9438]: 2017-09-28 12:49:05.523 9438 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:49:05 ctl02 nova-api[9438]: 2017-09-28 12:49:05.523 9438 ERROR nova.wsgi     self.filename))
Sep 28 12:49:05 ctl02 nova-api[9438]: 2017-09-28 12:49:05.523 9438 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:49:05 ctl02 nova-api[9438]: 2017-09-28 12:49:05.523 9438 ERROR nova.wsgi
Sep 28 12:49:05 ctl02 nova-api[9438]: 2017-09-28 12:49:05.525 9438 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:49:05 ctl02 nova-api[9438]: 2017-09-28 12:49:05.654 9438 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:49:05 ctl02 nova-api[9438]: 2017-09-28 12:49:05.902 9438 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:49:05 ctl02 nova-api[9438]: 2017-09-28 12:49:05.904 9438 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:49:05 ctl02 nova-api[9438]: 2017-09-28 12:49:05.905 9438 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:49:05 ctl02 nova-api[9438]: 2017-09-28 12:49:05.905 9438 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:49:06 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:49:06.033 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:49:06] "OPTIONS / HTTP/1.0" 200 134 0.000675
Sep 28 12:49:06 ctl02 nova-api[9438]: 2017-09-28 12:49:06.042 9438 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:49:06 ctl02 nova-api[9438]: 2017-09-28 12:49:06.044 9438 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:49:06 ctl02 nova-api[9438]: 2017-09-28 12:49:06.044 9438 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:49:06 ctl02 nova-api[9438]: 2017-09-28 12:49:06.045 9438 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:49:06 ctl02 nova-api[9438]: 2017-09-28 12:49:06.048 9438 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:49:06 ctl02 nova-api[9438]: 2017-09-28 12:49:06.048 9438 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:49:06 ctl02 nova-api[9438]: 2017-09-28 12:49:06.048 9438 ERROR nova Traceback (most recent call last):
Sep 28 12:49:06 ctl02 nova-api[9438]: 2017-09-28 12:49:06.048 9438 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:49:06 ctl02 nova-api[9438]: 2017-09-28 12:49:06.048 9438 ERROR nova     sys.exit(main())
Sep 28 12:49:06 ctl02 nova-api[9438]: 2017-09-28 12:49:06.048 9438 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:49:06 ctl02 nova-api[9438]: 2017-09-28 12:49:06.048 9438 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:49:06 ctl02 nova-api[9438]: 2017-09-28 12:49:06.048 9438 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:49:06 ctl02 nova-api[9438]: 2017-09-28 12:49:06.048 9438 ERROR nova     max_url_len=max_url_len)
Sep 28 12:49:06 ctl02 nova-api[9438]: 2017-09-28 12:49:06.048 9438 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:49:06 ctl02 nova-api[9438]: 2017-09-28 12:49:06.048 9438 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:49:06 ctl02 nova-api[9438]: 2017-09-28 12:49:06.048 9438 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:49:06 ctl02 nova-api[9438]: 2017-09-28 12:49:06.048 9438 ERROR nova     sock.listen(backlog)
Sep 28 12:49:06 ctl02 nova-api[9438]: 2017-09-28 12:49:06.048 9438 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:49:06 ctl02 nova-api[9438]: 2017-09-28 12:49:06.048 9438 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:49:06 ctl02 nova-api[9438]: 2017-09-28 12:49:06.048 9438 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:49:06 ctl02 nova-api[9438]: 2017-09-28 12:49:06.048 9438 ERROR nova
Sep 28 12:49:06 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x55412905)
Sep 28 12:49:06 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:49:06.187 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:49:06] "OPTIONS / HTTP/1.0" 200 134 0.000388
Sep 28 12:49:06 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:49:06 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:49:06 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:49:06 ctl02 neutron-server[30536]: 2017-09-28 12:49:06.210 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 12:49:06 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:49:06 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:47:28 cmp001
Sep 28 12:49:06 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:47:20 cmp002
Sep 28 12:49:06 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:48:16 cmp002
Sep 28 12:49:06 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:49:06 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:49:06 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:49:06 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:49:06 ctl02 heat-api-cfn[13300]: 2017-09-28 12:49:06.823 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:49:06] "OPTIONS / HTTP/1.0" 200 134 0.000419
Sep 28 12:49:07 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x55412905)
Sep 28 12:49:07 ctl02 heat-api-cfn[13300]: 2017-09-28 12:49:07.364 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:49:07] "OPTIONS / HTTP/1.0" 200 134 0.000437
Sep 28 12:49:08 ctl02 nova-api[9456]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:49:08 ctl02 nova-api[9456]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:49:08 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x55412905)
Sep 28 12:49:08 ctl02 heat-api[13008]: 2017-09-28 12:49:08.219 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:49:08] "OPTIONS / HTTP/1.0" 200 134 0.000536
Sep 28 12:49:08 ctl02 nova-api[9456]: 2017-09-28 12:49:08.280 9456 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:49:08 ctl02 nova-api[9456]: 2017-09-28 12:49:08.282 9456 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:49:08 ctl02 nova-api[9456]: 2017-09-28 12:49:08.282 9456 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:49:08 ctl02 nova-api[9456]: 2017-09-28 12:49:08.282 9456 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:49:08 ctl02 nova-api[9456]: 2017-09-28 12:49:08.282 9456 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:49:08 ctl02 nova-api[9456]: 2017-09-28 12:49:08.282 9456 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:49:08 ctl02 nova-api[9456]: 2017-09-28 12:49:08.282 9456 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:49:08 ctl02 nova-api[9456]: 2017-09-28 12:49:08.282 9456 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:49:08 ctl02 nova-api[9456]: 2017-09-28 12:49:08.282 9456 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:49:08 ctl02 nova-api[9456]: 2017-09-28 12:49:08.282 9456 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:49:08 ctl02 nova-api[9456]: 2017-09-28 12:49:08.282 9456 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:49:08 ctl02 nova-api[9456]: 2017-09-28 12:49:08.282 9456 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:49:08 ctl02 nova-api[9456]: 2017-09-28 12:49:08.282 9456 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:49:08 ctl02 nova-api[9456]: 2017-09-28 12:49:08.282 9456 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:49:08 ctl02 nova-api[9456]: 2017-09-28 12:49:08.282 9456 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:49:08 ctl02 nova-api[9456]: 2017-09-28 12:49:08.282 9456 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:49:08 ctl02 nova-api[9456]: 2017-09-28 12:49:08.282 9456 ERROR nova.wsgi     self.filename))
Sep 28 12:49:08 ctl02 nova-api[9456]: 2017-09-28 12:49:08.282 9456 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:49:08 ctl02 nova-api[9456]: 2017-09-28 12:49:08.282 9456 ERROR nova.wsgi
Sep 28 12:49:08 ctl02 nova-api[9456]: 2017-09-28 12:49:08.283 9456 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:49:08 ctl02 nova-api[9456]: 2017-09-28 12:49:08.419 9456 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:49:08 ctl02 nova-api[9456]: 2017-09-28 12:49:08.652 9456 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:49:08 ctl02 nova-api[9456]: 2017-09-28 12:49:08.654 9456 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:49:08 ctl02 nova-api[9456]: 2017-09-28 12:49:08.654 9456 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:49:08 ctl02 nova-api[9456]: 2017-09-28 12:49:08.655 9456 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:49:08 ctl02 nova-api[9456]: 2017-09-28 12:49:08.795 9456 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:49:08 ctl02 nova-api[9456]: 2017-09-28 12:49:08.796 9456 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:49:08 ctl02 nova-api[9456]: 2017-09-28 12:49:08.797 9456 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:49:08 ctl02 nova-api[9456]: 2017-09-28 12:49:08.797 9456 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:49:08 ctl02 nova-api[9456]: 2017-09-28 12:49:08.800 9456 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:49:08 ctl02 nova-api[9456]: 2017-09-28 12:49:08.801 9456 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:49:08 ctl02 nova-api[9456]: 2017-09-28 12:49:08.801 9456 ERROR nova Traceback (most recent call last):
Sep 28 12:49:08 ctl02 nova-api[9456]: 2017-09-28 12:49:08.801 9456 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:49:08 ctl02 nova-api[9456]: 2017-09-28 12:49:08.801 9456 ERROR nova     sys.exit(main())
Sep 28 12:49:08 ctl02 nova-api[9456]: 2017-09-28 12:49:08.801 9456 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:49:08 ctl02 nova-api[9456]: 2017-09-28 12:49:08.801 9456 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:49:08 ctl02 nova-api[9456]: 2017-09-28 12:49:08.801 9456 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:49:08 ctl02 nova-api[9456]: 2017-09-28 12:49:08.801 9456 ERROR nova     max_url_len=max_url_len)
Sep 28 12:49:08 ctl02 nova-api[9456]: 2017-09-28 12:49:08.801 9456 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:49:08 ctl02 nova-api[9456]: 2017-09-28 12:49:08.801 9456 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:49:08 ctl02 nova-api[9456]: 2017-09-28 12:49:08.801 9456 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:49:08 ctl02 nova-api[9456]: 2017-09-28 12:49:08.801 9456 ERROR nova     sock.listen(backlog)
Sep 28 12:49:08 ctl02 nova-api[9456]: 2017-09-28 12:49:08.801 9456 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:49:08 ctl02 nova-api[9456]: 2017-09-28 12:49:08.801 9456 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:49:08 ctl02 nova-api[9456]: 2017-09-28 12:49:08.801 9456 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:49:08 ctl02 nova-api[9456]: 2017-09-28 12:49:08.801 9456 ERROR nova
Sep 28 12:49:08 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:49:08 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:49:08 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:49:09 ctl02 heat-api[13008]: 2017-09-28 12:49:09.115 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:49:09] "OPTIONS / HTTP/1.0" 200 134 0.000562
Sep 28 12:49:09 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:49:09 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:49:09 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x55412905)
Sep 28 12:49:09 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:49:09 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:49:09 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:49:09.560 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:49:09] "OPTIONS / HTTP/1.0" 200 134 0.000346
Sep 28 12:49:09 ctl02 glance-api[29183]: 2017-09-28 12:49:09.725 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:49:09] "OPTIONS / HTTP/1.0" 200 134 0.000576
Sep 28 12:49:10 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:49:10 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:49:10 ctl02 glance-api[29183]: 2017-09-28 12:49:10.562 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:49:10] "OPTIONS / HTTP/1.0" 200 134 0.000554
Sep 28 12:49:10 ctl02 neutron-server[30536]: 2017-09-28 12:49:10.598 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:49:10] "OPTIONS / HTTP/1.0" 200 262 0.000440
Sep 28 12:49:10 ctl02 nova-api[9475]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:49:10 ctl02 nova-api[9475]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:49:10 ctl02 nova-api[9475]: 2017-09-28 12:49:10.973 9475 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:49:10 ctl02 nova-api[9475]: 2017-09-28 12:49:10.974 9475 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:49:10 ctl02 nova-api[9475]: 2017-09-28 12:49:10.974 9475 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:49:10 ctl02 nova-api[9475]: 2017-09-28 12:49:10.974 9475 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:49:10 ctl02 nova-api[9475]: 2017-09-28 12:49:10.974 9475 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:49:10 ctl02 nova-api[9475]: 2017-09-28 12:49:10.974 9475 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:49:10 ctl02 nova-api[9475]: 2017-09-28 12:49:10.974 9475 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:49:10 ctl02 nova-api[9475]: 2017-09-28 12:49:10.974 9475 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:49:10 ctl02 nova-api[9475]: 2017-09-28 12:49:10.974 9475 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:49:10 ctl02 nova-api[9475]: 2017-09-28 12:49:10.974 9475 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:49:10 ctl02 nova-api[9475]: 2017-09-28 12:49:10.974 9475 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:49:10 ctl02 nova-api[9475]: 2017-09-28 12:49:10.974 9475 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:49:10 ctl02 nova-api[9475]: 2017-09-28 12:49:10.974 9475 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:49:10 ctl02 nova-api[9475]: 2017-09-28 12:49:10.974 9475 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:49:10 ctl02 nova-api[9475]: 2017-09-28 12:49:10.974 9475 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:49:10 ctl02 nova-api[9475]: 2017-09-28 12:49:10.974 9475 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:49:10 ctl02 nova-api[9475]: 2017-09-28 12:49:10.974 9475 ERROR nova.wsgi     self.filename))
Sep 28 12:49:10 ctl02 nova-api[9475]: 2017-09-28 12:49:10.974 9475 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:49:10 ctl02 nova-api[9475]: 2017-09-28 12:49:10.974 9475 ERROR nova.wsgi
Sep 28 12:49:10 ctl02 nova-api[9475]: 2017-09-28 12:49:10.975 9475 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:49:11 ctl02 nova-conductor[5056]: 2017-09-28 12:49:11.037 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:49:11 ctl02 nova-cert[4860]: 2017-09-28 12:49:11.064 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:49:11 ctl02 nova-conductor[5056]: 2017-09-28 12:49:11.067 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:49:11 ctl02 nova-conductor[5056]: 2017-09-28 12:49:11.089 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:49:11 ctl02 nova-conductor[5056]: 2017-09-28 12:49:11.089 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:49:11 ctl02 nova-api[9475]: 2017-09-28 12:49:11.108 9475 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:49:11 ctl02 neutron-server[30536]: 2017-09-28 12:49:11.115 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:49:11] "OPTIONS / HTTP/1.0" 200 262 0.000562
Sep 28 12:49:11 ctl02 glance-api[29183]: 2017-09-28 12:49:11.183 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:49:11] "OPTIONS / HTTP/1.0" 200 134 0.000536
Sep 28 12:49:11 ctl02 heat-api-cfn[13300]: 2017-09-28 12:49:11.280 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:49:11] "OPTIONS / HTTP/1.0" 200 134 0.000525
Sep 28 12:49:11 ctl02 nova-api[9475]: 2017-09-28 12:49:11.335 9475 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:49:11 ctl02 nova-api[9475]: 2017-09-28 12:49:11.337 9475 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:49:11 ctl02 nova-api[9475]: 2017-09-28 12:49:11.337 9475 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:49:11 ctl02 nova-api[9475]: 2017-09-28 12:49:11.337 9475 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:49:11 ctl02 nova-api[9475]: 2017-09-28 12:49:11.469 9475 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:49:11 ctl02 nova-api[9475]: 2017-09-28 12:49:11.470 9475 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:49:11 ctl02 nova-api[9475]: 2017-09-28 12:49:11.471 9475 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:49:11 ctl02 nova-api[9475]: 2017-09-28 12:49:11.471 9475 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:49:11 ctl02 nova-api[9475]: 2017-09-28 12:49:11.474 9475 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:49:11 ctl02 nova-api[9475]: 2017-09-28 12:49:11.474 9475 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:49:11 ctl02 nova-api[9475]: 2017-09-28 12:49:11.474 9475 ERROR nova Traceback (most recent call last):
Sep 28 12:49:11 ctl02 nova-api[9475]: 2017-09-28 12:49:11.474 9475 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:49:11 ctl02 nova-api[9475]: 2017-09-28 12:49:11.474 9475 ERROR nova     sys.exit(main())
Sep 28 12:49:11 ctl02 nova-api[9475]: 2017-09-28 12:49:11.474 9475 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:49:11 ctl02 nova-api[9475]: 2017-09-28 12:49:11.474 9475 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:49:11 ctl02 nova-api[9475]: 2017-09-28 12:49:11.474 9475 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:49:11 ctl02 nova-api[9475]: 2017-09-28 12:49:11.474 9475 ERROR nova     max_url_len=max_url_len)
Sep 28 12:49:11 ctl02 nova-api[9475]: 2017-09-28 12:49:11.474 9475 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:49:11 ctl02 nova-api[9475]: 2017-09-28 12:49:11.474 9475 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:49:11 ctl02 nova-api[9475]: 2017-09-28 12:49:11.474 9475 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:49:11 ctl02 nova-api[9475]: 2017-09-28 12:49:11.474 9475 ERROR nova     sock.listen(backlog)
Sep 28 12:49:11 ctl02 nova-api[9475]: 2017-09-28 12:49:11.474 9475 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:49:11 ctl02 nova-api[9475]: 2017-09-28 12:49:11.474 9475 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:49:11 ctl02 nova-api[9475]: 2017-09-28 12:49:11.474 9475 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:49:11 ctl02 nova-api[9475]: 2017-09-28 12:49:11.474 9475 ERROR nova
Sep 28 12:49:11 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:49:11 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:49:11 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:49:11 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:49:11 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:49:11 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:49:11 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:49:12 ctl02 neutron-server[30536]: 2017-09-28 12:49:12.854 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:49:12] "OPTIONS / HTTP/1.0" 200 262 0.000497
Sep 28 12:49:13 ctl02 neutron-server[30536]: 2017-09-28 12:49:13.515 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:49:13 ctl02 nova-api[9498]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:49:13 ctl02 nova-api[9498]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:49:13 ctl02 nova-api[9498]: 2017-09-28 12:49:13.769 9498 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:49:13 ctl02 nova-api[9498]: 2017-09-28 12:49:13.770 9498 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:49:13 ctl02 nova-api[9498]: 2017-09-28 12:49:13.770 9498 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:49:13 ctl02 nova-api[9498]: 2017-09-28 12:49:13.770 9498 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:49:13 ctl02 nova-api[9498]: 2017-09-28 12:49:13.770 9498 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:49:13 ctl02 nova-api[9498]: 2017-09-28 12:49:13.770 9498 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:49:13 ctl02 nova-api[9498]: 2017-09-28 12:49:13.770 9498 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:49:13 ctl02 nova-api[9498]: 2017-09-28 12:49:13.770 9498 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:49:13 ctl02 nova-api[9498]: 2017-09-28 12:49:13.770 9498 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:49:13 ctl02 nova-api[9498]: 2017-09-28 12:49:13.770 9498 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:49:13 ctl02 nova-api[9498]: 2017-09-28 12:49:13.770 9498 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:49:13 ctl02 nova-api[9498]: 2017-09-28 12:49:13.770 9498 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:49:13 ctl02 nova-api[9498]: 2017-09-28 12:49:13.770 9498 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:49:13 ctl02 nova-api[9498]: 2017-09-28 12:49:13.770 9498 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:49:13 ctl02 nova-api[9498]: 2017-09-28 12:49:13.770 9498 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:49:13 ctl02 nova-api[9498]: 2017-09-28 12:49:13.770 9498 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:49:13 ctl02 nova-api[9498]: 2017-09-28 12:49:13.770 9498 ERROR nova.wsgi     self.filename))
Sep 28 12:49:13 ctl02 nova-api[9498]: 2017-09-28 12:49:13.770 9498 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:49:13 ctl02 nova-api[9498]: 2017-09-28 12:49:13.770 9498 ERROR nova.wsgi
Sep 28 12:49:13 ctl02 nova-api[9498]: 2017-09-28 12:49:13.771 9498 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:49:13 ctl02 nova-api[9498]: 2017-09-28 12:49:13.904 9498 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:49:13 ctl02 heat-api[13008]: 2017-09-28 12:49:13.906 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:49:13] "OPTIONS / HTTP/1.0" 200 134 0.000555
Sep 28 12:49:14 ctl02 nova-api[9498]: 2017-09-28 12:49:14.137 9498 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:49:14 ctl02 nova-api[9498]: 2017-09-28 12:49:14.139 9498 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:49:14 ctl02 nova-api[9498]: 2017-09-28 12:49:14.139 9498 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:49:14 ctl02 nova-api[9498]: 2017-09-28 12:49:14.140 9498 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:49:14 ctl02 nova-api[9498]: 2017-09-28 12:49:14.271 9498 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:49:14 ctl02 nova-api[9498]: 2017-09-28 12:49:14.273 9498 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:49:14 ctl02 nova-api[9498]: 2017-09-28 12:49:14.273 9498 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:49:14 ctl02 nova-api[9498]: 2017-09-28 12:49:14.273 9498 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:49:14 ctl02 nova-api[9498]: 2017-09-28 12:49:14.277 9498 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:49:14 ctl02 nova-api[9498]: 2017-09-28 12:49:14.277 9498 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:49:14 ctl02 nova-api[9498]: 2017-09-28 12:49:14.277 9498 ERROR nova Traceback (most recent call last):
Sep 28 12:49:14 ctl02 nova-api[9498]: 2017-09-28 12:49:14.277 9498 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:49:14 ctl02 nova-api[9498]: 2017-09-28 12:49:14.277 9498 ERROR nova     sys.exit(main())
Sep 28 12:49:14 ctl02 nova-api[9498]: 2017-09-28 12:49:14.277 9498 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:49:14 ctl02 nova-api[9498]: 2017-09-28 12:49:14.277 9498 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:49:14 ctl02 nova-api[9498]: 2017-09-28 12:49:14.277 9498 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:49:14 ctl02 nova-api[9498]: 2017-09-28 12:49:14.277 9498 ERROR nova     max_url_len=max_url_len)
Sep 28 12:49:14 ctl02 nova-api[9498]: 2017-09-28 12:49:14.277 9498 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:49:14 ctl02 nova-api[9498]: 2017-09-28 12:49:14.277 9498 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:49:14 ctl02 nova-api[9498]: 2017-09-28 12:49:14.277 9498 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:49:14 ctl02 nova-api[9498]: 2017-09-28 12:49:14.277 9498 ERROR nova     sock.listen(backlog)
Sep 28 12:49:14 ctl02 nova-api[9498]: 2017-09-28 12:49:14.277 9498 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:49:14 ctl02 nova-api[9498]: 2017-09-28 12:49:14.277 9498 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:49:14 ctl02 nova-api[9498]: 2017-09-28 12:49:14.277 9498 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:49:14 ctl02 nova-api[9498]: 2017-09-28 12:49:14.277 9498 ERROR nova
Sep 28 12:49:14 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:49:14 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:49:14 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:49:14 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:49:14 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:49:14 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:49:14 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:49:15 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:49:15.967 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:49:15] "OPTIONS / HTTP/1.0" 200 134 0.000358
Sep 28 12:49:16 ctl02 nova-api[9516]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:49:16 ctl02 nova-api[9516]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:49:16 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:49:16.379 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:49:16] "OPTIONS / HTTP/1.0" 200 134 0.000384
Sep 28 12:49:16 ctl02 nova-api[9516]: 2017-09-28 12:49:16.489 9516 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:49:16 ctl02 nova-api[9516]: 2017-09-28 12:49:16.490 9516 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:49:16 ctl02 nova-api[9516]: 2017-09-28 12:49:16.490 9516 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:49:16 ctl02 nova-api[9516]: 2017-09-28 12:49:16.490 9516 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:49:16 ctl02 nova-api[9516]: 2017-09-28 12:49:16.490 9516 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:49:16 ctl02 nova-api[9516]: 2017-09-28 12:49:16.490 9516 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:49:16 ctl02 nova-api[9516]: 2017-09-28 12:49:16.490 9516 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:49:16 ctl02 nova-api[9516]: 2017-09-28 12:49:16.490 9516 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:49:16 ctl02 nova-api[9516]: 2017-09-28 12:49:16.490 9516 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:49:16 ctl02 nova-api[9516]: 2017-09-28 12:49:16.490 9516 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:49:16 ctl02 nova-api[9516]: 2017-09-28 12:49:16.490 9516 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:49:16 ctl02 nova-api[9516]: 2017-09-28 12:49:16.490 9516 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:49:16 ctl02 nova-api[9516]: 2017-09-28 12:49:16.490 9516 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:49:16 ctl02 nova-api[9516]: 2017-09-28 12:49:16.490 9516 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:49:16 ctl02 nova-api[9516]: 2017-09-28 12:49:16.490 9516 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:49:16 ctl02 nova-api[9516]: 2017-09-28 12:49:16.490 9516 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:49:16 ctl02 nova-api[9516]: 2017-09-28 12:49:16.490 9516 ERROR nova.wsgi     self.filename))
Sep 28 12:49:16 ctl02 nova-api[9516]: 2017-09-28 12:49:16.490 9516 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:49:16 ctl02 nova-api[9516]: 2017-09-28 12:49:16.490 9516 ERROR nova.wsgi
Sep 28 12:49:16 ctl02 nova-api[9516]: 2017-09-28 12:49:16.491 9516 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:49:16 ctl02 nova-api[9516]: 2017-09-28 12:49:16.615 9516 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:49:16 ctl02 nova-api[9516]: 2017-09-28 12:49:16.832 9516 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:49:16 ctl02 nova-api[9516]: 2017-09-28 12:49:16.834 9516 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:49:16 ctl02 nova-api[9516]: 2017-09-28 12:49:16.834 9516 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:49:16 ctl02 nova-api[9516]: 2017-09-28 12:49:16.834 9516 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:49:16 ctl02 nova-api[9516]: 2017-09-28 12:49:16.963 9516 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:49:16 ctl02 nova-api[9516]: 2017-09-28 12:49:16.965 9516 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:49:16 ctl02 nova-api[9516]: 2017-09-28 12:49:16.965 9516 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:49:16 ctl02 nova-api[9516]: 2017-09-28 12:49:16.965 9516 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:49:16 ctl02 nova-api[9516]: 2017-09-28 12:49:16.968 9516 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:49:16 ctl02 nova-api[9516]: 2017-09-28 12:49:16.968 9516 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:49:16 ctl02 nova-api[9516]: 2017-09-28 12:49:16.968 9516 ERROR nova Traceback (most recent call last):
Sep 28 12:49:16 ctl02 nova-api[9516]: 2017-09-28 12:49:16.968 9516 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:49:16 ctl02 nova-api[9516]: 2017-09-28 12:49:16.968 9516 ERROR nova     sys.exit(main())
Sep 28 12:49:16 ctl02 nova-api[9516]: 2017-09-28 12:49:16.968 9516 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:49:16 ctl02 nova-api[9516]: 2017-09-28 12:49:16.968 9516 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:49:16 ctl02 nova-api[9516]: 2017-09-28 12:49:16.968 9516 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:49:16 ctl02 nova-api[9516]: 2017-09-28 12:49:16.968 9516 ERROR nova     max_url_len=max_url_len)
Sep 28 12:49:16 ctl02 nova-api[9516]: 2017-09-28 12:49:16.968 9516 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:49:16 ctl02 nova-api[9516]: 2017-09-28 12:49:16.968 9516 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:49:16 ctl02 nova-api[9516]: 2017-09-28 12:49:16.968 9516 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:49:16 ctl02 nova-api[9516]: 2017-09-28 12:49:16.968 9516 ERROR nova     sock.listen(backlog)
Sep 28 12:49:16 ctl02 nova-api[9516]: 2017-09-28 12:49:16.968 9516 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:49:16 ctl02 nova-api[9516]: 2017-09-28 12:49:16.968 9516 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:49:16 ctl02 nova-api[9516]: 2017-09-28 12:49:16.968 9516 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:49:16 ctl02 nova-api[9516]: 2017-09-28 12:49:16.968 9516 ERROR nova
Sep 28 12:49:16 ctl02 heat-api-cfn[13300]: 2017-09-28 12:49:16.977 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:49:16] "OPTIONS / HTTP/1.0" 200 134 0.000435
Sep 28 12:49:17 ctl02 heat-api-cfn[13300]: 2017-09-28 12:49:17.018 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:49:17] "OPTIONS / HTTP/1.0" 200 134 0.000432
Sep 28 12:49:17 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:49:17 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:49:17 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:49:17 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:49:17 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:49:17 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:49:17 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:49:18 ctl02 heat-api[13008]: 2017-09-28 12:49:18.562 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:49:18] "OPTIONS / HTTP/1.0" 200 134 0.000533
Sep 28 12:49:19 ctl02 nova-api[9534]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:49:19 ctl02 nova-api[9534]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:49:19 ctl02 nova-api[9534]: 2017-09-28 12:49:19.232 9534 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:49:19 ctl02 nova-api[9534]: 2017-09-28 12:49:19.233 9534 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:49:19 ctl02 nova-api[9534]: 2017-09-28 12:49:19.233 9534 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:49:19 ctl02 nova-api[9534]: 2017-09-28 12:49:19.233 9534 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:49:19 ctl02 nova-api[9534]: 2017-09-28 12:49:19.233 9534 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:49:19 ctl02 nova-api[9534]: 2017-09-28 12:49:19.233 9534 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:49:19 ctl02 nova-api[9534]: 2017-09-28 12:49:19.233 9534 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:49:19 ctl02 nova-api[9534]: 2017-09-28 12:49:19.233 9534 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:49:19 ctl02 nova-api[9534]: 2017-09-28 12:49:19.233 9534 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:49:19 ctl02 nova-api[9534]: 2017-09-28 12:49:19.233 9534 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:49:19 ctl02 nova-api[9534]: 2017-09-28 12:49:19.233 9534 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:49:19 ctl02 nova-api[9534]: 2017-09-28 12:49:19.233 9534 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:49:19 ctl02 nova-api[9534]: 2017-09-28 12:49:19.233 9534 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:49:19 ctl02 nova-api[9534]: 2017-09-28 12:49:19.233 9534 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:49:19 ctl02 nova-api[9534]: 2017-09-28 12:49:19.233 9534 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:49:19 ctl02 nova-api[9534]: 2017-09-28 12:49:19.233 9534 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:49:19 ctl02 nova-api[9534]: 2017-09-28 12:49:19.233 9534 ERROR nova.wsgi     self.filename))
Sep 28 12:49:19 ctl02 nova-api[9534]: 2017-09-28 12:49:19.233 9534 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:49:19 ctl02 nova-api[9534]: 2017-09-28 12:49:19.233 9534 ERROR nova.wsgi
Sep 28 12:49:19 ctl02 nova-api[9534]: 2017-09-28 12:49:19.234 9534 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:49:19 ctl02 nova-api[9534]: 2017-09-28 12:49:19.361 9534 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:49:19 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:49:19.446 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:49:19] "OPTIONS / HTTP/1.0" 200 134 0.000347
Sep 28 12:49:19 ctl02 heat-api[13008]: 2017-09-28 12:49:19.469 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:49:19] "OPTIONS / HTTP/1.0" 200 134 0.000513
Sep 28 12:49:19 ctl02 glance-api[29183]: 2017-09-28 12:49:19.510 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:49:19] "OPTIONS / HTTP/1.0" 200 134 0.000561
Sep 28 12:49:19 ctl02 nova-api[9534]: 2017-09-28 12:49:19.588 9534 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:49:19 ctl02 nova-api[9534]: 2017-09-28 12:49:19.590 9534 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:49:19 ctl02 nova-api[9534]: 2017-09-28 12:49:19.590 9534 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:49:19 ctl02 nova-api[9534]: 2017-09-28 12:49:19.591 9534 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:49:19 ctl02 nova-api[9534]: 2017-09-28 12:49:19.721 9534 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:49:19 ctl02 nova-api[9534]: 2017-09-28 12:49:19.723 9534 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:49:19 ctl02 nova-api[9534]: 2017-09-28 12:49:19.723 9534 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:49:19 ctl02 nova-api[9534]: 2017-09-28 12:49:19.724 9534 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:49:19 ctl02 nova-api[9534]: 2017-09-28 12:49:19.727 9534 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:49:19 ctl02 nova-api[9534]: 2017-09-28 12:49:19.727 9534 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:49:19 ctl02 nova-api[9534]: 2017-09-28 12:49:19.727 9534 ERROR nova Traceback (most recent call last):
Sep 28 12:49:19 ctl02 nova-api[9534]: 2017-09-28 12:49:19.727 9534 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:49:19 ctl02 nova-api[9534]: 2017-09-28 12:49:19.727 9534 ERROR nova     sys.exit(main())
Sep 28 12:49:19 ctl02 nova-api[9534]: 2017-09-28 12:49:19.727 9534 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:49:19 ctl02 nova-api[9534]: 2017-09-28 12:49:19.727 9534 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:49:19 ctl02 nova-api[9534]: 2017-09-28 12:49:19.727 9534 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:49:19 ctl02 nova-api[9534]: 2017-09-28 12:49:19.727 9534 ERROR nova     max_url_len=max_url_len)
Sep 28 12:49:19 ctl02 nova-api[9534]: 2017-09-28 12:49:19.727 9534 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:49:19 ctl02 nova-api[9534]: 2017-09-28 12:49:19.727 9534 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:49:19 ctl02 nova-api[9534]: 2017-09-28 12:49:19.727 9534 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:49:19 ctl02 nova-api[9534]: 2017-09-28 12:49:19.727 9534 ERROR nova     sock.listen(backlog)
Sep 28 12:49:19 ctl02 nova-api[9534]: 2017-09-28 12:49:19.727 9534 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:49:19 ctl02 nova-api[9534]: 2017-09-28 12:49:19.727 9534 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:49:19 ctl02 nova-api[9534]: 2017-09-28 12:49:19.727 9534 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:49:19 ctl02 nova-api[9534]: 2017-09-28 12:49:19.727 9534 ERROR nova
Sep 28 12:49:19 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:49:19 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:49:19 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:49:20 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:49:20 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:49:20 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:49:20 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:49:20 ctl02 glance-api[29183]: 2017-09-28 12:49:20.723 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:49:20] "OPTIONS / HTTP/1.0" 200 134 0.000553
Sep 28 12:49:20 ctl02 neutron-server[30536]: 2017-09-28 12:49:20.739 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:49:20] "OPTIONS / HTTP/1.0" 200 262 0.000498
Sep 28 12:49:20 ctl02 neutron-server[30536]: 2017-09-28 12:49:20.828 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:49:20] "OPTIONS / HTTP/1.0" 200 262 0.000525
Sep 28 12:49:20 ctl02 nova-consoleauth[5433]: 2017-09-28 12:49:20.907 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:49:21 ctl02 neutron-server[30536]: 2017-09-28 12:49:21.206 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 2 dead agents out of 6:
Sep 28 12:49:21 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:49:21 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:47:28 cmp001
Sep 28 12:49:21 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:48:16 cmp002
Sep 28 12:49:21 ctl02 heat-api-cfn[13300]: 2017-09-28 12:49:21.302 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:49:21] "OPTIONS / HTTP/1.0" 200 134 0.000458
Sep 28 12:49:21 ctl02 glance-api[29183]: 2017-09-28 12:49:21.313 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:49:21] "OPTIONS / HTTP/1.0" 200 134 0.000575
Sep 28 12:49:21 ctl02 nova-api[9552]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:49:21 ctl02 nova-api[9552]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:49:22 ctl02 nova-api[9552]: 2017-09-28 12:49:22.007 9552 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:49:22 ctl02 nova-api[9552]: 2017-09-28 12:49:22.008 9552 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:49:22 ctl02 nova-api[9552]: 2017-09-28 12:49:22.008 9552 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:49:22 ctl02 nova-api[9552]: 2017-09-28 12:49:22.008 9552 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:49:22 ctl02 nova-api[9552]: 2017-09-28 12:49:22.008 9552 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:49:22 ctl02 nova-api[9552]: 2017-09-28 12:49:22.008 9552 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:49:22 ctl02 nova-api[9552]: 2017-09-28 12:49:22.008 9552 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:49:22 ctl02 nova-api[9552]: 2017-09-28 12:49:22.008 9552 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:49:22 ctl02 nova-api[9552]: 2017-09-28 12:49:22.008 9552 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:49:22 ctl02 nova-api[9552]: 2017-09-28 12:49:22.008 9552 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:49:22 ctl02 nova-api[9552]: 2017-09-28 12:49:22.008 9552 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:49:22 ctl02 nova-api[9552]: 2017-09-28 12:49:22.008 9552 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:49:22 ctl02 nova-api[9552]: 2017-09-28 12:49:22.008 9552 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:49:22 ctl02 nova-api[9552]: 2017-09-28 12:49:22.008 9552 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:49:22 ctl02 nova-api[9552]: 2017-09-28 12:49:22.008 9552 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:49:22 ctl02 nova-api[9552]: 2017-09-28 12:49:22.008 9552 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:49:22 ctl02 nova-api[9552]: 2017-09-28 12:49:22.008 9552 ERROR nova.wsgi     self.filename))
Sep 28 12:49:22 ctl02 nova-api[9552]: 2017-09-28 12:49:22.008 9552 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:49:22 ctl02 nova-api[9552]: 2017-09-28 12:49:22.008 9552 ERROR nova.wsgi
Sep 28 12:49:22 ctl02 nova-api[9552]: 2017-09-28 12:49:22.009 9552 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:49:22 ctl02 nova-api[9552]: 2017-09-28 12:49:22.136 9552 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:49:22 ctl02 heat-engine[12803]: 2017-09-28 12:49:22.196 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:49:22 ctl02 heat-engine[12803]: 2017-09-28 12:49:22.197 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:49:22 ctl02 heat-engine[12803]: 2017-09-28 12:49:22.203 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:49:22 ctl02 heat-engine[12803]: 2017-09-28 12:49:22.208 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:49:22 ctl02 nova-api[9552]: 2017-09-28 12:49:22.372 9552 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:49:22 ctl02 nova-api[9552]: 2017-09-28 12:49:22.375 9552 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:49:22 ctl02 nova-api[9552]: 2017-09-28 12:49:22.375 9552 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:49:22 ctl02 nova-api[9552]: 2017-09-28 12:49:22.375 9552 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:49:22 ctl02 nova-api[9552]: 2017-09-28 12:49:22.510 9552 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:49:22 ctl02 nova-api[9552]: 2017-09-28 12:49:22.512 9552 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:49:22 ctl02 nova-api[9552]: 2017-09-28 12:49:22.512 9552 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:49:22 ctl02 nova-api[9552]: 2017-09-28 12:49:22.513 9552 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:49:22 ctl02 nova-api[9552]: 2017-09-28 12:49:22.516 9552 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:49:22 ctl02 nova-api[9552]: 2017-09-28 12:49:22.516 9552 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:49:22 ctl02 nova-api[9552]: 2017-09-28 12:49:22.516 9552 ERROR nova Traceback (most recent call last):
Sep 28 12:49:22 ctl02 nova-api[9552]: 2017-09-28 12:49:22.516 9552 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:49:22 ctl02 nova-api[9552]: 2017-09-28 12:49:22.516 9552 ERROR nova     sys.exit(main())
Sep 28 12:49:22 ctl02 nova-api[9552]: 2017-09-28 12:49:22.516 9552 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:49:22 ctl02 nova-api[9552]: 2017-09-28 12:49:22.516 9552 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:49:22 ctl02 nova-api[9552]: 2017-09-28 12:49:22.516 9552 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:49:22 ctl02 nova-api[9552]: 2017-09-28 12:49:22.516 9552 ERROR nova     max_url_len=max_url_len)
Sep 28 12:49:22 ctl02 nova-api[9552]: 2017-09-28 12:49:22.516 9552 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:49:22 ctl02 nova-api[9552]: 2017-09-28 12:49:22.516 9552 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:49:22 ctl02 nova-api[9552]: 2017-09-28 12:49:22.516 9552 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:49:22 ctl02 nova-api[9552]: 2017-09-28 12:49:22.516 9552 ERROR nova     sock.listen(backlog)
Sep 28 12:49:22 ctl02 nova-api[9552]: 2017-09-28 12:49:22.516 9552 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:49:22 ctl02 nova-api[9552]: 2017-09-28 12:49:22.516 9552 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:49:22 ctl02 nova-api[9552]: 2017-09-28 12:49:22.516 9552 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:49:22 ctl02 nova-api[9552]: 2017-09-28 12:49:22.516 9552 ERROR nova
Sep 28 12:49:22 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:49:22 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:49:22 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:49:22 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:49:22 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:49:22 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:49:22 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:49:23 ctl02 neutron-server[30536]: 2017-09-28 12:49:23.120 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:49:23] "OPTIONS / HTTP/1.0" 200 262 0.000526
Sep 28 12:49:24 ctl02 nova-scheduler[5620]: 2017-09-28 12:49:24.011 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:49:24 ctl02 heat-api[13008]: 2017-09-28 12:49:24.287 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:49:24] "OPTIONS / HTTP/1.0" 200 134 0.000544
Sep 28 12:49:24 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9b571211)
Sep 28 12:49:24 ctl02 nova-api[9570]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:49:24 ctl02 nova-api[9570]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:49:24 ctl02 nova-api[9570]: 2017-09-28 12:49:24.770 9570 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:49:24 ctl02 nova-api[9570]: 2017-09-28 12:49:24.771 9570 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:49:24 ctl02 nova-api[9570]: 2017-09-28 12:49:24.771 9570 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:49:24 ctl02 nova-api[9570]: 2017-09-28 12:49:24.771 9570 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:49:24 ctl02 nova-api[9570]: 2017-09-28 12:49:24.771 9570 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:49:24 ctl02 nova-api[9570]: 2017-09-28 12:49:24.771 9570 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:49:24 ctl02 nova-api[9570]: 2017-09-28 12:49:24.771 9570 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:49:24 ctl02 nova-api[9570]: 2017-09-28 12:49:24.771 9570 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:49:24 ctl02 nova-api[9570]: 2017-09-28 12:49:24.771 9570 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:49:24 ctl02 nova-api[9570]: 2017-09-28 12:49:24.771 9570 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:49:24 ctl02 nova-api[9570]: 2017-09-28 12:49:24.771 9570 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:49:24 ctl02 nova-api[9570]: 2017-09-28 12:49:24.771 9570 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:49:24 ctl02 nova-api[9570]: 2017-09-28 12:49:24.771 9570 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:49:24 ctl02 nova-api[9570]: 2017-09-28 12:49:24.771 9570 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:49:24 ctl02 nova-api[9570]: 2017-09-28 12:49:24.771 9570 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:49:24 ctl02 nova-api[9570]: 2017-09-28 12:49:24.771 9570 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:49:24 ctl02 nova-api[9570]: 2017-09-28 12:49:24.771 9570 ERROR nova.wsgi     self.filename))
Sep 28 12:49:24 ctl02 nova-api[9570]: 2017-09-28 12:49:24.771 9570 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:49:24 ctl02 nova-api[9570]: 2017-09-28 12:49:24.771 9570 ERROR nova.wsgi
Sep 28 12:49:24 ctl02 nova-api[9570]: 2017-09-28 12:49:24.772 9570 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:49:24 ctl02 nova-api[9570]: 2017-09-28 12:49:24.900 9570 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:49:25 ctl02 nova-api[9570]: 2017-09-28 12:49:25.134 9570 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:49:25 ctl02 nova-api[9570]: 2017-09-28 12:49:25.136 9570 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:49:25 ctl02 nova-api[9570]: 2017-09-28 12:49:25.137 9570 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:49:25 ctl02 nova-api[9570]: 2017-09-28 12:49:25.137 9570 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:49:25 ctl02 nova-api[9570]: 2017-09-28 12:49:25.273 9570 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:49:25 ctl02 nova-api[9570]: 2017-09-28 12:49:25.275 9570 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:49:25 ctl02 nova-api[9570]: 2017-09-28 12:49:25.275 9570 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:49:25 ctl02 nova-api[9570]: 2017-09-28 12:49:25.275 9570 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:49:25 ctl02 nova-api[9570]: 2017-09-28 12:49:25.278 9570 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:49:25 ctl02 nova-api[9570]: 2017-09-28 12:49:25.279 9570 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:49:25 ctl02 nova-api[9570]: 2017-09-28 12:49:25.279 9570 ERROR nova Traceback (most recent call last):
Sep 28 12:49:25 ctl02 nova-api[9570]: 2017-09-28 12:49:25.279 9570 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:49:25 ctl02 nova-api[9570]: 2017-09-28 12:49:25.279 9570 ERROR nova     sys.exit(main())
Sep 28 12:49:25 ctl02 nova-api[9570]: 2017-09-28 12:49:25.279 9570 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:49:25 ctl02 nova-api[9570]: 2017-09-28 12:49:25.279 9570 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:49:25 ctl02 nova-api[9570]: 2017-09-28 12:49:25.279 9570 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:49:25 ctl02 nova-api[9570]: 2017-09-28 12:49:25.279 9570 ERROR nova     max_url_len=max_url_len)
Sep 28 12:49:25 ctl02 nova-api[9570]: 2017-09-28 12:49:25.279 9570 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:49:25 ctl02 nova-api[9570]: 2017-09-28 12:49:25.279 9570 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:49:25 ctl02 nova-api[9570]: 2017-09-28 12:49:25.279 9570 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:49:25 ctl02 nova-api[9570]: 2017-09-28 12:49:25.279 9570 ERROR nova     sock.listen(backlog)
Sep 28 12:49:25 ctl02 nova-api[9570]: 2017-09-28 12:49:25.279 9570 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:49:25 ctl02 nova-api[9570]: 2017-09-28 12:49:25.279 9570 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:49:25 ctl02 nova-api[9570]: 2017-09-28 12:49:25.279 9570 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:49:25 ctl02 nova-api[9570]: 2017-09-28 12:49:25.279 9570 ERROR nova
Sep 28 12:49:25 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:49:25 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:49:25 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:49:25 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9b571211)
Sep 28 12:49:25 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:49:25 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:49:25 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:49:25 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:49:26 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:49:26.002 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:49:26] "OPTIONS / HTTP/1.0" 200 134 0.000447
Sep 28 12:49:26 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:49:26.151 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:49:26] "OPTIONS / HTTP/1.0" 200 134 0.000437
Sep 28 12:49:26 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9b571211)
Sep 28 12:49:27 ctl02 heat-api-cfn[13300]: 2017-09-28 12:49:27.014 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:49:27] "OPTIONS / HTTP/1.0" 200 134 0.000514
Sep 28 12:49:27 ctl02 heat-api-cfn[13300]: 2017-09-28 12:49:27.289 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:49:27] "OPTIONS / HTTP/1.0" 200 134 0.000473
Sep 28 12:49:27 ctl02 nova-api[9587]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:49:27 ctl02 nova-api[9587]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:49:27 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9b571211)
Sep 28 12:49:27 ctl02 nova-api[9587]: 2017-09-28 12:49:27.537 9587 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:49:27 ctl02 nova-api[9587]: 2017-09-28 12:49:27.539 9587 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:49:27 ctl02 nova-api[9587]: 2017-09-28 12:49:27.539 9587 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:49:27 ctl02 nova-api[9587]: 2017-09-28 12:49:27.539 9587 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:49:27 ctl02 nova-api[9587]: 2017-09-28 12:49:27.539 9587 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:49:27 ctl02 nova-api[9587]: 2017-09-28 12:49:27.539 9587 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:49:27 ctl02 nova-api[9587]: 2017-09-28 12:49:27.539 9587 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:49:27 ctl02 nova-api[9587]: 2017-09-28 12:49:27.539 9587 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:49:27 ctl02 nova-api[9587]: 2017-09-28 12:49:27.539 9587 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:49:27 ctl02 nova-api[9587]: 2017-09-28 12:49:27.539 9587 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:49:27 ctl02 nova-api[9587]: 2017-09-28 12:49:27.539 9587 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:49:27 ctl02 nova-api[9587]: 2017-09-28 12:49:27.539 9587 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:49:27 ctl02 nova-api[9587]: 2017-09-28 12:49:27.539 9587 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:49:27 ctl02 nova-api[9587]: 2017-09-28 12:49:27.539 9587 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:49:27 ctl02 nova-api[9587]: 2017-09-28 12:49:27.539 9587 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:49:27 ctl02 nova-api[9587]: 2017-09-28 12:49:27.539 9587 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:49:27 ctl02 nova-api[9587]: 2017-09-28 12:49:27.539 9587 ERROR nova.wsgi     self.filename))
Sep 28 12:49:27 ctl02 nova-api[9587]: 2017-09-28 12:49:27.539 9587 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:49:27 ctl02 nova-api[9587]: 2017-09-28 12:49:27.539 9587 ERROR nova.wsgi
Sep 28 12:49:27 ctl02 nova-api[9587]: 2017-09-28 12:49:27.541 9587 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:49:27 ctl02 nova-api[9587]: 2017-09-28 12:49:27.680 9587 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:49:27 ctl02 nova-api[9587]: 2017-09-28 12:49:27.935 9587 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:49:27 ctl02 nova-api[9587]: 2017-09-28 12:49:27.937 9587 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:49:27 ctl02 nova-api[9587]: 2017-09-28 12:49:27.937 9587 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:49:27 ctl02 nova-api[9587]: 2017-09-28 12:49:27.938 9587 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:49:28 ctl02 nova-api[9587]: 2017-09-28 12:49:28.073 9587 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:49:28 ctl02 nova-api[9587]: 2017-09-28 12:49:28.075 9587 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:49:28 ctl02 nova-api[9587]: 2017-09-28 12:49:28.075 9587 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:49:28 ctl02 nova-api[9587]: 2017-09-28 12:49:28.076 9587 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:49:28 ctl02 nova-api[9587]: 2017-09-28 12:49:28.079 9587 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:49:28 ctl02 nova-api[9587]: 2017-09-28 12:49:28.080 9587 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:49:28 ctl02 nova-api[9587]: 2017-09-28 12:49:28.080 9587 ERROR nova Traceback (most recent call last):
Sep 28 12:49:28 ctl02 nova-api[9587]: 2017-09-28 12:49:28.080 9587 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:49:28 ctl02 nova-api[9587]: 2017-09-28 12:49:28.080 9587 ERROR nova     sys.exit(main())
Sep 28 12:49:28 ctl02 nova-api[9587]: 2017-09-28 12:49:28.080 9587 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:49:28 ctl02 nova-api[9587]: 2017-09-28 12:49:28.080 9587 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:49:28 ctl02 nova-api[9587]: 2017-09-28 12:49:28.080 9587 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:49:28 ctl02 nova-api[9587]: 2017-09-28 12:49:28.080 9587 ERROR nova     max_url_len=max_url_len)
Sep 28 12:49:28 ctl02 nova-api[9587]: 2017-09-28 12:49:28.080 9587 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:49:28 ctl02 nova-api[9587]: 2017-09-28 12:49:28.080 9587 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:49:28 ctl02 nova-api[9587]: 2017-09-28 12:49:28.080 9587 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:49:28 ctl02 nova-api[9587]: 2017-09-28 12:49:28.080 9587 ERROR nova     sock.listen(backlog)
Sep 28 12:49:28 ctl02 nova-api[9587]: 2017-09-28 12:49:28.080 9587 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:49:28 ctl02 nova-api[9587]: 2017-09-28 12:49:28.080 9587 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:49:28 ctl02 nova-api[9587]: 2017-09-28 12:49:28.080 9587 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:49:28 ctl02 nova-api[9587]: 2017-09-28 12:49:28.080 9587 ERROR nova
Sep 28 12:49:28 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:49:28 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:49:28 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:49:28 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:49:28 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:49:28 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:49:28 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:49:28 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9b571211)
Sep 28 12:49:28 ctl02 heat-api[13008]: 2017-09-28 12:49:28.762 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:49:28] "OPTIONS / HTTP/1.0" 200 134 0.000586
Sep 28 12:49:29 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:49:29.331 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:49:29] "OPTIONS / HTTP/1.0" 200 134 0.000449
Sep 28 12:49:29 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9b571211)
Sep 28 12:49:29 ctl02 heat-api[13008]: 2017-09-28 12:49:29.817 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:49:29] "OPTIONS / HTTP/1.0" 200 134 0.000619
Sep 28 12:49:29 ctl02 glance-api[29183]: 2017-09-28 12:49:29.885 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:49:29] "OPTIONS / HTTP/1.0" 200 134 0.000632
Sep 28 12:49:30 ctl02 nova-api[9605]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:49:30 ctl02 nova-api[9605]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:49:30 ctl02 nova-api[9605]: 2017-09-28 12:49:30.286 9605 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:49:30 ctl02 nova-api[9605]: 2017-09-28 12:49:30.288 9605 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:49:30 ctl02 nova-api[9605]: 2017-09-28 12:49:30.288 9605 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:49:30 ctl02 nova-api[9605]: 2017-09-28 12:49:30.288 9605 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:49:30 ctl02 nova-api[9605]: 2017-09-28 12:49:30.288 9605 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:49:30 ctl02 nova-api[9605]: 2017-09-28 12:49:30.288 9605 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:49:30 ctl02 nova-api[9605]: 2017-09-28 12:49:30.288 9605 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:49:30 ctl02 nova-api[9605]: 2017-09-28 12:49:30.288 9605 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:49:30 ctl02 nova-api[9605]: 2017-09-28 12:49:30.288 9605 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:49:30 ctl02 nova-api[9605]: 2017-09-28 12:49:30.288 9605 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:49:30 ctl02 nova-api[9605]: 2017-09-28 12:49:30.288 9605 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:49:30 ctl02 nova-api[9605]: 2017-09-28 12:49:30.288 9605 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:49:30 ctl02 nova-api[9605]: 2017-09-28 12:49:30.288 9605 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:49:30 ctl02 nova-api[9605]: 2017-09-28 12:49:30.288 9605 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:49:30 ctl02 nova-api[9605]: 2017-09-28 12:49:30.288 9605 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:49:30 ctl02 nova-api[9605]: 2017-09-28 12:49:30.288 9605 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:49:30 ctl02 nova-api[9605]: 2017-09-28 12:49:30.288 9605 ERROR nova.wsgi     self.filename))
Sep 28 12:49:30 ctl02 nova-api[9605]: 2017-09-28 12:49:30.288 9605 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:49:30 ctl02 nova-api[9605]: 2017-09-28 12:49:30.288 9605 ERROR nova.wsgi
Sep 28 12:49:30 ctl02 nova-api[9605]: 2017-09-28 12:49:30.289 9605 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:49:30 ctl02 neutron-server[30536]: 2017-09-28 12:49:30.359 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:49:30] "OPTIONS / HTTP/1.0" 200 262 0.000602
Sep 28 12:49:30 ctl02 nova-api[9605]: 2017-09-28 12:49:30.423 9605 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:49:30 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9b571211)
Sep 28 12:49:30 ctl02 glance-api[29183]: 2017-09-28 12:49:30.447 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:49:30] "OPTIONS / HTTP/1.0" 200 134 0.000680
Sep 28 12:49:30 ctl02 nova-api[9605]: 2017-09-28 12:49:30.674 9605 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:49:30 ctl02 nova-api[9605]: 2017-09-28 12:49:30.677 9605 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:49:30 ctl02 nova-api[9605]: 2017-09-28 12:49:30.677 9605 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:49:30 ctl02 nova-api[9605]: 2017-09-28 12:49:30.677 9605 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:49:30 ctl02 nova-api[9605]: 2017-09-28 12:49:30.812 9605 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:49:30 ctl02 nova-api[9605]: 2017-09-28 12:49:30.815 9605 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:49:30 ctl02 nova-api[9605]: 2017-09-28 12:49:30.815 9605 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:49:30 ctl02 nova-api[9605]: 2017-09-28 12:49:30.816 9605 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:49:30 ctl02 nova-api[9605]: 2017-09-28 12:49:30.819 9605 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:49:30 ctl02 nova-api[9605]: 2017-09-28 12:49:30.820 9605 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:49:30 ctl02 nova-api[9605]: 2017-09-28 12:49:30.820 9605 ERROR nova Traceback (most recent call last):
Sep 28 12:49:30 ctl02 nova-api[9605]: 2017-09-28 12:49:30.820 9605 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:49:30 ctl02 nova-api[9605]: 2017-09-28 12:49:30.820 9605 ERROR nova     sys.exit(main())
Sep 28 12:49:30 ctl02 nova-api[9605]: 2017-09-28 12:49:30.820 9605 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:49:30 ctl02 nova-api[9605]: 2017-09-28 12:49:30.820 9605 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:49:30 ctl02 nova-api[9605]: 2017-09-28 12:49:30.820 9605 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:49:30 ctl02 nova-api[9605]: 2017-09-28 12:49:30.820 9605 ERROR nova     max_url_len=max_url_len)
Sep 28 12:49:30 ctl02 nova-api[9605]: 2017-09-28 12:49:30.820 9605 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:49:30 ctl02 nova-api[9605]: 2017-09-28 12:49:30.820 9605 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:49:30 ctl02 nova-api[9605]: 2017-09-28 12:49:30.820 9605 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:49:30 ctl02 nova-api[9605]: 2017-09-28 12:49:30.820 9605 ERROR nova     sock.listen(backlog)
Sep 28 12:49:30 ctl02 nova-api[9605]: 2017-09-28 12:49:30.820 9605 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:49:30 ctl02 nova-api[9605]: 2017-09-28 12:49:30.820 9605 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:49:30 ctl02 nova-api[9605]: 2017-09-28 12:49:30.820 9605 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:49:30 ctl02 nova-api[9605]: 2017-09-28 12:49:30.820 9605 ERROR nova
Sep 28 12:49:30 ctl02 neutron-server[30536]: 2017-09-28 12:49:30.837 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:49:30] "OPTIONS / HTTP/1.0" 200 262 0.000638
Sep 28 12:49:30 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:49:30 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:49:30 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:49:31 ctl02 glance-api[29183]: 2017-09-28 12:49:31.075 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:49:31] "OPTIONS / HTTP/1.0" 200 134 0.000805
Sep 28 12:49:31 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:49:31 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:49:31 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:49:31 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:49:31 ctl02 heat-api-cfn[13300]: 2017-09-28 12:49:31.163 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:49:31] "OPTIONS / HTTP/1.0" 200 134 0.000567
Sep 28 12:49:31 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9b571211)
Sep 28 12:49:32 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9b571211)
Sep 28 12:49:32 ctl02 neutron-server[30536]: 2017-09-28 12:49:32.783 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:49:32] "OPTIONS / HTTP/1.0" 200 262 0.000456
Sep 28 12:49:32 ctl02 nova-api[9624]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:49:32 ctl02 nova-api[9624]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:49:33 ctl02 nova-api[9624]: 2017-09-28 12:49:33.004 9624 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:49:33 ctl02 nova-api[9624]: 2017-09-28 12:49:33.005 9624 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:49:33 ctl02 nova-api[9624]: 2017-09-28 12:49:33.005 9624 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:49:33 ctl02 nova-api[9624]: 2017-09-28 12:49:33.005 9624 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:49:33 ctl02 nova-api[9624]: 2017-09-28 12:49:33.005 9624 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:49:33 ctl02 nova-api[9624]: 2017-09-28 12:49:33.005 9624 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:49:33 ctl02 nova-api[9624]: 2017-09-28 12:49:33.005 9624 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:49:33 ctl02 nova-api[9624]: 2017-09-28 12:49:33.005 9624 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:49:33 ctl02 nova-api[9624]: 2017-09-28 12:49:33.005 9624 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:49:33 ctl02 nova-api[9624]: 2017-09-28 12:49:33.005 9624 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:49:33 ctl02 nova-api[9624]: 2017-09-28 12:49:33.005 9624 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:49:33 ctl02 nova-api[9624]: 2017-09-28 12:49:33.005 9624 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:49:33 ctl02 nova-api[9624]: 2017-09-28 12:49:33.005 9624 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:49:33 ctl02 nova-api[9624]: 2017-09-28 12:49:33.005 9624 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:49:33 ctl02 nova-api[9624]: 2017-09-28 12:49:33.005 9624 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:49:33 ctl02 nova-api[9624]: 2017-09-28 12:49:33.005 9624 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:49:33 ctl02 nova-api[9624]: 2017-09-28 12:49:33.005 9624 ERROR nova.wsgi     self.filename))
Sep 28 12:49:33 ctl02 nova-api[9624]: 2017-09-28 12:49:33.005 9624 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:49:33 ctl02 nova-api[9624]: 2017-09-28 12:49:33.005 9624 ERROR nova.wsgi
Sep 28 12:49:33 ctl02 nova-api[9624]: 2017-09-28 12:49:33.006 9624 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:49:33 ctl02 nova-api[9624]: 2017-09-28 12:49:33.135 9624 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:49:33 ctl02 nova-api[9624]: 2017-09-28 12:49:33.358 9624 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:49:33 ctl02 nova-api[9624]: 2017-09-28 12:49:33.360 9624 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:49:33 ctl02 nova-api[9624]: 2017-09-28 12:49:33.360 9624 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:49:33 ctl02 nova-api[9624]: 2017-09-28 12:49:33.361 9624 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:49:33 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9b571211)
Sep 28 12:49:33 ctl02 nova-api[9624]: 2017-09-28 12:49:33.492 9624 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:49:33 ctl02 nova-api[9624]: 2017-09-28 12:49:33.494 9624 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:49:33 ctl02 nova-api[9624]: 2017-09-28 12:49:33.494 9624 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:49:33 ctl02 nova-api[9624]: 2017-09-28 12:49:33.494 9624 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:49:33 ctl02 nova-api[9624]: 2017-09-28 12:49:33.497 9624 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:49:33 ctl02 nova-api[9624]: 2017-09-28 12:49:33.497 9624 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:49:33 ctl02 nova-api[9624]: 2017-09-28 12:49:33.497 9624 ERROR nova Traceback (most recent call last):
Sep 28 12:49:33 ctl02 nova-api[9624]: 2017-09-28 12:49:33.497 9624 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:49:33 ctl02 nova-api[9624]: 2017-09-28 12:49:33.497 9624 ERROR nova     sys.exit(main())
Sep 28 12:49:33 ctl02 nova-api[9624]: 2017-09-28 12:49:33.497 9624 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:49:33 ctl02 nova-api[9624]: 2017-09-28 12:49:33.497 9624 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:49:33 ctl02 nova-api[9624]: 2017-09-28 12:49:33.497 9624 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:49:33 ctl02 nova-api[9624]: 2017-09-28 12:49:33.497 9624 ERROR nova     max_url_len=max_url_len)
Sep 28 12:49:33 ctl02 nova-api[9624]: 2017-09-28 12:49:33.497 9624 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:49:33 ctl02 nova-api[9624]: 2017-09-28 12:49:33.497 9624 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:49:33 ctl02 nova-api[9624]: 2017-09-28 12:49:33.497 9624 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:49:33 ctl02 nova-api[9624]: 2017-09-28 12:49:33.497 9624 ERROR nova     sock.listen(backlog)
Sep 28 12:49:33 ctl02 nova-api[9624]: 2017-09-28 12:49:33.497 9624 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:49:33 ctl02 nova-api[9624]: 2017-09-28 12:49:33.497 9624 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:49:33 ctl02 nova-api[9624]: 2017-09-28 12:49:33.497 9624 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:49:33 ctl02 nova-api[9624]: 2017-09-28 12:49:33.497 9624 ERROR nova
Sep 28 12:49:33 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:49:33 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:49:33 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:49:33 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:49:33 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:49:33 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:49:33 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:49:34 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9b571211)
Sep 28 12:49:34 ctl02 heat-api[13008]: 2017-09-28 12:49:34.467 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:49:34] "OPTIONS / HTTP/1.0" 200 134 0.000675
Sep 28 12:49:35 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:49:35 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:49:35 ctl02 nova-api[9642]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:49:35 ctl02 nova-api[9642]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:49:35 ctl02 nova-api[9642]: 2017-09-28 12:49:35.812 9642 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:49:35 ctl02 nova-api[9642]: 2017-09-28 12:49:35.814 9642 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:49:35 ctl02 nova-api[9642]: 2017-09-28 12:49:35.814 9642 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:49:35 ctl02 nova-api[9642]: 2017-09-28 12:49:35.814 9642 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:49:35 ctl02 nova-api[9642]: 2017-09-28 12:49:35.814 9642 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:49:35 ctl02 nova-api[9642]: 2017-09-28 12:49:35.814 9642 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:49:35 ctl02 nova-api[9642]: 2017-09-28 12:49:35.814 9642 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:49:35 ctl02 nova-api[9642]: 2017-09-28 12:49:35.814 9642 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:49:35 ctl02 nova-api[9642]: 2017-09-28 12:49:35.814 9642 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:49:35 ctl02 nova-api[9642]: 2017-09-28 12:49:35.814 9642 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:49:35 ctl02 nova-api[9642]: 2017-09-28 12:49:35.814 9642 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:49:35 ctl02 nova-api[9642]: 2017-09-28 12:49:35.814 9642 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:49:35 ctl02 nova-api[9642]: 2017-09-28 12:49:35.814 9642 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:49:35 ctl02 nova-api[9642]: 2017-09-28 12:49:35.814 9642 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:49:35 ctl02 nova-api[9642]: 2017-09-28 12:49:35.814 9642 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:49:35 ctl02 nova-api[9642]: 2017-09-28 12:49:35.814 9642 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:49:35 ctl02 nova-api[9642]: 2017-09-28 12:49:35.814 9642 ERROR nova.wsgi     self.filename))
Sep 28 12:49:35 ctl02 nova-api[9642]: 2017-09-28 12:49:35.814 9642 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:49:35 ctl02 nova-api[9642]: 2017-09-28 12:49:35.814 9642 ERROR nova.wsgi
Sep 28 12:49:35 ctl02 nova-api[9642]: 2017-09-28 12:49:35.817 9642 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:49:35 ctl02 nova-api[9642]: 2017-09-28 12:49:35.951 9642 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:49:36 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:49:36.163 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:49:36] "OPTIONS / HTTP/1.0" 200 134 0.000482
Sep 28 12:49:36 ctl02 neutron-server[30536]: 2017-09-28 12:49:36.202 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 2 dead agents out of 6:
Sep 28 12:49:36 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:49:36 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:48:56 cmp002
Sep 28 12:49:36 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:48:16 cmp002
Sep 28 12:49:36 ctl02 nova-api[9642]: 2017-09-28 12:49:36.209 9642 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:49:36 ctl02 nova-api[9642]: 2017-09-28 12:49:36.211 9642 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:49:36 ctl02 nova-api[9642]: 2017-09-28 12:49:36.212 9642 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:49:36 ctl02 nova-api[9642]: 2017-09-28 12:49:36.212 9642 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:49:36 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:49:36.246 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:49:36] "OPTIONS / HTTP/1.0" 200 134 0.000463
Sep 28 12:49:36 ctl02 nova-api[9642]: 2017-09-28 12:49:36.350 9642 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:49:36 ctl02 nova-api[9642]: 2017-09-28 12:49:36.352 9642 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:49:36 ctl02 nova-api[9642]: 2017-09-28 12:49:36.352 9642 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:49:36 ctl02 nova-api[9642]: 2017-09-28 12:49:36.353 9642 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:49:36 ctl02 nova-api[9642]: 2017-09-28 12:49:36.356 9642 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:49:36 ctl02 nova-api[9642]: 2017-09-28 12:49:36.357 9642 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:49:36 ctl02 nova-api[9642]: 2017-09-28 12:49:36.357 9642 ERROR nova Traceback (most recent call last):
Sep 28 12:49:36 ctl02 nova-api[9642]: 2017-09-28 12:49:36.357 9642 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:49:36 ctl02 nova-api[9642]: 2017-09-28 12:49:36.357 9642 ERROR nova     sys.exit(main())
Sep 28 12:49:36 ctl02 nova-api[9642]: 2017-09-28 12:49:36.357 9642 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:49:36 ctl02 nova-api[9642]: 2017-09-28 12:49:36.357 9642 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:49:36 ctl02 nova-api[9642]: 2017-09-28 12:49:36.357 9642 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:49:36 ctl02 nova-api[9642]: 2017-09-28 12:49:36.357 9642 ERROR nova     max_url_len=max_url_len)
Sep 28 12:49:36 ctl02 nova-api[9642]: 2017-09-28 12:49:36.357 9642 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:49:36 ctl02 nova-api[9642]: 2017-09-28 12:49:36.357 9642 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:49:36 ctl02 nova-api[9642]: 2017-09-28 12:49:36.357 9642 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:49:36 ctl02 nova-api[9642]: 2017-09-28 12:49:36.357 9642 ERROR nova     sock.listen(backlog)
Sep 28 12:49:36 ctl02 nova-api[9642]: 2017-09-28 12:49:36.357 9642 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:49:36 ctl02 nova-api[9642]: 2017-09-28 12:49:36.357 9642 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:49:36 ctl02 nova-api[9642]: 2017-09-28 12:49:36.357 9642 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:49:36 ctl02 nova-api[9642]: 2017-09-28 12:49:36.357 9642 ERROR nova
Sep 28 12:49:36 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:49:36 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:49:36 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:49:36 ctl02 heat-api-cfn[13300]: 2017-09-28 12:49:36.737 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:49:36] "OPTIONS / HTTP/1.0" 200 134 0.000553
Sep 28 12:49:36 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:49:36 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:49:36 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:49:36 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:49:37 ctl02 heat-api-cfn[13300]: 2017-09-28 12:49:37.380 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:49:37] "OPTIONS / HTTP/1.0" 200 134 0.000480
Sep 28 12:49:38 ctl02 heat-api[13008]: 2017-09-28 12:49:38.529 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:49:38] "OPTIONS / HTTP/1.0" 200 134 0.000652
Sep 28 12:49:38 ctl02 nova-api[9664]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:49:38 ctl02 nova-api[9664]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:49:38 ctl02 nova-api[9664]: 2017-09-28 12:49:38.777 9664 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:49:38 ctl02 nova-api[9664]: 2017-09-28 12:49:38.778 9664 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:49:38 ctl02 nova-api[9664]: 2017-09-28 12:49:38.778 9664 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:49:38 ctl02 nova-api[9664]: 2017-09-28 12:49:38.778 9664 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:49:38 ctl02 nova-api[9664]: 2017-09-28 12:49:38.778 9664 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:49:38 ctl02 nova-api[9664]: 2017-09-28 12:49:38.778 9664 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:49:38 ctl02 nova-api[9664]: 2017-09-28 12:49:38.778 9664 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:49:38 ctl02 nova-api[9664]: 2017-09-28 12:49:38.778 9664 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:49:38 ctl02 nova-api[9664]: 2017-09-28 12:49:38.778 9664 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:49:38 ctl02 nova-api[9664]: 2017-09-28 12:49:38.778 9664 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:49:38 ctl02 nova-api[9664]: 2017-09-28 12:49:38.778 9664 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:49:38 ctl02 nova-api[9664]: 2017-09-28 12:49:38.778 9664 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:49:38 ctl02 nova-api[9664]: 2017-09-28 12:49:38.778 9664 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:49:38 ctl02 nova-api[9664]: 2017-09-28 12:49:38.778 9664 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:49:38 ctl02 nova-api[9664]: 2017-09-28 12:49:38.778 9664 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:49:38 ctl02 nova-api[9664]: 2017-09-28 12:49:38.778 9664 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:49:38 ctl02 nova-api[9664]: 2017-09-28 12:49:38.778 9664 ERROR nova.wsgi     self.filename))
Sep 28 12:49:38 ctl02 nova-api[9664]: 2017-09-28 12:49:38.778 9664 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:49:38 ctl02 nova-api[9664]: 2017-09-28 12:49:38.778 9664 ERROR nova.wsgi
Sep 28 12:49:38 ctl02 nova-api[9664]: 2017-09-28 12:49:38.779 9664 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:49:38 ctl02 nova-api[9664]: 2017-09-28 12:49:38.913 9664 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:49:39 ctl02 nova-api[9664]: 2017-09-28 12:49:39.157 9664 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:49:39 ctl02 nova-api[9664]: 2017-09-28 12:49:39.160 9664 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:49:39 ctl02 nova-api[9664]: 2017-09-28 12:49:39.160 9664 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:49:39 ctl02 nova-api[9664]: 2017-09-28 12:49:39.160 9664 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:49:39 ctl02 nova-api[9664]: 2017-09-28 12:49:39.294 9664 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:49:39 ctl02 nova-api[9664]: 2017-09-28 12:49:39.296 9664 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:49:39 ctl02 nova-api[9664]: 2017-09-28 12:49:39.296 9664 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:49:39 ctl02 nova-api[9664]: 2017-09-28 12:49:39.296 9664 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:49:39 ctl02 nova-api[9664]: 2017-09-28 12:49:39.299 9664 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:49:39 ctl02 nova-api[9664]: 2017-09-28 12:49:39.300 9664 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:49:39 ctl02 nova-api[9664]: 2017-09-28 12:49:39.300 9664 ERROR nova Traceback (most recent call last):
Sep 28 12:49:39 ctl02 nova-api[9664]: 2017-09-28 12:49:39.300 9664 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:49:39 ctl02 nova-api[9664]: 2017-09-28 12:49:39.300 9664 ERROR nova     sys.exit(main())
Sep 28 12:49:39 ctl02 nova-api[9664]: 2017-09-28 12:49:39.300 9664 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:49:39 ctl02 nova-api[9664]: 2017-09-28 12:49:39.300 9664 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:49:39 ctl02 nova-api[9664]: 2017-09-28 12:49:39.300 9664 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:49:39 ctl02 nova-api[9664]: 2017-09-28 12:49:39.300 9664 ERROR nova     max_url_len=max_url_len)
Sep 28 12:49:39 ctl02 nova-api[9664]: 2017-09-28 12:49:39.300 9664 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:49:39 ctl02 nova-api[9664]: 2017-09-28 12:49:39.300 9664 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:49:39 ctl02 nova-api[9664]: 2017-09-28 12:49:39.300 9664 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:49:39 ctl02 nova-api[9664]: 2017-09-28 12:49:39.300 9664 ERROR nova     sock.listen(backlog)
Sep 28 12:49:39 ctl02 nova-api[9664]: 2017-09-28 12:49:39.300 9664 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:49:39 ctl02 nova-api[9664]: 2017-09-28 12:49:39.300 9664 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:49:39 ctl02 nova-api[9664]: 2017-09-28 12:49:39.300 9664 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:49:39 ctl02 nova-api[9664]: 2017-09-28 12:49:39.300 9664 ERROR nova
Sep 28 12:49:39 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:49:39 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:49:39 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:49:39 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:49:39.524 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:49:39] "OPTIONS / HTTP/1.0" 200 134 0.000532
Sep 28 12:49:39 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:49:39 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:49:39 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:49:39 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:49:39 ctl02 heat-api[13008]: 2017-09-28 12:49:39.858 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:49:39] "OPTIONS / HTTP/1.0" 200 134 0.000618
Sep 28 12:49:40 ctl02 glance-api[29183]: 2017-09-28 12:49:40.020 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:49:40] "OPTIONS / HTTP/1.0" 200 134 0.000628
Sep 28 12:49:40 ctl02 glance-api[29183]: 2017-09-28 12:49:40.294 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:49:40] "OPTIONS / HTTP/1.0" 200 134 0.000602
Sep 28 12:49:40 ctl02 neutron-server[30536]: 2017-09-28 12:49:40.350 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:49:40] "OPTIONS / HTTP/1.0" 200 262 0.000532
Sep 28 12:49:40 ctl02 heat-api-cfn[13300]: 2017-09-28 12:49:40.852 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:49:40] "OPTIONS / HTTP/1.0" 200 134 0.000515
Sep 28 12:49:41 ctl02 neutron-server[30536]: 2017-09-28 12:49:41.160 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:49:41] "OPTIONS / HTTP/1.0" 200 262 0.000568
Sep 28 12:49:41 ctl02 nova-api[9682]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:49:41 ctl02 nova-api[9682]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:49:41 ctl02 glance-api[29183]: 2017-09-28 12:49:41.394 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:49:41] "OPTIONS / HTTP/1.0" 200 134 0.000694
Sep 28 12:49:41 ctl02 nova-api[9682]: 2017-09-28 12:49:41.531 9682 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:49:41 ctl02 nova-api[9682]: 2017-09-28 12:49:41.533 9682 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:49:41 ctl02 nova-api[9682]: 2017-09-28 12:49:41.533 9682 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:49:41 ctl02 nova-api[9682]: 2017-09-28 12:49:41.533 9682 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:49:41 ctl02 nova-api[9682]: 2017-09-28 12:49:41.533 9682 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:49:41 ctl02 nova-api[9682]: 2017-09-28 12:49:41.533 9682 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:49:41 ctl02 nova-api[9682]: 2017-09-28 12:49:41.533 9682 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:49:41 ctl02 nova-api[9682]: 2017-09-28 12:49:41.533 9682 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:49:41 ctl02 nova-api[9682]: 2017-09-28 12:49:41.533 9682 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:49:41 ctl02 nova-api[9682]: 2017-09-28 12:49:41.533 9682 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:49:41 ctl02 nova-api[9682]: 2017-09-28 12:49:41.533 9682 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:49:41 ctl02 nova-api[9682]: 2017-09-28 12:49:41.533 9682 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:49:41 ctl02 nova-api[9682]: 2017-09-28 12:49:41.533 9682 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:49:41 ctl02 nova-api[9682]: 2017-09-28 12:49:41.533 9682 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:49:41 ctl02 nova-api[9682]: 2017-09-28 12:49:41.533 9682 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:49:41 ctl02 nova-api[9682]: 2017-09-28 12:49:41.533 9682 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:49:41 ctl02 nova-api[9682]: 2017-09-28 12:49:41.533 9682 ERROR nova.wsgi     self.filename))
Sep 28 12:49:41 ctl02 nova-api[9682]: 2017-09-28 12:49:41.533 9682 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:49:41 ctl02 nova-api[9682]: 2017-09-28 12:49:41.533 9682 ERROR nova.wsgi
Sep 28 12:49:41 ctl02 nova-api[9682]: 2017-09-28 12:49:41.535 9682 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:49:41 ctl02 nova-api[9682]: 2017-09-28 12:49:41.670 9682 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:49:41 ctl02 nova-api[9682]: 2017-09-28 12:49:41.922 9682 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:49:41 ctl02 nova-api[9682]: 2017-09-28 12:49:41.924 9682 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:49:41 ctl02 nova-api[9682]: 2017-09-28 12:49:41.924 9682 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:49:41 ctl02 nova-api[9682]: 2017-09-28 12:49:41.924 9682 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:49:42 ctl02 nova-api[9682]: 2017-09-28 12:49:42.057 9682 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:49:42 ctl02 nova-api[9682]: 2017-09-28 12:49:42.060 9682 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:49:42 ctl02 nova-api[9682]: 2017-09-28 12:49:42.060 9682 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:49:42 ctl02 nova-api[9682]: 2017-09-28 12:49:42.060 9682 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:49:42 ctl02 nova-api[9682]: 2017-09-28 12:49:42.063 9682 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:49:42 ctl02 nova-api[9682]: 2017-09-28 12:49:42.064 9682 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:49:42 ctl02 nova-api[9682]: 2017-09-28 12:49:42.064 9682 ERROR nova Traceback (most recent call last):
Sep 28 12:49:42 ctl02 nova-api[9682]: 2017-09-28 12:49:42.064 9682 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:49:42 ctl02 nova-api[9682]: 2017-09-28 12:49:42.064 9682 ERROR nova     sys.exit(main())
Sep 28 12:49:42 ctl02 nova-api[9682]: 2017-09-28 12:49:42.064 9682 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:49:42 ctl02 nova-api[9682]: 2017-09-28 12:49:42.064 9682 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:49:42 ctl02 nova-api[9682]: 2017-09-28 12:49:42.064 9682 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:49:42 ctl02 nova-api[9682]: 2017-09-28 12:49:42.064 9682 ERROR nova     max_url_len=max_url_len)
Sep 28 12:49:42 ctl02 nova-api[9682]: 2017-09-28 12:49:42.064 9682 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:49:42 ctl02 nova-api[9682]: 2017-09-28 12:49:42.064 9682 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:49:42 ctl02 nova-api[9682]: 2017-09-28 12:49:42.064 9682 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:49:42 ctl02 nova-api[9682]: 2017-09-28 12:49:42.064 9682 ERROR nova     sock.listen(backlog)
Sep 28 12:49:42 ctl02 nova-api[9682]: 2017-09-28 12:49:42.064 9682 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:49:42 ctl02 nova-api[9682]: 2017-09-28 12:49:42.064 9682 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:49:42 ctl02 nova-api[9682]: 2017-09-28 12:49:42.064 9682 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:49:42 ctl02 nova-api[9682]: 2017-09-28 12:49:42.064 9682 ERROR nova
Sep 28 12:49:42 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:49:42 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:49:42 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:49:42 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:49:42 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:49:42 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:49:42 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.464 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:49:42] "OPTIONS / HTTP/1.0" 200 262 0.000603
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.883 30599 ERROR oslo_messaging.rpc.dispatcher [req-d9106a6c-e2c8-4406-8fce-ab803a1db621 - - - - -] Exception during message handling: (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vi
Sep 28 12:49:42 ctl02 neutron-server[30536]: f_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability
Sep 28 12:49:42 ctl02 neutron-server[30536]: _zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipal
Sep 28 12:49:42 ctl02 neutron-server[30536]: locations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id']
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.883 30599 ERROR oslo_messaging.rpc.dispatcher Traceback (most recent call last):
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.883 30599 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.883 30599 ERROR oslo_messaging.rpc.dispatcher     incoming.message))
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.883 30599 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.883 30599 ERROR oslo_messaging.rpc.dispatcher     return self._do_dispatch(endpoint, method, ctxt, args)
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.883 30599 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.883 30599 ERROR oslo_messaging.rpc.dispatcher     result = func(ctxt, **new_args)
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.883 30599 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.883 30599 ERROR oslo_messaging.rpc.dispatcher     router_ids=None)
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.883 30599 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.883 30599 ERROR oslo_messaging.rpc.dispatcher     self, context, host, router_ids)
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.883 30599 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.883 30599 ERROR oslo_messaging.rpc.dispatcher     plugin, context, l3_agent)
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.883 30599 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.883 30599 ERROR oslo_messaging.rpc.dispatcher     agent)
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.883 30599 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.883 30599 ERROR oslo_messaging.rpc.dispatcher     return plugin.get_ha_routers_l3_agents_count(context)
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.883 30599 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.883 30599 ERROR oslo_messaging.rpc.dispatcher     for router, agent_count in query]
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.883 30599 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.883 30599 ERROR oslo_messaging.rpc.dispatcher     return self._execute_and_instances(context)
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.883 30599 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.883 30599 ERROR oslo_messaging.rpc.dispatcher     result = conn.execute(querycontext.statement, self._params)
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.883 30599 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.883 30599 ERROR oslo_messaging.rpc.dispatcher     return meth(self, multiparams, params)
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.883 30599 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.883 30599 ERROR oslo_messaging.rpc.dispatcher     return connection._execute_clauseelement(self, multiparams, params)
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.883 30599 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.883 30599 ERROR oslo_messaging.rpc.dispatcher     compiled_sql, distilled_params
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.883 30599 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.883 30599 ERROR oslo_messaging.rpc.dispatcher     context)
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.883 30599 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.883 30599 ERROR oslo_messaging.rpc.dispatcher     util.raise_from_cause(newraise, exc_info)
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.883 30599 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.883 30599 ERROR oslo_messaging.rpc.dispatcher     reraise(type(exception), exception, tb=exc_tb)
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.883 30599 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.883 30599 ERROR oslo_messaging.rpc.dispatcher     context)
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.883 30599 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.883 30599 ERROR oslo_messaging.rpc.dispatcher     cursor.execute(statement, parameters)
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.883 30599 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.883 30599 ERROR oslo_messaging.rpc.dispatcher     result = self._query(query)
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.883 30599 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.883 30599 ERROR oslo_messaging.rpc.dispatcher     conn.query(q)
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.883 30599 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.883 30599 ERROR oslo_messaging.rpc.dispatcher     self._affected_rows = self._read_query_result(unbuffered=unbuffered)
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.883 30599 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.883 30599 ERROR oslo_messaging.rpc.dispatcher     result.read()
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.883 30599 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.883 30599 ERROR oslo_messaging.rpc.dispatcher     first_packet = self.connection._read_packet()
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.883 30599 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.883 30599 ERROR oslo_messaging.rpc.dispatcher     packet.check_error()
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.883 30599 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.883 30599 ERROR oslo_messaging.rpc.dispatcher     err.raise_mysql_exception(self._data)
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.883 30599 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.883 30599 ERROR oslo_messaging.rpc.dispatcher     _check_mysql_exception(errinfo)
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.883 30599 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.883 30599 ERROR oslo_messaging.rpc.dispatcher     raise errorclass(errno, errorvalue)
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.883 30599 ERROR oslo_messaging.rpc.dispatcher ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port
Sep 28 12:49:42 ctl02 neutron-server[30536]: _id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.cr
Sep 28 12:49:42 ctl02 neutron-server[30536]: eated_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattr
Sep 28 12:49:42 ctl02 neutron-server[30536]: ibutes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id']
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.883 30599 ERROR oslo_messaging.rpc.dispatcher
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.890 30599 ERROR oslo_messaging._drivers.common [req-d9106a6c-e2c8-4406-8fce-ab803a1db621 - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:49:42 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:49:42 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:49:42 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:49:42 ctl02 neutron-server[30536]: 2017-09-28 12:49:42.890 30599 ERROR oslo_messaging._drivers.common [req-d9106a6c-e2c8-4406-8fce-ab803a1db621 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:49:42 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:49:42 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:49:42 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:49:42 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:49:42 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:49:43 ctl02 nova-conductor[5056]: 2017-09-28 12:49:43.046 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:49:43 ctl02 nova-conductor[5056]: 2017-09-28 12:49:43.074 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:49:43 ctl02 nova-conductor[5056]: 2017-09-28 12:49:43.101 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:49:43 ctl02 nova-cert[4860]: 2017-09-28 12:49:43.107 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:49:43 ctl02 nova-conductor[5056]: 2017-09-28 12:49:43.106 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:49:44 ctl02 nova-api[9701]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:49:44 ctl02 nova-api[9701]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:49:44 ctl02 heat-api[13008]: 2017-09-28 12:49:44.082 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:49:44] "OPTIONS / HTTP/1.0" 200 134 0.000556
Sep 28 12:49:44 ctl02 nova-api[9701]: 2017-09-28 12:49:44.268 9701 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:49:44 ctl02 nova-api[9701]: 2017-09-28 12:49:44.270 9701 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:49:44 ctl02 nova-api[9701]: 2017-09-28 12:49:44.270 9701 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:49:44 ctl02 nova-api[9701]: 2017-09-28 12:49:44.270 9701 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:49:44 ctl02 nova-api[9701]: 2017-09-28 12:49:44.270 9701 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:49:44 ctl02 nova-api[9701]: 2017-09-28 12:49:44.270 9701 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:49:44 ctl02 nova-api[9701]: 2017-09-28 12:49:44.270 9701 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:49:44 ctl02 nova-api[9701]: 2017-09-28 12:49:44.270 9701 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:49:44 ctl02 nova-api[9701]: 2017-09-28 12:49:44.270 9701 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:49:44 ctl02 nova-api[9701]: 2017-09-28 12:49:44.270 9701 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:49:44 ctl02 nova-api[9701]: 2017-09-28 12:49:44.270 9701 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:49:44 ctl02 nova-api[9701]: 2017-09-28 12:49:44.270 9701 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:49:44 ctl02 nova-api[9701]: 2017-09-28 12:49:44.270 9701 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:49:44 ctl02 nova-api[9701]: 2017-09-28 12:49:44.270 9701 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:49:44 ctl02 nova-api[9701]: 2017-09-28 12:49:44.270 9701 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:49:44 ctl02 nova-api[9701]: 2017-09-28 12:49:44.270 9701 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:49:44 ctl02 nova-api[9701]: 2017-09-28 12:49:44.270 9701 ERROR nova.wsgi     self.filename))
Sep 28 12:49:44 ctl02 nova-api[9701]: 2017-09-28 12:49:44.270 9701 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:49:44 ctl02 nova-api[9701]: 2017-09-28 12:49:44.270 9701 ERROR nova.wsgi
Sep 28 12:49:44 ctl02 nova-api[9701]: 2017-09-28 12:49:44.272 9701 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:49:44 ctl02 nova-api[9701]: 2017-09-28 12:49:44.403 9701 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:49:44 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x770ae310)
Sep 28 12:49:44 ctl02 nova-api[9701]: 2017-09-28 12:49:44.650 9701 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:49:44 ctl02 nova-api[9701]: 2017-09-28 12:49:44.672 9701 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:49:44 ctl02 nova-api[9701]: 2017-09-28 12:49:44.672 9701 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:49:44 ctl02 nova-api[9701]: 2017-09-28 12:49:44.672 9701 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:49:44 ctl02 nova-api[9701]: 2017-09-28 12:49:44.806 9701 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:49:44 ctl02 nova-api[9701]: 2017-09-28 12:49:44.809 9701 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:49:44 ctl02 nova-api[9701]: 2017-09-28 12:49:44.809 9701 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:49:44 ctl02 nova-api[9701]: 2017-09-28 12:49:44.809 9701 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:49:44 ctl02 nova-api[9701]: 2017-09-28 12:49:44.813 9701 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:49:44 ctl02 nova-api[9701]: 2017-09-28 12:49:44.813 9701 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:49:44 ctl02 nova-api[9701]: 2017-09-28 12:49:44.813 9701 ERROR nova Traceback (most recent call last):
Sep 28 12:49:44 ctl02 nova-api[9701]: 2017-09-28 12:49:44.813 9701 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:49:44 ctl02 nova-api[9701]: 2017-09-28 12:49:44.813 9701 ERROR nova     sys.exit(main())
Sep 28 12:49:44 ctl02 nova-api[9701]: 2017-09-28 12:49:44.813 9701 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:49:44 ctl02 nova-api[9701]: 2017-09-28 12:49:44.813 9701 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:49:44 ctl02 nova-api[9701]: 2017-09-28 12:49:44.813 9701 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:49:44 ctl02 nova-api[9701]: 2017-09-28 12:49:44.813 9701 ERROR nova     max_url_len=max_url_len)
Sep 28 12:49:44 ctl02 nova-api[9701]: 2017-09-28 12:49:44.813 9701 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:49:44 ctl02 nova-api[9701]: 2017-09-28 12:49:44.813 9701 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:49:44 ctl02 nova-api[9701]: 2017-09-28 12:49:44.813 9701 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:49:44 ctl02 nova-api[9701]: 2017-09-28 12:49:44.813 9701 ERROR nova     sock.listen(backlog)
Sep 28 12:49:44 ctl02 nova-api[9701]: 2017-09-28 12:49:44.813 9701 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:49:44 ctl02 nova-api[9701]: 2017-09-28 12:49:44.813 9701 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:49:44 ctl02 nova-api[9701]: 2017-09-28 12:49:44.813 9701 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:49:44 ctl02 nova-api[9701]: 2017-09-28 12:49:44.813 9701 ERROR nova
Sep 28 12:49:44 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:49:44 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:49:44 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:49:45 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:49:45 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:49:45 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:49:45 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:49:45 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x770ae310)
Sep 28 12:49:46 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:49:46.524 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:49:46] "OPTIONS / HTTP/1.0" 200 134 0.000466
Sep 28 12:49:46 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x770ae310)
Sep 28 12:49:46 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:49:46.647 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:49:46] "OPTIONS / HTTP/1.0" 200 134 0.000257
Sep 28 12:49:46 ctl02 heat-api-cfn[13300]: 2017-09-28 12:49:46.711 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:49:46] "OPTIONS / HTTP/1.0" 200 134 0.000491
Sep 28 12:49:46 ctl02 nova-api[9719]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:49:46 ctl02 nova-api[9719]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:49:47 ctl02 nova-api[9719]: 2017-09-28 12:49:47.006 9719 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:49:47 ctl02 nova-api[9719]: 2017-09-28 12:49:47.007 9719 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:49:47 ctl02 nova-api[9719]: 2017-09-28 12:49:47.007 9719 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:49:47 ctl02 nova-api[9719]: 2017-09-28 12:49:47.007 9719 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:49:47 ctl02 nova-api[9719]: 2017-09-28 12:49:47.007 9719 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:49:47 ctl02 nova-api[9719]: 2017-09-28 12:49:47.007 9719 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:49:47 ctl02 nova-api[9719]: 2017-09-28 12:49:47.007 9719 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:49:47 ctl02 nova-api[9719]: 2017-09-28 12:49:47.007 9719 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:49:47 ctl02 nova-api[9719]: 2017-09-28 12:49:47.007 9719 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:49:47 ctl02 nova-api[9719]: 2017-09-28 12:49:47.007 9719 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:49:47 ctl02 nova-api[9719]: 2017-09-28 12:49:47.007 9719 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:49:47 ctl02 nova-api[9719]: 2017-09-28 12:49:47.007 9719 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:49:47 ctl02 nova-api[9719]: 2017-09-28 12:49:47.007 9719 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:49:47 ctl02 nova-api[9719]: 2017-09-28 12:49:47.007 9719 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:49:47 ctl02 nova-api[9719]: 2017-09-28 12:49:47.007 9719 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:49:47 ctl02 nova-api[9719]: 2017-09-28 12:49:47.007 9719 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:49:47 ctl02 nova-api[9719]: 2017-09-28 12:49:47.007 9719 ERROR nova.wsgi     self.filename))
Sep 28 12:49:47 ctl02 nova-api[9719]: 2017-09-28 12:49:47.007 9719 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:49:47 ctl02 nova-api[9719]: 2017-09-28 12:49:47.007 9719 ERROR nova.wsgi
Sep 28 12:49:47 ctl02 nova-api[9719]: 2017-09-28 12:49:47.008 9719 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:49:47 ctl02 nova-api[9719]: 2017-09-28 12:49:47.140 9719 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:49:47 ctl02 nova-api[9719]: 2017-09-28 12:49:47.387 9719 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:49:47 ctl02 nova-api[9719]: 2017-09-28 12:49:47.389 9719 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:49:47 ctl02 nova-api[9719]: 2017-09-28 12:49:47.389 9719 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:49:47 ctl02 nova-api[9719]: 2017-09-28 12:49:47.389 9719 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:49:47 ctl02 nova-api[9719]: 2017-09-28 12:49:47.522 9719 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:49:47 ctl02 nova-api[9719]: 2017-09-28 12:49:47.524 9719 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:49:47 ctl02 nova-api[9719]: 2017-09-28 12:49:47.525 9719 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:49:47 ctl02 nova-api[9719]: 2017-09-28 12:49:47.525 9719 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:49:47 ctl02 nova-api[9719]: 2017-09-28 12:49:47.528 9719 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:49:47 ctl02 nova-api[9719]: 2017-09-28 12:49:47.529 9719 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:49:47 ctl02 nova-api[9719]: 2017-09-28 12:49:47.529 9719 ERROR nova Traceback (most recent call last):
Sep 28 12:49:47 ctl02 nova-api[9719]: 2017-09-28 12:49:47.529 9719 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:49:47 ctl02 nova-api[9719]: 2017-09-28 12:49:47.529 9719 ERROR nova     sys.exit(main())
Sep 28 12:49:47 ctl02 nova-api[9719]: 2017-09-28 12:49:47.529 9719 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:49:47 ctl02 nova-api[9719]: 2017-09-28 12:49:47.529 9719 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:49:47 ctl02 nova-api[9719]: 2017-09-28 12:49:47.529 9719 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:49:47 ctl02 nova-api[9719]: 2017-09-28 12:49:47.529 9719 ERROR nova     max_url_len=max_url_len)
Sep 28 12:49:47 ctl02 nova-api[9719]: 2017-09-28 12:49:47.529 9719 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:49:47 ctl02 nova-api[9719]: 2017-09-28 12:49:47.529 9719 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:49:47 ctl02 nova-api[9719]: 2017-09-28 12:49:47.529 9719 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:49:47 ctl02 nova-api[9719]: 2017-09-28 12:49:47.529 9719 ERROR nova     sock.listen(backlog)
Sep 28 12:49:47 ctl02 nova-api[9719]: 2017-09-28 12:49:47.529 9719 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:49:47 ctl02 nova-api[9719]: 2017-09-28 12:49:47.529 9719 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:49:47 ctl02 nova-api[9719]: 2017-09-28 12:49:47.529 9719 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:49:47 ctl02 nova-api[9719]: 2017-09-28 12:49:47.529 9719 ERROR nova
Sep 28 12:49:47 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x770ae310)
Sep 28 12:49:47 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:49:47 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:49:47 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:49:47 ctl02 heat-api-cfn[13300]: 2017-09-28 12:49:47.775 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:49:47] "OPTIONS / HTTP/1.0" 200 134 0.000501
Sep 28 12:49:47 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:49:47 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:49:47 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:49:47 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:49:48 ctl02 heat-api[13008]: 2017-09-28 12:49:48.307 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:49:48] "OPTIONS / HTTP/1.0" 200 134 0.000615
Sep 28 12:49:48 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x770ae310)
Sep 28 12:49:49 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:49:49.263 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:49:49] "OPTIONS / HTTP/1.0" 200 134 0.000430
Sep 28 12:49:49 ctl02 nova-api[9737]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:49:49 ctl02 nova-api[9737]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:49:49 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x770ae310)
Sep 28 12:49:49 ctl02 heat-api[13008]: 2017-09-28 12:49:49.706 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:49:49] "OPTIONS / HTTP/1.0" 200 134 0.000677
Sep 28 12:49:49 ctl02 nova-api[9737]: 2017-09-28 12:49:49.762 9737 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:49:49 ctl02 nova-api[9737]: 2017-09-28 12:49:49.763 9737 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:49:49 ctl02 nova-api[9737]: 2017-09-28 12:49:49.763 9737 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:49:49 ctl02 nova-api[9737]: 2017-09-28 12:49:49.763 9737 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:49:49 ctl02 nova-api[9737]: 2017-09-28 12:49:49.763 9737 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:49:49 ctl02 nova-api[9737]: 2017-09-28 12:49:49.763 9737 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:49:49 ctl02 nova-api[9737]: 2017-09-28 12:49:49.763 9737 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:49:49 ctl02 nova-api[9737]: 2017-09-28 12:49:49.763 9737 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:49:49 ctl02 nova-api[9737]: 2017-09-28 12:49:49.763 9737 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:49:49 ctl02 nova-api[9737]: 2017-09-28 12:49:49.763 9737 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:49:49 ctl02 nova-api[9737]: 2017-09-28 12:49:49.763 9737 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:49:49 ctl02 nova-api[9737]: 2017-09-28 12:49:49.763 9737 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:49:49 ctl02 nova-api[9737]: 2017-09-28 12:49:49.763 9737 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:49:49 ctl02 nova-api[9737]: 2017-09-28 12:49:49.763 9737 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:49:49 ctl02 nova-api[9737]: 2017-09-28 12:49:49.763 9737 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:49:49 ctl02 nova-api[9737]: 2017-09-28 12:49:49.763 9737 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:49:49 ctl02 nova-api[9737]: 2017-09-28 12:49:49.763 9737 ERROR nova.wsgi     self.filename))
Sep 28 12:49:49 ctl02 nova-api[9737]: 2017-09-28 12:49:49.763 9737 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:49:49 ctl02 nova-api[9737]: 2017-09-28 12:49:49.763 9737 ERROR nova.wsgi
Sep 28 12:49:49 ctl02 nova-api[9737]: 2017-09-28 12:49:49.766 9737 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:49:49 ctl02 nova-api[9737]: 2017-09-28 12:49:49.897 9737 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:49:50 ctl02 nova-api[9737]: 2017-09-28 12:49:50.145 9737 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:49:50 ctl02 nova-api[9737]: 2017-09-28 12:49:50.147 9737 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:49:50 ctl02 nova-api[9737]: 2017-09-28 12:49:50.148 9737 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:49:50 ctl02 nova-api[9737]: 2017-09-28 12:49:50.148 9737 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:49:50 ctl02 nova-api[9737]: 2017-09-28 12:49:50.282 9737 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:49:50 ctl02 nova-api[9737]: 2017-09-28 12:49:50.285 9737 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:49:50 ctl02 nova-api[9737]: 2017-09-28 12:49:50.285 9737 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:49:50 ctl02 nova-api[9737]: 2017-09-28 12:49:50.285 9737 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:49:50 ctl02 nova-api[9737]: 2017-09-28 12:49:50.289 9737 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:49:50 ctl02 nova-api[9737]: 2017-09-28 12:49:50.289 9737 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:49:50 ctl02 nova-api[9737]: 2017-09-28 12:49:50.289 9737 ERROR nova Traceback (most recent call last):
Sep 28 12:49:50 ctl02 nova-api[9737]: 2017-09-28 12:49:50.289 9737 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:49:50 ctl02 nova-api[9737]: 2017-09-28 12:49:50.289 9737 ERROR nova     sys.exit(main())
Sep 28 12:49:50 ctl02 nova-api[9737]: 2017-09-28 12:49:50.289 9737 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:49:50 ctl02 nova-api[9737]: 2017-09-28 12:49:50.289 9737 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:49:50 ctl02 nova-api[9737]: 2017-09-28 12:49:50.289 9737 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:49:50 ctl02 nova-api[9737]: 2017-09-28 12:49:50.289 9737 ERROR nova     max_url_len=max_url_len)
Sep 28 12:49:50 ctl02 nova-api[9737]: 2017-09-28 12:49:50.289 9737 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:49:50 ctl02 nova-api[9737]: 2017-09-28 12:49:50.289 9737 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:49:50 ctl02 nova-api[9737]: 2017-09-28 12:49:50.289 9737 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:49:50 ctl02 nova-api[9737]: 2017-09-28 12:49:50.289 9737 ERROR nova     sock.listen(backlog)
Sep 28 12:49:50 ctl02 nova-api[9737]: 2017-09-28 12:49:50.289 9737 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:49:50 ctl02 nova-api[9737]: 2017-09-28 12:49:50.289 9737 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:49:50 ctl02 nova-api[9737]: 2017-09-28 12:49:50.289 9737 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:49:50 ctl02 nova-api[9737]: 2017-09-28 12:49:50.289 9737 ERROR nova
Sep 28 12:49:50 ctl02 glance-api[29183]: 2017-09-28 12:49:50.309 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:49:50] "OPTIONS / HTTP/1.0" 200 134 0.000662
Sep 28 12:49:50 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:49:50 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:49:50 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:49:50 ctl02 heat-api-cfn[13300]: 2017-09-28 12:49:50.554 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:49:50] "OPTIONS / HTTP/1.0" 200 134 0.000543
Sep 28 12:49:50 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x770ae310)
Sep 28 12:49:50 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:49:50 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:49:50 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:49:50 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:49:50 ctl02 glance-api[29183]: 2017-09-28 12:49:50.661 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:49:50] "OPTIONS / HTTP/1.0" 200 134 0.000682
Sep 28 12:49:50 ctl02 neutron-server[30536]: 2017-09-28 12:49:50.666 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:49:50] "OPTIONS / HTTP/1.0" 200 262 0.000554
Sep 28 12:49:51 ctl02 neutron-server[30536]: 2017-09-28 12:49:51.198 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 2 dead agents out of 6:
Sep 28 12:49:51 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:49:51 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:48:56 cmp002
Sep 28 12:49:51 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:48:16 cmp002
Sep 28 12:49:51 ctl02 neutron-server[30536]: 2017-09-28 12:49:51.341 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:49:51] "OPTIONS / HTTP/1.0" 200 262 0.000588
Sep 28 12:49:51 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x770ae310)
Sep 28 12:49:51 ctl02 glance-api[29183]: 2017-09-28 12:49:51.604 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:49:51] "OPTIONS / HTTP/1.0" 200 134 0.000697
Sep 28 12:49:52 ctl02 nova-api[9755]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:49:52 ctl02 nova-api[9755]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:49:52 ctl02 nova-api[9755]: 2017-09-28 12:49:52.504 9755 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:49:52 ctl02 nova-api[9755]: 2017-09-28 12:49:52.506 9755 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:49:52 ctl02 nova-api[9755]: 2017-09-28 12:49:52.506 9755 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:49:52 ctl02 nova-api[9755]: 2017-09-28 12:49:52.506 9755 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:49:52 ctl02 nova-api[9755]: 2017-09-28 12:49:52.506 9755 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:49:52 ctl02 nova-api[9755]: 2017-09-28 12:49:52.506 9755 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:49:52 ctl02 nova-api[9755]: 2017-09-28 12:49:52.506 9755 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:49:52 ctl02 nova-api[9755]: 2017-09-28 12:49:52.506 9755 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:49:52 ctl02 nova-api[9755]: 2017-09-28 12:49:52.506 9755 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:49:52 ctl02 nova-api[9755]: 2017-09-28 12:49:52.506 9755 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:49:52 ctl02 nova-api[9755]: 2017-09-28 12:49:52.506 9755 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:49:52 ctl02 nova-api[9755]: 2017-09-28 12:49:52.506 9755 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:49:52 ctl02 nova-api[9755]: 2017-09-28 12:49:52.506 9755 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:49:52 ctl02 nova-api[9755]: 2017-09-28 12:49:52.506 9755 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:49:52 ctl02 nova-api[9755]: 2017-09-28 12:49:52.506 9755 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:49:52 ctl02 nova-api[9755]: 2017-09-28 12:49:52.506 9755 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:49:52 ctl02 nova-api[9755]: 2017-09-28 12:49:52.506 9755 ERROR nova.wsgi     self.filename))
Sep 28 12:49:52 ctl02 nova-api[9755]: 2017-09-28 12:49:52.506 9755 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:49:52 ctl02 nova-api[9755]: 2017-09-28 12:49:52.506 9755 ERROR nova.wsgi
Sep 28 12:49:52 ctl02 nova-api[9755]: 2017-09-28 12:49:52.507 9755 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:49:52 ctl02 neutron-server[30536]: 2017-09-28 12:49:52.547 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:49:52] "OPTIONS / HTTP/1.0" 200 262 0.000534
Sep 28 12:49:52 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x770ae310)
Sep 28 12:49:52 ctl02 nova-api[9755]: 2017-09-28 12:49:52.639 9755 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:49:52 ctl02 nova-api[9755]: 2017-09-28 12:49:52.887 9755 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:49:52 ctl02 nova-api[9755]: 2017-09-28 12:49:52.889 9755 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:49:52 ctl02 nova-api[9755]: 2017-09-28 12:49:52.889 9755 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:49:52 ctl02 nova-api[9755]: 2017-09-28 12:49:52.889 9755 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:49:52 ctl02 nova-consoleauth[5433]: 2017-09-28 12:49:52.944 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:49:53 ctl02 nova-api[9755]: 2017-09-28 12:49:53.020 9755 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:49:53 ctl02 nova-api[9755]: 2017-09-28 12:49:53.023 9755 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:49:53 ctl02 nova-api[9755]: 2017-09-28 12:49:53.023 9755 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:49:53 ctl02 nova-api[9755]: 2017-09-28 12:49:53.023 9755 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:49:53 ctl02 nova-api[9755]: 2017-09-28 12:49:53.026 9755 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:49:53 ctl02 nova-api[9755]: 2017-09-28 12:49:53.027 9755 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:49:53 ctl02 nova-api[9755]: 2017-09-28 12:49:53.027 9755 ERROR nova Traceback (most recent call last):
Sep 28 12:49:53 ctl02 nova-api[9755]: 2017-09-28 12:49:53.027 9755 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:49:53 ctl02 nova-api[9755]: 2017-09-28 12:49:53.027 9755 ERROR nova     sys.exit(main())
Sep 28 12:49:53 ctl02 nova-api[9755]: 2017-09-28 12:49:53.027 9755 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:49:53 ctl02 nova-api[9755]: 2017-09-28 12:49:53.027 9755 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:49:53 ctl02 nova-api[9755]: 2017-09-28 12:49:53.027 9755 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:49:53 ctl02 nova-api[9755]: 2017-09-28 12:49:53.027 9755 ERROR nova     max_url_len=max_url_len)
Sep 28 12:49:53 ctl02 nova-api[9755]: 2017-09-28 12:49:53.027 9755 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:49:53 ctl02 nova-api[9755]: 2017-09-28 12:49:53.027 9755 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:49:53 ctl02 nova-api[9755]: 2017-09-28 12:49:53.027 9755 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:49:53 ctl02 nova-api[9755]: 2017-09-28 12:49:53.027 9755 ERROR nova     sock.listen(backlog)
Sep 28 12:49:53 ctl02 nova-api[9755]: 2017-09-28 12:49:53.027 9755 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:49:53 ctl02 nova-api[9755]: 2017-09-28 12:49:53.027 9755 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:49:53 ctl02 nova-api[9755]: 2017-09-28 12:49:53.027 9755 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:49:53 ctl02 nova-api[9755]: 2017-09-28 12:49:53.027 9755 ERROR nova
Sep 28 12:49:53 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:49:53 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:49:53 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:49:53 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:49:53 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:49:53 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:49:53 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:49:53 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x770ae310)
Sep 28 12:49:53 ctl02 heat-api[13008]: 2017-09-28 12:49:53.963 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:49:53] "OPTIONS / HTTP/1.0" 200 134 0.000642
Sep 28 12:49:54 ctl02 heat-engine[12803]: 2017-09-28 12:49:54.205 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:49:54 ctl02 heat-engine[12803]: 2017-09-28 12:49:54.205 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:49:54 ctl02 heat-engine[12803]: 2017-09-28 12:49:54.211 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:49:54 ctl02 heat-engine[12803]: 2017-09-28 12:49:54.217 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:49:54 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x770ae310)
Sep 28 12:49:55 ctl02 nova-api[9773]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:49:55 ctl02 nova-api[9773]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:49:55 ctl02 nova-api[9773]: 2017-09-28 12:49:55.245 9773 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:49:55 ctl02 nova-api[9773]: 2017-09-28 12:49:55.246 9773 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:49:55 ctl02 nova-api[9773]: 2017-09-28 12:49:55.246 9773 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:49:55 ctl02 nova-api[9773]: 2017-09-28 12:49:55.246 9773 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:49:55 ctl02 nova-api[9773]: 2017-09-28 12:49:55.246 9773 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:49:55 ctl02 nova-api[9773]: 2017-09-28 12:49:55.246 9773 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:49:55 ctl02 nova-api[9773]: 2017-09-28 12:49:55.246 9773 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:49:55 ctl02 nova-api[9773]: 2017-09-28 12:49:55.246 9773 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:49:55 ctl02 nova-api[9773]: 2017-09-28 12:49:55.246 9773 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:49:55 ctl02 nova-api[9773]: 2017-09-28 12:49:55.246 9773 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:49:55 ctl02 nova-api[9773]: 2017-09-28 12:49:55.246 9773 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:49:55 ctl02 nova-api[9773]: 2017-09-28 12:49:55.246 9773 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:49:55 ctl02 nova-api[9773]: 2017-09-28 12:49:55.246 9773 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:49:55 ctl02 nova-api[9773]: 2017-09-28 12:49:55.246 9773 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:49:55 ctl02 nova-api[9773]: 2017-09-28 12:49:55.246 9773 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:49:55 ctl02 nova-api[9773]: 2017-09-28 12:49:55.246 9773 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:49:55 ctl02 nova-api[9773]: 2017-09-28 12:49:55.246 9773 ERROR nova.wsgi     self.filename))
Sep 28 12:49:55 ctl02 nova-api[9773]: 2017-09-28 12:49:55.246 9773 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:49:55 ctl02 nova-api[9773]: 2017-09-28 12:49:55.246 9773 ERROR nova.wsgi
Sep 28 12:49:55 ctl02 nova-api[9773]: 2017-09-28 12:49:55.247 9773 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:49:55 ctl02 nova-api[9773]: 2017-09-28 12:49:55.379 9773 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:49:55 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:49:55 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:49:55 ctl02 nova-api[9773]: 2017-09-28 12:49:55.624 9773 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:49:55 ctl02 nova-api[9773]: 2017-09-28 12:49:55.626 9773 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:49:55 ctl02 nova-api[9773]: 2017-09-28 12:49:55.626 9773 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:49:55 ctl02 nova-api[9773]: 2017-09-28 12:49:55.626 9773 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:49:55 ctl02 nova-api[9773]: 2017-09-28 12:49:55.759 9773 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:49:55 ctl02 nova-api[9773]: 2017-09-28 12:49:55.761 9773 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:49:55 ctl02 nova-api[9773]: 2017-09-28 12:49:55.761 9773 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:49:55 ctl02 nova-api[9773]: 2017-09-28 12:49:55.762 9773 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:49:55 ctl02 nova-api[9773]: 2017-09-28 12:49:55.765 9773 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:49:55 ctl02 nova-api[9773]: 2017-09-28 12:49:55.765 9773 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:49:55 ctl02 nova-api[9773]: 2017-09-28 12:49:55.765 9773 ERROR nova Traceback (most recent call last):
Sep 28 12:49:55 ctl02 nova-api[9773]: 2017-09-28 12:49:55.765 9773 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:49:55 ctl02 nova-api[9773]: 2017-09-28 12:49:55.765 9773 ERROR nova     sys.exit(main())
Sep 28 12:49:55 ctl02 nova-api[9773]: 2017-09-28 12:49:55.765 9773 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:49:55 ctl02 nova-api[9773]: 2017-09-28 12:49:55.765 9773 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:49:55 ctl02 nova-api[9773]: 2017-09-28 12:49:55.765 9773 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:49:55 ctl02 nova-api[9773]: 2017-09-28 12:49:55.765 9773 ERROR nova     max_url_len=max_url_len)
Sep 28 12:49:55 ctl02 nova-api[9773]: 2017-09-28 12:49:55.765 9773 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:49:55 ctl02 nova-api[9773]: 2017-09-28 12:49:55.765 9773 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:49:55 ctl02 nova-api[9773]: 2017-09-28 12:49:55.765 9773 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:49:55 ctl02 nova-api[9773]: 2017-09-28 12:49:55.765 9773 ERROR nova     sock.listen(backlog)
Sep 28 12:49:55 ctl02 nova-api[9773]: 2017-09-28 12:49:55.765 9773 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:49:55 ctl02 nova-api[9773]: 2017-09-28 12:49:55.765 9773 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:49:55 ctl02 nova-api[9773]: 2017-09-28 12:49:55.765 9773 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:49:55 ctl02 nova-api[9773]: 2017-09-28 12:49:55.765 9773 ERROR nova
Sep 28 12:49:55 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:49:55 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:49:55 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:49:56 ctl02 nova-scheduler[5620]: 2017-09-28 12:49:56.051 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:49:56 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:49:56 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:49:56 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:49:56 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:49:56 ctl02 neutron-server[30536]: 2017-09-28 12:49:56.245 30602 WARNING oslo_messaging._drivers.amqpdriver [req-9ab51703-16bb-4bb7-8bbc-3fe47316893c - - - - -] reply_74787a9d28524b7f9c3c98994688cba9 doesn't exists, drop reply to 7dd631913fb34f5d90cbe99029ec8af1
Sep 28 12:49:56 ctl02 neutron-server[30536]: 2017-09-28 12:49:56.246 30602 INFO oslo_messaging._drivers.amqpdriver [req-9ab51703-16bb-4bb7-8bbc-3fe47316893c - - - - -] The reply 7dd631913fb34f5d90cbe99029ec8af1 cannot be sent  reply_74787a9d28524b7f9c3c98994688cba9 reply queue don't exist after 60 sec abandoning...
Sep 28 12:49:56 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:49:56.589 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:49:56] "OPTIONS / HTTP/1.0" 200 134 0.000444
Sep 28 12:49:56 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:49:56.794 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:49:56] "OPTIONS / HTTP/1.0" 200 134 0.000451
Sep 28 12:49:57 ctl02 heat-api-cfn[13300]: 2017-09-28 12:49:57.082 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:49:57] "OPTIONS / HTTP/1.0" 200 134 0.000440
Sep 28 12:49:57 ctl02 heat-api-cfn[13300]: 2017-09-28 12:49:57.718 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:49:57] "OPTIONS / HTTP/1.0" 200 134 0.000532
Sep 28 12:49:57 ctl02 nova-api[9795]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:49:57 ctl02 nova-api[9795]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:49:58 ctl02 nova-api[9795]: 2017-09-28 12:49:58.044 9795 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:49:58 ctl02 nova-api[9795]: 2017-09-28 12:49:58.046 9795 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:49:58 ctl02 nova-api[9795]: 2017-09-28 12:49:58.046 9795 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:49:58 ctl02 nova-api[9795]: 2017-09-28 12:49:58.046 9795 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:49:58 ctl02 nova-api[9795]: 2017-09-28 12:49:58.046 9795 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:49:58 ctl02 nova-api[9795]: 2017-09-28 12:49:58.046 9795 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:49:58 ctl02 nova-api[9795]: 2017-09-28 12:49:58.046 9795 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:49:58 ctl02 nova-api[9795]: 2017-09-28 12:49:58.046 9795 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:49:58 ctl02 nova-api[9795]: 2017-09-28 12:49:58.046 9795 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:49:58 ctl02 nova-api[9795]: 2017-09-28 12:49:58.046 9795 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:49:58 ctl02 nova-api[9795]: 2017-09-28 12:49:58.046 9795 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:49:58 ctl02 nova-api[9795]: 2017-09-28 12:49:58.046 9795 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:49:58 ctl02 nova-api[9795]: 2017-09-28 12:49:58.046 9795 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:49:58 ctl02 nova-api[9795]: 2017-09-28 12:49:58.046 9795 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:49:58 ctl02 nova-api[9795]: 2017-09-28 12:49:58.046 9795 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:49:58 ctl02 nova-api[9795]: 2017-09-28 12:49:58.046 9795 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:49:58 ctl02 nova-api[9795]: 2017-09-28 12:49:58.046 9795 ERROR nova.wsgi     self.filename))
Sep 28 12:49:58 ctl02 nova-api[9795]: 2017-09-28 12:49:58.046 9795 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:49:58 ctl02 nova-api[9795]: 2017-09-28 12:49:58.046 9795 ERROR nova.wsgi
Sep 28 12:49:58 ctl02 nova-api[9795]: 2017-09-28 12:49:58.048 9795 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:49:58 ctl02 heat-api[13008]: 2017-09-28 12:49:58.134 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:49:58] "OPTIONS / HTTP/1.0" 200 134 0.000657
Sep 28 12:49:58 ctl02 nova-api[9795]: 2017-09-28 12:49:58.185 9795 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:49:58 ctl02 nova-api[9795]: 2017-09-28 12:49:58.434 9795 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:49:58 ctl02 nova-api[9795]: 2017-09-28 12:49:58.437 9795 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:49:58 ctl02 nova-api[9795]: 2017-09-28 12:49:58.437 9795 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:49:58 ctl02 nova-api[9795]: 2017-09-28 12:49:58.437 9795 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:49:58 ctl02 nova-api[9795]: 2017-09-28 12:49:58.572 9795 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:49:58 ctl02 nova-api[9795]: 2017-09-28 12:49:58.574 9795 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:49:58 ctl02 nova-api[9795]: 2017-09-28 12:49:58.574 9795 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:49:58 ctl02 nova-api[9795]: 2017-09-28 12:49:58.574 9795 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:49:58 ctl02 nova-api[9795]: 2017-09-28 12:49:58.578 9795 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:49:58 ctl02 nova-api[9795]: 2017-09-28 12:49:58.578 9795 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:49:58 ctl02 nova-api[9795]: 2017-09-28 12:49:58.578 9795 ERROR nova Traceback (most recent call last):
Sep 28 12:49:58 ctl02 nova-api[9795]: 2017-09-28 12:49:58.578 9795 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:49:58 ctl02 nova-api[9795]: 2017-09-28 12:49:58.578 9795 ERROR nova     sys.exit(main())
Sep 28 12:49:58 ctl02 nova-api[9795]: 2017-09-28 12:49:58.578 9795 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:49:58 ctl02 nova-api[9795]: 2017-09-28 12:49:58.578 9795 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:49:58 ctl02 nova-api[9795]: 2017-09-28 12:49:58.578 9795 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:49:58 ctl02 nova-api[9795]: 2017-09-28 12:49:58.578 9795 ERROR nova     max_url_len=max_url_len)
Sep 28 12:49:58 ctl02 nova-api[9795]: 2017-09-28 12:49:58.578 9795 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:49:58 ctl02 nova-api[9795]: 2017-09-28 12:49:58.578 9795 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:49:58 ctl02 nova-api[9795]: 2017-09-28 12:49:58.578 9795 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:49:58 ctl02 nova-api[9795]: 2017-09-28 12:49:58.578 9795 ERROR nova     sock.listen(backlog)
Sep 28 12:49:58 ctl02 nova-api[9795]: 2017-09-28 12:49:58.578 9795 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:49:58 ctl02 nova-api[9795]: 2017-09-28 12:49:58.578 9795 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:49:58 ctl02 nova-api[9795]: 2017-09-28 12:49:58.578 9795 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:49:58 ctl02 nova-api[9795]: 2017-09-28 12:49:58.578 9795 ERROR nova
Sep 28 12:49:58 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:49:58 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:49:58 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:49:58 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:49:58 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:49:58 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:49:58 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:49:59 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:49:59.337 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:49:59] "OPTIONS / HTTP/1.0" 200 134 0.000439
Sep 28 12:49:59 ctl02 heat-api[13008]: 2017-09-28 12:49:59.575 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:49:59] "OPTIONS / HTTP/1.0" 200 134 0.000618
Sep 28 12:49:59 ctl02 glance-api[29183]: 2017-09-28 12:49:59.958 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:49:59] "OPTIONS / HTTP/1.0" 200 134 0.000635
Sep 28 12:50:00 ctl02 nova-api[9814]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:50:00 ctl02 nova-api[9814]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:50:00 ctl02 heat-api-cfn[13300]: 2017-09-28 12:50:00.722 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:50:00] "OPTIONS / HTTP/1.0" 200 134 0.000558
Sep 28 12:50:00 ctl02 nova-api[9814]: 2017-09-28 12:50:00.730 9814 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:50:00 ctl02 nova-api[9814]: 2017-09-28 12:50:00.731 9814 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:50:00 ctl02 nova-api[9814]: 2017-09-28 12:50:00.731 9814 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:50:00 ctl02 nova-api[9814]: 2017-09-28 12:50:00.731 9814 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:50:00 ctl02 nova-api[9814]: 2017-09-28 12:50:00.731 9814 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:50:00 ctl02 nova-api[9814]: 2017-09-28 12:50:00.731 9814 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:50:00 ctl02 nova-api[9814]: 2017-09-28 12:50:00.731 9814 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:50:00 ctl02 nova-api[9814]: 2017-09-28 12:50:00.731 9814 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:50:00 ctl02 nova-api[9814]: 2017-09-28 12:50:00.731 9814 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:50:00 ctl02 nova-api[9814]: 2017-09-28 12:50:00.731 9814 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:50:00 ctl02 nova-api[9814]: 2017-09-28 12:50:00.731 9814 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:50:00 ctl02 nova-api[9814]: 2017-09-28 12:50:00.731 9814 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:50:00 ctl02 nova-api[9814]: 2017-09-28 12:50:00.731 9814 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:50:00 ctl02 nova-api[9814]: 2017-09-28 12:50:00.731 9814 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:50:00 ctl02 nova-api[9814]: 2017-09-28 12:50:00.731 9814 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:50:00 ctl02 nova-api[9814]: 2017-09-28 12:50:00.731 9814 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:50:00 ctl02 nova-api[9814]: 2017-09-28 12:50:00.731 9814 ERROR nova.wsgi     self.filename))
Sep 28 12:50:00 ctl02 nova-api[9814]: 2017-09-28 12:50:00.731 9814 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:50:00 ctl02 nova-api[9814]: 2017-09-28 12:50:00.731 9814 ERROR nova.wsgi
Sep 28 12:50:00 ctl02 nova-api[9814]: 2017-09-28 12:50:00.732 9814 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:50:00 ctl02 neutron-server[30536]: 2017-09-28 12:50:00.742 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:50:00] "OPTIONS / HTTP/1.0" 200 262 0.000636
Sep 28 12:50:00 ctl02 nova-api[9814]: 2017-09-28 12:50:00.857 9814 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:50:00 ctl02 glance-api[29183]: 2017-09-28 12:50:00.964 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:50:00] "OPTIONS / HTTP/1.0" 200 134 0.000580
Sep 28 12:50:01 ctl02 nova-api[9814]: 2017-09-28 12:50:01.109 9814 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:50:01 ctl02 nova-api[9814]: 2017-09-28 12:50:01.112 9814 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:50:01 ctl02 nova-api[9814]: 2017-09-28 12:50:01.112 9814 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:50:01 ctl02 nova-api[9814]: 2017-09-28 12:50:01.113 9814 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:50:01 ctl02 nova-api[9814]: 2017-09-28 12:50:01.247 9814 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:50:01 ctl02 nova-api[9814]: 2017-09-28 12:50:01.250 9814 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:50:01 ctl02 nova-api[9814]: 2017-09-28 12:50:01.250 9814 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:50:01 ctl02 nova-api[9814]: 2017-09-28 12:50:01.250 9814 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:50:01 ctl02 nova-api[9814]: 2017-09-28 12:50:01.254 9814 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:50:01 ctl02 nova-api[9814]: 2017-09-28 12:50:01.254 9814 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:50:01 ctl02 nova-api[9814]: 2017-09-28 12:50:01.254 9814 ERROR nova Traceback (most recent call last):
Sep 28 12:50:01 ctl02 nova-api[9814]: 2017-09-28 12:50:01.254 9814 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:50:01 ctl02 nova-api[9814]: 2017-09-28 12:50:01.254 9814 ERROR nova     sys.exit(main())
Sep 28 12:50:01 ctl02 nova-api[9814]: 2017-09-28 12:50:01.254 9814 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:50:01 ctl02 nova-api[9814]: 2017-09-28 12:50:01.254 9814 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:50:01 ctl02 nova-api[9814]: 2017-09-28 12:50:01.254 9814 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:50:01 ctl02 nova-api[9814]: 2017-09-28 12:50:01.254 9814 ERROR nova     max_url_len=max_url_len)
Sep 28 12:50:01 ctl02 nova-api[9814]: 2017-09-28 12:50:01.254 9814 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:50:01 ctl02 nova-api[9814]: 2017-09-28 12:50:01.254 9814 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:50:01 ctl02 nova-api[9814]: 2017-09-28 12:50:01.254 9814 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:50:01 ctl02 nova-api[9814]: 2017-09-28 12:50:01.254 9814 ERROR nova     sock.listen(backlog)
Sep 28 12:50:01 ctl02 nova-api[9814]: 2017-09-28 12:50:01.254 9814 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:50:01 ctl02 nova-api[9814]: 2017-09-28 12:50:01.254 9814 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:50:01 ctl02 nova-api[9814]: 2017-09-28 12:50:01.254 9814 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:50:01 ctl02 nova-api[9814]: 2017-09-28 12:50:01.254 9814 ERROR nova
Sep 28 12:50:01 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:50:01 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:50:01 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:50:01 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:50:01 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:50:01 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:50:01 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:50:01 ctl02 neutron-server[30536]: 2017-09-28 12:50:01.708 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:50:01] "OPTIONS / HTTP/1.0" 200 262 0.000597
Sep 28 12:50:01 ctl02 glance-api[29183]: 2017-09-28 12:50:01.848 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:50:01] "OPTIONS / HTTP/1.0" 200 134 0.000591
Sep 28 12:50:02 ctl02 neutron-server[30536]: 2017-09-28 12:50:02.561 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:50:02] "OPTIONS / HTTP/1.0" 200 262 0.000466
Sep 28 12:50:03 ctl02 nova-api[9832]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:50:03 ctl02 nova-api[9832]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:50:03 ctl02 nova-api[9832]: 2017-09-28 12:50:03.495 9832 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:50:03 ctl02 nova-api[9832]: 2017-09-28 12:50:03.497 9832 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:50:03 ctl02 nova-api[9832]: 2017-09-28 12:50:03.497 9832 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:50:03 ctl02 nova-api[9832]: 2017-09-28 12:50:03.497 9832 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:50:03 ctl02 nova-api[9832]: 2017-09-28 12:50:03.497 9832 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:50:03 ctl02 nova-api[9832]: 2017-09-28 12:50:03.497 9832 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:50:03 ctl02 nova-api[9832]: 2017-09-28 12:50:03.497 9832 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:50:03 ctl02 nova-api[9832]: 2017-09-28 12:50:03.497 9832 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:50:03 ctl02 nova-api[9832]: 2017-09-28 12:50:03.497 9832 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:50:03 ctl02 nova-api[9832]: 2017-09-28 12:50:03.497 9832 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:50:03 ctl02 nova-api[9832]: 2017-09-28 12:50:03.497 9832 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:50:03 ctl02 nova-api[9832]: 2017-09-28 12:50:03.497 9832 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:50:03 ctl02 nova-api[9832]: 2017-09-28 12:50:03.497 9832 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:50:03 ctl02 nova-api[9832]: 2017-09-28 12:50:03.497 9832 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:50:03 ctl02 nova-api[9832]: 2017-09-28 12:50:03.497 9832 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:50:03 ctl02 nova-api[9832]: 2017-09-28 12:50:03.497 9832 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:50:03 ctl02 nova-api[9832]: 2017-09-28 12:50:03.497 9832 ERROR nova.wsgi     self.filename))
Sep 28 12:50:03 ctl02 nova-api[9832]: 2017-09-28 12:50:03.497 9832 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:50:03 ctl02 nova-api[9832]: 2017-09-28 12:50:03.497 9832 ERROR nova.wsgi
Sep 28 12:50:03 ctl02 nova-api[9832]: 2017-09-28 12:50:03.498 9832 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:50:03 ctl02 nova-api[9832]: 2017-09-28 12:50:03.625 9832 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:50:03 ctl02 heat-api[13008]: 2017-09-28 12:50:03.629 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:50:03] "OPTIONS / HTTP/1.0" 200 134 0.000550
Sep 28 12:50:03 ctl02 nova-api[9832]: 2017-09-28 12:50:03.850 9832 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:50:03 ctl02 nova-api[9832]: 2017-09-28 12:50:03.853 9832 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:50:03 ctl02 nova-api[9832]: 2017-09-28 12:50:03.853 9832 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:50:03 ctl02 nova-api[9832]: 2017-09-28 12:50:03.853 9832 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:50:03 ctl02 nova-api[9832]: 2017-09-28 12:50:03.983 9832 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:50:03 ctl02 nova-api[9832]: 2017-09-28 12:50:03.985 9832 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:50:03 ctl02 nova-api[9832]: 2017-09-28 12:50:03.986 9832 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:50:03 ctl02 nova-api[9832]: 2017-09-28 12:50:03.986 9832 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:50:03 ctl02 nova-api[9832]: 2017-09-28 12:50:03.989 9832 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:50:03 ctl02 nova-api[9832]: 2017-09-28 12:50:03.989 9832 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:50:03 ctl02 nova-api[9832]: 2017-09-28 12:50:03.989 9832 ERROR nova Traceback (most recent call last):
Sep 28 12:50:03 ctl02 nova-api[9832]: 2017-09-28 12:50:03.989 9832 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:50:03 ctl02 nova-api[9832]: 2017-09-28 12:50:03.989 9832 ERROR nova     sys.exit(main())
Sep 28 12:50:03 ctl02 nova-api[9832]: 2017-09-28 12:50:03.989 9832 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:50:03 ctl02 nova-api[9832]: 2017-09-28 12:50:03.989 9832 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:50:03 ctl02 nova-api[9832]: 2017-09-28 12:50:03.989 9832 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:50:03 ctl02 nova-api[9832]: 2017-09-28 12:50:03.989 9832 ERROR nova     max_url_len=max_url_len)
Sep 28 12:50:03 ctl02 nova-api[9832]: 2017-09-28 12:50:03.989 9832 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:50:03 ctl02 nova-api[9832]: 2017-09-28 12:50:03.989 9832 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:50:03 ctl02 nova-api[9832]: 2017-09-28 12:50:03.989 9832 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:50:03 ctl02 nova-api[9832]: 2017-09-28 12:50:03.989 9832 ERROR nova     sock.listen(backlog)
Sep 28 12:50:03 ctl02 nova-api[9832]: 2017-09-28 12:50:03.989 9832 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:50:03 ctl02 nova-api[9832]: 2017-09-28 12:50:03.989 9832 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:50:03 ctl02 nova-api[9832]: 2017-09-28 12:50:03.989 9832 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:50:03 ctl02 nova-api[9832]: 2017-09-28 12:50:03.989 9832 ERROR nova
Sep 28 12:50:04 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:50:04 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:50:04 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:50:04 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:50:04 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:50:04 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:50:04 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:50:06 ctl02 nova-api[9850]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:50:06 ctl02 nova-api[9850]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:50:06 ctl02 neutron-server[30536]: 2017-09-28 12:50:06.195 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 2 dead agents out of 6:
Sep 28 12:50:06 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:50:06 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:48:56 cmp002
Sep 28 12:50:06 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:48:16 cmp002
Sep 28 12:50:06 ctl02 nova-api[9850]: 2017-09-28 12:50:06.246 9850 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:50:06 ctl02 nova-api[9850]: 2017-09-28 12:50:06.248 9850 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:50:06 ctl02 nova-api[9850]: 2017-09-28 12:50:06.248 9850 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:50:06 ctl02 nova-api[9850]: 2017-09-28 12:50:06.248 9850 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:50:06 ctl02 nova-api[9850]: 2017-09-28 12:50:06.248 9850 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:50:06 ctl02 nova-api[9850]: 2017-09-28 12:50:06.248 9850 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:50:06 ctl02 nova-api[9850]: 2017-09-28 12:50:06.248 9850 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:50:06 ctl02 nova-api[9850]: 2017-09-28 12:50:06.248 9850 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:50:06 ctl02 nova-api[9850]: 2017-09-28 12:50:06.248 9850 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:50:06 ctl02 nova-api[9850]: 2017-09-28 12:50:06.248 9850 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:50:06 ctl02 nova-api[9850]: 2017-09-28 12:50:06.248 9850 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:50:06 ctl02 nova-api[9850]: 2017-09-28 12:50:06.248 9850 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:50:06 ctl02 nova-api[9850]: 2017-09-28 12:50:06.248 9850 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:50:06 ctl02 nova-api[9850]: 2017-09-28 12:50:06.248 9850 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:50:06 ctl02 nova-api[9850]: 2017-09-28 12:50:06.248 9850 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:50:06 ctl02 nova-api[9850]: 2017-09-28 12:50:06.248 9850 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:50:06 ctl02 nova-api[9850]: 2017-09-28 12:50:06.248 9850 ERROR nova.wsgi     self.filename))
Sep 28 12:50:06 ctl02 nova-api[9850]: 2017-09-28 12:50:06.248 9850 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:50:06 ctl02 nova-api[9850]: 2017-09-28 12:50:06.248 9850 ERROR nova.wsgi
Sep 28 12:50:06 ctl02 nova-api[9850]: 2017-09-28 12:50:06.249 9850 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:50:06 ctl02 nova-api[9850]: 2017-09-28 12:50:06.389 9850 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:50:06 ctl02 nova-api[9850]: 2017-09-28 12:50:06.639 9850 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:50:06 ctl02 nova-api[9850]: 2017-09-28 12:50:06.641 9850 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:50:06 ctl02 nova-api[9850]: 2017-09-28 12:50:06.642 9850 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:50:06 ctl02 nova-api[9850]: 2017-09-28 12:50:06.642 9850 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:50:06 ctl02 nova-api[9850]: 2017-09-28 12:50:06.776 9850 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:50:06 ctl02 nova-api[9850]: 2017-09-28 12:50:06.778 9850 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:50:06 ctl02 nova-api[9850]: 2017-09-28 12:50:06.779 9850 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:50:06 ctl02 nova-api[9850]: 2017-09-28 12:50:06.779 9850 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:50:06 ctl02 nova-api[9850]: 2017-09-28 12:50:06.782 9850 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:50:06 ctl02 nova-api[9850]: 2017-09-28 12:50:06.783 9850 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:50:06 ctl02 nova-api[9850]: 2017-09-28 12:50:06.783 9850 ERROR nova Traceback (most recent call last):
Sep 28 12:50:06 ctl02 nova-api[9850]: 2017-09-28 12:50:06.783 9850 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:50:06 ctl02 nova-api[9850]: 2017-09-28 12:50:06.783 9850 ERROR nova     sys.exit(main())
Sep 28 12:50:06 ctl02 nova-api[9850]: 2017-09-28 12:50:06.783 9850 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:50:06 ctl02 nova-api[9850]: 2017-09-28 12:50:06.783 9850 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:50:06 ctl02 nova-api[9850]: 2017-09-28 12:50:06.783 9850 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:50:06 ctl02 nova-api[9850]: 2017-09-28 12:50:06.783 9850 ERROR nova     max_url_len=max_url_len)
Sep 28 12:50:06 ctl02 nova-api[9850]: 2017-09-28 12:50:06.783 9850 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:50:06 ctl02 nova-api[9850]: 2017-09-28 12:50:06.783 9850 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:50:06 ctl02 nova-api[9850]: 2017-09-28 12:50:06.783 9850 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:50:06 ctl02 nova-api[9850]: 2017-09-28 12:50:06.783 9850 ERROR nova     sock.listen(backlog)
Sep 28 12:50:06 ctl02 nova-api[9850]: 2017-09-28 12:50:06.783 9850 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:50:06 ctl02 nova-api[9850]: 2017-09-28 12:50:06.783 9850 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:50:06 ctl02 nova-api[9850]: 2017-09-28 12:50:06.783 9850 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:50:06 ctl02 nova-api[9850]: 2017-09-28 12:50:06.783 9850 ERROR nova
Sep 28 12:50:06 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:50:06.802 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:50:06] "OPTIONS / HTTP/1.0" 200 134 0.000457
Sep 28 12:50:06 ctl02 heat-api-cfn[13300]: 2017-09-28 12:50:06.891 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:50:06] "OPTIONS / HTTP/1.0" 200 134 0.000444
Sep 28 12:50:06 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:50:06 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:50:06 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:50:07 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:50:07.086 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:50:07] "OPTIONS / HTTP/1.0" 200 134 0.000350
Sep 28 12:50:07 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:50:07 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:50:07 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:50:07 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:50:07 ctl02 heat-api-cfn[13300]: 2017-09-28 12:50:07.324 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:50:07] "OPTIONS / HTTP/1.0" 200 134 0.000584
Sep 28 12:50:08 ctl02 heat-api[13008]: 2017-09-28 12:50:08.039 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:50:08] "OPTIONS / HTTP/1.0" 200 134 0.000536
Sep 28 12:50:08 ctl02 nova-api[9868]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:50:08 ctl02 nova-api[9868]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:50:08 ctl02 nova-api[9868]: 2017-09-28 12:50:08.980 9868 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:50:08 ctl02 nova-api[9868]: 2017-09-28 12:50:08.982 9868 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:50:08 ctl02 nova-api[9868]: 2017-09-28 12:50:08.982 9868 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:50:08 ctl02 nova-api[9868]: 2017-09-28 12:50:08.982 9868 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:50:08 ctl02 nova-api[9868]: 2017-09-28 12:50:08.982 9868 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:50:08 ctl02 nova-api[9868]: 2017-09-28 12:50:08.982 9868 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:50:08 ctl02 nova-api[9868]: 2017-09-28 12:50:08.982 9868 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:50:08 ctl02 nova-api[9868]: 2017-09-28 12:50:08.982 9868 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:50:08 ctl02 nova-api[9868]: 2017-09-28 12:50:08.982 9868 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:50:08 ctl02 nova-api[9868]: 2017-09-28 12:50:08.982 9868 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:50:08 ctl02 nova-api[9868]: 2017-09-28 12:50:08.982 9868 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:50:08 ctl02 nova-api[9868]: 2017-09-28 12:50:08.982 9868 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:50:08 ctl02 nova-api[9868]: 2017-09-28 12:50:08.982 9868 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:50:08 ctl02 nova-api[9868]: 2017-09-28 12:50:08.982 9868 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:50:08 ctl02 nova-api[9868]: 2017-09-28 12:50:08.982 9868 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:50:08 ctl02 nova-api[9868]: 2017-09-28 12:50:08.982 9868 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:50:08 ctl02 nova-api[9868]: 2017-09-28 12:50:08.982 9868 ERROR nova.wsgi     self.filename))
Sep 28 12:50:08 ctl02 nova-api[9868]: 2017-09-28 12:50:08.982 9868 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:50:08 ctl02 nova-api[9868]: 2017-09-28 12:50:08.982 9868 ERROR nova.wsgi
Sep 28 12:50:08 ctl02 nova-api[9868]: 2017-09-28 12:50:08.983 9868 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:50:09 ctl02 nova-api[9868]: 2017-09-28 12:50:09.111 9868 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:50:09 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:50:09.288 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:50:09] "OPTIONS / HTTP/1.0" 200 134 0.000470
Sep 28 12:50:09 ctl02 nova-api[9868]: 2017-09-28 12:50:09.338 9868 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:50:09 ctl02 heat-api[13008]: 2017-09-28 12:50:09.340 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:50:09] "OPTIONS / HTTP/1.0" 200 134 0.000546
Sep 28 12:50:09 ctl02 nova-api[9868]: 2017-09-28 12:50:09.341 9868 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:50:09 ctl02 nova-api[9868]: 2017-09-28 12:50:09.342 9868 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:50:09 ctl02 nova-api[9868]: 2017-09-28 12:50:09.342 9868 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:50:09 ctl02 nova-api[9868]: 2017-09-28 12:50:09.470 9868 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:50:09 ctl02 nova-api[9868]: 2017-09-28 12:50:09.472 9868 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:50:09 ctl02 nova-api[9868]: 2017-09-28 12:50:09.472 9868 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:50:09 ctl02 nova-api[9868]: 2017-09-28 12:50:09.472 9868 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:50:09 ctl02 nova-api[9868]: 2017-09-28 12:50:09.476 9868 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:50:09 ctl02 nova-api[9868]: 2017-09-28 12:50:09.476 9868 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:50:09 ctl02 nova-api[9868]: 2017-09-28 12:50:09.476 9868 ERROR nova Traceback (most recent call last):
Sep 28 12:50:09 ctl02 nova-api[9868]: 2017-09-28 12:50:09.476 9868 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:50:09 ctl02 nova-api[9868]: 2017-09-28 12:50:09.476 9868 ERROR nova     sys.exit(main())
Sep 28 12:50:09 ctl02 nova-api[9868]: 2017-09-28 12:50:09.476 9868 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:50:09 ctl02 nova-api[9868]: 2017-09-28 12:50:09.476 9868 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:50:09 ctl02 nova-api[9868]: 2017-09-28 12:50:09.476 9868 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:50:09 ctl02 nova-api[9868]: 2017-09-28 12:50:09.476 9868 ERROR nova     max_url_len=max_url_len)
Sep 28 12:50:09 ctl02 nova-api[9868]: 2017-09-28 12:50:09.476 9868 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:50:09 ctl02 nova-api[9868]: 2017-09-28 12:50:09.476 9868 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:50:09 ctl02 nova-api[9868]: 2017-09-28 12:50:09.476 9868 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:50:09 ctl02 nova-api[9868]: 2017-09-28 12:50:09.476 9868 ERROR nova     sock.listen(backlog)
Sep 28 12:50:09 ctl02 nova-api[9868]: 2017-09-28 12:50:09.476 9868 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:50:09 ctl02 nova-api[9868]: 2017-09-28 12:50:09.476 9868 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:50:09 ctl02 nova-api[9868]: 2017-09-28 12:50:09.476 9868 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:50:09 ctl02 nova-api[9868]: 2017-09-28 12:50:09.476 9868 ERROR nova
Sep 28 12:50:09 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:50:09 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:50:09 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:50:09 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:50:09 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:50:09 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:50:09 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:50:10 ctl02 glance-api[29183]: 2017-09-28 12:50:10.283 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:50:10] "OPTIONS / HTTP/1.0" 200 134 0.000586
Sep 28 12:50:10 ctl02 heat-api-cfn[13300]: 2017-09-28 12:50:10.436 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:50:10] "OPTIONS / HTTP/1.0" 200 134 0.000555
Sep 28 12:50:10 ctl02 neutron-server[30536]: 2017-09-28 12:50:10.618 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:50:10] "OPTIONS / HTTP/1.0" 200 262 0.000565
Sep 28 12:50:11 ctl02 glance-api[29183]: 2017-09-28 12:50:11.057 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:50:11] "OPTIONS / HTTP/1.0" 200 134 0.000588
Sep 28 12:50:11 ctl02 neutron-server[30536]: 2017-09-28 12:50:11.371 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:50:11] "OPTIONS / HTTP/1.0" 200 262 0.000547
Sep 28 12:50:11 ctl02 nova-api[9886]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:50:11 ctl02 nova-api[9886]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:50:11 ctl02 nova-api[9886]: 2017-09-28 12:50:11.748 9886 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:50:11 ctl02 nova-api[9886]: 2017-09-28 12:50:11.750 9886 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:50:11 ctl02 nova-api[9886]: 2017-09-28 12:50:11.750 9886 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:50:11 ctl02 nova-api[9886]: 2017-09-28 12:50:11.750 9886 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:50:11 ctl02 nova-api[9886]: 2017-09-28 12:50:11.750 9886 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:50:11 ctl02 nova-api[9886]: 2017-09-28 12:50:11.750 9886 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:50:11 ctl02 nova-api[9886]: 2017-09-28 12:50:11.750 9886 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:50:11 ctl02 nova-api[9886]: 2017-09-28 12:50:11.750 9886 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:50:11 ctl02 nova-api[9886]: 2017-09-28 12:50:11.750 9886 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:50:11 ctl02 nova-api[9886]: 2017-09-28 12:50:11.750 9886 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:50:11 ctl02 nova-api[9886]: 2017-09-28 12:50:11.750 9886 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:50:11 ctl02 nova-api[9886]: 2017-09-28 12:50:11.750 9886 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:50:11 ctl02 nova-api[9886]: 2017-09-28 12:50:11.750 9886 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:50:11 ctl02 nova-api[9886]: 2017-09-28 12:50:11.750 9886 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:50:11 ctl02 nova-api[9886]: 2017-09-28 12:50:11.750 9886 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:50:11 ctl02 nova-api[9886]: 2017-09-28 12:50:11.750 9886 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:50:11 ctl02 nova-api[9886]: 2017-09-28 12:50:11.750 9886 ERROR nova.wsgi     self.filename))
Sep 28 12:50:11 ctl02 nova-api[9886]: 2017-09-28 12:50:11.750 9886 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:50:11 ctl02 nova-api[9886]: 2017-09-28 12:50:11.750 9886 ERROR nova.wsgi
Sep 28 12:50:11 ctl02 nova-api[9886]: 2017-09-28 12:50:11.753 9886 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:50:11 ctl02 nova-api[9886]: 2017-09-28 12:50:11.882 9886 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:50:12 ctl02 glance-api[29183]: 2017-09-28 12:50:12.046 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:50:12] "OPTIONS / HTTP/1.0" 200 134 0.000571
Sep 28 12:50:12 ctl02 nova-api[9886]: 2017-09-28 12:50:12.107 9886 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:50:12 ctl02 nova-api[9886]: 2017-09-28 12:50:12.110 9886 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:50:12 ctl02 nova-api[9886]: 2017-09-28 12:50:12.110 9886 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:50:12 ctl02 nova-api[9886]: 2017-09-28 12:50:12.111 9886 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:50:12 ctl02 neutron-server[30536]: 2017-09-28 12:50:12.210 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:50:12] "OPTIONS / HTTP/1.0" 200 262 0.000586
Sep 28 12:50:12 ctl02 nova-api[9886]: 2017-09-28 12:50:12.243 9886 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:50:12 ctl02 nova-api[9886]: 2017-09-28 12:50:12.245 9886 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:50:12 ctl02 nova-api[9886]: 2017-09-28 12:50:12.245 9886 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:50:12 ctl02 nova-api[9886]: 2017-09-28 12:50:12.246 9886 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:50:12 ctl02 nova-api[9886]: 2017-09-28 12:50:12.249 9886 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:50:12 ctl02 nova-api[9886]: 2017-09-28 12:50:12.250 9886 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:50:12 ctl02 nova-api[9886]: 2017-09-28 12:50:12.250 9886 ERROR nova Traceback (most recent call last):
Sep 28 12:50:12 ctl02 nova-api[9886]: 2017-09-28 12:50:12.250 9886 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:50:12 ctl02 nova-api[9886]: 2017-09-28 12:50:12.250 9886 ERROR nova     sys.exit(main())
Sep 28 12:50:12 ctl02 nova-api[9886]: 2017-09-28 12:50:12.250 9886 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:50:12 ctl02 nova-api[9886]: 2017-09-28 12:50:12.250 9886 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:50:12 ctl02 nova-api[9886]: 2017-09-28 12:50:12.250 9886 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:50:12 ctl02 nova-api[9886]: 2017-09-28 12:50:12.250 9886 ERROR nova     max_url_len=max_url_len)
Sep 28 12:50:12 ctl02 nova-api[9886]: 2017-09-28 12:50:12.250 9886 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:50:12 ctl02 nova-api[9886]: 2017-09-28 12:50:12.250 9886 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:50:12 ctl02 nova-api[9886]: 2017-09-28 12:50:12.250 9886 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:50:12 ctl02 nova-api[9886]: 2017-09-28 12:50:12.250 9886 ERROR nova     sock.listen(backlog)
Sep 28 12:50:12 ctl02 nova-api[9886]: 2017-09-28 12:50:12.250 9886 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:50:12 ctl02 nova-api[9886]: 2017-09-28 12:50:12.250 9886 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:50:12 ctl02 nova-api[9886]: 2017-09-28 12:50:12.250 9886 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:50:12 ctl02 nova-api[9886]: 2017-09-28 12:50:12.250 9886 ERROR nova
Sep 28 12:50:12 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:50:12 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:50:12 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:50:12 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:50:12 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:50:12 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:50:12 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:50:13 ctl02 neutron-server[30536]: 2017-09-28 12:50:13.517 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:50:13 ctl02 heat-api[13008]: 2017-09-28 12:50:13.905 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:50:13] "OPTIONS / HTTP/1.0" 200 134 0.000624
Sep 28 12:50:14 ctl02 nova-api[9904]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:50:14 ctl02 nova-api[9904]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:50:14 ctl02 nova-api[9904]: 2017-09-28 12:50:14.541 9904 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:50:14 ctl02 nova-api[9904]: 2017-09-28 12:50:14.542 9904 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:50:14 ctl02 nova-api[9904]: 2017-09-28 12:50:14.542 9904 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:50:14 ctl02 nova-api[9904]: 2017-09-28 12:50:14.542 9904 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:50:14 ctl02 nova-api[9904]: 2017-09-28 12:50:14.542 9904 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:50:14 ctl02 nova-api[9904]: 2017-09-28 12:50:14.542 9904 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:50:14 ctl02 nova-api[9904]: 2017-09-28 12:50:14.542 9904 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:50:14 ctl02 nova-api[9904]: 2017-09-28 12:50:14.542 9904 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:50:14 ctl02 nova-api[9904]: 2017-09-28 12:50:14.542 9904 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:50:14 ctl02 nova-api[9904]: 2017-09-28 12:50:14.542 9904 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:50:14 ctl02 nova-api[9904]: 2017-09-28 12:50:14.542 9904 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:50:14 ctl02 nova-api[9904]: 2017-09-28 12:50:14.542 9904 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:50:14 ctl02 nova-api[9904]: 2017-09-28 12:50:14.542 9904 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:50:14 ctl02 nova-api[9904]: 2017-09-28 12:50:14.542 9904 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:50:14 ctl02 nova-api[9904]: 2017-09-28 12:50:14.542 9904 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:50:14 ctl02 nova-api[9904]: 2017-09-28 12:50:14.542 9904 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:50:14 ctl02 nova-api[9904]: 2017-09-28 12:50:14.542 9904 ERROR nova.wsgi     self.filename))
Sep 28 12:50:14 ctl02 nova-api[9904]: 2017-09-28 12:50:14.542 9904 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:50:14 ctl02 nova-api[9904]: 2017-09-28 12:50:14.542 9904 ERROR nova.wsgi
Sep 28 12:50:14 ctl02 nova-api[9904]: 2017-09-28 12:50:14.543 9904 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:50:14 ctl02 nova-api[9904]: 2017-09-28 12:50:14.674 9904 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:50:14 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xabc17517)
Sep 28 12:50:14 ctl02 nova-api[9904]: 2017-09-28 12:50:14.921 9904 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:50:14 ctl02 nova-api[9904]: 2017-09-28 12:50:14.923 9904 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:50:14 ctl02 nova-api[9904]: 2017-09-28 12:50:14.923 9904 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:50:14 ctl02 nova-api[9904]: 2017-09-28 12:50:14.924 9904 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:50:15 ctl02 nova-conductor[5056]: 2017-09-28 12:50:15.054 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:50:15 ctl02 nova-api[9904]: 2017-09-28 12:50:15.054 9904 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:50:15 ctl02 nova-api[9904]: 2017-09-28 12:50:15.056 9904 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:50:15 ctl02 nova-api[9904]: 2017-09-28 12:50:15.056 9904 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:50:15 ctl02 nova-api[9904]: 2017-09-28 12:50:15.057 9904 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:50:15 ctl02 nova-api[9904]: 2017-09-28 12:50:15.060 9904 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:50:15 ctl02 nova-api[9904]: 2017-09-28 12:50:15.060 9904 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:50:15 ctl02 nova-api[9904]: 2017-09-28 12:50:15.060 9904 ERROR nova Traceback (most recent call last):
Sep 28 12:50:15 ctl02 nova-api[9904]: 2017-09-28 12:50:15.060 9904 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:50:15 ctl02 nova-api[9904]: 2017-09-28 12:50:15.060 9904 ERROR nova     sys.exit(main())
Sep 28 12:50:15 ctl02 nova-api[9904]: 2017-09-28 12:50:15.060 9904 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:50:15 ctl02 nova-api[9904]: 2017-09-28 12:50:15.060 9904 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:50:15 ctl02 nova-api[9904]: 2017-09-28 12:50:15.060 9904 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:50:15 ctl02 nova-api[9904]: 2017-09-28 12:50:15.060 9904 ERROR nova     max_url_len=max_url_len)
Sep 28 12:50:15 ctl02 nova-api[9904]: 2017-09-28 12:50:15.060 9904 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:50:15 ctl02 nova-api[9904]: 2017-09-28 12:50:15.060 9904 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:50:15 ctl02 nova-api[9904]: 2017-09-28 12:50:15.060 9904 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:50:15 ctl02 nova-api[9904]: 2017-09-28 12:50:15.060 9904 ERROR nova     sock.listen(backlog)
Sep 28 12:50:15 ctl02 nova-api[9904]: 2017-09-28 12:50:15.060 9904 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:50:15 ctl02 nova-api[9904]: 2017-09-28 12:50:15.060 9904 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:50:15 ctl02 nova-api[9904]: 2017-09-28 12:50:15.060 9904 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:50:15 ctl02 nova-api[9904]: 2017-09-28 12:50:15.060 9904 ERROR nova
Sep 28 12:50:15 ctl02 nova-conductor[5056]: 2017-09-28 12:50:15.082 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:50:15 ctl02 nova-conductor[5056]: 2017-09-28 12:50:15.110 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:50:15 ctl02 nova-conductor[5056]: 2017-09-28 12:50:15.115 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:50:15 ctl02 nova-cert[4860]: 2017-09-28 12:50:15.143 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:50:15 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:50:15 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:50:15 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:50:15 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:50:15 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:50:15 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:50:15 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:50:15 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xabc17517)
Sep 28 12:50:16 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:50:16.721 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:50:16] "OPTIONS / HTTP/1.0" 200 134 0.000433
Sep 28 12:50:16 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xabc17517)
Sep 28 12:50:16 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:50:16.802 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:50:16] "OPTIONS / HTTP/1.0" 200 134 0.000269
Sep 28 12:50:17 ctl02 nova-api[9922]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:50:17 ctl02 nova-api[9922]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:50:17 ctl02 heat-api-cfn[13300]: 2017-09-28 12:50:17.161 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:50:17] "OPTIONS / HTTP/1.0" 200 134 0.000606
Sep 28 12:50:17 ctl02 nova-api[9922]: 2017-09-28 12:50:17.248 9922 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:50:17 ctl02 nova-api[9922]: 2017-09-28 12:50:17.250 9922 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:50:17 ctl02 nova-api[9922]: 2017-09-28 12:50:17.250 9922 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:50:17 ctl02 nova-api[9922]: 2017-09-28 12:50:17.250 9922 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:50:17 ctl02 nova-api[9922]: 2017-09-28 12:50:17.250 9922 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:50:17 ctl02 nova-api[9922]: 2017-09-28 12:50:17.250 9922 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:50:17 ctl02 nova-api[9922]: 2017-09-28 12:50:17.250 9922 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:50:17 ctl02 nova-api[9922]: 2017-09-28 12:50:17.250 9922 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:50:17 ctl02 nova-api[9922]: 2017-09-28 12:50:17.250 9922 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:50:17 ctl02 nova-api[9922]: 2017-09-28 12:50:17.250 9922 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:50:17 ctl02 nova-api[9922]: 2017-09-28 12:50:17.250 9922 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:50:17 ctl02 nova-api[9922]: 2017-09-28 12:50:17.250 9922 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:50:17 ctl02 nova-api[9922]: 2017-09-28 12:50:17.250 9922 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:50:17 ctl02 nova-api[9922]: 2017-09-28 12:50:17.250 9922 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:50:17 ctl02 nova-api[9922]: 2017-09-28 12:50:17.250 9922 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:50:17 ctl02 nova-api[9922]: 2017-09-28 12:50:17.250 9922 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:50:17 ctl02 nova-api[9922]: 2017-09-28 12:50:17.250 9922 ERROR nova.wsgi     self.filename))
Sep 28 12:50:17 ctl02 nova-api[9922]: 2017-09-28 12:50:17.250 9922 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:50:17 ctl02 nova-api[9922]: 2017-09-28 12:50:17.250 9922 ERROR nova.wsgi
Sep 28 12:50:17 ctl02 nova-api[9922]: 2017-09-28 12:50:17.251 9922 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:50:17 ctl02 heat-api-cfn[13300]: 2017-09-28 12:50:17.285 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:50:17] "OPTIONS / HTTP/1.0" 200 134 0.000412
Sep 28 12:50:17 ctl02 nova-api[9922]: 2017-09-28 12:50:17.382 9922 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:50:17 ctl02 nova-api[9922]: 2017-09-28 12:50:17.608 9922 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:50:17 ctl02 nova-api[9922]: 2017-09-28 12:50:17.610 9922 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:50:17 ctl02 nova-api[9922]: 2017-09-28 12:50:17.610 9922 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:50:17 ctl02 nova-api[9922]: 2017-09-28 12:50:17.610 9922 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:50:17 ctl02 heat-api[13008]: 2017-09-28 12:50:17.657 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:50:17] "OPTIONS / HTTP/1.0" 200 134 0.000577
Sep 28 12:50:17 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xabc17517)
Sep 28 12:50:17 ctl02 nova-api[9922]: 2017-09-28 12:50:17.744 9922 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:50:17 ctl02 nova-api[9922]: 2017-09-28 12:50:17.745 9922 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:50:17 ctl02 nova-api[9922]: 2017-09-28 12:50:17.746 9922 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:50:17 ctl02 nova-api[9922]: 2017-09-28 12:50:17.746 9922 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:50:17 ctl02 nova-api[9922]: 2017-09-28 12:50:17.749 9922 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:50:17 ctl02 nova-api[9922]: 2017-09-28 12:50:17.749 9922 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:50:17 ctl02 nova-api[9922]: 2017-09-28 12:50:17.749 9922 ERROR nova Traceback (most recent call last):
Sep 28 12:50:17 ctl02 nova-api[9922]: 2017-09-28 12:50:17.749 9922 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:50:17 ctl02 nova-api[9922]: 2017-09-28 12:50:17.749 9922 ERROR nova     sys.exit(main())
Sep 28 12:50:17 ctl02 nova-api[9922]: 2017-09-28 12:50:17.749 9922 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:50:17 ctl02 nova-api[9922]: 2017-09-28 12:50:17.749 9922 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:50:17 ctl02 nova-api[9922]: 2017-09-28 12:50:17.749 9922 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:50:17 ctl02 nova-api[9922]: 2017-09-28 12:50:17.749 9922 ERROR nova     max_url_len=max_url_len)
Sep 28 12:50:17 ctl02 nova-api[9922]: 2017-09-28 12:50:17.749 9922 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:50:17 ctl02 nova-api[9922]: 2017-09-28 12:50:17.749 9922 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:50:17 ctl02 nova-api[9922]: 2017-09-28 12:50:17.749 9922 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:50:17 ctl02 nova-api[9922]: 2017-09-28 12:50:17.749 9922 ERROR nova     sock.listen(backlog)
Sep 28 12:50:17 ctl02 nova-api[9922]: 2017-09-28 12:50:17.749 9922 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:50:17 ctl02 nova-api[9922]: 2017-09-28 12:50:17.749 9922 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:50:17 ctl02 nova-api[9922]: 2017-09-28 12:50:17.749 9922 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:50:17 ctl02 nova-api[9922]: 2017-09-28 12:50:17.749 9922 ERROR nova
Sep 28 12:50:17 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:50:17 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:50:17 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:50:18 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:50:18 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:50:18 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:50:18 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:50:18 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xabc17517)
Sep 28 12:50:19 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:50:19.034 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:50:19] "OPTIONS / HTTP/1.0" 200 134 0.000473
Sep 28 12:50:19 ctl02 heat-api[13008]: 2017-09-28 12:50:19.133 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:50:19] "OPTIONS / HTTP/1.0" 200 134 0.000610
Sep 28 12:50:19 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xabc17517)
Sep 28 12:50:19 ctl02 nova-api[9940]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:50:19 ctl02 nova-api[9940]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:50:20 ctl02 nova-api[9940]: 2017-09-28 12:50:20.078 9940 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:50:20 ctl02 nova-api[9940]: 2017-09-28 12:50:20.080 9940 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:50:20 ctl02 nova-api[9940]: 2017-09-28 12:50:20.080 9940 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:50:20 ctl02 nova-api[9940]: 2017-09-28 12:50:20.080 9940 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:50:20 ctl02 nova-api[9940]: 2017-09-28 12:50:20.080 9940 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:50:20 ctl02 nova-api[9940]: 2017-09-28 12:50:20.080 9940 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:50:20 ctl02 nova-api[9940]: 2017-09-28 12:50:20.080 9940 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:50:20 ctl02 nova-api[9940]: 2017-09-28 12:50:20.080 9940 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:50:20 ctl02 nova-api[9940]: 2017-09-28 12:50:20.080 9940 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:50:20 ctl02 nova-api[9940]: 2017-09-28 12:50:20.080 9940 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:50:20 ctl02 nova-api[9940]: 2017-09-28 12:50:20.080 9940 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:50:20 ctl02 nova-api[9940]: 2017-09-28 12:50:20.080 9940 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:50:20 ctl02 nova-api[9940]: 2017-09-28 12:50:20.080 9940 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:50:20 ctl02 nova-api[9940]: 2017-09-28 12:50:20.080 9940 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:50:20 ctl02 nova-api[9940]: 2017-09-28 12:50:20.080 9940 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:50:20 ctl02 nova-api[9940]: 2017-09-28 12:50:20.080 9940 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:50:20 ctl02 nova-api[9940]: 2017-09-28 12:50:20.080 9940 ERROR nova.wsgi     self.filename))
Sep 28 12:50:20 ctl02 nova-api[9940]: 2017-09-28 12:50:20.080 9940 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:50:20 ctl02 nova-api[9940]: 2017-09-28 12:50:20.080 9940 ERROR nova.wsgi
Sep 28 12:50:20 ctl02 nova-api[9940]: 2017-09-28 12:50:20.082 9940 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:50:20 ctl02 nova-api[9940]: 2017-09-28 12:50:20.221 9940 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:50:20 ctl02 glance-api[29183]: 2017-09-28 12:50:20.467 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:50:20] "OPTIONS / HTTP/1.0" 200 134 0.000695
Sep 28 12:50:20 ctl02 nova-api[9940]: 2017-09-28 12:50:20.475 9940 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:50:20 ctl02 nova-api[9940]: 2017-09-28 12:50:20.477 9940 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:50:20 ctl02 nova-api[9940]: 2017-09-28 12:50:20.477 9940 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:50:20 ctl02 nova-api[9940]: 2017-09-28 12:50:20.478 9940 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:50:20 ctl02 nova-api[9940]: 2017-09-28 12:50:20.613 9940 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:50:20 ctl02 nova-api[9940]: 2017-09-28 12:50:20.615 9940 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:50:20 ctl02 nova-api[9940]: 2017-09-28 12:50:20.616 9940 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:50:20 ctl02 nova-api[9940]: 2017-09-28 12:50:20.616 9940 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:50:20 ctl02 nova-api[9940]: 2017-09-28 12:50:20.619 9940 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:50:20 ctl02 nova-api[9940]: 2017-09-28 12:50:20.620 9940 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:50:20 ctl02 nova-api[9940]: 2017-09-28 12:50:20.620 9940 ERROR nova Traceback (most recent call last):
Sep 28 12:50:20 ctl02 nova-api[9940]: 2017-09-28 12:50:20.620 9940 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:50:20 ctl02 nova-api[9940]: 2017-09-28 12:50:20.620 9940 ERROR nova     sys.exit(main())
Sep 28 12:50:20 ctl02 nova-api[9940]: 2017-09-28 12:50:20.620 9940 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:50:20 ctl02 nova-api[9940]: 2017-09-28 12:50:20.620 9940 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:50:20 ctl02 nova-api[9940]: 2017-09-28 12:50:20.620 9940 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:50:20 ctl02 nova-api[9940]: 2017-09-28 12:50:20.620 9940 ERROR nova     max_url_len=max_url_len)
Sep 28 12:50:20 ctl02 nova-api[9940]: 2017-09-28 12:50:20.620 9940 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:50:20 ctl02 nova-api[9940]: 2017-09-28 12:50:20.620 9940 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:50:20 ctl02 nova-api[9940]: 2017-09-28 12:50:20.620 9940 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:50:20 ctl02 nova-api[9940]: 2017-09-28 12:50:20.620 9940 ERROR nova     sock.listen(backlog)
Sep 28 12:50:20 ctl02 nova-api[9940]: 2017-09-28 12:50:20.620 9940 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:50:20 ctl02 nova-api[9940]: 2017-09-28 12:50:20.620 9940 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:50:20 ctl02 nova-api[9940]: 2017-09-28 12:50:20.620 9940 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:50:20 ctl02 nova-api[9940]: 2017-09-28 12:50:20.620 9940 ERROR nova
Sep 28 12:50:20 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xabc17517)
Sep 28 12:50:20 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:50:20 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:50:20 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:50:20 ctl02 heat-api-cfn[13300]: 2017-09-28 12:50:20.798 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:50:20] "OPTIONS / HTTP/1.0" 200 134 0.000469
Sep 28 12:50:20 ctl02 neutron-server[30536]: 2017-09-28 12:50:20.970 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:50:20] "OPTIONS / HTTP/1.0" 200 262 0.000538
Sep 28 12:50:21 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:50:21 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:50:21 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:50:21 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:50:21 ctl02 neutron-server[30536]: 2017-09-28 12:50:21.192 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 2 dead agents out of 6:
Sep 28 12:50:21 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:50:21 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:48:56 cmp002
Sep 28 12:50:21 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:49:38 cmp001
Sep 28 12:50:21 ctl02 glance-api[29183]: 2017-09-28 12:50:21.219 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:50:21] "OPTIONS / HTTP/1.0" 200 134 0.000698
Sep 28 12:50:21 ctl02 neutron-server[30536]: 2017-09-28 12:50:21.575 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:50:21] "OPTIONS / HTTP/1.0" 200 262 0.000557
Sep 28 12:50:21 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xabc17517)
Sep 28 12:50:22 ctl02 glance-api[29183]: 2017-09-28 12:50:22.044 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:50:22] "OPTIONS / HTTP/1.0" 200 134 0.000993
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.267 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:50:22] "OPTIONS / HTTP/1.0" 200 262 0.000521
Sep 28 12:50:22 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xabc17517)
Sep 28 12:50:22 ctl02 nova-api[9958]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:50:22 ctl02 nova-api[9958]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.877 30601 ERROR oslo_messaging.rpc.dispatcher [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Exception during message handling: (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vi
Sep 28 12:50:22 ctl02 neutron-server[30536]: f_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability
Sep 28 12:50:22 ctl02 neutron-server[30536]: _zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipal
Sep 28 12:50:22 ctl02 neutron-server[30536]: locations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id']
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.877 30601 ERROR oslo_messaging.rpc.dispatcher Traceback (most recent call last):
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.877 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.877 30601 ERROR oslo_messaging.rpc.dispatcher     incoming.message))
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.877 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.877 30601 ERROR oslo_messaging.rpc.dispatcher     return self._do_dispatch(endpoint, method, ctxt, args)
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.877 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.877 30601 ERROR oslo_messaging.rpc.dispatcher     result = func(ctxt, **new_args)
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.877 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.877 30601 ERROR oslo_messaging.rpc.dispatcher     router_ids=None)
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.877 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.877 30601 ERROR oslo_messaging.rpc.dispatcher     self, context, host, router_ids)
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.877 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.877 30601 ERROR oslo_messaging.rpc.dispatcher     plugin, context, l3_agent)
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.877 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.877 30601 ERROR oslo_messaging.rpc.dispatcher     agent)
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.877 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.877 30601 ERROR oslo_messaging.rpc.dispatcher     return plugin.get_ha_routers_l3_agents_count(context)
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.877 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.877 30601 ERROR oslo_messaging.rpc.dispatcher     for router, agent_count in query]
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.877 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.877 30601 ERROR oslo_messaging.rpc.dispatcher     return self._execute_and_instances(context)
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.877 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.877 30601 ERROR oslo_messaging.rpc.dispatcher     result = conn.execute(querycontext.statement, self._params)
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.877 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.877 30601 ERROR oslo_messaging.rpc.dispatcher     return meth(self, multiparams, params)
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.877 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.877 30601 ERROR oslo_messaging.rpc.dispatcher     return connection._execute_clauseelement(self, multiparams, params)
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.877 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.877 30601 ERROR oslo_messaging.rpc.dispatcher     compiled_sql, distilled_params
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.877 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.877 30601 ERROR oslo_messaging.rpc.dispatcher     context)
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.877 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.877 30601 ERROR oslo_messaging.rpc.dispatcher     util.raise_from_cause(newraise, exc_info)
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.877 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.877 30601 ERROR oslo_messaging.rpc.dispatcher     reraise(type(exception), exception, tb=exc_tb)
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.877 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.877 30601 ERROR oslo_messaging.rpc.dispatcher     context)
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.877 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.877 30601 ERROR oslo_messaging.rpc.dispatcher     cursor.execute(statement, parameters)
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.877 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.877 30601 ERROR oslo_messaging.rpc.dispatcher     result = self._query(query)
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.877 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.877 30601 ERROR oslo_messaging.rpc.dispatcher     conn.query(q)
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.877 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.877 30601 ERROR oslo_messaging.rpc.dispatcher     self._affected_rows = self._read_query_result(unbuffered=unbuffered)
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.877 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.877 30601 ERROR oslo_messaging.rpc.dispatcher     result.read()
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.877 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.877 30601 ERROR oslo_messaging.rpc.dispatcher     first_packet = self.connection._read_packet()
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.877 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.877 30601 ERROR oslo_messaging.rpc.dispatcher     packet.check_error()
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.877 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.877 30601 ERROR oslo_messaging.rpc.dispatcher     err.raise_mysql_exception(self._data)
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.877 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.877 30601 ERROR oslo_messaging.rpc.dispatcher     _check_mysql_exception(errinfo)
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.877 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.877 30601 ERROR oslo_messaging.rpc.dispatcher     raise errorclass(errno, errorvalue)
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.877 30601 ERROR oslo_messaging.rpc.dispatcher ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port
Sep 28 12:50:22 ctl02 neutron-server[30536]: _id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.cr
Sep 28 12:50:22 ctl02 neutron-server[30536]: eated_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattr
Sep 28 12:50:22 ctl02 neutron-server[30536]: ibutes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id']
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.877 30601 ERROR oslo_messaging.rpc.dispatcher
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.881 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:22 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:22 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:22 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:22 ctl02 neutron-server[30536]: 2017-09-28 12:50:22.881 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:22 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:22 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:22 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:22 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:22 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:23 ctl02 nova-api[9958]: 2017-09-28 12:50:23.042 9958 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:50:23 ctl02 nova-api[9958]: 2017-09-28 12:50:23.044 9958 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:50:23 ctl02 nova-api[9958]: 2017-09-28 12:50:23.044 9958 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:50:23 ctl02 nova-api[9958]: 2017-09-28 12:50:23.044 9958 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:50:23 ctl02 nova-api[9958]: 2017-09-28 12:50:23.044 9958 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:50:23 ctl02 nova-api[9958]: 2017-09-28 12:50:23.044 9958 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:50:23 ctl02 nova-api[9958]: 2017-09-28 12:50:23.044 9958 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:50:23 ctl02 nova-api[9958]: 2017-09-28 12:50:23.044 9958 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:50:23 ctl02 nova-api[9958]: 2017-09-28 12:50:23.044 9958 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:50:23 ctl02 nova-api[9958]: 2017-09-28 12:50:23.044 9958 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:50:23 ctl02 nova-api[9958]: 2017-09-28 12:50:23.044 9958 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:50:23 ctl02 nova-api[9958]: 2017-09-28 12:50:23.044 9958 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:50:23 ctl02 nova-api[9958]: 2017-09-28 12:50:23.044 9958 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:50:23 ctl02 nova-api[9958]: 2017-09-28 12:50:23.044 9958 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:50:23 ctl02 nova-api[9958]: 2017-09-28 12:50:23.044 9958 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:50:23 ctl02 nova-api[9958]: 2017-09-28 12:50:23.044 9958 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:50:23 ctl02 nova-api[9958]: 2017-09-28 12:50:23.044 9958 ERROR nova.wsgi     self.filename))
Sep 28 12:50:23 ctl02 nova-api[9958]: 2017-09-28 12:50:23.044 9958 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:50:23 ctl02 nova-api[9958]: 2017-09-28 12:50:23.044 9958 ERROR nova.wsgi
Sep 28 12:50:23 ctl02 nova-api[9958]: 2017-09-28 12:50:23.045 9958 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:50:23 ctl02 neutron-server[30536]: 2017-09-28 12:50:23.135 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:23 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:23 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:23 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:23 ctl02 neutron-server[30536]: 2017-09-28 12:50:23.135 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:23 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:23 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:23 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:23 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:23 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:23 ctl02 nova-api[9958]: 2017-09-28 12:50:23.177 9958 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:50:23 ctl02 neutron-server[30536]: 2017-09-28 12:50:23.388 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:23 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:23 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:23 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:23 ctl02 neutron-server[30536]: 2017-09-28 12:50:23.388 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:23 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:23 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:23 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:23 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:23 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:23 ctl02 nova-api[9958]: 2017-09-28 12:50:23.400 9958 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:50:23 ctl02 nova-api[9958]: 2017-09-28 12:50:23.403 9958 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:50:23 ctl02 nova-api[9958]: 2017-09-28 12:50:23.403 9958 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:50:23 ctl02 nova-api[9958]: 2017-09-28 12:50:23.404 9958 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:50:23 ctl02 nova-api[9958]: 2017-09-28 12:50:23.535 9958 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:50:23 ctl02 nova-api[9958]: 2017-09-28 12:50:23.537 9958 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:50:23 ctl02 nova-api[9958]: 2017-09-28 12:50:23.538 9958 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:50:23 ctl02 nova-api[9958]: 2017-09-28 12:50:23.538 9958 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:50:23 ctl02 nova-api[9958]: 2017-09-28 12:50:23.542 9958 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:50:23 ctl02 nova-api[9958]: 2017-09-28 12:50:23.542 9958 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:50:23 ctl02 nova-api[9958]: 2017-09-28 12:50:23.542 9958 ERROR nova Traceback (most recent call last):
Sep 28 12:50:23 ctl02 nova-api[9958]: 2017-09-28 12:50:23.542 9958 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:50:23 ctl02 nova-api[9958]: 2017-09-28 12:50:23.542 9958 ERROR nova     sys.exit(main())
Sep 28 12:50:23 ctl02 nova-api[9958]: 2017-09-28 12:50:23.542 9958 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:50:23 ctl02 nova-api[9958]: 2017-09-28 12:50:23.542 9958 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:50:23 ctl02 nova-api[9958]: 2017-09-28 12:50:23.542 9958 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:50:23 ctl02 nova-api[9958]: 2017-09-28 12:50:23.542 9958 ERROR nova     max_url_len=max_url_len)
Sep 28 12:50:23 ctl02 nova-api[9958]: 2017-09-28 12:50:23.542 9958 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:50:23 ctl02 nova-api[9958]: 2017-09-28 12:50:23.542 9958 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:50:23 ctl02 nova-api[9958]: 2017-09-28 12:50:23.542 9958 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:50:23 ctl02 nova-api[9958]: 2017-09-28 12:50:23.542 9958 ERROR nova     sock.listen(backlog)
Sep 28 12:50:23 ctl02 nova-api[9958]: 2017-09-28 12:50:23.542 9958 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:50:23 ctl02 nova-api[9958]: 2017-09-28 12:50:23.542 9958 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:50:23 ctl02 nova-api[9958]: 2017-09-28 12:50:23.542 9958 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:50:23 ctl02 nova-api[9958]: 2017-09-28 12:50:23.542 9958 ERROR nova
Sep 28 12:50:23 ctl02 neutron-server[30536]: 2017-09-28 12:50:23.641 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:23 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:23 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:23 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:23 ctl02 neutron-server[30536]: 2017-09-28 12:50:23.643 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:23 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:23 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:23 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:23 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:23 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:23 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:50:23 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:50:23 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:50:23 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xabc17517)
Sep 28 12:50:23 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:50:23 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:50:23 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:50:23 ctl02 neutron-server[30536]: 2017-09-28 12:50:23.899 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:23 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:23 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:23 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:23 ctl02 neutron-server[30536]: 2017-09-28 12:50:23.900 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:23 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:50:23 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:23 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:23 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:23 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:23 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:24 ctl02 heat-api[13008]: 2017-09-28 12:50:24.089 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:50:24] "OPTIONS / HTTP/1.0" 200 134 0.000556
Sep 28 12:50:24 ctl02 neutron-server[30536]: 2017-09-28 12:50:24.154 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:24 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:24 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:24 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:24 ctl02 neutron-server[30536]: 2017-09-28 12:50:24.155 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:24 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:24 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:24 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:24 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:24 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:24 ctl02 neutron-server[30536]: 2017-09-28 12:50:24.408 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:24 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:24 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:24 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:24 ctl02 neutron-server[30536]: 2017-09-28 12:50:24.409 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:24 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:24 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:24 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:24 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:24 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:24 ctl02 neutron-server[30536]: 2017-09-28 12:50:24.662 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:24 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:24 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:24 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:24 ctl02 neutron-server[30536]: 2017-09-28 12:50:24.662 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:24 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:24 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:24 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:24 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:24 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:24 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xabc17517)
Sep 28 12:50:24 ctl02 neutron-server[30536]: 2017-09-28 12:50:24.915 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:24 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:24 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:24 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:24 ctl02 neutron-server[30536]: 2017-09-28 12:50:24.916 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:24 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:24 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:24 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:24 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:24 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:24 ctl02 nova-consoleauth[5433]: 2017-09-28 12:50:24.979 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:50:25 ctl02 neutron-server[30536]: 2017-09-28 12:50:25.170 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:25 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:25 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:25 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:25 ctl02 neutron-server[30536]: 2017-09-28 12:50:25.170 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:25 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:25 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:25 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:25 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:25 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:25 ctl02 neutron-server[30536]: 2017-09-28 12:50:25.423 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:25 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:25 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:25 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:25 ctl02 neutron-server[30536]: 2017-09-28 12:50:25.424 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:25 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:25 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:25 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:25 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:25 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:25 ctl02 nova-api[9976]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:50:25 ctl02 nova-api[9976]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:50:25 ctl02 neutron-server[30536]: 2017-09-28 12:50:25.677 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:25 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:25 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:25 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:25 ctl02 neutron-server[30536]: 2017-09-28 12:50:25.677 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:25 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:25 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:25 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:25 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:25 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:25 ctl02 nova-api[9976]: 2017-09-28 12:50:25.710 9976 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:50:25 ctl02 nova-api[9976]: 2017-09-28 12:50:25.712 9976 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:50:25 ctl02 nova-api[9976]: 2017-09-28 12:50:25.712 9976 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:50:25 ctl02 nova-api[9976]: 2017-09-28 12:50:25.712 9976 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:50:25 ctl02 nova-api[9976]: 2017-09-28 12:50:25.712 9976 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:50:25 ctl02 nova-api[9976]: 2017-09-28 12:50:25.712 9976 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:50:25 ctl02 nova-api[9976]: 2017-09-28 12:50:25.712 9976 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:50:25 ctl02 nova-api[9976]: 2017-09-28 12:50:25.712 9976 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:50:25 ctl02 nova-api[9976]: 2017-09-28 12:50:25.712 9976 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:50:25 ctl02 nova-api[9976]: 2017-09-28 12:50:25.712 9976 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:50:25 ctl02 nova-api[9976]: 2017-09-28 12:50:25.712 9976 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:50:25 ctl02 nova-api[9976]: 2017-09-28 12:50:25.712 9976 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:50:25 ctl02 nova-api[9976]: 2017-09-28 12:50:25.712 9976 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:50:25 ctl02 nova-api[9976]: 2017-09-28 12:50:25.712 9976 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:50:25 ctl02 nova-api[9976]: 2017-09-28 12:50:25.712 9976 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:50:25 ctl02 nova-api[9976]: 2017-09-28 12:50:25.712 9976 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:50:25 ctl02 nova-api[9976]: 2017-09-28 12:50:25.712 9976 ERROR nova.wsgi     self.filename))
Sep 28 12:50:25 ctl02 nova-api[9976]: 2017-09-28 12:50:25.712 9976 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:50:25 ctl02 nova-api[9976]: 2017-09-28 12:50:25.712 9976 ERROR nova.wsgi
Sep 28 12:50:25 ctl02 nova-api[9976]: 2017-09-28 12:50:25.713 9976 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:50:25 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:50:25 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:50:25 ctl02 nova-api[9976]: 2017-09-28 12:50:25.842 9976 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:50:25 ctl02 neutron-server[30536]: 2017-09-28 12:50:25.931 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:25 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:25 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:25 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:25 ctl02 neutron-server[30536]: 2017-09-28 12:50:25.931 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:25 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:25 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:25 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:25 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:25 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:26 ctl02 nova-api[9976]: 2017-09-28 12:50:26.065 9976 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:50:26 ctl02 nova-api[9976]: 2017-09-28 12:50:26.067 9976 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:50:26 ctl02 nova-api[9976]: 2017-09-28 12:50:26.067 9976 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:50:26 ctl02 nova-api[9976]: 2017-09-28 12:50:26.068 9976 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:50:26 ctl02 neutron-server[30536]: 2017-09-28 12:50:26.185 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:26 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:26 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:26 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:26 ctl02 neutron-server[30536]: 2017-09-28 12:50:26.185 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:26 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:26 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:26 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:26 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:26 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:26 ctl02 nova-api[9976]: 2017-09-28 12:50:26.200 9976 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:50:26 ctl02 nova-api[9976]: 2017-09-28 12:50:26.202 9976 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:50:26 ctl02 nova-api[9976]: 2017-09-28 12:50:26.202 9976 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:50:26 ctl02 nova-api[9976]: 2017-09-28 12:50:26.203 9976 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:50:26 ctl02 nova-api[9976]: 2017-09-28 12:50:26.206 9976 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:50:26 ctl02 nova-api[9976]: 2017-09-28 12:50:26.206 9976 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:50:26 ctl02 nova-api[9976]: 2017-09-28 12:50:26.206 9976 ERROR nova Traceback (most recent call last):
Sep 28 12:50:26 ctl02 nova-api[9976]: 2017-09-28 12:50:26.206 9976 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:50:26 ctl02 nova-api[9976]: 2017-09-28 12:50:26.206 9976 ERROR nova     sys.exit(main())
Sep 28 12:50:26 ctl02 nova-api[9976]: 2017-09-28 12:50:26.206 9976 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:50:26 ctl02 nova-api[9976]: 2017-09-28 12:50:26.206 9976 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:50:26 ctl02 nova-api[9976]: 2017-09-28 12:50:26.206 9976 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:50:26 ctl02 nova-api[9976]: 2017-09-28 12:50:26.206 9976 ERROR nova     max_url_len=max_url_len)
Sep 28 12:50:26 ctl02 nova-api[9976]: 2017-09-28 12:50:26.206 9976 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:50:26 ctl02 nova-api[9976]: 2017-09-28 12:50:26.206 9976 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:50:26 ctl02 nova-api[9976]: 2017-09-28 12:50:26.206 9976 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:50:26 ctl02 nova-api[9976]: 2017-09-28 12:50:26.206 9976 ERROR nova     sock.listen(backlog)
Sep 28 12:50:26 ctl02 nova-api[9976]: 2017-09-28 12:50:26.206 9976 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:50:26 ctl02 nova-api[9976]: 2017-09-28 12:50:26.206 9976 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:50:26 ctl02 nova-api[9976]: 2017-09-28 12:50:26.206 9976 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:50:26 ctl02 nova-api[9976]: 2017-09-28 12:50:26.206 9976 ERROR nova
Sep 28 12:50:26 ctl02 heat-engine[12803]: 2017-09-28 12:50:26.213 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:50:26 ctl02 heat-engine[12803]: 2017-09-28 12:50:26.213 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:50:26 ctl02 heat-engine[12803]: 2017-09-28 12:50:26.220 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:50:26 ctl02 heat-engine[12803]: 2017-09-28 12:50:26.225 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:50:26 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:50:26 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:50:26 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:50:26 ctl02 neutron-server[30536]: 2017-09-28 12:50:26.439 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:26 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:26 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:26 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:26 ctl02 neutron-server[30536]: 2017-09-28 12:50:26.439 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:26 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:26 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:26 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:26 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:26 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:26 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:50:26 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:50:26 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:50:26 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:50:26 ctl02 neutron-server[30536]: 2017-09-28 12:50:26.693 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:26 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:26 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:26 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:26 ctl02 neutron-server[30536]: 2017-09-28 12:50:26.693 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:26 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:26 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:26 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:26 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:26 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:26 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:50:26.800 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:50:26] "OPTIONS / HTTP/1.0" 200 134 0.000435
Sep 28 12:50:26 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:50:26.937 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:50:26] "OPTIONS / HTTP/1.0" 200 134 0.000399
Sep 28 12:50:26 ctl02 neutron-server[30536]: 2017-09-28 12:50:26.955 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:26 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:26 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:26 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:26 ctl02 neutron-server[30536]: 2017-09-28 12:50:26.957 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:26 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:26 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:26 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:26 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:26 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:27 ctl02 neutron-server[30536]: 2017-09-28 12:50:27.212 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:27 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:27 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:27 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:27 ctl02 neutron-server[30536]: 2017-09-28 12:50:27.214 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:27 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:27 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:27 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:27 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:27 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:27 ctl02 heat-api-cfn[13300]: 2017-09-28 12:50:27.227 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:50:27] "OPTIONS / HTTP/1.0" 200 134 0.000551
Sep 28 12:50:27 ctl02 neutron-server[30536]: 2017-09-28 12:50:27.469 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:27 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:27 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:27 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:27 ctl02 neutron-server[30536]: 2017-09-28 12:50:27.471 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:27 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:27 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:27 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:27 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:27 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:27 ctl02 heat-api-cfn[13300]: 2017-09-28 12:50:27.674 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:50:27] "OPTIONS / HTTP/1.0" 200 134 0.000463
Sep 28 12:50:27 ctl02 neutron-server[30536]: 2017-09-28 12:50:27.726 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:27 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:27 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:27 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:27 ctl02 neutron-server[30536]: 2017-09-28 12:50:27.728 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:27 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:27 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:27 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:27 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:27 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:27 ctl02 heat-api[13008]: 2017-09-28 12:50:27.913 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:50:27] "OPTIONS / HTTP/1.0" 200 134 0.000540
Sep 28 12:50:27 ctl02 neutron-server[30536]: 2017-09-28 12:50:27.983 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:27 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:27 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:27 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:27 ctl02 neutron-server[30536]: 2017-09-28 12:50:27.984 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:27 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:27 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:27 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:27 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:27 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:28 ctl02 nova-scheduler[5620]: 2017-09-28 12:50:28.088 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:50:28 ctl02 neutron-server[30536]: 2017-09-28 12:50:28.239 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:28 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:28 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:28 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:28 ctl02 neutron-server[30536]: 2017-09-28 12:50:28.241 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:28 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:28 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:28 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:28 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:28 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:28 ctl02 nova-api[9999]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:50:28 ctl02 nova-api[9999]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:50:28 ctl02 nova-api[9999]: 2017-09-28 12:50:28.470 9999 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:50:28 ctl02 nova-api[9999]: 2017-09-28 12:50:28.471 9999 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:50:28 ctl02 nova-api[9999]: 2017-09-28 12:50:28.471 9999 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:50:28 ctl02 nova-api[9999]: 2017-09-28 12:50:28.471 9999 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:50:28 ctl02 nova-api[9999]: 2017-09-28 12:50:28.471 9999 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:50:28 ctl02 nova-api[9999]: 2017-09-28 12:50:28.471 9999 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:50:28 ctl02 nova-api[9999]: 2017-09-28 12:50:28.471 9999 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:50:28 ctl02 nova-api[9999]: 2017-09-28 12:50:28.471 9999 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:50:28 ctl02 nova-api[9999]: 2017-09-28 12:50:28.471 9999 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:50:28 ctl02 nova-api[9999]: 2017-09-28 12:50:28.471 9999 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:50:28 ctl02 nova-api[9999]: 2017-09-28 12:50:28.471 9999 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:50:28 ctl02 nova-api[9999]: 2017-09-28 12:50:28.471 9999 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:50:28 ctl02 nova-api[9999]: 2017-09-28 12:50:28.471 9999 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:50:28 ctl02 nova-api[9999]: 2017-09-28 12:50:28.471 9999 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:50:28 ctl02 nova-api[9999]: 2017-09-28 12:50:28.471 9999 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:50:28 ctl02 nova-api[9999]: 2017-09-28 12:50:28.471 9999 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:50:28 ctl02 nova-api[9999]: 2017-09-28 12:50:28.471 9999 ERROR nova.wsgi     self.filename))
Sep 28 12:50:28 ctl02 nova-api[9999]: 2017-09-28 12:50:28.471 9999 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:50:28 ctl02 nova-api[9999]: 2017-09-28 12:50:28.471 9999 ERROR nova.wsgi
Sep 28 12:50:28 ctl02 nova-api[9999]: 2017-09-28 12:50:28.472 9999 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:50:28 ctl02 neutron-server[30536]: 2017-09-28 12:50:28.496 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:28 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:28 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:28 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:28 ctl02 neutron-server[30536]: 2017-09-28 12:50:28.500 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:28 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:28 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:28 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:28 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:28 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:28 ctl02 nova-api[9999]: 2017-09-28 12:50:28.600 9999 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:50:28 ctl02 neutron-server[30536]: 2017-09-28 12:50:28.760 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:28 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:28 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:28 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:28 ctl02 neutron-server[30536]: 2017-09-28 12:50:28.762 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:28 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:28 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:28 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:28 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:28 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:28 ctl02 nova-api[9999]: 2017-09-28 12:50:28.822 9999 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:50:28 ctl02 nova-api[9999]: 2017-09-28 12:50:28.824 9999 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:50:28 ctl02 nova-api[9999]: 2017-09-28 12:50:28.824 9999 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:50:28 ctl02 nova-api[9999]: 2017-09-28 12:50:28.824 9999 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:50:28 ctl02 nova-api[9999]: 2017-09-28 12:50:28.954 9999 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:50:28 ctl02 nova-api[9999]: 2017-09-28 12:50:28.956 9999 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:50:28 ctl02 nova-api[9999]: 2017-09-28 12:50:28.956 9999 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:50:28 ctl02 nova-api[9999]: 2017-09-28 12:50:28.957 9999 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:50:28 ctl02 nova-api[9999]: 2017-09-28 12:50:28.960 9999 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:50:28 ctl02 nova-api[9999]: 2017-09-28 12:50:28.960 9999 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:50:28 ctl02 nova-api[9999]: 2017-09-28 12:50:28.960 9999 ERROR nova Traceback (most recent call last):
Sep 28 12:50:28 ctl02 nova-api[9999]: 2017-09-28 12:50:28.960 9999 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:50:28 ctl02 nova-api[9999]: 2017-09-28 12:50:28.960 9999 ERROR nova     sys.exit(main())
Sep 28 12:50:28 ctl02 nova-api[9999]: 2017-09-28 12:50:28.960 9999 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:50:28 ctl02 nova-api[9999]: 2017-09-28 12:50:28.960 9999 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:50:28 ctl02 nova-api[9999]: 2017-09-28 12:50:28.960 9999 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:50:28 ctl02 nova-api[9999]: 2017-09-28 12:50:28.960 9999 ERROR nova     max_url_len=max_url_len)
Sep 28 12:50:28 ctl02 nova-api[9999]: 2017-09-28 12:50:28.960 9999 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:50:28 ctl02 nova-api[9999]: 2017-09-28 12:50:28.960 9999 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:50:28 ctl02 nova-api[9999]: 2017-09-28 12:50:28.960 9999 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:50:28 ctl02 nova-api[9999]: 2017-09-28 12:50:28.960 9999 ERROR nova     sock.listen(backlog)
Sep 28 12:50:28 ctl02 nova-api[9999]: 2017-09-28 12:50:28.960 9999 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:50:28 ctl02 nova-api[9999]: 2017-09-28 12:50:28.960 9999 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:50:28 ctl02 nova-api[9999]: 2017-09-28 12:50:28.960 9999 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:50:28 ctl02 nova-api[9999]: 2017-09-28 12:50:28.960 9999 ERROR nova
Sep 28 12:50:29 ctl02 neutron-server[30536]: 2017-09-28 12:50:29.017 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:29 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:29 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:29 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:29 ctl02 neutron-server[30536]: 2017-09-28 12:50:29.019 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:29 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:29 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:29 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:29 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:29 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:29 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:50:29 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:50:29 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:50:29 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:50:29.151 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:50:29] "OPTIONS / HTTP/1.0" 200 134 0.000408
Sep 28 12:50:29 ctl02 heat-api[13008]: 2017-09-28 12:50:29.193 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:50:29] "OPTIONS / HTTP/1.0" 200 134 0.000571
Sep 28 12:50:29 ctl02 neutron-server[30536]: 2017-09-28 12:50:29.274 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:29 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:29 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:29 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:29 ctl02 neutron-server[30536]: 2017-09-28 12:50:29.275 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:29 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:29 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:29 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:29 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:29 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:29 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:50:29 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:50:29 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:50:29 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:50:29 ctl02 neutron-server[30536]: 2017-09-28 12:50:29.531 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:29 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:29 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:29 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:29 ctl02 neutron-server[30536]: 2017-09-28 12:50:29.532 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:29 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:29 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:29 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:29 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:29 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:29 ctl02 neutron-server[30536]: 2017-09-28 12:50:29.785 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:29 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:29 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:29 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:29 ctl02 neutron-server[30536]: 2017-09-28 12:50:29.785 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:29 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:29 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:29 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:29 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:29 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:30 ctl02 neutron-server[30536]: 2017-09-28 12:50:30.040 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:30 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:30 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:30 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:30 ctl02 neutron-server[30536]: 2017-09-28 12:50:30.041 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:30 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:30 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:30 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:30 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:30 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:30 ctl02 neutron-server[30536]: 2017-09-28 12:50:30.293 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:30 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:30 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:30 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:30 ctl02 neutron-server[30536]: 2017-09-28 12:50:30.294 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:30 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:30 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:30 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:30 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:30 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:30 ctl02 neutron-server[30536]: 2017-09-28 12:50:30.546 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:30 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:30 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:30 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:30 ctl02 neutron-server[30536]: 2017-09-28 12:50:30.546 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:30 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:30 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:30 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:30 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:30 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:30 ctl02 glance-api[29183]: 2017-09-28 12:50:30.668 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:50:30] "OPTIONS / HTTP/1.0" 200 134 0.000594
Sep 28 12:50:30 ctl02 neutron-server[30536]: 2017-09-28 12:50:30.799 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:30 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:30 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:30 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:30 ctl02 neutron-server[30536]: 2017-09-28 12:50:30.800 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:30 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:30 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:30 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:30 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:30 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:31 ctl02 glance-api[29183]: 2017-09-28 12:50:31.045 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:50:31] "OPTIONS / HTTP/1.0" 200 134 0.000424
Sep 28 12:50:31 ctl02 neutron-server[30536]: 2017-09-28 12:50:31.052 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:31 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:31 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:31 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:31 ctl02 neutron-server[30536]: 2017-09-28 12:50:31.053 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:31 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:31 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:31 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:31 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:31 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:31 ctl02 heat-api-cfn[13300]: 2017-09-28 12:50:31.067 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:50:31] "OPTIONS / HTTP/1.0" 200 134 0.000429
Sep 28 12:50:31 ctl02 nova-api[10017]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:50:31 ctl02 nova-api[10017]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:50:31 ctl02 nova-api[10017]: 2017-09-28 12:50:31.262 10017 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:50:31 ctl02 nova-api[10017]: 2017-09-28 12:50:31.263 10017 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:50:31 ctl02 nova-api[10017]: 2017-09-28 12:50:31.263 10017 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:50:31 ctl02 nova-api[10017]: 2017-09-28 12:50:31.263 10017 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:50:31 ctl02 nova-api[10017]: 2017-09-28 12:50:31.263 10017 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:50:31 ctl02 nova-api[10017]: 2017-09-28 12:50:31.263 10017 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:50:31 ctl02 nova-api[10017]: 2017-09-28 12:50:31.263 10017 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:50:31 ctl02 nova-api[10017]: 2017-09-28 12:50:31.263 10017 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:50:31 ctl02 nova-api[10017]: 2017-09-28 12:50:31.263 10017 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:50:31 ctl02 nova-api[10017]: 2017-09-28 12:50:31.263 10017 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:50:31 ctl02 nova-api[10017]: 2017-09-28 12:50:31.263 10017 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:50:31 ctl02 nova-api[10017]: 2017-09-28 12:50:31.263 10017 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:50:31 ctl02 nova-api[10017]: 2017-09-28 12:50:31.263 10017 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:50:31 ctl02 nova-api[10017]: 2017-09-28 12:50:31.263 10017 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:50:31 ctl02 nova-api[10017]: 2017-09-28 12:50:31.263 10017 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:50:31 ctl02 nova-api[10017]: 2017-09-28 12:50:31.263 10017 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:50:31 ctl02 nova-api[10017]: 2017-09-28 12:50:31.263 10017 ERROR nova.wsgi     self.filename))
Sep 28 12:50:31 ctl02 nova-api[10017]: 2017-09-28 12:50:31.263 10017 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:50:31 ctl02 nova-api[10017]: 2017-09-28 12:50:31.263 10017 ERROR nova.wsgi
Sep 28 12:50:31 ctl02 nova-api[10017]: 2017-09-28 12:50:31.264 10017 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:50:31 ctl02 neutron-server[30536]: 2017-09-28 12:50:31.306 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:31 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:31 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:31 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:31 ctl02 neutron-server[30536]: 2017-09-28 12:50:31.306 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:31 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:31 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:31 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:31 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:31 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:31 ctl02 neutron-server[30536]: 2017-09-28 12:50:31.339 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:50:31] "OPTIONS / HTTP/1.0" 200 262 0.000476
Sep 28 12:50:31 ctl02 nova-api[10017]: 2017-09-28 12:50:31.397 10017 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:50:31 ctl02 neutron-server[30536]: 2017-09-28 12:50:31.559 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:31 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:31 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:31 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:31 ctl02 neutron-server[30536]: 2017-09-28 12:50:31.560 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:31 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:31 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:31 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:31 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:31 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:31 ctl02 neutron-server[30536]: 2017-09-28 12:50:31.604 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:50:31] "OPTIONS / HTTP/1.0" 200 262 0.000563
Sep 28 12:50:31 ctl02 nova-api[10017]: 2017-09-28 12:50:31.620 10017 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:50:31 ctl02 nova-api[10017]: 2017-09-28 12:50:31.622 10017 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:50:31 ctl02 nova-api[10017]: 2017-09-28 12:50:31.622 10017 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:50:31 ctl02 nova-api[10017]: 2017-09-28 12:50:31.622 10017 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:50:31 ctl02 glance-api[29183]: 2017-09-28 12:50:31.705 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:50:31] "OPTIONS / HTTP/1.0" 200 134 0.000608
Sep 28 12:50:31 ctl02 nova-api[10017]: 2017-09-28 12:50:31.756 10017 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:50:31 ctl02 nova-api[10017]: 2017-09-28 12:50:31.758 10017 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:50:31 ctl02 nova-api[10017]: 2017-09-28 12:50:31.758 10017 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:50:31 ctl02 nova-api[10017]: 2017-09-28 12:50:31.759 10017 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:50:31 ctl02 nova-api[10017]: 2017-09-28 12:50:31.762 10017 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:50:31 ctl02 nova-api[10017]: 2017-09-28 12:50:31.762 10017 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:50:31 ctl02 nova-api[10017]: 2017-09-28 12:50:31.762 10017 ERROR nova Traceback (most recent call last):
Sep 28 12:50:31 ctl02 nova-api[10017]: 2017-09-28 12:50:31.762 10017 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:50:31 ctl02 nova-api[10017]: 2017-09-28 12:50:31.762 10017 ERROR nova     sys.exit(main())
Sep 28 12:50:31 ctl02 nova-api[10017]: 2017-09-28 12:50:31.762 10017 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:50:31 ctl02 nova-api[10017]: 2017-09-28 12:50:31.762 10017 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:50:31 ctl02 nova-api[10017]: 2017-09-28 12:50:31.762 10017 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:50:31 ctl02 nova-api[10017]: 2017-09-28 12:50:31.762 10017 ERROR nova     max_url_len=max_url_len)
Sep 28 12:50:31 ctl02 nova-api[10017]: 2017-09-28 12:50:31.762 10017 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:50:31 ctl02 nova-api[10017]: 2017-09-28 12:50:31.762 10017 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:50:31 ctl02 nova-api[10017]: 2017-09-28 12:50:31.762 10017 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:50:31 ctl02 nova-api[10017]: 2017-09-28 12:50:31.762 10017 ERROR nova     sock.listen(backlog)
Sep 28 12:50:31 ctl02 nova-api[10017]: 2017-09-28 12:50:31.762 10017 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:50:31 ctl02 nova-api[10017]: 2017-09-28 12:50:31.762 10017 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:50:31 ctl02 nova-api[10017]: 2017-09-28 12:50:31.762 10017 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:50:31 ctl02 nova-api[10017]: 2017-09-28 12:50:31.762 10017 ERROR nova
Sep 28 12:50:31 ctl02 neutron-server[30536]: 2017-09-28 12:50:31.813 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:31 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:31 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:31 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:31 ctl02 neutron-server[30536]: 2017-09-28 12:50:31.814 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:31 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:31 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:31 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:31 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:31 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:31 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:50:31 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:50:31 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:50:32 ctl02 neutron-server[30536]: 2017-09-28 12:50:32.074 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:32 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:32 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:32 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:32 ctl02 neutron-server[30536]: 2017-09-28 12:50:32.074 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:32 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:32 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:32 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:32 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:32 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:32 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:50:32 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:50:32 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:50:32 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:50:32 ctl02 neutron-server[30536]: 2017-09-28 12:50:32.245 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:50:32] "OPTIONS / HTTP/1.0" 200 262 0.000537
Sep 28 12:50:32 ctl02 neutron-server[30536]: 2017-09-28 12:50:32.328 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:32 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:32 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:32 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:32 ctl02 neutron-server[30536]: 2017-09-28 12:50:32.328 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:32 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:32 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:32 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:32 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:32 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:32 ctl02 neutron-server[30536]: 2017-09-28 12:50:32.582 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:32 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:32 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:32 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:32 ctl02 neutron-server[30536]: 2017-09-28 12:50:32.582 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:32 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:32 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:32 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:32 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:32 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:32 ctl02 neutron-server[30536]: 2017-09-28 12:50:32.835 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:32 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:32 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:32 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:32 ctl02 neutron-server[30536]: 2017-09-28 12:50:32.836 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:32 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:32 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:32 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:32 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:32 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:33 ctl02 neutron-server[30536]: 2017-09-28 12:50:33.089 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:33 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:33 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:33 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:33 ctl02 neutron-server[30536]: 2017-09-28 12:50:33.089 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:33 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:33 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:33 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:33 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:33 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:33 ctl02 neutron-server[30536]: 2017-09-28 12:50:33.342 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:33 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:33 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:33 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:33 ctl02 neutron-server[30536]: 2017-09-28 12:50:33.343 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:33 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:33 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:33 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:33 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:33 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:33 ctl02 neutron-server[30536]: 2017-09-28 12:50:33.595 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:33 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:33 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:33 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:33 ctl02 neutron-server[30536]: 2017-09-28 12:50:33.596 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:33 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:33 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:33 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:33 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:33 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:33 ctl02 nova-api[10035]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:50:33 ctl02 nova-api[10035]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:50:33 ctl02 neutron-server[30536]: 2017-09-28 12:50:33.849 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:33 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:33 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:33 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:33 ctl02 neutron-server[30536]: 2017-09-28 12:50:33.849 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:33 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:33 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:33 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:33 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:33 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:33 ctl02 heat-api[13008]: 2017-09-28 12:50:33.934 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:50:33] "OPTIONS / HTTP/1.0" 200 134 0.000556
Sep 28 12:50:34 ctl02 nova-api[10035]: 2017-09-28 12:50:34.002 10035 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:50:34 ctl02 nova-api[10035]: 2017-09-28 12:50:34.003 10035 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:50:34 ctl02 nova-api[10035]: 2017-09-28 12:50:34.003 10035 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:50:34 ctl02 nova-api[10035]: 2017-09-28 12:50:34.003 10035 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:50:34 ctl02 nova-api[10035]: 2017-09-28 12:50:34.003 10035 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:50:34 ctl02 nova-api[10035]: 2017-09-28 12:50:34.003 10035 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:50:34 ctl02 nova-api[10035]: 2017-09-28 12:50:34.003 10035 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:50:34 ctl02 nova-api[10035]: 2017-09-28 12:50:34.003 10035 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:50:34 ctl02 nova-api[10035]: 2017-09-28 12:50:34.003 10035 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:50:34 ctl02 nova-api[10035]: 2017-09-28 12:50:34.003 10035 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:50:34 ctl02 nova-api[10035]: 2017-09-28 12:50:34.003 10035 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:50:34 ctl02 nova-api[10035]: 2017-09-28 12:50:34.003 10035 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:50:34 ctl02 nova-api[10035]: 2017-09-28 12:50:34.003 10035 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:50:34 ctl02 nova-api[10035]: 2017-09-28 12:50:34.003 10035 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:50:34 ctl02 nova-api[10035]: 2017-09-28 12:50:34.003 10035 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:50:34 ctl02 nova-api[10035]: 2017-09-28 12:50:34.003 10035 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:50:34 ctl02 nova-api[10035]: 2017-09-28 12:50:34.003 10035 ERROR nova.wsgi     self.filename))
Sep 28 12:50:34 ctl02 nova-api[10035]: 2017-09-28 12:50:34.003 10035 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:50:34 ctl02 nova-api[10035]: 2017-09-28 12:50:34.003 10035 ERROR nova.wsgi
Sep 28 12:50:34 ctl02 nova-api[10035]: 2017-09-28 12:50:34.004 10035 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:50:34 ctl02 neutron-server[30536]: 2017-09-28 12:50:34.102 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:34 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:34 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:34 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:34 ctl02 neutron-server[30536]: 2017-09-28 12:50:34.103 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:34 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:34 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:34 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:34 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:34 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:34 ctl02 nova-api[10035]: 2017-09-28 12:50:34.133 10035 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:50:34 ctl02 neutron-server[30536]: 2017-09-28 12:50:34.355 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:34 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:34 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:34 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:34 ctl02 neutron-server[30536]: 2017-09-28 12:50:34.356 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:34 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:34 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:34 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:34 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:34 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:34 ctl02 nova-api[10035]: 2017-09-28 12:50:34.382 10035 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:50:34 ctl02 nova-api[10035]: 2017-09-28 12:50:34.384 10035 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:50:34 ctl02 nova-api[10035]: 2017-09-28 12:50:34.384 10035 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:50:34 ctl02 nova-api[10035]: 2017-09-28 12:50:34.385 10035 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:50:34 ctl02 nova-api[10035]: 2017-09-28 12:50:34.515 10035 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:50:34 ctl02 nova-api[10035]: 2017-09-28 12:50:34.517 10035 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:50:34 ctl02 nova-api[10035]: 2017-09-28 12:50:34.517 10035 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:50:34 ctl02 nova-api[10035]: 2017-09-28 12:50:34.517 10035 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:50:34 ctl02 nova-api[10035]: 2017-09-28 12:50:34.521 10035 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:50:34 ctl02 nova-api[10035]: 2017-09-28 12:50:34.521 10035 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:50:34 ctl02 nova-api[10035]: 2017-09-28 12:50:34.521 10035 ERROR nova Traceback (most recent call last):
Sep 28 12:50:34 ctl02 nova-api[10035]: 2017-09-28 12:50:34.521 10035 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:50:34 ctl02 nova-api[10035]: 2017-09-28 12:50:34.521 10035 ERROR nova     sys.exit(main())
Sep 28 12:50:34 ctl02 nova-api[10035]: 2017-09-28 12:50:34.521 10035 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:50:34 ctl02 nova-api[10035]: 2017-09-28 12:50:34.521 10035 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:50:34 ctl02 nova-api[10035]: 2017-09-28 12:50:34.521 10035 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:50:34 ctl02 nova-api[10035]: 2017-09-28 12:50:34.521 10035 ERROR nova     max_url_len=max_url_len)
Sep 28 12:50:34 ctl02 nova-api[10035]: 2017-09-28 12:50:34.521 10035 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:50:34 ctl02 nova-api[10035]: 2017-09-28 12:50:34.521 10035 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:50:34 ctl02 nova-api[10035]: 2017-09-28 12:50:34.521 10035 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:50:34 ctl02 nova-api[10035]: 2017-09-28 12:50:34.521 10035 ERROR nova     sock.listen(backlog)
Sep 28 12:50:34 ctl02 nova-api[10035]: 2017-09-28 12:50:34.521 10035 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:50:34 ctl02 nova-api[10035]: 2017-09-28 12:50:34.521 10035 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:50:34 ctl02 nova-api[10035]: 2017-09-28 12:50:34.521 10035 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:50:34 ctl02 nova-api[10035]: 2017-09-28 12:50:34.521 10035 ERROR nova
Sep 28 12:50:34 ctl02 neutron-server[30536]: 2017-09-28 12:50:34.609 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:34 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:34 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:34 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:34 ctl02 neutron-server[30536]: 2017-09-28 12:50:34.610 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:34 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:34 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:34 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:34 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:34 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:34 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:50:34 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:50:34 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:50:34 ctl02 neutron-server[30536]: 2017-09-28 12:50:34.863 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:34 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:34 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:34 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:34 ctl02 neutron-server[30536]: 2017-09-28 12:50:34.863 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:34 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:34 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:34 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:34 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:34 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:34 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:50:34 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:50:34 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:50:34 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:50:35 ctl02 neutron-server[30536]: 2017-09-28 12:50:35.116 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:35 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:35 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:35 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:35 ctl02 neutron-server[30536]: 2017-09-28 12:50:35.117 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:35 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:35 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:35 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:35 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:35 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:35 ctl02 neutron-server[30536]: 2017-09-28 12:50:35.372 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:35 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:35 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:35 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:35 ctl02 neutron-server[30536]: 2017-09-28 12:50:35.373 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:35 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:35 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:35 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:35 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:35 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:35 ctl02 neutron-server[30536]: 2017-09-28 12:50:35.627 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:35 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:35 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:35 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:35 ctl02 neutron-server[30536]: 2017-09-28 12:50:35.629 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:35 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:35 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:35 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:35 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:35 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:35 ctl02 neutron-server[30536]: 2017-09-28 12:50:35.884 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:35 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:35 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:35 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:35 ctl02 neutron-server[30536]: 2017-09-28 12:50:35.885 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:35 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:35 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:35 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:35 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:35 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:36 ctl02 neutron-server[30536]: 2017-09-28 12:50:36.139 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:36 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:36 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:36 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:36 ctl02 neutron-server[30536]: 2017-09-28 12:50:36.141 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:36 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:36 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:36 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:36 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:36 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:36 ctl02 neutron-server[30536]: 2017-09-28 12:50:36.188 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 12:50:36 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:50:36 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:48:56 cmp002
Sep 28 12:50:36 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:49:38 cmp001
Sep 28 12:50:36 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:50:00 cmp002
Sep 28 12:50:36 ctl02 neutron-server[30536]: 2017-09-28 12:50:36.394 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:36 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:36 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:36 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:36 ctl02 neutron-server[30536]: 2017-09-28 12:50:36.396 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:36 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:36 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:36 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:36 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:36 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:36 ctl02 nova-api[10053]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:50:36 ctl02 nova-api[10053]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:50:36 ctl02 neutron-server[30536]: 2017-09-28 12:50:36.650 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:36 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:36 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:36 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:36 ctl02 neutron-server[30536]: 2017-09-28 12:50:36.652 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:36 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:36 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:36 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:36 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:36 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:36 ctl02 nova-api[10053]: 2017-09-28 12:50:36.707 10053 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:50:36 ctl02 nova-api[10053]: 2017-09-28 12:50:36.708 10053 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:50:36 ctl02 nova-api[10053]: 2017-09-28 12:50:36.708 10053 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:50:36 ctl02 nova-api[10053]: 2017-09-28 12:50:36.708 10053 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:50:36 ctl02 nova-api[10053]: 2017-09-28 12:50:36.708 10053 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:50:36 ctl02 nova-api[10053]: 2017-09-28 12:50:36.708 10053 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:50:36 ctl02 nova-api[10053]: 2017-09-28 12:50:36.708 10053 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:50:36 ctl02 nova-api[10053]: 2017-09-28 12:50:36.708 10053 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:50:36 ctl02 nova-api[10053]: 2017-09-28 12:50:36.708 10053 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:50:36 ctl02 nova-api[10053]: 2017-09-28 12:50:36.708 10053 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:50:36 ctl02 nova-api[10053]: 2017-09-28 12:50:36.708 10053 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:50:36 ctl02 nova-api[10053]: 2017-09-28 12:50:36.708 10053 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:50:36 ctl02 nova-api[10053]: 2017-09-28 12:50:36.708 10053 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:50:36 ctl02 nova-api[10053]: 2017-09-28 12:50:36.708 10053 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:50:36 ctl02 nova-api[10053]: 2017-09-28 12:50:36.708 10053 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:50:36 ctl02 nova-api[10053]: 2017-09-28 12:50:36.708 10053 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:50:36 ctl02 nova-api[10053]: 2017-09-28 12:50:36.708 10053 ERROR nova.wsgi     self.filename))
Sep 28 12:50:36 ctl02 nova-api[10053]: 2017-09-28 12:50:36.708 10053 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:50:36 ctl02 nova-api[10053]: 2017-09-28 12:50:36.708 10053 ERROR nova.wsgi
Sep 28 12:50:36 ctl02 nova-api[10053]: 2017-09-28 12:50:36.709 10053 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:50:36 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:50:36.753 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:50:36] "OPTIONS / HTTP/1.0" 200 134 0.000363
Sep 28 12:50:36 ctl02 nova-api[10053]: 2017-09-28 12:50:36.834 10053 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:50:36 ctl02 neutron-server[30536]: 2017-09-28 12:50:36.906 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:36 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:36 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:36 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:36 ctl02 neutron-server[30536]: 2017-09-28 12:50:36.908 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:36 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:36 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:36 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:36 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:36 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:37 ctl02 nova-api[10053]: 2017-09-28 12:50:37.050 10053 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:50:37 ctl02 nova-api[10053]: 2017-09-28 12:50:37.053 10053 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:50:37 ctl02 nova-api[10053]: 2017-09-28 12:50:37.053 10053 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:50:37 ctl02 nova-api[10053]: 2017-09-28 12:50:37.053 10053 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:50:37 ctl02 neutron-server[30536]: 2017-09-28 12:50:37.162 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:37 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:37 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:37 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:37 ctl02 neutron-server[30536]: 2017-09-28 12:50:37.164 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:37 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:37 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:37 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:37 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:37 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:37 ctl02 nova-api[10053]: 2017-09-28 12:50:37.182 10053 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:50:37 ctl02 nova-api[10053]: 2017-09-28 12:50:37.184 10053 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:50:37 ctl02 nova-api[10053]: 2017-09-28 12:50:37.184 10053 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:50:37 ctl02 nova-api[10053]: 2017-09-28 12:50:37.185 10053 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:50:37 ctl02 nova-api[10053]: 2017-09-28 12:50:37.188 10053 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:50:37 ctl02 nova-api[10053]: 2017-09-28 12:50:37.188 10053 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:50:37 ctl02 nova-api[10053]: 2017-09-28 12:50:37.188 10053 ERROR nova Traceback (most recent call last):
Sep 28 12:50:37 ctl02 nova-api[10053]: 2017-09-28 12:50:37.188 10053 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:50:37 ctl02 nova-api[10053]: 2017-09-28 12:50:37.188 10053 ERROR nova     sys.exit(main())
Sep 28 12:50:37 ctl02 nova-api[10053]: 2017-09-28 12:50:37.188 10053 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:50:37 ctl02 nova-api[10053]: 2017-09-28 12:50:37.188 10053 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:50:37 ctl02 nova-api[10053]: 2017-09-28 12:50:37.188 10053 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:50:37 ctl02 nova-api[10053]: 2017-09-28 12:50:37.188 10053 ERROR nova     max_url_len=max_url_len)
Sep 28 12:50:37 ctl02 nova-api[10053]: 2017-09-28 12:50:37.188 10053 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:50:37 ctl02 nova-api[10053]: 2017-09-28 12:50:37.188 10053 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:50:37 ctl02 nova-api[10053]: 2017-09-28 12:50:37.188 10053 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:50:37 ctl02 nova-api[10053]: 2017-09-28 12:50:37.188 10053 ERROR nova     sock.listen(backlog)
Sep 28 12:50:37 ctl02 nova-api[10053]: 2017-09-28 12:50:37.188 10053 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:50:37 ctl02 nova-api[10053]: 2017-09-28 12:50:37.188 10053 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:50:37 ctl02 nova-api[10053]: 2017-09-28 12:50:37.188 10053 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:50:37 ctl02 nova-api[10053]: 2017-09-28 12:50:37.188 10053 ERROR nova
Sep 28 12:50:37 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:50:37.304 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:50:37] "OPTIONS / HTTP/1.0" 200 134 0.000445
Sep 28 12:50:37 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:50:37 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:50:37 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:50:37 ctl02 heat-api-cfn[13300]: 2017-09-28 12:50:37.396 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:50:37] "OPTIONS / HTTP/1.0" 200 134 0.000595
Sep 28 12:50:37 ctl02 neutron-server[30536]: 2017-09-28 12:50:37.419 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:37 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:37 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:37 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:37 ctl02 neutron-server[30536]: 2017-09-28 12:50:37.421 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:37 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:37 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:37 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:37 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:37 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:37 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:50:37 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:50:37 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:50:37 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:50:37 ctl02 neutron-server[30536]: 2017-09-28 12:50:37.675 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:37 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:37 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:37 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:37 ctl02 neutron-server[30536]: 2017-09-28 12:50:37.676 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:37 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:37 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:37 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:37 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:37 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:37 ctl02 heat-api-cfn[13300]: 2017-09-28 12:50:37.783 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:50:37] "OPTIONS / HTTP/1.0" 200 134 0.000387
Sep 28 12:50:37 ctl02 neutron-server[30536]: 2017-09-28 12:50:37.930 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:37 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:37 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:37 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:37 ctl02 neutron-server[30536]: 2017-09-28 12:50:37.930 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:37 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:37 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:37 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:37 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:37 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:38 ctl02 heat-api[13008]: 2017-09-28 12:50:38.156 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:50:38] "OPTIONS / HTTP/1.0" 200 134 0.000569
Sep 28 12:50:38 ctl02 neutron-server[30536]: 2017-09-28 12:50:38.184 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:38 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:38 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:38 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:38 ctl02 neutron-server[30536]: 2017-09-28 12:50:38.185 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:38 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:38 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:38 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:38 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:38 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:38 ctl02 neutron-server[30536]: 2017-09-28 12:50:38.440 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:38 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:38 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:38 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:38 ctl02 neutron-server[30536]: 2017-09-28 12:50:38.441 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:38 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:38 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:38 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:38 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:38 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:38 ctl02 neutron-server[30536]: 2017-09-28 12:50:38.694 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:38 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:38 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:38 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:38 ctl02 neutron-server[30536]: 2017-09-28 12:50:38.695 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:38 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:38 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:38 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:38 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:38 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:38 ctl02 neutron-server[30536]: 2017-09-28 12:50:38.948 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:38 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:38 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:38 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:38 ctl02 neutron-server[30536]: 2017-09-28 12:50:38.948 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:38 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:38 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:38 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:38 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:38 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:39 ctl02 neutron-server[30536]: 2017-09-28 12:50:39.201 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:39 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:39 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:39 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:39 ctl02 neutron-server[30536]: 2017-09-28 12:50:39.202 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:39 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:39 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:39 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:39 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:39 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:39 ctl02 heat-api[13008]: 2017-09-28 12:50:39.276 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:50:39] "OPTIONS / HTTP/1.0" 200 134 0.000541
Sep 28 12:50:39 ctl02 nova-api[10070]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:50:39 ctl02 nova-api[10070]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:50:39 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:50:39.332 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:50:39] "OPTIONS / HTTP/1.0" 200 134 0.000428
Sep 28 12:50:39 ctl02 neutron-server[30536]: 2017-09-28 12:50:39.455 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:39 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:39 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:39 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:39 ctl02 neutron-server[30536]: 2017-09-28 12:50:39.457 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:39 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:39 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:39 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:39 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:39 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:39 ctl02 nova-api[10070]: 2017-09-28 12:50:39.478 10070 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:50:39 ctl02 nova-api[10070]: 2017-09-28 12:50:39.479 10070 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:50:39 ctl02 nova-api[10070]: 2017-09-28 12:50:39.479 10070 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:50:39 ctl02 nova-api[10070]: 2017-09-28 12:50:39.479 10070 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:50:39 ctl02 nova-api[10070]: 2017-09-28 12:50:39.479 10070 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:50:39 ctl02 nova-api[10070]: 2017-09-28 12:50:39.479 10070 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:50:39 ctl02 nova-api[10070]: 2017-09-28 12:50:39.479 10070 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:50:39 ctl02 nova-api[10070]: 2017-09-28 12:50:39.479 10070 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:50:39 ctl02 nova-api[10070]: 2017-09-28 12:50:39.479 10070 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:50:39 ctl02 nova-api[10070]: 2017-09-28 12:50:39.479 10070 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:50:39 ctl02 nova-api[10070]: 2017-09-28 12:50:39.479 10070 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:50:39 ctl02 nova-api[10070]: 2017-09-28 12:50:39.479 10070 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:50:39 ctl02 nova-api[10070]: 2017-09-28 12:50:39.479 10070 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:50:39 ctl02 nova-api[10070]: 2017-09-28 12:50:39.479 10070 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:50:39 ctl02 nova-api[10070]: 2017-09-28 12:50:39.479 10070 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:50:39 ctl02 nova-api[10070]: 2017-09-28 12:50:39.479 10070 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:50:39 ctl02 nova-api[10070]: 2017-09-28 12:50:39.479 10070 ERROR nova.wsgi     self.filename))
Sep 28 12:50:39 ctl02 nova-api[10070]: 2017-09-28 12:50:39.479 10070 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:50:39 ctl02 nova-api[10070]: 2017-09-28 12:50:39.479 10070 ERROR nova.wsgi
Sep 28 12:50:39 ctl02 nova-api[10070]: 2017-09-28 12:50:39.480 10070 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:50:39 ctl02 nova-api[10070]: 2017-09-28 12:50:39.606 10070 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:50:39 ctl02 neutron-server[30536]: 2017-09-28 12:50:39.712 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:39 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:39 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:39 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:39 ctl02 neutron-server[30536]: 2017-09-28 12:50:39.714 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:39 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:39 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:39 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:39 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:39 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:39 ctl02 nova-api[10070]: 2017-09-28 12:50:39.823 10070 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:50:39 ctl02 nova-api[10070]: 2017-09-28 12:50:39.825 10070 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:50:39 ctl02 nova-api[10070]: 2017-09-28 12:50:39.826 10070 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:50:39 ctl02 nova-api[10070]: 2017-09-28 12:50:39.826 10070 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:50:39 ctl02 nova-api[10070]: 2017-09-28 12:50:39.954 10070 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:50:39 ctl02 nova-api[10070]: 2017-09-28 12:50:39.955 10070 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:50:39 ctl02 nova-api[10070]: 2017-09-28 12:50:39.955 10070 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:50:39 ctl02 nova-api[10070]: 2017-09-28 12:50:39.956 10070 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:50:39 ctl02 nova-api[10070]: 2017-09-28 12:50:39.959 10070 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:50:39 ctl02 nova-api[10070]: 2017-09-28 12:50:39.959 10070 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:50:39 ctl02 nova-api[10070]: 2017-09-28 12:50:39.959 10070 ERROR nova Traceback (most recent call last):
Sep 28 12:50:39 ctl02 nova-api[10070]: 2017-09-28 12:50:39.959 10070 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:50:39 ctl02 nova-api[10070]: 2017-09-28 12:50:39.959 10070 ERROR nova     sys.exit(main())
Sep 28 12:50:39 ctl02 nova-api[10070]: 2017-09-28 12:50:39.959 10070 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:50:39 ctl02 nova-api[10070]: 2017-09-28 12:50:39.959 10070 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:50:39 ctl02 nova-api[10070]: 2017-09-28 12:50:39.959 10070 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:50:39 ctl02 nova-api[10070]: 2017-09-28 12:50:39.959 10070 ERROR nova     max_url_len=max_url_len)
Sep 28 12:50:39 ctl02 nova-api[10070]: 2017-09-28 12:50:39.959 10070 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:50:39 ctl02 nova-api[10070]: 2017-09-28 12:50:39.959 10070 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:50:39 ctl02 nova-api[10070]: 2017-09-28 12:50:39.959 10070 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:50:39 ctl02 nova-api[10070]: 2017-09-28 12:50:39.959 10070 ERROR nova     sock.listen(backlog)
Sep 28 12:50:39 ctl02 nova-api[10070]: 2017-09-28 12:50:39.959 10070 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:50:39 ctl02 nova-api[10070]: 2017-09-28 12:50:39.959 10070 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:50:39 ctl02 nova-api[10070]: 2017-09-28 12:50:39.959 10070 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:50:39 ctl02 nova-api[10070]: 2017-09-28 12:50:39.959 10070 ERROR nova
Sep 28 12:50:39 ctl02 neutron-server[30536]: 2017-09-28 12:50:39.968 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:39 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:39 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:39 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:39 ctl02 neutron-server[30536]: 2017-09-28 12:50:39.970 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:39 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:39 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:39 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:39 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:39 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:40 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:50:40 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:50:40 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:50:40 ctl02 neutron-server[30536]: 2017-09-28 12:50:40.225 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:40 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:40 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:40 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:40 ctl02 neutron-server[30536]: 2017-09-28 12:50:40.227 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:40 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:40 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:40 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:40 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:40 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:40 ctl02 glance-api[29183]: 2017-09-28 12:50:40.365 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:50:40] "OPTIONS / HTTP/1.0" 200 134 0.000766
Sep 28 12:50:40 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:50:40 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:50:40 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:50:40 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:50:40 ctl02 neutron-server[30536]: 2017-09-28 12:50:40.483 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:40 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:40 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:40 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:40 ctl02 neutron-server[30536]: 2017-09-28 12:50:40.484 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:40 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:40 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:40 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:40 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:40 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:40 ctl02 neutron-server[30536]: 2017-09-28 12:50:40.737 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:40 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:40 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:40 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:40 ctl02 neutron-server[30536]: 2017-09-28 12:50:40.738 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:40 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:40 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:40 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:40 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:40 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:40 ctl02 neutron-server[30536]: 2017-09-28 12:50:40.991 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:40 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:40 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:40 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:40 ctl02 neutron-server[30536]: 2017-09-28 12:50:40.992 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:40 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:40 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:40 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:40 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:40 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:41 ctl02 heat-api-cfn[13300]: 2017-09-28 12:50:41.062 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:50:41] "OPTIONS / HTTP/1.0" 200 134 0.000445
Sep 28 12:50:41 ctl02 glance-api[29183]: 2017-09-28 12:50:41.064 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:50:41] "OPTIONS / HTTP/1.0" 200 134 0.000544
Sep 28 12:50:41 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9db22258)
Sep 28 12:50:41 ctl02 neutron-server[30536]: 2017-09-28 12:50:41.149 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:50:41] "OPTIONS / HTTP/1.0" 200 262 0.000441
Sep 28 12:50:41 ctl02 neutron-server[30536]: 2017-09-28 12:50:41.245 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:41 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:41 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:41 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:41 ctl02 neutron-server[30536]: 2017-09-28 12:50:41.246 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:41 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:41 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:41 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:41 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:41 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:41 ctl02 neutron-server[30536]: 2017-09-28 12:50:41.501 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:41 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:41 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:41 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:41 ctl02 neutron-server[30536]: 2017-09-28 12:50:41.502 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:41 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:41 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:41 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:41 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:41 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:41 ctl02 neutron-server[30536]: 2017-09-28 12:50:41.659 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:50:41] "OPTIONS / HTTP/1.0" 200 262 0.000433
Sep 28 12:50:41 ctl02 neutron-server[30536]: 2017-09-28 12:50:41.757 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:41 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:41 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:41 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:41 ctl02 neutron-server[30536]: 2017-09-28 12:50:41.758 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:41 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:41 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:41 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:41 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:41 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:41 ctl02 glance-api[29183]: 2017-09-28 12:50:41.870 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:50:41] "OPTIONS / HTTP/1.0" 200 134 0.000555
Sep 28 12:50:42 ctl02 neutron-server[30536]: 2017-09-28 12:50:42.012 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:42 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:42 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:42 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:42 ctl02 neutron-server[30536]: 2017-09-28 12:50:42.013 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:42 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:42 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:42 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:42 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:42 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:42 ctl02 nova-api[10089]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:50:42 ctl02 nova-api[10089]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:50:42 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9db22258)
Sep 28 12:50:42 ctl02 nova-api[10089]: 2017-09-28 12:50:42.213 10089 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:50:42 ctl02 nova-api[10089]: 2017-09-28 12:50:42.214 10089 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:50:42 ctl02 nova-api[10089]: 2017-09-28 12:50:42.214 10089 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:50:42 ctl02 nova-api[10089]: 2017-09-28 12:50:42.214 10089 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:50:42 ctl02 nova-api[10089]: 2017-09-28 12:50:42.214 10089 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:50:42 ctl02 nova-api[10089]: 2017-09-28 12:50:42.214 10089 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:50:42 ctl02 nova-api[10089]: 2017-09-28 12:50:42.214 10089 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:50:42 ctl02 nova-api[10089]: 2017-09-28 12:50:42.214 10089 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:50:42 ctl02 nova-api[10089]: 2017-09-28 12:50:42.214 10089 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:50:42 ctl02 nova-api[10089]: 2017-09-28 12:50:42.214 10089 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:50:42 ctl02 nova-api[10089]: 2017-09-28 12:50:42.214 10089 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:50:42 ctl02 nova-api[10089]: 2017-09-28 12:50:42.214 10089 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:50:42 ctl02 nova-api[10089]: 2017-09-28 12:50:42.214 10089 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:50:42 ctl02 nova-api[10089]: 2017-09-28 12:50:42.214 10089 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:50:42 ctl02 nova-api[10089]: 2017-09-28 12:50:42.214 10089 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:50:42 ctl02 nova-api[10089]: 2017-09-28 12:50:42.214 10089 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:50:42 ctl02 nova-api[10089]: 2017-09-28 12:50:42.214 10089 ERROR nova.wsgi     self.filename))
Sep 28 12:50:42 ctl02 nova-api[10089]: 2017-09-28 12:50:42.214 10089 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:50:42 ctl02 nova-api[10089]: 2017-09-28 12:50:42.214 10089 ERROR nova.wsgi
Sep 28 12:50:42 ctl02 nova-api[10089]: 2017-09-28 12:50:42.215 10089 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:50:42 ctl02 neutron-server[30536]: 2017-09-28 12:50:42.268 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:42 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:42 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:42 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:42 ctl02 neutron-server[30536]: 2017-09-28 12:50:42.270 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:42 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:42 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:42 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:42 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:42 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:42 ctl02 neutron-server[30536]: 2017-09-28 12:50:42.320 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:50:42] "OPTIONS / HTTP/1.0" 200 262 0.000481
Sep 28 12:50:42 ctl02 nova-api[10089]: 2017-09-28 12:50:42.343 10089 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:50:42 ctl02 neutron-server[30536]: 2017-09-28 12:50:42.524 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:42 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:42 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:42 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:42 ctl02 neutron-server[30536]: 2017-09-28 12:50:42.526 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:42 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:42 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:42 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:42 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:42 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:42 ctl02 nova-api[10089]: 2017-09-28 12:50:42.575 10089 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:50:42 ctl02 nova-api[10089]: 2017-09-28 12:50:42.577 10089 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:50:42 ctl02 nova-api[10089]: 2017-09-28 12:50:42.577 10089 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:50:42 ctl02 nova-api[10089]: 2017-09-28 12:50:42.578 10089 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:50:42 ctl02 nova-api[10089]: 2017-09-28 12:50:42.706 10089 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:50:42 ctl02 nova-api[10089]: 2017-09-28 12:50:42.708 10089 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:50:42 ctl02 nova-api[10089]: 2017-09-28 12:50:42.709 10089 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:50:42 ctl02 nova-api[10089]: 2017-09-28 12:50:42.709 10089 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:50:42 ctl02 nova-api[10089]: 2017-09-28 12:50:42.712 10089 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:50:42 ctl02 nova-api[10089]: 2017-09-28 12:50:42.712 10089 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:50:42 ctl02 nova-api[10089]: 2017-09-28 12:50:42.712 10089 ERROR nova Traceback (most recent call last):
Sep 28 12:50:42 ctl02 nova-api[10089]: 2017-09-28 12:50:42.712 10089 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:50:42 ctl02 nova-api[10089]: 2017-09-28 12:50:42.712 10089 ERROR nova     sys.exit(main())
Sep 28 12:50:42 ctl02 nova-api[10089]: 2017-09-28 12:50:42.712 10089 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:50:42 ctl02 nova-api[10089]: 2017-09-28 12:50:42.712 10089 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:50:42 ctl02 nova-api[10089]: 2017-09-28 12:50:42.712 10089 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:50:42 ctl02 nova-api[10089]: 2017-09-28 12:50:42.712 10089 ERROR nova     max_url_len=max_url_len)
Sep 28 12:50:42 ctl02 nova-api[10089]: 2017-09-28 12:50:42.712 10089 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:50:42 ctl02 nova-api[10089]: 2017-09-28 12:50:42.712 10089 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:50:42 ctl02 nova-api[10089]: 2017-09-28 12:50:42.712 10089 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:50:42 ctl02 nova-api[10089]: 2017-09-28 12:50:42.712 10089 ERROR nova     sock.listen(backlog)
Sep 28 12:50:42 ctl02 nova-api[10089]: 2017-09-28 12:50:42.712 10089 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:50:42 ctl02 nova-api[10089]: 2017-09-28 12:50:42.712 10089 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:50:42 ctl02 nova-api[10089]: 2017-09-28 12:50:42.712 10089 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:50:42 ctl02 nova-api[10089]: 2017-09-28 12:50:42.712 10089 ERROR nova
Sep 28 12:50:42 ctl02 neutron-server[30536]: 2017-09-28 12:50:42.781 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:42 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:42 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:42 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:42 ctl02 neutron-server[30536]: 2017-09-28 12:50:42.783 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:42 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:42 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:42 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:42 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:42 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:42 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:50:42 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:50:42 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:50:43 ctl02 neutron-server[30536]: 2017-09-28 12:50:43.038 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:43 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:43 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:43 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:43 ctl02 neutron-server[30536]: 2017-09-28 12:50:43.040 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:43 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:43 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:43 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:43 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:43 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:43 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9db22258)
Sep 28 12:50:43 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:50:43 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:50:43 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:50:43 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:50:43 ctl02 neutron-server[30536]: 2017-09-28 12:50:43.294 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:43 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:43 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:43 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:43 ctl02 neutron-server[30536]: 2017-09-28 12:50:43.295 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:43 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:43 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:43 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:43 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:43 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:43 ctl02 neutron-server[30536]: 2017-09-28 12:50:43.549 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:43 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:43 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:43 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:43 ctl02 neutron-server[30536]: 2017-09-28 12:50:43.549 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:43 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:43 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:43 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:43 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:43 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:43 ctl02 neutron-server[30536]: 2017-09-28 12:50:43.803 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:43 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:43 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:43 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:43 ctl02 neutron-server[30536]: 2017-09-28 12:50:43.803 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:43 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:43 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:43 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:43 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:43 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:44 ctl02 heat-api[13008]: 2017-09-28 12:50:44.040 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:50:44] "OPTIONS / HTTP/1.0" 200 134 0.000533
Sep 28 12:50:44 ctl02 neutron-server[30536]: 2017-09-28 12:50:44.058 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:44 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:44 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:44 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:44 ctl02 neutron-server[30536]: 2017-09-28 12:50:44.058 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:44 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:44 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:44 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:44 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:44 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:44 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9db22258)
Sep 28 12:50:44 ctl02 neutron-server[30536]: 2017-09-28 12:50:44.312 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:44 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:44 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:44 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:44 ctl02 neutron-server[30536]: 2017-09-28 12:50:44.312 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:44 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:44 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:44 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:44 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:44 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:44 ctl02 neutron-server[30536]: 2017-09-28 12:50:44.574 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:44 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:44 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:44 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:44 ctl02 neutron-server[30536]: 2017-09-28 12:50:44.575 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:44 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:44 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:44 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:44 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:44 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:44 ctl02 nova-api[10106]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:50:44 ctl02 nova-api[10106]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:50:44 ctl02 neutron-server[30536]: 2017-09-28 12:50:44.828 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:44 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:44 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:44 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:44 ctl02 neutron-server[30536]: 2017-09-28 12:50:44.828 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:44 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:44 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:44 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:44 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:44 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:44 ctl02 nova-api[10106]: 2017-09-28 12:50:44.951 10106 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:50:44 ctl02 nova-api[10106]: 2017-09-28 12:50:44.953 10106 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:50:44 ctl02 nova-api[10106]: 2017-09-28 12:50:44.953 10106 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:50:44 ctl02 nova-api[10106]: 2017-09-28 12:50:44.953 10106 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:50:44 ctl02 nova-api[10106]: 2017-09-28 12:50:44.953 10106 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:50:44 ctl02 nova-api[10106]: 2017-09-28 12:50:44.953 10106 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:50:44 ctl02 nova-api[10106]: 2017-09-28 12:50:44.953 10106 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:50:44 ctl02 nova-api[10106]: 2017-09-28 12:50:44.953 10106 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:50:44 ctl02 nova-api[10106]: 2017-09-28 12:50:44.953 10106 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:50:44 ctl02 nova-api[10106]: 2017-09-28 12:50:44.953 10106 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:50:44 ctl02 nova-api[10106]: 2017-09-28 12:50:44.953 10106 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:50:44 ctl02 nova-api[10106]: 2017-09-28 12:50:44.953 10106 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:50:44 ctl02 nova-api[10106]: 2017-09-28 12:50:44.953 10106 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:50:44 ctl02 nova-api[10106]: 2017-09-28 12:50:44.953 10106 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:50:44 ctl02 nova-api[10106]: 2017-09-28 12:50:44.953 10106 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:50:44 ctl02 nova-api[10106]: 2017-09-28 12:50:44.953 10106 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:50:44 ctl02 nova-api[10106]: 2017-09-28 12:50:44.953 10106 ERROR nova.wsgi     self.filename))
Sep 28 12:50:44 ctl02 nova-api[10106]: 2017-09-28 12:50:44.953 10106 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:50:44 ctl02 nova-api[10106]: 2017-09-28 12:50:44.953 10106 ERROR nova.wsgi
Sep 28 12:50:44 ctl02 nova-api[10106]: 2017-09-28 12:50:44.954 10106 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:50:45 ctl02 nova-api[10106]: 2017-09-28 12:50:45.078 10106 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:50:45 ctl02 neutron-server[30536]: 2017-09-28 12:50:45.082 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:45 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:45 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:45 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:45 ctl02 neutron-server[30536]: 2017-09-28 12:50:45.082 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:45 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:45 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:45 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:45 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:45 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:45 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9db22258)
Sep 28 12:50:45 ctl02 nova-api[10106]: 2017-09-28 12:50:45.300 10106 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:50:45 ctl02 nova-api[10106]: 2017-09-28 12:50:45.302 10106 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:50:45 ctl02 nova-api[10106]: 2017-09-28 12:50:45.302 10106 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:50:45 ctl02 nova-api[10106]: 2017-09-28 12:50:45.302 10106 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:50:45 ctl02 neutron-server[30536]: 2017-09-28 12:50:45.335 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:45 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:45 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:45 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:45 ctl02 neutron-server[30536]: 2017-09-28 12:50:45.336 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:45 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:45 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:45 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:45 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:45 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:45 ctl02 nova-api[10106]: 2017-09-28 12:50:45.431 10106 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:50:45 ctl02 nova-api[10106]: 2017-09-28 12:50:45.432 10106 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:50:45 ctl02 nova-api[10106]: 2017-09-28 12:50:45.433 10106 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:50:45 ctl02 nova-api[10106]: 2017-09-28 12:50:45.433 10106 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:50:45 ctl02 nova-api[10106]: 2017-09-28 12:50:45.436 10106 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:50:45 ctl02 nova-api[10106]: 2017-09-28 12:50:45.436 10106 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:50:45 ctl02 nova-api[10106]: 2017-09-28 12:50:45.436 10106 ERROR nova Traceback (most recent call last):
Sep 28 12:50:45 ctl02 nova-api[10106]: 2017-09-28 12:50:45.436 10106 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:50:45 ctl02 nova-api[10106]: 2017-09-28 12:50:45.436 10106 ERROR nova     sys.exit(main())
Sep 28 12:50:45 ctl02 nova-api[10106]: 2017-09-28 12:50:45.436 10106 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:50:45 ctl02 nova-api[10106]: 2017-09-28 12:50:45.436 10106 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:50:45 ctl02 nova-api[10106]: 2017-09-28 12:50:45.436 10106 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:50:45 ctl02 nova-api[10106]: 2017-09-28 12:50:45.436 10106 ERROR nova     max_url_len=max_url_len)
Sep 28 12:50:45 ctl02 nova-api[10106]: 2017-09-28 12:50:45.436 10106 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:50:45 ctl02 nova-api[10106]: 2017-09-28 12:50:45.436 10106 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:50:45 ctl02 nova-api[10106]: 2017-09-28 12:50:45.436 10106 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:50:45 ctl02 nova-api[10106]: 2017-09-28 12:50:45.436 10106 ERROR nova     sock.listen(backlog)
Sep 28 12:50:45 ctl02 nova-api[10106]: 2017-09-28 12:50:45.436 10106 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:50:45 ctl02 nova-api[10106]: 2017-09-28 12:50:45.436 10106 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:50:45 ctl02 nova-api[10106]: 2017-09-28 12:50:45.436 10106 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:50:45 ctl02 nova-api[10106]: 2017-09-28 12:50:45.436 10106 ERROR nova
Sep 28 12:50:45 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:50:45 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:50:45 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:50:45 ctl02 neutron-server[30536]: 2017-09-28 12:50:45.589 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:45 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:45 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:45 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:45 ctl02 neutron-server[30536]: 2017-09-28 12:50:45.589 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:45 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:45 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:45 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:45 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:45 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:45 ctl02 neutron-server[30536]: 2017-09-28 12:50:45.843 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:45 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:45 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:45 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:45 ctl02 neutron-server[30536]: 2017-09-28 12:50:45.843 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:45 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:45 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:45 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:45 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:45 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:45 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:50:45 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:50:45 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:50:45 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:50:46 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9db22258)
Sep 28 12:50:46 ctl02 neutron-server[30536]: 2017-09-28 12:50:46.096 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:46 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:46 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:46 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:46 ctl02 neutron-server[30536]: 2017-09-28 12:50:46.097 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:46 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:46 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:46 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:46 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:46 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:46 ctl02 neutron-server[30536]: 2017-09-28 12:50:46.350 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:46 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:46 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:46 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:46 ctl02 neutron-server[30536]: 2017-09-28 12:50:46.351 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:46 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:46 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:46 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:46 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:46 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:46 ctl02 neutron-server[30536]: 2017-09-28 12:50:46.604 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:46 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:46 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:46 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:46 ctl02 neutron-server[30536]: 2017-09-28 12:50:46.605 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:46 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:46 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:46 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:46 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:46 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:46 ctl02 neutron-server[30536]: 2017-09-28 12:50:46.858 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:46 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:46 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:46 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:46 ctl02 neutron-server[30536]: 2017-09-28 12:50:46.858 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:46 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:46 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:46 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:46 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:46 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:46 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:50:46.886 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:50:46] "OPTIONS / HTTP/1.0" 200 134 0.000347
Sep 28 12:50:47 ctl02 nova-conductor[5056]: 2017-09-28 12:50:47.071 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:50:47 ctl02 nova-conductor[5056]: 2017-09-28 12:50:47.091 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:50:47 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9db22258)
Sep 28 12:50:47 ctl02 neutron-server[30536]: 2017-09-28 12:50:47.111 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:47 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:47 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:47 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:47 ctl02 neutron-server[30536]: 2017-09-28 12:50:47.112 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:47 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:47 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:47 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:47 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:47 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:47 ctl02 nova-conductor[5056]: 2017-09-28 12:50:47.119 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:50:47 ctl02 nova-conductor[5056]: 2017-09-28 12:50:47.123 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:50:47 ctl02 nova-cert[4860]: 2017-09-28 12:50:47.180 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:50:47 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:50:47.195 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:50:47] "OPTIONS / HTTP/1.0" 200 134 0.000354
Sep 28 12:50:47 ctl02 neutron-server[30536]: 2017-09-28 12:50:47.365 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:47 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:47 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:47 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:47 ctl02 neutron-server[30536]: 2017-09-28 12:50:47.365 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:47 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:47 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:47 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:47 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:47 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:47 ctl02 nova-api[10126]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:50:47 ctl02 nova-api[10126]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:50:47 ctl02 neutron-server[30536]: 2017-09-28 12:50:47.618 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:47 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:47 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:47 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:47 ctl02 neutron-server[30536]: 2017-09-28 12:50:47.619 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:47 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:47 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:47 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:47 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:47 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:47 ctl02 heat-api-cfn[13300]: 2017-09-28 12:50:47.675 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:50:47] "OPTIONS / HTTP/1.0" 200 134 0.000467
Sep 28 12:50:47 ctl02 nova-api[10126]: 2017-09-28 12:50:47.770 10126 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:50:47 ctl02 nova-api[10126]: 2017-09-28 12:50:47.772 10126 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:50:47 ctl02 nova-api[10126]: 2017-09-28 12:50:47.772 10126 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:50:47 ctl02 nova-api[10126]: 2017-09-28 12:50:47.772 10126 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:50:47 ctl02 nova-api[10126]: 2017-09-28 12:50:47.772 10126 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:50:47 ctl02 nova-api[10126]: 2017-09-28 12:50:47.772 10126 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:50:47 ctl02 nova-api[10126]: 2017-09-28 12:50:47.772 10126 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:50:47 ctl02 nova-api[10126]: 2017-09-28 12:50:47.772 10126 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:50:47 ctl02 nova-api[10126]: 2017-09-28 12:50:47.772 10126 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:50:47 ctl02 nova-api[10126]: 2017-09-28 12:50:47.772 10126 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:50:47 ctl02 nova-api[10126]: 2017-09-28 12:50:47.772 10126 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:50:47 ctl02 nova-api[10126]: 2017-09-28 12:50:47.772 10126 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:50:47 ctl02 nova-api[10126]: 2017-09-28 12:50:47.772 10126 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:50:47 ctl02 nova-api[10126]: 2017-09-28 12:50:47.772 10126 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:50:47 ctl02 nova-api[10126]: 2017-09-28 12:50:47.772 10126 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:50:47 ctl02 nova-api[10126]: 2017-09-28 12:50:47.772 10126 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:50:47 ctl02 nova-api[10126]: 2017-09-28 12:50:47.772 10126 ERROR nova.wsgi     self.filename))
Sep 28 12:50:47 ctl02 nova-api[10126]: 2017-09-28 12:50:47.772 10126 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:50:47 ctl02 nova-api[10126]: 2017-09-28 12:50:47.772 10126 ERROR nova.wsgi
Sep 28 12:50:47 ctl02 nova-api[10126]: 2017-09-28 12:50:47.773 10126 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:50:47 ctl02 neutron-server[30536]: 2017-09-28 12:50:47.871 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:47 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:47 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:47 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:47 ctl02 neutron-server[30536]: 2017-09-28 12:50:47.872 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:47 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:47 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:47 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:47 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:47 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:47 ctl02 heat-api[13008]: 2017-09-28 12:50:47.901 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:50:47] "OPTIONS / HTTP/1.0" 200 134 0.000690
Sep 28 12:50:47 ctl02 nova-api[10126]: 2017-09-28 12:50:47.912 10126 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:50:48 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9db22258)
Sep 28 12:50:48 ctl02 heat-api-cfn[13300]: 2017-09-28 12:50:48.107 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:50:48] "OPTIONS / HTTP/1.0" 200 134 0.000493
Sep 28 12:50:48 ctl02 neutron-server[30536]: 2017-09-28 12:50:48.125 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:48 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:48 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:48 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:48 ctl02 neutron-server[30536]: 2017-09-28 12:50:48.126 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:48 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:48 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:48 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:48 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:48 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:48 ctl02 nova-api[10126]: 2017-09-28 12:50:48.168 10126 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:50:48 ctl02 nova-api[10126]: 2017-09-28 12:50:48.170 10126 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:50:48 ctl02 nova-api[10126]: 2017-09-28 12:50:48.170 10126 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:50:48 ctl02 nova-api[10126]: 2017-09-28 12:50:48.171 10126 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:50:48 ctl02 nova-api[10126]: 2017-09-28 12:50:48.308 10126 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:50:48 ctl02 nova-api[10126]: 2017-09-28 12:50:48.310 10126 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:50:48 ctl02 nova-api[10126]: 2017-09-28 12:50:48.310 10126 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:50:48 ctl02 nova-api[10126]: 2017-09-28 12:50:48.310 10126 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:50:48 ctl02 nova-api[10126]: 2017-09-28 12:50:48.314 10126 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:50:48 ctl02 nova-api[10126]: 2017-09-28 12:50:48.314 10126 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:50:48 ctl02 nova-api[10126]: 2017-09-28 12:50:48.314 10126 ERROR nova Traceback (most recent call last):
Sep 28 12:50:48 ctl02 nova-api[10126]: 2017-09-28 12:50:48.314 10126 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:50:48 ctl02 nova-api[10126]: 2017-09-28 12:50:48.314 10126 ERROR nova     sys.exit(main())
Sep 28 12:50:48 ctl02 nova-api[10126]: 2017-09-28 12:50:48.314 10126 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:50:48 ctl02 nova-api[10126]: 2017-09-28 12:50:48.314 10126 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:50:48 ctl02 nova-api[10126]: 2017-09-28 12:50:48.314 10126 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:50:48 ctl02 nova-api[10126]: 2017-09-28 12:50:48.314 10126 ERROR nova     max_url_len=max_url_len)
Sep 28 12:50:48 ctl02 nova-api[10126]: 2017-09-28 12:50:48.314 10126 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:50:48 ctl02 nova-api[10126]: 2017-09-28 12:50:48.314 10126 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:50:48 ctl02 nova-api[10126]: 2017-09-28 12:50:48.314 10126 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:50:48 ctl02 nova-api[10126]: 2017-09-28 12:50:48.314 10126 ERROR nova     sock.listen(backlog)
Sep 28 12:50:48 ctl02 nova-api[10126]: 2017-09-28 12:50:48.314 10126 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:50:48 ctl02 nova-api[10126]: 2017-09-28 12:50:48.314 10126 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:50:48 ctl02 nova-api[10126]: 2017-09-28 12:50:48.314 10126 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:50:48 ctl02 nova-api[10126]: 2017-09-28 12:50:48.314 10126 ERROR nova
Sep 28 12:50:48 ctl02 neutron-server[30536]: 2017-09-28 12:50:48.379 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:48 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:48 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:48 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:48 ctl02 neutron-server[30536]: 2017-09-28 12:50:48.379 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:48 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:48 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:48 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:48 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:48 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:48 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:50:48 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:50:48 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:50:48 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:50:48 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:50:48 ctl02 neutron-server[30536]: 2017-09-28 12:50:48.633 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:48 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:48 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:50:48 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:48 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:48 ctl02 neutron-server[30536]: 2017-09-28 12:50:48.634 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:48 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:48 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:48 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:48 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:48 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:48 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:50:48 ctl02 neutron-server[30536]: 2017-09-28 12:50:48.887 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:48 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:48 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:48 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:48 ctl02 neutron-server[30536]: 2017-09-28 12:50:48.887 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:48 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:48 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:48 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:48 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:48 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:49 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:50:49.053 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:50:49] "OPTIONS / HTTP/1.0" 200 134 0.000396
Sep 28 12:50:49 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9db22258)
Sep 28 12:50:49 ctl02 neutron-server[30536]: 2017-09-28 12:50:49.141 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:49 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:49 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:49 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:49 ctl02 neutron-server[30536]: 2017-09-28 12:50:49.141 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:49 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:49 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:49 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:49 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:49 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:49 ctl02 neutron-server[30536]: 2017-09-28 12:50:49.395 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:49 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:49 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:49 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:49 ctl02 neutron-server[30536]: 2017-09-28 12:50:49.396 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:49 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:49 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:49 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:49 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:49 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:49 ctl02 heat-api[13008]: 2017-09-28 12:50:49.579 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:50:49] "OPTIONS / HTTP/1.0" 200 134 0.000533
Sep 28 12:50:49 ctl02 neutron-server[30536]: 2017-09-28 12:50:49.649 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:49 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:49 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:49 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:49 ctl02 neutron-server[30536]: 2017-09-28 12:50:49.650 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:49 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:49 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:49 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:49 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:49 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:49 ctl02 neutron-server[30536]: 2017-09-28 12:50:49.903 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:49 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:49 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:49 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:49 ctl02 neutron-server[30536]: 2017-09-28 12:50:49.903 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:49 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:49 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:49 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:49 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:49 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:50 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9db22258)
Sep 28 12:50:50 ctl02 neutron-server[30536]: 2017-09-28 12:50:50.157 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:50 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:50 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:50 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:50 ctl02 neutron-server[30536]: 2017-09-28 12:50:50.158 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:50 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:50 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:50 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:50 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:50 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:50 ctl02 nova-api[10144]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:50:50 ctl02 nova-api[10144]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:50:50 ctl02 neutron-server[30536]: 2017-09-28 12:50:50.411 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:50 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:50 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:50 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:50 ctl02 neutron-server[30536]: 2017-09-28 12:50:50.411 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:50 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:50 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:50 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:50 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:50 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:50 ctl02 nova-api[10144]: 2017-09-28 12:50:50.506 10144 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:50:50 ctl02 nova-api[10144]: 2017-09-28 12:50:50.507 10144 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:50:50 ctl02 nova-api[10144]: 2017-09-28 12:50:50.507 10144 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:50:50 ctl02 nova-api[10144]: 2017-09-28 12:50:50.507 10144 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:50:50 ctl02 nova-api[10144]: 2017-09-28 12:50:50.507 10144 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:50:50 ctl02 nova-api[10144]: 2017-09-28 12:50:50.507 10144 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:50:50 ctl02 nova-api[10144]: 2017-09-28 12:50:50.507 10144 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:50:50 ctl02 nova-api[10144]: 2017-09-28 12:50:50.507 10144 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:50:50 ctl02 nova-api[10144]: 2017-09-28 12:50:50.507 10144 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:50:50 ctl02 nova-api[10144]: 2017-09-28 12:50:50.507 10144 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:50:50 ctl02 nova-api[10144]: 2017-09-28 12:50:50.507 10144 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:50:50 ctl02 nova-api[10144]: 2017-09-28 12:50:50.507 10144 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:50:50 ctl02 nova-api[10144]: 2017-09-28 12:50:50.507 10144 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:50:50 ctl02 nova-api[10144]: 2017-09-28 12:50:50.507 10144 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:50:50 ctl02 nova-api[10144]: 2017-09-28 12:50:50.507 10144 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:50:50 ctl02 nova-api[10144]: 2017-09-28 12:50:50.507 10144 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:50:50 ctl02 nova-api[10144]: 2017-09-28 12:50:50.507 10144 ERROR nova.wsgi     self.filename))
Sep 28 12:50:50 ctl02 nova-api[10144]: 2017-09-28 12:50:50.507 10144 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:50:50 ctl02 nova-api[10144]: 2017-09-28 12:50:50.507 10144 ERROR nova.wsgi
Sep 28 12:50:50 ctl02 nova-api[10144]: 2017-09-28 12:50:50.508 10144 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:50:50 ctl02 glance-api[29183]: 2017-09-28 12:50:50.559 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:50:50] "OPTIONS / HTTP/1.0" 200 134 0.000581
Sep 28 12:50:50 ctl02 nova-api[10144]: 2017-09-28 12:50:50.640 10144 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:50:50 ctl02 neutron-server[30536]: 2017-09-28 12:50:50.665 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:50 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:50 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:50 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:50 ctl02 neutron-server[30536]: 2017-09-28 12:50:50.665 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:50 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:50 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:50 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:50 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:50 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:50 ctl02 nova-api[10144]: 2017-09-28 12:50:50.868 10144 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:50:50 ctl02 nova-api[10144]: 2017-09-28 12:50:50.871 10144 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:50:50 ctl02 nova-api[10144]: 2017-09-28 12:50:50.871 10144 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:50:50 ctl02 nova-api[10144]: 2017-09-28 12:50:50.871 10144 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:50:50 ctl02 neutron-server[30536]: 2017-09-28 12:50:50.919 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:50 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:50 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:50 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:50 ctl02 neutron-server[30536]: 2017-09-28 12:50:50.919 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:50 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:50 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:50 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:50 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:50 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:51 ctl02 nova-api[10144]: 2017-09-28 12:50:51.003 10144 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:50:51 ctl02 nova-api[10144]: 2017-09-28 12:50:51.005 10144 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:50:51 ctl02 nova-api[10144]: 2017-09-28 12:50:51.005 10144 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:50:51 ctl02 nova-api[10144]: 2017-09-28 12:50:51.005 10144 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:50:51 ctl02 nova-api[10144]: 2017-09-28 12:50:51.009 10144 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:50:51 ctl02 nova-api[10144]: 2017-09-28 12:50:51.009 10144 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:50:51 ctl02 nova-api[10144]: 2017-09-28 12:50:51.009 10144 ERROR nova Traceback (most recent call last):
Sep 28 12:50:51 ctl02 nova-api[10144]: 2017-09-28 12:50:51.009 10144 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:50:51 ctl02 nova-api[10144]: 2017-09-28 12:50:51.009 10144 ERROR nova     sys.exit(main())
Sep 28 12:50:51 ctl02 nova-api[10144]: 2017-09-28 12:50:51.009 10144 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:50:51 ctl02 nova-api[10144]: 2017-09-28 12:50:51.009 10144 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:50:51 ctl02 nova-api[10144]: 2017-09-28 12:50:51.009 10144 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:50:51 ctl02 nova-api[10144]: 2017-09-28 12:50:51.009 10144 ERROR nova     max_url_len=max_url_len)
Sep 28 12:50:51 ctl02 nova-api[10144]: 2017-09-28 12:50:51.009 10144 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:50:51 ctl02 nova-api[10144]: 2017-09-28 12:50:51.009 10144 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:50:51 ctl02 nova-api[10144]: 2017-09-28 12:50:51.009 10144 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:50:51 ctl02 nova-api[10144]: 2017-09-28 12:50:51.009 10144 ERROR nova     sock.listen(backlog)
Sep 28 12:50:51 ctl02 nova-api[10144]: 2017-09-28 12:50:51.009 10144 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:50:51 ctl02 nova-api[10144]: 2017-09-28 12:50:51.009 10144 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:50:51 ctl02 nova-api[10144]: 2017-09-28 12:50:51.009 10144 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:50:51 ctl02 nova-api[10144]: 2017-09-28 12:50:51.009 10144 ERROR nova
Sep 28 12:50:51 ctl02 neutron-server[30536]: 2017-09-28 12:50:51.091 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:50:51] "OPTIONS / HTTP/1.0" 200 262 0.000488
Sep 28 12:50:51 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9db22258)
Sep 28 12:50:51 ctl02 heat-api-cfn[13300]: 2017-09-28 12:50:51.115 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:50:51] "OPTIONS / HTTP/1.0" 200 134 0.000470
Sep 28 12:50:51 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:50:51 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:50:51 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:50:51 ctl02 neutron-server[30536]: 2017-09-28 12:50:51.173 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:51 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:51 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:51 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:51 ctl02 neutron-server[30536]: 2017-09-28 12:50:51.173 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:51 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:51 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:51 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:51 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:51 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:51 ctl02 neutron-server[30536]: 2017-09-28 12:50:51.184 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 4 dead agents out of 6:
Sep 28 12:50:51 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:50:51 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:48:56 cmp002
Sep 28 12:50:51 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:49:38 cmp001
Sep 28 12:50:51 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:50:00 cmp002
Sep 28 12:50:51 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:50:16 cmp002
Sep 28 12:50:51 ctl02 glance-api[29183]: 2017-09-28 12:50:51.207 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:50:51] "OPTIONS / HTTP/1.0" 200 134 0.000593
Sep 28 12:50:51 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:50:51 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:50:51 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:50:51 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:50:51 ctl02 neutron-server[30536]: 2017-09-28 12:50:51.426 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:51 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:51 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:51 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:51 ctl02 neutron-server[30536]: 2017-09-28 12:50:51.427 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:51 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:51 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:51 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:51 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:51 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:51 ctl02 neutron-server[30536]: 2017-09-28 12:50:51.681 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:51 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:51 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:51 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:51 ctl02 neutron-server[30536]: 2017-09-28 12:50:51.681 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:51 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:51 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:51 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:51 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:51 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:51 ctl02 glance-api[29183]: 2017-09-28 12:50:51.779 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:50:51] "OPTIONS / HTTP/1.0" 200 134 0.000582
Sep 28 12:50:51 ctl02 neutron-server[30536]: 2017-09-28 12:50:51.936 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:50:51] "OPTIONS / HTTP/1.0" 200 262 0.000458
Sep 28 12:50:51 ctl02 neutron-server[30536]: 2017-09-28 12:50:51.935 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:51 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:51 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:51 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:51 ctl02 neutron-server[30536]: 2017-09-28 12:50:51.946 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:51 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:51 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:51 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:51 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:51 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:52 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:50:52 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:50:52 ctl02 neutron-server[30536]: 2017-09-28 12:50:52.199 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:52 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:52 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:52 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:52 ctl02 neutron-server[30536]: 2017-09-28 12:50:52.200 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:52 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:52 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:52 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:52 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:52 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:52 ctl02 neutron-server[30536]: 2017-09-28 12:50:52.453 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:52 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:52 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:52 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:52 ctl02 neutron-server[30536]: 2017-09-28 12:50:52.454 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:52 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:52 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:52 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:52 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:52 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:52 ctl02 neutron-server[30536]: 2017-09-28 12:50:52.533 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:50:52] "OPTIONS / HTTP/1.0" 200 262 0.000630
Sep 28 12:50:52 ctl02 neutron-server[30536]: 2017-09-28 12:50:52.707 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:52 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:52 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:52 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:52 ctl02 neutron-server[30536]: 2017-09-28 12:50:52.708 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:52 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:52 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:52 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:52 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:52 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:52 ctl02 neutron-server[30536]: 2017-09-28 12:50:52.961 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:52 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:52 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:52 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:52 ctl02 neutron-server[30536]: 2017-09-28 12:50:52.962 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:52 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:52 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:52 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:52 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:52 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:53 ctl02 nova-api[10162]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:50:53 ctl02 nova-api[10162]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:50:53 ctl02 neutron-server[30536]: 2017-09-28 12:50:53.215 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:53 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:53 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:53 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:53 ctl02 neutron-server[30536]: 2017-09-28 12:50:53.215 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:53 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:53 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:53 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:53 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:53 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:53 ctl02 nova-api[10162]: 2017-09-28 12:50:53.252 10162 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:50:53 ctl02 nova-api[10162]: 2017-09-28 12:50:53.253 10162 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:50:53 ctl02 nova-api[10162]: 2017-09-28 12:50:53.253 10162 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:50:53 ctl02 nova-api[10162]: 2017-09-28 12:50:53.253 10162 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:50:53 ctl02 nova-api[10162]: 2017-09-28 12:50:53.253 10162 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:50:53 ctl02 nova-api[10162]: 2017-09-28 12:50:53.253 10162 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:50:53 ctl02 nova-api[10162]: 2017-09-28 12:50:53.253 10162 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:50:53 ctl02 nova-api[10162]: 2017-09-28 12:50:53.253 10162 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:50:53 ctl02 nova-api[10162]: 2017-09-28 12:50:53.253 10162 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:50:53 ctl02 nova-api[10162]: 2017-09-28 12:50:53.253 10162 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:50:53 ctl02 nova-api[10162]: 2017-09-28 12:50:53.253 10162 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:50:53 ctl02 nova-api[10162]: 2017-09-28 12:50:53.253 10162 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:50:53 ctl02 nova-api[10162]: 2017-09-28 12:50:53.253 10162 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:50:53 ctl02 nova-api[10162]: 2017-09-28 12:50:53.253 10162 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:50:53 ctl02 nova-api[10162]: 2017-09-28 12:50:53.253 10162 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:50:53 ctl02 nova-api[10162]: 2017-09-28 12:50:53.253 10162 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:50:53 ctl02 nova-api[10162]: 2017-09-28 12:50:53.253 10162 ERROR nova.wsgi     self.filename))
Sep 28 12:50:53 ctl02 nova-api[10162]: 2017-09-28 12:50:53.253 10162 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:50:53 ctl02 nova-api[10162]: 2017-09-28 12:50:53.253 10162 ERROR nova.wsgi
Sep 28 12:50:53 ctl02 nova-api[10162]: 2017-09-28 12:50:53.254 10162 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:50:53 ctl02 nova-api[10162]: 2017-09-28 12:50:53.382 10162 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:50:53 ctl02 neutron-server[30536]: 2017-09-28 12:50:53.469 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:53 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:53 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:53 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:53 ctl02 neutron-server[30536]: 2017-09-28 12:50:53.469 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:53 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:53 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:53 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:53 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:53 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:53 ctl02 nova-api[10162]: 2017-09-28 12:50:53.605 10162 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:50:53 ctl02 nova-api[10162]: 2017-09-28 12:50:53.607 10162 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:50:53 ctl02 nova-api[10162]: 2017-09-28 12:50:53.607 10162 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:50:53 ctl02 nova-api[10162]: 2017-09-28 12:50:53.608 10162 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:50:53 ctl02 neutron-server[30536]: 2017-09-28 12:50:53.722 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:53 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:53 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:53 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:53 ctl02 neutron-server[30536]: 2017-09-28 12:50:53.723 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:53 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:53 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:53 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:53 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:53 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:53 ctl02 nova-api[10162]: 2017-09-28 12:50:53.739 10162 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:50:53 ctl02 nova-api[10162]: 2017-09-28 12:50:53.741 10162 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:50:53 ctl02 nova-api[10162]: 2017-09-28 12:50:53.741 10162 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:50:53 ctl02 nova-api[10162]: 2017-09-28 12:50:53.741 10162 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:50:53 ctl02 nova-api[10162]: 2017-09-28 12:50:53.745 10162 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:50:53 ctl02 nova-api[10162]: 2017-09-28 12:50:53.745 10162 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:50:53 ctl02 nova-api[10162]: 2017-09-28 12:50:53.745 10162 ERROR nova Traceback (most recent call last):
Sep 28 12:50:53 ctl02 nova-api[10162]: 2017-09-28 12:50:53.745 10162 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:50:53 ctl02 nova-api[10162]: 2017-09-28 12:50:53.745 10162 ERROR nova     sys.exit(main())
Sep 28 12:50:53 ctl02 nova-api[10162]: 2017-09-28 12:50:53.745 10162 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:50:53 ctl02 nova-api[10162]: 2017-09-28 12:50:53.745 10162 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:50:53 ctl02 nova-api[10162]: 2017-09-28 12:50:53.745 10162 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:50:53 ctl02 nova-api[10162]: 2017-09-28 12:50:53.745 10162 ERROR nova     max_url_len=max_url_len)
Sep 28 12:50:53 ctl02 nova-api[10162]: 2017-09-28 12:50:53.745 10162 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:50:53 ctl02 nova-api[10162]: 2017-09-28 12:50:53.745 10162 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:50:53 ctl02 nova-api[10162]: 2017-09-28 12:50:53.745 10162 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:50:53 ctl02 nova-api[10162]: 2017-09-28 12:50:53.745 10162 ERROR nova     sock.listen(backlog)
Sep 28 12:50:53 ctl02 nova-api[10162]: 2017-09-28 12:50:53.745 10162 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:50:53 ctl02 nova-api[10162]: 2017-09-28 12:50:53.745 10162 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:50:53 ctl02 nova-api[10162]: 2017-09-28 12:50:53.745 10162 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:50:53 ctl02 nova-api[10162]: 2017-09-28 12:50:53.745 10162 ERROR nova
Sep 28 12:50:53 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:50:53 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:50:53 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:50:53 ctl02 heat-api[13008]: 2017-09-28 12:50:53.912 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:50:53] "OPTIONS / HTTP/1.0" 200 134 0.000594
Sep 28 12:50:53 ctl02 neutron-server[30536]: 2017-09-28 12:50:53.976 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:53 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:53 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:53 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:53 ctl02 neutron-server[30536]: 2017-09-28 12:50:53.977 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:53 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:53 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:53 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:53 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:53 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:54 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:50:54 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:50:54 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:50:54 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:50:54 ctl02 neutron-server[30536]: 2017-09-28 12:50:54.230 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:54 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:54 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:54 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:54 ctl02 neutron-server[30536]: 2017-09-28 12:50:54.231 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:54 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:54 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:54 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:54 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:54 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:54 ctl02 neutron-server[30536]: 2017-09-28 12:50:54.489 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:54 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:54 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:54 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:54 ctl02 neutron-server[30536]: 2017-09-28 12:50:54.490 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:54 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:54 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:54 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:54 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:54 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:54 ctl02 neutron-server[30536]: 2017-09-28 12:50:54.742 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:54 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:54 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:54 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:54 ctl02 neutron-server[30536]: 2017-09-28 12:50:54.743 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:54 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:54 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:54 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:54 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:54 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:54 ctl02 neutron-server[30536]: 2017-09-28 12:50:54.996 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:54 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:54 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:54 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:54 ctl02 neutron-server[30536]: 2017-09-28 12:50:54.996 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:54 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:54 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:54 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:55 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:55 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:55 ctl02 neutron-server[30536]: 2017-09-28 12:50:55.250 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:55 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:55 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:55 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:55 ctl02 neutron-server[30536]: 2017-09-28 12:50:55.250 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:55 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:55 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:55 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:55 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:55 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:55 ctl02 neutron-server[30536]: 2017-09-28 12:50:55.503 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:55 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:55 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:55 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:55 ctl02 neutron-server[30536]: 2017-09-28 12:50:55.504 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:55 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:55 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:55 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:55 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:55 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:55 ctl02 neutron-server[30536]: 2017-09-28 12:50:55.757 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:55 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:55 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:55 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:55 ctl02 neutron-server[30536]: 2017-09-28 12:50:55.758 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:55 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:55 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:55 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:55 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:55 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:55 ctl02 nova-api[10185]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:50:55 ctl02 nova-api[10185]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:50:56 ctl02 neutron-server[30536]: 2017-09-28 12:50:56.011 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:56 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:56 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:56 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:56 ctl02 neutron-server[30536]: 2017-09-28 12:50:56.011 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:56 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:56 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:56 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:56 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:56 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:56 ctl02 nova-api[10185]: 2017-09-28 12:50:56.024 10185 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:50:56 ctl02 nova-api[10185]: 2017-09-28 12:50:56.026 10185 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:50:56 ctl02 nova-api[10185]: 2017-09-28 12:50:56.026 10185 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:50:56 ctl02 nova-api[10185]: 2017-09-28 12:50:56.026 10185 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:50:56 ctl02 nova-api[10185]: 2017-09-28 12:50:56.026 10185 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:50:56 ctl02 nova-api[10185]: 2017-09-28 12:50:56.026 10185 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:50:56 ctl02 nova-api[10185]: 2017-09-28 12:50:56.026 10185 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:50:56 ctl02 nova-api[10185]: 2017-09-28 12:50:56.026 10185 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:50:56 ctl02 nova-api[10185]: 2017-09-28 12:50:56.026 10185 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:50:56 ctl02 nova-api[10185]: 2017-09-28 12:50:56.026 10185 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:50:56 ctl02 nova-api[10185]: 2017-09-28 12:50:56.026 10185 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:50:56 ctl02 nova-api[10185]: 2017-09-28 12:50:56.026 10185 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:50:56 ctl02 nova-api[10185]: 2017-09-28 12:50:56.026 10185 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:50:56 ctl02 nova-api[10185]: 2017-09-28 12:50:56.026 10185 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:50:56 ctl02 nova-api[10185]: 2017-09-28 12:50:56.026 10185 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:50:56 ctl02 nova-api[10185]: 2017-09-28 12:50:56.026 10185 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:50:56 ctl02 nova-api[10185]: 2017-09-28 12:50:56.026 10185 ERROR nova.wsgi     self.filename))
Sep 28 12:50:56 ctl02 nova-api[10185]: 2017-09-28 12:50:56.026 10185 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:50:56 ctl02 nova-api[10185]: 2017-09-28 12:50:56.026 10185 ERROR nova.wsgi
Sep 28 12:50:56 ctl02 nova-api[10185]: 2017-09-28 12:50:56.027 10185 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:50:56 ctl02 nova-api[10185]: 2017-09-28 12:50:56.157 10185 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:50:56 ctl02 neutron-server[30536]: 2017-09-28 12:50:56.274 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:56 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:56 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:56 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:56 ctl02 neutron-server[30536]: 2017-09-28 12:50:56.276 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:56 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:56 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:56 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:56 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:56 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:56 ctl02 nova-api[10185]: 2017-09-28 12:50:56.386 10185 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:50:56 ctl02 nova-api[10185]: 2017-09-28 12:50:56.388 10185 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:50:56 ctl02 nova-api[10185]: 2017-09-28 12:50:56.388 10185 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:50:56 ctl02 nova-api[10185]: 2017-09-28 12:50:56.388 10185 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:50:56 ctl02 nova-api[10185]: 2017-09-28 12:50:56.517 10185 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:50:56 ctl02 nova-api[10185]: 2017-09-28 12:50:56.519 10185 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:50:56 ctl02 nova-api[10185]: 2017-09-28 12:50:56.519 10185 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:50:56 ctl02 nova-api[10185]: 2017-09-28 12:50:56.519 10185 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:50:56 ctl02 nova-api[10185]: 2017-09-28 12:50:56.522 10185 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:50:56 ctl02 nova-api[10185]: 2017-09-28 12:50:56.523 10185 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:50:56 ctl02 nova-api[10185]: 2017-09-28 12:50:56.523 10185 ERROR nova Traceback (most recent call last):
Sep 28 12:50:56 ctl02 nova-api[10185]: 2017-09-28 12:50:56.523 10185 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:50:56 ctl02 nova-api[10185]: 2017-09-28 12:50:56.523 10185 ERROR nova     sys.exit(main())
Sep 28 12:50:56 ctl02 nova-api[10185]: 2017-09-28 12:50:56.523 10185 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:50:56 ctl02 nova-api[10185]: 2017-09-28 12:50:56.523 10185 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:50:56 ctl02 nova-api[10185]: 2017-09-28 12:50:56.523 10185 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:50:56 ctl02 nova-api[10185]: 2017-09-28 12:50:56.523 10185 ERROR nova     max_url_len=max_url_len)
Sep 28 12:50:56 ctl02 nova-api[10185]: 2017-09-28 12:50:56.523 10185 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:50:56 ctl02 nova-api[10185]: 2017-09-28 12:50:56.523 10185 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:50:56 ctl02 nova-api[10185]: 2017-09-28 12:50:56.523 10185 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:50:56 ctl02 nova-api[10185]: 2017-09-28 12:50:56.523 10185 ERROR nova     sock.listen(backlog)
Sep 28 12:50:56 ctl02 nova-api[10185]: 2017-09-28 12:50:56.523 10185 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:50:56 ctl02 nova-api[10185]: 2017-09-28 12:50:56.523 10185 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:50:56 ctl02 nova-api[10185]: 2017-09-28 12:50:56.523 10185 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:50:56 ctl02 nova-api[10185]: 2017-09-28 12:50:56.523 10185 ERROR nova
Sep 28 12:50:56 ctl02 neutron-server[30536]: 2017-09-28 12:50:56.530 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:56 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:56 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:56 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:56 ctl02 neutron-server[30536]: 2017-09-28 12:50:56.532 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:56 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:56 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:56 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:56 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:56 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:56 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:50:56 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:50:56 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:50:56 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:50:56.767 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:50:56] "OPTIONS / HTTP/1.0" 200 134 0.000415
Sep 28 12:50:56 ctl02 neutron-server[30536]: 2017-09-28 12:50:56.787 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:56 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:56 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:56 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:56 ctl02 neutron-server[30536]: 2017-09-28 12:50:56.789 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:56 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:56 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:56 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:56 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:56 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:56 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:50:56 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:50:56 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:50:56.880 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:50:56] "OPTIONS / HTTP/1.0" 200 134 0.000309
Sep 28 12:50:56 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:50:56 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:50:57 ctl02 nova-consoleauth[5433]: 2017-09-28 12:50:57.021 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:50:57 ctl02 neutron-server[30536]: 2017-09-28 12:50:57.044 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:57 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:57 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:57 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:57 ctl02 neutron-server[30536]: 2017-09-28 12:50:57.044 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:57 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:57 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:57 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:57 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:57 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:57 ctl02 neutron-server[30536]: 2017-09-28 12:50:57.300 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:57 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:57 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:57 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:57 ctl02 neutron-server[30536]: 2017-09-28 12:50:57.300 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:57 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:57 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:57 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:57 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:57 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:57 ctl02 neutron-server[30536]: 2017-09-28 12:50:57.554 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:57 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:57 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:57 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:57 ctl02 neutron-server[30536]: 2017-09-28 12:50:57.555 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:57 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:57 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:57 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:57 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:57 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:57 ctl02 heat-api[13008]: 2017-09-28 12:50:57.597 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:50:57] "OPTIONS / HTTP/1.0" 200 134 0.000548
Sep 28 12:50:57 ctl02 neutron-server[30536]: 2017-09-28 12:50:57.809 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:57 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:57 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:57 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:57 ctl02 neutron-server[30536]: 2017-09-28 12:50:57.809 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:57 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:57 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:57 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:57 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:57 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:57 ctl02 heat-api-cfn[13300]: 2017-09-28 12:50:57.894 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:50:57] "OPTIONS / HTTP/1.0" 200 134 0.000439
Sep 28 12:50:57 ctl02 heat-api-cfn[13300]: 2017-09-28 12:50:57.900 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:50:57] "OPTIONS / HTTP/1.0" 200 134 0.000286
Sep 28 12:50:58 ctl02 neutron-server[30536]: 2017-09-28 12:50:58.062 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:58 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:58 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:58 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:58 ctl02 neutron-server[30536]: 2017-09-28 12:50:58.062 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:58 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:58 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:58 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:58 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:58 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:58 ctl02 heat-engine[12803]: 2017-09-28 12:50:58.223 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:50:58 ctl02 heat-engine[12803]: 2017-09-28 12:50:58.225 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:50:58 ctl02 heat-engine[12803]: 2017-09-28 12:50:58.229 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:50:58 ctl02 heat-engine[12803]: 2017-09-28 12:50:58.234 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:50:58 ctl02 neutron-server[30536]: 2017-09-28 12:50:58.315 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:58 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:58 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:58 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:58 ctl02 neutron-server[30536]: 2017-09-28 12:50:58.316 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:58 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:58 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:58 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:58 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:58 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:58 ctl02 neutron-server[30536]: 2017-09-28 12:50:58.521 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:50:58 ctl02 neutron-server[30536]: 2017-09-28 12:50:58.570 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:58 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:58 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:58 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:58 ctl02 neutron-server[30536]: 2017-09-28 12:50:58.570 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:58 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:58 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:58 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:58 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:58 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:58 ctl02 nova-api[10202]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:50:58 ctl02 nova-api[10202]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:50:58 ctl02 nova-api[10202]: 2017-09-28 12:50:58.748 10202 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:50:58 ctl02 nova-api[10202]: 2017-09-28 12:50:58.749 10202 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:50:58 ctl02 nova-api[10202]: 2017-09-28 12:50:58.749 10202 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:50:58 ctl02 nova-api[10202]: 2017-09-28 12:50:58.749 10202 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:50:58 ctl02 nova-api[10202]: 2017-09-28 12:50:58.749 10202 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:50:58 ctl02 nova-api[10202]: 2017-09-28 12:50:58.749 10202 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:50:58 ctl02 nova-api[10202]: 2017-09-28 12:50:58.749 10202 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:50:58 ctl02 nova-api[10202]: 2017-09-28 12:50:58.749 10202 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:50:58 ctl02 nova-api[10202]: 2017-09-28 12:50:58.749 10202 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:50:58 ctl02 nova-api[10202]: 2017-09-28 12:50:58.749 10202 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:50:58 ctl02 nova-api[10202]: 2017-09-28 12:50:58.749 10202 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:50:58 ctl02 nova-api[10202]: 2017-09-28 12:50:58.749 10202 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:50:58 ctl02 nova-api[10202]: 2017-09-28 12:50:58.749 10202 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:50:58 ctl02 nova-api[10202]: 2017-09-28 12:50:58.749 10202 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:50:58 ctl02 nova-api[10202]: 2017-09-28 12:50:58.749 10202 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:50:58 ctl02 nova-api[10202]: 2017-09-28 12:50:58.749 10202 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:50:58 ctl02 nova-api[10202]: 2017-09-28 12:50:58.749 10202 ERROR nova.wsgi     self.filename))
Sep 28 12:50:58 ctl02 nova-api[10202]: 2017-09-28 12:50:58.749 10202 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:50:58 ctl02 nova-api[10202]: 2017-09-28 12:50:58.749 10202 ERROR nova.wsgi
Sep 28 12:50:58 ctl02 nova-api[10202]: 2017-09-28 12:50:58.751 10202 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:50:58 ctl02 neutron-server[30536]: 2017-09-28 12:50:58.826 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:58 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:58 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:58 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:58 ctl02 neutron-server[30536]: 2017-09-28 12:50:58.826 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:58 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:58 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:58 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:58 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:58 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:58 ctl02 nova-api[10202]: 2017-09-28 12:50:58.877 10202 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:50:58 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:50:58.905 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:50:58] "OPTIONS / HTTP/1.0" 200 134 0.000348
Sep 28 12:50:59 ctl02 neutron-server[30536]: 2017-09-28 12:50:59.080 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:59 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:59 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:59 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:59 ctl02 neutron-server[30536]: 2017-09-28 12:50:59.080 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:59 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:59 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:59 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:59 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:59 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:59 ctl02 nova-api[10202]: 2017-09-28 12:50:59.102 10202 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:50:59 ctl02 nova-api[10202]: 2017-09-28 12:50:59.104 10202 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:50:59 ctl02 nova-api[10202]: 2017-09-28 12:50:59.104 10202 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:50:59 ctl02 nova-api[10202]: 2017-09-28 12:50:59.104 10202 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:50:59 ctl02 nova-api[10202]: 2017-09-28 12:50:59.235 10202 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:50:59 ctl02 nova-api[10202]: 2017-09-28 12:50:59.236 10202 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:50:59 ctl02 nova-api[10202]: 2017-09-28 12:50:59.237 10202 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:50:59 ctl02 nova-api[10202]: 2017-09-28 12:50:59.237 10202 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:50:59 ctl02 nova-api[10202]: 2017-09-28 12:50:59.240 10202 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:50:59 ctl02 nova-api[10202]: 2017-09-28 12:50:59.240 10202 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:50:59 ctl02 nova-api[10202]: 2017-09-28 12:50:59.240 10202 ERROR nova Traceback (most recent call last):
Sep 28 12:50:59 ctl02 nova-api[10202]: 2017-09-28 12:50:59.240 10202 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:50:59 ctl02 nova-api[10202]: 2017-09-28 12:50:59.240 10202 ERROR nova     sys.exit(main())
Sep 28 12:50:59 ctl02 nova-api[10202]: 2017-09-28 12:50:59.240 10202 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:50:59 ctl02 nova-api[10202]: 2017-09-28 12:50:59.240 10202 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:50:59 ctl02 nova-api[10202]: 2017-09-28 12:50:59.240 10202 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:50:59 ctl02 nova-api[10202]: 2017-09-28 12:50:59.240 10202 ERROR nova     max_url_len=max_url_len)
Sep 28 12:50:59 ctl02 nova-api[10202]: 2017-09-28 12:50:59.240 10202 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:50:59 ctl02 nova-api[10202]: 2017-09-28 12:50:59.240 10202 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:50:59 ctl02 nova-api[10202]: 2017-09-28 12:50:59.240 10202 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:50:59 ctl02 nova-api[10202]: 2017-09-28 12:50:59.240 10202 ERROR nova     sock.listen(backlog)
Sep 28 12:50:59 ctl02 nova-api[10202]: 2017-09-28 12:50:59.240 10202 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:50:59 ctl02 nova-api[10202]: 2017-09-28 12:50:59.240 10202 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:50:59 ctl02 nova-api[10202]: 2017-09-28 12:50:59.240 10202 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:50:59 ctl02 nova-api[10202]: 2017-09-28 12:50:59.240 10202 ERROR nova
Sep 28 12:50:59 ctl02 neutron-server[30536]: 2017-09-28 12:50:59.334 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:59 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:59 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:59 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:59 ctl02 neutron-server[30536]: 2017-09-28 12:50:59.335 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:59 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:59 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:59 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:59 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:59 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:59 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:50:59 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:50:59 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:50:59 ctl02 neutron-server[30536]: 2017-09-28 12:50:59.588 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:59 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:59 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:59 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:59 ctl02 neutron-server[30536]: 2017-09-28 12:50:59.588 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:59 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:59 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:59 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:59 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:59 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:59 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:50:59 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:50:59 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:50:59 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:50:59 ctl02 neutron-server[30536]: 2017-09-28 12:50:59.842 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:50:59 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:50:59 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:50:59 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:50:59 ctl02 neutron-server[30536]: 2017-09-28 12:50:59.842 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:50:59 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:50:59 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:50:59 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:50:59 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:50:59 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:50:59 ctl02 heat-api[13008]: 2017-09-28 12:50:59.909 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:50:59] "OPTIONS / HTTP/1.0" 200 134 0.000620
Sep 28 12:51:00 ctl02 neutron-server[30536]: 2017-09-28 12:51:00.095 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:00 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:00 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:00 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:00 ctl02 neutron-server[30536]: 2017-09-28 12:51:00.096 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:00 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:00 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:00 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:00 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:00 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:00 ctl02 nova-scheduler[5620]: 2017-09-28 12:51:00.124 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:51:00 ctl02 neutron-server[30536]: 2017-09-28 12:51:00.349 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:00 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:00 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:00 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:00 ctl02 neutron-server[30536]: 2017-09-28 12:51:00.350 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:00 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:00 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:00 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:00 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:00 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:00 ctl02 glance-api[29183]: 2017-09-28 12:51:00.461 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:51:00] "OPTIONS / HTTP/1.0" 200 134 0.000665
Sep 28 12:51:00 ctl02 neutron-server[30536]: 2017-09-28 12:51:00.603 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:00 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:00 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:00 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:00 ctl02 neutron-server[30536]: 2017-09-28 12:51:00.604 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:00 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:00 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:00 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:00 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:00 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:00 ctl02 neutron-server[30536]: 2017-09-28 12:51:00.857 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:00 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:00 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:00 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:00 ctl02 neutron-server[30536]: 2017-09-28 12:51:00.857 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:00 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:00 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:00 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:00 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:00 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:01 ctl02 neutron-server[30536]: 2017-09-28 12:51:01.096 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:51:01] "OPTIONS / HTTP/1.0" 200 262 0.000519
Sep 28 12:51:01 ctl02 neutron-server[30536]: 2017-09-28 12:51:01.111 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:01 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:01 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:01 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:01 ctl02 neutron-server[30536]: 2017-09-28 12:51:01.112 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:01 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:01 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:01 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:01 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:01 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:01 ctl02 nova-api[10220]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:51:01 ctl02 nova-api[10220]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:51:01 ctl02 neutron-server[30536]: 2017-09-28 12:51:01.365 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:01 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:01 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:01 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:01 ctl02 neutron-server[30536]: 2017-09-28 12:51:01.366 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:01 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:01 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:01 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:01 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:01 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:01 ctl02 heat-api-cfn[13300]: 2017-09-28 12:51:01.505 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:51:01] "OPTIONS / HTTP/1.0" 200 134 0.000523
Sep 28 12:51:01 ctl02 nova-api[10220]: 2017-09-28 12:51:01.532 10220 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:51:01 ctl02 nova-api[10220]: 2017-09-28 12:51:01.534 10220 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:51:01 ctl02 nova-api[10220]: 2017-09-28 12:51:01.534 10220 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:51:01 ctl02 nova-api[10220]: 2017-09-28 12:51:01.534 10220 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:51:01 ctl02 nova-api[10220]: 2017-09-28 12:51:01.534 10220 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:51:01 ctl02 nova-api[10220]: 2017-09-28 12:51:01.534 10220 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:51:01 ctl02 nova-api[10220]: 2017-09-28 12:51:01.534 10220 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:51:01 ctl02 nova-api[10220]: 2017-09-28 12:51:01.534 10220 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:51:01 ctl02 nova-api[10220]: 2017-09-28 12:51:01.534 10220 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:51:01 ctl02 nova-api[10220]: 2017-09-28 12:51:01.534 10220 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:51:01 ctl02 nova-api[10220]: 2017-09-28 12:51:01.534 10220 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:51:01 ctl02 nova-api[10220]: 2017-09-28 12:51:01.534 10220 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:51:01 ctl02 nova-api[10220]: 2017-09-28 12:51:01.534 10220 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:51:01 ctl02 nova-api[10220]: 2017-09-28 12:51:01.534 10220 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:51:01 ctl02 nova-api[10220]: 2017-09-28 12:51:01.534 10220 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:51:01 ctl02 nova-api[10220]: 2017-09-28 12:51:01.534 10220 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:51:01 ctl02 nova-api[10220]: 2017-09-28 12:51:01.534 10220 ERROR nova.wsgi     self.filename))
Sep 28 12:51:01 ctl02 nova-api[10220]: 2017-09-28 12:51:01.534 10220 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:51:01 ctl02 nova-api[10220]: 2017-09-28 12:51:01.534 10220 ERROR nova.wsgi
Sep 28 12:51:01 ctl02 nova-api[10220]: 2017-09-28 12:51:01.535 10220 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:51:01 ctl02 glance-api[29183]: 2017-09-28 12:51:01.548 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:51:01] "OPTIONS / HTTP/1.0" 200 134 0.000680
Sep 28 12:51:01 ctl02 neutron-server[30536]: 2017-09-28 12:51:01.619 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:01 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:01 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:01 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:01 ctl02 neutron-server[30536]: 2017-09-28 12:51:01.620 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:01 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:01 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:01 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:01 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:01 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:01 ctl02 nova-api[10220]: 2017-09-28 12:51:01.669 10220 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:51:01 ctl02 neutron-server[30536]: 2017-09-28 12:51:01.874 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:01 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:01 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:01 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:01 ctl02 neutron-server[30536]: 2017-09-28 12:51:01.874 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:01 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:01 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:01 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:01 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:01 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:01 ctl02 nova-api[10220]: 2017-09-28 12:51:01.918 10220 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:51:01 ctl02 nova-api[10220]: 2017-09-28 12:51:01.920 10220 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:51:01 ctl02 nova-api[10220]: 2017-09-28 12:51:01.920 10220 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:51:01 ctl02 nova-api[10220]: 2017-09-28 12:51:01.920 10220 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:51:01 ctl02 glance-api[29183]: 2017-09-28 12:51:01.971 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:51:01] "OPTIONS / HTTP/1.0" 200 134 0.000719
Sep 28 12:51:02 ctl02 nova-api[10220]: 2017-09-28 12:51:02.053 10220 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:51:02 ctl02 nova-api[10220]: 2017-09-28 12:51:02.055 10220 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:51:02 ctl02 nova-api[10220]: 2017-09-28 12:51:02.066 10220 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:51:02 ctl02 nova-api[10220]: 2017-09-28 12:51:02.066 10220 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:51:02 ctl02 nova-api[10220]: 2017-09-28 12:51:02.070 10220 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:51:02 ctl02 nova-api[10220]: 2017-09-28 12:51:02.070 10220 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:51:02 ctl02 nova-api[10220]: 2017-09-28 12:51:02.070 10220 ERROR nova Traceback (most recent call last):
Sep 28 12:51:02 ctl02 nova-api[10220]: 2017-09-28 12:51:02.070 10220 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:51:02 ctl02 nova-api[10220]: 2017-09-28 12:51:02.070 10220 ERROR nova     sys.exit(main())
Sep 28 12:51:02 ctl02 nova-api[10220]: 2017-09-28 12:51:02.070 10220 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:51:02 ctl02 nova-api[10220]: 2017-09-28 12:51:02.070 10220 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:51:02 ctl02 nova-api[10220]: 2017-09-28 12:51:02.070 10220 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:51:02 ctl02 nova-api[10220]: 2017-09-28 12:51:02.070 10220 ERROR nova     max_url_len=max_url_len)
Sep 28 12:51:02 ctl02 nova-api[10220]: 2017-09-28 12:51:02.070 10220 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:51:02 ctl02 nova-api[10220]: 2017-09-28 12:51:02.070 10220 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:51:02 ctl02 nova-api[10220]: 2017-09-28 12:51:02.070 10220 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:51:02 ctl02 nova-api[10220]: 2017-09-28 12:51:02.070 10220 ERROR nova     sock.listen(backlog)
Sep 28 12:51:02 ctl02 nova-api[10220]: 2017-09-28 12:51:02.070 10220 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:51:02 ctl02 nova-api[10220]: 2017-09-28 12:51:02.070 10220 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:51:02 ctl02 nova-api[10220]: 2017-09-28 12:51:02.070 10220 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:51:02 ctl02 nova-api[10220]: 2017-09-28 12:51:02.070 10220 ERROR nova
Sep 28 12:51:02 ctl02 neutron-server[30536]: 2017-09-28 12:51:02.128 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:02 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:02 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:02 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:02 ctl02 neutron-server[30536]: 2017-09-28 12:51:02.128 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:02 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:02 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:02 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:02 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:02 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:02 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:51:02 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:51:02 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:51:02 ctl02 neutron-server[30536]: 2017-09-28 12:51:02.257 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:51:02] "OPTIONS / HTTP/1.0" 200 262 0.000513
Sep 28 12:51:02 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:51:02 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:51:02 ctl02 neutron-server[30536]: 2017-09-28 12:51:02.381 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:02 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:02 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:02 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:51:02 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:02 ctl02 neutron-server[30536]: 2017-09-28 12:51:02.382 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:02 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:02 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:02 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:02 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:02 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:02 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:51:02 ctl02 neutron-server[30536]: 2017-09-28 12:51:02.636 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:02 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:02 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:02 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:02 ctl02 neutron-server[30536]: 2017-09-28 12:51:02.636 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:02 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:02 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:02 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:02 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:02 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:02 ctl02 neutron-server[30536]: 2017-09-28 12:51:02.870 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:51:02] "OPTIONS / HTTP/1.0" 200 262 0.000557
Sep 28 12:51:02 ctl02 neutron-server[30536]: 2017-09-28 12:51:02.889 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:02 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:02 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:02 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:02 ctl02 neutron-server[30536]: 2017-09-28 12:51:02.890 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:02 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:02 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:02 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:02 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:02 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:03 ctl02 neutron-server[30536]: 2017-09-28 12:51:03.143 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:03 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:03 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:03 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:03 ctl02 neutron-server[30536]: 2017-09-28 12:51:03.144 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:03 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:03 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:03 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:03 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:03 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:03 ctl02 neutron-server[30536]: 2017-09-28 12:51:03.397 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:03 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:03 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:03 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:03 ctl02 neutron-server[30536]: 2017-09-28 12:51:03.398 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:03 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:03 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:03 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:03 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:03 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:03 ctl02 neutron-server[30536]: 2017-09-28 12:51:03.652 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:03 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:03 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:03 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:03 ctl02 neutron-server[30536]: 2017-09-28 12:51:03.652 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:03 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:03 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:03 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:03 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:03 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:03 ctl02 neutron-server[30536]: 2017-09-28 12:51:03.906 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:03 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:03 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:03 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:03 ctl02 neutron-server[30536]: 2017-09-28 12:51:03.907 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:03 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:03 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:03 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:03 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:03 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:03 ctl02 heat-api[13008]: 2017-09-28 12:51:03.971 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:51:03] "OPTIONS / HTTP/1.0" 200 134 0.000579
Sep 28 12:51:04 ctl02 nova-api[10238]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:51:04 ctl02 nova-api[10238]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:51:04 ctl02 neutron-server[30536]: 2017-09-28 12:51:04.160 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:04 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:04 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:04 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:04 ctl02 neutron-server[30536]: 2017-09-28 12:51:04.161 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:04 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:04 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:04 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:04 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:04 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:04 ctl02 nova-api[10238]: 2017-09-28 12:51:04.268 10238 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:51:04 ctl02 nova-api[10238]: 2017-09-28 12:51:04.270 10238 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:51:04 ctl02 nova-api[10238]: 2017-09-28 12:51:04.270 10238 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:51:04 ctl02 nova-api[10238]: 2017-09-28 12:51:04.270 10238 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:51:04 ctl02 nova-api[10238]: 2017-09-28 12:51:04.270 10238 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:51:04 ctl02 nova-api[10238]: 2017-09-28 12:51:04.270 10238 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:51:04 ctl02 nova-api[10238]: 2017-09-28 12:51:04.270 10238 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:51:04 ctl02 nova-api[10238]: 2017-09-28 12:51:04.270 10238 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:51:04 ctl02 nova-api[10238]: 2017-09-28 12:51:04.270 10238 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:51:04 ctl02 nova-api[10238]: 2017-09-28 12:51:04.270 10238 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:51:04 ctl02 nova-api[10238]: 2017-09-28 12:51:04.270 10238 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:51:04 ctl02 nova-api[10238]: 2017-09-28 12:51:04.270 10238 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:51:04 ctl02 nova-api[10238]: 2017-09-28 12:51:04.270 10238 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:51:04 ctl02 nova-api[10238]: 2017-09-28 12:51:04.270 10238 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:51:04 ctl02 nova-api[10238]: 2017-09-28 12:51:04.270 10238 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:51:04 ctl02 nova-api[10238]: 2017-09-28 12:51:04.270 10238 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:51:04 ctl02 nova-api[10238]: 2017-09-28 12:51:04.270 10238 ERROR nova.wsgi     self.filename))
Sep 28 12:51:04 ctl02 nova-api[10238]: 2017-09-28 12:51:04.270 10238 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:51:04 ctl02 nova-api[10238]: 2017-09-28 12:51:04.270 10238 ERROR nova.wsgi
Sep 28 12:51:04 ctl02 nova-api[10238]: 2017-09-28 12:51:04.271 10238 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:51:04 ctl02 nova-api[10238]: 2017-09-28 12:51:04.403 10238 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:51:04 ctl02 neutron-server[30536]: 2017-09-28 12:51:04.414 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:04 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:04 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:04 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:04 ctl02 neutron-server[30536]: 2017-09-28 12:51:04.415 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:04 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:04 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:04 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:04 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:04 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:04 ctl02 nova-api[10238]: 2017-09-28 12:51:04.651 10238 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:51:04 ctl02 nova-api[10238]: 2017-09-28 12:51:04.654 10238 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:51:04 ctl02 nova-api[10238]: 2017-09-28 12:51:04.654 10238 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:51:04 ctl02 nova-api[10238]: 2017-09-28 12:51:04.654 10238 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:51:04 ctl02 neutron-server[30536]: 2017-09-28 12:51:04.669 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:04 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:04 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:04 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:04 ctl02 neutron-server[30536]: 2017-09-28 12:51:04.669 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:04 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:04 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:04 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:04 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:04 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:04 ctl02 nova-api[10238]: 2017-09-28 12:51:04.788 10238 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:51:04 ctl02 nova-api[10238]: 2017-09-28 12:51:04.790 10238 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:51:04 ctl02 nova-api[10238]: 2017-09-28 12:51:04.790 10238 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:51:04 ctl02 nova-api[10238]: 2017-09-28 12:51:04.790 10238 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:51:04 ctl02 nova-api[10238]: 2017-09-28 12:51:04.794 10238 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:51:04 ctl02 nova-api[10238]: 2017-09-28 12:51:04.794 10238 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:51:04 ctl02 nova-api[10238]: 2017-09-28 12:51:04.794 10238 ERROR nova Traceback (most recent call last):
Sep 28 12:51:04 ctl02 nova-api[10238]: 2017-09-28 12:51:04.794 10238 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:51:04 ctl02 nova-api[10238]: 2017-09-28 12:51:04.794 10238 ERROR nova     sys.exit(main())
Sep 28 12:51:04 ctl02 nova-api[10238]: 2017-09-28 12:51:04.794 10238 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:51:04 ctl02 nova-api[10238]: 2017-09-28 12:51:04.794 10238 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:51:04 ctl02 nova-api[10238]: 2017-09-28 12:51:04.794 10238 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:51:04 ctl02 nova-api[10238]: 2017-09-28 12:51:04.794 10238 ERROR nova     max_url_len=max_url_len)
Sep 28 12:51:04 ctl02 nova-api[10238]: 2017-09-28 12:51:04.794 10238 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:51:04 ctl02 nova-api[10238]: 2017-09-28 12:51:04.794 10238 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:51:04 ctl02 nova-api[10238]: 2017-09-28 12:51:04.794 10238 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:51:04 ctl02 nova-api[10238]: 2017-09-28 12:51:04.794 10238 ERROR nova     sock.listen(backlog)
Sep 28 12:51:04 ctl02 nova-api[10238]: 2017-09-28 12:51:04.794 10238 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:51:04 ctl02 nova-api[10238]: 2017-09-28 12:51:04.794 10238 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:51:04 ctl02 nova-api[10238]: 2017-09-28 12:51:04.794 10238 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:51:04 ctl02 nova-api[10238]: 2017-09-28 12:51:04.794 10238 ERROR nova
Sep 28 12:51:04 ctl02 neutron-server[30536]: 2017-09-28 12:51:04.923 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:04 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:04 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:04 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:04 ctl02 neutron-server[30536]: 2017-09-28 12:51:04.924 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:04 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:04 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:04 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:04 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:04 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:04 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:51:04 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:51:04 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:51:05 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:51:05 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:51:05 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:51:05 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:51:05 ctl02 neutron-server[30536]: 2017-09-28 12:51:05.178 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:05 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:05 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:05 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:05 ctl02 neutron-server[30536]: 2017-09-28 12:51:05.179 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:05 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:05 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:05 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:05 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:05 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:05 ctl02 neutron-server[30536]: 2017-09-28 12:51:05.434 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:05 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:05 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:05 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:05 ctl02 neutron-server[30536]: 2017-09-28 12:51:05.435 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:05 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:05 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:05 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:05 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:05 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:05 ctl02 neutron-server[30536]: 2017-09-28 12:51:05.690 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:05 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:05 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:05 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:05 ctl02 neutron-server[30536]: 2017-09-28 12:51:05.691 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:05 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:05 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:05 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:05 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:05 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:05 ctl02 neutron-server[30536]: 2017-09-28 12:51:05.945 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:05 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:05 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:05 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:05 ctl02 neutron-server[30536]: 2017-09-28 12:51:05.946 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:05 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:05 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:05 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:05 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:05 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:06 ctl02 neutron-server[30536]: 2017-09-28 12:51:06.180 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 12:51:06 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:51:06 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:49:38 cmp001
Sep 28 12:51:06 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:50:00 cmp002
Sep 28 12:51:06 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:50:16 cmp002
Sep 28 12:51:06 ctl02 neutron-server[30536]: 2017-09-28 12:51:06.201 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:06 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:06 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:06 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:06 ctl02 neutron-server[30536]: 2017-09-28 12:51:06.201 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:06 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:06 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:06 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:06 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:06 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:06 ctl02 neutron-server[30536]: 2017-09-28 12:51:06.454 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:06 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:06 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:06 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:06 ctl02 neutron-server[30536]: 2017-09-28 12:51:06.456 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:06 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:06 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:06 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:06 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:06 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:06 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:51:06.695 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:51:06] "OPTIONS / HTTP/1.0" 200 134 0.000497
Sep 28 12:51:06 ctl02 neutron-server[30536]: 2017-09-28 12:51:06.711 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:06 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:06 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:06 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:06 ctl02 neutron-server[30536]: 2017-09-28 12:51:06.712 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:06 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:06 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:06 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:06 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:06 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:06 ctl02 nova-api[10257]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:51:06 ctl02 nova-api[10257]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:51:06 ctl02 neutron-server[30536]: 2017-09-28 12:51:06.967 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:06 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:06 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:06 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:06 ctl02 neutron-server[30536]: 2017-09-28 12:51:06.969 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:06 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:06 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:06 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:06 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:06 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:06 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:51:06.998 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:51:06] "OPTIONS / HTTP/1.0" 200 134 0.000416
Sep 28 12:51:07 ctl02 nova-api[10257]: 2017-09-28 12:51:07.026 10257 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:51:07 ctl02 nova-api[10257]: 2017-09-28 12:51:07.028 10257 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:51:07 ctl02 nova-api[10257]: 2017-09-28 12:51:07.028 10257 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:51:07 ctl02 nova-api[10257]: 2017-09-28 12:51:07.028 10257 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:51:07 ctl02 nova-api[10257]: 2017-09-28 12:51:07.028 10257 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:51:07 ctl02 nova-api[10257]: 2017-09-28 12:51:07.028 10257 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:51:07 ctl02 nova-api[10257]: 2017-09-28 12:51:07.028 10257 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:51:07 ctl02 nova-api[10257]: 2017-09-28 12:51:07.028 10257 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:51:07 ctl02 nova-api[10257]: 2017-09-28 12:51:07.028 10257 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:51:07 ctl02 nova-api[10257]: 2017-09-28 12:51:07.028 10257 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:51:07 ctl02 nova-api[10257]: 2017-09-28 12:51:07.028 10257 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:51:07 ctl02 nova-api[10257]: 2017-09-28 12:51:07.028 10257 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:51:07 ctl02 nova-api[10257]: 2017-09-28 12:51:07.028 10257 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:51:07 ctl02 nova-api[10257]: 2017-09-28 12:51:07.028 10257 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:51:07 ctl02 nova-api[10257]: 2017-09-28 12:51:07.028 10257 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:51:07 ctl02 nova-api[10257]: 2017-09-28 12:51:07.028 10257 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:51:07 ctl02 nova-api[10257]: 2017-09-28 12:51:07.028 10257 ERROR nova.wsgi     self.filename))
Sep 28 12:51:07 ctl02 nova-api[10257]: 2017-09-28 12:51:07.028 10257 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:51:07 ctl02 nova-api[10257]: 2017-09-28 12:51:07.028 10257 ERROR nova.wsgi
Sep 28 12:51:07 ctl02 nova-api[10257]: 2017-09-28 12:51:07.029 10257 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:51:07 ctl02 nova-api[10257]: 2017-09-28 12:51:07.160 10257 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:51:07 ctl02 neutron-server[30536]: 2017-09-28 12:51:07.224 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:07 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:07 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:07 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:07 ctl02 neutron-server[30536]: 2017-09-28 12:51:07.225 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:07 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:07 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:07 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:07 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:07 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:07 ctl02 nova-api[10257]: 2017-09-28 12:51:07.404 10257 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:51:07 ctl02 nova-api[10257]: 2017-09-28 12:51:07.406 10257 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:51:07 ctl02 nova-api[10257]: 2017-09-28 12:51:07.406 10257 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:51:07 ctl02 nova-api[10257]: 2017-09-28 12:51:07.407 10257 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:51:07 ctl02 neutron-server[30536]: 2017-09-28 12:51:07.481 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:07 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:07 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:07 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:07 ctl02 neutron-server[30536]: 2017-09-28 12:51:07.483 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:07 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:07 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:07 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:07 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:07 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:07 ctl02 nova-api[10257]: 2017-09-28 12:51:07.539 10257 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:51:07 ctl02 nova-api[10257]: 2017-09-28 12:51:07.541 10257 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:51:07 ctl02 nova-api[10257]: 2017-09-28 12:51:07.542 10257 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:51:07 ctl02 nova-api[10257]: 2017-09-28 12:51:07.542 10257 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:51:07 ctl02 nova-api[10257]: 2017-09-28 12:51:07.545 10257 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:51:07 ctl02 nova-api[10257]: 2017-09-28 12:51:07.546 10257 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:51:07 ctl02 nova-api[10257]: 2017-09-28 12:51:07.546 10257 ERROR nova Traceback (most recent call last):
Sep 28 12:51:07 ctl02 nova-api[10257]: 2017-09-28 12:51:07.546 10257 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:51:07 ctl02 nova-api[10257]: 2017-09-28 12:51:07.546 10257 ERROR nova     sys.exit(main())
Sep 28 12:51:07 ctl02 nova-api[10257]: 2017-09-28 12:51:07.546 10257 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:51:07 ctl02 nova-api[10257]: 2017-09-28 12:51:07.546 10257 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:51:07 ctl02 nova-api[10257]: 2017-09-28 12:51:07.546 10257 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:51:07 ctl02 nova-api[10257]: 2017-09-28 12:51:07.546 10257 ERROR nova     max_url_len=max_url_len)
Sep 28 12:51:07 ctl02 nova-api[10257]: 2017-09-28 12:51:07.546 10257 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:51:07 ctl02 nova-api[10257]: 2017-09-28 12:51:07.546 10257 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:51:07 ctl02 nova-api[10257]: 2017-09-28 12:51:07.546 10257 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:51:07 ctl02 nova-api[10257]: 2017-09-28 12:51:07.546 10257 ERROR nova     sock.listen(backlog)
Sep 28 12:51:07 ctl02 nova-api[10257]: 2017-09-28 12:51:07.546 10257 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:51:07 ctl02 nova-api[10257]: 2017-09-28 12:51:07.546 10257 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:51:07 ctl02 nova-api[10257]: 2017-09-28 12:51:07.546 10257 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:51:07 ctl02 nova-api[10257]: 2017-09-28 12:51:07.546 10257 ERROR nova
Sep 28 12:51:07 ctl02 heat-api-cfn[13300]: 2017-09-28 12:51:07.584 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:51:07] "OPTIONS / HTTP/1.0" 200 134 0.000502
Sep 28 12:51:07 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:51:07 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:51:07 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:51:07 ctl02 neutron-server[30536]: 2017-09-28 12:51:07.738 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:07 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:07 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:07 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:07 ctl02 neutron-server[30536]: 2017-09-28 12:51:07.740 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:07 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:07 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:07 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:07 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:07 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:07 ctl02 heat-api[13008]: 2017-09-28 12:51:07.828 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:51:07] "OPTIONS / HTTP/1.0" 200 134 0.000580
Sep 28 12:51:07 ctl02 heat-api-cfn[13300]: 2017-09-28 12:51:07.869 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:51:07] "OPTIONS / HTTP/1.0" 200 134 0.000507
Sep 28 12:51:07 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:51:07 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:51:07 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:51:07 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:51:07 ctl02 neutron-server[30536]: 2017-09-28 12:51:07.994 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:07 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:07 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:07 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:07 ctl02 neutron-server[30536]: 2017-09-28 12:51:07.994 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:07 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:07 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:07 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:07 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:07 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:08 ctl02 neutron-server[30536]: 2017-09-28 12:51:08.248 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:08 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:08 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:08 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:08 ctl02 neutron-server[30536]: 2017-09-28 12:51:08.249 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:08 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:08 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:08 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:08 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:08 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:08 ctl02 neutron-server[30536]: 2017-09-28 12:51:08.503 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:08 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:08 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:08 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:08 ctl02 neutron-server[30536]: 2017-09-28 12:51:08.503 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:08 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:08 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:08 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:08 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:08 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:08 ctl02 neutron-server[30536]: 2017-09-28 12:51:08.757 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:08 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:08 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7e145b79)
Sep 28 12:51:08 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:08 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:08 ctl02 neutron-server[30536]: 2017-09-28 12:51:08.757 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:08 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:08 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:08 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:08 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:08 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:09 ctl02 neutron-server[30536]: 2017-09-28 12:51:09.010 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:09 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:09 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:09 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:09 ctl02 neutron-server[30536]: 2017-09-28 12:51:09.011 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:09 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:09 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:09 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:09 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:09 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:09 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:51:09.086 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:51:09] "OPTIONS / HTTP/1.0" 200 134 0.000613
Sep 28 12:51:09 ctl02 neutron-server[30536]: 2017-09-28 12:51:09.265 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:09 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:09 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:09 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:09 ctl02 neutron-server[30536]: 2017-09-28 12:51:09.265 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:09 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:09 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:09 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:09 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:09 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:09 ctl02 neutron-server[30536]: 2017-09-28 12:51:09.518 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:09 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:09 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:09 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:09 ctl02 neutron-server[30536]: 2017-09-28 12:51:09.519 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:09 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:09 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:09 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:09 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:09 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:09 ctl02 nova-api[10275]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:51:09 ctl02 nova-api[10275]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:51:09 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7e145b79)
Sep 28 12:51:09 ctl02 neutron-server[30536]: 2017-09-28 12:51:09.772 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:09 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:09 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:09 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:09 ctl02 neutron-server[30536]: 2017-09-28 12:51:09.772 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:09 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:09 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:09 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:09 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:09 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:09 ctl02 nova-api[10275]: 2017-09-28 12:51:09.804 10275 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:51:09 ctl02 nova-api[10275]: 2017-09-28 12:51:09.806 10275 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:51:09 ctl02 nova-api[10275]: 2017-09-28 12:51:09.806 10275 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:51:09 ctl02 nova-api[10275]: 2017-09-28 12:51:09.806 10275 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:51:09 ctl02 nova-api[10275]: 2017-09-28 12:51:09.806 10275 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:51:09 ctl02 nova-api[10275]: 2017-09-28 12:51:09.806 10275 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:51:09 ctl02 nova-api[10275]: 2017-09-28 12:51:09.806 10275 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:51:09 ctl02 nova-api[10275]: 2017-09-28 12:51:09.806 10275 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:51:09 ctl02 nova-api[10275]: 2017-09-28 12:51:09.806 10275 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:51:09 ctl02 nova-api[10275]: 2017-09-28 12:51:09.806 10275 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:51:09 ctl02 nova-api[10275]: 2017-09-28 12:51:09.806 10275 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:51:09 ctl02 nova-api[10275]: 2017-09-28 12:51:09.806 10275 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:51:09 ctl02 nova-api[10275]: 2017-09-28 12:51:09.806 10275 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:51:09 ctl02 nova-api[10275]: 2017-09-28 12:51:09.806 10275 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:51:09 ctl02 nova-api[10275]: 2017-09-28 12:51:09.806 10275 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:51:09 ctl02 nova-api[10275]: 2017-09-28 12:51:09.806 10275 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:51:09 ctl02 nova-api[10275]: 2017-09-28 12:51:09.806 10275 ERROR nova.wsgi     self.filename))
Sep 28 12:51:09 ctl02 nova-api[10275]: 2017-09-28 12:51:09.806 10275 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:51:09 ctl02 nova-api[10275]: 2017-09-28 12:51:09.806 10275 ERROR nova.wsgi
Sep 28 12:51:09 ctl02 nova-api[10275]: 2017-09-28 12:51:09.807 10275 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:51:09 ctl02 nova-api[10275]: 2017-09-28 12:51:09.937 10275 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:51:10 ctl02 neutron-server[30536]: 2017-09-28 12:51:10.026 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:10 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:10 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:10 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:10 ctl02 neutron-server[30536]: 2017-09-28 12:51:10.027 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:10 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:10 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:10 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:10 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:10 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:10 ctl02 heat-api[13008]: 2017-09-28 12:51:10.121 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:51:10] "OPTIONS / HTTP/1.0" 200 134 0.000621
Sep 28 12:51:10 ctl02 nova-api[10275]: 2017-09-28 12:51:10.185 10275 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:51:10 ctl02 nova-api[10275]: 2017-09-28 12:51:10.187 10275 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:51:10 ctl02 nova-api[10275]: 2017-09-28 12:51:10.188 10275 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:51:10 ctl02 nova-api[10275]: 2017-09-28 12:51:10.188 10275 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:51:10 ctl02 glance-api[29183]: 2017-09-28 12:51:10.227 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:51:10] "OPTIONS / HTTP/1.0" 200 134 0.000628
Sep 28 12:51:10 ctl02 neutron-server[30536]: 2017-09-28 12:51:10.280 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:10 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:10 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:10 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:10 ctl02 neutron-server[30536]: 2017-09-28 12:51:10.281 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:10 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:10 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:10 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:10 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:10 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:10 ctl02 nova-api[10275]: 2017-09-28 12:51:10.324 10275 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:51:10 ctl02 nova-api[10275]: 2017-09-28 12:51:10.326 10275 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:51:10 ctl02 nova-api[10275]: 2017-09-28 12:51:10.326 10275 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:51:10 ctl02 nova-api[10275]: 2017-09-28 12:51:10.326 10275 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:51:10 ctl02 nova-api[10275]: 2017-09-28 12:51:10.329 10275 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:51:10 ctl02 nova-api[10275]: 2017-09-28 12:51:10.330 10275 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:51:10 ctl02 nova-api[10275]: 2017-09-28 12:51:10.330 10275 ERROR nova Traceback (most recent call last):
Sep 28 12:51:10 ctl02 nova-api[10275]: 2017-09-28 12:51:10.330 10275 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:51:10 ctl02 nova-api[10275]: 2017-09-28 12:51:10.330 10275 ERROR nova     sys.exit(main())
Sep 28 12:51:10 ctl02 nova-api[10275]: 2017-09-28 12:51:10.330 10275 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:51:10 ctl02 nova-api[10275]: 2017-09-28 12:51:10.330 10275 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:51:10 ctl02 nova-api[10275]: 2017-09-28 12:51:10.330 10275 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:51:10 ctl02 nova-api[10275]: 2017-09-28 12:51:10.330 10275 ERROR nova     max_url_len=max_url_len)
Sep 28 12:51:10 ctl02 nova-api[10275]: 2017-09-28 12:51:10.330 10275 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:51:10 ctl02 nova-api[10275]: 2017-09-28 12:51:10.330 10275 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:51:10 ctl02 nova-api[10275]: 2017-09-28 12:51:10.330 10275 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:51:10 ctl02 nova-api[10275]: 2017-09-28 12:51:10.330 10275 ERROR nova     sock.listen(backlog)
Sep 28 12:51:10 ctl02 nova-api[10275]: 2017-09-28 12:51:10.330 10275 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:51:10 ctl02 nova-api[10275]: 2017-09-28 12:51:10.330 10275 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:51:10 ctl02 nova-api[10275]: 2017-09-28 12:51:10.330 10275 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:51:10 ctl02 nova-api[10275]: 2017-09-28 12:51:10.330 10275 ERROR nova
Sep 28 12:51:10 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:51:10 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:51:10 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:51:10 ctl02 neutron-server[30536]: 2017-09-28 12:51:10.534 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:10 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:10 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:10 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:10 ctl02 neutron-server[30536]: 2017-09-28 12:51:10.535 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:10 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:10 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:10 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:10 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:10 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:10 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:51:10 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:51:10 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:51:10 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:51:10 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7e145b79)
Sep 28 12:51:10 ctl02 neutron-server[30536]: 2017-09-28 12:51:10.789 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:10 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:10 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:10 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:10 ctl02 neutron-server[30536]: 2017-09-28 12:51:10.789 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:10 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:10 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:10 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:10 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:10 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:11 ctl02 neutron-server[30536]: 2017-09-28 12:51:11.045 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:11 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:11 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:11 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:11 ctl02 neutron-server[30536]: 2017-09-28 12:51:11.045 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:11 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:11 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:11 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:11 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:11 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:11 ctl02 neutron-server[30536]: 2017-09-28 12:51:11.154 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:51:11] "OPTIONS / HTTP/1.0" 200 262 0.000453
Sep 28 12:51:11 ctl02 neutron-server[30536]: 2017-09-28 12:51:11.301 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:11 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:11 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:11 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:11 ctl02 neutron-server[30536]: 2017-09-28 12:51:11.302 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:11 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:11 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:11 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:11 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:11 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:11 ctl02 neutron-server[30536]: 2017-09-28 12:51:11.557 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:11 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:11 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:11 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:11 ctl02 neutron-server[30536]: 2017-09-28 12:51:11.559 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:11 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:11 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:11 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:11 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:11 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:11 ctl02 glance-api[29183]: 2017-09-28 12:51:11.623 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:51:11] "OPTIONS / HTTP/1.0" 200 134 0.000531
Sep 28 12:51:11 ctl02 heat-api-cfn[13300]: 2017-09-28 12:51:11.729 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:51:11] "OPTIONS / HTTP/1.0" 200 134 0.000424
Sep 28 12:51:11 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7e145b79)
Sep 28 12:51:11 ctl02 neutron-server[30536]: 2017-09-28 12:51:11.814 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:11 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:11 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:11 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:11 ctl02 neutron-server[30536]: 2017-09-28 12:51:11.816 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:11 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:11 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:11 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:11 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:11 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:12 ctl02 neutron-server[30536]: 2017-09-28 12:51:12.062 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:51:12] "OPTIONS / HTTP/1.0" 200 262 0.000462
Sep 28 12:51:12 ctl02 neutron-server[30536]: 2017-09-28 12:51:12.071 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:12 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:12 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:12 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:12 ctl02 neutron-server[30536]: 2017-09-28 12:51:12.071 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:12 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:12 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:12 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:12 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:12 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:12 ctl02 glance-api[29183]: 2017-09-28 12:51:12.252 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:51:12] "OPTIONS / HTTP/1.0" 200 134 0.000531
Sep 28 12:51:12 ctl02 neutron-server[30536]: 2017-09-28 12:51:12.324 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:12 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:12 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:12 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:12 ctl02 neutron-server[30536]: 2017-09-28 12:51:12.325 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:12 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:12 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:12 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:12 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:12 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:12 ctl02 nova-api[10293]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:51:12 ctl02 nova-api[10293]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:51:12 ctl02 nova-api[10293]: 2017-09-28 12:51:12.512 10293 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:51:12 ctl02 nova-api[10293]: 2017-09-28 12:51:12.513 10293 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:51:12 ctl02 nova-api[10293]: 2017-09-28 12:51:12.513 10293 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:51:12 ctl02 nova-api[10293]: 2017-09-28 12:51:12.513 10293 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:51:12 ctl02 nova-api[10293]: 2017-09-28 12:51:12.513 10293 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:51:12 ctl02 nova-api[10293]: 2017-09-28 12:51:12.513 10293 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:51:12 ctl02 nova-api[10293]: 2017-09-28 12:51:12.513 10293 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:51:12 ctl02 nova-api[10293]: 2017-09-28 12:51:12.513 10293 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:51:12 ctl02 nova-api[10293]: 2017-09-28 12:51:12.513 10293 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:51:12 ctl02 nova-api[10293]: 2017-09-28 12:51:12.513 10293 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:51:12 ctl02 nova-api[10293]: 2017-09-28 12:51:12.513 10293 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:51:12 ctl02 nova-api[10293]: 2017-09-28 12:51:12.513 10293 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:51:12 ctl02 nova-api[10293]: 2017-09-28 12:51:12.513 10293 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:51:12 ctl02 nova-api[10293]: 2017-09-28 12:51:12.513 10293 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:51:12 ctl02 nova-api[10293]: 2017-09-28 12:51:12.513 10293 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:51:12 ctl02 nova-api[10293]: 2017-09-28 12:51:12.513 10293 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:51:12 ctl02 nova-api[10293]: 2017-09-28 12:51:12.513 10293 ERROR nova.wsgi     self.filename))
Sep 28 12:51:12 ctl02 nova-api[10293]: 2017-09-28 12:51:12.513 10293 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:51:12 ctl02 nova-api[10293]: 2017-09-28 12:51:12.513 10293 ERROR nova.wsgi
Sep 28 12:51:12 ctl02 nova-api[10293]: 2017-09-28 12:51:12.514 10293 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:51:12 ctl02 neutron-server[30536]: 2017-09-28 12:51:12.578 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:12 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:12 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:12 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:12 ctl02 neutron-server[30536]: 2017-09-28 12:51:12.579 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:12 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:12 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:12 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:12 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:12 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:12 ctl02 nova-api[10293]: 2017-09-28 12:51:12.644 10293 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:51:12 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7e145b79)
Sep 28 12:51:12 ctl02 neutron-server[30536]: 2017-09-28 12:51:12.832 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:12 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:12 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:12 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:12 ctl02 neutron-server[30536]: 2017-09-28 12:51:12.832 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:12 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:12 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:12 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:12 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:12 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:12 ctl02 nova-api[10293]: 2017-09-28 12:51:12.866 10293 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:51:12 ctl02 nova-api[10293]: 2017-09-28 12:51:12.868 10293 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:51:12 ctl02 nova-api[10293]: 2017-09-28 12:51:12.869 10293 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:51:12 ctl02 nova-api[10293]: 2017-09-28 12:51:12.869 10293 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:51:12 ctl02 nova-api[10293]: 2017-09-28 12:51:12.998 10293 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:51:13 ctl02 nova-api[10293]: 2017-09-28 12:51:13.000 10293 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:51:13 ctl02 nova-api[10293]: 2017-09-28 12:51:13.000 10293 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:51:13 ctl02 nova-api[10293]: 2017-09-28 12:51:13.000 10293 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:51:13 ctl02 nova-api[10293]: 2017-09-28 12:51:13.004 10293 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:51:13 ctl02 nova-api[10293]: 2017-09-28 12:51:13.004 10293 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:51:13 ctl02 nova-api[10293]: 2017-09-28 12:51:13.004 10293 ERROR nova Traceback (most recent call last):
Sep 28 12:51:13 ctl02 nova-api[10293]: 2017-09-28 12:51:13.004 10293 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:51:13 ctl02 nova-api[10293]: 2017-09-28 12:51:13.004 10293 ERROR nova     sys.exit(main())
Sep 28 12:51:13 ctl02 nova-api[10293]: 2017-09-28 12:51:13.004 10293 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:51:13 ctl02 nova-api[10293]: 2017-09-28 12:51:13.004 10293 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:51:13 ctl02 nova-api[10293]: 2017-09-28 12:51:13.004 10293 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:51:13 ctl02 nova-api[10293]: 2017-09-28 12:51:13.004 10293 ERROR nova     max_url_len=max_url_len)
Sep 28 12:51:13 ctl02 nova-api[10293]: 2017-09-28 12:51:13.004 10293 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:51:13 ctl02 nova-api[10293]: 2017-09-28 12:51:13.004 10293 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:51:13 ctl02 nova-api[10293]: 2017-09-28 12:51:13.004 10293 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:51:13 ctl02 nova-api[10293]: 2017-09-28 12:51:13.004 10293 ERROR nova     sock.listen(backlog)
Sep 28 12:51:13 ctl02 nova-api[10293]: 2017-09-28 12:51:13.004 10293 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:51:13 ctl02 nova-api[10293]: 2017-09-28 12:51:13.004 10293 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:51:13 ctl02 nova-api[10293]: 2017-09-28 12:51:13.004 10293 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:51:13 ctl02 nova-api[10293]: 2017-09-28 12:51:13.004 10293 ERROR nova
Sep 28 12:51:13 ctl02 neutron-server[30536]: 2017-09-28 12:51:13.082 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:51:13] "OPTIONS / HTTP/1.0" 200 262 0.000453
Sep 28 12:51:13 ctl02 neutron-server[30536]: 2017-09-28 12:51:13.085 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:13 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:13 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:13 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:13 ctl02 neutron-server[30536]: 2017-09-28 12:51:13.086 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:13 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:13 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:13 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:13 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:13 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:13 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:51:13 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:51:13 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:51:13 ctl02 neutron-server[30536]: 2017-09-28 12:51:13.342 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:13 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:13 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:13 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:13 ctl02 neutron-server[30536]: 2017-09-28 12:51:13.344 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:13 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:13 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:13 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:13 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:13 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:13 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:51:13 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:51:13 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:51:13 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:51:13 ctl02 neutron-server[30536]: 2017-09-28 12:51:13.521 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:51:13 ctl02 neutron-server[30536]: 2017-09-28 12:51:13.599 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:13 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:13 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:13 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:13 ctl02 neutron-server[30536]: 2017-09-28 12:51:13.601 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:13 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:13 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:13 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:13 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:13 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:13 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7e145b79)
Sep 28 12:51:13 ctl02 neutron-server[30536]: 2017-09-28 12:51:13.856 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:13 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:13 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:13 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:13 ctl02 neutron-server[30536]: 2017-09-28 12:51:13.856 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:13 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:13 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:13 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:13 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:13 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:14 ctl02 neutron-server[30536]: 2017-09-28 12:51:14.109 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:14 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:14 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:14 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:14 ctl02 neutron-server[30536]: 2017-09-28 12:51:14.110 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:14 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:14 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:14 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:14 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:14 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:14 ctl02 heat-api[13008]: 2017-09-28 12:51:14.265 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:51:14] "OPTIONS / HTTP/1.0" 200 134 0.000525
Sep 28 12:51:14 ctl02 neutron-server[30536]: 2017-09-28 12:51:14.364 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:14 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:14 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:14 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:14 ctl02 neutron-server[30536]: 2017-09-28 12:51:14.364 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:14 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:14 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:14 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:14 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:14 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:14 ctl02 neutron-server[30536]: 2017-09-28 12:51:14.617 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:14 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:14 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:14 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:14 ctl02 neutron-server[30536]: 2017-09-28 12:51:14.618 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:14 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:14 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:14 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:14 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:14 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:14 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7e145b79)
Sep 28 12:51:14 ctl02 neutron-server[30536]: 2017-09-28 12:51:14.871 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:14 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:14 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:14 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:14 ctl02 neutron-server[30536]: 2017-09-28 12:51:14.871 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:14 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:14 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:14 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:14 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:14 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:15 ctl02 nova-api[10311]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:51:15 ctl02 nova-api[10311]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:51:15 ctl02 neutron-server[30536]: 2017-09-28 12:51:15.124 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:15 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:15 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:15 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:15 ctl02 neutron-server[30536]: 2017-09-28 12:51:15.125 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:15 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:15 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:15 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:15 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:15 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:15 ctl02 nova-api[10311]: 2017-09-28 12:51:15.237 10311 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:51:15 ctl02 nova-api[10311]: 2017-09-28 12:51:15.238 10311 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:51:15 ctl02 nova-api[10311]: 2017-09-28 12:51:15.238 10311 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:51:15 ctl02 nova-api[10311]: 2017-09-28 12:51:15.238 10311 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:51:15 ctl02 nova-api[10311]: 2017-09-28 12:51:15.238 10311 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:51:15 ctl02 nova-api[10311]: 2017-09-28 12:51:15.238 10311 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:51:15 ctl02 nova-api[10311]: 2017-09-28 12:51:15.238 10311 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:51:15 ctl02 nova-api[10311]: 2017-09-28 12:51:15.238 10311 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:51:15 ctl02 nova-api[10311]: 2017-09-28 12:51:15.238 10311 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:51:15 ctl02 nova-api[10311]: 2017-09-28 12:51:15.238 10311 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:51:15 ctl02 nova-api[10311]: 2017-09-28 12:51:15.238 10311 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:51:15 ctl02 nova-api[10311]: 2017-09-28 12:51:15.238 10311 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:51:15 ctl02 nova-api[10311]: 2017-09-28 12:51:15.238 10311 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:51:15 ctl02 nova-api[10311]: 2017-09-28 12:51:15.238 10311 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:51:15 ctl02 nova-api[10311]: 2017-09-28 12:51:15.238 10311 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:51:15 ctl02 nova-api[10311]: 2017-09-28 12:51:15.238 10311 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:51:15 ctl02 nova-api[10311]: 2017-09-28 12:51:15.238 10311 ERROR nova.wsgi     self.filename))
Sep 28 12:51:15 ctl02 nova-api[10311]: 2017-09-28 12:51:15.238 10311 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:51:15 ctl02 nova-api[10311]: 2017-09-28 12:51:15.238 10311 ERROR nova.wsgi
Sep 28 12:51:15 ctl02 nova-api[10311]: 2017-09-28 12:51:15.239 10311 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:51:15 ctl02 nova-api[10311]: 2017-09-28 12:51:15.369 10311 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:51:15 ctl02 neutron-server[30536]: 2017-09-28 12:51:15.378 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:15 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:15 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:15 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:15 ctl02 neutron-server[30536]: 2017-09-28 12:51:15.379 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:15 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:15 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:15 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:15 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:15 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:15 ctl02 nova-api[10311]: 2017-09-28 12:51:15.592 10311 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:51:15 ctl02 nova-api[10311]: 2017-09-28 12:51:15.594 10311 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:51:15 ctl02 nova-api[10311]: 2017-09-28 12:51:15.594 10311 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:51:15 ctl02 nova-api[10311]: 2017-09-28 12:51:15.594 10311 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:51:15 ctl02 neutron-server[30536]: 2017-09-28 12:51:15.632 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:15 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:15 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:15 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:15 ctl02 neutron-server[30536]: 2017-09-28 12:51:15.632 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:15 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:15 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:15 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:15 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:15 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:15 ctl02 nova-api[10311]: 2017-09-28 12:51:15.727 10311 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:51:15 ctl02 nova-api[10311]: 2017-09-28 12:51:15.728 10311 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:51:15 ctl02 nova-api[10311]: 2017-09-28 12:51:15.729 10311 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:51:15 ctl02 nova-api[10311]: 2017-09-28 12:51:15.729 10311 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:51:15 ctl02 nova-api[10311]: 2017-09-28 12:51:15.732 10311 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:51:15 ctl02 nova-api[10311]: 2017-09-28 12:51:15.732 10311 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:51:15 ctl02 nova-api[10311]: 2017-09-28 12:51:15.732 10311 ERROR nova Traceback (most recent call last):
Sep 28 12:51:15 ctl02 nova-api[10311]: 2017-09-28 12:51:15.732 10311 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:51:15 ctl02 nova-api[10311]: 2017-09-28 12:51:15.732 10311 ERROR nova     sys.exit(main())
Sep 28 12:51:15 ctl02 nova-api[10311]: 2017-09-28 12:51:15.732 10311 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:51:15 ctl02 nova-api[10311]: 2017-09-28 12:51:15.732 10311 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:51:15 ctl02 nova-api[10311]: 2017-09-28 12:51:15.732 10311 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:51:15 ctl02 nova-api[10311]: 2017-09-28 12:51:15.732 10311 ERROR nova     max_url_len=max_url_len)
Sep 28 12:51:15 ctl02 nova-api[10311]: 2017-09-28 12:51:15.732 10311 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:51:15 ctl02 nova-api[10311]: 2017-09-28 12:51:15.732 10311 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:51:15 ctl02 nova-api[10311]: 2017-09-28 12:51:15.732 10311 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:51:15 ctl02 nova-api[10311]: 2017-09-28 12:51:15.732 10311 ERROR nova     sock.listen(backlog)
Sep 28 12:51:15 ctl02 nova-api[10311]: 2017-09-28 12:51:15.732 10311 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:51:15 ctl02 nova-api[10311]: 2017-09-28 12:51:15.732 10311 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:51:15 ctl02 nova-api[10311]: 2017-09-28 12:51:15.732 10311 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:51:15 ctl02 nova-api[10311]: 2017-09-28 12:51:15.732 10311 ERROR nova
Sep 28 12:51:15 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7e145b79)
Sep 28 12:51:15 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:51:15 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:51:15 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:51:15 ctl02 neutron-server[30536]: 2017-09-28 12:51:15.886 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:15 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:15 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:15 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:15 ctl02 neutron-server[30536]: 2017-09-28 12:51:15.886 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:15 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:15 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:15 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:15 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:15 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:16 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:51:16 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:51:16 ctl02 neutron-server[30536]: 2017-09-28 12:51:16.140 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:16 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:16 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:51:16 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:16 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:16 ctl02 neutron-server[30536]: 2017-09-28 12:51:16.140 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:16 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:16 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:16 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:16 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:16 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:16 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:51:16 ctl02 neutron-server[30536]: 2017-09-28 12:51:16.394 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:16 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:16 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:16 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:16 ctl02 neutron-server[30536]: 2017-09-28 12:51:16.394 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:16 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:16 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:16 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:16 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:16 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:16 ctl02 neutron-server[30536]: 2017-09-28 12:51:16.650 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:16 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:16 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:16 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:16 ctl02 neutron-server[30536]: 2017-09-28 12:51:16.650 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:16 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:16 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:16 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:16 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:16 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:16 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7e145b79)
Sep 28 12:51:16 ctl02 neutron-server[30536]: 2017-09-28 12:51:16.907 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:16 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:16 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:16 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:16 ctl02 neutron-server[30536]: 2017-09-28 12:51:16.907 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:16 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:16 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:16 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:16 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:16 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:16 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:51:16.935 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:51:16] "OPTIONS / HTTP/1.0" 200 134 0.000377
Sep 28 12:51:17 ctl02 neutron-server[30536]: 2017-09-28 12:51:17.161 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:17 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:17 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:17 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:17 ctl02 neutron-server[30536]: 2017-09-28 12:51:17.161 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:17 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:17 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:17 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:17 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:17 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:17 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:51:17.214 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:51:17] "OPTIONS / HTTP/1.0" 200 134 0.000337
Sep 28 12:51:17 ctl02 neutron-server[30536]: 2017-09-28 12:51:17.415 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:17 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:17 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:17 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:17 ctl02 neutron-server[30536]: 2017-09-28 12:51:17.427 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:17 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:17 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:17 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:17 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:17 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:17 ctl02 heat-api[13008]: 2017-09-28 12:51:17.530 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:51:17] "OPTIONS / HTTP/1.0" 200 134 0.000530
Sep 28 12:51:17 ctl02 neutron-server[30536]: 2017-09-28 12:51:17.680 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:17 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:17 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:17 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:17 ctl02 neutron-server[30536]: 2017-09-28 12:51:17.681 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:17 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:17 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:17 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:17 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:17 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:17 ctl02 heat-api-cfn[13300]: 2017-09-28 12:51:17.735 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:51:17] "OPTIONS / HTTP/1.0" 200 134 0.000549
Sep 28 12:51:17 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7e145b79)
Sep 28 12:51:17 ctl02 heat-api-cfn[13300]: 2017-09-28 12:51:17.785 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:51:17] "OPTIONS / HTTP/1.0" 200 134 0.000360
Sep 28 12:51:17 ctl02 nova-api[10329]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:51:17 ctl02 nova-api[10329]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:51:17 ctl02 neutron-server[30536]: 2017-09-28 12:51:17.935 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:17 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:17 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:17 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:17 ctl02 neutron-server[30536]: 2017-09-28 12:51:17.936 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:17 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:17 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:17 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:17 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:17 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:18 ctl02 nova-api[10329]: 2017-09-28 12:51:18.013 10329 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:51:18 ctl02 nova-api[10329]: 2017-09-28 12:51:18.015 10329 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:51:18 ctl02 nova-api[10329]: 2017-09-28 12:51:18.015 10329 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:51:18 ctl02 nova-api[10329]: 2017-09-28 12:51:18.015 10329 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:51:18 ctl02 nova-api[10329]: 2017-09-28 12:51:18.015 10329 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:51:18 ctl02 nova-api[10329]: 2017-09-28 12:51:18.015 10329 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:51:18 ctl02 nova-api[10329]: 2017-09-28 12:51:18.015 10329 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:51:18 ctl02 nova-api[10329]: 2017-09-28 12:51:18.015 10329 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:51:18 ctl02 nova-api[10329]: 2017-09-28 12:51:18.015 10329 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:51:18 ctl02 nova-api[10329]: 2017-09-28 12:51:18.015 10329 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:51:18 ctl02 nova-api[10329]: 2017-09-28 12:51:18.015 10329 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:51:18 ctl02 nova-api[10329]: 2017-09-28 12:51:18.015 10329 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:51:18 ctl02 nova-api[10329]: 2017-09-28 12:51:18.015 10329 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:51:18 ctl02 nova-api[10329]: 2017-09-28 12:51:18.015 10329 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:51:18 ctl02 nova-api[10329]: 2017-09-28 12:51:18.015 10329 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:51:18 ctl02 nova-api[10329]: 2017-09-28 12:51:18.015 10329 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:51:18 ctl02 nova-api[10329]: 2017-09-28 12:51:18.015 10329 ERROR nova.wsgi     self.filename))
Sep 28 12:51:18 ctl02 nova-api[10329]: 2017-09-28 12:51:18.015 10329 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:51:18 ctl02 nova-api[10329]: 2017-09-28 12:51:18.015 10329 ERROR nova.wsgi
Sep 28 12:51:18 ctl02 nova-api[10329]: 2017-09-28 12:51:18.016 10329 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:51:18 ctl02 nova-api[10329]: 2017-09-28 12:51:18.148 10329 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:51:18 ctl02 neutron-server[30536]: 2017-09-28 12:51:18.189 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:18 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:18 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:18 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:18 ctl02 neutron-server[30536]: 2017-09-28 12:51:18.189 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:18 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:18 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:18 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:18 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:18 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:18 ctl02 nova-api[10329]: 2017-09-28 12:51:18.375 10329 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:51:18 ctl02 nova-api[10329]: 2017-09-28 12:51:18.377 10329 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:51:18 ctl02 nova-api[10329]: 2017-09-28 12:51:18.378 10329 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:51:18 ctl02 nova-api[10329]: 2017-09-28 12:51:18.378 10329 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:51:18 ctl02 neutron-server[30536]: 2017-09-28 12:51:18.442 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:18 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:18 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:18 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:18 ctl02 neutron-server[30536]: 2017-09-28 12:51:18.443 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:18 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:18 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:18 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:18 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:18 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:18 ctl02 nova-api[10329]: 2017-09-28 12:51:18.508 10329 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:51:18 ctl02 nova-api[10329]: 2017-09-28 12:51:18.509 10329 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:51:18 ctl02 nova-api[10329]: 2017-09-28 12:51:18.510 10329 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:51:18 ctl02 nova-api[10329]: 2017-09-28 12:51:18.510 10329 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:51:18 ctl02 nova-api[10329]: 2017-09-28 12:51:18.513 10329 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:51:18 ctl02 nova-api[10329]: 2017-09-28 12:51:18.513 10329 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:51:18 ctl02 nova-api[10329]: 2017-09-28 12:51:18.513 10329 ERROR nova Traceback (most recent call last):
Sep 28 12:51:18 ctl02 nova-api[10329]: 2017-09-28 12:51:18.513 10329 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:51:18 ctl02 nova-api[10329]: 2017-09-28 12:51:18.513 10329 ERROR nova     sys.exit(main())
Sep 28 12:51:18 ctl02 nova-api[10329]: 2017-09-28 12:51:18.513 10329 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:51:18 ctl02 nova-api[10329]: 2017-09-28 12:51:18.513 10329 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:51:18 ctl02 nova-api[10329]: 2017-09-28 12:51:18.513 10329 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:51:18 ctl02 nova-api[10329]: 2017-09-28 12:51:18.513 10329 ERROR nova     max_url_len=max_url_len)
Sep 28 12:51:18 ctl02 nova-api[10329]: 2017-09-28 12:51:18.513 10329 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:51:18 ctl02 nova-api[10329]: 2017-09-28 12:51:18.513 10329 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:51:18 ctl02 nova-api[10329]: 2017-09-28 12:51:18.513 10329 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:51:18 ctl02 nova-api[10329]: 2017-09-28 12:51:18.513 10329 ERROR nova     sock.listen(backlog)
Sep 28 12:51:18 ctl02 nova-api[10329]: 2017-09-28 12:51:18.513 10329 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:51:18 ctl02 nova-api[10329]: 2017-09-28 12:51:18.513 10329 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:51:18 ctl02 nova-api[10329]: 2017-09-28 12:51:18.513 10329 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:51:18 ctl02 nova-api[10329]: 2017-09-28 12:51:18.513 10329 ERROR nova
Sep 28 12:51:18 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:51:18 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:51:18 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:51:18 ctl02 neutron-server[30536]: 2017-09-28 12:51:18.696 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:18 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:18 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:18 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:18 ctl02 neutron-server[30536]: 2017-09-28 12:51:18.697 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:18 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:18 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:18 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:18 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:18 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:18 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x7e145b79)
Sep 28 12:51:18 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:51:18 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:51:18 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:51:18 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:51:18 ctl02 neutron-server[30536]: 2017-09-28 12:51:18.951 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:18 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:18 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:18 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:18 ctl02 neutron-server[30536]: 2017-09-28 12:51:18.953 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:18 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:18 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:18 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:18 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:18 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:19 ctl02 nova-conductor[5056]: 2017-09-28 12:51:19.082 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:51:19 ctl02 nova-conductor[5056]: 2017-09-28 12:51:19.099 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:51:19 ctl02 nova-conductor[5056]: 2017-09-28 12:51:19.127 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:51:19 ctl02 nova-conductor[5056]: 2017-09-28 12:51:19.131 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:51:19 ctl02 neutron-server[30536]: 2017-09-28 12:51:19.208 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:19 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:19 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:19 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:19 ctl02 neutron-server[30536]: 2017-09-28 12:51:19.210 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:19 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:19 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:19 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:19 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:19 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:19 ctl02 nova-cert[4860]: 2017-09-28 12:51:19.218 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:51:19 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:51:19.464 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:51:19] "OPTIONS / HTTP/1.0" 200 134 0.000361
Sep 28 12:51:19 ctl02 neutron-server[30536]: 2017-09-28 12:51:19.465 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:19 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:19 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:19 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:19 ctl02 neutron-server[30536]: 2017-09-28 12:51:19.466 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:19 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:19 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:19 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:19 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:19 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:19 ctl02 neutron-server[30536]: 2017-09-28 12:51:19.721 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:19 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:19 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:19 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:19 ctl02 neutron-server[30536]: 2017-09-28 12:51:19.723 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:19 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:19 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:19 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:19 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:19 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:19 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:51:19 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:51:19 ctl02 neutron-server[30536]: 2017-09-28 12:51:19.977 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:19 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:19 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:19 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:19 ctl02 neutron-server[30536]: 2017-09-28 12:51:19.978 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:19 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:19 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:19 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:19 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:19 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:20 ctl02 neutron-server[30536]: 2017-09-28 12:51:20.231 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:20 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:20 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:20 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:20 ctl02 neutron-server[30536]: 2017-09-28 12:51:20.233 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:20 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:20 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:20 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:20 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:20 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:20 ctl02 heat-api[13008]: 2017-09-28 12:51:20.385 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:51:20] "OPTIONS / HTTP/1.0" 200 134 0.000514
Sep 28 12:51:20 ctl02 neutron-server[30536]: 2017-09-28 12:51:20.486 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:20 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:20 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:20 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:20 ctl02 neutron-server[30536]: 2017-09-28 12:51:20.487 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:20 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:20 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:20 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:20 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:20 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:20 ctl02 nova-api[10347]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:51:20 ctl02 nova-api[10347]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:51:20 ctl02 glance-api[29183]: 2017-09-28 12:51:20.568 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:51:20] "OPTIONS / HTTP/1.0" 200 134 0.000604
Sep 28 12:51:20 ctl02 nova-api[10347]: 2017-09-28 12:51:20.722 10347 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:51:20 ctl02 nova-api[10347]: 2017-09-28 12:51:20.724 10347 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:51:20 ctl02 nova-api[10347]: 2017-09-28 12:51:20.724 10347 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:51:20 ctl02 nova-api[10347]: 2017-09-28 12:51:20.724 10347 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:51:20 ctl02 nova-api[10347]: 2017-09-28 12:51:20.724 10347 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:51:20 ctl02 nova-api[10347]: 2017-09-28 12:51:20.724 10347 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:51:20 ctl02 nova-api[10347]: 2017-09-28 12:51:20.724 10347 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:51:20 ctl02 nova-api[10347]: 2017-09-28 12:51:20.724 10347 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:51:20 ctl02 nova-api[10347]: 2017-09-28 12:51:20.724 10347 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:51:20 ctl02 nova-api[10347]: 2017-09-28 12:51:20.724 10347 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:51:20 ctl02 nova-api[10347]: 2017-09-28 12:51:20.724 10347 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:51:20 ctl02 nova-api[10347]: 2017-09-28 12:51:20.724 10347 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:51:20 ctl02 nova-api[10347]: 2017-09-28 12:51:20.724 10347 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:51:20 ctl02 nova-api[10347]: 2017-09-28 12:51:20.724 10347 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:51:20 ctl02 nova-api[10347]: 2017-09-28 12:51:20.724 10347 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:51:20 ctl02 nova-api[10347]: 2017-09-28 12:51:20.724 10347 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:51:20 ctl02 nova-api[10347]: 2017-09-28 12:51:20.724 10347 ERROR nova.wsgi     self.filename))
Sep 28 12:51:20 ctl02 nova-api[10347]: 2017-09-28 12:51:20.724 10347 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:51:20 ctl02 nova-api[10347]: 2017-09-28 12:51:20.724 10347 ERROR nova.wsgi
Sep 28 12:51:20 ctl02 nova-api[10347]: 2017-09-28 12:51:20.725 10347 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:51:20 ctl02 neutron-server[30536]: 2017-09-28 12:51:20.740 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:20 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:20 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:20 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:20 ctl02 neutron-server[30536]: 2017-09-28 12:51:20.740 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:20 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:20 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:20 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:20 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:20 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:20 ctl02 nova-api[10347]: 2017-09-28 12:51:20.859 10347 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:51:20 ctl02 neutron-server[30536]: 2017-09-28 12:51:20.923 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:51:20] "OPTIONS / HTTP/1.0" 200 262 0.000466
Sep 28 12:51:20 ctl02 neutron-server[30536]: 2017-09-28 12:51:20.994 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:20 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:20 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:20 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:20 ctl02 neutron-server[30536]: 2017-09-28 12:51:20.994 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:20 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:20 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:20 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:20 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:20 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:21 ctl02 nova-api[10347]: 2017-09-28 12:51:21.086 10347 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:51:21 ctl02 nova-api[10347]: 2017-09-28 12:51:21.089 10347 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:51:21 ctl02 nova-api[10347]: 2017-09-28 12:51:21.089 10347 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:51:21 ctl02 nova-api[10347]: 2017-09-28 12:51:21.089 10347 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:51:21 ctl02 neutron-server[30536]: 2017-09-28 12:51:21.176 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 12:51:21 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:51:21 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:49:38 cmp001
Sep 28 12:51:21 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:50:00 cmp002
Sep 28 12:51:21 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:50:16 cmp002
Sep 28 12:51:21 ctl02 nova-api[10347]: 2017-09-28 12:51:21.223 10347 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:51:21 ctl02 nova-api[10347]: 2017-09-28 12:51:21.225 10347 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:51:21 ctl02 nova-api[10347]: 2017-09-28 12:51:21.225 10347 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:51:21 ctl02 nova-api[10347]: 2017-09-28 12:51:21.226 10347 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:51:21 ctl02 nova-api[10347]: 2017-09-28 12:51:21.229 10347 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:51:21 ctl02 nova-api[10347]: 2017-09-28 12:51:21.229 10347 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:51:21 ctl02 nova-api[10347]: 2017-09-28 12:51:21.229 10347 ERROR nova Traceback (most recent call last):
Sep 28 12:51:21 ctl02 nova-api[10347]: 2017-09-28 12:51:21.229 10347 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:51:21 ctl02 nova-api[10347]: 2017-09-28 12:51:21.229 10347 ERROR nova     sys.exit(main())
Sep 28 12:51:21 ctl02 nova-api[10347]: 2017-09-28 12:51:21.229 10347 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:51:21 ctl02 nova-api[10347]: 2017-09-28 12:51:21.229 10347 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:51:21 ctl02 nova-api[10347]: 2017-09-28 12:51:21.229 10347 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:51:21 ctl02 nova-api[10347]: 2017-09-28 12:51:21.229 10347 ERROR nova     max_url_len=max_url_len)
Sep 28 12:51:21 ctl02 nova-api[10347]: 2017-09-28 12:51:21.229 10347 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:51:21 ctl02 nova-api[10347]: 2017-09-28 12:51:21.229 10347 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:51:21 ctl02 nova-api[10347]: 2017-09-28 12:51:21.229 10347 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:51:21 ctl02 nova-api[10347]: 2017-09-28 12:51:21.229 10347 ERROR nova     sock.listen(backlog)
Sep 28 12:51:21 ctl02 nova-api[10347]: 2017-09-28 12:51:21.229 10347 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:51:21 ctl02 nova-api[10347]: 2017-09-28 12:51:21.229 10347 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:51:21 ctl02 nova-api[10347]: 2017-09-28 12:51:21.229 10347 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:51:21 ctl02 nova-api[10347]: 2017-09-28 12:51:21.229 10347 ERROR nova
Sep 28 12:51:21 ctl02 neutron-server[30536]: 2017-09-28 12:51:21.252 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:21 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:21 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:21 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:21 ctl02 neutron-server[30536]: 2017-09-28 12:51:21.253 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:21 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:21 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:21 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:21 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:21 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:21 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:51:21 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:51:21 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:51:21 ctl02 neutron-server[30536]: 2017-09-28 12:51:21.507 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:21 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:21 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:21 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:21 ctl02 neutron-server[30536]: 2017-09-28 12:51:21.507 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:21 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:21 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:21 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:21 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:21 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:21 ctl02 heat-api-cfn[13300]: 2017-09-28 12:51:21.608 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:51:21] "OPTIONS / HTTP/1.0" 200 134 0.000598
Sep 28 12:51:21 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:51:21 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:51:21 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:51:21 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:51:21 ctl02 glance-api[29183]: 2017-09-28 12:51:21.660 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:51:21] "OPTIONS / HTTP/1.0" 200 134 0.000704
Sep 28 12:51:21 ctl02 neutron-server[30536]: 2017-09-28 12:51:21.761 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:21 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:21 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:21 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:21 ctl02 neutron-server[30536]: 2017-09-28 12:51:21.761 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:21 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:21 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:21 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:21 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:21 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:22 ctl02 neutron-server[30536]: 2017-09-28 12:51:22.015 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:22 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:22 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:22 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:22 ctl02 neutron-server[30536]: 2017-09-28 12:51:22.016 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:22 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:22 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:22 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:22 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:22 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:22 ctl02 neutron-server[30536]: 2017-09-28 12:51:22.269 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:22 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:22 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:22 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:22 ctl02 neutron-server[30536]: 2017-09-28 12:51:22.270 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:22 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:22 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:22 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:22 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:22 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:22 ctl02 neutron-server[30536]: 2017-09-28 12:51:22.317 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:51:22] "OPTIONS / HTTP/1.0" 200 262 0.000444
Sep 28 12:51:22 ctl02 glance-api[29183]: 2017-09-28 12:51:22.518 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:51:22] "OPTIONS / HTTP/1.0" 200 134 0.000532
Sep 28 12:51:22 ctl02 neutron-server[30536]: 2017-09-28 12:51:22.528 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:22 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:22 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:22 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:22 ctl02 neutron-server[30536]: 2017-09-28 12:51:22.528 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:22 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:22 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:22 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:22 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:22 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:22 ctl02 neutron-server[30536]: 2017-09-28 12:51:22.784 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:22 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:22 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:22 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:22 ctl02 neutron-server[30536]: 2017-09-28 12:51:22.786 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:22 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:22 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:22 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:22 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:22 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:22 ctl02 neutron-server[30536]: 2017-09-28 12:51:22.997 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:51:22] "OPTIONS / HTTP/1.0" 200 262 0.000416
Sep 28 12:51:23 ctl02 neutron-server[30536]: 2017-09-28 12:51:23.041 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] Returning exception (pymysql.err.ProgrammingError) (1146, u"Table 'neutron.ml2_dvr_port_bindings' doesn't exist") [SQL: u'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bindings_1_vif_details, all
Sep 28 12:51:23 ctl02 neutron-server[30536]: owedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_availability_zone, agents_
Sep 28 12:51:23 ctl02 neutron-server[30536]: 1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports_1.id = ipallocations_1.po
Sep 28 12:51:23 ctl02 neutron-server[30536]: rt_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id'] to caller
Sep 28 12:51:23 ctl02 neutron-server[30536]: 2017-09-28 12:51:23.043 30601 ERROR oslo_messaging._drivers.common [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/l3_rpc.py", line 75, in get_router_ids\n    router_ids=None)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_agentschedulers_db.py", line 525, in auto_schedule_routers\n    self, context, host, router_ids)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 148, in auto_schedule_routers\n    plugin, context, l3_agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 306, in _schedule_ha_routers_to_additional_agent\n    agent)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/l3_agent_scheduler.py", line 295, in get_ha_routers_l3_agents_counts\n    return plugin.get_ha_routers_l3_agents_count(context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/l3_hascheduler_db.py", line 57, in get_ha_routers_l3_agents_count\n    for router, agent_count in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycontext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist
Sep 28 12:51:23 ctl02 neutron-server[30536]: -packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n',
Sep 28 12:51:23 ctl02 neutron-server[30536]: '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 112, in _check_mysql_exception\n    raise errorclass(errno, errorvalue)\n', 'ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table \'neutron.ml2_dvr_port_bindings\' doesn\'t exist") [SQL: u\'SELECT routers.tenant_id AS routers_tenant_id, routers.id AS routers_id, routers.name AS routers_name, routers.status AS routers_status, routers.admin_state_up AS routers_admin_state_up, routers.gw_port_id AS routers_gw_port_id, routers.standard_attr_id AS routers_standard_attr_id, routers.enable_snat AS routers_enable_snat, anon_1.count AS anon_1_count, ipallocations_1.port_id AS ipallocations_1_port_id, ipallocations_1.ip_address AS ipallocations_1_ip_address, ipallocations_1.subnet_id AS ipallocations_1_subnet_id, ipallocations_1.network_id AS ipallocations_1_network_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, ports_1.tenant_id AS ports_1_tenant_id, ports_1.id AS ports_1_id, ports_1.name AS ports_1_name, ports_1.network_id AS ports_1_network_id, ports_1.mac_address AS ports_1_mac_address, ports_1.admin_state_up AS ports_1_admin_state_up, ports_1.status AS ports_1_status, ports_1.device_id AS ports_1_device_id, ports_1.device_owner AS ports_1_device_owner, ports_1.dns_name AS ports_1_dns_name, ports_1.standard_attr_id AS ports_1_standard_attr_id, ml2_port_bindings_1.port_id AS ml2_port_bindings_1_port_id, ml2_port_bindings_1.host AS ml2_port_bindings_1_host, ml2_port_bindings_1.vnic_type AS ml2_port_bindings_1_vnic_type, ml2_port_bindings_1.profile AS ml2_port_bindings_1_profile, ml2_port_bindings_1.vif_type AS ml2_port_bindings_1_vif_type, ml2_port_bindings_1.vif_details AS ml2_port_bind
Sep 28 12:51:23 ctl02 neutron-server[30536]: ings_1_vif_details, allowedaddresspairs_1.port_id AS allowedaddresspairs_1_port_id, allowedaddresspairs_1.mac_address AS allowedaddresspairs_1_mac_address, allowedaddresspairs_1.ip_address AS allowedaddresspairs_1_ip_address, ml2_dvr_port_bindings_1.port_id AS ml2_dvr_port_bindings_1_port_id, ml2_dvr_port_bindings_1.host AS ml2_dvr_port_bindings_1_host, ml2_dvr_port_bindings_1.router_id AS ml2_dvr_port_bindings_1_router_id, ml2_dvr_port_bindings_1.vif_type AS ml2_dvr_port_bindings_1_vif_type, ml2_dvr_port_bindings_1.vif_details AS ml2_dvr_port_bindings_1_vif_details, ml2_dvr_port_bindings_1.vnic_type AS ml2_dvr_port_bindings_1_vnic_type, ml2_dvr_port_bindings_1.profile AS ml2_dvr_port_bindings_1_profile, ml2_dvr_port_bindings_1.status AS ml2_dvr_port_bindings_1_status, extradhcpopts_1.id AS extradhcpopts_1_id, extradhcpopts_1.port_id AS extradhcpopts_1_port_id, extradhcpopts_1.opt_name AS extradhcpopts_1_opt_name, extradhcpopts_1.opt_value AS extradhcpopts_1_opt_value, extradhcpopts_1.ip_version AS extradhcpopts_1_ip_version, securitygroupportbindings_1.port_id AS securitygroupportbindings_1_port_id, securitygroupportbindings_1.security_group_id AS securitygroupportbindings_1_security_group_id, portsecuritybindings_1.port_id AS portsecuritybindings_1_port_id, portsecuritybindings_1.port_security_enabled AS portsecuritybindings_1_port_security_enabled, qos_port_policy_bindings_1.policy_id AS qos_port_policy_bindings_1_policy_id, qos_port_policy_bindings_1.port_id AS qos_port_policy_bindings_1_port_id, portdnses_1.port_id AS portdnses_1_port_id, portdnses_1.current_dns_name AS portdnses_1_current_dns_name, portdnses_1.current_dns_domain AS portdnses_1_current_dns_domain, portdnses_1.previous_dns_name AS portdnses_1_previous_dns_name, portdnses_1.previous_dns_domain AS portdnses_1_previous_dns_domain, agents_1.id AS agents_1_id, agents_1.agent_type AS agents_1_agent_type, agents_1.`binary` AS agents_1_binary, agents_1.topic AS agents_1_topic, agents_1.host AS agents_1_host, agents_1.availability_zone AS agents_1_ava
Sep 28 12:51:23 ctl02 neutron-server[30536]: ilability_zone, agents_1.admin_state_up AS agents_1_admin_state_up, agents_1.created_at AS agents_1_created_at, agents_1.started_at AS agents_1_started_at, agents_1.heartbeat_timestamp AS agents_1_heartbeat_timestamp, agents_1.description AS agents_1_description, agents_1.configurations AS agents_1_configurations, agents_1.resource_versions AS agents_1_resource_versions, agents_1.`load` AS agents_1_load, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag, router_extra_attributes_1.router_id AS router_extra_attributes_1_router_id, router_extra_attributes_1.distributed AS router_extra_attributes_1_distributed, router_extra_attributes_1.service_router AS router_extra_attributes_1_service_router, router_extra_attributes_1.ha AS router_extra_attributes_1_ha, router_extra_attributes_1.ha_vr_id AS router_extra_attributes_1_ha_vr_id, router_extra_attributes_1.availability_zone_hints AS router_extra_attributes_1_availability_zone_hints, routerroutes_1.destination AS routerroutes_1_destination, routerroutes_1.nexthop AS routerroutes_1_nexthop, routerroutes_1.router_id AS routerroutes_1_router_id \\nFROM routers INNER JOIN (SELECT routerl3agentbindings.router_id AS router_id, count(routerl3agentbindings.router_id) AS count \\nFROM routerl3agentbindings INNER JOIN router_extra_attributes ON routerl3agentbindings.router_id = router_extra_attributes.router_id INNER JOIN routers ON routers.id = router_extra_attributes.router_id \\nWHERE router_extra_attributes.ha = true GROUP BY routerl3agentbindings.router_id) AS anon_1 ON routers.id = anon_1.router_id LEFT OUTER JOIN ports AS ports_1 ON ports_1.id = routers.gw_port_id LEFT OUTER JOIN ipallocations AS ipallocations_1 ON ports
Sep 28 12:51:23 ctl02 neutron-server[30536]: _1.id = ipallocations_1.port_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = ports_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ml2_port_bindings AS ml2_port_bindings_1 ON ports_1.id = ml2_port_bindings_1.port_id LEFT OUTER JOIN allowedaddresspairs AS allowedaddresspairs_1 ON ports_1.id = allowedaddresspairs_1.port_id LEFT OUTER JOIN ml2_dvr_port_bindings AS ml2_dvr_port_bindings_1 ON ports_1.id = ml2_dvr_port_bindings_1.port_id LEFT OUTER JOIN extradhcpopts AS extradhcpopts_1 ON ports_1.id = extradhcpopts_1.port_id LEFT OUTER JOIN securitygroupportbindings AS securitygroupportbindings_1 ON ports_1.id = securitygroupportbindings_1.port_id LEFT OUTER JOIN portsecuritybindings AS portsecuritybindings_1 ON ports_1.id = portsecuritybindings_1.port_id LEFT OUTER JOIN qos_port_policy_bindings AS qos_port_policy_bindings_1 ON ports_1.id = qos_port_policy_bindings_1.port_id LEFT OUTER JOIN portdnses AS portdnses_1 ON ports_1.id = portdnses_1.port_id LEFT OUTER JOIN (routerl3agentbindings AS routerl3agentbindings_1 INNER JOIN agents AS agents_1 ON agents_1.id = routerl3agentbindings_1.l3_agent_id) ON routers.id = routerl3agentbindings_1.router_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = routers.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id LEFT OUTER JOIN router_extra_attributes AS router_extra_attributes_1 ON routers.id = router_extra_attributes_1.router_id LEFT OUTER JOIN routerroutes AS routerroutes_1 ON routers.id = routerroutes_1.router_id\']\n']
Sep 28 12:51:23 ctl02 neutron-server[30536]: 2017-09-28 12:51:23.048 30601 WARNING oslo_messaging._drivers.amqpdriver [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] reply_692b03e6d8d44d758b6be19b067c3aa3 doesn't exists, drop reply to 2302e5a4e03f4dc3a5397437224a9adf
Sep 28 12:51:23 ctl02 neutron-server[30536]: 2017-09-28 12:51:23.048 30601 INFO oslo_messaging._drivers.amqpdriver [req-d0fe7460-3b78-4f82-aebf-195d6f50734e - - - - -] The reply 2302e5a4e03f4dc3a5397437224a9adf cannot be sent  reply_692b03e6d8d44d758b6be19b067c3aa3 reply queue don't exist after 60 sec abandoning...
Sep 28 12:51:23 ctl02 nova-api[10369]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:51:23 ctl02 nova-api[10369]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:51:23 ctl02 nova-api[10369]: 2017-09-28 12:51:23.494 10369 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:51:23 ctl02 nova-api[10369]: 2017-09-28 12:51:23.495 10369 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:51:23 ctl02 nova-api[10369]: 2017-09-28 12:51:23.495 10369 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:51:23 ctl02 nova-api[10369]: 2017-09-28 12:51:23.495 10369 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:51:23 ctl02 nova-api[10369]: 2017-09-28 12:51:23.495 10369 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:51:23 ctl02 nova-api[10369]: 2017-09-28 12:51:23.495 10369 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:51:23 ctl02 nova-api[10369]: 2017-09-28 12:51:23.495 10369 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:51:23 ctl02 nova-api[10369]: 2017-09-28 12:51:23.495 10369 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:51:23 ctl02 nova-api[10369]: 2017-09-28 12:51:23.495 10369 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:51:23 ctl02 nova-api[10369]: 2017-09-28 12:51:23.495 10369 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:51:23 ctl02 nova-api[10369]: 2017-09-28 12:51:23.495 10369 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:51:23 ctl02 nova-api[10369]: 2017-09-28 12:51:23.495 10369 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:51:23 ctl02 nova-api[10369]: 2017-09-28 12:51:23.495 10369 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:51:23 ctl02 nova-api[10369]: 2017-09-28 12:51:23.495 10369 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:51:23 ctl02 nova-api[10369]: 2017-09-28 12:51:23.495 10369 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:51:23 ctl02 nova-api[10369]: 2017-09-28 12:51:23.495 10369 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:51:23 ctl02 nova-api[10369]: 2017-09-28 12:51:23.495 10369 ERROR nova.wsgi     self.filename))
Sep 28 12:51:23 ctl02 nova-api[10369]: 2017-09-28 12:51:23.495 10369 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:51:23 ctl02 nova-api[10369]: 2017-09-28 12:51:23.495 10369 ERROR nova.wsgi
Sep 28 12:51:23 ctl02 nova-api[10369]: 2017-09-28 12:51:23.496 10369 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:51:23 ctl02 nova-api[10369]: 2017-09-28 12:51:23.624 10369 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:51:23 ctl02 nova-api[10369]: 2017-09-28 12:51:23.843 10369 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:51:23 ctl02 nova-api[10369]: 2017-09-28 12:51:23.845 10369 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:51:23 ctl02 nova-api[10369]: 2017-09-28 12:51:23.846 10369 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:51:23 ctl02 nova-api[10369]: 2017-09-28 12:51:23.846 10369 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:51:23 ctl02 nova-api[10369]: 2017-09-28 12:51:23.975 10369 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:51:23 ctl02 nova-api[10369]: 2017-09-28 12:51:23.977 10369 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:51:23 ctl02 nova-api[10369]: 2017-09-28 12:51:23.977 10369 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:51:23 ctl02 nova-api[10369]: 2017-09-28 12:51:23.977 10369 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:51:23 ctl02 nova-api[10369]: 2017-09-28 12:51:23.981 10369 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:51:23 ctl02 nova-api[10369]: 2017-09-28 12:51:23.981 10369 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:51:23 ctl02 nova-api[10369]: 2017-09-28 12:51:23.981 10369 ERROR nova Traceback (most recent call last):
Sep 28 12:51:23 ctl02 nova-api[10369]: 2017-09-28 12:51:23.981 10369 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:51:23 ctl02 nova-api[10369]: 2017-09-28 12:51:23.981 10369 ERROR nova     sys.exit(main())
Sep 28 12:51:23 ctl02 nova-api[10369]: 2017-09-28 12:51:23.981 10369 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:51:23 ctl02 nova-api[10369]: 2017-09-28 12:51:23.981 10369 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:51:23 ctl02 nova-api[10369]: 2017-09-28 12:51:23.981 10369 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:51:23 ctl02 nova-api[10369]: 2017-09-28 12:51:23.981 10369 ERROR nova     max_url_len=max_url_len)
Sep 28 12:51:23 ctl02 nova-api[10369]: 2017-09-28 12:51:23.981 10369 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:51:23 ctl02 nova-api[10369]: 2017-09-28 12:51:23.981 10369 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:51:23 ctl02 nova-api[10369]: 2017-09-28 12:51:23.981 10369 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:51:23 ctl02 nova-api[10369]: 2017-09-28 12:51:23.981 10369 ERROR nova     sock.listen(backlog)
Sep 28 12:51:23 ctl02 nova-api[10369]: 2017-09-28 12:51:23.981 10369 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:51:23 ctl02 nova-api[10369]: 2017-09-28 12:51:23.981 10369 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:51:23 ctl02 nova-api[10369]: 2017-09-28 12:51:23.981 10369 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:51:23 ctl02 nova-api[10369]: 2017-09-28 12:51:23.981 10369 ERROR nova
Sep 28 12:51:24 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:51:24 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:51:24 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:51:24 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:51:24 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:51:24 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:51:24 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:51:24 ctl02 heat-api[13008]: 2017-09-28 12:51:24.414 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:51:24] "OPTIONS / HTTP/1.0" 200 134 0.000719
Sep 28 12:51:26 ctl02 nova-api[10387]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:51:26 ctl02 nova-api[10387]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:51:26 ctl02 nova-api[10387]: 2017-09-28 12:51:26.227 10387 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:51:26 ctl02 nova-api[10387]: 2017-09-28 12:51:26.229 10387 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:51:26 ctl02 nova-api[10387]: 2017-09-28 12:51:26.229 10387 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:51:26 ctl02 nova-api[10387]: 2017-09-28 12:51:26.229 10387 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:51:26 ctl02 nova-api[10387]: 2017-09-28 12:51:26.229 10387 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:51:26 ctl02 nova-api[10387]: 2017-09-28 12:51:26.229 10387 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:51:26 ctl02 nova-api[10387]: 2017-09-28 12:51:26.229 10387 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:51:26 ctl02 nova-api[10387]: 2017-09-28 12:51:26.229 10387 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:51:26 ctl02 nova-api[10387]: 2017-09-28 12:51:26.229 10387 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:51:26 ctl02 nova-api[10387]: 2017-09-28 12:51:26.229 10387 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:51:26 ctl02 nova-api[10387]: 2017-09-28 12:51:26.229 10387 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:51:26 ctl02 nova-api[10387]: 2017-09-28 12:51:26.229 10387 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:51:26 ctl02 nova-api[10387]: 2017-09-28 12:51:26.229 10387 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:51:26 ctl02 nova-api[10387]: 2017-09-28 12:51:26.229 10387 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:51:26 ctl02 nova-api[10387]: 2017-09-28 12:51:26.229 10387 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:51:26 ctl02 nova-api[10387]: 2017-09-28 12:51:26.229 10387 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:51:26 ctl02 nova-api[10387]: 2017-09-28 12:51:26.229 10387 ERROR nova.wsgi     self.filename))
Sep 28 12:51:26 ctl02 nova-api[10387]: 2017-09-28 12:51:26.229 10387 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:51:26 ctl02 nova-api[10387]: 2017-09-28 12:51:26.229 10387 ERROR nova.wsgi
Sep 28 12:51:26 ctl02 nova-api[10387]: 2017-09-28 12:51:26.230 10387 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:51:26 ctl02 nova-api[10387]: 2017-09-28 12:51:26.356 10387 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:51:26 ctl02 nova-api[10387]: 2017-09-28 12:51:26.579 10387 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:51:26 ctl02 nova-api[10387]: 2017-09-28 12:51:26.581 10387 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:51:26 ctl02 nova-api[10387]: 2017-09-28 12:51:26.581 10387 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:51:26 ctl02 nova-api[10387]: 2017-09-28 12:51:26.582 10387 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:51:26 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:51:26.657 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:51:26] "OPTIONS / HTTP/1.0" 200 134 0.000372
Sep 28 12:51:26 ctl02 nova-api[10387]: 2017-09-28 12:51:26.712 10387 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:51:26 ctl02 nova-api[10387]: 2017-09-28 12:51:26.713 10387 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:51:26 ctl02 nova-api[10387]: 2017-09-28 12:51:26.714 10387 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:51:26 ctl02 nova-api[10387]: 2017-09-28 12:51:26.714 10387 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:51:26 ctl02 nova-api[10387]: 2017-09-28 12:51:26.717 10387 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:51:26 ctl02 nova-api[10387]: 2017-09-28 12:51:26.717 10387 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:51:26 ctl02 nova-api[10387]: 2017-09-28 12:51:26.717 10387 ERROR nova Traceback (most recent call last):
Sep 28 12:51:26 ctl02 nova-api[10387]: 2017-09-28 12:51:26.717 10387 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:51:26 ctl02 nova-api[10387]: 2017-09-28 12:51:26.717 10387 ERROR nova     sys.exit(main())
Sep 28 12:51:26 ctl02 nova-api[10387]: 2017-09-28 12:51:26.717 10387 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:51:26 ctl02 nova-api[10387]: 2017-09-28 12:51:26.717 10387 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:51:26 ctl02 nova-api[10387]: 2017-09-28 12:51:26.717 10387 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:51:26 ctl02 nova-api[10387]: 2017-09-28 12:51:26.717 10387 ERROR nova     max_url_len=max_url_len)
Sep 28 12:51:26 ctl02 nova-api[10387]: 2017-09-28 12:51:26.717 10387 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:51:26 ctl02 nova-api[10387]: 2017-09-28 12:51:26.717 10387 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:51:26 ctl02 nova-api[10387]: 2017-09-28 12:51:26.717 10387 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:51:26 ctl02 nova-api[10387]: 2017-09-28 12:51:26.717 10387 ERROR nova     sock.listen(backlog)
Sep 28 12:51:26 ctl02 nova-api[10387]: 2017-09-28 12:51:26.717 10387 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:51:26 ctl02 nova-api[10387]: 2017-09-28 12:51:26.717 10387 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:51:26 ctl02 nova-api[10387]: 2017-09-28 12:51:26.717 10387 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:51:26 ctl02 nova-api[10387]: 2017-09-28 12:51:26.717 10387 ERROR nova
Sep 28 12:51:26 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:51:26 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:51:26 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:51:27 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:51:27 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:51:27 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:51:27 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:51:27 ctl02 heat-api[13008]: 2017-09-28 12:51:27.296 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:51:27] "OPTIONS / HTTP/1.0" 200 134 0.000640
Sep 28 12:51:27 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:51:27.567 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:51:27] "OPTIONS / HTTP/1.0" 200 134 0.000479
Sep 28 12:51:27 ctl02 heat-api-cfn[13300]: 2017-09-28 12:51:27.674 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:51:27] "OPTIONS / HTTP/1.0" 200 134 0.000464
Sep 28 12:51:27 ctl02 heat-api-cfn[13300]: 2017-09-28 12:51:27.784 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:51:27] "OPTIONS / HTTP/1.0" 200 134 0.000495
Sep 28 12:51:28 ctl02 neutron-server[30536]: 2017-09-28 12:51:28.515 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:51:28 ctl02 nova-api[10405]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:51:28 ctl02 nova-api[10405]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:51:29 ctl02 nova-api[10405]: 2017-09-28 12:51:29.055 10405 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:51:29 ctl02 nova-api[10405]: 2017-09-28 12:51:29.057 10405 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:51:29 ctl02 nova-api[10405]: 2017-09-28 12:51:29.057 10405 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:51:29 ctl02 nova-api[10405]: 2017-09-28 12:51:29.057 10405 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:51:29 ctl02 nova-api[10405]: 2017-09-28 12:51:29.057 10405 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:51:29 ctl02 nova-api[10405]: 2017-09-28 12:51:29.057 10405 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:51:29 ctl02 nova-api[10405]: 2017-09-28 12:51:29.057 10405 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:51:29 ctl02 nova-api[10405]: 2017-09-28 12:51:29.057 10405 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:51:29 ctl02 nova-api[10405]: 2017-09-28 12:51:29.057 10405 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:51:29 ctl02 nova-api[10405]: 2017-09-28 12:51:29.057 10405 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:51:29 ctl02 nova-api[10405]: 2017-09-28 12:51:29.057 10405 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:51:29 ctl02 nova-api[10405]: 2017-09-28 12:51:29.057 10405 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:51:29 ctl02 nova-api[10405]: 2017-09-28 12:51:29.057 10405 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:51:29 ctl02 nova-api[10405]: 2017-09-28 12:51:29.057 10405 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:51:29 ctl02 nova-api[10405]: 2017-09-28 12:51:29.057 10405 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:51:29 ctl02 nova-api[10405]: 2017-09-28 12:51:29.057 10405 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:51:29 ctl02 nova-api[10405]: 2017-09-28 12:51:29.057 10405 ERROR nova.wsgi     self.filename))
Sep 28 12:51:29 ctl02 nova-api[10405]: 2017-09-28 12:51:29.057 10405 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:51:29 ctl02 nova-api[10405]: 2017-09-28 12:51:29.057 10405 ERROR nova.wsgi
Sep 28 12:51:29 ctl02 nova-api[10405]: 2017-09-28 12:51:29.058 10405 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:51:29 ctl02 nova-consoleauth[5433]: 2017-09-28 12:51:29.063 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:51:29 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:51:29.146 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:51:29] "OPTIONS / HTTP/1.0" 200 134 0.000488
Sep 28 12:51:29 ctl02 nova-api[10405]: 2017-09-28 12:51:29.194 10405 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:51:29 ctl02 nova-api[10405]: 2017-09-28 12:51:29.446 10405 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:51:29 ctl02 nova-api[10405]: 2017-09-28 12:51:29.449 10405 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:51:29 ctl02 nova-api[10405]: 2017-09-28 12:51:29.449 10405 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:51:29 ctl02 nova-api[10405]: 2017-09-28 12:51:29.450 10405 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:51:29 ctl02 nova-api[10405]: 2017-09-28 12:51:29.584 10405 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:51:29 ctl02 nova-api[10405]: 2017-09-28 12:51:29.586 10405 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:51:29 ctl02 nova-api[10405]: 2017-09-28 12:51:29.586 10405 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:51:29 ctl02 nova-api[10405]: 2017-09-28 12:51:29.587 10405 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:51:29 ctl02 nova-api[10405]: 2017-09-28 12:51:29.590 10405 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:51:29 ctl02 nova-api[10405]: 2017-09-28 12:51:29.591 10405 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:51:29 ctl02 nova-api[10405]: 2017-09-28 12:51:29.591 10405 ERROR nova Traceback (most recent call last):
Sep 28 12:51:29 ctl02 nova-api[10405]: 2017-09-28 12:51:29.591 10405 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:51:29 ctl02 nova-api[10405]: 2017-09-28 12:51:29.591 10405 ERROR nova     sys.exit(main())
Sep 28 12:51:29 ctl02 nova-api[10405]: 2017-09-28 12:51:29.591 10405 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:51:29 ctl02 nova-api[10405]: 2017-09-28 12:51:29.591 10405 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:51:29 ctl02 nova-api[10405]: 2017-09-28 12:51:29.591 10405 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:51:29 ctl02 nova-api[10405]: 2017-09-28 12:51:29.591 10405 ERROR nova     max_url_len=max_url_len)
Sep 28 12:51:29 ctl02 nova-api[10405]: 2017-09-28 12:51:29.591 10405 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:51:29 ctl02 nova-api[10405]: 2017-09-28 12:51:29.591 10405 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:51:29 ctl02 nova-api[10405]: 2017-09-28 12:51:29.591 10405 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:51:29 ctl02 nova-api[10405]: 2017-09-28 12:51:29.591 10405 ERROR nova     sock.listen(backlog)
Sep 28 12:51:29 ctl02 nova-api[10405]: 2017-09-28 12:51:29.591 10405 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:51:29 ctl02 nova-api[10405]: 2017-09-28 12:51:29.591 10405 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:51:29 ctl02 nova-api[10405]: 2017-09-28 12:51:29.591 10405 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:51:29 ctl02 nova-api[10405]: 2017-09-28 12:51:29.591 10405 ERROR nova
Sep 28 12:51:29 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:51:29 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:51:29 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:51:29 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:51:29 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:51:29 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:51:29 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:51:30 ctl02 heat-engine[12803]: 2017-09-28 12:51:30.233 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:51:30 ctl02 heat-engine[12803]: 2017-09-28 12:51:30.238 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:51:30 ctl02 heat-engine[12803]: 2017-09-28 12:51:30.238 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:51:30 ctl02 heat-engine[12803]: 2017-09-28 12:51:30.243 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:51:30 ctl02 heat-api[13008]: 2017-09-28 12:51:30.375 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:51:30] "OPTIONS / HTTP/1.0" 200 134 0.000612
Sep 28 12:51:30 ctl02 glance-api[29183]: 2017-09-28 12:51:30.561 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:51:30] "OPTIONS / HTTP/1.0" 200 134 0.000701
Sep 28 12:51:30 ctl02 neutron-server[30536]: 2017-09-28 12:51:30.757 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:51:30] "OPTIONS / HTTP/1.0" 200 262 0.000544
Sep 28 12:51:31 ctl02 nova-api[10424]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:51:31 ctl02 nova-api[10424]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:51:31 ctl02 glance-api[29183]: 2017-09-28 12:51:31.729 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:51:31] "OPTIONS / HTTP/1.0" 200 134 0.000679
Sep 28 12:51:31 ctl02 nova-api[10424]: 2017-09-28 12:51:31.798 10424 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:51:31 ctl02 nova-api[10424]: 2017-09-28 12:51:31.800 10424 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:51:31 ctl02 nova-api[10424]: 2017-09-28 12:51:31.800 10424 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:51:31 ctl02 nova-api[10424]: 2017-09-28 12:51:31.800 10424 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:51:31 ctl02 nova-api[10424]: 2017-09-28 12:51:31.800 10424 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:51:31 ctl02 nova-api[10424]: 2017-09-28 12:51:31.800 10424 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:51:31 ctl02 nova-api[10424]: 2017-09-28 12:51:31.800 10424 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:51:31 ctl02 nova-api[10424]: 2017-09-28 12:51:31.800 10424 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:51:31 ctl02 nova-api[10424]: 2017-09-28 12:51:31.800 10424 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:51:31 ctl02 nova-api[10424]: 2017-09-28 12:51:31.800 10424 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:51:31 ctl02 nova-api[10424]: 2017-09-28 12:51:31.800 10424 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:51:31 ctl02 nova-api[10424]: 2017-09-28 12:51:31.800 10424 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:51:31 ctl02 nova-api[10424]: 2017-09-28 12:51:31.800 10424 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:51:31 ctl02 nova-api[10424]: 2017-09-28 12:51:31.800 10424 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:51:31 ctl02 nova-api[10424]: 2017-09-28 12:51:31.800 10424 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:51:31 ctl02 nova-api[10424]: 2017-09-28 12:51:31.800 10424 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:51:31 ctl02 nova-api[10424]: 2017-09-28 12:51:31.800 10424 ERROR nova.wsgi     self.filename))
Sep 28 12:51:31 ctl02 nova-api[10424]: 2017-09-28 12:51:31.800 10424 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:51:31 ctl02 nova-api[10424]: 2017-09-28 12:51:31.800 10424 ERROR nova.wsgi
Sep 28 12:51:31 ctl02 nova-api[10424]: 2017-09-28 12:51:31.801 10424 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:51:31 ctl02 heat-api-cfn[13300]: 2017-09-28 12:51:31.810 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:51:31] "OPTIONS / HTTP/1.0" 200 134 0.000551
Sep 28 12:51:31 ctl02 nova-api[10424]: 2017-09-28 12:51:31.936 10424 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:51:32 ctl02 nova-scheduler[5620]: 2017-09-28 12:51:32.162 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:51:32 ctl02 nova-api[10424]: 2017-09-28 12:51:32.185 10424 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:51:32 ctl02 nova-api[10424]: 2017-09-28 12:51:32.187 10424 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:51:32 ctl02 nova-api[10424]: 2017-09-28 12:51:32.187 10424 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:51:32 ctl02 nova-api[10424]: 2017-09-28 12:51:32.188 10424 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:51:32 ctl02 nova-api[10424]: 2017-09-28 12:51:32.323 10424 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:51:32 ctl02 nova-api[10424]: 2017-09-28 12:51:32.325 10424 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:51:32 ctl02 nova-api[10424]: 2017-09-28 12:51:32.325 10424 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:51:32 ctl02 nova-api[10424]: 2017-09-28 12:51:32.325 10424 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:51:32 ctl02 nova-api[10424]: 2017-09-28 12:51:32.329 10424 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:51:32 ctl02 nova-api[10424]: 2017-09-28 12:51:32.329 10424 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:51:32 ctl02 nova-api[10424]: 2017-09-28 12:51:32.329 10424 ERROR nova Traceback (most recent call last):
Sep 28 12:51:32 ctl02 nova-api[10424]: 2017-09-28 12:51:32.329 10424 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:51:32 ctl02 nova-api[10424]: 2017-09-28 12:51:32.329 10424 ERROR nova     sys.exit(main())
Sep 28 12:51:32 ctl02 nova-api[10424]: 2017-09-28 12:51:32.329 10424 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:51:32 ctl02 nova-api[10424]: 2017-09-28 12:51:32.329 10424 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:51:32 ctl02 nova-api[10424]: 2017-09-28 12:51:32.329 10424 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:51:32 ctl02 nova-api[10424]: 2017-09-28 12:51:32.329 10424 ERROR nova     max_url_len=max_url_len)
Sep 28 12:51:32 ctl02 nova-api[10424]: 2017-09-28 12:51:32.329 10424 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:51:32 ctl02 nova-api[10424]: 2017-09-28 12:51:32.329 10424 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:51:32 ctl02 nova-api[10424]: 2017-09-28 12:51:32.329 10424 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:51:32 ctl02 nova-api[10424]: 2017-09-28 12:51:32.329 10424 ERROR nova     sock.listen(backlog)
Sep 28 12:51:32 ctl02 nova-api[10424]: 2017-09-28 12:51:32.329 10424 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:51:32 ctl02 nova-api[10424]: 2017-09-28 12:51:32.329 10424 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:51:32 ctl02 nova-api[10424]: 2017-09-28 12:51:32.329 10424 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:51:32 ctl02 nova-api[10424]: 2017-09-28 12:51:32.329 10424 ERROR nova
Sep 28 12:51:32 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:51:32 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:51:32 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:51:32 ctl02 glance-api[29183]: 2017-09-28 12:51:32.569 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:51:32] "OPTIONS / HTTP/1.0" 200 134 0.000648
Sep 28 12:51:32 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:51:32 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:51:32 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:51:32 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:51:32 ctl02 neutron-server[30536]: 2017-09-28 12:51:32.678 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:51:32] "OPTIONS / HTTP/1.0" 200 262 0.000559
Sep 28 12:51:33 ctl02 neutron-server[30536]: 2017-09-28 12:51:33.275 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:51:33] "OPTIONS / HTTP/1.0" 200 262 0.000492
Sep 28 12:51:34 ctl02 nova-api[10442]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:51:34 ctl02 nova-api[10442]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:51:34 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x951f785c)
Sep 28 12:51:34 ctl02 nova-api[10442]: 2017-09-28 12:51:34.506 10442 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:51:34 ctl02 nova-api[10442]: 2017-09-28 12:51:34.507 10442 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:51:34 ctl02 nova-api[10442]: 2017-09-28 12:51:34.507 10442 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:51:34 ctl02 nova-api[10442]: 2017-09-28 12:51:34.507 10442 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:51:34 ctl02 nova-api[10442]: 2017-09-28 12:51:34.507 10442 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:51:34 ctl02 nova-api[10442]: 2017-09-28 12:51:34.507 10442 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:51:34 ctl02 nova-api[10442]: 2017-09-28 12:51:34.507 10442 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:51:34 ctl02 nova-api[10442]: 2017-09-28 12:51:34.507 10442 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:51:34 ctl02 nova-api[10442]: 2017-09-28 12:51:34.507 10442 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:51:34 ctl02 nova-api[10442]: 2017-09-28 12:51:34.507 10442 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:51:34 ctl02 nova-api[10442]: 2017-09-28 12:51:34.507 10442 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:51:34 ctl02 nova-api[10442]: 2017-09-28 12:51:34.507 10442 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:51:34 ctl02 nova-api[10442]: 2017-09-28 12:51:34.507 10442 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:51:34 ctl02 nova-api[10442]: 2017-09-28 12:51:34.507 10442 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:51:34 ctl02 nova-api[10442]: 2017-09-28 12:51:34.507 10442 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:51:34 ctl02 nova-api[10442]: 2017-09-28 12:51:34.507 10442 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:51:34 ctl02 nova-api[10442]: 2017-09-28 12:51:34.507 10442 ERROR nova.wsgi     self.filename))
Sep 28 12:51:34 ctl02 nova-api[10442]: 2017-09-28 12:51:34.507 10442 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:51:34 ctl02 nova-api[10442]: 2017-09-28 12:51:34.507 10442 ERROR nova.wsgi
Sep 28 12:51:34 ctl02 nova-api[10442]: 2017-09-28 12:51:34.508 10442 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:51:34 ctl02 nova-api[10442]: 2017-09-28 12:51:34.641 10442 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:51:34 ctl02 heat-api[13008]: 2017-09-28 12:51:34.811 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:51:34] "OPTIONS / HTTP/1.0" 200 134 0.000622
Sep 28 12:51:34 ctl02 nova-api[10442]: 2017-09-28 12:51:34.890 10442 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:51:34 ctl02 nova-api[10442]: 2017-09-28 12:51:34.892 10442 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:51:34 ctl02 nova-api[10442]: 2017-09-28 12:51:34.893 10442 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:51:34 ctl02 nova-api[10442]: 2017-09-28 12:51:34.893 10442 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:51:35 ctl02 nova-api[10442]: 2017-09-28 12:51:35.025 10442 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:51:35 ctl02 nova-api[10442]: 2017-09-28 12:51:35.027 10442 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:51:35 ctl02 nova-api[10442]: 2017-09-28 12:51:35.027 10442 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:51:35 ctl02 nova-api[10442]: 2017-09-28 12:51:35.027 10442 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:51:35 ctl02 nova-api[10442]: 2017-09-28 12:51:35.031 10442 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:51:35 ctl02 nova-api[10442]: 2017-09-28 12:51:35.031 10442 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:51:35 ctl02 nova-api[10442]: 2017-09-28 12:51:35.031 10442 ERROR nova Traceback (most recent call last):
Sep 28 12:51:35 ctl02 nova-api[10442]: 2017-09-28 12:51:35.031 10442 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:51:35 ctl02 nova-api[10442]: 2017-09-28 12:51:35.031 10442 ERROR nova     sys.exit(main())
Sep 28 12:51:35 ctl02 nova-api[10442]: 2017-09-28 12:51:35.031 10442 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:51:35 ctl02 nova-api[10442]: 2017-09-28 12:51:35.031 10442 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:51:35 ctl02 nova-api[10442]: 2017-09-28 12:51:35.031 10442 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:51:35 ctl02 nova-api[10442]: 2017-09-28 12:51:35.031 10442 ERROR nova     max_url_len=max_url_len)
Sep 28 12:51:35 ctl02 nova-api[10442]: 2017-09-28 12:51:35.031 10442 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:51:35 ctl02 nova-api[10442]: 2017-09-28 12:51:35.031 10442 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:51:35 ctl02 nova-api[10442]: 2017-09-28 12:51:35.031 10442 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:51:35 ctl02 nova-api[10442]: 2017-09-28 12:51:35.031 10442 ERROR nova     sock.listen(backlog)
Sep 28 12:51:35 ctl02 nova-api[10442]: 2017-09-28 12:51:35.031 10442 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:51:35 ctl02 nova-api[10442]: 2017-09-28 12:51:35.031 10442 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:51:35 ctl02 nova-api[10442]: 2017-09-28 12:51:35.031 10442 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:51:35 ctl02 nova-api[10442]: 2017-09-28 12:51:35.031 10442 ERROR nova
Sep 28 12:51:35 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:51:35 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:51:35 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:51:35 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:51:35 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:51:35 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x951f785c)
Sep 28 12:51:35 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:51:35 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:51:36 ctl02 neutron-server[30536]: 2017-09-28 12:51:36.172 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 4 dead agents out of 6:
Sep 28 12:51:36 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:51:36 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:50:56 cmp002
Sep 28 12:51:36 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:49:38 cmp001
Sep 28 12:51:36 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:50:00 cmp002
Sep 28 12:51:36 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:50:16 cmp002
Sep 28 12:51:36 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x951f785c)
Sep 28 12:51:36 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:51:36.581 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:51:36] "OPTIONS / HTTP/1.0" 200 134 0.000436
Sep 28 12:51:37 ctl02 nova-api[10460]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:51:37 ctl02 nova-api[10460]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:51:37 ctl02 heat-api[13008]: 2017-09-28 12:51:37.063 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:51:37] "OPTIONS / HTTP/1.0" 200 134 0.000599
Sep 28 12:51:37 ctl02 nova-api[10460]: 2017-09-28 12:51:37.268 10460 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:51:37 ctl02 nova-api[10460]: 2017-09-28 12:51:37.269 10460 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:51:37 ctl02 nova-api[10460]: 2017-09-28 12:51:37.269 10460 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:51:37 ctl02 nova-api[10460]: 2017-09-28 12:51:37.269 10460 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:51:37 ctl02 nova-api[10460]: 2017-09-28 12:51:37.269 10460 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:51:37 ctl02 nova-api[10460]: 2017-09-28 12:51:37.269 10460 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:51:37 ctl02 nova-api[10460]: 2017-09-28 12:51:37.269 10460 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:51:37 ctl02 nova-api[10460]: 2017-09-28 12:51:37.269 10460 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:51:37 ctl02 nova-api[10460]: 2017-09-28 12:51:37.269 10460 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:51:37 ctl02 nova-api[10460]: 2017-09-28 12:51:37.269 10460 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:51:37 ctl02 nova-api[10460]: 2017-09-28 12:51:37.269 10460 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:51:37 ctl02 nova-api[10460]: 2017-09-28 12:51:37.269 10460 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:51:37 ctl02 nova-api[10460]: 2017-09-28 12:51:37.269 10460 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:51:37 ctl02 nova-api[10460]: 2017-09-28 12:51:37.269 10460 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:51:37 ctl02 nova-api[10460]: 2017-09-28 12:51:37.269 10460 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:51:37 ctl02 nova-api[10460]: 2017-09-28 12:51:37.269 10460 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:51:37 ctl02 nova-api[10460]: 2017-09-28 12:51:37.269 10460 ERROR nova.wsgi     self.filename))
Sep 28 12:51:37 ctl02 nova-api[10460]: 2017-09-28 12:51:37.269 10460 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:51:37 ctl02 nova-api[10460]: 2017-09-28 12:51:37.269 10460 ERROR nova.wsgi
Sep 28 12:51:37 ctl02 nova-api[10460]: 2017-09-28 12:51:37.270 10460 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:51:37 ctl02 heat-api-cfn[13300]: 2017-09-28 12:51:37.371 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:51:37] "OPTIONS / HTTP/1.0" 200 134 0.000510
Sep 28 12:51:37 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x951f785c)
Sep 28 12:51:37 ctl02 nova-api[10460]: 2017-09-28 12:51:37.404 10460 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:51:37 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:51:37.451 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:51:37] "OPTIONS / HTTP/1.0" 200 134 0.000430
Sep 28 12:51:37 ctl02 nova-api[10460]: 2017-09-28 12:51:37.651 10460 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:51:37 ctl02 nova-api[10460]: 2017-09-28 12:51:37.654 10460 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:51:37 ctl02 nova-api[10460]: 2017-09-28 12:51:37.664 10460 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:51:37 ctl02 nova-api[10460]: 2017-09-28 12:51:37.665 10460 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:51:37 ctl02 nova-api[10460]: 2017-09-28 12:51:37.796 10460 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:51:37 ctl02 nova-api[10460]: 2017-09-28 12:51:37.799 10460 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:51:37 ctl02 nova-api[10460]: 2017-09-28 12:51:37.799 10460 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:51:37 ctl02 nova-api[10460]: 2017-09-28 12:51:37.800 10460 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:51:37 ctl02 nova-api[10460]: 2017-09-28 12:51:37.804 10460 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:51:37 ctl02 nova-api[10460]: 2017-09-28 12:51:37.804 10460 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:51:37 ctl02 nova-api[10460]: 2017-09-28 12:51:37.804 10460 ERROR nova Traceback (most recent call last):
Sep 28 12:51:37 ctl02 nova-api[10460]: 2017-09-28 12:51:37.804 10460 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:51:37 ctl02 nova-api[10460]: 2017-09-28 12:51:37.804 10460 ERROR nova     sys.exit(main())
Sep 28 12:51:37 ctl02 nova-api[10460]: 2017-09-28 12:51:37.804 10460 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:51:37 ctl02 nova-api[10460]: 2017-09-28 12:51:37.804 10460 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:51:37 ctl02 nova-api[10460]: 2017-09-28 12:51:37.804 10460 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:51:37 ctl02 nova-api[10460]: 2017-09-28 12:51:37.804 10460 ERROR nova     max_url_len=max_url_len)
Sep 28 12:51:37 ctl02 nova-api[10460]: 2017-09-28 12:51:37.804 10460 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:51:37 ctl02 nova-api[10460]: 2017-09-28 12:51:37.804 10460 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:51:37 ctl02 nova-api[10460]: 2017-09-28 12:51:37.804 10460 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:51:37 ctl02 nova-api[10460]: 2017-09-28 12:51:37.804 10460 ERROR nova     sock.listen(backlog)
Sep 28 12:51:37 ctl02 nova-api[10460]: 2017-09-28 12:51:37.804 10460 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:51:37 ctl02 nova-api[10460]: 2017-09-28 12:51:37.804 10460 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:51:37 ctl02 nova-api[10460]: 2017-09-28 12:51:37.804 10460 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:51:37 ctl02 nova-api[10460]: 2017-09-28 12:51:37.804 10460 ERROR nova
Sep 28 12:51:37 ctl02 heat-api-cfn[13300]: 2017-09-28 12:51:37.823 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:51:37] "OPTIONS / HTTP/1.0" 200 134 0.000500
Sep 28 12:51:37 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:51:37 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:51:37 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:51:38 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:51:38 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:51:38 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:51:38 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:51:38 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x951f785c)
Sep 28 12:51:39 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x951f785c)
Sep 28 12:51:39 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:51:39.469 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:51:39] "OPTIONS / HTTP/1.0" 200 134 0.000409
Sep 28 12:51:39 ctl02 nova-api[10478]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:51:39 ctl02 nova-api[10478]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:51:39 ctl02 nova-api[10478]: 2017-09-28 12:51:39.987 10478 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:51:39 ctl02 nova-api[10478]: 2017-09-28 12:51:39.988 10478 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:51:39 ctl02 nova-api[10478]: 2017-09-28 12:51:39.988 10478 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:51:39 ctl02 nova-api[10478]: 2017-09-28 12:51:39.988 10478 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:51:39 ctl02 nova-api[10478]: 2017-09-28 12:51:39.988 10478 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:51:39 ctl02 nova-api[10478]: 2017-09-28 12:51:39.988 10478 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:51:39 ctl02 nova-api[10478]: 2017-09-28 12:51:39.988 10478 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:51:39 ctl02 nova-api[10478]: 2017-09-28 12:51:39.988 10478 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:51:39 ctl02 nova-api[10478]: 2017-09-28 12:51:39.988 10478 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:51:39 ctl02 nova-api[10478]: 2017-09-28 12:51:39.988 10478 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:51:39 ctl02 nova-api[10478]: 2017-09-28 12:51:39.988 10478 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:51:39 ctl02 nova-api[10478]: 2017-09-28 12:51:39.988 10478 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:51:39 ctl02 nova-api[10478]: 2017-09-28 12:51:39.988 10478 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:51:39 ctl02 nova-api[10478]: 2017-09-28 12:51:39.988 10478 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:51:39 ctl02 nova-api[10478]: 2017-09-28 12:51:39.988 10478 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:51:39 ctl02 nova-api[10478]: 2017-09-28 12:51:39.988 10478 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:51:39 ctl02 nova-api[10478]: 2017-09-28 12:51:39.988 10478 ERROR nova.wsgi     self.filename))
Sep 28 12:51:39 ctl02 nova-api[10478]: 2017-09-28 12:51:39.988 10478 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:51:39 ctl02 nova-api[10478]: 2017-09-28 12:51:39.988 10478 ERROR nova.wsgi
Sep 28 12:51:39 ctl02 nova-api[10478]: 2017-09-28 12:51:39.989 10478 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:51:40 ctl02 nova-api[10478]: 2017-09-28 12:51:40.122 10478 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:51:40 ctl02 nova-api[10478]: 2017-09-28 12:51:40.374 10478 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:51:40 ctl02 nova-api[10478]: 2017-09-28 12:51:40.376 10478 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:51:40 ctl02 nova-api[10478]: 2017-09-28 12:51:40.376 10478 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:51:40 ctl02 nova-api[10478]: 2017-09-28 12:51:40.377 10478 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:51:40 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x951f785c)
Sep 28 12:51:40 ctl02 heat-api[13008]: 2017-09-28 12:51:40.414 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:51:40] "OPTIONS / HTTP/1.0" 200 134 0.000617
Sep 28 12:51:40 ctl02 nova-api[10478]: 2017-09-28 12:51:40.509 10478 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:51:40 ctl02 nova-api[10478]: 2017-09-28 12:51:40.511 10478 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:51:40 ctl02 nova-api[10478]: 2017-09-28 12:51:40.511 10478 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:51:40 ctl02 nova-api[10478]: 2017-09-28 12:51:40.512 10478 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:51:40 ctl02 nova-api[10478]: 2017-09-28 12:51:40.515 10478 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:51:40 ctl02 nova-api[10478]: 2017-09-28 12:51:40.515 10478 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:51:40 ctl02 nova-api[10478]: 2017-09-28 12:51:40.515 10478 ERROR nova Traceback (most recent call last):
Sep 28 12:51:40 ctl02 nova-api[10478]: 2017-09-28 12:51:40.515 10478 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:51:40 ctl02 nova-api[10478]: 2017-09-28 12:51:40.515 10478 ERROR nova     sys.exit(main())
Sep 28 12:51:40 ctl02 nova-api[10478]: 2017-09-28 12:51:40.515 10478 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:51:40 ctl02 nova-api[10478]: 2017-09-28 12:51:40.515 10478 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:51:40 ctl02 nova-api[10478]: 2017-09-28 12:51:40.515 10478 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:51:40 ctl02 nova-api[10478]: 2017-09-28 12:51:40.515 10478 ERROR nova     max_url_len=max_url_len)
Sep 28 12:51:40 ctl02 nova-api[10478]: 2017-09-28 12:51:40.515 10478 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:51:40 ctl02 nova-api[10478]: 2017-09-28 12:51:40.515 10478 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:51:40 ctl02 nova-api[10478]: 2017-09-28 12:51:40.515 10478 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:51:40 ctl02 nova-api[10478]: 2017-09-28 12:51:40.515 10478 ERROR nova     sock.listen(backlog)
Sep 28 12:51:40 ctl02 nova-api[10478]: 2017-09-28 12:51:40.515 10478 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:51:40 ctl02 nova-api[10478]: 2017-09-28 12:51:40.515 10478 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:51:40 ctl02 nova-api[10478]: 2017-09-28 12:51:40.515 10478 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:51:40 ctl02 nova-api[10478]: 2017-09-28 12:51:40.515 10478 ERROR nova
Sep 28 12:51:40 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:51:40 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:51:40 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:51:40 ctl02 glance-api[29183]: 2017-09-28 12:51:40.718 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:51:40] "OPTIONS / HTTP/1.0" 200 134 0.000640
Sep 28 12:51:40 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:51:40 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:51:40 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:51:40 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:51:41 ctl02 neutron-server[30536]: 2017-09-28 12:51:41.069 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:51:41] "OPTIONS / HTTP/1.0" 200 262 0.000531
Sep 28 12:51:41 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x951f785c)
Sep 28 12:51:41 ctl02 heat-api-cfn[13300]: 2017-09-28 12:51:41.446 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:51:41] "OPTIONS / HTTP/1.0" 200 134 0.000509
Sep 28 12:51:41 ctl02 glance-api[29183]: 2017-09-28 12:51:41.816 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:51:41] "OPTIONS / HTTP/1.0" 200 134 0.000612
Sep 28 12:51:42 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x951f785c)
Sep 28 12:51:42 ctl02 nova-api[10496]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:51:42 ctl02 nova-api[10496]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:51:42 ctl02 nova-api[10496]: 2017-09-28 12:51:42.774 10496 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:51:42 ctl02 nova-api[10496]: 2017-09-28 12:51:42.776 10496 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:51:42 ctl02 nova-api[10496]: 2017-09-28 12:51:42.776 10496 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:51:42 ctl02 nova-api[10496]: 2017-09-28 12:51:42.776 10496 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:51:42 ctl02 nova-api[10496]: 2017-09-28 12:51:42.776 10496 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:51:42 ctl02 nova-api[10496]: 2017-09-28 12:51:42.776 10496 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:51:42 ctl02 nova-api[10496]: 2017-09-28 12:51:42.776 10496 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:51:42 ctl02 nova-api[10496]: 2017-09-28 12:51:42.776 10496 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:51:42 ctl02 nova-api[10496]: 2017-09-28 12:51:42.776 10496 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:51:42 ctl02 nova-api[10496]: 2017-09-28 12:51:42.776 10496 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:51:42 ctl02 nova-api[10496]: 2017-09-28 12:51:42.776 10496 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:51:42 ctl02 nova-api[10496]: 2017-09-28 12:51:42.776 10496 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:51:42 ctl02 nova-api[10496]: 2017-09-28 12:51:42.776 10496 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:51:42 ctl02 nova-api[10496]: 2017-09-28 12:51:42.776 10496 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:51:42 ctl02 nova-api[10496]: 2017-09-28 12:51:42.776 10496 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:51:42 ctl02 nova-api[10496]: 2017-09-28 12:51:42.776 10496 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:51:42 ctl02 nova-api[10496]: 2017-09-28 12:51:42.776 10496 ERROR nova.wsgi     self.filename))
Sep 28 12:51:42 ctl02 nova-api[10496]: 2017-09-28 12:51:42.776 10496 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:51:42 ctl02 nova-api[10496]: 2017-09-28 12:51:42.776 10496 ERROR nova.wsgi
Sep 28 12:51:42 ctl02 nova-api[10496]: 2017-09-28 12:51:42.786 10496 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:51:42 ctl02 neutron-server[30536]: 2017-09-28 12:51:42.847 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:51:42] "OPTIONS / HTTP/1.0" 200 262 0.000540
Sep 28 12:51:42 ctl02 glance-api[29183]: 2017-09-28 12:51:42.870 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:51:42] "OPTIONS / HTTP/1.0" 200 134 0.000642
Sep 28 12:51:42 ctl02 nova-api[10496]: 2017-09-28 12:51:42.922 10496 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:51:43 ctl02 nova-api[10496]: 2017-09-28 12:51:43.168 10496 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:51:43 ctl02 nova-api[10496]: 2017-09-28 12:51:43.171 10496 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:51:43 ctl02 nova-api[10496]: 2017-09-28 12:51:43.171 10496 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:51:43 ctl02 nova-api[10496]: 2017-09-28 12:51:43.172 10496 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:51:43 ctl02 neutron-server[30536]: 2017-09-28 12:51:43.208 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:51:43] "OPTIONS / HTTP/1.0" 200 262 0.000528
Sep 28 12:51:43 ctl02 nova-api[10496]: 2017-09-28 12:51:43.308 10496 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:51:43 ctl02 nova-api[10496]: 2017-09-28 12:51:43.310 10496 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:51:43 ctl02 nova-api[10496]: 2017-09-28 12:51:43.310 10496 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:51:43 ctl02 nova-api[10496]: 2017-09-28 12:51:43.311 10496 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:51:43 ctl02 nova-api[10496]: 2017-09-28 12:51:43.314 10496 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:51:43 ctl02 nova-api[10496]: 2017-09-28 12:51:43.314 10496 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:51:43 ctl02 nova-api[10496]: 2017-09-28 12:51:43.314 10496 ERROR nova Traceback (most recent call last):
Sep 28 12:51:43 ctl02 nova-api[10496]: 2017-09-28 12:51:43.314 10496 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:51:43 ctl02 nova-api[10496]: 2017-09-28 12:51:43.314 10496 ERROR nova     sys.exit(main())
Sep 28 12:51:43 ctl02 nova-api[10496]: 2017-09-28 12:51:43.314 10496 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:51:43 ctl02 nova-api[10496]: 2017-09-28 12:51:43.314 10496 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:51:43 ctl02 nova-api[10496]: 2017-09-28 12:51:43.314 10496 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:51:43 ctl02 nova-api[10496]: 2017-09-28 12:51:43.314 10496 ERROR nova     max_url_len=max_url_len)
Sep 28 12:51:43 ctl02 nova-api[10496]: 2017-09-28 12:51:43.314 10496 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:51:43 ctl02 nova-api[10496]: 2017-09-28 12:51:43.314 10496 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:51:43 ctl02 nova-api[10496]: 2017-09-28 12:51:43.314 10496 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:51:43 ctl02 nova-api[10496]: 2017-09-28 12:51:43.314 10496 ERROR nova     sock.listen(backlog)
Sep 28 12:51:43 ctl02 nova-api[10496]: 2017-09-28 12:51:43.314 10496 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:51:43 ctl02 nova-api[10496]: 2017-09-28 12:51:43.314 10496 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:51:43 ctl02 nova-api[10496]: 2017-09-28 12:51:43.314 10496 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:51:43 ctl02 nova-api[10496]: 2017-09-28 12:51:43.314 10496 ERROR nova
Sep 28 12:51:43 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x951f785c)
Sep 28 12:51:43 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:51:43 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:51:43 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:51:43 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:51:43 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:51:43 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:51:43 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:51:44 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x951f785c)
Sep 28 12:51:44 ctl02 heat-api[13008]: 2017-09-28 12:51:44.869 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:51:44] "OPTIONS / HTTP/1.0" 200 134 0.000602
Sep 28 12:51:45 ctl02 nova-api[10514]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:51:45 ctl02 nova-api[10514]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:51:45 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:51:45 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:51:45 ctl02 nova-api[10514]: 2017-09-28 12:51:45.526 10514 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:51:45 ctl02 nova-api[10514]: 2017-09-28 12:51:45.528 10514 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:51:45 ctl02 nova-api[10514]: 2017-09-28 12:51:45.528 10514 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:51:45 ctl02 nova-api[10514]: 2017-09-28 12:51:45.528 10514 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:51:45 ctl02 nova-api[10514]: 2017-09-28 12:51:45.528 10514 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:51:45 ctl02 nova-api[10514]: 2017-09-28 12:51:45.528 10514 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:51:45 ctl02 nova-api[10514]: 2017-09-28 12:51:45.528 10514 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:51:45 ctl02 nova-api[10514]: 2017-09-28 12:51:45.528 10514 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:51:45 ctl02 nova-api[10514]: 2017-09-28 12:51:45.528 10514 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:51:45 ctl02 nova-api[10514]: 2017-09-28 12:51:45.528 10514 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:51:45 ctl02 nova-api[10514]: 2017-09-28 12:51:45.528 10514 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:51:45 ctl02 nova-api[10514]: 2017-09-28 12:51:45.528 10514 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:51:45 ctl02 nova-api[10514]: 2017-09-28 12:51:45.528 10514 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:51:45 ctl02 nova-api[10514]: 2017-09-28 12:51:45.528 10514 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:51:45 ctl02 nova-api[10514]: 2017-09-28 12:51:45.528 10514 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:51:45 ctl02 nova-api[10514]: 2017-09-28 12:51:45.528 10514 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:51:45 ctl02 nova-api[10514]: 2017-09-28 12:51:45.528 10514 ERROR nova.wsgi     self.filename))
Sep 28 12:51:45 ctl02 nova-api[10514]: 2017-09-28 12:51:45.528 10514 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:51:45 ctl02 nova-api[10514]: 2017-09-28 12:51:45.528 10514 ERROR nova.wsgi
Sep 28 12:51:45 ctl02 nova-api[10514]: 2017-09-28 12:51:45.530 10514 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:51:45 ctl02 nova-api[10514]: 2017-09-28 12:51:45.667 10514 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:51:45 ctl02 nova-api[10514]: 2017-09-28 12:51:45.903 10514 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:51:45 ctl02 nova-api[10514]: 2017-09-28 12:51:45.905 10514 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:51:45 ctl02 nova-api[10514]: 2017-09-28 12:51:45.905 10514 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:51:45 ctl02 nova-api[10514]: 2017-09-28 12:51:45.905 10514 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:51:46 ctl02 nova-api[10514]: 2017-09-28 12:51:46.037 10514 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:51:46 ctl02 nova-api[10514]: 2017-09-28 12:51:46.039 10514 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:51:46 ctl02 nova-api[10514]: 2017-09-28 12:51:46.040 10514 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:51:46 ctl02 nova-api[10514]: 2017-09-28 12:51:46.040 10514 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:51:46 ctl02 nova-api[10514]: 2017-09-28 12:51:46.043 10514 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:51:46 ctl02 nova-api[10514]: 2017-09-28 12:51:46.043 10514 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:51:46 ctl02 nova-api[10514]: 2017-09-28 12:51:46.043 10514 ERROR nova Traceback (most recent call last):
Sep 28 12:51:46 ctl02 nova-api[10514]: 2017-09-28 12:51:46.043 10514 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:51:46 ctl02 nova-api[10514]: 2017-09-28 12:51:46.043 10514 ERROR nova     sys.exit(main())
Sep 28 12:51:46 ctl02 nova-api[10514]: 2017-09-28 12:51:46.043 10514 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:51:46 ctl02 nova-api[10514]: 2017-09-28 12:51:46.043 10514 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:51:46 ctl02 nova-api[10514]: 2017-09-28 12:51:46.043 10514 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:51:46 ctl02 nova-api[10514]: 2017-09-28 12:51:46.043 10514 ERROR nova     max_url_len=max_url_len)
Sep 28 12:51:46 ctl02 nova-api[10514]: 2017-09-28 12:51:46.043 10514 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:51:46 ctl02 nova-api[10514]: 2017-09-28 12:51:46.043 10514 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:51:46 ctl02 nova-api[10514]: 2017-09-28 12:51:46.043 10514 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:51:46 ctl02 nova-api[10514]: 2017-09-28 12:51:46.043 10514 ERROR nova     sock.listen(backlog)
Sep 28 12:51:46 ctl02 nova-api[10514]: 2017-09-28 12:51:46.043 10514 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:51:46 ctl02 nova-api[10514]: 2017-09-28 12:51:46.043 10514 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:51:46 ctl02 nova-api[10514]: 2017-09-28 12:51:46.043 10514 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:51:46 ctl02 nova-api[10514]: 2017-09-28 12:51:46.043 10514 ERROR nova
Sep 28 12:51:46 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:51:46 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:51:46 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:51:46 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:51:46 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:51:46 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:51:46 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:51:46 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:51:46.606 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:51:46] "OPTIONS / HTTP/1.0" 200 134 0.000439
Sep 28 12:51:46 ctl02 heat-api[13008]: 2017-09-28 12:51:46.826 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:51:46] "OPTIONS / HTTP/1.0" 200 134 0.000597
Sep 28 12:51:47 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:51:47.069 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:51:47] "OPTIONS / HTTP/1.0" 200 134 0.000417
Sep 28 12:51:47 ctl02 heat-api-cfn[13300]: 2017-09-28 12:51:47.248 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:51:47] "OPTIONS / HTTP/1.0" 200 134 0.000539
Sep 28 12:51:47 ctl02 heat-api-cfn[13300]: 2017-09-28 12:51:47.546 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:51:47] "OPTIONS / HTTP/1.0" 200 134 0.000465
Sep 28 12:51:48 ctl02 nova-api[10537]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:51:48 ctl02 nova-api[10537]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:51:48 ctl02 nova-api[10537]: 2017-09-28 12:51:48.278 10537 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:51:48 ctl02 nova-api[10537]: 2017-09-28 12:51:48.279 10537 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:51:48 ctl02 nova-api[10537]: 2017-09-28 12:51:48.279 10537 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:51:48 ctl02 nova-api[10537]: 2017-09-28 12:51:48.279 10537 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:51:48 ctl02 nova-api[10537]: 2017-09-28 12:51:48.279 10537 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:51:48 ctl02 nova-api[10537]: 2017-09-28 12:51:48.279 10537 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:51:48 ctl02 nova-api[10537]: 2017-09-28 12:51:48.279 10537 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:51:48 ctl02 nova-api[10537]: 2017-09-28 12:51:48.279 10537 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:51:48 ctl02 nova-api[10537]: 2017-09-28 12:51:48.279 10537 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:51:48 ctl02 nova-api[10537]: 2017-09-28 12:51:48.279 10537 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:51:48 ctl02 nova-api[10537]: 2017-09-28 12:51:48.279 10537 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:51:48 ctl02 nova-api[10537]: 2017-09-28 12:51:48.279 10537 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:51:48 ctl02 nova-api[10537]: 2017-09-28 12:51:48.279 10537 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:51:48 ctl02 nova-api[10537]: 2017-09-28 12:51:48.279 10537 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:51:48 ctl02 nova-api[10537]: 2017-09-28 12:51:48.279 10537 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:51:48 ctl02 nova-api[10537]: 2017-09-28 12:51:48.279 10537 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:51:48 ctl02 nova-api[10537]: 2017-09-28 12:51:48.279 10537 ERROR nova.wsgi     self.filename))
Sep 28 12:51:48 ctl02 nova-api[10537]: 2017-09-28 12:51:48.279 10537 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:51:48 ctl02 nova-api[10537]: 2017-09-28 12:51:48.279 10537 ERROR nova.wsgi
Sep 28 12:51:48 ctl02 nova-api[10537]: 2017-09-28 12:51:48.280 10537 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:51:48 ctl02 nova-api[10537]: 2017-09-28 12:51:48.413 10537 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:51:48 ctl02 nova-api[10537]: 2017-09-28 12:51:48.663 10537 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:51:48 ctl02 nova-api[10537]: 2017-09-28 12:51:48.666 10537 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:51:48 ctl02 nova-api[10537]: 2017-09-28 12:51:48.666 10537 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:51:48 ctl02 nova-api[10537]: 2017-09-28 12:51:48.666 10537 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:51:48 ctl02 nova-api[10537]: 2017-09-28 12:51:48.802 10537 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:51:48 ctl02 nova-api[10537]: 2017-09-28 12:51:48.805 10537 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:51:48 ctl02 nova-api[10537]: 2017-09-28 12:51:48.805 10537 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:51:48 ctl02 nova-api[10537]: 2017-09-28 12:51:48.805 10537 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:51:48 ctl02 nova-api[10537]: 2017-09-28 12:51:48.808 10537 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:51:48 ctl02 nova-api[10537]: 2017-09-28 12:51:48.809 10537 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:51:48 ctl02 nova-api[10537]: 2017-09-28 12:51:48.809 10537 ERROR nova Traceback (most recent call last):
Sep 28 12:51:48 ctl02 nova-api[10537]: 2017-09-28 12:51:48.809 10537 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:51:48 ctl02 nova-api[10537]: 2017-09-28 12:51:48.809 10537 ERROR nova     sys.exit(main())
Sep 28 12:51:48 ctl02 nova-api[10537]: 2017-09-28 12:51:48.809 10537 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:51:48 ctl02 nova-api[10537]: 2017-09-28 12:51:48.809 10537 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:51:48 ctl02 nova-api[10537]: 2017-09-28 12:51:48.809 10537 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:51:48 ctl02 nova-api[10537]: 2017-09-28 12:51:48.809 10537 ERROR nova     max_url_len=max_url_len)
Sep 28 12:51:48 ctl02 nova-api[10537]: 2017-09-28 12:51:48.809 10537 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:51:48 ctl02 nova-api[10537]: 2017-09-28 12:51:48.809 10537 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:51:48 ctl02 nova-api[10537]: 2017-09-28 12:51:48.809 10537 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:51:48 ctl02 nova-api[10537]: 2017-09-28 12:51:48.809 10537 ERROR nova     sock.listen(backlog)
Sep 28 12:51:48 ctl02 nova-api[10537]: 2017-09-28 12:51:48.809 10537 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:51:48 ctl02 nova-api[10537]: 2017-09-28 12:51:48.809 10537 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:51:48 ctl02 nova-api[10537]: 2017-09-28 12:51:48.809 10537 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:51:48 ctl02 nova-api[10537]: 2017-09-28 12:51:48.809 10537 ERROR nova
Sep 28 12:51:48 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:51:48 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:51:48 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:51:49 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:51:49 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:51:49 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:51:49 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:51:49 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:51:49.737 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:51:49] "OPTIONS / HTTP/1.0" 200 134 0.000432
Sep 28 12:51:50 ctl02 glance-api[29183]: 2017-09-28 12:51:50.645 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:51:50] "OPTIONS / HTTP/1.0" 200 134 0.000651
Sep 28 12:51:50 ctl02 heat-api[13008]: 2017-09-28 12:51:50.652 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:51:50] "OPTIONS / HTTP/1.0" 200 134 0.000617
Sep 28 12:51:50 ctl02 nova-api[10555]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:51:50 ctl02 nova-api[10555]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:51:50 ctl02 nova-api[10555]: 2017-09-28 12:51:50.979 10555 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:51:50 ctl02 nova-api[10555]: 2017-09-28 12:51:50.981 10555 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:51:50 ctl02 nova-api[10555]: 2017-09-28 12:51:50.981 10555 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:51:50 ctl02 nova-api[10555]: 2017-09-28 12:51:50.981 10555 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:51:50 ctl02 nova-api[10555]: 2017-09-28 12:51:50.981 10555 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:51:50 ctl02 nova-api[10555]: 2017-09-28 12:51:50.981 10555 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:51:50 ctl02 nova-api[10555]: 2017-09-28 12:51:50.981 10555 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:51:50 ctl02 nova-api[10555]: 2017-09-28 12:51:50.981 10555 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:51:50 ctl02 nova-api[10555]: 2017-09-28 12:51:50.981 10555 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:51:50 ctl02 nova-api[10555]: 2017-09-28 12:51:50.981 10555 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:51:50 ctl02 nova-api[10555]: 2017-09-28 12:51:50.981 10555 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:51:50 ctl02 nova-api[10555]: 2017-09-28 12:51:50.981 10555 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:51:50 ctl02 nova-api[10555]: 2017-09-28 12:51:50.981 10555 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:51:50 ctl02 nova-api[10555]: 2017-09-28 12:51:50.981 10555 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:51:50 ctl02 nova-api[10555]: 2017-09-28 12:51:50.981 10555 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:51:50 ctl02 nova-api[10555]: 2017-09-28 12:51:50.981 10555 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:51:50 ctl02 nova-api[10555]: 2017-09-28 12:51:50.981 10555 ERROR nova.wsgi     self.filename))
Sep 28 12:51:50 ctl02 nova-api[10555]: 2017-09-28 12:51:50.981 10555 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:51:50 ctl02 nova-api[10555]: 2017-09-28 12:51:50.981 10555 ERROR nova.wsgi
Sep 28 12:51:50 ctl02 nova-api[10555]: 2017-09-28 12:51:50.983 10555 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:51:51 ctl02 neutron-server[30536]: 2017-09-28 12:51:51.081 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:51:51] "OPTIONS / HTTP/1.0" 200 262 0.000492
Sep 28 12:51:51 ctl02 nova-conductor[5056]: 2017-09-28 12:51:51.091 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:51:51 ctl02 nova-conductor[5056]: 2017-09-28 12:51:51.107 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:51:51 ctl02 nova-api[10555]: 2017-09-28 12:51:51.120 10555 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:51:51 ctl02 nova-conductor[5056]: 2017-09-28 12:51:51.135 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:51:51 ctl02 nova-conductor[5056]: 2017-09-28 12:51:51.139 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:51:51 ctl02 neutron-server[30536]: 2017-09-28 12:51:51.169 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 12:51:51 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:51:51 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:50:56 cmp002
Sep 28 12:51:51 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:50:00 cmp002
Sep 28 12:51:51 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:50:16 cmp002
Sep 28 12:51:51 ctl02 nova-cert[4860]: 2017-09-28 12:51:51.256 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:51:51 ctl02 nova-api[10555]: 2017-09-28 12:51:51.357 10555 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:51:51 ctl02 nova-api[10555]: 2017-09-28 12:51:51.359 10555 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:51:51 ctl02 nova-api[10555]: 2017-09-28 12:51:51.359 10555 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:51:51 ctl02 nova-api[10555]: 2017-09-28 12:51:51.359 10555 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:51:51 ctl02 glance-api[29183]: 2017-09-28 12:51:51.441 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:51:51] "OPTIONS / HTTP/1.0" 200 134 0.000557
Sep 28 12:51:51 ctl02 nova-api[10555]: 2017-09-28 12:51:51.492 10555 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:51:51 ctl02 nova-api[10555]: 2017-09-28 12:51:51.494 10555 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:51:51 ctl02 nova-api[10555]: 2017-09-28 12:51:51.495 10555 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:51:51 ctl02 nova-api[10555]: 2017-09-28 12:51:51.495 10555 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:51:51 ctl02 nova-api[10555]: 2017-09-28 12:51:51.499 10555 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:51:51 ctl02 nova-api[10555]: 2017-09-28 12:51:51.499 10555 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:51:51 ctl02 nova-api[10555]: 2017-09-28 12:51:51.499 10555 ERROR nova Traceback (most recent call last):
Sep 28 12:51:51 ctl02 nova-api[10555]: 2017-09-28 12:51:51.499 10555 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:51:51 ctl02 nova-api[10555]: 2017-09-28 12:51:51.499 10555 ERROR nova     sys.exit(main())
Sep 28 12:51:51 ctl02 nova-api[10555]: 2017-09-28 12:51:51.499 10555 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:51:51 ctl02 nova-api[10555]: 2017-09-28 12:51:51.499 10555 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:51:51 ctl02 nova-api[10555]: 2017-09-28 12:51:51.499 10555 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:51:51 ctl02 nova-api[10555]: 2017-09-28 12:51:51.499 10555 ERROR nova     max_url_len=max_url_len)
Sep 28 12:51:51 ctl02 nova-api[10555]: 2017-09-28 12:51:51.499 10555 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:51:51 ctl02 nova-api[10555]: 2017-09-28 12:51:51.499 10555 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:51:51 ctl02 nova-api[10555]: 2017-09-28 12:51:51.499 10555 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:51:51 ctl02 nova-api[10555]: 2017-09-28 12:51:51.499 10555 ERROR nova     sock.listen(backlog)
Sep 28 12:51:51 ctl02 nova-api[10555]: 2017-09-28 12:51:51.499 10555 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:51:51 ctl02 nova-api[10555]: 2017-09-28 12:51:51.499 10555 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:51:51 ctl02 nova-api[10555]: 2017-09-28 12:51:51.499 10555 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:51:51 ctl02 nova-api[10555]: 2017-09-28 12:51:51.499 10555 ERROR nova
Sep 28 12:51:51 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:51:51 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:51:51 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:51:51 ctl02 heat-api-cfn[13300]: 2017-09-28 12:51:51.795 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:51:51] "OPTIONS / HTTP/1.0" 200 134 0.000612
Sep 28 12:51:51 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:51:51 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:51:51 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:51:51 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:51:52 ctl02 neutron-server[30536]: 2017-09-28 12:51:52.572 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:51:52] "OPTIONS / HTTP/1.0" 200 262 0.000545
Sep 28 12:51:52 ctl02 glance-api[29183]: 2017-09-28 12:51:52.880 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:51:52] "OPTIONS / HTTP/1.0" 200 134 0.000677
Sep 28 12:51:53 ctl02 neutron-server[30536]: 2017-09-28 12:51:53.326 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:51:53] "OPTIONS / HTTP/1.0" 200 262 0.000521
Sep 28 12:51:53 ctl02 nova-api[10573]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:51:53 ctl02 nova-api[10573]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:51:53 ctl02 nova-api[10573]: 2017-09-28 12:51:53.798 10573 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:51:53 ctl02 nova-api[10573]: 2017-09-28 12:51:53.800 10573 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:51:53 ctl02 nova-api[10573]: 2017-09-28 12:51:53.800 10573 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:51:53 ctl02 nova-api[10573]: 2017-09-28 12:51:53.800 10573 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:51:53 ctl02 nova-api[10573]: 2017-09-28 12:51:53.800 10573 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:51:53 ctl02 nova-api[10573]: 2017-09-28 12:51:53.800 10573 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:51:53 ctl02 nova-api[10573]: 2017-09-28 12:51:53.800 10573 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:51:53 ctl02 nova-api[10573]: 2017-09-28 12:51:53.800 10573 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:51:53 ctl02 nova-api[10573]: 2017-09-28 12:51:53.800 10573 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:51:53 ctl02 nova-api[10573]: 2017-09-28 12:51:53.800 10573 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:51:53 ctl02 nova-api[10573]: 2017-09-28 12:51:53.800 10573 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:51:53 ctl02 nova-api[10573]: 2017-09-28 12:51:53.800 10573 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:51:53 ctl02 nova-api[10573]: 2017-09-28 12:51:53.800 10573 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:51:53 ctl02 nova-api[10573]: 2017-09-28 12:51:53.800 10573 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:51:53 ctl02 nova-api[10573]: 2017-09-28 12:51:53.800 10573 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:51:53 ctl02 nova-api[10573]: 2017-09-28 12:51:53.800 10573 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:51:53 ctl02 nova-api[10573]: 2017-09-28 12:51:53.800 10573 ERROR nova.wsgi     self.filename))
Sep 28 12:51:53 ctl02 nova-api[10573]: 2017-09-28 12:51:53.800 10573 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:51:53 ctl02 nova-api[10573]: 2017-09-28 12:51:53.800 10573 ERROR nova.wsgi
Sep 28 12:51:53 ctl02 nova-api[10573]: 2017-09-28 12:51:53.801 10573 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:51:53 ctl02 nova-api[10573]: 2017-09-28 12:51:53.932 10573 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:51:54 ctl02 nova-api[10573]: 2017-09-28 12:51:54.179 10573 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:51:54 ctl02 nova-api[10573]: 2017-09-28 12:51:54.181 10573 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:51:54 ctl02 nova-api[10573]: 2017-09-28 12:51:54.182 10573 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:51:54 ctl02 nova-api[10573]: 2017-09-28 12:51:54.182 10573 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:51:54 ctl02 nova-api[10573]: 2017-09-28 12:51:54.315 10573 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:51:54 ctl02 nova-api[10573]: 2017-09-28 12:51:54.317 10573 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:51:54 ctl02 nova-api[10573]: 2017-09-28 12:51:54.317 10573 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:51:54 ctl02 nova-api[10573]: 2017-09-28 12:51:54.317 10573 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:51:54 ctl02 nova-api[10573]: 2017-09-28 12:51:54.321 10573 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:51:54 ctl02 nova-api[10573]: 2017-09-28 12:51:54.321 10573 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:51:54 ctl02 nova-api[10573]: 2017-09-28 12:51:54.321 10573 ERROR nova Traceback (most recent call last):
Sep 28 12:51:54 ctl02 nova-api[10573]: 2017-09-28 12:51:54.321 10573 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:51:54 ctl02 nova-api[10573]: 2017-09-28 12:51:54.321 10573 ERROR nova     sys.exit(main())
Sep 28 12:51:54 ctl02 nova-api[10573]: 2017-09-28 12:51:54.321 10573 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:51:54 ctl02 nova-api[10573]: 2017-09-28 12:51:54.321 10573 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:51:54 ctl02 nova-api[10573]: 2017-09-28 12:51:54.321 10573 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:51:54 ctl02 nova-api[10573]: 2017-09-28 12:51:54.321 10573 ERROR nova     max_url_len=max_url_len)
Sep 28 12:51:54 ctl02 nova-api[10573]: 2017-09-28 12:51:54.321 10573 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:51:54 ctl02 nova-api[10573]: 2017-09-28 12:51:54.321 10573 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:51:54 ctl02 nova-api[10573]: 2017-09-28 12:51:54.321 10573 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:51:54 ctl02 nova-api[10573]: 2017-09-28 12:51:54.321 10573 ERROR nova     sock.listen(backlog)
Sep 28 12:51:54 ctl02 nova-api[10573]: 2017-09-28 12:51:54.321 10573 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:51:54 ctl02 nova-api[10573]: 2017-09-28 12:51:54.321 10573 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:51:54 ctl02 nova-api[10573]: 2017-09-28 12:51:54.321 10573 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:51:54 ctl02 nova-api[10573]: 2017-09-28 12:51:54.321 10573 ERROR nova
Sep 28 12:51:54 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:51:54 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:51:54 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:51:54 ctl02 heat-api[13008]: 2017-09-28 12:51:54.541 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:51:54] "OPTIONS / HTTP/1.0" 200 134 0.000625
Sep 28 12:51:54 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:51:54 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:51:54 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:51:54 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:51:56 ctl02 neutron-server[30536]: 2017-09-28 12:51:56.259 30603 WARNING oslo_messaging._drivers.amqpdriver [req-9ab51703-16bb-4bb7-8bbc-3fe47316893c - - - - -] reply_74787a9d28524b7f9c3c98994688cba9 doesn't exists, drop reply to 884e420bfdb146eb8c9886ea1a580094
Sep 28 12:51:56 ctl02 neutron-server[30536]: 2017-09-28 12:51:56.260 30603 INFO oslo_messaging._drivers.amqpdriver [req-9ab51703-16bb-4bb7-8bbc-3fe47316893c - - - - -] The reply 884e420bfdb146eb8c9886ea1a580094 cannot be sent  reply_74787a9d28524b7f9c3c98994688cba9 reply queue don't exist after 60 sec abandoning...
Sep 28 12:51:56 ctl02 nova-api[10590]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:51:56 ctl02 nova-api[10590]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:51:56 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:51:56.407 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:51:56] "OPTIONS / HTTP/1.0" 200 134 0.000453
Sep 28 12:51:56 ctl02 nova-api[10590]: 2017-09-28 12:51:56.522 10590 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:51:56 ctl02 nova-api[10590]: 2017-09-28 12:51:56.524 10590 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:51:56 ctl02 nova-api[10590]: 2017-09-28 12:51:56.524 10590 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:51:56 ctl02 nova-api[10590]: 2017-09-28 12:51:56.524 10590 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:51:56 ctl02 nova-api[10590]: 2017-09-28 12:51:56.524 10590 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:51:56 ctl02 nova-api[10590]: 2017-09-28 12:51:56.524 10590 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:51:56 ctl02 nova-api[10590]: 2017-09-28 12:51:56.524 10590 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:51:56 ctl02 nova-api[10590]: 2017-09-28 12:51:56.524 10590 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:51:56 ctl02 nova-api[10590]: 2017-09-28 12:51:56.524 10590 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:51:56 ctl02 nova-api[10590]: 2017-09-28 12:51:56.524 10590 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:51:56 ctl02 nova-api[10590]: 2017-09-28 12:51:56.524 10590 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:51:56 ctl02 nova-api[10590]: 2017-09-28 12:51:56.524 10590 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:51:56 ctl02 nova-api[10590]: 2017-09-28 12:51:56.524 10590 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:51:56 ctl02 nova-api[10590]: 2017-09-28 12:51:56.524 10590 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:51:56 ctl02 nova-api[10590]: 2017-09-28 12:51:56.524 10590 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:51:56 ctl02 nova-api[10590]: 2017-09-28 12:51:56.524 10590 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:51:56 ctl02 nova-api[10590]: 2017-09-28 12:51:56.524 10590 ERROR nova.wsgi     self.filename))
Sep 28 12:51:56 ctl02 nova-api[10590]: 2017-09-28 12:51:56.524 10590 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:51:56 ctl02 nova-api[10590]: 2017-09-28 12:51:56.524 10590 ERROR nova.wsgi
Sep 28 12:51:56 ctl02 nova-api[10590]: 2017-09-28 12:51:56.526 10590 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:51:56 ctl02 nova-api[10590]: 2017-09-28 12:51:56.662 10590 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:51:56 ctl02 heat-api[13008]: 2017-09-28 12:51:56.880 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:51:56] "OPTIONS / HTTP/1.0" 200 134 0.000650
Sep 28 12:51:56 ctl02 nova-api[10590]: 2017-09-28 12:51:56.902 10590 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:51:56 ctl02 nova-api[10590]: 2017-09-28 12:51:56.905 10590 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:51:56 ctl02 nova-api[10590]: 2017-09-28 12:51:56.905 10590 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:51:56 ctl02 nova-api[10590]: 2017-09-28 12:51:56.905 10590 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:51:56 ctl02 heat-api-cfn[13300]: 2017-09-28 12:51:56.980 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:51:56] "OPTIONS / HTTP/1.0" 200 134 0.000509
Sep 28 12:51:57 ctl02 nova-api[10590]: 2017-09-28 12:51:57.038 10590 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:51:57 ctl02 nova-api[10590]: 2017-09-28 12:51:57.040 10590 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:51:57 ctl02 nova-api[10590]: 2017-09-28 12:51:57.040 10590 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:51:57 ctl02 nova-api[10590]: 2017-09-28 12:51:57.040 10590 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:51:57 ctl02 nova-api[10590]: 2017-09-28 12:51:57.043 10590 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:51:57 ctl02 nova-api[10590]: 2017-09-28 12:51:57.044 10590 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:51:57 ctl02 nova-api[10590]: 2017-09-28 12:51:57.044 10590 ERROR nova Traceback (most recent call last):
Sep 28 12:51:57 ctl02 nova-api[10590]: 2017-09-28 12:51:57.044 10590 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:51:57 ctl02 nova-api[10590]: 2017-09-28 12:51:57.044 10590 ERROR nova     sys.exit(main())
Sep 28 12:51:57 ctl02 nova-api[10590]: 2017-09-28 12:51:57.044 10590 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:51:57 ctl02 nova-api[10590]: 2017-09-28 12:51:57.044 10590 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:51:57 ctl02 nova-api[10590]: 2017-09-28 12:51:57.044 10590 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:51:57 ctl02 nova-api[10590]: 2017-09-28 12:51:57.044 10590 ERROR nova     max_url_len=max_url_len)
Sep 28 12:51:57 ctl02 nova-api[10590]: 2017-09-28 12:51:57.044 10590 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:51:57 ctl02 nova-api[10590]: 2017-09-28 12:51:57.044 10590 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:51:57 ctl02 nova-api[10590]: 2017-09-28 12:51:57.044 10590 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:51:57 ctl02 nova-api[10590]: 2017-09-28 12:51:57.044 10590 ERROR nova     sock.listen(backlog)
Sep 28 12:51:57 ctl02 nova-api[10590]: 2017-09-28 12:51:57.044 10590 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:51:57 ctl02 nova-api[10590]: 2017-09-28 12:51:57.044 10590 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:51:57 ctl02 nova-api[10590]: 2017-09-28 12:51:57.044 10590 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:51:57 ctl02 nova-api[10590]: 2017-09-28 12:51:57.044 10590 ERROR nova
Sep 28 12:51:57 ctl02 dhclient[600]: DHCPREQUEST of 192.168.11.25 on ens2 to 192.168.11.3 port 67 (xid=0x3415f07)
Sep 28 12:51:57 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:51:57 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:51:57 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:51:57 ctl02 dhclient[600]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 12:51:57 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 12:51:57 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:51:57 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:51:57.290 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:51:57] "OPTIONS / HTTP/1.0" 200 134 0.000395
Sep 28 12:51:57 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:51:57 ctl02 ntp[10658]:  * Stopping NTP server ntpd
Sep 28 12:51:57 ctl02 ntp[10658]:    ...done.
Sep 28 12:51:57 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 12:51:57 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 12:51:57 ctl02 ntp[10669]:  * Starting NTP server ntpd
Sep 28 12:51:57 ctl02 ntpd[10676]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 12:51:57 ctl02 ntpd[10676]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -c /var/lib/ntp/ntp.conf.dhcp -u 108:112
Sep 28 12:51:57 ctl02 ntp[10669]:    ...done.
Sep 28 12:51:57 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 12:51:57 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:51:57 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:51:57 ctl02 ntpd[10679]: proto: precision = 0.042 usec (-24)
Sep 28 12:51:57 ctl02 ntpd[10679]: switching logging to file /var/log/ntp.log
Sep 28 12:51:57 ctl02 dhclient[600]: bound to 192.168.11.25 -- renewal in 272 seconds.
Sep 28 12:51:57 ctl02 heat-api-cfn[13300]: 2017-09-28 12:51:57.873 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:51:57] "OPTIONS / HTTP/1.0" 200 134 0.000462
Sep 28 12:51:58 ctl02 nova-api[10689]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:51:58 ctl02 nova-api[10689]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:51:59 ctl02 nova-api[10689]: 2017-09-28 12:51:59.164 10689 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:51:59 ctl02 nova-api[10689]: 2017-09-28 12:51:59.166 10689 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:51:59 ctl02 nova-api[10689]: 2017-09-28 12:51:59.166 10689 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:51:59 ctl02 nova-api[10689]: 2017-09-28 12:51:59.166 10689 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:51:59 ctl02 nova-api[10689]: 2017-09-28 12:51:59.166 10689 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:51:59 ctl02 nova-api[10689]: 2017-09-28 12:51:59.166 10689 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:51:59 ctl02 nova-api[10689]: 2017-09-28 12:51:59.166 10689 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:51:59 ctl02 nova-api[10689]: 2017-09-28 12:51:59.166 10689 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:51:59 ctl02 nova-api[10689]: 2017-09-28 12:51:59.166 10689 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:51:59 ctl02 nova-api[10689]: 2017-09-28 12:51:59.166 10689 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:51:59 ctl02 nova-api[10689]: 2017-09-28 12:51:59.166 10689 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:51:59 ctl02 nova-api[10689]: 2017-09-28 12:51:59.166 10689 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:51:59 ctl02 nova-api[10689]: 2017-09-28 12:51:59.166 10689 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:51:59 ctl02 nova-api[10689]: 2017-09-28 12:51:59.166 10689 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:51:59 ctl02 nova-api[10689]: 2017-09-28 12:51:59.166 10689 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:51:59 ctl02 nova-api[10689]: 2017-09-28 12:51:59.166 10689 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:51:59 ctl02 nova-api[10689]: 2017-09-28 12:51:59.166 10689 ERROR nova.wsgi     self.filename))
Sep 28 12:51:59 ctl02 nova-api[10689]: 2017-09-28 12:51:59.166 10689 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:51:59 ctl02 nova-api[10689]: 2017-09-28 12:51:59.166 10689 ERROR nova.wsgi
Sep 28 12:51:59 ctl02 nova-api[10689]: 2017-09-28 12:51:59.167 10689 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:51:59 ctl02 nova-api[10689]: 2017-09-28 12:51:59.306 10689 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:51:59 ctl02 nova-api[10689]: 2017-09-28 12:51:59.557 10689 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:51:59 ctl02 nova-api[10689]: 2017-09-28 12:51:59.560 10689 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:51:59 ctl02 nova-api[10689]: 2017-09-28 12:51:59.560 10689 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:51:59 ctl02 nova-api[10689]: 2017-09-28 12:51:59.560 10689 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:51:59 ctl02 nova-api[10689]: 2017-09-28 12:51:59.695 10689 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:51:59 ctl02 nova-api[10689]: 2017-09-28 12:51:59.697 10689 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:51:59 ctl02 nova-api[10689]: 2017-09-28 12:51:59.697 10689 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:51:59 ctl02 nova-api[10689]: 2017-09-28 12:51:59.698 10689 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:51:59 ctl02 nova-api[10689]: 2017-09-28 12:51:59.701 10689 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:51:59 ctl02 nova-api[10689]: 2017-09-28 12:51:59.701 10689 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:51:59 ctl02 nova-api[10689]: 2017-09-28 12:51:59.701 10689 ERROR nova Traceback (most recent call last):
Sep 28 12:51:59 ctl02 nova-api[10689]: 2017-09-28 12:51:59.701 10689 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:51:59 ctl02 nova-api[10689]: 2017-09-28 12:51:59.701 10689 ERROR nova     sys.exit(main())
Sep 28 12:51:59 ctl02 nova-api[10689]: 2017-09-28 12:51:59.701 10689 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:51:59 ctl02 nova-api[10689]: 2017-09-28 12:51:59.701 10689 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:51:59 ctl02 nova-api[10689]: 2017-09-28 12:51:59.701 10689 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:51:59 ctl02 nova-api[10689]: 2017-09-28 12:51:59.701 10689 ERROR nova     max_url_len=max_url_len)
Sep 28 12:51:59 ctl02 nova-api[10689]: 2017-09-28 12:51:59.701 10689 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:51:59 ctl02 nova-api[10689]: 2017-09-28 12:51:59.701 10689 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:51:59 ctl02 nova-api[10689]: 2017-09-28 12:51:59.701 10689 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:51:59 ctl02 nova-api[10689]: 2017-09-28 12:51:59.701 10689 ERROR nova     sock.listen(backlog)
Sep 28 12:51:59 ctl02 nova-api[10689]: 2017-09-28 12:51:59.701 10689 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:51:59 ctl02 nova-api[10689]: 2017-09-28 12:51:59.701 10689 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:51:59 ctl02 nova-api[10689]: 2017-09-28 12:51:59.701 10689 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:51:59 ctl02 nova-api[10689]: 2017-09-28 12:51:59.701 10689 ERROR nova
Sep 28 12:51:59 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:51:59 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:51:59 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:51:59 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:51:59.947 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:51:59] "OPTIONS / HTTP/1.0" 200 134 0.000481
Sep 28 12:52:00 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:52:00 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:52:00 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:52:00 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:52:00 ctl02 glance-api[29183]: 2017-09-28 12:52:00.461 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:52:00] "OPTIONS / HTTP/1.0" 200 134 0.000586
Sep 28 12:52:01 ctl02 heat-api[13008]: 2017-09-28 12:52:01.041 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:52:01] "OPTIONS / HTTP/1.0" 200 134 0.000667
Sep 28 12:52:01 ctl02 nova-consoleauth[5433]: 2017-09-28 12:52:01.101 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:52:01 ctl02 neutron-server[30536]: 2017-09-28 12:52:01.163 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:52:01] "OPTIONS / HTTP/1.0" 200 262 0.000446
Sep 28 12:52:01 ctl02 heat-api-cfn[13300]: 2017-09-28 12:52:01.519 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:52:01] "OPTIONS / HTTP/1.0" 200 134 0.000542
Sep 28 12:52:01 ctl02 glance-api[29183]: 2017-09-28 12:52:01.563 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:52:01] "OPTIONS / HTTP/1.0" 200 134 0.000534
Sep 28 12:52:01 ctl02 nova-api[10709]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:52:01 ctl02 nova-api[10709]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:52:01 ctl02 nova-api[10709]: 2017-09-28 12:52:01.974 10709 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:52:01 ctl02 nova-api[10709]: 2017-09-28 12:52:01.975 10709 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:52:01 ctl02 nova-api[10709]: 2017-09-28 12:52:01.975 10709 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:52:01 ctl02 nova-api[10709]: 2017-09-28 12:52:01.975 10709 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:52:01 ctl02 nova-api[10709]: 2017-09-28 12:52:01.975 10709 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:52:01 ctl02 nova-api[10709]: 2017-09-28 12:52:01.975 10709 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:52:01 ctl02 nova-api[10709]: 2017-09-28 12:52:01.975 10709 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:52:01 ctl02 nova-api[10709]: 2017-09-28 12:52:01.975 10709 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:52:01 ctl02 nova-api[10709]: 2017-09-28 12:52:01.975 10709 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:52:01 ctl02 nova-api[10709]: 2017-09-28 12:52:01.975 10709 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:52:01 ctl02 nova-api[10709]: 2017-09-28 12:52:01.975 10709 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:52:01 ctl02 nova-api[10709]: 2017-09-28 12:52:01.975 10709 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:52:01 ctl02 nova-api[10709]: 2017-09-28 12:52:01.975 10709 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:52:01 ctl02 nova-api[10709]: 2017-09-28 12:52:01.975 10709 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:52:01 ctl02 nova-api[10709]: 2017-09-28 12:52:01.975 10709 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:52:01 ctl02 nova-api[10709]: 2017-09-28 12:52:01.975 10709 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:52:01 ctl02 nova-api[10709]: 2017-09-28 12:52:01.975 10709 ERROR nova.wsgi     self.filename))
Sep 28 12:52:01 ctl02 nova-api[10709]: 2017-09-28 12:52:01.975 10709 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:52:01 ctl02 nova-api[10709]: 2017-09-28 12:52:01.975 10709 ERROR nova.wsgi
Sep 28 12:52:01 ctl02 nova-api[10709]: 2017-09-28 12:52:01.976 10709 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:52:02 ctl02 nova-api[10709]: 2017-09-28 12:52:02.103 10709 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:52:02 ctl02 heat-engine[12803]: 2017-09-28 12:52:02.242 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:52:02 ctl02 heat-engine[12803]: 2017-09-28 12:52:02.248 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:52:02 ctl02 heat-engine[12803]: 2017-09-28 12:52:02.252 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:52:02 ctl02 heat-engine[12803]: 2017-09-28 12:52:02.257 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:52:02 ctl02 nova-api[10709]: 2017-09-28 12:52:02.325 10709 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:52:02 ctl02 nova-api[10709]: 2017-09-28 12:52:02.327 10709 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:52:02 ctl02 nova-api[10709]: 2017-09-28 12:52:02.334 10709 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:52:02 ctl02 nova-api[10709]: 2017-09-28 12:52:02.334 10709 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:52:02 ctl02 neutron-server[30536]: 2017-09-28 12:52:02.456 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:52:02] "OPTIONS / HTTP/1.0" 200 262 0.000516
Sep 28 12:52:02 ctl02 nova-api[10709]: 2017-09-28 12:52:02.469 10709 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:52:02 ctl02 nova-api[10709]: 2017-09-28 12:52:02.471 10709 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:52:02 ctl02 nova-api[10709]: 2017-09-28 12:52:02.471 10709 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:52:02 ctl02 nova-api[10709]: 2017-09-28 12:52:02.472 10709 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:52:02 ctl02 nova-api[10709]: 2017-09-28 12:52:02.476 10709 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:52:02 ctl02 nova-api[10709]: 2017-09-28 12:52:02.476 10709 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:52:02 ctl02 nova-api[10709]: 2017-09-28 12:52:02.476 10709 ERROR nova Traceback (most recent call last):
Sep 28 12:52:02 ctl02 nova-api[10709]: 2017-09-28 12:52:02.476 10709 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:52:02 ctl02 nova-api[10709]: 2017-09-28 12:52:02.476 10709 ERROR nova     sys.exit(main())
Sep 28 12:52:02 ctl02 nova-api[10709]: 2017-09-28 12:52:02.476 10709 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:52:02 ctl02 nova-api[10709]: 2017-09-28 12:52:02.476 10709 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:52:02 ctl02 nova-api[10709]: 2017-09-28 12:52:02.476 10709 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:52:02 ctl02 nova-api[10709]: 2017-09-28 12:52:02.476 10709 ERROR nova     max_url_len=max_url_len)
Sep 28 12:52:02 ctl02 nova-api[10709]: 2017-09-28 12:52:02.476 10709 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:52:02 ctl02 nova-api[10709]: 2017-09-28 12:52:02.476 10709 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:52:02 ctl02 nova-api[10709]: 2017-09-28 12:52:02.476 10709 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:52:02 ctl02 nova-api[10709]: 2017-09-28 12:52:02.476 10709 ERROR nova     sock.listen(backlog)
Sep 28 12:52:02 ctl02 nova-api[10709]: 2017-09-28 12:52:02.476 10709 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:52:02 ctl02 nova-api[10709]: 2017-09-28 12:52:02.476 10709 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:52:02 ctl02 nova-api[10709]: 2017-09-28 12:52:02.476 10709 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:52:02 ctl02 nova-api[10709]: 2017-09-28 12:52:02.476 10709 ERROR nova
Sep 28 12:52:02 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:52:02 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:52:02 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:52:02 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:52:02 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:52:02 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:52:02 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:52:03 ctl02 glance-api[29183]: 2017-09-28 12:52:03.217 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:52:03] "OPTIONS / HTTP/1.0" 200 134 0.000643
Sep 28 12:52:03 ctl02 neutron-server[30536]: 2017-09-28 12:52:03.320 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:52:03] "OPTIONS / HTTP/1.0" 200 262 0.000518
Sep 28 12:52:04 ctl02 nova-scheduler[5620]: 2017-09-28 12:52:04.199 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:52:04 ctl02 heat-api[13008]: 2017-09-28 12:52:04.463 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:52:04] "OPTIONS / HTTP/1.0" 200 134 0.000634
Sep 28 12:52:04 ctl02 nova-api[10728]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:52:04 ctl02 nova-api[10728]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:52:04 ctl02 nova-api[10728]: 2017-09-28 12:52:04.777 10728 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:52:04 ctl02 nova-api[10728]: 2017-09-28 12:52:04.779 10728 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:52:04 ctl02 nova-api[10728]: 2017-09-28 12:52:04.779 10728 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:52:04 ctl02 nova-api[10728]: 2017-09-28 12:52:04.779 10728 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:52:04 ctl02 nova-api[10728]: 2017-09-28 12:52:04.779 10728 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:52:04 ctl02 nova-api[10728]: 2017-09-28 12:52:04.779 10728 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:52:04 ctl02 nova-api[10728]: 2017-09-28 12:52:04.779 10728 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:52:04 ctl02 nova-api[10728]: 2017-09-28 12:52:04.779 10728 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:52:04 ctl02 nova-api[10728]: 2017-09-28 12:52:04.779 10728 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:52:04 ctl02 nova-api[10728]: 2017-09-28 12:52:04.779 10728 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:52:04 ctl02 nova-api[10728]: 2017-09-28 12:52:04.779 10728 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:52:04 ctl02 nova-api[10728]: 2017-09-28 12:52:04.779 10728 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:52:04 ctl02 nova-api[10728]: 2017-09-28 12:52:04.779 10728 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:52:04 ctl02 nova-api[10728]: 2017-09-28 12:52:04.779 10728 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:52:04 ctl02 nova-api[10728]: 2017-09-28 12:52:04.779 10728 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:52:04 ctl02 nova-api[10728]: 2017-09-28 12:52:04.779 10728 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:52:04 ctl02 nova-api[10728]: 2017-09-28 12:52:04.779 10728 ERROR nova.wsgi     self.filename))
Sep 28 12:52:04 ctl02 nova-api[10728]: 2017-09-28 12:52:04.779 10728 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:52:04 ctl02 nova-api[10728]: 2017-09-28 12:52:04.779 10728 ERROR nova.wsgi
Sep 28 12:52:04 ctl02 nova-api[10728]: 2017-09-28 12:52:04.781 10728 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:52:04 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdd495e0b)
Sep 28 12:52:04 ctl02 nova-api[10728]: 2017-09-28 12:52:04.913 10728 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:52:05 ctl02 nova-api[10728]: 2017-09-28 12:52:05.155 10728 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:52:05 ctl02 nova-api[10728]: 2017-09-28 12:52:05.157 10728 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:52:05 ctl02 nova-api[10728]: 2017-09-28 12:52:05.158 10728 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:52:05 ctl02 nova-api[10728]: 2017-09-28 12:52:05.158 10728 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:52:05 ctl02 nova-api[10728]: 2017-09-28 12:52:05.292 10728 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:52:05 ctl02 nova-api[10728]: 2017-09-28 12:52:05.295 10728 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:52:05 ctl02 nova-api[10728]: 2017-09-28 12:52:05.296 10728 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:52:05 ctl02 nova-api[10728]: 2017-09-28 12:52:05.296 10728 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:52:05 ctl02 nova-api[10728]: 2017-09-28 12:52:05.300 10728 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:52:05 ctl02 nova-api[10728]: 2017-09-28 12:52:05.300 10728 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:52:05 ctl02 nova-api[10728]: 2017-09-28 12:52:05.300 10728 ERROR nova Traceback (most recent call last):
Sep 28 12:52:05 ctl02 nova-api[10728]: 2017-09-28 12:52:05.300 10728 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:52:05 ctl02 nova-api[10728]: 2017-09-28 12:52:05.300 10728 ERROR nova     sys.exit(main())
Sep 28 12:52:05 ctl02 nova-api[10728]: 2017-09-28 12:52:05.300 10728 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:52:05 ctl02 nova-api[10728]: 2017-09-28 12:52:05.300 10728 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:52:05 ctl02 nova-api[10728]: 2017-09-28 12:52:05.300 10728 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:52:05 ctl02 nova-api[10728]: 2017-09-28 12:52:05.300 10728 ERROR nova     max_url_len=max_url_len)
Sep 28 12:52:05 ctl02 nova-api[10728]: 2017-09-28 12:52:05.300 10728 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:52:05 ctl02 nova-api[10728]: 2017-09-28 12:52:05.300 10728 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:52:05 ctl02 nova-api[10728]: 2017-09-28 12:52:05.300 10728 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:52:05 ctl02 nova-api[10728]: 2017-09-28 12:52:05.300 10728 ERROR nova     sock.listen(backlog)
Sep 28 12:52:05 ctl02 nova-api[10728]: 2017-09-28 12:52:05.300 10728 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:52:05 ctl02 nova-api[10728]: 2017-09-28 12:52:05.300 10728 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:52:05 ctl02 nova-api[10728]: 2017-09-28 12:52:05.300 10728 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:52:05 ctl02 nova-api[10728]: 2017-09-28 12:52:05.300 10728 ERROR nova
Sep 28 12:52:05 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:52:05 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:52:05 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:52:05 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:52:05 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:52:05 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:52:05 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:52:05 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdd495e0b)
Sep 28 12:52:06 ctl02 neutron-server[30536]: 2017-09-28 12:52:06.166 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 2 dead agents out of 6:
Sep 28 12:52:06 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:52:06 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:50:56 cmp002
Sep 28 12:52:06 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:50:16 cmp002
Sep 28 12:52:06 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:52:06.652 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:52:06] "OPTIONS / HTTP/1.0" 200 134 0.000503
Sep 28 12:52:06 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdd495e0b)
Sep 28 12:52:06 ctl02 heat-api-cfn[13300]: 2017-09-28 12:52:06.910 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:52:06] "OPTIONS / HTTP/1.0" 200 134 0.000525
Sep 28 12:52:06 ctl02 heat-api[13008]: 2017-09-28 12:52:06.925 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:52:06] "OPTIONS / HTTP/1.0" 200 134 0.000587
Sep 28 12:52:07 ctl02 nova-api[10746]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:52:07 ctl02 nova-api[10746]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:52:07 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:52:07.489 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:52:07] "OPTIONS / HTTP/1.0" 200 134 0.000386
Sep 28 12:52:07 ctl02 heat-api-cfn[13300]: 2017-09-28 12:52:07.531 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:52:07] "OPTIONS / HTTP/1.0" 200 134 0.000486
Sep 28 12:52:07 ctl02 nova-api[10746]: 2017-09-28 12:52:07.540 10746 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:52:07 ctl02 nova-api[10746]: 2017-09-28 12:52:07.542 10746 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:52:07 ctl02 nova-api[10746]: 2017-09-28 12:52:07.542 10746 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:52:07 ctl02 nova-api[10746]: 2017-09-28 12:52:07.542 10746 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:52:07 ctl02 nova-api[10746]: 2017-09-28 12:52:07.542 10746 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:52:07 ctl02 nova-api[10746]: 2017-09-28 12:52:07.542 10746 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:52:07 ctl02 nova-api[10746]: 2017-09-28 12:52:07.542 10746 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:52:07 ctl02 nova-api[10746]: 2017-09-28 12:52:07.542 10746 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:52:07 ctl02 nova-api[10746]: 2017-09-28 12:52:07.542 10746 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:52:07 ctl02 nova-api[10746]: 2017-09-28 12:52:07.542 10746 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:52:07 ctl02 nova-api[10746]: 2017-09-28 12:52:07.542 10746 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:52:07 ctl02 nova-api[10746]: 2017-09-28 12:52:07.542 10746 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:52:07 ctl02 nova-api[10746]: 2017-09-28 12:52:07.542 10746 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:52:07 ctl02 nova-api[10746]: 2017-09-28 12:52:07.542 10746 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:52:07 ctl02 nova-api[10746]: 2017-09-28 12:52:07.542 10746 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:52:07 ctl02 nova-api[10746]: 2017-09-28 12:52:07.542 10746 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:52:07 ctl02 nova-api[10746]: 2017-09-28 12:52:07.542 10746 ERROR nova.wsgi     self.filename))
Sep 28 12:52:07 ctl02 nova-api[10746]: 2017-09-28 12:52:07.542 10746 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:52:07 ctl02 nova-api[10746]: 2017-09-28 12:52:07.542 10746 ERROR nova.wsgi
Sep 28 12:52:07 ctl02 nova-api[10746]: 2017-09-28 12:52:07.543 10746 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:52:07 ctl02 nova-api[10746]: 2017-09-28 12:52:07.675 10746 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:52:07 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdd495e0b)
Sep 28 12:52:07 ctl02 nova-api[10746]: 2017-09-28 12:52:07.924 10746 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:52:07 ctl02 nova-api[10746]: 2017-09-28 12:52:07.926 10746 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:52:07 ctl02 nova-api[10746]: 2017-09-28 12:52:07.926 10746 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:52:07 ctl02 nova-api[10746]: 2017-09-28 12:52:07.926 10746 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:52:08 ctl02 nova-api[10746]: 2017-09-28 12:52:08.058 10746 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:52:08 ctl02 nova-api[10746]: 2017-09-28 12:52:08.060 10746 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:52:08 ctl02 nova-api[10746]: 2017-09-28 12:52:08.060 10746 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:52:08 ctl02 nova-api[10746]: 2017-09-28 12:52:08.060 10746 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:52:08 ctl02 nova-api[10746]: 2017-09-28 12:52:08.064 10746 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:52:08 ctl02 nova-api[10746]: 2017-09-28 12:52:08.064 10746 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:52:08 ctl02 nova-api[10746]: 2017-09-28 12:52:08.064 10746 ERROR nova Traceback (most recent call last):
Sep 28 12:52:08 ctl02 nova-api[10746]: 2017-09-28 12:52:08.064 10746 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:52:08 ctl02 nova-api[10746]: 2017-09-28 12:52:08.064 10746 ERROR nova     sys.exit(main())
Sep 28 12:52:08 ctl02 nova-api[10746]: 2017-09-28 12:52:08.064 10746 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:52:08 ctl02 nova-api[10746]: 2017-09-28 12:52:08.064 10746 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:52:08 ctl02 nova-api[10746]: 2017-09-28 12:52:08.064 10746 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:52:08 ctl02 nova-api[10746]: 2017-09-28 12:52:08.064 10746 ERROR nova     max_url_len=max_url_len)
Sep 28 12:52:08 ctl02 nova-api[10746]: 2017-09-28 12:52:08.064 10746 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:52:08 ctl02 nova-api[10746]: 2017-09-28 12:52:08.064 10746 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:52:08 ctl02 nova-api[10746]: 2017-09-28 12:52:08.064 10746 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:52:08 ctl02 nova-api[10746]: 2017-09-28 12:52:08.064 10746 ERROR nova     sock.listen(backlog)
Sep 28 12:52:08 ctl02 nova-api[10746]: 2017-09-28 12:52:08.064 10746 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:52:08 ctl02 nova-api[10746]: 2017-09-28 12:52:08.064 10746 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:52:08 ctl02 nova-api[10746]: 2017-09-28 12:52:08.064 10746 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:52:08 ctl02 nova-api[10746]: 2017-09-28 12:52:08.064 10746 ERROR nova
Sep 28 12:52:08 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:52:08 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:52:08 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:52:08 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:52:08 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:52:08 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:52:08 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:52:08 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdd495e0b)
Sep 28 12:52:09 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:52:09.819 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:52:09] "OPTIONS / HTTP/1.0" 200 134 0.000466
Sep 28 12:52:09 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdd495e0b)
Sep 28 12:52:10 ctl02 nova-api[10763]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:52:10 ctl02 nova-api[10763]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:52:10 ctl02 glance-api[29183]: 2017-09-28 12:52:10.277 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:52:10] "OPTIONS / HTTP/1.0" 200 134 0.000693
Sep 28 12:52:10 ctl02 nova-api[10763]: 2017-09-28 12:52:10.289 10763 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:52:10 ctl02 nova-api[10763]: 2017-09-28 12:52:10.290 10763 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:52:10 ctl02 nova-api[10763]: 2017-09-28 12:52:10.290 10763 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:52:10 ctl02 nova-api[10763]: 2017-09-28 12:52:10.290 10763 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:52:10 ctl02 nova-api[10763]: 2017-09-28 12:52:10.290 10763 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:52:10 ctl02 nova-api[10763]: 2017-09-28 12:52:10.290 10763 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:52:10 ctl02 nova-api[10763]: 2017-09-28 12:52:10.290 10763 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:52:10 ctl02 nova-api[10763]: 2017-09-28 12:52:10.290 10763 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:52:10 ctl02 nova-api[10763]: 2017-09-28 12:52:10.290 10763 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:52:10 ctl02 nova-api[10763]: 2017-09-28 12:52:10.290 10763 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:52:10 ctl02 nova-api[10763]: 2017-09-28 12:52:10.290 10763 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:52:10 ctl02 nova-api[10763]: 2017-09-28 12:52:10.290 10763 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:52:10 ctl02 nova-api[10763]: 2017-09-28 12:52:10.290 10763 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:52:10 ctl02 nova-api[10763]: 2017-09-28 12:52:10.290 10763 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:52:10 ctl02 nova-api[10763]: 2017-09-28 12:52:10.290 10763 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:52:10 ctl02 nova-api[10763]: 2017-09-28 12:52:10.290 10763 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:52:10 ctl02 nova-api[10763]: 2017-09-28 12:52:10.290 10763 ERROR nova.wsgi     self.filename))
Sep 28 12:52:10 ctl02 nova-api[10763]: 2017-09-28 12:52:10.290 10763 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:52:10 ctl02 nova-api[10763]: 2017-09-28 12:52:10.290 10763 ERROR nova.wsgi
Sep 28 12:52:10 ctl02 nova-api[10763]: 2017-09-28 12:52:10.293 10763 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:52:10 ctl02 nova-api[10763]: 2017-09-28 12:52:10.443 10763 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:52:10 ctl02 nova-api[10763]: 2017-09-28 12:52:10.669 10763 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:52:10 ctl02 nova-api[10763]: 2017-09-28 12:52:10.672 10763 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:52:10 ctl02 nova-api[10763]: 2017-09-28 12:52:10.672 10763 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:52:10 ctl02 nova-api[10763]: 2017-09-28 12:52:10.673 10763 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:52:10 ctl02 nova-api[10763]: 2017-09-28 12:52:10.807 10763 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:52:10 ctl02 nova-api[10763]: 2017-09-28 12:52:10.809 10763 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:52:10 ctl02 nova-api[10763]: 2017-09-28 12:52:10.810 10763 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:52:10 ctl02 nova-api[10763]: 2017-09-28 12:52:10.810 10763 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:52:10 ctl02 nova-api[10763]: 2017-09-28 12:52:10.814 10763 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:52:10 ctl02 nova-api[10763]: 2017-09-28 12:52:10.814 10763 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:52:10 ctl02 nova-api[10763]: 2017-09-28 12:52:10.814 10763 ERROR nova Traceback (most recent call last):
Sep 28 12:52:10 ctl02 nova-api[10763]: 2017-09-28 12:52:10.814 10763 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:52:10 ctl02 nova-api[10763]: 2017-09-28 12:52:10.814 10763 ERROR nova     sys.exit(main())
Sep 28 12:52:10 ctl02 nova-api[10763]: 2017-09-28 12:52:10.814 10763 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:52:10 ctl02 nova-api[10763]: 2017-09-28 12:52:10.814 10763 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:52:10 ctl02 nova-api[10763]: 2017-09-28 12:52:10.814 10763 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:52:10 ctl02 nova-api[10763]: 2017-09-28 12:52:10.814 10763 ERROR nova     max_url_len=max_url_len)
Sep 28 12:52:10 ctl02 nova-api[10763]: 2017-09-28 12:52:10.814 10763 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:52:10 ctl02 nova-api[10763]: 2017-09-28 12:52:10.814 10763 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:52:10 ctl02 nova-api[10763]: 2017-09-28 12:52:10.814 10763 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:52:10 ctl02 nova-api[10763]: 2017-09-28 12:52:10.814 10763 ERROR nova     sock.listen(backlog)
Sep 28 12:52:10 ctl02 nova-api[10763]: 2017-09-28 12:52:10.814 10763 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:52:10 ctl02 nova-api[10763]: 2017-09-28 12:52:10.814 10763 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:52:10 ctl02 nova-api[10763]: 2017-09-28 12:52:10.814 10763 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:52:10 ctl02 nova-api[10763]: 2017-09-28 12:52:10.814 10763 ERROR nova
Sep 28 12:52:10 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdd495e0b)
Sep 28 12:52:10 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:52:10 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:52:10 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:52:10 ctl02 heat-api[13008]: 2017-09-28 12:52:10.963 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:52:10] "OPTIONS / HTTP/1.0" 200 134 0.000662
Sep 28 12:52:11 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:52:11 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:52:11 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:52:11 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:52:11 ctl02 neutron-server[30536]: 2017-09-28 12:52:11.288 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:52:11] "OPTIONS / HTTP/1.0" 200 262 0.000449
Sep 28 12:52:11 ctl02 heat-api-cfn[13300]: 2017-09-28 12:52:11.659 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:52:11] "OPTIONS / HTTP/1.0" 200 134 0.000435
Sep 28 12:52:11 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdd495e0b)
Sep 28 12:52:11 ctl02 glance-api[29183]: 2017-09-28 12:52:11.904 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:52:11] "OPTIONS / HTTP/1.0" 200 134 0.001109
Sep 28 12:52:12 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdd495e0b)
Sep 28 12:52:12 ctl02 nova-api[10782]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:52:12 ctl02 nova-api[10782]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:52:12 ctl02 neutron-server[30536]: 2017-09-28 12:52:12.834 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:52:12] "OPTIONS / HTTP/1.0" 200 262 0.000594
Sep 28 12:52:12 ctl02 nova-api[10782]: 2017-09-28 12:52:12.993 10782 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:52:12 ctl02 nova-api[10782]: 2017-09-28 12:52:12.995 10782 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:52:12 ctl02 nova-api[10782]: 2017-09-28 12:52:12.995 10782 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:52:12 ctl02 nova-api[10782]: 2017-09-28 12:52:12.995 10782 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:52:12 ctl02 nova-api[10782]: 2017-09-28 12:52:12.995 10782 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:52:12 ctl02 nova-api[10782]: 2017-09-28 12:52:12.995 10782 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:52:12 ctl02 nova-api[10782]: 2017-09-28 12:52:12.995 10782 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:52:12 ctl02 nova-api[10782]: 2017-09-28 12:52:12.995 10782 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:52:12 ctl02 nova-api[10782]: 2017-09-28 12:52:12.995 10782 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:52:12 ctl02 nova-api[10782]: 2017-09-28 12:52:12.995 10782 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:52:12 ctl02 nova-api[10782]: 2017-09-28 12:52:12.995 10782 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:52:12 ctl02 nova-api[10782]: 2017-09-28 12:52:12.995 10782 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:52:12 ctl02 nova-api[10782]: 2017-09-28 12:52:12.995 10782 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:52:12 ctl02 nova-api[10782]: 2017-09-28 12:52:12.995 10782 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:52:12 ctl02 nova-api[10782]: 2017-09-28 12:52:12.995 10782 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:52:12 ctl02 nova-api[10782]: 2017-09-28 12:52:12.995 10782 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:52:12 ctl02 nova-api[10782]: 2017-09-28 12:52:12.995 10782 ERROR nova.wsgi     self.filename))
Sep 28 12:52:12 ctl02 nova-api[10782]: 2017-09-28 12:52:12.995 10782 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:52:12 ctl02 nova-api[10782]: 2017-09-28 12:52:12.995 10782 ERROR nova.wsgi
Sep 28 12:52:12 ctl02 nova-api[10782]: 2017-09-28 12:52:12.996 10782 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:52:13 ctl02 glance-api[29183]: 2017-09-28 12:52:13.003 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:52:13] "OPTIONS / HTTP/1.0" 200 134 0.000582
Sep 28 12:52:13 ctl02 nova-api[10782]: 2017-09-28 12:52:13.128 10782 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:52:13 ctl02 nova-api[10782]: 2017-09-28 12:52:13.354 10782 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:52:13 ctl02 nova-api[10782]: 2017-09-28 12:52:13.357 10782 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:52:13 ctl02 nova-api[10782]: 2017-09-28 12:52:13.357 10782 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:52:13 ctl02 nova-api[10782]: 2017-09-28 12:52:13.357 10782 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:52:13 ctl02 nova-api[10782]: 2017-09-28 12:52:13.488 10782 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:52:13 ctl02 nova-api[10782]: 2017-09-28 12:52:13.489 10782 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:52:13 ctl02 nova-api[10782]: 2017-09-28 12:52:13.490 10782 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:52:13 ctl02 nova-api[10782]: 2017-09-28 12:52:13.490 10782 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:52:13 ctl02 nova-api[10782]: 2017-09-28 12:52:13.493 10782 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:52:13 ctl02 nova-api[10782]: 2017-09-28 12:52:13.493 10782 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:52:13 ctl02 nova-api[10782]: 2017-09-28 12:52:13.493 10782 ERROR nova Traceback (most recent call last):
Sep 28 12:52:13 ctl02 nova-api[10782]: 2017-09-28 12:52:13.493 10782 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:52:13 ctl02 nova-api[10782]: 2017-09-28 12:52:13.493 10782 ERROR nova     sys.exit(main())
Sep 28 12:52:13 ctl02 nova-api[10782]: 2017-09-28 12:52:13.493 10782 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:52:13 ctl02 nova-api[10782]: 2017-09-28 12:52:13.493 10782 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:52:13 ctl02 nova-api[10782]: 2017-09-28 12:52:13.493 10782 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:52:13 ctl02 nova-api[10782]: 2017-09-28 12:52:13.493 10782 ERROR nova     max_url_len=max_url_len)
Sep 28 12:52:13 ctl02 nova-api[10782]: 2017-09-28 12:52:13.493 10782 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:52:13 ctl02 nova-api[10782]: 2017-09-28 12:52:13.493 10782 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:52:13 ctl02 nova-api[10782]: 2017-09-28 12:52:13.493 10782 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:52:13 ctl02 nova-api[10782]: 2017-09-28 12:52:13.493 10782 ERROR nova     sock.listen(backlog)
Sep 28 12:52:13 ctl02 nova-api[10782]: 2017-09-28 12:52:13.493 10782 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:52:13 ctl02 nova-api[10782]: 2017-09-28 12:52:13.493 10782 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:52:13 ctl02 nova-api[10782]: 2017-09-28 12:52:13.493 10782 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:52:13 ctl02 nova-api[10782]: 2017-09-28 12:52:13.493 10782 ERROR nova
Sep 28 12:52:13 ctl02 neutron-server[30536]: 2017-09-28 12:52:13.517 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:52:13] "OPTIONS / HTTP/1.0" 200 262 0.000514
Sep 28 12:52:13 ctl02 neutron-server[30536]: 2017-09-28 12:52:13.527 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:52:13 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:52:13 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:52:13 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:52:13 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdd495e0b)
Sep 28 12:52:13 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:52:13 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:52:13 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:52:13 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:52:14 ctl02 heat-api[13008]: 2017-09-28 12:52:14.591 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:52:14] "OPTIONS / HTTP/1.0" 200 134 0.000503
Sep 28 12:52:14 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xdd495e0b)
Sep 28 12:52:15 ctl02 nova-api[10800]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:52:15 ctl02 nova-api[10800]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:52:15 ctl02 nova-api[10800]: 2017-09-28 12:52:15.743 10800 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:52:15 ctl02 nova-api[10800]: 2017-09-28 12:52:15.745 10800 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:52:15 ctl02 nova-api[10800]: 2017-09-28 12:52:15.745 10800 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:52:15 ctl02 nova-api[10800]: 2017-09-28 12:52:15.745 10800 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:52:15 ctl02 nova-api[10800]: 2017-09-28 12:52:15.745 10800 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:52:15 ctl02 nova-api[10800]: 2017-09-28 12:52:15.745 10800 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:52:15 ctl02 nova-api[10800]: 2017-09-28 12:52:15.745 10800 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:52:15 ctl02 nova-api[10800]: 2017-09-28 12:52:15.745 10800 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:52:15 ctl02 nova-api[10800]: 2017-09-28 12:52:15.745 10800 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:52:15 ctl02 nova-api[10800]: 2017-09-28 12:52:15.745 10800 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:52:15 ctl02 nova-api[10800]: 2017-09-28 12:52:15.745 10800 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:52:15 ctl02 nova-api[10800]: 2017-09-28 12:52:15.745 10800 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:52:15 ctl02 nova-api[10800]: 2017-09-28 12:52:15.745 10800 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:52:15 ctl02 nova-api[10800]: 2017-09-28 12:52:15.745 10800 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:52:15 ctl02 nova-api[10800]: 2017-09-28 12:52:15.745 10800 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:52:15 ctl02 nova-api[10800]: 2017-09-28 12:52:15.745 10800 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:52:15 ctl02 nova-api[10800]: 2017-09-28 12:52:15.745 10800 ERROR nova.wsgi     self.filename))
Sep 28 12:52:15 ctl02 nova-api[10800]: 2017-09-28 12:52:15.745 10800 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:52:15 ctl02 nova-api[10800]: 2017-09-28 12:52:15.745 10800 ERROR nova.wsgi
Sep 28 12:52:15 ctl02 nova-api[10800]: 2017-09-28 12:52:15.746 10800 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:52:15 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:52:15 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:52:15 ctl02 nova-api[10800]: 2017-09-28 12:52:15.881 10800 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:52:15 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 12:52:15 ctl02 ntp[10857]:  * Stopping NTP server ntpd
Sep 28 12:52:15 ctl02 ntp[10857]:    ...done.
Sep 28 12:52:15 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 12:52:15 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 12:52:15 ctl02 ntp[10868]:  * Starting NTP server ntpd
Sep 28 12:52:15 ctl02 ntpd[10875]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 12:52:15 ctl02 ntpd[10875]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 12:52:15 ctl02 ntp[10868]:    ...done.
Sep 28 12:52:15 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 12:52:15 ctl02 ntpd[10878]: proto: precision = 0.042 usec (-24)
Sep 28 12:52:15 ctl02 ntpd[10878]: switching logging to file /var/log/ntp.log
Sep 28 12:52:16 ctl02 nova-api[10800]: 2017-09-28 12:52:16.130 10800 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:52:16 ctl02 nova-api[10800]: 2017-09-28 12:52:16.133 10800 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:52:16 ctl02 nova-api[10800]: 2017-09-28 12:52:16.133 10800 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:52:16 ctl02 nova-api[10800]: 2017-09-28 12:52:16.133 10800 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:52:16 ctl02 nova-api[10800]: 2017-09-28 12:52:16.266 10800 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:52:16 ctl02 nova-api[10800]: 2017-09-28 12:52:16.268 10800 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:52:16 ctl02 nova-api[10800]: 2017-09-28 12:52:16.268 10800 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:52:16 ctl02 nova-api[10800]: 2017-09-28 12:52:16.268 10800 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:52:16 ctl02 nova-api[10800]: 2017-09-28 12:52:16.272 10800 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:52:16 ctl02 nova-api[10800]: 2017-09-28 12:52:16.272 10800 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:52:16 ctl02 nova-api[10800]: 2017-09-28 12:52:16.272 10800 ERROR nova Traceback (most recent call last):
Sep 28 12:52:16 ctl02 nova-api[10800]: 2017-09-28 12:52:16.272 10800 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:52:16 ctl02 nova-api[10800]: 2017-09-28 12:52:16.272 10800 ERROR nova     sys.exit(main())
Sep 28 12:52:16 ctl02 nova-api[10800]: 2017-09-28 12:52:16.272 10800 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:52:16 ctl02 nova-api[10800]: 2017-09-28 12:52:16.272 10800 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:52:16 ctl02 nova-api[10800]: 2017-09-28 12:52:16.272 10800 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:52:16 ctl02 nova-api[10800]: 2017-09-28 12:52:16.272 10800 ERROR nova     max_url_len=max_url_len)
Sep 28 12:52:16 ctl02 nova-api[10800]: 2017-09-28 12:52:16.272 10800 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:52:16 ctl02 nova-api[10800]: 2017-09-28 12:52:16.272 10800 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:52:16 ctl02 nova-api[10800]: 2017-09-28 12:52:16.272 10800 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:52:16 ctl02 nova-api[10800]: 2017-09-28 12:52:16.272 10800 ERROR nova     sock.listen(backlog)
Sep 28 12:52:16 ctl02 nova-api[10800]: 2017-09-28 12:52:16.272 10800 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:52:16 ctl02 nova-api[10800]: 2017-09-28 12:52:16.272 10800 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:52:16 ctl02 nova-api[10800]: 2017-09-28 12:52:16.272 10800 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:52:16 ctl02 nova-api[10800]: 2017-09-28 12:52:16.272 10800 ERROR nova
Sep 28 12:52:16 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:52:16.424 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:52:16] "OPTIONS / HTTP/1.0" 200 134 0.000488
Sep 28 12:52:16 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:52:16 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:52:16 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:52:16 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:52:16 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:52:16 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:52:16 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:52:16 ctl02 heat-api[13008]: 2017-09-28 12:52:16.749 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:52:16] "OPTIONS / HTTP/1.0" 200 134 0.000641
Sep 28 12:52:16 ctl02 heat-api-cfn[13300]: 2017-09-28 12:52:16.929 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:52:16] "OPTIONS / HTTP/1.0" 200 134 0.000520
Sep 28 12:52:17 ctl02 heat-api-cfn[13300]: 2017-09-28 12:52:17.778 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:52:17] "OPTIONS / HTTP/1.0" 200 134 0.000543
Sep 28 12:52:17 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:52:17.851 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:52:17] "OPTIONS / HTTP/1.0" 200 134 0.000504
Sep 28 12:52:18 ctl02 nova-api[10889]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:52:18 ctl02 nova-api[10889]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:52:18 ctl02 nova-api[10889]: 2017-09-28 12:52:18.537 10889 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:52:18 ctl02 nova-api[10889]: 2017-09-28 12:52:18.538 10889 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:52:18 ctl02 nova-api[10889]: 2017-09-28 12:52:18.538 10889 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:52:18 ctl02 nova-api[10889]: 2017-09-28 12:52:18.538 10889 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:52:18 ctl02 nova-api[10889]: 2017-09-28 12:52:18.538 10889 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:52:18 ctl02 nova-api[10889]: 2017-09-28 12:52:18.538 10889 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:52:18 ctl02 nova-api[10889]: 2017-09-28 12:52:18.538 10889 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:52:18 ctl02 nova-api[10889]: 2017-09-28 12:52:18.538 10889 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:52:18 ctl02 nova-api[10889]: 2017-09-28 12:52:18.538 10889 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:52:18 ctl02 nova-api[10889]: 2017-09-28 12:52:18.538 10889 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:52:18 ctl02 nova-api[10889]: 2017-09-28 12:52:18.538 10889 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:52:18 ctl02 nova-api[10889]: 2017-09-28 12:52:18.538 10889 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:52:18 ctl02 nova-api[10889]: 2017-09-28 12:52:18.538 10889 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:52:18 ctl02 nova-api[10889]: 2017-09-28 12:52:18.538 10889 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:52:18 ctl02 nova-api[10889]: 2017-09-28 12:52:18.538 10889 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:52:18 ctl02 nova-api[10889]: 2017-09-28 12:52:18.538 10889 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:52:18 ctl02 nova-api[10889]: 2017-09-28 12:52:18.538 10889 ERROR nova.wsgi     self.filename))
Sep 28 12:52:18 ctl02 nova-api[10889]: 2017-09-28 12:52:18.538 10889 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:52:18 ctl02 nova-api[10889]: 2017-09-28 12:52:18.538 10889 ERROR nova.wsgi
Sep 28 12:52:18 ctl02 nova-api[10889]: 2017-09-28 12:52:18.539 10889 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:52:18 ctl02 nova-api[10889]: 2017-09-28 12:52:18.673 10889 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:52:18 ctl02 nova-api[10889]: 2017-09-28 12:52:18.927 10889 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:52:18 ctl02 nova-api[10889]: 2017-09-28 12:52:18.930 10889 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:52:18 ctl02 nova-api[10889]: 2017-09-28 12:52:18.930 10889 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:52:18 ctl02 nova-api[10889]: 2017-09-28 12:52:18.930 10889 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:52:19 ctl02 nova-api[10889]: 2017-09-28 12:52:19.062 10889 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:52:19 ctl02 nova-api[10889]: 2017-09-28 12:52:19.064 10889 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:52:19 ctl02 nova-api[10889]: 2017-09-28 12:52:19.064 10889 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:52:19 ctl02 nova-api[10889]: 2017-09-28 12:52:19.064 10889 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:52:19 ctl02 nova-api[10889]: 2017-09-28 12:52:19.068 10889 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:52:19 ctl02 nova-api[10889]: 2017-09-28 12:52:19.068 10889 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:52:19 ctl02 nova-api[10889]: 2017-09-28 12:52:19.068 10889 ERROR nova Traceback (most recent call last):
Sep 28 12:52:19 ctl02 nova-api[10889]: 2017-09-28 12:52:19.068 10889 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:52:19 ctl02 nova-api[10889]: 2017-09-28 12:52:19.068 10889 ERROR nova     sys.exit(main())
Sep 28 12:52:19 ctl02 nova-api[10889]: 2017-09-28 12:52:19.068 10889 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:52:19 ctl02 nova-api[10889]: 2017-09-28 12:52:19.068 10889 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:52:19 ctl02 nova-api[10889]: 2017-09-28 12:52:19.068 10889 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:52:19 ctl02 nova-api[10889]: 2017-09-28 12:52:19.068 10889 ERROR nova     max_url_len=max_url_len)
Sep 28 12:52:19 ctl02 nova-api[10889]: 2017-09-28 12:52:19.068 10889 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:52:19 ctl02 nova-api[10889]: 2017-09-28 12:52:19.068 10889 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:52:19 ctl02 nova-api[10889]: 2017-09-28 12:52:19.068 10889 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:52:19 ctl02 nova-api[10889]: 2017-09-28 12:52:19.068 10889 ERROR nova     sock.listen(backlog)
Sep 28 12:52:19 ctl02 nova-api[10889]: 2017-09-28 12:52:19.068 10889 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:52:19 ctl02 nova-api[10889]: 2017-09-28 12:52:19.068 10889 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:52:19 ctl02 nova-api[10889]: 2017-09-28 12:52:19.068 10889 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:52:19 ctl02 nova-api[10889]: 2017-09-28 12:52:19.068 10889 ERROR nova
Sep 28 12:52:19 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:52:19 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:52:19 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:52:19 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:52:19 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:52:19 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:52:19 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:52:20 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:52:20.144 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:52:20] "OPTIONS / HTTP/1.0" 200 134 0.000394
Sep 28 12:52:20 ctl02 glance-api[29183]: 2017-09-28 12:52:20.684 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:52:20] "OPTIONS / HTTP/1.0" 200 134 0.000656
Sep 28 12:52:20 ctl02 neutron-server[30536]: 2017-09-28 12:52:20.959 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:52:20] "OPTIONS / HTTP/1.0" 200 262 0.000535
Sep 28 12:52:21 ctl02 nova-api[10907]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:52:21 ctl02 nova-api[10907]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:52:21 ctl02 neutron-server[30536]: 2017-09-28 12:52:21.163 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 2 dead agents out of 6:
Sep 28 12:52:21 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:52:21 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:50:56 cmp002
Sep 28 12:52:21 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:51:38 cmp001
Sep 28 12:52:21 ctl02 heat-api[13008]: 2017-09-28 12:52:21.214 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:52:21] "OPTIONS / HTTP/1.0" 200 134 0.000610
Sep 28 12:52:21 ctl02 nova-api[10907]: 2017-09-28 12:52:21.305 10907 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:52:21 ctl02 nova-api[10907]: 2017-09-28 12:52:21.307 10907 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:52:21 ctl02 nova-api[10907]: 2017-09-28 12:52:21.307 10907 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:52:21 ctl02 nova-api[10907]: 2017-09-28 12:52:21.307 10907 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:52:21 ctl02 nova-api[10907]: 2017-09-28 12:52:21.307 10907 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:52:21 ctl02 nova-api[10907]: 2017-09-28 12:52:21.307 10907 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:52:21 ctl02 nova-api[10907]: 2017-09-28 12:52:21.307 10907 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:52:21 ctl02 nova-api[10907]: 2017-09-28 12:52:21.307 10907 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:52:21 ctl02 nova-api[10907]: 2017-09-28 12:52:21.307 10907 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:52:21 ctl02 nova-api[10907]: 2017-09-28 12:52:21.307 10907 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:52:21 ctl02 nova-api[10907]: 2017-09-28 12:52:21.307 10907 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:52:21 ctl02 nova-api[10907]: 2017-09-28 12:52:21.307 10907 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:52:21 ctl02 nova-api[10907]: 2017-09-28 12:52:21.307 10907 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:52:21 ctl02 nova-api[10907]: 2017-09-28 12:52:21.307 10907 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:52:21 ctl02 nova-api[10907]: 2017-09-28 12:52:21.307 10907 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:52:21 ctl02 nova-api[10907]: 2017-09-28 12:52:21.307 10907 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:52:21 ctl02 nova-api[10907]: 2017-09-28 12:52:21.307 10907 ERROR nova.wsgi     self.filename))
Sep 28 12:52:21 ctl02 nova-api[10907]: 2017-09-28 12:52:21.307 10907 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:52:21 ctl02 nova-api[10907]: 2017-09-28 12:52:21.307 10907 ERROR nova.wsgi
Sep 28 12:52:21 ctl02 nova-api[10907]: 2017-09-28 12:52:21.309 10907 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:52:21 ctl02 nova-api[10907]: 2017-09-28 12:52:21.450 10907 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:52:21 ctl02 nova-api[10907]: 2017-09-28 12:52:21.708 10907 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:52:21 ctl02 nova-api[10907]: 2017-09-28 12:52:21.711 10907 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:52:21 ctl02 nova-api[10907]: 2017-09-28 12:52:21.712 10907 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:52:21 ctl02 nova-api[10907]: 2017-09-28 12:52:21.712 10907 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:52:21 ctl02 nova-api[10907]: 2017-09-28 12:52:21.857 10907 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:52:21 ctl02 nova-api[10907]: 2017-09-28 12:52:21.859 10907 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:52:21 ctl02 nova-api[10907]: 2017-09-28 12:52:21.860 10907 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:52:21 ctl02 nova-api[10907]: 2017-09-28 12:52:21.860 10907 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:52:21 ctl02 nova-api[10907]: 2017-09-28 12:52:21.864 10907 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:52:21 ctl02 nova-api[10907]: 2017-09-28 12:52:21.865 10907 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:52:21 ctl02 nova-api[10907]: 2017-09-28 12:52:21.865 10907 ERROR nova Traceback (most recent call last):
Sep 28 12:52:21 ctl02 nova-api[10907]: 2017-09-28 12:52:21.865 10907 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:52:21 ctl02 nova-api[10907]: 2017-09-28 12:52:21.865 10907 ERROR nova     sys.exit(main())
Sep 28 12:52:21 ctl02 nova-api[10907]: 2017-09-28 12:52:21.865 10907 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:52:21 ctl02 nova-api[10907]: 2017-09-28 12:52:21.865 10907 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:52:21 ctl02 nova-api[10907]: 2017-09-28 12:52:21.865 10907 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:52:21 ctl02 nova-api[10907]: 2017-09-28 12:52:21.865 10907 ERROR nova     max_url_len=max_url_len)
Sep 28 12:52:21 ctl02 nova-api[10907]: 2017-09-28 12:52:21.865 10907 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:52:21 ctl02 nova-api[10907]: 2017-09-28 12:52:21.865 10907 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:52:21 ctl02 nova-api[10907]: 2017-09-28 12:52:21.865 10907 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:52:21 ctl02 nova-api[10907]: 2017-09-28 12:52:21.865 10907 ERROR nova     sock.listen(backlog)
Sep 28 12:52:21 ctl02 nova-api[10907]: 2017-09-28 12:52:21.865 10907 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:52:21 ctl02 nova-api[10907]: 2017-09-28 12:52:21.865 10907 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:52:21 ctl02 nova-api[10907]: 2017-09-28 12:52:21.865 10907 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:52:21 ctl02 nova-api[10907]: 2017-09-28 12:52:21.865 10907 ERROR nova
Sep 28 12:52:22 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:52:22 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:52:22 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:52:22 ctl02 heat-api-cfn[13300]: 2017-09-28 12:52:22.047 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:52:22] "OPTIONS / HTTP/1.0" 200 134 0.000539
Sep 28 12:52:22 ctl02 glance-api[29183]: 2017-09-28 12:52:22.257 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:52:22] "OPTIONS / HTTP/1.0" 200 134 0.000677
Sep 28 12:52:22 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:52:22 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:52:22 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:52:22 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:52:22 ctl02 neutron-server[30536]: 2017-09-28 12:52:22.681 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:52:22] "OPTIONS / HTTP/1.0" 200 262 0.000531
Sep 28 12:52:22 ctl02 glance-api[29183]: 2017-09-28 12:52:22.725 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:52:22] "OPTIONS / HTTP/1.0" 200 134 0.000895
Sep 28 12:52:23 ctl02 nova-conductor[5056]: 2017-09-28 12:52:23.115 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:52:23 ctl02 nova-conductor[5056]: 2017-09-28 12:52:23.106 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:52:23 ctl02 nova-conductor[5056]: 2017-09-28 12:52:23.145 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:52:23 ctl02 nova-conductor[5056]: 2017-09-28 12:52:23.148 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:52:23 ctl02 nova-cert[4860]: 2017-09-28 12:52:23.296 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:52:23 ctl02 neutron-server[30536]: 2017-09-28 12:52:23.776 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:52:23] "OPTIONS / HTTP/1.0" 200 262 0.000476
Sep 28 12:52:24 ctl02 nova-api[10925]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:52:24 ctl02 nova-api[10925]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:52:24 ctl02 nova-api[10925]: 2017-09-28 12:52:24.297 10925 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:52:24 ctl02 nova-api[10925]: 2017-09-28 12:52:24.298 10925 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:52:24 ctl02 nova-api[10925]: 2017-09-28 12:52:24.298 10925 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:52:24 ctl02 nova-api[10925]: 2017-09-28 12:52:24.298 10925 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:52:24 ctl02 nova-api[10925]: 2017-09-28 12:52:24.298 10925 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:52:24 ctl02 nova-api[10925]: 2017-09-28 12:52:24.298 10925 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:52:24 ctl02 nova-api[10925]: 2017-09-28 12:52:24.298 10925 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:52:24 ctl02 nova-api[10925]: 2017-09-28 12:52:24.298 10925 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:52:24 ctl02 nova-api[10925]: 2017-09-28 12:52:24.298 10925 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:52:24 ctl02 nova-api[10925]: 2017-09-28 12:52:24.298 10925 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:52:24 ctl02 nova-api[10925]: 2017-09-28 12:52:24.298 10925 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:52:24 ctl02 nova-api[10925]: 2017-09-28 12:52:24.298 10925 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:52:24 ctl02 nova-api[10925]: 2017-09-28 12:52:24.298 10925 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:52:24 ctl02 nova-api[10925]: 2017-09-28 12:52:24.298 10925 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:52:24 ctl02 nova-api[10925]: 2017-09-28 12:52:24.298 10925 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:52:24 ctl02 nova-api[10925]: 2017-09-28 12:52:24.298 10925 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:52:24 ctl02 nova-api[10925]: 2017-09-28 12:52:24.298 10925 ERROR nova.wsgi     self.filename))
Sep 28 12:52:24 ctl02 nova-api[10925]: 2017-09-28 12:52:24.298 10925 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:52:24 ctl02 nova-api[10925]: 2017-09-28 12:52:24.298 10925 ERROR nova.wsgi
Sep 28 12:52:24 ctl02 nova-api[10925]: 2017-09-28 12:52:24.299 10925 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:52:24 ctl02 heat-api[13008]: 2017-09-28 12:52:24.416 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:52:24] "OPTIONS / HTTP/1.0" 200 134 0.000597
Sep 28 12:52:24 ctl02 nova-api[10925]: 2017-09-28 12:52:24.429 10925 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:52:24 ctl02 nova-api[10925]: 2017-09-28 12:52:24.650 10925 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:52:24 ctl02 nova-api[10925]: 2017-09-28 12:52:24.652 10925 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:52:24 ctl02 nova-api[10925]: 2017-09-28 12:52:24.652 10925 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:52:24 ctl02 nova-api[10925]: 2017-09-28 12:52:24.652 10925 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:52:24 ctl02 nova-api[10925]: 2017-09-28 12:52:24.783 10925 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:52:24 ctl02 nova-api[10925]: 2017-09-28 12:52:24.785 10925 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:52:24 ctl02 nova-api[10925]: 2017-09-28 12:52:24.785 10925 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:52:24 ctl02 nova-api[10925]: 2017-09-28 12:52:24.785 10925 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:52:24 ctl02 nova-api[10925]: 2017-09-28 12:52:24.788 10925 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:52:24 ctl02 nova-api[10925]: 2017-09-28 12:52:24.789 10925 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:52:24 ctl02 nova-api[10925]: 2017-09-28 12:52:24.789 10925 ERROR nova Traceback (most recent call last):
Sep 28 12:52:24 ctl02 nova-api[10925]: 2017-09-28 12:52:24.789 10925 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:52:24 ctl02 nova-api[10925]: 2017-09-28 12:52:24.789 10925 ERROR nova     sys.exit(main())
Sep 28 12:52:24 ctl02 nova-api[10925]: 2017-09-28 12:52:24.789 10925 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:52:24 ctl02 nova-api[10925]: 2017-09-28 12:52:24.789 10925 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:52:24 ctl02 nova-api[10925]: 2017-09-28 12:52:24.789 10925 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:52:24 ctl02 nova-api[10925]: 2017-09-28 12:52:24.789 10925 ERROR nova     max_url_len=max_url_len)
Sep 28 12:52:24 ctl02 nova-api[10925]: 2017-09-28 12:52:24.789 10925 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:52:24 ctl02 nova-api[10925]: 2017-09-28 12:52:24.789 10925 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:52:24 ctl02 nova-api[10925]: 2017-09-28 12:52:24.789 10925 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:52:24 ctl02 nova-api[10925]: 2017-09-28 12:52:24.789 10925 ERROR nova     sock.listen(backlog)
Sep 28 12:52:24 ctl02 nova-api[10925]: 2017-09-28 12:52:24.789 10925 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:52:24 ctl02 nova-api[10925]: 2017-09-28 12:52:24.789 10925 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:52:24 ctl02 nova-api[10925]: 2017-09-28 12:52:24.789 10925 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:52:24 ctl02 nova-api[10925]: 2017-09-28 12:52:24.789 10925 ERROR nova
Sep 28 12:52:24 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:52:24 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:52:24 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:52:25 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:52:25 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:52:25 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:52:25 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:52:26 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:52:26.759 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:52:26] "OPTIONS / HTTP/1.0" 200 134 0.000352
Sep 28 12:52:26 ctl02 heat-api[13008]: 2017-09-28 12:52:26.785 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:52:26] "OPTIONS / HTTP/1.0" 200 134 0.000699
Sep 28 12:52:26 ctl02 nova-api[10943]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:52:26 ctl02 nova-api[10943]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:52:26 ctl02 heat-api-cfn[13300]: 2017-09-28 12:52:26.931 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:52:26] "OPTIONS / HTTP/1.0" 200 134 0.000542
Sep 28 12:52:26 ctl02 nova-api[10943]: 2017-09-28 12:52:26.961 10943 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:52:26 ctl02 nova-api[10943]: 2017-09-28 12:52:26.963 10943 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:52:26 ctl02 nova-api[10943]: 2017-09-28 12:52:26.963 10943 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:52:26 ctl02 nova-api[10943]: 2017-09-28 12:52:26.963 10943 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:52:26 ctl02 nova-api[10943]: 2017-09-28 12:52:26.963 10943 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:52:26 ctl02 nova-api[10943]: 2017-09-28 12:52:26.963 10943 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:52:26 ctl02 nova-api[10943]: 2017-09-28 12:52:26.963 10943 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:52:26 ctl02 nova-api[10943]: 2017-09-28 12:52:26.963 10943 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:52:26 ctl02 nova-api[10943]: 2017-09-28 12:52:26.963 10943 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:52:26 ctl02 nova-api[10943]: 2017-09-28 12:52:26.963 10943 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:52:26 ctl02 nova-api[10943]: 2017-09-28 12:52:26.963 10943 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:52:26 ctl02 nova-api[10943]: 2017-09-28 12:52:26.963 10943 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:52:26 ctl02 nova-api[10943]: 2017-09-28 12:52:26.963 10943 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:52:26 ctl02 nova-api[10943]: 2017-09-28 12:52:26.963 10943 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:52:26 ctl02 nova-api[10943]: 2017-09-28 12:52:26.963 10943 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:52:26 ctl02 nova-api[10943]: 2017-09-28 12:52:26.963 10943 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:52:26 ctl02 nova-api[10943]: 2017-09-28 12:52:26.963 10943 ERROR nova.wsgi     self.filename))
Sep 28 12:52:26 ctl02 nova-api[10943]: 2017-09-28 12:52:26.963 10943 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:52:26 ctl02 nova-api[10943]: 2017-09-28 12:52:26.963 10943 ERROR nova.wsgi
Sep 28 12:52:26 ctl02 nova-api[10943]: 2017-09-28 12:52:26.965 10943 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:52:27 ctl02 nova-api[10943]: 2017-09-28 12:52:27.091 10943 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:52:27 ctl02 nova-api[10943]: 2017-09-28 12:52:27.313 10943 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:52:27 ctl02 nova-api[10943]: 2017-09-28 12:52:27.316 10943 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:52:27 ctl02 nova-api[10943]: 2017-09-28 12:52:27.316 10943 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:52:27 ctl02 nova-api[10943]: 2017-09-28 12:52:27.317 10943 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:52:27 ctl02 nova-api[10943]: 2017-09-28 12:52:27.446 10943 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:52:27 ctl02 nova-api[10943]: 2017-09-28 12:52:27.448 10943 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:52:27 ctl02 nova-api[10943]: 2017-09-28 12:52:27.449 10943 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:52:27 ctl02 nova-api[10943]: 2017-09-28 12:52:27.449 10943 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:52:27 ctl02 nova-api[10943]: 2017-09-28 12:52:27.452 10943 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:52:27 ctl02 nova-api[10943]: 2017-09-28 12:52:27.453 10943 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:52:27 ctl02 nova-api[10943]: 2017-09-28 12:52:27.453 10943 ERROR nova Traceback (most recent call last):
Sep 28 12:52:27 ctl02 nova-api[10943]: 2017-09-28 12:52:27.453 10943 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:52:27 ctl02 nova-api[10943]: 2017-09-28 12:52:27.453 10943 ERROR nova     sys.exit(main())
Sep 28 12:52:27 ctl02 nova-api[10943]: 2017-09-28 12:52:27.453 10943 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:52:27 ctl02 nova-api[10943]: 2017-09-28 12:52:27.453 10943 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:52:27 ctl02 nova-api[10943]: 2017-09-28 12:52:27.453 10943 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:52:27 ctl02 nova-api[10943]: 2017-09-28 12:52:27.453 10943 ERROR nova     max_url_len=max_url_len)
Sep 28 12:52:27 ctl02 nova-api[10943]: 2017-09-28 12:52:27.453 10943 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:52:27 ctl02 nova-api[10943]: 2017-09-28 12:52:27.453 10943 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:52:27 ctl02 nova-api[10943]: 2017-09-28 12:52:27.453 10943 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:52:27 ctl02 nova-api[10943]: 2017-09-28 12:52:27.453 10943 ERROR nova     sock.listen(backlog)
Sep 28 12:52:27 ctl02 nova-api[10943]: 2017-09-28 12:52:27.453 10943 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:52:27 ctl02 nova-api[10943]: 2017-09-28 12:52:27.453 10943 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:52:27 ctl02 nova-api[10943]: 2017-09-28 12:52:27.453 10943 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:52:27 ctl02 nova-api[10943]: 2017-09-28 12:52:27.453 10943 ERROR nova
Sep 28 12:52:27 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:52:27.474 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:52:27] "OPTIONS / HTTP/1.0" 200 134 0.000393
Sep 28 12:52:27 ctl02 heat-api-cfn[13300]: 2017-09-28 12:52:27.569 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:52:27] "OPTIONS / HTTP/1.0" 200 134 0.000537
Sep 28 12:52:27 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:52:27 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:52:27 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:52:27 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:52:27 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:52:27 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:52:27 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:52:29 ctl02 nova-api[10961]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:52:29 ctl02 nova-api[10961]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:52:29 ctl02 nova-api[10961]: 2017-09-28 12:52:29.825 10961 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:52:29 ctl02 nova-api[10961]: 2017-09-28 12:52:29.826 10961 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:52:29 ctl02 nova-api[10961]: 2017-09-28 12:52:29.826 10961 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:52:29 ctl02 nova-api[10961]: 2017-09-28 12:52:29.826 10961 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:52:29 ctl02 nova-api[10961]: 2017-09-28 12:52:29.826 10961 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:52:29 ctl02 nova-api[10961]: 2017-09-28 12:52:29.826 10961 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:52:29 ctl02 nova-api[10961]: 2017-09-28 12:52:29.826 10961 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:52:29 ctl02 nova-api[10961]: 2017-09-28 12:52:29.826 10961 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:52:29 ctl02 nova-api[10961]: 2017-09-28 12:52:29.826 10961 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:52:29 ctl02 nova-api[10961]: 2017-09-28 12:52:29.826 10961 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:52:29 ctl02 nova-api[10961]: 2017-09-28 12:52:29.826 10961 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:52:29 ctl02 nova-api[10961]: 2017-09-28 12:52:29.826 10961 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:52:29 ctl02 nova-api[10961]: 2017-09-28 12:52:29.826 10961 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:52:29 ctl02 nova-api[10961]: 2017-09-28 12:52:29.826 10961 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:52:29 ctl02 nova-api[10961]: 2017-09-28 12:52:29.826 10961 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:52:29 ctl02 nova-api[10961]: 2017-09-28 12:52:29.826 10961 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:52:29 ctl02 nova-api[10961]: 2017-09-28 12:52:29.826 10961 ERROR nova.wsgi     self.filename))
Sep 28 12:52:29 ctl02 nova-api[10961]: 2017-09-28 12:52:29.826 10961 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:52:29 ctl02 nova-api[10961]: 2017-09-28 12:52:29.826 10961 ERROR nova.wsgi
Sep 28 12:52:29 ctl02 nova-api[10961]: 2017-09-28 12:52:29.829 10961 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:52:29 ctl02 nova-api[10961]: 2017-09-28 12:52:29.966 10961 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:52:29 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:52:29.968 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:52:29] "OPTIONS / HTTP/1.0" 200 134 0.000462
Sep 28 12:52:30 ctl02 nova-api[10961]: 2017-09-28 12:52:30.226 10961 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:52:30 ctl02 nova-api[10961]: 2017-09-28 12:52:30.228 10961 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:52:30 ctl02 nova-api[10961]: 2017-09-28 12:52:30.229 10961 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:52:30 ctl02 nova-api[10961]: 2017-09-28 12:52:30.229 10961 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:52:30 ctl02 nova-api[10961]: 2017-09-28 12:52:30.365 10961 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:52:30 ctl02 nova-api[10961]: 2017-09-28 12:52:30.367 10961 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:52:30 ctl02 nova-api[10961]: 2017-09-28 12:52:30.367 10961 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:52:30 ctl02 nova-api[10961]: 2017-09-28 12:52:30.368 10961 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:52:30 ctl02 nova-api[10961]: 2017-09-28 12:52:30.371 10961 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:52:30 ctl02 nova-api[10961]: 2017-09-28 12:52:30.371 10961 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:52:30 ctl02 nova-api[10961]: 2017-09-28 12:52:30.371 10961 ERROR nova Traceback (most recent call last):
Sep 28 12:52:30 ctl02 nova-api[10961]: 2017-09-28 12:52:30.371 10961 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:52:30 ctl02 nova-api[10961]: 2017-09-28 12:52:30.371 10961 ERROR nova     sys.exit(main())
Sep 28 12:52:30 ctl02 nova-api[10961]: 2017-09-28 12:52:30.371 10961 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:52:30 ctl02 nova-api[10961]: 2017-09-28 12:52:30.371 10961 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:52:30 ctl02 nova-api[10961]: 2017-09-28 12:52:30.371 10961 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:52:30 ctl02 nova-api[10961]: 2017-09-28 12:52:30.371 10961 ERROR nova     max_url_len=max_url_len)
Sep 28 12:52:30 ctl02 nova-api[10961]: 2017-09-28 12:52:30.371 10961 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:52:30 ctl02 nova-api[10961]: 2017-09-28 12:52:30.371 10961 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:52:30 ctl02 nova-api[10961]: 2017-09-28 12:52:30.371 10961 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:52:30 ctl02 nova-api[10961]: 2017-09-28 12:52:30.371 10961 ERROR nova     sock.listen(backlog)
Sep 28 12:52:30 ctl02 nova-api[10961]: 2017-09-28 12:52:30.371 10961 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:52:30 ctl02 nova-api[10961]: 2017-09-28 12:52:30.371 10961 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:52:30 ctl02 nova-api[10961]: 2017-09-28 12:52:30.371 10961 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:52:30 ctl02 nova-api[10961]: 2017-09-28 12:52:30.371 10961 ERROR nova
Sep 28 12:52:30 ctl02 glance-api[29183]: 2017-09-28 12:52:30.429 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:52:30] "OPTIONS / HTTP/1.0" 200 134 0.000585
Sep 28 12:52:30 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:52:30 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:52:30 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:52:30 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:52:30 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:52:30 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:52:30 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:52:31 ctl02 neutron-server[30536]: 2017-09-28 12:52:31.003 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:52:31] "OPTIONS / HTTP/1.0" 200 262 0.000527
Sep 28 12:52:31 ctl02 heat-api[13008]: 2017-09-28 12:52:31.225 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:52:31] "OPTIONS / HTTP/1.0" 200 134 0.000623
Sep 28 12:52:31 ctl02 heat-api-cfn[13300]: 2017-09-28 12:52:31.996 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:52:31] "OPTIONS / HTTP/1.0" 200 134 0.000532
Sep 28 12:52:32 ctl02 glance-api[29183]: 2017-09-28 12:52:32.313 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:52:32] "OPTIONS / HTTP/1.0" 200 134 0.000977
Sep 28 12:52:32 ctl02 nova-api[10978]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:52:32 ctl02 nova-api[10978]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:52:32 ctl02 nova-api[10978]: 2017-09-28 12:52:32.512 10978 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:52:32 ctl02 nova-api[10978]: 2017-09-28 12:52:32.513 10978 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:52:32 ctl02 nova-api[10978]: 2017-09-28 12:52:32.513 10978 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:52:32 ctl02 nova-api[10978]: 2017-09-28 12:52:32.513 10978 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:52:32 ctl02 nova-api[10978]: 2017-09-28 12:52:32.513 10978 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:52:32 ctl02 nova-api[10978]: 2017-09-28 12:52:32.513 10978 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:52:32 ctl02 nova-api[10978]: 2017-09-28 12:52:32.513 10978 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:52:32 ctl02 nova-api[10978]: 2017-09-28 12:52:32.513 10978 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:52:32 ctl02 nova-api[10978]: 2017-09-28 12:52:32.513 10978 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:52:32 ctl02 nova-api[10978]: 2017-09-28 12:52:32.513 10978 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:52:32 ctl02 nova-api[10978]: 2017-09-28 12:52:32.513 10978 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:52:32 ctl02 nova-api[10978]: 2017-09-28 12:52:32.513 10978 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:52:32 ctl02 nova-api[10978]: 2017-09-28 12:52:32.513 10978 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:52:32 ctl02 nova-api[10978]: 2017-09-28 12:52:32.513 10978 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:52:32 ctl02 nova-api[10978]: 2017-09-28 12:52:32.513 10978 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:52:32 ctl02 nova-api[10978]: 2017-09-28 12:52:32.513 10978 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:52:32 ctl02 nova-api[10978]: 2017-09-28 12:52:32.513 10978 ERROR nova.wsgi     self.filename))
Sep 28 12:52:32 ctl02 nova-api[10978]: 2017-09-28 12:52:32.513 10978 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:52:32 ctl02 nova-api[10978]: 2017-09-28 12:52:32.513 10978 ERROR nova.wsgi
Sep 28 12:52:32 ctl02 nova-api[10978]: 2017-09-28 12:52:32.514 10978 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:52:32 ctl02 nova-api[10978]: 2017-09-28 12:52:32.645 10978 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:52:32 ctl02 glance-api[29183]: 2017-09-28 12:52:32.888 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:52:32] "OPTIONS / HTTP/1.0" 200 134 0.000639
Sep 28 12:52:32 ctl02 nova-api[10978]: 2017-09-28 12:52:32.895 10978 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:52:32 ctl02 nova-api[10978]: 2017-09-28 12:52:32.897 10978 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:52:32 ctl02 nova-api[10978]: 2017-09-28 12:52:32.897 10978 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:52:32 ctl02 nova-api[10978]: 2017-09-28 12:52:32.898 10978 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:52:32 ctl02 neutron-server[30536]: 2017-09-28 12:52:32.920 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:52:32] "OPTIONS / HTTP/1.0" 200 262 0.000556
Sep 28 12:52:33 ctl02 nova-api[10978]: 2017-09-28 12:52:33.034 10978 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:52:33 ctl02 nova-api[10978]: 2017-09-28 12:52:33.037 10978 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:52:33 ctl02 nova-api[10978]: 2017-09-28 12:52:33.037 10978 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:52:33 ctl02 nova-api[10978]: 2017-09-28 12:52:33.037 10978 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:52:33 ctl02 nova-api[10978]: 2017-09-28 12:52:33.041 10978 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:52:33 ctl02 nova-api[10978]: 2017-09-28 12:52:33.041 10978 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:52:33 ctl02 nova-api[10978]: 2017-09-28 12:52:33.041 10978 ERROR nova Traceback (most recent call last):
Sep 28 12:52:33 ctl02 nova-api[10978]: 2017-09-28 12:52:33.041 10978 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:52:33 ctl02 nova-api[10978]: 2017-09-28 12:52:33.041 10978 ERROR nova     sys.exit(main())
Sep 28 12:52:33 ctl02 nova-api[10978]: 2017-09-28 12:52:33.041 10978 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:52:33 ctl02 nova-api[10978]: 2017-09-28 12:52:33.041 10978 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:52:33 ctl02 nova-api[10978]: 2017-09-28 12:52:33.041 10978 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:52:33 ctl02 nova-api[10978]: 2017-09-28 12:52:33.041 10978 ERROR nova     max_url_len=max_url_len)
Sep 28 12:52:33 ctl02 nova-api[10978]: 2017-09-28 12:52:33.041 10978 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:52:33 ctl02 nova-api[10978]: 2017-09-28 12:52:33.041 10978 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:52:33 ctl02 nova-api[10978]: 2017-09-28 12:52:33.041 10978 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:52:33 ctl02 nova-api[10978]: 2017-09-28 12:52:33.041 10978 ERROR nova     sock.listen(backlog)
Sep 28 12:52:33 ctl02 nova-api[10978]: 2017-09-28 12:52:33.041 10978 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:52:33 ctl02 nova-api[10978]: 2017-09-28 12:52:33.041 10978 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:52:33 ctl02 nova-api[10978]: 2017-09-28 12:52:33.041 10978 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:52:33 ctl02 nova-api[10978]: 2017-09-28 12:52:33.041 10978 ERROR nova
Sep 28 12:52:33 ctl02 nova-consoleauth[5433]: 2017-09-28 12:52:33.139 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:52:33 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:52:33 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:52:33 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:52:33 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:52:33 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:52:33 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:52:33 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:52:33 ctl02 neutron-server[30536]: 2017-09-28 12:52:33.697 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:52:33] "OPTIONS / HTTP/1.0" 200 262 0.000521
Sep 28 12:52:34 ctl02 heat-engine[12803]: 2017-09-28 12:52:34.251 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:52:34 ctl02 heat-engine[12803]: 2017-09-28 12:52:34.257 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:52:34 ctl02 heat-engine[12803]: 2017-09-28 12:52:34.261 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:52:34 ctl02 heat-engine[12803]: 2017-09-28 12:52:34.266 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:52:34 ctl02 heat-api[13008]: 2017-09-28 12:52:34.518 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:52:34] "OPTIONS / HTTP/1.0" 200 134 0.000615
Sep 28 12:52:35 ctl02 nova-api[10996]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:52:35 ctl02 nova-api[10996]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:52:35 ctl02 nova-api[10996]: 2017-09-28 12:52:35.257 10996 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:52:35 ctl02 nova-api[10996]: 2017-09-28 12:52:35.259 10996 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:52:35 ctl02 nova-api[10996]: 2017-09-28 12:52:35.259 10996 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:52:35 ctl02 nova-api[10996]: 2017-09-28 12:52:35.259 10996 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:52:35 ctl02 nova-api[10996]: 2017-09-28 12:52:35.259 10996 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:52:35 ctl02 nova-api[10996]: 2017-09-28 12:52:35.259 10996 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:52:35 ctl02 nova-api[10996]: 2017-09-28 12:52:35.259 10996 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:52:35 ctl02 nova-api[10996]: 2017-09-28 12:52:35.259 10996 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:52:35 ctl02 nova-api[10996]: 2017-09-28 12:52:35.259 10996 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:52:35 ctl02 nova-api[10996]: 2017-09-28 12:52:35.259 10996 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:52:35 ctl02 nova-api[10996]: 2017-09-28 12:52:35.259 10996 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:52:35 ctl02 nova-api[10996]: 2017-09-28 12:52:35.259 10996 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:52:35 ctl02 nova-api[10996]: 2017-09-28 12:52:35.259 10996 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:52:35 ctl02 nova-api[10996]: 2017-09-28 12:52:35.259 10996 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:52:35 ctl02 nova-api[10996]: 2017-09-28 12:52:35.259 10996 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:52:35 ctl02 nova-api[10996]: 2017-09-28 12:52:35.259 10996 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:52:35 ctl02 nova-api[10996]: 2017-09-28 12:52:35.259 10996 ERROR nova.wsgi     self.filename))
Sep 28 12:52:35 ctl02 nova-api[10996]: 2017-09-28 12:52:35.259 10996 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:52:35 ctl02 nova-api[10996]: 2017-09-28 12:52:35.259 10996 ERROR nova.wsgi
Sep 28 12:52:35 ctl02 nova-api[10996]: 2017-09-28 12:52:35.260 10996 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:52:35 ctl02 nova-api[10996]: 2017-09-28 12:52:35.393 10996 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:52:35 ctl02 nova-api[10996]: 2017-09-28 12:52:35.639 10996 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:52:35 ctl02 nova-api[10996]: 2017-09-28 12:52:35.641 10996 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:52:35 ctl02 nova-api[10996]: 2017-09-28 12:52:35.641 10996 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:52:35 ctl02 nova-api[10996]: 2017-09-28 12:52:35.642 10996 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:52:35 ctl02 nova-api[10996]: 2017-09-28 12:52:35.773 10996 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:52:35 ctl02 nova-api[10996]: 2017-09-28 12:52:35.776 10996 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:52:35 ctl02 nova-api[10996]: 2017-09-28 12:52:35.776 10996 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:52:35 ctl02 nova-api[10996]: 2017-09-28 12:52:35.776 10996 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:52:35 ctl02 nova-api[10996]: 2017-09-28 12:52:35.780 10996 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:52:35 ctl02 nova-api[10996]: 2017-09-28 12:52:35.780 10996 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:52:35 ctl02 nova-api[10996]: 2017-09-28 12:52:35.780 10996 ERROR nova Traceback (most recent call last):
Sep 28 12:52:35 ctl02 nova-api[10996]: 2017-09-28 12:52:35.780 10996 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:52:35 ctl02 nova-api[10996]: 2017-09-28 12:52:35.780 10996 ERROR nova     sys.exit(main())
Sep 28 12:52:35 ctl02 nova-api[10996]: 2017-09-28 12:52:35.780 10996 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:52:35 ctl02 nova-api[10996]: 2017-09-28 12:52:35.780 10996 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:52:35 ctl02 nova-api[10996]: 2017-09-28 12:52:35.780 10996 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:52:35 ctl02 nova-api[10996]: 2017-09-28 12:52:35.780 10996 ERROR nova     max_url_len=max_url_len)
Sep 28 12:52:35 ctl02 nova-api[10996]: 2017-09-28 12:52:35.780 10996 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:52:35 ctl02 nova-api[10996]: 2017-09-28 12:52:35.780 10996 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:52:35 ctl02 nova-api[10996]: 2017-09-28 12:52:35.780 10996 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:52:35 ctl02 nova-api[10996]: 2017-09-28 12:52:35.780 10996 ERROR nova     sock.listen(backlog)
Sep 28 12:52:35 ctl02 nova-api[10996]: 2017-09-28 12:52:35.780 10996 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:52:35 ctl02 nova-api[10996]: 2017-09-28 12:52:35.780 10996 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:52:35 ctl02 nova-api[10996]: 2017-09-28 12:52:35.780 10996 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:52:35 ctl02 nova-api[10996]: 2017-09-28 12:52:35.780 10996 ERROR nova
Sep 28 12:52:35 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:52:35 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:52:35 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:52:36 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:52:36 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:52:36 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:52:36 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:52:36 ctl02 neutron-server[30536]: 2017-09-28 12:52:36.160 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 12:52:36 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:52:36 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:50:56 cmp002
Sep 28 12:52:36 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:51:38 cmp001
Sep 28 12:52:36 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:52:00 cmp002
Sep 28 12:52:36 ctl02 nova-scheduler[5620]: 2017-09-28 12:52:36.235 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:52:36 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb79f1b5e)
Sep 28 12:52:36 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:52:36.570 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:52:36] "OPTIONS / HTTP/1.0" 200 134 0.000353
Sep 28 12:52:37 ctl02 heat-api[13008]: 2017-09-28 12:52:37.129 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:52:37] "OPTIONS / HTTP/1.0" 200 134 0.000515
Sep 28 12:52:37 ctl02 heat-api-cfn[13300]: 2017-09-28 12:52:37.262 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:52:37] "OPTIONS / HTTP/1.0" 200 134 0.000533
Sep 28 12:52:37 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb79f1b5e)
Sep 28 12:52:37 ctl02 nova-api[11016]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:52:37 ctl02 nova-api[11016]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:52:37 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:52:37.847 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:52:37] "OPTIONS / HTTP/1.0" 200 134 0.000384
Sep 28 12:52:37 ctl02 heat-api-cfn[13300]: 2017-09-28 12:52:37.916 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:52:37] "OPTIONS / HTTP/1.0" 200 134 0.000448
Sep 28 12:52:38 ctl02 nova-api[11016]: 2017-09-28 12:52:38.015 11016 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:52:38 ctl02 nova-api[11016]: 2017-09-28 12:52:38.017 11016 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:52:38 ctl02 nova-api[11016]: 2017-09-28 12:52:38.017 11016 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:52:38 ctl02 nova-api[11016]: 2017-09-28 12:52:38.017 11016 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:52:38 ctl02 nova-api[11016]: 2017-09-28 12:52:38.017 11016 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:52:38 ctl02 nova-api[11016]: 2017-09-28 12:52:38.017 11016 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:52:38 ctl02 nova-api[11016]: 2017-09-28 12:52:38.017 11016 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:52:38 ctl02 nova-api[11016]: 2017-09-28 12:52:38.017 11016 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:52:38 ctl02 nova-api[11016]: 2017-09-28 12:52:38.017 11016 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:52:38 ctl02 nova-api[11016]: 2017-09-28 12:52:38.017 11016 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:52:38 ctl02 nova-api[11016]: 2017-09-28 12:52:38.017 11016 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:52:38 ctl02 nova-api[11016]: 2017-09-28 12:52:38.017 11016 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:52:38 ctl02 nova-api[11016]: 2017-09-28 12:52:38.017 11016 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:52:38 ctl02 nova-api[11016]: 2017-09-28 12:52:38.017 11016 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:52:38 ctl02 nova-api[11016]: 2017-09-28 12:52:38.017 11016 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:52:38 ctl02 nova-api[11016]: 2017-09-28 12:52:38.017 11016 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:52:38 ctl02 nova-api[11016]: 2017-09-28 12:52:38.017 11016 ERROR nova.wsgi     self.filename))
Sep 28 12:52:38 ctl02 nova-api[11016]: 2017-09-28 12:52:38.017 11016 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:52:38 ctl02 nova-api[11016]: 2017-09-28 12:52:38.017 11016 ERROR nova.wsgi
Sep 28 12:52:38 ctl02 nova-api[11016]: 2017-09-28 12:52:38.018 11016 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:52:38 ctl02 nova-api[11016]: 2017-09-28 12:52:38.149 11016 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:52:38 ctl02 nova-api[11016]: 2017-09-28 12:52:38.396 11016 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:52:38 ctl02 nova-api[11016]: 2017-09-28 12:52:38.398 11016 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:52:38 ctl02 nova-api[11016]: 2017-09-28 12:52:38.422 11016 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:52:38 ctl02 nova-api[11016]: 2017-09-28 12:52:38.422 11016 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:52:38 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb79f1b5e)
Sep 28 12:52:38 ctl02 nova-api[11016]: 2017-09-28 12:52:38.553 11016 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:52:38 ctl02 nova-api[11016]: 2017-09-28 12:52:38.555 11016 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:52:38 ctl02 nova-api[11016]: 2017-09-28 12:52:38.555 11016 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:52:38 ctl02 nova-api[11016]: 2017-09-28 12:52:38.555 11016 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:52:38 ctl02 nova-api[11016]: 2017-09-28 12:52:38.558 11016 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:52:38 ctl02 nova-api[11016]: 2017-09-28 12:52:38.559 11016 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:52:38 ctl02 nova-api[11016]: 2017-09-28 12:52:38.559 11016 ERROR nova Traceback (most recent call last):
Sep 28 12:52:38 ctl02 nova-api[11016]: 2017-09-28 12:52:38.559 11016 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:52:38 ctl02 nova-api[11016]: 2017-09-28 12:52:38.559 11016 ERROR nova     sys.exit(main())
Sep 28 12:52:38 ctl02 nova-api[11016]: 2017-09-28 12:52:38.559 11016 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:52:38 ctl02 nova-api[11016]: 2017-09-28 12:52:38.559 11016 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:52:38 ctl02 nova-api[11016]: 2017-09-28 12:52:38.559 11016 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:52:38 ctl02 nova-api[11016]: 2017-09-28 12:52:38.559 11016 ERROR nova     max_url_len=max_url_len)
Sep 28 12:52:38 ctl02 nova-api[11016]: 2017-09-28 12:52:38.559 11016 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:52:38 ctl02 nova-api[11016]: 2017-09-28 12:52:38.559 11016 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:52:38 ctl02 nova-api[11016]: 2017-09-28 12:52:38.559 11016 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:52:38 ctl02 nova-api[11016]: 2017-09-28 12:52:38.559 11016 ERROR nova     sock.listen(backlog)
Sep 28 12:52:38 ctl02 nova-api[11016]: 2017-09-28 12:52:38.559 11016 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:52:38 ctl02 nova-api[11016]: 2017-09-28 12:52:38.559 11016 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:52:38 ctl02 nova-api[11016]: 2017-09-28 12:52:38.559 11016 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:52:38 ctl02 nova-api[11016]: 2017-09-28 12:52:38.559 11016 ERROR nova
Sep 28 12:52:38 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:52:38 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:52:38 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:52:38 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:52:38 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:52:38 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:52:38 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:52:39 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb79f1b5e)
Sep 28 12:52:39 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:52:39.677 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:52:39] "OPTIONS / HTTP/1.0" 200 134 0.000364
Sep 28 12:52:40 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb79f1b5e)
Sep 28 12:52:40 ctl02 glance-api[29183]: 2017-09-28 12:52:40.543 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:52:40] "OPTIONS / HTTP/1.0" 200 134 0.000549
Sep 28 12:52:40 ctl02 nova-api[11034]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:52:40 ctl02 nova-api[11034]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:52:40 ctl02 neutron-server[30536]: 2017-09-28 12:52:40.757 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:52:40] "OPTIONS / HTTP/1.0" 200 262 0.000490
Sep 28 12:52:40 ctl02 nova-api[11034]: 2017-09-28 12:52:40.785 11034 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:52:40 ctl02 nova-api[11034]: 2017-09-28 12:52:40.787 11034 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:52:40 ctl02 nova-api[11034]: 2017-09-28 12:52:40.787 11034 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:52:40 ctl02 nova-api[11034]: 2017-09-28 12:52:40.787 11034 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:52:40 ctl02 nova-api[11034]: 2017-09-28 12:52:40.787 11034 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:52:40 ctl02 nova-api[11034]: 2017-09-28 12:52:40.787 11034 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:52:40 ctl02 nova-api[11034]: 2017-09-28 12:52:40.787 11034 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:52:40 ctl02 nova-api[11034]: 2017-09-28 12:52:40.787 11034 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:52:40 ctl02 nova-api[11034]: 2017-09-28 12:52:40.787 11034 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:52:40 ctl02 nova-api[11034]: 2017-09-28 12:52:40.787 11034 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:52:40 ctl02 nova-api[11034]: 2017-09-28 12:52:40.787 11034 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:52:40 ctl02 nova-api[11034]: 2017-09-28 12:52:40.787 11034 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:52:40 ctl02 nova-api[11034]: 2017-09-28 12:52:40.787 11034 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:52:40 ctl02 nova-api[11034]: 2017-09-28 12:52:40.787 11034 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:52:40 ctl02 nova-api[11034]: 2017-09-28 12:52:40.787 11034 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:52:40 ctl02 nova-api[11034]: 2017-09-28 12:52:40.787 11034 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:52:40 ctl02 nova-api[11034]: 2017-09-28 12:52:40.787 11034 ERROR nova.wsgi     self.filename))
Sep 28 12:52:40 ctl02 nova-api[11034]: 2017-09-28 12:52:40.787 11034 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:52:40 ctl02 nova-api[11034]: 2017-09-28 12:52:40.787 11034 ERROR nova.wsgi
Sep 28 12:52:40 ctl02 nova-api[11034]: 2017-09-28 12:52:40.788 11034 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:52:40 ctl02 nova-api[11034]: 2017-09-28 12:52:40.929 11034 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:52:41 ctl02 nova-api[11034]: 2017-09-28 12:52:41.179 11034 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:52:41 ctl02 nova-api[11034]: 2017-09-28 12:52:41.182 11034 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:52:41 ctl02 nova-api[11034]: 2017-09-28 12:52:41.182 11034 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:52:41 ctl02 nova-api[11034]: 2017-09-28 12:52:41.182 11034 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:52:41 ctl02 nova-api[11034]: 2017-09-28 12:52:41.317 11034 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:52:41 ctl02 nova-api[11034]: 2017-09-28 12:52:41.319 11034 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:52:41 ctl02 nova-api[11034]: 2017-09-28 12:52:41.320 11034 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:52:41 ctl02 nova-api[11034]: 2017-09-28 12:52:41.320 11034 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:52:41 ctl02 nova-api[11034]: 2017-09-28 12:52:41.323 11034 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:52:41 ctl02 nova-api[11034]: 2017-09-28 12:52:41.324 11034 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:52:41 ctl02 nova-api[11034]: 2017-09-28 12:52:41.324 11034 ERROR nova Traceback (most recent call last):
Sep 28 12:52:41 ctl02 nova-api[11034]: 2017-09-28 12:52:41.324 11034 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:52:41 ctl02 nova-api[11034]: 2017-09-28 12:52:41.324 11034 ERROR nova     sys.exit(main())
Sep 28 12:52:41 ctl02 nova-api[11034]: 2017-09-28 12:52:41.324 11034 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:52:41 ctl02 nova-api[11034]: 2017-09-28 12:52:41.324 11034 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:52:41 ctl02 nova-api[11034]: 2017-09-28 12:52:41.324 11034 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:52:41 ctl02 nova-api[11034]: 2017-09-28 12:52:41.324 11034 ERROR nova     max_url_len=max_url_len)
Sep 28 12:52:41 ctl02 nova-api[11034]: 2017-09-28 12:52:41.324 11034 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:52:41 ctl02 nova-api[11034]: 2017-09-28 12:52:41.324 11034 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:52:41 ctl02 nova-api[11034]: 2017-09-28 12:52:41.324 11034 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:52:41 ctl02 nova-api[11034]: 2017-09-28 12:52:41.324 11034 ERROR nova     sock.listen(backlog)
Sep 28 12:52:41 ctl02 nova-api[11034]: 2017-09-28 12:52:41.324 11034 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:52:41 ctl02 nova-api[11034]: 2017-09-28 12:52:41.324 11034 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:52:41 ctl02 nova-api[11034]: 2017-09-28 12:52:41.324 11034 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:52:41 ctl02 nova-api[11034]: 2017-09-28 12:52:41.324 11034 ERROR nova
Sep 28 12:52:41 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb79f1b5e)
Sep 28 12:52:41 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:52:41 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:52:41 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:52:41 ctl02 heat-api[13008]: 2017-09-28 12:52:41.545 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:52:41] "OPTIONS / HTTP/1.0" 200 134 0.000679
Sep 28 12:52:41 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:52:41 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:52:41 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:52:41 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:52:41 ctl02 heat-api-cfn[13300]: 2017-09-28 12:52:41.746 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:52:41] "OPTIONS / HTTP/1.0" 200 134 0.000466
Sep 28 12:52:42 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb79f1b5e)
Sep 28 12:52:42 ctl02 glance-api[29183]: 2017-09-28 12:52:42.636 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:52:42] "OPTIONS / HTTP/1.0" 200 134 0.000557
Sep 28 12:52:42 ctl02 glance-api[29183]: 2017-09-28 12:52:42.719 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:52:42] "OPTIONS / HTTP/1.0" 200 134 0.000795
Sep 28 12:52:43 ctl02 neutron-server[30536]: 2017-09-28 12:52:43.086 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:52:43] "OPTIONS / HTTP/1.0" 200 262 0.000601
Sep 28 12:52:43 ctl02 nova-api[11052]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:52:43 ctl02 nova-api[11052]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:52:43 ctl02 nova-api[11052]: 2017-09-28 12:52:43.465 11052 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:52:43 ctl02 nova-api[11052]: 2017-09-28 12:52:43.467 11052 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:52:43 ctl02 nova-api[11052]: 2017-09-28 12:52:43.467 11052 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:52:43 ctl02 nova-api[11052]: 2017-09-28 12:52:43.467 11052 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:52:43 ctl02 nova-api[11052]: 2017-09-28 12:52:43.467 11052 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:52:43 ctl02 nova-api[11052]: 2017-09-28 12:52:43.467 11052 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:52:43 ctl02 nova-api[11052]: 2017-09-28 12:52:43.467 11052 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:52:43 ctl02 nova-api[11052]: 2017-09-28 12:52:43.467 11052 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:52:43 ctl02 nova-api[11052]: 2017-09-28 12:52:43.467 11052 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:52:43 ctl02 nova-api[11052]: 2017-09-28 12:52:43.467 11052 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:52:43 ctl02 nova-api[11052]: 2017-09-28 12:52:43.467 11052 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:52:43 ctl02 nova-api[11052]: 2017-09-28 12:52:43.467 11052 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:52:43 ctl02 nova-api[11052]: 2017-09-28 12:52:43.467 11052 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:52:43 ctl02 nova-api[11052]: 2017-09-28 12:52:43.467 11052 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:52:43 ctl02 nova-api[11052]: 2017-09-28 12:52:43.467 11052 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:52:43 ctl02 nova-api[11052]: 2017-09-28 12:52:43.467 11052 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:52:43 ctl02 nova-api[11052]: 2017-09-28 12:52:43.467 11052 ERROR nova.wsgi     self.filename))
Sep 28 12:52:43 ctl02 nova-api[11052]: 2017-09-28 12:52:43.467 11052 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:52:43 ctl02 nova-api[11052]: 2017-09-28 12:52:43.467 11052 ERROR nova.wsgi
Sep 28 12:52:43 ctl02 nova-api[11052]: 2017-09-28 12:52:43.476 11052 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:52:43 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb79f1b5e)
Sep 28 12:52:43 ctl02 nova-api[11052]: 2017-09-28 12:52:43.603 11052 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:52:43 ctl02 nova-api[11052]: 2017-09-28 12:52:43.824 11052 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:52:43 ctl02 nova-api[11052]: 2017-09-28 12:52:43.826 11052 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:52:43 ctl02 nova-api[11052]: 2017-09-28 12:52:43.826 11052 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:52:43 ctl02 nova-api[11052]: 2017-09-28 12:52:43.827 11052 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:52:43 ctl02 nova-api[11052]: 2017-09-28 12:52:43.956 11052 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:52:43 ctl02 nova-api[11052]: 2017-09-28 12:52:43.958 11052 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:52:43 ctl02 nova-api[11052]: 2017-09-28 12:52:43.958 11052 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:52:43 ctl02 nova-api[11052]: 2017-09-28 12:52:43.958 11052 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:52:43 ctl02 nova-api[11052]: 2017-09-28 12:52:43.961 11052 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:52:43 ctl02 nova-api[11052]: 2017-09-28 12:52:43.962 11052 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:52:43 ctl02 nova-api[11052]: 2017-09-28 12:52:43.962 11052 ERROR nova Traceback (most recent call last):
Sep 28 12:52:43 ctl02 nova-api[11052]: 2017-09-28 12:52:43.962 11052 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:52:43 ctl02 nova-api[11052]: 2017-09-28 12:52:43.962 11052 ERROR nova     sys.exit(main())
Sep 28 12:52:43 ctl02 nova-api[11052]: 2017-09-28 12:52:43.962 11052 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:52:43 ctl02 nova-api[11052]: 2017-09-28 12:52:43.962 11052 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:52:43 ctl02 nova-api[11052]: 2017-09-28 12:52:43.962 11052 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:52:43 ctl02 nova-api[11052]: 2017-09-28 12:52:43.962 11052 ERROR nova     max_url_len=max_url_len)
Sep 28 12:52:43 ctl02 nova-api[11052]: 2017-09-28 12:52:43.962 11052 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:52:43 ctl02 nova-api[11052]: 2017-09-28 12:52:43.962 11052 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:52:43 ctl02 nova-api[11052]: 2017-09-28 12:52:43.962 11052 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:52:43 ctl02 nova-api[11052]: 2017-09-28 12:52:43.962 11052 ERROR nova     sock.listen(backlog)
Sep 28 12:52:43 ctl02 nova-api[11052]: 2017-09-28 12:52:43.962 11052 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:52:43 ctl02 nova-api[11052]: 2017-09-28 12:52:43.962 11052 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:52:43 ctl02 nova-api[11052]: 2017-09-28 12:52:43.962 11052 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:52:43 ctl02 nova-api[11052]: 2017-09-28 12:52:43.962 11052 ERROR nova
Sep 28 12:52:43 ctl02 neutron-server[30536]: 2017-09-28 12:52:43.967 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:52:43] "OPTIONS / HTTP/1.0" 200 262 0.000491
Sep 28 12:52:44 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:52:44 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:52:44 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:52:44 ctl02 heat-api[13008]: 2017-09-28 12:52:44.304 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:52:44] "OPTIONS / HTTP/1.0" 200 134 0.000742
Sep 28 12:52:44 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:52:44 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:52:44 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:52:44 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:52:44 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb79f1b5e)
Sep 28 12:52:45 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb79f1b5e)
Sep 28 12:52:46 ctl02 nova-api[11070]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:52:46 ctl02 nova-api[11070]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:52:46 ctl02 nova-api[11070]: 2017-09-28 12:52:46.273 11070 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:52:46 ctl02 nova-api[11070]: 2017-09-28 12:52:46.275 11070 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:52:46 ctl02 nova-api[11070]: 2017-09-28 12:52:46.275 11070 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:52:46 ctl02 nova-api[11070]: 2017-09-28 12:52:46.275 11070 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:52:46 ctl02 nova-api[11070]: 2017-09-28 12:52:46.275 11070 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:52:46 ctl02 nova-api[11070]: 2017-09-28 12:52:46.275 11070 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:52:46 ctl02 nova-api[11070]: 2017-09-28 12:52:46.275 11070 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:52:46 ctl02 nova-api[11070]: 2017-09-28 12:52:46.275 11070 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:52:46 ctl02 nova-api[11070]: 2017-09-28 12:52:46.275 11070 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:52:46 ctl02 nova-api[11070]: 2017-09-28 12:52:46.275 11070 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:52:46 ctl02 nova-api[11070]: 2017-09-28 12:52:46.275 11070 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:52:46 ctl02 nova-api[11070]: 2017-09-28 12:52:46.275 11070 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:52:46 ctl02 nova-api[11070]: 2017-09-28 12:52:46.275 11070 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:52:46 ctl02 nova-api[11070]: 2017-09-28 12:52:46.275 11070 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:52:46 ctl02 nova-api[11070]: 2017-09-28 12:52:46.275 11070 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:52:46 ctl02 nova-api[11070]: 2017-09-28 12:52:46.275 11070 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:52:46 ctl02 nova-api[11070]: 2017-09-28 12:52:46.275 11070 ERROR nova.wsgi     self.filename))
Sep 28 12:52:46 ctl02 nova-api[11070]: 2017-09-28 12:52:46.275 11070 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:52:46 ctl02 nova-api[11070]: 2017-09-28 12:52:46.275 11070 ERROR nova.wsgi
Sep 28 12:52:46 ctl02 nova-api[11070]: 2017-09-28 12:52:46.276 11070 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:52:46 ctl02 nova-api[11070]: 2017-09-28 12:52:46.408 11070 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:52:46 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb79f1b5e)
Sep 28 12:52:46 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:52:46.500 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:52:46] "OPTIONS / HTTP/1.0" 200 134 0.000532
Sep 28 12:52:46 ctl02 nova-api[11070]: 2017-09-28 12:52:46.654 11070 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:52:46 ctl02 nova-api[11070]: 2017-09-28 12:52:46.657 11070 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:52:46 ctl02 nova-api[11070]: 2017-09-28 12:52:46.657 11070 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:52:46 ctl02 nova-api[11070]: 2017-09-28 12:52:46.657 11070 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:52:46 ctl02 nova-api[11070]: 2017-09-28 12:52:46.789 11070 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:52:46 ctl02 nova-api[11070]: 2017-09-28 12:52:46.791 11070 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:52:46 ctl02 nova-api[11070]: 2017-09-28 12:52:46.791 11070 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:52:46 ctl02 nova-api[11070]: 2017-09-28 12:52:46.791 11070 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:52:46 ctl02 nova-api[11070]: 2017-09-28 12:52:46.794 11070 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:52:46 ctl02 nova-api[11070]: 2017-09-28 12:52:46.795 11070 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:52:46 ctl02 nova-api[11070]: 2017-09-28 12:52:46.795 11070 ERROR nova Traceback (most recent call last):
Sep 28 12:52:46 ctl02 nova-api[11070]: 2017-09-28 12:52:46.795 11070 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:52:46 ctl02 nova-api[11070]: 2017-09-28 12:52:46.795 11070 ERROR nova     sys.exit(main())
Sep 28 12:52:46 ctl02 nova-api[11070]: 2017-09-28 12:52:46.795 11070 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:52:46 ctl02 nova-api[11070]: 2017-09-28 12:52:46.795 11070 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:52:46 ctl02 nova-api[11070]: 2017-09-28 12:52:46.795 11070 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:52:46 ctl02 nova-api[11070]: 2017-09-28 12:52:46.795 11070 ERROR nova     max_url_len=max_url_len)
Sep 28 12:52:46 ctl02 nova-api[11070]: 2017-09-28 12:52:46.795 11070 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:52:46 ctl02 nova-api[11070]: 2017-09-28 12:52:46.795 11070 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:52:46 ctl02 nova-api[11070]: 2017-09-28 12:52:46.795 11070 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:52:46 ctl02 nova-api[11070]: 2017-09-28 12:52:46.795 11070 ERROR nova     sock.listen(backlog)
Sep 28 12:52:46 ctl02 nova-api[11070]: 2017-09-28 12:52:46.795 11070 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:52:46 ctl02 nova-api[11070]: 2017-09-28 12:52:46.795 11070 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:52:46 ctl02 nova-api[11070]: 2017-09-28 12:52:46.795 11070 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:52:46 ctl02 nova-api[11070]: 2017-09-28 12:52:46.795 11070 ERROR nova
Sep 28 12:52:46 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:52:46 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:52:46 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:52:47 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:52:47 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:52:47 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:52:47 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:52:47 ctl02 heat-api[13008]: 2017-09-28 12:52:47.183 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:52:47] "OPTIONS / HTTP/1.0" 200 134 0.000601
Sep 28 12:52:47 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:52:47 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:52:47 ctl02 heat-api-cfn[13300]: 2017-09-28 12:52:47.557 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:52:47] "OPTIONS / HTTP/1.0" 200 134 0.000529
Sep 28 12:52:47 ctl02 heat-api-cfn[13300]: 2017-09-28 12:52:47.807 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:52:47] "OPTIONS / HTTP/1.0" 200 134 0.000468
Sep 28 12:52:48 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:52:48.048 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:52:48] "OPTIONS / HTTP/1.0" 200 134 0.000356
Sep 28 12:52:48 ctl02 nova-api[11088]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:52:48 ctl02 nova-api[11088]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:52:48 ctl02 nova-api[11088]: 2017-09-28 12:52:48.946 11088 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:52:48 ctl02 nova-api[11088]: 2017-09-28 12:52:48.948 11088 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:52:48 ctl02 nova-api[11088]: 2017-09-28 12:52:48.948 11088 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:52:48 ctl02 nova-api[11088]: 2017-09-28 12:52:48.948 11088 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:52:48 ctl02 nova-api[11088]: 2017-09-28 12:52:48.948 11088 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:52:48 ctl02 nova-api[11088]: 2017-09-28 12:52:48.948 11088 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:52:48 ctl02 nova-api[11088]: 2017-09-28 12:52:48.948 11088 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:52:48 ctl02 nova-api[11088]: 2017-09-28 12:52:48.948 11088 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:52:48 ctl02 nova-api[11088]: 2017-09-28 12:52:48.948 11088 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:52:48 ctl02 nova-api[11088]: 2017-09-28 12:52:48.948 11088 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:52:48 ctl02 nova-api[11088]: 2017-09-28 12:52:48.948 11088 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:52:48 ctl02 nova-api[11088]: 2017-09-28 12:52:48.948 11088 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:52:48 ctl02 nova-api[11088]: 2017-09-28 12:52:48.948 11088 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:52:48 ctl02 nova-api[11088]: 2017-09-28 12:52:48.948 11088 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:52:48 ctl02 nova-api[11088]: 2017-09-28 12:52:48.948 11088 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:52:48 ctl02 nova-api[11088]: 2017-09-28 12:52:48.948 11088 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:52:48 ctl02 nova-api[11088]: 2017-09-28 12:52:48.948 11088 ERROR nova.wsgi     self.filename))
Sep 28 12:52:48 ctl02 nova-api[11088]: 2017-09-28 12:52:48.948 11088 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:52:48 ctl02 nova-api[11088]: 2017-09-28 12:52:48.948 11088 ERROR nova.wsgi
Sep 28 12:52:48 ctl02 nova-api[11088]: 2017-09-28 12:52:48.950 11088 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:52:49 ctl02 nova-api[11088]: 2017-09-28 12:52:49.076 11088 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:52:49 ctl02 nova-api[11088]: 2017-09-28 12:52:49.296 11088 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:52:49 ctl02 nova-api[11088]: 2017-09-28 12:52:49.299 11088 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:52:49 ctl02 nova-api[11088]: 2017-09-28 12:52:49.299 11088 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:52:49 ctl02 nova-api[11088]: 2017-09-28 12:52:49.300 11088 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:52:49 ctl02 nova-api[11088]: 2017-09-28 12:52:49.429 11088 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:52:49 ctl02 nova-api[11088]: 2017-09-28 12:52:49.432 11088 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:52:49 ctl02 nova-api[11088]: 2017-09-28 12:52:49.432 11088 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:52:49 ctl02 nova-api[11088]: 2017-09-28 12:52:49.432 11088 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:52:49 ctl02 nova-api[11088]: 2017-09-28 12:52:49.436 11088 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:52:49 ctl02 nova-api[11088]: 2017-09-28 12:52:49.436 11088 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:52:49 ctl02 nova-api[11088]: 2017-09-28 12:52:49.436 11088 ERROR nova Traceback (most recent call last):
Sep 28 12:52:49 ctl02 nova-api[11088]: 2017-09-28 12:52:49.436 11088 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:52:49 ctl02 nova-api[11088]: 2017-09-28 12:52:49.436 11088 ERROR nova     sys.exit(main())
Sep 28 12:52:49 ctl02 nova-api[11088]: 2017-09-28 12:52:49.436 11088 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:52:49 ctl02 nova-api[11088]: 2017-09-28 12:52:49.436 11088 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:52:49 ctl02 nova-api[11088]: 2017-09-28 12:52:49.436 11088 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:52:49 ctl02 nova-api[11088]: 2017-09-28 12:52:49.436 11088 ERROR nova     max_url_len=max_url_len)
Sep 28 12:52:49 ctl02 nova-api[11088]: 2017-09-28 12:52:49.436 11088 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:52:49 ctl02 nova-api[11088]: 2017-09-28 12:52:49.436 11088 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:52:49 ctl02 nova-api[11088]: 2017-09-28 12:52:49.436 11088 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:52:49 ctl02 nova-api[11088]: 2017-09-28 12:52:49.436 11088 ERROR nova     sock.listen(backlog)
Sep 28 12:52:49 ctl02 nova-api[11088]: 2017-09-28 12:52:49.436 11088 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:52:49 ctl02 nova-api[11088]: 2017-09-28 12:52:49.436 11088 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:52:49 ctl02 nova-api[11088]: 2017-09-28 12:52:49.436 11088 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:52:49 ctl02 nova-api[11088]: 2017-09-28 12:52:49.436 11088 ERROR nova
Sep 28 12:52:49 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:52:49 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:52:49 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:52:49 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:52:49.671 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:52:49] "OPTIONS / HTTP/1.0" 200 134 0.000409
Sep 28 12:52:49 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:52:49 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:52:49 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:52:49 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:52:50 ctl02 glance-api[29183]: 2017-09-28 12:52:50.813 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:52:50] "OPTIONS / HTTP/1.0" 200 134 0.000542
Sep 28 12:52:50 ctl02 neutron-server[30536]: 2017-09-28 12:52:50.881 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:52:50] "OPTIONS / HTTP/1.0" 200 262 0.000433
Sep 28 12:52:51 ctl02 neutron-server[30536]: 2017-09-28 12:52:51.157 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 12:52:51 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:52:51 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:50:56 cmp002
Sep 28 12:52:51 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:51:38 cmp001
Sep 28 12:52:51 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:52:00 cmp002
Sep 28 12:52:51 ctl02 nova-api[11111]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:52:51 ctl02 nova-api[11111]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:52:51 ctl02 heat-api[13008]: 2017-09-28 12:52:51.723 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:52:51] "OPTIONS / HTTP/1.0" 200 134 0.000549
Sep 28 12:52:51 ctl02 nova-api[11111]: 2017-09-28 12:52:51.768 11111 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:52:51 ctl02 nova-api[11111]: 2017-09-28 12:52:51.770 11111 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:52:51 ctl02 nova-api[11111]: 2017-09-28 12:52:51.770 11111 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:52:51 ctl02 nova-api[11111]: 2017-09-28 12:52:51.770 11111 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:52:51 ctl02 nova-api[11111]: 2017-09-28 12:52:51.770 11111 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:52:51 ctl02 nova-api[11111]: 2017-09-28 12:52:51.770 11111 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:52:51 ctl02 nova-api[11111]: 2017-09-28 12:52:51.770 11111 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:52:51 ctl02 nova-api[11111]: 2017-09-28 12:52:51.770 11111 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:52:51 ctl02 nova-api[11111]: 2017-09-28 12:52:51.770 11111 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:52:51 ctl02 nova-api[11111]: 2017-09-28 12:52:51.770 11111 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:52:51 ctl02 nova-api[11111]: 2017-09-28 12:52:51.770 11111 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:52:51 ctl02 nova-api[11111]: 2017-09-28 12:52:51.770 11111 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:52:51 ctl02 nova-api[11111]: 2017-09-28 12:52:51.770 11111 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:52:51 ctl02 nova-api[11111]: 2017-09-28 12:52:51.770 11111 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:52:51 ctl02 nova-api[11111]: 2017-09-28 12:52:51.770 11111 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:52:51 ctl02 nova-api[11111]: 2017-09-28 12:52:51.770 11111 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:52:51 ctl02 nova-api[11111]: 2017-09-28 12:52:51.770 11111 ERROR nova.wsgi     self.filename))
Sep 28 12:52:51 ctl02 nova-api[11111]: 2017-09-28 12:52:51.770 11111 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:52:51 ctl02 nova-api[11111]: 2017-09-28 12:52:51.770 11111 ERROR nova.wsgi
Sep 28 12:52:51 ctl02 nova-api[11111]: 2017-09-28 12:52:51.772 11111 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:52:51 ctl02 heat-api-cfn[13300]: 2017-09-28 12:52:51.876 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:52:51] "OPTIONS / HTTP/1.0" 200 134 0.000454
Sep 28 12:52:51 ctl02 nova-api[11111]: 2017-09-28 12:52:51.906 11111 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:52:52 ctl02 nova-api[11111]: 2017-09-28 12:52:52.134 11111 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:52:52 ctl02 nova-api[11111]: 2017-09-28 12:52:52.137 11111 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:52:52 ctl02 nova-api[11111]: 2017-09-28 12:52:52.137 11111 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:52:52 ctl02 nova-api[11111]: 2017-09-28 12:52:52.138 11111 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:52:52 ctl02 nova-api[11111]: 2017-09-28 12:52:52.274 11111 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:52:52 ctl02 nova-api[11111]: 2017-09-28 12:52:52.276 11111 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:52:52 ctl02 nova-api[11111]: 2017-09-28 12:52:52.277 11111 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:52:52 ctl02 nova-api[11111]: 2017-09-28 12:52:52.277 11111 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:52:52 ctl02 nova-api[11111]: 2017-09-28 12:52:52.280 11111 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:52:52 ctl02 nova-api[11111]: 2017-09-28 12:52:52.281 11111 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:52:52 ctl02 nova-api[11111]: 2017-09-28 12:52:52.281 11111 ERROR nova Traceback (most recent call last):
Sep 28 12:52:52 ctl02 nova-api[11111]: 2017-09-28 12:52:52.281 11111 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:52:52 ctl02 nova-api[11111]: 2017-09-28 12:52:52.281 11111 ERROR nova     sys.exit(main())
Sep 28 12:52:52 ctl02 nova-api[11111]: 2017-09-28 12:52:52.281 11111 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:52:52 ctl02 nova-api[11111]: 2017-09-28 12:52:52.281 11111 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:52:52 ctl02 nova-api[11111]: 2017-09-28 12:52:52.281 11111 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:52:52 ctl02 nova-api[11111]: 2017-09-28 12:52:52.281 11111 ERROR nova     max_url_len=max_url_len)
Sep 28 12:52:52 ctl02 nova-api[11111]: 2017-09-28 12:52:52.281 11111 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:52:52 ctl02 nova-api[11111]: 2017-09-28 12:52:52.281 11111 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:52:52 ctl02 nova-api[11111]: 2017-09-28 12:52:52.281 11111 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:52:52 ctl02 nova-api[11111]: 2017-09-28 12:52:52.281 11111 ERROR nova     sock.listen(backlog)
Sep 28 12:52:52 ctl02 nova-api[11111]: 2017-09-28 12:52:52.281 11111 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:52:52 ctl02 nova-api[11111]: 2017-09-28 12:52:52.281 11111 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:52:52 ctl02 nova-api[11111]: 2017-09-28 12:52:52.281 11111 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:52:52 ctl02 nova-api[11111]: 2017-09-28 12:52:52.281 11111 ERROR nova
Sep 28 12:52:52 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:52:52 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:52:52 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:52:52 ctl02 glance-api[29183]: 2017-09-28 12:52:52.480 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:52:52] "OPTIONS / HTTP/1.0" 200 134 0.000590
Sep 28 12:52:52 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:52:52 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:52:52 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:52:52 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:52:52 ctl02 glance-api[29183]: 2017-09-28 12:52:52.832 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:52:52] "OPTIONS / HTTP/1.0" 200 134 0.000615
Sep 28 12:52:53 ctl02 neutron-server[30536]: 2017-09-28 12:52:53.226 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:52:53] "OPTIONS / HTTP/1.0" 200 262 0.000463
Sep 28 12:52:53 ctl02 neutron-server[30536]: 2017-09-28 12:52:53.950 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:52:53] "OPTIONS / HTTP/1.0" 200 262 0.000447
Sep 28 12:52:54 ctl02 nova-api[11129]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:52:54 ctl02 nova-api[11129]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:52:54 ctl02 nova-api[11129]: 2017-09-28 12:52:54.459 11129 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:52:54 ctl02 nova-api[11129]: 2017-09-28 12:52:54.461 11129 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:52:54 ctl02 nova-api[11129]: 2017-09-28 12:52:54.461 11129 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:52:54 ctl02 nova-api[11129]: 2017-09-28 12:52:54.461 11129 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:52:54 ctl02 nova-api[11129]: 2017-09-28 12:52:54.461 11129 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:52:54 ctl02 nova-api[11129]: 2017-09-28 12:52:54.461 11129 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:52:54 ctl02 nova-api[11129]: 2017-09-28 12:52:54.461 11129 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:52:54 ctl02 nova-api[11129]: 2017-09-28 12:52:54.461 11129 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:52:54 ctl02 nova-api[11129]: 2017-09-28 12:52:54.461 11129 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:52:54 ctl02 nova-api[11129]: 2017-09-28 12:52:54.461 11129 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:52:54 ctl02 nova-api[11129]: 2017-09-28 12:52:54.461 11129 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:52:54 ctl02 nova-api[11129]: 2017-09-28 12:52:54.461 11129 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:52:54 ctl02 nova-api[11129]: 2017-09-28 12:52:54.461 11129 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:52:54 ctl02 nova-api[11129]: 2017-09-28 12:52:54.461 11129 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:52:54 ctl02 nova-api[11129]: 2017-09-28 12:52:54.461 11129 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:52:54 ctl02 nova-api[11129]: 2017-09-28 12:52:54.461 11129 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:52:54 ctl02 nova-api[11129]: 2017-09-28 12:52:54.461 11129 ERROR nova.wsgi     self.filename))
Sep 28 12:52:54 ctl02 nova-api[11129]: 2017-09-28 12:52:54.461 11129 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:52:54 ctl02 nova-api[11129]: 2017-09-28 12:52:54.461 11129 ERROR nova.wsgi
Sep 28 12:52:54 ctl02 nova-api[11129]: 2017-09-28 12:52:54.463 11129 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:52:54 ctl02 heat-api[13008]: 2017-09-28 12:52:54.580 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:52:54] "OPTIONS / HTTP/1.0" 200 134 0.000550
Sep 28 12:52:54 ctl02 nova-api[11129]: 2017-09-28 12:52:54.591 11129 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:52:54 ctl02 nova-api[11129]: 2017-09-28 12:52:54.814 11129 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:52:54 ctl02 nova-api[11129]: 2017-09-28 12:52:54.817 11129 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:52:54 ctl02 nova-api[11129]: 2017-09-28 12:52:54.817 11129 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:52:54 ctl02 nova-api[11129]: 2017-09-28 12:52:54.818 11129 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:52:54 ctl02 nova-api[11129]: 2017-09-28 12:52:54.948 11129 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:52:54 ctl02 nova-api[11129]: 2017-09-28 12:52:54.950 11129 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:52:54 ctl02 nova-api[11129]: 2017-09-28 12:52:54.950 11129 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:52:54 ctl02 nova-api[11129]: 2017-09-28 12:52:54.950 11129 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:52:54 ctl02 nova-api[11129]: 2017-09-28 12:52:54.953 11129 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:52:54 ctl02 nova-api[11129]: 2017-09-28 12:52:54.954 11129 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:52:54 ctl02 nova-api[11129]: 2017-09-28 12:52:54.954 11129 ERROR nova Traceback (most recent call last):
Sep 28 12:52:54 ctl02 nova-api[11129]: 2017-09-28 12:52:54.954 11129 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:52:54 ctl02 nova-api[11129]: 2017-09-28 12:52:54.954 11129 ERROR nova     sys.exit(main())
Sep 28 12:52:54 ctl02 nova-api[11129]: 2017-09-28 12:52:54.954 11129 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:52:54 ctl02 nova-api[11129]: 2017-09-28 12:52:54.954 11129 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:52:54 ctl02 nova-api[11129]: 2017-09-28 12:52:54.954 11129 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:52:54 ctl02 nova-api[11129]: 2017-09-28 12:52:54.954 11129 ERROR nova     max_url_len=max_url_len)
Sep 28 12:52:54 ctl02 nova-api[11129]: 2017-09-28 12:52:54.954 11129 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:52:54 ctl02 nova-api[11129]: 2017-09-28 12:52:54.954 11129 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:52:54 ctl02 nova-api[11129]: 2017-09-28 12:52:54.954 11129 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:52:54 ctl02 nova-api[11129]: 2017-09-28 12:52:54.954 11129 ERROR nova     sock.listen(backlog)
Sep 28 12:52:54 ctl02 nova-api[11129]: 2017-09-28 12:52:54.954 11129 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:52:54 ctl02 nova-api[11129]: 2017-09-28 12:52:54.954 11129 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:52:54 ctl02 nova-api[11129]: 2017-09-28 12:52:54.954 11129 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:52:54 ctl02 nova-api[11129]: 2017-09-28 12:52:54.954 11129 ERROR nova
Sep 28 12:52:55 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:52:55 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:52:55 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:52:55 ctl02 nova-conductor[5056]: 2017-09-28 12:52:55.137 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:52:55 ctl02 nova-conductor[5056]: 2017-09-28 12:52:55.139 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:52:55 ctl02 nova-conductor[5056]: 2017-09-28 12:52:55.153 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:52:55 ctl02 nova-conductor[5056]: 2017-09-28 12:52:55.157 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:52:55 ctl02 nova-cert[4860]: 2017-09-28 12:52:55.332 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:52:55 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:52:55 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:52:55 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:52:55 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:52:56 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:52:56.139 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:52:56] "OPTIONS / HTTP/1.0" 200 134 0.000357
Sep 28 12:52:57 ctl02 nova-api[11147]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:52:57 ctl02 nova-api[11147]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:52:57 ctl02 nova-api[11147]: 2017-09-28 12:52:57.230 11147 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:52:57 ctl02 nova-api[11147]: 2017-09-28 12:52:57.232 11147 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:52:57 ctl02 nova-api[11147]: 2017-09-28 12:52:57.232 11147 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:52:57 ctl02 nova-api[11147]: 2017-09-28 12:52:57.232 11147 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:52:57 ctl02 nova-api[11147]: 2017-09-28 12:52:57.232 11147 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:52:57 ctl02 nova-api[11147]: 2017-09-28 12:52:57.232 11147 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:52:57 ctl02 nova-api[11147]: 2017-09-28 12:52:57.232 11147 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:52:57 ctl02 nova-api[11147]: 2017-09-28 12:52:57.232 11147 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:52:57 ctl02 nova-api[11147]: 2017-09-28 12:52:57.232 11147 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:52:57 ctl02 nova-api[11147]: 2017-09-28 12:52:57.232 11147 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:52:57 ctl02 nova-api[11147]: 2017-09-28 12:52:57.232 11147 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:52:57 ctl02 nova-api[11147]: 2017-09-28 12:52:57.232 11147 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:52:57 ctl02 nova-api[11147]: 2017-09-28 12:52:57.232 11147 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:52:57 ctl02 nova-api[11147]: 2017-09-28 12:52:57.232 11147 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:52:57 ctl02 nova-api[11147]: 2017-09-28 12:52:57.232 11147 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:52:57 ctl02 nova-api[11147]: 2017-09-28 12:52:57.232 11147 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:52:57 ctl02 nova-api[11147]: 2017-09-28 12:52:57.232 11147 ERROR nova.wsgi     self.filename))
Sep 28 12:52:57 ctl02 nova-api[11147]: 2017-09-28 12:52:57.232 11147 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:52:57 ctl02 nova-api[11147]: 2017-09-28 12:52:57.232 11147 ERROR nova.wsgi
Sep 28 12:52:57 ctl02 nova-api[11147]: 2017-09-28 12:52:57.233 11147 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:52:57 ctl02 heat-api[13008]: 2017-09-28 12:52:57.298 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:52:57] "OPTIONS / HTTP/1.0" 200 134 0.000521
Sep 28 12:52:57 ctl02 nova-api[11147]: 2017-09-28 12:52:57.361 11147 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:52:57 ctl02 heat-api-cfn[13300]: 2017-09-28 12:52:57.420 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:52:57] "OPTIONS / HTTP/1.0" 200 134 0.000559
Sep 28 12:52:57 ctl02 nova-api[11147]: 2017-09-28 12:52:57.583 11147 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:52:57 ctl02 nova-api[11147]: 2017-09-28 12:52:57.585 11147 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:52:57 ctl02 nova-api[11147]: 2017-09-28 12:52:57.585 11147 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:52:57 ctl02 nova-api[11147]: 2017-09-28 12:52:57.585 11147 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:52:57 ctl02 heat-api-cfn[13300]: 2017-09-28 12:52:57.627 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:52:57] "OPTIONS / HTTP/1.0" 200 134 0.000424
Sep 28 12:52:57 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:52:57.659 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:52:57] "OPTIONS / HTTP/1.0" 200 134 0.000350
Sep 28 12:52:57 ctl02 nova-api[11147]: 2017-09-28 12:52:57.716 11147 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:52:57 ctl02 nova-api[11147]: 2017-09-28 12:52:57.718 11147 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:52:57 ctl02 nova-api[11147]: 2017-09-28 12:52:57.718 11147 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:52:57 ctl02 nova-api[11147]: 2017-09-28 12:52:57.719 11147 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:52:57 ctl02 nova-api[11147]: 2017-09-28 12:52:57.722 11147 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:52:57 ctl02 nova-api[11147]: 2017-09-28 12:52:57.722 11147 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:52:57 ctl02 nova-api[11147]: 2017-09-28 12:52:57.722 11147 ERROR nova Traceback (most recent call last):
Sep 28 12:52:57 ctl02 nova-api[11147]: 2017-09-28 12:52:57.722 11147 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:52:57 ctl02 nova-api[11147]: 2017-09-28 12:52:57.722 11147 ERROR nova     sys.exit(main())
Sep 28 12:52:57 ctl02 nova-api[11147]: 2017-09-28 12:52:57.722 11147 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:52:57 ctl02 nova-api[11147]: 2017-09-28 12:52:57.722 11147 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:52:57 ctl02 nova-api[11147]: 2017-09-28 12:52:57.722 11147 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:52:57 ctl02 nova-api[11147]: 2017-09-28 12:52:57.722 11147 ERROR nova     max_url_len=max_url_len)
Sep 28 12:52:57 ctl02 nova-api[11147]: 2017-09-28 12:52:57.722 11147 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:52:57 ctl02 nova-api[11147]: 2017-09-28 12:52:57.722 11147 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:52:57 ctl02 nova-api[11147]: 2017-09-28 12:52:57.722 11147 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:52:57 ctl02 nova-api[11147]: 2017-09-28 12:52:57.722 11147 ERROR nova     sock.listen(backlog)
Sep 28 12:52:57 ctl02 nova-api[11147]: 2017-09-28 12:52:57.722 11147 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:52:57 ctl02 nova-api[11147]: 2017-09-28 12:52:57.722 11147 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:52:57 ctl02 nova-api[11147]: 2017-09-28 12:52:57.722 11147 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:52:57 ctl02 nova-api[11147]: 2017-09-28 12:52:57.722 11147 ERROR nova
Sep 28 12:52:57 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:52:57 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:52:57 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:52:58 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:52:58 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:52:58 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:52:58 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:52:58 ctl02 neutron-server[30536]: 2017-09-28 12:52:58.544 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:52:59 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:52:59.374 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:52:59] "OPTIONS / HTTP/1.0" 200 134 0.000482
Sep 28 12:52:59 ctl02 nova-api[11165]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:52:59 ctl02 nova-api[11165]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:53:00 ctl02 nova-api[11165]: 2017-09-28 12:53:00.026 11165 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:53:00 ctl02 nova-api[11165]: 2017-09-28 12:53:00.027 11165 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:53:00 ctl02 nova-api[11165]: 2017-09-28 12:53:00.027 11165 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:53:00 ctl02 nova-api[11165]: 2017-09-28 12:53:00.027 11165 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:53:00 ctl02 nova-api[11165]: 2017-09-28 12:53:00.027 11165 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:53:00 ctl02 nova-api[11165]: 2017-09-28 12:53:00.027 11165 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:53:00 ctl02 nova-api[11165]: 2017-09-28 12:53:00.027 11165 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:53:00 ctl02 nova-api[11165]: 2017-09-28 12:53:00.027 11165 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:53:00 ctl02 nova-api[11165]: 2017-09-28 12:53:00.027 11165 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:53:00 ctl02 nova-api[11165]: 2017-09-28 12:53:00.027 11165 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:53:00 ctl02 nova-api[11165]: 2017-09-28 12:53:00.027 11165 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:53:00 ctl02 nova-api[11165]: 2017-09-28 12:53:00.027 11165 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:53:00 ctl02 nova-api[11165]: 2017-09-28 12:53:00.027 11165 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:53:00 ctl02 nova-api[11165]: 2017-09-28 12:53:00.027 11165 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:53:00 ctl02 nova-api[11165]: 2017-09-28 12:53:00.027 11165 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:53:00 ctl02 nova-api[11165]: 2017-09-28 12:53:00.027 11165 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:53:00 ctl02 nova-api[11165]: 2017-09-28 12:53:00.027 11165 ERROR nova.wsgi     self.filename))
Sep 28 12:53:00 ctl02 nova-api[11165]: 2017-09-28 12:53:00.027 11165 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:53:00 ctl02 nova-api[11165]: 2017-09-28 12:53:00.027 11165 ERROR nova.wsgi
Sep 28 12:53:00 ctl02 nova-api[11165]: 2017-09-28 12:53:00.030 11165 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:53:00 ctl02 nova-api[11165]: 2017-09-28 12:53:00.166 11165 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:53:00 ctl02 neutron-server[30536]: 2017-09-28 12:53:00.318 30601 WARNING oslo_messaging._drivers.amqpdriver [req-44753fc7-ca39-4769-b8c6-0b5b0c03421f - - - - -] reply_692b03e6d8d44d758b6be19b067c3aa3 doesn't exists, drop reply to 770d9207472543e29ea2bdcf8fe6592a
Sep 28 12:53:00 ctl02 neutron-server[30536]: 2017-09-28 12:53:00.319 30601 INFO oslo_messaging._drivers.amqpdriver [req-44753fc7-ca39-4769-b8c6-0b5b0c03421f - - - - -] The reply 770d9207472543e29ea2bdcf8fe6592a cannot be sent  reply_692b03e6d8d44d758b6be19b067c3aa3 reply queue don't exist after 60 sec abandoning...
Sep 28 12:53:00 ctl02 nova-api[11165]: 2017-09-28 12:53:00.423 11165 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:53:00 ctl02 nova-api[11165]: 2017-09-28 12:53:00.425 11165 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:53:00 ctl02 nova-api[11165]: 2017-09-28 12:53:00.426 11165 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:53:00 ctl02 nova-api[11165]: 2017-09-28 12:53:00.426 11165 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:53:00 ctl02 nova-api[11165]: 2017-09-28 12:53:00.561 11165 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:53:00 ctl02 nova-api[11165]: 2017-09-28 12:53:00.564 11165 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:53:00 ctl02 nova-api[11165]: 2017-09-28 12:53:00.564 11165 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:53:00 ctl02 nova-api[11165]: 2017-09-28 12:53:00.565 11165 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:53:00 ctl02 nova-api[11165]: 2017-09-28 12:53:00.568 11165 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:53:00 ctl02 nova-api[11165]: 2017-09-28 12:53:00.569 11165 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:53:00 ctl02 nova-api[11165]: 2017-09-28 12:53:00.569 11165 ERROR nova Traceback (most recent call last):
Sep 28 12:53:00 ctl02 nova-api[11165]: 2017-09-28 12:53:00.569 11165 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:53:00 ctl02 nova-api[11165]: 2017-09-28 12:53:00.569 11165 ERROR nova     sys.exit(main())
Sep 28 12:53:00 ctl02 nova-api[11165]: 2017-09-28 12:53:00.569 11165 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:53:00 ctl02 nova-api[11165]: 2017-09-28 12:53:00.569 11165 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:53:00 ctl02 nova-api[11165]: 2017-09-28 12:53:00.569 11165 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:53:00 ctl02 nova-api[11165]: 2017-09-28 12:53:00.569 11165 ERROR nova     max_url_len=max_url_len)
Sep 28 12:53:00 ctl02 nova-api[11165]: 2017-09-28 12:53:00.569 11165 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:53:00 ctl02 nova-api[11165]: 2017-09-28 12:53:00.569 11165 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:53:00 ctl02 nova-api[11165]: 2017-09-28 12:53:00.569 11165 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:53:00 ctl02 nova-api[11165]: 2017-09-28 12:53:00.569 11165 ERROR nova     sock.listen(backlog)
Sep 28 12:53:00 ctl02 nova-api[11165]: 2017-09-28 12:53:00.569 11165 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:53:00 ctl02 nova-api[11165]: 2017-09-28 12:53:00.569 11165 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:53:00 ctl02 nova-api[11165]: 2017-09-28 12:53:00.569 11165 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:53:00 ctl02 nova-api[11165]: 2017-09-28 12:53:00.569 11165 ERROR nova
Sep 28 12:53:00 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:53:00 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:53:00 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:53:00 ctl02 glance-api[29183]: 2017-09-28 12:53:00.767 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:53:00] "OPTIONS / HTTP/1.0" 200 134 0.000698
Sep 28 12:53:00 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:53:00 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:53:00 ctl02 neutron-server[30536]: 2017-09-28 12:53:00.895 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:53:00] "OPTIONS / HTTP/1.0" 200 262 0.000519
Sep 28 12:53:00 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:53:00 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:53:01 ctl02 heat-api-cfn[13300]: 2017-09-28 12:53:01.927 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:53:01] "OPTIONS / HTTP/1.0" 200 134 0.000526
Sep 28 12:53:02 ctl02 heat-api[13008]: 2017-09-28 12:53:02.089 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:53:02] "OPTIONS / HTTP/1.0" 200 134 0.000605
Sep 28 12:53:02 ctl02 glance-api[29183]: 2017-09-28 12:53:02.458 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:53:02] "OPTIONS / HTTP/1.0" 200 134 0.001003
Sep 28 12:53:02 ctl02 nova-api[11183]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:53:02 ctl02 nova-api[11183]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:53:02 ctl02 nova-api[11183]: 2017-09-28 12:53:02.765 11183 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:53:02 ctl02 nova-api[11183]: 2017-09-28 12:53:02.766 11183 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:53:02 ctl02 nova-api[11183]: 2017-09-28 12:53:02.766 11183 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:53:02 ctl02 nova-api[11183]: 2017-09-28 12:53:02.766 11183 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:53:02 ctl02 nova-api[11183]: 2017-09-28 12:53:02.766 11183 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:53:02 ctl02 nova-api[11183]: 2017-09-28 12:53:02.766 11183 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:53:02 ctl02 nova-api[11183]: 2017-09-28 12:53:02.766 11183 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:53:02 ctl02 nova-api[11183]: 2017-09-28 12:53:02.766 11183 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:53:02 ctl02 nova-api[11183]: 2017-09-28 12:53:02.766 11183 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:53:02 ctl02 nova-api[11183]: 2017-09-28 12:53:02.766 11183 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:53:02 ctl02 nova-api[11183]: 2017-09-28 12:53:02.766 11183 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:53:02 ctl02 nova-api[11183]: 2017-09-28 12:53:02.766 11183 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:53:02 ctl02 nova-api[11183]: 2017-09-28 12:53:02.766 11183 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:53:02 ctl02 nova-api[11183]: 2017-09-28 12:53:02.766 11183 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:53:02 ctl02 nova-api[11183]: 2017-09-28 12:53:02.766 11183 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:53:02 ctl02 nova-api[11183]: 2017-09-28 12:53:02.766 11183 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:53:02 ctl02 nova-api[11183]: 2017-09-28 12:53:02.766 11183 ERROR nova.wsgi     self.filename))
Sep 28 12:53:02 ctl02 nova-api[11183]: 2017-09-28 12:53:02.766 11183 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:53:02 ctl02 nova-api[11183]: 2017-09-28 12:53:02.766 11183 ERROR nova.wsgi
Sep 28 12:53:02 ctl02 nova-api[11183]: 2017-09-28 12:53:02.767 11183 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:53:02 ctl02 nova-api[11183]: 2017-09-28 12:53:02.902 11183 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:53:03 ctl02 nova-api[11183]: 2017-09-28 12:53:03.149 11183 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:53:03 ctl02 nova-api[11183]: 2017-09-28 12:53:03.152 11183 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:53:03 ctl02 nova-api[11183]: 2017-09-28 12:53:03.152 11183 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:53:03 ctl02 nova-api[11183]: 2017-09-28 12:53:03.152 11183 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:53:03 ctl02 glance-api[29183]: 2017-09-28 12:53:03.176 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:53:03] "OPTIONS / HTTP/1.0" 200 134 0.000587
Sep 28 12:53:03 ctl02 nova-api[11183]: 2017-09-28 12:53:03.288 11183 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:53:03 ctl02 nova-api[11183]: 2017-09-28 12:53:03.290 11183 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:53:03 ctl02 nova-api[11183]: 2017-09-28 12:53:03.291 11183 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:53:03 ctl02 nova-api[11183]: 2017-09-28 12:53:03.291 11183 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:53:03 ctl02 nova-api[11183]: 2017-09-28 12:53:03.295 11183 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:53:03 ctl02 nova-api[11183]: 2017-09-28 12:53:03.295 11183 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:53:03 ctl02 nova-api[11183]: 2017-09-28 12:53:03.295 11183 ERROR nova Traceback (most recent call last):
Sep 28 12:53:03 ctl02 nova-api[11183]: 2017-09-28 12:53:03.295 11183 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:53:03 ctl02 nova-api[11183]: 2017-09-28 12:53:03.295 11183 ERROR nova     sys.exit(main())
Sep 28 12:53:03 ctl02 nova-api[11183]: 2017-09-28 12:53:03.295 11183 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:53:03 ctl02 nova-api[11183]: 2017-09-28 12:53:03.295 11183 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:53:03 ctl02 nova-api[11183]: 2017-09-28 12:53:03.295 11183 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:53:03 ctl02 nova-api[11183]: 2017-09-28 12:53:03.295 11183 ERROR nova     max_url_len=max_url_len)
Sep 28 12:53:03 ctl02 nova-api[11183]: 2017-09-28 12:53:03.295 11183 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:53:03 ctl02 nova-api[11183]: 2017-09-28 12:53:03.295 11183 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:53:03 ctl02 nova-api[11183]: 2017-09-28 12:53:03.295 11183 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:53:03 ctl02 nova-api[11183]: 2017-09-28 12:53:03.295 11183 ERROR nova     sock.listen(backlog)
Sep 28 12:53:03 ctl02 nova-api[11183]: 2017-09-28 12:53:03.295 11183 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:53:03 ctl02 nova-api[11183]: 2017-09-28 12:53:03.295 11183 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:53:03 ctl02 nova-api[11183]: 2017-09-28 12:53:03.295 11183 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:53:03 ctl02 nova-api[11183]: 2017-09-28 12:53:03.295 11183 ERROR nova
Sep 28 12:53:03 ctl02 neutron-server[30536]: 2017-09-28 12:53:03.354 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:53:03] "OPTIONS / HTTP/1.0" 200 262 0.000554
Sep 28 12:53:03 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:53:03 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:53:03 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:53:03 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:53:03 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:53:03 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:53:03 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:53:03 ctl02 neutron-server[30536]: 2017-09-28 12:53:03.678 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:53:03] "OPTIONS / HTTP/1.0" 200 262 0.000545
Sep 28 12:53:04 ctl02 heat-api[13008]: 2017-09-28 12:53:04.368 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:53:04] "OPTIONS / HTTP/1.0" 200 134 0.000544
Sep 28 12:53:05 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x44e4fc6a)
Sep 28 12:53:05 ctl02 nova-consoleauth[5433]: 2017-09-28 12:53:05.176 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:53:05 ctl02 nova-api[11201]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:53:05 ctl02 nova-api[11201]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:53:05 ctl02 nova-api[11201]: 2017-09-28 12:53:05.555 11201 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:53:05 ctl02 nova-api[11201]: 2017-09-28 12:53:05.556 11201 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:53:05 ctl02 nova-api[11201]: 2017-09-28 12:53:05.556 11201 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:53:05 ctl02 nova-api[11201]: 2017-09-28 12:53:05.556 11201 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:53:05 ctl02 nova-api[11201]: 2017-09-28 12:53:05.556 11201 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:53:05 ctl02 nova-api[11201]: 2017-09-28 12:53:05.556 11201 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:53:05 ctl02 nova-api[11201]: 2017-09-28 12:53:05.556 11201 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:53:05 ctl02 nova-api[11201]: 2017-09-28 12:53:05.556 11201 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:53:05 ctl02 nova-api[11201]: 2017-09-28 12:53:05.556 11201 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:53:05 ctl02 nova-api[11201]: 2017-09-28 12:53:05.556 11201 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:53:05 ctl02 nova-api[11201]: 2017-09-28 12:53:05.556 11201 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:53:05 ctl02 nova-api[11201]: 2017-09-28 12:53:05.556 11201 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:53:05 ctl02 nova-api[11201]: 2017-09-28 12:53:05.556 11201 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:53:05 ctl02 nova-api[11201]: 2017-09-28 12:53:05.556 11201 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:53:05 ctl02 nova-api[11201]: 2017-09-28 12:53:05.556 11201 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:53:05 ctl02 nova-api[11201]: 2017-09-28 12:53:05.556 11201 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:53:05 ctl02 nova-api[11201]: 2017-09-28 12:53:05.556 11201 ERROR nova.wsgi     self.filename))
Sep 28 12:53:05 ctl02 nova-api[11201]: 2017-09-28 12:53:05.556 11201 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:53:05 ctl02 nova-api[11201]: 2017-09-28 12:53:05.556 11201 ERROR nova.wsgi
Sep 28 12:53:05 ctl02 nova-api[11201]: 2017-09-28 12:53:05.557 11201 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:53:05 ctl02 nova-api[11201]: 2017-09-28 12:53:05.690 11201 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:53:05 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:53:05.750 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:53:05] "OPTIONS / HTTP/1.0" 200 134 0.000481
Sep 28 12:53:05 ctl02 nova-api[11201]: 2017-09-28 12:53:05.942 11201 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:53:05 ctl02 nova-api[11201]: 2017-09-28 12:53:05.945 11201 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:53:05 ctl02 nova-api[11201]: 2017-09-28 12:53:05.945 11201 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:53:05 ctl02 nova-api[11201]: 2017-09-28 12:53:05.945 11201 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:53:06 ctl02 nova-api[11201]: 2017-09-28 12:53:06.080 11201 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:53:06 ctl02 nova-api[11201]: 2017-09-28 12:53:06.082 11201 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:53:06 ctl02 nova-api[11201]: 2017-09-28 12:53:06.082 11201 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:53:06 ctl02 nova-api[11201]: 2017-09-28 12:53:06.082 11201 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:53:06 ctl02 nova-api[11201]: 2017-09-28 12:53:06.085 11201 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:53:06 ctl02 nova-api[11201]: 2017-09-28 12:53:06.086 11201 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:53:06 ctl02 nova-api[11201]: 2017-09-28 12:53:06.086 11201 ERROR nova Traceback (most recent call last):
Sep 28 12:53:06 ctl02 nova-api[11201]: 2017-09-28 12:53:06.086 11201 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:53:06 ctl02 nova-api[11201]: 2017-09-28 12:53:06.086 11201 ERROR nova     sys.exit(main())
Sep 28 12:53:06 ctl02 nova-api[11201]: 2017-09-28 12:53:06.086 11201 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:53:06 ctl02 nova-api[11201]: 2017-09-28 12:53:06.086 11201 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:53:06 ctl02 nova-api[11201]: 2017-09-28 12:53:06.086 11201 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:53:06 ctl02 nova-api[11201]: 2017-09-28 12:53:06.086 11201 ERROR nova     max_url_len=max_url_len)
Sep 28 12:53:06 ctl02 nova-api[11201]: 2017-09-28 12:53:06.086 11201 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:53:06 ctl02 nova-api[11201]: 2017-09-28 12:53:06.086 11201 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:53:06 ctl02 nova-api[11201]: 2017-09-28 12:53:06.086 11201 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:53:06 ctl02 nova-api[11201]: 2017-09-28 12:53:06.086 11201 ERROR nova     sock.listen(backlog)
Sep 28 12:53:06 ctl02 nova-api[11201]: 2017-09-28 12:53:06.086 11201 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:53:06 ctl02 nova-api[11201]: 2017-09-28 12:53:06.086 11201 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:53:06 ctl02 nova-api[11201]: 2017-09-28 12:53:06.086 11201 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:53:06 ctl02 nova-api[11201]: 2017-09-28 12:53:06.086 11201 ERROR nova
Sep 28 12:53:06 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x44e4fc6a)
Sep 28 12:53:06 ctl02 neutron-server[30536]: 2017-09-28 12:53:06.154 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 12:53:06 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:53:06 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:51:38 cmp001
Sep 28 12:53:06 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:52:00 cmp002
Sep 28 12:53:06 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:52:26 cmp002
Sep 28 12:53:06 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:53:06 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:53:06 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:53:06 ctl02 heat-engine[12803]: 2017-09-28 12:53:06.263 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:53:06 ctl02 heat-engine[12803]: 2017-09-28 12:53:06.268 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:53:06 ctl02 heat-engine[12803]: 2017-09-28 12:53:06.270 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:53:06 ctl02 heat-engine[12803]: 2017-09-28 12:53:06.276 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:53:06 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:53:06 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:53:06 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:53:06 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:53:07 ctl02 heat-api[13008]: 2017-09-28 12:53:07.030 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:53:07] "OPTIONS / HTTP/1.0" 200 134 0.000539
Sep 28 12:53:07 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x44e4fc6a)
Sep 28 12:53:07 ctl02 heat-api-cfn[13300]: 2017-09-28 12:53:07.176 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:53:07] "OPTIONS / HTTP/1.0" 200 134 0.000558
Sep 28 12:53:07 ctl02 heat-api-cfn[13300]: 2017-09-28 12:53:07.371 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:53:07] "OPTIONS / HTTP/1.0" 200 134 0.000455
Sep 28 12:53:07 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:53:07.453 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:53:07] "OPTIONS / HTTP/1.0" 200 134 0.000405
Sep 28 12:53:08 ctl02 nova-api[11219]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:53:08 ctl02 nova-api[11219]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:53:08 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x44e4fc6a)
Sep 28 12:53:08 ctl02 nova-api[11219]: 2017-09-28 12:53:08.248 11219 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:53:08 ctl02 nova-api[11219]: 2017-09-28 12:53:08.249 11219 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:53:08 ctl02 nova-api[11219]: 2017-09-28 12:53:08.249 11219 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:53:08 ctl02 nova-api[11219]: 2017-09-28 12:53:08.249 11219 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:53:08 ctl02 nova-api[11219]: 2017-09-28 12:53:08.249 11219 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:53:08 ctl02 nova-api[11219]: 2017-09-28 12:53:08.249 11219 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:53:08 ctl02 nova-api[11219]: 2017-09-28 12:53:08.249 11219 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:53:08 ctl02 nova-api[11219]: 2017-09-28 12:53:08.249 11219 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:53:08 ctl02 nova-api[11219]: 2017-09-28 12:53:08.249 11219 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:53:08 ctl02 nova-api[11219]: 2017-09-28 12:53:08.249 11219 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:53:08 ctl02 nova-api[11219]: 2017-09-28 12:53:08.249 11219 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:53:08 ctl02 nova-api[11219]: 2017-09-28 12:53:08.249 11219 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:53:08 ctl02 nova-api[11219]: 2017-09-28 12:53:08.249 11219 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:53:08 ctl02 nova-api[11219]: 2017-09-28 12:53:08.249 11219 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:53:08 ctl02 nova-api[11219]: 2017-09-28 12:53:08.249 11219 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:53:08 ctl02 nova-api[11219]: 2017-09-28 12:53:08.249 11219 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:53:08 ctl02 nova-api[11219]: 2017-09-28 12:53:08.249 11219 ERROR nova.wsgi     self.filename))
Sep 28 12:53:08 ctl02 nova-api[11219]: 2017-09-28 12:53:08.249 11219 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:53:08 ctl02 nova-api[11219]: 2017-09-28 12:53:08.249 11219 ERROR nova.wsgi
Sep 28 12:53:08 ctl02 nova-api[11219]: 2017-09-28 12:53:08.250 11219 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:53:08 ctl02 nova-scheduler[5620]: 2017-09-28 12:53:08.274 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:53:08 ctl02 nova-api[11219]: 2017-09-28 12:53:08.379 11219 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:53:08 ctl02 nova-api[11219]: 2017-09-28 12:53:08.602 11219 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:53:08 ctl02 nova-api[11219]: 2017-09-28 12:53:08.605 11219 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:53:08 ctl02 nova-api[11219]: 2017-09-28 12:53:08.605 11219 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:53:08 ctl02 nova-api[11219]: 2017-09-28 12:53:08.605 11219 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:53:08 ctl02 nova-api[11219]: 2017-09-28 12:53:08.736 11219 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:53:08 ctl02 nova-api[11219]: 2017-09-28 12:53:08.738 11219 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:53:08 ctl02 nova-api[11219]: 2017-09-28 12:53:08.738 11219 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:53:08 ctl02 nova-api[11219]: 2017-09-28 12:53:08.738 11219 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:53:08 ctl02 nova-api[11219]: 2017-09-28 12:53:08.742 11219 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:53:08 ctl02 nova-api[11219]: 2017-09-28 12:53:08.742 11219 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:53:08 ctl02 nova-api[11219]: 2017-09-28 12:53:08.742 11219 ERROR nova Traceback (most recent call last):
Sep 28 12:53:08 ctl02 nova-api[11219]: 2017-09-28 12:53:08.742 11219 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:53:08 ctl02 nova-api[11219]: 2017-09-28 12:53:08.742 11219 ERROR nova     sys.exit(main())
Sep 28 12:53:08 ctl02 nova-api[11219]: 2017-09-28 12:53:08.742 11219 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:53:08 ctl02 nova-api[11219]: 2017-09-28 12:53:08.742 11219 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:53:08 ctl02 nova-api[11219]: 2017-09-28 12:53:08.742 11219 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:53:08 ctl02 nova-api[11219]: 2017-09-28 12:53:08.742 11219 ERROR nova     max_url_len=max_url_len)
Sep 28 12:53:08 ctl02 nova-api[11219]: 2017-09-28 12:53:08.742 11219 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:53:08 ctl02 nova-api[11219]: 2017-09-28 12:53:08.742 11219 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:53:08 ctl02 nova-api[11219]: 2017-09-28 12:53:08.742 11219 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:53:08 ctl02 nova-api[11219]: 2017-09-28 12:53:08.742 11219 ERROR nova     sock.listen(backlog)
Sep 28 12:53:08 ctl02 nova-api[11219]: 2017-09-28 12:53:08.742 11219 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:53:08 ctl02 nova-api[11219]: 2017-09-28 12:53:08.742 11219 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:53:08 ctl02 nova-api[11219]: 2017-09-28 12:53:08.742 11219 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:53:08 ctl02 nova-api[11219]: 2017-09-28 12:53:08.742 11219 ERROR nova
Sep 28 12:53:08 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:53:08 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:53:08 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:53:09 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:53:09.070 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:53:09] "OPTIONS / HTTP/1.0" 200 134 0.000492
Sep 28 12:53:09 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x44e4fc6a)
Sep 28 12:53:09 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:53:09 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:53:09 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:53:09 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:53:10 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x44e4fc6a)
Sep 28 12:53:10 ctl02 neutron-server[30536]: 2017-09-28 12:53:10.540 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:53:10] "OPTIONS / HTTP/1.0" 200 262 0.000506
Sep 28 12:53:10 ctl02 glance-api[29183]: 2017-09-28 12:53:10.596 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:53:10] "OPTIONS / HTTP/1.0" 200 134 0.000553
Sep 28 12:53:10 ctl02 nova-api[11237]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:53:10 ctl02 nova-api[11237]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:53:10 ctl02 nova-api[11237]: 2017-09-28 12:53:10.959 11237 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:53:10 ctl02 nova-api[11237]: 2017-09-28 12:53:10.961 11237 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:53:10 ctl02 nova-api[11237]: 2017-09-28 12:53:10.961 11237 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:53:10 ctl02 nova-api[11237]: 2017-09-28 12:53:10.961 11237 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:53:10 ctl02 nova-api[11237]: 2017-09-28 12:53:10.961 11237 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:53:10 ctl02 nova-api[11237]: 2017-09-28 12:53:10.961 11237 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:53:10 ctl02 nova-api[11237]: 2017-09-28 12:53:10.961 11237 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:53:10 ctl02 nova-api[11237]: 2017-09-28 12:53:10.961 11237 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:53:10 ctl02 nova-api[11237]: 2017-09-28 12:53:10.961 11237 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:53:10 ctl02 nova-api[11237]: 2017-09-28 12:53:10.961 11237 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:53:10 ctl02 nova-api[11237]: 2017-09-28 12:53:10.961 11237 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:53:10 ctl02 nova-api[11237]: 2017-09-28 12:53:10.961 11237 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:53:10 ctl02 nova-api[11237]: 2017-09-28 12:53:10.961 11237 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:53:10 ctl02 nova-api[11237]: 2017-09-28 12:53:10.961 11237 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:53:10 ctl02 nova-api[11237]: 2017-09-28 12:53:10.961 11237 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:53:10 ctl02 nova-api[11237]: 2017-09-28 12:53:10.961 11237 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:53:10 ctl02 nova-api[11237]: 2017-09-28 12:53:10.961 11237 ERROR nova.wsgi     self.filename))
Sep 28 12:53:10 ctl02 nova-api[11237]: 2017-09-28 12:53:10.961 11237 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:53:10 ctl02 nova-api[11237]: 2017-09-28 12:53:10.961 11237 ERROR nova.wsgi
Sep 28 12:53:10 ctl02 nova-api[11237]: 2017-09-28 12:53:10.962 11237 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:53:11 ctl02 nova-api[11237]: 2017-09-28 12:53:11.088 11237 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:53:11 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x44e4fc6a)
Sep 28 12:53:11 ctl02 nova-api[11237]: 2017-09-28 12:53:11.310 11237 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:53:11 ctl02 nova-api[11237]: 2017-09-28 12:53:11.313 11237 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:53:11 ctl02 nova-api[11237]: 2017-09-28 12:53:11.313 11237 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:53:11 ctl02 nova-api[11237]: 2017-09-28 12:53:11.314 11237 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:53:11 ctl02 nova-api[11237]: 2017-09-28 12:53:11.442 11237 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:53:11 ctl02 nova-api[11237]: 2017-09-28 12:53:11.444 11237 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:53:11 ctl02 nova-api[11237]: 2017-09-28 12:53:11.445 11237 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:53:11 ctl02 nova-api[11237]: 2017-09-28 12:53:11.445 11237 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:53:11 ctl02 nova-api[11237]: 2017-09-28 12:53:11.448 11237 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:53:11 ctl02 nova-api[11237]: 2017-09-28 12:53:11.449 11237 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:53:11 ctl02 nova-api[11237]: 2017-09-28 12:53:11.449 11237 ERROR nova Traceback (most recent call last):
Sep 28 12:53:11 ctl02 nova-api[11237]: 2017-09-28 12:53:11.449 11237 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:53:11 ctl02 nova-api[11237]: 2017-09-28 12:53:11.449 11237 ERROR nova     sys.exit(main())
Sep 28 12:53:11 ctl02 nova-api[11237]: 2017-09-28 12:53:11.449 11237 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:53:11 ctl02 nova-api[11237]: 2017-09-28 12:53:11.449 11237 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:53:11 ctl02 nova-api[11237]: 2017-09-28 12:53:11.449 11237 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:53:11 ctl02 nova-api[11237]: 2017-09-28 12:53:11.449 11237 ERROR nova     max_url_len=max_url_len)
Sep 28 12:53:11 ctl02 nova-api[11237]: 2017-09-28 12:53:11.449 11237 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:53:11 ctl02 nova-api[11237]: 2017-09-28 12:53:11.449 11237 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:53:11 ctl02 nova-api[11237]: 2017-09-28 12:53:11.449 11237 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:53:11 ctl02 nova-api[11237]: 2017-09-28 12:53:11.449 11237 ERROR nova     sock.listen(backlog)
Sep 28 12:53:11 ctl02 nova-api[11237]: 2017-09-28 12:53:11.449 11237 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:53:11 ctl02 nova-api[11237]: 2017-09-28 12:53:11.449 11237 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:53:11 ctl02 nova-api[11237]: 2017-09-28 12:53:11.449 11237 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:53:11 ctl02 nova-api[11237]: 2017-09-28 12:53:11.449 11237 ERROR nova
Sep 28 12:53:11 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:53:11 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:53:11 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:53:11 ctl02 heat-api-cfn[13300]: 2017-09-28 12:53:11.709 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:53:11] "OPTIONS / HTTP/1.0" 200 134 0.000500
Sep 28 12:53:11 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:53:11 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:53:11 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:53:11 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:53:12 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x44e4fc6a)
Sep 28 12:53:12 ctl02 heat-api[13008]: 2017-09-28 12:53:12.416 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:53:12] "OPTIONS / HTTP/1.0" 200 134 0.000542
Sep 28 12:53:12 ctl02 glance-api[29183]: 2017-09-28 12:53:12.487 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:53:12] "OPTIONS / HTTP/1.0" 200 134 0.000548
Sep 28 12:53:12 ctl02 glance-api[29183]: 2017-09-28 12:53:12.826 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:53:12] "OPTIONS / HTTP/1.0" 200 134 0.000909
Sep 28 12:53:13 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x44e4fc6a)
Sep 28 12:53:13 ctl02 neutron-server[30536]: 2017-09-28 12:53:13.541 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:53:13 ctl02 nova-api[11255]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:53:13 ctl02 nova-api[11255]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:53:13 ctl02 neutron-server[30536]: 2017-09-28 12:53:13.633 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:53:13] "OPTIONS / HTTP/1.0" 200 262 0.000619
Sep 28 12:53:13 ctl02 nova-api[11255]: 2017-09-28 12:53:13.749 11255 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:53:13 ctl02 nova-api[11255]: 2017-09-28 12:53:13.750 11255 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:53:13 ctl02 nova-api[11255]: 2017-09-28 12:53:13.750 11255 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:53:13 ctl02 nova-api[11255]: 2017-09-28 12:53:13.750 11255 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:53:13 ctl02 nova-api[11255]: 2017-09-28 12:53:13.750 11255 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:53:13 ctl02 nova-api[11255]: 2017-09-28 12:53:13.750 11255 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:53:13 ctl02 nova-api[11255]: 2017-09-28 12:53:13.750 11255 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:53:13 ctl02 nova-api[11255]: 2017-09-28 12:53:13.750 11255 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:53:13 ctl02 nova-api[11255]: 2017-09-28 12:53:13.750 11255 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:53:13 ctl02 nova-api[11255]: 2017-09-28 12:53:13.750 11255 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:53:13 ctl02 nova-api[11255]: 2017-09-28 12:53:13.750 11255 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:53:13 ctl02 nova-api[11255]: 2017-09-28 12:53:13.750 11255 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:53:13 ctl02 nova-api[11255]: 2017-09-28 12:53:13.750 11255 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:53:13 ctl02 nova-api[11255]: 2017-09-28 12:53:13.750 11255 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:53:13 ctl02 nova-api[11255]: 2017-09-28 12:53:13.750 11255 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:53:13 ctl02 nova-api[11255]: 2017-09-28 12:53:13.750 11255 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:53:13 ctl02 nova-api[11255]: 2017-09-28 12:53:13.750 11255 ERROR nova.wsgi     self.filename))
Sep 28 12:53:13 ctl02 nova-api[11255]: 2017-09-28 12:53:13.750 11255 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:53:13 ctl02 nova-api[11255]: 2017-09-28 12:53:13.750 11255 ERROR nova.wsgi
Sep 28 12:53:13 ctl02 nova-api[11255]: 2017-09-28 12:53:13.752 11255 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:53:13 ctl02 neutron-server[30536]: 2017-09-28 12:53:13.878 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:53:13] "OPTIONS / HTTP/1.0" 200 262 0.000502
Sep 28 12:53:13 ctl02 nova-api[11255]: 2017-09-28 12:53:13.916 11255 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:53:14 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x44e4fc6a)
Sep 28 12:53:14 ctl02 nova-api[11255]: 2017-09-28 12:53:14.167 11255 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:53:14 ctl02 nova-api[11255]: 2017-09-28 12:53:14.169 11255 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:53:14 ctl02 nova-api[11255]: 2017-09-28 12:53:14.169 11255 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:53:14 ctl02 nova-api[11255]: 2017-09-28 12:53:14.170 11255 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:53:14 ctl02 heat-api[13008]: 2017-09-28 12:53:14.172 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:53:14] "OPTIONS / HTTP/1.0" 200 134 0.000572
Sep 28 12:53:14 ctl02 nova-api[11255]: 2017-09-28 12:53:14.307 11255 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:53:14 ctl02 nova-api[11255]: 2017-09-28 12:53:14.309 11255 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:53:14 ctl02 nova-api[11255]: 2017-09-28 12:53:14.309 11255 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:53:14 ctl02 nova-api[11255]: 2017-09-28 12:53:14.310 11255 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:53:14 ctl02 nova-api[11255]: 2017-09-28 12:53:14.313 11255 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:53:14 ctl02 nova-api[11255]: 2017-09-28 12:53:14.313 11255 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:53:14 ctl02 nova-api[11255]: 2017-09-28 12:53:14.313 11255 ERROR nova Traceback (most recent call last):
Sep 28 12:53:14 ctl02 nova-api[11255]: 2017-09-28 12:53:14.313 11255 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:53:14 ctl02 nova-api[11255]: 2017-09-28 12:53:14.313 11255 ERROR nova     sys.exit(main())
Sep 28 12:53:14 ctl02 nova-api[11255]: 2017-09-28 12:53:14.313 11255 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:53:14 ctl02 nova-api[11255]: 2017-09-28 12:53:14.313 11255 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:53:14 ctl02 nova-api[11255]: 2017-09-28 12:53:14.313 11255 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:53:14 ctl02 nova-api[11255]: 2017-09-28 12:53:14.313 11255 ERROR nova     max_url_len=max_url_len)
Sep 28 12:53:14 ctl02 nova-api[11255]: 2017-09-28 12:53:14.313 11255 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:53:14 ctl02 nova-api[11255]: 2017-09-28 12:53:14.313 11255 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:53:14 ctl02 nova-api[11255]: 2017-09-28 12:53:14.313 11255 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:53:14 ctl02 nova-api[11255]: 2017-09-28 12:53:14.313 11255 ERROR nova     sock.listen(backlog)
Sep 28 12:53:14 ctl02 nova-api[11255]: 2017-09-28 12:53:14.313 11255 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:53:14 ctl02 nova-api[11255]: 2017-09-28 12:53:14.313 11255 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:53:14 ctl02 nova-api[11255]: 2017-09-28 12:53:14.313 11255 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:53:14 ctl02 nova-api[11255]: 2017-09-28 12:53:14.313 11255 ERROR nova
Sep 28 12:53:14 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:53:14 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:53:14 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:53:14 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:53:14 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:53:14 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:53:14 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:53:15 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x44e4fc6a)
Sep 28 12:53:15 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:53:15.997 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:53:15] "OPTIONS / HTTP/1.0" 200 134 0.000367
Sep 28 12:53:16 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:53:16 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:53:16 ctl02 nova-api[11273]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:53:16 ctl02 nova-api[11273]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:53:16 ctl02 nova-api[11273]: 2017-09-28 12:53:16.455 11273 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:53:16 ctl02 nova-api[11273]: 2017-09-28 12:53:16.457 11273 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:53:16 ctl02 nova-api[11273]: 2017-09-28 12:53:16.457 11273 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:53:16 ctl02 nova-api[11273]: 2017-09-28 12:53:16.457 11273 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:53:16 ctl02 nova-api[11273]: 2017-09-28 12:53:16.457 11273 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:53:16 ctl02 nova-api[11273]: 2017-09-28 12:53:16.457 11273 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:53:16 ctl02 nova-api[11273]: 2017-09-28 12:53:16.457 11273 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:53:16 ctl02 nova-api[11273]: 2017-09-28 12:53:16.457 11273 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:53:16 ctl02 nova-api[11273]: 2017-09-28 12:53:16.457 11273 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:53:16 ctl02 nova-api[11273]: 2017-09-28 12:53:16.457 11273 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:53:16 ctl02 nova-api[11273]: 2017-09-28 12:53:16.457 11273 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:53:16 ctl02 nova-api[11273]: 2017-09-28 12:53:16.457 11273 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:53:16 ctl02 nova-api[11273]: 2017-09-28 12:53:16.457 11273 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:53:16 ctl02 nova-api[11273]: 2017-09-28 12:53:16.457 11273 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:53:16 ctl02 nova-api[11273]: 2017-09-28 12:53:16.457 11273 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:53:16 ctl02 nova-api[11273]: 2017-09-28 12:53:16.457 11273 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:53:16 ctl02 nova-api[11273]: 2017-09-28 12:53:16.457 11273 ERROR nova.wsgi     self.filename))
Sep 28 12:53:16 ctl02 nova-api[11273]: 2017-09-28 12:53:16.457 11273 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:53:16 ctl02 nova-api[11273]: 2017-09-28 12:53:16.457 11273 ERROR nova.wsgi
Sep 28 12:53:16 ctl02 nova-api[11273]: 2017-09-28 12:53:16.458 11273 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:53:16 ctl02 nova-api[11273]: 2017-09-28 12:53:16.582 11273 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:53:16 ctl02 heat-api[13008]: 2017-09-28 12:53:16.666 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:53:16] "OPTIONS / HTTP/1.0" 200 134 0.000551
Sep 28 12:53:16 ctl02 nova-api[11273]: 2017-09-28 12:53:16.802 11273 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:53:16 ctl02 nova-api[11273]: 2017-09-28 12:53:16.804 11273 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:53:16 ctl02 nova-api[11273]: 2017-09-28 12:53:16.805 11273 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:53:16 ctl02 nova-api[11273]: 2017-09-28 12:53:16.805 11273 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:53:16 ctl02 nova-api[11273]: 2017-09-28 12:53:16.933 11273 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:53:16 ctl02 nova-api[11273]: 2017-09-28 12:53:16.934 11273 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:53:16 ctl02 nova-api[11273]: 2017-09-28 12:53:16.935 11273 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:53:16 ctl02 nova-api[11273]: 2017-09-28 12:53:16.935 11273 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:53:16 ctl02 nova-api[11273]: 2017-09-28 12:53:16.938 11273 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:53:16 ctl02 nova-api[11273]: 2017-09-28 12:53:16.938 11273 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:53:16 ctl02 nova-api[11273]: 2017-09-28 12:53:16.938 11273 ERROR nova Traceback (most recent call last):
Sep 28 12:53:16 ctl02 nova-api[11273]: 2017-09-28 12:53:16.938 11273 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:53:16 ctl02 nova-api[11273]: 2017-09-28 12:53:16.938 11273 ERROR nova     sys.exit(main())
Sep 28 12:53:16 ctl02 nova-api[11273]: 2017-09-28 12:53:16.938 11273 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:53:16 ctl02 nova-api[11273]: 2017-09-28 12:53:16.938 11273 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:53:16 ctl02 nova-api[11273]: 2017-09-28 12:53:16.938 11273 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:53:16 ctl02 nova-api[11273]: 2017-09-28 12:53:16.938 11273 ERROR nova     max_url_len=max_url_len)
Sep 28 12:53:16 ctl02 nova-api[11273]: 2017-09-28 12:53:16.938 11273 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:53:16 ctl02 nova-api[11273]: 2017-09-28 12:53:16.938 11273 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:53:16 ctl02 nova-api[11273]: 2017-09-28 12:53:16.938 11273 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:53:16 ctl02 nova-api[11273]: 2017-09-28 12:53:16.938 11273 ERROR nova     sock.listen(backlog)
Sep 28 12:53:16 ctl02 nova-api[11273]: 2017-09-28 12:53:16.938 11273 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:53:16 ctl02 nova-api[11273]: 2017-09-28 12:53:16.938 11273 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:53:16 ctl02 nova-api[11273]: 2017-09-28 12:53:16.938 11273 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:53:16 ctl02 nova-api[11273]: 2017-09-28 12:53:16.938 11273 ERROR nova
Sep 28 12:53:17 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:53:17 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:53:17 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:53:17 ctl02 heat-api-cfn[13300]: 2017-09-28 12:53:17.200 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:53:17] "OPTIONS / HTTP/1.0" 200 134 0.000493
Sep 28 12:53:17 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:53:17 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:53:17 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:53:17 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:53:17 ctl02 heat-api-cfn[13300]: 2017-09-28 12:53:17.554 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:53:17] "OPTIONS / HTTP/1.0" 200 134 0.000442
Sep 28 12:53:17 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:53:17.839 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:53:17] "OPTIONS / HTTP/1.0" 200 134 0.000364
Sep 28 12:53:19 ctl02 nova-api[11295]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:53:19 ctl02 nova-api[11295]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:53:19 ctl02 nova-api[11295]: 2017-09-28 12:53:19.205 11295 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:53:19 ctl02 nova-api[11295]: 2017-09-28 12:53:19.206 11295 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:53:19 ctl02 nova-api[11295]: 2017-09-28 12:53:19.206 11295 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:53:19 ctl02 nova-api[11295]: 2017-09-28 12:53:19.206 11295 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:53:19 ctl02 nova-api[11295]: 2017-09-28 12:53:19.206 11295 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:53:19 ctl02 nova-api[11295]: 2017-09-28 12:53:19.206 11295 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:53:19 ctl02 nova-api[11295]: 2017-09-28 12:53:19.206 11295 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:53:19 ctl02 nova-api[11295]: 2017-09-28 12:53:19.206 11295 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:53:19 ctl02 nova-api[11295]: 2017-09-28 12:53:19.206 11295 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:53:19 ctl02 nova-api[11295]: 2017-09-28 12:53:19.206 11295 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:53:19 ctl02 nova-api[11295]: 2017-09-28 12:53:19.206 11295 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:53:19 ctl02 nova-api[11295]: 2017-09-28 12:53:19.206 11295 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:53:19 ctl02 nova-api[11295]: 2017-09-28 12:53:19.206 11295 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:53:19 ctl02 nova-api[11295]: 2017-09-28 12:53:19.206 11295 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:53:19 ctl02 nova-api[11295]: 2017-09-28 12:53:19.206 11295 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:53:19 ctl02 nova-api[11295]: 2017-09-28 12:53:19.206 11295 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:53:19 ctl02 nova-api[11295]: 2017-09-28 12:53:19.206 11295 ERROR nova.wsgi     self.filename))
Sep 28 12:53:19 ctl02 nova-api[11295]: 2017-09-28 12:53:19.206 11295 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:53:19 ctl02 nova-api[11295]: 2017-09-28 12:53:19.206 11295 ERROR nova.wsgi
Sep 28 12:53:19 ctl02 nova-api[11295]: 2017-09-28 12:53:19.207 11295 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:53:19 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:53:19.291 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:53:19] "OPTIONS / HTTP/1.0" 200 134 0.000364
Sep 28 12:53:19 ctl02 nova-api[11295]: 2017-09-28 12:53:19.333 11295 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:53:19 ctl02 nova-api[11295]: 2017-09-28 12:53:19.553 11295 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:53:19 ctl02 nova-api[11295]: 2017-09-28 12:53:19.555 11295 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:53:19 ctl02 nova-api[11295]: 2017-09-28 12:53:19.555 11295 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:53:19 ctl02 nova-api[11295]: 2017-09-28 12:53:19.555 11295 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:53:19 ctl02 nova-api[11295]: 2017-09-28 12:53:19.684 11295 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:53:19 ctl02 nova-api[11295]: 2017-09-28 12:53:19.686 11295 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:53:19 ctl02 nova-api[11295]: 2017-09-28 12:53:19.686 11295 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:53:19 ctl02 nova-api[11295]: 2017-09-28 12:53:19.686 11295 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:53:19 ctl02 nova-api[11295]: 2017-09-28 12:53:19.689 11295 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:53:19 ctl02 nova-api[11295]: 2017-09-28 12:53:19.690 11295 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:53:19 ctl02 nova-api[11295]: 2017-09-28 12:53:19.690 11295 ERROR nova Traceback (most recent call last):
Sep 28 12:53:19 ctl02 nova-api[11295]: 2017-09-28 12:53:19.690 11295 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:53:19 ctl02 nova-api[11295]: 2017-09-28 12:53:19.690 11295 ERROR nova     sys.exit(main())
Sep 28 12:53:19 ctl02 nova-api[11295]: 2017-09-28 12:53:19.690 11295 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:53:19 ctl02 nova-api[11295]: 2017-09-28 12:53:19.690 11295 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:53:19 ctl02 nova-api[11295]: 2017-09-28 12:53:19.690 11295 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:53:19 ctl02 nova-api[11295]: 2017-09-28 12:53:19.690 11295 ERROR nova     max_url_len=max_url_len)
Sep 28 12:53:19 ctl02 nova-api[11295]: 2017-09-28 12:53:19.690 11295 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:53:19 ctl02 nova-api[11295]: 2017-09-28 12:53:19.690 11295 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:53:19 ctl02 nova-api[11295]: 2017-09-28 12:53:19.690 11295 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:53:19 ctl02 nova-api[11295]: 2017-09-28 12:53:19.690 11295 ERROR nova     sock.listen(backlog)
Sep 28 12:53:19 ctl02 nova-api[11295]: 2017-09-28 12:53:19.690 11295 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:53:19 ctl02 nova-api[11295]: 2017-09-28 12:53:19.690 11295 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:53:19 ctl02 nova-api[11295]: 2017-09-28 12:53:19.690 11295 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:53:19 ctl02 nova-api[11295]: 2017-09-28 12:53:19.690 11295 ERROR nova
Sep 28 12:53:19 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:53:19 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:53:19 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:53:20 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:53:20 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:53:20 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:53:20 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:53:20 ctl02 neutron-server[30536]: 2017-09-28 12:53:20.680 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:53:20] "OPTIONS / HTTP/1.0" 200 262 0.000448
Sep 28 12:53:20 ctl02 glance-api[29183]: 2017-09-28 12:53:20.830 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:53:20] "OPTIONS / HTTP/1.0" 200 134 0.000588
Sep 28 12:53:21 ctl02 neutron-server[30536]: 2017-09-28 12:53:21.150 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 12:53:21 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:53:21 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:51:38 cmp001
Sep 28 12:53:21 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:52:00 cmp002
Sep 28 12:53:21 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:52:26 cmp002
Sep 28 12:53:21 ctl02 heat-api-cfn[13300]: 2017-09-28 12:53:21.355 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:53:21] "OPTIONS / HTTP/1.0" 200 134 0.000561
Sep 28 12:53:21 ctl02 nova-api[11314]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:53:21 ctl02 nova-api[11314]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:53:22 ctl02 nova-api[11314]: 2017-09-28 12:53:22.013 11314 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:53:22 ctl02 nova-api[11314]: 2017-09-28 12:53:22.014 11314 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:53:22 ctl02 nova-api[11314]: 2017-09-28 12:53:22.014 11314 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:53:22 ctl02 nova-api[11314]: 2017-09-28 12:53:22.014 11314 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:53:22 ctl02 nova-api[11314]: 2017-09-28 12:53:22.014 11314 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:53:22 ctl02 nova-api[11314]: 2017-09-28 12:53:22.014 11314 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:53:22 ctl02 nova-api[11314]: 2017-09-28 12:53:22.014 11314 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:53:22 ctl02 nova-api[11314]: 2017-09-28 12:53:22.014 11314 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:53:22 ctl02 nova-api[11314]: 2017-09-28 12:53:22.014 11314 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:53:22 ctl02 nova-api[11314]: 2017-09-28 12:53:22.014 11314 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:53:22 ctl02 nova-api[11314]: 2017-09-28 12:53:22.014 11314 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:53:22 ctl02 nova-api[11314]: 2017-09-28 12:53:22.014 11314 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:53:22 ctl02 nova-api[11314]: 2017-09-28 12:53:22.014 11314 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:53:22 ctl02 nova-api[11314]: 2017-09-28 12:53:22.014 11314 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:53:22 ctl02 nova-api[11314]: 2017-09-28 12:53:22.014 11314 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:53:22 ctl02 nova-api[11314]: 2017-09-28 12:53:22.014 11314 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:53:22 ctl02 nova-api[11314]: 2017-09-28 12:53:22.014 11314 ERROR nova.wsgi     self.filename))
Sep 28 12:53:22 ctl02 nova-api[11314]: 2017-09-28 12:53:22.014 11314 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:53:22 ctl02 nova-api[11314]: 2017-09-28 12:53:22.014 11314 ERROR nova.wsgi
Sep 28 12:53:22 ctl02 nova-api[11314]: 2017-09-28 12:53:22.015 11314 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:53:22 ctl02 nova-api[11314]: 2017-09-28 12:53:22.148 11314 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:53:22 ctl02 nova-api[11314]: 2017-09-28 12:53:22.405 11314 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:53:22 ctl02 nova-api[11314]: 2017-09-28 12:53:22.407 11314 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:53:22 ctl02 nova-api[11314]: 2017-09-28 12:53:22.408 11314 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:53:22 ctl02 nova-api[11314]: 2017-09-28 12:53:22.408 11314 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:53:22 ctl02 heat-api[13008]: 2017-09-28 12:53:22.514 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:53:22] "OPTIONS / HTTP/1.0" 200 134 0.000656
Sep 28 12:53:22 ctl02 nova-api[11314]: 2017-09-28 12:53:22.541 11314 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:53:22 ctl02 nova-api[11314]: 2017-09-28 12:53:22.543 11314 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:53:22 ctl02 nova-api[11314]: 2017-09-28 12:53:22.544 11314 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:53:22 ctl02 nova-api[11314]: 2017-09-28 12:53:22.544 11314 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:53:22 ctl02 nova-api[11314]: 2017-09-28 12:53:22.547 11314 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:53:22 ctl02 nova-api[11314]: 2017-09-28 12:53:22.548 11314 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:53:22 ctl02 nova-api[11314]: 2017-09-28 12:53:22.548 11314 ERROR nova Traceback (most recent call last):
Sep 28 12:53:22 ctl02 nova-api[11314]: 2017-09-28 12:53:22.548 11314 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:53:22 ctl02 nova-api[11314]: 2017-09-28 12:53:22.548 11314 ERROR nova     sys.exit(main())
Sep 28 12:53:22 ctl02 nova-api[11314]: 2017-09-28 12:53:22.548 11314 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:53:22 ctl02 nova-api[11314]: 2017-09-28 12:53:22.548 11314 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:53:22 ctl02 nova-api[11314]: 2017-09-28 12:53:22.548 11314 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:53:22 ctl02 nova-api[11314]: 2017-09-28 12:53:22.548 11314 ERROR nova     max_url_len=max_url_len)
Sep 28 12:53:22 ctl02 nova-api[11314]: 2017-09-28 12:53:22.548 11314 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:53:22 ctl02 nova-api[11314]: 2017-09-28 12:53:22.548 11314 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:53:22 ctl02 nova-api[11314]: 2017-09-28 12:53:22.548 11314 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:53:22 ctl02 nova-api[11314]: 2017-09-28 12:53:22.548 11314 ERROR nova     sock.listen(backlog)
Sep 28 12:53:22 ctl02 nova-api[11314]: 2017-09-28 12:53:22.548 11314 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:53:22 ctl02 nova-api[11314]: 2017-09-28 12:53:22.548 11314 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:53:22 ctl02 nova-api[11314]: 2017-09-28 12:53:22.548 11314 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:53:22 ctl02 nova-api[11314]: 2017-09-28 12:53:22.548 11314 ERROR nova
Sep 28 12:53:22 ctl02 glance-api[29183]: 2017-09-28 12:53:22.713 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:53:22] "OPTIONS / HTTP/1.0" 200 134 0.000719
Sep 28 12:53:22 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:53:22 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:53:22 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:53:22 ctl02 glance-api[29183]: 2017-09-28 12:53:22.775 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:53:22] "OPTIONS / HTTP/1.0" 200 134 0.000634
Sep 28 12:53:22 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:53:22 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:53:22 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:53:22 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:53:23 ctl02 neutron-server[30536]: 2017-09-28 12:53:23.481 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:53:23] "OPTIONS / HTTP/1.0" 200 262 0.000524
Sep 28 12:53:23 ctl02 heat-api[13008]: 2017-09-28 12:53:23.930 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:53:23] "OPTIONS / HTTP/1.0" 200 134 0.000559
Sep 28 12:53:24 ctl02 neutron-server[30536]: 2017-09-28 12:53:24.185 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:53:24] "OPTIONS / HTTP/1.0" 200 262 0.000470
Sep 28 12:53:24 ctl02 nova-api[11332]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:53:24 ctl02 nova-api[11332]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:53:24 ctl02 nova-api[11332]: 2017-09-28 12:53:24.739 11332 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:53:24 ctl02 nova-api[11332]: 2017-09-28 12:53:24.741 11332 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:53:24 ctl02 nova-api[11332]: 2017-09-28 12:53:24.741 11332 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:53:24 ctl02 nova-api[11332]: 2017-09-28 12:53:24.741 11332 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:53:24 ctl02 nova-api[11332]: 2017-09-28 12:53:24.741 11332 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:53:24 ctl02 nova-api[11332]: 2017-09-28 12:53:24.741 11332 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:53:24 ctl02 nova-api[11332]: 2017-09-28 12:53:24.741 11332 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:53:24 ctl02 nova-api[11332]: 2017-09-28 12:53:24.741 11332 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:53:24 ctl02 nova-api[11332]: 2017-09-28 12:53:24.741 11332 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:53:24 ctl02 nova-api[11332]: 2017-09-28 12:53:24.741 11332 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:53:24 ctl02 nova-api[11332]: 2017-09-28 12:53:24.741 11332 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:53:24 ctl02 nova-api[11332]: 2017-09-28 12:53:24.741 11332 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:53:24 ctl02 nova-api[11332]: 2017-09-28 12:53:24.741 11332 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:53:24 ctl02 nova-api[11332]: 2017-09-28 12:53:24.741 11332 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:53:24 ctl02 nova-api[11332]: 2017-09-28 12:53:24.741 11332 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:53:24 ctl02 nova-api[11332]: 2017-09-28 12:53:24.741 11332 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:53:24 ctl02 nova-api[11332]: 2017-09-28 12:53:24.741 11332 ERROR nova.wsgi     self.filename))
Sep 28 12:53:24 ctl02 nova-api[11332]: 2017-09-28 12:53:24.741 11332 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:53:24 ctl02 nova-api[11332]: 2017-09-28 12:53:24.741 11332 ERROR nova.wsgi
Sep 28 12:53:24 ctl02 nova-api[11332]: 2017-09-28 12:53:24.742 11332 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:53:24 ctl02 nova-api[11332]: 2017-09-28 12:53:24.874 11332 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:53:25 ctl02 nova-api[11332]: 2017-09-28 12:53:25.099 11332 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:53:25 ctl02 nova-api[11332]: 2017-09-28 12:53:25.101 11332 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:53:25 ctl02 nova-api[11332]: 2017-09-28 12:53:25.101 11332 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:53:25 ctl02 nova-api[11332]: 2017-09-28 12:53:25.102 11332 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:53:25 ctl02 nova-api[11332]: 2017-09-28 12:53:25.235 11332 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:53:25 ctl02 nova-api[11332]: 2017-09-28 12:53:25.237 11332 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:53:25 ctl02 nova-api[11332]: 2017-09-28 12:53:25.237 11332 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:53:25 ctl02 nova-api[11332]: 2017-09-28 12:53:25.237 11332 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:53:25 ctl02 nova-api[11332]: 2017-09-28 12:53:25.240 11332 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:53:25 ctl02 nova-api[11332]: 2017-09-28 12:53:25.241 11332 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:53:25 ctl02 nova-api[11332]: 2017-09-28 12:53:25.241 11332 ERROR nova Traceback (most recent call last):
Sep 28 12:53:25 ctl02 nova-api[11332]: 2017-09-28 12:53:25.241 11332 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:53:25 ctl02 nova-api[11332]: 2017-09-28 12:53:25.241 11332 ERROR nova     sys.exit(main())
Sep 28 12:53:25 ctl02 nova-api[11332]: 2017-09-28 12:53:25.241 11332 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:53:25 ctl02 nova-api[11332]: 2017-09-28 12:53:25.241 11332 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:53:25 ctl02 nova-api[11332]: 2017-09-28 12:53:25.241 11332 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:53:25 ctl02 nova-api[11332]: 2017-09-28 12:53:25.241 11332 ERROR nova     max_url_len=max_url_len)
Sep 28 12:53:25 ctl02 nova-api[11332]: 2017-09-28 12:53:25.241 11332 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:53:25 ctl02 nova-api[11332]: 2017-09-28 12:53:25.241 11332 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:53:25 ctl02 nova-api[11332]: 2017-09-28 12:53:25.241 11332 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:53:25 ctl02 nova-api[11332]: 2017-09-28 12:53:25.241 11332 ERROR nova     sock.listen(backlog)
Sep 28 12:53:25 ctl02 nova-api[11332]: 2017-09-28 12:53:25.241 11332 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:53:25 ctl02 nova-api[11332]: 2017-09-28 12:53:25.241 11332 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:53:25 ctl02 nova-api[11332]: 2017-09-28 12:53:25.241 11332 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:53:25 ctl02 nova-api[11332]: 2017-09-28 12:53:25.241 11332 ERROR nova
Sep 28 12:53:25 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:53:25 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:53:25 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:53:25 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:53:25 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:53:25 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:53:25 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:53:25 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:53:25.879 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:53:25] "OPTIONS / HTTP/1.0" 200 134 0.000355
Sep 28 12:53:26 ctl02 heat-api[13008]: 2017-09-28 12:53:26.831 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:53:26] "OPTIONS / HTTP/1.0" 200 134 0.000510
Sep 28 12:53:27 ctl02 nova-conductor[5056]: 2017-09-28 12:53:27.145 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:53:27 ctl02 nova-conductor[5056]: 2017-09-28 12:53:27.148 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:53:27 ctl02 nova-conductor[5056]: 2017-09-28 12:53:27.161 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:53:27 ctl02 nova-conductor[5056]: 2017-09-28 12:53:27.165 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:53:27 ctl02 heat-api-cfn[13300]: 2017-09-28 12:53:27.246 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:53:27] "OPTIONS / HTTP/1.0" 200 134 0.000529
Sep 28 12:53:27 ctl02 nova-api[11350]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:53:27 ctl02 nova-api[11350]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:53:27 ctl02 nova-cert[4860]: 2017-09-28 12:53:27.368 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:53:27 ctl02 nova-api[11350]: 2017-09-28 12:53:27.549 11350 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:53:27 ctl02 nova-api[11350]: 2017-09-28 12:53:27.550 11350 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:53:27 ctl02 nova-api[11350]: 2017-09-28 12:53:27.550 11350 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:53:27 ctl02 nova-api[11350]: 2017-09-28 12:53:27.550 11350 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:53:27 ctl02 nova-api[11350]: 2017-09-28 12:53:27.550 11350 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:53:27 ctl02 nova-api[11350]: 2017-09-28 12:53:27.550 11350 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:53:27 ctl02 nova-api[11350]: 2017-09-28 12:53:27.550 11350 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:53:27 ctl02 nova-api[11350]: 2017-09-28 12:53:27.550 11350 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:53:27 ctl02 nova-api[11350]: 2017-09-28 12:53:27.550 11350 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:53:27 ctl02 nova-api[11350]: 2017-09-28 12:53:27.550 11350 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:53:27 ctl02 nova-api[11350]: 2017-09-28 12:53:27.550 11350 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:53:27 ctl02 nova-api[11350]: 2017-09-28 12:53:27.550 11350 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:53:27 ctl02 nova-api[11350]: 2017-09-28 12:53:27.550 11350 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:53:27 ctl02 nova-api[11350]: 2017-09-28 12:53:27.550 11350 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:53:27 ctl02 nova-api[11350]: 2017-09-28 12:53:27.550 11350 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:53:27 ctl02 nova-api[11350]: 2017-09-28 12:53:27.550 11350 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:53:27 ctl02 nova-api[11350]: 2017-09-28 12:53:27.550 11350 ERROR nova.wsgi     self.filename))
Sep 28 12:53:27 ctl02 nova-api[11350]: 2017-09-28 12:53:27.550 11350 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:53:27 ctl02 nova-api[11350]: 2017-09-28 12:53:27.550 11350 ERROR nova.wsgi
Sep 28 12:53:27 ctl02 nova-api[11350]: 2017-09-28 12:53:27.552 11350 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:53:27 ctl02 nova-api[11350]: 2017-09-28 12:53:27.695 11350 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:53:27 ctl02 heat-api-cfn[13300]: 2017-09-28 12:53:27.799 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:53:27] "OPTIONS / HTTP/1.0" 200 134 0.000465
Sep 28 12:53:27 ctl02 nova-api[11350]: 2017-09-28 12:53:27.920 11350 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:53:27 ctl02 nova-api[11350]: 2017-09-28 12:53:27.922 11350 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:53:27 ctl02 nova-api[11350]: 2017-09-28 12:53:27.923 11350 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:53:27 ctl02 nova-api[11350]: 2017-09-28 12:53:27.923 11350 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:53:28 ctl02 nova-api[11350]: 2017-09-28 12:53:28.059 11350 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:53:28 ctl02 nova-api[11350]: 2017-09-28 12:53:28.062 11350 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:53:28 ctl02 nova-api[11350]: 2017-09-28 12:53:28.062 11350 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:53:28 ctl02 nova-api[11350]: 2017-09-28 12:53:28.063 11350 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:53:28 ctl02 nova-api[11350]: 2017-09-28 12:53:28.067 11350 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:53:28 ctl02 nova-api[11350]: 2017-09-28 12:53:28.067 11350 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:53:28 ctl02 nova-api[11350]: 2017-09-28 12:53:28.067 11350 ERROR nova Traceback (most recent call last):
Sep 28 12:53:28 ctl02 nova-api[11350]: 2017-09-28 12:53:28.067 11350 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:53:28 ctl02 nova-api[11350]: 2017-09-28 12:53:28.067 11350 ERROR nova     sys.exit(main())
Sep 28 12:53:28 ctl02 nova-api[11350]: 2017-09-28 12:53:28.067 11350 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:53:28 ctl02 nova-api[11350]: 2017-09-28 12:53:28.067 11350 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:53:28 ctl02 nova-api[11350]: 2017-09-28 12:53:28.067 11350 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:53:28 ctl02 nova-api[11350]: 2017-09-28 12:53:28.067 11350 ERROR nova     max_url_len=max_url_len)
Sep 28 12:53:28 ctl02 nova-api[11350]: 2017-09-28 12:53:28.067 11350 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:53:28 ctl02 nova-api[11350]: 2017-09-28 12:53:28.067 11350 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:53:28 ctl02 nova-api[11350]: 2017-09-28 12:53:28.067 11350 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:53:28 ctl02 nova-api[11350]: 2017-09-28 12:53:28.067 11350 ERROR nova     sock.listen(backlog)
Sep 28 12:53:28 ctl02 nova-api[11350]: 2017-09-28 12:53:28.067 11350 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:53:28 ctl02 nova-api[11350]: 2017-09-28 12:53:28.067 11350 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:53:28 ctl02 nova-api[11350]: 2017-09-28 12:53:28.067 11350 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:53:28 ctl02 nova-api[11350]: 2017-09-28 12:53:28.067 11350 ERROR nova
Sep 28 12:53:28 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:53:28.112 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:53:28] "OPTIONS / HTTP/1.0" 200 134 0.000401
Sep 28 12:53:28 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:53:28 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:53:28 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:53:28 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8bdbf210)
Sep 28 12:53:28 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:53:28 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:53:28 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:53:28 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:53:28 ctl02 neutron-server[30536]: 2017-09-28 12:53:28.542 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:53:29 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8bdbf210)
Sep 28 12:53:29 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:53:29.357 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:53:29] "OPTIONS / HTTP/1.0" 200 134 0.000385
Sep 28 12:53:30 ctl02 nova-api[11368]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:53:30 ctl02 nova-api[11368]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:53:30 ctl02 nova-api[11368]: 2017-09-28 12:53:30.231 11368 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:53:30 ctl02 nova-api[11368]: 2017-09-28 12:53:30.232 11368 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:53:30 ctl02 nova-api[11368]: 2017-09-28 12:53:30.232 11368 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:53:30 ctl02 nova-api[11368]: 2017-09-28 12:53:30.232 11368 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:53:30 ctl02 nova-api[11368]: 2017-09-28 12:53:30.232 11368 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:53:30 ctl02 nova-api[11368]: 2017-09-28 12:53:30.232 11368 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:53:30 ctl02 nova-api[11368]: 2017-09-28 12:53:30.232 11368 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:53:30 ctl02 nova-api[11368]: 2017-09-28 12:53:30.232 11368 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:53:30 ctl02 nova-api[11368]: 2017-09-28 12:53:30.232 11368 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:53:30 ctl02 nova-api[11368]: 2017-09-28 12:53:30.232 11368 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:53:30 ctl02 nova-api[11368]: 2017-09-28 12:53:30.232 11368 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:53:30 ctl02 nova-api[11368]: 2017-09-28 12:53:30.232 11368 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:53:30 ctl02 nova-api[11368]: 2017-09-28 12:53:30.232 11368 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:53:30 ctl02 nova-api[11368]: 2017-09-28 12:53:30.232 11368 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:53:30 ctl02 nova-api[11368]: 2017-09-28 12:53:30.232 11368 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:53:30 ctl02 nova-api[11368]: 2017-09-28 12:53:30.232 11368 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:53:30 ctl02 nova-api[11368]: 2017-09-28 12:53:30.232 11368 ERROR nova.wsgi     self.filename))
Sep 28 12:53:30 ctl02 nova-api[11368]: 2017-09-28 12:53:30.232 11368 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:53:30 ctl02 nova-api[11368]: 2017-09-28 12:53:30.232 11368 ERROR nova.wsgi
Sep 28 12:53:30 ctl02 nova-api[11368]: 2017-09-28 12:53:30.233 11368 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:53:30 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8bdbf210)
Sep 28 12:53:30 ctl02 nova-api[11368]: 2017-09-28 12:53:30.361 11368 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:53:30 ctl02 nova-api[11368]: 2017-09-28 12:53:30.585 11368 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:53:30 ctl02 nova-api[11368]: 2017-09-28 12:53:30.587 11368 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:53:30 ctl02 nova-api[11368]: 2017-09-28 12:53:30.587 11368 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:53:30 ctl02 nova-api[11368]: 2017-09-28 12:53:30.587 11368 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:53:30 ctl02 neutron-server[30536]: 2017-09-28 12:53:30.638 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:53:30] "OPTIONS / HTTP/1.0" 200 262 0.000442
Sep 28 12:53:30 ctl02 nova-api[11368]: 2017-09-28 12:53:30.719 11368 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:53:30 ctl02 nova-api[11368]: 2017-09-28 12:53:30.721 11368 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:53:30 ctl02 nova-api[11368]: 2017-09-28 12:53:30.721 11368 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:53:30 ctl02 nova-api[11368]: 2017-09-28 12:53:30.721 11368 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:53:30 ctl02 nova-api[11368]: 2017-09-28 12:53:30.724 11368 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:53:30 ctl02 nova-api[11368]: 2017-09-28 12:53:30.725 11368 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:53:30 ctl02 nova-api[11368]: 2017-09-28 12:53:30.725 11368 ERROR nova Traceback (most recent call last):
Sep 28 12:53:30 ctl02 nova-api[11368]: 2017-09-28 12:53:30.725 11368 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:53:30 ctl02 nova-api[11368]: 2017-09-28 12:53:30.725 11368 ERROR nova     sys.exit(main())
Sep 28 12:53:30 ctl02 nova-api[11368]: 2017-09-28 12:53:30.725 11368 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:53:30 ctl02 nova-api[11368]: 2017-09-28 12:53:30.725 11368 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:53:30 ctl02 nova-api[11368]: 2017-09-28 12:53:30.725 11368 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:53:30 ctl02 nova-api[11368]: 2017-09-28 12:53:30.725 11368 ERROR nova     max_url_len=max_url_len)
Sep 28 12:53:30 ctl02 nova-api[11368]: 2017-09-28 12:53:30.725 11368 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:53:30 ctl02 nova-api[11368]: 2017-09-28 12:53:30.725 11368 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:53:30 ctl02 nova-api[11368]: 2017-09-28 12:53:30.725 11368 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:53:30 ctl02 nova-api[11368]: 2017-09-28 12:53:30.725 11368 ERROR nova     sock.listen(backlog)
Sep 28 12:53:30 ctl02 nova-api[11368]: 2017-09-28 12:53:30.725 11368 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:53:30 ctl02 nova-api[11368]: 2017-09-28 12:53:30.725 11368 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:53:30 ctl02 nova-api[11368]: 2017-09-28 12:53:30.725 11368 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:53:30 ctl02 nova-api[11368]: 2017-09-28 12:53:30.725 11368 ERROR nova
Sep 28 12:53:30 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:53:30 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:53:30 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:53:31 ctl02 glance-api[29183]: 2017-09-28 12:53:31.011 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:53:31] "OPTIONS / HTTP/1.0" 200 134 0.000626
Sep 28 12:53:31 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:53:31 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:53:31 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:53:31 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:53:31 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8bdbf210)
Sep 28 12:53:31 ctl02 heat-api-cfn[13300]: 2017-09-28 12:53:31.608 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:53:31] "OPTIONS / HTTP/1.0" 200 134 0.000456
Sep 28 12:53:32 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8bdbf210)
Sep 28 12:53:32 ctl02 glance-api[29183]: 2017-09-28 12:53:32.402 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:53:32] "OPTIONS / HTTP/1.0" 200 134 0.000553
Sep 28 12:53:32 ctl02 glance-api[29183]: 2017-09-28 12:53:32.432 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:53:32] "OPTIONS / HTTP/1.0" 200 134 0.000386
Sep 28 12:53:32 ctl02 nova-api[11386]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:53:32 ctl02 nova-api[11386]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:53:32 ctl02 heat-api[13008]: 2017-09-28 12:53:32.885 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:53:32] "OPTIONS / HTTP/1.0" 200 134 0.000532
Sep 28 12:53:32 ctl02 nova-api[11386]: 2017-09-28 12:53:32.993 11386 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:53:32 ctl02 nova-api[11386]: 2017-09-28 12:53:32.994 11386 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:53:32 ctl02 nova-api[11386]: 2017-09-28 12:53:32.994 11386 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:53:32 ctl02 nova-api[11386]: 2017-09-28 12:53:32.994 11386 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:53:32 ctl02 nova-api[11386]: 2017-09-28 12:53:32.994 11386 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:53:32 ctl02 nova-api[11386]: 2017-09-28 12:53:32.994 11386 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:53:32 ctl02 nova-api[11386]: 2017-09-28 12:53:32.994 11386 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:53:32 ctl02 nova-api[11386]: 2017-09-28 12:53:32.994 11386 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:53:32 ctl02 nova-api[11386]: 2017-09-28 12:53:32.994 11386 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:53:32 ctl02 nova-api[11386]: 2017-09-28 12:53:32.994 11386 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:53:32 ctl02 nova-api[11386]: 2017-09-28 12:53:32.994 11386 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:53:32 ctl02 nova-api[11386]: 2017-09-28 12:53:32.994 11386 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:53:32 ctl02 nova-api[11386]: 2017-09-28 12:53:32.994 11386 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:53:32 ctl02 nova-api[11386]: 2017-09-28 12:53:32.994 11386 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:53:32 ctl02 nova-api[11386]: 2017-09-28 12:53:32.994 11386 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:53:32 ctl02 nova-api[11386]: 2017-09-28 12:53:32.994 11386 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:53:32 ctl02 nova-api[11386]: 2017-09-28 12:53:32.994 11386 ERROR nova.wsgi     self.filename))
Sep 28 12:53:32 ctl02 nova-api[11386]: 2017-09-28 12:53:32.994 11386 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:53:32 ctl02 nova-api[11386]: 2017-09-28 12:53:32.994 11386 ERROR nova.wsgi
Sep 28 12:53:32 ctl02 nova-api[11386]: 2017-09-28 12:53:32.995 11386 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:53:33 ctl02 nova-api[11386]: 2017-09-28 12:53:33.123 11386 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:53:33 ctl02 neutron-server[30536]: 2017-09-28 12:53:33.184 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:53:33] "OPTIONS / HTTP/1.0" 200 262 0.000491
Sep 28 12:53:33 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8bdbf210)
Sep 28 12:53:33 ctl02 nova-api[11386]: 2017-09-28 12:53:33.347 11386 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:53:33 ctl02 nova-api[11386]: 2017-09-28 12:53:33.350 11386 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:53:33 ctl02 nova-api[11386]: 2017-09-28 12:53:33.350 11386 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:53:33 ctl02 nova-api[11386]: 2017-09-28 12:53:33.350 11386 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:53:33 ctl02 nova-api[11386]: 2017-09-28 12:53:33.481 11386 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:53:33 ctl02 nova-api[11386]: 2017-09-28 12:53:33.483 11386 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:53:33 ctl02 nova-api[11386]: 2017-09-28 12:53:33.483 11386 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:53:33 ctl02 nova-api[11386]: 2017-09-28 12:53:33.484 11386 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:53:33 ctl02 nova-api[11386]: 2017-09-28 12:53:33.487 11386 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:53:33 ctl02 nova-api[11386]: 2017-09-28 12:53:33.487 11386 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:53:33 ctl02 nova-api[11386]: 2017-09-28 12:53:33.487 11386 ERROR nova Traceback (most recent call last):
Sep 28 12:53:33 ctl02 nova-api[11386]: 2017-09-28 12:53:33.487 11386 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:53:33 ctl02 nova-api[11386]: 2017-09-28 12:53:33.487 11386 ERROR nova     sys.exit(main())
Sep 28 12:53:33 ctl02 nova-api[11386]: 2017-09-28 12:53:33.487 11386 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:53:33 ctl02 nova-api[11386]: 2017-09-28 12:53:33.487 11386 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:53:33 ctl02 nova-api[11386]: 2017-09-28 12:53:33.487 11386 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:53:33 ctl02 nova-api[11386]: 2017-09-28 12:53:33.487 11386 ERROR nova     max_url_len=max_url_len)
Sep 28 12:53:33 ctl02 nova-api[11386]: 2017-09-28 12:53:33.487 11386 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:53:33 ctl02 nova-api[11386]: 2017-09-28 12:53:33.487 11386 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:53:33 ctl02 nova-api[11386]: 2017-09-28 12:53:33.487 11386 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:53:33 ctl02 nova-api[11386]: 2017-09-28 12:53:33.487 11386 ERROR nova     sock.listen(backlog)
Sep 28 12:53:33 ctl02 nova-api[11386]: 2017-09-28 12:53:33.487 11386 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:53:33 ctl02 nova-api[11386]: 2017-09-28 12:53:33.487 11386 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:53:33 ctl02 nova-api[11386]: 2017-09-28 12:53:33.487 11386 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:53:33 ctl02 nova-api[11386]: 2017-09-28 12:53:33.487 11386 ERROR nova
Sep 28 12:53:33 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:53:33 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:53:33 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:53:33 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:53:33 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:53:33 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:53:33 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:53:34 ctl02 heat-api[13008]: 2017-09-28 12:53:34.165 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:53:34] "OPTIONS / HTTP/1.0" 200 134 0.000533
Sep 28 12:53:34 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8bdbf210)
Sep 28 12:53:34 ctl02 neutron-server[30536]: 2017-09-28 12:53:34.320 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:53:34] "OPTIONS / HTTP/1.0" 200 262 0.000475
Sep 28 12:53:35 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8bdbf210)
Sep 28 12:53:35 ctl02 nova-api[11404]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:53:35 ctl02 nova-api[11404]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:53:35 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:53:35.551 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:53:35] "OPTIONS / HTTP/1.0" 200 134 0.000384
Sep 28 12:53:35 ctl02 nova-api[11404]: 2017-09-28 12:53:35.729 11404 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:53:35 ctl02 nova-api[11404]: 2017-09-28 12:53:35.731 11404 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:53:35 ctl02 nova-api[11404]: 2017-09-28 12:53:35.731 11404 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:53:35 ctl02 nova-api[11404]: 2017-09-28 12:53:35.731 11404 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:53:35 ctl02 nova-api[11404]: 2017-09-28 12:53:35.731 11404 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:53:35 ctl02 nova-api[11404]: 2017-09-28 12:53:35.731 11404 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:53:35 ctl02 nova-api[11404]: 2017-09-28 12:53:35.731 11404 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:53:35 ctl02 nova-api[11404]: 2017-09-28 12:53:35.731 11404 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:53:35 ctl02 nova-api[11404]: 2017-09-28 12:53:35.731 11404 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:53:35 ctl02 nova-api[11404]: 2017-09-28 12:53:35.731 11404 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:53:35 ctl02 nova-api[11404]: 2017-09-28 12:53:35.731 11404 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:53:35 ctl02 nova-api[11404]: 2017-09-28 12:53:35.731 11404 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:53:35 ctl02 nova-api[11404]: 2017-09-28 12:53:35.731 11404 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:53:35 ctl02 nova-api[11404]: 2017-09-28 12:53:35.731 11404 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:53:35 ctl02 nova-api[11404]: 2017-09-28 12:53:35.731 11404 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:53:35 ctl02 nova-api[11404]: 2017-09-28 12:53:35.731 11404 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:53:35 ctl02 nova-api[11404]: 2017-09-28 12:53:35.731 11404 ERROR nova.wsgi     self.filename))
Sep 28 12:53:35 ctl02 nova-api[11404]: 2017-09-28 12:53:35.731 11404 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:53:35 ctl02 nova-api[11404]: 2017-09-28 12:53:35.731 11404 ERROR nova.wsgi
Sep 28 12:53:35 ctl02 nova-api[11404]: 2017-09-28 12:53:35.733 11404 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:53:35 ctl02 nova-api[11404]: 2017-09-28 12:53:35.862 11404 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:53:36 ctl02 nova-api[11404]: 2017-09-28 12:53:36.082 11404 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:53:36 ctl02 nova-api[11404]: 2017-09-28 12:53:36.084 11404 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:53:36 ctl02 nova-api[11404]: 2017-09-28 12:53:36.085 11404 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:53:36 ctl02 nova-api[11404]: 2017-09-28 12:53:36.085 11404 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:53:36 ctl02 neutron-server[30536]: 2017-09-28 12:53:36.146 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 4 dead agents out of 6:
Sep 28 12:53:36 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:53:36 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:53:06 cmp002
Sep 28 12:53:36 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:51:38 cmp001
Sep 28 12:53:36 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:52:00 cmp002
Sep 28 12:53:36 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:52:26 cmp002
Sep 28 12:53:36 ctl02 nova-api[11404]: 2017-09-28 12:53:36.216 11404 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:53:36 ctl02 nova-api[11404]: 2017-09-28 12:53:36.218 11404 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:53:36 ctl02 nova-api[11404]: 2017-09-28 12:53:36.219 11404 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:53:36 ctl02 nova-api[11404]: 2017-09-28 12:53:36.219 11404 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:53:36 ctl02 nova-api[11404]: 2017-09-28 12:53:36.222 11404 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:53:36 ctl02 nova-api[11404]: 2017-09-28 12:53:36.223 11404 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:53:36 ctl02 nova-api[11404]: 2017-09-28 12:53:36.223 11404 ERROR nova Traceback (most recent call last):
Sep 28 12:53:36 ctl02 nova-api[11404]: 2017-09-28 12:53:36.223 11404 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:53:36 ctl02 nova-api[11404]: 2017-09-28 12:53:36.223 11404 ERROR nova     sys.exit(main())
Sep 28 12:53:36 ctl02 nova-api[11404]: 2017-09-28 12:53:36.223 11404 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:53:36 ctl02 nova-api[11404]: 2017-09-28 12:53:36.223 11404 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:53:36 ctl02 nova-api[11404]: 2017-09-28 12:53:36.223 11404 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:53:36 ctl02 nova-api[11404]: 2017-09-28 12:53:36.223 11404 ERROR nova     max_url_len=max_url_len)
Sep 28 12:53:36 ctl02 nova-api[11404]: 2017-09-28 12:53:36.223 11404 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:53:36 ctl02 nova-api[11404]: 2017-09-28 12:53:36.223 11404 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:53:36 ctl02 nova-api[11404]: 2017-09-28 12:53:36.223 11404 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:53:36 ctl02 nova-api[11404]: 2017-09-28 12:53:36.223 11404 ERROR nova     sock.listen(backlog)
Sep 28 12:53:36 ctl02 nova-api[11404]: 2017-09-28 12:53:36.223 11404 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:53:36 ctl02 nova-api[11404]: 2017-09-28 12:53:36.223 11404 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:53:36 ctl02 nova-api[11404]: 2017-09-28 12:53:36.223 11404 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:53:36 ctl02 nova-api[11404]: 2017-09-28 12:53:36.223 11404 ERROR nova
Sep 28 12:53:36 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8bdbf210)
Sep 28 12:53:36 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:53:36 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:53:36 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:53:36 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:53:36 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:53:36 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:53:36 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:53:36 ctl02 heat-api[13008]: 2017-09-28 12:53:36.693 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:53:36] "OPTIONS / HTTP/1.0" 200 134 0.000667
Sep 28 12:53:37 ctl02 nova-consoleauth[5433]: 2017-09-28 12:53:37.211 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:53:37 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8bdbf210)
Sep 28 12:53:37 ctl02 heat-api-cfn[13300]: 2017-09-28 12:53:37.460 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:53:37] "OPTIONS / HTTP/1.0" 200 134 0.000609
Sep 28 12:53:37 ctl02 heat-api-cfn[13300]: 2017-09-28 12:53:37.552 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:53:37] "OPTIONS / HTTP/1.0" 200 134 0.000353
Sep 28 12:53:37 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:53:37.991 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:53:37] "OPTIONS / HTTP/1.0" 200 134 0.000350
Sep 28 12:53:38 ctl02 heat-engine[12803]: 2017-09-28 12:53:38.271 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:53:38 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8bdbf210)
Sep 28 12:53:38 ctl02 heat-engine[12803]: 2017-09-28 12:53:38.278 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:53:38 ctl02 heat-engine[12803]: 2017-09-28 12:53:38.279 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:53:38 ctl02 heat-engine[12803]: 2017-09-28 12:53:38.285 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:53:38 ctl02 nova-api[11422]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:53:38 ctl02 nova-api[11422]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:53:38 ctl02 nova-api[11422]: 2017-09-28 12:53:38.486 11422 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:53:38 ctl02 nova-api[11422]: 2017-09-28 12:53:38.487 11422 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:53:38 ctl02 nova-api[11422]: 2017-09-28 12:53:38.487 11422 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:53:38 ctl02 nova-api[11422]: 2017-09-28 12:53:38.487 11422 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:53:38 ctl02 nova-api[11422]: 2017-09-28 12:53:38.487 11422 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:53:38 ctl02 nova-api[11422]: 2017-09-28 12:53:38.487 11422 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:53:38 ctl02 nova-api[11422]: 2017-09-28 12:53:38.487 11422 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:53:38 ctl02 nova-api[11422]: 2017-09-28 12:53:38.487 11422 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:53:38 ctl02 nova-api[11422]: 2017-09-28 12:53:38.487 11422 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:53:38 ctl02 nova-api[11422]: 2017-09-28 12:53:38.487 11422 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:53:38 ctl02 nova-api[11422]: 2017-09-28 12:53:38.487 11422 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:53:38 ctl02 nova-api[11422]: 2017-09-28 12:53:38.487 11422 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:53:38 ctl02 nova-api[11422]: 2017-09-28 12:53:38.487 11422 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:53:38 ctl02 nova-api[11422]: 2017-09-28 12:53:38.487 11422 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:53:38 ctl02 nova-api[11422]: 2017-09-28 12:53:38.487 11422 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:53:38 ctl02 nova-api[11422]: 2017-09-28 12:53:38.487 11422 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:53:38 ctl02 nova-api[11422]: 2017-09-28 12:53:38.487 11422 ERROR nova.wsgi     self.filename))
Sep 28 12:53:38 ctl02 nova-api[11422]: 2017-09-28 12:53:38.487 11422 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:53:38 ctl02 nova-api[11422]: 2017-09-28 12:53:38.487 11422 ERROR nova.wsgi
Sep 28 12:53:38 ctl02 nova-api[11422]: 2017-09-28 12:53:38.488 11422 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:53:38 ctl02 nova-api[11422]: 2017-09-28 12:53:38.614 11422 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:53:38 ctl02 nova-api[11422]: 2017-09-28 12:53:38.834 11422 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:53:38 ctl02 nova-api[11422]: 2017-09-28 12:53:38.836 11422 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:53:38 ctl02 nova-api[11422]: 2017-09-28 12:53:38.836 11422 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:53:38 ctl02 nova-api[11422]: 2017-09-28 12:53:38.837 11422 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:53:38 ctl02 nova-api[11422]: 2017-09-28 12:53:38.966 11422 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:53:38 ctl02 nova-api[11422]: 2017-09-28 12:53:38.967 11422 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:53:38 ctl02 nova-api[11422]: 2017-09-28 12:53:38.968 11422 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:53:38 ctl02 nova-api[11422]: 2017-09-28 12:53:38.968 11422 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:53:38 ctl02 nova-api[11422]: 2017-09-28 12:53:38.971 11422 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:53:38 ctl02 nova-api[11422]: 2017-09-28 12:53:38.971 11422 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:53:38 ctl02 nova-api[11422]: 2017-09-28 12:53:38.971 11422 ERROR nova Traceback (most recent call last):
Sep 28 12:53:38 ctl02 nova-api[11422]: 2017-09-28 12:53:38.971 11422 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:53:38 ctl02 nova-api[11422]: 2017-09-28 12:53:38.971 11422 ERROR nova     sys.exit(main())
Sep 28 12:53:38 ctl02 nova-api[11422]: 2017-09-28 12:53:38.971 11422 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:53:38 ctl02 nova-api[11422]: 2017-09-28 12:53:38.971 11422 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:53:38 ctl02 nova-api[11422]: 2017-09-28 12:53:38.971 11422 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:53:38 ctl02 nova-api[11422]: 2017-09-28 12:53:38.971 11422 ERROR nova     max_url_len=max_url_len)
Sep 28 12:53:38 ctl02 nova-api[11422]: 2017-09-28 12:53:38.971 11422 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:53:38 ctl02 nova-api[11422]: 2017-09-28 12:53:38.971 11422 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:53:38 ctl02 nova-api[11422]: 2017-09-28 12:53:38.971 11422 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:53:38 ctl02 nova-api[11422]: 2017-09-28 12:53:38.971 11422 ERROR nova     sock.listen(backlog)
Sep 28 12:53:38 ctl02 nova-api[11422]: 2017-09-28 12:53:38.971 11422 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:53:38 ctl02 nova-api[11422]: 2017-09-28 12:53:38.971 11422 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:53:38 ctl02 nova-api[11422]: 2017-09-28 12:53:38.971 11422 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:53:38 ctl02 nova-api[11422]: 2017-09-28 12:53:38.971 11422 ERROR nova
Sep 28 12:53:39 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:53:39 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:53:39 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:53:39 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:53:39 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:53:39 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:53:39 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:53:39 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:53:39 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:53:39 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:53:39.760 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:53:39] "OPTIONS / HTTP/1.0" 200 134 0.000378
Sep 28 12:53:40 ctl02 nova-scheduler[5620]: 2017-09-28 12:53:40.309 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:53:40 ctl02 glance-api[29183]: 2017-09-28 12:53:40.670 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:53:40] "OPTIONS / HTTP/1.0" 200 134 0.000556
Sep 28 12:53:41 ctl02 neutron-server[30536]: 2017-09-28 12:53:41.020 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:53:41] "OPTIONS / HTTP/1.0" 200 262 0.000480
Sep 28 12:53:41 ctl02 nova-api[11445]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:53:41 ctl02 nova-api[11445]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:53:41 ctl02 nova-api[11445]: 2017-09-28 12:53:41.223 11445 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:53:41 ctl02 nova-api[11445]: 2017-09-28 12:53:41.224 11445 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:53:41 ctl02 nova-api[11445]: 2017-09-28 12:53:41.224 11445 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:53:41 ctl02 nova-api[11445]: 2017-09-28 12:53:41.224 11445 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:53:41 ctl02 nova-api[11445]: 2017-09-28 12:53:41.224 11445 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:53:41 ctl02 nova-api[11445]: 2017-09-28 12:53:41.224 11445 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:53:41 ctl02 nova-api[11445]: 2017-09-28 12:53:41.224 11445 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:53:41 ctl02 nova-api[11445]: 2017-09-28 12:53:41.224 11445 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:53:41 ctl02 nova-api[11445]: 2017-09-28 12:53:41.224 11445 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:53:41 ctl02 nova-api[11445]: 2017-09-28 12:53:41.224 11445 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:53:41 ctl02 nova-api[11445]: 2017-09-28 12:53:41.224 11445 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:53:41 ctl02 nova-api[11445]: 2017-09-28 12:53:41.224 11445 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:53:41 ctl02 nova-api[11445]: 2017-09-28 12:53:41.224 11445 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:53:41 ctl02 nova-api[11445]: 2017-09-28 12:53:41.224 11445 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:53:41 ctl02 nova-api[11445]: 2017-09-28 12:53:41.224 11445 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:53:41 ctl02 nova-api[11445]: 2017-09-28 12:53:41.224 11445 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:53:41 ctl02 nova-api[11445]: 2017-09-28 12:53:41.224 11445 ERROR nova.wsgi     self.filename))
Sep 28 12:53:41 ctl02 nova-api[11445]: 2017-09-28 12:53:41.224 11445 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:53:41 ctl02 nova-api[11445]: 2017-09-28 12:53:41.224 11445 ERROR nova.wsgi
Sep 28 12:53:41 ctl02 nova-api[11445]: 2017-09-28 12:53:41.225 11445 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:53:41 ctl02 heat-api-cfn[13300]: 2017-09-28 12:53:41.244 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:53:41] "OPTIONS / HTTP/1.0" 200 134 0.000451
Sep 28 12:53:41 ctl02 nova-api[11445]: 2017-09-28 12:53:41.352 11445 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:53:41 ctl02 nova-api[11445]: 2017-09-28 12:53:41.573 11445 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:53:41 ctl02 nova-api[11445]: 2017-09-28 12:53:41.575 11445 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:53:41 ctl02 nova-api[11445]: 2017-09-28 12:53:41.576 11445 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:53:41 ctl02 nova-api[11445]: 2017-09-28 12:53:41.576 11445 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:53:41 ctl02 nova-api[11445]: 2017-09-28 12:53:41.706 11445 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:53:41 ctl02 nova-api[11445]: 2017-09-28 12:53:41.707 11445 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:53:41 ctl02 nova-api[11445]: 2017-09-28 12:53:41.708 11445 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:53:41 ctl02 nova-api[11445]: 2017-09-28 12:53:41.708 11445 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:53:41 ctl02 nova-api[11445]: 2017-09-28 12:53:41.711 11445 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:53:41 ctl02 nova-api[11445]: 2017-09-28 12:53:41.711 11445 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:53:41 ctl02 nova-api[11445]: 2017-09-28 12:53:41.711 11445 ERROR nova Traceback (most recent call last):
Sep 28 12:53:41 ctl02 nova-api[11445]: 2017-09-28 12:53:41.711 11445 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:53:41 ctl02 nova-api[11445]: 2017-09-28 12:53:41.711 11445 ERROR nova     sys.exit(main())
Sep 28 12:53:41 ctl02 nova-api[11445]: 2017-09-28 12:53:41.711 11445 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:53:41 ctl02 nova-api[11445]: 2017-09-28 12:53:41.711 11445 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:53:41 ctl02 nova-api[11445]: 2017-09-28 12:53:41.711 11445 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:53:41 ctl02 nova-api[11445]: 2017-09-28 12:53:41.711 11445 ERROR nova     max_url_len=max_url_len)
Sep 28 12:53:41 ctl02 nova-api[11445]: 2017-09-28 12:53:41.711 11445 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:53:41 ctl02 nova-api[11445]: 2017-09-28 12:53:41.711 11445 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:53:41 ctl02 nova-api[11445]: 2017-09-28 12:53:41.711 11445 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:53:41 ctl02 nova-api[11445]: 2017-09-28 12:53:41.711 11445 ERROR nova     sock.listen(backlog)
Sep 28 12:53:41 ctl02 nova-api[11445]: 2017-09-28 12:53:41.711 11445 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:53:41 ctl02 nova-api[11445]: 2017-09-28 12:53:41.711 11445 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:53:41 ctl02 nova-api[11445]: 2017-09-28 12:53:41.711 11445 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:53:41 ctl02 nova-api[11445]: 2017-09-28 12:53:41.711 11445 ERROR nova
Sep 28 12:53:41 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:53:41 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:53:41 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:53:42 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:53:42 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:53:42 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:53:42 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:53:42 ctl02 glance-api[29183]: 2017-09-28 12:53:42.421 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:53:42] "OPTIONS / HTTP/1.0" 200 134 0.000568
Sep 28 12:53:42 ctl02 glance-api[29183]: 2017-09-28 12:53:42.481 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:53:42] "OPTIONS / HTTP/1.0" 200 134 0.000590
Sep 28 12:53:42 ctl02 heat-api[13008]: 2017-09-28 12:53:42.909 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:53:42] "OPTIONS / HTTP/1.0" 200 134 0.000547
Sep 28 12:53:43 ctl02 neutron-server[30536]: 2017-09-28 12:53:43.042 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:53:43] "OPTIONS / HTTP/1.0" 200 262 0.000472
Sep 28 12:53:43 ctl02 nova-api[11463]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:53:43 ctl02 nova-api[11463]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:53:43 ctl02 heat-api[13008]: 2017-09-28 12:53:43.942 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:53:43] "OPTIONS / HTTP/1.0" 200 134 0.000556
Sep 28 12:53:43 ctl02 nova-api[11463]: 2017-09-28 12:53:43.968 11463 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:53:43 ctl02 nova-api[11463]: 2017-09-28 12:53:43.969 11463 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:53:43 ctl02 nova-api[11463]: 2017-09-28 12:53:43.969 11463 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:53:43 ctl02 nova-api[11463]: 2017-09-28 12:53:43.969 11463 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:53:43 ctl02 nova-api[11463]: 2017-09-28 12:53:43.969 11463 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:53:43 ctl02 nova-api[11463]: 2017-09-28 12:53:43.969 11463 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:53:43 ctl02 nova-api[11463]: 2017-09-28 12:53:43.969 11463 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:53:43 ctl02 nova-api[11463]: 2017-09-28 12:53:43.969 11463 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:53:43 ctl02 nova-api[11463]: 2017-09-28 12:53:43.969 11463 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:53:43 ctl02 nova-api[11463]: 2017-09-28 12:53:43.969 11463 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:53:43 ctl02 nova-api[11463]: 2017-09-28 12:53:43.969 11463 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:53:43 ctl02 nova-api[11463]: 2017-09-28 12:53:43.969 11463 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:53:43 ctl02 nova-api[11463]: 2017-09-28 12:53:43.969 11463 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:53:43 ctl02 nova-api[11463]: 2017-09-28 12:53:43.969 11463 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:53:43 ctl02 nova-api[11463]: 2017-09-28 12:53:43.969 11463 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:53:43 ctl02 nova-api[11463]: 2017-09-28 12:53:43.969 11463 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:53:43 ctl02 nova-api[11463]: 2017-09-28 12:53:43.969 11463 ERROR nova.wsgi     self.filename))
Sep 28 12:53:43 ctl02 nova-api[11463]: 2017-09-28 12:53:43.969 11463 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:53:43 ctl02 nova-api[11463]: 2017-09-28 12:53:43.969 11463 ERROR nova.wsgi
Sep 28 12:53:43 ctl02 nova-api[11463]: 2017-09-28 12:53:43.970 11463 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:53:44 ctl02 nova-api[11463]: 2017-09-28 12:53:44.096 11463 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:53:44 ctl02 neutron-server[30536]: 2017-09-28 12:53:44.314 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:53:44] "OPTIONS / HTTP/1.0" 200 262 0.000500
Sep 28 12:53:44 ctl02 nova-api[11463]: 2017-09-28 12:53:44.320 11463 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:53:44 ctl02 nova-api[11463]: 2017-09-28 12:53:44.322 11463 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:53:44 ctl02 nova-api[11463]: 2017-09-28 12:53:44.322 11463 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:53:44 ctl02 nova-api[11463]: 2017-09-28 12:53:44.323 11463 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:53:44 ctl02 nova-api[11463]: 2017-09-28 12:53:44.452 11463 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:53:44 ctl02 nova-api[11463]: 2017-09-28 12:53:44.453 11463 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:53:44 ctl02 nova-api[11463]: 2017-09-28 12:53:44.454 11463 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:53:44 ctl02 nova-api[11463]: 2017-09-28 12:53:44.454 11463 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:53:44 ctl02 nova-api[11463]: 2017-09-28 12:53:44.457 11463 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:53:44 ctl02 nova-api[11463]: 2017-09-28 12:53:44.458 11463 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:53:44 ctl02 nova-api[11463]: 2017-09-28 12:53:44.458 11463 ERROR nova Traceback (most recent call last):
Sep 28 12:53:44 ctl02 nova-api[11463]: 2017-09-28 12:53:44.458 11463 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:53:44 ctl02 nova-api[11463]: 2017-09-28 12:53:44.458 11463 ERROR nova     sys.exit(main())
Sep 28 12:53:44 ctl02 nova-api[11463]: 2017-09-28 12:53:44.458 11463 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:53:44 ctl02 nova-api[11463]: 2017-09-28 12:53:44.458 11463 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:53:44 ctl02 nova-api[11463]: 2017-09-28 12:53:44.458 11463 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:53:44 ctl02 nova-api[11463]: 2017-09-28 12:53:44.458 11463 ERROR nova     max_url_len=max_url_len)
Sep 28 12:53:44 ctl02 nova-api[11463]: 2017-09-28 12:53:44.458 11463 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:53:44 ctl02 nova-api[11463]: 2017-09-28 12:53:44.458 11463 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:53:44 ctl02 nova-api[11463]: 2017-09-28 12:53:44.458 11463 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:53:44 ctl02 nova-api[11463]: 2017-09-28 12:53:44.458 11463 ERROR nova     sock.listen(backlog)
Sep 28 12:53:44 ctl02 nova-api[11463]: 2017-09-28 12:53:44.458 11463 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:53:44 ctl02 nova-api[11463]: 2017-09-28 12:53:44.458 11463 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:53:44 ctl02 nova-api[11463]: 2017-09-28 12:53:44.458 11463 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:53:44 ctl02 nova-api[11463]: 2017-09-28 12:53:44.458 11463 ERROR nova
Sep 28 12:53:44 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:53:44 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:53:44 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:53:44 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:53:44 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:53:44 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:53:44 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:53:45 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:53:45.808 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:53:45] "OPTIONS / HTTP/1.0" 200 134 0.000375
Sep 28 12:53:46 ctl02 nova-api[11481]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:53:46 ctl02 nova-api[11481]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:53:46 ctl02 nova-api[11481]: 2017-09-28 12:53:46.721 11481 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:53:46 ctl02 nova-api[11481]: 2017-09-28 12:53:46.722 11481 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:53:46 ctl02 nova-api[11481]: 2017-09-28 12:53:46.722 11481 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:53:46 ctl02 nova-api[11481]: 2017-09-28 12:53:46.722 11481 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:53:46 ctl02 nova-api[11481]: 2017-09-28 12:53:46.722 11481 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:53:46 ctl02 nova-api[11481]: 2017-09-28 12:53:46.722 11481 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:53:46 ctl02 nova-api[11481]: 2017-09-28 12:53:46.722 11481 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:53:46 ctl02 nova-api[11481]: 2017-09-28 12:53:46.722 11481 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:53:46 ctl02 nova-api[11481]: 2017-09-28 12:53:46.722 11481 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:53:46 ctl02 nova-api[11481]: 2017-09-28 12:53:46.722 11481 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:53:46 ctl02 nova-api[11481]: 2017-09-28 12:53:46.722 11481 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:53:46 ctl02 nova-api[11481]: 2017-09-28 12:53:46.722 11481 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:53:46 ctl02 nova-api[11481]: 2017-09-28 12:53:46.722 11481 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:53:46 ctl02 nova-api[11481]: 2017-09-28 12:53:46.722 11481 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:53:46 ctl02 nova-api[11481]: 2017-09-28 12:53:46.722 11481 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:53:46 ctl02 nova-api[11481]: 2017-09-28 12:53:46.722 11481 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:53:46 ctl02 nova-api[11481]: 2017-09-28 12:53:46.722 11481 ERROR nova.wsgi     self.filename))
Sep 28 12:53:46 ctl02 nova-api[11481]: 2017-09-28 12:53:46.722 11481 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:53:46 ctl02 nova-api[11481]: 2017-09-28 12:53:46.722 11481 ERROR nova.wsgi
Sep 28 12:53:46 ctl02 nova-api[11481]: 2017-09-28 12:53:46.723 11481 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:53:46 ctl02 nova-api[11481]: 2017-09-28 12:53:46.854 11481 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:53:46 ctl02 heat-api[13008]: 2017-09-28 12:53:46.889 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:53:46] "OPTIONS / HTTP/1.0" 200 134 0.000561
Sep 28 12:53:47 ctl02 nova-api[11481]: 2017-09-28 12:53:47.091 11481 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:53:47 ctl02 nova-api[11481]: 2017-09-28 12:53:47.093 11481 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:53:47 ctl02 nova-api[11481]: 2017-09-28 12:53:47.093 11481 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:53:47 ctl02 nova-api[11481]: 2017-09-28 12:53:47.093 11481 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:53:47 ctl02 heat-api-cfn[13300]: 2017-09-28 12:53:47.207 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:53:47] "OPTIONS / HTTP/1.0" 200 134 0.000409
Sep 28 12:53:47 ctl02 nova-api[11481]: 2017-09-28 12:53:47.225 11481 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:53:47 ctl02 nova-api[11481]: 2017-09-28 12:53:47.227 11481 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:53:47 ctl02 nova-api[11481]: 2017-09-28 12:53:47.228 11481 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:53:47 ctl02 nova-api[11481]: 2017-09-28 12:53:47.228 11481 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:53:47 ctl02 nova-api[11481]: 2017-09-28 12:53:47.232 11481 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:53:47 ctl02 nova-api[11481]: 2017-09-28 12:53:47.232 11481 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:53:47 ctl02 nova-api[11481]: 2017-09-28 12:53:47.232 11481 ERROR nova Traceback (most recent call last):
Sep 28 12:53:47 ctl02 nova-api[11481]: 2017-09-28 12:53:47.232 11481 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:53:47 ctl02 nova-api[11481]: 2017-09-28 12:53:47.232 11481 ERROR nova     sys.exit(main())
Sep 28 12:53:47 ctl02 nova-api[11481]: 2017-09-28 12:53:47.232 11481 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:53:47 ctl02 nova-api[11481]: 2017-09-28 12:53:47.232 11481 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:53:47 ctl02 nova-api[11481]: 2017-09-28 12:53:47.232 11481 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:53:47 ctl02 nova-api[11481]: 2017-09-28 12:53:47.232 11481 ERROR nova     max_url_len=max_url_len)
Sep 28 12:53:47 ctl02 nova-api[11481]: 2017-09-28 12:53:47.232 11481 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:53:47 ctl02 nova-api[11481]: 2017-09-28 12:53:47.232 11481 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:53:47 ctl02 nova-api[11481]: 2017-09-28 12:53:47.232 11481 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:53:47 ctl02 nova-api[11481]: 2017-09-28 12:53:47.232 11481 ERROR nova     sock.listen(backlog)
Sep 28 12:53:47 ctl02 nova-api[11481]: 2017-09-28 12:53:47.232 11481 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:53:47 ctl02 nova-api[11481]: 2017-09-28 12:53:47.232 11481 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:53:47 ctl02 nova-api[11481]: 2017-09-28 12:53:47.232 11481 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:53:47 ctl02 nova-api[11481]: 2017-09-28 12:53:47.232 11481 ERROR nova
Sep 28 12:53:47 ctl02 heat-api-cfn[13300]: 2017-09-28 12:53:47.276 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:53:47] "OPTIONS / HTTP/1.0" 200 134 0.000477
Sep 28 12:53:47 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:53:47 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:53:47 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:53:47 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:53:47 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:53:47 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:53:47 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:53:48 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:53:48.374 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:53:48] "OPTIONS / HTTP/1.0" 200 134 0.000414
Sep 28 12:53:49 ctl02 nova-api[11500]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:53:49 ctl02 nova-api[11500]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:53:49 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:53:49.480 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:53:49] "OPTIONS / HTTP/1.0" 200 134 0.000415
Sep 28 12:53:49 ctl02 nova-api[11500]: 2017-09-28 12:53:49.529 11500 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:53:49 ctl02 nova-api[11500]: 2017-09-28 12:53:49.531 11500 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:53:49 ctl02 nova-api[11500]: 2017-09-28 12:53:49.531 11500 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:53:49 ctl02 nova-api[11500]: 2017-09-28 12:53:49.531 11500 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:53:49 ctl02 nova-api[11500]: 2017-09-28 12:53:49.531 11500 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:53:49 ctl02 nova-api[11500]: 2017-09-28 12:53:49.531 11500 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:53:49 ctl02 nova-api[11500]: 2017-09-28 12:53:49.531 11500 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:53:49 ctl02 nova-api[11500]: 2017-09-28 12:53:49.531 11500 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:53:49 ctl02 nova-api[11500]: 2017-09-28 12:53:49.531 11500 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:53:49 ctl02 nova-api[11500]: 2017-09-28 12:53:49.531 11500 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:53:49 ctl02 nova-api[11500]: 2017-09-28 12:53:49.531 11500 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:53:49 ctl02 nova-api[11500]: 2017-09-28 12:53:49.531 11500 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:53:49 ctl02 nova-api[11500]: 2017-09-28 12:53:49.531 11500 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:53:49 ctl02 nova-api[11500]: 2017-09-28 12:53:49.531 11500 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:53:49 ctl02 nova-api[11500]: 2017-09-28 12:53:49.531 11500 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:53:49 ctl02 nova-api[11500]: 2017-09-28 12:53:49.531 11500 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:53:49 ctl02 nova-api[11500]: 2017-09-28 12:53:49.531 11500 ERROR nova.wsgi     self.filename))
Sep 28 12:53:49 ctl02 nova-api[11500]: 2017-09-28 12:53:49.531 11500 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:53:49 ctl02 nova-api[11500]: 2017-09-28 12:53:49.531 11500 ERROR nova.wsgi
Sep 28 12:53:49 ctl02 nova-api[11500]: 2017-09-28 12:53:49.533 11500 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:53:49 ctl02 nova-api[11500]: 2017-09-28 12:53:49.666 11500 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:53:49 ctl02 nova-api[11500]: 2017-09-28 12:53:49.913 11500 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:53:49 ctl02 nova-api[11500]: 2017-09-28 12:53:49.916 11500 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:53:49 ctl02 nova-api[11500]: 2017-09-28 12:53:49.916 11500 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:53:49 ctl02 nova-api[11500]: 2017-09-28 12:53:49.917 11500 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:53:50 ctl02 nova-api[11500]: 2017-09-28 12:53:50.049 11500 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:53:50 ctl02 nova-api[11500]: 2017-09-28 12:53:50.052 11500 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:53:50 ctl02 nova-api[11500]: 2017-09-28 12:53:50.052 11500 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:53:50 ctl02 nova-api[11500]: 2017-09-28 12:53:50.052 11500 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:53:50 ctl02 nova-api[11500]: 2017-09-28 12:53:50.056 11500 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:53:50 ctl02 nova-api[11500]: 2017-09-28 12:53:50.056 11500 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:53:50 ctl02 nova-api[11500]: 2017-09-28 12:53:50.056 11500 ERROR nova Traceback (most recent call last):
Sep 28 12:53:50 ctl02 nova-api[11500]: 2017-09-28 12:53:50.056 11500 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:53:50 ctl02 nova-api[11500]: 2017-09-28 12:53:50.056 11500 ERROR nova     sys.exit(main())
Sep 28 12:53:50 ctl02 nova-api[11500]: 2017-09-28 12:53:50.056 11500 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:53:50 ctl02 nova-api[11500]: 2017-09-28 12:53:50.056 11500 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:53:50 ctl02 nova-api[11500]: 2017-09-28 12:53:50.056 11500 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:53:50 ctl02 nova-api[11500]: 2017-09-28 12:53:50.056 11500 ERROR nova     max_url_len=max_url_len)
Sep 28 12:53:50 ctl02 nova-api[11500]: 2017-09-28 12:53:50.056 11500 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:53:50 ctl02 nova-api[11500]: 2017-09-28 12:53:50.056 11500 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:53:50 ctl02 nova-api[11500]: 2017-09-28 12:53:50.056 11500 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:53:50 ctl02 nova-api[11500]: 2017-09-28 12:53:50.056 11500 ERROR nova     sock.listen(backlog)
Sep 28 12:53:50 ctl02 nova-api[11500]: 2017-09-28 12:53:50.056 11500 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:53:50 ctl02 nova-api[11500]: 2017-09-28 12:53:50.056 11500 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:53:50 ctl02 nova-api[11500]: 2017-09-28 12:53:50.056 11500 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:53:50 ctl02 nova-api[11500]: 2017-09-28 12:53:50.056 11500 ERROR nova
Sep 28 12:53:50 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:53:50 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:53:50 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:53:50 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:53:50 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:53:50 ctl02 glance-api[29183]: 2017-09-28 12:53:50.382 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:53:50] "OPTIONS / HTTP/1.0" 200 134 0.000701
Sep 28 12:53:50 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:53:50 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:53:51 ctl02 neutron-server[30536]: 2017-09-28 12:53:51.141 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 12:53:51 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:53:51 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:53:06 cmp002
Sep 28 12:53:51 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:52:00 cmp002
Sep 28 12:53:51 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:52:26 cmp002
Sep 28 12:53:51 ctl02 neutron-server[30536]: 2017-09-28 12:53:51.156 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:53:51] "OPTIONS / HTTP/1.0" 200 262 0.000482
Sep 28 12:53:51 ctl02 heat-api-cfn[13300]: 2017-09-28 12:53:51.173 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:53:51] "OPTIONS / HTTP/1.0" 200 134 0.000513
Sep 28 12:53:52 ctl02 nova-api[11518]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:53:52 ctl02 nova-api[11518]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:53:52 ctl02 nova-api[11518]: 2017-09-28 12:53:52.290 11518 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:53:52 ctl02 nova-api[11518]: 2017-09-28 12:53:52.292 11518 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:53:52 ctl02 nova-api[11518]: 2017-09-28 12:53:52.292 11518 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:53:52 ctl02 nova-api[11518]: 2017-09-28 12:53:52.292 11518 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:53:52 ctl02 nova-api[11518]: 2017-09-28 12:53:52.292 11518 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:53:52 ctl02 nova-api[11518]: 2017-09-28 12:53:52.292 11518 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:53:52 ctl02 nova-api[11518]: 2017-09-28 12:53:52.292 11518 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:53:52 ctl02 nova-api[11518]: 2017-09-28 12:53:52.292 11518 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:53:52 ctl02 nova-api[11518]: 2017-09-28 12:53:52.292 11518 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:53:52 ctl02 nova-api[11518]: 2017-09-28 12:53:52.292 11518 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:53:52 ctl02 nova-api[11518]: 2017-09-28 12:53:52.292 11518 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:53:52 ctl02 nova-api[11518]: 2017-09-28 12:53:52.292 11518 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:53:52 ctl02 nova-api[11518]: 2017-09-28 12:53:52.292 11518 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:53:52 ctl02 nova-api[11518]: 2017-09-28 12:53:52.292 11518 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:53:52 ctl02 nova-api[11518]: 2017-09-28 12:53:52.292 11518 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:53:52 ctl02 nova-api[11518]: 2017-09-28 12:53:52.292 11518 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:53:52 ctl02 nova-api[11518]: 2017-09-28 12:53:52.292 11518 ERROR nova.wsgi     self.filename))
Sep 28 12:53:52 ctl02 nova-api[11518]: 2017-09-28 12:53:52.292 11518 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:53:52 ctl02 nova-api[11518]: 2017-09-28 12:53:52.292 11518 ERROR nova.wsgi
Sep 28 12:53:52 ctl02 nova-api[11518]: 2017-09-28 12:53:52.293 11518 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:53:52 ctl02 nova-api[11518]: 2017-09-28 12:53:52.425 11518 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:53:52 ctl02 glance-api[29183]: 2017-09-28 12:53:52.578 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:53:52] "OPTIONS / HTTP/1.0" 200 134 0.000578
Sep 28 12:53:52 ctl02 glance-api[29183]: 2017-09-28 12:53:52.609 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:53:52] "OPTIONS / HTTP/1.0" 200 134 0.000586
Sep 28 12:53:52 ctl02 nova-api[11518]: 2017-09-28 12:53:52.647 11518 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:53:52 ctl02 nova-api[11518]: 2017-09-28 12:53:52.658 11518 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:53:52 ctl02 nova-api[11518]: 2017-09-28 12:53:52.658 11518 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:53:52 ctl02 nova-api[11518]: 2017-09-28 12:53:52.659 11518 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:53:52 ctl02 nova-api[11518]: 2017-09-28 12:53:52.795 11518 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:53:52 ctl02 nova-api[11518]: 2017-09-28 12:53:52.798 11518 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:53:52 ctl02 nova-api[11518]: 2017-09-28 12:53:52.798 11518 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:53:52 ctl02 nova-api[11518]: 2017-09-28 12:53:52.799 11518 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:53:52 ctl02 nova-api[11518]: 2017-09-28 12:53:52.802 11518 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:53:52 ctl02 nova-api[11518]: 2017-09-28 12:53:52.802 11518 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:53:52 ctl02 nova-api[11518]: 2017-09-28 12:53:52.802 11518 ERROR nova Traceback (most recent call last):
Sep 28 12:53:52 ctl02 nova-api[11518]: 2017-09-28 12:53:52.802 11518 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:53:52 ctl02 nova-api[11518]: 2017-09-28 12:53:52.802 11518 ERROR nova     sys.exit(main())
Sep 28 12:53:52 ctl02 nova-api[11518]: 2017-09-28 12:53:52.802 11518 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:53:52 ctl02 nova-api[11518]: 2017-09-28 12:53:52.802 11518 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:53:52 ctl02 nova-api[11518]: 2017-09-28 12:53:52.802 11518 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:53:52 ctl02 nova-api[11518]: 2017-09-28 12:53:52.802 11518 ERROR nova     max_url_len=max_url_len)
Sep 28 12:53:52 ctl02 nova-api[11518]: 2017-09-28 12:53:52.802 11518 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:53:52 ctl02 nova-api[11518]: 2017-09-28 12:53:52.802 11518 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:53:52 ctl02 nova-api[11518]: 2017-09-28 12:53:52.802 11518 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:53:52 ctl02 nova-api[11518]: 2017-09-28 12:53:52.802 11518 ERROR nova     sock.listen(backlog)
Sep 28 12:53:52 ctl02 nova-api[11518]: 2017-09-28 12:53:52.802 11518 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:53:52 ctl02 nova-api[11518]: 2017-09-28 12:53:52.802 11518 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:53:52 ctl02 nova-api[11518]: 2017-09-28 12:53:52.802 11518 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:53:52 ctl02 nova-api[11518]: 2017-09-28 12:53:52.802 11518 ERROR nova
Sep 28 12:53:52 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:53:52 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:53:52 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:53:53 ctl02 heat-api[13008]: 2017-09-28 12:53:53.093 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:53:53] "OPTIONS / HTTP/1.0" 200 134 0.000584
Sep 28 12:53:53 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:53:53 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:53:53 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:53:53 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:53:53 ctl02 neutron-server[30536]: 2017-09-28 12:53:53.386 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:53:53] "OPTIONS / HTTP/1.0" 200 262 0.000451
Sep 28 12:53:53 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9f6f5f31)
Sep 28 12:53:53 ctl02 heat-api[13008]: 2017-09-28 12:53:53.581 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:53:53] "OPTIONS / HTTP/1.0" 200 134 0.000520
Sep 28 12:53:53 ctl02 neutron-server[30536]: 2017-09-28 12:53:53.961 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:53:53] "OPTIONS / HTTP/1.0" 200 262 0.000455
Sep 28 12:53:54 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9f6f5f31)
Sep 28 12:53:54 ctl02 nova-api[11536]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:53:54 ctl02 nova-api[11536]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:53:54 ctl02 nova-api[11536]: 2017-09-28 12:53:54.980 11536 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:53:54 ctl02 nova-api[11536]: 2017-09-28 12:53:54.982 11536 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:53:54 ctl02 nova-api[11536]: 2017-09-28 12:53:54.982 11536 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:53:54 ctl02 nova-api[11536]: 2017-09-28 12:53:54.982 11536 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:53:54 ctl02 nova-api[11536]: 2017-09-28 12:53:54.982 11536 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:53:54 ctl02 nova-api[11536]: 2017-09-28 12:53:54.982 11536 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:53:54 ctl02 nova-api[11536]: 2017-09-28 12:53:54.982 11536 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:53:54 ctl02 nova-api[11536]: 2017-09-28 12:53:54.982 11536 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:53:54 ctl02 nova-api[11536]: 2017-09-28 12:53:54.982 11536 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:53:54 ctl02 nova-api[11536]: 2017-09-28 12:53:54.982 11536 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:53:54 ctl02 nova-api[11536]: 2017-09-28 12:53:54.982 11536 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:53:54 ctl02 nova-api[11536]: 2017-09-28 12:53:54.982 11536 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:53:54 ctl02 nova-api[11536]: 2017-09-28 12:53:54.982 11536 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:53:54 ctl02 nova-api[11536]: 2017-09-28 12:53:54.982 11536 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:53:54 ctl02 nova-api[11536]: 2017-09-28 12:53:54.982 11536 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:53:54 ctl02 nova-api[11536]: 2017-09-28 12:53:54.982 11536 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:53:54 ctl02 nova-api[11536]: 2017-09-28 12:53:54.982 11536 ERROR nova.wsgi     self.filename))
Sep 28 12:53:54 ctl02 nova-api[11536]: 2017-09-28 12:53:54.982 11536 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:53:54 ctl02 nova-api[11536]: 2017-09-28 12:53:54.982 11536 ERROR nova.wsgi
Sep 28 12:53:54 ctl02 nova-api[11536]: 2017-09-28 12:53:54.983 11536 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:53:55 ctl02 nova-api[11536]: 2017-09-28 12:53:55.109 11536 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:53:55 ctl02 nova-api[11536]: 2017-09-28 12:53:55.322 11536 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:53:55 ctl02 nova-api[11536]: 2017-09-28 12:53:55.324 11536 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:53:55 ctl02 nova-api[11536]: 2017-09-28 12:53:55.325 11536 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:53:55 ctl02 nova-api[11536]: 2017-09-28 12:53:55.325 11536 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:53:55 ctl02 nova-api[11536]: 2017-09-28 12:53:55.454 11536 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:53:55 ctl02 nova-api[11536]: 2017-09-28 12:53:55.456 11536 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:53:55 ctl02 nova-api[11536]: 2017-09-28 12:53:55.456 11536 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:53:55 ctl02 nova-api[11536]: 2017-09-28 12:53:55.456 11536 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:53:55 ctl02 nova-api[11536]: 2017-09-28 12:53:55.460 11536 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:53:55 ctl02 nova-api[11536]: 2017-09-28 12:53:55.460 11536 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:53:55 ctl02 nova-api[11536]: 2017-09-28 12:53:55.460 11536 ERROR nova Traceback (most recent call last):
Sep 28 12:53:55 ctl02 nova-api[11536]: 2017-09-28 12:53:55.460 11536 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:53:55 ctl02 nova-api[11536]: 2017-09-28 12:53:55.460 11536 ERROR nova     sys.exit(main())
Sep 28 12:53:55 ctl02 nova-api[11536]: 2017-09-28 12:53:55.460 11536 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:53:55 ctl02 nova-api[11536]: 2017-09-28 12:53:55.460 11536 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:53:55 ctl02 nova-api[11536]: 2017-09-28 12:53:55.460 11536 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:53:55 ctl02 nova-api[11536]: 2017-09-28 12:53:55.460 11536 ERROR nova     max_url_len=max_url_len)
Sep 28 12:53:55 ctl02 nova-api[11536]: 2017-09-28 12:53:55.460 11536 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:53:55 ctl02 nova-api[11536]: 2017-09-28 12:53:55.460 11536 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:53:55 ctl02 nova-api[11536]: 2017-09-28 12:53:55.460 11536 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:53:55 ctl02 nova-api[11536]: 2017-09-28 12:53:55.460 11536 ERROR nova     sock.listen(backlog)
Sep 28 12:53:55 ctl02 nova-api[11536]: 2017-09-28 12:53:55.460 11536 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:53:55 ctl02 nova-api[11536]: 2017-09-28 12:53:55.460 11536 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:53:55 ctl02 nova-api[11536]: 2017-09-28 12:53:55.460 11536 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:53:55 ctl02 nova-api[11536]: 2017-09-28 12:53:55.460 11536 ERROR nova
Sep 28 12:53:55 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9f6f5f31)
Sep 28 12:53:55 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:53:55 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:53:55 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:53:55 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:53:55 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:53:55 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:53:55 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:53:56 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:53:56.078 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:53:56] "OPTIONS / HTTP/1.0" 200 134 0.000491
Sep 28 12:53:56 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9f6f5f31)
Sep 28 12:53:57 ctl02 heat-api[13008]: 2017-09-28 12:53:57.129 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:53:57] "OPTIONS / HTTP/1.0" 200 134 0.000535
Sep 28 12:53:57 ctl02 heat-api-cfn[13300]: 2017-09-28 12:53:57.264 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:53:57] "OPTIONS / HTTP/1.0" 200 134 0.000583
Sep 28 12:53:57 ctl02 heat-api-cfn[13300]: 2017-09-28 12:53:57.388 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:53:57] "OPTIONS / HTTP/1.0" 200 134 0.000442
Sep 28 12:53:57 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9f6f5f31)
Sep 28 12:53:57 ctl02 nova-api[11554]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:53:57 ctl02 nova-api[11554]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:53:57 ctl02 nova-api[11554]: 2017-09-28 12:53:57.763 11554 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:53:57 ctl02 nova-api[11554]: 2017-09-28 12:53:57.764 11554 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:53:57 ctl02 nova-api[11554]: 2017-09-28 12:53:57.764 11554 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:53:57 ctl02 nova-api[11554]: 2017-09-28 12:53:57.764 11554 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:53:57 ctl02 nova-api[11554]: 2017-09-28 12:53:57.764 11554 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:53:57 ctl02 nova-api[11554]: 2017-09-28 12:53:57.764 11554 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:53:57 ctl02 nova-api[11554]: 2017-09-28 12:53:57.764 11554 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:53:57 ctl02 nova-api[11554]: 2017-09-28 12:53:57.764 11554 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:53:57 ctl02 nova-api[11554]: 2017-09-28 12:53:57.764 11554 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:53:57 ctl02 nova-api[11554]: 2017-09-28 12:53:57.764 11554 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:53:57 ctl02 nova-api[11554]: 2017-09-28 12:53:57.764 11554 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:53:57 ctl02 nova-api[11554]: 2017-09-28 12:53:57.764 11554 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:53:57 ctl02 nova-api[11554]: 2017-09-28 12:53:57.764 11554 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:53:57 ctl02 nova-api[11554]: 2017-09-28 12:53:57.764 11554 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:53:57 ctl02 nova-api[11554]: 2017-09-28 12:53:57.764 11554 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:53:57 ctl02 nova-api[11554]: 2017-09-28 12:53:57.764 11554 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:53:57 ctl02 nova-api[11554]: 2017-09-28 12:53:57.764 11554 ERROR nova.wsgi     self.filename))
Sep 28 12:53:57 ctl02 nova-api[11554]: 2017-09-28 12:53:57.764 11554 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:53:57 ctl02 nova-api[11554]: 2017-09-28 12:53:57.764 11554 ERROR nova.wsgi
Sep 28 12:53:57 ctl02 nova-api[11554]: 2017-09-28 12:53:57.775 11554 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:53:57 ctl02 nova-api[11554]: 2017-09-28 12:53:57.901 11554 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:53:57 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:53:57.998 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:53:57] "OPTIONS / HTTP/1.0" 200 134 0.000384
Sep 28 12:53:58 ctl02 nova-api[11554]: 2017-09-28 12:53:58.121 11554 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:53:58 ctl02 nova-api[11554]: 2017-09-28 12:53:58.123 11554 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:53:58 ctl02 nova-api[11554]: 2017-09-28 12:53:58.123 11554 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:53:58 ctl02 nova-api[11554]: 2017-09-28 12:53:58.124 11554 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:53:58 ctl02 nova-api[11554]: 2017-09-28 12:53:58.255 11554 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:53:58 ctl02 nova-api[11554]: 2017-09-28 12:53:58.257 11554 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:53:58 ctl02 nova-api[11554]: 2017-09-28 12:53:58.258 11554 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:53:58 ctl02 nova-api[11554]: 2017-09-28 12:53:58.258 11554 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:53:58 ctl02 nova-api[11554]: 2017-09-28 12:53:58.261 11554 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:53:58 ctl02 nova-api[11554]: 2017-09-28 12:53:58.262 11554 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:53:58 ctl02 nova-api[11554]: 2017-09-28 12:53:58.262 11554 ERROR nova Traceback (most recent call last):
Sep 28 12:53:58 ctl02 nova-api[11554]: 2017-09-28 12:53:58.262 11554 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:53:58 ctl02 nova-api[11554]: 2017-09-28 12:53:58.262 11554 ERROR nova     sys.exit(main())
Sep 28 12:53:58 ctl02 nova-api[11554]: 2017-09-28 12:53:58.262 11554 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:53:58 ctl02 nova-api[11554]: 2017-09-28 12:53:58.262 11554 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:53:58 ctl02 nova-api[11554]: 2017-09-28 12:53:58.262 11554 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:53:58 ctl02 nova-api[11554]: 2017-09-28 12:53:58.262 11554 ERROR nova     max_url_len=max_url_len)
Sep 28 12:53:58 ctl02 nova-api[11554]: 2017-09-28 12:53:58.262 11554 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:53:58 ctl02 nova-api[11554]: 2017-09-28 12:53:58.262 11554 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:53:58 ctl02 nova-api[11554]: 2017-09-28 12:53:58.262 11554 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:53:58 ctl02 nova-api[11554]: 2017-09-28 12:53:58.262 11554 ERROR nova     sock.listen(backlog)
Sep 28 12:53:58 ctl02 nova-api[11554]: 2017-09-28 12:53:58.262 11554 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:53:58 ctl02 nova-api[11554]: 2017-09-28 12:53:58.262 11554 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:53:58 ctl02 nova-api[11554]: 2017-09-28 12:53:58.262 11554 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:53:58 ctl02 nova-api[11554]: 2017-09-28 12:53:58.262 11554 ERROR nova
Sep 28 12:53:58 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:53:58 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:53:58 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:53:58 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9f6f5f31)
Sep 28 12:53:58 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:53:58 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:53:58 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:53:58 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:53:59 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:53:59.127 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:53:59] "OPTIONS / HTTP/1.0" 200 134 0.000504
Sep 28 12:53:59 ctl02 nova-conductor[5056]: 2017-09-28 12:53:59.157 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:53:59 ctl02 nova-conductor[5056]: 2017-09-28 12:53:59.159 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:53:59 ctl02 nova-conductor[5056]: 2017-09-28 12:53:59.171 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:53:59 ctl02 nova-conductor[5056]: 2017-09-28 12:53:59.173 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:53:59 ctl02 nova-cert[4860]: 2017-09-28 12:53:59.410 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:53:59 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9f6f5f31)
Sep 28 12:54:00 ctl02 neutron-server[30536]: 2017-09-28 12:54:00.163 30601 WARNING oslo_messaging._drivers.amqpdriver [req-e7fc6bdd-b07d-451b-8172-654565248dd3 - - - - -] reply_692b03e6d8d44d758b6be19b067c3aa3 doesn't exists, drop reply to ecf7e5d9fd0a42b998f78d92703efed4
Sep 28 12:54:00 ctl02 nova-api[11572]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:54:00 ctl02 nova-api[11572]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:54:00 ctl02 nova-api[11572]: 2017-09-28 12:54:00.503 11572 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:54:00 ctl02 nova-api[11572]: 2017-09-28 12:54:00.504 11572 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:54:00 ctl02 nova-api[11572]: 2017-09-28 12:54:00.504 11572 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:54:00 ctl02 nova-api[11572]: 2017-09-28 12:54:00.504 11572 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:54:00 ctl02 nova-api[11572]: 2017-09-28 12:54:00.504 11572 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:54:00 ctl02 nova-api[11572]: 2017-09-28 12:54:00.504 11572 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:54:00 ctl02 nova-api[11572]: 2017-09-28 12:54:00.504 11572 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:54:00 ctl02 nova-api[11572]: 2017-09-28 12:54:00.504 11572 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:54:00 ctl02 nova-api[11572]: 2017-09-28 12:54:00.504 11572 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:54:00 ctl02 nova-api[11572]: 2017-09-28 12:54:00.504 11572 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:54:00 ctl02 nova-api[11572]: 2017-09-28 12:54:00.504 11572 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:54:00 ctl02 nova-api[11572]: 2017-09-28 12:54:00.504 11572 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:54:00 ctl02 nova-api[11572]: 2017-09-28 12:54:00.504 11572 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:54:00 ctl02 nova-api[11572]: 2017-09-28 12:54:00.504 11572 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:54:00 ctl02 nova-api[11572]: 2017-09-28 12:54:00.504 11572 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:54:00 ctl02 nova-api[11572]: 2017-09-28 12:54:00.504 11572 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:54:00 ctl02 nova-api[11572]: 2017-09-28 12:54:00.504 11572 ERROR nova.wsgi     self.filename))
Sep 28 12:54:00 ctl02 nova-api[11572]: 2017-09-28 12:54:00.504 11572 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:54:00 ctl02 nova-api[11572]: 2017-09-28 12:54:00.504 11572 ERROR nova.wsgi
Sep 28 12:54:00 ctl02 nova-api[11572]: 2017-09-28 12:54:00.506 11572 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:54:00 ctl02 glance-api[29183]: 2017-09-28 12:54:00.510 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:54:00] "OPTIONS / HTTP/1.0" 200 134 0.000545
Sep 28 12:54:00 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9f6f5f31)
Sep 28 12:54:00 ctl02 nova-api[11572]: 2017-09-28 12:54:00.635 11572 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:54:00 ctl02 nova-api[11572]: 2017-09-28 12:54:00.856 11572 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:54:00 ctl02 nova-api[11572]: 2017-09-28 12:54:00.859 11572 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:54:00 ctl02 nova-api[11572]: 2017-09-28 12:54:00.859 11572 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:54:00 ctl02 nova-api[11572]: 2017-09-28 12:54:00.860 11572 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:54:00 ctl02 neutron-server[30536]: 2017-09-28 12:54:00.975 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:54:00] "OPTIONS / HTTP/1.0" 200 262 0.000475
Sep 28 12:54:00 ctl02 nova-api[11572]: 2017-09-28 12:54:00.992 11572 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:54:00 ctl02 nova-api[11572]: 2017-09-28 12:54:00.994 11572 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:54:00 ctl02 nova-api[11572]: 2017-09-28 12:54:00.995 11572 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:54:00 ctl02 nova-api[11572]: 2017-09-28 12:54:00.995 11572 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:54:00 ctl02 nova-api[11572]: 2017-09-28 12:54:00.998 11572 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:54:00 ctl02 nova-api[11572]: 2017-09-28 12:54:00.999 11572 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:54:00 ctl02 nova-api[11572]: 2017-09-28 12:54:00.999 11572 ERROR nova Traceback (most recent call last):
Sep 28 12:54:01 ctl02 nova-api[11572]: 2017-09-28 12:54:00.999 11572 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:54:01 ctl02 nova-api[11572]: 2017-09-28 12:54:00.999 11572 ERROR nova     sys.exit(main())
Sep 28 12:54:01 ctl02 nova-api[11572]: 2017-09-28 12:54:00.999 11572 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:54:01 ctl02 nova-api[11572]: 2017-09-28 12:54:00.999 11572 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:54:01 ctl02 nova-api[11572]: 2017-09-28 12:54:00.999 11572 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:54:01 ctl02 nova-api[11572]: 2017-09-28 12:54:00.999 11572 ERROR nova     max_url_len=max_url_len)
Sep 28 12:54:01 ctl02 nova-api[11572]: 2017-09-28 12:54:00.999 11572 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:54:01 ctl02 nova-api[11572]: 2017-09-28 12:54:00.999 11572 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:54:01 ctl02 nova-api[11572]: 2017-09-28 12:54:00.999 11572 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:54:01 ctl02 nova-api[11572]: 2017-09-28 12:54:00.999 11572 ERROR nova     sock.listen(backlog)
Sep 28 12:54:01 ctl02 nova-api[11572]: 2017-09-28 12:54:00.999 11572 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:54:01 ctl02 nova-api[11572]: 2017-09-28 12:54:00.999 11572 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:54:01 ctl02 nova-api[11572]: 2017-09-28 12:54:00.999 11572 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:54:01 ctl02 nova-api[11572]: 2017-09-28 12:54:00.999 11572 ERROR nova
Sep 28 12:54:01 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:54:01 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:54:01 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:54:01 ctl02 heat-api-cfn[13300]: 2017-09-28 12:54:01.308 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:54:01] "OPTIONS / HTTP/1.0" 200 134 0.000589
Sep 28 12:54:01 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:54:01 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:54:01 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:54:01 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:54:01 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9f6f5f31)
Sep 28 12:54:02 ctl02 glance-api[29183]: 2017-09-28 12:54:02.441 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:54:02] "OPTIONS / HTTP/1.0" 200 134 0.000567
Sep 28 12:54:02 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9f6f5f31)
Sep 28 12:54:02 ctl02 glance-api[29183]: 2017-09-28 12:54:02.797 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:54:02] "OPTIONS / HTTP/1.0" 200 134 0.000420
Sep 28 12:54:03 ctl02 nova-api[11590]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:54:03 ctl02 nova-api[11590]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:54:03 ctl02 neutron-server[30536]: 2017-09-28 12:54:03.156 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:54:03] "OPTIONS / HTTP/1.0" 200 262 0.000492
Sep 28 12:54:03 ctl02 nova-api[11590]: 2017-09-28 12:54:03.236 11590 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:54:03 ctl02 nova-api[11590]: 2017-09-28 12:54:03.237 11590 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:54:03 ctl02 nova-api[11590]: 2017-09-28 12:54:03.237 11590 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:54:03 ctl02 nova-api[11590]: 2017-09-28 12:54:03.237 11590 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:54:03 ctl02 nova-api[11590]: 2017-09-28 12:54:03.237 11590 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:54:03 ctl02 nova-api[11590]: 2017-09-28 12:54:03.237 11590 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:54:03 ctl02 nova-api[11590]: 2017-09-28 12:54:03.237 11590 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:54:03 ctl02 nova-api[11590]: 2017-09-28 12:54:03.237 11590 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:54:03 ctl02 nova-api[11590]: 2017-09-28 12:54:03.237 11590 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:54:03 ctl02 nova-api[11590]: 2017-09-28 12:54:03.237 11590 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:54:03 ctl02 nova-api[11590]: 2017-09-28 12:54:03.237 11590 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:54:03 ctl02 nova-api[11590]: 2017-09-28 12:54:03.237 11590 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:54:03 ctl02 nova-api[11590]: 2017-09-28 12:54:03.237 11590 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:54:03 ctl02 nova-api[11590]: 2017-09-28 12:54:03.237 11590 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:54:03 ctl02 nova-api[11590]: 2017-09-28 12:54:03.237 11590 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:54:03 ctl02 nova-api[11590]: 2017-09-28 12:54:03.237 11590 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:54:03 ctl02 nova-api[11590]: 2017-09-28 12:54:03.237 11590 ERROR nova.wsgi     self.filename))
Sep 28 12:54:03 ctl02 nova-api[11590]: 2017-09-28 12:54:03.237 11590 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:54:03 ctl02 nova-api[11590]: 2017-09-28 12:54:03.237 11590 ERROR nova.wsgi
Sep 28 12:54:03 ctl02 nova-api[11590]: 2017-09-28 12:54:03.238 11590 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:54:03 ctl02 nova-api[11590]: 2017-09-28 12:54:03.367 11590 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:54:03 ctl02 heat-api[13008]: 2017-09-28 12:54:03.471 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:54:03] "OPTIONS / HTTP/1.0" 200 134 0.000570
Sep 28 12:54:03 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9f6f5f31)
Sep 28 12:54:03 ctl02 nova-api[11590]: 2017-09-28 12:54:03.591 11590 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:54:03 ctl02 nova-api[11590]: 2017-09-28 12:54:03.593 11590 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:54:03 ctl02 nova-api[11590]: 2017-09-28 12:54:03.594 11590 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:54:03 ctl02 nova-api[11590]: 2017-09-28 12:54:03.594 11590 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:54:03 ctl02 nova-api[11590]: 2017-09-28 12:54:03.726 11590 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:54:03 ctl02 nova-api[11590]: 2017-09-28 12:54:03.727 11590 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:54:03 ctl02 nova-api[11590]: 2017-09-28 12:54:03.728 11590 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:54:03 ctl02 nova-api[11590]: 2017-09-28 12:54:03.728 11590 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:54:03 ctl02 nova-api[11590]: 2017-09-28 12:54:03.731 11590 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:54:03 ctl02 nova-api[11590]: 2017-09-28 12:54:03.731 11590 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:54:03 ctl02 nova-api[11590]: 2017-09-28 12:54:03.731 11590 ERROR nova Traceback (most recent call last):
Sep 28 12:54:03 ctl02 nova-api[11590]: 2017-09-28 12:54:03.731 11590 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:54:03 ctl02 nova-api[11590]: 2017-09-28 12:54:03.731 11590 ERROR nova     sys.exit(main())
Sep 28 12:54:03 ctl02 nova-api[11590]: 2017-09-28 12:54:03.731 11590 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:54:03 ctl02 nova-api[11590]: 2017-09-28 12:54:03.731 11590 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:54:03 ctl02 nova-api[11590]: 2017-09-28 12:54:03.731 11590 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:54:03 ctl02 nova-api[11590]: 2017-09-28 12:54:03.731 11590 ERROR nova     max_url_len=max_url_len)
Sep 28 12:54:03 ctl02 nova-api[11590]: 2017-09-28 12:54:03.731 11590 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:54:03 ctl02 nova-api[11590]: 2017-09-28 12:54:03.731 11590 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:54:03 ctl02 nova-api[11590]: 2017-09-28 12:54:03.731 11590 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:54:03 ctl02 nova-api[11590]: 2017-09-28 12:54:03.731 11590 ERROR nova     sock.listen(backlog)
Sep 28 12:54:03 ctl02 nova-api[11590]: 2017-09-28 12:54:03.731 11590 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:54:03 ctl02 nova-api[11590]: 2017-09-28 12:54:03.731 11590 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:54:03 ctl02 nova-api[11590]: 2017-09-28 12:54:03.731 11590 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:54:03 ctl02 nova-api[11590]: 2017-09-28 12:54:03.731 11590 ERROR nova
Sep 28 12:54:03 ctl02 heat-api[13008]: 2017-09-28 12:54:03.845 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:54:03] "OPTIONS / HTTP/1.0" 200 134 0.000573
Sep 28 12:54:03 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:54:03 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:54:03 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:54:04 ctl02 neutron-server[30536]: 2017-09-28 12:54:04.074 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:54:04] "OPTIONS / HTTP/1.0" 200 262 0.000613
Sep 28 12:54:04 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:54:04 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:54:04 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:54:04 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:54:04 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:54:04 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:54:05 ctl02 nova-api[11608]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:54:05 ctl02 nova-api[11608]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:54:05 ctl02 nova-api[11608]: 2017-09-28 12:54:05.977 11608 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:54:05 ctl02 nova-api[11608]: 2017-09-28 12:54:05.979 11608 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:54:05 ctl02 nova-api[11608]: 2017-09-28 12:54:05.979 11608 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:54:05 ctl02 nova-api[11608]: 2017-09-28 12:54:05.979 11608 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:54:05 ctl02 nova-api[11608]: 2017-09-28 12:54:05.979 11608 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:54:05 ctl02 nova-api[11608]: 2017-09-28 12:54:05.979 11608 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:54:05 ctl02 nova-api[11608]: 2017-09-28 12:54:05.979 11608 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:54:05 ctl02 nova-api[11608]: 2017-09-28 12:54:05.979 11608 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:54:05 ctl02 nova-api[11608]: 2017-09-28 12:54:05.979 11608 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:54:05 ctl02 nova-api[11608]: 2017-09-28 12:54:05.979 11608 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:54:05 ctl02 nova-api[11608]: 2017-09-28 12:54:05.979 11608 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:54:05 ctl02 nova-api[11608]: 2017-09-28 12:54:05.979 11608 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:54:05 ctl02 nova-api[11608]: 2017-09-28 12:54:05.979 11608 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:54:05 ctl02 nova-api[11608]: 2017-09-28 12:54:05.979 11608 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:54:05 ctl02 nova-api[11608]: 2017-09-28 12:54:05.979 11608 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:54:05 ctl02 nova-api[11608]: 2017-09-28 12:54:05.979 11608 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:54:05 ctl02 nova-api[11608]: 2017-09-28 12:54:05.979 11608 ERROR nova.wsgi     self.filename))
Sep 28 12:54:05 ctl02 nova-api[11608]: 2017-09-28 12:54:05.979 11608 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:54:05 ctl02 nova-api[11608]: 2017-09-28 12:54:05.979 11608 ERROR nova.wsgi
Sep 28 12:54:05 ctl02 nova-api[11608]: 2017-09-28 12:54:05.981 11608 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:54:06 ctl02 nova-api[11608]: 2017-09-28 12:54:06.108 11608 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:54:06 ctl02 neutron-server[30536]: 2017-09-28 12:54:06.137 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 2 dead agents out of 6:
Sep 28 12:54:06 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:54:06 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:53:06 cmp002
Sep 28 12:54:06 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:52:26 cmp002
Sep 28 12:54:06 ctl02 nova-api[11608]: 2017-09-28 12:54:06.337 11608 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:54:06 ctl02 nova-api[11608]: 2017-09-28 12:54:06.340 11608 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:54:06 ctl02 nova-api[11608]: 2017-09-28 12:54:06.340 11608 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:54:06 ctl02 nova-api[11608]: 2017-09-28 12:54:06.340 11608 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:54:06 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:54:06.447 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:54:06] "OPTIONS / HTTP/1.0" 200 134 0.000476
Sep 28 12:54:06 ctl02 nova-api[11608]: 2017-09-28 12:54:06.470 11608 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:54:06 ctl02 nova-api[11608]: 2017-09-28 12:54:06.472 11608 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:54:06 ctl02 nova-api[11608]: 2017-09-28 12:54:06.473 11608 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:54:06 ctl02 nova-api[11608]: 2017-09-28 12:54:06.473 11608 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:54:06 ctl02 nova-api[11608]: 2017-09-28 12:54:06.476 11608 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:54:06 ctl02 nova-api[11608]: 2017-09-28 12:54:06.477 11608 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:54:06 ctl02 nova-api[11608]: 2017-09-28 12:54:06.477 11608 ERROR nova Traceback (most recent call last):
Sep 28 12:54:06 ctl02 nova-api[11608]: 2017-09-28 12:54:06.477 11608 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:54:06 ctl02 nova-api[11608]: 2017-09-28 12:54:06.477 11608 ERROR nova     sys.exit(main())
Sep 28 12:54:06 ctl02 nova-api[11608]: 2017-09-28 12:54:06.477 11608 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:54:06 ctl02 nova-api[11608]: 2017-09-28 12:54:06.477 11608 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:54:06 ctl02 nova-api[11608]: 2017-09-28 12:54:06.477 11608 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:54:06 ctl02 nova-api[11608]: 2017-09-28 12:54:06.477 11608 ERROR nova     max_url_len=max_url_len)
Sep 28 12:54:06 ctl02 nova-api[11608]: 2017-09-28 12:54:06.477 11608 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:54:06 ctl02 nova-api[11608]: 2017-09-28 12:54:06.477 11608 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:54:06 ctl02 nova-api[11608]: 2017-09-28 12:54:06.477 11608 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:54:06 ctl02 nova-api[11608]: 2017-09-28 12:54:06.477 11608 ERROR nova     sock.listen(backlog)
Sep 28 12:54:06 ctl02 nova-api[11608]: 2017-09-28 12:54:06.477 11608 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:54:06 ctl02 nova-api[11608]: 2017-09-28 12:54:06.477 11608 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:54:06 ctl02 nova-api[11608]: 2017-09-28 12:54:06.477 11608 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:54:06 ctl02 nova-api[11608]: 2017-09-28 12:54:06.477 11608 ERROR nova
Sep 28 12:54:06 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:54:06 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:54:06 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:54:06 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:54:06 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:54:06 ctl02 heat-api-cfn[13300]: 2017-09-28 12:54:06.892 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:54:06] "OPTIONS / HTTP/1.0" 200 134 0.000662
Sep 28 12:54:06 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:54:06 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:54:07 ctl02 heat-api[13008]: 2017-09-28 12:54:07.093 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:54:07] "OPTIONS / HTTP/1.0" 200 134 0.000680
Sep 28 12:54:07 ctl02 heat-api-cfn[13300]: 2017-09-28 12:54:07.191 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:54:07] "OPTIONS / HTTP/1.0" 200 134 0.000479
Sep 28 12:54:08 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:54:08.231 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:54:08] "OPTIONS / HTTP/1.0" 200 134 0.000474
Sep 28 12:54:08 ctl02 nova-api[11631]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:54:08 ctl02 nova-api[11631]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:54:08 ctl02 nova-api[11631]: 2017-09-28 12:54:08.786 11631 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:54:08 ctl02 nova-api[11631]: 2017-09-28 12:54:08.787 11631 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:54:08 ctl02 nova-api[11631]: 2017-09-28 12:54:08.787 11631 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:54:08 ctl02 nova-api[11631]: 2017-09-28 12:54:08.787 11631 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:54:08 ctl02 nova-api[11631]: 2017-09-28 12:54:08.787 11631 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:54:08 ctl02 nova-api[11631]: 2017-09-28 12:54:08.787 11631 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:54:08 ctl02 nova-api[11631]: 2017-09-28 12:54:08.787 11631 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:54:08 ctl02 nova-api[11631]: 2017-09-28 12:54:08.787 11631 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:54:08 ctl02 nova-api[11631]: 2017-09-28 12:54:08.787 11631 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:54:08 ctl02 nova-api[11631]: 2017-09-28 12:54:08.787 11631 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:54:08 ctl02 nova-api[11631]: 2017-09-28 12:54:08.787 11631 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:54:08 ctl02 nova-api[11631]: 2017-09-28 12:54:08.787 11631 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:54:08 ctl02 nova-api[11631]: 2017-09-28 12:54:08.787 11631 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:54:08 ctl02 nova-api[11631]: 2017-09-28 12:54:08.787 11631 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:54:08 ctl02 nova-api[11631]: 2017-09-28 12:54:08.787 11631 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:54:08 ctl02 nova-api[11631]: 2017-09-28 12:54:08.787 11631 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:54:08 ctl02 nova-api[11631]: 2017-09-28 12:54:08.787 11631 ERROR nova.wsgi     self.filename))
Sep 28 12:54:08 ctl02 nova-api[11631]: 2017-09-28 12:54:08.787 11631 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:54:08 ctl02 nova-api[11631]: 2017-09-28 12:54:08.787 11631 ERROR nova.wsgi
Sep 28 12:54:08 ctl02 nova-api[11631]: 2017-09-28 12:54:08.788 11631 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:54:08 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:54:08.815 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:54:08] "OPTIONS / HTTP/1.0" 200 134 0.000554
Sep 28 12:54:08 ctl02 nova-api[11631]: 2017-09-28 12:54:08.923 11631 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:54:09 ctl02 nova-api[11631]: 2017-09-28 12:54:09.172 11631 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:54:09 ctl02 nova-api[11631]: 2017-09-28 12:54:09.175 11631 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:54:09 ctl02 nova-api[11631]: 2017-09-28 12:54:09.175 11631 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:54:09 ctl02 nova-api[11631]: 2017-09-28 12:54:09.175 11631 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:54:09 ctl02 nova-consoleauth[5433]: 2017-09-28 12:54:09.246 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:54:09 ctl02 nova-api[11631]: 2017-09-28 12:54:09.312 11631 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:54:09 ctl02 nova-api[11631]: 2017-09-28 12:54:09.314 11631 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:54:09 ctl02 nova-api[11631]: 2017-09-28 12:54:09.315 11631 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:54:09 ctl02 nova-api[11631]: 2017-09-28 12:54:09.315 11631 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:54:09 ctl02 nova-api[11631]: 2017-09-28 12:54:09.318 11631 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:54:09 ctl02 nova-api[11631]: 2017-09-28 12:54:09.319 11631 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:54:09 ctl02 nova-api[11631]: 2017-09-28 12:54:09.319 11631 ERROR nova Traceback (most recent call last):
Sep 28 12:54:09 ctl02 nova-api[11631]: 2017-09-28 12:54:09.319 11631 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:54:09 ctl02 nova-api[11631]: 2017-09-28 12:54:09.319 11631 ERROR nova     sys.exit(main())
Sep 28 12:54:09 ctl02 nova-api[11631]: 2017-09-28 12:54:09.319 11631 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:54:09 ctl02 nova-api[11631]: 2017-09-28 12:54:09.319 11631 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:54:09 ctl02 nova-api[11631]: 2017-09-28 12:54:09.319 11631 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:54:09 ctl02 nova-api[11631]: 2017-09-28 12:54:09.319 11631 ERROR nova     max_url_len=max_url_len)
Sep 28 12:54:09 ctl02 nova-api[11631]: 2017-09-28 12:54:09.319 11631 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:54:09 ctl02 nova-api[11631]: 2017-09-28 12:54:09.319 11631 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:54:09 ctl02 nova-api[11631]: 2017-09-28 12:54:09.319 11631 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:54:09 ctl02 nova-api[11631]: 2017-09-28 12:54:09.319 11631 ERROR nova     sock.listen(backlog)
Sep 28 12:54:09 ctl02 nova-api[11631]: 2017-09-28 12:54:09.319 11631 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:54:09 ctl02 nova-api[11631]: 2017-09-28 12:54:09.319 11631 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:54:09 ctl02 nova-api[11631]: 2017-09-28 12:54:09.319 11631 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:54:09 ctl02 nova-api[11631]: 2017-09-28 12:54:09.319 11631 ERROR nova
Sep 28 12:54:09 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:54:09 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:54:09 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:54:09 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:54:09 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:54:09 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:54:09 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:54:10 ctl02 glance-api[29183]: 2017-09-28 12:54:10.233 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:54:10] "OPTIONS / HTTP/1.0" 200 134 0.000689
Sep 28 12:54:10 ctl02 heat-engine[12803]: 2017-09-28 12:54:10.280 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:54:10 ctl02 heat-engine[12803]: 2017-09-28 12:54:10.289 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:54:10 ctl02 heat-engine[12803]: 2017-09-28 12:54:10.290 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:54:10 ctl02 heat-engine[12803]: 2017-09-28 12:54:10.293 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:54:11 ctl02 neutron-server[30536]: 2017-09-28 12:54:11.018 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:54:11] "OPTIONS / HTTP/1.0" 200 262 0.000543
Sep 28 12:54:11 ctl02 heat-api-cfn[13300]: 2017-09-28 12:54:11.227 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:54:11] "OPTIONS / HTTP/1.0" 200 134 0.000548
Sep 28 12:54:11 ctl02 nova-api[11649]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:54:11 ctl02 nova-api[11649]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:54:11 ctl02 nova-api[11649]: 2017-09-28 12:54:11.528 11649 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:54:11 ctl02 nova-api[11649]: 2017-09-28 12:54:11.530 11649 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:54:11 ctl02 nova-api[11649]: 2017-09-28 12:54:11.530 11649 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:54:11 ctl02 nova-api[11649]: 2017-09-28 12:54:11.530 11649 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:54:11 ctl02 nova-api[11649]: 2017-09-28 12:54:11.530 11649 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:54:11 ctl02 nova-api[11649]: 2017-09-28 12:54:11.530 11649 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:54:11 ctl02 nova-api[11649]: 2017-09-28 12:54:11.530 11649 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:54:11 ctl02 nova-api[11649]: 2017-09-28 12:54:11.530 11649 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:54:11 ctl02 nova-api[11649]: 2017-09-28 12:54:11.530 11649 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:54:11 ctl02 nova-api[11649]: 2017-09-28 12:54:11.530 11649 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:54:11 ctl02 nova-api[11649]: 2017-09-28 12:54:11.530 11649 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:54:11 ctl02 nova-api[11649]: 2017-09-28 12:54:11.530 11649 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:54:11 ctl02 nova-api[11649]: 2017-09-28 12:54:11.530 11649 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:54:11 ctl02 nova-api[11649]: 2017-09-28 12:54:11.530 11649 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:54:11 ctl02 nova-api[11649]: 2017-09-28 12:54:11.530 11649 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:54:11 ctl02 nova-api[11649]: 2017-09-28 12:54:11.530 11649 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:54:11 ctl02 nova-api[11649]: 2017-09-28 12:54:11.530 11649 ERROR nova.wsgi     self.filename))
Sep 28 12:54:11 ctl02 nova-api[11649]: 2017-09-28 12:54:11.530 11649 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:54:11 ctl02 nova-api[11649]: 2017-09-28 12:54:11.530 11649 ERROR nova.wsgi
Sep 28 12:54:11 ctl02 nova-api[11649]: 2017-09-28 12:54:11.532 11649 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:54:11 ctl02 nova-api[11649]: 2017-09-28 12:54:11.664 11649 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:54:11 ctl02 nova-api[11649]: 2017-09-28 12:54:11.910 11649 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:54:11 ctl02 nova-api[11649]: 2017-09-28 12:54:11.913 11649 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:54:11 ctl02 nova-api[11649]: 2017-09-28 12:54:11.913 11649 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:54:11 ctl02 nova-api[11649]: 2017-09-28 12:54:11.913 11649 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:54:12 ctl02 nova-api[11649]: 2017-09-28 12:54:12.048 11649 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:54:12 ctl02 nova-api[11649]: 2017-09-28 12:54:12.050 11649 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:54:12 ctl02 nova-api[11649]: 2017-09-28 12:54:12.051 11649 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:54:12 ctl02 nova-api[11649]: 2017-09-28 12:54:12.051 11649 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:54:12 ctl02 nova-api[11649]: 2017-09-28 12:54:12.055 11649 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:54:12 ctl02 nova-api[11649]: 2017-09-28 12:54:12.055 11649 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:54:12 ctl02 nova-api[11649]: 2017-09-28 12:54:12.055 11649 ERROR nova Traceback (most recent call last):
Sep 28 12:54:12 ctl02 nova-api[11649]: 2017-09-28 12:54:12.055 11649 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:54:12 ctl02 nova-api[11649]: 2017-09-28 12:54:12.055 11649 ERROR nova     sys.exit(main())
Sep 28 12:54:12 ctl02 nova-api[11649]: 2017-09-28 12:54:12.055 11649 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:54:12 ctl02 nova-api[11649]: 2017-09-28 12:54:12.055 11649 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:54:12 ctl02 nova-api[11649]: 2017-09-28 12:54:12.055 11649 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:54:12 ctl02 nova-api[11649]: 2017-09-28 12:54:12.055 11649 ERROR nova     max_url_len=max_url_len)
Sep 28 12:54:12 ctl02 nova-api[11649]: 2017-09-28 12:54:12.055 11649 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:54:12 ctl02 nova-api[11649]: 2017-09-28 12:54:12.055 11649 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:54:12 ctl02 nova-api[11649]: 2017-09-28 12:54:12.055 11649 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:54:12 ctl02 nova-api[11649]: 2017-09-28 12:54:12.055 11649 ERROR nova     sock.listen(backlog)
Sep 28 12:54:12 ctl02 nova-api[11649]: 2017-09-28 12:54:12.055 11649 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:54:12 ctl02 nova-api[11649]: 2017-09-28 12:54:12.055 11649 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:54:12 ctl02 nova-api[11649]: 2017-09-28 12:54:12.055 11649 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:54:12 ctl02 nova-api[11649]: 2017-09-28 12:54:12.055 11649 ERROR nova
Sep 28 12:54:12 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:54:12 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:54:12 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:54:12 ctl02 nova-scheduler[5620]: 2017-09-28 12:54:12.345 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:54:12 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:54:12 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:54:12 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:54:12 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:54:12 ctl02 glance-api[29183]: 2017-09-28 12:54:12.703 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:54:12] "OPTIONS / HTTP/1.0" 200 134 0.001156
Sep 28 12:54:12 ctl02 glance-api[29183]: 2017-09-28 12:54:12.958 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:54:12] "OPTIONS / HTTP/1.0" 200 134 0.000560
Sep 28 12:54:13 ctl02 neutron-server[30536]: 2017-09-28 12:54:13.262 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:54:13] "OPTIONS / HTTP/1.0" 200 262 0.000513
Sep 28 12:54:13 ctl02 heat-api[13008]: 2017-09-28 12:54:13.468 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:54:13] "OPTIONS / HTTP/1.0" 200 134 0.000616
Sep 28 12:54:13 ctl02 neutron-server[30536]: 2017-09-28 12:54:13.536 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:54:14 ctl02 nova-api[11667]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:54:14 ctl02 nova-api[11667]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:54:14 ctl02 heat-api[13008]: 2017-09-28 12:54:14.166 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:54:14] "OPTIONS / HTTP/1.0" 200 134 0.000595
Sep 28 12:54:14 ctl02 nova-api[11667]: 2017-09-28 12:54:14.298 11667 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:54:14 ctl02 nova-api[11667]: 2017-09-28 12:54:14.300 11667 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:54:14 ctl02 nova-api[11667]: 2017-09-28 12:54:14.300 11667 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:54:14 ctl02 nova-api[11667]: 2017-09-28 12:54:14.300 11667 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:54:14 ctl02 nova-api[11667]: 2017-09-28 12:54:14.300 11667 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:54:14 ctl02 nova-api[11667]: 2017-09-28 12:54:14.300 11667 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:54:14 ctl02 nova-api[11667]: 2017-09-28 12:54:14.300 11667 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:54:14 ctl02 nova-api[11667]: 2017-09-28 12:54:14.300 11667 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:54:14 ctl02 nova-api[11667]: 2017-09-28 12:54:14.300 11667 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:54:14 ctl02 nova-api[11667]: 2017-09-28 12:54:14.300 11667 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:54:14 ctl02 nova-api[11667]: 2017-09-28 12:54:14.300 11667 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:54:14 ctl02 nova-api[11667]: 2017-09-28 12:54:14.300 11667 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:54:14 ctl02 nova-api[11667]: 2017-09-28 12:54:14.300 11667 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:54:14 ctl02 nova-api[11667]: 2017-09-28 12:54:14.300 11667 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:54:14 ctl02 nova-api[11667]: 2017-09-28 12:54:14.300 11667 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:54:14 ctl02 nova-api[11667]: 2017-09-28 12:54:14.300 11667 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:54:14 ctl02 nova-api[11667]: 2017-09-28 12:54:14.300 11667 ERROR nova.wsgi     self.filename))
Sep 28 12:54:14 ctl02 nova-api[11667]: 2017-09-28 12:54:14.300 11667 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:54:14 ctl02 nova-api[11667]: 2017-09-28 12:54:14.300 11667 ERROR nova.wsgi
Sep 28 12:54:14 ctl02 nova-api[11667]: 2017-09-28 12:54:14.303 11667 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:54:14 ctl02 nova-api[11667]: 2017-09-28 12:54:14.433 11667 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:54:14 ctl02 neutron-server[30536]: 2017-09-28 12:54:14.470 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:54:14] "OPTIONS / HTTP/1.0" 200 262 0.000478
Sep 28 12:54:14 ctl02 nova-api[11667]: 2017-09-28 12:54:14.657 11667 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:54:14 ctl02 nova-api[11667]: 2017-09-28 12:54:14.660 11667 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:54:14 ctl02 nova-api[11667]: 2017-09-28 12:54:14.660 11667 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:54:14 ctl02 nova-api[11667]: 2017-09-28 12:54:14.661 11667 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:54:14 ctl02 nova-api[11667]: 2017-09-28 12:54:14.792 11667 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:54:14 ctl02 nova-api[11667]: 2017-09-28 12:54:14.795 11667 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:54:14 ctl02 nova-api[11667]: 2017-09-28 12:54:14.795 11667 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:54:14 ctl02 nova-api[11667]: 2017-09-28 12:54:14.795 11667 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:54:14 ctl02 nova-api[11667]: 2017-09-28 12:54:14.799 11667 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:54:14 ctl02 nova-api[11667]: 2017-09-28 12:54:14.799 11667 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:54:14 ctl02 nova-api[11667]: 2017-09-28 12:54:14.799 11667 ERROR nova Traceback (most recent call last):
Sep 28 12:54:14 ctl02 nova-api[11667]: 2017-09-28 12:54:14.799 11667 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:54:14 ctl02 nova-api[11667]: 2017-09-28 12:54:14.799 11667 ERROR nova     sys.exit(main())
Sep 28 12:54:14 ctl02 nova-api[11667]: 2017-09-28 12:54:14.799 11667 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:54:14 ctl02 nova-api[11667]: 2017-09-28 12:54:14.799 11667 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:54:14 ctl02 nova-api[11667]: 2017-09-28 12:54:14.799 11667 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:54:14 ctl02 nova-api[11667]: 2017-09-28 12:54:14.799 11667 ERROR nova     max_url_len=max_url_len)
Sep 28 12:54:14 ctl02 nova-api[11667]: 2017-09-28 12:54:14.799 11667 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:54:14 ctl02 nova-api[11667]: 2017-09-28 12:54:14.799 11667 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:54:14 ctl02 nova-api[11667]: 2017-09-28 12:54:14.799 11667 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:54:14 ctl02 nova-api[11667]: 2017-09-28 12:54:14.799 11667 ERROR nova     sock.listen(backlog)
Sep 28 12:54:14 ctl02 nova-api[11667]: 2017-09-28 12:54:14.799 11667 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:54:14 ctl02 nova-api[11667]: 2017-09-28 12:54:14.799 11667 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:54:14 ctl02 nova-api[11667]: 2017-09-28 12:54:14.799 11667 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:54:14 ctl02 nova-api[11667]: 2017-09-28 12:54:14.799 11667 ERROR nova
Sep 28 12:54:14 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:54:14 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:54:14 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:54:15 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:54:15 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:54:15 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:54:15 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:54:16 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:54:16.550 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:54:16] "OPTIONS / HTTP/1.0" 200 134 0.000523
Sep 28 12:54:16 ctl02 nova-api[11686]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:54:16 ctl02 nova-api[11686]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:54:16 ctl02 heat-api-cfn[13300]: 2017-09-28 12:54:16.897 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:54:16] "OPTIONS / HTTP/1.0" 200 134 0.000566
Sep 28 12:54:16 ctl02 heat-api[13008]: 2017-09-28 12:54:16.928 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:54:16] "OPTIONS / HTTP/1.0" 200 134 0.000621
Sep 28 12:54:17 ctl02 nova-api[11686]: 2017-09-28 12:54:17.011 11686 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:54:17 ctl02 nova-api[11686]: 2017-09-28 12:54:17.013 11686 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:54:17 ctl02 nova-api[11686]: 2017-09-28 12:54:17.013 11686 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:54:17 ctl02 nova-api[11686]: 2017-09-28 12:54:17.013 11686 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:54:17 ctl02 nova-api[11686]: 2017-09-28 12:54:17.013 11686 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:54:17 ctl02 nova-api[11686]: 2017-09-28 12:54:17.013 11686 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:54:17 ctl02 nova-api[11686]: 2017-09-28 12:54:17.013 11686 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:54:17 ctl02 nova-api[11686]: 2017-09-28 12:54:17.013 11686 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:54:17 ctl02 nova-api[11686]: 2017-09-28 12:54:17.013 11686 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:54:17 ctl02 nova-api[11686]: 2017-09-28 12:54:17.013 11686 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:54:17 ctl02 nova-api[11686]: 2017-09-28 12:54:17.013 11686 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:54:17 ctl02 nova-api[11686]: 2017-09-28 12:54:17.013 11686 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:54:17 ctl02 nova-api[11686]: 2017-09-28 12:54:17.013 11686 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:54:17 ctl02 nova-api[11686]: 2017-09-28 12:54:17.013 11686 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:54:17 ctl02 nova-api[11686]: 2017-09-28 12:54:17.013 11686 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:54:17 ctl02 nova-api[11686]: 2017-09-28 12:54:17.013 11686 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:54:17 ctl02 nova-api[11686]: 2017-09-28 12:54:17.013 11686 ERROR nova.wsgi     self.filename))
Sep 28 12:54:17 ctl02 nova-api[11686]: 2017-09-28 12:54:17.013 11686 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:54:17 ctl02 nova-api[11686]: 2017-09-28 12:54:17.013 11686 ERROR nova.wsgi
Sep 28 12:54:17 ctl02 nova-api[11686]: 2017-09-28 12:54:17.014 11686 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:54:17 ctl02 nova-api[11686]: 2017-09-28 12:54:17.143 11686 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:54:17 ctl02 heat-api-cfn[13300]: 2017-09-28 12:54:17.151 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:54:17] "OPTIONS / HTTP/1.0" 200 134 0.000441
Sep 28 12:54:17 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xab66304a)
Sep 28 12:54:17 ctl02 nova-api[11686]: 2017-09-28 12:54:17.372 11686 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:54:17 ctl02 nova-api[11686]: 2017-09-28 12:54:17.375 11686 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:54:17 ctl02 nova-api[11686]: 2017-09-28 12:54:17.375 11686 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:54:17 ctl02 nova-api[11686]: 2017-09-28 12:54:17.375 11686 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:54:17 ctl02 nova-api[11686]: 2017-09-28 12:54:17.510 11686 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:54:17 ctl02 nova-api[11686]: 2017-09-28 12:54:17.512 11686 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:54:17 ctl02 nova-api[11686]: 2017-09-28 12:54:17.512 11686 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:54:17 ctl02 nova-api[11686]: 2017-09-28 12:54:17.513 11686 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:54:17 ctl02 nova-api[11686]: 2017-09-28 12:54:17.516 11686 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:54:17 ctl02 nova-api[11686]: 2017-09-28 12:54:17.516 11686 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:54:17 ctl02 nova-api[11686]: 2017-09-28 12:54:17.516 11686 ERROR nova Traceback (most recent call last):
Sep 28 12:54:17 ctl02 nova-api[11686]: 2017-09-28 12:54:17.516 11686 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:54:17 ctl02 nova-api[11686]: 2017-09-28 12:54:17.516 11686 ERROR nova     sys.exit(main())
Sep 28 12:54:17 ctl02 nova-api[11686]: 2017-09-28 12:54:17.516 11686 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:54:17 ctl02 nova-api[11686]: 2017-09-28 12:54:17.516 11686 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:54:17 ctl02 nova-api[11686]: 2017-09-28 12:54:17.516 11686 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:54:17 ctl02 nova-api[11686]: 2017-09-28 12:54:17.516 11686 ERROR nova     max_url_len=max_url_len)
Sep 28 12:54:17 ctl02 nova-api[11686]: 2017-09-28 12:54:17.516 11686 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:54:17 ctl02 nova-api[11686]: 2017-09-28 12:54:17.516 11686 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:54:17 ctl02 nova-api[11686]: 2017-09-28 12:54:17.516 11686 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:54:17 ctl02 nova-api[11686]: 2017-09-28 12:54:17.516 11686 ERROR nova     sock.listen(backlog)
Sep 28 12:54:17 ctl02 nova-api[11686]: 2017-09-28 12:54:17.516 11686 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:54:17 ctl02 nova-api[11686]: 2017-09-28 12:54:17.516 11686 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:54:17 ctl02 nova-api[11686]: 2017-09-28 12:54:17.516 11686 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:54:17 ctl02 nova-api[11686]: 2017-09-28 12:54:17.516 11686 ERROR nova
Sep 28 12:54:17 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:54:17 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:54:17 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:54:17 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:54:17 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:54:17 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:54:17 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:54:18 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xab66304a)
Sep 28 12:54:18 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:54:18.478 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:54:18] "OPTIONS / HTTP/1.0" 200 134 0.000601
Sep 28 12:54:19 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xab66304a)
Sep 28 12:54:19 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:54:19.208 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:54:19] "OPTIONS / HTTP/1.0" 200 134 0.000573
Sep 28 12:54:19 ctl02 nova-api[11703]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:54:19 ctl02 nova-api[11703]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:54:19 ctl02 nova-api[11703]: 2017-09-28 12:54:19.736 11703 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:54:19 ctl02 nova-api[11703]: 2017-09-28 12:54:19.737 11703 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:54:19 ctl02 nova-api[11703]: 2017-09-28 12:54:19.737 11703 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:54:19 ctl02 nova-api[11703]: 2017-09-28 12:54:19.737 11703 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:54:19 ctl02 nova-api[11703]: 2017-09-28 12:54:19.737 11703 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:54:19 ctl02 nova-api[11703]: 2017-09-28 12:54:19.737 11703 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:54:19 ctl02 nova-api[11703]: 2017-09-28 12:54:19.737 11703 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:54:19 ctl02 nova-api[11703]: 2017-09-28 12:54:19.737 11703 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:54:19 ctl02 nova-api[11703]: 2017-09-28 12:54:19.737 11703 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:54:19 ctl02 nova-api[11703]: 2017-09-28 12:54:19.737 11703 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:54:19 ctl02 nova-api[11703]: 2017-09-28 12:54:19.737 11703 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:54:19 ctl02 nova-api[11703]: 2017-09-28 12:54:19.737 11703 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:54:19 ctl02 nova-api[11703]: 2017-09-28 12:54:19.737 11703 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:54:19 ctl02 nova-api[11703]: 2017-09-28 12:54:19.737 11703 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:54:19 ctl02 nova-api[11703]: 2017-09-28 12:54:19.737 11703 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:54:19 ctl02 nova-api[11703]: 2017-09-28 12:54:19.737 11703 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:54:19 ctl02 nova-api[11703]: 2017-09-28 12:54:19.737 11703 ERROR nova.wsgi     self.filename))
Sep 28 12:54:19 ctl02 nova-api[11703]: 2017-09-28 12:54:19.737 11703 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:54:19 ctl02 nova-api[11703]: 2017-09-28 12:54:19.737 11703 ERROR nova.wsgi
Sep 28 12:54:19 ctl02 nova-api[11703]: 2017-09-28 12:54:19.738 11703 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:54:19 ctl02 nova-api[11703]: 2017-09-28 12:54:19.866 11703 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:54:20 ctl02 nova-api[11703]: 2017-09-28 12:54:20.091 11703 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:54:20 ctl02 nova-api[11703]: 2017-09-28 12:54:20.093 11703 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:54:20 ctl02 nova-api[11703]: 2017-09-28 12:54:20.093 11703 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:54:20 ctl02 nova-api[11703]: 2017-09-28 12:54:20.094 11703 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:54:20 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xab66304a)
Sep 28 12:54:20 ctl02 nova-api[11703]: 2017-09-28 12:54:20.224 11703 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:54:20 ctl02 nova-api[11703]: 2017-09-28 12:54:20.226 11703 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:54:20 ctl02 nova-api[11703]: 2017-09-28 12:54:20.226 11703 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:54:20 ctl02 nova-api[11703]: 2017-09-28 12:54:20.226 11703 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:54:20 ctl02 nova-api[11703]: 2017-09-28 12:54:20.229 11703 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:54:20 ctl02 nova-api[11703]: 2017-09-28 12:54:20.230 11703 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:54:20 ctl02 nova-api[11703]: 2017-09-28 12:54:20.230 11703 ERROR nova Traceback (most recent call last):
Sep 28 12:54:20 ctl02 nova-api[11703]: 2017-09-28 12:54:20.230 11703 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:54:20 ctl02 nova-api[11703]: 2017-09-28 12:54:20.230 11703 ERROR nova     sys.exit(main())
Sep 28 12:54:20 ctl02 nova-api[11703]: 2017-09-28 12:54:20.230 11703 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:54:20 ctl02 nova-api[11703]: 2017-09-28 12:54:20.230 11703 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:54:20 ctl02 nova-api[11703]: 2017-09-28 12:54:20.230 11703 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:54:20 ctl02 nova-api[11703]: 2017-09-28 12:54:20.230 11703 ERROR nova     max_url_len=max_url_len)
Sep 28 12:54:20 ctl02 nova-api[11703]: 2017-09-28 12:54:20.230 11703 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:54:20 ctl02 nova-api[11703]: 2017-09-28 12:54:20.230 11703 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:54:20 ctl02 nova-api[11703]: 2017-09-28 12:54:20.230 11703 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:54:20 ctl02 nova-api[11703]: 2017-09-28 12:54:20.230 11703 ERROR nova     sock.listen(backlog)
Sep 28 12:54:20 ctl02 nova-api[11703]: 2017-09-28 12:54:20.230 11703 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:54:20 ctl02 nova-api[11703]: 2017-09-28 12:54:20.230 11703 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:54:20 ctl02 nova-api[11703]: 2017-09-28 12:54:20.230 11703 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:54:20 ctl02 nova-api[11703]: 2017-09-28 12:54:20.230 11703 ERROR nova
Sep 28 12:54:20 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:54:20 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:54:20 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:54:20 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:54:20 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:54:20 ctl02 glance-api[29183]: 2017-09-28 12:54:20.635 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:54:20] "OPTIONS / HTTP/1.0" 200 134 0.000784
Sep 28 12:54:20 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:54:20 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:54:20 ctl02 heat-api-cfn[13300]: 2017-09-28 12:54:20.839 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:54:20] "OPTIONS / HTTP/1.0" 200 134 0.000471
Sep 28 12:54:21 ctl02 neutron-server[30536]: 2017-09-28 12:54:21.027 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:54:21] "OPTIONS / HTTP/1.0" 200 262 0.000444
Sep 28 12:54:21 ctl02 neutron-server[30536]: 2017-09-28 12:54:21.134 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 12:54:21 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:54:21 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:53:06 cmp002
Sep 28 12:54:21 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:53:38 cmp001
Sep 28 12:54:21 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:52:26 cmp002
Sep 28 12:54:21 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xab66304a)
Sep 28 12:54:22 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xab66304a)
Sep 28 12:54:22 ctl02 nova-api[11722]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:54:22 ctl02 nova-api[11722]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:54:22 ctl02 glance-api[29183]: 2017-09-28 12:54:22.319 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:54:22] "OPTIONS / HTTP/1.0" 200 134 0.000778
Sep 28 12:54:22 ctl02 nova-api[11722]: 2017-09-28 12:54:22.482 11722 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:54:22 ctl02 nova-api[11722]: 2017-09-28 12:54:22.483 11722 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:54:22 ctl02 nova-api[11722]: 2017-09-28 12:54:22.483 11722 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:54:22 ctl02 nova-api[11722]: 2017-09-28 12:54:22.483 11722 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:54:22 ctl02 nova-api[11722]: 2017-09-28 12:54:22.483 11722 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:54:22 ctl02 nova-api[11722]: 2017-09-28 12:54:22.483 11722 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:54:22 ctl02 nova-api[11722]: 2017-09-28 12:54:22.483 11722 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:54:22 ctl02 nova-api[11722]: 2017-09-28 12:54:22.483 11722 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:54:22 ctl02 nova-api[11722]: 2017-09-28 12:54:22.483 11722 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:54:22 ctl02 nova-api[11722]: 2017-09-28 12:54:22.483 11722 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:54:22 ctl02 nova-api[11722]: 2017-09-28 12:54:22.483 11722 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:54:22 ctl02 nova-api[11722]: 2017-09-28 12:54:22.483 11722 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:54:22 ctl02 nova-api[11722]: 2017-09-28 12:54:22.483 11722 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:54:22 ctl02 nova-api[11722]: 2017-09-28 12:54:22.483 11722 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:54:22 ctl02 nova-api[11722]: 2017-09-28 12:54:22.483 11722 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:54:22 ctl02 nova-api[11722]: 2017-09-28 12:54:22.483 11722 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:54:22 ctl02 nova-api[11722]: 2017-09-28 12:54:22.483 11722 ERROR nova.wsgi     self.filename))
Sep 28 12:54:22 ctl02 nova-api[11722]: 2017-09-28 12:54:22.483 11722 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:54:22 ctl02 nova-api[11722]: 2017-09-28 12:54:22.483 11722 ERROR nova.wsgi
Sep 28 12:54:22 ctl02 nova-api[11722]: 2017-09-28 12:54:22.486 11722 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:54:22 ctl02 nova-api[11722]: 2017-09-28 12:54:22.617 11722 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:54:22 ctl02 nova-api[11722]: 2017-09-28 12:54:22.843 11722 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:54:22 ctl02 nova-api[11722]: 2017-09-28 12:54:22.846 11722 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:54:22 ctl02 nova-api[11722]: 2017-09-28 12:54:22.846 11722 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:54:22 ctl02 nova-api[11722]: 2017-09-28 12:54:22.847 11722 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:54:22 ctl02 nova-api[11722]: 2017-09-28 12:54:22.980 11722 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:54:22 ctl02 nova-api[11722]: 2017-09-28 12:54:22.982 11722 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:54:22 ctl02 nova-api[11722]: 2017-09-28 12:54:22.982 11722 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:54:22 ctl02 nova-api[11722]: 2017-09-28 12:54:22.983 11722 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:54:22 ctl02 nova-api[11722]: 2017-09-28 12:54:22.986 11722 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:54:22 ctl02 nova-api[11722]: 2017-09-28 12:54:22.987 11722 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:54:22 ctl02 nova-api[11722]: 2017-09-28 12:54:22.987 11722 ERROR nova Traceback (most recent call last):
Sep 28 12:54:22 ctl02 nova-api[11722]: 2017-09-28 12:54:22.987 11722 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:54:22 ctl02 nova-api[11722]: 2017-09-28 12:54:22.987 11722 ERROR nova     sys.exit(main())
Sep 28 12:54:22 ctl02 nova-api[11722]: 2017-09-28 12:54:22.987 11722 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:54:22 ctl02 nova-api[11722]: 2017-09-28 12:54:22.987 11722 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:54:22 ctl02 nova-api[11722]: 2017-09-28 12:54:22.987 11722 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:54:22 ctl02 nova-api[11722]: 2017-09-28 12:54:22.987 11722 ERROR nova     max_url_len=max_url_len)
Sep 28 12:54:22 ctl02 nova-api[11722]: 2017-09-28 12:54:22.987 11722 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:54:22 ctl02 nova-api[11722]: 2017-09-28 12:54:22.987 11722 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:54:22 ctl02 nova-api[11722]: 2017-09-28 12:54:22.987 11722 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:54:22 ctl02 nova-api[11722]: 2017-09-28 12:54:22.987 11722 ERROR nova     sock.listen(backlog)
Sep 28 12:54:22 ctl02 nova-api[11722]: 2017-09-28 12:54:22.987 11722 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:54:22 ctl02 nova-api[11722]: 2017-09-28 12:54:22.987 11722 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:54:22 ctl02 nova-api[11722]: 2017-09-28 12:54:22.987 11722 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:54:22 ctl02 nova-api[11722]: 2017-09-28 12:54:22.987 11722 ERROR nova
Sep 28 12:54:23 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:54:23 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:54:23 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:54:23 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xab66304a)
Sep 28 12:54:23 ctl02 glance-api[29183]: 2017-09-28 12:54:23.292 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:54:23] "OPTIONS / HTTP/1.0" 200 134 0.000800
Sep 28 12:54:23 ctl02 neutron-server[30536]: 2017-09-28 12:54:23.364 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:54:23] "OPTIONS / HTTP/1.0" 200 262 0.000681
Sep 28 12:54:23 ctl02 heat-api[13008]: 2017-09-28 12:54:23.366 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:54:23] "OPTIONS / HTTP/1.0" 200 134 0.000683
Sep 28 12:54:23 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:54:23 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:54:23 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:54:23 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:54:23 ctl02 heat-api[13008]: 2017-09-28 12:54:23.859 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:54:23] "OPTIONS / HTTP/1.0" 200 134 0.000533
Sep 28 12:54:24 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xab66304a)
Sep 28 12:54:24 ctl02 neutron-server[30536]: 2017-09-28 12:54:24.338 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:54:24] "OPTIONS / HTTP/1.0" 200 262 0.000452
Sep 28 12:54:25 ctl02 nova-api[11740]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:54:25 ctl02 nova-api[11740]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:54:25 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xab66304a)
Sep 28 12:54:25 ctl02 nova-api[11740]: 2017-09-28 12:54:25.236 11740 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:54:25 ctl02 nova-api[11740]: 2017-09-28 12:54:25.237 11740 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:54:25 ctl02 nova-api[11740]: 2017-09-28 12:54:25.237 11740 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:54:25 ctl02 nova-api[11740]: 2017-09-28 12:54:25.237 11740 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:54:25 ctl02 nova-api[11740]: 2017-09-28 12:54:25.237 11740 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:54:25 ctl02 nova-api[11740]: 2017-09-28 12:54:25.237 11740 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:54:25 ctl02 nova-api[11740]: 2017-09-28 12:54:25.237 11740 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:54:25 ctl02 nova-api[11740]: 2017-09-28 12:54:25.237 11740 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:54:25 ctl02 nova-api[11740]: 2017-09-28 12:54:25.237 11740 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:54:25 ctl02 nova-api[11740]: 2017-09-28 12:54:25.237 11740 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:54:25 ctl02 nova-api[11740]: 2017-09-28 12:54:25.237 11740 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:54:25 ctl02 nova-api[11740]: 2017-09-28 12:54:25.237 11740 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:54:25 ctl02 nova-api[11740]: 2017-09-28 12:54:25.237 11740 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:54:25 ctl02 nova-api[11740]: 2017-09-28 12:54:25.237 11740 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:54:25 ctl02 nova-api[11740]: 2017-09-28 12:54:25.237 11740 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:54:25 ctl02 nova-api[11740]: 2017-09-28 12:54:25.237 11740 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:54:25 ctl02 nova-api[11740]: 2017-09-28 12:54:25.237 11740 ERROR nova.wsgi     self.filename))
Sep 28 12:54:25 ctl02 nova-api[11740]: 2017-09-28 12:54:25.237 11740 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:54:25 ctl02 nova-api[11740]: 2017-09-28 12:54:25.237 11740 ERROR nova.wsgi
Sep 28 12:54:25 ctl02 nova-api[11740]: 2017-09-28 12:54:25.238 11740 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:54:25 ctl02 nova-api[11740]: 2017-09-28 12:54:25.369 11740 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:54:25 ctl02 nova-api[11740]: 2017-09-28 12:54:25.593 11740 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:54:25 ctl02 nova-api[11740]: 2017-09-28 12:54:25.595 11740 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:54:25 ctl02 nova-api[11740]: 2017-09-28 12:54:25.595 11740 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:54:25 ctl02 nova-api[11740]: 2017-09-28 12:54:25.596 11740 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:54:25 ctl02 nova-api[11740]: 2017-09-28 12:54:25.725 11740 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:54:25 ctl02 nova-api[11740]: 2017-09-28 12:54:25.727 11740 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:54:25 ctl02 nova-api[11740]: 2017-09-28 12:54:25.727 11740 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:54:25 ctl02 nova-api[11740]: 2017-09-28 12:54:25.728 11740 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:54:25 ctl02 nova-api[11740]: 2017-09-28 12:54:25.731 11740 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:54:25 ctl02 nova-api[11740]: 2017-09-28 12:54:25.731 11740 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:54:25 ctl02 nova-api[11740]: 2017-09-28 12:54:25.731 11740 ERROR nova Traceback (most recent call last):
Sep 28 12:54:25 ctl02 nova-api[11740]: 2017-09-28 12:54:25.731 11740 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:54:25 ctl02 nova-api[11740]: 2017-09-28 12:54:25.731 11740 ERROR nova     sys.exit(main())
Sep 28 12:54:25 ctl02 nova-api[11740]: 2017-09-28 12:54:25.731 11740 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:54:25 ctl02 nova-api[11740]: 2017-09-28 12:54:25.731 11740 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:54:25 ctl02 nova-api[11740]: 2017-09-28 12:54:25.731 11740 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:54:25 ctl02 nova-api[11740]: 2017-09-28 12:54:25.731 11740 ERROR nova     max_url_len=max_url_len)
Sep 28 12:54:25 ctl02 nova-api[11740]: 2017-09-28 12:54:25.731 11740 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:54:25 ctl02 nova-api[11740]: 2017-09-28 12:54:25.731 11740 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:54:25 ctl02 nova-api[11740]: 2017-09-28 12:54:25.731 11740 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:54:25 ctl02 nova-api[11740]: 2017-09-28 12:54:25.731 11740 ERROR nova     sock.listen(backlog)
Sep 28 12:54:25 ctl02 nova-api[11740]: 2017-09-28 12:54:25.731 11740 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:54:25 ctl02 nova-api[11740]: 2017-09-28 12:54:25.731 11740 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:54:25 ctl02 nova-api[11740]: 2017-09-28 12:54:25.731 11740 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:54:25 ctl02 nova-api[11740]: 2017-09-28 12:54:25.731 11740 ERROR nova
Sep 28 12:54:25 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:54:25 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:54:25 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:54:26 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:54:26 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:54:26 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:54:26 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:54:26 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xab66304a)
Sep 28 12:54:26 ctl02 heat-api-cfn[13300]: 2017-09-28 12:54:26.820 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:54:26] "OPTIONS / HTTP/1.0" 200 134 0.000434
Sep 28 12:54:26 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:54:26.849 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:54:26] "OPTIONS / HTTP/1.0" 200 134 0.000371
Sep 28 12:54:26 ctl02 heat-api-cfn[13300]: 2017-09-28 12:54:26.987 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:54:26] "OPTIONS / HTTP/1.0" 200 134 0.000476
Sep 28 12:54:27 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xab66304a)
Sep 28 12:54:27 ctl02 heat-api[13008]: 2017-09-28 12:54:27.292 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:54:27] "OPTIONS / HTTP/1.0" 200 134 0.000562
Sep 28 12:54:27 ctl02 nova-api[11758]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:54:27 ctl02 nova-api[11758]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:54:28 ctl02 nova-api[11758]: 2017-09-28 12:54:28.018 11758 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:54:28 ctl02 nova-api[11758]: 2017-09-28 12:54:28.019 11758 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:54:28 ctl02 nova-api[11758]: 2017-09-28 12:54:28.019 11758 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:54:28 ctl02 nova-api[11758]: 2017-09-28 12:54:28.019 11758 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:54:28 ctl02 nova-api[11758]: 2017-09-28 12:54:28.019 11758 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:54:28 ctl02 nova-api[11758]: 2017-09-28 12:54:28.019 11758 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:54:28 ctl02 nova-api[11758]: 2017-09-28 12:54:28.019 11758 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:54:28 ctl02 nova-api[11758]: 2017-09-28 12:54:28.019 11758 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:54:28 ctl02 nova-api[11758]: 2017-09-28 12:54:28.019 11758 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:54:28 ctl02 nova-api[11758]: 2017-09-28 12:54:28.019 11758 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:54:28 ctl02 nova-api[11758]: 2017-09-28 12:54:28.019 11758 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:54:28 ctl02 nova-api[11758]: 2017-09-28 12:54:28.019 11758 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:54:28 ctl02 nova-api[11758]: 2017-09-28 12:54:28.019 11758 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:54:28 ctl02 nova-api[11758]: 2017-09-28 12:54:28.019 11758 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:54:28 ctl02 nova-api[11758]: 2017-09-28 12:54:28.019 11758 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:54:28 ctl02 nova-api[11758]: 2017-09-28 12:54:28.019 11758 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:54:28 ctl02 nova-api[11758]: 2017-09-28 12:54:28.019 11758 ERROR nova.wsgi     self.filename))
Sep 28 12:54:28 ctl02 nova-api[11758]: 2017-09-28 12:54:28.019 11758 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:54:28 ctl02 nova-api[11758]: 2017-09-28 12:54:28.019 11758 ERROR nova.wsgi
Sep 28 12:54:28 ctl02 nova-api[11758]: 2017-09-28 12:54:28.020 11758 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:54:28 ctl02 nova-api[11758]: 2017-09-28 12:54:28.149 11758 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:54:28 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:54:28.157 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:54:28] "OPTIONS / HTTP/1.0" 200 134 0.000377
Sep 28 12:54:28 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:54:28 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:54:28 ctl02 nova-api[11758]: 2017-09-28 12:54:28.379 11758 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:54:28 ctl02 nova-api[11758]: 2017-09-28 12:54:28.382 11758 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:54:28 ctl02 nova-api[11758]: 2017-09-28 12:54:28.383 11758 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:54:28 ctl02 nova-api[11758]: 2017-09-28 12:54:28.383 11758 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:54:28 ctl02 nova-api[11758]: 2017-09-28 12:54:28.516 11758 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:54:28 ctl02 nova-api[11758]: 2017-09-28 12:54:28.518 11758 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:54:28 ctl02 nova-api[11758]: 2017-09-28 12:54:28.519 11758 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:54:28 ctl02 nova-api[11758]: 2017-09-28 12:54:28.519 11758 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:54:28 ctl02 nova-api[11758]: 2017-09-28 12:54:28.522 11758 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:54:28 ctl02 nova-api[11758]: 2017-09-28 12:54:28.523 11758 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:54:28 ctl02 nova-api[11758]: 2017-09-28 12:54:28.523 11758 ERROR nova Traceback (most recent call last):
Sep 28 12:54:28 ctl02 nova-api[11758]: 2017-09-28 12:54:28.523 11758 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:54:28 ctl02 nova-api[11758]: 2017-09-28 12:54:28.523 11758 ERROR nova     sys.exit(main())
Sep 28 12:54:28 ctl02 nova-api[11758]: 2017-09-28 12:54:28.523 11758 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:54:28 ctl02 nova-api[11758]: 2017-09-28 12:54:28.523 11758 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:54:28 ctl02 nova-api[11758]: 2017-09-28 12:54:28.523 11758 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:54:28 ctl02 nova-api[11758]: 2017-09-28 12:54:28.523 11758 ERROR nova     max_url_len=max_url_len)
Sep 28 12:54:28 ctl02 nova-api[11758]: 2017-09-28 12:54:28.523 11758 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:54:28 ctl02 nova-api[11758]: 2017-09-28 12:54:28.523 11758 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:54:28 ctl02 nova-api[11758]: 2017-09-28 12:54:28.523 11758 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:54:28 ctl02 nova-api[11758]: 2017-09-28 12:54:28.523 11758 ERROR nova     sock.listen(backlog)
Sep 28 12:54:28 ctl02 nova-api[11758]: 2017-09-28 12:54:28.523 11758 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:54:28 ctl02 nova-api[11758]: 2017-09-28 12:54:28.523 11758 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:54:28 ctl02 nova-api[11758]: 2017-09-28 12:54:28.523 11758 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:54:28 ctl02 nova-api[11758]: 2017-09-28 12:54:28.523 11758 ERROR nova
Sep 28 12:54:28 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:54:28 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:54:28 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:54:28 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:54:28 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:54:28 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:54:28 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:54:29 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:54:29.045 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:54:29] "OPTIONS / HTTP/1.0" 200 134 0.000487
Sep 28 12:54:30 ctl02 nova-api[11781]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:54:30 ctl02 nova-api[11781]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:54:30 ctl02 nova-api[11781]: 2017-09-28 12:54:30.753 11781 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:54:30 ctl02 nova-api[11781]: 2017-09-28 12:54:30.754 11781 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:54:30 ctl02 nova-api[11781]: 2017-09-28 12:54:30.754 11781 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:54:30 ctl02 nova-api[11781]: 2017-09-28 12:54:30.754 11781 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:54:30 ctl02 nova-api[11781]: 2017-09-28 12:54:30.754 11781 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:54:30 ctl02 nova-api[11781]: 2017-09-28 12:54:30.754 11781 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:54:30 ctl02 nova-api[11781]: 2017-09-28 12:54:30.754 11781 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:54:30 ctl02 nova-api[11781]: 2017-09-28 12:54:30.754 11781 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:54:30 ctl02 nova-api[11781]: 2017-09-28 12:54:30.754 11781 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:54:30 ctl02 nova-api[11781]: 2017-09-28 12:54:30.754 11781 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:54:30 ctl02 nova-api[11781]: 2017-09-28 12:54:30.754 11781 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:54:30 ctl02 nova-api[11781]: 2017-09-28 12:54:30.754 11781 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:54:30 ctl02 nova-api[11781]: 2017-09-28 12:54:30.754 11781 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:54:30 ctl02 nova-api[11781]: 2017-09-28 12:54:30.754 11781 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:54:30 ctl02 nova-api[11781]: 2017-09-28 12:54:30.754 11781 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:54:30 ctl02 nova-api[11781]: 2017-09-28 12:54:30.754 11781 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:54:30 ctl02 nova-api[11781]: 2017-09-28 12:54:30.754 11781 ERROR nova.wsgi     self.filename))
Sep 28 12:54:30 ctl02 nova-api[11781]: 2017-09-28 12:54:30.754 11781 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:54:30 ctl02 nova-api[11781]: 2017-09-28 12:54:30.754 11781 ERROR nova.wsgi
Sep 28 12:54:30 ctl02 nova-api[11781]: 2017-09-28 12:54:30.756 11781 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:54:30 ctl02 neutron-server[30536]: 2017-09-28 12:54:30.832 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:54:30] "OPTIONS / HTTP/1.0" 200 262 0.000468
Sep 28 12:54:30 ctl02 nova-api[11781]: 2017-09-28 12:54:30.890 11781 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:54:30 ctl02 glance-api[29183]: 2017-09-28 12:54:30.921 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:54:30] "OPTIONS / HTTP/1.0" 200 134 0.000584
Sep 28 12:54:31 ctl02 nova-api[11781]: 2017-09-28 12:54:31.124 11781 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:54:31 ctl02 nova-api[11781]: 2017-09-28 12:54:31.126 11781 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:54:31 ctl02 nova-api[11781]: 2017-09-28 12:54:31.126 11781 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:54:31 ctl02 nova-api[11781]: 2017-09-28 12:54:31.127 11781 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:54:31 ctl02 heat-api-cfn[13300]: 2017-09-28 12:54:31.157 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:54:31] "OPTIONS / HTTP/1.0" 200 134 0.000434
Sep 28 12:54:31 ctl02 nova-conductor[5056]: 2017-09-28 12:54:31.166 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:54:31 ctl02 nova-conductor[5056]: 2017-09-28 12:54:31.169 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:54:31 ctl02 nova-conductor[5056]: 2017-09-28 12:54:31.179 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:54:31 ctl02 nova-conductor[5056]: 2017-09-28 12:54:31.180 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:54:31 ctl02 nova-api[11781]: 2017-09-28 12:54:31.271 11781 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:54:31 ctl02 nova-api[11781]: 2017-09-28 12:54:31.273 11781 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:54:31 ctl02 nova-api[11781]: 2017-09-28 12:54:31.273 11781 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:54:31 ctl02 nova-api[11781]: 2017-09-28 12:54:31.273 11781 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:54:31 ctl02 nova-api[11781]: 2017-09-28 12:54:31.276 11781 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:54:31 ctl02 nova-api[11781]: 2017-09-28 12:54:31.277 11781 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:54:31 ctl02 nova-api[11781]: 2017-09-28 12:54:31.277 11781 ERROR nova Traceback (most recent call last):
Sep 28 12:54:31 ctl02 nova-api[11781]: 2017-09-28 12:54:31.277 11781 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:54:31 ctl02 nova-api[11781]: 2017-09-28 12:54:31.277 11781 ERROR nova     sys.exit(main())
Sep 28 12:54:31 ctl02 nova-api[11781]: 2017-09-28 12:54:31.277 11781 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:54:31 ctl02 nova-api[11781]: 2017-09-28 12:54:31.277 11781 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:54:31 ctl02 nova-api[11781]: 2017-09-28 12:54:31.277 11781 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:54:31 ctl02 nova-api[11781]: 2017-09-28 12:54:31.277 11781 ERROR nova     max_url_len=max_url_len)
Sep 28 12:54:31 ctl02 nova-api[11781]: 2017-09-28 12:54:31.277 11781 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:54:31 ctl02 nova-api[11781]: 2017-09-28 12:54:31.277 11781 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:54:31 ctl02 nova-api[11781]: 2017-09-28 12:54:31.277 11781 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:54:31 ctl02 nova-api[11781]: 2017-09-28 12:54:31.277 11781 ERROR nova     sock.listen(backlog)
Sep 28 12:54:31 ctl02 nova-api[11781]: 2017-09-28 12:54:31.277 11781 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:54:31 ctl02 nova-api[11781]: 2017-09-28 12:54:31.277 11781 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:54:31 ctl02 nova-api[11781]: 2017-09-28 12:54:31.277 11781 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:54:31 ctl02 nova-api[11781]: 2017-09-28 12:54:31.277 11781 ERROR nova
Sep 28 12:54:31 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:54:31 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:54:31 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:54:31 ctl02 nova-cert[4860]: 2017-09-28 12:54:31.447 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:54:31 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:54:31 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:54:31 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:54:31 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:54:32 ctl02 glance-api[29183]: 2017-09-28 12:54:32.135 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:54:32] "OPTIONS / HTTP/1.0" 200 134 0.000672
Sep 28 12:54:33 ctl02 neutron-server[30536]: 2017-09-28 12:54:33.062 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:54:33] "OPTIONS / HTTP/1.0" 200 262 0.000623
Sep 28 12:54:33 ctl02 glance-api[29183]: 2017-09-28 12:54:33.253 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:54:33] "OPTIONS / HTTP/1.0" 200 134 0.000684
Sep 28 12:54:33 ctl02 nova-api[11799]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:54:33 ctl02 nova-api[11799]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:54:33 ctl02 heat-api[13008]: 2017-09-28 12:54:33.431 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:54:33] "OPTIONS / HTTP/1.0" 200 134 0.000600
Sep 28 12:54:33 ctl02 nova-api[11799]: 2017-09-28 12:54:33.534 11799 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:54:33 ctl02 nova-api[11799]: 2017-09-28 12:54:33.535 11799 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:54:33 ctl02 nova-api[11799]: 2017-09-28 12:54:33.535 11799 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:54:33 ctl02 nova-api[11799]: 2017-09-28 12:54:33.535 11799 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:54:33 ctl02 nova-api[11799]: 2017-09-28 12:54:33.535 11799 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:54:33 ctl02 nova-api[11799]: 2017-09-28 12:54:33.535 11799 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:54:33 ctl02 nova-api[11799]: 2017-09-28 12:54:33.535 11799 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:54:33 ctl02 nova-api[11799]: 2017-09-28 12:54:33.535 11799 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:54:33 ctl02 nova-api[11799]: 2017-09-28 12:54:33.535 11799 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:54:33 ctl02 nova-api[11799]: 2017-09-28 12:54:33.535 11799 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:54:33 ctl02 nova-api[11799]: 2017-09-28 12:54:33.535 11799 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:54:33 ctl02 nova-api[11799]: 2017-09-28 12:54:33.535 11799 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:54:33 ctl02 nova-api[11799]: 2017-09-28 12:54:33.535 11799 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:54:33 ctl02 nova-api[11799]: 2017-09-28 12:54:33.535 11799 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:54:33 ctl02 nova-api[11799]: 2017-09-28 12:54:33.535 11799 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:54:33 ctl02 nova-api[11799]: 2017-09-28 12:54:33.535 11799 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:54:33 ctl02 nova-api[11799]: 2017-09-28 12:54:33.535 11799 ERROR nova.wsgi     self.filename))
Sep 28 12:54:33 ctl02 nova-api[11799]: 2017-09-28 12:54:33.535 11799 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:54:33 ctl02 nova-api[11799]: 2017-09-28 12:54:33.535 11799 ERROR nova.wsgi
Sep 28 12:54:33 ctl02 nova-api[11799]: 2017-09-28 12:54:33.536 11799 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:54:33 ctl02 nova-api[11799]: 2017-09-28 12:54:33.670 11799 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:54:33 ctl02 nova-api[11799]: 2017-09-28 12:54:33.923 11799 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:54:33 ctl02 nova-api[11799]: 2017-09-28 12:54:33.926 11799 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:54:33 ctl02 nova-api[11799]: 2017-09-28 12:54:33.944 11799 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:54:33 ctl02 nova-api[11799]: 2017-09-28 12:54:33.944 11799 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:54:34 ctl02 nova-api[11799]: 2017-09-28 12:54:34.087 11799 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:54:34 ctl02 nova-api[11799]: 2017-09-28 12:54:34.090 11799 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:54:34 ctl02 nova-api[11799]: 2017-09-28 12:54:34.090 11799 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:54:34 ctl02 nova-api[11799]: 2017-09-28 12:54:34.090 11799 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:54:34 ctl02 nova-api[11799]: 2017-09-28 12:54:34.094 11799 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:54:34 ctl02 nova-api[11799]: 2017-09-28 12:54:34.094 11799 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:54:34 ctl02 nova-api[11799]: 2017-09-28 12:54:34.094 11799 ERROR nova Traceback (most recent call last):
Sep 28 12:54:34 ctl02 nova-api[11799]: 2017-09-28 12:54:34.094 11799 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:54:34 ctl02 nova-api[11799]: 2017-09-28 12:54:34.094 11799 ERROR nova     sys.exit(main())
Sep 28 12:54:34 ctl02 nova-api[11799]: 2017-09-28 12:54:34.094 11799 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:54:34 ctl02 nova-api[11799]: 2017-09-28 12:54:34.094 11799 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:54:34 ctl02 nova-api[11799]: 2017-09-28 12:54:34.094 11799 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:54:34 ctl02 nova-api[11799]: 2017-09-28 12:54:34.094 11799 ERROR nova     max_url_len=max_url_len)
Sep 28 12:54:34 ctl02 nova-api[11799]: 2017-09-28 12:54:34.094 11799 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:54:34 ctl02 nova-api[11799]: 2017-09-28 12:54:34.094 11799 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:54:34 ctl02 nova-api[11799]: 2017-09-28 12:54:34.094 11799 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:54:34 ctl02 nova-api[11799]: 2017-09-28 12:54:34.094 11799 ERROR nova     sock.listen(backlog)
Sep 28 12:54:34 ctl02 nova-api[11799]: 2017-09-28 12:54:34.094 11799 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:54:34 ctl02 nova-api[11799]: 2017-09-28 12:54:34.094 11799 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:54:34 ctl02 nova-api[11799]: 2017-09-28 12:54:34.094 11799 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:54:34 ctl02 nova-api[11799]: 2017-09-28 12:54:34.094 11799 ERROR nova
Sep 28 12:54:34 ctl02 heat-api[13008]: 2017-09-28 12:54:34.135 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:54:34] "OPTIONS / HTTP/1.0" 200 134 0.000569
Sep 28 12:54:34 ctl02 neutron-server[30536]: 2017-09-28 12:54:34.138 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:54:34] "OPTIONS / HTTP/1.0" 200 262 0.000468
Sep 28 12:54:34 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:54:34 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:54:34 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:54:34 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:54:34 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:54:34 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:54:34 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:54:36 ctl02 nova-api[11817]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:54:36 ctl02 nova-api[11817]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:54:36 ctl02 neutron-server[30536]: 2017-09-28 12:54:36.130 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 12:54:36 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:54:36 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:53:06 cmp002
Sep 28 12:54:36 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:53:38 cmp001
Sep 28 12:54:36 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:54:00 cmp002
Sep 28 12:54:36 ctl02 nova-api[11817]: 2017-09-28 12:54:36.215 11817 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:54:36 ctl02 nova-api[11817]: 2017-09-28 12:54:36.216 11817 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:54:36 ctl02 nova-api[11817]: 2017-09-28 12:54:36.216 11817 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:54:36 ctl02 nova-api[11817]: 2017-09-28 12:54:36.216 11817 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:54:36 ctl02 nova-api[11817]: 2017-09-28 12:54:36.216 11817 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:54:36 ctl02 nova-api[11817]: 2017-09-28 12:54:36.216 11817 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:54:36 ctl02 nova-api[11817]: 2017-09-28 12:54:36.216 11817 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:54:36 ctl02 nova-api[11817]: 2017-09-28 12:54:36.216 11817 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:54:36 ctl02 nova-api[11817]: 2017-09-28 12:54:36.216 11817 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:54:36 ctl02 nova-api[11817]: 2017-09-28 12:54:36.216 11817 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:54:36 ctl02 nova-api[11817]: 2017-09-28 12:54:36.216 11817 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:54:36 ctl02 nova-api[11817]: 2017-09-28 12:54:36.216 11817 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:54:36 ctl02 nova-api[11817]: 2017-09-28 12:54:36.216 11817 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:54:36 ctl02 nova-api[11817]: 2017-09-28 12:54:36.216 11817 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:54:36 ctl02 nova-api[11817]: 2017-09-28 12:54:36.216 11817 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:54:36 ctl02 nova-api[11817]: 2017-09-28 12:54:36.216 11817 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:54:36 ctl02 nova-api[11817]: 2017-09-28 12:54:36.216 11817 ERROR nova.wsgi     self.filename))
Sep 28 12:54:36 ctl02 nova-api[11817]: 2017-09-28 12:54:36.216 11817 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:54:36 ctl02 nova-api[11817]: 2017-09-28 12:54:36.216 11817 ERROR nova.wsgi
Sep 28 12:54:36 ctl02 nova-api[11817]: 2017-09-28 12:54:36.217 11817 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:54:36 ctl02 nova-api[11817]: 2017-09-28 12:54:36.346 11817 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:54:36 ctl02 nova-api[11817]: 2017-09-28 12:54:36.567 11817 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:54:36 ctl02 nova-api[11817]: 2017-09-28 12:54:36.569 11817 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:54:36 ctl02 nova-api[11817]: 2017-09-28 12:54:36.569 11817 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:54:36 ctl02 nova-api[11817]: 2017-09-28 12:54:36.570 11817 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:54:36 ctl02 heat-api-cfn[13300]: 2017-09-28 12:54:36.605 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:54:36] "OPTIONS / HTTP/1.0" 200 134 0.000426
Sep 28 12:54:36 ctl02 nova-api[11817]: 2017-09-28 12:54:36.700 11817 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:54:36 ctl02 nova-api[11817]: 2017-09-28 12:54:36.702 11817 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:54:36 ctl02 nova-api[11817]: 2017-09-28 12:54:36.702 11817 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:54:36 ctl02 nova-api[11817]: 2017-09-28 12:54:36.702 11817 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:54:36 ctl02 nova-api[11817]: 2017-09-28 12:54:36.705 11817 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:54:36 ctl02 nova-api[11817]: 2017-09-28 12:54:36.706 11817 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:54:36 ctl02 nova-api[11817]: 2017-09-28 12:54:36.706 11817 ERROR nova Traceback (most recent call last):
Sep 28 12:54:36 ctl02 nova-api[11817]: 2017-09-28 12:54:36.706 11817 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:54:36 ctl02 nova-api[11817]: 2017-09-28 12:54:36.706 11817 ERROR nova     sys.exit(main())
Sep 28 12:54:36 ctl02 nova-api[11817]: 2017-09-28 12:54:36.706 11817 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:54:36 ctl02 nova-api[11817]: 2017-09-28 12:54:36.706 11817 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:54:36 ctl02 nova-api[11817]: 2017-09-28 12:54:36.706 11817 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:54:36 ctl02 nova-api[11817]: 2017-09-28 12:54:36.706 11817 ERROR nova     max_url_len=max_url_len)
Sep 28 12:54:36 ctl02 nova-api[11817]: 2017-09-28 12:54:36.706 11817 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:54:36 ctl02 nova-api[11817]: 2017-09-28 12:54:36.706 11817 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:54:36 ctl02 nova-api[11817]: 2017-09-28 12:54:36.706 11817 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:54:36 ctl02 nova-api[11817]: 2017-09-28 12:54:36.706 11817 ERROR nova     sock.listen(backlog)
Sep 28 12:54:36 ctl02 nova-api[11817]: 2017-09-28 12:54:36.706 11817 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:54:36 ctl02 nova-api[11817]: 2017-09-28 12:54:36.706 11817 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:54:36 ctl02 nova-api[11817]: 2017-09-28 12:54:36.706 11817 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:54:36 ctl02 nova-api[11817]: 2017-09-28 12:54:36.706 11817 ERROR nova
Sep 28 12:54:36 ctl02 heat-api-cfn[13300]: 2017-09-28 12:54:36.794 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:54:36] "OPTIONS / HTTP/1.0" 200 134 0.000430
Sep 28 12:54:36 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:54:36 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:54:36 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:54:37 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:54:37.044 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:54:37] "OPTIONS / HTTP/1.0" 200 134 0.000486
Sep 28 12:54:37 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:54:37 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:54:37 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:54:37 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:54:37 ctl02 heat-api[13008]: 2017-09-28 12:54:37.678 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:54:37] "OPTIONS / HTTP/1.0" 200 134 0.000509
Sep 28 12:54:38 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:54:38.085 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:54:38] "OPTIONS / HTTP/1.0" 200 134 0.000498
Sep 28 12:54:38 ctl02 nova-api[11834]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:54:38 ctl02 nova-api[11834]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:54:38 ctl02 nova-api[11834]: 2017-09-28 12:54:38.978 11834 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:54:38 ctl02 nova-api[11834]: 2017-09-28 12:54:38.979 11834 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:54:38 ctl02 nova-api[11834]: 2017-09-28 12:54:38.979 11834 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:54:38 ctl02 nova-api[11834]: 2017-09-28 12:54:38.979 11834 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:54:38 ctl02 nova-api[11834]: 2017-09-28 12:54:38.979 11834 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:54:38 ctl02 nova-api[11834]: 2017-09-28 12:54:38.979 11834 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:54:38 ctl02 nova-api[11834]: 2017-09-28 12:54:38.979 11834 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:54:38 ctl02 nova-api[11834]: 2017-09-28 12:54:38.979 11834 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:54:38 ctl02 nova-api[11834]: 2017-09-28 12:54:38.979 11834 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:54:38 ctl02 nova-api[11834]: 2017-09-28 12:54:38.979 11834 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:54:38 ctl02 nova-api[11834]: 2017-09-28 12:54:38.979 11834 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:54:38 ctl02 nova-api[11834]: 2017-09-28 12:54:38.979 11834 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:54:38 ctl02 nova-api[11834]: 2017-09-28 12:54:38.979 11834 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:54:38 ctl02 nova-api[11834]: 2017-09-28 12:54:38.979 11834 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:54:38 ctl02 nova-api[11834]: 2017-09-28 12:54:38.979 11834 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:54:38 ctl02 nova-api[11834]: 2017-09-28 12:54:38.979 11834 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:54:38 ctl02 nova-api[11834]: 2017-09-28 12:54:38.979 11834 ERROR nova.wsgi     self.filename))
Sep 28 12:54:38 ctl02 nova-api[11834]: 2017-09-28 12:54:38.979 11834 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:54:38 ctl02 nova-api[11834]: 2017-09-28 12:54:38.979 11834 ERROR nova.wsgi
Sep 28 12:54:38 ctl02 nova-api[11834]: 2017-09-28 12:54:38.988 11834 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:54:39 ctl02 nova-api[11834]: 2017-09-28 12:54:39.114 11834 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:54:39 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:54:39.197 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:54:39] "OPTIONS / HTTP/1.0" 200 134 0.000468
Sep 28 12:54:39 ctl02 nova-api[11834]: 2017-09-28 12:54:39.337 11834 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:54:39 ctl02 nova-api[11834]: 2017-09-28 12:54:39.339 11834 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:54:39 ctl02 nova-api[11834]: 2017-09-28 12:54:39.340 11834 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:54:39 ctl02 nova-api[11834]: 2017-09-28 12:54:39.340 11834 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:54:39 ctl02 nova-api[11834]: 2017-09-28 12:54:39.470 11834 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:54:39 ctl02 nova-api[11834]: 2017-09-28 12:54:39.472 11834 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:54:39 ctl02 nova-api[11834]: 2017-09-28 12:54:39.472 11834 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:54:39 ctl02 nova-api[11834]: 2017-09-28 12:54:39.472 11834 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:54:39 ctl02 nova-api[11834]: 2017-09-28 12:54:39.475 11834 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:54:39 ctl02 nova-api[11834]: 2017-09-28 12:54:39.476 11834 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:54:39 ctl02 nova-api[11834]: 2017-09-28 12:54:39.476 11834 ERROR nova Traceback (most recent call last):
Sep 28 12:54:39 ctl02 nova-api[11834]: 2017-09-28 12:54:39.476 11834 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:54:39 ctl02 nova-api[11834]: 2017-09-28 12:54:39.476 11834 ERROR nova     sys.exit(main())
Sep 28 12:54:39 ctl02 nova-api[11834]: 2017-09-28 12:54:39.476 11834 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:54:39 ctl02 nova-api[11834]: 2017-09-28 12:54:39.476 11834 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:54:39 ctl02 nova-api[11834]: 2017-09-28 12:54:39.476 11834 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:54:39 ctl02 nova-api[11834]: 2017-09-28 12:54:39.476 11834 ERROR nova     max_url_len=max_url_len)
Sep 28 12:54:39 ctl02 nova-api[11834]: 2017-09-28 12:54:39.476 11834 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:54:39 ctl02 nova-api[11834]: 2017-09-28 12:54:39.476 11834 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:54:39 ctl02 nova-api[11834]: 2017-09-28 12:54:39.476 11834 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:54:39 ctl02 nova-api[11834]: 2017-09-28 12:54:39.476 11834 ERROR nova     sock.listen(backlog)
Sep 28 12:54:39 ctl02 nova-api[11834]: 2017-09-28 12:54:39.476 11834 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:54:39 ctl02 nova-api[11834]: 2017-09-28 12:54:39.476 11834 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:54:39 ctl02 nova-api[11834]: 2017-09-28 12:54:39.476 11834 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:54:39 ctl02 nova-api[11834]: 2017-09-28 12:54:39.476 11834 ERROR nova
Sep 28 12:54:39 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:54:39 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:54:39 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:54:39 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:54:39 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:54:39 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:54:39 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:54:40 ctl02 glance-api[29183]: 2017-09-28 12:54:40.860 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:54:40] "OPTIONS / HTTP/1.0" 200 134 0.000630
Sep 28 12:54:40 ctl02 neutron-server[30536]: 2017-09-28 12:54:40.956 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:54:40] "OPTIONS / HTTP/1.0" 200 262 0.000568
Sep 28 12:54:41 ctl02 heat-api-cfn[13300]: 2017-09-28 12:54:41.127 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:54:41] "OPTIONS / HTTP/1.0" 200 134 0.000575
Sep 28 12:54:41 ctl02 nova-consoleauth[5433]: 2017-09-28 12:54:41.283 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:54:41 ctl02 nova-api[11853]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:54:41 ctl02 nova-api[11853]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:54:41 ctl02 nova-api[11853]: 2017-09-28 12:54:41.788 11853 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:54:41 ctl02 nova-api[11853]: 2017-09-28 12:54:41.790 11853 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:54:41 ctl02 nova-api[11853]: 2017-09-28 12:54:41.790 11853 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:54:41 ctl02 nova-api[11853]: 2017-09-28 12:54:41.790 11853 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:54:41 ctl02 nova-api[11853]: 2017-09-28 12:54:41.790 11853 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:54:41 ctl02 nova-api[11853]: 2017-09-28 12:54:41.790 11853 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:54:41 ctl02 nova-api[11853]: 2017-09-28 12:54:41.790 11853 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:54:41 ctl02 nova-api[11853]: 2017-09-28 12:54:41.790 11853 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:54:41 ctl02 nova-api[11853]: 2017-09-28 12:54:41.790 11853 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:54:41 ctl02 nova-api[11853]: 2017-09-28 12:54:41.790 11853 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:54:41 ctl02 nova-api[11853]: 2017-09-28 12:54:41.790 11853 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:54:41 ctl02 nova-api[11853]: 2017-09-28 12:54:41.790 11853 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:54:41 ctl02 nova-api[11853]: 2017-09-28 12:54:41.790 11853 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:54:41 ctl02 nova-api[11853]: 2017-09-28 12:54:41.790 11853 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:54:41 ctl02 nova-api[11853]: 2017-09-28 12:54:41.790 11853 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:54:41 ctl02 nova-api[11853]: 2017-09-28 12:54:41.790 11853 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:54:41 ctl02 nova-api[11853]: 2017-09-28 12:54:41.790 11853 ERROR nova.wsgi     self.filename))
Sep 28 12:54:41 ctl02 nova-api[11853]: 2017-09-28 12:54:41.790 11853 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:54:41 ctl02 nova-api[11853]: 2017-09-28 12:54:41.790 11853 ERROR nova.wsgi
Sep 28 12:54:41 ctl02 nova-api[11853]: 2017-09-28 12:54:41.790 11853 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:54:41 ctl02 glance-api[29183]: 2017-09-28 12:54:41.856 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:54:41] "OPTIONS / HTTP/1.0" 200 134 0.000608
Sep 28 12:54:41 ctl02 nova-api[11853]: 2017-09-28 12:54:41.936 11853 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:54:42 ctl02 nova-api[11853]: 2017-09-28 12:54:42.184 11853 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:54:42 ctl02 nova-api[11853]: 2017-09-28 12:54:42.187 11853 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:54:42 ctl02 nova-api[11853]: 2017-09-28 12:54:42.188 11853 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:54:42 ctl02 nova-api[11853]: 2017-09-28 12:54:42.188 11853 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:54:42 ctl02 heat-engine[12803]: 2017-09-28 12:54:42.289 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:54:42 ctl02 heat-engine[12803]: 2017-09-28 12:54:42.300 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:54:42 ctl02 heat-engine[12803]: 2017-09-28 12:54:42.300 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:54:42 ctl02 heat-engine[12803]: 2017-09-28 12:54:42.302 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:54:42 ctl02 nova-api[11853]: 2017-09-28 12:54:42.323 11853 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:54:42 ctl02 nova-api[11853]: 2017-09-28 12:54:42.325 11853 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:54:42 ctl02 nova-api[11853]: 2017-09-28 12:54:42.326 11853 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:54:42 ctl02 nova-api[11853]: 2017-09-28 12:54:42.326 11853 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:54:42 ctl02 nova-api[11853]: 2017-09-28 12:54:42.330 11853 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:54:42 ctl02 nova-api[11853]: 2017-09-28 12:54:42.330 11853 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:54:42 ctl02 nova-api[11853]: 2017-09-28 12:54:42.330 11853 ERROR nova Traceback (most recent call last):
Sep 28 12:54:42 ctl02 nova-api[11853]: 2017-09-28 12:54:42.330 11853 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:54:42 ctl02 nova-api[11853]: 2017-09-28 12:54:42.330 11853 ERROR nova     sys.exit(main())
Sep 28 12:54:42 ctl02 nova-api[11853]: 2017-09-28 12:54:42.330 11853 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:54:42 ctl02 nova-api[11853]: 2017-09-28 12:54:42.330 11853 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:54:42 ctl02 nova-api[11853]: 2017-09-28 12:54:42.330 11853 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:54:42 ctl02 nova-api[11853]: 2017-09-28 12:54:42.330 11853 ERROR nova     max_url_len=max_url_len)
Sep 28 12:54:42 ctl02 nova-api[11853]: 2017-09-28 12:54:42.330 11853 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:54:42 ctl02 nova-api[11853]: 2017-09-28 12:54:42.330 11853 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:54:42 ctl02 nova-api[11853]: 2017-09-28 12:54:42.330 11853 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:54:42 ctl02 nova-api[11853]: 2017-09-28 12:54:42.330 11853 ERROR nova     sock.listen(backlog)
Sep 28 12:54:42 ctl02 nova-api[11853]: 2017-09-28 12:54:42.330 11853 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:54:42 ctl02 nova-api[11853]: 2017-09-28 12:54:42.330 11853 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:54:42 ctl02 nova-api[11853]: 2017-09-28 12:54:42.330 11853 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:54:42 ctl02 nova-api[11853]: 2017-09-28 12:54:42.330 11853 ERROR nova
Sep 28 12:54:42 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:54:42 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:54:42 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:54:42 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:54:42 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:54:42 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:54:42 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:54:43 ctl02 glance-api[29183]: 2017-09-28 12:54:43.240 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:54:43] "OPTIONS / HTTP/1.0" 200 134 0.000589
Sep 28 12:54:43 ctl02 neutron-server[30536]: 2017-09-28 12:54:43.434 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:54:43] "OPTIONS / HTTP/1.0" 200 262 0.000448
Sep 28 12:54:43 ctl02 heat-api[13008]: 2017-09-28 12:54:43.583 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:54:43] "OPTIONS / HTTP/1.0" 200 134 0.000566
Sep 28 12:54:43 ctl02 neutron-server[30536]: 2017-09-28 12:54:43.851 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:54:43] "OPTIONS / HTTP/1.0" 200 262 0.000459
Sep 28 12:54:44 ctl02 heat-api[13008]: 2017-09-28 12:54:44.033 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:54:44] "OPTIONS / HTTP/1.0" 200 134 0.000536
Sep 28 12:54:44 ctl02 nova-api[11871]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:54:44 ctl02 nova-api[11871]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:54:44 ctl02 nova-scheduler[5620]: 2017-09-28 12:54:44.382 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:54:44 ctl02 nova-api[11871]: 2017-09-28 12:54:44.465 11871 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:54:44 ctl02 nova-api[11871]: 2017-09-28 12:54:44.467 11871 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:54:44 ctl02 nova-api[11871]: 2017-09-28 12:54:44.467 11871 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:54:44 ctl02 nova-api[11871]: 2017-09-28 12:54:44.467 11871 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:54:44 ctl02 nova-api[11871]: 2017-09-28 12:54:44.467 11871 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:54:44 ctl02 nova-api[11871]: 2017-09-28 12:54:44.467 11871 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:54:44 ctl02 nova-api[11871]: 2017-09-28 12:54:44.467 11871 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:54:44 ctl02 nova-api[11871]: 2017-09-28 12:54:44.467 11871 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:54:44 ctl02 nova-api[11871]: 2017-09-28 12:54:44.467 11871 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:54:44 ctl02 nova-api[11871]: 2017-09-28 12:54:44.467 11871 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:54:44 ctl02 nova-api[11871]: 2017-09-28 12:54:44.467 11871 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:54:44 ctl02 nova-api[11871]: 2017-09-28 12:54:44.467 11871 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:54:44 ctl02 nova-api[11871]: 2017-09-28 12:54:44.467 11871 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:54:44 ctl02 nova-api[11871]: 2017-09-28 12:54:44.467 11871 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:54:44 ctl02 nova-api[11871]: 2017-09-28 12:54:44.467 11871 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:54:44 ctl02 nova-api[11871]: 2017-09-28 12:54:44.467 11871 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:54:44 ctl02 nova-api[11871]: 2017-09-28 12:54:44.467 11871 ERROR nova.wsgi     self.filename))
Sep 28 12:54:44 ctl02 nova-api[11871]: 2017-09-28 12:54:44.467 11871 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:54:44 ctl02 nova-api[11871]: 2017-09-28 12:54:44.467 11871 ERROR nova.wsgi
Sep 28 12:54:44 ctl02 nova-api[11871]: 2017-09-28 12:54:44.468 11871 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:54:44 ctl02 nova-api[11871]: 2017-09-28 12:54:44.592 11871 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:54:44 ctl02 nova-api[11871]: 2017-09-28 12:54:44.816 11871 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:54:44 ctl02 nova-api[11871]: 2017-09-28 12:54:44.818 11871 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:54:44 ctl02 nova-api[11871]: 2017-09-28 12:54:44.818 11871 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:54:44 ctl02 nova-api[11871]: 2017-09-28 12:54:44.818 11871 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:54:44 ctl02 nova-api[11871]: 2017-09-28 12:54:44.947 11871 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:54:44 ctl02 nova-api[11871]: 2017-09-28 12:54:44.949 11871 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:54:44 ctl02 nova-api[11871]: 2017-09-28 12:54:44.949 11871 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:54:44 ctl02 nova-api[11871]: 2017-09-28 12:54:44.949 11871 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:54:44 ctl02 nova-api[11871]: 2017-09-28 12:54:44.952 11871 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:54:44 ctl02 nova-api[11871]: 2017-09-28 12:54:44.952 11871 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:54:44 ctl02 nova-api[11871]: 2017-09-28 12:54:44.952 11871 ERROR nova Traceback (most recent call last):
Sep 28 12:54:44 ctl02 nova-api[11871]: 2017-09-28 12:54:44.952 11871 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:54:44 ctl02 nova-api[11871]: 2017-09-28 12:54:44.952 11871 ERROR nova     sys.exit(main())
Sep 28 12:54:44 ctl02 nova-api[11871]: 2017-09-28 12:54:44.952 11871 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:54:44 ctl02 nova-api[11871]: 2017-09-28 12:54:44.952 11871 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:54:44 ctl02 nova-api[11871]: 2017-09-28 12:54:44.952 11871 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:54:44 ctl02 nova-api[11871]: 2017-09-28 12:54:44.952 11871 ERROR nova     max_url_len=max_url_len)
Sep 28 12:54:44 ctl02 nova-api[11871]: 2017-09-28 12:54:44.952 11871 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:54:44 ctl02 nova-api[11871]: 2017-09-28 12:54:44.952 11871 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:54:44 ctl02 nova-api[11871]: 2017-09-28 12:54:44.952 11871 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:54:44 ctl02 nova-api[11871]: 2017-09-28 12:54:44.952 11871 ERROR nova     sock.listen(backlog)
Sep 28 12:54:44 ctl02 nova-api[11871]: 2017-09-28 12:54:44.952 11871 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:54:44 ctl02 nova-api[11871]: 2017-09-28 12:54:44.952 11871 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:54:44 ctl02 nova-api[11871]: 2017-09-28 12:54:44.952 11871 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:54:44 ctl02 nova-api[11871]: 2017-09-28 12:54:44.952 11871 ERROR nova
Sep 28 12:54:45 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:54:45 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:54:45 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:54:45 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:54:45 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:54:45 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:54:45 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:54:46 ctl02 heat-api-cfn[13300]: 2017-09-28 12:54:46.557 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:54:46] "OPTIONS / HTTP/1.0" 200 134 0.000545
Sep 28 12:54:47 ctl02 heat-api-cfn[13300]: 2017-09-28 12:54:47.040 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:54:47] "OPTIONS / HTTP/1.0" 200 134 0.000441
Sep 28 12:54:47 ctl02 nova-api[11889]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:54:47 ctl02 nova-api[11889]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:54:47 ctl02 nova-api[11889]: 2017-09-28 12:54:47.262 11889 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:54:47 ctl02 nova-api[11889]: 2017-09-28 12:54:47.264 11889 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:54:47 ctl02 nova-api[11889]: 2017-09-28 12:54:47.264 11889 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:54:47 ctl02 nova-api[11889]: 2017-09-28 12:54:47.264 11889 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:54:47 ctl02 nova-api[11889]: 2017-09-28 12:54:47.264 11889 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:54:47 ctl02 nova-api[11889]: 2017-09-28 12:54:47.264 11889 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:54:47 ctl02 nova-api[11889]: 2017-09-28 12:54:47.264 11889 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:54:47 ctl02 nova-api[11889]: 2017-09-28 12:54:47.264 11889 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:54:47 ctl02 nova-api[11889]: 2017-09-28 12:54:47.264 11889 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:54:47 ctl02 nova-api[11889]: 2017-09-28 12:54:47.264 11889 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:54:47 ctl02 nova-api[11889]: 2017-09-28 12:54:47.264 11889 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:54:47 ctl02 nova-api[11889]: 2017-09-28 12:54:47.264 11889 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:54:47 ctl02 nova-api[11889]: 2017-09-28 12:54:47.264 11889 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:54:47 ctl02 nova-api[11889]: 2017-09-28 12:54:47.264 11889 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:54:47 ctl02 nova-api[11889]: 2017-09-28 12:54:47.264 11889 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:54:47 ctl02 nova-api[11889]: 2017-09-28 12:54:47.264 11889 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:54:47 ctl02 nova-api[11889]: 2017-09-28 12:54:47.264 11889 ERROR nova.wsgi     self.filename))
Sep 28 12:54:47 ctl02 nova-api[11889]: 2017-09-28 12:54:47.264 11889 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:54:47 ctl02 nova-api[11889]: 2017-09-28 12:54:47.264 11889 ERROR nova.wsgi
Sep 28 12:54:47 ctl02 nova-api[11889]: 2017-09-28 12:54:47.265 11889 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:54:47 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:54:47.308 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:54:47] "OPTIONS / HTTP/1.0" 200 134 0.000365
Sep 28 12:54:47 ctl02 nova-api[11889]: 2017-09-28 12:54:47.398 11889 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:54:47 ctl02 heat-api[13008]: 2017-09-28 12:54:47.470 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:54:47] "OPTIONS / HTTP/1.0" 200 134 0.000502
Sep 28 12:54:47 ctl02 nova-api[11889]: 2017-09-28 12:54:47.630 11889 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:54:47 ctl02 nova-api[11889]: 2017-09-28 12:54:47.632 11889 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:54:47 ctl02 nova-api[11889]: 2017-09-28 12:54:47.633 11889 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:54:47 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3226cb46)
Sep 28 12:54:47 ctl02 nova-api[11889]: 2017-09-28 12:54:47.633 11889 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:54:47 ctl02 nova-api[11889]: 2017-09-28 12:54:47.768 11889 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:54:47 ctl02 nova-api[11889]: 2017-09-28 12:54:47.770 11889 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:54:47 ctl02 nova-api[11889]: 2017-09-28 12:54:47.770 11889 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:54:47 ctl02 nova-api[11889]: 2017-09-28 12:54:47.771 11889 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:54:47 ctl02 nova-api[11889]: 2017-09-28 12:54:47.775 11889 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:54:47 ctl02 nova-api[11889]: 2017-09-28 12:54:47.775 11889 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:54:47 ctl02 nova-api[11889]: 2017-09-28 12:54:47.775 11889 ERROR nova Traceback (most recent call last):
Sep 28 12:54:47 ctl02 nova-api[11889]: 2017-09-28 12:54:47.775 11889 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:54:47 ctl02 nova-api[11889]: 2017-09-28 12:54:47.775 11889 ERROR nova     sys.exit(main())
Sep 28 12:54:47 ctl02 nova-api[11889]: 2017-09-28 12:54:47.775 11889 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:54:47 ctl02 nova-api[11889]: 2017-09-28 12:54:47.775 11889 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:54:47 ctl02 nova-api[11889]: 2017-09-28 12:54:47.775 11889 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:54:47 ctl02 nova-api[11889]: 2017-09-28 12:54:47.775 11889 ERROR nova     max_url_len=max_url_len)
Sep 28 12:54:47 ctl02 nova-api[11889]: 2017-09-28 12:54:47.775 11889 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:54:47 ctl02 nova-api[11889]: 2017-09-28 12:54:47.775 11889 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:54:47 ctl02 nova-api[11889]: 2017-09-28 12:54:47.775 11889 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:54:47 ctl02 nova-api[11889]: 2017-09-28 12:54:47.775 11889 ERROR nova     sock.listen(backlog)
Sep 28 12:54:47 ctl02 nova-api[11889]: 2017-09-28 12:54:47.775 11889 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:54:47 ctl02 nova-api[11889]: 2017-09-28 12:54:47.775 11889 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:54:47 ctl02 nova-api[11889]: 2017-09-28 12:54:47.775 11889 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:54:47 ctl02 nova-api[11889]: 2017-09-28 12:54:47.775 11889 ERROR nova
Sep 28 12:54:47 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:54:47 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:54:47 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:54:48 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:54:48.031 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:54:48] "OPTIONS / HTTP/1.0" 200 134 0.000497
Sep 28 12:54:48 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:54:48 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:54:48 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:54:48 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:54:48 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3226cb46)
Sep 28 12:54:48 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:54:48.951 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:54:48] "OPTIONS / HTTP/1.0" 200 134 0.000376
Sep 28 12:54:49 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3226cb46)
Sep 28 12:54:49 ctl02 nova-api[11907]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:54:49 ctl02 nova-api[11907]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:54:50 ctl02 nova-api[11907]: 2017-09-28 12:54:50.016 11907 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:54:50 ctl02 nova-api[11907]: 2017-09-28 12:54:50.017 11907 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:54:50 ctl02 nova-api[11907]: 2017-09-28 12:54:50.017 11907 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:54:50 ctl02 nova-api[11907]: 2017-09-28 12:54:50.017 11907 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:54:50 ctl02 nova-api[11907]: 2017-09-28 12:54:50.017 11907 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:54:50 ctl02 nova-api[11907]: 2017-09-28 12:54:50.017 11907 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:54:50 ctl02 nova-api[11907]: 2017-09-28 12:54:50.017 11907 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:54:50 ctl02 nova-api[11907]: 2017-09-28 12:54:50.017 11907 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:54:50 ctl02 nova-api[11907]: 2017-09-28 12:54:50.017 11907 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:54:50 ctl02 nova-api[11907]: 2017-09-28 12:54:50.017 11907 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:54:50 ctl02 nova-api[11907]: 2017-09-28 12:54:50.017 11907 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:54:50 ctl02 nova-api[11907]: 2017-09-28 12:54:50.017 11907 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:54:50 ctl02 nova-api[11907]: 2017-09-28 12:54:50.017 11907 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:54:50 ctl02 nova-api[11907]: 2017-09-28 12:54:50.017 11907 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:54:50 ctl02 nova-api[11907]: 2017-09-28 12:54:50.017 11907 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:54:50 ctl02 nova-api[11907]: 2017-09-28 12:54:50.017 11907 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:54:50 ctl02 nova-api[11907]: 2017-09-28 12:54:50.017 11907 ERROR nova.wsgi     self.filename))
Sep 28 12:54:50 ctl02 nova-api[11907]: 2017-09-28 12:54:50.017 11907 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:54:50 ctl02 nova-api[11907]: 2017-09-28 12:54:50.017 11907 ERROR nova.wsgi
Sep 28 12:54:50 ctl02 nova-api[11907]: 2017-09-28 12:54:50.019 11907 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:54:50 ctl02 nova-api[11907]: 2017-09-28 12:54:50.146 11907 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:54:50 ctl02 nova-api[11907]: 2017-09-28 12:54:50.375 11907 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:54:50 ctl02 nova-api[11907]: 2017-09-28 12:54:50.377 11907 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:54:50 ctl02 nova-api[11907]: 2017-09-28 12:54:50.378 11907 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:54:50 ctl02 nova-api[11907]: 2017-09-28 12:54:50.378 11907 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:54:50 ctl02 nova-api[11907]: 2017-09-28 12:54:50.511 11907 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:54:50 ctl02 nova-api[11907]: 2017-09-28 12:54:50.513 11907 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:54:50 ctl02 nova-api[11907]: 2017-09-28 12:54:50.513 11907 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:54:50 ctl02 nova-api[11907]: 2017-09-28 12:54:50.514 11907 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:54:50 ctl02 nova-api[11907]: 2017-09-28 12:54:50.517 11907 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:54:50 ctl02 nova-api[11907]: 2017-09-28 12:54:50.517 11907 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:54:50 ctl02 nova-api[11907]: 2017-09-28 12:54:50.517 11907 ERROR nova Traceback (most recent call last):
Sep 28 12:54:50 ctl02 nova-api[11907]: 2017-09-28 12:54:50.517 11907 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:54:50 ctl02 nova-api[11907]: 2017-09-28 12:54:50.517 11907 ERROR nova     sys.exit(main())
Sep 28 12:54:50 ctl02 nova-api[11907]: 2017-09-28 12:54:50.517 11907 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:54:50 ctl02 nova-api[11907]: 2017-09-28 12:54:50.517 11907 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:54:50 ctl02 nova-api[11907]: 2017-09-28 12:54:50.517 11907 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:54:50 ctl02 nova-api[11907]: 2017-09-28 12:54:50.517 11907 ERROR nova     max_url_len=max_url_len)
Sep 28 12:54:50 ctl02 nova-api[11907]: 2017-09-28 12:54:50.517 11907 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:54:50 ctl02 nova-api[11907]: 2017-09-28 12:54:50.517 11907 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:54:50 ctl02 nova-api[11907]: 2017-09-28 12:54:50.517 11907 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:54:50 ctl02 nova-api[11907]: 2017-09-28 12:54:50.517 11907 ERROR nova     sock.listen(backlog)
Sep 28 12:54:50 ctl02 nova-api[11907]: 2017-09-28 12:54:50.517 11907 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:54:50 ctl02 nova-api[11907]: 2017-09-28 12:54:50.517 11907 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:54:50 ctl02 nova-api[11907]: 2017-09-28 12:54:50.517 11907 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:54:50 ctl02 nova-api[11907]: 2017-09-28 12:54:50.517 11907 ERROR nova
Sep 28 12:54:50 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3226cb46)
Sep 28 12:54:50 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:54:50 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:54:50 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:54:50 ctl02 glance-api[29183]: 2017-09-28 12:54:50.750 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:54:50] "OPTIONS / HTTP/1.0" 200 134 0.000679
Sep 28 12:54:50 ctl02 heat-api-cfn[13300]: 2017-09-28 12:54:50.845 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:54:50] "OPTIONS / HTTP/1.0" 200 134 0.000627
Sep 28 12:54:50 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:54:50 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:54:50 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:54:50 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:54:51 ctl02 neutron-server[30536]: 2017-09-28 12:54:51.135 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 12:54:51 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:54:51 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:53:06 cmp002
Sep 28 12:54:51 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:53:38 cmp001
Sep 28 12:54:51 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:54:00 cmp002
Sep 28 12:54:51 ctl02 neutron-server[30536]: 2017-09-28 12:54:51.178 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:54:51] "OPTIONS / HTTP/1.0" 200 262 0.000508
Sep 28 12:54:51 ctl02 glance-api[29183]: 2017-09-28 12:54:51.611 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:54:51] "OPTIONS / HTTP/1.0" 200 134 0.000592
Sep 28 12:54:51 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3226cb46)
Sep 28 12:54:52 ctl02 nova-api[11924]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:54:52 ctl02 nova-api[11924]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:54:52 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3226cb46)
Sep 28 12:54:52 ctl02 nova-api[11924]: 2017-09-28 12:54:52.768 11924 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:54:52 ctl02 nova-api[11924]: 2017-09-28 12:54:52.770 11924 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:54:52 ctl02 nova-api[11924]: 2017-09-28 12:54:52.770 11924 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:54:52 ctl02 nova-api[11924]: 2017-09-28 12:54:52.770 11924 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:54:52 ctl02 nova-api[11924]: 2017-09-28 12:54:52.770 11924 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:54:52 ctl02 nova-api[11924]: 2017-09-28 12:54:52.770 11924 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:54:52 ctl02 nova-api[11924]: 2017-09-28 12:54:52.770 11924 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:54:52 ctl02 nova-api[11924]: 2017-09-28 12:54:52.770 11924 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:54:52 ctl02 nova-api[11924]: 2017-09-28 12:54:52.770 11924 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:54:52 ctl02 nova-api[11924]: 2017-09-28 12:54:52.770 11924 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:54:52 ctl02 nova-api[11924]: 2017-09-28 12:54:52.770 11924 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:54:52 ctl02 nova-api[11924]: 2017-09-28 12:54:52.770 11924 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:54:52 ctl02 nova-api[11924]: 2017-09-28 12:54:52.770 11924 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:54:52 ctl02 nova-api[11924]: 2017-09-28 12:54:52.770 11924 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:54:52 ctl02 nova-api[11924]: 2017-09-28 12:54:52.770 11924 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:54:52 ctl02 nova-api[11924]: 2017-09-28 12:54:52.770 11924 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:54:52 ctl02 nova-api[11924]: 2017-09-28 12:54:52.770 11924 ERROR nova.wsgi     self.filename))
Sep 28 12:54:52 ctl02 nova-api[11924]: 2017-09-28 12:54:52.770 11924 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:54:52 ctl02 nova-api[11924]: 2017-09-28 12:54:52.770 11924 ERROR nova.wsgi
Sep 28 12:54:52 ctl02 nova-api[11924]: 2017-09-28 12:54:52.771 11924 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:54:52 ctl02 nova-api[11924]: 2017-09-28 12:54:52.903 11924 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:54:53 ctl02 nova-api[11924]: 2017-09-28 12:54:53.128 11924 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:54:53 ctl02 nova-api[11924]: 2017-09-28 12:54:53.131 11924 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:54:53 ctl02 nova-api[11924]: 2017-09-28 12:54:53.131 11924 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:54:53 ctl02 nova-api[11924]: 2017-09-28 12:54:53.131 11924 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:54:53 ctl02 nova-api[11924]: 2017-09-28 12:54:53.263 11924 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:54:53 ctl02 nova-api[11924]: 2017-09-28 12:54:53.265 11924 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:54:53 ctl02 nova-api[11924]: 2017-09-28 12:54:53.265 11924 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:54:53 ctl02 nova-api[11924]: 2017-09-28 12:54:53.266 11924 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:54:53 ctl02 nova-api[11924]: 2017-09-28 12:54:53.269 11924 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:54:53 ctl02 nova-api[11924]: 2017-09-28 12:54:53.269 11924 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:54:53 ctl02 nova-api[11924]: 2017-09-28 12:54:53.269 11924 ERROR nova Traceback (most recent call last):
Sep 28 12:54:53 ctl02 nova-api[11924]: 2017-09-28 12:54:53.269 11924 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:54:53 ctl02 nova-api[11924]: 2017-09-28 12:54:53.269 11924 ERROR nova     sys.exit(main())
Sep 28 12:54:53 ctl02 nova-api[11924]: 2017-09-28 12:54:53.269 11924 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:54:53 ctl02 nova-api[11924]: 2017-09-28 12:54:53.269 11924 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:54:53 ctl02 nova-api[11924]: 2017-09-28 12:54:53.269 11924 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:54:53 ctl02 nova-api[11924]: 2017-09-28 12:54:53.269 11924 ERROR nova     max_url_len=max_url_len)
Sep 28 12:54:53 ctl02 nova-api[11924]: 2017-09-28 12:54:53.269 11924 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:54:53 ctl02 nova-api[11924]: 2017-09-28 12:54:53.269 11924 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:54:53 ctl02 nova-api[11924]: 2017-09-28 12:54:53.269 11924 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:54:53 ctl02 nova-api[11924]: 2017-09-28 12:54:53.269 11924 ERROR nova     sock.listen(backlog)
Sep 28 12:54:53 ctl02 nova-api[11924]: 2017-09-28 12:54:53.269 11924 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:54:53 ctl02 nova-api[11924]: 2017-09-28 12:54:53.269 11924 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:54:53 ctl02 nova-api[11924]: 2017-09-28 12:54:53.269 11924 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:54:53 ctl02 nova-api[11924]: 2017-09-28 12:54:53.269 11924 ERROR nova
Sep 28 12:54:53 ctl02 glance-api[29183]: 2017-09-28 12:54:53.351 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:54:53] "OPTIONS / HTTP/1.0" 200 134 0.000643
Sep 28 12:54:53 ctl02 heat-api[13008]: 2017-09-28 12:54:53.373 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:54:53] "OPTIONS / HTTP/1.0" 200 134 0.000638
Sep 28 12:54:53 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:54:53 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:54:53 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:54:53 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:54:53 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:54:53 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3226cb46)
Sep 28 12:54:53 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:54:53 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:54:53 ctl02 neutron-server[30536]: 2017-09-28 12:54:53.701 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:54:53] "OPTIONS / HTTP/1.0" 200 262 0.000594
Sep 28 12:54:54 ctl02 heat-api[13008]: 2017-09-28 12:54:54.032 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:54:54] "OPTIONS / HTTP/1.0" 200 134 0.000532
Sep 28 12:54:54 ctl02 neutron-server[30536]: 2017-09-28 12:54:54.098 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:54:54] "OPTIONS / HTTP/1.0" 200 262 0.000455
Sep 28 12:54:54 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3226cb46)
Sep 28 12:54:55 ctl02 nova-api[11943]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:54:55 ctl02 nova-api[11943]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:54:55 ctl02 nova-api[11943]: 2017-09-28 12:54:55.470 11943 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:54:55 ctl02 nova-api[11943]: 2017-09-28 12:54:55.472 11943 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:54:55 ctl02 nova-api[11943]: 2017-09-28 12:54:55.472 11943 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:54:55 ctl02 nova-api[11943]: 2017-09-28 12:54:55.472 11943 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:54:55 ctl02 nova-api[11943]: 2017-09-28 12:54:55.472 11943 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:54:55 ctl02 nova-api[11943]: 2017-09-28 12:54:55.472 11943 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:54:55 ctl02 nova-api[11943]: 2017-09-28 12:54:55.472 11943 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:54:55 ctl02 nova-api[11943]: 2017-09-28 12:54:55.472 11943 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:54:55 ctl02 nova-api[11943]: 2017-09-28 12:54:55.472 11943 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:54:55 ctl02 nova-api[11943]: 2017-09-28 12:54:55.472 11943 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:54:55 ctl02 nova-api[11943]: 2017-09-28 12:54:55.472 11943 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:54:55 ctl02 nova-api[11943]: 2017-09-28 12:54:55.472 11943 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:54:55 ctl02 nova-api[11943]: 2017-09-28 12:54:55.472 11943 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:54:55 ctl02 nova-api[11943]: 2017-09-28 12:54:55.472 11943 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:54:55 ctl02 nova-api[11943]: 2017-09-28 12:54:55.472 11943 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:54:55 ctl02 nova-api[11943]: 2017-09-28 12:54:55.472 11943 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:54:55 ctl02 nova-api[11943]: 2017-09-28 12:54:55.472 11943 ERROR nova.wsgi     self.filename))
Sep 28 12:54:55 ctl02 nova-api[11943]: 2017-09-28 12:54:55.472 11943 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:54:55 ctl02 nova-api[11943]: 2017-09-28 12:54:55.472 11943 ERROR nova.wsgi
Sep 28 12:54:55 ctl02 nova-api[11943]: 2017-09-28 12:54:55.474 11943 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:54:55 ctl02 nova-api[11943]: 2017-09-28 12:54:55.601 11943 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:54:55 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3226cb46)
Sep 28 12:54:55 ctl02 nova-api[11943]: 2017-09-28 12:54:55.820 11943 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:54:55 ctl02 nova-api[11943]: 2017-09-28 12:54:55.823 11943 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:54:55 ctl02 nova-api[11943]: 2017-09-28 12:54:55.823 11943 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:54:55 ctl02 nova-api[11943]: 2017-09-28 12:54:55.823 11943 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:54:55 ctl02 nova-api[11943]: 2017-09-28 12:54:55.954 11943 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:54:55 ctl02 nova-api[11943]: 2017-09-28 12:54:55.956 11943 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:54:55 ctl02 nova-api[11943]: 2017-09-28 12:54:55.957 11943 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:54:55 ctl02 nova-api[11943]: 2017-09-28 12:54:55.957 11943 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:54:55 ctl02 nova-api[11943]: 2017-09-28 12:54:55.960 11943 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:54:55 ctl02 nova-api[11943]: 2017-09-28 12:54:55.961 11943 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:54:55 ctl02 nova-api[11943]: 2017-09-28 12:54:55.961 11943 ERROR nova Traceback (most recent call last):
Sep 28 12:54:55 ctl02 nova-api[11943]: 2017-09-28 12:54:55.961 11943 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:54:55 ctl02 nova-api[11943]: 2017-09-28 12:54:55.961 11943 ERROR nova     sys.exit(main())
Sep 28 12:54:55 ctl02 nova-api[11943]: 2017-09-28 12:54:55.961 11943 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:54:55 ctl02 nova-api[11943]: 2017-09-28 12:54:55.961 11943 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:54:55 ctl02 nova-api[11943]: 2017-09-28 12:54:55.961 11943 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:54:55 ctl02 nova-api[11943]: 2017-09-28 12:54:55.961 11943 ERROR nova     max_url_len=max_url_len)
Sep 28 12:54:55 ctl02 nova-api[11943]: 2017-09-28 12:54:55.961 11943 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:54:55 ctl02 nova-api[11943]: 2017-09-28 12:54:55.961 11943 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:54:55 ctl02 nova-api[11943]: 2017-09-28 12:54:55.961 11943 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:54:55 ctl02 nova-api[11943]: 2017-09-28 12:54:55.961 11943 ERROR nova     sock.listen(backlog)
Sep 28 12:54:55 ctl02 nova-api[11943]: 2017-09-28 12:54:55.961 11943 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:54:55 ctl02 nova-api[11943]: 2017-09-28 12:54:55.961 11943 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:54:55 ctl02 nova-api[11943]: 2017-09-28 12:54:55.961 11943 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:54:55 ctl02 nova-api[11943]: 2017-09-28 12:54:55.961 11943 ERROR nova
Sep 28 12:54:56 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:54:56 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:54:56 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:54:56 ctl02 heat-api-cfn[13300]: 2017-09-28 12:54:56.344 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:54:56] "OPTIONS / HTTP/1.0" 200 134 0.000673
Sep 28 12:54:56 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:54:56 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:54:56 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:54:56 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:54:56 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3226cb46)
Sep 28 12:54:56 ctl02 heat-api-cfn[13300]: 2017-09-28 12:54:56.809 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:54:56] "OPTIONS / HTTP/1.0" 200 134 0.000445
Sep 28 12:54:57 ctl02 heat-api[13008]: 2017-09-28 12:54:57.123 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:54:57] "OPTIONS / HTTP/1.0" 200 134 0.000585
Sep 28 12:54:57 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:54:57.527 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:54:57] "OPTIONS / HTTP/1.0" 200 134 0.000366
Sep 28 12:54:57 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x3226cb46)
Sep 28 12:54:57 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:54:57.986 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:54:57] "OPTIONS / HTTP/1.0" 200 134 0.000275
Sep 28 12:54:58 ctl02 nova-api[11960]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:54:58 ctl02 nova-api[11960]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:54:58 ctl02 nova-api[11960]: 2017-09-28 12:54:58.196 11960 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:54:58 ctl02 nova-api[11960]: 2017-09-28 12:54:58.197 11960 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:54:58 ctl02 nova-api[11960]: 2017-09-28 12:54:58.197 11960 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:54:58 ctl02 nova-api[11960]: 2017-09-28 12:54:58.197 11960 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:54:58 ctl02 nova-api[11960]: 2017-09-28 12:54:58.197 11960 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:54:58 ctl02 nova-api[11960]: 2017-09-28 12:54:58.197 11960 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:54:58 ctl02 nova-api[11960]: 2017-09-28 12:54:58.197 11960 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:54:58 ctl02 nova-api[11960]: 2017-09-28 12:54:58.197 11960 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:54:58 ctl02 nova-api[11960]: 2017-09-28 12:54:58.197 11960 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:54:58 ctl02 nova-api[11960]: 2017-09-28 12:54:58.197 11960 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:54:58 ctl02 nova-api[11960]: 2017-09-28 12:54:58.197 11960 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:54:58 ctl02 nova-api[11960]: 2017-09-28 12:54:58.197 11960 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:54:58 ctl02 nova-api[11960]: 2017-09-28 12:54:58.197 11960 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:54:58 ctl02 nova-api[11960]: 2017-09-28 12:54:58.197 11960 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:54:58 ctl02 nova-api[11960]: 2017-09-28 12:54:58.197 11960 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:54:58 ctl02 nova-api[11960]: 2017-09-28 12:54:58.197 11960 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:54:58 ctl02 nova-api[11960]: 2017-09-28 12:54:58.197 11960 ERROR nova.wsgi     self.filename))
Sep 28 12:54:58 ctl02 nova-api[11960]: 2017-09-28 12:54:58.197 11960 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:54:58 ctl02 nova-api[11960]: 2017-09-28 12:54:58.197 11960 ERROR nova.wsgi
Sep 28 12:54:58 ctl02 nova-api[11960]: 2017-09-28 12:54:58.199 11960 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:54:58 ctl02 nova-api[11960]: 2017-09-28 12:54:58.326 11960 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:54:58 ctl02 nova-api[11960]: 2017-09-28 12:54:58.550 11960 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:54:58 ctl02 neutron-server[30536]: 2017-09-28 12:54:58.552 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:54:58 ctl02 nova-api[11960]: 2017-09-28 12:54:58.553 11960 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:54:58 ctl02 nova-api[11960]: 2017-09-28 12:54:58.553 11960 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:54:58 ctl02 nova-api[11960]: 2017-09-28 12:54:58.553 11960 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:54:58 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:54:58 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:54:58 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:54:58.648 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:54:58] "OPTIONS / HTTP/1.0" 200 134 0.000385
Sep 28 12:54:58 ctl02 nova-api[11960]: 2017-09-28 12:54:58.684 11960 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:54:58 ctl02 nova-api[11960]: 2017-09-28 12:54:58.687 11960 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:54:58 ctl02 nova-api[11960]: 2017-09-28 12:54:58.687 11960 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:54:58 ctl02 nova-api[11960]: 2017-09-28 12:54:58.687 11960 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:54:58 ctl02 nova-api[11960]: 2017-09-28 12:54:58.691 11960 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:54:58 ctl02 nova-api[11960]: 2017-09-28 12:54:58.691 11960 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:54:58 ctl02 nova-api[11960]: 2017-09-28 12:54:58.691 11960 ERROR nova Traceback (most recent call last):
Sep 28 12:54:58 ctl02 nova-api[11960]: 2017-09-28 12:54:58.691 11960 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:54:58 ctl02 nova-api[11960]: 2017-09-28 12:54:58.691 11960 ERROR nova     sys.exit(main())
Sep 28 12:54:58 ctl02 nova-api[11960]: 2017-09-28 12:54:58.691 11960 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:54:58 ctl02 nova-api[11960]: 2017-09-28 12:54:58.691 11960 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:54:58 ctl02 nova-api[11960]: 2017-09-28 12:54:58.691 11960 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:54:58 ctl02 nova-api[11960]: 2017-09-28 12:54:58.691 11960 ERROR nova     max_url_len=max_url_len)
Sep 28 12:54:58 ctl02 nova-api[11960]: 2017-09-28 12:54:58.691 11960 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:54:58 ctl02 nova-api[11960]: 2017-09-28 12:54:58.691 11960 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:54:58 ctl02 nova-api[11960]: 2017-09-28 12:54:58.691 11960 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:54:58 ctl02 nova-api[11960]: 2017-09-28 12:54:58.691 11960 ERROR nova     sock.listen(backlog)
Sep 28 12:54:58 ctl02 nova-api[11960]: 2017-09-28 12:54:58.691 11960 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:54:58 ctl02 nova-api[11960]: 2017-09-28 12:54:58.691 11960 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:54:58 ctl02 nova-api[11960]: 2017-09-28 12:54:58.691 11960 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:54:58 ctl02 nova-api[11960]: 2017-09-28 12:54:58.691 11960 ERROR nova
Sep 28 12:54:58 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:54:58 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:54:58 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:54:59 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:54:59 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:54:59 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:54:59 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:55:00 ctl02 glance-api[29183]: 2017-09-28 12:55:00.646 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:55:00] "OPTIONS / HTTP/1.0" 200 134 0.000560
Sep 28 12:55:00 ctl02 nova-api[11984]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:55:00 ctl02 nova-api[11984]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:55:00 ctl02 nova-api[11984]: 2017-09-28 12:55:00.975 11984 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:55:00 ctl02 nova-api[11984]: 2017-09-28 12:55:00.977 11984 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:55:00 ctl02 nova-api[11984]: 2017-09-28 12:55:00.977 11984 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:55:00 ctl02 nova-api[11984]: 2017-09-28 12:55:00.977 11984 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:55:00 ctl02 nova-api[11984]: 2017-09-28 12:55:00.977 11984 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:55:00 ctl02 nova-api[11984]: 2017-09-28 12:55:00.977 11984 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:55:00 ctl02 nova-api[11984]: 2017-09-28 12:55:00.977 11984 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:55:00 ctl02 nova-api[11984]: 2017-09-28 12:55:00.977 11984 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:55:00 ctl02 nova-api[11984]: 2017-09-28 12:55:00.977 11984 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:55:00 ctl02 nova-api[11984]: 2017-09-28 12:55:00.977 11984 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:55:00 ctl02 nova-api[11984]: 2017-09-28 12:55:00.977 11984 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:55:00 ctl02 nova-api[11984]: 2017-09-28 12:55:00.977 11984 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:55:00 ctl02 nova-api[11984]: 2017-09-28 12:55:00.977 11984 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:55:00 ctl02 nova-api[11984]: 2017-09-28 12:55:00.977 11984 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:55:00 ctl02 nova-api[11984]: 2017-09-28 12:55:00.977 11984 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:55:00 ctl02 nova-api[11984]: 2017-09-28 12:55:00.977 11984 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:55:00 ctl02 nova-api[11984]: 2017-09-28 12:55:00.977 11984 ERROR nova.wsgi     self.filename))
Sep 28 12:55:00 ctl02 nova-api[11984]: 2017-09-28 12:55:00.977 11984 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:55:00 ctl02 nova-api[11984]: 2017-09-28 12:55:00.977 11984 ERROR nova.wsgi
Sep 28 12:55:00 ctl02 nova-api[11984]: 2017-09-28 12:55:00.978 11984 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:55:00 ctl02 heat-api-cfn[13300]: 2017-09-28 12:55:00.992 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:55:00] "OPTIONS / HTTP/1.0" 200 134 0.000400
Sep 28 12:55:01 ctl02 nova-api[11984]: 2017-09-28 12:55:01.107 11984 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:55:01 ctl02 nova-api[11984]: 2017-09-28 12:55:01.328 11984 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:55:01 ctl02 nova-api[11984]: 2017-09-28 12:55:01.330 11984 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:55:01 ctl02 nova-api[11984]: 2017-09-28 12:55:01.330 11984 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:55:01 ctl02 nova-api[11984]: 2017-09-28 12:55:01.331 11984 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:55:01 ctl02 glance-api[29183]: 2017-09-28 12:55:01.352 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:55:01] "OPTIONS / HTTP/1.0" 200 134 0.000537
Sep 28 12:55:01 ctl02 neutron-server[30536]: 2017-09-28 12:55:01.405 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:55:01] "OPTIONS / HTTP/1.0" 200 262 0.000518
Sep 28 12:55:01 ctl02 nova-api[11984]: 2017-09-28 12:55:01.475 11984 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:55:01 ctl02 nova-api[11984]: 2017-09-28 12:55:01.477 11984 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:55:01 ctl02 nova-api[11984]: 2017-09-28 12:55:01.477 11984 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:55:01 ctl02 nova-api[11984]: 2017-09-28 12:55:01.477 11984 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:55:01 ctl02 nova-api[11984]: 2017-09-28 12:55:01.481 11984 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:55:01 ctl02 nova-api[11984]: 2017-09-28 12:55:01.481 11984 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:55:01 ctl02 nova-api[11984]: 2017-09-28 12:55:01.481 11984 ERROR nova Traceback (most recent call last):
Sep 28 12:55:01 ctl02 nova-api[11984]: 2017-09-28 12:55:01.481 11984 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:55:01 ctl02 nova-api[11984]: 2017-09-28 12:55:01.481 11984 ERROR nova     sys.exit(main())
Sep 28 12:55:01 ctl02 nova-api[11984]: 2017-09-28 12:55:01.481 11984 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:55:01 ctl02 nova-api[11984]: 2017-09-28 12:55:01.481 11984 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:55:01 ctl02 nova-api[11984]: 2017-09-28 12:55:01.481 11984 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:55:01 ctl02 nova-api[11984]: 2017-09-28 12:55:01.481 11984 ERROR nova     max_url_len=max_url_len)
Sep 28 12:55:01 ctl02 nova-api[11984]: 2017-09-28 12:55:01.481 11984 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:55:01 ctl02 nova-api[11984]: 2017-09-28 12:55:01.481 11984 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:55:01 ctl02 nova-api[11984]: 2017-09-28 12:55:01.481 11984 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:55:01 ctl02 nova-api[11984]: 2017-09-28 12:55:01.481 11984 ERROR nova     sock.listen(backlog)
Sep 28 12:55:01 ctl02 nova-api[11984]: 2017-09-28 12:55:01.481 11984 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:55:01 ctl02 nova-api[11984]: 2017-09-28 12:55:01.481 11984 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:55:01 ctl02 nova-api[11984]: 2017-09-28 12:55:01.481 11984 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:55:01 ctl02 nova-api[11984]: 2017-09-28 12:55:01.481 11984 ERROR nova
Sep 28 12:55:01 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:55:01 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:55:01 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:55:01 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:55:01 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:55:01 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:55:01 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:55:03 ctl02 nova-conductor[5056]: 2017-09-28 12:55:03.174 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:55:03 ctl02 nova-conductor[5056]: 2017-09-28 12:55:03.179 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:55:03 ctl02 nova-conductor[5056]: 2017-09-28 12:55:03.187 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:55:03 ctl02 heat-api[13008]: 2017-09-28 12:55:03.188 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:55:03] "OPTIONS / HTTP/1.0" 200 134 0.000593
Sep 28 12:55:03 ctl02 nova-conductor[5056]: 2017-09-28 12:55:03.189 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:55:03 ctl02 nova-cert[4860]: 2017-09-28 12:55:03.483 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:55:03 ctl02 glance-api[29183]: 2017-09-28 12:55:03.488 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:55:03] "OPTIONS / HTTP/1.0" 200 134 0.000651
Sep 28 12:55:03 ctl02 nova-api[12002]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:55:03 ctl02 nova-api[12002]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:55:03 ctl02 nova-api[12002]: 2017-09-28 12:55:03.720 12002 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:55:03 ctl02 nova-api[12002]: 2017-09-28 12:55:03.721 12002 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:55:03 ctl02 nova-api[12002]: 2017-09-28 12:55:03.721 12002 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:55:03 ctl02 nova-api[12002]: 2017-09-28 12:55:03.721 12002 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:55:03 ctl02 nova-api[12002]: 2017-09-28 12:55:03.721 12002 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:55:03 ctl02 nova-api[12002]: 2017-09-28 12:55:03.721 12002 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:55:03 ctl02 nova-api[12002]: 2017-09-28 12:55:03.721 12002 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:55:03 ctl02 nova-api[12002]: 2017-09-28 12:55:03.721 12002 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:55:03 ctl02 nova-api[12002]: 2017-09-28 12:55:03.721 12002 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:55:03 ctl02 nova-api[12002]: 2017-09-28 12:55:03.721 12002 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:55:03 ctl02 nova-api[12002]: 2017-09-28 12:55:03.721 12002 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:55:03 ctl02 nova-api[12002]: 2017-09-28 12:55:03.721 12002 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:55:03 ctl02 nova-api[12002]: 2017-09-28 12:55:03.721 12002 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:55:03 ctl02 nova-api[12002]: 2017-09-28 12:55:03.721 12002 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:55:03 ctl02 nova-api[12002]: 2017-09-28 12:55:03.721 12002 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:55:03 ctl02 nova-api[12002]: 2017-09-28 12:55:03.721 12002 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:55:03 ctl02 nova-api[12002]: 2017-09-28 12:55:03.721 12002 ERROR nova.wsgi     self.filename))
Sep 28 12:55:03 ctl02 nova-api[12002]: 2017-09-28 12:55:03.721 12002 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:55:03 ctl02 nova-api[12002]: 2017-09-28 12:55:03.721 12002 ERROR nova.wsgi
Sep 28 12:55:03 ctl02 nova-api[12002]: 2017-09-28 12:55:03.722 12002 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:55:03 ctl02 nova-api[12002]: 2017-09-28 12:55:03.847 12002 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:55:03 ctl02 neutron-server[30536]: 2017-09-28 12:55:03.865 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:55:03] "OPTIONS / HTTP/1.0" 200 262 0.000451
Sep 28 12:55:03 ctl02 neutron-server[30536]: 2017-09-28 12:55:03.920 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:55:03] "OPTIONS / HTTP/1.0" 200 262 0.000630
Sep 28 12:55:03 ctl02 heat-api[13008]: 2017-09-28 12:55:03.974 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:55:03] "OPTIONS / HTTP/1.0" 200 134 0.000543
Sep 28 12:55:04 ctl02 nova-api[12002]: 2017-09-28 12:55:04.069 12002 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:55:04 ctl02 nova-api[12002]: 2017-09-28 12:55:04.071 12002 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:55:04 ctl02 nova-api[12002]: 2017-09-28 12:55:04.071 12002 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:55:04 ctl02 nova-api[12002]: 2017-09-28 12:55:04.071 12002 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:55:04 ctl02 nova-api[12002]: 2017-09-28 12:55:04.200 12002 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:55:04 ctl02 nova-api[12002]: 2017-09-28 12:55:04.202 12002 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:55:04 ctl02 nova-api[12002]: 2017-09-28 12:55:04.202 12002 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:55:04 ctl02 nova-api[12002]: 2017-09-28 12:55:04.202 12002 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:55:04 ctl02 nova-api[12002]: 2017-09-28 12:55:04.206 12002 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:55:04 ctl02 nova-api[12002]: 2017-09-28 12:55:04.206 12002 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:55:04 ctl02 nova-api[12002]: 2017-09-28 12:55:04.206 12002 ERROR nova Traceback (most recent call last):
Sep 28 12:55:04 ctl02 nova-api[12002]: 2017-09-28 12:55:04.206 12002 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:55:04 ctl02 nova-api[12002]: 2017-09-28 12:55:04.206 12002 ERROR nova     sys.exit(main())
Sep 28 12:55:04 ctl02 nova-api[12002]: 2017-09-28 12:55:04.206 12002 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:55:04 ctl02 nova-api[12002]: 2017-09-28 12:55:04.206 12002 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:55:04 ctl02 nova-api[12002]: 2017-09-28 12:55:04.206 12002 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:55:04 ctl02 nova-api[12002]: 2017-09-28 12:55:04.206 12002 ERROR nova     max_url_len=max_url_len)
Sep 28 12:55:04 ctl02 nova-api[12002]: 2017-09-28 12:55:04.206 12002 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:55:04 ctl02 nova-api[12002]: 2017-09-28 12:55:04.206 12002 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:55:04 ctl02 nova-api[12002]: 2017-09-28 12:55:04.206 12002 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:55:04 ctl02 nova-api[12002]: 2017-09-28 12:55:04.206 12002 ERROR nova     sock.listen(backlog)
Sep 28 12:55:04 ctl02 nova-api[12002]: 2017-09-28 12:55:04.206 12002 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:55:04 ctl02 nova-api[12002]: 2017-09-28 12:55:04.206 12002 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:55:04 ctl02 nova-api[12002]: 2017-09-28 12:55:04.206 12002 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:55:04 ctl02 nova-api[12002]: 2017-09-28 12:55:04.206 12002 ERROR nova
Sep 28 12:55:04 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:55:04 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:55:04 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:55:04 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:55:04 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:55:04 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:55:04 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:55:06 ctl02 heat-api-cfn[13300]: 2017-09-28 12:55:06.055 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:55:06] "OPTIONS / HTTP/1.0" 200 134 0.000417
Sep 28 12:55:06 ctl02 neutron-server[30536]: 2017-09-28 12:55:06.131 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 4 dead agents out of 6:
Sep 28 12:55:06 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:55:06 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:53:06 cmp002
Sep 28 12:55:06 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:53:38 cmp001
Sep 28 12:55:06 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:54:00 cmp002
Sep 28 12:55:06 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:54:26 cmp002
Sep 28 12:55:06 ctl02 nova-api[12020]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:55:06 ctl02 nova-api[12020]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:55:06 ctl02 nova-api[12020]: 2017-09-28 12:55:06.494 12020 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:55:06 ctl02 nova-api[12020]: 2017-09-28 12:55:06.495 12020 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:55:06 ctl02 nova-api[12020]: 2017-09-28 12:55:06.495 12020 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:55:06 ctl02 nova-api[12020]: 2017-09-28 12:55:06.495 12020 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:55:06 ctl02 nova-api[12020]: 2017-09-28 12:55:06.495 12020 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:55:06 ctl02 nova-api[12020]: 2017-09-28 12:55:06.495 12020 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:55:06 ctl02 nova-api[12020]: 2017-09-28 12:55:06.495 12020 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:55:06 ctl02 nova-api[12020]: 2017-09-28 12:55:06.495 12020 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:55:06 ctl02 nova-api[12020]: 2017-09-28 12:55:06.495 12020 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:55:06 ctl02 nova-api[12020]: 2017-09-28 12:55:06.495 12020 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:55:06 ctl02 nova-api[12020]: 2017-09-28 12:55:06.495 12020 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:55:06 ctl02 nova-api[12020]: 2017-09-28 12:55:06.495 12020 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:55:06 ctl02 nova-api[12020]: 2017-09-28 12:55:06.495 12020 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:55:06 ctl02 nova-api[12020]: 2017-09-28 12:55:06.495 12020 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:55:06 ctl02 nova-api[12020]: 2017-09-28 12:55:06.495 12020 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:55:06 ctl02 nova-api[12020]: 2017-09-28 12:55:06.495 12020 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:55:06 ctl02 nova-api[12020]: 2017-09-28 12:55:06.495 12020 ERROR nova.wsgi     self.filename))
Sep 28 12:55:06 ctl02 nova-api[12020]: 2017-09-28 12:55:06.495 12020 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:55:06 ctl02 nova-api[12020]: 2017-09-28 12:55:06.495 12020 ERROR nova.wsgi
Sep 28 12:55:06 ctl02 nova-api[12020]: 2017-09-28 12:55:06.496 12020 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:55:06 ctl02 nova-api[12020]: 2017-09-28 12:55:06.625 12020 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:55:06 ctl02 heat-api-cfn[13300]: 2017-09-28 12:55:06.759 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:55:06] "OPTIONS / HTTP/1.0" 200 134 0.000462
Sep 28 12:55:06 ctl02 nova-api[12020]: 2017-09-28 12:55:06.848 12020 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:55:06 ctl02 nova-api[12020]: 2017-09-28 12:55:06.850 12020 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:55:06 ctl02 nova-api[12020]: 2017-09-28 12:55:06.850 12020 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:55:06 ctl02 nova-api[12020]: 2017-09-28 12:55:06.851 12020 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:55:06 ctl02 nova-api[12020]: 2017-09-28 12:55:06.982 12020 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:55:06 ctl02 nova-api[12020]: 2017-09-28 12:55:06.983 12020 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:55:06 ctl02 nova-api[12020]: 2017-09-28 12:55:06.984 12020 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:55:06 ctl02 nova-api[12020]: 2017-09-28 12:55:06.984 12020 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:55:06 ctl02 nova-api[12020]: 2017-09-28 12:55:06.987 12020 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:55:06 ctl02 nova-api[12020]: 2017-09-28 12:55:06.987 12020 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:55:06 ctl02 nova-api[12020]: 2017-09-28 12:55:06.987 12020 ERROR nova Traceback (most recent call last):
Sep 28 12:55:06 ctl02 nova-api[12020]: 2017-09-28 12:55:06.987 12020 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:55:06 ctl02 nova-api[12020]: 2017-09-28 12:55:06.987 12020 ERROR nova     sys.exit(main())
Sep 28 12:55:06 ctl02 nova-api[12020]: 2017-09-28 12:55:06.987 12020 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:55:06 ctl02 nova-api[12020]: 2017-09-28 12:55:06.987 12020 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:55:06 ctl02 nova-api[12020]: 2017-09-28 12:55:06.987 12020 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:55:06 ctl02 nova-api[12020]: 2017-09-28 12:55:06.987 12020 ERROR nova     max_url_len=max_url_len)
Sep 28 12:55:06 ctl02 nova-api[12020]: 2017-09-28 12:55:06.987 12020 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:55:06 ctl02 nova-api[12020]: 2017-09-28 12:55:06.987 12020 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:55:06 ctl02 nova-api[12020]: 2017-09-28 12:55:06.987 12020 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:55:06 ctl02 nova-api[12020]: 2017-09-28 12:55:06.987 12020 ERROR nova     sock.listen(backlog)
Sep 28 12:55:06 ctl02 nova-api[12020]: 2017-09-28 12:55:06.987 12020 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:55:06 ctl02 nova-api[12020]: 2017-09-28 12:55:06.987 12020 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:55:06 ctl02 nova-api[12020]: 2017-09-28 12:55:06.987 12020 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:55:06 ctl02 nova-api[12020]: 2017-09-28 12:55:06.987 12020 ERROR nova
Sep 28 12:55:07 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:55:07 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:55:07 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:55:07 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:55:07 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:55:07 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:55:07 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:55:07 ctl02 heat-api[13008]: 2017-09-28 12:55:07.453 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:55:07] "OPTIONS / HTTP/1.0" 200 134 0.000620
Sep 28 12:55:07 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:55:07.777 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:55:07] "OPTIONS / HTTP/1.0" 200 134 0.000364
Sep 28 12:55:07 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:55:07.778 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:55:07] "OPTIONS / HTTP/1.0" 200 134 0.000248
Sep 28 12:55:08 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:55:08.596 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:55:08] "OPTIONS / HTTP/1.0" 200 134 0.000411
Sep 28 12:55:09 ctl02 nova-api[12038]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:55:09 ctl02 nova-api[12038]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:55:09 ctl02 nova-api[12038]: 2017-09-28 12:55:09.243 12038 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:55:09 ctl02 nova-api[12038]: 2017-09-28 12:55:09.245 12038 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:55:09 ctl02 nova-api[12038]: 2017-09-28 12:55:09.245 12038 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:55:09 ctl02 nova-api[12038]: 2017-09-28 12:55:09.245 12038 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:55:09 ctl02 nova-api[12038]: 2017-09-28 12:55:09.245 12038 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:55:09 ctl02 nova-api[12038]: 2017-09-28 12:55:09.245 12038 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:55:09 ctl02 nova-api[12038]: 2017-09-28 12:55:09.245 12038 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:55:09 ctl02 nova-api[12038]: 2017-09-28 12:55:09.245 12038 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:55:09 ctl02 nova-api[12038]: 2017-09-28 12:55:09.245 12038 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:55:09 ctl02 nova-api[12038]: 2017-09-28 12:55:09.245 12038 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:55:09 ctl02 nova-api[12038]: 2017-09-28 12:55:09.245 12038 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:55:09 ctl02 nova-api[12038]: 2017-09-28 12:55:09.245 12038 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:55:09 ctl02 nova-api[12038]: 2017-09-28 12:55:09.245 12038 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:55:09 ctl02 nova-api[12038]: 2017-09-28 12:55:09.245 12038 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:55:09 ctl02 nova-api[12038]: 2017-09-28 12:55:09.245 12038 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:55:09 ctl02 nova-api[12038]: 2017-09-28 12:55:09.245 12038 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:55:09 ctl02 nova-api[12038]: 2017-09-28 12:55:09.245 12038 ERROR nova.wsgi     self.filename))
Sep 28 12:55:09 ctl02 nova-api[12038]: 2017-09-28 12:55:09.245 12038 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:55:09 ctl02 nova-api[12038]: 2017-09-28 12:55:09.245 12038 ERROR nova.wsgi
Sep 28 12:55:09 ctl02 nova-api[12038]: 2017-09-28 12:55:09.246 12038 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:55:09 ctl02 nova-api[12038]: 2017-09-28 12:55:09.373 12038 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:55:09 ctl02 nova-api[12038]: 2017-09-28 12:55:09.597 12038 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:55:09 ctl02 nova-api[12038]: 2017-09-28 12:55:09.599 12038 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:55:09 ctl02 nova-api[12038]: 2017-09-28 12:55:09.599 12038 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:55:09 ctl02 nova-api[12038]: 2017-09-28 12:55:09.599 12038 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:55:09 ctl02 nova-api[12038]: 2017-09-28 12:55:09.730 12038 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:55:09 ctl02 nova-api[12038]: 2017-09-28 12:55:09.732 12038 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:55:09 ctl02 nova-api[12038]: 2017-09-28 12:55:09.732 12038 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:55:09 ctl02 nova-api[12038]: 2017-09-28 12:55:09.733 12038 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:55:09 ctl02 nova-api[12038]: 2017-09-28 12:55:09.736 12038 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:55:09 ctl02 nova-api[12038]: 2017-09-28 12:55:09.737 12038 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:55:09 ctl02 nova-api[12038]: 2017-09-28 12:55:09.737 12038 ERROR nova Traceback (most recent call last):
Sep 28 12:55:09 ctl02 nova-api[12038]: 2017-09-28 12:55:09.737 12038 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:55:09 ctl02 nova-api[12038]: 2017-09-28 12:55:09.737 12038 ERROR nova     sys.exit(main())
Sep 28 12:55:09 ctl02 nova-api[12038]: 2017-09-28 12:55:09.737 12038 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:55:09 ctl02 nova-api[12038]: 2017-09-28 12:55:09.737 12038 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:55:09 ctl02 nova-api[12038]: 2017-09-28 12:55:09.737 12038 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:55:09 ctl02 nova-api[12038]: 2017-09-28 12:55:09.737 12038 ERROR nova     max_url_len=max_url_len)
Sep 28 12:55:09 ctl02 nova-api[12038]: 2017-09-28 12:55:09.737 12038 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:55:09 ctl02 nova-api[12038]: 2017-09-28 12:55:09.737 12038 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:55:09 ctl02 nova-api[12038]: 2017-09-28 12:55:09.737 12038 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:55:09 ctl02 nova-api[12038]: 2017-09-28 12:55:09.737 12038 ERROR nova     sock.listen(backlog)
Sep 28 12:55:09 ctl02 nova-api[12038]: 2017-09-28 12:55:09.737 12038 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:55:09 ctl02 nova-api[12038]: 2017-09-28 12:55:09.737 12038 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:55:09 ctl02 nova-api[12038]: 2017-09-28 12:55:09.737 12038 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:55:09 ctl02 nova-api[12038]: 2017-09-28 12:55:09.737 12038 ERROR nova
Sep 28 12:55:09 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:55:09 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:55:09 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:55:10 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:55:10 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:55:10 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:55:10 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:55:10 ctl02 heat-api-cfn[13300]: 2017-09-28 12:55:10.751 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:55:10] "OPTIONS / HTTP/1.0" 200 134 0.000588
Sep 28 12:55:10 ctl02 glance-api[29183]: 2017-09-28 12:55:10.832 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:55:10] "OPTIONS / HTTP/1.0" 200 134 0.000539
Sep 28 12:55:11 ctl02 neutron-server[30536]: 2017-09-28 12:55:11.042 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:55:11] "OPTIONS / HTTP/1.0" 200 262 0.000443
Sep 28 12:55:11 ctl02 glance-api[29183]: 2017-09-28 12:55:11.072 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:55:11] "OPTIONS / HTTP/1.0" 200 134 0.000392
Sep 28 12:55:11 ctl02 nova-api[12055]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:55:11 ctl02 nova-api[12055]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:55:11 ctl02 nova-api[12055]: 2017-09-28 12:55:11.979 12055 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:55:11 ctl02 nova-api[12055]: 2017-09-28 12:55:11.980 12055 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:55:11 ctl02 nova-api[12055]: 2017-09-28 12:55:11.980 12055 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:55:11 ctl02 nova-api[12055]: 2017-09-28 12:55:11.980 12055 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:55:11 ctl02 nova-api[12055]: 2017-09-28 12:55:11.980 12055 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:55:11 ctl02 nova-api[12055]: 2017-09-28 12:55:11.980 12055 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:55:11 ctl02 nova-api[12055]: 2017-09-28 12:55:11.980 12055 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:55:11 ctl02 nova-api[12055]: 2017-09-28 12:55:11.980 12055 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:55:11 ctl02 nova-api[12055]: 2017-09-28 12:55:11.980 12055 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:55:11 ctl02 nova-api[12055]: 2017-09-28 12:55:11.980 12055 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:55:11 ctl02 nova-api[12055]: 2017-09-28 12:55:11.980 12055 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:55:11 ctl02 nova-api[12055]: 2017-09-28 12:55:11.980 12055 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:55:11 ctl02 nova-api[12055]: 2017-09-28 12:55:11.980 12055 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:55:11 ctl02 nova-api[12055]: 2017-09-28 12:55:11.980 12055 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:55:11 ctl02 nova-api[12055]: 2017-09-28 12:55:11.980 12055 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:55:11 ctl02 nova-api[12055]: 2017-09-28 12:55:11.980 12055 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:55:11 ctl02 nova-api[12055]: 2017-09-28 12:55:11.980 12055 ERROR nova.wsgi     self.filename))
Sep 28 12:55:11 ctl02 nova-api[12055]: 2017-09-28 12:55:11.980 12055 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:55:11 ctl02 nova-api[12055]: 2017-09-28 12:55:11.980 12055 ERROR nova.wsgi
Sep 28 12:55:11 ctl02 nova-api[12055]: 2017-09-28 12:55:11.983 12055 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:55:12 ctl02 nova-api[12055]: 2017-09-28 12:55:12.111 12055 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:55:12 ctl02 nova-api[12055]: 2017-09-28 12:55:12.335 12055 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:55:12 ctl02 nova-api[12055]: 2017-09-28 12:55:12.338 12055 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:55:12 ctl02 nova-api[12055]: 2017-09-28 12:55:12.338 12055 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:55:12 ctl02 nova-api[12055]: 2017-09-28 12:55:12.338 12055 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:55:12 ctl02 nova-api[12055]: 2017-09-28 12:55:12.468 12055 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:55:12 ctl02 nova-api[12055]: 2017-09-28 12:55:12.471 12055 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:55:12 ctl02 nova-api[12055]: 2017-09-28 12:55:12.471 12055 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:55:12 ctl02 nova-api[12055]: 2017-09-28 12:55:12.471 12055 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:55:12 ctl02 nova-api[12055]: 2017-09-28 12:55:12.475 12055 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:55:12 ctl02 nova-api[12055]: 2017-09-28 12:55:12.475 12055 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:55:12 ctl02 nova-api[12055]: 2017-09-28 12:55:12.475 12055 ERROR nova Traceback (most recent call last):
Sep 28 12:55:12 ctl02 nova-api[12055]: 2017-09-28 12:55:12.475 12055 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:55:12 ctl02 nova-api[12055]: 2017-09-28 12:55:12.475 12055 ERROR nova     sys.exit(main())
Sep 28 12:55:12 ctl02 nova-api[12055]: 2017-09-28 12:55:12.475 12055 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:55:12 ctl02 nova-api[12055]: 2017-09-28 12:55:12.475 12055 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:55:12 ctl02 nova-api[12055]: 2017-09-28 12:55:12.475 12055 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:55:12 ctl02 nova-api[12055]: 2017-09-28 12:55:12.475 12055 ERROR nova     max_url_len=max_url_len)
Sep 28 12:55:12 ctl02 nova-api[12055]: 2017-09-28 12:55:12.475 12055 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:55:12 ctl02 nova-api[12055]: 2017-09-28 12:55:12.475 12055 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:55:12 ctl02 nova-api[12055]: 2017-09-28 12:55:12.475 12055 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:55:12 ctl02 nova-api[12055]: 2017-09-28 12:55:12.475 12055 ERROR nova     sock.listen(backlog)
Sep 28 12:55:12 ctl02 nova-api[12055]: 2017-09-28 12:55:12.475 12055 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:55:12 ctl02 nova-api[12055]: 2017-09-28 12:55:12.475 12055 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:55:12 ctl02 nova-api[12055]: 2017-09-28 12:55:12.475 12055 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:55:12 ctl02 nova-api[12055]: 2017-09-28 12:55:12.475 12055 ERROR nova
Sep 28 12:55:12 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:55:12 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:55:12 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:55:12 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:55:12 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:55:12 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:55:12 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:55:13 ctl02 glance-api[29183]: 2017-09-28 12:55:13.116 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:55:13] "OPTIONS / HTTP/1.0" 200 134 0.000568
Sep 28 12:55:13 ctl02 heat-api[13008]: 2017-09-28 12:55:13.195 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:55:13] "OPTIONS / HTTP/1.0" 200 134 0.000526
Sep 28 12:55:13 ctl02 nova-consoleauth[5433]: 2017-09-28 12:55:13.325 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:55:13 ctl02 neutron-server[30536]: 2017-09-28 12:55:13.554 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:55:13 ctl02 neutron-server[30536]: 2017-09-28 12:55:13.966 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:55:13] "OPTIONS / HTTP/1.0" 200 262 0.000440
Sep 28 12:55:14 ctl02 neutron-server[30536]: 2017-09-28 12:55:14.112 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:55:14] "OPTIONS / HTTP/1.0" 200 262 0.000292
Sep 28 12:55:14 ctl02 heat-api[13008]: 2017-09-28 12:55:14.235 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:55:14] "OPTIONS / HTTP/1.0" 200 134 0.000521
Sep 28 12:55:14 ctl02 heat-engine[12803]: 2017-09-28 12:55:14.297 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:55:14 ctl02 heat-engine[12803]: 2017-09-28 12:55:14.310 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:55:14 ctl02 heat-engine[12803]: 2017-09-28 12:55:14.310 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:55:14 ctl02 heat-engine[12803]: 2017-09-28 12:55:14.312 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:55:14 ctl02 nova-api[12073]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:55:14 ctl02 nova-api[12073]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:55:14 ctl02 nova-api[12073]: 2017-09-28 12:55:14.734 12073 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:55:14 ctl02 nova-api[12073]: 2017-09-28 12:55:14.735 12073 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:55:14 ctl02 nova-api[12073]: 2017-09-28 12:55:14.735 12073 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:55:14 ctl02 nova-api[12073]: 2017-09-28 12:55:14.735 12073 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:55:14 ctl02 nova-api[12073]: 2017-09-28 12:55:14.735 12073 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:55:14 ctl02 nova-api[12073]: 2017-09-28 12:55:14.735 12073 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:55:14 ctl02 nova-api[12073]: 2017-09-28 12:55:14.735 12073 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:55:14 ctl02 nova-api[12073]: 2017-09-28 12:55:14.735 12073 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:55:14 ctl02 nova-api[12073]: 2017-09-28 12:55:14.735 12073 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:55:14 ctl02 nova-api[12073]: 2017-09-28 12:55:14.735 12073 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:55:14 ctl02 nova-api[12073]: 2017-09-28 12:55:14.735 12073 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:55:14 ctl02 nova-api[12073]: 2017-09-28 12:55:14.735 12073 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:55:14 ctl02 nova-api[12073]: 2017-09-28 12:55:14.735 12073 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:55:14 ctl02 nova-api[12073]: 2017-09-28 12:55:14.735 12073 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:55:14 ctl02 nova-api[12073]: 2017-09-28 12:55:14.735 12073 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:55:14 ctl02 nova-api[12073]: 2017-09-28 12:55:14.735 12073 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:55:14 ctl02 nova-api[12073]: 2017-09-28 12:55:14.735 12073 ERROR nova.wsgi     self.filename))
Sep 28 12:55:14 ctl02 nova-api[12073]: 2017-09-28 12:55:14.735 12073 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:55:14 ctl02 nova-api[12073]: 2017-09-28 12:55:14.735 12073 ERROR nova.wsgi
Sep 28 12:55:14 ctl02 nova-api[12073]: 2017-09-28 12:55:14.736 12073 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:55:14 ctl02 nova-api[12073]: 2017-09-28 12:55:14.864 12073 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:55:15 ctl02 nova-api[12073]: 2017-09-28 12:55:15.085 12073 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:55:15 ctl02 nova-api[12073]: 2017-09-28 12:55:15.087 12073 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:55:15 ctl02 nova-api[12073]: 2017-09-28 12:55:15.087 12073 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:55:15 ctl02 nova-api[12073]: 2017-09-28 12:55:15.088 12073 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:55:15 ctl02 nova-api[12073]: 2017-09-28 12:55:15.217 12073 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:55:15 ctl02 nova-api[12073]: 2017-09-28 12:55:15.219 12073 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:55:15 ctl02 nova-api[12073]: 2017-09-28 12:55:15.219 12073 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:55:15 ctl02 nova-api[12073]: 2017-09-28 12:55:15.220 12073 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:55:15 ctl02 nova-api[12073]: 2017-09-28 12:55:15.223 12073 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:55:15 ctl02 nova-api[12073]: 2017-09-28 12:55:15.223 12073 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:55:15 ctl02 nova-api[12073]: 2017-09-28 12:55:15.223 12073 ERROR nova Traceback (most recent call last):
Sep 28 12:55:15 ctl02 nova-api[12073]: 2017-09-28 12:55:15.223 12073 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:55:15 ctl02 nova-api[12073]: 2017-09-28 12:55:15.223 12073 ERROR nova     sys.exit(main())
Sep 28 12:55:15 ctl02 nova-api[12073]: 2017-09-28 12:55:15.223 12073 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:55:15 ctl02 nova-api[12073]: 2017-09-28 12:55:15.223 12073 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:55:15 ctl02 nova-api[12073]: 2017-09-28 12:55:15.223 12073 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:55:15 ctl02 nova-api[12073]: 2017-09-28 12:55:15.223 12073 ERROR nova     max_url_len=max_url_len)
Sep 28 12:55:15 ctl02 nova-api[12073]: 2017-09-28 12:55:15.223 12073 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:55:15 ctl02 nova-api[12073]: 2017-09-28 12:55:15.223 12073 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:55:15 ctl02 nova-api[12073]: 2017-09-28 12:55:15.223 12073 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:55:15 ctl02 nova-api[12073]: 2017-09-28 12:55:15.223 12073 ERROR nova     sock.listen(backlog)
Sep 28 12:55:15 ctl02 nova-api[12073]: 2017-09-28 12:55:15.223 12073 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:55:15 ctl02 nova-api[12073]: 2017-09-28 12:55:15.223 12073 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:55:15 ctl02 nova-api[12073]: 2017-09-28 12:55:15.223 12073 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:55:15 ctl02 nova-api[12073]: 2017-09-28 12:55:15.223 12073 ERROR nova
Sep 28 12:55:15 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:55:15 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:55:15 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:55:15 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:55:15 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:55:15 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:55:15 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:55:16 ctl02 heat-api-cfn[13300]: 2017-09-28 12:55:16.060 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:55:16] "OPTIONS / HTTP/1.0" 200 134 0.000627
Sep 28 12:55:16 ctl02 nova-scheduler[5620]: 2017-09-28 12:55:16.420 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:55:16 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa6c66703)
Sep 28 12:55:16 ctl02 heat-api-cfn[13300]: 2017-09-28 12:55:16.968 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:55:16] "OPTIONS / HTTP/1.0" 200 134 0.000538
Sep 28 12:55:17 ctl02 nova-api[12092]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:55:17 ctl02 nova-api[12092]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:55:17 ctl02 heat-api[13008]: 2017-09-28 12:55:17.453 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:55:17] "OPTIONS / HTTP/1.0" 200 134 0.000516
Sep 28 12:55:17 ctl02 nova-api[12092]: 2017-09-28 12:55:17.470 12092 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:55:17 ctl02 nova-api[12092]: 2017-09-28 12:55:17.472 12092 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:55:17 ctl02 nova-api[12092]: 2017-09-28 12:55:17.472 12092 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:55:17 ctl02 nova-api[12092]: 2017-09-28 12:55:17.472 12092 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:55:17 ctl02 nova-api[12092]: 2017-09-28 12:55:17.472 12092 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:55:17 ctl02 nova-api[12092]: 2017-09-28 12:55:17.472 12092 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:55:17 ctl02 nova-api[12092]: 2017-09-28 12:55:17.472 12092 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:55:17 ctl02 nova-api[12092]: 2017-09-28 12:55:17.472 12092 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:55:17 ctl02 nova-api[12092]: 2017-09-28 12:55:17.472 12092 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:55:17 ctl02 nova-api[12092]: 2017-09-28 12:55:17.472 12092 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:55:17 ctl02 nova-api[12092]: 2017-09-28 12:55:17.472 12092 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:55:17 ctl02 nova-api[12092]: 2017-09-28 12:55:17.472 12092 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:55:17 ctl02 nova-api[12092]: 2017-09-28 12:55:17.472 12092 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:55:17 ctl02 nova-api[12092]: 2017-09-28 12:55:17.472 12092 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:55:17 ctl02 nova-api[12092]: 2017-09-28 12:55:17.472 12092 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:55:17 ctl02 nova-api[12092]: 2017-09-28 12:55:17.472 12092 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:55:17 ctl02 nova-api[12092]: 2017-09-28 12:55:17.472 12092 ERROR nova.wsgi     self.filename))
Sep 28 12:55:17 ctl02 nova-api[12092]: 2017-09-28 12:55:17.472 12092 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:55:17 ctl02 nova-api[12092]: 2017-09-28 12:55:17.472 12092 ERROR nova.wsgi
Sep 28 12:55:17 ctl02 nova-api[12092]: 2017-09-28 12:55:17.473 12092 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:55:17 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:55:17.565 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:55:17] "OPTIONS / HTTP/1.0" 200 134 0.000351
Sep 28 12:55:17 ctl02 nova-api[12092]: 2017-09-28 12:55:17.604 12092 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:55:17 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa6c66703)
Sep 28 12:55:17 ctl02 nova-api[12092]: 2017-09-28 12:55:17.859 12092 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:55:17 ctl02 nova-api[12092]: 2017-09-28 12:55:17.862 12092 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:55:17 ctl02 nova-api[12092]: 2017-09-28 12:55:17.862 12092 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:55:17 ctl02 nova-api[12092]: 2017-09-28 12:55:17.862 12092 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:55:17 ctl02 nova-api[12092]: 2017-09-28 12:55:17.997 12092 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:55:17 ctl02 nova-api[12092]: 2017-09-28 12:55:17.999 12092 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:55:17 ctl02 nova-api[12092]: 2017-09-28 12:55:17.999 12092 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:55:17 ctl02 nova-api[12092]: 2017-09-28 12:55:17.999 12092 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:55:18 ctl02 nova-api[12092]: 2017-09-28 12:55:18.002 12092 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:55:18 ctl02 nova-api[12092]: 2017-09-28 12:55:18.003 12092 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:55:18 ctl02 nova-api[12092]: 2017-09-28 12:55:18.003 12092 ERROR nova Traceback (most recent call last):
Sep 28 12:55:18 ctl02 nova-api[12092]: 2017-09-28 12:55:18.003 12092 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:55:18 ctl02 nova-api[12092]: 2017-09-28 12:55:18.003 12092 ERROR nova     sys.exit(main())
Sep 28 12:55:18 ctl02 nova-api[12092]: 2017-09-28 12:55:18.003 12092 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:55:18 ctl02 nova-api[12092]: 2017-09-28 12:55:18.003 12092 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:55:18 ctl02 nova-api[12092]: 2017-09-28 12:55:18.003 12092 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:55:18 ctl02 nova-api[12092]: 2017-09-28 12:55:18.003 12092 ERROR nova     max_url_len=max_url_len)
Sep 28 12:55:18 ctl02 nova-api[12092]: 2017-09-28 12:55:18.003 12092 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:55:18 ctl02 nova-api[12092]: 2017-09-28 12:55:18.003 12092 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:55:18 ctl02 nova-api[12092]: 2017-09-28 12:55:18.003 12092 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:55:18 ctl02 nova-api[12092]: 2017-09-28 12:55:18.003 12092 ERROR nova     sock.listen(backlog)
Sep 28 12:55:18 ctl02 nova-api[12092]: 2017-09-28 12:55:18.003 12092 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:55:18 ctl02 nova-api[12092]: 2017-09-28 12:55:18.003 12092 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:55:18 ctl02 nova-api[12092]: 2017-09-28 12:55:18.003 12092 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:55:18 ctl02 nova-api[12092]: 2017-09-28 12:55:18.003 12092 ERROR nova
Sep 28 12:55:18 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:55:18.141 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:55:18] "OPTIONS / HTTP/1.0" 200 134 0.000272
Sep 28 12:55:18 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:55:18 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:55:18 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:55:18 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:55:18 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:55:18 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:55:18 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:55:18 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:55:18.684 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:55:18] "OPTIONS / HTTP/1.0" 200 134 0.000582
Sep 28 12:55:18 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa6c66703)
Sep 28 12:55:19 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa6c66703)
Sep 28 12:55:20 ctl02 nova-api[12109]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:55:20 ctl02 nova-api[12109]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:55:20 ctl02 nova-api[12109]: 2017-09-28 12:55:20.220 12109 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:55:20 ctl02 nova-api[12109]: 2017-09-28 12:55:20.221 12109 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:55:20 ctl02 nova-api[12109]: 2017-09-28 12:55:20.221 12109 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:55:20 ctl02 nova-api[12109]: 2017-09-28 12:55:20.221 12109 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:55:20 ctl02 nova-api[12109]: 2017-09-28 12:55:20.221 12109 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:55:20 ctl02 nova-api[12109]: 2017-09-28 12:55:20.221 12109 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:55:20 ctl02 nova-api[12109]: 2017-09-28 12:55:20.221 12109 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:55:20 ctl02 nova-api[12109]: 2017-09-28 12:55:20.221 12109 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:55:20 ctl02 nova-api[12109]: 2017-09-28 12:55:20.221 12109 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:55:20 ctl02 nova-api[12109]: 2017-09-28 12:55:20.221 12109 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:55:20 ctl02 nova-api[12109]: 2017-09-28 12:55:20.221 12109 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:55:20 ctl02 nova-api[12109]: 2017-09-28 12:55:20.221 12109 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:55:20 ctl02 nova-api[12109]: 2017-09-28 12:55:20.221 12109 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:55:20 ctl02 nova-api[12109]: 2017-09-28 12:55:20.221 12109 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:55:20 ctl02 nova-api[12109]: 2017-09-28 12:55:20.221 12109 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:55:20 ctl02 nova-api[12109]: 2017-09-28 12:55:20.221 12109 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:55:20 ctl02 nova-api[12109]: 2017-09-28 12:55:20.221 12109 ERROR nova.wsgi     self.filename))
Sep 28 12:55:20 ctl02 nova-api[12109]: 2017-09-28 12:55:20.221 12109 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:55:20 ctl02 nova-api[12109]: 2017-09-28 12:55:20.221 12109 ERROR nova.wsgi
Sep 28 12:55:20 ctl02 nova-api[12109]: 2017-09-28 12:55:20.222 12109 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:55:20 ctl02 nova-api[12109]: 2017-09-28 12:55:20.348 12109 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:55:20 ctl02 glance-api[29183]: 2017-09-28 12:55:20.471 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:55:20] "OPTIONS / HTTP/1.0" 200 134 0.000573
Sep 28 12:55:20 ctl02 nova-api[12109]: 2017-09-28 12:55:20.570 12109 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:55:20 ctl02 nova-api[12109]: 2017-09-28 12:55:20.572 12109 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:55:20 ctl02 nova-api[12109]: 2017-09-28 12:55:20.572 12109 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:55:20 ctl02 nova-api[12109]: 2017-09-28 12:55:20.572 12109 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:55:20 ctl02 nova-api[12109]: 2017-09-28 12:55:20.700 12109 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:55:20 ctl02 nova-api[12109]: 2017-09-28 12:55:20.702 12109 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:55:20 ctl02 nova-api[12109]: 2017-09-28 12:55:20.702 12109 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:55:20 ctl02 nova-api[12109]: 2017-09-28 12:55:20.702 12109 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:55:20 ctl02 nova-api[12109]: 2017-09-28 12:55:20.705 12109 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:55:20 ctl02 nova-api[12109]: 2017-09-28 12:55:20.706 12109 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:55:20 ctl02 nova-api[12109]: 2017-09-28 12:55:20.706 12109 ERROR nova Traceback (most recent call last):
Sep 28 12:55:20 ctl02 nova-api[12109]: 2017-09-28 12:55:20.706 12109 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:55:20 ctl02 nova-api[12109]: 2017-09-28 12:55:20.706 12109 ERROR nova     sys.exit(main())
Sep 28 12:55:20 ctl02 nova-api[12109]: 2017-09-28 12:55:20.706 12109 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:55:20 ctl02 nova-api[12109]: 2017-09-28 12:55:20.706 12109 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:55:20 ctl02 nova-api[12109]: 2017-09-28 12:55:20.706 12109 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:55:20 ctl02 nova-api[12109]: 2017-09-28 12:55:20.706 12109 ERROR nova     max_url_len=max_url_len)
Sep 28 12:55:20 ctl02 nova-api[12109]: 2017-09-28 12:55:20.706 12109 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:55:20 ctl02 nova-api[12109]: 2017-09-28 12:55:20.706 12109 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:55:20 ctl02 nova-api[12109]: 2017-09-28 12:55:20.706 12109 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:55:20 ctl02 nova-api[12109]: 2017-09-28 12:55:20.706 12109 ERROR nova     sock.listen(backlog)
Sep 28 12:55:20 ctl02 nova-api[12109]: 2017-09-28 12:55:20.706 12109 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:55:20 ctl02 nova-api[12109]: 2017-09-28 12:55:20.706 12109 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:55:20 ctl02 nova-api[12109]: 2017-09-28 12:55:20.706 12109 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:55:20 ctl02 nova-api[12109]: 2017-09-28 12:55:20.706 12109 ERROR nova
Sep 28 12:55:20 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa6c66703)
Sep 28 12:55:20 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:55:20 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:55:20 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:55:20 ctl02 heat-api-cfn[13300]: 2017-09-28 12:55:20.938 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:55:20] "OPTIONS / HTTP/1.0" 200 134 0.000564
Sep 28 12:55:20 ctl02 glance-api[29183]: 2017-09-28 12:55:20.946 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:55:20] "OPTIONS / HTTP/1.0" 200 134 0.000716
Sep 28 12:55:20 ctl02 neutron-server[30536]: 2017-09-28 12:55:20.970 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:55:20] "OPTIONS / HTTP/1.0" 200 262 0.000585
Sep 28 12:55:21 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:55:21 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:55:21 ctl02 neutron-server[30536]: 2017-09-28 12:55:21.128 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 12:55:21 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:55:21 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:53:38 cmp001
Sep 28 12:55:21 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:54:00 cmp002
Sep 28 12:55:21 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:54:26 cmp002
Sep 28 12:55:21 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:55:21 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:55:21 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa6c66703)
Sep 28 12:55:22 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa6c66703)
Sep 28 12:55:22 ctl02 nova-api[12128]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:55:22 ctl02 nova-api[12128]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:55:23 ctl02 nova-api[12128]: 2017-09-28 12:55:23.040 12128 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:55:23 ctl02 nova-api[12128]: 2017-09-28 12:55:23.042 12128 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:55:23 ctl02 nova-api[12128]: 2017-09-28 12:55:23.042 12128 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:55:23 ctl02 nova-api[12128]: 2017-09-28 12:55:23.042 12128 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:55:23 ctl02 nova-api[12128]: 2017-09-28 12:55:23.042 12128 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:55:23 ctl02 nova-api[12128]: 2017-09-28 12:55:23.042 12128 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:55:23 ctl02 nova-api[12128]: 2017-09-28 12:55:23.042 12128 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:55:23 ctl02 nova-api[12128]: 2017-09-28 12:55:23.042 12128 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:55:23 ctl02 nova-api[12128]: 2017-09-28 12:55:23.042 12128 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:55:23 ctl02 nova-api[12128]: 2017-09-28 12:55:23.042 12128 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:55:23 ctl02 nova-api[12128]: 2017-09-28 12:55:23.042 12128 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:55:23 ctl02 nova-api[12128]: 2017-09-28 12:55:23.042 12128 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:55:23 ctl02 nova-api[12128]: 2017-09-28 12:55:23.042 12128 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:55:23 ctl02 nova-api[12128]: 2017-09-28 12:55:23.042 12128 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:55:23 ctl02 nova-api[12128]: 2017-09-28 12:55:23.042 12128 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:55:23 ctl02 nova-api[12128]: 2017-09-28 12:55:23.042 12128 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:55:23 ctl02 nova-api[12128]: 2017-09-28 12:55:23.042 12128 ERROR nova.wsgi     self.filename))
Sep 28 12:55:23 ctl02 nova-api[12128]: 2017-09-28 12:55:23.042 12128 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:55:23 ctl02 nova-api[12128]: 2017-09-28 12:55:23.042 12128 ERROR nova.wsgi
Sep 28 12:55:23 ctl02 nova-api[12128]: 2017-09-28 12:55:23.043 12128 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:55:23 ctl02 glance-api[29183]: 2017-09-28 12:55:23.099 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:55:23] "OPTIONS / HTTP/1.0" 200 134 0.000682
Sep 28 12:55:23 ctl02 nova-api[12128]: 2017-09-28 12:55:23.175 12128 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:55:23 ctl02 nova-api[12128]: 2017-09-28 12:55:23.424 12128 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:55:23 ctl02 nova-api[12128]: 2017-09-28 12:55:23.426 12128 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:55:23 ctl02 nova-api[12128]: 2017-09-28 12:55:23.426 12128 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:55:23 ctl02 nova-api[12128]: 2017-09-28 12:55:23.427 12128 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:55:23 ctl02 heat-api[13008]: 2017-09-28 12:55:23.525 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:55:23] "OPTIONS / HTTP/1.0" 200 134 0.000626
Sep 28 12:55:23 ctl02 nova-api[12128]: 2017-09-28 12:55:23.563 12128 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:55:23 ctl02 nova-api[12128]: 2017-09-28 12:55:23.565 12128 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:55:23 ctl02 nova-api[12128]: 2017-09-28 12:55:23.565 12128 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:55:23 ctl02 nova-api[12128]: 2017-09-28 12:55:23.565 12128 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:55:23 ctl02 nova-api[12128]: 2017-09-28 12:55:23.569 12128 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:55:23 ctl02 nova-api[12128]: 2017-09-28 12:55:23.569 12128 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:55:23 ctl02 nova-api[12128]: 2017-09-28 12:55:23.569 12128 ERROR nova Traceback (most recent call last):
Sep 28 12:55:23 ctl02 nova-api[12128]: 2017-09-28 12:55:23.569 12128 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:55:23 ctl02 nova-api[12128]: 2017-09-28 12:55:23.569 12128 ERROR nova     sys.exit(main())
Sep 28 12:55:23 ctl02 nova-api[12128]: 2017-09-28 12:55:23.569 12128 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:55:23 ctl02 nova-api[12128]: 2017-09-28 12:55:23.569 12128 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:55:23 ctl02 nova-api[12128]: 2017-09-28 12:55:23.569 12128 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:55:23 ctl02 nova-api[12128]: 2017-09-28 12:55:23.569 12128 ERROR nova     max_url_len=max_url_len)
Sep 28 12:55:23 ctl02 nova-api[12128]: 2017-09-28 12:55:23.569 12128 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:55:23 ctl02 nova-api[12128]: 2017-09-28 12:55:23.569 12128 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:55:23 ctl02 nova-api[12128]: 2017-09-28 12:55:23.569 12128 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:55:23 ctl02 nova-api[12128]: 2017-09-28 12:55:23.569 12128 ERROR nova     sock.listen(backlog)
Sep 28 12:55:23 ctl02 nova-api[12128]: 2017-09-28 12:55:23.569 12128 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:55:23 ctl02 nova-api[12128]: 2017-09-28 12:55:23.569 12128 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:55:23 ctl02 nova-api[12128]: 2017-09-28 12:55:23.569 12128 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:55:23 ctl02 nova-api[12128]: 2017-09-28 12:55:23.569 12128 ERROR nova
Sep 28 12:55:23 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:55:23 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:55:23 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:55:23 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa6c66703)
Sep 28 12:55:23 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:55:23 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:55:23 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:55:23 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:55:24 ctl02 neutron-server[30536]: 2017-09-28 12:55:24.151 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:55:24] "OPTIONS / HTTP/1.0" 200 262 0.000548
Sep 28 12:55:24 ctl02 heat-api[13008]: 2017-09-28 12:55:24.319 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:55:24] "OPTIONS / HTTP/1.0" 200 134 0.000617
Sep 28 12:55:24 ctl02 neutron-server[30536]: 2017-09-28 12:55:24.462 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:55:24] "OPTIONS / HTTP/1.0" 200 262 0.000530
Sep 28 12:55:24 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa6c66703)
Sep 28 12:55:25 ctl02 nova-api[12146]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:55:25 ctl02 nova-api[12146]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:55:25 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa6c66703)
Sep 28 12:55:25 ctl02 nova-api[12146]: 2017-09-28 12:55:25.804 12146 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:55:25 ctl02 nova-api[12146]: 2017-09-28 12:55:25.806 12146 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:55:25 ctl02 nova-api[12146]: 2017-09-28 12:55:25.806 12146 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:55:25 ctl02 nova-api[12146]: 2017-09-28 12:55:25.806 12146 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:55:25 ctl02 nova-api[12146]: 2017-09-28 12:55:25.806 12146 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:55:25 ctl02 nova-api[12146]: 2017-09-28 12:55:25.806 12146 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:55:25 ctl02 nova-api[12146]: 2017-09-28 12:55:25.806 12146 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:55:25 ctl02 nova-api[12146]: 2017-09-28 12:55:25.806 12146 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:55:25 ctl02 nova-api[12146]: 2017-09-28 12:55:25.806 12146 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:55:25 ctl02 nova-api[12146]: 2017-09-28 12:55:25.806 12146 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:55:25 ctl02 nova-api[12146]: 2017-09-28 12:55:25.806 12146 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:55:25 ctl02 nova-api[12146]: 2017-09-28 12:55:25.806 12146 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:55:25 ctl02 nova-api[12146]: 2017-09-28 12:55:25.806 12146 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:55:25 ctl02 nova-api[12146]: 2017-09-28 12:55:25.806 12146 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:55:25 ctl02 nova-api[12146]: 2017-09-28 12:55:25.806 12146 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:55:25 ctl02 nova-api[12146]: 2017-09-28 12:55:25.806 12146 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:55:25 ctl02 nova-api[12146]: 2017-09-28 12:55:25.806 12146 ERROR nova.wsgi     self.filename))
Sep 28 12:55:25 ctl02 nova-api[12146]: 2017-09-28 12:55:25.806 12146 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:55:25 ctl02 nova-api[12146]: 2017-09-28 12:55:25.806 12146 ERROR nova.wsgi
Sep 28 12:55:25 ctl02 nova-api[12146]: 2017-09-28 12:55:25.807 12146 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:55:25 ctl02 nova-api[12146]: 2017-09-28 12:55:25.941 12146 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:55:26 ctl02 heat-api-cfn[13300]: 2017-09-28 12:55:26.034 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:55:26] "OPTIONS / HTTP/1.0" 200 134 0.000488
Sep 28 12:55:26 ctl02 nova-api[12146]: 2017-09-28 12:55:26.196 12146 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:55:26 ctl02 nova-api[12146]: 2017-09-28 12:55:26.198 12146 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:55:26 ctl02 nova-api[12146]: 2017-09-28 12:55:26.199 12146 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:55:26 ctl02 nova-api[12146]: 2017-09-28 12:55:26.199 12146 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:55:26 ctl02 nova-api[12146]: 2017-09-28 12:55:26.336 12146 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:55:26 ctl02 nova-api[12146]: 2017-09-28 12:55:26.338 12146 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:55:26 ctl02 nova-api[12146]: 2017-09-28 12:55:26.338 12146 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:55:26 ctl02 nova-api[12146]: 2017-09-28 12:55:26.339 12146 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:55:26 ctl02 nova-api[12146]: 2017-09-28 12:55:26.342 12146 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:55:26 ctl02 nova-api[12146]: 2017-09-28 12:55:26.342 12146 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:55:26 ctl02 nova-api[12146]: 2017-09-28 12:55:26.342 12146 ERROR nova Traceback (most recent call last):
Sep 28 12:55:26 ctl02 nova-api[12146]: 2017-09-28 12:55:26.342 12146 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:55:26 ctl02 nova-api[12146]: 2017-09-28 12:55:26.342 12146 ERROR nova     sys.exit(main())
Sep 28 12:55:26 ctl02 nova-api[12146]: 2017-09-28 12:55:26.342 12146 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:55:26 ctl02 nova-api[12146]: 2017-09-28 12:55:26.342 12146 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:55:26 ctl02 nova-api[12146]: 2017-09-28 12:55:26.342 12146 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:55:26 ctl02 nova-api[12146]: 2017-09-28 12:55:26.342 12146 ERROR nova     max_url_len=max_url_len)
Sep 28 12:55:26 ctl02 nova-api[12146]: 2017-09-28 12:55:26.342 12146 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:55:26 ctl02 nova-api[12146]: 2017-09-28 12:55:26.342 12146 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:55:26 ctl02 nova-api[12146]: 2017-09-28 12:55:26.342 12146 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:55:26 ctl02 nova-api[12146]: 2017-09-28 12:55:26.342 12146 ERROR nova     sock.listen(backlog)
Sep 28 12:55:26 ctl02 nova-api[12146]: 2017-09-28 12:55:26.342 12146 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:55:26 ctl02 nova-api[12146]: 2017-09-28 12:55:26.342 12146 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:55:26 ctl02 nova-api[12146]: 2017-09-28 12:55:26.342 12146 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:55:26 ctl02 nova-api[12146]: 2017-09-28 12:55:26.342 12146 ERROR nova
Sep 28 12:55:26 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:55:26 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:55:26 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:55:26 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:55:26 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:55:26 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:55:26 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:55:26 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa6c66703)
Sep 28 12:55:26 ctl02 heat-api-cfn[13300]: 2017-09-28 12:55:26.851 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:55:26] "OPTIONS / HTTP/1.0" 200 134 0.000418
Sep 28 12:55:27 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:55:27.575 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:55:27] "OPTIONS / HTTP/1.0" 200 134 0.000492
Sep 28 12:55:27 ctl02 heat-api[13008]: 2017-09-28 12:55:27.710 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:55:27] "OPTIONS / HTTP/1.0" 200 134 0.000691
Sep 28 12:55:27 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:55:27 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:55:27 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:55:27.975 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:55:27] "OPTIONS / HTTP/1.0" 200 134 0.000373
Sep 28 12:55:28 ctl02 nova-api[12164]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:55:28 ctl02 nova-api[12164]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:55:28 ctl02 nova-api[12164]: 2017-09-28 12:55:28.510 12164 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:55:28 ctl02 nova-api[12164]: 2017-09-28 12:55:28.512 12164 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:55:28 ctl02 nova-api[12164]: 2017-09-28 12:55:28.512 12164 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:55:28 ctl02 nova-api[12164]: 2017-09-28 12:55:28.512 12164 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:55:28 ctl02 nova-api[12164]: 2017-09-28 12:55:28.512 12164 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:55:28 ctl02 nova-api[12164]: 2017-09-28 12:55:28.512 12164 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:55:28 ctl02 nova-api[12164]: 2017-09-28 12:55:28.512 12164 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:55:28 ctl02 nova-api[12164]: 2017-09-28 12:55:28.512 12164 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:55:28 ctl02 nova-api[12164]: 2017-09-28 12:55:28.512 12164 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:55:28 ctl02 nova-api[12164]: 2017-09-28 12:55:28.512 12164 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:55:28 ctl02 nova-api[12164]: 2017-09-28 12:55:28.512 12164 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:55:28 ctl02 nova-api[12164]: 2017-09-28 12:55:28.512 12164 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:55:28 ctl02 nova-api[12164]: 2017-09-28 12:55:28.512 12164 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:55:28 ctl02 nova-api[12164]: 2017-09-28 12:55:28.512 12164 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:55:28 ctl02 nova-api[12164]: 2017-09-28 12:55:28.512 12164 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:55:28 ctl02 nova-api[12164]: 2017-09-28 12:55:28.512 12164 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:55:28 ctl02 nova-api[12164]: 2017-09-28 12:55:28.512 12164 ERROR nova.wsgi     self.filename))
Sep 28 12:55:28 ctl02 nova-api[12164]: 2017-09-28 12:55:28.512 12164 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:55:28 ctl02 nova-api[12164]: 2017-09-28 12:55:28.512 12164 ERROR nova.wsgi
Sep 28 12:55:28 ctl02 nova-api[12164]: 2017-09-28 12:55:28.513 12164 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:55:28 ctl02 neutron-server[30536]: 2017-09-28 12:55:28.557 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:55:28 ctl02 nova-api[12164]: 2017-09-28 12:55:28.654 12164 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:55:28 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:55:28.855 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:55:28] "OPTIONS / HTTP/1.0" 200 134 0.000416
Sep 28 12:55:28 ctl02 nova-api[12164]: 2017-09-28 12:55:28.899 12164 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:55:28 ctl02 nova-api[12164]: 2017-09-28 12:55:28.901 12164 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:55:28 ctl02 nova-api[12164]: 2017-09-28 12:55:28.901 12164 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:55:28 ctl02 nova-api[12164]: 2017-09-28 12:55:28.902 12164 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:55:29 ctl02 nova-api[12164]: 2017-09-28 12:55:29.034 12164 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:55:29 ctl02 nova-api[12164]: 2017-09-28 12:55:29.036 12164 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:55:29 ctl02 nova-api[12164]: 2017-09-28 12:55:29.037 12164 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:55:29 ctl02 nova-api[12164]: 2017-09-28 12:55:29.037 12164 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:55:29 ctl02 nova-api[12164]: 2017-09-28 12:55:29.040 12164 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:55:29 ctl02 nova-api[12164]: 2017-09-28 12:55:29.040 12164 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:55:29 ctl02 nova-api[12164]: 2017-09-28 12:55:29.040 12164 ERROR nova Traceback (most recent call last):
Sep 28 12:55:29 ctl02 nova-api[12164]: 2017-09-28 12:55:29.040 12164 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:55:29 ctl02 nova-api[12164]: 2017-09-28 12:55:29.040 12164 ERROR nova     sys.exit(main())
Sep 28 12:55:29 ctl02 nova-api[12164]: 2017-09-28 12:55:29.040 12164 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:55:29 ctl02 nova-api[12164]: 2017-09-28 12:55:29.040 12164 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:55:29 ctl02 nova-api[12164]: 2017-09-28 12:55:29.040 12164 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:55:29 ctl02 nova-api[12164]: 2017-09-28 12:55:29.040 12164 ERROR nova     max_url_len=max_url_len)
Sep 28 12:55:29 ctl02 nova-api[12164]: 2017-09-28 12:55:29.040 12164 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:55:29 ctl02 nova-api[12164]: 2017-09-28 12:55:29.040 12164 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:55:29 ctl02 nova-api[12164]: 2017-09-28 12:55:29.040 12164 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:55:29 ctl02 nova-api[12164]: 2017-09-28 12:55:29.040 12164 ERROR nova     sock.listen(backlog)
Sep 28 12:55:29 ctl02 nova-api[12164]: 2017-09-28 12:55:29.040 12164 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:55:29 ctl02 nova-api[12164]: 2017-09-28 12:55:29.040 12164 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:55:29 ctl02 nova-api[12164]: 2017-09-28 12:55:29.040 12164 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:55:29 ctl02 nova-api[12164]: 2017-09-28 12:55:29.040 12164 ERROR nova
Sep 28 12:55:29 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:55:29 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:55:29 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:55:29 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:55:29 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:55:29 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:55:29 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:55:30 ctl02 glance-api[29183]: 2017-09-28 12:55:30.495 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:55:30] "OPTIONS / HTTP/1.0" 200 134 0.000540
Sep 28 12:55:30 ctl02 heat-api-cfn[13300]: 2017-09-28 12:55:30.599 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:55:30] "OPTIONS / HTTP/1.0" 200 134 0.000563
Sep 28 12:55:30 ctl02 glance-api[29183]: 2017-09-28 12:55:30.772 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:55:30] "OPTIONS / HTTP/1.0" 200 134 0.000389
Sep 28 12:55:31 ctl02 nova-api[12187]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:55:31 ctl02 nova-api[12187]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:55:31 ctl02 neutron-server[30536]: 2017-09-28 12:55:31.148 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:55:31] "OPTIONS / HTTP/1.0" 200 262 0.000538
Sep 28 12:55:31 ctl02 nova-api[12187]: 2017-09-28 12:55:31.279 12187 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:55:31 ctl02 nova-api[12187]: 2017-09-28 12:55:31.281 12187 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:55:31 ctl02 nova-api[12187]: 2017-09-28 12:55:31.281 12187 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:55:31 ctl02 nova-api[12187]: 2017-09-28 12:55:31.281 12187 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:55:31 ctl02 nova-api[12187]: 2017-09-28 12:55:31.281 12187 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:55:31 ctl02 nova-api[12187]: 2017-09-28 12:55:31.281 12187 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:55:31 ctl02 nova-api[12187]: 2017-09-28 12:55:31.281 12187 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:55:31 ctl02 nova-api[12187]: 2017-09-28 12:55:31.281 12187 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:55:31 ctl02 nova-api[12187]: 2017-09-28 12:55:31.281 12187 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:55:31 ctl02 nova-api[12187]: 2017-09-28 12:55:31.281 12187 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:55:31 ctl02 nova-api[12187]: 2017-09-28 12:55:31.281 12187 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:55:31 ctl02 nova-api[12187]: 2017-09-28 12:55:31.281 12187 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:55:31 ctl02 nova-api[12187]: 2017-09-28 12:55:31.281 12187 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:55:31 ctl02 nova-api[12187]: 2017-09-28 12:55:31.281 12187 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:55:31 ctl02 nova-api[12187]: 2017-09-28 12:55:31.281 12187 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:55:31 ctl02 nova-api[12187]: 2017-09-28 12:55:31.281 12187 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:55:31 ctl02 nova-api[12187]: 2017-09-28 12:55:31.281 12187 ERROR nova.wsgi     self.filename))
Sep 28 12:55:31 ctl02 nova-api[12187]: 2017-09-28 12:55:31.281 12187 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:55:31 ctl02 nova-api[12187]: 2017-09-28 12:55:31.281 12187 ERROR nova.wsgi
Sep 28 12:55:31 ctl02 nova-api[12187]: 2017-09-28 12:55:31.282 12187 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:55:31 ctl02 nova-api[12187]: 2017-09-28 12:55:31.416 12187 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:55:31 ctl02 nova-api[12187]: 2017-09-28 12:55:31.672 12187 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:55:31 ctl02 nova-api[12187]: 2017-09-28 12:55:31.674 12187 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:55:31 ctl02 nova-api[12187]: 2017-09-28 12:55:31.675 12187 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:55:31 ctl02 nova-api[12187]: 2017-09-28 12:55:31.675 12187 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:55:31 ctl02 nova-api[12187]: 2017-09-28 12:55:31.811 12187 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:55:31 ctl02 nova-api[12187]: 2017-09-28 12:55:31.813 12187 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:55:31 ctl02 nova-api[12187]: 2017-09-28 12:55:31.814 12187 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:55:31 ctl02 nova-api[12187]: 2017-09-28 12:55:31.814 12187 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:55:31 ctl02 nova-api[12187]: 2017-09-28 12:55:31.818 12187 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:55:31 ctl02 nova-api[12187]: 2017-09-28 12:55:31.818 12187 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:55:31 ctl02 nova-api[12187]: 2017-09-28 12:55:31.818 12187 ERROR nova Traceback (most recent call last):
Sep 28 12:55:31 ctl02 nova-api[12187]: 2017-09-28 12:55:31.818 12187 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:55:31 ctl02 nova-api[12187]: 2017-09-28 12:55:31.818 12187 ERROR nova     sys.exit(main())
Sep 28 12:55:31 ctl02 nova-api[12187]: 2017-09-28 12:55:31.818 12187 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:55:31 ctl02 nova-api[12187]: 2017-09-28 12:55:31.818 12187 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:55:31 ctl02 nova-api[12187]: 2017-09-28 12:55:31.818 12187 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:55:31 ctl02 nova-api[12187]: 2017-09-28 12:55:31.818 12187 ERROR nova     max_url_len=max_url_len)
Sep 28 12:55:31 ctl02 nova-api[12187]: 2017-09-28 12:55:31.818 12187 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:55:31 ctl02 nova-api[12187]: 2017-09-28 12:55:31.818 12187 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:55:31 ctl02 nova-api[12187]: 2017-09-28 12:55:31.818 12187 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:55:31 ctl02 nova-api[12187]: 2017-09-28 12:55:31.818 12187 ERROR nova     sock.listen(backlog)
Sep 28 12:55:31 ctl02 nova-api[12187]: 2017-09-28 12:55:31.818 12187 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:55:31 ctl02 nova-api[12187]: 2017-09-28 12:55:31.818 12187 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:55:31 ctl02 nova-api[12187]: 2017-09-28 12:55:31.818 12187 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:55:31 ctl02 nova-api[12187]: 2017-09-28 12:55:31.818 12187 ERROR nova
Sep 28 12:55:31 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:55:31 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:55:31 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:55:32 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:55:32 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:55:32 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:55:32 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:55:32 ctl02 glance-api[29183]: 2017-09-28 12:55:32.960 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:55:32] "OPTIONS / HTTP/1.0" 200 134 0.000504
Sep 28 12:55:33 ctl02 heat-api[13008]: 2017-09-28 12:55:33.659 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:55:33] "OPTIONS / HTTP/1.0" 200 134 0.000678
Sep 28 12:55:33 ctl02 nova-api[12205]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:55:33 ctl02 nova-api[12205]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:55:33 ctl02 nova-api[12205]: 2017-09-28 12:55:33.984 12205 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:55:33 ctl02 nova-api[12205]: 2017-09-28 12:55:33.986 12205 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:55:33 ctl02 nova-api[12205]: 2017-09-28 12:55:33.986 12205 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:55:33 ctl02 nova-api[12205]: 2017-09-28 12:55:33.986 12205 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:55:33 ctl02 nova-api[12205]: 2017-09-28 12:55:33.986 12205 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:55:33 ctl02 nova-api[12205]: 2017-09-28 12:55:33.986 12205 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:55:33 ctl02 nova-api[12205]: 2017-09-28 12:55:33.986 12205 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:55:33 ctl02 nova-api[12205]: 2017-09-28 12:55:33.986 12205 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:55:33 ctl02 nova-api[12205]: 2017-09-28 12:55:33.986 12205 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:55:33 ctl02 nova-api[12205]: 2017-09-28 12:55:33.986 12205 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:55:33 ctl02 nova-api[12205]: 2017-09-28 12:55:33.986 12205 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:55:33 ctl02 nova-api[12205]: 2017-09-28 12:55:33.986 12205 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:55:33 ctl02 nova-api[12205]: 2017-09-28 12:55:33.986 12205 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:55:33 ctl02 nova-api[12205]: 2017-09-28 12:55:33.986 12205 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:55:33 ctl02 nova-api[12205]: 2017-09-28 12:55:33.986 12205 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:55:33 ctl02 nova-api[12205]: 2017-09-28 12:55:33.986 12205 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:55:33 ctl02 nova-api[12205]: 2017-09-28 12:55:33.986 12205 ERROR nova.wsgi     self.filename))
Sep 28 12:55:33 ctl02 nova-api[12205]: 2017-09-28 12:55:33.986 12205 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:55:33 ctl02 nova-api[12205]: 2017-09-28 12:55:33.986 12205 ERROR nova.wsgi
Sep 28 12:55:33 ctl02 nova-api[12205]: 2017-09-28 12:55:33.988 12205 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:55:34 ctl02 nova-api[12205]: 2017-09-28 12:55:34.120 12205 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:55:34 ctl02 neutron-server[30536]: 2017-09-28 12:55:34.153 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:55:34] "OPTIONS / HTTP/1.0" 200 262 0.000508
Sep 28 12:55:34 ctl02 neutron-server[30536]: 2017-09-28 12:55:34.215 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:55:34] "OPTIONS / HTTP/1.0" 200 262 0.000472
Sep 28 12:55:34 ctl02 heat-api[13008]: 2017-09-28 12:55:34.344 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:55:34] "OPTIONS / HTTP/1.0" 200 134 0.000647
Sep 28 12:55:34 ctl02 nova-api[12205]: 2017-09-28 12:55:34.375 12205 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:55:34 ctl02 nova-api[12205]: 2017-09-28 12:55:34.377 12205 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:55:34 ctl02 nova-api[12205]: 2017-09-28 12:55:34.377 12205 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:55:34 ctl02 nova-api[12205]: 2017-09-28 12:55:34.378 12205 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:55:34 ctl02 nova-api[12205]: 2017-09-28 12:55:34.512 12205 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:55:34 ctl02 nova-api[12205]: 2017-09-28 12:55:34.514 12205 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:55:34 ctl02 nova-api[12205]: 2017-09-28 12:55:34.514 12205 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:55:34 ctl02 nova-api[12205]: 2017-09-28 12:55:34.514 12205 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:55:34 ctl02 nova-api[12205]: 2017-09-28 12:55:34.518 12205 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:55:34 ctl02 nova-api[12205]: 2017-09-28 12:55:34.518 12205 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:55:34 ctl02 nova-api[12205]: 2017-09-28 12:55:34.518 12205 ERROR nova Traceback (most recent call last):
Sep 28 12:55:34 ctl02 nova-api[12205]: 2017-09-28 12:55:34.518 12205 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:55:34 ctl02 nova-api[12205]: 2017-09-28 12:55:34.518 12205 ERROR nova     sys.exit(main())
Sep 28 12:55:34 ctl02 nova-api[12205]: 2017-09-28 12:55:34.518 12205 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:55:34 ctl02 nova-api[12205]: 2017-09-28 12:55:34.518 12205 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:55:34 ctl02 nova-api[12205]: 2017-09-28 12:55:34.518 12205 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:55:34 ctl02 nova-api[12205]: 2017-09-28 12:55:34.518 12205 ERROR nova     max_url_len=max_url_len)
Sep 28 12:55:34 ctl02 nova-api[12205]: 2017-09-28 12:55:34.518 12205 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:55:34 ctl02 nova-api[12205]: 2017-09-28 12:55:34.518 12205 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:55:34 ctl02 nova-api[12205]: 2017-09-28 12:55:34.518 12205 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:55:34 ctl02 nova-api[12205]: 2017-09-28 12:55:34.518 12205 ERROR nova     sock.listen(backlog)
Sep 28 12:55:34 ctl02 nova-api[12205]: 2017-09-28 12:55:34.518 12205 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:55:34 ctl02 nova-api[12205]: 2017-09-28 12:55:34.518 12205 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:55:34 ctl02 nova-api[12205]: 2017-09-28 12:55:34.518 12205 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:55:34 ctl02 nova-api[12205]: 2017-09-28 12:55:34.518 12205 ERROR nova
Sep 28 12:55:34 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:55:34 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:55:34 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:55:34 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:55:34 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:55:34 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:55:34 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:55:35 ctl02 nova-conductor[5056]: 2017-09-28 12:55:35.182 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:55:35 ctl02 nova-conductor[5056]: 2017-09-28 12:55:35.188 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:55:35 ctl02 nova-conductor[5056]: 2017-09-28 12:55:35.193 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:55:35 ctl02 nova-conductor[5056]: 2017-09-28 12:55:35.197 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:55:35 ctl02 nova-cert[4860]: 2017-09-28 12:55:35.520 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:55:36 ctl02 heat-api-cfn[13300]: 2017-09-28 12:55:36.100 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:55:36] "OPTIONS / HTTP/1.0" 200 134 0.000489
Sep 28 12:55:36 ctl02 neutron-server[30536]: 2017-09-28 12:55:36.126 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 4 dead agents out of 6:
Sep 28 12:55:36 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:55:36 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:55:06 cmp002
Sep 28 12:55:36 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:53:38 cmp001
Sep 28 12:55:36 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:54:00 cmp002
Sep 28 12:55:36 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:54:26 cmp002
Sep 28 12:55:36 ctl02 nova-api[12223]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:55:36 ctl02 nova-api[12223]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:55:36 ctl02 heat-api-cfn[13300]: 2017-09-28 12:55:36.756 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:55:36] "OPTIONS / HTTP/1.0" 200 134 0.000360
Sep 28 12:55:36 ctl02 nova-api[12223]: 2017-09-28 12:55:36.759 12223 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:55:36 ctl02 nova-api[12223]: 2017-09-28 12:55:36.760 12223 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:55:36 ctl02 nova-api[12223]: 2017-09-28 12:55:36.760 12223 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:55:36 ctl02 nova-api[12223]: 2017-09-28 12:55:36.760 12223 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:55:36 ctl02 nova-api[12223]: 2017-09-28 12:55:36.760 12223 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:55:36 ctl02 nova-api[12223]: 2017-09-28 12:55:36.760 12223 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:55:36 ctl02 nova-api[12223]: 2017-09-28 12:55:36.760 12223 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:55:36 ctl02 nova-api[12223]: 2017-09-28 12:55:36.760 12223 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:55:36 ctl02 nova-api[12223]: 2017-09-28 12:55:36.760 12223 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:55:36 ctl02 nova-api[12223]: 2017-09-28 12:55:36.760 12223 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:55:36 ctl02 nova-api[12223]: 2017-09-28 12:55:36.760 12223 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:55:36 ctl02 nova-api[12223]: 2017-09-28 12:55:36.760 12223 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:55:36 ctl02 nova-api[12223]: 2017-09-28 12:55:36.760 12223 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:55:36 ctl02 nova-api[12223]: 2017-09-28 12:55:36.760 12223 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:55:36 ctl02 nova-api[12223]: 2017-09-28 12:55:36.760 12223 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:55:36 ctl02 nova-api[12223]: 2017-09-28 12:55:36.760 12223 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:55:36 ctl02 nova-api[12223]: 2017-09-28 12:55:36.760 12223 ERROR nova.wsgi     self.filename))
Sep 28 12:55:36 ctl02 nova-api[12223]: 2017-09-28 12:55:36.760 12223 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:55:36 ctl02 nova-api[12223]: 2017-09-28 12:55:36.760 12223 ERROR nova.wsgi
Sep 28 12:55:36 ctl02 nova-api[12223]: 2017-09-28 12:55:36.761 12223 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:55:36 ctl02 nova-api[12223]: 2017-09-28 12:55:36.893 12223 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:55:37 ctl02 nova-api[12223]: 2017-09-28 12:55:37.125 12223 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:55:37 ctl02 nova-api[12223]: 2017-09-28 12:55:37.127 12223 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:55:37 ctl02 nova-api[12223]: 2017-09-28 12:55:37.127 12223 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:55:37 ctl02 nova-api[12223]: 2017-09-28 12:55:37.127 12223 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:55:37 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2d664f6d)
Sep 28 12:55:37 ctl02 nova-api[12223]: 2017-09-28 12:55:37.259 12223 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:55:37 ctl02 nova-api[12223]: 2017-09-28 12:55:37.261 12223 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:55:37 ctl02 nova-api[12223]: 2017-09-28 12:55:37.261 12223 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:55:37 ctl02 nova-api[12223]: 2017-09-28 12:55:37.261 12223 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:55:37 ctl02 nova-api[12223]: 2017-09-28 12:55:37.265 12223 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:55:37 ctl02 nova-api[12223]: 2017-09-28 12:55:37.265 12223 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:55:37 ctl02 nova-api[12223]: 2017-09-28 12:55:37.265 12223 ERROR nova Traceback (most recent call last):
Sep 28 12:55:37 ctl02 nova-api[12223]: 2017-09-28 12:55:37.265 12223 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:55:37 ctl02 nova-api[12223]: 2017-09-28 12:55:37.265 12223 ERROR nova     sys.exit(main())
Sep 28 12:55:37 ctl02 nova-api[12223]: 2017-09-28 12:55:37.265 12223 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:55:37 ctl02 nova-api[12223]: 2017-09-28 12:55:37.265 12223 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:55:37 ctl02 nova-api[12223]: 2017-09-28 12:55:37.265 12223 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:55:37 ctl02 nova-api[12223]: 2017-09-28 12:55:37.265 12223 ERROR nova     max_url_len=max_url_len)
Sep 28 12:55:37 ctl02 nova-api[12223]: 2017-09-28 12:55:37.265 12223 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:55:37 ctl02 nova-api[12223]: 2017-09-28 12:55:37.265 12223 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:55:37 ctl02 nova-api[12223]: 2017-09-28 12:55:37.265 12223 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:55:37 ctl02 nova-api[12223]: 2017-09-28 12:55:37.265 12223 ERROR nova     sock.listen(backlog)
Sep 28 12:55:37 ctl02 nova-api[12223]: 2017-09-28 12:55:37.265 12223 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:55:37 ctl02 nova-api[12223]: 2017-09-28 12:55:37.265 12223 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:55:37 ctl02 nova-api[12223]: 2017-09-28 12:55:37.265 12223 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:55:37 ctl02 nova-api[12223]: 2017-09-28 12:55:37.265 12223 ERROR nova
Sep 28 12:55:37 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:55:37 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:55:37 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:55:37 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:55:37.578 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:55:37] "OPTIONS / HTTP/1.0" 200 134 0.000470
Sep 28 12:55:37 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:55:37 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:55:37 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:55:37 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:55:37 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:55:37.781 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:55:37] "OPTIONS / HTTP/1.0" 200 134 0.000426
Sep 28 12:55:38 ctl02 heat-api[13008]: 2017-09-28 12:55:38.042 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:55:38] "OPTIONS / HTTP/1.0" 200 134 0.000604
Sep 28 12:55:38 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2d664f6d)
Sep 28 12:55:38 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:55:38.981 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:55:38] "OPTIONS / HTTP/1.0" 200 134 0.000472
Sep 28 12:55:39 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2d664f6d)
Sep 28 12:55:39 ctl02 nova-api[12241]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:55:39 ctl02 nova-api[12241]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:55:39 ctl02 nova-api[12241]: 2017-09-28 12:55:39.573 12241 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:55:39 ctl02 nova-api[12241]: 2017-09-28 12:55:39.574 12241 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:55:39 ctl02 nova-api[12241]: 2017-09-28 12:55:39.574 12241 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:55:39 ctl02 nova-api[12241]: 2017-09-28 12:55:39.574 12241 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:55:39 ctl02 nova-api[12241]: 2017-09-28 12:55:39.574 12241 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:55:39 ctl02 nova-api[12241]: 2017-09-28 12:55:39.574 12241 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:55:39 ctl02 nova-api[12241]: 2017-09-28 12:55:39.574 12241 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:55:39 ctl02 nova-api[12241]: 2017-09-28 12:55:39.574 12241 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:55:39 ctl02 nova-api[12241]: 2017-09-28 12:55:39.574 12241 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:55:39 ctl02 nova-api[12241]: 2017-09-28 12:55:39.574 12241 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:55:39 ctl02 nova-api[12241]: 2017-09-28 12:55:39.574 12241 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:55:39 ctl02 nova-api[12241]: 2017-09-28 12:55:39.574 12241 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:55:39 ctl02 nova-api[12241]: 2017-09-28 12:55:39.574 12241 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:55:39 ctl02 nova-api[12241]: 2017-09-28 12:55:39.574 12241 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:55:39 ctl02 nova-api[12241]: 2017-09-28 12:55:39.574 12241 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:55:39 ctl02 nova-api[12241]: 2017-09-28 12:55:39.574 12241 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:55:39 ctl02 nova-api[12241]: 2017-09-28 12:55:39.574 12241 ERROR nova.wsgi     self.filename))
Sep 28 12:55:39 ctl02 nova-api[12241]: 2017-09-28 12:55:39.574 12241 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:55:39 ctl02 nova-api[12241]: 2017-09-28 12:55:39.574 12241 ERROR nova.wsgi
Sep 28 12:55:39 ctl02 nova-api[12241]: 2017-09-28 12:55:39.575 12241 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:55:39 ctl02 nova-api[12241]: 2017-09-28 12:55:39.714 12241 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:55:39 ctl02 nova-api[12241]: 2017-09-28 12:55:39.952 12241 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:55:39 ctl02 nova-api[12241]: 2017-09-28 12:55:39.954 12241 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:55:39 ctl02 nova-api[12241]: 2017-09-28 12:55:39.954 12241 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:55:39 ctl02 nova-api[12241]: 2017-09-28 12:55:39.955 12241 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:55:40 ctl02 nova-api[12241]: 2017-09-28 12:55:40.094 12241 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:55:40 ctl02 nova-api[12241]: 2017-09-28 12:55:40.096 12241 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:55:40 ctl02 nova-api[12241]: 2017-09-28 12:55:40.097 12241 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:55:40 ctl02 nova-api[12241]: 2017-09-28 12:55:40.097 12241 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:55:40 ctl02 nova-api[12241]: 2017-09-28 12:55:40.100 12241 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:55:40 ctl02 nova-api[12241]: 2017-09-28 12:55:40.101 12241 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:55:40 ctl02 nova-api[12241]: 2017-09-28 12:55:40.101 12241 ERROR nova Traceback (most recent call last):
Sep 28 12:55:40 ctl02 nova-api[12241]: 2017-09-28 12:55:40.101 12241 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:55:40 ctl02 nova-api[12241]: 2017-09-28 12:55:40.101 12241 ERROR nova     sys.exit(main())
Sep 28 12:55:40 ctl02 nova-api[12241]: 2017-09-28 12:55:40.101 12241 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:55:40 ctl02 nova-api[12241]: 2017-09-28 12:55:40.101 12241 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:55:40 ctl02 nova-api[12241]: 2017-09-28 12:55:40.101 12241 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:55:40 ctl02 nova-api[12241]: 2017-09-28 12:55:40.101 12241 ERROR nova     max_url_len=max_url_len)
Sep 28 12:55:40 ctl02 nova-api[12241]: 2017-09-28 12:55:40.101 12241 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:55:40 ctl02 nova-api[12241]: 2017-09-28 12:55:40.101 12241 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:55:40 ctl02 nova-api[12241]: 2017-09-28 12:55:40.101 12241 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:55:40 ctl02 nova-api[12241]: 2017-09-28 12:55:40.101 12241 ERROR nova     sock.listen(backlog)
Sep 28 12:55:40 ctl02 nova-api[12241]: 2017-09-28 12:55:40.101 12241 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:55:40 ctl02 nova-api[12241]: 2017-09-28 12:55:40.101 12241 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:55:40 ctl02 nova-api[12241]: 2017-09-28 12:55:40.101 12241 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:55:40 ctl02 nova-api[12241]: 2017-09-28 12:55:40.101 12241 ERROR nova
Sep 28 12:55:40 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2d664f6d)
Sep 28 12:55:40 ctl02 glance-api[29183]: 2017-09-28 12:55:40.191 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:55:40] "OPTIONS / HTTP/1.0" 200 134 0.000618
Sep 28 12:55:40 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:55:40 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:55:40 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:55:40 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:55:40 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:55:40 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:55:40 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:55:40 ctl02 heat-api-cfn[13300]: 2017-09-28 12:55:40.409 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:55:40] "OPTIONS / HTTP/1.0" 200 134 0.000480
Sep 28 12:55:40 ctl02 glance-api[29183]: 2017-09-28 12:55:40.852 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:55:40] "OPTIONS / HTTP/1.0" 200 134 0.000592
Sep 28 12:55:41 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2d664f6d)
Sep 28 12:55:41 ctl02 neutron-server[30536]: 2017-09-28 12:55:41.242 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:55:41] "OPTIONS / HTTP/1.0" 200 262 0.000455
Sep 28 12:55:42 ctl02 nova-api[12258]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:55:42 ctl02 nova-api[12258]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:55:42 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2d664f6d)
Sep 28 12:55:42 ctl02 nova-api[12258]: 2017-09-28 12:55:42.224 12258 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:55:42 ctl02 nova-api[12258]: 2017-09-28 12:55:42.225 12258 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:55:42 ctl02 nova-api[12258]: 2017-09-28 12:55:42.225 12258 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:55:42 ctl02 nova-api[12258]: 2017-09-28 12:55:42.225 12258 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:55:42 ctl02 nova-api[12258]: 2017-09-28 12:55:42.225 12258 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:55:42 ctl02 nova-api[12258]: 2017-09-28 12:55:42.225 12258 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:55:42 ctl02 nova-api[12258]: 2017-09-28 12:55:42.225 12258 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:55:42 ctl02 nova-api[12258]: 2017-09-28 12:55:42.225 12258 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:55:42 ctl02 nova-api[12258]: 2017-09-28 12:55:42.225 12258 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:55:42 ctl02 nova-api[12258]: 2017-09-28 12:55:42.225 12258 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:55:42 ctl02 nova-api[12258]: 2017-09-28 12:55:42.225 12258 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:55:42 ctl02 nova-api[12258]: 2017-09-28 12:55:42.225 12258 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:55:42 ctl02 nova-api[12258]: 2017-09-28 12:55:42.225 12258 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:55:42 ctl02 nova-api[12258]: 2017-09-28 12:55:42.225 12258 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:55:42 ctl02 nova-api[12258]: 2017-09-28 12:55:42.225 12258 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:55:42 ctl02 nova-api[12258]: 2017-09-28 12:55:42.225 12258 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:55:42 ctl02 nova-api[12258]: 2017-09-28 12:55:42.225 12258 ERROR nova.wsgi     self.filename))
Sep 28 12:55:42 ctl02 nova-api[12258]: 2017-09-28 12:55:42.225 12258 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:55:42 ctl02 nova-api[12258]: 2017-09-28 12:55:42.225 12258 ERROR nova.wsgi
Sep 28 12:55:42 ctl02 nova-api[12258]: 2017-09-28 12:55:42.226 12258 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:55:42 ctl02 nova-api[12258]: 2017-09-28 12:55:42.353 12258 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:55:42 ctl02 nova-api[12258]: 2017-09-28 12:55:42.576 12258 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:55:42 ctl02 nova-api[12258]: 2017-09-28 12:55:42.578 12258 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:55:42 ctl02 nova-api[12258]: 2017-09-28 12:55:42.579 12258 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:55:42 ctl02 nova-api[12258]: 2017-09-28 12:55:42.579 12258 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:55:42 ctl02 nova-api[12258]: 2017-09-28 12:55:42.709 12258 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:55:42 ctl02 nova-api[12258]: 2017-09-28 12:55:42.711 12258 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:55:42 ctl02 nova-api[12258]: 2017-09-28 12:55:42.711 12258 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:55:42 ctl02 nova-api[12258]: 2017-09-28 12:55:42.711 12258 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:55:42 ctl02 nova-api[12258]: 2017-09-28 12:55:42.715 12258 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:55:42 ctl02 nova-api[12258]: 2017-09-28 12:55:42.715 12258 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:55:42 ctl02 nova-api[12258]: 2017-09-28 12:55:42.715 12258 ERROR nova Traceback (most recent call last):
Sep 28 12:55:42 ctl02 nova-api[12258]: 2017-09-28 12:55:42.715 12258 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:55:42 ctl02 nova-api[12258]: 2017-09-28 12:55:42.715 12258 ERROR nova     sys.exit(main())
Sep 28 12:55:42 ctl02 nova-api[12258]: 2017-09-28 12:55:42.715 12258 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:55:42 ctl02 nova-api[12258]: 2017-09-28 12:55:42.715 12258 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:55:42 ctl02 nova-api[12258]: 2017-09-28 12:55:42.715 12258 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:55:42 ctl02 nova-api[12258]: 2017-09-28 12:55:42.715 12258 ERROR nova     max_url_len=max_url_len)
Sep 28 12:55:42 ctl02 nova-api[12258]: 2017-09-28 12:55:42.715 12258 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:55:42 ctl02 nova-api[12258]: 2017-09-28 12:55:42.715 12258 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:55:42 ctl02 nova-api[12258]: 2017-09-28 12:55:42.715 12258 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:55:42 ctl02 nova-api[12258]: 2017-09-28 12:55:42.715 12258 ERROR nova     sock.listen(backlog)
Sep 28 12:55:42 ctl02 nova-api[12258]: 2017-09-28 12:55:42.715 12258 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:55:42 ctl02 nova-api[12258]: 2017-09-28 12:55:42.715 12258 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:55:42 ctl02 nova-api[12258]: 2017-09-28 12:55:42.715 12258 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:55:42 ctl02 nova-api[12258]: 2017-09-28 12:55:42.715 12258 ERROR nova
Sep 28 12:55:42 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:55:42 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:55:42 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:55:42 ctl02 glance-api[29183]: 2017-09-28 12:55:42.999 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:55:42] "OPTIONS / HTTP/1.0" 200 134 0.001135
Sep 28 12:55:43 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:55:43 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:55:43 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:55:43 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:55:43 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2d664f6d)
Sep 28 12:55:43 ctl02 heat-api[13008]: 2017-09-28 12:55:43.434 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:55:43] "OPTIONS / HTTP/1.0" 200 134 0.000628
Sep 28 12:55:43 ctl02 neutron-server[30536]: 2017-09-28 12:55:43.963 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:55:43] "OPTIONS / HTTP/1.0" 200 262 0.000541
Sep 28 12:55:44 ctl02 heat-api[13008]: 2017-09-28 12:55:44.124 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:55:44] "OPTIONS / HTTP/1.0" 200 134 0.000679
Sep 28 12:55:44 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2d664f6d)
Sep 28 12:55:44 ctl02 neutron-server[30536]: 2017-09-28 12:55:44.347 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:55:44] "OPTIONS / HTTP/1.0" 200 262 0.000521
Sep 28 12:55:44 ctl02 nova-api[12276]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:55:44 ctl02 nova-api[12276]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:55:45 ctl02 nova-api[12276]: 2017-09-28 12:55:45.025 12276 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:55:45 ctl02 nova-api[12276]: 2017-09-28 12:55:45.027 12276 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:55:45 ctl02 nova-api[12276]: 2017-09-28 12:55:45.027 12276 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:55:45 ctl02 nova-api[12276]: 2017-09-28 12:55:45.027 12276 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:55:45 ctl02 nova-api[12276]: 2017-09-28 12:55:45.027 12276 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:55:45 ctl02 nova-api[12276]: 2017-09-28 12:55:45.027 12276 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:55:45 ctl02 nova-api[12276]: 2017-09-28 12:55:45.027 12276 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:55:45 ctl02 nova-api[12276]: 2017-09-28 12:55:45.027 12276 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:55:45 ctl02 nova-api[12276]: 2017-09-28 12:55:45.027 12276 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:55:45 ctl02 nova-api[12276]: 2017-09-28 12:55:45.027 12276 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:55:45 ctl02 nova-api[12276]: 2017-09-28 12:55:45.027 12276 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:55:45 ctl02 nova-api[12276]: 2017-09-28 12:55:45.027 12276 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:55:45 ctl02 nova-api[12276]: 2017-09-28 12:55:45.027 12276 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:55:45 ctl02 nova-api[12276]: 2017-09-28 12:55:45.027 12276 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:55:45 ctl02 nova-api[12276]: 2017-09-28 12:55:45.027 12276 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:55:45 ctl02 nova-api[12276]: 2017-09-28 12:55:45.027 12276 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:55:45 ctl02 nova-api[12276]: 2017-09-28 12:55:45.027 12276 ERROR nova.wsgi     self.filename))
Sep 28 12:55:45 ctl02 nova-api[12276]: 2017-09-28 12:55:45.027 12276 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:55:45 ctl02 nova-api[12276]: 2017-09-28 12:55:45.027 12276 ERROR nova.wsgi
Sep 28 12:55:45 ctl02 nova-api[12276]: 2017-09-28 12:55:45.029 12276 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:55:45 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2d664f6d)
Sep 28 12:55:45 ctl02 nova-api[12276]: 2017-09-28 12:55:45.156 12276 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:55:45 ctl02 nova-consoleauth[5433]: 2017-09-28 12:55:45.362 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:55:45 ctl02 nova-api[12276]: 2017-09-28 12:55:45.383 12276 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:55:45 ctl02 nova-api[12276]: 2017-09-28 12:55:45.386 12276 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:55:45 ctl02 nova-api[12276]: 2017-09-28 12:55:45.386 12276 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:55:45 ctl02 nova-api[12276]: 2017-09-28 12:55:45.387 12276 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:55:45 ctl02 nova-api[12276]: 2017-09-28 12:55:45.517 12276 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:55:45 ctl02 nova-api[12276]: 2017-09-28 12:55:45.519 12276 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:55:45 ctl02 nova-api[12276]: 2017-09-28 12:55:45.520 12276 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:55:45 ctl02 nova-api[12276]: 2017-09-28 12:55:45.520 12276 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:55:45 ctl02 nova-api[12276]: 2017-09-28 12:55:45.523 12276 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:55:45 ctl02 nova-api[12276]: 2017-09-28 12:55:45.524 12276 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:55:45 ctl02 nova-api[12276]: 2017-09-28 12:55:45.524 12276 ERROR nova Traceback (most recent call last):
Sep 28 12:55:45 ctl02 nova-api[12276]: 2017-09-28 12:55:45.524 12276 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:55:45 ctl02 nova-api[12276]: 2017-09-28 12:55:45.524 12276 ERROR nova     sys.exit(main())
Sep 28 12:55:45 ctl02 nova-api[12276]: 2017-09-28 12:55:45.524 12276 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:55:45 ctl02 nova-api[12276]: 2017-09-28 12:55:45.524 12276 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:55:45 ctl02 nova-api[12276]: 2017-09-28 12:55:45.524 12276 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:55:45 ctl02 nova-api[12276]: 2017-09-28 12:55:45.524 12276 ERROR nova     max_url_len=max_url_len)
Sep 28 12:55:45 ctl02 nova-api[12276]: 2017-09-28 12:55:45.524 12276 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:55:45 ctl02 nova-api[12276]: 2017-09-28 12:55:45.524 12276 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:55:45 ctl02 nova-api[12276]: 2017-09-28 12:55:45.524 12276 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:55:45 ctl02 nova-api[12276]: 2017-09-28 12:55:45.524 12276 ERROR nova     sock.listen(backlog)
Sep 28 12:55:45 ctl02 nova-api[12276]: 2017-09-28 12:55:45.524 12276 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:55:45 ctl02 nova-api[12276]: 2017-09-28 12:55:45.524 12276 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:55:45 ctl02 nova-api[12276]: 2017-09-28 12:55:45.524 12276 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:55:45 ctl02 nova-api[12276]: 2017-09-28 12:55:45.524 12276 ERROR nova
Sep 28 12:55:45 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:55:45 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:55:45 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:55:45 ctl02 heat-api-cfn[13300]: 2017-09-28 12:55:45.730 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:55:45] "OPTIONS / HTTP/1.0" 200 134 0.000461
Sep 28 12:55:45 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:55:45 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:55:45 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:55:45 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:55:46 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2d664f6d)
Sep 28 12:55:46 ctl02 heat-engine[12803]: 2017-09-28 12:55:46.307 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:55:46 ctl02 heat-engine[12803]: 2017-09-28 12:55:46.319 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:55:46 ctl02 heat-engine[12803]: 2017-09-28 12:55:46.319 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:55:46 ctl02 heat-engine[12803]: 2017-09-28 12:55:46.321 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:55:46 ctl02 heat-api-cfn[13300]: 2017-09-28 12:55:46.952 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:55:46] "OPTIONS / HTTP/1.0" 200 134 0.000495
Sep 28 12:55:47 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2d664f6d)
Sep 28 12:55:47 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:55:47.477 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:55:47] "OPTIONS / HTTP/1.0" 200 134 0.000375
Sep 28 12:55:47 ctl02 nova-api[12295]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:55:47 ctl02 nova-api[12295]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:55:47 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:55:47.570 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:55:47] "OPTIONS / HTTP/1.0" 200 134 0.000338
Sep 28 12:55:47 ctl02 nova-api[12295]: 2017-09-28 12:55:47.739 12295 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:55:47 ctl02 nova-api[12295]: 2017-09-28 12:55:47.740 12295 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:55:47 ctl02 nova-api[12295]: 2017-09-28 12:55:47.740 12295 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:55:47 ctl02 nova-api[12295]: 2017-09-28 12:55:47.740 12295 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:55:47 ctl02 nova-api[12295]: 2017-09-28 12:55:47.740 12295 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:55:47 ctl02 nova-api[12295]: 2017-09-28 12:55:47.740 12295 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:55:47 ctl02 nova-api[12295]: 2017-09-28 12:55:47.740 12295 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:55:47 ctl02 nova-api[12295]: 2017-09-28 12:55:47.740 12295 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:55:47 ctl02 nova-api[12295]: 2017-09-28 12:55:47.740 12295 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:55:47 ctl02 nova-api[12295]: 2017-09-28 12:55:47.740 12295 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:55:47 ctl02 nova-api[12295]: 2017-09-28 12:55:47.740 12295 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:55:47 ctl02 nova-api[12295]: 2017-09-28 12:55:47.740 12295 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:55:47 ctl02 nova-api[12295]: 2017-09-28 12:55:47.740 12295 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:55:47 ctl02 nova-api[12295]: 2017-09-28 12:55:47.740 12295 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:55:47 ctl02 nova-api[12295]: 2017-09-28 12:55:47.740 12295 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:55:47 ctl02 nova-api[12295]: 2017-09-28 12:55:47.740 12295 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:55:47 ctl02 nova-api[12295]: 2017-09-28 12:55:47.740 12295 ERROR nova.wsgi     self.filename))
Sep 28 12:55:47 ctl02 nova-api[12295]: 2017-09-28 12:55:47.740 12295 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:55:47 ctl02 nova-api[12295]: 2017-09-28 12:55:47.740 12295 ERROR nova.wsgi
Sep 28 12:55:47 ctl02 nova-api[12295]: 2017-09-28 12:55:47.743 12295 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:55:47 ctl02 nova-api[12295]: 2017-09-28 12:55:47.871 12295 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:55:48 ctl02 nova-api[12295]: 2017-09-28 12:55:48.096 12295 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:55:48 ctl02 nova-api[12295]: 2017-09-28 12:55:48.099 12295 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:55:48 ctl02 nova-api[12295]: 2017-09-28 12:55:48.099 12295 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:55:48 ctl02 nova-api[12295]: 2017-09-28 12:55:48.100 12295 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:55:48 ctl02 heat-api[13008]: 2017-09-28 12:55:48.116 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:55:48] "OPTIONS / HTTP/1.0" 200 134 0.000561
Sep 28 12:55:48 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:55:48 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:55:48 ctl02 nova-api[12295]: 2017-09-28 12:55:48.232 12295 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:55:48 ctl02 nova-api[12295]: 2017-09-28 12:55:48.234 12295 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:55:48 ctl02 nova-api[12295]: 2017-09-28 12:55:48.234 12295 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:55:48 ctl02 nova-api[12295]: 2017-09-28 12:55:48.235 12295 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:55:48 ctl02 nova-api[12295]: 2017-09-28 12:55:48.238 12295 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:55:48 ctl02 nova-api[12295]: 2017-09-28 12:55:48.238 12295 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:55:48 ctl02 nova-api[12295]: 2017-09-28 12:55:48.238 12295 ERROR nova Traceback (most recent call last):
Sep 28 12:55:48 ctl02 nova-api[12295]: 2017-09-28 12:55:48.238 12295 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:55:48 ctl02 nova-api[12295]: 2017-09-28 12:55:48.238 12295 ERROR nova     sys.exit(main())
Sep 28 12:55:48 ctl02 nova-api[12295]: 2017-09-28 12:55:48.238 12295 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:55:48 ctl02 nova-api[12295]: 2017-09-28 12:55:48.238 12295 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:55:48 ctl02 nova-api[12295]: 2017-09-28 12:55:48.238 12295 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:55:48 ctl02 nova-api[12295]: 2017-09-28 12:55:48.238 12295 ERROR nova     max_url_len=max_url_len)
Sep 28 12:55:48 ctl02 nova-api[12295]: 2017-09-28 12:55:48.238 12295 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:55:48 ctl02 nova-api[12295]: 2017-09-28 12:55:48.238 12295 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:55:48 ctl02 nova-api[12295]: 2017-09-28 12:55:48.238 12295 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:55:48 ctl02 nova-api[12295]: 2017-09-28 12:55:48.238 12295 ERROR nova     sock.listen(backlog)
Sep 28 12:55:48 ctl02 nova-api[12295]: 2017-09-28 12:55:48.238 12295 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:55:48 ctl02 nova-api[12295]: 2017-09-28 12:55:48.238 12295 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:55:48 ctl02 nova-api[12295]: 2017-09-28 12:55:48.238 12295 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:55:48 ctl02 nova-api[12295]: 2017-09-28 12:55:48.238 12295 ERROR nova
Sep 28 12:55:48 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:55:48 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:55:48 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:55:48 ctl02 nova-scheduler[5620]: 2017-09-28 12:55:48.456 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:55:48 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:55:48 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:55:48 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:55:48 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:55:48 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:55:48.696 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:55:48] "OPTIONS / HTTP/1.0" 200 134 0.000488
Sep 28 12:55:49 ctl02 glance-api[29183]: 2017-09-28 12:55:49.873 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:55:49] "OPTIONS / HTTP/1.0" 200 134 0.001039
Sep 28 12:55:50 ctl02 nova-api[12318]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:55:50 ctl02 nova-api[12318]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:55:50 ctl02 heat-api-cfn[13300]: 2017-09-28 12:55:50.477 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:55:50] "OPTIONS / HTTP/1.0" 200 134 0.000496
Sep 28 12:55:50 ctl02 nova-api[12318]: 2017-09-28 12:55:50.521 12318 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:55:50 ctl02 nova-api[12318]: 2017-09-28 12:55:50.522 12318 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:55:50 ctl02 nova-api[12318]: 2017-09-28 12:55:50.522 12318 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:55:50 ctl02 nova-api[12318]: 2017-09-28 12:55:50.522 12318 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:55:50 ctl02 nova-api[12318]: 2017-09-28 12:55:50.522 12318 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:55:50 ctl02 nova-api[12318]: 2017-09-28 12:55:50.522 12318 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:55:50 ctl02 nova-api[12318]: 2017-09-28 12:55:50.522 12318 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:55:50 ctl02 nova-api[12318]: 2017-09-28 12:55:50.522 12318 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:55:50 ctl02 nova-api[12318]: 2017-09-28 12:55:50.522 12318 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:55:50 ctl02 nova-api[12318]: 2017-09-28 12:55:50.522 12318 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:55:50 ctl02 nova-api[12318]: 2017-09-28 12:55:50.522 12318 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:55:50 ctl02 nova-api[12318]: 2017-09-28 12:55:50.522 12318 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:55:50 ctl02 nova-api[12318]: 2017-09-28 12:55:50.522 12318 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:55:50 ctl02 nova-api[12318]: 2017-09-28 12:55:50.522 12318 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:55:50 ctl02 nova-api[12318]: 2017-09-28 12:55:50.522 12318 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:55:50 ctl02 nova-api[12318]: 2017-09-28 12:55:50.522 12318 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:55:50 ctl02 nova-api[12318]: 2017-09-28 12:55:50.522 12318 ERROR nova.wsgi     self.filename))
Sep 28 12:55:50 ctl02 nova-api[12318]: 2017-09-28 12:55:50.522 12318 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:55:50 ctl02 nova-api[12318]: 2017-09-28 12:55:50.522 12318 ERROR nova.wsgi
Sep 28 12:55:50 ctl02 nova-api[12318]: 2017-09-28 12:55:50.523 12318 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:55:50 ctl02 nova-api[12318]: 2017-09-28 12:55:50.654 12318 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:55:50 ctl02 nova-api[12318]: 2017-09-28 12:55:50.900 12318 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:55:50 ctl02 nova-api[12318]: 2017-09-28 12:55:50.902 12318 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:55:50 ctl02 nova-api[12318]: 2017-09-28 12:55:50.902 12318 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:55:50 ctl02 nova-api[12318]: 2017-09-28 12:55:50.903 12318 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:55:51 ctl02 nova-api[12318]: 2017-09-28 12:55:51.035 12318 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:55:51 ctl02 nova-api[12318]: 2017-09-28 12:55:51.037 12318 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:55:51 ctl02 nova-api[12318]: 2017-09-28 12:55:51.037 12318 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:55:51 ctl02 nova-api[12318]: 2017-09-28 12:55:51.038 12318 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:55:51 ctl02 nova-api[12318]: 2017-09-28 12:55:51.041 12318 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:55:51 ctl02 nova-api[12318]: 2017-09-28 12:55:51.041 12318 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:55:51 ctl02 nova-api[12318]: 2017-09-28 12:55:51.041 12318 ERROR nova Traceback (most recent call last):
Sep 28 12:55:51 ctl02 nova-api[12318]: 2017-09-28 12:55:51.041 12318 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:55:51 ctl02 nova-api[12318]: 2017-09-28 12:55:51.041 12318 ERROR nova     sys.exit(main())
Sep 28 12:55:51 ctl02 nova-api[12318]: 2017-09-28 12:55:51.041 12318 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:55:51 ctl02 nova-api[12318]: 2017-09-28 12:55:51.041 12318 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:55:51 ctl02 nova-api[12318]: 2017-09-28 12:55:51.041 12318 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:55:51 ctl02 nova-api[12318]: 2017-09-28 12:55:51.041 12318 ERROR nova     max_url_len=max_url_len)
Sep 28 12:55:51 ctl02 nova-api[12318]: 2017-09-28 12:55:51.041 12318 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:55:51 ctl02 nova-api[12318]: 2017-09-28 12:55:51.041 12318 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:55:51 ctl02 nova-api[12318]: 2017-09-28 12:55:51.041 12318 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:55:51 ctl02 nova-api[12318]: 2017-09-28 12:55:51.041 12318 ERROR nova     sock.listen(backlog)
Sep 28 12:55:51 ctl02 nova-api[12318]: 2017-09-28 12:55:51.041 12318 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:55:51 ctl02 nova-api[12318]: 2017-09-28 12:55:51.041 12318 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:55:51 ctl02 nova-api[12318]: 2017-09-28 12:55:51.041 12318 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:55:51 ctl02 nova-api[12318]: 2017-09-28 12:55:51.041 12318 ERROR nova
Sep 28 12:55:51 ctl02 neutron-server[30536]: 2017-09-28 12:55:51.123 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 12:55:51 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:55:51 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:55:06 cmp002
Sep 28 12:55:51 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:54:00 cmp002
Sep 28 12:55:51 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:54:26 cmp002
Sep 28 12:55:51 ctl02 glance-api[29183]: 2017-09-28 12:55:51.161 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:55:51] "OPTIONS / HTTP/1.0" 200 134 0.000642
Sep 28 12:55:51 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:55:51 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:55:51 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:55:51 ctl02 neutron-server[30536]: 2017-09-28 12:55:51.284 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:55:51] "OPTIONS / HTTP/1.0" 200 262 0.000522
Sep 28 12:55:51 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:55:51 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:55:51 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:55:51 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:55:53 ctl02 nova-api[12336]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:55:53 ctl02 nova-api[12336]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:55:53 ctl02 glance-api[29183]: 2017-09-28 12:55:53.160 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:55:53] "OPTIONS / HTTP/1.0" 200 134 0.000622
Sep 28 12:55:53 ctl02 nova-api[12336]: 2017-09-28 12:55:53.219 12336 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:55:53 ctl02 nova-api[12336]: 2017-09-28 12:55:53.221 12336 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:55:53 ctl02 nova-api[12336]: 2017-09-28 12:55:53.221 12336 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:55:53 ctl02 nova-api[12336]: 2017-09-28 12:55:53.221 12336 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:55:53 ctl02 nova-api[12336]: 2017-09-28 12:55:53.221 12336 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:55:53 ctl02 nova-api[12336]: 2017-09-28 12:55:53.221 12336 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:55:53 ctl02 nova-api[12336]: 2017-09-28 12:55:53.221 12336 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:55:53 ctl02 nova-api[12336]: 2017-09-28 12:55:53.221 12336 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:55:53 ctl02 nova-api[12336]: 2017-09-28 12:55:53.221 12336 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:55:53 ctl02 nova-api[12336]: 2017-09-28 12:55:53.221 12336 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:55:53 ctl02 nova-api[12336]: 2017-09-28 12:55:53.221 12336 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:55:53 ctl02 nova-api[12336]: 2017-09-28 12:55:53.221 12336 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:55:53 ctl02 nova-api[12336]: 2017-09-28 12:55:53.221 12336 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:55:53 ctl02 nova-api[12336]: 2017-09-28 12:55:53.221 12336 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:55:53 ctl02 nova-api[12336]: 2017-09-28 12:55:53.221 12336 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:55:53 ctl02 nova-api[12336]: 2017-09-28 12:55:53.221 12336 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:55:53 ctl02 nova-api[12336]: 2017-09-28 12:55:53.221 12336 ERROR nova.wsgi     self.filename))
Sep 28 12:55:53 ctl02 nova-api[12336]: 2017-09-28 12:55:53.221 12336 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:55:53 ctl02 nova-api[12336]: 2017-09-28 12:55:53.221 12336 ERROR nova.wsgi
Sep 28 12:55:53 ctl02 nova-api[12336]: 2017-09-28 12:55:53.222 12336 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:55:53 ctl02 heat-api[13008]: 2017-09-28 12:55:53.317 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:55:53] "OPTIONS / HTTP/1.0" 200 134 0.000507
Sep 28 12:55:53 ctl02 nova-api[12336]: 2017-09-28 12:55:53.354 12336 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:55:53 ctl02 nova-api[12336]: 2017-09-28 12:55:53.582 12336 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:55:53 ctl02 nova-api[12336]: 2017-09-28 12:55:53.585 12336 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:55:53 ctl02 nova-api[12336]: 2017-09-28 12:55:53.585 12336 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:55:53 ctl02 nova-api[12336]: 2017-09-28 12:55:53.585 12336 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:55:53 ctl02 nova-api[12336]: 2017-09-28 12:55:53.720 12336 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:55:53 ctl02 nova-api[12336]: 2017-09-28 12:55:53.722 12336 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:55:53 ctl02 nova-api[12336]: 2017-09-28 12:55:53.722 12336 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:55:53 ctl02 nova-api[12336]: 2017-09-28 12:55:53.722 12336 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:55:53 ctl02 nova-api[12336]: 2017-09-28 12:55:53.725 12336 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:55:53 ctl02 nova-api[12336]: 2017-09-28 12:55:53.726 12336 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:55:53 ctl02 nova-api[12336]: 2017-09-28 12:55:53.726 12336 ERROR nova Traceback (most recent call last):
Sep 28 12:55:53 ctl02 nova-api[12336]: 2017-09-28 12:55:53.726 12336 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:55:53 ctl02 nova-api[12336]: 2017-09-28 12:55:53.726 12336 ERROR nova     sys.exit(main())
Sep 28 12:55:53 ctl02 nova-api[12336]: 2017-09-28 12:55:53.726 12336 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:55:53 ctl02 nova-api[12336]: 2017-09-28 12:55:53.726 12336 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:55:53 ctl02 nova-api[12336]: 2017-09-28 12:55:53.726 12336 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:55:53 ctl02 nova-api[12336]: 2017-09-28 12:55:53.726 12336 ERROR nova     max_url_len=max_url_len)
Sep 28 12:55:53 ctl02 nova-api[12336]: 2017-09-28 12:55:53.726 12336 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:55:53 ctl02 nova-api[12336]: 2017-09-28 12:55:53.726 12336 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:55:53 ctl02 nova-api[12336]: 2017-09-28 12:55:53.726 12336 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:55:53 ctl02 nova-api[12336]: 2017-09-28 12:55:53.726 12336 ERROR nova     sock.listen(backlog)
Sep 28 12:55:53 ctl02 nova-api[12336]: 2017-09-28 12:55:53.726 12336 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:55:53 ctl02 nova-api[12336]: 2017-09-28 12:55:53.726 12336 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:55:53 ctl02 nova-api[12336]: 2017-09-28 12:55:53.726 12336 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:55:53 ctl02 nova-api[12336]: 2017-09-28 12:55:53.726 12336 ERROR nova
Sep 28 12:55:53 ctl02 neutron-server[30536]: 2017-09-28 12:55:53.765 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:55:53] "OPTIONS / HTTP/1.0" 200 262 0.000481
Sep 28 12:55:53 ctl02 heat-api[13008]: 2017-09-28 12:55:53.837 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:55:53] "OPTIONS / HTTP/1.0" 200 134 0.000581
Sep 28 12:55:53 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:55:53 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:55:53 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:55:54 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:55:54 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:55:54 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:55:54 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:55:54 ctl02 neutron-server[30536]: 2017-09-28 12:55:54.450 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:55:54] "OPTIONS / HTTP/1.0" 200 262 0.000459
Sep 28 12:55:55 ctl02 nova-api[12354]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:55:55 ctl02 nova-api[12354]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:55:55 ctl02 heat-api-cfn[13300]: 2017-09-28 12:55:55.856 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:55:55] "OPTIONS / HTTP/1.0" 200 134 0.000499
Sep 28 12:55:56 ctl02 nova-api[12354]: 2017-09-28 12:55:56.044 12354 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:55:56 ctl02 nova-api[12354]: 2017-09-28 12:55:56.045 12354 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:55:56 ctl02 nova-api[12354]: 2017-09-28 12:55:56.045 12354 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:55:56 ctl02 nova-api[12354]: 2017-09-28 12:55:56.045 12354 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:55:56 ctl02 nova-api[12354]: 2017-09-28 12:55:56.045 12354 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:55:56 ctl02 nova-api[12354]: 2017-09-28 12:55:56.045 12354 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:55:56 ctl02 nova-api[12354]: 2017-09-28 12:55:56.045 12354 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:55:56 ctl02 nova-api[12354]: 2017-09-28 12:55:56.045 12354 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:55:56 ctl02 nova-api[12354]: 2017-09-28 12:55:56.045 12354 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:55:56 ctl02 nova-api[12354]: 2017-09-28 12:55:56.045 12354 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:55:56 ctl02 nova-api[12354]: 2017-09-28 12:55:56.045 12354 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:55:56 ctl02 nova-api[12354]: 2017-09-28 12:55:56.045 12354 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:55:56 ctl02 nova-api[12354]: 2017-09-28 12:55:56.045 12354 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:55:56 ctl02 nova-api[12354]: 2017-09-28 12:55:56.045 12354 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:55:56 ctl02 nova-api[12354]: 2017-09-28 12:55:56.045 12354 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:55:56 ctl02 nova-api[12354]: 2017-09-28 12:55:56.045 12354 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:55:56 ctl02 nova-api[12354]: 2017-09-28 12:55:56.045 12354 ERROR nova.wsgi     self.filename))
Sep 28 12:55:56 ctl02 nova-api[12354]: 2017-09-28 12:55:56.045 12354 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:55:56 ctl02 nova-api[12354]: 2017-09-28 12:55:56.045 12354 ERROR nova.wsgi
Sep 28 12:55:56 ctl02 nova-api[12354]: 2017-09-28 12:55:56.046 12354 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:55:56 ctl02 nova-api[12354]: 2017-09-28 12:55:56.179 12354 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:55:56 ctl02 nova-api[12354]: 2017-09-28 12:55:56.417 12354 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:55:56 ctl02 nova-api[12354]: 2017-09-28 12:55:56.420 12354 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:55:56 ctl02 nova-api[12354]: 2017-09-28 12:55:56.420 12354 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:55:56 ctl02 nova-api[12354]: 2017-09-28 12:55:56.420 12354 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:55:56 ctl02 nova-api[12354]: 2017-09-28 12:55:56.554 12354 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:55:56 ctl02 nova-api[12354]: 2017-09-28 12:55:56.556 12354 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:55:56 ctl02 nova-api[12354]: 2017-09-28 12:55:56.556 12354 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:55:56 ctl02 nova-api[12354]: 2017-09-28 12:55:56.557 12354 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:55:56 ctl02 nova-api[12354]: 2017-09-28 12:55:56.560 12354 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:55:56 ctl02 nova-api[12354]: 2017-09-28 12:55:56.560 12354 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:55:56 ctl02 nova-api[12354]: 2017-09-28 12:55:56.560 12354 ERROR nova Traceback (most recent call last):
Sep 28 12:55:56 ctl02 nova-api[12354]: 2017-09-28 12:55:56.560 12354 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:55:56 ctl02 nova-api[12354]: 2017-09-28 12:55:56.560 12354 ERROR nova     sys.exit(main())
Sep 28 12:55:56 ctl02 nova-api[12354]: 2017-09-28 12:55:56.560 12354 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:55:56 ctl02 nova-api[12354]: 2017-09-28 12:55:56.560 12354 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:55:56 ctl02 nova-api[12354]: 2017-09-28 12:55:56.560 12354 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:55:56 ctl02 nova-api[12354]: 2017-09-28 12:55:56.560 12354 ERROR nova     max_url_len=max_url_len)
Sep 28 12:55:56 ctl02 nova-api[12354]: 2017-09-28 12:55:56.560 12354 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:55:56 ctl02 nova-api[12354]: 2017-09-28 12:55:56.560 12354 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:55:56 ctl02 nova-api[12354]: 2017-09-28 12:55:56.560 12354 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:55:56 ctl02 nova-api[12354]: 2017-09-28 12:55:56.560 12354 ERROR nova     sock.listen(backlog)
Sep 28 12:55:56 ctl02 nova-api[12354]: 2017-09-28 12:55:56.560 12354 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:55:56 ctl02 nova-api[12354]: 2017-09-28 12:55:56.560 12354 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:55:56 ctl02 nova-api[12354]: 2017-09-28 12:55:56.560 12354 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:55:56 ctl02 nova-api[12354]: 2017-09-28 12:55:56.560 12354 ERROR nova
Sep 28 12:55:56 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:55:56 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:55:56 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:55:56 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:55:56 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:55:56 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:55:56 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:55:57 ctl02 heat-api-cfn[13300]: 2017-09-28 12:55:57.275 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:55:57] "OPTIONS / HTTP/1.0" 200 134 0.000444
Sep 28 12:55:57 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:55:57.354 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:55:57] "OPTIONS / HTTP/1.0" 200 134 0.000427
Sep 28 12:55:57 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:55:57.781 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:55:57] "OPTIONS / HTTP/1.0" 200 134 0.000405
Sep 28 12:55:57 ctl02 heat-api[13008]: 2017-09-28 12:55:57.939 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:55:57] "OPTIONS / HTTP/1.0" 200 134 0.000568
Sep 28 12:55:58 ctl02 nova-api[12372]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:55:58 ctl02 nova-api[12372]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:55:58 ctl02 nova-api[12372]: 2017-09-28 12:55:58.752 12372 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:55:58 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:55:58.752 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:55:58] "OPTIONS / HTTP/1.0" 200 134 0.000451
Sep 28 12:55:58 ctl02 nova-api[12372]: 2017-09-28 12:55:58.753 12372 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:55:58 ctl02 nova-api[12372]: 2017-09-28 12:55:58.753 12372 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:55:58 ctl02 nova-api[12372]: 2017-09-28 12:55:58.753 12372 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:55:58 ctl02 nova-api[12372]: 2017-09-28 12:55:58.753 12372 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:55:58 ctl02 nova-api[12372]: 2017-09-28 12:55:58.753 12372 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:55:58 ctl02 nova-api[12372]: 2017-09-28 12:55:58.753 12372 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:55:58 ctl02 nova-api[12372]: 2017-09-28 12:55:58.753 12372 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:55:58 ctl02 nova-api[12372]: 2017-09-28 12:55:58.753 12372 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:55:58 ctl02 nova-api[12372]: 2017-09-28 12:55:58.753 12372 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:55:58 ctl02 nova-api[12372]: 2017-09-28 12:55:58.753 12372 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:55:58 ctl02 nova-api[12372]: 2017-09-28 12:55:58.753 12372 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:55:58 ctl02 nova-api[12372]: 2017-09-28 12:55:58.753 12372 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:55:58 ctl02 nova-api[12372]: 2017-09-28 12:55:58.753 12372 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:55:58 ctl02 nova-api[12372]: 2017-09-28 12:55:58.753 12372 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:55:58 ctl02 nova-api[12372]: 2017-09-28 12:55:58.753 12372 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:55:58 ctl02 nova-api[12372]: 2017-09-28 12:55:58.753 12372 ERROR nova.wsgi     self.filename))
Sep 28 12:55:58 ctl02 nova-api[12372]: 2017-09-28 12:55:58.753 12372 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:55:58 ctl02 nova-api[12372]: 2017-09-28 12:55:58.753 12372 ERROR nova.wsgi
Sep 28 12:55:58 ctl02 nova-api[12372]: 2017-09-28 12:55:58.754 12372 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:55:58 ctl02 nova-api[12372]: 2017-09-28 12:55:58.883 12372 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:55:59 ctl02 nova-api[12372]: 2017-09-28 12:55:59.127 12372 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:55:59 ctl02 nova-api[12372]: 2017-09-28 12:55:59.130 12372 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:55:59 ctl02 nova-api[12372]: 2017-09-28 12:55:59.130 12372 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:55:59 ctl02 nova-api[12372]: 2017-09-28 12:55:59.130 12372 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:55:59 ctl02 nova-api[12372]: 2017-09-28 12:55:59.261 12372 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:55:59 ctl02 nova-api[12372]: 2017-09-28 12:55:59.263 12372 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:55:59 ctl02 nova-api[12372]: 2017-09-28 12:55:59.263 12372 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:55:59 ctl02 nova-api[12372]: 2017-09-28 12:55:59.263 12372 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:55:59 ctl02 nova-api[12372]: 2017-09-28 12:55:59.266 12372 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:55:59 ctl02 nova-api[12372]: 2017-09-28 12:55:59.267 12372 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:55:59 ctl02 nova-api[12372]: 2017-09-28 12:55:59.267 12372 ERROR nova Traceback (most recent call last):
Sep 28 12:55:59 ctl02 nova-api[12372]: 2017-09-28 12:55:59.267 12372 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:55:59 ctl02 nova-api[12372]: 2017-09-28 12:55:59.267 12372 ERROR nova     sys.exit(main())
Sep 28 12:55:59 ctl02 nova-api[12372]: 2017-09-28 12:55:59.267 12372 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:55:59 ctl02 nova-api[12372]: 2017-09-28 12:55:59.267 12372 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:55:59 ctl02 nova-api[12372]: 2017-09-28 12:55:59.267 12372 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:55:59 ctl02 nova-api[12372]: 2017-09-28 12:55:59.267 12372 ERROR nova     max_url_len=max_url_len)
Sep 28 12:55:59 ctl02 nova-api[12372]: 2017-09-28 12:55:59.267 12372 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:55:59 ctl02 nova-api[12372]: 2017-09-28 12:55:59.267 12372 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:55:59 ctl02 nova-api[12372]: 2017-09-28 12:55:59.267 12372 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:55:59 ctl02 nova-api[12372]: 2017-09-28 12:55:59.267 12372 ERROR nova     sock.listen(backlog)
Sep 28 12:55:59 ctl02 nova-api[12372]: 2017-09-28 12:55:59.267 12372 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:55:59 ctl02 nova-api[12372]: 2017-09-28 12:55:59.267 12372 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:55:59 ctl02 nova-api[12372]: 2017-09-28 12:55:59.267 12372 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:55:59 ctl02 nova-api[12372]: 2017-09-28 12:55:59.267 12372 ERROR nova
Sep 28 12:55:59 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:55:59 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:55:59 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:55:59 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:55:59 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:55:59 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:55:59 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:55:59 ctl02 glance-api[29183]: 2017-09-28 12:55:59.653 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:55:59] "OPTIONS / HTTP/1.0" 200 134 0.000984
Sep 28 12:56:00 ctl02 heat-api-cfn[13300]: 2017-09-28 12:56:00.431 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:56:00] "OPTIONS / HTTP/1.0" 200 134 0.000554
Sep 28 12:56:01 ctl02 glance-api[29183]: 2017-09-28 12:56:01.115 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:56:01] "OPTIONS / HTTP/1.0" 200 134 0.000631
Sep 28 12:56:01 ctl02 nova-api[12390]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:56:01 ctl02 nova-api[12390]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:56:01 ctl02 neutron-server[30536]: 2017-09-28 12:56:01.443 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:56:01] "OPTIONS / HTTP/1.0" 200 262 0.000479
Sep 28 12:56:01 ctl02 nova-api[12390]: 2017-09-28 12:56:01.527 12390 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:56:01 ctl02 nova-api[12390]: 2017-09-28 12:56:01.529 12390 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:56:01 ctl02 nova-api[12390]: 2017-09-28 12:56:01.529 12390 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:56:01 ctl02 nova-api[12390]: 2017-09-28 12:56:01.529 12390 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:56:01 ctl02 nova-api[12390]: 2017-09-28 12:56:01.529 12390 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:56:01 ctl02 nova-api[12390]: 2017-09-28 12:56:01.529 12390 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:56:01 ctl02 nova-api[12390]: 2017-09-28 12:56:01.529 12390 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:56:01 ctl02 nova-api[12390]: 2017-09-28 12:56:01.529 12390 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:56:01 ctl02 nova-api[12390]: 2017-09-28 12:56:01.529 12390 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:56:01 ctl02 nova-api[12390]: 2017-09-28 12:56:01.529 12390 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:56:01 ctl02 nova-api[12390]: 2017-09-28 12:56:01.529 12390 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:56:01 ctl02 nova-api[12390]: 2017-09-28 12:56:01.529 12390 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:56:01 ctl02 nova-api[12390]: 2017-09-28 12:56:01.529 12390 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:56:01 ctl02 nova-api[12390]: 2017-09-28 12:56:01.529 12390 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:56:01 ctl02 nova-api[12390]: 2017-09-28 12:56:01.529 12390 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:56:01 ctl02 nova-api[12390]: 2017-09-28 12:56:01.529 12390 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:56:01 ctl02 nova-api[12390]: 2017-09-28 12:56:01.529 12390 ERROR nova.wsgi     self.filename))
Sep 28 12:56:01 ctl02 nova-api[12390]: 2017-09-28 12:56:01.529 12390 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:56:01 ctl02 nova-api[12390]: 2017-09-28 12:56:01.529 12390 ERROR nova.wsgi
Sep 28 12:56:01 ctl02 nova-api[12390]: 2017-09-28 12:56:01.531 12390 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:56:01 ctl02 nova-api[12390]: 2017-09-28 12:56:01.663 12390 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:56:01 ctl02 nova-api[12390]: 2017-09-28 12:56:01.906 12390 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:56:01 ctl02 nova-api[12390]: 2017-09-28 12:56:01.908 12390 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:56:01 ctl02 nova-api[12390]: 2017-09-28 12:56:01.908 12390 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:56:01 ctl02 nova-api[12390]: 2017-09-28 12:56:01.909 12390 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:56:02 ctl02 nova-api[12390]: 2017-09-28 12:56:02.042 12390 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:56:02 ctl02 nova-api[12390]: 2017-09-28 12:56:02.045 12390 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:56:02 ctl02 nova-api[12390]: 2017-09-28 12:56:02.045 12390 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:56:02 ctl02 nova-api[12390]: 2017-09-28 12:56:02.046 12390 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:56:02 ctl02 nova-api[12390]: 2017-09-28 12:56:02.049 12390 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:56:02 ctl02 nova-api[12390]: 2017-09-28 12:56:02.050 12390 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:56:02 ctl02 nova-api[12390]: 2017-09-28 12:56:02.050 12390 ERROR nova Traceback (most recent call last):
Sep 28 12:56:02 ctl02 nova-api[12390]: 2017-09-28 12:56:02.050 12390 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:56:02 ctl02 nova-api[12390]: 2017-09-28 12:56:02.050 12390 ERROR nova     sys.exit(main())
Sep 28 12:56:02 ctl02 nova-api[12390]: 2017-09-28 12:56:02.050 12390 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:56:02 ctl02 nova-api[12390]: 2017-09-28 12:56:02.050 12390 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:56:02 ctl02 nova-api[12390]: 2017-09-28 12:56:02.050 12390 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:56:02 ctl02 nova-api[12390]: 2017-09-28 12:56:02.050 12390 ERROR nova     max_url_len=max_url_len)
Sep 28 12:56:02 ctl02 nova-api[12390]: 2017-09-28 12:56:02.050 12390 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:56:02 ctl02 nova-api[12390]: 2017-09-28 12:56:02.050 12390 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:56:02 ctl02 nova-api[12390]: 2017-09-28 12:56:02.050 12390 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:56:02 ctl02 nova-api[12390]: 2017-09-28 12:56:02.050 12390 ERROR nova     sock.listen(backlog)
Sep 28 12:56:02 ctl02 nova-api[12390]: 2017-09-28 12:56:02.050 12390 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:56:02 ctl02 nova-api[12390]: 2017-09-28 12:56:02.050 12390 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:56:02 ctl02 nova-api[12390]: 2017-09-28 12:56:02.050 12390 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:56:02 ctl02 nova-api[12390]: 2017-09-28 12:56:02.050 12390 ERROR nova
Sep 28 12:56:02 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:56:02 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:56:02 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:56:02 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:56:02 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:56:02 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:56:02 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:56:02 ctl02 glance-api[29183]: 2017-09-28 12:56:02.841 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:56:02] "OPTIONS / HTTP/1.0" 200 134 0.000638
Sep 28 12:56:03 ctl02 heat-api[13008]: 2017-09-28 12:56:03.052 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:56:03] "OPTIONS / HTTP/1.0" 200 134 0.000624
Sep 28 12:56:04 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc9c12155)
Sep 28 12:56:04 ctl02 neutron-server[30536]: 2017-09-28 12:56:04.021 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:56:04] "OPTIONS / HTTP/1.0" 200 262 0.000530
Sep 28 12:56:04 ctl02 nova-api[12408]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:56:04 ctl02 nova-api[12408]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:56:04 ctl02 heat-api[13008]: 2017-09-28 12:56:04.220 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:56:04] "OPTIONS / HTTP/1.0" 200 134 0.000565
Sep 28 12:56:04 ctl02 nova-api[12408]: 2017-09-28 12:56:04.264 12408 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:56:04 ctl02 nova-api[12408]: 2017-09-28 12:56:04.265 12408 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:56:04 ctl02 nova-api[12408]: 2017-09-28 12:56:04.265 12408 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:56:04 ctl02 nova-api[12408]: 2017-09-28 12:56:04.265 12408 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:56:04 ctl02 nova-api[12408]: 2017-09-28 12:56:04.265 12408 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:56:04 ctl02 nova-api[12408]: 2017-09-28 12:56:04.265 12408 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:56:04 ctl02 nova-api[12408]: 2017-09-28 12:56:04.265 12408 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:56:04 ctl02 nova-api[12408]: 2017-09-28 12:56:04.265 12408 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:56:04 ctl02 nova-api[12408]: 2017-09-28 12:56:04.265 12408 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:56:04 ctl02 nova-api[12408]: 2017-09-28 12:56:04.265 12408 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:56:04 ctl02 nova-api[12408]: 2017-09-28 12:56:04.265 12408 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:56:04 ctl02 nova-api[12408]: 2017-09-28 12:56:04.265 12408 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:56:04 ctl02 nova-api[12408]: 2017-09-28 12:56:04.265 12408 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:56:04 ctl02 nova-api[12408]: 2017-09-28 12:56:04.265 12408 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:56:04 ctl02 nova-api[12408]: 2017-09-28 12:56:04.265 12408 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:56:04 ctl02 nova-api[12408]: 2017-09-28 12:56:04.265 12408 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:56:04 ctl02 nova-api[12408]: 2017-09-28 12:56:04.265 12408 ERROR nova.wsgi     self.filename))
Sep 28 12:56:04 ctl02 nova-api[12408]: 2017-09-28 12:56:04.265 12408 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:56:04 ctl02 nova-api[12408]: 2017-09-28 12:56:04.265 12408 ERROR nova.wsgi
Sep 28 12:56:04 ctl02 nova-api[12408]: 2017-09-28 12:56:04.268 12408 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:56:04 ctl02 neutron-server[30536]: 2017-09-28 12:56:04.280 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:56:04] "OPTIONS / HTTP/1.0" 200 262 0.000489
Sep 28 12:56:04 ctl02 nova-api[12408]: 2017-09-28 12:56:04.399 12408 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:56:04 ctl02 nova-api[12408]: 2017-09-28 12:56:04.631 12408 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:56:04 ctl02 nova-api[12408]: 2017-09-28 12:56:04.633 12408 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:56:04 ctl02 nova-api[12408]: 2017-09-28 12:56:04.634 12408 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:56:04 ctl02 nova-api[12408]: 2017-09-28 12:56:04.634 12408 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:56:04 ctl02 nova-api[12408]: 2017-09-28 12:56:04.764 12408 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:56:04 ctl02 nova-api[12408]: 2017-09-28 12:56:04.766 12408 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:56:04 ctl02 nova-api[12408]: 2017-09-28 12:56:04.767 12408 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:56:04 ctl02 nova-api[12408]: 2017-09-28 12:56:04.767 12408 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:56:04 ctl02 nova-api[12408]: 2017-09-28 12:56:04.770 12408 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:56:04 ctl02 nova-api[12408]: 2017-09-28 12:56:04.770 12408 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:56:04 ctl02 nova-api[12408]: 2017-09-28 12:56:04.770 12408 ERROR nova Traceback (most recent call last):
Sep 28 12:56:04 ctl02 nova-api[12408]: 2017-09-28 12:56:04.770 12408 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:56:04 ctl02 nova-api[12408]: 2017-09-28 12:56:04.770 12408 ERROR nova     sys.exit(main())
Sep 28 12:56:04 ctl02 nova-api[12408]: 2017-09-28 12:56:04.770 12408 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:56:04 ctl02 nova-api[12408]: 2017-09-28 12:56:04.770 12408 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:56:04 ctl02 nova-api[12408]: 2017-09-28 12:56:04.770 12408 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:56:04 ctl02 nova-api[12408]: 2017-09-28 12:56:04.770 12408 ERROR nova     max_url_len=max_url_len)
Sep 28 12:56:04 ctl02 nova-api[12408]: 2017-09-28 12:56:04.770 12408 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:56:04 ctl02 nova-api[12408]: 2017-09-28 12:56:04.770 12408 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:56:04 ctl02 nova-api[12408]: 2017-09-28 12:56:04.770 12408 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:56:04 ctl02 nova-api[12408]: 2017-09-28 12:56:04.770 12408 ERROR nova     sock.listen(backlog)
Sep 28 12:56:04 ctl02 nova-api[12408]: 2017-09-28 12:56:04.770 12408 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:56:04 ctl02 nova-api[12408]: 2017-09-28 12:56:04.770 12408 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:56:04 ctl02 nova-api[12408]: 2017-09-28 12:56:04.770 12408 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:56:04 ctl02 nova-api[12408]: 2017-09-28 12:56:04.770 12408 ERROR nova
Sep 28 12:56:04 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:56:04 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:56:04 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:56:05 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc9c12155)
Sep 28 12:56:05 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:56:05 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:56:05 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:56:05 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:56:05 ctl02 heat-api-cfn[13300]: 2017-09-28 12:56:05.672 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:56:05] "OPTIONS / HTTP/1.0" 200 134 0.000477
Sep 28 12:56:06 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc9c12155)
Sep 28 12:56:06 ctl02 neutron-server[30536]: 2017-09-28 12:56:06.118 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 2 dead agents out of 6:
Sep 28 12:56:06 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:56:06 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:55:06 cmp002
Sep 28 12:56:06 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:54:26 cmp002
Sep 28 12:56:06 ctl02 nova-api[12427]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:56:06 ctl02 nova-api[12427]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:56:06 ctl02 nova-api[12427]: 2017-09-28 12:56:06.989 12427 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:56:06 ctl02 nova-api[12427]: 2017-09-28 12:56:06.991 12427 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:56:06 ctl02 nova-api[12427]: 2017-09-28 12:56:06.991 12427 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:56:06 ctl02 nova-api[12427]: 2017-09-28 12:56:06.991 12427 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:56:06 ctl02 nova-api[12427]: 2017-09-28 12:56:06.991 12427 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:56:06 ctl02 nova-api[12427]: 2017-09-28 12:56:06.991 12427 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:56:06 ctl02 nova-api[12427]: 2017-09-28 12:56:06.991 12427 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:56:06 ctl02 nova-api[12427]: 2017-09-28 12:56:06.991 12427 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:56:06 ctl02 nova-api[12427]: 2017-09-28 12:56:06.991 12427 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:56:06 ctl02 nova-api[12427]: 2017-09-28 12:56:06.991 12427 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:56:06 ctl02 nova-api[12427]: 2017-09-28 12:56:06.991 12427 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:56:06 ctl02 nova-api[12427]: 2017-09-28 12:56:06.991 12427 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:56:06 ctl02 nova-api[12427]: 2017-09-28 12:56:06.991 12427 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:56:06 ctl02 nova-api[12427]: 2017-09-28 12:56:06.991 12427 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:56:06 ctl02 nova-api[12427]: 2017-09-28 12:56:06.991 12427 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:56:06 ctl02 nova-api[12427]: 2017-09-28 12:56:06.991 12427 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:56:06 ctl02 nova-api[12427]: 2017-09-28 12:56:06.991 12427 ERROR nova.wsgi     self.filename))
Sep 28 12:56:06 ctl02 nova-api[12427]: 2017-09-28 12:56:06.991 12427 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:56:06 ctl02 nova-api[12427]: 2017-09-28 12:56:06.991 12427 ERROR nova.wsgi
Sep 28 12:56:06 ctl02 nova-api[12427]: 2017-09-28 12:56:06.992 12427 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:56:07 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc9c12155)
Sep 28 12:56:07 ctl02 heat-api-cfn[13300]: 2017-09-28 12:56:07.033 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:56:07] "OPTIONS / HTTP/1.0" 200 134 0.000496
Sep 28 12:56:07 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:56:07.043 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:56:07] "OPTIONS / HTTP/1.0" 200 134 0.000392
Sep 28 12:56:07 ctl02 nova-api[12427]: 2017-09-28 12:56:07.126 12427 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:56:07 ctl02 nova-conductor[5056]: 2017-09-28 12:56:07.191 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:56:07 ctl02 nova-conductor[5056]: 2017-09-28 12:56:07.196 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:56:07 ctl02 nova-conductor[5056]: 2017-09-28 12:56:07.201 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:56:07 ctl02 nova-conductor[5056]: 2017-09-28 12:56:07.205 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:56:07 ctl02 nova-api[12427]: 2017-09-28 12:56:07.381 12427 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:56:07 ctl02 nova-api[12427]: 2017-09-28 12:56:07.383 12427 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:56:07 ctl02 nova-api[12427]: 2017-09-28 12:56:07.384 12427 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:56:07 ctl02 nova-api[12427]: 2017-09-28 12:56:07.384 12427 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:56:07 ctl02 nova-api[12427]: 2017-09-28 12:56:07.524 12427 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:56:07 ctl02 nova-api[12427]: 2017-09-28 12:56:07.526 12427 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:56:07 ctl02 nova-api[12427]: 2017-09-28 12:56:07.526 12427 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:56:07 ctl02 nova-api[12427]: 2017-09-28 12:56:07.526 12427 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:56:07 ctl02 nova-api[12427]: 2017-09-28 12:56:07.530 12427 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:56:07 ctl02 nova-api[12427]: 2017-09-28 12:56:07.530 12427 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:56:07 ctl02 nova-api[12427]: 2017-09-28 12:56:07.530 12427 ERROR nova Traceback (most recent call last):
Sep 28 12:56:07 ctl02 nova-api[12427]: 2017-09-28 12:56:07.530 12427 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:56:07 ctl02 nova-api[12427]: 2017-09-28 12:56:07.530 12427 ERROR nova     sys.exit(main())
Sep 28 12:56:07 ctl02 nova-api[12427]: 2017-09-28 12:56:07.530 12427 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:56:07 ctl02 nova-api[12427]: 2017-09-28 12:56:07.530 12427 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:56:07 ctl02 nova-api[12427]: 2017-09-28 12:56:07.530 12427 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:56:07 ctl02 nova-api[12427]: 2017-09-28 12:56:07.530 12427 ERROR nova     max_url_len=max_url_len)
Sep 28 12:56:07 ctl02 nova-api[12427]: 2017-09-28 12:56:07.530 12427 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:56:07 ctl02 nova-api[12427]: 2017-09-28 12:56:07.530 12427 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:56:07 ctl02 nova-api[12427]: 2017-09-28 12:56:07.530 12427 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:56:07 ctl02 nova-api[12427]: 2017-09-28 12:56:07.530 12427 ERROR nova     sock.listen(backlog)
Sep 28 12:56:07 ctl02 nova-api[12427]: 2017-09-28 12:56:07.530 12427 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:56:07 ctl02 nova-api[12427]: 2017-09-28 12:56:07.530 12427 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:56:07 ctl02 nova-api[12427]: 2017-09-28 12:56:07.530 12427 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:56:07 ctl02 nova-api[12427]: 2017-09-28 12:56:07.530 12427 ERROR nova
Sep 28 12:56:07 ctl02 nova-cert[4860]: 2017-09-28 12:56:07.558 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:56:07 ctl02 heat-api[13008]: 2017-09-28 12:56:07.619 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:56:07] "OPTIONS / HTTP/1.0" 200 134 0.000596
Sep 28 12:56:07 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:56:07 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:56:07 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:56:07 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:56:07.857 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:56:07] "OPTIONS / HTTP/1.0" 200 134 0.000454
Sep 28 12:56:07 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:56:07 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:56:07 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:56:07 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:56:08 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc9c12155)
Sep 28 12:56:09 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc9c12155)
Sep 28 12:56:09 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:56:09.128 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:56:09] "OPTIONS / HTTP/1.0" 200 134 0.000403
Sep 28 12:56:09 ctl02 nova-api[12444]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:56:09 ctl02 nova-api[12444]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:56:09 ctl02 glance-api[29183]: 2017-09-28 12:56:09.586 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:56:09] "OPTIONS / HTTP/1.0" 200 134 0.001094
Sep 28 12:56:09 ctl02 nova-api[12444]: 2017-09-28 12:56:09.739 12444 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:56:09 ctl02 nova-api[12444]: 2017-09-28 12:56:09.741 12444 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:56:09 ctl02 nova-api[12444]: 2017-09-28 12:56:09.741 12444 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:56:09 ctl02 nova-api[12444]: 2017-09-28 12:56:09.741 12444 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:56:09 ctl02 nova-api[12444]: 2017-09-28 12:56:09.741 12444 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:56:09 ctl02 nova-api[12444]: 2017-09-28 12:56:09.741 12444 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:56:09 ctl02 nova-api[12444]: 2017-09-28 12:56:09.741 12444 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:56:09 ctl02 nova-api[12444]: 2017-09-28 12:56:09.741 12444 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:56:09 ctl02 nova-api[12444]: 2017-09-28 12:56:09.741 12444 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:56:09 ctl02 nova-api[12444]: 2017-09-28 12:56:09.741 12444 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:56:09 ctl02 nova-api[12444]: 2017-09-28 12:56:09.741 12444 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:56:09 ctl02 nova-api[12444]: 2017-09-28 12:56:09.741 12444 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:56:09 ctl02 nova-api[12444]: 2017-09-28 12:56:09.741 12444 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:56:09 ctl02 nova-api[12444]: 2017-09-28 12:56:09.741 12444 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:56:09 ctl02 nova-api[12444]: 2017-09-28 12:56:09.741 12444 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:56:09 ctl02 nova-api[12444]: 2017-09-28 12:56:09.741 12444 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:56:09 ctl02 nova-api[12444]: 2017-09-28 12:56:09.741 12444 ERROR nova.wsgi     self.filename))
Sep 28 12:56:09 ctl02 nova-api[12444]: 2017-09-28 12:56:09.741 12444 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:56:09 ctl02 nova-api[12444]: 2017-09-28 12:56:09.741 12444 ERROR nova.wsgi
Sep 28 12:56:09 ctl02 nova-api[12444]: 2017-09-28 12:56:09.742 12444 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:56:09 ctl02 nova-api[12444]: 2017-09-28 12:56:09.870 12444 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:56:10 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc9c12155)
Sep 28 12:56:10 ctl02 nova-api[12444]: 2017-09-28 12:56:10.106 12444 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:56:10 ctl02 nova-api[12444]: 2017-09-28 12:56:10.108 12444 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:56:10 ctl02 nova-api[12444]: 2017-09-28 12:56:10.108 12444 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:56:10 ctl02 nova-api[12444]: 2017-09-28 12:56:10.108 12444 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:56:10 ctl02 nova-api[12444]: 2017-09-28 12:56:10.240 12444 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:56:10 ctl02 nova-api[12444]: 2017-09-28 12:56:10.242 12444 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:56:10 ctl02 nova-api[12444]: 2017-09-28 12:56:10.242 12444 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:56:10 ctl02 nova-api[12444]: 2017-09-28 12:56:10.242 12444 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:56:10 ctl02 nova-api[12444]: 2017-09-28 12:56:10.246 12444 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:56:10 ctl02 nova-api[12444]: 2017-09-28 12:56:10.246 12444 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:56:10 ctl02 nova-api[12444]: 2017-09-28 12:56:10.246 12444 ERROR nova Traceback (most recent call last):
Sep 28 12:56:10 ctl02 nova-api[12444]: 2017-09-28 12:56:10.246 12444 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:56:10 ctl02 nova-api[12444]: 2017-09-28 12:56:10.246 12444 ERROR nova     sys.exit(main())
Sep 28 12:56:10 ctl02 nova-api[12444]: 2017-09-28 12:56:10.246 12444 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:56:10 ctl02 nova-api[12444]: 2017-09-28 12:56:10.246 12444 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:56:10 ctl02 nova-api[12444]: 2017-09-28 12:56:10.246 12444 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:56:10 ctl02 nova-api[12444]: 2017-09-28 12:56:10.246 12444 ERROR nova     max_url_len=max_url_len)
Sep 28 12:56:10 ctl02 nova-api[12444]: 2017-09-28 12:56:10.246 12444 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:56:10 ctl02 nova-api[12444]: 2017-09-28 12:56:10.246 12444 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:56:10 ctl02 nova-api[12444]: 2017-09-28 12:56:10.246 12444 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:56:10 ctl02 nova-api[12444]: 2017-09-28 12:56:10.246 12444 ERROR nova     sock.listen(backlog)
Sep 28 12:56:10 ctl02 nova-api[12444]: 2017-09-28 12:56:10.246 12444 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:56:10 ctl02 nova-api[12444]: 2017-09-28 12:56:10.246 12444 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:56:10 ctl02 nova-api[12444]: 2017-09-28 12:56:10.246 12444 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:56:10 ctl02 nova-api[12444]: 2017-09-28 12:56:10.246 12444 ERROR nova
Sep 28 12:56:10 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:56:10 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:56:10 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:56:10 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:56:10 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:56:10 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:56:10 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:56:10 ctl02 heat-api-cfn[13300]: 2017-09-28 12:56:10.750 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:56:10] "OPTIONS / HTTP/1.0" 200 134 0.000484
Sep 28 12:56:11 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc9c12155)
Sep 28 12:56:11 ctl02 glance-api[29183]: 2017-09-28 12:56:11.429 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:56:11] "OPTIONS / HTTP/1.0" 200 134 0.000837
Sep 28 12:56:11 ctl02 neutron-server[30536]: 2017-09-28 12:56:11.797 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:56:11] "OPTIONS / HTTP/1.0" 200 262 0.000496
Sep 28 12:56:12 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc9c12155)
Sep 28 12:56:12 ctl02 nova-api[12463]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:56:12 ctl02 nova-api[12463]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:56:12 ctl02 nova-api[12463]: 2017-09-28 12:56:12.520 12463 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:56:12 ctl02 nova-api[12463]: 2017-09-28 12:56:12.522 12463 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:56:12 ctl02 nova-api[12463]: 2017-09-28 12:56:12.522 12463 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:56:12 ctl02 nova-api[12463]: 2017-09-28 12:56:12.522 12463 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:56:12 ctl02 nova-api[12463]: 2017-09-28 12:56:12.522 12463 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:56:12 ctl02 nova-api[12463]: 2017-09-28 12:56:12.522 12463 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:56:12 ctl02 nova-api[12463]: 2017-09-28 12:56:12.522 12463 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:56:12 ctl02 nova-api[12463]: 2017-09-28 12:56:12.522 12463 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:56:12 ctl02 nova-api[12463]: 2017-09-28 12:56:12.522 12463 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:56:12 ctl02 nova-api[12463]: 2017-09-28 12:56:12.522 12463 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:56:12 ctl02 nova-api[12463]: 2017-09-28 12:56:12.522 12463 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:56:12 ctl02 nova-api[12463]: 2017-09-28 12:56:12.522 12463 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:56:12 ctl02 nova-api[12463]: 2017-09-28 12:56:12.522 12463 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:56:12 ctl02 nova-api[12463]: 2017-09-28 12:56:12.522 12463 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:56:12 ctl02 nova-api[12463]: 2017-09-28 12:56:12.522 12463 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:56:12 ctl02 nova-api[12463]: 2017-09-28 12:56:12.522 12463 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:56:12 ctl02 nova-api[12463]: 2017-09-28 12:56:12.522 12463 ERROR nova.wsgi     self.filename))
Sep 28 12:56:12 ctl02 nova-api[12463]: 2017-09-28 12:56:12.522 12463 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:56:12 ctl02 nova-api[12463]: 2017-09-28 12:56:12.522 12463 ERROR nova.wsgi
Sep 28 12:56:12 ctl02 nova-api[12463]: 2017-09-28 12:56:12.524 12463 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:56:12 ctl02 nova-api[12463]: 2017-09-28 12:56:12.654 12463 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:56:12 ctl02 heat-api[13008]: 2017-09-28 12:56:12.777 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:56:12] "OPTIONS / HTTP/1.0" 200 134 0.000576
Sep 28 12:56:12 ctl02 nova-api[12463]: 2017-09-28 12:56:12.889 12463 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:56:12 ctl02 nova-api[12463]: 2017-09-28 12:56:12.891 12463 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:56:12 ctl02 nova-api[12463]: 2017-09-28 12:56:12.891 12463 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:56:12 ctl02 nova-api[12463]: 2017-09-28 12:56:12.892 12463 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:56:13 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc9c12155)
Sep 28 12:56:13 ctl02 nova-api[12463]: 2017-09-28 12:56:13.024 12463 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:56:13 ctl02 nova-api[12463]: 2017-09-28 12:56:13.026 12463 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:56:13 ctl02 nova-api[12463]: 2017-09-28 12:56:13.026 12463 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:56:13 ctl02 nova-api[12463]: 2017-09-28 12:56:13.027 12463 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:56:13 ctl02 nova-api[12463]: 2017-09-28 12:56:13.030 12463 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:56:13 ctl02 nova-api[12463]: 2017-09-28 12:56:13.030 12463 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:56:13 ctl02 nova-api[12463]: 2017-09-28 12:56:13.030 12463 ERROR nova Traceback (most recent call last):
Sep 28 12:56:13 ctl02 nova-api[12463]: 2017-09-28 12:56:13.030 12463 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:56:13 ctl02 nova-api[12463]: 2017-09-28 12:56:13.030 12463 ERROR nova     sys.exit(main())
Sep 28 12:56:13 ctl02 nova-api[12463]: 2017-09-28 12:56:13.030 12463 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:56:13 ctl02 nova-api[12463]: 2017-09-28 12:56:13.030 12463 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:56:13 ctl02 nova-api[12463]: 2017-09-28 12:56:13.030 12463 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:56:13 ctl02 nova-api[12463]: 2017-09-28 12:56:13.030 12463 ERROR nova     max_url_len=max_url_len)
Sep 28 12:56:13 ctl02 nova-api[12463]: 2017-09-28 12:56:13.030 12463 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:56:13 ctl02 nova-api[12463]: 2017-09-28 12:56:13.030 12463 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:56:13 ctl02 nova-api[12463]: 2017-09-28 12:56:13.030 12463 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:56:13 ctl02 nova-api[12463]: 2017-09-28 12:56:13.030 12463 ERROR nova     sock.listen(backlog)
Sep 28 12:56:13 ctl02 nova-api[12463]: 2017-09-28 12:56:13.030 12463 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:56:13 ctl02 nova-api[12463]: 2017-09-28 12:56:13.030 12463 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:56:13 ctl02 nova-api[12463]: 2017-09-28 12:56:13.030 12463 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:56:13 ctl02 nova-api[12463]: 2017-09-28 12:56:13.030 12463 ERROR nova
Sep 28 12:56:13 ctl02 glance-api[29183]: 2017-09-28 12:56:13.176 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:56:13] "OPTIONS / HTTP/1.0" 200 134 0.000619
Sep 28 12:56:13 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:56:13 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:56:13 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:56:13 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:56:13 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:56:13 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:56:13 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:56:13 ctl02 neutron-server[30536]: 2017-09-28 12:56:13.973 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:56:13] "OPTIONS / HTTP/1.0" 200 262 0.000494
Sep 28 12:56:13 ctl02 neutron-server[30536]: 2017-09-28 12:56:13.990 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:56:13] "OPTIONS / HTTP/1.0" 200 262 0.000325
Sep 28 12:56:14 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xc9c12155)
Sep 28 12:56:14 ctl02 heat-api[13008]: 2017-09-28 12:56:14.245 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:56:14] "OPTIONS / HTTP/1.0" 200 134 0.000625
Sep 28 12:56:15 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:56:15 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:56:15 ctl02 nova-api[12481]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:56:15 ctl02 nova-api[12481]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:56:15 ctl02 nova-api[12481]: 2017-09-28 12:56:15.288 12481 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:56:15 ctl02 nova-api[12481]: 2017-09-28 12:56:15.290 12481 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:56:15 ctl02 nova-api[12481]: 2017-09-28 12:56:15.290 12481 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:56:15 ctl02 nova-api[12481]: 2017-09-28 12:56:15.290 12481 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:56:15 ctl02 nova-api[12481]: 2017-09-28 12:56:15.290 12481 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:56:15 ctl02 nova-api[12481]: 2017-09-28 12:56:15.290 12481 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:56:15 ctl02 nova-api[12481]: 2017-09-28 12:56:15.290 12481 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:56:15 ctl02 nova-api[12481]: 2017-09-28 12:56:15.290 12481 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:56:15 ctl02 nova-api[12481]: 2017-09-28 12:56:15.290 12481 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:56:15 ctl02 nova-api[12481]: 2017-09-28 12:56:15.290 12481 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:56:15 ctl02 nova-api[12481]: 2017-09-28 12:56:15.290 12481 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:56:15 ctl02 nova-api[12481]: 2017-09-28 12:56:15.290 12481 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:56:15 ctl02 nova-api[12481]: 2017-09-28 12:56:15.290 12481 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:56:15 ctl02 nova-api[12481]: 2017-09-28 12:56:15.290 12481 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:56:15 ctl02 nova-api[12481]: 2017-09-28 12:56:15.290 12481 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:56:15 ctl02 nova-api[12481]: 2017-09-28 12:56:15.290 12481 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:56:15 ctl02 nova-api[12481]: 2017-09-28 12:56:15.290 12481 ERROR nova.wsgi     self.filename))
Sep 28 12:56:15 ctl02 nova-api[12481]: 2017-09-28 12:56:15.290 12481 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:56:15 ctl02 nova-api[12481]: 2017-09-28 12:56:15.290 12481 ERROR nova.wsgi
Sep 28 12:56:15 ctl02 nova-api[12481]: 2017-09-28 12:56:15.291 12481 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:56:15 ctl02 nova-api[12481]: 2017-09-28 12:56:15.426 12481 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:56:15 ctl02 heat-api-cfn[13300]: 2017-09-28 12:56:15.485 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:56:15] "OPTIONS / HTTP/1.0" 200 134 0.000482
Sep 28 12:56:15 ctl02 nova-api[12481]: 2017-09-28 12:56:15.677 12481 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:56:15 ctl02 nova-api[12481]: 2017-09-28 12:56:15.679 12481 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:56:15 ctl02 nova-api[12481]: 2017-09-28 12:56:15.679 12481 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:56:15 ctl02 nova-api[12481]: 2017-09-28 12:56:15.680 12481 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:56:15 ctl02 nova-api[12481]: 2017-09-28 12:56:15.812 12481 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:56:15 ctl02 nova-api[12481]: 2017-09-28 12:56:15.814 12481 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:56:15 ctl02 nova-api[12481]: 2017-09-28 12:56:15.814 12481 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:56:15 ctl02 nova-api[12481]: 2017-09-28 12:56:15.814 12481 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:56:15 ctl02 nova-api[12481]: 2017-09-28 12:56:15.817 12481 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:56:15 ctl02 nova-api[12481]: 2017-09-28 12:56:15.818 12481 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:56:15 ctl02 nova-api[12481]: 2017-09-28 12:56:15.818 12481 ERROR nova Traceback (most recent call last):
Sep 28 12:56:15 ctl02 nova-api[12481]: 2017-09-28 12:56:15.818 12481 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:56:15 ctl02 nova-api[12481]: 2017-09-28 12:56:15.818 12481 ERROR nova     sys.exit(main())
Sep 28 12:56:15 ctl02 nova-api[12481]: 2017-09-28 12:56:15.818 12481 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:56:15 ctl02 nova-api[12481]: 2017-09-28 12:56:15.818 12481 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:56:15 ctl02 nova-api[12481]: 2017-09-28 12:56:15.818 12481 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:56:15 ctl02 nova-api[12481]: 2017-09-28 12:56:15.818 12481 ERROR nova     max_url_len=max_url_len)
Sep 28 12:56:15 ctl02 nova-api[12481]: 2017-09-28 12:56:15.818 12481 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:56:15 ctl02 nova-api[12481]: 2017-09-28 12:56:15.818 12481 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:56:15 ctl02 nova-api[12481]: 2017-09-28 12:56:15.818 12481 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:56:15 ctl02 nova-api[12481]: 2017-09-28 12:56:15.818 12481 ERROR nova     sock.listen(backlog)
Sep 28 12:56:15 ctl02 nova-api[12481]: 2017-09-28 12:56:15.818 12481 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:56:15 ctl02 nova-api[12481]: 2017-09-28 12:56:15.818 12481 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:56:15 ctl02 nova-api[12481]: 2017-09-28 12:56:15.818 12481 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:56:15 ctl02 nova-api[12481]: 2017-09-28 12:56:15.818 12481 ERROR nova
Sep 28 12:56:15 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:56:15 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:56:15 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:56:16 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:56:16 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:56:16 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:56:16 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:56:16 ctl02 heat-api-cfn[13300]: 2017-09-28 12:56:16.798 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:56:16] "OPTIONS / HTTP/1.0" 200 134 0.000542
Sep 28 12:56:16 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:56:16.832 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:56:16] "OPTIONS / HTTP/1.0" 200 134 0.000522
Sep 28 12:56:17 ctl02 heat-api[13008]: 2017-09-28 12:56:17.326 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:56:17] "OPTIONS / HTTP/1.0" 200 134 0.000510
Sep 28 12:56:17 ctl02 nova-consoleauth[5433]: 2017-09-28 12:56:17.399 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:56:17 ctl02 nova-api[12504]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:56:17 ctl02 nova-api[12504]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:56:17 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:56:17.834 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:56:17] "OPTIONS / HTTP/1.0" 200 134 0.000433
Sep 28 12:56:18 ctl02 nova-api[12504]: 2017-09-28 12:56:18.022 12504 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:56:18 ctl02 nova-api[12504]: 2017-09-28 12:56:18.024 12504 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:56:18 ctl02 nova-api[12504]: 2017-09-28 12:56:18.024 12504 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:56:18 ctl02 nova-api[12504]: 2017-09-28 12:56:18.024 12504 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:56:18 ctl02 nova-api[12504]: 2017-09-28 12:56:18.024 12504 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:56:18 ctl02 nova-api[12504]: 2017-09-28 12:56:18.024 12504 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:56:18 ctl02 nova-api[12504]: 2017-09-28 12:56:18.024 12504 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:56:18 ctl02 nova-api[12504]: 2017-09-28 12:56:18.024 12504 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:56:18 ctl02 nova-api[12504]: 2017-09-28 12:56:18.024 12504 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:56:18 ctl02 nova-api[12504]: 2017-09-28 12:56:18.024 12504 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:56:18 ctl02 nova-api[12504]: 2017-09-28 12:56:18.024 12504 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:56:18 ctl02 nova-api[12504]: 2017-09-28 12:56:18.024 12504 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:56:18 ctl02 nova-api[12504]: 2017-09-28 12:56:18.024 12504 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:56:18 ctl02 nova-api[12504]: 2017-09-28 12:56:18.024 12504 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:56:18 ctl02 nova-api[12504]: 2017-09-28 12:56:18.024 12504 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:56:18 ctl02 nova-api[12504]: 2017-09-28 12:56:18.024 12504 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:56:18 ctl02 nova-api[12504]: 2017-09-28 12:56:18.024 12504 ERROR nova.wsgi     self.filename))
Sep 28 12:56:18 ctl02 nova-api[12504]: 2017-09-28 12:56:18.024 12504 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:56:18 ctl02 nova-api[12504]: 2017-09-28 12:56:18.024 12504 ERROR nova.wsgi
Sep 28 12:56:18 ctl02 nova-api[12504]: 2017-09-28 12:56:18.026 12504 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:56:18 ctl02 nova-api[12504]: 2017-09-28 12:56:18.162 12504 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:56:18 ctl02 heat-engine[12803]: 2017-09-28 12:56:18.316 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:56:18 ctl02 heat-engine[12803]: 2017-09-28 12:56:18.328 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:56:18 ctl02 heat-engine[12803]: 2017-09-28 12:56:18.328 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:56:18 ctl02 heat-engine[12803]: 2017-09-28 12:56:18.329 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:56:18 ctl02 nova-api[12504]: 2017-09-28 12:56:18.416 12504 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:56:18 ctl02 nova-api[12504]: 2017-09-28 12:56:18.419 12504 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:56:18 ctl02 nova-api[12504]: 2017-09-28 12:56:18.419 12504 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:56:18 ctl02 nova-api[12504]: 2017-09-28 12:56:18.419 12504 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:56:18 ctl02 nova-api[12504]: 2017-09-28 12:56:18.550 12504 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:56:18 ctl02 nova-api[12504]: 2017-09-28 12:56:18.553 12504 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:56:18 ctl02 nova-api[12504]: 2017-09-28 12:56:18.553 12504 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:56:18 ctl02 nova-api[12504]: 2017-09-28 12:56:18.553 12504 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:56:18 ctl02 nova-api[12504]: 2017-09-28 12:56:18.557 12504 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:56:18 ctl02 nova-api[12504]: 2017-09-28 12:56:18.557 12504 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:56:18 ctl02 nova-api[12504]: 2017-09-28 12:56:18.557 12504 ERROR nova Traceback (most recent call last):
Sep 28 12:56:18 ctl02 nova-api[12504]: 2017-09-28 12:56:18.557 12504 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:56:18 ctl02 nova-api[12504]: 2017-09-28 12:56:18.557 12504 ERROR nova     sys.exit(main())
Sep 28 12:56:18 ctl02 nova-api[12504]: 2017-09-28 12:56:18.557 12504 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:56:18 ctl02 nova-api[12504]: 2017-09-28 12:56:18.557 12504 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:56:18 ctl02 nova-api[12504]: 2017-09-28 12:56:18.557 12504 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:56:18 ctl02 nova-api[12504]: 2017-09-28 12:56:18.557 12504 ERROR nova     max_url_len=max_url_len)
Sep 28 12:56:18 ctl02 nova-api[12504]: 2017-09-28 12:56:18.557 12504 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:56:18 ctl02 nova-api[12504]: 2017-09-28 12:56:18.557 12504 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:56:18 ctl02 nova-api[12504]: 2017-09-28 12:56:18.557 12504 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:56:18 ctl02 nova-api[12504]: 2017-09-28 12:56:18.557 12504 ERROR nova     sock.listen(backlog)
Sep 28 12:56:18 ctl02 nova-api[12504]: 2017-09-28 12:56:18.557 12504 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:56:18 ctl02 nova-api[12504]: 2017-09-28 12:56:18.557 12504 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:56:18 ctl02 nova-api[12504]: 2017-09-28 12:56:18.557 12504 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:56:18 ctl02 nova-api[12504]: 2017-09-28 12:56:18.557 12504 ERROR nova
Sep 28 12:56:18 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:56:18 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:56:18 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:56:18 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:56:18 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:56:18 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:56:18 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:56:18 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:56:18.952 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:56:18] "OPTIONS / HTTP/1.0" 200 134 0.000500
Sep 28 12:56:19 ctl02 glance-api[29183]: 2017-09-28 12:56:19.784 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:56:19] "OPTIONS / HTTP/1.0" 200 134 0.000667
Sep 28 12:56:20 ctl02 nova-scheduler[5620]: 2017-09-28 12:56:20.492 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:56:20 ctl02 nova-api[12522]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:56:20 ctl02 nova-api[12522]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:56:20 ctl02 heat-api-cfn[13300]: 2017-09-28 12:56:20.709 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:56:20] "OPTIONS / HTTP/1.0" 200 134 0.000625
Sep 28 12:56:20 ctl02 nova-api[12522]: 2017-09-28 12:56:20.756 12522 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:56:20 ctl02 nova-api[12522]: 2017-09-28 12:56:20.757 12522 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:56:20 ctl02 nova-api[12522]: 2017-09-28 12:56:20.757 12522 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:56:20 ctl02 nova-api[12522]: 2017-09-28 12:56:20.757 12522 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:56:20 ctl02 nova-api[12522]: 2017-09-28 12:56:20.757 12522 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:56:20 ctl02 nova-api[12522]: 2017-09-28 12:56:20.757 12522 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:56:20 ctl02 nova-api[12522]: 2017-09-28 12:56:20.757 12522 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:56:20 ctl02 nova-api[12522]: 2017-09-28 12:56:20.757 12522 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:56:20 ctl02 nova-api[12522]: 2017-09-28 12:56:20.757 12522 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:56:20 ctl02 nova-api[12522]: 2017-09-28 12:56:20.757 12522 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:56:20 ctl02 nova-api[12522]: 2017-09-28 12:56:20.757 12522 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:56:20 ctl02 nova-api[12522]: 2017-09-28 12:56:20.757 12522 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:56:20 ctl02 nova-api[12522]: 2017-09-28 12:56:20.757 12522 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:56:20 ctl02 nova-api[12522]: 2017-09-28 12:56:20.757 12522 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:56:20 ctl02 nova-api[12522]: 2017-09-28 12:56:20.757 12522 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:56:20 ctl02 nova-api[12522]: 2017-09-28 12:56:20.757 12522 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:56:20 ctl02 nova-api[12522]: 2017-09-28 12:56:20.757 12522 ERROR nova.wsgi     self.filename))
Sep 28 12:56:20 ctl02 nova-api[12522]: 2017-09-28 12:56:20.757 12522 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:56:20 ctl02 nova-api[12522]: 2017-09-28 12:56:20.757 12522 ERROR nova.wsgi
Sep 28 12:56:20 ctl02 nova-api[12522]: 2017-09-28 12:56:20.760 12522 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:56:20 ctl02 nova-api[12522]: 2017-09-28 12:56:20.894 12522 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:56:21 ctl02 neutron-server[30536]: 2017-09-28 12:56:21.113 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 2 dead agents out of 6:
Sep 28 12:56:21 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:56:21 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:55:06 cmp002
Sep 28 12:56:21 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:54:26 cmp002
Sep 28 12:56:21 ctl02 nova-api[12522]: 2017-09-28 12:56:21.149 12522 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:56:21 ctl02 nova-api[12522]: 2017-09-28 12:56:21.151 12522 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:56:21 ctl02 nova-api[12522]: 2017-09-28 12:56:21.152 12522 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:56:21 ctl02 nova-api[12522]: 2017-09-28 12:56:21.152 12522 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:56:21 ctl02 glance-api[29183]: 2017-09-28 12:56:21.212 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:56:21] "OPTIONS / HTTP/1.0" 200 134 0.000723
Sep 28 12:56:21 ctl02 nova-api[12522]: 2017-09-28 12:56:21.288 12522 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:56:21 ctl02 nova-api[12522]: 2017-09-28 12:56:21.291 12522 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:56:21 ctl02 nova-api[12522]: 2017-09-28 12:56:21.291 12522 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:56:21 ctl02 nova-api[12522]: 2017-09-28 12:56:21.292 12522 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:56:21 ctl02 nova-api[12522]: 2017-09-28 12:56:21.295 12522 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:56:21 ctl02 nova-api[12522]: 2017-09-28 12:56:21.296 12522 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:56:21 ctl02 nova-api[12522]: 2017-09-28 12:56:21.296 12522 ERROR nova Traceback (most recent call last):
Sep 28 12:56:21 ctl02 nova-api[12522]: 2017-09-28 12:56:21.296 12522 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:56:21 ctl02 nova-api[12522]: 2017-09-28 12:56:21.296 12522 ERROR nova     sys.exit(main())
Sep 28 12:56:21 ctl02 nova-api[12522]: 2017-09-28 12:56:21.296 12522 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:56:21 ctl02 nova-api[12522]: 2017-09-28 12:56:21.296 12522 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:56:21 ctl02 nova-api[12522]: 2017-09-28 12:56:21.296 12522 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:56:21 ctl02 nova-api[12522]: 2017-09-28 12:56:21.296 12522 ERROR nova     max_url_len=max_url_len)
Sep 28 12:56:21 ctl02 nova-api[12522]: 2017-09-28 12:56:21.296 12522 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:56:21 ctl02 nova-api[12522]: 2017-09-28 12:56:21.296 12522 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:56:21 ctl02 nova-api[12522]: 2017-09-28 12:56:21.296 12522 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:56:21 ctl02 nova-api[12522]: 2017-09-28 12:56:21.296 12522 ERROR nova     sock.listen(backlog)
Sep 28 12:56:21 ctl02 nova-api[12522]: 2017-09-28 12:56:21.296 12522 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:56:21 ctl02 nova-api[12522]: 2017-09-28 12:56:21.296 12522 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:56:21 ctl02 nova-api[12522]: 2017-09-28 12:56:21.296 12522 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:56:21 ctl02 nova-api[12522]: 2017-09-28 12:56:21.296 12522 ERROR nova
Sep 28 12:56:21 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:56:21 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:56:21 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:56:21 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:56:21 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:56:21 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:56:21 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:56:22 ctl02 neutron-server[30536]: 2017-09-28 12:56:22.019 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:56:22] "OPTIONS / HTTP/1.0" 200 262 0.000486
Sep 28 12:56:22 ctl02 heat-api[13008]: 2017-09-28 12:56:22.482 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:56:22] "OPTIONS / HTTP/1.0" 200 134 0.000566
Sep 28 12:56:23 ctl02 glance-api[29183]: 2017-09-28 12:56:23.189 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:56:23] "OPTIONS / HTTP/1.0" 200 134 0.000611
Sep 28 12:56:23 ctl02 nova-api[12540]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:56:23 ctl02 nova-api[12540]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:56:23 ctl02 nova-api[12540]: 2017-09-28 12:56:23.525 12540 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:56:23 ctl02 nova-api[12540]: 2017-09-28 12:56:23.527 12540 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:56:23 ctl02 nova-api[12540]: 2017-09-28 12:56:23.527 12540 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:56:23 ctl02 nova-api[12540]: 2017-09-28 12:56:23.527 12540 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:56:23 ctl02 nova-api[12540]: 2017-09-28 12:56:23.527 12540 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:56:23 ctl02 nova-api[12540]: 2017-09-28 12:56:23.527 12540 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:56:23 ctl02 nova-api[12540]: 2017-09-28 12:56:23.527 12540 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:56:23 ctl02 nova-api[12540]: 2017-09-28 12:56:23.527 12540 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:56:23 ctl02 nova-api[12540]: 2017-09-28 12:56:23.527 12540 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:56:23 ctl02 nova-api[12540]: 2017-09-28 12:56:23.527 12540 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:56:23 ctl02 nova-api[12540]: 2017-09-28 12:56:23.527 12540 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:56:23 ctl02 nova-api[12540]: 2017-09-28 12:56:23.527 12540 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:56:23 ctl02 nova-api[12540]: 2017-09-28 12:56:23.527 12540 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:56:23 ctl02 nova-api[12540]: 2017-09-28 12:56:23.527 12540 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:56:23 ctl02 nova-api[12540]: 2017-09-28 12:56:23.527 12540 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:56:23 ctl02 nova-api[12540]: 2017-09-28 12:56:23.527 12540 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:56:23 ctl02 nova-api[12540]: 2017-09-28 12:56:23.527 12540 ERROR nova.wsgi     self.filename))
Sep 28 12:56:23 ctl02 nova-api[12540]: 2017-09-28 12:56:23.527 12540 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:56:23 ctl02 nova-api[12540]: 2017-09-28 12:56:23.527 12540 ERROR nova.wsgi
Sep 28 12:56:23 ctl02 nova-api[12540]: 2017-09-28 12:56:23.528 12540 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:56:23 ctl02 nova-api[12540]: 2017-09-28 12:56:23.660 12540 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:56:23 ctl02 neutron-server[30536]: 2017-09-28 12:56:23.826 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:56:23] "OPTIONS / HTTP/1.0" 200 262 0.000487
Sep 28 12:56:23 ctl02 nova-api[12540]: 2017-09-28 12:56:23.891 12540 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:56:23 ctl02 nova-api[12540]: 2017-09-28 12:56:23.893 12540 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:56:23 ctl02 nova-api[12540]: 2017-09-28 12:56:23.894 12540 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:56:23 ctl02 nova-api[12540]: 2017-09-28 12:56:23.894 12540 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:56:24 ctl02 nova-api[12540]: 2017-09-28 12:56:24.027 12540 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:56:24 ctl02 nova-api[12540]: 2017-09-28 12:56:24.029 12540 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:56:24 ctl02 nova-api[12540]: 2017-09-28 12:56:24.030 12540 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:56:24 ctl02 nova-api[12540]: 2017-09-28 12:56:24.030 12540 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:56:24 ctl02 nova-api[12540]: 2017-09-28 12:56:24.033 12540 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:56:24 ctl02 nova-api[12540]: 2017-09-28 12:56:24.033 12540 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:56:24 ctl02 nova-api[12540]: 2017-09-28 12:56:24.033 12540 ERROR nova Traceback (most recent call last):
Sep 28 12:56:24 ctl02 nova-api[12540]: 2017-09-28 12:56:24.033 12540 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:56:24 ctl02 nova-api[12540]: 2017-09-28 12:56:24.033 12540 ERROR nova     sys.exit(main())
Sep 28 12:56:24 ctl02 nova-api[12540]: 2017-09-28 12:56:24.033 12540 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:56:24 ctl02 nova-api[12540]: 2017-09-28 12:56:24.033 12540 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:56:24 ctl02 nova-api[12540]: 2017-09-28 12:56:24.033 12540 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:56:24 ctl02 nova-api[12540]: 2017-09-28 12:56:24.033 12540 ERROR nova     max_url_len=max_url_len)
Sep 28 12:56:24 ctl02 nova-api[12540]: 2017-09-28 12:56:24.033 12540 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:56:24 ctl02 nova-api[12540]: 2017-09-28 12:56:24.033 12540 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:56:24 ctl02 nova-api[12540]: 2017-09-28 12:56:24.033 12540 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:56:24 ctl02 nova-api[12540]: 2017-09-28 12:56:24.033 12540 ERROR nova     sock.listen(backlog)
Sep 28 12:56:24 ctl02 nova-api[12540]: 2017-09-28 12:56:24.033 12540 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:56:24 ctl02 nova-api[12540]: 2017-09-28 12:56:24.033 12540 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:56:24 ctl02 nova-api[12540]: 2017-09-28 12:56:24.033 12540 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:56:24 ctl02 nova-api[12540]: 2017-09-28 12:56:24.033 12540 ERROR nova
Sep 28 12:56:24 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:56:24 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:56:24 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:56:24 ctl02 heat-api[13008]: 2017-09-28 12:56:24.186 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:56:24] "OPTIONS / HTTP/1.0" 200 134 0.000625
Sep 28 12:56:24 ctl02 neutron-server[30536]: 2017-09-28 12:56:24.240 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:56:24] "OPTIONS / HTTP/1.0" 200 262 0.000479
Sep 28 12:56:24 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:56:24 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:56:24 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:56:24 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:56:25 ctl02 heat-api-cfn[13300]: 2017-09-28 12:56:25.141 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:56:25] "OPTIONS / HTTP/1.0" 200 134 0.000470
Sep 28 12:56:26 ctl02 nova-api[12556]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:56:26 ctl02 nova-api[12556]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:56:26 ctl02 nova-api[12556]: 2017-09-28 12:56:26.244 12556 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:56:26 ctl02 nova-api[12556]: 2017-09-28 12:56:26.245 12556 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:56:26 ctl02 nova-api[12556]: 2017-09-28 12:56:26.245 12556 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:56:26 ctl02 nova-api[12556]: 2017-09-28 12:56:26.245 12556 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:56:26 ctl02 nova-api[12556]: 2017-09-28 12:56:26.245 12556 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:56:26 ctl02 nova-api[12556]: 2017-09-28 12:56:26.245 12556 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:56:26 ctl02 nova-api[12556]: 2017-09-28 12:56:26.245 12556 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:56:26 ctl02 nova-api[12556]: 2017-09-28 12:56:26.245 12556 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:56:26 ctl02 nova-api[12556]: 2017-09-28 12:56:26.245 12556 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:56:26 ctl02 nova-api[12556]: 2017-09-28 12:56:26.245 12556 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:56:26 ctl02 nova-api[12556]: 2017-09-28 12:56:26.245 12556 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:56:26 ctl02 nova-api[12556]: 2017-09-28 12:56:26.245 12556 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:56:26 ctl02 nova-api[12556]: 2017-09-28 12:56:26.245 12556 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:56:26 ctl02 nova-api[12556]: 2017-09-28 12:56:26.245 12556 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:56:26 ctl02 nova-api[12556]: 2017-09-28 12:56:26.245 12556 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:56:26 ctl02 nova-api[12556]: 2017-09-28 12:56:26.245 12556 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:56:26 ctl02 nova-api[12556]: 2017-09-28 12:56:26.245 12556 ERROR nova.wsgi     self.filename))
Sep 28 12:56:26 ctl02 nova-api[12556]: 2017-09-28 12:56:26.245 12556 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:56:26 ctl02 nova-api[12556]: 2017-09-28 12:56:26.245 12556 ERROR nova.wsgi
Sep 28 12:56:26 ctl02 nova-api[12556]: 2017-09-28 12:56:26.248 12556 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:56:26 ctl02 nova-api[12556]: 2017-09-28 12:56:26.379 12556 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:56:26 ctl02 nova-api[12556]: 2017-09-28 12:56:26.617 12556 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:56:26 ctl02 nova-api[12556]: 2017-09-28 12:56:26.620 12556 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:56:26 ctl02 nova-api[12556]: 2017-09-28 12:56:26.620 12556 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:56:26 ctl02 nova-api[12556]: 2017-09-28 12:56:26.620 12556 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:56:26 ctl02 nova-api[12556]: 2017-09-28 12:56:26.752 12556 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:56:26 ctl02 nova-api[12556]: 2017-09-28 12:56:26.754 12556 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:56:26 ctl02 nova-api[12556]: 2017-09-28 12:56:26.755 12556 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:56:26 ctl02 nova-api[12556]: 2017-09-28 12:56:26.755 12556 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:56:26 ctl02 nova-api[12556]: 2017-09-28 12:56:26.758 12556 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:56:26 ctl02 nova-api[12556]: 2017-09-28 12:56:26.759 12556 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:56:26 ctl02 nova-api[12556]: 2017-09-28 12:56:26.759 12556 ERROR nova Traceback (most recent call last):
Sep 28 12:56:26 ctl02 nova-api[12556]: 2017-09-28 12:56:26.759 12556 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:56:26 ctl02 nova-api[12556]: 2017-09-28 12:56:26.759 12556 ERROR nova     sys.exit(main())
Sep 28 12:56:26 ctl02 nova-api[12556]: 2017-09-28 12:56:26.759 12556 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:56:26 ctl02 nova-api[12556]: 2017-09-28 12:56:26.759 12556 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:56:26 ctl02 nova-api[12556]: 2017-09-28 12:56:26.759 12556 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:56:26 ctl02 nova-api[12556]: 2017-09-28 12:56:26.759 12556 ERROR nova     max_url_len=max_url_len)
Sep 28 12:56:26 ctl02 nova-api[12556]: 2017-09-28 12:56:26.759 12556 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:56:26 ctl02 nova-api[12556]: 2017-09-28 12:56:26.759 12556 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:56:26 ctl02 nova-api[12556]: 2017-09-28 12:56:26.759 12556 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:56:26 ctl02 nova-api[12556]: 2017-09-28 12:56:26.759 12556 ERROR nova     sock.listen(backlog)
Sep 28 12:56:26 ctl02 nova-api[12556]: 2017-09-28 12:56:26.759 12556 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:56:26 ctl02 nova-api[12556]: 2017-09-28 12:56:26.759 12556 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:56:26 ctl02 nova-api[12556]: 2017-09-28 12:56:26.759 12556 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:56:26 ctl02 nova-api[12556]: 2017-09-28 12:56:26.759 12556 ERROR nova
Sep 28 12:56:26 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:56:26.894 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:56:26] "OPTIONS / HTTP/1.0" 200 134 0.000403
Sep 28 12:56:26 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:56:26 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:56:26 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:56:27 ctl02 heat-api-cfn[13300]: 2017-09-28 12:56:27.070 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:56:27] "OPTIONS / HTTP/1.0" 200 134 0.000481
Sep 28 12:56:27 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:56:27 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:56:27 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:56:27 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:56:27 ctl02 heat-api[13008]: 2017-09-28 12:56:27.505 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:56:27] "OPTIONS / HTTP/1.0" 200 134 0.000620
Sep 28 12:56:27 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:56:27.993 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:56:27] "OPTIONS / HTTP/1.0" 200 134 0.000444
Sep 28 12:56:28 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:56:28.674 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:56:28] "OPTIONS / HTTP/1.0" 200 134 0.000388
Sep 28 12:56:28 ctl02 nova-api[12575]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:56:28 ctl02 nova-api[12575]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:56:29 ctl02 nova-api[12575]: 2017-09-28 12:56:29.003 12575 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:56:29 ctl02 nova-api[12575]: 2017-09-28 12:56:29.004 12575 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:56:29 ctl02 nova-api[12575]: 2017-09-28 12:56:29.004 12575 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:56:29 ctl02 nova-api[12575]: 2017-09-28 12:56:29.004 12575 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:56:29 ctl02 nova-api[12575]: 2017-09-28 12:56:29.004 12575 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:56:29 ctl02 nova-api[12575]: 2017-09-28 12:56:29.004 12575 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:56:29 ctl02 nova-api[12575]: 2017-09-28 12:56:29.004 12575 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:56:29 ctl02 nova-api[12575]: 2017-09-28 12:56:29.004 12575 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:56:29 ctl02 nova-api[12575]: 2017-09-28 12:56:29.004 12575 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:56:29 ctl02 nova-api[12575]: 2017-09-28 12:56:29.004 12575 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:56:29 ctl02 nova-api[12575]: 2017-09-28 12:56:29.004 12575 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:56:29 ctl02 nova-api[12575]: 2017-09-28 12:56:29.004 12575 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:56:29 ctl02 nova-api[12575]: 2017-09-28 12:56:29.004 12575 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:56:29 ctl02 nova-api[12575]: 2017-09-28 12:56:29.004 12575 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:56:29 ctl02 nova-api[12575]: 2017-09-28 12:56:29.004 12575 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:56:29 ctl02 nova-api[12575]: 2017-09-28 12:56:29.004 12575 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:56:29 ctl02 nova-api[12575]: 2017-09-28 12:56:29.004 12575 ERROR nova.wsgi     self.filename))
Sep 28 12:56:29 ctl02 nova-api[12575]: 2017-09-28 12:56:29.004 12575 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:56:29 ctl02 nova-api[12575]: 2017-09-28 12:56:29.004 12575 ERROR nova.wsgi
Sep 28 12:56:29 ctl02 nova-api[12575]: 2017-09-28 12:56:29.005 12575 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:56:29 ctl02 nova-api[12575]: 2017-09-28 12:56:29.134 12575 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:56:29 ctl02 nova-api[12575]: 2017-09-28 12:56:29.367 12575 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:56:29 ctl02 nova-api[12575]: 2017-09-28 12:56:29.369 12575 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:56:29 ctl02 nova-api[12575]: 2017-09-28 12:56:29.369 12575 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:56:29 ctl02 nova-api[12575]: 2017-09-28 12:56:29.369 12575 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:56:29 ctl02 nova-api[12575]: 2017-09-28 12:56:29.504 12575 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:56:29 ctl02 nova-api[12575]: 2017-09-28 12:56:29.506 12575 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:56:29 ctl02 nova-api[12575]: 2017-09-28 12:56:29.506 12575 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:56:29 ctl02 nova-api[12575]: 2017-09-28 12:56:29.506 12575 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:56:29 ctl02 nova-api[12575]: 2017-09-28 12:56:29.509 12575 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:56:29 ctl02 nova-api[12575]: 2017-09-28 12:56:29.510 12575 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:56:29 ctl02 nova-api[12575]: 2017-09-28 12:56:29.510 12575 ERROR nova Traceback (most recent call last):
Sep 28 12:56:29 ctl02 nova-api[12575]: 2017-09-28 12:56:29.510 12575 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:56:29 ctl02 nova-api[12575]: 2017-09-28 12:56:29.510 12575 ERROR nova     sys.exit(main())
Sep 28 12:56:29 ctl02 nova-api[12575]: 2017-09-28 12:56:29.510 12575 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:56:29 ctl02 nova-api[12575]: 2017-09-28 12:56:29.510 12575 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:56:29 ctl02 nova-api[12575]: 2017-09-28 12:56:29.510 12575 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:56:29 ctl02 nova-api[12575]: 2017-09-28 12:56:29.510 12575 ERROR nova     max_url_len=max_url_len)
Sep 28 12:56:29 ctl02 nova-api[12575]: 2017-09-28 12:56:29.510 12575 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:56:29 ctl02 nova-api[12575]: 2017-09-28 12:56:29.510 12575 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:56:29 ctl02 nova-api[12575]: 2017-09-28 12:56:29.510 12575 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:56:29 ctl02 nova-api[12575]: 2017-09-28 12:56:29.510 12575 ERROR nova     sock.listen(backlog)
Sep 28 12:56:29 ctl02 nova-api[12575]: 2017-09-28 12:56:29.510 12575 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:56:29 ctl02 nova-api[12575]: 2017-09-28 12:56:29.510 12575 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:56:29 ctl02 nova-api[12575]: 2017-09-28 12:56:29.510 12575 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:56:29 ctl02 nova-api[12575]: 2017-09-28 12:56:29.510 12575 ERROR nova
Sep 28 12:56:29 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x69153339)
Sep 28 12:56:29 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:56:29 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:56:29 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:56:29 ctl02 dhclient[600]: DHCPREQUEST of 192.168.11.25 on ens2 to 192.168.11.3 port 67 (xid=0x3415f07)
Sep 28 12:56:29 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:56:29 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:56:29 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:56:29 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:56:29 ctl02 dhclient[600]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 12:56:29 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 12:56:30 ctl02 ntp[12654]:  * Stopping NTP server ntpd
Sep 28 12:56:30 ctl02 ntp[12654]:    ...done.
Sep 28 12:56:30 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 12:56:30 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 12:56:30 ctl02 ntp[12665]:  * Starting NTP server ntpd
Sep 28 12:56:30 ctl02 ntpd[12672]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 12:56:30 ctl02 ntpd[12672]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -c /var/lib/ntp/ntp.conf.dhcp -u 108:112
Sep 28 12:56:30 ctl02 ntp[12665]:    ...done.
Sep 28 12:56:30 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 12:56:30 ctl02 ntpd[12675]: proto: precision = 0.044 usec (-24)
Sep 28 12:56:30 ctl02 ntpd[12675]: switching logging to file /var/log/ntp.log
Sep 28 12:56:30 ctl02 dhclient[600]: bound to 192.168.11.25 -- renewal in 294 seconds.
Sep 28 12:56:30 ctl02 glance-api[29183]: 2017-09-28 12:56:30.164 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:56:30] "OPTIONS / HTTP/1.0" 200 134 0.001008
Sep 28 12:56:30 ctl02 heat-api-cfn[13300]: 2017-09-28 12:56:30.499 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:56:30] "OPTIONS / HTTP/1.0" 200 134 0.000437
Sep 28 12:56:30 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x69153339)
Sep 28 12:56:31 ctl02 glance-api[29183]: 2017-09-28 12:56:31.420 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:56:31] "OPTIONS / HTTP/1.0" 200 134 0.000641
Sep 28 12:56:31 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x69153339)
Sep 28 12:56:31 ctl02 nova-api[12593]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:56:31 ctl02 nova-api[12593]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:56:31 ctl02 nova-api[12593]: 2017-09-28 12:56:31.762 12593 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:56:31 ctl02 nova-api[12593]: 2017-09-28 12:56:31.764 12593 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:56:31 ctl02 nova-api[12593]: 2017-09-28 12:56:31.764 12593 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:56:31 ctl02 nova-api[12593]: 2017-09-28 12:56:31.764 12593 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:56:31 ctl02 nova-api[12593]: 2017-09-28 12:56:31.764 12593 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:56:31 ctl02 nova-api[12593]: 2017-09-28 12:56:31.764 12593 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:56:31 ctl02 nova-api[12593]: 2017-09-28 12:56:31.764 12593 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:56:31 ctl02 nova-api[12593]: 2017-09-28 12:56:31.764 12593 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:56:31 ctl02 nova-api[12593]: 2017-09-28 12:56:31.764 12593 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:56:31 ctl02 nova-api[12593]: 2017-09-28 12:56:31.764 12593 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:56:31 ctl02 nova-api[12593]: 2017-09-28 12:56:31.764 12593 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:56:31 ctl02 nova-api[12593]: 2017-09-28 12:56:31.764 12593 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:56:31 ctl02 nova-api[12593]: 2017-09-28 12:56:31.764 12593 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:56:31 ctl02 nova-api[12593]: 2017-09-28 12:56:31.764 12593 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:56:31 ctl02 nova-api[12593]: 2017-09-28 12:56:31.764 12593 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:56:31 ctl02 nova-api[12593]: 2017-09-28 12:56:31.764 12593 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:56:31 ctl02 nova-api[12593]: 2017-09-28 12:56:31.764 12593 ERROR nova.wsgi     self.filename))
Sep 28 12:56:31 ctl02 nova-api[12593]: 2017-09-28 12:56:31.764 12593 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:56:31 ctl02 nova-api[12593]: 2017-09-28 12:56:31.764 12593 ERROR nova.wsgi
Sep 28 12:56:31 ctl02 nova-api[12593]: 2017-09-28 12:56:31.766 12593 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:56:31 ctl02 neutron-server[30536]: 2017-09-28 12:56:31.814 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:56:31] "OPTIONS / HTTP/1.0" 200 262 0.000474
Sep 28 12:56:31 ctl02 nova-api[12593]: 2017-09-28 12:56:31.901 12593 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:56:32 ctl02 nova-api[12593]: 2017-09-28 12:56:32.131 12593 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:56:32 ctl02 nova-api[12593]: 2017-09-28 12:56:32.133 12593 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:56:32 ctl02 nova-api[12593]: 2017-09-28 12:56:32.134 12593 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:56:32 ctl02 nova-api[12593]: 2017-09-28 12:56:32.134 12593 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:56:32 ctl02 nova-api[12593]: 2017-09-28 12:56:32.270 12593 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:56:32 ctl02 nova-api[12593]: 2017-09-28 12:56:32.272 12593 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:56:32 ctl02 nova-api[12593]: 2017-09-28 12:56:32.272 12593 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:56:32 ctl02 nova-api[12593]: 2017-09-28 12:56:32.272 12593 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:56:32 ctl02 nova-api[12593]: 2017-09-28 12:56:32.276 12593 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:56:32 ctl02 nova-api[12593]: 2017-09-28 12:56:32.276 12593 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:56:32 ctl02 nova-api[12593]: 2017-09-28 12:56:32.276 12593 ERROR nova Traceback (most recent call last):
Sep 28 12:56:32 ctl02 nova-api[12593]: 2017-09-28 12:56:32.276 12593 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:56:32 ctl02 nova-api[12593]: 2017-09-28 12:56:32.276 12593 ERROR nova     sys.exit(main())
Sep 28 12:56:32 ctl02 nova-api[12593]: 2017-09-28 12:56:32.276 12593 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:56:32 ctl02 nova-api[12593]: 2017-09-28 12:56:32.276 12593 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:56:32 ctl02 nova-api[12593]: 2017-09-28 12:56:32.276 12593 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:56:32 ctl02 nova-api[12593]: 2017-09-28 12:56:32.276 12593 ERROR nova     max_url_len=max_url_len)
Sep 28 12:56:32 ctl02 nova-api[12593]: 2017-09-28 12:56:32.276 12593 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:56:32 ctl02 nova-api[12593]: 2017-09-28 12:56:32.276 12593 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:56:32 ctl02 nova-api[12593]: 2017-09-28 12:56:32.276 12593 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:56:32 ctl02 nova-api[12593]: 2017-09-28 12:56:32.276 12593 ERROR nova     sock.listen(backlog)
Sep 28 12:56:32 ctl02 nova-api[12593]: 2017-09-28 12:56:32.276 12593 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:56:32 ctl02 nova-api[12593]: 2017-09-28 12:56:32.276 12593 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:56:32 ctl02 nova-api[12593]: 2017-09-28 12:56:32.276 12593 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:56:32 ctl02 nova-api[12593]: 2017-09-28 12:56:32.276 12593 ERROR nova
Sep 28 12:56:32 ctl02 heat-api[13008]: 2017-09-28 12:56:32.310 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:56:32] "OPTIONS / HTTP/1.0" 200 134 0.000529
Sep 28 12:56:32 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:56:32 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:56:32 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:56:32 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x69153339)
Sep 28 12:56:32 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:56:32 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:56:32 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:56:32 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:56:33 ctl02 neutron-server[30536]: 2017-09-28 12:56:33.468 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:56:33] "OPTIONS / HTTP/1.0" 200 262 0.000446
Sep 28 12:56:33 ctl02 glance-api[29183]: 2017-09-28 12:56:33.485 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:56:33] "OPTIONS / HTTP/1.0" 200 134 0.000599
Sep 28 12:56:33 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x69153339)
Sep 28 12:56:33 ctl02 heat-api[13008]: 2017-09-28 12:56:33.805 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:56:33] "OPTIONS / HTTP/1.0" 200 134 0.000529
Sep 28 12:56:34 ctl02 neutron-server[30536]: 2017-09-28 12:56:34.172 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:56:34] "OPTIONS / HTTP/1.0" 200 262 0.000432
Sep 28 12:56:34 ctl02 nova-api[12693]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:56:34 ctl02 nova-api[12693]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:56:34 ctl02 nova-api[12693]: 2017-09-28 12:56:34.473 12693 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:56:34 ctl02 nova-api[12693]: 2017-09-28 12:56:34.474 12693 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:56:34 ctl02 nova-api[12693]: 2017-09-28 12:56:34.474 12693 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:56:34 ctl02 nova-api[12693]: 2017-09-28 12:56:34.474 12693 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:56:34 ctl02 nova-api[12693]: 2017-09-28 12:56:34.474 12693 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:56:34 ctl02 nova-api[12693]: 2017-09-28 12:56:34.474 12693 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:56:34 ctl02 nova-api[12693]: 2017-09-28 12:56:34.474 12693 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:56:34 ctl02 nova-api[12693]: 2017-09-28 12:56:34.474 12693 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:56:34 ctl02 nova-api[12693]: 2017-09-28 12:56:34.474 12693 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:56:34 ctl02 nova-api[12693]: 2017-09-28 12:56:34.474 12693 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:56:34 ctl02 nova-api[12693]: 2017-09-28 12:56:34.474 12693 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:56:34 ctl02 nova-api[12693]: 2017-09-28 12:56:34.474 12693 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:56:34 ctl02 nova-api[12693]: 2017-09-28 12:56:34.474 12693 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:56:34 ctl02 nova-api[12693]: 2017-09-28 12:56:34.474 12693 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:56:34 ctl02 nova-api[12693]: 2017-09-28 12:56:34.474 12693 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:56:34 ctl02 nova-api[12693]: 2017-09-28 12:56:34.474 12693 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:56:34 ctl02 nova-api[12693]: 2017-09-28 12:56:34.474 12693 ERROR nova.wsgi     self.filename))
Sep 28 12:56:34 ctl02 nova-api[12693]: 2017-09-28 12:56:34.474 12693 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:56:34 ctl02 nova-api[12693]: 2017-09-28 12:56:34.474 12693 ERROR nova.wsgi
Sep 28 12:56:34 ctl02 nova-api[12693]: 2017-09-28 12:56:34.475 12693 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:56:34 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x69153339)
Sep 28 12:56:34 ctl02 nova-api[12693]: 2017-09-28 12:56:34.600 12693 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:56:34 ctl02 nova-api[12693]: 2017-09-28 12:56:34.815 12693 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:56:34 ctl02 nova-api[12693]: 2017-09-28 12:56:34.817 12693 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:56:34 ctl02 nova-api[12693]: 2017-09-28 12:56:34.817 12693 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:56:34 ctl02 nova-api[12693]: 2017-09-28 12:56:34.818 12693 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:56:34 ctl02 nova-api[12693]: 2017-09-28 12:56:34.946 12693 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:56:34 ctl02 nova-api[12693]: 2017-09-28 12:56:34.948 12693 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:56:34 ctl02 nova-api[12693]: 2017-09-28 12:56:34.948 12693 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:56:34 ctl02 nova-api[12693]: 2017-09-28 12:56:34.948 12693 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:56:34 ctl02 nova-api[12693]: 2017-09-28 12:56:34.952 12693 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:56:34 ctl02 nova-api[12693]: 2017-09-28 12:56:34.952 12693 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:56:34 ctl02 nova-api[12693]: 2017-09-28 12:56:34.952 12693 ERROR nova Traceback (most recent call last):
Sep 28 12:56:34 ctl02 nova-api[12693]: 2017-09-28 12:56:34.952 12693 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:56:34 ctl02 nova-api[12693]: 2017-09-28 12:56:34.952 12693 ERROR nova     sys.exit(main())
Sep 28 12:56:34 ctl02 nova-api[12693]: 2017-09-28 12:56:34.952 12693 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:56:34 ctl02 nova-api[12693]: 2017-09-28 12:56:34.952 12693 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:56:34 ctl02 nova-api[12693]: 2017-09-28 12:56:34.952 12693 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:56:34 ctl02 nova-api[12693]: 2017-09-28 12:56:34.952 12693 ERROR nova     max_url_len=max_url_len)
Sep 28 12:56:34 ctl02 nova-api[12693]: 2017-09-28 12:56:34.952 12693 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:56:34 ctl02 nova-api[12693]: 2017-09-28 12:56:34.952 12693 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:56:34 ctl02 nova-api[12693]: 2017-09-28 12:56:34.952 12693 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:56:34 ctl02 nova-api[12693]: 2017-09-28 12:56:34.952 12693 ERROR nova     sock.listen(backlog)
Sep 28 12:56:34 ctl02 nova-api[12693]: 2017-09-28 12:56:34.952 12693 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:56:34 ctl02 nova-api[12693]: 2017-09-28 12:56:34.952 12693 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:56:34 ctl02 nova-api[12693]: 2017-09-28 12:56:34.952 12693 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:56:34 ctl02 nova-api[12693]: 2017-09-28 12:56:34.952 12693 ERROR nova
Sep 28 12:56:34 ctl02 heat-api-cfn[13300]: 2017-09-28 12:56:34.971 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:56:34] "OPTIONS / HTTP/1.0" 200 134 0.000456
Sep 28 12:56:35 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:56:35 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:56:35 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:56:35 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:56:35 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:56:35 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:56:35 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:56:35 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x69153339)
Sep 28 12:56:36 ctl02 neutron-server[30536]: 2017-09-28 12:56:36.109 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 2 dead agents out of 6:
Sep 28 12:56:36 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:56:36 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:55:06 cmp002
Sep 28 12:56:36 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:56:00 cmp002
Sep 28 12:56:36 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x69153339)
Sep 28 12:56:36 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:56:36.730 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:56:36] "OPTIONS / HTTP/1.0" 200 134 0.000379
Sep 28 12:56:36 ctl02 heat-api-cfn[13300]: 2017-09-28 12:56:36.931 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:56:36] "OPTIONS / HTTP/1.0" 200 134 0.000467
Sep 28 12:56:37 ctl02 nova-api[12712]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:56:37 ctl02 nova-api[12712]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:56:37 ctl02 nova-api[12712]: 2017-09-28 12:56:37.281 12712 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:56:37 ctl02 nova-api[12712]: 2017-09-28 12:56:37.283 12712 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:56:37 ctl02 nova-api[12712]: 2017-09-28 12:56:37.283 12712 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:56:37 ctl02 nova-api[12712]: 2017-09-28 12:56:37.283 12712 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:56:37 ctl02 nova-api[12712]: 2017-09-28 12:56:37.283 12712 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:56:37 ctl02 nova-api[12712]: 2017-09-28 12:56:37.283 12712 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:56:37 ctl02 nova-api[12712]: 2017-09-28 12:56:37.283 12712 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:56:37 ctl02 nova-api[12712]: 2017-09-28 12:56:37.283 12712 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:56:37 ctl02 nova-api[12712]: 2017-09-28 12:56:37.283 12712 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:56:37 ctl02 nova-api[12712]: 2017-09-28 12:56:37.283 12712 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:56:37 ctl02 nova-api[12712]: 2017-09-28 12:56:37.283 12712 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:56:37 ctl02 nova-api[12712]: 2017-09-28 12:56:37.283 12712 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:56:37 ctl02 nova-api[12712]: 2017-09-28 12:56:37.283 12712 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:56:37 ctl02 nova-api[12712]: 2017-09-28 12:56:37.283 12712 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:56:37 ctl02 nova-api[12712]: 2017-09-28 12:56:37.283 12712 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:56:37 ctl02 nova-api[12712]: 2017-09-28 12:56:37.283 12712 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:56:37 ctl02 nova-api[12712]: 2017-09-28 12:56:37.283 12712 ERROR nova.wsgi     self.filename))
Sep 28 12:56:37 ctl02 nova-api[12712]: 2017-09-28 12:56:37.283 12712 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:56:37 ctl02 nova-api[12712]: 2017-09-28 12:56:37.283 12712 ERROR nova.wsgi
Sep 28 12:56:37 ctl02 nova-api[12712]: 2017-09-28 12:56:37.285 12712 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:56:37 ctl02 nova-api[12712]: 2017-09-28 12:56:37.417 12712 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:56:37 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x69153339)
Sep 28 12:56:37 ctl02 heat-api[13008]: 2017-09-28 12:56:37.596 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:56:37] "OPTIONS / HTTP/1.0" 200 134 0.000871
Sep 28 12:56:37 ctl02 nova-api[12712]: 2017-09-28 12:56:37.660 12712 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:56:37 ctl02 nova-api[12712]: 2017-09-28 12:56:37.662 12712 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:56:37 ctl02 nova-api[12712]: 2017-09-28 12:56:37.662 12712 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:56:37 ctl02 nova-api[12712]: 2017-09-28 12:56:37.663 12712 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:56:37 ctl02 nova-api[12712]: 2017-09-28 12:56:37.795 12712 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:56:37 ctl02 nova-api[12712]: 2017-09-28 12:56:37.797 12712 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:56:37 ctl02 nova-api[12712]: 2017-09-28 12:56:37.797 12712 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:56:37 ctl02 nova-api[12712]: 2017-09-28 12:56:37.798 12712 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:56:37 ctl02 nova-api[12712]: 2017-09-28 12:56:37.801 12712 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:56:37 ctl02 nova-api[12712]: 2017-09-28 12:56:37.801 12712 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:56:37 ctl02 nova-api[12712]: 2017-09-28 12:56:37.801 12712 ERROR nova Traceback (most recent call last):
Sep 28 12:56:37 ctl02 nova-api[12712]: 2017-09-28 12:56:37.801 12712 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:56:37 ctl02 nova-api[12712]: 2017-09-28 12:56:37.801 12712 ERROR nova     sys.exit(main())
Sep 28 12:56:37 ctl02 nova-api[12712]: 2017-09-28 12:56:37.801 12712 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:56:37 ctl02 nova-api[12712]: 2017-09-28 12:56:37.801 12712 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:56:37 ctl02 nova-api[12712]: 2017-09-28 12:56:37.801 12712 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:56:37 ctl02 nova-api[12712]: 2017-09-28 12:56:37.801 12712 ERROR nova     max_url_len=max_url_len)
Sep 28 12:56:37 ctl02 nova-api[12712]: 2017-09-28 12:56:37.801 12712 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:56:37 ctl02 nova-api[12712]: 2017-09-28 12:56:37.801 12712 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:56:37 ctl02 nova-api[12712]: 2017-09-28 12:56:37.801 12712 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:56:37 ctl02 nova-api[12712]: 2017-09-28 12:56:37.801 12712 ERROR nova     sock.listen(backlog)
Sep 28 12:56:37 ctl02 nova-api[12712]: 2017-09-28 12:56:37.801 12712 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:56:37 ctl02 nova-api[12712]: 2017-09-28 12:56:37.801 12712 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:56:37 ctl02 nova-api[12712]: 2017-09-28 12:56:37.801 12712 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:56:37 ctl02 nova-api[12712]: 2017-09-28 12:56:37.801 12712 ERROR nova
Sep 28 12:56:37 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:56:37.937 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:56:37] "OPTIONS / HTTP/1.0" 200 134 0.000389
Sep 28 12:56:37 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:56:37 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:56:37 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:56:38 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:56:38 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:56:38 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:56:38 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:56:38 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x69153339)
Sep 28 12:56:38 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:56:38.849 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:56:38] "OPTIONS / HTTP/1.0" 200 134 0.000347
Sep 28 12:56:39 ctl02 nova-conductor[5056]: 2017-09-28 12:56:39.198 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:56:39 ctl02 nova-conductor[5056]: 2017-09-28 12:56:39.204 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:56:39 ctl02 nova-conductor[5056]: 2017-09-28 12:56:39.208 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:56:39 ctl02 nova-conductor[5056]: 2017-09-28 12:56:39.213 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:56:39 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x69153339)
Sep 28 12:56:39 ctl02 nova-cert[4860]: 2017-09-28 12:56:39.595 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:56:39 ctl02 nova-api[12730]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:56:39 ctl02 nova-api[12730]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:56:39 ctl02 nova-api[12730]: 2017-09-28 12:56:39.985 12730 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:56:39 ctl02 nova-api[12730]: 2017-09-28 12:56:39.987 12730 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:56:39 ctl02 nova-api[12730]: 2017-09-28 12:56:39.987 12730 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:56:39 ctl02 nova-api[12730]: 2017-09-28 12:56:39.987 12730 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:56:39 ctl02 nova-api[12730]: 2017-09-28 12:56:39.987 12730 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:56:39 ctl02 nova-api[12730]: 2017-09-28 12:56:39.987 12730 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:56:39 ctl02 nova-api[12730]: 2017-09-28 12:56:39.987 12730 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:56:39 ctl02 nova-api[12730]: 2017-09-28 12:56:39.987 12730 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:56:39 ctl02 nova-api[12730]: 2017-09-28 12:56:39.987 12730 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:56:39 ctl02 nova-api[12730]: 2017-09-28 12:56:39.987 12730 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:56:39 ctl02 nova-api[12730]: 2017-09-28 12:56:39.987 12730 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:56:39 ctl02 nova-api[12730]: 2017-09-28 12:56:39.987 12730 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:56:39 ctl02 nova-api[12730]: 2017-09-28 12:56:39.987 12730 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:56:39 ctl02 nova-api[12730]: 2017-09-28 12:56:39.987 12730 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:56:39 ctl02 nova-api[12730]: 2017-09-28 12:56:39.987 12730 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:56:39 ctl02 nova-api[12730]: 2017-09-28 12:56:39.987 12730 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:56:39 ctl02 nova-api[12730]: 2017-09-28 12:56:39.987 12730 ERROR nova.wsgi     self.filename))
Sep 28 12:56:39 ctl02 nova-api[12730]: 2017-09-28 12:56:39.987 12730 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:56:39 ctl02 nova-api[12730]: 2017-09-28 12:56:39.987 12730 ERROR nova.wsgi
Sep 28 12:56:39 ctl02 nova-api[12730]: 2017-09-28 12:56:39.988 12730 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:56:40 ctl02 nova-api[12730]: 2017-09-28 12:56:40.120 12730 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:56:40 ctl02 glance-api[29183]: 2017-09-28 12:56:40.189 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:56:40] "OPTIONS / HTTP/1.0" 200 134 0.000625
Sep 28 12:56:40 ctl02 heat-api-cfn[13300]: 2017-09-28 12:56:40.237 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:56:40] "OPTIONS / HTTP/1.0" 200 134 0.000441
Sep 28 12:56:40 ctl02 nova-api[12730]: 2017-09-28 12:56:40.367 12730 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:56:40 ctl02 nova-api[12730]: 2017-09-28 12:56:40.369 12730 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:56:40 ctl02 nova-api[12730]: 2017-09-28 12:56:40.369 12730 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:56:40 ctl02 nova-api[12730]: 2017-09-28 12:56:40.370 12730 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:56:40 ctl02 nova-api[12730]: 2017-09-28 12:56:40.501 12730 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:56:40 ctl02 nova-api[12730]: 2017-09-28 12:56:40.504 12730 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:56:40 ctl02 nova-api[12730]: 2017-09-28 12:56:40.504 12730 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:56:40 ctl02 nova-api[12730]: 2017-09-28 12:56:40.504 12730 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:56:40 ctl02 nova-api[12730]: 2017-09-28 12:56:40.507 12730 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:56:40 ctl02 nova-api[12730]: 2017-09-28 12:56:40.508 12730 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:56:40 ctl02 nova-api[12730]: 2017-09-28 12:56:40.508 12730 ERROR nova Traceback (most recent call last):
Sep 28 12:56:40 ctl02 nova-api[12730]: 2017-09-28 12:56:40.508 12730 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:56:40 ctl02 nova-api[12730]: 2017-09-28 12:56:40.508 12730 ERROR nova     sys.exit(main())
Sep 28 12:56:40 ctl02 nova-api[12730]: 2017-09-28 12:56:40.508 12730 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:56:40 ctl02 nova-api[12730]: 2017-09-28 12:56:40.508 12730 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:56:40 ctl02 nova-api[12730]: 2017-09-28 12:56:40.508 12730 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:56:40 ctl02 nova-api[12730]: 2017-09-28 12:56:40.508 12730 ERROR nova     max_url_len=max_url_len)
Sep 28 12:56:40 ctl02 nova-api[12730]: 2017-09-28 12:56:40.508 12730 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:56:40 ctl02 nova-api[12730]: 2017-09-28 12:56:40.508 12730 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:56:40 ctl02 nova-api[12730]: 2017-09-28 12:56:40.508 12730 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:56:40 ctl02 nova-api[12730]: 2017-09-28 12:56:40.508 12730 ERROR nova     sock.listen(backlog)
Sep 28 12:56:40 ctl02 nova-api[12730]: 2017-09-28 12:56:40.508 12730 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:56:40 ctl02 nova-api[12730]: 2017-09-28 12:56:40.508 12730 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:56:40 ctl02 nova-api[12730]: 2017-09-28 12:56:40.508 12730 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:56:40 ctl02 nova-api[12730]: 2017-09-28 12:56:40.508 12730 ERROR nova
Sep 28 12:56:40 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:56:40 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:56:40 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 12:56:40 ctl02 ntp[12787]:  * Stopping NTP server ntpd
Sep 28 12:56:40 ctl02 ntp[12787]:    ...done.
Sep 28 12:56:40 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 12:56:40 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 12:56:40 ctl02 ntp[12798]:  * Starting NTP server ntpd
Sep 28 12:56:40 ctl02 ntpd[12806]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 12:56:40 ctl02 ntpd[12806]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 12:56:40 ctl02 ntp[12798]:    ...done.
Sep 28 12:56:40 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 12:56:40 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:56:40 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:56:40 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:56:40 ctl02 ntpd[12809]: proto: precision = 0.043 usec (-24)
Sep 28 12:56:40 ctl02 ntpd[12809]: switching logging to file /var/log/ntp.log
Sep 28 12:56:40 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:56:40 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:56:40 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:56:40 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:56:41 ctl02 glance-api[29183]: 2017-09-28 12:56:41.498 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:56:41] "OPTIONS / HTTP/1.0" 200 134 0.000547
Sep 28 12:56:41 ctl02 neutron-server[30536]: 2017-09-28 12:56:41.910 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:56:41] "OPTIONS / HTTP/1.0" 200 262 0.000423
Sep 28 12:56:42 ctl02 heat-api[13008]: 2017-09-28 12:56:42.338 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:56:42] "OPTIONS / HTTP/1.0" 200 134 0.000504
Sep 28 12:56:42 ctl02 nova-api[12820]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:56:42 ctl02 nova-api[12820]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:56:42 ctl02 nova-api[12820]: 2017-09-28 12:56:42.720 12820 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:56:42 ctl02 nova-api[12820]: 2017-09-28 12:56:42.721 12820 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:56:42 ctl02 nova-api[12820]: 2017-09-28 12:56:42.721 12820 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:56:42 ctl02 nova-api[12820]: 2017-09-28 12:56:42.721 12820 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:56:42 ctl02 nova-api[12820]: 2017-09-28 12:56:42.721 12820 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:56:42 ctl02 nova-api[12820]: 2017-09-28 12:56:42.721 12820 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:56:42 ctl02 nova-api[12820]: 2017-09-28 12:56:42.721 12820 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:56:42 ctl02 nova-api[12820]: 2017-09-28 12:56:42.721 12820 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:56:42 ctl02 nova-api[12820]: 2017-09-28 12:56:42.721 12820 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:56:42 ctl02 nova-api[12820]: 2017-09-28 12:56:42.721 12820 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:56:42 ctl02 nova-api[12820]: 2017-09-28 12:56:42.721 12820 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:56:42 ctl02 nova-api[12820]: 2017-09-28 12:56:42.721 12820 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:56:42 ctl02 nova-api[12820]: 2017-09-28 12:56:42.721 12820 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:56:42 ctl02 nova-api[12820]: 2017-09-28 12:56:42.721 12820 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:56:42 ctl02 nova-api[12820]: 2017-09-28 12:56:42.721 12820 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:56:42 ctl02 nova-api[12820]: 2017-09-28 12:56:42.721 12820 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:56:42 ctl02 nova-api[12820]: 2017-09-28 12:56:42.721 12820 ERROR nova.wsgi     self.filename))
Sep 28 12:56:42 ctl02 nova-api[12820]: 2017-09-28 12:56:42.721 12820 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:56:42 ctl02 nova-api[12820]: 2017-09-28 12:56:42.721 12820 ERROR nova.wsgi
Sep 28 12:56:42 ctl02 nova-api[12820]: 2017-09-28 12:56:42.723 12820 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:56:42 ctl02 nova-api[12820]: 2017-09-28 12:56:42.848 12820 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:56:43 ctl02 nova-api[12820]: 2017-09-28 12:56:43.057 12820 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:56:43 ctl02 nova-api[12820]: 2017-09-28 12:56:43.060 12820 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:56:43 ctl02 nova-api[12820]: 2017-09-28 12:56:43.060 12820 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:56:43 ctl02 nova-api[12820]: 2017-09-28 12:56:43.060 12820 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:56:43 ctl02 nova-api[12820]: 2017-09-28 12:56:43.189 12820 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:56:43 ctl02 nova-api[12820]: 2017-09-28 12:56:43.192 12820 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:56:43 ctl02 nova-api[12820]: 2017-09-28 12:56:43.192 12820 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:56:43 ctl02 nova-api[12820]: 2017-09-28 12:56:43.192 12820 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:56:43 ctl02 nova-api[12820]: 2017-09-28 12:56:43.196 12820 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:56:43 ctl02 nova-api[12820]: 2017-09-28 12:56:43.196 12820 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:56:43 ctl02 nova-api[12820]: 2017-09-28 12:56:43.196 12820 ERROR nova Traceback (most recent call last):
Sep 28 12:56:43 ctl02 nova-api[12820]: 2017-09-28 12:56:43.196 12820 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:56:43 ctl02 nova-api[12820]: 2017-09-28 12:56:43.196 12820 ERROR nova     sys.exit(main())
Sep 28 12:56:43 ctl02 nova-api[12820]: 2017-09-28 12:56:43.196 12820 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:56:43 ctl02 nova-api[12820]: 2017-09-28 12:56:43.196 12820 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:56:43 ctl02 nova-api[12820]: 2017-09-28 12:56:43.196 12820 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:56:43 ctl02 nova-api[12820]: 2017-09-28 12:56:43.196 12820 ERROR nova     max_url_len=max_url_len)
Sep 28 12:56:43 ctl02 nova-api[12820]: 2017-09-28 12:56:43.196 12820 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:56:43 ctl02 nova-api[12820]: 2017-09-28 12:56:43.196 12820 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:56:43 ctl02 nova-api[12820]: 2017-09-28 12:56:43.196 12820 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:56:43 ctl02 nova-api[12820]: 2017-09-28 12:56:43.196 12820 ERROR nova     sock.listen(backlog)
Sep 28 12:56:43 ctl02 nova-api[12820]: 2017-09-28 12:56:43.196 12820 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:56:43 ctl02 nova-api[12820]: 2017-09-28 12:56:43.196 12820 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:56:43 ctl02 nova-api[12820]: 2017-09-28 12:56:43.196 12820 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:56:43 ctl02 nova-api[12820]: 2017-09-28 12:56:43.196 12820 ERROR nova
Sep 28 12:56:43 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:56:43 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:56:43 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:56:43 ctl02 glance-api[29183]: 2017-09-28 12:56:43.536 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:56:43] "OPTIONS / HTTP/1.0" 200 134 0.000551
Sep 28 12:56:43 ctl02 heat-api[13008]: 2017-09-28 12:56:43.615 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:56:43] "OPTIONS / HTTP/1.0" 200 134 0.000544
Sep 28 12:56:43 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:56:43 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:56:43 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:56:43 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:56:43 ctl02 neutron-server[30536]: 2017-09-28 12:56:43.828 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:56:43] "OPTIONS / HTTP/1.0" 200 262 0.000448
Sep 28 12:56:44 ctl02 neutron-server[30536]: 2017-09-28 12:56:44.044 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:56:44] "OPTIONS / HTTP/1.0" 200 262 0.000533
Sep 28 12:56:44 ctl02 heat-api-cfn[13300]: 2017-09-28 12:56:44.941 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:56:44] "OPTIONS / HTTP/1.0" 200 134 0.000467
Sep 28 12:56:45 ctl02 nova-api[12838]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:56:45 ctl02 nova-api[12838]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:56:45 ctl02 nova-api[12838]: 2017-09-28 12:56:45.496 12838 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:56:45 ctl02 nova-api[12838]: 2017-09-28 12:56:45.498 12838 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:56:45 ctl02 nova-api[12838]: 2017-09-28 12:56:45.498 12838 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:56:45 ctl02 nova-api[12838]: 2017-09-28 12:56:45.498 12838 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:56:45 ctl02 nova-api[12838]: 2017-09-28 12:56:45.498 12838 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:56:45 ctl02 nova-api[12838]: 2017-09-28 12:56:45.498 12838 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:56:45 ctl02 nova-api[12838]: 2017-09-28 12:56:45.498 12838 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:56:45 ctl02 nova-api[12838]: 2017-09-28 12:56:45.498 12838 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:56:45 ctl02 nova-api[12838]: 2017-09-28 12:56:45.498 12838 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:56:45 ctl02 nova-api[12838]: 2017-09-28 12:56:45.498 12838 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:56:45 ctl02 nova-api[12838]: 2017-09-28 12:56:45.498 12838 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:56:45 ctl02 nova-api[12838]: 2017-09-28 12:56:45.498 12838 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:56:45 ctl02 nova-api[12838]: 2017-09-28 12:56:45.498 12838 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:56:45 ctl02 nova-api[12838]: 2017-09-28 12:56:45.498 12838 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:56:45 ctl02 nova-api[12838]: 2017-09-28 12:56:45.498 12838 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:56:45 ctl02 nova-api[12838]: 2017-09-28 12:56:45.498 12838 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:56:45 ctl02 nova-api[12838]: 2017-09-28 12:56:45.498 12838 ERROR nova.wsgi     self.filename))
Sep 28 12:56:45 ctl02 nova-api[12838]: 2017-09-28 12:56:45.498 12838 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:56:45 ctl02 nova-api[12838]: 2017-09-28 12:56:45.498 12838 ERROR nova.wsgi
Sep 28 12:56:45 ctl02 nova-api[12838]: 2017-09-28 12:56:45.499 12838 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:56:45 ctl02 nova-api[12838]: 2017-09-28 12:56:45.629 12838 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:56:45 ctl02 nova-api[12838]: 2017-09-28 12:56:45.860 12838 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:56:45 ctl02 nova-api[12838]: 2017-09-28 12:56:45.862 12838 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:56:45 ctl02 nova-api[12838]: 2017-09-28 12:56:45.862 12838 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:56:45 ctl02 nova-api[12838]: 2017-09-28 12:56:45.862 12838 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:56:45 ctl02 nova-api[12838]: 2017-09-28 12:56:45.992 12838 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:56:45 ctl02 nova-api[12838]: 2017-09-28 12:56:45.994 12838 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:56:45 ctl02 nova-api[12838]: 2017-09-28 12:56:45.994 12838 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:56:45 ctl02 nova-api[12838]: 2017-09-28 12:56:45.994 12838 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:56:45 ctl02 nova-api[12838]: 2017-09-28 12:56:45.998 12838 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:56:45 ctl02 nova-api[12838]: 2017-09-28 12:56:45.998 12838 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:56:45 ctl02 nova-api[12838]: 2017-09-28 12:56:45.998 12838 ERROR nova Traceback (most recent call last):
Sep 28 12:56:45 ctl02 nova-api[12838]: 2017-09-28 12:56:45.998 12838 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:56:45 ctl02 nova-api[12838]: 2017-09-28 12:56:45.998 12838 ERROR nova     sys.exit(main())
Sep 28 12:56:45 ctl02 nova-api[12838]: 2017-09-28 12:56:45.998 12838 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:56:45 ctl02 nova-api[12838]: 2017-09-28 12:56:45.998 12838 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:56:45 ctl02 nova-api[12838]: 2017-09-28 12:56:45.998 12838 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:56:45 ctl02 nova-api[12838]: 2017-09-28 12:56:45.998 12838 ERROR nova     max_url_len=max_url_len)
Sep 28 12:56:45 ctl02 nova-api[12838]: 2017-09-28 12:56:45.998 12838 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:56:45 ctl02 nova-api[12838]: 2017-09-28 12:56:45.998 12838 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:56:45 ctl02 nova-api[12838]: 2017-09-28 12:56:45.998 12838 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:56:46 ctl02 nova-api[12838]: 2017-09-28 12:56:45.998 12838 ERROR nova     sock.listen(backlog)
Sep 28 12:56:46 ctl02 nova-api[12838]: 2017-09-28 12:56:45.998 12838 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:56:46 ctl02 nova-api[12838]: 2017-09-28 12:56:45.998 12838 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:56:46 ctl02 nova-api[12838]: 2017-09-28 12:56:45.998 12838 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:56:46 ctl02 nova-api[12838]: 2017-09-28 12:56:45.998 12838 ERROR nova
Sep 28 12:56:46 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:56:46 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:56:46 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:56:46 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:56:46 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:56:46 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:56:46 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:56:46 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:56:46.445 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:56:46] "OPTIONS / HTTP/1.0" 200 134 0.000393
Sep 28 12:56:46 ctl02 heat-api-cfn[13300]: 2017-09-28 12:56:46.821 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:56:46] "OPTIONS / HTTP/1.0" 200 134 0.000428
Sep 28 12:56:47 ctl02 heat-api[13008]: 2017-09-28 12:56:47.376 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:56:47] "OPTIONS / HTTP/1.0" 200 134 0.000628
Sep 28 12:56:48 ctl02 nova-api[12856]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:56:48 ctl02 nova-api[12856]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:56:48 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:56:48.106 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:56:48] "OPTIONS / HTTP/1.0" 200 134 0.000371
Sep 28 12:56:48 ctl02 nova-api[12856]: 2017-09-28 12:56:48.216 12856 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:56:48 ctl02 nova-api[12856]: 2017-09-28 12:56:48.217 12856 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:56:48 ctl02 nova-api[12856]: 2017-09-28 12:56:48.217 12856 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:56:48 ctl02 nova-api[12856]: 2017-09-28 12:56:48.217 12856 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:56:48 ctl02 nova-api[12856]: 2017-09-28 12:56:48.217 12856 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:56:48 ctl02 nova-api[12856]: 2017-09-28 12:56:48.217 12856 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:56:48 ctl02 nova-api[12856]: 2017-09-28 12:56:48.217 12856 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:56:48 ctl02 nova-api[12856]: 2017-09-28 12:56:48.217 12856 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:56:48 ctl02 nova-api[12856]: 2017-09-28 12:56:48.217 12856 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:56:48 ctl02 nova-api[12856]: 2017-09-28 12:56:48.217 12856 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:56:48 ctl02 nova-api[12856]: 2017-09-28 12:56:48.217 12856 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:56:48 ctl02 nova-api[12856]: 2017-09-28 12:56:48.217 12856 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:56:48 ctl02 nova-api[12856]: 2017-09-28 12:56:48.217 12856 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:56:48 ctl02 nova-api[12856]: 2017-09-28 12:56:48.217 12856 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:56:48 ctl02 nova-api[12856]: 2017-09-28 12:56:48.217 12856 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:56:48 ctl02 nova-api[12856]: 2017-09-28 12:56:48.217 12856 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:56:48 ctl02 nova-api[12856]: 2017-09-28 12:56:48.217 12856 ERROR nova.wsgi     self.filename))
Sep 28 12:56:48 ctl02 nova-api[12856]: 2017-09-28 12:56:48.217 12856 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:56:48 ctl02 nova-api[12856]: 2017-09-28 12:56:48.217 12856 ERROR nova.wsgi
Sep 28 12:56:48 ctl02 nova-api[12856]: 2017-09-28 12:56:48.218 12856 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:56:48 ctl02 nova-api[12856]: 2017-09-28 12:56:48.354 12856 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:56:48 ctl02 nova-api[12856]: 2017-09-28 12:56:48.573 12856 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:56:48 ctl02 nova-api[12856]: 2017-09-28 12:56:48.575 12856 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:56:48 ctl02 nova-api[12856]: 2017-09-28 12:56:48.576 12856 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:56:48 ctl02 nova-api[12856]: 2017-09-28 12:56:48.576 12856 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:56:48 ctl02 nova-api[12856]: 2017-09-28 12:56:48.707 12856 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:56:48 ctl02 nova-api[12856]: 2017-09-28 12:56:48.709 12856 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:56:48 ctl02 nova-api[12856]: 2017-09-28 12:56:48.709 12856 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:56:48 ctl02 nova-api[12856]: 2017-09-28 12:56:48.710 12856 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:56:48 ctl02 nova-api[12856]: 2017-09-28 12:56:48.713 12856 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:56:48 ctl02 nova-api[12856]: 2017-09-28 12:56:48.713 12856 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:56:48 ctl02 nova-api[12856]: 2017-09-28 12:56:48.713 12856 ERROR nova Traceback (most recent call last):
Sep 28 12:56:48 ctl02 nova-api[12856]: 2017-09-28 12:56:48.713 12856 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:56:48 ctl02 nova-api[12856]: 2017-09-28 12:56:48.713 12856 ERROR nova     sys.exit(main())
Sep 28 12:56:48 ctl02 nova-api[12856]: 2017-09-28 12:56:48.713 12856 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:56:48 ctl02 nova-api[12856]: 2017-09-28 12:56:48.713 12856 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:56:48 ctl02 nova-api[12856]: 2017-09-28 12:56:48.713 12856 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:56:48 ctl02 nova-api[12856]: 2017-09-28 12:56:48.713 12856 ERROR nova     max_url_len=max_url_len)
Sep 28 12:56:48 ctl02 nova-api[12856]: 2017-09-28 12:56:48.713 12856 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:56:48 ctl02 nova-api[12856]: 2017-09-28 12:56:48.713 12856 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:56:48 ctl02 nova-api[12856]: 2017-09-28 12:56:48.713 12856 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:56:48 ctl02 nova-api[12856]: 2017-09-28 12:56:48.713 12856 ERROR nova     sock.listen(backlog)
Sep 28 12:56:48 ctl02 nova-api[12856]: 2017-09-28 12:56:48.713 12856 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:56:48 ctl02 nova-api[12856]: 2017-09-28 12:56:48.713 12856 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:56:48 ctl02 nova-api[12856]: 2017-09-28 12:56:48.713 12856 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:56:48 ctl02 nova-api[12856]: 2017-09-28 12:56:48.713 12856 ERROR nova
Sep 28 12:56:48 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:56:48 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:56:48 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:56:49 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:56:49 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:56:49 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:56:49 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:56:49 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:56:49.160 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:56:49] "OPTIONS / HTTP/1.0" 200 134 0.000500
Sep 28 12:56:49 ctl02 nova-consoleauth[5433]: 2017-09-28 12:56:49.433 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:56:49 ctl02 glance-api[29183]: 2017-09-28 12:56:49.901 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:56:49] "OPTIONS / HTTP/1.0" 200 134 0.000565
Sep 28 12:56:50 ctl02 heat-engine[12803]: 2017-09-28 12:56:50.325 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:56:50 ctl02 heat-engine[12803]: 2017-09-28 12:56:50.340 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:56:50 ctl02 heat-engine[12803]: 2017-09-28 12:56:50.339 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:56:50 ctl02 heat-engine[12803]: 2017-09-28 12:56:50.342 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:56:50 ctl02 heat-api-cfn[13300]: 2017-09-28 12:56:50.557 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:56:50] "OPTIONS / HTTP/1.0" 200 134 0.000445
Sep 28 12:56:50 ctl02 nova-api[12874]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:56:50 ctl02 nova-api[12874]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:56:51 ctl02 nova-api[12874]: 2017-09-28 12:56:51.004 12874 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:56:51 ctl02 nova-api[12874]: 2017-09-28 12:56:51.006 12874 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:56:51 ctl02 nova-api[12874]: 2017-09-28 12:56:51.006 12874 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:56:51 ctl02 nova-api[12874]: 2017-09-28 12:56:51.006 12874 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:56:51 ctl02 nova-api[12874]: 2017-09-28 12:56:51.006 12874 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:56:51 ctl02 nova-api[12874]: 2017-09-28 12:56:51.006 12874 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:56:51 ctl02 nova-api[12874]: 2017-09-28 12:56:51.006 12874 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:56:51 ctl02 nova-api[12874]: 2017-09-28 12:56:51.006 12874 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:56:51 ctl02 nova-api[12874]: 2017-09-28 12:56:51.006 12874 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:56:51 ctl02 nova-api[12874]: 2017-09-28 12:56:51.006 12874 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:56:51 ctl02 nova-api[12874]: 2017-09-28 12:56:51.006 12874 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:56:51 ctl02 nova-api[12874]: 2017-09-28 12:56:51.006 12874 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:56:51 ctl02 nova-api[12874]: 2017-09-28 12:56:51.006 12874 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:56:51 ctl02 nova-api[12874]: 2017-09-28 12:56:51.006 12874 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:56:51 ctl02 nova-api[12874]: 2017-09-28 12:56:51.006 12874 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:56:51 ctl02 nova-api[12874]: 2017-09-28 12:56:51.006 12874 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:56:51 ctl02 nova-api[12874]: 2017-09-28 12:56:51.006 12874 ERROR nova.wsgi     self.filename))
Sep 28 12:56:51 ctl02 nova-api[12874]: 2017-09-28 12:56:51.006 12874 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:56:51 ctl02 nova-api[12874]: 2017-09-28 12:56:51.006 12874 ERROR nova.wsgi
Sep 28 12:56:51 ctl02 nova-api[12874]: 2017-09-28 12:56:51.007 12874 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:56:51 ctl02 neutron-server[30536]: 2017-09-28 12:56:51.105 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 2 dead agents out of 6:
Sep 28 12:56:51 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:56:51 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:55:06 cmp002
Sep 28 12:56:51 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:56:00 cmp002
Sep 28 12:56:51 ctl02 nova-api[12874]: 2017-09-28 12:56:51.142 12874 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:56:51 ctl02 glance-api[29183]: 2017-09-28 12:56:51.326 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:56:51] "OPTIONS / HTTP/1.0" 200 134 0.000661
Sep 28 12:56:51 ctl02 nova-api[12874]: 2017-09-28 12:56:51.379 12874 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:56:51 ctl02 nova-api[12874]: 2017-09-28 12:56:51.382 12874 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:56:51 ctl02 nova-api[12874]: 2017-09-28 12:56:51.382 12874 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:56:51 ctl02 nova-api[12874]: 2017-09-28 12:56:51.383 12874 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:56:51 ctl02 nova-api[12874]: 2017-09-28 12:56:51.517 12874 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:56:51 ctl02 nova-api[12874]: 2017-09-28 12:56:51.520 12874 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:56:51 ctl02 nova-api[12874]: 2017-09-28 12:56:51.520 12874 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:56:51 ctl02 nova-api[12874]: 2017-09-28 12:56:51.520 12874 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:56:51 ctl02 nova-api[12874]: 2017-09-28 12:56:51.524 12874 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:56:51 ctl02 nova-api[12874]: 2017-09-28 12:56:51.524 12874 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:56:51 ctl02 nova-api[12874]: 2017-09-28 12:56:51.524 12874 ERROR nova Traceback (most recent call last):
Sep 28 12:56:51 ctl02 nova-api[12874]: 2017-09-28 12:56:51.524 12874 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:56:51 ctl02 nova-api[12874]: 2017-09-28 12:56:51.524 12874 ERROR nova     sys.exit(main())
Sep 28 12:56:51 ctl02 nova-api[12874]: 2017-09-28 12:56:51.524 12874 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:56:51 ctl02 nova-api[12874]: 2017-09-28 12:56:51.524 12874 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:56:51 ctl02 nova-api[12874]: 2017-09-28 12:56:51.524 12874 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:56:51 ctl02 nova-api[12874]: 2017-09-28 12:56:51.524 12874 ERROR nova     max_url_len=max_url_len)
Sep 28 12:56:51 ctl02 nova-api[12874]: 2017-09-28 12:56:51.524 12874 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:56:51 ctl02 nova-api[12874]: 2017-09-28 12:56:51.524 12874 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:56:51 ctl02 nova-api[12874]: 2017-09-28 12:56:51.524 12874 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:56:51 ctl02 nova-api[12874]: 2017-09-28 12:56:51.524 12874 ERROR nova     sock.listen(backlog)
Sep 28 12:56:51 ctl02 nova-api[12874]: 2017-09-28 12:56:51.524 12874 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:56:51 ctl02 nova-api[12874]: 2017-09-28 12:56:51.524 12874 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:56:51 ctl02 nova-api[12874]: 2017-09-28 12:56:51.524 12874 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:56:51 ctl02 nova-api[12874]: 2017-09-28 12:56:51.524 12874 ERROR nova
Sep 28 12:56:51 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:56:51 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:56:51 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:56:51 ctl02 neutron-server[30536]: 2017-09-28 12:56:51.795 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:56:51] "OPTIONS / HTTP/1.0" 200 262 0.000493
Sep 28 12:56:51 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:56:51 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:56:51 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:56:51 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:56:52 ctl02 heat-api[13008]: 2017-09-28 12:56:52.492 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:56:52] "OPTIONS / HTTP/1.0" 200 134 0.000617
Sep 28 12:56:52 ctl02 nova-scheduler[5620]: 2017-09-28 12:56:52.535 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:56:53 ctl02 glance-api[29183]: 2017-09-28 12:56:53.441 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:56:53] "OPTIONS / HTTP/1.0" 200 134 0.000634
Sep 28 12:56:53 ctl02 nova-api[12895]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:56:53 ctl02 nova-api[12895]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:56:53 ctl02 heat-api[13008]: 2017-09-28 12:56:53.706 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:56:53] "OPTIONS / HTTP/1.0" 200 134 0.000620
Sep 28 12:56:53 ctl02 nova-api[12895]: 2017-09-28 12:56:53.787 12895 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:56:53 ctl02 nova-api[12895]: 2017-09-28 12:56:53.789 12895 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:56:53 ctl02 nova-api[12895]: 2017-09-28 12:56:53.789 12895 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:56:53 ctl02 nova-api[12895]: 2017-09-28 12:56:53.789 12895 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:56:53 ctl02 nova-api[12895]: 2017-09-28 12:56:53.789 12895 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:56:53 ctl02 nova-api[12895]: 2017-09-28 12:56:53.789 12895 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:56:53 ctl02 nova-api[12895]: 2017-09-28 12:56:53.789 12895 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:56:53 ctl02 nova-api[12895]: 2017-09-28 12:56:53.789 12895 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:56:53 ctl02 nova-api[12895]: 2017-09-28 12:56:53.789 12895 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:56:53 ctl02 nova-api[12895]: 2017-09-28 12:56:53.789 12895 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:56:53 ctl02 nova-api[12895]: 2017-09-28 12:56:53.789 12895 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:56:53 ctl02 nova-api[12895]: 2017-09-28 12:56:53.789 12895 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:56:53 ctl02 nova-api[12895]: 2017-09-28 12:56:53.789 12895 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:56:53 ctl02 nova-api[12895]: 2017-09-28 12:56:53.789 12895 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:56:53 ctl02 nova-api[12895]: 2017-09-28 12:56:53.789 12895 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:56:53 ctl02 nova-api[12895]: 2017-09-28 12:56:53.789 12895 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:56:53 ctl02 nova-api[12895]: 2017-09-28 12:56:53.789 12895 ERROR nova.wsgi     self.filename))
Sep 28 12:56:53 ctl02 nova-api[12895]: 2017-09-28 12:56:53.789 12895 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:56:53 ctl02 nova-api[12895]: 2017-09-28 12:56:53.789 12895 ERROR nova.wsgi
Sep 28 12:56:53 ctl02 nova-api[12895]: 2017-09-28 12:56:53.790 12895 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:56:53 ctl02 nova-api[12895]: 2017-09-28 12:56:53.926 12895 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:56:54 ctl02 nova-api[12895]: 2017-09-28 12:56:54.179 12895 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:56:54 ctl02 nova-api[12895]: 2017-09-28 12:56:54.183 12895 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:56:54 ctl02 nova-api[12895]: 2017-09-28 12:56:54.183 12895 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:56:54 ctl02 nova-api[12895]: 2017-09-28 12:56:54.183 12895 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:56:54 ctl02 neutron-server[30536]: 2017-09-28 12:56:54.222 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:56:54] "OPTIONS / HTTP/1.0" 200 262 0.000508
Sep 28 12:56:54 ctl02 nova-api[12895]: 2017-09-28 12:56:54.318 12895 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:56:54 ctl02 nova-api[12895]: 2017-09-28 12:56:54.320 12895 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:56:54 ctl02 nova-api[12895]: 2017-09-28 12:56:54.321 12895 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:56:54 ctl02 nova-api[12895]: 2017-09-28 12:56:54.321 12895 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:56:54 ctl02 nova-api[12895]: 2017-09-28 12:56:54.324 12895 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:56:54 ctl02 nova-api[12895]: 2017-09-28 12:56:54.325 12895 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:56:54 ctl02 nova-api[12895]: 2017-09-28 12:56:54.325 12895 ERROR nova Traceback (most recent call last):
Sep 28 12:56:54 ctl02 nova-api[12895]: 2017-09-28 12:56:54.325 12895 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:56:54 ctl02 nova-api[12895]: 2017-09-28 12:56:54.325 12895 ERROR nova     sys.exit(main())
Sep 28 12:56:54 ctl02 nova-api[12895]: 2017-09-28 12:56:54.325 12895 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:56:54 ctl02 nova-api[12895]: 2017-09-28 12:56:54.325 12895 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:56:54 ctl02 nova-api[12895]: 2017-09-28 12:56:54.325 12895 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:56:54 ctl02 nova-api[12895]: 2017-09-28 12:56:54.325 12895 ERROR nova     max_url_len=max_url_len)
Sep 28 12:56:54 ctl02 nova-api[12895]: 2017-09-28 12:56:54.325 12895 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:56:54 ctl02 nova-api[12895]: 2017-09-28 12:56:54.325 12895 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:56:54 ctl02 nova-api[12895]: 2017-09-28 12:56:54.325 12895 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:56:54 ctl02 nova-api[12895]: 2017-09-28 12:56:54.325 12895 ERROR nova     sock.listen(backlog)
Sep 28 12:56:54 ctl02 nova-api[12895]: 2017-09-28 12:56:54.325 12895 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:56:54 ctl02 nova-api[12895]: 2017-09-28 12:56:54.325 12895 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:56:54 ctl02 nova-api[12895]: 2017-09-28 12:56:54.325 12895 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:56:54 ctl02 nova-api[12895]: 2017-09-28 12:56:54.325 12895 ERROR nova
Sep 28 12:56:54 ctl02 neutron-server[30536]: 2017-09-28 12:56:54.398 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:56:54] "OPTIONS / HTTP/1.0" 200 262 0.000496
Sep 28 12:56:54 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:56:54 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:56:54 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:56:54 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:56:54 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:56:54 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:56:54 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:56:54 ctl02 heat-api-cfn[13300]: 2017-09-28 12:56:54.919 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:56:54] "OPTIONS / HTTP/1.0" 200 134 0.000495
Sep 28 12:56:56 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:56:56.298 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:56:56] "OPTIONS / HTTP/1.0" 200 134 0.000378
Sep 28 12:56:56 ctl02 nova-api[12913]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:56:56 ctl02 nova-api[12913]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:56:56 ctl02 nova-api[12913]: 2017-09-28 12:56:56.549 12913 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:56:56 ctl02 nova-api[12913]: 2017-09-28 12:56:56.551 12913 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:56:56 ctl02 nova-api[12913]: 2017-09-28 12:56:56.551 12913 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:56:56 ctl02 nova-api[12913]: 2017-09-28 12:56:56.551 12913 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:56:56 ctl02 nova-api[12913]: 2017-09-28 12:56:56.551 12913 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:56:56 ctl02 nova-api[12913]: 2017-09-28 12:56:56.551 12913 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:56:56 ctl02 nova-api[12913]: 2017-09-28 12:56:56.551 12913 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:56:56 ctl02 nova-api[12913]: 2017-09-28 12:56:56.551 12913 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:56:56 ctl02 nova-api[12913]: 2017-09-28 12:56:56.551 12913 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:56:56 ctl02 nova-api[12913]: 2017-09-28 12:56:56.551 12913 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:56:56 ctl02 nova-api[12913]: 2017-09-28 12:56:56.551 12913 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:56:56 ctl02 nova-api[12913]: 2017-09-28 12:56:56.551 12913 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:56:56 ctl02 nova-api[12913]: 2017-09-28 12:56:56.551 12913 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:56:56 ctl02 nova-api[12913]: 2017-09-28 12:56:56.551 12913 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:56:56 ctl02 nova-api[12913]: 2017-09-28 12:56:56.551 12913 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:56:56 ctl02 nova-api[12913]: 2017-09-28 12:56:56.551 12913 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:56:56 ctl02 nova-api[12913]: 2017-09-28 12:56:56.551 12913 ERROR nova.wsgi     self.filename))
Sep 28 12:56:56 ctl02 nova-api[12913]: 2017-09-28 12:56:56.551 12913 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:56:56 ctl02 nova-api[12913]: 2017-09-28 12:56:56.551 12913 ERROR nova.wsgi
Sep 28 12:56:56 ctl02 nova-api[12913]: 2017-09-28 12:56:56.552 12913 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:56:56 ctl02 heat-api-cfn[13300]: 2017-09-28 12:56:56.586 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:56:56] "OPTIONS / HTTP/1.0" 200 134 0.000666
Sep 28 12:56:56 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb98cf02b)
Sep 28 12:56:56 ctl02 nova-api[12913]: 2017-09-28 12:56:56.684 12913 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:56:56 ctl02 nova-api[12913]: 2017-09-28 12:56:56.917 12913 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:56:56 ctl02 nova-api[12913]: 2017-09-28 12:56:56.920 12913 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:56:56 ctl02 nova-api[12913]: 2017-09-28 12:56:56.920 12913 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:56:56 ctl02 nova-api[12913]: 2017-09-28 12:56:56.920 12913 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:56:57 ctl02 nova-api[12913]: 2017-09-28 12:56:57.054 12913 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:56:57 ctl02 nova-api[12913]: 2017-09-28 12:56:57.056 12913 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:56:57 ctl02 nova-api[12913]: 2017-09-28 12:56:57.056 12913 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:56:57 ctl02 nova-api[12913]: 2017-09-28 12:56:57.056 12913 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:56:57 ctl02 nova-api[12913]: 2017-09-28 12:56:57.060 12913 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:56:57 ctl02 nova-api[12913]: 2017-09-28 12:56:57.060 12913 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:56:57 ctl02 nova-api[12913]: 2017-09-28 12:56:57.060 12913 ERROR nova Traceback (most recent call last):
Sep 28 12:56:57 ctl02 nova-api[12913]: 2017-09-28 12:56:57.060 12913 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:56:57 ctl02 nova-api[12913]: 2017-09-28 12:56:57.060 12913 ERROR nova     sys.exit(main())
Sep 28 12:56:57 ctl02 nova-api[12913]: 2017-09-28 12:56:57.060 12913 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:56:57 ctl02 nova-api[12913]: 2017-09-28 12:56:57.060 12913 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:56:57 ctl02 nova-api[12913]: 2017-09-28 12:56:57.060 12913 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:56:57 ctl02 nova-api[12913]: 2017-09-28 12:56:57.060 12913 ERROR nova     max_url_len=max_url_len)
Sep 28 12:56:57 ctl02 nova-api[12913]: 2017-09-28 12:56:57.060 12913 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:56:57 ctl02 nova-api[12913]: 2017-09-28 12:56:57.060 12913 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:56:57 ctl02 nova-api[12913]: 2017-09-28 12:56:57.060 12913 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:56:57 ctl02 nova-api[12913]: 2017-09-28 12:56:57.060 12913 ERROR nova     sock.listen(backlog)
Sep 28 12:56:57 ctl02 nova-api[12913]: 2017-09-28 12:56:57.060 12913 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:56:57 ctl02 nova-api[12913]: 2017-09-28 12:56:57.060 12913 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:56:57 ctl02 nova-api[12913]: 2017-09-28 12:56:57.060 12913 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:56:57 ctl02 nova-api[12913]: 2017-09-28 12:56:57.060 12913 ERROR nova
Sep 28 12:56:57 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:56:57 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:56:57 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:56:57 ctl02 heat-api[13008]: 2017-09-28 12:56:57.279 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:56:57] "OPTIONS / HTTP/1.0" 200 134 0.000735
Sep 28 12:56:57 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:56:57 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:56:57 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:56:57 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:56:57 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb98cf02b)
Sep 28 12:56:58 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:56:58.466 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:56:58] "OPTIONS / HTTP/1.0" 200 134 0.000350
Sep 28 12:56:58 ctl02 neutron-server[30536]: 2017-09-28 12:56:58.555 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:56:58 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb98cf02b)
Sep 28 12:56:58 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:56:58.972 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:56:58] "OPTIONS / HTTP/1.0" 200 134 0.000347
Sep 28 12:56:59 ctl02 nova-api[12932]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:56:59 ctl02 nova-api[12932]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:56:59 ctl02 nova-api[12932]: 2017-09-28 12:56:59.211 12932 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:56:59 ctl02 nova-api[12932]: 2017-09-28 12:56:59.212 12932 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:56:59 ctl02 nova-api[12932]: 2017-09-28 12:56:59.212 12932 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:56:59 ctl02 nova-api[12932]: 2017-09-28 12:56:59.212 12932 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:56:59 ctl02 nova-api[12932]: 2017-09-28 12:56:59.212 12932 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:56:59 ctl02 nova-api[12932]: 2017-09-28 12:56:59.212 12932 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:56:59 ctl02 nova-api[12932]: 2017-09-28 12:56:59.212 12932 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:56:59 ctl02 nova-api[12932]: 2017-09-28 12:56:59.212 12932 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:56:59 ctl02 nova-api[12932]: 2017-09-28 12:56:59.212 12932 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:56:59 ctl02 nova-api[12932]: 2017-09-28 12:56:59.212 12932 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:56:59 ctl02 nova-api[12932]: 2017-09-28 12:56:59.212 12932 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:56:59 ctl02 nova-api[12932]: 2017-09-28 12:56:59.212 12932 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:56:59 ctl02 nova-api[12932]: 2017-09-28 12:56:59.212 12932 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:56:59 ctl02 nova-api[12932]: 2017-09-28 12:56:59.212 12932 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:56:59 ctl02 nova-api[12932]: 2017-09-28 12:56:59.212 12932 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:56:59 ctl02 nova-api[12932]: 2017-09-28 12:56:59.212 12932 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:56:59 ctl02 nova-api[12932]: 2017-09-28 12:56:59.212 12932 ERROR nova.wsgi     self.filename))
Sep 28 12:56:59 ctl02 nova-api[12932]: 2017-09-28 12:56:59.212 12932 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:56:59 ctl02 nova-api[12932]: 2017-09-28 12:56:59.212 12932 ERROR nova.wsgi
Sep 28 12:56:59 ctl02 nova-api[12932]: 2017-09-28 12:56:59.213 12932 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:56:59 ctl02 nova-api[12932]: 2017-09-28 12:56:59.337 12932 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:56:59 ctl02 nova-api[12932]: 2017-09-28 12:56:59.547 12932 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:56:59 ctl02 nova-api[12932]: 2017-09-28 12:56:59.549 12932 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:56:59 ctl02 nova-api[12932]: 2017-09-28 12:56:59.550 12932 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:56:59 ctl02 nova-api[12932]: 2017-09-28 12:56:59.550 12932 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:56:59 ctl02 glance-api[29183]: 2017-09-28 12:56:59.551 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:56:59] "OPTIONS / HTTP/1.0" 200 134 0.000517
Sep 28 12:56:59 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb98cf02b)
Sep 28 12:56:59 ctl02 nova-api[12932]: 2017-09-28 12:56:59.682 12932 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:56:59 ctl02 nova-api[12932]: 2017-09-28 12:56:59.683 12932 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:56:59 ctl02 nova-api[12932]: 2017-09-28 12:56:59.684 12932 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:56:59 ctl02 nova-api[12932]: 2017-09-28 12:56:59.684 12932 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:56:59 ctl02 nova-api[12932]: 2017-09-28 12:56:59.687 12932 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:56:59 ctl02 nova-api[12932]: 2017-09-28 12:56:59.687 12932 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:56:59 ctl02 nova-api[12932]: 2017-09-28 12:56:59.687 12932 ERROR nova Traceback (most recent call last):
Sep 28 12:56:59 ctl02 nova-api[12932]: 2017-09-28 12:56:59.687 12932 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:56:59 ctl02 nova-api[12932]: 2017-09-28 12:56:59.687 12932 ERROR nova     sys.exit(main())
Sep 28 12:56:59 ctl02 nova-api[12932]: 2017-09-28 12:56:59.687 12932 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:56:59 ctl02 nova-api[12932]: 2017-09-28 12:56:59.687 12932 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:56:59 ctl02 nova-api[12932]: 2017-09-28 12:56:59.687 12932 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:56:59 ctl02 nova-api[12932]: 2017-09-28 12:56:59.687 12932 ERROR nova     max_url_len=max_url_len)
Sep 28 12:56:59 ctl02 nova-api[12932]: 2017-09-28 12:56:59.687 12932 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:56:59 ctl02 nova-api[12932]: 2017-09-28 12:56:59.687 12932 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:56:59 ctl02 nova-api[12932]: 2017-09-28 12:56:59.687 12932 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:56:59 ctl02 nova-api[12932]: 2017-09-28 12:56:59.687 12932 ERROR nova     sock.listen(backlog)
Sep 28 12:56:59 ctl02 nova-api[12932]: 2017-09-28 12:56:59.687 12932 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:56:59 ctl02 nova-api[12932]: 2017-09-28 12:56:59.687 12932 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:56:59 ctl02 nova-api[12932]: 2017-09-28 12:56:59.687 12932 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:56:59 ctl02 nova-api[12932]: 2017-09-28 12:56:59.687 12932 ERROR nova
Sep 28 12:56:59 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:56:59 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:56:59 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:57:00 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:57:00 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:57:00 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:57:00 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:57:00 ctl02 neutron-server[30536]: 2017-09-28 12:57:00.239 30601 WARNING oslo_messaging._drivers.amqpdriver [req-25c9f1c8-3dab-4c9c-8acd-50b3e7834411 - - - - -] reply_692b03e6d8d44d758b6be19b067c3aa3 doesn't exists, drop reply to ba975a09e3f44433a7928e8584374544
Sep 28 12:57:00 ctl02 neutron-server[30536]: 2017-09-28 12:57:00.239 30601 INFO oslo_messaging._drivers.amqpdriver [req-25c9f1c8-3dab-4c9c-8acd-50b3e7834411 - - - - -] The reply ba975a09e3f44433a7928e8584374544 cannot be sent  reply_692b03e6d8d44d758b6be19b067c3aa3 reply queue don't exist after 60 sec abandoning...
Sep 28 12:57:00 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb98cf02b)
Sep 28 12:57:00 ctl02 heat-api-cfn[13300]: 2017-09-28 12:57:00.659 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:57:00] "OPTIONS / HTTP/1.0" 200 134 0.000395
Sep 28 12:57:01 ctl02 glance-api[29183]: 2017-09-28 12:57:01.521 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:57:01] "OPTIONS / HTTP/1.0" 200 134 0.000553
Sep 28 12:57:01 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb98cf02b)
Sep 28 12:57:01 ctl02 neutron-server[30536]: 2017-09-28 12:57:01.740 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:57:01] "OPTIONS / HTTP/1.0" 200 262 0.000470
Sep 28 12:57:01 ctl02 nova-api[12950]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:57:01 ctl02 nova-api[12950]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:57:01 ctl02 nova-api[12950]: 2017-09-28 12:57:01.940 12950 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:57:01 ctl02 nova-api[12950]: 2017-09-28 12:57:01.942 12950 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:57:01 ctl02 nova-api[12950]: 2017-09-28 12:57:01.942 12950 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:57:01 ctl02 nova-api[12950]: 2017-09-28 12:57:01.942 12950 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:57:01 ctl02 nova-api[12950]: 2017-09-28 12:57:01.942 12950 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:57:01 ctl02 nova-api[12950]: 2017-09-28 12:57:01.942 12950 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:57:01 ctl02 nova-api[12950]: 2017-09-28 12:57:01.942 12950 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:57:01 ctl02 nova-api[12950]: 2017-09-28 12:57:01.942 12950 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:57:01 ctl02 nova-api[12950]: 2017-09-28 12:57:01.942 12950 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:57:01 ctl02 nova-api[12950]: 2017-09-28 12:57:01.942 12950 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:57:01 ctl02 nova-api[12950]: 2017-09-28 12:57:01.942 12950 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:57:01 ctl02 nova-api[12950]: 2017-09-28 12:57:01.942 12950 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:57:01 ctl02 nova-api[12950]: 2017-09-28 12:57:01.942 12950 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:57:01 ctl02 nova-api[12950]: 2017-09-28 12:57:01.942 12950 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:57:01 ctl02 nova-api[12950]: 2017-09-28 12:57:01.942 12950 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:57:01 ctl02 nova-api[12950]: 2017-09-28 12:57:01.942 12950 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:57:01 ctl02 nova-api[12950]: 2017-09-28 12:57:01.942 12950 ERROR nova.wsgi     self.filename))
Sep 28 12:57:01 ctl02 nova-api[12950]: 2017-09-28 12:57:01.942 12950 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:57:01 ctl02 nova-api[12950]: 2017-09-28 12:57:01.942 12950 ERROR nova.wsgi
Sep 28 12:57:01 ctl02 nova-api[12950]: 2017-09-28 12:57:01.944 12950 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:57:02 ctl02 nova-api[12950]: 2017-09-28 12:57:02.070 12950 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:57:02 ctl02 heat-api[13008]: 2017-09-28 12:57:02.206 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:57:02] "OPTIONS / HTTP/1.0" 200 134 0.000598
Sep 28 12:57:02 ctl02 nova-api[12950]: 2017-09-28 12:57:02.296 12950 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:57:02 ctl02 nova-api[12950]: 2017-09-28 12:57:02.299 12950 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:57:02 ctl02 nova-api[12950]: 2017-09-28 12:57:02.300 12950 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:57:02 ctl02 nova-api[12950]: 2017-09-28 12:57:02.300 12950 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:57:02 ctl02 nova-api[12950]: 2017-09-28 12:57:02.430 12950 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:57:02 ctl02 nova-api[12950]: 2017-09-28 12:57:02.433 12950 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:57:02 ctl02 nova-api[12950]: 2017-09-28 12:57:02.433 12950 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:57:02 ctl02 nova-api[12950]: 2017-09-28 12:57:02.434 12950 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:57:02 ctl02 nova-api[12950]: 2017-09-28 12:57:02.437 12950 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:57:02 ctl02 nova-api[12950]: 2017-09-28 12:57:02.437 12950 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:57:02 ctl02 nova-api[12950]: 2017-09-28 12:57:02.437 12950 ERROR nova Traceback (most recent call last):
Sep 28 12:57:02 ctl02 nova-api[12950]: 2017-09-28 12:57:02.437 12950 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:57:02 ctl02 nova-api[12950]: 2017-09-28 12:57:02.437 12950 ERROR nova     sys.exit(main())
Sep 28 12:57:02 ctl02 nova-api[12950]: 2017-09-28 12:57:02.437 12950 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:57:02 ctl02 nova-api[12950]: 2017-09-28 12:57:02.437 12950 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:57:02 ctl02 nova-api[12950]: 2017-09-28 12:57:02.437 12950 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:57:02 ctl02 nova-api[12950]: 2017-09-28 12:57:02.437 12950 ERROR nova     max_url_len=max_url_len)
Sep 28 12:57:02 ctl02 nova-api[12950]: 2017-09-28 12:57:02.437 12950 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:57:02 ctl02 nova-api[12950]: 2017-09-28 12:57:02.437 12950 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:57:02 ctl02 nova-api[12950]: 2017-09-28 12:57:02.437 12950 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:57:02 ctl02 nova-api[12950]: 2017-09-28 12:57:02.437 12950 ERROR nova     sock.listen(backlog)
Sep 28 12:57:02 ctl02 nova-api[12950]: 2017-09-28 12:57:02.437 12950 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:57:02 ctl02 nova-api[12950]: 2017-09-28 12:57:02.437 12950 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:57:02 ctl02 nova-api[12950]: 2017-09-28 12:57:02.437 12950 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:57:02 ctl02 nova-api[12950]: 2017-09-28 12:57:02.437 12950 ERROR nova
Sep 28 12:57:02 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:57:02 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:57:02 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:57:02 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb98cf02b)
Sep 28 12:57:02 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:57:02 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:57:02 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:57:02 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:57:03 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb98cf02b)
Sep 28 12:57:03 ctl02 glance-api[29183]: 2017-09-28 12:57:03.650 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:57:03] "OPTIONS / HTTP/1.0" 200 134 0.000564
Sep 28 12:57:03 ctl02 heat-api[13008]: 2017-09-28 12:57:03.821 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:57:03] "OPTIONS / HTTP/1.0" 200 134 0.000578
Sep 28 12:57:04 ctl02 neutron-server[30536]: 2017-09-28 12:57:04.088 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:57:04] "OPTIONS / HTTP/1.0" 200 262 0.000458
Sep 28 12:57:04 ctl02 nova-api[12967]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:57:04 ctl02 nova-api[12967]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:57:04 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb98cf02b)
Sep 28 12:57:04 ctl02 neutron-server[30536]: 2017-09-28 12:57:04.668 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:57:04] "OPTIONS / HTTP/1.0" 200 262 0.000455
Sep 28 12:57:04 ctl02 heat-api-cfn[13300]: 2017-09-28 12:57:04.744 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:57:04] "OPTIONS / HTTP/1.0" 200 134 0.000445
Sep 28 12:57:04 ctl02 nova-api[12967]: 2017-09-28 12:57:04.771 12967 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:57:04 ctl02 nova-api[12967]: 2017-09-28 12:57:04.773 12967 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:57:04 ctl02 nova-api[12967]: 2017-09-28 12:57:04.773 12967 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:57:04 ctl02 nova-api[12967]: 2017-09-28 12:57:04.773 12967 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:57:04 ctl02 nova-api[12967]: 2017-09-28 12:57:04.773 12967 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:57:04 ctl02 nova-api[12967]: 2017-09-28 12:57:04.773 12967 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:57:04 ctl02 nova-api[12967]: 2017-09-28 12:57:04.773 12967 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:57:04 ctl02 nova-api[12967]: 2017-09-28 12:57:04.773 12967 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:57:04 ctl02 nova-api[12967]: 2017-09-28 12:57:04.773 12967 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:57:04 ctl02 nova-api[12967]: 2017-09-28 12:57:04.773 12967 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:57:04 ctl02 nova-api[12967]: 2017-09-28 12:57:04.773 12967 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:57:04 ctl02 nova-api[12967]: 2017-09-28 12:57:04.773 12967 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:57:04 ctl02 nova-api[12967]: 2017-09-28 12:57:04.773 12967 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:57:04 ctl02 nova-api[12967]: 2017-09-28 12:57:04.773 12967 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:57:04 ctl02 nova-api[12967]: 2017-09-28 12:57:04.773 12967 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:57:04 ctl02 nova-api[12967]: 2017-09-28 12:57:04.773 12967 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:57:04 ctl02 nova-api[12967]: 2017-09-28 12:57:04.773 12967 ERROR nova.wsgi     self.filename))
Sep 28 12:57:04 ctl02 nova-api[12967]: 2017-09-28 12:57:04.773 12967 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:57:04 ctl02 nova-api[12967]: 2017-09-28 12:57:04.773 12967 ERROR nova.wsgi
Sep 28 12:57:04 ctl02 nova-api[12967]: 2017-09-28 12:57:04.774 12967 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:57:04 ctl02 nova-api[12967]: 2017-09-28 12:57:04.901 12967 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:57:05 ctl02 nova-api[12967]: 2017-09-28 12:57:05.125 12967 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:57:05 ctl02 nova-api[12967]: 2017-09-28 12:57:05.127 12967 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:57:05 ctl02 nova-api[12967]: 2017-09-28 12:57:05.128 12967 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:57:05 ctl02 nova-api[12967]: 2017-09-28 12:57:05.128 12967 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:57:05 ctl02 nova-api[12967]: 2017-09-28 12:57:05.261 12967 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:57:05 ctl02 nova-api[12967]: 2017-09-28 12:57:05.264 12967 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:57:05 ctl02 nova-api[12967]: 2017-09-28 12:57:05.264 12967 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:57:05 ctl02 nova-api[12967]: 2017-09-28 12:57:05.265 12967 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:57:05 ctl02 nova-api[12967]: 2017-09-28 12:57:05.268 12967 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:57:05 ctl02 nova-api[12967]: 2017-09-28 12:57:05.268 12967 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:57:05 ctl02 nova-api[12967]: 2017-09-28 12:57:05.268 12967 ERROR nova Traceback (most recent call last):
Sep 28 12:57:05 ctl02 nova-api[12967]: 2017-09-28 12:57:05.268 12967 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:57:05 ctl02 nova-api[12967]: 2017-09-28 12:57:05.268 12967 ERROR nova     sys.exit(main())
Sep 28 12:57:05 ctl02 nova-api[12967]: 2017-09-28 12:57:05.268 12967 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:57:05 ctl02 nova-api[12967]: 2017-09-28 12:57:05.268 12967 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:57:05 ctl02 nova-api[12967]: 2017-09-28 12:57:05.268 12967 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:57:05 ctl02 nova-api[12967]: 2017-09-28 12:57:05.268 12967 ERROR nova     max_url_len=max_url_len)
Sep 28 12:57:05 ctl02 nova-api[12967]: 2017-09-28 12:57:05.268 12967 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:57:05 ctl02 nova-api[12967]: 2017-09-28 12:57:05.268 12967 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:57:05 ctl02 nova-api[12967]: 2017-09-28 12:57:05.268 12967 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:57:05 ctl02 nova-api[12967]: 2017-09-28 12:57:05.268 12967 ERROR nova     sock.listen(backlog)
Sep 28 12:57:05 ctl02 nova-api[12967]: 2017-09-28 12:57:05.268 12967 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:57:05 ctl02 nova-api[12967]: 2017-09-28 12:57:05.268 12967 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:57:05 ctl02 nova-api[12967]: 2017-09-28 12:57:05.268 12967 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:57:05 ctl02 nova-api[12967]: 2017-09-28 12:57:05.268 12967 ERROR nova
Sep 28 12:57:05 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:57:05 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:57:05 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:57:05 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb98cf02b)
Sep 28 12:57:05 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:57:05 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:57:05 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:57:05 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:57:06 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:57:06.084 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:57:06] "OPTIONS / HTTP/1.0" 200 134 0.000421
Sep 28 12:57:06 ctl02 neutron-server[30536]: 2017-09-28 12:57:06.101 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 4 dead agents out of 6:
Sep 28 12:57:06 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:57:06 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:55:06 cmp002
Sep 28 12:57:06 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:56:28 cmp001
Sep 28 12:57:06 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:56:00 cmp002
Sep 28 12:57:06 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:56:26 cmp002
Sep 28 12:57:06 ctl02 heat-api-cfn[13300]: 2017-09-28 12:57:06.383 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:57:06] "OPTIONS / HTTP/1.0" 200 134 0.000450
Sep 28 12:57:06 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb98cf02b)
Sep 28 12:57:07 ctl02 nova-api[12985]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:57:07 ctl02 nova-api[12985]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:57:07 ctl02 nova-api[12985]: 2017-09-28 12:57:07.487 12985 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:57:07 ctl02 nova-api[12985]: 2017-09-28 12:57:07.488 12985 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:57:07 ctl02 nova-api[12985]: 2017-09-28 12:57:07.488 12985 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:57:07 ctl02 nova-api[12985]: 2017-09-28 12:57:07.488 12985 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:57:07 ctl02 nova-api[12985]: 2017-09-28 12:57:07.488 12985 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:57:07 ctl02 nova-api[12985]: 2017-09-28 12:57:07.488 12985 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:57:07 ctl02 nova-api[12985]: 2017-09-28 12:57:07.488 12985 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:57:07 ctl02 nova-api[12985]: 2017-09-28 12:57:07.488 12985 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:57:07 ctl02 nova-api[12985]: 2017-09-28 12:57:07.488 12985 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:57:07 ctl02 nova-api[12985]: 2017-09-28 12:57:07.488 12985 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:57:07 ctl02 nova-api[12985]: 2017-09-28 12:57:07.488 12985 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:57:07 ctl02 nova-api[12985]: 2017-09-28 12:57:07.488 12985 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:57:07 ctl02 nova-api[12985]: 2017-09-28 12:57:07.488 12985 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:57:07 ctl02 nova-api[12985]: 2017-09-28 12:57:07.488 12985 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:57:07 ctl02 nova-api[12985]: 2017-09-28 12:57:07.488 12985 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:57:07 ctl02 nova-api[12985]: 2017-09-28 12:57:07.488 12985 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:57:07 ctl02 nova-api[12985]: 2017-09-28 12:57:07.488 12985 ERROR nova.wsgi     self.filename))
Sep 28 12:57:07 ctl02 nova-api[12985]: 2017-09-28 12:57:07.488 12985 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:57:07 ctl02 nova-api[12985]: 2017-09-28 12:57:07.488 12985 ERROR nova.wsgi
Sep 28 12:57:07 ctl02 nova-api[12985]: 2017-09-28 12:57:07.489 12985 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:57:07 ctl02 nova-api[12985]: 2017-09-28 12:57:07.617 12985 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:57:07 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:57:07 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:57:07 ctl02 heat-api[13008]: 2017-09-28 12:57:07.681 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:57:07] "OPTIONS / HTTP/1.0" 200 134 0.000574
Sep 28 12:57:07 ctl02 nova-api[12985]: 2017-09-28 12:57:07.841 12985 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:57:07 ctl02 nova-api[12985]: 2017-09-28 12:57:07.843 12985 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:57:07 ctl02 nova-api[12985]: 2017-09-28 12:57:07.843 12985 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:57:07 ctl02 nova-api[12985]: 2017-09-28 12:57:07.844 12985 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:57:07 ctl02 nova-api[12985]: 2017-09-28 12:57:07.975 12985 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:57:07 ctl02 nova-api[12985]: 2017-09-28 12:57:07.977 12985 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:57:07 ctl02 nova-api[12985]: 2017-09-28 12:57:07.977 12985 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:57:07 ctl02 nova-api[12985]: 2017-09-28 12:57:07.977 12985 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:57:07 ctl02 nova-api[12985]: 2017-09-28 12:57:07.981 12985 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:57:07 ctl02 nova-api[12985]: 2017-09-28 12:57:07.981 12985 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:57:07 ctl02 nova-api[12985]: 2017-09-28 12:57:07.981 12985 ERROR nova Traceback (most recent call last):
Sep 28 12:57:07 ctl02 nova-api[12985]: 2017-09-28 12:57:07.981 12985 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:57:07 ctl02 nova-api[12985]: 2017-09-28 12:57:07.981 12985 ERROR nova     sys.exit(main())
Sep 28 12:57:07 ctl02 nova-api[12985]: 2017-09-28 12:57:07.981 12985 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:57:07 ctl02 nova-api[12985]: 2017-09-28 12:57:07.981 12985 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:57:07 ctl02 nova-api[12985]: 2017-09-28 12:57:07.981 12985 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:57:07 ctl02 nova-api[12985]: 2017-09-28 12:57:07.981 12985 ERROR nova     max_url_len=max_url_len)
Sep 28 12:57:07 ctl02 nova-api[12985]: 2017-09-28 12:57:07.981 12985 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:57:07 ctl02 nova-api[12985]: 2017-09-28 12:57:07.981 12985 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:57:07 ctl02 nova-api[12985]: 2017-09-28 12:57:07.981 12985 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:57:07 ctl02 nova-api[12985]: 2017-09-28 12:57:07.981 12985 ERROR nova     sock.listen(backlog)
Sep 28 12:57:07 ctl02 nova-api[12985]: 2017-09-28 12:57:07.981 12985 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:57:07 ctl02 nova-api[12985]: 2017-09-28 12:57:07.981 12985 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:57:07 ctl02 nova-api[12985]: 2017-09-28 12:57:07.981 12985 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:57:07 ctl02 nova-api[12985]: 2017-09-28 12:57:07.981 12985 ERROR nova
Sep 28 12:57:08 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:57:08 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:57:08 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:57:08 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:57:08 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:57:08 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:57:08 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:57:08 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:57:08.738 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:57:08] "OPTIONS / HTTP/1.0" 200 134 0.000383
Sep 28 12:57:09 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:57:09.104 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:57:09] "OPTIONS / HTTP/1.0" 200 134 0.000348
Sep 28 12:57:09 ctl02 glance-api[29183]: 2017-09-28 12:57:09.293 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:57:09] "OPTIONS / HTTP/1.0" 200 134 0.000597
Sep 28 12:57:10 ctl02 nova-api[13009]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:57:10 ctl02 nova-api[13009]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:57:10 ctl02 nova-api[13009]: 2017-09-28 12:57:10.255 13009 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:57:10 ctl02 nova-api[13009]: 2017-09-28 12:57:10.256 13009 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:57:10 ctl02 nova-api[13009]: 2017-09-28 12:57:10.256 13009 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:57:10 ctl02 nova-api[13009]: 2017-09-28 12:57:10.256 13009 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:57:10 ctl02 nova-api[13009]: 2017-09-28 12:57:10.256 13009 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:57:10 ctl02 nova-api[13009]: 2017-09-28 12:57:10.256 13009 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:57:10 ctl02 nova-api[13009]: 2017-09-28 12:57:10.256 13009 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:57:10 ctl02 nova-api[13009]: 2017-09-28 12:57:10.256 13009 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:57:10 ctl02 nova-api[13009]: 2017-09-28 12:57:10.256 13009 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:57:10 ctl02 nova-api[13009]: 2017-09-28 12:57:10.256 13009 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:57:10 ctl02 nova-api[13009]: 2017-09-28 12:57:10.256 13009 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:57:10 ctl02 nova-api[13009]: 2017-09-28 12:57:10.256 13009 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:57:10 ctl02 nova-api[13009]: 2017-09-28 12:57:10.256 13009 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:57:10 ctl02 nova-api[13009]: 2017-09-28 12:57:10.256 13009 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:57:10 ctl02 nova-api[13009]: 2017-09-28 12:57:10.256 13009 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:57:10 ctl02 nova-api[13009]: 2017-09-28 12:57:10.256 13009 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:57:10 ctl02 nova-api[13009]: 2017-09-28 12:57:10.256 13009 ERROR nova.wsgi     self.filename))
Sep 28 12:57:10 ctl02 nova-api[13009]: 2017-09-28 12:57:10.256 13009 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:57:10 ctl02 nova-api[13009]: 2017-09-28 12:57:10.256 13009 ERROR nova.wsgi
Sep 28 12:57:10 ctl02 nova-api[13009]: 2017-09-28 12:57:10.257 13009 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:57:10 ctl02 heat-api-cfn[13300]: 2017-09-28 12:57:10.340 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:57:10] "OPTIONS / HTTP/1.0" 200 134 0.000416
Sep 28 12:57:10 ctl02 nova-api[13009]: 2017-09-28 12:57:10.391 13009 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:57:10 ctl02 nova-api[13009]: 2017-09-28 12:57:10.614 13009 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:57:10 ctl02 nova-api[13009]: 2017-09-28 12:57:10.616 13009 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:57:10 ctl02 nova-api[13009]: 2017-09-28 12:57:10.616 13009 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:57:10 ctl02 nova-api[13009]: 2017-09-28 12:57:10.616 13009 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:57:10 ctl02 nova-api[13009]: 2017-09-28 12:57:10.745 13009 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:57:10 ctl02 nova-api[13009]: 2017-09-28 12:57:10.747 13009 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:57:10 ctl02 nova-api[13009]: 2017-09-28 12:57:10.747 13009 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:57:10 ctl02 nova-api[13009]: 2017-09-28 12:57:10.748 13009 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:57:10 ctl02 nova-api[13009]: 2017-09-28 12:57:10.751 13009 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:57:10 ctl02 nova-api[13009]: 2017-09-28 12:57:10.751 13009 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:57:10 ctl02 nova-api[13009]: 2017-09-28 12:57:10.751 13009 ERROR nova Traceback (most recent call last):
Sep 28 12:57:10 ctl02 nova-api[13009]: 2017-09-28 12:57:10.751 13009 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:57:10 ctl02 nova-api[13009]: 2017-09-28 12:57:10.751 13009 ERROR nova     sys.exit(main())
Sep 28 12:57:10 ctl02 nova-api[13009]: 2017-09-28 12:57:10.751 13009 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:57:10 ctl02 nova-api[13009]: 2017-09-28 12:57:10.751 13009 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:57:10 ctl02 nova-api[13009]: 2017-09-28 12:57:10.751 13009 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:57:10 ctl02 nova-api[13009]: 2017-09-28 12:57:10.751 13009 ERROR nova     max_url_len=max_url_len)
Sep 28 12:57:10 ctl02 nova-api[13009]: 2017-09-28 12:57:10.751 13009 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:57:10 ctl02 nova-api[13009]: 2017-09-28 12:57:10.751 13009 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:57:10 ctl02 nova-api[13009]: 2017-09-28 12:57:10.751 13009 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:57:10 ctl02 nova-api[13009]: 2017-09-28 12:57:10.751 13009 ERROR nova     sock.listen(backlog)
Sep 28 12:57:10 ctl02 nova-api[13009]: 2017-09-28 12:57:10.751 13009 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:57:10 ctl02 nova-api[13009]: 2017-09-28 12:57:10.751 13009 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:57:10 ctl02 nova-api[13009]: 2017-09-28 12:57:10.751 13009 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:57:10 ctl02 nova-api[13009]: 2017-09-28 12:57:10.751 13009 ERROR nova
Sep 28 12:57:10 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:57:10 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:57:10 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:57:11 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:57:11 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:57:11 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:57:11 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:57:11 ctl02 nova-conductor[5056]: 2017-09-28 12:57:11.206 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:57:11 ctl02 nova-conductor[5056]: 2017-09-28 12:57:11.212 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:57:11 ctl02 nova-conductor[5056]: 2017-09-28 12:57:11.216 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:57:11 ctl02 nova-conductor[5056]: 2017-09-28 12:57:11.221 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:57:11 ctl02 neutron-server[30536]: 2017-09-28 12:57:11.515 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:57:11] "OPTIONS / HTTP/1.0" 200 262 0.000452
Sep 28 12:57:11 ctl02 nova-cert[4860]: 2017-09-28 12:57:11.633 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:57:11 ctl02 heat-api[13008]: 2017-09-28 12:57:11.817 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:57:11] "OPTIONS / HTTP/1.0" 200 134 0.000534
Sep 28 12:57:11 ctl02 glance-api[29183]: 2017-09-28 12:57:11.888 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:57:11] "OPTIONS / HTTP/1.0" 200 134 0.000515
Sep 28 12:57:12 ctl02 nova-api[13028]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:57:12 ctl02 nova-api[13028]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:57:12 ctl02 nova-api[13028]: 2017-09-28 12:57:12.969 13028 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:57:12 ctl02 nova-api[13028]: 2017-09-28 12:57:12.970 13028 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:57:12 ctl02 nova-api[13028]: 2017-09-28 12:57:12.970 13028 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:57:12 ctl02 nova-api[13028]: 2017-09-28 12:57:12.970 13028 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:57:12 ctl02 nova-api[13028]: 2017-09-28 12:57:12.970 13028 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:57:12 ctl02 nova-api[13028]: 2017-09-28 12:57:12.970 13028 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:57:12 ctl02 nova-api[13028]: 2017-09-28 12:57:12.970 13028 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:57:12 ctl02 nova-api[13028]: 2017-09-28 12:57:12.970 13028 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:57:12 ctl02 nova-api[13028]: 2017-09-28 12:57:12.970 13028 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:57:12 ctl02 nova-api[13028]: 2017-09-28 12:57:12.970 13028 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:57:12 ctl02 nova-api[13028]: 2017-09-28 12:57:12.970 13028 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:57:12 ctl02 nova-api[13028]: 2017-09-28 12:57:12.970 13028 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:57:12 ctl02 nova-api[13028]: 2017-09-28 12:57:12.970 13028 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:57:12 ctl02 nova-api[13028]: 2017-09-28 12:57:12.970 13028 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:57:12 ctl02 nova-api[13028]: 2017-09-28 12:57:12.970 13028 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:57:12 ctl02 nova-api[13028]: 2017-09-28 12:57:12.970 13028 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:57:12 ctl02 nova-api[13028]: 2017-09-28 12:57:12.970 13028 ERROR nova.wsgi     self.filename))
Sep 28 12:57:12 ctl02 nova-api[13028]: 2017-09-28 12:57:12.970 13028 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:57:12 ctl02 nova-api[13028]: 2017-09-28 12:57:12.970 13028 ERROR nova.wsgi
Sep 28 12:57:12 ctl02 nova-api[13028]: 2017-09-28 12:57:12.971 13028 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:57:13 ctl02 nova-api[13028]: 2017-09-28 12:57:13.103 13028 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:57:13 ctl02 nova-api[13028]: 2017-09-28 12:57:13.331 13028 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:57:13 ctl02 nova-api[13028]: 2017-09-28 12:57:13.333 13028 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:57:13 ctl02 nova-api[13028]: 2017-09-28 12:57:13.333 13028 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:57:13 ctl02 nova-api[13028]: 2017-09-28 12:57:13.334 13028 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:57:13 ctl02 nova-api[13028]: 2017-09-28 12:57:13.465 13028 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:57:13 ctl02 nova-api[13028]: 2017-09-28 12:57:13.467 13028 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:57:13 ctl02 nova-api[13028]: 2017-09-28 12:57:13.467 13028 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:57:13 ctl02 nova-api[13028]: 2017-09-28 12:57:13.468 13028 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:57:13 ctl02 nova-api[13028]: 2017-09-28 12:57:13.471 13028 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:57:13 ctl02 nova-api[13028]: 2017-09-28 12:57:13.471 13028 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:57:13 ctl02 nova-api[13028]: 2017-09-28 12:57:13.471 13028 ERROR nova Traceback (most recent call last):
Sep 28 12:57:13 ctl02 nova-api[13028]: 2017-09-28 12:57:13.471 13028 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:57:13 ctl02 nova-api[13028]: 2017-09-28 12:57:13.471 13028 ERROR nova     sys.exit(main())
Sep 28 12:57:13 ctl02 nova-api[13028]: 2017-09-28 12:57:13.471 13028 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:57:13 ctl02 nova-api[13028]: 2017-09-28 12:57:13.471 13028 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:57:13 ctl02 nova-api[13028]: 2017-09-28 12:57:13.471 13028 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:57:13 ctl02 nova-api[13028]: 2017-09-28 12:57:13.471 13028 ERROR nova     max_url_len=max_url_len)
Sep 28 12:57:13 ctl02 nova-api[13028]: 2017-09-28 12:57:13.471 13028 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:57:13 ctl02 nova-api[13028]: 2017-09-28 12:57:13.471 13028 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:57:13 ctl02 nova-api[13028]: 2017-09-28 12:57:13.471 13028 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:57:13 ctl02 nova-api[13028]: 2017-09-28 12:57:13.471 13028 ERROR nova     sock.listen(backlog)
Sep 28 12:57:13 ctl02 nova-api[13028]: 2017-09-28 12:57:13.471 13028 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:57:13 ctl02 nova-api[13028]: 2017-09-28 12:57:13.471 13028 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:57:13 ctl02 nova-api[13028]: 2017-09-28 12:57:13.471 13028 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:57:13 ctl02 nova-api[13028]: 2017-09-28 12:57:13.471 13028 ERROR nova
Sep 28 12:57:13 ctl02 neutron-server[30536]: 2017-09-28 12:57:13.552 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:57:13 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:57:13 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:57:13 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:57:13 ctl02 glance-api[29183]: 2017-09-28 12:57:13.627 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:57:13] "OPTIONS / HTTP/1.0" 200 134 0.000573
Sep 28 12:57:13 ctl02 heat-api[13008]: 2017-09-28 12:57:13.822 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:57:13] "OPTIONS / HTTP/1.0" 200 134 0.000711
Sep 28 12:57:13 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:57:13 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:57:13 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:57:13 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:57:14 ctl02 neutron-server[30536]: 2017-09-28 12:57:14.305 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:57:14] "OPTIONS / HTTP/1.0" 200 262 0.000604
Sep 28 12:57:14 ctl02 neutron-server[30536]: 2017-09-28 12:57:14.386 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:57:14] "OPTIONS / HTTP/1.0" 200 262 0.000441
Sep 28 12:57:14 ctl02 heat-api-cfn[13300]: 2017-09-28 12:57:14.965 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:57:14] "OPTIONS / HTTP/1.0" 200 134 0.000684
Sep 28 12:57:15 ctl02 nova-api[13045]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:57:15 ctl02 nova-api[13045]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:57:15 ctl02 nova-api[13045]: 2017-09-28 12:57:15.730 13045 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:57:15 ctl02 nova-api[13045]: 2017-09-28 12:57:15.731 13045 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:57:15 ctl02 nova-api[13045]: 2017-09-28 12:57:15.731 13045 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:57:15 ctl02 nova-api[13045]: 2017-09-28 12:57:15.731 13045 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:57:15 ctl02 nova-api[13045]: 2017-09-28 12:57:15.731 13045 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:57:15 ctl02 nova-api[13045]: 2017-09-28 12:57:15.731 13045 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:57:15 ctl02 nova-api[13045]: 2017-09-28 12:57:15.731 13045 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:57:15 ctl02 nova-api[13045]: 2017-09-28 12:57:15.731 13045 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:57:15 ctl02 nova-api[13045]: 2017-09-28 12:57:15.731 13045 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:57:15 ctl02 nova-api[13045]: 2017-09-28 12:57:15.731 13045 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:57:15 ctl02 nova-api[13045]: 2017-09-28 12:57:15.731 13045 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:57:15 ctl02 nova-api[13045]: 2017-09-28 12:57:15.731 13045 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:57:15 ctl02 nova-api[13045]: 2017-09-28 12:57:15.731 13045 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:57:15 ctl02 nova-api[13045]: 2017-09-28 12:57:15.731 13045 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:57:15 ctl02 nova-api[13045]: 2017-09-28 12:57:15.731 13045 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:57:15 ctl02 nova-api[13045]: 2017-09-28 12:57:15.731 13045 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:57:15 ctl02 nova-api[13045]: 2017-09-28 12:57:15.731 13045 ERROR nova.wsgi     self.filename))
Sep 28 12:57:15 ctl02 nova-api[13045]: 2017-09-28 12:57:15.731 13045 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:57:15 ctl02 nova-api[13045]: 2017-09-28 12:57:15.731 13045 ERROR nova.wsgi
Sep 28 12:57:15 ctl02 nova-api[13045]: 2017-09-28 12:57:15.732 13045 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:57:15 ctl02 nova-api[13045]: 2017-09-28 12:57:15.860 13045 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:57:16 ctl02 nova-api[13045]: 2017-09-28 12:57:16.082 13045 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:57:16 ctl02 nova-api[13045]: 2017-09-28 12:57:16.084 13045 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:57:16 ctl02 nova-api[13045]: 2017-09-28 12:57:16.084 13045 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:57:16 ctl02 nova-api[13045]: 2017-09-28 12:57:16.085 13045 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:57:16 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:57:16.116 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:57:16] "OPTIONS / HTTP/1.0" 200 134 0.000411
Sep 28 12:57:16 ctl02 nova-api[13045]: 2017-09-28 12:57:16.215 13045 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:57:16 ctl02 nova-api[13045]: 2017-09-28 12:57:16.216 13045 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:57:16 ctl02 nova-api[13045]: 2017-09-28 12:57:16.217 13045 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:57:16 ctl02 nova-api[13045]: 2017-09-28 12:57:16.217 13045 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:57:16 ctl02 nova-api[13045]: 2017-09-28 12:57:16.220 13045 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:57:16 ctl02 nova-api[13045]: 2017-09-28 12:57:16.220 13045 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:57:16 ctl02 nova-api[13045]: 2017-09-28 12:57:16.220 13045 ERROR nova Traceback (most recent call last):
Sep 28 12:57:16 ctl02 nova-api[13045]: 2017-09-28 12:57:16.220 13045 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:57:16 ctl02 nova-api[13045]: 2017-09-28 12:57:16.220 13045 ERROR nova     sys.exit(main())
Sep 28 12:57:16 ctl02 nova-api[13045]: 2017-09-28 12:57:16.220 13045 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:57:16 ctl02 nova-api[13045]: 2017-09-28 12:57:16.220 13045 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:57:16 ctl02 nova-api[13045]: 2017-09-28 12:57:16.220 13045 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:57:16 ctl02 nova-api[13045]: 2017-09-28 12:57:16.220 13045 ERROR nova     max_url_len=max_url_len)
Sep 28 12:57:16 ctl02 nova-api[13045]: 2017-09-28 12:57:16.220 13045 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:57:16 ctl02 nova-api[13045]: 2017-09-28 12:57:16.220 13045 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:57:16 ctl02 nova-api[13045]: 2017-09-28 12:57:16.220 13045 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:57:16 ctl02 nova-api[13045]: 2017-09-28 12:57:16.220 13045 ERROR nova     sock.listen(backlog)
Sep 28 12:57:16 ctl02 nova-api[13045]: 2017-09-28 12:57:16.220 13045 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:57:16 ctl02 nova-api[13045]: 2017-09-28 12:57:16.220 13045 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:57:16 ctl02 nova-api[13045]: 2017-09-28 12:57:16.220 13045 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:57:16 ctl02 nova-api[13045]: 2017-09-28 12:57:16.220 13045 ERROR nova
Sep 28 12:57:16 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:57:16 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:57:16 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:57:16 ctl02 heat-api-cfn[13300]: 2017-09-28 12:57:16.469 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:57:16] "OPTIONS / HTTP/1.0" 200 134 0.000480
Sep 28 12:57:16 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:57:16 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:57:16 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:57:16 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:57:17 ctl02 heat-api[13008]: 2017-09-28 12:57:17.982 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:57:17] "OPTIONS / HTTP/1.0" 200 134 0.000602
Sep 28 12:57:18 ctl02 nova-api[13065]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:57:18 ctl02 nova-api[13065]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:57:18 ctl02 nova-api[13065]: 2017-09-28 12:57:18.472 13065 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:57:18 ctl02 nova-api[13065]: 2017-09-28 12:57:18.474 13065 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:57:18 ctl02 nova-api[13065]: 2017-09-28 12:57:18.474 13065 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:57:18 ctl02 nova-api[13065]: 2017-09-28 12:57:18.474 13065 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:57:18 ctl02 nova-api[13065]: 2017-09-28 12:57:18.474 13065 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:57:18 ctl02 nova-api[13065]: 2017-09-28 12:57:18.474 13065 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:57:18 ctl02 nova-api[13065]: 2017-09-28 12:57:18.474 13065 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:57:18 ctl02 nova-api[13065]: 2017-09-28 12:57:18.474 13065 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:57:18 ctl02 nova-api[13065]: 2017-09-28 12:57:18.474 13065 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:57:18 ctl02 nova-api[13065]: 2017-09-28 12:57:18.474 13065 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:57:18 ctl02 nova-api[13065]: 2017-09-28 12:57:18.474 13065 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:57:18 ctl02 nova-api[13065]: 2017-09-28 12:57:18.474 13065 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:57:18 ctl02 nova-api[13065]: 2017-09-28 12:57:18.474 13065 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:57:18 ctl02 nova-api[13065]: 2017-09-28 12:57:18.474 13065 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:57:18 ctl02 nova-api[13065]: 2017-09-28 12:57:18.474 13065 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:57:18 ctl02 nova-api[13065]: 2017-09-28 12:57:18.474 13065 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:57:18 ctl02 nova-api[13065]: 2017-09-28 12:57:18.474 13065 ERROR nova.wsgi     self.filename))
Sep 28 12:57:18 ctl02 nova-api[13065]: 2017-09-28 12:57:18.474 13065 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:57:18 ctl02 nova-api[13065]: 2017-09-28 12:57:18.474 13065 ERROR nova.wsgi
Sep 28 12:57:18 ctl02 nova-api[13065]: 2017-09-28 12:57:18.476 13065 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:57:18 ctl02 nova-api[13065]: 2017-09-28 12:57:18.605 13065 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:57:18 ctl02 nova-api[13065]: 2017-09-28 12:57:18.828 13065 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:57:18 ctl02 nova-api[13065]: 2017-09-28 12:57:18.830 13065 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:57:18 ctl02 nova-api[13065]: 2017-09-28 12:57:18.831 13065 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:57:18 ctl02 nova-api[13065]: 2017-09-28 12:57:18.831 13065 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:57:18 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:57:18.918 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:57:18] "OPTIONS / HTTP/1.0" 200 134 0.000380
Sep 28 12:57:18 ctl02 nova-api[13065]: 2017-09-28 12:57:18.961 13065 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:57:18 ctl02 nova-api[13065]: 2017-09-28 12:57:18.963 13065 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:57:18 ctl02 nova-api[13065]: 2017-09-28 12:57:18.963 13065 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:57:18 ctl02 nova-api[13065]: 2017-09-28 12:57:18.964 13065 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:57:18 ctl02 nova-api[13065]: 2017-09-28 12:57:18.967 13065 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:57:18 ctl02 nova-api[13065]: 2017-09-28 12:57:18.967 13065 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:57:18 ctl02 nova-api[13065]: 2017-09-28 12:57:18.967 13065 ERROR nova Traceback (most recent call last):
Sep 28 12:57:18 ctl02 nova-api[13065]: 2017-09-28 12:57:18.967 13065 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:57:18 ctl02 nova-api[13065]: 2017-09-28 12:57:18.967 13065 ERROR nova     sys.exit(main())
Sep 28 12:57:18 ctl02 nova-api[13065]: 2017-09-28 12:57:18.967 13065 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:57:18 ctl02 nova-api[13065]: 2017-09-28 12:57:18.967 13065 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:57:18 ctl02 nova-api[13065]: 2017-09-28 12:57:18.967 13065 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:57:18 ctl02 nova-api[13065]: 2017-09-28 12:57:18.967 13065 ERROR nova     max_url_len=max_url_len)
Sep 28 12:57:18 ctl02 nova-api[13065]: 2017-09-28 12:57:18.967 13065 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:57:18 ctl02 nova-api[13065]: 2017-09-28 12:57:18.967 13065 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:57:18 ctl02 nova-api[13065]: 2017-09-28 12:57:18.967 13065 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:57:18 ctl02 nova-api[13065]: 2017-09-28 12:57:18.967 13065 ERROR nova     sock.listen(backlog)
Sep 28 12:57:18 ctl02 nova-api[13065]: 2017-09-28 12:57:18.967 13065 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:57:18 ctl02 nova-api[13065]: 2017-09-28 12:57:18.967 13065 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:57:18 ctl02 nova-api[13065]: 2017-09-28 12:57:18.967 13065 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:57:18 ctl02 nova-api[13065]: 2017-09-28 12:57:18.967 13065 ERROR nova
Sep 28 12:57:18 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:57:18.986 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:57:18] "OPTIONS / HTTP/1.0" 200 134 0.000375
Sep 28 12:57:19 ctl02 glance-api[29183]: 2017-09-28 12:57:19.027 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:57:19] "OPTIONS / HTTP/1.0" 200 134 0.000532
Sep 28 12:57:19 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:57:19 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:57:19 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:57:19 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:57:19 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:57:19 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:57:19 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:57:20 ctl02 heat-api-cfn[13300]: 2017-09-28 12:57:20.502 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:57:20] "OPTIONS / HTTP/1.0" 200 134 0.000424
Sep 28 12:57:21 ctl02 nova-api[13083]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:57:21 ctl02 nova-api[13083]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:57:21 ctl02 neutron-server[30536]: 2017-09-28 12:57:21.098 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 12:57:21 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:57:21 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:56:28 cmp001
Sep 28 12:57:21 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:56:00 cmp002
Sep 28 12:57:21 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:56:26 cmp002
Sep 28 12:57:21 ctl02 nova-api[13083]: 2017-09-28 12:57:21.221 13083 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:57:21 ctl02 nova-api[13083]: 2017-09-28 12:57:21.222 13083 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:57:21 ctl02 nova-api[13083]: 2017-09-28 12:57:21.222 13083 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:57:21 ctl02 nova-api[13083]: 2017-09-28 12:57:21.222 13083 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:57:21 ctl02 nova-api[13083]: 2017-09-28 12:57:21.222 13083 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:57:21 ctl02 nova-api[13083]: 2017-09-28 12:57:21.222 13083 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:57:21 ctl02 nova-api[13083]: 2017-09-28 12:57:21.222 13083 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:57:21 ctl02 nova-api[13083]: 2017-09-28 12:57:21.222 13083 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:57:21 ctl02 nova-api[13083]: 2017-09-28 12:57:21.222 13083 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:57:21 ctl02 nova-api[13083]: 2017-09-28 12:57:21.222 13083 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:57:21 ctl02 nova-api[13083]: 2017-09-28 12:57:21.222 13083 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:57:21 ctl02 nova-api[13083]: 2017-09-28 12:57:21.222 13083 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:57:21 ctl02 nova-api[13083]: 2017-09-28 12:57:21.222 13083 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:57:21 ctl02 nova-api[13083]: 2017-09-28 12:57:21.222 13083 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:57:21 ctl02 nova-api[13083]: 2017-09-28 12:57:21.222 13083 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:57:21 ctl02 nova-api[13083]: 2017-09-28 12:57:21.222 13083 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:57:21 ctl02 nova-api[13083]: 2017-09-28 12:57:21.222 13083 ERROR nova.wsgi     self.filename))
Sep 28 12:57:21 ctl02 nova-api[13083]: 2017-09-28 12:57:21.222 13083 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:57:21 ctl02 nova-api[13083]: 2017-09-28 12:57:21.222 13083 ERROR nova.wsgi
Sep 28 12:57:21 ctl02 nova-api[13083]: 2017-09-28 12:57:21.223 13083 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:57:21 ctl02 nova-api[13083]: 2017-09-28 12:57:21.351 13083 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:57:21 ctl02 nova-consoleauth[5433]: 2017-09-28 12:57:21.469 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:57:21 ctl02 neutron-server[30536]: 2017-09-28 12:57:21.505 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:57:21] "OPTIONS / HTTP/1.0" 200 262 0.000439
Sep 28 12:57:21 ctl02 nova-api[13083]: 2017-09-28 12:57:21.574 13083 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:57:21 ctl02 nova-api[13083]: 2017-09-28 12:57:21.576 13083 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:57:21 ctl02 nova-api[13083]: 2017-09-28 12:57:21.576 13083 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:57:21 ctl02 nova-api[13083]: 2017-09-28 12:57:21.576 13083 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:57:21 ctl02 nova-api[13083]: 2017-09-28 12:57:21.706 13083 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:57:21 ctl02 nova-api[13083]: 2017-09-28 12:57:21.708 13083 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:57:21 ctl02 nova-api[13083]: 2017-09-28 12:57:21.708 13083 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:57:21 ctl02 nova-api[13083]: 2017-09-28 12:57:21.708 13083 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:57:21 ctl02 nova-api[13083]: 2017-09-28 12:57:21.712 13083 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:57:21 ctl02 nova-api[13083]: 2017-09-28 12:57:21.712 13083 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:57:21 ctl02 nova-api[13083]: 2017-09-28 12:57:21.712 13083 ERROR nova Traceback (most recent call last):
Sep 28 12:57:21 ctl02 nova-api[13083]: 2017-09-28 12:57:21.712 13083 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:57:21 ctl02 nova-api[13083]: 2017-09-28 12:57:21.712 13083 ERROR nova     sys.exit(main())
Sep 28 12:57:21 ctl02 nova-api[13083]: 2017-09-28 12:57:21.712 13083 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:57:21 ctl02 nova-api[13083]: 2017-09-28 12:57:21.712 13083 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:57:21 ctl02 nova-api[13083]: 2017-09-28 12:57:21.712 13083 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:57:21 ctl02 nova-api[13083]: 2017-09-28 12:57:21.712 13083 ERROR nova     max_url_len=max_url_len)
Sep 28 12:57:21 ctl02 nova-api[13083]: 2017-09-28 12:57:21.712 13083 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:57:21 ctl02 nova-api[13083]: 2017-09-28 12:57:21.712 13083 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:57:21 ctl02 nova-api[13083]: 2017-09-28 12:57:21.712 13083 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:57:21 ctl02 nova-api[13083]: 2017-09-28 12:57:21.712 13083 ERROR nova     sock.listen(backlog)
Sep 28 12:57:21 ctl02 nova-api[13083]: 2017-09-28 12:57:21.712 13083 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:57:21 ctl02 nova-api[13083]: 2017-09-28 12:57:21.712 13083 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:57:21 ctl02 nova-api[13083]: 2017-09-28 12:57:21.712 13083 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:57:21 ctl02 nova-api[13083]: 2017-09-28 12:57:21.712 13083 ERROR nova
Sep 28 12:57:21 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:57:21 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:57:21 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:57:21 ctl02 heat-api[13008]: 2017-09-28 12:57:21.994 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:57:21] "OPTIONS / HTTP/1.0" 200 134 0.000592
Sep 28 12:57:22 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:57:22 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:57:22 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:57:22 ctl02 glance-api[29183]: 2017-09-28 12:57:22.141 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:57:22] "OPTIONS / HTTP/1.0" 200 134 0.001403
Sep 28 12:57:22 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:57:22 ctl02 heat-engine[12803]: 2017-09-28 12:57:22.333 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:57:22 ctl02 heat-engine[12803]: 2017-09-28 12:57:22.351 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:57:22 ctl02 heat-engine[12803]: 2017-09-28 12:57:22.354 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:57:22 ctl02 heat-engine[12803]: 2017-09-28 12:57:22.356 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:57:22 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4eec1805)
Sep 28 12:57:23 ctl02 glance-api[29183]: 2017-09-28 12:57:23.379 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:57:23] "OPTIONS / HTTP/1.0" 200 134 0.000557
Sep 28 12:57:23 ctl02 heat-api[13008]: 2017-09-28 12:57:23.720 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:57:23] "OPTIONS / HTTP/1.0" 200 134 0.000601
Sep 28 12:57:23 ctl02 nova-api[13105]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:57:23 ctl02 nova-api[13105]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:57:23 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4eec1805)
Sep 28 12:57:23 ctl02 nova-api[13105]: 2017-09-28 12:57:23.992 13105 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:57:23 ctl02 nova-api[13105]: 2017-09-28 12:57:23.993 13105 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:57:23 ctl02 nova-api[13105]: 2017-09-28 12:57:23.993 13105 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:57:23 ctl02 nova-api[13105]: 2017-09-28 12:57:23.993 13105 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:57:23 ctl02 nova-api[13105]: 2017-09-28 12:57:23.993 13105 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:57:23 ctl02 nova-api[13105]: 2017-09-28 12:57:23.993 13105 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:57:23 ctl02 nova-api[13105]: 2017-09-28 12:57:23.993 13105 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:57:23 ctl02 nova-api[13105]: 2017-09-28 12:57:23.993 13105 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:57:23 ctl02 nova-api[13105]: 2017-09-28 12:57:23.993 13105 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:57:23 ctl02 nova-api[13105]: 2017-09-28 12:57:23.993 13105 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:57:23 ctl02 nova-api[13105]: 2017-09-28 12:57:23.993 13105 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:57:23 ctl02 nova-api[13105]: 2017-09-28 12:57:23.993 13105 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:57:23 ctl02 nova-api[13105]: 2017-09-28 12:57:23.993 13105 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:57:23 ctl02 nova-api[13105]: 2017-09-28 12:57:23.993 13105 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:57:23 ctl02 nova-api[13105]: 2017-09-28 12:57:23.993 13105 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:57:23 ctl02 nova-api[13105]: 2017-09-28 12:57:23.993 13105 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:57:23 ctl02 nova-api[13105]: 2017-09-28 12:57:23.993 13105 ERROR nova.wsgi     self.filename))
Sep 28 12:57:23 ctl02 nova-api[13105]: 2017-09-28 12:57:23.993 13105 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:57:23 ctl02 nova-api[13105]: 2017-09-28 12:57:23.993 13105 ERROR nova.wsgi
Sep 28 12:57:23 ctl02 nova-api[13105]: 2017-09-28 12:57:23.994 13105 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:57:24 ctl02 nova-api[13105]: 2017-09-28 12:57:24.125 13105 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:57:24 ctl02 nova-api[13105]: 2017-09-28 12:57:24.349 13105 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:57:24 ctl02 nova-api[13105]: 2017-09-28 12:57:24.351 13105 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:57:24 ctl02 nova-api[13105]: 2017-09-28 12:57:24.352 13105 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:57:24 ctl02 nova-api[13105]: 2017-09-28 12:57:24.352 13105 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:57:24 ctl02 nova-api[13105]: 2017-09-28 12:57:24.482 13105 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:57:24 ctl02 nova-api[13105]: 2017-09-28 12:57:24.484 13105 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:57:24 ctl02 nova-api[13105]: 2017-09-28 12:57:24.484 13105 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:57:24 ctl02 nova-api[13105]: 2017-09-28 12:57:24.485 13105 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:57:24 ctl02 nova-api[13105]: 2017-09-28 12:57:24.488 13105 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:57:24 ctl02 nova-api[13105]: 2017-09-28 12:57:24.488 13105 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:57:24 ctl02 nova-api[13105]: 2017-09-28 12:57:24.488 13105 ERROR nova Traceback (most recent call last):
Sep 28 12:57:24 ctl02 nova-api[13105]: 2017-09-28 12:57:24.488 13105 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:57:24 ctl02 nova-api[13105]: 2017-09-28 12:57:24.488 13105 ERROR nova     sys.exit(main())
Sep 28 12:57:24 ctl02 nova-api[13105]: 2017-09-28 12:57:24.488 13105 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:57:24 ctl02 nova-api[13105]: 2017-09-28 12:57:24.488 13105 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:57:24 ctl02 nova-api[13105]: 2017-09-28 12:57:24.488 13105 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:57:24 ctl02 nova-api[13105]: 2017-09-28 12:57:24.488 13105 ERROR nova     max_url_len=max_url_len)
Sep 28 12:57:24 ctl02 nova-api[13105]: 2017-09-28 12:57:24.488 13105 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:57:24 ctl02 nova-api[13105]: 2017-09-28 12:57:24.488 13105 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:57:24 ctl02 nova-api[13105]: 2017-09-28 12:57:24.488 13105 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:57:24 ctl02 nova-api[13105]: 2017-09-28 12:57:24.488 13105 ERROR nova     sock.listen(backlog)
Sep 28 12:57:24 ctl02 nova-api[13105]: 2017-09-28 12:57:24.488 13105 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:57:24 ctl02 nova-api[13105]: 2017-09-28 12:57:24.488 13105 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:57:24 ctl02 nova-api[13105]: 2017-09-28 12:57:24.488 13105 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:57:24 ctl02 nova-api[13105]: 2017-09-28 12:57:24.488 13105 ERROR nova
Sep 28 12:57:24 ctl02 nova-scheduler[5620]: 2017-09-28 12:57:24.573 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:57:24 ctl02 neutron-server[30536]: 2017-09-28 12:57:24.624 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:57:24] "OPTIONS / HTTP/1.0" 200 262 0.000574
Sep 28 12:57:24 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:57:24 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:57:24 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:57:24 ctl02 neutron-server[30536]: 2017-09-28 12:57:24.648 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:57:24] "OPTIONS / HTTP/1.0" 200 262 0.000304
Sep 28 12:57:24 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4eec1805)
Sep 28 12:57:24 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:57:24 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:57:24 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:57:24 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:57:25 ctl02 heat-api-cfn[13300]: 2017-09-28 12:57:25.067 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:57:25] "OPTIONS / HTTP/1.0" 200 134 0.000588
Sep 28 12:57:25 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4eec1805)
Sep 28 12:57:26 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:57:26.015 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:57:26] "OPTIONS / HTTP/1.0" 200 134 0.000458
Sep 28 12:57:26 ctl02 heat-api-cfn[13300]: 2017-09-28 12:57:26.158 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:57:26] "OPTIONS / HTTP/1.0" 200 134 0.000531
Sep 28 12:57:26 ctl02 nova-api[13123]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:57:26 ctl02 nova-api[13123]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:57:26 ctl02 nova-api[13123]: 2017-09-28 12:57:26.748 13123 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:57:26 ctl02 nova-api[13123]: 2017-09-28 12:57:26.750 13123 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:57:26 ctl02 nova-api[13123]: 2017-09-28 12:57:26.750 13123 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:57:26 ctl02 nova-api[13123]: 2017-09-28 12:57:26.750 13123 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:57:26 ctl02 nova-api[13123]: 2017-09-28 12:57:26.750 13123 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:57:26 ctl02 nova-api[13123]: 2017-09-28 12:57:26.750 13123 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:57:26 ctl02 nova-api[13123]: 2017-09-28 12:57:26.750 13123 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:57:26 ctl02 nova-api[13123]: 2017-09-28 12:57:26.750 13123 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:57:26 ctl02 nova-api[13123]: 2017-09-28 12:57:26.750 13123 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:57:26 ctl02 nova-api[13123]: 2017-09-28 12:57:26.750 13123 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:57:26 ctl02 nova-api[13123]: 2017-09-28 12:57:26.750 13123 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:57:26 ctl02 nova-api[13123]: 2017-09-28 12:57:26.750 13123 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:57:26 ctl02 nova-api[13123]: 2017-09-28 12:57:26.750 13123 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:57:26 ctl02 nova-api[13123]: 2017-09-28 12:57:26.750 13123 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:57:26 ctl02 nova-api[13123]: 2017-09-28 12:57:26.750 13123 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:57:26 ctl02 nova-api[13123]: 2017-09-28 12:57:26.750 13123 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:57:26 ctl02 nova-api[13123]: 2017-09-28 12:57:26.750 13123 ERROR nova.wsgi     self.filename))
Sep 28 12:57:26 ctl02 nova-api[13123]: 2017-09-28 12:57:26.750 13123 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:57:26 ctl02 nova-api[13123]: 2017-09-28 12:57:26.750 13123 ERROR nova.wsgi
Sep 28 12:57:26 ctl02 nova-api[13123]: 2017-09-28 12:57:26.751 13123 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:57:26 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4eec1805)
Sep 28 12:57:26 ctl02 nova-api[13123]: 2017-09-28 12:57:26.880 13123 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:57:27 ctl02 nova-api[13123]: 2017-09-28 12:57:27.107 13123 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:57:27 ctl02 nova-api[13123]: 2017-09-28 12:57:27.109 13123 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:57:27 ctl02 nova-api[13123]: 2017-09-28 12:57:27.109 13123 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:57:27 ctl02 nova-api[13123]: 2017-09-28 12:57:27.109 13123 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:57:27 ctl02 nova-api[13123]: 2017-09-28 12:57:27.242 13123 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:57:27 ctl02 nova-api[13123]: 2017-09-28 12:57:27.244 13123 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:57:27 ctl02 nova-api[13123]: 2017-09-28 12:57:27.244 13123 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:57:27 ctl02 nova-api[13123]: 2017-09-28 12:57:27.244 13123 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:57:27 ctl02 nova-api[13123]: 2017-09-28 12:57:27.247 13123 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:57:27 ctl02 nova-api[13123]: 2017-09-28 12:57:27.248 13123 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:57:27 ctl02 nova-api[13123]: 2017-09-28 12:57:27.248 13123 ERROR nova Traceback (most recent call last):
Sep 28 12:57:27 ctl02 nova-api[13123]: 2017-09-28 12:57:27.248 13123 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:57:27 ctl02 nova-api[13123]: 2017-09-28 12:57:27.248 13123 ERROR nova     sys.exit(main())
Sep 28 12:57:27 ctl02 nova-api[13123]: 2017-09-28 12:57:27.248 13123 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:57:27 ctl02 nova-api[13123]: 2017-09-28 12:57:27.248 13123 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:57:27 ctl02 nova-api[13123]: 2017-09-28 12:57:27.248 13123 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:57:27 ctl02 nova-api[13123]: 2017-09-28 12:57:27.248 13123 ERROR nova     max_url_len=max_url_len)
Sep 28 12:57:27 ctl02 nova-api[13123]: 2017-09-28 12:57:27.248 13123 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:57:27 ctl02 nova-api[13123]: 2017-09-28 12:57:27.248 13123 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:57:27 ctl02 nova-api[13123]: 2017-09-28 12:57:27.248 13123 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:57:27 ctl02 nova-api[13123]: 2017-09-28 12:57:27.248 13123 ERROR nova     sock.listen(backlog)
Sep 28 12:57:27 ctl02 nova-api[13123]: 2017-09-28 12:57:27.248 13123 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:57:27 ctl02 nova-api[13123]: 2017-09-28 12:57:27.248 13123 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:57:27 ctl02 nova-api[13123]: 2017-09-28 12:57:27.248 13123 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:57:27 ctl02 nova-api[13123]: 2017-09-28 12:57:27.248 13123 ERROR nova
Sep 28 12:57:27 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:57:27 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:57:27 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:57:27 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:57:27 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:57:27 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:57:27 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:57:27 ctl02 heat-api[13008]: 2017-09-28 12:57:27.719 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:57:27] "OPTIONS / HTTP/1.0" 200 134 0.000780
Sep 28 12:57:27 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4eec1805)
Sep 28 12:57:28 ctl02 neutron-server[30536]: 2017-09-28 12:57:28.548 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:57:28 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:57:28.707 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:57:28] "OPTIONS / HTTP/1.0" 200 134 0.000460
Sep 28 12:57:28 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4eec1805)
Sep 28 12:57:29 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:57:29.121 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:57:29] "OPTIONS / HTTP/1.0" 200 134 0.000427
Sep 28 12:57:29 ctl02 glance-api[29183]: 2017-09-28 12:57:29.279 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:57:29] "OPTIONS / HTTP/1.0" 200 134 0.000626
Sep 28 12:57:29 ctl02 nova-api[13141]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:57:29 ctl02 nova-api[13141]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:57:29 ctl02 nova-api[13141]: 2017-09-28 12:57:29.557 13141 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:57:29 ctl02 nova-api[13141]: 2017-09-28 12:57:29.558 13141 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:57:29 ctl02 nova-api[13141]: 2017-09-28 12:57:29.558 13141 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:57:29 ctl02 nova-api[13141]: 2017-09-28 12:57:29.558 13141 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:57:29 ctl02 nova-api[13141]: 2017-09-28 12:57:29.558 13141 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:57:29 ctl02 nova-api[13141]: 2017-09-28 12:57:29.558 13141 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:57:29 ctl02 nova-api[13141]: 2017-09-28 12:57:29.558 13141 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:57:29 ctl02 nova-api[13141]: 2017-09-28 12:57:29.558 13141 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:57:29 ctl02 nova-api[13141]: 2017-09-28 12:57:29.558 13141 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:57:29 ctl02 nova-api[13141]: 2017-09-28 12:57:29.558 13141 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:57:29 ctl02 nova-api[13141]: 2017-09-28 12:57:29.558 13141 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:57:29 ctl02 nova-api[13141]: 2017-09-28 12:57:29.558 13141 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:57:29 ctl02 nova-api[13141]: 2017-09-28 12:57:29.558 13141 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:57:29 ctl02 nova-api[13141]: 2017-09-28 12:57:29.558 13141 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:57:29 ctl02 nova-api[13141]: 2017-09-28 12:57:29.558 13141 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:57:29 ctl02 nova-api[13141]: 2017-09-28 12:57:29.558 13141 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:57:29 ctl02 nova-api[13141]: 2017-09-28 12:57:29.558 13141 ERROR nova.wsgi     self.filename))
Sep 28 12:57:29 ctl02 nova-api[13141]: 2017-09-28 12:57:29.558 13141 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:57:29 ctl02 nova-api[13141]: 2017-09-28 12:57:29.558 13141 ERROR nova.wsgi
Sep 28 12:57:29 ctl02 nova-api[13141]: 2017-09-28 12:57:29.559 13141 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:57:29 ctl02 nova-api[13141]: 2017-09-28 12:57:29.693 13141 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:57:29 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4eec1805)
Sep 28 12:57:29 ctl02 nova-api[13141]: 2017-09-28 12:57:29.942 13141 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:57:29 ctl02 nova-api[13141]: 2017-09-28 12:57:29.944 13141 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:57:29 ctl02 nova-api[13141]: 2017-09-28 12:57:29.945 13141 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:57:29 ctl02 nova-api[13141]: 2017-09-28 12:57:29.945 13141 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:57:30 ctl02 nova-api[13141]: 2017-09-28 12:57:30.077 13141 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:57:30 ctl02 nova-api[13141]: 2017-09-28 12:57:30.079 13141 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:57:30 ctl02 nova-api[13141]: 2017-09-28 12:57:30.079 13141 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:57:30 ctl02 nova-api[13141]: 2017-09-28 12:57:30.079 13141 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:57:30 ctl02 nova-api[13141]: 2017-09-28 12:57:30.083 13141 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:57:30 ctl02 nova-api[13141]: 2017-09-28 12:57:30.083 13141 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:57:30 ctl02 nova-api[13141]: 2017-09-28 12:57:30.083 13141 ERROR nova Traceback (most recent call last):
Sep 28 12:57:30 ctl02 nova-api[13141]: 2017-09-28 12:57:30.083 13141 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:57:30 ctl02 nova-api[13141]: 2017-09-28 12:57:30.083 13141 ERROR nova     sys.exit(main())
Sep 28 12:57:30 ctl02 nova-api[13141]: 2017-09-28 12:57:30.083 13141 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:57:30 ctl02 nova-api[13141]: 2017-09-28 12:57:30.083 13141 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:57:30 ctl02 nova-api[13141]: 2017-09-28 12:57:30.083 13141 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:57:30 ctl02 nova-api[13141]: 2017-09-28 12:57:30.083 13141 ERROR nova     max_url_len=max_url_len)
Sep 28 12:57:30 ctl02 nova-api[13141]: 2017-09-28 12:57:30.083 13141 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:57:30 ctl02 nova-api[13141]: 2017-09-28 12:57:30.083 13141 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:57:30 ctl02 nova-api[13141]: 2017-09-28 12:57:30.083 13141 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:57:30 ctl02 nova-api[13141]: 2017-09-28 12:57:30.083 13141 ERROR nova     sock.listen(backlog)
Sep 28 12:57:30 ctl02 nova-api[13141]: 2017-09-28 12:57:30.083 13141 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:57:30 ctl02 nova-api[13141]: 2017-09-28 12:57:30.083 13141 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:57:30 ctl02 nova-api[13141]: 2017-09-28 12:57:30.083 13141 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:57:30 ctl02 nova-api[13141]: 2017-09-28 12:57:30.083 13141 ERROR nova
Sep 28 12:57:30 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:57:30 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:57:30 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:57:30 ctl02 heat-api-cfn[13300]: 2017-09-28 12:57:30.349 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:57:30] "OPTIONS / HTTP/1.0" 200 134 0.000514
Sep 28 12:57:30 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:57:30 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:57:30 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:57:30 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:57:30 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4eec1805)
Sep 28 12:57:31 ctl02 neutron-server[30536]: 2017-09-28 12:57:31.556 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:57:31] "OPTIONS / HTTP/1.0" 200 262 0.000476
Sep 28 12:57:31 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4eec1805)
Sep 28 12:57:31 ctl02 glance-api[29183]: 2017-09-28 12:57:31.932 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:57:31] "OPTIONS / HTTP/1.0" 200 134 0.000615
Sep 28 12:57:31 ctl02 heat-api[13008]: 2017-09-28 12:57:31.942 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:57:31] "OPTIONS / HTTP/1.0" 200 134 0.000666
Sep 28 12:57:32 ctl02 nova-api[13158]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:57:32 ctl02 nova-api[13158]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:57:32 ctl02 nova-api[13158]: 2017-09-28 12:57:32.248 13158 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:57:32 ctl02 nova-api[13158]: 2017-09-28 12:57:32.250 13158 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:57:32 ctl02 nova-api[13158]: 2017-09-28 12:57:32.250 13158 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:57:32 ctl02 nova-api[13158]: 2017-09-28 12:57:32.250 13158 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:57:32 ctl02 nova-api[13158]: 2017-09-28 12:57:32.250 13158 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:57:32 ctl02 nova-api[13158]: 2017-09-28 12:57:32.250 13158 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:57:32 ctl02 nova-api[13158]: 2017-09-28 12:57:32.250 13158 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:57:32 ctl02 nova-api[13158]: 2017-09-28 12:57:32.250 13158 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:57:32 ctl02 nova-api[13158]: 2017-09-28 12:57:32.250 13158 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:57:32 ctl02 nova-api[13158]: 2017-09-28 12:57:32.250 13158 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:57:32 ctl02 nova-api[13158]: 2017-09-28 12:57:32.250 13158 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:57:32 ctl02 nova-api[13158]: 2017-09-28 12:57:32.250 13158 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:57:32 ctl02 nova-api[13158]: 2017-09-28 12:57:32.250 13158 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:57:32 ctl02 nova-api[13158]: 2017-09-28 12:57:32.250 13158 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:57:32 ctl02 nova-api[13158]: 2017-09-28 12:57:32.250 13158 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:57:32 ctl02 nova-api[13158]: 2017-09-28 12:57:32.250 13158 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:57:32 ctl02 nova-api[13158]: 2017-09-28 12:57:32.250 13158 ERROR nova.wsgi     self.filename))
Sep 28 12:57:32 ctl02 nova-api[13158]: 2017-09-28 12:57:32.250 13158 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:57:32 ctl02 nova-api[13158]: 2017-09-28 12:57:32.250 13158 ERROR nova.wsgi
Sep 28 12:57:32 ctl02 nova-api[13158]: 2017-09-28 12:57:32.252 13158 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:57:32 ctl02 nova-api[13158]: 2017-09-28 12:57:32.398 13158 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:57:32 ctl02 nova-api[13158]: 2017-09-28 12:57:32.644 13158 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:57:32 ctl02 nova-api[13158]: 2017-09-28 12:57:32.646 13158 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:57:32 ctl02 nova-api[13158]: 2017-09-28 12:57:32.646 13158 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:57:32 ctl02 nova-api[13158]: 2017-09-28 12:57:32.646 13158 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:57:32 ctl02 nova-api[13158]: 2017-09-28 12:57:32.778 13158 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:57:32 ctl02 nova-api[13158]: 2017-09-28 12:57:32.779 13158 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:57:32 ctl02 nova-api[13158]: 2017-09-28 12:57:32.780 13158 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:57:32 ctl02 nova-api[13158]: 2017-09-28 12:57:32.780 13158 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:57:32 ctl02 nova-api[13158]: 2017-09-28 12:57:32.783 13158 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:57:32 ctl02 nova-api[13158]: 2017-09-28 12:57:32.784 13158 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:57:32 ctl02 nova-api[13158]: 2017-09-28 12:57:32.784 13158 ERROR nova Traceback (most recent call last):
Sep 28 12:57:32 ctl02 nova-api[13158]: 2017-09-28 12:57:32.784 13158 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:57:32 ctl02 nova-api[13158]: 2017-09-28 12:57:32.784 13158 ERROR nova     sys.exit(main())
Sep 28 12:57:32 ctl02 nova-api[13158]: 2017-09-28 12:57:32.784 13158 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:57:32 ctl02 nova-api[13158]: 2017-09-28 12:57:32.784 13158 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:57:32 ctl02 nova-api[13158]: 2017-09-28 12:57:32.784 13158 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:57:32 ctl02 nova-api[13158]: 2017-09-28 12:57:32.784 13158 ERROR nova     max_url_len=max_url_len)
Sep 28 12:57:32 ctl02 nova-api[13158]: 2017-09-28 12:57:32.784 13158 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:57:32 ctl02 nova-api[13158]: 2017-09-28 12:57:32.784 13158 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:57:32 ctl02 nova-api[13158]: 2017-09-28 12:57:32.784 13158 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:57:32 ctl02 nova-api[13158]: 2017-09-28 12:57:32.784 13158 ERROR nova     sock.listen(backlog)
Sep 28 12:57:32 ctl02 nova-api[13158]: 2017-09-28 12:57:32.784 13158 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:57:32 ctl02 nova-api[13158]: 2017-09-28 12:57:32.784 13158 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:57:32 ctl02 nova-api[13158]: 2017-09-28 12:57:32.784 13158 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:57:32 ctl02 nova-api[13158]: 2017-09-28 12:57:32.784 13158 ERROR nova
Sep 28 12:57:32 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4eec1805)
Sep 28 12:57:32 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:57:32 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:57:32 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:57:33 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:57:33 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:57:33 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:57:33 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:57:33 ctl02 heat-api[13008]: 2017-09-28 12:57:33.442 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:57:33] "OPTIONS / HTTP/1.0" 200 134 0.000629
Sep 28 12:57:33 ctl02 glance-api[29183]: 2017-09-28 12:57:33.542 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:57:33] "OPTIONS / HTTP/1.0" 200 134 0.000553
Sep 28 12:57:33 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:57:33 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:57:34 ctl02 neutron-server[30536]: 2017-09-28 12:57:34.661 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:57:34] "OPTIONS / HTTP/1.0" 200 262 0.000442
Sep 28 12:57:34 ctl02 nova-api[13177]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:57:34 ctl02 nova-api[13177]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:57:34 ctl02 heat-api-cfn[13300]: 2017-09-28 12:57:34.947 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:57:34] "OPTIONS / HTTP/1.0" 200 134 0.000550
Sep 28 12:57:34 ctl02 nova-api[13177]: 2017-09-28 12:57:34.989 13177 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:57:34 ctl02 nova-api[13177]: 2017-09-28 12:57:34.990 13177 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:57:34 ctl02 nova-api[13177]: 2017-09-28 12:57:34.990 13177 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:57:34 ctl02 nova-api[13177]: 2017-09-28 12:57:34.990 13177 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:57:34 ctl02 nova-api[13177]: 2017-09-28 12:57:34.990 13177 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:57:34 ctl02 nova-api[13177]: 2017-09-28 12:57:34.990 13177 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:57:34 ctl02 nova-api[13177]: 2017-09-28 12:57:34.990 13177 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:57:34 ctl02 nova-api[13177]: 2017-09-28 12:57:34.990 13177 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:57:34 ctl02 nova-api[13177]: 2017-09-28 12:57:34.990 13177 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:57:34 ctl02 nova-api[13177]: 2017-09-28 12:57:34.990 13177 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:57:34 ctl02 nova-api[13177]: 2017-09-28 12:57:34.990 13177 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:57:34 ctl02 nova-api[13177]: 2017-09-28 12:57:34.990 13177 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:57:34 ctl02 nova-api[13177]: 2017-09-28 12:57:34.990 13177 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:57:34 ctl02 nova-api[13177]: 2017-09-28 12:57:34.990 13177 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:57:34 ctl02 nova-api[13177]: 2017-09-28 12:57:34.990 13177 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:57:34 ctl02 nova-api[13177]: 2017-09-28 12:57:34.990 13177 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:57:34 ctl02 nova-api[13177]: 2017-09-28 12:57:34.990 13177 ERROR nova.wsgi     self.filename))
Sep 28 12:57:34 ctl02 nova-api[13177]: 2017-09-28 12:57:34.990 13177 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:57:34 ctl02 nova-api[13177]: 2017-09-28 12:57:34.990 13177 ERROR nova.wsgi
Sep 28 12:57:34 ctl02 nova-api[13177]: 2017-09-28 12:57:34.991 13177 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:57:34 ctl02 neutron-server[30536]: 2017-09-28 12:57:34.995 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:57:34] "OPTIONS / HTTP/1.0" 200 262 0.000486
Sep 28 12:57:35 ctl02 nova-api[13177]: 2017-09-28 12:57:35.120 13177 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:57:35 ctl02 nova-api[13177]: 2017-09-28 12:57:35.342 13177 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:57:35 ctl02 nova-api[13177]: 2017-09-28 12:57:35.344 13177 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:57:35 ctl02 nova-api[13177]: 2017-09-28 12:57:35.344 13177 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:57:35 ctl02 nova-api[13177]: 2017-09-28 12:57:35.344 13177 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:57:35 ctl02 nova-api[13177]: 2017-09-28 12:57:35.474 13177 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:57:35 ctl02 nova-api[13177]: 2017-09-28 12:57:35.476 13177 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:57:35 ctl02 nova-api[13177]: 2017-09-28 12:57:35.476 13177 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:57:35 ctl02 nova-api[13177]: 2017-09-28 12:57:35.476 13177 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:57:35 ctl02 nova-api[13177]: 2017-09-28 12:57:35.479 13177 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:57:35 ctl02 nova-api[13177]: 2017-09-28 12:57:35.480 13177 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:57:35 ctl02 nova-api[13177]: 2017-09-28 12:57:35.480 13177 ERROR nova Traceback (most recent call last):
Sep 28 12:57:35 ctl02 nova-api[13177]: 2017-09-28 12:57:35.480 13177 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:57:35 ctl02 nova-api[13177]: 2017-09-28 12:57:35.480 13177 ERROR nova     sys.exit(main())
Sep 28 12:57:35 ctl02 nova-api[13177]: 2017-09-28 12:57:35.480 13177 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:57:35 ctl02 nova-api[13177]: 2017-09-28 12:57:35.480 13177 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:57:35 ctl02 nova-api[13177]: 2017-09-28 12:57:35.480 13177 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:57:35 ctl02 nova-api[13177]: 2017-09-28 12:57:35.480 13177 ERROR nova     max_url_len=max_url_len)
Sep 28 12:57:35 ctl02 nova-api[13177]: 2017-09-28 12:57:35.480 13177 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:57:35 ctl02 nova-api[13177]: 2017-09-28 12:57:35.480 13177 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:57:35 ctl02 nova-api[13177]: 2017-09-28 12:57:35.480 13177 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:57:35 ctl02 nova-api[13177]: 2017-09-28 12:57:35.480 13177 ERROR nova     sock.listen(backlog)
Sep 28 12:57:35 ctl02 nova-api[13177]: 2017-09-28 12:57:35.480 13177 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:57:35 ctl02 nova-api[13177]: 2017-09-28 12:57:35.480 13177 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:57:35 ctl02 nova-api[13177]: 2017-09-28 12:57:35.480 13177 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:57:35 ctl02 nova-api[13177]: 2017-09-28 12:57:35.480 13177 ERROR nova
Sep 28 12:57:35 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:57:35 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:57:35 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:57:35 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:57:35 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:57:35 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:57:35 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:57:35 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:57:35.966 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:57:35] "OPTIONS / HTTP/1.0" 200 134 0.000446
Sep 28 12:57:36 ctl02 neutron-server[30536]: 2017-09-28 12:57:36.093 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 4 dead agents out of 6:
Sep 28 12:57:36 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:57:36 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:57:06 cmp002
Sep 28 12:57:36 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:56:28 cmp001
Sep 28 12:57:36 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:56:00 cmp002
Sep 28 12:57:36 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:56:26 cmp002
Sep 28 12:57:36 ctl02 heat-api-cfn[13300]: 2017-09-28 12:57:36.304 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:57:36] "OPTIONS / HTTP/1.0" 200 134 0.000640
Sep 28 12:57:37 ctl02 heat-api[13008]: 2017-09-28 12:57:37.552 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:57:37] "OPTIONS / HTTP/1.0" 200 134 0.000597
Sep 28 12:57:37 ctl02 nova-api[13200]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:57:37 ctl02 nova-api[13200]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:57:37 ctl02 nova-api[13200]: 2017-09-28 12:57:37.763 13200 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:57:37 ctl02 nova-api[13200]: 2017-09-28 12:57:37.765 13200 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:57:37 ctl02 nova-api[13200]: 2017-09-28 12:57:37.765 13200 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:57:37 ctl02 nova-api[13200]: 2017-09-28 12:57:37.765 13200 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:57:37 ctl02 nova-api[13200]: 2017-09-28 12:57:37.765 13200 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:57:37 ctl02 nova-api[13200]: 2017-09-28 12:57:37.765 13200 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:57:37 ctl02 nova-api[13200]: 2017-09-28 12:57:37.765 13200 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:57:37 ctl02 nova-api[13200]: 2017-09-28 12:57:37.765 13200 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:57:37 ctl02 nova-api[13200]: 2017-09-28 12:57:37.765 13200 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:57:37 ctl02 nova-api[13200]: 2017-09-28 12:57:37.765 13200 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:57:37 ctl02 nova-api[13200]: 2017-09-28 12:57:37.765 13200 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:57:37 ctl02 nova-api[13200]: 2017-09-28 12:57:37.765 13200 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:57:37 ctl02 nova-api[13200]: 2017-09-28 12:57:37.765 13200 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:57:37 ctl02 nova-api[13200]: 2017-09-28 12:57:37.765 13200 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:57:37 ctl02 nova-api[13200]: 2017-09-28 12:57:37.765 13200 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:57:37 ctl02 nova-api[13200]: 2017-09-28 12:57:37.765 13200 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:57:37 ctl02 nova-api[13200]: 2017-09-28 12:57:37.765 13200 ERROR nova.wsgi     self.filename))
Sep 28 12:57:37 ctl02 nova-api[13200]: 2017-09-28 12:57:37.765 13200 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:57:37 ctl02 nova-api[13200]: 2017-09-28 12:57:37.765 13200 ERROR nova.wsgi
Sep 28 12:57:37 ctl02 nova-api[13200]: 2017-09-28 12:57:37.766 13200 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:57:37 ctl02 nova-api[13200]: 2017-09-28 12:57:37.896 13200 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:57:38 ctl02 nova-api[13200]: 2017-09-28 12:57:38.116 13200 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:57:38 ctl02 nova-api[13200]: 2017-09-28 12:57:38.118 13200 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:57:38 ctl02 nova-api[13200]: 2017-09-28 12:57:38.118 13200 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:57:38 ctl02 nova-api[13200]: 2017-09-28 12:57:38.118 13200 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:57:38 ctl02 nova-api[13200]: 2017-09-28 12:57:38.249 13200 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:57:38 ctl02 nova-api[13200]: 2017-09-28 12:57:38.251 13200 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:57:38 ctl02 nova-api[13200]: 2017-09-28 12:57:38.251 13200 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:57:38 ctl02 nova-api[13200]: 2017-09-28 12:57:38.252 13200 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:57:38 ctl02 nova-api[13200]: 2017-09-28 12:57:38.255 13200 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:57:38 ctl02 nova-api[13200]: 2017-09-28 12:57:38.255 13200 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:57:38 ctl02 nova-api[13200]: 2017-09-28 12:57:38.255 13200 ERROR nova Traceback (most recent call last):
Sep 28 12:57:38 ctl02 nova-api[13200]: 2017-09-28 12:57:38.255 13200 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:57:38 ctl02 nova-api[13200]: 2017-09-28 12:57:38.255 13200 ERROR nova     sys.exit(main())
Sep 28 12:57:38 ctl02 nova-api[13200]: 2017-09-28 12:57:38.255 13200 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:57:38 ctl02 nova-api[13200]: 2017-09-28 12:57:38.255 13200 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:57:38 ctl02 nova-api[13200]: 2017-09-28 12:57:38.255 13200 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:57:38 ctl02 nova-api[13200]: 2017-09-28 12:57:38.255 13200 ERROR nova     max_url_len=max_url_len)
Sep 28 12:57:38 ctl02 nova-api[13200]: 2017-09-28 12:57:38.255 13200 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:57:38 ctl02 nova-api[13200]: 2017-09-28 12:57:38.255 13200 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:57:38 ctl02 nova-api[13200]: 2017-09-28 12:57:38.255 13200 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:57:38 ctl02 nova-api[13200]: 2017-09-28 12:57:38.255 13200 ERROR nova     sock.listen(backlog)
Sep 28 12:57:38 ctl02 nova-api[13200]: 2017-09-28 12:57:38.255 13200 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:57:38 ctl02 nova-api[13200]: 2017-09-28 12:57:38.255 13200 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:57:38 ctl02 nova-api[13200]: 2017-09-28 12:57:38.255 13200 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:57:38 ctl02 nova-api[13200]: 2017-09-28 12:57:38.255 13200 ERROR nova
Sep 28 12:57:38 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:57:38 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:57:38 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:57:38 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:57:38.451 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:57:38] "OPTIONS / HTTP/1.0" 200 134 0.000435
Sep 28 12:57:38 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:57:38 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:57:38 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:57:38 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:57:38 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:57:38.900 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:57:38] "OPTIONS / HTTP/1.0" 200 134 0.000444
Sep 28 12:57:39 ctl02 glance-api[29183]: 2017-09-28 12:57:39.269 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:57:39] "OPTIONS / HTTP/1.0" 200 134 0.000552
Sep 28 12:57:40 ctl02 nova-api[13217]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:57:40 ctl02 nova-api[13217]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:57:40 ctl02 heat-api-cfn[13300]: 2017-09-28 12:57:40.401 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:57:40] "OPTIONS / HTTP/1.0" 200 134 0.000526
Sep 28 12:57:40 ctl02 nova-api[13217]: 2017-09-28 12:57:40.501 13217 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:57:40 ctl02 nova-api[13217]: 2017-09-28 12:57:40.502 13217 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:57:40 ctl02 nova-api[13217]: 2017-09-28 12:57:40.502 13217 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:57:40 ctl02 nova-api[13217]: 2017-09-28 12:57:40.502 13217 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:57:40 ctl02 nova-api[13217]: 2017-09-28 12:57:40.502 13217 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:57:40 ctl02 nova-api[13217]: 2017-09-28 12:57:40.502 13217 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:57:40 ctl02 nova-api[13217]: 2017-09-28 12:57:40.502 13217 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:57:40 ctl02 nova-api[13217]: 2017-09-28 12:57:40.502 13217 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:57:40 ctl02 nova-api[13217]: 2017-09-28 12:57:40.502 13217 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:57:40 ctl02 nova-api[13217]: 2017-09-28 12:57:40.502 13217 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:57:40 ctl02 nova-api[13217]: 2017-09-28 12:57:40.502 13217 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:57:40 ctl02 nova-api[13217]: 2017-09-28 12:57:40.502 13217 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:57:40 ctl02 nova-api[13217]: 2017-09-28 12:57:40.502 13217 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:57:40 ctl02 nova-api[13217]: 2017-09-28 12:57:40.502 13217 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:57:40 ctl02 nova-api[13217]: 2017-09-28 12:57:40.502 13217 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:57:40 ctl02 nova-api[13217]: 2017-09-28 12:57:40.502 13217 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:57:40 ctl02 nova-api[13217]: 2017-09-28 12:57:40.502 13217 ERROR nova.wsgi     self.filename))
Sep 28 12:57:40 ctl02 nova-api[13217]: 2017-09-28 12:57:40.502 13217 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:57:40 ctl02 nova-api[13217]: 2017-09-28 12:57:40.502 13217 ERROR nova.wsgi
Sep 28 12:57:40 ctl02 nova-api[13217]: 2017-09-28 12:57:40.503 13217 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:57:40 ctl02 nova-api[13217]: 2017-09-28 12:57:40.629 13217 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:57:40 ctl02 nova-api[13217]: 2017-09-28 12:57:40.851 13217 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:57:40 ctl02 nova-api[13217]: 2017-09-28 12:57:40.854 13217 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:57:40 ctl02 nova-api[13217]: 2017-09-28 12:57:40.854 13217 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:57:40 ctl02 nova-api[13217]: 2017-09-28 12:57:40.855 13217 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:57:40 ctl02 nova-api[13217]: 2017-09-28 12:57:40.985 13217 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:57:40 ctl02 nova-api[13217]: 2017-09-28 12:57:40.987 13217 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:57:40 ctl02 nova-api[13217]: 2017-09-28 12:57:40.987 13217 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:57:40 ctl02 nova-api[13217]: 2017-09-28 12:57:40.987 13217 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:57:40 ctl02 nova-api[13217]: 2017-09-28 12:57:40.990 13217 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:57:40 ctl02 nova-api[13217]: 2017-09-28 12:57:40.991 13217 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:57:40 ctl02 nova-api[13217]: 2017-09-28 12:57:40.991 13217 ERROR nova Traceback (most recent call last):
Sep 28 12:57:40 ctl02 nova-api[13217]: 2017-09-28 12:57:40.991 13217 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:57:40 ctl02 nova-api[13217]: 2017-09-28 12:57:40.991 13217 ERROR nova     sys.exit(main())
Sep 28 12:57:40 ctl02 nova-api[13217]: 2017-09-28 12:57:40.991 13217 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:57:40 ctl02 nova-api[13217]: 2017-09-28 12:57:40.991 13217 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:57:40 ctl02 nova-api[13217]: 2017-09-28 12:57:40.991 13217 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:57:40 ctl02 nova-api[13217]: 2017-09-28 12:57:40.991 13217 ERROR nova     max_url_len=max_url_len)
Sep 28 12:57:40 ctl02 nova-api[13217]: 2017-09-28 12:57:40.991 13217 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:57:40 ctl02 nova-api[13217]: 2017-09-28 12:57:40.991 13217 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:57:40 ctl02 nova-api[13217]: 2017-09-28 12:57:40.991 13217 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:57:40 ctl02 nova-api[13217]: 2017-09-28 12:57:40.991 13217 ERROR nova     sock.listen(backlog)
Sep 28 12:57:40 ctl02 nova-api[13217]: 2017-09-28 12:57:40.991 13217 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:57:40 ctl02 nova-api[13217]: 2017-09-28 12:57:40.991 13217 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:57:40 ctl02 nova-api[13217]: 2017-09-28 12:57:40.991 13217 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:57:40 ctl02 nova-api[13217]: 2017-09-28 12:57:40.991 13217 ERROR nova
Sep 28 12:57:41 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:57:41 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:57:41 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:57:41 ctl02 neutron-server[30536]: 2017-09-28 12:57:41.233 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:57:41] "OPTIONS / HTTP/1.0" 200 262 0.000593
Sep 28 12:57:41 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:57:41 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:57:41 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:57:41 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:57:41 ctl02 heat-api[13008]: 2017-09-28 12:57:41.873 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:57:41] "OPTIONS / HTTP/1.0" 200 134 0.000556
Sep 28 12:57:42 ctl02 glance-api[29183]: 2017-09-28 12:57:42.065 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:57:42] "OPTIONS / HTTP/1.0" 200 134 0.000556
Sep 28 12:57:43 ctl02 nova-api[13235]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:57:43 ctl02 nova-api[13235]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:57:43 ctl02 nova-conductor[5056]: 2017-09-28 12:57:43.214 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:57:43 ctl02 nova-conductor[5056]: 2017-09-28 12:57:43.220 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:57:43 ctl02 nova-conductor[5056]: 2017-09-28 12:57:43.224 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:57:43 ctl02 nova-conductor[5056]: 2017-09-28 12:57:43.230 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:57:43 ctl02 nova-api[13235]: 2017-09-28 12:57:43.272 13235 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:57:43 ctl02 nova-api[13235]: 2017-09-28 12:57:43.274 13235 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:57:43 ctl02 nova-api[13235]: 2017-09-28 12:57:43.274 13235 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:57:43 ctl02 nova-api[13235]: 2017-09-28 12:57:43.274 13235 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:57:43 ctl02 nova-api[13235]: 2017-09-28 12:57:43.274 13235 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:57:43 ctl02 nova-api[13235]: 2017-09-28 12:57:43.274 13235 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:57:43 ctl02 nova-api[13235]: 2017-09-28 12:57:43.274 13235 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:57:43 ctl02 nova-api[13235]: 2017-09-28 12:57:43.274 13235 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:57:43 ctl02 nova-api[13235]: 2017-09-28 12:57:43.274 13235 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:57:43 ctl02 nova-api[13235]: 2017-09-28 12:57:43.274 13235 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:57:43 ctl02 nova-api[13235]: 2017-09-28 12:57:43.274 13235 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:57:43 ctl02 nova-api[13235]: 2017-09-28 12:57:43.274 13235 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:57:43 ctl02 nova-api[13235]: 2017-09-28 12:57:43.274 13235 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:57:43 ctl02 nova-api[13235]: 2017-09-28 12:57:43.274 13235 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:57:43 ctl02 nova-api[13235]: 2017-09-28 12:57:43.274 13235 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:57:43 ctl02 nova-api[13235]: 2017-09-28 12:57:43.274 13235 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:57:43 ctl02 nova-api[13235]: 2017-09-28 12:57:43.274 13235 ERROR nova.wsgi     self.filename))
Sep 28 12:57:43 ctl02 nova-api[13235]: 2017-09-28 12:57:43.274 13235 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:57:43 ctl02 nova-api[13235]: 2017-09-28 12:57:43.274 13235 ERROR nova.wsgi
Sep 28 12:57:43 ctl02 nova-api[13235]: 2017-09-28 12:57:43.275 13235 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:57:43 ctl02 heat-api[13008]: 2017-09-28 12:57:43.322 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:57:43] "OPTIONS / HTTP/1.0" 200 134 0.000555
Sep 28 12:57:43 ctl02 nova-api[13235]: 2017-09-28 12:57:43.406 13235 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:57:43 ctl02 neutron-server[30536]: 2017-09-28 12:57:43.551 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:57:43 ctl02 nova-api[13235]: 2017-09-28 12:57:43.646 13235 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:57:43 ctl02 nova-api[13235]: 2017-09-28 12:57:43.648 13235 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:57:43 ctl02 nova-api[13235]: 2017-09-28 12:57:43.648 13235 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:57:43 ctl02 nova-api[13235]: 2017-09-28 12:57:43.649 13235 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:57:43 ctl02 nova-cert[4860]: 2017-09-28 12:57:43.668 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:57:43 ctl02 nova-api[13235]: 2017-09-28 12:57:43.781 13235 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:57:43 ctl02 nova-api[13235]: 2017-09-28 12:57:43.783 13235 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:57:43 ctl02 nova-api[13235]: 2017-09-28 12:57:43.783 13235 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:57:43 ctl02 nova-api[13235]: 2017-09-28 12:57:43.784 13235 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:57:43 ctl02 nova-api[13235]: 2017-09-28 12:57:43.787 13235 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:57:43 ctl02 nova-api[13235]: 2017-09-28 12:57:43.787 13235 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:57:43 ctl02 nova-api[13235]: 2017-09-28 12:57:43.787 13235 ERROR nova Traceback (most recent call last):
Sep 28 12:57:43 ctl02 nova-api[13235]: 2017-09-28 12:57:43.787 13235 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:57:43 ctl02 nova-api[13235]: 2017-09-28 12:57:43.787 13235 ERROR nova     sys.exit(main())
Sep 28 12:57:43 ctl02 nova-api[13235]: 2017-09-28 12:57:43.787 13235 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:57:43 ctl02 nova-api[13235]: 2017-09-28 12:57:43.787 13235 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:57:43 ctl02 nova-api[13235]: 2017-09-28 12:57:43.787 13235 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:57:43 ctl02 nova-api[13235]: 2017-09-28 12:57:43.787 13235 ERROR nova     max_url_len=max_url_len)
Sep 28 12:57:43 ctl02 nova-api[13235]: 2017-09-28 12:57:43.787 13235 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:57:43 ctl02 nova-api[13235]: 2017-09-28 12:57:43.787 13235 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:57:43 ctl02 nova-api[13235]: 2017-09-28 12:57:43.787 13235 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:57:43 ctl02 nova-api[13235]: 2017-09-28 12:57:43.787 13235 ERROR nova     sock.listen(backlog)
Sep 28 12:57:43 ctl02 nova-api[13235]: 2017-09-28 12:57:43.787 13235 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:57:43 ctl02 nova-api[13235]: 2017-09-28 12:57:43.787 13235 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:57:43 ctl02 nova-api[13235]: 2017-09-28 12:57:43.787 13235 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:57:43 ctl02 nova-api[13235]: 2017-09-28 12:57:43.787 13235 ERROR nova
Sep 28 12:57:43 ctl02 glance-api[29183]: 2017-09-28 12:57:43.898 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:57:43] "OPTIONS / HTTP/1.0" 200 134 0.000566
Sep 28 12:57:43 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:57:43 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:57:43 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:57:44 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:57:44 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:57:44 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:57:44 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:57:44 ctl02 neutron-server[30536]: 2017-09-28 12:57:44.656 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:57:44] "OPTIONS / HTTP/1.0" 200 262 0.000488
Sep 28 12:57:45 ctl02 heat-api-cfn[13300]: 2017-09-28 12:57:45.321 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:57:45] "OPTIONS / HTTP/1.0" 200 134 0.000586
Sep 28 12:57:45 ctl02 neutron-server[30536]: 2017-09-28 12:57:45.385 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:57:45] "OPTIONS / HTTP/1.0" 200 262 0.000468
Sep 28 12:57:45 ctl02 nova-api[13254]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:57:45 ctl02 nova-api[13254]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:57:46 ctl02 nova-api[13254]: 2017-09-28 12:57:46.013 13254 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:57:46 ctl02 nova-api[13254]: 2017-09-28 12:57:46.014 13254 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:57:46 ctl02 nova-api[13254]: 2017-09-28 12:57:46.014 13254 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:57:46 ctl02 nova-api[13254]: 2017-09-28 12:57:46.014 13254 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:57:46 ctl02 nova-api[13254]: 2017-09-28 12:57:46.014 13254 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:57:46 ctl02 nova-api[13254]: 2017-09-28 12:57:46.014 13254 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:57:46 ctl02 nova-api[13254]: 2017-09-28 12:57:46.014 13254 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:57:46 ctl02 nova-api[13254]: 2017-09-28 12:57:46.014 13254 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:57:46 ctl02 nova-api[13254]: 2017-09-28 12:57:46.014 13254 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:57:46 ctl02 nova-api[13254]: 2017-09-28 12:57:46.014 13254 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:57:46 ctl02 nova-api[13254]: 2017-09-28 12:57:46.014 13254 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:57:46 ctl02 nova-api[13254]: 2017-09-28 12:57:46.014 13254 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:57:46 ctl02 nova-api[13254]: 2017-09-28 12:57:46.014 13254 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:57:46 ctl02 nova-api[13254]: 2017-09-28 12:57:46.014 13254 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:57:46 ctl02 nova-api[13254]: 2017-09-28 12:57:46.014 13254 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:57:46 ctl02 nova-api[13254]: 2017-09-28 12:57:46.014 13254 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:57:46 ctl02 nova-api[13254]: 2017-09-28 12:57:46.014 13254 ERROR nova.wsgi     self.filename))
Sep 28 12:57:46 ctl02 nova-api[13254]: 2017-09-28 12:57:46.014 13254 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:57:46 ctl02 nova-api[13254]: 2017-09-28 12:57:46.014 13254 ERROR nova.wsgi
Sep 28 12:57:46 ctl02 nova-api[13254]: 2017-09-28 12:57:46.015 13254 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:57:46 ctl02 nova-api[13254]: 2017-09-28 12:57:46.145 13254 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:57:46 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:57:46.233 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:57:46] "OPTIONS / HTTP/1.0" 200 134 0.000507
Sep 28 12:57:46 ctl02 nova-api[13254]: 2017-09-28 12:57:46.370 13254 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:57:46 ctl02 nova-api[13254]: 2017-09-28 12:57:46.372 13254 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:57:46 ctl02 nova-api[13254]: 2017-09-28 12:57:46.373 13254 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:57:46 ctl02 nova-api[13254]: 2017-09-28 12:57:46.373 13254 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:57:46 ctl02 nova-api[13254]: 2017-09-28 12:57:46.505 13254 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:57:46 ctl02 nova-api[13254]: 2017-09-28 12:57:46.507 13254 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:57:46 ctl02 nova-api[13254]: 2017-09-28 12:57:46.507 13254 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:57:46 ctl02 nova-api[13254]: 2017-09-28 12:57:46.508 13254 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:57:46 ctl02 nova-api[13254]: 2017-09-28 12:57:46.511 13254 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:57:46 ctl02 nova-api[13254]: 2017-09-28 12:57:46.511 13254 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:57:46 ctl02 nova-api[13254]: 2017-09-28 12:57:46.511 13254 ERROR nova Traceback (most recent call last):
Sep 28 12:57:46 ctl02 nova-api[13254]: 2017-09-28 12:57:46.511 13254 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:57:46 ctl02 nova-api[13254]: 2017-09-28 12:57:46.511 13254 ERROR nova     sys.exit(main())
Sep 28 12:57:46 ctl02 nova-api[13254]: 2017-09-28 12:57:46.511 13254 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:57:46 ctl02 nova-api[13254]: 2017-09-28 12:57:46.511 13254 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:57:46 ctl02 nova-api[13254]: 2017-09-28 12:57:46.511 13254 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:57:46 ctl02 nova-api[13254]: 2017-09-28 12:57:46.511 13254 ERROR nova     max_url_len=max_url_len)
Sep 28 12:57:46 ctl02 nova-api[13254]: 2017-09-28 12:57:46.511 13254 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:57:46 ctl02 nova-api[13254]: 2017-09-28 12:57:46.511 13254 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:57:46 ctl02 nova-api[13254]: 2017-09-28 12:57:46.511 13254 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:57:46 ctl02 nova-api[13254]: 2017-09-28 12:57:46.511 13254 ERROR nova     sock.listen(backlog)
Sep 28 12:57:46 ctl02 nova-api[13254]: 2017-09-28 12:57:46.511 13254 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:57:46 ctl02 nova-api[13254]: 2017-09-28 12:57:46.511 13254 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:57:46 ctl02 nova-api[13254]: 2017-09-28 12:57:46.511 13254 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:57:46 ctl02 nova-api[13254]: 2017-09-28 12:57:46.511 13254 ERROR nova
Sep 28 12:57:46 ctl02 heat-api-cfn[13300]: 2017-09-28 12:57:46.601 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:57:46] "OPTIONS / HTTP/1.0" 200 134 0.000574
Sep 28 12:57:46 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:57:46 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:57:46 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:57:46 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:57:46 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:57:46 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:57:46 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:57:47 ctl02 heat-api[13008]: 2017-09-28 12:57:47.537 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:57:47] "OPTIONS / HTTP/1.0" 200 134 0.000610
Sep 28 12:57:48 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:57:48.292 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:57:48] "OPTIONS / HTTP/1.0" 200 134 0.000568
Sep 28 12:57:48 ctl02 nova-api[13273]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:57:48 ctl02 nova-api[13273]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:57:48 ctl02 nova-api[13273]: 2017-09-28 12:57:48.760 13273 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:57:48 ctl02 nova-api[13273]: 2017-09-28 12:57:48.762 13273 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:57:48 ctl02 nova-api[13273]: 2017-09-28 12:57:48.762 13273 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:57:48 ctl02 nova-api[13273]: 2017-09-28 12:57:48.762 13273 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:57:48 ctl02 nova-api[13273]: 2017-09-28 12:57:48.762 13273 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:57:48 ctl02 nova-api[13273]: 2017-09-28 12:57:48.762 13273 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:57:48 ctl02 nova-api[13273]: 2017-09-28 12:57:48.762 13273 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:57:48 ctl02 nova-api[13273]: 2017-09-28 12:57:48.762 13273 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:57:48 ctl02 nova-api[13273]: 2017-09-28 12:57:48.762 13273 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:57:48 ctl02 nova-api[13273]: 2017-09-28 12:57:48.762 13273 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:57:48 ctl02 nova-api[13273]: 2017-09-28 12:57:48.762 13273 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:57:48 ctl02 nova-api[13273]: 2017-09-28 12:57:48.762 13273 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:57:48 ctl02 nova-api[13273]: 2017-09-28 12:57:48.762 13273 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:57:48 ctl02 nova-api[13273]: 2017-09-28 12:57:48.762 13273 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:57:48 ctl02 nova-api[13273]: 2017-09-28 12:57:48.762 13273 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:57:48 ctl02 nova-api[13273]: 2017-09-28 12:57:48.762 13273 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:57:48 ctl02 nova-api[13273]: 2017-09-28 12:57:48.762 13273 ERROR nova.wsgi     self.filename))
Sep 28 12:57:48 ctl02 nova-api[13273]: 2017-09-28 12:57:48.762 13273 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:57:48 ctl02 nova-api[13273]: 2017-09-28 12:57:48.762 13273 ERROR nova.wsgi
Sep 28 12:57:48 ctl02 nova-api[13273]: 2017-09-28 12:57:48.763 13273 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:57:48 ctl02 nova-api[13273]: 2017-09-28 12:57:48.897 13273 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:57:48 ctl02 glance-api[29183]: 2017-09-28 12:57:48.996 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:57:48] "OPTIONS / HTTP/1.0" 200 134 0.000871
Sep 28 12:57:49 ctl02 nova-api[13273]: 2017-09-28 12:57:49.140 13273 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:57:49 ctl02 nova-api[13273]: 2017-09-28 12:57:49.142 13273 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:57:49 ctl02 nova-api[13273]: 2017-09-28 12:57:49.143 13273 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:57:49 ctl02 nova-api[13273]: 2017-09-28 12:57:49.143 13273 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:57:49 ctl02 nova-api[13273]: 2017-09-28 12:57:49.278 13273 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:57:49 ctl02 nova-api[13273]: 2017-09-28 12:57:49.280 13273 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:57:49 ctl02 nova-api[13273]: 2017-09-28 12:57:49.280 13273 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:57:49 ctl02 nova-api[13273]: 2017-09-28 12:57:49.280 13273 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:57:49 ctl02 nova-api[13273]: 2017-09-28 12:57:49.284 13273 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:57:49 ctl02 nova-api[13273]: 2017-09-28 12:57:49.284 13273 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:57:49 ctl02 nova-api[13273]: 2017-09-28 12:57:49.284 13273 ERROR nova Traceback (most recent call last):
Sep 28 12:57:49 ctl02 nova-api[13273]: 2017-09-28 12:57:49.284 13273 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:57:49 ctl02 nova-api[13273]: 2017-09-28 12:57:49.284 13273 ERROR nova     sys.exit(main())
Sep 28 12:57:49 ctl02 nova-api[13273]: 2017-09-28 12:57:49.284 13273 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:57:49 ctl02 nova-api[13273]: 2017-09-28 12:57:49.284 13273 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:57:49 ctl02 nova-api[13273]: 2017-09-28 12:57:49.284 13273 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:57:49 ctl02 nova-api[13273]: 2017-09-28 12:57:49.284 13273 ERROR nova     max_url_len=max_url_len)
Sep 28 12:57:49 ctl02 nova-api[13273]: 2017-09-28 12:57:49.284 13273 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:57:49 ctl02 nova-api[13273]: 2017-09-28 12:57:49.284 13273 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:57:49 ctl02 nova-api[13273]: 2017-09-28 12:57:49.284 13273 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:57:49 ctl02 nova-api[13273]: 2017-09-28 12:57:49.284 13273 ERROR nova     sock.listen(backlog)
Sep 28 12:57:49 ctl02 nova-api[13273]: 2017-09-28 12:57:49.284 13273 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:57:49 ctl02 nova-api[13273]: 2017-09-28 12:57:49.284 13273 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:57:49 ctl02 nova-api[13273]: 2017-09-28 12:57:49.284 13273 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:57:49 ctl02 nova-api[13273]: 2017-09-28 12:57:49.284 13273 ERROR nova
Sep 28 12:57:49 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:57:49.285 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:57:49] "OPTIONS / HTTP/1.0" 200 134 0.000433
Sep 28 12:57:49 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:57:49 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:57:49 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:57:49 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:57:49 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:57:49 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:57:49 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:57:50 ctl02 heat-api-cfn[13300]: 2017-09-28 12:57:50.595 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:57:50] "OPTIONS / HTTP/1.0" 200 134 0.000437
Sep 28 12:57:51 ctl02 neutron-server[30536]: 2017-09-28 12:57:51.090 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 4 dead agents out of 6:
Sep 28 12:57:51 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:57:51 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:57:06 cmp002
Sep 28 12:57:51 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:56:28 cmp001
Sep 28 12:57:51 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:56:00 cmp002
Sep 28 12:57:51 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:56:26 cmp002
Sep 28 12:57:51 ctl02 nova-api[13290]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:57:51 ctl02 nova-api[13290]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:57:51 ctl02 nova-api[13290]: 2017-09-28 12:57:51.501 13290 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:57:51 ctl02 nova-api[13290]: 2017-09-28 12:57:51.502 13290 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:57:51 ctl02 nova-api[13290]: 2017-09-28 12:57:51.502 13290 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:57:51 ctl02 nova-api[13290]: 2017-09-28 12:57:51.502 13290 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:57:51 ctl02 nova-api[13290]: 2017-09-28 12:57:51.502 13290 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:57:51 ctl02 nova-api[13290]: 2017-09-28 12:57:51.502 13290 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:57:51 ctl02 nova-api[13290]: 2017-09-28 12:57:51.502 13290 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:57:51 ctl02 nova-api[13290]: 2017-09-28 12:57:51.502 13290 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:57:51 ctl02 nova-api[13290]: 2017-09-28 12:57:51.502 13290 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:57:51 ctl02 nova-api[13290]: 2017-09-28 12:57:51.502 13290 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:57:51 ctl02 nova-api[13290]: 2017-09-28 12:57:51.502 13290 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:57:51 ctl02 nova-api[13290]: 2017-09-28 12:57:51.502 13290 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:57:51 ctl02 nova-api[13290]: 2017-09-28 12:57:51.502 13290 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:57:51 ctl02 nova-api[13290]: 2017-09-28 12:57:51.502 13290 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:57:51 ctl02 nova-api[13290]: 2017-09-28 12:57:51.502 13290 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:57:51 ctl02 nova-api[13290]: 2017-09-28 12:57:51.502 13290 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:57:51 ctl02 nova-api[13290]: 2017-09-28 12:57:51.502 13290 ERROR nova.wsgi     self.filename))
Sep 28 12:57:51 ctl02 nova-api[13290]: 2017-09-28 12:57:51.502 13290 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:57:51 ctl02 nova-api[13290]: 2017-09-28 12:57:51.502 13290 ERROR nova.wsgi
Sep 28 12:57:51 ctl02 nova-api[13290]: 2017-09-28 12:57:51.503 13290 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:57:51 ctl02 neutron-server[30536]: 2017-09-28 12:57:51.621 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:57:51] "OPTIONS / HTTP/1.0" 200 262 0.000521
Sep 28 12:57:51 ctl02 nova-api[13290]: 2017-09-28 12:57:51.632 13290 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:57:51 ctl02 nova-api[13290]: 2017-09-28 12:57:51.858 13290 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:57:51 ctl02 nova-api[13290]: 2017-09-28 12:57:51.861 13290 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:57:51 ctl02 nova-api[13290]: 2017-09-28 12:57:51.861 13290 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:57:51 ctl02 nova-api[13290]: 2017-09-28 12:57:51.861 13290 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:57:51 ctl02 nova-api[13290]: 2017-09-28 12:57:51.995 13290 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:57:51 ctl02 nova-api[13290]: 2017-09-28 12:57:51.997 13290 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:57:51 ctl02 nova-api[13290]: 2017-09-28 12:57:51.997 13290 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:57:51 ctl02 nova-api[13290]: 2017-09-28 12:57:51.997 13290 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:57:52 ctl02 nova-api[13290]: 2017-09-28 12:57:52.001 13290 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:57:52 ctl02 nova-api[13290]: 2017-09-28 12:57:52.001 13290 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:57:52 ctl02 nova-api[13290]: 2017-09-28 12:57:52.001 13290 ERROR nova Traceback (most recent call last):
Sep 28 12:57:52 ctl02 nova-api[13290]: 2017-09-28 12:57:52.001 13290 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:57:52 ctl02 nova-api[13290]: 2017-09-28 12:57:52.001 13290 ERROR nova     sys.exit(main())
Sep 28 12:57:52 ctl02 nova-api[13290]: 2017-09-28 12:57:52.001 13290 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:57:52 ctl02 nova-api[13290]: 2017-09-28 12:57:52.001 13290 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:57:52 ctl02 nova-api[13290]: 2017-09-28 12:57:52.001 13290 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:57:52 ctl02 nova-api[13290]: 2017-09-28 12:57:52.001 13290 ERROR nova     max_url_len=max_url_len)
Sep 28 12:57:52 ctl02 nova-api[13290]: 2017-09-28 12:57:52.001 13290 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:57:52 ctl02 nova-api[13290]: 2017-09-28 12:57:52.001 13290 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:57:52 ctl02 nova-api[13290]: 2017-09-28 12:57:52.001 13290 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:57:52 ctl02 nova-api[13290]: 2017-09-28 12:57:52.001 13290 ERROR nova     sock.listen(backlog)
Sep 28 12:57:52 ctl02 nova-api[13290]: 2017-09-28 12:57:52.001 13290 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:57:52 ctl02 nova-api[13290]: 2017-09-28 12:57:52.001 13290 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:57:52 ctl02 nova-api[13290]: 2017-09-28 12:57:52.001 13290 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:57:52 ctl02 nova-api[13290]: 2017-09-28 12:57:52.001 13290 ERROR nova
Sep 28 12:57:52 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:57:52 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:57:52 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:57:52 ctl02 heat-api[13008]: 2017-09-28 12:57:52.199 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:57:52] "OPTIONS / HTTP/1.0" 200 134 0.000844
Sep 28 12:57:52 ctl02 glance-api[29183]: 2017-09-28 12:57:52.316 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:57:52] "OPTIONS / HTTP/1.0" 200 134 0.000771
Sep 28 12:57:52 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:57:52 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:57:52 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:57:52 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:57:53 ctl02 heat-api[13008]: 2017-09-28 12:57:53.252 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:57:53] "OPTIONS / HTTP/1.0" 200 134 0.000636
Sep 28 12:57:53 ctl02 nova-consoleauth[5433]: 2017-09-28 12:57:53.505 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:57:53 ctl02 glance-api[29183]: 2017-09-28 12:57:53.952 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:57:53] "OPTIONS / HTTP/1.0" 200 134 0.000795
Sep 28 12:57:54 ctl02 nova-api[13310]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:57:54 ctl02 nova-api[13310]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:57:54 ctl02 nova-api[13310]: 2017-09-28 12:57:54.324 13310 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:57:54 ctl02 nova-api[13310]: 2017-09-28 12:57:54.326 13310 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:57:54 ctl02 nova-api[13310]: 2017-09-28 12:57:54.326 13310 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:57:54 ctl02 nova-api[13310]: 2017-09-28 12:57:54.326 13310 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:57:54 ctl02 nova-api[13310]: 2017-09-28 12:57:54.326 13310 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:57:54 ctl02 nova-api[13310]: 2017-09-28 12:57:54.326 13310 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:57:54 ctl02 nova-api[13310]: 2017-09-28 12:57:54.326 13310 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:57:54 ctl02 nova-api[13310]: 2017-09-28 12:57:54.326 13310 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:57:54 ctl02 nova-api[13310]: 2017-09-28 12:57:54.326 13310 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:57:54 ctl02 nova-api[13310]: 2017-09-28 12:57:54.326 13310 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:57:54 ctl02 nova-api[13310]: 2017-09-28 12:57:54.326 13310 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:57:54 ctl02 nova-api[13310]: 2017-09-28 12:57:54.326 13310 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:57:54 ctl02 nova-api[13310]: 2017-09-28 12:57:54.326 13310 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:57:54 ctl02 nova-api[13310]: 2017-09-28 12:57:54.326 13310 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:57:54 ctl02 nova-api[13310]: 2017-09-28 12:57:54.326 13310 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:57:54 ctl02 nova-api[13310]: 2017-09-28 12:57:54.326 13310 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:57:54 ctl02 nova-api[13310]: 2017-09-28 12:57:54.326 13310 ERROR nova.wsgi     self.filename))
Sep 28 12:57:54 ctl02 nova-api[13310]: 2017-09-28 12:57:54.326 13310 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:57:54 ctl02 nova-api[13310]: 2017-09-28 12:57:54.326 13310 ERROR nova.wsgi
Sep 28 12:57:54 ctl02 nova-api[13310]: 2017-09-28 12:57:54.328 13310 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:57:54 ctl02 heat-engine[12803]: 2017-09-28 12:57:54.342 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:57:54 ctl02 heat-engine[12803]: 2017-09-28 12:57:54.364 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:57:54 ctl02 heat-engine[12803]: 2017-09-28 12:57:54.365 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:57:54 ctl02 heat-engine[12803]: 2017-09-28 12:57:54.366 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:57:54 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9f235e02)
Sep 28 12:57:54 ctl02 nova-api[13310]: 2017-09-28 12:57:54.460 13310 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:57:54 ctl02 neutron-server[30536]: 2017-09-28 12:57:54.593 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:57:54] "OPTIONS / HTTP/1.0" 200 262 0.000631
Sep 28 12:57:54 ctl02 nova-api[13310]: 2017-09-28 12:57:54.707 13310 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:57:54 ctl02 nova-api[13310]: 2017-09-28 12:57:54.710 13310 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:57:54 ctl02 nova-api[13310]: 2017-09-28 12:57:54.710 13310 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:57:54 ctl02 nova-api[13310]: 2017-09-28 12:57:54.711 13310 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:57:54 ctl02 nova-api[13310]: 2017-09-28 12:57:54.843 13310 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:57:54 ctl02 nova-api[13310]: 2017-09-28 12:57:54.846 13310 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:57:54 ctl02 nova-api[13310]: 2017-09-28 12:57:54.847 13310 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:57:54 ctl02 nova-api[13310]: 2017-09-28 12:57:54.847 13310 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:57:54 ctl02 nova-api[13310]: 2017-09-28 12:57:54.851 13310 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:57:54 ctl02 nova-api[13310]: 2017-09-28 12:57:54.852 13310 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:57:54 ctl02 nova-api[13310]: 2017-09-28 12:57:54.852 13310 ERROR nova Traceback (most recent call last):
Sep 28 12:57:54 ctl02 nova-api[13310]: 2017-09-28 12:57:54.852 13310 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:57:54 ctl02 nova-api[13310]: 2017-09-28 12:57:54.852 13310 ERROR nova     sys.exit(main())
Sep 28 12:57:54 ctl02 nova-api[13310]: 2017-09-28 12:57:54.852 13310 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:57:54 ctl02 nova-api[13310]: 2017-09-28 12:57:54.852 13310 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:57:54 ctl02 nova-api[13310]: 2017-09-28 12:57:54.852 13310 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:57:54 ctl02 nova-api[13310]: 2017-09-28 12:57:54.852 13310 ERROR nova     max_url_len=max_url_len)
Sep 28 12:57:54 ctl02 nova-api[13310]: 2017-09-28 12:57:54.852 13310 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:57:54 ctl02 nova-api[13310]: 2017-09-28 12:57:54.852 13310 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:57:54 ctl02 nova-api[13310]: 2017-09-28 12:57:54.852 13310 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:57:54 ctl02 nova-api[13310]: 2017-09-28 12:57:54.852 13310 ERROR nova     sock.listen(backlog)
Sep 28 12:57:54 ctl02 nova-api[13310]: 2017-09-28 12:57:54.852 13310 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:57:54 ctl02 nova-api[13310]: 2017-09-28 12:57:54.852 13310 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:57:54 ctl02 nova-api[13310]: 2017-09-28 12:57:54.852 13310 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:57:54 ctl02 nova-api[13310]: 2017-09-28 12:57:54.852 13310 ERROR nova
Sep 28 12:57:55 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:57:55 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:57:55 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:57:55 ctl02 heat-api-cfn[13300]: 2017-09-28 12:57:55.080 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:57:55] "OPTIONS / HTTP/1.0" 200 134 0.000515
Sep 28 12:57:55 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:57:55 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:57:55 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:57:55 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:57:55 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9f235e02)
Sep 28 12:57:55 ctl02 neutron-server[30536]: 2017-09-28 12:57:55.740 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:57:55] "OPTIONS / HTTP/1.0" 200 262 0.000457
Sep 28 12:57:56 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9f235e02)
Sep 28 12:57:56 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:57:56.541 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:57:56] "OPTIONS / HTTP/1.0" 200 134 0.000377
Sep 28 12:57:56 ctl02 heat-api-cfn[13300]: 2017-09-28 12:57:56.566 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:57:56] "OPTIONS / HTTP/1.0" 200 134 0.000528
Sep 28 12:57:56 ctl02 nova-scheduler[5620]: 2017-09-28 12:57:56.611 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:57:56 ctl02 nova-api[13327]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:57:56 ctl02 nova-api[13327]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:57:57 ctl02 nova-api[13327]: 2017-09-28 12:57:57.004 13327 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:57:57 ctl02 nova-api[13327]: 2017-09-28 12:57:57.005 13327 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:57:57 ctl02 nova-api[13327]: 2017-09-28 12:57:57.005 13327 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:57:57 ctl02 nova-api[13327]: 2017-09-28 12:57:57.005 13327 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:57:57 ctl02 nova-api[13327]: 2017-09-28 12:57:57.005 13327 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:57:57 ctl02 nova-api[13327]: 2017-09-28 12:57:57.005 13327 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:57:57 ctl02 nova-api[13327]: 2017-09-28 12:57:57.005 13327 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:57:57 ctl02 nova-api[13327]: 2017-09-28 12:57:57.005 13327 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:57:57 ctl02 nova-api[13327]: 2017-09-28 12:57:57.005 13327 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:57:57 ctl02 nova-api[13327]: 2017-09-28 12:57:57.005 13327 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:57:57 ctl02 nova-api[13327]: 2017-09-28 12:57:57.005 13327 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:57:57 ctl02 nova-api[13327]: 2017-09-28 12:57:57.005 13327 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:57:57 ctl02 nova-api[13327]: 2017-09-28 12:57:57.005 13327 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:57:57 ctl02 nova-api[13327]: 2017-09-28 12:57:57.005 13327 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:57:57 ctl02 nova-api[13327]: 2017-09-28 12:57:57.005 13327 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:57:57 ctl02 nova-api[13327]: 2017-09-28 12:57:57.005 13327 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:57:57 ctl02 nova-api[13327]: 2017-09-28 12:57:57.005 13327 ERROR nova.wsgi     self.filename))
Sep 28 12:57:57 ctl02 nova-api[13327]: 2017-09-28 12:57:57.005 13327 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:57:57 ctl02 nova-api[13327]: 2017-09-28 12:57:57.005 13327 ERROR nova.wsgi
Sep 28 12:57:57 ctl02 nova-api[13327]: 2017-09-28 12:57:57.006 13327 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:57:57 ctl02 nova-api[13327]: 2017-09-28 12:57:57.136 13327 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:57:57 ctl02 nova-api[13327]: 2017-09-28 12:57:57.363 13327 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:57:57 ctl02 nova-api[13327]: 2017-09-28 12:57:57.366 13327 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:57:57 ctl02 nova-api[13327]: 2017-09-28 12:57:57.366 13327 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:57:57 ctl02 nova-api[13327]: 2017-09-28 12:57:57.366 13327 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:57:57 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9f235e02)
Sep 28 12:57:57 ctl02 heat-api[13008]: 2017-09-28 12:57:57.475 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:57:57] "OPTIONS / HTTP/1.0" 200 134 0.000562
Sep 28 12:57:57 ctl02 nova-api[13327]: 2017-09-28 12:57:57.503 13327 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:57:57 ctl02 nova-api[13327]: 2017-09-28 12:57:57.505 13327 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:57:57 ctl02 nova-api[13327]: 2017-09-28 12:57:57.505 13327 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:57:57 ctl02 nova-api[13327]: 2017-09-28 12:57:57.506 13327 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:57:57 ctl02 nova-api[13327]: 2017-09-28 12:57:57.509 13327 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:57:57 ctl02 nova-api[13327]: 2017-09-28 12:57:57.509 13327 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:57:57 ctl02 nova-api[13327]: 2017-09-28 12:57:57.509 13327 ERROR nova Traceback (most recent call last):
Sep 28 12:57:57 ctl02 nova-api[13327]: 2017-09-28 12:57:57.509 13327 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:57:57 ctl02 nova-api[13327]: 2017-09-28 12:57:57.509 13327 ERROR nova     sys.exit(main())
Sep 28 12:57:57 ctl02 nova-api[13327]: 2017-09-28 12:57:57.509 13327 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:57:57 ctl02 nova-api[13327]: 2017-09-28 12:57:57.509 13327 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:57:57 ctl02 nova-api[13327]: 2017-09-28 12:57:57.509 13327 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:57:57 ctl02 nova-api[13327]: 2017-09-28 12:57:57.509 13327 ERROR nova     max_url_len=max_url_len)
Sep 28 12:57:57 ctl02 nova-api[13327]: 2017-09-28 12:57:57.509 13327 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:57:57 ctl02 nova-api[13327]: 2017-09-28 12:57:57.509 13327 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:57:57 ctl02 nova-api[13327]: 2017-09-28 12:57:57.509 13327 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:57:57 ctl02 nova-api[13327]: 2017-09-28 12:57:57.509 13327 ERROR nova     sock.listen(backlog)
Sep 28 12:57:57 ctl02 nova-api[13327]: 2017-09-28 12:57:57.509 13327 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:57:57 ctl02 nova-api[13327]: 2017-09-28 12:57:57.509 13327 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:57:57 ctl02 nova-api[13327]: 2017-09-28 12:57:57.509 13327 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:57:57 ctl02 nova-api[13327]: 2017-09-28 12:57:57.509 13327 ERROR nova
Sep 28 12:57:57 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:57:57 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:57:57 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:57:57 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:57:57 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:57:57 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:57:57 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:57:58 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9f235e02)
Sep 28 12:57:58 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:57:58.414 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:57:58] "OPTIONS / HTTP/1.0" 200 134 0.000475
Sep 28 12:57:58 ctl02 neutron-server[30536]: 2017-09-28 12:57:58.551 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:57:59 ctl02 glance-api[29183]: 2017-09-28 12:57:59.145 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:57:59] "OPTIONS / HTTP/1.0" 200 134 0.000767
Sep 28 12:57:59 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:57:59.377 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:57:59] "OPTIONS / HTTP/1.0" 200 134 0.000527
Sep 28 12:57:59 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9f235e02)
Sep 28 12:57:59 ctl02 nova-api[13346]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:57:59 ctl02 nova-api[13346]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:57:59 ctl02 nova-api[13346]: 2017-09-28 12:57:59.805 13346 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:57:59 ctl02 nova-api[13346]: 2017-09-28 12:57:59.807 13346 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:57:59 ctl02 nova-api[13346]: 2017-09-28 12:57:59.807 13346 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:57:59 ctl02 nova-api[13346]: 2017-09-28 12:57:59.807 13346 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:57:59 ctl02 nova-api[13346]: 2017-09-28 12:57:59.807 13346 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:57:59 ctl02 nova-api[13346]: 2017-09-28 12:57:59.807 13346 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:57:59 ctl02 nova-api[13346]: 2017-09-28 12:57:59.807 13346 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:57:59 ctl02 nova-api[13346]: 2017-09-28 12:57:59.807 13346 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:57:59 ctl02 nova-api[13346]: 2017-09-28 12:57:59.807 13346 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:57:59 ctl02 nova-api[13346]: 2017-09-28 12:57:59.807 13346 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:57:59 ctl02 nova-api[13346]: 2017-09-28 12:57:59.807 13346 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:57:59 ctl02 nova-api[13346]: 2017-09-28 12:57:59.807 13346 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:57:59 ctl02 nova-api[13346]: 2017-09-28 12:57:59.807 13346 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:57:59 ctl02 nova-api[13346]: 2017-09-28 12:57:59.807 13346 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:57:59 ctl02 nova-api[13346]: 2017-09-28 12:57:59.807 13346 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:57:59 ctl02 nova-api[13346]: 2017-09-28 12:57:59.807 13346 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:57:59 ctl02 nova-api[13346]: 2017-09-28 12:57:59.807 13346 ERROR nova.wsgi     self.filename))
Sep 28 12:57:59 ctl02 nova-api[13346]: 2017-09-28 12:57:59.807 13346 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:57:59 ctl02 nova-api[13346]: 2017-09-28 12:57:59.807 13346 ERROR nova.wsgi
Sep 28 12:57:59 ctl02 nova-api[13346]: 2017-09-28 12:57:59.808 13346 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:57:59 ctl02 nova-api[13346]: 2017-09-28 12:57:59.935 13346 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:58:00 ctl02 nova-api[13346]: 2017-09-28 12:58:00.154 13346 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:58:00 ctl02 nova-api[13346]: 2017-09-28 12:58:00.156 13346 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:58:00 ctl02 nova-api[13346]: 2017-09-28 12:58:00.157 13346 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:58:00 ctl02 nova-api[13346]: 2017-09-28 12:58:00.157 13346 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:58:00 ctl02 neutron-server[30536]: 2017-09-28 12:58:00.167 30601 WARNING oslo_messaging._drivers.amqpdriver [req-3fa9b7bc-8ec9-4c83-ba5d-49c118e14fee - - - - -] reply_692b03e6d8d44d758b6be19b067c3aa3 doesn't exists, drop reply to 56221c443ad34ba3a74cf3ca04835ddb
Sep 28 12:58:00 ctl02 nova-api[13346]: 2017-09-28 12:58:00.289 13346 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:58:00 ctl02 nova-api[13346]: 2017-09-28 12:58:00.292 13346 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:58:00 ctl02 nova-api[13346]: 2017-09-28 12:58:00.292 13346 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:58:00 ctl02 nova-api[13346]: 2017-09-28 12:58:00.292 13346 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:58:00 ctl02 nova-api[13346]: 2017-09-28 12:58:00.296 13346 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:58:00 ctl02 nova-api[13346]: 2017-09-28 12:58:00.296 13346 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:58:00 ctl02 nova-api[13346]: 2017-09-28 12:58:00.296 13346 ERROR nova Traceback (most recent call last):
Sep 28 12:58:00 ctl02 nova-api[13346]: 2017-09-28 12:58:00.296 13346 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:58:00 ctl02 nova-api[13346]: 2017-09-28 12:58:00.296 13346 ERROR nova     sys.exit(main())
Sep 28 12:58:00 ctl02 nova-api[13346]: 2017-09-28 12:58:00.296 13346 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:58:00 ctl02 nova-api[13346]: 2017-09-28 12:58:00.296 13346 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:58:00 ctl02 nova-api[13346]: 2017-09-28 12:58:00.296 13346 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:58:00 ctl02 nova-api[13346]: 2017-09-28 12:58:00.296 13346 ERROR nova     max_url_len=max_url_len)
Sep 28 12:58:00 ctl02 nova-api[13346]: 2017-09-28 12:58:00.296 13346 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:58:00 ctl02 nova-api[13346]: 2017-09-28 12:58:00.296 13346 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:58:00 ctl02 nova-api[13346]: 2017-09-28 12:58:00.296 13346 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:58:00 ctl02 nova-api[13346]: 2017-09-28 12:58:00.296 13346 ERROR nova     sock.listen(backlog)
Sep 28 12:58:00 ctl02 nova-api[13346]: 2017-09-28 12:58:00.296 13346 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:58:00 ctl02 nova-api[13346]: 2017-09-28 12:58:00.296 13346 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:58:00 ctl02 nova-api[13346]: 2017-09-28 12:58:00.296 13346 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:58:00 ctl02 nova-api[13346]: 2017-09-28 12:58:00.296 13346 ERROR nova
Sep 28 12:58:00 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9f235e02)
Sep 28 12:58:00 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:58:00 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:58:00 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:58:00 ctl02 heat-api-cfn[13300]: 2017-09-28 12:58:00.549 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:58:00] "OPTIONS / HTTP/1.0" 200 134 0.000463
Sep 28 12:58:00 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:58:00 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:58:00 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:58:00 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:58:01 ctl02 neutron-server[30536]: 2017-09-28 12:58:01.379 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:58:01] "OPTIONS / HTTP/1.0" 200 262 0.000455
Sep 28 12:58:01 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9f235e02)
Sep 28 12:58:02 ctl02 heat-api[13008]: 2017-09-28 12:58:02.043 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:58:02] "OPTIONS / HTTP/1.0" 200 134 0.000671
Sep 28 12:58:02 ctl02 nova-api[13364]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:58:02 ctl02 nova-api[13364]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:58:02 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9f235e02)
Sep 28 12:58:02 ctl02 nova-api[13364]: 2017-09-28 12:58:02.479 13364 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:58:02 ctl02 nova-api[13364]: 2017-09-28 12:58:02.481 13364 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:58:02 ctl02 nova-api[13364]: 2017-09-28 12:58:02.481 13364 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:58:02 ctl02 nova-api[13364]: 2017-09-28 12:58:02.481 13364 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:58:02 ctl02 nova-api[13364]: 2017-09-28 12:58:02.481 13364 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:58:02 ctl02 nova-api[13364]: 2017-09-28 12:58:02.481 13364 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:58:02 ctl02 nova-api[13364]: 2017-09-28 12:58:02.481 13364 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:58:02 ctl02 nova-api[13364]: 2017-09-28 12:58:02.481 13364 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:58:02 ctl02 nova-api[13364]: 2017-09-28 12:58:02.481 13364 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:58:02 ctl02 nova-api[13364]: 2017-09-28 12:58:02.481 13364 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:58:02 ctl02 nova-api[13364]: 2017-09-28 12:58:02.481 13364 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:58:02 ctl02 nova-api[13364]: 2017-09-28 12:58:02.481 13364 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:58:02 ctl02 nova-api[13364]: 2017-09-28 12:58:02.481 13364 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:58:02 ctl02 nova-api[13364]: 2017-09-28 12:58:02.481 13364 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:58:02 ctl02 nova-api[13364]: 2017-09-28 12:58:02.481 13364 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:58:02 ctl02 nova-api[13364]: 2017-09-28 12:58:02.481 13364 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:58:02 ctl02 nova-api[13364]: 2017-09-28 12:58:02.481 13364 ERROR nova.wsgi     self.filename))
Sep 28 12:58:02 ctl02 nova-api[13364]: 2017-09-28 12:58:02.481 13364 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:58:02 ctl02 nova-api[13364]: 2017-09-28 12:58:02.481 13364 ERROR nova.wsgi
Sep 28 12:58:02 ctl02 nova-api[13364]: 2017-09-28 12:58:02.483 13364 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:58:02 ctl02 glance-api[29183]: 2017-09-28 12:58:02.545 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:58:02] "OPTIONS / HTTP/1.0" 200 134 0.000591
Sep 28 12:58:02 ctl02 nova-api[13364]: 2017-09-28 12:58:02.612 13364 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:58:02 ctl02 nova-api[13364]: 2017-09-28 12:58:02.834 13364 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:58:02 ctl02 nova-api[13364]: 2017-09-28 12:58:02.838 13364 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:58:02 ctl02 nova-api[13364]: 2017-09-28 12:58:02.838 13364 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:58:02 ctl02 nova-api[13364]: 2017-09-28 12:58:02.839 13364 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:58:02 ctl02 nova-api[13364]: 2017-09-28 12:58:02.989 13364 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:58:02 ctl02 nova-api[13364]: 2017-09-28 12:58:02.991 13364 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:58:02 ctl02 nova-api[13364]: 2017-09-28 12:58:02.992 13364 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:58:02 ctl02 nova-api[13364]: 2017-09-28 12:58:02.992 13364 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:58:02 ctl02 nova-api[13364]: 2017-09-28 12:58:02.996 13364 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:58:02 ctl02 nova-api[13364]: 2017-09-28 12:58:02.996 13364 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:58:02 ctl02 nova-api[13364]: 2017-09-28 12:58:02.996 13364 ERROR nova Traceback (most recent call last):
Sep 28 12:58:02 ctl02 nova-api[13364]: 2017-09-28 12:58:02.996 13364 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:58:02 ctl02 nova-api[13364]: 2017-09-28 12:58:02.996 13364 ERROR nova     sys.exit(main())
Sep 28 12:58:02 ctl02 nova-api[13364]: 2017-09-28 12:58:02.996 13364 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:58:02 ctl02 nova-api[13364]: 2017-09-28 12:58:02.996 13364 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:58:02 ctl02 nova-api[13364]: 2017-09-28 12:58:02.996 13364 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:58:02 ctl02 nova-api[13364]: 2017-09-28 12:58:02.996 13364 ERROR nova     max_url_len=max_url_len)
Sep 28 12:58:02 ctl02 nova-api[13364]: 2017-09-28 12:58:02.996 13364 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:58:02 ctl02 nova-api[13364]: 2017-09-28 12:58:02.996 13364 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:58:02 ctl02 nova-api[13364]: 2017-09-28 12:58:02.996 13364 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:58:02 ctl02 nova-api[13364]: 2017-09-28 12:58:02.996 13364 ERROR nova     sock.listen(backlog)
Sep 28 12:58:02 ctl02 nova-api[13364]: 2017-09-28 12:58:02.996 13364 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:58:02 ctl02 nova-api[13364]: 2017-09-28 12:58:02.996 13364 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:58:02 ctl02 nova-api[13364]: 2017-09-28 12:58:02.996 13364 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:58:02 ctl02 nova-api[13364]: 2017-09-28 12:58:02.996 13364 ERROR nova
Sep 28 12:58:03 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:58:03 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:58:03 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:58:03 ctl02 heat-api[13008]: 2017-09-28 12:58:03.191 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:58:03] "OPTIONS / HTTP/1.0" 200 134 0.000628
Sep 28 12:58:03 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:58:03 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:58:03 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:58:03 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:58:03 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9f235e02)
Sep 28 12:58:03 ctl02 glance-api[29183]: 2017-09-28 12:58:03.932 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:58:03] "OPTIONS / HTTP/1.0" 200 134 0.000603
Sep 28 12:58:04 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x9f235e02)
Sep 28 12:58:04 ctl02 neutron-server[30536]: 2017-09-28 12:58:04.638 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:58:04] "OPTIONS / HTTP/1.0" 200 262 0.000508
Sep 28 12:58:05 ctl02 nova-api[13382]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:58:05 ctl02 nova-api[13382]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:58:05 ctl02 nova-api[13382]: 2017-09-28 12:58:05.264 13382 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:58:05 ctl02 nova-api[13382]: 2017-09-28 12:58:05.266 13382 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:58:05 ctl02 nova-api[13382]: 2017-09-28 12:58:05.266 13382 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:58:05 ctl02 nova-api[13382]: 2017-09-28 12:58:05.266 13382 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:58:05 ctl02 nova-api[13382]: 2017-09-28 12:58:05.266 13382 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:58:05 ctl02 nova-api[13382]: 2017-09-28 12:58:05.266 13382 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:58:05 ctl02 nova-api[13382]: 2017-09-28 12:58:05.266 13382 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:58:05 ctl02 nova-api[13382]: 2017-09-28 12:58:05.266 13382 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:58:05 ctl02 nova-api[13382]: 2017-09-28 12:58:05.266 13382 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:58:05 ctl02 nova-api[13382]: 2017-09-28 12:58:05.266 13382 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:58:05 ctl02 nova-api[13382]: 2017-09-28 12:58:05.266 13382 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:58:05 ctl02 nova-api[13382]: 2017-09-28 12:58:05.266 13382 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:58:05 ctl02 nova-api[13382]: 2017-09-28 12:58:05.266 13382 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:58:05 ctl02 nova-api[13382]: 2017-09-28 12:58:05.266 13382 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:58:05 ctl02 nova-api[13382]: 2017-09-28 12:58:05.266 13382 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:58:05 ctl02 nova-api[13382]: 2017-09-28 12:58:05.266 13382 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:58:05 ctl02 nova-api[13382]: 2017-09-28 12:58:05.266 13382 ERROR nova.wsgi     self.filename))
Sep 28 12:58:05 ctl02 nova-api[13382]: 2017-09-28 12:58:05.266 13382 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:58:05 ctl02 nova-api[13382]: 2017-09-28 12:58:05.266 13382 ERROR nova.wsgi
Sep 28 12:58:05 ctl02 nova-api[13382]: 2017-09-28 12:58:05.268 13382 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:58:05 ctl02 heat-api-cfn[13300]: 2017-09-28 12:58:05.321 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:58:05] "OPTIONS / HTTP/1.0" 200 134 0.000438
Sep 28 12:58:05 ctl02 nova-api[13382]: 2017-09-28 12:58:05.397 13382 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:58:05 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:58:05 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:58:05 ctl02 nova-api[13382]: 2017-09-28 12:58:05.621 13382 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:58:05 ctl02 nova-api[13382]: 2017-09-28 12:58:05.623 13382 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:58:05 ctl02 nova-api[13382]: 2017-09-28 12:58:05.623 13382 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:58:05 ctl02 nova-api[13382]: 2017-09-28 12:58:05.624 13382 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:58:05 ctl02 neutron-server[30536]: 2017-09-28 12:58:05.753 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:58:05] "OPTIONS / HTTP/1.0" 200 262 0.000475
Sep 28 12:58:05 ctl02 nova-api[13382]: 2017-09-28 12:58:05.754 13382 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:58:05 ctl02 nova-api[13382]: 2017-09-28 12:58:05.756 13382 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:58:05 ctl02 nova-api[13382]: 2017-09-28 12:58:05.756 13382 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:58:05 ctl02 nova-api[13382]: 2017-09-28 12:58:05.756 13382 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:58:05 ctl02 nova-api[13382]: 2017-09-28 12:58:05.759 13382 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:58:05 ctl02 nova-api[13382]: 2017-09-28 12:58:05.760 13382 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:58:05 ctl02 nova-api[13382]: 2017-09-28 12:58:05.760 13382 ERROR nova Traceback (most recent call last):
Sep 28 12:58:05 ctl02 nova-api[13382]: 2017-09-28 12:58:05.760 13382 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:58:05 ctl02 nova-api[13382]: 2017-09-28 12:58:05.760 13382 ERROR nova     sys.exit(main())
Sep 28 12:58:05 ctl02 nova-api[13382]: 2017-09-28 12:58:05.760 13382 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:58:05 ctl02 nova-api[13382]: 2017-09-28 12:58:05.760 13382 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:58:05 ctl02 nova-api[13382]: 2017-09-28 12:58:05.760 13382 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:58:05 ctl02 nova-api[13382]: 2017-09-28 12:58:05.760 13382 ERROR nova     max_url_len=max_url_len)
Sep 28 12:58:05 ctl02 nova-api[13382]: 2017-09-28 12:58:05.760 13382 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:58:05 ctl02 nova-api[13382]: 2017-09-28 12:58:05.760 13382 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:58:05 ctl02 nova-api[13382]: 2017-09-28 12:58:05.760 13382 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:58:05 ctl02 nova-api[13382]: 2017-09-28 12:58:05.760 13382 ERROR nova     sock.listen(backlog)
Sep 28 12:58:05 ctl02 nova-api[13382]: 2017-09-28 12:58:05.760 13382 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:58:05 ctl02 nova-api[13382]: 2017-09-28 12:58:05.760 13382 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:58:05 ctl02 nova-api[13382]: 2017-09-28 12:58:05.760 13382 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:58:05 ctl02 nova-api[13382]: 2017-09-28 12:58:05.760 13382 ERROR nova
Sep 28 12:58:05 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:58:05 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:58:05 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:58:06 ctl02 neutron-server[30536]: 2017-09-28 12:58:06.087 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 12:58:06 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:58:06 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:57:06 cmp002
Sep 28 12:58:06 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:56:28 cmp001
Sep 28 12:58:06 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:56:26 cmp002
Sep 28 12:58:06 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:58:06 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:58:06 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:58:06 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:58:06 ctl02 heat-api-cfn[13300]: 2017-09-28 12:58:06.407 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:58:06] "OPTIONS / HTTP/1.0" 200 134 0.000520
Sep 28 12:58:06 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:58:06.869 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:58:06] "OPTIONS / HTTP/1.0" 200 134 0.000370
Sep 28 12:58:07 ctl02 heat-api[13008]: 2017-09-28 12:58:07.737 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:58:07] "OPTIONS / HTTP/1.0" 200 134 0.000576
Sep 28 12:58:07 ctl02 nova-api[13405]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:58:07 ctl02 nova-api[13405]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:58:07 ctl02 nova-api[13405]: 2017-09-28 12:58:07.985 13405 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:58:07 ctl02 nova-api[13405]: 2017-09-28 12:58:07.987 13405 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:58:07 ctl02 nova-api[13405]: 2017-09-28 12:58:07.987 13405 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:58:07 ctl02 nova-api[13405]: 2017-09-28 12:58:07.987 13405 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:58:07 ctl02 nova-api[13405]: 2017-09-28 12:58:07.987 13405 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:58:07 ctl02 nova-api[13405]: 2017-09-28 12:58:07.987 13405 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:58:07 ctl02 nova-api[13405]: 2017-09-28 12:58:07.987 13405 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:58:07 ctl02 nova-api[13405]: 2017-09-28 12:58:07.987 13405 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:58:07 ctl02 nova-api[13405]: 2017-09-28 12:58:07.987 13405 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:58:07 ctl02 nova-api[13405]: 2017-09-28 12:58:07.987 13405 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:58:07 ctl02 nova-api[13405]: 2017-09-28 12:58:07.987 13405 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:58:07 ctl02 nova-api[13405]: 2017-09-28 12:58:07.987 13405 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:58:07 ctl02 nova-api[13405]: 2017-09-28 12:58:07.987 13405 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:58:07 ctl02 nova-api[13405]: 2017-09-28 12:58:07.987 13405 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:58:07 ctl02 nova-api[13405]: 2017-09-28 12:58:07.987 13405 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:58:07 ctl02 nova-api[13405]: 2017-09-28 12:58:07.987 13405 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:58:07 ctl02 nova-api[13405]: 2017-09-28 12:58:07.987 13405 ERROR nova.wsgi     self.filename))
Sep 28 12:58:07 ctl02 nova-api[13405]: 2017-09-28 12:58:07.987 13405 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:58:07 ctl02 nova-api[13405]: 2017-09-28 12:58:07.987 13405 ERROR nova.wsgi
Sep 28 12:58:07 ctl02 nova-api[13405]: 2017-09-28 12:58:07.989 13405 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:58:08 ctl02 nova-api[13405]: 2017-09-28 12:58:08.114 13405 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:58:08 ctl02 nova-api[13405]: 2017-09-28 12:58:08.339 13405 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:58:08 ctl02 nova-api[13405]: 2017-09-28 12:58:08.342 13405 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:58:08 ctl02 nova-api[13405]: 2017-09-28 12:58:08.342 13405 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:58:08 ctl02 nova-api[13405]: 2017-09-28 12:58:08.342 13405 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:58:08 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:58:08.470 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:58:08] "OPTIONS / HTTP/1.0" 200 134 0.000362
Sep 28 12:58:08 ctl02 nova-api[13405]: 2017-09-28 12:58:08.474 13405 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:58:08 ctl02 nova-api[13405]: 2017-09-28 12:58:08.476 13405 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:58:08 ctl02 nova-api[13405]: 2017-09-28 12:58:08.477 13405 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:58:08 ctl02 nova-api[13405]: 2017-09-28 12:58:08.477 13405 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:58:08 ctl02 nova-api[13405]: 2017-09-28 12:58:08.480 13405 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:58:08 ctl02 nova-api[13405]: 2017-09-28 12:58:08.481 13405 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:58:08 ctl02 nova-api[13405]: 2017-09-28 12:58:08.481 13405 ERROR nova Traceback (most recent call last):
Sep 28 12:58:08 ctl02 nova-api[13405]: 2017-09-28 12:58:08.481 13405 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:58:08 ctl02 nova-api[13405]: 2017-09-28 12:58:08.481 13405 ERROR nova     sys.exit(main())
Sep 28 12:58:08 ctl02 nova-api[13405]: 2017-09-28 12:58:08.481 13405 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:58:08 ctl02 nova-api[13405]: 2017-09-28 12:58:08.481 13405 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:58:08 ctl02 nova-api[13405]: 2017-09-28 12:58:08.481 13405 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:58:08 ctl02 nova-api[13405]: 2017-09-28 12:58:08.481 13405 ERROR nova     max_url_len=max_url_len)
Sep 28 12:58:08 ctl02 nova-api[13405]: 2017-09-28 12:58:08.481 13405 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:58:08 ctl02 nova-api[13405]: 2017-09-28 12:58:08.481 13405 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:58:08 ctl02 nova-api[13405]: 2017-09-28 12:58:08.481 13405 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:58:08 ctl02 nova-api[13405]: 2017-09-28 12:58:08.481 13405 ERROR nova     sock.listen(backlog)
Sep 28 12:58:08 ctl02 nova-api[13405]: 2017-09-28 12:58:08.481 13405 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:58:08 ctl02 nova-api[13405]: 2017-09-28 12:58:08.481 13405 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:58:08 ctl02 nova-api[13405]: 2017-09-28 12:58:08.481 13405 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:58:08 ctl02 nova-api[13405]: 2017-09-28 12:58:08.481 13405 ERROR nova
Sep 28 12:58:08 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:58:08 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:58:08 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:58:08 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:58:08 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:58:08 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:58:08 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:58:09 ctl02 glance-api[29183]: 2017-09-28 12:58:09.123 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:58:09] "OPTIONS / HTTP/1.0" 200 134 0.000589
Sep 28 12:58:09 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:58:09.523 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:58:09] "OPTIONS / HTTP/1.0" 200 134 0.000388
Sep 28 12:58:10 ctl02 heat-api-cfn[13300]: 2017-09-28 12:58:10.294 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:58:10] "OPTIONS / HTTP/1.0" 200 134 0.000554
Sep 28 12:58:10 ctl02 nova-api[13423]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:58:10 ctl02 nova-api[13423]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:58:10 ctl02 nova-api[13423]: 2017-09-28 12:58:10.722 13423 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:58:10 ctl02 nova-api[13423]: 2017-09-28 12:58:10.723 13423 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:58:10 ctl02 nova-api[13423]: 2017-09-28 12:58:10.723 13423 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:58:10 ctl02 nova-api[13423]: 2017-09-28 12:58:10.723 13423 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:58:10 ctl02 nova-api[13423]: 2017-09-28 12:58:10.723 13423 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:58:10 ctl02 nova-api[13423]: 2017-09-28 12:58:10.723 13423 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:58:10 ctl02 nova-api[13423]: 2017-09-28 12:58:10.723 13423 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:58:10 ctl02 nova-api[13423]: 2017-09-28 12:58:10.723 13423 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:58:10 ctl02 nova-api[13423]: 2017-09-28 12:58:10.723 13423 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:58:10 ctl02 nova-api[13423]: 2017-09-28 12:58:10.723 13423 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:58:10 ctl02 nova-api[13423]: 2017-09-28 12:58:10.723 13423 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:58:10 ctl02 nova-api[13423]: 2017-09-28 12:58:10.723 13423 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:58:10 ctl02 nova-api[13423]: 2017-09-28 12:58:10.723 13423 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:58:10 ctl02 nova-api[13423]: 2017-09-28 12:58:10.723 13423 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:58:10 ctl02 nova-api[13423]: 2017-09-28 12:58:10.723 13423 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:58:10 ctl02 nova-api[13423]: 2017-09-28 12:58:10.723 13423 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:58:10 ctl02 nova-api[13423]: 2017-09-28 12:58:10.723 13423 ERROR nova.wsgi     self.filename))
Sep 28 12:58:10 ctl02 nova-api[13423]: 2017-09-28 12:58:10.723 13423 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:58:10 ctl02 nova-api[13423]: 2017-09-28 12:58:10.723 13423 ERROR nova.wsgi
Sep 28 12:58:10 ctl02 nova-api[13423]: 2017-09-28 12:58:10.724 13423 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:58:10 ctl02 nova-api[13423]: 2017-09-28 12:58:10.849 13423 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:58:11 ctl02 neutron-server[30536]: 2017-09-28 12:58:11.070 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:58:11] "OPTIONS / HTTP/1.0" 200 262 0.000476
Sep 28 12:58:11 ctl02 nova-api[13423]: 2017-09-28 12:58:11.071 13423 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:58:11 ctl02 nova-api[13423]: 2017-09-28 12:58:11.073 13423 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:58:11 ctl02 nova-api[13423]: 2017-09-28 12:58:11.074 13423 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:58:11 ctl02 nova-api[13423]: 2017-09-28 12:58:11.074 13423 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:58:11 ctl02 nova-api[13423]: 2017-09-28 12:58:11.203 13423 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:58:11 ctl02 nova-api[13423]: 2017-09-28 12:58:11.205 13423 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:58:11 ctl02 nova-api[13423]: 2017-09-28 12:58:11.205 13423 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:58:11 ctl02 nova-api[13423]: 2017-09-28 12:58:11.206 13423 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:58:11 ctl02 nova-api[13423]: 2017-09-28 12:58:11.209 13423 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:58:11 ctl02 nova-api[13423]: 2017-09-28 12:58:11.209 13423 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:58:11 ctl02 nova-api[13423]: 2017-09-28 12:58:11.209 13423 ERROR nova Traceback (most recent call last):
Sep 28 12:58:11 ctl02 nova-api[13423]: 2017-09-28 12:58:11.209 13423 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:58:11 ctl02 nova-api[13423]: 2017-09-28 12:58:11.209 13423 ERROR nova     sys.exit(main())
Sep 28 12:58:11 ctl02 nova-api[13423]: 2017-09-28 12:58:11.209 13423 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:58:11 ctl02 nova-api[13423]: 2017-09-28 12:58:11.209 13423 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:58:11 ctl02 nova-api[13423]: 2017-09-28 12:58:11.209 13423 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:58:11 ctl02 nova-api[13423]: 2017-09-28 12:58:11.209 13423 ERROR nova     max_url_len=max_url_len)
Sep 28 12:58:11 ctl02 nova-api[13423]: 2017-09-28 12:58:11.209 13423 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:58:11 ctl02 nova-api[13423]: 2017-09-28 12:58:11.209 13423 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:58:11 ctl02 nova-api[13423]: 2017-09-28 12:58:11.209 13423 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:58:11 ctl02 nova-api[13423]: 2017-09-28 12:58:11.209 13423 ERROR nova     sock.listen(backlog)
Sep 28 12:58:11 ctl02 nova-api[13423]: 2017-09-28 12:58:11.209 13423 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:58:11 ctl02 nova-api[13423]: 2017-09-28 12:58:11.209 13423 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:58:11 ctl02 nova-api[13423]: 2017-09-28 12:58:11.209 13423 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:58:11 ctl02 nova-api[13423]: 2017-09-28 12:58:11.209 13423 ERROR nova
Sep 28 12:58:11 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:58:11 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:58:11 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:58:11 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:58:11 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:58:11 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:58:11 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:58:11 ctl02 heat-api[13008]: 2017-09-28 12:58:11.744 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:58:11] "OPTIONS / HTTP/1.0" 200 134 0.000648
Sep 28 12:58:12 ctl02 glance-api[29183]: 2017-09-28 12:58:12.504 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:58:12] "OPTIONS / HTTP/1.0" 200 134 0.000578
Sep 28 12:58:13 ctl02 nova-api[13440]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:58:13 ctl02 nova-api[13440]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:58:13 ctl02 heat-api[13008]: 2017-09-28 12:58:13.449 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:58:13] "OPTIONS / HTTP/1.0" 200 134 0.000526
Sep 28 12:58:13 ctl02 nova-api[13440]: 2017-09-28 12:58:13.515 13440 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:58:13 ctl02 nova-api[13440]: 2017-09-28 12:58:13.516 13440 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:58:13 ctl02 nova-api[13440]: 2017-09-28 12:58:13.516 13440 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:58:13 ctl02 nova-api[13440]: 2017-09-28 12:58:13.516 13440 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:58:13 ctl02 nova-api[13440]: 2017-09-28 12:58:13.516 13440 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:58:13 ctl02 nova-api[13440]: 2017-09-28 12:58:13.516 13440 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:58:13 ctl02 nova-api[13440]: 2017-09-28 12:58:13.516 13440 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:58:13 ctl02 nova-api[13440]: 2017-09-28 12:58:13.516 13440 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:58:13 ctl02 nova-api[13440]: 2017-09-28 12:58:13.516 13440 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:58:13 ctl02 nova-api[13440]: 2017-09-28 12:58:13.516 13440 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:58:13 ctl02 nova-api[13440]: 2017-09-28 12:58:13.516 13440 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:58:13 ctl02 nova-api[13440]: 2017-09-28 12:58:13.516 13440 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:58:13 ctl02 nova-api[13440]: 2017-09-28 12:58:13.516 13440 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:58:13 ctl02 nova-api[13440]: 2017-09-28 12:58:13.516 13440 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:58:13 ctl02 nova-api[13440]: 2017-09-28 12:58:13.516 13440 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:58:13 ctl02 nova-api[13440]: 2017-09-28 12:58:13.516 13440 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:58:13 ctl02 nova-api[13440]: 2017-09-28 12:58:13.516 13440 ERROR nova.wsgi     self.filename))
Sep 28 12:58:13 ctl02 nova-api[13440]: 2017-09-28 12:58:13.516 13440 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:58:13 ctl02 nova-api[13440]: 2017-09-28 12:58:13.516 13440 ERROR nova.wsgi
Sep 28 12:58:13 ctl02 nova-api[13440]: 2017-09-28 12:58:13.517 13440 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:58:13 ctl02 neutron-server[30536]: 2017-09-28 12:58:13.545 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:58:13 ctl02 nova-api[13440]: 2017-09-28 12:58:13.642 13440 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:58:13 ctl02 nova-api[13440]: 2017-09-28 12:58:13.857 13440 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:58:13 ctl02 nova-api[13440]: 2017-09-28 12:58:13.859 13440 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:58:13 ctl02 nova-api[13440]: 2017-09-28 12:58:13.859 13440 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:58:13 ctl02 nova-api[13440]: 2017-09-28 12:58:13.859 13440 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:58:13 ctl02 nova-api[13440]: 2017-09-28 12:58:13.988 13440 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:58:13 ctl02 nova-api[13440]: 2017-09-28 12:58:13.990 13440 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:58:13 ctl02 nova-api[13440]: 2017-09-28 12:58:13.990 13440 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:58:13 ctl02 nova-api[13440]: 2017-09-28 12:58:13.990 13440 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:58:13 ctl02 nova-api[13440]: 2017-09-28 12:58:13.994 13440 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:58:13 ctl02 nova-api[13440]: 2017-09-28 12:58:13.994 13440 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:58:13 ctl02 nova-api[13440]: 2017-09-28 12:58:13.994 13440 ERROR nova Traceback (most recent call last):
Sep 28 12:58:13 ctl02 nova-api[13440]: 2017-09-28 12:58:13.994 13440 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:58:13 ctl02 nova-api[13440]: 2017-09-28 12:58:13.994 13440 ERROR nova     sys.exit(main())
Sep 28 12:58:13 ctl02 nova-api[13440]: 2017-09-28 12:58:13.994 13440 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:58:13 ctl02 nova-api[13440]: 2017-09-28 12:58:13.994 13440 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:58:13 ctl02 nova-api[13440]: 2017-09-28 12:58:13.994 13440 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:58:13 ctl02 nova-api[13440]: 2017-09-28 12:58:13.994 13440 ERROR nova     max_url_len=max_url_len)
Sep 28 12:58:13 ctl02 nova-api[13440]: 2017-09-28 12:58:13.994 13440 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:58:13 ctl02 nova-api[13440]: 2017-09-28 12:58:13.994 13440 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:58:13 ctl02 nova-api[13440]: 2017-09-28 12:58:13.994 13440 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:58:13 ctl02 nova-api[13440]: 2017-09-28 12:58:13.994 13440 ERROR nova     sock.listen(backlog)
Sep 28 12:58:13 ctl02 nova-api[13440]: 2017-09-28 12:58:13.994 13440 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:58:13 ctl02 nova-api[13440]: 2017-09-28 12:58:13.994 13440 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:58:13 ctl02 nova-api[13440]: 2017-09-28 12:58:13.994 13440 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:58:13 ctl02 nova-api[13440]: 2017-09-28 12:58:13.994 13440 ERROR nova
Sep 28 12:58:14 ctl02 glance-api[29183]: 2017-09-28 12:58:14.049 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:58:14] "OPTIONS / HTTP/1.0" 200 134 0.000593
Sep 28 12:58:14 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:58:14 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:58:14 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:58:14 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:58:14 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:58:14 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:58:14 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:58:14 ctl02 neutron-server[30536]: 2017-09-28 12:58:14.732 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:58:14] "OPTIONS / HTTP/1.0" 200 262 0.000597
Sep 28 12:58:15 ctl02 nova-conductor[5056]: 2017-09-28 12:58:15.224 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:58:15 ctl02 nova-conductor[5056]: 2017-09-28 12:58:15.229 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:58:15 ctl02 nova-conductor[5056]: 2017-09-28 12:58:15.231 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:58:15 ctl02 nova-conductor[5056]: 2017-09-28 12:58:15.239 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:58:15 ctl02 heat-api-cfn[13300]: 2017-09-28 12:58:15.285 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:58:15] "OPTIONS / HTTP/1.0" 200 134 0.000516
Sep 28 12:58:15 ctl02 nova-cert[4860]: 2017-09-28 12:58:15.706 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:58:15 ctl02 neutron-server[30536]: 2017-09-28 12:58:15.822 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:58:15] "OPTIONS / HTTP/1.0" 200 262 0.000500
Sep 28 12:58:16 ctl02 nova-api[13459]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:58:16 ctl02 nova-api[13459]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:58:16 ctl02 nova-api[13459]: 2017-09-28 12:58:16.270 13459 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:58:16 ctl02 nova-api[13459]: 2017-09-28 12:58:16.271 13459 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:58:16 ctl02 nova-api[13459]: 2017-09-28 12:58:16.271 13459 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:58:16 ctl02 nova-api[13459]: 2017-09-28 12:58:16.271 13459 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:58:16 ctl02 nova-api[13459]: 2017-09-28 12:58:16.271 13459 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:58:16 ctl02 nova-api[13459]: 2017-09-28 12:58:16.271 13459 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:58:16 ctl02 nova-api[13459]: 2017-09-28 12:58:16.271 13459 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:58:16 ctl02 nova-api[13459]: 2017-09-28 12:58:16.271 13459 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:58:16 ctl02 nova-api[13459]: 2017-09-28 12:58:16.271 13459 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:58:16 ctl02 nova-api[13459]: 2017-09-28 12:58:16.271 13459 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:58:16 ctl02 nova-api[13459]: 2017-09-28 12:58:16.271 13459 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:58:16 ctl02 nova-api[13459]: 2017-09-28 12:58:16.271 13459 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:58:16 ctl02 nova-api[13459]: 2017-09-28 12:58:16.271 13459 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:58:16 ctl02 nova-api[13459]: 2017-09-28 12:58:16.271 13459 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:58:16 ctl02 nova-api[13459]: 2017-09-28 12:58:16.271 13459 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:58:16 ctl02 nova-api[13459]: 2017-09-28 12:58:16.271 13459 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:58:16 ctl02 nova-api[13459]: 2017-09-28 12:58:16.271 13459 ERROR nova.wsgi     self.filename))
Sep 28 12:58:16 ctl02 nova-api[13459]: 2017-09-28 12:58:16.271 13459 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:58:16 ctl02 nova-api[13459]: 2017-09-28 12:58:16.271 13459 ERROR nova.wsgi
Sep 28 12:58:16 ctl02 nova-api[13459]: 2017-09-28 12:58:16.273 13459 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:58:16 ctl02 heat-api-cfn[13300]: 2017-09-28 12:58:16.331 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:58:16] "OPTIONS / HTTP/1.0" 200 134 0.000499
Sep 28 12:58:16 ctl02 nova-api[13459]: 2017-09-28 12:58:16.399 13459 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:58:16 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:58:16.482 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:58:16] "OPTIONS / HTTP/1.0" 200 134 0.000486
Sep 28 12:58:16 ctl02 nova-api[13459]: 2017-09-28 12:58:16.619 13459 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:58:16 ctl02 nova-api[13459]: 2017-09-28 12:58:16.621 13459 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:58:16 ctl02 nova-api[13459]: 2017-09-28 12:58:16.621 13459 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:58:16 ctl02 nova-api[13459]: 2017-09-28 12:58:16.622 13459 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:58:16 ctl02 nova-api[13459]: 2017-09-28 12:58:16.749 13459 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:58:16 ctl02 nova-api[13459]: 2017-09-28 12:58:16.751 13459 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:58:16 ctl02 nova-api[13459]: 2017-09-28 12:58:16.751 13459 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:58:16 ctl02 nova-api[13459]: 2017-09-28 12:58:16.751 13459 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:58:16 ctl02 nova-api[13459]: 2017-09-28 12:58:16.754 13459 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:58:16 ctl02 nova-api[13459]: 2017-09-28 12:58:16.755 13459 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:58:16 ctl02 nova-api[13459]: 2017-09-28 12:58:16.755 13459 ERROR nova Traceback (most recent call last):
Sep 28 12:58:16 ctl02 nova-api[13459]: 2017-09-28 12:58:16.755 13459 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:58:16 ctl02 nova-api[13459]: 2017-09-28 12:58:16.755 13459 ERROR nova     sys.exit(main())
Sep 28 12:58:16 ctl02 nova-api[13459]: 2017-09-28 12:58:16.755 13459 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:58:16 ctl02 nova-api[13459]: 2017-09-28 12:58:16.755 13459 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:58:16 ctl02 nova-api[13459]: 2017-09-28 12:58:16.755 13459 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:58:16 ctl02 nova-api[13459]: 2017-09-28 12:58:16.755 13459 ERROR nova     max_url_len=max_url_len)
Sep 28 12:58:16 ctl02 nova-api[13459]: 2017-09-28 12:58:16.755 13459 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:58:16 ctl02 nova-api[13459]: 2017-09-28 12:58:16.755 13459 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:58:16 ctl02 nova-api[13459]: 2017-09-28 12:58:16.755 13459 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:58:16 ctl02 nova-api[13459]: 2017-09-28 12:58:16.755 13459 ERROR nova     sock.listen(backlog)
Sep 28 12:58:16 ctl02 nova-api[13459]: 2017-09-28 12:58:16.755 13459 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:58:16 ctl02 nova-api[13459]: 2017-09-28 12:58:16.755 13459 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:58:16 ctl02 nova-api[13459]: 2017-09-28 12:58:16.755 13459 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:58:16 ctl02 nova-api[13459]: 2017-09-28 12:58:16.755 13459 ERROR nova
Sep 28 12:58:16 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:58:16 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:58:16 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:58:17 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:58:17 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:58:17 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:58:17 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:58:17 ctl02 heat-api[13008]: 2017-09-28 12:58:17.950 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:58:17] "OPTIONS / HTTP/1.0" 200 134 0.000531
Sep 28 12:58:18 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:58:18.371 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:58:18] "OPTIONS / HTTP/1.0" 200 134 0.000488
Sep 28 12:58:18 ctl02 nova-api[13477]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:58:18 ctl02 nova-api[13477]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:58:18 ctl02 glance-api[29183]: 2017-09-28 12:58:18.859 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:58:18] "OPTIONS / HTTP/1.0" 200 134 0.000601
Sep 28 12:58:18 ctl02 nova-api[13477]: 2017-09-28 12:58:18.975 13477 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:58:18 ctl02 nova-api[13477]: 2017-09-28 12:58:18.977 13477 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:58:18 ctl02 nova-api[13477]: 2017-09-28 12:58:18.977 13477 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:58:18 ctl02 nova-api[13477]: 2017-09-28 12:58:18.977 13477 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:58:18 ctl02 nova-api[13477]: 2017-09-28 12:58:18.977 13477 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:58:18 ctl02 nova-api[13477]: 2017-09-28 12:58:18.977 13477 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:58:18 ctl02 nova-api[13477]: 2017-09-28 12:58:18.977 13477 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:58:18 ctl02 nova-api[13477]: 2017-09-28 12:58:18.977 13477 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:58:18 ctl02 nova-api[13477]: 2017-09-28 12:58:18.977 13477 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:58:18 ctl02 nova-api[13477]: 2017-09-28 12:58:18.977 13477 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:58:18 ctl02 nova-api[13477]: 2017-09-28 12:58:18.977 13477 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:58:18 ctl02 nova-api[13477]: 2017-09-28 12:58:18.977 13477 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:58:18 ctl02 nova-api[13477]: 2017-09-28 12:58:18.977 13477 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:58:18 ctl02 nova-api[13477]: 2017-09-28 12:58:18.977 13477 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:58:18 ctl02 nova-api[13477]: 2017-09-28 12:58:18.977 13477 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:58:18 ctl02 nova-api[13477]: 2017-09-28 12:58:18.977 13477 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:58:18 ctl02 nova-api[13477]: 2017-09-28 12:58:18.977 13477 ERROR nova.wsgi     self.filename))
Sep 28 12:58:18 ctl02 nova-api[13477]: 2017-09-28 12:58:18.977 13477 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:58:18 ctl02 nova-api[13477]: 2017-09-28 12:58:18.977 13477 ERROR nova.wsgi
Sep 28 12:58:18 ctl02 nova-api[13477]: 2017-09-28 12:58:18.979 13477 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:58:19 ctl02 nova-api[13477]: 2017-09-28 12:58:19.104 13477 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:58:19 ctl02 nova-api[13477]: 2017-09-28 12:58:19.323 13477 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:58:19 ctl02 nova-api[13477]: 2017-09-28 12:58:19.325 13477 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:58:19 ctl02 nova-api[13477]: 2017-09-28 12:58:19.326 13477 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:58:19 ctl02 nova-api[13477]: 2017-09-28 12:58:19.326 13477 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:58:19 ctl02 nova-api[13477]: 2017-09-28 12:58:19.456 13477 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:58:19 ctl02 nova-api[13477]: 2017-09-28 12:58:19.459 13477 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:58:19 ctl02 nova-api[13477]: 2017-09-28 12:58:19.459 13477 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:58:19 ctl02 nova-api[13477]: 2017-09-28 12:58:19.460 13477 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:58:19 ctl02 nova-api[13477]: 2017-09-28 12:58:19.463 13477 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:58:19 ctl02 nova-api[13477]: 2017-09-28 12:58:19.464 13477 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:58:19 ctl02 nova-api[13477]: 2017-09-28 12:58:19.464 13477 ERROR nova Traceback (most recent call last):
Sep 28 12:58:19 ctl02 nova-api[13477]: 2017-09-28 12:58:19.464 13477 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:58:19 ctl02 nova-api[13477]: 2017-09-28 12:58:19.464 13477 ERROR nova     sys.exit(main())
Sep 28 12:58:19 ctl02 nova-api[13477]: 2017-09-28 12:58:19.464 13477 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:58:19 ctl02 nova-api[13477]: 2017-09-28 12:58:19.464 13477 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:58:19 ctl02 nova-api[13477]: 2017-09-28 12:58:19.464 13477 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:58:19 ctl02 nova-api[13477]: 2017-09-28 12:58:19.464 13477 ERROR nova     max_url_len=max_url_len)
Sep 28 12:58:19 ctl02 nova-api[13477]: 2017-09-28 12:58:19.464 13477 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:58:19 ctl02 nova-api[13477]: 2017-09-28 12:58:19.464 13477 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:58:19 ctl02 nova-api[13477]: 2017-09-28 12:58:19.464 13477 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:58:19 ctl02 nova-api[13477]: 2017-09-28 12:58:19.464 13477 ERROR nova     sock.listen(backlog)
Sep 28 12:58:19 ctl02 nova-api[13477]: 2017-09-28 12:58:19.464 13477 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:58:19 ctl02 nova-api[13477]: 2017-09-28 12:58:19.464 13477 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:58:19 ctl02 nova-api[13477]: 2017-09-28 12:58:19.464 13477 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:58:19 ctl02 nova-api[13477]: 2017-09-28 12:58:19.464 13477 ERROR nova
Sep 28 12:58:19 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:58:19.528 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:58:19] "OPTIONS / HTTP/1.0" 200 134 0.000361
Sep 28 12:58:19 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:58:19 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:58:19 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:58:19 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x22c0787a)
Sep 28 12:58:19 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:58:19 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:58:19 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:58:19 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:58:20 ctl02 heat-api-cfn[13300]: 2017-09-28 12:58:20.251 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:58:20] "OPTIONS / HTTP/1.0" 200 134 0.000553
Sep 28 12:58:20 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x22c0787a)
Sep 28 12:58:21 ctl02 neutron-server[30536]: 2017-09-28 12:58:21.083 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 12:58:21 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:58:21 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:57:06 cmp002
Sep 28 12:58:21 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:56:28 cmp001
Sep 28 12:58:21 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:56:26 cmp002
Sep 28 12:58:21 ctl02 neutron-server[30536]: 2017-09-28 12:58:21.403 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:58:21] "OPTIONS / HTTP/1.0" 200 262 0.000468
Sep 28 12:58:21 ctl02 heat-api[13008]: 2017-09-28 12:58:21.560 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:58:21] "OPTIONS / HTTP/1.0" 200 134 0.000567
Sep 28 12:58:21 ctl02 nova-api[13494]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:58:21 ctl02 nova-api[13494]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:58:21 ctl02 nova-api[13494]: 2017-09-28 12:58:21.738 13494 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:58:21 ctl02 nova-api[13494]: 2017-09-28 12:58:21.740 13494 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:58:21 ctl02 nova-api[13494]: 2017-09-28 12:58:21.740 13494 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:58:21 ctl02 nova-api[13494]: 2017-09-28 12:58:21.740 13494 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:58:21 ctl02 nova-api[13494]: 2017-09-28 12:58:21.740 13494 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:58:21 ctl02 nova-api[13494]: 2017-09-28 12:58:21.740 13494 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:58:21 ctl02 nova-api[13494]: 2017-09-28 12:58:21.740 13494 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:58:21 ctl02 nova-api[13494]: 2017-09-28 12:58:21.740 13494 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:58:21 ctl02 nova-api[13494]: 2017-09-28 12:58:21.740 13494 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:58:21 ctl02 nova-api[13494]: 2017-09-28 12:58:21.740 13494 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:58:21 ctl02 nova-api[13494]: 2017-09-28 12:58:21.740 13494 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:58:21 ctl02 nova-api[13494]: 2017-09-28 12:58:21.740 13494 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:58:21 ctl02 nova-api[13494]: 2017-09-28 12:58:21.740 13494 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:58:21 ctl02 nova-api[13494]: 2017-09-28 12:58:21.740 13494 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:58:21 ctl02 nova-api[13494]: 2017-09-28 12:58:21.740 13494 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:58:21 ctl02 nova-api[13494]: 2017-09-28 12:58:21.740 13494 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:58:21 ctl02 nova-api[13494]: 2017-09-28 12:58:21.740 13494 ERROR nova.wsgi     self.filename))
Sep 28 12:58:21 ctl02 nova-api[13494]: 2017-09-28 12:58:21.740 13494 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:58:21 ctl02 nova-api[13494]: 2017-09-28 12:58:21.740 13494 ERROR nova.wsgi
Sep 28 12:58:21 ctl02 nova-api[13494]: 2017-09-28 12:58:21.742 13494 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:58:21 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x22c0787a)
Sep 28 12:58:21 ctl02 nova-api[13494]: 2017-09-28 12:58:21.872 13494 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:58:22 ctl02 nova-api[13494]: 2017-09-28 12:58:22.094 13494 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:58:22 ctl02 nova-api[13494]: 2017-09-28 12:58:22.096 13494 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:58:22 ctl02 nova-api[13494]: 2017-09-28 12:58:22.097 13494 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:58:22 ctl02 nova-api[13494]: 2017-09-28 12:58:22.097 13494 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:58:22 ctl02 nova-api[13494]: 2017-09-28 12:58:22.228 13494 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:58:22 ctl02 nova-api[13494]: 2017-09-28 12:58:22.231 13494 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:58:22 ctl02 nova-api[13494]: 2017-09-28 12:58:22.231 13494 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:58:22 ctl02 nova-api[13494]: 2017-09-28 12:58:22.232 13494 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:58:22 ctl02 nova-api[13494]: 2017-09-28 12:58:22.235 13494 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:58:22 ctl02 nova-api[13494]: 2017-09-28 12:58:22.235 13494 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:58:22 ctl02 nova-api[13494]: 2017-09-28 12:58:22.235 13494 ERROR nova Traceback (most recent call last):
Sep 28 12:58:22 ctl02 nova-api[13494]: 2017-09-28 12:58:22.235 13494 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:58:22 ctl02 nova-api[13494]: 2017-09-28 12:58:22.235 13494 ERROR nova     sys.exit(main())
Sep 28 12:58:22 ctl02 nova-api[13494]: 2017-09-28 12:58:22.235 13494 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:58:22 ctl02 nova-api[13494]: 2017-09-28 12:58:22.235 13494 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:58:22 ctl02 nova-api[13494]: 2017-09-28 12:58:22.235 13494 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:58:22 ctl02 nova-api[13494]: 2017-09-28 12:58:22.235 13494 ERROR nova     max_url_len=max_url_len)
Sep 28 12:58:22 ctl02 nova-api[13494]: 2017-09-28 12:58:22.235 13494 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:58:22 ctl02 nova-api[13494]: 2017-09-28 12:58:22.235 13494 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:58:22 ctl02 nova-api[13494]: 2017-09-28 12:58:22.235 13494 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:58:22 ctl02 nova-api[13494]: 2017-09-28 12:58:22.235 13494 ERROR nova     sock.listen(backlog)
Sep 28 12:58:22 ctl02 nova-api[13494]: 2017-09-28 12:58:22.235 13494 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:58:22 ctl02 nova-api[13494]: 2017-09-28 12:58:22.235 13494 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:58:22 ctl02 nova-api[13494]: 2017-09-28 12:58:22.235 13494 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:58:22 ctl02 nova-api[13494]: 2017-09-28 12:58:22.235 13494 ERROR nova
Sep 28 12:58:22 ctl02 glance-api[29183]: 2017-09-28 12:58:22.318 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:58:22] "OPTIONS / HTTP/1.0" 200 134 0.000605
Sep 28 12:58:22 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:58:22 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:58:22 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:58:22 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:58:22 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:58:22 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:58:22 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:58:22 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x22c0787a)
Sep 28 12:58:23 ctl02 heat-api[13008]: 2017-09-28 12:58:23.704 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:58:23] "OPTIONS / HTTP/1.0" 200 134 0.000592
Sep 28 12:58:23 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x22c0787a)
Sep 28 12:58:23 ctl02 glance-api[29183]: 2017-09-28 12:58:23.937 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:58:23] "OPTIONS / HTTP/1.0" 200 134 0.000576
Sep 28 12:58:24 ctl02 nova-api[13512]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:58:24 ctl02 nova-api[13512]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:58:24 ctl02 nova-api[13512]: 2017-09-28 12:58:24.510 13512 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:58:24 ctl02 nova-api[13512]: 2017-09-28 12:58:24.512 13512 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:58:24 ctl02 nova-api[13512]: 2017-09-28 12:58:24.512 13512 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:58:24 ctl02 nova-api[13512]: 2017-09-28 12:58:24.512 13512 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:58:24 ctl02 nova-api[13512]: 2017-09-28 12:58:24.512 13512 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:58:24 ctl02 nova-api[13512]: 2017-09-28 12:58:24.512 13512 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:58:24 ctl02 nova-api[13512]: 2017-09-28 12:58:24.512 13512 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:58:24 ctl02 nova-api[13512]: 2017-09-28 12:58:24.512 13512 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:58:24 ctl02 nova-api[13512]: 2017-09-28 12:58:24.512 13512 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:58:24 ctl02 nova-api[13512]: 2017-09-28 12:58:24.512 13512 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:58:24 ctl02 nova-api[13512]: 2017-09-28 12:58:24.512 13512 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:58:24 ctl02 nova-api[13512]: 2017-09-28 12:58:24.512 13512 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:58:24 ctl02 nova-api[13512]: 2017-09-28 12:58:24.512 13512 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:58:24 ctl02 nova-api[13512]: 2017-09-28 12:58:24.512 13512 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:58:24 ctl02 nova-api[13512]: 2017-09-28 12:58:24.512 13512 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:58:24 ctl02 nova-api[13512]: 2017-09-28 12:58:24.512 13512 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:58:24 ctl02 nova-api[13512]: 2017-09-28 12:58:24.512 13512 ERROR nova.wsgi     self.filename))
Sep 28 12:58:24 ctl02 nova-api[13512]: 2017-09-28 12:58:24.512 13512 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:58:24 ctl02 nova-api[13512]: 2017-09-28 12:58:24.512 13512 ERROR nova.wsgi
Sep 28 12:58:24 ctl02 nova-api[13512]: 2017-09-28 12:58:24.513 13512 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:58:24 ctl02 neutron-server[30536]: 2017-09-28 12:58:24.572 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:58:24] "OPTIONS / HTTP/1.0" 200 262 0.000522
Sep 28 12:58:24 ctl02 nova-api[13512]: 2017-09-28 12:58:24.643 13512 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:58:24 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x22c0787a)
Sep 28 12:58:24 ctl02 nova-api[13512]: 2017-09-28 12:58:24.876 13512 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:58:24 ctl02 nova-api[13512]: 2017-09-28 12:58:24.878 13512 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:58:24 ctl02 nova-api[13512]: 2017-09-28 12:58:24.878 13512 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:58:24 ctl02 nova-api[13512]: 2017-09-28 12:58:24.878 13512 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:58:25 ctl02 nova-api[13512]: 2017-09-28 12:58:25.011 13512 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:58:25 ctl02 nova-api[13512]: 2017-09-28 12:58:25.012 13512 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:58:25 ctl02 nova-api[13512]: 2017-09-28 12:58:25.013 13512 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:58:25 ctl02 nova-api[13512]: 2017-09-28 12:58:25.013 13512 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:58:25 ctl02 nova-api[13512]: 2017-09-28 12:58:25.016 13512 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:58:25 ctl02 nova-api[13512]: 2017-09-28 12:58:25.016 13512 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:58:25 ctl02 nova-api[13512]: 2017-09-28 12:58:25.016 13512 ERROR nova Traceback (most recent call last):
Sep 28 12:58:25 ctl02 nova-api[13512]: 2017-09-28 12:58:25.016 13512 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:58:25 ctl02 nova-api[13512]: 2017-09-28 12:58:25.016 13512 ERROR nova     sys.exit(main())
Sep 28 12:58:25 ctl02 nova-api[13512]: 2017-09-28 12:58:25.016 13512 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:58:25 ctl02 nova-api[13512]: 2017-09-28 12:58:25.016 13512 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:58:25 ctl02 nova-api[13512]: 2017-09-28 12:58:25.016 13512 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:58:25 ctl02 nova-api[13512]: 2017-09-28 12:58:25.016 13512 ERROR nova     max_url_len=max_url_len)
Sep 28 12:58:25 ctl02 nova-api[13512]: 2017-09-28 12:58:25.016 13512 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:58:25 ctl02 nova-api[13512]: 2017-09-28 12:58:25.016 13512 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:58:25 ctl02 nova-api[13512]: 2017-09-28 12:58:25.016 13512 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:58:25 ctl02 nova-api[13512]: 2017-09-28 12:58:25.016 13512 ERROR nova     sock.listen(backlog)
Sep 28 12:58:25 ctl02 nova-api[13512]: 2017-09-28 12:58:25.016 13512 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:58:25 ctl02 nova-api[13512]: 2017-09-28 12:58:25.016 13512 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:58:25 ctl02 nova-api[13512]: 2017-09-28 12:58:25.016 13512 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:58:25 ctl02 nova-api[13512]: 2017-09-28 12:58:25.016 13512 ERROR nova
Sep 28 12:58:25 ctl02 heat-api-cfn[13300]: 2017-09-28 12:58:25.060 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:58:25] "OPTIONS / HTTP/1.0" 200 134 0.000543
Sep 28 12:58:25 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:58:25 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:58:25 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:58:25 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:58:25 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:58:25 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:58:25 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:58:25 ctl02 nova-consoleauth[5433]: 2017-09-28 12:58:25.542 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:58:25 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x22c0787a)
Sep 28 12:58:25 ctl02 neutron-server[30536]: 2017-09-28 12:58:25.853 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:58:25] "OPTIONS / HTTP/1.0" 200 262 0.000469
Sep 28 12:58:26 ctl02 heat-api-cfn[13300]: 2017-09-28 12:58:26.279 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:58:26] "OPTIONS / HTTP/1.0" 200 134 0.000549
Sep 28 12:58:26 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:58:26.284 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:58:26] "OPTIONS / HTTP/1.0" 200 134 0.000551
Sep 28 12:58:26 ctl02 heat-engine[12803]: 2017-09-28 12:58:26.351 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:58:26 ctl02 heat-engine[12803]: 2017-09-28 12:58:26.373 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:58:26 ctl02 heat-engine[12803]: 2017-09-28 12:58:26.373 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:58:26 ctl02 heat-engine[12803]: 2017-09-28 12:58:26.378 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:58:26 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x22c0787a)
Sep 28 12:58:27 ctl02 nova-api[13531]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:58:27 ctl02 nova-api[13531]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:58:27 ctl02 nova-api[13531]: 2017-09-28 12:58:27.247 13531 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:58:27 ctl02 nova-api[13531]: 2017-09-28 12:58:27.248 13531 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:58:27 ctl02 nova-api[13531]: 2017-09-28 12:58:27.248 13531 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:58:27 ctl02 nova-api[13531]: 2017-09-28 12:58:27.248 13531 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:58:27 ctl02 nova-api[13531]: 2017-09-28 12:58:27.248 13531 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:58:27 ctl02 nova-api[13531]: 2017-09-28 12:58:27.248 13531 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:58:27 ctl02 nova-api[13531]: 2017-09-28 12:58:27.248 13531 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:58:27 ctl02 nova-api[13531]: 2017-09-28 12:58:27.248 13531 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:58:27 ctl02 nova-api[13531]: 2017-09-28 12:58:27.248 13531 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:58:27 ctl02 nova-api[13531]: 2017-09-28 12:58:27.248 13531 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:58:27 ctl02 nova-api[13531]: 2017-09-28 12:58:27.248 13531 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:58:27 ctl02 nova-api[13531]: 2017-09-28 12:58:27.248 13531 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:58:27 ctl02 nova-api[13531]: 2017-09-28 12:58:27.248 13531 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:58:27 ctl02 nova-api[13531]: 2017-09-28 12:58:27.248 13531 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:58:27 ctl02 nova-api[13531]: 2017-09-28 12:58:27.248 13531 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:58:27 ctl02 nova-api[13531]: 2017-09-28 12:58:27.248 13531 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:58:27 ctl02 nova-api[13531]: 2017-09-28 12:58:27.248 13531 ERROR nova.wsgi     self.filename))
Sep 28 12:58:27 ctl02 nova-api[13531]: 2017-09-28 12:58:27.248 13531 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:58:27 ctl02 nova-api[13531]: 2017-09-28 12:58:27.248 13531 ERROR nova.wsgi
Sep 28 12:58:27 ctl02 nova-api[13531]: 2017-09-28 12:58:27.250 13531 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:58:27 ctl02 nova-api[13531]: 2017-09-28 12:58:27.378 13531 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:58:27 ctl02 nova-api[13531]: 2017-09-28 12:58:27.601 13531 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:58:27 ctl02 nova-api[13531]: 2017-09-28 12:58:27.604 13531 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:58:27 ctl02 nova-api[13531]: 2017-09-28 12:58:27.604 13531 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:58:27 ctl02 nova-api[13531]: 2017-09-28 12:58:27.605 13531 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:58:27 ctl02 nova-api[13531]: 2017-09-28 12:58:27.736 13531 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:58:27 ctl02 nova-api[13531]: 2017-09-28 12:58:27.739 13531 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:58:27 ctl02 nova-api[13531]: 2017-09-28 12:58:27.739 13531 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:58:27 ctl02 nova-api[13531]: 2017-09-28 12:58:27.739 13531 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:58:27 ctl02 nova-api[13531]: 2017-09-28 12:58:27.743 13531 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:58:27 ctl02 nova-api[13531]: 2017-09-28 12:58:27.743 13531 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:58:27 ctl02 nova-api[13531]: 2017-09-28 12:58:27.743 13531 ERROR nova Traceback (most recent call last):
Sep 28 12:58:27 ctl02 nova-api[13531]: 2017-09-28 12:58:27.743 13531 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:58:27 ctl02 nova-api[13531]: 2017-09-28 12:58:27.743 13531 ERROR nova     sys.exit(main())
Sep 28 12:58:27 ctl02 nova-api[13531]: 2017-09-28 12:58:27.743 13531 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:58:27 ctl02 nova-api[13531]: 2017-09-28 12:58:27.743 13531 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:58:27 ctl02 nova-api[13531]: 2017-09-28 12:58:27.743 13531 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:58:27 ctl02 nova-api[13531]: 2017-09-28 12:58:27.743 13531 ERROR nova     max_url_len=max_url_len)
Sep 28 12:58:27 ctl02 nova-api[13531]: 2017-09-28 12:58:27.743 13531 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:58:27 ctl02 nova-api[13531]: 2017-09-28 12:58:27.743 13531 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:58:27 ctl02 nova-api[13531]: 2017-09-28 12:58:27.743 13531 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:58:27 ctl02 nova-api[13531]: 2017-09-28 12:58:27.743 13531 ERROR nova     sock.listen(backlog)
Sep 28 12:58:27 ctl02 nova-api[13531]: 2017-09-28 12:58:27.743 13531 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:58:27 ctl02 nova-api[13531]: 2017-09-28 12:58:27.743 13531 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:58:27 ctl02 nova-api[13531]: 2017-09-28 12:58:27.743 13531 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:58:27 ctl02 nova-api[13531]: 2017-09-28 12:58:27.743 13531 ERROR nova
Sep 28 12:58:27 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x22c0787a)
Sep 28 12:58:27 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:58:27 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:58:27 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:58:27 ctl02 heat-api[13008]: 2017-09-28 12:58:27.891 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:58:27] "OPTIONS / HTTP/1.0" 200 134 0.000540
Sep 28 12:58:28 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:58:28 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:58:28 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:58:28 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:58:28 ctl02 nova-scheduler[5620]: 2017-09-28 12:58:28.650 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:58:28 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:58:28.711 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:58:28] "OPTIONS / HTTP/1.0" 200 134 0.000386
Sep 28 12:58:28 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x22c0787a)
Sep 28 12:58:28 ctl02 glance-api[29183]: 2017-09-28 12:58:28.987 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:58:28] "OPTIONS / HTTP/1.0" 200 134 0.000559
Sep 28 12:58:29 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:58:29.460 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:58:29] "OPTIONS / HTTP/1.0" 200 134 0.000458
Sep 28 12:58:29 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x22c0787a)
Sep 28 12:58:29 ctl02 nova-api[13548]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:58:29 ctl02 nova-api[13548]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:58:30 ctl02 nova-api[13548]: 2017-09-28 12:58:30.035 13548 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:58:30 ctl02 nova-api[13548]: 2017-09-28 12:58:30.037 13548 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:58:30 ctl02 nova-api[13548]: 2017-09-28 12:58:30.037 13548 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:58:30 ctl02 nova-api[13548]: 2017-09-28 12:58:30.037 13548 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:58:30 ctl02 nova-api[13548]: 2017-09-28 12:58:30.037 13548 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:58:30 ctl02 nova-api[13548]: 2017-09-28 12:58:30.037 13548 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:58:30 ctl02 nova-api[13548]: 2017-09-28 12:58:30.037 13548 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:58:30 ctl02 nova-api[13548]: 2017-09-28 12:58:30.037 13548 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:58:30 ctl02 nova-api[13548]: 2017-09-28 12:58:30.037 13548 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:58:30 ctl02 nova-api[13548]: 2017-09-28 12:58:30.037 13548 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:58:30 ctl02 nova-api[13548]: 2017-09-28 12:58:30.037 13548 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:58:30 ctl02 nova-api[13548]: 2017-09-28 12:58:30.037 13548 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:58:30 ctl02 nova-api[13548]: 2017-09-28 12:58:30.037 13548 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:58:30 ctl02 nova-api[13548]: 2017-09-28 12:58:30.037 13548 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:58:30 ctl02 nova-api[13548]: 2017-09-28 12:58:30.037 13548 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:58:30 ctl02 nova-api[13548]: 2017-09-28 12:58:30.037 13548 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:58:30 ctl02 nova-api[13548]: 2017-09-28 12:58:30.037 13548 ERROR nova.wsgi     self.filename))
Sep 28 12:58:30 ctl02 nova-api[13548]: 2017-09-28 12:58:30.037 13548 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:58:30 ctl02 nova-api[13548]: 2017-09-28 12:58:30.037 13548 ERROR nova.wsgi
Sep 28 12:58:30 ctl02 nova-api[13548]: 2017-09-28 12:58:30.038 13548 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:58:30 ctl02 heat-api-cfn[13300]: 2017-09-28 12:58:30.146 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:58:30] "OPTIONS / HTTP/1.0" 200 134 0.000551
Sep 28 12:58:30 ctl02 nova-api[13548]: 2017-09-28 12:58:30.169 13548 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:58:30 ctl02 nova-api[13548]: 2017-09-28 12:58:30.397 13548 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:58:30 ctl02 nova-api[13548]: 2017-09-28 12:58:30.399 13548 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:58:30 ctl02 nova-api[13548]: 2017-09-28 12:58:30.399 13548 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:58:30 ctl02 nova-api[13548]: 2017-09-28 12:58:30.400 13548 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:58:30 ctl02 nova-api[13548]: 2017-09-28 12:58:30.534 13548 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:58:30 ctl02 nova-api[13548]: 2017-09-28 12:58:30.536 13548 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:58:30 ctl02 nova-api[13548]: 2017-09-28 12:58:30.536 13548 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:58:30 ctl02 nova-api[13548]: 2017-09-28 12:58:30.536 13548 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:58:30 ctl02 nova-api[13548]: 2017-09-28 12:58:30.539 13548 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:58:30 ctl02 nova-api[13548]: 2017-09-28 12:58:30.540 13548 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:58:30 ctl02 nova-api[13548]: 2017-09-28 12:58:30.540 13548 ERROR nova Traceback (most recent call last):
Sep 28 12:58:30 ctl02 nova-api[13548]: 2017-09-28 12:58:30.540 13548 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:58:30 ctl02 nova-api[13548]: 2017-09-28 12:58:30.540 13548 ERROR nova     sys.exit(main())
Sep 28 12:58:30 ctl02 nova-api[13548]: 2017-09-28 12:58:30.540 13548 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:58:30 ctl02 nova-api[13548]: 2017-09-28 12:58:30.540 13548 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:58:30 ctl02 nova-api[13548]: 2017-09-28 12:58:30.540 13548 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:58:30 ctl02 nova-api[13548]: 2017-09-28 12:58:30.540 13548 ERROR nova     max_url_len=max_url_len)
Sep 28 12:58:30 ctl02 nova-api[13548]: 2017-09-28 12:58:30.540 13548 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:58:30 ctl02 nova-api[13548]: 2017-09-28 12:58:30.540 13548 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:58:30 ctl02 nova-api[13548]: 2017-09-28 12:58:30.540 13548 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:58:30 ctl02 nova-api[13548]: 2017-09-28 12:58:30.540 13548 ERROR nova     sock.listen(backlog)
Sep 28 12:58:30 ctl02 nova-api[13548]: 2017-09-28 12:58:30.540 13548 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:58:30 ctl02 nova-api[13548]: 2017-09-28 12:58:30.540 13548 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:58:30 ctl02 nova-api[13548]: 2017-09-28 12:58:30.540 13548 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:58:30 ctl02 nova-api[13548]: 2017-09-28 12:58:30.540 13548 ERROR nova
Sep 28 12:58:30 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:58:30 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:58:30 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:58:30 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:58:30 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:58:30 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:58:30 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:58:30 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:58:30 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:58:31 ctl02 heat-api[13008]: 2017-09-28 12:58:31.245 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:58:31] "OPTIONS / HTTP/1.0" 200 134 0.000689
Sep 28 12:58:31 ctl02 neutron-server[30536]: 2017-09-28 12:58:31.594 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:58:31] "OPTIONS / HTTP/1.0" 200 262 0.000508
Sep 28 12:58:32 ctl02 glance-api[29183]: 2017-09-28 12:58:32.173 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:58:32] "OPTIONS / HTTP/1.0" 200 134 0.000644
Sep 28 12:58:32 ctl02 nova-api[13572]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:58:32 ctl02 nova-api[13572]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:58:32 ctl02 nova-api[13572]: 2017-09-28 12:58:32.824 13572 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:58:32 ctl02 nova-api[13572]: 2017-09-28 12:58:32.826 13572 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:58:32 ctl02 nova-api[13572]: 2017-09-28 12:58:32.826 13572 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:58:32 ctl02 nova-api[13572]: 2017-09-28 12:58:32.826 13572 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:58:32 ctl02 nova-api[13572]: 2017-09-28 12:58:32.826 13572 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:58:32 ctl02 nova-api[13572]: 2017-09-28 12:58:32.826 13572 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:58:32 ctl02 nova-api[13572]: 2017-09-28 12:58:32.826 13572 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:58:32 ctl02 nova-api[13572]: 2017-09-28 12:58:32.826 13572 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:58:32 ctl02 nova-api[13572]: 2017-09-28 12:58:32.826 13572 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:58:32 ctl02 nova-api[13572]: 2017-09-28 12:58:32.826 13572 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:58:32 ctl02 nova-api[13572]: 2017-09-28 12:58:32.826 13572 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:58:32 ctl02 nova-api[13572]: 2017-09-28 12:58:32.826 13572 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:58:32 ctl02 nova-api[13572]: 2017-09-28 12:58:32.826 13572 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:58:32 ctl02 nova-api[13572]: 2017-09-28 12:58:32.826 13572 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:58:32 ctl02 nova-api[13572]: 2017-09-28 12:58:32.826 13572 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:58:32 ctl02 nova-api[13572]: 2017-09-28 12:58:32.826 13572 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:58:32 ctl02 nova-api[13572]: 2017-09-28 12:58:32.826 13572 ERROR nova.wsgi     self.filename))
Sep 28 12:58:32 ctl02 nova-api[13572]: 2017-09-28 12:58:32.826 13572 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:58:32 ctl02 nova-api[13572]: 2017-09-28 12:58:32.826 13572 ERROR nova.wsgi
Sep 28 12:58:32 ctl02 nova-api[13572]: 2017-09-28 12:58:32.827 13572 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:58:32 ctl02 nova-api[13572]: 2017-09-28 12:58:32.961 13572 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:58:33 ctl02 nova-api[13572]: 2017-09-28 12:58:33.211 13572 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:58:33 ctl02 nova-api[13572]: 2017-09-28 12:58:33.214 13572 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:58:33 ctl02 nova-api[13572]: 2017-09-28 12:58:33.214 13572 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:58:33 ctl02 nova-api[13572]: 2017-09-28 12:58:33.214 13572 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:58:33 ctl02 nova-api[13572]: 2017-09-28 12:58:33.349 13572 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:58:33 ctl02 nova-api[13572]: 2017-09-28 12:58:33.351 13572 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:58:33 ctl02 nova-api[13572]: 2017-09-28 12:58:33.351 13572 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:58:33 ctl02 nova-api[13572]: 2017-09-28 12:58:33.352 13572 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:58:33 ctl02 nova-api[13572]: 2017-09-28 12:58:33.355 13572 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:58:33 ctl02 nova-api[13572]: 2017-09-28 12:58:33.355 13572 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:58:33 ctl02 nova-api[13572]: 2017-09-28 12:58:33.355 13572 ERROR nova Traceback (most recent call last):
Sep 28 12:58:33 ctl02 nova-api[13572]: 2017-09-28 12:58:33.355 13572 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:58:33 ctl02 nova-api[13572]: 2017-09-28 12:58:33.355 13572 ERROR nova     sys.exit(main())
Sep 28 12:58:33 ctl02 nova-api[13572]: 2017-09-28 12:58:33.355 13572 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:58:33 ctl02 nova-api[13572]: 2017-09-28 12:58:33.355 13572 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:58:33 ctl02 nova-api[13572]: 2017-09-28 12:58:33.355 13572 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:58:33 ctl02 nova-api[13572]: 2017-09-28 12:58:33.355 13572 ERROR nova     max_url_len=max_url_len)
Sep 28 12:58:33 ctl02 nova-api[13572]: 2017-09-28 12:58:33.355 13572 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:58:33 ctl02 nova-api[13572]: 2017-09-28 12:58:33.355 13572 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:58:33 ctl02 nova-api[13572]: 2017-09-28 12:58:33.355 13572 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:58:33 ctl02 nova-api[13572]: 2017-09-28 12:58:33.355 13572 ERROR nova     sock.listen(backlog)
Sep 28 12:58:33 ctl02 nova-api[13572]: 2017-09-28 12:58:33.355 13572 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:58:33 ctl02 nova-api[13572]: 2017-09-28 12:58:33.355 13572 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:58:33 ctl02 nova-api[13572]: 2017-09-28 12:58:33.355 13572 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:58:33 ctl02 nova-api[13572]: 2017-09-28 12:58:33.355 13572 ERROR nova
Sep 28 12:58:33 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:58:33 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:58:33 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:58:33 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:58:33 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:58:33 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:58:33 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:58:33 ctl02 glance-api[29183]: 2017-09-28 12:58:33.704 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:58:33] "OPTIONS / HTTP/1.0" 200 134 0.001081
Sep 28 12:58:33 ctl02 heat-api[13008]: 2017-09-28 12:58:33.749 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:58:33] "OPTIONS / HTTP/1.0" 200 134 0.000603
Sep 28 12:58:34 ctl02 neutron-server[30536]: 2017-09-28 12:58:34.866 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:58:34] "OPTIONS / HTTP/1.0" 200 262 0.000473
Sep 28 12:58:35 ctl02 nova-api[13590]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:58:35 ctl02 nova-api[13590]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:58:35 ctl02 heat-api-cfn[13300]: 2017-09-28 12:58:35.433 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:58:35] "OPTIONS / HTTP/1.0" 200 134 0.000483
Sep 28 12:58:35 ctl02 nova-api[13590]: 2017-09-28 12:58:35.522 13590 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:58:35 ctl02 nova-api[13590]: 2017-09-28 12:58:35.523 13590 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:58:35 ctl02 nova-api[13590]: 2017-09-28 12:58:35.523 13590 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:58:35 ctl02 nova-api[13590]: 2017-09-28 12:58:35.523 13590 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:58:35 ctl02 nova-api[13590]: 2017-09-28 12:58:35.523 13590 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:58:35 ctl02 nova-api[13590]: 2017-09-28 12:58:35.523 13590 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:58:35 ctl02 nova-api[13590]: 2017-09-28 12:58:35.523 13590 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:58:35 ctl02 nova-api[13590]: 2017-09-28 12:58:35.523 13590 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:58:35 ctl02 nova-api[13590]: 2017-09-28 12:58:35.523 13590 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:58:35 ctl02 nova-api[13590]: 2017-09-28 12:58:35.523 13590 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:58:35 ctl02 nova-api[13590]: 2017-09-28 12:58:35.523 13590 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:58:35 ctl02 nova-api[13590]: 2017-09-28 12:58:35.523 13590 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:58:35 ctl02 nova-api[13590]: 2017-09-28 12:58:35.523 13590 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:58:35 ctl02 nova-api[13590]: 2017-09-28 12:58:35.523 13590 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:58:35 ctl02 nova-api[13590]: 2017-09-28 12:58:35.523 13590 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:58:35 ctl02 nova-api[13590]: 2017-09-28 12:58:35.523 13590 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:58:35 ctl02 nova-api[13590]: 2017-09-28 12:58:35.523 13590 ERROR nova.wsgi     self.filename))
Sep 28 12:58:35 ctl02 nova-api[13590]: 2017-09-28 12:58:35.523 13590 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:58:35 ctl02 nova-api[13590]: 2017-09-28 12:58:35.523 13590 ERROR nova.wsgi
Sep 28 12:58:35 ctl02 nova-api[13590]: 2017-09-28 12:58:35.525 13590 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:58:35 ctl02 nova-api[13590]: 2017-09-28 12:58:35.653 13590 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:58:35 ctl02 nova-api[13590]: 2017-09-28 12:58:35.878 13590 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:58:35 ctl02 nova-api[13590]: 2017-09-28 12:58:35.881 13590 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:58:35 ctl02 nova-api[13590]: 2017-09-28 12:58:35.881 13590 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:58:35 ctl02 nova-api[13590]: 2017-09-28 12:58:35.882 13590 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:58:36 ctl02 nova-api[13590]: 2017-09-28 12:58:36.012 13590 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:58:36 ctl02 nova-api[13590]: 2017-09-28 12:58:36.014 13590 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:58:36 ctl02 nova-api[13590]: 2017-09-28 12:58:36.015 13590 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:58:36 ctl02 nova-api[13590]: 2017-09-28 12:58:36.015 13590 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:58:36 ctl02 nova-api[13590]: 2017-09-28 12:58:36.018 13590 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:58:36 ctl02 nova-api[13590]: 2017-09-28 12:58:36.019 13590 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:58:36 ctl02 nova-api[13590]: 2017-09-28 12:58:36.019 13590 ERROR nova Traceback (most recent call last):
Sep 28 12:58:36 ctl02 nova-api[13590]: 2017-09-28 12:58:36.019 13590 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:58:36 ctl02 nova-api[13590]: 2017-09-28 12:58:36.019 13590 ERROR nova     sys.exit(main())
Sep 28 12:58:36 ctl02 nova-api[13590]: 2017-09-28 12:58:36.019 13590 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:58:36 ctl02 nova-api[13590]: 2017-09-28 12:58:36.019 13590 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:58:36 ctl02 nova-api[13590]: 2017-09-28 12:58:36.019 13590 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:58:36 ctl02 nova-api[13590]: 2017-09-28 12:58:36.019 13590 ERROR nova     max_url_len=max_url_len)
Sep 28 12:58:36 ctl02 nova-api[13590]: 2017-09-28 12:58:36.019 13590 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:58:36 ctl02 nova-api[13590]: 2017-09-28 12:58:36.019 13590 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:58:36 ctl02 nova-api[13590]: 2017-09-28 12:58:36.019 13590 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:58:36 ctl02 nova-api[13590]: 2017-09-28 12:58:36.019 13590 ERROR nova     sock.listen(backlog)
Sep 28 12:58:36 ctl02 nova-api[13590]: 2017-09-28 12:58:36.019 13590 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:58:36 ctl02 nova-api[13590]: 2017-09-28 12:58:36.019 13590 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:58:36 ctl02 nova-api[13590]: 2017-09-28 12:58:36.019 13590 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:58:36 ctl02 nova-api[13590]: 2017-09-28 12:58:36.019 13590 ERROR nova
Sep 28 12:58:36 ctl02 neutron-server[30536]: 2017-09-28 12:58:36.080 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 2 dead agents out of 6:
Sep 28 12:58:36 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:58:36 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:57:06 cmp002
Sep 28 12:58:36 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:58:00 cmp002
Sep 28 12:58:36 ctl02 heat-api-cfn[13300]: 2017-09-28 12:58:36.081 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:58:36] "OPTIONS / HTTP/1.0" 200 134 0.000605
Sep 28 12:58:36 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:58:36 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:58:36 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:58:36 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:58:36.169 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:58:36] "OPTIONS / HTTP/1.0" 200 134 0.000498
Sep 28 12:58:36 ctl02 neutron-server[30536]: 2017-09-28 12:58:36.255 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:58:36] "OPTIONS / HTTP/1.0" 200 262 0.000613
Sep 28 12:58:36 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:58:36 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:58:36 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:58:36 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:58:38 ctl02 heat-api[13008]: 2017-09-28 12:58:38.059 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:58:38] "OPTIONS / HTTP/1.0" 200 134 0.000612
Sep 28 12:58:38 ctl02 nova-api[13608]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:58:38 ctl02 nova-api[13608]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:58:38 ctl02 nova-api[13608]: 2017-09-28 12:58:38.266 13608 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:58:38 ctl02 nova-api[13608]: 2017-09-28 12:58:38.267 13608 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:58:38 ctl02 nova-api[13608]: 2017-09-28 12:58:38.267 13608 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:58:38 ctl02 nova-api[13608]: 2017-09-28 12:58:38.267 13608 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:58:38 ctl02 nova-api[13608]: 2017-09-28 12:58:38.267 13608 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:58:38 ctl02 nova-api[13608]: 2017-09-28 12:58:38.267 13608 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:58:38 ctl02 nova-api[13608]: 2017-09-28 12:58:38.267 13608 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:58:38 ctl02 nova-api[13608]: 2017-09-28 12:58:38.267 13608 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:58:38 ctl02 nova-api[13608]: 2017-09-28 12:58:38.267 13608 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:58:38 ctl02 nova-api[13608]: 2017-09-28 12:58:38.267 13608 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:58:38 ctl02 nova-api[13608]: 2017-09-28 12:58:38.267 13608 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:58:38 ctl02 nova-api[13608]: 2017-09-28 12:58:38.267 13608 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:58:38 ctl02 nova-api[13608]: 2017-09-28 12:58:38.267 13608 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:58:38 ctl02 nova-api[13608]: 2017-09-28 12:58:38.267 13608 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:58:38 ctl02 nova-api[13608]: 2017-09-28 12:58:38.267 13608 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:58:38 ctl02 nova-api[13608]: 2017-09-28 12:58:38.267 13608 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:58:38 ctl02 nova-api[13608]: 2017-09-28 12:58:38.267 13608 ERROR nova.wsgi     self.filename))
Sep 28 12:58:38 ctl02 nova-api[13608]: 2017-09-28 12:58:38.267 13608 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:58:38 ctl02 nova-api[13608]: 2017-09-28 12:58:38.267 13608 ERROR nova.wsgi
Sep 28 12:58:38 ctl02 nova-api[13608]: 2017-09-28 12:58:38.270 13608 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:58:38 ctl02 nova-api[13608]: 2017-09-28 12:58:38.407 13608 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:58:38 ctl02 nova-api[13608]: 2017-09-28 12:58:38.661 13608 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:58:38 ctl02 nova-api[13608]: 2017-09-28 12:58:38.664 13608 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:58:38 ctl02 nova-api[13608]: 2017-09-28 12:58:38.664 13608 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:58:38 ctl02 nova-api[13608]: 2017-09-28 12:58:38.664 13608 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:58:38 ctl02 nova-api[13608]: 2017-09-28 12:58:38.798 13608 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:58:38 ctl02 nova-api[13608]: 2017-09-28 12:58:38.800 13608 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:58:38 ctl02 nova-api[13608]: 2017-09-28 12:58:38.800 13608 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:58:38 ctl02 nova-api[13608]: 2017-09-28 12:58:38.801 13608 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:58:38 ctl02 nova-api[13608]: 2017-09-28 12:58:38.804 13608 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:58:38 ctl02 nova-api[13608]: 2017-09-28 12:58:38.804 13608 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:58:38 ctl02 nova-api[13608]: 2017-09-28 12:58:38.804 13608 ERROR nova Traceback (most recent call last):
Sep 28 12:58:38 ctl02 nova-api[13608]: 2017-09-28 12:58:38.804 13608 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:58:38 ctl02 nova-api[13608]: 2017-09-28 12:58:38.804 13608 ERROR nova     sys.exit(main())
Sep 28 12:58:38 ctl02 nova-api[13608]: 2017-09-28 12:58:38.804 13608 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:58:38 ctl02 nova-api[13608]: 2017-09-28 12:58:38.804 13608 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:58:38 ctl02 nova-api[13608]: 2017-09-28 12:58:38.804 13608 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:58:38 ctl02 nova-api[13608]: 2017-09-28 12:58:38.804 13608 ERROR nova     max_url_len=max_url_len)
Sep 28 12:58:38 ctl02 nova-api[13608]: 2017-09-28 12:58:38.804 13608 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:58:38 ctl02 nova-api[13608]: 2017-09-28 12:58:38.804 13608 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:58:38 ctl02 nova-api[13608]: 2017-09-28 12:58:38.804 13608 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:58:38 ctl02 nova-api[13608]: 2017-09-28 12:58:38.804 13608 ERROR nova     sock.listen(backlog)
Sep 28 12:58:38 ctl02 nova-api[13608]: 2017-09-28 12:58:38.804 13608 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:58:38 ctl02 nova-api[13608]: 2017-09-28 12:58:38.804 13608 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:58:38 ctl02 nova-api[13608]: 2017-09-28 12:58:38.804 13608 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:58:38 ctl02 nova-api[13608]: 2017-09-28 12:58:38.804 13608 ERROR nova
Sep 28 12:58:38 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:58:38 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:58:38 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:58:39 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:58:39.103 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:58:39] "OPTIONS / HTTP/1.0" 200 134 0.000483
Sep 28 12:58:39 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:58:39 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:58:39 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:58:39 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:58:39 ctl02 glance-api[29183]: 2017-09-28 12:58:39.309 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:58:39] "OPTIONS / HTTP/1.0" 200 134 0.000739
Sep 28 12:58:39 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb3ab5531)
Sep 28 12:58:39 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:58:39.662 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:58:39] "OPTIONS / HTTP/1.0" 200 134 0.000428
Sep 28 12:58:39 ctl02 heat-api-cfn[13300]: 2017-09-28 12:58:39.812 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:58:39] "OPTIONS / HTTP/1.0" 200 134 0.000491
Sep 28 12:58:40 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb3ab5531)
Sep 28 12:58:40 ctl02 nova-api[13625]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:58:40 ctl02 nova-api[13625]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:58:41 ctl02 nova-api[13625]: 2017-09-28 12:58:41.028 13625 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:58:41 ctl02 nova-api[13625]: 2017-09-28 12:58:41.030 13625 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:58:41 ctl02 nova-api[13625]: 2017-09-28 12:58:41.030 13625 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:58:41 ctl02 nova-api[13625]: 2017-09-28 12:58:41.030 13625 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:58:41 ctl02 nova-api[13625]: 2017-09-28 12:58:41.030 13625 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:58:41 ctl02 nova-api[13625]: 2017-09-28 12:58:41.030 13625 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:58:41 ctl02 nova-api[13625]: 2017-09-28 12:58:41.030 13625 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:58:41 ctl02 nova-api[13625]: 2017-09-28 12:58:41.030 13625 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:58:41 ctl02 nova-api[13625]: 2017-09-28 12:58:41.030 13625 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:58:41 ctl02 nova-api[13625]: 2017-09-28 12:58:41.030 13625 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:58:41 ctl02 nova-api[13625]: 2017-09-28 12:58:41.030 13625 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:58:41 ctl02 nova-api[13625]: 2017-09-28 12:58:41.030 13625 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:58:41 ctl02 nova-api[13625]: 2017-09-28 12:58:41.030 13625 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:58:41 ctl02 nova-api[13625]: 2017-09-28 12:58:41.030 13625 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:58:41 ctl02 nova-api[13625]: 2017-09-28 12:58:41.030 13625 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:58:41 ctl02 nova-api[13625]: 2017-09-28 12:58:41.030 13625 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:58:41 ctl02 nova-api[13625]: 2017-09-28 12:58:41.030 13625 ERROR nova.wsgi     self.filename))
Sep 28 12:58:41 ctl02 nova-api[13625]: 2017-09-28 12:58:41.030 13625 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:58:41 ctl02 nova-api[13625]: 2017-09-28 12:58:41.030 13625 ERROR nova.wsgi
Sep 28 12:58:41 ctl02 nova-api[13625]: 2017-09-28 12:58:41.032 13625 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:58:41 ctl02 nova-api[13625]: 2017-09-28 12:58:41.175 13625 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:58:41 ctl02 neutron-server[30536]: 2017-09-28 12:58:41.244 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:58:41] "OPTIONS / HTTP/1.0" 200 262 0.000483
Sep 28 12:58:41 ctl02 nova-api[13625]: 2017-09-28 12:58:41.408 13625 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:58:41 ctl02 nova-api[13625]: 2017-09-28 12:58:41.410 13625 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:58:41 ctl02 nova-api[13625]: 2017-09-28 12:58:41.410 13625 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:58:41 ctl02 nova-api[13625]: 2017-09-28 12:58:41.410 13625 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:58:41 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb3ab5531)
Sep 28 12:58:41 ctl02 heat-api[13008]: 2017-09-28 12:58:41.499 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:58:41] "OPTIONS / HTTP/1.0" 200 134 0.000552
Sep 28 12:58:41 ctl02 nova-api[13625]: 2017-09-28 12:58:41.541 13625 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:58:41 ctl02 nova-api[13625]: 2017-09-28 12:58:41.543 13625 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:58:41 ctl02 nova-api[13625]: 2017-09-28 12:58:41.543 13625 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:58:41 ctl02 nova-api[13625]: 2017-09-28 12:58:41.543 13625 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:58:41 ctl02 nova-api[13625]: 2017-09-28 12:58:41.547 13625 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:58:41 ctl02 nova-api[13625]: 2017-09-28 12:58:41.547 13625 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:58:41 ctl02 nova-api[13625]: 2017-09-28 12:58:41.547 13625 ERROR nova Traceback (most recent call last):
Sep 28 12:58:41 ctl02 nova-api[13625]: 2017-09-28 12:58:41.547 13625 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:58:41 ctl02 nova-api[13625]: 2017-09-28 12:58:41.547 13625 ERROR nova     sys.exit(main())
Sep 28 12:58:41 ctl02 nova-api[13625]: 2017-09-28 12:58:41.547 13625 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:58:41 ctl02 nova-api[13625]: 2017-09-28 12:58:41.547 13625 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:58:41 ctl02 nova-api[13625]: 2017-09-28 12:58:41.547 13625 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:58:41 ctl02 nova-api[13625]: 2017-09-28 12:58:41.547 13625 ERROR nova     max_url_len=max_url_len)
Sep 28 12:58:41 ctl02 nova-api[13625]: 2017-09-28 12:58:41.547 13625 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:58:41 ctl02 nova-api[13625]: 2017-09-28 12:58:41.547 13625 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:58:41 ctl02 nova-api[13625]: 2017-09-28 12:58:41.547 13625 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:58:41 ctl02 nova-api[13625]: 2017-09-28 12:58:41.547 13625 ERROR nova     sock.listen(backlog)
Sep 28 12:58:41 ctl02 nova-api[13625]: 2017-09-28 12:58:41.547 13625 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:58:41 ctl02 nova-api[13625]: 2017-09-28 12:58:41.547 13625 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:58:41 ctl02 nova-api[13625]: 2017-09-28 12:58:41.547 13625 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:58:41 ctl02 nova-api[13625]: 2017-09-28 12:58:41.547 13625 ERROR nova
Sep 28 12:58:41 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:58:41 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:58:41 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:58:41 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:58:41 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:58:41 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:58:41 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:58:42 ctl02 glance-api[29183]: 2017-09-28 12:58:42.388 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:58:42] "OPTIONS / HTTP/1.0" 200 134 0.000579
Sep 28 12:58:42 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb3ab5531)
Sep 28 12:58:43 ctl02 glance-api[29183]: 2017-09-28 12:58:43.323 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:58:43] "OPTIONS / HTTP/1.0" 200 134 0.000619
Sep 28 12:58:43 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb3ab5531)
Sep 28 12:58:43 ctl02 heat-api[13008]: 2017-09-28 12:58:43.490 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:58:43] "OPTIONS / HTTP/1.0" 200 134 0.000514
Sep 28 12:58:43 ctl02 nova-api[13644]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:58:43 ctl02 nova-api[13644]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:58:43 ctl02 nova-api[13644]: 2017-09-28 12:58:43.728 13644 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:58:43 ctl02 nova-api[13644]: 2017-09-28 12:58:43.730 13644 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:58:43 ctl02 nova-api[13644]: 2017-09-28 12:58:43.730 13644 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:58:43 ctl02 nova-api[13644]: 2017-09-28 12:58:43.730 13644 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:58:43 ctl02 nova-api[13644]: 2017-09-28 12:58:43.730 13644 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:58:43 ctl02 nova-api[13644]: 2017-09-28 12:58:43.730 13644 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:58:43 ctl02 nova-api[13644]: 2017-09-28 12:58:43.730 13644 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:58:43 ctl02 nova-api[13644]: 2017-09-28 12:58:43.730 13644 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:58:43 ctl02 nova-api[13644]: 2017-09-28 12:58:43.730 13644 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:58:43 ctl02 nova-api[13644]: 2017-09-28 12:58:43.730 13644 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:58:43 ctl02 nova-api[13644]: 2017-09-28 12:58:43.730 13644 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:58:43 ctl02 nova-api[13644]: 2017-09-28 12:58:43.730 13644 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:58:43 ctl02 nova-api[13644]: 2017-09-28 12:58:43.730 13644 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:58:43 ctl02 nova-api[13644]: 2017-09-28 12:58:43.730 13644 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:58:43 ctl02 nova-api[13644]: 2017-09-28 12:58:43.730 13644 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:58:43 ctl02 nova-api[13644]: 2017-09-28 12:58:43.730 13644 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:58:43 ctl02 nova-api[13644]: 2017-09-28 12:58:43.730 13644 ERROR nova.wsgi     self.filename))
Sep 28 12:58:43 ctl02 nova-api[13644]: 2017-09-28 12:58:43.730 13644 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:58:43 ctl02 nova-api[13644]: 2017-09-28 12:58:43.730 13644 ERROR nova.wsgi
Sep 28 12:58:43 ctl02 nova-api[13644]: 2017-09-28 12:58:43.732 13644 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:58:43 ctl02 nova-api[13644]: 2017-09-28 12:58:43.860 13644 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:58:44 ctl02 nova-api[13644]: 2017-09-28 12:58:44.082 13644 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:58:44 ctl02 nova-api[13644]: 2017-09-28 12:58:44.085 13644 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:58:44 ctl02 nova-api[13644]: 2017-09-28 12:58:44.085 13644 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:58:44 ctl02 nova-api[13644]: 2017-09-28 12:58:44.086 13644 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:58:44 ctl02 nova-api[13644]: 2017-09-28 12:58:44.215 13644 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:58:44 ctl02 nova-api[13644]: 2017-09-28 12:58:44.218 13644 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:58:44 ctl02 nova-api[13644]: 2017-09-28 12:58:44.218 13644 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:58:44 ctl02 nova-api[13644]: 2017-09-28 12:58:44.218 13644 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:58:44 ctl02 nova-api[13644]: 2017-09-28 12:58:44.222 13644 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:58:44 ctl02 nova-api[13644]: 2017-09-28 12:58:44.222 13644 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:58:44 ctl02 nova-api[13644]: 2017-09-28 12:58:44.222 13644 ERROR nova Traceback (most recent call last):
Sep 28 12:58:44 ctl02 nova-api[13644]: 2017-09-28 12:58:44.222 13644 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:58:44 ctl02 nova-api[13644]: 2017-09-28 12:58:44.222 13644 ERROR nova     sys.exit(main())
Sep 28 12:58:44 ctl02 nova-api[13644]: 2017-09-28 12:58:44.222 13644 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:58:44 ctl02 nova-api[13644]: 2017-09-28 12:58:44.222 13644 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:58:44 ctl02 nova-api[13644]: 2017-09-28 12:58:44.222 13644 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:58:44 ctl02 nova-api[13644]: 2017-09-28 12:58:44.222 13644 ERROR nova     max_url_len=max_url_len)
Sep 28 12:58:44 ctl02 nova-api[13644]: 2017-09-28 12:58:44.222 13644 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:58:44 ctl02 nova-api[13644]: 2017-09-28 12:58:44.222 13644 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:58:44 ctl02 nova-api[13644]: 2017-09-28 12:58:44.222 13644 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:58:44 ctl02 nova-api[13644]: 2017-09-28 12:58:44.222 13644 ERROR nova     sock.listen(backlog)
Sep 28 12:58:44 ctl02 nova-api[13644]: 2017-09-28 12:58:44.222 13644 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:58:44 ctl02 nova-api[13644]: 2017-09-28 12:58:44.222 13644 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:58:44 ctl02 nova-api[13644]: 2017-09-28 12:58:44.222 13644 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:58:44 ctl02 nova-api[13644]: 2017-09-28 12:58:44.222 13644 ERROR nova
Sep 28 12:58:44 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:58:44 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:58:44 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:58:44 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb3ab5531)
Sep 28 12:58:44 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:58:44 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:58:44 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:58:44 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:58:44 ctl02 neutron-server[30536]: 2017-09-28 12:58:44.959 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:58:44] "OPTIONS / HTTP/1.0" 200 262 0.000494
Sep 28 12:58:45 ctl02 heat-api-cfn[13300]: 2017-09-28 12:58:45.254 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:58:45] "OPTIONS / HTTP/1.0" 200 134 0.000526
Sep 28 12:58:45 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb3ab5531)
Sep 28 12:58:46 ctl02 nova-api[13662]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:58:46 ctl02 nova-api[13662]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:58:46 ctl02 neutron-server[30536]: 2017-09-28 12:58:46.353 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:58:46] "OPTIONS / HTTP/1.0" 200 262 0.000464
Sep 28 12:58:46 ctl02 heat-api-cfn[13300]: 2017-09-28 12:58:46.461 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:58:46] "OPTIONS / HTTP/1.0" 200 134 0.000597
Sep 28 12:58:46 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:58:46.463 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:58:46] "OPTIONS / HTTP/1.0" 200 134 0.000464
Sep 28 12:58:46 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb3ab5531)
Sep 28 12:58:46 ctl02 nova-api[13662]: 2017-09-28 12:58:46.510 13662 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:58:46 ctl02 nova-api[13662]: 2017-09-28 12:58:46.511 13662 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:58:46 ctl02 nova-api[13662]: 2017-09-28 12:58:46.511 13662 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:58:46 ctl02 nova-api[13662]: 2017-09-28 12:58:46.511 13662 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:58:46 ctl02 nova-api[13662]: 2017-09-28 12:58:46.511 13662 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:58:46 ctl02 nova-api[13662]: 2017-09-28 12:58:46.511 13662 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:58:46 ctl02 nova-api[13662]: 2017-09-28 12:58:46.511 13662 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:58:46 ctl02 nova-api[13662]: 2017-09-28 12:58:46.511 13662 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:58:46 ctl02 nova-api[13662]: 2017-09-28 12:58:46.511 13662 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:58:46 ctl02 nova-api[13662]: 2017-09-28 12:58:46.511 13662 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:58:46 ctl02 nova-api[13662]: 2017-09-28 12:58:46.511 13662 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:58:46 ctl02 nova-api[13662]: 2017-09-28 12:58:46.511 13662 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:58:46 ctl02 nova-api[13662]: 2017-09-28 12:58:46.511 13662 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:58:46 ctl02 nova-api[13662]: 2017-09-28 12:58:46.511 13662 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:58:46 ctl02 nova-api[13662]: 2017-09-28 12:58:46.511 13662 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:58:46 ctl02 nova-api[13662]: 2017-09-28 12:58:46.511 13662 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:58:46 ctl02 nova-api[13662]: 2017-09-28 12:58:46.511 13662 ERROR nova.wsgi     self.filename))
Sep 28 12:58:46 ctl02 nova-api[13662]: 2017-09-28 12:58:46.511 13662 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:58:46 ctl02 nova-api[13662]: 2017-09-28 12:58:46.511 13662 ERROR nova.wsgi
Sep 28 12:58:46 ctl02 nova-api[13662]: 2017-09-28 12:58:46.512 13662 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:58:46 ctl02 nova-api[13662]: 2017-09-28 12:58:46.642 13662 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:58:46 ctl02 nova-api[13662]: 2017-09-28 12:58:46.869 13662 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:58:46 ctl02 nova-api[13662]: 2017-09-28 12:58:46.872 13662 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:58:46 ctl02 nova-api[13662]: 2017-09-28 12:58:46.872 13662 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:58:46 ctl02 nova-api[13662]: 2017-09-28 12:58:46.872 13662 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:58:47 ctl02 nova-api[13662]: 2017-09-28 12:58:47.004 13662 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:58:47 ctl02 nova-api[13662]: 2017-09-28 12:58:47.006 13662 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:58:47 ctl02 nova-api[13662]: 2017-09-28 12:58:47.006 13662 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:58:47 ctl02 nova-api[13662]: 2017-09-28 12:58:47.007 13662 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:58:47 ctl02 nova-api[13662]: 2017-09-28 12:58:47.010 13662 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:58:47 ctl02 nova-api[13662]: 2017-09-28 12:58:47.010 13662 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:58:47 ctl02 nova-api[13662]: 2017-09-28 12:58:47.010 13662 ERROR nova Traceback (most recent call last):
Sep 28 12:58:47 ctl02 nova-api[13662]: 2017-09-28 12:58:47.010 13662 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:58:47 ctl02 nova-api[13662]: 2017-09-28 12:58:47.010 13662 ERROR nova     sys.exit(main())
Sep 28 12:58:47 ctl02 nova-api[13662]: 2017-09-28 12:58:47.010 13662 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:58:47 ctl02 nova-api[13662]: 2017-09-28 12:58:47.010 13662 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:58:47 ctl02 nova-api[13662]: 2017-09-28 12:58:47.010 13662 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:58:47 ctl02 nova-api[13662]: 2017-09-28 12:58:47.010 13662 ERROR nova     max_url_len=max_url_len)
Sep 28 12:58:47 ctl02 nova-api[13662]: 2017-09-28 12:58:47.010 13662 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:58:47 ctl02 nova-api[13662]: 2017-09-28 12:58:47.010 13662 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:58:47 ctl02 nova-api[13662]: 2017-09-28 12:58:47.010 13662 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:58:47 ctl02 nova-api[13662]: 2017-09-28 12:58:47.010 13662 ERROR nova     sock.listen(backlog)
Sep 28 12:58:47 ctl02 nova-api[13662]: 2017-09-28 12:58:47.010 13662 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:58:47 ctl02 nova-api[13662]: 2017-09-28 12:58:47.010 13662 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:58:47 ctl02 nova-api[13662]: 2017-09-28 12:58:47.010 13662 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:58:47 ctl02 nova-api[13662]: 2017-09-28 12:58:47.010 13662 ERROR nova
Sep 28 12:58:47 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:58:47 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:58:47 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:58:47 ctl02 nova-conductor[5056]: 2017-09-28 12:58:47.232 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:58:47 ctl02 nova-conductor[5056]: 2017-09-28 12:58:47.237 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:58:47 ctl02 nova-conductor[5056]: 2017-09-28 12:58:47.237 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:58:47 ctl02 nova-conductor[5056]: 2017-09-28 12:58:47.248 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:58:47 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:58:47 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:58:47 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:58:47 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:58:47 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb3ab5531)
Sep 28 12:58:47 ctl02 nova-cert[4860]: 2017-09-28 12:58:47.744 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:58:48 ctl02 heat-api[13008]: 2017-09-28 12:58:48.276 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:58:48] "OPTIONS / HTTP/1.0" 200 134 0.000568
Sep 28 12:58:48 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb3ab5531)
Sep 28 12:58:48 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:58:48.982 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:58:48] "OPTIONS / HTTP/1.0" 200 134 0.000360
Sep 28 12:58:49 ctl02 nova-api[13679]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:58:49 ctl02 nova-api[13679]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:58:49 ctl02 nova-api[13679]: 2017-09-28 12:58:49.287 13679 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:58:49 ctl02 nova-api[13679]: 2017-09-28 12:58:49.288 13679 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:58:49 ctl02 nova-api[13679]: 2017-09-28 12:58:49.288 13679 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:58:49 ctl02 nova-api[13679]: 2017-09-28 12:58:49.288 13679 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:58:49 ctl02 nova-api[13679]: 2017-09-28 12:58:49.288 13679 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:58:49 ctl02 nova-api[13679]: 2017-09-28 12:58:49.288 13679 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:58:49 ctl02 nova-api[13679]: 2017-09-28 12:58:49.288 13679 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:58:49 ctl02 nova-api[13679]: 2017-09-28 12:58:49.288 13679 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:58:49 ctl02 nova-api[13679]: 2017-09-28 12:58:49.288 13679 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:58:49 ctl02 nova-api[13679]: 2017-09-28 12:58:49.288 13679 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:58:49 ctl02 nova-api[13679]: 2017-09-28 12:58:49.288 13679 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:58:49 ctl02 nova-api[13679]: 2017-09-28 12:58:49.288 13679 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:58:49 ctl02 nova-api[13679]: 2017-09-28 12:58:49.288 13679 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:58:49 ctl02 nova-api[13679]: 2017-09-28 12:58:49.288 13679 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:58:49 ctl02 nova-api[13679]: 2017-09-28 12:58:49.288 13679 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:58:49 ctl02 nova-api[13679]: 2017-09-28 12:58:49.288 13679 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:58:49 ctl02 nova-api[13679]: 2017-09-28 12:58:49.288 13679 ERROR nova.wsgi     self.filename))
Sep 28 12:58:49 ctl02 nova-api[13679]: 2017-09-28 12:58:49.288 13679 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:58:49 ctl02 nova-api[13679]: 2017-09-28 12:58:49.288 13679 ERROR nova.wsgi
Sep 28 12:58:49 ctl02 nova-api[13679]: 2017-09-28 12:58:49.291 13679 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:58:49 ctl02 nova-api[13679]: 2017-09-28 12:58:49.419 13679 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:58:49 ctl02 glance-api[29183]: 2017-09-28 12:58:49.433 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:58:49] "OPTIONS / HTTP/1.0" 200 134 0.000564
Sep 28 12:58:49 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb3ab5531)
Sep 28 12:58:49 ctl02 nova-api[13679]: 2017-09-28 12:58:49.649 13679 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:58:49 ctl02 nova-api[13679]: 2017-09-28 12:58:49.651 13679 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:58:49 ctl02 nova-api[13679]: 2017-09-28 12:58:49.651 13679 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:58:49 ctl02 nova-api[13679]: 2017-09-28 12:58:49.651 13679 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:58:49 ctl02 nova-api[13679]: 2017-09-28 12:58:49.779 13679 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:58:49 ctl02 nova-api[13679]: 2017-09-28 12:58:49.781 13679 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:58:49 ctl02 nova-api[13679]: 2017-09-28 12:58:49.781 13679 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:58:49 ctl02 nova-api[13679]: 2017-09-28 12:58:49.782 13679 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:58:49 ctl02 nova-api[13679]: 2017-09-28 12:58:49.785 13679 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:58:49 ctl02 nova-api[13679]: 2017-09-28 12:58:49.785 13679 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:58:49 ctl02 nova-api[13679]: 2017-09-28 12:58:49.785 13679 ERROR nova Traceback (most recent call last):
Sep 28 12:58:49 ctl02 nova-api[13679]: 2017-09-28 12:58:49.785 13679 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:58:49 ctl02 nova-api[13679]: 2017-09-28 12:58:49.785 13679 ERROR nova     sys.exit(main())
Sep 28 12:58:49 ctl02 nova-api[13679]: 2017-09-28 12:58:49.785 13679 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:58:49 ctl02 nova-api[13679]: 2017-09-28 12:58:49.785 13679 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:58:49 ctl02 nova-api[13679]: 2017-09-28 12:58:49.785 13679 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:58:49 ctl02 nova-api[13679]: 2017-09-28 12:58:49.785 13679 ERROR nova     max_url_len=max_url_len)
Sep 28 12:58:49 ctl02 nova-api[13679]: 2017-09-28 12:58:49.785 13679 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:58:49 ctl02 nova-api[13679]: 2017-09-28 12:58:49.785 13679 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:58:49 ctl02 nova-api[13679]: 2017-09-28 12:58:49.785 13679 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:58:49 ctl02 nova-api[13679]: 2017-09-28 12:58:49.785 13679 ERROR nova     sock.listen(backlog)
Sep 28 12:58:49 ctl02 nova-api[13679]: 2017-09-28 12:58:49.785 13679 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:58:49 ctl02 nova-api[13679]: 2017-09-28 12:58:49.785 13679 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:58:49 ctl02 nova-api[13679]: 2017-09-28 12:58:49.785 13679 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:58:49 ctl02 nova-api[13679]: 2017-09-28 12:58:49.785 13679 ERROR nova
Sep 28 12:58:49 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:58:49 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:58:49 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:58:49 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:58:49.937 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:58:49] "OPTIONS / HTTP/1.0" 200 134 0.000540
Sep 28 12:58:50 ctl02 heat-api-cfn[13300]: 2017-09-28 12:58:50.054 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:58:50] "OPTIONS / HTTP/1.0" 200 134 0.000556
Sep 28 12:58:50 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:58:50 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:58:50 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:58:50 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:58:50 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:58:50 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:58:51 ctl02 neutron-server[30536]: 2017-09-28 12:58:51.076 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 2 dead agents out of 6:
Sep 28 12:58:51 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:58:51 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:57:06 cmp002
Sep 28 12:58:51 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:58:00 cmp002
Sep 28 12:58:51 ctl02 heat-api[13008]: 2017-09-28 12:58:51.231 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:58:51] "OPTIONS / HTTP/1.0" 200 134 0.000533
Sep 28 12:58:51 ctl02 neutron-server[30536]: 2017-09-28 12:58:51.471 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:58:51] "OPTIONS / HTTP/1.0" 200 262 0.000436
Sep 28 12:58:51 ctl02 nova-api[13699]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:58:51 ctl02 nova-api[13699]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:58:51 ctl02 nova-api[13699]: 2017-09-28 12:58:51.984 13699 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:58:51 ctl02 nova-api[13699]: 2017-09-28 12:58:51.985 13699 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:58:51 ctl02 nova-api[13699]: 2017-09-28 12:58:51.985 13699 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:58:51 ctl02 nova-api[13699]: 2017-09-28 12:58:51.985 13699 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:58:51 ctl02 nova-api[13699]: 2017-09-28 12:58:51.985 13699 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:58:51 ctl02 nova-api[13699]: 2017-09-28 12:58:51.985 13699 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:58:51 ctl02 nova-api[13699]: 2017-09-28 12:58:51.985 13699 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:58:51 ctl02 nova-api[13699]: 2017-09-28 12:58:51.985 13699 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:58:51 ctl02 nova-api[13699]: 2017-09-28 12:58:51.985 13699 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:58:51 ctl02 nova-api[13699]: 2017-09-28 12:58:51.985 13699 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:58:51 ctl02 nova-api[13699]: 2017-09-28 12:58:51.985 13699 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:58:51 ctl02 nova-api[13699]: 2017-09-28 12:58:51.985 13699 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:58:51 ctl02 nova-api[13699]: 2017-09-28 12:58:51.985 13699 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:58:51 ctl02 nova-api[13699]: 2017-09-28 12:58:51.985 13699 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:58:51 ctl02 nova-api[13699]: 2017-09-28 12:58:51.985 13699 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:58:51 ctl02 nova-api[13699]: 2017-09-28 12:58:51.985 13699 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:58:51 ctl02 nova-api[13699]: 2017-09-28 12:58:51.985 13699 ERROR nova.wsgi     self.filename))
Sep 28 12:58:51 ctl02 nova-api[13699]: 2017-09-28 12:58:51.985 13699 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:58:51 ctl02 nova-api[13699]: 2017-09-28 12:58:51.985 13699 ERROR nova.wsgi
Sep 28 12:58:51 ctl02 nova-api[13699]: 2017-09-28 12:58:51.986 13699 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:58:52 ctl02 nova-api[13699]: 2017-09-28 12:58:52.111 13699 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:58:52 ctl02 nova-api[13699]: 2017-09-28 12:58:52.334 13699 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:58:52 ctl02 nova-api[13699]: 2017-09-28 12:58:52.336 13699 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:58:52 ctl02 nova-api[13699]: 2017-09-28 12:58:52.336 13699 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:58:52 ctl02 nova-api[13699]: 2017-09-28 12:58:52.337 13699 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:58:52 ctl02 nova-api[13699]: 2017-09-28 12:58:52.467 13699 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:58:52 ctl02 nova-api[13699]: 2017-09-28 12:58:52.469 13699 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:58:52 ctl02 nova-api[13699]: 2017-09-28 12:58:52.469 13699 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:58:52 ctl02 nova-api[13699]: 2017-09-28 12:58:52.469 13699 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:58:52 ctl02 nova-api[13699]: 2017-09-28 12:58:52.472 13699 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:58:52 ctl02 nova-api[13699]: 2017-09-28 12:58:52.473 13699 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:58:52 ctl02 nova-api[13699]: 2017-09-28 12:58:52.473 13699 ERROR nova Traceback (most recent call last):
Sep 28 12:58:52 ctl02 nova-api[13699]: 2017-09-28 12:58:52.473 13699 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:58:52 ctl02 nova-api[13699]: 2017-09-28 12:58:52.473 13699 ERROR nova     sys.exit(main())
Sep 28 12:58:52 ctl02 nova-api[13699]: 2017-09-28 12:58:52.473 13699 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:58:52 ctl02 nova-api[13699]: 2017-09-28 12:58:52.473 13699 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:58:52 ctl02 nova-api[13699]: 2017-09-28 12:58:52.473 13699 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:58:52 ctl02 nova-api[13699]: 2017-09-28 12:58:52.473 13699 ERROR nova     max_url_len=max_url_len)
Sep 28 12:58:52 ctl02 nova-api[13699]: 2017-09-28 12:58:52.473 13699 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:58:52 ctl02 nova-api[13699]: 2017-09-28 12:58:52.473 13699 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:58:52 ctl02 nova-api[13699]: 2017-09-28 12:58:52.473 13699 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:58:52 ctl02 nova-api[13699]: 2017-09-28 12:58:52.473 13699 ERROR nova     sock.listen(backlog)
Sep 28 12:58:52 ctl02 nova-api[13699]: 2017-09-28 12:58:52.473 13699 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:58:52 ctl02 nova-api[13699]: 2017-09-28 12:58:52.473 13699 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:58:52 ctl02 nova-api[13699]: 2017-09-28 12:58:52.473 13699 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:58:52 ctl02 nova-api[13699]: 2017-09-28 12:58:52.473 13699 ERROR nova
Sep 28 12:58:52 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:58:52 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:58:52 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:58:52 ctl02 glance-api[29183]: 2017-09-28 12:58:52.625 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:58:52] "OPTIONS / HTTP/1.0" 200 134 0.000531
Sep 28 12:58:52 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:58:52 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:58:52 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:58:52 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:58:52 ctl02 glance-api[29183]: 2017-09-28 12:58:52.946 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:58:52] "OPTIONS / HTTP/1.0" 200 134 0.000762
Sep 28 12:58:53 ctl02 heat-api[13008]: 2017-09-28 12:58:53.249 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:58:53] "OPTIONS / HTTP/1.0" 200 134 0.000652
Sep 28 12:58:54 ctl02 nova-api[13722]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:58:54 ctl02 nova-api[13722]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:58:54 ctl02 nova-api[13722]: 2017-09-28 12:58:54.823 13722 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:58:54 ctl02 nova-api[13722]: 2017-09-28 12:58:54.825 13722 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:58:54 ctl02 nova-api[13722]: 2017-09-28 12:58:54.825 13722 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:58:54 ctl02 nova-api[13722]: 2017-09-28 12:58:54.825 13722 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:58:54 ctl02 nova-api[13722]: 2017-09-28 12:58:54.825 13722 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:58:54 ctl02 nova-api[13722]: 2017-09-28 12:58:54.825 13722 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:58:54 ctl02 nova-api[13722]: 2017-09-28 12:58:54.825 13722 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:58:54 ctl02 nova-api[13722]: 2017-09-28 12:58:54.825 13722 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:58:54 ctl02 nova-api[13722]: 2017-09-28 12:58:54.825 13722 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:58:54 ctl02 nova-api[13722]: 2017-09-28 12:58:54.825 13722 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:58:54 ctl02 nova-api[13722]: 2017-09-28 12:58:54.825 13722 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:58:54 ctl02 nova-api[13722]: 2017-09-28 12:58:54.825 13722 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:58:54 ctl02 nova-api[13722]: 2017-09-28 12:58:54.825 13722 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:58:54 ctl02 nova-api[13722]: 2017-09-28 12:58:54.825 13722 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:58:54 ctl02 nova-api[13722]: 2017-09-28 12:58:54.825 13722 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:58:54 ctl02 nova-api[13722]: 2017-09-28 12:58:54.825 13722 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:58:54 ctl02 nova-api[13722]: 2017-09-28 12:58:54.825 13722 ERROR nova.wsgi     self.filename))
Sep 28 12:58:54 ctl02 nova-api[13722]: 2017-09-28 12:58:54.825 13722 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:58:54 ctl02 nova-api[13722]: 2017-09-28 12:58:54.825 13722 ERROR nova.wsgi
Sep 28 12:58:54 ctl02 nova-api[13722]: 2017-09-28 12:58:54.827 13722 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:58:54 ctl02 heat-api-cfn[13300]: 2017-09-28 12:58:54.951 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:58:54] "OPTIONS / HTTP/1.0" 200 134 0.000518
Sep 28 12:58:54 ctl02 neutron-server[30536]: 2017-09-28 12:58:54.953 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:58:54] "OPTIONS / HTTP/1.0" 200 262 0.000554
Sep 28 12:58:54 ctl02 nova-api[13722]: 2017-09-28 12:58:54.963 13722 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:58:55 ctl02 nova-api[13722]: 2017-09-28 12:58:55.212 13722 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:58:55 ctl02 nova-api[13722]: 2017-09-28 12:58:55.215 13722 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:58:55 ctl02 nova-api[13722]: 2017-09-28 12:58:55.215 13722 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:58:55 ctl02 nova-api[13722]: 2017-09-28 12:58:55.215 13722 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:58:55 ctl02 nova-api[13722]: 2017-09-28 12:58:55.349 13722 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:58:55 ctl02 nova-api[13722]: 2017-09-28 12:58:55.352 13722 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:58:55 ctl02 nova-api[13722]: 2017-09-28 12:58:55.352 13722 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:58:55 ctl02 nova-api[13722]: 2017-09-28 12:58:55.353 13722 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:58:55 ctl02 nova-api[13722]: 2017-09-28 12:58:55.356 13722 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:58:55 ctl02 nova-api[13722]: 2017-09-28 12:58:55.357 13722 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:58:55 ctl02 nova-api[13722]: 2017-09-28 12:58:55.357 13722 ERROR nova Traceback (most recent call last):
Sep 28 12:58:55 ctl02 nova-api[13722]: 2017-09-28 12:58:55.357 13722 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:58:55 ctl02 nova-api[13722]: 2017-09-28 12:58:55.357 13722 ERROR nova     sys.exit(main())
Sep 28 12:58:55 ctl02 nova-api[13722]: 2017-09-28 12:58:55.357 13722 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:58:55 ctl02 nova-api[13722]: 2017-09-28 12:58:55.357 13722 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:58:55 ctl02 nova-api[13722]: 2017-09-28 12:58:55.357 13722 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:58:55 ctl02 nova-api[13722]: 2017-09-28 12:58:55.357 13722 ERROR nova     max_url_len=max_url_len)
Sep 28 12:58:55 ctl02 nova-api[13722]: 2017-09-28 12:58:55.357 13722 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:58:55 ctl02 nova-api[13722]: 2017-09-28 12:58:55.357 13722 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:58:55 ctl02 nova-api[13722]: 2017-09-28 12:58:55.357 13722 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:58:55 ctl02 nova-api[13722]: 2017-09-28 12:58:55.357 13722 ERROR nova     sock.listen(backlog)
Sep 28 12:58:55 ctl02 nova-api[13722]: 2017-09-28 12:58:55.357 13722 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:58:55 ctl02 nova-api[13722]: 2017-09-28 12:58:55.357 13722 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:58:55 ctl02 nova-api[13722]: 2017-09-28 12:58:55.357 13722 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:58:55 ctl02 nova-api[13722]: 2017-09-28 12:58:55.357 13722 ERROR nova
Sep 28 12:58:55 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:58:55 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:58:55 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:58:55 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:58:55 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:58:55 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:58:55 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:58:56 ctl02 neutron-server[30536]: 2017-09-28 12:58:56.285 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:58:56] "OPTIONS / HTTP/1.0" 200 262 0.000496
Sep 28 12:58:56 ctl02 heat-api-cfn[13300]: 2017-09-28 12:58:56.605 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:58:56] "OPTIONS / HTTP/1.0" 200 134 0.000491
Sep 28 12:58:56 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:58:56.838 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:58:56] "OPTIONS / HTTP/1.0" 200 134 0.000465
Sep 28 12:58:57 ctl02 nova-api[13740]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:58:57 ctl02 nova-api[13740]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:58:57 ctl02 nova-api[13740]: 2017-09-28 12:58:57.526 13740 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:58:57 ctl02 nova-api[13740]: 2017-09-28 12:58:57.528 13740 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:58:57 ctl02 nova-api[13740]: 2017-09-28 12:58:57.528 13740 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:58:57 ctl02 nova-api[13740]: 2017-09-28 12:58:57.528 13740 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:58:57 ctl02 nova-api[13740]: 2017-09-28 12:58:57.528 13740 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:58:57 ctl02 nova-api[13740]: 2017-09-28 12:58:57.528 13740 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:58:57 ctl02 nova-api[13740]: 2017-09-28 12:58:57.528 13740 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:58:57 ctl02 nova-api[13740]: 2017-09-28 12:58:57.528 13740 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:58:57 ctl02 nova-api[13740]: 2017-09-28 12:58:57.528 13740 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:58:57 ctl02 nova-api[13740]: 2017-09-28 12:58:57.528 13740 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:58:57 ctl02 nova-api[13740]: 2017-09-28 12:58:57.528 13740 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:58:57 ctl02 nova-api[13740]: 2017-09-28 12:58:57.528 13740 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:58:57 ctl02 nova-api[13740]: 2017-09-28 12:58:57.528 13740 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:58:57 ctl02 nova-api[13740]: 2017-09-28 12:58:57.528 13740 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:58:57 ctl02 nova-api[13740]: 2017-09-28 12:58:57.528 13740 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:58:57 ctl02 nova-api[13740]: 2017-09-28 12:58:57.528 13740 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:58:57 ctl02 nova-api[13740]: 2017-09-28 12:58:57.528 13740 ERROR nova.wsgi     self.filename))
Sep 28 12:58:57 ctl02 nova-api[13740]: 2017-09-28 12:58:57.528 13740 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:58:57 ctl02 nova-api[13740]: 2017-09-28 12:58:57.528 13740 ERROR nova.wsgi
Sep 28 12:58:57 ctl02 nova-api[13740]: 2017-09-28 12:58:57.529 13740 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:58:57 ctl02 nova-consoleauth[5433]: 2017-09-28 12:58:57.579 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:58:57 ctl02 nova-api[13740]: 2017-09-28 12:58:57.652 13740 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:58:57 ctl02 nova-api[13740]: 2017-09-28 12:58:57.871 13740 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:58:57 ctl02 nova-api[13740]: 2017-09-28 12:58:57.874 13740 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:58:57 ctl02 nova-api[13740]: 2017-09-28 12:58:57.874 13740 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:58:57 ctl02 nova-api[13740]: 2017-09-28 12:58:57.874 13740 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:58:58 ctl02 nova-api[13740]: 2017-09-28 12:58:58.004 13740 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:58:58 ctl02 nova-api[13740]: 2017-09-28 12:58:58.006 13740 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:58:58 ctl02 nova-api[13740]: 2017-09-28 12:58:58.006 13740 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:58:58 ctl02 nova-api[13740]: 2017-09-28 12:58:58.006 13740 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:58:58 ctl02 nova-api[13740]: 2017-09-28 12:58:58.009 13740 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:58:58 ctl02 nova-api[13740]: 2017-09-28 12:58:58.010 13740 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:58:58 ctl02 nova-api[13740]: 2017-09-28 12:58:58.010 13740 ERROR nova Traceback (most recent call last):
Sep 28 12:58:58 ctl02 nova-api[13740]: 2017-09-28 12:58:58.010 13740 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:58:58 ctl02 nova-api[13740]: 2017-09-28 12:58:58.010 13740 ERROR nova     sys.exit(main())
Sep 28 12:58:58 ctl02 nova-api[13740]: 2017-09-28 12:58:58.010 13740 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:58:58 ctl02 nova-api[13740]: 2017-09-28 12:58:58.010 13740 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:58:58 ctl02 nova-api[13740]: 2017-09-28 12:58:58.010 13740 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:58:58 ctl02 nova-api[13740]: 2017-09-28 12:58:58.010 13740 ERROR nova     max_url_len=max_url_len)
Sep 28 12:58:58 ctl02 nova-api[13740]: 2017-09-28 12:58:58.010 13740 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:58:58 ctl02 nova-api[13740]: 2017-09-28 12:58:58.010 13740 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:58:58 ctl02 nova-api[13740]: 2017-09-28 12:58:58.010 13740 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:58:58 ctl02 nova-api[13740]: 2017-09-28 12:58:58.010 13740 ERROR nova     sock.listen(backlog)
Sep 28 12:58:58 ctl02 nova-api[13740]: 2017-09-28 12:58:58.010 13740 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:58:58 ctl02 nova-api[13740]: 2017-09-28 12:58:58.010 13740 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:58:58 ctl02 nova-api[13740]: 2017-09-28 12:58:58.010 13740 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:58:58 ctl02 nova-api[13740]: 2017-09-28 12:58:58.010 13740 ERROR nova
Sep 28 12:58:58 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:58:58 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:58:58 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:58:58 ctl02 heat-engine[12803]: 2017-09-28 12:58:58.359 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:58:58 ctl02 heat-api[13008]: 2017-09-28 12:58:58.375 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:58:58] "OPTIONS / HTTP/1.0" 200 134 0.000754
Sep 28 12:58:58 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:58:58 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:58:58 ctl02 heat-engine[12803]: 2017-09-28 12:58:58.382 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:58:58 ctl02 heat-engine[12803]: 2017-09-28 12:58:58.385 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:58:58 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:58:58 ctl02 heat-engine[12803]: 2017-09-28 12:58:58.386 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:58:58 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:58:58 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:58:58.798 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:58:58] "OPTIONS / HTTP/1.0" 200 134 0.000458
Sep 28 12:58:59 ctl02 glance-api[29183]: 2017-09-28 12:58:59.314 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:58:59] "OPTIONS / HTTP/1.0" 200 134 0.000566
Sep 28 12:59:00 ctl02 nova-api[13758]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:59:00 ctl02 nova-api[13758]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:59:00 ctl02 nova-api[13758]: 2017-09-28 12:59:00.281 13758 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:59:00 ctl02 nova-api[13758]: 2017-09-28 12:59:00.282 13758 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:59:00 ctl02 nova-api[13758]: 2017-09-28 12:59:00.282 13758 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:59:00 ctl02 nova-api[13758]: 2017-09-28 12:59:00.282 13758 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:59:00 ctl02 nova-api[13758]: 2017-09-28 12:59:00.282 13758 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:59:00 ctl02 nova-api[13758]: 2017-09-28 12:59:00.282 13758 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:59:00 ctl02 nova-api[13758]: 2017-09-28 12:59:00.282 13758 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:59:00 ctl02 nova-api[13758]: 2017-09-28 12:59:00.282 13758 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:59:00 ctl02 nova-api[13758]: 2017-09-28 12:59:00.282 13758 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:59:00 ctl02 nova-api[13758]: 2017-09-28 12:59:00.282 13758 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:59:00 ctl02 nova-api[13758]: 2017-09-28 12:59:00.282 13758 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:59:00 ctl02 nova-api[13758]: 2017-09-28 12:59:00.282 13758 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:59:00 ctl02 nova-api[13758]: 2017-09-28 12:59:00.282 13758 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:59:00 ctl02 nova-api[13758]: 2017-09-28 12:59:00.282 13758 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:59:00 ctl02 nova-api[13758]: 2017-09-28 12:59:00.282 13758 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:59:00 ctl02 nova-api[13758]: 2017-09-28 12:59:00.282 13758 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:59:00 ctl02 nova-api[13758]: 2017-09-28 12:59:00.282 13758 ERROR nova.wsgi     self.filename))
Sep 28 12:59:00 ctl02 nova-api[13758]: 2017-09-28 12:59:00.282 13758 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:59:00 ctl02 nova-api[13758]: 2017-09-28 12:59:00.282 13758 ERROR nova.wsgi
Sep 28 12:59:00 ctl02 nova-api[13758]: 2017-09-28 12:59:00.283 13758 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:59:00 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:59:00.319 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:59:00] "OPTIONS / HTTP/1.0" 200 134 0.000420
Sep 28 12:59:00 ctl02 heat-api-cfn[13300]: 2017-09-28 12:59:00.371 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:59:00] "OPTIONS / HTTP/1.0" 200 134 0.000454
Sep 28 12:59:00 ctl02 nova-api[13758]: 2017-09-28 12:59:00.413 13758 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:59:00 ctl02 nova-api[13758]: 2017-09-28 12:59:00.632 13758 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:59:00 ctl02 nova-api[13758]: 2017-09-28 12:59:00.634 13758 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:59:00 ctl02 nova-api[13758]: 2017-09-28 12:59:00.635 13758 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:59:00 ctl02 nova-api[13758]: 2017-09-28 12:59:00.635 13758 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:59:00 ctl02 nova-scheduler[5620]: 2017-09-28 12:59:00.688 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:59:00 ctl02 nova-api[13758]: 2017-09-28 12:59:00.766 13758 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:59:00 ctl02 nova-api[13758]: 2017-09-28 12:59:00.768 13758 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:59:00 ctl02 nova-api[13758]: 2017-09-28 12:59:00.768 13758 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:59:00 ctl02 nova-api[13758]: 2017-09-28 12:59:00.768 13758 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:59:00 ctl02 nova-api[13758]: 2017-09-28 12:59:00.772 13758 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:59:00 ctl02 nova-api[13758]: 2017-09-28 12:59:00.772 13758 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:59:00 ctl02 nova-api[13758]: 2017-09-28 12:59:00.772 13758 ERROR nova Traceback (most recent call last):
Sep 28 12:59:00 ctl02 nova-api[13758]: 2017-09-28 12:59:00.772 13758 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:59:00 ctl02 nova-api[13758]: 2017-09-28 12:59:00.772 13758 ERROR nova     sys.exit(main())
Sep 28 12:59:00 ctl02 nova-api[13758]: 2017-09-28 12:59:00.772 13758 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:59:00 ctl02 nova-api[13758]: 2017-09-28 12:59:00.772 13758 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:59:00 ctl02 nova-api[13758]: 2017-09-28 12:59:00.772 13758 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:59:00 ctl02 nova-api[13758]: 2017-09-28 12:59:00.772 13758 ERROR nova     max_url_len=max_url_len)
Sep 28 12:59:00 ctl02 nova-api[13758]: 2017-09-28 12:59:00.772 13758 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:59:00 ctl02 nova-api[13758]: 2017-09-28 12:59:00.772 13758 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:59:00 ctl02 nova-api[13758]: 2017-09-28 12:59:00.772 13758 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:59:00 ctl02 nova-api[13758]: 2017-09-28 12:59:00.772 13758 ERROR nova     sock.listen(backlog)
Sep 28 12:59:00 ctl02 nova-api[13758]: 2017-09-28 12:59:00.772 13758 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:59:00 ctl02 nova-api[13758]: 2017-09-28 12:59:00.772 13758 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:59:00 ctl02 nova-api[13758]: 2017-09-28 12:59:00.772 13758 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:59:00 ctl02 nova-api[13758]: 2017-09-28 12:59:00.772 13758 ERROR nova
Sep 28 12:59:00 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:59:00 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:59:00 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:59:01 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:59:01 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:59:01 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:59:01 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:59:01 ctl02 heat-api[13008]: 2017-09-28 12:59:01.204 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:59:01] "OPTIONS / HTTP/1.0" 200 134 0.000674
Sep 28 12:59:01 ctl02 neutron-server[30536]: 2017-09-28 12:59:01.447 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:59:01] "OPTIONS / HTTP/1.0" 200 262 0.000471
Sep 28 12:59:02 ctl02 nova-api[13776]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:59:02 ctl02 nova-api[13776]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:59:02 ctl02 glance-api[29183]: 2017-09-28 12:59:02.846 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:59:02] "OPTIONS / HTTP/1.0" 200 134 0.000598
Sep 28 12:59:02 ctl02 glance-api[29183]: 2017-09-28 12:59:02.917 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:59:02] "OPTIONS / HTTP/1.0" 200 134 0.000820
Sep 28 12:59:02 ctl02 nova-api[13776]: 2017-09-28 12:59:02.976 13776 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:59:02 ctl02 nova-api[13776]: 2017-09-28 12:59:02.978 13776 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:59:02 ctl02 nova-api[13776]: 2017-09-28 12:59:02.978 13776 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:59:02 ctl02 nova-api[13776]: 2017-09-28 12:59:02.978 13776 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:59:02 ctl02 nova-api[13776]: 2017-09-28 12:59:02.978 13776 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:59:02 ctl02 nova-api[13776]: 2017-09-28 12:59:02.978 13776 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:59:02 ctl02 nova-api[13776]: 2017-09-28 12:59:02.978 13776 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:59:02 ctl02 nova-api[13776]: 2017-09-28 12:59:02.978 13776 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:59:02 ctl02 nova-api[13776]: 2017-09-28 12:59:02.978 13776 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:59:02 ctl02 nova-api[13776]: 2017-09-28 12:59:02.978 13776 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:59:02 ctl02 nova-api[13776]: 2017-09-28 12:59:02.978 13776 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:59:02 ctl02 nova-api[13776]: 2017-09-28 12:59:02.978 13776 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:59:02 ctl02 nova-api[13776]: 2017-09-28 12:59:02.978 13776 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:59:02 ctl02 nova-api[13776]: 2017-09-28 12:59:02.978 13776 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:59:02 ctl02 nova-api[13776]: 2017-09-28 12:59:02.978 13776 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:59:02 ctl02 nova-api[13776]: 2017-09-28 12:59:02.978 13776 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:59:02 ctl02 nova-api[13776]: 2017-09-28 12:59:02.978 13776 ERROR nova.wsgi     self.filename))
Sep 28 12:59:02 ctl02 nova-api[13776]: 2017-09-28 12:59:02.978 13776 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:59:02 ctl02 nova-api[13776]: 2017-09-28 12:59:02.978 13776 ERROR nova.wsgi
Sep 28 12:59:02 ctl02 nova-api[13776]: 2017-09-28 12:59:02.978 13776 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:59:03 ctl02 heat-api[13008]: 2017-09-28 12:59:03.005 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:59:03] "OPTIONS / HTTP/1.0" 200 134 0.000557
Sep 28 12:59:03 ctl02 nova-api[13776]: 2017-09-28 12:59:03.103 13776 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:59:03 ctl02 nova-api[13776]: 2017-09-28 12:59:03.324 13776 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:59:03 ctl02 nova-api[13776]: 2017-09-28 12:59:03.326 13776 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:59:03 ctl02 nova-api[13776]: 2017-09-28 12:59:03.326 13776 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:59:03 ctl02 nova-api[13776]: 2017-09-28 12:59:03.326 13776 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:59:03 ctl02 nova-api[13776]: 2017-09-28 12:59:03.455 13776 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:59:03 ctl02 nova-api[13776]: 2017-09-28 12:59:03.457 13776 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:59:03 ctl02 nova-api[13776]: 2017-09-28 12:59:03.457 13776 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:59:03 ctl02 nova-api[13776]: 2017-09-28 12:59:03.457 13776 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:59:03 ctl02 nova-api[13776]: 2017-09-28 12:59:03.460 13776 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:59:03 ctl02 nova-api[13776]: 2017-09-28 12:59:03.461 13776 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:59:03 ctl02 nova-api[13776]: 2017-09-28 12:59:03.461 13776 ERROR nova Traceback (most recent call last):
Sep 28 12:59:03 ctl02 nova-api[13776]: 2017-09-28 12:59:03.461 13776 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:59:03 ctl02 nova-api[13776]: 2017-09-28 12:59:03.461 13776 ERROR nova     sys.exit(main())
Sep 28 12:59:03 ctl02 nova-api[13776]: 2017-09-28 12:59:03.461 13776 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:59:03 ctl02 nova-api[13776]: 2017-09-28 12:59:03.461 13776 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:59:03 ctl02 nova-api[13776]: 2017-09-28 12:59:03.461 13776 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:59:03 ctl02 nova-api[13776]: 2017-09-28 12:59:03.461 13776 ERROR nova     max_url_len=max_url_len)
Sep 28 12:59:03 ctl02 nova-api[13776]: 2017-09-28 12:59:03.461 13776 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:59:03 ctl02 nova-api[13776]: 2017-09-28 12:59:03.461 13776 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:59:03 ctl02 nova-api[13776]: 2017-09-28 12:59:03.461 13776 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:59:03 ctl02 nova-api[13776]: 2017-09-28 12:59:03.461 13776 ERROR nova     sock.listen(backlog)
Sep 28 12:59:03 ctl02 nova-api[13776]: 2017-09-28 12:59:03.461 13776 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:59:03 ctl02 nova-api[13776]: 2017-09-28 12:59:03.461 13776 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:59:03 ctl02 nova-api[13776]: 2017-09-28 12:59:03.461 13776 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:59:03 ctl02 nova-api[13776]: 2017-09-28 12:59:03.461 13776 ERROR nova
Sep 28 12:59:03 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:59:03 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:59:03 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:59:03 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:59:03 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:59:03 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:59:03 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:59:05 ctl02 heat-api-cfn[13300]: 2017-09-28 12:59:05.085 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:59:05] "OPTIONS / HTTP/1.0" 200 134 0.000528
Sep 28 12:59:05 ctl02 neutron-server[30536]: 2017-09-28 12:59:05.099 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:59:05] "OPTIONS / HTTP/1.0" 200 262 0.000460
Sep 28 12:59:05 ctl02 nova-api[13793]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:59:05 ctl02 nova-api[13793]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:59:05 ctl02 nova-api[13793]: 2017-09-28 12:59:05.699 13793 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:59:05 ctl02 nova-api[13793]: 2017-09-28 12:59:05.701 13793 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:59:05 ctl02 nova-api[13793]: 2017-09-28 12:59:05.701 13793 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:59:05 ctl02 nova-api[13793]: 2017-09-28 12:59:05.701 13793 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:59:05 ctl02 nova-api[13793]: 2017-09-28 12:59:05.701 13793 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:59:05 ctl02 nova-api[13793]: 2017-09-28 12:59:05.701 13793 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:59:05 ctl02 nova-api[13793]: 2017-09-28 12:59:05.701 13793 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:59:05 ctl02 nova-api[13793]: 2017-09-28 12:59:05.701 13793 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:59:05 ctl02 nova-api[13793]: 2017-09-28 12:59:05.701 13793 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:59:05 ctl02 nova-api[13793]: 2017-09-28 12:59:05.701 13793 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:59:05 ctl02 nova-api[13793]: 2017-09-28 12:59:05.701 13793 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:59:05 ctl02 nova-api[13793]: 2017-09-28 12:59:05.701 13793 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:59:05 ctl02 nova-api[13793]: 2017-09-28 12:59:05.701 13793 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:59:05 ctl02 nova-api[13793]: 2017-09-28 12:59:05.701 13793 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:59:05 ctl02 nova-api[13793]: 2017-09-28 12:59:05.701 13793 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:59:05 ctl02 nova-api[13793]: 2017-09-28 12:59:05.701 13793 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:59:05 ctl02 nova-api[13793]: 2017-09-28 12:59:05.701 13793 ERROR nova.wsgi     self.filename))
Sep 28 12:59:05 ctl02 nova-api[13793]: 2017-09-28 12:59:05.701 13793 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:59:05 ctl02 nova-api[13793]: 2017-09-28 12:59:05.701 13793 ERROR nova.wsgi
Sep 28 12:59:05 ctl02 nova-api[13793]: 2017-09-28 12:59:05.701 13793 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:59:05 ctl02 nova-api[13793]: 2017-09-28 12:59:05.829 13793 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:59:06 ctl02 nova-api[13793]: 2017-09-28 12:59:06.050 13793 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:59:06 ctl02 nova-api[13793]: 2017-09-28 12:59:06.052 13793 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:59:06 ctl02 nova-api[13793]: 2017-09-28 12:59:06.052 13793 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:59:06 ctl02 nova-api[13793]: 2017-09-28 12:59:06.053 13793 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:59:06 ctl02 neutron-server[30536]: 2017-09-28 12:59:06.072 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 2 dead agents out of 6:
Sep 28 12:59:06 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:59:06 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:57:06 cmp002
Sep 28 12:59:06 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:58:00 cmp002
Sep 28 12:59:06 ctl02 nova-api[13793]: 2017-09-28 12:59:06.208 13793 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:59:06 ctl02 nova-api[13793]: 2017-09-28 12:59:06.210 13793 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:59:06 ctl02 nova-api[13793]: 2017-09-28 12:59:06.210 13793 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:59:06 ctl02 nova-api[13793]: 2017-09-28 12:59:06.210 13793 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:59:06 ctl02 nova-api[13793]: 2017-09-28 12:59:06.213 13793 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:59:06 ctl02 nova-api[13793]: 2017-09-28 12:59:06.214 13793 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:59:06 ctl02 nova-api[13793]: 2017-09-28 12:59:06.214 13793 ERROR nova Traceback (most recent call last):
Sep 28 12:59:06 ctl02 nova-api[13793]: 2017-09-28 12:59:06.214 13793 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:59:06 ctl02 nova-api[13793]: 2017-09-28 12:59:06.214 13793 ERROR nova     sys.exit(main())
Sep 28 12:59:06 ctl02 nova-api[13793]: 2017-09-28 12:59:06.214 13793 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:59:06 ctl02 nova-api[13793]: 2017-09-28 12:59:06.214 13793 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:59:06 ctl02 nova-api[13793]: 2017-09-28 12:59:06.214 13793 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:59:06 ctl02 nova-api[13793]: 2017-09-28 12:59:06.214 13793 ERROR nova     max_url_len=max_url_len)
Sep 28 12:59:06 ctl02 nova-api[13793]: 2017-09-28 12:59:06.214 13793 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:59:06 ctl02 nova-api[13793]: 2017-09-28 12:59:06.214 13793 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:59:06 ctl02 nova-api[13793]: 2017-09-28 12:59:06.214 13793 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:59:06 ctl02 nova-api[13793]: 2017-09-28 12:59:06.214 13793 ERROR nova     sock.listen(backlog)
Sep 28 12:59:06 ctl02 nova-api[13793]: 2017-09-28 12:59:06.214 13793 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:59:06 ctl02 nova-api[13793]: 2017-09-28 12:59:06.214 13793 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:59:06 ctl02 nova-api[13793]: 2017-09-28 12:59:06.214 13793 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:59:06 ctl02 nova-api[13793]: 2017-09-28 12:59:06.214 13793 ERROR nova
Sep 28 12:59:06 ctl02 heat-api-cfn[13300]: 2017-09-28 12:59:06.286 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:59:06] "OPTIONS / HTTP/1.0" 200 134 0.000470
Sep 28 12:59:06 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:59:06 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:59:06 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:59:06 ctl02 neutron-server[30536]: 2017-09-28 12:59:06.506 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:59:06] "OPTIONS / HTTP/1.0" 200 262 0.000572
Sep 28 12:59:06 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:59:06 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:59:06 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:59:06 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:59:07 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:59:07.204 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:59:07] "OPTIONS / HTTP/1.0" 200 134 0.000447
Sep 28 12:59:08 ctl02 heat-api[13008]: 2017-09-28 12:59:08.112 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:59:08] "OPTIONS / HTTP/1.0" 200 134 0.000694
Sep 28 12:59:08 ctl02 nova-api[13812]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:59:08 ctl02 nova-api[13812]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:59:08 ctl02 nova-api[13812]: 2017-09-28 12:59:08.536 13812 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:59:08 ctl02 nova-api[13812]: 2017-09-28 12:59:08.538 13812 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:59:08 ctl02 nova-api[13812]: 2017-09-28 12:59:08.538 13812 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:59:08 ctl02 nova-api[13812]: 2017-09-28 12:59:08.538 13812 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:59:08 ctl02 nova-api[13812]: 2017-09-28 12:59:08.538 13812 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:59:08 ctl02 nova-api[13812]: 2017-09-28 12:59:08.538 13812 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:59:08 ctl02 nova-api[13812]: 2017-09-28 12:59:08.538 13812 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:59:08 ctl02 nova-api[13812]: 2017-09-28 12:59:08.538 13812 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:59:08 ctl02 nova-api[13812]: 2017-09-28 12:59:08.538 13812 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:59:08 ctl02 nova-api[13812]: 2017-09-28 12:59:08.538 13812 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:59:08 ctl02 nova-api[13812]: 2017-09-28 12:59:08.538 13812 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:59:08 ctl02 nova-api[13812]: 2017-09-28 12:59:08.538 13812 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:59:08 ctl02 nova-api[13812]: 2017-09-28 12:59:08.538 13812 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:59:08 ctl02 nova-api[13812]: 2017-09-28 12:59:08.538 13812 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:59:08 ctl02 nova-api[13812]: 2017-09-28 12:59:08.538 13812 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:59:08 ctl02 nova-api[13812]: 2017-09-28 12:59:08.538 13812 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:59:08 ctl02 nova-api[13812]: 2017-09-28 12:59:08.538 13812 ERROR nova.wsgi     self.filename))
Sep 28 12:59:08 ctl02 nova-api[13812]: 2017-09-28 12:59:08.538 13812 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:59:08 ctl02 nova-api[13812]: 2017-09-28 12:59:08.538 13812 ERROR nova.wsgi
Sep 28 12:59:08 ctl02 nova-api[13812]: 2017-09-28 12:59:08.539 13812 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:59:08 ctl02 nova-api[13812]: 2017-09-28 12:59:08.670 13812 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:59:08 ctl02 nova-api[13812]: 2017-09-28 12:59:08.918 13812 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:59:08 ctl02 nova-api[13812]: 2017-09-28 12:59:08.920 13812 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:59:08 ctl02 nova-api[13812]: 2017-09-28 12:59:08.920 13812 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:59:08 ctl02 nova-api[13812]: 2017-09-28 12:59:08.921 13812 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:59:09 ctl02 nova-api[13812]: 2017-09-28 12:59:09.054 13812 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:59:09 ctl02 nova-api[13812]: 2017-09-28 12:59:09.056 13812 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:59:09 ctl02 nova-api[13812]: 2017-09-28 12:59:09.056 13812 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:59:09 ctl02 nova-api[13812]: 2017-09-28 12:59:09.057 13812 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:59:09 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:59:09.060 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:59:09] "OPTIONS / HTTP/1.0" 200 134 0.000485
Sep 28 12:59:09 ctl02 nova-api[13812]: 2017-09-28 12:59:09.060 13812 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:59:09 ctl02 nova-api[13812]: 2017-09-28 12:59:09.060 13812 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:59:09 ctl02 nova-api[13812]: 2017-09-28 12:59:09.060 13812 ERROR nova Traceback (most recent call last):
Sep 28 12:59:09 ctl02 nova-api[13812]: 2017-09-28 12:59:09.060 13812 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:59:09 ctl02 nova-api[13812]: 2017-09-28 12:59:09.060 13812 ERROR nova     sys.exit(main())
Sep 28 12:59:09 ctl02 nova-api[13812]: 2017-09-28 12:59:09.060 13812 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:59:09 ctl02 nova-api[13812]: 2017-09-28 12:59:09.060 13812 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:59:09 ctl02 nova-api[13812]: 2017-09-28 12:59:09.060 13812 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:59:09 ctl02 nova-api[13812]: 2017-09-28 12:59:09.060 13812 ERROR nova     max_url_len=max_url_len)
Sep 28 12:59:09 ctl02 nova-api[13812]: 2017-09-28 12:59:09.060 13812 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:59:09 ctl02 nova-api[13812]: 2017-09-28 12:59:09.060 13812 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:59:09 ctl02 nova-api[13812]: 2017-09-28 12:59:09.060 13812 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:59:09 ctl02 nova-api[13812]: 2017-09-28 12:59:09.060 13812 ERROR nova     sock.listen(backlog)
Sep 28 12:59:09 ctl02 nova-api[13812]: 2017-09-28 12:59:09.060 13812 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:59:09 ctl02 nova-api[13812]: 2017-09-28 12:59:09.060 13812 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:59:09 ctl02 nova-api[13812]: 2017-09-28 12:59:09.060 13812 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:59:09 ctl02 nova-api[13812]: 2017-09-28 12:59:09.060 13812 ERROR nova
Sep 28 12:59:09 ctl02 glance-api[29183]: 2017-09-28 12:59:09.187 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:59:09] "OPTIONS / HTTP/1.0" 200 134 0.000964
Sep 28 12:59:09 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:59:09 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:59:09 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:59:09 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:59:09 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:59:09 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:59:09 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:59:09 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x36658f2d)
Sep 28 12:59:10 ctl02 heat-api-cfn[13300]: 2017-09-28 12:59:10.084 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:59:10] "OPTIONS / HTTP/1.0" 200 134 0.000515
Sep 28 12:59:10 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:59:10.409 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:59:10] "OPTIONS / HTTP/1.0" 200 134 0.000463
Sep 28 12:59:10 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x36658f2d)
Sep 28 12:59:11 ctl02 nova-api[13830]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:59:11 ctl02 nova-api[13830]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:59:11 ctl02 heat-api[13008]: 2017-09-28 12:59:11.151 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:59:11] "OPTIONS / HTTP/1.0" 200 134 0.000667
Sep 28 12:59:11 ctl02 nova-api[13830]: 2017-09-28 12:59:11.225 13830 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:59:11 ctl02 nova-api[13830]: 2017-09-28 12:59:11.226 13830 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:59:11 ctl02 nova-api[13830]: 2017-09-28 12:59:11.226 13830 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:59:11 ctl02 nova-api[13830]: 2017-09-28 12:59:11.226 13830 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:59:11 ctl02 nova-api[13830]: 2017-09-28 12:59:11.226 13830 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:59:11 ctl02 nova-api[13830]: 2017-09-28 12:59:11.226 13830 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:59:11 ctl02 nova-api[13830]: 2017-09-28 12:59:11.226 13830 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:59:11 ctl02 nova-api[13830]: 2017-09-28 12:59:11.226 13830 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:59:11 ctl02 nova-api[13830]: 2017-09-28 12:59:11.226 13830 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:59:11 ctl02 nova-api[13830]: 2017-09-28 12:59:11.226 13830 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:59:11 ctl02 nova-api[13830]: 2017-09-28 12:59:11.226 13830 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:59:11 ctl02 nova-api[13830]: 2017-09-28 12:59:11.226 13830 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:59:11 ctl02 nova-api[13830]: 2017-09-28 12:59:11.226 13830 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:59:11 ctl02 nova-api[13830]: 2017-09-28 12:59:11.226 13830 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:59:11 ctl02 nova-api[13830]: 2017-09-28 12:59:11.226 13830 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:59:11 ctl02 nova-api[13830]: 2017-09-28 12:59:11.226 13830 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:59:11 ctl02 nova-api[13830]: 2017-09-28 12:59:11.226 13830 ERROR nova.wsgi     self.filename))
Sep 28 12:59:11 ctl02 nova-api[13830]: 2017-09-28 12:59:11.226 13830 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:59:11 ctl02 nova-api[13830]: 2017-09-28 12:59:11.226 13830 ERROR nova.wsgi
Sep 28 12:59:11 ctl02 nova-api[13830]: 2017-09-28 12:59:11.227 13830 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:59:11 ctl02 nova-api[13830]: 2017-09-28 12:59:11.355 13830 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:59:11 ctl02 neutron-server[30536]: 2017-09-28 12:59:11.457 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:59:11] "OPTIONS / HTTP/1.0" 200 262 0.000636
Sep 28 12:59:11 ctl02 nova-api[13830]: 2017-09-28 12:59:11.576 13830 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:59:11 ctl02 nova-api[13830]: 2017-09-28 12:59:11.579 13830 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:59:11 ctl02 nova-api[13830]: 2017-09-28 12:59:11.579 13830 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:59:11 ctl02 nova-api[13830]: 2017-09-28 12:59:11.579 13830 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:59:11 ctl02 nova-api[13830]: 2017-09-28 12:59:11.708 13830 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:59:11 ctl02 nova-api[13830]: 2017-09-28 12:59:11.710 13830 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:59:11 ctl02 nova-api[13830]: 2017-09-28 12:59:11.710 13830 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:59:11 ctl02 nova-api[13830]: 2017-09-28 12:59:11.710 13830 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:59:11 ctl02 nova-api[13830]: 2017-09-28 12:59:11.713 13830 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:59:11 ctl02 nova-api[13830]: 2017-09-28 12:59:11.714 13830 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:59:11 ctl02 nova-api[13830]: 2017-09-28 12:59:11.714 13830 ERROR nova Traceback (most recent call last):
Sep 28 12:59:11 ctl02 nova-api[13830]: 2017-09-28 12:59:11.714 13830 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:59:11 ctl02 nova-api[13830]: 2017-09-28 12:59:11.714 13830 ERROR nova     sys.exit(main())
Sep 28 12:59:11 ctl02 nova-api[13830]: 2017-09-28 12:59:11.714 13830 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:59:11 ctl02 nova-api[13830]: 2017-09-28 12:59:11.714 13830 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:59:11 ctl02 nova-api[13830]: 2017-09-28 12:59:11.714 13830 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:59:11 ctl02 nova-api[13830]: 2017-09-28 12:59:11.714 13830 ERROR nova     max_url_len=max_url_len)
Sep 28 12:59:11 ctl02 nova-api[13830]: 2017-09-28 12:59:11.714 13830 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:59:11 ctl02 nova-api[13830]: 2017-09-28 12:59:11.714 13830 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:59:11 ctl02 nova-api[13830]: 2017-09-28 12:59:11.714 13830 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:59:11 ctl02 nova-api[13830]: 2017-09-28 12:59:11.714 13830 ERROR nova     sock.listen(backlog)
Sep 28 12:59:11 ctl02 nova-api[13830]: 2017-09-28 12:59:11.714 13830 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:59:11 ctl02 nova-api[13830]: 2017-09-28 12:59:11.714 13830 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:59:11 ctl02 nova-api[13830]: 2017-09-28 12:59:11.714 13830 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:59:11 ctl02 nova-api[13830]: 2017-09-28 12:59:11.714 13830 ERROR nova
Sep 28 12:59:11 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x36658f2d)
Sep 28 12:59:11 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:59:11 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:59:11 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:59:12 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:59:12 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:59:12 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:59:12 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:59:12 ctl02 glance-api[29183]: 2017-09-28 12:59:12.537 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:59:12] "OPTIONS / HTTP/1.0" 200 134 0.000555
Sep 28 12:59:12 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x36658f2d)
Sep 28 12:59:12 ctl02 glance-api[29183]: 2017-09-28 12:59:12.847 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:59:12] "OPTIONS / HTTP/1.0" 200 134 0.000585
Sep 28 12:59:13 ctl02 heat-api[13008]: 2017-09-28 12:59:13.215 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:59:13] "OPTIONS / HTTP/1.0" 200 134 0.000546
Sep 28 12:59:13 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x36658f2d)
Sep 28 12:59:13 ctl02 nova-api[13848]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:59:13 ctl02 nova-api[13848]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:59:13 ctl02 nova-api[13848]: 2017-09-28 12:59:13.991 13848 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:59:13 ctl02 nova-api[13848]: 2017-09-28 12:59:13.993 13848 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:59:13 ctl02 nova-api[13848]: 2017-09-28 12:59:13.993 13848 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:59:13 ctl02 nova-api[13848]: 2017-09-28 12:59:13.993 13848 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:59:13 ctl02 nova-api[13848]: 2017-09-28 12:59:13.993 13848 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:59:13 ctl02 nova-api[13848]: 2017-09-28 12:59:13.993 13848 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:59:13 ctl02 nova-api[13848]: 2017-09-28 12:59:13.993 13848 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:59:13 ctl02 nova-api[13848]: 2017-09-28 12:59:13.993 13848 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:59:13 ctl02 nova-api[13848]: 2017-09-28 12:59:13.993 13848 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:59:13 ctl02 nova-api[13848]: 2017-09-28 12:59:13.993 13848 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:59:13 ctl02 nova-api[13848]: 2017-09-28 12:59:13.993 13848 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:59:13 ctl02 nova-api[13848]: 2017-09-28 12:59:13.993 13848 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:59:13 ctl02 nova-api[13848]: 2017-09-28 12:59:13.993 13848 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:59:13 ctl02 nova-api[13848]: 2017-09-28 12:59:13.993 13848 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:59:13 ctl02 nova-api[13848]: 2017-09-28 12:59:13.993 13848 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:59:13 ctl02 nova-api[13848]: 2017-09-28 12:59:13.993 13848 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:59:13 ctl02 nova-api[13848]: 2017-09-28 12:59:13.993 13848 ERROR nova.wsgi     self.filename))
Sep 28 12:59:13 ctl02 nova-api[13848]: 2017-09-28 12:59:13.993 13848 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:59:13 ctl02 nova-api[13848]: 2017-09-28 12:59:13.993 13848 ERROR nova.wsgi
Sep 28 12:59:13 ctl02 nova-api[13848]: 2017-09-28 12:59:13.993 13848 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:59:14 ctl02 nova-api[13848]: 2017-09-28 12:59:14.121 13848 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:59:14 ctl02 nova-api[13848]: 2017-09-28 12:59:14.346 13848 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:59:14 ctl02 nova-api[13848]: 2017-09-28 12:59:14.348 13848 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:59:14 ctl02 nova-api[13848]: 2017-09-28 12:59:14.348 13848 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:59:14 ctl02 nova-api[13848]: 2017-09-28 12:59:14.349 13848 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:59:14 ctl02 nova-api[13848]: 2017-09-28 12:59:14.481 13848 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:59:14 ctl02 nova-api[13848]: 2017-09-28 12:59:14.482 13848 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:59:14 ctl02 nova-api[13848]: 2017-09-28 12:59:14.483 13848 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:59:14 ctl02 nova-api[13848]: 2017-09-28 12:59:14.483 13848 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:59:14 ctl02 nova-api[13848]: 2017-09-28 12:59:14.486 13848 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:59:14 ctl02 nova-api[13848]: 2017-09-28 12:59:14.486 13848 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:59:14 ctl02 nova-api[13848]: 2017-09-28 12:59:14.486 13848 ERROR nova Traceback (most recent call last):
Sep 28 12:59:14 ctl02 nova-api[13848]: 2017-09-28 12:59:14.486 13848 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:59:14 ctl02 nova-api[13848]: 2017-09-28 12:59:14.486 13848 ERROR nova     sys.exit(main())
Sep 28 12:59:14 ctl02 nova-api[13848]: 2017-09-28 12:59:14.486 13848 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:59:14 ctl02 nova-api[13848]: 2017-09-28 12:59:14.486 13848 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:59:14 ctl02 nova-api[13848]: 2017-09-28 12:59:14.486 13848 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:59:14 ctl02 nova-api[13848]: 2017-09-28 12:59:14.486 13848 ERROR nova     max_url_len=max_url_len)
Sep 28 12:59:14 ctl02 nova-api[13848]: 2017-09-28 12:59:14.486 13848 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:59:14 ctl02 nova-api[13848]: 2017-09-28 12:59:14.486 13848 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:59:14 ctl02 nova-api[13848]: 2017-09-28 12:59:14.486 13848 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:59:14 ctl02 nova-api[13848]: 2017-09-28 12:59:14.486 13848 ERROR nova     sock.listen(backlog)
Sep 28 12:59:14 ctl02 nova-api[13848]: 2017-09-28 12:59:14.486 13848 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:59:14 ctl02 nova-api[13848]: 2017-09-28 12:59:14.486 13848 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:59:14 ctl02 nova-api[13848]: 2017-09-28 12:59:14.486 13848 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:59:14 ctl02 nova-api[13848]: 2017-09-28 12:59:14.486 13848 ERROR nova
Sep 28 12:59:14 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:59:14 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:59:14 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:59:14 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x36658f2d)
Sep 28 12:59:14 ctl02 neutron-server[30536]: 2017-09-28 12:59:14.875 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:59:14] "OPTIONS / HTTP/1.0" 200 262 0.000947
Sep 28 12:59:14 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:59:14 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:59:14 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:59:14 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:59:15 ctl02 heat-api-cfn[13300]: 2017-09-28 12:59:15.466 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:59:15] "OPTIONS / HTTP/1.0" 200 134 0.000589
Sep 28 12:59:15 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x36658f2d)
Sep 28 12:59:15 ctl02 heat-api-cfn[13300]: 2017-09-28 12:59:15.937 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:59:15] "OPTIONS / HTTP/1.0" 200 134 0.000438
Sep 28 12:59:16 ctl02 neutron-server[30536]: 2017-09-28 12:59:16.354 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:59:16] "OPTIONS / HTTP/1.0" 200 262 0.000464
Sep 28 12:59:16 ctl02 nova-api[13866]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:59:16 ctl02 nova-api[13866]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:59:16 ctl02 nova-api[13866]: 2017-09-28 12:59:16.723 13866 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:59:16 ctl02 nova-api[13866]: 2017-09-28 12:59:16.724 13866 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:59:16 ctl02 nova-api[13866]: 2017-09-28 12:59:16.724 13866 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:59:16 ctl02 nova-api[13866]: 2017-09-28 12:59:16.724 13866 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:59:16 ctl02 nova-api[13866]: 2017-09-28 12:59:16.724 13866 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:59:16 ctl02 nova-api[13866]: 2017-09-28 12:59:16.724 13866 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:59:16 ctl02 nova-api[13866]: 2017-09-28 12:59:16.724 13866 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:59:16 ctl02 nova-api[13866]: 2017-09-28 12:59:16.724 13866 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:59:16 ctl02 nova-api[13866]: 2017-09-28 12:59:16.724 13866 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:59:16 ctl02 nova-api[13866]: 2017-09-28 12:59:16.724 13866 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:59:16 ctl02 nova-api[13866]: 2017-09-28 12:59:16.724 13866 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:59:16 ctl02 nova-api[13866]: 2017-09-28 12:59:16.724 13866 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:59:16 ctl02 nova-api[13866]: 2017-09-28 12:59:16.724 13866 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:59:16 ctl02 nova-api[13866]: 2017-09-28 12:59:16.724 13866 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:59:16 ctl02 nova-api[13866]: 2017-09-28 12:59:16.724 13866 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:59:16 ctl02 nova-api[13866]: 2017-09-28 12:59:16.724 13866 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:59:16 ctl02 nova-api[13866]: 2017-09-28 12:59:16.724 13866 ERROR nova.wsgi     self.filename))
Sep 28 12:59:16 ctl02 nova-api[13866]: 2017-09-28 12:59:16.724 13866 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:59:16 ctl02 nova-api[13866]: 2017-09-28 12:59:16.724 13866 ERROR nova.wsgi
Sep 28 12:59:16 ctl02 nova-api[13866]: 2017-09-28 12:59:16.725 13866 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:59:16 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x36658f2d)
Sep 28 12:59:16 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:59:16.846 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:59:16] "OPTIONS / HTTP/1.0" 200 134 0.000484
Sep 28 12:59:16 ctl02 nova-api[13866]: 2017-09-28 12:59:16.853 13866 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:59:17 ctl02 nova-api[13866]: 2017-09-28 12:59:17.080 13866 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:59:17 ctl02 nova-api[13866]: 2017-09-28 12:59:17.082 13866 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:59:17 ctl02 nova-api[13866]: 2017-09-28 12:59:17.083 13866 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:59:17 ctl02 nova-api[13866]: 2017-09-28 12:59:17.083 13866 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:59:17 ctl02 nova-api[13866]: 2017-09-28 12:59:17.218 13866 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:59:17 ctl02 nova-api[13866]: 2017-09-28 12:59:17.220 13866 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:59:17 ctl02 nova-api[13866]: 2017-09-28 12:59:17.220 13866 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:59:17 ctl02 nova-api[13866]: 2017-09-28 12:59:17.220 13866 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:59:17 ctl02 nova-api[13866]: 2017-09-28 12:59:17.223 13866 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:59:17 ctl02 nova-api[13866]: 2017-09-28 12:59:17.223 13866 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:59:17 ctl02 nova-api[13866]: 2017-09-28 12:59:17.223 13866 ERROR nova Traceback (most recent call last):
Sep 28 12:59:17 ctl02 nova-api[13866]: 2017-09-28 12:59:17.223 13866 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:59:17 ctl02 nova-api[13866]: 2017-09-28 12:59:17.223 13866 ERROR nova     sys.exit(main())
Sep 28 12:59:17 ctl02 nova-api[13866]: 2017-09-28 12:59:17.223 13866 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:59:17 ctl02 nova-api[13866]: 2017-09-28 12:59:17.223 13866 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:59:17 ctl02 nova-api[13866]: 2017-09-28 12:59:17.223 13866 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:59:17 ctl02 nova-api[13866]: 2017-09-28 12:59:17.223 13866 ERROR nova     max_url_len=max_url_len)
Sep 28 12:59:17 ctl02 nova-api[13866]: 2017-09-28 12:59:17.223 13866 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:59:17 ctl02 nova-api[13866]: 2017-09-28 12:59:17.223 13866 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:59:17 ctl02 nova-api[13866]: 2017-09-28 12:59:17.223 13866 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:59:17 ctl02 nova-api[13866]: 2017-09-28 12:59:17.223 13866 ERROR nova     sock.listen(backlog)
Sep 28 12:59:17 ctl02 nova-api[13866]: 2017-09-28 12:59:17.223 13866 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:59:17 ctl02 nova-api[13866]: 2017-09-28 12:59:17.223 13866 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:59:17 ctl02 nova-api[13866]: 2017-09-28 12:59:17.223 13866 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:59:17 ctl02 nova-api[13866]: 2017-09-28 12:59:17.223 13866 ERROR nova
Sep 28 12:59:17 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:59:17 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:59:17 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:59:17 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:59:17 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:59:17 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:59:17 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:59:17 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x36658f2d)
Sep 28 12:59:17 ctl02 heat-api[13008]: 2017-09-28 12:59:17.821 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:59:17] "OPTIONS / HTTP/1.0" 200 134 0.000540
Sep 28 12:59:18 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x36658f2d)
Sep 28 12:59:19 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:59:19.112 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:59:19] "OPTIONS / HTTP/1.0" 200 134 0.000507
Sep 28 12:59:19 ctl02 glance-api[29183]: 2017-09-28 12:59:19.179 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:59:19] "OPTIONS / HTTP/1.0" 200 134 0.000563
Sep 28 12:59:19 ctl02 nova-conductor[5056]: 2017-09-28 12:59:19.240 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:59:19 ctl02 nova-conductor[5056]: 2017-09-28 12:59:19.245 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:59:19 ctl02 nova-conductor[5056]: 2017-09-28 12:59:19.245 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:59:19 ctl02 nova-conductor[5056]: 2017-09-28 12:59:19.256 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:59:19 ctl02 nova-api[13884]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:59:19 ctl02 nova-api[13884]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:59:19 ctl02 nova-api[13884]: 2017-09-28 12:59:19.529 13884 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:59:19 ctl02 nova-api[13884]: 2017-09-28 12:59:19.530 13884 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:59:19 ctl02 nova-api[13884]: 2017-09-28 12:59:19.530 13884 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:59:19 ctl02 nova-api[13884]: 2017-09-28 12:59:19.530 13884 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:59:19 ctl02 nova-api[13884]: 2017-09-28 12:59:19.530 13884 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:59:19 ctl02 nova-api[13884]: 2017-09-28 12:59:19.530 13884 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:59:19 ctl02 nova-api[13884]: 2017-09-28 12:59:19.530 13884 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:59:19 ctl02 nova-api[13884]: 2017-09-28 12:59:19.530 13884 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:59:19 ctl02 nova-api[13884]: 2017-09-28 12:59:19.530 13884 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:59:19 ctl02 nova-api[13884]: 2017-09-28 12:59:19.530 13884 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:59:19 ctl02 nova-api[13884]: 2017-09-28 12:59:19.530 13884 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:59:19 ctl02 nova-api[13884]: 2017-09-28 12:59:19.530 13884 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:59:19 ctl02 nova-api[13884]: 2017-09-28 12:59:19.530 13884 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:59:19 ctl02 nova-api[13884]: 2017-09-28 12:59:19.530 13884 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:59:19 ctl02 nova-api[13884]: 2017-09-28 12:59:19.530 13884 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:59:19 ctl02 nova-api[13884]: 2017-09-28 12:59:19.530 13884 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:59:19 ctl02 nova-api[13884]: 2017-09-28 12:59:19.530 13884 ERROR nova.wsgi     self.filename))
Sep 28 12:59:19 ctl02 nova-api[13884]: 2017-09-28 12:59:19.530 13884 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:59:19 ctl02 nova-api[13884]: 2017-09-28 12:59:19.530 13884 ERROR nova.wsgi
Sep 28 12:59:19 ctl02 nova-api[13884]: 2017-09-28 12:59:19.531 13884 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:59:19 ctl02 nova-api[13884]: 2017-09-28 12:59:19.657 13884 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:59:19 ctl02 heat-api-cfn[13300]: 2017-09-28 12:59:19.727 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:59:19] "OPTIONS / HTTP/1.0" 200 134 0.000444
Sep 28 12:59:19 ctl02 nova-cert[4860]: 2017-09-28 12:59:19.778 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:59:19 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x36658f2d)
Sep 28 12:59:19 ctl02 nova-api[13884]: 2017-09-28 12:59:19.878 13884 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:59:19 ctl02 nova-api[13884]: 2017-09-28 12:59:19.880 13884 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:59:19 ctl02 nova-api[13884]: 2017-09-28 12:59:19.880 13884 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:59:19 ctl02 nova-api[13884]: 2017-09-28 12:59:19.880 13884 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:59:20 ctl02 nova-api[13884]: 2017-09-28 12:59:20.010 13884 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:59:20 ctl02 nova-api[13884]: 2017-09-28 12:59:20.012 13884 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:59:20 ctl02 nova-api[13884]: 2017-09-28 12:59:20.012 13884 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:59:20 ctl02 nova-api[13884]: 2017-09-28 12:59:20.012 13884 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:59:20 ctl02 nova-api[13884]: 2017-09-28 12:59:20.015 13884 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:59:20 ctl02 nova-api[13884]: 2017-09-28 12:59:20.016 13884 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:59:20 ctl02 nova-api[13884]: 2017-09-28 12:59:20.016 13884 ERROR nova Traceback (most recent call last):
Sep 28 12:59:20 ctl02 nova-api[13884]: 2017-09-28 12:59:20.016 13884 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:59:20 ctl02 nova-api[13884]: 2017-09-28 12:59:20.016 13884 ERROR nova     sys.exit(main())
Sep 28 12:59:20 ctl02 nova-api[13884]: 2017-09-28 12:59:20.016 13884 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:59:20 ctl02 nova-api[13884]: 2017-09-28 12:59:20.016 13884 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:59:20 ctl02 nova-api[13884]: 2017-09-28 12:59:20.016 13884 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:59:20 ctl02 nova-api[13884]: 2017-09-28 12:59:20.016 13884 ERROR nova     max_url_len=max_url_len)
Sep 28 12:59:20 ctl02 nova-api[13884]: 2017-09-28 12:59:20.016 13884 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:59:20 ctl02 nova-api[13884]: 2017-09-28 12:59:20.016 13884 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:59:20 ctl02 nova-api[13884]: 2017-09-28 12:59:20.016 13884 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:59:20 ctl02 nova-api[13884]: 2017-09-28 12:59:20.016 13884 ERROR nova     sock.listen(backlog)
Sep 28 12:59:20 ctl02 nova-api[13884]: 2017-09-28 12:59:20.016 13884 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:59:20 ctl02 nova-api[13884]: 2017-09-28 12:59:20.016 13884 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:59:20 ctl02 nova-api[13884]: 2017-09-28 12:59:20.016 13884 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:59:20 ctl02 nova-api[13884]: 2017-09-28 12:59:20.016 13884 ERROR nova
Sep 28 12:59:20 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:59:20 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:59:20 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:59:20 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:59:20 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:59:20 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:59:20 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:59:20 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:59:20.789 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:59:20] "OPTIONS / HTTP/1.0" 200 134 0.000380
Sep 28 12:59:20 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:59:20 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:59:21 ctl02 heat-api[13008]: 2017-09-28 12:59:21.060 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:59:21] "OPTIONS / HTTP/1.0" 200 134 0.000559
Sep 28 12:59:21 ctl02 neutron-server[30536]: 2017-09-28 12:59:21.067 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 12:59:21 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:59:21 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:58:38 cmp001
Sep 28 12:59:21 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:58:00 cmp002
Sep 28 12:59:21 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:58:46 cmp002
Sep 28 12:59:21 ctl02 neutron-server[30536]: 2017-09-28 12:59:21.859 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:59:21] "OPTIONS / HTTP/1.0" 200 262 0.000641
Sep 28 12:59:22 ctl02 nova-api[13902]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:59:22 ctl02 nova-api[13902]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:59:22 ctl02 glance-api[29183]: 2017-09-28 12:59:22.221 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:59:22] "OPTIONS / HTTP/1.0" 200 134 0.000612
Sep 28 12:59:22 ctl02 nova-api[13902]: 2017-09-28 12:59:22.246 13902 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:59:22 ctl02 nova-api[13902]: 2017-09-28 12:59:22.248 13902 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:59:22 ctl02 nova-api[13902]: 2017-09-28 12:59:22.248 13902 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:59:22 ctl02 nova-api[13902]: 2017-09-28 12:59:22.248 13902 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:59:22 ctl02 nova-api[13902]: 2017-09-28 12:59:22.248 13902 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:59:22 ctl02 nova-api[13902]: 2017-09-28 12:59:22.248 13902 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:59:22 ctl02 nova-api[13902]: 2017-09-28 12:59:22.248 13902 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:59:22 ctl02 nova-api[13902]: 2017-09-28 12:59:22.248 13902 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:59:22 ctl02 nova-api[13902]: 2017-09-28 12:59:22.248 13902 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:59:22 ctl02 nova-api[13902]: 2017-09-28 12:59:22.248 13902 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:59:22 ctl02 nova-api[13902]: 2017-09-28 12:59:22.248 13902 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:59:22 ctl02 nova-api[13902]: 2017-09-28 12:59:22.248 13902 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:59:22 ctl02 nova-api[13902]: 2017-09-28 12:59:22.248 13902 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:59:22 ctl02 nova-api[13902]: 2017-09-28 12:59:22.248 13902 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:59:22 ctl02 nova-api[13902]: 2017-09-28 12:59:22.248 13902 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:59:22 ctl02 nova-api[13902]: 2017-09-28 12:59:22.248 13902 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:59:22 ctl02 nova-api[13902]: 2017-09-28 12:59:22.248 13902 ERROR nova.wsgi     self.filename))
Sep 28 12:59:22 ctl02 nova-api[13902]: 2017-09-28 12:59:22.248 13902 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:59:22 ctl02 nova-api[13902]: 2017-09-28 12:59:22.248 13902 ERROR nova.wsgi
Sep 28 12:59:22 ctl02 nova-api[13902]: 2017-09-28 12:59:22.249 13902 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:59:22 ctl02 nova-api[13902]: 2017-09-28 12:59:22.375 13902 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:59:22 ctl02 nova-api[13902]: 2017-09-28 12:59:22.596 13902 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:59:22 ctl02 nova-api[13902]: 2017-09-28 12:59:22.598 13902 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:59:22 ctl02 nova-api[13902]: 2017-09-28 12:59:22.598 13902 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:59:22 ctl02 nova-api[13902]: 2017-09-28 12:59:22.598 13902 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:59:22 ctl02 nova-api[13902]: 2017-09-28 12:59:22.727 13902 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:59:22 ctl02 nova-api[13902]: 2017-09-28 12:59:22.728 13902 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:59:22 ctl02 nova-api[13902]: 2017-09-28 12:59:22.729 13902 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:59:22 ctl02 nova-api[13902]: 2017-09-28 12:59:22.729 13902 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:59:22 ctl02 nova-api[13902]: 2017-09-28 12:59:22.732 13902 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:59:22 ctl02 nova-api[13902]: 2017-09-28 12:59:22.732 13902 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:59:22 ctl02 nova-api[13902]: 2017-09-28 12:59:22.732 13902 ERROR nova Traceback (most recent call last):
Sep 28 12:59:22 ctl02 nova-api[13902]: 2017-09-28 12:59:22.732 13902 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:59:22 ctl02 nova-api[13902]: 2017-09-28 12:59:22.732 13902 ERROR nova     sys.exit(main())
Sep 28 12:59:22 ctl02 nova-api[13902]: 2017-09-28 12:59:22.732 13902 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:59:22 ctl02 nova-api[13902]: 2017-09-28 12:59:22.732 13902 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:59:22 ctl02 nova-api[13902]: 2017-09-28 12:59:22.732 13902 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:59:22 ctl02 nova-api[13902]: 2017-09-28 12:59:22.732 13902 ERROR nova     max_url_len=max_url_len)
Sep 28 12:59:22 ctl02 nova-api[13902]: 2017-09-28 12:59:22.732 13902 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:59:22 ctl02 nova-api[13902]: 2017-09-28 12:59:22.732 13902 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:59:22 ctl02 nova-api[13902]: 2017-09-28 12:59:22.732 13902 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:59:22 ctl02 nova-api[13902]: 2017-09-28 12:59:22.732 13902 ERROR nova     sock.listen(backlog)
Sep 28 12:59:22 ctl02 nova-api[13902]: 2017-09-28 12:59:22.732 13902 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:59:22 ctl02 nova-api[13902]: 2017-09-28 12:59:22.732 13902 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:59:22 ctl02 nova-api[13902]: 2017-09-28 12:59:22.732 13902 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:59:22 ctl02 nova-api[13902]: 2017-09-28 12:59:22.732 13902 ERROR nova
Sep 28 12:59:22 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:59:22 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:59:22 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:59:23 ctl02 glance-api[29183]: 2017-09-28 12:59:23.050 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:59:23] "OPTIONS / HTTP/1.0" 200 134 0.000751
Sep 28 12:59:23 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:59:23 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:59:23 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:59:23 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:59:23 ctl02 heat-api[13008]: 2017-09-28 12:59:23.231 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:59:23] "OPTIONS / HTTP/1.0" 200 134 0.000585
Sep 28 12:59:24 ctl02 neutron-server[30536]: 2017-09-28 12:59:24.637 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:59:24] "OPTIONS / HTTP/1.0" 200 262 0.000666
Sep 28 12:59:24 ctl02 nova-api[13924]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:59:24 ctl02 nova-api[13924]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:59:24 ctl02 nova-api[13924]: 2017-09-28 12:59:24.984 13924 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:59:24 ctl02 nova-api[13924]: 2017-09-28 12:59:24.985 13924 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:59:24 ctl02 nova-api[13924]: 2017-09-28 12:59:24.985 13924 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:59:24 ctl02 nova-api[13924]: 2017-09-28 12:59:24.985 13924 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:59:24 ctl02 nova-api[13924]: 2017-09-28 12:59:24.985 13924 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:59:24 ctl02 nova-api[13924]: 2017-09-28 12:59:24.985 13924 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:59:24 ctl02 nova-api[13924]: 2017-09-28 12:59:24.985 13924 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:59:24 ctl02 nova-api[13924]: 2017-09-28 12:59:24.985 13924 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:59:24 ctl02 nova-api[13924]: 2017-09-28 12:59:24.985 13924 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:59:24 ctl02 nova-api[13924]: 2017-09-28 12:59:24.985 13924 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:59:24 ctl02 nova-api[13924]: 2017-09-28 12:59:24.985 13924 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:59:24 ctl02 nova-api[13924]: 2017-09-28 12:59:24.985 13924 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:59:24 ctl02 nova-api[13924]: 2017-09-28 12:59:24.985 13924 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:59:24 ctl02 nova-api[13924]: 2017-09-28 12:59:24.985 13924 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:59:24 ctl02 nova-api[13924]: 2017-09-28 12:59:24.985 13924 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:59:24 ctl02 nova-api[13924]: 2017-09-28 12:59:24.985 13924 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:59:24 ctl02 nova-api[13924]: 2017-09-28 12:59:24.985 13924 ERROR nova.wsgi     self.filename))
Sep 28 12:59:24 ctl02 nova-api[13924]: 2017-09-28 12:59:24.985 13924 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:59:24 ctl02 nova-api[13924]: 2017-09-28 12:59:24.985 13924 ERROR nova.wsgi
Sep 28 12:59:24 ctl02 nova-api[13924]: 2017-09-28 12:59:24.987 13924 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:59:25 ctl02 nova-api[13924]: 2017-09-28 12:59:25.114 13924 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:59:25 ctl02 nova-api[13924]: 2017-09-28 12:59:25.338 13924 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:59:25 ctl02 nova-api[13924]: 2017-09-28 12:59:25.341 13924 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:59:25 ctl02 nova-api[13924]: 2017-09-28 12:59:25.341 13924 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:59:25 ctl02 nova-api[13924]: 2017-09-28 12:59:25.342 13924 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:59:25 ctl02 nova-api[13924]: 2017-09-28 12:59:25.471 13924 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:59:25 ctl02 nova-api[13924]: 2017-09-28 12:59:25.474 13924 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:59:25 ctl02 nova-api[13924]: 2017-09-28 12:59:25.474 13924 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:59:25 ctl02 nova-api[13924]: 2017-09-28 12:59:25.475 13924 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:59:25 ctl02 nova-api[13924]: 2017-09-28 12:59:25.478 13924 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:59:25 ctl02 nova-api[13924]: 2017-09-28 12:59:25.478 13924 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:59:25 ctl02 nova-api[13924]: 2017-09-28 12:59:25.478 13924 ERROR nova Traceback (most recent call last):
Sep 28 12:59:25 ctl02 nova-api[13924]: 2017-09-28 12:59:25.478 13924 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:59:25 ctl02 nova-api[13924]: 2017-09-28 12:59:25.478 13924 ERROR nova     sys.exit(main())
Sep 28 12:59:25 ctl02 nova-api[13924]: 2017-09-28 12:59:25.478 13924 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:59:25 ctl02 nova-api[13924]: 2017-09-28 12:59:25.478 13924 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:59:25 ctl02 nova-api[13924]: 2017-09-28 12:59:25.478 13924 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:59:25 ctl02 nova-api[13924]: 2017-09-28 12:59:25.478 13924 ERROR nova     max_url_len=max_url_len)
Sep 28 12:59:25 ctl02 nova-api[13924]: 2017-09-28 12:59:25.478 13924 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:59:25 ctl02 nova-api[13924]: 2017-09-28 12:59:25.478 13924 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:59:25 ctl02 nova-api[13924]: 2017-09-28 12:59:25.478 13924 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:59:25 ctl02 nova-api[13924]: 2017-09-28 12:59:25.478 13924 ERROR nova     sock.listen(backlog)
Sep 28 12:59:25 ctl02 nova-api[13924]: 2017-09-28 12:59:25.478 13924 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:59:25 ctl02 nova-api[13924]: 2017-09-28 12:59:25.478 13924 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:59:25 ctl02 nova-api[13924]: 2017-09-28 12:59:25.478 13924 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:59:25 ctl02 nova-api[13924]: 2017-09-28 12:59:25.478 13924 ERROR nova
Sep 28 12:59:25 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:59:25 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:59:25 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:59:25 ctl02 heat-api-cfn[13300]: 2017-09-28 12:59:25.713 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:59:25] "OPTIONS / HTTP/1.0" 200 134 0.000505
Sep 28 12:59:25 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:59:25 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:59:25 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:59:25 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:59:26 ctl02 neutron-server[30536]: 2017-09-28 12:59:26.077 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:59:26] "OPTIONS / HTTP/1.0" 200 262 0.000492
Sep 28 12:59:26 ctl02 heat-api-cfn[13300]: 2017-09-28 12:59:26.205 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:59:26] "OPTIONS / HTTP/1.0" 200 134 0.000470
Sep 28 12:59:26 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:59:26.966 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:59:26] "OPTIONS / HTTP/1.0" 200 134 0.000449
Sep 28 12:59:27 ctl02 nova-api[13943]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:59:27 ctl02 nova-api[13943]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:59:27 ctl02 heat-api[13008]: 2017-09-28 12:59:27.689 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:59:27] "OPTIONS / HTTP/1.0" 200 134 0.000589
Sep 28 12:59:27 ctl02 nova-api[13943]: 2017-09-28 12:59:27.786 13943 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:59:27 ctl02 nova-api[13943]: 2017-09-28 12:59:27.787 13943 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:59:27 ctl02 nova-api[13943]: 2017-09-28 12:59:27.787 13943 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:59:27 ctl02 nova-api[13943]: 2017-09-28 12:59:27.787 13943 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:59:27 ctl02 nova-api[13943]: 2017-09-28 12:59:27.787 13943 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:59:27 ctl02 nova-api[13943]: 2017-09-28 12:59:27.787 13943 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:59:27 ctl02 nova-api[13943]: 2017-09-28 12:59:27.787 13943 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:59:27 ctl02 nova-api[13943]: 2017-09-28 12:59:27.787 13943 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:59:27 ctl02 nova-api[13943]: 2017-09-28 12:59:27.787 13943 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:59:27 ctl02 nova-api[13943]: 2017-09-28 12:59:27.787 13943 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:59:27 ctl02 nova-api[13943]: 2017-09-28 12:59:27.787 13943 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:59:27 ctl02 nova-api[13943]: 2017-09-28 12:59:27.787 13943 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:59:27 ctl02 nova-api[13943]: 2017-09-28 12:59:27.787 13943 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:59:27 ctl02 nova-api[13943]: 2017-09-28 12:59:27.787 13943 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:59:27 ctl02 nova-api[13943]: 2017-09-28 12:59:27.787 13943 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:59:27 ctl02 nova-api[13943]: 2017-09-28 12:59:27.787 13943 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:59:27 ctl02 nova-api[13943]: 2017-09-28 12:59:27.787 13943 ERROR nova.wsgi     self.filename))
Sep 28 12:59:27 ctl02 nova-api[13943]: 2017-09-28 12:59:27.787 13943 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:59:27 ctl02 nova-api[13943]: 2017-09-28 12:59:27.787 13943 ERROR nova.wsgi
Sep 28 12:59:27 ctl02 nova-api[13943]: 2017-09-28 12:59:27.788 13943 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:59:27 ctl02 nova-api[13943]: 2017-09-28 12:59:27.919 13943 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:59:28 ctl02 nova-api[13943]: 2017-09-28 12:59:28.167 13943 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:59:28 ctl02 nova-api[13943]: 2017-09-28 12:59:28.169 13943 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:59:28 ctl02 nova-api[13943]: 2017-09-28 12:59:28.170 13943 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:59:28 ctl02 nova-api[13943]: 2017-09-28 12:59:28.170 13943 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:59:28 ctl02 nova-api[13943]: 2017-09-28 12:59:28.303 13943 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:59:28 ctl02 nova-api[13943]: 2017-09-28 12:59:28.306 13943 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:59:28 ctl02 nova-api[13943]: 2017-09-28 12:59:28.307 13943 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:59:28 ctl02 nova-api[13943]: 2017-09-28 12:59:28.307 13943 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:59:28 ctl02 nova-api[13943]: 2017-09-28 12:59:28.310 13943 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:59:28 ctl02 nova-api[13943]: 2017-09-28 12:59:28.311 13943 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:59:28 ctl02 nova-api[13943]: 2017-09-28 12:59:28.311 13943 ERROR nova Traceback (most recent call last):
Sep 28 12:59:28 ctl02 nova-api[13943]: 2017-09-28 12:59:28.311 13943 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:59:28 ctl02 nova-api[13943]: 2017-09-28 12:59:28.311 13943 ERROR nova     sys.exit(main())
Sep 28 12:59:28 ctl02 nova-api[13943]: 2017-09-28 12:59:28.311 13943 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:59:28 ctl02 nova-api[13943]: 2017-09-28 12:59:28.311 13943 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:59:28 ctl02 nova-api[13943]: 2017-09-28 12:59:28.311 13943 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:59:28 ctl02 nova-api[13943]: 2017-09-28 12:59:28.311 13943 ERROR nova     max_url_len=max_url_len)
Sep 28 12:59:28 ctl02 nova-api[13943]: 2017-09-28 12:59:28.311 13943 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:59:28 ctl02 nova-api[13943]: 2017-09-28 12:59:28.311 13943 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:59:28 ctl02 nova-api[13943]: 2017-09-28 12:59:28.311 13943 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:59:28 ctl02 nova-api[13943]: 2017-09-28 12:59:28.311 13943 ERROR nova     sock.listen(backlog)
Sep 28 12:59:28 ctl02 nova-api[13943]: 2017-09-28 12:59:28.311 13943 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:59:28 ctl02 nova-api[13943]: 2017-09-28 12:59:28.311 13943 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:59:28 ctl02 nova-api[13943]: 2017-09-28 12:59:28.311 13943 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:59:28 ctl02 nova-api[13943]: 2017-09-28 12:59:28.311 13943 ERROR nova
Sep 28 12:59:28 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:59:28 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:59:28 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:59:28 ctl02 neutron-server[30536]: 2017-09-28 12:59:28.550 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:59:28 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:59:28 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:59:28 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:59:28 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:59:28 ctl02 glance-api[29183]: 2017-09-28 12:59:28.856 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:59:28] "OPTIONS / HTTP/1.0" 200 134 0.000691
Sep 28 12:59:29 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:59:29.137 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:59:29] "OPTIONS / HTTP/1.0" 200 134 0.000478
Sep 28 12:59:29 ctl02 nova-consoleauth[5433]: 2017-09-28 12:59:29.616 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:59:29 ctl02 heat-api-cfn[13300]: 2017-09-28 12:59:29.685 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:59:29] "OPTIONS / HTTP/1.0" 200 134 0.000472
Sep 28 12:59:30 ctl02 nova-api[13961]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:59:30 ctl02 nova-api[13961]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:59:30 ctl02 heat-engine[12803]: 2017-09-28 12:59:30.368 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:59:30 ctl02 heat-engine[12803]: 2017-09-28 12:59:30.390 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:59:30 ctl02 heat-engine[12803]: 2017-09-28 12:59:30.395 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:59:30 ctl02 heat-engine[12803]: 2017-09-28 12:59:30.397 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:59:30 ctl02 nova-api[13961]: 2017-09-28 12:59:30.553 13961 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:59:30 ctl02 nova-api[13961]: 2017-09-28 12:59:30.555 13961 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:59:30 ctl02 nova-api[13961]: 2017-09-28 12:59:30.555 13961 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:59:30 ctl02 nova-api[13961]: 2017-09-28 12:59:30.555 13961 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:59:30 ctl02 nova-api[13961]: 2017-09-28 12:59:30.555 13961 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:59:30 ctl02 nova-api[13961]: 2017-09-28 12:59:30.555 13961 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:59:30 ctl02 nova-api[13961]: 2017-09-28 12:59:30.555 13961 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:59:30 ctl02 nova-api[13961]: 2017-09-28 12:59:30.555 13961 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:59:30 ctl02 nova-api[13961]: 2017-09-28 12:59:30.555 13961 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:59:30 ctl02 nova-api[13961]: 2017-09-28 12:59:30.555 13961 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:59:30 ctl02 nova-api[13961]: 2017-09-28 12:59:30.555 13961 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:59:30 ctl02 nova-api[13961]: 2017-09-28 12:59:30.555 13961 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:59:30 ctl02 nova-api[13961]: 2017-09-28 12:59:30.555 13961 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:59:30 ctl02 nova-api[13961]: 2017-09-28 12:59:30.555 13961 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:59:30 ctl02 nova-api[13961]: 2017-09-28 12:59:30.555 13961 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:59:30 ctl02 nova-api[13961]: 2017-09-28 12:59:30.555 13961 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:59:30 ctl02 nova-api[13961]: 2017-09-28 12:59:30.555 13961 ERROR nova.wsgi     self.filename))
Sep 28 12:59:30 ctl02 nova-api[13961]: 2017-09-28 12:59:30.555 13961 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:59:30 ctl02 nova-api[13961]: 2017-09-28 12:59:30.555 13961 ERROR nova.wsgi
Sep 28 12:59:30 ctl02 nova-api[13961]: 2017-09-28 12:59:30.556 13961 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:59:30 ctl02 nova-api[13961]: 2017-09-28 12:59:30.691 13961 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:59:30 ctl02 nova-api[13961]: 2017-09-28 12:59:30.948 13961 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:59:30 ctl02 nova-api[13961]: 2017-09-28 12:59:30.950 13961 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:59:30 ctl02 nova-api[13961]: 2017-09-28 12:59:30.951 13961 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:59:30 ctl02 nova-api[13961]: 2017-09-28 12:59:30.951 13961 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:59:31 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:59:31.044 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:59:31] "OPTIONS / HTTP/1.0" 200 134 0.000430
Sep 28 12:59:31 ctl02 nova-api[13961]: 2017-09-28 12:59:31.089 13961 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:59:31 ctl02 nova-api[13961]: 2017-09-28 12:59:31.091 13961 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:59:31 ctl02 nova-api[13961]: 2017-09-28 12:59:31.092 13961 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:59:31 ctl02 nova-api[13961]: 2017-09-28 12:59:31.092 13961 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:59:31 ctl02 nova-api[13961]: 2017-09-28 12:59:31.096 13961 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:59:31 ctl02 nova-api[13961]: 2017-09-28 12:59:31.096 13961 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:59:31 ctl02 nova-api[13961]: 2017-09-28 12:59:31.096 13961 ERROR nova Traceback (most recent call last):
Sep 28 12:59:31 ctl02 nova-api[13961]: 2017-09-28 12:59:31.096 13961 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:59:31 ctl02 nova-api[13961]: 2017-09-28 12:59:31.096 13961 ERROR nova     sys.exit(main())
Sep 28 12:59:31 ctl02 nova-api[13961]: 2017-09-28 12:59:31.096 13961 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:59:31 ctl02 nova-api[13961]: 2017-09-28 12:59:31.096 13961 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:59:31 ctl02 nova-api[13961]: 2017-09-28 12:59:31.096 13961 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:59:31 ctl02 nova-api[13961]: 2017-09-28 12:59:31.096 13961 ERROR nova     max_url_len=max_url_len)
Sep 28 12:59:31 ctl02 nova-api[13961]: 2017-09-28 12:59:31.096 13961 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:59:31 ctl02 nova-api[13961]: 2017-09-28 12:59:31.096 13961 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:59:31 ctl02 nova-api[13961]: 2017-09-28 12:59:31.096 13961 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:59:31 ctl02 nova-api[13961]: 2017-09-28 12:59:31.096 13961 ERROR nova     sock.listen(backlog)
Sep 28 12:59:31 ctl02 nova-api[13961]: 2017-09-28 12:59:31.096 13961 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:59:31 ctl02 nova-api[13961]: 2017-09-28 12:59:31.096 13961 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:59:31 ctl02 nova-api[13961]: 2017-09-28 12:59:31.096 13961 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:59:31 ctl02 nova-api[13961]: 2017-09-28 12:59:31.096 13961 ERROR nova
Sep 28 12:59:31 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:59:31 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:59:31 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:59:31 ctl02 heat-api[13008]: 2017-09-28 12:59:31.356 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:59:31] "OPTIONS / HTTP/1.0" 200 134 0.000618
Sep 28 12:59:31 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:59:31 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:59:31 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:59:31 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:59:32 ctl02 neutron-server[30536]: 2017-09-28 12:59:32.063 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:59:32] "OPTIONS / HTTP/1.0" 200 262 0.000469
Sep 28 12:59:32 ctl02 glance-api[29183]: 2017-09-28 12:59:32.119 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:59:32] "OPTIONS / HTTP/1.0" 200 134 0.000577
Sep 28 12:59:32 ctl02 nova-scheduler[5620]: 2017-09-28 12:59:32.725 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:59:33 ctl02 nova-api[13979]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:59:33 ctl02 nova-api[13979]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:59:33 ctl02 glance-api[29183]: 2017-09-28 12:59:33.259 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:59:33] "OPTIONS / HTTP/1.0" 200 134 0.000627
Sep 28 12:59:33 ctl02 nova-api[13979]: 2017-09-28 12:59:33.268 13979 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:59:33 ctl02 nova-api[13979]: 2017-09-28 12:59:33.270 13979 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:59:33 ctl02 nova-api[13979]: 2017-09-28 12:59:33.270 13979 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:59:33 ctl02 nova-api[13979]: 2017-09-28 12:59:33.270 13979 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:59:33 ctl02 nova-api[13979]: 2017-09-28 12:59:33.270 13979 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:59:33 ctl02 nova-api[13979]: 2017-09-28 12:59:33.270 13979 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:59:33 ctl02 nova-api[13979]: 2017-09-28 12:59:33.270 13979 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:59:33 ctl02 nova-api[13979]: 2017-09-28 12:59:33.270 13979 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:59:33 ctl02 nova-api[13979]: 2017-09-28 12:59:33.270 13979 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:59:33 ctl02 nova-api[13979]: 2017-09-28 12:59:33.270 13979 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:59:33 ctl02 nova-api[13979]: 2017-09-28 12:59:33.270 13979 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:59:33 ctl02 nova-api[13979]: 2017-09-28 12:59:33.270 13979 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:59:33 ctl02 nova-api[13979]: 2017-09-28 12:59:33.270 13979 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:59:33 ctl02 nova-api[13979]: 2017-09-28 12:59:33.270 13979 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:59:33 ctl02 nova-api[13979]: 2017-09-28 12:59:33.270 13979 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:59:33 ctl02 nova-api[13979]: 2017-09-28 12:59:33.270 13979 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:59:33 ctl02 nova-api[13979]: 2017-09-28 12:59:33.270 13979 ERROR nova.wsgi     self.filename))
Sep 28 12:59:33 ctl02 nova-api[13979]: 2017-09-28 12:59:33.270 13979 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:59:33 ctl02 nova-api[13979]: 2017-09-28 12:59:33.270 13979 ERROR nova.wsgi
Sep 28 12:59:33 ctl02 nova-api[13979]: 2017-09-28 12:59:33.271 13979 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:59:33 ctl02 nova-api[13979]: 2017-09-28 12:59:33.405 13979 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:59:33 ctl02 heat-api[13008]: 2017-09-28 12:59:33.477 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:59:33] "OPTIONS / HTTP/1.0" 200 134 0.000592
Sep 28 12:59:33 ctl02 nova-api[13979]: 2017-09-28 12:59:33.640 13979 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:59:33 ctl02 nova-api[13979]: 2017-09-28 12:59:33.642 13979 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:59:33 ctl02 nova-api[13979]: 2017-09-28 12:59:33.642 13979 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:59:33 ctl02 nova-api[13979]: 2017-09-28 12:59:33.642 13979 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:59:33 ctl02 nova-api[13979]: 2017-09-28 12:59:33.775 13979 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:59:33 ctl02 nova-api[13979]: 2017-09-28 12:59:33.777 13979 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:59:33 ctl02 nova-api[13979]: 2017-09-28 12:59:33.777 13979 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:59:33 ctl02 nova-api[13979]: 2017-09-28 12:59:33.777 13979 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:59:33 ctl02 nova-api[13979]: 2017-09-28 12:59:33.781 13979 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:59:33 ctl02 nova-api[13979]: 2017-09-28 12:59:33.781 13979 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:59:33 ctl02 nova-api[13979]: 2017-09-28 12:59:33.781 13979 ERROR nova Traceback (most recent call last):
Sep 28 12:59:33 ctl02 nova-api[13979]: 2017-09-28 12:59:33.781 13979 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:59:33 ctl02 nova-api[13979]: 2017-09-28 12:59:33.781 13979 ERROR nova     sys.exit(main())
Sep 28 12:59:33 ctl02 nova-api[13979]: 2017-09-28 12:59:33.781 13979 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:59:33 ctl02 nova-api[13979]: 2017-09-28 12:59:33.781 13979 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:59:33 ctl02 nova-api[13979]: 2017-09-28 12:59:33.781 13979 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:59:33 ctl02 nova-api[13979]: 2017-09-28 12:59:33.781 13979 ERROR nova     max_url_len=max_url_len)
Sep 28 12:59:33 ctl02 nova-api[13979]: 2017-09-28 12:59:33.781 13979 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:59:33 ctl02 nova-api[13979]: 2017-09-28 12:59:33.781 13979 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:59:33 ctl02 nova-api[13979]: 2017-09-28 12:59:33.781 13979 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:59:33 ctl02 nova-api[13979]: 2017-09-28 12:59:33.781 13979 ERROR nova     sock.listen(backlog)
Sep 28 12:59:33 ctl02 nova-api[13979]: 2017-09-28 12:59:33.781 13979 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:59:33 ctl02 nova-api[13979]: 2017-09-28 12:59:33.781 13979 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:59:33 ctl02 nova-api[13979]: 2017-09-28 12:59:33.781 13979 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:59:33 ctl02 nova-api[13979]: 2017-09-28 12:59:33.781 13979 ERROR nova
Sep 28 12:59:33 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:59:33 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:59:33 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:59:34 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:59:34 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:59:34 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:59:34 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:59:35 ctl02 neutron-server[30536]: 2017-09-28 12:59:35.015 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:59:35] "OPTIONS / HTTP/1.0" 200 262 0.000553
Sep 28 12:59:35 ctl02 heat-api-cfn[13300]: 2017-09-28 12:59:35.586 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:59:35] "OPTIONS / HTTP/1.0" 200 134 0.000506
Sep 28 12:59:35 ctl02 neutron-server[30536]: 2017-09-28 12:59:35.834 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:59:35] "OPTIONS / HTTP/1.0" 200 262 0.000581
Sep 28 12:59:35 ctl02 nova-api[13997]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:59:35 ctl02 nova-api[13997]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:59:35 ctl02 heat-api-cfn[13300]: 2017-09-28 12:59:35.917 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:59:35] "OPTIONS / HTTP/1.0" 200 134 0.000496
Sep 28 12:59:36 ctl02 nova-api[13997]: 2017-09-28 12:59:36.026 13997 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:59:36 ctl02 nova-api[13997]: 2017-09-28 12:59:36.028 13997 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:59:36 ctl02 nova-api[13997]: 2017-09-28 12:59:36.028 13997 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:59:36 ctl02 nova-api[13997]: 2017-09-28 12:59:36.028 13997 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:59:36 ctl02 nova-api[13997]: 2017-09-28 12:59:36.028 13997 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:59:36 ctl02 nova-api[13997]: 2017-09-28 12:59:36.028 13997 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:59:36 ctl02 nova-api[13997]: 2017-09-28 12:59:36.028 13997 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:59:36 ctl02 nova-api[13997]: 2017-09-28 12:59:36.028 13997 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:59:36 ctl02 nova-api[13997]: 2017-09-28 12:59:36.028 13997 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:59:36 ctl02 nova-api[13997]: 2017-09-28 12:59:36.028 13997 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:59:36 ctl02 nova-api[13997]: 2017-09-28 12:59:36.028 13997 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:59:36 ctl02 nova-api[13997]: 2017-09-28 12:59:36.028 13997 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:59:36 ctl02 nova-api[13997]: 2017-09-28 12:59:36.028 13997 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:59:36 ctl02 nova-api[13997]: 2017-09-28 12:59:36.028 13997 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:59:36 ctl02 nova-api[13997]: 2017-09-28 12:59:36.028 13997 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:59:36 ctl02 nova-api[13997]: 2017-09-28 12:59:36.028 13997 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:59:36 ctl02 nova-api[13997]: 2017-09-28 12:59:36.028 13997 ERROR nova.wsgi     self.filename))
Sep 28 12:59:36 ctl02 nova-api[13997]: 2017-09-28 12:59:36.028 13997 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:59:36 ctl02 nova-api[13997]: 2017-09-28 12:59:36.028 13997 ERROR nova.wsgi
Sep 28 12:59:36 ctl02 nova-api[13997]: 2017-09-28 12:59:36.029 13997 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:59:36 ctl02 neutron-server[30536]: 2017-09-28 12:59:36.063 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 4 dead agents out of 6:
Sep 28 12:59:36 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:59:36 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:59:06 cmp002
Sep 28 12:59:36 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:58:38 cmp001
Sep 28 12:59:36 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:58:00 cmp002
Sep 28 12:59:36 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:58:46 cmp002
Sep 28 12:59:36 ctl02 nova-api[13997]: 2017-09-28 12:59:36.163 13997 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:59:36 ctl02 nova-api[13997]: 2017-09-28 12:59:36.416 13997 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:59:36 ctl02 nova-api[13997]: 2017-09-28 12:59:36.419 13997 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:59:36 ctl02 nova-api[13997]: 2017-09-28 12:59:36.419 13997 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:59:36 ctl02 nova-api[13997]: 2017-09-28 12:59:36.419 13997 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:59:36 ctl02 nova-api[13997]: 2017-09-28 12:59:36.552 13997 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:59:36 ctl02 nova-api[13997]: 2017-09-28 12:59:36.555 13997 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:59:36 ctl02 nova-api[13997]: 2017-09-28 12:59:36.555 13997 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:59:36 ctl02 nova-api[13997]: 2017-09-28 12:59:36.555 13997 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:59:36 ctl02 nova-api[13997]: 2017-09-28 12:59:36.558 13997 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:59:36 ctl02 nova-api[13997]: 2017-09-28 12:59:36.559 13997 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:59:36 ctl02 nova-api[13997]: 2017-09-28 12:59:36.559 13997 ERROR nova Traceback (most recent call last):
Sep 28 12:59:36 ctl02 nova-api[13997]: 2017-09-28 12:59:36.559 13997 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:59:36 ctl02 nova-api[13997]: 2017-09-28 12:59:36.559 13997 ERROR nova     sys.exit(main())
Sep 28 12:59:36 ctl02 nova-api[13997]: 2017-09-28 12:59:36.559 13997 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:59:36 ctl02 nova-api[13997]: 2017-09-28 12:59:36.559 13997 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:59:36 ctl02 nova-api[13997]: 2017-09-28 12:59:36.559 13997 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:59:36 ctl02 nova-api[13997]: 2017-09-28 12:59:36.559 13997 ERROR nova     max_url_len=max_url_len)
Sep 28 12:59:36 ctl02 nova-api[13997]: 2017-09-28 12:59:36.559 13997 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:59:36 ctl02 nova-api[13997]: 2017-09-28 12:59:36.559 13997 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:59:36 ctl02 nova-api[13997]: 2017-09-28 12:59:36.559 13997 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:59:36 ctl02 nova-api[13997]: 2017-09-28 12:59:36.559 13997 ERROR nova     sock.listen(backlog)
Sep 28 12:59:36 ctl02 nova-api[13997]: 2017-09-28 12:59:36.559 13997 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:59:36 ctl02 nova-api[13997]: 2017-09-28 12:59:36.559 13997 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:59:36 ctl02 nova-api[13997]: 2017-09-28 12:59:36.559 13997 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:59:36 ctl02 nova-api[13997]: 2017-09-28 12:59:36.559 13997 ERROR nova
Sep 28 12:59:36 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:59:36 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:59:36 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:59:36 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:59:36 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:59:36 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:59:36 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:59:36 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:59:36.955 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:59:36] "OPTIONS / HTTP/1.0" 200 134 0.000460
Sep 28 12:59:37 ctl02 heat-api[13008]: 2017-09-28 12:59:37.493 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:59:37] "OPTIONS / HTTP/1.0" 200 134 0.000630
Sep 28 12:59:37 ctl02 neutron-server[30536]: 2017-09-28 12:59:37.974 30602 WARNING oslo_messaging._drivers.amqpdriver [req-8a0114fe-a9e1-4a73-bf60-f537e6bc87e5 - - - - -] reply_01ed9623b6f1416cb0b0d6e759ffbaf3 doesn't exists, drop reply to ba43b733ab6c460b94b4bbf22e5e201d
Sep 28 12:59:37 ctl02 neutron-server[30536]: 2017-09-28 12:59:37.974 30602 INFO oslo_messaging._drivers.amqpdriver [req-8a0114fe-a9e1-4a73-bf60-f537e6bc87e5 - - - - -] The reply ba43b733ab6c460b94b4bbf22e5e201d cannot be sent  reply_01ed9623b6f1416cb0b0d6e759ffbaf3 reply queue don't exist after 60 sec abandoning...
Sep 28 12:59:38 ctl02 nova-api[14014]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:59:38 ctl02 nova-api[14014]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:59:38 ctl02 nova-api[14014]: 2017-09-28 12:59:38.792 14014 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:59:38 ctl02 nova-api[14014]: 2017-09-28 12:59:38.794 14014 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:59:38 ctl02 nova-api[14014]: 2017-09-28 12:59:38.794 14014 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:59:38 ctl02 nova-api[14014]: 2017-09-28 12:59:38.794 14014 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:59:38 ctl02 nova-api[14014]: 2017-09-28 12:59:38.794 14014 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:59:38 ctl02 nova-api[14014]: 2017-09-28 12:59:38.794 14014 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:59:38 ctl02 nova-api[14014]: 2017-09-28 12:59:38.794 14014 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:59:38 ctl02 nova-api[14014]: 2017-09-28 12:59:38.794 14014 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:59:38 ctl02 nova-api[14014]: 2017-09-28 12:59:38.794 14014 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:59:38 ctl02 nova-api[14014]: 2017-09-28 12:59:38.794 14014 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:59:38 ctl02 nova-api[14014]: 2017-09-28 12:59:38.794 14014 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:59:38 ctl02 nova-api[14014]: 2017-09-28 12:59:38.794 14014 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:59:38 ctl02 nova-api[14014]: 2017-09-28 12:59:38.794 14014 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:59:38 ctl02 nova-api[14014]: 2017-09-28 12:59:38.794 14014 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:59:38 ctl02 nova-api[14014]: 2017-09-28 12:59:38.794 14014 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:59:38 ctl02 nova-api[14014]: 2017-09-28 12:59:38.794 14014 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:59:38 ctl02 nova-api[14014]: 2017-09-28 12:59:38.794 14014 ERROR nova.wsgi     self.filename))
Sep 28 12:59:38 ctl02 nova-api[14014]: 2017-09-28 12:59:38.794 14014 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:59:38 ctl02 nova-api[14014]: 2017-09-28 12:59:38.794 14014 ERROR nova.wsgi
Sep 28 12:59:38 ctl02 nova-api[14014]: 2017-09-28 12:59:38.795 14014 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:59:38 ctl02 nova-api[14014]: 2017-09-28 12:59:38.925 14014 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:59:38 ctl02 glance-api[29183]: 2017-09-28 12:59:38.991 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:59:38] "OPTIONS / HTTP/1.0" 200 134 0.000640
Sep 28 12:59:39 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:59:39.067 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:59:39] "OPTIONS / HTTP/1.0" 200 134 0.000408
Sep 28 12:59:39 ctl02 nova-api[14014]: 2017-09-28 12:59:39.167 14014 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:59:39 ctl02 nova-api[14014]: 2017-09-28 12:59:39.170 14014 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:59:39 ctl02 nova-api[14014]: 2017-09-28 12:59:39.170 14014 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:59:39 ctl02 nova-api[14014]: 2017-09-28 12:59:39.170 14014 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:59:39 ctl02 nova-api[14014]: 2017-09-28 12:59:39.305 14014 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:59:39 ctl02 nova-api[14014]: 2017-09-28 12:59:39.307 14014 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:59:39 ctl02 nova-api[14014]: 2017-09-28 12:59:39.307 14014 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:59:39 ctl02 nova-api[14014]: 2017-09-28 12:59:39.307 14014 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:59:39 ctl02 nova-api[14014]: 2017-09-28 12:59:39.311 14014 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:59:39 ctl02 nova-api[14014]: 2017-09-28 12:59:39.311 14014 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:59:39 ctl02 nova-api[14014]: 2017-09-28 12:59:39.311 14014 ERROR nova Traceback (most recent call last):
Sep 28 12:59:39 ctl02 nova-api[14014]: 2017-09-28 12:59:39.311 14014 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:59:39 ctl02 nova-api[14014]: 2017-09-28 12:59:39.311 14014 ERROR nova     sys.exit(main())
Sep 28 12:59:39 ctl02 nova-api[14014]: 2017-09-28 12:59:39.311 14014 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:59:39 ctl02 nova-api[14014]: 2017-09-28 12:59:39.311 14014 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:59:39 ctl02 nova-api[14014]: 2017-09-28 12:59:39.311 14014 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:59:39 ctl02 nova-api[14014]: 2017-09-28 12:59:39.311 14014 ERROR nova     max_url_len=max_url_len)
Sep 28 12:59:39 ctl02 nova-api[14014]: 2017-09-28 12:59:39.311 14014 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:59:39 ctl02 nova-api[14014]: 2017-09-28 12:59:39.311 14014 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:59:39 ctl02 nova-api[14014]: 2017-09-28 12:59:39.311 14014 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:59:39 ctl02 nova-api[14014]: 2017-09-28 12:59:39.311 14014 ERROR nova     sock.listen(backlog)
Sep 28 12:59:39 ctl02 nova-api[14014]: 2017-09-28 12:59:39.311 14014 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:59:39 ctl02 nova-api[14014]: 2017-09-28 12:59:39.311 14014 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:59:39 ctl02 nova-api[14014]: 2017-09-28 12:59:39.311 14014 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:59:39 ctl02 nova-api[14014]: 2017-09-28 12:59:39.311 14014 ERROR nova
Sep 28 12:59:39 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:59:39 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:59:39 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:59:39 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:59:39 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:59:39 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:59:39 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:59:39 ctl02 heat-api-cfn[13300]: 2017-09-28 12:59:39.775 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:59:39] "OPTIONS / HTTP/1.0" 200 134 0.000483
Sep 28 12:59:40 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:59:40.715 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:59:40] "OPTIONS / HTTP/1.0" 200 134 0.000333
Sep 28 12:59:40 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x464a7353)
Sep 28 12:59:41 ctl02 heat-api[13008]: 2017-09-28 12:59:41.251 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:59:41] "OPTIONS / HTTP/1.0" 200 134 0.000525
Sep 28 12:59:41 ctl02 nova-api[14032]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:59:41 ctl02 nova-api[14032]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:59:41 ctl02 nova-api[14032]: 2017-09-28 12:59:41.491 14032 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:59:41 ctl02 nova-api[14032]: 2017-09-28 12:59:41.492 14032 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:59:41 ctl02 nova-api[14032]: 2017-09-28 12:59:41.492 14032 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:59:41 ctl02 nova-api[14032]: 2017-09-28 12:59:41.492 14032 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:59:41 ctl02 nova-api[14032]: 2017-09-28 12:59:41.492 14032 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:59:41 ctl02 nova-api[14032]: 2017-09-28 12:59:41.492 14032 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:59:41 ctl02 nova-api[14032]: 2017-09-28 12:59:41.492 14032 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:59:41 ctl02 nova-api[14032]: 2017-09-28 12:59:41.492 14032 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:59:41 ctl02 nova-api[14032]: 2017-09-28 12:59:41.492 14032 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:59:41 ctl02 nova-api[14032]: 2017-09-28 12:59:41.492 14032 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:59:41 ctl02 nova-api[14032]: 2017-09-28 12:59:41.492 14032 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:59:41 ctl02 nova-api[14032]: 2017-09-28 12:59:41.492 14032 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:59:41 ctl02 nova-api[14032]: 2017-09-28 12:59:41.492 14032 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:59:41 ctl02 nova-api[14032]: 2017-09-28 12:59:41.492 14032 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:59:41 ctl02 nova-api[14032]: 2017-09-28 12:59:41.492 14032 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:59:41 ctl02 nova-api[14032]: 2017-09-28 12:59:41.492 14032 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:59:41 ctl02 nova-api[14032]: 2017-09-28 12:59:41.492 14032 ERROR nova.wsgi     self.filename))
Sep 28 12:59:41 ctl02 nova-api[14032]: 2017-09-28 12:59:41.492 14032 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:59:41 ctl02 nova-api[14032]: 2017-09-28 12:59:41.492 14032 ERROR nova.wsgi
Sep 28 12:59:41 ctl02 nova-api[14032]: 2017-09-28 12:59:41.493 14032 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:59:41 ctl02 nova-api[14032]: 2017-09-28 12:59:41.619 14032 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:59:41 ctl02 glance-api[29183]: 2017-09-28 12:59:41.787 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:59:41] "OPTIONS / HTTP/1.0" 200 134 0.000546
Sep 28 12:59:41 ctl02 nova-api[14032]: 2017-09-28 12:59:41.846 14032 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:59:41 ctl02 nova-api[14032]: 2017-09-28 12:59:41.848 14032 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:59:41 ctl02 nova-api[14032]: 2017-09-28 12:59:41.848 14032 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:59:41 ctl02 nova-api[14032]: 2017-09-28 12:59:41.848 14032 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:59:41 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x464a7353)
Sep 28 12:59:41 ctl02 nova-api[14032]: 2017-09-28 12:59:41.978 14032 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:59:41 ctl02 nova-api[14032]: 2017-09-28 12:59:41.980 14032 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:59:41 ctl02 nova-api[14032]: 2017-09-28 12:59:41.980 14032 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:59:41 ctl02 nova-api[14032]: 2017-09-28 12:59:41.980 14032 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:59:41 ctl02 nova-api[14032]: 2017-09-28 12:59:41.983 14032 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:59:41 ctl02 nova-api[14032]: 2017-09-28 12:59:41.984 14032 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:59:41 ctl02 nova-api[14032]: 2017-09-28 12:59:41.984 14032 ERROR nova Traceback (most recent call last):
Sep 28 12:59:41 ctl02 nova-api[14032]: 2017-09-28 12:59:41.984 14032 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:59:41 ctl02 nova-api[14032]: 2017-09-28 12:59:41.984 14032 ERROR nova     sys.exit(main())
Sep 28 12:59:41 ctl02 nova-api[14032]: 2017-09-28 12:59:41.984 14032 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:59:41 ctl02 nova-api[14032]: 2017-09-28 12:59:41.984 14032 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:59:41 ctl02 nova-api[14032]: 2017-09-28 12:59:41.984 14032 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:59:41 ctl02 nova-api[14032]: 2017-09-28 12:59:41.984 14032 ERROR nova     max_url_len=max_url_len)
Sep 28 12:59:41 ctl02 nova-api[14032]: 2017-09-28 12:59:41.984 14032 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:59:41 ctl02 nova-api[14032]: 2017-09-28 12:59:41.984 14032 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:59:41 ctl02 nova-api[14032]: 2017-09-28 12:59:41.984 14032 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:59:41 ctl02 nova-api[14032]: 2017-09-28 12:59:41.984 14032 ERROR nova     sock.listen(backlog)
Sep 28 12:59:41 ctl02 nova-api[14032]: 2017-09-28 12:59:41.984 14032 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:59:41 ctl02 nova-api[14032]: 2017-09-28 12:59:41.984 14032 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:59:41 ctl02 nova-api[14032]: 2017-09-28 12:59:41.984 14032 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:59:41 ctl02 nova-api[14032]: 2017-09-28 12:59:41.984 14032 ERROR nova
Sep 28 12:59:42 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:59:42 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:59:42 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:59:42 ctl02 neutron-server[30536]: 2017-09-28 12:59:42.135 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:59:42] "OPTIONS / HTTP/1.0" 200 262 0.000465
Sep 28 12:59:42 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:59:42 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:59:42 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:59:42 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:59:42 ctl02 glance-api[29183]: 2017-09-28 12:59:42.957 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:59:42] "OPTIONS / HTTP/1.0" 200 134 0.000535
Sep 28 12:59:42 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x464a7353)
Sep 28 12:59:43 ctl02 neutron-server[30536]: 2017-09-28 12:59:43.550 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:59:43 ctl02 heat-api[13008]: 2017-09-28 12:59:43.822 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:59:43] "OPTIONS / HTTP/1.0" 200 134 0.000537
Sep 28 12:59:43 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x464a7353)
Sep 28 12:59:44 ctl02 nova-api[14052]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:59:44 ctl02 nova-api[14052]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:59:44 ctl02 nova-api[14052]: 2017-09-28 12:59:44.236 14052 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:59:44 ctl02 nova-api[14052]: 2017-09-28 12:59:44.238 14052 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:59:44 ctl02 nova-api[14052]: 2017-09-28 12:59:44.238 14052 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:59:44 ctl02 nova-api[14052]: 2017-09-28 12:59:44.238 14052 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:59:44 ctl02 nova-api[14052]: 2017-09-28 12:59:44.238 14052 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:59:44 ctl02 nova-api[14052]: 2017-09-28 12:59:44.238 14052 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:59:44 ctl02 nova-api[14052]: 2017-09-28 12:59:44.238 14052 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:59:44 ctl02 nova-api[14052]: 2017-09-28 12:59:44.238 14052 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:59:44 ctl02 nova-api[14052]: 2017-09-28 12:59:44.238 14052 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:59:44 ctl02 nova-api[14052]: 2017-09-28 12:59:44.238 14052 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:59:44 ctl02 nova-api[14052]: 2017-09-28 12:59:44.238 14052 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:59:44 ctl02 nova-api[14052]: 2017-09-28 12:59:44.238 14052 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:59:44 ctl02 nova-api[14052]: 2017-09-28 12:59:44.238 14052 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:59:44 ctl02 nova-api[14052]: 2017-09-28 12:59:44.238 14052 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:59:44 ctl02 nova-api[14052]: 2017-09-28 12:59:44.238 14052 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:59:44 ctl02 nova-api[14052]: 2017-09-28 12:59:44.238 14052 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:59:44 ctl02 nova-api[14052]: 2017-09-28 12:59:44.238 14052 ERROR nova.wsgi     self.filename))
Sep 28 12:59:44 ctl02 nova-api[14052]: 2017-09-28 12:59:44.238 14052 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:59:44 ctl02 nova-api[14052]: 2017-09-28 12:59:44.238 14052 ERROR nova.wsgi
Sep 28 12:59:44 ctl02 nova-api[14052]: 2017-09-28 12:59:44.239 14052 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:59:44 ctl02 nova-api[14052]: 2017-09-28 12:59:44.365 14052 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:59:44 ctl02 nova-api[14052]: 2017-09-28 12:59:44.587 14052 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:59:44 ctl02 nova-api[14052]: 2017-09-28 12:59:44.589 14052 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:59:44 ctl02 nova-api[14052]: 2017-09-28 12:59:44.590 14052 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:59:44 ctl02 nova-api[14052]: 2017-09-28 12:59:44.590 14052 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:59:44 ctl02 nova-api[14052]: 2017-09-28 12:59:44.719 14052 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:59:44 ctl02 nova-api[14052]: 2017-09-28 12:59:44.720 14052 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:59:44 ctl02 nova-api[14052]: 2017-09-28 12:59:44.721 14052 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:59:44 ctl02 nova-api[14052]: 2017-09-28 12:59:44.721 14052 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:59:44 ctl02 nova-api[14052]: 2017-09-28 12:59:44.724 14052 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:59:44 ctl02 nova-api[14052]: 2017-09-28 12:59:44.724 14052 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:59:44 ctl02 nova-api[14052]: 2017-09-28 12:59:44.724 14052 ERROR nova Traceback (most recent call last):
Sep 28 12:59:44 ctl02 nova-api[14052]: 2017-09-28 12:59:44.724 14052 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:59:44 ctl02 nova-api[14052]: 2017-09-28 12:59:44.724 14052 ERROR nova     sys.exit(main())
Sep 28 12:59:44 ctl02 nova-api[14052]: 2017-09-28 12:59:44.724 14052 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:59:44 ctl02 nova-api[14052]: 2017-09-28 12:59:44.724 14052 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:59:44 ctl02 nova-api[14052]: 2017-09-28 12:59:44.724 14052 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:59:44 ctl02 nova-api[14052]: 2017-09-28 12:59:44.724 14052 ERROR nova     max_url_len=max_url_len)
Sep 28 12:59:44 ctl02 nova-api[14052]: 2017-09-28 12:59:44.724 14052 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:59:44 ctl02 nova-api[14052]: 2017-09-28 12:59:44.724 14052 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:59:44 ctl02 nova-api[14052]: 2017-09-28 12:59:44.724 14052 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:59:44 ctl02 nova-api[14052]: 2017-09-28 12:59:44.724 14052 ERROR nova     sock.listen(backlog)
Sep 28 12:59:44 ctl02 nova-api[14052]: 2017-09-28 12:59:44.724 14052 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:59:44 ctl02 nova-api[14052]: 2017-09-28 12:59:44.724 14052 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:59:44 ctl02 nova-api[14052]: 2017-09-28 12:59:44.724 14052 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:59:44 ctl02 nova-api[14052]: 2017-09-28 12:59:44.724 14052 ERROR nova
Sep 28 12:59:44 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:59:44 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:59:44 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:59:44 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x464a7353)
Sep 28 12:59:45 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:59:45 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:59:45 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:59:45 ctl02 neutron-server[30536]: 2017-09-28 12:59:45.152 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:59:45] "OPTIONS / HTTP/1.0" 200 262 0.000685
Sep 28 12:59:45 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:59:45 ctl02 heat-api-cfn[13300]: 2017-09-28 12:59:45.558 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:59:45] "OPTIONS / HTTP/1.0" 200 134 0.000553
Sep 28 12:59:45 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x464a7353)
Sep 28 12:59:46 ctl02 neutron-server[30536]: 2017-09-28 12:59:46.088 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:59:46] "OPTIONS / HTTP/1.0" 200 262 0.000560
Sep 28 12:59:46 ctl02 neutron-server[30536]: 2017-09-28 12:59:46.192 30600 WARNING oslo_messaging._drivers.amqpdriver [req-2b5bea3d-9442-4c6e-85fa-7964fce2b92f - - - - -] reply_a13a20a54b91453780e36bdf20a855d2 doesn't exists, drop reply to 19f524885db44c4f8381bf6b9c4f7ca2
Sep 28 12:59:46 ctl02 neutron-server[30536]: 2017-09-28 12:59:46.192 30600 INFO oslo_messaging._drivers.amqpdriver [req-2b5bea3d-9442-4c6e-85fa-7964fce2b92f - - - - -] The reply 19f524885db44c4f8381bf6b9c4f7ca2 cannot be sent  reply_a13a20a54b91453780e36bdf20a855d2 reply queue don't exist after 60 sec abandoning...
Sep 28 12:59:46 ctl02 heat-api-cfn[13300]: 2017-09-28 12:59:46.233 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:59:46] "OPTIONS / HTTP/1.0" 200 134 0.000539
Sep 28 12:59:46 ctl02 nova-api[14070]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:59:46 ctl02 nova-api[14070]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:59:46 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:59:46.964 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:59:46] "OPTIONS / HTTP/1.0" 200 134 0.000451
Sep 28 12:59:46 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x464a7353)
Sep 28 12:59:47 ctl02 nova-api[14070]: 2017-09-28 12:59:47.032 14070 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:59:47 ctl02 nova-api[14070]: 2017-09-28 12:59:47.033 14070 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:59:47 ctl02 nova-api[14070]: 2017-09-28 12:59:47.033 14070 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:59:47 ctl02 nova-api[14070]: 2017-09-28 12:59:47.033 14070 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:59:47 ctl02 nova-api[14070]: 2017-09-28 12:59:47.033 14070 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:59:47 ctl02 nova-api[14070]: 2017-09-28 12:59:47.033 14070 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:59:47 ctl02 nova-api[14070]: 2017-09-28 12:59:47.033 14070 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:59:47 ctl02 nova-api[14070]: 2017-09-28 12:59:47.033 14070 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:59:47 ctl02 nova-api[14070]: 2017-09-28 12:59:47.033 14070 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:59:47 ctl02 nova-api[14070]: 2017-09-28 12:59:47.033 14070 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:59:47 ctl02 nova-api[14070]: 2017-09-28 12:59:47.033 14070 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:59:47 ctl02 nova-api[14070]: 2017-09-28 12:59:47.033 14070 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:59:47 ctl02 nova-api[14070]: 2017-09-28 12:59:47.033 14070 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:59:47 ctl02 nova-api[14070]: 2017-09-28 12:59:47.033 14070 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:59:47 ctl02 nova-api[14070]: 2017-09-28 12:59:47.033 14070 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:59:47 ctl02 nova-api[14070]: 2017-09-28 12:59:47.033 14070 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:59:47 ctl02 nova-api[14070]: 2017-09-28 12:59:47.033 14070 ERROR nova.wsgi     self.filename))
Sep 28 12:59:47 ctl02 nova-api[14070]: 2017-09-28 12:59:47.033 14070 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:59:47 ctl02 nova-api[14070]: 2017-09-28 12:59:47.033 14070 ERROR nova.wsgi
Sep 28 12:59:47 ctl02 nova-api[14070]: 2017-09-28 12:59:47.034 14070 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:59:47 ctl02 nova-api[14070]: 2017-09-28 12:59:47.167 14070 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:59:47 ctl02 heat-api[13008]: 2017-09-28 12:59:47.214 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:59:47] "OPTIONS / HTTP/1.0" 200 134 0.000738
Sep 28 12:59:47 ctl02 nova-api[14070]: 2017-09-28 12:59:47.412 14070 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:59:47 ctl02 nova-api[14070]: 2017-09-28 12:59:47.414 14070 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:59:47 ctl02 nova-api[14070]: 2017-09-28 12:59:47.414 14070 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:59:47 ctl02 nova-api[14070]: 2017-09-28 12:59:47.415 14070 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:59:47 ctl02 nova-api[14070]: 2017-09-28 12:59:47.549 14070 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:59:47 ctl02 nova-api[14070]: 2017-09-28 12:59:47.552 14070 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:59:47 ctl02 nova-api[14070]: 2017-09-28 12:59:47.552 14070 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:59:47 ctl02 nova-api[14070]: 2017-09-28 12:59:47.552 14070 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:59:47 ctl02 nova-api[14070]: 2017-09-28 12:59:47.556 14070 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:59:47 ctl02 nova-api[14070]: 2017-09-28 12:59:47.556 14070 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:59:47 ctl02 nova-api[14070]: 2017-09-28 12:59:47.556 14070 ERROR nova Traceback (most recent call last):
Sep 28 12:59:47 ctl02 nova-api[14070]: 2017-09-28 12:59:47.556 14070 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:59:47 ctl02 nova-api[14070]: 2017-09-28 12:59:47.556 14070 ERROR nova     sys.exit(main())
Sep 28 12:59:47 ctl02 nova-api[14070]: 2017-09-28 12:59:47.556 14070 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:59:47 ctl02 nova-api[14070]: 2017-09-28 12:59:47.556 14070 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:59:47 ctl02 nova-api[14070]: 2017-09-28 12:59:47.556 14070 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:59:47 ctl02 nova-api[14070]: 2017-09-28 12:59:47.556 14070 ERROR nova     max_url_len=max_url_len)
Sep 28 12:59:47 ctl02 nova-api[14070]: 2017-09-28 12:59:47.556 14070 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:59:47 ctl02 nova-api[14070]: 2017-09-28 12:59:47.556 14070 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:59:47 ctl02 nova-api[14070]: 2017-09-28 12:59:47.556 14070 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:59:47 ctl02 nova-api[14070]: 2017-09-28 12:59:47.556 14070 ERROR nova     sock.listen(backlog)
Sep 28 12:59:47 ctl02 nova-api[14070]: 2017-09-28 12:59:47.556 14070 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:59:47 ctl02 nova-api[14070]: 2017-09-28 12:59:47.556 14070 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:59:47 ctl02 nova-api[14070]: 2017-09-28 12:59:47.556 14070 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:59:47 ctl02 nova-api[14070]: 2017-09-28 12:59:47.556 14070 ERROR nova
Sep 28 12:59:47 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:59:47 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:59:47 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:59:47 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:59:47 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:59:47 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:59:47 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:59:47 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x464a7353)
Sep 28 12:59:48 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x464a7353)
Sep 28 12:59:49 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:59:49.197 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:59:49] "OPTIONS / HTTP/1.0" 200 134 0.000502
Sep 28 12:59:49 ctl02 glance-api[29183]: 2017-09-28 12:59:49.385 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:59:49] "OPTIONS / HTTP/1.0" 200 134 0.000550
Sep 28 12:59:49 ctl02 nova-api[14088]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:59:49 ctl02 nova-api[14088]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:59:49 ctl02 heat-api-cfn[13300]: 2017-09-28 12:59:49.646 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:59:49] "OPTIONS / HTTP/1.0" 200 134 0.000594
Sep 28 12:59:49 ctl02 nova-api[14088]: 2017-09-28 12:59:49.734 14088 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:59:49 ctl02 nova-api[14088]: 2017-09-28 12:59:49.736 14088 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:59:49 ctl02 nova-api[14088]: 2017-09-28 12:59:49.736 14088 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:59:49 ctl02 nova-api[14088]: 2017-09-28 12:59:49.736 14088 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:59:49 ctl02 nova-api[14088]: 2017-09-28 12:59:49.736 14088 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:59:49 ctl02 nova-api[14088]: 2017-09-28 12:59:49.736 14088 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:59:49 ctl02 nova-api[14088]: 2017-09-28 12:59:49.736 14088 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:59:49 ctl02 nova-api[14088]: 2017-09-28 12:59:49.736 14088 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:59:49 ctl02 nova-api[14088]: 2017-09-28 12:59:49.736 14088 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:59:49 ctl02 nova-api[14088]: 2017-09-28 12:59:49.736 14088 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:59:49 ctl02 nova-api[14088]: 2017-09-28 12:59:49.736 14088 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:59:49 ctl02 nova-api[14088]: 2017-09-28 12:59:49.736 14088 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:59:49 ctl02 nova-api[14088]: 2017-09-28 12:59:49.736 14088 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:59:49 ctl02 nova-api[14088]: 2017-09-28 12:59:49.736 14088 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:59:49 ctl02 nova-api[14088]: 2017-09-28 12:59:49.736 14088 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:59:49 ctl02 nova-api[14088]: 2017-09-28 12:59:49.736 14088 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:59:49 ctl02 nova-api[14088]: 2017-09-28 12:59:49.736 14088 ERROR nova.wsgi     self.filename))
Sep 28 12:59:49 ctl02 nova-api[14088]: 2017-09-28 12:59:49.736 14088 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:59:49 ctl02 nova-api[14088]: 2017-09-28 12:59:49.736 14088 ERROR nova.wsgi
Sep 28 12:59:49 ctl02 nova-api[14088]: 2017-09-28 12:59:49.738 14088 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:59:49 ctl02 nova-api[14088]: 2017-09-28 12:59:49.886 14088 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:59:49 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x464a7353)
Sep 28 12:59:50 ctl02 nova-api[14088]: 2017-09-28 12:59:50.136 14088 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:59:50 ctl02 nova-api[14088]: 2017-09-28 12:59:50.138 14088 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:59:50 ctl02 nova-api[14088]: 2017-09-28 12:59:50.139 14088 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:59:50 ctl02 nova-api[14088]: 2017-09-28 12:59:50.139 14088 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:59:50 ctl02 nova-api[14088]: 2017-09-28 12:59:50.273 14088 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:59:50 ctl02 nova-api[14088]: 2017-09-28 12:59:50.275 14088 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:59:50 ctl02 nova-api[14088]: 2017-09-28 12:59:50.275 14088 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:59:50 ctl02 nova-api[14088]: 2017-09-28 12:59:50.275 14088 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:59:50 ctl02 nova-api[14088]: 2017-09-28 12:59:50.279 14088 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:59:50 ctl02 nova-api[14088]: 2017-09-28 12:59:50.279 14088 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:59:50 ctl02 nova-api[14088]: 2017-09-28 12:59:50.279 14088 ERROR nova Traceback (most recent call last):
Sep 28 12:59:50 ctl02 nova-api[14088]: 2017-09-28 12:59:50.279 14088 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:59:50 ctl02 nova-api[14088]: 2017-09-28 12:59:50.279 14088 ERROR nova     sys.exit(main())
Sep 28 12:59:50 ctl02 nova-api[14088]: 2017-09-28 12:59:50.279 14088 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:59:50 ctl02 nova-api[14088]: 2017-09-28 12:59:50.279 14088 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:59:50 ctl02 nova-api[14088]: 2017-09-28 12:59:50.279 14088 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:59:50 ctl02 nova-api[14088]: 2017-09-28 12:59:50.279 14088 ERROR nova     max_url_len=max_url_len)
Sep 28 12:59:50 ctl02 nova-api[14088]: 2017-09-28 12:59:50.279 14088 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:59:50 ctl02 nova-api[14088]: 2017-09-28 12:59:50.279 14088 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:59:50 ctl02 nova-api[14088]: 2017-09-28 12:59:50.279 14088 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:59:50 ctl02 nova-api[14088]: 2017-09-28 12:59:50.279 14088 ERROR nova     sock.listen(backlog)
Sep 28 12:59:50 ctl02 nova-api[14088]: 2017-09-28 12:59:50.279 14088 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:59:50 ctl02 nova-api[14088]: 2017-09-28 12:59:50.279 14088 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:59:50 ctl02 nova-api[14088]: 2017-09-28 12:59:50.279 14088 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:59:50 ctl02 nova-api[14088]: 2017-09-28 12:59:50.279 14088 ERROR nova
Sep 28 12:59:50 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:59:50 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:59:50 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:59:50 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:59:50.449 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:59:50] "OPTIONS / HTTP/1.0" 200 134 0.000412
Sep 28 12:59:50 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:59:50 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:59:50 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:59:50 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:59:50 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x464a7353)
Sep 28 12:59:51 ctl02 neutron-server[30536]: 2017-09-28 12:59:51.059 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 4 dead agents out of 6:
Sep 28 12:59:51 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 12:59:51 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:59:06 cmp002
Sep 28 12:59:51 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:58:38 cmp001
Sep 28 12:59:51 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 12:58:00 cmp002
Sep 28 12:59:51 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:58:46 cmp002
Sep 28 12:59:51 ctl02 nova-conductor[5056]: 2017-09-28 12:59:51.249 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:59:51 ctl02 nova-conductor[5056]: 2017-09-28 12:59:51.254 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:59:51 ctl02 nova-conductor[5056]: 2017-09-28 12:59:51.254 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:59:51 ctl02 nova-conductor[5056]: 2017-09-28 12:59:51.266 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:59:51 ctl02 heat-api[13008]: 2017-09-28 12:59:51.420 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:59:51] "OPTIONS / HTTP/1.0" 200 134 0.000597
Sep 28 12:59:51 ctl02 nova-cert[4860]: 2017-09-28 12:59:51.815 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 12:59:51 ctl02 glance-api[29183]: 2017-09-28 12:59:51.859 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:59:51] "OPTIONS / HTTP/1.0" 200 134 0.000565
Sep 28 12:59:51 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 12:59:51 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 12:59:52 ctl02 neutron-server[30536]: 2017-09-28 12:59:52.039 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 12:59:52] "OPTIONS / HTTP/1.0" 200 262 0.000472
Sep 28 12:59:52 ctl02 nova-api[14106]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:59:52 ctl02 nova-api[14106]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:59:52 ctl02 nova-api[14106]: 2017-09-28 12:59:52.472 14106 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:59:52 ctl02 nova-api[14106]: 2017-09-28 12:59:52.473 14106 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:59:52 ctl02 nova-api[14106]: 2017-09-28 12:59:52.473 14106 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:59:52 ctl02 nova-api[14106]: 2017-09-28 12:59:52.473 14106 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:59:52 ctl02 nova-api[14106]: 2017-09-28 12:59:52.473 14106 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:59:52 ctl02 nova-api[14106]: 2017-09-28 12:59:52.473 14106 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:59:52 ctl02 nova-api[14106]: 2017-09-28 12:59:52.473 14106 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:59:52 ctl02 nova-api[14106]: 2017-09-28 12:59:52.473 14106 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:59:52 ctl02 nova-api[14106]: 2017-09-28 12:59:52.473 14106 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:59:52 ctl02 nova-api[14106]: 2017-09-28 12:59:52.473 14106 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:59:52 ctl02 nova-api[14106]: 2017-09-28 12:59:52.473 14106 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:59:52 ctl02 nova-api[14106]: 2017-09-28 12:59:52.473 14106 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:59:52 ctl02 nova-api[14106]: 2017-09-28 12:59:52.473 14106 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:59:52 ctl02 nova-api[14106]: 2017-09-28 12:59:52.473 14106 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:59:52 ctl02 nova-api[14106]: 2017-09-28 12:59:52.473 14106 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:59:52 ctl02 nova-api[14106]: 2017-09-28 12:59:52.473 14106 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:59:52 ctl02 nova-api[14106]: 2017-09-28 12:59:52.473 14106 ERROR nova.wsgi     self.filename))
Sep 28 12:59:52 ctl02 nova-api[14106]: 2017-09-28 12:59:52.473 14106 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:59:52 ctl02 nova-api[14106]: 2017-09-28 12:59:52.473 14106 ERROR nova.wsgi
Sep 28 12:59:52 ctl02 nova-api[14106]: 2017-09-28 12:59:52.476 14106 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:59:52 ctl02 nova-api[14106]: 2017-09-28 12:59:52.604 14106 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:59:52 ctl02 nova-api[14106]: 2017-09-28 12:59:52.829 14106 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:59:52 ctl02 nova-api[14106]: 2017-09-28 12:59:52.832 14106 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:59:52 ctl02 nova-api[14106]: 2017-09-28 12:59:52.833 14106 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:59:52 ctl02 nova-api[14106]: 2017-09-28 12:59:52.833 14106 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:59:52 ctl02 nova-api[14106]: 2017-09-28 12:59:52.966 14106 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:59:52 ctl02 nova-api[14106]: 2017-09-28 12:59:52.968 14106 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:59:52 ctl02 nova-api[14106]: 2017-09-28 12:59:52.968 14106 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:59:52 ctl02 nova-api[14106]: 2017-09-28 12:59:52.969 14106 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:59:52 ctl02 nova-api[14106]: 2017-09-28 12:59:52.972 14106 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:59:52 ctl02 nova-api[14106]: 2017-09-28 12:59:52.973 14106 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:59:52 ctl02 nova-api[14106]: 2017-09-28 12:59:52.973 14106 ERROR nova Traceback (most recent call last):
Sep 28 12:59:52 ctl02 nova-api[14106]: 2017-09-28 12:59:52.973 14106 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:59:52 ctl02 nova-api[14106]: 2017-09-28 12:59:52.973 14106 ERROR nova     sys.exit(main())
Sep 28 12:59:52 ctl02 nova-api[14106]: 2017-09-28 12:59:52.973 14106 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:59:52 ctl02 nova-api[14106]: 2017-09-28 12:59:52.973 14106 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:59:52 ctl02 nova-api[14106]: 2017-09-28 12:59:52.973 14106 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:59:52 ctl02 nova-api[14106]: 2017-09-28 12:59:52.973 14106 ERROR nova     max_url_len=max_url_len)
Sep 28 12:59:52 ctl02 nova-api[14106]: 2017-09-28 12:59:52.973 14106 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:59:52 ctl02 nova-api[14106]: 2017-09-28 12:59:52.973 14106 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:59:52 ctl02 nova-api[14106]: 2017-09-28 12:59:52.973 14106 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:59:52 ctl02 nova-api[14106]: 2017-09-28 12:59:52.973 14106 ERROR nova     sock.listen(backlog)
Sep 28 12:59:52 ctl02 nova-api[14106]: 2017-09-28 12:59:52.973 14106 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:59:52 ctl02 nova-api[14106]: 2017-09-28 12:59:52.973 14106 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:59:52 ctl02 nova-api[14106]: 2017-09-28 12:59:52.973 14106 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:59:52 ctl02 nova-api[14106]: 2017-09-28 12:59:52.973 14106 ERROR nova
Sep 28 12:59:53 ctl02 glance-api[29183]: 2017-09-28 12:59:53.076 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:59:53] "OPTIONS / HTTP/1.0" 200 134 0.000620
Sep 28 12:59:53 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:59:53 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:59:53 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:59:53 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:59:53 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:59:53 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:59:53 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:59:53 ctl02 heat-api[13008]: 2017-09-28 12:59:53.591 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:59:53] "OPTIONS / HTTP/1.0" 200 134 0.000559
Sep 28 12:59:55 ctl02 nova-api[14128]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:59:55 ctl02 nova-api[14128]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:59:55 ctl02 nova-api[14128]: 2017-09-28 12:59:55.254 14128 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:59:55 ctl02 nova-api[14128]: 2017-09-28 12:59:55.256 14128 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:59:55 ctl02 nova-api[14128]: 2017-09-28 12:59:55.256 14128 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:59:55 ctl02 nova-api[14128]: 2017-09-28 12:59:55.256 14128 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:59:55 ctl02 nova-api[14128]: 2017-09-28 12:59:55.256 14128 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:59:55 ctl02 nova-api[14128]: 2017-09-28 12:59:55.256 14128 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:59:55 ctl02 nova-api[14128]: 2017-09-28 12:59:55.256 14128 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:59:55 ctl02 nova-api[14128]: 2017-09-28 12:59:55.256 14128 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:59:55 ctl02 nova-api[14128]: 2017-09-28 12:59:55.256 14128 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:59:55 ctl02 nova-api[14128]: 2017-09-28 12:59:55.256 14128 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:59:55 ctl02 nova-api[14128]: 2017-09-28 12:59:55.256 14128 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:59:55 ctl02 nova-api[14128]: 2017-09-28 12:59:55.256 14128 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:59:55 ctl02 nova-api[14128]: 2017-09-28 12:59:55.256 14128 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:59:55 ctl02 nova-api[14128]: 2017-09-28 12:59:55.256 14128 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:59:55 ctl02 nova-api[14128]: 2017-09-28 12:59:55.256 14128 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:59:55 ctl02 nova-api[14128]: 2017-09-28 12:59:55.256 14128 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:59:55 ctl02 nova-api[14128]: 2017-09-28 12:59:55.256 14128 ERROR nova.wsgi     self.filename))
Sep 28 12:59:55 ctl02 nova-api[14128]: 2017-09-28 12:59:55.256 14128 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:59:55 ctl02 nova-api[14128]: 2017-09-28 12:59:55.256 14128 ERROR nova.wsgi
Sep 28 12:59:55 ctl02 nova-api[14128]: 2017-09-28 12:59:55.257 14128 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:59:55 ctl02 nova-api[14128]: 2017-09-28 12:59:55.388 14128 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:59:55 ctl02 neutron-server[30536]: 2017-09-28 12:59:55.398 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 12:59:55] "OPTIONS / HTTP/1.0" 200 262 0.000473
Sep 28 12:59:55 ctl02 nova-api[14128]: 2017-09-28 12:59:55.609 14128 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:59:55 ctl02 nova-api[14128]: 2017-09-28 12:59:55.611 14128 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:59:55 ctl02 nova-api[14128]: 2017-09-28 12:59:55.611 14128 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:59:55 ctl02 nova-api[14128]: 2017-09-28 12:59:55.611 14128 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:59:55 ctl02 heat-api-cfn[13300]: 2017-09-28 12:59:55.631 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:59:55] "OPTIONS / HTTP/1.0" 200 134 0.000557
Sep 28 12:59:55 ctl02 nova-api[14128]: 2017-09-28 12:59:55.742 14128 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:59:55 ctl02 nova-api[14128]: 2017-09-28 12:59:55.744 14128 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:59:55 ctl02 nova-api[14128]: 2017-09-28 12:59:55.744 14128 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:59:55 ctl02 nova-api[14128]: 2017-09-28 12:59:55.744 14128 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:59:55 ctl02 nova-api[14128]: 2017-09-28 12:59:55.747 14128 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:59:55 ctl02 nova-api[14128]: 2017-09-28 12:59:55.748 14128 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:59:55 ctl02 nova-api[14128]: 2017-09-28 12:59:55.748 14128 ERROR nova Traceback (most recent call last):
Sep 28 12:59:55 ctl02 nova-api[14128]: 2017-09-28 12:59:55.748 14128 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:59:55 ctl02 nova-api[14128]: 2017-09-28 12:59:55.748 14128 ERROR nova     sys.exit(main())
Sep 28 12:59:55 ctl02 nova-api[14128]: 2017-09-28 12:59:55.748 14128 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:59:55 ctl02 nova-api[14128]: 2017-09-28 12:59:55.748 14128 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:59:55 ctl02 nova-api[14128]: 2017-09-28 12:59:55.748 14128 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:59:55 ctl02 nova-api[14128]: 2017-09-28 12:59:55.748 14128 ERROR nova     max_url_len=max_url_len)
Sep 28 12:59:55 ctl02 nova-api[14128]: 2017-09-28 12:59:55.748 14128 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:59:55 ctl02 nova-api[14128]: 2017-09-28 12:59:55.748 14128 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:59:55 ctl02 nova-api[14128]: 2017-09-28 12:59:55.748 14128 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:59:55 ctl02 nova-api[14128]: 2017-09-28 12:59:55.748 14128 ERROR nova     sock.listen(backlog)
Sep 28 12:59:55 ctl02 nova-api[14128]: 2017-09-28 12:59:55.748 14128 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:59:55 ctl02 nova-api[14128]: 2017-09-28 12:59:55.748 14128 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:59:55 ctl02 nova-api[14128]: 2017-09-28 12:59:55.748 14128 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:59:55 ctl02 nova-api[14128]: 2017-09-28 12:59:55.748 14128 ERROR nova
Sep 28 12:59:55 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:59:55 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:59:55 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:59:56 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:59:56 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:59:56 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:59:56 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:59:56 ctl02 neutron-server[30536]: 2017-09-28 12:59:56.290 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 12:59:56] "OPTIONS / HTTP/1.0" 200 262 0.000521
Sep 28 12:59:56 ctl02 heat-api-cfn[13300]: 2017-09-28 12:59:56.341 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:59:56] "OPTIONS / HTTP/1.0" 200 134 0.000507
Sep 28 12:59:56 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:59:56.646 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 12:59:56] "OPTIONS / HTTP/1.0" 200 134 0.000430
Sep 28 12:59:56 ctl02 heat-api[13008]: 2017-09-28 12:59:56.853 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:59:56] "OPTIONS / HTTP/1.0" 200 134 0.000567
Sep 28 12:59:57 ctl02 nova-api[14147]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 12:59:57 ctl02 nova-api[14147]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 12:59:58 ctl02 nova-api[14147]: 2017-09-28 12:59:58.067 14147 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 12:59:58 ctl02 nova-api[14147]: 2017-09-28 12:59:58.069 14147 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 12:59:58 ctl02 nova-api[14147]: 2017-09-28 12:59:58.069 14147 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 12:59:58 ctl02 nova-api[14147]: 2017-09-28 12:59:58.069 14147 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 12:59:58 ctl02 nova-api[14147]: 2017-09-28 12:59:58.069 14147 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 12:59:58 ctl02 nova-api[14147]: 2017-09-28 12:59:58.069 14147 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 12:59:58 ctl02 nova-api[14147]: 2017-09-28 12:59:58.069 14147 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 12:59:58 ctl02 nova-api[14147]: 2017-09-28 12:59:58.069 14147 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 12:59:58 ctl02 nova-api[14147]: 2017-09-28 12:59:58.069 14147 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:59:58 ctl02 nova-api[14147]: 2017-09-28 12:59:58.069 14147 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 12:59:58 ctl02 nova-api[14147]: 2017-09-28 12:59:58.069 14147 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 12:59:58 ctl02 nova-api[14147]: 2017-09-28 12:59:58.069 14147 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 12:59:58 ctl02 nova-api[14147]: 2017-09-28 12:59:58.069 14147 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 12:59:58 ctl02 nova-api[14147]: 2017-09-28 12:59:58.069 14147 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 12:59:58 ctl02 nova-api[14147]: 2017-09-28 12:59:58.069 14147 ERROR nova.wsgi     object_type, name=name)
Sep 28 12:59:58 ctl02 nova-api[14147]: 2017-09-28 12:59:58.069 14147 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 12:59:58 ctl02 nova-api[14147]: 2017-09-28 12:59:58.069 14147 ERROR nova.wsgi     self.filename))
Sep 28 12:59:58 ctl02 nova-api[14147]: 2017-09-28 12:59:58.069 14147 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 12:59:58 ctl02 nova-api[14147]: 2017-09-28 12:59:58.069 14147 ERROR nova.wsgi
Sep 28 12:59:58 ctl02 nova-api[14147]: 2017-09-28 12:59:58.070 14147 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 12:59:58 ctl02 nova-api[14147]: 2017-09-28 12:59:58.205 14147 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 12:59:58 ctl02 nova-api[14147]: 2017-09-28 12:59:58.465 14147 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:59:58 ctl02 nova-api[14147]: 2017-09-28 12:59:58.467 14147 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:59:58 ctl02 nova-api[14147]: 2017-09-28 12:59:58.467 14147 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:59:58 ctl02 nova-api[14147]: 2017-09-28 12:59:58.468 14147 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:59:58 ctl02 neutron-server[30536]: 2017-09-28 12:59:58.546 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 12:59:58 ctl02 nova-api[14147]: 2017-09-28 12:59:58.602 14147 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 12:59:58 ctl02 nova-api[14147]: 2017-09-28 12:59:58.604 14147 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 12:59:58 ctl02 nova-api[14147]: 2017-09-28 12:59:58.604 14147 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 12:59:58 ctl02 nova-api[14147]: 2017-09-28 12:59:58.605 14147 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 12:59:58 ctl02 nova-api[14147]: 2017-09-28 12:59:58.608 14147 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 12:59:58 ctl02 nova-api[14147]: 2017-09-28 12:59:58.608 14147 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 12:59:58 ctl02 nova-api[14147]: 2017-09-28 12:59:58.608 14147 ERROR nova Traceback (most recent call last):
Sep 28 12:59:58 ctl02 nova-api[14147]: 2017-09-28 12:59:58.608 14147 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 12:59:58 ctl02 nova-api[14147]: 2017-09-28 12:59:58.608 14147 ERROR nova     sys.exit(main())
Sep 28 12:59:58 ctl02 nova-api[14147]: 2017-09-28 12:59:58.608 14147 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 12:59:58 ctl02 nova-api[14147]: 2017-09-28 12:59:58.608 14147 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 12:59:58 ctl02 nova-api[14147]: 2017-09-28 12:59:58.608 14147 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 12:59:58 ctl02 nova-api[14147]: 2017-09-28 12:59:58.608 14147 ERROR nova     max_url_len=max_url_len)
Sep 28 12:59:58 ctl02 nova-api[14147]: 2017-09-28 12:59:58.608 14147 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 12:59:58 ctl02 nova-api[14147]: 2017-09-28 12:59:58.608 14147 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 12:59:58 ctl02 nova-api[14147]: 2017-09-28 12:59:58.608 14147 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 12:59:58 ctl02 nova-api[14147]: 2017-09-28 12:59:58.608 14147 ERROR nova     sock.listen(backlog)
Sep 28 12:59:58 ctl02 nova-api[14147]: 2017-09-28 12:59:58.608 14147 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 12:59:58 ctl02 nova-api[14147]: 2017-09-28 12:59:58.608 14147 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 12:59:58 ctl02 nova-api[14147]: 2017-09-28 12:59:58.608 14147 ERROR nova error: [Errno 98] Address already in use
Sep 28 12:59:58 ctl02 nova-api[14147]: 2017-09-28 12:59:58.608 14147 ERROR nova
Sep 28 12:59:58 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 12:59:58 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 12:59:58 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 12:59:58 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 12:59:58.945 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:59:58] "OPTIONS / HTTP/1.0" 200 134 0.000519
Sep 28 12:59:59 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 12:59:59 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 12:59:59 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 12:59:59 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 12:59:59 ctl02 glance-api[29183]: 2017-09-28 12:59:59.172 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 12:59:59] "OPTIONS / HTTP/1.0" 200 134 0.000800
Sep 28 12:59:59 ctl02 heat-api-cfn[13300]: 2017-09-28 12:59:59.364 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 12:59:59] "OPTIONS / HTTP/1.0" 200 134 0.000625
Sep 28 13:00:00 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:00:00.484 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:00:00] "OPTIONS / HTTP/1.0" 200 134 0.000484
Sep 28 13:00:00 ctl02 nova-api[14165]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:00:00 ctl02 nova-api[14165]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:00:00 ctl02 nova-api[14165]: 2017-09-28 13:00:00.998 14165 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:00:01 ctl02 nova-api[14165]: 2017-09-28 13:00:00.999 14165 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:00:01 ctl02 nova-api[14165]: 2017-09-28 13:00:00.999 14165 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:00:01 ctl02 nova-api[14165]: 2017-09-28 13:00:00.999 14165 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:00:01 ctl02 nova-api[14165]: 2017-09-28 13:00:00.999 14165 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:00:01 ctl02 nova-api[14165]: 2017-09-28 13:00:00.999 14165 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:00:01 ctl02 nova-api[14165]: 2017-09-28 13:00:00.999 14165 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:00:01 ctl02 nova-api[14165]: 2017-09-28 13:00:00.999 14165 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:00:01 ctl02 nova-api[14165]: 2017-09-28 13:00:00.999 14165 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:00:01 ctl02 nova-api[14165]: 2017-09-28 13:00:00.999 14165 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:00:01 ctl02 nova-api[14165]: 2017-09-28 13:00:00.999 14165 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:00:01 ctl02 nova-api[14165]: 2017-09-28 13:00:00.999 14165 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:00:01 ctl02 nova-api[14165]: 2017-09-28 13:00:00.999 14165 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:00:01 ctl02 nova-api[14165]: 2017-09-28 13:00:00.999 14165 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:00:01 ctl02 nova-api[14165]: 2017-09-28 13:00:00.999 14165 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:00:01 ctl02 nova-api[14165]: 2017-09-28 13:00:00.999 14165 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:00:01 ctl02 nova-api[14165]: 2017-09-28 13:00:00.999 14165 ERROR nova.wsgi     self.filename))
Sep 28 13:00:01 ctl02 nova-api[14165]: 2017-09-28 13:00:00.999 14165 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:00:01 ctl02 nova-api[14165]: 2017-09-28 13:00:00.999 14165 ERROR nova.wsgi
Sep 28 13:00:01 ctl02 nova-api[14165]: 2017-09-28 13:00:01.002 14165 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:00:01 ctl02 heat-api[13008]: 2017-09-28 13:00:01.065 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:00:01] "OPTIONS / HTTP/1.0" 200 134 0.000778
Sep 28 13:00:01 ctl02 nova-api[14165]: 2017-09-28 13:00:01.133 14165 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:00:01 ctl02 nova-api[14165]: 2017-09-28 13:00:01.364 14165 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:00:01 ctl02 nova-api[14165]: 2017-09-28 13:00:01.367 14165 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:00:01 ctl02 nova-api[14165]: 2017-09-28 13:00:01.379 14165 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:00:01 ctl02 nova-api[14165]: 2017-09-28 13:00:01.379 14165 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:00:01 ctl02 nova-api[14165]: 2017-09-28 13:00:01.510 14165 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:00:01 ctl02 nova-api[14165]: 2017-09-28 13:00:01.513 14165 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:00:01 ctl02 nova-api[14165]: 2017-09-28 13:00:01.513 14165 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:00:01 ctl02 nova-api[14165]: 2017-09-28 13:00:01.513 14165 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:00:01 ctl02 nova-api[14165]: 2017-09-28 13:00:01.517 14165 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:00:01 ctl02 nova-api[14165]: 2017-09-28 13:00:01.517 14165 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:00:01 ctl02 nova-api[14165]: 2017-09-28 13:00:01.517 14165 ERROR nova Traceback (most recent call last):
Sep 28 13:00:01 ctl02 nova-api[14165]: 2017-09-28 13:00:01.517 14165 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:00:01 ctl02 nova-api[14165]: 2017-09-28 13:00:01.517 14165 ERROR nova     sys.exit(main())
Sep 28 13:00:01 ctl02 nova-api[14165]: 2017-09-28 13:00:01.517 14165 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:00:01 ctl02 nova-api[14165]: 2017-09-28 13:00:01.517 14165 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:00:01 ctl02 nova-api[14165]: 2017-09-28 13:00:01.517 14165 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:00:01 ctl02 nova-api[14165]: 2017-09-28 13:00:01.517 14165 ERROR nova     max_url_len=max_url_len)
Sep 28 13:00:01 ctl02 nova-api[14165]: 2017-09-28 13:00:01.517 14165 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:00:01 ctl02 nova-api[14165]: 2017-09-28 13:00:01.517 14165 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:00:01 ctl02 nova-api[14165]: 2017-09-28 13:00:01.517 14165 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:00:01 ctl02 nova-api[14165]: 2017-09-28 13:00:01.517 14165 ERROR nova     sock.listen(backlog)
Sep 28 13:00:01 ctl02 nova-api[14165]: 2017-09-28 13:00:01.517 14165 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:00:01 ctl02 nova-api[14165]: 2017-09-28 13:00:01.517 14165 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:00:01 ctl02 nova-api[14165]: 2017-09-28 13:00:01.517 14165 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:00:01 ctl02 nova-api[14165]: 2017-09-28 13:00:01.517 14165 ERROR nova
Sep 28 13:00:01 ctl02 nova-consoleauth[5433]: 2017-09-28 13:00:01.653 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:00:01 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:00:01 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:00:01 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:00:01 ctl02 neutron-server[30536]: 2017-09-28 13:00:01.803 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:00:01] "OPTIONS / HTTP/1.0" 200 262 0.000659
Sep 28 13:00:01 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:00:01 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:00:01 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:00:01 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:00:02 ctl02 glance-api[29183]: 2017-09-28 13:00:02.194 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:00:02] "OPTIONS / HTTP/1.0" 200 134 0.000658
Sep 28 13:00:02 ctl02 heat-engine[12803]: 2017-09-28 13:00:02.377 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:00:02 ctl02 heat-engine[12803]: 2017-09-28 13:00:02.399 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:00:02 ctl02 heat-engine[12803]: 2017-09-28 13:00:02.404 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:00:02 ctl02 heat-engine[12803]: 2017-09-28 13:00:02.407 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:00:02 ctl02 glance-api[29183]: 2017-09-28 13:00:02.753 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:00:02] "OPTIONS / HTTP/1.0" 200 134 0.000659
Sep 28 13:00:03 ctl02 nova-api[14183]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:00:03 ctl02 nova-api[14183]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:00:03 ctl02 nova-api[14183]: 2017-09-28 13:00:03.798 14183 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:00:03 ctl02 nova-api[14183]: 2017-09-28 13:00:03.799 14183 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:00:03 ctl02 nova-api[14183]: 2017-09-28 13:00:03.799 14183 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:00:03 ctl02 nova-api[14183]: 2017-09-28 13:00:03.799 14183 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:00:03 ctl02 nova-api[14183]: 2017-09-28 13:00:03.799 14183 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:00:03 ctl02 nova-api[14183]: 2017-09-28 13:00:03.799 14183 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:00:03 ctl02 nova-api[14183]: 2017-09-28 13:00:03.799 14183 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:00:03 ctl02 nova-api[14183]: 2017-09-28 13:00:03.799 14183 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:00:03 ctl02 nova-api[14183]: 2017-09-28 13:00:03.799 14183 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:00:03 ctl02 nova-api[14183]: 2017-09-28 13:00:03.799 14183 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:00:03 ctl02 nova-api[14183]: 2017-09-28 13:00:03.799 14183 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:00:03 ctl02 nova-api[14183]: 2017-09-28 13:00:03.799 14183 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:00:03 ctl02 nova-api[14183]: 2017-09-28 13:00:03.799 14183 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:00:03 ctl02 nova-api[14183]: 2017-09-28 13:00:03.799 14183 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:00:03 ctl02 nova-api[14183]: 2017-09-28 13:00:03.799 14183 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:00:03 ctl02 nova-api[14183]: 2017-09-28 13:00:03.799 14183 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:00:03 ctl02 nova-api[14183]: 2017-09-28 13:00:03.799 14183 ERROR nova.wsgi     self.filename))
Sep 28 13:00:03 ctl02 nova-api[14183]: 2017-09-28 13:00:03.799 14183 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:00:03 ctl02 nova-api[14183]: 2017-09-28 13:00:03.799 14183 ERROR nova.wsgi
Sep 28 13:00:03 ctl02 nova-api[14183]: 2017-09-28 13:00:03.800 14183 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:00:03 ctl02 heat-api[13008]: 2017-09-28 13:00:03.915 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:00:03] "OPTIONS / HTTP/1.0" 200 134 0.000505
Sep 28 13:00:03 ctl02 nova-api[14183]: 2017-09-28 13:00:03.927 14183 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:00:04 ctl02 nova-api[14183]: 2017-09-28 13:00:04.140 14183 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:00:04 ctl02 nova-api[14183]: 2017-09-28 13:00:04.142 14183 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:00:04 ctl02 nova-api[14183]: 2017-09-28 13:00:04.142 14183 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:00:04 ctl02 nova-api[14183]: 2017-09-28 13:00:04.143 14183 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:00:04 ctl02 nova-api[14183]: 2017-09-28 13:00:04.273 14183 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:00:04 ctl02 nova-api[14183]: 2017-09-28 13:00:04.275 14183 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:00:04 ctl02 nova-api[14183]: 2017-09-28 13:00:04.275 14183 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:00:04 ctl02 nova-api[14183]: 2017-09-28 13:00:04.276 14183 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:00:04 ctl02 nova-api[14183]: 2017-09-28 13:00:04.279 14183 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:00:04 ctl02 nova-api[14183]: 2017-09-28 13:00:04.279 14183 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:00:04 ctl02 nova-api[14183]: 2017-09-28 13:00:04.279 14183 ERROR nova Traceback (most recent call last):
Sep 28 13:00:04 ctl02 nova-api[14183]: 2017-09-28 13:00:04.279 14183 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:00:04 ctl02 nova-api[14183]: 2017-09-28 13:00:04.279 14183 ERROR nova     sys.exit(main())
Sep 28 13:00:04 ctl02 nova-api[14183]: 2017-09-28 13:00:04.279 14183 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:00:04 ctl02 nova-api[14183]: 2017-09-28 13:00:04.279 14183 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:00:04 ctl02 nova-api[14183]: 2017-09-28 13:00:04.279 14183 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:00:04 ctl02 nova-api[14183]: 2017-09-28 13:00:04.279 14183 ERROR nova     max_url_len=max_url_len)
Sep 28 13:00:04 ctl02 nova-api[14183]: 2017-09-28 13:00:04.279 14183 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:00:04 ctl02 nova-api[14183]: 2017-09-28 13:00:04.279 14183 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:00:04 ctl02 nova-api[14183]: 2017-09-28 13:00:04.279 14183 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:00:04 ctl02 nova-api[14183]: 2017-09-28 13:00:04.279 14183 ERROR nova     sock.listen(backlog)
Sep 28 13:00:04 ctl02 nova-api[14183]: 2017-09-28 13:00:04.279 14183 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:00:04 ctl02 nova-api[14183]: 2017-09-28 13:00:04.279 14183 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:00:04 ctl02 nova-api[14183]: 2017-09-28 13:00:04.279 14183 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:00:04 ctl02 nova-api[14183]: 2017-09-28 13:00:04.279 14183 ERROR nova
Sep 28 13:00:04 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:00:04 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:00:04 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:00:04 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:00:04 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:00:04 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:00:04 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:00:04 ctl02 nova-scheduler[5620]: 2017-09-28 13:00:04.762 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:00:05 ctl02 neutron-server[30536]: 2017-09-28 13:00:05.101 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:00:05] "OPTIONS / HTTP/1.0" 200 262 0.000726
Sep 28 13:00:05 ctl02 heat-api-cfn[13300]: 2017-09-28 13:00:05.266 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:00:05] "OPTIONS / HTTP/1.0" 200 134 0.000498
Sep 28 13:00:06 ctl02 neutron-server[30536]: 2017-09-28 13:00:06.055 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 13:00:06 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 13:00:06 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:59:06 cmp002
Sep 28 13:00:06 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:58:38 cmp001
Sep 28 13:00:06 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:58:46 cmp002
Sep 28 13:00:06 ctl02 heat-api-cfn[13300]: 2017-09-28 13:00:06.206 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:00:06] "OPTIONS / HTTP/1.0" 200 134 0.000527
Sep 28 13:00:06 ctl02 nova-api[14200]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:00:06 ctl02 nova-api[14200]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:00:06 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:00:06.432 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:00:06] "OPTIONS / HTTP/1.0" 200 134 0.000379
Sep 28 13:00:06 ctl02 nova-api[14200]: 2017-09-28 13:00:06.476 14200 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:00:06 ctl02 nova-api[14200]: 2017-09-28 13:00:06.477 14200 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:00:06 ctl02 nova-api[14200]: 2017-09-28 13:00:06.477 14200 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:00:06 ctl02 nova-api[14200]: 2017-09-28 13:00:06.477 14200 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:00:06 ctl02 nova-api[14200]: 2017-09-28 13:00:06.477 14200 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:00:06 ctl02 nova-api[14200]: 2017-09-28 13:00:06.477 14200 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:00:06 ctl02 nova-api[14200]: 2017-09-28 13:00:06.477 14200 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:00:06 ctl02 nova-api[14200]: 2017-09-28 13:00:06.477 14200 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:00:06 ctl02 nova-api[14200]: 2017-09-28 13:00:06.477 14200 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:00:06 ctl02 nova-api[14200]: 2017-09-28 13:00:06.477 14200 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:00:06 ctl02 nova-api[14200]: 2017-09-28 13:00:06.477 14200 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:00:06 ctl02 nova-api[14200]: 2017-09-28 13:00:06.477 14200 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:00:06 ctl02 nova-api[14200]: 2017-09-28 13:00:06.477 14200 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:00:06 ctl02 nova-api[14200]: 2017-09-28 13:00:06.477 14200 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:00:06 ctl02 nova-api[14200]: 2017-09-28 13:00:06.477 14200 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:00:06 ctl02 nova-api[14200]: 2017-09-28 13:00:06.477 14200 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:00:06 ctl02 nova-api[14200]: 2017-09-28 13:00:06.477 14200 ERROR nova.wsgi     self.filename))
Sep 28 13:00:06 ctl02 nova-api[14200]: 2017-09-28 13:00:06.477 14200 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:00:06 ctl02 nova-api[14200]: 2017-09-28 13:00:06.477 14200 ERROR nova.wsgi
Sep 28 13:00:06 ctl02 nova-api[14200]: 2017-09-28 13:00:06.478 14200 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:00:06 ctl02 nova-api[14200]: 2017-09-28 13:00:06.605 14200 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:00:06 ctl02 neutron-server[30536]: 2017-09-28 13:00:06.675 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:00:06] "OPTIONS / HTTP/1.0" 200 262 0.000461
Sep 28 13:00:06 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8bb06d28)
Sep 28 13:00:06 ctl02 nova-api[14200]: 2017-09-28 13:00:06.827 14200 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:00:06 ctl02 nova-api[14200]: 2017-09-28 13:00:06.829 14200 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:00:06 ctl02 nova-api[14200]: 2017-09-28 13:00:06.830 14200 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:00:06 ctl02 nova-api[14200]: 2017-09-28 13:00:06.830 14200 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:00:06 ctl02 heat-api[13008]: 2017-09-28 13:00:06.945 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:00:06] "OPTIONS / HTTP/1.0" 200 134 0.000571
Sep 28 13:00:06 ctl02 nova-api[14200]: 2017-09-28 13:00:06.962 14200 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:00:06 ctl02 nova-api[14200]: 2017-09-28 13:00:06.963 14200 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:00:06 ctl02 nova-api[14200]: 2017-09-28 13:00:06.963 14200 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:00:06 ctl02 nova-api[14200]: 2017-09-28 13:00:06.964 14200 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:00:06 ctl02 nova-api[14200]: 2017-09-28 13:00:06.967 14200 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:00:06 ctl02 nova-api[14200]: 2017-09-28 13:00:06.967 14200 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:00:06 ctl02 nova-api[14200]: 2017-09-28 13:00:06.967 14200 ERROR nova Traceback (most recent call last):
Sep 28 13:00:06 ctl02 nova-api[14200]: 2017-09-28 13:00:06.967 14200 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:00:06 ctl02 nova-api[14200]: 2017-09-28 13:00:06.967 14200 ERROR nova     sys.exit(main())
Sep 28 13:00:06 ctl02 nova-api[14200]: 2017-09-28 13:00:06.967 14200 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:00:06 ctl02 nova-api[14200]: 2017-09-28 13:00:06.967 14200 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:00:06 ctl02 nova-api[14200]: 2017-09-28 13:00:06.967 14200 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:00:06 ctl02 nova-api[14200]: 2017-09-28 13:00:06.967 14200 ERROR nova     max_url_len=max_url_len)
Sep 28 13:00:06 ctl02 nova-api[14200]: 2017-09-28 13:00:06.967 14200 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:00:06 ctl02 nova-api[14200]: 2017-09-28 13:00:06.967 14200 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:00:06 ctl02 nova-api[14200]: 2017-09-28 13:00:06.967 14200 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:00:06 ctl02 nova-api[14200]: 2017-09-28 13:00:06.967 14200 ERROR nova     sock.listen(backlog)
Sep 28 13:00:06 ctl02 nova-api[14200]: 2017-09-28 13:00:06.967 14200 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:00:06 ctl02 nova-api[14200]: 2017-09-28 13:00:06.967 14200 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:00:06 ctl02 nova-api[14200]: 2017-09-28 13:00:06.967 14200 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:00:06 ctl02 nova-api[14200]: 2017-09-28 13:00:06.967 14200 ERROR nova
Sep 28 13:00:07 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:00:07 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:00:07 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:00:07 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:00:07 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:00:07 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:00:07 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:00:07 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8bb06d28)
Sep 28 13:00:08 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:00:08.592 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:00:08] "OPTIONS / HTTP/1.0" 200 134 0.000538
Sep 28 13:00:08 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8bb06d28)
Sep 28 13:00:09 ctl02 glance-api[29183]: 2017-09-28 13:00:09.081 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:00:09] "OPTIONS / HTTP/1.0" 200 134 0.000701
Sep 28 13:00:09 ctl02 nova-api[14219]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:00:09 ctl02 nova-api[14219]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:00:09 ctl02 nova-api[14219]: 2017-09-28 13:00:09.316 14219 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:00:09 ctl02 nova-api[14219]: 2017-09-28 13:00:09.318 14219 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:00:09 ctl02 nova-api[14219]: 2017-09-28 13:00:09.318 14219 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:00:09 ctl02 nova-api[14219]: 2017-09-28 13:00:09.318 14219 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:00:09 ctl02 nova-api[14219]: 2017-09-28 13:00:09.318 14219 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:00:09 ctl02 nova-api[14219]: 2017-09-28 13:00:09.318 14219 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:00:09 ctl02 nova-api[14219]: 2017-09-28 13:00:09.318 14219 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:00:09 ctl02 nova-api[14219]: 2017-09-28 13:00:09.318 14219 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:00:09 ctl02 nova-api[14219]: 2017-09-28 13:00:09.318 14219 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:00:09 ctl02 nova-api[14219]: 2017-09-28 13:00:09.318 14219 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:00:09 ctl02 nova-api[14219]: 2017-09-28 13:00:09.318 14219 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:00:09 ctl02 nova-api[14219]: 2017-09-28 13:00:09.318 14219 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:00:09 ctl02 nova-api[14219]: 2017-09-28 13:00:09.318 14219 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:00:09 ctl02 nova-api[14219]: 2017-09-28 13:00:09.318 14219 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:00:09 ctl02 nova-api[14219]: 2017-09-28 13:00:09.318 14219 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:00:09 ctl02 nova-api[14219]: 2017-09-28 13:00:09.318 14219 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:00:09 ctl02 nova-api[14219]: 2017-09-28 13:00:09.318 14219 ERROR nova.wsgi     self.filename))
Sep 28 13:00:09 ctl02 nova-api[14219]: 2017-09-28 13:00:09.318 14219 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:00:09 ctl02 nova-api[14219]: 2017-09-28 13:00:09.318 14219 ERROR nova.wsgi
Sep 28 13:00:09 ctl02 nova-api[14219]: 2017-09-28 13:00:09.320 14219 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:00:09 ctl02 heat-api-cfn[13300]: 2017-09-28 13:00:09.324 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:00:09] "OPTIONS / HTTP/1.0" 200 134 0.000500
Sep 28 13:00:09 ctl02 nova-api[14219]: 2017-09-28 13:00:09.456 14219 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:00:09 ctl02 nova-api[14219]: 2017-09-28 13:00:09.711 14219 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:00:09 ctl02 nova-api[14219]: 2017-09-28 13:00:09.714 14219 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:00:09 ctl02 nova-api[14219]: 2017-09-28 13:00:09.714 14219 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:00:09 ctl02 nova-api[14219]: 2017-09-28 13:00:09.714 14219 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:00:09 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8bb06d28)
Sep 28 13:00:09 ctl02 nova-api[14219]: 2017-09-28 13:00:09.850 14219 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:00:09 ctl02 nova-api[14219]: 2017-09-28 13:00:09.852 14219 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:00:09 ctl02 nova-api[14219]: 2017-09-28 13:00:09.853 14219 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:00:09 ctl02 nova-api[14219]: 2017-09-28 13:00:09.853 14219 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:00:09 ctl02 nova-api[14219]: 2017-09-28 13:00:09.857 14219 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:00:09 ctl02 nova-api[14219]: 2017-09-28 13:00:09.857 14219 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:00:09 ctl02 nova-api[14219]: 2017-09-28 13:00:09.857 14219 ERROR nova Traceback (most recent call last):
Sep 28 13:00:09 ctl02 nova-api[14219]: 2017-09-28 13:00:09.857 14219 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:00:09 ctl02 nova-api[14219]: 2017-09-28 13:00:09.857 14219 ERROR nova     sys.exit(main())
Sep 28 13:00:09 ctl02 nova-api[14219]: 2017-09-28 13:00:09.857 14219 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:00:09 ctl02 nova-api[14219]: 2017-09-28 13:00:09.857 14219 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:00:09 ctl02 nova-api[14219]: 2017-09-28 13:00:09.857 14219 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:00:09 ctl02 nova-api[14219]: 2017-09-28 13:00:09.857 14219 ERROR nova     max_url_len=max_url_len)
Sep 28 13:00:09 ctl02 nova-api[14219]: 2017-09-28 13:00:09.857 14219 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:00:09 ctl02 nova-api[14219]: 2017-09-28 13:00:09.857 14219 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:00:09 ctl02 nova-api[14219]: 2017-09-28 13:00:09.857 14219 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:00:09 ctl02 nova-api[14219]: 2017-09-28 13:00:09.857 14219 ERROR nova     sock.listen(backlog)
Sep 28 13:00:09 ctl02 nova-api[14219]: 2017-09-28 13:00:09.857 14219 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:00:09 ctl02 nova-api[14219]: 2017-09-28 13:00:09.857 14219 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:00:09 ctl02 nova-api[14219]: 2017-09-28 13:00:09.857 14219 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:00:09 ctl02 nova-api[14219]: 2017-09-28 13:00:09.857 14219 ERROR nova
Sep 28 13:00:10 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:00:10 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:00:10 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:00:10 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:00:10 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:00:10 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:00:10 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:00:10 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:00:10.685 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:00:10] "OPTIONS / HTTP/1.0" 200 134 0.000450
Sep 28 13:00:10 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8bb06d28)
Sep 28 13:00:10 ctl02 heat-api[13008]: 2017-09-28 13:00:10.776 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:00:10] "OPTIONS / HTTP/1.0" 200 134 0.000588
Sep 28 13:00:11 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8bb06d28)
Sep 28 13:00:11 ctl02 neutron-server[30536]: 2017-09-28 13:00:11.977 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:00:11] "OPTIONS / HTTP/1.0" 200 262 0.000529
Sep 28 13:00:12 ctl02 nova-api[14237]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:00:12 ctl02 nova-api[14237]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:00:12 ctl02 nova-api[14237]: 2017-09-28 13:00:12.301 14237 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:00:12 ctl02 nova-api[14237]: 2017-09-28 13:00:12.302 14237 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:00:12 ctl02 nova-api[14237]: 2017-09-28 13:00:12.302 14237 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:00:12 ctl02 nova-api[14237]: 2017-09-28 13:00:12.302 14237 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:00:12 ctl02 nova-api[14237]: 2017-09-28 13:00:12.302 14237 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:00:12 ctl02 nova-api[14237]: 2017-09-28 13:00:12.302 14237 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:00:12 ctl02 nova-api[14237]: 2017-09-28 13:00:12.302 14237 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:00:12 ctl02 nova-api[14237]: 2017-09-28 13:00:12.302 14237 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:00:12 ctl02 nova-api[14237]: 2017-09-28 13:00:12.302 14237 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:00:12 ctl02 nova-api[14237]: 2017-09-28 13:00:12.302 14237 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:00:12 ctl02 nova-api[14237]: 2017-09-28 13:00:12.302 14237 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:00:12 ctl02 nova-api[14237]: 2017-09-28 13:00:12.302 14237 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:00:12 ctl02 nova-api[14237]: 2017-09-28 13:00:12.302 14237 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:00:12 ctl02 nova-api[14237]: 2017-09-28 13:00:12.302 14237 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:00:12 ctl02 nova-api[14237]: 2017-09-28 13:00:12.302 14237 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:00:12 ctl02 nova-api[14237]: 2017-09-28 13:00:12.302 14237 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:00:12 ctl02 nova-api[14237]: 2017-09-28 13:00:12.302 14237 ERROR nova.wsgi     self.filename))
Sep 28 13:00:12 ctl02 nova-api[14237]: 2017-09-28 13:00:12.302 14237 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:00:12 ctl02 nova-api[14237]: 2017-09-28 13:00:12.302 14237 ERROR nova.wsgi
Sep 28 13:00:12 ctl02 nova-api[14237]: 2017-09-28 13:00:12.303 14237 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:00:12 ctl02 glance-api[29183]: 2017-09-28 13:00:12.350 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:00:12] "OPTIONS / HTTP/1.0" 200 134 0.000637
Sep 28 13:00:12 ctl02 nova-api[14237]: 2017-09-28 13:00:12.441 14237 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:00:12 ctl02 glance-api[29183]: 2017-09-28 13:00:12.568 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:00:12] "OPTIONS / HTTP/1.0" 200 134 0.000689
Sep 28 13:00:12 ctl02 nova-api[14237]: 2017-09-28 13:00:12.698 14237 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:00:12 ctl02 nova-api[14237]: 2017-09-28 13:00:12.701 14237 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:00:12 ctl02 nova-api[14237]: 2017-09-28 13:00:12.701 14237 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:00:12 ctl02 nova-api[14237]: 2017-09-28 13:00:12.701 14237 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:00:12 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8bb06d28)
Sep 28 13:00:12 ctl02 nova-api[14237]: 2017-09-28 13:00:12.839 14237 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:00:12 ctl02 nova-api[14237]: 2017-09-28 13:00:12.842 14237 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:00:12 ctl02 nova-api[14237]: 2017-09-28 13:00:12.842 14237 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:00:12 ctl02 nova-api[14237]: 2017-09-28 13:00:12.843 14237 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:00:12 ctl02 nova-api[14237]: 2017-09-28 13:00:12.847 14237 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:00:12 ctl02 nova-api[14237]: 2017-09-28 13:00:12.847 14237 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:00:12 ctl02 nova-api[14237]: 2017-09-28 13:00:12.847 14237 ERROR nova Traceback (most recent call last):
Sep 28 13:00:12 ctl02 nova-api[14237]: 2017-09-28 13:00:12.847 14237 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:00:12 ctl02 nova-api[14237]: 2017-09-28 13:00:12.847 14237 ERROR nova     sys.exit(main())
Sep 28 13:00:12 ctl02 nova-api[14237]: 2017-09-28 13:00:12.847 14237 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:00:12 ctl02 nova-api[14237]: 2017-09-28 13:00:12.847 14237 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:00:12 ctl02 nova-api[14237]: 2017-09-28 13:00:12.847 14237 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:00:12 ctl02 nova-api[14237]: 2017-09-28 13:00:12.847 14237 ERROR nova     max_url_len=max_url_len)
Sep 28 13:00:12 ctl02 nova-api[14237]: 2017-09-28 13:00:12.847 14237 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:00:12 ctl02 nova-api[14237]: 2017-09-28 13:00:12.847 14237 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:00:12 ctl02 nova-api[14237]: 2017-09-28 13:00:12.847 14237 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:00:12 ctl02 nova-api[14237]: 2017-09-28 13:00:12.847 14237 ERROR nova     sock.listen(backlog)
Sep 28 13:00:12 ctl02 nova-api[14237]: 2017-09-28 13:00:12.847 14237 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:00:12 ctl02 nova-api[14237]: 2017-09-28 13:00:12.847 14237 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:00:12 ctl02 nova-api[14237]: 2017-09-28 13:00:12.847 14237 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:00:12 ctl02 nova-api[14237]: 2017-09-28 13:00:12.847 14237 ERROR nova
Sep 28 13:00:13 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:00:13 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:00:13 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:00:13 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:00:13 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:00:13 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:00:13 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:00:13 ctl02 neutron-server[30536]: 2017-09-28 13:00:13.544 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 13:00:13 ctl02 heat-api[13008]: 2017-09-28 13:00:13.717 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:00:13] "OPTIONS / HTTP/1.0" 200 134 0.000643
Sep 28 13:00:13 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8bb06d28)
Sep 28 13:00:14 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8bb06d28)
Sep 28 13:00:14 ctl02 nova-api[14255]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:00:14 ctl02 nova-api[14255]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:00:14 ctl02 neutron-server[30536]: 2017-09-28 13:00:14.830 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:00:14] "OPTIONS / HTTP/1.0" 200 262 0.000526
Sep 28 13:00:15 ctl02 nova-api[14255]: 2017-09-28 13:00:15.022 14255 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:00:15 ctl02 nova-api[14255]: 2017-09-28 13:00:15.023 14255 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:00:15 ctl02 nova-api[14255]: 2017-09-28 13:00:15.023 14255 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:00:15 ctl02 nova-api[14255]: 2017-09-28 13:00:15.023 14255 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:00:15 ctl02 nova-api[14255]: 2017-09-28 13:00:15.023 14255 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:00:15 ctl02 nova-api[14255]: 2017-09-28 13:00:15.023 14255 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:00:15 ctl02 nova-api[14255]: 2017-09-28 13:00:15.023 14255 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:00:15 ctl02 nova-api[14255]: 2017-09-28 13:00:15.023 14255 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:00:15 ctl02 nova-api[14255]: 2017-09-28 13:00:15.023 14255 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:00:15 ctl02 nova-api[14255]: 2017-09-28 13:00:15.023 14255 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:00:15 ctl02 nova-api[14255]: 2017-09-28 13:00:15.023 14255 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:00:15 ctl02 nova-api[14255]: 2017-09-28 13:00:15.023 14255 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:00:15 ctl02 nova-api[14255]: 2017-09-28 13:00:15.023 14255 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:00:15 ctl02 nova-api[14255]: 2017-09-28 13:00:15.023 14255 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:00:15 ctl02 nova-api[14255]: 2017-09-28 13:00:15.023 14255 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:00:15 ctl02 nova-api[14255]: 2017-09-28 13:00:15.023 14255 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:00:15 ctl02 nova-api[14255]: 2017-09-28 13:00:15.023 14255 ERROR nova.wsgi     self.filename))
Sep 28 13:00:15 ctl02 nova-api[14255]: 2017-09-28 13:00:15.023 14255 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:00:15 ctl02 nova-api[14255]: 2017-09-28 13:00:15.023 14255 ERROR nova.wsgi
Sep 28 13:00:15 ctl02 nova-api[14255]: 2017-09-28 13:00:15.026 14255 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:00:15 ctl02 nova-api[14255]: 2017-09-28 13:00:15.156 14255 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:00:15 ctl02 heat-api-cfn[13300]: 2017-09-28 13:00:15.196 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:00:15] "OPTIONS / HTTP/1.0" 200 134 0.000592
Sep 28 13:00:15 ctl02 nova-api[14255]: 2017-09-28 13:00:15.405 14255 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:00:15 ctl02 nova-api[14255]: 2017-09-28 13:00:15.408 14255 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:00:15 ctl02 nova-api[14255]: 2017-09-28 13:00:15.408 14255 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:00:15 ctl02 nova-api[14255]: 2017-09-28 13:00:15.409 14255 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:00:15 ctl02 nova-api[14255]: 2017-09-28 13:00:15.541 14255 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:00:15 ctl02 nova-api[14255]: 2017-09-28 13:00:15.543 14255 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:00:15 ctl02 nova-api[14255]: 2017-09-28 13:00:15.544 14255 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:00:15 ctl02 nova-api[14255]: 2017-09-28 13:00:15.544 14255 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:00:15 ctl02 nova-api[14255]: 2017-09-28 13:00:15.548 14255 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:00:15 ctl02 nova-api[14255]: 2017-09-28 13:00:15.548 14255 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:00:15 ctl02 nova-api[14255]: 2017-09-28 13:00:15.548 14255 ERROR nova Traceback (most recent call last):
Sep 28 13:00:15 ctl02 nova-api[14255]: 2017-09-28 13:00:15.548 14255 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:00:15 ctl02 nova-api[14255]: 2017-09-28 13:00:15.548 14255 ERROR nova     sys.exit(main())
Sep 28 13:00:15 ctl02 nova-api[14255]: 2017-09-28 13:00:15.548 14255 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:00:15 ctl02 nova-api[14255]: 2017-09-28 13:00:15.548 14255 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:00:15 ctl02 nova-api[14255]: 2017-09-28 13:00:15.548 14255 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:00:15 ctl02 nova-api[14255]: 2017-09-28 13:00:15.548 14255 ERROR nova     max_url_len=max_url_len)
Sep 28 13:00:15 ctl02 nova-api[14255]: 2017-09-28 13:00:15.548 14255 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:00:15 ctl02 nova-api[14255]: 2017-09-28 13:00:15.548 14255 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:00:15 ctl02 nova-api[14255]: 2017-09-28 13:00:15.548 14255 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:00:15 ctl02 nova-api[14255]: 2017-09-28 13:00:15.548 14255 ERROR nova     sock.listen(backlog)
Sep 28 13:00:15 ctl02 nova-api[14255]: 2017-09-28 13:00:15.548 14255 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:00:15 ctl02 nova-api[14255]: 2017-09-28 13:00:15.548 14255 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:00:15 ctl02 nova-api[14255]: 2017-09-28 13:00:15.548 14255 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:00:15 ctl02 nova-api[14255]: 2017-09-28 13:00:15.548 14255 ERROR nova
Sep 28 13:00:15 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:00:15 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:00:15 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:00:15 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8bb06d28)
Sep 28 13:00:15 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:00:15 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:00:15 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:00:15 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:00:16 ctl02 heat-api-cfn[13300]: 2017-09-28 13:00:16.068 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:00:16] "OPTIONS / HTTP/1.0" 200 134 0.000481
Sep 28 13:00:16 ctl02 neutron-server[30536]: 2017-09-28 13:00:16.650 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:00:16] "OPTIONS / HTTP/1.0" 200 262 0.000469
Sep 28 13:00:16 ctl02 heat-api[13008]: 2017-09-28 13:00:16.663 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:00:16] "OPTIONS / HTTP/1.0" 200 134 0.000577
Sep 28 13:00:16 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8bb06d28)
Sep 28 13:00:16 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:00:16.811 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:00:16] "OPTIONS / HTTP/1.0" 200 134 0.000379
Sep 28 13:00:17 ctl02 nova-api[14273]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:00:17 ctl02 nova-api[14273]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:00:17 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 13:00:17 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 13:00:17 ctl02 nova-api[14273]: 2017-09-28 13:00:17.769 14273 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:00:17 ctl02 nova-api[14273]: 2017-09-28 13:00:17.770 14273 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:00:17 ctl02 nova-api[14273]: 2017-09-28 13:00:17.770 14273 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:00:17 ctl02 nova-api[14273]: 2017-09-28 13:00:17.770 14273 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:00:17 ctl02 nova-api[14273]: 2017-09-28 13:00:17.770 14273 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:00:17 ctl02 nova-api[14273]: 2017-09-28 13:00:17.770 14273 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:00:17 ctl02 nova-api[14273]: 2017-09-28 13:00:17.770 14273 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:00:17 ctl02 nova-api[14273]: 2017-09-28 13:00:17.770 14273 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:00:17 ctl02 nova-api[14273]: 2017-09-28 13:00:17.770 14273 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:00:17 ctl02 nova-api[14273]: 2017-09-28 13:00:17.770 14273 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:00:17 ctl02 nova-api[14273]: 2017-09-28 13:00:17.770 14273 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:00:17 ctl02 nova-api[14273]: 2017-09-28 13:00:17.770 14273 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:00:17 ctl02 nova-api[14273]: 2017-09-28 13:00:17.770 14273 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:00:17 ctl02 nova-api[14273]: 2017-09-28 13:00:17.770 14273 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:00:17 ctl02 nova-api[14273]: 2017-09-28 13:00:17.770 14273 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:00:17 ctl02 nova-api[14273]: 2017-09-28 13:00:17.770 14273 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:00:17 ctl02 nova-api[14273]: 2017-09-28 13:00:17.770 14273 ERROR nova.wsgi     self.filename))
Sep 28 13:00:17 ctl02 nova-api[14273]: 2017-09-28 13:00:17.770 14273 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:00:17 ctl02 nova-api[14273]: 2017-09-28 13:00:17.770 14273 ERROR nova.wsgi
Sep 28 13:00:17 ctl02 nova-api[14273]: 2017-09-28 13:00:17.771 14273 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:00:17 ctl02 nova-api[14273]: 2017-09-28 13:00:17.903 14273 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:00:18 ctl02 nova-api[14273]: 2017-09-28 13:00:18.136 14273 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:00:18 ctl02 nova-api[14273]: 2017-09-28 13:00:18.138 14273 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:00:18 ctl02 nova-api[14273]: 2017-09-28 13:00:18.138 14273 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:00:18 ctl02 nova-api[14273]: 2017-09-28 13:00:18.138 14273 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:00:18 ctl02 nova-api[14273]: 2017-09-28 13:00:18.272 14273 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:00:18 ctl02 nova-api[14273]: 2017-09-28 13:00:18.274 14273 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:00:18 ctl02 nova-api[14273]: 2017-09-28 13:00:18.274 14273 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:00:18 ctl02 nova-api[14273]: 2017-09-28 13:00:18.274 14273 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:00:18 ctl02 nova-api[14273]: 2017-09-28 13:00:18.277 14273 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:00:18 ctl02 nova-api[14273]: 2017-09-28 13:00:18.278 14273 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:00:18 ctl02 nova-api[14273]: 2017-09-28 13:00:18.278 14273 ERROR nova Traceback (most recent call last):
Sep 28 13:00:18 ctl02 nova-api[14273]: 2017-09-28 13:00:18.278 14273 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:00:18 ctl02 nova-api[14273]: 2017-09-28 13:00:18.278 14273 ERROR nova     sys.exit(main())
Sep 28 13:00:18 ctl02 nova-api[14273]: 2017-09-28 13:00:18.278 14273 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:00:18 ctl02 nova-api[14273]: 2017-09-28 13:00:18.278 14273 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:00:18 ctl02 nova-api[14273]: 2017-09-28 13:00:18.278 14273 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:00:18 ctl02 nova-api[14273]: 2017-09-28 13:00:18.278 14273 ERROR nova     max_url_len=max_url_len)
Sep 28 13:00:18 ctl02 nova-api[14273]: 2017-09-28 13:00:18.278 14273 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:00:18 ctl02 nova-api[14273]: 2017-09-28 13:00:18.278 14273 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:00:18 ctl02 nova-api[14273]: 2017-09-28 13:00:18.278 14273 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:00:18 ctl02 nova-api[14273]: 2017-09-28 13:00:18.278 14273 ERROR nova     sock.listen(backlog)
Sep 28 13:00:18 ctl02 nova-api[14273]: 2017-09-28 13:00:18.278 14273 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:00:18 ctl02 nova-api[14273]: 2017-09-28 13:00:18.278 14273 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:00:18 ctl02 nova-api[14273]: 2017-09-28 13:00:18.278 14273 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:00:18 ctl02 nova-api[14273]: 2017-09-28 13:00:18.278 14273 ERROR nova
Sep 28 13:00:18 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:00:18 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:00:18 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:00:18 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:00:18 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:00:18 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:00:18 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:00:18 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:00:18.745 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:00:18] "OPTIONS / HTTP/1.0" 200 134 0.000553
Sep 28 13:00:19 ctl02 glance-api[29183]: 2017-09-28 13:00:19.109 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:00:19] "OPTIONS / HTTP/1.0" 200 134 0.001052
Sep 28 13:00:19 ctl02 heat-api-cfn[13300]: 2017-09-28 13:00:19.514 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:00:19] "OPTIONS / HTTP/1.0" 200 134 0.000491
Sep 28 13:00:20 ctl02 nova-api[14295]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:00:20 ctl02 nova-api[14295]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:00:20 ctl02 heat-api[13008]: 2017-09-28 13:00:20.490 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:00:20] "OPTIONS / HTTP/1.0" 200 134 0.000639
Sep 28 13:00:20 ctl02 nova-api[14295]: 2017-09-28 13:00:20.552 14295 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:00:20 ctl02 nova-api[14295]: 2017-09-28 13:00:20.554 14295 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:00:20 ctl02 nova-api[14295]: 2017-09-28 13:00:20.554 14295 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:00:20 ctl02 nova-api[14295]: 2017-09-28 13:00:20.554 14295 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:00:20 ctl02 nova-api[14295]: 2017-09-28 13:00:20.554 14295 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:00:20 ctl02 nova-api[14295]: 2017-09-28 13:00:20.554 14295 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:00:20 ctl02 nova-api[14295]: 2017-09-28 13:00:20.554 14295 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:00:20 ctl02 nova-api[14295]: 2017-09-28 13:00:20.554 14295 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:00:20 ctl02 nova-api[14295]: 2017-09-28 13:00:20.554 14295 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:00:20 ctl02 nova-api[14295]: 2017-09-28 13:00:20.554 14295 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:00:20 ctl02 nova-api[14295]: 2017-09-28 13:00:20.554 14295 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:00:20 ctl02 nova-api[14295]: 2017-09-28 13:00:20.554 14295 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:00:20 ctl02 nova-api[14295]: 2017-09-28 13:00:20.554 14295 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:00:20 ctl02 nova-api[14295]: 2017-09-28 13:00:20.554 14295 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:00:20 ctl02 nova-api[14295]: 2017-09-28 13:00:20.554 14295 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:00:20 ctl02 nova-api[14295]: 2017-09-28 13:00:20.554 14295 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:00:20 ctl02 nova-api[14295]: 2017-09-28 13:00:20.554 14295 ERROR nova.wsgi     self.filename))
Sep 28 13:00:20 ctl02 nova-api[14295]: 2017-09-28 13:00:20.554 14295 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:00:20 ctl02 nova-api[14295]: 2017-09-28 13:00:20.554 14295 ERROR nova.wsgi
Sep 28 13:00:20 ctl02 nova-api[14295]: 2017-09-28 13:00:20.555 14295 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:00:20 ctl02 nova-api[14295]: 2017-09-28 13:00:20.686 14295 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:00:20 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:00:20.850 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:00:20] "OPTIONS / HTTP/1.0" 200 134 0.000475
Sep 28 13:00:20 ctl02 nova-api[14295]: 2017-09-28 13:00:20.933 14295 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:00:20 ctl02 nova-api[14295]: 2017-09-28 13:00:20.935 14295 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:00:20 ctl02 nova-api[14295]: 2017-09-28 13:00:20.936 14295 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:00:20 ctl02 nova-api[14295]: 2017-09-28 13:00:20.936 14295 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:00:21 ctl02 neutron-server[30536]: 2017-09-28 13:00:21.051 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 13:00:21 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 13:00:21 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:59:06 cmp002
Sep 28 13:00:21 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:58:38 cmp001
Sep 28 13:00:21 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:58:46 cmp002
Sep 28 13:00:21 ctl02 nova-api[14295]: 2017-09-28 13:00:21.074 14295 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:00:21 ctl02 nova-api[14295]: 2017-09-28 13:00:21.076 14295 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:00:21 ctl02 nova-api[14295]: 2017-09-28 13:00:21.076 14295 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:00:21 ctl02 nova-api[14295]: 2017-09-28 13:00:21.077 14295 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:00:21 ctl02 nova-api[14295]: 2017-09-28 13:00:21.080 14295 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:00:21 ctl02 nova-api[14295]: 2017-09-28 13:00:21.080 14295 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:00:21 ctl02 nova-api[14295]: 2017-09-28 13:00:21.080 14295 ERROR nova Traceback (most recent call last):
Sep 28 13:00:21 ctl02 nova-api[14295]: 2017-09-28 13:00:21.080 14295 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:00:21 ctl02 nova-api[14295]: 2017-09-28 13:00:21.080 14295 ERROR nova     sys.exit(main())
Sep 28 13:00:21 ctl02 nova-api[14295]: 2017-09-28 13:00:21.080 14295 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:00:21 ctl02 nova-api[14295]: 2017-09-28 13:00:21.080 14295 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:00:21 ctl02 nova-api[14295]: 2017-09-28 13:00:21.080 14295 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:00:21 ctl02 nova-api[14295]: 2017-09-28 13:00:21.080 14295 ERROR nova     max_url_len=max_url_len)
Sep 28 13:00:21 ctl02 nova-api[14295]: 2017-09-28 13:00:21.080 14295 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:00:21 ctl02 nova-api[14295]: 2017-09-28 13:00:21.080 14295 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:00:21 ctl02 nova-api[14295]: 2017-09-28 13:00:21.080 14295 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:00:21 ctl02 nova-api[14295]: 2017-09-28 13:00:21.080 14295 ERROR nova     sock.listen(backlog)
Sep 28 13:00:21 ctl02 nova-api[14295]: 2017-09-28 13:00:21.080 14295 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:00:21 ctl02 nova-api[14295]: 2017-09-28 13:00:21.080 14295 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:00:21 ctl02 nova-api[14295]: 2017-09-28 13:00:21.080 14295 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:00:21 ctl02 nova-api[14295]: 2017-09-28 13:00:21.080 14295 ERROR nova
Sep 28 13:00:21 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:00:21 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:00:21 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:00:21 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:00:21 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:00:21 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:00:21 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:00:22 ctl02 neutron-server[30536]: 2017-09-28 13:00:22.290 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:00:22] "OPTIONS / HTTP/1.0" 200 262 0.000556
Sep 28 13:00:22 ctl02 glance-api[29183]: 2017-09-28 13:00:22.496 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:00:22] "OPTIONS / HTTP/1.0" 200 134 0.000630
Sep 28 13:00:22 ctl02 glance-api[29183]: 2017-09-28 13:00:22.606 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:00:22] "OPTIONS / HTTP/1.0" 200 134 0.000413
Sep 28 13:00:23 ctl02 nova-api[14313]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:00:23 ctl02 nova-api[14313]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:00:23 ctl02 nova-api[14313]: 2017-09-28 13:00:23.241 14313 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:00:23 ctl02 nova-api[14313]: 2017-09-28 13:00:23.243 14313 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:00:23 ctl02 nova-api[14313]: 2017-09-28 13:00:23.243 14313 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:00:23 ctl02 nova-api[14313]: 2017-09-28 13:00:23.243 14313 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:00:23 ctl02 nova-api[14313]: 2017-09-28 13:00:23.243 14313 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:00:23 ctl02 nova-api[14313]: 2017-09-28 13:00:23.243 14313 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:00:23 ctl02 nova-api[14313]: 2017-09-28 13:00:23.243 14313 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:00:23 ctl02 nova-api[14313]: 2017-09-28 13:00:23.243 14313 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:00:23 ctl02 nova-api[14313]: 2017-09-28 13:00:23.243 14313 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:00:23 ctl02 nova-api[14313]: 2017-09-28 13:00:23.243 14313 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:00:23 ctl02 nova-api[14313]: 2017-09-28 13:00:23.243 14313 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:00:23 ctl02 nova-api[14313]: 2017-09-28 13:00:23.243 14313 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:00:23 ctl02 nova-api[14313]: 2017-09-28 13:00:23.243 14313 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:00:23 ctl02 nova-api[14313]: 2017-09-28 13:00:23.243 14313 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:00:23 ctl02 nova-api[14313]: 2017-09-28 13:00:23.243 14313 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:00:23 ctl02 nova-api[14313]: 2017-09-28 13:00:23.243 14313 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:00:23 ctl02 nova-api[14313]: 2017-09-28 13:00:23.243 14313 ERROR nova.wsgi     self.filename))
Sep 28 13:00:23 ctl02 nova-api[14313]: 2017-09-28 13:00:23.243 14313 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:00:23 ctl02 nova-api[14313]: 2017-09-28 13:00:23.243 14313 ERROR nova.wsgi
Sep 28 13:00:23 ctl02 nova-api[14313]: 2017-09-28 13:00:23.244 14313 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:00:23 ctl02 nova-conductor[5056]: 2017-09-28 13:00:23.258 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:00:23 ctl02 nova-conductor[5056]: 2017-09-28 13:00:23.269 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:00:23 ctl02 nova-conductor[5056]: 2017-09-28 13:00:23.269 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:00:23 ctl02 nova-conductor[5056]: 2017-09-28 13:00:23.276 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:00:23 ctl02 nova-api[14313]: 2017-09-28 13:00:23.381 14313 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:00:23 ctl02 nova-api[14313]: 2017-09-28 13:00:23.629 14313 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:00:23 ctl02 nova-api[14313]: 2017-09-28 13:00:23.632 14313 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:00:23 ctl02 nova-api[14313]: 2017-09-28 13:00:23.632 14313 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:00:23 ctl02 nova-api[14313]: 2017-09-28 13:00:23.632 14313 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:00:23 ctl02 nova-api[14313]: 2017-09-28 13:00:23.763 14313 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:00:23 ctl02 nova-api[14313]: 2017-09-28 13:00:23.765 14313 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:00:23 ctl02 nova-api[14313]: 2017-09-28 13:00:23.766 14313 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:00:23 ctl02 nova-api[14313]: 2017-09-28 13:00:23.766 14313 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:00:23 ctl02 nova-api[14313]: 2017-09-28 13:00:23.769 14313 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:00:23 ctl02 nova-api[14313]: 2017-09-28 13:00:23.770 14313 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:00:23 ctl02 nova-api[14313]: 2017-09-28 13:00:23.770 14313 ERROR nova Traceback (most recent call last):
Sep 28 13:00:23 ctl02 nova-api[14313]: 2017-09-28 13:00:23.770 14313 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:00:23 ctl02 nova-api[14313]: 2017-09-28 13:00:23.770 14313 ERROR nova     sys.exit(main())
Sep 28 13:00:23 ctl02 nova-api[14313]: 2017-09-28 13:00:23.770 14313 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:00:23 ctl02 nova-api[14313]: 2017-09-28 13:00:23.770 14313 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:00:23 ctl02 nova-api[14313]: 2017-09-28 13:00:23.770 14313 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:00:23 ctl02 nova-api[14313]: 2017-09-28 13:00:23.770 14313 ERROR nova     max_url_len=max_url_len)
Sep 28 13:00:23 ctl02 nova-api[14313]: 2017-09-28 13:00:23.770 14313 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:00:23 ctl02 nova-api[14313]: 2017-09-28 13:00:23.770 14313 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:00:23 ctl02 nova-api[14313]: 2017-09-28 13:00:23.770 14313 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:00:23 ctl02 nova-api[14313]: 2017-09-28 13:00:23.770 14313 ERROR nova     sock.listen(backlog)
Sep 28 13:00:23 ctl02 nova-api[14313]: 2017-09-28 13:00:23.770 14313 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:00:23 ctl02 nova-api[14313]: 2017-09-28 13:00:23.770 14313 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:00:23 ctl02 nova-api[14313]: 2017-09-28 13:00:23.770 14313 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:00:23 ctl02 nova-api[14313]: 2017-09-28 13:00:23.770 14313 ERROR nova
Sep 28 13:00:23 ctl02 nova-cert[4860]: 2017-09-28 13:00:23.852 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:00:23 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:00:23 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:00:23 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:00:24 ctl02 heat-api[13008]: 2017-09-28 13:00:24.048 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:00:24] "OPTIONS / HTTP/1.0" 200 134 0.000676
Sep 28 13:00:24 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:00:24 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:00:24 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:00:24 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:00:25 ctl02 neutron-server[30536]: 2017-09-28 13:00:25.194 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:00:25] "OPTIONS / HTTP/1.0" 200 262 0.000517
Sep 28 13:00:25 ctl02 heat-api-cfn[13300]: 2017-09-28 13:00:25.578 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:00:25] "OPTIONS / HTTP/1.0" 200 134 0.000473
Sep 28 13:00:25 ctl02 nova-api[14332]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:00:25 ctl02 nova-api[14332]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:00:26 ctl02 nova-api[14332]: 2017-09-28 13:00:26.056 14332 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:00:26 ctl02 nova-api[14332]: 2017-09-28 13:00:26.058 14332 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:00:26 ctl02 nova-api[14332]: 2017-09-28 13:00:26.058 14332 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:00:26 ctl02 nova-api[14332]: 2017-09-28 13:00:26.058 14332 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:00:26 ctl02 nova-api[14332]: 2017-09-28 13:00:26.058 14332 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:00:26 ctl02 nova-api[14332]: 2017-09-28 13:00:26.058 14332 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:00:26 ctl02 nova-api[14332]: 2017-09-28 13:00:26.058 14332 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:00:26 ctl02 nova-api[14332]: 2017-09-28 13:00:26.058 14332 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:00:26 ctl02 nova-api[14332]: 2017-09-28 13:00:26.058 14332 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:00:26 ctl02 nova-api[14332]: 2017-09-28 13:00:26.058 14332 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:00:26 ctl02 nova-api[14332]: 2017-09-28 13:00:26.058 14332 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:00:26 ctl02 nova-api[14332]: 2017-09-28 13:00:26.058 14332 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:00:26 ctl02 nova-api[14332]: 2017-09-28 13:00:26.058 14332 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:00:26 ctl02 nova-api[14332]: 2017-09-28 13:00:26.058 14332 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:00:26 ctl02 nova-api[14332]: 2017-09-28 13:00:26.058 14332 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:00:26 ctl02 nova-api[14332]: 2017-09-28 13:00:26.058 14332 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:00:26 ctl02 nova-api[14332]: 2017-09-28 13:00:26.058 14332 ERROR nova.wsgi     self.filename))
Sep 28 13:00:26 ctl02 nova-api[14332]: 2017-09-28 13:00:26.058 14332 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:00:26 ctl02 nova-api[14332]: 2017-09-28 13:00:26.058 14332 ERROR nova.wsgi
Sep 28 13:00:26 ctl02 nova-api[14332]: 2017-09-28 13:00:26.060 14332 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:00:26 ctl02 nova-api[14332]: 2017-09-28 13:00:26.196 14332 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:00:26 ctl02 heat-api-cfn[13300]: 2017-09-28 13:00:26.272 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:00:26] "OPTIONS / HTTP/1.0" 200 134 0.000611
Sep 28 13:00:26 ctl02 nova-api[14332]: 2017-09-28 13:00:26.448 14332 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:00:26 ctl02 nova-api[14332]: 2017-09-28 13:00:26.451 14332 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:00:26 ctl02 nova-api[14332]: 2017-09-28 13:00:26.452 14332 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:00:26 ctl02 nova-api[14332]: 2017-09-28 13:00:26.452 14332 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:00:26 ctl02 nova-api[14332]: 2017-09-28 13:00:26.586 14332 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:00:26 ctl02 nova-api[14332]: 2017-09-28 13:00:26.589 14332 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:00:26 ctl02 nova-api[14332]: 2017-09-28 13:00:26.589 14332 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:00:26 ctl02 nova-api[14332]: 2017-09-28 13:00:26.590 14332 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:00:26 ctl02 nova-api[14332]: 2017-09-28 13:00:26.593 14332 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:00:26 ctl02 nova-api[14332]: 2017-09-28 13:00:26.594 14332 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:00:26 ctl02 nova-api[14332]: 2017-09-28 13:00:26.594 14332 ERROR nova Traceback (most recent call last):
Sep 28 13:00:26 ctl02 nova-api[14332]: 2017-09-28 13:00:26.594 14332 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:00:26 ctl02 nova-api[14332]: 2017-09-28 13:00:26.594 14332 ERROR nova     sys.exit(main())
Sep 28 13:00:26 ctl02 nova-api[14332]: 2017-09-28 13:00:26.594 14332 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:00:26 ctl02 nova-api[14332]: 2017-09-28 13:00:26.594 14332 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:00:26 ctl02 nova-api[14332]: 2017-09-28 13:00:26.594 14332 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:00:26 ctl02 nova-api[14332]: 2017-09-28 13:00:26.594 14332 ERROR nova     max_url_len=max_url_len)
Sep 28 13:00:26 ctl02 nova-api[14332]: 2017-09-28 13:00:26.594 14332 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:00:26 ctl02 nova-api[14332]: 2017-09-28 13:00:26.594 14332 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:00:26 ctl02 nova-api[14332]: 2017-09-28 13:00:26.594 14332 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:00:26 ctl02 nova-api[14332]: 2017-09-28 13:00:26.594 14332 ERROR nova     sock.listen(backlog)
Sep 28 13:00:26 ctl02 nova-api[14332]: 2017-09-28 13:00:26.594 14332 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:00:26 ctl02 nova-api[14332]: 2017-09-28 13:00:26.594 14332 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:00:26 ctl02 nova-api[14332]: 2017-09-28 13:00:26.594 14332 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:00:26 ctl02 nova-api[14332]: 2017-09-28 13:00:26.594 14332 ERROR nova
Sep 28 13:00:26 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:00:26.619 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:00:26] "OPTIONS / HTTP/1.0" 200 134 0.000425
Sep 28 13:00:26 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:00:26 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:00:26 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:00:26 ctl02 neutron-server[30536]: 2017-09-28 13:00:26.800 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:00:26] "OPTIONS / HTTP/1.0" 200 262 0.000506
Sep 28 13:00:26 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:00:26 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:00:26 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:00:26 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:00:27 ctl02 heat-api[13008]: 2017-09-28 13:00:27.014 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:00:27] "OPTIONS / HTTP/1.0" 200 134 0.000588
Sep 28 13:00:28 ctl02 neutron-server[30536]: 2017-09-28 13:00:28.539 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 13:00:28 ctl02 nova-api[14350]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:00:28 ctl02 nova-api[14350]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:00:28 ctl02 nova-api[14350]: 2017-09-28 13:00:28.767 14350 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:00:28 ctl02 nova-api[14350]: 2017-09-28 13:00:28.769 14350 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:00:28 ctl02 nova-api[14350]: 2017-09-28 13:00:28.769 14350 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:00:28 ctl02 nova-api[14350]: 2017-09-28 13:00:28.769 14350 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:00:28 ctl02 nova-api[14350]: 2017-09-28 13:00:28.769 14350 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:00:28 ctl02 nova-api[14350]: 2017-09-28 13:00:28.769 14350 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:00:28 ctl02 nova-api[14350]: 2017-09-28 13:00:28.769 14350 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:00:28 ctl02 nova-api[14350]: 2017-09-28 13:00:28.769 14350 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:00:28 ctl02 nova-api[14350]: 2017-09-28 13:00:28.769 14350 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:00:28 ctl02 nova-api[14350]: 2017-09-28 13:00:28.769 14350 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:00:28 ctl02 nova-api[14350]: 2017-09-28 13:00:28.769 14350 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:00:28 ctl02 nova-api[14350]: 2017-09-28 13:00:28.769 14350 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:00:28 ctl02 nova-api[14350]: 2017-09-28 13:00:28.769 14350 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:00:28 ctl02 nova-api[14350]: 2017-09-28 13:00:28.769 14350 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:00:28 ctl02 nova-api[14350]: 2017-09-28 13:00:28.769 14350 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:00:28 ctl02 nova-api[14350]: 2017-09-28 13:00:28.769 14350 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:00:28 ctl02 nova-api[14350]: 2017-09-28 13:00:28.769 14350 ERROR nova.wsgi     self.filename))
Sep 28 13:00:28 ctl02 nova-api[14350]: 2017-09-28 13:00:28.769 14350 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:00:28 ctl02 nova-api[14350]: 2017-09-28 13:00:28.769 14350 ERROR nova.wsgi
Sep 28 13:00:28 ctl02 nova-api[14350]: 2017-09-28 13:00:28.771 14350 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:00:28 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:00:28.816 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:00:28] "OPTIONS / HTTP/1.0" 200 134 0.000465
Sep 28 13:00:28 ctl02 nova-api[14350]: 2017-09-28 13:00:28.907 14350 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:00:29 ctl02 glance-api[29183]: 2017-09-28 13:00:29.063 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:00:29] "OPTIONS / HTTP/1.0" 200 134 0.000632
Sep 28 13:00:29 ctl02 nova-api[14350]: 2017-09-28 13:00:29.161 14350 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:00:29 ctl02 nova-api[14350]: 2017-09-28 13:00:29.164 14350 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:00:29 ctl02 nova-api[14350]: 2017-09-28 13:00:29.164 14350 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:00:29 ctl02 nova-api[14350]: 2017-09-28 13:00:29.165 14350 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:00:29 ctl02 nova-api[14350]: 2017-09-28 13:00:29.301 14350 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:00:29 ctl02 nova-api[14350]: 2017-09-28 13:00:29.304 14350 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:00:29 ctl02 nova-api[14350]: 2017-09-28 13:00:29.304 14350 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:00:29 ctl02 nova-api[14350]: 2017-09-28 13:00:29.305 14350 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:00:29 ctl02 nova-api[14350]: 2017-09-28 13:00:29.308 14350 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:00:29 ctl02 nova-api[14350]: 2017-09-28 13:00:29.309 14350 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:00:29 ctl02 nova-api[14350]: 2017-09-28 13:00:29.309 14350 ERROR nova Traceback (most recent call last):
Sep 28 13:00:29 ctl02 nova-api[14350]: 2017-09-28 13:00:29.309 14350 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:00:29 ctl02 nova-api[14350]: 2017-09-28 13:00:29.309 14350 ERROR nova     sys.exit(main())
Sep 28 13:00:29 ctl02 nova-api[14350]: 2017-09-28 13:00:29.309 14350 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:00:29 ctl02 nova-api[14350]: 2017-09-28 13:00:29.309 14350 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:00:29 ctl02 nova-api[14350]: 2017-09-28 13:00:29.309 14350 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:00:29 ctl02 nova-api[14350]: 2017-09-28 13:00:29.309 14350 ERROR nova     max_url_len=max_url_len)
Sep 28 13:00:29 ctl02 nova-api[14350]: 2017-09-28 13:00:29.309 14350 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:00:29 ctl02 nova-api[14350]: 2017-09-28 13:00:29.309 14350 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:00:29 ctl02 nova-api[14350]: 2017-09-28 13:00:29.309 14350 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:00:29 ctl02 nova-api[14350]: 2017-09-28 13:00:29.309 14350 ERROR nova     sock.listen(backlog)
Sep 28 13:00:29 ctl02 nova-api[14350]: 2017-09-28 13:00:29.309 14350 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:00:29 ctl02 nova-api[14350]: 2017-09-28 13:00:29.309 14350 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:00:29 ctl02 nova-api[14350]: 2017-09-28 13:00:29.309 14350 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:00:29 ctl02 nova-api[14350]: 2017-09-28 13:00:29.309 14350 ERROR nova
Sep 28 13:00:29 ctl02 heat-api-cfn[13300]: 2017-09-28 13:00:29.381 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:00:29] "OPTIONS / HTTP/1.0" 200 134 0.000543
Sep 28 13:00:29 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:00:29 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:00:29 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:00:29 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:00:29 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:00:29 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:00:29 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:00:30 ctl02 heat-api[13008]: 2017-09-28 13:00:30.383 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:00:30] "OPTIONS / HTTP/1.0" 200 134 0.000640
Sep 28 13:00:30 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:00:30.824 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:00:30] "OPTIONS / HTTP/1.0" 200 134 0.000489
Sep 28 13:00:31 ctl02 nova-api[14367]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:00:31 ctl02 nova-api[14367]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:00:31 ctl02 nova-api[14367]: 2017-09-28 13:00:31.541 14367 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:00:31 ctl02 nova-api[14367]: 2017-09-28 13:00:31.543 14367 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:00:31 ctl02 nova-api[14367]: 2017-09-28 13:00:31.543 14367 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:00:31 ctl02 nova-api[14367]: 2017-09-28 13:00:31.543 14367 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:00:31 ctl02 nova-api[14367]: 2017-09-28 13:00:31.543 14367 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:00:31 ctl02 nova-api[14367]: 2017-09-28 13:00:31.543 14367 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:00:31 ctl02 nova-api[14367]: 2017-09-28 13:00:31.543 14367 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:00:31 ctl02 nova-api[14367]: 2017-09-28 13:00:31.543 14367 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:00:31 ctl02 nova-api[14367]: 2017-09-28 13:00:31.543 14367 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:00:31 ctl02 nova-api[14367]: 2017-09-28 13:00:31.543 14367 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:00:31 ctl02 nova-api[14367]: 2017-09-28 13:00:31.543 14367 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:00:31 ctl02 nova-api[14367]: 2017-09-28 13:00:31.543 14367 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:00:31 ctl02 nova-api[14367]: 2017-09-28 13:00:31.543 14367 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:00:31 ctl02 nova-api[14367]: 2017-09-28 13:00:31.543 14367 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:00:31 ctl02 nova-api[14367]: 2017-09-28 13:00:31.543 14367 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:00:31 ctl02 nova-api[14367]: 2017-09-28 13:00:31.543 14367 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:00:31 ctl02 nova-api[14367]: 2017-09-28 13:00:31.543 14367 ERROR nova.wsgi     self.filename))
Sep 28 13:00:31 ctl02 nova-api[14367]: 2017-09-28 13:00:31.543 14367 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:00:31 ctl02 nova-api[14367]: 2017-09-28 13:00:31.543 14367 ERROR nova.wsgi
Sep 28 13:00:31 ctl02 nova-api[14367]: 2017-09-28 13:00:31.545 14367 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:00:31 ctl02 nova-api[14367]: 2017-09-28 13:00:31.679 14367 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:00:31 ctl02 nova-api[14367]: 2017-09-28 13:00:31.930 14367 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:00:31 ctl02 neutron-server[30536]: 2017-09-28 13:00:31.933 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:00:31] "OPTIONS / HTTP/1.0" 200 262 0.000543
Sep 28 13:00:31 ctl02 nova-api[14367]: 2017-09-28 13:00:31.934 14367 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:00:31 ctl02 nova-api[14367]: 2017-09-28 13:00:31.934 14367 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:00:31 ctl02 nova-api[14367]: 2017-09-28 13:00:31.935 14367 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:00:32 ctl02 nova-api[14367]: 2017-09-28 13:00:32.077 14367 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:00:32 ctl02 nova-api[14367]: 2017-09-28 13:00:32.079 14367 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:00:32 ctl02 nova-api[14367]: 2017-09-28 13:00:32.079 14367 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:00:32 ctl02 nova-api[14367]: 2017-09-28 13:00:32.079 14367 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:00:32 ctl02 nova-api[14367]: 2017-09-28 13:00:32.082 14367 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:00:32 ctl02 nova-api[14367]: 2017-09-28 13:00:32.083 14367 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:00:32 ctl02 nova-api[14367]: 2017-09-28 13:00:32.083 14367 ERROR nova Traceback (most recent call last):
Sep 28 13:00:32 ctl02 nova-api[14367]: 2017-09-28 13:00:32.083 14367 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:00:32 ctl02 nova-api[14367]: 2017-09-28 13:00:32.083 14367 ERROR nova     sys.exit(main())
Sep 28 13:00:32 ctl02 nova-api[14367]: 2017-09-28 13:00:32.083 14367 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:00:32 ctl02 nova-api[14367]: 2017-09-28 13:00:32.083 14367 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:00:32 ctl02 nova-api[14367]: 2017-09-28 13:00:32.083 14367 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:00:32 ctl02 nova-api[14367]: 2017-09-28 13:00:32.083 14367 ERROR nova     max_url_len=max_url_len)
Sep 28 13:00:32 ctl02 nova-api[14367]: 2017-09-28 13:00:32.083 14367 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:00:32 ctl02 nova-api[14367]: 2017-09-28 13:00:32.083 14367 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:00:32 ctl02 nova-api[14367]: 2017-09-28 13:00:32.083 14367 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:00:32 ctl02 nova-api[14367]: 2017-09-28 13:00:32.083 14367 ERROR nova     sock.listen(backlog)
Sep 28 13:00:32 ctl02 nova-api[14367]: 2017-09-28 13:00:32.083 14367 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:00:32 ctl02 nova-api[14367]: 2017-09-28 13:00:32.083 14367 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:00:32 ctl02 nova-api[14367]: 2017-09-28 13:00:32.083 14367 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:00:32 ctl02 nova-api[14367]: 2017-09-28 13:00:32.083 14367 ERROR nova
Sep 28 13:00:32 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:00:32 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:00:32 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:00:32 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:00:32 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:00:32 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:00:32 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:00:32 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xeb929d4b)
Sep 28 13:00:32 ctl02 glance-api[29183]: 2017-09-28 13:00:32.847 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:00:32] "OPTIONS / HTTP/1.0" 200 134 0.000579
Sep 28 13:00:32 ctl02 glance-api[29183]: 2017-09-28 13:00:32.862 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:00:32] "OPTIONS / HTTP/1.0" 200 134 0.000374
Sep 28 13:00:33 ctl02 nova-consoleauth[5433]: 2017-09-28 13:00:33.693 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:00:33 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xeb929d4b)
Sep 28 13:00:34 ctl02 nova-api[14385]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:00:34 ctl02 nova-api[14385]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:00:34 ctl02 heat-api[13008]: 2017-09-28 13:00:34.175 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:00:34] "OPTIONS / HTTP/1.0" 200 134 0.000557
Sep 28 13:00:34 ctl02 nova-api[14385]: 2017-09-28 13:00:34.247 14385 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:00:34 ctl02 nova-api[14385]: 2017-09-28 13:00:34.248 14385 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:00:34 ctl02 nova-api[14385]: 2017-09-28 13:00:34.248 14385 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:00:34 ctl02 nova-api[14385]: 2017-09-28 13:00:34.248 14385 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:00:34 ctl02 nova-api[14385]: 2017-09-28 13:00:34.248 14385 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:00:34 ctl02 nova-api[14385]: 2017-09-28 13:00:34.248 14385 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:00:34 ctl02 nova-api[14385]: 2017-09-28 13:00:34.248 14385 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:00:34 ctl02 nova-api[14385]: 2017-09-28 13:00:34.248 14385 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:00:34 ctl02 nova-api[14385]: 2017-09-28 13:00:34.248 14385 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:00:34 ctl02 nova-api[14385]: 2017-09-28 13:00:34.248 14385 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:00:34 ctl02 nova-api[14385]: 2017-09-28 13:00:34.248 14385 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:00:34 ctl02 nova-api[14385]: 2017-09-28 13:00:34.248 14385 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:00:34 ctl02 nova-api[14385]: 2017-09-28 13:00:34.248 14385 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:00:34 ctl02 nova-api[14385]: 2017-09-28 13:00:34.248 14385 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:00:34 ctl02 nova-api[14385]: 2017-09-28 13:00:34.248 14385 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:00:34 ctl02 nova-api[14385]: 2017-09-28 13:00:34.248 14385 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:00:34 ctl02 nova-api[14385]: 2017-09-28 13:00:34.248 14385 ERROR nova.wsgi     self.filename))
Sep 28 13:00:34 ctl02 nova-api[14385]: 2017-09-28 13:00:34.248 14385 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:00:34 ctl02 nova-api[14385]: 2017-09-28 13:00:34.248 14385 ERROR nova.wsgi
Sep 28 13:00:34 ctl02 nova-api[14385]: 2017-09-28 13:00:34.249 14385 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:00:34 ctl02 nova-api[14385]: 2017-09-28 13:00:34.381 14385 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:00:34 ctl02 heat-engine[12803]: 2017-09-28 13:00:34.386 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:00:34 ctl02 heat-engine[12803]: 2017-09-28 13:00:34.407 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:00:34 ctl02 heat-engine[12803]: 2017-09-28 13:00:34.414 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:00:34 ctl02 heat-engine[12803]: 2017-09-28 13:00:34.416 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:00:34 ctl02 nova-api[14385]: 2017-09-28 13:00:34.609 14385 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:00:34 ctl02 nova-api[14385]: 2017-09-28 13:00:34.611 14385 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:00:34 ctl02 nova-api[14385]: 2017-09-28 13:00:34.611 14385 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:00:34 ctl02 nova-api[14385]: 2017-09-28 13:00:34.611 14385 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:00:34 ctl02 nova-api[14385]: 2017-09-28 13:00:34.740 14385 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:00:34 ctl02 nova-api[14385]: 2017-09-28 13:00:34.742 14385 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:00:34 ctl02 nova-api[14385]: 2017-09-28 13:00:34.742 14385 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:00:34 ctl02 nova-api[14385]: 2017-09-28 13:00:34.743 14385 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:00:34 ctl02 nova-api[14385]: 2017-09-28 13:00:34.746 14385 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:00:34 ctl02 nova-api[14385]: 2017-09-28 13:00:34.747 14385 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:00:34 ctl02 nova-api[14385]: 2017-09-28 13:00:34.747 14385 ERROR nova Traceback (most recent call last):
Sep 28 13:00:34 ctl02 nova-api[14385]: 2017-09-28 13:00:34.747 14385 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:00:34 ctl02 nova-api[14385]: 2017-09-28 13:00:34.747 14385 ERROR nova     sys.exit(main())
Sep 28 13:00:34 ctl02 nova-api[14385]: 2017-09-28 13:00:34.747 14385 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:00:34 ctl02 nova-api[14385]: 2017-09-28 13:00:34.747 14385 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:00:34 ctl02 nova-api[14385]: 2017-09-28 13:00:34.747 14385 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:00:34 ctl02 nova-api[14385]: 2017-09-28 13:00:34.747 14385 ERROR nova     max_url_len=max_url_len)
Sep 28 13:00:34 ctl02 nova-api[14385]: 2017-09-28 13:00:34.747 14385 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:00:34 ctl02 nova-api[14385]: 2017-09-28 13:00:34.747 14385 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:00:34 ctl02 nova-api[14385]: 2017-09-28 13:00:34.747 14385 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:00:34 ctl02 nova-api[14385]: 2017-09-28 13:00:34.747 14385 ERROR nova     sock.listen(backlog)
Sep 28 13:00:34 ctl02 nova-api[14385]: 2017-09-28 13:00:34.747 14385 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:00:34 ctl02 nova-api[14385]: 2017-09-28 13:00:34.747 14385 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:00:34 ctl02 nova-api[14385]: 2017-09-28 13:00:34.747 14385 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:00:34 ctl02 nova-api[14385]: 2017-09-28 13:00:34.747 14385 ERROR nova
Sep 28 13:00:34 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xeb929d4b)
Sep 28 13:00:34 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:00:34 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:00:34 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:00:34 ctl02 neutron-server[30536]: 2017-09-28 13:00:34.892 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:00:34] "OPTIONS / HTTP/1.0" 200 262 0.000638
Sep 28 13:00:35 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:00:35 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:00:35 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:00:35 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:00:35 ctl02 heat-api-cfn[13300]: 2017-09-28 13:00:35.308 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:00:35] "OPTIONS / HTTP/1.0" 200 134 0.000568
Sep 28 13:00:35 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xeb929d4b)
Sep 28 13:00:36 ctl02 neutron-server[30536]: 2017-09-28 13:00:36.048 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 13:00:36 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 13:00:36 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:59:06 cmp002
Sep 28 13:00:36 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:58:38 cmp001
Sep 28 13:00:36 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 12:58:46 cmp002
Sep 28 13:00:36 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:00:36.400 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:00:36] "OPTIONS / HTTP/1.0" 200 134 0.000526
Sep 28 13:00:36 ctl02 heat-api-cfn[13300]: 2017-09-28 13:00:36.482 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:00:36] "OPTIONS / HTTP/1.0" 200 134 0.000530
Sep 28 13:00:36 ctl02 nova-api[14404]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:00:36 ctl02 nova-api[14404]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:00:36 ctl02 nova-scheduler[5620]: 2017-09-28 13:00:36.799 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:00:36 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xeb929d4b)
Sep 28 13:00:36 ctl02 nova-api[14404]: 2017-09-28 13:00:36.986 14404 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:00:36 ctl02 nova-api[14404]: 2017-09-28 13:00:36.988 14404 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:00:36 ctl02 nova-api[14404]: 2017-09-28 13:00:36.988 14404 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:00:36 ctl02 nova-api[14404]: 2017-09-28 13:00:36.988 14404 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:00:36 ctl02 nova-api[14404]: 2017-09-28 13:00:36.988 14404 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:00:36 ctl02 nova-api[14404]: 2017-09-28 13:00:36.988 14404 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:00:36 ctl02 nova-api[14404]: 2017-09-28 13:00:36.988 14404 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:00:36 ctl02 nova-api[14404]: 2017-09-28 13:00:36.988 14404 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:00:36 ctl02 nova-api[14404]: 2017-09-28 13:00:36.988 14404 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:00:36 ctl02 nova-api[14404]: 2017-09-28 13:00:36.988 14404 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:00:36 ctl02 nova-api[14404]: 2017-09-28 13:00:36.988 14404 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:00:36 ctl02 nova-api[14404]: 2017-09-28 13:00:36.988 14404 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:00:36 ctl02 nova-api[14404]: 2017-09-28 13:00:36.988 14404 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:00:36 ctl02 nova-api[14404]: 2017-09-28 13:00:36.988 14404 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:00:36 ctl02 nova-api[14404]: 2017-09-28 13:00:36.988 14404 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:00:36 ctl02 nova-api[14404]: 2017-09-28 13:00:36.988 14404 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:00:36 ctl02 nova-api[14404]: 2017-09-28 13:00:36.988 14404 ERROR nova.wsgi     self.filename))
Sep 28 13:00:36 ctl02 nova-api[14404]: 2017-09-28 13:00:36.988 14404 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:00:36 ctl02 nova-api[14404]: 2017-09-28 13:00:36.988 14404 ERROR nova.wsgi
Sep 28 13:00:36 ctl02 nova-api[14404]: 2017-09-28 13:00:36.989 14404 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.095 30598 ERROR oslo_db.sqlalchemy.exc_filters [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] DBAPIError exception wrapped from (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpoo
Sep 28 13:00:37 ctl02 neutron-server[30536]: ls_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`']
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.095 30598 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.095 30598 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.095 30598 ERROR oslo_db.sqlalchemy.exc_filters     context)
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.095 30598 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.095 30598 ERROR oslo_db.sqlalchemy.exc_filters     cursor.execute(statement, parameters)
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.095 30598 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.095 30598 ERROR oslo_db.sqlalchemy.exc_filters     result = self._query(query)
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.095 30598 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.095 30598 ERROR oslo_db.sqlalchemy.exc_filters     conn.query(q)
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.095 30598 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.095 30598 ERROR oslo_db.sqlalchemy.exc_filters     self._affected_rows = self._read_query_result(unbuffered=unbuffered)
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.095 30598 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.095 30598 ERROR oslo_db.sqlalchemy.exc_filters     result.read()
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.095 30598 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.095 30598 ERROR oslo_db.sqlalchemy.exc_filters     first_packet = self.connection._read_packet()
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.095 30598 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.095 30598 ERROR oslo_db.sqlalchemy.exc_filters     packet.check_error()
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.095 30598 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.095 30598 ERROR oslo_db.sqlalchemy.exc_filters     err.raise_mysql_exception(self._data)
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.095 30598 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.095 30598 ERROR oslo_db.sqlalchemy.exc_filters     _check_mysql_exception(errinfo)
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.095 30598 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.095 30598 ERROR oslo_db.sqlalchemy.exc_filters     raise InternalError(errno, errorvalue)
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.095 30598 ERROR oslo_db.sqlalchemy.exc_filters InternalError: (1054, u"Unknown column 'subnets.tenant_id' in 'field list'")
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.095 30598 ERROR oslo_db.sqlalchemy.exc_filters
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Exception during message handling: (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpoo
Sep 28 13:00:37 ctl02 neutron-server[30536]: ls_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`']
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher Traceback (most recent call last):
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher     incoming.message))
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher     return self._do_dispatch(endpoint, method, ctxt, args)
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher     result = func(ctxt, **new_args)
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher     networks = self._get_active_networks(context, **kwargs)
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher     plugin.auto_schedule_networks(context, host)
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher     self.network_scheduler.auto_schedule_networks(self, context, host)
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher     subnets = plugin.get_subnets(context, fields=fields)
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher     marker, page_reverse)
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher     page_reverse=page_reverse)
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher     items = [dict_func(c, fields) for c in query]
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher     return self._execute_and_instances(context)
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher     result = conn.execute(querycontext.statement, self._params)
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher     return meth(self, multiparams, params)
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher     return connection._execute_clauseelement(self, multiparams, params)
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher     compiled_sql, distilled_params
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher     context)
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher     util.raise_from_cause(newraise, exc_info)
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher     reraise(type(exception), exception, tb=exc_tb)
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher     context)
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher     cursor.execute(statement, parameters)
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher     result = self._query(query)
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher     conn.query(q)
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher     self._affected_rows = self._read_query_result(unbuffered=unbuffered)
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher     result.read()
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher     first_packet = self.connection._read_packet()
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher     packet.check_error()
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher     err.raise_mysql_exception(self._data)
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher     _check_mysql_exception(errinfo)
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher     raise InternalError(errno, errorvalue)
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher DBError: (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallo
Sep 28 13:00:37 ctl02 neutron-server[30536]: cationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`']
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.100 30598 ERROR oslo_messaging.rpc.dispatcher
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.111 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:37 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.112 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:37 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:37 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:37 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:37 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:37 ctl02 nova-api[14404]: 2017-09-28 13:00:37.121 14404 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.190 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:00:37] "OPTIONS / HTTP/1.0" 200 262 0.000557
Sep 28 13:00:37 ctl02 heat-api[13008]: 2017-09-28 13:00:37.247 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:00:37] "OPTIONS / HTTP/1.0" 200 134 0.000685
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.367 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:37 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.367 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:37 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:37 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:37 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:37 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:37 ctl02 nova-api[14404]: 2017-09-28 13:00:37.368 14404 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:00:37 ctl02 nova-api[14404]: 2017-09-28 13:00:37.371 14404 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:00:37 ctl02 nova-api[14404]: 2017-09-28 13:00:37.371 14404 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:00:37 ctl02 nova-api[14404]: 2017-09-28 13:00:37.371 14404 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:00:37 ctl02 nova-api[14404]: 2017-09-28 13:00:37.503 14404 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:00:37 ctl02 nova-api[14404]: 2017-09-28 13:00:37.505 14404 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:00:37 ctl02 nova-api[14404]: 2017-09-28 13:00:37.505 14404 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:00:37 ctl02 nova-api[14404]: 2017-09-28 13:00:37.505 14404 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:00:37 ctl02 nova-api[14404]: 2017-09-28 13:00:37.508 14404 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:00:37 ctl02 nova-api[14404]: 2017-09-28 13:00:37.509 14404 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:00:37 ctl02 nova-api[14404]: 2017-09-28 13:00:37.509 14404 ERROR nova Traceback (most recent call last):
Sep 28 13:00:37 ctl02 nova-api[14404]: 2017-09-28 13:00:37.509 14404 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:00:37 ctl02 nova-api[14404]: 2017-09-28 13:00:37.509 14404 ERROR nova     sys.exit(main())
Sep 28 13:00:37 ctl02 nova-api[14404]: 2017-09-28 13:00:37.509 14404 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:00:37 ctl02 nova-api[14404]: 2017-09-28 13:00:37.509 14404 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:00:37 ctl02 nova-api[14404]: 2017-09-28 13:00:37.509 14404 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:00:37 ctl02 nova-api[14404]: 2017-09-28 13:00:37.509 14404 ERROR nova     max_url_len=max_url_len)
Sep 28 13:00:37 ctl02 nova-api[14404]: 2017-09-28 13:00:37.509 14404 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:00:37 ctl02 nova-api[14404]: 2017-09-28 13:00:37.509 14404 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:00:37 ctl02 nova-api[14404]: 2017-09-28 13:00:37.509 14404 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:00:37 ctl02 nova-api[14404]: 2017-09-28 13:00:37.509 14404 ERROR nova     sock.listen(backlog)
Sep 28 13:00:37 ctl02 nova-api[14404]: 2017-09-28 13:00:37.509 14404 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:00:37 ctl02 nova-api[14404]: 2017-09-28 13:00:37.509 14404 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:00:37 ctl02 nova-api[14404]: 2017-09-28 13:00:37.509 14404 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:00:37 ctl02 nova-api[14404]: 2017-09-28 13:00:37.509 14404 ERROR nova
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.621 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:37 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.622 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:37 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:37 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:37 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:37 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:37 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:00:37 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:00:37 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:00:37 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xeb929d4b)
Sep 28 13:00:37 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:00:37 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.876 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:37 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:37 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:00:37 ctl02 neutron-server[30536]: 2017-09-28 13:00:37.877 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:37 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:37 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:37 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:37 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:37 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:00:38 ctl02 neutron-server[30536]: 2017-09-28 13:00:38.131 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:38 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:38 ctl02 neutron-server[30536]: 2017-09-28 13:00:38.131 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:38 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:38 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:38 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:38 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:38 ctl02 neutron-server[30536]: 2017-09-28 13:00:38.385 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:38 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:38 ctl02 neutron-server[30536]: 2017-09-28 13:00:38.385 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:38 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:38 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:38 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:38 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:38 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:00:38.458 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:00:38] "OPTIONS / HTTP/1.0" 200 134 0.000378
Sep 28 13:00:38 ctl02 neutron-server[30536]: 2017-09-28 13:00:38.638 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:38 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:38 ctl02 neutron-server[30536]: 2017-09-28 13:00:38.639 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:38 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:38 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:38 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:38 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:38 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xeb929d4b)
Sep 28 13:00:38 ctl02 neutron-server[30536]: 2017-09-28 13:00:38.892 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:38 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:38 ctl02 neutron-server[30536]: 2017-09-28 13:00:38.893 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:38 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:38 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:38 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:38 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:39 ctl02 glance-api[29183]: 2017-09-28 13:00:39.053 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:00:39] "OPTIONS / HTTP/1.0" 200 134 0.000548
Sep 28 13:00:39 ctl02 heat-api-cfn[13300]: 2017-09-28 13:00:39.115 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:00:39] "OPTIONS / HTTP/1.0" 200 134 0.000612
Sep 28 13:00:39 ctl02 neutron-server[30536]: 2017-09-28 13:00:39.145 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:39 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:39 ctl02 neutron-server[30536]: 2017-09-28 13:00:39.146 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:39 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:39 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:39 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:39 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:39 ctl02 neutron-server[30536]: 2017-09-28 13:00:39.399 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:39 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:39 ctl02 neutron-server[30536]: 2017-09-28 13:00:39.399 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:39 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:39 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:39 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:39 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:39 ctl02 nova-api[14422]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:00:39 ctl02 nova-api[14422]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:00:39 ctl02 neutron-server[30536]: 2017-09-28 13:00:39.652 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:39 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:39 ctl02 neutron-server[30536]: 2017-09-28 13:00:39.652 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:39 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:39 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:39 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:39 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:39 ctl02 nova-api[14422]: 2017-09-28 13:00:39.728 14422 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:00:39 ctl02 nova-api[14422]: 2017-09-28 13:00:39.729 14422 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:00:39 ctl02 nova-api[14422]: 2017-09-28 13:00:39.729 14422 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:00:39 ctl02 nova-api[14422]: 2017-09-28 13:00:39.729 14422 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:00:39 ctl02 nova-api[14422]: 2017-09-28 13:00:39.729 14422 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:00:39 ctl02 nova-api[14422]: 2017-09-28 13:00:39.729 14422 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:00:39 ctl02 nova-api[14422]: 2017-09-28 13:00:39.729 14422 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:00:39 ctl02 nova-api[14422]: 2017-09-28 13:00:39.729 14422 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:00:39 ctl02 nova-api[14422]: 2017-09-28 13:00:39.729 14422 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:00:39 ctl02 nova-api[14422]: 2017-09-28 13:00:39.729 14422 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:00:39 ctl02 nova-api[14422]: 2017-09-28 13:00:39.729 14422 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:00:39 ctl02 nova-api[14422]: 2017-09-28 13:00:39.729 14422 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:00:39 ctl02 nova-api[14422]: 2017-09-28 13:00:39.729 14422 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:00:39 ctl02 nova-api[14422]: 2017-09-28 13:00:39.729 14422 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:00:39 ctl02 nova-api[14422]: 2017-09-28 13:00:39.729 14422 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:00:39 ctl02 nova-api[14422]: 2017-09-28 13:00:39.729 14422 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:00:39 ctl02 nova-api[14422]: 2017-09-28 13:00:39.729 14422 ERROR nova.wsgi     self.filename))
Sep 28 13:00:39 ctl02 nova-api[14422]: 2017-09-28 13:00:39.729 14422 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:00:39 ctl02 nova-api[14422]: 2017-09-28 13:00:39.729 14422 ERROR nova.wsgi
Sep 28 13:00:39 ctl02 nova-api[14422]: 2017-09-28 13:00:39.730 14422 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:00:39 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xeb929d4b)
Sep 28 13:00:39 ctl02 nova-api[14422]: 2017-09-28 13:00:39.861 14422 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:00:39 ctl02 neutron-server[30536]: 2017-09-28 13:00:39.906 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:39 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:39 ctl02 neutron-server[30536]: 2017-09-28 13:00:39.906 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:39 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:39 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:39 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:39 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:40 ctl02 nova-api[14422]: 2017-09-28 13:00:40.089 14422 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:00:40 ctl02 nova-api[14422]: 2017-09-28 13:00:40.092 14422 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:00:40 ctl02 nova-api[14422]: 2017-09-28 13:00:40.092 14422 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:00:40 ctl02 nova-api[14422]: 2017-09-28 13:00:40.092 14422 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:00:40 ctl02 heat-api[13008]: 2017-09-28 13:00:40.143 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:00:40] "OPTIONS / HTTP/1.0" 200 134 0.000862
Sep 28 13:00:40 ctl02 neutron-server[30536]: 2017-09-28 13:00:40.159 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:40 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:40 ctl02 neutron-server[30536]: 2017-09-28 13:00:40.159 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:40 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:40 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:40 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:40 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:40 ctl02 nova-api[14422]: 2017-09-28 13:00:40.228 14422 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:00:40 ctl02 nova-api[14422]: 2017-09-28 13:00:40.230 14422 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:00:40 ctl02 nova-api[14422]: 2017-09-28 13:00:40.231 14422 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:00:40 ctl02 nova-api[14422]: 2017-09-28 13:00:40.231 14422 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:00:40 ctl02 nova-api[14422]: 2017-09-28 13:00:40.234 14422 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:00:40 ctl02 nova-api[14422]: 2017-09-28 13:00:40.235 14422 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:00:40 ctl02 nova-api[14422]: 2017-09-28 13:00:40.235 14422 ERROR nova Traceback (most recent call last):
Sep 28 13:00:40 ctl02 nova-api[14422]: 2017-09-28 13:00:40.235 14422 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:00:40 ctl02 nova-api[14422]: 2017-09-28 13:00:40.235 14422 ERROR nova     sys.exit(main())
Sep 28 13:00:40 ctl02 nova-api[14422]: 2017-09-28 13:00:40.235 14422 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:00:40 ctl02 nova-api[14422]: 2017-09-28 13:00:40.235 14422 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:00:40 ctl02 nova-api[14422]: 2017-09-28 13:00:40.235 14422 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:00:40 ctl02 nova-api[14422]: 2017-09-28 13:00:40.235 14422 ERROR nova     max_url_len=max_url_len)
Sep 28 13:00:40 ctl02 nova-api[14422]: 2017-09-28 13:00:40.235 14422 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:00:40 ctl02 nova-api[14422]: 2017-09-28 13:00:40.235 14422 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:00:40 ctl02 nova-api[14422]: 2017-09-28 13:00:40.235 14422 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:00:40 ctl02 nova-api[14422]: 2017-09-28 13:00:40.235 14422 ERROR nova     sock.listen(backlog)
Sep 28 13:00:40 ctl02 nova-api[14422]: 2017-09-28 13:00:40.235 14422 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:00:40 ctl02 nova-api[14422]: 2017-09-28 13:00:40.235 14422 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:00:40 ctl02 nova-api[14422]: 2017-09-28 13:00:40.235 14422 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:00:40 ctl02 nova-api[14422]: 2017-09-28 13:00:40.235 14422 ERROR nova
Sep 28 13:00:40 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:00:40 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:00:40 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:00:40 ctl02 neutron-server[30536]: 2017-09-28 13:00:40.412 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:40 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:40 ctl02 neutron-server[30536]: 2017-09-28 13:00:40.413 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:40 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:40 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:40 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:40 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:40 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:00:40.541 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:00:40] "OPTIONS / HTTP/1.0" 200 134 0.000518
Sep 28 13:00:40 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:00:40 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:00:40 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:00:40 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:00:40 ctl02 neutron-server[30536]: 2017-09-28 13:00:40.666 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:40 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:40 ctl02 neutron-server[30536]: 2017-09-28 13:00:40.667 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:40 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:40 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:40 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:40 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:40 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xeb929d4b)
Sep 28 13:00:40 ctl02 neutron-server[30536]: 2017-09-28 13:00:40.921 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:40 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:40 ctl02 neutron-server[30536]: 2017-09-28 13:00:40.921 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:40 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:40 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:40 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:40 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:41 ctl02 neutron-server[30536]: 2017-09-28 13:00:41.174 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:41 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:41 ctl02 neutron-server[30536]: 2017-09-28 13:00:41.175 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:41 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:41 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:41 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:41 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:41 ctl02 neutron-server[30536]: 2017-09-28 13:00:41.430 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:41 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:41 ctl02 neutron-server[30536]: 2017-09-28 13:00:41.430 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:41 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:41 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:41 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:41 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:41 ctl02 neutron-server[30536]: 2017-09-28 13:00:41.537 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:00:41] "OPTIONS / HTTP/1.0" 200 262 0.000465
Sep 28 13:00:41 ctl02 neutron-server[30536]: 2017-09-28 13:00:41.684 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:41 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:41 ctl02 neutron-server[30536]: 2017-09-28 13:00:41.684 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:41 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:41 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:41 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:41 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:41 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xeb929d4b)
Sep 28 13:00:41 ctl02 neutron-server[30536]: 2017-09-28 13:00:41.938 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:41 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:41 ctl02 neutron-server[30536]: 2017-09-28 13:00:41.938 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:41 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:41 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:41 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:41 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:42 ctl02 neutron-server[30536]: 2017-09-28 13:00:42.191 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:42 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:42 ctl02 neutron-server[30536]: 2017-09-28 13:00:42.192 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:42 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:42 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:42 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:42 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:42 ctl02 nova-api[14440]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:00:42 ctl02 nova-api[14440]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:00:42 ctl02 neutron-server[30536]: 2017-09-28 13:00:42.445 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:42 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:42 ctl02 neutron-server[30536]: 2017-09-28 13:00:42.445 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:42 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:42 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:42 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:42 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:42 ctl02 nova-api[14440]: 2017-09-28 13:00:42.501 14440 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:00:42 ctl02 nova-api[14440]: 2017-09-28 13:00:42.502 14440 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:00:42 ctl02 nova-api[14440]: 2017-09-28 13:00:42.502 14440 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:00:42 ctl02 nova-api[14440]: 2017-09-28 13:00:42.502 14440 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:00:42 ctl02 nova-api[14440]: 2017-09-28 13:00:42.502 14440 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:00:42 ctl02 nova-api[14440]: 2017-09-28 13:00:42.502 14440 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:00:42 ctl02 nova-api[14440]: 2017-09-28 13:00:42.502 14440 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:00:42 ctl02 nova-api[14440]: 2017-09-28 13:00:42.502 14440 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:00:42 ctl02 nova-api[14440]: 2017-09-28 13:00:42.502 14440 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:00:42 ctl02 nova-api[14440]: 2017-09-28 13:00:42.502 14440 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:00:42 ctl02 nova-api[14440]: 2017-09-28 13:00:42.502 14440 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:00:42 ctl02 nova-api[14440]: 2017-09-28 13:00:42.502 14440 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:00:42 ctl02 nova-api[14440]: 2017-09-28 13:00:42.502 14440 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:00:42 ctl02 nova-api[14440]: 2017-09-28 13:00:42.502 14440 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:00:42 ctl02 nova-api[14440]: 2017-09-28 13:00:42.502 14440 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:00:42 ctl02 nova-api[14440]: 2017-09-28 13:00:42.502 14440 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:00:42 ctl02 nova-api[14440]: 2017-09-28 13:00:42.502 14440 ERROR nova.wsgi     self.filename))
Sep 28 13:00:42 ctl02 nova-api[14440]: 2017-09-28 13:00:42.502 14440 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:00:42 ctl02 nova-api[14440]: 2017-09-28 13:00:42.502 14440 ERROR nova.wsgi
Sep 28 13:00:42 ctl02 nova-api[14440]: 2017-09-28 13:00:42.503 14440 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:00:42 ctl02 nova-api[14440]: 2017-09-28 13:00:42.631 14440 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:00:42 ctl02 neutron-server[30536]: 2017-09-28 13:00:42.699 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:42 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:42 ctl02 neutron-server[30536]: 2017-09-28 13:00:42.700 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:42 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:42 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:42 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:42 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:42 ctl02 glance-api[29183]: 2017-09-28 13:00:42.744 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:00:42] "OPTIONS / HTTP/1.0" 200 134 0.000641
Sep 28 13:00:42 ctl02 glance-api[29183]: 2017-09-28 13:00:42.802 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:00:42] "OPTIONS / HTTP/1.0" 200 134 0.000698
Sep 28 13:00:42 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xeb929d4b)
Sep 28 13:00:42 ctl02 nova-api[14440]: 2017-09-28 13:00:42.853 14440 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:00:42 ctl02 nova-api[14440]: 2017-09-28 13:00:42.855 14440 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:00:42 ctl02 nova-api[14440]: 2017-09-28 13:00:42.855 14440 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:00:42 ctl02 nova-api[14440]: 2017-09-28 13:00:42.856 14440 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:00:42 ctl02 neutron-server[30536]: 2017-09-28 13:00:42.953 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:42 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:42 ctl02 neutron-server[30536]: 2017-09-28 13:00:42.954 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:42 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:42 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:42 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:42 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:42 ctl02 nova-api[14440]: 2017-09-28 13:00:42.986 14440 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:00:42 ctl02 nova-api[14440]: 2017-09-28 13:00:42.988 14440 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:00:42 ctl02 nova-api[14440]: 2017-09-28 13:00:42.988 14440 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:00:42 ctl02 nova-api[14440]: 2017-09-28 13:00:42.988 14440 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:00:42 ctl02 nova-api[14440]: 2017-09-28 13:00:42.992 14440 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:00:42 ctl02 nova-api[14440]: 2017-09-28 13:00:42.992 14440 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:00:42 ctl02 nova-api[14440]: 2017-09-28 13:00:42.992 14440 ERROR nova Traceback (most recent call last):
Sep 28 13:00:42 ctl02 nova-api[14440]: 2017-09-28 13:00:42.992 14440 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:00:42 ctl02 nova-api[14440]: 2017-09-28 13:00:42.992 14440 ERROR nova     sys.exit(main())
Sep 28 13:00:42 ctl02 nova-api[14440]: 2017-09-28 13:00:42.992 14440 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:00:42 ctl02 nova-api[14440]: 2017-09-28 13:00:42.992 14440 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:00:42 ctl02 nova-api[14440]: 2017-09-28 13:00:42.992 14440 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:00:42 ctl02 nova-api[14440]: 2017-09-28 13:00:42.992 14440 ERROR nova     max_url_len=max_url_len)
Sep 28 13:00:42 ctl02 nova-api[14440]: 2017-09-28 13:00:42.992 14440 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:00:42 ctl02 nova-api[14440]: 2017-09-28 13:00:42.992 14440 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:00:42 ctl02 nova-api[14440]: 2017-09-28 13:00:42.992 14440 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:00:42 ctl02 nova-api[14440]: 2017-09-28 13:00:42.992 14440 ERROR nova     sock.listen(backlog)
Sep 28 13:00:42 ctl02 nova-api[14440]: 2017-09-28 13:00:42.992 14440 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:00:42 ctl02 nova-api[14440]: 2017-09-28 13:00:42.992 14440 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:00:42 ctl02 nova-api[14440]: 2017-09-28 13:00:42.992 14440 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:00:42 ctl02 nova-api[14440]: 2017-09-28 13:00:42.992 14440 ERROR nova
Sep 28 13:00:43 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:00:43 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:00:43 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:00:43 ctl02 neutron-server[30536]: 2017-09-28 13:00:43.207 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:43 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:43 ctl02 neutron-server[30536]: 2017-09-28 13:00:43.207 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:43 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:43 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:43 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:43 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:43 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:00:43 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:00:43 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:00:43 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:00:43 ctl02 neutron-server[30536]: 2017-09-28 13:00:43.461 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:43 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:43 ctl02 neutron-server[30536]: 2017-09-28 13:00:43.461 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:43 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:43 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:43 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:43 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:43 ctl02 neutron-server[30536]: 2017-09-28 13:00:43.715 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:43 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:43 ctl02 neutron-server[30536]: 2017-09-28 13:00:43.715 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:43 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:43 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:43 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:43 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:43 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 13:00:43 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 13:00:43 ctl02 heat-api[13008]: 2017-09-28 13:00:43.935 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:00:43] "OPTIONS / HTTP/1.0" 200 134 0.000537
Sep 28 13:00:43 ctl02 neutron-server[30536]: 2017-09-28 13:00:43.968 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:43 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:43 ctl02 neutron-server[30536]: 2017-09-28 13:00:43.969 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:43 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:43 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:43 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:43 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:44 ctl02 neutron-server[30536]: 2017-09-28 13:00:44.223 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:44 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:44 ctl02 neutron-server[30536]: 2017-09-28 13:00:44.223 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:44 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:44 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:44 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:44 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:44 ctl02 neutron-server[30536]: 2017-09-28 13:00:44.476 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:44 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:44 ctl02 neutron-server[30536]: 2017-09-28 13:00:44.477 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:44 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:44 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:44 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:44 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:44 ctl02 neutron-server[30536]: 2017-09-28 13:00:44.730 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:44 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:44 ctl02 neutron-server[30536]: 2017-09-28 13:00:44.730 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:44 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:44 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:44 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:44 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:44 ctl02 neutron-server[30536]: 2017-09-28 13:00:44.984 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:44 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:44 ctl02 neutron-server[30536]: 2017-09-28 13:00:44.984 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:44 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:44 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:44 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:44 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:45 ctl02 nova-api[14457]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:00:45 ctl02 nova-api[14457]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:00:45 ctl02 neutron-server[30536]: 2017-09-28 13:00:45.117 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:00:45] "OPTIONS / HTTP/1.0" 200 262 0.000620
Sep 28 13:00:45 ctl02 neutron-server[30536]: 2017-09-28 13:00:45.237 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:45 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:45 ctl02 neutron-server[30536]: 2017-09-28 13:00:45.238 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:45 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:45 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:45 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:45 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:45 ctl02 heat-api-cfn[13300]: 2017-09-28 13:00:45.246 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:00:45] "OPTIONS / HTTP/1.0" 200 134 0.000403
Sep 28 13:00:45 ctl02 nova-api[14457]: 2017-09-28 13:00:45.294 14457 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:00:45 ctl02 nova-api[14457]: 2017-09-28 13:00:45.295 14457 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:00:45 ctl02 nova-api[14457]: 2017-09-28 13:00:45.295 14457 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:00:45 ctl02 nova-api[14457]: 2017-09-28 13:00:45.295 14457 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:00:45 ctl02 nova-api[14457]: 2017-09-28 13:00:45.295 14457 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:00:45 ctl02 nova-api[14457]: 2017-09-28 13:00:45.295 14457 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:00:45 ctl02 nova-api[14457]: 2017-09-28 13:00:45.295 14457 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:00:45 ctl02 nova-api[14457]: 2017-09-28 13:00:45.295 14457 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:00:45 ctl02 nova-api[14457]: 2017-09-28 13:00:45.295 14457 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:00:45 ctl02 nova-api[14457]: 2017-09-28 13:00:45.295 14457 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:00:45 ctl02 nova-api[14457]: 2017-09-28 13:00:45.295 14457 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:00:45 ctl02 nova-api[14457]: 2017-09-28 13:00:45.295 14457 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:00:45 ctl02 nova-api[14457]: 2017-09-28 13:00:45.295 14457 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:00:45 ctl02 nova-api[14457]: 2017-09-28 13:00:45.295 14457 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:00:45 ctl02 nova-api[14457]: 2017-09-28 13:00:45.295 14457 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:00:45 ctl02 nova-api[14457]: 2017-09-28 13:00:45.295 14457 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:00:45 ctl02 nova-api[14457]: 2017-09-28 13:00:45.295 14457 ERROR nova.wsgi     self.filename))
Sep 28 13:00:45 ctl02 nova-api[14457]: 2017-09-28 13:00:45.295 14457 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:00:45 ctl02 nova-api[14457]: 2017-09-28 13:00:45.295 14457 ERROR nova.wsgi
Sep 28 13:00:45 ctl02 nova-api[14457]: 2017-09-28 13:00:45.296 14457 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:00:45 ctl02 nova-api[14457]: 2017-09-28 13:00:45.424 14457 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:00:45 ctl02 neutron-server[30536]: 2017-09-28 13:00:45.491 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:45 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:45 ctl02 neutron-server[30536]: 2017-09-28 13:00:45.492 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:45 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:45 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:45 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:45 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:45 ctl02 nova-api[14457]: 2017-09-28 13:00:45.648 14457 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:00:45 ctl02 nova-api[14457]: 2017-09-28 13:00:45.650 14457 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:00:45 ctl02 nova-api[14457]: 2017-09-28 13:00:45.650 14457 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:00:45 ctl02 nova-api[14457]: 2017-09-28 13:00:45.650 14457 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:00:45 ctl02 neutron-server[30536]: 2017-09-28 13:00:45.745 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:45 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:45 ctl02 neutron-server[30536]: 2017-09-28 13:00:45.746 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:45 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:45 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:45 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:45 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:45 ctl02 nova-api[14457]: 2017-09-28 13:00:45.780 14457 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:00:45 ctl02 nova-api[14457]: 2017-09-28 13:00:45.782 14457 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:00:45 ctl02 nova-api[14457]: 2017-09-28 13:00:45.782 14457 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:00:45 ctl02 nova-api[14457]: 2017-09-28 13:00:45.782 14457 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:00:45 ctl02 nova-api[14457]: 2017-09-28 13:00:45.785 14457 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:00:45 ctl02 nova-api[14457]: 2017-09-28 13:00:45.786 14457 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:00:45 ctl02 nova-api[14457]: 2017-09-28 13:00:45.786 14457 ERROR nova Traceback (most recent call last):
Sep 28 13:00:45 ctl02 nova-api[14457]: 2017-09-28 13:00:45.786 14457 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:00:45 ctl02 nova-api[14457]: 2017-09-28 13:00:45.786 14457 ERROR nova     sys.exit(main())
Sep 28 13:00:45 ctl02 nova-api[14457]: 2017-09-28 13:00:45.786 14457 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:00:45 ctl02 nova-api[14457]: 2017-09-28 13:00:45.786 14457 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:00:45 ctl02 nova-api[14457]: 2017-09-28 13:00:45.786 14457 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:00:45 ctl02 nova-api[14457]: 2017-09-28 13:00:45.786 14457 ERROR nova     max_url_len=max_url_len)
Sep 28 13:00:45 ctl02 nova-api[14457]: 2017-09-28 13:00:45.786 14457 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:00:45 ctl02 nova-api[14457]: 2017-09-28 13:00:45.786 14457 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:00:45 ctl02 nova-api[14457]: 2017-09-28 13:00:45.786 14457 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:00:45 ctl02 nova-api[14457]: 2017-09-28 13:00:45.786 14457 ERROR nova     sock.listen(backlog)
Sep 28 13:00:45 ctl02 nova-api[14457]: 2017-09-28 13:00:45.786 14457 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:00:45 ctl02 nova-api[14457]: 2017-09-28 13:00:45.786 14457 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:00:45 ctl02 nova-api[14457]: 2017-09-28 13:00:45.786 14457 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:00:45 ctl02 nova-api[14457]: 2017-09-28 13:00:45.786 14457 ERROR nova
Sep 28 13:00:45 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:00:45 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:00:45 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:00:45 ctl02 neutron-server[30536]: 2017-09-28 13:00:45.999 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:46 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:46 ctl02 neutron-server[30536]: 2017-09-28 13:00:45.999 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:46 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:46 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:46 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:46 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:46 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:00:46 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:00:46 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:00:46 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:00:46 ctl02 neutron-server[30536]: 2017-09-28 13:00:46.253 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:46 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:46 ctl02 neutron-server[30536]: 2017-09-28 13:00:46.253 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:46 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:46 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:46 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:46 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:46 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:00:46.301 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:00:46] "OPTIONS / HTTP/1.0" 200 134 0.000379
Sep 28 13:00:46 ctl02 heat-api-cfn[13300]: 2017-09-28 13:00:46.438 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:00:46] "OPTIONS / HTTP/1.0" 200 134 0.000435
Sep 28 13:00:46 ctl02 neutron-server[30536]: 2017-09-28 13:00:46.506 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:46 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:46 ctl02 neutron-server[30536]: 2017-09-28 13:00:46.507 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:46 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:46 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:46 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:46 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:46 ctl02 neutron-server[30536]: 2017-09-28 13:00:46.760 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:46 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:46 ctl02 neutron-server[30536]: 2017-09-28 13:00:46.761 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:46 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:46 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:46 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:46 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:47 ctl02 neutron-server[30536]: 2017-09-28 13:00:47.014 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:47 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:47 ctl02 neutron-server[30536]: 2017-09-28 13:00:47.015 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:47 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:47 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:47 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:47 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:47 ctl02 neutron-server[30536]: 2017-09-28 13:00:47.268 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:47 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:47 ctl02 neutron-server[30536]: 2017-09-28 13:00:47.268 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:47 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:47 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:47 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:47 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:47 ctl02 heat-api[13008]: 2017-09-28 13:00:47.527 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:00:47] "OPTIONS / HTTP/1.0" 200 134 0.000768
Sep 28 13:00:47 ctl02 neutron-server[30536]: 2017-09-28 13:00:47.534 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:47 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:47 ctl02 neutron-server[30536]: 2017-09-28 13:00:47.534 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:47 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:47 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:47 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:47 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:47 ctl02 neutron-server[30536]: 2017-09-28 13:00:47.588 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:00:47] "OPTIONS / HTTP/1.0" 200 262 0.000465
Sep 28 13:00:47 ctl02 neutron-server[30536]: 2017-09-28 13:00:47.787 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:47 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:47 ctl02 neutron-server[30536]: 2017-09-28 13:00:47.787 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:47 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:47 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:47 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:47 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:47 ctl02 nova-api[14481]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:00:47 ctl02 nova-api[14481]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:00:48 ctl02 nova-api[14481]: 2017-09-28 13:00:48.003 14481 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:00:48 ctl02 nova-api[14481]: 2017-09-28 13:00:48.005 14481 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:00:48 ctl02 nova-api[14481]: 2017-09-28 13:00:48.005 14481 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:00:48 ctl02 nova-api[14481]: 2017-09-28 13:00:48.005 14481 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:00:48 ctl02 nova-api[14481]: 2017-09-28 13:00:48.005 14481 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:00:48 ctl02 nova-api[14481]: 2017-09-28 13:00:48.005 14481 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:00:48 ctl02 nova-api[14481]: 2017-09-28 13:00:48.005 14481 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:00:48 ctl02 nova-api[14481]: 2017-09-28 13:00:48.005 14481 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:00:48 ctl02 nova-api[14481]: 2017-09-28 13:00:48.005 14481 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:00:48 ctl02 nova-api[14481]: 2017-09-28 13:00:48.005 14481 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:00:48 ctl02 nova-api[14481]: 2017-09-28 13:00:48.005 14481 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:00:48 ctl02 nova-api[14481]: 2017-09-28 13:00:48.005 14481 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:00:48 ctl02 nova-api[14481]: 2017-09-28 13:00:48.005 14481 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:00:48 ctl02 nova-api[14481]: 2017-09-28 13:00:48.005 14481 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:00:48 ctl02 nova-api[14481]: 2017-09-28 13:00:48.005 14481 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:00:48 ctl02 nova-api[14481]: 2017-09-28 13:00:48.005 14481 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:00:48 ctl02 nova-api[14481]: 2017-09-28 13:00:48.005 14481 ERROR nova.wsgi     self.filename))
Sep 28 13:00:48 ctl02 nova-api[14481]: 2017-09-28 13:00:48.005 14481 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:00:48 ctl02 nova-api[14481]: 2017-09-28 13:00:48.005 14481 ERROR nova.wsgi
Sep 28 13:00:48 ctl02 nova-api[14481]: 2017-09-28 13:00:48.006 14481 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:00:48 ctl02 neutron-server[30536]: 2017-09-28 13:00:48.040 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:48 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:48 ctl02 neutron-server[30536]: 2017-09-28 13:00:48.041 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:48 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:48 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:48 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:48 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:48 ctl02 nova-api[14481]: 2017-09-28 13:00:48.138 14481 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:00:48 ctl02 neutron-server[30536]: 2017-09-28 13:00:48.294 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:48 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:48 ctl02 neutron-server[30536]: 2017-09-28 13:00:48.294 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:48 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:48 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:48 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:48 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:48 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:00:48.312 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:00:48] "OPTIONS / HTTP/1.0" 200 134 0.000361
Sep 28 13:00:48 ctl02 nova-api[14481]: 2017-09-28 13:00:48.366 14481 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:00:48 ctl02 nova-api[14481]: 2017-09-28 13:00:48.368 14481 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:00:48 ctl02 nova-api[14481]: 2017-09-28 13:00:48.368 14481 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:00:48 ctl02 nova-api[14481]: 2017-09-28 13:00:48.368 14481 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:00:48 ctl02 nova-api[14481]: 2017-09-28 13:00:48.499 14481 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:00:48 ctl02 nova-api[14481]: 2017-09-28 13:00:48.501 14481 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:00:48 ctl02 nova-api[14481]: 2017-09-28 13:00:48.501 14481 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:00:48 ctl02 nova-api[14481]: 2017-09-28 13:00:48.502 14481 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:00:48 ctl02 nova-api[14481]: 2017-09-28 13:00:48.505 14481 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:00:48 ctl02 nova-api[14481]: 2017-09-28 13:00:48.505 14481 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:00:48 ctl02 nova-api[14481]: 2017-09-28 13:00:48.505 14481 ERROR nova Traceback (most recent call last):
Sep 28 13:00:48 ctl02 nova-api[14481]: 2017-09-28 13:00:48.505 14481 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:00:48 ctl02 nova-api[14481]: 2017-09-28 13:00:48.505 14481 ERROR nova     sys.exit(main())
Sep 28 13:00:48 ctl02 nova-api[14481]: 2017-09-28 13:00:48.505 14481 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:00:48 ctl02 nova-api[14481]: 2017-09-28 13:00:48.505 14481 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:00:48 ctl02 nova-api[14481]: 2017-09-28 13:00:48.505 14481 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:00:48 ctl02 nova-api[14481]: 2017-09-28 13:00:48.505 14481 ERROR nova     max_url_len=max_url_len)
Sep 28 13:00:48 ctl02 nova-api[14481]: 2017-09-28 13:00:48.505 14481 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:00:48 ctl02 nova-api[14481]: 2017-09-28 13:00:48.505 14481 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:00:48 ctl02 nova-api[14481]: 2017-09-28 13:00:48.505 14481 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:00:48 ctl02 nova-api[14481]: 2017-09-28 13:00:48.505 14481 ERROR nova     sock.listen(backlog)
Sep 28 13:00:48 ctl02 nova-api[14481]: 2017-09-28 13:00:48.505 14481 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:00:48 ctl02 nova-api[14481]: 2017-09-28 13:00:48.505 14481 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:00:48 ctl02 nova-api[14481]: 2017-09-28 13:00:48.505 14481 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:00:48 ctl02 nova-api[14481]: 2017-09-28 13:00:48.505 14481 ERROR nova
Sep 28 13:00:48 ctl02 neutron-server[30536]: 2017-09-28 13:00:48.548 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:48 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:48 ctl02 neutron-server[30536]: 2017-09-28 13:00:48.549 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:48 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:48 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:48 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:48 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:48 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:00:48 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:00:48 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:00:48 ctl02 glance-api[29183]: 2017-09-28 13:00:48.675 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:00:48] "OPTIONS / HTTP/1.0" 200 134 0.000773
Sep 28 13:00:48 ctl02 neutron-server[30536]: 2017-09-28 13:00:48.802 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:48 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:48 ctl02 neutron-server[30536]: 2017-09-28 13:00:48.803 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:48 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:48 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:48 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:48 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:48 ctl02 heat-api-cfn[13300]: 2017-09-28 13:00:48.853 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:00:48] "OPTIONS / HTTP/1.0" 200 134 0.000559
Sep 28 13:00:48 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:00:48 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:00:48 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:00:48 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:00:49 ctl02 neutron-server[30536]: 2017-09-28 13:00:49.056 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:49 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:49 ctl02 neutron-server[30536]: 2017-09-28 13:00:49.057 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:49 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:49 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:49 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:49 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:49 ctl02 neutron-server[30536]: 2017-09-28 13:00:49.316 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:49 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:49 ctl02 neutron-server[30536]: 2017-09-28 13:00:49.316 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:49 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:49 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:49 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:49 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:49 ctl02 neutron-server[30536]: 2017-09-28 13:00:49.582 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:49 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:49 ctl02 neutron-server[30536]: 2017-09-28 13:00:49.582 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:49 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:49 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:49 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:49 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:49 ctl02 neutron-server[30536]: 2017-09-28 13:00:49.835 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:49 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:49 ctl02 neutron-server[30536]: 2017-09-28 13:00:49.836 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:49 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:49 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:49 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:49 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:49 ctl02 heat-api[13008]: 2017-09-28 13:00:49.992 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:00:49] "OPTIONS / HTTP/1.0" 200 134 0.000574
Sep 28 13:00:50 ctl02 neutron-server[30536]: 2017-09-28 13:00:50.088 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:50 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:50 ctl02 neutron-server[30536]: 2017-09-28 13:00:50.089 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:50 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:50 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:50 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:50 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:50 ctl02 neutron-server[30536]: 2017-09-28 13:00:50.342 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:50 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:50 ctl02 neutron-server[30536]: 2017-09-28 13:00:50.343 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:50 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:50 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:50 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:50 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:50 ctl02 nova-api[14499]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:00:50 ctl02 nova-api[14499]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:00:50 ctl02 neutron-server[30536]: 2017-09-28 13:00:50.596 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:50 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:50 ctl02 neutron-server[30536]: 2017-09-28 13:00:50.597 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:50 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:50 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:50 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:50 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:50 ctl02 nova-api[14499]: 2017-09-28 13:00:50.722 14499 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:00:50 ctl02 nova-api[14499]: 2017-09-28 13:00:50.723 14499 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:00:50 ctl02 nova-api[14499]: 2017-09-28 13:00:50.723 14499 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:00:50 ctl02 nova-api[14499]: 2017-09-28 13:00:50.723 14499 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:00:50 ctl02 nova-api[14499]: 2017-09-28 13:00:50.723 14499 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:00:50 ctl02 nova-api[14499]: 2017-09-28 13:00:50.723 14499 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:00:50 ctl02 nova-api[14499]: 2017-09-28 13:00:50.723 14499 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:00:50 ctl02 nova-api[14499]: 2017-09-28 13:00:50.723 14499 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:00:50 ctl02 nova-api[14499]: 2017-09-28 13:00:50.723 14499 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:00:50 ctl02 nova-api[14499]: 2017-09-28 13:00:50.723 14499 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:00:50 ctl02 nova-api[14499]: 2017-09-28 13:00:50.723 14499 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:00:50 ctl02 nova-api[14499]: 2017-09-28 13:00:50.723 14499 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:00:50 ctl02 nova-api[14499]: 2017-09-28 13:00:50.723 14499 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:00:50 ctl02 nova-api[14499]: 2017-09-28 13:00:50.723 14499 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:00:50 ctl02 nova-api[14499]: 2017-09-28 13:00:50.723 14499 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:00:50 ctl02 nova-api[14499]: 2017-09-28 13:00:50.723 14499 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:00:50 ctl02 nova-api[14499]: 2017-09-28 13:00:50.723 14499 ERROR nova.wsgi     self.filename))
Sep 28 13:00:50 ctl02 nova-api[14499]: 2017-09-28 13:00:50.723 14499 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:00:50 ctl02 nova-api[14499]: 2017-09-28 13:00:50.723 14499 ERROR nova.wsgi
Sep 28 13:00:50 ctl02 nova-api[14499]: 2017-09-28 13:00:50.724 14499 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:00:50 ctl02 nova-api[14499]: 2017-09-28 13:00:50.850 14499 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:00:50 ctl02 neutron-server[30536]: 2017-09-28 13:00:50.850 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:50 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:50 ctl02 neutron-server[30536]: 2017-09-28 13:00:50.851 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:50 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:50 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:50 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:50 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:50 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:00:50.915 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:00:50] "OPTIONS / HTTP/1.0" 200 134 0.000517
Sep 28 13:00:51 ctl02 neutron-server[30536]: 2017-09-28 13:00:51.045 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 2 dead agents out of 6:
Sep 28 13:00:51 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 13:00:51 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:59:06 cmp002
Sep 28 13:00:51 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 13:00:10 cmp002
Sep 28 13:00:51 ctl02 nova-api[14499]: 2017-09-28 13:00:51.073 14499 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:00:51 ctl02 nova-api[14499]: 2017-09-28 13:00:51.075 14499 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:00:51 ctl02 nova-api[14499]: 2017-09-28 13:00:51.075 14499 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:00:51 ctl02 nova-api[14499]: 2017-09-28 13:00:51.075 14499 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:00:51 ctl02 neutron-server[30536]: 2017-09-28 13:00:51.104 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:51 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:51 ctl02 neutron-server[30536]: 2017-09-28 13:00:51.105 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:51 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:51 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:51 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:51 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:51 ctl02 nova-api[14499]: 2017-09-28 13:00:51.205 14499 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:00:51 ctl02 nova-api[14499]: 2017-09-28 13:00:51.206 14499 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:00:51 ctl02 nova-api[14499]: 2017-09-28 13:00:51.207 14499 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:00:51 ctl02 nova-api[14499]: 2017-09-28 13:00:51.207 14499 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:00:51 ctl02 nova-api[14499]: 2017-09-28 13:00:51.211 14499 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:00:51 ctl02 nova-api[14499]: 2017-09-28 13:00:51.211 14499 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:00:51 ctl02 nova-api[14499]: 2017-09-28 13:00:51.211 14499 ERROR nova Traceback (most recent call last):
Sep 28 13:00:51 ctl02 nova-api[14499]: 2017-09-28 13:00:51.211 14499 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:00:51 ctl02 nova-api[14499]: 2017-09-28 13:00:51.211 14499 ERROR nova     sys.exit(main())
Sep 28 13:00:51 ctl02 nova-api[14499]: 2017-09-28 13:00:51.211 14499 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:00:51 ctl02 nova-api[14499]: 2017-09-28 13:00:51.211 14499 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:00:51 ctl02 nova-api[14499]: 2017-09-28 13:00:51.211 14499 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:00:51 ctl02 nova-api[14499]: 2017-09-28 13:00:51.211 14499 ERROR nova     max_url_len=max_url_len)
Sep 28 13:00:51 ctl02 nova-api[14499]: 2017-09-28 13:00:51.211 14499 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:00:51 ctl02 nova-api[14499]: 2017-09-28 13:00:51.211 14499 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:00:51 ctl02 nova-api[14499]: 2017-09-28 13:00:51.211 14499 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:00:51 ctl02 nova-api[14499]: 2017-09-28 13:00:51.211 14499 ERROR nova     sock.listen(backlog)
Sep 28 13:00:51 ctl02 nova-api[14499]: 2017-09-28 13:00:51.211 14499 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:00:51 ctl02 nova-api[14499]: 2017-09-28 13:00:51.211 14499 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:00:51 ctl02 nova-api[14499]: 2017-09-28 13:00:51.211 14499 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:00:51 ctl02 nova-api[14499]: 2017-09-28 13:00:51.211 14499 ERROR nova
Sep 28 13:00:51 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:00:51 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:00:51 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:00:51 ctl02 neutron-server[30536]: 2017-09-28 13:00:51.359 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:51 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:51 ctl02 neutron-server[30536]: 2017-09-28 13:00:51.359 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:51 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:51 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:51 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:51 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:51 ctl02 neutron-server[30536]: 2017-09-28 13:00:51.528 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:00:51] "OPTIONS / HTTP/1.0" 200 262 0.000631
Sep 28 13:00:51 ctl02 neutron-server[30536]: 2017-09-28 13:00:51.613 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:51 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:51 ctl02 neutron-server[30536]: 2017-09-28 13:00:51.614 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:51 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:51 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:51 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:51 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:51 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:00:51 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:00:51 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:00:51 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:00:51 ctl02 neutron-server[30536]: 2017-09-28 13:00:51.867 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:51 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:51 ctl02 neutron-server[30536]: 2017-09-28 13:00:51.869 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:51 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:51 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:51 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:51 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:52 ctl02 neutron-server[30536]: 2017-09-28 13:00:52.123 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:52 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:52 ctl02 neutron-server[30536]: 2017-09-28 13:00:52.125 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:52 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:52 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:52 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:52 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:52 ctl02 neutron-server[30536]: 2017-09-28 13:00:52.379 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:52 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:52 ctl02 neutron-server[30536]: 2017-09-28 13:00:52.380 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:52 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:52 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:52 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:52 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:52 ctl02 neutron-server[30536]: 2017-09-28 13:00:52.635 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:52 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:52 ctl02 neutron-server[30536]: 2017-09-28 13:00:52.637 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:52 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:52 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:52 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:52 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:52 ctl02 neutron-server[30536]: 2017-09-28 13:00:52.892 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:52 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:52 ctl02 neutron-server[30536]: 2017-09-28 13:00:52.893 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:52 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:52 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:52 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:52 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:52 ctl02 glance-api[29183]: 2017-09-28 13:00:52.916 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:00:52] "OPTIONS / HTTP/1.0" 200 134 0.000668
Sep 28 13:00:52 ctl02 glance-api[29183]: 2017-09-28 13:00:52.937 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:00:52] "OPTIONS / HTTP/1.0" 200 134 0.000568
Sep 28 13:00:53 ctl02 neutron-server[30536]: 2017-09-28 13:00:53.148 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:53 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:53 ctl02 neutron-server[30536]: 2017-09-28 13:00:53.149 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:53 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:53 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:53 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:53 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:53 ctl02 nova-api[14517]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:00:53 ctl02 nova-api[14517]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:00:53 ctl02 neutron-server[30536]: 2017-09-28 13:00:53.404 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:53 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:53 ctl02 neutron-server[30536]: 2017-09-28 13:00:53.406 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:53 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:53 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:53 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:53 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:53 ctl02 nova-api[14517]: 2017-09-28 13:00:53.539 14517 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:00:53 ctl02 nova-api[14517]: 2017-09-28 13:00:53.540 14517 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:00:53 ctl02 nova-api[14517]: 2017-09-28 13:00:53.540 14517 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:00:53 ctl02 nova-api[14517]: 2017-09-28 13:00:53.540 14517 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:00:53 ctl02 nova-api[14517]: 2017-09-28 13:00:53.540 14517 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:00:53 ctl02 nova-api[14517]: 2017-09-28 13:00:53.540 14517 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:00:53 ctl02 nova-api[14517]: 2017-09-28 13:00:53.540 14517 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:00:53 ctl02 nova-api[14517]: 2017-09-28 13:00:53.540 14517 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:00:53 ctl02 nova-api[14517]: 2017-09-28 13:00:53.540 14517 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:00:53 ctl02 nova-api[14517]: 2017-09-28 13:00:53.540 14517 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:00:53 ctl02 nova-api[14517]: 2017-09-28 13:00:53.540 14517 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:00:53 ctl02 nova-api[14517]: 2017-09-28 13:00:53.540 14517 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:00:53 ctl02 nova-api[14517]: 2017-09-28 13:00:53.540 14517 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:00:53 ctl02 nova-api[14517]: 2017-09-28 13:00:53.540 14517 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:00:53 ctl02 nova-api[14517]: 2017-09-28 13:00:53.540 14517 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:00:53 ctl02 nova-api[14517]: 2017-09-28 13:00:53.540 14517 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:00:53 ctl02 nova-api[14517]: 2017-09-28 13:00:53.540 14517 ERROR nova.wsgi     self.filename))
Sep 28 13:00:53 ctl02 nova-api[14517]: 2017-09-28 13:00:53.540 14517 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:00:53 ctl02 nova-api[14517]: 2017-09-28 13:00:53.540 14517 ERROR nova.wsgi
Sep 28 13:00:53 ctl02 nova-api[14517]: 2017-09-28 13:00:53.541 14517 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:00:53 ctl02 neutron-server[30536]: 2017-09-28 13:00:53.660 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:53 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:53 ctl02 neutron-server[30536]: 2017-09-28 13:00:53.661 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:53 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:53 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:53 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:53 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:53 ctl02 nova-api[14517]: 2017-09-28 13:00:53.672 14517 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:00:53 ctl02 neutron-server[30536]: 2017-09-28 13:00:53.915 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:53 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:53 ctl02 neutron-server[30536]: 2017-09-28 13:00:53.917 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:53 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:53 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:53 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:53 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:53 ctl02 nova-api[14517]: 2017-09-28 13:00:53.921 14517 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:00:53 ctl02 nova-api[14517]: 2017-09-28 13:00:53.923 14517 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:00:53 ctl02 nova-api[14517]: 2017-09-28 13:00:53.923 14517 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:00:53 ctl02 nova-api[14517]: 2017-09-28 13:00:53.924 14517 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:00:54 ctl02 nova-api[14517]: 2017-09-28 13:00:54.054 14517 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:00:54 ctl02 nova-api[14517]: 2017-09-28 13:00:54.056 14517 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:00:54 ctl02 nova-api[14517]: 2017-09-28 13:00:54.056 14517 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:00:54 ctl02 nova-api[14517]: 2017-09-28 13:00:54.063 14517 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:00:54 ctl02 nova-api[14517]: 2017-09-28 13:00:54.066 14517 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:00:54 ctl02 nova-api[14517]: 2017-09-28 13:00:54.067 14517 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:00:54 ctl02 nova-api[14517]: 2017-09-28 13:00:54.067 14517 ERROR nova Traceback (most recent call last):
Sep 28 13:00:54 ctl02 nova-api[14517]: 2017-09-28 13:00:54.067 14517 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:00:54 ctl02 nova-api[14517]: 2017-09-28 13:00:54.067 14517 ERROR nova     sys.exit(main())
Sep 28 13:00:54 ctl02 nova-api[14517]: 2017-09-28 13:00:54.067 14517 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:00:54 ctl02 nova-api[14517]: 2017-09-28 13:00:54.067 14517 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:00:54 ctl02 nova-api[14517]: 2017-09-28 13:00:54.067 14517 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:00:54 ctl02 nova-api[14517]: 2017-09-28 13:00:54.067 14517 ERROR nova     max_url_len=max_url_len)
Sep 28 13:00:54 ctl02 nova-api[14517]: 2017-09-28 13:00:54.067 14517 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:00:54 ctl02 nova-api[14517]: 2017-09-28 13:00:54.067 14517 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:00:54 ctl02 nova-api[14517]: 2017-09-28 13:00:54.067 14517 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:00:54 ctl02 nova-api[14517]: 2017-09-28 13:00:54.067 14517 ERROR nova     sock.listen(backlog)
Sep 28 13:00:54 ctl02 nova-api[14517]: 2017-09-28 13:00:54.067 14517 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:00:54 ctl02 nova-api[14517]: 2017-09-28 13:00:54.067 14517 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:00:54 ctl02 nova-api[14517]: 2017-09-28 13:00:54.067 14517 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:00:54 ctl02 nova-api[14517]: 2017-09-28 13:00:54.067 14517 ERROR nova
Sep 28 13:00:54 ctl02 heat-api[13008]: 2017-09-28 13:00:54.123 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:00:54] "OPTIONS / HTTP/1.0" 200 134 0.000594
Sep 28 13:00:54 ctl02 neutron-server[30536]: 2017-09-28 13:00:54.171 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:54 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:54 ctl02 neutron-server[30536]: 2017-09-28 13:00:54.173 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:54 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:54 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:54 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:54 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:54 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:00:54 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:00:54 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:00:54 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:00:54 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:00:54 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:00:54 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:00:54 ctl02 neutron-server[30536]: 2017-09-28 13:00:54.427 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:54 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:54 ctl02 neutron-server[30536]: 2017-09-28 13:00:54.428 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:54 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:54 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:54 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:54 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:54 ctl02 neutron-server[30536]: 2017-09-28 13:00:54.681 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:54 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:54 ctl02 neutron-server[30536]: 2017-09-28 13:00:54.682 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:54 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:54 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:54 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:54 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:54 ctl02 neutron-server[30536]: 2017-09-28 13:00:54.936 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:54 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:54 ctl02 neutron-server[30536]: 2017-09-28 13:00:54.936 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:54 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:54 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:54 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:54 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:55 ctl02 neutron-server[30536]: 2017-09-28 13:00:55.191 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:55 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:55 ctl02 neutron-server[30536]: 2017-09-28 13:00:55.192 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:55 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:55 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:55 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:55 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:55 ctl02 neutron-server[30536]: 2017-09-28 13:00:55.222 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:00:55] "OPTIONS / HTTP/1.0" 200 262 0.000544
Sep 28 13:00:55 ctl02 nova-conductor[5056]: 2017-09-28 13:00:55.267 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:00:55 ctl02 heat-api-cfn[13300]: 2017-09-28 13:00:55.276 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:00:55] "OPTIONS / HTTP/1.0" 200 134 0.000581
Sep 28 13:00:55 ctl02 nova-conductor[5056]: 2017-09-28 13:00:55.277 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:00:55 ctl02 nova-conductor[5056]: 2017-09-28 13:00:55.278 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:00:55 ctl02 nova-conductor[5056]: 2017-09-28 13:00:55.285 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:00:55 ctl02 neutron-server[30536]: 2017-09-28 13:00:55.447 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:55 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:55 ctl02 neutron-server[30536]: 2017-09-28 13:00:55.449 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:55 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:55 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:55 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:55 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:55 ctl02 neutron-server[30536]: 2017-09-28 13:00:55.702 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:55 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:55 ctl02 neutron-server[30536]: 2017-09-28 13:00:55.704 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:55 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:55 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:55 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:55 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:55 ctl02 nova-cert[4860]: 2017-09-28 13:00:55.881 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:00:55 ctl02 neutron-server[30536]: 2017-09-28 13:00:55.958 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:55 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:55 ctl02 neutron-server[30536]: 2017-09-28 13:00:55.960 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:55 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:55 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:55 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:55 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:56 ctl02 nova-api[14535]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:00:56 ctl02 nova-api[14535]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:00:56 ctl02 heat-api-cfn[13300]: 2017-09-28 13:00:56.124 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:00:56] "OPTIONS / HTTP/1.0" 200 134 0.000571
Sep 28 13:00:56 ctl02 neutron-server[30536]: 2017-09-28 13:00:56.214 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:56 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:56 ctl02 neutron-server[30536]: 2017-09-28 13:00:56.215 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:56 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:56 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:56 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:56 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:56 ctl02 nova-api[14535]: 2017-09-28 13:00:56.295 14535 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:00:56 ctl02 nova-api[14535]: 2017-09-28 13:00:56.296 14535 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:00:56 ctl02 nova-api[14535]: 2017-09-28 13:00:56.296 14535 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:00:56 ctl02 nova-api[14535]: 2017-09-28 13:00:56.296 14535 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:00:56 ctl02 nova-api[14535]: 2017-09-28 13:00:56.296 14535 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:00:56 ctl02 nova-api[14535]: 2017-09-28 13:00:56.296 14535 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:00:56 ctl02 nova-api[14535]: 2017-09-28 13:00:56.296 14535 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:00:56 ctl02 nova-api[14535]: 2017-09-28 13:00:56.296 14535 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:00:56 ctl02 nova-api[14535]: 2017-09-28 13:00:56.296 14535 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:00:56 ctl02 nova-api[14535]: 2017-09-28 13:00:56.296 14535 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:00:56 ctl02 nova-api[14535]: 2017-09-28 13:00:56.296 14535 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:00:56 ctl02 nova-api[14535]: 2017-09-28 13:00:56.296 14535 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:00:56 ctl02 nova-api[14535]: 2017-09-28 13:00:56.296 14535 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:00:56 ctl02 nova-api[14535]: 2017-09-28 13:00:56.296 14535 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:00:56 ctl02 nova-api[14535]: 2017-09-28 13:00:56.296 14535 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:00:56 ctl02 nova-api[14535]: 2017-09-28 13:00:56.296 14535 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:00:56 ctl02 nova-api[14535]: 2017-09-28 13:00:56.296 14535 ERROR nova.wsgi     self.filename))
Sep 28 13:00:56 ctl02 nova-api[14535]: 2017-09-28 13:00:56.296 14535 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:00:56 ctl02 nova-api[14535]: 2017-09-28 13:00:56.296 14535 ERROR nova.wsgi
Sep 28 13:00:56 ctl02 nova-api[14535]: 2017-09-28 13:00:56.297 14535 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:00:56 ctl02 nova-api[14535]: 2017-09-28 13:00:56.431 14535 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:00:56 ctl02 neutron-server[30536]: 2017-09-28 13:00:56.470 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:56 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:56 ctl02 neutron-server[30536]: 2017-09-28 13:00:56.471 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:56 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:56 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:56 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:56 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:56 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:00:56.528 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:00:56] "OPTIONS / HTTP/1.0" 200 134 0.000472
Sep 28 13:00:56 ctl02 nova-api[14535]: 2017-09-28 13:00:56.657 14535 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:00:56 ctl02 nova-api[14535]: 2017-09-28 13:00:56.659 14535 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:00:56 ctl02 nova-api[14535]: 2017-09-28 13:00:56.659 14535 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:00:56 ctl02 nova-api[14535]: 2017-09-28 13:00:56.660 14535 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:00:56 ctl02 neutron-server[30536]: 2017-09-28 13:00:56.725 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:56 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:56 ctl02 neutron-server[30536]: 2017-09-28 13:00:56.726 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:56 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:56 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:56 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:56 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:56 ctl02 nova-api[14535]: 2017-09-28 13:00:56.790 14535 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:00:56 ctl02 nova-api[14535]: 2017-09-28 13:00:56.792 14535 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:00:56 ctl02 nova-api[14535]: 2017-09-28 13:00:56.792 14535 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:00:56 ctl02 nova-api[14535]: 2017-09-28 13:00:56.792 14535 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:00:56 ctl02 nova-api[14535]: 2017-09-28 13:00:56.795 14535 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:00:56 ctl02 nova-api[14535]: 2017-09-28 13:00:56.796 14535 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:00:56 ctl02 nova-api[14535]: 2017-09-28 13:00:56.796 14535 ERROR nova Traceback (most recent call last):
Sep 28 13:00:56 ctl02 nova-api[14535]: 2017-09-28 13:00:56.796 14535 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:00:56 ctl02 nova-api[14535]: 2017-09-28 13:00:56.796 14535 ERROR nova     sys.exit(main())
Sep 28 13:00:56 ctl02 nova-api[14535]: 2017-09-28 13:00:56.796 14535 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:00:56 ctl02 nova-api[14535]: 2017-09-28 13:00:56.796 14535 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:00:56 ctl02 nova-api[14535]: 2017-09-28 13:00:56.796 14535 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:00:56 ctl02 nova-api[14535]: 2017-09-28 13:00:56.796 14535 ERROR nova     max_url_len=max_url_len)
Sep 28 13:00:56 ctl02 nova-api[14535]: 2017-09-28 13:00:56.796 14535 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:00:56 ctl02 nova-api[14535]: 2017-09-28 13:00:56.796 14535 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:00:56 ctl02 nova-api[14535]: 2017-09-28 13:00:56.796 14535 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:00:56 ctl02 nova-api[14535]: 2017-09-28 13:00:56.796 14535 ERROR nova     sock.listen(backlog)
Sep 28 13:00:56 ctl02 nova-api[14535]: 2017-09-28 13:00:56.796 14535 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:00:56 ctl02 nova-api[14535]: 2017-09-28 13:00:56.796 14535 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:00:56 ctl02 nova-api[14535]: 2017-09-28 13:00:56.796 14535 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:00:56 ctl02 nova-api[14535]: 2017-09-28 13:00:56.796 14535 ERROR nova
Sep 28 13:00:56 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:00:56 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:00:56 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:00:56 ctl02 neutron-server[30536]: 2017-09-28 13:00:56.981 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:56 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:56 ctl02 neutron-server[30536]: 2017-09-28 13:00:56.982 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:56 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:56 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:56 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:56 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:57 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:00:57 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:00:57 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:00:57 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:00:57 ctl02 neutron-server[30536]: 2017-09-28 13:00:57.236 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:57 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:57 ctl02 neutron-server[30536]: 2017-09-28 13:00:57.236 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:57 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:57 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:57 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:57 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:57 ctl02 heat-api[13008]: 2017-09-28 13:00:57.337 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:00:57] "OPTIONS / HTTP/1.0" 200 134 0.000665
Sep 28 13:00:57 ctl02 neutron-server[30536]: 2017-09-28 13:00:57.490 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:57 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:57 ctl02 neutron-server[30536]: 2017-09-28 13:00:57.493 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:00:57] "OPTIONS / HTTP/1.0" 200 262 0.000536
Sep 28 13:00:57 ctl02 neutron-server[30536]: 2017-09-28 13:00:57.490 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:57 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:57 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:57 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:57 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:57 ctl02 neutron-server[30536]: 2017-09-28 13:00:57.747 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:57 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:57 ctl02 neutron-server[30536]: 2017-09-28 13:00:57.748 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:57 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:57 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:57 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:57 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:58 ctl02 neutron-server[30536]: 2017-09-28 13:00:58.007 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:58 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:58 ctl02 neutron-server[30536]: 2017-09-28 13:00:58.007 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:58 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:58 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:58 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:58 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:58 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xeb25325)
Sep 28 13:00:58 ctl02 neutron-server[30536]: 2017-09-28 13:00:58.261 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:58 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:58 ctl02 neutron-server[30536]: 2017-09-28 13:00:58.261 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:58 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:58 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:58 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:58 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:58 ctl02 neutron-server[30536]: 2017-09-28 13:00:58.515 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:58 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:58 ctl02 neutron-server[30536]: 2017-09-28 13:00:58.515 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:58 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:58 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:58 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:58 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:58 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:00:58.668 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:00:58] "OPTIONS / HTTP/1.0" 200 134 0.000528
Sep 28 13:00:58 ctl02 neutron-server[30536]: 2017-09-28 13:00:58.769 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:58 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:58 ctl02 neutron-server[30536]: 2017-09-28 13:00:58.770 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:58 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:58 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:58 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:58 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:58 ctl02 glance-api[29183]: 2017-09-28 13:00:58.817 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:00:58] "OPTIONS / HTTP/1.0" 200 134 0.000633
Sep 28 13:00:58 ctl02 nova-api[14552]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:00:58 ctl02 nova-api[14552]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:00:59 ctl02 neutron-server[30536]: 2017-09-28 13:00:59.024 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:59 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:59 ctl02 neutron-server[30536]: 2017-09-28 13:00:59.024 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:59 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:59 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:59 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:59 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:59 ctl02 nova-api[14552]: 2017-09-28 13:00:59.033 14552 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:00:59 ctl02 nova-api[14552]: 2017-09-28 13:00:59.034 14552 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:00:59 ctl02 nova-api[14552]: 2017-09-28 13:00:59.034 14552 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:00:59 ctl02 nova-api[14552]: 2017-09-28 13:00:59.034 14552 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:00:59 ctl02 nova-api[14552]: 2017-09-28 13:00:59.034 14552 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:00:59 ctl02 nova-api[14552]: 2017-09-28 13:00:59.034 14552 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:00:59 ctl02 nova-api[14552]: 2017-09-28 13:00:59.034 14552 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:00:59 ctl02 nova-api[14552]: 2017-09-28 13:00:59.034 14552 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:00:59 ctl02 nova-api[14552]: 2017-09-28 13:00:59.034 14552 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:00:59 ctl02 nova-api[14552]: 2017-09-28 13:00:59.034 14552 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:00:59 ctl02 nova-api[14552]: 2017-09-28 13:00:59.034 14552 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:00:59 ctl02 nova-api[14552]: 2017-09-28 13:00:59.034 14552 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:00:59 ctl02 nova-api[14552]: 2017-09-28 13:00:59.034 14552 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:00:59 ctl02 nova-api[14552]: 2017-09-28 13:00:59.034 14552 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:00:59 ctl02 nova-api[14552]: 2017-09-28 13:00:59.034 14552 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:00:59 ctl02 nova-api[14552]: 2017-09-28 13:00:59.034 14552 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:00:59 ctl02 nova-api[14552]: 2017-09-28 13:00:59.034 14552 ERROR nova.wsgi     self.filename))
Sep 28 13:00:59 ctl02 nova-api[14552]: 2017-09-28 13:00:59.034 14552 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:00:59 ctl02 nova-api[14552]: 2017-09-28 13:00:59.034 14552 ERROR nova.wsgi
Sep 28 13:00:59 ctl02 nova-api[14552]: 2017-09-28 13:00:59.036 14552 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:00:59 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xeb25325)
Sep 28 13:00:59 ctl02 nova-api[14552]: 2017-09-28 13:00:59.170 14552 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:00:59 ctl02 heat-api-cfn[13300]: 2017-09-28 13:00:59.223 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:00:59] "OPTIONS / HTTP/1.0" 200 134 0.000479
Sep 28 13:00:59 ctl02 neutron-server[30536]: 2017-09-28 13:00:59.278 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:59 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:59 ctl02 neutron-server[30536]: 2017-09-28 13:00:59.278 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:59 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:59 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:59 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:59 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:59 ctl02 nova-api[14552]: 2017-09-28 13:00:59.425 14552 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:00:59 ctl02 nova-api[14552]: 2017-09-28 13:00:59.428 14552 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:00:59 ctl02 nova-api[14552]: 2017-09-28 13:00:59.428 14552 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:00:59 ctl02 nova-api[14552]: 2017-09-28 13:00:59.428 14552 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:00:59 ctl02 neutron-server[30536]: 2017-09-28 13:00:59.532 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:59 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:59 ctl02 neutron-server[30536]: 2017-09-28 13:00:59.533 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:59 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:59 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:59 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:59 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:59 ctl02 nova-api[14552]: 2017-09-28 13:00:59.561 14552 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:00:59 ctl02 nova-api[14552]: 2017-09-28 13:00:59.563 14552 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:00:59 ctl02 nova-api[14552]: 2017-09-28 13:00:59.563 14552 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:00:59 ctl02 nova-api[14552]: 2017-09-28 13:00:59.564 14552 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:00:59 ctl02 nova-api[14552]: 2017-09-28 13:00:59.567 14552 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:00:59 ctl02 nova-api[14552]: 2017-09-28 13:00:59.567 14552 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:00:59 ctl02 nova-api[14552]: 2017-09-28 13:00:59.567 14552 ERROR nova Traceback (most recent call last):
Sep 28 13:00:59 ctl02 nova-api[14552]: 2017-09-28 13:00:59.567 14552 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:00:59 ctl02 nova-api[14552]: 2017-09-28 13:00:59.567 14552 ERROR nova     sys.exit(main())
Sep 28 13:00:59 ctl02 nova-api[14552]: 2017-09-28 13:00:59.567 14552 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:00:59 ctl02 nova-api[14552]: 2017-09-28 13:00:59.567 14552 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:00:59 ctl02 nova-api[14552]: 2017-09-28 13:00:59.567 14552 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:00:59 ctl02 nova-api[14552]: 2017-09-28 13:00:59.567 14552 ERROR nova     max_url_len=max_url_len)
Sep 28 13:00:59 ctl02 nova-api[14552]: 2017-09-28 13:00:59.567 14552 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:00:59 ctl02 nova-api[14552]: 2017-09-28 13:00:59.567 14552 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:00:59 ctl02 nova-api[14552]: 2017-09-28 13:00:59.567 14552 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:00:59 ctl02 nova-api[14552]: 2017-09-28 13:00:59.567 14552 ERROR nova     sock.listen(backlog)
Sep 28 13:00:59 ctl02 nova-api[14552]: 2017-09-28 13:00:59.567 14552 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:00:59 ctl02 nova-api[14552]: 2017-09-28 13:00:59.567 14552 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:00:59 ctl02 nova-api[14552]: 2017-09-28 13:00:59.567 14552 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:00:59 ctl02 nova-api[14552]: 2017-09-28 13:00:59.567 14552 ERROR nova
Sep 28 13:00:59 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:00:59 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:00:59 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:00:59 ctl02 neutron-server[30536]: 2017-09-28 13:00:59.787 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:00:59 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:00:59 ctl02 neutron-server[30536]: 2017-09-28 13:00:59.787 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:00:59 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:00:59 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:00:59 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:00:59 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:00:59 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:00:59 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:00:59 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:00:59 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:01:00 ctl02 neutron-server[30536]: 2017-09-28 13:01:00.041 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:00 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:00 ctl02 neutron-server[30536]: 2017-09-28 13:01:00.041 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:00 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:00 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:00 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:00 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:00 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xeb25325)
Sep 28 13:01:00 ctl02 neutron-server[30536]: 2017-09-28 13:01:00.295 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:00 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:00 ctl02 neutron-server[30536]: 2017-09-28 13:01:00.296 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:00 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:00 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:00 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:00 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:00 ctl02 heat-api[13008]: 2017-09-28 13:01:00.389 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:01:00] "OPTIONS / HTTP/1.0" 200 134 0.000611
Sep 28 13:01:00 ctl02 neutron-server[30536]: 2017-09-28 13:01:00.550 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:00 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:00 ctl02 neutron-server[30536]: 2017-09-28 13:01:00.551 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:00 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:00 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:00 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:00 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:00 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:01:00.556 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:01:00] "OPTIONS / HTTP/1.0" 200 134 0.000407
Sep 28 13:01:00 ctl02 neutron-server[30536]: 2017-09-28 13:01:00.804 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:00 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:00 ctl02 neutron-server[30536]: 2017-09-28 13:01:00.804 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:00 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:00 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:00 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:00 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:01 ctl02 neutron-server[30536]: 2017-09-28 13:01:01.057 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:01 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:01 ctl02 neutron-server[30536]: 2017-09-28 13:01:01.058 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:01 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:01 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:01 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:01 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:01 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xeb25325)
Sep 28 13:01:01 ctl02 neutron-server[30536]: 2017-09-28 13:01:01.312 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:01 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:01 ctl02 neutron-server[30536]: 2017-09-28 13:01:01.313 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:01 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:01 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:01 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:01 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:01 ctl02 neutron-server[30536]: 2017-09-28 13:01:01.567 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:01 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:01 ctl02 neutron-server[30536]: 2017-09-28 13:01:01.567 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:01 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:01 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:01 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:01 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:01 ctl02 nova-api[14571]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:01:01 ctl02 nova-api[14571]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:01:01 ctl02 neutron-server[30536]: 2017-09-28 13:01:01.700 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:01:01] "OPTIONS / HTTP/1.0" 200 262 0.000512
Sep 28 13:01:01 ctl02 nova-api[14571]: 2017-09-28 13:01:01.809 14571 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:01:01 ctl02 nova-api[14571]: 2017-09-28 13:01:01.810 14571 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:01:01 ctl02 nova-api[14571]: 2017-09-28 13:01:01.810 14571 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:01:01 ctl02 nova-api[14571]: 2017-09-28 13:01:01.810 14571 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:01:01 ctl02 nova-api[14571]: 2017-09-28 13:01:01.810 14571 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:01:01 ctl02 nova-api[14571]: 2017-09-28 13:01:01.810 14571 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:01:01 ctl02 nova-api[14571]: 2017-09-28 13:01:01.810 14571 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:01:01 ctl02 nova-api[14571]: 2017-09-28 13:01:01.810 14571 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:01:01 ctl02 nova-api[14571]: 2017-09-28 13:01:01.810 14571 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:01:01 ctl02 nova-api[14571]: 2017-09-28 13:01:01.810 14571 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:01:01 ctl02 nova-api[14571]: 2017-09-28 13:01:01.810 14571 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:01:01 ctl02 nova-api[14571]: 2017-09-28 13:01:01.810 14571 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:01:01 ctl02 nova-api[14571]: 2017-09-28 13:01:01.810 14571 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:01:01 ctl02 nova-api[14571]: 2017-09-28 13:01:01.810 14571 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:01:01 ctl02 nova-api[14571]: 2017-09-28 13:01:01.810 14571 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:01:01 ctl02 nova-api[14571]: 2017-09-28 13:01:01.810 14571 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:01:01 ctl02 nova-api[14571]: 2017-09-28 13:01:01.810 14571 ERROR nova.wsgi     self.filename))
Sep 28 13:01:01 ctl02 nova-api[14571]: 2017-09-28 13:01:01.810 14571 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:01:01 ctl02 nova-api[14571]: 2017-09-28 13:01:01.810 14571 ERROR nova.wsgi
Sep 28 13:01:01 ctl02 nova-api[14571]: 2017-09-28 13:01:01.811 14571 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:01:01 ctl02 neutron-server[30536]: 2017-09-28 13:01:01.820 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:01 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:01 ctl02 neutron-server[30536]: 2017-09-28 13:01:01.821 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:01 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:01 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:01 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:01 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:01 ctl02 nova-api[14571]: 2017-09-28 13:01:01.943 14571 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:01:02 ctl02 neutron-server[30536]: 2017-09-28 13:01:02.074 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:02 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:02 ctl02 neutron-server[30536]: 2017-09-28 13:01:02.076 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:02 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:02 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:02 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:02 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:02 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xeb25325)
Sep 28 13:01:02 ctl02 nova-api[14571]: 2017-09-28 13:01:02.189 14571 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:01:02 ctl02 nova-api[14571]: 2017-09-28 13:01:02.191 14571 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:01:02 ctl02 nova-api[14571]: 2017-09-28 13:01:02.192 14571 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:01:02 ctl02 nova-api[14571]: 2017-09-28 13:01:02.192 14571 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:01:02 ctl02 nova-api[14571]: 2017-09-28 13:01:02.324 14571 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:01:02 ctl02 nova-api[14571]: 2017-09-28 13:01:02.326 14571 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:01:02 ctl02 nova-api[14571]: 2017-09-28 13:01:02.326 14571 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:01:02 ctl02 nova-api[14571]: 2017-09-28 13:01:02.326 14571 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:01:02 ctl02 nova-api[14571]: 2017-09-28 13:01:02.330 14571 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:01:02 ctl02 neutron-server[30536]: 2017-09-28 13:01:02.330 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:02 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:02 ctl02 nova-api[14571]: 2017-09-28 13:01:02.330 14571 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:01:02 ctl02 nova-api[14571]: 2017-09-28 13:01:02.330 14571 ERROR nova Traceback (most recent call last):
Sep 28 13:01:02 ctl02 nova-api[14571]: 2017-09-28 13:01:02.330 14571 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:01:02 ctl02 nova-api[14571]: 2017-09-28 13:01:02.330 14571 ERROR nova     sys.exit(main())
Sep 28 13:01:02 ctl02 nova-api[14571]: 2017-09-28 13:01:02.330 14571 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:01:02 ctl02 nova-api[14571]: 2017-09-28 13:01:02.330 14571 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:01:02 ctl02 nova-api[14571]: 2017-09-28 13:01:02.330 14571 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:01:02 ctl02 nova-api[14571]: 2017-09-28 13:01:02.330 14571 ERROR nova     max_url_len=max_url_len)
Sep 28 13:01:02 ctl02 nova-api[14571]: 2017-09-28 13:01:02.330 14571 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:01:02 ctl02 nova-api[14571]: 2017-09-28 13:01:02.330 14571 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:01:02 ctl02 nova-api[14571]: 2017-09-28 13:01:02.330 14571 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:01:02 ctl02 nova-api[14571]: 2017-09-28 13:01:02.330 14571 ERROR nova     sock.listen(backlog)
Sep 28 13:01:02 ctl02 nova-api[14571]: 2017-09-28 13:01:02.330 14571 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:01:02 ctl02 nova-api[14571]: 2017-09-28 13:01:02.330 14571 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:01:02 ctl02 nova-api[14571]: 2017-09-28 13:01:02.330 14571 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:01:02 ctl02 nova-api[14571]: 2017-09-28 13:01:02.330 14571 ERROR nova
Sep 28 13:01:02 ctl02 neutron-server[30536]: 2017-09-28 13:01:02.333 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:02 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:02 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:02 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:02 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:02 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:01:02 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:01:02 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:01:02 ctl02 neutron-server[30536]: 2017-09-28 13:01:02.587 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:02 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:02 ctl02 neutron-server[30536]: 2017-09-28 13:01:02.588 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:02 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:02 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:02 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:02 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:02 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:01:02 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:01:02 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:01:02 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:01:02 ctl02 glance-api[29183]: 2017-09-28 13:01:02.657 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:01:02] "OPTIONS / HTTP/1.0" 200 134 0.000725
Sep 28 13:01:02 ctl02 neutron-server[30536]: 2017-09-28 13:01:02.843 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:02 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:02 ctl02 neutron-server[30536]: 2017-09-28 13:01:02.843 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:02 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:02 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:02 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:02 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:03 ctl02 glance-api[29183]: 2017-09-28 13:01:03.007 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:01:03] "OPTIONS / HTTP/1.0" 200 134 0.000663
Sep 28 13:01:03 ctl02 neutron-server[30536]: 2017-09-28 13:01:03.097 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:03 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:03 ctl02 neutron-server[30536]: 2017-09-28 13:01:03.097 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:03 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:03 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:03 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:03 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:03 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xeb25325)
Sep 28 13:01:03 ctl02 neutron-server[30536]: 2017-09-28 13:01:03.351 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:03 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:03 ctl02 neutron-server[30536]: 2017-09-28 13:01:03.353 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:03 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:03 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:03 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:03 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:03 ctl02 neutron-server[30536]: 2017-09-28 13:01:03.607 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:03 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:03 ctl02 neutron-server[30536]: 2017-09-28 13:01:03.608 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:03 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:03 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:03 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:03 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:03 ctl02 neutron-server[30536]: 2017-09-28 13:01:03.863 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:03 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:03 ctl02 neutron-server[30536]: 2017-09-28 13:01:03.865 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:03 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:03 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:03 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:03 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:04 ctl02 heat-api[13008]: 2017-09-28 13:01:04.076 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:01:04] "OPTIONS / HTTP/1.0" 200 134 0.000623
Sep 28 13:01:04 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xeb25325)
Sep 28 13:01:04 ctl02 neutron-server[30536]: 2017-09-28 13:01:04.120 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:04 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:04 ctl02 neutron-server[30536]: 2017-09-28 13:01:04.120 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:04 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:04 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:04 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:04 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:04 ctl02 nova-api[14589]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:01:04 ctl02 nova-api[14589]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:01:04 ctl02 neutron-server[30536]: 2017-09-28 13:01:04.375 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:04 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:04 ctl02 neutron-server[30536]: 2017-09-28 13:01:04.376 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:04 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:04 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:04 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:04 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:04 ctl02 nova-api[14589]: 2017-09-28 13:01:04.513 14589 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:01:04 ctl02 nova-api[14589]: 2017-09-28 13:01:04.515 14589 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:01:04 ctl02 nova-api[14589]: 2017-09-28 13:01:04.515 14589 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:01:04 ctl02 nova-api[14589]: 2017-09-28 13:01:04.515 14589 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:01:04 ctl02 nova-api[14589]: 2017-09-28 13:01:04.515 14589 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:01:04 ctl02 nova-api[14589]: 2017-09-28 13:01:04.515 14589 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:01:04 ctl02 nova-api[14589]: 2017-09-28 13:01:04.515 14589 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:01:04 ctl02 nova-api[14589]: 2017-09-28 13:01:04.515 14589 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:01:04 ctl02 nova-api[14589]: 2017-09-28 13:01:04.515 14589 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:01:04 ctl02 nova-api[14589]: 2017-09-28 13:01:04.515 14589 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:01:04 ctl02 nova-api[14589]: 2017-09-28 13:01:04.515 14589 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:01:04 ctl02 nova-api[14589]: 2017-09-28 13:01:04.515 14589 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:01:04 ctl02 nova-api[14589]: 2017-09-28 13:01:04.515 14589 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:01:04 ctl02 nova-api[14589]: 2017-09-28 13:01:04.515 14589 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:01:04 ctl02 nova-api[14589]: 2017-09-28 13:01:04.515 14589 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:01:04 ctl02 nova-api[14589]: 2017-09-28 13:01:04.515 14589 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:01:04 ctl02 nova-api[14589]: 2017-09-28 13:01:04.515 14589 ERROR nova.wsgi     self.filename))
Sep 28 13:01:04 ctl02 nova-api[14589]: 2017-09-28 13:01:04.515 14589 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:01:04 ctl02 nova-api[14589]: 2017-09-28 13:01:04.515 14589 ERROR nova.wsgi
Sep 28 13:01:04 ctl02 nova-api[14589]: 2017-09-28 13:01:04.516 14589 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:01:04 ctl02 neutron-server[30536]: 2017-09-28 13:01:04.629 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:04 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:04 ctl02 neutron-server[30536]: 2017-09-28 13:01:04.629 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:04 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:04 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:04 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:04 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:04 ctl02 nova-api[14589]: 2017-09-28 13:01:04.641 14589 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:01:04 ctl02 nova-api[14589]: 2017-09-28 13:01:04.862 14589 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:01:04 ctl02 nova-api[14589]: 2017-09-28 13:01:04.864 14589 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:01:04 ctl02 nova-api[14589]: 2017-09-28 13:01:04.864 14589 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:01:04 ctl02 nova-api[14589]: 2017-09-28 13:01:04.865 14589 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:01:04 ctl02 neutron-server[30536]: 2017-09-28 13:01:04.882 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:04 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:04 ctl02 neutron-server[30536]: 2017-09-28 13:01:04.882 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:04 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:04 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:04 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:04 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:04 ctl02 nova-api[14589]: 2017-09-28 13:01:04.999 14589 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:01:05 ctl02 nova-api[14589]: 2017-09-28 13:01:05.001 14589 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:01:05 ctl02 nova-api[14589]: 2017-09-28 13:01:05.001 14589 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:01:05 ctl02 nova-api[14589]: 2017-09-28 13:01:05.001 14589 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:01:05 ctl02 nova-api[14589]: 2017-09-28 13:01:05.004 14589 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:01:05 ctl02 nova-api[14589]: 2017-09-28 13:01:05.005 14589 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:01:05 ctl02 nova-api[14589]: 2017-09-28 13:01:05.005 14589 ERROR nova Traceback (most recent call last):
Sep 28 13:01:05 ctl02 nova-api[14589]: 2017-09-28 13:01:05.005 14589 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:01:05 ctl02 nova-api[14589]: 2017-09-28 13:01:05.005 14589 ERROR nova     sys.exit(main())
Sep 28 13:01:05 ctl02 nova-api[14589]: 2017-09-28 13:01:05.005 14589 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:01:05 ctl02 nova-api[14589]: 2017-09-28 13:01:05.005 14589 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:01:05 ctl02 nova-api[14589]: 2017-09-28 13:01:05.005 14589 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:01:05 ctl02 nova-api[14589]: 2017-09-28 13:01:05.005 14589 ERROR nova     max_url_len=max_url_len)
Sep 28 13:01:05 ctl02 nova-api[14589]: 2017-09-28 13:01:05.005 14589 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:01:05 ctl02 nova-api[14589]: 2017-09-28 13:01:05.005 14589 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:01:05 ctl02 nova-api[14589]: 2017-09-28 13:01:05.005 14589 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:01:05 ctl02 nova-api[14589]: 2017-09-28 13:01:05.005 14589 ERROR nova     sock.listen(backlog)
Sep 28 13:01:05 ctl02 nova-api[14589]: 2017-09-28 13:01:05.005 14589 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:01:05 ctl02 nova-api[14589]: 2017-09-28 13:01:05.005 14589 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:01:05 ctl02 nova-api[14589]: 2017-09-28 13:01:05.005 14589 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:01:05 ctl02 nova-api[14589]: 2017-09-28 13:01:05.005 14589 ERROR nova
Sep 28 13:01:05 ctl02 heat-api-cfn[13300]: 2017-09-28 13:01:05.082 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:01:05] "OPTIONS / HTTP/1.0" 200 134 0.000505
Sep 28 13:01:05 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xeb25325)
Sep 28 13:01:05 ctl02 neutron-server[30536]: 2017-09-28 13:01:05.136 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:05 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:05 ctl02 neutron-server[30536]: 2017-09-28 13:01:05.136 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:05 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:05 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:05 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:05 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:05 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:01:05 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:01:05 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:01:05 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:01:05 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:01:05 ctl02 neutron-server[30536]: 2017-09-28 13:01:05.390 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:05 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:05 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:01:05 ctl02 neutron-server[30536]: 2017-09-28 13:01:05.390 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:05 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:05 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:05 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:05 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:05 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:01:05 ctl02 neutron-server[30536]: 2017-09-28 13:01:05.570 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:01:05] "OPTIONS / HTTP/1.0" 200 262 0.000548
Sep 28 13:01:05 ctl02 neutron-server[30536]: 2017-09-28 13:01:05.644 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:05 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:05 ctl02 neutron-server[30536]: 2017-09-28 13:01:05.644 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:05 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:05 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:05 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:05 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:05 ctl02 nova-consoleauth[5433]: 2017-09-28 13:01:05.731 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:01:05 ctl02 neutron-server[30536]: 2017-09-28 13:01:05.898 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:05 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:05 ctl02 neutron-server[30536]: 2017-09-28 13:01:05.898 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:05 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:05 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:05 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:05 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:06 ctl02 neutron-server[30536]: 2017-09-28 13:01:06.043 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 2 dead agents out of 6:
Sep 28 13:01:06 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 13:01:06 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 12:59:06 cmp002
Sep 28 13:01:06 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 13:00:10 cmp002
Sep 28 13:01:06 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xeb25325)
Sep 28 13:01:06 ctl02 neutron-server[30536]: 2017-09-28 13:01:06.151 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:06 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:06 ctl02 neutron-server[30536]: 2017-09-28 13:01:06.152 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:06 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:06 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:06 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:06 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:06 ctl02 heat-api-cfn[13300]: 2017-09-28 13:01:06.223 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:01:06] "OPTIONS / HTTP/1.0" 200 134 0.000530
Sep 28 13:01:06 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:01:06.331 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:01:06] "OPTIONS / HTTP/1.0" 200 134 0.000423
Sep 28 13:01:06 ctl02 heat-engine[12803]: 2017-09-28 13:01:06.395 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:01:06 ctl02 neutron-server[30536]: 2017-09-28 13:01:06.405 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:06 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:06 ctl02 neutron-server[30536]: 2017-09-28 13:01:06.405 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:06 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:06 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:06 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:06 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:06 ctl02 heat-engine[12803]: 2017-09-28 13:01:06.415 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:01:06 ctl02 heat-engine[12803]: 2017-09-28 13:01:06.422 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:01:06 ctl02 heat-engine[12803]: 2017-09-28 13:01:06.425 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:01:06 ctl02 neutron-server[30536]: 2017-09-28 13:01:06.657 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:06 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:06 ctl02 neutron-server[30536]: 2017-09-28 13:01:06.658 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:06 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:06 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:06 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:06 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:06 ctl02 neutron-server[30536]: 2017-09-28 13:01:06.910 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:06 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:06 ctl02 neutron-server[30536]: 2017-09-28 13:01:06.910 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:06 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:06 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:06 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:06 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:07 ctl02 nova-api[14607]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:01:07 ctl02 nova-api[14607]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:01:07 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xeb25325)
Sep 28 13:01:07 ctl02 neutron-server[30536]: 2017-09-28 13:01:07.164 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:07 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:07 ctl02 neutron-server[30536]: 2017-09-28 13:01:07.164 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:07 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:07 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:07 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:07 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:07 ctl02 nova-api[14607]: 2017-09-28 13:01:07.272 14607 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:01:07 ctl02 nova-api[14607]: 2017-09-28 13:01:07.273 14607 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:01:07 ctl02 nova-api[14607]: 2017-09-28 13:01:07.273 14607 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:01:07 ctl02 nova-api[14607]: 2017-09-28 13:01:07.273 14607 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:01:07 ctl02 nova-api[14607]: 2017-09-28 13:01:07.273 14607 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:01:07 ctl02 nova-api[14607]: 2017-09-28 13:01:07.273 14607 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:01:07 ctl02 nova-api[14607]: 2017-09-28 13:01:07.273 14607 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:01:07 ctl02 nova-api[14607]: 2017-09-28 13:01:07.273 14607 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:01:07 ctl02 nova-api[14607]: 2017-09-28 13:01:07.273 14607 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:01:07 ctl02 nova-api[14607]: 2017-09-28 13:01:07.273 14607 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:01:07 ctl02 nova-api[14607]: 2017-09-28 13:01:07.273 14607 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:01:07 ctl02 nova-api[14607]: 2017-09-28 13:01:07.273 14607 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:01:07 ctl02 nova-api[14607]: 2017-09-28 13:01:07.273 14607 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:01:07 ctl02 nova-api[14607]: 2017-09-28 13:01:07.273 14607 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:01:07 ctl02 nova-api[14607]: 2017-09-28 13:01:07.273 14607 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:01:07 ctl02 nova-api[14607]: 2017-09-28 13:01:07.273 14607 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:01:07 ctl02 nova-api[14607]: 2017-09-28 13:01:07.273 14607 ERROR nova.wsgi     self.filename))
Sep 28 13:01:07 ctl02 nova-api[14607]: 2017-09-28 13:01:07.273 14607 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:01:07 ctl02 nova-api[14607]: 2017-09-28 13:01:07.273 14607 ERROR nova.wsgi
Sep 28 13:01:07 ctl02 nova-api[14607]: 2017-09-28 13:01:07.274 14607 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:01:07 ctl02 heat-api[13008]: 2017-09-28 13:01:07.397 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:01:07] "OPTIONS / HTTP/1.0" 200 134 0.000548
Sep 28 13:01:07 ctl02 nova-api[14607]: 2017-09-28 13:01:07.403 14607 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:01:07 ctl02 neutron-server[30536]: 2017-09-28 13:01:07.418 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:07 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:07 ctl02 neutron-server[30536]: 2017-09-28 13:01:07.418 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:07 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:07 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:07 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:07 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:07 ctl02 nova-api[14607]: 2017-09-28 13:01:07.624 14607 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:01:07 ctl02 nova-api[14607]: 2017-09-28 13:01:07.627 14607 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:01:07 ctl02 nova-api[14607]: 2017-09-28 13:01:07.627 14607 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:01:07 ctl02 nova-api[14607]: 2017-09-28 13:01:07.627 14607 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:01:07 ctl02 neutron-server[30536]: 2017-09-28 13:01:07.671 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:07 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:07 ctl02 neutron-server[30536]: 2017-09-28 13:01:07.672 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:07 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:07 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:07 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:07 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:07 ctl02 neutron-server[30536]: 2017-09-28 13:01:07.698 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:01:07] "OPTIONS / HTTP/1.0" 200 262 0.000465
Sep 28 13:01:07 ctl02 nova-api[14607]: 2017-09-28 13:01:07.757 14607 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:01:07 ctl02 nova-api[14607]: 2017-09-28 13:01:07.759 14607 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:01:07 ctl02 nova-api[14607]: 2017-09-28 13:01:07.759 14607 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:01:07 ctl02 nova-api[14607]: 2017-09-28 13:01:07.759 14607 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:01:07 ctl02 nova-api[14607]: 2017-09-28 13:01:07.763 14607 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:01:07 ctl02 nova-api[14607]: 2017-09-28 13:01:07.763 14607 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:01:07 ctl02 nova-api[14607]: 2017-09-28 13:01:07.763 14607 ERROR nova Traceback (most recent call last):
Sep 28 13:01:07 ctl02 nova-api[14607]: 2017-09-28 13:01:07.763 14607 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:01:07 ctl02 nova-api[14607]: 2017-09-28 13:01:07.763 14607 ERROR nova     sys.exit(main())
Sep 28 13:01:07 ctl02 nova-api[14607]: 2017-09-28 13:01:07.763 14607 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:01:07 ctl02 nova-api[14607]: 2017-09-28 13:01:07.763 14607 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:01:07 ctl02 nova-api[14607]: 2017-09-28 13:01:07.763 14607 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:01:07 ctl02 nova-api[14607]: 2017-09-28 13:01:07.763 14607 ERROR nova     max_url_len=max_url_len)
Sep 28 13:01:07 ctl02 nova-api[14607]: 2017-09-28 13:01:07.763 14607 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:01:07 ctl02 nova-api[14607]: 2017-09-28 13:01:07.763 14607 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:01:07 ctl02 nova-api[14607]: 2017-09-28 13:01:07.763 14607 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:01:07 ctl02 nova-api[14607]: 2017-09-28 13:01:07.763 14607 ERROR nova     sock.listen(backlog)
Sep 28 13:01:07 ctl02 nova-api[14607]: 2017-09-28 13:01:07.763 14607 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:01:07 ctl02 nova-api[14607]: 2017-09-28 13:01:07.763 14607 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:01:07 ctl02 nova-api[14607]: 2017-09-28 13:01:07.763 14607 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:01:07 ctl02 nova-api[14607]: 2017-09-28 13:01:07.763 14607 ERROR nova
Sep 28 13:01:07 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:01:07 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:01:07 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:01:07 ctl02 neutron-server[30536]: 2017-09-28 13:01:07.925 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:07 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:07 ctl02 neutron-server[30536]: 2017-09-28 13:01:07.925 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:07 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:07 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:07 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:07 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:08 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xeb25325)
Sep 28 13:01:08 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:01:08 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:01:08 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:01:08 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:01:08 ctl02 neutron-server[30536]: 2017-09-28 13:01:08.178 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:08 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:08 ctl02 neutron-server[30536]: 2017-09-28 13:01:08.179 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:08 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:08 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:08 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:08 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:08 ctl02 neutron-server[30536]: 2017-09-28 13:01:08.432 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:08 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:08 ctl02 neutron-server[30536]: 2017-09-28 13:01:08.433 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:08 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:08 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:08 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:08 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:08 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:01:08.565 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:01:08] "OPTIONS / HTTP/1.0" 200 134 0.000369
Sep 28 13:01:08 ctl02 neutron-server[30536]: 2017-09-28 13:01:08.686 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:08 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:08 ctl02 neutron-server[30536]: 2017-09-28 13:01:08.686 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:08 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:08 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:08 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:08 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:08 ctl02 glance-api[29183]: 2017-09-28 13:01:08.728 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:01:08] "OPTIONS / HTTP/1.0" 200 134 0.000567
Sep 28 13:01:08 ctl02 nova-scheduler[5620]: 2017-09-28 13:01:08.836 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:01:08 ctl02 neutron-server[30536]: 2017-09-28 13:01:08.940 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:08 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:08 ctl02 neutron-server[30536]: 2017-09-28 13:01:08.940 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:08 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:08 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:08 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:08 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:09 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 13:01:09 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 13:01:09 ctl02 neutron-server[30536]: 2017-09-28 13:01:09.193 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:09 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:09 ctl02 neutron-server[30536]: 2017-09-28 13:01:09.194 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:09 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:09 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:09 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:09 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:09 ctl02 heat-api-cfn[13300]: 2017-09-28 13:01:09.407 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:01:09] "OPTIONS / HTTP/1.0" 200 134 0.000450
Sep 28 13:01:09 ctl02 neutron-server[30536]: 2017-09-28 13:01:09.447 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:09 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:09 ctl02 neutron-server[30536]: 2017-09-28 13:01:09.447 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:09 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:09 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:09 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:09 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:09 ctl02 neutron-server[30536]: 2017-09-28 13:01:09.700 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:09 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:09 ctl02 neutron-server[30536]: 2017-09-28 13:01:09.701 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:09 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:09 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:09 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:09 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:09 ctl02 nova-api[14625]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:01:09 ctl02 nova-api[14625]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:01:09 ctl02 neutron-server[30536]: 2017-09-28 13:01:09.954 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:09 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:09 ctl02 neutron-server[30536]: 2017-09-28 13:01:09.954 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:09 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:09 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:09 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:09 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:10 ctl02 nova-api[14625]: 2017-09-28 13:01:10.001 14625 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:01:10 ctl02 nova-api[14625]: 2017-09-28 13:01:10.003 14625 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:01:10 ctl02 nova-api[14625]: 2017-09-28 13:01:10.003 14625 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:01:10 ctl02 nova-api[14625]: 2017-09-28 13:01:10.003 14625 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:01:10 ctl02 nova-api[14625]: 2017-09-28 13:01:10.003 14625 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:01:10 ctl02 nova-api[14625]: 2017-09-28 13:01:10.003 14625 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:01:10 ctl02 nova-api[14625]: 2017-09-28 13:01:10.003 14625 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:01:10 ctl02 nova-api[14625]: 2017-09-28 13:01:10.003 14625 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:01:10 ctl02 nova-api[14625]: 2017-09-28 13:01:10.003 14625 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:01:10 ctl02 nova-api[14625]: 2017-09-28 13:01:10.003 14625 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:01:10 ctl02 nova-api[14625]: 2017-09-28 13:01:10.003 14625 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:01:10 ctl02 nova-api[14625]: 2017-09-28 13:01:10.003 14625 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:01:10 ctl02 nova-api[14625]: 2017-09-28 13:01:10.003 14625 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:01:10 ctl02 nova-api[14625]: 2017-09-28 13:01:10.003 14625 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:01:10 ctl02 nova-api[14625]: 2017-09-28 13:01:10.003 14625 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:01:10 ctl02 nova-api[14625]: 2017-09-28 13:01:10.003 14625 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:01:10 ctl02 nova-api[14625]: 2017-09-28 13:01:10.003 14625 ERROR nova.wsgi     self.filename))
Sep 28 13:01:10 ctl02 nova-api[14625]: 2017-09-28 13:01:10.003 14625 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:01:10 ctl02 nova-api[14625]: 2017-09-28 13:01:10.003 14625 ERROR nova.wsgi
Sep 28 13:01:10 ctl02 nova-api[14625]: 2017-09-28 13:01:10.004 14625 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:01:10 ctl02 nova-api[14625]: 2017-09-28 13:01:10.135 14625 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:01:10 ctl02 heat-api[13008]: 2017-09-28 13:01:10.199 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:01:10] "OPTIONS / HTTP/1.0" 200 134 0.000558
Sep 28 13:01:10 ctl02 neutron-server[30536]: 2017-09-28 13:01:10.207 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:10 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:10 ctl02 neutron-server[30536]: 2017-09-28 13:01:10.208 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:10 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:10 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:10 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:10 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:10 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:01:10.350 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:01:10] "OPTIONS / HTTP/1.0" 200 134 0.000402
Sep 28 13:01:10 ctl02 nova-api[14625]: 2017-09-28 13:01:10.360 14625 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:01:10 ctl02 nova-api[14625]: 2017-09-28 13:01:10.362 14625 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:01:10 ctl02 nova-api[14625]: 2017-09-28 13:01:10.363 14625 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:01:10 ctl02 nova-api[14625]: 2017-09-28 13:01:10.363 14625 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:01:10 ctl02 neutron-server[30536]: 2017-09-28 13:01:10.461 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:10 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:10 ctl02 neutron-server[30536]: 2017-09-28 13:01:10.461 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:10 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:10 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:10 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:10 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:10 ctl02 nova-api[14625]: 2017-09-28 13:01:10.495 14625 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:01:10 ctl02 nova-api[14625]: 2017-09-28 13:01:10.496 14625 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:01:10 ctl02 nova-api[14625]: 2017-09-28 13:01:10.497 14625 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:01:10 ctl02 nova-api[14625]: 2017-09-28 13:01:10.497 14625 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:01:10 ctl02 nova-api[14625]: 2017-09-28 13:01:10.500 14625 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:01:10 ctl02 nova-api[14625]: 2017-09-28 13:01:10.500 14625 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:01:10 ctl02 nova-api[14625]: 2017-09-28 13:01:10.500 14625 ERROR nova Traceback (most recent call last):
Sep 28 13:01:10 ctl02 nova-api[14625]: 2017-09-28 13:01:10.500 14625 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:01:10 ctl02 nova-api[14625]: 2017-09-28 13:01:10.500 14625 ERROR nova     sys.exit(main())
Sep 28 13:01:10 ctl02 nova-api[14625]: 2017-09-28 13:01:10.500 14625 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:01:10 ctl02 nova-api[14625]: 2017-09-28 13:01:10.500 14625 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:01:10 ctl02 nova-api[14625]: 2017-09-28 13:01:10.500 14625 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:01:10 ctl02 nova-api[14625]: 2017-09-28 13:01:10.500 14625 ERROR nova     max_url_len=max_url_len)
Sep 28 13:01:10 ctl02 nova-api[14625]: 2017-09-28 13:01:10.500 14625 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:01:10 ctl02 nova-api[14625]: 2017-09-28 13:01:10.500 14625 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:01:10 ctl02 nova-api[14625]: 2017-09-28 13:01:10.500 14625 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:01:10 ctl02 nova-api[14625]: 2017-09-28 13:01:10.500 14625 ERROR nova     sock.listen(backlog)
Sep 28 13:01:10 ctl02 nova-api[14625]: 2017-09-28 13:01:10.500 14625 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:01:10 ctl02 nova-api[14625]: 2017-09-28 13:01:10.500 14625 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:01:10 ctl02 nova-api[14625]: 2017-09-28 13:01:10.500 14625 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:01:10 ctl02 nova-api[14625]: 2017-09-28 13:01:10.500 14625 ERROR nova
Sep 28 13:01:10 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:01:10 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:01:10 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:01:10 ctl02 neutron-server[30536]: 2017-09-28 13:01:10.714 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:10 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:10 ctl02 neutron-server[30536]: 2017-09-28 13:01:10.715 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:10 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:10 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:10 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:10 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:10 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:01:10 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:01:10 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:01:10 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:01:10 ctl02 neutron-server[30536]: 2017-09-28 13:01:10.968 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:10 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:10 ctl02 neutron-server[30536]: 2017-09-28 13:01:10.970 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:10 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:10 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:10 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:10 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:11 ctl02 neutron-server[30536]: 2017-09-28 13:01:11.224 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:11 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:11 ctl02 neutron-server[30536]: 2017-09-28 13:01:11.225 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:11 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:11 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:11 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:11 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:11 ctl02 neutron-server[30536]: 2017-09-28 13:01:11.480 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:11 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:11 ctl02 neutron-server[30536]: 2017-09-28 13:01:11.481 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:11 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:11 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:11 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:11 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:11 ctl02 neutron-server[30536]: 2017-09-28 13:01:11.671 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:01:11] "OPTIONS / HTTP/1.0" 200 262 0.000500
Sep 28 13:01:11 ctl02 neutron-server[30536]: 2017-09-28 13:01:11.735 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:11 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:11 ctl02 neutron-server[30536]: 2017-09-28 13:01:11.737 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:11 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:11 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:11 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:11 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:11 ctl02 neutron-server[30536]: 2017-09-28 13:01:11.990 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:11 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:11 ctl02 neutron-server[30536]: 2017-09-28 13:01:11.992 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:11 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:11 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:11 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:11 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:12 ctl02 neutron-server[30536]: 2017-09-28 13:01:12.245 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:12 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:12 ctl02 neutron-server[30536]: 2017-09-28 13:01:12.246 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:12 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:12 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:12 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:12 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:12 ctl02 glance-api[29183]: 2017-09-28 13:01:12.344 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:01:12] "OPTIONS / HTTP/1.0" 200 134 0.000538
Sep 28 13:01:12 ctl02 neutron-server[30536]: 2017-09-28 13:01:12.500 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:12 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:12 ctl02 neutron-server[30536]: 2017-09-28 13:01:12.500 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:12 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:12 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:12 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:12 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:12 ctl02 nova-api[14646]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:01:12 ctl02 nova-api[14646]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:01:12 ctl02 neutron-server[30536]: 2017-09-28 13:01:12.754 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:12 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:12 ctl02 neutron-server[30536]: 2017-09-28 13:01:12.756 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:12 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:12 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:12 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:12 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:12 ctl02 nova-api[14646]: 2017-09-28 13:01:12.772 14646 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:01:12 ctl02 nova-api[14646]: 2017-09-28 13:01:12.773 14646 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:01:12 ctl02 nova-api[14646]: 2017-09-28 13:01:12.773 14646 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:01:12 ctl02 nova-api[14646]: 2017-09-28 13:01:12.773 14646 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:01:12 ctl02 nova-api[14646]: 2017-09-28 13:01:12.773 14646 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:01:12 ctl02 nova-api[14646]: 2017-09-28 13:01:12.773 14646 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:01:12 ctl02 nova-api[14646]: 2017-09-28 13:01:12.773 14646 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:01:12 ctl02 nova-api[14646]: 2017-09-28 13:01:12.773 14646 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:01:12 ctl02 nova-api[14646]: 2017-09-28 13:01:12.773 14646 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:01:12 ctl02 nova-api[14646]: 2017-09-28 13:01:12.773 14646 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:01:12 ctl02 nova-api[14646]: 2017-09-28 13:01:12.773 14646 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:01:12 ctl02 nova-api[14646]: 2017-09-28 13:01:12.773 14646 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:01:12 ctl02 nova-api[14646]: 2017-09-28 13:01:12.773 14646 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:01:12 ctl02 nova-api[14646]: 2017-09-28 13:01:12.773 14646 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:01:12 ctl02 nova-api[14646]: 2017-09-28 13:01:12.773 14646 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:01:12 ctl02 nova-api[14646]: 2017-09-28 13:01:12.773 14646 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:01:12 ctl02 nova-api[14646]: 2017-09-28 13:01:12.773 14646 ERROR nova.wsgi     self.filename))
Sep 28 13:01:12 ctl02 nova-api[14646]: 2017-09-28 13:01:12.773 14646 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:01:12 ctl02 nova-api[14646]: 2017-09-28 13:01:12.773 14646 ERROR nova.wsgi
Sep 28 13:01:12 ctl02 nova-api[14646]: 2017-09-28 13:01:12.774 14646 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:01:12 ctl02 nova-api[14646]: 2017-09-28 13:01:12.907 14646 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:01:13 ctl02 neutron-server[30536]: 2017-09-28 13:01:13.010 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:13 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:13 ctl02 neutron-server[30536]: 2017-09-28 13:01:13.010 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:13 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:13 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:13 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:13 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:13 ctl02 glance-api[29183]: 2017-09-28 13:01:13.103 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:01:13] "OPTIONS / HTTP/1.0" 200 134 0.000673
Sep 28 13:01:13 ctl02 nova-api[14646]: 2017-09-28 13:01:13.156 14646 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:01:13 ctl02 nova-api[14646]: 2017-09-28 13:01:13.159 14646 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:01:13 ctl02 nova-api[14646]: 2017-09-28 13:01:13.159 14646 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:01:13 ctl02 nova-api[14646]: 2017-09-28 13:01:13.159 14646 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:01:13 ctl02 neutron-server[30536]: 2017-09-28 13:01:13.265 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:13 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:13 ctl02 neutron-server[30536]: 2017-09-28 13:01:13.266 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:13 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:13 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:13 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:13 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:13 ctl02 nova-api[14646]: 2017-09-28 13:01:13.295 14646 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:01:13 ctl02 nova-api[14646]: 2017-09-28 13:01:13.297 14646 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:01:13 ctl02 nova-api[14646]: 2017-09-28 13:01:13.297 14646 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:01:13 ctl02 nova-api[14646]: 2017-09-28 13:01:13.297 14646 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:01:13 ctl02 nova-api[14646]: 2017-09-28 13:01:13.301 14646 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:01:13 ctl02 nova-api[14646]: 2017-09-28 13:01:13.301 14646 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:01:13 ctl02 nova-api[14646]: 2017-09-28 13:01:13.301 14646 ERROR nova Traceback (most recent call last):
Sep 28 13:01:13 ctl02 nova-api[14646]: 2017-09-28 13:01:13.301 14646 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:01:13 ctl02 nova-api[14646]: 2017-09-28 13:01:13.301 14646 ERROR nova     sys.exit(main())
Sep 28 13:01:13 ctl02 nova-api[14646]: 2017-09-28 13:01:13.301 14646 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:01:13 ctl02 nova-api[14646]: 2017-09-28 13:01:13.301 14646 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:01:13 ctl02 nova-api[14646]: 2017-09-28 13:01:13.301 14646 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:01:13 ctl02 nova-api[14646]: 2017-09-28 13:01:13.301 14646 ERROR nova     max_url_len=max_url_len)
Sep 28 13:01:13 ctl02 nova-api[14646]: 2017-09-28 13:01:13.301 14646 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:01:13 ctl02 nova-api[14646]: 2017-09-28 13:01:13.301 14646 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:01:13 ctl02 nova-api[14646]: 2017-09-28 13:01:13.301 14646 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:01:13 ctl02 nova-api[14646]: 2017-09-28 13:01:13.301 14646 ERROR nova     sock.listen(backlog)
Sep 28 13:01:13 ctl02 nova-api[14646]: 2017-09-28 13:01:13.301 14646 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:01:13 ctl02 nova-api[14646]: 2017-09-28 13:01:13.301 14646 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:01:13 ctl02 nova-api[14646]: 2017-09-28 13:01:13.301 14646 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:01:13 ctl02 nova-api[14646]: 2017-09-28 13:01:13.301 14646 ERROR nova
Sep 28 13:01:13 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:01:13 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:01:13 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:01:13 ctl02 neutron-server[30536]: 2017-09-28 13:01:13.522 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:13 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:13 ctl02 neutron-server[30536]: 2017-09-28 13:01:13.522 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:13 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:13 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:13 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:13 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:13 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:01:13 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:01:13 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:01:13 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:01:13 ctl02 neutron-server[30536]: 2017-09-28 13:01:13.777 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:13 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:13 ctl02 neutron-server[30536]: 2017-09-28 13:01:13.778 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:13 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:13 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:13 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:13 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:13 ctl02 heat-api[13008]: 2017-09-28 13:01:13.952 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:01:13] "OPTIONS / HTTP/1.0" 200 134 0.000559
Sep 28 13:01:14 ctl02 neutron-server[30536]: 2017-09-28 13:01:14.031 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:14 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:14 ctl02 neutron-server[30536]: 2017-09-28 13:01:14.032 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:14 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:14 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:14 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:14 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:14 ctl02 neutron-server[30536]: 2017-09-28 13:01:14.284 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:14 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:14 ctl02 neutron-server[30536]: 2017-09-28 13:01:14.285 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:14 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:14 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:14 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:14 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:14 ctl02 neutron-server[30536]: 2017-09-28 13:01:14.538 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:14 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:14 ctl02 neutron-server[30536]: 2017-09-28 13:01:14.539 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:14 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:14 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:14 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:14 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:14 ctl02 neutron-server[30536]: 2017-09-28 13:01:14.801 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:14 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:14 ctl02 neutron-server[30536]: 2017-09-28 13:01:14.801 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:14 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:14 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:14 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:14 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:14 ctl02 heat-api-cfn[13300]: 2017-09-28 13:01:14.902 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:01:14] "OPTIONS / HTTP/1.0" 200 134 0.000427
Sep 28 13:01:15 ctl02 neutron-server[30536]: 2017-09-28 13:01:15.054 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:15 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:15 ctl02 neutron-server[30536]: 2017-09-28 13:01:15.055 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:15 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:15 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:15 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:15 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:15 ctl02 nova-api[14667]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:01:15 ctl02 nova-api[14667]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:01:15 ctl02 neutron-server[30536]: 2017-09-28 13:01:15.307 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:15 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:15 ctl02 neutron-server[30536]: 2017-09-28 13:01:15.309 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:15 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:15 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:15 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:15 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:15 ctl02 nova-api[14667]: 2017-09-28 13:01:15.470 14667 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:01:15 ctl02 nova-api[14667]: 2017-09-28 13:01:15.472 14667 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:01:15 ctl02 nova-api[14667]: 2017-09-28 13:01:15.472 14667 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:01:15 ctl02 nova-api[14667]: 2017-09-28 13:01:15.472 14667 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:01:15 ctl02 nova-api[14667]: 2017-09-28 13:01:15.472 14667 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:01:15 ctl02 nova-api[14667]: 2017-09-28 13:01:15.472 14667 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:01:15 ctl02 nova-api[14667]: 2017-09-28 13:01:15.472 14667 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:01:15 ctl02 nova-api[14667]: 2017-09-28 13:01:15.472 14667 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:01:15 ctl02 nova-api[14667]: 2017-09-28 13:01:15.472 14667 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:01:15 ctl02 nova-api[14667]: 2017-09-28 13:01:15.472 14667 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:01:15 ctl02 nova-api[14667]: 2017-09-28 13:01:15.472 14667 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:01:15 ctl02 nova-api[14667]: 2017-09-28 13:01:15.472 14667 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:01:15 ctl02 nova-api[14667]: 2017-09-28 13:01:15.472 14667 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:01:15 ctl02 nova-api[14667]: 2017-09-28 13:01:15.472 14667 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:01:15 ctl02 nova-api[14667]: 2017-09-28 13:01:15.472 14667 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:01:15 ctl02 nova-api[14667]: 2017-09-28 13:01:15.472 14667 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:01:15 ctl02 nova-api[14667]: 2017-09-28 13:01:15.472 14667 ERROR nova.wsgi     self.filename))
Sep 28 13:01:15 ctl02 nova-api[14667]: 2017-09-28 13:01:15.472 14667 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:01:15 ctl02 nova-api[14667]: 2017-09-28 13:01:15.472 14667 ERROR nova.wsgi
Sep 28 13:01:15 ctl02 nova-api[14667]: 2017-09-28 13:01:15.472 14667 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:01:15 ctl02 neutron-server[30536]: 2017-09-28 13:01:15.510 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:01:15] "OPTIONS / HTTP/1.0" 200 262 0.000455
Sep 28 13:01:15 ctl02 neutron-server[30536]: 2017-09-28 13:01:15.562 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:15 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:15 ctl02 neutron-server[30536]: 2017-09-28 13:01:15.563 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:15 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:15 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:15 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:15 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:15 ctl02 nova-api[14667]: 2017-09-28 13:01:15.599 14667 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:01:15 ctl02 neutron-server[30536]: 2017-09-28 13:01:15.816 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:15 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:15 ctl02 neutron-server[30536]: 2017-09-28 13:01:15.817 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:15 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:15 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:15 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:15 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:15 ctl02 nova-api[14667]: 2017-09-28 13:01:15.821 14667 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:01:15 ctl02 nova-api[14667]: 2017-09-28 13:01:15.823 14667 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:01:15 ctl02 nova-api[14667]: 2017-09-28 13:01:15.823 14667 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:01:15 ctl02 nova-api[14667]: 2017-09-28 13:01:15.823 14667 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:01:15 ctl02 nova-api[14667]: 2017-09-28 13:01:15.953 14667 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:01:15 ctl02 nova-api[14667]: 2017-09-28 13:01:15.955 14667 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:01:15 ctl02 nova-api[14667]: 2017-09-28 13:01:15.955 14667 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:01:15 ctl02 nova-api[14667]: 2017-09-28 13:01:15.955 14667 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:01:15 ctl02 heat-api-cfn[13300]: 2017-09-28 13:01:15.956 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:01:15] "OPTIONS / HTTP/1.0" 200 134 0.000479
Sep 28 13:01:15 ctl02 nova-api[14667]: 2017-09-28 13:01:15.959 14667 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:01:15 ctl02 nova-api[14667]: 2017-09-28 13:01:15.959 14667 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:01:15 ctl02 nova-api[14667]: 2017-09-28 13:01:15.959 14667 ERROR nova Traceback (most recent call last):
Sep 28 13:01:15 ctl02 nova-api[14667]: 2017-09-28 13:01:15.959 14667 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:01:15 ctl02 nova-api[14667]: 2017-09-28 13:01:15.959 14667 ERROR nova     sys.exit(main())
Sep 28 13:01:15 ctl02 nova-api[14667]: 2017-09-28 13:01:15.959 14667 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:01:15 ctl02 nova-api[14667]: 2017-09-28 13:01:15.959 14667 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:01:15 ctl02 nova-api[14667]: 2017-09-28 13:01:15.959 14667 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:01:15 ctl02 nova-api[14667]: 2017-09-28 13:01:15.959 14667 ERROR nova     max_url_len=max_url_len)
Sep 28 13:01:15 ctl02 nova-api[14667]: 2017-09-28 13:01:15.959 14667 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:01:15 ctl02 nova-api[14667]: 2017-09-28 13:01:15.959 14667 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:01:15 ctl02 nova-api[14667]: 2017-09-28 13:01:15.959 14667 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:01:15 ctl02 nova-api[14667]: 2017-09-28 13:01:15.959 14667 ERROR nova     sock.listen(backlog)
Sep 28 13:01:15 ctl02 nova-api[14667]: 2017-09-28 13:01:15.959 14667 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:01:15 ctl02 nova-api[14667]: 2017-09-28 13:01:15.959 14667 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:01:15 ctl02 nova-api[14667]: 2017-09-28 13:01:15.959 14667 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:01:15 ctl02 nova-api[14667]: 2017-09-28 13:01:15.959 14667 ERROR nova
Sep 28 13:01:15 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:01:15.976 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:01:15] "OPTIONS / HTTP/1.0" 200 134 0.000413
Sep 28 13:01:16 ctl02 neutron-server[30536]: 2017-09-28 13:01:16.070 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:16 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:16 ctl02 neutron-server[30536]: 2017-09-28 13:01:16.070 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:16 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:16 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:16 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:16 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:16 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:01:16 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:01:16 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:01:16 ctl02 neutron-server[30536]: 2017-09-28 13:01:16.323 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:16 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:16 ctl02 neutron-server[30536]: 2017-09-28 13:01:16.324 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:16 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:16 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:16 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:16 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:16 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:01:16 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:01:16 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:01:16 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:01:16 ctl02 neutron-server[30536]: 2017-09-28 13:01:16.578 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:16 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:16 ctl02 neutron-server[30536]: 2017-09-28 13:01:16.578 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:16 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:16 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:16 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:16 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:16 ctl02 neutron-server[30536]: 2017-09-28 13:01:16.831 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:16 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:16 ctl02 neutron-server[30536]: 2017-09-28 13:01:16.832 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:16 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:16 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:16 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:16 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:17 ctl02 neutron-server[30536]: 2017-09-28 13:01:17.084 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:17 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:17 ctl02 neutron-server[30536]: 2017-09-28 13:01:17.085 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:17 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:17 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:17 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:17 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:17 ctl02 neutron-server[30536]: 2017-09-28 13:01:17.337 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:17 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:17 ctl02 neutron-server[30536]: 2017-09-28 13:01:17.338 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:17 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:17 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:17 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:17 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:17 ctl02 neutron-server[30536]: 2017-09-28 13:01:17.590 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:17 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:17 ctl02 neutron-server[30536]: 2017-09-28 13:01:17.591 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:17 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:17 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:17 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:17 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:17 ctl02 heat-api[13008]: 2017-09-28 13:01:17.614 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:01:17] "OPTIONS / HTTP/1.0" 200 134 0.000556
Sep 28 13:01:17 ctl02 neutron-server[30536]: 2017-09-28 13:01:17.616 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:01:17] "OPTIONS / HTTP/1.0" 200 262 0.000478
Sep 28 13:01:17 ctl02 neutron-server[30536]: 2017-09-28 13:01:17.844 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:17 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:17 ctl02 neutron-server[30536]: 2017-09-28 13:01:17.844 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:17 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:17 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:17 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:17 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:18 ctl02 nova-api[14686]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:01:18 ctl02 nova-api[14686]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:01:18 ctl02 neutron-server[30536]: 2017-09-28 13:01:18.098 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:18 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:18 ctl02 neutron-server[30536]: 2017-09-28 13:01:18.098 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:18 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:18 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:18 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:18 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:18 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:01:18.188 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:01:18] "OPTIONS / HTTP/1.0" 200 134 0.000385
Sep 28 13:01:18 ctl02 nova-api[14686]: 2017-09-28 13:01:18.228 14686 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:01:18 ctl02 nova-api[14686]: 2017-09-28 13:01:18.230 14686 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:01:18 ctl02 nova-api[14686]: 2017-09-28 13:01:18.230 14686 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:01:18 ctl02 nova-api[14686]: 2017-09-28 13:01:18.230 14686 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:01:18 ctl02 nova-api[14686]: 2017-09-28 13:01:18.230 14686 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:01:18 ctl02 nova-api[14686]: 2017-09-28 13:01:18.230 14686 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:01:18 ctl02 nova-api[14686]: 2017-09-28 13:01:18.230 14686 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:01:18 ctl02 nova-api[14686]: 2017-09-28 13:01:18.230 14686 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:01:18 ctl02 nova-api[14686]: 2017-09-28 13:01:18.230 14686 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:01:18 ctl02 nova-api[14686]: 2017-09-28 13:01:18.230 14686 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:01:18 ctl02 nova-api[14686]: 2017-09-28 13:01:18.230 14686 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:01:18 ctl02 nova-api[14686]: 2017-09-28 13:01:18.230 14686 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:01:18 ctl02 nova-api[14686]: 2017-09-28 13:01:18.230 14686 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:01:18 ctl02 nova-api[14686]: 2017-09-28 13:01:18.230 14686 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:01:18 ctl02 nova-api[14686]: 2017-09-28 13:01:18.230 14686 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:01:18 ctl02 nova-api[14686]: 2017-09-28 13:01:18.230 14686 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:01:18 ctl02 nova-api[14686]: 2017-09-28 13:01:18.230 14686 ERROR nova.wsgi     self.filename))
Sep 28 13:01:18 ctl02 nova-api[14686]: 2017-09-28 13:01:18.230 14686 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:01:18 ctl02 nova-api[14686]: 2017-09-28 13:01:18.230 14686 ERROR nova.wsgi
Sep 28 13:01:18 ctl02 nova-api[14686]: 2017-09-28 13:01:18.231 14686 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:01:18 ctl02 neutron-server[30536]: 2017-09-28 13:01:18.352 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:18 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:18 ctl02 neutron-server[30536]: 2017-09-28 13:01:18.352 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:18 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:18 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:18 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:18 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:18 ctl02 nova-api[14686]: 2017-09-28 13:01:18.360 14686 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:01:18 ctl02 glance-api[29183]: 2017-09-28 13:01:18.568 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:01:18] "OPTIONS / HTTP/1.0" 200 134 0.000621
Sep 28 13:01:18 ctl02 nova-api[14686]: 2017-09-28 13:01:18.586 14686 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:01:18 ctl02 nova-api[14686]: 2017-09-28 13:01:18.588 14686 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:01:18 ctl02 nova-api[14686]: 2017-09-28 13:01:18.588 14686 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:01:18 ctl02 nova-api[14686]: 2017-09-28 13:01:18.588 14686 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:01:18 ctl02 neutron-server[30536]: 2017-09-28 13:01:18.605 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:18 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:18 ctl02 neutron-server[30536]: 2017-09-28 13:01:18.606 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:18 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:18 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:18 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:18 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:18 ctl02 nova-api[14686]: 2017-09-28 13:01:18.719 14686 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:01:18 ctl02 nova-api[14686]: 2017-09-28 13:01:18.721 14686 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:01:18 ctl02 nova-api[14686]: 2017-09-28 13:01:18.721 14686 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:01:18 ctl02 nova-api[14686]: 2017-09-28 13:01:18.721 14686 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:01:18 ctl02 nova-api[14686]: 2017-09-28 13:01:18.724 14686 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:01:18 ctl02 nova-api[14686]: 2017-09-28 13:01:18.725 14686 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:01:18 ctl02 nova-api[14686]: 2017-09-28 13:01:18.725 14686 ERROR nova Traceback (most recent call last):
Sep 28 13:01:18 ctl02 nova-api[14686]: 2017-09-28 13:01:18.725 14686 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:01:18 ctl02 nova-api[14686]: 2017-09-28 13:01:18.725 14686 ERROR nova     sys.exit(main())
Sep 28 13:01:18 ctl02 nova-api[14686]: 2017-09-28 13:01:18.725 14686 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:01:18 ctl02 nova-api[14686]: 2017-09-28 13:01:18.725 14686 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:01:18 ctl02 nova-api[14686]: 2017-09-28 13:01:18.725 14686 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:01:18 ctl02 nova-api[14686]: 2017-09-28 13:01:18.725 14686 ERROR nova     max_url_len=max_url_len)
Sep 28 13:01:18 ctl02 nova-api[14686]: 2017-09-28 13:01:18.725 14686 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:01:18 ctl02 nova-api[14686]: 2017-09-28 13:01:18.725 14686 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:01:18 ctl02 nova-api[14686]: 2017-09-28 13:01:18.725 14686 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:01:18 ctl02 nova-api[14686]: 2017-09-28 13:01:18.725 14686 ERROR nova     sock.listen(backlog)
Sep 28 13:01:18 ctl02 nova-api[14686]: 2017-09-28 13:01:18.725 14686 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:01:18 ctl02 nova-api[14686]: 2017-09-28 13:01:18.725 14686 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:01:18 ctl02 nova-api[14686]: 2017-09-28 13:01:18.725 14686 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:01:18 ctl02 nova-api[14686]: 2017-09-28 13:01:18.725 14686 ERROR nova
Sep 28 13:01:18 ctl02 neutron-server[30536]: 2017-09-28 13:01:18.859 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:18 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:18 ctl02 neutron-server[30536]: 2017-09-28 13:01:18.860 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:18 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:18 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:01:18 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:18 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:01:18 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:18 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:01:18 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:19 ctl02 neutron-server[30536]: 2017-09-28 13:01:19.113 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:19 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:19 ctl02 neutron-server[30536]: 2017-09-28 13:01:19.114 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:19 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:19 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:19 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:19 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:19 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:01:19 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:01:19 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:01:19 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:01:19 ctl02 neutron-server[30536]: 2017-09-28 13:01:19.368 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:19 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:19 ctl02 neutron-server[30536]: 2017-09-28 13:01:19.368 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:19 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:19 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:19 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:19 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:19 ctl02 neutron-server[30536]: 2017-09-28 13:01:19.622 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:19 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:19 ctl02 neutron-server[30536]: 2017-09-28 13:01:19.622 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:19 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:19 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:19 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:19 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:19 ctl02 heat-api-cfn[13300]: 2017-09-28 13:01:19.727 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:01:19] "OPTIONS / HTTP/1.0" 200 134 0.000450
Sep 28 13:01:19 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x45653437)
Sep 28 13:01:19 ctl02 neutron-server[30536]: 2017-09-28 13:01:19.896 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:19 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:19 ctl02 neutron-server[30536]: 2017-09-28 13:01:19.896 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:19 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:19 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:19 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:19 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:20 ctl02 heat-api[13008]: 2017-09-28 13:01:20.021 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:01:20] "OPTIONS / HTTP/1.0" 200 134 0.000519
Sep 28 13:01:20 ctl02 neutron-server[30536]: 2017-09-28 13:01:20.149 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:20 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:20 ctl02 neutron-server[30536]: 2017-09-28 13:01:20.150 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:20 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:20 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:20 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:20 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:20 ctl02 neutron-server[30536]: 2017-09-28 13:01:20.402 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:20 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:20 ctl02 neutron-server[30536]: 2017-09-28 13:01:20.403 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:20 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:20 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:20 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:20 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:20 ctl02 neutron-server[30536]: 2017-09-28 13:01:20.655 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:20 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:20 ctl02 neutron-server[30536]: 2017-09-28 13:01:20.656 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:20 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:20 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:20 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:20 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:20 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:01:20.708 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:01:20] "OPTIONS / HTTP/1.0" 200 134 0.000370
Sep 28 13:01:20 ctl02 nova-api[14704]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:01:20 ctl02 nova-api[14704]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:01:20 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x45653437)
Sep 28 13:01:20 ctl02 neutron-server[30536]: 2017-09-28 13:01:20.909 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:20 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:20 ctl02 neutron-server[30536]: 2017-09-28 13:01:20.909 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:20 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:20 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:20 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:20 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:20 ctl02 nova-api[14704]: 2017-09-28 13:01:20.976 14704 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:01:20 ctl02 nova-api[14704]: 2017-09-28 13:01:20.978 14704 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:01:20 ctl02 nova-api[14704]: 2017-09-28 13:01:20.978 14704 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:01:20 ctl02 nova-api[14704]: 2017-09-28 13:01:20.978 14704 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:01:20 ctl02 nova-api[14704]: 2017-09-28 13:01:20.978 14704 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:01:20 ctl02 nova-api[14704]: 2017-09-28 13:01:20.978 14704 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:01:20 ctl02 nova-api[14704]: 2017-09-28 13:01:20.978 14704 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:01:20 ctl02 nova-api[14704]: 2017-09-28 13:01:20.978 14704 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:01:20 ctl02 nova-api[14704]: 2017-09-28 13:01:20.978 14704 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:01:20 ctl02 nova-api[14704]: 2017-09-28 13:01:20.978 14704 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:01:20 ctl02 nova-api[14704]: 2017-09-28 13:01:20.978 14704 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:01:20 ctl02 nova-api[14704]: 2017-09-28 13:01:20.978 14704 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:01:20 ctl02 nova-api[14704]: 2017-09-28 13:01:20.978 14704 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:01:20 ctl02 nova-api[14704]: 2017-09-28 13:01:20.978 14704 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:01:20 ctl02 nova-api[14704]: 2017-09-28 13:01:20.978 14704 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:01:20 ctl02 nova-api[14704]: 2017-09-28 13:01:20.978 14704 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:01:20 ctl02 nova-api[14704]: 2017-09-28 13:01:20.978 14704 ERROR nova.wsgi     self.filename))
Sep 28 13:01:20 ctl02 nova-api[14704]: 2017-09-28 13:01:20.978 14704 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:01:20 ctl02 nova-api[14704]: 2017-09-28 13:01:20.978 14704 ERROR nova.wsgi
Sep 28 13:01:20 ctl02 nova-api[14704]: 2017-09-28 13:01:20.978 14704 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:01:21 ctl02 neutron-server[30536]: 2017-09-28 13:01:21.040 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 1 dead agents out of 6:
Sep 28 13:01:21 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 13:01:21 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 13:00:10 cmp002
Sep 28 13:01:21 ctl02 nova-api[14704]: 2017-09-28 13:01:21.106 14704 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:01:21 ctl02 neutron-server[30536]: 2017-09-28 13:01:21.162 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:21 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:21 ctl02 neutron-server[30536]: 2017-09-28 13:01:21.163 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:21 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:21 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:21 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:21 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:21 ctl02 nova-api[14704]: 2017-09-28 13:01:21.331 14704 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:01:21 ctl02 nova-api[14704]: 2017-09-28 13:01:21.334 14704 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:01:21 ctl02 nova-api[14704]: 2017-09-28 13:01:21.334 14704 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:01:21 ctl02 nova-api[14704]: 2017-09-28 13:01:21.334 14704 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:01:21 ctl02 neutron-server[30536]: 2017-09-28 13:01:21.416 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:21 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:21 ctl02 neutron-server[30536]: 2017-09-28 13:01:21.417 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:21 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:21 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:21 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:21 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:21 ctl02 nova-api[14704]: 2017-09-28 13:01:21.466 14704 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:01:21 ctl02 nova-api[14704]: 2017-09-28 13:01:21.468 14704 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:01:21 ctl02 nova-api[14704]: 2017-09-28 13:01:21.468 14704 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:01:21 ctl02 nova-api[14704]: 2017-09-28 13:01:21.469 14704 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:01:21 ctl02 nova-api[14704]: 2017-09-28 13:01:21.472 14704 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:01:21 ctl02 nova-api[14704]: 2017-09-28 13:01:21.472 14704 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:01:21 ctl02 nova-api[14704]: 2017-09-28 13:01:21.472 14704 ERROR nova Traceback (most recent call last):
Sep 28 13:01:21 ctl02 nova-api[14704]: 2017-09-28 13:01:21.472 14704 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:01:21 ctl02 nova-api[14704]: 2017-09-28 13:01:21.472 14704 ERROR nova     sys.exit(main())
Sep 28 13:01:21 ctl02 nova-api[14704]: 2017-09-28 13:01:21.472 14704 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:01:21 ctl02 nova-api[14704]: 2017-09-28 13:01:21.472 14704 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:01:21 ctl02 nova-api[14704]: 2017-09-28 13:01:21.472 14704 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:01:21 ctl02 nova-api[14704]: 2017-09-28 13:01:21.472 14704 ERROR nova     max_url_len=max_url_len)
Sep 28 13:01:21 ctl02 nova-api[14704]: 2017-09-28 13:01:21.472 14704 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:01:21 ctl02 nova-api[14704]: 2017-09-28 13:01:21.472 14704 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:01:21 ctl02 nova-api[14704]: 2017-09-28 13:01:21.472 14704 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:01:21 ctl02 nova-api[14704]: 2017-09-28 13:01:21.472 14704 ERROR nova     sock.listen(backlog)
Sep 28 13:01:21 ctl02 nova-api[14704]: 2017-09-28 13:01:21.472 14704 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:01:21 ctl02 nova-api[14704]: 2017-09-28 13:01:21.472 14704 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:01:21 ctl02 nova-api[14704]: 2017-09-28 13:01:21.472 14704 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:01:21 ctl02 nova-api[14704]: 2017-09-28 13:01:21.472 14704 ERROR nova
Sep 28 13:01:21 ctl02 neutron-server[30536]: 2017-09-28 13:01:21.605 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:01:21] "OPTIONS / HTTP/1.0" 200 262 0.000471
Sep 28 13:01:21 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:01:21 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:01:21 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:01:21 ctl02 neutron-server[30536]: 2017-09-28 13:01:21.670 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:21 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:21 ctl02 neutron-server[30536]: 2017-09-28 13:01:21.670 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:21 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:21 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:21 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:21 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:21 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x45653437)
Sep 28 13:01:21 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:01:21 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:01:21 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:01:21 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:01:21 ctl02 neutron-server[30536]: 2017-09-28 13:01:21.924 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:21 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:21 ctl02 neutron-server[30536]: 2017-09-28 13:01:21.925 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:21 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:21 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:21 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:21 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:22 ctl02 glance-api[29183]: 2017-09-28 13:01:22.073 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:01:22] "OPTIONS / HTTP/1.0" 200 134 0.000578
Sep 28 13:01:22 ctl02 neutron-server[30536]: 2017-09-28 13:01:22.179 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:22 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:22 ctl02 neutron-server[30536]: 2017-09-28 13:01:22.179 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:22 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:22 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:22 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:22 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:22 ctl02 neutron-server[30536]: 2017-09-28 13:01:22.433 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:22 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:22 ctl02 neutron-server[30536]: 2017-09-28 13:01:22.433 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:22 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:22 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:22 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:22 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:22 ctl02 neutron-server[30536]: 2017-09-28 13:01:22.687 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:22 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:22 ctl02 neutron-server[30536]: 2017-09-28 13:01:22.687 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:22 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:22 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:22 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:22 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:22 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x45653437)
Sep 28 13:01:22 ctl02 neutron-server[30536]: 2017-09-28 13:01:22.940 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:22 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:22 ctl02 neutron-server[30536]: 2017-09-28 13:01:22.940 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:22 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:22 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:22 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:22 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:23 ctl02 glance-api[29183]: 2017-09-28 13:01:23.149 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:01:23] "OPTIONS / HTTP/1.0" 200 134 0.000867
Sep 28 13:01:23 ctl02 neutron-server[30536]: 2017-09-28 13:01:23.193 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:23 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:23 ctl02 neutron-server[30536]: 2017-09-28 13:01:23.193 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:23 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:23 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:23 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:23 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:23 ctl02 neutron-server[30536]: 2017-09-28 13:01:23.446 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:23 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:23 ctl02 neutron-server[30536]: 2017-09-28 13:01:23.446 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:23 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:23 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:23 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:23 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:23 ctl02 nova-api[14722]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:01:23 ctl02 nova-api[14722]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:01:23 ctl02 neutron-server[30536]: 2017-09-28 13:01:23.699 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:23 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:23 ctl02 neutron-server[30536]: 2017-09-28 13:01:23.699 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:23 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:23 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:23 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:23 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:23 ctl02 nova-api[14722]: 2017-09-28 13:01:23.751 14722 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:01:23 ctl02 nova-api[14722]: 2017-09-28 13:01:23.752 14722 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:01:23 ctl02 nova-api[14722]: 2017-09-28 13:01:23.752 14722 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:01:23 ctl02 nova-api[14722]: 2017-09-28 13:01:23.752 14722 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:01:23 ctl02 nova-api[14722]: 2017-09-28 13:01:23.752 14722 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:01:23 ctl02 nova-api[14722]: 2017-09-28 13:01:23.752 14722 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:01:23 ctl02 nova-api[14722]: 2017-09-28 13:01:23.752 14722 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:01:23 ctl02 nova-api[14722]: 2017-09-28 13:01:23.752 14722 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:01:23 ctl02 nova-api[14722]: 2017-09-28 13:01:23.752 14722 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:01:23 ctl02 nova-api[14722]: 2017-09-28 13:01:23.752 14722 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:01:23 ctl02 nova-api[14722]: 2017-09-28 13:01:23.752 14722 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:01:23 ctl02 nova-api[14722]: 2017-09-28 13:01:23.752 14722 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:01:23 ctl02 nova-api[14722]: 2017-09-28 13:01:23.752 14722 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:01:23 ctl02 nova-api[14722]: 2017-09-28 13:01:23.752 14722 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:01:23 ctl02 nova-api[14722]: 2017-09-28 13:01:23.752 14722 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:01:23 ctl02 nova-api[14722]: 2017-09-28 13:01:23.752 14722 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:01:23 ctl02 nova-api[14722]: 2017-09-28 13:01:23.752 14722 ERROR nova.wsgi     self.filename))
Sep 28 13:01:23 ctl02 nova-api[14722]: 2017-09-28 13:01:23.752 14722 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:01:23 ctl02 nova-api[14722]: 2017-09-28 13:01:23.752 14722 ERROR nova.wsgi
Sep 28 13:01:23 ctl02 nova-api[14722]: 2017-09-28 13:01:23.753 14722 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:01:23 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x45653437)
Sep 28 13:01:23 ctl02 nova-api[14722]: 2017-09-28 13:01:23.883 14722 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:01:23 ctl02 neutron-server[30536]: 2017-09-28 13:01:23.952 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:23 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:23 ctl02 neutron-server[30536]: 2017-09-28 13:01:23.952 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:23 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:23 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:23 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:23 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:24 ctl02 nova-api[14722]: 2017-09-28 13:01:24.106 14722 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:01:24 ctl02 nova-api[14722]: 2017-09-28 13:01:24.108 14722 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:01:24 ctl02 nova-api[14722]: 2017-09-28 13:01:24.109 14722 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:01:24 ctl02 nova-api[14722]: 2017-09-28 13:01:24.109 14722 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:01:24 ctl02 heat-api[13008]: 2017-09-28 13:01:24.130 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:01:24] "OPTIONS / HTTP/1.0" 200 134 0.000527
Sep 28 13:01:24 ctl02 neutron-server[30536]: 2017-09-28 13:01:24.206 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:24 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:24 ctl02 neutron-server[30536]: 2017-09-28 13:01:24.206 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:24 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:24 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:24 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:24 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:24 ctl02 nova-api[14722]: 2017-09-28 13:01:24.246 14722 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:01:24 ctl02 nova-api[14722]: 2017-09-28 13:01:24.248 14722 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:01:24 ctl02 nova-api[14722]: 2017-09-28 13:01:24.248 14722 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:01:24 ctl02 nova-api[14722]: 2017-09-28 13:01:24.248 14722 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:01:24 ctl02 nova-api[14722]: 2017-09-28 13:01:24.251 14722 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:01:24 ctl02 nova-api[14722]: 2017-09-28 13:01:24.252 14722 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:01:24 ctl02 nova-api[14722]: 2017-09-28 13:01:24.252 14722 ERROR nova Traceback (most recent call last):
Sep 28 13:01:24 ctl02 nova-api[14722]: 2017-09-28 13:01:24.252 14722 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:01:24 ctl02 nova-api[14722]: 2017-09-28 13:01:24.252 14722 ERROR nova     sys.exit(main())
Sep 28 13:01:24 ctl02 nova-api[14722]: 2017-09-28 13:01:24.252 14722 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:01:24 ctl02 nova-api[14722]: 2017-09-28 13:01:24.252 14722 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:01:24 ctl02 nova-api[14722]: 2017-09-28 13:01:24.252 14722 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:01:24 ctl02 nova-api[14722]: 2017-09-28 13:01:24.252 14722 ERROR nova     max_url_len=max_url_len)
Sep 28 13:01:24 ctl02 nova-api[14722]: 2017-09-28 13:01:24.252 14722 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:01:24 ctl02 nova-api[14722]: 2017-09-28 13:01:24.252 14722 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:01:24 ctl02 nova-api[14722]: 2017-09-28 13:01:24.252 14722 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:01:24 ctl02 nova-api[14722]: 2017-09-28 13:01:24.252 14722 ERROR nova     sock.listen(backlog)
Sep 28 13:01:24 ctl02 nova-api[14722]: 2017-09-28 13:01:24.252 14722 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:01:24 ctl02 nova-api[14722]: 2017-09-28 13:01:24.252 14722 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:01:24 ctl02 nova-api[14722]: 2017-09-28 13:01:24.252 14722 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:01:24 ctl02 nova-api[14722]: 2017-09-28 13:01:24.252 14722 ERROR nova
Sep 28 13:01:24 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:01:24 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:01:24 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:01:24 ctl02 neutron-server[30536]: 2017-09-28 13:01:24.465 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:24 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:24 ctl02 neutron-server[30536]: 2017-09-28 13:01:24.465 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:24 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:24 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:24 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:24 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:24 ctl02 dhclient[600]: DHCPREQUEST of 192.168.11.25 on ens2 to 192.168.11.3 port 67 (xid=0x3415f07)
Sep 28 13:01:24 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:01:24 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:01:24 ctl02 dhclient[600]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 13:01:24 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:01:24 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:01:24 ctl02 heat-api-cfn[13300]: 2017-09-28 13:01:24.691 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:01:24] "OPTIONS / HTTP/1.0" 200 134 0.000648
Sep 28 13:01:24 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 13:01:24 ctl02 neutron-server[30536]: 2017-09-28 13:01:24.719 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:24 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:24 ctl02 neutron-server[30536]: 2017-09-28 13:01:24.719 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:24 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:24 ctl02 ntp[14800]:  * Stopping NTP server ntpd
Sep 28 13:01:24 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:24 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:24 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:24 ctl02 ntp[14800]:    ...done.
Sep 28 13:01:24 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 13:01:24 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 13:01:24 ctl02 ntp[14811]:  * Starting NTP server ntpd
Sep 28 13:01:24 ctl02 ntpd[14818]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 13:01:24 ctl02 ntpd[14818]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -c /var/lib/ntp/ntp.conf.dhcp -u 108:112
Sep 28 13:01:24 ctl02 ntp[14811]:    ...done.
Sep 28 13:01:24 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 13:01:24 ctl02 ntpd[14821]: proto: precision = 0.042 usec (-24)
Sep 28 13:01:24 ctl02 ntpd[14821]: switching logging to file /var/log/ntp.log
Sep 28 13:01:24 ctl02 dhclient[600]: bound to 192.168.11.25 -- renewal in 231 seconds.
Sep 28 13:01:24 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x45653437)
Sep 28 13:01:24 ctl02 neutron-server[30536]: 2017-09-28 13:01:24.972 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:24 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:24 ctl02 neutron-server[30536]: 2017-09-28 13:01:24.973 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:24 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:24 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:24 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:24 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:25 ctl02 neutron-server[30536]: 2017-09-28 13:01:25.138 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:01:25] "OPTIONS / HTTP/1.0" 200 262 0.000434
Sep 28 13:01:25 ctl02 neutron-server[30536]: 2017-09-28 13:01:25.226 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:25 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:25 ctl02 neutron-server[30536]: 2017-09-28 13:01:25.227 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:25 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:25 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:25 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:25 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:25 ctl02 neutron-server[30536]: 2017-09-28 13:01:25.481 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:25 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:25 ctl02 neutron-server[30536]: 2017-09-28 13:01:25.483 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:25 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:25 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:25 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:25 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:25 ctl02 heat-api-cfn[13300]: 2017-09-28 13:01:25.668 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:01:25] "OPTIONS / HTTP/1.0" 200 134 0.000659
Sep 28 13:01:25 ctl02 neutron-server[30536]: 2017-09-28 13:01:25.738 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:25 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:25 ctl02 neutron-server[30536]: 2017-09-28 13:01:25.739 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:25 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:25 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:25 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:25 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:25 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:01:25.766 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:01:25] "OPTIONS / HTTP/1.0" 200 134 0.000482
Sep 28 13:01:25 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x45653437)
Sep 28 13:01:25 ctl02 neutron-server[30536]: 2017-09-28 13:01:25.993 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:25 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:25 ctl02 neutron-server[30536]: 2017-09-28 13:01:25.994 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:25 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:25 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:25 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:25 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:26 ctl02 neutron-server[30536]: 2017-09-28 13:01:26.247 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:26 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:26 ctl02 neutron-server[30536]: 2017-09-28 13:01:26.247 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:26 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:26 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:26 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:26 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:26 ctl02 nova-api[14755]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:01:26 ctl02 nova-api[14755]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:01:26 ctl02 nova-api[14755]: 2017-09-28 13:01:26.479 14755 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:01:26 ctl02 nova-api[14755]: 2017-09-28 13:01:26.481 14755 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:01:26 ctl02 nova-api[14755]: 2017-09-28 13:01:26.481 14755 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:01:26 ctl02 nova-api[14755]: 2017-09-28 13:01:26.481 14755 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:01:26 ctl02 nova-api[14755]: 2017-09-28 13:01:26.481 14755 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:01:26 ctl02 nova-api[14755]: 2017-09-28 13:01:26.481 14755 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:01:26 ctl02 nova-api[14755]: 2017-09-28 13:01:26.481 14755 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:01:26 ctl02 nova-api[14755]: 2017-09-28 13:01:26.481 14755 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:01:26 ctl02 nova-api[14755]: 2017-09-28 13:01:26.481 14755 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:01:26 ctl02 nova-api[14755]: 2017-09-28 13:01:26.481 14755 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:01:26 ctl02 nova-api[14755]: 2017-09-28 13:01:26.481 14755 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:01:26 ctl02 nova-api[14755]: 2017-09-28 13:01:26.481 14755 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:01:26 ctl02 nova-api[14755]: 2017-09-28 13:01:26.481 14755 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:01:26 ctl02 nova-api[14755]: 2017-09-28 13:01:26.481 14755 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:01:26 ctl02 nova-api[14755]: 2017-09-28 13:01:26.481 14755 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:01:26 ctl02 nova-api[14755]: 2017-09-28 13:01:26.481 14755 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:01:26 ctl02 nova-api[14755]: 2017-09-28 13:01:26.481 14755 ERROR nova.wsgi     self.filename))
Sep 28 13:01:26 ctl02 nova-api[14755]: 2017-09-28 13:01:26.481 14755 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:01:26 ctl02 nova-api[14755]: 2017-09-28 13:01:26.481 14755 ERROR nova.wsgi
Sep 28 13:01:26 ctl02 nova-api[14755]: 2017-09-28 13:01:26.482 14755 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:01:26 ctl02 neutron-server[30536]: 2017-09-28 13:01:26.500 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:26 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:26 ctl02 neutron-server[30536]: 2017-09-28 13:01:26.501 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:26 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:26 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:26 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:26 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:26 ctl02 nova-api[14755]: 2017-09-28 13:01:26.612 14755 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:01:26 ctl02 neutron-server[30536]: 2017-09-28 13:01:26.754 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:26 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:26 ctl02 neutron-server[30536]: 2017-09-28 13:01:26.754 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:26 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:26 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:26 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:26 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:26 ctl02 nova-api[14755]: 2017-09-28 13:01:26.833 14755 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:01:26 ctl02 nova-api[14755]: 2017-09-28 13:01:26.836 14755 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:01:26 ctl02 nova-api[14755]: 2017-09-28 13:01:26.836 14755 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:01:26 ctl02 nova-api[14755]: 2017-09-28 13:01:26.837 14755 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:01:26 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x45653437)
Sep 28 13:01:26 ctl02 nova-api[14755]: 2017-09-28 13:01:26.968 14755 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:01:26 ctl02 nova-api[14755]: 2017-09-28 13:01:26.971 14755 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:01:26 ctl02 nova-api[14755]: 2017-09-28 13:01:26.971 14755 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:01:26 ctl02 nova-api[14755]: 2017-09-28 13:01:26.971 14755 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:01:26 ctl02 nova-api[14755]: 2017-09-28 13:01:26.975 14755 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:01:26 ctl02 nova-api[14755]: 2017-09-28 13:01:26.975 14755 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:01:26 ctl02 nova-api[14755]: 2017-09-28 13:01:26.975 14755 ERROR nova Traceback (most recent call last):
Sep 28 13:01:26 ctl02 nova-api[14755]: 2017-09-28 13:01:26.975 14755 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:01:26 ctl02 nova-api[14755]: 2017-09-28 13:01:26.975 14755 ERROR nova     sys.exit(main())
Sep 28 13:01:26 ctl02 nova-api[14755]: 2017-09-28 13:01:26.975 14755 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:01:26 ctl02 nova-api[14755]: 2017-09-28 13:01:26.975 14755 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:01:26 ctl02 nova-api[14755]: 2017-09-28 13:01:26.975 14755 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:01:26 ctl02 nova-api[14755]: 2017-09-28 13:01:26.975 14755 ERROR nova     max_url_len=max_url_len)
Sep 28 13:01:26 ctl02 nova-api[14755]: 2017-09-28 13:01:26.975 14755 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:01:26 ctl02 nova-api[14755]: 2017-09-28 13:01:26.975 14755 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:01:26 ctl02 nova-api[14755]: 2017-09-28 13:01:26.975 14755 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:01:26 ctl02 nova-api[14755]: 2017-09-28 13:01:26.975 14755 ERROR nova     sock.listen(backlog)
Sep 28 13:01:26 ctl02 nova-api[14755]: 2017-09-28 13:01:26.975 14755 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:01:26 ctl02 nova-api[14755]: 2017-09-28 13:01:26.975 14755 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:01:26 ctl02 nova-api[14755]: 2017-09-28 13:01:26.975 14755 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:01:26 ctl02 nova-api[14755]: 2017-09-28 13:01:26.975 14755 ERROR nova
Sep 28 13:01:27 ctl02 neutron-server[30536]: 2017-09-28 13:01:27.007 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:27 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:27 ctl02 neutron-server[30536]: 2017-09-28 13:01:27.008 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:27 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:27 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:27 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:27 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:27 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:01:27 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:01:27 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:01:27 ctl02 neutron-server[30536]: 2017-09-28 13:01:27.261 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:27 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:27 ctl02 neutron-server[30536]: 2017-09-28 13:01:27.262 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:27 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:27 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:27 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:27 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:27 ctl02 nova-conductor[5056]: 2017-09-28 13:01:27.276 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:01:27 ctl02 nova-conductor[5056]: 2017-09-28 13:01:27.287 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:01:27 ctl02 nova-conductor[5056]: 2017-09-28 13:01:27.289 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:01:27 ctl02 nova-conductor[5056]: 2017-09-28 13:01:27.293 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:01:27 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:01:27 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:01:27 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:01:27 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:01:27 ctl02 neutron-server[30536]: 2017-09-28 13:01:27.516 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:27 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:27 ctl02 neutron-server[30536]: 2017-09-28 13:01:27.516 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:27 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:27 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:27 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:27 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:27 ctl02 neutron-server[30536]: 2017-09-28 13:01:27.770 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:27 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:27 ctl02 neutron-server[30536]: 2017-09-28 13:01:27.770 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:27 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:27 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:27 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:27 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:27 ctl02 heat-api[13008]: 2017-09-28 13:01:27.810 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:01:27] "OPTIONS / HTTP/1.0" 200 134 0.000568
Sep 28 13:01:27 ctl02 neutron-server[30536]: 2017-09-28 13:01:27.844 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:01:27] "OPTIONS / HTTP/1.0" 200 262 0.000455
Sep 28 13:01:27 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x45653437)
Sep 28 13:01:27 ctl02 nova-cert[4860]: 2017-09-28 13:01:27.916 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:01:28 ctl02 neutron-server[30536]: 2017-09-28 13:01:28.024 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:28 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:28 ctl02 neutron-server[30536]: 2017-09-28 13:01:28.024 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:28 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:28 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:28 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:28 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:28 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:01:28.171 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:01:28] "OPTIONS / HTTP/1.0" 200 134 0.000489
Sep 28 13:01:28 ctl02 neutron-server[30536]: 2017-09-28 13:01:28.277 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:28 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:28 ctl02 neutron-server[30536]: 2017-09-28 13:01:28.277 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:28 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:28 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:28 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:28 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:28 ctl02 neutron-server[30536]: 2017-09-28 13:01:28.532 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:28 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:28 ctl02 neutron-server[30536]: 2017-09-28 13:01:28.532 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:28 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:28 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:28 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:28 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:28 ctl02 glance-api[29183]: 2017-09-28 13:01:28.582 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:01:28] "OPTIONS / HTTP/1.0" 200 134 0.000571
Sep 28 13:01:28 ctl02 neutron-server[30536]: 2017-09-28 13:01:28.786 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:28 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:28 ctl02 neutron-server[30536]: 2017-09-28 13:01:28.787 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:28 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:28 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:28 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:28 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:28 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x45653437)
Sep 28 13:01:29 ctl02 neutron-server[30536]: 2017-09-28 13:01:29.040 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:29 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:29 ctl02 neutron-server[30536]: 2017-09-28 13:01:29.041 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:29 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:29 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:29 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:29 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:29 ctl02 nova-api[14840]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:01:29 ctl02 nova-api[14840]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:01:29 ctl02 neutron-server[30536]: 2017-09-28 13:01:29.293 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:29 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:29 ctl02 neutron-server[30536]: 2017-09-28 13:01:29.294 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:29 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:29 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:29 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:29 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:29 ctl02 nova-api[14840]: 2017-09-28 13:01:29.303 14840 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:01:29 ctl02 nova-api[14840]: 2017-09-28 13:01:29.304 14840 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:01:29 ctl02 nova-api[14840]: 2017-09-28 13:01:29.304 14840 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:01:29 ctl02 nova-api[14840]: 2017-09-28 13:01:29.304 14840 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:01:29 ctl02 nova-api[14840]: 2017-09-28 13:01:29.304 14840 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:01:29 ctl02 nova-api[14840]: 2017-09-28 13:01:29.304 14840 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:01:29 ctl02 nova-api[14840]: 2017-09-28 13:01:29.304 14840 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:01:29 ctl02 nova-api[14840]: 2017-09-28 13:01:29.304 14840 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:01:29 ctl02 nova-api[14840]: 2017-09-28 13:01:29.304 14840 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:01:29 ctl02 nova-api[14840]: 2017-09-28 13:01:29.304 14840 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:01:29 ctl02 nova-api[14840]: 2017-09-28 13:01:29.304 14840 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:01:29 ctl02 nova-api[14840]: 2017-09-28 13:01:29.304 14840 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:01:29 ctl02 nova-api[14840]: 2017-09-28 13:01:29.304 14840 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:01:29 ctl02 nova-api[14840]: 2017-09-28 13:01:29.304 14840 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:01:29 ctl02 nova-api[14840]: 2017-09-28 13:01:29.304 14840 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:01:29 ctl02 nova-api[14840]: 2017-09-28 13:01:29.304 14840 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:01:29 ctl02 nova-api[14840]: 2017-09-28 13:01:29.304 14840 ERROR nova.wsgi     self.filename))
Sep 28 13:01:29 ctl02 nova-api[14840]: 2017-09-28 13:01:29.304 14840 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:01:29 ctl02 nova-api[14840]: 2017-09-28 13:01:29.304 14840 ERROR nova.wsgi
Sep 28 13:01:29 ctl02 nova-api[14840]: 2017-09-28 13:01:29.305 14840 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:01:29 ctl02 nova-api[14840]: 2017-09-28 13:01:29.438 14840 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:01:29 ctl02 neutron-server[30536]: 2017-09-28 13:01:29.547 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:29 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:29 ctl02 neutron-server[30536]: 2017-09-28 13:01:29.547 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:29 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:29 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:29 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:29 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:29 ctl02 nova-api[14840]: 2017-09-28 13:01:29.683 14840 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:01:29 ctl02 nova-api[14840]: 2017-09-28 13:01:29.685 14840 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:01:29 ctl02 nova-api[14840]: 2017-09-28 13:01:29.686 14840 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:01:29 ctl02 nova-api[14840]: 2017-09-28 13:01:29.686 14840 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:01:29 ctl02 neutron-server[30536]: 2017-09-28 13:01:29.801 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:29 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:29 ctl02 neutron-server[30536]: 2017-09-28 13:01:29.801 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:29 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:29 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:29 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:29 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:29 ctl02 nova-api[14840]: 2017-09-28 13:01:29.818 14840 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:01:29 ctl02 nova-api[14840]: 2017-09-28 13:01:29.820 14840 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:01:29 ctl02 nova-api[14840]: 2017-09-28 13:01:29.820 14840 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:01:29 ctl02 nova-api[14840]: 2017-09-28 13:01:29.820 14840 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:01:29 ctl02 nova-api[14840]: 2017-09-28 13:01:29.824 14840 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:01:29 ctl02 nova-api[14840]: 2017-09-28 13:01:29.824 14840 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:01:29 ctl02 nova-api[14840]: 2017-09-28 13:01:29.824 14840 ERROR nova Traceback (most recent call last):
Sep 28 13:01:29 ctl02 nova-api[14840]: 2017-09-28 13:01:29.824 14840 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:01:29 ctl02 nova-api[14840]: 2017-09-28 13:01:29.824 14840 ERROR nova     sys.exit(main())
Sep 28 13:01:29 ctl02 nova-api[14840]: 2017-09-28 13:01:29.824 14840 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:01:29 ctl02 nova-api[14840]: 2017-09-28 13:01:29.824 14840 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:01:29 ctl02 nova-api[14840]: 2017-09-28 13:01:29.824 14840 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:01:29 ctl02 nova-api[14840]: 2017-09-28 13:01:29.824 14840 ERROR nova     max_url_len=max_url_len)
Sep 28 13:01:29 ctl02 nova-api[14840]: 2017-09-28 13:01:29.824 14840 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:01:29 ctl02 nova-api[14840]: 2017-09-28 13:01:29.824 14840 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:01:29 ctl02 nova-api[14840]: 2017-09-28 13:01:29.824 14840 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:01:29 ctl02 nova-api[14840]: 2017-09-28 13:01:29.824 14840 ERROR nova     sock.listen(backlog)
Sep 28 13:01:29 ctl02 nova-api[14840]: 2017-09-28 13:01:29.824 14840 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:01:29 ctl02 nova-api[14840]: 2017-09-28 13:01:29.824 14840 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:01:29 ctl02 nova-api[14840]: 2017-09-28 13:01:29.824 14840 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:01:29 ctl02 nova-api[14840]: 2017-09-28 13:01:29.824 14840 ERROR nova
Sep 28 13:01:29 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x45653437)
Sep 28 13:01:29 ctl02 heat-api[13008]: 2017-09-28 13:01:29.853 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:01:29] "OPTIONS / HTTP/1.0" 200 134 0.000715
Sep 28 13:01:29 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:01:29 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:01:29 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:01:30 ctl02 heat-api-cfn[13300]: 2017-09-28 13:01:30.058 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:01:30] "OPTIONS / HTTP/1.0" 200 134 0.000614
Sep 28 13:01:30 ctl02 neutron-server[30536]: 2017-09-28 13:01:30.070 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:30 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:30 ctl02 neutron-server[30536]: 2017-09-28 13:01:30.071 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:30 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:30 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:30 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:30 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:30 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:01:30 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:01:30 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:01:30 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:01:30 ctl02 neutron-server[30536]: 2017-09-28 13:01:30.324 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:30 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:30 ctl02 neutron-server[30536]: 2017-09-28 13:01:30.325 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:30 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:30 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:30 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:30 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:30 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:01:30.331 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:01:30] "OPTIONS / HTTP/1.0" 200 134 0.000415
Sep 28 13:01:30 ctl02 neutron-server[30536]: 2017-09-28 13:01:30.578 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:30 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:30 ctl02 neutron-server[30536]: 2017-09-28 13:01:30.578 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:30 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:30 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:30 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:30 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:30 ctl02 neutron-server[30536]: 2017-09-28 13:01:30.832 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:30 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:30 ctl02 neutron-server[30536]: 2017-09-28 13:01:30.832 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:30 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:30 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:30 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:30 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:30 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 13:01:30 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 13:01:30 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 13:01:30 ctl02 ntp[14913]:  * Stopping NTP server ntpd
Sep 28 13:01:30 ctl02 ntp[14913]:    ...done.
Sep 28 13:01:30 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 13:01:30 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 13:01:30 ctl02 ntp[14924]:  * Starting NTP server ntpd
Sep 28 13:01:30 ctl02 ntpd[14931]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 13:01:30 ctl02 ntpd[14931]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 13:01:30 ctl02 ntp[14924]:    ...done.
Sep 28 13:01:30 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 13:01:30 ctl02 ntpd[14934]: proto: precision = 0.042 usec (-24)
Sep 28 13:01:30 ctl02 ntpd[14934]: switching logging to file /var/log/ntp.log
Sep 28 13:01:31 ctl02 neutron-server[30536]: 2017-09-28 13:01:31.085 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:31 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:31 ctl02 neutron-server[30536]: 2017-09-28 13:01:31.085 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:31 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:31 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:31 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:31 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:31 ctl02 neutron-server[30536]: 2017-09-28 13:01:31.339 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:31 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:31 ctl02 neutron-server[30536]: 2017-09-28 13:01:31.339 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:31 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:31 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:31 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:31 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:31 ctl02 neutron-server[30536]: 2017-09-28 13:01:31.529 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:01:31] "OPTIONS / HTTP/1.0" 200 262 0.000470
Sep 28 13:01:31 ctl02 neutron-server[30536]: 2017-09-28 13:01:31.593 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:31 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:31 ctl02 neutron-server[30536]: 2017-09-28 13:01:31.593 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:31 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:31 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:31 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:31 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:31 ctl02 glance-api[29183]: 2017-09-28 13:01:31.820 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:01:31] "OPTIONS / HTTP/1.0" 200 134 0.000846
Sep 28 13:01:31 ctl02 nova-api[14858]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:01:31 ctl02 nova-api[14858]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:01:31 ctl02 neutron-server[30536]: 2017-09-28 13:01:31.846 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:31 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:31 ctl02 neutron-server[30536]: 2017-09-28 13:01:31.847 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:31 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:31 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:31 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:31 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:32 ctl02 nova-api[14858]: 2017-09-28 13:01:32.022 14858 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:01:32 ctl02 nova-api[14858]: 2017-09-28 13:01:32.024 14858 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:01:32 ctl02 nova-api[14858]: 2017-09-28 13:01:32.024 14858 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:01:32 ctl02 nova-api[14858]: 2017-09-28 13:01:32.024 14858 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:01:32 ctl02 nova-api[14858]: 2017-09-28 13:01:32.024 14858 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:01:32 ctl02 nova-api[14858]: 2017-09-28 13:01:32.024 14858 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:01:32 ctl02 nova-api[14858]: 2017-09-28 13:01:32.024 14858 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:01:32 ctl02 nova-api[14858]: 2017-09-28 13:01:32.024 14858 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:01:32 ctl02 nova-api[14858]: 2017-09-28 13:01:32.024 14858 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:01:32 ctl02 nova-api[14858]: 2017-09-28 13:01:32.024 14858 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:01:32 ctl02 nova-api[14858]: 2017-09-28 13:01:32.024 14858 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:01:32 ctl02 nova-api[14858]: 2017-09-28 13:01:32.024 14858 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:01:32 ctl02 nova-api[14858]: 2017-09-28 13:01:32.024 14858 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:01:32 ctl02 nova-api[14858]: 2017-09-28 13:01:32.024 14858 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:01:32 ctl02 nova-api[14858]: 2017-09-28 13:01:32.024 14858 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:01:32 ctl02 nova-api[14858]: 2017-09-28 13:01:32.024 14858 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:01:32 ctl02 nova-api[14858]: 2017-09-28 13:01:32.024 14858 ERROR nova.wsgi     self.filename))
Sep 28 13:01:32 ctl02 nova-api[14858]: 2017-09-28 13:01:32.024 14858 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:01:32 ctl02 nova-api[14858]: 2017-09-28 13:01:32.024 14858 ERROR nova.wsgi
Sep 28 13:01:32 ctl02 nova-api[14858]: 2017-09-28 13:01:32.026 14858 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:01:32 ctl02 neutron-server[30536]: 2017-09-28 13:01:32.100 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:32 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:32 ctl02 neutron-server[30536]: 2017-09-28 13:01:32.101 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:32 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:32 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:32 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:32 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:32 ctl02 nova-api[14858]: 2017-09-28 13:01:32.160 14858 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:01:32 ctl02 neutron-server[30536]: 2017-09-28 13:01:32.354 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:32 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:32 ctl02 neutron-server[30536]: 2017-09-28 13:01:32.355 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:32 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:32 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:32 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:32 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:32 ctl02 nova-api[14858]: 2017-09-28 13:01:32.404 14858 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:01:32 ctl02 nova-api[14858]: 2017-09-28 13:01:32.406 14858 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:01:32 ctl02 nova-api[14858]: 2017-09-28 13:01:32.406 14858 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:01:32 ctl02 nova-api[14858]: 2017-09-28 13:01:32.406 14858 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:01:32 ctl02 nova-api[14858]: 2017-09-28 13:01:32.538 14858 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:01:32 ctl02 nova-api[14858]: 2017-09-28 13:01:32.539 14858 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:01:32 ctl02 nova-api[14858]: 2017-09-28 13:01:32.540 14858 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:01:32 ctl02 nova-api[14858]: 2017-09-28 13:01:32.540 14858 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:01:32 ctl02 nova-api[14858]: 2017-09-28 13:01:32.543 14858 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:01:32 ctl02 nova-api[14858]: 2017-09-28 13:01:32.543 14858 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:01:32 ctl02 nova-api[14858]: 2017-09-28 13:01:32.543 14858 ERROR nova Traceback (most recent call last):
Sep 28 13:01:32 ctl02 nova-api[14858]: 2017-09-28 13:01:32.543 14858 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:01:32 ctl02 nova-api[14858]: 2017-09-28 13:01:32.543 14858 ERROR nova     sys.exit(main())
Sep 28 13:01:32 ctl02 nova-api[14858]: 2017-09-28 13:01:32.543 14858 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:01:32 ctl02 nova-api[14858]: 2017-09-28 13:01:32.543 14858 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:01:32 ctl02 nova-api[14858]: 2017-09-28 13:01:32.543 14858 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:01:32 ctl02 nova-api[14858]: 2017-09-28 13:01:32.543 14858 ERROR nova     max_url_len=max_url_len)
Sep 28 13:01:32 ctl02 nova-api[14858]: 2017-09-28 13:01:32.543 14858 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:01:32 ctl02 nova-api[14858]: 2017-09-28 13:01:32.543 14858 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:01:32 ctl02 nova-api[14858]: 2017-09-28 13:01:32.543 14858 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:01:32 ctl02 nova-api[14858]: 2017-09-28 13:01:32.543 14858 ERROR nova     sock.listen(backlog)
Sep 28 13:01:32 ctl02 nova-api[14858]: 2017-09-28 13:01:32.543 14858 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:01:32 ctl02 nova-api[14858]: 2017-09-28 13:01:32.543 14858 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:01:32 ctl02 nova-api[14858]: 2017-09-28 13:01:32.543 14858 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:01:32 ctl02 nova-api[14858]: 2017-09-28 13:01:32.543 14858 ERROR nova
Sep 28 13:01:32 ctl02 neutron-server[30536]: 2017-09-28 13:01:32.608 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:32 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:32 ctl02 neutron-server[30536]: 2017-09-28 13:01:32.608 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:32 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:32 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:32 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:32 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:32 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:01:32 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:01:32 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:01:32 ctl02 neutron-server[30536]: 2017-09-28 13:01:32.861 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:32 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:32 ctl02 neutron-server[30536]: 2017-09-28 13:01:32.862 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:32 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:32 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:32 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:32 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:32 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:01:32 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:01:32 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:01:32 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:01:33 ctl02 neutron-server[30536]: 2017-09-28 13:01:33.115 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:33 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:33 ctl02 neutron-server[30536]: 2017-09-28 13:01:33.115 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:33 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:33 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:33 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:33 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:33 ctl02 glance-api[29183]: 2017-09-28 13:01:33.314 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:01:33] "OPTIONS / HTTP/1.0" 200 134 0.000593
Sep 28 13:01:33 ctl02 neutron-server[30536]: 2017-09-28 13:01:33.368 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:33 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:33 ctl02 neutron-server[30536]: 2017-09-28 13:01:33.368 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:33 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:33 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:33 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:33 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:33 ctl02 neutron-server[30536]: 2017-09-28 13:01:33.621 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:33 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:33 ctl02 neutron-server[30536]: 2017-09-28 13:01:33.622 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:33 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:33 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:33 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:33 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:33 ctl02 neutron-server[30536]: 2017-09-28 13:01:33.874 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:33 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:33 ctl02 neutron-server[30536]: 2017-09-28 13:01:33.875 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:33 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:33 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:33 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:33 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:33 ctl02 heat-api[13008]: 2017-09-28 13:01:33.953 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:01:33] "OPTIONS / HTTP/1.0" 200 134 0.000630
Sep 28 13:01:34 ctl02 neutron-server[30536]: 2017-09-28 13:01:34.127 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:34 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:34 ctl02 neutron-server[30536]: 2017-09-28 13:01:34.128 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:34 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:34 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:34 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:34 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:34 ctl02 neutron-server[30536]: 2017-09-28 13:01:34.382 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:34 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:34 ctl02 neutron-server[30536]: 2017-09-28 13:01:34.384 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:34 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:34 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:34 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:34 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:34 ctl02 nova-api[14947]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:01:34 ctl02 nova-api[14947]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:01:34 ctl02 neutron-server[30536]: 2017-09-28 13:01:34.638 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:34 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:34 ctl02 neutron-server[30536]: 2017-09-28 13:01:34.639 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:34 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:34 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:34 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:34 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:34 ctl02 nova-api[14947]: 2017-09-28 13:01:34.760 14947 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:01:34 ctl02 nova-api[14947]: 2017-09-28 13:01:34.762 14947 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:01:34 ctl02 nova-api[14947]: 2017-09-28 13:01:34.762 14947 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:01:34 ctl02 nova-api[14947]: 2017-09-28 13:01:34.762 14947 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:01:34 ctl02 nova-api[14947]: 2017-09-28 13:01:34.762 14947 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:01:34 ctl02 nova-api[14947]: 2017-09-28 13:01:34.762 14947 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:01:34 ctl02 nova-api[14947]: 2017-09-28 13:01:34.762 14947 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:01:34 ctl02 nova-api[14947]: 2017-09-28 13:01:34.762 14947 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:01:34 ctl02 nova-api[14947]: 2017-09-28 13:01:34.762 14947 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:01:34 ctl02 nova-api[14947]: 2017-09-28 13:01:34.762 14947 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:01:34 ctl02 nova-api[14947]: 2017-09-28 13:01:34.762 14947 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:01:34 ctl02 nova-api[14947]: 2017-09-28 13:01:34.762 14947 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:01:34 ctl02 nova-api[14947]: 2017-09-28 13:01:34.762 14947 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:01:34 ctl02 nova-api[14947]: 2017-09-28 13:01:34.762 14947 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:01:34 ctl02 nova-api[14947]: 2017-09-28 13:01:34.762 14947 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:01:34 ctl02 nova-api[14947]: 2017-09-28 13:01:34.762 14947 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:01:34 ctl02 nova-api[14947]: 2017-09-28 13:01:34.762 14947 ERROR nova.wsgi     self.filename))
Sep 28 13:01:34 ctl02 nova-api[14947]: 2017-09-28 13:01:34.762 14947 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:01:34 ctl02 nova-api[14947]: 2017-09-28 13:01:34.762 14947 ERROR nova.wsgi
Sep 28 13:01:34 ctl02 nova-api[14947]: 2017-09-28 13:01:34.763 14947 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:01:34 ctl02 heat-api-cfn[13300]: 2017-09-28 13:01:34.798 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:01:34] "OPTIONS / HTTP/1.0" 200 134 0.000470
Sep 28 13:01:34 ctl02 neutron-server[30536]: 2017-09-28 13:01:34.866 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:01:34] "OPTIONS / HTTP/1.0" 200 262 0.000541
Sep 28 13:01:34 ctl02 neutron-server[30536]: 2017-09-28 13:01:34.893 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:34 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:34 ctl02 neutron-server[30536]: 2017-09-28 13:01:34.895 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:34 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:34 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:34 ctl02 nova-api[14947]: 2017-09-28 13:01:34.895 14947 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:01:34 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:34 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:35 ctl02 nova-api[14947]: 2017-09-28 13:01:35.147 14947 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:01:35 ctl02 nova-api[14947]: 2017-09-28 13:01:35.150 14947 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:01:35 ctl02 nova-api[14947]: 2017-09-28 13:01:35.150 14947 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:01:35 ctl02 neutron-server[30536]: 2017-09-28 13:01:35.150 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:35 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:35 ctl02 nova-api[14947]: 2017-09-28 13:01:35.150 14947 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:01:35 ctl02 neutron-server[30536]: 2017-09-28 13:01:35.151 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:35 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:35 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:35 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:35 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:35 ctl02 nova-api[14947]: 2017-09-28 13:01:35.287 14947 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:01:35 ctl02 nova-api[14947]: 2017-09-28 13:01:35.289 14947 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:01:35 ctl02 nova-api[14947]: 2017-09-28 13:01:35.289 14947 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:01:35 ctl02 nova-api[14947]: 2017-09-28 13:01:35.290 14947 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:01:35 ctl02 nova-api[14947]: 2017-09-28 13:01:35.293 14947 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:01:35 ctl02 nova-api[14947]: 2017-09-28 13:01:35.293 14947 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:01:35 ctl02 nova-api[14947]: 2017-09-28 13:01:35.293 14947 ERROR nova Traceback (most recent call last):
Sep 28 13:01:35 ctl02 nova-api[14947]: 2017-09-28 13:01:35.293 14947 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:01:35 ctl02 nova-api[14947]: 2017-09-28 13:01:35.293 14947 ERROR nova     sys.exit(main())
Sep 28 13:01:35 ctl02 nova-api[14947]: 2017-09-28 13:01:35.293 14947 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:01:35 ctl02 nova-api[14947]: 2017-09-28 13:01:35.293 14947 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:01:35 ctl02 nova-api[14947]: 2017-09-28 13:01:35.293 14947 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:01:35 ctl02 nova-api[14947]: 2017-09-28 13:01:35.293 14947 ERROR nova     max_url_len=max_url_len)
Sep 28 13:01:35 ctl02 nova-api[14947]: 2017-09-28 13:01:35.293 14947 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:01:35 ctl02 nova-api[14947]: 2017-09-28 13:01:35.293 14947 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:01:35 ctl02 nova-api[14947]: 2017-09-28 13:01:35.293 14947 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:01:35 ctl02 nova-api[14947]: 2017-09-28 13:01:35.293 14947 ERROR nova     sock.listen(backlog)
Sep 28 13:01:35 ctl02 nova-api[14947]: 2017-09-28 13:01:35.293 14947 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:01:35 ctl02 nova-api[14947]: 2017-09-28 13:01:35.293 14947 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:01:35 ctl02 nova-api[14947]: 2017-09-28 13:01:35.293 14947 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:01:35 ctl02 nova-api[14947]: 2017-09-28 13:01:35.293 14947 ERROR nova
Sep 28 13:01:35 ctl02 neutron-server[30536]: 2017-09-28 13:01:35.405 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:35 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:35 ctl02 neutron-server[30536]: 2017-09-28 13:01:35.407 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:35 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:35 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:35 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:35 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:35 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:01:35 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:01:35 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:01:35 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:01:35 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:01:35 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:01:35 ctl02 heat-api-cfn[13300]: 2017-09-28 13:01:35.653 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:01:35] "OPTIONS / HTTP/1.0" 200 134 0.000789
Sep 28 13:01:35 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:01:35 ctl02 neutron-server[30536]: 2017-09-28 13:01:35.661 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:35 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:35 ctl02 neutron-server[30536]: 2017-09-28 13:01:35.661 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:35 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:35 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:35 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:35 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:35 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:01:35.702 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:01:35] "OPTIONS / HTTP/1.0" 200 134 0.000481
Sep 28 13:01:35 ctl02 neutron-server[30536]: 2017-09-28 13:01:35.916 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:35 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:35 ctl02 neutron-server[30536]: 2017-09-28 13:01:35.918 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:35 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:35 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:35 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:35 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:36 ctl02 neutron-server[30536]: 2017-09-28 13:01:36.036 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 13:01:36 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 13:01:36 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 13:01:06 cmp002
Sep 28 13:01:36 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 13:00:58 cmp001
Sep 28 13:01:36 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 13:00:10 cmp002
Sep 28 13:01:36 ctl02 neutron-server[30536]: 2017-09-28 13:01:36.173 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:36 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:36 ctl02 neutron-server[30536]: 2017-09-28 13:01:36.174 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:36 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:36 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:36 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:36 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:36 ctl02 neutron-server[30536]: 2017-09-28 13:01:36.429 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:36 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:36 ctl02 neutron-server[30536]: 2017-09-28 13:01:36.430 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:36 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:36 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:36 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:36 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:36 ctl02 neutron-server[30536]: 2017-09-28 13:01:36.684 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:36 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:36 ctl02 neutron-server[30536]: 2017-09-28 13:01:36.686 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:36 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:36 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:36 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:36 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:36 ctl02 neutron-server[30536]: 2017-09-28 13:01:36.940 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:36 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:36 ctl02 neutron-server[30536]: 2017-09-28 13:01:36.941 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:36 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:36 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:36 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:36 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:37 ctl02 neutron-server[30536]: 2017-09-28 13:01:37.196 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:01:37 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:01:37 ctl02 neutron-server[30536]: 2017-09-28 13:01:37.197 30598 ERROR oslo_messaging._drivers.common [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:01:37 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:01:37 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:01:37 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:01:37 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:01:37 ctl02 neutron-server[30536]: 2017-09-28 13:01:37.201 30598 WARNING oslo_messaging._drivers.amqpdriver [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] reply_01ed9623b6f1416cb0b0d6e759ffbaf3 doesn't exists, drop reply to fc804780c98246499b187ed12356fc65
Sep 28 13:01:37 ctl02 neutron-server[30536]: 2017-09-28 13:01:37.202 30598 INFO oslo_messaging._drivers.amqpdriver [req-5dc6342b-4a7e-4a52-bd80-cfa680da4905 - - - - -] The reply fc804780c98246499b187ed12356fc65 cannot be sent  reply_01ed9623b6f1416cb0b0d6e759ffbaf3 reply queue don't exist after 60 sec abandoning...
Sep 28 13:01:37 ctl02 nova-api[14964]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:01:37 ctl02 nova-api[14964]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:01:37 ctl02 neutron-server[30536]: 2017-09-28 13:01:37.480 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:01:37] "OPTIONS / HTTP/1.0" 200 262 0.000559
Sep 28 13:01:37 ctl02 nova-api[14964]: 2017-09-28 13:01:37.542 14964 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:01:37 ctl02 nova-api[14964]: 2017-09-28 13:01:37.543 14964 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:01:37 ctl02 nova-api[14964]: 2017-09-28 13:01:37.543 14964 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:01:37 ctl02 nova-api[14964]: 2017-09-28 13:01:37.543 14964 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:01:37 ctl02 nova-api[14964]: 2017-09-28 13:01:37.543 14964 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:01:37 ctl02 nova-api[14964]: 2017-09-28 13:01:37.543 14964 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:01:37 ctl02 nova-api[14964]: 2017-09-28 13:01:37.543 14964 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:01:37 ctl02 nova-api[14964]: 2017-09-28 13:01:37.543 14964 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:01:37 ctl02 nova-api[14964]: 2017-09-28 13:01:37.543 14964 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:01:37 ctl02 nova-api[14964]: 2017-09-28 13:01:37.543 14964 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:01:37 ctl02 nova-api[14964]: 2017-09-28 13:01:37.543 14964 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:01:37 ctl02 nova-api[14964]: 2017-09-28 13:01:37.543 14964 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:01:37 ctl02 nova-api[14964]: 2017-09-28 13:01:37.543 14964 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:01:37 ctl02 nova-api[14964]: 2017-09-28 13:01:37.543 14964 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:01:37 ctl02 nova-api[14964]: 2017-09-28 13:01:37.543 14964 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:01:37 ctl02 nova-api[14964]: 2017-09-28 13:01:37.543 14964 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:01:37 ctl02 nova-api[14964]: 2017-09-28 13:01:37.543 14964 ERROR nova.wsgi     self.filename))
Sep 28 13:01:37 ctl02 nova-api[14964]: 2017-09-28 13:01:37.543 14964 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:01:37 ctl02 nova-api[14964]: 2017-09-28 13:01:37.543 14964 ERROR nova.wsgi
Sep 28 13:01:37 ctl02 nova-api[14964]: 2017-09-28 13:01:37.544 14964 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:01:37 ctl02 heat-api[13008]: 2017-09-28 13:01:37.583 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:01:37] "OPTIONS / HTTP/1.0" 200 134 0.000632
Sep 28 13:01:37 ctl02 nova-api[14964]: 2017-09-28 13:01:37.679 14964 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:01:37 ctl02 nova-consoleauth[5433]: 2017-09-28 13:01:37.766 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:01:37 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:01:37.850 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:01:37] "OPTIONS / HTTP/1.0" 200 134 0.000439
Sep 28 13:01:37 ctl02 nova-api[14964]: 2017-09-28 13:01:37.928 14964 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:01:37 ctl02 nova-api[14964]: 2017-09-28 13:01:37.931 14964 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:01:37 ctl02 nova-api[14964]: 2017-09-28 13:01:37.932 14964 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:01:37 ctl02 nova-api[14964]: 2017-09-28 13:01:37.932 14964 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:01:38 ctl02 nova-api[14964]: 2017-09-28 13:01:38.067 14964 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:01:38 ctl02 nova-api[14964]: 2017-09-28 13:01:38.070 14964 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:01:38 ctl02 nova-api[14964]: 2017-09-28 13:01:38.070 14964 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:01:38 ctl02 nova-api[14964]: 2017-09-28 13:01:38.071 14964 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:01:38 ctl02 nova-api[14964]: 2017-09-28 13:01:38.074 14964 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:01:38 ctl02 nova-api[14964]: 2017-09-28 13:01:38.075 14964 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:01:38 ctl02 nova-api[14964]: 2017-09-28 13:01:38.075 14964 ERROR nova Traceback (most recent call last):
Sep 28 13:01:38 ctl02 nova-api[14964]: 2017-09-28 13:01:38.075 14964 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:01:38 ctl02 nova-api[14964]: 2017-09-28 13:01:38.075 14964 ERROR nova     sys.exit(main())
Sep 28 13:01:38 ctl02 nova-api[14964]: 2017-09-28 13:01:38.075 14964 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:01:38 ctl02 nova-api[14964]: 2017-09-28 13:01:38.075 14964 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:01:38 ctl02 nova-api[14964]: 2017-09-28 13:01:38.075 14964 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:01:38 ctl02 nova-api[14964]: 2017-09-28 13:01:38.075 14964 ERROR nova     max_url_len=max_url_len)
Sep 28 13:01:38 ctl02 nova-api[14964]: 2017-09-28 13:01:38.075 14964 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:01:38 ctl02 nova-api[14964]: 2017-09-28 13:01:38.075 14964 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:01:38 ctl02 nova-api[14964]: 2017-09-28 13:01:38.075 14964 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:01:38 ctl02 nova-api[14964]: 2017-09-28 13:01:38.075 14964 ERROR nova     sock.listen(backlog)
Sep 28 13:01:38 ctl02 nova-api[14964]: 2017-09-28 13:01:38.075 14964 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:01:38 ctl02 nova-api[14964]: 2017-09-28 13:01:38.075 14964 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:01:38 ctl02 nova-api[14964]: 2017-09-28 13:01:38.075 14964 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:01:38 ctl02 nova-api[14964]: 2017-09-28 13:01:38.075 14964 ERROR nova
Sep 28 13:01:38 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:01:38 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:01:38 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:01:38 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:01:38 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:01:38 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:01:38 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:01:38 ctl02 heat-engine[12803]: 2017-09-28 13:01:38.405 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:01:38 ctl02 heat-engine[12803]: 2017-09-28 13:01:38.423 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:01:38 ctl02 heat-engine[12803]: 2017-09-28 13:01:38.431 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:01:38 ctl02 heat-engine[12803]: 2017-09-28 13:01:38.433 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:01:38 ctl02 glance-api[29183]: 2017-09-28 13:01:38.952 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:01:38] "OPTIONS / HTTP/1.0" 200 134 0.000760
Sep 28 13:01:39 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfafb495b)
Sep 28 13:01:39 ctl02 heat-api-cfn[13300]: 2017-09-28 13:01:39.887 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:01:39] "OPTIONS / HTTP/1.0" 200 134 0.000539
Sep 28 13:01:39 ctl02 heat-api[13008]: 2017-09-28 13:01:39.928 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:01:39] "OPTIONS / HTTP/1.0" 200 134 0.000555
Sep 28 13:01:40 ctl02 nova-api[14986]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:01:40 ctl02 nova-api[14986]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:01:40 ctl02 nova-api[14986]: 2017-09-28 13:01:40.244 14986 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:01:40 ctl02 nova-api[14986]: 2017-09-28 13:01:40.246 14986 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:01:40 ctl02 nova-api[14986]: 2017-09-28 13:01:40.246 14986 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:01:40 ctl02 nova-api[14986]: 2017-09-28 13:01:40.246 14986 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:01:40 ctl02 nova-api[14986]: 2017-09-28 13:01:40.246 14986 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:01:40 ctl02 nova-api[14986]: 2017-09-28 13:01:40.246 14986 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:01:40 ctl02 nova-api[14986]: 2017-09-28 13:01:40.246 14986 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:01:40 ctl02 nova-api[14986]: 2017-09-28 13:01:40.246 14986 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:01:40 ctl02 nova-api[14986]: 2017-09-28 13:01:40.246 14986 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:01:40 ctl02 nova-api[14986]: 2017-09-28 13:01:40.246 14986 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:01:40 ctl02 nova-api[14986]: 2017-09-28 13:01:40.246 14986 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:01:40 ctl02 nova-api[14986]: 2017-09-28 13:01:40.246 14986 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:01:40 ctl02 nova-api[14986]: 2017-09-28 13:01:40.246 14986 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:01:40 ctl02 nova-api[14986]: 2017-09-28 13:01:40.246 14986 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:01:40 ctl02 nova-api[14986]: 2017-09-28 13:01:40.246 14986 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:01:40 ctl02 nova-api[14986]: 2017-09-28 13:01:40.246 14986 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:01:40 ctl02 nova-api[14986]: 2017-09-28 13:01:40.246 14986 ERROR nova.wsgi     self.filename))
Sep 28 13:01:40 ctl02 nova-api[14986]: 2017-09-28 13:01:40.246 14986 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:01:40 ctl02 nova-api[14986]: 2017-09-28 13:01:40.246 14986 ERROR nova.wsgi
Sep 28 13:01:40 ctl02 nova-api[14986]: 2017-09-28 13:01:40.247 14986 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:01:40 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:01:40.354 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:01:40] "OPTIONS / HTTP/1.0" 200 134 0.000388
Sep 28 13:01:40 ctl02 nova-api[14986]: 2017-09-28 13:01:40.378 14986 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:01:40 ctl02 nova-api[14986]: 2017-09-28 13:01:40.602 14986 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:01:40 ctl02 nova-api[14986]: 2017-09-28 13:01:40.605 14986 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:01:40 ctl02 nova-api[14986]: 2017-09-28 13:01:40.605 14986 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:01:40 ctl02 nova-api[14986]: 2017-09-28 13:01:40.605 14986 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:01:40 ctl02 nova-api[14986]: 2017-09-28 13:01:40.738 14986 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:01:40 ctl02 nova-api[14986]: 2017-09-28 13:01:40.740 14986 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:01:40 ctl02 nova-api[14986]: 2017-09-28 13:01:40.740 14986 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:01:40 ctl02 nova-api[14986]: 2017-09-28 13:01:40.740 14986 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:01:40 ctl02 nova-api[14986]: 2017-09-28 13:01:40.743 14986 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:01:40 ctl02 nova-api[14986]: 2017-09-28 13:01:40.744 14986 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:01:40 ctl02 nova-api[14986]: 2017-09-28 13:01:40.744 14986 ERROR nova Traceback (most recent call last):
Sep 28 13:01:40 ctl02 nova-api[14986]: 2017-09-28 13:01:40.744 14986 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:01:40 ctl02 nova-api[14986]: 2017-09-28 13:01:40.744 14986 ERROR nova     sys.exit(main())
Sep 28 13:01:40 ctl02 nova-api[14986]: 2017-09-28 13:01:40.744 14986 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:01:40 ctl02 nova-api[14986]: 2017-09-28 13:01:40.744 14986 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:01:40 ctl02 nova-api[14986]: 2017-09-28 13:01:40.744 14986 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:01:40 ctl02 nova-api[14986]: 2017-09-28 13:01:40.744 14986 ERROR nova     max_url_len=max_url_len)
Sep 28 13:01:40 ctl02 nova-api[14986]: 2017-09-28 13:01:40.744 14986 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:01:40 ctl02 nova-api[14986]: 2017-09-28 13:01:40.744 14986 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:01:40 ctl02 nova-api[14986]: 2017-09-28 13:01:40.744 14986 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:01:40 ctl02 nova-api[14986]: 2017-09-28 13:01:40.744 14986 ERROR nova     sock.listen(backlog)
Sep 28 13:01:40 ctl02 nova-api[14986]: 2017-09-28 13:01:40.744 14986 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:01:40 ctl02 nova-api[14986]: 2017-09-28 13:01:40.744 14986 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:01:40 ctl02 nova-api[14986]: 2017-09-28 13:01:40.744 14986 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:01:40 ctl02 nova-api[14986]: 2017-09-28 13:01:40.744 14986 ERROR nova
Sep 28 13:01:40 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfafb495b)
Sep 28 13:01:40 ctl02 nova-scheduler[5620]: 2017-09-28 13:01:40.872 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:01:40 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:01:40 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:01:40 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:01:41 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:01:41 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:01:41 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:01:41 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:01:41 ctl02 neutron-server[30536]: 2017-09-28 13:01:41.676 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:01:41] "OPTIONS / HTTP/1.0" 200 262 0.000533
Sep 28 13:01:41 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfafb495b)
Sep 28 13:01:41 ctl02 glance-api[29183]: 2017-09-28 13:01:41.867 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:01:41] "OPTIONS / HTTP/1.0" 200 134 0.000603
Sep 28 13:01:42 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfafb495b)
Sep 28 13:01:42 ctl02 nova-api[15005]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:01:42 ctl02 nova-api[15005]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:01:43 ctl02 glance-api[29183]: 2017-09-28 13:01:43.013 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:01:43] "OPTIONS / HTTP/1.0" 200 134 0.000612
Sep 28 13:01:43 ctl02 nova-api[15005]: 2017-09-28 13:01:43.020 15005 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:01:43 ctl02 nova-api[15005]: 2017-09-28 13:01:43.021 15005 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:01:43 ctl02 nova-api[15005]: 2017-09-28 13:01:43.021 15005 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:01:43 ctl02 nova-api[15005]: 2017-09-28 13:01:43.021 15005 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:01:43 ctl02 nova-api[15005]: 2017-09-28 13:01:43.021 15005 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:01:43 ctl02 nova-api[15005]: 2017-09-28 13:01:43.021 15005 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:01:43 ctl02 nova-api[15005]: 2017-09-28 13:01:43.021 15005 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:01:43 ctl02 nova-api[15005]: 2017-09-28 13:01:43.021 15005 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:01:43 ctl02 nova-api[15005]: 2017-09-28 13:01:43.021 15005 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:01:43 ctl02 nova-api[15005]: 2017-09-28 13:01:43.021 15005 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:01:43 ctl02 nova-api[15005]: 2017-09-28 13:01:43.021 15005 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:01:43 ctl02 nova-api[15005]: 2017-09-28 13:01:43.021 15005 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:01:43 ctl02 nova-api[15005]: 2017-09-28 13:01:43.021 15005 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:01:43 ctl02 nova-api[15005]: 2017-09-28 13:01:43.021 15005 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:01:43 ctl02 nova-api[15005]: 2017-09-28 13:01:43.021 15005 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:01:43 ctl02 nova-api[15005]: 2017-09-28 13:01:43.021 15005 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:01:43 ctl02 nova-api[15005]: 2017-09-28 13:01:43.021 15005 ERROR nova.wsgi     self.filename))
Sep 28 13:01:43 ctl02 nova-api[15005]: 2017-09-28 13:01:43.021 15005 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:01:43 ctl02 nova-api[15005]: 2017-09-28 13:01:43.021 15005 ERROR nova.wsgi
Sep 28 13:01:43 ctl02 nova-api[15005]: 2017-09-28 13:01:43.022 15005 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:01:43 ctl02 nova-api[15005]: 2017-09-28 13:01:43.152 15005 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:01:43 ctl02 nova-api[15005]: 2017-09-28 13:01:43.379 15005 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:01:43 ctl02 nova-api[15005]: 2017-09-28 13:01:43.382 15005 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:01:43 ctl02 nova-api[15005]: 2017-09-28 13:01:43.382 15005 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:01:43 ctl02 nova-api[15005]: 2017-09-28 13:01:43.382 15005 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:01:43 ctl02 nova-api[15005]: 2017-09-28 13:01:43.515 15005 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:01:43 ctl02 nova-api[15005]: 2017-09-28 13:01:43.517 15005 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:01:43 ctl02 nova-api[15005]: 2017-09-28 13:01:43.517 15005 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:01:43 ctl02 nova-api[15005]: 2017-09-28 13:01:43.517 15005 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:01:43 ctl02 nova-api[15005]: 2017-09-28 13:01:43.521 15005 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:01:43 ctl02 nova-api[15005]: 2017-09-28 13:01:43.521 15005 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:01:43 ctl02 nova-api[15005]: 2017-09-28 13:01:43.521 15005 ERROR nova Traceback (most recent call last):
Sep 28 13:01:43 ctl02 nova-api[15005]: 2017-09-28 13:01:43.521 15005 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:01:43 ctl02 nova-api[15005]: 2017-09-28 13:01:43.521 15005 ERROR nova     sys.exit(main())
Sep 28 13:01:43 ctl02 nova-api[15005]: 2017-09-28 13:01:43.521 15005 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:01:43 ctl02 nova-api[15005]: 2017-09-28 13:01:43.521 15005 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:01:43 ctl02 nova-api[15005]: 2017-09-28 13:01:43.521 15005 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:01:43 ctl02 nova-api[15005]: 2017-09-28 13:01:43.521 15005 ERROR nova     max_url_len=max_url_len)
Sep 28 13:01:43 ctl02 nova-api[15005]: 2017-09-28 13:01:43.521 15005 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:01:43 ctl02 nova-api[15005]: 2017-09-28 13:01:43.521 15005 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:01:43 ctl02 nova-api[15005]: 2017-09-28 13:01:43.521 15005 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:01:43 ctl02 nova-api[15005]: 2017-09-28 13:01:43.521 15005 ERROR nova     sock.listen(backlog)
Sep 28 13:01:43 ctl02 nova-api[15005]: 2017-09-28 13:01:43.521 15005 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:01:43 ctl02 nova-api[15005]: 2017-09-28 13:01:43.521 15005 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:01:43 ctl02 nova-api[15005]: 2017-09-28 13:01:43.521 15005 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:01:43 ctl02 nova-api[15005]: 2017-09-28 13:01:43.521 15005 ERROR nova
Sep 28 13:01:43 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:01:43 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:01:43 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:01:43 ctl02 heat-api[13008]: 2017-09-28 13:01:43.680 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:01:43] "OPTIONS / HTTP/1.0" 200 134 0.000569
Sep 28 13:01:43 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfafb495b)
Sep 28 13:01:43 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:01:43 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:01:43 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:01:43 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:01:44 ctl02 neutron-server[30536]: 2017-09-28 13:01:44.835 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:01:44] "OPTIONS / HTTP/1.0" 200 262 0.000470
Sep 28 13:01:44 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfafb495b)
Sep 28 13:01:45 ctl02 heat-api-cfn[13300]: 2017-09-28 13:01:45.102 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:01:45] "OPTIONS / HTTP/1.0" 200 134 0.000442
Sep 28 13:01:45 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:01:45.368 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:01:45] "OPTIONS / HTTP/1.0" 200 134 0.000382
Sep 28 13:01:45 ctl02 nova-api[15024]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:01:45 ctl02 nova-api[15024]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:01:45 ctl02 nova-api[15024]: 2017-09-28 13:01:45.734 15024 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:01:45 ctl02 nova-api[15024]: 2017-09-28 13:01:45.736 15024 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:01:45 ctl02 nova-api[15024]: 2017-09-28 13:01:45.736 15024 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:01:45 ctl02 nova-api[15024]: 2017-09-28 13:01:45.736 15024 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:01:45 ctl02 nova-api[15024]: 2017-09-28 13:01:45.736 15024 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:01:45 ctl02 nova-api[15024]: 2017-09-28 13:01:45.736 15024 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:01:45 ctl02 nova-api[15024]: 2017-09-28 13:01:45.736 15024 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:01:45 ctl02 nova-api[15024]: 2017-09-28 13:01:45.736 15024 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:01:45 ctl02 nova-api[15024]: 2017-09-28 13:01:45.736 15024 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:01:45 ctl02 nova-api[15024]: 2017-09-28 13:01:45.736 15024 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:01:45 ctl02 nova-api[15024]: 2017-09-28 13:01:45.736 15024 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:01:45 ctl02 nova-api[15024]: 2017-09-28 13:01:45.736 15024 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:01:45 ctl02 nova-api[15024]: 2017-09-28 13:01:45.736 15024 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:01:45 ctl02 nova-api[15024]: 2017-09-28 13:01:45.736 15024 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:01:45 ctl02 nova-api[15024]: 2017-09-28 13:01:45.736 15024 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:01:45 ctl02 nova-api[15024]: 2017-09-28 13:01:45.736 15024 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:01:45 ctl02 nova-api[15024]: 2017-09-28 13:01:45.736 15024 ERROR nova.wsgi     self.filename))
Sep 28 13:01:45 ctl02 nova-api[15024]: 2017-09-28 13:01:45.736 15024 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:01:45 ctl02 nova-api[15024]: 2017-09-28 13:01:45.736 15024 ERROR nova.wsgi
Sep 28 13:01:45 ctl02 nova-api[15024]: 2017-09-28 13:01:45.737 15024 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:01:45 ctl02 heat-api-cfn[13300]: 2017-09-28 13:01:45.788 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:01:45] "OPTIONS / HTTP/1.0" 200 134 0.000500
Sep 28 13:01:45 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfafb495b)
Sep 28 13:01:45 ctl02 nova-api[15024]: 2017-09-28 13:01:45.863 15024 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:01:46 ctl02 nova-api[15024]: 2017-09-28 13:01:46.084 15024 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:01:46 ctl02 nova-api[15024]: 2017-09-28 13:01:46.086 15024 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:01:46 ctl02 nova-api[15024]: 2017-09-28 13:01:46.086 15024 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:01:46 ctl02 nova-api[15024]: 2017-09-28 13:01:46.087 15024 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:01:46 ctl02 nova-api[15024]: 2017-09-28 13:01:46.219 15024 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:01:46 ctl02 nova-api[15024]: 2017-09-28 13:01:46.220 15024 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:01:46 ctl02 nova-api[15024]: 2017-09-28 13:01:46.221 15024 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:01:46 ctl02 nova-api[15024]: 2017-09-28 13:01:46.221 15024 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:01:46 ctl02 nova-api[15024]: 2017-09-28 13:01:46.224 15024 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:01:46 ctl02 nova-api[15024]: 2017-09-28 13:01:46.225 15024 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:01:46 ctl02 nova-api[15024]: 2017-09-28 13:01:46.225 15024 ERROR nova Traceback (most recent call last):
Sep 28 13:01:46 ctl02 nova-api[15024]: 2017-09-28 13:01:46.225 15024 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:01:46 ctl02 nova-api[15024]: 2017-09-28 13:01:46.225 15024 ERROR nova     sys.exit(main())
Sep 28 13:01:46 ctl02 nova-api[15024]: 2017-09-28 13:01:46.225 15024 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:01:46 ctl02 nova-api[15024]: 2017-09-28 13:01:46.225 15024 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:01:46 ctl02 nova-api[15024]: 2017-09-28 13:01:46.225 15024 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:01:46 ctl02 nova-api[15024]: 2017-09-28 13:01:46.225 15024 ERROR nova     max_url_len=max_url_len)
Sep 28 13:01:46 ctl02 nova-api[15024]: 2017-09-28 13:01:46.225 15024 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:01:46 ctl02 nova-api[15024]: 2017-09-28 13:01:46.225 15024 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:01:46 ctl02 nova-api[15024]: 2017-09-28 13:01:46.225 15024 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:01:46 ctl02 nova-api[15024]: 2017-09-28 13:01:46.225 15024 ERROR nova     sock.listen(backlog)
Sep 28 13:01:46 ctl02 nova-api[15024]: 2017-09-28 13:01:46.225 15024 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:01:46 ctl02 nova-api[15024]: 2017-09-28 13:01:46.225 15024 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:01:46 ctl02 nova-api[15024]: 2017-09-28 13:01:46.225 15024 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:01:46 ctl02 nova-api[15024]: 2017-09-28 13:01:46.225 15024 ERROR nova
Sep 28 13:01:46 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:01:46 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:01:46 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:01:46 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:01:46 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:01:46 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:01:46 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:01:46 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfafb495b)
Sep 28 13:01:47 ctl02 neutron-server[30536]: 2017-09-28 13:01:47.316 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:01:47] "OPTIONS / HTTP/1.0" 200 262 0.000467
Sep 28 13:01:47 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:01:47.526 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:01:47] "OPTIONS / HTTP/1.0" 200 134 0.000380
Sep 28 13:01:47 ctl02 heat-api[13008]: 2017-09-28 13:01:47.663 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:01:47] "OPTIONS / HTTP/1.0" 200 134 0.000515
Sep 28 13:01:47 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfafb495b)
Sep 28 13:01:48 ctl02 nova-api[15043]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:01:48 ctl02 nova-api[15043]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:01:48 ctl02 nova-api[15043]: 2017-09-28 13:01:48.471 15043 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:01:48 ctl02 nova-api[15043]: 2017-09-28 13:01:48.473 15043 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:01:48 ctl02 nova-api[15043]: 2017-09-28 13:01:48.473 15043 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:01:48 ctl02 nova-api[15043]: 2017-09-28 13:01:48.473 15043 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:01:48 ctl02 nova-api[15043]: 2017-09-28 13:01:48.473 15043 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:01:48 ctl02 nova-api[15043]: 2017-09-28 13:01:48.473 15043 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:01:48 ctl02 nova-api[15043]: 2017-09-28 13:01:48.473 15043 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:01:48 ctl02 nova-api[15043]: 2017-09-28 13:01:48.473 15043 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:01:48 ctl02 nova-api[15043]: 2017-09-28 13:01:48.473 15043 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:01:48 ctl02 nova-api[15043]: 2017-09-28 13:01:48.473 15043 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:01:48 ctl02 nova-api[15043]: 2017-09-28 13:01:48.473 15043 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:01:48 ctl02 nova-api[15043]: 2017-09-28 13:01:48.473 15043 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:01:48 ctl02 nova-api[15043]: 2017-09-28 13:01:48.473 15043 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:01:48 ctl02 nova-api[15043]: 2017-09-28 13:01:48.473 15043 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:01:48 ctl02 nova-api[15043]: 2017-09-28 13:01:48.473 15043 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:01:48 ctl02 nova-api[15043]: 2017-09-28 13:01:48.473 15043 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:01:48 ctl02 nova-api[15043]: 2017-09-28 13:01:48.473 15043 ERROR nova.wsgi     self.filename))
Sep 28 13:01:48 ctl02 nova-api[15043]: 2017-09-28 13:01:48.473 15043 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:01:48 ctl02 nova-api[15043]: 2017-09-28 13:01:48.473 15043 ERROR nova.wsgi
Sep 28 13:01:48 ctl02 nova-api[15043]: 2017-09-28 13:01:48.474 15043 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:01:48 ctl02 nova-api[15043]: 2017-09-28 13:01:48.599 15043 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:01:48 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfafb495b)
Sep 28 13:01:48 ctl02 nova-api[15043]: 2017-09-28 13:01:48.858 15043 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:01:48 ctl02 nova-api[15043]: 2017-09-28 13:01:48.860 15043 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:01:48 ctl02 nova-api[15043]: 2017-09-28 13:01:48.860 15043 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:01:48 ctl02 nova-api[15043]: 2017-09-28 13:01:48.861 15043 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:01:48 ctl02 nova-api[15043]: 2017-09-28 13:01:48.994 15043 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:01:48 ctl02 nova-api[15043]: 2017-09-28 13:01:48.996 15043 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:01:48 ctl02 nova-api[15043]: 2017-09-28 13:01:48.996 15043 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:01:48 ctl02 nova-api[15043]: 2017-09-28 13:01:48.996 15043 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:01:49 ctl02 nova-api[15043]: 2017-09-28 13:01:49.000 15043 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:01:49 ctl02 nova-api[15043]: 2017-09-28 13:01:49.000 15043 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:01:49 ctl02 nova-api[15043]: 2017-09-28 13:01:49.000 15043 ERROR nova Traceback (most recent call last):
Sep 28 13:01:49 ctl02 nova-api[15043]: 2017-09-28 13:01:49.000 15043 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:01:49 ctl02 nova-api[15043]: 2017-09-28 13:01:49.000 15043 ERROR nova     sys.exit(main())
Sep 28 13:01:49 ctl02 nova-api[15043]: 2017-09-28 13:01:49.000 15043 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:01:49 ctl02 nova-api[15043]: 2017-09-28 13:01:49.000 15043 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:01:49 ctl02 nova-api[15043]: 2017-09-28 13:01:49.000 15043 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:01:49 ctl02 nova-api[15043]: 2017-09-28 13:01:49.000 15043 ERROR nova     max_url_len=max_url_len)
Sep 28 13:01:49 ctl02 nova-api[15043]: 2017-09-28 13:01:49.000 15043 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:01:49 ctl02 nova-api[15043]: 2017-09-28 13:01:49.000 15043 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:01:49 ctl02 nova-api[15043]: 2017-09-28 13:01:49.000 15043 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:01:49 ctl02 nova-api[15043]: 2017-09-28 13:01:49.000 15043 ERROR nova     sock.listen(backlog)
Sep 28 13:01:49 ctl02 nova-api[15043]: 2017-09-28 13:01:49.000 15043 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:01:49 ctl02 nova-api[15043]: 2017-09-28 13:01:49.000 15043 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:01:49 ctl02 nova-api[15043]: 2017-09-28 13:01:49.000 15043 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:01:49 ctl02 nova-api[15043]: 2017-09-28 13:01:49.000 15043 ERROR nova
Sep 28 13:01:49 ctl02 glance-api[29183]: 2017-09-28 13:01:49.034 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:01:49] "OPTIONS / HTTP/1.0" 200 134 0.000695
Sep 28 13:01:49 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:01:49 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:01:49 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:01:49 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:01:49 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:01:49 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:01:49 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:01:49 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfafb495b)
Sep 28 13:01:50 ctl02 heat-api[13008]: 2017-09-28 13:01:50.067 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:01:50] "OPTIONS / HTTP/1.0" 200 134 0.000509
Sep 28 13:01:50 ctl02 heat-api-cfn[13300]: 2017-09-28 13:01:50.225 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:01:50] "OPTIONS / HTTP/1.0" 200 134 0.000411
Sep 28 13:01:50 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:01:50.637 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:01:50] "OPTIONS / HTTP/1.0" 200 134 0.000363
Sep 28 13:01:50 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 13:01:50 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 13:01:51 ctl02 neutron-server[30536]: 2017-09-28 13:01:51.033 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 13:01:51 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 13:01:51 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 13:01:06 cmp002
Sep 28 13:01:51 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 13:00:58 cmp001
Sep 28 13:01:51 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 13:00:10 cmp002
Sep 28 13:01:51 ctl02 nova-api[15061]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:01:51 ctl02 nova-api[15061]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:01:51 ctl02 nova-api[15061]: 2017-09-28 13:01:51.222 15061 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:01:51 ctl02 nova-api[15061]: 2017-09-28 13:01:51.223 15061 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:01:51 ctl02 nova-api[15061]: 2017-09-28 13:01:51.223 15061 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:01:51 ctl02 nova-api[15061]: 2017-09-28 13:01:51.223 15061 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:01:51 ctl02 nova-api[15061]: 2017-09-28 13:01:51.223 15061 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:01:51 ctl02 nova-api[15061]: 2017-09-28 13:01:51.223 15061 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:01:51 ctl02 nova-api[15061]: 2017-09-28 13:01:51.223 15061 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:01:51 ctl02 nova-api[15061]: 2017-09-28 13:01:51.223 15061 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:01:51 ctl02 nova-api[15061]: 2017-09-28 13:01:51.223 15061 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:01:51 ctl02 nova-api[15061]: 2017-09-28 13:01:51.223 15061 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:01:51 ctl02 nova-api[15061]: 2017-09-28 13:01:51.223 15061 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:01:51 ctl02 nova-api[15061]: 2017-09-28 13:01:51.223 15061 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:01:51 ctl02 nova-api[15061]: 2017-09-28 13:01:51.223 15061 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:01:51 ctl02 nova-api[15061]: 2017-09-28 13:01:51.223 15061 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:01:51 ctl02 nova-api[15061]: 2017-09-28 13:01:51.223 15061 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:01:51 ctl02 nova-api[15061]: 2017-09-28 13:01:51.223 15061 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:01:51 ctl02 nova-api[15061]: 2017-09-28 13:01:51.223 15061 ERROR nova.wsgi     self.filename))
Sep 28 13:01:51 ctl02 nova-api[15061]: 2017-09-28 13:01:51.223 15061 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:01:51 ctl02 nova-api[15061]: 2017-09-28 13:01:51.223 15061 ERROR nova.wsgi
Sep 28 13:01:51 ctl02 nova-api[15061]: 2017-09-28 13:01:51.226 15061 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:01:51 ctl02 nova-api[15061]: 2017-09-28 13:01:51.353 15061 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:01:51 ctl02 neutron-server[30536]: 2017-09-28 13:01:51.419 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:01:51] "OPTIONS / HTTP/1.0" 200 262 0.000470
Sep 28 13:01:51 ctl02 nova-api[15061]: 2017-09-28 13:01:51.579 15061 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:01:51 ctl02 nova-api[15061]: 2017-09-28 13:01:51.582 15061 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:01:51 ctl02 nova-api[15061]: 2017-09-28 13:01:51.582 15061 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:01:51 ctl02 nova-api[15061]: 2017-09-28 13:01:51.582 15061 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:01:51 ctl02 nova-api[15061]: 2017-09-28 13:01:51.713 15061 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:01:51 ctl02 nova-api[15061]: 2017-09-28 13:01:51.715 15061 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:01:51 ctl02 nova-api[15061]: 2017-09-28 13:01:51.716 15061 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:01:51 ctl02 nova-api[15061]: 2017-09-28 13:01:51.716 15061 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:01:51 ctl02 nova-api[15061]: 2017-09-28 13:01:51.719 15061 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:01:51 ctl02 nova-api[15061]: 2017-09-28 13:01:51.720 15061 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:01:51 ctl02 nova-api[15061]: 2017-09-28 13:01:51.720 15061 ERROR nova Traceback (most recent call last):
Sep 28 13:01:51 ctl02 nova-api[15061]: 2017-09-28 13:01:51.720 15061 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:01:51 ctl02 nova-api[15061]: 2017-09-28 13:01:51.720 15061 ERROR nova     sys.exit(main())
Sep 28 13:01:51 ctl02 nova-api[15061]: 2017-09-28 13:01:51.720 15061 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:01:51 ctl02 nova-api[15061]: 2017-09-28 13:01:51.720 15061 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:01:51 ctl02 nova-api[15061]: 2017-09-28 13:01:51.720 15061 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:01:51 ctl02 nova-api[15061]: 2017-09-28 13:01:51.720 15061 ERROR nova     max_url_len=max_url_len)
Sep 28 13:01:51 ctl02 nova-api[15061]: 2017-09-28 13:01:51.720 15061 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:01:51 ctl02 nova-api[15061]: 2017-09-28 13:01:51.720 15061 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:01:51 ctl02 nova-api[15061]: 2017-09-28 13:01:51.720 15061 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:01:51 ctl02 nova-api[15061]: 2017-09-28 13:01:51.720 15061 ERROR nova     sock.listen(backlog)
Sep 28 13:01:51 ctl02 nova-api[15061]: 2017-09-28 13:01:51.720 15061 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:01:51 ctl02 nova-api[15061]: 2017-09-28 13:01:51.720 15061 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:01:51 ctl02 nova-api[15061]: 2017-09-28 13:01:51.720 15061 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:01:51 ctl02 nova-api[15061]: 2017-09-28 13:01:51.720 15061 ERROR nova
Sep 28 13:01:51 ctl02 glance-api[29183]: 2017-09-28 13:01:51.759 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:01:51] "OPTIONS / HTTP/1.0" 200 134 0.000678
Sep 28 13:01:51 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:01:51 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:01:51 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:01:52 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:01:52 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:01:52 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:01:52 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:01:53 ctl02 glance-api[29183]: 2017-09-28 13:01:53.180 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:01:53] "OPTIONS / HTTP/1.0" 200 134 0.000896
Sep 28 13:01:53 ctl02 heat-api[13008]: 2017-09-28 13:01:53.503 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:01:53] "OPTIONS / HTTP/1.0" 200 134 0.000504
Sep 28 13:01:53 ctl02 nova-api[15084]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:01:53 ctl02 nova-api[15084]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:01:53 ctl02 nova-api[15084]: 2017-09-28 13:01:53.999 15084 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:01:54 ctl02 nova-api[15084]: 2017-09-28 13:01:54.000 15084 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:01:54 ctl02 nova-api[15084]: 2017-09-28 13:01:54.000 15084 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:01:54 ctl02 nova-api[15084]: 2017-09-28 13:01:54.000 15084 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:01:54 ctl02 nova-api[15084]: 2017-09-28 13:01:54.000 15084 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:01:54 ctl02 nova-api[15084]: 2017-09-28 13:01:54.000 15084 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:01:54 ctl02 nova-api[15084]: 2017-09-28 13:01:54.000 15084 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:01:54 ctl02 nova-api[15084]: 2017-09-28 13:01:54.000 15084 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:01:54 ctl02 nova-api[15084]: 2017-09-28 13:01:54.000 15084 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:01:54 ctl02 nova-api[15084]: 2017-09-28 13:01:54.000 15084 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:01:54 ctl02 nova-api[15084]: 2017-09-28 13:01:54.000 15084 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:01:54 ctl02 nova-api[15084]: 2017-09-28 13:01:54.000 15084 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:01:54 ctl02 nova-api[15084]: 2017-09-28 13:01:54.000 15084 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:01:54 ctl02 nova-api[15084]: 2017-09-28 13:01:54.000 15084 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:01:54 ctl02 nova-api[15084]: 2017-09-28 13:01:54.000 15084 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:01:54 ctl02 nova-api[15084]: 2017-09-28 13:01:54.000 15084 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:01:54 ctl02 nova-api[15084]: 2017-09-28 13:01:54.000 15084 ERROR nova.wsgi     self.filename))
Sep 28 13:01:54 ctl02 nova-api[15084]: 2017-09-28 13:01:54.000 15084 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:01:54 ctl02 nova-api[15084]: 2017-09-28 13:01:54.000 15084 ERROR nova.wsgi
Sep 28 13:01:54 ctl02 nova-api[15084]: 2017-09-28 13:01:54.003 15084 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:01:54 ctl02 nova-api[15084]: 2017-09-28 13:01:54.133 15084 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:01:54 ctl02 nova-api[15084]: 2017-09-28 13:01:54.359 15084 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:01:54 ctl02 nova-api[15084]: 2017-09-28 13:01:54.361 15084 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:01:54 ctl02 nova-api[15084]: 2017-09-28 13:01:54.361 15084 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:01:54 ctl02 nova-api[15084]: 2017-09-28 13:01:54.362 15084 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:01:54 ctl02 nova-api[15084]: 2017-09-28 13:01:54.493 15084 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:01:54 ctl02 nova-api[15084]: 2017-09-28 13:01:54.494 15084 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:01:54 ctl02 nova-api[15084]: 2017-09-28 13:01:54.494 15084 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:01:54 ctl02 nova-api[15084]: 2017-09-28 13:01:54.495 15084 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:01:54 ctl02 nova-api[15084]: 2017-09-28 13:01:54.498 15084 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:01:54 ctl02 nova-api[15084]: 2017-09-28 13:01:54.498 15084 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:01:54 ctl02 nova-api[15084]: 2017-09-28 13:01:54.498 15084 ERROR nova Traceback (most recent call last):
Sep 28 13:01:54 ctl02 nova-api[15084]: 2017-09-28 13:01:54.498 15084 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:01:54 ctl02 nova-api[15084]: 2017-09-28 13:01:54.498 15084 ERROR nova     sys.exit(main())
Sep 28 13:01:54 ctl02 nova-api[15084]: 2017-09-28 13:01:54.498 15084 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:01:54 ctl02 nova-api[15084]: 2017-09-28 13:01:54.498 15084 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:01:54 ctl02 nova-api[15084]: 2017-09-28 13:01:54.498 15084 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:01:54 ctl02 nova-api[15084]: 2017-09-28 13:01:54.498 15084 ERROR nova     max_url_len=max_url_len)
Sep 28 13:01:54 ctl02 nova-api[15084]: 2017-09-28 13:01:54.498 15084 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:01:54 ctl02 nova-api[15084]: 2017-09-28 13:01:54.498 15084 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:01:54 ctl02 nova-api[15084]: 2017-09-28 13:01:54.498 15084 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:01:54 ctl02 nova-api[15084]: 2017-09-28 13:01:54.498 15084 ERROR nova     sock.listen(backlog)
Sep 28 13:01:54 ctl02 nova-api[15084]: 2017-09-28 13:01:54.498 15084 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:01:54 ctl02 nova-api[15084]: 2017-09-28 13:01:54.498 15084 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:01:54 ctl02 nova-api[15084]: 2017-09-28 13:01:54.498 15084 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:01:54 ctl02 nova-api[15084]: 2017-09-28 13:01:54.498 15084 ERROR nova
Sep 28 13:01:54 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:01:54 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:01:54 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:01:54 ctl02 neutron-server[30536]: 2017-09-28 13:01:54.768 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:01:54] "OPTIONS / HTTP/1.0" 200 262 0.000560
Sep 28 13:01:54 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:01:54 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:01:54 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:01:54 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:01:55 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:01:55.046 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:01:55] "OPTIONS / HTTP/1.0" 200 134 0.000379
Sep 28 13:01:55 ctl02 heat-api-cfn[13300]: 2017-09-28 13:01:55.188 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:01:55] "OPTIONS / HTTP/1.0" 200 134 0.000451
Sep 28 13:01:55 ctl02 heat-api-cfn[13300]: 2017-09-28 13:01:55.608 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:01:55] "OPTIONS / HTTP/1.0" 200 134 0.000463
Sep 28 13:01:56 ctl02 nova-api[15102]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:01:56 ctl02 nova-api[15102]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:01:56 ctl02 nova-api[15102]: 2017-09-28 13:01:56.722 15102 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:01:56 ctl02 nova-api[15102]: 2017-09-28 13:01:56.724 15102 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:01:56 ctl02 nova-api[15102]: 2017-09-28 13:01:56.724 15102 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:01:56 ctl02 nova-api[15102]: 2017-09-28 13:01:56.724 15102 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:01:56 ctl02 nova-api[15102]: 2017-09-28 13:01:56.724 15102 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:01:56 ctl02 nova-api[15102]: 2017-09-28 13:01:56.724 15102 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:01:56 ctl02 nova-api[15102]: 2017-09-28 13:01:56.724 15102 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:01:56 ctl02 nova-api[15102]: 2017-09-28 13:01:56.724 15102 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:01:56 ctl02 nova-api[15102]: 2017-09-28 13:01:56.724 15102 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:01:56 ctl02 nova-api[15102]: 2017-09-28 13:01:56.724 15102 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:01:56 ctl02 nova-api[15102]: 2017-09-28 13:01:56.724 15102 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:01:56 ctl02 nova-api[15102]: 2017-09-28 13:01:56.724 15102 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:01:56 ctl02 nova-api[15102]: 2017-09-28 13:01:56.724 15102 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:01:56 ctl02 nova-api[15102]: 2017-09-28 13:01:56.724 15102 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:01:56 ctl02 nova-api[15102]: 2017-09-28 13:01:56.724 15102 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:01:56 ctl02 nova-api[15102]: 2017-09-28 13:01:56.724 15102 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:01:56 ctl02 nova-api[15102]: 2017-09-28 13:01:56.724 15102 ERROR nova.wsgi     self.filename))
Sep 28 13:01:56 ctl02 nova-api[15102]: 2017-09-28 13:01:56.724 15102 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:01:56 ctl02 nova-api[15102]: 2017-09-28 13:01:56.724 15102 ERROR nova.wsgi
Sep 28 13:01:56 ctl02 nova-api[15102]: 2017-09-28 13:01:56.726 15102 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:01:56 ctl02 nova-api[15102]: 2017-09-28 13:01:56.861 15102 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:01:57 ctl02 nova-api[15102]: 2017-09-28 13:01:57.092 15102 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:01:57 ctl02 nova-api[15102]: 2017-09-28 13:01:57.095 15102 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:01:57 ctl02 nova-api[15102]: 2017-09-28 13:01:57.095 15102 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:01:57 ctl02 nova-api[15102]: 2017-09-28 13:01:57.095 15102 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:01:57 ctl02 nova-api[15102]: 2017-09-28 13:01:57.230 15102 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:01:57 ctl02 nova-api[15102]: 2017-09-28 13:01:57.233 15102 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:01:57 ctl02 nova-api[15102]: 2017-09-28 13:01:57.233 15102 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:01:57 ctl02 nova-api[15102]: 2017-09-28 13:01:57.234 15102 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:01:57 ctl02 nova-api[15102]: 2017-09-28 13:01:57.237 15102 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:01:57 ctl02 nova-api[15102]: 2017-09-28 13:01:57.237 15102 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:01:57 ctl02 nova-api[15102]: 2017-09-28 13:01:57.237 15102 ERROR nova Traceback (most recent call last):
Sep 28 13:01:57 ctl02 nova-api[15102]: 2017-09-28 13:01:57.237 15102 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:01:57 ctl02 nova-api[15102]: 2017-09-28 13:01:57.237 15102 ERROR nova     sys.exit(main())
Sep 28 13:01:57 ctl02 nova-api[15102]: 2017-09-28 13:01:57.237 15102 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:01:57 ctl02 nova-api[15102]: 2017-09-28 13:01:57.237 15102 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:01:57 ctl02 nova-api[15102]: 2017-09-28 13:01:57.237 15102 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:01:57 ctl02 nova-api[15102]: 2017-09-28 13:01:57.237 15102 ERROR nova     max_url_len=max_url_len)
Sep 28 13:01:57 ctl02 nova-api[15102]: 2017-09-28 13:01:57.237 15102 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:01:57 ctl02 nova-api[15102]: 2017-09-28 13:01:57.237 15102 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:01:57 ctl02 nova-api[15102]: 2017-09-28 13:01:57.237 15102 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:01:57 ctl02 nova-api[15102]: 2017-09-28 13:01:57.237 15102 ERROR nova     sock.listen(backlog)
Sep 28 13:01:57 ctl02 nova-api[15102]: 2017-09-28 13:01:57.237 15102 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:01:57 ctl02 nova-api[15102]: 2017-09-28 13:01:57.237 15102 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:01:57 ctl02 nova-api[15102]: 2017-09-28 13:01:57.237 15102 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:01:57 ctl02 nova-api[15102]: 2017-09-28 13:01:57.237 15102 ERROR nova
Sep 28 13:01:57 ctl02 heat-api[13008]: 2017-09-28 13:01:57.355 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:01:57] "OPTIONS / HTTP/1.0" 200 134 0.000566
Sep 28 13:01:57 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:01:57 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:01:57 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:01:57 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:01:57 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:01:57 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:01:57 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:01:57 ctl02 neutron-server[30536]: 2017-09-28 13:01:57.649 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:01:57] "OPTIONS / HTTP/1.0" 200 262 0.000618
Sep 28 13:01:57 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:01:57.818 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:01:57] "OPTIONS / HTTP/1.0" 200 134 0.000373
Sep 28 13:01:59 ctl02 glance-api[29183]: 2017-09-28 13:01:59.258 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:01:59] "OPTIONS / HTTP/1.0" 200 134 0.000575
Sep 28 13:01:59 ctl02 nova-conductor[5056]: 2017-09-28 13:01:59.285 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:01:59 ctl02 nova-conductor[5056]: 2017-09-28 13:01:59.295 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:01:59 ctl02 nova-conductor[5056]: 2017-09-28 13:01:59.298 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:01:59 ctl02 nova-conductor[5056]: 2017-09-28 13:01:59.302 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:01:59 ctl02 nova-api[15120]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:01:59 ctl02 nova-api[15120]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:01:59 ctl02 nova-api[15120]: 2017-09-28 13:01:59.484 15120 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:01:59 ctl02 nova-api[15120]: 2017-09-28 13:01:59.486 15120 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:01:59 ctl02 nova-api[15120]: 2017-09-28 13:01:59.486 15120 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:01:59 ctl02 nova-api[15120]: 2017-09-28 13:01:59.486 15120 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:01:59 ctl02 nova-api[15120]: 2017-09-28 13:01:59.486 15120 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:01:59 ctl02 nova-api[15120]: 2017-09-28 13:01:59.486 15120 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:01:59 ctl02 nova-api[15120]: 2017-09-28 13:01:59.486 15120 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:01:59 ctl02 nova-api[15120]: 2017-09-28 13:01:59.486 15120 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:01:59 ctl02 nova-api[15120]: 2017-09-28 13:01:59.486 15120 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:01:59 ctl02 nova-api[15120]: 2017-09-28 13:01:59.486 15120 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:01:59 ctl02 nova-api[15120]: 2017-09-28 13:01:59.486 15120 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:01:59 ctl02 nova-api[15120]: 2017-09-28 13:01:59.486 15120 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:01:59 ctl02 nova-api[15120]: 2017-09-28 13:01:59.486 15120 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:01:59 ctl02 nova-api[15120]: 2017-09-28 13:01:59.486 15120 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:01:59 ctl02 nova-api[15120]: 2017-09-28 13:01:59.486 15120 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:01:59 ctl02 nova-api[15120]: 2017-09-28 13:01:59.486 15120 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:01:59 ctl02 nova-api[15120]: 2017-09-28 13:01:59.486 15120 ERROR nova.wsgi     self.filename))
Sep 28 13:01:59 ctl02 nova-api[15120]: 2017-09-28 13:01:59.486 15120 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:01:59 ctl02 nova-api[15120]: 2017-09-28 13:01:59.486 15120 ERROR nova.wsgi
Sep 28 13:01:59 ctl02 nova-api[15120]: 2017-09-28 13:01:59.488 15120 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:01:59 ctl02 nova-api[15120]: 2017-09-28 13:01:59.622 15120 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:01:59 ctl02 nova-api[15120]: 2017-09-28 13:01:59.847 15120 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:01:59 ctl02 nova-api[15120]: 2017-09-28 13:01:59.849 15120 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:01:59 ctl02 nova-api[15120]: 2017-09-28 13:01:59.850 15120 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:01:59 ctl02 nova-api[15120]: 2017-09-28 13:01:59.850 15120 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:01:59 ctl02 nova-cert[4860]: 2017-09-28 13:01:59.953 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:01:59 ctl02 nova-api[15120]: 2017-09-28 13:01:59.980 15120 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:01:59 ctl02 nova-api[15120]: 2017-09-28 13:01:59.983 15120 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:01:59 ctl02 nova-api[15120]: 2017-09-28 13:01:59.983 15120 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:01:59 ctl02 nova-api[15120]: 2017-09-28 13:01:59.983 15120 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:01:59 ctl02 nova-api[15120]: 2017-09-28 13:01:59.987 15120 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:01:59 ctl02 nova-api[15120]: 2017-09-28 13:01:59.987 15120 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:01:59 ctl02 nova-api[15120]: 2017-09-28 13:01:59.987 15120 ERROR nova Traceback (most recent call last):
Sep 28 13:01:59 ctl02 nova-api[15120]: 2017-09-28 13:01:59.987 15120 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:01:59 ctl02 nova-api[15120]: 2017-09-28 13:01:59.987 15120 ERROR nova     sys.exit(main())
Sep 28 13:01:59 ctl02 nova-api[15120]: 2017-09-28 13:01:59.987 15120 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:01:59 ctl02 nova-api[15120]: 2017-09-28 13:01:59.987 15120 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:01:59 ctl02 nova-api[15120]: 2017-09-28 13:01:59.987 15120 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:01:59 ctl02 nova-api[15120]: 2017-09-28 13:01:59.987 15120 ERROR nova     max_url_len=max_url_len)
Sep 28 13:01:59 ctl02 nova-api[15120]: 2017-09-28 13:01:59.987 15120 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:01:59 ctl02 nova-api[15120]: 2017-09-28 13:01:59.987 15120 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:01:59 ctl02 nova-api[15120]: 2017-09-28 13:01:59.987 15120 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:01:59 ctl02 nova-api[15120]: 2017-09-28 13:01:59.987 15120 ERROR nova     sock.listen(backlog)
Sep 28 13:01:59 ctl02 nova-api[15120]: 2017-09-28 13:01:59.987 15120 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:01:59 ctl02 nova-api[15120]: 2017-09-28 13:01:59.987 15120 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:01:59 ctl02 nova-api[15120]: 2017-09-28 13:01:59.987 15120 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:01:59 ctl02 nova-api[15120]: 2017-09-28 13:01:59.987 15120 ERROR nova
Sep 28 13:02:00 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:02:00 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:02:00 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:02:00 ctl02 heat-api[13008]: 2017-09-28 13:02:00.119 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:02:00] "OPTIONS / HTTP/1.0" 200 134 0.000558
Sep 28 13:02:00 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:02:00 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:02:00 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:02:00 ctl02 heat-api-cfn[13300]: 2017-09-28 13:02:00.395 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:02:00] "OPTIONS / HTTP/1.0" 200 134 0.000575
Sep 28 13:02:00 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:02:00 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd0d8e70b)
Sep 28 13:02:00 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:02:00.756 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:02:00] "OPTIONS / HTTP/1.0" 200 134 0.000389
Sep 28 13:02:01 ctl02 neutron-server[30536]: 2017-09-28 13:02:01.389 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:02:01] "OPTIONS / HTTP/1.0" 200 262 0.000490
Sep 28 13:02:01 ctl02 glance-api[29183]: 2017-09-28 13:02:01.514 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:02:01] "OPTIONS / HTTP/1.0" 200 134 0.000581
Sep 28 13:02:01 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd0d8e70b)
Sep 28 13:02:02 ctl02 nova-api[15138]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:02:02 ctl02 nova-api[15138]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:02:02 ctl02 nova-api[15138]: 2017-09-28 13:02:02.244 15138 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:02:02 ctl02 nova-api[15138]: 2017-09-28 13:02:02.245 15138 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:02:02 ctl02 nova-api[15138]: 2017-09-28 13:02:02.245 15138 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:02:02 ctl02 nova-api[15138]: 2017-09-28 13:02:02.245 15138 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:02:02 ctl02 nova-api[15138]: 2017-09-28 13:02:02.245 15138 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:02:02 ctl02 nova-api[15138]: 2017-09-28 13:02:02.245 15138 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:02:02 ctl02 nova-api[15138]: 2017-09-28 13:02:02.245 15138 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:02:02 ctl02 nova-api[15138]: 2017-09-28 13:02:02.245 15138 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:02:02 ctl02 nova-api[15138]: 2017-09-28 13:02:02.245 15138 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:02:02 ctl02 nova-api[15138]: 2017-09-28 13:02:02.245 15138 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:02:02 ctl02 nova-api[15138]: 2017-09-28 13:02:02.245 15138 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:02:02 ctl02 nova-api[15138]: 2017-09-28 13:02:02.245 15138 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:02:02 ctl02 nova-api[15138]: 2017-09-28 13:02:02.245 15138 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:02:02 ctl02 nova-api[15138]: 2017-09-28 13:02:02.245 15138 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:02:02 ctl02 nova-api[15138]: 2017-09-28 13:02:02.245 15138 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:02:02 ctl02 nova-api[15138]: 2017-09-28 13:02:02.245 15138 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:02:02 ctl02 nova-api[15138]: 2017-09-28 13:02:02.245 15138 ERROR nova.wsgi     self.filename))
Sep 28 13:02:02 ctl02 nova-api[15138]: 2017-09-28 13:02:02.245 15138 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:02:02 ctl02 nova-api[15138]: 2017-09-28 13:02:02.245 15138 ERROR nova.wsgi
Sep 28 13:02:02 ctl02 nova-api[15138]: 2017-09-28 13:02:02.246 15138 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:02:02 ctl02 nova-api[15138]: 2017-09-28 13:02:02.374 15138 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:02:02 ctl02 nova-api[15138]: 2017-09-28 13:02:02.593 15138 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:02:02 ctl02 nova-api[15138]: 2017-09-28 13:02:02.595 15138 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:02:02 ctl02 nova-api[15138]: 2017-09-28 13:02:02.596 15138 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:02:02 ctl02 nova-api[15138]: 2017-09-28 13:02:02.596 15138 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:02:02 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd0d8e70b)
Sep 28 13:02:02 ctl02 nova-api[15138]: 2017-09-28 13:02:02.724 15138 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:02:02 ctl02 nova-api[15138]: 2017-09-28 13:02:02.726 15138 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:02:02 ctl02 nova-api[15138]: 2017-09-28 13:02:02.726 15138 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:02:02 ctl02 nova-api[15138]: 2017-09-28 13:02:02.727 15138 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:02:02 ctl02 nova-api[15138]: 2017-09-28 13:02:02.730 15138 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:02:02 ctl02 nova-api[15138]: 2017-09-28 13:02:02.730 15138 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:02:02 ctl02 nova-api[15138]: 2017-09-28 13:02:02.730 15138 ERROR nova Traceback (most recent call last):
Sep 28 13:02:02 ctl02 nova-api[15138]: 2017-09-28 13:02:02.730 15138 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:02:02 ctl02 nova-api[15138]: 2017-09-28 13:02:02.730 15138 ERROR nova     sys.exit(main())
Sep 28 13:02:02 ctl02 nova-api[15138]: 2017-09-28 13:02:02.730 15138 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:02:02 ctl02 nova-api[15138]: 2017-09-28 13:02:02.730 15138 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:02:02 ctl02 nova-api[15138]: 2017-09-28 13:02:02.730 15138 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:02:02 ctl02 nova-api[15138]: 2017-09-28 13:02:02.730 15138 ERROR nova     max_url_len=max_url_len)
Sep 28 13:02:02 ctl02 nova-api[15138]: 2017-09-28 13:02:02.730 15138 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:02:02 ctl02 nova-api[15138]: 2017-09-28 13:02:02.730 15138 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:02:02 ctl02 nova-api[15138]: 2017-09-28 13:02:02.730 15138 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:02:02 ctl02 nova-api[15138]: 2017-09-28 13:02:02.730 15138 ERROR nova     sock.listen(backlog)
Sep 28 13:02:02 ctl02 nova-api[15138]: 2017-09-28 13:02:02.730 15138 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:02:02 ctl02 nova-api[15138]: 2017-09-28 13:02:02.730 15138 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:02:02 ctl02 nova-api[15138]: 2017-09-28 13:02:02.730 15138 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:02:02 ctl02 nova-api[15138]: 2017-09-28 13:02:02.730 15138 ERROR nova
Sep 28 13:02:02 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:02:02 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:02:02 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:02:03 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:02:03 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:02:03 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:02:03 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:02:03 ctl02 glance-api[29183]: 2017-09-28 13:02:03.318 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:02:03] "OPTIONS / HTTP/1.0" 200 134 0.000583
Sep 28 13:02:03 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd0d8e70b)
Sep 28 13:02:03 ctl02 heat-api[13008]: 2017-09-28 13:02:03.653 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:02:03] "OPTIONS / HTTP/1.0" 200 134 0.000528
Sep 28 13:02:04 ctl02 neutron-server[30536]: 2017-09-28 13:02:04.434 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:02:04] "OPTIONS / HTTP/1.0" 200 262 0.000600
Sep 28 13:02:04 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd0d8e70b)
Sep 28 13:02:04 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:02:04.758 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:02:04] "OPTIONS / HTTP/1.0" 200 134 0.000459
Sep 28 13:02:04 ctl02 nova-api[15155]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:02:04 ctl02 nova-api[15155]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:02:04 ctl02 nova-api[15155]: 2017-09-28 13:02:04.982 15155 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:02:04 ctl02 nova-api[15155]: 2017-09-28 13:02:04.984 15155 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:02:04 ctl02 nova-api[15155]: 2017-09-28 13:02:04.984 15155 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:02:04 ctl02 nova-api[15155]: 2017-09-28 13:02:04.984 15155 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:02:04 ctl02 nova-api[15155]: 2017-09-28 13:02:04.984 15155 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:02:04 ctl02 nova-api[15155]: 2017-09-28 13:02:04.984 15155 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:02:04 ctl02 nova-api[15155]: 2017-09-28 13:02:04.984 15155 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:02:04 ctl02 nova-api[15155]: 2017-09-28 13:02:04.984 15155 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:02:04 ctl02 nova-api[15155]: 2017-09-28 13:02:04.984 15155 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:02:04 ctl02 nova-api[15155]: 2017-09-28 13:02:04.984 15155 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:02:04 ctl02 nova-api[15155]: 2017-09-28 13:02:04.984 15155 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:02:04 ctl02 nova-api[15155]: 2017-09-28 13:02:04.984 15155 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:02:04 ctl02 nova-api[15155]: 2017-09-28 13:02:04.984 15155 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:02:04 ctl02 nova-api[15155]: 2017-09-28 13:02:04.984 15155 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:02:04 ctl02 nova-api[15155]: 2017-09-28 13:02:04.984 15155 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:02:04 ctl02 nova-api[15155]: 2017-09-28 13:02:04.984 15155 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:02:04 ctl02 nova-api[15155]: 2017-09-28 13:02:04.984 15155 ERROR nova.wsgi     self.filename))
Sep 28 13:02:04 ctl02 nova-api[15155]: 2017-09-28 13:02:04.984 15155 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:02:04 ctl02 nova-api[15155]: 2017-09-28 13:02:04.984 15155 ERROR nova.wsgi
Sep 28 13:02:04 ctl02 nova-api[15155]: 2017-09-28 13:02:04.985 15155 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:02:05 ctl02 heat-api-cfn[13300]: 2017-09-28 13:02:05.059 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:02:05] "OPTIONS / HTTP/1.0" 200 134 0.000550
Sep 28 13:02:05 ctl02 nova-api[15155]: 2017-09-28 13:02:05.111 15155 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:02:05 ctl02 nova-api[15155]: 2017-09-28 13:02:05.324 15155 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:02:05 ctl02 nova-api[15155]: 2017-09-28 13:02:05.326 15155 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:02:05 ctl02 nova-api[15155]: 2017-09-28 13:02:05.327 15155 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:02:05 ctl02 nova-api[15155]: 2017-09-28 13:02:05.327 15155 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:02:05 ctl02 nova-api[15155]: 2017-09-28 13:02:05.456 15155 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:02:05 ctl02 nova-api[15155]: 2017-09-28 13:02:05.458 15155 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:02:05 ctl02 nova-api[15155]: 2017-09-28 13:02:05.458 15155 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:02:05 ctl02 nova-api[15155]: 2017-09-28 13:02:05.458 15155 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:02:05 ctl02 nova-api[15155]: 2017-09-28 13:02:05.461 15155 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:02:05 ctl02 nova-api[15155]: 2017-09-28 13:02:05.461 15155 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:02:05 ctl02 nova-api[15155]: 2017-09-28 13:02:05.461 15155 ERROR nova Traceback (most recent call last):
Sep 28 13:02:05 ctl02 nova-api[15155]: 2017-09-28 13:02:05.461 15155 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:02:05 ctl02 nova-api[15155]: 2017-09-28 13:02:05.461 15155 ERROR nova     sys.exit(main())
Sep 28 13:02:05 ctl02 nova-api[15155]: 2017-09-28 13:02:05.461 15155 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:02:05 ctl02 nova-api[15155]: 2017-09-28 13:02:05.461 15155 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:02:05 ctl02 nova-api[15155]: 2017-09-28 13:02:05.461 15155 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:02:05 ctl02 nova-api[15155]: 2017-09-28 13:02:05.461 15155 ERROR nova     max_url_len=max_url_len)
Sep 28 13:02:05 ctl02 nova-api[15155]: 2017-09-28 13:02:05.461 15155 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:02:05 ctl02 nova-api[15155]: 2017-09-28 13:02:05.461 15155 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:02:05 ctl02 nova-api[15155]: 2017-09-28 13:02:05.461 15155 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:02:05 ctl02 nova-api[15155]: 2017-09-28 13:02:05.461 15155 ERROR nova     sock.listen(backlog)
Sep 28 13:02:05 ctl02 nova-api[15155]: 2017-09-28 13:02:05.461 15155 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:02:05 ctl02 nova-api[15155]: 2017-09-28 13:02:05.461 15155 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:02:05 ctl02 nova-api[15155]: 2017-09-28 13:02:05.461 15155 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:02:05 ctl02 nova-api[15155]: 2017-09-28 13:02:05.461 15155 ERROR nova
Sep 28 13:02:05 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:02:05 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:02:05 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:02:05 ctl02 heat-api-cfn[13300]: 2017-09-28 13:02:05.641 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:02:05] "OPTIONS / HTTP/1.0" 200 134 0.000549
Sep 28 13:02:05 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd0d8e70b)
Sep 28 13:02:05 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:02:05 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:02:05 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:02:05 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:02:06 ctl02 neutron-server[30536]: 2017-09-28 13:02:06.029 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 4 dead agents out of 6:
Sep 28 13:02:06 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 13:02:06 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 13:01:06 cmp002
Sep 28 13:02:06 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 13:00:58 cmp001
Sep 28 13:02:06 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 13:00:10 cmp002
Sep 28 13:02:06 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 13:01:36 cmp002
Sep 28 13:02:06 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd0d8e70b)
Sep 28 13:02:07 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:02:07.513 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:02:07] "OPTIONS / HTTP/1.0" 200 134 0.000447
Sep 28 13:02:07 ctl02 nova-api[15174]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:02:07 ctl02 nova-api[15174]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:02:07 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd0d8e70b)
Sep 28 13:02:07 ctl02 heat-api[13008]: 2017-09-28 13:02:07.679 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:02:07] "OPTIONS / HTTP/1.0" 200 134 0.000614
Sep 28 13:02:07 ctl02 nova-api[15174]: 2017-09-28 13:02:07.800 15174 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:02:07 ctl02 nova-api[15174]: 2017-09-28 13:02:07.802 15174 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:02:07 ctl02 nova-api[15174]: 2017-09-28 13:02:07.802 15174 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:02:07 ctl02 nova-api[15174]: 2017-09-28 13:02:07.802 15174 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:02:07 ctl02 nova-api[15174]: 2017-09-28 13:02:07.802 15174 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:02:07 ctl02 nova-api[15174]: 2017-09-28 13:02:07.802 15174 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:02:07 ctl02 nova-api[15174]: 2017-09-28 13:02:07.802 15174 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:02:07 ctl02 nova-api[15174]: 2017-09-28 13:02:07.802 15174 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:02:07 ctl02 nova-api[15174]: 2017-09-28 13:02:07.802 15174 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:02:07 ctl02 nova-api[15174]: 2017-09-28 13:02:07.802 15174 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:02:07 ctl02 nova-api[15174]: 2017-09-28 13:02:07.802 15174 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:02:07 ctl02 nova-api[15174]: 2017-09-28 13:02:07.802 15174 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:02:07 ctl02 nova-api[15174]: 2017-09-28 13:02:07.802 15174 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:02:07 ctl02 nova-api[15174]: 2017-09-28 13:02:07.802 15174 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:02:07 ctl02 nova-api[15174]: 2017-09-28 13:02:07.802 15174 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:02:07 ctl02 nova-api[15174]: 2017-09-28 13:02:07.802 15174 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:02:07 ctl02 nova-api[15174]: 2017-09-28 13:02:07.802 15174 ERROR nova.wsgi     self.filename))
Sep 28 13:02:07 ctl02 nova-api[15174]: 2017-09-28 13:02:07.802 15174 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:02:07 ctl02 nova-api[15174]: 2017-09-28 13:02:07.802 15174 ERROR nova.wsgi
Sep 28 13:02:07 ctl02 nova-api[15174]: 2017-09-28 13:02:07.803 15174 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:02:07 ctl02 neutron-server[30536]: 2017-09-28 13:02:07.831 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:02:07] "OPTIONS / HTTP/1.0" 200 262 0.000529
Sep 28 13:02:07 ctl02 nova-api[15174]: 2017-09-28 13:02:07.937 15174 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:02:08 ctl02 nova-api[15174]: 2017-09-28 13:02:08.181 15174 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:02:08 ctl02 nova-api[15174]: 2017-09-28 13:02:08.184 15174 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:02:08 ctl02 nova-api[15174]: 2017-09-28 13:02:08.184 15174 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:02:08 ctl02 nova-api[15174]: 2017-09-28 13:02:08.184 15174 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:02:08 ctl02 nova-api[15174]: 2017-09-28 13:02:08.317 15174 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:02:08 ctl02 nova-api[15174]: 2017-09-28 13:02:08.319 15174 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:02:08 ctl02 nova-api[15174]: 2017-09-28 13:02:08.319 15174 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:02:08 ctl02 nova-api[15174]: 2017-09-28 13:02:08.319 15174 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:02:08 ctl02 nova-api[15174]: 2017-09-28 13:02:08.323 15174 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:02:08 ctl02 nova-api[15174]: 2017-09-28 13:02:08.323 15174 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:02:08 ctl02 nova-api[15174]: 2017-09-28 13:02:08.323 15174 ERROR nova Traceback (most recent call last):
Sep 28 13:02:08 ctl02 nova-api[15174]: 2017-09-28 13:02:08.323 15174 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:02:08 ctl02 nova-api[15174]: 2017-09-28 13:02:08.323 15174 ERROR nova     sys.exit(main())
Sep 28 13:02:08 ctl02 nova-api[15174]: 2017-09-28 13:02:08.323 15174 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:02:08 ctl02 nova-api[15174]: 2017-09-28 13:02:08.323 15174 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:02:08 ctl02 nova-api[15174]: 2017-09-28 13:02:08.323 15174 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:02:08 ctl02 nova-api[15174]: 2017-09-28 13:02:08.323 15174 ERROR nova     max_url_len=max_url_len)
Sep 28 13:02:08 ctl02 nova-api[15174]: 2017-09-28 13:02:08.323 15174 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:02:08 ctl02 nova-api[15174]: 2017-09-28 13:02:08.323 15174 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:02:08 ctl02 nova-api[15174]: 2017-09-28 13:02:08.323 15174 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:02:08 ctl02 nova-api[15174]: 2017-09-28 13:02:08.323 15174 ERROR nova     sock.listen(backlog)
Sep 28 13:02:08 ctl02 nova-api[15174]: 2017-09-28 13:02:08.323 15174 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:02:08 ctl02 nova-api[15174]: 2017-09-28 13:02:08.323 15174 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:02:08 ctl02 nova-api[15174]: 2017-09-28 13:02:08.323 15174 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:02:08 ctl02 nova-api[15174]: 2017-09-28 13:02:08.323 15174 ERROR nova
Sep 28 13:02:08 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:02:08 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:02:08 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:02:08 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:02:08 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:02:08 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:02:08 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:02:08 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd0d8e70b)
Sep 28 13:02:09 ctl02 glance-api[29183]: 2017-09-28 13:02:09.400 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:02:09] "OPTIONS / HTTP/1.0" 200 134 0.000637
Sep 28 13:02:09 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd0d8e70b)
Sep 28 13:02:09 ctl02 nova-consoleauth[5433]: 2017-09-28 13:02:09.802 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:02:09 ctl02 heat-api[13008]: 2017-09-28 13:02:09.877 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:02:09] "OPTIONS / HTTP/1.0" 200 134 0.000617
Sep 28 13:02:10 ctl02 heat-api-cfn[13300]: 2017-09-28 13:02:10.228 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:02:10] "OPTIONS / HTTP/1.0" 200 134 0.000556
Sep 28 13:02:10 ctl02 nova-api[15192]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:02:10 ctl02 nova-api[15192]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:02:10 ctl02 heat-engine[12803]: 2017-09-28 13:02:10.415 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:02:10 ctl02 heat-engine[12803]: 2017-09-28 13:02:10.431 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:02:10 ctl02 heat-engine[12803]: 2017-09-28 13:02:10.440 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:02:10 ctl02 heat-engine[12803]: 2017-09-28 13:02:10.441 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:02:10 ctl02 nova-api[15192]: 2017-09-28 13:02:10.529 15192 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:02:10 ctl02 nova-api[15192]: 2017-09-28 13:02:10.531 15192 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:02:10 ctl02 nova-api[15192]: 2017-09-28 13:02:10.531 15192 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:02:10 ctl02 nova-api[15192]: 2017-09-28 13:02:10.531 15192 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:02:10 ctl02 nova-api[15192]: 2017-09-28 13:02:10.531 15192 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:02:10 ctl02 nova-api[15192]: 2017-09-28 13:02:10.531 15192 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:02:10 ctl02 nova-api[15192]: 2017-09-28 13:02:10.531 15192 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:02:10 ctl02 nova-api[15192]: 2017-09-28 13:02:10.531 15192 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:02:10 ctl02 nova-api[15192]: 2017-09-28 13:02:10.531 15192 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:02:10 ctl02 nova-api[15192]: 2017-09-28 13:02:10.531 15192 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:02:10 ctl02 nova-api[15192]: 2017-09-28 13:02:10.531 15192 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:02:10 ctl02 nova-api[15192]: 2017-09-28 13:02:10.531 15192 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:02:10 ctl02 nova-api[15192]: 2017-09-28 13:02:10.531 15192 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:02:10 ctl02 nova-api[15192]: 2017-09-28 13:02:10.531 15192 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:02:10 ctl02 nova-api[15192]: 2017-09-28 13:02:10.531 15192 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:02:10 ctl02 nova-api[15192]: 2017-09-28 13:02:10.531 15192 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:02:10 ctl02 nova-api[15192]: 2017-09-28 13:02:10.531 15192 ERROR nova.wsgi     self.filename))
Sep 28 13:02:10 ctl02 nova-api[15192]: 2017-09-28 13:02:10.531 15192 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:02:10 ctl02 nova-api[15192]: 2017-09-28 13:02:10.531 15192 ERROR nova.wsgi
Sep 28 13:02:10 ctl02 nova-api[15192]: 2017-09-28 13:02:10.532 15192 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:02:10 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:02:10.569 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:02:10] "OPTIONS / HTTP/1.0" 200 134 0.000481
Sep 28 13:02:10 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd0d8e70b)
Sep 28 13:02:10 ctl02 nova-api[15192]: 2017-09-28 13:02:10.666 15192 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:02:10 ctl02 nova-api[15192]: 2017-09-28 13:02:10.921 15192 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:02:10 ctl02 nova-api[15192]: 2017-09-28 13:02:10.923 15192 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:02:10 ctl02 nova-api[15192]: 2017-09-28 13:02:10.935 15192 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:02:10 ctl02 nova-api[15192]: 2017-09-28 13:02:10.936 15192 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:02:11 ctl02 nova-api[15192]: 2017-09-28 13:02:11.082 15192 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:02:11 ctl02 nova-api[15192]: 2017-09-28 13:02:11.084 15192 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:02:11 ctl02 nova-api[15192]: 2017-09-28 13:02:11.084 15192 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:02:11 ctl02 nova-api[15192]: 2017-09-28 13:02:11.084 15192 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:02:11 ctl02 nova-api[15192]: 2017-09-28 13:02:11.087 15192 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:02:11 ctl02 nova-api[15192]: 2017-09-28 13:02:11.088 15192 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:02:11 ctl02 nova-api[15192]: 2017-09-28 13:02:11.088 15192 ERROR nova Traceback (most recent call last):
Sep 28 13:02:11 ctl02 nova-api[15192]: 2017-09-28 13:02:11.088 15192 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:02:11 ctl02 nova-api[15192]: 2017-09-28 13:02:11.088 15192 ERROR nova     sys.exit(main())
Sep 28 13:02:11 ctl02 nova-api[15192]: 2017-09-28 13:02:11.088 15192 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:02:11 ctl02 nova-api[15192]: 2017-09-28 13:02:11.088 15192 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:02:11 ctl02 nova-api[15192]: 2017-09-28 13:02:11.088 15192 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:02:11 ctl02 nova-api[15192]: 2017-09-28 13:02:11.088 15192 ERROR nova     max_url_len=max_url_len)
Sep 28 13:02:11 ctl02 nova-api[15192]: 2017-09-28 13:02:11.088 15192 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:02:11 ctl02 nova-api[15192]: 2017-09-28 13:02:11.088 15192 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:02:11 ctl02 nova-api[15192]: 2017-09-28 13:02:11.088 15192 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:02:11 ctl02 nova-api[15192]: 2017-09-28 13:02:11.088 15192 ERROR nova     sock.listen(backlog)
Sep 28 13:02:11 ctl02 nova-api[15192]: 2017-09-28 13:02:11.088 15192 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:02:11 ctl02 nova-api[15192]: 2017-09-28 13:02:11.088 15192 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:02:11 ctl02 nova-api[15192]: 2017-09-28 13:02:11.088 15192 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:02:11 ctl02 nova-api[15192]: 2017-09-28 13:02:11.088 15192 ERROR nova
Sep 28 13:02:11 ctl02 neutron-server[30536]: 2017-09-28 13:02:11.148 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:02:11] "OPTIONS / HTTP/1.0" 200 262 0.000553
Sep 28 13:02:11 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:02:11 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:02:11 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:02:11 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:02:11 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:02:11 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:02:11 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:02:11 ctl02 glance-api[29183]: 2017-09-28 13:02:11.546 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:02:11] "OPTIONS / HTTP/1.0" 200 134 0.000934
Sep 28 13:02:11 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 13:02:11 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 13:02:12 ctl02 nova-scheduler[5620]: 2017-09-28 13:02:12.908 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:02:13 ctl02 nova-api[15210]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:02:13 ctl02 nova-api[15210]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:02:13 ctl02 nova-api[15210]: 2017-09-28 13:02:13.302 15210 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:02:13 ctl02 nova-api[15210]: 2017-09-28 13:02:13.304 15210 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:02:13 ctl02 nova-api[15210]: 2017-09-28 13:02:13.304 15210 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:02:13 ctl02 nova-api[15210]: 2017-09-28 13:02:13.304 15210 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:02:13 ctl02 nova-api[15210]: 2017-09-28 13:02:13.304 15210 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:02:13 ctl02 nova-api[15210]: 2017-09-28 13:02:13.304 15210 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:02:13 ctl02 nova-api[15210]: 2017-09-28 13:02:13.304 15210 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:02:13 ctl02 nova-api[15210]: 2017-09-28 13:02:13.304 15210 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:02:13 ctl02 nova-api[15210]: 2017-09-28 13:02:13.304 15210 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:02:13 ctl02 nova-api[15210]: 2017-09-28 13:02:13.304 15210 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:02:13 ctl02 nova-api[15210]: 2017-09-28 13:02:13.304 15210 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:02:13 ctl02 nova-api[15210]: 2017-09-28 13:02:13.304 15210 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:02:13 ctl02 nova-api[15210]: 2017-09-28 13:02:13.304 15210 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:02:13 ctl02 nova-api[15210]: 2017-09-28 13:02:13.304 15210 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:02:13 ctl02 nova-api[15210]: 2017-09-28 13:02:13.304 15210 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:02:13 ctl02 nova-api[15210]: 2017-09-28 13:02:13.304 15210 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:02:13 ctl02 nova-api[15210]: 2017-09-28 13:02:13.304 15210 ERROR nova.wsgi     self.filename))
Sep 28 13:02:13 ctl02 nova-api[15210]: 2017-09-28 13:02:13.304 15210 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:02:13 ctl02 nova-api[15210]: 2017-09-28 13:02:13.304 15210 ERROR nova.wsgi
Sep 28 13:02:13 ctl02 nova-api[15210]: 2017-09-28 13:02:13.307 15210 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:02:13 ctl02 glance-api[29183]: 2017-09-28 13:02:13.423 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:02:13] "OPTIONS / HTTP/1.0" 200 134 0.000569
Sep 28 13:02:13 ctl02 nova-api[15210]: 2017-09-28 13:02:13.453 15210 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:02:13 ctl02 heat-api[13008]: 2017-09-28 13:02:13.524 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:02:13] "OPTIONS / HTTP/1.0" 200 134 0.000524
Sep 28 13:02:13 ctl02 neutron-server[30536]: 2017-09-28 13:02:13.538 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 13:02:13 ctl02 nova-api[15210]: 2017-09-28 13:02:13.669 15210 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:02:13 ctl02 nova-api[15210]: 2017-09-28 13:02:13.671 15210 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:02:13 ctl02 nova-api[15210]: 2017-09-28 13:02:13.671 15210 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:02:13 ctl02 nova-api[15210]: 2017-09-28 13:02:13.671 15210 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:02:13 ctl02 nova-api[15210]: 2017-09-28 13:02:13.802 15210 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:02:13 ctl02 nova-api[15210]: 2017-09-28 13:02:13.804 15210 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:02:13 ctl02 nova-api[15210]: 2017-09-28 13:02:13.804 15210 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:02:13 ctl02 nova-api[15210]: 2017-09-28 13:02:13.805 15210 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:02:13 ctl02 nova-api[15210]: 2017-09-28 13:02:13.808 15210 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:02:13 ctl02 nova-api[15210]: 2017-09-28 13:02:13.808 15210 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:02:13 ctl02 nova-api[15210]: 2017-09-28 13:02:13.808 15210 ERROR nova Traceback (most recent call last):
Sep 28 13:02:13 ctl02 nova-api[15210]: 2017-09-28 13:02:13.808 15210 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:02:13 ctl02 nova-api[15210]: 2017-09-28 13:02:13.808 15210 ERROR nova     sys.exit(main())
Sep 28 13:02:13 ctl02 nova-api[15210]: 2017-09-28 13:02:13.808 15210 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:02:13 ctl02 nova-api[15210]: 2017-09-28 13:02:13.808 15210 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:02:13 ctl02 nova-api[15210]: 2017-09-28 13:02:13.808 15210 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:02:13 ctl02 nova-api[15210]: 2017-09-28 13:02:13.808 15210 ERROR nova     max_url_len=max_url_len)
Sep 28 13:02:13 ctl02 nova-api[15210]: 2017-09-28 13:02:13.808 15210 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:02:13 ctl02 nova-api[15210]: 2017-09-28 13:02:13.808 15210 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:02:13 ctl02 nova-api[15210]: 2017-09-28 13:02:13.808 15210 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:02:13 ctl02 nova-api[15210]: 2017-09-28 13:02:13.808 15210 ERROR nova     sock.listen(backlog)
Sep 28 13:02:13 ctl02 nova-api[15210]: 2017-09-28 13:02:13.808 15210 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:02:13 ctl02 nova-api[15210]: 2017-09-28 13:02:13.808 15210 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:02:13 ctl02 nova-api[15210]: 2017-09-28 13:02:13.808 15210 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:02:13 ctl02 nova-api[15210]: 2017-09-28 13:02:13.808 15210 ERROR nova
Sep 28 13:02:13 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:02:13 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:02:13 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:02:14 ctl02 neutron-server[30536]: 2017-09-28 13:02:14.107 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:02:14] "OPTIONS / HTTP/1.0" 200 262 0.000644
Sep 28 13:02:14 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:02:14 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:02:14 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:02:14 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:02:14 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:02:14.456 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:02:14] "OPTIONS / HTTP/1.0" 200 134 0.000482
Sep 28 13:02:14 ctl02 heat-api-cfn[13300]: 2017-09-28 13:02:14.861 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:02:14] "OPTIONS / HTTP/1.0" 200 134 0.000440
Sep 28 13:02:15 ctl02 nova-api[15233]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:02:15 ctl02 nova-api[15233]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:02:15 ctl02 heat-api-cfn[13300]: 2017-09-28 13:02:15.935 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:02:15] "OPTIONS / HTTP/1.0" 200 134 0.000462
Sep 28 13:02:16 ctl02 nova-api[15233]: 2017-09-28 13:02:15.999 15233 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:02:16 ctl02 nova-api[15233]: 2017-09-28 13:02:16.001 15233 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:02:16 ctl02 nova-api[15233]: 2017-09-28 13:02:16.001 15233 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:02:16 ctl02 nova-api[15233]: 2017-09-28 13:02:16.001 15233 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:02:16 ctl02 nova-api[15233]: 2017-09-28 13:02:16.001 15233 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:02:16 ctl02 nova-api[15233]: 2017-09-28 13:02:16.001 15233 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:02:16 ctl02 nova-api[15233]: 2017-09-28 13:02:16.001 15233 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:02:16 ctl02 nova-api[15233]: 2017-09-28 13:02:16.001 15233 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:02:16 ctl02 nova-api[15233]: 2017-09-28 13:02:16.001 15233 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:02:16 ctl02 nova-api[15233]: 2017-09-28 13:02:16.001 15233 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:02:16 ctl02 nova-api[15233]: 2017-09-28 13:02:16.001 15233 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:02:16 ctl02 nova-api[15233]: 2017-09-28 13:02:16.001 15233 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:02:16 ctl02 nova-api[15233]: 2017-09-28 13:02:16.001 15233 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:02:16 ctl02 nova-api[15233]: 2017-09-28 13:02:16.001 15233 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:02:16 ctl02 nova-api[15233]: 2017-09-28 13:02:16.001 15233 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:02:16 ctl02 nova-api[15233]: 2017-09-28 13:02:16.001 15233 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:02:16 ctl02 nova-api[15233]: 2017-09-28 13:02:16.001 15233 ERROR nova.wsgi     self.filename))
Sep 28 13:02:16 ctl02 nova-api[15233]: 2017-09-28 13:02:16.001 15233 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:02:16 ctl02 nova-api[15233]: 2017-09-28 13:02:16.001 15233 ERROR nova.wsgi
Sep 28 13:02:16 ctl02 nova-api[15233]: 2017-09-28 13:02:16.002 15233 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:02:16 ctl02 nova-api[15233]: 2017-09-28 13:02:16.139 15233 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:02:16 ctl02 nova-api[15233]: 2017-09-28 13:02:16.390 15233 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:02:16 ctl02 nova-api[15233]: 2017-09-28 13:02:16.392 15233 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:02:16 ctl02 nova-api[15233]: 2017-09-28 13:02:16.392 15233 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:02:16 ctl02 nova-api[15233]: 2017-09-28 13:02:16.393 15233 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:02:16 ctl02 nova-api[15233]: 2017-09-28 13:02:16.528 15233 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:02:16 ctl02 nova-api[15233]: 2017-09-28 13:02:16.531 15233 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:02:16 ctl02 nova-api[15233]: 2017-09-28 13:02:16.531 15233 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:02:16 ctl02 nova-api[15233]: 2017-09-28 13:02:16.531 15233 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:02:16 ctl02 nova-api[15233]: 2017-09-28 13:02:16.534 15233 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:02:16 ctl02 nova-api[15233]: 2017-09-28 13:02:16.535 15233 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:02:16 ctl02 nova-api[15233]: 2017-09-28 13:02:16.535 15233 ERROR nova Traceback (most recent call last):
Sep 28 13:02:16 ctl02 nova-api[15233]: 2017-09-28 13:02:16.535 15233 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:02:16 ctl02 nova-api[15233]: 2017-09-28 13:02:16.535 15233 ERROR nova     sys.exit(main())
Sep 28 13:02:16 ctl02 nova-api[15233]: 2017-09-28 13:02:16.535 15233 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:02:16 ctl02 nova-api[15233]: 2017-09-28 13:02:16.535 15233 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:02:16 ctl02 nova-api[15233]: 2017-09-28 13:02:16.535 15233 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:02:16 ctl02 nova-api[15233]: 2017-09-28 13:02:16.535 15233 ERROR nova     max_url_len=max_url_len)
Sep 28 13:02:16 ctl02 nova-api[15233]: 2017-09-28 13:02:16.535 15233 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:02:16 ctl02 nova-api[15233]: 2017-09-28 13:02:16.535 15233 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:02:16 ctl02 nova-api[15233]: 2017-09-28 13:02:16.535 15233 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:02:16 ctl02 nova-api[15233]: 2017-09-28 13:02:16.535 15233 ERROR nova     sock.listen(backlog)
Sep 28 13:02:16 ctl02 nova-api[15233]: 2017-09-28 13:02:16.535 15233 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:02:16 ctl02 nova-api[15233]: 2017-09-28 13:02:16.535 15233 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:02:16 ctl02 nova-api[15233]: 2017-09-28 13:02:16.535 15233 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:02:16 ctl02 nova-api[15233]: 2017-09-28 13:02:16.535 15233 ERROR nova
Sep 28 13:02:16 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:02:16 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:02:16 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:02:16 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:02:16 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:02:16 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:02:16 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:02:17 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:02:17.811 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:02:17] "OPTIONS / HTTP/1.0" 200 134 0.000385
Sep 28 13:02:17 ctl02 heat-api[13008]: 2017-09-28 13:02:17.888 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:02:17] "OPTIONS / HTTP/1.0" 200 134 0.000583
Sep 28 13:02:18 ctl02 neutron-server[30536]: 2017-09-28 13:02:18.194 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:02:18] "OPTIONS / HTTP/1.0" 200 262 0.000464
Sep 28 13:02:18 ctl02 nova-api[15250]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:02:18 ctl02 nova-api[15250]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:02:18 ctl02 nova-api[15250]: 2017-09-28 13:02:18.775 15250 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:02:18 ctl02 nova-api[15250]: 2017-09-28 13:02:18.777 15250 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:02:18 ctl02 nova-api[15250]: 2017-09-28 13:02:18.777 15250 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:02:18 ctl02 nova-api[15250]: 2017-09-28 13:02:18.777 15250 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:02:18 ctl02 nova-api[15250]: 2017-09-28 13:02:18.777 15250 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:02:18 ctl02 nova-api[15250]: 2017-09-28 13:02:18.777 15250 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:02:18 ctl02 nova-api[15250]: 2017-09-28 13:02:18.777 15250 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:02:18 ctl02 nova-api[15250]: 2017-09-28 13:02:18.777 15250 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:02:18 ctl02 nova-api[15250]: 2017-09-28 13:02:18.777 15250 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:02:18 ctl02 nova-api[15250]: 2017-09-28 13:02:18.777 15250 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:02:18 ctl02 nova-api[15250]: 2017-09-28 13:02:18.777 15250 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:02:18 ctl02 nova-api[15250]: 2017-09-28 13:02:18.777 15250 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:02:18 ctl02 nova-api[15250]: 2017-09-28 13:02:18.777 15250 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:02:18 ctl02 nova-api[15250]: 2017-09-28 13:02:18.777 15250 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:02:18 ctl02 nova-api[15250]: 2017-09-28 13:02:18.777 15250 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:02:18 ctl02 nova-api[15250]: 2017-09-28 13:02:18.777 15250 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:02:18 ctl02 nova-api[15250]: 2017-09-28 13:02:18.777 15250 ERROR nova.wsgi     self.filename))
Sep 28 13:02:18 ctl02 nova-api[15250]: 2017-09-28 13:02:18.777 15250 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:02:18 ctl02 nova-api[15250]: 2017-09-28 13:02:18.777 15250 ERROR nova.wsgi
Sep 28 13:02:18 ctl02 nova-api[15250]: 2017-09-28 13:02:18.778 15250 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:02:18 ctl02 nova-api[15250]: 2017-09-28 13:02:18.910 15250 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:02:19 ctl02 nova-api[15250]: 2017-09-28 13:02:19.142 15250 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:02:19 ctl02 nova-api[15250]: 2017-09-28 13:02:19.144 15250 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:02:19 ctl02 nova-api[15250]: 2017-09-28 13:02:19.144 15250 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:02:19 ctl02 nova-api[15250]: 2017-09-28 13:02:19.144 15250 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:02:19 ctl02 nova-api[15250]: 2017-09-28 13:02:19.281 15250 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:02:19 ctl02 nova-api[15250]: 2017-09-28 13:02:19.283 15250 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:02:19 ctl02 nova-api[15250]: 2017-09-28 13:02:19.283 15250 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:02:19 ctl02 nova-api[15250]: 2017-09-28 13:02:19.283 15250 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:02:19 ctl02 nova-api[15250]: 2017-09-28 13:02:19.286 15250 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:02:19 ctl02 nova-api[15250]: 2017-09-28 13:02:19.287 15250 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:02:19 ctl02 nova-api[15250]: 2017-09-28 13:02:19.287 15250 ERROR nova Traceback (most recent call last):
Sep 28 13:02:19 ctl02 nova-api[15250]: 2017-09-28 13:02:19.287 15250 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:02:19 ctl02 nova-api[15250]: 2017-09-28 13:02:19.287 15250 ERROR nova     sys.exit(main())
Sep 28 13:02:19 ctl02 nova-api[15250]: 2017-09-28 13:02:19.287 15250 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:02:19 ctl02 nova-api[15250]: 2017-09-28 13:02:19.287 15250 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:02:19 ctl02 nova-api[15250]: 2017-09-28 13:02:19.287 15250 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:02:19 ctl02 nova-api[15250]: 2017-09-28 13:02:19.287 15250 ERROR nova     max_url_len=max_url_len)
Sep 28 13:02:19 ctl02 nova-api[15250]: 2017-09-28 13:02:19.287 15250 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:02:19 ctl02 nova-api[15250]: 2017-09-28 13:02:19.287 15250 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:02:19 ctl02 nova-api[15250]: 2017-09-28 13:02:19.287 15250 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:02:19 ctl02 nova-api[15250]: 2017-09-28 13:02:19.287 15250 ERROR nova     sock.listen(backlog)
Sep 28 13:02:19 ctl02 nova-api[15250]: 2017-09-28 13:02:19.287 15250 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:02:19 ctl02 nova-api[15250]: 2017-09-28 13:02:19.287 15250 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:02:19 ctl02 nova-api[15250]: 2017-09-28 13:02:19.287 15250 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:02:19 ctl02 nova-api[15250]: 2017-09-28 13:02:19.287 15250 ERROR nova
Sep 28 13:02:19 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:02:19 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:02:19 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:02:19 ctl02 glance-api[29183]: 2017-09-28 13:02:19.534 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:02:19] "OPTIONS / HTTP/1.0" 200 134 0.000615
Sep 28 13:02:19 ctl02 heat-api[13008]: 2017-09-28 13:02:19.590 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:02:19] "OPTIONS / HTTP/1.0" 200 134 0.000593
Sep 28 13:02:19 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:02:19 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:02:19 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:02:19 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:02:19 ctl02 heat-api-cfn[13300]: 2017-09-28 13:02:19.913 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:02:19] "OPTIONS / HTTP/1.0" 200 134 0.000453
Sep 28 13:02:19 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6e198436)
Sep 28 13:02:20 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:02:20.876 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:02:20] "OPTIONS / HTTP/1.0" 200 134 0.000385
Sep 28 13:02:20 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6e198436)
Sep 28 13:02:21 ctl02 neutron-server[30536]: 2017-09-28 13:02:21.024 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 13:02:21 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 13:02:21 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 13:01:06 cmp002
Sep 28 13:02:21 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 13:00:58 cmp001
Sep 28 13:02:21 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 13:01:36 cmp002
Sep 28 13:02:21 ctl02 neutron-server[30536]: 2017-09-28 13:02:21.231 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:02:21] "OPTIONS / HTTP/1.0" 200 262 0.000560
Sep 28 13:02:21 ctl02 nova-api[15269]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:02:21 ctl02 nova-api[15269]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:02:21 ctl02 nova-api[15269]: 2017-09-28 13:02:21.475 15269 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:02:21 ctl02 nova-api[15269]: 2017-09-28 13:02:21.477 15269 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:02:21 ctl02 nova-api[15269]: 2017-09-28 13:02:21.477 15269 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:02:21 ctl02 nova-api[15269]: 2017-09-28 13:02:21.477 15269 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:02:21 ctl02 nova-api[15269]: 2017-09-28 13:02:21.477 15269 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:02:21 ctl02 nova-api[15269]: 2017-09-28 13:02:21.477 15269 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:02:21 ctl02 nova-api[15269]: 2017-09-28 13:02:21.477 15269 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:02:21 ctl02 nova-api[15269]: 2017-09-28 13:02:21.477 15269 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:02:21 ctl02 nova-api[15269]: 2017-09-28 13:02:21.477 15269 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:02:21 ctl02 nova-api[15269]: 2017-09-28 13:02:21.477 15269 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:02:21 ctl02 nova-api[15269]: 2017-09-28 13:02:21.477 15269 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:02:21 ctl02 nova-api[15269]: 2017-09-28 13:02:21.477 15269 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:02:21 ctl02 nova-api[15269]: 2017-09-28 13:02:21.477 15269 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:02:21 ctl02 nova-api[15269]: 2017-09-28 13:02:21.477 15269 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:02:21 ctl02 nova-api[15269]: 2017-09-28 13:02:21.477 15269 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:02:21 ctl02 nova-api[15269]: 2017-09-28 13:02:21.477 15269 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:02:21 ctl02 nova-api[15269]: 2017-09-28 13:02:21.477 15269 ERROR nova.wsgi     self.filename))
Sep 28 13:02:21 ctl02 nova-api[15269]: 2017-09-28 13:02:21.477 15269 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:02:21 ctl02 nova-api[15269]: 2017-09-28 13:02:21.477 15269 ERROR nova.wsgi
Sep 28 13:02:21 ctl02 nova-api[15269]: 2017-09-28 13:02:21.479 15269 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:02:21 ctl02 nova-api[15269]: 2017-09-28 13:02:21.606 15269 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:02:21 ctl02 glance-api[29183]: 2017-09-28 13:02:21.649 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:02:21] "OPTIONS / HTTP/1.0" 200 134 0.000564
Sep 28 13:02:21 ctl02 nova-api[15269]: 2017-09-28 13:02:21.829 15269 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:02:21 ctl02 nova-api[15269]: 2017-09-28 13:02:21.832 15269 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:02:21 ctl02 nova-api[15269]: 2017-09-28 13:02:21.832 15269 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:02:21 ctl02 nova-api[15269]: 2017-09-28 13:02:21.832 15269 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:02:21 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6e198436)
Sep 28 13:02:21 ctl02 nova-api[15269]: 2017-09-28 13:02:21.964 15269 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:02:21 ctl02 nova-api[15269]: 2017-09-28 13:02:21.966 15269 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:02:21 ctl02 nova-api[15269]: 2017-09-28 13:02:21.966 15269 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:02:21 ctl02 nova-api[15269]: 2017-09-28 13:02:21.966 15269 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:02:21 ctl02 nova-api[15269]: 2017-09-28 13:02:21.969 15269 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:02:21 ctl02 nova-api[15269]: 2017-09-28 13:02:21.970 15269 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:02:21 ctl02 nova-api[15269]: 2017-09-28 13:02:21.970 15269 ERROR nova Traceback (most recent call last):
Sep 28 13:02:21 ctl02 nova-api[15269]: 2017-09-28 13:02:21.970 15269 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:02:21 ctl02 nova-api[15269]: 2017-09-28 13:02:21.970 15269 ERROR nova     sys.exit(main())
Sep 28 13:02:21 ctl02 nova-api[15269]: 2017-09-28 13:02:21.970 15269 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:02:21 ctl02 nova-api[15269]: 2017-09-28 13:02:21.970 15269 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:02:21 ctl02 nova-api[15269]: 2017-09-28 13:02:21.970 15269 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:02:21 ctl02 nova-api[15269]: 2017-09-28 13:02:21.970 15269 ERROR nova     max_url_len=max_url_len)
Sep 28 13:02:21 ctl02 nova-api[15269]: 2017-09-28 13:02:21.970 15269 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:02:21 ctl02 nova-api[15269]: 2017-09-28 13:02:21.970 15269 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:02:21 ctl02 nova-api[15269]: 2017-09-28 13:02:21.970 15269 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:02:21 ctl02 nova-api[15269]: 2017-09-28 13:02:21.970 15269 ERROR nova     sock.listen(backlog)
Sep 28 13:02:21 ctl02 nova-api[15269]: 2017-09-28 13:02:21.970 15269 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:02:21 ctl02 nova-api[15269]: 2017-09-28 13:02:21.970 15269 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:02:21 ctl02 nova-api[15269]: 2017-09-28 13:02:21.970 15269 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:02:21 ctl02 nova-api[15269]: 2017-09-28 13:02:21.970 15269 ERROR nova
Sep 28 13:02:22 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:02:22 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:02:22 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:02:22 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:02:22 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:02:22 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:02:22 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:02:22 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6e198436)
Sep 28 13:02:23 ctl02 glance-api[29183]: 2017-09-28 13:02:23.139 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:02:23] "OPTIONS / HTTP/1.0" 200 134 0.000550
Sep 28 13:02:23 ctl02 heat-api[13008]: 2017-09-28 13:02:23.851 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:02:23] "OPTIONS / HTTP/1.0" 200 134 0.000515
Sep 28 13:02:23 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6e198436)
Sep 28 13:02:24 ctl02 nova-api[15287]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:02:24 ctl02 nova-api[15287]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:02:24 ctl02 nova-api[15287]: 2017-09-28 13:02:24.237 15287 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:02:24 ctl02 nova-api[15287]: 2017-09-28 13:02:24.238 15287 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:02:24 ctl02 nova-api[15287]: 2017-09-28 13:02:24.238 15287 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:02:24 ctl02 nova-api[15287]: 2017-09-28 13:02:24.238 15287 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:02:24 ctl02 nova-api[15287]: 2017-09-28 13:02:24.238 15287 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:02:24 ctl02 nova-api[15287]: 2017-09-28 13:02:24.238 15287 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:02:24 ctl02 nova-api[15287]: 2017-09-28 13:02:24.238 15287 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:02:24 ctl02 nova-api[15287]: 2017-09-28 13:02:24.238 15287 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:02:24 ctl02 nova-api[15287]: 2017-09-28 13:02:24.238 15287 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:02:24 ctl02 nova-api[15287]: 2017-09-28 13:02:24.238 15287 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:02:24 ctl02 nova-api[15287]: 2017-09-28 13:02:24.238 15287 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:02:24 ctl02 nova-api[15287]: 2017-09-28 13:02:24.238 15287 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:02:24 ctl02 nova-api[15287]: 2017-09-28 13:02:24.238 15287 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:02:24 ctl02 nova-api[15287]: 2017-09-28 13:02:24.238 15287 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:02:24 ctl02 nova-api[15287]: 2017-09-28 13:02:24.238 15287 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:02:24 ctl02 nova-api[15287]: 2017-09-28 13:02:24.238 15287 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:02:24 ctl02 nova-api[15287]: 2017-09-28 13:02:24.238 15287 ERROR nova.wsgi     self.filename))
Sep 28 13:02:24 ctl02 nova-api[15287]: 2017-09-28 13:02:24.238 15287 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:02:24 ctl02 nova-api[15287]: 2017-09-28 13:02:24.238 15287 ERROR nova.wsgi
Sep 28 13:02:24 ctl02 nova-api[15287]: 2017-09-28 13:02:24.239 15287 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:02:24 ctl02 nova-api[15287]: 2017-09-28 13:02:24.367 15287 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:02:24 ctl02 neutron-server[30536]: 2017-09-28 13:02:24.429 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:02:24] "OPTIONS / HTTP/1.0" 200 262 0.000599
Sep 28 13:02:24 ctl02 nova-api[15287]: 2017-09-28 13:02:24.586 15287 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:02:24 ctl02 nova-api[15287]: 2017-09-28 13:02:24.589 15287 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:02:24 ctl02 nova-api[15287]: 2017-09-28 13:02:24.589 15287 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:02:24 ctl02 nova-api[15287]: 2017-09-28 13:02:24.589 15287 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:02:24 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:02:24.707 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:02:24] "OPTIONS / HTTP/1.0" 200 134 0.000486
Sep 28 13:02:24 ctl02 nova-api[15287]: 2017-09-28 13:02:24.719 15287 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:02:24 ctl02 nova-api[15287]: 2017-09-28 13:02:24.720 15287 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:02:24 ctl02 nova-api[15287]: 2017-09-28 13:02:24.721 15287 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:02:24 ctl02 nova-api[15287]: 2017-09-28 13:02:24.721 15287 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:02:24 ctl02 nova-api[15287]: 2017-09-28 13:02:24.724 15287 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:02:24 ctl02 nova-api[15287]: 2017-09-28 13:02:24.724 15287 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:02:24 ctl02 nova-api[15287]: 2017-09-28 13:02:24.724 15287 ERROR nova Traceback (most recent call last):
Sep 28 13:02:24 ctl02 nova-api[15287]: 2017-09-28 13:02:24.724 15287 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:02:24 ctl02 nova-api[15287]: 2017-09-28 13:02:24.724 15287 ERROR nova     sys.exit(main())
Sep 28 13:02:24 ctl02 nova-api[15287]: 2017-09-28 13:02:24.724 15287 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:02:24 ctl02 nova-api[15287]: 2017-09-28 13:02:24.724 15287 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:02:24 ctl02 nova-api[15287]: 2017-09-28 13:02:24.724 15287 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:02:24 ctl02 nova-api[15287]: 2017-09-28 13:02:24.724 15287 ERROR nova     max_url_len=max_url_len)
Sep 28 13:02:24 ctl02 nova-api[15287]: 2017-09-28 13:02:24.724 15287 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:02:24 ctl02 nova-api[15287]: 2017-09-28 13:02:24.724 15287 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:02:24 ctl02 nova-api[15287]: 2017-09-28 13:02:24.724 15287 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:02:24 ctl02 nova-api[15287]: 2017-09-28 13:02:24.724 15287 ERROR nova     sock.listen(backlog)
Sep 28 13:02:24 ctl02 nova-api[15287]: 2017-09-28 13:02:24.724 15287 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:02:24 ctl02 nova-api[15287]: 2017-09-28 13:02:24.724 15287 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:02:24 ctl02 nova-api[15287]: 2017-09-28 13:02:24.724 15287 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:02:24 ctl02 nova-api[15287]: 2017-09-28 13:02:24.724 15287 ERROR nova
Sep 28 13:02:24 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:02:24 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:02:24 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:02:24 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6e198436)
Sep 28 13:02:25 ctl02 heat-api-cfn[13300]: 2017-09-28 13:02:25.074 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:02:25] "OPTIONS / HTTP/1.0" 200 134 0.000574
Sep 28 13:02:25 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:02:25 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:02:25 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:02:25 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:02:25 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6e198436)
Sep 28 13:02:26 ctl02 heat-api-cfn[13300]: 2017-09-28 13:02:26.129 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:02:26] "OPTIONS / HTTP/1.0" 200 134 0.000490
Sep 28 13:02:26 ctl02 nova-api[15305]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:02:26 ctl02 nova-api[15305]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:02:26 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6e198436)
Sep 28 13:02:27 ctl02 nova-api[15305]: 2017-09-28 13:02:27.054 15305 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:02:27 ctl02 nova-api[15305]: 2017-09-28 13:02:27.055 15305 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:02:27 ctl02 nova-api[15305]: 2017-09-28 13:02:27.055 15305 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:02:27 ctl02 nova-api[15305]: 2017-09-28 13:02:27.055 15305 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:02:27 ctl02 nova-api[15305]: 2017-09-28 13:02:27.055 15305 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:02:27 ctl02 nova-api[15305]: 2017-09-28 13:02:27.055 15305 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:02:27 ctl02 nova-api[15305]: 2017-09-28 13:02:27.055 15305 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:02:27 ctl02 nova-api[15305]: 2017-09-28 13:02:27.055 15305 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:02:27 ctl02 nova-api[15305]: 2017-09-28 13:02:27.055 15305 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:02:27 ctl02 nova-api[15305]: 2017-09-28 13:02:27.055 15305 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:02:27 ctl02 nova-api[15305]: 2017-09-28 13:02:27.055 15305 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:02:27 ctl02 nova-api[15305]: 2017-09-28 13:02:27.055 15305 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:02:27 ctl02 nova-api[15305]: 2017-09-28 13:02:27.055 15305 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:02:27 ctl02 nova-api[15305]: 2017-09-28 13:02:27.055 15305 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:02:27 ctl02 nova-api[15305]: 2017-09-28 13:02:27.055 15305 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:02:27 ctl02 nova-api[15305]: 2017-09-28 13:02:27.055 15305 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:02:27 ctl02 nova-api[15305]: 2017-09-28 13:02:27.055 15305 ERROR nova.wsgi     self.filename))
Sep 28 13:02:27 ctl02 nova-api[15305]: 2017-09-28 13:02:27.055 15305 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:02:27 ctl02 nova-api[15305]: 2017-09-28 13:02:27.055 15305 ERROR nova.wsgi
Sep 28 13:02:27 ctl02 nova-api[15305]: 2017-09-28 13:02:27.056 15305 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:02:27 ctl02 nova-api[15305]: 2017-09-28 13:02:27.191 15305 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:02:27 ctl02 nova-api[15305]: 2017-09-28 13:02:27.445 15305 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:02:27 ctl02 nova-api[15305]: 2017-09-28 13:02:27.447 15305 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:02:27 ctl02 nova-api[15305]: 2017-09-28 13:02:27.447 15305 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:02:27 ctl02 nova-api[15305]: 2017-09-28 13:02:27.448 15305 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:02:27 ctl02 heat-api[13008]: 2017-09-28 13:02:27.547 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:02:27] "OPTIONS / HTTP/1.0" 200 134 0.000615
Sep 28 13:02:27 ctl02 nova-api[15305]: 2017-09-28 13:02:27.583 15305 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:02:27 ctl02 nova-api[15305]: 2017-09-28 13:02:27.585 15305 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:02:27 ctl02 nova-api[15305]: 2017-09-28 13:02:27.585 15305 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:02:27 ctl02 nova-api[15305]: 2017-09-28 13:02:27.585 15305 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:02:27 ctl02 nova-api[15305]: 2017-09-28 13:02:27.589 15305 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:02:27 ctl02 nova-api[15305]: 2017-09-28 13:02:27.589 15305 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:02:27 ctl02 nova-api[15305]: 2017-09-28 13:02:27.589 15305 ERROR nova Traceback (most recent call last):
Sep 28 13:02:27 ctl02 nova-api[15305]: 2017-09-28 13:02:27.589 15305 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:02:27 ctl02 nova-api[15305]: 2017-09-28 13:02:27.589 15305 ERROR nova     sys.exit(main())
Sep 28 13:02:27 ctl02 nova-api[15305]: 2017-09-28 13:02:27.589 15305 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:02:27 ctl02 nova-api[15305]: 2017-09-28 13:02:27.589 15305 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:02:27 ctl02 nova-api[15305]: 2017-09-28 13:02:27.589 15305 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:02:27 ctl02 nova-api[15305]: 2017-09-28 13:02:27.589 15305 ERROR nova     max_url_len=max_url_len)
Sep 28 13:02:27 ctl02 nova-api[15305]: 2017-09-28 13:02:27.589 15305 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:02:27 ctl02 nova-api[15305]: 2017-09-28 13:02:27.589 15305 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:02:27 ctl02 nova-api[15305]: 2017-09-28 13:02:27.589 15305 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:02:27 ctl02 nova-api[15305]: 2017-09-28 13:02:27.589 15305 ERROR nova     sock.listen(backlog)
Sep 28 13:02:27 ctl02 nova-api[15305]: 2017-09-28 13:02:27.589 15305 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:02:27 ctl02 nova-api[15305]: 2017-09-28 13:02:27.589 15305 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:02:27 ctl02 nova-api[15305]: 2017-09-28 13:02:27.589 15305 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:02:27 ctl02 nova-api[15305]: 2017-09-28 13:02:27.589 15305 ERROR nova
Sep 28 13:02:27 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:02:27 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:02:27 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:02:27 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:02:27 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:02:27 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:02:27 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:02:27 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6e198436)
Sep 28 13:02:28 ctl02 neutron-server[30536]: 2017-09-28 13:02:28.003 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:02:28] "OPTIONS / HTTP/1.0" 200 262 0.000476
Sep 28 13:02:28 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:02:28.065 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:02:28] "OPTIONS / HTTP/1.0" 200 134 0.000371
Sep 28 13:02:28 ctl02 neutron-server[30536]: 2017-09-28 13:02:28.535 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 13:02:28 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6e198436)
Sep 28 13:02:29 ctl02 nova-api[15323]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:02:29 ctl02 nova-api[15323]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:02:29 ctl02 glance-api[29183]: 2017-09-28 13:02:29.587 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:02:29] "OPTIONS / HTTP/1.0" 200 134 0.000756
Sep 28 13:02:29 ctl02 nova-api[15323]: 2017-09-28 13:02:29.729 15323 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:02:29 ctl02 nova-api[15323]: 2017-09-28 13:02:29.731 15323 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:02:29 ctl02 nova-api[15323]: 2017-09-28 13:02:29.731 15323 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:02:29 ctl02 nova-api[15323]: 2017-09-28 13:02:29.731 15323 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:02:29 ctl02 nova-api[15323]: 2017-09-28 13:02:29.731 15323 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:02:29 ctl02 nova-api[15323]: 2017-09-28 13:02:29.731 15323 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:02:29 ctl02 nova-api[15323]: 2017-09-28 13:02:29.731 15323 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:02:29 ctl02 nova-api[15323]: 2017-09-28 13:02:29.731 15323 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:02:29 ctl02 nova-api[15323]: 2017-09-28 13:02:29.731 15323 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:02:29 ctl02 nova-api[15323]: 2017-09-28 13:02:29.731 15323 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:02:29 ctl02 nova-api[15323]: 2017-09-28 13:02:29.731 15323 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:02:29 ctl02 nova-api[15323]: 2017-09-28 13:02:29.731 15323 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:02:29 ctl02 nova-api[15323]: 2017-09-28 13:02:29.731 15323 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:02:29 ctl02 nova-api[15323]: 2017-09-28 13:02:29.731 15323 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:02:29 ctl02 nova-api[15323]: 2017-09-28 13:02:29.731 15323 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:02:29 ctl02 nova-api[15323]: 2017-09-28 13:02:29.731 15323 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:02:29 ctl02 nova-api[15323]: 2017-09-28 13:02:29.731 15323 ERROR nova.wsgi     self.filename))
Sep 28 13:02:29 ctl02 nova-api[15323]: 2017-09-28 13:02:29.731 15323 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:02:29 ctl02 nova-api[15323]: 2017-09-28 13:02:29.731 15323 ERROR nova.wsgi
Sep 28 13:02:29 ctl02 nova-api[15323]: 2017-09-28 13:02:29.731 15323 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:02:29 ctl02 nova-api[15323]: 2017-09-28 13:02:29.858 15323 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:02:29 ctl02 heat-api[13008]: 2017-09-28 13:02:29.957 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:02:29] "OPTIONS / HTTP/1.0" 200 134 0.000626
Sep 28 13:02:29 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6e198436)
Sep 28 13:02:30 ctl02 nova-api[15323]: 2017-09-28 13:02:30.126 15323 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:02:30 ctl02 nova-api[15323]: 2017-09-28 13:02:30.129 15323 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:02:30 ctl02 nova-api[15323]: 2017-09-28 13:02:30.129 15323 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:02:30 ctl02 nova-api[15323]: 2017-09-28 13:02:30.129 15323 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:02:30 ctl02 nova-api[15323]: 2017-09-28 13:02:30.262 15323 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:02:30 ctl02 nova-api[15323]: 2017-09-28 13:02:30.264 15323 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:02:30 ctl02 nova-api[15323]: 2017-09-28 13:02:30.264 15323 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:02:30 ctl02 nova-api[15323]: 2017-09-28 13:02:30.265 15323 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:02:30 ctl02 nova-api[15323]: 2017-09-28 13:02:30.268 15323 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:02:30 ctl02 nova-api[15323]: 2017-09-28 13:02:30.268 15323 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:02:30 ctl02 nova-api[15323]: 2017-09-28 13:02:30.268 15323 ERROR nova Traceback (most recent call last):
Sep 28 13:02:30 ctl02 nova-api[15323]: 2017-09-28 13:02:30.268 15323 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:02:30 ctl02 nova-api[15323]: 2017-09-28 13:02:30.268 15323 ERROR nova     sys.exit(main())
Sep 28 13:02:30 ctl02 nova-api[15323]: 2017-09-28 13:02:30.268 15323 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:02:30 ctl02 nova-api[15323]: 2017-09-28 13:02:30.268 15323 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:02:30 ctl02 nova-api[15323]: 2017-09-28 13:02:30.268 15323 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:02:30 ctl02 nova-api[15323]: 2017-09-28 13:02:30.268 15323 ERROR nova     max_url_len=max_url_len)
Sep 28 13:02:30 ctl02 nova-api[15323]: 2017-09-28 13:02:30.268 15323 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:02:30 ctl02 nova-api[15323]: 2017-09-28 13:02:30.268 15323 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:02:30 ctl02 nova-api[15323]: 2017-09-28 13:02:30.268 15323 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:02:30 ctl02 nova-api[15323]: 2017-09-28 13:02:30.268 15323 ERROR nova     sock.listen(backlog)
Sep 28 13:02:30 ctl02 nova-api[15323]: 2017-09-28 13:02:30.268 15323 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:02:30 ctl02 nova-api[15323]: 2017-09-28 13:02:30.268 15323 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:02:30 ctl02 nova-api[15323]: 2017-09-28 13:02:30.268 15323 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:02:30 ctl02 nova-api[15323]: 2017-09-28 13:02:30.268 15323 ERROR nova
Sep 28 13:02:30 ctl02 heat-api-cfn[13300]: 2017-09-28 13:02:30.295 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:02:30] "OPTIONS / HTTP/1.0" 200 134 0.000527
Sep 28 13:02:30 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:02:30 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:02:30 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:02:30 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:02:30 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:02:30 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:02:30 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:02:30 ctl02 neutron-server[30536]: 2017-09-28 13:02:30.885 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:02:30] "OPTIONS / HTTP/1.0" 200 262 0.000543
Sep 28 13:02:30 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 13:02:30 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 13:02:31 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:02:31.235 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:02:31] "OPTIONS / HTTP/1.0" 200 134 0.000582
Sep 28 13:02:31 ctl02 nova-conductor[5056]: 2017-09-28 13:02:31.293 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:02:31 ctl02 nova-conductor[5056]: 2017-09-28 13:02:31.303 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:02:31 ctl02 nova-conductor[5056]: 2017-09-28 13:02:31.310 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:02:31 ctl02 nova-conductor[5056]: 2017-09-28 13:02:31.310 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:02:31 ctl02 nova-cert[4860]: 2017-09-28 13:02:31.987 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:02:32 ctl02 glance-api[29183]: 2017-09-28 13:02:32.035 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:02:32] "OPTIONS / HTTP/1.0" 200 134 0.000701
Sep 28 13:02:32 ctl02 nova-api[15341]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:02:32 ctl02 nova-api[15341]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:02:32 ctl02 nova-api[15341]: 2017-09-28 13:02:32.571 15341 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:02:32 ctl02 nova-api[15341]: 2017-09-28 13:02:32.572 15341 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:02:32 ctl02 nova-api[15341]: 2017-09-28 13:02:32.572 15341 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:02:32 ctl02 nova-api[15341]: 2017-09-28 13:02:32.572 15341 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:02:32 ctl02 nova-api[15341]: 2017-09-28 13:02:32.572 15341 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:02:32 ctl02 nova-api[15341]: 2017-09-28 13:02:32.572 15341 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:02:32 ctl02 nova-api[15341]: 2017-09-28 13:02:32.572 15341 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:02:32 ctl02 nova-api[15341]: 2017-09-28 13:02:32.572 15341 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:02:32 ctl02 nova-api[15341]: 2017-09-28 13:02:32.572 15341 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:02:32 ctl02 nova-api[15341]: 2017-09-28 13:02:32.572 15341 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:02:32 ctl02 nova-api[15341]: 2017-09-28 13:02:32.572 15341 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:02:32 ctl02 nova-api[15341]: 2017-09-28 13:02:32.572 15341 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:02:32 ctl02 nova-api[15341]: 2017-09-28 13:02:32.572 15341 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:02:32 ctl02 nova-api[15341]: 2017-09-28 13:02:32.572 15341 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:02:32 ctl02 nova-api[15341]: 2017-09-28 13:02:32.572 15341 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:02:32 ctl02 nova-api[15341]: 2017-09-28 13:02:32.572 15341 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:02:32 ctl02 nova-api[15341]: 2017-09-28 13:02:32.572 15341 ERROR nova.wsgi     self.filename))
Sep 28 13:02:32 ctl02 nova-api[15341]: 2017-09-28 13:02:32.572 15341 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:02:32 ctl02 nova-api[15341]: 2017-09-28 13:02:32.572 15341 ERROR nova.wsgi
Sep 28 13:02:32 ctl02 nova-api[15341]: 2017-09-28 13:02:32.573 15341 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:02:32 ctl02 nova-api[15341]: 2017-09-28 13:02:32.703 15341 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:02:32 ctl02 nova-api[15341]: 2017-09-28 13:02:32.957 15341 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:02:32 ctl02 nova-api[15341]: 2017-09-28 13:02:32.959 15341 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:02:32 ctl02 nova-api[15341]: 2017-09-28 13:02:32.959 15341 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:02:32 ctl02 nova-api[15341]: 2017-09-28 13:02:32.960 15341 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:02:33 ctl02 nova-api[15341]: 2017-09-28 13:02:33.093 15341 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:02:33 ctl02 nova-api[15341]: 2017-09-28 13:02:33.095 15341 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:02:33 ctl02 nova-api[15341]: 2017-09-28 13:02:33.096 15341 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:02:33 ctl02 nova-api[15341]: 2017-09-28 13:02:33.096 15341 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:02:33 ctl02 nova-api[15341]: 2017-09-28 13:02:33.100 15341 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:02:33 ctl02 nova-api[15341]: 2017-09-28 13:02:33.100 15341 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:02:33 ctl02 nova-api[15341]: 2017-09-28 13:02:33.100 15341 ERROR nova Traceback (most recent call last):
Sep 28 13:02:33 ctl02 nova-api[15341]: 2017-09-28 13:02:33.100 15341 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:02:33 ctl02 nova-api[15341]: 2017-09-28 13:02:33.100 15341 ERROR nova     sys.exit(main())
Sep 28 13:02:33 ctl02 nova-api[15341]: 2017-09-28 13:02:33.100 15341 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:02:33 ctl02 nova-api[15341]: 2017-09-28 13:02:33.100 15341 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:02:33 ctl02 nova-api[15341]: 2017-09-28 13:02:33.100 15341 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:02:33 ctl02 nova-api[15341]: 2017-09-28 13:02:33.100 15341 ERROR nova     max_url_len=max_url_len)
Sep 28 13:02:33 ctl02 nova-api[15341]: 2017-09-28 13:02:33.100 15341 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:02:33 ctl02 nova-api[15341]: 2017-09-28 13:02:33.100 15341 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:02:33 ctl02 nova-api[15341]: 2017-09-28 13:02:33.100 15341 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:02:33 ctl02 nova-api[15341]: 2017-09-28 13:02:33.100 15341 ERROR nova     sock.listen(backlog)
Sep 28 13:02:33 ctl02 nova-api[15341]: 2017-09-28 13:02:33.100 15341 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:02:33 ctl02 nova-api[15341]: 2017-09-28 13:02:33.100 15341 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:02:33 ctl02 nova-api[15341]: 2017-09-28 13:02:33.100 15341 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:02:33 ctl02 nova-api[15341]: 2017-09-28 13:02:33.100 15341 ERROR nova
Sep 28 13:02:33 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:02:33 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:02:33 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:02:33 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:02:33 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:02:33 ctl02 glance-api[29183]: 2017-09-28 13:02:33.388 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:02:33] "OPTIONS / HTTP/1.0" 200 134 0.000709
Sep 28 13:02:33 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:02:33 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:02:33 ctl02 heat-api[13008]: 2017-09-28 13:02:33.521 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:02:33] "OPTIONS / HTTP/1.0" 200 134 0.000602
Sep 28 13:02:34 ctl02 neutron-server[30536]: 2017-09-28 13:02:34.313 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:02:34] "OPTIONS / HTTP/1.0" 200 262 0.000554
Sep 28 13:02:34 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:02:34.804 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:02:34] "OPTIONS / HTTP/1.0" 200 134 0.000605
Sep 28 13:02:34 ctl02 heat-api-cfn[13300]: 2017-09-28 13:02:34.978 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:02:34] "OPTIONS / HTTP/1.0" 200 134 0.000661
Sep 28 13:02:35 ctl02 nova-api[15363]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:02:35 ctl02 nova-api[15363]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:02:35 ctl02 nova-api[15363]: 2017-09-28 13:02:35.315 15363 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:02:35 ctl02 nova-api[15363]: 2017-09-28 13:02:35.316 15363 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:02:35 ctl02 nova-api[15363]: 2017-09-28 13:02:35.316 15363 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:02:35 ctl02 nova-api[15363]: 2017-09-28 13:02:35.316 15363 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:02:35 ctl02 nova-api[15363]: 2017-09-28 13:02:35.316 15363 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:02:35 ctl02 nova-api[15363]: 2017-09-28 13:02:35.316 15363 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:02:35 ctl02 nova-api[15363]: 2017-09-28 13:02:35.316 15363 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:02:35 ctl02 nova-api[15363]: 2017-09-28 13:02:35.316 15363 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:02:35 ctl02 nova-api[15363]: 2017-09-28 13:02:35.316 15363 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:02:35 ctl02 nova-api[15363]: 2017-09-28 13:02:35.316 15363 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:02:35 ctl02 nova-api[15363]: 2017-09-28 13:02:35.316 15363 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:02:35 ctl02 nova-api[15363]: 2017-09-28 13:02:35.316 15363 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:02:35 ctl02 nova-api[15363]: 2017-09-28 13:02:35.316 15363 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:02:35 ctl02 nova-api[15363]: 2017-09-28 13:02:35.316 15363 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:02:35 ctl02 nova-api[15363]: 2017-09-28 13:02:35.316 15363 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:02:35 ctl02 nova-api[15363]: 2017-09-28 13:02:35.316 15363 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:02:35 ctl02 nova-api[15363]: 2017-09-28 13:02:35.316 15363 ERROR nova.wsgi     self.filename))
Sep 28 13:02:35 ctl02 nova-api[15363]: 2017-09-28 13:02:35.316 15363 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:02:35 ctl02 nova-api[15363]: 2017-09-28 13:02:35.316 15363 ERROR nova.wsgi
Sep 28 13:02:35 ctl02 nova-api[15363]: 2017-09-28 13:02:35.317 15363 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:02:35 ctl02 nova-api[15363]: 2017-09-28 13:02:35.455 15363 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:02:35 ctl02 nova-api[15363]: 2017-09-28 13:02:35.708 15363 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:02:35 ctl02 nova-api[15363]: 2017-09-28 13:02:35.711 15363 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:02:35 ctl02 nova-api[15363]: 2017-09-28 13:02:35.711 15363 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:02:35 ctl02 nova-api[15363]: 2017-09-28 13:02:35.711 15363 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:02:35 ctl02 nova-api[15363]: 2017-09-28 13:02:35.845 15363 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:02:35 ctl02 nova-api[15363]: 2017-09-28 13:02:35.847 15363 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:02:35 ctl02 nova-api[15363]: 2017-09-28 13:02:35.847 15363 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:02:35 ctl02 nova-api[15363]: 2017-09-28 13:02:35.847 15363 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:02:35 ctl02 nova-api[15363]: 2017-09-28 13:02:35.850 15363 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:02:35 ctl02 nova-api[15363]: 2017-09-28 13:02:35.851 15363 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:02:35 ctl02 nova-api[15363]: 2017-09-28 13:02:35.851 15363 ERROR nova Traceback (most recent call last):
Sep 28 13:02:35 ctl02 nova-api[15363]: 2017-09-28 13:02:35.851 15363 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:02:35 ctl02 nova-api[15363]: 2017-09-28 13:02:35.851 15363 ERROR nova     sys.exit(main())
Sep 28 13:02:35 ctl02 nova-api[15363]: 2017-09-28 13:02:35.851 15363 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:02:35 ctl02 nova-api[15363]: 2017-09-28 13:02:35.851 15363 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:02:35 ctl02 nova-api[15363]: 2017-09-28 13:02:35.851 15363 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:02:35 ctl02 nova-api[15363]: 2017-09-28 13:02:35.851 15363 ERROR nova     max_url_len=max_url_len)
Sep 28 13:02:35 ctl02 nova-api[15363]: 2017-09-28 13:02:35.851 15363 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:02:35 ctl02 nova-api[15363]: 2017-09-28 13:02:35.851 15363 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:02:35 ctl02 nova-api[15363]: 2017-09-28 13:02:35.851 15363 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:02:35 ctl02 nova-api[15363]: 2017-09-28 13:02:35.851 15363 ERROR nova     sock.listen(backlog)
Sep 28 13:02:35 ctl02 nova-api[15363]: 2017-09-28 13:02:35.851 15363 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:02:35 ctl02 nova-api[15363]: 2017-09-28 13:02:35.851 15363 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:02:35 ctl02 nova-api[15363]: 2017-09-28 13:02:35.851 15363 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:02:35 ctl02 nova-api[15363]: 2017-09-28 13:02:35.851 15363 ERROR nova
Sep 28 13:02:36 ctl02 neutron-server[30536]: 2017-09-28 13:02:36.022 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 13:02:36 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 13:02:36 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 13:01:06 cmp002
Sep 28 13:02:36 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 13:00:58 cmp001
Sep 28 13:02:36 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 13:01:36 cmp002
Sep 28 13:02:36 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:02:36 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:02:36 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:02:36 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:02:36 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:02:36 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:02:36 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:02:36 ctl02 heat-api-cfn[13300]: 2017-09-28 13:02:36.164 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:02:36] "OPTIONS / HTTP/1.0" 200 134 0.000523
Sep 28 13:02:36 ctl02 neutron-server[30536]: 2017-09-28 13:02:36.188 30601 WARNING oslo_messaging._drivers.amqpdriver [req-64559a12-3189-468f-890c-b82e173018d7 - - - - -] reply_a13a20a54b91453780e36bdf20a855d2 doesn't exists, drop reply to 3a06d16d1cf142fa8d758acf2b5acc50
Sep 28 13:02:36 ctl02 neutron-server[30536]: 2017-09-28 13:02:36.189 30601 INFO oslo_messaging._drivers.amqpdriver [req-64559a12-3189-468f-890c-b82e173018d7 - - - - -] The reply 3a06d16d1cf142fa8d758acf2b5acc50 cannot be sent  reply_a13a20a54b91453780e36bdf20a855d2 reply queue don't exist after 60 sec abandoning...
Sep 28 13:02:37 ctl02 heat-api[13008]: 2017-09-28 13:02:37.346 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:02:37] "OPTIONS / HTTP/1.0" 200 134 0.000597
Sep 28 13:02:37 ctl02 neutron-server[30536]: 2017-09-28 13:02:37.704 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:02:37] "OPTIONS / HTTP/1.0" 200 262 0.000549
Sep 28 13:02:37 ctl02 nova-api[15381]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:02:37 ctl02 nova-api[15381]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:02:37 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:02:37.867 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:02:37] "OPTIONS / HTTP/1.0" 200 134 0.000570
Sep 28 13:02:38 ctl02 nova-api[15381]: 2017-09-28 13:02:38.027 15381 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:02:38 ctl02 nova-api[15381]: 2017-09-28 13:02:38.028 15381 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:02:38 ctl02 nova-api[15381]: 2017-09-28 13:02:38.028 15381 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:02:38 ctl02 nova-api[15381]: 2017-09-28 13:02:38.028 15381 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:02:38 ctl02 nova-api[15381]: 2017-09-28 13:02:38.028 15381 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:02:38 ctl02 nova-api[15381]: 2017-09-28 13:02:38.028 15381 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:02:38 ctl02 nova-api[15381]: 2017-09-28 13:02:38.028 15381 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:02:38 ctl02 nova-api[15381]: 2017-09-28 13:02:38.028 15381 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:02:38 ctl02 nova-api[15381]: 2017-09-28 13:02:38.028 15381 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:02:38 ctl02 nova-api[15381]: 2017-09-28 13:02:38.028 15381 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:02:38 ctl02 nova-api[15381]: 2017-09-28 13:02:38.028 15381 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:02:38 ctl02 nova-api[15381]: 2017-09-28 13:02:38.028 15381 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:02:38 ctl02 nova-api[15381]: 2017-09-28 13:02:38.028 15381 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:02:38 ctl02 nova-api[15381]: 2017-09-28 13:02:38.028 15381 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:02:38 ctl02 nova-api[15381]: 2017-09-28 13:02:38.028 15381 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:02:38 ctl02 nova-api[15381]: 2017-09-28 13:02:38.028 15381 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:02:38 ctl02 nova-api[15381]: 2017-09-28 13:02:38.028 15381 ERROR nova.wsgi     self.filename))
Sep 28 13:02:38 ctl02 nova-api[15381]: 2017-09-28 13:02:38.028 15381 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:02:38 ctl02 nova-api[15381]: 2017-09-28 13:02:38.028 15381 ERROR nova.wsgi
Sep 28 13:02:38 ctl02 nova-api[15381]: 2017-09-28 13:02:38.029 15381 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:02:38 ctl02 nova-api[15381]: 2017-09-28 13:02:38.163 15381 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:02:38 ctl02 nova-api[15381]: 2017-09-28 13:02:38.414 15381 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:02:38 ctl02 nova-api[15381]: 2017-09-28 13:02:38.416 15381 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:02:38 ctl02 nova-api[15381]: 2017-09-28 13:02:38.416 15381 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:02:38 ctl02 nova-api[15381]: 2017-09-28 13:02:38.417 15381 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:02:38 ctl02 nova-api[15381]: 2017-09-28 13:02:38.549 15381 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:02:38 ctl02 nova-api[15381]: 2017-09-28 13:02:38.551 15381 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:02:38 ctl02 nova-api[15381]: 2017-09-28 13:02:38.551 15381 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:02:38 ctl02 nova-api[15381]: 2017-09-28 13:02:38.551 15381 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:02:38 ctl02 nova-api[15381]: 2017-09-28 13:02:38.555 15381 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:02:38 ctl02 nova-api[15381]: 2017-09-28 13:02:38.555 15381 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:02:38 ctl02 nova-api[15381]: 2017-09-28 13:02:38.555 15381 ERROR nova Traceback (most recent call last):
Sep 28 13:02:38 ctl02 nova-api[15381]: 2017-09-28 13:02:38.555 15381 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:02:38 ctl02 nova-api[15381]: 2017-09-28 13:02:38.555 15381 ERROR nova     sys.exit(main())
Sep 28 13:02:38 ctl02 nova-api[15381]: 2017-09-28 13:02:38.555 15381 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:02:38 ctl02 nova-api[15381]: 2017-09-28 13:02:38.555 15381 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:02:38 ctl02 nova-api[15381]: 2017-09-28 13:02:38.555 15381 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:02:38 ctl02 nova-api[15381]: 2017-09-28 13:02:38.555 15381 ERROR nova     max_url_len=max_url_len)
Sep 28 13:02:38 ctl02 nova-api[15381]: 2017-09-28 13:02:38.555 15381 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:02:38 ctl02 nova-api[15381]: 2017-09-28 13:02:38.555 15381 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:02:38 ctl02 nova-api[15381]: 2017-09-28 13:02:38.555 15381 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:02:38 ctl02 nova-api[15381]: 2017-09-28 13:02:38.555 15381 ERROR nova     sock.listen(backlog)
Sep 28 13:02:38 ctl02 nova-api[15381]: 2017-09-28 13:02:38.555 15381 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:02:38 ctl02 nova-api[15381]: 2017-09-28 13:02:38.555 15381 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:02:38 ctl02 nova-api[15381]: 2017-09-28 13:02:38.555 15381 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:02:38 ctl02 nova-api[15381]: 2017-09-28 13:02:38.555 15381 ERROR nova
Sep 28 13:02:38 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:02:38 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:02:38 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:02:38 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:02:38 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:02:38 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:02:38 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:02:39 ctl02 glance-api[29183]: 2017-09-28 13:02:39.702 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:02:39] "OPTIONS / HTTP/1.0" 200 134 0.000635
Sep 28 13:02:39 ctl02 heat-api-cfn[13300]: 2017-09-28 13:02:39.984 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:02:39] "OPTIONS / HTTP/1.0" 200 134 0.000532
Sep 28 13:02:40 ctl02 heat-api[13008]: 2017-09-28 13:02:40.315 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:02:40] "OPTIONS / HTTP/1.0" 200 134 0.000650
Sep 28 13:02:40 ctl02 nova-api[15399]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:02:40 ctl02 nova-api[15399]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:02:40 ctl02 neutron-server[30536]: 2017-09-28 13:02:40.601 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:02:40] "OPTIONS / HTTP/1.0" 200 262 0.000573
Sep 28 13:02:40 ctl02 nova-api[15399]: 2017-09-28 13:02:40.794 15399 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:02:40 ctl02 nova-api[15399]: 2017-09-28 13:02:40.795 15399 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:02:40 ctl02 nova-api[15399]: 2017-09-28 13:02:40.795 15399 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:02:40 ctl02 nova-api[15399]: 2017-09-28 13:02:40.795 15399 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:02:40 ctl02 nova-api[15399]: 2017-09-28 13:02:40.795 15399 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:02:40 ctl02 nova-api[15399]: 2017-09-28 13:02:40.795 15399 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:02:40 ctl02 nova-api[15399]: 2017-09-28 13:02:40.795 15399 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:02:40 ctl02 nova-api[15399]: 2017-09-28 13:02:40.795 15399 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:02:40 ctl02 nova-api[15399]: 2017-09-28 13:02:40.795 15399 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:02:40 ctl02 nova-api[15399]: 2017-09-28 13:02:40.795 15399 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:02:40 ctl02 nova-api[15399]: 2017-09-28 13:02:40.795 15399 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:02:40 ctl02 nova-api[15399]: 2017-09-28 13:02:40.795 15399 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:02:40 ctl02 nova-api[15399]: 2017-09-28 13:02:40.795 15399 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:02:40 ctl02 nova-api[15399]: 2017-09-28 13:02:40.795 15399 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:02:40 ctl02 nova-api[15399]: 2017-09-28 13:02:40.795 15399 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:02:40 ctl02 nova-api[15399]: 2017-09-28 13:02:40.795 15399 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:02:40 ctl02 nova-api[15399]: 2017-09-28 13:02:40.795 15399 ERROR nova.wsgi     self.filename))
Sep 28 13:02:40 ctl02 nova-api[15399]: 2017-09-28 13:02:40.795 15399 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:02:40 ctl02 nova-api[15399]: 2017-09-28 13:02:40.795 15399 ERROR nova.wsgi
Sep 28 13:02:40 ctl02 nova-api[15399]: 2017-09-28 13:02:40.796 15399 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:02:40 ctl02 nova-api[15399]: 2017-09-28 13:02:40.935 15399 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:02:41 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:02:41.096 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:02:41] "OPTIONS / HTTP/1.0" 200 134 0.000582
Sep 28 13:02:41 ctl02 nova-api[15399]: 2017-09-28 13:02:41.188 15399 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:02:41 ctl02 nova-api[15399]: 2017-09-28 13:02:41.190 15399 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:02:41 ctl02 nova-api[15399]: 2017-09-28 13:02:41.190 15399 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:02:41 ctl02 nova-api[15399]: 2017-09-28 13:02:41.191 15399 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:02:41 ctl02 nova-api[15399]: 2017-09-28 13:02:41.330 15399 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:02:41 ctl02 nova-api[15399]: 2017-09-28 13:02:41.342 15399 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:02:41 ctl02 nova-api[15399]: 2017-09-28 13:02:41.342 15399 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:02:41 ctl02 nova-api[15399]: 2017-09-28 13:02:41.343 15399 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:02:41 ctl02 nova-api[15399]: 2017-09-28 13:02:41.347 15399 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:02:41 ctl02 nova-api[15399]: 2017-09-28 13:02:41.347 15399 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:02:41 ctl02 nova-api[15399]: 2017-09-28 13:02:41.347 15399 ERROR nova Traceback (most recent call last):
Sep 28 13:02:41 ctl02 nova-api[15399]: 2017-09-28 13:02:41.347 15399 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:02:41 ctl02 nova-api[15399]: 2017-09-28 13:02:41.347 15399 ERROR nova     sys.exit(main())
Sep 28 13:02:41 ctl02 nova-api[15399]: 2017-09-28 13:02:41.347 15399 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:02:41 ctl02 nova-api[15399]: 2017-09-28 13:02:41.347 15399 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:02:41 ctl02 nova-api[15399]: 2017-09-28 13:02:41.347 15399 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:02:41 ctl02 nova-api[15399]: 2017-09-28 13:02:41.347 15399 ERROR nova     max_url_len=max_url_len)
Sep 28 13:02:41 ctl02 nova-api[15399]: 2017-09-28 13:02:41.347 15399 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:02:41 ctl02 nova-api[15399]: 2017-09-28 13:02:41.347 15399 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:02:41 ctl02 nova-api[15399]: 2017-09-28 13:02:41.347 15399 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:02:41 ctl02 nova-api[15399]: 2017-09-28 13:02:41.347 15399 ERROR nova     sock.listen(backlog)
Sep 28 13:02:41 ctl02 nova-api[15399]: 2017-09-28 13:02:41.347 15399 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:02:41 ctl02 nova-api[15399]: 2017-09-28 13:02:41.347 15399 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:02:41 ctl02 nova-api[15399]: 2017-09-28 13:02:41.347 15399 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:02:41 ctl02 nova-api[15399]: 2017-09-28 13:02:41.347 15399 ERROR nova
Sep 28 13:02:41 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:02:41 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:02:41 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:02:41 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:02:41 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:02:41 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:02:41 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:02:41 ctl02 nova-consoleauth[5433]: 2017-09-28 13:02:41.840 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:02:41 ctl02 glance-api[29183]: 2017-09-28 13:02:41.886 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:02:41] "OPTIONS / HTTP/1.0" 200 134 0.000633
Sep 28 13:02:42 ctl02 heat-engine[12803]: 2017-09-28 13:02:42.424 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:02:42 ctl02 heat-engine[12803]: 2017-09-28 13:02:42.439 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:02:42 ctl02 heat-engine[12803]: 2017-09-28 13:02:42.449 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:02:42 ctl02 heat-engine[12803]: 2017-09-28 13:02:42.449 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:02:43 ctl02 glance-api[29183]: 2017-09-28 13:02:43.058 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:02:43] "OPTIONS / HTTP/1.0" 200 134 0.000640
Sep 28 13:02:43 ctl02 nova-api[15418]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:02:43 ctl02 nova-api[15418]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:02:43 ctl02 nova-api[15418]: 2017-09-28 13:02:43.530 15418 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:02:43 ctl02 neutron-server[30536]: 2017-09-28 13:02:43.532 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 13:02:43 ctl02 nova-api[15418]: 2017-09-28 13:02:43.531 15418 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:02:43 ctl02 nova-api[15418]: 2017-09-28 13:02:43.531 15418 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:02:43 ctl02 nova-api[15418]: 2017-09-28 13:02:43.531 15418 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:02:43 ctl02 nova-api[15418]: 2017-09-28 13:02:43.531 15418 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:02:43 ctl02 nova-api[15418]: 2017-09-28 13:02:43.531 15418 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:02:43 ctl02 nova-api[15418]: 2017-09-28 13:02:43.531 15418 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:02:43 ctl02 nova-api[15418]: 2017-09-28 13:02:43.531 15418 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:02:43 ctl02 nova-api[15418]: 2017-09-28 13:02:43.531 15418 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:02:43 ctl02 nova-api[15418]: 2017-09-28 13:02:43.531 15418 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:02:43 ctl02 nova-api[15418]: 2017-09-28 13:02:43.531 15418 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:02:43 ctl02 nova-api[15418]: 2017-09-28 13:02:43.531 15418 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:02:43 ctl02 nova-api[15418]: 2017-09-28 13:02:43.531 15418 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:02:43 ctl02 nova-api[15418]: 2017-09-28 13:02:43.531 15418 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:02:43 ctl02 nova-api[15418]: 2017-09-28 13:02:43.531 15418 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:02:43 ctl02 nova-api[15418]: 2017-09-28 13:02:43.531 15418 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:02:43 ctl02 nova-api[15418]: 2017-09-28 13:02:43.531 15418 ERROR nova.wsgi     self.filename))
Sep 28 13:02:43 ctl02 nova-api[15418]: 2017-09-28 13:02:43.531 15418 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:02:43 ctl02 nova-api[15418]: 2017-09-28 13:02:43.531 15418 ERROR nova.wsgi
Sep 28 13:02:43 ctl02 nova-api[15418]: 2017-09-28 13:02:43.533 15418 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:02:43 ctl02 nova-api[15418]: 2017-09-28 13:02:43.668 15418 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:02:43 ctl02 heat-api[13008]: 2017-09-28 13:02:43.716 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:02:43] "OPTIONS / HTTP/1.0" 200 134 0.000652
Sep 28 13:02:43 ctl02 nova-api[15418]: 2017-09-28 13:02:43.919 15418 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:02:43 ctl02 nova-api[15418]: 2017-09-28 13:02:43.922 15418 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:02:43 ctl02 nova-api[15418]: 2017-09-28 13:02:43.923 15418 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:02:43 ctl02 nova-api[15418]: 2017-09-28 13:02:43.923 15418 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:02:43 ctl02 neutron-server[30536]: 2017-09-28 13:02:43.933 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:02:43] "OPTIONS / HTTP/1.0" 200 262 0.000495
Sep 28 13:02:44 ctl02 nova-api[15418]: 2017-09-28 13:02:44.059 15418 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:02:44 ctl02 nova-api[15418]: 2017-09-28 13:02:44.062 15418 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:02:44 ctl02 nova-api[15418]: 2017-09-28 13:02:44.062 15418 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:02:44 ctl02 nova-api[15418]: 2017-09-28 13:02:44.063 15418 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:02:44 ctl02 nova-api[15418]: 2017-09-28 13:02:44.066 15418 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:02:44 ctl02 nova-api[15418]: 2017-09-28 13:02:44.067 15418 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:02:44 ctl02 nova-api[15418]: 2017-09-28 13:02:44.067 15418 ERROR nova Traceback (most recent call last):
Sep 28 13:02:44 ctl02 nova-api[15418]: 2017-09-28 13:02:44.067 15418 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:02:44 ctl02 nova-api[15418]: 2017-09-28 13:02:44.067 15418 ERROR nova     sys.exit(main())
Sep 28 13:02:44 ctl02 nova-api[15418]: 2017-09-28 13:02:44.067 15418 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:02:44 ctl02 nova-api[15418]: 2017-09-28 13:02:44.067 15418 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:02:44 ctl02 nova-api[15418]: 2017-09-28 13:02:44.067 15418 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:02:44 ctl02 nova-api[15418]: 2017-09-28 13:02:44.067 15418 ERROR nova     max_url_len=max_url_len)
Sep 28 13:02:44 ctl02 nova-api[15418]: 2017-09-28 13:02:44.067 15418 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:02:44 ctl02 nova-api[15418]: 2017-09-28 13:02:44.067 15418 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:02:44 ctl02 nova-api[15418]: 2017-09-28 13:02:44.067 15418 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:02:44 ctl02 nova-api[15418]: 2017-09-28 13:02:44.067 15418 ERROR nova     sock.listen(backlog)
Sep 28 13:02:44 ctl02 nova-api[15418]: 2017-09-28 13:02:44.067 15418 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:02:44 ctl02 nova-api[15418]: 2017-09-28 13:02:44.067 15418 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:02:44 ctl02 nova-api[15418]: 2017-09-28 13:02:44.067 15418 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:02:44 ctl02 nova-api[15418]: 2017-09-28 13:02:44.067 15418 ERROR nova
Sep 28 13:02:44 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:02:44 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:02:44 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:02:44 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:02:44 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:02:44 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:02:44 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:02:44 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:02:44.845 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:02:44] "OPTIONS / HTTP/1.0" 200 134 0.000456
Sep 28 13:02:44 ctl02 nova-scheduler[5620]: 2017-09-28 13:02:44.945 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:02:45 ctl02 heat-api-cfn[13300]: 2017-09-28 13:02:45.330 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:02:45] "OPTIONS / HTTP/1.0" 200 134 0.000482
Sep 28 13:02:45 ctl02 heat-api-cfn[13300]: 2017-09-28 13:02:45.772 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:02:45] "OPTIONS / HTTP/1.0" 200 134 0.000504
Sep 28 13:02:46 ctl02 nova-api[15435]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:02:46 ctl02 nova-api[15435]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:02:46 ctl02 nova-api[15435]: 2017-09-28 13:02:46.289 15435 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:02:46 ctl02 nova-api[15435]: 2017-09-28 13:02:46.291 15435 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:02:46 ctl02 nova-api[15435]: 2017-09-28 13:02:46.291 15435 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:02:46 ctl02 nova-api[15435]: 2017-09-28 13:02:46.291 15435 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:02:46 ctl02 nova-api[15435]: 2017-09-28 13:02:46.291 15435 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:02:46 ctl02 nova-api[15435]: 2017-09-28 13:02:46.291 15435 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:02:46 ctl02 nova-api[15435]: 2017-09-28 13:02:46.291 15435 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:02:46 ctl02 nova-api[15435]: 2017-09-28 13:02:46.291 15435 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:02:46 ctl02 nova-api[15435]: 2017-09-28 13:02:46.291 15435 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:02:46 ctl02 nova-api[15435]: 2017-09-28 13:02:46.291 15435 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:02:46 ctl02 nova-api[15435]: 2017-09-28 13:02:46.291 15435 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:02:46 ctl02 nova-api[15435]: 2017-09-28 13:02:46.291 15435 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:02:46 ctl02 nova-api[15435]: 2017-09-28 13:02:46.291 15435 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:02:46 ctl02 nova-api[15435]: 2017-09-28 13:02:46.291 15435 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:02:46 ctl02 nova-api[15435]: 2017-09-28 13:02:46.291 15435 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:02:46 ctl02 nova-api[15435]: 2017-09-28 13:02:46.291 15435 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:02:46 ctl02 nova-api[15435]: 2017-09-28 13:02:46.291 15435 ERROR nova.wsgi     self.filename))
Sep 28 13:02:46 ctl02 nova-api[15435]: 2017-09-28 13:02:46.291 15435 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:02:46 ctl02 nova-api[15435]: 2017-09-28 13:02:46.291 15435 ERROR nova.wsgi
Sep 28 13:02:46 ctl02 nova-api[15435]: 2017-09-28 13:02:46.293 15435 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:02:46 ctl02 nova-api[15435]: 2017-09-28 13:02:46.426 15435 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:02:46 ctl02 nova-api[15435]: 2017-09-28 13:02:46.677 15435 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:02:46 ctl02 nova-api[15435]: 2017-09-28 13:02:46.679 15435 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:02:46 ctl02 nova-api[15435]: 2017-09-28 13:02:46.689 15435 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:02:46 ctl02 nova-api[15435]: 2017-09-28 13:02:46.689 15435 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:02:46 ctl02 nova-api[15435]: 2017-09-28 13:02:46.832 15435 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:02:46 ctl02 nova-api[15435]: 2017-09-28 13:02:46.834 15435 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:02:46 ctl02 nova-api[15435]: 2017-09-28 13:02:46.835 15435 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:02:46 ctl02 nova-api[15435]: 2017-09-28 13:02:46.835 15435 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:02:46 ctl02 nova-api[15435]: 2017-09-28 13:02:46.838 15435 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:02:46 ctl02 nova-api[15435]: 2017-09-28 13:02:46.839 15435 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:02:46 ctl02 nova-api[15435]: 2017-09-28 13:02:46.839 15435 ERROR nova Traceback (most recent call last):
Sep 28 13:02:46 ctl02 nova-api[15435]: 2017-09-28 13:02:46.839 15435 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:02:46 ctl02 nova-api[15435]: 2017-09-28 13:02:46.839 15435 ERROR nova     sys.exit(main())
Sep 28 13:02:46 ctl02 nova-api[15435]: 2017-09-28 13:02:46.839 15435 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:02:46 ctl02 nova-api[15435]: 2017-09-28 13:02:46.839 15435 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:02:46 ctl02 nova-api[15435]: 2017-09-28 13:02:46.839 15435 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:02:46 ctl02 nova-api[15435]: 2017-09-28 13:02:46.839 15435 ERROR nova     max_url_len=max_url_len)
Sep 28 13:02:46 ctl02 nova-api[15435]: 2017-09-28 13:02:46.839 15435 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:02:46 ctl02 nova-api[15435]: 2017-09-28 13:02:46.839 15435 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:02:46 ctl02 nova-api[15435]: 2017-09-28 13:02:46.839 15435 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:02:46 ctl02 nova-api[15435]: 2017-09-28 13:02:46.839 15435 ERROR nova     sock.listen(backlog)
Sep 28 13:02:46 ctl02 nova-api[15435]: 2017-09-28 13:02:46.839 15435 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:02:46 ctl02 nova-api[15435]: 2017-09-28 13:02:46.839 15435 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:02:46 ctl02 nova-api[15435]: 2017-09-28 13:02:46.839 15435 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:02:46 ctl02 nova-api[15435]: 2017-09-28 13:02:46.839 15435 ERROR nova
Sep 28 13:02:46 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:02:46 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:02:46 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:02:47 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:02:47 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:02:47 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:02:47 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:02:47 ctl02 heat-api[13008]: 2017-09-28 13:02:47.156 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:02:47] "OPTIONS / HTTP/1.0" 200 134 0.000749
Sep 28 13:02:47 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:02:47.524 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:02:47] "OPTIONS / HTTP/1.0" 200 134 0.000487
Sep 28 13:02:47 ctl02 neutron-server[30536]: 2017-09-28 13:02:47.755 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:02:47] "OPTIONS / HTTP/1.0" 200 262 0.000553
Sep 28 13:02:48 ctl02 nova-api[15454]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:02:48 ctl02 nova-api[15454]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:02:49 ctl02 nova-api[15454]: 2017-09-28 13:02:49.019 15454 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:02:49 ctl02 nova-api[15454]: 2017-09-28 13:02:49.021 15454 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:02:49 ctl02 nova-api[15454]: 2017-09-28 13:02:49.021 15454 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:02:49 ctl02 nova-api[15454]: 2017-09-28 13:02:49.021 15454 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:02:49 ctl02 nova-api[15454]: 2017-09-28 13:02:49.021 15454 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:02:49 ctl02 nova-api[15454]: 2017-09-28 13:02:49.021 15454 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:02:49 ctl02 nova-api[15454]: 2017-09-28 13:02:49.021 15454 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:02:49 ctl02 nova-api[15454]: 2017-09-28 13:02:49.021 15454 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:02:49 ctl02 nova-api[15454]: 2017-09-28 13:02:49.021 15454 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:02:49 ctl02 nova-api[15454]: 2017-09-28 13:02:49.021 15454 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:02:49 ctl02 nova-api[15454]: 2017-09-28 13:02:49.021 15454 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:02:49 ctl02 nova-api[15454]: 2017-09-28 13:02:49.021 15454 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:02:49 ctl02 nova-api[15454]: 2017-09-28 13:02:49.021 15454 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:02:49 ctl02 nova-api[15454]: 2017-09-28 13:02:49.021 15454 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:02:49 ctl02 nova-api[15454]: 2017-09-28 13:02:49.021 15454 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:02:49 ctl02 nova-api[15454]: 2017-09-28 13:02:49.021 15454 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:02:49 ctl02 nova-api[15454]: 2017-09-28 13:02:49.021 15454 ERROR nova.wsgi     self.filename))
Sep 28 13:02:49 ctl02 nova-api[15454]: 2017-09-28 13:02:49.021 15454 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:02:49 ctl02 nova-api[15454]: 2017-09-28 13:02:49.021 15454 ERROR nova.wsgi
Sep 28 13:02:49 ctl02 nova-api[15454]: 2017-09-28 13:02:49.022 15454 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:02:49 ctl02 nova-api[15454]: 2017-09-28 13:02:49.154 15454 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:02:49 ctl02 nova-api[15454]: 2017-09-28 13:02:49.399 15454 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:02:49 ctl02 nova-api[15454]: 2017-09-28 13:02:49.402 15454 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:02:49 ctl02 nova-api[15454]: 2017-09-28 13:02:49.402 15454 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:02:49 ctl02 nova-api[15454]: 2017-09-28 13:02:49.402 15454 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:02:49 ctl02 nova-api[15454]: 2017-09-28 13:02:49.536 15454 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:02:49 ctl02 nova-api[15454]: 2017-09-28 13:02:49.538 15454 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:02:49 ctl02 nova-api[15454]: 2017-09-28 13:02:49.538 15454 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:02:49 ctl02 nova-api[15454]: 2017-09-28 13:02:49.539 15454 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:02:49 ctl02 nova-api[15454]: 2017-09-28 13:02:49.542 15454 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:02:49 ctl02 nova-api[15454]: 2017-09-28 13:02:49.542 15454 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:02:49 ctl02 nova-api[15454]: 2017-09-28 13:02:49.542 15454 ERROR nova Traceback (most recent call last):
Sep 28 13:02:49 ctl02 nova-api[15454]: 2017-09-28 13:02:49.542 15454 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:02:49 ctl02 nova-api[15454]: 2017-09-28 13:02:49.542 15454 ERROR nova     sys.exit(main())
Sep 28 13:02:49 ctl02 nova-api[15454]: 2017-09-28 13:02:49.542 15454 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:02:49 ctl02 nova-api[15454]: 2017-09-28 13:02:49.542 15454 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:02:49 ctl02 nova-api[15454]: 2017-09-28 13:02:49.542 15454 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:02:49 ctl02 nova-api[15454]: 2017-09-28 13:02:49.542 15454 ERROR nova     max_url_len=max_url_len)
Sep 28 13:02:49 ctl02 nova-api[15454]: 2017-09-28 13:02:49.542 15454 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:02:49 ctl02 nova-api[15454]: 2017-09-28 13:02:49.542 15454 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:02:49 ctl02 nova-api[15454]: 2017-09-28 13:02:49.542 15454 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:02:49 ctl02 nova-api[15454]: 2017-09-28 13:02:49.542 15454 ERROR nova     sock.listen(backlog)
Sep 28 13:02:49 ctl02 nova-api[15454]: 2017-09-28 13:02:49.542 15454 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:02:49 ctl02 nova-api[15454]: 2017-09-28 13:02:49.542 15454 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:02:49 ctl02 nova-api[15454]: 2017-09-28 13:02:49.542 15454 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:02:49 ctl02 nova-api[15454]: 2017-09-28 13:02:49.542 15454 ERROR nova
Sep 28 13:02:49 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:02:49 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:02:49 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:02:49 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:02:49 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:02:49 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:02:49 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:02:49 ctl02 heat-api-cfn[13300]: 2017-09-28 13:02:49.933 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:02:49] "OPTIONS / HTTP/1.0" 200 134 0.000520
Sep 28 13:02:50 ctl02 glance-api[29183]: 2017-09-28 13:02:50.045 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:02:50] "OPTIONS / HTTP/1.0" 200 134 0.001189
Sep 28 13:02:50 ctl02 heat-api[13008]: 2017-09-28 13:02:50.336 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:02:50] "OPTIONS / HTTP/1.0" 200 134 0.000636
Sep 28 13:02:50 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:02:50.721 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:02:50] "OPTIONS / HTTP/1.0" 200 134 0.000466
Sep 28 13:02:50 ctl02 neutron-server[30536]: 2017-09-28 13:02:50.880 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:02:50] "OPTIONS / HTTP/1.0" 200 262 0.000549
Sep 28 13:02:51 ctl02 neutron-server[30536]: 2017-09-28 13:02:51.019 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 13:02:51 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 13:02:51 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 13:01:06 cmp002
Sep 28 13:02:51 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 13:00:58 cmp001
Sep 28 13:02:51 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 13:01:36 cmp002
Sep 28 13:02:51 ctl02 nova-api[15471]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:02:51 ctl02 nova-api[15471]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:02:51 ctl02 glance-api[29183]: 2017-09-28 13:02:51.726 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:02:51] "OPTIONS / HTTP/1.0" 200 134 0.000669
Sep 28 13:02:51 ctl02 nova-api[15471]: 2017-09-28 13:02:51.785 15471 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:02:51 ctl02 nova-api[15471]: 2017-09-28 13:02:51.787 15471 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:02:51 ctl02 nova-api[15471]: 2017-09-28 13:02:51.787 15471 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:02:51 ctl02 nova-api[15471]: 2017-09-28 13:02:51.787 15471 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:02:51 ctl02 nova-api[15471]: 2017-09-28 13:02:51.787 15471 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:02:51 ctl02 nova-api[15471]: 2017-09-28 13:02:51.787 15471 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:02:51 ctl02 nova-api[15471]: 2017-09-28 13:02:51.787 15471 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:02:51 ctl02 nova-api[15471]: 2017-09-28 13:02:51.787 15471 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:02:51 ctl02 nova-api[15471]: 2017-09-28 13:02:51.787 15471 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:02:51 ctl02 nova-api[15471]: 2017-09-28 13:02:51.787 15471 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:02:51 ctl02 nova-api[15471]: 2017-09-28 13:02:51.787 15471 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:02:51 ctl02 nova-api[15471]: 2017-09-28 13:02:51.787 15471 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:02:51 ctl02 nova-api[15471]: 2017-09-28 13:02:51.787 15471 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:02:51 ctl02 nova-api[15471]: 2017-09-28 13:02:51.787 15471 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:02:51 ctl02 nova-api[15471]: 2017-09-28 13:02:51.787 15471 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:02:51 ctl02 nova-api[15471]: 2017-09-28 13:02:51.787 15471 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:02:51 ctl02 nova-api[15471]: 2017-09-28 13:02:51.787 15471 ERROR nova.wsgi     self.filename))
Sep 28 13:02:51 ctl02 nova-api[15471]: 2017-09-28 13:02:51.787 15471 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:02:51 ctl02 nova-api[15471]: 2017-09-28 13:02:51.787 15471 ERROR nova.wsgi
Sep 28 13:02:51 ctl02 nova-api[15471]: 2017-09-28 13:02:51.788 15471 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:02:51 ctl02 nova-api[15471]: 2017-09-28 13:02:51.923 15471 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:02:52 ctl02 nova-api[15471]: 2017-09-28 13:02:52.176 15471 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:02:52 ctl02 nova-api[15471]: 2017-09-28 13:02:52.178 15471 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:02:52 ctl02 nova-api[15471]: 2017-09-28 13:02:52.179 15471 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:02:52 ctl02 nova-api[15471]: 2017-09-28 13:02:52.179 15471 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:02:52 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x23f27b)
Sep 28 13:02:52 ctl02 nova-api[15471]: 2017-09-28 13:02:52.316 15471 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:02:52 ctl02 nova-api[15471]: 2017-09-28 13:02:52.319 15471 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:02:52 ctl02 nova-api[15471]: 2017-09-28 13:02:52.319 15471 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:02:52 ctl02 nova-api[15471]: 2017-09-28 13:02:52.319 15471 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:02:52 ctl02 nova-api[15471]: 2017-09-28 13:02:52.323 15471 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:02:52 ctl02 nova-api[15471]: 2017-09-28 13:02:52.323 15471 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:02:52 ctl02 nova-api[15471]: 2017-09-28 13:02:52.323 15471 ERROR nova Traceback (most recent call last):
Sep 28 13:02:52 ctl02 nova-api[15471]: 2017-09-28 13:02:52.323 15471 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:02:52 ctl02 nova-api[15471]: 2017-09-28 13:02:52.323 15471 ERROR nova     sys.exit(main())
Sep 28 13:02:52 ctl02 nova-api[15471]: 2017-09-28 13:02:52.323 15471 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:02:52 ctl02 nova-api[15471]: 2017-09-28 13:02:52.323 15471 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:02:52 ctl02 nova-api[15471]: 2017-09-28 13:02:52.323 15471 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:02:52 ctl02 nova-api[15471]: 2017-09-28 13:02:52.323 15471 ERROR nova     max_url_len=max_url_len)
Sep 28 13:02:52 ctl02 nova-api[15471]: 2017-09-28 13:02:52.323 15471 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:02:52 ctl02 nova-api[15471]: 2017-09-28 13:02:52.323 15471 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:02:52 ctl02 nova-api[15471]: 2017-09-28 13:02:52.323 15471 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:02:52 ctl02 nova-api[15471]: 2017-09-28 13:02:52.323 15471 ERROR nova     sock.listen(backlog)
Sep 28 13:02:52 ctl02 nova-api[15471]: 2017-09-28 13:02:52.323 15471 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:02:52 ctl02 nova-api[15471]: 2017-09-28 13:02:52.323 15471 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:02:52 ctl02 nova-api[15471]: 2017-09-28 13:02:52.323 15471 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:02:52 ctl02 nova-api[15471]: 2017-09-28 13:02:52.323 15471 ERROR nova
Sep 28 13:02:52 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:02:52 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:02:52 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:02:52 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:02:52 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:02:52 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:02:52 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:02:52 ctl02 glance-api[29183]: 2017-09-28 13:02:52.874 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:02:52] "OPTIONS / HTTP/1.0" 200 134 0.000705
Sep 28 13:02:53 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x23f27b)
Sep 28 13:02:53 ctl02 heat-api[13008]: 2017-09-28 13:02:53.761 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:02:53] "OPTIONS / HTTP/1.0" 200 134 0.000615
Sep 28 13:02:54 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x23f27b)
Sep 28 13:02:54 ctl02 neutron-server[30536]: 2017-09-28 13:02:54.258 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:02:54] "OPTIONS / HTTP/1.0" 200 262 0.000578
Sep 28 13:02:54 ctl02 nova-api[15490]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:02:54 ctl02 nova-api[15490]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:02:54 ctl02 nova-api[15490]: 2017-09-28 13:02:54.504 15490 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:02:54 ctl02 nova-api[15490]: 2017-09-28 13:02:54.506 15490 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:02:54 ctl02 nova-api[15490]: 2017-09-28 13:02:54.506 15490 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:02:54 ctl02 nova-api[15490]: 2017-09-28 13:02:54.506 15490 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:02:54 ctl02 nova-api[15490]: 2017-09-28 13:02:54.506 15490 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:02:54 ctl02 nova-api[15490]: 2017-09-28 13:02:54.506 15490 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:02:54 ctl02 nova-api[15490]: 2017-09-28 13:02:54.506 15490 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:02:54 ctl02 nova-api[15490]: 2017-09-28 13:02:54.506 15490 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:02:54 ctl02 nova-api[15490]: 2017-09-28 13:02:54.506 15490 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:02:54 ctl02 nova-api[15490]: 2017-09-28 13:02:54.506 15490 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:02:54 ctl02 nova-api[15490]: 2017-09-28 13:02:54.506 15490 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:02:54 ctl02 nova-api[15490]: 2017-09-28 13:02:54.506 15490 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:02:54 ctl02 nova-api[15490]: 2017-09-28 13:02:54.506 15490 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:02:54 ctl02 nova-api[15490]: 2017-09-28 13:02:54.506 15490 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:02:54 ctl02 nova-api[15490]: 2017-09-28 13:02:54.506 15490 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:02:54 ctl02 nova-api[15490]: 2017-09-28 13:02:54.506 15490 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:02:54 ctl02 nova-api[15490]: 2017-09-28 13:02:54.506 15490 ERROR nova.wsgi     self.filename))
Sep 28 13:02:54 ctl02 nova-api[15490]: 2017-09-28 13:02:54.506 15490 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:02:54 ctl02 nova-api[15490]: 2017-09-28 13:02:54.506 15490 ERROR nova.wsgi
Sep 28 13:02:54 ctl02 nova-api[15490]: 2017-09-28 13:02:54.507 15490 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:02:54 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:02:54.552 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:02:54] "OPTIONS / HTTP/1.0" 200 134 0.000476
Sep 28 13:02:54 ctl02 nova-api[15490]: 2017-09-28 13:02:54.642 15490 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:02:54 ctl02 nova-api[15490]: 2017-09-28 13:02:54.882 15490 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:02:54 ctl02 nova-api[15490]: 2017-09-28 13:02:54.884 15490 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:02:54 ctl02 nova-api[15490]: 2017-09-28 13:02:54.885 15490 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:02:54 ctl02 nova-api[15490]: 2017-09-28 13:02:54.885 15490 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:02:55 ctl02 nova-api[15490]: 2017-09-28 13:02:55.017 15490 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:02:55 ctl02 nova-api[15490]: 2017-09-28 13:02:55.019 15490 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:02:55 ctl02 nova-api[15490]: 2017-09-28 13:02:55.019 15490 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:02:55 ctl02 nova-api[15490]: 2017-09-28 13:02:55.020 15490 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:02:55 ctl02 nova-api[15490]: 2017-09-28 13:02:55.023 15490 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:02:55 ctl02 nova-api[15490]: 2017-09-28 13:02:55.023 15490 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:02:55 ctl02 nova-api[15490]: 2017-09-28 13:02:55.023 15490 ERROR nova Traceback (most recent call last):
Sep 28 13:02:55 ctl02 nova-api[15490]: 2017-09-28 13:02:55.023 15490 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:02:55 ctl02 nova-api[15490]: 2017-09-28 13:02:55.023 15490 ERROR nova     sys.exit(main())
Sep 28 13:02:55 ctl02 nova-api[15490]: 2017-09-28 13:02:55.023 15490 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:02:55 ctl02 nova-api[15490]: 2017-09-28 13:02:55.023 15490 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:02:55 ctl02 nova-api[15490]: 2017-09-28 13:02:55.023 15490 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:02:55 ctl02 nova-api[15490]: 2017-09-28 13:02:55.023 15490 ERROR nova     max_url_len=max_url_len)
Sep 28 13:02:55 ctl02 nova-api[15490]: 2017-09-28 13:02:55.023 15490 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:02:55 ctl02 nova-api[15490]: 2017-09-28 13:02:55.023 15490 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:02:55 ctl02 nova-api[15490]: 2017-09-28 13:02:55.023 15490 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:02:55 ctl02 nova-api[15490]: 2017-09-28 13:02:55.023 15490 ERROR nova     sock.listen(backlog)
Sep 28 13:02:55 ctl02 nova-api[15490]: 2017-09-28 13:02:55.023 15490 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:02:55 ctl02 nova-api[15490]: 2017-09-28 13:02:55.023 15490 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:02:55 ctl02 nova-api[15490]: 2017-09-28 13:02:55.023 15490 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:02:55 ctl02 nova-api[15490]: 2017-09-28 13:02:55.023 15490 ERROR nova
Sep 28 13:02:55 ctl02 heat-api-cfn[13300]: 2017-09-28 13:02:55.064 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:02:55] "OPTIONS / HTTP/1.0" 200 134 0.000513
Sep 28 13:02:55 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:02:55 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:02:55 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:02:55 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x23f27b)
Sep 28 13:02:55 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:02:55 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:02:55 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:02:55 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:02:55 ctl02 heat-api-cfn[13300]: 2017-09-28 13:02:55.905 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:02:55] "OPTIONS / HTTP/1.0" 200 134 0.000495
Sep 28 13:02:56 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x23f27b)
Sep 28 13:02:57 ctl02 nova-api[15508]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:02:57 ctl02 nova-api[15508]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:02:57 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x23f27b)
Sep 28 13:02:57 ctl02 nova-api[15508]: 2017-09-28 13:02:57.291 15508 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:02:57 ctl02 nova-api[15508]: 2017-09-28 13:02:57.293 15508 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:02:57 ctl02 nova-api[15508]: 2017-09-28 13:02:57.293 15508 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:02:57 ctl02 nova-api[15508]: 2017-09-28 13:02:57.293 15508 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:02:57 ctl02 nova-api[15508]: 2017-09-28 13:02:57.293 15508 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:02:57 ctl02 nova-api[15508]: 2017-09-28 13:02:57.293 15508 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:02:57 ctl02 nova-api[15508]: 2017-09-28 13:02:57.293 15508 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:02:57 ctl02 nova-api[15508]: 2017-09-28 13:02:57.293 15508 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:02:57 ctl02 nova-api[15508]: 2017-09-28 13:02:57.293 15508 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:02:57 ctl02 nova-api[15508]: 2017-09-28 13:02:57.293 15508 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:02:57 ctl02 nova-api[15508]: 2017-09-28 13:02:57.293 15508 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:02:57 ctl02 nova-api[15508]: 2017-09-28 13:02:57.293 15508 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:02:57 ctl02 nova-api[15508]: 2017-09-28 13:02:57.293 15508 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:02:57 ctl02 nova-api[15508]: 2017-09-28 13:02:57.293 15508 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:02:57 ctl02 nova-api[15508]: 2017-09-28 13:02:57.293 15508 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:02:57 ctl02 nova-api[15508]: 2017-09-28 13:02:57.293 15508 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:02:57 ctl02 nova-api[15508]: 2017-09-28 13:02:57.293 15508 ERROR nova.wsgi     self.filename))
Sep 28 13:02:57 ctl02 nova-api[15508]: 2017-09-28 13:02:57.293 15508 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:02:57 ctl02 nova-api[15508]: 2017-09-28 13:02:57.293 15508 ERROR nova.wsgi
Sep 28 13:02:57 ctl02 nova-api[15508]: 2017-09-28 13:02:57.294 15508 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:02:57 ctl02 nova-api[15508]: 2017-09-28 13:02:57.424 15508 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:02:57 ctl02 neutron-server[30536]: 2017-09-28 13:02:57.430 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:02:57] "OPTIONS / HTTP/1.0" 200 262 0.000533
Sep 28 13:02:57 ctl02 heat-api[13008]: 2017-09-28 13:02:57.512 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:02:57] "OPTIONS / HTTP/1.0" 200 134 0.000658
Sep 28 13:02:57 ctl02 nova-api[15508]: 2017-09-28 13:02:57.670 15508 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:02:57 ctl02 nova-api[15508]: 2017-09-28 13:02:57.673 15508 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:02:57 ctl02 nova-api[15508]: 2017-09-28 13:02:57.673 15508 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:02:57 ctl02 nova-api[15508]: 2017-09-28 13:02:57.673 15508 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:02:57 ctl02 nova-api[15508]: 2017-09-28 13:02:57.804 15508 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:02:57 ctl02 nova-api[15508]: 2017-09-28 13:02:57.806 15508 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:02:57 ctl02 nova-api[15508]: 2017-09-28 13:02:57.806 15508 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:02:57 ctl02 nova-api[15508]: 2017-09-28 13:02:57.806 15508 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:02:57 ctl02 nova-api[15508]: 2017-09-28 13:02:57.810 15508 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:02:57 ctl02 nova-api[15508]: 2017-09-28 13:02:57.810 15508 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:02:57 ctl02 nova-api[15508]: 2017-09-28 13:02:57.810 15508 ERROR nova Traceback (most recent call last):
Sep 28 13:02:57 ctl02 nova-api[15508]: 2017-09-28 13:02:57.810 15508 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:02:57 ctl02 nova-api[15508]: 2017-09-28 13:02:57.810 15508 ERROR nova     sys.exit(main())
Sep 28 13:02:57 ctl02 nova-api[15508]: 2017-09-28 13:02:57.810 15508 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:02:57 ctl02 nova-api[15508]: 2017-09-28 13:02:57.810 15508 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:02:57 ctl02 nova-api[15508]: 2017-09-28 13:02:57.810 15508 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:02:57 ctl02 nova-api[15508]: 2017-09-28 13:02:57.810 15508 ERROR nova     max_url_len=max_url_len)
Sep 28 13:02:57 ctl02 nova-api[15508]: 2017-09-28 13:02:57.810 15508 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:02:57 ctl02 nova-api[15508]: 2017-09-28 13:02:57.810 15508 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:02:57 ctl02 nova-api[15508]: 2017-09-28 13:02:57.810 15508 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:02:57 ctl02 nova-api[15508]: 2017-09-28 13:02:57.810 15508 ERROR nova     sock.listen(backlog)
Sep 28 13:02:57 ctl02 nova-api[15508]: 2017-09-28 13:02:57.810 15508 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:02:57 ctl02 nova-api[15508]: 2017-09-28 13:02:57.810 15508 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:02:57 ctl02 nova-api[15508]: 2017-09-28 13:02:57.810 15508 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:02:57 ctl02 nova-api[15508]: 2017-09-28 13:02:57.810 15508 ERROR nova
Sep 28 13:02:57 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:02:57.843 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:02:57] "OPTIONS / HTTP/1.0" 200 134 0.000437
Sep 28 13:02:57 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:02:57 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:02:57 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:02:58 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:02:58 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:02:58 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:02:58 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:02:58 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x23f27b)
Sep 28 13:02:59 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x23f27b)
Sep 28 13:02:59 ctl02 nova-api[15526]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:02:59 ctl02 nova-api[15526]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:02:59 ctl02 nova-api[15526]: 2017-09-28 13:02:59.996 15526 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:02:59 ctl02 nova-api[15526]: 2017-09-28 13:02:59.998 15526 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:02:59 ctl02 nova-api[15526]: 2017-09-28 13:02:59.998 15526 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:02:59 ctl02 nova-api[15526]: 2017-09-28 13:02:59.998 15526 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:02:59 ctl02 nova-api[15526]: 2017-09-28 13:02:59.998 15526 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:02:59 ctl02 nova-api[15526]: 2017-09-28 13:02:59.998 15526 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:03:00 ctl02 nova-api[15526]: 2017-09-28 13:02:59.998 15526 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:03:00 ctl02 nova-api[15526]: 2017-09-28 13:02:59.998 15526 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:03:00 ctl02 nova-api[15526]: 2017-09-28 13:02:59.998 15526 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:03:00 ctl02 nova-api[15526]: 2017-09-28 13:02:59.998 15526 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:03:00 ctl02 nova-api[15526]: 2017-09-28 13:02:59.998 15526 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:03:00 ctl02 nova-api[15526]: 2017-09-28 13:02:59.998 15526 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:03:00 ctl02 nova-api[15526]: 2017-09-28 13:02:59.998 15526 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:03:00 ctl02 nova-api[15526]: 2017-09-28 13:02:59.998 15526 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:03:00 ctl02 nova-api[15526]: 2017-09-28 13:02:59.998 15526 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:03:00 ctl02 nova-api[15526]: 2017-09-28 13:02:59.998 15526 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:03:00 ctl02 nova-api[15526]: 2017-09-28 13:02:59.998 15526 ERROR nova.wsgi     self.filename))
Sep 28 13:03:00 ctl02 nova-api[15526]: 2017-09-28 13:02:59.998 15526 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:03:00 ctl02 nova-api[15526]: 2017-09-28 13:02:59.998 15526 ERROR nova.wsgi
Sep 28 13:03:00 ctl02 nova-api[15526]: 2017-09-28 13:03:00.001 15526 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:03:00 ctl02 heat-api[13008]: 2017-09-28 13:03:00.056 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:03:00] "OPTIONS / HTTP/1.0" 200 134 0.000590
Sep 28 13:03:00 ctl02 nova-api[15526]: 2017-09-28 13:03:00.135 15526 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:03:00 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x23f27b)
Sep 28 13:03:00 ctl02 glance-api[29183]: 2017-09-28 13:03:00.283 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:03:00] "OPTIONS / HTTP/1.0" 200 134 0.000600
Sep 28 13:03:00 ctl02 heat-api-cfn[13300]: 2017-09-28 13:03:00.307 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:03:00] "OPTIONS / HTTP/1.0" 200 134 0.000624
Sep 28 13:03:00 ctl02 nova-api[15526]: 2017-09-28 13:03:00.367 15526 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:03:00 ctl02 nova-api[15526]: 2017-09-28 13:03:00.369 15526 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:03:00 ctl02 nova-api[15526]: 2017-09-28 13:03:00.369 15526 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:03:00 ctl02 nova-api[15526]: 2017-09-28 13:03:00.370 15526 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:03:00 ctl02 nova-api[15526]: 2017-09-28 13:03:00.503 15526 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:03:00 ctl02 nova-api[15526]: 2017-09-28 13:03:00.505 15526 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:03:00 ctl02 nova-api[15526]: 2017-09-28 13:03:00.506 15526 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:03:00 ctl02 nova-api[15526]: 2017-09-28 13:03:00.506 15526 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:03:00 ctl02 nova-api[15526]: 2017-09-28 13:03:00.510 15526 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:03:00 ctl02 nova-api[15526]: 2017-09-28 13:03:00.510 15526 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:03:00 ctl02 nova-api[15526]: 2017-09-28 13:03:00.510 15526 ERROR nova Traceback (most recent call last):
Sep 28 13:03:00 ctl02 nova-api[15526]: 2017-09-28 13:03:00.510 15526 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:03:00 ctl02 nova-api[15526]: 2017-09-28 13:03:00.510 15526 ERROR nova     sys.exit(main())
Sep 28 13:03:00 ctl02 nova-api[15526]: 2017-09-28 13:03:00.510 15526 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:03:00 ctl02 nova-api[15526]: 2017-09-28 13:03:00.510 15526 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:03:00 ctl02 nova-api[15526]: 2017-09-28 13:03:00.510 15526 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:03:00 ctl02 nova-api[15526]: 2017-09-28 13:03:00.510 15526 ERROR nova     max_url_len=max_url_len)
Sep 28 13:03:00 ctl02 nova-api[15526]: 2017-09-28 13:03:00.510 15526 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:03:00 ctl02 nova-api[15526]: 2017-09-28 13:03:00.510 15526 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:03:00 ctl02 nova-api[15526]: 2017-09-28 13:03:00.510 15526 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:03:00 ctl02 nova-api[15526]: 2017-09-28 13:03:00.510 15526 ERROR nova     sock.listen(backlog)
Sep 28 13:03:00 ctl02 nova-api[15526]: 2017-09-28 13:03:00.510 15526 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:03:00 ctl02 nova-api[15526]: 2017-09-28 13:03:00.510 15526 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:03:00 ctl02 nova-api[15526]: 2017-09-28 13:03:00.510 15526 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:03:00 ctl02 nova-api[15526]: 2017-09-28 13:03:00.510 15526 ERROR nova
Sep 28 13:03:00 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:03:00.592 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:03:00] "OPTIONS / HTTP/1.0" 200 134 0.000596
Sep 28 13:03:00 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:03:00 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:03:00 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:03:00 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:03:00 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:03:00 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:03:00 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:03:01 ctl02 neutron-server[30536]: 2017-09-28 13:03:01.013 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:03:01] "OPTIONS / HTTP/1.0" 200 262 0.000446
Sep 28 13:03:01 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x23f27b)
Sep 28 13:03:01 ctl02 glance-api[29183]: 2017-09-28 13:03:01.944 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:03:01] "OPTIONS / HTTP/1.0" 200 134 0.000575
Sep 28 13:03:02 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x23f27b)
Sep 28 13:03:02 ctl02 nova-api[15543]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:03:02 ctl02 nova-api[15543]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:03:02 ctl02 nova-api[15543]: 2017-09-28 13:03:02.749 15543 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:03:02 ctl02 nova-api[15543]: 2017-09-28 13:03:02.750 15543 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:03:02 ctl02 nova-api[15543]: 2017-09-28 13:03:02.750 15543 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:03:02 ctl02 nova-api[15543]: 2017-09-28 13:03:02.750 15543 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:03:02 ctl02 nova-api[15543]: 2017-09-28 13:03:02.750 15543 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:03:02 ctl02 nova-api[15543]: 2017-09-28 13:03:02.750 15543 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:03:02 ctl02 nova-api[15543]: 2017-09-28 13:03:02.750 15543 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:03:02 ctl02 nova-api[15543]: 2017-09-28 13:03:02.750 15543 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:03:02 ctl02 nova-api[15543]: 2017-09-28 13:03:02.750 15543 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:03:02 ctl02 nova-api[15543]: 2017-09-28 13:03:02.750 15543 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:03:02 ctl02 nova-api[15543]: 2017-09-28 13:03:02.750 15543 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:03:02 ctl02 nova-api[15543]: 2017-09-28 13:03:02.750 15543 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:03:02 ctl02 nova-api[15543]: 2017-09-28 13:03:02.750 15543 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:03:02 ctl02 nova-api[15543]: 2017-09-28 13:03:02.750 15543 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:03:02 ctl02 nova-api[15543]: 2017-09-28 13:03:02.750 15543 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:03:02 ctl02 nova-api[15543]: 2017-09-28 13:03:02.750 15543 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:03:02 ctl02 nova-api[15543]: 2017-09-28 13:03:02.750 15543 ERROR nova.wsgi     self.filename))
Sep 28 13:03:02 ctl02 nova-api[15543]: 2017-09-28 13:03:02.750 15543 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:03:02 ctl02 nova-api[15543]: 2017-09-28 13:03:02.750 15543 ERROR nova.wsgi
Sep 28 13:03:02 ctl02 nova-api[15543]: 2017-09-28 13:03:02.751 15543 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:03:02 ctl02 nova-api[15543]: 2017-09-28 13:03:02.880 15543 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:03:02 ctl02 glance-api[29183]: 2017-09-28 13:03:02.976 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:03:02] "OPTIONS / HTTP/1.0" 200 134 0.000567
Sep 28 13:03:03 ctl02 nova-api[15543]: 2017-09-28 13:03:03.108 15543 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:03:03 ctl02 nova-api[15543]: 2017-09-28 13:03:03.110 15543 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:03:03 ctl02 nova-api[15543]: 2017-09-28 13:03:03.110 15543 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:03:03 ctl02 nova-api[15543]: 2017-09-28 13:03:03.110 15543 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:03:03 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 13:03:03 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 13:03:03 ctl02 nova-api[15543]: 2017-09-28 13:03:03.241 15543 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:03:03 ctl02 nova-api[15543]: 2017-09-28 13:03:03.243 15543 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:03:03 ctl02 nova-api[15543]: 2017-09-28 13:03:03.243 15543 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:03:03 ctl02 nova-api[15543]: 2017-09-28 13:03:03.244 15543 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:03:03 ctl02 nova-api[15543]: 2017-09-28 13:03:03.247 15543 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:03:03 ctl02 nova-api[15543]: 2017-09-28 13:03:03.247 15543 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:03:03 ctl02 nova-api[15543]: 2017-09-28 13:03:03.247 15543 ERROR nova Traceback (most recent call last):
Sep 28 13:03:03 ctl02 nova-api[15543]: 2017-09-28 13:03:03.247 15543 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:03:03 ctl02 nova-api[15543]: 2017-09-28 13:03:03.247 15543 ERROR nova     sys.exit(main())
Sep 28 13:03:03 ctl02 nova-api[15543]: 2017-09-28 13:03:03.247 15543 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:03:03 ctl02 nova-api[15543]: 2017-09-28 13:03:03.247 15543 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:03:03 ctl02 nova-api[15543]: 2017-09-28 13:03:03.247 15543 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:03:03 ctl02 nova-api[15543]: 2017-09-28 13:03:03.247 15543 ERROR nova     max_url_len=max_url_len)
Sep 28 13:03:03 ctl02 nova-api[15543]: 2017-09-28 13:03:03.247 15543 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:03:03 ctl02 nova-api[15543]: 2017-09-28 13:03:03.247 15543 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:03:03 ctl02 nova-api[15543]: 2017-09-28 13:03:03.247 15543 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:03:03 ctl02 nova-api[15543]: 2017-09-28 13:03:03.247 15543 ERROR nova     sock.listen(backlog)
Sep 28 13:03:03 ctl02 nova-api[15543]: 2017-09-28 13:03:03.247 15543 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:03:03 ctl02 nova-api[15543]: 2017-09-28 13:03:03.247 15543 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:03:03 ctl02 nova-api[15543]: 2017-09-28 13:03:03.247 15543 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:03:03 ctl02 nova-api[15543]: 2017-09-28 13:03:03.247 15543 ERROR nova
Sep 28 13:03:03 ctl02 nova-conductor[5056]: 2017-09-28 13:03:03.302 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:03:03 ctl02 nova-conductor[5056]: 2017-09-28 13:03:03.311 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:03:03 ctl02 nova-conductor[5056]: 2017-09-28 13:03:03.318 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:03:03 ctl02 nova-conductor[5056]: 2017-09-28 13:03:03.318 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:03:03 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:03:03 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:03:03 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:03:03 ctl02 heat-api[13008]: 2017-09-28 13:03:03.492 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:03:03] "OPTIONS / HTTP/1.0" 200 134 0.000660
Sep 28 13:03:03 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:03:03 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:03:03 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:03:03 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:03:04 ctl02 nova-cert[4860]: 2017-09-28 13:03:04.023 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:03:04 ctl02 neutron-server[30536]: 2017-09-28 13:03:04.298 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:03:04] "OPTIONS / HTTP/1.0" 200 262 0.000517
Sep 28 13:03:04 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:03:04.390 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:03:04] "OPTIONS / HTTP/1.0" 200 134 0.000342
Sep 28 13:03:04 ctl02 heat-api-cfn[13300]: 2017-09-28 13:03:04.756 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:03:04] "OPTIONS / HTTP/1.0" 200 134 0.000482
Sep 28 13:03:05 ctl02 nova-api[15566]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:03:05 ctl02 nova-api[15566]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:03:05 ctl02 nova-api[15566]: 2017-09-28 13:03:05.507 15566 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:03:05 ctl02 nova-api[15566]: 2017-09-28 13:03:05.508 15566 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:03:05 ctl02 nova-api[15566]: 2017-09-28 13:03:05.508 15566 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:03:05 ctl02 nova-api[15566]: 2017-09-28 13:03:05.508 15566 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:03:05 ctl02 nova-api[15566]: 2017-09-28 13:03:05.508 15566 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:03:05 ctl02 nova-api[15566]: 2017-09-28 13:03:05.508 15566 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:03:05 ctl02 nova-api[15566]: 2017-09-28 13:03:05.508 15566 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:03:05 ctl02 nova-api[15566]: 2017-09-28 13:03:05.508 15566 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:03:05 ctl02 nova-api[15566]: 2017-09-28 13:03:05.508 15566 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:03:05 ctl02 nova-api[15566]: 2017-09-28 13:03:05.508 15566 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:03:05 ctl02 nova-api[15566]: 2017-09-28 13:03:05.508 15566 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:03:05 ctl02 nova-api[15566]: 2017-09-28 13:03:05.508 15566 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:03:05 ctl02 nova-api[15566]: 2017-09-28 13:03:05.508 15566 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:03:05 ctl02 nova-api[15566]: 2017-09-28 13:03:05.508 15566 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:03:05 ctl02 nova-api[15566]: 2017-09-28 13:03:05.508 15566 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:03:05 ctl02 nova-api[15566]: 2017-09-28 13:03:05.508 15566 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:03:05 ctl02 nova-api[15566]: 2017-09-28 13:03:05.508 15566 ERROR nova.wsgi     self.filename))
Sep 28 13:03:05 ctl02 nova-api[15566]: 2017-09-28 13:03:05.508 15566 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:03:05 ctl02 nova-api[15566]: 2017-09-28 13:03:05.508 15566 ERROR nova.wsgi
Sep 28 13:03:05 ctl02 nova-api[15566]: 2017-09-28 13:03:05.509 15566 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:03:05 ctl02 nova-api[15566]: 2017-09-28 13:03:05.637 15566 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:03:05 ctl02 heat-api-cfn[13300]: 2017-09-28 13:03:05.678 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:03:05] "OPTIONS / HTTP/1.0" 200 134 0.000672
Sep 28 13:03:05 ctl02 nova-api[15566]: 2017-09-28 13:03:05.860 15566 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:03:05 ctl02 nova-api[15566]: 2017-09-28 13:03:05.863 15566 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:03:05 ctl02 nova-api[15566]: 2017-09-28 13:03:05.863 15566 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:03:05 ctl02 nova-api[15566]: 2017-09-28 13:03:05.864 15566 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:03:05 ctl02 nova-api[15566]: 2017-09-28 13:03:05.994 15566 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:03:05 ctl02 nova-api[15566]: 2017-09-28 13:03:05.996 15566 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:03:05 ctl02 nova-api[15566]: 2017-09-28 13:03:05.996 15566 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:03:05 ctl02 nova-api[15566]: 2017-09-28 13:03:05.997 15566 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:03:06 ctl02 nova-api[15566]: 2017-09-28 13:03:06.000 15566 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:03:06 ctl02 nova-api[15566]: 2017-09-28 13:03:06.001 15566 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:03:06 ctl02 nova-api[15566]: 2017-09-28 13:03:06.001 15566 ERROR nova Traceback (most recent call last):
Sep 28 13:03:06 ctl02 nova-api[15566]: 2017-09-28 13:03:06.001 15566 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:03:06 ctl02 nova-api[15566]: 2017-09-28 13:03:06.001 15566 ERROR nova     sys.exit(main())
Sep 28 13:03:06 ctl02 nova-api[15566]: 2017-09-28 13:03:06.001 15566 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:03:06 ctl02 nova-api[15566]: 2017-09-28 13:03:06.001 15566 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:03:06 ctl02 nova-api[15566]: 2017-09-28 13:03:06.001 15566 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:03:06 ctl02 nova-api[15566]: 2017-09-28 13:03:06.001 15566 ERROR nova     max_url_len=max_url_len)
Sep 28 13:03:06 ctl02 nova-api[15566]: 2017-09-28 13:03:06.001 15566 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:03:06 ctl02 nova-api[15566]: 2017-09-28 13:03:06.001 15566 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:03:06 ctl02 nova-api[15566]: 2017-09-28 13:03:06.001 15566 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:03:06 ctl02 nova-api[15566]: 2017-09-28 13:03:06.001 15566 ERROR nova     sock.listen(backlog)
Sep 28 13:03:06 ctl02 nova-api[15566]: 2017-09-28 13:03:06.001 15566 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:03:06 ctl02 nova-api[15566]: 2017-09-28 13:03:06.001 15566 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:03:06 ctl02 nova-api[15566]: 2017-09-28 13:03:06.001 15566 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:03:06 ctl02 nova-api[15566]: 2017-09-28 13:03:06.001 15566 ERROR nova
Sep 28 13:03:06 ctl02 neutron-server[30536]: 2017-09-28 13:03:06.015 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 13:03:06 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 13:03:06 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 13:01:06 cmp002
Sep 28 13:03:06 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 13:02:30 cmp002
Sep 28 13:03:06 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 13:01:36 cmp002
Sep 28 13:03:06 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:03:06 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:03:06 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:03:06 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:03:06 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:03:06 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:03:06 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:03:07 ctl02 heat-api[13008]: 2017-09-28 13:03:07.403 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:03:07] "OPTIONS / HTTP/1.0" 200 134 0.000522
Sep 28 13:03:07 ctl02 neutron-server[30536]: 2017-09-28 13:03:07.549 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:03:07] "OPTIONS / HTTP/1.0" 200 262 0.000451
Sep 28 13:03:07 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:03:07.785 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:03:07] "OPTIONS / HTTP/1.0" 200 134 0.000494
Sep 28 13:03:08 ctl02 nova-api[15584]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:03:08 ctl02 nova-api[15584]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:03:08 ctl02 nova-api[15584]: 2017-09-28 13:03:08.227 15584 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:03:08 ctl02 nova-api[15584]: 2017-09-28 13:03:08.228 15584 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:03:08 ctl02 nova-api[15584]: 2017-09-28 13:03:08.228 15584 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:03:08 ctl02 nova-api[15584]: 2017-09-28 13:03:08.228 15584 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:03:08 ctl02 nova-api[15584]: 2017-09-28 13:03:08.228 15584 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:03:08 ctl02 nova-api[15584]: 2017-09-28 13:03:08.228 15584 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:03:08 ctl02 nova-api[15584]: 2017-09-28 13:03:08.228 15584 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:03:08 ctl02 nova-api[15584]: 2017-09-28 13:03:08.228 15584 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:03:08 ctl02 nova-api[15584]: 2017-09-28 13:03:08.228 15584 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:03:08 ctl02 nova-api[15584]: 2017-09-28 13:03:08.228 15584 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:03:08 ctl02 nova-api[15584]: 2017-09-28 13:03:08.228 15584 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:03:08 ctl02 nova-api[15584]: 2017-09-28 13:03:08.228 15584 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:03:08 ctl02 nova-api[15584]: 2017-09-28 13:03:08.228 15584 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:03:08 ctl02 nova-api[15584]: 2017-09-28 13:03:08.228 15584 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:03:08 ctl02 nova-api[15584]: 2017-09-28 13:03:08.228 15584 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:03:08 ctl02 nova-api[15584]: 2017-09-28 13:03:08.228 15584 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:03:08 ctl02 nova-api[15584]: 2017-09-28 13:03:08.228 15584 ERROR nova.wsgi     self.filename))
Sep 28 13:03:08 ctl02 nova-api[15584]: 2017-09-28 13:03:08.228 15584 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:03:08 ctl02 nova-api[15584]: 2017-09-28 13:03:08.228 15584 ERROR nova.wsgi
Sep 28 13:03:08 ctl02 nova-api[15584]: 2017-09-28 13:03:08.229 15584 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:03:08 ctl02 nova-api[15584]: 2017-09-28 13:03:08.357 15584 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:03:08 ctl02 nova-api[15584]: 2017-09-28 13:03:08.582 15584 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:03:08 ctl02 nova-api[15584]: 2017-09-28 13:03:08.584 15584 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:03:08 ctl02 nova-api[15584]: 2017-09-28 13:03:08.585 15584 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:03:08 ctl02 nova-api[15584]: 2017-09-28 13:03:08.585 15584 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:03:08 ctl02 nova-api[15584]: 2017-09-28 13:03:08.714 15584 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:03:08 ctl02 nova-api[15584]: 2017-09-28 13:03:08.716 15584 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:03:08 ctl02 nova-api[15584]: 2017-09-28 13:03:08.716 15584 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:03:08 ctl02 nova-api[15584]: 2017-09-28 13:03:08.717 15584 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:03:08 ctl02 nova-api[15584]: 2017-09-28 13:03:08.720 15584 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:03:08 ctl02 nova-api[15584]: 2017-09-28 13:03:08.720 15584 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:03:08 ctl02 nova-api[15584]: 2017-09-28 13:03:08.720 15584 ERROR nova Traceback (most recent call last):
Sep 28 13:03:08 ctl02 nova-api[15584]: 2017-09-28 13:03:08.720 15584 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:03:08 ctl02 nova-api[15584]: 2017-09-28 13:03:08.720 15584 ERROR nova     sys.exit(main())
Sep 28 13:03:08 ctl02 nova-api[15584]: 2017-09-28 13:03:08.720 15584 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:03:08 ctl02 nova-api[15584]: 2017-09-28 13:03:08.720 15584 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:03:08 ctl02 nova-api[15584]: 2017-09-28 13:03:08.720 15584 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:03:08 ctl02 nova-api[15584]: 2017-09-28 13:03:08.720 15584 ERROR nova     max_url_len=max_url_len)
Sep 28 13:03:08 ctl02 nova-api[15584]: 2017-09-28 13:03:08.720 15584 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:03:08 ctl02 nova-api[15584]: 2017-09-28 13:03:08.720 15584 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:03:08 ctl02 nova-api[15584]: 2017-09-28 13:03:08.720 15584 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:03:08 ctl02 nova-api[15584]: 2017-09-28 13:03:08.720 15584 ERROR nova     sock.listen(backlog)
Sep 28 13:03:08 ctl02 nova-api[15584]: 2017-09-28 13:03:08.720 15584 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:03:08 ctl02 nova-api[15584]: 2017-09-28 13:03:08.720 15584 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:03:08 ctl02 nova-api[15584]: 2017-09-28 13:03:08.720 15584 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:03:08 ctl02 nova-api[15584]: 2017-09-28 13:03:08.720 15584 ERROR nova
Sep 28 13:03:08 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:03:08 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:03:08 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:03:09 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:03:09 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:03:09 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:03:09 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:03:09 ctl02 heat-api[13008]: 2017-09-28 13:03:09.861 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:03:09] "OPTIONS / HTTP/1.0" 200 134 0.000553
Sep 28 13:03:10 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:03:10.200 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:03:10] "OPTIONS / HTTP/1.0" 200 134 0.000348
Sep 28 13:03:10 ctl02 heat-api-cfn[13300]: 2017-09-28 13:03:10.418 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:03:10] "OPTIONS / HTTP/1.0" 200 134 0.000469
Sep 28 13:03:10 ctl02 glance-api[29183]: 2017-09-28 13:03:10.419 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:03:10] "OPTIONS / HTTP/1.0" 200 134 0.000522
Sep 28 13:03:10 ctl02 nova-api[15603]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:03:10 ctl02 nova-api[15603]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:03:10 ctl02 neutron-server[30536]: 2017-09-28 13:03:10.971 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:03:10] "OPTIONS / HTTP/1.0" 200 262 0.000455
Sep 28 13:03:10 ctl02 nova-api[15603]: 2017-09-28 13:03:10.972 15603 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:03:10 ctl02 nova-api[15603]: 2017-09-28 13:03:10.973 15603 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:03:10 ctl02 nova-api[15603]: 2017-09-28 13:03:10.973 15603 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:03:10 ctl02 nova-api[15603]: 2017-09-28 13:03:10.973 15603 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:03:10 ctl02 nova-api[15603]: 2017-09-28 13:03:10.973 15603 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:03:10 ctl02 nova-api[15603]: 2017-09-28 13:03:10.973 15603 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:03:10 ctl02 nova-api[15603]: 2017-09-28 13:03:10.973 15603 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:03:10 ctl02 nova-api[15603]: 2017-09-28 13:03:10.973 15603 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:03:10 ctl02 nova-api[15603]: 2017-09-28 13:03:10.973 15603 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:03:10 ctl02 nova-api[15603]: 2017-09-28 13:03:10.973 15603 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:03:10 ctl02 nova-api[15603]: 2017-09-28 13:03:10.973 15603 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:03:10 ctl02 nova-api[15603]: 2017-09-28 13:03:10.973 15603 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:03:10 ctl02 nova-api[15603]: 2017-09-28 13:03:10.973 15603 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:03:10 ctl02 nova-api[15603]: 2017-09-28 13:03:10.973 15603 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:03:10 ctl02 nova-api[15603]: 2017-09-28 13:03:10.973 15603 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:03:10 ctl02 nova-api[15603]: 2017-09-28 13:03:10.973 15603 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:03:10 ctl02 nova-api[15603]: 2017-09-28 13:03:10.973 15603 ERROR nova.wsgi     self.filename))
Sep 28 13:03:10 ctl02 nova-api[15603]: 2017-09-28 13:03:10.973 15603 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:03:10 ctl02 nova-api[15603]: 2017-09-28 13:03:10.973 15603 ERROR nova.wsgi
Sep 28 13:03:10 ctl02 nova-api[15603]: 2017-09-28 13:03:10.975 15603 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:03:11 ctl02 nova-api[15603]: 2017-09-28 13:03:11.103 15603 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:03:11 ctl02 nova-api[15603]: 2017-09-28 13:03:11.326 15603 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:03:11 ctl02 nova-api[15603]: 2017-09-28 13:03:11.329 15603 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:03:11 ctl02 nova-api[15603]: 2017-09-28 13:03:11.330 15603 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:03:11 ctl02 nova-api[15603]: 2017-09-28 13:03:11.330 15603 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:03:11 ctl02 nova-api[15603]: 2017-09-28 13:03:11.461 15603 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:03:11 ctl02 nova-api[15603]: 2017-09-28 13:03:11.464 15603 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:03:11 ctl02 nova-api[15603]: 2017-09-28 13:03:11.464 15603 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:03:11 ctl02 nova-api[15603]: 2017-09-28 13:03:11.464 15603 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:03:11 ctl02 nova-api[15603]: 2017-09-28 13:03:11.467 15603 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:03:11 ctl02 nova-api[15603]: 2017-09-28 13:03:11.468 15603 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:03:11 ctl02 nova-api[15603]: 2017-09-28 13:03:11.468 15603 ERROR nova Traceback (most recent call last):
Sep 28 13:03:11 ctl02 nova-api[15603]: 2017-09-28 13:03:11.468 15603 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:03:11 ctl02 nova-api[15603]: 2017-09-28 13:03:11.468 15603 ERROR nova     sys.exit(main())
Sep 28 13:03:11 ctl02 nova-api[15603]: 2017-09-28 13:03:11.468 15603 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:03:11 ctl02 nova-api[15603]: 2017-09-28 13:03:11.468 15603 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:03:11 ctl02 nova-api[15603]: 2017-09-28 13:03:11.468 15603 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:03:11 ctl02 nova-api[15603]: 2017-09-28 13:03:11.468 15603 ERROR nova     max_url_len=max_url_len)
Sep 28 13:03:11 ctl02 nova-api[15603]: 2017-09-28 13:03:11.468 15603 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:03:11 ctl02 nova-api[15603]: 2017-09-28 13:03:11.468 15603 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:03:11 ctl02 nova-api[15603]: 2017-09-28 13:03:11.468 15603 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:03:11 ctl02 nova-api[15603]: 2017-09-28 13:03:11.468 15603 ERROR nova     sock.listen(backlog)
Sep 28 13:03:11 ctl02 nova-api[15603]: 2017-09-28 13:03:11.468 15603 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:03:11 ctl02 nova-api[15603]: 2017-09-28 13:03:11.468 15603 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:03:11 ctl02 nova-api[15603]: 2017-09-28 13:03:11.468 15603 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:03:11 ctl02 nova-api[15603]: 2017-09-28 13:03:11.468 15603 ERROR nova
Sep 28 13:03:11 ctl02 glance-api[29183]: 2017-09-28 13:03:11.588 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:03:11] "OPTIONS / HTTP/1.0" 200 134 0.000606
Sep 28 13:03:11 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:03:11 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:03:11 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:03:11 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:03:11 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:03:11 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:03:11 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:03:13 ctl02 glance-api[29183]: 2017-09-28 13:03:13.074 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:03:13] "OPTIONS / HTTP/1.0" 200 134 0.000541
Sep 28 13:03:13 ctl02 nova-api[15621]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:03:13 ctl02 nova-api[15621]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:03:13 ctl02 heat-api[13008]: 2017-09-28 13:03:13.715 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:03:13] "OPTIONS / HTTP/1.0" 200 134 0.000537
Sep 28 13:03:13 ctl02 nova-api[15621]: 2017-09-28 13:03:13.753 15621 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:03:13 ctl02 nova-api[15621]: 2017-09-28 13:03:13.755 15621 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:03:13 ctl02 nova-api[15621]: 2017-09-28 13:03:13.755 15621 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:03:13 ctl02 nova-api[15621]: 2017-09-28 13:03:13.755 15621 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:03:13 ctl02 nova-api[15621]: 2017-09-28 13:03:13.755 15621 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:03:13 ctl02 nova-api[15621]: 2017-09-28 13:03:13.755 15621 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:03:13 ctl02 nova-api[15621]: 2017-09-28 13:03:13.755 15621 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:03:13 ctl02 nova-api[15621]: 2017-09-28 13:03:13.755 15621 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:03:13 ctl02 nova-api[15621]: 2017-09-28 13:03:13.755 15621 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:03:13 ctl02 nova-api[15621]: 2017-09-28 13:03:13.755 15621 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:03:13 ctl02 nova-api[15621]: 2017-09-28 13:03:13.755 15621 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:03:13 ctl02 nova-api[15621]: 2017-09-28 13:03:13.755 15621 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:03:13 ctl02 nova-api[15621]: 2017-09-28 13:03:13.755 15621 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:03:13 ctl02 nova-api[15621]: 2017-09-28 13:03:13.755 15621 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:03:13 ctl02 nova-api[15621]: 2017-09-28 13:03:13.755 15621 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:03:13 ctl02 nova-api[15621]: 2017-09-28 13:03:13.755 15621 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:03:13 ctl02 nova-api[15621]: 2017-09-28 13:03:13.755 15621 ERROR nova.wsgi     self.filename))
Sep 28 13:03:13 ctl02 nova-api[15621]: 2017-09-28 13:03:13.755 15621 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:03:13 ctl02 nova-api[15621]: 2017-09-28 13:03:13.755 15621 ERROR nova.wsgi
Sep 28 13:03:13 ctl02 nova-api[15621]: 2017-09-28 13:03:13.757 15621 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:03:13 ctl02 nova-consoleauth[5433]: 2017-09-28 13:03:13.877 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:03:13 ctl02 nova-api[15621]: 2017-09-28 13:03:13.883 15621 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:03:14 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:03:14.059 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:03:14] "OPTIONS / HTTP/1.0" 200 134 0.000388
Sep 28 13:03:14 ctl02 nova-api[15621]: 2017-09-28 13:03:14.101 15621 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:03:14 ctl02 nova-api[15621]: 2017-09-28 13:03:14.103 15621 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:03:14 ctl02 nova-api[15621]: 2017-09-28 13:03:14.103 15621 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:03:14 ctl02 nova-api[15621]: 2017-09-28 13:03:14.103 15621 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:03:14 ctl02 nova-api[15621]: 2017-09-28 13:03:14.235 15621 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:03:14 ctl02 nova-api[15621]: 2017-09-28 13:03:14.237 15621 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:03:14 ctl02 nova-api[15621]: 2017-09-28 13:03:14.237 15621 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:03:14 ctl02 nova-api[15621]: 2017-09-28 13:03:14.237 15621 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:03:14 ctl02 nova-api[15621]: 2017-09-28 13:03:14.240 15621 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:03:14 ctl02 nova-api[15621]: 2017-09-28 13:03:14.241 15621 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:03:14 ctl02 nova-api[15621]: 2017-09-28 13:03:14.241 15621 ERROR nova Traceback (most recent call last):
Sep 28 13:03:14 ctl02 nova-api[15621]: 2017-09-28 13:03:14.241 15621 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:03:14 ctl02 nova-api[15621]: 2017-09-28 13:03:14.241 15621 ERROR nova     sys.exit(main())
Sep 28 13:03:14 ctl02 nova-api[15621]: 2017-09-28 13:03:14.241 15621 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:03:14 ctl02 nova-api[15621]: 2017-09-28 13:03:14.241 15621 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:03:14 ctl02 nova-api[15621]: 2017-09-28 13:03:14.241 15621 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:03:14 ctl02 nova-api[15621]: 2017-09-28 13:03:14.241 15621 ERROR nova     max_url_len=max_url_len)
Sep 28 13:03:14 ctl02 nova-api[15621]: 2017-09-28 13:03:14.241 15621 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:03:14 ctl02 nova-api[15621]: 2017-09-28 13:03:14.241 15621 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:03:14 ctl02 nova-api[15621]: 2017-09-28 13:03:14.241 15621 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:03:14 ctl02 nova-api[15621]: 2017-09-28 13:03:14.241 15621 ERROR nova     sock.listen(backlog)
Sep 28 13:03:14 ctl02 nova-api[15621]: 2017-09-28 13:03:14.241 15621 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:03:14 ctl02 nova-api[15621]: 2017-09-28 13:03:14.241 15621 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:03:14 ctl02 nova-api[15621]: 2017-09-28 13:03:14.241 15621 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:03:14 ctl02 nova-api[15621]: 2017-09-28 13:03:14.241 15621 ERROR nova
Sep 28 13:03:14 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfa998d55)
Sep 28 13:03:14 ctl02 neutron-server[30536]: 2017-09-28 13:03:14.250 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:03:14] "OPTIONS / HTTP/1.0" 200 262 0.000455
Sep 28 13:03:14 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:03:14 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:03:14 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:03:14 ctl02 heat-engine[12803]: 2017-09-28 13:03:14.433 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:03:14 ctl02 heat-engine[12803]: 2017-09-28 13:03:14.448 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:03:14 ctl02 heat-engine[12803]: 2017-09-28 13:03:14.457 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:03:14 ctl02 heat-engine[12803]: 2017-09-28 13:03:14.458 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:03:14 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:03:14 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:03:14 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:03:14 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:03:14 ctl02 heat-api-cfn[13300]: 2017-09-28 13:03:14.910 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:03:14] "OPTIONS / HTTP/1.0" 200 134 0.000453
Sep 28 13:03:15 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfa998d55)
Sep 28 13:03:15 ctl02 heat-api-cfn[13300]: 2017-09-28 13:03:15.840 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:03:15] "OPTIONS / HTTP/1.0" 200 134 0.000591
Sep 28 13:03:16 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfa998d55)
Sep 28 13:03:16 ctl02 nova-api[15639]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:03:16 ctl02 nova-api[15639]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:03:16 ctl02 nova-api[15639]: 2017-09-28 13:03:16.483 15639 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:03:16 ctl02 nova-api[15639]: 2017-09-28 13:03:16.484 15639 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:03:16 ctl02 nova-api[15639]: 2017-09-28 13:03:16.484 15639 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:03:16 ctl02 nova-api[15639]: 2017-09-28 13:03:16.484 15639 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:03:16 ctl02 nova-api[15639]: 2017-09-28 13:03:16.484 15639 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:03:16 ctl02 nova-api[15639]: 2017-09-28 13:03:16.484 15639 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:03:16 ctl02 nova-api[15639]: 2017-09-28 13:03:16.484 15639 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:03:16 ctl02 nova-api[15639]: 2017-09-28 13:03:16.484 15639 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:03:16 ctl02 nova-api[15639]: 2017-09-28 13:03:16.484 15639 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:03:16 ctl02 nova-api[15639]: 2017-09-28 13:03:16.484 15639 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:03:16 ctl02 nova-api[15639]: 2017-09-28 13:03:16.484 15639 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:03:16 ctl02 nova-api[15639]: 2017-09-28 13:03:16.484 15639 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:03:16 ctl02 nova-api[15639]: 2017-09-28 13:03:16.484 15639 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:03:16 ctl02 nova-api[15639]: 2017-09-28 13:03:16.484 15639 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:03:16 ctl02 nova-api[15639]: 2017-09-28 13:03:16.484 15639 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:03:16 ctl02 nova-api[15639]: 2017-09-28 13:03:16.484 15639 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:03:16 ctl02 nova-api[15639]: 2017-09-28 13:03:16.484 15639 ERROR nova.wsgi     self.filename))
Sep 28 13:03:16 ctl02 nova-api[15639]: 2017-09-28 13:03:16.484 15639 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:03:16 ctl02 nova-api[15639]: 2017-09-28 13:03:16.484 15639 ERROR nova.wsgi
Sep 28 13:03:16 ctl02 nova-api[15639]: 2017-09-28 13:03:16.485 15639 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:03:16 ctl02 nova-api[15639]: 2017-09-28 13:03:16.612 15639 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:03:16 ctl02 nova-api[15639]: 2017-09-28 13:03:16.836 15639 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:03:16 ctl02 nova-api[15639]: 2017-09-28 13:03:16.838 15639 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:03:16 ctl02 nova-api[15639]: 2017-09-28 13:03:16.839 15639 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:03:16 ctl02 nova-api[15639]: 2017-09-28 13:03:16.839 15639 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:03:16 ctl02 nova-api[15639]: 2017-09-28 13:03:16.971 15639 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:03:16 ctl02 nova-api[15639]: 2017-09-28 13:03:16.972 15639 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:03:16 ctl02 nova-api[15639]: 2017-09-28 13:03:16.973 15639 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:03:16 ctl02 nova-api[15639]: 2017-09-28 13:03:16.973 15639 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:03:16 ctl02 nova-api[15639]: 2017-09-28 13:03:16.976 15639 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:03:16 ctl02 nova-api[15639]: 2017-09-28 13:03:16.976 15639 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:03:16 ctl02 nova-api[15639]: 2017-09-28 13:03:16.976 15639 ERROR nova Traceback (most recent call last):
Sep 28 13:03:16 ctl02 nova-api[15639]: 2017-09-28 13:03:16.976 15639 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:03:16 ctl02 nova-api[15639]: 2017-09-28 13:03:16.976 15639 ERROR nova     sys.exit(main())
Sep 28 13:03:16 ctl02 nova-api[15639]: 2017-09-28 13:03:16.976 15639 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:03:16 ctl02 nova-api[15639]: 2017-09-28 13:03:16.976 15639 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:03:16 ctl02 nova-api[15639]: 2017-09-28 13:03:16.976 15639 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:03:16 ctl02 nova-api[15639]: 2017-09-28 13:03:16.976 15639 ERROR nova     max_url_len=max_url_len)
Sep 28 13:03:16 ctl02 nova-api[15639]: 2017-09-28 13:03:16.976 15639 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:03:16 ctl02 nova-api[15639]: 2017-09-28 13:03:16.976 15639 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:03:16 ctl02 nova-api[15639]: 2017-09-28 13:03:16.976 15639 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:03:16 ctl02 nova-api[15639]: 2017-09-28 13:03:16.976 15639 ERROR nova     sock.listen(backlog)
Sep 28 13:03:16 ctl02 nova-api[15639]: 2017-09-28 13:03:16.976 15639 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:03:16 ctl02 nova-api[15639]: 2017-09-28 13:03:16.976 15639 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:03:16 ctl02 nova-api[15639]: 2017-09-28 13:03:16.976 15639 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:03:16 ctl02 nova-api[15639]: 2017-09-28 13:03:16.976 15639 ERROR nova
Sep 28 13:03:16 ctl02 nova-scheduler[5620]: 2017-09-28 13:03:16.983 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:03:17 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:03:17 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:03:17 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:03:17 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfa998d55)
Sep 28 13:03:17 ctl02 heat-api[13008]: 2017-09-28 13:03:17.254 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:03:17] "OPTIONS / HTTP/1.0" 200 134 0.000711
Sep 28 13:03:17 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:03:17 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:03:17 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:03:17 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:03:17 ctl02 neutron-server[30536]: 2017-09-28 13:03:17.940 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:03:17] "OPTIONS / HTTP/1.0" 200 262 0.000659
Sep 28 13:03:17 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:03:17.993 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:03:17] "OPTIONS / HTTP/1.0" 200 134 0.000524
Sep 28 13:03:18 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfa998d55)
Sep 28 13:03:19 ctl02 nova-api[15657]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:03:19 ctl02 nova-api[15657]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:03:19 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfa998d55)
Sep 28 13:03:19 ctl02 nova-api[15657]: 2017-09-28 13:03:19.280 15657 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:03:19 ctl02 nova-api[15657]: 2017-09-28 13:03:19.281 15657 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:03:19 ctl02 nova-api[15657]: 2017-09-28 13:03:19.281 15657 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:03:19 ctl02 nova-api[15657]: 2017-09-28 13:03:19.281 15657 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:03:19 ctl02 nova-api[15657]: 2017-09-28 13:03:19.281 15657 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:03:19 ctl02 nova-api[15657]: 2017-09-28 13:03:19.281 15657 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:03:19 ctl02 nova-api[15657]: 2017-09-28 13:03:19.281 15657 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:03:19 ctl02 nova-api[15657]: 2017-09-28 13:03:19.281 15657 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:03:19 ctl02 nova-api[15657]: 2017-09-28 13:03:19.281 15657 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:03:19 ctl02 nova-api[15657]: 2017-09-28 13:03:19.281 15657 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:03:19 ctl02 nova-api[15657]: 2017-09-28 13:03:19.281 15657 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:03:19 ctl02 nova-api[15657]: 2017-09-28 13:03:19.281 15657 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:03:19 ctl02 nova-api[15657]: 2017-09-28 13:03:19.281 15657 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:03:19 ctl02 nova-api[15657]: 2017-09-28 13:03:19.281 15657 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:03:19 ctl02 nova-api[15657]: 2017-09-28 13:03:19.281 15657 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:03:19 ctl02 nova-api[15657]: 2017-09-28 13:03:19.281 15657 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:03:19 ctl02 nova-api[15657]: 2017-09-28 13:03:19.281 15657 ERROR nova.wsgi     self.filename))
Sep 28 13:03:19 ctl02 nova-api[15657]: 2017-09-28 13:03:19.281 15657 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:03:19 ctl02 nova-api[15657]: 2017-09-28 13:03:19.281 15657 ERROR nova.wsgi
Sep 28 13:03:19 ctl02 nova-api[15657]: 2017-09-28 13:03:19.283 15657 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:03:19 ctl02 nova-api[15657]: 2017-09-28 13:03:19.434 15657 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:03:19 ctl02 heat-api[13008]: 2017-09-28 13:03:19.469 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:03:19] "OPTIONS / HTTP/1.0" 200 134 0.000601
Sep 28 13:03:19 ctl02 nova-api[15657]: 2017-09-28 13:03:19.689 15657 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:03:19 ctl02 nova-api[15657]: 2017-09-28 13:03:19.691 15657 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:03:19 ctl02 nova-api[15657]: 2017-09-28 13:03:19.691 15657 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:03:19 ctl02 nova-api[15657]: 2017-09-28 13:03:19.692 15657 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:03:19 ctl02 nova-api[15657]: 2017-09-28 13:03:19.828 15657 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:03:19 ctl02 nova-api[15657]: 2017-09-28 13:03:19.831 15657 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:03:19 ctl02 nova-api[15657]: 2017-09-28 13:03:19.831 15657 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:03:19 ctl02 nova-api[15657]: 2017-09-28 13:03:19.832 15657 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:03:19 ctl02 nova-api[15657]: 2017-09-28 13:03:19.835 15657 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:03:19 ctl02 nova-api[15657]: 2017-09-28 13:03:19.836 15657 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:03:19 ctl02 nova-api[15657]: 2017-09-28 13:03:19.836 15657 ERROR nova Traceback (most recent call last):
Sep 28 13:03:19 ctl02 nova-api[15657]: 2017-09-28 13:03:19.836 15657 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:03:19 ctl02 nova-api[15657]: 2017-09-28 13:03:19.836 15657 ERROR nova     sys.exit(main())
Sep 28 13:03:19 ctl02 nova-api[15657]: 2017-09-28 13:03:19.836 15657 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:03:19 ctl02 nova-api[15657]: 2017-09-28 13:03:19.836 15657 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:03:19 ctl02 nova-api[15657]: 2017-09-28 13:03:19.836 15657 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:03:19 ctl02 nova-api[15657]: 2017-09-28 13:03:19.836 15657 ERROR nova     max_url_len=max_url_len)
Sep 28 13:03:19 ctl02 nova-api[15657]: 2017-09-28 13:03:19.836 15657 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:03:19 ctl02 nova-api[15657]: 2017-09-28 13:03:19.836 15657 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:03:19 ctl02 nova-api[15657]: 2017-09-28 13:03:19.836 15657 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:03:19 ctl02 nova-api[15657]: 2017-09-28 13:03:19.836 15657 ERROR nova     sock.listen(backlog)
Sep 28 13:03:19 ctl02 nova-api[15657]: 2017-09-28 13:03:19.836 15657 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:03:19 ctl02 nova-api[15657]: 2017-09-28 13:03:19.836 15657 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:03:19 ctl02 nova-api[15657]: 2017-09-28 13:03:19.836 15657 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:03:19 ctl02 nova-api[15657]: 2017-09-28 13:03:19.836 15657 ERROR nova
Sep 28 13:03:20 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:03:20 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:03:20 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:03:20 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:03:20 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:03:20 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:03:20 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:03:20 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfa998d55)
Sep 28 13:03:20 ctl02 glance-api[29183]: 2017-09-28 13:03:20.334 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:03:20] "OPTIONS / HTTP/1.0" 200 134 0.000599
Sep 28 13:03:20 ctl02 heat-api-cfn[13300]: 2017-09-28 13:03:20.381 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:03:20] "OPTIONS / HTTP/1.0" 200 134 0.000442
Sep 28 13:03:20 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:03:20.563 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:03:20] "OPTIONS / HTTP/1.0" 200 134 0.000473
Sep 28 13:03:20 ctl02 neutron-server[30536]: 2017-09-28 13:03:20.716 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:03:20] "OPTIONS / HTTP/1.0" 200 262 0.000639
Sep 28 13:03:21 ctl02 neutron-server[30536]: 2017-09-28 13:03:21.011 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 2 dead agents out of 6:
Sep 28 13:03:21 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 13:03:21 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 13:02:30 cmp002
Sep 28 13:03:21 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 13:01:36 cmp002
Sep 28 13:03:21 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfa998d55)
Sep 28 13:03:21 ctl02 glance-api[29183]: 2017-09-28 13:03:21.258 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:03:21] "OPTIONS / HTTP/1.0" 200 134 0.000565
Sep 28 13:03:21 ctl02 nova-api[15675]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:03:21 ctl02 nova-api[15675]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:03:21 ctl02 nova-api[15675]: 2017-09-28 13:03:21.973 15675 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:03:21 ctl02 nova-api[15675]: 2017-09-28 13:03:21.974 15675 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:03:21 ctl02 nova-api[15675]: 2017-09-28 13:03:21.974 15675 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:03:21 ctl02 nova-api[15675]: 2017-09-28 13:03:21.974 15675 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:03:21 ctl02 nova-api[15675]: 2017-09-28 13:03:21.974 15675 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:03:21 ctl02 nova-api[15675]: 2017-09-28 13:03:21.974 15675 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:03:21 ctl02 nova-api[15675]: 2017-09-28 13:03:21.974 15675 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:03:21 ctl02 nova-api[15675]: 2017-09-28 13:03:21.974 15675 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:03:21 ctl02 nova-api[15675]: 2017-09-28 13:03:21.974 15675 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:03:21 ctl02 nova-api[15675]: 2017-09-28 13:03:21.974 15675 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:03:21 ctl02 nova-api[15675]: 2017-09-28 13:03:21.974 15675 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:03:21 ctl02 nova-api[15675]: 2017-09-28 13:03:21.974 15675 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:03:21 ctl02 nova-api[15675]: 2017-09-28 13:03:21.974 15675 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:03:21 ctl02 nova-api[15675]: 2017-09-28 13:03:21.974 15675 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:03:21 ctl02 nova-api[15675]: 2017-09-28 13:03:21.974 15675 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:03:21 ctl02 nova-api[15675]: 2017-09-28 13:03:21.974 15675 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:03:21 ctl02 nova-api[15675]: 2017-09-28 13:03:21.974 15675 ERROR nova.wsgi     self.filename))
Sep 28 13:03:21 ctl02 nova-api[15675]: 2017-09-28 13:03:21.974 15675 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:03:21 ctl02 nova-api[15675]: 2017-09-28 13:03:21.974 15675 ERROR nova.wsgi
Sep 28 13:03:21 ctl02 nova-api[15675]: 2017-09-28 13:03:21.976 15675 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:03:22 ctl02 nova-api[15675]: 2017-09-28 13:03:22.119 15675 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:03:22 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfa998d55)
Sep 28 13:03:22 ctl02 nova-api[15675]: 2017-09-28 13:03:22.368 15675 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:03:22 ctl02 nova-api[15675]: 2017-09-28 13:03:22.370 15675 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:03:22 ctl02 nova-api[15675]: 2017-09-28 13:03:22.370 15675 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:03:22 ctl02 nova-api[15675]: 2017-09-28 13:03:22.370 15675 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:03:22 ctl02 nova-api[15675]: 2017-09-28 13:03:22.503 15675 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:03:22 ctl02 nova-api[15675]: 2017-09-28 13:03:22.505 15675 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:03:22 ctl02 nova-api[15675]: 2017-09-28 13:03:22.505 15675 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:03:22 ctl02 nova-api[15675]: 2017-09-28 13:03:22.506 15675 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:03:22 ctl02 nova-api[15675]: 2017-09-28 13:03:22.509 15675 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:03:22 ctl02 nova-api[15675]: 2017-09-28 13:03:22.509 15675 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:03:22 ctl02 nova-api[15675]: 2017-09-28 13:03:22.509 15675 ERROR nova Traceback (most recent call last):
Sep 28 13:03:22 ctl02 nova-api[15675]: 2017-09-28 13:03:22.509 15675 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:03:22 ctl02 nova-api[15675]: 2017-09-28 13:03:22.509 15675 ERROR nova     sys.exit(main())
Sep 28 13:03:22 ctl02 nova-api[15675]: 2017-09-28 13:03:22.509 15675 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:03:22 ctl02 nova-api[15675]: 2017-09-28 13:03:22.509 15675 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:03:22 ctl02 nova-api[15675]: 2017-09-28 13:03:22.509 15675 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:03:22 ctl02 nova-api[15675]: 2017-09-28 13:03:22.509 15675 ERROR nova     max_url_len=max_url_len)
Sep 28 13:03:22 ctl02 nova-api[15675]: 2017-09-28 13:03:22.509 15675 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:03:22 ctl02 nova-api[15675]: 2017-09-28 13:03:22.509 15675 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:03:22 ctl02 nova-api[15675]: 2017-09-28 13:03:22.509 15675 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:03:22 ctl02 nova-api[15675]: 2017-09-28 13:03:22.509 15675 ERROR nova     sock.listen(backlog)
Sep 28 13:03:22 ctl02 nova-api[15675]: 2017-09-28 13:03:22.509 15675 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:03:22 ctl02 nova-api[15675]: 2017-09-28 13:03:22.509 15675 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:03:22 ctl02 nova-api[15675]: 2017-09-28 13:03:22.509 15675 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:03:22 ctl02 nova-api[15675]: 2017-09-28 13:03:22.509 15675 ERROR nova
Sep 28 13:03:22 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:03:22 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:03:22 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:03:22 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:03:22 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:03:22 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:03:22 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:03:23 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfa998d55)
Sep 28 13:03:23 ctl02 glance-api[29183]: 2017-09-28 13:03:23.431 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:03:23] "OPTIONS / HTTP/1.0" 200 134 0.000581
Sep 28 13:03:23 ctl02 heat-api[13008]: 2017-09-28 13:03:23.557 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:03:23] "OPTIONS / HTTP/1.0" 200 134 0.000563
Sep 28 13:03:24 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:03:24.225 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:03:24] "OPTIONS / HTTP/1.0" 200 134 0.000379
Sep 28 13:03:24 ctl02 neutron-server[30536]: 2017-09-28 13:03:24.246 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:03:24] "OPTIONS / HTTP/1.0" 200 262 0.000485
Sep 28 13:03:24 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xfa998d55)
Sep 28 13:03:24 ctl02 nova-api[15693]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:03:24 ctl02 nova-api[15693]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:03:24 ctl02 heat-api-cfn[13300]: 2017-09-28 13:03:24.763 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:03:24] "OPTIONS / HTTP/1.0" 200 134 0.000454
Sep 28 13:03:24 ctl02 nova-api[15693]: 2017-09-28 13:03:24.781 15693 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:03:24 ctl02 nova-api[15693]: 2017-09-28 13:03:24.783 15693 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:03:24 ctl02 nova-api[15693]: 2017-09-28 13:03:24.783 15693 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:03:24 ctl02 nova-api[15693]: 2017-09-28 13:03:24.783 15693 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:03:24 ctl02 nova-api[15693]: 2017-09-28 13:03:24.783 15693 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:03:24 ctl02 nova-api[15693]: 2017-09-28 13:03:24.783 15693 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:03:24 ctl02 nova-api[15693]: 2017-09-28 13:03:24.783 15693 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:03:24 ctl02 nova-api[15693]: 2017-09-28 13:03:24.783 15693 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:03:24 ctl02 nova-api[15693]: 2017-09-28 13:03:24.783 15693 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:03:24 ctl02 nova-api[15693]: 2017-09-28 13:03:24.783 15693 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:03:24 ctl02 nova-api[15693]: 2017-09-28 13:03:24.783 15693 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:03:24 ctl02 nova-api[15693]: 2017-09-28 13:03:24.783 15693 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:03:24 ctl02 nova-api[15693]: 2017-09-28 13:03:24.783 15693 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:03:24 ctl02 nova-api[15693]: 2017-09-28 13:03:24.783 15693 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:03:24 ctl02 nova-api[15693]: 2017-09-28 13:03:24.783 15693 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:03:24 ctl02 nova-api[15693]: 2017-09-28 13:03:24.783 15693 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:03:24 ctl02 nova-api[15693]: 2017-09-28 13:03:24.783 15693 ERROR nova.wsgi     self.filename))
Sep 28 13:03:24 ctl02 nova-api[15693]: 2017-09-28 13:03:24.783 15693 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:03:24 ctl02 nova-api[15693]: 2017-09-28 13:03:24.783 15693 ERROR nova.wsgi
Sep 28 13:03:24 ctl02 nova-api[15693]: 2017-09-28 13:03:24.784 15693 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:03:24 ctl02 nova-api[15693]: 2017-09-28 13:03:24.917 15693 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:03:25 ctl02 nova-api[15693]: 2017-09-28 13:03:25.148 15693 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:03:25 ctl02 nova-api[15693]: 2017-09-28 13:03:25.150 15693 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:03:25 ctl02 nova-api[15693]: 2017-09-28 13:03:25.150 15693 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:03:25 ctl02 nova-api[15693]: 2017-09-28 13:03:25.150 15693 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:03:25 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 13:03:25 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 13:03:25 ctl02 nova-api[15693]: 2017-09-28 13:03:25.287 15693 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:03:25 ctl02 nova-api[15693]: 2017-09-28 13:03:25.289 15693 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:03:25 ctl02 nova-api[15693]: 2017-09-28 13:03:25.289 15693 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:03:25 ctl02 nova-api[15693]: 2017-09-28 13:03:25.289 15693 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:03:25 ctl02 nova-api[15693]: 2017-09-28 13:03:25.293 15693 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:03:25 ctl02 nova-api[15693]: 2017-09-28 13:03:25.293 15693 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:03:25 ctl02 nova-api[15693]: 2017-09-28 13:03:25.293 15693 ERROR nova Traceback (most recent call last):
Sep 28 13:03:25 ctl02 nova-api[15693]: 2017-09-28 13:03:25.293 15693 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:03:25 ctl02 nova-api[15693]: 2017-09-28 13:03:25.293 15693 ERROR nova     sys.exit(main())
Sep 28 13:03:25 ctl02 nova-api[15693]: 2017-09-28 13:03:25.293 15693 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:03:25 ctl02 nova-api[15693]: 2017-09-28 13:03:25.293 15693 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:03:25 ctl02 nova-api[15693]: 2017-09-28 13:03:25.293 15693 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:03:25 ctl02 nova-api[15693]: 2017-09-28 13:03:25.293 15693 ERROR nova     max_url_len=max_url_len)
Sep 28 13:03:25 ctl02 nova-api[15693]: 2017-09-28 13:03:25.293 15693 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:03:25 ctl02 nova-api[15693]: 2017-09-28 13:03:25.293 15693 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:03:25 ctl02 nova-api[15693]: 2017-09-28 13:03:25.293 15693 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:03:25 ctl02 nova-api[15693]: 2017-09-28 13:03:25.293 15693 ERROR nova     sock.listen(backlog)
Sep 28 13:03:25 ctl02 nova-api[15693]: 2017-09-28 13:03:25.293 15693 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:03:25 ctl02 nova-api[15693]: 2017-09-28 13:03:25.293 15693 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:03:25 ctl02 nova-api[15693]: 2017-09-28 13:03:25.293 15693 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:03:25 ctl02 nova-api[15693]: 2017-09-28 13:03:25.293 15693 ERROR nova
Sep 28 13:03:25 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:03:25 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:03:25 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:03:25 ctl02 heat-api-cfn[13300]: 2017-09-28 13:03:25.444 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:03:25] "OPTIONS / HTTP/1.0" 200 134 0.000435
Sep 28 13:03:25 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:03:25 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:03:25 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:03:25 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:03:27 ctl02 nova-api[15716]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:03:27 ctl02 nova-api[15716]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:03:27 ctl02 nova-api[15716]: 2017-09-28 13:03:27.528 15716 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:03:27 ctl02 nova-api[15716]: 2017-09-28 13:03:27.529 15716 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:03:27 ctl02 nova-api[15716]: 2017-09-28 13:03:27.529 15716 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:03:27 ctl02 nova-api[15716]: 2017-09-28 13:03:27.529 15716 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:03:27 ctl02 nova-api[15716]: 2017-09-28 13:03:27.529 15716 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:03:27 ctl02 nova-api[15716]: 2017-09-28 13:03:27.529 15716 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:03:27 ctl02 nova-api[15716]: 2017-09-28 13:03:27.529 15716 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:03:27 ctl02 nova-api[15716]: 2017-09-28 13:03:27.529 15716 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:03:27 ctl02 nova-api[15716]: 2017-09-28 13:03:27.529 15716 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:03:27 ctl02 nova-api[15716]: 2017-09-28 13:03:27.529 15716 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:03:27 ctl02 nova-api[15716]: 2017-09-28 13:03:27.529 15716 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:03:27 ctl02 nova-api[15716]: 2017-09-28 13:03:27.529 15716 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:03:27 ctl02 nova-api[15716]: 2017-09-28 13:03:27.529 15716 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:03:27 ctl02 nova-api[15716]: 2017-09-28 13:03:27.529 15716 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:03:27 ctl02 nova-api[15716]: 2017-09-28 13:03:27.529 15716 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:03:27 ctl02 nova-api[15716]: 2017-09-28 13:03:27.529 15716 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:03:27 ctl02 nova-api[15716]: 2017-09-28 13:03:27.529 15716 ERROR nova.wsgi     self.filename))
Sep 28 13:03:27 ctl02 nova-api[15716]: 2017-09-28 13:03:27.529 15716 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:03:27 ctl02 nova-api[15716]: 2017-09-28 13:03:27.529 15716 ERROR nova.wsgi
Sep 28 13:03:27 ctl02 nova-api[15716]: 2017-09-28 13:03:27.530 15716 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:03:27 ctl02 heat-api[13008]: 2017-09-28 13:03:27.613 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:03:27] "OPTIONS / HTTP/1.0" 200 134 0.000520
Sep 28 13:03:27 ctl02 nova-api[15716]: 2017-09-28 13:03:27.664 15716 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:03:27 ctl02 nova-api[15716]: 2017-09-28 13:03:27.889 15716 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:03:27 ctl02 nova-api[15716]: 2017-09-28 13:03:27.891 15716 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:03:27 ctl02 nova-api[15716]: 2017-09-28 13:03:27.891 15716 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:03:27 ctl02 nova-api[15716]: 2017-09-28 13:03:27.892 15716 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:03:27 ctl02 neutron-server[30536]: 2017-09-28 13:03:27.962 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:03:27] "OPTIONS / HTTP/1.0" 200 262 0.000446
Sep 28 13:03:28 ctl02 nova-api[15716]: 2017-09-28 13:03:28.025 15716 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:03:28 ctl02 nova-api[15716]: 2017-09-28 13:03:28.026 15716 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:03:28 ctl02 nova-api[15716]: 2017-09-28 13:03:28.027 15716 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:03:28 ctl02 nova-api[15716]: 2017-09-28 13:03:28.027 15716 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:03:28 ctl02 nova-api[15716]: 2017-09-28 13:03:28.030 15716 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:03:28 ctl02 nova-api[15716]: 2017-09-28 13:03:28.030 15716 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:03:28 ctl02 nova-api[15716]: 2017-09-28 13:03:28.030 15716 ERROR nova Traceback (most recent call last):
Sep 28 13:03:28 ctl02 nova-api[15716]: 2017-09-28 13:03:28.030 15716 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:03:28 ctl02 nova-api[15716]: 2017-09-28 13:03:28.030 15716 ERROR nova     sys.exit(main())
Sep 28 13:03:28 ctl02 nova-api[15716]: 2017-09-28 13:03:28.030 15716 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:03:28 ctl02 nova-api[15716]: 2017-09-28 13:03:28.030 15716 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:03:28 ctl02 nova-api[15716]: 2017-09-28 13:03:28.030 15716 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:03:28 ctl02 nova-api[15716]: 2017-09-28 13:03:28.030 15716 ERROR nova     max_url_len=max_url_len)
Sep 28 13:03:28 ctl02 nova-api[15716]: 2017-09-28 13:03:28.030 15716 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:03:28 ctl02 nova-api[15716]: 2017-09-28 13:03:28.030 15716 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:03:28 ctl02 nova-api[15716]: 2017-09-28 13:03:28.030 15716 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:03:28 ctl02 nova-api[15716]: 2017-09-28 13:03:28.030 15716 ERROR nova     sock.listen(backlog)
Sep 28 13:03:28 ctl02 nova-api[15716]: 2017-09-28 13:03:28.030 15716 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:03:28 ctl02 nova-api[15716]: 2017-09-28 13:03:28.030 15716 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:03:28 ctl02 nova-api[15716]: 2017-09-28 13:03:28.030 15716 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:03:28 ctl02 nova-api[15716]: 2017-09-28 13:03:28.030 15716 ERROR nova
Sep 28 13:03:28 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:03:28.041 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:03:28] "OPTIONS / HTTP/1.0" 200 134 0.000354
Sep 28 13:03:28 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:03:28 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:03:28 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:03:28 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:03:28 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:03:28 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:03:28 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:03:28 ctl02 neutron-server[30536]: 2017-09-28 13:03:28.523 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 13:03:29 ctl02 heat-api[13008]: 2017-09-28 13:03:29.386 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:03:29] "OPTIONS / HTTP/1.0" 200 134 0.000611
Sep 28 13:03:30 ctl02 heat-api-cfn[13300]: 2017-09-28 13:03:30.090 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:03:30] "OPTIONS / HTTP/1.0" 200 134 0.000520
Sep 28 13:03:30 ctl02 nova-api[15734]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:03:30 ctl02 nova-api[15734]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:03:30 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:03:30.262 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:03:30] "OPTIONS / HTTP/1.0" 200 134 0.000427
Sep 28 13:03:30 ctl02 neutron-server[30536]: 2017-09-28 13:03:30.287 30601 WARNING oslo_messaging._drivers.amqpdriver [req-b17be2a3-7b60-44ec-a8e7-09df93ee76aa - - - - -] reply_692b03e6d8d44d758b6be19b067c3aa3 doesn't exists, drop reply to f2a1d56b0c5848b492bb2edf6e721e34
Sep 28 13:03:30 ctl02 neutron-server[30536]: 2017-09-28 13:03:30.288 30601 INFO oslo_messaging._drivers.amqpdriver [req-b17be2a3-7b60-44ec-a8e7-09df93ee76aa - - - - -] The reply f2a1d56b0c5848b492bb2edf6e721e34 cannot be sent  reply_692b03e6d8d44d758b6be19b067c3aa3 reply queue don't exist after 60 sec abandoning...
Sep 28 13:03:30 ctl02 nova-api[15734]: 2017-09-28 13:03:30.307 15734 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:03:30 ctl02 nova-api[15734]: 2017-09-28 13:03:30.308 15734 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:03:30 ctl02 nova-api[15734]: 2017-09-28 13:03:30.308 15734 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:03:30 ctl02 nova-api[15734]: 2017-09-28 13:03:30.308 15734 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:03:30 ctl02 nova-api[15734]: 2017-09-28 13:03:30.308 15734 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:03:30 ctl02 nova-api[15734]: 2017-09-28 13:03:30.308 15734 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:03:30 ctl02 nova-api[15734]: 2017-09-28 13:03:30.308 15734 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:03:30 ctl02 nova-api[15734]: 2017-09-28 13:03:30.308 15734 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:03:30 ctl02 nova-api[15734]: 2017-09-28 13:03:30.308 15734 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:03:30 ctl02 nova-api[15734]: 2017-09-28 13:03:30.308 15734 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:03:30 ctl02 nova-api[15734]: 2017-09-28 13:03:30.308 15734 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:03:30 ctl02 nova-api[15734]: 2017-09-28 13:03:30.308 15734 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:03:30 ctl02 nova-api[15734]: 2017-09-28 13:03:30.308 15734 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:03:30 ctl02 nova-api[15734]: 2017-09-28 13:03:30.308 15734 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:03:30 ctl02 nova-api[15734]: 2017-09-28 13:03:30.308 15734 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:03:30 ctl02 nova-api[15734]: 2017-09-28 13:03:30.308 15734 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:03:30 ctl02 nova-api[15734]: 2017-09-28 13:03:30.308 15734 ERROR nova.wsgi     self.filename))
Sep 28 13:03:30 ctl02 nova-api[15734]: 2017-09-28 13:03:30.308 15734 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:03:30 ctl02 nova-api[15734]: 2017-09-28 13:03:30.308 15734 ERROR nova.wsgi
Sep 28 13:03:30 ctl02 nova-api[15734]: 2017-09-28 13:03:30.309 15734 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:03:30 ctl02 glance-api[29183]: 2017-09-28 13:03:30.392 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:03:30] "OPTIONS / HTTP/1.0" 200 134 0.001037
Sep 28 13:03:30 ctl02 nova-api[15734]: 2017-09-28 13:03:30.443 15734 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:03:30 ctl02 nova-api[15734]: 2017-09-28 13:03:30.691 15734 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:03:30 ctl02 nova-api[15734]: 2017-09-28 13:03:30.694 15734 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:03:30 ctl02 nova-api[15734]: 2017-09-28 13:03:30.694 15734 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:03:30 ctl02 nova-api[15734]: 2017-09-28 13:03:30.694 15734 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:03:30 ctl02 nova-api[15734]: 2017-09-28 13:03:30.826 15734 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:03:30 ctl02 nova-api[15734]: 2017-09-28 13:03:30.828 15734 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:03:30 ctl02 nova-api[15734]: 2017-09-28 13:03:30.829 15734 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:03:30 ctl02 nova-api[15734]: 2017-09-28 13:03:30.829 15734 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:03:30 ctl02 nova-api[15734]: 2017-09-28 13:03:30.832 15734 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:03:30 ctl02 nova-api[15734]: 2017-09-28 13:03:30.833 15734 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:03:30 ctl02 nova-api[15734]: 2017-09-28 13:03:30.833 15734 ERROR nova Traceback (most recent call last):
Sep 28 13:03:30 ctl02 nova-api[15734]: 2017-09-28 13:03:30.833 15734 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:03:30 ctl02 nova-api[15734]: 2017-09-28 13:03:30.833 15734 ERROR nova     sys.exit(main())
Sep 28 13:03:30 ctl02 nova-api[15734]: 2017-09-28 13:03:30.833 15734 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:03:30 ctl02 nova-api[15734]: 2017-09-28 13:03:30.833 15734 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:03:30 ctl02 nova-api[15734]: 2017-09-28 13:03:30.833 15734 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:03:30 ctl02 nova-api[15734]: 2017-09-28 13:03:30.833 15734 ERROR nova     max_url_len=max_url_len)
Sep 28 13:03:30 ctl02 nova-api[15734]: 2017-09-28 13:03:30.833 15734 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:03:30 ctl02 nova-api[15734]: 2017-09-28 13:03:30.833 15734 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:03:30 ctl02 nova-api[15734]: 2017-09-28 13:03:30.833 15734 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:03:30 ctl02 nova-api[15734]: 2017-09-28 13:03:30.833 15734 ERROR nova     sock.listen(backlog)
Sep 28 13:03:30 ctl02 nova-api[15734]: 2017-09-28 13:03:30.833 15734 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:03:30 ctl02 nova-api[15734]: 2017-09-28 13:03:30.833 15734 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:03:30 ctl02 nova-api[15734]: 2017-09-28 13:03:30.833 15734 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:03:30 ctl02 nova-api[15734]: 2017-09-28 13:03:30.833 15734 ERROR nova
Sep 28 13:03:30 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:03:30 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:03:30 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:03:31 ctl02 neutron-server[30536]: 2017-09-28 13:03:31.003 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:03:31] "OPTIONS / HTTP/1.0" 200 262 0.000439
Sep 28 13:03:31 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:03:31 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:03:31 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:03:31 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:03:31 ctl02 glance-api[29183]: 2017-09-28 13:03:31.562 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:03:31] "OPTIONS / HTTP/1.0" 200 134 0.000581
Sep 28 13:03:32 ctl02 nova-api[15752]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:03:32 ctl02 nova-api[15752]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:03:32 ctl02 nova-api[15752]: 2017-09-28 13:03:32.995 15752 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:03:32 ctl02 nova-api[15752]: 2017-09-28 13:03:32.996 15752 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:03:32 ctl02 nova-api[15752]: 2017-09-28 13:03:32.996 15752 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:03:32 ctl02 nova-api[15752]: 2017-09-28 13:03:32.996 15752 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:03:32 ctl02 nova-api[15752]: 2017-09-28 13:03:32.996 15752 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:03:32 ctl02 nova-api[15752]: 2017-09-28 13:03:32.996 15752 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:03:32 ctl02 nova-api[15752]: 2017-09-28 13:03:32.996 15752 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:03:32 ctl02 nova-api[15752]: 2017-09-28 13:03:32.996 15752 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:03:32 ctl02 nova-api[15752]: 2017-09-28 13:03:32.996 15752 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:03:32 ctl02 nova-api[15752]: 2017-09-28 13:03:32.996 15752 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:03:32 ctl02 nova-api[15752]: 2017-09-28 13:03:32.996 15752 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:03:32 ctl02 nova-api[15752]: 2017-09-28 13:03:32.996 15752 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:03:32 ctl02 nova-api[15752]: 2017-09-28 13:03:32.996 15752 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:03:32 ctl02 nova-api[15752]: 2017-09-28 13:03:32.996 15752 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:03:32 ctl02 nova-api[15752]: 2017-09-28 13:03:32.996 15752 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:03:32 ctl02 nova-api[15752]: 2017-09-28 13:03:32.996 15752 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:03:32 ctl02 nova-api[15752]: 2017-09-28 13:03:32.996 15752 ERROR nova.wsgi     self.filename))
Sep 28 13:03:32 ctl02 nova-api[15752]: 2017-09-28 13:03:32.996 15752 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:03:32 ctl02 nova-api[15752]: 2017-09-28 13:03:32.996 15752 ERROR nova.wsgi
Sep 28 13:03:32 ctl02 nova-api[15752]: 2017-09-28 13:03:32.998 15752 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:03:33 ctl02 nova-api[15752]: 2017-09-28 13:03:33.125 15752 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:03:33 ctl02 glance-api[29183]: 2017-09-28 13:03:33.186 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:03:33] "OPTIONS / HTTP/1.0" 200 134 0.000557
Sep 28 13:03:33 ctl02 nova-api[15752]: 2017-09-28 13:03:33.351 15752 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:03:33 ctl02 nova-api[15752]: 2017-09-28 13:03:33.353 15752 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:03:33 ctl02 nova-api[15752]: 2017-09-28 13:03:33.354 15752 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:03:33 ctl02 nova-api[15752]: 2017-09-28 13:03:33.354 15752 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:03:33 ctl02 nova-api[15752]: 2017-09-28 13:03:33.484 15752 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:03:33 ctl02 nova-api[15752]: 2017-09-28 13:03:33.486 15752 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:03:33 ctl02 nova-api[15752]: 2017-09-28 13:03:33.487 15752 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:03:33 ctl02 nova-api[15752]: 2017-09-28 13:03:33.487 15752 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:03:33 ctl02 nova-api[15752]: 2017-09-28 13:03:33.490 15752 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:03:33 ctl02 nova-api[15752]: 2017-09-28 13:03:33.491 15752 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:03:33 ctl02 nova-api[15752]: 2017-09-28 13:03:33.491 15752 ERROR nova Traceback (most recent call last):
Sep 28 13:03:33 ctl02 nova-api[15752]: 2017-09-28 13:03:33.491 15752 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:03:33 ctl02 nova-api[15752]: 2017-09-28 13:03:33.491 15752 ERROR nova     sys.exit(main())
Sep 28 13:03:33 ctl02 nova-api[15752]: 2017-09-28 13:03:33.491 15752 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:03:33 ctl02 nova-api[15752]: 2017-09-28 13:03:33.491 15752 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:03:33 ctl02 nova-api[15752]: 2017-09-28 13:03:33.491 15752 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:03:33 ctl02 nova-api[15752]: 2017-09-28 13:03:33.491 15752 ERROR nova     max_url_len=max_url_len)
Sep 28 13:03:33 ctl02 nova-api[15752]: 2017-09-28 13:03:33.491 15752 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:03:33 ctl02 nova-api[15752]: 2017-09-28 13:03:33.491 15752 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:03:33 ctl02 nova-api[15752]: 2017-09-28 13:03:33.491 15752 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:03:33 ctl02 nova-api[15752]: 2017-09-28 13:03:33.491 15752 ERROR nova     sock.listen(backlog)
Sep 28 13:03:33 ctl02 nova-api[15752]: 2017-09-28 13:03:33.491 15752 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:03:33 ctl02 nova-api[15752]: 2017-09-28 13:03:33.491 15752 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:03:33 ctl02 nova-api[15752]: 2017-09-28 13:03:33.491 15752 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:03:33 ctl02 nova-api[15752]: 2017-09-28 13:03:33.491 15752 ERROR nova
Sep 28 13:03:33 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:03:33 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:03:33 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:03:33 ctl02 heat-api[13008]: 2017-09-28 13:03:33.650 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:03:33] "OPTIONS / HTTP/1.0" 200 134 0.000549
Sep 28 13:03:33 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:03:33 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:03:33 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:03:33 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:03:34 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:03:34.410 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:03:34] "OPTIONS / HTTP/1.0" 200 134 0.000474
Sep 28 13:03:34 ctl02 neutron-server[30536]: 2017-09-28 13:03:34.608 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:03:34] "OPTIONS / HTTP/1.0" 200 262 0.000538
Sep 28 13:03:34 ctl02 heat-api-cfn[13300]: 2017-09-28 13:03:34.992 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:03:34] "OPTIONS / HTTP/1.0" 200 134 0.000516
Sep 28 13:03:35 ctl02 nova-conductor[5056]: 2017-09-28 13:03:35.310 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:03:35 ctl02 nova-conductor[5056]: 2017-09-28 13:03:35.319 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:03:35 ctl02 nova-conductor[5056]: 2017-09-28 13:03:35.330 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:03:35 ctl02 nova-conductor[5056]: 2017-09-28 13:03:35.331 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:03:35 ctl02 nova-api[15769]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:03:35 ctl02 nova-api[15769]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:03:35 ctl02 heat-api-cfn[13300]: 2017-09-28 13:03:35.684 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:03:35] "OPTIONS / HTTP/1.0" 200 134 0.000624
Sep 28 13:03:35 ctl02 nova-api[15769]: 2017-09-28 13:03:35.791 15769 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:03:35 ctl02 nova-api[15769]: 2017-09-28 13:03:35.793 15769 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:03:35 ctl02 nova-api[15769]: 2017-09-28 13:03:35.793 15769 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:03:35 ctl02 nova-api[15769]: 2017-09-28 13:03:35.793 15769 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:03:35 ctl02 nova-api[15769]: 2017-09-28 13:03:35.793 15769 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:03:35 ctl02 nova-api[15769]: 2017-09-28 13:03:35.793 15769 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:03:35 ctl02 nova-api[15769]: 2017-09-28 13:03:35.793 15769 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:03:35 ctl02 nova-api[15769]: 2017-09-28 13:03:35.793 15769 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:03:35 ctl02 nova-api[15769]: 2017-09-28 13:03:35.793 15769 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:03:35 ctl02 nova-api[15769]: 2017-09-28 13:03:35.793 15769 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:03:35 ctl02 nova-api[15769]: 2017-09-28 13:03:35.793 15769 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:03:35 ctl02 nova-api[15769]: 2017-09-28 13:03:35.793 15769 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:03:35 ctl02 nova-api[15769]: 2017-09-28 13:03:35.793 15769 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:03:35 ctl02 nova-api[15769]: 2017-09-28 13:03:35.793 15769 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:03:35 ctl02 nova-api[15769]: 2017-09-28 13:03:35.793 15769 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:03:35 ctl02 nova-api[15769]: 2017-09-28 13:03:35.793 15769 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:03:35 ctl02 nova-api[15769]: 2017-09-28 13:03:35.793 15769 ERROR nova.wsgi     self.filename))
Sep 28 13:03:35 ctl02 nova-api[15769]: 2017-09-28 13:03:35.793 15769 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:03:35 ctl02 nova-api[15769]: 2017-09-28 13:03:35.793 15769 ERROR nova.wsgi
Sep 28 13:03:35 ctl02 nova-api[15769]: 2017-09-28 13:03:35.795 15769 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:03:35 ctl02 nova-api[15769]: 2017-09-28 13:03:35.928 15769 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:03:36 ctl02 neutron-server[30536]: 2017-09-28 13:03:36.008 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 4 dead agents out of 6:
Sep 28 13:03:36 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 13:03:36 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 13:03:06 cmp002
Sep 28 13:03:36 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 13:02:58 cmp001
Sep 28 13:03:36 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 13:02:30 cmp002
Sep 28 13:03:36 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 13:01:36 cmp002
Sep 28 13:03:36 ctl02 neutron-server[30536]: 2017-09-28 13:03:36.029 30601 WARNING oslo_messaging._drivers.amqpdriver [req-756bd1f8-c618-4c6d-9cd7-61c82bcbb4dd - - - - -] reply_a13a20a54b91453780e36bdf20a855d2 doesn't exists, drop reply to c89e42a705424edca0e2038dd75c8f5d
Sep 28 13:03:36 ctl02 nova-cert[4860]: 2017-09-28 13:03:36.060 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:03:36 ctl02 nova-api[15769]: 2017-09-28 13:03:36.152 15769 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:03:36 ctl02 nova-api[15769]: 2017-09-28 13:03:36.155 15769 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:03:36 ctl02 nova-api[15769]: 2017-09-28 13:03:36.155 15769 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:03:36 ctl02 nova-api[15769]: 2017-09-28 13:03:36.156 15769 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:03:36 ctl02 nova-api[15769]: 2017-09-28 13:03:36.288 15769 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:03:36 ctl02 nova-api[15769]: 2017-09-28 13:03:36.291 15769 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:03:36 ctl02 nova-api[15769]: 2017-09-28 13:03:36.291 15769 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:03:36 ctl02 nova-api[15769]: 2017-09-28 13:03:36.291 15769 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:03:36 ctl02 nova-api[15769]: 2017-09-28 13:03:36.295 15769 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:03:36 ctl02 nova-api[15769]: 2017-09-28 13:03:36.295 15769 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:03:36 ctl02 nova-api[15769]: 2017-09-28 13:03:36.295 15769 ERROR nova Traceback (most recent call last):
Sep 28 13:03:36 ctl02 nova-api[15769]: 2017-09-28 13:03:36.295 15769 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:03:36 ctl02 nova-api[15769]: 2017-09-28 13:03:36.295 15769 ERROR nova     sys.exit(main())
Sep 28 13:03:36 ctl02 nova-api[15769]: 2017-09-28 13:03:36.295 15769 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:03:36 ctl02 nova-api[15769]: 2017-09-28 13:03:36.295 15769 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:03:36 ctl02 nova-api[15769]: 2017-09-28 13:03:36.295 15769 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:03:36 ctl02 nova-api[15769]: 2017-09-28 13:03:36.295 15769 ERROR nova     max_url_len=max_url_len)
Sep 28 13:03:36 ctl02 nova-api[15769]: 2017-09-28 13:03:36.295 15769 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:03:36 ctl02 nova-api[15769]: 2017-09-28 13:03:36.295 15769 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:03:36 ctl02 nova-api[15769]: 2017-09-28 13:03:36.295 15769 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:03:36 ctl02 nova-api[15769]: 2017-09-28 13:03:36.295 15769 ERROR nova     sock.listen(backlog)
Sep 28 13:03:36 ctl02 nova-api[15769]: 2017-09-28 13:03:36.295 15769 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:03:36 ctl02 nova-api[15769]: 2017-09-28 13:03:36.295 15769 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:03:36 ctl02 nova-api[15769]: 2017-09-28 13:03:36.295 15769 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:03:36 ctl02 nova-api[15769]: 2017-09-28 13:03:36.295 15769 ERROR nova
Sep 28 13:03:36 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:03:36 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:03:36 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:03:36 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:03:36 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:03:36 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:03:36 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:03:37 ctl02 neutron-server[30536]: 2017-09-28 13:03:37.790 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:03:37] "OPTIONS / HTTP/1.0" 200 262 0.000542
Sep 28 13:03:37 ctl02 heat-api[13008]: 2017-09-28 13:03:37.815 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:03:37] "OPTIONS / HTTP/1.0" 200 134 0.000590
Sep 28 13:03:37 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:03:37.885 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:03:37] "OPTIONS / HTTP/1.0" 200 134 0.000481
Sep 28 13:03:38 ctl02 nova-api[15788]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:03:38 ctl02 nova-api[15788]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:03:38 ctl02 nova-api[15788]: 2017-09-28 13:03:38.577 15788 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:03:38 ctl02 nova-api[15788]: 2017-09-28 13:03:38.579 15788 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:03:38 ctl02 nova-api[15788]: 2017-09-28 13:03:38.579 15788 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:03:38 ctl02 nova-api[15788]: 2017-09-28 13:03:38.579 15788 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:03:38 ctl02 nova-api[15788]: 2017-09-28 13:03:38.579 15788 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:03:38 ctl02 nova-api[15788]: 2017-09-28 13:03:38.579 15788 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:03:38 ctl02 nova-api[15788]: 2017-09-28 13:03:38.579 15788 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:03:38 ctl02 nova-api[15788]: 2017-09-28 13:03:38.579 15788 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:03:38 ctl02 nova-api[15788]: 2017-09-28 13:03:38.579 15788 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:03:38 ctl02 nova-api[15788]: 2017-09-28 13:03:38.579 15788 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:03:38 ctl02 nova-api[15788]: 2017-09-28 13:03:38.579 15788 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:03:38 ctl02 nova-api[15788]: 2017-09-28 13:03:38.579 15788 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:03:38 ctl02 nova-api[15788]: 2017-09-28 13:03:38.579 15788 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:03:38 ctl02 nova-api[15788]: 2017-09-28 13:03:38.579 15788 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:03:38 ctl02 nova-api[15788]: 2017-09-28 13:03:38.579 15788 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:03:38 ctl02 nova-api[15788]: 2017-09-28 13:03:38.579 15788 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:03:38 ctl02 nova-api[15788]: 2017-09-28 13:03:38.579 15788 ERROR nova.wsgi     self.filename))
Sep 28 13:03:38 ctl02 nova-api[15788]: 2017-09-28 13:03:38.579 15788 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:03:38 ctl02 nova-api[15788]: 2017-09-28 13:03:38.579 15788 ERROR nova.wsgi
Sep 28 13:03:38 ctl02 nova-api[15788]: 2017-09-28 13:03:38.580 15788 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:03:38 ctl02 nova-api[15788]: 2017-09-28 13:03:38.715 15788 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:03:38 ctl02 nova-api[15788]: 2017-09-28 13:03:38.972 15788 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:03:38 ctl02 nova-api[15788]: 2017-09-28 13:03:38.975 15788 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:03:38 ctl02 nova-api[15788]: 2017-09-28 13:03:38.975 15788 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:03:38 ctl02 nova-api[15788]: 2017-09-28 13:03:38.975 15788 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:03:39 ctl02 heat-api[13008]: 2017-09-28 13:03:39.040 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:03:39] "OPTIONS / HTTP/1.0" 200 134 0.000646
Sep 28 13:03:39 ctl02 nova-api[15788]: 2017-09-28 13:03:39.128 15788 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:03:39 ctl02 nova-api[15788]: 2017-09-28 13:03:39.129 15788 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:03:39 ctl02 nova-api[15788]: 2017-09-28 13:03:39.130 15788 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:03:39 ctl02 nova-api[15788]: 2017-09-28 13:03:39.130 15788 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:03:39 ctl02 nova-api[15788]: 2017-09-28 13:03:39.134 15788 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:03:39 ctl02 nova-api[15788]: 2017-09-28 13:03:39.134 15788 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:03:39 ctl02 nova-api[15788]: 2017-09-28 13:03:39.134 15788 ERROR nova Traceback (most recent call last):
Sep 28 13:03:39 ctl02 nova-api[15788]: 2017-09-28 13:03:39.134 15788 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:03:39 ctl02 nova-api[15788]: 2017-09-28 13:03:39.134 15788 ERROR nova     sys.exit(main())
Sep 28 13:03:39 ctl02 nova-api[15788]: 2017-09-28 13:03:39.134 15788 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:03:39 ctl02 nova-api[15788]: 2017-09-28 13:03:39.134 15788 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:03:39 ctl02 nova-api[15788]: 2017-09-28 13:03:39.134 15788 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:03:39 ctl02 nova-api[15788]: 2017-09-28 13:03:39.134 15788 ERROR nova     max_url_len=max_url_len)
Sep 28 13:03:39 ctl02 nova-api[15788]: 2017-09-28 13:03:39.134 15788 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:03:39 ctl02 nova-api[15788]: 2017-09-28 13:03:39.134 15788 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:03:39 ctl02 nova-api[15788]: 2017-09-28 13:03:39.134 15788 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:03:39 ctl02 nova-api[15788]: 2017-09-28 13:03:39.134 15788 ERROR nova     sock.listen(backlog)
Sep 28 13:03:39 ctl02 nova-api[15788]: 2017-09-28 13:03:39.134 15788 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:03:39 ctl02 nova-api[15788]: 2017-09-28 13:03:39.134 15788 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:03:39 ctl02 nova-api[15788]: 2017-09-28 13:03:39.134 15788 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:03:39 ctl02 nova-api[15788]: 2017-09-28 13:03:39.134 15788 ERROR nova
Sep 28 13:03:39 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:03:39 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:03:39 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:03:39 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:03:39 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:03:39 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:03:39 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:03:39 ctl02 heat-api-cfn[13300]: 2017-09-28 13:03:39.697 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:03:39] "OPTIONS / HTTP/1.0" 200 134 0.000514
Sep 28 13:03:40 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:03:40.220 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:03:40] "OPTIONS / HTTP/1.0" 200 134 0.000451
Sep 28 13:03:40 ctl02 glance-api[29183]: 2017-09-28 13:03:40.398 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:03:40] "OPTIONS / HTTP/1.0" 200 134 0.000642
Sep 28 13:03:40 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa86a4952)
Sep 28 13:03:41 ctl02 neutron-server[30536]: 2017-09-28 13:03:41.109 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:03:41] "OPTIONS / HTTP/1.0" 200 262 0.000547
Sep 28 13:03:41 ctl02 nova-api[15806]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:03:41 ctl02 nova-api[15806]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:03:41 ctl02 glance-api[29183]: 2017-09-28 13:03:41.370 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:03:41] "OPTIONS / HTTP/1.0" 200 134 0.000667
Sep 28 13:03:41 ctl02 nova-api[15806]: 2017-09-28 13:03:41.543 15806 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:03:41 ctl02 nova-api[15806]: 2017-09-28 13:03:41.544 15806 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:03:41 ctl02 nova-api[15806]: 2017-09-28 13:03:41.544 15806 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:03:41 ctl02 nova-api[15806]: 2017-09-28 13:03:41.544 15806 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:03:41 ctl02 nova-api[15806]: 2017-09-28 13:03:41.544 15806 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:03:41 ctl02 nova-api[15806]: 2017-09-28 13:03:41.544 15806 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:03:41 ctl02 nova-api[15806]: 2017-09-28 13:03:41.544 15806 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:03:41 ctl02 nova-api[15806]: 2017-09-28 13:03:41.544 15806 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:03:41 ctl02 nova-api[15806]: 2017-09-28 13:03:41.544 15806 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:03:41 ctl02 nova-api[15806]: 2017-09-28 13:03:41.544 15806 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:03:41 ctl02 nova-api[15806]: 2017-09-28 13:03:41.544 15806 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:03:41 ctl02 nova-api[15806]: 2017-09-28 13:03:41.544 15806 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:03:41 ctl02 nova-api[15806]: 2017-09-28 13:03:41.544 15806 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:03:41 ctl02 nova-api[15806]: 2017-09-28 13:03:41.544 15806 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:03:41 ctl02 nova-api[15806]: 2017-09-28 13:03:41.544 15806 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:03:41 ctl02 nova-api[15806]: 2017-09-28 13:03:41.544 15806 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:03:41 ctl02 nova-api[15806]: 2017-09-28 13:03:41.544 15806 ERROR nova.wsgi     self.filename))
Sep 28 13:03:41 ctl02 nova-api[15806]: 2017-09-28 13:03:41.544 15806 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:03:41 ctl02 nova-api[15806]: 2017-09-28 13:03:41.544 15806 ERROR nova.wsgi
Sep 28 13:03:41 ctl02 nova-api[15806]: 2017-09-28 13:03:41.545 15806 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:03:41 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa86a4952)
Sep 28 13:03:41 ctl02 nova-api[15806]: 2017-09-28 13:03:41.678 15806 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:03:41 ctl02 nova-api[15806]: 2017-09-28 13:03:41.928 15806 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:03:41 ctl02 nova-api[15806]: 2017-09-28 13:03:41.930 15806 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:03:41 ctl02 nova-api[15806]: 2017-09-28 13:03:41.931 15806 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:03:41 ctl02 nova-api[15806]: 2017-09-28 13:03:41.931 15806 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:03:42 ctl02 nova-api[15806]: 2017-09-28 13:03:42.064 15806 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:03:42 ctl02 nova-api[15806]: 2017-09-28 13:03:42.066 15806 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:03:42 ctl02 nova-api[15806]: 2017-09-28 13:03:42.067 15806 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:03:42 ctl02 nova-api[15806]: 2017-09-28 13:03:42.067 15806 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:03:42 ctl02 nova-api[15806]: 2017-09-28 13:03:42.070 15806 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:03:42 ctl02 nova-api[15806]: 2017-09-28 13:03:42.071 15806 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:03:42 ctl02 nova-api[15806]: 2017-09-28 13:03:42.071 15806 ERROR nova Traceback (most recent call last):
Sep 28 13:03:42 ctl02 nova-api[15806]: 2017-09-28 13:03:42.071 15806 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:03:42 ctl02 nova-api[15806]: 2017-09-28 13:03:42.071 15806 ERROR nova     sys.exit(main())
Sep 28 13:03:42 ctl02 nova-api[15806]: 2017-09-28 13:03:42.071 15806 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:03:42 ctl02 nova-api[15806]: 2017-09-28 13:03:42.071 15806 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:03:42 ctl02 nova-api[15806]: 2017-09-28 13:03:42.071 15806 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:03:42 ctl02 nova-api[15806]: 2017-09-28 13:03:42.071 15806 ERROR nova     max_url_len=max_url_len)
Sep 28 13:03:42 ctl02 nova-api[15806]: 2017-09-28 13:03:42.071 15806 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:03:42 ctl02 nova-api[15806]: 2017-09-28 13:03:42.071 15806 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:03:42 ctl02 nova-api[15806]: 2017-09-28 13:03:42.071 15806 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:03:42 ctl02 nova-api[15806]: 2017-09-28 13:03:42.071 15806 ERROR nova     sock.listen(backlog)
Sep 28 13:03:42 ctl02 nova-api[15806]: 2017-09-28 13:03:42.071 15806 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:03:42 ctl02 nova-api[15806]: 2017-09-28 13:03:42.071 15806 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:03:42 ctl02 nova-api[15806]: 2017-09-28 13:03:42.071 15806 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:03:42 ctl02 nova-api[15806]: 2017-09-28 13:03:42.071 15806 ERROR nova
Sep 28 13:03:42 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:03:42 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:03:42 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:03:42 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:03:42 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:03:42 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:03:42 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:03:42 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa86a4952)
Sep 28 13:03:43 ctl02 glance-api[29183]: 2017-09-28 13:03:43.422 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:03:43] "OPTIONS / HTTP/1.0" 200 134 0.000551
Sep 28 13:03:43 ctl02 heat-api[13008]: 2017-09-28 13:03:43.516 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:03:43] "OPTIONS / HTTP/1.0" 200 134 0.000517
Sep 28 13:03:43 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa86a4952)
Sep 28 13:03:44 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:03:44.053 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:03:44] "OPTIONS / HTTP/1.0" 200 134 0.000338
Sep 28 13:03:44 ctl02 nova-api[15824]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:03:44 ctl02 nova-api[15824]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:03:44 ctl02 nova-api[15824]: 2017-09-28 13:03:44.236 15824 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:03:44 ctl02 nova-api[15824]: 2017-09-28 13:03:44.238 15824 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:03:44 ctl02 nova-api[15824]: 2017-09-28 13:03:44.238 15824 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:03:44 ctl02 nova-api[15824]: 2017-09-28 13:03:44.238 15824 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:03:44 ctl02 nova-api[15824]: 2017-09-28 13:03:44.238 15824 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:03:44 ctl02 nova-api[15824]: 2017-09-28 13:03:44.238 15824 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:03:44 ctl02 nova-api[15824]: 2017-09-28 13:03:44.238 15824 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:03:44 ctl02 nova-api[15824]: 2017-09-28 13:03:44.238 15824 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:03:44 ctl02 nova-api[15824]: 2017-09-28 13:03:44.238 15824 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:03:44 ctl02 nova-api[15824]: 2017-09-28 13:03:44.238 15824 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:03:44 ctl02 nova-api[15824]: 2017-09-28 13:03:44.238 15824 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:03:44 ctl02 nova-api[15824]: 2017-09-28 13:03:44.238 15824 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:03:44 ctl02 nova-api[15824]: 2017-09-28 13:03:44.238 15824 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:03:44 ctl02 nova-api[15824]: 2017-09-28 13:03:44.238 15824 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:03:44 ctl02 nova-api[15824]: 2017-09-28 13:03:44.238 15824 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:03:44 ctl02 nova-api[15824]: 2017-09-28 13:03:44.238 15824 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:03:44 ctl02 nova-api[15824]: 2017-09-28 13:03:44.238 15824 ERROR nova.wsgi     self.filename))
Sep 28 13:03:44 ctl02 nova-api[15824]: 2017-09-28 13:03:44.238 15824 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:03:44 ctl02 nova-api[15824]: 2017-09-28 13:03:44.238 15824 ERROR nova.wsgi
Sep 28 13:03:44 ctl02 nova-api[15824]: 2017-09-28 13:03:44.240 15824 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:03:44 ctl02 nova-api[15824]: 2017-09-28 13:03:44.368 15824 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:03:44 ctl02 nova-api[15824]: 2017-09-28 13:03:44.585 15824 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:03:44 ctl02 nova-api[15824]: 2017-09-28 13:03:44.588 15824 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:03:44 ctl02 nova-api[15824]: 2017-09-28 13:03:44.588 15824 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:03:44 ctl02 nova-api[15824]: 2017-09-28 13:03:44.588 15824 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:03:44 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa86a4952)
Sep 28 13:03:44 ctl02 nova-api[15824]: 2017-09-28 13:03:44.717 15824 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:03:44 ctl02 nova-api[15824]: 2017-09-28 13:03:44.719 15824 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:03:44 ctl02 nova-api[15824]: 2017-09-28 13:03:44.719 15824 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:03:44 ctl02 nova-api[15824]: 2017-09-28 13:03:44.719 15824 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:03:44 ctl02 nova-api[15824]: 2017-09-28 13:03:44.722 15824 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:03:44 ctl02 nova-api[15824]: 2017-09-28 13:03:44.723 15824 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:03:44 ctl02 nova-api[15824]: 2017-09-28 13:03:44.723 15824 ERROR nova Traceback (most recent call last):
Sep 28 13:03:44 ctl02 nova-api[15824]: 2017-09-28 13:03:44.723 15824 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:03:44 ctl02 nova-api[15824]: 2017-09-28 13:03:44.723 15824 ERROR nova     sys.exit(main())
Sep 28 13:03:44 ctl02 nova-api[15824]: 2017-09-28 13:03:44.723 15824 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:03:44 ctl02 nova-api[15824]: 2017-09-28 13:03:44.723 15824 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:03:44 ctl02 nova-api[15824]: 2017-09-28 13:03:44.723 15824 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:03:44 ctl02 nova-api[15824]: 2017-09-28 13:03:44.723 15824 ERROR nova     max_url_len=max_url_len)
Sep 28 13:03:44 ctl02 nova-api[15824]: 2017-09-28 13:03:44.723 15824 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:03:44 ctl02 nova-api[15824]: 2017-09-28 13:03:44.723 15824 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:03:44 ctl02 nova-api[15824]: 2017-09-28 13:03:44.723 15824 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:03:44 ctl02 nova-api[15824]: 2017-09-28 13:03:44.723 15824 ERROR nova     sock.listen(backlog)
Sep 28 13:03:44 ctl02 nova-api[15824]: 2017-09-28 13:03:44.723 15824 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:03:44 ctl02 nova-api[15824]: 2017-09-28 13:03:44.723 15824 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:03:44 ctl02 nova-api[15824]: 2017-09-28 13:03:44.723 15824 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:03:44 ctl02 nova-api[15824]: 2017-09-28 13:03:44.723 15824 ERROR nova
Sep 28 13:03:44 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:03:44 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:03:44 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:03:44 ctl02 neutron-server[30536]: 2017-09-28 13:03:44.863 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:03:44] "OPTIONS / HTTP/1.0" 200 262 0.000564
Sep 28 13:03:44 ctl02 heat-api-cfn[13300]: 2017-09-28 13:03:44.963 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:03:44] "OPTIONS / HTTP/1.0" 200 134 0.000592
Sep 28 13:03:45 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:03:45 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:03:45 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:03:45 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:03:45 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa86a4952)
Sep 28 13:03:45 ctl02 heat-api-cfn[13300]: 2017-09-28 13:03:45.685 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:03:45] "OPTIONS / HTTP/1.0" 200 134 0.000576
Sep 28 13:03:45 ctl02 nova-consoleauth[5433]: 2017-09-28 13:03:45.910 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:03:46 ctl02 heat-engine[12803]: 2017-09-28 13:03:46.442 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:03:46 ctl02 heat-engine[12803]: 2017-09-28 13:03:46.456 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:03:46 ctl02 heat-engine[12803]: 2017-09-28 13:03:46.465 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:03:46 ctl02 heat-engine[12803]: 2017-09-28 13:03:46.466 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:03:46 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa86a4952)
Sep 28 13:03:46 ctl02 nova-api[15842]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:03:46 ctl02 nova-api[15842]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:03:47 ctl02 nova-api[15842]: 2017-09-28 13:03:46.999 15842 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:03:47 ctl02 nova-api[15842]: 2017-09-28 13:03:47.001 15842 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:03:47 ctl02 nova-api[15842]: 2017-09-28 13:03:47.001 15842 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:03:47 ctl02 nova-api[15842]: 2017-09-28 13:03:47.001 15842 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:03:47 ctl02 nova-api[15842]: 2017-09-28 13:03:47.001 15842 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:03:47 ctl02 nova-api[15842]: 2017-09-28 13:03:47.001 15842 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:03:47 ctl02 nova-api[15842]: 2017-09-28 13:03:47.001 15842 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:03:47 ctl02 nova-api[15842]: 2017-09-28 13:03:47.001 15842 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:03:47 ctl02 nova-api[15842]: 2017-09-28 13:03:47.001 15842 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:03:47 ctl02 nova-api[15842]: 2017-09-28 13:03:47.001 15842 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:03:47 ctl02 nova-api[15842]: 2017-09-28 13:03:47.001 15842 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:03:47 ctl02 nova-api[15842]: 2017-09-28 13:03:47.001 15842 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:03:47 ctl02 nova-api[15842]: 2017-09-28 13:03:47.001 15842 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:03:47 ctl02 nova-api[15842]: 2017-09-28 13:03:47.001 15842 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:03:47 ctl02 nova-api[15842]: 2017-09-28 13:03:47.001 15842 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:03:47 ctl02 nova-api[15842]: 2017-09-28 13:03:47.001 15842 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:03:47 ctl02 nova-api[15842]: 2017-09-28 13:03:47.001 15842 ERROR nova.wsgi     self.filename))
Sep 28 13:03:47 ctl02 nova-api[15842]: 2017-09-28 13:03:47.001 15842 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:03:47 ctl02 nova-api[15842]: 2017-09-28 13:03:47.001 15842 ERROR nova.wsgi
Sep 28 13:03:47 ctl02 nova-api[15842]: 2017-09-28 13:03:47.001 15842 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:03:47 ctl02 nova-api[15842]: 2017-09-28 13:03:47.126 15842 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:03:47 ctl02 nova-api[15842]: 2017-09-28 13:03:47.347 15842 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:03:47 ctl02 nova-api[15842]: 2017-09-28 13:03:47.349 15842 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:03:47 ctl02 nova-api[15842]: 2017-09-28 13:03:47.349 15842 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:03:47 ctl02 nova-api[15842]: 2017-09-28 13:03:47.349 15842 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:03:47 ctl02 nova-api[15842]: 2017-09-28 13:03:47.479 15842 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:03:47 ctl02 nova-api[15842]: 2017-09-28 13:03:47.481 15842 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:03:47 ctl02 nova-api[15842]: 2017-09-28 13:03:47.481 15842 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:03:47 ctl02 nova-api[15842]: 2017-09-28 13:03:47.481 15842 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:03:47 ctl02 nova-api[15842]: 2017-09-28 13:03:47.485 15842 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:03:47 ctl02 nova-api[15842]: 2017-09-28 13:03:47.485 15842 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:03:47 ctl02 nova-api[15842]: 2017-09-28 13:03:47.485 15842 ERROR nova Traceback (most recent call last):
Sep 28 13:03:47 ctl02 nova-api[15842]: 2017-09-28 13:03:47.485 15842 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:03:47 ctl02 nova-api[15842]: 2017-09-28 13:03:47.485 15842 ERROR nova     sys.exit(main())
Sep 28 13:03:47 ctl02 nova-api[15842]: 2017-09-28 13:03:47.485 15842 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:03:47 ctl02 nova-api[15842]: 2017-09-28 13:03:47.485 15842 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:03:47 ctl02 nova-api[15842]: 2017-09-28 13:03:47.485 15842 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:03:47 ctl02 nova-api[15842]: 2017-09-28 13:03:47.485 15842 ERROR nova     max_url_len=max_url_len)
Sep 28 13:03:47 ctl02 nova-api[15842]: 2017-09-28 13:03:47.485 15842 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:03:47 ctl02 nova-api[15842]: 2017-09-28 13:03:47.485 15842 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:03:47 ctl02 nova-api[15842]: 2017-09-28 13:03:47.485 15842 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:03:47 ctl02 nova-api[15842]: 2017-09-28 13:03:47.485 15842 ERROR nova     sock.listen(backlog)
Sep 28 13:03:47 ctl02 nova-api[15842]: 2017-09-28 13:03:47.485 15842 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:03:47 ctl02 nova-api[15842]: 2017-09-28 13:03:47.485 15842 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:03:47 ctl02 nova-api[15842]: 2017-09-28 13:03:47.485 15842 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:03:47 ctl02 nova-api[15842]: 2017-09-28 13:03:47.485 15842 ERROR nova
Sep 28 13:03:47 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:03:47 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:03:47 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:03:47 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa86a4952)
Sep 28 13:03:47 ctl02 neutron-server[30536]: 2017-09-28 13:03:47.844 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:03:47] "OPTIONS / HTTP/1.0" 200 262 0.000726
Sep 28 13:03:47 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:03:47 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:03:47 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:03:47 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:03:48 ctl02 heat-api[13008]: 2017-09-28 13:03:48.139 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:03:48] "OPTIONS / HTTP/1.0" 200 134 0.000551
Sep 28 13:03:48 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:03:48.159 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:03:48] "OPTIONS / HTTP/1.0" 200 134 0.000350
Sep 28 13:03:48 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa86a4952)
Sep 28 13:03:48 ctl02 heat-api[13008]: 2017-09-28 13:03:48.974 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:03:48] "OPTIONS / HTTP/1.0" 200 134 0.000527
Sep 28 13:03:49 ctl02 nova-scheduler[5620]: 2017-09-28 13:03:49.018 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:03:49 ctl02 heat-api-cfn[13300]: 2017-09-28 13:03:49.448 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:03:49] "OPTIONS / HTTP/1.0" 200 134 0.000439
Sep 28 13:03:49 ctl02 nova-api[15860]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:03:49 ctl02 nova-api[15860]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:03:49 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa86a4952)
Sep 28 13:03:49 ctl02 nova-api[15860]: 2017-09-28 13:03:49.752 15860 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:03:49 ctl02 nova-api[15860]: 2017-09-28 13:03:49.754 15860 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:03:49 ctl02 nova-api[15860]: 2017-09-28 13:03:49.754 15860 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:03:49 ctl02 nova-api[15860]: 2017-09-28 13:03:49.754 15860 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:03:49 ctl02 nova-api[15860]: 2017-09-28 13:03:49.754 15860 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:03:49 ctl02 nova-api[15860]: 2017-09-28 13:03:49.754 15860 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:03:49 ctl02 nova-api[15860]: 2017-09-28 13:03:49.754 15860 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:03:49 ctl02 nova-api[15860]: 2017-09-28 13:03:49.754 15860 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:03:49 ctl02 nova-api[15860]: 2017-09-28 13:03:49.754 15860 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:03:49 ctl02 nova-api[15860]: 2017-09-28 13:03:49.754 15860 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:03:49 ctl02 nova-api[15860]: 2017-09-28 13:03:49.754 15860 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:03:49 ctl02 nova-api[15860]: 2017-09-28 13:03:49.754 15860 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:03:49 ctl02 nova-api[15860]: 2017-09-28 13:03:49.754 15860 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:03:49 ctl02 nova-api[15860]: 2017-09-28 13:03:49.754 15860 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:03:49 ctl02 nova-api[15860]: 2017-09-28 13:03:49.754 15860 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:03:49 ctl02 nova-api[15860]: 2017-09-28 13:03:49.754 15860 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:03:49 ctl02 nova-api[15860]: 2017-09-28 13:03:49.754 15860 ERROR nova.wsgi     self.filename))
Sep 28 13:03:49 ctl02 nova-api[15860]: 2017-09-28 13:03:49.754 15860 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:03:49 ctl02 nova-api[15860]: 2017-09-28 13:03:49.754 15860 ERROR nova.wsgi
Sep 28 13:03:49 ctl02 nova-api[15860]: 2017-09-28 13:03:49.760 15860 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:03:49 ctl02 nova-api[15860]: 2017-09-28 13:03:49.893 15860 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:03:50 ctl02 nova-api[15860]: 2017-09-28 13:03:50.117 15860 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:03:50 ctl02 nova-api[15860]: 2017-09-28 13:03:50.119 15860 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:03:50 ctl02 nova-api[15860]: 2017-09-28 13:03:50.119 15860 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:03:50 ctl02 nova-api[15860]: 2017-09-28 13:03:50.119 15860 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:03:50 ctl02 nova-api[15860]: 2017-09-28 13:03:50.254 15860 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:03:50 ctl02 nova-api[15860]: 2017-09-28 13:03:50.256 15860 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:03:50 ctl02 nova-api[15860]: 2017-09-28 13:03:50.256 15860 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:03:50 ctl02 nova-api[15860]: 2017-09-28 13:03:50.257 15860 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:03:50 ctl02 nova-api[15860]: 2017-09-28 13:03:50.260 15860 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:03:50 ctl02 nova-api[15860]: 2017-09-28 13:03:50.260 15860 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:03:50 ctl02 nova-api[15860]: 2017-09-28 13:03:50.260 15860 ERROR nova Traceback (most recent call last):
Sep 28 13:03:50 ctl02 nova-api[15860]: 2017-09-28 13:03:50.260 15860 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:03:50 ctl02 nova-api[15860]: 2017-09-28 13:03:50.260 15860 ERROR nova     sys.exit(main())
Sep 28 13:03:50 ctl02 nova-api[15860]: 2017-09-28 13:03:50.260 15860 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:03:50 ctl02 nova-api[15860]: 2017-09-28 13:03:50.260 15860 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:03:50 ctl02 nova-api[15860]: 2017-09-28 13:03:50.260 15860 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:03:50 ctl02 nova-api[15860]: 2017-09-28 13:03:50.260 15860 ERROR nova     max_url_len=max_url_len)
Sep 28 13:03:50 ctl02 nova-api[15860]: 2017-09-28 13:03:50.260 15860 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:03:50 ctl02 nova-api[15860]: 2017-09-28 13:03:50.260 15860 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:03:50 ctl02 nova-api[15860]: 2017-09-28 13:03:50.260 15860 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:03:50 ctl02 nova-api[15860]: 2017-09-28 13:03:50.260 15860 ERROR nova     sock.listen(backlog)
Sep 28 13:03:50 ctl02 nova-api[15860]: 2017-09-28 13:03:50.260 15860 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:03:50 ctl02 nova-api[15860]: 2017-09-28 13:03:50.260 15860 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:03:50 ctl02 nova-api[15860]: 2017-09-28 13:03:50.260 15860 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:03:50 ctl02 nova-api[15860]: 2017-09-28 13:03:50.260 15860 ERROR nova
Sep 28 13:03:50 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:03:50 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:03:50 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:03:50 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:03:50.442 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:03:50] "OPTIONS / HTTP/1.0" 200 134 0.000378
Sep 28 13:03:50 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:03:50 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:03:50 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:03:50 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:03:50 ctl02 glance-api[29183]: 2017-09-28 13:03:50.673 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:03:50] "OPTIONS / HTTP/1.0" 200 134 0.000719
Sep 28 13:03:50 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa86a4952)
Sep 28 13:03:51 ctl02 neutron-server[30536]: 2017-09-28 13:03:51.004 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 13:03:51 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 13:03:51 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 13:03:06 cmp002
Sep 28 13:03:51 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 13:02:58 cmp001
Sep 28 13:03:51 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 13:02:30 cmp002
Sep 28 13:03:51 ctl02 glance-api[29183]: 2017-09-28 13:03:51.396 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:03:51] "OPTIONS / HTTP/1.0" 200 134 0.000558
Sep 28 13:03:51 ctl02 neutron-server[30536]: 2017-09-28 13:03:51.424 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:03:51] "OPTIONS / HTTP/1.0" 200 262 0.000479
Sep 28 13:03:51 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 13:03:51 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 13:03:52 ctl02 nova-api[15878]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:03:52 ctl02 nova-api[15878]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:03:52 ctl02 nova-api[15878]: 2017-09-28 13:03:52.534 15878 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:03:52 ctl02 nova-api[15878]: 2017-09-28 13:03:52.535 15878 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:03:52 ctl02 nova-api[15878]: 2017-09-28 13:03:52.535 15878 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:03:52 ctl02 nova-api[15878]: 2017-09-28 13:03:52.535 15878 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:03:52 ctl02 nova-api[15878]: 2017-09-28 13:03:52.535 15878 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:03:52 ctl02 nova-api[15878]: 2017-09-28 13:03:52.535 15878 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:03:52 ctl02 nova-api[15878]: 2017-09-28 13:03:52.535 15878 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:03:52 ctl02 nova-api[15878]: 2017-09-28 13:03:52.535 15878 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:03:52 ctl02 nova-api[15878]: 2017-09-28 13:03:52.535 15878 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:03:52 ctl02 nova-api[15878]: 2017-09-28 13:03:52.535 15878 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:03:52 ctl02 nova-api[15878]: 2017-09-28 13:03:52.535 15878 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:03:52 ctl02 nova-api[15878]: 2017-09-28 13:03:52.535 15878 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:03:52 ctl02 nova-api[15878]: 2017-09-28 13:03:52.535 15878 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:03:52 ctl02 nova-api[15878]: 2017-09-28 13:03:52.535 15878 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:03:52 ctl02 nova-api[15878]: 2017-09-28 13:03:52.535 15878 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:03:52 ctl02 nova-api[15878]: 2017-09-28 13:03:52.535 15878 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:03:52 ctl02 nova-api[15878]: 2017-09-28 13:03:52.535 15878 ERROR nova.wsgi     self.filename))
Sep 28 13:03:52 ctl02 nova-api[15878]: 2017-09-28 13:03:52.535 15878 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:03:52 ctl02 nova-api[15878]: 2017-09-28 13:03:52.535 15878 ERROR nova.wsgi
Sep 28 13:03:52 ctl02 nova-api[15878]: 2017-09-28 13:03:52.536 15878 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:03:52 ctl02 nova-api[15878]: 2017-09-28 13:03:52.667 15878 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:03:52 ctl02 nova-api[15878]: 2017-09-28 13:03:52.895 15878 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:03:52 ctl02 nova-api[15878]: 2017-09-28 13:03:52.897 15878 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:03:52 ctl02 nova-api[15878]: 2017-09-28 13:03:52.897 15878 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:03:52 ctl02 nova-api[15878]: 2017-09-28 13:03:52.898 15878 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:03:53 ctl02 nova-api[15878]: 2017-09-28 13:03:53.033 15878 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:03:53 ctl02 nova-api[15878]: 2017-09-28 13:03:53.034 15878 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:03:53 ctl02 nova-api[15878]: 2017-09-28 13:03:53.035 15878 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:03:53 ctl02 nova-api[15878]: 2017-09-28 13:03:53.035 15878 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:03:53 ctl02 nova-api[15878]: 2017-09-28 13:03:53.038 15878 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:03:53 ctl02 nova-api[15878]: 2017-09-28 13:03:53.038 15878 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:03:53 ctl02 nova-api[15878]: 2017-09-28 13:03:53.038 15878 ERROR nova Traceback (most recent call last):
Sep 28 13:03:53 ctl02 nova-api[15878]: 2017-09-28 13:03:53.038 15878 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:03:53 ctl02 nova-api[15878]: 2017-09-28 13:03:53.038 15878 ERROR nova     sys.exit(main())
Sep 28 13:03:53 ctl02 nova-api[15878]: 2017-09-28 13:03:53.038 15878 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:03:53 ctl02 nova-api[15878]: 2017-09-28 13:03:53.038 15878 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:03:53 ctl02 nova-api[15878]: 2017-09-28 13:03:53.038 15878 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:03:53 ctl02 nova-api[15878]: 2017-09-28 13:03:53.038 15878 ERROR nova     max_url_len=max_url_len)
Sep 28 13:03:53 ctl02 nova-api[15878]: 2017-09-28 13:03:53.038 15878 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:03:53 ctl02 nova-api[15878]: 2017-09-28 13:03:53.038 15878 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:03:53 ctl02 nova-api[15878]: 2017-09-28 13:03:53.038 15878 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:03:53 ctl02 nova-api[15878]: 2017-09-28 13:03:53.038 15878 ERROR nova     sock.listen(backlog)
Sep 28 13:03:53 ctl02 nova-api[15878]: 2017-09-28 13:03:53.038 15878 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:03:53 ctl02 nova-api[15878]: 2017-09-28 13:03:53.038 15878 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:03:53 ctl02 nova-api[15878]: 2017-09-28 13:03:53.038 15878 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:03:53 ctl02 nova-api[15878]: 2017-09-28 13:03:53.038 15878 ERROR nova
Sep 28 13:03:53 ctl02 heat-api[13008]: 2017-09-28 13:03:53.133 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:03:53] "OPTIONS / HTTP/1.0" 200 134 0.000537
Sep 28 13:03:53 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:03:53 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:03:53 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:03:53 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:03:53 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:03:53 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:03:53 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:03:53 ctl02 glance-api[29183]: 2017-09-28 13:03:53.737 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:03:53] "OPTIONS / HTTP/1.0" 200 134 0.000644
Sep 28 13:03:53 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:03:53.864 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:03:53] "OPTIONS / HTTP/1.0" 200 134 0.000451
Sep 28 13:03:55 ctl02 heat-api-cfn[13300]: 2017-09-28 13:03:55.014 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:03:55] "OPTIONS / HTTP/1.0" 200 134 0.000496
Sep 28 13:03:55 ctl02 nova-api[15900]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:03:55 ctl02 nova-api[15900]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:03:55 ctl02 neutron-server[30536]: 2017-09-28 13:03:55.093 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:03:55] "OPTIONS / HTTP/1.0" 200 262 0.000609
Sep 28 13:03:55 ctl02 nova-api[15900]: 2017-09-28 13:03:55.252 15900 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:03:55 ctl02 nova-api[15900]: 2017-09-28 13:03:55.254 15900 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:03:55 ctl02 nova-api[15900]: 2017-09-28 13:03:55.254 15900 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:03:55 ctl02 nova-api[15900]: 2017-09-28 13:03:55.254 15900 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:03:55 ctl02 nova-api[15900]: 2017-09-28 13:03:55.254 15900 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:03:55 ctl02 nova-api[15900]: 2017-09-28 13:03:55.254 15900 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:03:55 ctl02 nova-api[15900]: 2017-09-28 13:03:55.254 15900 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:03:55 ctl02 nova-api[15900]: 2017-09-28 13:03:55.254 15900 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:03:55 ctl02 nova-api[15900]: 2017-09-28 13:03:55.254 15900 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:03:55 ctl02 nova-api[15900]: 2017-09-28 13:03:55.254 15900 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:03:55 ctl02 nova-api[15900]: 2017-09-28 13:03:55.254 15900 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:03:55 ctl02 nova-api[15900]: 2017-09-28 13:03:55.254 15900 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:03:55 ctl02 nova-api[15900]: 2017-09-28 13:03:55.254 15900 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:03:55 ctl02 nova-api[15900]: 2017-09-28 13:03:55.254 15900 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:03:55 ctl02 nova-api[15900]: 2017-09-28 13:03:55.254 15900 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:03:55 ctl02 nova-api[15900]: 2017-09-28 13:03:55.254 15900 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:03:55 ctl02 nova-api[15900]: 2017-09-28 13:03:55.254 15900 ERROR nova.wsgi     self.filename))
Sep 28 13:03:55 ctl02 nova-api[15900]: 2017-09-28 13:03:55.254 15900 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:03:55 ctl02 nova-api[15900]: 2017-09-28 13:03:55.254 15900 ERROR nova.wsgi
Sep 28 13:03:55 ctl02 nova-api[15900]: 2017-09-28 13:03:55.255 15900 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:03:55 ctl02 nova-api[15900]: 2017-09-28 13:03:55.388 15900 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:03:55 ctl02 nova-api[15900]: 2017-09-28 13:03:55.633 15900 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:03:55 ctl02 nova-api[15900]: 2017-09-28 13:03:55.635 15900 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:03:55 ctl02 nova-api[15900]: 2017-09-28 13:03:55.635 15900 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:03:55 ctl02 nova-api[15900]: 2017-09-28 13:03:55.635 15900 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:03:55 ctl02 nova-api[15900]: 2017-09-28 13:03:55.767 15900 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:03:55 ctl02 nova-api[15900]: 2017-09-28 13:03:55.769 15900 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:03:55 ctl02 nova-api[15900]: 2017-09-28 13:03:55.769 15900 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:03:55 ctl02 nova-api[15900]: 2017-09-28 13:03:55.769 15900 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:03:55 ctl02 nova-api[15900]: 2017-09-28 13:03:55.772 15900 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:03:55 ctl02 nova-api[15900]: 2017-09-28 13:03:55.773 15900 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:03:55 ctl02 nova-api[15900]: 2017-09-28 13:03:55.773 15900 ERROR nova Traceback (most recent call last):
Sep 28 13:03:55 ctl02 nova-api[15900]: 2017-09-28 13:03:55.773 15900 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:03:55 ctl02 nova-api[15900]: 2017-09-28 13:03:55.773 15900 ERROR nova     sys.exit(main())
Sep 28 13:03:55 ctl02 nova-api[15900]: 2017-09-28 13:03:55.773 15900 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:03:55 ctl02 nova-api[15900]: 2017-09-28 13:03:55.773 15900 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:03:55 ctl02 nova-api[15900]: 2017-09-28 13:03:55.773 15900 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:03:55 ctl02 nova-api[15900]: 2017-09-28 13:03:55.773 15900 ERROR nova     max_url_len=max_url_len)
Sep 28 13:03:55 ctl02 nova-api[15900]: 2017-09-28 13:03:55.773 15900 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:03:55 ctl02 nova-api[15900]: 2017-09-28 13:03:55.773 15900 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:03:55 ctl02 nova-api[15900]: 2017-09-28 13:03:55.773 15900 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:03:55 ctl02 nova-api[15900]: 2017-09-28 13:03:55.773 15900 ERROR nova     sock.listen(backlog)
Sep 28 13:03:55 ctl02 nova-api[15900]: 2017-09-28 13:03:55.773 15900 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:03:55 ctl02 nova-api[15900]: 2017-09-28 13:03:55.773 15900 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:03:55 ctl02 nova-api[15900]: 2017-09-28 13:03:55.773 15900 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:03:55 ctl02 nova-api[15900]: 2017-09-28 13:03:55.773 15900 ERROR nova
Sep 28 13:03:55 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:03:55 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:03:55 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:03:56 ctl02 heat-api-cfn[13300]: 2017-09-28 13:03:56.046 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:03:56] "OPTIONS / HTTP/1.0" 200 134 0.000552
Sep 28 13:03:56 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:03:56 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:03:56 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:03:56 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:03:57 ctl02 nova-api[15919]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:03:57 ctl02 nova-api[15919]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:03:57 ctl02 nova-api[15919]: 2017-09-28 13:03:57.953 15919 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:03:57 ctl02 nova-api[15919]: 2017-09-28 13:03:57.954 15919 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:03:57 ctl02 nova-api[15919]: 2017-09-28 13:03:57.954 15919 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:03:57 ctl02 nova-api[15919]: 2017-09-28 13:03:57.954 15919 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:03:57 ctl02 nova-api[15919]: 2017-09-28 13:03:57.954 15919 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:03:57 ctl02 nova-api[15919]: 2017-09-28 13:03:57.954 15919 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:03:57 ctl02 nova-api[15919]: 2017-09-28 13:03:57.954 15919 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:03:57 ctl02 nova-api[15919]: 2017-09-28 13:03:57.954 15919 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:03:57 ctl02 nova-api[15919]: 2017-09-28 13:03:57.954 15919 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:03:57 ctl02 nova-api[15919]: 2017-09-28 13:03:57.954 15919 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:03:57 ctl02 nova-api[15919]: 2017-09-28 13:03:57.954 15919 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:03:57 ctl02 nova-api[15919]: 2017-09-28 13:03:57.954 15919 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:03:57 ctl02 nova-api[15919]: 2017-09-28 13:03:57.954 15919 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:03:57 ctl02 nova-api[15919]: 2017-09-28 13:03:57.954 15919 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:03:57 ctl02 nova-api[15919]: 2017-09-28 13:03:57.954 15919 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:03:57 ctl02 nova-api[15919]: 2017-09-28 13:03:57.954 15919 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:03:57 ctl02 nova-api[15919]: 2017-09-28 13:03:57.954 15919 ERROR nova.wsgi     self.filename))
Sep 28 13:03:57 ctl02 nova-api[15919]: 2017-09-28 13:03:57.954 15919 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:03:57 ctl02 nova-api[15919]: 2017-09-28 13:03:57.954 15919 ERROR nova.wsgi
Sep 28 13:03:57 ctl02 nova-api[15919]: 2017-09-28 13:03:57.955 15919 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:03:58 ctl02 neutron-server[30536]: 2017-09-28 13:03:58.015 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:03:58] "OPTIONS / HTTP/1.0" 200 262 0.000585
Sep 28 13:03:58 ctl02 nova-api[15919]: 2017-09-28 13:03:58.081 15919 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:03:58 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:03:58.219 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:03:58] "OPTIONS / HTTP/1.0" 200 134 0.000516
Sep 28 13:03:58 ctl02 nova-api[15919]: 2017-09-28 13:03:58.302 15919 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:03:58 ctl02 nova-api[15919]: 2017-09-28 13:03:58.304 15919 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:03:58 ctl02 nova-api[15919]: 2017-09-28 13:03:58.304 15919 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:03:58 ctl02 nova-api[15919]: 2017-09-28 13:03:58.304 15919 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:03:58 ctl02 heat-api[13008]: 2017-09-28 13:03:58.424 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:03:58] "OPTIONS / HTTP/1.0" 200 134 0.000574
Sep 28 13:03:58 ctl02 nova-api[15919]: 2017-09-28 13:03:58.440 15919 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:03:58 ctl02 nova-api[15919]: 2017-09-28 13:03:58.442 15919 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:03:58 ctl02 nova-api[15919]: 2017-09-28 13:03:58.442 15919 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:03:58 ctl02 nova-api[15919]: 2017-09-28 13:03:58.443 15919 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:03:58 ctl02 nova-api[15919]: 2017-09-28 13:03:58.447 15919 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:03:58 ctl02 nova-api[15919]: 2017-09-28 13:03:58.447 15919 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:03:58 ctl02 nova-api[15919]: 2017-09-28 13:03:58.447 15919 ERROR nova Traceback (most recent call last):
Sep 28 13:03:58 ctl02 nova-api[15919]: 2017-09-28 13:03:58.447 15919 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:03:58 ctl02 nova-api[15919]: 2017-09-28 13:03:58.447 15919 ERROR nova     sys.exit(main())
Sep 28 13:03:58 ctl02 nova-api[15919]: 2017-09-28 13:03:58.447 15919 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:03:58 ctl02 nova-api[15919]: 2017-09-28 13:03:58.447 15919 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:03:58 ctl02 nova-api[15919]: 2017-09-28 13:03:58.447 15919 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:03:58 ctl02 nova-api[15919]: 2017-09-28 13:03:58.447 15919 ERROR nova     max_url_len=max_url_len)
Sep 28 13:03:58 ctl02 nova-api[15919]: 2017-09-28 13:03:58.447 15919 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:03:58 ctl02 nova-api[15919]: 2017-09-28 13:03:58.447 15919 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:03:58 ctl02 nova-api[15919]: 2017-09-28 13:03:58.447 15919 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:03:58 ctl02 nova-api[15919]: 2017-09-28 13:03:58.447 15919 ERROR nova     sock.listen(backlog)
Sep 28 13:03:58 ctl02 nova-api[15919]: 2017-09-28 13:03:58.447 15919 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:03:58 ctl02 nova-api[15919]: 2017-09-28 13:03:58.447 15919 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:03:58 ctl02 nova-api[15919]: 2017-09-28 13:03:58.447 15919 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:03:58 ctl02 nova-api[15919]: 2017-09-28 13:03:58.447 15919 ERROR nova
Sep 28 13:03:58 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:03:58 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:03:58 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:03:58 ctl02 heat-api[13008]: 2017-09-28 13:03:58.766 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:03:58] "OPTIONS / HTTP/1.0" 200 134 0.000453
Sep 28 13:03:58 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:03:58 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:03:58 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:03:58 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:03:59 ctl02 heat-api-cfn[13300]: 2017-09-28 13:03:59.304 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:03:59] "OPTIONS / HTTP/1.0" 200 134 0.000553
Sep 28 13:04:00 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:04:00.295 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:04:00] "OPTIONS / HTTP/1.0" 200 134 0.000474
Sep 28 13:04:00 ctl02 glance-api[29183]: 2017-09-28 13:04:00.420 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:04:00] "OPTIONS / HTTP/1.0" 200 134 0.000670
Sep 28 13:04:00 ctl02 nova-api[15937]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:04:00 ctl02 nova-api[15937]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:04:00 ctl02 nova-api[15937]: 2017-09-28 13:04:00.769 15937 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:04:00 ctl02 nova-api[15937]: 2017-09-28 13:04:00.770 15937 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:04:00 ctl02 nova-api[15937]: 2017-09-28 13:04:00.770 15937 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:04:00 ctl02 nova-api[15937]: 2017-09-28 13:04:00.770 15937 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:04:00 ctl02 nova-api[15937]: 2017-09-28 13:04:00.770 15937 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:04:00 ctl02 nova-api[15937]: 2017-09-28 13:04:00.770 15937 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:04:00 ctl02 nova-api[15937]: 2017-09-28 13:04:00.770 15937 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:04:00 ctl02 nova-api[15937]: 2017-09-28 13:04:00.770 15937 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:04:00 ctl02 nova-api[15937]: 2017-09-28 13:04:00.770 15937 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:04:00 ctl02 nova-api[15937]: 2017-09-28 13:04:00.770 15937 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:04:00 ctl02 nova-api[15937]: 2017-09-28 13:04:00.770 15937 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:04:00 ctl02 nova-api[15937]: 2017-09-28 13:04:00.770 15937 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:04:00 ctl02 nova-api[15937]: 2017-09-28 13:04:00.770 15937 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:04:00 ctl02 nova-api[15937]: 2017-09-28 13:04:00.770 15937 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:04:00 ctl02 nova-api[15937]: 2017-09-28 13:04:00.770 15937 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:04:00 ctl02 nova-api[15937]: 2017-09-28 13:04:00.770 15937 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:04:00 ctl02 nova-api[15937]: 2017-09-28 13:04:00.770 15937 ERROR nova.wsgi     self.filename))
Sep 28 13:04:00 ctl02 nova-api[15937]: 2017-09-28 13:04:00.770 15937 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:04:00 ctl02 nova-api[15937]: 2017-09-28 13:04:00.770 15937 ERROR nova.wsgi
Sep 28 13:04:00 ctl02 nova-api[15937]: 2017-09-28 13:04:00.772 15937 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:04:00 ctl02 nova-api[15937]: 2017-09-28 13:04:00.898 15937 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:04:01 ctl02 nova-api[15937]: 2017-09-28 13:04:01.122 15937 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:04:01 ctl02 nova-api[15937]: 2017-09-28 13:04:01.124 15937 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:04:01 ctl02 nova-api[15937]: 2017-09-28 13:04:01.125 15937 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:04:01 ctl02 nova-api[15937]: 2017-09-28 13:04:01.125 15937 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:04:01 ctl02 neutron-server[30536]: 2017-09-28 13:04:01.222 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:04:01] "OPTIONS / HTTP/1.0" 200 262 0.000515
Sep 28 13:04:01 ctl02 nova-api[15937]: 2017-09-28 13:04:01.256 15937 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:04:01 ctl02 nova-api[15937]: 2017-09-28 13:04:01.259 15937 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:04:01 ctl02 nova-api[15937]: 2017-09-28 13:04:01.259 15937 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:04:01 ctl02 nova-api[15937]: 2017-09-28 13:04:01.259 15937 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:04:01 ctl02 nova-api[15937]: 2017-09-28 13:04:01.263 15937 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:04:01 ctl02 nova-api[15937]: 2017-09-28 13:04:01.263 15937 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:04:01 ctl02 nova-api[15937]: 2017-09-28 13:04:01.263 15937 ERROR nova Traceback (most recent call last):
Sep 28 13:04:01 ctl02 nova-api[15937]: 2017-09-28 13:04:01.263 15937 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:04:01 ctl02 nova-api[15937]: 2017-09-28 13:04:01.263 15937 ERROR nova     sys.exit(main())
Sep 28 13:04:01 ctl02 nova-api[15937]: 2017-09-28 13:04:01.263 15937 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:04:01 ctl02 nova-api[15937]: 2017-09-28 13:04:01.263 15937 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:04:01 ctl02 nova-api[15937]: 2017-09-28 13:04:01.263 15937 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:04:01 ctl02 nova-api[15937]: 2017-09-28 13:04:01.263 15937 ERROR nova     max_url_len=max_url_len)
Sep 28 13:04:01 ctl02 nova-api[15937]: 2017-09-28 13:04:01.263 15937 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:04:01 ctl02 nova-api[15937]: 2017-09-28 13:04:01.263 15937 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:04:01 ctl02 nova-api[15937]: 2017-09-28 13:04:01.263 15937 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:04:01 ctl02 nova-api[15937]: 2017-09-28 13:04:01.263 15937 ERROR nova     sock.listen(backlog)
Sep 28 13:04:01 ctl02 nova-api[15937]: 2017-09-28 13:04:01.263 15937 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:04:01 ctl02 nova-api[15937]: 2017-09-28 13:04:01.263 15937 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:04:01 ctl02 nova-api[15937]: 2017-09-28 13:04:01.263 15937 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:04:01 ctl02 nova-api[15937]: 2017-09-28 13:04:01.263 15937 ERROR nova
Sep 28 13:04:01 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:04:01 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:04:01 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:04:01 ctl02 glance-api[29183]: 2017-09-28 13:04:01.485 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:04:01] "OPTIONS / HTTP/1.0" 200 134 0.001143
Sep 28 13:04:01 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:04:01 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:04:01 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:04:01 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:04:03 ctl02 heat-api[13008]: 2017-09-28 13:04:03.010 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:04:03] "OPTIONS / HTTP/1.0" 200 134 0.000544
Sep 28 13:04:03 ctl02 nova-api[15954]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:04:03 ctl02 nova-api[15954]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:04:03 ctl02 glance-api[29183]: 2017-09-28 13:04:03.456 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:04:03] "OPTIONS / HTTP/1.0" 200 134 0.000596
Sep 28 13:04:03 ctl02 nova-api[15954]: 2017-09-28 13:04:03.488 15954 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:04:03 ctl02 nova-api[15954]: 2017-09-28 13:04:03.489 15954 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:04:03 ctl02 nova-api[15954]: 2017-09-28 13:04:03.489 15954 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:04:03 ctl02 nova-api[15954]: 2017-09-28 13:04:03.489 15954 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:04:03 ctl02 nova-api[15954]: 2017-09-28 13:04:03.489 15954 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:04:03 ctl02 nova-api[15954]: 2017-09-28 13:04:03.489 15954 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:04:03 ctl02 nova-api[15954]: 2017-09-28 13:04:03.489 15954 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:04:03 ctl02 nova-api[15954]: 2017-09-28 13:04:03.489 15954 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:04:03 ctl02 nova-api[15954]: 2017-09-28 13:04:03.489 15954 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:04:03 ctl02 nova-api[15954]: 2017-09-28 13:04:03.489 15954 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:04:03 ctl02 nova-api[15954]: 2017-09-28 13:04:03.489 15954 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:04:03 ctl02 nova-api[15954]: 2017-09-28 13:04:03.489 15954 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:04:03 ctl02 nova-api[15954]: 2017-09-28 13:04:03.489 15954 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:04:03 ctl02 nova-api[15954]: 2017-09-28 13:04:03.489 15954 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:04:03 ctl02 nova-api[15954]: 2017-09-28 13:04:03.489 15954 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:04:03 ctl02 nova-api[15954]: 2017-09-28 13:04:03.489 15954 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:04:03 ctl02 nova-api[15954]: 2017-09-28 13:04:03.489 15954 ERROR nova.wsgi     self.filename))
Sep 28 13:04:03 ctl02 nova-api[15954]: 2017-09-28 13:04:03.489 15954 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:04:03 ctl02 nova-api[15954]: 2017-09-28 13:04:03.489 15954 ERROR nova.wsgi
Sep 28 13:04:03 ctl02 nova-api[15954]: 2017-09-28 13:04:03.490 15954 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:04:03 ctl02 nova-api[15954]: 2017-09-28 13:04:03.619 15954 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:04:03 ctl02 nova-api[15954]: 2017-09-28 13:04:03.842 15954 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:04:03 ctl02 nova-api[15954]: 2017-09-28 13:04:03.844 15954 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:04:03 ctl02 nova-api[15954]: 2017-09-28 13:04:03.844 15954 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:04:03 ctl02 nova-api[15954]: 2017-09-28 13:04:03.844 15954 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:04:03 ctl02 nova-api[15954]: 2017-09-28 13:04:03.979 15954 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:04:03 ctl02 nova-api[15954]: 2017-09-28 13:04:03.981 15954 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:04:03 ctl02 nova-api[15954]: 2017-09-28 13:04:03.981 15954 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:04:03 ctl02 nova-api[15954]: 2017-09-28 13:04:03.981 15954 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:04:03 ctl02 nova-api[15954]: 2017-09-28 13:04:03.985 15954 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:04:03 ctl02 nova-api[15954]: 2017-09-28 13:04:03.985 15954 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:04:03 ctl02 nova-api[15954]: 2017-09-28 13:04:03.985 15954 ERROR nova Traceback (most recent call last):
Sep 28 13:04:03 ctl02 nova-api[15954]: 2017-09-28 13:04:03.985 15954 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:04:03 ctl02 nova-api[15954]: 2017-09-28 13:04:03.985 15954 ERROR nova     sys.exit(main())
Sep 28 13:04:03 ctl02 nova-api[15954]: 2017-09-28 13:04:03.985 15954 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:04:03 ctl02 nova-api[15954]: 2017-09-28 13:04:03.985 15954 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:04:03 ctl02 nova-api[15954]: 2017-09-28 13:04:03.985 15954 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:04:03 ctl02 nova-api[15954]: 2017-09-28 13:04:03.985 15954 ERROR nova     max_url_len=max_url_len)
Sep 28 13:04:03 ctl02 nova-api[15954]: 2017-09-28 13:04:03.985 15954 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:04:03 ctl02 nova-api[15954]: 2017-09-28 13:04:03.985 15954 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:04:03 ctl02 nova-api[15954]: 2017-09-28 13:04:03.985 15954 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:04:03 ctl02 nova-api[15954]: 2017-09-28 13:04:03.985 15954 ERROR nova     sock.listen(backlog)
Sep 28 13:04:03 ctl02 nova-api[15954]: 2017-09-28 13:04:03.985 15954 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:04:03 ctl02 nova-api[15954]: 2017-09-28 13:04:03.985 15954 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:04:03 ctl02 nova-api[15954]: 2017-09-28 13:04:03.985 15954 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:04:03 ctl02 nova-api[15954]: 2017-09-28 13:04:03.985 15954 ERROR nova
Sep 28 13:04:04 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:04:04 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:04:04 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:04:04 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:04:04.161 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:04:04] "OPTIONS / HTTP/1.0" 200 134 0.000514
Sep 28 13:04:04 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:04:04 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:04:04 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:04:04 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:04:05 ctl02 neutron-server[30536]: 2017-09-28 13:04:05.113 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:04:05] "OPTIONS / HTTP/1.0" 200 262 0.000556
Sep 28 13:04:05 ctl02 heat-api-cfn[13300]: 2017-09-28 13:04:05.274 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:04:05] "OPTIONS / HTTP/1.0" 200 134 0.000528
Sep 28 13:04:05 ctl02 heat-api-cfn[13300]: 2017-09-28 13:04:05.802 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:04:05] "OPTIONS / HTTP/1.0" 200 134 0.000551
Sep 28 13:04:06 ctl02 neutron-server[30536]: 2017-09-28 13:04:06.001 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 4 dead agents out of 6:
Sep 28 13:04:06 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 13:04:06 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 13:03:06 cmp002
Sep 28 13:04:06 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 13:02:58 cmp001
Sep 28 13:04:06 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 13:02:30 cmp002
Sep 28 13:04:06 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 13:03:36 cmp002
Sep 28 13:04:06 ctl02 nova-api[15973]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:04:06 ctl02 nova-api[15973]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:04:06 ctl02 nova-api[15973]: 2017-09-28 13:04:06.251 15973 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:04:06 ctl02 nova-api[15973]: 2017-09-28 13:04:06.252 15973 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:04:06 ctl02 nova-api[15973]: 2017-09-28 13:04:06.252 15973 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:04:06 ctl02 nova-api[15973]: 2017-09-28 13:04:06.252 15973 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:04:06 ctl02 nova-api[15973]: 2017-09-28 13:04:06.252 15973 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:04:06 ctl02 nova-api[15973]: 2017-09-28 13:04:06.252 15973 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:04:06 ctl02 nova-api[15973]: 2017-09-28 13:04:06.252 15973 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:04:06 ctl02 nova-api[15973]: 2017-09-28 13:04:06.252 15973 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:04:06 ctl02 nova-api[15973]: 2017-09-28 13:04:06.252 15973 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:04:06 ctl02 nova-api[15973]: 2017-09-28 13:04:06.252 15973 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:04:06 ctl02 nova-api[15973]: 2017-09-28 13:04:06.252 15973 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:04:06 ctl02 nova-api[15973]: 2017-09-28 13:04:06.252 15973 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:04:06 ctl02 nova-api[15973]: 2017-09-28 13:04:06.252 15973 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:04:06 ctl02 nova-api[15973]: 2017-09-28 13:04:06.252 15973 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:04:06 ctl02 nova-api[15973]: 2017-09-28 13:04:06.252 15973 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:04:06 ctl02 nova-api[15973]: 2017-09-28 13:04:06.252 15973 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:04:06 ctl02 nova-api[15973]: 2017-09-28 13:04:06.252 15973 ERROR nova.wsgi     self.filename))
Sep 28 13:04:06 ctl02 nova-api[15973]: 2017-09-28 13:04:06.252 15973 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:04:06 ctl02 nova-api[15973]: 2017-09-28 13:04:06.252 15973 ERROR nova.wsgi
Sep 28 13:04:06 ctl02 nova-api[15973]: 2017-09-28 13:04:06.253 15973 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:04:06 ctl02 nova-api[15973]: 2017-09-28 13:04:06.377 15973 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:04:06 ctl02 nova-api[15973]: 2017-09-28 13:04:06.595 15973 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:04:06 ctl02 nova-api[15973]: 2017-09-28 13:04:06.597 15973 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:04:06 ctl02 nova-api[15973]: 2017-09-28 13:04:06.597 15973 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:04:06 ctl02 nova-api[15973]: 2017-09-28 13:04:06.597 15973 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:04:06 ctl02 nova-api[15973]: 2017-09-28 13:04:06.725 15973 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:04:06 ctl02 nova-api[15973]: 2017-09-28 13:04:06.727 15973 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:04:06 ctl02 nova-api[15973]: 2017-09-28 13:04:06.727 15973 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:04:06 ctl02 nova-api[15973]: 2017-09-28 13:04:06.728 15973 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:04:06 ctl02 nova-api[15973]: 2017-09-28 13:04:06.731 15973 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:04:06 ctl02 nova-api[15973]: 2017-09-28 13:04:06.731 15973 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:04:06 ctl02 nova-api[15973]: 2017-09-28 13:04:06.731 15973 ERROR nova Traceback (most recent call last):
Sep 28 13:04:06 ctl02 nova-api[15973]: 2017-09-28 13:04:06.731 15973 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:04:06 ctl02 nova-api[15973]: 2017-09-28 13:04:06.731 15973 ERROR nova     sys.exit(main())
Sep 28 13:04:06 ctl02 nova-api[15973]: 2017-09-28 13:04:06.731 15973 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:04:06 ctl02 nova-api[15973]: 2017-09-28 13:04:06.731 15973 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:04:06 ctl02 nova-api[15973]: 2017-09-28 13:04:06.731 15973 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:04:06 ctl02 nova-api[15973]: 2017-09-28 13:04:06.731 15973 ERROR nova     max_url_len=max_url_len)
Sep 28 13:04:06 ctl02 nova-api[15973]: 2017-09-28 13:04:06.731 15973 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:04:06 ctl02 nova-api[15973]: 2017-09-28 13:04:06.731 15973 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:04:06 ctl02 nova-api[15973]: 2017-09-28 13:04:06.731 15973 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:04:06 ctl02 nova-api[15973]: 2017-09-28 13:04:06.731 15973 ERROR nova     sock.listen(backlog)
Sep 28 13:04:06 ctl02 nova-api[15973]: 2017-09-28 13:04:06.731 15973 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:04:06 ctl02 nova-api[15973]: 2017-09-28 13:04:06.731 15973 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:04:06 ctl02 nova-api[15973]: 2017-09-28 13:04:06.731 15973 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:04:06 ctl02 nova-api[15973]: 2017-09-28 13:04:06.731 15973 ERROR nova
Sep 28 13:04:06 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:04:06 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:04:06 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:04:07 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:04:07 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:04:07 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:04:07 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:04:07 ctl02 nova-conductor[5056]: 2017-09-28 13:04:07.318 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:04:07 ctl02 nova-conductor[5056]: 2017-09-28 13:04:07.328 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:04:07 ctl02 nova-conductor[5056]: 2017-09-28 13:04:07.339 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:04:07 ctl02 nova-conductor[5056]: 2017-09-28 13:04:07.340 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:04:07 ctl02 neutron-server[30536]: 2017-09-28 13:04:07.836 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:04:07] "OPTIONS / HTTP/1.0" 200 262 0.000519
Sep 28 13:04:08 ctl02 nova-cert[4860]: 2017-09-28 13:04:08.096 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:04:08 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x820d2838)
Sep 28 13:04:08 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:04:08.317 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:04:08] "OPTIONS / HTTP/1.0" 200 134 0.000490
Sep 28 13:04:08 ctl02 heat-api[13008]: 2017-09-28 13:04:08.544 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:04:08] "OPTIONS / HTTP/1.0" 200 134 0.000661
Sep 28 13:04:08 ctl02 nova-api[15991]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:04:08 ctl02 nova-api[15991]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:04:09 ctl02 nova-api[15991]: 2017-09-28 13:04:09.060 15991 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:04:09 ctl02 nova-api[15991]: 2017-09-28 13:04:09.061 15991 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:04:09 ctl02 nova-api[15991]: 2017-09-28 13:04:09.061 15991 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:04:09 ctl02 nova-api[15991]: 2017-09-28 13:04:09.061 15991 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:04:09 ctl02 nova-api[15991]: 2017-09-28 13:04:09.061 15991 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:04:09 ctl02 nova-api[15991]: 2017-09-28 13:04:09.061 15991 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:04:09 ctl02 nova-api[15991]: 2017-09-28 13:04:09.061 15991 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:04:09 ctl02 nova-api[15991]: 2017-09-28 13:04:09.061 15991 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:04:09 ctl02 nova-api[15991]: 2017-09-28 13:04:09.061 15991 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:04:09 ctl02 nova-api[15991]: 2017-09-28 13:04:09.061 15991 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:04:09 ctl02 nova-api[15991]: 2017-09-28 13:04:09.061 15991 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:04:09 ctl02 nova-api[15991]: 2017-09-28 13:04:09.061 15991 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:04:09 ctl02 nova-api[15991]: 2017-09-28 13:04:09.061 15991 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:04:09 ctl02 nova-api[15991]: 2017-09-28 13:04:09.061 15991 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:04:09 ctl02 nova-api[15991]: 2017-09-28 13:04:09.061 15991 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:04:09 ctl02 nova-api[15991]: 2017-09-28 13:04:09.061 15991 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:04:09 ctl02 nova-api[15991]: 2017-09-28 13:04:09.061 15991 ERROR nova.wsgi     self.filename))
Sep 28 13:04:09 ctl02 nova-api[15991]: 2017-09-28 13:04:09.061 15991 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:04:09 ctl02 nova-api[15991]: 2017-09-28 13:04:09.061 15991 ERROR nova.wsgi
Sep 28 13:04:09 ctl02 nova-api[15991]: 2017-09-28 13:04:09.062 15991 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:04:09 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x820d2838)
Sep 28 13:04:09 ctl02 heat-api[13008]: 2017-09-28 13:04:09.165 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:04:09] "OPTIONS / HTTP/1.0" 200 134 0.000615
Sep 28 13:04:09 ctl02 nova-api[15991]: 2017-09-28 13:04:09.197 15991 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:04:09 ctl02 nova-api[15991]: 2017-09-28 13:04:09.451 15991 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:04:09 ctl02 nova-api[15991]: 2017-09-28 13:04:09.453 15991 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:04:09 ctl02 nova-api[15991]: 2017-09-28 13:04:09.453 15991 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:04:09 ctl02 nova-api[15991]: 2017-09-28 13:04:09.453 15991 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:04:09 ctl02 heat-api-cfn[13300]: 2017-09-28 13:04:09.553 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:04:09] "OPTIONS / HTTP/1.0" 200 134 0.000556
Sep 28 13:04:09 ctl02 nova-api[15991]: 2017-09-28 13:04:09.587 15991 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:04:09 ctl02 nova-api[15991]: 2017-09-28 13:04:09.589 15991 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:04:09 ctl02 nova-api[15991]: 2017-09-28 13:04:09.589 15991 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:04:09 ctl02 nova-api[15991]: 2017-09-28 13:04:09.589 15991 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:04:09 ctl02 nova-api[15991]: 2017-09-28 13:04:09.593 15991 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:04:09 ctl02 nova-api[15991]: 2017-09-28 13:04:09.593 15991 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:04:09 ctl02 nova-api[15991]: 2017-09-28 13:04:09.593 15991 ERROR nova Traceback (most recent call last):
Sep 28 13:04:09 ctl02 nova-api[15991]: 2017-09-28 13:04:09.593 15991 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:04:09 ctl02 nova-api[15991]: 2017-09-28 13:04:09.593 15991 ERROR nova     sys.exit(main())
Sep 28 13:04:09 ctl02 nova-api[15991]: 2017-09-28 13:04:09.593 15991 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:04:09 ctl02 nova-api[15991]: 2017-09-28 13:04:09.593 15991 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:04:09 ctl02 nova-api[15991]: 2017-09-28 13:04:09.593 15991 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:04:09 ctl02 nova-api[15991]: 2017-09-28 13:04:09.593 15991 ERROR nova     max_url_len=max_url_len)
Sep 28 13:04:09 ctl02 nova-api[15991]: 2017-09-28 13:04:09.593 15991 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:04:09 ctl02 nova-api[15991]: 2017-09-28 13:04:09.593 15991 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:04:09 ctl02 nova-api[15991]: 2017-09-28 13:04:09.593 15991 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:04:09 ctl02 nova-api[15991]: 2017-09-28 13:04:09.593 15991 ERROR nova     sock.listen(backlog)
Sep 28 13:04:09 ctl02 nova-api[15991]: 2017-09-28 13:04:09.593 15991 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:04:09 ctl02 nova-api[15991]: 2017-09-28 13:04:09.593 15991 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:04:09 ctl02 nova-api[15991]: 2017-09-28 13:04:09.593 15991 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:04:09 ctl02 nova-api[15991]: 2017-09-28 13:04:09.593 15991 ERROR nova
Sep 28 13:04:09 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:04:09 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:04:09 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:04:09 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:04:09 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:04:09 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:04:09 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:04:10 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x820d2838)
Sep 28 13:04:10 ctl02 glance-api[29183]: 2017-09-28 13:04:10.224 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:04:10] "OPTIONS / HTTP/1.0" 200 134 0.000622
Sep 28 13:04:10 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:04:10.571 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:04:10] "OPTIONS / HTTP/1.0" 200 134 0.000386
Sep 28 13:04:11 ctl02 neutron-server[30536]: 2017-09-28 13:04:11.066 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:04:11] "OPTIONS / HTTP/1.0" 200 262 0.000443
Sep 28 13:04:11 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x820d2838)
Sep 28 13:04:11 ctl02 nova-api[16009]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:04:11 ctl02 nova-api[16009]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:04:11 ctl02 nova-api[16009]: 2017-09-28 13:04:11.730 16009 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:04:11 ctl02 nova-api[16009]: 2017-09-28 13:04:11.732 16009 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:04:11 ctl02 nova-api[16009]: 2017-09-28 13:04:11.732 16009 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:04:11 ctl02 nova-api[16009]: 2017-09-28 13:04:11.732 16009 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:04:11 ctl02 nova-api[16009]: 2017-09-28 13:04:11.732 16009 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:04:11 ctl02 nova-api[16009]: 2017-09-28 13:04:11.732 16009 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:04:11 ctl02 nova-api[16009]: 2017-09-28 13:04:11.732 16009 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:04:11 ctl02 nova-api[16009]: 2017-09-28 13:04:11.732 16009 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:04:11 ctl02 nova-api[16009]: 2017-09-28 13:04:11.732 16009 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:04:11 ctl02 nova-api[16009]: 2017-09-28 13:04:11.732 16009 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:04:11 ctl02 nova-api[16009]: 2017-09-28 13:04:11.732 16009 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:04:11 ctl02 nova-api[16009]: 2017-09-28 13:04:11.732 16009 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:04:11 ctl02 nova-api[16009]: 2017-09-28 13:04:11.732 16009 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:04:11 ctl02 nova-api[16009]: 2017-09-28 13:04:11.732 16009 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:04:11 ctl02 nova-api[16009]: 2017-09-28 13:04:11.732 16009 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:04:11 ctl02 nova-api[16009]: 2017-09-28 13:04:11.732 16009 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:04:11 ctl02 nova-api[16009]: 2017-09-28 13:04:11.732 16009 ERROR nova.wsgi     self.filename))
Sep 28 13:04:11 ctl02 nova-api[16009]: 2017-09-28 13:04:11.732 16009 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:04:11 ctl02 nova-api[16009]: 2017-09-28 13:04:11.732 16009 ERROR nova.wsgi
Sep 28 13:04:11 ctl02 nova-api[16009]: 2017-09-28 13:04:11.734 16009 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:04:11 ctl02 glance-api[29183]: 2017-09-28 13:04:11.812 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:04:11] "OPTIONS / HTTP/1.0" 200 134 0.000636
Sep 28 13:04:11 ctl02 nova-api[16009]: 2017-09-28 13:04:11.864 16009 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:04:12 ctl02 nova-api[16009]: 2017-09-28 13:04:12.093 16009 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:04:12 ctl02 nova-api[16009]: 2017-09-28 13:04:12.096 16009 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:04:12 ctl02 nova-api[16009]: 2017-09-28 13:04:12.096 16009 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:04:12 ctl02 nova-api[16009]: 2017-09-28 13:04:12.096 16009 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:04:12 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x820d2838)
Sep 28 13:04:12 ctl02 nova-api[16009]: 2017-09-28 13:04:12.230 16009 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:04:12 ctl02 nova-api[16009]: 2017-09-28 13:04:12.232 16009 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:04:12 ctl02 nova-api[16009]: 2017-09-28 13:04:12.232 16009 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:04:12 ctl02 nova-api[16009]: 2017-09-28 13:04:12.232 16009 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:04:12 ctl02 nova-api[16009]: 2017-09-28 13:04:12.235 16009 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:04:12 ctl02 nova-api[16009]: 2017-09-28 13:04:12.236 16009 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:04:12 ctl02 nova-api[16009]: 2017-09-28 13:04:12.236 16009 ERROR nova Traceback (most recent call last):
Sep 28 13:04:12 ctl02 nova-api[16009]: 2017-09-28 13:04:12.236 16009 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:04:12 ctl02 nova-api[16009]: 2017-09-28 13:04:12.236 16009 ERROR nova     sys.exit(main())
Sep 28 13:04:12 ctl02 nova-api[16009]: 2017-09-28 13:04:12.236 16009 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:04:12 ctl02 nova-api[16009]: 2017-09-28 13:04:12.236 16009 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:04:12 ctl02 nova-api[16009]: 2017-09-28 13:04:12.236 16009 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:04:12 ctl02 nova-api[16009]: 2017-09-28 13:04:12.236 16009 ERROR nova     max_url_len=max_url_len)
Sep 28 13:04:12 ctl02 nova-api[16009]: 2017-09-28 13:04:12.236 16009 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:04:12 ctl02 nova-api[16009]: 2017-09-28 13:04:12.236 16009 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:04:12 ctl02 nova-api[16009]: 2017-09-28 13:04:12.236 16009 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:04:12 ctl02 nova-api[16009]: 2017-09-28 13:04:12.236 16009 ERROR nova     sock.listen(backlog)
Sep 28 13:04:12 ctl02 nova-api[16009]: 2017-09-28 13:04:12.236 16009 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:04:12 ctl02 nova-api[16009]: 2017-09-28 13:04:12.236 16009 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:04:12 ctl02 nova-api[16009]: 2017-09-28 13:04:12.236 16009 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:04:12 ctl02 nova-api[16009]: 2017-09-28 13:04:12.236 16009 ERROR nova
Sep 28 13:04:12 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:04:12 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:04:12 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:04:12 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:04:12 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:04:12 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:04:12 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:04:13 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x820d2838)
Sep 28 13:04:13 ctl02 heat-api[13008]: 2017-09-28 13:04:13.319 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:04:13] "OPTIONS / HTTP/1.0" 200 134 0.000520
Sep 28 13:04:13 ctl02 neutron-server[30536]: 2017-09-28 13:04:13.540 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 13:04:13 ctl02 glance-api[29183]: 2017-09-28 13:04:13.734 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:04:13] "OPTIONS / HTTP/1.0" 200 134 0.000704
Sep 28 13:04:13 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:04:13.811 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:04:13] "OPTIONS / HTTP/1.0" 200 134 0.000398
Sep 28 13:04:14 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x820d2838)
Sep 28 13:04:14 ctl02 nova-api[16028]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:04:14 ctl02 nova-api[16028]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:04:14 ctl02 nova-api[16028]: 2017-09-28 13:04:14.505 16028 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:04:14 ctl02 nova-api[16028]: 2017-09-28 13:04:14.506 16028 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:04:14 ctl02 nova-api[16028]: 2017-09-28 13:04:14.506 16028 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:04:14 ctl02 nova-api[16028]: 2017-09-28 13:04:14.506 16028 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:04:14 ctl02 nova-api[16028]: 2017-09-28 13:04:14.506 16028 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:04:14 ctl02 nova-api[16028]: 2017-09-28 13:04:14.506 16028 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:04:14 ctl02 nova-api[16028]: 2017-09-28 13:04:14.506 16028 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:04:14 ctl02 nova-api[16028]: 2017-09-28 13:04:14.506 16028 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:04:14 ctl02 nova-api[16028]: 2017-09-28 13:04:14.506 16028 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:04:14 ctl02 nova-api[16028]: 2017-09-28 13:04:14.506 16028 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:04:14 ctl02 nova-api[16028]: 2017-09-28 13:04:14.506 16028 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:04:14 ctl02 nova-api[16028]: 2017-09-28 13:04:14.506 16028 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:04:14 ctl02 nova-api[16028]: 2017-09-28 13:04:14.506 16028 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:04:14 ctl02 nova-api[16028]: 2017-09-28 13:04:14.506 16028 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:04:14 ctl02 nova-api[16028]: 2017-09-28 13:04:14.506 16028 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:04:14 ctl02 nova-api[16028]: 2017-09-28 13:04:14.506 16028 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:04:14 ctl02 nova-api[16028]: 2017-09-28 13:04:14.506 16028 ERROR nova.wsgi     self.filename))
Sep 28 13:04:14 ctl02 nova-api[16028]: 2017-09-28 13:04:14.506 16028 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:04:14 ctl02 nova-api[16028]: 2017-09-28 13:04:14.506 16028 ERROR nova.wsgi
Sep 28 13:04:14 ctl02 nova-api[16028]: 2017-09-28 13:04:14.507 16028 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:04:14 ctl02 nova-api[16028]: 2017-09-28 13:04:14.637 16028 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:04:14 ctl02 neutron-server[30536]: 2017-09-28 13:04:14.841 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:04:14] "OPTIONS / HTTP/1.0" 200 262 0.000605
Sep 28 13:04:14 ctl02 nova-api[16028]: 2017-09-28 13:04:14.867 16028 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:04:14 ctl02 nova-api[16028]: 2017-09-28 13:04:14.869 16028 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:04:14 ctl02 nova-api[16028]: 2017-09-28 13:04:14.870 16028 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:04:14 ctl02 nova-api[16028]: 2017-09-28 13:04:14.870 16028 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:04:15 ctl02 nova-api[16028]: 2017-09-28 13:04:15.001 16028 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:04:15 ctl02 nova-api[16028]: 2017-09-28 13:04:15.002 16028 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:04:15 ctl02 nova-api[16028]: 2017-09-28 13:04:15.003 16028 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:04:15 ctl02 nova-api[16028]: 2017-09-28 13:04:15.003 16028 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:04:15 ctl02 nova-api[16028]: 2017-09-28 13:04:15.006 16028 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:04:15 ctl02 nova-api[16028]: 2017-09-28 13:04:15.006 16028 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:04:15 ctl02 nova-api[16028]: 2017-09-28 13:04:15.006 16028 ERROR nova Traceback (most recent call last):
Sep 28 13:04:15 ctl02 nova-api[16028]: 2017-09-28 13:04:15.006 16028 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:04:15 ctl02 nova-api[16028]: 2017-09-28 13:04:15.006 16028 ERROR nova     sys.exit(main())
Sep 28 13:04:15 ctl02 nova-api[16028]: 2017-09-28 13:04:15.006 16028 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:04:15 ctl02 nova-api[16028]: 2017-09-28 13:04:15.006 16028 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:04:15 ctl02 nova-api[16028]: 2017-09-28 13:04:15.006 16028 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:04:15 ctl02 nova-api[16028]: 2017-09-28 13:04:15.006 16028 ERROR nova     max_url_len=max_url_len)
Sep 28 13:04:15 ctl02 nova-api[16028]: 2017-09-28 13:04:15.006 16028 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:04:15 ctl02 nova-api[16028]: 2017-09-28 13:04:15.006 16028 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:04:15 ctl02 nova-api[16028]: 2017-09-28 13:04:15.006 16028 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:04:15 ctl02 nova-api[16028]: 2017-09-28 13:04:15.006 16028 ERROR nova     sock.listen(backlog)
Sep 28 13:04:15 ctl02 nova-api[16028]: 2017-09-28 13:04:15.006 16028 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:04:15 ctl02 nova-api[16028]: 2017-09-28 13:04:15.006 16028 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:04:15 ctl02 nova-api[16028]: 2017-09-28 13:04:15.006 16028 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:04:15 ctl02 nova-api[16028]: 2017-09-28 13:04:15.006 16028 ERROR nova
Sep 28 13:04:15 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:04:15 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:04:15 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:04:15 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x820d2838)
Sep 28 13:04:15 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:04:15 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:04:15 ctl02 heat-api-cfn[13300]: 2017-09-28 13:04:15.395 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:04:15] "OPTIONS / HTTP/1.0" 200 134 0.000622
Sep 28 13:04:15 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:04:15 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:04:16 ctl02 heat-api-cfn[13300]: 2017-09-28 13:04:16.022 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:04:16] "OPTIONS / HTTP/1.0" 200 134 0.000446
Sep 28 13:04:16 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x820d2838)
Sep 28 13:04:17 ctl02 nova-api[16046]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:04:17 ctl02 nova-api[16046]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:04:17 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x820d2838)
Sep 28 13:04:17 ctl02 nova-api[16046]: 2017-09-28 13:04:17.255 16046 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:04:17 ctl02 nova-api[16046]: 2017-09-28 13:04:17.256 16046 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:04:17 ctl02 nova-api[16046]: 2017-09-28 13:04:17.256 16046 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:04:17 ctl02 nova-api[16046]: 2017-09-28 13:04:17.256 16046 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:04:17 ctl02 nova-api[16046]: 2017-09-28 13:04:17.256 16046 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:04:17 ctl02 nova-api[16046]: 2017-09-28 13:04:17.256 16046 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:04:17 ctl02 nova-api[16046]: 2017-09-28 13:04:17.256 16046 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:04:17 ctl02 nova-api[16046]: 2017-09-28 13:04:17.256 16046 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:04:17 ctl02 nova-api[16046]: 2017-09-28 13:04:17.256 16046 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:04:17 ctl02 nova-api[16046]: 2017-09-28 13:04:17.256 16046 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:04:17 ctl02 nova-api[16046]: 2017-09-28 13:04:17.256 16046 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:04:17 ctl02 nova-api[16046]: 2017-09-28 13:04:17.256 16046 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:04:17 ctl02 nova-api[16046]: 2017-09-28 13:04:17.256 16046 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:04:17 ctl02 nova-api[16046]: 2017-09-28 13:04:17.256 16046 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:04:17 ctl02 nova-api[16046]: 2017-09-28 13:04:17.256 16046 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:04:17 ctl02 nova-api[16046]: 2017-09-28 13:04:17.256 16046 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:04:17 ctl02 nova-api[16046]: 2017-09-28 13:04:17.256 16046 ERROR nova.wsgi     self.filename))
Sep 28 13:04:17 ctl02 nova-api[16046]: 2017-09-28 13:04:17.256 16046 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:04:17 ctl02 nova-api[16046]: 2017-09-28 13:04:17.256 16046 ERROR nova.wsgi
Sep 28 13:04:17 ctl02 nova-api[16046]: 2017-09-28 13:04:17.258 16046 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:04:17 ctl02 nova-api[16046]: 2017-09-28 13:04:17.388 16046 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:04:17 ctl02 neutron-server[30536]: 2017-09-28 13:04:17.548 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:04:17] "OPTIONS / HTTP/1.0" 200 262 0.000577
Sep 28 13:04:17 ctl02 nova-api[16046]: 2017-09-28 13:04:17.614 16046 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:04:17 ctl02 nova-api[16046]: 2017-09-28 13:04:17.616 16046 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:04:17 ctl02 nova-api[16046]: 2017-09-28 13:04:17.617 16046 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:04:17 ctl02 nova-api[16046]: 2017-09-28 13:04:17.617 16046 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:04:17 ctl02 nova-api[16046]: 2017-09-28 13:04:17.749 16046 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:04:17 ctl02 nova-api[16046]: 2017-09-28 13:04:17.751 16046 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:04:17 ctl02 nova-api[16046]: 2017-09-28 13:04:17.751 16046 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:04:17 ctl02 nova-api[16046]: 2017-09-28 13:04:17.752 16046 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:04:17 ctl02 nova-api[16046]: 2017-09-28 13:04:17.755 16046 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:04:17 ctl02 nova-api[16046]: 2017-09-28 13:04:17.756 16046 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:04:17 ctl02 nova-api[16046]: 2017-09-28 13:04:17.756 16046 ERROR nova Traceback (most recent call last):
Sep 28 13:04:17 ctl02 nova-api[16046]: 2017-09-28 13:04:17.756 16046 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:04:17 ctl02 nova-api[16046]: 2017-09-28 13:04:17.756 16046 ERROR nova     sys.exit(main())
Sep 28 13:04:17 ctl02 nova-api[16046]: 2017-09-28 13:04:17.756 16046 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:04:17 ctl02 nova-api[16046]: 2017-09-28 13:04:17.756 16046 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:04:17 ctl02 nova-api[16046]: 2017-09-28 13:04:17.756 16046 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:04:17 ctl02 nova-api[16046]: 2017-09-28 13:04:17.756 16046 ERROR nova     max_url_len=max_url_len)
Sep 28 13:04:17 ctl02 nova-api[16046]: 2017-09-28 13:04:17.756 16046 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:04:17 ctl02 nova-api[16046]: 2017-09-28 13:04:17.756 16046 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:04:17 ctl02 nova-api[16046]: 2017-09-28 13:04:17.756 16046 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:04:17 ctl02 nova-api[16046]: 2017-09-28 13:04:17.756 16046 ERROR nova     sock.listen(backlog)
Sep 28 13:04:17 ctl02 nova-api[16046]: 2017-09-28 13:04:17.756 16046 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:04:17 ctl02 nova-api[16046]: 2017-09-28 13:04:17.756 16046 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:04:17 ctl02 nova-api[16046]: 2017-09-28 13:04:17.756 16046 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:04:17 ctl02 nova-api[16046]: 2017-09-28 13:04:17.756 16046 ERROR nova
Sep 28 13:04:17 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:04:17 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:04:17 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:04:17 ctl02 nova-consoleauth[5433]: 2017-09-28 13:04:17.948 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:04:18 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:04:18 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:04:18 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:04:18 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:04:18 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x820d2838)
Sep 28 13:04:18 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:04:18.412 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:04:18] "OPTIONS / HTTP/1.0" 200 134 0.000540
Sep 28 13:04:18 ctl02 heat-engine[12803]: 2017-09-28 13:04:18.451 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:04:18 ctl02 heat-engine[12803]: 2017-09-28 13:04:18.468 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:04:18 ctl02 heat-engine[12803]: 2017-09-28 13:04:18.474 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:04:18 ctl02 heat-engine[12803]: 2017-09-28 13:04:18.475 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:04:18 ctl02 heat-api[13008]: 2017-09-28 13:04:18.557 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:04:18] "OPTIONS / HTTP/1.0" 200 134 0.000551
Sep 28 13:04:18 ctl02 heat-api[13008]: 2017-09-28 13:04:18.808 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:04:18] "OPTIONS / HTTP/1.0" 200 134 0.000560
Sep 28 13:04:19 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 13:04:19 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 13:04:19 ctl02 heat-api-cfn[13300]: 2017-09-28 13:04:19.226 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:04:19] "OPTIONS / HTTP/1.0" 200 134 0.000435
Sep 28 13:04:19 ctl02 nova-api[16064]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:04:19 ctl02 nova-api[16064]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:04:19 ctl02 glance-api[29183]: 2017-09-28 13:04:19.841 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:04:19] "OPTIONS / HTTP/1.0" 200 134 0.000558
Sep 28 13:04:19 ctl02 nova-api[16064]: 2017-09-28 13:04:19.996 16064 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:04:19 ctl02 nova-api[16064]: 2017-09-28 13:04:19.997 16064 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:04:19 ctl02 nova-api[16064]: 2017-09-28 13:04:19.997 16064 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:04:19 ctl02 nova-api[16064]: 2017-09-28 13:04:19.997 16064 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:04:19 ctl02 nova-api[16064]: 2017-09-28 13:04:19.997 16064 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:04:19 ctl02 nova-api[16064]: 2017-09-28 13:04:19.997 16064 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:04:19 ctl02 nova-api[16064]: 2017-09-28 13:04:19.997 16064 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:04:19 ctl02 nova-api[16064]: 2017-09-28 13:04:19.997 16064 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:04:19 ctl02 nova-api[16064]: 2017-09-28 13:04:19.997 16064 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:04:19 ctl02 nova-api[16064]: 2017-09-28 13:04:19.997 16064 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:04:19 ctl02 nova-api[16064]: 2017-09-28 13:04:19.997 16064 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:04:19 ctl02 nova-api[16064]: 2017-09-28 13:04:19.997 16064 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:04:19 ctl02 nova-api[16064]: 2017-09-28 13:04:19.997 16064 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:04:19 ctl02 nova-api[16064]: 2017-09-28 13:04:19.997 16064 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:04:19 ctl02 nova-api[16064]: 2017-09-28 13:04:19.997 16064 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:04:19 ctl02 nova-api[16064]: 2017-09-28 13:04:19.997 16064 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:04:19 ctl02 nova-api[16064]: 2017-09-28 13:04:19.997 16064 ERROR nova.wsgi     self.filename))
Sep 28 13:04:19 ctl02 nova-api[16064]: 2017-09-28 13:04:19.997 16064 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:04:19 ctl02 nova-api[16064]: 2017-09-28 13:04:19.997 16064 ERROR nova.wsgi
Sep 28 13:04:19 ctl02 nova-api[16064]: 2017-09-28 13:04:19.998 16064 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:04:20 ctl02 nova-api[16064]: 2017-09-28 13:04:20.128 16064 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:04:20 ctl02 nova-api[16064]: 2017-09-28 13:04:20.352 16064 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:04:20 ctl02 nova-api[16064]: 2017-09-28 13:04:20.355 16064 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:04:20 ctl02 nova-api[16064]: 2017-09-28 13:04:20.355 16064 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:04:20 ctl02 nova-api[16064]: 2017-09-28 13:04:20.355 16064 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:04:20 ctl02 nova-api[16064]: 2017-09-28 13:04:20.488 16064 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:04:20 ctl02 nova-api[16064]: 2017-09-28 13:04:20.490 16064 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:04:20 ctl02 nova-api[16064]: 2017-09-28 13:04:20.490 16064 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:04:20 ctl02 nova-api[16064]: 2017-09-28 13:04:20.490 16064 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:04:20 ctl02 nova-api[16064]: 2017-09-28 13:04:20.493 16064 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:04:20 ctl02 nova-api[16064]: 2017-09-28 13:04:20.494 16064 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:04:20 ctl02 nova-api[16064]: 2017-09-28 13:04:20.494 16064 ERROR nova Traceback (most recent call last):
Sep 28 13:04:20 ctl02 nova-api[16064]: 2017-09-28 13:04:20.494 16064 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:04:20 ctl02 nova-api[16064]: 2017-09-28 13:04:20.494 16064 ERROR nova     sys.exit(main())
Sep 28 13:04:20 ctl02 nova-api[16064]: 2017-09-28 13:04:20.494 16064 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:04:20 ctl02 nova-api[16064]: 2017-09-28 13:04:20.494 16064 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:04:20 ctl02 nova-api[16064]: 2017-09-28 13:04:20.494 16064 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:04:20 ctl02 nova-api[16064]: 2017-09-28 13:04:20.494 16064 ERROR nova     max_url_len=max_url_len)
Sep 28 13:04:20 ctl02 nova-api[16064]: 2017-09-28 13:04:20.494 16064 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:04:20 ctl02 nova-api[16064]: 2017-09-28 13:04:20.494 16064 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:04:20 ctl02 nova-api[16064]: 2017-09-28 13:04:20.494 16064 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:04:20 ctl02 nova-api[16064]: 2017-09-28 13:04:20.494 16064 ERROR nova     sock.listen(backlog)
Sep 28 13:04:20 ctl02 nova-api[16064]: 2017-09-28 13:04:20.494 16064 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:04:20 ctl02 nova-api[16064]: 2017-09-28 13:04:20.494 16064 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:04:20 ctl02 nova-api[16064]: 2017-09-28 13:04:20.494 16064 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:04:20 ctl02 nova-api[16064]: 2017-09-28 13:04:20.494 16064 ERROR nova
Sep 28 13:04:20 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:04:20 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:04:20 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:04:20 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:04:20.792 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:04:20] "OPTIONS / HTTP/1.0" 200 134 0.000570
Sep 28 13:04:20 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:04:20 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:04:20 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:04:20 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:04:20 ctl02 neutron-server[30536]: 2017-09-28 13:04:20.998 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 4 dead agents out of 6:
Sep 28 13:04:20 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 13:04:20 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 13:03:06 cmp002
Sep 28 13:04:20 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 13:02:58 cmp001
Sep 28 13:04:20 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 13:02:30 cmp002
Sep 28 13:04:20 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 13:03:36 cmp002
Sep 28 13:04:21 ctl02 nova-scheduler[5620]: 2017-09-28 13:04:21.057 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:04:21 ctl02 neutron-server[30536]: 2017-09-28 13:04:21.358 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:04:21] "OPTIONS / HTTP/1.0" 200 262 0.000656
Sep 28 13:04:22 ctl02 glance-api[29183]: 2017-09-28 13:04:22.204 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:04:22] "OPTIONS / HTTP/1.0" 200 134 0.000698
Sep 28 13:04:22 ctl02 nova-api[16087]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:04:22 ctl02 nova-api[16087]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:04:22 ctl02 nova-api[16087]: 2017-09-28 13:04:22.740 16087 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:04:22 ctl02 nova-api[16087]: 2017-09-28 13:04:22.741 16087 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:04:22 ctl02 nova-api[16087]: 2017-09-28 13:04:22.741 16087 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:04:22 ctl02 nova-api[16087]: 2017-09-28 13:04:22.741 16087 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:04:22 ctl02 nova-api[16087]: 2017-09-28 13:04:22.741 16087 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:04:22 ctl02 nova-api[16087]: 2017-09-28 13:04:22.741 16087 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:04:22 ctl02 nova-api[16087]: 2017-09-28 13:04:22.741 16087 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:04:22 ctl02 nova-api[16087]: 2017-09-28 13:04:22.741 16087 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:04:22 ctl02 nova-api[16087]: 2017-09-28 13:04:22.741 16087 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:04:22 ctl02 nova-api[16087]: 2017-09-28 13:04:22.741 16087 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:04:22 ctl02 nova-api[16087]: 2017-09-28 13:04:22.741 16087 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:04:22 ctl02 nova-api[16087]: 2017-09-28 13:04:22.741 16087 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:04:22 ctl02 nova-api[16087]: 2017-09-28 13:04:22.741 16087 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:04:22 ctl02 nova-api[16087]: 2017-09-28 13:04:22.741 16087 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:04:22 ctl02 nova-api[16087]: 2017-09-28 13:04:22.741 16087 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:04:22 ctl02 nova-api[16087]: 2017-09-28 13:04:22.741 16087 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:04:22 ctl02 nova-api[16087]: 2017-09-28 13:04:22.741 16087 ERROR nova.wsgi     self.filename))
Sep 28 13:04:22 ctl02 nova-api[16087]: 2017-09-28 13:04:22.741 16087 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:04:22 ctl02 nova-api[16087]: 2017-09-28 13:04:22.741 16087 ERROR nova.wsgi
Sep 28 13:04:22 ctl02 nova-api[16087]: 2017-09-28 13:04:22.744 16087 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:04:22 ctl02 nova-api[16087]: 2017-09-28 13:04:22.872 16087 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:04:23 ctl02 nova-api[16087]: 2017-09-28 13:04:23.101 16087 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:04:23 ctl02 nova-api[16087]: 2017-09-28 13:04:23.104 16087 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:04:23 ctl02 nova-api[16087]: 2017-09-28 13:04:23.104 16087 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:04:23 ctl02 nova-api[16087]: 2017-09-28 13:04:23.105 16087 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:04:23 ctl02 heat-api[13008]: 2017-09-28 13:04:23.119 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:04:23] "OPTIONS / HTTP/1.0" 200 134 0.000540
Sep 28 13:04:23 ctl02 nova-api[16087]: 2017-09-28 13:04:23.237 16087 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:04:23 ctl02 nova-api[16087]: 2017-09-28 13:04:23.240 16087 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:04:23 ctl02 nova-api[16087]: 2017-09-28 13:04:23.240 16087 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:04:23 ctl02 nova-api[16087]: 2017-09-28 13:04:23.240 16087 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:04:23 ctl02 nova-api[16087]: 2017-09-28 13:04:23.244 16087 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:04:23 ctl02 nova-api[16087]: 2017-09-28 13:04:23.244 16087 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:04:23 ctl02 nova-api[16087]: 2017-09-28 13:04:23.244 16087 ERROR nova Traceback (most recent call last):
Sep 28 13:04:23 ctl02 nova-api[16087]: 2017-09-28 13:04:23.244 16087 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:04:23 ctl02 nova-api[16087]: 2017-09-28 13:04:23.244 16087 ERROR nova     sys.exit(main())
Sep 28 13:04:23 ctl02 nova-api[16087]: 2017-09-28 13:04:23.244 16087 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:04:23 ctl02 nova-api[16087]: 2017-09-28 13:04:23.244 16087 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:04:23 ctl02 nova-api[16087]: 2017-09-28 13:04:23.244 16087 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:04:23 ctl02 nova-api[16087]: 2017-09-28 13:04:23.244 16087 ERROR nova     max_url_len=max_url_len)
Sep 28 13:04:23 ctl02 nova-api[16087]: 2017-09-28 13:04:23.244 16087 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:04:23 ctl02 nova-api[16087]: 2017-09-28 13:04:23.244 16087 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:04:23 ctl02 nova-api[16087]: 2017-09-28 13:04:23.244 16087 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:04:23 ctl02 nova-api[16087]: 2017-09-28 13:04:23.244 16087 ERROR nova     sock.listen(backlog)
Sep 28 13:04:23 ctl02 nova-api[16087]: 2017-09-28 13:04:23.244 16087 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:04:23 ctl02 nova-api[16087]: 2017-09-28 13:04:23.244 16087 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:04:23 ctl02 nova-api[16087]: 2017-09-28 13:04:23.244 16087 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:04:23 ctl02 nova-api[16087]: 2017-09-28 13:04:23.244 16087 ERROR nova
Sep 28 13:04:23 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:04:23 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:04:23 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:04:23 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:04:23 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:04:23 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:04:23 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:04:24 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:04:24.053 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:04:24] "OPTIONS / HTTP/1.0" 200 134 0.000445
Sep 28 13:04:24 ctl02 glance-api[29183]: 2017-09-28 13:04:24.059 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:04:24] "OPTIONS / HTTP/1.0" 200 134 0.001020
Sep 28 13:04:24 ctl02 neutron-server[30536]: 2017-09-28 13:04:24.523 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:04:24] "OPTIONS / HTTP/1.0" 200 262 0.000546
Sep 28 13:04:25 ctl02 nova-api[16105]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:04:25 ctl02 nova-api[16105]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:04:25 ctl02 heat-api-cfn[13300]: 2017-09-28 13:04:25.398 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:04:25] "OPTIONS / HTTP/1.0" 200 134 0.000496
Sep 28 13:04:25 ctl02 nova-api[16105]: 2017-09-28 13:04:25.544 16105 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:04:25 ctl02 nova-api[16105]: 2017-09-28 13:04:25.545 16105 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:04:25 ctl02 nova-api[16105]: 2017-09-28 13:04:25.545 16105 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:04:25 ctl02 nova-api[16105]: 2017-09-28 13:04:25.545 16105 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:04:25 ctl02 nova-api[16105]: 2017-09-28 13:04:25.545 16105 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:04:25 ctl02 nova-api[16105]: 2017-09-28 13:04:25.545 16105 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:04:25 ctl02 nova-api[16105]: 2017-09-28 13:04:25.545 16105 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:04:25 ctl02 nova-api[16105]: 2017-09-28 13:04:25.545 16105 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:04:25 ctl02 nova-api[16105]: 2017-09-28 13:04:25.545 16105 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:04:25 ctl02 nova-api[16105]: 2017-09-28 13:04:25.545 16105 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:04:25 ctl02 nova-api[16105]: 2017-09-28 13:04:25.545 16105 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:04:25 ctl02 nova-api[16105]: 2017-09-28 13:04:25.545 16105 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:04:25 ctl02 nova-api[16105]: 2017-09-28 13:04:25.545 16105 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:04:25 ctl02 nova-api[16105]: 2017-09-28 13:04:25.545 16105 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:04:25 ctl02 nova-api[16105]: 2017-09-28 13:04:25.545 16105 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:04:25 ctl02 nova-api[16105]: 2017-09-28 13:04:25.545 16105 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:04:25 ctl02 nova-api[16105]: 2017-09-28 13:04:25.545 16105 ERROR nova.wsgi     self.filename))
Sep 28 13:04:25 ctl02 nova-api[16105]: 2017-09-28 13:04:25.545 16105 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:04:25 ctl02 nova-api[16105]: 2017-09-28 13:04:25.545 16105 ERROR nova.wsgi
Sep 28 13:04:25 ctl02 nova-api[16105]: 2017-09-28 13:04:25.546 16105 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:04:25 ctl02 nova-api[16105]: 2017-09-28 13:04:25.680 16105 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:04:25 ctl02 heat-api-cfn[13300]: 2017-09-28 13:04:25.717 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:04:25] "OPTIONS / HTTP/1.0" 200 134 0.000492
Sep 28 13:04:25 ctl02 nova-api[16105]: 2017-09-28 13:04:25.930 16105 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:04:25 ctl02 nova-api[16105]: 2017-09-28 13:04:25.932 16105 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:04:25 ctl02 nova-api[16105]: 2017-09-28 13:04:25.932 16105 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:04:25 ctl02 nova-api[16105]: 2017-09-28 13:04:25.933 16105 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:04:26 ctl02 nova-api[16105]: 2017-09-28 13:04:26.065 16105 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:04:26 ctl02 nova-api[16105]: 2017-09-28 13:04:26.068 16105 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:04:26 ctl02 nova-api[16105]: 2017-09-28 13:04:26.068 16105 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:04:26 ctl02 nova-api[16105]: 2017-09-28 13:04:26.068 16105 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:04:26 ctl02 nova-api[16105]: 2017-09-28 13:04:26.071 16105 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:04:26 ctl02 nova-api[16105]: 2017-09-28 13:04:26.072 16105 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:04:26 ctl02 nova-api[16105]: 2017-09-28 13:04:26.072 16105 ERROR nova Traceback (most recent call last):
Sep 28 13:04:26 ctl02 nova-api[16105]: 2017-09-28 13:04:26.072 16105 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:04:26 ctl02 nova-api[16105]: 2017-09-28 13:04:26.072 16105 ERROR nova     sys.exit(main())
Sep 28 13:04:26 ctl02 nova-api[16105]: 2017-09-28 13:04:26.072 16105 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:04:26 ctl02 nova-api[16105]: 2017-09-28 13:04:26.072 16105 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:04:26 ctl02 nova-api[16105]: 2017-09-28 13:04:26.072 16105 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:04:26 ctl02 nova-api[16105]: 2017-09-28 13:04:26.072 16105 ERROR nova     max_url_len=max_url_len)
Sep 28 13:04:26 ctl02 nova-api[16105]: 2017-09-28 13:04:26.072 16105 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:04:26 ctl02 nova-api[16105]: 2017-09-28 13:04:26.072 16105 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:04:26 ctl02 nova-api[16105]: 2017-09-28 13:04:26.072 16105 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:04:26 ctl02 nova-api[16105]: 2017-09-28 13:04:26.072 16105 ERROR nova     sock.listen(backlog)
Sep 28 13:04:26 ctl02 nova-api[16105]: 2017-09-28 13:04:26.072 16105 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:04:26 ctl02 nova-api[16105]: 2017-09-28 13:04:26.072 16105 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:04:26 ctl02 nova-api[16105]: 2017-09-28 13:04:26.072 16105 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:04:26 ctl02 nova-api[16105]: 2017-09-28 13:04:26.072 16105 ERROR nova
Sep 28 13:04:26 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:04:26 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:04:26 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:04:26 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:04:26 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:04:26 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:04:26 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:04:27 ctl02 neutron-server[30536]: 2017-09-28 13:04:27.391 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:04:27] "OPTIONS / HTTP/1.0" 200 262 0.000521
Sep 28 13:04:28 ctl02 nova-api[16123]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:04:28 ctl02 nova-api[16123]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:04:28 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:04:28.155 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:04:28] "OPTIONS / HTTP/1.0" 200 134 0.000472
Sep 28 13:04:28 ctl02 nova-api[16123]: 2017-09-28 13:04:28.287 16123 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:04:28 ctl02 nova-api[16123]: 2017-09-28 13:04:28.289 16123 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:04:28 ctl02 nova-api[16123]: 2017-09-28 13:04:28.289 16123 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:04:28 ctl02 nova-api[16123]: 2017-09-28 13:04:28.289 16123 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:04:28 ctl02 nova-api[16123]: 2017-09-28 13:04:28.289 16123 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:04:28 ctl02 nova-api[16123]: 2017-09-28 13:04:28.289 16123 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:04:28 ctl02 nova-api[16123]: 2017-09-28 13:04:28.289 16123 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:04:28 ctl02 nova-api[16123]: 2017-09-28 13:04:28.289 16123 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:04:28 ctl02 nova-api[16123]: 2017-09-28 13:04:28.289 16123 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:04:28 ctl02 nova-api[16123]: 2017-09-28 13:04:28.289 16123 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:04:28 ctl02 nova-api[16123]: 2017-09-28 13:04:28.289 16123 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:04:28 ctl02 nova-api[16123]: 2017-09-28 13:04:28.289 16123 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:04:28 ctl02 nova-api[16123]: 2017-09-28 13:04:28.289 16123 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:04:28 ctl02 nova-api[16123]: 2017-09-28 13:04:28.289 16123 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:04:28 ctl02 nova-api[16123]: 2017-09-28 13:04:28.289 16123 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:04:28 ctl02 nova-api[16123]: 2017-09-28 13:04:28.289 16123 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:04:28 ctl02 nova-api[16123]: 2017-09-28 13:04:28.289 16123 ERROR nova.wsgi     self.filename))
Sep 28 13:04:28 ctl02 nova-api[16123]: 2017-09-28 13:04:28.289 16123 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:04:28 ctl02 nova-api[16123]: 2017-09-28 13:04:28.289 16123 ERROR nova.wsgi
Sep 28 13:04:28 ctl02 nova-api[16123]: 2017-09-28 13:04:28.290 16123 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:04:28 ctl02 nova-api[16123]: 2017-09-28 13:04:28.426 16123 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:04:28 ctl02 neutron-server[30536]: 2017-09-28 13:04:28.541 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 13:04:28 ctl02 nova-api[16123]: 2017-09-28 13:04:28.672 16123 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:04:28 ctl02 nova-api[16123]: 2017-09-28 13:04:28.675 16123 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:04:28 ctl02 nova-api[16123]: 2017-09-28 13:04:28.675 16123 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:04:28 ctl02 nova-api[16123]: 2017-09-28 13:04:28.675 16123 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:04:28 ctl02 heat-api[13008]: 2017-09-28 13:04:28.681 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:04:28] "OPTIONS / HTTP/1.0" 200 134 0.000638
Sep 28 13:04:28 ctl02 heat-api[13008]: 2017-09-28 13:04:28.689 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:04:28] "OPTIONS / HTTP/1.0" 200 134 0.000597
Sep 28 13:04:28 ctl02 nova-api[16123]: 2017-09-28 13:04:28.811 16123 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:04:28 ctl02 nova-api[16123]: 2017-09-28 13:04:28.813 16123 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:04:28 ctl02 nova-api[16123]: 2017-09-28 13:04:28.813 16123 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:04:28 ctl02 nova-api[16123]: 2017-09-28 13:04:28.814 16123 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:04:28 ctl02 nova-api[16123]: 2017-09-28 13:04:28.817 16123 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:04:28 ctl02 nova-api[16123]: 2017-09-28 13:04:28.817 16123 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:04:28 ctl02 nova-api[16123]: 2017-09-28 13:04:28.817 16123 ERROR nova Traceback (most recent call last):
Sep 28 13:04:28 ctl02 nova-api[16123]: 2017-09-28 13:04:28.817 16123 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:04:28 ctl02 nova-api[16123]: 2017-09-28 13:04:28.817 16123 ERROR nova     sys.exit(main())
Sep 28 13:04:28 ctl02 nova-api[16123]: 2017-09-28 13:04:28.817 16123 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:04:28 ctl02 nova-api[16123]: 2017-09-28 13:04:28.817 16123 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:04:28 ctl02 nova-api[16123]: 2017-09-28 13:04:28.817 16123 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:04:28 ctl02 nova-api[16123]: 2017-09-28 13:04:28.817 16123 ERROR nova     max_url_len=max_url_len)
Sep 28 13:04:28 ctl02 nova-api[16123]: 2017-09-28 13:04:28.817 16123 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:04:28 ctl02 nova-api[16123]: 2017-09-28 13:04:28.817 16123 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:04:28 ctl02 nova-api[16123]: 2017-09-28 13:04:28.817 16123 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:04:28 ctl02 nova-api[16123]: 2017-09-28 13:04:28.817 16123 ERROR nova     sock.listen(backlog)
Sep 28 13:04:28 ctl02 nova-api[16123]: 2017-09-28 13:04:28.817 16123 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:04:28 ctl02 nova-api[16123]: 2017-09-28 13:04:28.817 16123 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:04:28 ctl02 nova-api[16123]: 2017-09-28 13:04:28.817 16123 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:04:28 ctl02 nova-api[16123]: 2017-09-28 13:04:28.817 16123 ERROR nova
Sep 28 13:04:28 ctl02 heat-api-cfn[13300]: 2017-09-28 13:04:28.860 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:04:28] "OPTIONS / HTTP/1.0" 200 134 0.000498
Sep 28 13:04:28 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:04:28 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:04:28 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:04:29 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:04:29 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:04:29 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:04:29 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:04:30 ctl02 glance-api[29183]: 2017-09-28 13:04:30.034 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:04:30] "OPTIONS / HTTP/1.0" 200 134 0.000607
Sep 28 13:04:30 ctl02 nova-api[16141]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:04:30 ctl02 nova-api[16141]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:04:30 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:04:30.806 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:04:30] "OPTIONS / HTTP/1.0" 200 134 0.000389
Sep 28 13:04:30 ctl02 nova-api[16141]: 2017-09-28 13:04:30.964 16141 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:04:30 ctl02 nova-api[16141]: 2017-09-28 13:04:30.966 16141 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:04:30 ctl02 nova-api[16141]: 2017-09-28 13:04:30.966 16141 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:04:30 ctl02 nova-api[16141]: 2017-09-28 13:04:30.966 16141 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:04:30 ctl02 nova-api[16141]: 2017-09-28 13:04:30.966 16141 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:04:30 ctl02 nova-api[16141]: 2017-09-28 13:04:30.966 16141 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:04:30 ctl02 nova-api[16141]: 2017-09-28 13:04:30.966 16141 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:04:30 ctl02 nova-api[16141]: 2017-09-28 13:04:30.966 16141 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:04:30 ctl02 nova-api[16141]: 2017-09-28 13:04:30.966 16141 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:04:30 ctl02 nova-api[16141]: 2017-09-28 13:04:30.966 16141 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:04:30 ctl02 nova-api[16141]: 2017-09-28 13:04:30.966 16141 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:04:30 ctl02 nova-api[16141]: 2017-09-28 13:04:30.966 16141 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:04:30 ctl02 nova-api[16141]: 2017-09-28 13:04:30.966 16141 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:04:30 ctl02 nova-api[16141]: 2017-09-28 13:04:30.966 16141 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:04:30 ctl02 nova-api[16141]: 2017-09-28 13:04:30.966 16141 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:04:30 ctl02 nova-api[16141]: 2017-09-28 13:04:30.966 16141 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:04:30 ctl02 nova-api[16141]: 2017-09-28 13:04:30.966 16141 ERROR nova.wsgi     self.filename))
Sep 28 13:04:30 ctl02 nova-api[16141]: 2017-09-28 13:04:30.966 16141 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:04:30 ctl02 nova-api[16141]: 2017-09-28 13:04:30.966 16141 ERROR nova.wsgi
Sep 28 13:04:30 ctl02 nova-api[16141]: 2017-09-28 13:04:30.968 16141 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:04:31 ctl02 nova-api[16141]: 2017-09-28 13:04:31.094 16141 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:04:31 ctl02 nova-api[16141]: 2017-09-28 13:04:31.315 16141 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:04:31 ctl02 nova-api[16141]: 2017-09-28 13:04:31.318 16141 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:04:31 ctl02 nova-api[16141]: 2017-09-28 13:04:31.318 16141 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:04:31 ctl02 nova-api[16141]: 2017-09-28 13:04:31.319 16141 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:04:31 ctl02 neutron-server[30536]: 2017-09-28 13:04:31.440 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:04:31] "OPTIONS / HTTP/1.0" 200 262 0.000467
Sep 28 13:04:31 ctl02 nova-api[16141]: 2017-09-28 13:04:31.458 16141 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:04:31 ctl02 nova-api[16141]: 2017-09-28 13:04:31.459 16141 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:04:31 ctl02 nova-api[16141]: 2017-09-28 13:04:31.460 16141 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:04:31 ctl02 nova-api[16141]: 2017-09-28 13:04:31.460 16141 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:04:31 ctl02 nova-api[16141]: 2017-09-28 13:04:31.463 16141 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:04:31 ctl02 nova-api[16141]: 2017-09-28 13:04:31.463 16141 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:04:31 ctl02 nova-api[16141]: 2017-09-28 13:04:31.463 16141 ERROR nova Traceback (most recent call last):
Sep 28 13:04:31 ctl02 nova-api[16141]: 2017-09-28 13:04:31.463 16141 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:04:31 ctl02 nova-api[16141]: 2017-09-28 13:04:31.463 16141 ERROR nova     sys.exit(main())
Sep 28 13:04:31 ctl02 nova-api[16141]: 2017-09-28 13:04:31.463 16141 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:04:31 ctl02 nova-api[16141]: 2017-09-28 13:04:31.463 16141 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:04:31 ctl02 nova-api[16141]: 2017-09-28 13:04:31.463 16141 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:04:31 ctl02 nova-api[16141]: 2017-09-28 13:04:31.463 16141 ERROR nova     max_url_len=max_url_len)
Sep 28 13:04:31 ctl02 nova-api[16141]: 2017-09-28 13:04:31.463 16141 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:04:31 ctl02 nova-api[16141]: 2017-09-28 13:04:31.463 16141 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:04:31 ctl02 nova-api[16141]: 2017-09-28 13:04:31.463 16141 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:04:31 ctl02 nova-api[16141]: 2017-09-28 13:04:31.463 16141 ERROR nova     sock.listen(backlog)
Sep 28 13:04:31 ctl02 nova-api[16141]: 2017-09-28 13:04:31.463 16141 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:04:31 ctl02 nova-api[16141]: 2017-09-28 13:04:31.463 16141 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:04:31 ctl02 nova-api[16141]: 2017-09-28 13:04:31.463 16141 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:04:31 ctl02 nova-api[16141]: 2017-09-28 13:04:31.463 16141 ERROR nova
Sep 28 13:04:31 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:04:31 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:04:31 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:04:31 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:04:31 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:04:31 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:04:31 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:04:32 ctl02 glance-api[29183]: 2017-09-28 13:04:32.172 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:04:32] "OPTIONS / HTTP/1.0" 200 134 0.000560
Sep 28 13:04:33 ctl02 heat-api[13008]: 2017-09-28 13:04:33.288 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:04:33] "OPTIONS / HTTP/1.0" 200 134 0.000556
Sep 28 13:04:33 ctl02 nova-api[16159]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:04:33 ctl02 nova-api[16159]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:04:33 ctl02 nova-api[16159]: 2017-09-28 13:04:33.784 16159 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:04:33 ctl02 nova-api[16159]: 2017-09-28 13:04:33.786 16159 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:04:33 ctl02 nova-api[16159]: 2017-09-28 13:04:33.786 16159 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:04:33 ctl02 nova-api[16159]: 2017-09-28 13:04:33.786 16159 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:04:33 ctl02 nova-api[16159]: 2017-09-28 13:04:33.786 16159 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:04:33 ctl02 nova-api[16159]: 2017-09-28 13:04:33.786 16159 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:04:33 ctl02 nova-api[16159]: 2017-09-28 13:04:33.786 16159 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:04:33 ctl02 nova-api[16159]: 2017-09-28 13:04:33.786 16159 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:04:33 ctl02 nova-api[16159]: 2017-09-28 13:04:33.786 16159 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:04:33 ctl02 nova-api[16159]: 2017-09-28 13:04:33.786 16159 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:04:33 ctl02 nova-api[16159]: 2017-09-28 13:04:33.786 16159 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:04:33 ctl02 nova-api[16159]: 2017-09-28 13:04:33.786 16159 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:04:33 ctl02 nova-api[16159]: 2017-09-28 13:04:33.786 16159 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:04:33 ctl02 nova-api[16159]: 2017-09-28 13:04:33.786 16159 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:04:33 ctl02 nova-api[16159]: 2017-09-28 13:04:33.786 16159 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:04:33 ctl02 nova-api[16159]: 2017-09-28 13:04:33.786 16159 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:04:33 ctl02 nova-api[16159]: 2017-09-28 13:04:33.786 16159 ERROR nova.wsgi     self.filename))
Sep 28 13:04:33 ctl02 nova-api[16159]: 2017-09-28 13:04:33.786 16159 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:04:33 ctl02 nova-api[16159]: 2017-09-28 13:04:33.786 16159 ERROR nova.wsgi
Sep 28 13:04:33 ctl02 nova-api[16159]: 2017-09-28 13:04:33.788 16159 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:04:33 ctl02 nova-api[16159]: 2017-09-28 13:04:33.921 16159 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:04:33 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:04:33.946 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:04:33] "OPTIONS / HTTP/1.0" 200 134 0.000372
Sep 28 13:04:34 ctl02 nova-api[16159]: 2017-09-28 13:04:34.150 16159 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:04:34 ctl02 nova-api[16159]: 2017-09-28 13:04:34.152 16159 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:04:34 ctl02 nova-api[16159]: 2017-09-28 13:04:34.152 16159 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:04:34 ctl02 nova-api[16159]: 2017-09-28 13:04:34.153 16159 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:04:34 ctl02 nova-api[16159]: 2017-09-28 13:04:34.287 16159 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:04:34 ctl02 nova-api[16159]: 2017-09-28 13:04:34.290 16159 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:04:34 ctl02 nova-api[16159]: 2017-09-28 13:04:34.290 16159 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:04:34 ctl02 nova-api[16159]: 2017-09-28 13:04:34.291 16159 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:04:34 ctl02 nova-api[16159]: 2017-09-28 13:04:34.294 16159 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:04:34 ctl02 nova-api[16159]: 2017-09-28 13:04:34.295 16159 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:04:34 ctl02 nova-api[16159]: 2017-09-28 13:04:34.295 16159 ERROR nova Traceback (most recent call last):
Sep 28 13:04:34 ctl02 nova-api[16159]: 2017-09-28 13:04:34.295 16159 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:04:34 ctl02 nova-api[16159]: 2017-09-28 13:04:34.295 16159 ERROR nova     sys.exit(main())
Sep 28 13:04:34 ctl02 nova-api[16159]: 2017-09-28 13:04:34.295 16159 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:04:34 ctl02 nova-api[16159]: 2017-09-28 13:04:34.295 16159 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:04:34 ctl02 nova-api[16159]: 2017-09-28 13:04:34.295 16159 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:04:34 ctl02 nova-api[16159]: 2017-09-28 13:04:34.295 16159 ERROR nova     max_url_len=max_url_len)
Sep 28 13:04:34 ctl02 nova-api[16159]: 2017-09-28 13:04:34.295 16159 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:04:34 ctl02 nova-api[16159]: 2017-09-28 13:04:34.295 16159 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:04:34 ctl02 nova-api[16159]: 2017-09-28 13:04:34.295 16159 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:04:34 ctl02 nova-api[16159]: 2017-09-28 13:04:34.295 16159 ERROR nova     sock.listen(backlog)
Sep 28 13:04:34 ctl02 nova-api[16159]: 2017-09-28 13:04:34.295 16159 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:04:34 ctl02 nova-api[16159]: 2017-09-28 13:04:34.295 16159 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:04:34 ctl02 nova-api[16159]: 2017-09-28 13:04:34.295 16159 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:04:34 ctl02 nova-api[16159]: 2017-09-28 13:04:34.295 16159 ERROR nova
Sep 28 13:04:34 ctl02 glance-api[29183]: 2017-09-28 13:04:34.432 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:04:34] "OPTIONS / HTTP/1.0" 200 134 0.000630
Sep 28 13:04:34 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:04:34 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:04:34 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:04:34 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:04:34 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:04:34 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:04:34 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:04:34 ctl02 neutron-server[30536]: 2017-09-28 13:04:34.756 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:04:34] "OPTIONS / HTTP/1.0" 200 262 0.000482
Sep 28 13:04:35 ctl02 heat-api-cfn[13300]: 2017-09-28 13:04:35.100 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:04:35] "OPTIONS / HTTP/1.0" 200 134 0.000460
Sep 28 13:04:35 ctl02 heat-api-cfn[13300]: 2017-09-28 13:04:35.910 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:04:35] "OPTIONS / HTTP/1.0" 200 134 0.000562
Sep 28 13:04:35 ctl02 neutron-server[30536]: 2017-09-28 13:04:35.995 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 13:04:35 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 13:04:35 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 13:03:06 cmp002
Sep 28 13:04:35 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 13:02:58 cmp001
Sep 28 13:04:35 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 13:03:36 cmp002
Sep 28 13:04:36 ctl02 nova-api[16176]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:04:36 ctl02 nova-api[16176]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:04:36 ctl02 nova-api[16176]: 2017-09-28 13:04:36.485 16176 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:04:36 ctl02 nova-api[16176]: 2017-09-28 13:04:36.486 16176 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:04:36 ctl02 nova-api[16176]: 2017-09-28 13:04:36.486 16176 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:04:36 ctl02 nova-api[16176]: 2017-09-28 13:04:36.486 16176 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:04:36 ctl02 nova-api[16176]: 2017-09-28 13:04:36.486 16176 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:04:36 ctl02 nova-api[16176]: 2017-09-28 13:04:36.486 16176 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:04:36 ctl02 nova-api[16176]: 2017-09-28 13:04:36.486 16176 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:04:36 ctl02 nova-api[16176]: 2017-09-28 13:04:36.486 16176 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:04:36 ctl02 nova-api[16176]: 2017-09-28 13:04:36.486 16176 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:04:36 ctl02 nova-api[16176]: 2017-09-28 13:04:36.486 16176 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:04:36 ctl02 nova-api[16176]: 2017-09-28 13:04:36.486 16176 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:04:36 ctl02 nova-api[16176]: 2017-09-28 13:04:36.486 16176 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:04:36 ctl02 nova-api[16176]: 2017-09-28 13:04:36.486 16176 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:04:36 ctl02 nova-api[16176]: 2017-09-28 13:04:36.486 16176 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:04:36 ctl02 nova-api[16176]: 2017-09-28 13:04:36.486 16176 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:04:36 ctl02 nova-api[16176]: 2017-09-28 13:04:36.486 16176 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:04:36 ctl02 nova-api[16176]: 2017-09-28 13:04:36.486 16176 ERROR nova.wsgi     self.filename))
Sep 28 13:04:36 ctl02 nova-api[16176]: 2017-09-28 13:04:36.486 16176 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:04:36 ctl02 nova-api[16176]: 2017-09-28 13:04:36.486 16176 ERROR nova.wsgi
Sep 28 13:04:36 ctl02 nova-api[16176]: 2017-09-28 13:04:36.487 16176 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:04:36 ctl02 nova-api[16176]: 2017-09-28 13:04:36.614 16176 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:04:36 ctl02 nova-api[16176]: 2017-09-28 13:04:36.838 16176 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:04:36 ctl02 nova-api[16176]: 2017-09-28 13:04:36.840 16176 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:04:36 ctl02 nova-api[16176]: 2017-09-28 13:04:36.840 16176 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:04:36 ctl02 nova-api[16176]: 2017-09-28 13:04:36.841 16176 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:04:36 ctl02 nova-api[16176]: 2017-09-28 13:04:36.972 16176 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:04:36 ctl02 nova-api[16176]: 2017-09-28 13:04:36.974 16176 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:04:36 ctl02 nova-api[16176]: 2017-09-28 13:04:36.974 16176 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:04:36 ctl02 nova-api[16176]: 2017-09-28 13:04:36.974 16176 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:04:36 ctl02 nova-api[16176]: 2017-09-28 13:04:36.977 16176 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:04:36 ctl02 nova-api[16176]: 2017-09-28 13:04:36.978 16176 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:04:36 ctl02 nova-api[16176]: 2017-09-28 13:04:36.978 16176 ERROR nova Traceback (most recent call last):
Sep 28 13:04:36 ctl02 nova-api[16176]: 2017-09-28 13:04:36.978 16176 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:04:36 ctl02 nova-api[16176]: 2017-09-28 13:04:36.978 16176 ERROR nova     sys.exit(main())
Sep 28 13:04:36 ctl02 nova-api[16176]: 2017-09-28 13:04:36.978 16176 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:04:36 ctl02 nova-api[16176]: 2017-09-28 13:04:36.978 16176 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:04:36 ctl02 nova-api[16176]: 2017-09-28 13:04:36.978 16176 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:04:36 ctl02 nova-api[16176]: 2017-09-28 13:04:36.978 16176 ERROR nova     max_url_len=max_url_len)
Sep 28 13:04:36 ctl02 nova-api[16176]: 2017-09-28 13:04:36.978 16176 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:04:36 ctl02 nova-api[16176]: 2017-09-28 13:04:36.978 16176 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:04:36 ctl02 nova-api[16176]: 2017-09-28 13:04:36.978 16176 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:04:36 ctl02 nova-api[16176]: 2017-09-28 13:04:36.978 16176 ERROR nova     sock.listen(backlog)
Sep 28 13:04:36 ctl02 nova-api[16176]: 2017-09-28 13:04:36.978 16176 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:04:36 ctl02 nova-api[16176]: 2017-09-28 13:04:36.978 16176 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:04:36 ctl02 nova-api[16176]: 2017-09-28 13:04:36.978 16176 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:04:36 ctl02 nova-api[16176]: 2017-09-28 13:04:36.978 16176 ERROR nova
Sep 28 13:04:37 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:04:37 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:04:37 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:04:37 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:04:37 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:04:37 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:04:37 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:04:37 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x58ef5913)
Sep 28 13:04:37 ctl02 neutron-server[30536]: 2017-09-28 13:04:37.615 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:04:37] "OPTIONS / HTTP/1.0" 200 262 0.000532
Sep 28 13:04:37 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:04:37.811 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:04:37] "OPTIONS / HTTP/1.0" 200 134 0.000468
Sep 28 13:04:38 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x58ef5913)
Sep 28 13:04:38 ctl02 heat-api-cfn[13300]: 2017-09-28 13:04:38.478 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:04:38] "OPTIONS / HTTP/1.0" 200 134 0.000666
Sep 28 13:04:38 ctl02 heat-api[13008]: 2017-09-28 13:04:38.605 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:04:38] "OPTIONS / HTTP/1.0" 200 134 0.000617
Sep 28 13:04:38 ctl02 heat-api[13008]: 2017-09-28 13:04:38.929 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:04:38] "OPTIONS / HTTP/1.0" 200 134 0.000522
Sep 28 13:04:39 ctl02 nova-api[16195]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:04:39 ctl02 nova-api[16195]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:04:39 ctl02 nova-api[16195]: 2017-09-28 13:04:39.289 16195 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:04:39 ctl02 nova-api[16195]: 2017-09-28 13:04:39.291 16195 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:04:39 ctl02 nova-api[16195]: 2017-09-28 13:04:39.291 16195 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:04:39 ctl02 nova-api[16195]: 2017-09-28 13:04:39.291 16195 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:04:39 ctl02 nova-api[16195]: 2017-09-28 13:04:39.291 16195 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:04:39 ctl02 nova-api[16195]: 2017-09-28 13:04:39.291 16195 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:04:39 ctl02 nova-api[16195]: 2017-09-28 13:04:39.291 16195 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:04:39 ctl02 nova-api[16195]: 2017-09-28 13:04:39.291 16195 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:04:39 ctl02 nova-api[16195]: 2017-09-28 13:04:39.291 16195 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:04:39 ctl02 nova-api[16195]: 2017-09-28 13:04:39.291 16195 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:04:39 ctl02 nova-api[16195]: 2017-09-28 13:04:39.291 16195 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:04:39 ctl02 nova-api[16195]: 2017-09-28 13:04:39.291 16195 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:04:39 ctl02 nova-api[16195]: 2017-09-28 13:04:39.291 16195 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:04:39 ctl02 nova-api[16195]: 2017-09-28 13:04:39.291 16195 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:04:39 ctl02 nova-api[16195]: 2017-09-28 13:04:39.291 16195 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:04:39 ctl02 nova-api[16195]: 2017-09-28 13:04:39.291 16195 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:04:39 ctl02 nova-api[16195]: 2017-09-28 13:04:39.291 16195 ERROR nova.wsgi     self.filename))
Sep 28 13:04:39 ctl02 nova-api[16195]: 2017-09-28 13:04:39.291 16195 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:04:39 ctl02 nova-api[16195]: 2017-09-28 13:04:39.291 16195 ERROR nova.wsgi
Sep 28 13:04:39 ctl02 nova-api[16195]: 2017-09-28 13:04:39.292 16195 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:04:39 ctl02 nova-conductor[5056]: 2017-09-28 13:04:39.325 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:04:39 ctl02 nova-conductor[5056]: 2017-09-28 13:04:39.336 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:04:39 ctl02 nova-conductor[5056]: 2017-09-28 13:04:39.349 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:04:39 ctl02 nova-conductor[5056]: 2017-09-28 13:04:39.353 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:04:39 ctl02 nova-api[16195]: 2017-09-28 13:04:39.434 16195 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:04:39 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x58ef5913)
Sep 28 13:04:39 ctl02 nova-api[16195]: 2017-09-28 13:04:39.684 16195 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:04:39 ctl02 nova-api[16195]: 2017-09-28 13:04:39.687 16195 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:04:39 ctl02 nova-api[16195]: 2017-09-28 13:04:39.687 16195 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:04:39 ctl02 nova-api[16195]: 2017-09-28 13:04:39.687 16195 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:04:39 ctl02 nova-api[16195]: 2017-09-28 13:04:39.820 16195 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:04:39 ctl02 nova-api[16195]: 2017-09-28 13:04:39.823 16195 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:04:39 ctl02 nova-api[16195]: 2017-09-28 13:04:39.823 16195 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:04:39 ctl02 nova-api[16195]: 2017-09-28 13:04:39.824 16195 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:04:39 ctl02 nova-api[16195]: 2017-09-28 13:04:39.827 16195 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:04:39 ctl02 nova-api[16195]: 2017-09-28 13:04:39.828 16195 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:04:39 ctl02 nova-api[16195]: 2017-09-28 13:04:39.828 16195 ERROR nova Traceback (most recent call last):
Sep 28 13:04:39 ctl02 nova-api[16195]: 2017-09-28 13:04:39.828 16195 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:04:39 ctl02 nova-api[16195]: 2017-09-28 13:04:39.828 16195 ERROR nova     sys.exit(main())
Sep 28 13:04:39 ctl02 nova-api[16195]: 2017-09-28 13:04:39.828 16195 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:04:39 ctl02 nova-api[16195]: 2017-09-28 13:04:39.828 16195 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:04:39 ctl02 nova-api[16195]: 2017-09-28 13:04:39.828 16195 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:04:39 ctl02 nova-api[16195]: 2017-09-28 13:04:39.828 16195 ERROR nova     max_url_len=max_url_len)
Sep 28 13:04:39 ctl02 nova-api[16195]: 2017-09-28 13:04:39.828 16195 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:04:39 ctl02 nova-api[16195]: 2017-09-28 13:04:39.828 16195 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:04:39 ctl02 nova-api[16195]: 2017-09-28 13:04:39.828 16195 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:04:39 ctl02 nova-api[16195]: 2017-09-28 13:04:39.828 16195 ERROR nova     sock.listen(backlog)
Sep 28 13:04:39 ctl02 nova-api[16195]: 2017-09-28 13:04:39.828 16195 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:04:39 ctl02 nova-api[16195]: 2017-09-28 13:04:39.828 16195 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:04:39 ctl02 nova-api[16195]: 2017-09-28 13:04:39.828 16195 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:04:39 ctl02 nova-api[16195]: 2017-09-28 13:04:39.828 16195 ERROR nova
Sep 28 13:04:39 ctl02 glance-api[29183]: 2017-09-28 13:04:39.978 29253 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:04:39] "OPTIONS / HTTP/1.0" 200 134 0.000723
Sep 28 13:04:39 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:04:39 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:04:39 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:04:40 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:04:40 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:04:40 ctl02 nova-cert[4860]: 2017-09-28 13:04:40.132 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:04:40 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:04:40 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:04:40 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x58ef5913)
Sep 28 13:04:40 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:04:40.663 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:04:40] "OPTIONS / HTTP/1.0" 200 134 0.000348
Sep 28 13:04:41 ctl02 neutron-server[30536]: 2017-09-28 13:04:41.423 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:04:41] "OPTIONS / HTTP/1.0" 200 262 0.000437
Sep 28 13:04:41 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x58ef5913)
Sep 28 13:04:41 ctl02 nova-api[16213]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:04:41 ctl02 nova-api[16213]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:04:41 ctl02 nova-api[16213]: 2017-09-28 13:04:41.993 16213 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:04:41 ctl02 nova-api[16213]: 2017-09-28 13:04:41.994 16213 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:04:41 ctl02 nova-api[16213]: 2017-09-28 13:04:41.994 16213 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:04:41 ctl02 nova-api[16213]: 2017-09-28 13:04:41.994 16213 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:04:41 ctl02 nova-api[16213]: 2017-09-28 13:04:41.994 16213 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:04:41 ctl02 nova-api[16213]: 2017-09-28 13:04:41.994 16213 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:04:41 ctl02 nova-api[16213]: 2017-09-28 13:04:41.994 16213 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:04:41 ctl02 nova-api[16213]: 2017-09-28 13:04:41.994 16213 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:04:41 ctl02 nova-api[16213]: 2017-09-28 13:04:41.994 16213 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:04:41 ctl02 nova-api[16213]: 2017-09-28 13:04:41.994 16213 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:04:41 ctl02 nova-api[16213]: 2017-09-28 13:04:41.994 16213 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:04:41 ctl02 nova-api[16213]: 2017-09-28 13:04:41.994 16213 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:04:41 ctl02 nova-api[16213]: 2017-09-28 13:04:41.994 16213 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:04:41 ctl02 nova-api[16213]: 2017-09-28 13:04:41.994 16213 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:04:41 ctl02 nova-api[16213]: 2017-09-28 13:04:41.994 16213 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:04:41 ctl02 nova-api[16213]: 2017-09-28 13:04:41.994 16213 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:04:41 ctl02 nova-api[16213]: 2017-09-28 13:04:41.994 16213 ERROR nova.wsgi     self.filename))
Sep 28 13:04:41 ctl02 nova-api[16213]: 2017-09-28 13:04:41.994 16213 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:04:41 ctl02 nova-api[16213]: 2017-09-28 13:04:41.994 16213 ERROR nova.wsgi
Sep 28 13:04:41 ctl02 nova-api[16213]: 2017-09-28 13:04:41.995 16213 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:04:42 ctl02 nova-api[16213]: 2017-09-28 13:04:42.122 16213 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:04:42 ctl02 glance-api[29183]: 2017-09-28 13:04:42.325 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:04:42] "OPTIONS / HTTP/1.0" 200 134 0.000587
Sep 28 13:04:42 ctl02 nova-api[16213]: 2017-09-28 13:04:42.346 16213 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:04:42 ctl02 nova-api[16213]: 2017-09-28 13:04:42.348 16213 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:04:42 ctl02 nova-api[16213]: 2017-09-28 13:04:42.348 16213 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:04:42 ctl02 nova-api[16213]: 2017-09-28 13:04:42.348 16213 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:04:42 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x58ef5913)
Sep 28 13:04:42 ctl02 nova-api[16213]: 2017-09-28 13:04:42.480 16213 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:04:42 ctl02 nova-api[16213]: 2017-09-28 13:04:42.482 16213 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:04:42 ctl02 nova-api[16213]: 2017-09-28 13:04:42.482 16213 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:04:42 ctl02 nova-api[16213]: 2017-09-28 13:04:42.483 16213 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:04:42 ctl02 nova-api[16213]: 2017-09-28 13:04:42.486 16213 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:04:42 ctl02 nova-api[16213]: 2017-09-28 13:04:42.486 16213 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:04:42 ctl02 nova-api[16213]: 2017-09-28 13:04:42.486 16213 ERROR nova Traceback (most recent call last):
Sep 28 13:04:42 ctl02 nova-api[16213]: 2017-09-28 13:04:42.486 16213 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:04:42 ctl02 nova-api[16213]: 2017-09-28 13:04:42.486 16213 ERROR nova     sys.exit(main())
Sep 28 13:04:42 ctl02 nova-api[16213]: 2017-09-28 13:04:42.486 16213 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:04:42 ctl02 nova-api[16213]: 2017-09-28 13:04:42.486 16213 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:04:42 ctl02 nova-api[16213]: 2017-09-28 13:04:42.486 16213 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:04:42 ctl02 nova-api[16213]: 2017-09-28 13:04:42.486 16213 ERROR nova     max_url_len=max_url_len)
Sep 28 13:04:42 ctl02 nova-api[16213]: 2017-09-28 13:04:42.486 16213 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:04:42 ctl02 nova-api[16213]: 2017-09-28 13:04:42.486 16213 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:04:42 ctl02 nova-api[16213]: 2017-09-28 13:04:42.486 16213 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:04:42 ctl02 nova-api[16213]: 2017-09-28 13:04:42.486 16213 ERROR nova     sock.listen(backlog)
Sep 28 13:04:42 ctl02 nova-api[16213]: 2017-09-28 13:04:42.486 16213 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:04:42 ctl02 nova-api[16213]: 2017-09-28 13:04:42.486 16213 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:04:42 ctl02 nova-api[16213]: 2017-09-28 13:04:42.486 16213 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:04:42 ctl02 nova-api[16213]: 2017-09-28 13:04:42.486 16213 ERROR nova
Sep 28 13:04:42 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:04:42 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:04:42 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:04:42 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:04:42 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:04:42 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:04:42 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:04:43 ctl02 heat-api[13008]: 2017-09-28 13:04:43.197 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:04:43] "OPTIONS / HTTP/1.0" 200 134 0.000531
Sep 28 13:04:43 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x58ef5913)
Sep 28 13:04:43 ctl02 neutron-server[30536]: 2017-09-28 13:04:43.537 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 13:04:44 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:04:44.202 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:04:44] "OPTIONS / HTTP/1.0" 200 134 0.000514
Sep 28 13:04:44 ctl02 glance-api[29183]: 2017-09-28 13:04:44.392 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:04:44] "OPTIONS / HTTP/1.0" 200 134 0.000803
Sep 28 13:04:44 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x58ef5913)
Sep 28 13:04:44 ctl02 nova-api[16230]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:04:44 ctl02 nova-api[16230]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:04:44 ctl02 nova-api[16230]: 2017-09-28 13:04:44.769 16230 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:04:44 ctl02 nova-api[16230]: 2017-09-28 13:04:44.770 16230 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:04:44 ctl02 nova-api[16230]: 2017-09-28 13:04:44.770 16230 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:04:44 ctl02 nova-api[16230]: 2017-09-28 13:04:44.770 16230 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:04:44 ctl02 nova-api[16230]: 2017-09-28 13:04:44.770 16230 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:04:44 ctl02 nova-api[16230]: 2017-09-28 13:04:44.770 16230 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:04:44 ctl02 nova-api[16230]: 2017-09-28 13:04:44.770 16230 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:04:44 ctl02 nova-api[16230]: 2017-09-28 13:04:44.770 16230 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:04:44 ctl02 nova-api[16230]: 2017-09-28 13:04:44.770 16230 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:04:44 ctl02 nova-api[16230]: 2017-09-28 13:04:44.770 16230 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:04:44 ctl02 nova-api[16230]: 2017-09-28 13:04:44.770 16230 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:04:44 ctl02 nova-api[16230]: 2017-09-28 13:04:44.770 16230 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:04:44 ctl02 nova-api[16230]: 2017-09-28 13:04:44.770 16230 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:04:44 ctl02 nova-api[16230]: 2017-09-28 13:04:44.770 16230 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:04:44 ctl02 nova-api[16230]: 2017-09-28 13:04:44.770 16230 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:04:44 ctl02 nova-api[16230]: 2017-09-28 13:04:44.770 16230 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:04:44 ctl02 nova-api[16230]: 2017-09-28 13:04:44.770 16230 ERROR nova.wsgi     self.filename))
Sep 28 13:04:44 ctl02 nova-api[16230]: 2017-09-28 13:04:44.770 16230 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:04:44 ctl02 nova-api[16230]: 2017-09-28 13:04:44.770 16230 ERROR nova.wsgi
Sep 28 13:04:44 ctl02 nova-api[16230]: 2017-09-28 13:04:44.771 16230 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:04:44 ctl02 neutron-server[30536]: 2017-09-28 13:04:44.868 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:04:44] "OPTIONS / HTTP/1.0" 200 262 0.000489
Sep 28 13:04:44 ctl02 nova-api[16230]: 2017-09-28 13:04:44.900 16230 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:04:45 ctl02 heat-api-cfn[13300]: 2017-09-28 13:04:45.056 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:04:45] "OPTIONS / HTTP/1.0" 200 134 0.000474
Sep 28 13:04:45 ctl02 nova-api[16230]: 2017-09-28 13:04:45.148 16230 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:04:45 ctl02 nova-api[16230]: 2017-09-28 13:04:45.151 16230 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:04:45 ctl02 nova-api[16230]: 2017-09-28 13:04:45.151 16230 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:04:45 ctl02 nova-api[16230]: 2017-09-28 13:04:45.151 16230 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:04:45 ctl02 nova-api[16230]: 2017-09-28 13:04:45.290 16230 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:04:45 ctl02 nova-api[16230]: 2017-09-28 13:04:45.292 16230 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:04:45 ctl02 nova-api[16230]: 2017-09-28 13:04:45.292 16230 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:04:45 ctl02 nova-api[16230]: 2017-09-28 13:04:45.292 16230 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:04:45 ctl02 nova-api[16230]: 2017-09-28 13:04:45.296 16230 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:04:45 ctl02 nova-api[16230]: 2017-09-28 13:04:45.296 16230 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:04:45 ctl02 nova-api[16230]: 2017-09-28 13:04:45.296 16230 ERROR nova Traceback (most recent call last):
Sep 28 13:04:45 ctl02 nova-api[16230]: 2017-09-28 13:04:45.296 16230 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:04:45 ctl02 nova-api[16230]: 2017-09-28 13:04:45.296 16230 ERROR nova     sys.exit(main())
Sep 28 13:04:45 ctl02 nova-api[16230]: 2017-09-28 13:04:45.296 16230 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:04:45 ctl02 nova-api[16230]: 2017-09-28 13:04:45.296 16230 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:04:45 ctl02 nova-api[16230]: 2017-09-28 13:04:45.296 16230 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:04:45 ctl02 nova-api[16230]: 2017-09-28 13:04:45.296 16230 ERROR nova     max_url_len=max_url_len)
Sep 28 13:04:45 ctl02 nova-api[16230]: 2017-09-28 13:04:45.296 16230 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:04:45 ctl02 nova-api[16230]: 2017-09-28 13:04:45.296 16230 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:04:45 ctl02 nova-api[16230]: 2017-09-28 13:04:45.296 16230 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:04:45 ctl02 nova-api[16230]: 2017-09-28 13:04:45.296 16230 ERROR nova     sock.listen(backlog)
Sep 28 13:04:45 ctl02 nova-api[16230]: 2017-09-28 13:04:45.296 16230 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:04:45 ctl02 nova-api[16230]: 2017-09-28 13:04:45.296 16230 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:04:45 ctl02 nova-api[16230]: 2017-09-28 13:04:45.296 16230 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:04:45 ctl02 nova-api[16230]: 2017-09-28 13:04:45.296 16230 ERROR nova
Sep 28 13:04:45 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x58ef5913)
Sep 28 13:04:45 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:04:45 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:04:45 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:04:45 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:04:45 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:04:45 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:04:45 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:04:46 ctl02 heat-api-cfn[13300]: 2017-09-28 13:04:46.292 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:04:46] "OPTIONS / HTTP/1.0" 200 134 0.000477
Sep 28 13:04:46 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x58ef5913)
Sep 28 13:04:47 ctl02 nova-api[16248]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:04:47 ctl02 nova-api[16248]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:04:47 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x58ef5913)
Sep 28 13:04:47 ctl02 nova-api[16248]: 2017-09-28 13:04:47.510 16248 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:04:47 ctl02 nova-api[16248]: 2017-09-28 13:04:47.511 16248 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:04:47 ctl02 nova-api[16248]: 2017-09-28 13:04:47.511 16248 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:04:47 ctl02 nova-api[16248]: 2017-09-28 13:04:47.511 16248 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:04:47 ctl02 nova-api[16248]: 2017-09-28 13:04:47.511 16248 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:04:47 ctl02 nova-api[16248]: 2017-09-28 13:04:47.511 16248 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:04:47 ctl02 nova-api[16248]: 2017-09-28 13:04:47.511 16248 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:04:47 ctl02 nova-api[16248]: 2017-09-28 13:04:47.511 16248 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:04:47 ctl02 nova-api[16248]: 2017-09-28 13:04:47.511 16248 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:04:47 ctl02 nova-api[16248]: 2017-09-28 13:04:47.511 16248 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:04:47 ctl02 nova-api[16248]: 2017-09-28 13:04:47.511 16248 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:04:47 ctl02 nova-api[16248]: 2017-09-28 13:04:47.511 16248 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:04:47 ctl02 nova-api[16248]: 2017-09-28 13:04:47.511 16248 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:04:47 ctl02 nova-api[16248]: 2017-09-28 13:04:47.511 16248 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:04:47 ctl02 nova-api[16248]: 2017-09-28 13:04:47.511 16248 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:04:47 ctl02 nova-api[16248]: 2017-09-28 13:04:47.511 16248 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:04:47 ctl02 nova-api[16248]: 2017-09-28 13:04:47.511 16248 ERROR nova.wsgi     self.filename))
Sep 28 13:04:47 ctl02 nova-api[16248]: 2017-09-28 13:04:47.511 16248 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:04:47 ctl02 nova-api[16248]: 2017-09-28 13:04:47.511 16248 ERROR nova.wsgi
Sep 28 13:04:47 ctl02 nova-api[16248]: 2017-09-28 13:04:47.512 16248 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:04:47 ctl02 nova-api[16248]: 2017-09-28 13:04:47.641 16248 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:04:47 ctl02 neutron-server[30536]: 2017-09-28 13:04:47.790 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:04:47] "OPTIONS / HTTP/1.0" 200 262 0.000572
Sep 28 13:04:47 ctl02 nova-api[16248]: 2017-09-28 13:04:47.860 16248 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:04:47 ctl02 nova-api[16248]: 2017-09-28 13:04:47.862 16248 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:04:47 ctl02 nova-api[16248]: 2017-09-28 13:04:47.863 16248 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:04:47 ctl02 nova-api[16248]: 2017-09-28 13:04:47.863 16248 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:04:47 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:04:47.921 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:04:47] "OPTIONS / HTTP/1.0" 200 134 0.000482
Sep 28 13:04:47 ctl02 nova-api[16248]: 2017-09-28 13:04:47.993 16248 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:04:47 ctl02 nova-api[16248]: 2017-09-28 13:04:47.994 16248 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:04:47 ctl02 nova-api[16248]: 2017-09-28 13:04:47.994 16248 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:04:47 ctl02 nova-api[16248]: 2017-09-28 13:04:47.995 16248 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:04:47 ctl02 nova-api[16248]: 2017-09-28 13:04:47.998 16248 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:04:47 ctl02 nova-api[16248]: 2017-09-28 13:04:47.998 16248 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:04:47 ctl02 nova-api[16248]: 2017-09-28 13:04:47.998 16248 ERROR nova Traceback (most recent call last):
Sep 28 13:04:47 ctl02 nova-api[16248]: 2017-09-28 13:04:47.998 16248 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:04:47 ctl02 nova-api[16248]: 2017-09-28 13:04:47.998 16248 ERROR nova     sys.exit(main())
Sep 28 13:04:47 ctl02 nova-api[16248]: 2017-09-28 13:04:47.998 16248 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:04:47 ctl02 nova-api[16248]: 2017-09-28 13:04:47.998 16248 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:04:48 ctl02 nova-api[16248]: 2017-09-28 13:04:47.998 16248 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:04:48 ctl02 nova-api[16248]: 2017-09-28 13:04:47.998 16248 ERROR nova     max_url_len=max_url_len)
Sep 28 13:04:48 ctl02 nova-api[16248]: 2017-09-28 13:04:47.998 16248 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:04:48 ctl02 nova-api[16248]: 2017-09-28 13:04:47.998 16248 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:04:48 ctl02 nova-api[16248]: 2017-09-28 13:04:47.998 16248 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:04:48 ctl02 nova-api[16248]: 2017-09-28 13:04:47.998 16248 ERROR nova     sock.listen(backlog)
Sep 28 13:04:48 ctl02 nova-api[16248]: 2017-09-28 13:04:47.998 16248 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:04:48 ctl02 nova-api[16248]: 2017-09-28 13:04:47.998 16248 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:04:48 ctl02 nova-api[16248]: 2017-09-28 13:04:47.998 16248 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:04:48 ctl02 nova-api[16248]: 2017-09-28 13:04:47.998 16248 ERROR nova
Sep 28 13:04:48 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:04:48 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:04:48 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:04:48 ctl02 heat-api-cfn[13300]: 2017-09-28 13:04:48.175 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:04:48] "OPTIONS / HTTP/1.0" 200 134 0.000478
Sep 28 13:04:48 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:04:48 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:04:48 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:04:48 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:04:48 ctl02 heat-api[13008]: 2017-09-28 13:04:48.428 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:04:48] "OPTIONS / HTTP/1.0" 200 134 0.000766
Sep 28 13:04:48 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 13:04:48 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 13:04:48 ctl02 heat-api[13008]: 2017-09-28 13:04:48.618 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:04:48] "OPTIONS / HTTP/1.0" 200 134 0.000600
Sep 28 13:04:49 ctl02 glance-api[29183]: 2017-09-28 13:04:49.803 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:04:49] "OPTIONS / HTTP/1.0" 200 134 0.000625
Sep 28 13:04:49 ctl02 nova-consoleauth[5433]: 2017-09-28 13:04:49.984 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:04:50 ctl02 nova-api[16267]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:04:50 ctl02 nova-api[16267]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:04:50 ctl02 nova-api[16267]: 2017-09-28 13:04:50.311 16267 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:04:50 ctl02 nova-api[16267]: 2017-09-28 13:04:50.312 16267 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:04:50 ctl02 nova-api[16267]: 2017-09-28 13:04:50.312 16267 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:04:50 ctl02 nova-api[16267]: 2017-09-28 13:04:50.312 16267 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:04:50 ctl02 nova-api[16267]: 2017-09-28 13:04:50.312 16267 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:04:50 ctl02 nova-api[16267]: 2017-09-28 13:04:50.312 16267 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:04:50 ctl02 nova-api[16267]: 2017-09-28 13:04:50.312 16267 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:04:50 ctl02 nova-api[16267]: 2017-09-28 13:04:50.312 16267 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:04:50 ctl02 nova-api[16267]: 2017-09-28 13:04:50.312 16267 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:04:50 ctl02 nova-api[16267]: 2017-09-28 13:04:50.312 16267 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:04:50 ctl02 nova-api[16267]: 2017-09-28 13:04:50.312 16267 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:04:50 ctl02 nova-api[16267]: 2017-09-28 13:04:50.312 16267 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:04:50 ctl02 nova-api[16267]: 2017-09-28 13:04:50.312 16267 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:04:50 ctl02 nova-api[16267]: 2017-09-28 13:04:50.312 16267 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:04:50 ctl02 nova-api[16267]: 2017-09-28 13:04:50.312 16267 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:04:50 ctl02 nova-api[16267]: 2017-09-28 13:04:50.312 16267 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:04:50 ctl02 nova-api[16267]: 2017-09-28 13:04:50.312 16267 ERROR nova.wsgi     self.filename))
Sep 28 13:04:50 ctl02 nova-api[16267]: 2017-09-28 13:04:50.312 16267 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:04:50 ctl02 nova-api[16267]: 2017-09-28 13:04:50.312 16267 ERROR nova.wsgi
Sep 28 13:04:50 ctl02 nova-api[16267]: 2017-09-28 13:04:50.313 16267 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:04:50 ctl02 nova-api[16267]: 2017-09-28 13:04:50.442 16267 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:04:50 ctl02 heat-engine[12803]: 2017-09-28 13:04:50.459 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:04:50 ctl02 heat-engine[12803]: 2017-09-28 13:04:50.477 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:04:50 ctl02 heat-engine[12803]: 2017-09-28 13:04:50.482 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:04:50 ctl02 heat-engine[12803]: 2017-09-28 13:04:50.483 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:04:50 ctl02 nova-api[16267]: 2017-09-28 13:04:50.672 16267 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:04:50 ctl02 nova-api[16267]: 2017-09-28 13:04:50.674 16267 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:04:50 ctl02 nova-api[16267]: 2017-09-28 13:04:50.674 16267 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:04:50 ctl02 nova-api[16267]: 2017-09-28 13:04:50.675 16267 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:04:50 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:04:50.691 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:04:50] "OPTIONS / HTTP/1.0" 200 134 0.000391
Sep 28 13:04:50 ctl02 nova-api[16267]: 2017-09-28 13:04:50.804 16267 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:04:50 ctl02 nova-api[16267]: 2017-09-28 13:04:50.806 16267 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:04:50 ctl02 nova-api[16267]: 2017-09-28 13:04:50.806 16267 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:04:50 ctl02 nova-api[16267]: 2017-09-28 13:04:50.806 16267 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:04:50 ctl02 nova-api[16267]: 2017-09-28 13:04:50.810 16267 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:04:50 ctl02 nova-api[16267]: 2017-09-28 13:04:50.810 16267 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:04:50 ctl02 nova-api[16267]: 2017-09-28 13:04:50.810 16267 ERROR nova Traceback (most recent call last):
Sep 28 13:04:50 ctl02 nova-api[16267]: 2017-09-28 13:04:50.810 16267 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:04:50 ctl02 nova-api[16267]: 2017-09-28 13:04:50.810 16267 ERROR nova     sys.exit(main())
Sep 28 13:04:50 ctl02 nova-api[16267]: 2017-09-28 13:04:50.810 16267 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:04:50 ctl02 nova-api[16267]: 2017-09-28 13:04:50.810 16267 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:04:50 ctl02 nova-api[16267]: 2017-09-28 13:04:50.810 16267 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:04:50 ctl02 nova-api[16267]: 2017-09-28 13:04:50.810 16267 ERROR nova     max_url_len=max_url_len)
Sep 28 13:04:50 ctl02 nova-api[16267]: 2017-09-28 13:04:50.810 16267 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:04:50 ctl02 nova-api[16267]: 2017-09-28 13:04:50.810 16267 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:04:50 ctl02 nova-api[16267]: 2017-09-28 13:04:50.810 16267 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:04:50 ctl02 nova-api[16267]: 2017-09-28 13:04:50.810 16267 ERROR nova     sock.listen(backlog)
Sep 28 13:04:50 ctl02 nova-api[16267]: 2017-09-28 13:04:50.810 16267 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:04:50 ctl02 nova-api[16267]: 2017-09-28 13:04:50.810 16267 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:04:50 ctl02 nova-api[16267]: 2017-09-28 13:04:50.810 16267 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:04:50 ctl02 nova-api[16267]: 2017-09-28 13:04:50.810 16267 ERROR nova
Sep 28 13:04:50 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:04:50 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:04:50 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:04:50 ctl02 neutron-server[30536]: 2017-09-28 13:04:50.992 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 13:04:50 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 13:04:50 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 13:03:06 cmp002
Sep 28 13:04:50 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 13:02:58 cmp001
Sep 28 13:04:50 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 13:03:36 cmp002
Sep 28 13:04:51 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:04:51 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:04:51 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:04:51 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:04:51 ctl02 neutron-server[30536]: 2017-09-28 13:04:51.291 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:04:51] "OPTIONS / HTTP/1.0" 200 262 0.000526
Sep 28 13:04:52 ctl02 glance-api[29183]: 2017-09-28 13:04:52.082 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:04:52] "OPTIONS / HTTP/1.0" 200 134 0.000741
Sep 28 13:04:52 ctl02 nova-api[16290]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:04:52 ctl02 nova-api[16290]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:04:53 ctl02 nova-api[16290]: 2017-09-28 13:04:53.057 16290 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:04:53 ctl02 nova-api[16290]: 2017-09-28 13:04:53.059 16290 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:04:53 ctl02 nova-api[16290]: 2017-09-28 13:04:53.059 16290 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:04:53 ctl02 nova-api[16290]: 2017-09-28 13:04:53.059 16290 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:04:53 ctl02 nova-api[16290]: 2017-09-28 13:04:53.059 16290 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:04:53 ctl02 nova-api[16290]: 2017-09-28 13:04:53.059 16290 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:04:53 ctl02 nova-api[16290]: 2017-09-28 13:04:53.059 16290 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:04:53 ctl02 nova-api[16290]: 2017-09-28 13:04:53.059 16290 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:04:53 ctl02 nova-api[16290]: 2017-09-28 13:04:53.059 16290 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:04:53 ctl02 nova-api[16290]: 2017-09-28 13:04:53.059 16290 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:04:53 ctl02 nova-api[16290]: 2017-09-28 13:04:53.059 16290 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:04:53 ctl02 nova-api[16290]: 2017-09-28 13:04:53.059 16290 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:04:53 ctl02 nova-api[16290]: 2017-09-28 13:04:53.059 16290 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:04:53 ctl02 nova-api[16290]: 2017-09-28 13:04:53.059 16290 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:04:53 ctl02 nova-api[16290]: 2017-09-28 13:04:53.059 16290 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:04:53 ctl02 nova-api[16290]: 2017-09-28 13:04:53.059 16290 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:04:53 ctl02 nova-api[16290]: 2017-09-28 13:04:53.059 16290 ERROR nova.wsgi     self.filename))
Sep 28 13:04:53 ctl02 nova-api[16290]: 2017-09-28 13:04:53.059 16290 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:04:53 ctl02 nova-api[16290]: 2017-09-28 13:04:53.059 16290 ERROR nova.wsgi
Sep 28 13:04:53 ctl02 nova-api[16290]: 2017-09-28 13:04:53.061 16290 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:04:53 ctl02 nova-scheduler[5620]: 2017-09-28 13:04:53.093 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:04:53 ctl02 nova-api[16290]: 2017-09-28 13:04:53.202 16290 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:04:53 ctl02 heat-api[13008]: 2017-09-28 13:04:53.267 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:04:53] "OPTIONS / HTTP/1.0" 200 134 0.000624
Sep 28 13:04:53 ctl02 nova-api[16290]: 2017-09-28 13:04:53.460 16290 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:04:53 ctl02 nova-api[16290]: 2017-09-28 13:04:53.462 16290 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:04:53 ctl02 nova-api[16290]: 2017-09-28 13:04:53.463 16290 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:04:53 ctl02 nova-api[16290]: 2017-09-28 13:04:53.463 16290 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:04:53 ctl02 nova-api[16290]: 2017-09-28 13:04:53.602 16290 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:04:53 ctl02 nova-api[16290]: 2017-09-28 13:04:53.605 16290 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:04:53 ctl02 nova-api[16290]: 2017-09-28 13:04:53.605 16290 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:04:53 ctl02 nova-api[16290]: 2017-09-28 13:04:53.605 16290 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:04:53 ctl02 nova-api[16290]: 2017-09-28 13:04:53.609 16290 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:04:53 ctl02 nova-api[16290]: 2017-09-28 13:04:53.609 16290 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:04:53 ctl02 nova-api[16290]: 2017-09-28 13:04:53.609 16290 ERROR nova Traceback (most recent call last):
Sep 28 13:04:53 ctl02 nova-api[16290]: 2017-09-28 13:04:53.609 16290 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:04:53 ctl02 nova-api[16290]: 2017-09-28 13:04:53.609 16290 ERROR nova     sys.exit(main())
Sep 28 13:04:53 ctl02 nova-api[16290]: 2017-09-28 13:04:53.609 16290 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:04:53 ctl02 nova-api[16290]: 2017-09-28 13:04:53.609 16290 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:04:53 ctl02 nova-api[16290]: 2017-09-28 13:04:53.609 16290 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:04:53 ctl02 nova-api[16290]: 2017-09-28 13:04:53.609 16290 ERROR nova     max_url_len=max_url_len)
Sep 28 13:04:53 ctl02 nova-api[16290]: 2017-09-28 13:04:53.609 16290 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:04:53 ctl02 nova-api[16290]: 2017-09-28 13:04:53.609 16290 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:04:53 ctl02 nova-api[16290]: 2017-09-28 13:04:53.609 16290 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:04:53 ctl02 nova-api[16290]: 2017-09-28 13:04:53.609 16290 ERROR nova     sock.listen(backlog)
Sep 28 13:04:53 ctl02 nova-api[16290]: 2017-09-28 13:04:53.609 16290 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:04:53 ctl02 nova-api[16290]: 2017-09-28 13:04:53.609 16290 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:04:53 ctl02 nova-api[16290]: 2017-09-28 13:04:53.609 16290 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:04:53 ctl02 nova-api[16290]: 2017-09-28 13:04:53.609 16290 ERROR nova
Sep 28 13:04:53 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:04:53 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:04:53 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:04:54 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:04:54 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:04:54 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:04:54.135 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:04:54] "OPTIONS / HTTP/1.0" 200 134 0.000526
Sep 28 13:04:54 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:04:54 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:04:54 ctl02 glance-api[29183]: 2017-09-28 13:04:54.764 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:04:54] "OPTIONS / HTTP/1.0" 200 134 0.001131
Sep 28 13:04:54 ctl02 heat-api-cfn[13300]: 2017-09-28 13:04:54.767 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:04:54] "OPTIONS / HTTP/1.0" 200 134 0.000468
Sep 28 13:04:55 ctl02 neutron-server[30536]: 2017-09-28 13:04:55.003 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:04:55] "OPTIONS / HTTP/1.0" 200 262 0.000469
Sep 28 13:04:55 ctl02 nova-api[16308]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:04:55 ctl02 nova-api[16308]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:04:56 ctl02 nova-api[16308]: 2017-09-28 13:04:56.000 16308 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:04:56 ctl02 nova-api[16308]: 2017-09-28 13:04:56.001 16308 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:04:56 ctl02 nova-api[16308]: 2017-09-28 13:04:56.001 16308 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:04:56 ctl02 nova-api[16308]: 2017-09-28 13:04:56.001 16308 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:04:56 ctl02 nova-api[16308]: 2017-09-28 13:04:56.001 16308 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:04:56 ctl02 nova-api[16308]: 2017-09-28 13:04:56.001 16308 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:04:56 ctl02 nova-api[16308]: 2017-09-28 13:04:56.001 16308 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:04:56 ctl02 nova-api[16308]: 2017-09-28 13:04:56.001 16308 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:04:56 ctl02 nova-api[16308]: 2017-09-28 13:04:56.001 16308 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:04:56 ctl02 nova-api[16308]: 2017-09-28 13:04:56.001 16308 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:04:56 ctl02 nova-api[16308]: 2017-09-28 13:04:56.001 16308 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:04:56 ctl02 nova-api[16308]: 2017-09-28 13:04:56.001 16308 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:04:56 ctl02 nova-api[16308]: 2017-09-28 13:04:56.001 16308 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:04:56 ctl02 nova-api[16308]: 2017-09-28 13:04:56.001 16308 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:04:56 ctl02 nova-api[16308]: 2017-09-28 13:04:56.001 16308 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:04:56 ctl02 nova-api[16308]: 2017-09-28 13:04:56.001 16308 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:04:56 ctl02 nova-api[16308]: 2017-09-28 13:04:56.001 16308 ERROR nova.wsgi     self.filename))
Sep 28 13:04:56 ctl02 nova-api[16308]: 2017-09-28 13:04:56.001 16308 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:04:56 ctl02 nova-api[16308]: 2017-09-28 13:04:56.001 16308 ERROR nova.wsgi
Sep 28 13:04:56 ctl02 nova-api[16308]: 2017-09-28 13:04:56.002 16308 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:04:56 ctl02 nova-api[16308]: 2017-09-28 13:04:56.131 16308 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:04:56 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x65c3b877)
Sep 28 13:04:56 ctl02 nova-api[16308]: 2017-09-28 13:04:56.356 16308 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:04:56 ctl02 nova-api[16308]: 2017-09-28 13:04:56.358 16308 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:04:56 ctl02 nova-api[16308]: 2017-09-28 13:04:56.358 16308 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:04:56 ctl02 nova-api[16308]: 2017-09-28 13:04:56.358 16308 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:04:56 ctl02 heat-api-cfn[13300]: 2017-09-28 13:04:56.398 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:04:56] "OPTIONS / HTTP/1.0" 200 134 0.000529
Sep 28 13:04:56 ctl02 nova-api[16308]: 2017-09-28 13:04:56.491 16308 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:04:56 ctl02 nova-api[16308]: 2017-09-28 13:04:56.493 16308 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:04:56 ctl02 nova-api[16308]: 2017-09-28 13:04:56.493 16308 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:04:56 ctl02 nova-api[16308]: 2017-09-28 13:04:56.493 16308 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:04:56 ctl02 nova-api[16308]: 2017-09-28 13:04:56.496 16308 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:04:56 ctl02 nova-api[16308]: 2017-09-28 13:04:56.497 16308 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:04:56 ctl02 nova-api[16308]: 2017-09-28 13:04:56.497 16308 ERROR nova Traceback (most recent call last):
Sep 28 13:04:56 ctl02 nova-api[16308]: 2017-09-28 13:04:56.497 16308 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:04:56 ctl02 nova-api[16308]: 2017-09-28 13:04:56.497 16308 ERROR nova     sys.exit(main())
Sep 28 13:04:56 ctl02 nova-api[16308]: 2017-09-28 13:04:56.497 16308 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:04:56 ctl02 nova-api[16308]: 2017-09-28 13:04:56.497 16308 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:04:56 ctl02 nova-api[16308]: 2017-09-28 13:04:56.497 16308 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:04:56 ctl02 nova-api[16308]: 2017-09-28 13:04:56.497 16308 ERROR nova     max_url_len=max_url_len)
Sep 28 13:04:56 ctl02 nova-api[16308]: 2017-09-28 13:04:56.497 16308 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:04:56 ctl02 nova-api[16308]: 2017-09-28 13:04:56.497 16308 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:04:56 ctl02 nova-api[16308]: 2017-09-28 13:04:56.497 16308 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:04:56 ctl02 nova-api[16308]: 2017-09-28 13:04:56.497 16308 ERROR nova     sock.listen(backlog)
Sep 28 13:04:56 ctl02 nova-api[16308]: 2017-09-28 13:04:56.497 16308 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:04:56 ctl02 nova-api[16308]: 2017-09-28 13:04:56.497 16308 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:04:56 ctl02 nova-api[16308]: 2017-09-28 13:04:56.497 16308 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:04:56 ctl02 nova-api[16308]: 2017-09-28 13:04:56.497 16308 ERROR nova
Sep 28 13:04:56 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:04:56 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:04:56 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:04:56 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:04:56 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:04:56 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:04:56 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:04:57 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x65c3b877)
Sep 28 13:04:57 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:04:57.687 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:04:57] "OPTIONS / HTTP/1.0" 200 134 0.000476
Sep 28 13:04:58 ctl02 neutron-server[30536]: 2017-09-28 13:04:58.158 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:04:58] "OPTIONS / HTTP/1.0" 200 262 0.000514
Sep 28 13:04:58 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x65c3b877)
Sep 28 13:04:58 ctl02 heat-api-cfn[13300]: 2017-09-28 13:04:58.338 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:04:58] "OPTIONS / HTTP/1.0" 200 134 0.000496
Sep 28 13:04:58 ctl02 heat-api[13008]: 2017-09-28 13:04:58.354 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:04:58] "OPTIONS / HTTP/1.0" 200 134 0.000624
Sep 28 13:04:58 ctl02 heat-api[13008]: 2017-09-28 13:04:58.504 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:04:58] "OPTIONS / HTTP/1.0" 200 134 0.000821
Sep 28 13:04:58 ctl02 nova-api[16326]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:04:58 ctl02 nova-api[16326]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:04:58 ctl02 nova-api[16326]: 2017-09-28 13:04:58.780 16326 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:04:58 ctl02 nova-api[16326]: 2017-09-28 13:04:58.782 16326 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:04:58 ctl02 nova-api[16326]: 2017-09-28 13:04:58.782 16326 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:04:58 ctl02 nova-api[16326]: 2017-09-28 13:04:58.782 16326 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:04:58 ctl02 nova-api[16326]: 2017-09-28 13:04:58.782 16326 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:04:58 ctl02 nova-api[16326]: 2017-09-28 13:04:58.782 16326 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:04:58 ctl02 nova-api[16326]: 2017-09-28 13:04:58.782 16326 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:04:58 ctl02 nova-api[16326]: 2017-09-28 13:04:58.782 16326 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:04:58 ctl02 nova-api[16326]: 2017-09-28 13:04:58.782 16326 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:04:58 ctl02 nova-api[16326]: 2017-09-28 13:04:58.782 16326 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:04:58 ctl02 nova-api[16326]: 2017-09-28 13:04:58.782 16326 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:04:58 ctl02 nova-api[16326]: 2017-09-28 13:04:58.782 16326 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:04:58 ctl02 nova-api[16326]: 2017-09-28 13:04:58.782 16326 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:04:58 ctl02 nova-api[16326]: 2017-09-28 13:04:58.782 16326 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:04:58 ctl02 nova-api[16326]: 2017-09-28 13:04:58.782 16326 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:04:58 ctl02 nova-api[16326]: 2017-09-28 13:04:58.782 16326 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:04:58 ctl02 nova-api[16326]: 2017-09-28 13:04:58.782 16326 ERROR nova.wsgi     self.filename))
Sep 28 13:04:58 ctl02 nova-api[16326]: 2017-09-28 13:04:58.782 16326 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:04:58 ctl02 nova-api[16326]: 2017-09-28 13:04:58.782 16326 ERROR nova.wsgi
Sep 28 13:04:58 ctl02 nova-api[16326]: 2017-09-28 13:04:58.784 16326 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:04:58 ctl02 nova-api[16326]: 2017-09-28 13:04:58.915 16326 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:04:59 ctl02 nova-api[16326]: 2017-09-28 13:04:59.163 16326 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:04:59 ctl02 nova-api[16326]: 2017-09-28 13:04:59.198 16326 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:04:59 ctl02 nova-api[16326]: 2017-09-28 13:04:59.198 16326 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:04:59 ctl02 nova-api[16326]: 2017-09-28 13:04:59.199 16326 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:04:59 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x65c3b877)
Sep 28 13:04:59 ctl02 nova-api[16326]: 2017-09-28 13:04:59.333 16326 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:04:59 ctl02 nova-api[16326]: 2017-09-28 13:04:59.336 16326 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:04:59 ctl02 nova-api[16326]: 2017-09-28 13:04:59.336 16326 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:04:59 ctl02 nova-api[16326]: 2017-09-28 13:04:59.337 16326 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:04:59 ctl02 nova-api[16326]: 2017-09-28 13:04:59.340 16326 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:04:59 ctl02 nova-api[16326]: 2017-09-28 13:04:59.341 16326 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:04:59 ctl02 nova-api[16326]: 2017-09-28 13:04:59.341 16326 ERROR nova Traceback (most recent call last):
Sep 28 13:04:59 ctl02 nova-api[16326]: 2017-09-28 13:04:59.341 16326 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:04:59 ctl02 nova-api[16326]: 2017-09-28 13:04:59.341 16326 ERROR nova     sys.exit(main())
Sep 28 13:04:59 ctl02 nova-api[16326]: 2017-09-28 13:04:59.341 16326 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:04:59 ctl02 nova-api[16326]: 2017-09-28 13:04:59.341 16326 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:04:59 ctl02 nova-api[16326]: 2017-09-28 13:04:59.341 16326 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:04:59 ctl02 nova-api[16326]: 2017-09-28 13:04:59.341 16326 ERROR nova     max_url_len=max_url_len)
Sep 28 13:04:59 ctl02 nova-api[16326]: 2017-09-28 13:04:59.341 16326 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:04:59 ctl02 nova-api[16326]: 2017-09-28 13:04:59.341 16326 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:04:59 ctl02 nova-api[16326]: 2017-09-28 13:04:59.341 16326 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:04:59 ctl02 nova-api[16326]: 2017-09-28 13:04:59.341 16326 ERROR nova     sock.listen(backlog)
Sep 28 13:04:59 ctl02 nova-api[16326]: 2017-09-28 13:04:59.341 16326 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:04:59 ctl02 nova-api[16326]: 2017-09-28 13:04:59.341 16326 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:04:59 ctl02 nova-api[16326]: 2017-09-28 13:04:59.341 16326 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:04:59 ctl02 nova-api[16326]: 2017-09-28 13:04:59.341 16326 ERROR nova
Sep 28 13:04:59 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:04:59 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:04:59 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:04:59 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:04:59 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:04:59 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:04:59 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:04:59 ctl02 glance-api[29183]: 2017-09-28 13:04:59.835 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:04:59] "OPTIONS / HTTP/1.0" 200 134 0.000680
Sep 28 13:05:00 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x65c3b877)
Sep 28 13:05:00 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:05:00.419 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:05:00] "OPTIONS / HTTP/1.0" 200 134 0.000431
Sep 28 13:05:01 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x65c3b877)
Sep 28 13:05:01 ctl02 neutron-server[30536]: 2017-09-28 13:05:01.265 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:05:01] "OPTIONS / HTTP/1.0" 200 262 0.000553
Sep 28 13:05:01 ctl02 nova-api[16344]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:05:01 ctl02 nova-api[16344]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:05:01 ctl02 nova-api[16344]: 2017-09-28 13:05:01.550 16344 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:05:01 ctl02 nova-api[16344]: 2017-09-28 13:05:01.551 16344 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:05:01 ctl02 nova-api[16344]: 2017-09-28 13:05:01.551 16344 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:05:01 ctl02 nova-api[16344]: 2017-09-28 13:05:01.551 16344 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:05:01 ctl02 nova-api[16344]: 2017-09-28 13:05:01.551 16344 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:05:01 ctl02 nova-api[16344]: 2017-09-28 13:05:01.551 16344 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:05:01 ctl02 nova-api[16344]: 2017-09-28 13:05:01.551 16344 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:05:01 ctl02 nova-api[16344]: 2017-09-28 13:05:01.551 16344 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:05:01 ctl02 nova-api[16344]: 2017-09-28 13:05:01.551 16344 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:05:01 ctl02 nova-api[16344]: 2017-09-28 13:05:01.551 16344 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:05:01 ctl02 nova-api[16344]: 2017-09-28 13:05:01.551 16344 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:05:01 ctl02 nova-api[16344]: 2017-09-28 13:05:01.551 16344 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:05:01 ctl02 nova-api[16344]: 2017-09-28 13:05:01.551 16344 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:05:01 ctl02 nova-api[16344]: 2017-09-28 13:05:01.551 16344 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:05:01 ctl02 nova-api[16344]: 2017-09-28 13:05:01.551 16344 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:05:01 ctl02 nova-api[16344]: 2017-09-28 13:05:01.551 16344 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:05:01 ctl02 nova-api[16344]: 2017-09-28 13:05:01.551 16344 ERROR nova.wsgi     self.filename))
Sep 28 13:05:01 ctl02 nova-api[16344]: 2017-09-28 13:05:01.551 16344 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:05:01 ctl02 nova-api[16344]: 2017-09-28 13:05:01.551 16344 ERROR nova.wsgi
Sep 28 13:05:01 ctl02 nova-api[16344]: 2017-09-28 13:05:01.554 16344 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:05:01 ctl02 nova-api[16344]: 2017-09-28 13:05:01.689 16344 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:05:01 ctl02 nova-api[16344]: 2017-09-28 13:05:01.944 16344 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:05:01 ctl02 nova-api[16344]: 2017-09-28 13:05:01.947 16344 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:05:01 ctl02 nova-api[16344]: 2017-09-28 13:05:01.948 16344 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:05:01 ctl02 nova-api[16344]: 2017-09-28 13:05:01.948 16344 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:05:02 ctl02 nova-api[16344]: 2017-09-28 13:05:02.084 16344 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:05:02 ctl02 nova-api[16344]: 2017-09-28 13:05:02.087 16344 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:05:02 ctl02 nova-api[16344]: 2017-09-28 13:05:02.087 16344 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:05:02 ctl02 nova-api[16344]: 2017-09-28 13:05:02.088 16344 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:05:02 ctl02 nova-api[16344]: 2017-09-28 13:05:02.091 16344 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:05:02 ctl02 nova-api[16344]: 2017-09-28 13:05:02.092 16344 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:05:02 ctl02 nova-api[16344]: 2017-09-28 13:05:02.092 16344 ERROR nova Traceback (most recent call last):
Sep 28 13:05:02 ctl02 nova-api[16344]: 2017-09-28 13:05:02.092 16344 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:05:02 ctl02 nova-api[16344]: 2017-09-28 13:05:02.092 16344 ERROR nova     sys.exit(main())
Sep 28 13:05:02 ctl02 nova-api[16344]: 2017-09-28 13:05:02.092 16344 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:05:02 ctl02 nova-api[16344]: 2017-09-28 13:05:02.092 16344 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:05:02 ctl02 nova-api[16344]: 2017-09-28 13:05:02.092 16344 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:05:02 ctl02 nova-api[16344]: 2017-09-28 13:05:02.092 16344 ERROR nova     max_url_len=max_url_len)
Sep 28 13:05:02 ctl02 nova-api[16344]: 2017-09-28 13:05:02.092 16344 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:05:02 ctl02 nova-api[16344]: 2017-09-28 13:05:02.092 16344 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:05:02 ctl02 nova-api[16344]: 2017-09-28 13:05:02.092 16344 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:05:02 ctl02 nova-api[16344]: 2017-09-28 13:05:02.092 16344 ERROR nova     sock.listen(backlog)
Sep 28 13:05:02 ctl02 nova-api[16344]: 2017-09-28 13:05:02.092 16344 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:05:02 ctl02 nova-api[16344]: 2017-09-28 13:05:02.092 16344 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:05:02 ctl02 nova-api[16344]: 2017-09-28 13:05:02.092 16344 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:05:02 ctl02 nova-api[16344]: 2017-09-28 13:05:02.092 16344 ERROR nova
Sep 28 13:05:02 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x65c3b877)
Sep 28 13:05:02 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:05:02 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:05:02 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:05:02 ctl02 glance-api[29183]: 2017-09-28 13:05:02.369 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:05:02] "OPTIONS / HTTP/1.0" 200 134 0.000696
Sep 28 13:05:02 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:05:02 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:05:02 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:05:02 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:05:03 ctl02 heat-api[13008]: 2017-09-28 13:05:03.064 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:05:03] "OPTIONS / HTTP/1.0" 200 134 0.000616
Sep 28 13:05:03 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x65c3b877)
Sep 28 13:05:04 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:05:04.040 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:05:04] "OPTIONS / HTTP/1.0" 200 134 0.000472
Sep 28 13:05:04 ctl02 nova-api[16362]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:05:04 ctl02 nova-api[16362]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:05:04 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x65c3b877)
Sep 28 13:05:04 ctl02 nova-api[16362]: 2017-09-28 13:05:04.237 16362 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:05:04 ctl02 nova-api[16362]: 2017-09-28 13:05:04.238 16362 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:05:04 ctl02 nova-api[16362]: 2017-09-28 13:05:04.238 16362 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:05:04 ctl02 nova-api[16362]: 2017-09-28 13:05:04.238 16362 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:05:04 ctl02 nova-api[16362]: 2017-09-28 13:05:04.238 16362 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:05:04 ctl02 nova-api[16362]: 2017-09-28 13:05:04.238 16362 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:05:04 ctl02 nova-api[16362]: 2017-09-28 13:05:04.238 16362 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:05:04 ctl02 nova-api[16362]: 2017-09-28 13:05:04.238 16362 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:05:04 ctl02 nova-api[16362]: 2017-09-28 13:05:04.238 16362 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:05:04 ctl02 nova-api[16362]: 2017-09-28 13:05:04.238 16362 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:05:04 ctl02 nova-api[16362]: 2017-09-28 13:05:04.238 16362 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:05:04 ctl02 nova-api[16362]: 2017-09-28 13:05:04.238 16362 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:05:04 ctl02 nova-api[16362]: 2017-09-28 13:05:04.238 16362 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:05:04 ctl02 nova-api[16362]: 2017-09-28 13:05:04.238 16362 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:05:04 ctl02 nova-api[16362]: 2017-09-28 13:05:04.238 16362 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:05:04 ctl02 nova-api[16362]: 2017-09-28 13:05:04.238 16362 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:05:04 ctl02 nova-api[16362]: 2017-09-28 13:05:04.238 16362 ERROR nova.wsgi     self.filename))
Sep 28 13:05:04 ctl02 nova-api[16362]: 2017-09-28 13:05:04.238 16362 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:05:04 ctl02 nova-api[16362]: 2017-09-28 13:05:04.238 16362 ERROR nova.wsgi
Sep 28 13:05:04 ctl02 nova-api[16362]: 2017-09-28 13:05:04.239 16362 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:05:04 ctl02 nova-api[16362]: 2017-09-28 13:05:04.365 16362 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:05:04 ctl02 glance-api[29183]: 2017-09-28 13:05:04.378 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:05:04] "OPTIONS / HTTP/1.0" 200 134 0.000780
Sep 28 13:05:04 ctl02 nova-api[16362]: 2017-09-28 13:05:04.583 16362 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:05:04 ctl02 nova-api[16362]: 2017-09-28 13:05:04.585 16362 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:05:04 ctl02 nova-api[16362]: 2017-09-28 13:05:04.585 16362 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:05:04 ctl02 nova-api[16362]: 2017-09-28 13:05:04.586 16362 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:05:04 ctl02 neutron-server[30536]: 2017-09-28 13:05:04.638 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:05:04] "OPTIONS / HTTP/1.0" 200 262 0.000463
Sep 28 13:05:04 ctl02 nova-api[16362]: 2017-09-28 13:05:04.716 16362 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:05:04 ctl02 nova-api[16362]: 2017-09-28 13:05:04.717 16362 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:05:04 ctl02 nova-api[16362]: 2017-09-28 13:05:04.718 16362 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:05:04 ctl02 nova-api[16362]: 2017-09-28 13:05:04.718 16362 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:05:04 ctl02 nova-api[16362]: 2017-09-28 13:05:04.721 16362 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:05:04 ctl02 nova-api[16362]: 2017-09-28 13:05:04.721 16362 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:05:04 ctl02 nova-api[16362]: 2017-09-28 13:05:04.721 16362 ERROR nova Traceback (most recent call last):
Sep 28 13:05:04 ctl02 nova-api[16362]: 2017-09-28 13:05:04.721 16362 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:05:04 ctl02 nova-api[16362]: 2017-09-28 13:05:04.721 16362 ERROR nova     sys.exit(main())
Sep 28 13:05:04 ctl02 nova-api[16362]: 2017-09-28 13:05:04.721 16362 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:05:04 ctl02 nova-api[16362]: 2017-09-28 13:05:04.721 16362 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:05:04 ctl02 nova-api[16362]: 2017-09-28 13:05:04.721 16362 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:05:04 ctl02 nova-api[16362]: 2017-09-28 13:05:04.721 16362 ERROR nova     max_url_len=max_url_len)
Sep 28 13:05:04 ctl02 nova-api[16362]: 2017-09-28 13:05:04.721 16362 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:05:04 ctl02 nova-api[16362]: 2017-09-28 13:05:04.721 16362 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:05:04 ctl02 nova-api[16362]: 2017-09-28 13:05:04.721 16362 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:05:04 ctl02 nova-api[16362]: 2017-09-28 13:05:04.721 16362 ERROR nova     sock.listen(backlog)
Sep 28 13:05:04 ctl02 nova-api[16362]: 2017-09-28 13:05:04.721 16362 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:05:04 ctl02 nova-api[16362]: 2017-09-28 13:05:04.721 16362 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:05:04 ctl02 nova-api[16362]: 2017-09-28 13:05:04.721 16362 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:05:04 ctl02 nova-api[16362]: 2017-09-28 13:05:04.721 16362 ERROR nova
Sep 28 13:05:04 ctl02 heat-api-cfn[13300]: 2017-09-28 13:05:04.807 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:05:04] "OPTIONS / HTTP/1.0" 200 134 0.000450
Sep 28 13:05:04 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:05:04 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:05:04 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:05:05 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:05:05 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:05:05 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:05:05 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:05:05 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x65c3b877)
Sep 28 13:05:05 ctl02 neutron-server[30536]: 2017-09-28 13:05:05.991 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 13:05:05 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 13:05:05 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 13:03:06 cmp002
Sep 28 13:05:05 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 13:04:30 cmp002
Sep 28 13:05:05 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 13:03:36 cmp002
Sep 28 13:05:06 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x65c3b877)
Sep 28 13:05:06 ctl02 heat-api-cfn[13300]: 2017-09-28 13:05:06.324 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:05:06] "OPTIONS / HTTP/1.0" 200 134 0.000625
Sep 28 13:05:06 ctl02 nova-api[16380]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:05:06 ctl02 nova-api[16380]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:05:07 ctl02 nova-api[16380]: 2017-09-28 13:05:07.051 16380 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:05:07 ctl02 nova-api[16380]: 2017-09-28 13:05:07.052 16380 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:05:07 ctl02 nova-api[16380]: 2017-09-28 13:05:07.052 16380 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:05:07 ctl02 nova-api[16380]: 2017-09-28 13:05:07.052 16380 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:05:07 ctl02 nova-api[16380]: 2017-09-28 13:05:07.052 16380 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:05:07 ctl02 nova-api[16380]: 2017-09-28 13:05:07.052 16380 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:05:07 ctl02 nova-api[16380]: 2017-09-28 13:05:07.052 16380 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:05:07 ctl02 nova-api[16380]: 2017-09-28 13:05:07.052 16380 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:05:07 ctl02 nova-api[16380]: 2017-09-28 13:05:07.052 16380 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:05:07 ctl02 nova-api[16380]: 2017-09-28 13:05:07.052 16380 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:05:07 ctl02 nova-api[16380]: 2017-09-28 13:05:07.052 16380 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:05:07 ctl02 nova-api[16380]: 2017-09-28 13:05:07.052 16380 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:05:07 ctl02 nova-api[16380]: 2017-09-28 13:05:07.052 16380 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:05:07 ctl02 nova-api[16380]: 2017-09-28 13:05:07.052 16380 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:05:07 ctl02 nova-api[16380]: 2017-09-28 13:05:07.052 16380 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:05:07 ctl02 nova-api[16380]: 2017-09-28 13:05:07.052 16380 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:05:07 ctl02 nova-api[16380]: 2017-09-28 13:05:07.052 16380 ERROR nova.wsgi     self.filename))
Sep 28 13:05:07 ctl02 nova-api[16380]: 2017-09-28 13:05:07.052 16380 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:05:07 ctl02 nova-api[16380]: 2017-09-28 13:05:07.052 16380 ERROR nova.wsgi
Sep 28 13:05:07 ctl02 nova-api[16380]: 2017-09-28 13:05:07.053 16380 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:05:07 ctl02 nova-api[16380]: 2017-09-28 13:05:07.186 16380 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:05:07 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 13:05:07 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 13:05:07 ctl02 nova-api[16380]: 2017-09-28 13:05:07.440 16380 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:05:07 ctl02 nova-api[16380]: 2017-09-28 13:05:07.442 16380 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:05:07 ctl02 nova-api[16380]: 2017-09-28 13:05:07.443 16380 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:05:07 ctl02 nova-api[16380]: 2017-09-28 13:05:07.443 16380 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:05:07 ctl02 nova-api[16380]: 2017-09-28 13:05:07.577 16380 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:05:07 ctl02 nova-api[16380]: 2017-09-28 13:05:07.580 16380 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:05:07 ctl02 nova-api[16380]: 2017-09-28 13:05:07.580 16380 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:05:07 ctl02 nova-api[16380]: 2017-09-28 13:05:07.581 16380 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:05:07 ctl02 nova-api[16380]: 2017-09-28 13:05:07.584 16380 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:05:07 ctl02 nova-api[16380]: 2017-09-28 13:05:07.585 16380 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:05:07 ctl02 nova-api[16380]: 2017-09-28 13:05:07.585 16380 ERROR nova Traceback (most recent call last):
Sep 28 13:05:07 ctl02 nova-api[16380]: 2017-09-28 13:05:07.585 16380 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:05:07 ctl02 nova-api[16380]: 2017-09-28 13:05:07.585 16380 ERROR nova     sys.exit(main())
Sep 28 13:05:07 ctl02 nova-api[16380]: 2017-09-28 13:05:07.585 16380 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:05:07 ctl02 nova-api[16380]: 2017-09-28 13:05:07.585 16380 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:05:07 ctl02 nova-api[16380]: 2017-09-28 13:05:07.585 16380 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:05:07 ctl02 nova-api[16380]: 2017-09-28 13:05:07.585 16380 ERROR nova     max_url_len=max_url_len)
Sep 28 13:05:07 ctl02 nova-api[16380]: 2017-09-28 13:05:07.585 16380 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:05:07 ctl02 nova-api[16380]: 2017-09-28 13:05:07.585 16380 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:05:07 ctl02 nova-api[16380]: 2017-09-28 13:05:07.585 16380 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:05:07 ctl02 nova-api[16380]: 2017-09-28 13:05:07.585 16380 ERROR nova     sock.listen(backlog)
Sep 28 13:05:07 ctl02 nova-api[16380]: 2017-09-28 13:05:07.585 16380 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:05:07 ctl02 nova-api[16380]: 2017-09-28 13:05:07.585 16380 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:05:07 ctl02 nova-api[16380]: 2017-09-28 13:05:07.585 16380 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:05:07 ctl02 nova-api[16380]: 2017-09-28 13:05:07.585 16380 ERROR nova
Sep 28 13:05:07 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:05:07.709 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:05:07] "OPTIONS / HTTP/1.0" 200 134 0.000477
Sep 28 13:05:07 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:05:07 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:05:07 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:05:07 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:05:07 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:05:07 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:05:07 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:05:08 ctl02 heat-api-cfn[13300]: 2017-09-28 13:05:08.092 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:05:08] "OPTIONS / HTTP/1.0" 200 134 0.000489
Sep 28 13:05:08 ctl02 neutron-server[30536]: 2017-09-28 13:05:08.132 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:05:08] "OPTIONS / HTTP/1.0" 200 262 0.000577
Sep 28 13:05:08 ctl02 heat-api[13008]: 2017-09-28 13:05:08.437 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:05:08] "OPTIONS / HTTP/1.0" 200 134 0.000660
Sep 28 13:05:08 ctl02 heat-api[13008]: 2017-09-28 13:05:08.437 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:05:08] "OPTIONS / HTTP/1.0" 200 134 0.000536
Sep 28 13:05:09 ctl02 nova-api[16403]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:05:09 ctl02 nova-api[16403]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:05:09 ctl02 nova-api[16403]: 2017-09-28 13:05:09.759 16403 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:05:09 ctl02 nova-api[16403]: 2017-09-28 13:05:09.760 16403 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:05:09 ctl02 nova-api[16403]: 2017-09-28 13:05:09.760 16403 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:05:09 ctl02 nova-api[16403]: 2017-09-28 13:05:09.760 16403 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:05:09 ctl02 nova-api[16403]: 2017-09-28 13:05:09.760 16403 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:05:09 ctl02 nova-api[16403]: 2017-09-28 13:05:09.760 16403 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:05:09 ctl02 nova-api[16403]: 2017-09-28 13:05:09.760 16403 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:05:09 ctl02 nova-api[16403]: 2017-09-28 13:05:09.760 16403 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:05:09 ctl02 nova-api[16403]: 2017-09-28 13:05:09.760 16403 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:05:09 ctl02 nova-api[16403]: 2017-09-28 13:05:09.760 16403 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:05:09 ctl02 nova-api[16403]: 2017-09-28 13:05:09.760 16403 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:05:09 ctl02 nova-api[16403]: 2017-09-28 13:05:09.760 16403 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:05:09 ctl02 nova-api[16403]: 2017-09-28 13:05:09.760 16403 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:05:09 ctl02 nova-api[16403]: 2017-09-28 13:05:09.760 16403 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:05:09 ctl02 nova-api[16403]: 2017-09-28 13:05:09.760 16403 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:05:09 ctl02 nova-api[16403]: 2017-09-28 13:05:09.760 16403 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:05:09 ctl02 nova-api[16403]: 2017-09-28 13:05:09.760 16403 ERROR nova.wsgi     self.filename))
Sep 28 13:05:09 ctl02 nova-api[16403]: 2017-09-28 13:05:09.760 16403 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:05:09 ctl02 nova-api[16403]: 2017-09-28 13:05:09.760 16403 ERROR nova.wsgi
Sep 28 13:05:09 ctl02 nova-api[16403]: 2017-09-28 13:05:09.763 16403 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:05:09 ctl02 glance-api[29183]: 2017-09-28 13:05:09.885 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:05:09] "OPTIONS / HTTP/1.0" 200 134 0.000635
Sep 28 13:05:09 ctl02 nova-api[16403]: 2017-09-28 13:05:09.890 16403 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:05:10 ctl02 nova-api[16403]: 2017-09-28 13:05:10.116 16403 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:05:10 ctl02 nova-api[16403]: 2017-09-28 13:05:10.119 16403 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:05:10 ctl02 nova-api[16403]: 2017-09-28 13:05:10.119 16403 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:05:10 ctl02 nova-api[16403]: 2017-09-28 13:05:10.120 16403 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:05:10 ctl02 nova-api[16403]: 2017-09-28 13:05:10.253 16403 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:05:10 ctl02 nova-api[16403]: 2017-09-28 13:05:10.256 16403 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:05:10 ctl02 nova-api[16403]: 2017-09-28 13:05:10.256 16403 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:05:10 ctl02 nova-api[16403]: 2017-09-28 13:05:10.256 16403 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:05:10 ctl02 nova-api[16403]: 2017-09-28 13:05:10.260 16403 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:05:10 ctl02 nova-api[16403]: 2017-09-28 13:05:10.260 16403 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:05:10 ctl02 nova-api[16403]: 2017-09-28 13:05:10.260 16403 ERROR nova Traceback (most recent call last):
Sep 28 13:05:10 ctl02 nova-api[16403]: 2017-09-28 13:05:10.260 16403 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:05:10 ctl02 nova-api[16403]: 2017-09-28 13:05:10.260 16403 ERROR nova     sys.exit(main())
Sep 28 13:05:10 ctl02 nova-api[16403]: 2017-09-28 13:05:10.260 16403 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:05:10 ctl02 nova-api[16403]: 2017-09-28 13:05:10.260 16403 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:05:10 ctl02 nova-api[16403]: 2017-09-28 13:05:10.260 16403 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:05:10 ctl02 nova-api[16403]: 2017-09-28 13:05:10.260 16403 ERROR nova     max_url_len=max_url_len)
Sep 28 13:05:10 ctl02 nova-api[16403]: 2017-09-28 13:05:10.260 16403 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:05:10 ctl02 nova-api[16403]: 2017-09-28 13:05:10.260 16403 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:05:10 ctl02 nova-api[16403]: 2017-09-28 13:05:10.260 16403 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:05:10 ctl02 nova-api[16403]: 2017-09-28 13:05:10.260 16403 ERROR nova     sock.listen(backlog)
Sep 28 13:05:10 ctl02 nova-api[16403]: 2017-09-28 13:05:10.260 16403 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:05:10 ctl02 nova-api[16403]: 2017-09-28 13:05:10.260 16403 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:05:10 ctl02 nova-api[16403]: 2017-09-28 13:05:10.260 16403 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:05:10 ctl02 nova-api[16403]: 2017-09-28 13:05:10.260 16403 ERROR nova
Sep 28 13:05:10 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:05:10 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:05:10 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:05:10 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:05:10.468 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:05:10] "OPTIONS / HTTP/1.0" 200 134 0.000517
Sep 28 13:05:10 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:05:10 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:05:10 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:05:10 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:05:11 ctl02 nova-conductor[5056]: 2017-09-28 13:05:11.333 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:05:11 ctl02 nova-conductor[5056]: 2017-09-28 13:05:11.345 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:05:11 ctl02 nova-conductor[5056]: 2017-09-28 13:05:11.362 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:05:11 ctl02 nova-conductor[5056]: 2017-09-28 13:05:11.362 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:05:11 ctl02 neutron-server[30536]: 2017-09-28 13:05:11.543 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:05:11] "OPTIONS / HTTP/1.0" 200 262 0.000408
Sep 28 13:05:12 ctl02 glance-api[29183]: 2017-09-28 13:05:12.121 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:05:12] "OPTIONS / HTTP/1.0" 200 134 0.000519
Sep 28 13:05:12 ctl02 nova-cert[4860]: 2017-09-28 13:05:12.168 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:05:12 ctl02 nova-api[16421]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:05:12 ctl02 nova-api[16421]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:05:12 ctl02 nova-api[16421]: 2017-09-28 13:05:12.523 16421 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:05:12 ctl02 nova-api[16421]: 2017-09-28 13:05:12.525 16421 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:05:12 ctl02 nova-api[16421]: 2017-09-28 13:05:12.525 16421 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:05:12 ctl02 nova-api[16421]: 2017-09-28 13:05:12.525 16421 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:05:12 ctl02 nova-api[16421]: 2017-09-28 13:05:12.525 16421 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:05:12 ctl02 nova-api[16421]: 2017-09-28 13:05:12.525 16421 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:05:12 ctl02 nova-api[16421]: 2017-09-28 13:05:12.525 16421 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:05:12 ctl02 nova-api[16421]: 2017-09-28 13:05:12.525 16421 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:05:12 ctl02 nova-api[16421]: 2017-09-28 13:05:12.525 16421 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:05:12 ctl02 nova-api[16421]: 2017-09-28 13:05:12.525 16421 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:05:12 ctl02 nova-api[16421]: 2017-09-28 13:05:12.525 16421 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:05:12 ctl02 nova-api[16421]: 2017-09-28 13:05:12.525 16421 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:05:12 ctl02 nova-api[16421]: 2017-09-28 13:05:12.525 16421 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:05:12 ctl02 nova-api[16421]: 2017-09-28 13:05:12.525 16421 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:05:12 ctl02 nova-api[16421]: 2017-09-28 13:05:12.525 16421 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:05:12 ctl02 nova-api[16421]: 2017-09-28 13:05:12.525 16421 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:05:12 ctl02 nova-api[16421]: 2017-09-28 13:05:12.525 16421 ERROR nova.wsgi     self.filename))
Sep 28 13:05:12 ctl02 nova-api[16421]: 2017-09-28 13:05:12.525 16421 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:05:12 ctl02 nova-api[16421]: 2017-09-28 13:05:12.525 16421 ERROR nova.wsgi
Sep 28 13:05:12 ctl02 nova-api[16421]: 2017-09-28 13:05:12.526 16421 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:05:12 ctl02 nova-api[16421]: 2017-09-28 13:05:12.653 16421 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:05:12 ctl02 nova-api[16421]: 2017-09-28 13:05:12.873 16421 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:05:12 ctl02 nova-api[16421]: 2017-09-28 13:05:12.875 16421 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:05:12 ctl02 nova-api[16421]: 2017-09-28 13:05:12.875 16421 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:05:12 ctl02 nova-api[16421]: 2017-09-28 13:05:12.876 16421 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:05:13 ctl02 nova-api[16421]: 2017-09-28 13:05:13.006 16421 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:05:13 ctl02 nova-api[16421]: 2017-09-28 13:05:13.008 16421 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:05:13 ctl02 nova-api[16421]: 2017-09-28 13:05:13.008 16421 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:05:13 ctl02 nova-api[16421]: 2017-09-28 13:05:13.009 16421 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:05:13 ctl02 nova-api[16421]: 2017-09-28 13:05:13.012 16421 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:05:13 ctl02 nova-api[16421]: 2017-09-28 13:05:13.012 16421 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:05:13 ctl02 nova-api[16421]: 2017-09-28 13:05:13.012 16421 ERROR nova Traceback (most recent call last):
Sep 28 13:05:13 ctl02 nova-api[16421]: 2017-09-28 13:05:13.012 16421 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:05:13 ctl02 nova-api[16421]: 2017-09-28 13:05:13.012 16421 ERROR nova     sys.exit(main())
Sep 28 13:05:13 ctl02 nova-api[16421]: 2017-09-28 13:05:13.012 16421 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:05:13 ctl02 nova-api[16421]: 2017-09-28 13:05:13.012 16421 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:05:13 ctl02 nova-api[16421]: 2017-09-28 13:05:13.012 16421 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:05:13 ctl02 nova-api[16421]: 2017-09-28 13:05:13.012 16421 ERROR nova     max_url_len=max_url_len)
Sep 28 13:05:13 ctl02 nova-api[16421]: 2017-09-28 13:05:13.012 16421 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:05:13 ctl02 nova-api[16421]: 2017-09-28 13:05:13.012 16421 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:05:13 ctl02 nova-api[16421]: 2017-09-28 13:05:13.012 16421 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:05:13 ctl02 nova-api[16421]: 2017-09-28 13:05:13.012 16421 ERROR nova     sock.listen(backlog)
Sep 28 13:05:13 ctl02 nova-api[16421]: 2017-09-28 13:05:13.012 16421 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:05:13 ctl02 nova-api[16421]: 2017-09-28 13:05:13.012 16421 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:05:13 ctl02 nova-api[16421]: 2017-09-28 13:05:13.012 16421 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:05:13 ctl02 nova-api[16421]: 2017-09-28 13:05:13.012 16421 ERROR nova
Sep 28 13:05:13 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:05:13 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:05:13 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:05:13 ctl02 heat-api[13008]: 2017-09-28 13:05:13.213 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:05:13] "OPTIONS / HTTP/1.0" 200 134 0.000652
Sep 28 13:05:13 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:05:13 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:05:13 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:05:13 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:05:13 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:05:13.769 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:05:13] "OPTIONS / HTTP/1.0" 200 134 0.000581
Sep 28 13:05:14 ctl02 glance-api[29183]: 2017-09-28 13:05:14.062 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:05:14] "OPTIONS / HTTP/1.0" 200 134 0.000572
Sep 28 13:05:14 ctl02 heat-api-cfn[13300]: 2017-09-28 13:05:14.428 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:05:14] "OPTIONS / HTTP/1.0" 200 134 0.000601
Sep 28 13:05:14 ctl02 neutron-server[30536]: 2017-09-28 13:05:14.738 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:05:14] "OPTIONS / HTTP/1.0" 200 262 0.000512
Sep 28 13:05:15 ctl02 nova-api[16439]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:05:15 ctl02 nova-api[16439]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:05:15 ctl02 nova-api[16439]: 2017-09-28 13:05:15.288 16439 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:05:15 ctl02 nova-api[16439]: 2017-09-28 13:05:15.289 16439 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:05:15 ctl02 nova-api[16439]: 2017-09-28 13:05:15.289 16439 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:05:15 ctl02 nova-api[16439]: 2017-09-28 13:05:15.289 16439 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:05:15 ctl02 nova-api[16439]: 2017-09-28 13:05:15.289 16439 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:05:15 ctl02 nova-api[16439]: 2017-09-28 13:05:15.289 16439 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:05:15 ctl02 nova-api[16439]: 2017-09-28 13:05:15.289 16439 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:05:15 ctl02 nova-api[16439]: 2017-09-28 13:05:15.289 16439 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:05:15 ctl02 nova-api[16439]: 2017-09-28 13:05:15.289 16439 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:05:15 ctl02 nova-api[16439]: 2017-09-28 13:05:15.289 16439 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:05:15 ctl02 nova-api[16439]: 2017-09-28 13:05:15.289 16439 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:05:15 ctl02 nova-api[16439]: 2017-09-28 13:05:15.289 16439 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:05:15 ctl02 nova-api[16439]: 2017-09-28 13:05:15.289 16439 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:05:15 ctl02 nova-api[16439]: 2017-09-28 13:05:15.289 16439 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:05:15 ctl02 nova-api[16439]: 2017-09-28 13:05:15.289 16439 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:05:15 ctl02 nova-api[16439]: 2017-09-28 13:05:15.289 16439 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:05:15 ctl02 nova-api[16439]: 2017-09-28 13:05:15.289 16439 ERROR nova.wsgi     self.filename))
Sep 28 13:05:15 ctl02 nova-api[16439]: 2017-09-28 13:05:15.289 16439 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:05:15 ctl02 nova-api[16439]: 2017-09-28 13:05:15.289 16439 ERROR nova.wsgi
Sep 28 13:05:15 ctl02 nova-api[16439]: 2017-09-28 13:05:15.290 16439 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:05:15 ctl02 nova-api[16439]: 2017-09-28 13:05:15.419 16439 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:05:15 ctl02 nova-api[16439]: 2017-09-28 13:05:15.646 16439 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:05:15 ctl02 nova-api[16439]: 2017-09-28 13:05:15.648 16439 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:05:15 ctl02 nova-api[16439]: 2017-09-28 13:05:15.648 16439 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:05:15 ctl02 nova-api[16439]: 2017-09-28 13:05:15.649 16439 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:05:15 ctl02 nova-api[16439]: 2017-09-28 13:05:15.779 16439 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:05:15 ctl02 nova-api[16439]: 2017-09-28 13:05:15.780 16439 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:05:15 ctl02 nova-api[16439]: 2017-09-28 13:05:15.781 16439 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:05:15 ctl02 nova-api[16439]: 2017-09-28 13:05:15.781 16439 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:05:15 ctl02 nova-api[16439]: 2017-09-28 13:05:15.784 16439 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:05:15 ctl02 nova-api[16439]: 2017-09-28 13:05:15.784 16439 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:05:15 ctl02 nova-api[16439]: 2017-09-28 13:05:15.784 16439 ERROR nova Traceback (most recent call last):
Sep 28 13:05:15 ctl02 nova-api[16439]: 2017-09-28 13:05:15.784 16439 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:05:15 ctl02 nova-api[16439]: 2017-09-28 13:05:15.784 16439 ERROR nova     sys.exit(main())
Sep 28 13:05:15 ctl02 nova-api[16439]: 2017-09-28 13:05:15.784 16439 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:05:15 ctl02 nova-api[16439]: 2017-09-28 13:05:15.784 16439 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:05:15 ctl02 nova-api[16439]: 2017-09-28 13:05:15.784 16439 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:05:15 ctl02 nova-api[16439]: 2017-09-28 13:05:15.784 16439 ERROR nova     max_url_len=max_url_len)
Sep 28 13:05:15 ctl02 nova-api[16439]: 2017-09-28 13:05:15.784 16439 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:05:15 ctl02 nova-api[16439]: 2017-09-28 13:05:15.784 16439 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:05:15 ctl02 nova-api[16439]: 2017-09-28 13:05:15.784 16439 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:05:15 ctl02 nova-api[16439]: 2017-09-28 13:05:15.784 16439 ERROR nova     sock.listen(backlog)
Sep 28 13:05:15 ctl02 nova-api[16439]: 2017-09-28 13:05:15.784 16439 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:05:15 ctl02 nova-api[16439]: 2017-09-28 13:05:15.784 16439 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:05:15 ctl02 nova-api[16439]: 2017-09-28 13:05:15.784 16439 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:05:15 ctl02 nova-api[16439]: 2017-09-28 13:05:15.784 16439 ERROR nova
Sep 28 13:05:15 ctl02 dhclient[600]: DHCPREQUEST of 192.168.11.25 on ens2 to 192.168.11.3 port 67 (xid=0x3415f07)
Sep 28 13:05:15 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:05:15 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:05:15 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:05:15 ctl02 dhclient[600]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 13:05:16 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 13:05:16 ctl02 ntp[16506]:  * Stopping NTP server ntpd
Sep 28 13:05:16 ctl02 ntp[16506]:    ...done.
Sep 28 13:05:16 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 13:05:16 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 13:05:16 ctl02 ntp[16517]:  * Starting NTP server ntpd
Sep 28 13:05:16 ctl02 ntpd[16524]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 13:05:16 ctl02 ntpd[16524]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -c /var/lib/ntp/ntp.conf.dhcp -u 108:112
Sep 28 13:05:16 ctl02 ntp[16517]:    ...done.
Sep 28 13:05:16 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 13:05:16 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:05:16 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:05:16 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:05:16 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:05:16 ctl02 ntpd[16527]: proto: precision = 0.042 usec (-24)
Sep 28 13:05:16 ctl02 ntpd[16527]: switching logging to file /var/log/ntp.log
Sep 28 13:05:16 ctl02 dhclient[600]: bound to 192.168.11.25 -- renewal in 248 seconds.
Sep 28 13:05:16 ctl02 heat-api-cfn[13300]: 2017-09-28 13:05:16.650 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:05:16] "OPTIONS / HTTP/1.0" 200 134 0.000457
Sep 28 13:05:17 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:05:17.427 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:05:17] "OPTIONS / HTTP/1.0" 200 134 0.000442
Sep 28 13:05:17 ctl02 nova-api[16539]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:05:17 ctl02 nova-api[16539]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:05:17 ctl02 nova-api[16539]: 2017-09-28 13:05:17.880 16539 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:05:17 ctl02 nova-api[16539]: 2017-09-28 13:05:17.882 16539 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:05:17 ctl02 nova-api[16539]: 2017-09-28 13:05:17.882 16539 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:05:17 ctl02 nova-api[16539]: 2017-09-28 13:05:17.882 16539 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:05:17 ctl02 nova-api[16539]: 2017-09-28 13:05:17.882 16539 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:05:17 ctl02 nova-api[16539]: 2017-09-28 13:05:17.882 16539 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:05:17 ctl02 nova-api[16539]: 2017-09-28 13:05:17.882 16539 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:05:17 ctl02 nova-api[16539]: 2017-09-28 13:05:17.882 16539 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:05:17 ctl02 nova-api[16539]: 2017-09-28 13:05:17.882 16539 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:05:17 ctl02 nova-api[16539]: 2017-09-28 13:05:17.882 16539 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:05:17 ctl02 nova-api[16539]: 2017-09-28 13:05:17.882 16539 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:05:17 ctl02 nova-api[16539]: 2017-09-28 13:05:17.882 16539 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:05:17 ctl02 nova-api[16539]: 2017-09-28 13:05:17.882 16539 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:05:17 ctl02 nova-api[16539]: 2017-09-28 13:05:17.882 16539 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:05:17 ctl02 nova-api[16539]: 2017-09-28 13:05:17.882 16539 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:05:17 ctl02 nova-api[16539]: 2017-09-28 13:05:17.882 16539 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:05:17 ctl02 nova-api[16539]: 2017-09-28 13:05:17.882 16539 ERROR nova.wsgi     self.filename))
Sep 28 13:05:17 ctl02 nova-api[16539]: 2017-09-28 13:05:17.882 16539 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:05:17 ctl02 nova-api[16539]: 2017-09-28 13:05:17.882 16539 ERROR nova.wsgi
Sep 28 13:05:17 ctl02 nova-api[16539]: 2017-09-28 13:05:17.884 16539 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:05:18 ctl02 nova-api[16539]: 2017-09-28 13:05:18.018 16539 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:05:18 ctl02 heat-api-cfn[13300]: 2017-09-28 13:05:18.041 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:05:18] "OPTIONS / HTTP/1.0" 200 134 0.000657
Sep 28 13:05:18 ctl02 heat-api[13008]: 2017-09-28 13:05:18.107 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:05:18] "OPTIONS / HTTP/1.0" 200 134 0.000531
Sep 28 13:05:18 ctl02 nova-api[16539]: 2017-09-28 13:05:18.251 16539 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:05:18 ctl02 nova-api[16539]: 2017-09-28 13:05:18.254 16539 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:05:18 ctl02 nova-api[16539]: 2017-09-28 13:05:18.254 16539 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:05:18 ctl02 nova-api[16539]: 2017-09-28 13:05:18.254 16539 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:05:18 ctl02 neutron-server[30536]: 2017-09-28 13:05:18.308 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:05:18] "OPTIONS / HTTP/1.0" 200 262 0.000475
Sep 28 13:05:18 ctl02 nova-api[16539]: 2017-09-28 13:05:18.400 16539 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:05:18 ctl02 nova-api[16539]: 2017-09-28 13:05:18.402 16539 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:05:18 ctl02 nova-api[16539]: 2017-09-28 13:05:18.402 16539 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:05:18 ctl02 nova-api[16539]: 2017-09-28 13:05:18.403 16539 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:05:18 ctl02 nova-api[16539]: 2017-09-28 13:05:18.406 16539 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:05:18 ctl02 nova-api[16539]: 2017-09-28 13:05:18.407 16539 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:05:18 ctl02 nova-api[16539]: 2017-09-28 13:05:18.407 16539 ERROR nova Traceback (most recent call last):
Sep 28 13:05:18 ctl02 nova-api[16539]: 2017-09-28 13:05:18.407 16539 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:05:18 ctl02 nova-api[16539]: 2017-09-28 13:05:18.407 16539 ERROR nova     sys.exit(main())
Sep 28 13:05:18 ctl02 nova-api[16539]: 2017-09-28 13:05:18.407 16539 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:05:18 ctl02 nova-api[16539]: 2017-09-28 13:05:18.407 16539 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:05:18 ctl02 nova-api[16539]: 2017-09-28 13:05:18.407 16539 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:05:18 ctl02 nova-api[16539]: 2017-09-28 13:05:18.407 16539 ERROR nova     max_url_len=max_url_len)
Sep 28 13:05:18 ctl02 nova-api[16539]: 2017-09-28 13:05:18.407 16539 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:05:18 ctl02 nova-api[16539]: 2017-09-28 13:05:18.407 16539 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:05:18 ctl02 nova-api[16539]: 2017-09-28 13:05:18.407 16539 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:05:18 ctl02 nova-api[16539]: 2017-09-28 13:05:18.407 16539 ERROR nova     sock.listen(backlog)
Sep 28 13:05:18 ctl02 nova-api[16539]: 2017-09-28 13:05:18.407 16539 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:05:18 ctl02 nova-api[16539]: 2017-09-28 13:05:18.407 16539 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:05:18 ctl02 nova-api[16539]: 2017-09-28 13:05:18.407 16539 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:05:18 ctl02 nova-api[16539]: 2017-09-28 13:05:18.407 16539 ERROR nova
Sep 28 13:05:18 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:05:18 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:05:18 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:05:18 ctl02 heat-api[13008]: 2017-09-28 13:05:18.759 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:05:18] "OPTIONS / HTTP/1.0" 200 134 0.000649
Sep 28 13:05:18 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:05:18 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:05:18 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:05:18 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:05:20 ctl02 glance-api[29183]: 2017-09-28 13:05:20.146 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:05:20] "OPTIONS / HTTP/1.0" 200 134 0.000675
Sep 28 13:05:20 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:05:20.555 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:05:20] "OPTIONS / HTTP/1.0" 200 134 0.000427
Sep 28 13:05:20 ctl02 nova-api[16556]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:05:20 ctl02 nova-api[16556]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:05:20 ctl02 nova-api[16556]: 2017-09-28 13:05:20.783 16556 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:05:20 ctl02 nova-api[16556]: 2017-09-28 13:05:20.785 16556 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:05:20 ctl02 nova-api[16556]: 2017-09-28 13:05:20.785 16556 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:05:20 ctl02 nova-api[16556]: 2017-09-28 13:05:20.785 16556 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:05:20 ctl02 nova-api[16556]: 2017-09-28 13:05:20.785 16556 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:05:20 ctl02 nova-api[16556]: 2017-09-28 13:05:20.785 16556 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:05:20 ctl02 nova-api[16556]: 2017-09-28 13:05:20.785 16556 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:05:20 ctl02 nova-api[16556]: 2017-09-28 13:05:20.785 16556 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:05:20 ctl02 nova-api[16556]: 2017-09-28 13:05:20.785 16556 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:05:20 ctl02 nova-api[16556]: 2017-09-28 13:05:20.785 16556 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:05:20 ctl02 nova-api[16556]: 2017-09-28 13:05:20.785 16556 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:05:20 ctl02 nova-api[16556]: 2017-09-28 13:05:20.785 16556 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:05:20 ctl02 nova-api[16556]: 2017-09-28 13:05:20.785 16556 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:05:20 ctl02 nova-api[16556]: 2017-09-28 13:05:20.785 16556 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:05:20 ctl02 nova-api[16556]: 2017-09-28 13:05:20.785 16556 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:05:20 ctl02 nova-api[16556]: 2017-09-28 13:05:20.785 16556 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:05:20 ctl02 nova-api[16556]: 2017-09-28 13:05:20.785 16556 ERROR nova.wsgi     self.filename))
Sep 28 13:05:20 ctl02 nova-api[16556]: 2017-09-28 13:05:20.785 16556 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:05:20 ctl02 nova-api[16556]: 2017-09-28 13:05:20.785 16556 ERROR nova.wsgi
Sep 28 13:05:20 ctl02 nova-api[16556]: 2017-09-28 13:05:20.786 16556 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:05:20 ctl02 nova-api[16556]: 2017-09-28 13:05:20.919 16556 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:05:20 ctl02 neutron-server[30536]: 2017-09-28 13:05:20.987 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 2 dead agents out of 6:
Sep 28 13:05:20 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 13:05:20 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 13:04:30 cmp002
Sep 28 13:05:20 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 13:03:36 cmp002
Sep 28 13:05:21 ctl02 nova-api[16556]: 2017-09-28 13:05:21.153 16556 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:05:21 ctl02 nova-api[16556]: 2017-09-28 13:05:21.156 16556 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:05:21 ctl02 nova-api[16556]: 2017-09-28 13:05:21.166 16556 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:05:21 ctl02 nova-api[16556]: 2017-09-28 13:05:21.166 16556 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:05:21 ctl02 nova-api[16556]: 2017-09-28 13:05:21.300 16556 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:05:21 ctl02 nova-api[16556]: 2017-09-28 13:05:21.302 16556 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:05:21 ctl02 nova-api[16556]: 2017-09-28 13:05:21.302 16556 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:05:21 ctl02 nova-api[16556]: 2017-09-28 13:05:21.302 16556 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:05:21 ctl02 nova-api[16556]: 2017-09-28 13:05:21.305 16556 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:05:21 ctl02 nova-api[16556]: 2017-09-28 13:05:21.306 16556 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:05:21 ctl02 nova-api[16556]: 2017-09-28 13:05:21.306 16556 ERROR nova Traceback (most recent call last):
Sep 28 13:05:21 ctl02 nova-api[16556]: 2017-09-28 13:05:21.306 16556 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:05:21 ctl02 nova-api[16556]: 2017-09-28 13:05:21.306 16556 ERROR nova     sys.exit(main())
Sep 28 13:05:21 ctl02 nova-api[16556]: 2017-09-28 13:05:21.306 16556 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:05:21 ctl02 nova-api[16556]: 2017-09-28 13:05:21.306 16556 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:05:21 ctl02 nova-api[16556]: 2017-09-28 13:05:21.306 16556 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:05:21 ctl02 nova-api[16556]: 2017-09-28 13:05:21.306 16556 ERROR nova     max_url_len=max_url_len)
Sep 28 13:05:21 ctl02 nova-api[16556]: 2017-09-28 13:05:21.306 16556 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:05:21 ctl02 nova-api[16556]: 2017-09-28 13:05:21.306 16556 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:05:21 ctl02 nova-api[16556]: 2017-09-28 13:05:21.306 16556 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:05:21 ctl02 nova-api[16556]: 2017-09-28 13:05:21.306 16556 ERROR nova     sock.listen(backlog)
Sep 28 13:05:21 ctl02 nova-api[16556]: 2017-09-28 13:05:21.306 16556 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:05:21 ctl02 nova-api[16556]: 2017-09-28 13:05:21.306 16556 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:05:21 ctl02 nova-api[16556]: 2017-09-28 13:05:21.306 16556 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:05:21 ctl02 nova-api[16556]: 2017-09-28 13:05:21.306 16556 ERROR nova
Sep 28 13:05:21 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:05:21 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:05:21 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:05:21 ctl02 neutron-server[30536]: 2017-09-28 13:05:21.543 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:05:21] "OPTIONS / HTTP/1.0" 200 262 0.000408
Sep 28 13:05:21 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:05:21 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:05:21 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:05:21 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:05:21 ctl02 glance-api[29183]: 2017-09-28 13:05:21.851 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:05:21] "OPTIONS / HTTP/1.0" 200 134 0.000665
Sep 28 13:05:22 ctl02 nova-consoleauth[5433]: 2017-09-28 13:05:22.019 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:05:22 ctl02 heat-engine[12803]: 2017-09-28 13:05:22.468 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:05:22 ctl02 heat-engine[12803]: 2017-09-28 13:05:22.486 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:05:22 ctl02 heat-engine[12803]: 2017-09-28 13:05:22.490 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:05:22 ctl02 heat-engine[12803]: 2017-09-28 13:05:22.492 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:05:22 ctl02 heat-api[13008]: 2017-09-28 13:05:22.922 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:05:22] "OPTIONS / HTTP/1.0" 200 134 0.000596
Sep 28 13:05:23 ctl02 nova-api[16575]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:05:23 ctl02 nova-api[16575]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:05:23 ctl02 nova-api[16575]: 2017-09-28 13:05:23.576 16575 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:05:23 ctl02 nova-api[16575]: 2017-09-28 13:05:23.578 16575 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:05:23 ctl02 nova-api[16575]: 2017-09-28 13:05:23.578 16575 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:05:23 ctl02 nova-api[16575]: 2017-09-28 13:05:23.578 16575 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:05:23 ctl02 nova-api[16575]: 2017-09-28 13:05:23.578 16575 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:05:23 ctl02 nova-api[16575]: 2017-09-28 13:05:23.578 16575 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:05:23 ctl02 nova-api[16575]: 2017-09-28 13:05:23.578 16575 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:05:23 ctl02 nova-api[16575]: 2017-09-28 13:05:23.578 16575 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:05:23 ctl02 nova-api[16575]: 2017-09-28 13:05:23.578 16575 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:05:23 ctl02 nova-api[16575]: 2017-09-28 13:05:23.578 16575 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:05:23 ctl02 nova-api[16575]: 2017-09-28 13:05:23.578 16575 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:05:23 ctl02 nova-api[16575]: 2017-09-28 13:05:23.578 16575 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:05:23 ctl02 nova-api[16575]: 2017-09-28 13:05:23.578 16575 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:05:23 ctl02 nova-api[16575]: 2017-09-28 13:05:23.578 16575 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:05:23 ctl02 nova-api[16575]: 2017-09-28 13:05:23.578 16575 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:05:23 ctl02 nova-api[16575]: 2017-09-28 13:05:23.578 16575 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:05:23 ctl02 nova-api[16575]: 2017-09-28 13:05:23.578 16575 ERROR nova.wsgi     self.filename))
Sep 28 13:05:23 ctl02 nova-api[16575]: 2017-09-28 13:05:23.578 16575 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:05:23 ctl02 nova-api[16575]: 2017-09-28 13:05:23.578 16575 ERROR nova.wsgi
Sep 28 13:05:23 ctl02 nova-api[16575]: 2017-09-28 13:05:23.580 16575 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:05:23 ctl02 glance-api[29183]: 2017-09-28 13:05:23.703 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:05:23] "OPTIONS / HTTP/1.0" 200 134 0.000669
Sep 28 13:05:23 ctl02 nova-api[16575]: 2017-09-28 13:05:23.715 16575 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:05:23 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:05:23.860 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:05:23] "OPTIONS / HTTP/1.0" 200 134 0.000472
Sep 28 13:05:23 ctl02 nova-api[16575]: 2017-09-28 13:05:23.967 16575 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:05:23 ctl02 nova-api[16575]: 2017-09-28 13:05:23.970 16575 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:05:23 ctl02 nova-api[16575]: 2017-09-28 13:05:23.970 16575 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:05:23 ctl02 nova-api[16575]: 2017-09-28 13:05:23.970 16575 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:05:24 ctl02 nova-api[16575]: 2017-09-28 13:05:24.108 16575 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:05:24 ctl02 nova-api[16575]: 2017-09-28 13:05:24.110 16575 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:05:24 ctl02 nova-api[16575]: 2017-09-28 13:05:24.110 16575 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:05:24 ctl02 nova-api[16575]: 2017-09-28 13:05:24.110 16575 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:05:24 ctl02 nova-api[16575]: 2017-09-28 13:05:24.114 16575 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:05:24 ctl02 nova-api[16575]: 2017-09-28 13:05:24.114 16575 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:05:24 ctl02 nova-api[16575]: 2017-09-28 13:05:24.114 16575 ERROR nova Traceback (most recent call last):
Sep 28 13:05:24 ctl02 nova-api[16575]: 2017-09-28 13:05:24.114 16575 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:05:24 ctl02 nova-api[16575]: 2017-09-28 13:05:24.114 16575 ERROR nova     sys.exit(main())
Sep 28 13:05:24 ctl02 nova-api[16575]: 2017-09-28 13:05:24.114 16575 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:05:24 ctl02 nova-api[16575]: 2017-09-28 13:05:24.114 16575 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:05:24 ctl02 nova-api[16575]: 2017-09-28 13:05:24.114 16575 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:05:24 ctl02 nova-api[16575]: 2017-09-28 13:05:24.114 16575 ERROR nova     max_url_len=max_url_len)
Sep 28 13:05:24 ctl02 nova-api[16575]: 2017-09-28 13:05:24.114 16575 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:05:24 ctl02 nova-api[16575]: 2017-09-28 13:05:24.114 16575 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:05:24 ctl02 nova-api[16575]: 2017-09-28 13:05:24.114 16575 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:05:24 ctl02 nova-api[16575]: 2017-09-28 13:05:24.114 16575 ERROR nova     sock.listen(backlog)
Sep 28 13:05:24 ctl02 nova-api[16575]: 2017-09-28 13:05:24.114 16575 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:05:24 ctl02 nova-api[16575]: 2017-09-28 13:05:24.114 16575 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:05:24 ctl02 nova-api[16575]: 2017-09-28 13:05:24.114 16575 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:05:24 ctl02 nova-api[16575]: 2017-09-28 13:05:24.114 16575 ERROR nova
Sep 28 13:05:24 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:05:24 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:05:24 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:05:24 ctl02 neutron-server[30536]: 2017-09-28 13:05:24.358 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:05:24] "OPTIONS / HTTP/1.0" 200 262 0.000587
Sep 28 13:05:24 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:05:24 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:05:24 ctl02 heat-api-cfn[13300]: 2017-09-28 13:05:24.647 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:05:24] "OPTIONS / HTTP/1.0" 200 134 0.000600
Sep 28 13:05:24 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:05:24 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:05:25 ctl02 nova-scheduler[5620]: 2017-09-28 13:05:25.134 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:05:25 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5e26822e)
Sep 28 13:05:26 ctl02 nova-api[16593]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:05:26 ctl02 nova-api[16593]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:05:26 ctl02 nova-api[16593]: 2017-09-28 13:05:26.527 16593 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:05:26 ctl02 nova-api[16593]: 2017-09-28 13:05:26.529 16593 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:05:26 ctl02 nova-api[16593]: 2017-09-28 13:05:26.529 16593 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:05:26 ctl02 nova-api[16593]: 2017-09-28 13:05:26.529 16593 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:05:26 ctl02 nova-api[16593]: 2017-09-28 13:05:26.529 16593 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:05:26 ctl02 nova-api[16593]: 2017-09-28 13:05:26.529 16593 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:05:26 ctl02 nova-api[16593]: 2017-09-28 13:05:26.529 16593 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:05:26 ctl02 nova-api[16593]: 2017-09-28 13:05:26.529 16593 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:05:26 ctl02 nova-api[16593]: 2017-09-28 13:05:26.529 16593 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:05:26 ctl02 nova-api[16593]: 2017-09-28 13:05:26.529 16593 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:05:26 ctl02 nova-api[16593]: 2017-09-28 13:05:26.529 16593 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:05:26 ctl02 nova-api[16593]: 2017-09-28 13:05:26.529 16593 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:05:26 ctl02 nova-api[16593]: 2017-09-28 13:05:26.529 16593 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:05:26 ctl02 nova-api[16593]: 2017-09-28 13:05:26.529 16593 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:05:26 ctl02 nova-api[16593]: 2017-09-28 13:05:26.529 16593 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:05:26 ctl02 nova-api[16593]: 2017-09-28 13:05:26.529 16593 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:05:26 ctl02 nova-api[16593]: 2017-09-28 13:05:26.529 16593 ERROR nova.wsgi     self.filename))
Sep 28 13:05:26 ctl02 nova-api[16593]: 2017-09-28 13:05:26.529 16593 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:05:26 ctl02 nova-api[16593]: 2017-09-28 13:05:26.529 16593 ERROR nova.wsgi
Sep 28 13:05:26 ctl02 nova-api[16593]: 2017-09-28 13:05:26.531 16593 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:05:26 ctl02 nova-api[16593]: 2017-09-28 13:05:26.661 16593 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:05:26 ctl02 nova-api[16593]: 2017-09-28 13:05:26.885 16593 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:05:26 ctl02 nova-api[16593]: 2017-09-28 13:05:26.887 16593 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:05:26 ctl02 nova-api[16593]: 2017-09-28 13:05:26.888 16593 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:05:26 ctl02 nova-api[16593]: 2017-09-28 13:05:26.888 16593 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:05:26 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5e26822e)
Sep 28 13:05:27 ctl02 heat-api-cfn[13300]: 2017-09-28 13:05:26.971 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:05:26] "OPTIONS / HTTP/1.0" 200 134 0.000438
Sep 28 13:05:27 ctl02 nova-api[16593]: 2017-09-28 13:05:27.022 16593 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:05:27 ctl02 nova-api[16593]: 2017-09-28 13:05:27.025 16593 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:05:27 ctl02 nova-api[16593]: 2017-09-28 13:05:27.025 16593 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:05:27 ctl02 nova-api[16593]: 2017-09-28 13:05:27.025 16593 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:05:27 ctl02 nova-api[16593]: 2017-09-28 13:05:27.029 16593 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:05:27 ctl02 nova-api[16593]: 2017-09-28 13:05:27.029 16593 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:05:27 ctl02 nova-api[16593]: 2017-09-28 13:05:27.029 16593 ERROR nova Traceback (most recent call last):
Sep 28 13:05:27 ctl02 nova-api[16593]: 2017-09-28 13:05:27.029 16593 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:05:27 ctl02 nova-api[16593]: 2017-09-28 13:05:27.029 16593 ERROR nova     sys.exit(main())
Sep 28 13:05:27 ctl02 nova-api[16593]: 2017-09-28 13:05:27.029 16593 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:05:27 ctl02 nova-api[16593]: 2017-09-28 13:05:27.029 16593 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:05:27 ctl02 nova-api[16593]: 2017-09-28 13:05:27.029 16593 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:05:27 ctl02 nova-api[16593]: 2017-09-28 13:05:27.029 16593 ERROR nova     max_url_len=max_url_len)
Sep 28 13:05:27 ctl02 nova-api[16593]: 2017-09-28 13:05:27.029 16593 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:05:27 ctl02 nova-api[16593]: 2017-09-28 13:05:27.029 16593 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:05:27 ctl02 nova-api[16593]: 2017-09-28 13:05:27.029 16593 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:05:27 ctl02 nova-api[16593]: 2017-09-28 13:05:27.029 16593 ERROR nova     sock.listen(backlog)
Sep 28 13:05:27 ctl02 nova-api[16593]: 2017-09-28 13:05:27.029 16593 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:05:27 ctl02 nova-api[16593]: 2017-09-28 13:05:27.029 16593 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:05:27 ctl02 nova-api[16593]: 2017-09-28 13:05:27.029 16593 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:05:27 ctl02 nova-api[16593]: 2017-09-28 13:05:27.029 16593 ERROR nova
Sep 28 13:05:27 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:05:27 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:05:27 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:05:27 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:05:27 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:05:27 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:05:27 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:05:27 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:05:27.605 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:05:27] "OPTIONS / HTTP/1.0" 200 134 0.000485
Sep 28 13:05:27 ctl02 heat-api-cfn[13300]: 2017-09-28 13:05:27.684 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:05:27] "OPTIONS / HTTP/1.0" 200 134 0.000524
Sep 28 13:05:27 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5e26822e)
Sep 28 13:05:28 ctl02 neutron-server[30536]: 2017-09-28 13:05:28.200 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:05:28] "OPTIONS / HTTP/1.0" 200 262 0.000501
Sep 28 13:05:28 ctl02 heat-api[13008]: 2017-09-28 13:05:28.447 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:05:28] "OPTIONS / HTTP/1.0" 200 134 0.000614
Sep 28 13:05:28 ctl02 heat-api[13008]: 2017-09-28 13:05:28.845 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:05:28] "OPTIONS / HTTP/1.0" 200 134 0.000597
Sep 28 13:05:28 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5e26822e)
Sep 28 13:05:29 ctl02 nova-api[16611]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:05:29 ctl02 nova-api[16611]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:05:29 ctl02 nova-api[16611]: 2017-09-28 13:05:29.286 16611 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:05:29 ctl02 nova-api[16611]: 2017-09-28 13:05:29.287 16611 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:05:29 ctl02 nova-api[16611]: 2017-09-28 13:05:29.287 16611 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:05:29 ctl02 nova-api[16611]: 2017-09-28 13:05:29.287 16611 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:05:29 ctl02 nova-api[16611]: 2017-09-28 13:05:29.287 16611 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:05:29 ctl02 nova-api[16611]: 2017-09-28 13:05:29.287 16611 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:05:29 ctl02 nova-api[16611]: 2017-09-28 13:05:29.287 16611 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:05:29 ctl02 nova-api[16611]: 2017-09-28 13:05:29.287 16611 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:05:29 ctl02 nova-api[16611]: 2017-09-28 13:05:29.287 16611 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:05:29 ctl02 nova-api[16611]: 2017-09-28 13:05:29.287 16611 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:05:29 ctl02 nova-api[16611]: 2017-09-28 13:05:29.287 16611 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:05:29 ctl02 nova-api[16611]: 2017-09-28 13:05:29.287 16611 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:05:29 ctl02 nova-api[16611]: 2017-09-28 13:05:29.287 16611 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:05:29 ctl02 nova-api[16611]: 2017-09-28 13:05:29.287 16611 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:05:29 ctl02 nova-api[16611]: 2017-09-28 13:05:29.287 16611 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:05:29 ctl02 nova-api[16611]: 2017-09-28 13:05:29.287 16611 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:05:29 ctl02 nova-api[16611]: 2017-09-28 13:05:29.287 16611 ERROR nova.wsgi     self.filename))
Sep 28 13:05:29 ctl02 nova-api[16611]: 2017-09-28 13:05:29.287 16611 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:05:29 ctl02 nova-api[16611]: 2017-09-28 13:05:29.287 16611 ERROR nova.wsgi
Sep 28 13:05:29 ctl02 nova-api[16611]: 2017-09-28 13:05:29.288 16611 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:05:29 ctl02 nova-api[16611]: 2017-09-28 13:05:29.427 16611 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:05:29 ctl02 nova-api[16611]: 2017-09-28 13:05:29.680 16611 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:05:29 ctl02 nova-api[16611]: 2017-09-28 13:05:29.683 16611 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:05:29 ctl02 nova-api[16611]: 2017-09-28 13:05:29.683 16611 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:05:29 ctl02 nova-api[16611]: 2017-09-28 13:05:29.683 16611 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:05:29 ctl02 nova-api[16611]: 2017-09-28 13:05:29.819 16611 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:05:29 ctl02 nova-api[16611]: 2017-09-28 13:05:29.821 16611 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:05:29 ctl02 nova-api[16611]: 2017-09-28 13:05:29.822 16611 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:05:29 ctl02 nova-api[16611]: 2017-09-28 13:05:29.822 16611 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:05:29 ctl02 nova-api[16611]: 2017-09-28 13:05:29.825 16611 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:05:29 ctl02 nova-api[16611]: 2017-09-28 13:05:29.826 16611 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:05:29 ctl02 nova-api[16611]: 2017-09-28 13:05:29.826 16611 ERROR nova Traceback (most recent call last):
Sep 28 13:05:29 ctl02 nova-api[16611]: 2017-09-28 13:05:29.826 16611 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:05:29 ctl02 nova-api[16611]: 2017-09-28 13:05:29.826 16611 ERROR nova     sys.exit(main())
Sep 28 13:05:29 ctl02 nova-api[16611]: 2017-09-28 13:05:29.826 16611 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:05:29 ctl02 nova-api[16611]: 2017-09-28 13:05:29.826 16611 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:05:29 ctl02 nova-api[16611]: 2017-09-28 13:05:29.826 16611 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:05:29 ctl02 nova-api[16611]: 2017-09-28 13:05:29.826 16611 ERROR nova     max_url_len=max_url_len)
Sep 28 13:05:29 ctl02 nova-api[16611]: 2017-09-28 13:05:29.826 16611 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:05:29 ctl02 nova-api[16611]: 2017-09-28 13:05:29.826 16611 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:05:29 ctl02 nova-api[16611]: 2017-09-28 13:05:29.826 16611 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:05:29 ctl02 nova-api[16611]: 2017-09-28 13:05:29.826 16611 ERROR nova     sock.listen(backlog)
Sep 28 13:05:29 ctl02 nova-api[16611]: 2017-09-28 13:05:29.826 16611 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:05:29 ctl02 nova-api[16611]: 2017-09-28 13:05:29.826 16611 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:05:29 ctl02 nova-api[16611]: 2017-09-28 13:05:29.826 16611 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:05:29 ctl02 nova-api[16611]: 2017-09-28 13:05:29.826 16611 ERROR nova
Sep 28 13:05:29 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5e26822e)
Sep 28 13:05:29 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:05:29 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:05:29 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:05:30 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:05:30 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:05:30 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:05:30 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:05:30 ctl02 glance-api[29183]: 2017-09-28 13:05:30.197 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:05:30] "OPTIONS / HTTP/1.0" 200 134 0.000648
Sep 28 13:05:30 ctl02 neutron-server[30536]: 2017-09-28 13:05:30.292 30600 WARNING oslo_messaging._drivers.amqpdriver [req-b27f757d-de93-499c-aa6f-4dc4f2a35d9b - - - - -] reply_692b03e6d8d44d758b6be19b067c3aa3 doesn't exists, drop reply to cb2bf34252f448a7abf6201b649b2d2a
Sep 28 13:05:30 ctl02 neutron-server[30536]: 2017-09-28 13:05:30.293 30600 INFO oslo_messaging._drivers.amqpdriver [req-b27f757d-de93-499c-aa6f-4dc4f2a35d9b - - - - -] The reply cb2bf34252f448a7abf6201b649b2d2a cannot be sent  reply_692b03e6d8d44d758b6be19b067c3aa3 reply queue don't exist after 60 sec abandoning...
Sep 28 13:05:30 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:05:30.902 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:05:30] "OPTIONS / HTTP/1.0" 200 134 0.000404
Sep 28 13:05:30 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5e26822e)
Sep 28 13:05:31 ctl02 neutron-server[30536]: 2017-09-28 13:05:31.154 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:05:31] "OPTIONS / HTTP/1.0" 200 262 0.000548
Sep 28 13:05:31 ctl02 nova-api[16629]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:05:31 ctl02 nova-api[16629]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:05:31 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5e26822e)
Sep 28 13:05:32 ctl02 nova-api[16629]: 2017-09-28 13:05:32.036 16629 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:05:32 ctl02 nova-api[16629]: 2017-09-28 13:05:32.037 16629 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:05:32 ctl02 nova-api[16629]: 2017-09-28 13:05:32.037 16629 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:05:32 ctl02 nova-api[16629]: 2017-09-28 13:05:32.037 16629 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:05:32 ctl02 nova-api[16629]: 2017-09-28 13:05:32.037 16629 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:05:32 ctl02 nova-api[16629]: 2017-09-28 13:05:32.037 16629 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:05:32 ctl02 nova-api[16629]: 2017-09-28 13:05:32.037 16629 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:05:32 ctl02 nova-api[16629]: 2017-09-28 13:05:32.037 16629 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:05:32 ctl02 nova-api[16629]: 2017-09-28 13:05:32.037 16629 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:05:32 ctl02 nova-api[16629]: 2017-09-28 13:05:32.037 16629 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:05:32 ctl02 nova-api[16629]: 2017-09-28 13:05:32.037 16629 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:05:32 ctl02 nova-api[16629]: 2017-09-28 13:05:32.037 16629 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:05:32 ctl02 nova-api[16629]: 2017-09-28 13:05:32.037 16629 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:05:32 ctl02 nova-api[16629]: 2017-09-28 13:05:32.037 16629 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:05:32 ctl02 nova-api[16629]: 2017-09-28 13:05:32.037 16629 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:05:32 ctl02 nova-api[16629]: 2017-09-28 13:05:32.037 16629 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:05:32 ctl02 nova-api[16629]: 2017-09-28 13:05:32.037 16629 ERROR nova.wsgi     self.filename))
Sep 28 13:05:32 ctl02 nova-api[16629]: 2017-09-28 13:05:32.037 16629 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:05:32 ctl02 nova-api[16629]: 2017-09-28 13:05:32.037 16629 ERROR nova.wsgi
Sep 28 13:05:32 ctl02 nova-api[16629]: 2017-09-28 13:05:32.038 16629 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:05:32 ctl02 nova-api[16629]: 2017-09-28 13:05:32.173 16629 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:05:32 ctl02 glance-api[29183]: 2017-09-28 13:05:32.181 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:05:32] "OPTIONS / HTTP/1.0" 200 134 0.001031
Sep 28 13:05:32 ctl02 nova-api[16629]: 2017-09-28 13:05:32.424 16629 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:05:32 ctl02 nova-api[16629]: 2017-09-28 13:05:32.426 16629 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:05:32 ctl02 nova-api[16629]: 2017-09-28 13:05:32.427 16629 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:05:32 ctl02 nova-api[16629]: 2017-09-28 13:05:32.427 16629 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:05:32 ctl02 heat-api[13008]: 2017-09-28 13:05:32.549 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:05:32] "OPTIONS / HTTP/1.0" 200 134 0.000621
Sep 28 13:05:32 ctl02 nova-api[16629]: 2017-09-28 13:05:32.562 16629 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:05:32 ctl02 nova-api[16629]: 2017-09-28 13:05:32.564 16629 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:05:32 ctl02 nova-api[16629]: 2017-09-28 13:05:32.564 16629 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:05:32 ctl02 nova-api[16629]: 2017-09-28 13:05:32.564 16629 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:05:32 ctl02 nova-api[16629]: 2017-09-28 13:05:32.568 16629 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:05:32 ctl02 nova-api[16629]: 2017-09-28 13:05:32.568 16629 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:05:32 ctl02 nova-api[16629]: 2017-09-28 13:05:32.568 16629 ERROR nova Traceback (most recent call last):
Sep 28 13:05:32 ctl02 nova-api[16629]: 2017-09-28 13:05:32.568 16629 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:05:32 ctl02 nova-api[16629]: 2017-09-28 13:05:32.568 16629 ERROR nova     sys.exit(main())
Sep 28 13:05:32 ctl02 nova-api[16629]: 2017-09-28 13:05:32.568 16629 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:05:32 ctl02 nova-api[16629]: 2017-09-28 13:05:32.568 16629 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:05:32 ctl02 nova-api[16629]: 2017-09-28 13:05:32.568 16629 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:05:32 ctl02 nova-api[16629]: 2017-09-28 13:05:32.568 16629 ERROR nova     max_url_len=max_url_len)
Sep 28 13:05:32 ctl02 nova-api[16629]: 2017-09-28 13:05:32.568 16629 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:05:32 ctl02 nova-api[16629]: 2017-09-28 13:05:32.568 16629 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:05:32 ctl02 nova-api[16629]: 2017-09-28 13:05:32.568 16629 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:05:32 ctl02 nova-api[16629]: 2017-09-28 13:05:32.568 16629 ERROR nova     sock.listen(backlog)
Sep 28 13:05:32 ctl02 nova-api[16629]: 2017-09-28 13:05:32.568 16629 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:05:32 ctl02 nova-api[16629]: 2017-09-28 13:05:32.568 16629 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:05:32 ctl02 nova-api[16629]: 2017-09-28 13:05:32.568 16629 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:05:32 ctl02 nova-api[16629]: 2017-09-28 13:05:32.568 16629 ERROR nova
Sep 28 13:05:32 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:05:32 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:05:32 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:05:32 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:05:32 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:05:32 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:05:32 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:05:32 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5e26822e)
Sep 28 13:05:33 ctl02 glance-api[29183]: 2017-09-28 13:05:33.591 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:05:33] "OPTIONS / HTTP/1.0" 200 134 0.000558
Sep 28 13:05:33 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:05:33.887 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:05:33] "OPTIONS / HTTP/1.0" 200 134 0.000403
Sep 28 13:05:33 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5e26822e)
Sep 28 13:05:34 ctl02 neutron-server[30536]: 2017-09-28 13:05:34.209 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:05:34] "OPTIONS / HTTP/1.0" 200 262 0.000467
Sep 28 13:05:34 ctl02 heat-api-cfn[13300]: 2017-09-28 13:05:34.288 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:05:34] "OPTIONS / HTTP/1.0" 200 134 0.000651
Sep 28 13:05:34 ctl02 nova-api[16647]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:05:34 ctl02 nova-api[16647]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:05:34 ctl02 nova-api[16647]: 2017-09-28 13:05:34.726 16647 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:05:34 ctl02 nova-api[16647]: 2017-09-28 13:05:34.728 16647 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:05:34 ctl02 nova-api[16647]: 2017-09-28 13:05:34.728 16647 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:05:34 ctl02 nova-api[16647]: 2017-09-28 13:05:34.728 16647 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:05:34 ctl02 nova-api[16647]: 2017-09-28 13:05:34.728 16647 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:05:34 ctl02 nova-api[16647]: 2017-09-28 13:05:34.728 16647 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:05:34 ctl02 nova-api[16647]: 2017-09-28 13:05:34.728 16647 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:05:34 ctl02 nova-api[16647]: 2017-09-28 13:05:34.728 16647 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:05:34 ctl02 nova-api[16647]: 2017-09-28 13:05:34.728 16647 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:05:34 ctl02 nova-api[16647]: 2017-09-28 13:05:34.728 16647 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:05:34 ctl02 nova-api[16647]: 2017-09-28 13:05:34.728 16647 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:05:34 ctl02 nova-api[16647]: 2017-09-28 13:05:34.728 16647 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:05:34 ctl02 nova-api[16647]: 2017-09-28 13:05:34.728 16647 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:05:34 ctl02 nova-api[16647]: 2017-09-28 13:05:34.728 16647 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:05:34 ctl02 nova-api[16647]: 2017-09-28 13:05:34.728 16647 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:05:34 ctl02 nova-api[16647]: 2017-09-28 13:05:34.728 16647 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:05:34 ctl02 nova-api[16647]: 2017-09-28 13:05:34.728 16647 ERROR nova.wsgi     self.filename))
Sep 28 13:05:34 ctl02 nova-api[16647]: 2017-09-28 13:05:34.728 16647 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:05:34 ctl02 nova-api[16647]: 2017-09-28 13:05:34.728 16647 ERROR nova.wsgi
Sep 28 13:05:34 ctl02 nova-api[16647]: 2017-09-28 13:05:34.729 16647 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:05:34 ctl02 nova-api[16647]: 2017-09-28 13:05:34.854 16647 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:05:34 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5e26822e)
Sep 28 13:05:35 ctl02 nova-api[16647]: 2017-09-28 13:05:35.083 16647 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:05:35 ctl02 nova-api[16647]: 2017-09-28 13:05:35.085 16647 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:05:35 ctl02 nova-api[16647]: 2017-09-28 13:05:35.085 16647 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:05:35 ctl02 nova-api[16647]: 2017-09-28 13:05:35.085 16647 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:05:35 ctl02 nova-api[16647]: 2017-09-28 13:05:35.216 16647 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:05:35 ctl02 nova-api[16647]: 2017-09-28 13:05:35.218 16647 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:05:35 ctl02 nova-api[16647]: 2017-09-28 13:05:35.218 16647 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:05:35 ctl02 nova-api[16647]: 2017-09-28 13:05:35.218 16647 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:05:35 ctl02 nova-api[16647]: 2017-09-28 13:05:35.221 16647 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:05:35 ctl02 nova-api[16647]: 2017-09-28 13:05:35.222 16647 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:05:35 ctl02 nova-api[16647]: 2017-09-28 13:05:35.222 16647 ERROR nova Traceback (most recent call last):
Sep 28 13:05:35 ctl02 nova-api[16647]: 2017-09-28 13:05:35.222 16647 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:05:35 ctl02 nova-api[16647]: 2017-09-28 13:05:35.222 16647 ERROR nova     sys.exit(main())
Sep 28 13:05:35 ctl02 nova-api[16647]: 2017-09-28 13:05:35.222 16647 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:05:35 ctl02 nova-api[16647]: 2017-09-28 13:05:35.222 16647 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:05:35 ctl02 nova-api[16647]: 2017-09-28 13:05:35.222 16647 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:05:35 ctl02 nova-api[16647]: 2017-09-28 13:05:35.222 16647 ERROR nova     max_url_len=max_url_len)
Sep 28 13:05:35 ctl02 nova-api[16647]: 2017-09-28 13:05:35.222 16647 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:05:35 ctl02 nova-api[16647]: 2017-09-28 13:05:35.222 16647 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:05:35 ctl02 nova-api[16647]: 2017-09-28 13:05:35.222 16647 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:05:35 ctl02 nova-api[16647]: 2017-09-28 13:05:35.222 16647 ERROR nova     sock.listen(backlog)
Sep 28 13:05:35 ctl02 nova-api[16647]: 2017-09-28 13:05:35.222 16647 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:05:35 ctl02 nova-api[16647]: 2017-09-28 13:05:35.222 16647 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:05:35 ctl02 nova-api[16647]: 2017-09-28 13:05:35.222 16647 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:05:35 ctl02 nova-api[16647]: 2017-09-28 13:05:35.222 16647 ERROR nova
Sep 28 13:05:35 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:05:35 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:05:35 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:05:35 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:05:35 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:05:35 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:05:35 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:05:35 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x5e26822e)
Sep 28 13:05:35 ctl02 neutron-server[30536]: 2017-09-28 13:05:35.982 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 2 dead agents out of 6:
Sep 28 13:05:35 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 13:05:35 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 13:04:30 cmp002
Sep 28 13:05:35 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 13:03:36 cmp002
Sep 28 13:05:36 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 13:05:36 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 13:05:37 ctl02 heat-api-cfn[13300]: 2017-09-28 13:05:37.021 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:05:37] "OPTIONS / HTTP/1.0" 200 134 0.000428
Sep 28 13:05:37 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 13:05:37 ctl02 ntp[16720]:  * Stopping NTP server ntpd
Sep 28 13:05:37 ctl02 ntp[16720]:    ...done.
Sep 28 13:05:37 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 13:05:37 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 13:05:37 ctl02 ntp[16730]:  * Starting NTP server ntpd
Sep 28 13:05:37 ctl02 ntpd[16738]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 13:05:37 ctl02 ntpd[16738]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 13:05:37 ctl02 ntp[16730]:    ...done.
Sep 28 13:05:37 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 13:05:37 ctl02 ntpd[16741]: proto: precision = 0.044 usec (-24)
Sep 28 13:05:37 ctl02 ntpd[16741]: switching logging to file /var/log/ntp.log
Sep 28 13:05:37 ctl02 nova-api[16665]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:05:37 ctl02 nova-api[16665]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:05:37 ctl02 nova-api[16665]: 2017-09-28 13:05:37.550 16665 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:05:37 ctl02 nova-api[16665]: 2017-09-28 13:05:37.551 16665 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:05:37 ctl02 nova-api[16665]: 2017-09-28 13:05:37.551 16665 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:05:37 ctl02 nova-api[16665]: 2017-09-28 13:05:37.551 16665 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:05:37 ctl02 nova-api[16665]: 2017-09-28 13:05:37.551 16665 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:05:37 ctl02 nova-api[16665]: 2017-09-28 13:05:37.551 16665 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:05:37 ctl02 nova-api[16665]: 2017-09-28 13:05:37.551 16665 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:05:37 ctl02 nova-api[16665]: 2017-09-28 13:05:37.551 16665 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:05:37 ctl02 nova-api[16665]: 2017-09-28 13:05:37.551 16665 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:05:37 ctl02 nova-api[16665]: 2017-09-28 13:05:37.551 16665 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:05:37 ctl02 nova-api[16665]: 2017-09-28 13:05:37.551 16665 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:05:37 ctl02 nova-api[16665]: 2017-09-28 13:05:37.551 16665 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:05:37 ctl02 nova-api[16665]: 2017-09-28 13:05:37.551 16665 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:05:37 ctl02 nova-api[16665]: 2017-09-28 13:05:37.551 16665 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:05:37 ctl02 nova-api[16665]: 2017-09-28 13:05:37.551 16665 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:05:37 ctl02 nova-api[16665]: 2017-09-28 13:05:37.551 16665 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:05:37 ctl02 nova-api[16665]: 2017-09-28 13:05:37.551 16665 ERROR nova.wsgi     self.filename))
Sep 28 13:05:37 ctl02 nova-api[16665]: 2017-09-28 13:05:37.551 16665 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:05:37 ctl02 nova-api[16665]: 2017-09-28 13:05:37.551 16665 ERROR nova.wsgi
Sep 28 13:05:37 ctl02 nova-api[16665]: 2017-09-28 13:05:37.553 16665 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:05:37 ctl02 nova-api[16665]: 2017-09-28 13:05:37.688 16665 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:05:37 ctl02 heat-api-cfn[13300]: 2017-09-28 13:05:37.853 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:05:37] "OPTIONS / HTTP/1.0" 200 134 0.000506
Sep 28 13:05:37 ctl02 nova-api[16665]: 2017-09-28 13:05:37.944 16665 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:05:37 ctl02 nova-api[16665]: 2017-09-28 13:05:37.946 16665 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:05:37 ctl02 nova-api[16665]: 2017-09-28 13:05:37.946 16665 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:05:37 ctl02 nova-api[16665]: 2017-09-28 13:05:37.947 16665 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:05:37 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:05:37.985 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:05:37] "OPTIONS / HTTP/1.0" 200 134 0.000438
Sep 28 13:05:38 ctl02 nova-api[16665]: 2017-09-28 13:05:38.079 16665 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:05:38 ctl02 nova-api[16665]: 2017-09-28 13:05:38.081 16665 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:05:38 ctl02 nova-api[16665]: 2017-09-28 13:05:38.081 16665 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:05:38 ctl02 nova-api[16665]: 2017-09-28 13:05:38.081 16665 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:05:38 ctl02 nova-api[16665]: 2017-09-28 13:05:38.085 16665 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:05:38 ctl02 nova-api[16665]: 2017-09-28 13:05:38.085 16665 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:05:38 ctl02 nova-api[16665]: 2017-09-28 13:05:38.085 16665 ERROR nova Traceback (most recent call last):
Sep 28 13:05:38 ctl02 nova-api[16665]: 2017-09-28 13:05:38.085 16665 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:05:38 ctl02 nova-api[16665]: 2017-09-28 13:05:38.085 16665 ERROR nova     sys.exit(main())
Sep 28 13:05:38 ctl02 nova-api[16665]: 2017-09-28 13:05:38.085 16665 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:05:38 ctl02 nova-api[16665]: 2017-09-28 13:05:38.085 16665 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:05:38 ctl02 nova-api[16665]: 2017-09-28 13:05:38.085 16665 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:05:38 ctl02 nova-api[16665]: 2017-09-28 13:05:38.085 16665 ERROR nova     max_url_len=max_url_len)
Sep 28 13:05:38 ctl02 nova-api[16665]: 2017-09-28 13:05:38.085 16665 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:05:38 ctl02 nova-api[16665]: 2017-09-28 13:05:38.085 16665 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:05:38 ctl02 nova-api[16665]: 2017-09-28 13:05:38.085 16665 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:05:38 ctl02 nova-api[16665]: 2017-09-28 13:05:38.085 16665 ERROR nova     sock.listen(backlog)
Sep 28 13:05:38 ctl02 nova-api[16665]: 2017-09-28 13:05:38.085 16665 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:05:38 ctl02 nova-api[16665]: 2017-09-28 13:05:38.085 16665 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:05:38 ctl02 nova-api[16665]: 2017-09-28 13:05:38.085 16665 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:05:38 ctl02 nova-api[16665]: 2017-09-28 13:05:38.085 16665 ERROR nova
Sep 28 13:05:38 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:05:38 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:05:38 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:05:38 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:05:38 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:05:38 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:05:38 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:05:38 ctl02 neutron-server[30536]: 2017-09-28 13:05:38.454 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:05:38] "OPTIONS / HTTP/1.0" 200 262 0.000535
Sep 28 13:05:38 ctl02 heat-api[13008]: 2017-09-28 13:05:38.708 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:05:38] "OPTIONS / HTTP/1.0" 200 134 0.000618
Sep 28 13:05:39 ctl02 heat-api[13008]: 2017-09-28 13:05:39.211 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:05:39] "OPTIONS / HTTP/1.0" 200 134 0.000614
Sep 28 13:05:40 ctl02 nova-api[16754]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:05:40 ctl02 nova-api[16754]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:05:40 ctl02 glance-api[29183]: 2017-09-28 13:05:40.248 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:05:40] "OPTIONS / HTTP/1.0" 200 134 0.000660
Sep 28 13:05:40 ctl02 nova-api[16754]: 2017-09-28 13:05:40.265 16754 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:05:40 ctl02 nova-api[16754]: 2017-09-28 13:05:40.267 16754 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:05:40 ctl02 nova-api[16754]: 2017-09-28 13:05:40.267 16754 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:05:40 ctl02 nova-api[16754]: 2017-09-28 13:05:40.267 16754 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:05:40 ctl02 nova-api[16754]: 2017-09-28 13:05:40.267 16754 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:05:40 ctl02 nova-api[16754]: 2017-09-28 13:05:40.267 16754 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:05:40 ctl02 nova-api[16754]: 2017-09-28 13:05:40.267 16754 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:05:40 ctl02 nova-api[16754]: 2017-09-28 13:05:40.267 16754 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:05:40 ctl02 nova-api[16754]: 2017-09-28 13:05:40.267 16754 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:05:40 ctl02 nova-api[16754]: 2017-09-28 13:05:40.267 16754 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:05:40 ctl02 nova-api[16754]: 2017-09-28 13:05:40.267 16754 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:05:40 ctl02 nova-api[16754]: 2017-09-28 13:05:40.267 16754 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:05:40 ctl02 nova-api[16754]: 2017-09-28 13:05:40.267 16754 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:05:40 ctl02 nova-api[16754]: 2017-09-28 13:05:40.267 16754 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:05:40 ctl02 nova-api[16754]: 2017-09-28 13:05:40.267 16754 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:05:40 ctl02 nova-api[16754]: 2017-09-28 13:05:40.267 16754 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:05:40 ctl02 nova-api[16754]: 2017-09-28 13:05:40.267 16754 ERROR nova.wsgi     self.filename))
Sep 28 13:05:40 ctl02 nova-api[16754]: 2017-09-28 13:05:40.267 16754 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:05:40 ctl02 nova-api[16754]: 2017-09-28 13:05:40.267 16754 ERROR nova.wsgi
Sep 28 13:05:40 ctl02 nova-api[16754]: 2017-09-28 13:05:40.268 16754 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:05:40 ctl02 nova-api[16754]: 2017-09-28 13:05:40.401 16754 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:05:40 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:05:40.626 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:05:40] "OPTIONS / HTTP/1.0" 200 134 0.000436
Sep 28 13:05:40 ctl02 nova-api[16754]: 2017-09-28 13:05:40.646 16754 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:05:40 ctl02 nova-api[16754]: 2017-09-28 13:05:40.649 16754 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:05:40 ctl02 nova-api[16754]: 2017-09-28 13:05:40.649 16754 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:05:40 ctl02 nova-api[16754]: 2017-09-28 13:05:40.649 16754 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:05:40 ctl02 nova-api[16754]: 2017-09-28 13:05:40.781 16754 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:05:40 ctl02 nova-api[16754]: 2017-09-28 13:05:40.783 16754 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:05:40 ctl02 nova-api[16754]: 2017-09-28 13:05:40.783 16754 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:05:40 ctl02 nova-api[16754]: 2017-09-28 13:05:40.783 16754 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:05:40 ctl02 nova-api[16754]: 2017-09-28 13:05:40.787 16754 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:05:40 ctl02 nova-api[16754]: 2017-09-28 13:05:40.787 16754 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:05:40 ctl02 nova-api[16754]: 2017-09-28 13:05:40.787 16754 ERROR nova Traceback (most recent call last):
Sep 28 13:05:40 ctl02 nova-api[16754]: 2017-09-28 13:05:40.787 16754 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:05:40 ctl02 nova-api[16754]: 2017-09-28 13:05:40.787 16754 ERROR nova     sys.exit(main())
Sep 28 13:05:40 ctl02 nova-api[16754]: 2017-09-28 13:05:40.787 16754 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:05:40 ctl02 nova-api[16754]: 2017-09-28 13:05:40.787 16754 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:05:40 ctl02 nova-api[16754]: 2017-09-28 13:05:40.787 16754 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:05:40 ctl02 nova-api[16754]: 2017-09-28 13:05:40.787 16754 ERROR nova     max_url_len=max_url_len)
Sep 28 13:05:40 ctl02 nova-api[16754]: 2017-09-28 13:05:40.787 16754 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:05:40 ctl02 nova-api[16754]: 2017-09-28 13:05:40.787 16754 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:05:40 ctl02 nova-api[16754]: 2017-09-28 13:05:40.787 16754 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:05:40 ctl02 nova-api[16754]: 2017-09-28 13:05:40.787 16754 ERROR nova     sock.listen(backlog)
Sep 28 13:05:40 ctl02 nova-api[16754]: 2017-09-28 13:05:40.787 16754 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:05:40 ctl02 nova-api[16754]: 2017-09-28 13:05:40.787 16754 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:05:40 ctl02 nova-api[16754]: 2017-09-28 13:05:40.787 16754 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:05:40 ctl02 nova-api[16754]: 2017-09-28 13:05:40.787 16754 ERROR nova
Sep 28 13:05:40 ctl02 neutron-server[30536]: 2017-09-28 13:05:40.820 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:05:40] "OPTIONS / HTTP/1.0" 200 262 0.000574
Sep 28 13:05:40 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:05:40 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:05:40 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:05:41 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:05:41 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:05:41 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:05:41 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:05:42 ctl02 heat-api[13008]: 2017-09-28 13:05:42.429 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:05:42] "OPTIONS / HTTP/1.0" 200 134 0.000577
Sep 28 13:05:42 ctl02 glance-api[29183]: 2017-09-28 13:05:42.508 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:05:42] "OPTIONS / HTTP/1.0" 200 134 0.000636
Sep 28 13:05:42 ctl02 nova-api[16773]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:05:42 ctl02 nova-api[16773]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:05:43 ctl02 nova-api[16773]: 2017-09-28 13:05:43.043 16773 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:05:43 ctl02 nova-api[16773]: 2017-09-28 13:05:43.045 16773 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:05:43 ctl02 nova-api[16773]: 2017-09-28 13:05:43.045 16773 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:05:43 ctl02 nova-api[16773]: 2017-09-28 13:05:43.045 16773 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:05:43 ctl02 nova-api[16773]: 2017-09-28 13:05:43.045 16773 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:05:43 ctl02 nova-api[16773]: 2017-09-28 13:05:43.045 16773 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:05:43 ctl02 nova-api[16773]: 2017-09-28 13:05:43.045 16773 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:05:43 ctl02 nova-api[16773]: 2017-09-28 13:05:43.045 16773 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:05:43 ctl02 nova-api[16773]: 2017-09-28 13:05:43.045 16773 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:05:43 ctl02 nova-api[16773]: 2017-09-28 13:05:43.045 16773 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:05:43 ctl02 nova-api[16773]: 2017-09-28 13:05:43.045 16773 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:05:43 ctl02 nova-api[16773]: 2017-09-28 13:05:43.045 16773 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:05:43 ctl02 nova-api[16773]: 2017-09-28 13:05:43.045 16773 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:05:43 ctl02 nova-api[16773]: 2017-09-28 13:05:43.045 16773 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:05:43 ctl02 nova-api[16773]: 2017-09-28 13:05:43.045 16773 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:05:43 ctl02 nova-api[16773]: 2017-09-28 13:05:43.045 16773 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:05:43 ctl02 nova-api[16773]: 2017-09-28 13:05:43.045 16773 ERROR nova.wsgi     self.filename))
Sep 28 13:05:43 ctl02 nova-api[16773]: 2017-09-28 13:05:43.045 16773 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:05:43 ctl02 nova-api[16773]: 2017-09-28 13:05:43.045 16773 ERROR nova.wsgi
Sep 28 13:05:43 ctl02 nova-api[16773]: 2017-09-28 13:05:43.047 16773 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:05:43 ctl02 nova-api[16773]: 2017-09-28 13:05:43.196 16773 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:05:43 ctl02 nova-conductor[5056]: 2017-09-28 13:05:43.342 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:05:43 ctl02 nova-conductor[5056]: 2017-09-28 13:05:43.354 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:05:43 ctl02 nova-conductor[5056]: 2017-09-28 13:05:43.370 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:05:43 ctl02 nova-conductor[5056]: 2017-09-28 13:05:43.371 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:05:43 ctl02 nova-api[16773]: 2017-09-28 13:05:43.437 16773 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:05:43 ctl02 nova-api[16773]: 2017-09-28 13:05:43.439 16773 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:05:43 ctl02 nova-api[16773]: 2017-09-28 13:05:43.439 16773 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:05:43 ctl02 nova-api[16773]: 2017-09-28 13:05:43.440 16773 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:05:43 ctl02 nova-api[16773]: 2017-09-28 13:05:43.573 16773 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:05:43 ctl02 nova-api[16773]: 2017-09-28 13:05:43.577 16773 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:05:43 ctl02 nova-api[16773]: 2017-09-28 13:05:43.577 16773 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:05:43 ctl02 nova-api[16773]: 2017-09-28 13:05:43.578 16773 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:05:43 ctl02 nova-api[16773]: 2017-09-28 13:05:43.582 16773 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:05:43 ctl02 nova-api[16773]: 2017-09-28 13:05:43.583 16773 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:05:43 ctl02 nova-api[16773]: 2017-09-28 13:05:43.583 16773 ERROR nova Traceback (most recent call last):
Sep 28 13:05:43 ctl02 nova-api[16773]: 2017-09-28 13:05:43.583 16773 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:05:43 ctl02 nova-api[16773]: 2017-09-28 13:05:43.583 16773 ERROR nova     sys.exit(main())
Sep 28 13:05:43 ctl02 nova-api[16773]: 2017-09-28 13:05:43.583 16773 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:05:43 ctl02 nova-api[16773]: 2017-09-28 13:05:43.583 16773 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:05:43 ctl02 nova-api[16773]: 2017-09-28 13:05:43.583 16773 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:05:43 ctl02 nova-api[16773]: 2017-09-28 13:05:43.583 16773 ERROR nova     max_url_len=max_url_len)
Sep 28 13:05:43 ctl02 nova-api[16773]: 2017-09-28 13:05:43.583 16773 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:05:43 ctl02 nova-api[16773]: 2017-09-28 13:05:43.583 16773 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:05:43 ctl02 nova-api[16773]: 2017-09-28 13:05:43.583 16773 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:05:43 ctl02 nova-api[16773]: 2017-09-28 13:05:43.583 16773 ERROR nova     sock.listen(backlog)
Sep 28 13:05:43 ctl02 nova-api[16773]: 2017-09-28 13:05:43.583 16773 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:05:43 ctl02 nova-api[16773]: 2017-09-28 13:05:43.583 16773 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:05:43 ctl02 nova-api[16773]: 2017-09-28 13:05:43.583 16773 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:05:43 ctl02 nova-api[16773]: 2017-09-28 13:05:43.583 16773 ERROR nova
Sep 28 13:05:43 ctl02 glance-api[29183]: 2017-09-28 13:05:43.690 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:05:43] "OPTIONS / HTTP/1.0" 200 134 0.000567
Sep 28 13:05:43 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:05:43 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:05:43 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:05:43 ctl02 neutron-server[30536]: 2017-09-28 13:05:43.827 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:05:43] "OPTIONS / HTTP/1.0" 200 262 0.000532
Sep 28 13:05:43 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:05:43 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:05:43 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:05:43 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:05:43 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:05:43.981 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:05:43] "OPTIONS / HTTP/1.0" 200 134 0.000472
Sep 28 13:05:44 ctl02 nova-cert[4860]: 2017-09-28 13:05:44.207 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:05:44 ctl02 heat-api-cfn[13300]: 2017-09-28 13:05:44.643 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:05:44] "OPTIONS / HTTP/1.0" 200 134 0.000503
Sep 28 13:05:45 ctl02 nova-api[16790]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:05:45 ctl02 nova-api[16790]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:05:45 ctl02 nova-api[16790]: 2017-09-28 13:05:45.751 16790 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:05:45 ctl02 nova-api[16790]: 2017-09-28 13:05:45.752 16790 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:05:45 ctl02 nova-api[16790]: 2017-09-28 13:05:45.752 16790 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:05:45 ctl02 nova-api[16790]: 2017-09-28 13:05:45.752 16790 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:05:45 ctl02 nova-api[16790]: 2017-09-28 13:05:45.752 16790 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:05:45 ctl02 nova-api[16790]: 2017-09-28 13:05:45.752 16790 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:05:45 ctl02 nova-api[16790]: 2017-09-28 13:05:45.752 16790 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:05:45 ctl02 nova-api[16790]: 2017-09-28 13:05:45.752 16790 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:05:45 ctl02 nova-api[16790]: 2017-09-28 13:05:45.752 16790 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:05:45 ctl02 nova-api[16790]: 2017-09-28 13:05:45.752 16790 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:05:45 ctl02 nova-api[16790]: 2017-09-28 13:05:45.752 16790 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:05:45 ctl02 nova-api[16790]: 2017-09-28 13:05:45.752 16790 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:05:45 ctl02 nova-api[16790]: 2017-09-28 13:05:45.752 16790 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:05:45 ctl02 nova-api[16790]: 2017-09-28 13:05:45.752 16790 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:05:45 ctl02 nova-api[16790]: 2017-09-28 13:05:45.752 16790 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:05:45 ctl02 nova-api[16790]: 2017-09-28 13:05:45.752 16790 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:05:45 ctl02 nova-api[16790]: 2017-09-28 13:05:45.752 16790 ERROR nova.wsgi     self.filename))
Sep 28 13:05:45 ctl02 nova-api[16790]: 2017-09-28 13:05:45.752 16790 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:05:45 ctl02 nova-api[16790]: 2017-09-28 13:05:45.752 16790 ERROR nova.wsgi
Sep 28 13:05:45 ctl02 nova-api[16790]: 2017-09-28 13:05:45.753 16790 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:05:45 ctl02 nova-api[16790]: 2017-09-28 13:05:45.885 16790 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:05:46 ctl02 nova-api[16790]: 2017-09-28 13:05:46.131 16790 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:05:46 ctl02 nova-api[16790]: 2017-09-28 13:05:46.133 16790 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:05:46 ctl02 nova-api[16790]: 2017-09-28 13:05:46.133 16790 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:05:46 ctl02 nova-api[16790]: 2017-09-28 13:05:46.134 16790 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:05:46 ctl02 nova-api[16790]: 2017-09-28 13:05:46.265 16790 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:05:46 ctl02 nova-api[16790]: 2017-09-28 13:05:46.267 16790 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:05:46 ctl02 nova-api[16790]: 2017-09-28 13:05:46.267 16790 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:05:46 ctl02 nova-api[16790]: 2017-09-28 13:05:46.267 16790 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:05:46 ctl02 nova-api[16790]: 2017-09-28 13:05:46.271 16790 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:05:46 ctl02 nova-api[16790]: 2017-09-28 13:05:46.271 16790 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:05:46 ctl02 nova-api[16790]: 2017-09-28 13:05:46.271 16790 ERROR nova Traceback (most recent call last):
Sep 28 13:05:46 ctl02 nova-api[16790]: 2017-09-28 13:05:46.271 16790 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:05:46 ctl02 nova-api[16790]: 2017-09-28 13:05:46.271 16790 ERROR nova     sys.exit(main())
Sep 28 13:05:46 ctl02 nova-api[16790]: 2017-09-28 13:05:46.271 16790 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:05:46 ctl02 nova-api[16790]: 2017-09-28 13:05:46.271 16790 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:05:46 ctl02 nova-api[16790]: 2017-09-28 13:05:46.271 16790 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:05:46 ctl02 nova-api[16790]: 2017-09-28 13:05:46.271 16790 ERROR nova     max_url_len=max_url_len)
Sep 28 13:05:46 ctl02 nova-api[16790]: 2017-09-28 13:05:46.271 16790 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:05:46 ctl02 nova-api[16790]: 2017-09-28 13:05:46.271 16790 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:05:46 ctl02 nova-api[16790]: 2017-09-28 13:05:46.271 16790 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:05:46 ctl02 nova-api[16790]: 2017-09-28 13:05:46.271 16790 ERROR nova     sock.listen(backlog)
Sep 28 13:05:46 ctl02 nova-api[16790]: 2017-09-28 13:05:46.271 16790 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:05:46 ctl02 nova-api[16790]: 2017-09-28 13:05:46.271 16790 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:05:46 ctl02 nova-api[16790]: 2017-09-28 13:05:46.271 16790 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:05:46 ctl02 nova-api[16790]: 2017-09-28 13:05:46.271 16790 ERROR nova
Sep 28 13:05:46 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:05:46 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:05:46 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:05:46 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:05:46 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:05:46 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:05:46 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:05:47 ctl02 heat-api-cfn[13300]: 2017-09-28 13:05:47.180 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:05:47] "OPTIONS / HTTP/1.0" 200 134 0.000444
Sep 28 13:05:47 ctl02 heat-api-cfn[13300]: 2017-09-28 13:05:47.919 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:05:47] "OPTIONS / HTTP/1.0" 200 134 0.000440
Sep 28 13:05:48 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:05:48.205 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:05:48] "OPTIONS / HTTP/1.0" 200 134 0.000465
Sep 28 13:05:48 ctl02 nova-api[16810]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:05:48 ctl02 nova-api[16810]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:05:48 ctl02 nova-api[16810]: 2017-09-28 13:05:48.529 16810 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:05:48 ctl02 nova-api[16810]: 2017-09-28 13:05:48.531 16810 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:05:48 ctl02 nova-api[16810]: 2017-09-28 13:05:48.531 16810 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:05:48 ctl02 nova-api[16810]: 2017-09-28 13:05:48.531 16810 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:05:48 ctl02 nova-api[16810]: 2017-09-28 13:05:48.531 16810 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:05:48 ctl02 nova-api[16810]: 2017-09-28 13:05:48.531 16810 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:05:48 ctl02 nova-api[16810]: 2017-09-28 13:05:48.531 16810 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:05:48 ctl02 nova-api[16810]: 2017-09-28 13:05:48.531 16810 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:05:48 ctl02 nova-api[16810]: 2017-09-28 13:05:48.531 16810 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:05:48 ctl02 nova-api[16810]: 2017-09-28 13:05:48.531 16810 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:05:48 ctl02 nova-api[16810]: 2017-09-28 13:05:48.531 16810 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:05:48 ctl02 nova-api[16810]: 2017-09-28 13:05:48.531 16810 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:05:48 ctl02 nova-api[16810]: 2017-09-28 13:05:48.531 16810 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:05:48 ctl02 nova-api[16810]: 2017-09-28 13:05:48.531 16810 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:05:48 ctl02 nova-api[16810]: 2017-09-28 13:05:48.531 16810 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:05:48 ctl02 nova-api[16810]: 2017-09-28 13:05:48.531 16810 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:05:48 ctl02 nova-api[16810]: 2017-09-28 13:05:48.531 16810 ERROR nova.wsgi     self.filename))
Sep 28 13:05:48 ctl02 nova-api[16810]: 2017-09-28 13:05:48.531 16810 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:05:48 ctl02 nova-api[16810]: 2017-09-28 13:05:48.531 16810 ERROR nova.wsgi
Sep 28 13:05:48 ctl02 nova-api[16810]: 2017-09-28 13:05:48.533 16810 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:05:48 ctl02 neutron-server[30536]: 2017-09-28 13:05:48.583 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:05:48] "OPTIONS / HTTP/1.0" 200 262 0.000537
Sep 28 13:05:48 ctl02 nova-api[16810]: 2017-09-28 13:05:48.672 16810 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:05:48 ctl02 nova-api[16810]: 2017-09-28 13:05:48.927 16810 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:05:48 ctl02 nova-api[16810]: 2017-09-28 13:05:48.930 16810 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:05:48 ctl02 nova-api[16810]: 2017-09-28 13:05:48.930 16810 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:05:48 ctl02 nova-api[16810]: 2017-09-28 13:05:48.930 16810 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:05:49 ctl02 heat-api[13008]: 2017-09-28 13:05:49.011 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:05:49] "OPTIONS / HTTP/1.0" 200 134 0.000655
Sep 28 13:05:49 ctl02 nova-api[16810]: 2017-09-28 13:05:49.068 16810 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:05:49 ctl02 nova-api[16810]: 2017-09-28 13:05:49.070 16810 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:05:49 ctl02 nova-api[16810]: 2017-09-28 13:05:49.071 16810 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:05:49 ctl02 nova-api[16810]: 2017-09-28 13:05:49.071 16810 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:05:49 ctl02 nova-api[16810]: 2017-09-28 13:05:49.074 16810 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:05:49 ctl02 nova-api[16810]: 2017-09-28 13:05:49.075 16810 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:05:49 ctl02 nova-api[16810]: 2017-09-28 13:05:49.075 16810 ERROR nova Traceback (most recent call last):
Sep 28 13:05:49 ctl02 nova-api[16810]: 2017-09-28 13:05:49.075 16810 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:05:49 ctl02 nova-api[16810]: 2017-09-28 13:05:49.075 16810 ERROR nova     sys.exit(main())
Sep 28 13:05:49 ctl02 nova-api[16810]: 2017-09-28 13:05:49.075 16810 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:05:49 ctl02 nova-api[16810]: 2017-09-28 13:05:49.075 16810 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:05:49 ctl02 nova-api[16810]: 2017-09-28 13:05:49.075 16810 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:05:49 ctl02 nova-api[16810]: 2017-09-28 13:05:49.075 16810 ERROR nova     max_url_len=max_url_len)
Sep 28 13:05:49 ctl02 nova-api[16810]: 2017-09-28 13:05:49.075 16810 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:05:49 ctl02 nova-api[16810]: 2017-09-28 13:05:49.075 16810 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:05:49 ctl02 nova-api[16810]: 2017-09-28 13:05:49.075 16810 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:05:49 ctl02 nova-api[16810]: 2017-09-28 13:05:49.075 16810 ERROR nova     sock.listen(backlog)
Sep 28 13:05:49 ctl02 nova-api[16810]: 2017-09-28 13:05:49.075 16810 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:05:49 ctl02 nova-api[16810]: 2017-09-28 13:05:49.075 16810 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:05:49 ctl02 nova-api[16810]: 2017-09-28 13:05:49.075 16810 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:05:49 ctl02 nova-api[16810]: 2017-09-28 13:05:49.075 16810 ERROR nova
Sep 28 13:05:49 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:05:49 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:05:49 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:05:49 ctl02 heat-api[13008]: 2017-09-28 13:05:49.290 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:05:49] "OPTIONS / HTTP/1.0" 200 134 0.000613
Sep 28 13:05:49 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:05:49 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:05:49 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:05:49 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:05:50 ctl02 glance-api[29183]: 2017-09-28 13:05:50.218 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:05:50] "OPTIONS / HTTP/1.0" 200 134 0.000632
Sep 28 13:05:50 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:05:50.431 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:05:50] "OPTIONS / HTTP/1.0" 200 134 0.000419
Sep 28 13:05:50 ctl02 neutron-server[30536]: 2017-09-28 13:05:50.979 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 13:05:50 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 13:05:50 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 13:05:06 cmp002
Sep 28 13:05:50 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 13:05:08 cmp001
Sep 28 13:05:50 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 13:04:30 cmp002
Sep 28 13:05:50 ctl02 neutron-server[30536]: 2017-09-28 13:05:50.982 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:05:50] "OPTIONS / HTTP/1.0" 200 262 0.000538
Sep 28 13:05:51 ctl02 nova-api[16828]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:05:51 ctl02 nova-api[16828]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:05:51 ctl02 nova-api[16828]: 2017-09-28 13:05:51.264 16828 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:05:51 ctl02 nova-api[16828]: 2017-09-28 13:05:51.265 16828 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:05:51 ctl02 nova-api[16828]: 2017-09-28 13:05:51.265 16828 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:05:51 ctl02 nova-api[16828]: 2017-09-28 13:05:51.265 16828 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:05:51 ctl02 nova-api[16828]: 2017-09-28 13:05:51.265 16828 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:05:51 ctl02 nova-api[16828]: 2017-09-28 13:05:51.265 16828 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:05:51 ctl02 nova-api[16828]: 2017-09-28 13:05:51.265 16828 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:05:51 ctl02 nova-api[16828]: 2017-09-28 13:05:51.265 16828 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:05:51 ctl02 nova-api[16828]: 2017-09-28 13:05:51.265 16828 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:05:51 ctl02 nova-api[16828]: 2017-09-28 13:05:51.265 16828 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:05:51 ctl02 nova-api[16828]: 2017-09-28 13:05:51.265 16828 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:05:51 ctl02 nova-api[16828]: 2017-09-28 13:05:51.265 16828 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:05:51 ctl02 nova-api[16828]: 2017-09-28 13:05:51.265 16828 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:05:51 ctl02 nova-api[16828]: 2017-09-28 13:05:51.265 16828 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:05:51 ctl02 nova-api[16828]: 2017-09-28 13:05:51.265 16828 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:05:51 ctl02 nova-api[16828]: 2017-09-28 13:05:51.265 16828 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:05:51 ctl02 nova-api[16828]: 2017-09-28 13:05:51.265 16828 ERROR nova.wsgi     self.filename))
Sep 28 13:05:51 ctl02 nova-api[16828]: 2017-09-28 13:05:51.265 16828 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:05:51 ctl02 nova-api[16828]: 2017-09-28 13:05:51.265 16828 ERROR nova.wsgi
Sep 28 13:05:51 ctl02 nova-api[16828]: 2017-09-28 13:05:51.266 16828 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:05:51 ctl02 nova-api[16828]: 2017-09-28 13:05:51.399 16828 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:05:51 ctl02 nova-api[16828]: 2017-09-28 13:05:51.642 16828 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:05:51 ctl02 nova-api[16828]: 2017-09-28 13:05:51.644 16828 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:05:51 ctl02 nova-api[16828]: 2017-09-28 13:05:51.644 16828 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:05:51 ctl02 nova-api[16828]: 2017-09-28 13:05:51.645 16828 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:05:51 ctl02 nova-api[16828]: 2017-09-28 13:05:51.776 16828 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:05:51 ctl02 nova-api[16828]: 2017-09-28 13:05:51.778 16828 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:05:51 ctl02 nova-api[16828]: 2017-09-28 13:05:51.778 16828 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:05:51 ctl02 nova-api[16828]: 2017-09-28 13:05:51.779 16828 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:05:51 ctl02 nova-api[16828]: 2017-09-28 13:05:51.782 16828 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:05:51 ctl02 nova-api[16828]: 2017-09-28 13:05:51.782 16828 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:05:51 ctl02 nova-api[16828]: 2017-09-28 13:05:51.782 16828 ERROR nova Traceback (most recent call last):
Sep 28 13:05:51 ctl02 nova-api[16828]: 2017-09-28 13:05:51.782 16828 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:05:51 ctl02 nova-api[16828]: 2017-09-28 13:05:51.782 16828 ERROR nova     sys.exit(main())
Sep 28 13:05:51 ctl02 nova-api[16828]: 2017-09-28 13:05:51.782 16828 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:05:51 ctl02 nova-api[16828]: 2017-09-28 13:05:51.782 16828 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:05:51 ctl02 nova-api[16828]: 2017-09-28 13:05:51.782 16828 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:05:51 ctl02 nova-api[16828]: 2017-09-28 13:05:51.782 16828 ERROR nova     max_url_len=max_url_len)
Sep 28 13:05:51 ctl02 nova-api[16828]: 2017-09-28 13:05:51.782 16828 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:05:51 ctl02 nova-api[16828]: 2017-09-28 13:05:51.782 16828 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:05:51 ctl02 nova-api[16828]: 2017-09-28 13:05:51.782 16828 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:05:51 ctl02 nova-api[16828]: 2017-09-28 13:05:51.782 16828 ERROR nova     sock.listen(backlog)
Sep 28 13:05:51 ctl02 nova-api[16828]: 2017-09-28 13:05:51.782 16828 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:05:51 ctl02 nova-api[16828]: 2017-09-28 13:05:51.782 16828 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:05:51 ctl02 nova-api[16828]: 2017-09-28 13:05:51.782 16828 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:05:51 ctl02 nova-api[16828]: 2017-09-28 13:05:51.782 16828 ERROR nova
Sep 28 13:05:51 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:05:51 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:05:51 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:05:52 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:05:52 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:05:52 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:05:52 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:05:52 ctl02 heat-api[13008]: 2017-09-28 13:05:52.461 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:05:52] "OPTIONS / HTTP/1.0" 200 134 0.000493
Sep 28 13:05:52 ctl02 glance-api[29183]: 2017-09-28 13:05:52.653 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:05:52] "OPTIONS / HTTP/1.0" 200 134 0.000554
Sep 28 13:05:53 ctl02 glance-api[29183]: 2017-09-28 13:05:53.353 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:05:53] "OPTIONS / HTTP/1.0" 200 134 0.000584
Sep 28 13:05:53 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x465bbf11)
Sep 28 13:05:53 ctl02 nova-api[16846]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:05:53 ctl02 nova-api[16846]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:05:54 ctl02 neutron-server[30536]: 2017-09-28 13:05:54.020 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:05:54] "OPTIONS / HTTP/1.0" 200 262 0.000487
Sep 28 13:05:54 ctl02 nova-api[16846]: 2017-09-28 13:05:54.025 16846 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:05:54 ctl02 nova-api[16846]: 2017-09-28 13:05:54.026 16846 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:05:54 ctl02 nova-api[16846]: 2017-09-28 13:05:54.026 16846 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:05:54 ctl02 nova-api[16846]: 2017-09-28 13:05:54.026 16846 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:05:54 ctl02 nova-api[16846]: 2017-09-28 13:05:54.026 16846 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:05:54 ctl02 nova-api[16846]: 2017-09-28 13:05:54.026 16846 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:05:54 ctl02 nova-api[16846]: 2017-09-28 13:05:54.026 16846 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:05:54 ctl02 nova-api[16846]: 2017-09-28 13:05:54.026 16846 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:05:54 ctl02 nova-api[16846]: 2017-09-28 13:05:54.026 16846 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:05:54 ctl02 nova-api[16846]: 2017-09-28 13:05:54.026 16846 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:05:54 ctl02 nova-api[16846]: 2017-09-28 13:05:54.026 16846 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:05:54 ctl02 nova-api[16846]: 2017-09-28 13:05:54.026 16846 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:05:54 ctl02 nova-api[16846]: 2017-09-28 13:05:54.026 16846 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:05:54 ctl02 nova-api[16846]: 2017-09-28 13:05:54.026 16846 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:05:54 ctl02 nova-api[16846]: 2017-09-28 13:05:54.026 16846 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:05:54 ctl02 nova-api[16846]: 2017-09-28 13:05:54.026 16846 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:05:54 ctl02 nova-api[16846]: 2017-09-28 13:05:54.026 16846 ERROR nova.wsgi     self.filename))
Sep 28 13:05:54 ctl02 nova-api[16846]: 2017-09-28 13:05:54.026 16846 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:05:54 ctl02 nova-api[16846]: 2017-09-28 13:05:54.026 16846 ERROR nova.wsgi
Sep 28 13:05:54 ctl02 nova-api[16846]: 2017-09-28 13:05:54.029 16846 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:05:54 ctl02 nova-consoleauth[5433]: 2017-09-28 13:05:54.056 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:05:54 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:05:54.087 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:05:54] "OPTIONS / HTTP/1.0" 200 134 0.000548
Sep 28 13:05:54 ctl02 nova-api[16846]: 2017-09-28 13:05:54.163 16846 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:05:54 ctl02 nova-api[16846]: 2017-09-28 13:05:54.387 16846 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:05:54 ctl02 nova-api[16846]: 2017-09-28 13:05:54.389 16846 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:05:54 ctl02 nova-api[16846]: 2017-09-28 13:05:54.389 16846 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:05:54 ctl02 nova-api[16846]: 2017-09-28 13:05:54.389 16846 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:05:54 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x465bbf11)
Sep 28 13:05:54 ctl02 heat-engine[12803]: 2017-09-28 13:05:54.477 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:05:54 ctl02 heat-engine[12803]: 2017-09-28 13:05:54.494 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:05:54 ctl02 heat-engine[12803]: 2017-09-28 13:05:54.499 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:05:54 ctl02 heat-engine[12803]: 2017-09-28 13:05:54.501 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:05:54 ctl02 nova-api[16846]: 2017-09-28 13:05:54.520 16846 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:05:54 ctl02 nova-api[16846]: 2017-09-28 13:05:54.522 16846 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:05:54 ctl02 nova-api[16846]: 2017-09-28 13:05:54.522 16846 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:05:54 ctl02 nova-api[16846]: 2017-09-28 13:05:54.523 16846 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:05:54 ctl02 nova-api[16846]: 2017-09-28 13:05:54.526 16846 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:05:54 ctl02 nova-api[16846]: 2017-09-28 13:05:54.526 16846 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:05:54 ctl02 nova-api[16846]: 2017-09-28 13:05:54.526 16846 ERROR nova Traceback (most recent call last):
Sep 28 13:05:54 ctl02 nova-api[16846]: 2017-09-28 13:05:54.526 16846 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:05:54 ctl02 nova-api[16846]: 2017-09-28 13:05:54.526 16846 ERROR nova     sys.exit(main())
Sep 28 13:05:54 ctl02 nova-api[16846]: 2017-09-28 13:05:54.526 16846 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:05:54 ctl02 nova-api[16846]: 2017-09-28 13:05:54.526 16846 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:05:54 ctl02 nova-api[16846]: 2017-09-28 13:05:54.526 16846 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:05:54 ctl02 nova-api[16846]: 2017-09-28 13:05:54.526 16846 ERROR nova     max_url_len=max_url_len)
Sep 28 13:05:54 ctl02 nova-api[16846]: 2017-09-28 13:05:54.526 16846 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:05:54 ctl02 nova-api[16846]: 2017-09-28 13:05:54.526 16846 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:05:54 ctl02 nova-api[16846]: 2017-09-28 13:05:54.526 16846 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:05:54 ctl02 nova-api[16846]: 2017-09-28 13:05:54.526 16846 ERROR nova     sock.listen(backlog)
Sep 28 13:05:54 ctl02 nova-api[16846]: 2017-09-28 13:05:54.526 16846 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:05:54 ctl02 nova-api[16846]: 2017-09-28 13:05:54.526 16846 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:05:54 ctl02 nova-api[16846]: 2017-09-28 13:05:54.526 16846 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:05:54 ctl02 nova-api[16846]: 2017-09-28 13:05:54.526 16846 ERROR nova
Sep 28 13:05:54 ctl02 heat-api-cfn[13300]: 2017-09-28 13:05:54.535 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:05:54] "OPTIONS / HTTP/1.0" 200 134 0.000455
Sep 28 13:05:54 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:05:54 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:05:54 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:05:54 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:05:54 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:05:54 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:05:54 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:05:55 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x465bbf11)
Sep 28 13:05:56 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x465bbf11)
Sep 28 13:05:56 ctl02 nova-api[16864]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:05:56 ctl02 nova-api[16864]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:05:56 ctl02 nova-api[16864]: 2017-09-28 13:05:56.734 16864 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:05:56 ctl02 nova-api[16864]: 2017-09-28 13:05:56.735 16864 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:05:56 ctl02 nova-api[16864]: 2017-09-28 13:05:56.735 16864 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:05:56 ctl02 nova-api[16864]: 2017-09-28 13:05:56.735 16864 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:05:56 ctl02 nova-api[16864]: 2017-09-28 13:05:56.735 16864 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:05:56 ctl02 nova-api[16864]: 2017-09-28 13:05:56.735 16864 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:05:56 ctl02 nova-api[16864]: 2017-09-28 13:05:56.735 16864 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:05:56 ctl02 nova-api[16864]: 2017-09-28 13:05:56.735 16864 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:05:56 ctl02 nova-api[16864]: 2017-09-28 13:05:56.735 16864 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:05:56 ctl02 nova-api[16864]: 2017-09-28 13:05:56.735 16864 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:05:56 ctl02 nova-api[16864]: 2017-09-28 13:05:56.735 16864 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:05:56 ctl02 nova-api[16864]: 2017-09-28 13:05:56.735 16864 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:05:56 ctl02 nova-api[16864]: 2017-09-28 13:05:56.735 16864 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:05:56 ctl02 nova-api[16864]: 2017-09-28 13:05:56.735 16864 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:05:56 ctl02 nova-api[16864]: 2017-09-28 13:05:56.735 16864 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:05:56 ctl02 nova-api[16864]: 2017-09-28 13:05:56.735 16864 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:05:56 ctl02 nova-api[16864]: 2017-09-28 13:05:56.735 16864 ERROR nova.wsgi     self.filename))
Sep 28 13:05:56 ctl02 nova-api[16864]: 2017-09-28 13:05:56.735 16864 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:05:56 ctl02 nova-api[16864]: 2017-09-28 13:05:56.735 16864 ERROR nova.wsgi
Sep 28 13:05:56 ctl02 nova-api[16864]: 2017-09-28 13:05:56.736 16864 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:05:56 ctl02 heat-api-cfn[13300]: 2017-09-28 13:05:56.835 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:05:56] "OPTIONS / HTTP/1.0" 200 134 0.000496
Sep 28 13:05:56 ctl02 nova-api[16864]: 2017-09-28 13:05:56.863 16864 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:05:57 ctl02 nova-api[16864]: 2017-09-28 13:05:57.088 16864 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:05:57 ctl02 nova-api[16864]: 2017-09-28 13:05:57.091 16864 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:05:57 ctl02 nova-api[16864]: 2017-09-28 13:05:57.091 16864 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:05:57 ctl02 nova-api[16864]: 2017-09-28 13:05:57.091 16864 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:05:57 ctl02 nova-scheduler[5620]: 2017-09-28 13:05:57.170 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:05:57 ctl02 nova-api[16864]: 2017-09-28 13:05:57.221 16864 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:05:57 ctl02 nova-api[16864]: 2017-09-28 13:05:57.223 16864 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:05:57 ctl02 nova-api[16864]: 2017-09-28 13:05:57.223 16864 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:05:57 ctl02 nova-api[16864]: 2017-09-28 13:05:57.224 16864 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:05:57 ctl02 nova-api[16864]: 2017-09-28 13:05:57.227 16864 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:05:57 ctl02 nova-api[16864]: 2017-09-28 13:05:57.227 16864 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:05:57 ctl02 nova-api[16864]: 2017-09-28 13:05:57.227 16864 ERROR nova Traceback (most recent call last):
Sep 28 13:05:57 ctl02 nova-api[16864]: 2017-09-28 13:05:57.227 16864 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:05:57 ctl02 nova-api[16864]: 2017-09-28 13:05:57.227 16864 ERROR nova     sys.exit(main())
Sep 28 13:05:57 ctl02 nova-api[16864]: 2017-09-28 13:05:57.227 16864 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:05:57 ctl02 nova-api[16864]: 2017-09-28 13:05:57.227 16864 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:05:57 ctl02 nova-api[16864]: 2017-09-28 13:05:57.227 16864 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:05:57 ctl02 nova-api[16864]: 2017-09-28 13:05:57.227 16864 ERROR nova     max_url_len=max_url_len)
Sep 28 13:05:57 ctl02 nova-api[16864]: 2017-09-28 13:05:57.227 16864 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:05:57 ctl02 nova-api[16864]: 2017-09-28 13:05:57.227 16864 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:05:57 ctl02 nova-api[16864]: 2017-09-28 13:05:57.227 16864 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:05:57 ctl02 nova-api[16864]: 2017-09-28 13:05:57.227 16864 ERROR nova     sock.listen(backlog)
Sep 28 13:05:57 ctl02 nova-api[16864]: 2017-09-28 13:05:57.227 16864 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:05:57 ctl02 nova-api[16864]: 2017-09-28 13:05:57.227 16864 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:05:57 ctl02 nova-api[16864]: 2017-09-28 13:05:57.227 16864 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:05:57 ctl02 nova-api[16864]: 2017-09-28 13:05:57.227 16864 ERROR nova
Sep 28 13:05:57 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:05:57 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:05:57 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:05:57 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x465bbf11)
Sep 28 13:05:57 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:05:57 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:05:57 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:05:57 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:05:58 ctl02 heat-api-cfn[13300]: 2017-09-28 13:05:58.081 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:05:58] "OPTIONS / HTTP/1.0" 200 134 0.000659
Sep 28 13:05:58 ctl02 neutron-server[30536]: 2017-09-28 13:05:58.225 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:05:58] "OPTIONS / HTTP/1.0" 200 262 0.000488
Sep 28 13:05:58 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x465bbf11)
Sep 28 13:05:58 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:05:58.599 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:05:58] "OPTIONS / HTTP/1.0" 200 134 0.000405
Sep 28 13:05:58 ctl02 heat-api[13008]: 2017-09-28 13:05:58.755 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:05:58] "OPTIONS / HTTP/1.0" 200 134 0.000762
Sep 28 13:05:59 ctl02 nova-api[16882]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:05:59 ctl02 nova-api[16882]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:05:59 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x465bbf11)
Sep 28 13:05:59 ctl02 nova-api[16882]: 2017-09-28 13:05:59.496 16882 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:05:59 ctl02 nova-api[16882]: 2017-09-28 13:05:59.498 16882 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:05:59 ctl02 nova-api[16882]: 2017-09-28 13:05:59.498 16882 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:05:59 ctl02 nova-api[16882]: 2017-09-28 13:05:59.498 16882 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:05:59 ctl02 nova-api[16882]: 2017-09-28 13:05:59.498 16882 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:05:59 ctl02 nova-api[16882]: 2017-09-28 13:05:59.498 16882 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:05:59 ctl02 nova-api[16882]: 2017-09-28 13:05:59.498 16882 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:05:59 ctl02 nova-api[16882]: 2017-09-28 13:05:59.498 16882 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:05:59 ctl02 nova-api[16882]: 2017-09-28 13:05:59.498 16882 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:05:59 ctl02 nova-api[16882]: 2017-09-28 13:05:59.498 16882 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:05:59 ctl02 nova-api[16882]: 2017-09-28 13:05:59.498 16882 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:05:59 ctl02 nova-api[16882]: 2017-09-28 13:05:59.498 16882 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:05:59 ctl02 nova-api[16882]: 2017-09-28 13:05:59.498 16882 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:05:59 ctl02 nova-api[16882]: 2017-09-28 13:05:59.498 16882 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:05:59 ctl02 nova-api[16882]: 2017-09-28 13:05:59.498 16882 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:05:59 ctl02 nova-api[16882]: 2017-09-28 13:05:59.498 16882 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:05:59 ctl02 nova-api[16882]: 2017-09-28 13:05:59.498 16882 ERROR nova.wsgi     self.filename))
Sep 28 13:05:59 ctl02 nova-api[16882]: 2017-09-28 13:05:59.498 16882 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:05:59 ctl02 nova-api[16882]: 2017-09-28 13:05:59.498 16882 ERROR nova.wsgi
Sep 28 13:05:59 ctl02 nova-api[16882]: 2017-09-28 13:05:59.499 16882 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:05:59 ctl02 heat-api[13008]: 2017-09-28 13:05:59.596 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:05:59] "OPTIONS / HTTP/1.0" 200 134 0.000518
Sep 28 13:05:59 ctl02 nova-api[16882]: 2017-09-28 13:05:59.632 16882 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:05:59 ctl02 glance-api[29183]: 2017-09-28 13:05:59.834 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:05:59] "OPTIONS / HTTP/1.0" 200 134 0.000563
Sep 28 13:05:59 ctl02 nova-api[16882]: 2017-09-28 13:05:59.857 16882 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:05:59 ctl02 nova-api[16882]: 2017-09-28 13:05:59.859 16882 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:05:59 ctl02 nova-api[16882]: 2017-09-28 13:05:59.860 16882 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:05:59 ctl02 nova-api[16882]: 2017-09-28 13:05:59.860 16882 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:05:59 ctl02 nova-api[16882]: 2017-09-28 13:05:59.993 16882 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:05:59 ctl02 nova-api[16882]: 2017-09-28 13:05:59.995 16882 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:05:59 ctl02 nova-api[16882]: 2017-09-28 13:05:59.995 16882 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:05:59 ctl02 nova-api[16882]: 2017-09-28 13:05:59.995 16882 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:05:59 ctl02 nova-api[16882]: 2017-09-28 13:05:59.999 16882 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:06:00 ctl02 nova-api[16882]: 2017-09-28 13:05:59.999 16882 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:06:00 ctl02 nova-api[16882]: 2017-09-28 13:05:59.999 16882 ERROR nova Traceback (most recent call last):
Sep 28 13:06:00 ctl02 nova-api[16882]: 2017-09-28 13:05:59.999 16882 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:06:00 ctl02 nova-api[16882]: 2017-09-28 13:05:59.999 16882 ERROR nova     sys.exit(main())
Sep 28 13:06:00 ctl02 nova-api[16882]: 2017-09-28 13:05:59.999 16882 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:06:00 ctl02 nova-api[16882]: 2017-09-28 13:05:59.999 16882 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:06:00 ctl02 nova-api[16882]: 2017-09-28 13:05:59.999 16882 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:06:00 ctl02 nova-api[16882]: 2017-09-28 13:05:59.999 16882 ERROR nova     max_url_len=max_url_len)
Sep 28 13:06:00 ctl02 nova-api[16882]: 2017-09-28 13:05:59.999 16882 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:06:00 ctl02 nova-api[16882]: 2017-09-28 13:05:59.999 16882 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:06:00 ctl02 nova-api[16882]: 2017-09-28 13:05:59.999 16882 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:06:00 ctl02 nova-api[16882]: 2017-09-28 13:05:59.999 16882 ERROR nova     sock.listen(backlog)
Sep 28 13:06:00 ctl02 nova-api[16882]: 2017-09-28 13:05:59.999 16882 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:06:00 ctl02 nova-api[16882]: 2017-09-28 13:05:59.999 16882 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:06:00 ctl02 nova-api[16882]: 2017-09-28 13:05:59.999 16882 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:06:00 ctl02 nova-api[16882]: 2017-09-28 13:05:59.999 16882 ERROR nova
Sep 28 13:06:00 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:06:00 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:06:00 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:06:00 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:06:00 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:06:00 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:06:00 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:06:00 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x465bbf11)
Sep 28 13:06:00 ctl02 neutron-server[30536]: 2017-09-28 13:06:00.594 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:06:00] "OPTIONS / HTTP/1.0" 200 262 0.000468
Sep 28 13:06:00 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:06:00.640 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:06:00] "OPTIONS / HTTP/1.0" 200 134 0.000371
Sep 28 13:06:01 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x465bbf11)
Sep 28 13:06:02 ctl02 nova-api[16900]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:06:02 ctl02 nova-api[16900]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:06:02 ctl02 nova-api[16900]: 2017-09-28 13:06:02.229 16900 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:06:02 ctl02 nova-api[16900]: 2017-09-28 13:06:02.231 16900 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:06:02 ctl02 nova-api[16900]: 2017-09-28 13:06:02.231 16900 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:06:02 ctl02 nova-api[16900]: 2017-09-28 13:06:02.231 16900 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:06:02 ctl02 nova-api[16900]: 2017-09-28 13:06:02.231 16900 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:06:02 ctl02 nova-api[16900]: 2017-09-28 13:06:02.231 16900 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:06:02 ctl02 nova-api[16900]: 2017-09-28 13:06:02.231 16900 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:06:02 ctl02 nova-api[16900]: 2017-09-28 13:06:02.231 16900 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:06:02 ctl02 nova-api[16900]: 2017-09-28 13:06:02.231 16900 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:06:02 ctl02 nova-api[16900]: 2017-09-28 13:06:02.231 16900 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:06:02 ctl02 nova-api[16900]: 2017-09-28 13:06:02.231 16900 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:06:02 ctl02 nova-api[16900]: 2017-09-28 13:06:02.231 16900 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:06:02 ctl02 nova-api[16900]: 2017-09-28 13:06:02.231 16900 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:06:02 ctl02 nova-api[16900]: 2017-09-28 13:06:02.231 16900 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:06:02 ctl02 nova-api[16900]: 2017-09-28 13:06:02.231 16900 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:06:02 ctl02 nova-api[16900]: 2017-09-28 13:06:02.231 16900 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:06:02 ctl02 nova-api[16900]: 2017-09-28 13:06:02.231 16900 ERROR nova.wsgi     self.filename))
Sep 28 13:06:02 ctl02 nova-api[16900]: 2017-09-28 13:06:02.231 16900 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:06:02 ctl02 nova-api[16900]: 2017-09-28 13:06:02.231 16900 ERROR nova.wsgi
Sep 28 13:06:02 ctl02 nova-api[16900]: 2017-09-28 13:06:02.232 16900 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:06:02 ctl02 nova-api[16900]: 2017-09-28 13:06:02.363 16900 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:06:02 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x465bbf11)
Sep 28 13:06:02 ctl02 heat-api[13008]: 2017-09-28 13:06:02.494 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:06:02] "OPTIONS / HTTP/1.0" 200 134 0.000518
Sep 28 13:06:02 ctl02 nova-api[16900]: 2017-09-28 13:06:02.582 16900 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:06:02 ctl02 nova-api[16900]: 2017-09-28 13:06:02.585 16900 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:06:02 ctl02 nova-api[16900]: 2017-09-28 13:06:02.585 16900 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:06:02 ctl02 nova-api[16900]: 2017-09-28 13:06:02.586 16900 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:06:02 ctl02 nova-api[16900]: 2017-09-28 13:06:02.717 16900 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:06:02 ctl02 nova-api[16900]: 2017-09-28 13:06:02.720 16900 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:06:02 ctl02 nova-api[16900]: 2017-09-28 13:06:02.720 16900 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:06:02 ctl02 nova-api[16900]: 2017-09-28 13:06:02.721 16900 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:06:02 ctl02 nova-api[16900]: 2017-09-28 13:06:02.724 16900 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:06:02 ctl02 nova-api[16900]: 2017-09-28 13:06:02.724 16900 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:06:02 ctl02 nova-api[16900]: 2017-09-28 13:06:02.724 16900 ERROR nova Traceback (most recent call last):
Sep 28 13:06:02 ctl02 nova-api[16900]: 2017-09-28 13:06:02.724 16900 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:06:02 ctl02 nova-api[16900]: 2017-09-28 13:06:02.724 16900 ERROR nova     sys.exit(main())
Sep 28 13:06:02 ctl02 nova-api[16900]: 2017-09-28 13:06:02.724 16900 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:06:02 ctl02 nova-api[16900]: 2017-09-28 13:06:02.724 16900 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:06:02 ctl02 nova-api[16900]: 2017-09-28 13:06:02.724 16900 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:06:02 ctl02 nova-api[16900]: 2017-09-28 13:06:02.724 16900 ERROR nova     max_url_len=max_url_len)
Sep 28 13:06:02 ctl02 nova-api[16900]: 2017-09-28 13:06:02.724 16900 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:06:02 ctl02 nova-api[16900]: 2017-09-28 13:06:02.724 16900 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:06:02 ctl02 nova-api[16900]: 2017-09-28 13:06:02.724 16900 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:06:02 ctl02 nova-api[16900]: 2017-09-28 13:06:02.724 16900 ERROR nova     sock.listen(backlog)
Sep 28 13:06:02 ctl02 nova-api[16900]: 2017-09-28 13:06:02.724 16900 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:06:02 ctl02 nova-api[16900]: 2017-09-28 13:06:02.724 16900 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:06:02 ctl02 nova-api[16900]: 2017-09-28 13:06:02.724 16900 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:06:02 ctl02 nova-api[16900]: 2017-09-28 13:06:02.724 16900 ERROR nova
Sep 28 13:06:02 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:06:02 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:06:02 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:06:03 ctl02 glance-api[29183]: 2017-09-28 13:06:03.030 29258 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:06:03] "OPTIONS / HTTP/1.0" 200 134 0.000652
Sep 28 13:06:03 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:06:03 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:06:03 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:06:03 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:06:03 ctl02 glance-api[29183]: 2017-09-28 13:06:03.244 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:06:03] "OPTIONS / HTTP/1.0" 200 134 0.000675
Sep 28 13:06:03 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x465bbf11)
Sep 28 13:06:04 ctl02 heat-api-cfn[13300]: 2017-09-28 13:06:04.274 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:06:04] "OPTIONS / HTTP/1.0" 200 134 0.000424
Sep 28 13:06:04 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:06:04.359 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:06:04] "OPTIONS / HTTP/1.0" 200 134 0.000371
Sep 28 13:06:04 ctl02 neutron-server[30536]: 2017-09-28 13:06:04.403 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:06:04] "OPTIONS / HTTP/1.0" 200 262 0.000442
Sep 28 13:06:04 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 13:06:04 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 13:06:04 ctl02 nova-api[16918]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:06:04 ctl02 nova-api[16918]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:06:05 ctl02 nova-api[16918]: 2017-09-28 13:06:05.031 16918 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:06:05 ctl02 nova-api[16918]: 2017-09-28 13:06:05.032 16918 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:06:05 ctl02 nova-api[16918]: 2017-09-28 13:06:05.032 16918 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:06:05 ctl02 nova-api[16918]: 2017-09-28 13:06:05.032 16918 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:06:05 ctl02 nova-api[16918]: 2017-09-28 13:06:05.032 16918 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:06:05 ctl02 nova-api[16918]: 2017-09-28 13:06:05.032 16918 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:06:05 ctl02 nova-api[16918]: 2017-09-28 13:06:05.032 16918 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:06:05 ctl02 nova-api[16918]: 2017-09-28 13:06:05.032 16918 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:06:05 ctl02 nova-api[16918]: 2017-09-28 13:06:05.032 16918 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:06:05 ctl02 nova-api[16918]: 2017-09-28 13:06:05.032 16918 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:06:05 ctl02 nova-api[16918]: 2017-09-28 13:06:05.032 16918 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:06:05 ctl02 nova-api[16918]: 2017-09-28 13:06:05.032 16918 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:06:05 ctl02 nova-api[16918]: 2017-09-28 13:06:05.032 16918 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:06:05 ctl02 nova-api[16918]: 2017-09-28 13:06:05.032 16918 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:06:05 ctl02 nova-api[16918]: 2017-09-28 13:06:05.032 16918 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:06:05 ctl02 nova-api[16918]: 2017-09-28 13:06:05.032 16918 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:06:05 ctl02 nova-api[16918]: 2017-09-28 13:06:05.032 16918 ERROR nova.wsgi     self.filename))
Sep 28 13:06:05 ctl02 nova-api[16918]: 2017-09-28 13:06:05.032 16918 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:06:05 ctl02 nova-api[16918]: 2017-09-28 13:06:05.032 16918 ERROR nova.wsgi
Sep 28 13:06:05 ctl02 nova-api[16918]: 2017-09-28 13:06:05.035 16918 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:06:05 ctl02 nova-api[16918]: 2017-09-28 13:06:05.165 16918 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:06:05 ctl02 nova-api[16918]: 2017-09-28 13:06:05.386 16918 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:06:05 ctl02 nova-api[16918]: 2017-09-28 13:06:05.389 16918 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:06:05 ctl02 nova-api[16918]: 2017-09-28 13:06:05.389 16918 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:06:05 ctl02 nova-api[16918]: 2017-09-28 13:06:05.389 16918 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:06:05 ctl02 nova-api[16918]: 2017-09-28 13:06:05.521 16918 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:06:05 ctl02 nova-api[16918]: 2017-09-28 13:06:05.524 16918 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:06:05 ctl02 nova-api[16918]: 2017-09-28 13:06:05.524 16918 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:06:05 ctl02 nova-api[16918]: 2017-09-28 13:06:05.525 16918 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:06:05 ctl02 nova-api[16918]: 2017-09-28 13:06:05.528 16918 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:06:05 ctl02 nova-api[16918]: 2017-09-28 13:06:05.529 16918 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:06:05 ctl02 nova-api[16918]: 2017-09-28 13:06:05.529 16918 ERROR nova Traceback (most recent call last):
Sep 28 13:06:05 ctl02 nova-api[16918]: 2017-09-28 13:06:05.529 16918 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:06:05 ctl02 nova-api[16918]: 2017-09-28 13:06:05.529 16918 ERROR nova     sys.exit(main())
Sep 28 13:06:05 ctl02 nova-api[16918]: 2017-09-28 13:06:05.529 16918 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:06:05 ctl02 nova-api[16918]: 2017-09-28 13:06:05.529 16918 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:06:05 ctl02 nova-api[16918]: 2017-09-28 13:06:05.529 16918 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:06:05 ctl02 nova-api[16918]: 2017-09-28 13:06:05.529 16918 ERROR nova     max_url_len=max_url_len)
Sep 28 13:06:05 ctl02 nova-api[16918]: 2017-09-28 13:06:05.529 16918 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:06:05 ctl02 nova-api[16918]: 2017-09-28 13:06:05.529 16918 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:06:05 ctl02 nova-api[16918]: 2017-09-28 13:06:05.529 16918 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:06:05 ctl02 nova-api[16918]: 2017-09-28 13:06:05.529 16918 ERROR nova     sock.listen(backlog)
Sep 28 13:06:05 ctl02 nova-api[16918]: 2017-09-28 13:06:05.529 16918 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:06:05 ctl02 nova-api[16918]: 2017-09-28 13:06:05.529 16918 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:06:05 ctl02 nova-api[16918]: 2017-09-28 13:06:05.529 16918 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:06:05 ctl02 nova-api[16918]: 2017-09-28 13:06:05.529 16918 ERROR nova
Sep 28 13:06:05 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:06:05 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:06:05 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:06:05 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:06:05 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:06:05 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:06:05 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:06:05 ctl02 neutron-server[30536]: 2017-09-28 13:06:05.976 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 13:06:05 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 13:06:05 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 13:05:06 cmp002
Sep 28 13:06:05 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 13:05:08 cmp001
Sep 28 13:06:05 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 13:04:30 cmp002
Sep 28 13:06:07 ctl02 heat-api-cfn[13300]: 2017-09-28 13:06:07.221 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:06:07] "OPTIONS / HTTP/1.0" 200 134 0.000458
Sep 28 13:06:07 ctl02 nova-api[16940]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:06:07 ctl02 nova-api[16940]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:06:07 ctl02 nova-api[16940]: 2017-09-28 13:06:07.761 16940 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:06:07 ctl02 nova-api[16940]: 2017-09-28 13:06:07.762 16940 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:06:07 ctl02 nova-api[16940]: 2017-09-28 13:06:07.762 16940 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:06:07 ctl02 nova-api[16940]: 2017-09-28 13:06:07.762 16940 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:06:07 ctl02 nova-api[16940]: 2017-09-28 13:06:07.762 16940 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:06:07 ctl02 nova-api[16940]: 2017-09-28 13:06:07.762 16940 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:06:07 ctl02 nova-api[16940]: 2017-09-28 13:06:07.762 16940 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:06:07 ctl02 nova-api[16940]: 2017-09-28 13:06:07.762 16940 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:06:07 ctl02 nova-api[16940]: 2017-09-28 13:06:07.762 16940 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:06:07 ctl02 nova-api[16940]: 2017-09-28 13:06:07.762 16940 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:06:07 ctl02 nova-api[16940]: 2017-09-28 13:06:07.762 16940 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:06:07 ctl02 nova-api[16940]: 2017-09-28 13:06:07.762 16940 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:06:07 ctl02 nova-api[16940]: 2017-09-28 13:06:07.762 16940 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:06:07 ctl02 nova-api[16940]: 2017-09-28 13:06:07.762 16940 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:06:07 ctl02 nova-api[16940]: 2017-09-28 13:06:07.762 16940 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:06:07 ctl02 nova-api[16940]: 2017-09-28 13:06:07.762 16940 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:06:07 ctl02 nova-api[16940]: 2017-09-28 13:06:07.762 16940 ERROR nova.wsgi     self.filename))
Sep 28 13:06:07 ctl02 nova-api[16940]: 2017-09-28 13:06:07.762 16940 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:06:07 ctl02 nova-api[16940]: 2017-09-28 13:06:07.762 16940 ERROR nova.wsgi
Sep 28 13:06:07 ctl02 nova-api[16940]: 2017-09-28 13:06:07.764 16940 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:06:07 ctl02 heat-api-cfn[13300]: 2017-09-28 13:06:07.811 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:06:07] "OPTIONS / HTTP/1.0" 200 134 0.000434
Sep 28 13:06:07 ctl02 nova-api[16940]: 2017-09-28 13:06:07.891 16940 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:06:08 ctl02 nova-api[16940]: 2017-09-28 13:06:08.111 16940 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:06:08 ctl02 nova-api[16940]: 2017-09-28 13:06:08.114 16940 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:06:08 ctl02 nova-api[16940]: 2017-09-28 13:06:08.115 16940 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:06:08 ctl02 nova-api[16940]: 2017-09-28 13:06:08.115 16940 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:06:08 ctl02 nova-api[16940]: 2017-09-28 13:06:08.245 16940 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:06:08 ctl02 nova-api[16940]: 2017-09-28 13:06:08.248 16940 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:06:08 ctl02 nova-api[16940]: 2017-09-28 13:06:08.248 16940 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:06:08 ctl02 nova-api[16940]: 2017-09-28 13:06:08.248 16940 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:06:08 ctl02 nova-api[16940]: 2017-09-28 13:06:08.252 16940 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:06:08 ctl02 nova-api[16940]: 2017-09-28 13:06:08.252 16940 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:06:08 ctl02 nova-api[16940]: 2017-09-28 13:06:08.252 16940 ERROR nova Traceback (most recent call last):
Sep 28 13:06:08 ctl02 nova-api[16940]: 2017-09-28 13:06:08.252 16940 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:06:08 ctl02 nova-api[16940]: 2017-09-28 13:06:08.252 16940 ERROR nova     sys.exit(main())
Sep 28 13:06:08 ctl02 nova-api[16940]: 2017-09-28 13:06:08.252 16940 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:06:08 ctl02 nova-api[16940]: 2017-09-28 13:06:08.252 16940 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:06:08 ctl02 nova-api[16940]: 2017-09-28 13:06:08.252 16940 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:06:08 ctl02 nova-api[16940]: 2017-09-28 13:06:08.252 16940 ERROR nova     max_url_len=max_url_len)
Sep 28 13:06:08 ctl02 nova-api[16940]: 2017-09-28 13:06:08.252 16940 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:06:08 ctl02 nova-api[16940]: 2017-09-28 13:06:08.252 16940 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:06:08 ctl02 nova-api[16940]: 2017-09-28 13:06:08.252 16940 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:06:08 ctl02 nova-api[16940]: 2017-09-28 13:06:08.252 16940 ERROR nova     sock.listen(backlog)
Sep 28 13:06:08 ctl02 nova-api[16940]: 2017-09-28 13:06:08.252 16940 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:06:08 ctl02 nova-api[16940]: 2017-09-28 13:06:08.252 16940 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:06:08 ctl02 nova-api[16940]: 2017-09-28 13:06:08.252 16940 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:06:08 ctl02 nova-api[16940]: 2017-09-28 13:06:08.252 16940 ERROR nova
Sep 28 13:06:08 ctl02 neutron-server[30536]: 2017-09-28 13:06:08.334 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:06:08] "OPTIONS / HTTP/1.0" 200 262 0.000451
Sep 28 13:06:08 ctl02 heat-api[13008]: 2017-09-28 13:06:08.381 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:06:08] "OPTIONS / HTTP/1.0" 200 134 0.000540
Sep 28 13:06:08 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:06:08.387 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:06:08] "OPTIONS / HTTP/1.0" 200 134 0.000365
Sep 28 13:06:08 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:06:08 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:06:08 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:06:08 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:06:08 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:06:08 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:06:08 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:06:09 ctl02 heat-api[13008]: 2017-09-28 13:06:09.700 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:06:09] "OPTIONS / HTTP/1.0" 200 134 0.000581
Sep 28 13:06:10 ctl02 glance-api[29183]: 2017-09-28 13:06:10.207 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:06:10] "OPTIONS / HTTP/1.0" 200 134 0.000607
Sep 28 13:06:10 ctl02 nova-api[16959]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:06:10 ctl02 nova-api[16959]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:06:10 ctl02 nova-api[16959]: 2017-09-28 13:06:10.462 16959 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:06:10 ctl02 nova-api[16959]: 2017-09-28 13:06:10.463 16959 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:06:10 ctl02 nova-api[16959]: 2017-09-28 13:06:10.463 16959 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:06:10 ctl02 nova-api[16959]: 2017-09-28 13:06:10.463 16959 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:06:10 ctl02 nova-api[16959]: 2017-09-28 13:06:10.463 16959 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:06:10 ctl02 nova-api[16959]: 2017-09-28 13:06:10.463 16959 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:06:10 ctl02 nova-api[16959]: 2017-09-28 13:06:10.463 16959 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:06:10 ctl02 nova-api[16959]: 2017-09-28 13:06:10.463 16959 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:06:10 ctl02 nova-api[16959]: 2017-09-28 13:06:10.463 16959 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:06:10 ctl02 nova-api[16959]: 2017-09-28 13:06:10.463 16959 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:06:10 ctl02 nova-api[16959]: 2017-09-28 13:06:10.463 16959 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:06:10 ctl02 nova-api[16959]: 2017-09-28 13:06:10.463 16959 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:06:10 ctl02 nova-api[16959]: 2017-09-28 13:06:10.463 16959 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:06:10 ctl02 nova-api[16959]: 2017-09-28 13:06:10.463 16959 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:06:10 ctl02 nova-api[16959]: 2017-09-28 13:06:10.463 16959 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:06:10 ctl02 nova-api[16959]: 2017-09-28 13:06:10.463 16959 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:06:10 ctl02 nova-api[16959]: 2017-09-28 13:06:10.463 16959 ERROR nova.wsgi     self.filename))
Sep 28 13:06:10 ctl02 nova-api[16959]: 2017-09-28 13:06:10.463 16959 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:06:10 ctl02 nova-api[16959]: 2017-09-28 13:06:10.463 16959 ERROR nova.wsgi
Sep 28 13:06:10 ctl02 nova-api[16959]: 2017-09-28 13:06:10.466 16959 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:06:10 ctl02 nova-api[16959]: 2017-09-28 13:06:10.590 16959 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:06:10 ctl02 nova-api[16959]: 2017-09-28 13:06:10.810 16959 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:06:10 ctl02 nova-api[16959]: 2017-09-28 13:06:10.812 16959 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:06:10 ctl02 nova-api[16959]: 2017-09-28 13:06:10.813 16959 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:06:10 ctl02 nova-api[16959]: 2017-09-28 13:06:10.813 16959 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:06:10 ctl02 neutron-server[30536]: 2017-09-28 13:06:10.817 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:06:10] "OPTIONS / HTTP/1.0" 200 262 0.000469
Sep 28 13:06:10 ctl02 nova-api[16959]: 2017-09-28 13:06:10.944 16959 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:06:10 ctl02 nova-api[16959]: 2017-09-28 13:06:10.946 16959 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:06:10 ctl02 nova-api[16959]: 2017-09-28 13:06:10.946 16959 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:06:10 ctl02 nova-api[16959]: 2017-09-28 13:06:10.947 16959 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:06:10 ctl02 nova-api[16959]: 2017-09-28 13:06:10.950 16959 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:06:10 ctl02 nova-api[16959]: 2017-09-28 13:06:10.951 16959 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:06:10 ctl02 nova-api[16959]: 2017-09-28 13:06:10.951 16959 ERROR nova Traceback (most recent call last):
Sep 28 13:06:10 ctl02 nova-api[16959]: 2017-09-28 13:06:10.951 16959 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:06:10 ctl02 nova-api[16959]: 2017-09-28 13:06:10.951 16959 ERROR nova     sys.exit(main())
Sep 28 13:06:10 ctl02 nova-api[16959]: 2017-09-28 13:06:10.951 16959 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:06:10 ctl02 nova-api[16959]: 2017-09-28 13:06:10.951 16959 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:06:10 ctl02 nova-api[16959]: 2017-09-28 13:06:10.951 16959 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:06:10 ctl02 nova-api[16959]: 2017-09-28 13:06:10.951 16959 ERROR nova     max_url_len=max_url_len)
Sep 28 13:06:10 ctl02 nova-api[16959]: 2017-09-28 13:06:10.951 16959 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:06:10 ctl02 nova-api[16959]: 2017-09-28 13:06:10.951 16959 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:06:10 ctl02 nova-api[16959]: 2017-09-28 13:06:10.951 16959 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:06:10 ctl02 nova-api[16959]: 2017-09-28 13:06:10.951 16959 ERROR nova     sock.listen(backlog)
Sep 28 13:06:10 ctl02 nova-api[16959]: 2017-09-28 13:06:10.951 16959 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:06:10 ctl02 nova-api[16959]: 2017-09-28 13:06:10.951 16959 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:06:10 ctl02 nova-api[16959]: 2017-09-28 13:06:10.951 16959 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:06:10 ctl02 nova-api[16959]: 2017-09-28 13:06:10.951 16959 ERROR nova
Sep 28 13:06:11 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:06:11.015 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:06:11] "OPTIONS / HTTP/1.0" 200 134 0.000408
Sep 28 13:06:11 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:06:11 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:06:11 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:06:11 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:06:11 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:06:11 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:06:11 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:06:12 ctl02 heat-api[13008]: 2017-09-28 13:06:12.468 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:06:12] "OPTIONS / HTTP/1.0" 200 134 0.000526
Sep 28 13:06:13 ctl02 nova-api[16980]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:06:13 ctl02 nova-api[16980]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:06:13 ctl02 glance-api[29183]: 2017-09-28 13:06:13.209 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:06:13] "OPTIONS / HTTP/1.0" 200 134 0.000610
Sep 28 13:06:13 ctl02 nova-api[16980]: 2017-09-28 13:06:13.277 16980 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:06:13 ctl02 nova-api[16980]: 2017-09-28 13:06:13.278 16980 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:06:13 ctl02 nova-api[16980]: 2017-09-28 13:06:13.278 16980 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:06:13 ctl02 nova-api[16980]: 2017-09-28 13:06:13.278 16980 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:06:13 ctl02 nova-api[16980]: 2017-09-28 13:06:13.278 16980 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:06:13 ctl02 nova-api[16980]: 2017-09-28 13:06:13.278 16980 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:06:13 ctl02 nova-api[16980]: 2017-09-28 13:06:13.278 16980 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:06:13 ctl02 nova-api[16980]: 2017-09-28 13:06:13.278 16980 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:06:13 ctl02 nova-api[16980]: 2017-09-28 13:06:13.278 16980 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:06:13 ctl02 nova-api[16980]: 2017-09-28 13:06:13.278 16980 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:06:13 ctl02 nova-api[16980]: 2017-09-28 13:06:13.278 16980 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:06:13 ctl02 nova-api[16980]: 2017-09-28 13:06:13.278 16980 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:06:13 ctl02 nova-api[16980]: 2017-09-28 13:06:13.278 16980 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:06:13 ctl02 nova-api[16980]: 2017-09-28 13:06:13.278 16980 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:06:13 ctl02 nova-api[16980]: 2017-09-28 13:06:13.278 16980 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:06:13 ctl02 nova-api[16980]: 2017-09-28 13:06:13.278 16980 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:06:13 ctl02 nova-api[16980]: 2017-09-28 13:06:13.278 16980 ERROR nova.wsgi     self.filename))
Sep 28 13:06:13 ctl02 nova-api[16980]: 2017-09-28 13:06:13.278 16980 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:06:13 ctl02 nova-api[16980]: 2017-09-28 13:06:13.278 16980 ERROR nova.wsgi
Sep 28 13:06:13 ctl02 nova-api[16980]: 2017-09-28 13:06:13.279 16980 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:06:13 ctl02 nova-api[16980]: 2017-09-28 13:06:13.407 16980 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:06:13 ctl02 glance-api[29183]: 2017-09-28 13:06:13.512 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:06:13] "OPTIONS / HTTP/1.0" 200 134 0.000577
Sep 28 13:06:13 ctl02 neutron-server[30536]: 2017-09-28 13:06:13.547 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 13:06:13 ctl02 nova-api[16980]: 2017-09-28 13:06:13.637 16980 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:06:13 ctl02 nova-api[16980]: 2017-09-28 13:06:13.639 16980 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:06:13 ctl02 nova-api[16980]: 2017-09-28 13:06:13.639 16980 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:06:13 ctl02 nova-api[16980]: 2017-09-28 13:06:13.639 16980 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:06:13 ctl02 nova-api[16980]: 2017-09-28 13:06:13.770 16980 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:06:13 ctl02 nova-api[16980]: 2017-09-28 13:06:13.772 16980 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:06:13 ctl02 nova-api[16980]: 2017-09-28 13:06:13.772 16980 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:06:13 ctl02 nova-api[16980]: 2017-09-28 13:06:13.772 16980 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:06:13 ctl02 nova-api[16980]: 2017-09-28 13:06:13.776 16980 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:06:13 ctl02 nova-api[16980]: 2017-09-28 13:06:13.776 16980 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:06:13 ctl02 nova-api[16980]: 2017-09-28 13:06:13.776 16980 ERROR nova Traceback (most recent call last):
Sep 28 13:06:13 ctl02 nova-api[16980]: 2017-09-28 13:06:13.776 16980 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:06:13 ctl02 nova-api[16980]: 2017-09-28 13:06:13.776 16980 ERROR nova     sys.exit(main())
Sep 28 13:06:13 ctl02 nova-api[16980]: 2017-09-28 13:06:13.776 16980 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:06:13 ctl02 nova-api[16980]: 2017-09-28 13:06:13.776 16980 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:06:13 ctl02 nova-api[16980]: 2017-09-28 13:06:13.776 16980 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:06:13 ctl02 nova-api[16980]: 2017-09-28 13:06:13.776 16980 ERROR nova     max_url_len=max_url_len)
Sep 28 13:06:13 ctl02 nova-api[16980]: 2017-09-28 13:06:13.776 16980 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:06:13 ctl02 nova-api[16980]: 2017-09-28 13:06:13.776 16980 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:06:13 ctl02 nova-api[16980]: 2017-09-28 13:06:13.776 16980 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:06:13 ctl02 nova-api[16980]: 2017-09-28 13:06:13.776 16980 ERROR nova     sock.listen(backlog)
Sep 28 13:06:13 ctl02 nova-api[16980]: 2017-09-28 13:06:13.776 16980 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:06:13 ctl02 nova-api[16980]: 2017-09-28 13:06:13.776 16980 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:06:13 ctl02 nova-api[16980]: 2017-09-28 13:06:13.776 16980 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:06:13 ctl02 nova-api[16980]: 2017-09-28 13:06:13.776 16980 ERROR nova
Sep 28 13:06:13 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:06:13 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:06:13 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:06:13 ctl02 heat-api-cfn[13300]: 2017-09-28 13:06:13.967 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:06:13] "OPTIONS / HTTP/1.0" 200 134 0.000454
Sep 28 13:06:14 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:06:14 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:06:14 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:06:14 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:06:14 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:06:14.248 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:06:14] "OPTIONS / HTTP/1.0" 200 134 0.000378
Sep 28 13:06:14 ctl02 neutron-server[30536]: 2017-09-28 13:06:14.532 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:06:14] "OPTIONS / HTTP/1.0" 200 262 0.000445
Sep 28 13:06:15 ctl02 nova-conductor[5056]: 2017-09-28 13:06:15.350 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:06:15 ctl02 nova-conductor[5056]: 2017-09-28 13:06:15.362 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:06:15 ctl02 nova-conductor[5056]: 2017-09-28 13:06:15.378 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:06:15 ctl02 nova-conductor[5056]: 2017-09-28 13:06:15.379 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:06:15 ctl02 nova-api[16998]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:06:15 ctl02 nova-api[16998]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:06:15 ctl02 nova-api[16998]: 2017-09-28 13:06:15.985 16998 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:06:15 ctl02 nova-api[16998]: 2017-09-28 13:06:15.987 16998 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:06:15 ctl02 nova-api[16998]: 2017-09-28 13:06:15.987 16998 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:06:15 ctl02 nova-api[16998]: 2017-09-28 13:06:15.987 16998 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:06:15 ctl02 nova-api[16998]: 2017-09-28 13:06:15.987 16998 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:06:15 ctl02 nova-api[16998]: 2017-09-28 13:06:15.987 16998 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:06:15 ctl02 nova-api[16998]: 2017-09-28 13:06:15.987 16998 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:06:15 ctl02 nova-api[16998]: 2017-09-28 13:06:15.987 16998 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:06:15 ctl02 nova-api[16998]: 2017-09-28 13:06:15.987 16998 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:06:15 ctl02 nova-api[16998]: 2017-09-28 13:06:15.987 16998 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:06:15 ctl02 nova-api[16998]: 2017-09-28 13:06:15.987 16998 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:06:15 ctl02 nova-api[16998]: 2017-09-28 13:06:15.987 16998 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:06:15 ctl02 nova-api[16998]: 2017-09-28 13:06:15.987 16998 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:06:15 ctl02 nova-api[16998]: 2017-09-28 13:06:15.987 16998 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:06:15 ctl02 nova-api[16998]: 2017-09-28 13:06:15.987 16998 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:06:15 ctl02 nova-api[16998]: 2017-09-28 13:06:15.987 16998 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:06:15 ctl02 nova-api[16998]: 2017-09-28 13:06:15.987 16998 ERROR nova.wsgi     self.filename))
Sep 28 13:06:15 ctl02 nova-api[16998]: 2017-09-28 13:06:15.987 16998 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:06:15 ctl02 nova-api[16998]: 2017-09-28 13:06:15.987 16998 ERROR nova.wsgi
Sep 28 13:06:15 ctl02 nova-api[16998]: 2017-09-28 13:06:15.988 16998 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:06:16 ctl02 nova-api[16998]: 2017-09-28 13:06:16.115 16998 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:06:16 ctl02 nova-cert[4860]: 2017-09-28 13:06:16.244 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:06:16 ctl02 nova-api[16998]: 2017-09-28 13:06:16.339 16998 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:06:16 ctl02 nova-api[16998]: 2017-09-28 13:06:16.341 16998 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:06:16 ctl02 nova-api[16998]: 2017-09-28 13:06:16.341 16998 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:06:16 ctl02 nova-api[16998]: 2017-09-28 13:06:16.341 16998 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:06:16 ctl02 nova-api[16998]: 2017-09-28 13:06:16.472 16998 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:06:16 ctl02 nova-api[16998]: 2017-09-28 13:06:16.474 16998 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:06:16 ctl02 nova-api[16998]: 2017-09-28 13:06:16.474 16998 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:06:16 ctl02 nova-api[16998]: 2017-09-28 13:06:16.474 16998 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:06:16 ctl02 nova-api[16998]: 2017-09-28 13:06:16.477 16998 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:06:16 ctl02 nova-api[16998]: 2017-09-28 13:06:16.478 16998 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:06:16 ctl02 nova-api[16998]: 2017-09-28 13:06:16.478 16998 ERROR nova Traceback (most recent call last):
Sep 28 13:06:16 ctl02 nova-api[16998]: 2017-09-28 13:06:16.478 16998 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:06:16 ctl02 nova-api[16998]: 2017-09-28 13:06:16.478 16998 ERROR nova     sys.exit(main())
Sep 28 13:06:16 ctl02 nova-api[16998]: 2017-09-28 13:06:16.478 16998 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:06:16 ctl02 nova-api[16998]: 2017-09-28 13:06:16.478 16998 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:06:16 ctl02 nova-api[16998]: 2017-09-28 13:06:16.478 16998 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:06:16 ctl02 nova-api[16998]: 2017-09-28 13:06:16.478 16998 ERROR nova     max_url_len=max_url_len)
Sep 28 13:06:16 ctl02 nova-api[16998]: 2017-09-28 13:06:16.478 16998 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:06:16 ctl02 nova-api[16998]: 2017-09-28 13:06:16.478 16998 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:06:16 ctl02 nova-api[16998]: 2017-09-28 13:06:16.478 16998 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:06:16 ctl02 nova-api[16998]: 2017-09-28 13:06:16.478 16998 ERROR nova     sock.listen(backlog)
Sep 28 13:06:16 ctl02 nova-api[16998]: 2017-09-28 13:06:16.478 16998 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:06:16 ctl02 nova-api[16998]: 2017-09-28 13:06:16.478 16998 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:06:16 ctl02 nova-api[16998]: 2017-09-28 13:06:16.478 16998 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:06:16 ctl02 nova-api[16998]: 2017-09-28 13:06:16.478 16998 ERROR nova
Sep 28 13:06:16 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:06:16 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:06:16 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:06:16 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:06:16 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:06:16 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:06:16 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:06:17 ctl02 heat-api-cfn[13300]: 2017-09-28 13:06:17.295 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:06:17] "OPTIONS / HTTP/1.0" 200 134 0.000447
Sep 28 13:06:18 ctl02 heat-api[13008]: 2017-09-28 13:06:18.020 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:06:18] "OPTIONS / HTTP/1.0" 200 134 0.000522
Sep 28 13:06:18 ctl02 heat-api-cfn[13300]: 2017-09-28 13:06:18.107 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:06:18] "OPTIONS / HTTP/1.0" 200 134 0.000430
Sep 28 13:06:18 ctl02 neutron-server[30536]: 2017-09-28 13:06:18.552 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:06:18] "OPTIONS / HTTP/1.0" 200 262 0.000500
Sep 28 13:06:18 ctl02 nova-api[17015]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:06:18 ctl02 nova-api[17015]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:06:18 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:06:18.677 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:06:18] "OPTIONS / HTTP/1.0" 200 134 0.000380
Sep 28 13:06:18 ctl02 nova-api[17015]: 2017-09-28 13:06:18.761 17015 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:06:18 ctl02 nova-api[17015]: 2017-09-28 13:06:18.762 17015 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:06:18 ctl02 nova-api[17015]: 2017-09-28 13:06:18.762 17015 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:06:18 ctl02 nova-api[17015]: 2017-09-28 13:06:18.762 17015 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:06:18 ctl02 nova-api[17015]: 2017-09-28 13:06:18.762 17015 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:06:18 ctl02 nova-api[17015]: 2017-09-28 13:06:18.762 17015 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:06:18 ctl02 nova-api[17015]: 2017-09-28 13:06:18.762 17015 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:06:18 ctl02 nova-api[17015]: 2017-09-28 13:06:18.762 17015 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:06:18 ctl02 nova-api[17015]: 2017-09-28 13:06:18.762 17015 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:06:18 ctl02 nova-api[17015]: 2017-09-28 13:06:18.762 17015 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:06:18 ctl02 nova-api[17015]: 2017-09-28 13:06:18.762 17015 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:06:18 ctl02 nova-api[17015]: 2017-09-28 13:06:18.762 17015 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:06:18 ctl02 nova-api[17015]: 2017-09-28 13:06:18.762 17015 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:06:18 ctl02 nova-api[17015]: 2017-09-28 13:06:18.762 17015 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:06:18 ctl02 nova-api[17015]: 2017-09-28 13:06:18.762 17015 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:06:18 ctl02 nova-api[17015]: 2017-09-28 13:06:18.762 17015 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:06:18 ctl02 nova-api[17015]: 2017-09-28 13:06:18.762 17015 ERROR nova.wsgi     self.filename))
Sep 28 13:06:18 ctl02 nova-api[17015]: 2017-09-28 13:06:18.762 17015 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:06:18 ctl02 nova-api[17015]: 2017-09-28 13:06:18.762 17015 ERROR nova.wsgi
Sep 28 13:06:18 ctl02 nova-api[17015]: 2017-09-28 13:06:18.764 17015 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:06:18 ctl02 nova-api[17015]: 2017-09-28 13:06:18.891 17015 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:06:19 ctl02 nova-api[17015]: 2017-09-28 13:06:19.111 17015 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:06:19 ctl02 nova-api[17015]: 2017-09-28 13:06:19.113 17015 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:06:19 ctl02 nova-api[17015]: 2017-09-28 13:06:19.113 17015 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:06:19 ctl02 nova-api[17015]: 2017-09-28 13:06:19.114 17015 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:06:19 ctl02 nova-api[17015]: 2017-09-28 13:06:19.245 17015 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:06:19 ctl02 nova-api[17015]: 2017-09-28 13:06:19.247 17015 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:06:19 ctl02 nova-api[17015]: 2017-09-28 13:06:19.247 17015 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:06:19 ctl02 nova-api[17015]: 2017-09-28 13:06:19.248 17015 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:06:19 ctl02 nova-api[17015]: 2017-09-28 13:06:19.251 17015 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:06:19 ctl02 nova-api[17015]: 2017-09-28 13:06:19.251 17015 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:06:19 ctl02 nova-api[17015]: 2017-09-28 13:06:19.251 17015 ERROR nova Traceback (most recent call last):
Sep 28 13:06:19 ctl02 nova-api[17015]: 2017-09-28 13:06:19.251 17015 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:06:19 ctl02 nova-api[17015]: 2017-09-28 13:06:19.251 17015 ERROR nova     sys.exit(main())
Sep 28 13:06:19 ctl02 nova-api[17015]: 2017-09-28 13:06:19.251 17015 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:06:19 ctl02 nova-api[17015]: 2017-09-28 13:06:19.251 17015 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:06:19 ctl02 nova-api[17015]: 2017-09-28 13:06:19.251 17015 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:06:19 ctl02 nova-api[17015]: 2017-09-28 13:06:19.251 17015 ERROR nova     max_url_len=max_url_len)
Sep 28 13:06:19 ctl02 nova-api[17015]: 2017-09-28 13:06:19.251 17015 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:06:19 ctl02 nova-api[17015]: 2017-09-28 13:06:19.251 17015 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:06:19 ctl02 nova-api[17015]: 2017-09-28 13:06:19.251 17015 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:06:19 ctl02 nova-api[17015]: 2017-09-28 13:06:19.251 17015 ERROR nova     sock.listen(backlog)
Sep 28 13:06:19 ctl02 nova-api[17015]: 2017-09-28 13:06:19.251 17015 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:06:19 ctl02 nova-api[17015]: 2017-09-28 13:06:19.251 17015 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:06:19 ctl02 nova-api[17015]: 2017-09-28 13:06:19.251 17015 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:06:19 ctl02 nova-api[17015]: 2017-09-28 13:06:19.251 17015 ERROR nova
Sep 28 13:06:19 ctl02 heat-api[13008]: 2017-09-28 13:06:19.361 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:06:19] "OPTIONS / HTTP/1.0" 200 134 0.000563
Sep 28 13:06:19 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:06:19 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:06:19 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:06:19 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:06:19 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:06:19 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:06:19 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:06:20 ctl02 glance-api[29183]: 2017-09-28 13:06:20.053 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:06:20] "OPTIONS / HTTP/1.0" 200 134 0.000541
Sep 28 13:06:20 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf90db47b)
Sep 28 13:06:20 ctl02 neutron-server[30536]: 2017-09-28 13:06:20.778 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:06:20] "OPTIONS / HTTP/1.0" 200 262 0.000468
Sep 28 13:06:20 ctl02 neutron-server[30536]: 2017-09-28 13:06:20.973 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 4 dead agents out of 6:
Sep 28 13:06:20 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 13:06:20 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 13:05:06 cmp002
Sep 28 13:06:20 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 13:05:08 cmp001
Sep 28 13:06:20 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 13:04:30 cmp002
Sep 28 13:06:20 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 13:05:36 cmp002
Sep 28 13:06:21 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:06:21.273 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:06:21] "OPTIONS / HTTP/1.0" 200 134 0.000347
Sep 28 13:06:21 ctl02 nova-api[17034]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:06:21 ctl02 nova-api[17034]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:06:21 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf90db47b)
Sep 28 13:06:21 ctl02 nova-api[17034]: 2017-09-28 13:06:21.468 17034 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:06:21 ctl02 nova-api[17034]: 2017-09-28 13:06:21.470 17034 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:06:21 ctl02 nova-api[17034]: 2017-09-28 13:06:21.470 17034 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:06:21 ctl02 nova-api[17034]: 2017-09-28 13:06:21.470 17034 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:06:21 ctl02 nova-api[17034]: 2017-09-28 13:06:21.470 17034 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:06:21 ctl02 nova-api[17034]: 2017-09-28 13:06:21.470 17034 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:06:21 ctl02 nova-api[17034]: 2017-09-28 13:06:21.470 17034 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:06:21 ctl02 nova-api[17034]: 2017-09-28 13:06:21.470 17034 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:06:21 ctl02 nova-api[17034]: 2017-09-28 13:06:21.470 17034 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:06:21 ctl02 nova-api[17034]: 2017-09-28 13:06:21.470 17034 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:06:21 ctl02 nova-api[17034]: 2017-09-28 13:06:21.470 17034 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:06:21 ctl02 nova-api[17034]: 2017-09-28 13:06:21.470 17034 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:06:21 ctl02 nova-api[17034]: 2017-09-28 13:06:21.470 17034 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:06:21 ctl02 nova-api[17034]: 2017-09-28 13:06:21.470 17034 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:06:21 ctl02 nova-api[17034]: 2017-09-28 13:06:21.470 17034 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:06:21 ctl02 nova-api[17034]: 2017-09-28 13:06:21.470 17034 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:06:21 ctl02 nova-api[17034]: 2017-09-28 13:06:21.470 17034 ERROR nova.wsgi     self.filename))
Sep 28 13:06:21 ctl02 nova-api[17034]: 2017-09-28 13:06:21.470 17034 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:06:21 ctl02 nova-api[17034]: 2017-09-28 13:06:21.470 17034 ERROR nova.wsgi
Sep 28 13:06:21 ctl02 nova-api[17034]: 2017-09-28 13:06:21.471 17034 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:06:21 ctl02 nova-api[17034]: 2017-09-28 13:06:21.598 17034 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:06:21 ctl02 nova-api[17034]: 2017-09-28 13:06:21.819 17034 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:06:21 ctl02 nova-api[17034]: 2017-09-28 13:06:21.821 17034 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:06:21 ctl02 nova-api[17034]: 2017-09-28 13:06:21.822 17034 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:06:21 ctl02 nova-api[17034]: 2017-09-28 13:06:21.822 17034 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:06:21 ctl02 nova-api[17034]: 2017-09-28 13:06:21.952 17034 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:06:21 ctl02 nova-api[17034]: 2017-09-28 13:06:21.954 17034 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:06:21 ctl02 nova-api[17034]: 2017-09-28 13:06:21.954 17034 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:06:21 ctl02 nova-api[17034]: 2017-09-28 13:06:21.954 17034 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:06:21 ctl02 nova-api[17034]: 2017-09-28 13:06:21.957 17034 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:06:21 ctl02 nova-api[17034]: 2017-09-28 13:06:21.958 17034 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:06:21 ctl02 nova-api[17034]: 2017-09-28 13:06:21.958 17034 ERROR nova Traceback (most recent call last):
Sep 28 13:06:21 ctl02 nova-api[17034]: 2017-09-28 13:06:21.958 17034 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:06:21 ctl02 nova-api[17034]: 2017-09-28 13:06:21.958 17034 ERROR nova     sys.exit(main())
Sep 28 13:06:21 ctl02 nova-api[17034]: 2017-09-28 13:06:21.958 17034 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:06:21 ctl02 nova-api[17034]: 2017-09-28 13:06:21.958 17034 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:06:21 ctl02 nova-api[17034]: 2017-09-28 13:06:21.958 17034 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:06:21 ctl02 nova-api[17034]: 2017-09-28 13:06:21.958 17034 ERROR nova     max_url_len=max_url_len)
Sep 28 13:06:21 ctl02 nova-api[17034]: 2017-09-28 13:06:21.958 17034 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:06:21 ctl02 nova-api[17034]: 2017-09-28 13:06:21.958 17034 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:06:21 ctl02 nova-api[17034]: 2017-09-28 13:06:21.958 17034 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:06:21 ctl02 nova-api[17034]: 2017-09-28 13:06:21.958 17034 ERROR nova     sock.listen(backlog)
Sep 28 13:06:21 ctl02 nova-api[17034]: 2017-09-28 13:06:21.958 17034 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:06:21 ctl02 nova-api[17034]: 2017-09-28 13:06:21.958 17034 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:06:21 ctl02 nova-api[17034]: 2017-09-28 13:06:21.958 17034 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:06:21 ctl02 nova-api[17034]: 2017-09-28 13:06:21.958 17034 ERROR nova
Sep 28 13:06:22 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:06:22 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:06:22 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:06:22 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf90db47b)
Sep 28 13:06:22 ctl02 heat-api[13008]: 2017-09-28 13:06:22.356 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:06:22] "OPTIONS / HTTP/1.0" 200 134 0.000532
Sep 28 13:06:22 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:06:22 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:06:22 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:06:22 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:06:23 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf90db47b)
Sep 28 13:06:23 ctl02 glance-api[29183]: 2017-09-28 13:06:23.388 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:06:23] "OPTIONS / HTTP/1.0" 200 134 0.000555
Sep 28 13:06:23 ctl02 glance-api[29183]: 2017-09-28 13:06:23.608 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:06:23] "OPTIONS / HTTP/1.0" 200 134 0.000581
Sep 28 13:06:23 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:06:23.917 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:06:23] "OPTIONS / HTTP/1.0" 200 134 0.000348
Sep 28 13:06:24 ctl02 nova-api[17052]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:06:24 ctl02 nova-api[17052]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:06:24 ctl02 nova-api[17052]: 2017-09-28 13:06:24.193 17052 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:06:24 ctl02 nova-api[17052]: 2017-09-28 13:06:24.195 17052 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:06:24 ctl02 nova-api[17052]: 2017-09-28 13:06:24.195 17052 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:06:24 ctl02 nova-api[17052]: 2017-09-28 13:06:24.195 17052 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:06:24 ctl02 nova-api[17052]: 2017-09-28 13:06:24.195 17052 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:06:24 ctl02 nova-api[17052]: 2017-09-28 13:06:24.195 17052 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:06:24 ctl02 nova-api[17052]: 2017-09-28 13:06:24.195 17052 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:06:24 ctl02 nova-api[17052]: 2017-09-28 13:06:24.195 17052 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:06:24 ctl02 nova-api[17052]: 2017-09-28 13:06:24.195 17052 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:06:24 ctl02 nova-api[17052]: 2017-09-28 13:06:24.195 17052 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:06:24 ctl02 nova-api[17052]: 2017-09-28 13:06:24.195 17052 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:06:24 ctl02 nova-api[17052]: 2017-09-28 13:06:24.195 17052 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:06:24 ctl02 nova-api[17052]: 2017-09-28 13:06:24.195 17052 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:06:24 ctl02 nova-api[17052]: 2017-09-28 13:06:24.195 17052 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:06:24 ctl02 nova-api[17052]: 2017-09-28 13:06:24.195 17052 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:06:24 ctl02 nova-api[17052]: 2017-09-28 13:06:24.195 17052 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:06:24 ctl02 nova-api[17052]: 2017-09-28 13:06:24.195 17052 ERROR nova.wsgi     self.filename))
Sep 28 13:06:24 ctl02 nova-api[17052]: 2017-09-28 13:06:24.195 17052 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:06:24 ctl02 nova-api[17052]: 2017-09-28 13:06:24.195 17052 ERROR nova.wsgi
Sep 28 13:06:24 ctl02 nova-api[17052]: 2017-09-28 13:06:24.197 17052 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:06:24 ctl02 heat-api-cfn[13300]: 2017-09-28 13:06:24.321 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:06:24] "OPTIONS / HTTP/1.0" 200 134 0.000422
Sep 28 13:06:24 ctl02 nova-api[17052]: 2017-09-28 13:06:24.324 17052 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:06:24 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf90db47b)
Sep 28 13:06:24 ctl02 nova-api[17052]: 2017-09-28 13:06:24.544 17052 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:06:24 ctl02 nova-api[17052]: 2017-09-28 13:06:24.547 17052 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:06:24 ctl02 nova-api[17052]: 2017-09-28 13:06:24.547 17052 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:06:24 ctl02 nova-api[17052]: 2017-09-28 13:06:24.548 17052 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:06:24 ctl02 nova-api[17052]: 2017-09-28 13:06:24.677 17052 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:06:24 ctl02 nova-api[17052]: 2017-09-28 13:06:24.680 17052 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:06:24 ctl02 nova-api[17052]: 2017-09-28 13:06:24.680 17052 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:06:24 ctl02 nova-api[17052]: 2017-09-28 13:06:24.680 17052 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:06:24 ctl02 nova-api[17052]: 2017-09-28 13:06:24.683 17052 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:06:24 ctl02 nova-api[17052]: 2017-09-28 13:06:24.684 17052 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:06:24 ctl02 nova-api[17052]: 2017-09-28 13:06:24.684 17052 ERROR nova Traceback (most recent call last):
Sep 28 13:06:24 ctl02 nova-api[17052]: 2017-09-28 13:06:24.684 17052 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:06:24 ctl02 nova-api[17052]: 2017-09-28 13:06:24.684 17052 ERROR nova     sys.exit(main())
Sep 28 13:06:24 ctl02 nova-api[17052]: 2017-09-28 13:06:24.684 17052 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:06:24 ctl02 nova-api[17052]: 2017-09-28 13:06:24.684 17052 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:06:24 ctl02 nova-api[17052]: 2017-09-28 13:06:24.684 17052 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:06:24 ctl02 nova-api[17052]: 2017-09-28 13:06:24.684 17052 ERROR nova     max_url_len=max_url_len)
Sep 28 13:06:24 ctl02 nova-api[17052]: 2017-09-28 13:06:24.684 17052 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:06:24 ctl02 nova-api[17052]: 2017-09-28 13:06:24.684 17052 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:06:24 ctl02 nova-api[17052]: 2017-09-28 13:06:24.684 17052 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:06:24 ctl02 nova-api[17052]: 2017-09-28 13:06:24.684 17052 ERROR nova     sock.listen(backlog)
Sep 28 13:06:24 ctl02 nova-api[17052]: 2017-09-28 13:06:24.684 17052 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:06:24 ctl02 nova-api[17052]: 2017-09-28 13:06:24.684 17052 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:06:24 ctl02 nova-api[17052]: 2017-09-28 13:06:24.684 17052 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:06:24 ctl02 nova-api[17052]: 2017-09-28 13:06:24.684 17052 ERROR nova
Sep 28 13:06:24 ctl02 neutron-server[30536]: 2017-09-28 13:06:24.746 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:06:24] "OPTIONS / HTTP/1.0" 200 262 0.000455
Sep 28 13:06:24 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:06:24 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:06:24 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:06:25 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:06:25 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:06:25 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:06:25 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:06:25 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf90db47b)
Sep 28 13:06:26 ctl02 nova-consoleauth[5433]: 2017-09-28 13:06:26.099 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:06:26 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf90db47b)
Sep 28 13:06:26 ctl02 heat-engine[12803]: 2017-09-28 13:06:26.484 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:06:26 ctl02 heat-engine[12803]: 2017-09-28 13:06:26.503 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:06:26 ctl02 heat-engine[12803]: 2017-09-28 13:06:26.507 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:06:26 ctl02 heat-engine[12803]: 2017-09-28 13:06:26.511 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:06:26 ctl02 nova-api[17070]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:06:26 ctl02 nova-api[17070]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:06:27 ctl02 nova-api[17070]: 2017-09-28 13:06:27.043 17070 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:06:27 ctl02 nova-api[17070]: 2017-09-28 13:06:27.044 17070 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:06:27 ctl02 nova-api[17070]: 2017-09-28 13:06:27.044 17070 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:06:27 ctl02 nova-api[17070]: 2017-09-28 13:06:27.044 17070 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:06:27 ctl02 nova-api[17070]: 2017-09-28 13:06:27.044 17070 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:06:27 ctl02 nova-api[17070]: 2017-09-28 13:06:27.044 17070 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:06:27 ctl02 nova-api[17070]: 2017-09-28 13:06:27.044 17070 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:06:27 ctl02 nova-api[17070]: 2017-09-28 13:06:27.044 17070 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:06:27 ctl02 nova-api[17070]: 2017-09-28 13:06:27.044 17070 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:06:27 ctl02 nova-api[17070]: 2017-09-28 13:06:27.044 17070 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:06:27 ctl02 nova-api[17070]: 2017-09-28 13:06:27.044 17070 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:06:27 ctl02 nova-api[17070]: 2017-09-28 13:06:27.044 17070 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:06:27 ctl02 nova-api[17070]: 2017-09-28 13:06:27.044 17070 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:06:27 ctl02 nova-api[17070]: 2017-09-28 13:06:27.044 17070 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:06:27 ctl02 nova-api[17070]: 2017-09-28 13:06:27.044 17070 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:06:27 ctl02 nova-api[17070]: 2017-09-28 13:06:27.044 17070 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:06:27 ctl02 nova-api[17070]: 2017-09-28 13:06:27.044 17070 ERROR nova.wsgi     self.filename))
Sep 28 13:06:27 ctl02 nova-api[17070]: 2017-09-28 13:06:27.044 17070 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:06:27 ctl02 nova-api[17070]: 2017-09-28 13:06:27.044 17070 ERROR nova.wsgi
Sep 28 13:06:27 ctl02 nova-api[17070]: 2017-09-28 13:06:27.047 17070 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:06:27 ctl02 nova-api[17070]: 2017-09-28 13:06:27.179 17070 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:06:27 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf90db47b)
Sep 28 13:06:27 ctl02 nova-api[17070]: 2017-09-28 13:06:27.427 17070 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:06:27 ctl02 nova-api[17070]: 2017-09-28 13:06:27.429 17070 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:06:27 ctl02 nova-api[17070]: 2017-09-28 13:06:27.429 17070 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:06:27 ctl02 nova-api[17070]: 2017-09-28 13:06:27.430 17070 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:06:27 ctl02 nova-api[17070]: 2017-09-28 13:06:27.565 17070 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:06:27 ctl02 nova-api[17070]: 2017-09-28 13:06:27.567 17070 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:06:27 ctl02 nova-api[17070]: 2017-09-28 13:06:27.568 17070 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:06:27 ctl02 nova-api[17070]: 2017-09-28 13:06:27.568 17070 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:06:27 ctl02 nova-api[17070]: 2017-09-28 13:06:27.571 17070 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:06:27 ctl02 nova-api[17070]: 2017-09-28 13:06:27.572 17070 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:06:27 ctl02 nova-api[17070]: 2017-09-28 13:06:27.572 17070 ERROR nova Traceback (most recent call last):
Sep 28 13:06:27 ctl02 nova-api[17070]: 2017-09-28 13:06:27.572 17070 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:06:27 ctl02 nova-api[17070]: 2017-09-28 13:06:27.572 17070 ERROR nova     sys.exit(main())
Sep 28 13:06:27 ctl02 nova-api[17070]: 2017-09-28 13:06:27.572 17070 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:06:27 ctl02 nova-api[17070]: 2017-09-28 13:06:27.572 17070 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:06:27 ctl02 nova-api[17070]: 2017-09-28 13:06:27.572 17070 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:06:27 ctl02 nova-api[17070]: 2017-09-28 13:06:27.572 17070 ERROR nova     max_url_len=max_url_len)
Sep 28 13:06:27 ctl02 nova-api[17070]: 2017-09-28 13:06:27.572 17070 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:06:27 ctl02 nova-api[17070]: 2017-09-28 13:06:27.572 17070 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:06:27 ctl02 nova-api[17070]: 2017-09-28 13:06:27.572 17070 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:06:27 ctl02 nova-api[17070]: 2017-09-28 13:06:27.572 17070 ERROR nova     sock.listen(backlog)
Sep 28 13:06:27 ctl02 nova-api[17070]: 2017-09-28 13:06:27.572 17070 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:06:27 ctl02 nova-api[17070]: 2017-09-28 13:06:27.572 17070 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:06:27 ctl02 nova-api[17070]: 2017-09-28 13:06:27.572 17070 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:06:27 ctl02 nova-api[17070]: 2017-09-28 13:06:27.572 17070 ERROR nova
Sep 28 13:06:27 ctl02 heat-api-cfn[13300]: 2017-09-28 13:06:27.638 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:06:27] "OPTIONS / HTTP/1.0" 200 134 0.000511
Sep 28 13:06:27 ctl02 heat-api[13008]: 2017-09-28 13:06:27.747 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:06:27] "OPTIONS / HTTP/1.0" 200 134 0.000649
Sep 28 13:06:27 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:06:27 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:06:27 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:06:27 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:06:27 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:06:27 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:06:27 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:06:28 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:06:28.322 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:06:28] "OPTIONS / HTTP/1.0" 200 134 0.000414
Sep 28 13:06:28 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf90db47b)
Sep 28 13:06:28 ctl02 heat-api-cfn[13300]: 2017-09-28 13:06:28.508 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:06:28] "OPTIONS / HTTP/1.0" 200 134 0.000515
Sep 28 13:06:28 ctl02 neutron-server[30536]: 2017-09-28 13:06:28.543 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 13:06:28 ctl02 neutron-server[30536]: 2017-09-28 13:06:28.781 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:06:28] "OPTIONS / HTTP/1.0" 200 262 0.000519
Sep 28 13:06:29 ctl02 heat-api[13008]: 2017-09-28 13:06:29.098 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:06:29] "OPTIONS / HTTP/1.0" 200 134 0.000620
Sep 28 13:06:29 ctl02 nova-scheduler[5620]: 2017-09-28 13:06:29.208 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:06:29 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf90db47b)
Sep 28 13:06:29 ctl02 nova-api[17087]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:06:29 ctl02 nova-api[17087]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:06:29 ctl02 nova-api[17087]: 2017-09-28 13:06:29.802 17087 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:06:29 ctl02 nova-api[17087]: 2017-09-28 13:06:29.804 17087 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:06:29 ctl02 nova-api[17087]: 2017-09-28 13:06:29.804 17087 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:06:29 ctl02 nova-api[17087]: 2017-09-28 13:06:29.804 17087 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:06:29 ctl02 nova-api[17087]: 2017-09-28 13:06:29.804 17087 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:06:29 ctl02 nova-api[17087]: 2017-09-28 13:06:29.804 17087 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:06:29 ctl02 nova-api[17087]: 2017-09-28 13:06:29.804 17087 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:06:29 ctl02 nova-api[17087]: 2017-09-28 13:06:29.804 17087 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:06:29 ctl02 nova-api[17087]: 2017-09-28 13:06:29.804 17087 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:06:29 ctl02 nova-api[17087]: 2017-09-28 13:06:29.804 17087 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:06:29 ctl02 nova-api[17087]: 2017-09-28 13:06:29.804 17087 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:06:29 ctl02 nova-api[17087]: 2017-09-28 13:06:29.804 17087 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:06:29 ctl02 nova-api[17087]: 2017-09-28 13:06:29.804 17087 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:06:29 ctl02 nova-api[17087]: 2017-09-28 13:06:29.804 17087 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:06:29 ctl02 nova-api[17087]: 2017-09-28 13:06:29.804 17087 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:06:29 ctl02 nova-api[17087]: 2017-09-28 13:06:29.804 17087 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:06:29 ctl02 nova-api[17087]: 2017-09-28 13:06:29.804 17087 ERROR nova.wsgi     self.filename))
Sep 28 13:06:29 ctl02 nova-api[17087]: 2017-09-28 13:06:29.804 17087 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:06:29 ctl02 nova-api[17087]: 2017-09-28 13:06:29.804 17087 ERROR nova.wsgi
Sep 28 13:06:29 ctl02 nova-api[17087]: 2017-09-28 13:06:29.806 17087 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:06:29 ctl02 nova-api[17087]: 2017-09-28 13:06:29.946 17087 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:06:30 ctl02 glance-api[29183]: 2017-09-28 13:06:30.084 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:06:30] "OPTIONS / HTTP/1.0" 200 134 0.000743
Sep 28 13:06:30 ctl02 nova-api[17087]: 2017-09-28 13:06:30.208 17087 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:06:30 ctl02 nova-api[17087]: 2017-09-28 13:06:30.211 17087 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:06:30 ctl02 nova-api[17087]: 2017-09-28 13:06:30.211 17087 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:06:30 ctl02 nova-api[17087]: 2017-09-28 13:06:30.212 17087 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:06:30 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf90db47b)
Sep 28 13:06:30 ctl02 nova-api[17087]: 2017-09-28 13:06:30.348 17087 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:06:30 ctl02 nova-api[17087]: 2017-09-28 13:06:30.351 17087 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:06:30 ctl02 nova-api[17087]: 2017-09-28 13:06:30.351 17087 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:06:30 ctl02 nova-api[17087]: 2017-09-28 13:06:30.352 17087 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:06:30 ctl02 nova-api[17087]: 2017-09-28 13:06:30.355 17087 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:06:30 ctl02 nova-api[17087]: 2017-09-28 13:06:30.356 17087 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:06:30 ctl02 nova-api[17087]: 2017-09-28 13:06:30.356 17087 ERROR nova Traceback (most recent call last):
Sep 28 13:06:30 ctl02 nova-api[17087]: 2017-09-28 13:06:30.356 17087 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:06:30 ctl02 nova-api[17087]: 2017-09-28 13:06:30.356 17087 ERROR nova     sys.exit(main())
Sep 28 13:06:30 ctl02 nova-api[17087]: 2017-09-28 13:06:30.356 17087 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:06:30 ctl02 nova-api[17087]: 2017-09-28 13:06:30.356 17087 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:06:30 ctl02 nova-api[17087]: 2017-09-28 13:06:30.356 17087 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:06:30 ctl02 nova-api[17087]: 2017-09-28 13:06:30.356 17087 ERROR nova     max_url_len=max_url_len)
Sep 28 13:06:30 ctl02 nova-api[17087]: 2017-09-28 13:06:30.356 17087 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:06:30 ctl02 nova-api[17087]: 2017-09-28 13:06:30.356 17087 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:06:30 ctl02 nova-api[17087]: 2017-09-28 13:06:30.356 17087 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:06:30 ctl02 nova-api[17087]: 2017-09-28 13:06:30.356 17087 ERROR nova     sock.listen(backlog)
Sep 28 13:06:30 ctl02 nova-api[17087]: 2017-09-28 13:06:30.356 17087 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:06:30 ctl02 nova-api[17087]: 2017-09-28 13:06:30.356 17087 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:06:30 ctl02 nova-api[17087]: 2017-09-28 13:06:30.356 17087 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:06:30 ctl02 nova-api[17087]: 2017-09-28 13:06:30.356 17087 ERROR nova
Sep 28 13:06:30 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:06:30 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:06:30 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:06:30 ctl02 neutron-server[30536]: 2017-09-28 13:06:30.621 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:06:30] "OPTIONS / HTTP/1.0" 200 262 0.000538
Sep 28 13:06:30 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:06:30 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:06:30 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:06:30 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:06:31 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:06:31.202 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:06:31] "OPTIONS / HTTP/1.0" 200 134 0.000444
Sep 28 13:06:31 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 13:06:31 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 13:06:32 ctl02 nova-api[17106]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:06:32 ctl02 nova-api[17106]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:06:32 ctl02 heat-api[13008]: 2017-09-28 13:06:32.492 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:06:32] "OPTIONS / HTTP/1.0" 200 134 0.000638
Sep 28 13:06:32 ctl02 nova-api[17106]: 2017-09-28 13:06:32.535 17106 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:06:32 ctl02 nova-api[17106]: 2017-09-28 13:06:32.537 17106 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:06:32 ctl02 nova-api[17106]: 2017-09-28 13:06:32.537 17106 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:06:32 ctl02 nova-api[17106]: 2017-09-28 13:06:32.537 17106 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:06:32 ctl02 nova-api[17106]: 2017-09-28 13:06:32.537 17106 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:06:32 ctl02 nova-api[17106]: 2017-09-28 13:06:32.537 17106 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:06:32 ctl02 nova-api[17106]: 2017-09-28 13:06:32.537 17106 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:06:32 ctl02 nova-api[17106]: 2017-09-28 13:06:32.537 17106 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:06:32 ctl02 nova-api[17106]: 2017-09-28 13:06:32.537 17106 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:06:32 ctl02 nova-api[17106]: 2017-09-28 13:06:32.537 17106 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:06:32 ctl02 nova-api[17106]: 2017-09-28 13:06:32.537 17106 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:06:32 ctl02 nova-api[17106]: 2017-09-28 13:06:32.537 17106 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:06:32 ctl02 nova-api[17106]: 2017-09-28 13:06:32.537 17106 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:06:32 ctl02 nova-api[17106]: 2017-09-28 13:06:32.537 17106 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:06:32 ctl02 nova-api[17106]: 2017-09-28 13:06:32.537 17106 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:06:32 ctl02 nova-api[17106]: 2017-09-28 13:06:32.537 17106 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:06:32 ctl02 nova-api[17106]: 2017-09-28 13:06:32.537 17106 ERROR nova.wsgi     self.filename))
Sep 28 13:06:32 ctl02 nova-api[17106]: 2017-09-28 13:06:32.537 17106 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:06:32 ctl02 nova-api[17106]: 2017-09-28 13:06:32.537 17106 ERROR nova.wsgi
Sep 28 13:06:32 ctl02 nova-api[17106]: 2017-09-28 13:06:32.538 17106 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:06:32 ctl02 nova-api[17106]: 2017-09-28 13:06:32.670 17106 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:06:32 ctl02 nova-api[17106]: 2017-09-28 13:06:32.895 17106 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:06:32 ctl02 nova-api[17106]: 2017-09-28 13:06:32.898 17106 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:06:32 ctl02 nova-api[17106]: 2017-09-28 13:06:32.898 17106 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:06:32 ctl02 nova-api[17106]: 2017-09-28 13:06:32.898 17106 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:06:32 ctl02 glance-api[29183]: 2017-09-28 13:06:32.995 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:06:32] "OPTIONS / HTTP/1.0" 200 134 0.000618
Sep 28 13:06:33 ctl02 nova-api[17106]: 2017-09-28 13:06:33.027 17106 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:06:33 ctl02 nova-api[17106]: 2017-09-28 13:06:33.029 17106 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:06:33 ctl02 nova-api[17106]: 2017-09-28 13:06:33.029 17106 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:06:33 ctl02 nova-api[17106]: 2017-09-28 13:06:33.029 17106 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:06:33 ctl02 nova-api[17106]: 2017-09-28 13:06:33.032 17106 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:06:33 ctl02 nova-api[17106]: 2017-09-28 13:06:33.033 17106 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:06:33 ctl02 nova-api[17106]: 2017-09-28 13:06:33.033 17106 ERROR nova Traceback (most recent call last):
Sep 28 13:06:33 ctl02 nova-api[17106]: 2017-09-28 13:06:33.033 17106 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:06:33 ctl02 nova-api[17106]: 2017-09-28 13:06:33.033 17106 ERROR nova     sys.exit(main())
Sep 28 13:06:33 ctl02 nova-api[17106]: 2017-09-28 13:06:33.033 17106 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:06:33 ctl02 nova-api[17106]: 2017-09-28 13:06:33.033 17106 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:06:33 ctl02 nova-api[17106]: 2017-09-28 13:06:33.033 17106 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:06:33 ctl02 nova-api[17106]: 2017-09-28 13:06:33.033 17106 ERROR nova     max_url_len=max_url_len)
Sep 28 13:06:33 ctl02 nova-api[17106]: 2017-09-28 13:06:33.033 17106 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:06:33 ctl02 nova-api[17106]: 2017-09-28 13:06:33.033 17106 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:06:33 ctl02 nova-api[17106]: 2017-09-28 13:06:33.033 17106 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:06:33 ctl02 nova-api[17106]: 2017-09-28 13:06:33.033 17106 ERROR nova     sock.listen(backlog)
Sep 28 13:06:33 ctl02 nova-api[17106]: 2017-09-28 13:06:33.033 17106 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:06:33 ctl02 nova-api[17106]: 2017-09-28 13:06:33.033 17106 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:06:33 ctl02 nova-api[17106]: 2017-09-28 13:06:33.033 17106 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:06:33 ctl02 nova-api[17106]: 2017-09-28 13:06:33.033 17106 ERROR nova
Sep 28 13:06:33 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:06:33 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:06:33 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:06:33 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:06:33 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:06:33 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:06:33 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:06:33 ctl02 glance-api[29183]: 2017-09-28 13:06:33.626 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:06:33] "OPTIONS / HTTP/1.0" 200 134 0.000740
Sep 28 13:06:33 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:06:33.722 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:06:33] "OPTIONS / HTTP/1.0" 200 134 0.000431
Sep 28 13:06:34 ctl02 neutron-server[30536]: 2017-09-28 13:06:34.482 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:06:34] "OPTIONS / HTTP/1.0" 200 262 0.000516
Sep 28 13:06:34 ctl02 heat-api-cfn[13300]: 2017-09-28 13:06:34.486 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:06:34] "OPTIONS / HTTP/1.0" 200 134 0.000491
Sep 28 13:06:35 ctl02 nova-api[17128]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:06:35 ctl02 nova-api[17128]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:06:35 ctl02 nova-api[17128]: 2017-09-28 13:06:35.308 17128 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:06:35 ctl02 nova-api[17128]: 2017-09-28 13:06:35.309 17128 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:06:35 ctl02 nova-api[17128]: 2017-09-28 13:06:35.309 17128 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:06:35 ctl02 nova-api[17128]: 2017-09-28 13:06:35.309 17128 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:06:35 ctl02 nova-api[17128]: 2017-09-28 13:06:35.309 17128 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:06:35 ctl02 nova-api[17128]: 2017-09-28 13:06:35.309 17128 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:06:35 ctl02 nova-api[17128]: 2017-09-28 13:06:35.309 17128 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:06:35 ctl02 nova-api[17128]: 2017-09-28 13:06:35.309 17128 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:06:35 ctl02 nova-api[17128]: 2017-09-28 13:06:35.309 17128 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:06:35 ctl02 nova-api[17128]: 2017-09-28 13:06:35.309 17128 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:06:35 ctl02 nova-api[17128]: 2017-09-28 13:06:35.309 17128 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:06:35 ctl02 nova-api[17128]: 2017-09-28 13:06:35.309 17128 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:06:35 ctl02 nova-api[17128]: 2017-09-28 13:06:35.309 17128 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:06:35 ctl02 nova-api[17128]: 2017-09-28 13:06:35.309 17128 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:06:35 ctl02 nova-api[17128]: 2017-09-28 13:06:35.309 17128 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:06:35 ctl02 nova-api[17128]: 2017-09-28 13:06:35.309 17128 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:06:35 ctl02 nova-api[17128]: 2017-09-28 13:06:35.309 17128 ERROR nova.wsgi     self.filename))
Sep 28 13:06:35 ctl02 nova-api[17128]: 2017-09-28 13:06:35.309 17128 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:06:35 ctl02 nova-api[17128]: 2017-09-28 13:06:35.309 17128 ERROR nova.wsgi
Sep 28 13:06:35 ctl02 nova-api[17128]: 2017-09-28 13:06:35.312 17128 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:06:35 ctl02 nova-api[17128]: 2017-09-28 13:06:35.450 17128 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:06:35 ctl02 nova-api[17128]: 2017-09-28 13:06:35.701 17128 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:06:35 ctl02 nova-api[17128]: 2017-09-28 13:06:35.704 17128 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:06:35 ctl02 nova-api[17128]: 2017-09-28 13:06:35.705 17128 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:06:35 ctl02 nova-api[17128]: 2017-09-28 13:06:35.705 17128 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:06:35 ctl02 nova-api[17128]: 2017-09-28 13:06:35.838 17128 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:06:35 ctl02 nova-api[17128]: 2017-09-28 13:06:35.841 17128 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:06:35 ctl02 nova-api[17128]: 2017-09-28 13:06:35.841 17128 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:06:35 ctl02 nova-api[17128]: 2017-09-28 13:06:35.842 17128 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:06:35 ctl02 nova-api[17128]: 2017-09-28 13:06:35.845 17128 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:06:35 ctl02 nova-api[17128]: 2017-09-28 13:06:35.846 17128 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:06:35 ctl02 nova-api[17128]: 2017-09-28 13:06:35.846 17128 ERROR nova Traceback (most recent call last):
Sep 28 13:06:35 ctl02 nova-api[17128]: 2017-09-28 13:06:35.846 17128 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:06:35 ctl02 nova-api[17128]: 2017-09-28 13:06:35.846 17128 ERROR nova     sys.exit(main())
Sep 28 13:06:35 ctl02 nova-api[17128]: 2017-09-28 13:06:35.846 17128 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:06:35 ctl02 nova-api[17128]: 2017-09-28 13:06:35.846 17128 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:06:35 ctl02 nova-api[17128]: 2017-09-28 13:06:35.846 17128 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:06:35 ctl02 nova-api[17128]: 2017-09-28 13:06:35.846 17128 ERROR nova     max_url_len=max_url_len)
Sep 28 13:06:35 ctl02 nova-api[17128]: 2017-09-28 13:06:35.846 17128 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:06:35 ctl02 nova-api[17128]: 2017-09-28 13:06:35.846 17128 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:06:35 ctl02 nova-api[17128]: 2017-09-28 13:06:35.846 17128 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:06:35 ctl02 nova-api[17128]: 2017-09-28 13:06:35.846 17128 ERROR nova     sock.listen(backlog)
Sep 28 13:06:35 ctl02 nova-api[17128]: 2017-09-28 13:06:35.846 17128 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:06:35 ctl02 nova-api[17128]: 2017-09-28 13:06:35.846 17128 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:06:35 ctl02 nova-api[17128]: 2017-09-28 13:06:35.846 17128 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:06:35 ctl02 nova-api[17128]: 2017-09-28 13:06:35.846 17128 ERROR nova
Sep 28 13:06:35 ctl02 neutron-server[30536]: 2017-09-28 13:06:35.968 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 13:06:35 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 13:06:35 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 13:05:06 cmp002
Sep 28 13:06:35 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 13:05:08 cmp001
Sep 28 13:06:35 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 13:05:36 cmp002
Sep 28 13:06:36 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:06:36 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:06:36 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:06:36 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:06:36 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:06:36 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:06:36 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:06:36 ctl02 neutron-server[30536]: 2017-09-28 13:06:36.153 30603 WARNING oslo_messaging._drivers.amqpdriver [req-036b42ba-79ff-452b-8c4e-471057d2b1d3 - - - - -] reply_a13a20a54b91453780e36bdf20a855d2 doesn't exists, drop reply to 2176633a94d0445da2b0a864ff2f3393
Sep 28 13:06:36 ctl02 neutron-server[30536]: 2017-09-28 13:06:36.154 30603 INFO oslo_messaging._drivers.amqpdriver [req-036b42ba-79ff-452b-8c4e-471057d2b1d3 - - - - -] The reply 2176633a94d0445da2b0a864ff2f3393 cannot be sent  reply_a13a20a54b91453780e36bdf20a855d2 reply queue don't exist after 60 sec abandoning...
Sep 28 13:06:37 ctl02 heat-api-cfn[13300]: 2017-09-28 13:06:37.361 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:06:37] "OPTIONS / HTTP/1.0" 200 134 0.000534
Sep 28 13:06:37 ctl02 heat-api[13008]: 2017-09-28 13:06:37.501 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:06:37] "OPTIONS / HTTP/1.0" 200 134 0.000737
Sep 28 13:06:37 ctl02 nova-api[17147]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:06:37 ctl02 nova-api[17147]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:06:38 ctl02 nova-api[17147]: 2017-09-28 13:06:38.054 17147 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:06:38 ctl02 nova-api[17147]: 2017-09-28 13:06:38.056 17147 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:06:38 ctl02 nova-api[17147]: 2017-09-28 13:06:38.056 17147 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:06:38 ctl02 nova-api[17147]: 2017-09-28 13:06:38.056 17147 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:06:38 ctl02 nova-api[17147]: 2017-09-28 13:06:38.056 17147 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:06:38 ctl02 nova-api[17147]: 2017-09-28 13:06:38.056 17147 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:06:38 ctl02 nova-api[17147]: 2017-09-28 13:06:38.056 17147 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:06:38 ctl02 nova-api[17147]: 2017-09-28 13:06:38.056 17147 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:06:38 ctl02 nova-api[17147]: 2017-09-28 13:06:38.056 17147 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:06:38 ctl02 nova-api[17147]: 2017-09-28 13:06:38.056 17147 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:06:38 ctl02 nova-api[17147]: 2017-09-28 13:06:38.056 17147 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:06:38 ctl02 nova-api[17147]: 2017-09-28 13:06:38.056 17147 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:06:38 ctl02 nova-api[17147]: 2017-09-28 13:06:38.056 17147 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:06:38 ctl02 nova-api[17147]: 2017-09-28 13:06:38.056 17147 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:06:38 ctl02 nova-api[17147]: 2017-09-28 13:06:38.056 17147 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:06:38 ctl02 nova-api[17147]: 2017-09-28 13:06:38.056 17147 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:06:38 ctl02 nova-api[17147]: 2017-09-28 13:06:38.056 17147 ERROR nova.wsgi     self.filename))
Sep 28 13:06:38 ctl02 nova-api[17147]: 2017-09-28 13:06:38.056 17147 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:06:38 ctl02 nova-api[17147]: 2017-09-28 13:06:38.056 17147 ERROR nova.wsgi
Sep 28 13:06:38 ctl02 nova-api[17147]: 2017-09-28 13:06:38.058 17147 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:06:38 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:06:38.078 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:06:38] "OPTIONS / HTTP/1.0" 200 134 0.000435
Sep 28 13:06:38 ctl02 nova-api[17147]: 2017-09-28 13:06:38.197 17147 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:06:38 ctl02 nova-api[17147]: 2017-09-28 13:06:38.454 17147 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:06:38 ctl02 nova-api[17147]: 2017-09-28 13:06:38.457 17147 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:06:38 ctl02 nova-api[17147]: 2017-09-28 13:06:38.457 17147 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:06:38 ctl02 nova-api[17147]: 2017-09-28 13:06:38.457 17147 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:06:38 ctl02 nova-api[17147]: 2017-09-28 13:06:38.592 17147 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:06:38 ctl02 nova-api[17147]: 2017-09-28 13:06:38.594 17147 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:06:38 ctl02 nova-api[17147]: 2017-09-28 13:06:38.594 17147 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:06:38 ctl02 nova-api[17147]: 2017-09-28 13:06:38.595 17147 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:06:38 ctl02 nova-api[17147]: 2017-09-28 13:06:38.598 17147 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:06:38 ctl02 nova-api[17147]: 2017-09-28 13:06:38.598 17147 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:06:38 ctl02 nova-api[17147]: 2017-09-28 13:06:38.598 17147 ERROR nova Traceback (most recent call last):
Sep 28 13:06:38 ctl02 nova-api[17147]: 2017-09-28 13:06:38.598 17147 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:06:38 ctl02 nova-api[17147]: 2017-09-28 13:06:38.598 17147 ERROR nova     sys.exit(main())
Sep 28 13:06:38 ctl02 nova-api[17147]: 2017-09-28 13:06:38.598 17147 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:06:38 ctl02 nova-api[17147]: 2017-09-28 13:06:38.598 17147 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:06:38 ctl02 nova-api[17147]: 2017-09-28 13:06:38.598 17147 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:06:38 ctl02 nova-api[17147]: 2017-09-28 13:06:38.598 17147 ERROR nova     max_url_len=max_url_len)
Sep 28 13:06:38 ctl02 nova-api[17147]: 2017-09-28 13:06:38.598 17147 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:06:38 ctl02 nova-api[17147]: 2017-09-28 13:06:38.598 17147 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:06:38 ctl02 nova-api[17147]: 2017-09-28 13:06:38.598 17147 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:06:38 ctl02 nova-api[17147]: 2017-09-28 13:06:38.598 17147 ERROR nova     sock.listen(backlog)
Sep 28 13:06:38 ctl02 nova-api[17147]: 2017-09-28 13:06:38.598 17147 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:06:38 ctl02 nova-api[17147]: 2017-09-28 13:06:38.598 17147 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:06:38 ctl02 nova-api[17147]: 2017-09-28 13:06:38.598 17147 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:06:38 ctl02 nova-api[17147]: 2017-09-28 13:06:38.598 17147 ERROR nova
Sep 28 13:06:38 ctl02 heat-api-cfn[13300]: 2017-09-28 13:06:38.699 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:06:38] "OPTIONS / HTTP/1.0" 200 134 0.000489
Sep 28 13:06:38 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:06:38 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:06:38 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:06:38 ctl02 neutron-server[30536]: 2017-09-28 13:06:38.842 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:06:38] "OPTIONS / HTTP/1.0" 200 262 0.000577
Sep 28 13:06:38 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:06:38 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:06:38 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:06:38 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:06:39 ctl02 heat-api[13008]: 2017-09-28 13:06:39.363 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:06:39] "OPTIONS / HTTP/1.0" 200 134 0.000529
Sep 28 13:06:39 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf050b4e)
Sep 28 13:06:40 ctl02 glance-api[29183]: 2017-09-28 13:06:40.163 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:06:40] "OPTIONS / HTTP/1.0" 200 134 0.000632
Sep 28 13:06:40 ctl02 nova-api[17166]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:06:40 ctl02 nova-api[17166]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:06:40 ctl02 neutron-server[30536]: 2017-09-28 13:06:40.679 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:06:40] "OPTIONS / HTTP/1.0" 200 262 0.000496
Sep 28 13:06:40 ctl02 nova-api[17166]: 2017-09-28 13:06:40.781 17166 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:06:40 ctl02 nova-api[17166]: 2017-09-28 13:06:40.783 17166 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:06:40 ctl02 nova-api[17166]: 2017-09-28 13:06:40.783 17166 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:06:40 ctl02 nova-api[17166]: 2017-09-28 13:06:40.783 17166 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:06:40 ctl02 nova-api[17166]: 2017-09-28 13:06:40.783 17166 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:06:40 ctl02 nova-api[17166]: 2017-09-28 13:06:40.783 17166 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:06:40 ctl02 nova-api[17166]: 2017-09-28 13:06:40.783 17166 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:06:40 ctl02 nova-api[17166]: 2017-09-28 13:06:40.783 17166 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:06:40 ctl02 nova-api[17166]: 2017-09-28 13:06:40.783 17166 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:06:40 ctl02 nova-api[17166]: 2017-09-28 13:06:40.783 17166 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:06:40 ctl02 nova-api[17166]: 2017-09-28 13:06:40.783 17166 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:06:40 ctl02 nova-api[17166]: 2017-09-28 13:06:40.783 17166 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:06:40 ctl02 nova-api[17166]: 2017-09-28 13:06:40.783 17166 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:06:40 ctl02 nova-api[17166]: 2017-09-28 13:06:40.783 17166 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:06:40 ctl02 nova-api[17166]: 2017-09-28 13:06:40.783 17166 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:06:40 ctl02 nova-api[17166]: 2017-09-28 13:06:40.783 17166 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:06:40 ctl02 nova-api[17166]: 2017-09-28 13:06:40.783 17166 ERROR nova.wsgi     self.filename))
Sep 28 13:06:40 ctl02 nova-api[17166]: 2017-09-28 13:06:40.783 17166 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:06:40 ctl02 nova-api[17166]: 2017-09-28 13:06:40.783 17166 ERROR nova.wsgi
Sep 28 13:06:40 ctl02 nova-api[17166]: 2017-09-28 13:06:40.784 17166 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:06:40 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf050b4e)
Sep 28 13:06:40 ctl02 nova-api[17166]: 2017-09-28 13:06:40.913 17166 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:06:41 ctl02 nova-api[17166]: 2017-09-28 13:06:41.134 17166 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:06:41 ctl02 nova-api[17166]: 2017-09-28 13:06:41.137 17166 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:06:41 ctl02 nova-api[17166]: 2017-09-28 13:06:41.138 17166 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:06:41 ctl02 nova-api[17166]: 2017-09-28 13:06:41.138 17166 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:06:41 ctl02 nova-api[17166]: 2017-09-28 13:06:41.271 17166 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:06:41 ctl02 nova-api[17166]: 2017-09-28 13:06:41.273 17166 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:06:41 ctl02 nova-api[17166]: 2017-09-28 13:06:41.273 17166 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:06:41 ctl02 nova-api[17166]: 2017-09-28 13:06:41.274 17166 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:06:41 ctl02 nova-api[17166]: 2017-09-28 13:06:41.277 17166 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:06:41 ctl02 nova-api[17166]: 2017-09-28 13:06:41.277 17166 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:06:41 ctl02 nova-api[17166]: 2017-09-28 13:06:41.277 17166 ERROR nova Traceback (most recent call last):
Sep 28 13:06:41 ctl02 nova-api[17166]: 2017-09-28 13:06:41.277 17166 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:06:41 ctl02 nova-api[17166]: 2017-09-28 13:06:41.277 17166 ERROR nova     sys.exit(main())
Sep 28 13:06:41 ctl02 nova-api[17166]: 2017-09-28 13:06:41.277 17166 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:06:41 ctl02 nova-api[17166]: 2017-09-28 13:06:41.277 17166 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:06:41 ctl02 nova-api[17166]: 2017-09-28 13:06:41.277 17166 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:06:41 ctl02 nova-api[17166]: 2017-09-28 13:06:41.277 17166 ERROR nova     max_url_len=max_url_len)
Sep 28 13:06:41 ctl02 nova-api[17166]: 2017-09-28 13:06:41.277 17166 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:06:41 ctl02 nova-api[17166]: 2017-09-28 13:06:41.277 17166 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:06:41 ctl02 nova-api[17166]: 2017-09-28 13:06:41.277 17166 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:06:41 ctl02 nova-api[17166]: 2017-09-28 13:06:41.277 17166 ERROR nova     sock.listen(backlog)
Sep 28 13:06:41 ctl02 nova-api[17166]: 2017-09-28 13:06:41.277 17166 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:06:41 ctl02 nova-api[17166]: 2017-09-28 13:06:41.277 17166 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:06:41 ctl02 nova-api[17166]: 2017-09-28 13:06:41.277 17166 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:06:41 ctl02 nova-api[17166]: 2017-09-28 13:06:41.277 17166 ERROR nova
Sep 28 13:06:41 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:06:41 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:06:41 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:06:41 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:06:41.432 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:06:41] "OPTIONS / HTTP/1.0" 200 134 0.000412
Sep 28 13:06:41 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:06:41 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:06:41 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:06:41 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:06:41 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf050b4e)
Sep 28 13:06:42 ctl02 heat-api[13008]: 2017-09-28 13:06:42.752 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:06:42] "OPTIONS / HTTP/1.0" 200 134 0.000546
Sep 28 13:06:42 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf050b4e)
Sep 28 13:06:43 ctl02 glance-api[29183]: 2017-09-28 13:06:43.188 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:06:43] "OPTIONS / HTTP/1.0" 200 134 0.000559
Sep 28 13:06:43 ctl02 nova-api[17184]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:06:43 ctl02 nova-api[17184]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:06:43 ctl02 glance-api[29183]: 2017-09-28 13:06:43.450 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:06:43] "OPTIONS / HTTP/1.0" 200 134 0.000550
Sep 28 13:06:43 ctl02 nova-api[17184]: 2017-09-28 13:06:43.477 17184 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:06:43 ctl02 nova-api[17184]: 2017-09-28 13:06:43.478 17184 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:06:43 ctl02 nova-api[17184]: 2017-09-28 13:06:43.478 17184 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:06:43 ctl02 nova-api[17184]: 2017-09-28 13:06:43.478 17184 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:06:43 ctl02 nova-api[17184]: 2017-09-28 13:06:43.478 17184 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:06:43 ctl02 nova-api[17184]: 2017-09-28 13:06:43.478 17184 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:06:43 ctl02 nova-api[17184]: 2017-09-28 13:06:43.478 17184 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:06:43 ctl02 nova-api[17184]: 2017-09-28 13:06:43.478 17184 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:06:43 ctl02 nova-api[17184]: 2017-09-28 13:06:43.478 17184 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:06:43 ctl02 nova-api[17184]: 2017-09-28 13:06:43.478 17184 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:06:43 ctl02 nova-api[17184]: 2017-09-28 13:06:43.478 17184 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:06:43 ctl02 nova-api[17184]: 2017-09-28 13:06:43.478 17184 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:06:43 ctl02 nova-api[17184]: 2017-09-28 13:06:43.478 17184 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:06:43 ctl02 nova-api[17184]: 2017-09-28 13:06:43.478 17184 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:06:43 ctl02 nova-api[17184]: 2017-09-28 13:06:43.478 17184 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:06:43 ctl02 nova-api[17184]: 2017-09-28 13:06:43.478 17184 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:06:43 ctl02 nova-api[17184]: 2017-09-28 13:06:43.478 17184 ERROR nova.wsgi     self.filename))
Sep 28 13:06:43 ctl02 nova-api[17184]: 2017-09-28 13:06:43.478 17184 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:06:43 ctl02 nova-api[17184]: 2017-09-28 13:06:43.478 17184 ERROR nova.wsgi
Sep 28 13:06:43 ctl02 nova-api[17184]: 2017-09-28 13:06:43.479 17184 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:06:43 ctl02 neutron-server[30536]: 2017-09-28 13:06:43.540 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 13:06:43 ctl02 nova-api[17184]: 2017-09-28 13:06:43.611 17184 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:06:43 ctl02 nova-api[17184]: 2017-09-28 13:06:43.831 17184 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:06:43 ctl02 nova-api[17184]: 2017-09-28 13:06:43.833 17184 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:06:43 ctl02 nova-api[17184]: 2017-09-28 13:06:43.833 17184 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:06:43 ctl02 nova-api[17184]: 2017-09-28 13:06:43.833 17184 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:06:43 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf050b4e)
Sep 28 13:06:43 ctl02 nova-api[17184]: 2017-09-28 13:06:43.965 17184 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:06:43 ctl02 nova-api[17184]: 2017-09-28 13:06:43.967 17184 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:06:43 ctl02 nova-api[17184]: 2017-09-28 13:06:43.967 17184 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:06:43 ctl02 nova-api[17184]: 2017-09-28 13:06:43.968 17184 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:06:43 ctl02 nova-api[17184]: 2017-09-28 13:06:43.971 17184 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:06:43 ctl02 nova-api[17184]: 2017-09-28 13:06:43.971 17184 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:06:43 ctl02 nova-api[17184]: 2017-09-28 13:06:43.971 17184 ERROR nova Traceback (most recent call last):
Sep 28 13:06:43 ctl02 nova-api[17184]: 2017-09-28 13:06:43.971 17184 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:06:43 ctl02 nova-api[17184]: 2017-09-28 13:06:43.971 17184 ERROR nova     sys.exit(main())
Sep 28 13:06:43 ctl02 nova-api[17184]: 2017-09-28 13:06:43.971 17184 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:06:43 ctl02 nova-api[17184]: 2017-09-28 13:06:43.971 17184 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:06:43 ctl02 nova-api[17184]: 2017-09-28 13:06:43.971 17184 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:06:43 ctl02 nova-api[17184]: 2017-09-28 13:06:43.971 17184 ERROR nova     max_url_len=max_url_len)
Sep 28 13:06:43 ctl02 nova-api[17184]: 2017-09-28 13:06:43.971 17184 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:06:43 ctl02 nova-api[17184]: 2017-09-28 13:06:43.971 17184 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:06:43 ctl02 nova-api[17184]: 2017-09-28 13:06:43.971 17184 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:06:43 ctl02 nova-api[17184]: 2017-09-28 13:06:43.971 17184 ERROR nova     sock.listen(backlog)
Sep 28 13:06:43 ctl02 nova-api[17184]: 2017-09-28 13:06:43.971 17184 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:06:43 ctl02 nova-api[17184]: 2017-09-28 13:06:43.971 17184 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:06:43 ctl02 nova-api[17184]: 2017-09-28 13:06:43.971 17184 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:06:43 ctl02 nova-api[17184]: 2017-09-28 13:06:43.971 17184 ERROR nova
Sep 28 13:06:44 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:06:44 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:06:44 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:06:44 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:06:44.114 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:06:44] "OPTIONS / HTTP/1.0" 200 134 0.000392
Sep 28 13:06:44 ctl02 heat-api-cfn[13300]: 2017-09-28 13:06:44.167 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:06:44] "OPTIONS / HTTP/1.0" 200 134 0.000438
Sep 28 13:06:44 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:06:44 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:06:44 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:06:44 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:06:44 ctl02 neutron-server[30536]: 2017-09-28 13:06:44.832 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:06:44] "OPTIONS / HTTP/1.0" 200 262 0.000460
Sep 28 13:06:44 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf050b4e)
Sep 28 13:06:45 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf050b4e)
Sep 28 13:06:46 ctl02 nova-api[17202]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:06:46 ctl02 nova-api[17202]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:06:46 ctl02 nova-api[17202]: 2017-09-28 13:06:46.246 17202 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:06:46 ctl02 nova-api[17202]: 2017-09-28 13:06:46.247 17202 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:06:46 ctl02 nova-api[17202]: 2017-09-28 13:06:46.247 17202 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:06:46 ctl02 nova-api[17202]: 2017-09-28 13:06:46.247 17202 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:06:46 ctl02 nova-api[17202]: 2017-09-28 13:06:46.247 17202 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:06:46 ctl02 nova-api[17202]: 2017-09-28 13:06:46.247 17202 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:06:46 ctl02 nova-api[17202]: 2017-09-28 13:06:46.247 17202 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:06:46 ctl02 nova-api[17202]: 2017-09-28 13:06:46.247 17202 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:06:46 ctl02 nova-api[17202]: 2017-09-28 13:06:46.247 17202 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:06:46 ctl02 nova-api[17202]: 2017-09-28 13:06:46.247 17202 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:06:46 ctl02 nova-api[17202]: 2017-09-28 13:06:46.247 17202 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:06:46 ctl02 nova-api[17202]: 2017-09-28 13:06:46.247 17202 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:06:46 ctl02 nova-api[17202]: 2017-09-28 13:06:46.247 17202 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:06:46 ctl02 nova-api[17202]: 2017-09-28 13:06:46.247 17202 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:06:46 ctl02 nova-api[17202]: 2017-09-28 13:06:46.247 17202 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:06:46 ctl02 nova-api[17202]: 2017-09-28 13:06:46.247 17202 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:06:46 ctl02 nova-api[17202]: 2017-09-28 13:06:46.247 17202 ERROR nova.wsgi     self.filename))
Sep 28 13:06:46 ctl02 nova-api[17202]: 2017-09-28 13:06:46.247 17202 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:06:46 ctl02 nova-api[17202]: 2017-09-28 13:06:46.247 17202 ERROR nova.wsgi
Sep 28 13:06:46 ctl02 nova-api[17202]: 2017-09-28 13:06:46.248 17202 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:06:46 ctl02 nova-api[17202]: 2017-09-28 13:06:46.377 17202 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:06:46 ctl02 nova-api[17202]: 2017-09-28 13:06:46.603 17202 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:06:46 ctl02 nova-api[17202]: 2017-09-28 13:06:46.605 17202 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:06:46 ctl02 nova-api[17202]: 2017-09-28 13:06:46.606 17202 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:06:46 ctl02 nova-api[17202]: 2017-09-28 13:06:46.606 17202 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:06:46 ctl02 nova-api[17202]: 2017-09-28 13:06:46.738 17202 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:06:46 ctl02 nova-api[17202]: 2017-09-28 13:06:46.739 17202 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:06:46 ctl02 nova-api[17202]: 2017-09-28 13:06:46.740 17202 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:06:46 ctl02 nova-api[17202]: 2017-09-28 13:06:46.740 17202 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:06:46 ctl02 nova-api[17202]: 2017-09-28 13:06:46.743 17202 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:06:46 ctl02 nova-api[17202]: 2017-09-28 13:06:46.743 17202 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:06:46 ctl02 nova-api[17202]: 2017-09-28 13:06:46.743 17202 ERROR nova Traceback (most recent call last):
Sep 28 13:06:46 ctl02 nova-api[17202]: 2017-09-28 13:06:46.743 17202 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:06:46 ctl02 nova-api[17202]: 2017-09-28 13:06:46.743 17202 ERROR nova     sys.exit(main())
Sep 28 13:06:46 ctl02 nova-api[17202]: 2017-09-28 13:06:46.743 17202 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:06:46 ctl02 nova-api[17202]: 2017-09-28 13:06:46.743 17202 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:06:46 ctl02 nova-api[17202]: 2017-09-28 13:06:46.743 17202 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:06:46 ctl02 nova-api[17202]: 2017-09-28 13:06:46.743 17202 ERROR nova     max_url_len=max_url_len)
Sep 28 13:06:46 ctl02 nova-api[17202]: 2017-09-28 13:06:46.743 17202 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:06:46 ctl02 nova-api[17202]: 2017-09-28 13:06:46.743 17202 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:06:46 ctl02 nova-api[17202]: 2017-09-28 13:06:46.743 17202 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:06:46 ctl02 nova-api[17202]: 2017-09-28 13:06:46.743 17202 ERROR nova     sock.listen(backlog)
Sep 28 13:06:46 ctl02 nova-api[17202]: 2017-09-28 13:06:46.743 17202 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:06:46 ctl02 nova-api[17202]: 2017-09-28 13:06:46.743 17202 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:06:46 ctl02 nova-api[17202]: 2017-09-28 13:06:46.743 17202 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:06:46 ctl02 nova-api[17202]: 2017-09-28 13:06:46.743 17202 ERROR nova
Sep 28 13:06:46 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf050b4e)
Sep 28 13:06:46 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:06:46 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:06:46 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:06:47 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:06:47 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:06:47 ctl02 heat-api-cfn[13300]: 2017-09-28 13:06:47.146 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:06:47] "OPTIONS / HTTP/1.0" 200 134 0.000614
Sep 28 13:06:47 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:06:47 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:06:47 ctl02 nova-conductor[5056]: 2017-09-28 13:06:47.372 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:06:47 ctl02 nova-conductor[5056]: 2017-09-28 13:06:47.374 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:06:47 ctl02 nova-conductor[5056]: 2017-09-28 13:06:47.387 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:06:47 ctl02 nova-conductor[5056]: 2017-09-28 13:06:47.388 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:06:47 ctl02 heat-api[13008]: 2017-09-28 13:06:47.683 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:06:47] "OPTIONS / HTTP/1.0" 200 134 0.000632
Sep 28 13:06:47 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf050b4e)
Sep 28 13:06:48 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:06:48.000 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:06:48] "OPTIONS / HTTP/1.0" 200 134 0.000502
Sep 28 13:06:48 ctl02 nova-cert[4860]: 2017-09-28 13:06:48.279 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:06:48 ctl02 heat-api-cfn[13300]: 2017-09-28 13:06:48.359 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:06:48] "OPTIONS / HTTP/1.0" 200 134 0.000500
Sep 28 13:06:48 ctl02 neutron-server[30536]: 2017-09-28 13:06:48.519 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:06:48] "OPTIONS / HTTP/1.0" 200 262 0.000494
Sep 28 13:06:48 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf050b4e)
Sep 28 13:06:48 ctl02 nova-api[17219]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:06:48 ctl02 nova-api[17219]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:06:49 ctl02 nova-api[17219]: 2017-09-28 13:06:49.043 17219 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:06:49 ctl02 nova-api[17219]: 2017-09-28 13:06:49.045 17219 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:06:49 ctl02 nova-api[17219]: 2017-09-28 13:06:49.045 17219 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:06:49 ctl02 nova-api[17219]: 2017-09-28 13:06:49.045 17219 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:06:49 ctl02 nova-api[17219]: 2017-09-28 13:06:49.045 17219 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:06:49 ctl02 nova-api[17219]: 2017-09-28 13:06:49.045 17219 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:06:49 ctl02 nova-api[17219]: 2017-09-28 13:06:49.045 17219 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:06:49 ctl02 nova-api[17219]: 2017-09-28 13:06:49.045 17219 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:06:49 ctl02 nova-api[17219]: 2017-09-28 13:06:49.045 17219 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:06:49 ctl02 nova-api[17219]: 2017-09-28 13:06:49.045 17219 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:06:49 ctl02 nova-api[17219]: 2017-09-28 13:06:49.045 17219 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:06:49 ctl02 nova-api[17219]: 2017-09-28 13:06:49.045 17219 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:06:49 ctl02 nova-api[17219]: 2017-09-28 13:06:49.045 17219 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:06:49 ctl02 nova-api[17219]: 2017-09-28 13:06:49.045 17219 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:06:49 ctl02 nova-api[17219]: 2017-09-28 13:06:49.045 17219 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:06:49 ctl02 nova-api[17219]: 2017-09-28 13:06:49.045 17219 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:06:49 ctl02 nova-api[17219]: 2017-09-28 13:06:49.045 17219 ERROR nova.wsgi     self.filename))
Sep 28 13:06:49 ctl02 nova-api[17219]: 2017-09-28 13:06:49.045 17219 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:06:49 ctl02 nova-api[17219]: 2017-09-28 13:06:49.045 17219 ERROR nova.wsgi
Sep 28 13:06:49 ctl02 nova-api[17219]: 2017-09-28 13:06:49.047 17219 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:06:49 ctl02 nova-api[17219]: 2017-09-28 13:06:49.179 17219 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:06:49 ctl02 heat-api[13008]: 2017-09-28 13:06:49.185 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:06:49] "OPTIONS / HTTP/1.0" 200 134 0.000733
Sep 28 13:06:49 ctl02 nova-api[17219]: 2017-09-28 13:06:49.426 17219 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:06:49 ctl02 nova-api[17219]: 2017-09-28 13:06:49.428 17219 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:06:49 ctl02 nova-api[17219]: 2017-09-28 13:06:49.428 17219 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:06:49 ctl02 nova-api[17219]: 2017-09-28 13:06:49.429 17219 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:06:49 ctl02 nova-api[17219]: 2017-09-28 13:06:49.561 17219 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:06:49 ctl02 nova-api[17219]: 2017-09-28 13:06:49.563 17219 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:06:49 ctl02 nova-api[17219]: 2017-09-28 13:06:49.564 17219 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:06:49 ctl02 nova-api[17219]: 2017-09-28 13:06:49.564 17219 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:06:49 ctl02 nova-api[17219]: 2017-09-28 13:06:49.567 17219 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:06:49 ctl02 nova-api[17219]: 2017-09-28 13:06:49.568 17219 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:06:49 ctl02 nova-api[17219]: 2017-09-28 13:06:49.568 17219 ERROR nova Traceback (most recent call last):
Sep 28 13:06:49 ctl02 nova-api[17219]: 2017-09-28 13:06:49.568 17219 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:06:49 ctl02 nova-api[17219]: 2017-09-28 13:06:49.568 17219 ERROR nova     sys.exit(main())
Sep 28 13:06:49 ctl02 nova-api[17219]: 2017-09-28 13:06:49.568 17219 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:06:49 ctl02 nova-api[17219]: 2017-09-28 13:06:49.568 17219 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:06:49 ctl02 nova-api[17219]: 2017-09-28 13:06:49.568 17219 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:06:49 ctl02 nova-api[17219]: 2017-09-28 13:06:49.568 17219 ERROR nova     max_url_len=max_url_len)
Sep 28 13:06:49 ctl02 nova-api[17219]: 2017-09-28 13:06:49.568 17219 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:06:49 ctl02 nova-api[17219]: 2017-09-28 13:06:49.568 17219 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:06:49 ctl02 nova-api[17219]: 2017-09-28 13:06:49.568 17219 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:06:49 ctl02 nova-api[17219]: 2017-09-28 13:06:49.568 17219 ERROR nova     sock.listen(backlog)
Sep 28 13:06:49 ctl02 nova-api[17219]: 2017-09-28 13:06:49.568 17219 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:06:49 ctl02 nova-api[17219]: 2017-09-28 13:06:49.568 17219 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:06:49 ctl02 nova-api[17219]: 2017-09-28 13:06:49.568 17219 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:06:49 ctl02 nova-api[17219]: 2017-09-28 13:06:49.568 17219 ERROR nova
Sep 28 13:06:49 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:06:49 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:06:49 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:06:49 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf050b4e)
Sep 28 13:06:49 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:06:49 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:06:49 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:06:49 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:06:49 ctl02 glance-api[29183]: 2017-09-28 13:06:49.900 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:06:49] "OPTIONS / HTTP/1.0" 200 134 0.000684
Sep 28 13:06:50 ctl02 neutron-server[30536]: 2017-09-28 13:06:50.738 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:06:50] "OPTIONS / HTTP/1.0" 200 262 0.000489
Sep 28 13:06:50 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 13:06:50 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 13:06:50 ctl02 neutron-server[30536]: 2017-09-28 13:06:50.975 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 13:06:50 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 13:06:50 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 13:05:06 cmp002
Sep 28 13:06:50 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 13:05:08 cmp001
Sep 28 13:06:50 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 13:05:36 cmp002
Sep 28 13:06:51 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:06:51.230 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:06:51] "OPTIONS / HTTP/1.0" 200 134 0.000501
Sep 28 13:06:51 ctl02 nova-api[17237]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:06:51 ctl02 nova-api[17237]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:06:51 ctl02 nova-api[17237]: 2017-09-28 13:06:51.772 17237 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:06:51 ctl02 nova-api[17237]: 2017-09-28 13:06:51.774 17237 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:06:51 ctl02 nova-api[17237]: 2017-09-28 13:06:51.774 17237 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:06:51 ctl02 nova-api[17237]: 2017-09-28 13:06:51.774 17237 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:06:51 ctl02 nova-api[17237]: 2017-09-28 13:06:51.774 17237 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:06:51 ctl02 nova-api[17237]: 2017-09-28 13:06:51.774 17237 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:06:51 ctl02 nova-api[17237]: 2017-09-28 13:06:51.774 17237 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:06:51 ctl02 nova-api[17237]: 2017-09-28 13:06:51.774 17237 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:06:51 ctl02 nova-api[17237]: 2017-09-28 13:06:51.774 17237 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:06:51 ctl02 nova-api[17237]: 2017-09-28 13:06:51.774 17237 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:06:51 ctl02 nova-api[17237]: 2017-09-28 13:06:51.774 17237 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:06:51 ctl02 nova-api[17237]: 2017-09-28 13:06:51.774 17237 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:06:51 ctl02 nova-api[17237]: 2017-09-28 13:06:51.774 17237 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:06:51 ctl02 nova-api[17237]: 2017-09-28 13:06:51.774 17237 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:06:51 ctl02 nova-api[17237]: 2017-09-28 13:06:51.774 17237 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:06:51 ctl02 nova-api[17237]: 2017-09-28 13:06:51.774 17237 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:06:51 ctl02 nova-api[17237]: 2017-09-28 13:06:51.774 17237 ERROR nova.wsgi     self.filename))
Sep 28 13:06:51 ctl02 nova-api[17237]: 2017-09-28 13:06:51.774 17237 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:06:51 ctl02 nova-api[17237]: 2017-09-28 13:06:51.774 17237 ERROR nova.wsgi
Sep 28 13:06:51 ctl02 nova-api[17237]: 2017-09-28 13:06:51.785 17237 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:06:51 ctl02 nova-api[17237]: 2017-09-28 13:06:51.913 17237 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:06:52 ctl02 nova-api[17237]: 2017-09-28 13:06:52.140 17237 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:06:52 ctl02 nova-api[17237]: 2017-09-28 13:06:52.142 17237 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:06:52 ctl02 nova-api[17237]: 2017-09-28 13:06:52.142 17237 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:06:52 ctl02 nova-api[17237]: 2017-09-28 13:06:52.143 17237 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:06:52 ctl02 nova-api[17237]: 2017-09-28 13:06:52.275 17237 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:06:52 ctl02 nova-api[17237]: 2017-09-28 13:06:52.277 17237 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:06:52 ctl02 nova-api[17237]: 2017-09-28 13:06:52.277 17237 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:06:52 ctl02 nova-api[17237]: 2017-09-28 13:06:52.277 17237 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:06:52 ctl02 nova-api[17237]: 2017-09-28 13:06:52.281 17237 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:06:52 ctl02 nova-api[17237]: 2017-09-28 13:06:52.281 17237 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:06:52 ctl02 nova-api[17237]: 2017-09-28 13:06:52.281 17237 ERROR nova Traceback (most recent call last):
Sep 28 13:06:52 ctl02 nova-api[17237]: 2017-09-28 13:06:52.281 17237 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:06:52 ctl02 nova-api[17237]: 2017-09-28 13:06:52.281 17237 ERROR nova     sys.exit(main())
Sep 28 13:06:52 ctl02 nova-api[17237]: 2017-09-28 13:06:52.281 17237 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:06:52 ctl02 nova-api[17237]: 2017-09-28 13:06:52.281 17237 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:06:52 ctl02 nova-api[17237]: 2017-09-28 13:06:52.281 17237 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:06:52 ctl02 nova-api[17237]: 2017-09-28 13:06:52.281 17237 ERROR nova     max_url_len=max_url_len)
Sep 28 13:06:52 ctl02 nova-api[17237]: 2017-09-28 13:06:52.281 17237 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:06:52 ctl02 nova-api[17237]: 2017-09-28 13:06:52.281 17237 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:06:52 ctl02 nova-api[17237]: 2017-09-28 13:06:52.281 17237 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:06:52 ctl02 nova-api[17237]: 2017-09-28 13:06:52.281 17237 ERROR nova     sock.listen(backlog)
Sep 28 13:06:52 ctl02 nova-api[17237]: 2017-09-28 13:06:52.281 17237 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:06:52 ctl02 nova-api[17237]: 2017-09-28 13:06:52.281 17237 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:06:52 ctl02 nova-api[17237]: 2017-09-28 13:06:52.281 17237 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:06:52 ctl02 nova-api[17237]: 2017-09-28 13:06:52.281 17237 ERROR nova
Sep 28 13:06:52 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:06:52 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:06:52 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:06:52 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:06:52 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:06:52 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:06:52 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:06:53 ctl02 glance-api[29183]: 2017-09-28 13:06:53.029 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:06:53] "OPTIONS / HTTP/1.0" 200 134 0.000631
Sep 28 13:06:53 ctl02 heat-api[13008]: 2017-09-28 13:06:53.061 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:06:53] "OPTIONS / HTTP/1.0" 200 134 0.000605
Sep 28 13:06:53 ctl02 glance-api[29183]: 2017-09-28 13:06:53.835 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:06:53] "OPTIONS / HTTP/1.0" 200 134 0.000674
Sep 28 13:06:53 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:06:53.854 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:06:53] "OPTIONS / HTTP/1.0" 200 134 0.000566
Sep 28 13:06:53 ctl02 heat-api-cfn[13300]: 2017-09-28 13:06:53.968 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:06:53] "OPTIONS / HTTP/1.0" 200 134 0.000493
Sep 28 13:06:54 ctl02 nova-api[17261]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:06:54 ctl02 nova-api[17261]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:06:54 ctl02 nova-api[17261]: 2017-09-28 13:06:54.569 17261 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:06:54 ctl02 nova-api[17261]: 2017-09-28 13:06:54.571 17261 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:06:54 ctl02 nova-api[17261]: 2017-09-28 13:06:54.571 17261 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:06:54 ctl02 nova-api[17261]: 2017-09-28 13:06:54.571 17261 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:06:54 ctl02 nova-api[17261]: 2017-09-28 13:06:54.571 17261 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:06:54 ctl02 nova-api[17261]: 2017-09-28 13:06:54.571 17261 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:06:54 ctl02 nova-api[17261]: 2017-09-28 13:06:54.571 17261 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:06:54 ctl02 nova-api[17261]: 2017-09-28 13:06:54.571 17261 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:06:54 ctl02 nova-api[17261]: 2017-09-28 13:06:54.571 17261 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:06:54 ctl02 nova-api[17261]: 2017-09-28 13:06:54.571 17261 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:06:54 ctl02 nova-api[17261]: 2017-09-28 13:06:54.571 17261 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:06:54 ctl02 nova-api[17261]: 2017-09-28 13:06:54.571 17261 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:06:54 ctl02 nova-api[17261]: 2017-09-28 13:06:54.571 17261 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:06:54 ctl02 nova-api[17261]: 2017-09-28 13:06:54.571 17261 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:06:54 ctl02 nova-api[17261]: 2017-09-28 13:06:54.571 17261 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:06:54 ctl02 nova-api[17261]: 2017-09-28 13:06:54.571 17261 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:06:54 ctl02 nova-api[17261]: 2017-09-28 13:06:54.571 17261 ERROR nova.wsgi     self.filename))
Sep 28 13:06:54 ctl02 nova-api[17261]: 2017-09-28 13:06:54.571 17261 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:06:54 ctl02 nova-api[17261]: 2017-09-28 13:06:54.571 17261 ERROR nova.wsgi
Sep 28 13:06:54 ctl02 nova-api[17261]: 2017-09-28 13:06:54.573 17261 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:06:54 ctl02 neutron-server[30536]: 2017-09-28 13:06:54.681 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:06:54] "OPTIONS / HTTP/1.0" 200 262 0.000534
Sep 28 13:06:54 ctl02 nova-api[17261]: 2017-09-28 13:06:54.710 17261 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:06:54 ctl02 nova-api[17261]: 2017-09-28 13:06:54.961 17261 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:06:54 ctl02 nova-api[17261]: 2017-09-28 13:06:54.964 17261 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:06:54 ctl02 nova-api[17261]: 2017-09-28 13:06:54.964 17261 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:06:54 ctl02 nova-api[17261]: 2017-09-28 13:06:54.965 17261 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:06:55 ctl02 nova-api[17261]: 2017-09-28 13:06:55.099 17261 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:06:55 ctl02 nova-api[17261]: 2017-09-28 13:06:55.103 17261 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:06:55 ctl02 nova-api[17261]: 2017-09-28 13:06:55.103 17261 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:06:55 ctl02 nova-api[17261]: 2017-09-28 13:06:55.104 17261 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:06:55 ctl02 nova-api[17261]: 2017-09-28 13:06:55.107 17261 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:06:55 ctl02 nova-api[17261]: 2017-09-28 13:06:55.107 17261 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:06:55 ctl02 nova-api[17261]: 2017-09-28 13:06:55.107 17261 ERROR nova Traceback (most recent call last):
Sep 28 13:06:55 ctl02 nova-api[17261]: 2017-09-28 13:06:55.107 17261 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:06:55 ctl02 nova-api[17261]: 2017-09-28 13:06:55.107 17261 ERROR nova     sys.exit(main())
Sep 28 13:06:55 ctl02 nova-api[17261]: 2017-09-28 13:06:55.107 17261 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:06:55 ctl02 nova-api[17261]: 2017-09-28 13:06:55.107 17261 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:06:55 ctl02 nova-api[17261]: 2017-09-28 13:06:55.107 17261 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:06:55 ctl02 nova-api[17261]: 2017-09-28 13:06:55.107 17261 ERROR nova     max_url_len=max_url_len)
Sep 28 13:06:55 ctl02 nova-api[17261]: 2017-09-28 13:06:55.107 17261 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:06:55 ctl02 nova-api[17261]: 2017-09-28 13:06:55.107 17261 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:06:55 ctl02 nova-api[17261]: 2017-09-28 13:06:55.107 17261 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:06:55 ctl02 nova-api[17261]: 2017-09-28 13:06:55.107 17261 ERROR nova     sock.listen(backlog)
Sep 28 13:06:55 ctl02 nova-api[17261]: 2017-09-28 13:06:55.107 17261 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:06:55 ctl02 nova-api[17261]: 2017-09-28 13:06:55.107 17261 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:06:55 ctl02 nova-api[17261]: 2017-09-28 13:06:55.107 17261 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:06:55 ctl02 nova-api[17261]: 2017-09-28 13:06:55.107 17261 ERROR nova
Sep 28 13:06:55 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:06:55 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:06:55 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:06:55 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:06:55 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:06:55 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:06:55 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:06:57 ctl02 nova-api[17279]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:06:57 ctl02 nova-api[17279]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:06:57 ctl02 heat-api-cfn[13300]: 2017-09-28 13:06:57.365 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:06:57] "OPTIONS / HTTP/1.0" 200 134 0.000554
Sep 28 13:06:57 ctl02 heat-api[13008]: 2017-09-28 13:06:57.379 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:06:57] "OPTIONS / HTTP/1.0" 200 134 0.000559
Sep 28 13:06:57 ctl02 nova-api[17279]: 2017-09-28 13:06:57.513 17279 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:06:57 ctl02 nova-api[17279]: 2017-09-28 13:06:57.515 17279 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:06:57 ctl02 nova-api[17279]: 2017-09-28 13:06:57.515 17279 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:06:57 ctl02 nova-api[17279]: 2017-09-28 13:06:57.515 17279 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:06:57 ctl02 nova-api[17279]: 2017-09-28 13:06:57.515 17279 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:06:57 ctl02 nova-api[17279]: 2017-09-28 13:06:57.515 17279 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:06:57 ctl02 nova-api[17279]: 2017-09-28 13:06:57.515 17279 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:06:57 ctl02 nova-api[17279]: 2017-09-28 13:06:57.515 17279 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:06:57 ctl02 nova-api[17279]: 2017-09-28 13:06:57.515 17279 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:06:57 ctl02 nova-api[17279]: 2017-09-28 13:06:57.515 17279 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:06:57 ctl02 nova-api[17279]: 2017-09-28 13:06:57.515 17279 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:06:57 ctl02 nova-api[17279]: 2017-09-28 13:06:57.515 17279 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:06:57 ctl02 nova-api[17279]: 2017-09-28 13:06:57.515 17279 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:06:57 ctl02 nova-api[17279]: 2017-09-28 13:06:57.515 17279 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:06:57 ctl02 nova-api[17279]: 2017-09-28 13:06:57.515 17279 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:06:57 ctl02 nova-api[17279]: 2017-09-28 13:06:57.515 17279 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:06:57 ctl02 nova-api[17279]: 2017-09-28 13:06:57.515 17279 ERROR nova.wsgi     self.filename))
Sep 28 13:06:57 ctl02 nova-api[17279]: 2017-09-28 13:06:57.515 17279 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:06:57 ctl02 nova-api[17279]: 2017-09-28 13:06:57.515 17279 ERROR nova.wsgi
Sep 28 13:06:57 ctl02 nova-api[17279]: 2017-09-28 13:06:57.516 17279 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:06:57 ctl02 nova-api[17279]: 2017-09-28 13:06:57.655 17279 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:06:57 ctl02 nova-api[17279]: 2017-09-28 13:06:57.881 17279 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:06:57 ctl02 nova-api[17279]: 2017-09-28 13:06:57.883 17279 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:06:57 ctl02 nova-api[17279]: 2017-09-28 13:06:57.883 17279 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:06:57 ctl02 nova-api[17279]: 2017-09-28 13:06:57.884 17279 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:06:58 ctl02 nova-api[17279]: 2017-09-28 13:06:58.015 17279 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:06:58 ctl02 nova-api[17279]: 2017-09-28 13:06:58.017 17279 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:06:58 ctl02 nova-api[17279]: 2017-09-28 13:06:58.017 17279 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:06:58 ctl02 nova-api[17279]: 2017-09-28 13:06:58.017 17279 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:06:58 ctl02 nova-api[17279]: 2017-09-28 13:06:58.021 17279 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:06:58 ctl02 nova-api[17279]: 2017-09-28 13:06:58.021 17279 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:06:58 ctl02 nova-api[17279]: 2017-09-28 13:06:58.021 17279 ERROR nova Traceback (most recent call last):
Sep 28 13:06:58 ctl02 nova-api[17279]: 2017-09-28 13:06:58.021 17279 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:06:58 ctl02 nova-api[17279]: 2017-09-28 13:06:58.021 17279 ERROR nova     sys.exit(main())
Sep 28 13:06:58 ctl02 nova-api[17279]: 2017-09-28 13:06:58.021 17279 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:06:58 ctl02 nova-api[17279]: 2017-09-28 13:06:58.021 17279 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:06:58 ctl02 nova-api[17279]: 2017-09-28 13:06:58.021 17279 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:06:58 ctl02 nova-api[17279]: 2017-09-28 13:06:58.021 17279 ERROR nova     max_url_len=max_url_len)
Sep 28 13:06:58 ctl02 nova-api[17279]: 2017-09-28 13:06:58.021 17279 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:06:58 ctl02 nova-api[17279]: 2017-09-28 13:06:58.021 17279 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:06:58 ctl02 nova-api[17279]: 2017-09-28 13:06:58.021 17279 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:06:58 ctl02 nova-api[17279]: 2017-09-28 13:06:58.021 17279 ERROR nova     sock.listen(backlog)
Sep 28 13:06:58 ctl02 nova-api[17279]: 2017-09-28 13:06:58.021 17279 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:06:58 ctl02 nova-api[17279]: 2017-09-28 13:06:58.021 17279 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:06:58 ctl02 nova-api[17279]: 2017-09-28 13:06:58.021 17279 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:06:58 ctl02 nova-api[17279]: 2017-09-28 13:06:58.021 17279 ERROR nova
Sep 28 13:06:58 ctl02 nova-consoleauth[5433]: 2017-09-28 13:06:58.137 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:06:58 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:06:58 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:06:58 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:06:58 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:06:58.368 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:06:58] "OPTIONS / HTTP/1.0" 200 134 0.000602
Sep 28 13:06:58 ctl02 neutron-server[30536]: 2017-09-28 13:06:58.373 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:06:58] "OPTIONS / HTTP/1.0" 200 262 0.000641
Sep 28 13:06:58 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:06:58 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:06:58 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:06:58 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:06:58 ctl02 heat-engine[12803]: 2017-09-28 13:06:58.494 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:06:58 ctl02 heat-engine[12803]: 2017-09-28 13:06:58.511 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:06:58 ctl02 heat-engine[12803]: 2017-09-28 13:06:58.520 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:06:58 ctl02 heat-engine[12803]: 2017-09-28 13:06:58.525 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:06:58 ctl02 neutron-server[30536]: 2017-09-28 13:06:58.534 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 13:06:58 ctl02 heat-api-cfn[13300]: 2017-09-28 13:06:58.538 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:06:58] "OPTIONS / HTTP/1.0" 200 134 0.000524
Sep 28 13:06:59 ctl02 neutron-server[30536]: 2017-09-28 13:06:59.046 30595 WARNING keystonemiddleware.auth_token [-] Using the in-process token cache is deprecated as of the 4.2.0 release and may be removed in the 5.0.0 release or the 'O' development cycle. The in-process cache causes inconsistent results and high memory usage. When the feature is removed the auth_token middleware will not cache tokens by default which may result in performance issues. It is recommended to use  memcache for the auth_token token cache by setting the memcached_servers option.
Sep 28 13:06:59 ctl02 neutron-server[30536]: 2017-09-28 13:06:59.183 30595 INFO neutron.wsgi [req-67be3b58-4e77-444c-97b6-cf775ba4274c 47d6ef1b5476456ea76a1f62f17c0bea 5f384790c44b46a1986075a6d7985b8c - - -] 10.167.4.13 - - [28/Sep/2017 13:06:59] "GET /v2.0/lbaas/loadbalancers.json HTTP/1.1" 404 261 0.137677
Sep 28 13:06:59 ctl02 heat-api[13008]: 2017-09-28 13:06:59.315 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:06:59] "OPTIONS / HTTP/1.0" 200 134 0.000686
Sep 28 13:06:59 ctl02 neutron-server[30536]: 2017-09-28 13:06:59.407 30596 WARNING keystonemiddleware.auth_token [-] Using the in-process token cache is deprecated as of the 4.2.0 release and may be removed in the 5.0.0 release or the 'O' development cycle. The in-process cache causes inconsistent results and high memory usage. When the feature is removed the auth_token middleware will not cache tokens by default which may result in performance issues. It is recommended to use  memcache for the auth_token token cache by setting the memcached_servers option.
Sep 28 13:06:59 ctl02 neutron-server[30536]: 2017-09-28 13:06:59.543 30596 INFO neutron.wsgi [req-dac89f4b-f2ac-4792-a531-f4b933157b10 47d6ef1b5476456ea76a1f62f17c0bea 5f384790c44b46a1986075a6d7985b8c - - -] 10.167.4.13 - - [28/Sep/2017 13:06:59] "GET /v2.0/lbaas/pools.json HTTP/1.1" 404 261 0.136900
Sep 28 13:07:00 ctl02 glance-api[29183]: 2017-09-28 13:07:00.101 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:07:00] "OPTIONS / HTTP/1.0" 200 134 0.000515
Sep 28 13:07:00 ctl02 nova-api[17297]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:07:00 ctl02 nova-api[17297]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:07:00 ctl02 nova-api[17297]: 2017-09-28 13:07:00.291 17297 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:07:00 ctl02 nova-api[17297]: 2017-09-28 13:07:00.292 17297 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:07:00 ctl02 nova-api[17297]: 2017-09-28 13:07:00.292 17297 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:07:00 ctl02 nova-api[17297]: 2017-09-28 13:07:00.292 17297 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:07:00 ctl02 nova-api[17297]: 2017-09-28 13:07:00.292 17297 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:07:00 ctl02 nova-api[17297]: 2017-09-28 13:07:00.292 17297 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:07:00 ctl02 nova-api[17297]: 2017-09-28 13:07:00.292 17297 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:07:00 ctl02 nova-api[17297]: 2017-09-28 13:07:00.292 17297 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:07:00 ctl02 nova-api[17297]: 2017-09-28 13:07:00.292 17297 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:07:00 ctl02 nova-api[17297]: 2017-09-28 13:07:00.292 17297 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:07:00 ctl02 nova-api[17297]: 2017-09-28 13:07:00.292 17297 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:07:00 ctl02 nova-api[17297]: 2017-09-28 13:07:00.292 17297 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:07:00 ctl02 nova-api[17297]: 2017-09-28 13:07:00.292 17297 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:07:00 ctl02 nova-api[17297]: 2017-09-28 13:07:00.292 17297 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:07:00 ctl02 nova-api[17297]: 2017-09-28 13:07:00.292 17297 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:07:00 ctl02 nova-api[17297]: 2017-09-28 13:07:00.292 17297 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:07:00 ctl02 nova-api[17297]: 2017-09-28 13:07:00.292 17297 ERROR nova.wsgi     self.filename))
Sep 28 13:07:00 ctl02 nova-api[17297]: 2017-09-28 13:07:00.292 17297 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:07:00 ctl02 nova-api[17297]: 2017-09-28 13:07:00.292 17297 ERROR nova.wsgi
Sep 28 13:07:00 ctl02 nova-api[17297]: 2017-09-28 13:07:00.293 17297 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:07:00 ctl02 nova-api[17297]: 2017-09-28 13:07:00.424 17297 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:07:00 ctl02 neutron-server[30536]: 2017-09-28 13:07:00.459 30594 WARNING keystonemiddleware.auth_token [-] Using the in-process token cache is deprecated as of the 4.2.0 release and may be removed in the 5.0.0 release or the 'O' development cycle. The in-process cache causes inconsistent results and high memory usage. When the feature is removed the auth_token middleware will not cache tokens by default which may result in performance issues. It is recommended to use  memcache for the auth_token token cache by setting the memcached_servers option.
Sep 28 13:07:00 ctl02 neutron-server[30536]: 2017-09-28 13:07:00.597 30594 INFO neutron.wsgi [req-8f92c5e4-1ed0-47b1-a5b3-6bf875c10af4 47d6ef1b5476456ea76a1f62f17c0bea 5f384790c44b46a1986075a6d7985b8c - - -] 10.167.4.13 - - [28/Sep/2017 13:07:00] "GET /v2.0/fw/firewall_policies.json HTTP/1.1" 404 261 0.139443
Sep 28 13:07:00 ctl02 nova-api[17297]: 2017-09-28 13:07:00.655 17297 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:07:00 ctl02 nova-api[17297]: 2017-09-28 13:07:00.658 17297 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:07:00 ctl02 nova-api[17297]: 2017-09-28 13:07:00.658 17297 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:07:00 ctl02 nova-api[17297]: 2017-09-28 13:07:00.658 17297 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:07:00 ctl02 nova-api[17297]: 2017-09-28 13:07:00.791 17297 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:07:00 ctl02 nova-api[17297]: 2017-09-28 13:07:00.793 17297 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:07:00 ctl02 nova-api[17297]: 2017-09-28 13:07:00.794 17297 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:07:00 ctl02 nova-api[17297]: 2017-09-28 13:07:00.794 17297 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:07:00 ctl02 nova-api[17297]: 2017-09-28 13:07:00.797 17297 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:07:00 ctl02 nova-api[17297]: 2017-09-28 13:07:00.798 17297 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:07:00 ctl02 nova-api[17297]: 2017-09-28 13:07:00.798 17297 ERROR nova Traceback (most recent call last):
Sep 28 13:07:00 ctl02 nova-api[17297]: 2017-09-28 13:07:00.798 17297 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:07:00 ctl02 nova-api[17297]: 2017-09-28 13:07:00.798 17297 ERROR nova     sys.exit(main())
Sep 28 13:07:00 ctl02 nova-api[17297]: 2017-09-28 13:07:00.798 17297 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:07:00 ctl02 nova-api[17297]: 2017-09-28 13:07:00.798 17297 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:07:00 ctl02 nova-api[17297]: 2017-09-28 13:07:00.798 17297 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:07:00 ctl02 nova-api[17297]: 2017-09-28 13:07:00.798 17297 ERROR nova     max_url_len=max_url_len)
Sep 28 13:07:00 ctl02 nova-api[17297]: 2017-09-28 13:07:00.798 17297 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:07:00 ctl02 nova-api[17297]: 2017-09-28 13:07:00.798 17297 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:07:00 ctl02 nova-api[17297]: 2017-09-28 13:07:00.798 17297 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:07:00 ctl02 nova-api[17297]: 2017-09-28 13:07:00.798 17297 ERROR nova     sock.listen(backlog)
Sep 28 13:07:00 ctl02 nova-api[17297]: 2017-09-28 13:07:00.798 17297 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:07:00 ctl02 nova-api[17297]: 2017-09-28 13:07:00.798 17297 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:07:00 ctl02 nova-api[17297]: 2017-09-28 13:07:00.798 17297 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:07:00 ctl02 nova-api[17297]: 2017-09-28 13:07:00.798 17297 ERROR nova
Sep 28 13:07:00 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:07:00 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:07:00 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:07:00 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:07:00.997 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:07:00] "OPTIONS / HTTP/1.0" 200 134 0.000384
Sep 28 13:07:01 ctl02 neutron-server[30536]: 2017-09-28 13:07:01.123 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:07:01] "OPTIONS / HTTP/1.0" 200 262 0.000573
Sep 28 13:07:01 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:07:01 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:07:01 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:07:01 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:07:01 ctl02 nova-scheduler[5620]: 2017-09-28 13:07:01.240 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:07:02 ctl02 glance-api[29183]: 2017-09-28 13:07:02.707 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:07:02] "OPTIONS / HTTP/1.0" 200 134 0.000547
Sep 28 13:07:02 ctl02 nova-api[17316]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:07:02 ctl02 nova-api[17316]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:07:02 ctl02 nova-api[17316]: 2017-09-28 13:07:02.956 17316 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:07:02 ctl02 nova-api[17316]: 2017-09-28 13:07:02.958 17316 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:07:02 ctl02 nova-api[17316]: 2017-09-28 13:07:02.958 17316 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:07:02 ctl02 nova-api[17316]: 2017-09-28 13:07:02.958 17316 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:07:02 ctl02 nova-api[17316]: 2017-09-28 13:07:02.958 17316 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:07:02 ctl02 nova-api[17316]: 2017-09-28 13:07:02.958 17316 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:07:02 ctl02 nova-api[17316]: 2017-09-28 13:07:02.958 17316 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:07:02 ctl02 nova-api[17316]: 2017-09-28 13:07:02.958 17316 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:07:02 ctl02 nova-api[17316]: 2017-09-28 13:07:02.958 17316 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:07:02 ctl02 nova-api[17316]: 2017-09-28 13:07:02.958 17316 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:07:02 ctl02 nova-api[17316]: 2017-09-28 13:07:02.958 17316 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:07:02 ctl02 nova-api[17316]: 2017-09-28 13:07:02.958 17316 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:07:02 ctl02 nova-api[17316]: 2017-09-28 13:07:02.958 17316 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:07:02 ctl02 nova-api[17316]: 2017-09-28 13:07:02.958 17316 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:07:02 ctl02 nova-api[17316]: 2017-09-28 13:07:02.958 17316 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:07:02 ctl02 nova-api[17316]: 2017-09-28 13:07:02.958 17316 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:07:02 ctl02 nova-api[17316]: 2017-09-28 13:07:02.958 17316 ERROR nova.wsgi     self.filename))
Sep 28 13:07:02 ctl02 nova-api[17316]: 2017-09-28 13:07:02.958 17316 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:07:02 ctl02 nova-api[17316]: 2017-09-28 13:07:02.958 17316 ERROR nova.wsgi
Sep 28 13:07:02 ctl02 nova-api[17316]: 2017-09-28 13:07:02.959 17316 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:07:03 ctl02 nova-api[17316]: 2017-09-28 13:07:03.085 17316 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:07:03 ctl02 heat-api[13008]: 2017-09-28 13:07:03.199 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:07:03] "OPTIONS / HTTP/1.0" 200 134 0.000556
Sep 28 13:07:03 ctl02 nova-api[17316]: 2017-09-28 13:07:03.307 17316 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:07:03 ctl02 nova-api[17316]: 2017-09-28 13:07:03.309 17316 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:07:03 ctl02 nova-api[17316]: 2017-09-28 13:07:03.309 17316 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:07:03 ctl02 nova-api[17316]: 2017-09-28 13:07:03.310 17316 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:07:03 ctl02 nova-api[17316]: 2017-09-28 13:07:03.440 17316 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:07:03 ctl02 nova-api[17316]: 2017-09-28 13:07:03.442 17316 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:07:03 ctl02 nova-api[17316]: 2017-09-28 13:07:03.442 17316 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:07:03 ctl02 nova-api[17316]: 2017-09-28 13:07:03.443 17316 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:07:03 ctl02 nova-api[17316]: 2017-09-28 13:07:03.446 17316 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:07:03 ctl02 nova-api[17316]: 2017-09-28 13:07:03.446 17316 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:07:03 ctl02 nova-api[17316]: 2017-09-28 13:07:03.446 17316 ERROR nova Traceback (most recent call last):
Sep 28 13:07:03 ctl02 nova-api[17316]: 2017-09-28 13:07:03.446 17316 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:07:03 ctl02 nova-api[17316]: 2017-09-28 13:07:03.446 17316 ERROR nova     sys.exit(main())
Sep 28 13:07:03 ctl02 nova-api[17316]: 2017-09-28 13:07:03.446 17316 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:07:03 ctl02 nova-api[17316]: 2017-09-28 13:07:03.446 17316 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:07:03 ctl02 nova-api[17316]: 2017-09-28 13:07:03.446 17316 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:07:03 ctl02 nova-api[17316]: 2017-09-28 13:07:03.446 17316 ERROR nova     max_url_len=max_url_len)
Sep 28 13:07:03 ctl02 nova-api[17316]: 2017-09-28 13:07:03.446 17316 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:07:03 ctl02 nova-api[17316]: 2017-09-28 13:07:03.446 17316 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:07:03 ctl02 nova-api[17316]: 2017-09-28 13:07:03.446 17316 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:07:03 ctl02 nova-api[17316]: 2017-09-28 13:07:03.446 17316 ERROR nova     sock.listen(backlog)
Sep 28 13:07:03 ctl02 nova-api[17316]: 2017-09-28 13:07:03.446 17316 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:07:03 ctl02 nova-api[17316]: 2017-09-28 13:07:03.446 17316 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:07:03 ctl02 nova-api[17316]: 2017-09-28 13:07:03.446 17316 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:07:03 ctl02 nova-api[17316]: 2017-09-28 13:07:03.446 17316 ERROR nova
Sep 28 13:07:03 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:07:03 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:07:03 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:07:03 ctl02 heat-api-cfn[13300]: 2017-09-28 13:07:03.782 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:07:03] "OPTIONS / HTTP/1.0" 200 134 0.000586
Sep 28 13:07:03 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:07:03 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:07:03 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:07:03.876 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:07:03] "OPTIONS / HTTP/1.0" 200 134 0.000596
Sep 28 13:07:03 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:07:03 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:07:04 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8dae3530)
Sep 28 13:07:04 ctl02 glance-api[29183]: 2017-09-28 13:07:04.137 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:07:04] "OPTIONS / HTTP/1.0" 200 134 0.000612
Sep 28 13:07:04 ctl02 neutron-server[30536]: 2017-09-28 13:07:04.447 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:07:04] "OPTIONS / HTTP/1.0" 200 262 0.000492
Sep 28 13:07:05 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8dae3530)
Sep 28 13:07:05 ctl02 nova-api[17334]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:07:05 ctl02 nova-api[17334]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:07:05 ctl02 nova-api[17334]: 2017-09-28 13:07:05.769 17334 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:07:05 ctl02 nova-api[17334]: 2017-09-28 13:07:05.771 17334 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:07:05 ctl02 nova-api[17334]: 2017-09-28 13:07:05.771 17334 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:07:05 ctl02 nova-api[17334]: 2017-09-28 13:07:05.771 17334 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:07:05 ctl02 nova-api[17334]: 2017-09-28 13:07:05.771 17334 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:07:05 ctl02 nova-api[17334]: 2017-09-28 13:07:05.771 17334 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:07:05 ctl02 nova-api[17334]: 2017-09-28 13:07:05.771 17334 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:07:05 ctl02 nova-api[17334]: 2017-09-28 13:07:05.771 17334 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:07:05 ctl02 nova-api[17334]: 2017-09-28 13:07:05.771 17334 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:07:05 ctl02 nova-api[17334]: 2017-09-28 13:07:05.771 17334 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:07:05 ctl02 nova-api[17334]: 2017-09-28 13:07:05.771 17334 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:07:05 ctl02 nova-api[17334]: 2017-09-28 13:07:05.771 17334 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:07:05 ctl02 nova-api[17334]: 2017-09-28 13:07:05.771 17334 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:07:05 ctl02 nova-api[17334]: 2017-09-28 13:07:05.771 17334 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:07:05 ctl02 nova-api[17334]: 2017-09-28 13:07:05.771 17334 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:07:05 ctl02 nova-api[17334]: 2017-09-28 13:07:05.771 17334 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:07:05 ctl02 nova-api[17334]: 2017-09-28 13:07:05.771 17334 ERROR nova.wsgi     self.filename))
Sep 28 13:07:05 ctl02 nova-api[17334]: 2017-09-28 13:07:05.771 17334 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:07:05 ctl02 nova-api[17334]: 2017-09-28 13:07:05.771 17334 ERROR nova.wsgi
Sep 28 13:07:05 ctl02 nova-api[17334]: 2017-09-28 13:07:05.772 17334 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:07:05 ctl02 nova-api[17334]: 2017-09-28 13:07:05.906 17334 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:07:05 ctl02 neutron-server[30536]: 2017-09-28 13:07:05.970 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 13:07:05 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 13:07:05 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 13:05:06 cmp002
Sep 28 13:07:05 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 13:05:08 cmp001
Sep 28 13:07:05 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 13:05:36 cmp002
Sep 28 13:07:06 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8dae3530)
Sep 28 13:07:06 ctl02 nova-api[17334]: 2017-09-28 13:07:06.127 17334 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:07:06 ctl02 nova-api[17334]: 2017-09-28 13:07:06.129 17334 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:07:06 ctl02 nova-api[17334]: 2017-09-28 13:07:06.130 17334 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:07:06 ctl02 nova-api[17334]: 2017-09-28 13:07:06.130 17334 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:07:06 ctl02 nova-api[17334]: 2017-09-28 13:07:06.268 17334 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:07:06 ctl02 nova-api[17334]: 2017-09-28 13:07:06.270 17334 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:07:06 ctl02 nova-api[17334]: 2017-09-28 13:07:06.271 17334 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:07:06 ctl02 nova-api[17334]: 2017-09-28 13:07:06.271 17334 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:07:06 ctl02 nova-api[17334]: 2017-09-28 13:07:06.274 17334 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:07:06 ctl02 nova-api[17334]: 2017-09-28 13:07:06.274 17334 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:07:06 ctl02 nova-api[17334]: 2017-09-28 13:07:06.274 17334 ERROR nova Traceback (most recent call last):
Sep 28 13:07:06 ctl02 nova-api[17334]: 2017-09-28 13:07:06.274 17334 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:07:06 ctl02 nova-api[17334]: 2017-09-28 13:07:06.274 17334 ERROR nova     sys.exit(main())
Sep 28 13:07:06 ctl02 nova-api[17334]: 2017-09-28 13:07:06.274 17334 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:07:06 ctl02 nova-api[17334]: 2017-09-28 13:07:06.274 17334 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:07:06 ctl02 nova-api[17334]: 2017-09-28 13:07:06.274 17334 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:07:06 ctl02 nova-api[17334]: 2017-09-28 13:07:06.274 17334 ERROR nova     max_url_len=max_url_len)
Sep 28 13:07:06 ctl02 nova-api[17334]: 2017-09-28 13:07:06.274 17334 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:07:06 ctl02 nova-api[17334]: 2017-09-28 13:07:06.274 17334 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:07:06 ctl02 nova-api[17334]: 2017-09-28 13:07:06.274 17334 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:07:06 ctl02 nova-api[17334]: 2017-09-28 13:07:06.274 17334 ERROR nova     sock.listen(backlog)
Sep 28 13:07:06 ctl02 nova-api[17334]: 2017-09-28 13:07:06.274 17334 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:07:06 ctl02 nova-api[17334]: 2017-09-28 13:07:06.274 17334 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:07:06 ctl02 nova-api[17334]: 2017-09-28 13:07:06.274 17334 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:07:06 ctl02 nova-api[17334]: 2017-09-28 13:07:06.274 17334 ERROR nova
Sep 28 13:07:06 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:07:06 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:07:06 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:07:06 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:07:06 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:07:06 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:07:06 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:07:07 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8dae3530)
Sep 28 13:07:07 ctl02 heat-api-cfn[13300]: 2017-09-28 13:07:07.315 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:07:07] "OPTIONS / HTTP/1.0" 200 134 0.000477
Sep 28 13:07:07 ctl02 heat-api[13008]: 2017-09-28 13:07:07.770 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:07:07] "OPTIONS / HTTP/1.0" 200 134 0.000624
Sep 28 13:07:08 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8dae3530)
Sep 28 13:07:08 ctl02 heat-api-cfn[13300]: 2017-09-28 13:07:08.191 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:07:08] "OPTIONS / HTTP/1.0" 200 134 0.000498
Sep 28 13:07:08 ctl02 neutron-server[30536]: 2017-09-28 13:07:08.322 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:07:08] "OPTIONS / HTTP/1.0" 200 262 0.000550
Sep 28 13:07:08 ctl02 nova-api[17352]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:07:08 ctl02 nova-api[17352]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:07:08 ctl02 nova-api[17352]: 2017-09-28 13:07:08.554 17352 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:07:08 ctl02 nova-api[17352]: 2017-09-28 13:07:08.555 17352 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:07:08 ctl02 nova-api[17352]: 2017-09-28 13:07:08.555 17352 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:07:08 ctl02 nova-api[17352]: 2017-09-28 13:07:08.555 17352 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:07:08 ctl02 nova-api[17352]: 2017-09-28 13:07:08.555 17352 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:07:08 ctl02 nova-api[17352]: 2017-09-28 13:07:08.555 17352 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:07:08 ctl02 nova-api[17352]: 2017-09-28 13:07:08.555 17352 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:07:08 ctl02 nova-api[17352]: 2017-09-28 13:07:08.555 17352 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:07:08 ctl02 nova-api[17352]: 2017-09-28 13:07:08.555 17352 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:07:08 ctl02 nova-api[17352]: 2017-09-28 13:07:08.555 17352 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:07:08 ctl02 nova-api[17352]: 2017-09-28 13:07:08.555 17352 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:07:08 ctl02 nova-api[17352]: 2017-09-28 13:07:08.555 17352 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:07:08 ctl02 nova-api[17352]: 2017-09-28 13:07:08.555 17352 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:07:08 ctl02 nova-api[17352]: 2017-09-28 13:07:08.555 17352 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:07:08 ctl02 nova-api[17352]: 2017-09-28 13:07:08.555 17352 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:07:08 ctl02 nova-api[17352]: 2017-09-28 13:07:08.555 17352 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:07:08 ctl02 nova-api[17352]: 2017-09-28 13:07:08.555 17352 ERROR nova.wsgi     self.filename))
Sep 28 13:07:08 ctl02 nova-api[17352]: 2017-09-28 13:07:08.555 17352 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:07:08 ctl02 nova-api[17352]: 2017-09-28 13:07:08.555 17352 ERROR nova.wsgi
Sep 28 13:07:08 ctl02 nova-api[17352]: 2017-09-28 13:07:08.557 17352 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:07:08 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:07:08.643 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:07:08] "OPTIONS / HTTP/1.0" 200 134 0.000447
Sep 28 13:07:08 ctl02 nova-api[17352]: 2017-09-28 13:07:08.689 17352 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:07:08 ctl02 nova-api[17352]: 2017-09-28 13:07:08.941 17352 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:07:08 ctl02 nova-api[17352]: 2017-09-28 13:07:08.943 17352 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:07:08 ctl02 nova-api[17352]: 2017-09-28 13:07:08.943 17352 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:07:08 ctl02 nova-api[17352]: 2017-09-28 13:07:08.944 17352 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:07:09 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8dae3530)
Sep 28 13:07:09 ctl02 nova-api[17352]: 2017-09-28 13:07:09.077 17352 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:07:09 ctl02 nova-api[17352]: 2017-09-28 13:07:09.079 17352 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:07:09 ctl02 nova-api[17352]: 2017-09-28 13:07:09.079 17352 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:07:09 ctl02 nova-api[17352]: 2017-09-28 13:07:09.080 17352 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:07:09 ctl02 nova-api[17352]: 2017-09-28 13:07:09.083 17352 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:07:09 ctl02 nova-api[17352]: 2017-09-28 13:07:09.083 17352 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:07:09 ctl02 nova-api[17352]: 2017-09-28 13:07:09.083 17352 ERROR nova Traceback (most recent call last):
Sep 28 13:07:09 ctl02 nova-api[17352]: 2017-09-28 13:07:09.083 17352 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:07:09 ctl02 nova-api[17352]: 2017-09-28 13:07:09.083 17352 ERROR nova     sys.exit(main())
Sep 28 13:07:09 ctl02 nova-api[17352]: 2017-09-28 13:07:09.083 17352 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:07:09 ctl02 nova-api[17352]: 2017-09-28 13:07:09.083 17352 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:07:09 ctl02 nova-api[17352]: 2017-09-28 13:07:09.083 17352 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:07:09 ctl02 nova-api[17352]: 2017-09-28 13:07:09.083 17352 ERROR nova     max_url_len=max_url_len)
Sep 28 13:07:09 ctl02 nova-api[17352]: 2017-09-28 13:07:09.083 17352 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:07:09 ctl02 nova-api[17352]: 2017-09-28 13:07:09.083 17352 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:07:09 ctl02 nova-api[17352]: 2017-09-28 13:07:09.083 17352 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:07:09 ctl02 nova-api[17352]: 2017-09-28 13:07:09.083 17352 ERROR nova     sock.listen(backlog)
Sep 28 13:07:09 ctl02 nova-api[17352]: 2017-09-28 13:07:09.083 17352 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:07:09 ctl02 nova-api[17352]: 2017-09-28 13:07:09.083 17352 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:07:09 ctl02 nova-api[17352]: 2017-09-28 13:07:09.083 17352 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:07:09 ctl02 nova-api[17352]: 2017-09-28 13:07:09.083 17352 ERROR nova
Sep 28 13:07:09 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:07:09 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:07:09 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:07:09 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:07:09 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:07:09 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:07:09 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:07:09 ctl02 heat-api[13008]: 2017-09-28 13:07:09.654 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:07:09] "OPTIONS / HTTP/1.0" 200 134 0.000649
Sep 28 13:07:10 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8dae3530)
Sep 28 13:07:10 ctl02 glance-api[29183]: 2017-09-28 13:07:10.335 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:07:10] "OPTIONS / HTTP/1.0" 200 134 0.000629
Sep 28 13:07:11 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8dae3530)
Sep 28 13:07:11 ctl02 nova-api[17370]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:07:11 ctl02 nova-api[17370]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:07:11 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:07:11.200 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:07:11] "OPTIONS / HTTP/1.0" 200 134 0.000475
Sep 28 13:07:11 ctl02 nova-api[17370]: 2017-09-28 13:07:11.272 17370 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:07:11 ctl02 nova-api[17370]: 2017-09-28 13:07:11.274 17370 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:07:11 ctl02 nova-api[17370]: 2017-09-28 13:07:11.274 17370 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:07:11 ctl02 nova-api[17370]: 2017-09-28 13:07:11.274 17370 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:07:11 ctl02 nova-api[17370]: 2017-09-28 13:07:11.274 17370 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:07:11 ctl02 nova-api[17370]: 2017-09-28 13:07:11.274 17370 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:07:11 ctl02 nova-api[17370]: 2017-09-28 13:07:11.274 17370 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:07:11 ctl02 nova-api[17370]: 2017-09-28 13:07:11.274 17370 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:07:11 ctl02 nova-api[17370]: 2017-09-28 13:07:11.274 17370 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:07:11 ctl02 nova-api[17370]: 2017-09-28 13:07:11.274 17370 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:07:11 ctl02 nova-api[17370]: 2017-09-28 13:07:11.274 17370 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:07:11 ctl02 nova-api[17370]: 2017-09-28 13:07:11.274 17370 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:07:11 ctl02 nova-api[17370]: 2017-09-28 13:07:11.274 17370 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:07:11 ctl02 nova-api[17370]: 2017-09-28 13:07:11.274 17370 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:07:11 ctl02 nova-api[17370]: 2017-09-28 13:07:11.274 17370 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:07:11 ctl02 nova-api[17370]: 2017-09-28 13:07:11.274 17370 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:07:11 ctl02 nova-api[17370]: 2017-09-28 13:07:11.274 17370 ERROR nova.wsgi     self.filename))
Sep 28 13:07:11 ctl02 nova-api[17370]: 2017-09-28 13:07:11.274 17370 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:07:11 ctl02 nova-api[17370]: 2017-09-28 13:07:11.274 17370 ERROR nova.wsgi
Sep 28 13:07:11 ctl02 nova-api[17370]: 2017-09-28 13:07:11.275 17370 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:07:11 ctl02 nova-api[17370]: 2017-09-28 13:07:11.409 17370 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:07:11 ctl02 neutron-server[30536]: 2017-09-28 13:07:11.509 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:07:11] "OPTIONS / HTTP/1.0" 200 262 0.000548
Sep 28 13:07:11 ctl02 nova-api[17370]: 2017-09-28 13:07:11.665 17370 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:07:11 ctl02 nova-api[17370]: 2017-09-28 13:07:11.667 17370 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:07:11 ctl02 nova-api[17370]: 2017-09-28 13:07:11.667 17370 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:07:11 ctl02 nova-api[17370]: 2017-09-28 13:07:11.668 17370 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:07:11 ctl02 nova-api[17370]: 2017-09-28 13:07:11.804 17370 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:07:11 ctl02 nova-api[17370]: 2017-09-28 13:07:11.806 17370 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:07:11 ctl02 nova-api[17370]: 2017-09-28 13:07:11.806 17370 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:07:11 ctl02 nova-api[17370]: 2017-09-28 13:07:11.806 17370 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:07:11 ctl02 nova-api[17370]: 2017-09-28 13:07:11.810 17370 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:07:11 ctl02 nova-api[17370]: 2017-09-28 13:07:11.810 17370 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:07:11 ctl02 nova-api[17370]: 2017-09-28 13:07:11.810 17370 ERROR nova Traceback (most recent call last):
Sep 28 13:07:11 ctl02 nova-api[17370]: 2017-09-28 13:07:11.810 17370 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:07:11 ctl02 nova-api[17370]: 2017-09-28 13:07:11.810 17370 ERROR nova     sys.exit(main())
Sep 28 13:07:11 ctl02 nova-api[17370]: 2017-09-28 13:07:11.810 17370 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:07:11 ctl02 nova-api[17370]: 2017-09-28 13:07:11.810 17370 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:07:11 ctl02 nova-api[17370]: 2017-09-28 13:07:11.810 17370 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:07:11 ctl02 nova-api[17370]: 2017-09-28 13:07:11.810 17370 ERROR nova     max_url_len=max_url_len)
Sep 28 13:07:11 ctl02 nova-api[17370]: 2017-09-28 13:07:11.810 17370 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:07:11 ctl02 nova-api[17370]: 2017-09-28 13:07:11.810 17370 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:07:11 ctl02 nova-api[17370]: 2017-09-28 13:07:11.810 17370 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:07:11 ctl02 nova-api[17370]: 2017-09-28 13:07:11.810 17370 ERROR nova     sock.listen(backlog)
Sep 28 13:07:11 ctl02 nova-api[17370]: 2017-09-28 13:07:11.810 17370 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:07:11 ctl02 nova-api[17370]: 2017-09-28 13:07:11.810 17370 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:07:11 ctl02 nova-api[17370]: 2017-09-28 13:07:11.810 17370 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:07:11 ctl02 nova-api[17370]: 2017-09-28 13:07:11.810 17370 ERROR nova
Sep 28 13:07:11 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:07:11 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:07:11 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:07:12 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8dae3530)
Sep 28 13:07:12 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:07:12 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:07:12 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:07:12 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:07:12 ctl02 glance-api[29183]: 2017-09-28 13:07:12.634 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:07:12] "OPTIONS / HTTP/1.0" 200 134 0.000660
Sep 28 13:07:13 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8dae3530)
Sep 28 13:07:13 ctl02 heat-api[13008]: 2017-09-28 13:07:13.404 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:07:13] "OPTIONS / HTTP/1.0" 200 134 0.000606
Sep 28 13:07:13 ctl02 nova-api[17388]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:07:13 ctl02 nova-api[17388]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:07:13 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:07:13.849 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:07:13] "OPTIONS / HTTP/1.0" 200 134 0.000641
Sep 28 13:07:13 ctl02 heat-api-cfn[13300]: 2017-09-28 13:07:13.905 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:07:13] "OPTIONS / HTTP/1.0" 200 134 0.000646
Sep 28 13:07:14 ctl02 nova-api[17388]: 2017-09-28 13:07:14.027 17388 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:07:14 ctl02 nova-api[17388]: 2017-09-28 13:07:14.029 17388 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:07:14 ctl02 nova-api[17388]: 2017-09-28 13:07:14.029 17388 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:07:14 ctl02 nova-api[17388]: 2017-09-28 13:07:14.029 17388 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:07:14 ctl02 nova-api[17388]: 2017-09-28 13:07:14.029 17388 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:07:14 ctl02 nova-api[17388]: 2017-09-28 13:07:14.029 17388 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:07:14 ctl02 nova-api[17388]: 2017-09-28 13:07:14.029 17388 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:07:14 ctl02 nova-api[17388]: 2017-09-28 13:07:14.029 17388 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:07:14 ctl02 nova-api[17388]: 2017-09-28 13:07:14.029 17388 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:07:14 ctl02 nova-api[17388]: 2017-09-28 13:07:14.029 17388 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:07:14 ctl02 nova-api[17388]: 2017-09-28 13:07:14.029 17388 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:07:14 ctl02 nova-api[17388]: 2017-09-28 13:07:14.029 17388 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:07:14 ctl02 nova-api[17388]: 2017-09-28 13:07:14.029 17388 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:07:14 ctl02 nova-api[17388]: 2017-09-28 13:07:14.029 17388 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:07:14 ctl02 nova-api[17388]: 2017-09-28 13:07:14.029 17388 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:07:14 ctl02 nova-api[17388]: 2017-09-28 13:07:14.029 17388 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:07:14 ctl02 nova-api[17388]: 2017-09-28 13:07:14.029 17388 ERROR nova.wsgi     self.filename))
Sep 28 13:07:14 ctl02 nova-api[17388]: 2017-09-28 13:07:14.029 17388 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:07:14 ctl02 nova-api[17388]: 2017-09-28 13:07:14.029 17388 ERROR nova.wsgi
Sep 28 13:07:14 ctl02 nova-api[17388]: 2017-09-28 13:07:14.031 17388 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:07:14 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x8dae3530)
Sep 28 13:07:14 ctl02 nova-api[17388]: 2017-09-28 13:07:14.167 17388 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:07:14 ctl02 glance-api[29183]: 2017-09-28 13:07:14.202 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:07:14] "OPTIONS / HTTP/1.0" 200 134 0.000584
Sep 28 13:07:14 ctl02 neutron-server[30536]: 2017-09-28 13:07:14.374 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:07:14] "OPTIONS / HTTP/1.0" 200 262 0.000473
Sep 28 13:07:14 ctl02 nova-api[17388]: 2017-09-28 13:07:14.401 17388 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:07:14 ctl02 nova-api[17388]: 2017-09-28 13:07:14.403 17388 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:07:14 ctl02 nova-api[17388]: 2017-09-28 13:07:14.404 17388 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:07:14 ctl02 nova-api[17388]: 2017-09-28 13:07:14.404 17388 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:07:14 ctl02 nova-api[17388]: 2017-09-28 13:07:14.536 17388 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:07:14 ctl02 nova-api[17388]: 2017-09-28 13:07:14.538 17388 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:07:14 ctl02 nova-api[17388]: 2017-09-28 13:07:14.538 17388 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:07:14 ctl02 nova-api[17388]: 2017-09-28 13:07:14.538 17388 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:07:14 ctl02 nova-api[17388]: 2017-09-28 13:07:14.541 17388 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:07:14 ctl02 nova-api[17388]: 2017-09-28 13:07:14.542 17388 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:07:14 ctl02 nova-api[17388]: 2017-09-28 13:07:14.542 17388 ERROR nova Traceback (most recent call last):
Sep 28 13:07:14 ctl02 nova-api[17388]: 2017-09-28 13:07:14.542 17388 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:07:14 ctl02 nova-api[17388]: 2017-09-28 13:07:14.542 17388 ERROR nova     sys.exit(main())
Sep 28 13:07:14 ctl02 nova-api[17388]: 2017-09-28 13:07:14.542 17388 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:07:14 ctl02 nova-api[17388]: 2017-09-28 13:07:14.542 17388 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:07:14 ctl02 nova-api[17388]: 2017-09-28 13:07:14.542 17388 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:07:14 ctl02 nova-api[17388]: 2017-09-28 13:07:14.542 17388 ERROR nova     max_url_len=max_url_len)
Sep 28 13:07:14 ctl02 nova-api[17388]: 2017-09-28 13:07:14.542 17388 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:07:14 ctl02 nova-api[17388]: 2017-09-28 13:07:14.542 17388 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:07:14 ctl02 nova-api[17388]: 2017-09-28 13:07:14.542 17388 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:07:14 ctl02 nova-api[17388]: 2017-09-28 13:07:14.542 17388 ERROR nova     sock.listen(backlog)
Sep 28 13:07:14 ctl02 nova-api[17388]: 2017-09-28 13:07:14.542 17388 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:07:14 ctl02 nova-api[17388]: 2017-09-28 13:07:14.542 17388 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:07:14 ctl02 nova-api[17388]: 2017-09-28 13:07:14.542 17388 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:07:14 ctl02 nova-api[17388]: 2017-09-28 13:07:14.542 17388 ERROR nova
Sep 28 13:07:14 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:07:14 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:07:14 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:07:14 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:07:14 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:07:14 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:07:14 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:07:15 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 13:07:15 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 13:07:16 ctl02 nova-api[17406]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:07:16 ctl02 nova-api[17406]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:07:16 ctl02 nova-api[17406]: 2017-09-28 13:07:16.743 17406 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:07:16 ctl02 nova-api[17406]: 2017-09-28 13:07:16.744 17406 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:07:16 ctl02 nova-api[17406]: 2017-09-28 13:07:16.744 17406 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:07:16 ctl02 nova-api[17406]: 2017-09-28 13:07:16.744 17406 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:07:16 ctl02 nova-api[17406]: 2017-09-28 13:07:16.744 17406 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:07:16 ctl02 nova-api[17406]: 2017-09-28 13:07:16.744 17406 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:07:16 ctl02 nova-api[17406]: 2017-09-28 13:07:16.744 17406 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:07:16 ctl02 nova-api[17406]: 2017-09-28 13:07:16.744 17406 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:07:16 ctl02 nova-api[17406]: 2017-09-28 13:07:16.744 17406 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:07:16 ctl02 nova-api[17406]: 2017-09-28 13:07:16.744 17406 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:07:16 ctl02 nova-api[17406]: 2017-09-28 13:07:16.744 17406 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:07:16 ctl02 nova-api[17406]: 2017-09-28 13:07:16.744 17406 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:07:16 ctl02 nova-api[17406]: 2017-09-28 13:07:16.744 17406 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:07:16 ctl02 nova-api[17406]: 2017-09-28 13:07:16.744 17406 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:07:16 ctl02 nova-api[17406]: 2017-09-28 13:07:16.744 17406 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:07:16 ctl02 nova-api[17406]: 2017-09-28 13:07:16.744 17406 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:07:16 ctl02 nova-api[17406]: 2017-09-28 13:07:16.744 17406 ERROR nova.wsgi     self.filename))
Sep 28 13:07:16 ctl02 nova-api[17406]: 2017-09-28 13:07:16.744 17406 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:07:16 ctl02 nova-api[17406]: 2017-09-28 13:07:16.744 17406 ERROR nova.wsgi
Sep 28 13:07:16 ctl02 nova-api[17406]: 2017-09-28 13:07:16.745 17406 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:07:16 ctl02 nova-api[17406]: 2017-09-28 13:07:16.878 17406 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:07:17 ctl02 heat-api-cfn[13300]: 2017-09-28 13:07:17.096 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:07:17] "OPTIONS / HTTP/1.0" 200 134 0.000564
Sep 28 13:07:17 ctl02 nova-api[17406]: 2017-09-28 13:07:17.125 17406 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:07:17 ctl02 nova-api[17406]: 2017-09-28 13:07:17.128 17406 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:07:17 ctl02 nova-api[17406]: 2017-09-28 13:07:17.128 17406 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:07:17 ctl02 nova-api[17406]: 2017-09-28 13:07:17.128 17406 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:07:17 ctl02 nova-api[17406]: 2017-09-28 13:07:17.262 17406 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:07:17 ctl02 nova-api[17406]: 2017-09-28 13:07:17.264 17406 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:07:17 ctl02 nova-api[17406]: 2017-09-28 13:07:17.264 17406 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:07:17 ctl02 nova-api[17406]: 2017-09-28 13:07:17.265 17406 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:07:17 ctl02 nova-api[17406]: 2017-09-28 13:07:17.268 17406 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:07:17 ctl02 nova-api[17406]: 2017-09-28 13:07:17.268 17406 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:07:17 ctl02 nova-api[17406]: 2017-09-28 13:07:17.268 17406 ERROR nova Traceback (most recent call last):
Sep 28 13:07:17 ctl02 nova-api[17406]: 2017-09-28 13:07:17.268 17406 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:07:17 ctl02 nova-api[17406]: 2017-09-28 13:07:17.268 17406 ERROR nova     sys.exit(main())
Sep 28 13:07:17 ctl02 nova-api[17406]: 2017-09-28 13:07:17.268 17406 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:07:17 ctl02 nova-api[17406]: 2017-09-28 13:07:17.268 17406 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:07:17 ctl02 nova-api[17406]: 2017-09-28 13:07:17.268 17406 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:07:17 ctl02 nova-api[17406]: 2017-09-28 13:07:17.268 17406 ERROR nova     max_url_len=max_url_len)
Sep 28 13:07:17 ctl02 nova-api[17406]: 2017-09-28 13:07:17.268 17406 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:07:17 ctl02 nova-api[17406]: 2017-09-28 13:07:17.268 17406 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:07:17 ctl02 nova-api[17406]: 2017-09-28 13:07:17.268 17406 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:07:17 ctl02 nova-api[17406]: 2017-09-28 13:07:17.268 17406 ERROR nova     sock.listen(backlog)
Sep 28 13:07:17 ctl02 nova-api[17406]: 2017-09-28 13:07:17.268 17406 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:07:17 ctl02 nova-api[17406]: 2017-09-28 13:07:17.268 17406 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:07:17 ctl02 nova-api[17406]: 2017-09-28 13:07:17.268 17406 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:07:17 ctl02 nova-api[17406]: 2017-09-28 13:07:17.268 17406 ERROR nova
Sep 28 13:07:17 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:07:17 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:07:17 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:07:17 ctl02 heat-api[13008]: 2017-09-28 13:07:17.473 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:07:17] "OPTIONS / HTTP/1.0" 200 134 0.000640
Sep 28 13:07:17 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:07:17 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:07:17 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:07:17 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:07:18 ctl02 neutron-server[30536]: 2017-09-28 13:07:18.373 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:07:18] "OPTIONS / HTTP/1.0" 200 262 0.000759
Sep 28 13:07:18 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:07:18.465 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:07:18] "OPTIONS / HTTP/1.0" 200 134 0.000440
Sep 28 13:07:18 ctl02 heat-api-cfn[13300]: 2017-09-28 13:07:18.478 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:07:18] "OPTIONS / HTTP/1.0" 200 134 0.000496
Sep 28 13:07:19 ctl02 nova-api[17429]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:07:19 ctl02 nova-api[17429]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:07:19 ctl02 nova-conductor[5056]: 2017-09-28 13:07:19.385 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:07:19 ctl02 nova-conductor[5056]: 2017-09-28 13:07:19.386 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:07:19 ctl02 nova-conductor[5056]: 2017-09-28 13:07:19.395 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:07:19 ctl02 nova-conductor[5056]: 2017-09-28 13:07:19.397 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:07:19 ctl02 nova-api[17429]: 2017-09-28 13:07:19.543 17429 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:07:19 ctl02 nova-api[17429]: 2017-09-28 13:07:19.545 17429 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:07:19 ctl02 nova-api[17429]: 2017-09-28 13:07:19.545 17429 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:07:19 ctl02 nova-api[17429]: 2017-09-28 13:07:19.545 17429 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:07:19 ctl02 nova-api[17429]: 2017-09-28 13:07:19.545 17429 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:07:19 ctl02 nova-api[17429]: 2017-09-28 13:07:19.545 17429 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:07:19 ctl02 nova-api[17429]: 2017-09-28 13:07:19.545 17429 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:07:19 ctl02 nova-api[17429]: 2017-09-28 13:07:19.545 17429 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:07:19 ctl02 nova-api[17429]: 2017-09-28 13:07:19.545 17429 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:07:19 ctl02 nova-api[17429]: 2017-09-28 13:07:19.545 17429 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:07:19 ctl02 nova-api[17429]: 2017-09-28 13:07:19.545 17429 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:07:19 ctl02 nova-api[17429]: 2017-09-28 13:07:19.545 17429 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:07:19 ctl02 nova-api[17429]: 2017-09-28 13:07:19.545 17429 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:07:19 ctl02 nova-api[17429]: 2017-09-28 13:07:19.545 17429 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:07:19 ctl02 nova-api[17429]: 2017-09-28 13:07:19.545 17429 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:07:19 ctl02 nova-api[17429]: 2017-09-28 13:07:19.545 17429 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:07:19 ctl02 nova-api[17429]: 2017-09-28 13:07:19.545 17429 ERROR nova.wsgi     self.filename))
Sep 28 13:07:19 ctl02 nova-api[17429]: 2017-09-28 13:07:19.545 17429 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:07:19 ctl02 nova-api[17429]: 2017-09-28 13:07:19.545 17429 ERROR nova.wsgi
Sep 28 13:07:19 ctl02 nova-api[17429]: 2017-09-28 13:07:19.546 17429 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:07:19 ctl02 heat-api[13008]: 2017-09-28 13:07:19.605 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:07:19] "OPTIONS / HTTP/1.0" 200 134 0.000643
Sep 28 13:07:19 ctl02 nova-api[17429]: 2017-09-28 13:07:19.682 17429 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:07:19 ctl02 nova-api[17429]: 2017-09-28 13:07:19.934 17429 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:07:19 ctl02 nova-api[17429]: 2017-09-28 13:07:19.937 17429 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:07:19 ctl02 nova-api[17429]: 2017-09-28 13:07:19.937 17429 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:07:19 ctl02 nova-api[17429]: 2017-09-28 13:07:19.937 17429 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:07:20 ctl02 nova-api[17429]: 2017-09-28 13:07:20.070 17429 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:07:20 ctl02 nova-api[17429]: 2017-09-28 13:07:20.072 17429 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:07:20 ctl02 nova-api[17429]: 2017-09-28 13:07:20.073 17429 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:07:20 ctl02 nova-api[17429]: 2017-09-28 13:07:20.073 17429 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:07:20 ctl02 nova-api[17429]: 2017-09-28 13:07:20.076 17429 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:07:20 ctl02 nova-api[17429]: 2017-09-28 13:07:20.077 17429 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:07:20 ctl02 nova-api[17429]: 2017-09-28 13:07:20.077 17429 ERROR nova Traceback (most recent call last):
Sep 28 13:07:20 ctl02 nova-api[17429]: 2017-09-28 13:07:20.077 17429 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:07:20 ctl02 nova-api[17429]: 2017-09-28 13:07:20.077 17429 ERROR nova     sys.exit(main())
Sep 28 13:07:20 ctl02 nova-api[17429]: 2017-09-28 13:07:20.077 17429 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:07:20 ctl02 nova-api[17429]: 2017-09-28 13:07:20.077 17429 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:07:20 ctl02 nova-api[17429]: 2017-09-28 13:07:20.077 17429 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:07:20 ctl02 nova-api[17429]: 2017-09-28 13:07:20.077 17429 ERROR nova     max_url_len=max_url_len)
Sep 28 13:07:20 ctl02 nova-api[17429]: 2017-09-28 13:07:20.077 17429 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:07:20 ctl02 nova-api[17429]: 2017-09-28 13:07:20.077 17429 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:07:20 ctl02 nova-api[17429]: 2017-09-28 13:07:20.077 17429 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:07:20 ctl02 nova-api[17429]: 2017-09-28 13:07:20.077 17429 ERROR nova     sock.listen(backlog)
Sep 28 13:07:20 ctl02 nova-api[17429]: 2017-09-28 13:07:20.077 17429 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:07:20 ctl02 nova-api[17429]: 2017-09-28 13:07:20.077 17429 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:07:20 ctl02 nova-api[17429]: 2017-09-28 13:07:20.077 17429 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:07:20 ctl02 nova-api[17429]: 2017-09-28 13:07:20.077 17429 ERROR nova
Sep 28 13:07:20 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:07:20 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:07:20 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:07:20 ctl02 glance-api[29183]: 2017-09-28 13:07:20.251 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:07:20] "OPTIONS / HTTP/1.0" 200 134 0.000627
Sep 28 13:07:20 ctl02 nova-cert[4860]: 2017-09-28 13:07:20.315 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:07:20 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:07:20 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:07:20 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:07:20 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:07:20 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:07:20.804 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:07:20] "OPTIONS / HTTP/1.0" 200 134 0.000439
Sep 28 13:07:20 ctl02 neutron-server[30536]: 2017-09-28 13:07:20.968 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 2 dead agents out of 6:
Sep 28 13:07:20 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 13:07:20 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 13:06:40 cmp002
Sep 28 13:07:20 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 13:05:36 cmp002
Sep 28 13:07:21 ctl02 neutron-server[30536]: 2017-09-28 13:07:21.660 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:07:21] "OPTIONS / HTTP/1.0" 200 262 0.000608
Sep 28 13:07:22 ctl02 nova-api[17446]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:07:22 ctl02 nova-api[17446]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:07:22 ctl02 nova-api[17446]: 2017-09-28 13:07:22.283 17446 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:07:22 ctl02 nova-api[17446]: 2017-09-28 13:07:22.284 17446 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:07:22 ctl02 nova-api[17446]: 2017-09-28 13:07:22.284 17446 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:07:22 ctl02 nova-api[17446]: 2017-09-28 13:07:22.284 17446 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:07:22 ctl02 nova-api[17446]: 2017-09-28 13:07:22.284 17446 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:07:22 ctl02 nova-api[17446]: 2017-09-28 13:07:22.284 17446 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:07:22 ctl02 nova-api[17446]: 2017-09-28 13:07:22.284 17446 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:07:22 ctl02 nova-api[17446]: 2017-09-28 13:07:22.284 17446 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:07:22 ctl02 nova-api[17446]: 2017-09-28 13:07:22.284 17446 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:07:22 ctl02 nova-api[17446]: 2017-09-28 13:07:22.284 17446 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:07:22 ctl02 nova-api[17446]: 2017-09-28 13:07:22.284 17446 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:07:22 ctl02 nova-api[17446]: 2017-09-28 13:07:22.284 17446 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:07:22 ctl02 nova-api[17446]: 2017-09-28 13:07:22.284 17446 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:07:22 ctl02 nova-api[17446]: 2017-09-28 13:07:22.284 17446 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:07:22 ctl02 nova-api[17446]: 2017-09-28 13:07:22.284 17446 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:07:22 ctl02 nova-api[17446]: 2017-09-28 13:07:22.284 17446 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:07:22 ctl02 nova-api[17446]: 2017-09-28 13:07:22.284 17446 ERROR nova.wsgi     self.filename))
Sep 28 13:07:22 ctl02 nova-api[17446]: 2017-09-28 13:07:22.284 17446 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:07:22 ctl02 nova-api[17446]: 2017-09-28 13:07:22.284 17446 ERROR nova.wsgi
Sep 28 13:07:22 ctl02 nova-api[17446]: 2017-09-28 13:07:22.285 17446 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:07:22 ctl02 glance-api[29183]: 2017-09-28 13:07:22.297 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:07:22] "OPTIONS / HTTP/1.0" 200 134 0.000656
Sep 28 13:07:22 ctl02 nova-api[17446]: 2017-09-28 13:07:22.411 17446 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:07:22 ctl02 nova-api[17446]: 2017-09-28 13:07:22.631 17446 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:07:22 ctl02 nova-api[17446]: 2017-09-28 13:07:22.633 17446 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:07:22 ctl02 nova-api[17446]: 2017-09-28 13:07:22.633 17446 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:07:22 ctl02 nova-api[17446]: 2017-09-28 13:07:22.633 17446 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:07:22 ctl02 nova-api[17446]: 2017-09-28 13:07:22.763 17446 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:07:22 ctl02 nova-api[17446]: 2017-09-28 13:07:22.765 17446 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:07:22 ctl02 nova-api[17446]: 2017-09-28 13:07:22.765 17446 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:07:22 ctl02 nova-api[17446]: 2017-09-28 13:07:22.765 17446 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:07:22 ctl02 nova-api[17446]: 2017-09-28 13:07:22.768 17446 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:07:22 ctl02 nova-api[17446]: 2017-09-28 13:07:22.769 17446 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:07:22 ctl02 nova-api[17446]: 2017-09-28 13:07:22.769 17446 ERROR nova Traceback (most recent call last):
Sep 28 13:07:22 ctl02 nova-api[17446]: 2017-09-28 13:07:22.769 17446 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:07:22 ctl02 nova-api[17446]: 2017-09-28 13:07:22.769 17446 ERROR nova     sys.exit(main())
Sep 28 13:07:22 ctl02 nova-api[17446]: 2017-09-28 13:07:22.769 17446 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:07:22 ctl02 nova-api[17446]: 2017-09-28 13:07:22.769 17446 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:07:22 ctl02 nova-api[17446]: 2017-09-28 13:07:22.769 17446 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:07:22 ctl02 nova-api[17446]: 2017-09-28 13:07:22.769 17446 ERROR nova     max_url_len=max_url_len)
Sep 28 13:07:22 ctl02 nova-api[17446]: 2017-09-28 13:07:22.769 17446 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:07:22 ctl02 nova-api[17446]: 2017-09-28 13:07:22.769 17446 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:07:22 ctl02 nova-api[17446]: 2017-09-28 13:07:22.769 17446 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:07:22 ctl02 nova-api[17446]: 2017-09-28 13:07:22.769 17446 ERROR nova     sock.listen(backlog)
Sep 28 13:07:22 ctl02 nova-api[17446]: 2017-09-28 13:07:22.769 17446 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:07:22 ctl02 nova-api[17446]: 2017-09-28 13:07:22.769 17446 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:07:22 ctl02 nova-api[17446]: 2017-09-28 13:07:22.769 17446 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:07:22 ctl02 nova-api[17446]: 2017-09-28 13:07:22.769 17446 ERROR nova
Sep 28 13:07:22 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:07:22 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:07:22 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:07:23 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:07:23 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:07:23 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:07:23 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:07:23 ctl02 heat-api[13008]: 2017-09-28 13:07:23.437 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:07:23] "OPTIONS / HTTP/1.0" 200 134 0.000619
Sep 28 13:07:23 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:07:23.646 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:07:23] "OPTIONS / HTTP/1.0" 200 134 0.000455
Sep 28 13:07:23 ctl02 heat-api-cfn[13300]: 2017-09-28 13:07:23.879 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:07:23] "OPTIONS / HTTP/1.0" 200 134 0.000475
Sep 28 13:07:24 ctl02 neutron-server[30536]: 2017-09-28 13:07:24.082 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:07:24] "OPTIONS / HTTP/1.0" 200 262 0.000511
Sep 28 13:07:24 ctl02 glance-api[29183]: 2017-09-28 13:07:24.244 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:07:24] "OPTIONS / HTTP/1.0" 200 134 0.000997
Sep 28 13:07:24 ctl02 nova-api[17465]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:07:24 ctl02 nova-api[17465]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:07:25 ctl02 nova-api[17465]: 2017-09-28 13:07:25.005 17465 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:07:25 ctl02 nova-api[17465]: 2017-09-28 13:07:25.007 17465 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:07:25 ctl02 nova-api[17465]: 2017-09-28 13:07:25.007 17465 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:07:25 ctl02 nova-api[17465]: 2017-09-28 13:07:25.007 17465 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:07:25 ctl02 nova-api[17465]: 2017-09-28 13:07:25.007 17465 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:07:25 ctl02 nova-api[17465]: 2017-09-28 13:07:25.007 17465 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:07:25 ctl02 nova-api[17465]: 2017-09-28 13:07:25.007 17465 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:07:25 ctl02 nova-api[17465]: 2017-09-28 13:07:25.007 17465 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:07:25 ctl02 nova-api[17465]: 2017-09-28 13:07:25.007 17465 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:07:25 ctl02 nova-api[17465]: 2017-09-28 13:07:25.007 17465 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:07:25 ctl02 nova-api[17465]: 2017-09-28 13:07:25.007 17465 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:07:25 ctl02 nova-api[17465]: 2017-09-28 13:07:25.007 17465 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:07:25 ctl02 nova-api[17465]: 2017-09-28 13:07:25.007 17465 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:07:25 ctl02 nova-api[17465]: 2017-09-28 13:07:25.007 17465 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:07:25 ctl02 nova-api[17465]: 2017-09-28 13:07:25.007 17465 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:07:25 ctl02 nova-api[17465]: 2017-09-28 13:07:25.007 17465 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:07:25 ctl02 nova-api[17465]: 2017-09-28 13:07:25.007 17465 ERROR nova.wsgi     self.filename))
Sep 28 13:07:25 ctl02 nova-api[17465]: 2017-09-28 13:07:25.007 17465 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:07:25 ctl02 nova-api[17465]: 2017-09-28 13:07:25.007 17465 ERROR nova.wsgi
Sep 28 13:07:25 ctl02 nova-api[17465]: 2017-09-28 13:07:25.008 17465 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:07:25 ctl02 nova-api[17465]: 2017-09-28 13:07:25.132 17465 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:07:25 ctl02 nova-api[17465]: 2017-09-28 13:07:25.352 17465 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:07:25 ctl02 nova-api[17465]: 2017-09-28 13:07:25.354 17465 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:07:25 ctl02 nova-api[17465]: 2017-09-28 13:07:25.354 17465 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:07:25 ctl02 nova-api[17465]: 2017-09-28 13:07:25.354 17465 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:07:25 ctl02 nova-api[17465]: 2017-09-28 13:07:25.484 17465 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:07:25 ctl02 nova-api[17465]: 2017-09-28 13:07:25.486 17465 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:07:25 ctl02 nova-api[17465]: 2017-09-28 13:07:25.486 17465 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:07:25 ctl02 nova-api[17465]: 2017-09-28 13:07:25.487 17465 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:07:25 ctl02 nova-api[17465]: 2017-09-28 13:07:25.490 17465 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:07:25 ctl02 nova-api[17465]: 2017-09-28 13:07:25.490 17465 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:07:25 ctl02 nova-api[17465]: 2017-09-28 13:07:25.490 17465 ERROR nova Traceback (most recent call last):
Sep 28 13:07:25 ctl02 nova-api[17465]: 2017-09-28 13:07:25.490 17465 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:07:25 ctl02 nova-api[17465]: 2017-09-28 13:07:25.490 17465 ERROR nova     sys.exit(main())
Sep 28 13:07:25 ctl02 nova-api[17465]: 2017-09-28 13:07:25.490 17465 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:07:25 ctl02 nova-api[17465]: 2017-09-28 13:07:25.490 17465 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:07:25 ctl02 nova-api[17465]: 2017-09-28 13:07:25.490 17465 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:07:25 ctl02 nova-api[17465]: 2017-09-28 13:07:25.490 17465 ERROR nova     max_url_len=max_url_len)
Sep 28 13:07:25 ctl02 nova-api[17465]: 2017-09-28 13:07:25.490 17465 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:07:25 ctl02 nova-api[17465]: 2017-09-28 13:07:25.490 17465 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:07:25 ctl02 nova-api[17465]: 2017-09-28 13:07:25.490 17465 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:07:25 ctl02 nova-api[17465]: 2017-09-28 13:07:25.490 17465 ERROR nova     sock.listen(backlog)
Sep 28 13:07:25 ctl02 nova-api[17465]: 2017-09-28 13:07:25.490 17465 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:07:25 ctl02 nova-api[17465]: 2017-09-28 13:07:25.490 17465 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:07:25 ctl02 nova-api[17465]: 2017-09-28 13:07:25.490 17465 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:07:25 ctl02 nova-api[17465]: 2017-09-28 13:07:25.490 17465 ERROR nova
Sep 28 13:07:25 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:07:25 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:07:25 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:07:25 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:07:25 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:07:25 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:07:25 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:07:26 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2e2bef37)
Sep 28 13:07:27 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2e2bef37)
Sep 28 13:07:27 ctl02 heat-api-cfn[13300]: 2017-09-28 13:07:27.345 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:07:27] "OPTIONS / HTTP/1.0" 200 134 0.000477
Sep 28 13:07:27 ctl02 heat-api[13008]: 2017-09-28 13:07:27.454 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:07:27] "OPTIONS / HTTP/1.0" 200 134 0.000604
Sep 28 13:07:27 ctl02 nova-api[17483]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:07:27 ctl02 nova-api[17483]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:07:27 ctl02 nova-api[17483]: 2017-09-28 13:07:27.788 17483 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:07:27 ctl02 nova-api[17483]: 2017-09-28 13:07:27.789 17483 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:07:27 ctl02 nova-api[17483]: 2017-09-28 13:07:27.789 17483 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:07:27 ctl02 nova-api[17483]: 2017-09-28 13:07:27.789 17483 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:07:27 ctl02 nova-api[17483]: 2017-09-28 13:07:27.789 17483 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:07:27 ctl02 nova-api[17483]: 2017-09-28 13:07:27.789 17483 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:07:27 ctl02 nova-api[17483]: 2017-09-28 13:07:27.789 17483 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:07:27 ctl02 nova-api[17483]: 2017-09-28 13:07:27.789 17483 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:07:27 ctl02 nova-api[17483]: 2017-09-28 13:07:27.789 17483 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:07:27 ctl02 nova-api[17483]: 2017-09-28 13:07:27.789 17483 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:07:27 ctl02 nova-api[17483]: 2017-09-28 13:07:27.789 17483 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:07:27 ctl02 nova-api[17483]: 2017-09-28 13:07:27.789 17483 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:07:27 ctl02 nova-api[17483]: 2017-09-28 13:07:27.789 17483 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:07:27 ctl02 nova-api[17483]: 2017-09-28 13:07:27.789 17483 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:07:27 ctl02 nova-api[17483]: 2017-09-28 13:07:27.789 17483 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:07:27 ctl02 nova-api[17483]: 2017-09-28 13:07:27.789 17483 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:07:27 ctl02 nova-api[17483]: 2017-09-28 13:07:27.789 17483 ERROR nova.wsgi     self.filename))
Sep 28 13:07:27 ctl02 nova-api[17483]: 2017-09-28 13:07:27.789 17483 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:07:27 ctl02 nova-api[17483]: 2017-09-28 13:07:27.789 17483 ERROR nova.wsgi
Sep 28 13:07:27 ctl02 nova-api[17483]: 2017-09-28 13:07:27.790 17483 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:07:27 ctl02 nova-api[17483]: 2017-09-28 13:07:27.921 17483 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:07:28 ctl02 nova-api[17483]: 2017-09-28 13:07:28.170 17483 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:07:28 ctl02 nova-api[17483]: 2017-09-28 13:07:28.172 17483 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:07:28 ctl02 nova-api[17483]: 2017-09-28 13:07:28.172 17483 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:07:28 ctl02 nova-api[17483]: 2017-09-28 13:07:28.172 17483 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:07:28 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2e2bef37)
Sep 28 13:07:28 ctl02 nova-api[17483]: 2017-09-28 13:07:28.307 17483 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:07:28 ctl02 nova-api[17483]: 2017-09-28 13:07:28.309 17483 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:07:28 ctl02 nova-api[17483]: 2017-09-28 13:07:28.309 17483 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:07:28 ctl02 nova-api[17483]: 2017-09-28 13:07:28.309 17483 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:07:28 ctl02 nova-api[17483]: 2017-09-28 13:07:28.313 17483 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:07:28 ctl02 nova-api[17483]: 2017-09-28 13:07:28.313 17483 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:07:28 ctl02 nova-api[17483]: 2017-09-28 13:07:28.313 17483 ERROR nova Traceback (most recent call last):
Sep 28 13:07:28 ctl02 nova-api[17483]: 2017-09-28 13:07:28.313 17483 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:07:28 ctl02 nova-api[17483]: 2017-09-28 13:07:28.313 17483 ERROR nova     sys.exit(main())
Sep 28 13:07:28 ctl02 nova-api[17483]: 2017-09-28 13:07:28.313 17483 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:07:28 ctl02 nova-api[17483]: 2017-09-28 13:07:28.313 17483 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:07:28 ctl02 nova-api[17483]: 2017-09-28 13:07:28.313 17483 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:07:28 ctl02 nova-api[17483]: 2017-09-28 13:07:28.313 17483 ERROR nova     max_url_len=max_url_len)
Sep 28 13:07:28 ctl02 nova-api[17483]: 2017-09-28 13:07:28.313 17483 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:07:28 ctl02 nova-api[17483]: 2017-09-28 13:07:28.313 17483 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:07:28 ctl02 nova-api[17483]: 2017-09-28 13:07:28.313 17483 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:07:28 ctl02 nova-api[17483]: 2017-09-28 13:07:28.313 17483 ERROR nova     sock.listen(backlog)
Sep 28 13:07:28 ctl02 nova-api[17483]: 2017-09-28 13:07:28.313 17483 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:07:28 ctl02 nova-api[17483]: 2017-09-28 13:07:28.313 17483 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:07:28 ctl02 nova-api[17483]: 2017-09-28 13:07:28.313 17483 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:07:28 ctl02 nova-api[17483]: 2017-09-28 13:07:28.313 17483 ERROR nova
Sep 28 13:07:28 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:07:28 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:07:28 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:07:28 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:07:28 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:07:28 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:07:28 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:07:28 ctl02 neutron-server[30536]: 2017-09-28 13:07:28.653 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:07:28] "OPTIONS / HTTP/1.0" 200 262 0.000550
Sep 28 13:07:28 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:07:28.665 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:07:28] "OPTIONS / HTTP/1.0" 200 134 0.000493
Sep 28 13:07:28 ctl02 heat-api-cfn[13300]: 2017-09-28 13:07:28.868 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:07:28] "OPTIONS / HTTP/1.0" 200 134 0.000481
Sep 28 13:07:29 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2e2bef37)
Sep 28 13:07:29 ctl02 heat-api[13008]: 2017-09-28 13:07:29.331 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:07:29] "OPTIONS / HTTP/1.0" 200 134 0.000605
Sep 28 13:07:30 ctl02 glance-api[29183]: 2017-09-28 13:07:30.073 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:07:30] "OPTIONS / HTTP/1.0" 200 134 0.000633
Sep 28 13:07:30 ctl02 nova-consoleauth[5433]: 2017-09-28 13:07:30.173 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:07:30 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2e2bef37)
Sep 28 13:07:30 ctl02 nova-api[17499]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:07:30 ctl02 nova-api[17499]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:07:30 ctl02 heat-engine[12803]: 2017-09-28 13:07:30.503 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:07:30 ctl02 heat-engine[12803]: 2017-09-28 13:07:30.520 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:07:30 ctl02 heat-engine[12803]: 2017-09-28 13:07:30.529 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:07:30 ctl02 heat-engine[12803]: 2017-09-28 13:07:30.533 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:07:30 ctl02 nova-api[17499]: 2017-09-28 13:07:30.552 17499 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:07:30 ctl02 nova-api[17499]: 2017-09-28 13:07:30.554 17499 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:07:30 ctl02 nova-api[17499]: 2017-09-28 13:07:30.554 17499 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:07:30 ctl02 nova-api[17499]: 2017-09-28 13:07:30.554 17499 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:07:30 ctl02 nova-api[17499]: 2017-09-28 13:07:30.554 17499 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:07:30 ctl02 nova-api[17499]: 2017-09-28 13:07:30.554 17499 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:07:30 ctl02 nova-api[17499]: 2017-09-28 13:07:30.554 17499 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:07:30 ctl02 nova-api[17499]: 2017-09-28 13:07:30.554 17499 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:07:30 ctl02 nova-api[17499]: 2017-09-28 13:07:30.554 17499 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:07:30 ctl02 nova-api[17499]: 2017-09-28 13:07:30.554 17499 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:07:30 ctl02 nova-api[17499]: 2017-09-28 13:07:30.554 17499 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:07:30 ctl02 nova-api[17499]: 2017-09-28 13:07:30.554 17499 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:07:30 ctl02 nova-api[17499]: 2017-09-28 13:07:30.554 17499 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:07:30 ctl02 nova-api[17499]: 2017-09-28 13:07:30.554 17499 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:07:30 ctl02 nova-api[17499]: 2017-09-28 13:07:30.554 17499 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:07:30 ctl02 nova-api[17499]: 2017-09-28 13:07:30.554 17499 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:07:30 ctl02 nova-api[17499]: 2017-09-28 13:07:30.554 17499 ERROR nova.wsgi     self.filename))
Sep 28 13:07:30 ctl02 nova-api[17499]: 2017-09-28 13:07:30.554 17499 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:07:30 ctl02 nova-api[17499]: 2017-09-28 13:07:30.554 17499 ERROR nova.wsgi
Sep 28 13:07:30 ctl02 nova-api[17499]: 2017-09-28 13:07:30.555 17499 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:07:30 ctl02 nova-api[17499]: 2017-09-28 13:07:30.687 17499 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:07:30 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:07:30.696 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:07:30] "OPTIONS / HTTP/1.0" 200 134 0.000417
Sep 28 13:07:30 ctl02 nova-api[17499]: 2017-09-28 13:07:30.904 17499 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:07:30 ctl02 nova-api[17499]: 2017-09-28 13:07:30.906 17499 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:07:30 ctl02 nova-api[17499]: 2017-09-28 13:07:30.906 17499 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:07:30 ctl02 nova-api[17499]: 2017-09-28 13:07:30.907 17499 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:07:31 ctl02 nova-api[17499]: 2017-09-28 13:07:31.036 17499 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:07:31 ctl02 nova-api[17499]: 2017-09-28 13:07:31.038 17499 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:07:31 ctl02 nova-api[17499]: 2017-09-28 13:07:31.038 17499 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:07:31 ctl02 nova-api[17499]: 2017-09-28 13:07:31.039 17499 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:07:31 ctl02 nova-api[17499]: 2017-09-28 13:07:31.042 17499 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:07:31 ctl02 nova-api[17499]: 2017-09-28 13:07:31.042 17499 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:07:31 ctl02 nova-api[17499]: 2017-09-28 13:07:31.042 17499 ERROR nova Traceback (most recent call last):
Sep 28 13:07:31 ctl02 nova-api[17499]: 2017-09-28 13:07:31.042 17499 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:07:31 ctl02 nova-api[17499]: 2017-09-28 13:07:31.042 17499 ERROR nova     sys.exit(main())
Sep 28 13:07:31 ctl02 nova-api[17499]: 2017-09-28 13:07:31.042 17499 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:07:31 ctl02 nova-api[17499]: 2017-09-28 13:07:31.042 17499 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:07:31 ctl02 nova-api[17499]: 2017-09-28 13:07:31.042 17499 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:07:31 ctl02 nova-api[17499]: 2017-09-28 13:07:31.042 17499 ERROR nova     max_url_len=max_url_len)
Sep 28 13:07:31 ctl02 nova-api[17499]: 2017-09-28 13:07:31.042 17499 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:07:31 ctl02 nova-api[17499]: 2017-09-28 13:07:31.042 17499 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:07:31 ctl02 nova-api[17499]: 2017-09-28 13:07:31.042 17499 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:07:31 ctl02 nova-api[17499]: 2017-09-28 13:07:31.042 17499 ERROR nova     sock.listen(backlog)
Sep 28 13:07:31 ctl02 nova-api[17499]: 2017-09-28 13:07:31.042 17499 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:07:31 ctl02 nova-api[17499]: 2017-09-28 13:07:31.042 17499 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:07:31 ctl02 nova-api[17499]: 2017-09-28 13:07:31.042 17499 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:07:31 ctl02 nova-api[17499]: 2017-09-28 13:07:31.042 17499 ERROR nova
Sep 28 13:07:31 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:07:31 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:07:31 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:07:31 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2e2bef37)
Sep 28 13:07:31 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:07:31 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:07:31 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:07:31 ctl02 neutron-server[30536]: 2017-09-28 13:07:31.407 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:07:31] "OPTIONS / HTTP/1.0" 200 262 0.000713
Sep 28 13:07:31 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:07:32 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2e2bef37)
Sep 28 13:07:32 ctl02 glance-api[29183]: 2017-09-28 13:07:32.370 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:07:32] "OPTIONS / HTTP/1.0" 200 134 0.000554
Sep 28 13:07:33 ctl02 nova-api[17519]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:07:33 ctl02 nova-api[17519]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:07:33 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2e2bef37)
Sep 28 13:07:33 ctl02 nova-scheduler[5620]: 2017-09-28 13:07:33.279 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:07:33 ctl02 nova-api[17519]: 2017-09-28 13:07:33.314 17519 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:07:33 ctl02 nova-api[17519]: 2017-09-28 13:07:33.315 17519 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:07:33 ctl02 nova-api[17519]: 2017-09-28 13:07:33.315 17519 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:07:33 ctl02 nova-api[17519]: 2017-09-28 13:07:33.315 17519 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:07:33 ctl02 nova-api[17519]: 2017-09-28 13:07:33.315 17519 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:07:33 ctl02 nova-api[17519]: 2017-09-28 13:07:33.315 17519 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:07:33 ctl02 nova-api[17519]: 2017-09-28 13:07:33.315 17519 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:07:33 ctl02 nova-api[17519]: 2017-09-28 13:07:33.315 17519 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:07:33 ctl02 nova-api[17519]: 2017-09-28 13:07:33.315 17519 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:07:33 ctl02 nova-api[17519]: 2017-09-28 13:07:33.315 17519 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:07:33 ctl02 nova-api[17519]: 2017-09-28 13:07:33.315 17519 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:07:33 ctl02 nova-api[17519]: 2017-09-28 13:07:33.315 17519 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:07:33 ctl02 nova-api[17519]: 2017-09-28 13:07:33.315 17519 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:07:33 ctl02 nova-api[17519]: 2017-09-28 13:07:33.315 17519 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:07:33 ctl02 nova-api[17519]: 2017-09-28 13:07:33.315 17519 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:07:33 ctl02 nova-api[17519]: 2017-09-28 13:07:33.315 17519 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:07:33 ctl02 nova-api[17519]: 2017-09-28 13:07:33.315 17519 ERROR nova.wsgi     self.filename))
Sep 28 13:07:33 ctl02 nova-api[17519]: 2017-09-28 13:07:33.315 17519 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:07:33 ctl02 nova-api[17519]: 2017-09-28 13:07:33.315 17519 ERROR nova.wsgi
Sep 28 13:07:33 ctl02 nova-api[17519]: 2017-09-28 13:07:33.318 17519 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:07:33 ctl02 nova-api[17519]: 2017-09-28 13:07:33.453 17519 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:07:33 ctl02 nova-api[17519]: 2017-09-28 13:07:33.704 17519 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:07:33 ctl02 nova-api[17519]: 2017-09-28 13:07:33.717 17519 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:07:33 ctl02 nova-api[17519]: 2017-09-28 13:07:33.717 17519 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:07:33 ctl02 nova-api[17519]: 2017-09-28 13:07:33.718 17519 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:07:33 ctl02 heat-api[13008]: 2017-09-28 13:07:33.753 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:07:33] "OPTIONS / HTTP/1.0" 200 134 0.000637
Sep 28 13:07:33 ctl02 neutron-server[30536]: 2017-09-28 13:07:33.818 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:07:33] "OPTIONS / HTTP/1.0" 200 262 0.000515
Sep 28 13:07:33 ctl02 nova-api[17519]: 2017-09-28 13:07:33.853 17519 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:07:33 ctl02 nova-api[17519]: 2017-09-28 13:07:33.855 17519 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:07:33 ctl02 nova-api[17519]: 2017-09-28 13:07:33.855 17519 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:07:33 ctl02 nova-api[17519]: 2017-09-28 13:07:33.855 17519 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:07:33 ctl02 nova-api[17519]: 2017-09-28 13:07:33.859 17519 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:07:33 ctl02 nova-api[17519]: 2017-09-28 13:07:33.859 17519 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:07:33 ctl02 nova-api[17519]: 2017-09-28 13:07:33.859 17519 ERROR nova Traceback (most recent call last):
Sep 28 13:07:33 ctl02 nova-api[17519]: 2017-09-28 13:07:33.859 17519 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:07:33 ctl02 nova-api[17519]: 2017-09-28 13:07:33.859 17519 ERROR nova     sys.exit(main())
Sep 28 13:07:33 ctl02 nova-api[17519]: 2017-09-28 13:07:33.859 17519 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:07:33 ctl02 nova-api[17519]: 2017-09-28 13:07:33.859 17519 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:07:33 ctl02 nova-api[17519]: 2017-09-28 13:07:33.859 17519 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:07:33 ctl02 nova-api[17519]: 2017-09-28 13:07:33.859 17519 ERROR nova     max_url_len=max_url_len)
Sep 28 13:07:33 ctl02 nova-api[17519]: 2017-09-28 13:07:33.859 17519 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:07:33 ctl02 nova-api[17519]: 2017-09-28 13:07:33.859 17519 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:07:33 ctl02 nova-api[17519]: 2017-09-28 13:07:33.859 17519 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:07:33 ctl02 nova-api[17519]: 2017-09-28 13:07:33.859 17519 ERROR nova     sock.listen(backlog)
Sep 28 13:07:33 ctl02 nova-api[17519]: 2017-09-28 13:07:33.859 17519 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:07:33 ctl02 nova-api[17519]: 2017-09-28 13:07:33.859 17519 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:07:33 ctl02 nova-api[17519]: 2017-09-28 13:07:33.859 17519 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:07:33 ctl02 nova-api[17519]: 2017-09-28 13:07:33.859 17519 ERROR nova
Sep 28 13:07:33 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:07:33.946 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:07:33] "OPTIONS / HTTP/1.0" 200 134 0.000476
Sep 28 13:07:34 ctl02 heat-api-cfn[13300]: 2017-09-28 13:07:34.026 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:07:34] "OPTIONS / HTTP/1.0" 200 134 0.000473
Sep 28 13:07:34 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:07:34 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:07:34 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:07:34 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2e2bef37)
Sep 28 13:07:34 ctl02 glance-api[29183]: 2017-09-28 13:07:34.283 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:07:34] "OPTIONS / HTTP/1.0" 200 134 0.000809
Sep 28 13:07:34 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:07:34 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:07:34 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:07:34 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:07:35 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2e2bef37)
Sep 28 13:07:35 ctl02 neutron-server[30536]: 2017-09-28 13:07:35.963 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 2 dead agents out of 6:
Sep 28 13:07:35 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 13:07:35 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 13:06:40 cmp002
Sep 28 13:07:35 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 13:05:36 cmp002
Sep 28 13:07:36 ctl02 nova-api[17537]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:07:36 ctl02 nova-api[17537]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:07:36 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x2e2bef37)
Sep 28 13:07:36 ctl02 nova-api[17537]: 2017-09-28 13:07:36.269 17537 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:07:36 ctl02 nova-api[17537]: 2017-09-28 13:07:36.271 17537 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:07:36 ctl02 nova-api[17537]: 2017-09-28 13:07:36.271 17537 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:07:36 ctl02 nova-api[17537]: 2017-09-28 13:07:36.271 17537 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:07:36 ctl02 nova-api[17537]: 2017-09-28 13:07:36.271 17537 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:07:36 ctl02 nova-api[17537]: 2017-09-28 13:07:36.271 17537 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:07:36 ctl02 nova-api[17537]: 2017-09-28 13:07:36.271 17537 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:07:36 ctl02 nova-api[17537]: 2017-09-28 13:07:36.271 17537 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:07:36 ctl02 nova-api[17537]: 2017-09-28 13:07:36.271 17537 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:07:36 ctl02 nova-api[17537]: 2017-09-28 13:07:36.271 17537 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:07:36 ctl02 nova-api[17537]: 2017-09-28 13:07:36.271 17537 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:07:36 ctl02 nova-api[17537]: 2017-09-28 13:07:36.271 17537 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:07:36 ctl02 nova-api[17537]: 2017-09-28 13:07:36.271 17537 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:07:36 ctl02 nova-api[17537]: 2017-09-28 13:07:36.271 17537 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:07:36 ctl02 nova-api[17537]: 2017-09-28 13:07:36.271 17537 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:07:36 ctl02 nova-api[17537]: 2017-09-28 13:07:36.271 17537 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:07:36 ctl02 nova-api[17537]: 2017-09-28 13:07:36.271 17537 ERROR nova.wsgi     self.filename))
Sep 28 13:07:36 ctl02 nova-api[17537]: 2017-09-28 13:07:36.271 17537 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:07:36 ctl02 nova-api[17537]: 2017-09-28 13:07:36.271 17537 ERROR nova.wsgi
Sep 28 13:07:36 ctl02 nova-api[17537]: 2017-09-28 13:07:36.273 17537 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:07:36 ctl02 nova-api[17537]: 2017-09-28 13:07:36.404 17537 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:07:36 ctl02 nova-api[17537]: 2017-09-28 13:07:36.656 17537 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:07:36 ctl02 nova-api[17537]: 2017-09-28 13:07:36.659 17537 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:07:36 ctl02 nova-api[17537]: 2017-09-28 13:07:36.659 17537 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:07:36 ctl02 nova-api[17537]: 2017-09-28 13:07:36.660 17537 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:07:36 ctl02 nova-api[17537]: 2017-09-28 13:07:36.794 17537 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:07:36 ctl02 nova-api[17537]: 2017-09-28 13:07:36.797 17537 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:07:36 ctl02 nova-api[17537]: 2017-09-28 13:07:36.797 17537 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:07:36 ctl02 nova-api[17537]: 2017-09-28 13:07:36.797 17537 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:07:36 ctl02 nova-api[17537]: 2017-09-28 13:07:36.801 17537 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:07:36 ctl02 nova-api[17537]: 2017-09-28 13:07:36.801 17537 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:07:36 ctl02 nova-api[17537]: 2017-09-28 13:07:36.801 17537 ERROR nova Traceback (most recent call last):
Sep 28 13:07:36 ctl02 nova-api[17537]: 2017-09-28 13:07:36.801 17537 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:07:36 ctl02 nova-api[17537]: 2017-09-28 13:07:36.801 17537 ERROR nova     sys.exit(main())
Sep 28 13:07:36 ctl02 nova-api[17537]: 2017-09-28 13:07:36.801 17537 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:07:36 ctl02 nova-api[17537]: 2017-09-28 13:07:36.801 17537 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:07:36 ctl02 nova-api[17537]: 2017-09-28 13:07:36.801 17537 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:07:36 ctl02 nova-api[17537]: 2017-09-28 13:07:36.801 17537 ERROR nova     max_url_len=max_url_len)
Sep 28 13:07:36 ctl02 nova-api[17537]: 2017-09-28 13:07:36.801 17537 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:07:36 ctl02 nova-api[17537]: 2017-09-28 13:07:36.801 17537 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:07:36 ctl02 nova-api[17537]: 2017-09-28 13:07:36.801 17537 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:07:36 ctl02 nova-api[17537]: 2017-09-28 13:07:36.801 17537 ERROR nova     sock.listen(backlog)
Sep 28 13:07:36 ctl02 nova-api[17537]: 2017-09-28 13:07:36.801 17537 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:07:36 ctl02 nova-api[17537]: 2017-09-28 13:07:36.801 17537 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:07:36 ctl02 nova-api[17537]: 2017-09-28 13:07:36.801 17537 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:07:36 ctl02 nova-api[17537]: 2017-09-28 13:07:36.801 17537 ERROR nova
Sep 28 13:07:36 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:07:36 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:07:36 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:07:37 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:07:37 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:07:37 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:07:37 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:07:37 ctl02 heat-api-cfn[13300]: 2017-09-28 13:07:37.191 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:07:37] "OPTIONS / HTTP/1.0" 200 134 0.000485
Sep 28 13:07:37 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 13:07:37 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 13:07:37 ctl02 heat-api[13008]: 2017-09-28 13:07:37.722 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:07:37] "OPTIONS / HTTP/1.0" 200 134 0.000546
Sep 28 13:07:38 ctl02 neutron-server[30536]: 2017-09-28 13:07:38.701 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:07:38] "OPTIONS / HTTP/1.0" 200 262 0.000504
Sep 28 13:07:38 ctl02 heat-api-cfn[13300]: 2017-09-28 13:07:38.707 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:07:38] "OPTIONS / HTTP/1.0" 200 134 0.000521
Sep 28 13:07:38 ctl02 nova-api[17555]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:07:38 ctl02 nova-api[17555]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:07:38 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:07:38.887 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:07:38] "OPTIONS / HTTP/1.0" 200 134 0.000409
Sep 28 13:07:38 ctl02 nova-api[17555]: 2017-09-28 13:07:38.983 17555 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:07:38 ctl02 nova-api[17555]: 2017-09-28 13:07:38.985 17555 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:07:38 ctl02 nova-api[17555]: 2017-09-28 13:07:38.985 17555 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:07:38 ctl02 nova-api[17555]: 2017-09-28 13:07:38.985 17555 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:07:38 ctl02 nova-api[17555]: 2017-09-28 13:07:38.985 17555 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:07:38 ctl02 nova-api[17555]: 2017-09-28 13:07:38.985 17555 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:07:38 ctl02 nova-api[17555]: 2017-09-28 13:07:38.985 17555 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:07:38 ctl02 nova-api[17555]: 2017-09-28 13:07:38.985 17555 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:07:38 ctl02 nova-api[17555]: 2017-09-28 13:07:38.985 17555 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:07:38 ctl02 nova-api[17555]: 2017-09-28 13:07:38.985 17555 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:07:38 ctl02 nova-api[17555]: 2017-09-28 13:07:38.985 17555 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:07:38 ctl02 nova-api[17555]: 2017-09-28 13:07:38.985 17555 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:07:38 ctl02 nova-api[17555]: 2017-09-28 13:07:38.985 17555 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:07:38 ctl02 nova-api[17555]: 2017-09-28 13:07:38.985 17555 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:07:38 ctl02 nova-api[17555]: 2017-09-28 13:07:38.985 17555 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:07:38 ctl02 nova-api[17555]: 2017-09-28 13:07:38.985 17555 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:07:38 ctl02 nova-api[17555]: 2017-09-28 13:07:38.985 17555 ERROR nova.wsgi     self.filename))
Sep 28 13:07:38 ctl02 nova-api[17555]: 2017-09-28 13:07:38.985 17555 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:07:38 ctl02 nova-api[17555]: 2017-09-28 13:07:38.985 17555 ERROR nova.wsgi
Sep 28 13:07:38 ctl02 nova-api[17555]: 2017-09-28 13:07:38.987 17555 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:07:39 ctl02 nova-api[17555]: 2017-09-28 13:07:39.111 17555 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:07:39 ctl02 nova-api[17555]: 2017-09-28 13:07:39.330 17555 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:07:39 ctl02 nova-api[17555]: 2017-09-28 13:07:39.333 17555 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:07:39 ctl02 nova-api[17555]: 2017-09-28 13:07:39.333 17555 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:07:39 ctl02 nova-api[17555]: 2017-09-28 13:07:39.334 17555 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:07:39 ctl02 nova-api[17555]: 2017-09-28 13:07:39.462 17555 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:07:39 ctl02 nova-api[17555]: 2017-09-28 13:07:39.465 17555 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:07:39 ctl02 nova-api[17555]: 2017-09-28 13:07:39.465 17555 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:07:39 ctl02 nova-api[17555]: 2017-09-28 13:07:39.466 17555 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:07:39 ctl02 nova-api[17555]: 2017-09-28 13:07:39.469 17555 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:07:39 ctl02 nova-api[17555]: 2017-09-28 13:07:39.469 17555 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:07:39 ctl02 nova-api[17555]: 2017-09-28 13:07:39.469 17555 ERROR nova Traceback (most recent call last):
Sep 28 13:07:39 ctl02 nova-api[17555]: 2017-09-28 13:07:39.469 17555 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:07:39 ctl02 nova-api[17555]: 2017-09-28 13:07:39.469 17555 ERROR nova     sys.exit(main())
Sep 28 13:07:39 ctl02 nova-api[17555]: 2017-09-28 13:07:39.469 17555 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:07:39 ctl02 nova-api[17555]: 2017-09-28 13:07:39.469 17555 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:07:39 ctl02 nova-api[17555]: 2017-09-28 13:07:39.469 17555 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:07:39 ctl02 nova-api[17555]: 2017-09-28 13:07:39.469 17555 ERROR nova     max_url_len=max_url_len)
Sep 28 13:07:39 ctl02 nova-api[17555]: 2017-09-28 13:07:39.469 17555 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:07:39 ctl02 nova-api[17555]: 2017-09-28 13:07:39.469 17555 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:07:39 ctl02 nova-api[17555]: 2017-09-28 13:07:39.469 17555 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:07:39 ctl02 nova-api[17555]: 2017-09-28 13:07:39.469 17555 ERROR nova     sock.listen(backlog)
Sep 28 13:07:39 ctl02 nova-api[17555]: 2017-09-28 13:07:39.469 17555 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:07:39 ctl02 nova-api[17555]: 2017-09-28 13:07:39.469 17555 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:07:39 ctl02 nova-api[17555]: 2017-09-28 13:07:39.469 17555 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:07:39 ctl02 nova-api[17555]: 2017-09-28 13:07:39.469 17555 ERROR nova
Sep 28 13:07:39 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:07:39 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:07:39 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:07:39 ctl02 heat-api[13008]: 2017-09-28 13:07:39.680 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:07:39] "OPTIONS / HTTP/1.0" 200 134 0.000682
Sep 28 13:07:39 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:07:39 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:07:39 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:07:39 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:07:40 ctl02 glance-api[29183]: 2017-09-28 13:07:40.216 29258 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:07:40] "OPTIONS / HTTP/1.0" 200 134 0.000568
Sep 28 13:07:40 ctl02 neutron-server[30536]: 2017-09-28 13:07:40.364 30601 WARNING oslo_messaging._drivers.amqpdriver [req-6688e16e-51e3-4b6e-96b3-f46feb5b5c64 - - - - -] reply_692b03e6d8d44d758b6be19b067c3aa3 doesn't exists, drop reply to 379426300edd45d8aad5d274a9562c97
Sep 28 13:07:40 ctl02 neutron-server[30536]: 2017-09-28 13:07:40.364 30601 INFO oslo_messaging._drivers.amqpdriver [req-6688e16e-51e3-4b6e-96b3-f46feb5b5c64 - - - - -] The reply 379426300edd45d8aad5d274a9562c97 cannot be sent  reply_692b03e6d8d44d758b6be19b067c3aa3 reply queue don't exist after 60 sec abandoning...
Sep 28 13:07:41 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:07:41.070 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:07:41] "OPTIONS / HTTP/1.0" 200 134 0.000546
Sep 28 13:07:41 ctl02 neutron-server[30536]: 2017-09-28 13:07:41.234 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:07:41] "OPTIONS / HTTP/1.0" 200 262 0.000437
Sep 28 13:07:41 ctl02 nova-api[17576]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:07:41 ctl02 nova-api[17576]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:07:41 ctl02 nova-api[17576]: 2017-09-28 13:07:41.801 17576 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:07:41 ctl02 nova-api[17576]: 2017-09-28 13:07:41.802 17576 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:07:41 ctl02 nova-api[17576]: 2017-09-28 13:07:41.802 17576 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:07:41 ctl02 nova-api[17576]: 2017-09-28 13:07:41.802 17576 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:07:41 ctl02 nova-api[17576]: 2017-09-28 13:07:41.802 17576 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:07:41 ctl02 nova-api[17576]: 2017-09-28 13:07:41.802 17576 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:07:41 ctl02 nova-api[17576]: 2017-09-28 13:07:41.802 17576 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:07:41 ctl02 nova-api[17576]: 2017-09-28 13:07:41.802 17576 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:07:41 ctl02 nova-api[17576]: 2017-09-28 13:07:41.802 17576 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:07:41 ctl02 nova-api[17576]: 2017-09-28 13:07:41.802 17576 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:07:41 ctl02 nova-api[17576]: 2017-09-28 13:07:41.802 17576 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:07:41 ctl02 nova-api[17576]: 2017-09-28 13:07:41.802 17576 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:07:41 ctl02 nova-api[17576]: 2017-09-28 13:07:41.802 17576 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:07:41 ctl02 nova-api[17576]: 2017-09-28 13:07:41.802 17576 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:07:41 ctl02 nova-api[17576]: 2017-09-28 13:07:41.802 17576 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:07:41 ctl02 nova-api[17576]: 2017-09-28 13:07:41.802 17576 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:07:41 ctl02 nova-api[17576]: 2017-09-28 13:07:41.802 17576 ERROR nova.wsgi     self.filename))
Sep 28 13:07:41 ctl02 nova-api[17576]: 2017-09-28 13:07:41.802 17576 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:07:41 ctl02 nova-api[17576]: 2017-09-28 13:07:41.802 17576 ERROR nova.wsgi
Sep 28 13:07:41 ctl02 nova-api[17576]: 2017-09-28 13:07:41.804 17576 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:07:41 ctl02 nova-api[17576]: 2017-09-28 13:07:41.939 17576 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:07:42 ctl02 nova-api[17576]: 2017-09-28 13:07:42.167 17576 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:07:42 ctl02 nova-api[17576]: 2017-09-28 13:07:42.170 17576 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:07:42 ctl02 nova-api[17576]: 2017-09-28 13:07:42.170 17576 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:07:42 ctl02 nova-api[17576]: 2017-09-28 13:07:42.170 17576 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:07:42 ctl02 glance-api[29183]: 2017-09-28 13:07:42.195 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:07:42] "OPTIONS / HTTP/1.0" 200 134 0.000587
Sep 28 13:07:42 ctl02 nova-api[17576]: 2017-09-28 13:07:42.308 17576 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:07:42 ctl02 nova-api[17576]: 2017-09-28 13:07:42.310 17576 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:07:42 ctl02 nova-api[17576]: 2017-09-28 13:07:42.310 17576 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:07:42 ctl02 nova-api[17576]: 2017-09-28 13:07:42.311 17576 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:07:42 ctl02 nova-api[17576]: 2017-09-28 13:07:42.314 17576 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:07:42 ctl02 nova-api[17576]: 2017-09-28 13:07:42.314 17576 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:07:42 ctl02 nova-api[17576]: 2017-09-28 13:07:42.314 17576 ERROR nova Traceback (most recent call last):
Sep 28 13:07:42 ctl02 nova-api[17576]: 2017-09-28 13:07:42.314 17576 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:07:42 ctl02 nova-api[17576]: 2017-09-28 13:07:42.314 17576 ERROR nova     sys.exit(main())
Sep 28 13:07:42 ctl02 nova-api[17576]: 2017-09-28 13:07:42.314 17576 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:07:42 ctl02 nova-api[17576]: 2017-09-28 13:07:42.314 17576 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:07:42 ctl02 nova-api[17576]: 2017-09-28 13:07:42.314 17576 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:07:42 ctl02 nova-api[17576]: 2017-09-28 13:07:42.314 17576 ERROR nova     max_url_len=max_url_len)
Sep 28 13:07:42 ctl02 nova-api[17576]: 2017-09-28 13:07:42.314 17576 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:07:42 ctl02 nova-api[17576]: 2017-09-28 13:07:42.314 17576 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:07:42 ctl02 nova-api[17576]: 2017-09-28 13:07:42.314 17576 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:07:42 ctl02 nova-api[17576]: 2017-09-28 13:07:42.314 17576 ERROR nova     sock.listen(backlog)
Sep 28 13:07:42 ctl02 nova-api[17576]: 2017-09-28 13:07:42.314 17576 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:07:42 ctl02 nova-api[17576]: 2017-09-28 13:07:42.314 17576 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:07:42 ctl02 nova-api[17576]: 2017-09-28 13:07:42.314 17576 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:07:42 ctl02 nova-api[17576]: 2017-09-28 13:07:42.314 17576 ERROR nova
Sep 28 13:07:42 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:07:42 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:07:42 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:07:42 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:07:42 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:07:42 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:07:42 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:07:43 ctl02 heat-api[13008]: 2017-09-28 13:07:43.694 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:07:43] "OPTIONS / HTTP/1.0" 200 134 0.000572
Sep 28 13:07:44 ctl02 neutron-server[30536]: 2017-09-28 13:07:44.075 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:07:44] "OPTIONS / HTTP/1.0" 200 262 0.000449
Sep 28 13:07:44 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:07:44.225 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:07:44] "OPTIONS / HTTP/1.0" 200 134 0.000376
Sep 28 13:07:44 ctl02 nova-api[17596]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:07:44 ctl02 nova-api[17596]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:07:44 ctl02 heat-api-cfn[13300]: 2017-09-28 13:07:44.354 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:07:44] "OPTIONS / HTTP/1.0" 200 134 0.000470
Sep 28 13:07:44 ctl02 nova-api[17596]: 2017-09-28 13:07:44.486 17596 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:07:44 ctl02 nova-api[17596]: 2017-09-28 13:07:44.488 17596 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:07:44 ctl02 nova-api[17596]: 2017-09-28 13:07:44.488 17596 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:07:44 ctl02 nova-api[17596]: 2017-09-28 13:07:44.488 17596 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:07:44 ctl02 nova-api[17596]: 2017-09-28 13:07:44.488 17596 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:07:44 ctl02 nova-api[17596]: 2017-09-28 13:07:44.488 17596 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:07:44 ctl02 nova-api[17596]: 2017-09-28 13:07:44.488 17596 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:07:44 ctl02 nova-api[17596]: 2017-09-28 13:07:44.488 17596 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:07:44 ctl02 nova-api[17596]: 2017-09-28 13:07:44.488 17596 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:07:44 ctl02 nova-api[17596]: 2017-09-28 13:07:44.488 17596 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:07:44 ctl02 nova-api[17596]: 2017-09-28 13:07:44.488 17596 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:07:44 ctl02 nova-api[17596]: 2017-09-28 13:07:44.488 17596 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:07:44 ctl02 nova-api[17596]: 2017-09-28 13:07:44.488 17596 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:07:44 ctl02 nova-api[17596]: 2017-09-28 13:07:44.488 17596 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:07:44 ctl02 nova-api[17596]: 2017-09-28 13:07:44.488 17596 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:07:44 ctl02 nova-api[17596]: 2017-09-28 13:07:44.488 17596 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:07:44 ctl02 nova-api[17596]: 2017-09-28 13:07:44.488 17596 ERROR nova.wsgi     self.filename))
Sep 28 13:07:44 ctl02 nova-api[17596]: 2017-09-28 13:07:44.488 17596 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:07:44 ctl02 nova-api[17596]: 2017-09-28 13:07:44.488 17596 ERROR nova.wsgi
Sep 28 13:07:44 ctl02 nova-api[17596]: 2017-09-28 13:07:44.489 17596 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:07:44 ctl02 nova-api[17596]: 2017-09-28 13:07:44.614 17596 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:07:44 ctl02 glance-api[29183]: 2017-09-28 13:07:44.652 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:07:44] "OPTIONS / HTTP/1.0" 200 134 0.000646
Sep 28 13:07:44 ctl02 nova-api[17596]: 2017-09-28 13:07:44.836 17596 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:07:44 ctl02 nova-api[17596]: 2017-09-28 13:07:44.838 17596 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:07:44 ctl02 nova-api[17596]: 2017-09-28 13:07:44.839 17596 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:07:44 ctl02 nova-api[17596]: 2017-09-28 13:07:44.839 17596 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:07:44 ctl02 nova-api[17596]: 2017-09-28 13:07:44.970 17596 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:07:44 ctl02 nova-api[17596]: 2017-09-28 13:07:44.971 17596 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:07:44 ctl02 nova-api[17596]: 2017-09-28 13:07:44.972 17596 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:07:44 ctl02 nova-api[17596]: 2017-09-28 13:07:44.972 17596 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:07:44 ctl02 nova-api[17596]: 2017-09-28 13:07:44.975 17596 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:07:44 ctl02 nova-api[17596]: 2017-09-28 13:07:44.975 17596 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:07:44 ctl02 nova-api[17596]: 2017-09-28 13:07:44.975 17596 ERROR nova Traceback (most recent call last):
Sep 28 13:07:44 ctl02 nova-api[17596]: 2017-09-28 13:07:44.975 17596 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:07:44 ctl02 nova-api[17596]: 2017-09-28 13:07:44.975 17596 ERROR nova     sys.exit(main())
Sep 28 13:07:44 ctl02 nova-api[17596]: 2017-09-28 13:07:44.975 17596 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:07:44 ctl02 nova-api[17596]: 2017-09-28 13:07:44.975 17596 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:07:44 ctl02 nova-api[17596]: 2017-09-28 13:07:44.975 17596 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:07:44 ctl02 nova-api[17596]: 2017-09-28 13:07:44.975 17596 ERROR nova     max_url_len=max_url_len)
Sep 28 13:07:44 ctl02 nova-api[17596]: 2017-09-28 13:07:44.975 17596 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:07:44 ctl02 nova-api[17596]: 2017-09-28 13:07:44.975 17596 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:07:44 ctl02 nova-api[17596]: 2017-09-28 13:07:44.975 17596 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:07:44 ctl02 nova-api[17596]: 2017-09-28 13:07:44.975 17596 ERROR nova     sock.listen(backlog)
Sep 28 13:07:44 ctl02 nova-api[17596]: 2017-09-28 13:07:44.975 17596 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:07:44 ctl02 nova-api[17596]: 2017-09-28 13:07:44.975 17596 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:07:44 ctl02 nova-api[17596]: 2017-09-28 13:07:44.975 17596 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:07:44 ctl02 nova-api[17596]: 2017-09-28 13:07:44.975 17596 ERROR nova
Sep 28 13:07:45 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:07:45 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:07:45 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:07:45 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:07:45 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:07:45 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:07:45 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:07:47 ctl02 nova-api[17613]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:07:47 ctl02 nova-api[17613]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:07:47 ctl02 heat-api-cfn[13300]: 2017-09-28 13:07:47.146 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:07:47] "OPTIONS / HTTP/1.0" 200 134 0.000442
Sep 28 13:07:47 ctl02 nova-api[17613]: 2017-09-28 13:07:47.244 17613 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:07:47 ctl02 nova-api[17613]: 2017-09-28 13:07:47.245 17613 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:07:47 ctl02 nova-api[17613]: 2017-09-28 13:07:47.245 17613 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:07:47 ctl02 nova-api[17613]: 2017-09-28 13:07:47.245 17613 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:07:47 ctl02 nova-api[17613]: 2017-09-28 13:07:47.245 17613 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:07:47 ctl02 nova-api[17613]: 2017-09-28 13:07:47.245 17613 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:07:47 ctl02 nova-api[17613]: 2017-09-28 13:07:47.245 17613 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:07:47 ctl02 nova-api[17613]: 2017-09-28 13:07:47.245 17613 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:07:47 ctl02 nova-api[17613]: 2017-09-28 13:07:47.245 17613 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:07:47 ctl02 nova-api[17613]: 2017-09-28 13:07:47.245 17613 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:07:47 ctl02 nova-api[17613]: 2017-09-28 13:07:47.245 17613 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:07:47 ctl02 nova-api[17613]: 2017-09-28 13:07:47.245 17613 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:07:47 ctl02 nova-api[17613]: 2017-09-28 13:07:47.245 17613 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:07:47 ctl02 nova-api[17613]: 2017-09-28 13:07:47.245 17613 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:07:47 ctl02 nova-api[17613]: 2017-09-28 13:07:47.245 17613 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:07:47 ctl02 nova-api[17613]: 2017-09-28 13:07:47.245 17613 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:07:47 ctl02 nova-api[17613]: 2017-09-28 13:07:47.245 17613 ERROR nova.wsgi     self.filename))
Sep 28 13:07:47 ctl02 nova-api[17613]: 2017-09-28 13:07:47.245 17613 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:07:47 ctl02 nova-api[17613]: 2017-09-28 13:07:47.245 17613 ERROR nova.wsgi
Sep 28 13:07:47 ctl02 nova-api[17613]: 2017-09-28 13:07:47.246 17613 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:07:47 ctl02 nova-api[17613]: 2017-09-28 13:07:47.374 17613 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:07:47 ctl02 nova-api[17613]: 2017-09-28 13:07:47.600 17613 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:07:47 ctl02 nova-api[17613]: 2017-09-28 13:07:47.602 17613 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:07:47 ctl02 nova-api[17613]: 2017-09-28 13:07:47.602 17613 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:07:47 ctl02 nova-api[17613]: 2017-09-28 13:07:47.602 17613 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:07:47 ctl02 nova-api[17613]: 2017-09-28 13:07:47.732 17613 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:07:47 ctl02 nova-api[17613]: 2017-09-28 13:07:47.734 17613 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:07:47 ctl02 nova-api[17613]: 2017-09-28 13:07:47.734 17613 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:07:47 ctl02 nova-api[17613]: 2017-09-28 13:07:47.735 17613 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:07:47 ctl02 nova-api[17613]: 2017-09-28 13:07:47.738 17613 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:07:47 ctl02 nova-api[17613]: 2017-09-28 13:07:47.738 17613 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:07:47 ctl02 nova-api[17613]: 2017-09-28 13:07:47.738 17613 ERROR nova Traceback (most recent call last):
Sep 28 13:07:47 ctl02 nova-api[17613]: 2017-09-28 13:07:47.738 17613 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:07:47 ctl02 nova-api[17613]: 2017-09-28 13:07:47.738 17613 ERROR nova     sys.exit(main())
Sep 28 13:07:47 ctl02 nova-api[17613]: 2017-09-28 13:07:47.738 17613 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:07:47 ctl02 nova-api[17613]: 2017-09-28 13:07:47.738 17613 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:07:47 ctl02 nova-api[17613]: 2017-09-28 13:07:47.738 17613 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:07:47 ctl02 nova-api[17613]: 2017-09-28 13:07:47.738 17613 ERROR nova     max_url_len=max_url_len)
Sep 28 13:07:47 ctl02 nova-api[17613]: 2017-09-28 13:07:47.738 17613 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:07:47 ctl02 nova-api[17613]: 2017-09-28 13:07:47.738 17613 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:07:47 ctl02 nova-api[17613]: 2017-09-28 13:07:47.738 17613 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:07:47 ctl02 nova-api[17613]: 2017-09-28 13:07:47.738 17613 ERROR nova     sock.listen(backlog)
Sep 28 13:07:47 ctl02 nova-api[17613]: 2017-09-28 13:07:47.738 17613 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:07:47 ctl02 nova-api[17613]: 2017-09-28 13:07:47.738 17613 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:07:47 ctl02 nova-api[17613]: 2017-09-28 13:07:47.738 17613 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:07:47 ctl02 nova-api[17613]: 2017-09-28 13:07:47.738 17613 ERROR nova
Sep 28 13:07:47 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:07:47 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:07:47 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:07:48 ctl02 heat-api[13008]: 2017-09-28 13:07:48.116 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:07:48] "OPTIONS / HTTP/1.0" 200 134 0.000812
Sep 28 13:07:48 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:07:48 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:07:48 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:07:48 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:07:48 ctl02 heat-api-cfn[13300]: 2017-09-28 13:07:48.724 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:07:48] "OPTIONS / HTTP/1.0" 200 134 0.000608
Sep 28 13:07:49 ctl02 neutron-server[30536]: 2017-09-28 13:07:49.064 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:07:49] "OPTIONS / HTTP/1.0" 200 262 0.000482
Sep 28 13:07:49 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:07:49.242 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:07:49] "OPTIONS / HTTP/1.0" 200 134 0.000486
Sep 28 13:07:49 ctl02 nova-api[17632]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:07:49 ctl02 nova-api[17632]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:07:49 ctl02 nova-api[17632]: 2017-09-28 13:07:49.993 17632 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:07:49 ctl02 nova-api[17632]: 2017-09-28 13:07:49.995 17632 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:07:49 ctl02 nova-api[17632]: 2017-09-28 13:07:49.995 17632 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:07:49 ctl02 nova-api[17632]: 2017-09-28 13:07:49.995 17632 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:07:49 ctl02 nova-api[17632]: 2017-09-28 13:07:49.995 17632 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:07:49 ctl02 nova-api[17632]: 2017-09-28 13:07:49.995 17632 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:07:49 ctl02 nova-api[17632]: 2017-09-28 13:07:49.995 17632 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:07:49 ctl02 nova-api[17632]: 2017-09-28 13:07:49.995 17632 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:07:49 ctl02 nova-api[17632]: 2017-09-28 13:07:49.995 17632 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:07:49 ctl02 nova-api[17632]: 2017-09-28 13:07:49.995 17632 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:07:49 ctl02 nova-api[17632]: 2017-09-28 13:07:49.995 17632 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:07:49 ctl02 nova-api[17632]: 2017-09-28 13:07:49.995 17632 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:07:49 ctl02 nova-api[17632]: 2017-09-28 13:07:49.995 17632 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:07:49 ctl02 nova-api[17632]: 2017-09-28 13:07:49.995 17632 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:07:49 ctl02 nova-api[17632]: 2017-09-28 13:07:49.995 17632 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:07:49 ctl02 nova-api[17632]: 2017-09-28 13:07:49.995 17632 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:07:49 ctl02 nova-api[17632]: 2017-09-28 13:07:49.995 17632 ERROR nova.wsgi     self.filename))
Sep 28 13:07:49 ctl02 nova-api[17632]: 2017-09-28 13:07:49.995 17632 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:07:49 ctl02 nova-api[17632]: 2017-09-28 13:07:49.995 17632 ERROR nova.wsgi
Sep 28 13:07:49 ctl02 nova-api[17632]: 2017-09-28 13:07:49.997 17632 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:07:50 ctl02 heat-api[13008]: 2017-09-28 13:07:50.044 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:07:50] "OPTIONS / HTTP/1.0" 200 134 0.000703
Sep 28 13:07:50 ctl02 nova-api[17632]: 2017-09-28 13:07:50.124 17632 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:07:50 ctl02 nova-api[17632]: 2017-09-28 13:07:50.348 17632 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:07:50 ctl02 nova-api[17632]: 2017-09-28 13:07:50.350 17632 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:07:50 ctl02 nova-api[17632]: 2017-09-28 13:07:50.350 17632 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:07:50 ctl02 nova-api[17632]: 2017-09-28 13:07:50.351 17632 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:07:50 ctl02 nova-api[17632]: 2017-09-28 13:07:50.483 17632 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:07:50 ctl02 nova-api[17632]: 2017-09-28 13:07:50.485 17632 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:07:50 ctl02 nova-api[17632]: 2017-09-28 13:07:50.485 17632 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:07:50 ctl02 nova-api[17632]: 2017-09-28 13:07:50.485 17632 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:07:50 ctl02 nova-api[17632]: 2017-09-28 13:07:50.488 17632 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:07:50 ctl02 nova-api[17632]: 2017-09-28 13:07:50.489 17632 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:07:50 ctl02 nova-api[17632]: 2017-09-28 13:07:50.489 17632 ERROR nova Traceback (most recent call last):
Sep 28 13:07:50 ctl02 nova-api[17632]: 2017-09-28 13:07:50.489 17632 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:07:50 ctl02 nova-api[17632]: 2017-09-28 13:07:50.489 17632 ERROR nova     sys.exit(main())
Sep 28 13:07:50 ctl02 nova-api[17632]: 2017-09-28 13:07:50.489 17632 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:07:50 ctl02 nova-api[17632]: 2017-09-28 13:07:50.489 17632 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:07:50 ctl02 nova-api[17632]: 2017-09-28 13:07:50.489 17632 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:07:50 ctl02 nova-api[17632]: 2017-09-28 13:07:50.489 17632 ERROR nova     max_url_len=max_url_len)
Sep 28 13:07:50 ctl02 nova-api[17632]: 2017-09-28 13:07:50.489 17632 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:07:50 ctl02 nova-api[17632]: 2017-09-28 13:07:50.489 17632 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:07:50 ctl02 nova-api[17632]: 2017-09-28 13:07:50.489 17632 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:07:50 ctl02 nova-api[17632]: 2017-09-28 13:07:50.489 17632 ERROR nova     sock.listen(backlog)
Sep 28 13:07:50 ctl02 nova-api[17632]: 2017-09-28 13:07:50.489 17632 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:07:50 ctl02 nova-api[17632]: 2017-09-28 13:07:50.489 17632 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:07:50 ctl02 nova-api[17632]: 2017-09-28 13:07:50.489 17632 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:07:50 ctl02 nova-api[17632]: 2017-09-28 13:07:50.489 17632 ERROR nova
Sep 28 13:07:50 ctl02 glance-api[29183]: 2017-09-28 13:07:50.576 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:07:50] "OPTIONS / HTTP/1.0" 200 134 0.000588
Sep 28 13:07:50 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:07:50 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:07:50 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:07:50 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:07:50.851 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:07:50] "OPTIONS / HTTP/1.0" 200 134 0.000520
Sep 28 13:07:50 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:07:50 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:07:50 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:07:50 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:07:50 ctl02 neutron-server[30536]: 2017-09-28 13:07:50.970 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 13:07:50 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 13:07:50 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 13:07:06 cmp002
Sep 28 13:07:50 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 13:07:08 cmp001
Sep 28 13:07:50 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 13:06:40 cmp002
Sep 28 13:07:51 ctl02 neutron-server[30536]: 2017-09-28 13:07:51.046 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:07:51] "OPTIONS / HTTP/1.0" 200 262 0.000492
Sep 28 13:07:51 ctl02 nova-conductor[5056]: 2017-09-28 13:07:51.394 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:07:51 ctl02 nova-conductor[5056]: 2017-09-28 13:07:51.394 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:07:51 ctl02 nova-conductor[5056]: 2017-09-28 13:07:51.403 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:07:51 ctl02 nova-conductor[5056]: 2017-09-28 13:07:51.406 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:07:52 ctl02 nova-cert[4860]: 2017-09-28 13:07:52.351 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:07:52 ctl02 glance-api[29183]: 2017-09-28 13:07:52.553 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:07:52] "OPTIONS / HTTP/1.0" 200 134 0.000695
Sep 28 13:07:52 ctl02 nova-api[17650]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:07:52 ctl02 nova-api[17650]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:07:52 ctl02 nova-api[17650]: 2017-09-28 13:07:52.755 17650 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:07:52 ctl02 nova-api[17650]: 2017-09-28 13:07:52.756 17650 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:07:52 ctl02 nova-api[17650]: 2017-09-28 13:07:52.756 17650 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:07:52 ctl02 nova-api[17650]: 2017-09-28 13:07:52.756 17650 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:07:52 ctl02 nova-api[17650]: 2017-09-28 13:07:52.756 17650 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:07:52 ctl02 nova-api[17650]: 2017-09-28 13:07:52.756 17650 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:07:52 ctl02 nova-api[17650]: 2017-09-28 13:07:52.756 17650 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:07:52 ctl02 nova-api[17650]: 2017-09-28 13:07:52.756 17650 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:07:52 ctl02 nova-api[17650]: 2017-09-28 13:07:52.756 17650 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:07:52 ctl02 nova-api[17650]: 2017-09-28 13:07:52.756 17650 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:07:52 ctl02 nova-api[17650]: 2017-09-28 13:07:52.756 17650 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:07:52 ctl02 nova-api[17650]: 2017-09-28 13:07:52.756 17650 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:07:52 ctl02 nova-api[17650]: 2017-09-28 13:07:52.756 17650 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:07:52 ctl02 nova-api[17650]: 2017-09-28 13:07:52.756 17650 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:07:52 ctl02 nova-api[17650]: 2017-09-28 13:07:52.756 17650 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:07:52 ctl02 nova-api[17650]: 2017-09-28 13:07:52.756 17650 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:07:52 ctl02 nova-api[17650]: 2017-09-28 13:07:52.756 17650 ERROR nova.wsgi     self.filename))
Sep 28 13:07:52 ctl02 nova-api[17650]: 2017-09-28 13:07:52.756 17650 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:07:52 ctl02 nova-api[17650]: 2017-09-28 13:07:52.756 17650 ERROR nova.wsgi
Sep 28 13:07:52 ctl02 nova-api[17650]: 2017-09-28 13:07:52.758 17650 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:07:52 ctl02 nova-api[17650]: 2017-09-28 13:07:52.889 17650 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:07:53 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa86dc831)
Sep 28 13:07:53 ctl02 nova-api[17650]: 2017-09-28 13:07:53.112 17650 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:07:53 ctl02 nova-api[17650]: 2017-09-28 13:07:53.114 17650 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:07:53 ctl02 nova-api[17650]: 2017-09-28 13:07:53.115 17650 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:07:53 ctl02 nova-api[17650]: 2017-09-28 13:07:53.115 17650 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:07:53 ctl02 nova-api[17650]: 2017-09-28 13:07:53.247 17650 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:07:53 ctl02 nova-api[17650]: 2017-09-28 13:07:53.249 17650 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:07:53 ctl02 nova-api[17650]: 2017-09-28 13:07:53.249 17650 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:07:53 ctl02 nova-api[17650]: 2017-09-28 13:07:53.249 17650 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:07:53 ctl02 nova-api[17650]: 2017-09-28 13:07:53.253 17650 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:07:53 ctl02 nova-api[17650]: 2017-09-28 13:07:53.253 17650 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:07:53 ctl02 nova-api[17650]: 2017-09-28 13:07:53.253 17650 ERROR nova Traceback (most recent call last):
Sep 28 13:07:53 ctl02 nova-api[17650]: 2017-09-28 13:07:53.253 17650 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:07:53 ctl02 nova-api[17650]: 2017-09-28 13:07:53.253 17650 ERROR nova     sys.exit(main())
Sep 28 13:07:53 ctl02 nova-api[17650]: 2017-09-28 13:07:53.253 17650 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:07:53 ctl02 nova-api[17650]: 2017-09-28 13:07:53.253 17650 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:07:53 ctl02 nova-api[17650]: 2017-09-28 13:07:53.253 17650 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:07:53 ctl02 nova-api[17650]: 2017-09-28 13:07:53.253 17650 ERROR nova     max_url_len=max_url_len)
Sep 28 13:07:53 ctl02 nova-api[17650]: 2017-09-28 13:07:53.253 17650 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:07:53 ctl02 nova-api[17650]: 2017-09-28 13:07:53.253 17650 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:07:53 ctl02 nova-api[17650]: 2017-09-28 13:07:53.253 17650 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:07:53 ctl02 nova-api[17650]: 2017-09-28 13:07:53.253 17650 ERROR nova     sock.listen(backlog)
Sep 28 13:07:53 ctl02 nova-api[17650]: 2017-09-28 13:07:53.253 17650 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:07:53 ctl02 nova-api[17650]: 2017-09-28 13:07:53.253 17650 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:07:53 ctl02 nova-api[17650]: 2017-09-28 13:07:53.253 17650 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:07:53 ctl02 nova-api[17650]: 2017-09-28 13:07:53.253 17650 ERROR nova
Sep 28 13:07:53 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:07:53 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:07:53 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:07:53 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:07:53 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:07:53 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:07:53 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:07:54 ctl02 heat-api[13008]: 2017-09-28 13:07:54.074 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:07:54] "OPTIONS / HTTP/1.0" 200 134 0.000624
Sep 28 13:07:54 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa86dc831)
Sep 28 13:07:54 ctl02 neutron-server[30536]: 2017-09-28 13:07:54.304 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:07:54] "OPTIONS / HTTP/1.0" 200 262 0.000494
Sep 28 13:07:54 ctl02 heat-api-cfn[13300]: 2017-09-28 13:07:54.440 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:07:54] "OPTIONS / HTTP/1.0" 200 134 0.000500
Sep 28 13:07:54 ctl02 glance-api[29183]: 2017-09-28 13:07:54.458 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:07:54] "OPTIONS / HTTP/1.0" 200 134 0.000624
Sep 28 13:07:54 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:07:54.489 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:07:54] "OPTIONS / HTTP/1.0" 200 134 0.000420
Sep 28 13:07:55 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa86dc831)
Sep 28 13:07:55 ctl02 nova-api[17668]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:07:55 ctl02 nova-api[17668]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:07:55 ctl02 nova-api[17668]: 2017-09-28 13:07:55.533 17668 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:07:55 ctl02 nova-api[17668]: 2017-09-28 13:07:55.535 17668 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:07:55 ctl02 nova-api[17668]: 2017-09-28 13:07:55.535 17668 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:07:55 ctl02 nova-api[17668]: 2017-09-28 13:07:55.535 17668 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:07:55 ctl02 nova-api[17668]: 2017-09-28 13:07:55.535 17668 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:07:55 ctl02 nova-api[17668]: 2017-09-28 13:07:55.535 17668 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:07:55 ctl02 nova-api[17668]: 2017-09-28 13:07:55.535 17668 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:07:55 ctl02 nova-api[17668]: 2017-09-28 13:07:55.535 17668 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:07:55 ctl02 nova-api[17668]: 2017-09-28 13:07:55.535 17668 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:07:55 ctl02 nova-api[17668]: 2017-09-28 13:07:55.535 17668 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:07:55 ctl02 nova-api[17668]: 2017-09-28 13:07:55.535 17668 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:07:55 ctl02 nova-api[17668]: 2017-09-28 13:07:55.535 17668 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:07:55 ctl02 nova-api[17668]: 2017-09-28 13:07:55.535 17668 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:07:55 ctl02 nova-api[17668]: 2017-09-28 13:07:55.535 17668 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:07:55 ctl02 nova-api[17668]: 2017-09-28 13:07:55.535 17668 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:07:55 ctl02 nova-api[17668]: 2017-09-28 13:07:55.535 17668 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:07:55 ctl02 nova-api[17668]: 2017-09-28 13:07:55.535 17668 ERROR nova.wsgi     self.filename))
Sep 28 13:07:55 ctl02 nova-api[17668]: 2017-09-28 13:07:55.535 17668 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:07:55 ctl02 nova-api[17668]: 2017-09-28 13:07:55.535 17668 ERROR nova.wsgi
Sep 28 13:07:55 ctl02 nova-api[17668]: 2017-09-28 13:07:55.536 17668 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:07:55 ctl02 nova-api[17668]: 2017-09-28 13:07:55.669 17668 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:07:55 ctl02 nova-api[17668]: 2017-09-28 13:07:55.922 17668 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:07:55 ctl02 nova-api[17668]: 2017-09-28 13:07:55.924 17668 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:07:55 ctl02 nova-api[17668]: 2017-09-28 13:07:55.924 17668 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:07:55 ctl02 nova-api[17668]: 2017-09-28 13:07:55.924 17668 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:07:56 ctl02 nova-api[17668]: 2017-09-28 13:07:56.058 17668 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:07:56 ctl02 nova-api[17668]: 2017-09-28 13:07:56.060 17668 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:07:56 ctl02 nova-api[17668]: 2017-09-28 13:07:56.060 17668 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:07:56 ctl02 nova-api[17668]: 2017-09-28 13:07:56.060 17668 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:07:56 ctl02 nova-api[17668]: 2017-09-28 13:07:56.064 17668 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:07:56 ctl02 nova-api[17668]: 2017-09-28 13:07:56.064 17668 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:07:56 ctl02 nova-api[17668]: 2017-09-28 13:07:56.064 17668 ERROR nova Traceback (most recent call last):
Sep 28 13:07:56 ctl02 nova-api[17668]: 2017-09-28 13:07:56.064 17668 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:07:56 ctl02 nova-api[17668]: 2017-09-28 13:07:56.064 17668 ERROR nova     sys.exit(main())
Sep 28 13:07:56 ctl02 nova-api[17668]: 2017-09-28 13:07:56.064 17668 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:07:56 ctl02 nova-api[17668]: 2017-09-28 13:07:56.064 17668 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:07:56 ctl02 nova-api[17668]: 2017-09-28 13:07:56.064 17668 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:07:56 ctl02 nova-api[17668]: 2017-09-28 13:07:56.064 17668 ERROR nova     max_url_len=max_url_len)
Sep 28 13:07:56 ctl02 nova-api[17668]: 2017-09-28 13:07:56.064 17668 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:07:56 ctl02 nova-api[17668]: 2017-09-28 13:07:56.064 17668 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:07:56 ctl02 nova-api[17668]: 2017-09-28 13:07:56.064 17668 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:07:56 ctl02 nova-api[17668]: 2017-09-28 13:07:56.064 17668 ERROR nova     sock.listen(backlog)
Sep 28 13:07:56 ctl02 nova-api[17668]: 2017-09-28 13:07:56.064 17668 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:07:56 ctl02 nova-api[17668]: 2017-09-28 13:07:56.064 17668 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:07:56 ctl02 nova-api[17668]: 2017-09-28 13:07:56.064 17668 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:07:56 ctl02 nova-api[17668]: 2017-09-28 13:07:56.064 17668 ERROR nova
Sep 28 13:07:56 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa86dc831)
Sep 28 13:07:56 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:07:56 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:07:56 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:07:56 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:07:56 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:07:56 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:07:56 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:07:57 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa86dc831)
Sep 28 13:07:57 ctl02 heat-api-cfn[13300]: 2017-09-28 13:07:57.179 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:07:57] "OPTIONS / HTTP/1.0" 200 134 0.000498
Sep 28 13:07:58 ctl02 nova-api[17685]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:07:58 ctl02 nova-api[17685]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:07:58 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa86dc831)
Sep 28 13:07:58 ctl02 nova-api[17685]: 2017-09-28 13:07:58.293 17685 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:07:58 ctl02 nova-api[17685]: 2017-09-28 13:07:58.294 17685 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:07:58 ctl02 nova-api[17685]: 2017-09-28 13:07:58.294 17685 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:07:58 ctl02 nova-api[17685]: 2017-09-28 13:07:58.294 17685 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:07:58 ctl02 nova-api[17685]: 2017-09-28 13:07:58.294 17685 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:07:58 ctl02 nova-api[17685]: 2017-09-28 13:07:58.294 17685 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:07:58 ctl02 nova-api[17685]: 2017-09-28 13:07:58.294 17685 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:07:58 ctl02 nova-api[17685]: 2017-09-28 13:07:58.294 17685 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:07:58 ctl02 nova-api[17685]: 2017-09-28 13:07:58.294 17685 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:07:58 ctl02 nova-api[17685]: 2017-09-28 13:07:58.294 17685 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:07:58 ctl02 nova-api[17685]: 2017-09-28 13:07:58.294 17685 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:07:58 ctl02 nova-api[17685]: 2017-09-28 13:07:58.294 17685 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:07:58 ctl02 nova-api[17685]: 2017-09-28 13:07:58.294 17685 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:07:58 ctl02 nova-api[17685]: 2017-09-28 13:07:58.294 17685 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:07:58 ctl02 nova-api[17685]: 2017-09-28 13:07:58.294 17685 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:07:58 ctl02 nova-api[17685]: 2017-09-28 13:07:58.294 17685 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:07:58 ctl02 nova-api[17685]: 2017-09-28 13:07:58.294 17685 ERROR nova.wsgi     self.filename))
Sep 28 13:07:58 ctl02 nova-api[17685]: 2017-09-28 13:07:58.294 17685 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:07:58 ctl02 nova-api[17685]: 2017-09-28 13:07:58.294 17685 ERROR nova.wsgi
Sep 28 13:07:58 ctl02 nova-api[17685]: 2017-09-28 13:07:58.295 17685 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:07:58 ctl02 heat-api[13008]: 2017-09-28 13:07:58.318 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:07:58] "OPTIONS / HTTP/1.0" 200 134 0.000709
Sep 28 13:07:58 ctl02 nova-api[17685]: 2017-09-28 13:07:58.431 17685 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:07:58 ctl02 nova-api[17685]: 2017-09-28 13:07:58.695 17685 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:07:58 ctl02 nova-api[17685]: 2017-09-28 13:07:58.698 17685 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:07:58 ctl02 nova-api[17685]: 2017-09-28 13:07:58.698 17685 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:07:58 ctl02 nova-api[17685]: 2017-09-28 13:07:58.698 17685 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:07:58 ctl02 nova-api[17685]: 2017-09-28 13:07:58.832 17685 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:07:58 ctl02 nova-api[17685]: 2017-09-28 13:07:58.835 17685 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:07:58 ctl02 nova-api[17685]: 2017-09-28 13:07:58.835 17685 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:07:58 ctl02 nova-api[17685]: 2017-09-28 13:07:58.835 17685 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:07:58 ctl02 nova-api[17685]: 2017-09-28 13:07:58.839 17685 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:07:58 ctl02 nova-api[17685]: 2017-09-28 13:07:58.839 17685 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:07:58 ctl02 nova-api[17685]: 2017-09-28 13:07:58.839 17685 ERROR nova Traceback (most recent call last):
Sep 28 13:07:58 ctl02 nova-api[17685]: 2017-09-28 13:07:58.839 17685 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:07:58 ctl02 nova-api[17685]: 2017-09-28 13:07:58.839 17685 ERROR nova     sys.exit(main())
Sep 28 13:07:58 ctl02 nova-api[17685]: 2017-09-28 13:07:58.839 17685 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:07:58 ctl02 nova-api[17685]: 2017-09-28 13:07:58.839 17685 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:07:58 ctl02 nova-api[17685]: 2017-09-28 13:07:58.839 17685 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:07:58 ctl02 nova-api[17685]: 2017-09-28 13:07:58.839 17685 ERROR nova     max_url_len=max_url_len)
Sep 28 13:07:58 ctl02 nova-api[17685]: 2017-09-28 13:07:58.839 17685 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:07:58 ctl02 nova-api[17685]: 2017-09-28 13:07:58.839 17685 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:07:58 ctl02 nova-api[17685]: 2017-09-28 13:07:58.839 17685 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:07:58 ctl02 nova-api[17685]: 2017-09-28 13:07:58.839 17685 ERROR nova     sock.listen(backlog)
Sep 28 13:07:58 ctl02 nova-api[17685]: 2017-09-28 13:07:58.839 17685 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:07:58 ctl02 nova-api[17685]: 2017-09-28 13:07:58.839 17685 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:07:58 ctl02 nova-api[17685]: 2017-09-28 13:07:58.839 17685 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:07:58 ctl02 nova-api[17685]: 2017-09-28 13:07:58.839 17685 ERROR nova
Sep 28 13:07:58 ctl02 heat-api-cfn[13300]: 2017-09-28 13:07:58.874 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:07:58] "OPTIONS / HTTP/1.0" 200 134 0.000537
Sep 28 13:07:59 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:07:59 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:07:59 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:07:59 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa86dc831)
Sep 28 13:07:59 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:07:59.104 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:07:59] "OPTIONS / HTTP/1.0" 200 134 0.000488
Sep 28 13:07:59 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:07:59 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:07:59 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:07:59 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:07:59 ctl02 neutron-server[30536]: 2017-09-28 13:07:59.313 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:07:59] "OPTIONS / HTTP/1.0" 200 262 0.000557
Sep 28 13:07:59 ctl02 heat-api[13008]: 2017-09-28 13:07:59.725 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:07:59] "OPTIONS / HTTP/1.0" 200 134 0.000622
Sep 28 13:08:00 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa86dc831)
Sep 28 13:08:00 ctl02 glance-api[29183]: 2017-09-28 13:08:00.252 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:08:00] "OPTIONS / HTTP/1.0" 200 134 0.000648
Sep 28 13:08:00 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:08:00.535 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:08:00] "OPTIONS / HTTP/1.0" 200 134 0.000410
Sep 28 13:08:00 ctl02 nova-api[17704]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:08:00 ctl02 nova-api[17704]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:08:01 ctl02 nova-api[17704]: 2017-09-28 13:08:01.033 17704 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:08:01 ctl02 nova-api[17704]: 2017-09-28 13:08:01.034 17704 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:08:01 ctl02 nova-api[17704]: 2017-09-28 13:08:01.034 17704 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:08:01 ctl02 nova-api[17704]: 2017-09-28 13:08:01.034 17704 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:08:01 ctl02 nova-api[17704]: 2017-09-28 13:08:01.034 17704 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:08:01 ctl02 nova-api[17704]: 2017-09-28 13:08:01.034 17704 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:08:01 ctl02 nova-api[17704]: 2017-09-28 13:08:01.034 17704 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:08:01 ctl02 nova-api[17704]: 2017-09-28 13:08:01.034 17704 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:08:01 ctl02 nova-api[17704]: 2017-09-28 13:08:01.034 17704 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:08:01 ctl02 nova-api[17704]: 2017-09-28 13:08:01.034 17704 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:08:01 ctl02 nova-api[17704]: 2017-09-28 13:08:01.034 17704 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:08:01 ctl02 nova-api[17704]: 2017-09-28 13:08:01.034 17704 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:08:01 ctl02 nova-api[17704]: 2017-09-28 13:08:01.034 17704 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:08:01 ctl02 nova-api[17704]: 2017-09-28 13:08:01.034 17704 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:08:01 ctl02 nova-api[17704]: 2017-09-28 13:08:01.034 17704 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:08:01 ctl02 nova-api[17704]: 2017-09-28 13:08:01.034 17704 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:08:01 ctl02 nova-api[17704]: 2017-09-28 13:08:01.034 17704 ERROR nova.wsgi     self.filename))
Sep 28 13:08:01 ctl02 nova-api[17704]: 2017-09-28 13:08:01.034 17704 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:08:01 ctl02 nova-api[17704]: 2017-09-28 13:08:01.034 17704 ERROR nova.wsgi
Sep 28 13:08:01 ctl02 nova-api[17704]: 2017-09-28 13:08:01.037 17704 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:08:01 ctl02 neutron-server[30536]: 2017-09-28 13:08:01.047 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:08:01] "OPTIONS / HTTP/1.0" 200 262 0.000454
Sep 28 13:08:01 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa86dc831)
Sep 28 13:08:01 ctl02 nova-api[17704]: 2017-09-28 13:08:01.167 17704 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:08:01 ctl02 nova-api[17704]: 2017-09-28 13:08:01.420 17704 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:08:01 ctl02 nova-api[17704]: 2017-09-28 13:08:01.423 17704 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:08:01 ctl02 nova-api[17704]: 2017-09-28 13:08:01.423 17704 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:08:01 ctl02 nova-api[17704]: 2017-09-28 13:08:01.424 17704 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:08:01 ctl02 nova-api[17704]: 2017-09-28 13:08:01.562 17704 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:08:01 ctl02 nova-api[17704]: 2017-09-28 13:08:01.565 17704 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:08:01 ctl02 nova-api[17704]: 2017-09-28 13:08:01.566 17704 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:08:01 ctl02 nova-api[17704]: 2017-09-28 13:08:01.566 17704 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:08:01 ctl02 nova-api[17704]: 2017-09-28 13:08:01.570 17704 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:08:01 ctl02 nova-api[17704]: 2017-09-28 13:08:01.570 17704 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:08:01 ctl02 nova-api[17704]: 2017-09-28 13:08:01.570 17704 ERROR nova Traceback (most recent call last):
Sep 28 13:08:01 ctl02 nova-api[17704]: 2017-09-28 13:08:01.570 17704 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:08:01 ctl02 nova-api[17704]: 2017-09-28 13:08:01.570 17704 ERROR nova     sys.exit(main())
Sep 28 13:08:01 ctl02 nova-api[17704]: 2017-09-28 13:08:01.570 17704 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:08:01 ctl02 nova-api[17704]: 2017-09-28 13:08:01.570 17704 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:08:01 ctl02 nova-api[17704]: 2017-09-28 13:08:01.570 17704 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:08:01 ctl02 nova-api[17704]: 2017-09-28 13:08:01.570 17704 ERROR nova     max_url_len=max_url_len)
Sep 28 13:08:01 ctl02 nova-api[17704]: 2017-09-28 13:08:01.570 17704 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:08:01 ctl02 nova-api[17704]: 2017-09-28 13:08:01.570 17704 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:08:01 ctl02 nova-api[17704]: 2017-09-28 13:08:01.570 17704 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:08:01 ctl02 nova-api[17704]: 2017-09-28 13:08:01.570 17704 ERROR nova     sock.listen(backlog)
Sep 28 13:08:01 ctl02 nova-api[17704]: 2017-09-28 13:08:01.570 17704 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:08:01 ctl02 nova-api[17704]: 2017-09-28 13:08:01.570 17704 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:08:01 ctl02 nova-api[17704]: 2017-09-28 13:08:01.570 17704 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:08:01 ctl02 nova-api[17704]: 2017-09-28 13:08:01.570 17704 ERROR nova
Sep 28 13:08:01 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:08:01 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:08:01 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:08:01 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:08:01 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:08:01 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:08:01 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:08:02 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa86dc831)
Sep 28 13:08:02 ctl02 nova-consoleauth[5433]: 2017-09-28 13:08:02.212 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:08:02 ctl02 glance-api[29183]: 2017-09-28 13:08:02.492 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:08:02] "OPTIONS / HTTP/1.0" 200 134 0.000687
Sep 28 13:08:02 ctl02 heat-engine[12803]: 2017-09-28 13:08:02.512 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:08:02 ctl02 heat-engine[12803]: 2017-09-28 13:08:02.528 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:08:02 ctl02 heat-engine[12803]: 2017-09-28 13:08:02.537 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:08:02 ctl02 heat-engine[12803]: 2017-09-28 13:08:02.541 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:08:03 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xa86dc831)
Sep 28 13:08:03 ctl02 nova-api[17721]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:08:03 ctl02 nova-api[17721]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:08:03 ctl02 nova-api[17721]: 2017-09-28 13:08:03.822 17721 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:08:03 ctl02 nova-api[17721]: 2017-09-28 13:08:03.824 17721 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:08:03 ctl02 nova-api[17721]: 2017-09-28 13:08:03.824 17721 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:08:03 ctl02 nova-api[17721]: 2017-09-28 13:08:03.824 17721 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:08:03 ctl02 nova-api[17721]: 2017-09-28 13:08:03.824 17721 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:08:03 ctl02 nova-api[17721]: 2017-09-28 13:08:03.824 17721 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:08:03 ctl02 nova-api[17721]: 2017-09-28 13:08:03.824 17721 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:08:03 ctl02 nova-api[17721]: 2017-09-28 13:08:03.824 17721 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:08:03 ctl02 nova-api[17721]: 2017-09-28 13:08:03.824 17721 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:08:03 ctl02 nova-api[17721]: 2017-09-28 13:08:03.824 17721 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:08:03 ctl02 nova-api[17721]: 2017-09-28 13:08:03.824 17721 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:08:03 ctl02 nova-api[17721]: 2017-09-28 13:08:03.824 17721 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:08:03 ctl02 nova-api[17721]: 2017-09-28 13:08:03.824 17721 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:08:03 ctl02 nova-api[17721]: 2017-09-28 13:08:03.824 17721 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:08:03 ctl02 nova-api[17721]: 2017-09-28 13:08:03.824 17721 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:08:03 ctl02 nova-api[17721]: 2017-09-28 13:08:03.824 17721 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:08:03 ctl02 nova-api[17721]: 2017-09-28 13:08:03.824 17721 ERROR nova.wsgi     self.filename))
Sep 28 13:08:03 ctl02 nova-api[17721]: 2017-09-28 13:08:03.824 17721 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:08:03 ctl02 nova-api[17721]: 2017-09-28 13:08:03.824 17721 ERROR nova.wsgi
Sep 28 13:08:03 ctl02 nova-api[17721]: 2017-09-28 13:08:03.825 17721 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:08:03 ctl02 nova-api[17721]: 2017-09-28 13:08:03.955 17721 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:08:04 ctl02 heat-api[13008]: 2017-09-28 13:08:04.018 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:08:04] "OPTIONS / HTTP/1.0" 200 134 0.000631
Sep 28 13:08:04 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 13:08:04 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 13:08:04 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:08:04.161 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:08:04] "OPTIONS / HTTP/1.0" 200 134 0.000389
Sep 28 13:08:04 ctl02 nova-api[17721]: 2017-09-28 13:08:04.198 17721 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:08:04 ctl02 nova-api[17721]: 2017-09-28 13:08:04.200 17721 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:08:04 ctl02 nova-api[17721]: 2017-09-28 13:08:04.201 17721 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:08:04 ctl02 nova-api[17721]: 2017-09-28 13:08:04.201 17721 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:08:04 ctl02 nova-api[17721]: 2017-09-28 13:08:04.333 17721 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:08:04 ctl02 nova-api[17721]: 2017-09-28 13:08:04.335 17721 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:08:04 ctl02 nova-api[17721]: 2017-09-28 13:08:04.340 17721 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:08:04 ctl02 nova-api[17721]: 2017-09-28 13:08:04.340 17721 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:08:04 ctl02 nova-api[17721]: 2017-09-28 13:08:04.345 17721 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:08:04 ctl02 nova-api[17721]: 2017-09-28 13:08:04.345 17721 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:08:04 ctl02 nova-api[17721]: 2017-09-28 13:08:04.345 17721 ERROR nova Traceback (most recent call last):
Sep 28 13:08:04 ctl02 nova-api[17721]: 2017-09-28 13:08:04.345 17721 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:08:04 ctl02 nova-api[17721]: 2017-09-28 13:08:04.345 17721 ERROR nova     sys.exit(main())
Sep 28 13:08:04 ctl02 nova-api[17721]: 2017-09-28 13:08:04.345 17721 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:08:04 ctl02 nova-api[17721]: 2017-09-28 13:08:04.345 17721 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:08:04 ctl02 nova-api[17721]: 2017-09-28 13:08:04.345 17721 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:08:04 ctl02 nova-api[17721]: 2017-09-28 13:08:04.345 17721 ERROR nova     max_url_len=max_url_len)
Sep 28 13:08:04 ctl02 nova-api[17721]: 2017-09-28 13:08:04.345 17721 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:08:04 ctl02 nova-api[17721]: 2017-09-28 13:08:04.345 17721 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:08:04 ctl02 nova-api[17721]: 2017-09-28 13:08:04.345 17721 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:08:04 ctl02 nova-api[17721]: 2017-09-28 13:08:04.345 17721 ERROR nova     sock.listen(backlog)
Sep 28 13:08:04 ctl02 nova-api[17721]: 2017-09-28 13:08:04.345 17721 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:08:04 ctl02 nova-api[17721]: 2017-09-28 13:08:04.345 17721 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:08:04 ctl02 nova-api[17721]: 2017-09-28 13:08:04.345 17721 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:08:04 ctl02 nova-api[17721]: 2017-09-28 13:08:04.345 17721 ERROR nova
Sep 28 13:08:04 ctl02 heat-api-cfn[13300]: 2017-09-28 13:08:04.347 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:08:04] "OPTIONS / HTTP/1.0" 200 134 0.000550
Sep 28 13:08:04 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:08:04 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:08:04 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:08:04 ctl02 neutron-server[30536]: 2017-09-28 13:08:04.517 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:08:04] "OPTIONS / HTTP/1.0" 200 262 0.000470
Sep 28 13:08:04 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:08:04 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:08:04 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:08:04 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:08:04 ctl02 glance-api[29183]: 2017-09-28 13:08:04.825 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:08:04] "OPTIONS / HTTP/1.0" 200 134 0.000942
Sep 28 13:08:05 ctl02 nova-scheduler[5620]: 2017-09-28 13:08:05.317 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:08:05 ctl02 neutron-server[30536]: 2017-09-28 13:08:05.965 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 13:08:05 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 13:08:05 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 13:07:06 cmp002
Sep 28 13:08:05 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 13:07:08 cmp001
Sep 28 13:08:05 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 13:06:40 cmp002
Sep 28 13:08:06 ctl02 nova-api[17744]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:08:06 ctl02 nova-api[17744]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:08:06 ctl02 nova-api[17744]: 2017-09-28 13:08:06.448 17744 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:08:06 ctl02 nova-api[17744]: 2017-09-28 13:08:06.449 17744 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:08:06 ctl02 nova-api[17744]: 2017-09-28 13:08:06.449 17744 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:08:06 ctl02 nova-api[17744]: 2017-09-28 13:08:06.449 17744 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:08:06 ctl02 nova-api[17744]: 2017-09-28 13:08:06.449 17744 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:08:06 ctl02 nova-api[17744]: 2017-09-28 13:08:06.449 17744 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:08:06 ctl02 nova-api[17744]: 2017-09-28 13:08:06.449 17744 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:08:06 ctl02 nova-api[17744]: 2017-09-28 13:08:06.449 17744 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:08:06 ctl02 nova-api[17744]: 2017-09-28 13:08:06.449 17744 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:08:06 ctl02 nova-api[17744]: 2017-09-28 13:08:06.449 17744 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:08:06 ctl02 nova-api[17744]: 2017-09-28 13:08:06.449 17744 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:08:06 ctl02 nova-api[17744]: 2017-09-28 13:08:06.449 17744 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:08:06 ctl02 nova-api[17744]: 2017-09-28 13:08:06.449 17744 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:08:06 ctl02 nova-api[17744]: 2017-09-28 13:08:06.449 17744 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:08:06 ctl02 nova-api[17744]: 2017-09-28 13:08:06.449 17744 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:08:06 ctl02 nova-api[17744]: 2017-09-28 13:08:06.449 17744 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:08:06 ctl02 nova-api[17744]: 2017-09-28 13:08:06.449 17744 ERROR nova.wsgi     self.filename))
Sep 28 13:08:06 ctl02 nova-api[17744]: 2017-09-28 13:08:06.449 17744 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:08:06 ctl02 nova-api[17744]: 2017-09-28 13:08:06.449 17744 ERROR nova.wsgi
Sep 28 13:08:06 ctl02 nova-api[17744]: 2017-09-28 13:08:06.451 17744 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:08:06 ctl02 nova-api[17744]: 2017-09-28 13:08:06.579 17744 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:08:06 ctl02 nova-api[17744]: 2017-09-28 13:08:06.798 17744 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:08:06 ctl02 nova-api[17744]: 2017-09-28 13:08:06.801 17744 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:08:06 ctl02 nova-api[17744]: 2017-09-28 13:08:06.801 17744 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:08:06 ctl02 nova-api[17744]: 2017-09-28 13:08:06.801 17744 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:08:06 ctl02 nova-api[17744]: 2017-09-28 13:08:06.930 17744 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:08:06 ctl02 nova-api[17744]: 2017-09-28 13:08:06.933 17744 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:08:06 ctl02 nova-api[17744]: 2017-09-28 13:08:06.933 17744 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:08:06 ctl02 nova-api[17744]: 2017-09-28 13:08:06.933 17744 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:08:06 ctl02 nova-api[17744]: 2017-09-28 13:08:06.937 17744 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:08:06 ctl02 nova-api[17744]: 2017-09-28 13:08:06.937 17744 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:08:06 ctl02 nova-api[17744]: 2017-09-28 13:08:06.937 17744 ERROR nova Traceback (most recent call last):
Sep 28 13:08:06 ctl02 nova-api[17744]: 2017-09-28 13:08:06.937 17744 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:08:06 ctl02 nova-api[17744]: 2017-09-28 13:08:06.937 17744 ERROR nova     sys.exit(main())
Sep 28 13:08:06 ctl02 nova-api[17744]: 2017-09-28 13:08:06.937 17744 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:08:06 ctl02 nova-api[17744]: 2017-09-28 13:08:06.937 17744 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:08:06 ctl02 nova-api[17744]: 2017-09-28 13:08:06.937 17744 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:08:06 ctl02 nova-api[17744]: 2017-09-28 13:08:06.937 17744 ERROR nova     max_url_len=max_url_len)
Sep 28 13:08:06 ctl02 nova-api[17744]: 2017-09-28 13:08:06.937 17744 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:08:06 ctl02 nova-api[17744]: 2017-09-28 13:08:06.937 17744 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:08:06 ctl02 nova-api[17744]: 2017-09-28 13:08:06.937 17744 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:08:06 ctl02 nova-api[17744]: 2017-09-28 13:08:06.937 17744 ERROR nova     sock.listen(backlog)
Sep 28 13:08:06 ctl02 nova-api[17744]: 2017-09-28 13:08:06.937 17744 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:08:06 ctl02 nova-api[17744]: 2017-09-28 13:08:06.937 17744 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:08:06 ctl02 nova-api[17744]: 2017-09-28 13:08:06.937 17744 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:08:06 ctl02 nova-api[17744]: 2017-09-28 13:08:06.937 17744 ERROR nova
Sep 28 13:08:07 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:08:07 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:08:07 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:08:07 ctl02 heat-api-cfn[13300]: 2017-09-28 13:08:07.197 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:08:07] "OPTIONS / HTTP/1.0" 200 134 0.000495
Sep 28 13:08:07 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:08:07 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:08:07 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:08:07 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:08:08 ctl02 heat-api[13008]: 2017-09-28 13:08:08.281 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:08:08] "OPTIONS / HTTP/1.0" 200 134 0.000609
Sep 28 13:08:08 ctl02 heat-api-cfn[13300]: 2017-09-28 13:08:08.601 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:08:08] "OPTIONS / HTTP/1.0" 200 134 0.000473
Sep 28 13:08:08 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:08:08.920 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:08:08] "OPTIONS / HTTP/1.0" 200 134 0.000383
Sep 28 13:08:08 ctl02 neutron-server[30536]: 2017-09-28 13:08:08.929 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:08:08] "OPTIONS / HTTP/1.0" 200 262 0.000448
Sep 28 13:08:09 ctl02 nova-api[17763]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:08:09 ctl02 nova-api[17763]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:08:09 ctl02 nova-api[17763]: 2017-09-28 13:08:09.241 17763 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:08:09 ctl02 nova-api[17763]: 2017-09-28 13:08:09.242 17763 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:08:09 ctl02 nova-api[17763]: 2017-09-28 13:08:09.242 17763 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:08:09 ctl02 nova-api[17763]: 2017-09-28 13:08:09.242 17763 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:08:09 ctl02 nova-api[17763]: 2017-09-28 13:08:09.242 17763 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:08:09 ctl02 nova-api[17763]: 2017-09-28 13:08:09.242 17763 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:08:09 ctl02 nova-api[17763]: 2017-09-28 13:08:09.242 17763 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:08:09 ctl02 nova-api[17763]: 2017-09-28 13:08:09.242 17763 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:08:09 ctl02 nova-api[17763]: 2017-09-28 13:08:09.242 17763 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:08:09 ctl02 nova-api[17763]: 2017-09-28 13:08:09.242 17763 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:08:09 ctl02 nova-api[17763]: 2017-09-28 13:08:09.242 17763 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:08:09 ctl02 nova-api[17763]: 2017-09-28 13:08:09.242 17763 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:08:09 ctl02 nova-api[17763]: 2017-09-28 13:08:09.242 17763 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:08:09 ctl02 nova-api[17763]: 2017-09-28 13:08:09.242 17763 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:08:09 ctl02 nova-api[17763]: 2017-09-28 13:08:09.242 17763 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:08:09 ctl02 nova-api[17763]: 2017-09-28 13:08:09.242 17763 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:08:09 ctl02 nova-api[17763]: 2017-09-28 13:08:09.242 17763 ERROR nova.wsgi     self.filename))
Sep 28 13:08:09 ctl02 nova-api[17763]: 2017-09-28 13:08:09.242 17763 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:08:09 ctl02 nova-api[17763]: 2017-09-28 13:08:09.242 17763 ERROR nova.wsgi
Sep 28 13:08:09 ctl02 nova-api[17763]: 2017-09-28 13:08:09.243 17763 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:08:09 ctl02 nova-api[17763]: 2017-09-28 13:08:09.372 17763 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:08:09 ctl02 heat-api[13008]: 2017-09-28 13:08:09.583 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:08:09] "OPTIONS / HTTP/1.0" 200 134 0.000688
Sep 28 13:08:09 ctl02 nova-api[17763]: 2017-09-28 13:08:09.602 17763 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:08:09 ctl02 nova-api[17763]: 2017-09-28 13:08:09.605 17763 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:08:09 ctl02 nova-api[17763]: 2017-09-28 13:08:09.605 17763 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:08:09 ctl02 nova-api[17763]: 2017-09-28 13:08:09.605 17763 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:08:09 ctl02 nova-api[17763]: 2017-09-28 13:08:09.736 17763 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:08:09 ctl02 nova-api[17763]: 2017-09-28 13:08:09.738 17763 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:08:09 ctl02 nova-api[17763]: 2017-09-28 13:08:09.738 17763 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:08:09 ctl02 nova-api[17763]: 2017-09-28 13:08:09.738 17763 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:08:09 ctl02 nova-api[17763]: 2017-09-28 13:08:09.742 17763 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:08:09 ctl02 nova-api[17763]: 2017-09-28 13:08:09.742 17763 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:08:09 ctl02 nova-api[17763]: 2017-09-28 13:08:09.742 17763 ERROR nova Traceback (most recent call last):
Sep 28 13:08:09 ctl02 nova-api[17763]: 2017-09-28 13:08:09.742 17763 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:08:09 ctl02 nova-api[17763]: 2017-09-28 13:08:09.742 17763 ERROR nova     sys.exit(main())
Sep 28 13:08:09 ctl02 nova-api[17763]: 2017-09-28 13:08:09.742 17763 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:08:09 ctl02 nova-api[17763]: 2017-09-28 13:08:09.742 17763 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:08:09 ctl02 nova-api[17763]: 2017-09-28 13:08:09.742 17763 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:08:09 ctl02 nova-api[17763]: 2017-09-28 13:08:09.742 17763 ERROR nova     max_url_len=max_url_len)
Sep 28 13:08:09 ctl02 nova-api[17763]: 2017-09-28 13:08:09.742 17763 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:08:09 ctl02 nova-api[17763]: 2017-09-28 13:08:09.742 17763 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:08:09 ctl02 nova-api[17763]: 2017-09-28 13:08:09.742 17763 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:08:09 ctl02 nova-api[17763]: 2017-09-28 13:08:09.742 17763 ERROR nova     sock.listen(backlog)
Sep 28 13:08:09 ctl02 nova-api[17763]: 2017-09-28 13:08:09.742 17763 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:08:09 ctl02 nova-api[17763]: 2017-09-28 13:08:09.742 17763 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:08:09 ctl02 nova-api[17763]: 2017-09-28 13:08:09.742 17763 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:08:09 ctl02 nova-api[17763]: 2017-09-28 13:08:09.742 17763 ERROR nova
Sep 28 13:08:09 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:08:09 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:08:09 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:08:10 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:08:10 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:08:10 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:08:10 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:08:10 ctl02 glance-api[29183]: 2017-09-28 13:08:10.249 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:08:10] "OPTIONS / HTTP/1.0" 200 134 0.000946
Sep 28 13:08:10 ctl02 neutron-server[30536]: 2017-09-28 13:08:10.832 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:08:10] "OPTIONS / HTTP/1.0" 200 262 0.000491
Sep 28 13:08:10 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:08:10.866 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:08:10] "OPTIONS / HTTP/1.0" 200 134 0.000453
Sep 28 13:08:11 ctl02 nova-api[17780]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:08:11 ctl02 nova-api[17780]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:08:11 ctl02 nova-api[17780]: 2017-09-28 13:08:11.954 17780 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:08:11 ctl02 nova-api[17780]: 2017-09-28 13:08:11.955 17780 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:08:11 ctl02 nova-api[17780]: 2017-09-28 13:08:11.955 17780 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:08:11 ctl02 nova-api[17780]: 2017-09-28 13:08:11.955 17780 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:08:11 ctl02 nova-api[17780]: 2017-09-28 13:08:11.955 17780 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:08:11 ctl02 nova-api[17780]: 2017-09-28 13:08:11.955 17780 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:08:11 ctl02 nova-api[17780]: 2017-09-28 13:08:11.955 17780 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:08:11 ctl02 nova-api[17780]: 2017-09-28 13:08:11.955 17780 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:08:11 ctl02 nova-api[17780]: 2017-09-28 13:08:11.955 17780 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:08:11 ctl02 nova-api[17780]: 2017-09-28 13:08:11.955 17780 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:08:11 ctl02 nova-api[17780]: 2017-09-28 13:08:11.955 17780 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:08:11 ctl02 nova-api[17780]: 2017-09-28 13:08:11.955 17780 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:08:11 ctl02 nova-api[17780]: 2017-09-28 13:08:11.955 17780 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:08:11 ctl02 nova-api[17780]: 2017-09-28 13:08:11.955 17780 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:08:11 ctl02 nova-api[17780]: 2017-09-28 13:08:11.955 17780 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:08:11 ctl02 nova-api[17780]: 2017-09-28 13:08:11.955 17780 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:08:11 ctl02 nova-api[17780]: 2017-09-28 13:08:11.955 17780 ERROR nova.wsgi     self.filename))
Sep 28 13:08:11 ctl02 nova-api[17780]: 2017-09-28 13:08:11.955 17780 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:08:11 ctl02 nova-api[17780]: 2017-09-28 13:08:11.955 17780 ERROR nova.wsgi
Sep 28 13:08:11 ctl02 nova-api[17780]: 2017-09-28 13:08:11.956 17780 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:08:12 ctl02 nova-api[17780]: 2017-09-28 13:08:12.081 17780 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:08:12 ctl02 nova-api[17780]: 2017-09-28 13:08:12.298 17780 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:08:12 ctl02 nova-api[17780]: 2017-09-28 13:08:12.300 17780 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:08:12 ctl02 nova-api[17780]: 2017-09-28 13:08:12.300 17780 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:08:12 ctl02 nova-api[17780]: 2017-09-28 13:08:12.300 17780 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:08:12 ctl02 glance-api[29183]: 2017-09-28 13:08:12.421 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:08:12] "OPTIONS / HTTP/1.0" 200 134 0.000624
Sep 28 13:08:12 ctl02 nova-api[17780]: 2017-09-28 13:08:12.428 17780 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:08:12 ctl02 nova-api[17780]: 2017-09-28 13:08:12.430 17780 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:08:12 ctl02 nova-api[17780]: 2017-09-28 13:08:12.430 17780 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:08:12 ctl02 nova-api[17780]: 2017-09-28 13:08:12.430 17780 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:08:12 ctl02 nova-api[17780]: 2017-09-28 13:08:12.433 17780 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:08:12 ctl02 nova-api[17780]: 2017-09-28 13:08:12.434 17780 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:08:12 ctl02 nova-api[17780]: 2017-09-28 13:08:12.434 17780 ERROR nova Traceback (most recent call last):
Sep 28 13:08:12 ctl02 nova-api[17780]: 2017-09-28 13:08:12.434 17780 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:08:12 ctl02 nova-api[17780]: 2017-09-28 13:08:12.434 17780 ERROR nova     sys.exit(main())
Sep 28 13:08:12 ctl02 nova-api[17780]: 2017-09-28 13:08:12.434 17780 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:08:12 ctl02 nova-api[17780]: 2017-09-28 13:08:12.434 17780 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:08:12 ctl02 nova-api[17780]: 2017-09-28 13:08:12.434 17780 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:08:12 ctl02 nova-api[17780]: 2017-09-28 13:08:12.434 17780 ERROR nova     max_url_len=max_url_len)
Sep 28 13:08:12 ctl02 nova-api[17780]: 2017-09-28 13:08:12.434 17780 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:08:12 ctl02 nova-api[17780]: 2017-09-28 13:08:12.434 17780 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:08:12 ctl02 nova-api[17780]: 2017-09-28 13:08:12.434 17780 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:08:12 ctl02 nova-api[17780]: 2017-09-28 13:08:12.434 17780 ERROR nova     sock.listen(backlog)
Sep 28 13:08:12 ctl02 nova-api[17780]: 2017-09-28 13:08:12.434 17780 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:08:12 ctl02 nova-api[17780]: 2017-09-28 13:08:12.434 17780 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:08:12 ctl02 nova-api[17780]: 2017-09-28 13:08:12.434 17780 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:08:12 ctl02 nova-api[17780]: 2017-09-28 13:08:12.434 17780 ERROR nova
Sep 28 13:08:12 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:08:12 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:08:12 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:08:12 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:08:12 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:08:12 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:08:12 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:08:13 ctl02 neutron-server[30536]: 2017-09-28 13:08:13.544 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 13:08:13 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:08:13.941 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:08:13] "OPTIONS / HTTP/1.0" 200 134 0.000361
Sep 28 13:08:14 ctl02 heat-api[13008]: 2017-09-28 13:08:14.272 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:08:14] "OPTIONS / HTTP/1.0" 200 134 0.000559
Sep 28 13:08:14 ctl02 heat-api-cfn[13300]: 2017-09-28 13:08:14.383 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:08:14] "OPTIONS / HTTP/1.0" 200 134 0.000409
Sep 28 13:08:14 ctl02 nova-api[17798]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:08:14 ctl02 nova-api[17798]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:08:14 ctl02 neutron-server[30536]: 2017-09-28 13:08:14.648 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:08:14] "OPTIONS / HTTP/1.0" 200 262 0.000515
Sep 28 13:08:14 ctl02 nova-api[17798]: 2017-09-28 13:08:14.717 17798 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:08:14 ctl02 nova-api[17798]: 2017-09-28 13:08:14.718 17798 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:08:14 ctl02 nova-api[17798]: 2017-09-28 13:08:14.718 17798 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:08:14 ctl02 nova-api[17798]: 2017-09-28 13:08:14.718 17798 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:08:14 ctl02 nova-api[17798]: 2017-09-28 13:08:14.718 17798 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:08:14 ctl02 nova-api[17798]: 2017-09-28 13:08:14.718 17798 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:08:14 ctl02 nova-api[17798]: 2017-09-28 13:08:14.718 17798 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:08:14 ctl02 nova-api[17798]: 2017-09-28 13:08:14.718 17798 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:08:14 ctl02 nova-api[17798]: 2017-09-28 13:08:14.718 17798 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:08:14 ctl02 nova-api[17798]: 2017-09-28 13:08:14.718 17798 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:08:14 ctl02 nova-api[17798]: 2017-09-28 13:08:14.718 17798 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:08:14 ctl02 nova-api[17798]: 2017-09-28 13:08:14.718 17798 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:08:14 ctl02 nova-api[17798]: 2017-09-28 13:08:14.718 17798 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:08:14 ctl02 nova-api[17798]: 2017-09-28 13:08:14.718 17798 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:08:14 ctl02 nova-api[17798]: 2017-09-28 13:08:14.718 17798 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:08:14 ctl02 nova-api[17798]: 2017-09-28 13:08:14.718 17798 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:08:14 ctl02 nova-api[17798]: 2017-09-28 13:08:14.718 17798 ERROR nova.wsgi     self.filename))
Sep 28 13:08:14 ctl02 nova-api[17798]: 2017-09-28 13:08:14.718 17798 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:08:14 ctl02 nova-api[17798]: 2017-09-28 13:08:14.718 17798 ERROR nova.wsgi
Sep 28 13:08:14 ctl02 nova-api[17798]: 2017-09-28 13:08:14.719 17798 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:08:14 ctl02 nova-api[17798]: 2017-09-28 13:08:14.846 17798 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:08:15 ctl02 glance-api[29183]: 2017-09-28 13:08:15.066 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:08:15] "OPTIONS / HTTP/1.0" 200 134 0.000568
Sep 28 13:08:15 ctl02 nova-api[17798]: 2017-09-28 13:08:15.071 17798 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:08:15 ctl02 nova-api[17798]: 2017-09-28 13:08:15.073 17798 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:08:15 ctl02 nova-api[17798]: 2017-09-28 13:08:15.074 17798 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:08:15 ctl02 nova-api[17798]: 2017-09-28 13:08:15.074 17798 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:08:15 ctl02 nova-api[17798]: 2017-09-28 13:08:15.202 17798 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:08:15 ctl02 nova-api[17798]: 2017-09-28 13:08:15.204 17798 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:08:15 ctl02 nova-api[17798]: 2017-09-28 13:08:15.204 17798 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:08:15 ctl02 nova-api[17798]: 2017-09-28 13:08:15.204 17798 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:08:15 ctl02 nova-api[17798]: 2017-09-28 13:08:15.207 17798 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:08:15 ctl02 nova-api[17798]: 2017-09-28 13:08:15.208 17798 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:08:15 ctl02 nova-api[17798]: 2017-09-28 13:08:15.208 17798 ERROR nova Traceback (most recent call last):
Sep 28 13:08:15 ctl02 nova-api[17798]: 2017-09-28 13:08:15.208 17798 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:08:15 ctl02 nova-api[17798]: 2017-09-28 13:08:15.208 17798 ERROR nova     sys.exit(main())
Sep 28 13:08:15 ctl02 nova-api[17798]: 2017-09-28 13:08:15.208 17798 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:08:15 ctl02 nova-api[17798]: 2017-09-28 13:08:15.208 17798 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:08:15 ctl02 nova-api[17798]: 2017-09-28 13:08:15.208 17798 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:08:15 ctl02 nova-api[17798]: 2017-09-28 13:08:15.208 17798 ERROR nova     max_url_len=max_url_len)
Sep 28 13:08:15 ctl02 nova-api[17798]: 2017-09-28 13:08:15.208 17798 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:08:15 ctl02 nova-api[17798]: 2017-09-28 13:08:15.208 17798 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:08:15 ctl02 nova-api[17798]: 2017-09-28 13:08:15.208 17798 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:08:15 ctl02 nova-api[17798]: 2017-09-28 13:08:15.208 17798 ERROR nova     sock.listen(backlog)
Sep 28 13:08:15 ctl02 nova-api[17798]: 2017-09-28 13:08:15.208 17798 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:08:15 ctl02 nova-api[17798]: 2017-09-28 13:08:15.208 17798 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:08:15 ctl02 nova-api[17798]: 2017-09-28 13:08:15.208 17798 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:08:15 ctl02 nova-api[17798]: 2017-09-28 13:08:15.208 17798 ERROR nova
Sep 28 13:08:15 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:08:15 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:08:15 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:08:15 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:08:15 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:08:15 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:08:15 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:08:16 ctl02 heat-api-cfn[13300]: 2017-09-28 13:08:16.826 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:08:16] "OPTIONS / HTTP/1.0" 200 134 0.000418
Sep 28 13:08:17 ctl02 nova-api[17816]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:08:17 ctl02 nova-api[17816]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:08:17 ctl02 nova-api[17816]: 2017-09-28 13:08:17.468 17816 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:08:17 ctl02 nova-api[17816]: 2017-09-28 13:08:17.469 17816 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:08:17 ctl02 nova-api[17816]: 2017-09-28 13:08:17.469 17816 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:08:17 ctl02 nova-api[17816]: 2017-09-28 13:08:17.469 17816 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:08:17 ctl02 nova-api[17816]: 2017-09-28 13:08:17.469 17816 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:08:17 ctl02 nova-api[17816]: 2017-09-28 13:08:17.469 17816 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:08:17 ctl02 nova-api[17816]: 2017-09-28 13:08:17.469 17816 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:08:17 ctl02 nova-api[17816]: 2017-09-28 13:08:17.469 17816 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:08:17 ctl02 nova-api[17816]: 2017-09-28 13:08:17.469 17816 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:08:17 ctl02 nova-api[17816]: 2017-09-28 13:08:17.469 17816 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:08:17 ctl02 nova-api[17816]: 2017-09-28 13:08:17.469 17816 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:08:17 ctl02 nova-api[17816]: 2017-09-28 13:08:17.469 17816 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:08:17 ctl02 nova-api[17816]: 2017-09-28 13:08:17.469 17816 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:08:17 ctl02 nova-api[17816]: 2017-09-28 13:08:17.469 17816 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:08:17 ctl02 nova-api[17816]: 2017-09-28 13:08:17.469 17816 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:08:17 ctl02 nova-api[17816]: 2017-09-28 13:08:17.469 17816 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:08:17 ctl02 nova-api[17816]: 2017-09-28 13:08:17.469 17816 ERROR nova.wsgi     self.filename))
Sep 28 13:08:17 ctl02 nova-api[17816]: 2017-09-28 13:08:17.469 17816 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:08:17 ctl02 nova-api[17816]: 2017-09-28 13:08:17.469 17816 ERROR nova.wsgi
Sep 28 13:08:17 ctl02 nova-api[17816]: 2017-09-28 13:08:17.470 17816 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:08:17 ctl02 nova-api[17816]: 2017-09-28 13:08:17.597 17816 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:08:17 ctl02 nova-api[17816]: 2017-09-28 13:08:17.818 17816 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:08:17 ctl02 nova-api[17816]: 2017-09-28 13:08:17.820 17816 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:08:17 ctl02 nova-api[17816]: 2017-09-28 13:08:17.821 17816 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:08:17 ctl02 nova-api[17816]: 2017-09-28 13:08:17.821 17816 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:08:17 ctl02 nova-api[17816]: 2017-09-28 13:08:17.951 17816 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:08:17 ctl02 nova-api[17816]: 2017-09-28 13:08:17.952 17816 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:08:17 ctl02 nova-api[17816]: 2017-09-28 13:08:17.953 17816 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:08:17 ctl02 nova-api[17816]: 2017-09-28 13:08:17.953 17816 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:08:17 ctl02 nova-api[17816]: 2017-09-28 13:08:17.956 17816 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:08:17 ctl02 nova-api[17816]: 2017-09-28 13:08:17.956 17816 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:08:17 ctl02 nova-api[17816]: 2017-09-28 13:08:17.956 17816 ERROR nova Traceback (most recent call last):
Sep 28 13:08:17 ctl02 nova-api[17816]: 2017-09-28 13:08:17.956 17816 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:08:17 ctl02 nova-api[17816]: 2017-09-28 13:08:17.956 17816 ERROR nova     sys.exit(main())
Sep 28 13:08:17 ctl02 nova-api[17816]: 2017-09-28 13:08:17.956 17816 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:08:17 ctl02 nova-api[17816]: 2017-09-28 13:08:17.956 17816 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:08:17 ctl02 nova-api[17816]: 2017-09-28 13:08:17.956 17816 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:08:17 ctl02 nova-api[17816]: 2017-09-28 13:08:17.956 17816 ERROR nova     max_url_len=max_url_len)
Sep 28 13:08:17 ctl02 nova-api[17816]: 2017-09-28 13:08:17.956 17816 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:08:17 ctl02 nova-api[17816]: 2017-09-28 13:08:17.956 17816 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:08:17 ctl02 nova-api[17816]: 2017-09-28 13:08:17.956 17816 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:08:17 ctl02 nova-api[17816]: 2017-09-28 13:08:17.956 17816 ERROR nova     sock.listen(backlog)
Sep 28 13:08:17 ctl02 nova-api[17816]: 2017-09-28 13:08:17.956 17816 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:08:17 ctl02 nova-api[17816]: 2017-09-28 13:08:17.956 17816 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:08:17 ctl02 nova-api[17816]: 2017-09-28 13:08:17.956 17816 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:08:17 ctl02 nova-api[17816]: 2017-09-28 13:08:17.956 17816 ERROR nova
Sep 28 13:08:18 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:08:18 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:08:18 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:08:18 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:08:18 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:08:18 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:08:18 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:08:18 ctl02 neutron-server[30536]: 2017-09-28 13:08:18.550 30594 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:08:18] "OPTIONS / HTTP/1.0" 200 262 0.000498
Sep 28 13:08:18 ctl02 heat-api[13008]: 2017-09-28 13:08:18.668 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:08:18] "OPTIONS / HTTP/1.0" 200 134 0.000601
Sep 28 13:08:18 ctl02 heat-api-cfn[13300]: 2017-09-28 13:08:18.994 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:08:18] "OPTIONS / HTTP/1.0" 200 134 0.000450
Sep 28 13:08:19 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:08:19.151 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:08:19] "OPTIONS / HTTP/1.0" 200 134 0.000365
Sep 28 13:08:19 ctl02 heat-api[13008]: 2017-09-28 13:08:19.248 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:08:19] "OPTIONS / HTTP/1.0" 200 134 0.000770
Sep 28 13:08:20 ctl02 nova-api[17835]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:08:20 ctl02 nova-api[17835]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:08:20 ctl02 nova-api[17835]: 2017-09-28 13:08:20.244 17835 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:08:20 ctl02 nova-api[17835]: 2017-09-28 13:08:20.245 17835 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:08:20 ctl02 nova-api[17835]: 2017-09-28 13:08:20.245 17835 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:08:20 ctl02 nova-api[17835]: 2017-09-28 13:08:20.245 17835 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:08:20 ctl02 nova-api[17835]: 2017-09-28 13:08:20.245 17835 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:08:20 ctl02 nova-api[17835]: 2017-09-28 13:08:20.245 17835 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:08:20 ctl02 nova-api[17835]: 2017-09-28 13:08:20.245 17835 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:08:20 ctl02 nova-api[17835]: 2017-09-28 13:08:20.245 17835 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:08:20 ctl02 nova-api[17835]: 2017-09-28 13:08:20.245 17835 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:08:20 ctl02 nova-api[17835]: 2017-09-28 13:08:20.245 17835 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:08:20 ctl02 nova-api[17835]: 2017-09-28 13:08:20.245 17835 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:08:20 ctl02 nova-api[17835]: 2017-09-28 13:08:20.245 17835 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:08:20 ctl02 nova-api[17835]: 2017-09-28 13:08:20.245 17835 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:08:20 ctl02 nova-api[17835]: 2017-09-28 13:08:20.245 17835 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:08:20 ctl02 nova-api[17835]: 2017-09-28 13:08:20.245 17835 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:08:20 ctl02 nova-api[17835]: 2017-09-28 13:08:20.245 17835 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:08:20 ctl02 nova-api[17835]: 2017-09-28 13:08:20.245 17835 ERROR nova.wsgi     self.filename))
Sep 28 13:08:20 ctl02 nova-api[17835]: 2017-09-28 13:08:20.245 17835 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:08:20 ctl02 nova-api[17835]: 2017-09-28 13:08:20.245 17835 ERROR nova.wsgi
Sep 28 13:08:20 ctl02 nova-api[17835]: 2017-09-28 13:08:20.246 17835 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:08:20 ctl02 glance-api[29183]: 2017-09-28 13:08:20.288 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:08:20] "OPTIONS / HTTP/1.0" 200 134 0.000539
Sep 28 13:08:20 ctl02 nova-api[17835]: 2017-09-28 13:08:20.378 17835 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:08:20 ctl02 nova-api[17835]: 2017-09-28 13:08:20.603 17835 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:08:20 ctl02 nova-api[17835]: 2017-09-28 13:08:20.606 17835 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:08:20 ctl02 nova-api[17835]: 2017-09-28 13:08:20.606 17835 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:08:20 ctl02 nova-api[17835]: 2017-09-28 13:08:20.606 17835 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:08:20 ctl02 nova-api[17835]: 2017-09-28 13:08:20.739 17835 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:08:20 ctl02 nova-api[17835]: 2017-09-28 13:08:20.741 17835 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:08:20 ctl02 nova-api[17835]: 2017-09-28 13:08:20.741 17835 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:08:20 ctl02 nova-api[17835]: 2017-09-28 13:08:20.741 17835 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:08:20 ctl02 nova-api[17835]: 2017-09-28 13:08:20.744 17835 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:08:20 ctl02 nova-api[17835]: 2017-09-28 13:08:20.745 17835 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:08:20 ctl02 nova-api[17835]: 2017-09-28 13:08:20.745 17835 ERROR nova Traceback (most recent call last):
Sep 28 13:08:20 ctl02 nova-api[17835]: 2017-09-28 13:08:20.745 17835 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:08:20 ctl02 nova-api[17835]: 2017-09-28 13:08:20.745 17835 ERROR nova     sys.exit(main())
Sep 28 13:08:20 ctl02 nova-api[17835]: 2017-09-28 13:08:20.745 17835 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:08:20 ctl02 nova-api[17835]: 2017-09-28 13:08:20.745 17835 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:08:20 ctl02 nova-api[17835]: 2017-09-28 13:08:20.745 17835 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:08:20 ctl02 nova-api[17835]: 2017-09-28 13:08:20.745 17835 ERROR nova     max_url_len=max_url_len)
Sep 28 13:08:20 ctl02 nova-api[17835]: 2017-09-28 13:08:20.745 17835 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:08:20 ctl02 nova-api[17835]: 2017-09-28 13:08:20.745 17835 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:08:20 ctl02 nova-api[17835]: 2017-09-28 13:08:20.745 17835 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:08:20 ctl02 nova-api[17835]: 2017-09-28 13:08:20.745 17835 ERROR nova     sock.listen(backlog)
Sep 28 13:08:20 ctl02 nova-api[17835]: 2017-09-28 13:08:20.745 17835 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:08:20 ctl02 nova-api[17835]: 2017-09-28 13:08:20.745 17835 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:08:20 ctl02 nova-api[17835]: 2017-09-28 13:08:20.745 17835 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:08:20 ctl02 nova-api[17835]: 2017-09-28 13:08:20.745 17835 ERROR nova
Sep 28 13:08:20 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:08:20 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:08:20 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:08:20 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:08:20.912 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:08:20] "OPTIONS / HTTP/1.0" 200 134 0.000394
Sep 28 13:08:20 ctl02 neutron-server[30536]: 2017-09-28 13:08:20.971 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 4 dead agents out of 6:
Sep 28 13:08:20 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 13:08:20 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 13:07:06 cmp002
Sep 28 13:08:20 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 13:07:08 cmp001
Sep 28 13:08:20 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 13:06:40 cmp002
Sep 28 13:08:20 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 13:07:36 cmp002
Sep 28 13:08:21 ctl02 neutron-server[30536]: 2017-09-28 13:08:21.046 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:08:21] "OPTIONS / HTTP/1.0" 200 262 0.000603
Sep 28 13:08:21 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:08:21 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:08:21 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:08:21 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:08:22 ctl02 glance-api[29183]: 2017-09-28 13:08:22.735 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:08:22] "OPTIONS / HTTP/1.0" 200 134 0.000551
Sep 28 13:08:22 ctl02 nova-api[17852]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:08:22 ctl02 nova-api[17852]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:08:22 ctl02 nova-api[17852]: 2017-09-28 13:08:22.984 17852 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:08:22 ctl02 nova-api[17852]: 2017-09-28 13:08:22.985 17852 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:08:22 ctl02 nova-api[17852]: 2017-09-28 13:08:22.985 17852 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:08:22 ctl02 nova-api[17852]: 2017-09-28 13:08:22.985 17852 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:08:22 ctl02 nova-api[17852]: 2017-09-28 13:08:22.985 17852 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:08:22 ctl02 nova-api[17852]: 2017-09-28 13:08:22.985 17852 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:08:22 ctl02 nova-api[17852]: 2017-09-28 13:08:22.985 17852 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:08:22 ctl02 nova-api[17852]: 2017-09-28 13:08:22.985 17852 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:08:22 ctl02 nova-api[17852]: 2017-09-28 13:08:22.985 17852 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:08:22 ctl02 nova-api[17852]: 2017-09-28 13:08:22.985 17852 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:08:22 ctl02 nova-api[17852]: 2017-09-28 13:08:22.985 17852 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:08:22 ctl02 nova-api[17852]: 2017-09-28 13:08:22.985 17852 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:08:22 ctl02 nova-api[17852]: 2017-09-28 13:08:22.985 17852 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:08:22 ctl02 nova-api[17852]: 2017-09-28 13:08:22.985 17852 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:08:22 ctl02 nova-api[17852]: 2017-09-28 13:08:22.985 17852 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:08:22 ctl02 nova-api[17852]: 2017-09-28 13:08:22.985 17852 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:08:22 ctl02 nova-api[17852]: 2017-09-28 13:08:22.985 17852 ERROR nova.wsgi     self.filename))
Sep 28 13:08:22 ctl02 nova-api[17852]: 2017-09-28 13:08:22.985 17852 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:08:22 ctl02 nova-api[17852]: 2017-09-28 13:08:22.985 17852 ERROR nova.wsgi
Sep 28 13:08:22 ctl02 nova-api[17852]: 2017-09-28 13:08:22.986 17852 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:08:23 ctl02 nova-api[17852]: 2017-09-28 13:08:23.112 17852 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:08:23 ctl02 nova-api[17852]: 2017-09-28 13:08:23.335 17852 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:08:23 ctl02 nova-api[17852]: 2017-09-28 13:08:23.337 17852 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:08:23 ctl02 nova-api[17852]: 2017-09-28 13:08:23.338 17852 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:08:23 ctl02 nova-api[17852]: 2017-09-28 13:08:23.338 17852 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:08:23 ctl02 nova-conductor[5056]: 2017-09-28 13:08:23.404 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:08:23 ctl02 nova-conductor[5056]: 2017-09-28 13:08:23.404 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:08:23 ctl02 nova-conductor[5056]: 2017-09-28 13:08:23.412 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:08:23 ctl02 nova-conductor[5056]: 2017-09-28 13:08:23.414 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:08:23 ctl02 nova-api[17852]: 2017-09-28 13:08:23.468 17852 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:08:23 ctl02 nova-api[17852]: 2017-09-28 13:08:23.470 17852 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:08:23 ctl02 nova-api[17852]: 2017-09-28 13:08:23.470 17852 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:08:23 ctl02 nova-api[17852]: 2017-09-28 13:08:23.470 17852 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:08:23 ctl02 nova-api[17852]: 2017-09-28 13:08:23.473 17852 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:08:23 ctl02 nova-api[17852]: 2017-09-28 13:08:23.474 17852 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:08:23 ctl02 nova-api[17852]: 2017-09-28 13:08:23.474 17852 ERROR nova Traceback (most recent call last):
Sep 28 13:08:23 ctl02 nova-api[17852]: 2017-09-28 13:08:23.474 17852 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:08:23 ctl02 nova-api[17852]: 2017-09-28 13:08:23.474 17852 ERROR nova     sys.exit(main())
Sep 28 13:08:23 ctl02 nova-api[17852]: 2017-09-28 13:08:23.474 17852 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:08:23 ctl02 nova-api[17852]: 2017-09-28 13:08:23.474 17852 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:08:23 ctl02 nova-api[17852]: 2017-09-28 13:08:23.474 17852 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:08:23 ctl02 nova-api[17852]: 2017-09-28 13:08:23.474 17852 ERROR nova     max_url_len=max_url_len)
Sep 28 13:08:23 ctl02 nova-api[17852]: 2017-09-28 13:08:23.474 17852 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:08:23 ctl02 nova-api[17852]: 2017-09-28 13:08:23.474 17852 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:08:23 ctl02 nova-api[17852]: 2017-09-28 13:08:23.474 17852 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:08:23 ctl02 nova-api[17852]: 2017-09-28 13:08:23.474 17852 ERROR nova     sock.listen(backlog)
Sep 28 13:08:23 ctl02 nova-api[17852]: 2017-09-28 13:08:23.474 17852 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:08:23 ctl02 nova-api[17852]: 2017-09-28 13:08:23.474 17852 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:08:23 ctl02 nova-api[17852]: 2017-09-28 13:08:23.474 17852 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:08:23 ctl02 nova-api[17852]: 2017-09-28 13:08:23.474 17852 ERROR nova
Sep 28 13:08:23 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:08:23 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:08:23 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:08:23 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:08:23.834 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:08:23] "OPTIONS / HTTP/1.0" 200 134 0.000499
Sep 28 13:08:23 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:08:23 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:08:23 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:08:23 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:08:24 ctl02 heat-api[13008]: 2017-09-28 13:08:24.043 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:08:24] "OPTIONS / HTTP/1.0" 200 134 0.000577
Sep 28 13:08:24 ctl02 heat-api-cfn[13300]: 2017-09-28 13:08:24.186 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:08:24] "OPTIONS / HTTP/1.0" 200 134 0.000471
Sep 28 13:08:24 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd7129d79)
Sep 28 13:08:24 ctl02 nova-cert[4860]: 2017-09-28 13:08:24.389 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:08:24 ctl02 neutron-server[30536]: 2017-09-28 13:08:24.606 30594 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:08:24] "OPTIONS / HTTP/1.0" 200 262 0.000460
Sep 28 13:08:24 ctl02 glance-api[29183]: 2017-09-28 13:08:24.786 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:08:24] "OPTIONS / HTTP/1.0" 200 134 0.000607
Sep 28 13:08:25 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd7129d79)
Sep 28 13:08:25 ctl02 nova-api[17871]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:08:25 ctl02 nova-api[17871]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:08:25 ctl02 nova-api[17871]: 2017-09-28 13:08:25.733 17871 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:08:25 ctl02 nova-api[17871]: 2017-09-28 13:08:25.734 17871 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:08:25 ctl02 nova-api[17871]: 2017-09-28 13:08:25.734 17871 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:08:25 ctl02 nova-api[17871]: 2017-09-28 13:08:25.734 17871 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:08:25 ctl02 nova-api[17871]: 2017-09-28 13:08:25.734 17871 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:08:25 ctl02 nova-api[17871]: 2017-09-28 13:08:25.734 17871 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:08:25 ctl02 nova-api[17871]: 2017-09-28 13:08:25.734 17871 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:08:25 ctl02 nova-api[17871]: 2017-09-28 13:08:25.734 17871 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:08:25 ctl02 nova-api[17871]: 2017-09-28 13:08:25.734 17871 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:08:25 ctl02 nova-api[17871]: 2017-09-28 13:08:25.734 17871 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:08:25 ctl02 nova-api[17871]: 2017-09-28 13:08:25.734 17871 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:08:25 ctl02 nova-api[17871]: 2017-09-28 13:08:25.734 17871 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:08:25 ctl02 nova-api[17871]: 2017-09-28 13:08:25.734 17871 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:08:25 ctl02 nova-api[17871]: 2017-09-28 13:08:25.734 17871 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:08:25 ctl02 nova-api[17871]: 2017-09-28 13:08:25.734 17871 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:08:25 ctl02 nova-api[17871]: 2017-09-28 13:08:25.734 17871 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:08:25 ctl02 nova-api[17871]: 2017-09-28 13:08:25.734 17871 ERROR nova.wsgi     self.filename))
Sep 28 13:08:25 ctl02 nova-api[17871]: 2017-09-28 13:08:25.734 17871 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:08:25 ctl02 nova-api[17871]: 2017-09-28 13:08:25.734 17871 ERROR nova.wsgi
Sep 28 13:08:25 ctl02 nova-api[17871]: 2017-09-28 13:08:25.735 17871 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:08:25 ctl02 nova-api[17871]: 2017-09-28 13:08:25.865 17871 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:08:26 ctl02 nova-api[17871]: 2017-09-28 13:08:26.085 17871 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:08:26 ctl02 nova-api[17871]: 2017-09-28 13:08:26.087 17871 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:08:26 ctl02 nova-api[17871]: 2017-09-28 13:08:26.087 17871 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:08:26 ctl02 nova-api[17871]: 2017-09-28 13:08:26.087 17871 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:08:26 ctl02 nova-api[17871]: 2017-09-28 13:08:26.217 17871 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:08:26 ctl02 nova-api[17871]: 2017-09-28 13:08:26.219 17871 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:08:26 ctl02 nova-api[17871]: 2017-09-28 13:08:26.219 17871 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:08:26 ctl02 nova-api[17871]: 2017-09-28 13:08:26.219 17871 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:08:26 ctl02 nova-api[17871]: 2017-09-28 13:08:26.223 17871 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:08:26 ctl02 nova-api[17871]: 2017-09-28 13:08:26.223 17871 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:08:26 ctl02 nova-api[17871]: 2017-09-28 13:08:26.223 17871 ERROR nova Traceback (most recent call last):
Sep 28 13:08:26 ctl02 nova-api[17871]: 2017-09-28 13:08:26.223 17871 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:08:26 ctl02 nova-api[17871]: 2017-09-28 13:08:26.223 17871 ERROR nova     sys.exit(main())
Sep 28 13:08:26 ctl02 nova-api[17871]: 2017-09-28 13:08:26.223 17871 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:08:26 ctl02 nova-api[17871]: 2017-09-28 13:08:26.223 17871 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:08:26 ctl02 nova-api[17871]: 2017-09-28 13:08:26.223 17871 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:08:26 ctl02 nova-api[17871]: 2017-09-28 13:08:26.223 17871 ERROR nova     max_url_len=max_url_len)
Sep 28 13:08:26 ctl02 nova-api[17871]: 2017-09-28 13:08:26.223 17871 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:08:26 ctl02 nova-api[17871]: 2017-09-28 13:08:26.223 17871 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:08:26 ctl02 nova-api[17871]: 2017-09-28 13:08:26.223 17871 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:08:26 ctl02 nova-api[17871]: 2017-09-28 13:08:26.223 17871 ERROR nova     sock.listen(backlog)
Sep 28 13:08:26 ctl02 nova-api[17871]: 2017-09-28 13:08:26.223 17871 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:08:26 ctl02 nova-api[17871]: 2017-09-28 13:08:26.223 17871 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:08:26 ctl02 nova-api[17871]: 2017-09-28 13:08:26.223 17871 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:08:26 ctl02 nova-api[17871]: 2017-09-28 13:08:26.223 17871 ERROR nova
Sep 28 13:08:26 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd7129d79)
Sep 28 13:08:26 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:08:26 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:08:26 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:08:26 ctl02 heat-api-cfn[13300]: 2017-09-28 13:08:26.579 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:08:26] "OPTIONS / HTTP/1.0" 200 134 0.000515
Sep 28 13:08:26 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:08:26 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:08:26 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:08:26 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:08:27 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd7129d79)
Sep 28 13:08:28 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd7129d79)
Sep 28 13:08:28 ctl02 nova-api[17888]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:08:28 ctl02 nova-api[17888]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:08:28 ctl02 heat-api[13008]: 2017-09-28 13:08:28.422 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:08:28] "OPTIONS / HTTP/1.0" 200 134 0.000539
Sep 28 13:08:28 ctl02 nova-api[17888]: 2017-09-28 13:08:28.493 17888 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:08:28 ctl02 nova-api[17888]: 2017-09-28 13:08:28.494 17888 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:08:28 ctl02 nova-api[17888]: 2017-09-28 13:08:28.494 17888 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:08:28 ctl02 nova-api[17888]: 2017-09-28 13:08:28.494 17888 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:08:28 ctl02 nova-api[17888]: 2017-09-28 13:08:28.494 17888 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:08:28 ctl02 nova-api[17888]: 2017-09-28 13:08:28.494 17888 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:08:28 ctl02 nova-api[17888]: 2017-09-28 13:08:28.494 17888 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:08:28 ctl02 nova-api[17888]: 2017-09-28 13:08:28.494 17888 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:08:28 ctl02 nova-api[17888]: 2017-09-28 13:08:28.494 17888 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:08:28 ctl02 nova-api[17888]: 2017-09-28 13:08:28.494 17888 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:08:28 ctl02 nova-api[17888]: 2017-09-28 13:08:28.494 17888 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:08:28 ctl02 nova-api[17888]: 2017-09-28 13:08:28.494 17888 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:08:28 ctl02 nova-api[17888]: 2017-09-28 13:08:28.494 17888 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:08:28 ctl02 nova-api[17888]: 2017-09-28 13:08:28.494 17888 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:08:28 ctl02 nova-api[17888]: 2017-09-28 13:08:28.494 17888 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:08:28 ctl02 nova-api[17888]: 2017-09-28 13:08:28.494 17888 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:08:28 ctl02 nova-api[17888]: 2017-09-28 13:08:28.494 17888 ERROR nova.wsgi     self.filename))
Sep 28 13:08:28 ctl02 nova-api[17888]: 2017-09-28 13:08:28.494 17888 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:08:28 ctl02 nova-api[17888]: 2017-09-28 13:08:28.494 17888 ERROR nova.wsgi
Sep 28 13:08:28 ctl02 nova-api[17888]: 2017-09-28 13:08:28.495 17888 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:08:28 ctl02 neutron-server[30536]: 2017-09-28 13:08:28.555 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 13:08:28 ctl02 neutron-server[30536]: 2017-09-28 13:08:28.604 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:08:28] "OPTIONS / HTTP/1.0" 200 262 0.000561
Sep 28 13:08:28 ctl02 nova-api[17888]: 2017-09-28 13:08:28.630 17888 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:08:28 ctl02 nova-api[17888]: 2017-09-28 13:08:28.854 17888 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:08:28 ctl02 nova-api[17888]: 2017-09-28 13:08:28.857 17888 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:08:28 ctl02 nova-api[17888]: 2017-09-28 13:08:28.857 17888 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:08:28 ctl02 nova-api[17888]: 2017-09-28 13:08:28.857 17888 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:08:28 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:08:28.969 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:08:28] "OPTIONS / HTTP/1.0" 200 134 0.000531
Sep 28 13:08:28 ctl02 nova-api[17888]: 2017-09-28 13:08:28.990 17888 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:08:28 ctl02 nova-api[17888]: 2017-09-28 13:08:28.992 17888 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:08:28 ctl02 nova-api[17888]: 2017-09-28 13:08:28.992 17888 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:08:28 ctl02 nova-api[17888]: 2017-09-28 13:08:28.993 17888 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:08:28 ctl02 nova-api[17888]: 2017-09-28 13:08:28.996 17888 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:08:28 ctl02 nova-api[17888]: 2017-09-28 13:08:28.997 17888 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:08:28 ctl02 nova-api[17888]: 2017-09-28 13:08:28.997 17888 ERROR nova Traceback (most recent call last):
Sep 28 13:08:28 ctl02 nova-api[17888]: 2017-09-28 13:08:28.997 17888 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:08:28 ctl02 nova-api[17888]: 2017-09-28 13:08:28.997 17888 ERROR nova     sys.exit(main())
Sep 28 13:08:28 ctl02 nova-api[17888]: 2017-09-28 13:08:28.997 17888 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:08:28 ctl02 nova-api[17888]: 2017-09-28 13:08:28.997 17888 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:08:28 ctl02 nova-api[17888]: 2017-09-28 13:08:28.997 17888 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:08:28 ctl02 nova-api[17888]: 2017-09-28 13:08:28.997 17888 ERROR nova     max_url_len=max_url_len)
Sep 28 13:08:28 ctl02 nova-api[17888]: 2017-09-28 13:08:28.997 17888 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:08:28 ctl02 nova-api[17888]: 2017-09-28 13:08:28.997 17888 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:08:28 ctl02 nova-api[17888]: 2017-09-28 13:08:28.997 17888 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:08:28 ctl02 nova-api[17888]: 2017-09-28 13:08:28.997 17888 ERROR nova     sock.listen(backlog)
Sep 28 13:08:28 ctl02 nova-api[17888]: 2017-09-28 13:08:28.997 17888 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:08:28 ctl02 nova-api[17888]: 2017-09-28 13:08:28.997 17888 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:08:28 ctl02 nova-api[17888]: 2017-09-28 13:08:28.997 17888 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:08:28 ctl02 nova-api[17888]: 2017-09-28 13:08:28.997 17888 ERROR nova
Sep 28 13:08:29 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:08:29 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:08:29 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:08:29 ctl02 heat-api-cfn[13300]: 2017-09-28 13:08:29.202 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:08:29] "OPTIONS / HTTP/1.0" 200 134 0.000487
Sep 28 13:08:29 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd7129d79)
Sep 28 13:08:29 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:08:29 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:08:29 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:08:29 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:08:29 ctl02 heat-api[13008]: 2017-09-28 13:08:29.557 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:08:29] "OPTIONS / HTTP/1.0" 200 134 0.000542
Sep 28 13:08:30 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd7129d79)
Sep 28 13:08:30 ctl02 glance-api[29183]: 2017-09-28 13:08:30.659 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:08:30] "OPTIONS / HTTP/1.0" 200 134 0.000568
Sep 28 13:08:30 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:08:30.678 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:08:30] "OPTIONS / HTTP/1.0" 200 134 0.000354
Sep 28 13:08:30 ctl02 neutron-server[30536]: 2017-09-28 13:08:30.848 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:08:30] "OPTIONS / HTTP/1.0" 200 262 0.000459
Sep 28 13:08:31 ctl02 nova-api[17907]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:08:31 ctl02 nova-api[17907]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:08:31 ctl02 nova-api[17907]: 2017-09-28 13:08:31.233 17907 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:08:31 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd7129d79)
Sep 28 13:08:31 ctl02 nova-api[17907]: 2017-09-28 13:08:31.234 17907 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:08:31 ctl02 nova-api[17907]: 2017-09-28 13:08:31.234 17907 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:08:31 ctl02 nova-api[17907]: 2017-09-28 13:08:31.234 17907 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:08:31 ctl02 nova-api[17907]: 2017-09-28 13:08:31.234 17907 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:08:31 ctl02 nova-api[17907]: 2017-09-28 13:08:31.234 17907 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:08:31 ctl02 nova-api[17907]: 2017-09-28 13:08:31.234 17907 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:08:31 ctl02 nova-api[17907]: 2017-09-28 13:08:31.234 17907 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:08:31 ctl02 nova-api[17907]: 2017-09-28 13:08:31.234 17907 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:08:31 ctl02 nova-api[17907]: 2017-09-28 13:08:31.234 17907 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:08:31 ctl02 nova-api[17907]: 2017-09-28 13:08:31.234 17907 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:08:31 ctl02 nova-api[17907]: 2017-09-28 13:08:31.234 17907 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:08:31 ctl02 nova-api[17907]: 2017-09-28 13:08:31.234 17907 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:08:31 ctl02 nova-api[17907]: 2017-09-28 13:08:31.234 17907 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:08:31 ctl02 nova-api[17907]: 2017-09-28 13:08:31.234 17907 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:08:31 ctl02 nova-api[17907]: 2017-09-28 13:08:31.234 17907 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:08:31 ctl02 nova-api[17907]: 2017-09-28 13:08:31.234 17907 ERROR nova.wsgi     self.filename))
Sep 28 13:08:31 ctl02 nova-api[17907]: 2017-09-28 13:08:31.234 17907 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:08:31 ctl02 nova-api[17907]: 2017-09-28 13:08:31.234 17907 ERROR nova.wsgi
Sep 28 13:08:31 ctl02 nova-api[17907]: 2017-09-28 13:08:31.235 17907 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:08:31 ctl02 nova-api[17907]: 2017-09-28 13:08:31.364 17907 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:08:31 ctl02 nova-api[17907]: 2017-09-28 13:08:31.586 17907 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:08:31 ctl02 nova-api[17907]: 2017-09-28 13:08:31.588 17907 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:08:31 ctl02 nova-api[17907]: 2017-09-28 13:08:31.588 17907 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:08:31 ctl02 nova-api[17907]: 2017-09-28 13:08:31.588 17907 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:08:31 ctl02 nova-api[17907]: 2017-09-28 13:08:31.720 17907 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:08:31 ctl02 nova-api[17907]: 2017-09-28 13:08:31.722 17907 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:08:31 ctl02 nova-api[17907]: 2017-09-28 13:08:31.722 17907 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:08:31 ctl02 nova-api[17907]: 2017-09-28 13:08:31.723 17907 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:08:31 ctl02 nova-api[17907]: 2017-09-28 13:08:31.726 17907 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:08:31 ctl02 nova-api[17907]: 2017-09-28 13:08:31.727 17907 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:08:31 ctl02 nova-api[17907]: 2017-09-28 13:08:31.727 17907 ERROR nova Traceback (most recent call last):
Sep 28 13:08:31 ctl02 nova-api[17907]: 2017-09-28 13:08:31.727 17907 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:08:31 ctl02 nova-api[17907]: 2017-09-28 13:08:31.727 17907 ERROR nova     sys.exit(main())
Sep 28 13:08:31 ctl02 nova-api[17907]: 2017-09-28 13:08:31.727 17907 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:08:31 ctl02 nova-api[17907]: 2017-09-28 13:08:31.727 17907 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:08:31 ctl02 nova-api[17907]: 2017-09-28 13:08:31.727 17907 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:08:31 ctl02 nova-api[17907]: 2017-09-28 13:08:31.727 17907 ERROR nova     max_url_len=max_url_len)
Sep 28 13:08:31 ctl02 nova-api[17907]: 2017-09-28 13:08:31.727 17907 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:08:31 ctl02 nova-api[17907]: 2017-09-28 13:08:31.727 17907 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:08:31 ctl02 nova-api[17907]: 2017-09-28 13:08:31.727 17907 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:08:31 ctl02 nova-api[17907]: 2017-09-28 13:08:31.727 17907 ERROR nova     sock.listen(backlog)
Sep 28 13:08:31 ctl02 nova-api[17907]: 2017-09-28 13:08:31.727 17907 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:08:31 ctl02 nova-api[17907]: 2017-09-28 13:08:31.727 17907 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:08:31 ctl02 nova-api[17907]: 2017-09-28 13:08:31.727 17907 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:08:31 ctl02 nova-api[17907]: 2017-09-28 13:08:31.727 17907 ERROR nova
Sep 28 13:08:31 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:08:31 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:08:31 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:08:32 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:08:32 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:08:32 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:08:32 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:08:32 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd7129d79)
Sep 28 13:08:32 ctl02 glance-api[29183]: 2017-09-28 13:08:32.702 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:08:32] "OPTIONS / HTTP/1.0" 200 134 0.001082
Sep 28 13:08:33 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd7129d79)
Sep 28 13:08:33 ctl02 nova-api[17924]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:08:33 ctl02 nova-api[17924]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:08:34 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:08:34.001 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:08:34] "OPTIONS / HTTP/1.0" 200 134 0.000469
Sep 28 13:08:34 ctl02 nova-api[17924]: 2017-09-28 13:08:34.041 17924 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:08:34 ctl02 nova-api[17924]: 2017-09-28 13:08:34.042 17924 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:08:34 ctl02 nova-api[17924]: 2017-09-28 13:08:34.042 17924 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:08:34 ctl02 nova-api[17924]: 2017-09-28 13:08:34.042 17924 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:08:34 ctl02 nova-api[17924]: 2017-09-28 13:08:34.042 17924 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:08:34 ctl02 nova-api[17924]: 2017-09-28 13:08:34.042 17924 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:08:34 ctl02 nova-api[17924]: 2017-09-28 13:08:34.042 17924 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:08:34 ctl02 nova-api[17924]: 2017-09-28 13:08:34.042 17924 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:08:34 ctl02 nova-api[17924]: 2017-09-28 13:08:34.042 17924 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:08:34 ctl02 nova-api[17924]: 2017-09-28 13:08:34.042 17924 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:08:34 ctl02 nova-api[17924]: 2017-09-28 13:08:34.042 17924 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:08:34 ctl02 nova-api[17924]: 2017-09-28 13:08:34.042 17924 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:08:34 ctl02 nova-api[17924]: 2017-09-28 13:08:34.042 17924 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:08:34 ctl02 nova-api[17924]: 2017-09-28 13:08:34.042 17924 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:08:34 ctl02 nova-api[17924]: 2017-09-28 13:08:34.042 17924 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:08:34 ctl02 nova-api[17924]: 2017-09-28 13:08:34.042 17924 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:08:34 ctl02 nova-api[17924]: 2017-09-28 13:08:34.042 17924 ERROR nova.wsgi     self.filename))
Sep 28 13:08:34 ctl02 nova-api[17924]: 2017-09-28 13:08:34.042 17924 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:08:34 ctl02 nova-api[17924]: 2017-09-28 13:08:34.042 17924 ERROR nova.wsgi
Sep 28 13:08:34 ctl02 nova-api[17924]: 2017-09-28 13:08:34.043 17924 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:08:34 ctl02 heat-api-cfn[13300]: 2017-09-28 13:08:34.167 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:08:34] "OPTIONS / HTTP/1.0" 200 134 0.000509
Sep 28 13:08:34 ctl02 nova-api[17924]: 2017-09-28 13:08:34.175 17924 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:08:34 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd7129d79)
Sep 28 13:08:34 ctl02 nova-consoleauth[5433]: 2017-09-28 13:08:34.241 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:08:34 ctl02 heat-api[13008]: 2017-09-28 13:08:34.258 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:08:34] "OPTIONS / HTTP/1.0" 200 134 0.000647
Sep 28 13:08:34 ctl02 nova-api[17924]: 2017-09-28 13:08:34.422 17924 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:08:34 ctl02 nova-api[17924]: 2017-09-28 13:08:34.424 17924 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:08:34 ctl02 nova-api[17924]: 2017-09-28 13:08:34.424 17924 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:08:34 ctl02 nova-api[17924]: 2017-09-28 13:08:34.424 17924 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:08:34 ctl02 heat-engine[12803]: 2017-09-28 13:08:34.520 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:08:34 ctl02 neutron-server[30536]: 2017-09-28 13:08:34.530 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:08:34] "OPTIONS / HTTP/1.0" 200 262 0.000569
Sep 28 13:08:34 ctl02 heat-engine[12803]: 2017-09-28 13:08:34.537 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:08:34 ctl02 heat-engine[12803]: 2017-09-28 13:08:34.546 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:08:34 ctl02 heat-engine[12803]: 2017-09-28 13:08:34.549 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:08:34 ctl02 nova-api[17924]: 2017-09-28 13:08:34.575 17924 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:08:34 ctl02 nova-api[17924]: 2017-09-28 13:08:34.577 17924 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:08:34 ctl02 nova-api[17924]: 2017-09-28 13:08:34.577 17924 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:08:34 ctl02 nova-api[17924]: 2017-09-28 13:08:34.578 17924 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:08:34 ctl02 nova-api[17924]: 2017-09-28 13:08:34.581 17924 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:08:34 ctl02 nova-api[17924]: 2017-09-28 13:08:34.581 17924 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:08:34 ctl02 nova-api[17924]: 2017-09-28 13:08:34.581 17924 ERROR nova Traceback (most recent call last):
Sep 28 13:08:34 ctl02 nova-api[17924]: 2017-09-28 13:08:34.581 17924 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:08:34 ctl02 nova-api[17924]: 2017-09-28 13:08:34.581 17924 ERROR nova     sys.exit(main())
Sep 28 13:08:34 ctl02 nova-api[17924]: 2017-09-28 13:08:34.581 17924 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:08:34 ctl02 nova-api[17924]: 2017-09-28 13:08:34.581 17924 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:08:34 ctl02 nova-api[17924]: 2017-09-28 13:08:34.581 17924 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:08:34 ctl02 nova-api[17924]: 2017-09-28 13:08:34.581 17924 ERROR nova     max_url_len=max_url_len)
Sep 28 13:08:34 ctl02 nova-api[17924]: 2017-09-28 13:08:34.581 17924 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:08:34 ctl02 nova-api[17924]: 2017-09-28 13:08:34.581 17924 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:08:34 ctl02 nova-api[17924]: 2017-09-28 13:08:34.581 17924 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:08:34 ctl02 nova-api[17924]: 2017-09-28 13:08:34.581 17924 ERROR nova     sock.listen(backlog)
Sep 28 13:08:34 ctl02 nova-api[17924]: 2017-09-28 13:08:34.581 17924 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:08:34 ctl02 nova-api[17924]: 2017-09-28 13:08:34.581 17924 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:08:34 ctl02 nova-api[17924]: 2017-09-28 13:08:34.581 17924 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:08:34 ctl02 nova-api[17924]: 2017-09-28 13:08:34.581 17924 ERROR nova
Sep 28 13:08:34 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:08:34 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:08:34 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:08:34 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:08:34 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:08:34 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:08:34 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:08:35 ctl02 glance-api[29183]: 2017-09-28 13:08:35.149 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:08:35] "OPTIONS / HTTP/1.0" 200 134 0.000544
Sep 28 13:08:35 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 13:08:35 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 13:08:35 ctl02 neutron-server[30536]: 2017-09-28 13:08:35.968 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 4 dead agents out of 6:
Sep 28 13:08:35 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 13:08:35 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 13:07:06 cmp002
Sep 28 13:08:35 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 13:07:08 cmp001
Sep 28 13:08:35 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 13:06:40 cmp002
Sep 28 13:08:35 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 13:07:36 cmp002
Sep 28 13:08:36 ctl02 neutron-server[30536]: 2017-09-28 13:08:36.171 30600 WARNING oslo_messaging._drivers.amqpdriver [req-6194b923-d305-4e29-8769-607428900615 - - - - -] reply_a13a20a54b91453780e36bdf20a855d2 doesn't exists, drop reply to d1d3f81592e44aa9a9d23b93208d3ffa
Sep 28 13:08:36 ctl02 neutron-server[30536]: 2017-09-28 13:08:36.171 30600 INFO oslo_messaging._drivers.amqpdriver [req-6194b923-d305-4e29-8769-607428900615 - - - - -] The reply d1d3f81592e44aa9a9d23b93208d3ffa cannot be sent  reply_a13a20a54b91453780e36bdf20a855d2 reply queue don't exist after 60 sec abandoning...
Sep 28 13:08:36 ctl02 nova-api[17942]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:08:36 ctl02 nova-api[17942]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:08:36 ctl02 nova-api[17942]: 2017-09-28 13:08:36.745 17942 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:08:36 ctl02 nova-api[17942]: 2017-09-28 13:08:36.746 17942 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:08:36 ctl02 nova-api[17942]: 2017-09-28 13:08:36.746 17942 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:08:36 ctl02 nova-api[17942]: 2017-09-28 13:08:36.746 17942 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:08:36 ctl02 nova-api[17942]: 2017-09-28 13:08:36.746 17942 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:08:36 ctl02 nova-api[17942]: 2017-09-28 13:08:36.746 17942 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:08:36 ctl02 nova-api[17942]: 2017-09-28 13:08:36.746 17942 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:08:36 ctl02 nova-api[17942]: 2017-09-28 13:08:36.746 17942 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:08:36 ctl02 nova-api[17942]: 2017-09-28 13:08:36.746 17942 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:08:36 ctl02 nova-api[17942]: 2017-09-28 13:08:36.746 17942 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:08:36 ctl02 nova-api[17942]: 2017-09-28 13:08:36.746 17942 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:08:36 ctl02 nova-api[17942]: 2017-09-28 13:08:36.746 17942 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:08:36 ctl02 nova-api[17942]: 2017-09-28 13:08:36.746 17942 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:08:36 ctl02 nova-api[17942]: 2017-09-28 13:08:36.746 17942 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:08:36 ctl02 nova-api[17942]: 2017-09-28 13:08:36.746 17942 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:08:36 ctl02 nova-api[17942]: 2017-09-28 13:08:36.746 17942 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:08:36 ctl02 nova-api[17942]: 2017-09-28 13:08:36.746 17942 ERROR nova.wsgi     self.filename))
Sep 28 13:08:36 ctl02 nova-api[17942]: 2017-09-28 13:08:36.746 17942 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:08:36 ctl02 nova-api[17942]: 2017-09-28 13:08:36.746 17942 ERROR nova.wsgi
Sep 28 13:08:36 ctl02 nova-api[17942]: 2017-09-28 13:08:36.749 17942 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:08:36 ctl02 nova-api[17942]: 2017-09-28 13:08:36.876 17942 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:08:36 ctl02 heat-api-cfn[13300]: 2017-09-28 13:08:36.897 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:08:36] "OPTIONS / HTTP/1.0" 200 134 0.000408
Sep 28 13:08:37 ctl02 nova-api[17942]: 2017-09-28 13:08:37.093 17942 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:08:37 ctl02 nova-api[17942]: 2017-09-28 13:08:37.096 17942 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:08:37 ctl02 nova-api[17942]: 2017-09-28 13:08:37.096 17942 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:08:37 ctl02 nova-api[17942]: 2017-09-28 13:08:37.097 17942 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:08:37 ctl02 nova-api[17942]: 2017-09-28 13:08:37.228 17942 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:08:37 ctl02 nova-api[17942]: 2017-09-28 13:08:37.231 17942 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:08:37 ctl02 nova-api[17942]: 2017-09-28 13:08:37.231 17942 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:08:37 ctl02 nova-api[17942]: 2017-09-28 13:08:37.231 17942 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:08:37 ctl02 nova-api[17942]: 2017-09-28 13:08:37.235 17942 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:08:37 ctl02 nova-api[17942]: 2017-09-28 13:08:37.235 17942 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:08:37 ctl02 nova-api[17942]: 2017-09-28 13:08:37.235 17942 ERROR nova Traceback (most recent call last):
Sep 28 13:08:37 ctl02 nova-api[17942]: 2017-09-28 13:08:37.235 17942 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:08:37 ctl02 nova-api[17942]: 2017-09-28 13:08:37.235 17942 ERROR nova     sys.exit(main())
Sep 28 13:08:37 ctl02 nova-api[17942]: 2017-09-28 13:08:37.235 17942 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:08:37 ctl02 nova-api[17942]: 2017-09-28 13:08:37.235 17942 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:08:37 ctl02 nova-api[17942]: 2017-09-28 13:08:37.235 17942 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:08:37 ctl02 nova-api[17942]: 2017-09-28 13:08:37.235 17942 ERROR nova     max_url_len=max_url_len)
Sep 28 13:08:37 ctl02 nova-api[17942]: 2017-09-28 13:08:37.235 17942 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:08:37 ctl02 nova-api[17942]: 2017-09-28 13:08:37.235 17942 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:08:37 ctl02 nova-api[17942]: 2017-09-28 13:08:37.235 17942 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:08:37 ctl02 nova-api[17942]: 2017-09-28 13:08:37.235 17942 ERROR nova     sock.listen(backlog)
Sep 28 13:08:37 ctl02 nova-api[17942]: 2017-09-28 13:08:37.235 17942 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:08:37 ctl02 nova-api[17942]: 2017-09-28 13:08:37.235 17942 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:08:37 ctl02 nova-api[17942]: 2017-09-28 13:08:37.235 17942 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:08:37 ctl02 nova-api[17942]: 2017-09-28 13:08:37.235 17942 ERROR nova
Sep 28 13:08:37 ctl02 nova-scheduler[5620]: 2017-09-28 13:08:37.355 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:08:37 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:08:37 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:08:37 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:08:37 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:08:37 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:08:37 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:08:37 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:08:38 ctl02 neutron-server[30536]: 2017-09-28 13:08:38.447 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:08:38] "OPTIONS / HTTP/1.0" 200 262 0.000439
Sep 28 13:08:38 ctl02 heat-api[13008]: 2017-09-28 13:08:38.720 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:08:38] "OPTIONS / HTTP/1.0" 200 134 0.000563
Sep 28 13:08:38 ctl02 heat-api-cfn[13300]: 2017-09-28 13:08:38.978 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:08:38] "OPTIONS / HTTP/1.0" 200 134 0.000452
Sep 28 13:08:39 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:08:39.186 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:08:39] "OPTIONS / HTTP/1.0" 200 134 0.000371
Sep 28 13:08:39 ctl02 nova-api[17966]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:08:39 ctl02 nova-api[17966]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:08:39 ctl02 heat-api[13008]: 2017-09-28 13:08:39.385 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:08:39] "OPTIONS / HTTP/1.0" 200 134 0.000565
Sep 28 13:08:39 ctl02 nova-api[17966]: 2017-09-28 13:08:39.491 17966 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:08:39 ctl02 nova-api[17966]: 2017-09-28 13:08:39.492 17966 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:08:39 ctl02 nova-api[17966]: 2017-09-28 13:08:39.492 17966 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:08:39 ctl02 nova-api[17966]: 2017-09-28 13:08:39.492 17966 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:08:39 ctl02 nova-api[17966]: 2017-09-28 13:08:39.492 17966 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:08:39 ctl02 nova-api[17966]: 2017-09-28 13:08:39.492 17966 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:08:39 ctl02 nova-api[17966]: 2017-09-28 13:08:39.492 17966 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:08:39 ctl02 nova-api[17966]: 2017-09-28 13:08:39.492 17966 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:08:39 ctl02 nova-api[17966]: 2017-09-28 13:08:39.492 17966 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:08:39 ctl02 nova-api[17966]: 2017-09-28 13:08:39.492 17966 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:08:39 ctl02 nova-api[17966]: 2017-09-28 13:08:39.492 17966 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:08:39 ctl02 nova-api[17966]: 2017-09-28 13:08:39.492 17966 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:08:39 ctl02 nova-api[17966]: 2017-09-28 13:08:39.492 17966 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:08:39 ctl02 nova-api[17966]: 2017-09-28 13:08:39.492 17966 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:08:39 ctl02 nova-api[17966]: 2017-09-28 13:08:39.492 17966 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:08:39 ctl02 nova-api[17966]: 2017-09-28 13:08:39.492 17966 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:08:39 ctl02 nova-api[17966]: 2017-09-28 13:08:39.492 17966 ERROR nova.wsgi     self.filename))
Sep 28 13:08:39 ctl02 nova-api[17966]: 2017-09-28 13:08:39.492 17966 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:08:39 ctl02 nova-api[17966]: 2017-09-28 13:08:39.492 17966 ERROR nova.wsgi
Sep 28 13:08:39 ctl02 nova-api[17966]: 2017-09-28 13:08:39.493 17966 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:08:39 ctl02 nova-api[17966]: 2017-09-28 13:08:39.619 17966 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:08:39 ctl02 nova-api[17966]: 2017-09-28 13:08:39.840 17966 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:08:39 ctl02 nova-api[17966]: 2017-09-28 13:08:39.842 17966 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:08:39 ctl02 nova-api[17966]: 2017-09-28 13:08:39.842 17966 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:08:39 ctl02 nova-api[17966]: 2017-09-28 13:08:39.843 17966 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:08:39 ctl02 nova-api[17966]: 2017-09-28 13:08:39.972 17966 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:08:39 ctl02 nova-api[17966]: 2017-09-28 13:08:39.974 17966 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:08:39 ctl02 nova-api[17966]: 2017-09-28 13:08:39.974 17966 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:08:39 ctl02 nova-api[17966]: 2017-09-28 13:08:39.974 17966 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:08:39 ctl02 nova-api[17966]: 2017-09-28 13:08:39.977 17966 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:08:39 ctl02 nova-api[17966]: 2017-09-28 13:08:39.977 17966 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:08:39 ctl02 nova-api[17966]: 2017-09-28 13:08:39.977 17966 ERROR nova Traceback (most recent call last):
Sep 28 13:08:39 ctl02 nova-api[17966]: 2017-09-28 13:08:39.977 17966 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:08:39 ctl02 nova-api[17966]: 2017-09-28 13:08:39.977 17966 ERROR nova     sys.exit(main())
Sep 28 13:08:39 ctl02 nova-api[17966]: 2017-09-28 13:08:39.977 17966 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:08:39 ctl02 nova-api[17966]: 2017-09-28 13:08:39.977 17966 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:08:39 ctl02 nova-api[17966]: 2017-09-28 13:08:39.977 17966 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:08:39 ctl02 nova-api[17966]: 2017-09-28 13:08:39.977 17966 ERROR nova     max_url_len=max_url_len)
Sep 28 13:08:39 ctl02 nova-api[17966]: 2017-09-28 13:08:39.977 17966 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:08:39 ctl02 nova-api[17966]: 2017-09-28 13:08:39.977 17966 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:08:39 ctl02 nova-api[17966]: 2017-09-28 13:08:39.977 17966 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:08:39 ctl02 nova-api[17966]: 2017-09-28 13:08:39.977 17966 ERROR nova     sock.listen(backlog)
Sep 28 13:08:39 ctl02 nova-api[17966]: 2017-09-28 13:08:39.977 17966 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:08:39 ctl02 nova-api[17966]: 2017-09-28 13:08:39.977 17966 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:08:39 ctl02 nova-api[17966]: 2017-09-28 13:08:39.977 17966 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:08:39 ctl02 nova-api[17966]: 2017-09-28 13:08:39.977 17966 ERROR nova
Sep 28 13:08:40 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:08:40 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:08:40 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:08:40 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:08:40 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:08:40 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:08:40 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:08:40 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:08:40.446 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:08:40] "OPTIONS / HTTP/1.0" 200 134 0.000435
Sep 28 13:08:40 ctl02 glance-api[29183]: 2017-09-28 13:08:40.570 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:08:40] "OPTIONS / HTTP/1.0" 200 134 0.000556
Sep 28 13:08:40 ctl02 neutron-server[30536]: 2017-09-28 13:08:40.821 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:08:40] "OPTIONS / HTTP/1.0" 200 262 0.000440
Sep 28 13:08:42 ctl02 nova-api[17983]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:08:42 ctl02 nova-api[17983]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:08:42 ctl02 nova-api[17983]: 2017-09-28 13:08:42.230 17983 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:08:42 ctl02 nova-api[17983]: 2017-09-28 13:08:42.232 17983 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:08:42 ctl02 nova-api[17983]: 2017-09-28 13:08:42.232 17983 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:08:42 ctl02 nova-api[17983]: 2017-09-28 13:08:42.232 17983 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:08:42 ctl02 nova-api[17983]: 2017-09-28 13:08:42.232 17983 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:08:42 ctl02 nova-api[17983]: 2017-09-28 13:08:42.232 17983 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:08:42 ctl02 nova-api[17983]: 2017-09-28 13:08:42.232 17983 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:08:42 ctl02 nova-api[17983]: 2017-09-28 13:08:42.232 17983 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:08:42 ctl02 nova-api[17983]: 2017-09-28 13:08:42.232 17983 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:08:42 ctl02 nova-api[17983]: 2017-09-28 13:08:42.232 17983 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:08:42 ctl02 nova-api[17983]: 2017-09-28 13:08:42.232 17983 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:08:42 ctl02 nova-api[17983]: 2017-09-28 13:08:42.232 17983 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:08:42 ctl02 nova-api[17983]: 2017-09-28 13:08:42.232 17983 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:08:42 ctl02 nova-api[17983]: 2017-09-28 13:08:42.232 17983 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:08:42 ctl02 nova-api[17983]: 2017-09-28 13:08:42.232 17983 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:08:42 ctl02 nova-api[17983]: 2017-09-28 13:08:42.232 17983 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:08:42 ctl02 nova-api[17983]: 2017-09-28 13:08:42.232 17983 ERROR nova.wsgi     self.filename))
Sep 28 13:08:42 ctl02 nova-api[17983]: 2017-09-28 13:08:42.232 17983 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:08:42 ctl02 nova-api[17983]: 2017-09-28 13:08:42.232 17983 ERROR nova.wsgi
Sep 28 13:08:42 ctl02 nova-api[17983]: 2017-09-28 13:08:42.234 17983 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:08:42 ctl02 nova-api[17983]: 2017-09-28 13:08:42.362 17983 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:08:42 ctl02 nova-api[17983]: 2017-09-28 13:08:42.587 17983 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:08:42 ctl02 nova-api[17983]: 2017-09-28 13:08:42.590 17983 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:08:42 ctl02 nova-api[17983]: 2017-09-28 13:08:42.590 17983 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:08:42 ctl02 nova-api[17983]: 2017-09-28 13:08:42.590 17983 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:08:42 ctl02 glance-api[29183]: 2017-09-28 13:08:42.635 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:08:42] "OPTIONS / HTTP/1.0" 200 134 0.000588
Sep 28 13:08:42 ctl02 nova-api[17983]: 2017-09-28 13:08:42.722 17983 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:08:42 ctl02 nova-api[17983]: 2017-09-28 13:08:42.724 17983 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:08:42 ctl02 nova-api[17983]: 2017-09-28 13:08:42.724 17983 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:08:42 ctl02 nova-api[17983]: 2017-09-28 13:08:42.725 17983 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:08:42 ctl02 nova-api[17983]: 2017-09-28 13:08:42.728 17983 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:08:42 ctl02 nova-api[17983]: 2017-09-28 13:08:42.728 17983 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:08:42 ctl02 nova-api[17983]: 2017-09-28 13:08:42.728 17983 ERROR nova Traceback (most recent call last):
Sep 28 13:08:42 ctl02 nova-api[17983]: 2017-09-28 13:08:42.728 17983 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:08:42 ctl02 nova-api[17983]: 2017-09-28 13:08:42.728 17983 ERROR nova     sys.exit(main())
Sep 28 13:08:42 ctl02 nova-api[17983]: 2017-09-28 13:08:42.728 17983 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:08:42 ctl02 nova-api[17983]: 2017-09-28 13:08:42.728 17983 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:08:42 ctl02 nova-api[17983]: 2017-09-28 13:08:42.728 17983 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:08:42 ctl02 nova-api[17983]: 2017-09-28 13:08:42.728 17983 ERROR nova     max_url_len=max_url_len)
Sep 28 13:08:42 ctl02 nova-api[17983]: 2017-09-28 13:08:42.728 17983 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:08:42 ctl02 nova-api[17983]: 2017-09-28 13:08:42.728 17983 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:08:42 ctl02 nova-api[17983]: 2017-09-28 13:08:42.728 17983 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:08:42 ctl02 nova-api[17983]: 2017-09-28 13:08:42.728 17983 ERROR nova     sock.listen(backlog)
Sep 28 13:08:42 ctl02 nova-api[17983]: 2017-09-28 13:08:42.728 17983 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:08:42 ctl02 nova-api[17983]: 2017-09-28 13:08:42.728 17983 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:08:42 ctl02 nova-api[17983]: 2017-09-28 13:08:42.728 17983 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:08:42 ctl02 nova-api[17983]: 2017-09-28 13:08:42.728 17983 ERROR nova
Sep 28 13:08:42 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:08:42 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:08:42 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:08:43 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:08:43 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:08:43 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:08:43 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:08:43 ctl02 neutron-server[30536]: 2017-09-28 13:08:43.554 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 13:08:44 ctl02 heat-api-cfn[13300]: 2017-09-28 13:08:44.061 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:08:44] "OPTIONS / HTTP/1.0" 200 134 0.000406
Sep 28 13:08:44 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:08:44.319 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:08:44] "OPTIONS / HTTP/1.0" 200 134 0.000372
Sep 28 13:08:44 ctl02 heat-api[13008]: 2017-09-28 13:08:44.526 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:08:44] "OPTIONS / HTTP/1.0" 200 134 0.000520
Sep 28 13:08:44 ctl02 neutron-server[30536]: 2017-09-28 13:08:44.648 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:08:44] "OPTIONS / HTTP/1.0" 200 262 0.000483
Sep 28 13:08:44 ctl02 nova-api[18002]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:08:44 ctl02 nova-api[18002]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:08:44 ctl02 glance-api[29183]: 2017-09-28 13:08:44.853 29252 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:08:44] "OPTIONS / HTTP/1.0" 200 134 0.000576
Sep 28 13:08:44 ctl02 nova-api[18002]: 2017-09-28 13:08:44.968 18002 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:08:44 ctl02 nova-api[18002]: 2017-09-28 13:08:44.969 18002 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:08:44 ctl02 nova-api[18002]: 2017-09-28 13:08:44.969 18002 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:08:44 ctl02 nova-api[18002]: 2017-09-28 13:08:44.969 18002 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:08:44 ctl02 nova-api[18002]: 2017-09-28 13:08:44.969 18002 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:08:44 ctl02 nova-api[18002]: 2017-09-28 13:08:44.969 18002 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:08:44 ctl02 nova-api[18002]: 2017-09-28 13:08:44.969 18002 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:08:44 ctl02 nova-api[18002]: 2017-09-28 13:08:44.969 18002 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:08:44 ctl02 nova-api[18002]: 2017-09-28 13:08:44.969 18002 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:08:44 ctl02 nova-api[18002]: 2017-09-28 13:08:44.969 18002 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:08:44 ctl02 nova-api[18002]: 2017-09-28 13:08:44.969 18002 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:08:44 ctl02 nova-api[18002]: 2017-09-28 13:08:44.969 18002 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:08:44 ctl02 nova-api[18002]: 2017-09-28 13:08:44.969 18002 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:08:44 ctl02 nova-api[18002]: 2017-09-28 13:08:44.969 18002 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:08:44 ctl02 nova-api[18002]: 2017-09-28 13:08:44.969 18002 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:08:44 ctl02 nova-api[18002]: 2017-09-28 13:08:44.969 18002 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:08:44 ctl02 nova-api[18002]: 2017-09-28 13:08:44.969 18002 ERROR nova.wsgi     self.filename))
Sep 28 13:08:44 ctl02 nova-api[18002]: 2017-09-28 13:08:44.969 18002 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:08:44 ctl02 nova-api[18002]: 2017-09-28 13:08:44.969 18002 ERROR nova.wsgi
Sep 28 13:08:44 ctl02 nova-api[18002]: 2017-09-28 13:08:44.970 18002 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:08:45 ctl02 nova-api[18002]: 2017-09-28 13:08:45.096 18002 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:08:45 ctl02 nova-api[18002]: 2017-09-28 13:08:45.317 18002 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:08:45 ctl02 nova-api[18002]: 2017-09-28 13:08:45.319 18002 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:08:45 ctl02 nova-api[18002]: 2017-09-28 13:08:45.319 18002 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:08:45 ctl02 nova-api[18002]: 2017-09-28 13:08:45.319 18002 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:08:45 ctl02 nova-api[18002]: 2017-09-28 13:08:45.449 18002 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:08:45 ctl02 nova-api[18002]: 2017-09-28 13:08:45.450 18002 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:08:45 ctl02 nova-api[18002]: 2017-09-28 13:08:45.450 18002 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:08:45 ctl02 nova-api[18002]: 2017-09-28 13:08:45.451 18002 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:08:45 ctl02 nova-api[18002]: 2017-09-28 13:08:45.454 18002 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:08:45 ctl02 nova-api[18002]: 2017-09-28 13:08:45.455 18002 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:08:45 ctl02 nova-api[18002]: 2017-09-28 13:08:45.455 18002 ERROR nova Traceback (most recent call last):
Sep 28 13:08:45 ctl02 nova-api[18002]: 2017-09-28 13:08:45.455 18002 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:08:45 ctl02 nova-api[18002]: 2017-09-28 13:08:45.455 18002 ERROR nova     sys.exit(main())
Sep 28 13:08:45 ctl02 nova-api[18002]: 2017-09-28 13:08:45.455 18002 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:08:45 ctl02 nova-api[18002]: 2017-09-28 13:08:45.455 18002 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:08:45 ctl02 nova-api[18002]: 2017-09-28 13:08:45.455 18002 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:08:45 ctl02 nova-api[18002]: 2017-09-28 13:08:45.455 18002 ERROR nova     max_url_len=max_url_len)
Sep 28 13:08:45 ctl02 nova-api[18002]: 2017-09-28 13:08:45.455 18002 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:08:45 ctl02 nova-api[18002]: 2017-09-28 13:08:45.455 18002 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:08:45 ctl02 nova-api[18002]: 2017-09-28 13:08:45.455 18002 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:08:45 ctl02 nova-api[18002]: 2017-09-28 13:08:45.455 18002 ERROR nova     sock.listen(backlog)
Sep 28 13:08:45 ctl02 nova-api[18002]: 2017-09-28 13:08:45.455 18002 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:08:45 ctl02 nova-api[18002]: 2017-09-28 13:08:45.455 18002 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:08:45 ctl02 nova-api[18002]: 2017-09-28 13:08:45.455 18002 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:08:45 ctl02 nova-api[18002]: 2017-09-28 13:08:45.455 18002 ERROR nova
Sep 28 13:08:45 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:08:45 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:08:45 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:08:45 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:08:45 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:08:45 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:08:45 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:08:46 ctl02 heat-api-cfn[13300]: 2017-09-28 13:08:46.673 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:08:46] "OPTIONS / HTTP/1.0" 200 134 0.000558
Sep 28 13:08:47 ctl02 nova-api[18020]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:08:47 ctl02 nova-api[18020]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:08:47 ctl02 nova-api[18020]: 2017-09-28 13:08:47.699 18020 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:08:47 ctl02 nova-api[18020]: 2017-09-28 13:08:47.701 18020 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:08:47 ctl02 nova-api[18020]: 2017-09-28 13:08:47.701 18020 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:08:47 ctl02 nova-api[18020]: 2017-09-28 13:08:47.701 18020 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:08:47 ctl02 nova-api[18020]: 2017-09-28 13:08:47.701 18020 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:08:47 ctl02 nova-api[18020]: 2017-09-28 13:08:47.701 18020 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:08:47 ctl02 nova-api[18020]: 2017-09-28 13:08:47.701 18020 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:08:47 ctl02 nova-api[18020]: 2017-09-28 13:08:47.701 18020 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:08:47 ctl02 nova-api[18020]: 2017-09-28 13:08:47.701 18020 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:08:47 ctl02 nova-api[18020]: 2017-09-28 13:08:47.701 18020 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:08:47 ctl02 nova-api[18020]: 2017-09-28 13:08:47.701 18020 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:08:47 ctl02 nova-api[18020]: 2017-09-28 13:08:47.701 18020 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:08:47 ctl02 nova-api[18020]: 2017-09-28 13:08:47.701 18020 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:08:47 ctl02 nova-api[18020]: 2017-09-28 13:08:47.701 18020 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:08:47 ctl02 nova-api[18020]: 2017-09-28 13:08:47.701 18020 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:08:47 ctl02 nova-api[18020]: 2017-09-28 13:08:47.701 18020 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:08:47 ctl02 nova-api[18020]: 2017-09-28 13:08:47.701 18020 ERROR nova.wsgi     self.filename))
Sep 28 13:08:47 ctl02 nova-api[18020]: 2017-09-28 13:08:47.701 18020 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:08:47 ctl02 nova-api[18020]: 2017-09-28 13:08:47.701 18020 ERROR nova.wsgi
Sep 28 13:08:47 ctl02 nova-api[18020]: 2017-09-28 13:08:47.702 18020 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:08:47 ctl02 nova-api[18020]: 2017-09-28 13:08:47.840 18020 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:08:48 ctl02 nova-api[18020]: 2017-09-28 13:08:48.094 18020 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:08:48 ctl02 nova-api[18020]: 2017-09-28 13:08:48.096 18020 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:08:48 ctl02 nova-api[18020]: 2017-09-28 13:08:48.096 18020 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:08:48 ctl02 nova-api[18020]: 2017-09-28 13:08:48.096 18020 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:08:48 ctl02 neutron-server[30536]: 2017-09-28 13:08:48.143 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:08:48] "OPTIONS / HTTP/1.0" 200 262 0.000507
Sep 28 13:08:48 ctl02 nova-api[18020]: 2017-09-28 13:08:48.231 18020 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:08:48 ctl02 nova-api[18020]: 2017-09-28 13:08:48.234 18020 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:08:48 ctl02 nova-api[18020]: 2017-09-28 13:08:48.234 18020 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:08:48 ctl02 nova-api[18020]: 2017-09-28 13:08:48.234 18020 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:08:48 ctl02 nova-api[18020]: 2017-09-28 13:08:48.237 18020 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:08:48 ctl02 nova-api[18020]: 2017-09-28 13:08:48.238 18020 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:08:48 ctl02 nova-api[18020]: 2017-09-28 13:08:48.238 18020 ERROR nova Traceback (most recent call last):
Sep 28 13:08:48 ctl02 nova-api[18020]: 2017-09-28 13:08:48.238 18020 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:08:48 ctl02 nova-api[18020]: 2017-09-28 13:08:48.238 18020 ERROR nova     sys.exit(main())
Sep 28 13:08:48 ctl02 nova-api[18020]: 2017-09-28 13:08:48.238 18020 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:08:48 ctl02 nova-api[18020]: 2017-09-28 13:08:48.238 18020 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:08:48 ctl02 nova-api[18020]: 2017-09-28 13:08:48.238 18020 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:08:48 ctl02 nova-api[18020]: 2017-09-28 13:08:48.238 18020 ERROR nova     max_url_len=max_url_len)
Sep 28 13:08:48 ctl02 nova-api[18020]: 2017-09-28 13:08:48.238 18020 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:08:48 ctl02 nova-api[18020]: 2017-09-28 13:08:48.238 18020 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:08:48 ctl02 nova-api[18020]: 2017-09-28 13:08:48.238 18020 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:08:48 ctl02 nova-api[18020]: 2017-09-28 13:08:48.238 18020 ERROR nova     sock.listen(backlog)
Sep 28 13:08:48 ctl02 nova-api[18020]: 2017-09-28 13:08:48.238 18020 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:08:48 ctl02 nova-api[18020]: 2017-09-28 13:08:48.238 18020 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:08:48 ctl02 nova-api[18020]: 2017-09-28 13:08:48.238 18020 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:08:48 ctl02 nova-api[18020]: 2017-09-28 13:08:48.238 18020 ERROR nova
Sep 28 13:08:48 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:08:48 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:08:48 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:08:48 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:08:48 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:08:48 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:08:48 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:08:48 ctl02 heat-api[13008]: 2017-09-28 13:08:48.965 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:08:48] "OPTIONS / HTTP/1.0" 200 134 0.000574
Sep 28 13:08:49 ctl02 heat-api-cfn[13300]: 2017-09-28 13:08:49.152 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:08:49] "OPTIONS / HTTP/1.0" 200 134 0.000443
Sep 28 13:08:49 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:08:49.384 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:08:49] "OPTIONS / HTTP/1.0" 200 134 0.000372
Sep 28 13:08:49 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb5e99049)
Sep 28 13:08:49 ctl02 heat-api[13008]: 2017-09-28 13:08:49.768 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:08:49] "OPTIONS / HTTP/1.0" 200 134 0.000552
Sep 28 13:08:50 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:08:50.052 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:08:50] "OPTIONS / HTTP/1.0" 200 134 0.000381
Sep 28 13:08:50 ctl02 nova-api[18038]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:08:50 ctl02 nova-api[18038]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:08:50 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb5e99049)
Sep 28 13:08:50 ctl02 nova-api[18038]: 2017-09-28 13:08:50.476 18038 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:08:50 ctl02 nova-api[18038]: 2017-09-28 13:08:50.477 18038 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:08:50 ctl02 nova-api[18038]: 2017-09-28 13:08:50.477 18038 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:08:50 ctl02 nova-api[18038]: 2017-09-28 13:08:50.477 18038 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:08:50 ctl02 nova-api[18038]: 2017-09-28 13:08:50.477 18038 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:08:50 ctl02 nova-api[18038]: 2017-09-28 13:08:50.477 18038 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:08:50 ctl02 nova-api[18038]: 2017-09-28 13:08:50.477 18038 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:08:50 ctl02 nova-api[18038]: 2017-09-28 13:08:50.477 18038 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:08:50 ctl02 nova-api[18038]: 2017-09-28 13:08:50.477 18038 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:08:50 ctl02 nova-api[18038]: 2017-09-28 13:08:50.477 18038 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:08:50 ctl02 nova-api[18038]: 2017-09-28 13:08:50.477 18038 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:08:50 ctl02 nova-api[18038]: 2017-09-28 13:08:50.477 18038 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:08:50 ctl02 nova-api[18038]: 2017-09-28 13:08:50.477 18038 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:08:50 ctl02 nova-api[18038]: 2017-09-28 13:08:50.477 18038 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:08:50 ctl02 nova-api[18038]: 2017-09-28 13:08:50.477 18038 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:08:50 ctl02 nova-api[18038]: 2017-09-28 13:08:50.477 18038 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:08:50 ctl02 nova-api[18038]: 2017-09-28 13:08:50.477 18038 ERROR nova.wsgi     self.filename))
Sep 28 13:08:50 ctl02 nova-api[18038]: 2017-09-28 13:08:50.477 18038 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:08:50 ctl02 nova-api[18038]: 2017-09-28 13:08:50.477 18038 ERROR nova.wsgi
Sep 28 13:08:50 ctl02 nova-api[18038]: 2017-09-28 13:08:50.479 18038 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:08:50 ctl02 neutron-server[30536]: 2017-09-28 13:08:50.544 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:08:50] "OPTIONS / HTTP/1.0" 200 262 0.000512
Sep 28 13:08:50 ctl02 glance-api[29183]: 2017-09-28 13:08:50.601 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:08:50] "OPTIONS / HTTP/1.0" 200 134 0.000551
Sep 28 13:08:50 ctl02 nova-api[18038]: 2017-09-28 13:08:50.608 18038 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:08:50 ctl02 nova-api[18038]: 2017-09-28 13:08:50.827 18038 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:08:50 ctl02 nova-api[18038]: 2017-09-28 13:08:50.830 18038 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:08:50 ctl02 nova-api[18038]: 2017-09-28 13:08:50.830 18038 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:08:50 ctl02 nova-api[18038]: 2017-09-28 13:08:50.830 18038 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:08:50 ctl02 nova-api[18038]: 2017-09-28 13:08:50.959 18038 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:08:50 ctl02 nova-api[18038]: 2017-09-28 13:08:50.962 18038 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:08:50 ctl02 nova-api[18038]: 2017-09-28 13:08:50.962 18038 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:08:50 ctl02 nova-api[18038]: 2017-09-28 13:08:50.963 18038 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:08:50 ctl02 neutron-server[30536]: 2017-09-28 13:08:50.964 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 13:08:50 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 13:08:50 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 13:07:06 cmp002
Sep 28 13:08:50 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 13:07:08 cmp001
Sep 28 13:08:50 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 13:07:36 cmp002
Sep 28 13:08:50 ctl02 nova-api[18038]: 2017-09-28 13:08:50.966 18038 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:08:50 ctl02 nova-api[18038]: 2017-09-28 13:08:50.966 18038 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:08:50 ctl02 nova-api[18038]: 2017-09-28 13:08:50.966 18038 ERROR nova Traceback (most recent call last):
Sep 28 13:08:50 ctl02 nova-api[18038]: 2017-09-28 13:08:50.966 18038 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:08:50 ctl02 nova-api[18038]: 2017-09-28 13:08:50.966 18038 ERROR nova     sys.exit(main())
Sep 28 13:08:50 ctl02 nova-api[18038]: 2017-09-28 13:08:50.966 18038 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:08:50 ctl02 nova-api[18038]: 2017-09-28 13:08:50.966 18038 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:08:50 ctl02 nova-api[18038]: 2017-09-28 13:08:50.966 18038 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:08:50 ctl02 nova-api[18038]: 2017-09-28 13:08:50.966 18038 ERROR nova     max_url_len=max_url_len)
Sep 28 13:08:50 ctl02 nova-api[18038]: 2017-09-28 13:08:50.966 18038 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:08:50 ctl02 nova-api[18038]: 2017-09-28 13:08:50.966 18038 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:08:50 ctl02 nova-api[18038]: 2017-09-28 13:08:50.966 18038 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:08:50 ctl02 nova-api[18038]: 2017-09-28 13:08:50.966 18038 ERROR nova     sock.listen(backlog)
Sep 28 13:08:50 ctl02 nova-api[18038]: 2017-09-28 13:08:50.966 18038 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:08:50 ctl02 nova-api[18038]: 2017-09-28 13:08:50.966 18038 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:08:50 ctl02 nova-api[18038]: 2017-09-28 13:08:50.966 18038 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:08:50 ctl02 nova-api[18038]: 2017-09-28 13:08:50.966 18038 ERROR nova
Sep 28 13:08:51 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:08:51 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:08:51 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:08:51 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:08:51 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:08:51 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:08:51 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:08:51 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb5e99049)
Sep 28 13:08:52 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb5e99049)
Sep 28 13:08:52 ctl02 glance-api[29183]: 2017-09-28 13:08:52.809 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:08:52] "OPTIONS / HTTP/1.0" 200 134 0.000597
Sep 28 13:08:53 ctl02 nova-api[18056]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:08:53 ctl02 nova-api[18056]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:08:53 ctl02 nova-api[18056]: 2017-09-28 13:08:53.222 18056 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:08:53 ctl02 nova-api[18056]: 2017-09-28 13:08:53.223 18056 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:08:53 ctl02 nova-api[18056]: 2017-09-28 13:08:53.223 18056 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:08:53 ctl02 nova-api[18056]: 2017-09-28 13:08:53.223 18056 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:08:53 ctl02 nova-api[18056]: 2017-09-28 13:08:53.223 18056 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:08:53 ctl02 nova-api[18056]: 2017-09-28 13:08:53.223 18056 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:08:53 ctl02 nova-api[18056]: 2017-09-28 13:08:53.223 18056 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:08:53 ctl02 nova-api[18056]: 2017-09-28 13:08:53.223 18056 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:08:53 ctl02 nova-api[18056]: 2017-09-28 13:08:53.223 18056 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:08:53 ctl02 nova-api[18056]: 2017-09-28 13:08:53.223 18056 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:08:53 ctl02 nova-api[18056]: 2017-09-28 13:08:53.223 18056 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:08:53 ctl02 nova-api[18056]: 2017-09-28 13:08:53.223 18056 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:08:53 ctl02 nova-api[18056]: 2017-09-28 13:08:53.223 18056 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:08:53 ctl02 nova-api[18056]: 2017-09-28 13:08:53.223 18056 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:08:53 ctl02 nova-api[18056]: 2017-09-28 13:08:53.223 18056 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:08:53 ctl02 nova-api[18056]: 2017-09-28 13:08:53.223 18056 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:08:53 ctl02 nova-api[18056]: 2017-09-28 13:08:53.223 18056 ERROR nova.wsgi     self.filename))
Sep 28 13:08:53 ctl02 nova-api[18056]: 2017-09-28 13:08:53.223 18056 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:08:53 ctl02 nova-api[18056]: 2017-09-28 13:08:53.223 18056 ERROR nova.wsgi
Sep 28 13:08:53 ctl02 nova-api[18056]: 2017-09-28 13:08:53.224 18056 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:08:53 ctl02 nova-api[18056]: 2017-09-28 13:08:53.350 18056 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:08:53 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb5e99049)
Sep 28 13:08:53 ctl02 nova-api[18056]: 2017-09-28 13:08:53.562 18056 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:08:53 ctl02 nova-api[18056]: 2017-09-28 13:08:53.564 18056 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:08:53 ctl02 nova-api[18056]: 2017-09-28 13:08:53.564 18056 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:08:53 ctl02 nova-api[18056]: 2017-09-28 13:08:53.565 18056 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:08:53 ctl02 nova-api[18056]: 2017-09-28 13:08:53.692 18056 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:08:53 ctl02 nova-api[18056]: 2017-09-28 13:08:53.694 18056 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:08:53 ctl02 nova-api[18056]: 2017-09-28 13:08:53.694 18056 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:08:53 ctl02 nova-api[18056]: 2017-09-28 13:08:53.695 18056 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:08:53 ctl02 nova-api[18056]: 2017-09-28 13:08:53.698 18056 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:08:53 ctl02 nova-api[18056]: 2017-09-28 13:08:53.698 18056 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:08:53 ctl02 nova-api[18056]: 2017-09-28 13:08:53.698 18056 ERROR nova Traceback (most recent call last):
Sep 28 13:08:53 ctl02 nova-api[18056]: 2017-09-28 13:08:53.698 18056 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:08:53 ctl02 nova-api[18056]: 2017-09-28 13:08:53.698 18056 ERROR nova     sys.exit(main())
Sep 28 13:08:53 ctl02 nova-api[18056]: 2017-09-28 13:08:53.698 18056 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:08:53 ctl02 nova-api[18056]: 2017-09-28 13:08:53.698 18056 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:08:53 ctl02 nova-api[18056]: 2017-09-28 13:08:53.698 18056 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:08:53 ctl02 nova-api[18056]: 2017-09-28 13:08:53.698 18056 ERROR nova     max_url_len=max_url_len)
Sep 28 13:08:53 ctl02 nova-api[18056]: 2017-09-28 13:08:53.698 18056 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:08:53 ctl02 nova-api[18056]: 2017-09-28 13:08:53.698 18056 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:08:53 ctl02 nova-api[18056]: 2017-09-28 13:08:53.698 18056 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:08:53 ctl02 nova-api[18056]: 2017-09-28 13:08:53.698 18056 ERROR nova     sock.listen(backlog)
Sep 28 13:08:53 ctl02 nova-api[18056]: 2017-09-28 13:08:53.698 18056 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:08:53 ctl02 nova-api[18056]: 2017-09-28 13:08:53.698 18056 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:08:53 ctl02 nova-api[18056]: 2017-09-28 13:08:53.698 18056 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:08:53 ctl02 nova-api[18056]: 2017-09-28 13:08:53.698 18056 ERROR nova
Sep 28 13:08:53 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:08:53 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:08:53 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:08:53 ctl02 neutron-server[30536]: 2017-09-28 13:08:53.979 30596 INFO neutron.wsgi [req-0b668625-e8ac-47c3-a23f-171b677a1b96 47d6ef1b5476456ea76a1f62f17c0bea 5f384790c44b46a1986075a6d7985b8c - - -] 10.167.4.13 - - [28/Sep/2017 13:08:53] "GET /v2.0/lbaas/listeners.json HTTP/1.1" 404 261 0.027976
Sep 28 13:08:54 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:08:54.056 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:08:54] "OPTIONS / HTTP/1.0" 200 134 0.000447
Sep 28 13:08:54 ctl02 heat-api-cfn[13300]: 2017-09-28 13:08:54.077 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:08:54] "OPTIONS / HTTP/1.0" 200 134 0.000532
Sep 28 13:08:54 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:08:54 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:08:54 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:08:54 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.421 30595 ERROR oslo_db.sqlalchemy.exc_filters [req-a65b3662-c9dd-4f55-b4cd-bbefe50cd5ec 47d6ef1b5476456ea76a1f62f17c0bea 5f384790c44b46a1986075a6d7985b8c - - -] DBAPIError exception wrapped from (pymysql.err.InternalError) (1054, u"Unknown column 'floatingips.tenant_id' in 'field list'") [SQL: u'SELECT floatingips.tenant_id AS floatingips_tenant_id, floatingips.id AS floatingips_id, floatingips.floating_ip_address AS floatingips_floating_ip_address, floatingips.floating_network_id AS floatingips_floating_network_id, floatingips.floating_port_id AS floatingips_floating_port_id, floatingips.fixed_port_id AS floatingips_fixed_port_id, floatingips.fixed_ip_address AS floatingips_fixed_ip_address, floatingips.router_id AS floatingips_router_id, floatingips.last_known_router_id AS floatingips_last_known_router_id, floatingips.status AS floatingips_status, floatingips.standard_attr_id AS floatingips_standard_attr_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, floatingipdnses_1.floatingip_id AS floatingipdnses_1_floatingip_id, floatingipdnses_1.dns_name AS floatingipdnses_1_dns_name, floatingipdnses_1.dns_domain AS floatingipdnses_1_dns_domain, floatingipdnses_1.published_dns_name AS floatingipdnses_1_published_dns_name, floatingipdnses_1.published_dns_domain AS floatingipdnses_1_published_dns_domain \nFROM floatingips LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = floatingips.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN floatingipdnses AS floatingipdnses_1 ON floatingips.id = floatingipdnses_1.floatingip_id']
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.421 30595 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.421 30595 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.421 30595 ERROR oslo_db.sqlalchemy.exc_filters     context)
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.421 30595 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.421 30595 ERROR oslo_db.sqlalchemy.exc_filters     cursor.execute(statement, parameters)
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.421 30595 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.421 30595 ERROR oslo_db.sqlalchemy.exc_filters     result = self._query(query)
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.421 30595 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.421 30595 ERROR oslo_db.sqlalchemy.exc_filters     conn.query(q)
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.421 30595 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.421 30595 ERROR oslo_db.sqlalchemy.exc_filters     self._affected_rows = self._read_query_result(unbuffered=unbuffered)
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.421 30595 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.421 30595 ERROR oslo_db.sqlalchemy.exc_filters     result.read()
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.421 30595 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.421 30595 ERROR oslo_db.sqlalchemy.exc_filters     first_packet = self.connection._read_packet()
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.421 30595 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.421 30595 ERROR oslo_db.sqlalchemy.exc_filters     packet.check_error()
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.421 30595 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.421 30595 ERROR oslo_db.sqlalchemy.exc_filters     err.raise_mysql_exception(self._data)
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.421 30595 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.421 30595 ERROR oslo_db.sqlalchemy.exc_filters     _check_mysql_exception(errinfo)
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.421 30595 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.421 30595 ERROR oslo_db.sqlalchemy.exc_filters     raise InternalError(errno, errorvalue)
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.421 30595 ERROR oslo_db.sqlalchemy.exc_filters InternalError: (1054, u"Unknown column 'floatingips.tenant_id' in 'field list'")
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.421 30595 ERROR oslo_db.sqlalchemy.exc_filters
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.425 30595 ERROR neutron.api.v2.resource [req-a65b3662-c9dd-4f55-b4cd-bbefe50cd5ec 47d6ef1b5476456ea76a1f62f17c0bea 5f384790c44b46a1986075a6d7985b8c - - -] index failed
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.425 30595 ERROR neutron.api.v2.resource Traceback (most recent call last):
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.425 30595 ERROR neutron.api.v2.resource   File "/usr/lib/python2.7/dist-packages/neutron/api/v2/resource.py", line 84, in resource
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.425 30595 ERROR neutron.api.v2.resource     result = method(request=request, **args)
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.425 30595 ERROR neutron.api.v2.resource   File "/usr/lib/python2.7/dist-packages/oslo_db/api.py", line 148, in wrapper
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.425 30595 ERROR neutron.api.v2.resource     ectxt.value = e.inner_exc
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.425 30595 ERROR neutron.api.v2.resource   File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.425 30595 ERROR neutron.api.v2.resource     self.force_reraise()
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.425 30595 ERROR neutron.api.v2.resource   File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.425 30595 ERROR neutron.api.v2.resource     six.reraise(self.type_, self.value, self.tb)
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.425 30595 ERROR neutron.api.v2.resource   File "/usr/lib/python2.7/dist-packages/oslo_db/api.py", line 138, in wrapper
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.425 30595 ERROR neutron.api.v2.resource     return f(*args, **kwargs)
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.425 30595 ERROR neutron.api.v2.resource   File "/usr/lib/python2.7/dist-packages/neutron/api/v2/base.py", line 341, in index
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.425 30595 ERROR neutron.api.v2.resource     return self._items(request, True, parent_id)
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.425 30595 ERROR neutron.api.v2.resource   File "/usr/lib/python2.7/dist-packages/neutron/api/v2/base.py", line 267, in _items
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.425 30595 ERROR neutron.api.v2.resource     obj_list = obj_getter(request.context, **kwargs)
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.425 30595 ERROR neutron.api.v2.resource   File "/usr/lib/python2.7/dist-packages/neutron/db/l3_db.py", line 1274, in get_floatingips
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.425 30595 ERROR neutron.api.v2.resource     page_reverse=page_reverse)
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.425 30595 ERROR neutron.api.v2.resource   File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.425 30595 ERROR neutron.api.v2.resource     items = [dict_func(c, fields) for c in query]
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.425 30595 ERROR neutron.api.v2.resource   File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.425 30595 ERROR neutron.api.v2.resource     return self._execute_and_instances(context)
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.425 30595 ERROR neutron.api.v2.resource   File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.425 30595 ERROR neutron.api.v2.resource     result = conn.execute(querycontext.statement, self._params)
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.425 30595 ERROR neutron.api.v2.resource   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.425 30595 ERROR neutron.api.v2.resource     return meth(self, multiparams, params)
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.425 30595 ERROR neutron.api.v2.resource   File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.425 30595 ERROR neutron.api.v2.resource     return connection._execute_clauseelement(self, multiparams, params)
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.425 30595 ERROR neutron.api.v2.resource   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.425 30595 ERROR neutron.api.v2.resource     compiled_sql, distilled_params
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.425 30595 ERROR neutron.api.v2.resource   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.425 30595 ERROR neutron.api.v2.resource     context)
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.425 30595 ERROR neutron.api.v2.resource   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.425 30595 ERROR neutron.api.v2.resource     util.raise_from_cause(newraise, exc_info)
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.425 30595 ERROR neutron.api.v2.resource   File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.425 30595 ERROR neutron.api.v2.resource     reraise(type(exception), exception, tb=exc_tb)
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.425 30595 ERROR neutron.api.v2.resource   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.425 30595 ERROR neutron.api.v2.resource     context)
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.425 30595 ERROR neutron.api.v2.resource   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.425 30595 ERROR neutron.api.v2.resource     cursor.execute(statement, parameters)
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.425 30595 ERROR neutron.api.v2.resource   File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.425 30595 ERROR neutron.api.v2.resource     result = self._query(query)
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.425 30595 ERROR neutron.api.v2.resource   File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.425 30595 ERROR neutron.api.v2.resource     conn.query(q)
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.425 30595 ERROR neutron.api.v2.resource   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.425 30595 ERROR neutron.api.v2.resource     self._affected_rows = self._read_query_result(unbuffered=unbuffered)
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.425 30595 ERROR neutron.api.v2.resource   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.425 30595 ERROR neutron.api.v2.resource     result.read()
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.425 30595 ERROR neutron.api.v2.resource   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.425 30595 ERROR neutron.api.v2.resource     first_packet = self.connection._read_packet()
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.425 30595 ERROR neutron.api.v2.resource   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.425 30595 ERROR neutron.api.v2.resource     packet.check_error()
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.425 30595 ERROR neutron.api.v2.resource   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.425 30595 ERROR neutron.api.v2.resource     err.raise_mysql_exception(self._data)
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.425 30595 ERROR neutron.api.v2.resource   File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.425 30595 ERROR neutron.api.v2.resource     _check_mysql_exception(errinfo)
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.425 30595 ERROR neutron.api.v2.resource   File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.425 30595 ERROR neutron.api.v2.resource     raise InternalError(errno, errorvalue)
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.425 30595 ERROR neutron.api.v2.resource DBError: (pymysql.err.InternalError) (1054, u"Unknown column 'floatingips.tenant_id' in 'field list'") [SQL: u'SELECT floatingips.tenant_id AS floatingips_tenant_id, floatingips.id AS floatingips_id, floatingips.floating_ip_address AS floatingips_floating_ip_address, floatingips.floating_network_id AS floatingips_floating_network_id, floatingips.floating_port_id AS floatingips_floating_port_id, floatingips.fixed_port_id AS floatingips_fixed_port_id, floatingips.fixed_ip_address AS floatingips_fixed_ip_address, floatingips.router_id AS floatingips_router_id, floatingips.last_known_router_id AS floatingips_last_known_router_id, floatingips.status AS floatingips_status, floatingips.standard_attr_id AS floatingips_standard_attr_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, floatingipdnses_1.floatingip_id AS floatingipdnses_1_floatingip_id, floatingipdnses_1.dns_name AS floatingipdnses_1_dns_name, floatingipdnses_1.dns_domain AS floatingipdnses_1_dns_domain, floatingipdnses_1.published_dns_name AS floatingipdnses_1_published_dns_name, floatingipdnses_1.published_dns_domain AS floatingipdnses_1_published_dns_domain \nFROM floatingips LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = floatingips.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN floatingipdnses AS floatingipdnses_1 ON floatingips.id = floatingipdnses_1.floatingip_id']
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.425 30595 ERROR neutron.api.v2.resource
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.429 30595 INFO neutron.wsgi [req-a65b3662-c9dd-4f55-b4cd-bbefe50cd5ec 47d6ef1b5476456ea76a1f62f17c0bea 5f384790c44b46a1986075a6d7985b8c - - -] 10.167.4.13 - - [28/Sep/2017 13:08:54] "GET /v2.0/floatingips.json HTTP/1.1" 500 378 0.068854
Sep 28 13:08:54 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb5e99049)
Sep 28 13:08:54 ctl02 heat-api[13008]: 2017-09-28 13:08:54.671 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:08:54] "OPTIONS / HTTP/1.0" 200 134 0.000543
Sep 28 13:08:54 ctl02 neutron-server[30536]: 2017-09-28 13:08:54.686 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:08:54] "OPTIONS / HTTP/1.0" 200 262 0.000456
Sep 28 13:08:55 ctl02 glance-api[29183]: 2017-09-28 13:08:55.095 29257 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:08:55] "OPTIONS / HTTP/1.0" 200 134 0.000588
Sep 28 13:08:55 ctl02 neutron-server[30536]: 2017-09-28 13:08:55.235 30597 WARNING keystonemiddleware.auth_token [-] Using the in-process token cache is deprecated as of the 4.2.0 release and may be removed in the 5.0.0 release or the 'O' development cycle. The in-process cache causes inconsistent results and high memory usage. When the feature is removed the auth_token middleware will not cache tokens by default which may result in performance issues. It is recommended to use  memcache for the auth_token token cache by setting the memcached_servers option.
Sep 28 13:08:55 ctl02 neutron-server[30536]: 2017-09-28 13:08:55.395 30597 INFO neutron.wsgi [req-19d2274b-0c6a-49e4-8b72-07943777b040 47d6ef1b5476456ea76a1f62f17c0bea 5f384790c44b46a1986075a6d7985b8c - - -] 10.167.4.13 - - [28/Sep/2017 13:08:55] "GET /v2.0/vpn/ipsec-site-connections.json HTTP/1.1" 404 261 0.160278
Sep 28 13:08:55 ctl02 nova-conductor[5056]: 2017-09-28 13:08:55.414 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:08:55 ctl02 nova-conductor[5056]: 2017-09-28 13:08:55.414 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:08:55 ctl02 nova-conductor[5056]: 2017-09-28 13:08:55.420 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:08:55 ctl02 nova-conductor[5056]: 2017-09-28 13:08:55.422 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:08:55 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb5e99049)
Sep 28 13:08:55 ctl02 nova-api[18074]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:08:55 ctl02 nova-api[18074]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:08:56 ctl02 nova-api[18074]: 2017-09-28 13:08:56.021 18074 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:08:56 ctl02 nova-api[18074]: 2017-09-28 13:08:56.022 18074 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:08:56 ctl02 nova-api[18074]: 2017-09-28 13:08:56.022 18074 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:08:56 ctl02 nova-api[18074]: 2017-09-28 13:08:56.022 18074 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:08:56 ctl02 nova-api[18074]: 2017-09-28 13:08:56.022 18074 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:08:56 ctl02 nova-api[18074]: 2017-09-28 13:08:56.022 18074 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:08:56 ctl02 nova-api[18074]: 2017-09-28 13:08:56.022 18074 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:08:56 ctl02 nova-api[18074]: 2017-09-28 13:08:56.022 18074 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:08:56 ctl02 nova-api[18074]: 2017-09-28 13:08:56.022 18074 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:08:56 ctl02 nova-api[18074]: 2017-09-28 13:08:56.022 18074 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:08:56 ctl02 nova-api[18074]: 2017-09-28 13:08:56.022 18074 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:08:56 ctl02 nova-api[18074]: 2017-09-28 13:08:56.022 18074 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:08:56 ctl02 nova-api[18074]: 2017-09-28 13:08:56.022 18074 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:08:56 ctl02 nova-api[18074]: 2017-09-28 13:08:56.022 18074 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:08:56 ctl02 nova-api[18074]: 2017-09-28 13:08:56.022 18074 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:08:56 ctl02 nova-api[18074]: 2017-09-28 13:08:56.022 18074 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:08:56 ctl02 nova-api[18074]: 2017-09-28 13:08:56.022 18074 ERROR nova.wsgi     self.filename))
Sep 28 13:08:56 ctl02 nova-api[18074]: 2017-09-28 13:08:56.022 18074 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:08:56 ctl02 nova-api[18074]: 2017-09-28 13:08:56.022 18074 ERROR nova.wsgi
Sep 28 13:08:56 ctl02 nova-api[18074]: 2017-09-28 13:08:56.023 18074 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:08:56 ctl02 nova-api[18074]: 2017-09-28 13:08:56.152 18074 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.226 30596 INFO neutron.wsgi [req-c2245d54-6619-41a0-9d9e-f8919f036a5e 47d6ef1b5476456ea76a1f62f17c0bea 5f384790c44b46a1986075a6d7985b8c - - -] 10.167.4.13 - - [28/Sep/2017 13:08:56] "GET /v2.0/lbaas/healthmonitors.json HTTP/1.1" 404 261 0.028954
Sep 28 13:08:56 ctl02 nova-api[18074]: 2017-09-28 13:08:56.378 18074 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.379 30596 INFO neutron.wsgi [req-c0814be6-d26f-4e99-aace-c5bf7c19c065 47d6ef1b5476456ea76a1f62f17c0bea 5f384790c44b46a1986075a6d7985b8c - - -] 10.167.4.13 - - [28/Sep/2017 13:08:56] "GET /v2.0/lbaas/pools.json HTTP/1.1" 404 261 0.024851
Sep 28 13:08:56 ctl02 nova-api[18074]: 2017-09-28 13:08:56.381 18074 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:08:56 ctl02 nova-api[18074]: 2017-09-28 13:08:56.381 18074 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:08:56 ctl02 nova-api[18074]: 2017-09-28 13:08:56.381 18074 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:08:56 ctl02 nova-cert[4860]: 2017-09-28 13:08:56.425 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:08:56 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb5e99049)
Sep 28 13:08:56 ctl02 nova-api[18074]: 2017-09-28 13:08:56.518 18074 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:08:56 ctl02 nova-api[18074]: 2017-09-28 13:08:56.519 18074 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:08:56 ctl02 nova-api[18074]: 2017-09-28 13:08:56.520 18074 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:08:56 ctl02 nova-api[18074]: 2017-09-28 13:08:56.520 18074 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:08:56 ctl02 nova-api[18074]: 2017-09-28 13:08:56.523 18074 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:08:56 ctl02 nova-api[18074]: 2017-09-28 13:08:56.524 18074 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:08:56 ctl02 nova-api[18074]: 2017-09-28 13:08:56.524 18074 ERROR nova Traceback (most recent call last):
Sep 28 13:08:56 ctl02 nova-api[18074]: 2017-09-28 13:08:56.524 18074 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:08:56 ctl02 nova-api[18074]: 2017-09-28 13:08:56.524 18074 ERROR nova     sys.exit(main())
Sep 28 13:08:56 ctl02 nova-api[18074]: 2017-09-28 13:08:56.524 18074 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:08:56 ctl02 nova-api[18074]: 2017-09-28 13:08:56.524 18074 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:08:56 ctl02 nova-api[18074]: 2017-09-28 13:08:56.524 18074 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:08:56 ctl02 nova-api[18074]: 2017-09-28 13:08:56.524 18074 ERROR nova     max_url_len=max_url_len)
Sep 28 13:08:56 ctl02 nova-api[18074]: 2017-09-28 13:08:56.524 18074 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:08:56 ctl02 nova-api[18074]: 2017-09-28 13:08:56.524 18074 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:08:56 ctl02 nova-api[18074]: 2017-09-28 13:08:56.524 18074 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:08:56 ctl02 nova-api[18074]: 2017-09-28 13:08:56.524 18074 ERROR nova     sock.listen(backlog)
Sep 28 13:08:56 ctl02 nova-api[18074]: 2017-09-28 13:08:56.524 18074 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:08:56 ctl02 nova-api[18074]: 2017-09-28 13:08:56.524 18074 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:08:56 ctl02 nova-api[18074]: 2017-09-28 13:08:56.524 18074 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:08:56 ctl02 nova-api[18074]: 2017-09-28 13:08:56.524 18074 ERROR nova
Sep 28 13:08:56 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:08:56 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:08:56 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.746 30597 ERROR oslo_db.sqlalchemy.exc_filters [req-19c21918-a902-48bf-94c9-38c9ef97a4d6 47d6ef1b5476456ea76a1f62f17c0bea 5f384790c44b46a1986075a6d7985b8c - - -] DBAPIError exception wrapped from (pymysql.err.InternalError) (1054, u"Unknown column 'floatingips.tenant_id' in 'field list'") [SQL: u'SELECT floatingips.tenant_id AS floatingips_tenant_id, floatingips.id AS floatingips_id, floatingips.floating_ip_address AS floatingips_floating_ip_address, floatingips.floating_network_id AS floatingips_floating_network_id, floatingips.floating_port_id AS floatingips_floating_port_id, floatingips.fixed_port_id AS floatingips_fixed_port_id, floatingips.fixed_ip_address AS floatingips_fixed_ip_address, floatingips.router_id AS floatingips_router_id, floatingips.last_known_router_id AS floatingips_last_known_router_id, floatingips.status AS floatingips_status, floatingips.standard_attr_id AS floatingips_standard_attr_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, floatingipdnses_1.floatingip_id AS floatingipdnses_1_floatingip_id, floatingipdnses_1.dns_name AS floatingipdnses_1_dns_name, floatingipdnses_1.dns_domain AS floatingipdnses_1_dns_domain, floatingipdnses_1.published_dns_name AS floatingipdnses_1_published_dns_name, floatingipdnses_1.published_dns_domain AS floatingipdnses_1_published_dns_domain \nFROM floatingips LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = floatingips.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN floatingipdnses AS floatingipdnses_1 ON floatingips.id = floatingipdnses_1.floatingip_id']
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.746 30597 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.746 30597 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.746 30597 ERROR oslo_db.sqlalchemy.exc_filters     context)
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.746 30597 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.746 30597 ERROR oslo_db.sqlalchemy.exc_filters     cursor.execute(statement, parameters)
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.746 30597 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.746 30597 ERROR oslo_db.sqlalchemy.exc_filters     result = self._query(query)
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.746 30597 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.746 30597 ERROR oslo_db.sqlalchemy.exc_filters     conn.query(q)
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.746 30597 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.746 30597 ERROR oslo_db.sqlalchemy.exc_filters     self._affected_rows = self._read_query_result(unbuffered=unbuffered)
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.746 30597 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.746 30597 ERROR oslo_db.sqlalchemy.exc_filters     result.read()
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.746 30597 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.746 30597 ERROR oslo_db.sqlalchemy.exc_filters     first_packet = self.connection._read_packet()
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.746 30597 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.746 30597 ERROR oslo_db.sqlalchemy.exc_filters     packet.check_error()
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.746 30597 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.746 30597 ERROR oslo_db.sqlalchemy.exc_filters     err.raise_mysql_exception(self._data)
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.746 30597 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.746 30597 ERROR oslo_db.sqlalchemy.exc_filters     _check_mysql_exception(errinfo)
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.746 30597 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.746 30597 ERROR oslo_db.sqlalchemy.exc_filters     raise InternalError(errno, errorvalue)
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.746 30597 ERROR oslo_db.sqlalchemy.exc_filters InternalError: (1054, u"Unknown column 'floatingips.tenant_id' in 'field list'")
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.746 30597 ERROR oslo_db.sqlalchemy.exc_filters
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.750 30597 ERROR neutron.api.v2.resource [req-19c21918-a902-48bf-94c9-38c9ef97a4d6 47d6ef1b5476456ea76a1f62f17c0bea 5f384790c44b46a1986075a6d7985b8c - - -] index failed
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.750 30597 ERROR neutron.api.v2.resource Traceback (most recent call last):
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.750 30597 ERROR neutron.api.v2.resource   File "/usr/lib/python2.7/dist-packages/neutron/api/v2/resource.py", line 84, in resource
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.750 30597 ERROR neutron.api.v2.resource     result = method(request=request, **args)
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.750 30597 ERROR neutron.api.v2.resource   File "/usr/lib/python2.7/dist-packages/oslo_db/api.py", line 148, in wrapper
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.750 30597 ERROR neutron.api.v2.resource     ectxt.value = e.inner_exc
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.750 30597 ERROR neutron.api.v2.resource   File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.750 30597 ERROR neutron.api.v2.resource     self.force_reraise()
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.750 30597 ERROR neutron.api.v2.resource   File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.750 30597 ERROR neutron.api.v2.resource     six.reraise(self.type_, self.value, self.tb)
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.750 30597 ERROR neutron.api.v2.resource   File "/usr/lib/python2.7/dist-packages/oslo_db/api.py", line 138, in wrapper
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.750 30597 ERROR neutron.api.v2.resource     return f(*args, **kwargs)
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.750 30597 ERROR neutron.api.v2.resource   File "/usr/lib/python2.7/dist-packages/neutron/api/v2/base.py", line 341, in index
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.750 30597 ERROR neutron.api.v2.resource     return self._items(request, True, parent_id)
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.750 30597 ERROR neutron.api.v2.resource   File "/usr/lib/python2.7/dist-packages/neutron/api/v2/base.py", line 267, in _items
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.750 30597 ERROR neutron.api.v2.resource     obj_list = obj_getter(request.context, **kwargs)
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.750 30597 ERROR neutron.api.v2.resource   File "/usr/lib/python2.7/dist-packages/neutron/db/l3_db.py", line 1274, in get_floatingips
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.750 30597 ERROR neutron.api.v2.resource     page_reverse=page_reverse)
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.750 30597 ERROR neutron.api.v2.resource   File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.750 30597 ERROR neutron.api.v2.resource     items = [dict_func(c, fields) for c in query]
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.750 30597 ERROR neutron.api.v2.resource   File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.750 30597 ERROR neutron.api.v2.resource     return self._execute_and_instances(context)
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.750 30597 ERROR neutron.api.v2.resource   File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.750 30597 ERROR neutron.api.v2.resource     result = conn.execute(querycontext.statement, self._params)
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.750 30597 ERROR neutron.api.v2.resource   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.750 30597 ERROR neutron.api.v2.resource     return meth(self, multiparams, params)
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.750 30597 ERROR neutron.api.v2.resource   File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.750 30597 ERROR neutron.api.v2.resource     return connection._execute_clauseelement(self, multiparams, params)
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.750 30597 ERROR neutron.api.v2.resource   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.750 30597 ERROR neutron.api.v2.resource     compiled_sql, distilled_params
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.750 30597 ERROR neutron.api.v2.resource   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.750 30597 ERROR neutron.api.v2.resource     context)
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.750 30597 ERROR neutron.api.v2.resource   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.750 30597 ERROR neutron.api.v2.resource     util.raise_from_cause(newraise, exc_info)
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.750 30597 ERROR neutron.api.v2.resource   File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.750 30597 ERROR neutron.api.v2.resource     reraise(type(exception), exception, tb=exc_tb)
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.750 30597 ERROR neutron.api.v2.resource   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.750 30597 ERROR neutron.api.v2.resource     context)
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.750 30597 ERROR neutron.api.v2.resource   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.750 30597 ERROR neutron.api.v2.resource     cursor.execute(statement, parameters)
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.750 30597 ERROR neutron.api.v2.resource   File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.750 30597 ERROR neutron.api.v2.resource     result = self._query(query)
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.750 30597 ERROR neutron.api.v2.resource   File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.750 30597 ERROR neutron.api.v2.resource     conn.query(q)
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.750 30597 ERROR neutron.api.v2.resource   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.750 30597 ERROR neutron.api.v2.resource     self._affected_rows = self._read_query_result(unbuffered=unbuffered)
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.750 30597 ERROR neutron.api.v2.resource   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.750 30597 ERROR neutron.api.v2.resource     result.read()
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.750 30597 ERROR neutron.api.v2.resource   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.750 30597 ERROR neutron.api.v2.resource     first_packet = self.connection._read_packet()
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.750 30597 ERROR neutron.api.v2.resource   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.750 30597 ERROR neutron.api.v2.resource     packet.check_error()
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.750 30597 ERROR neutron.api.v2.resource   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.750 30597 ERROR neutron.api.v2.resource     err.raise_mysql_exception(self._data)
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.750 30597 ERROR neutron.api.v2.resource   File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.750 30597 ERROR neutron.api.v2.resource     _check_mysql_exception(errinfo)
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.750 30597 ERROR neutron.api.v2.resource   File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.750 30597 ERROR neutron.api.v2.resource     raise InternalError(errno, errorvalue)
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.750 30597 ERROR neutron.api.v2.resource DBError: (pymysql.err.InternalError) (1054, u"Unknown column 'floatingips.tenant_id' in 'field list'") [SQL: u'SELECT floatingips.tenant_id AS floatingips_tenant_id, floatingips.id AS floatingips_id, floatingips.floating_ip_address AS floatingips_floating_ip_address, floatingips.floating_network_id AS floatingips_floating_network_id, floatingips.floating_port_id AS floatingips_floating_port_id, floatingips.fixed_port_id AS floatingips_fixed_port_id, floatingips.fixed_ip_address AS floatingips_fixed_ip_address, floatingips.router_id AS floatingips_router_id, floatingips.last_known_router_id AS floatingips_last_known_router_id, floatingips.status AS floatingips_status, floatingips.standard_attr_id AS floatingips_standard_attr_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, floatingipdnses_1.floatingip_id AS floatingipdnses_1_floatingip_id, floatingipdnses_1.dns_name AS floatingipdnses_1_dns_name, floatingipdnses_1.dns_domain AS floatingipdnses_1_dns_domain, floatingipdnses_1.published_dns_name AS floatingipdnses_1_published_dns_name, floatingipdnses_1.published_dns_domain AS floatingipdnses_1_published_dns_domain \nFROM floatingips LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = floatingips.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN floatingipdnses AS floatingipdnses_1 ON floatingips.id = floatingipdnses_1.floatingip_id']
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.750 30597 ERROR neutron.api.v2.resource
Sep 28 13:08:56 ctl02 neutron-server[30536]: 2017-09-28 13:08:56.754 30597 INFO neutron.wsgi [req-19c21918-a902-48bf-94c9-38c9ef97a4d6 47d6ef1b5476456ea76a1f62f17c0bea 5f384790c44b46a1986075a6d7985b8c - - -] 10.167.4.13 - - [28/Sep/2017 13:08:56] "GET /v2.0/floatingips.json HTTP/1.1" 500 378 0.061248
Sep 28 13:08:56 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:08:56 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:08:56 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:08:56 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:08:56 ctl02 heat-api-cfn[13300]: 2017-09-28 13:08:56.981 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:08:56] "OPTIONS / HTTP/1.0" 200 134 0.000436
Sep 28 13:08:56 ctl02 glance-api[29183]: /usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/enginefacade.py:1056: OsloDBDeprecationWarning: EngineFacade is deprecated; please use oslo_db.sqlalchemy.enginefacade
Sep 28 13:08:57 ctl02 glance-api[29183]:   expire_on_commit=expire_on_commit, _conf=conf)
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.160 29254 ERROR oslo_db.sqlalchemy.exc_filters [req-789334ad-0584-4832-8316-bba1c8cf5561 47d6ef1b5476456ea76a1f62f17c0bea 5f384790c44b46a1986075a6d7985b8c - - -] DBAPIError exception wrapped from (pymysql.err.InternalError) (1054, u"Unknown column 'images.is_public' in 'field list'") [SQL: u'SELECT anon_1.images_created_at AS anon_1_images_created_at, anon_1.images_updated_at AS anon_1_images_updated_at, anon_1.images_deleted_at AS anon_1_images_deleted_at, anon_1.images_deleted AS anon_1_images_deleted, anon_1.images_id AS anon_1_images_id, anon_1.images_name AS anon_1_images_name, anon_1.images_disk_format AS anon_1_images_disk_format, anon_1.images_container_format AS anon_1_images_container_format, anon_1.images_size AS anon_1_images_size, anon_1.images_virtual_size AS anon_1_images_virtual_size, anon_1.images_status AS anon_1_images_status, anon_1.images_is_public AS anon_1_images_is_public, anon_1.images_checksum AS anon_1_images_checksum, anon_1.images_min_disk AS anon_1_images_min_disk, anon_1.images_min_ram AS anon_1_images_min_ram, anon_1.images_owner AS anon_1_images_owner, anon_1.images_protected AS anon_1_images_protected, image_tags_1.created_at AS image_tags_1_created_at, image_tags_1.updated_at AS image_tags_1_updated_at, image_tags_1.deleted_at AS image_tags_1_deleted_at, image_tags_1.deleted AS image_tags_1_deleted, image_tags_1.id AS image_tags_1_id, image_tags_1.image_id AS image_tags_1_image_id, image_tags_1.value AS image_tags_1_value, image_properties_1.created_at AS image_properties_1_created_at, image_properties_1.updated_at AS image_properties_1_updated_at, image_properties_1.deleted_at AS image_properties_1_deleted_at, image_properties_1.deleted AS image_properties_1_deleted, image_properties_1.id AS image_properties_1_id, image_properties_1.image_id AS image_properties_1_image_id, image_properties_1.name AS image_properties_1_name, image_properties_1.value AS image_properties_1_value, image_locations_1.created_at AS image_locations_1_created_at, image_locations_1.up
Sep 28 13:08:57 ctl02 glance-api[29183]: dated_at AS image_locations_1_updated_at, image_locations_1.deleted_at AS image_locations_1_deleted_at, image_locations_1.deleted AS image_locations_1_deleted, image_locations_1.id AS image_locations_1_id, image_locations_1.image_id AS image_locations_1_image_id, image_locations_1.value AS image_locations_1_value, image_locations_1.meta_data AS image_locations_1_meta_data, image_locations_1.status AS image_locations_1_status \nFROM (SELECT images.created_at AS images_created_at, images.updated_at AS images_updated_at, images.deleted_at AS images_deleted_at, images.deleted AS images_deleted, images.id AS images_id, images.name AS images_name, images.disk_format AS images_disk_format, images.container_format AS images_container_format, images.size AS images_size, images.virtual_size AS images_virtual_size, images.status AS images_status, images.is_public AS images_is_public, images.checksum AS images_checksum, images.min_disk AS images_min_disk, images.min_ram AS images_min_ram, images.owner AS images_owner, images.protected AS images_protected \nFROM images \nWHERE images.deleted = false AND images.status IN (%(status_1)s, %(status_2)s, %(status_3)s, %(status_4)s, %(status_5)s, %(status_6)s) ORDER BY images.created_at DESC, images.id DESC \n LIMIT %(param_1)s) AS anon_1 LEFT OUTER JOIN image_tags AS image_tags_1 ON anon_1.images_id = image_tags_1.image_id LEFT OUTER JOIN image_properties AS image_properties_1 ON anon_1.images_id = image_properties_1.image_id LEFT OUTER JOIN image_locations AS image_locations_1 ON anon_1.images_id = image_locations_1.image_id ORDER BY anon_1.images_created_at DESC, anon_1.images_id DESC'] [parameters: {u'param_1': 20, u'status_6': 'deactivated', u'status_5': 'deleted', u'status_4': 'pending_delete', u'status_3': 'queued', u'status_2': 'saving', u'status_1': 'active'}]
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.160 29254 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.160 29254 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.160 29254 ERROR oslo_db.sqlalchemy.exc_filters     context)
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.160 29254 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.160 29254 ERROR oslo_db.sqlalchemy.exc_filters     cursor.execute(statement, parameters)
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.160 29254 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.160 29254 ERROR oslo_db.sqlalchemy.exc_filters     result = self._query(query)
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.160 29254 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.160 29254 ERROR oslo_db.sqlalchemy.exc_filters     conn.query(q)
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.160 29254 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.160 29254 ERROR oslo_db.sqlalchemy.exc_filters     self._affected_rows = self._read_query_result(unbuffered=unbuffered)
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.160 29254 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.160 29254 ERROR oslo_db.sqlalchemy.exc_filters     result.read()
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.160 29254 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.160 29254 ERROR oslo_db.sqlalchemy.exc_filters     first_packet = self.connection._read_packet()
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.160 29254 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.160 29254 ERROR oslo_db.sqlalchemy.exc_filters     packet.check_error()
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.160 29254 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.160 29254 ERROR oslo_db.sqlalchemy.exc_filters     err.raise_mysql_exception(self._data)
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.160 29254 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.160 29254 ERROR oslo_db.sqlalchemy.exc_filters     _check_mysql_exception(errinfo)
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.160 29254 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.160 29254 ERROR oslo_db.sqlalchemy.exc_filters     raise InternalError(errno, errorvalue)
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.160 29254 ERROR oslo_db.sqlalchemy.exc_filters InternalError: (1054, u"Unknown column 'images.is_public' in 'field list'")
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.160 29254 ERROR oslo_db.sqlalchemy.exc_filters
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi [req-789334ad-0584-4832-8316-bba1c8cf5561 47d6ef1b5476456ea76a1f62f17c0bea 5f384790c44b46a1986075a6d7985b8c - - -] Caught error: (pymysql.err.InternalError) (1054, u"Unknown column 'images.is_public' in 'field list'") [SQL: u'SELECT anon_1.images_created_at AS anon_1_images_created_at, anon_1.images_updated_at AS anon_1_images_updated_at, anon_1.images_deleted_at AS anon_1_images_deleted_at, anon_1.images_deleted AS anon_1_images_deleted, anon_1.images_id AS anon_1_images_id, anon_1.images_name AS anon_1_images_name, anon_1.images_disk_format AS anon_1_images_disk_format, anon_1.images_container_format AS anon_1_images_container_format, anon_1.images_size AS anon_1_images_size, anon_1.images_virtual_size AS anon_1_images_virtual_size, anon_1.images_status AS anon_1_images_status, anon_1.images_is_public AS anon_1_images_is_public, anon_1.images_checksum AS anon_1_images_checksum, anon_1.images_min_disk AS anon_1_images_min_disk, anon_1.images_min_ram AS anon_1_images_min_ram, anon_1.images_owner AS anon_1_images_owner, anon_1.images_protected AS anon_1_images_protected, image_tags_1.created_at AS image_tags_1_created_at, image_tags_1.updated_at AS image_tags_1_updated_at, image_tags_1.deleted_at AS image_tags_1_deleted_at, image_tags_1.deleted AS image_tags_1_deleted, image_tags_1.id AS image_tags_1_id, image_tags_1.image_id AS image_tags_1_image_id, image_tags_1.value AS image_tags_1_value, image_properties_1.created_at AS image_properties_1_created_at, image_properties_1.updated_at AS image_properties_1_updated_at, image_properties_1.deleted_at AS image_properties_1_deleted_at, image_properties_1.deleted AS image_properties_1_deleted, image_properties_1.id AS image_properties_1_id, image_properties_1.image_id AS image_properties_1_image_id, image_properties_1.name AS image_properties_1_name, image_properties_1.value AS image_properties_1_value, image_locations_1.created_at AS image_locations_1_created_at, image_locations_1.updated_at AS image_locations_1_up
Sep 28 13:08:57 ctl02 glance-api[29183]: dated_at, image_locations_1.deleted_at AS image_locations_1_deleted_at, image_locations_1.deleted AS image_locations_1_deleted, image_locations_1.id AS image_locations_1_id, image_locations_1.image_id AS image_locations_1_image_id, image_locations_1.value AS image_locations_1_value, image_locations_1.meta_data AS image_locations_1_meta_data, image_locations_1.status AS image_locations_1_status \nFROM (SELECT images.created_at AS images_created_at, images.updated_at AS images_updated_at, images.deleted_at AS images_deleted_at, images.deleted AS images_deleted, images.id AS images_id, images.name AS images_name, images.disk_format AS images_disk_format, images.container_format AS images_container_format, images.size AS images_size, images.virtual_size AS images_virtual_size, images.status AS images_status, images.is_public AS images_is_public, images.checksum AS images_checksum, images.min_disk AS images_min_disk, images.min_ram AS images_min_ram, images.owner AS images_owner, images.protected AS images_protected \nFROM images \nWHERE images.deleted = false AND images.status IN (%(status_1)s, %(status_2)s, %(status_3)s, %(status_4)s, %(status_5)s, %(status_6)s) ORDER BY images.created_at DESC, images.id DESC \n LIMIT %(param_1)s) AS anon_1 LEFT OUTER JOIN image_tags AS image_tags_1 ON anon_1.images_id = image_tags_1.image_id LEFT OUTER JOIN image_properties AS image_properties_1 ON anon_1.images_id = image_properties_1.image_id LEFT OUTER JOIN image_locations AS image_locations_1 ON anon_1.images_id = image_locations_1.image_id ORDER BY anon_1.images_created_at DESC, anon_1.images_id DESC'] [parameters: {u'param_1': 20, u'status_6': 'deactivated', u'status_5': 'deleted', u'status_4': 'pending_delete', u'status_3': 'queued', u'status_2': 'saving', u'status_1': 'active'}]
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi Traceback (most recent call last):
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi   File "/usr/lib/python2.7/dist-packages/glance/common/wsgi.py", line 902, in __call__
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi     request, **action_args)
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi   File "/usr/lib/python2.7/dist-packages/glance/common/wsgi.py", line 941, in dispatch
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi     return method(*args, **kwargs)
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi   File "/usr/lib/python2.7/dist-packages/glance/api/v2/images.py", line 110, in index
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi     member_status=member_status)
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi   File "/usr/lib/python2.7/dist-packages/glance/api/authorization.py", line 111, in list
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi     images = self.image_repo.list(*args, **kwargs)
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi   File "/usr/lib/python2.7/dist-packages/glance/domain/proxy.py", line 89, in list
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi     items = self.base.list(*args, **kwargs)
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi   File "/usr/lib/python2.7/dist-packages/glance/api/policy.py", line 121, in list
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi     return super(ImageRepoProxy, self).list(*args, **kwargs)
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi   File "/usr/lib/python2.7/dist-packages/glance/domain/proxy.py", line 89, in list
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi     items = self.base.list(*args, **kwargs)
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi   File "/usr/lib/python2.7/dist-packages/glance/domain/proxy.py", line 89, in list
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi     items = self.base.list(*args, **kwargs)
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi   File "/usr/lib/python2.7/dist-packages/glance/domain/proxy.py", line 89, in list
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi     items = self.base.list(*args, **kwargs)
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi   File "/usr/lib/python2.7/dist-packages/glance/db/__init__.py", line 180, in list
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi     member_status=member_status, return_tag=True)
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi   File "/usr/lib/python2.7/dist-packages/glance/db/sqlalchemy/api.py", line 678, in image_get_all
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi     for image in query.all():
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi   File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2588, in all
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi     return list(self)
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi   File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi     return self._execute_and_instances(context)
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi   File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi     result = conn.execute(querycontext.statement, self._params)
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi     return meth(self, multiparams, params)
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi   File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi     return connection._execute_clauseelement(self, multiparams, params)
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi     compiled_sql, distilled_params
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi     context)
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi     util.raise_from_cause(newraise, exc_info)
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi   File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi     reraise(type(exception), exception, tb=exc_tb)
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi     context)
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi     cursor.execute(statement, parameters)
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi   File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi     result = self._query(query)
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi   File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi     conn.query(q)
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi     self._affected_rows = self._read_query_result(unbuffered=unbuffered)
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi     result.read()
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi     first_packet = self.connection._read_packet()
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi     packet.check_error()
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi     err.raise_mysql_exception(self._data)
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi   File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi     _check_mysql_exception(errinfo)
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi   File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi     raise InternalError(errno, errorvalue)
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi DBError: (pymysql.err.InternalError) (1054, u"Unknown column 'images.is_public' in 'field list'") [SQL: u'SELECT anon_1.images_created_at AS anon_1_images_created_at, anon_1.images_updated_at AS anon_1_images_updated_at, anon_1.images_deleted_at AS anon_1_images_deleted_at, anon_1.images_deleted AS anon_1_images_deleted, anon_1.images_id AS anon_1_images_id, anon_1.images_name AS anon_1_images_name, anon_1.images_disk_format AS anon_1_images_disk_format, anon_1.images_container_format AS anon_1_images_container_format, anon_1.images_size AS anon_1_images_size, anon_1.images_virtual_size AS anon_1_images_virtual_size, anon_1.images_status AS anon_1_images_status, anon_1.images_is_public AS anon_1_images_is_public, anon_1.images_checksum AS anon_1_images_checksum, anon_1.images_min_disk AS anon_1_images_min_disk, anon_1.images_min_ram AS anon_1_images_min_ram, anon_1.images_owner AS anon_1_images_owner, anon_1.images_protected AS anon_1_images_protected, image_tags_1.created_at AS image_tags_1_created_at, image_tags_1.updated_at AS image_tags_1_updated_at, image_tags_1.deleted_at AS image_tags_1_deleted_at, image_tags_1.deleted AS image_tags_1_deleted, image_tags_1.id AS image_tags_1_id, image_tags_1.image_id AS image_tags_1_image_id, image_tags_1.value AS image_tags_1_value, image_properties_1.created_at AS image_properties_1_created_at, image_properties_1.updated_at AS image_properties_1_updated_at, image_properties_1.deleted_at AS image_properties_1_deleted_at, image_properties_1.deleted AS image_properties_1_deleted, image_properties_1.id AS image_properties_1_id, image_properties_1.image_id AS image_properties_1_image_id, image_properties_1.name AS image_properties_1_name, image_properties_1.value AS image_properties_1_value, image_locations_1.created_at AS image_locations_1_created_at, image_locations_1.updated_at AS image_locations_1_updated_at, image_locations_1.deleted_at AS image_locations_1_deleted_at, image_locations_1.deleted AS image_locations_1_d
Sep 28 13:08:57 ctl02 glance-api[29183]: eleted, image_locations_1.id AS image_locations_1_id, image_locations_1.image_id AS image_locations_1_image_id, image_locations_1.value AS image_locations_1_value, image_locations_1.meta_data AS image_locations_1_meta_data, image_locations_1.status AS image_locations_1_status \nFROM (SELECT images.created_at AS images_created_at, images.updated_at AS images_updated_at, images.deleted_at AS images_deleted_at, images.deleted AS images_deleted, images.id AS images_id, images.name AS images_name, images.disk_format AS images_disk_format, images.container_format AS images_container_format, images.size AS images_size, images.virtual_size AS images_virtual_size, images.status AS images_status, images.is_public AS images_is_public, images.checksum AS images_checksum, images.min_disk AS images_min_disk, images.min_ram AS images_min_ram, images.owner AS images_owner, images.protected AS images_protected \nFROM images \nWHERE images.deleted = false AND images.status IN (%(status_1)s, %(status_2)s, %(status_3)s, %(status_4)s, %(status_5)s, %(status_6)s) ORDER BY images.created_at DESC, images.id DESC \n LIMIT %(param_1)s) AS anon_1 LEFT OUTER JOIN image_tags AS image_tags_1 ON anon_1.images_id = image_tags_1.image_id LEFT OUTER JOIN image_properties AS image_properties_1 ON anon_1.images_id = image_properties_1.image_id LEFT OUTER JOIN image_locations AS image_locations_1 ON anon_1.images_id = image_locations_1.image_id ORDER BY anon_1.images_created_at DESC, anon_1.images_id DESC'] [parameters: {u'param_1': 20, u'status_6': 'deactivated', u'status_5': 'deleted', u'status_4': 'pending_delete', u'status_3': 'queued', u'status_2': 'saving', u'status_1': 'active'}]
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.163 29254 ERROR glance.common.wsgi
Sep 28 13:08:57 ctl02 glance-api[29183]: 2017-09-28 13:08:57.167 29254 INFO eventlet.wsgi.server [req-789334ad-0584-4832-8316-bba1c8cf5561 47d6ef1b5476456ea76a1f62f17c0bea 5f384790c44b46a1986075a6d7985b8c - - -] 10.167.4.13 - - [28/Sep/2017 13:08:57] "GET /v2/images?limit=20 HTTP/1.1" 500 449 0.270539
Sep 28 13:08:57 ctl02 neutron-server[30536]: 2017-09-28 13:08:57.398 30597 INFO neutron.wsgi [req-ef5fbc84-e3e7-4a52-a3c2-e6974c3ce525 47d6ef1b5476456ea76a1f62f17c0bea 5f384790c44b46a1986075a6d7985b8c - - -] 10.167.4.13 - - [28/Sep/2017 13:08:57] "GET /v2.0/vpn/ipsec-site-connections.json HTTP/1.1" 404 261 0.025893
Sep 28 13:08:57 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb5e99049)
Sep 28 13:08:57 ctl02 neutron-server[30536]: 2017-09-28 13:08:57.626 30596 INFO neutron.wsgi [req-af7c23de-2904-40f0-ae82-a38b8c91216a 47d6ef1b5476456ea76a1f62f17c0bea 5f384790c44b46a1986075a6d7985b8c - - -] 10.167.4.13 - - [28/Sep/2017 13:08:57] "GET /v2.0/lbaas/healthmonitors.json HTTP/1.1" 404 261 0.028570
Sep 28 13:08:57 ctl02 neutron-server[30536]: 2017-09-28 13:08:57.797 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:08:57] "OPTIONS / HTTP/1.0" 200 262 0.000491
Sep 28 13:08:58 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb5e99049)
Sep 28 13:08:58 ctl02 neutron-server[30536]: 2017-09-28 13:08:58.553 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 13:08:58 ctl02 nova-api[18091]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:08:58 ctl02 nova-api[18091]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:08:58 ctl02 nova-api[18091]: 2017-09-28 13:08:58.738 18091 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:08:58 ctl02 nova-api[18091]: 2017-09-28 13:08:58.739 18091 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:08:58 ctl02 nova-api[18091]: 2017-09-28 13:08:58.739 18091 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:08:58 ctl02 nova-api[18091]: 2017-09-28 13:08:58.739 18091 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:08:58 ctl02 nova-api[18091]: 2017-09-28 13:08:58.739 18091 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:08:58 ctl02 nova-api[18091]: 2017-09-28 13:08:58.739 18091 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:08:58 ctl02 nova-api[18091]: 2017-09-28 13:08:58.739 18091 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:08:58 ctl02 nova-api[18091]: 2017-09-28 13:08:58.739 18091 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:08:58 ctl02 nova-api[18091]: 2017-09-28 13:08:58.739 18091 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:08:58 ctl02 nova-api[18091]: 2017-09-28 13:08:58.739 18091 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:08:58 ctl02 nova-api[18091]: 2017-09-28 13:08:58.739 18091 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:08:58 ctl02 nova-api[18091]: 2017-09-28 13:08:58.739 18091 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:08:58 ctl02 nova-api[18091]: 2017-09-28 13:08:58.739 18091 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:08:58 ctl02 nova-api[18091]: 2017-09-28 13:08:58.739 18091 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:08:58 ctl02 nova-api[18091]: 2017-09-28 13:08:58.739 18091 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:08:58 ctl02 nova-api[18091]: 2017-09-28 13:08:58.739 18091 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:08:58 ctl02 nova-api[18091]: 2017-09-28 13:08:58.739 18091 ERROR nova.wsgi     self.filename))
Sep 28 13:08:58 ctl02 nova-api[18091]: 2017-09-28 13:08:58.739 18091 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:08:58 ctl02 nova-api[18091]: 2017-09-28 13:08:58.739 18091 ERROR nova.wsgi
Sep 28 13:08:58 ctl02 nova-api[18091]: 2017-09-28 13:08:58.741 18091 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:08:58 ctl02 heat-api-cfn[13300]: 2017-09-28 13:08:58.756 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:08:58] "OPTIONS / HTTP/1.0" 200 134 0.000558
Sep 28 13:08:58 ctl02 nova-api[18091]: 2017-09-28 13:08:58.867 18091 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:08:58 ctl02 heat-api[13008]: 2017-09-28 13:08:58.871 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:08:58] "OPTIONS / HTTP/1.0" 200 134 0.000580
Sep 28 13:08:59 ctl02 nova-api[18091]: 2017-09-28 13:08:59.094 18091 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:08:59 ctl02 nova-api[18091]: 2017-09-28 13:08:59.096 18091 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:08:59 ctl02 nova-api[18091]: 2017-09-28 13:08:59.096 18091 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:08:59 ctl02 nova-api[18091]: 2017-09-28 13:08:59.096 18091 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:08:59 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:08:59.128 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:08:59] "OPTIONS / HTTP/1.0" 200 134 0.000493
Sep 28 13:08:59 ctl02 nova-api[18091]: 2017-09-28 13:08:59.224 18091 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:08:59 ctl02 nova-api[18091]: 2017-09-28 13:08:59.226 18091 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:08:59 ctl02 nova-api[18091]: 2017-09-28 13:08:59.226 18091 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:08:59 ctl02 nova-api[18091]: 2017-09-28 13:08:59.226 18091 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:08:59 ctl02 nova-api[18091]: 2017-09-28 13:08:59.230 18091 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:08:59 ctl02 nova-api[18091]: 2017-09-28 13:08:59.230 18091 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:08:59 ctl02 nova-api[18091]: 2017-09-28 13:08:59.230 18091 ERROR nova Traceback (most recent call last):
Sep 28 13:08:59 ctl02 nova-api[18091]: 2017-09-28 13:08:59.230 18091 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:08:59 ctl02 nova-api[18091]: 2017-09-28 13:08:59.230 18091 ERROR nova     sys.exit(main())
Sep 28 13:08:59 ctl02 nova-api[18091]: 2017-09-28 13:08:59.230 18091 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:08:59 ctl02 nova-api[18091]: 2017-09-28 13:08:59.230 18091 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:08:59 ctl02 nova-api[18091]: 2017-09-28 13:08:59.230 18091 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:08:59 ctl02 nova-api[18091]: 2017-09-28 13:08:59.230 18091 ERROR nova     max_url_len=max_url_len)
Sep 28 13:08:59 ctl02 nova-api[18091]: 2017-09-28 13:08:59.230 18091 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:08:59 ctl02 nova-api[18091]: 2017-09-28 13:08:59.230 18091 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:08:59 ctl02 nova-api[18091]: 2017-09-28 13:08:59.230 18091 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:08:59 ctl02 nova-api[18091]: 2017-09-28 13:08:59.230 18091 ERROR nova     sock.listen(backlog)
Sep 28 13:08:59 ctl02 nova-api[18091]: 2017-09-28 13:08:59.230 18091 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:08:59 ctl02 nova-api[18091]: 2017-09-28 13:08:59.230 18091 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:08:59 ctl02 nova-api[18091]: 2017-09-28 13:08:59.230 18091 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:08:59 ctl02 nova-api[18091]: 2017-09-28 13:08:59.230 18091 ERROR nova
Sep 28 13:08:59 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:08:59 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:08:59 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:08:59 ctl02 heat-api[13008]: 2017-09-28 13:08:59.415 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:08:59] "OPTIONS / HTTP/1.0" 200 134 0.000754
Sep 28 13:08:59 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xb5e99049)
Sep 28 13:08:59 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:08:59 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:08:59 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:08:59 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:08:59 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:08:59.855 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:08:59] "OPTIONS / HTTP/1.0" 200 134 0.000406
Sep 28 13:09:00 ctl02 neutron-server[30536]: 2017-09-28 13:09:00.168 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:09:00] "OPTIONS / HTTP/1.0" 200 262 0.000518
Sep 28 13:09:00 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 13:09:00 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 13:09:00 ctl02 glance-api[29183]: 2017-09-28 13:09:00.746 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:09:00] "OPTIONS / HTTP/1.0" 200 134 0.000547
Sep 28 13:09:01 ctl02 nova-api[18110]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:09:01 ctl02 nova-api[18110]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:09:01 ctl02 nova-api[18110]: 2017-09-28 13:09:01.499 18110 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:09:01 ctl02 nova-api[18110]: 2017-09-28 13:09:01.500 18110 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:09:01 ctl02 nova-api[18110]: 2017-09-28 13:09:01.500 18110 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:09:01 ctl02 nova-api[18110]: 2017-09-28 13:09:01.500 18110 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:09:01 ctl02 nova-api[18110]: 2017-09-28 13:09:01.500 18110 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:09:01 ctl02 nova-api[18110]: 2017-09-28 13:09:01.500 18110 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:09:01 ctl02 nova-api[18110]: 2017-09-28 13:09:01.500 18110 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:09:01 ctl02 nova-api[18110]: 2017-09-28 13:09:01.500 18110 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:09:01 ctl02 nova-api[18110]: 2017-09-28 13:09:01.500 18110 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:09:01 ctl02 nova-api[18110]: 2017-09-28 13:09:01.500 18110 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:09:01 ctl02 nova-api[18110]: 2017-09-28 13:09:01.500 18110 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:09:01 ctl02 nova-api[18110]: 2017-09-28 13:09:01.500 18110 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:09:01 ctl02 nova-api[18110]: 2017-09-28 13:09:01.500 18110 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:09:01 ctl02 nova-api[18110]: 2017-09-28 13:09:01.500 18110 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:09:01 ctl02 nova-api[18110]: 2017-09-28 13:09:01.500 18110 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:09:01 ctl02 nova-api[18110]: 2017-09-28 13:09:01.500 18110 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:09:01 ctl02 nova-api[18110]: 2017-09-28 13:09:01.500 18110 ERROR nova.wsgi     self.filename))
Sep 28 13:09:01 ctl02 nova-api[18110]: 2017-09-28 13:09:01.500 18110 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:09:01 ctl02 nova-api[18110]: 2017-09-28 13:09:01.500 18110 ERROR nova.wsgi
Sep 28 13:09:01 ctl02 nova-api[18110]: 2017-09-28 13:09:01.501 18110 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:09:01 ctl02 nova-api[18110]: 2017-09-28 13:09:01.638 18110 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:09:01 ctl02 nova-api[18110]: 2017-09-28 13:09:01.892 18110 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:09:01 ctl02 nova-api[18110]: 2017-09-28 13:09:01.894 18110 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:09:01 ctl02 nova-api[18110]: 2017-09-28 13:09:01.894 18110 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:09:01 ctl02 nova-api[18110]: 2017-09-28 13:09:01.895 18110 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:09:02 ctl02 nova-api[18110]: 2017-09-28 13:09:02.032 18110 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:09:02 ctl02 nova-api[18110]: 2017-09-28 13:09:02.034 18110 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:09:02 ctl02 nova-api[18110]: 2017-09-28 13:09:02.034 18110 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:09:02 ctl02 nova-api[18110]: 2017-09-28 13:09:02.034 18110 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:09:02 ctl02 nova-api[18110]: 2017-09-28 13:09:02.038 18110 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:09:02 ctl02 nova-api[18110]: 2017-09-28 13:09:02.038 18110 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:09:02 ctl02 nova-api[18110]: 2017-09-28 13:09:02.038 18110 ERROR nova Traceback (most recent call last):
Sep 28 13:09:02 ctl02 nova-api[18110]: 2017-09-28 13:09:02.038 18110 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:09:02 ctl02 nova-api[18110]: 2017-09-28 13:09:02.038 18110 ERROR nova     sys.exit(main())
Sep 28 13:09:02 ctl02 nova-api[18110]: 2017-09-28 13:09:02.038 18110 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:09:02 ctl02 nova-api[18110]: 2017-09-28 13:09:02.038 18110 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:09:02 ctl02 nova-api[18110]: 2017-09-28 13:09:02.038 18110 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:09:02 ctl02 nova-api[18110]: 2017-09-28 13:09:02.038 18110 ERROR nova     max_url_len=max_url_len)
Sep 28 13:09:02 ctl02 nova-api[18110]: 2017-09-28 13:09:02.038 18110 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:09:02 ctl02 nova-api[18110]: 2017-09-28 13:09:02.038 18110 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:09:02 ctl02 nova-api[18110]: 2017-09-28 13:09:02.038 18110 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:09:02 ctl02 nova-api[18110]: 2017-09-28 13:09:02.038 18110 ERROR nova     sock.listen(backlog)
Sep 28 13:09:02 ctl02 nova-api[18110]: 2017-09-28 13:09:02.038 18110 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:09:02 ctl02 nova-api[18110]: 2017-09-28 13:09:02.038 18110 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:09:02 ctl02 nova-api[18110]: 2017-09-28 13:09:02.038 18110 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:09:02 ctl02 nova-api[18110]: 2017-09-28 13:09:02.038 18110 ERROR nova
Sep 28 13:09:02 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:09:02 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:09:02 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:09:02 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:09:02 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:09:02 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:09:02 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:09:02 ctl02 glance-api[29183]: 2017-09-28 13:09:02.589 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:09:02] "OPTIONS / HTTP/1.0" 200 134 0.000838
Sep 28 13:09:04 ctl02 nova-api[18132]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:09:04 ctl02 nova-api[18132]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:09:04 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:09:04.202 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:09:04] "OPTIONS / HTTP/1.0" 200 134 0.000429
Sep 28 13:09:04 ctl02 heat-api-cfn[13300]: 2017-09-28 13:09:04.240 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:09:04] "OPTIONS / HTTP/1.0" 200 134 0.000466
Sep 28 13:09:04 ctl02 nova-api[18132]: 2017-09-28 13:09:04.260 18132 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:09:04 ctl02 nova-api[18132]: 2017-09-28 13:09:04.261 18132 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:09:04 ctl02 nova-api[18132]: 2017-09-28 13:09:04.261 18132 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:09:04 ctl02 nova-api[18132]: 2017-09-28 13:09:04.261 18132 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:09:04 ctl02 nova-api[18132]: 2017-09-28 13:09:04.261 18132 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:09:04 ctl02 nova-api[18132]: 2017-09-28 13:09:04.261 18132 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:09:04 ctl02 nova-api[18132]: 2017-09-28 13:09:04.261 18132 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:09:04 ctl02 nova-api[18132]: 2017-09-28 13:09:04.261 18132 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:09:04 ctl02 nova-api[18132]: 2017-09-28 13:09:04.261 18132 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:09:04 ctl02 nova-api[18132]: 2017-09-28 13:09:04.261 18132 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:09:04 ctl02 nova-api[18132]: 2017-09-28 13:09:04.261 18132 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:09:04 ctl02 nova-api[18132]: 2017-09-28 13:09:04.261 18132 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:09:04 ctl02 nova-api[18132]: 2017-09-28 13:09:04.261 18132 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:09:04 ctl02 nova-api[18132]: 2017-09-28 13:09:04.261 18132 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:09:04 ctl02 nova-api[18132]: 2017-09-28 13:09:04.261 18132 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:09:04 ctl02 nova-api[18132]: 2017-09-28 13:09:04.261 18132 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:09:04 ctl02 nova-api[18132]: 2017-09-28 13:09:04.261 18132 ERROR nova.wsgi     self.filename))
Sep 28 13:09:04 ctl02 nova-api[18132]: 2017-09-28 13:09:04.261 18132 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:09:04 ctl02 nova-api[18132]: 2017-09-28 13:09:04.261 18132 ERROR nova.wsgi
Sep 28 13:09:04 ctl02 nova-api[18132]: 2017-09-28 13:09:04.262 18132 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:09:04 ctl02 nova-api[18132]: 2017-09-28 13:09:04.393 18132 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:09:04 ctl02 heat-api[13008]: 2017-09-28 13:09:04.624 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:09:04] "OPTIONS / HTTP/1.0" 200 134 0.000611
Sep 28 13:09:04 ctl02 nova-api[18132]: 2017-09-28 13:09:04.641 18132 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:09:04 ctl02 nova-api[18132]: 2017-09-28 13:09:04.643 18132 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:09:04 ctl02 nova-api[18132]: 2017-09-28 13:09:04.644 18132 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:09:04 ctl02 nova-api[18132]: 2017-09-28 13:09:04.644 18132 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:09:04 ctl02 nova-api[18132]: 2017-09-28 13:09:04.777 18132 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:09:04 ctl02 nova-api[18132]: 2017-09-28 13:09:04.779 18132 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:09:04 ctl02 nova-api[18132]: 2017-09-28 13:09:04.779 18132 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:09:04 ctl02 nova-api[18132]: 2017-09-28 13:09:04.780 18132 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:09:04 ctl02 nova-api[18132]: 2017-09-28 13:09:04.783 18132 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:09:04 ctl02 nova-api[18132]: 2017-09-28 13:09:04.783 18132 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:09:04 ctl02 nova-api[18132]: 2017-09-28 13:09:04.783 18132 ERROR nova Traceback (most recent call last):
Sep 28 13:09:04 ctl02 nova-api[18132]: 2017-09-28 13:09:04.783 18132 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:09:04 ctl02 nova-api[18132]: 2017-09-28 13:09:04.783 18132 ERROR nova     sys.exit(main())
Sep 28 13:09:04 ctl02 nova-api[18132]: 2017-09-28 13:09:04.783 18132 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:09:04 ctl02 nova-api[18132]: 2017-09-28 13:09:04.783 18132 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:09:04 ctl02 nova-api[18132]: 2017-09-28 13:09:04.783 18132 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:09:04 ctl02 nova-api[18132]: 2017-09-28 13:09:04.783 18132 ERROR nova     max_url_len=max_url_len)
Sep 28 13:09:04 ctl02 nova-api[18132]: 2017-09-28 13:09:04.783 18132 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:09:04 ctl02 nova-api[18132]: 2017-09-28 13:09:04.783 18132 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:09:04 ctl02 nova-api[18132]: 2017-09-28 13:09:04.783 18132 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:09:04 ctl02 nova-api[18132]: 2017-09-28 13:09:04.783 18132 ERROR nova     sock.listen(backlog)
Sep 28 13:09:04 ctl02 nova-api[18132]: 2017-09-28 13:09:04.783 18132 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:09:04 ctl02 nova-api[18132]: 2017-09-28 13:09:04.783 18132 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:09:04 ctl02 nova-api[18132]: 2017-09-28 13:09:04.783 18132 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:09:04 ctl02 nova-api[18132]: 2017-09-28 13:09:04.783 18132 ERROR nova
Sep 28 13:09:04 ctl02 neutron-server[30536]: 2017-09-28 13:09:04.841 30597 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:09:04] "OPTIONS / HTTP/1.0" 200 262 0.000532
Sep 28 13:09:04 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:09:04 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:09:04 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:09:05 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:09:05 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:09:05 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:09:05 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:09:05 ctl02 glance-api[29183]: 2017-09-28 13:09:05.353 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:09:05] "OPTIONS / HTTP/1.0" 200 134 0.000715
Sep 28 13:09:05 ctl02 neutron-server[30536]: 2017-09-28 13:09:05.960 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 13:09:05 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 13:09:05 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 13:07:06 cmp002
Sep 28 13:09:05 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 13:07:08 cmp001
Sep 28 13:09:05 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 13:07:36 cmp002
Sep 28 13:09:06 ctl02 nova-consoleauth[5433]: 2017-09-28 13:09:06.276 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:09:06 ctl02 heat-engine[12803]: 2017-09-28 13:09:06.528 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:09:06 ctl02 heat-engine[12803]: 2017-09-28 13:09:06.545 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:09:06 ctl02 heat-engine[12803]: 2017-09-28 13:09:06.554 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:09:06 ctl02 heat-engine[12803]: 2017-09-28 13:09:06.558 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:09:06 ctl02 nova-api[18151]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:09:06 ctl02 nova-api[18151]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:09:07 ctl02 nova-api[18151]: 2017-09-28 13:09:07.002 18151 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:09:07 ctl02 nova-api[18151]: 2017-09-28 13:09:07.004 18151 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:09:07 ctl02 nova-api[18151]: 2017-09-28 13:09:07.004 18151 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:09:07 ctl02 nova-api[18151]: 2017-09-28 13:09:07.004 18151 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:09:07 ctl02 nova-api[18151]: 2017-09-28 13:09:07.004 18151 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:09:07 ctl02 nova-api[18151]: 2017-09-28 13:09:07.004 18151 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:09:07 ctl02 nova-api[18151]: 2017-09-28 13:09:07.004 18151 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:09:07 ctl02 nova-api[18151]: 2017-09-28 13:09:07.004 18151 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:09:07 ctl02 nova-api[18151]: 2017-09-28 13:09:07.004 18151 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:09:07 ctl02 nova-api[18151]: 2017-09-28 13:09:07.004 18151 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:09:07 ctl02 nova-api[18151]: 2017-09-28 13:09:07.004 18151 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:09:07 ctl02 nova-api[18151]: 2017-09-28 13:09:07.004 18151 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:09:07 ctl02 nova-api[18151]: 2017-09-28 13:09:07.004 18151 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:09:07 ctl02 nova-api[18151]: 2017-09-28 13:09:07.004 18151 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:09:07 ctl02 nova-api[18151]: 2017-09-28 13:09:07.004 18151 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:09:07 ctl02 nova-api[18151]: 2017-09-28 13:09:07.004 18151 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:09:07 ctl02 nova-api[18151]: 2017-09-28 13:09:07.004 18151 ERROR nova.wsgi     self.filename))
Sep 28 13:09:07 ctl02 nova-api[18151]: 2017-09-28 13:09:07.004 18151 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:09:07 ctl02 nova-api[18151]: 2017-09-28 13:09:07.004 18151 ERROR nova.wsgi
Sep 28 13:09:07 ctl02 nova-api[18151]: 2017-09-28 13:09:07.005 18151 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:09:07 ctl02 nova-api[18151]: 2017-09-28 13:09:07.136 18151 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:09:07 ctl02 heat-api-cfn[13300]: 2017-09-28 13:09:07.267 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:09:07] "OPTIONS / HTTP/1.0" 200 134 0.000574
Sep 28 13:09:07 ctl02 nova-api[18151]: 2017-09-28 13:09:07.383 18151 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:09:07 ctl02 nova-api[18151]: 2017-09-28 13:09:07.385 18151 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:09:07 ctl02 nova-api[18151]: 2017-09-28 13:09:07.386 18151 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:09:07 ctl02 nova-api[18151]: 2017-09-28 13:09:07.386 18151 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:09:07 ctl02 nova-api[18151]: 2017-09-28 13:09:07.519 18151 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:09:07 ctl02 nova-api[18151]: 2017-09-28 13:09:07.522 18151 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:09:07 ctl02 nova-api[18151]: 2017-09-28 13:09:07.522 18151 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:09:07 ctl02 nova-api[18151]: 2017-09-28 13:09:07.523 18151 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:09:07 ctl02 nova-api[18151]: 2017-09-28 13:09:07.526 18151 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:09:07 ctl02 nova-api[18151]: 2017-09-28 13:09:07.527 18151 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:09:07 ctl02 nova-api[18151]: 2017-09-28 13:09:07.527 18151 ERROR nova Traceback (most recent call last):
Sep 28 13:09:07 ctl02 nova-api[18151]: 2017-09-28 13:09:07.527 18151 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:09:07 ctl02 nova-api[18151]: 2017-09-28 13:09:07.527 18151 ERROR nova     sys.exit(main())
Sep 28 13:09:07 ctl02 nova-api[18151]: 2017-09-28 13:09:07.527 18151 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:09:07 ctl02 nova-api[18151]: 2017-09-28 13:09:07.527 18151 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:09:07 ctl02 nova-api[18151]: 2017-09-28 13:09:07.527 18151 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:09:07 ctl02 nova-api[18151]: 2017-09-28 13:09:07.527 18151 ERROR nova     max_url_len=max_url_len)
Sep 28 13:09:07 ctl02 nova-api[18151]: 2017-09-28 13:09:07.527 18151 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:09:07 ctl02 nova-api[18151]: 2017-09-28 13:09:07.527 18151 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:09:07 ctl02 nova-api[18151]: 2017-09-28 13:09:07.527 18151 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:09:07 ctl02 nova-api[18151]: 2017-09-28 13:09:07.527 18151 ERROR nova     sock.listen(backlog)
Sep 28 13:09:07 ctl02 nova-api[18151]: 2017-09-28 13:09:07.527 18151 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:09:07 ctl02 nova-api[18151]: 2017-09-28 13:09:07.527 18151 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:09:07 ctl02 nova-api[18151]: 2017-09-28 13:09:07.527 18151 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:09:07 ctl02 nova-api[18151]: 2017-09-28 13:09:07.527 18151 ERROR nova
Sep 28 13:09:07 ctl02 neutron-server[30536]: 2017-09-28 13:09:07.612 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:09:07] "OPTIONS / HTTP/1.0" 200 262 0.000517
Sep 28 13:09:07 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:09:07 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:09:07 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:09:07 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:09:07 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:09:07 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:09:07 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:09:08 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x764bb44b)
Sep 28 13:09:08 ctl02 heat-api-cfn[13300]: 2017-09-28 13:09:08.429 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:09:08] "OPTIONS / HTTP/1.0" 200 134 0.000533
Sep 28 13:09:08 ctl02 heat-api[13008]: 2017-09-28 13:09:08.719 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:09:08] "OPTIONS / HTTP/1.0" 200 134 0.000627
Sep 28 13:09:09 ctl02 heat-api[13008]: 2017-09-28 13:09:09.358 13085 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:09:09] "OPTIONS / HTTP/1.0" 200 134 0.000598
Sep 28 13:09:09 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x764bb44b)
Sep 28 13:09:09 ctl02 nova-scheduler[5620]: 2017-09-28 13:09:09.392 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:09:09 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:09:09.433 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:09:09] "OPTIONS / HTTP/1.0" 200 134 0.000440
Sep 28 13:09:09 ctl02 nova-api[18168]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:09:09 ctl02 nova-api[18168]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:09:09 ctl02 nova-api[18168]: 2017-09-28 13:09:09.784 18168 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:09:09 ctl02 nova-api[18168]: 2017-09-28 13:09:09.786 18168 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:09:09 ctl02 nova-api[18168]: 2017-09-28 13:09:09.786 18168 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:09:09 ctl02 nova-api[18168]: 2017-09-28 13:09:09.786 18168 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:09:09 ctl02 nova-api[18168]: 2017-09-28 13:09:09.786 18168 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:09:09 ctl02 nova-api[18168]: 2017-09-28 13:09:09.786 18168 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:09:09 ctl02 nova-api[18168]: 2017-09-28 13:09:09.786 18168 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:09:09 ctl02 nova-api[18168]: 2017-09-28 13:09:09.786 18168 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:09:09 ctl02 nova-api[18168]: 2017-09-28 13:09:09.786 18168 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:09:09 ctl02 nova-api[18168]: 2017-09-28 13:09:09.786 18168 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:09:09 ctl02 nova-api[18168]: 2017-09-28 13:09:09.786 18168 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:09:09 ctl02 nova-api[18168]: 2017-09-28 13:09:09.786 18168 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:09:09 ctl02 nova-api[18168]: 2017-09-28 13:09:09.786 18168 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:09:09 ctl02 nova-api[18168]: 2017-09-28 13:09:09.786 18168 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:09:09 ctl02 nova-api[18168]: 2017-09-28 13:09:09.786 18168 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:09:09 ctl02 nova-api[18168]: 2017-09-28 13:09:09.786 18168 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:09:09 ctl02 nova-api[18168]: 2017-09-28 13:09:09.786 18168 ERROR nova.wsgi     self.filename))
Sep 28 13:09:09 ctl02 nova-api[18168]: 2017-09-28 13:09:09.786 18168 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:09:09 ctl02 nova-api[18168]: 2017-09-28 13:09:09.786 18168 ERROR nova.wsgi
Sep 28 13:09:09 ctl02 nova-api[18168]: 2017-09-28 13:09:09.787 18168 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:09:09 ctl02 nova-api[18168]: 2017-09-28 13:09:09.918 18168 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:09:10 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:09:10.062 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:09:10] "OPTIONS / HTTP/1.0" 200 134 0.000433
Sep 28 13:09:10 ctl02 neutron-server[30536]: 2017-09-28 13:09:10.107 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:09:10] "OPTIONS / HTTP/1.0" 200 262 0.000516
Sep 28 13:09:10 ctl02 nova-api[18168]: 2017-09-28 13:09:10.168 18168 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:09:10 ctl02 nova-api[18168]: 2017-09-28 13:09:10.170 18168 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:09:10 ctl02 nova-api[18168]: 2017-09-28 13:09:10.170 18168 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:09:10 ctl02 nova-api[18168]: 2017-09-28 13:09:10.170 18168 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:09:10 ctl02 nova-api[18168]: 2017-09-28 13:09:10.304 18168 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:09:10 ctl02 nova-api[18168]: 2017-09-28 13:09:10.306 18168 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:09:10 ctl02 nova-api[18168]: 2017-09-28 13:09:10.306 18168 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:09:10 ctl02 nova-api[18168]: 2017-09-28 13:09:10.306 18168 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:09:10 ctl02 nova-api[18168]: 2017-09-28 13:09:10.309 18168 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:09:10 ctl02 nova-api[18168]: 2017-09-28 13:09:10.310 18168 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:09:10 ctl02 nova-api[18168]: 2017-09-28 13:09:10.310 18168 ERROR nova Traceback (most recent call last):
Sep 28 13:09:10 ctl02 nova-api[18168]: 2017-09-28 13:09:10.310 18168 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:09:10 ctl02 nova-api[18168]: 2017-09-28 13:09:10.310 18168 ERROR nova     sys.exit(main())
Sep 28 13:09:10 ctl02 nova-api[18168]: 2017-09-28 13:09:10.310 18168 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:09:10 ctl02 nova-api[18168]: 2017-09-28 13:09:10.310 18168 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:09:10 ctl02 nova-api[18168]: 2017-09-28 13:09:10.310 18168 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:09:10 ctl02 nova-api[18168]: 2017-09-28 13:09:10.310 18168 ERROR nova     max_url_len=max_url_len)
Sep 28 13:09:10 ctl02 nova-api[18168]: 2017-09-28 13:09:10.310 18168 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:09:10 ctl02 nova-api[18168]: 2017-09-28 13:09:10.310 18168 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:09:10 ctl02 nova-api[18168]: 2017-09-28 13:09:10.310 18168 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:09:10 ctl02 nova-api[18168]: 2017-09-28 13:09:10.310 18168 ERROR nova     sock.listen(backlog)
Sep 28 13:09:10 ctl02 nova-api[18168]: 2017-09-28 13:09:10.310 18168 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:09:10 ctl02 nova-api[18168]: 2017-09-28 13:09:10.310 18168 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:09:10 ctl02 nova-api[18168]: 2017-09-28 13:09:10.310 18168 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:09:10 ctl02 nova-api[18168]: 2017-09-28 13:09:10.310 18168 ERROR nova
Sep 28 13:09:10 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x764bb44b)
Sep 28 13:09:10 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:09:10 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:09:10 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:09:10 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:09:10 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:09:10 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:09:10 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:09:10 ctl02 glance-api[29183]: 2017-09-28 13:09:10.875 29252 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:09:10] "OPTIONS / HTTP/1.0" 200 134 0.000634
Sep 28 13:09:11 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x764bb44b)
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.908 30601 ERROR oslo_db.sqlalchemy.exc_filters [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] DBAPIError exception wrapped from (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpoo
Sep 28 13:09:11 ctl02 neutron-server[30536]: ls_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`']
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.908 30601 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.908 30601 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.908 30601 ERROR oslo_db.sqlalchemy.exc_filters     context)
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.908 30601 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.908 30601 ERROR oslo_db.sqlalchemy.exc_filters     cursor.execute(statement, parameters)
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.908 30601 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.908 30601 ERROR oslo_db.sqlalchemy.exc_filters     result = self._query(query)
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.908 30601 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.908 30601 ERROR oslo_db.sqlalchemy.exc_filters     conn.query(q)
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.908 30601 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.908 30601 ERROR oslo_db.sqlalchemy.exc_filters     self._affected_rows = self._read_query_result(unbuffered=unbuffered)
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.908 30601 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.908 30601 ERROR oslo_db.sqlalchemy.exc_filters     result.read()
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.908 30601 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.908 30601 ERROR oslo_db.sqlalchemy.exc_filters     first_packet = self.connection._read_packet()
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.908 30601 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.908 30601 ERROR oslo_db.sqlalchemy.exc_filters     packet.check_error()
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.908 30601 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.908 30601 ERROR oslo_db.sqlalchemy.exc_filters     err.raise_mysql_exception(self._data)
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.908 30601 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.908 30601 ERROR oslo_db.sqlalchemy.exc_filters     _check_mysql_exception(errinfo)
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.908 30601 ERROR oslo_db.sqlalchemy.exc_filters   File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.908 30601 ERROR oslo_db.sqlalchemy.exc_filters     raise InternalError(errno, errorvalue)
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.908 30601 ERROR oslo_db.sqlalchemy.exc_filters InternalError: (1054, u"Unknown column 'subnets.tenant_id' in 'field list'")
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.908 30601 ERROR oslo_db.sqlalchemy.exc_filters
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Exception during message handling: (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpoo
Sep 28 13:09:11 ctl02 neutron-server[30536]: ls_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`']
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher Traceback (most recent call last):
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher     incoming.message))
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher     return self._do_dispatch(endpoint, method, ctxt, args)
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher     result = func(ctxt, **new_args)
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher     networks = self._get_active_networks(context, **kwargs)
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher     plugin.auto_schedule_networks(context, host)
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher     self.network_scheduler.auto_schedule_networks(self, context, host)
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher     subnets = plugin.get_subnets(context, fields=fields)
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher     marker, page_reverse)
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher     page_reverse=page_reverse)
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher     items = [dict_func(c, fields) for c in query]
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher     return self._execute_and_instances(context)
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher     result = conn.execute(querycontext.statement, self._params)
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher     return meth(self, multiparams, params)
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher     return connection._execute_clauseelement(self, multiparams, params)
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher     compiled_sql, distilled_params
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher     context)
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher     util.raise_from_cause(newraise, exc_info)
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher     reraise(type(exception), exception, tb=exc_tb)
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher     context)
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher     cursor.execute(statement, parameters)
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher     result = self._query(query)
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher     conn.query(q)
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher     self._affected_rows = self._read_query_result(unbuffered=unbuffered)
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher     result.read()
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher     first_packet = self.connection._read_packet()
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher     packet.check_error()
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 394, in check_error
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher     err.raise_mysql_exception(self._data)
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher     _check_mysql_exception(errinfo)
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher     raise InternalError(errno, errorvalue)
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher DBError: (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallo
Sep 28 13:09:11 ctl02 neutron-server[30536]: cationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`']
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.910 30601 ERROR oslo_messaging.rpc.dispatcher
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.912 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:11 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:11 ctl02 neutron-server[30536]: 2017-09-28 13:09:11.912 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:11 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:11 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:11 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:11 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:12 ctl02 neutron-server[30536]: 2017-09-28 13:09:12.166 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:12 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:12 ctl02 neutron-server[30536]: 2017-09-28 13:09:12.166 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:12 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:12 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:12 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:12 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:12 ctl02 nova-api[18187]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:09:12 ctl02 nova-api[18187]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:09:12 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x764bb44b)
Sep 28 13:09:12 ctl02 neutron-server[30536]: 2017-09-28 13:09:12.420 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:12 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:12 ctl02 neutron-server[30536]: 2017-09-28 13:09:12.420 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:12 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:12 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:12 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:12 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:12 ctl02 nova-api[18187]: 2017-09-28 13:09:12.459 18187 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:09:12 ctl02 nova-api[18187]: 2017-09-28 13:09:12.460 18187 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:09:12 ctl02 nova-api[18187]: 2017-09-28 13:09:12.460 18187 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:09:12 ctl02 nova-api[18187]: 2017-09-28 13:09:12.460 18187 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:09:12 ctl02 nova-api[18187]: 2017-09-28 13:09:12.460 18187 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:09:12 ctl02 nova-api[18187]: 2017-09-28 13:09:12.460 18187 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:09:12 ctl02 nova-api[18187]: 2017-09-28 13:09:12.460 18187 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:09:12 ctl02 nova-api[18187]: 2017-09-28 13:09:12.460 18187 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:09:12 ctl02 nova-api[18187]: 2017-09-28 13:09:12.460 18187 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:09:12 ctl02 nova-api[18187]: 2017-09-28 13:09:12.460 18187 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:09:12 ctl02 nova-api[18187]: 2017-09-28 13:09:12.460 18187 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:09:12 ctl02 nova-api[18187]: 2017-09-28 13:09:12.460 18187 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:09:12 ctl02 nova-api[18187]: 2017-09-28 13:09:12.460 18187 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:09:12 ctl02 nova-api[18187]: 2017-09-28 13:09:12.460 18187 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:09:12 ctl02 nova-api[18187]: 2017-09-28 13:09:12.460 18187 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:09:12 ctl02 nova-api[18187]: 2017-09-28 13:09:12.460 18187 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:09:12 ctl02 nova-api[18187]: 2017-09-28 13:09:12.460 18187 ERROR nova.wsgi     self.filename))
Sep 28 13:09:12 ctl02 nova-api[18187]: 2017-09-28 13:09:12.460 18187 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:09:12 ctl02 nova-api[18187]: 2017-09-28 13:09:12.460 18187 ERROR nova.wsgi
Sep 28 13:09:12 ctl02 nova-api[18187]: 2017-09-28 13:09:12.461 18187 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:09:12 ctl02 glance-api[29183]: 2017-09-28 13:09:12.508 29252 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:09:12] "OPTIONS / HTTP/1.0" 200 134 0.000638
Sep 28 13:09:12 ctl02 nova-api[18187]: 2017-09-28 13:09:12.594 18187 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:09:12 ctl02 neutron-server[30536]: 2017-09-28 13:09:12.676 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:12 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:12 ctl02 neutron-server[30536]: 2017-09-28 13:09:12.676 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:12 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:12 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:12 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:12 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:12 ctl02 nova-api[18187]: 2017-09-28 13:09:12.819 18187 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:09:12 ctl02 nova-api[18187]: 2017-09-28 13:09:12.821 18187 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:09:12 ctl02 nova-api[18187]: 2017-09-28 13:09:12.821 18187 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:09:12 ctl02 nova-api[18187]: 2017-09-28 13:09:12.822 18187 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:09:12 ctl02 neutron-server[30536]: 2017-09-28 13:09:12.929 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:12 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:12 ctl02 neutron-server[30536]: 2017-09-28 13:09:12.930 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:12 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:12 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:12 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:12 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:12 ctl02 nova-api[18187]: 2017-09-28 13:09:12.954 18187 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:09:12 ctl02 nova-api[18187]: 2017-09-28 13:09:12.955 18187 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:09:12 ctl02 nova-api[18187]: 2017-09-28 13:09:12.956 18187 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:09:12 ctl02 nova-api[18187]: 2017-09-28 13:09:12.956 18187 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:09:12 ctl02 nova-api[18187]: 2017-09-28 13:09:12.959 18187 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:09:12 ctl02 nova-api[18187]: 2017-09-28 13:09:12.959 18187 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:09:12 ctl02 nova-api[18187]: 2017-09-28 13:09:12.959 18187 ERROR nova Traceback (most recent call last):
Sep 28 13:09:12 ctl02 nova-api[18187]: 2017-09-28 13:09:12.959 18187 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:09:12 ctl02 nova-api[18187]: 2017-09-28 13:09:12.959 18187 ERROR nova     sys.exit(main())
Sep 28 13:09:12 ctl02 nova-api[18187]: 2017-09-28 13:09:12.959 18187 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:09:12 ctl02 nova-api[18187]: 2017-09-28 13:09:12.959 18187 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:09:12 ctl02 nova-api[18187]: 2017-09-28 13:09:12.959 18187 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:09:12 ctl02 nova-api[18187]: 2017-09-28 13:09:12.959 18187 ERROR nova     max_url_len=max_url_len)
Sep 28 13:09:12 ctl02 nova-api[18187]: 2017-09-28 13:09:12.959 18187 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:09:12 ctl02 nova-api[18187]: 2017-09-28 13:09:12.959 18187 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:09:12 ctl02 nova-api[18187]: 2017-09-28 13:09:12.959 18187 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:09:12 ctl02 nova-api[18187]: 2017-09-28 13:09:12.959 18187 ERROR nova     sock.listen(backlog)
Sep 28 13:09:12 ctl02 nova-api[18187]: 2017-09-28 13:09:12.959 18187 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:09:12 ctl02 nova-api[18187]: 2017-09-28 13:09:12.959 18187 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:09:12 ctl02 nova-api[18187]: 2017-09-28 13:09:12.959 18187 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:09:12 ctl02 nova-api[18187]: 2017-09-28 13:09:12.959 18187 ERROR nova
Sep 28 13:09:13 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:09:13 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:09:13 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:09:13 ctl02 neutron-server[30536]: 2017-09-28 13:09:13.183 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:13 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:13 ctl02 neutron-server[30536]: 2017-09-28 13:09:13.183 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:13 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:13 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:13 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:13 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:13 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:09:13 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:09:13 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x764bb44b)
Sep 28 13:09:13 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:09:13 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:09:13 ctl02 neutron-server[30536]: 2017-09-28 13:09:13.436 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:13 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:13 ctl02 neutron-server[30536]: 2017-09-28 13:09:13.437 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:13 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:13 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:13 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:13 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:13 ctl02 neutron-server[30536]: 2017-09-28 13:09:13.691 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:13 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:13 ctl02 neutron-server[30536]: 2017-09-28 13:09:13.691 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:13 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:13 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:13 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:13 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:13 ctl02 neutron-server[30536]: 2017-09-28 13:09:13.944 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:13 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:13 ctl02 neutron-server[30536]: 2017-09-28 13:09:13.945 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:13 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:13 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:13 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:13 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:14 ctl02 neutron-server[30536]: 2017-09-28 13:09:14.198 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:14 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:14 ctl02 neutron-server[30536]: 2017-09-28 13:09:14.199 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:14 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:14 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:14 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:14 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:14 ctl02 heat-api-cfn[13300]: 2017-09-28 13:09:14.258 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:09:14] "OPTIONS / HTTP/1.0" 200 134 0.000465
Sep 28 13:09:14 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:09:14.381 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:09:14] "OPTIONS / HTTP/1.0" 200 134 0.000358
Sep 28 13:09:14 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x764bb44b)
Sep 28 13:09:14 ctl02 neutron-server[30536]: 2017-09-28 13:09:14.459 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:14 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:14 ctl02 neutron-server[30536]: 2017-09-28 13:09:14.459 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:14 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:14 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:14 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:14 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:14 ctl02 neutron-server[30536]: 2017-09-28 13:09:14.714 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:14 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:14 ctl02 neutron-server[30536]: 2017-09-28 13:09:14.714 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:14 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:14 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:14 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:14 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:14 ctl02 neutron-server[30536]: 2017-09-28 13:09:14.871 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:09:14] "OPTIONS / HTTP/1.0" 200 262 0.000561
Sep 28 13:09:14 ctl02 heat-api[13008]: 2017-09-28 13:09:14.962 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:09:14] "OPTIONS / HTTP/1.0" 200 134 0.000592
Sep 28 13:09:14 ctl02 neutron-server[30536]: 2017-09-28 13:09:14.969 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:14 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:14 ctl02 neutron-server[30536]: 2017-09-28 13:09:14.969 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:14 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:14 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:14 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:14 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:15 ctl02 nova-api[18204]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:09:15 ctl02 nova-api[18204]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:09:15 ctl02 neutron-server[30536]: 2017-09-28 13:09:15.225 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:15 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:15 ctl02 neutron-server[30536]: 2017-09-28 13:09:15.226 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:15 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:15 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:15 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:15 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:15 ctl02 nova-api[18204]: 2017-09-28 13:09:15.255 18204 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:09:15 ctl02 nova-api[18204]: 2017-09-28 13:09:15.256 18204 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:09:15 ctl02 nova-api[18204]: 2017-09-28 13:09:15.256 18204 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:09:15 ctl02 nova-api[18204]: 2017-09-28 13:09:15.256 18204 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:09:15 ctl02 nova-api[18204]: 2017-09-28 13:09:15.256 18204 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:09:15 ctl02 nova-api[18204]: 2017-09-28 13:09:15.256 18204 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:09:15 ctl02 nova-api[18204]: 2017-09-28 13:09:15.256 18204 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:09:15 ctl02 nova-api[18204]: 2017-09-28 13:09:15.256 18204 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:09:15 ctl02 nova-api[18204]: 2017-09-28 13:09:15.256 18204 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:09:15 ctl02 nova-api[18204]: 2017-09-28 13:09:15.256 18204 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:09:15 ctl02 nova-api[18204]: 2017-09-28 13:09:15.256 18204 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:09:15 ctl02 nova-api[18204]: 2017-09-28 13:09:15.256 18204 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:09:15 ctl02 nova-api[18204]: 2017-09-28 13:09:15.256 18204 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:09:15 ctl02 nova-api[18204]: 2017-09-28 13:09:15.256 18204 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:09:15 ctl02 nova-api[18204]: 2017-09-28 13:09:15.256 18204 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:09:15 ctl02 nova-api[18204]: 2017-09-28 13:09:15.256 18204 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:09:15 ctl02 nova-api[18204]: 2017-09-28 13:09:15.256 18204 ERROR nova.wsgi     self.filename))
Sep 28 13:09:15 ctl02 nova-api[18204]: 2017-09-28 13:09:15.256 18204 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:09:15 ctl02 nova-api[18204]: 2017-09-28 13:09:15.256 18204 ERROR nova.wsgi
Sep 28 13:09:15 ctl02 nova-api[18204]: 2017-09-28 13:09:15.257 18204 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:09:15 ctl02 nova-api[18204]: 2017-09-28 13:09:15.385 18204 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:09:15 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x764bb44b)
Sep 28 13:09:15 ctl02 glance-api[29183]: 2017-09-28 13:09:15.419 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:09:15] "OPTIONS / HTTP/1.0" 200 134 0.000572
Sep 28 13:09:15 ctl02 neutron-server[30536]: 2017-09-28 13:09:15.480 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:15 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:15 ctl02 neutron-server[30536]: 2017-09-28 13:09:15.482 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:15 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:15 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:15 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:15 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:15 ctl02 nova-api[18204]: 2017-09-28 13:09:15.609 18204 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:09:15 ctl02 nova-api[18204]: 2017-09-28 13:09:15.611 18204 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:09:15 ctl02 nova-api[18204]: 2017-09-28 13:09:15.611 18204 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:09:15 ctl02 nova-api[18204]: 2017-09-28 13:09:15.612 18204 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:09:15 ctl02 neutron-server[30536]: 2017-09-28 13:09:15.736 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:15 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:15 ctl02 neutron-server[30536]: 2017-09-28 13:09:15.737 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:15 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:15 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:15 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:15 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:15 ctl02 nova-api[18204]: 2017-09-28 13:09:15.740 18204 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:09:15 ctl02 nova-api[18204]: 2017-09-28 13:09:15.742 18204 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:09:15 ctl02 nova-api[18204]: 2017-09-28 13:09:15.742 18204 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:09:15 ctl02 nova-api[18204]: 2017-09-28 13:09:15.742 18204 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:09:15 ctl02 nova-api[18204]: 2017-09-28 13:09:15.745 18204 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:09:15 ctl02 nova-api[18204]: 2017-09-28 13:09:15.745 18204 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:09:15 ctl02 nova-api[18204]: 2017-09-28 13:09:15.745 18204 ERROR nova Traceback (most recent call last):
Sep 28 13:09:15 ctl02 nova-api[18204]: 2017-09-28 13:09:15.745 18204 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:09:15 ctl02 nova-api[18204]: 2017-09-28 13:09:15.745 18204 ERROR nova     sys.exit(main())
Sep 28 13:09:15 ctl02 nova-api[18204]: 2017-09-28 13:09:15.745 18204 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:09:15 ctl02 nova-api[18204]: 2017-09-28 13:09:15.745 18204 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:09:15 ctl02 nova-api[18204]: 2017-09-28 13:09:15.745 18204 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:09:15 ctl02 nova-api[18204]: 2017-09-28 13:09:15.745 18204 ERROR nova     max_url_len=max_url_len)
Sep 28 13:09:15 ctl02 nova-api[18204]: 2017-09-28 13:09:15.745 18204 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:09:15 ctl02 nova-api[18204]: 2017-09-28 13:09:15.745 18204 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:09:15 ctl02 nova-api[18204]: 2017-09-28 13:09:15.745 18204 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:09:15 ctl02 nova-api[18204]: 2017-09-28 13:09:15.745 18204 ERROR nova     sock.listen(backlog)
Sep 28 13:09:15 ctl02 nova-api[18204]: 2017-09-28 13:09:15.745 18204 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:09:15 ctl02 nova-api[18204]: 2017-09-28 13:09:15.745 18204 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:09:15 ctl02 nova-api[18204]: 2017-09-28 13:09:15.745 18204 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:09:15 ctl02 nova-api[18204]: 2017-09-28 13:09:15.745 18204 ERROR nova
Sep 28 13:09:15 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:09:15 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:09:15 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:09:15 ctl02 neutron-server[30536]: 2017-09-28 13:09:15.992 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:15 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:15 ctl02 neutron-server[30536]: 2017-09-28 13:09:15.993 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:15 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:15 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:15 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:15 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:16 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:09:16 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:09:16 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:09:16 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:09:16 ctl02 neutron-server[30536]: 2017-09-28 13:09:16.247 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:16 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:16 ctl02 neutron-server[30536]: 2017-09-28 13:09:16.248 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:16 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:16 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:16 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:16 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:16 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x764bb44b)
Sep 28 13:09:16 ctl02 neutron-server[30536]: 2017-09-28 13:09:16.501 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:16 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:16 ctl02 neutron-server[30536]: 2017-09-28 13:09:16.503 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:16 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:16 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:16 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:16 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:16 ctl02 neutron-server[30536]: 2017-09-28 13:09:16.758 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:16 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:16 ctl02 neutron-server[30536]: 2017-09-28 13:09:16.760 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:16 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:16 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:16 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:16 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:17 ctl02 neutron-server[30536]: 2017-09-28 13:09:17.014 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:17 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:17 ctl02 neutron-server[30536]: 2017-09-28 13:09:17.015 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:17 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:17 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:17 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:17 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:17 ctl02 heat-api-cfn[13300]: 2017-09-28 13:09:17.117 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:09:17] "OPTIONS / HTTP/1.0" 200 134 0.000597
Sep 28 13:09:17 ctl02 neutron-server[30536]: 2017-09-28 13:09:17.270 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:17 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:17 ctl02 neutron-server[30536]: 2017-09-28 13:09:17.270 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:17 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:17 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:17 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:17 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:17 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x764bb44b)
Sep 28 13:09:17 ctl02 neutron-server[30536]: 2017-09-28 13:09:17.473 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:09:17] "OPTIONS / HTTP/1.0" 200 262 0.000523
Sep 28 13:09:17 ctl02 neutron-server[30536]: 2017-09-28 13:09:17.524 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:17 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:17 ctl02 neutron-server[30536]: 2017-09-28 13:09:17.525 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:17 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:17 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:17 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:17 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:17 ctl02 neutron-server[30536]: 2017-09-28 13:09:17.780 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:17 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:17 ctl02 neutron-server[30536]: 2017-09-28 13:09:17.781 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:17 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:17 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:17 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:17 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:17 ctl02 nova-api[18223]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:09:17 ctl02 nova-api[18223]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:09:18 ctl02 neutron-server[30536]: 2017-09-28 13:09:18.035 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:18 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:18 ctl02 neutron-server[30536]: 2017-09-28 13:09:18.036 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:18 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:18 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:18 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:18 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:18 ctl02 nova-api[18223]: 2017-09-28 13:09:18.048 18223 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:09:18 ctl02 nova-api[18223]: 2017-09-28 13:09:18.050 18223 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:09:18 ctl02 nova-api[18223]: 2017-09-28 13:09:18.050 18223 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:09:18 ctl02 nova-api[18223]: 2017-09-28 13:09:18.050 18223 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:09:18 ctl02 nova-api[18223]: 2017-09-28 13:09:18.050 18223 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:09:18 ctl02 nova-api[18223]: 2017-09-28 13:09:18.050 18223 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:09:18 ctl02 nova-api[18223]: 2017-09-28 13:09:18.050 18223 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:09:18 ctl02 nova-api[18223]: 2017-09-28 13:09:18.050 18223 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:09:18 ctl02 nova-api[18223]: 2017-09-28 13:09:18.050 18223 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:09:18 ctl02 nova-api[18223]: 2017-09-28 13:09:18.050 18223 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:09:18 ctl02 nova-api[18223]: 2017-09-28 13:09:18.050 18223 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:09:18 ctl02 nova-api[18223]: 2017-09-28 13:09:18.050 18223 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:09:18 ctl02 nova-api[18223]: 2017-09-28 13:09:18.050 18223 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:09:18 ctl02 nova-api[18223]: 2017-09-28 13:09:18.050 18223 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:09:18 ctl02 nova-api[18223]: 2017-09-28 13:09:18.050 18223 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:09:18 ctl02 nova-api[18223]: 2017-09-28 13:09:18.050 18223 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:09:18 ctl02 nova-api[18223]: 2017-09-28 13:09:18.050 18223 ERROR nova.wsgi     self.filename))
Sep 28 13:09:18 ctl02 nova-api[18223]: 2017-09-28 13:09:18.050 18223 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:09:18 ctl02 nova-api[18223]: 2017-09-28 13:09:18.050 18223 ERROR nova.wsgi
Sep 28 13:09:18 ctl02 nova-api[18223]: 2017-09-28 13:09:18.051 18223 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:09:18 ctl02 nova-api[18223]: 2017-09-28 13:09:18.176 18223 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:09:18 ctl02 neutron-server[30536]: 2017-09-28 13:09:18.289 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:18 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:18 ctl02 neutron-server[30536]: 2017-09-28 13:09:18.290 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:18 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:18 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:18 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:18 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:18 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x764bb44b)
Sep 28 13:09:18 ctl02 nova-api[18223]: 2017-09-28 13:09:18.393 18223 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:09:18 ctl02 nova-api[18223]: 2017-09-28 13:09:18.395 18223 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:09:18 ctl02 nova-api[18223]: 2017-09-28 13:09:18.395 18223 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:09:18 ctl02 nova-api[18223]: 2017-09-28 13:09:18.396 18223 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:09:18 ctl02 nova-api[18223]: 2017-09-28 13:09:18.523 18223 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:09:18 ctl02 nova-api[18223]: 2017-09-28 13:09:18.525 18223 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:09:18 ctl02 nova-api[18223]: 2017-09-28 13:09:18.525 18223 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:09:18 ctl02 nova-api[18223]: 2017-09-28 13:09:18.525 18223 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:09:18 ctl02 nova-api[18223]: 2017-09-28 13:09:18.529 18223 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:09:18 ctl02 nova-api[18223]: 2017-09-28 13:09:18.529 18223 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:09:18 ctl02 nova-api[18223]: 2017-09-28 13:09:18.529 18223 ERROR nova Traceback (most recent call last):
Sep 28 13:09:18 ctl02 nova-api[18223]: 2017-09-28 13:09:18.529 18223 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:09:18 ctl02 nova-api[18223]: 2017-09-28 13:09:18.529 18223 ERROR nova     sys.exit(main())
Sep 28 13:09:18 ctl02 nova-api[18223]: 2017-09-28 13:09:18.529 18223 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:09:18 ctl02 nova-api[18223]: 2017-09-28 13:09:18.529 18223 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:09:18 ctl02 nova-api[18223]: 2017-09-28 13:09:18.529 18223 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:09:18 ctl02 nova-api[18223]: 2017-09-28 13:09:18.529 18223 ERROR nova     max_url_len=max_url_len)
Sep 28 13:09:18 ctl02 nova-api[18223]: 2017-09-28 13:09:18.529 18223 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:09:18 ctl02 nova-api[18223]: 2017-09-28 13:09:18.529 18223 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:09:18 ctl02 nova-api[18223]: 2017-09-28 13:09:18.529 18223 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:09:18 ctl02 nova-api[18223]: 2017-09-28 13:09:18.529 18223 ERROR nova     sock.listen(backlog)
Sep 28 13:09:18 ctl02 nova-api[18223]: 2017-09-28 13:09:18.529 18223 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:09:18 ctl02 nova-api[18223]: 2017-09-28 13:09:18.529 18223 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:09:18 ctl02 nova-api[18223]: 2017-09-28 13:09:18.529 18223 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:09:18 ctl02 nova-api[18223]: 2017-09-28 13:09:18.529 18223 ERROR nova
Sep 28 13:09:18 ctl02 neutron-server[30536]: 2017-09-28 13:09:18.544 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:18 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:18 ctl02 neutron-server[30536]: 2017-09-28 13:09:18.545 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:18 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:18 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:18 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:18 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:18 ctl02 heat-api-cfn[13300]: 2017-09-28 13:09:18.585 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:09:18] "OPTIONS / HTTP/1.0" 200 134 0.000492
Sep 28 13:09:18 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:09:18 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:09:18 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:09:18 ctl02 neutron-server[30536]: 2017-09-28 13:09:18.800 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:18 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:18 ctl02 neutron-server[30536]: 2017-09-28 13:09:18.801 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:18 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:18 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:18 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:18 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:18 ctl02 heat-api[13008]: 2017-09-28 13:09:18.808 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:09:18] "OPTIONS / HTTP/1.0" 200 134 0.000621
Sep 28 13:09:18 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:09:18 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:09:18 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:09:18 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:09:19 ctl02 neutron-server[30536]: 2017-09-28 13:09:19.054 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:19 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:19 ctl02 neutron-server[30536]: 2017-09-28 13:09:19.055 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:19 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:19 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:19 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:19 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:19 ctl02 neutron-server[30536]: 2017-09-28 13:09:19.309 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:19 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:19 ctl02 neutron-server[30536]: 2017-09-28 13:09:19.309 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:19 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:19 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:19 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:19 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:19 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 13:09:19 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 13:09:19 ctl02 neutron-server[30536]: 2017-09-28 13:09:19.562 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:19 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:19 ctl02 neutron-server[30536]: 2017-09-28 13:09:19.563 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:19 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:19 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:19 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:19 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:19 ctl02 heat-api[13008]: 2017-09-28 13:09:19.666 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:09:19] "OPTIONS / HTTP/1.0" 200 134 0.000714
Sep 28 13:09:19 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:09:19.700 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:09:19] "OPTIONS / HTTP/1.0" 200 134 0.000380
Sep 28 13:09:19 ctl02 neutron-server[30536]: 2017-09-28 13:09:19.816 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:19 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:19 ctl02 neutron-server[30536]: 2017-09-28 13:09:19.816 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:19 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:19 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:19 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:19 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:19 ctl02 neutron-server[30536]: 2017-09-28 13:09:19.948 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:09:19] "OPTIONS / HTTP/1.0" 200 262 0.000456
Sep 28 13:09:19 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:09:19.953 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:09:19] "OPTIONS / HTTP/1.0" 200 134 0.000344
Sep 28 13:09:20 ctl02 neutron-server[30536]: 2017-09-28 13:09:20.069 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:20 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:20 ctl02 neutron-server[30536]: 2017-09-28 13:09:20.070 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:20 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:20 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:20 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:20 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:20 ctl02 neutron-server[30536]: 2017-09-28 13:09:20.323 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:20 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:20 ctl02 neutron-server[30536]: 2017-09-28 13:09:20.324 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:20 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:20 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:20 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:20 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:20 ctl02 nova-api[18242]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:09:20 ctl02 nova-api[18242]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:09:20 ctl02 neutron-server[30536]: 2017-09-28 13:09:20.577 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:20 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:20 ctl02 neutron-server[30536]: 2017-09-28 13:09:20.578 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:20 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:20 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:20 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:20 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:20 ctl02 nova-api[18242]: 2017-09-28 13:09:20.749 18242 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:09:20 ctl02 nova-api[18242]: 2017-09-28 13:09:20.751 18242 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:09:20 ctl02 nova-api[18242]: 2017-09-28 13:09:20.751 18242 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:09:20 ctl02 nova-api[18242]: 2017-09-28 13:09:20.751 18242 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:09:20 ctl02 nova-api[18242]: 2017-09-28 13:09:20.751 18242 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:09:20 ctl02 nova-api[18242]: 2017-09-28 13:09:20.751 18242 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:09:20 ctl02 nova-api[18242]: 2017-09-28 13:09:20.751 18242 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:09:20 ctl02 nova-api[18242]: 2017-09-28 13:09:20.751 18242 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:09:20 ctl02 nova-api[18242]: 2017-09-28 13:09:20.751 18242 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:09:20 ctl02 nova-api[18242]: 2017-09-28 13:09:20.751 18242 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:09:20 ctl02 nova-api[18242]: 2017-09-28 13:09:20.751 18242 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:09:20 ctl02 nova-api[18242]: 2017-09-28 13:09:20.751 18242 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:09:20 ctl02 nova-api[18242]: 2017-09-28 13:09:20.751 18242 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:09:20 ctl02 nova-api[18242]: 2017-09-28 13:09:20.751 18242 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:09:20 ctl02 nova-api[18242]: 2017-09-28 13:09:20.751 18242 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:09:20 ctl02 nova-api[18242]: 2017-09-28 13:09:20.751 18242 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:09:20 ctl02 nova-api[18242]: 2017-09-28 13:09:20.751 18242 ERROR nova.wsgi     self.filename))
Sep 28 13:09:20 ctl02 nova-api[18242]: 2017-09-28 13:09:20.751 18242 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:09:20 ctl02 nova-api[18242]: 2017-09-28 13:09:20.751 18242 ERROR nova.wsgi
Sep 28 13:09:20 ctl02 nova-api[18242]: 2017-09-28 13:09:20.752 18242 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:09:20 ctl02 neutron-server[30536]: 2017-09-28 13:09:20.831 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:20 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:20 ctl02 neutron-server[30536]: 2017-09-28 13:09:20.832 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:20 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:20 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:20 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:20 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:20 ctl02 nova-api[18242]: 2017-09-28 13:09:20.886 18242 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:09:20 ctl02 neutron-server[30536]: 2017-09-28 13:09:20.957 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 2 dead agents out of 6:
Sep 28 13:09:20 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 13:09:20 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 13:08:40 cmp002
Sep 28 13:09:20 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 13:07:36 cmp002
Sep 28 13:09:21 ctl02 neutron-server[30536]: 2017-09-28 13:09:21.085 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:21 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:21 ctl02 neutron-server[30536]: 2017-09-28 13:09:21.086 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:21 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:21 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:21 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:21 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:21 ctl02 nova-api[18242]: 2017-09-28 13:09:21.139 18242 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:09:21 ctl02 nova-api[18242]: 2017-09-28 13:09:21.141 18242 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:09:21 ctl02 nova-api[18242]: 2017-09-28 13:09:21.142 18242 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:09:21 ctl02 nova-api[18242]: 2017-09-28 13:09:21.142 18242 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:09:21 ctl02 glance-api[29183]: 2017-09-28 13:09:21.176 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:09:21] "OPTIONS / HTTP/1.0" 200 134 0.000641
Sep 28 13:09:21 ctl02 nova-api[18242]: 2017-09-28 13:09:21.277 18242 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:09:21 ctl02 nova-api[18242]: 2017-09-28 13:09:21.279 18242 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:09:21 ctl02 nova-api[18242]: 2017-09-28 13:09:21.279 18242 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:09:21 ctl02 nova-api[18242]: 2017-09-28 13:09:21.279 18242 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:09:21 ctl02 nova-api[18242]: 2017-09-28 13:09:21.283 18242 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:09:21 ctl02 nova-api[18242]: 2017-09-28 13:09:21.283 18242 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:09:21 ctl02 nova-api[18242]: 2017-09-28 13:09:21.283 18242 ERROR nova Traceback (most recent call last):
Sep 28 13:09:21 ctl02 nova-api[18242]: 2017-09-28 13:09:21.283 18242 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:09:21 ctl02 nova-api[18242]: 2017-09-28 13:09:21.283 18242 ERROR nova     sys.exit(main())
Sep 28 13:09:21 ctl02 nova-api[18242]: 2017-09-28 13:09:21.283 18242 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:09:21 ctl02 nova-api[18242]: 2017-09-28 13:09:21.283 18242 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:09:21 ctl02 nova-api[18242]: 2017-09-28 13:09:21.283 18242 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:09:21 ctl02 nova-api[18242]: 2017-09-28 13:09:21.283 18242 ERROR nova     max_url_len=max_url_len)
Sep 28 13:09:21 ctl02 nova-api[18242]: 2017-09-28 13:09:21.283 18242 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:09:21 ctl02 nova-api[18242]: 2017-09-28 13:09:21.283 18242 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:09:21 ctl02 nova-api[18242]: 2017-09-28 13:09:21.283 18242 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:09:21 ctl02 nova-api[18242]: 2017-09-28 13:09:21.283 18242 ERROR nova     sock.listen(backlog)
Sep 28 13:09:21 ctl02 nova-api[18242]: 2017-09-28 13:09:21.283 18242 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:09:21 ctl02 nova-api[18242]: 2017-09-28 13:09:21.283 18242 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:09:21 ctl02 nova-api[18242]: 2017-09-28 13:09:21.283 18242 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:09:21 ctl02 nova-api[18242]: 2017-09-28 13:09:21.283 18242 ERROR nova
Sep 28 13:09:21 ctl02 neutron-server[30536]: 2017-09-28 13:09:21.339 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:21 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:21 ctl02 neutron-server[30536]: 2017-09-28 13:09:21.340 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:21 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:21 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:21 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:21 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:21 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:09:21 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:09:21 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:09:21 ctl02 neutron-server[30536]: 2017-09-28 13:09:21.593 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:21 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:21 ctl02 neutron-server[30536]: 2017-09-28 13:09:21.594 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:21 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:21 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:21 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:21 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:21 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:09:21 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:09:21 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:09:21 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:09:21 ctl02 neutron-server[30536]: 2017-09-28 13:09:21.848 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:21 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:21 ctl02 neutron-server[30536]: 2017-09-28 13:09:21.848 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:21 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:21 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:21 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:21 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:22 ctl02 neutron-server[30536]: 2017-09-28 13:09:22.101 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:22 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:22 ctl02 neutron-server[30536]: 2017-09-28 13:09:22.102 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:22 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:22 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:22 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:22 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:22 ctl02 neutron-server[30536]: 2017-09-28 13:09:22.356 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:22 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:22 ctl02 neutron-server[30536]: 2017-09-28 13:09:22.356 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:22 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:22 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:22 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:22 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:22 ctl02 neutron-server[30536]: 2017-09-28 13:09:22.609 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:22 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:22 ctl02 neutron-server[30536]: 2017-09-28 13:09:22.610 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:22 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:22 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:22 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:22 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:22 ctl02 glance-api[29183]: 2017-09-28 13:09:22.806 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:09:22] "OPTIONS / HTTP/1.0" 200 134 0.000641
Sep 28 13:09:22 ctl02 neutron-server[30536]: 2017-09-28 13:09:22.862 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:22 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:22 ctl02 neutron-server[30536]: 2017-09-28 13:09:22.863 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:22 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:22 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:22 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:22 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:23 ctl02 neutron-server[30536]: 2017-09-28 13:09:23.115 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:23 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:23 ctl02 neutron-server[30536]: 2017-09-28 13:09:23.116 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:23 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:23 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:23 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:23 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:23 ctl02 nova-api[18265]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:09:23 ctl02 nova-api[18265]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:09:23 ctl02 neutron-server[30536]: 2017-09-28 13:09:23.369 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:23 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:23 ctl02 neutron-server[30536]: 2017-09-28 13:09:23.369 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:23 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:23 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:23 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:23 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:23 ctl02 nova-api[18265]: 2017-09-28 13:09:23.528 18265 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:09:23 ctl02 nova-api[18265]: 2017-09-28 13:09:23.529 18265 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:09:23 ctl02 nova-api[18265]: 2017-09-28 13:09:23.529 18265 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:09:23 ctl02 nova-api[18265]: 2017-09-28 13:09:23.529 18265 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:09:23 ctl02 nova-api[18265]: 2017-09-28 13:09:23.529 18265 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:09:23 ctl02 nova-api[18265]: 2017-09-28 13:09:23.529 18265 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:09:23 ctl02 nova-api[18265]: 2017-09-28 13:09:23.529 18265 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:09:23 ctl02 nova-api[18265]: 2017-09-28 13:09:23.529 18265 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:09:23 ctl02 nova-api[18265]: 2017-09-28 13:09:23.529 18265 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:09:23 ctl02 nova-api[18265]: 2017-09-28 13:09:23.529 18265 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:09:23 ctl02 nova-api[18265]: 2017-09-28 13:09:23.529 18265 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:09:23 ctl02 nova-api[18265]: 2017-09-28 13:09:23.529 18265 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:09:23 ctl02 nova-api[18265]: 2017-09-28 13:09:23.529 18265 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:09:23 ctl02 nova-api[18265]: 2017-09-28 13:09:23.529 18265 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:09:23 ctl02 nova-api[18265]: 2017-09-28 13:09:23.529 18265 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:09:23 ctl02 nova-api[18265]: 2017-09-28 13:09:23.529 18265 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:09:23 ctl02 nova-api[18265]: 2017-09-28 13:09:23.529 18265 ERROR nova.wsgi     self.filename))
Sep 28 13:09:23 ctl02 nova-api[18265]: 2017-09-28 13:09:23.529 18265 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:09:23 ctl02 nova-api[18265]: 2017-09-28 13:09:23.529 18265 ERROR nova.wsgi
Sep 28 13:09:23 ctl02 nova-api[18265]: 2017-09-28 13:09:23.530 18265 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:09:23 ctl02 neutron-server[30536]: 2017-09-28 13:09:23.622 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:23 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:23 ctl02 neutron-server[30536]: 2017-09-28 13:09:23.623 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:23 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:23 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:23 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:23 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:23 ctl02 nova-api[18265]: 2017-09-28 13:09:23.664 18265 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:09:23 ctl02 neutron-server[30536]: 2017-09-28 13:09:23.876 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:23 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:23 ctl02 neutron-server[30536]: 2017-09-28 13:09:23.877 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:23 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:23 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:23 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:23 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:23 ctl02 nova-api[18265]: 2017-09-28 13:09:23.911 18265 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:09:23 ctl02 nova-api[18265]: 2017-09-28 13:09:23.913 18265 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:09:23 ctl02 nova-api[18265]: 2017-09-28 13:09:23.913 18265 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:09:23 ctl02 nova-api[18265]: 2017-09-28 13:09:23.913 18265 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:09:24 ctl02 nova-api[18265]: 2017-09-28 13:09:24.048 18265 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:09:24 ctl02 nova-api[18265]: 2017-09-28 13:09:24.050 18265 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:09:24 ctl02 nova-api[18265]: 2017-09-28 13:09:24.050 18265 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:09:24 ctl02 nova-api[18265]: 2017-09-28 13:09:24.051 18265 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:09:24 ctl02 nova-api[18265]: 2017-09-28 13:09:24.054 18265 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:09:24 ctl02 nova-api[18265]: 2017-09-28 13:09:24.054 18265 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:09:24 ctl02 nova-api[18265]: 2017-09-28 13:09:24.054 18265 ERROR nova Traceback (most recent call last):
Sep 28 13:09:24 ctl02 nova-api[18265]: 2017-09-28 13:09:24.054 18265 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:09:24 ctl02 nova-api[18265]: 2017-09-28 13:09:24.054 18265 ERROR nova     sys.exit(main())
Sep 28 13:09:24 ctl02 nova-api[18265]: 2017-09-28 13:09:24.054 18265 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:09:24 ctl02 nova-api[18265]: 2017-09-28 13:09:24.054 18265 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:09:24 ctl02 nova-api[18265]: 2017-09-28 13:09:24.054 18265 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:09:24 ctl02 nova-api[18265]: 2017-09-28 13:09:24.054 18265 ERROR nova     max_url_len=max_url_len)
Sep 28 13:09:24 ctl02 nova-api[18265]: 2017-09-28 13:09:24.054 18265 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:09:24 ctl02 nova-api[18265]: 2017-09-28 13:09:24.054 18265 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:09:24 ctl02 nova-api[18265]: 2017-09-28 13:09:24.054 18265 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:09:24 ctl02 nova-api[18265]: 2017-09-28 13:09:24.054 18265 ERROR nova     sock.listen(backlog)
Sep 28 13:09:24 ctl02 nova-api[18265]: 2017-09-28 13:09:24.054 18265 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:09:24 ctl02 nova-api[18265]: 2017-09-28 13:09:24.054 18265 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:09:24 ctl02 nova-api[18265]: 2017-09-28 13:09:24.054 18265 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:09:24 ctl02 nova-api[18265]: 2017-09-28 13:09:24.054 18265 ERROR nova
Sep 28 13:09:24 ctl02 heat-api-cfn[13300]: 2017-09-28 13:09:24.090 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:09:24] "OPTIONS / HTTP/1.0" 200 134 0.000515
Sep 28 13:09:24 ctl02 neutron-server[30536]: 2017-09-28 13:09:24.130 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:24 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:24 ctl02 neutron-server[30536]: 2017-09-28 13:09:24.131 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:24 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:24 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:24 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:24 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:24 ctl02 dhclient[600]: DHCPREQUEST of 192.168.11.25 on ens2 to 192.168.11.3 port 67 (xid=0x3415f07)
Sep 28 13:09:24 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:09:24 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:09:24 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:09:24 ctl02 dhclient[600]: DHCPACK of 192.168.11.25 from 192.168.11.3
Sep 28 13:09:24 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 13:09:24 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:09:24 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:09:24 ctl02 ntp[18332]:  * Stopping NTP server ntpd
Sep 28 13:09:24 ctl02 ntp[18332]:    ...done.
Sep 28 13:09:24 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 13:09:24 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 13:09:24 ctl02 ntp[18343]:  * Starting NTP server ntpd
Sep 28 13:09:24 ctl02 ntpd[18350]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 13:09:24 ctl02 ntpd[18350]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -c /var/lib/ntp/ntp.conf.dhcp -u 108:112
Sep 28 13:09:24 ctl02 ntp[18343]:    ...done.
Sep 28 13:09:24 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 13:09:24 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:09:24 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:09:24 ctl02 ntpd[18353]: proto: precision = 0.045 usec (-24)
Sep 28 13:09:24 ctl02 ntpd[18353]: switching logging to file /var/log/ntp.log
Sep 28 13:09:24 ctl02 neutron-server[30536]: 2017-09-28 13:09:24.384 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:24 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:24 ctl02 neutron-server[30536]: 2017-09-28 13:09:24.411 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:24 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:24 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:24 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:24 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:24 ctl02 dhclient[600]: bound to 192.168.11.25 -- renewal in 296 seconds.
Sep 28 13:09:24 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:09:24.582 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:09:24] "OPTIONS / HTTP/1.0" 200 134 0.000484
Sep 28 13:09:24 ctl02 neutron-server[30536]: 2017-09-28 13:09:24.664 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:24 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:24 ctl02 neutron-server[30536]: 2017-09-28 13:09:24.665 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:24 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:24 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:24 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:24 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:24 ctl02 neutron-server[30536]: 2017-09-28 13:09:24.875 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:09:24] "OPTIONS / HTTP/1.0" 200 262 0.000462
Sep 28 13:09:24 ctl02 neutron-server[30536]: 2017-09-28 13:09:24.918 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:24 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:24 ctl02 neutron-server[30536]: 2017-09-28 13:09:24.918 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:24 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:24 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:24 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:24 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:25 ctl02 neutron-server[30536]: 2017-09-28 13:09:25.171 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:25 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:25 ctl02 neutron-server[30536]: 2017-09-28 13:09:25.172 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:25 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:25 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:25 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:25 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:25 ctl02 heat-api[13008]: 2017-09-28 13:09:25.225 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:09:25] "OPTIONS / HTTP/1.0" 200 134 0.000642
Sep 28 13:09:25 ctl02 glance-api[29183]: 2017-09-28 13:09:25.248 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:09:25] "OPTIONS / HTTP/1.0" 200 134 0.000658
Sep 28 13:09:25 ctl02 neutron-server[30536]: 2017-09-28 13:09:25.425 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:25 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:25 ctl02 neutron-server[30536]: 2017-09-28 13:09:25.425 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:25 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:25 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:25 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:25 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:25 ctl02 neutron-server[30536]: 2017-09-28 13:09:25.679 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:25 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:25 ctl02 neutron-server[30536]: 2017-09-28 13:09:25.680 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:25 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:25 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:25 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:25 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:25 ctl02 neutron-server[30536]: 2017-09-28 13:09:25.933 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:25 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:25 ctl02 neutron-server[30536]: 2017-09-28 13:09:25.933 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:25 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:25 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:25 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:25 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:26 ctl02 nova-api[18365]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:09:26 ctl02 nova-api[18365]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:09:26 ctl02 neutron-server[30536]: 2017-09-28 13:09:26.186 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:26 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:26 ctl02 neutron-server[30536]: 2017-09-28 13:09:26.186 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:26 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:26 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:26 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:26 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:26 ctl02 nova-api[18365]: 2017-09-28 13:09:26.253 18365 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:09:26 ctl02 nova-api[18365]: 2017-09-28 13:09:26.255 18365 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:09:26 ctl02 nova-api[18365]: 2017-09-28 13:09:26.255 18365 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:09:26 ctl02 nova-api[18365]: 2017-09-28 13:09:26.255 18365 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:09:26 ctl02 nova-api[18365]: 2017-09-28 13:09:26.255 18365 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:09:26 ctl02 nova-api[18365]: 2017-09-28 13:09:26.255 18365 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:09:26 ctl02 nova-api[18365]: 2017-09-28 13:09:26.255 18365 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:09:26 ctl02 nova-api[18365]: 2017-09-28 13:09:26.255 18365 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:09:26 ctl02 nova-api[18365]: 2017-09-28 13:09:26.255 18365 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:09:26 ctl02 nova-api[18365]: 2017-09-28 13:09:26.255 18365 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:09:26 ctl02 nova-api[18365]: 2017-09-28 13:09:26.255 18365 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:09:26 ctl02 nova-api[18365]: 2017-09-28 13:09:26.255 18365 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:09:26 ctl02 nova-api[18365]: 2017-09-28 13:09:26.255 18365 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:09:26 ctl02 nova-api[18365]: 2017-09-28 13:09:26.255 18365 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:09:26 ctl02 nova-api[18365]: 2017-09-28 13:09:26.255 18365 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:09:26 ctl02 nova-api[18365]: 2017-09-28 13:09:26.255 18365 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:09:26 ctl02 nova-api[18365]: 2017-09-28 13:09:26.255 18365 ERROR nova.wsgi     self.filename))
Sep 28 13:09:26 ctl02 nova-api[18365]: 2017-09-28 13:09:26.255 18365 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:09:26 ctl02 nova-api[18365]: 2017-09-28 13:09:26.255 18365 ERROR nova.wsgi
Sep 28 13:09:26 ctl02 nova-api[18365]: 2017-09-28 13:09:26.256 18365 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:09:26 ctl02 nova-api[18365]: 2017-09-28 13:09:26.387 18365 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:09:26 ctl02 neutron-server[30536]: 2017-09-28 13:09:26.439 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:26 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:26 ctl02 neutron-server[30536]: 2017-09-28 13:09:26.439 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:26 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:26 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:26 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:26 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:26 ctl02 nova-api[18365]: 2017-09-28 13:09:26.636 18365 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:09:26 ctl02 nova-api[18365]: 2017-09-28 13:09:26.638 18365 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:09:26 ctl02 nova-api[18365]: 2017-09-28 13:09:26.638 18365 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:09:26 ctl02 nova-api[18365]: 2017-09-28 13:09:26.639 18365 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:09:26 ctl02 neutron-server[30536]: 2017-09-28 13:09:26.692 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:26 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:26 ctl02 neutron-server[30536]: 2017-09-28 13:09:26.692 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:26 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:26 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:26 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:26 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:26 ctl02 nova-api[18365]: 2017-09-28 13:09:26.772 18365 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:09:26 ctl02 nova-api[18365]: 2017-09-28 13:09:26.774 18365 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:09:26 ctl02 nova-api[18365]: 2017-09-28 13:09:26.774 18365 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:09:26 ctl02 nova-api[18365]: 2017-09-28 13:09:26.774 18365 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:09:26 ctl02 nova-api[18365]: 2017-09-28 13:09:26.777 18365 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:09:26 ctl02 nova-api[18365]: 2017-09-28 13:09:26.778 18365 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:09:26 ctl02 nova-api[18365]: 2017-09-28 13:09:26.778 18365 ERROR nova Traceback (most recent call last):
Sep 28 13:09:26 ctl02 nova-api[18365]: 2017-09-28 13:09:26.778 18365 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:09:26 ctl02 nova-api[18365]: 2017-09-28 13:09:26.778 18365 ERROR nova     sys.exit(main())
Sep 28 13:09:26 ctl02 nova-api[18365]: 2017-09-28 13:09:26.778 18365 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:09:26 ctl02 nova-api[18365]: 2017-09-28 13:09:26.778 18365 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:09:26 ctl02 nova-api[18365]: 2017-09-28 13:09:26.778 18365 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:09:26 ctl02 nova-api[18365]: 2017-09-28 13:09:26.778 18365 ERROR nova     max_url_len=max_url_len)
Sep 28 13:09:26 ctl02 nova-api[18365]: 2017-09-28 13:09:26.778 18365 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:09:26 ctl02 nova-api[18365]: 2017-09-28 13:09:26.778 18365 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:09:26 ctl02 nova-api[18365]: 2017-09-28 13:09:26.778 18365 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:09:26 ctl02 nova-api[18365]: 2017-09-28 13:09:26.778 18365 ERROR nova     sock.listen(backlog)
Sep 28 13:09:26 ctl02 nova-api[18365]: 2017-09-28 13:09:26.778 18365 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:09:26 ctl02 nova-api[18365]: 2017-09-28 13:09:26.778 18365 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:09:26 ctl02 nova-api[18365]: 2017-09-28 13:09:26.778 18365 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:09:26 ctl02 nova-api[18365]: 2017-09-28 13:09:26.778 18365 ERROR nova
Sep 28 13:09:26 ctl02 neutron-server[30536]: 2017-09-28 13:09:26.946 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:26 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:26 ctl02 neutron-server[30536]: 2017-09-28 13:09:26.946 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:26 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:26 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:26 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:09:26 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:26 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:09:26 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:26 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:09:27 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:09:27 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:09:27 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:09:27 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:09:27 ctl02 neutron-server[30536]: 2017-09-28 13:09:27.199 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:27 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:27 ctl02 neutron-server[30536]: 2017-09-28 13:09:27.200 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:27 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:27 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:27 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:27 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:27 ctl02 heat-api-cfn[13300]: 2017-09-28 13:09:27.213 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:09:27] "OPTIONS / HTTP/1.0" 200 134 0.000477
Sep 28 13:09:27 ctl02 neutron-server[30536]: 2017-09-28 13:09:27.220 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:09:27] "OPTIONS / HTTP/1.0" 200 262 0.000590
Sep 28 13:09:27 ctl02 nova-conductor[5056]: 2017-09-28 13:09:27.422 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:09:27 ctl02 nova-conductor[5056]: 2017-09-28 13:09:27.424 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:09:27 ctl02 nova-conductor[5056]: 2017-09-28 13:09:27.429 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:09:27 ctl02 nova-conductor[5056]: 2017-09-28 13:09:27.431 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:09:27 ctl02 neutron-server[30536]: 2017-09-28 13:09:27.455 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:27 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:27 ctl02 neutron-server[30536]: 2017-09-28 13:09:27.455 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:27 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:27 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:27 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:27 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:27 ctl02 neutron-server[30536]: 2017-09-28 13:09:27.710 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:27 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:27 ctl02 neutron-server[30536]: 2017-09-28 13:09:27.711 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:27 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:27 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:27 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:27 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:27 ctl02 neutron-server[30536]: 2017-09-28 13:09:27.965 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:27 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:27 ctl02 neutron-server[30536]: 2017-09-28 13:09:27.966 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:27 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:27 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:27 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:27 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:28 ctl02 neutron-server[30536]: 2017-09-28 13:09:28.221 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:28 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:28 ctl02 neutron-server[30536]: 2017-09-28 13:09:28.222 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:28 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:28 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:28 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:28 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:28 ctl02 heat-api-cfn[13300]: 2017-09-28 13:09:28.273 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:09:28] "OPTIONS / HTTP/1.0" 200 134 0.000447
Sep 28 13:09:28 ctl02 nova-cert[4860]: 2017-09-28 13:09:28.459 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:09:28 ctl02 neutron-server[30536]: 2017-09-28 13:09:28.476 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:28 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:28 ctl02 neutron-server[30536]: 2017-09-28 13:09:28.477 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:28 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:28 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:28 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:28 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:28 ctl02 neutron-server[30536]: 2017-09-28 13:09:28.732 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:28 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:28 ctl02 neutron-server[30536]: 2017-09-28 13:09:28.733 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:28 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:28 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:28 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:28 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:28 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf596d57)
Sep 28 13:09:28 ctl02 nova-api[18383]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:09:28 ctl02 nova-api[18383]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:09:28 ctl02 heat-api[13008]: 2017-09-28 13:09:28.819 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:09:28] "OPTIONS / HTTP/1.0" 200 134 0.000547
Sep 28 13:09:28 ctl02 nova-api[18383]: 2017-09-28 13:09:28.970 18383 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:09:28 ctl02 nova-api[18383]: 2017-09-28 13:09:28.971 18383 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:09:28 ctl02 nova-api[18383]: 2017-09-28 13:09:28.971 18383 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:09:28 ctl02 nova-api[18383]: 2017-09-28 13:09:28.971 18383 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:09:28 ctl02 nova-api[18383]: 2017-09-28 13:09:28.971 18383 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:09:28 ctl02 nova-api[18383]: 2017-09-28 13:09:28.971 18383 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:09:28 ctl02 nova-api[18383]: 2017-09-28 13:09:28.971 18383 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:09:28 ctl02 nova-api[18383]: 2017-09-28 13:09:28.971 18383 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:09:28 ctl02 nova-api[18383]: 2017-09-28 13:09:28.971 18383 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:09:28 ctl02 nova-api[18383]: 2017-09-28 13:09:28.971 18383 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:09:28 ctl02 nova-api[18383]: 2017-09-28 13:09:28.971 18383 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:09:28 ctl02 nova-api[18383]: 2017-09-28 13:09:28.971 18383 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:09:28 ctl02 nova-api[18383]: 2017-09-28 13:09:28.971 18383 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:09:28 ctl02 nova-api[18383]: 2017-09-28 13:09:28.971 18383 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:09:28 ctl02 nova-api[18383]: 2017-09-28 13:09:28.971 18383 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:09:28 ctl02 nova-api[18383]: 2017-09-28 13:09:28.971 18383 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:09:28 ctl02 nova-api[18383]: 2017-09-28 13:09:28.971 18383 ERROR nova.wsgi     self.filename))
Sep 28 13:09:28 ctl02 nova-api[18383]: 2017-09-28 13:09:28.971 18383 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:09:28 ctl02 nova-api[18383]: 2017-09-28 13:09:28.971 18383 ERROR nova.wsgi
Sep 28 13:09:28 ctl02 nova-api[18383]: 2017-09-28 13:09:28.972 18383 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:09:28 ctl02 neutron-server[30536]: 2017-09-28 13:09:28.987 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:28 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:28 ctl02 neutron-server[30536]: 2017-09-28 13:09:28.987 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:28 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:28 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:28 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:28 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:29 ctl02 nova-api[18383]: 2017-09-28 13:09:29.099 18383 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:09:29 ctl02 neutron-server[30536]: 2017-09-28 13:09:29.240 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:29 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:29 ctl02 neutron-server[30536]: 2017-09-28 13:09:29.241 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:29 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:29 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:29 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:29 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:29 ctl02 nova-api[18383]: 2017-09-28 13:09:29.324 18383 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:09:29 ctl02 nova-api[18383]: 2017-09-28 13:09:29.326 18383 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:09:29 ctl02 nova-api[18383]: 2017-09-28 13:09:29.326 18383 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:09:29 ctl02 nova-api[18383]: 2017-09-28 13:09:29.326 18383 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:09:29 ctl02 nova-api[18383]: 2017-09-28 13:09:29.460 18383 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:09:29 ctl02 nova-api[18383]: 2017-09-28 13:09:29.495 18383 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:09:29 ctl02 nova-api[18383]: 2017-09-28 13:09:29.495 18383 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:09:29 ctl02 nova-api[18383]: 2017-09-28 13:09:29.495 18383 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:09:29 ctl02 nova-api[18383]: 2017-09-28 13:09:29.498 18383 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:09:29 ctl02 nova-api[18383]: 2017-09-28 13:09:29.499 18383 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:09:29 ctl02 nova-api[18383]: 2017-09-28 13:09:29.499 18383 ERROR nova Traceback (most recent call last):
Sep 28 13:09:29 ctl02 nova-api[18383]: 2017-09-28 13:09:29.499 18383 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:09:29 ctl02 nova-api[18383]: 2017-09-28 13:09:29.499 18383 ERROR nova     sys.exit(main())
Sep 28 13:09:29 ctl02 nova-api[18383]: 2017-09-28 13:09:29.499 18383 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:09:29 ctl02 nova-api[18383]: 2017-09-28 13:09:29.499 18383 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:09:29 ctl02 nova-api[18383]: 2017-09-28 13:09:29.499 18383 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:09:29 ctl02 nova-api[18383]: 2017-09-28 13:09:29.499 18383 ERROR nova     max_url_len=max_url_len)
Sep 28 13:09:29 ctl02 nova-api[18383]: 2017-09-28 13:09:29.499 18383 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:09:29 ctl02 nova-api[18383]: 2017-09-28 13:09:29.499 18383 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:09:29 ctl02 nova-api[18383]: 2017-09-28 13:09:29.499 18383 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:09:29 ctl02 nova-api[18383]: 2017-09-28 13:09:29.499 18383 ERROR nova     sock.listen(backlog)
Sep 28 13:09:29 ctl02 nova-api[18383]: 2017-09-28 13:09:29.499 18383 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:09:29 ctl02 nova-api[18383]: 2017-09-28 13:09:29.499 18383 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:09:29 ctl02 nova-api[18383]: 2017-09-28 13:09:29.499 18383 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:09:29 ctl02 nova-api[18383]: 2017-09-28 13:09:29.499 18383 ERROR nova
Sep 28 13:09:29 ctl02 neutron-server[30536]: 2017-09-28 13:09:29.508 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:29 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:29 ctl02 neutron-server[30536]: 2017-09-28 13:09:29.508 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:29 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:29 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:29 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:29 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:29 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:09:29.563 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:09:29] "OPTIONS / HTTP/1.0" 200 134 0.000422
Sep 28 13:09:29 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:09:29.572 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:09:29] "OPTIONS / HTTP/1.0" 200 134 0.000404
Sep 28 13:09:29 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:09:29 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:09:29 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:09:29 ctl02 heat-api[13008]: 2017-09-28 13:09:29.683 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:09:29] "OPTIONS / HTTP/1.0" 200 134 0.000545
Sep 28 13:09:29 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf596d57)
Sep 28 13:09:29 ctl02 neutron-server[30536]: 2017-09-28 13:09:29.761 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:29 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:29 ctl02 neutron-server[30536]: 2017-09-28 13:09:29.762 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:29 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:29 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:29 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:29 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:29 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:09:29 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:09:29 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:09:29 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:09:30 ctl02 neutron-server[30536]: 2017-09-28 13:09:30.016 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:30 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:30 ctl02 neutron-server[30536]: 2017-09-28 13:09:30.017 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:30 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:30 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:30 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:30 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:30 ctl02 neutron-server[30536]: 2017-09-28 13:09:30.078 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:09:30] "OPTIONS / HTTP/1.0" 200 262 0.000500
Sep 28 13:09:30 ctl02 neutron-server[30536]: 2017-09-28 13:09:30.272 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:30 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:30 ctl02 neutron-server[30536]: 2017-09-28 13:09:30.274 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:30 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:30 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:30 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:30 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:30 ctl02 neutron-server[30536]: 2017-09-28 13:09:30.528 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:30 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:30 ctl02 neutron-server[30536]: 2017-09-28 13:09:30.530 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:30 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:30 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:30 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:30 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:30 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf596d57)
Sep 28 13:09:30 ctl02 neutron-server[30536]: 2017-09-28 13:09:30.784 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:30 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:30 ctl02 neutron-server[30536]: 2017-09-28 13:09:30.785 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:30 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:30 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:30 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:30 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:30 ctl02 glance-api[29183]: 2017-09-28 13:09:30.855 29257 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:09:30] "OPTIONS / HTTP/1.0" 200 134 0.000587
Sep 28 13:09:31 ctl02 neutron-server[30536]: 2017-09-28 13:09:31.040 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:31 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:31 ctl02 neutron-server[30536]: 2017-09-28 13:09:31.041 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:31 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:31 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:31 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:31 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:31 ctl02 neutron-server[30536]: 2017-09-28 13:09:31.295 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:31 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:31 ctl02 neutron-server[30536]: 2017-09-28 13:09:31.296 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:31 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:31 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:31 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:31 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:31 ctl02 neutron-server[30536]: 2017-09-28 13:09:31.550 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:31 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:31 ctl02 neutron-server[30536]: 2017-09-28 13:09:31.551 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:31 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:31 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:31 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:31 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:31 ctl02 nova-api[18400]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:09:31 ctl02 nova-api[18400]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:09:31 ctl02 nova-api[18400]: 2017-09-28 13:09:31.740 18400 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:09:31 ctl02 nova-api[18400]: 2017-09-28 13:09:31.742 18400 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:09:31 ctl02 nova-api[18400]: 2017-09-28 13:09:31.742 18400 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:09:31 ctl02 nova-api[18400]: 2017-09-28 13:09:31.742 18400 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:09:31 ctl02 nova-api[18400]: 2017-09-28 13:09:31.742 18400 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:09:31 ctl02 nova-api[18400]: 2017-09-28 13:09:31.742 18400 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:09:31 ctl02 nova-api[18400]: 2017-09-28 13:09:31.742 18400 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:09:31 ctl02 nova-api[18400]: 2017-09-28 13:09:31.742 18400 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:09:31 ctl02 nova-api[18400]: 2017-09-28 13:09:31.742 18400 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:09:31 ctl02 nova-api[18400]: 2017-09-28 13:09:31.742 18400 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:09:31 ctl02 nova-api[18400]: 2017-09-28 13:09:31.742 18400 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:09:31 ctl02 nova-api[18400]: 2017-09-28 13:09:31.742 18400 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:09:31 ctl02 nova-api[18400]: 2017-09-28 13:09:31.742 18400 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:09:31 ctl02 nova-api[18400]: 2017-09-28 13:09:31.742 18400 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:09:31 ctl02 nova-api[18400]: 2017-09-28 13:09:31.742 18400 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:09:31 ctl02 nova-api[18400]: 2017-09-28 13:09:31.742 18400 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:09:31 ctl02 nova-api[18400]: 2017-09-28 13:09:31.742 18400 ERROR nova.wsgi     self.filename))
Sep 28 13:09:31 ctl02 nova-api[18400]: 2017-09-28 13:09:31.742 18400 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:09:31 ctl02 nova-api[18400]: 2017-09-28 13:09:31.742 18400 ERROR nova.wsgi
Sep 28 13:09:31 ctl02 nova-api[18400]: 2017-09-28 13:09:31.743 18400 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:09:31 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf596d57)
Sep 28 13:09:31 ctl02 neutron-server[30536]: 2017-09-28 13:09:31.805 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:31 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:31 ctl02 neutron-server[30536]: 2017-09-28 13:09:31.806 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:31 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:31 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:31 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:31 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:31 ctl02 nova-api[18400]: 2017-09-28 13:09:31.874 18400 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:09:32 ctl02 neutron-server[30536]: 2017-09-28 13:09:32.059 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:32 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:32 ctl02 neutron-server[30536]: 2017-09-28 13:09:32.060 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:32 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:32 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:32 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:32 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:32 ctl02 nova-api[18400]: 2017-09-28 13:09:32.106 18400 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:09:32 ctl02 nova-api[18400]: 2017-09-28 13:09:32.109 18400 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:09:32 ctl02 nova-api[18400]: 2017-09-28 13:09:32.109 18400 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:09:32 ctl02 nova-api[18400]: 2017-09-28 13:09:32.109 18400 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:09:32 ctl02 nova-api[18400]: 2017-09-28 13:09:32.240 18400 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:09:32 ctl02 nova-api[18400]: 2017-09-28 13:09:32.243 18400 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:09:32 ctl02 nova-api[18400]: 2017-09-28 13:09:32.243 18400 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:09:32 ctl02 nova-api[18400]: 2017-09-28 13:09:32.243 18400 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:09:32 ctl02 nova-api[18400]: 2017-09-28 13:09:32.247 18400 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:09:32 ctl02 nova-api[18400]: 2017-09-28 13:09:32.247 18400 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:09:32 ctl02 nova-api[18400]: 2017-09-28 13:09:32.247 18400 ERROR nova Traceback (most recent call last):
Sep 28 13:09:32 ctl02 nova-api[18400]: 2017-09-28 13:09:32.247 18400 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:09:32 ctl02 nova-api[18400]: 2017-09-28 13:09:32.247 18400 ERROR nova     sys.exit(main())
Sep 28 13:09:32 ctl02 nova-api[18400]: 2017-09-28 13:09:32.247 18400 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:09:32 ctl02 nova-api[18400]: 2017-09-28 13:09:32.247 18400 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:09:32 ctl02 nova-api[18400]: 2017-09-28 13:09:32.247 18400 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:09:32 ctl02 nova-api[18400]: 2017-09-28 13:09:32.247 18400 ERROR nova     max_url_len=max_url_len)
Sep 28 13:09:32 ctl02 nova-api[18400]: 2017-09-28 13:09:32.247 18400 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:09:32 ctl02 nova-api[18400]: 2017-09-28 13:09:32.247 18400 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:09:32 ctl02 nova-api[18400]: 2017-09-28 13:09:32.247 18400 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:09:32 ctl02 nova-api[18400]: 2017-09-28 13:09:32.247 18400 ERROR nova     sock.listen(backlog)
Sep 28 13:09:32 ctl02 nova-api[18400]: 2017-09-28 13:09:32.247 18400 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:09:32 ctl02 nova-api[18400]: 2017-09-28 13:09:32.247 18400 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:09:32 ctl02 nova-api[18400]: 2017-09-28 13:09:32.247 18400 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:09:32 ctl02 nova-api[18400]: 2017-09-28 13:09:32.247 18400 ERROR nova
Sep 28 13:09:32 ctl02 neutron-server[30536]: 2017-09-28 13:09:32.314 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:32 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:32 ctl02 neutron-server[30536]: 2017-09-28 13:09:32.314 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:32 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:32 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:32 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:32 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:32 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:09:32 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:09:32 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:09:32 ctl02 neutron-server[30536]: 2017-09-28 13:09:32.568 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:32 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:32 ctl02 neutron-server[30536]: 2017-09-28 13:09:32.569 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:32 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:32 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:32 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:32 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:32 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:09:32 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:09:32 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:09:32 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:09:32 ctl02 glance-api[29183]: 2017-09-28 13:09:32.678 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:09:32] "OPTIONS / HTTP/1.0" 200 134 0.000830
Sep 28 13:09:32 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf596d57)
Sep 28 13:09:32 ctl02 neutron-server[30536]: 2017-09-28 13:09:32.823 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:32 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:32 ctl02 neutron-server[30536]: 2017-09-28 13:09:32.824 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:32 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:32 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:32 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:32 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:33 ctl02 neutron-server[30536]: 2017-09-28 13:09:33.077 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:33 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:33 ctl02 neutron-server[30536]: 2017-09-28 13:09:33.078 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:33 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:33 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:33 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:33 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:33 ctl02 neutron-server[30536]: 2017-09-28 13:09:33.331 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:33 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:33 ctl02 neutron-server[30536]: 2017-09-28 13:09:33.332 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:33 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:33 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:33 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:33 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:33 ctl02 neutron-server[30536]: 2017-09-28 13:09:33.584 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:33 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:33 ctl02 neutron-server[30536]: 2017-09-28 13:09:33.585 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:33 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:33 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:33 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:33 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:33 ctl02 heat-api-cfn[13300]: 2017-09-28 13:09:33.704 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:09:33] "OPTIONS / HTTP/1.0" 200 134 0.000430
Sep 28 13:09:33 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf596d57)
Sep 28 13:09:33 ctl02 neutron-server[30536]: 2017-09-28 13:09:33.838 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:33 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:33 ctl02 neutron-server[30536]: 2017-09-28 13:09:33.838 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:33 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:33 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:33 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:33 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:34 ctl02 neutron-server[30536]: 2017-09-28 13:09:34.092 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:34 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:34 ctl02 neutron-server[30536]: 2017-09-28 13:09:34.092 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:34 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:34 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:34 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:34 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:34 ctl02 neutron-server[30536]: 2017-09-28 13:09:34.346 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:34 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:34 ctl02 neutron-server[30536]: 2017-09-28 13:09:34.347 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:34 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:34 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:34 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:34 ctl02 nova-api[18418]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:09:34 ctl02 nova-api[18418]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:09:34 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:34 ctl02 nova-api[18418]: 2017-09-28 13:09:34.535 18418 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:09:34 ctl02 nova-api[18418]: 2017-09-28 13:09:34.536 18418 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:09:34 ctl02 nova-api[18418]: 2017-09-28 13:09:34.536 18418 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:09:34 ctl02 nova-api[18418]: 2017-09-28 13:09:34.536 18418 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:09:34 ctl02 nova-api[18418]: 2017-09-28 13:09:34.536 18418 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:09:34 ctl02 nova-api[18418]: 2017-09-28 13:09:34.536 18418 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:09:34 ctl02 nova-api[18418]: 2017-09-28 13:09:34.536 18418 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:09:34 ctl02 nova-api[18418]: 2017-09-28 13:09:34.536 18418 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:09:34 ctl02 nova-api[18418]: 2017-09-28 13:09:34.536 18418 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:09:34 ctl02 nova-api[18418]: 2017-09-28 13:09:34.536 18418 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:09:34 ctl02 nova-api[18418]: 2017-09-28 13:09:34.536 18418 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:09:34 ctl02 nova-api[18418]: 2017-09-28 13:09:34.536 18418 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:09:34 ctl02 nova-api[18418]: 2017-09-28 13:09:34.536 18418 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:09:34 ctl02 nova-api[18418]: 2017-09-28 13:09:34.536 18418 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:09:34 ctl02 nova-api[18418]: 2017-09-28 13:09:34.536 18418 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:09:34 ctl02 nova-api[18418]: 2017-09-28 13:09:34.536 18418 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:09:34 ctl02 nova-api[18418]: 2017-09-28 13:09:34.536 18418 ERROR nova.wsgi     self.filename))
Sep 28 13:09:34 ctl02 nova-api[18418]: 2017-09-28 13:09:34.536 18418 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:09:34 ctl02 nova-api[18418]: 2017-09-28 13:09:34.536 18418 ERROR nova.wsgi
Sep 28 13:09:34 ctl02 nova-api[18418]: 2017-09-28 13:09:34.549 18418 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:09:34 ctl02 neutron-server[30536]: 2017-09-28 13:09:34.601 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:34 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:34 ctl02 neutron-server[30536]: 2017-09-28 13:09:34.601 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:34 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:34 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:34 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:34 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:34 ctl02 nova-api[18418]: 2017-09-28 13:09:34.690 18418 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:09:34 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf596d57)
Sep 28 13:09:34 ctl02 neutron-server[30536]: 2017-09-28 13:09:34.790 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:09:34] "OPTIONS / HTTP/1.0" 200 262 0.000467
Sep 28 13:09:34 ctl02 neutron-server[30536]: 2017-09-28 13:09:34.854 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:34 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:34 ctl02 neutron-server[30536]: 2017-09-28 13:09:34.855 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:34 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:34 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:34 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:34 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:34 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:09:34.861 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:09:34] "OPTIONS / HTTP/1.0" 200 134 0.000367
Sep 28 13:09:34 ctl02 nova-api[18418]: 2017-09-28 13:09:34.916 18418 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:09:34 ctl02 nova-api[18418]: 2017-09-28 13:09:34.918 18418 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:09:34 ctl02 nova-api[18418]: 2017-09-28 13:09:34.919 18418 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:09:34 ctl02 nova-api[18418]: 2017-09-28 13:09:34.919 18418 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:09:35 ctl02 nova-api[18418]: 2017-09-28 13:09:35.050 18418 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:09:35 ctl02 nova-api[18418]: 2017-09-28 13:09:35.052 18418 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:09:35 ctl02 nova-api[18418]: 2017-09-28 13:09:35.052 18418 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:09:35 ctl02 nova-api[18418]: 2017-09-28 13:09:35.052 18418 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:09:35 ctl02 nova-api[18418]: 2017-09-28 13:09:35.056 18418 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:09:35 ctl02 nova-api[18418]: 2017-09-28 13:09:35.056 18418 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:09:35 ctl02 nova-api[18418]: 2017-09-28 13:09:35.056 18418 ERROR nova Traceback (most recent call last):
Sep 28 13:09:35 ctl02 nova-api[18418]: 2017-09-28 13:09:35.056 18418 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:09:35 ctl02 nova-api[18418]: 2017-09-28 13:09:35.056 18418 ERROR nova     sys.exit(main())
Sep 28 13:09:35 ctl02 nova-api[18418]: 2017-09-28 13:09:35.056 18418 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:09:35 ctl02 nova-api[18418]: 2017-09-28 13:09:35.056 18418 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:09:35 ctl02 nova-api[18418]: 2017-09-28 13:09:35.056 18418 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:09:35 ctl02 nova-api[18418]: 2017-09-28 13:09:35.056 18418 ERROR nova     max_url_len=max_url_len)
Sep 28 13:09:35 ctl02 nova-api[18418]: 2017-09-28 13:09:35.056 18418 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:09:35 ctl02 nova-api[18418]: 2017-09-28 13:09:35.056 18418 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:09:35 ctl02 nova-api[18418]: 2017-09-28 13:09:35.056 18418 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:09:35 ctl02 nova-api[18418]: 2017-09-28 13:09:35.056 18418 ERROR nova     sock.listen(backlog)
Sep 28 13:09:35 ctl02 nova-api[18418]: 2017-09-28 13:09:35.056 18418 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:09:35 ctl02 nova-api[18418]: 2017-09-28 13:09:35.056 18418 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:09:35 ctl02 nova-api[18418]: 2017-09-28 13:09:35.056 18418 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:09:35 ctl02 nova-api[18418]: 2017-09-28 13:09:35.056 18418 ERROR nova
Sep 28 13:09:35 ctl02 neutron-server[30536]: 2017-09-28 13:09:35.108 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:35 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:35 ctl02 neutron-server[30536]: 2017-09-28 13:09:35.109 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:35 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:35 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:35 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:35 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:35 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:09:35 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:09:35 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:09:35 ctl02 heat-api[13008]: 2017-09-28 13:09:35.257 13085 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:09:35] "OPTIONS / HTTP/1.0" 200 134 0.000559
Sep 28 13:09:35 ctl02 neutron-server[30536]: 2017-09-28 13:09:35.362 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:35 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:35 ctl02 neutron-server[30536]: 2017-09-28 13:09:35.363 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:35 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:35 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:35 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:35 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:35 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:09:35 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:09:35 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:09:35 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:09:35 ctl02 glance-api[29183]: 2017-09-28 13:09:35.447 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:09:35] "OPTIONS / HTTP/1.0" 200 134 0.000772
Sep 28 13:09:35 ctl02 neutron-server[30536]: 2017-09-28 13:09:35.617 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:35 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:35 ctl02 neutron-server[30536]: 2017-09-28 13:09:35.617 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:35 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:35 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:35 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:35 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:35 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf596d57)
Sep 28 13:09:35 ctl02 neutron-server[30536]: 2017-09-28 13:09:35.871 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:35 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:35 ctl02 neutron-server[30536]: 2017-09-28 13:09:35.871 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:35 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:35 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:35 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:35 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:35 ctl02 neutron-server[30536]: 2017-09-28 13:09:35.952 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 2 dead agents out of 6:
Sep 28 13:09:35 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 13:09:35 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 13:08:40 cmp002
Sep 28 13:09:35 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 13:07:36 cmp002
Sep 28 13:09:36 ctl02 neutron-server[30536]: 2017-09-28 13:09:36.125 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:36 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:36 ctl02 neutron-server[30536]: 2017-09-28 13:09:36.126 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:36 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:36 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:36 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:36 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:36 ctl02 neutron-server[30536]: 2017-09-28 13:09:36.379 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:36 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:36 ctl02 neutron-server[30536]: 2017-09-28 13:09:36.380 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:36 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:36 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:36 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:36 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:36 ctl02 neutron-server[30536]: 2017-09-28 13:09:36.633 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:36 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:36 ctl02 neutron-server[30536]: 2017-09-28 13:09:36.633 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:36 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:36 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:36 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:36 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:36 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf596d57)
Sep 28 13:09:36 ctl02 heat-api-cfn[13300]: 2017-09-28 13:09:36.861 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:09:36] "OPTIONS / HTTP/1.0" 200 134 0.000429
Sep 28 13:09:36 ctl02 neutron-server[30536]: 2017-09-28 13:09:36.886 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:36 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:36 ctl02 neutron-server[30536]: 2017-09-28 13:09:36.886 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:36 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:36 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:36 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:36 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:37 ctl02 neutron-server[30536]: 2017-09-28 13:09:37.059 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:09:37] "OPTIONS / HTTP/1.0" 200 262 0.000461
Sep 28 13:09:37 ctl02 nova-api[18437]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:09:37 ctl02 nova-api[18437]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:09:37 ctl02 neutron-server[30536]: 2017-09-28 13:09:37.139 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:37 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:37 ctl02 neutron-server[30536]: 2017-09-28 13:09:37.139 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:37 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:37 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:37 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:37 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:37 ctl02 nova-api[18437]: 2017-09-28 13:09:37.296 18437 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:09:37 ctl02 nova-api[18437]: 2017-09-28 13:09:37.298 18437 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:09:37 ctl02 nova-api[18437]: 2017-09-28 13:09:37.298 18437 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:09:37 ctl02 nova-api[18437]: 2017-09-28 13:09:37.298 18437 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:09:37 ctl02 nova-api[18437]: 2017-09-28 13:09:37.298 18437 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:09:37 ctl02 nova-api[18437]: 2017-09-28 13:09:37.298 18437 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:09:37 ctl02 nova-api[18437]: 2017-09-28 13:09:37.298 18437 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:09:37 ctl02 nova-api[18437]: 2017-09-28 13:09:37.298 18437 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:09:37 ctl02 nova-api[18437]: 2017-09-28 13:09:37.298 18437 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:09:37 ctl02 nova-api[18437]: 2017-09-28 13:09:37.298 18437 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:09:37 ctl02 nova-api[18437]: 2017-09-28 13:09:37.298 18437 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:09:37 ctl02 nova-api[18437]: 2017-09-28 13:09:37.298 18437 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:09:37 ctl02 nova-api[18437]: 2017-09-28 13:09:37.298 18437 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:09:37 ctl02 nova-api[18437]: 2017-09-28 13:09:37.298 18437 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:09:37 ctl02 nova-api[18437]: 2017-09-28 13:09:37.298 18437 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:09:37 ctl02 nova-api[18437]: 2017-09-28 13:09:37.298 18437 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:09:37 ctl02 nova-api[18437]: 2017-09-28 13:09:37.298 18437 ERROR nova.wsgi     self.filename))
Sep 28 13:09:37 ctl02 nova-api[18437]: 2017-09-28 13:09:37.298 18437 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:09:37 ctl02 nova-api[18437]: 2017-09-28 13:09:37.298 18437 ERROR nova.wsgi
Sep 28 13:09:37 ctl02 nova-api[18437]: 2017-09-28 13:09:37.299 18437 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:09:37 ctl02 neutron-server[30536]: 2017-09-28 13:09:37.393 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:37 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:37 ctl02 neutron-server[30536]: 2017-09-28 13:09:37.393 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:37 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:37 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:37 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:37 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:37 ctl02 nova-api[18437]: 2017-09-28 13:09:37.433 18437 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:09:37 ctl02 neutron-server[30536]: 2017-09-28 13:09:37.646 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:37 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:37 ctl02 neutron-server[30536]: 2017-09-28 13:09:37.647 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:37 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:37 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:37 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:37 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:37 ctl02 nova-api[18437]: 2017-09-28 13:09:37.674 18437 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:09:37 ctl02 nova-api[18437]: 2017-09-28 13:09:37.676 18437 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:09:37 ctl02 nova-api[18437]: 2017-09-28 13:09:37.676 18437 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:09:37 ctl02 nova-api[18437]: 2017-09-28 13:09:37.677 18437 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:09:37 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf596d57)
Sep 28 13:09:37 ctl02 nova-api[18437]: 2017-09-28 13:09:37.810 18437 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:09:37 ctl02 nova-api[18437]: 2017-09-28 13:09:37.812 18437 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:09:37 ctl02 nova-api[18437]: 2017-09-28 13:09:37.812 18437 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:09:37 ctl02 nova-api[18437]: 2017-09-28 13:09:37.812 18437 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:09:37 ctl02 nova-api[18437]: 2017-09-28 13:09:37.816 18437 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:09:37 ctl02 nova-api[18437]: 2017-09-28 13:09:37.816 18437 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:09:37 ctl02 nova-api[18437]: 2017-09-28 13:09:37.816 18437 ERROR nova Traceback (most recent call last):
Sep 28 13:09:37 ctl02 nova-api[18437]: 2017-09-28 13:09:37.816 18437 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:09:37 ctl02 nova-api[18437]: 2017-09-28 13:09:37.816 18437 ERROR nova     sys.exit(main())
Sep 28 13:09:37 ctl02 nova-api[18437]: 2017-09-28 13:09:37.816 18437 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:09:37 ctl02 nova-api[18437]: 2017-09-28 13:09:37.816 18437 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:09:37 ctl02 nova-api[18437]: 2017-09-28 13:09:37.816 18437 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:09:37 ctl02 nova-api[18437]: 2017-09-28 13:09:37.816 18437 ERROR nova     max_url_len=max_url_len)
Sep 28 13:09:37 ctl02 nova-api[18437]: 2017-09-28 13:09:37.816 18437 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:09:37 ctl02 nova-api[18437]: 2017-09-28 13:09:37.816 18437 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:09:37 ctl02 nova-api[18437]: 2017-09-28 13:09:37.816 18437 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:09:37 ctl02 nova-api[18437]: 2017-09-28 13:09:37.816 18437 ERROR nova     sock.listen(backlog)
Sep 28 13:09:37 ctl02 nova-api[18437]: 2017-09-28 13:09:37.816 18437 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:09:37 ctl02 nova-api[18437]: 2017-09-28 13:09:37.816 18437 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:09:37 ctl02 nova-api[18437]: 2017-09-28 13:09:37.816 18437 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:09:37 ctl02 nova-api[18437]: 2017-09-28 13:09:37.816 18437 ERROR nova
Sep 28 13:09:37 ctl02 neutron-server[30536]: 2017-09-28 13:09:37.900 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:37 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:37 ctl02 neutron-server[30536]: 2017-09-28 13:09:37.901 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:37 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:37 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:37 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:37 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:37 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:09:37 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:09:37 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:09:38 ctl02 heat-api-cfn[13300]: 2017-09-28 13:09:38.076 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:09:38] "OPTIONS / HTTP/1.0" 200 134 0.000539
Sep 28 13:09:38 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:09:38 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:09:38 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:09:38 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:09:38 ctl02 neutron-server[30536]: 2017-09-28 13:09:38.154 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:38 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:38 ctl02 neutron-server[30536]: 2017-09-28 13:09:38.156 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:38 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:38 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:38 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:38 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:38 ctl02 nova-consoleauth[5433]: 2017-09-28 13:09:38.314 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:09:38 ctl02 neutron-server[30536]: 2017-09-28 13:09:38.411 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:38 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:38 ctl02 neutron-server[30536]: 2017-09-28 13:09:38.413 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:38 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:38 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:38 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:38 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:38 ctl02 heat-engine[12803]: 2017-09-28 13:09:38.537 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:09:38 ctl02 heat-engine[12803]: 2017-09-28 13:09:38.553 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:09:38 ctl02 heat-engine[12803]: 2017-09-28 13:09:38.562 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:09:38 ctl02 heat-engine[12803]: 2017-09-28 13:09:38.566 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:09:38 ctl02 neutron-server[30536]: 2017-09-28 13:09:38.667 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:38 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:38 ctl02 neutron-server[30536]: 2017-09-28 13:09:38.667 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:38 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:38 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:38 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:38 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:38 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xf596d57)
Sep 28 13:09:38 ctl02 heat-api[13008]: 2017-09-28 13:09:38.816 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:09:38] "OPTIONS / HTTP/1.0" 200 134 0.000562
Sep 28 13:09:38 ctl02 neutron-server[30536]: 2017-09-28 13:09:38.920 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:38 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:38 ctl02 neutron-server[30536]: 2017-09-28 13:09:38.921 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:38 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:38 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:38 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:38 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:39 ctl02 neutron-server[30536]: 2017-09-28 13:09:39.174 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:39 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:39 ctl02 neutron-server[30536]: 2017-09-28 13:09:39.175 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:39 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:39 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:39 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:39 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:39 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:09:39.253 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:09:39] "OPTIONS / HTTP/1.0" 200 134 0.000387
Sep 28 13:09:39 ctl02 neutron-server[30536]: 2017-09-28 13:09:39.438 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:39 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:39 ctl02 neutron-server[30536]: 2017-09-28 13:09:39.438 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:39 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:39 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:39 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:39 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:39 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:09:39.572 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:09:39] "OPTIONS / HTTP/1.0" 200 134 0.000332
Sep 28 13:09:39 ctl02 neutron-server[30536]: 2017-09-28 13:09:39.691 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:39 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:39 ctl02 neutron-server[30536]: 2017-09-28 13:09:39.691 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:39 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:39 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:39 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:39 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:39 ctl02 heat-api[13008]: 2017-09-28 13:09:39.702 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:09:39] "OPTIONS / HTTP/1.0" 200 134 0.000536
Sep 28 13:09:39 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 13:09:39 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 13:09:39 ctl02 nova-api[18454]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:09:39 ctl02 nova-api[18454]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:09:39 ctl02 systemd[1]: Stopping LSB: Start NTP daemon...
Sep 28 13:09:39 ctl02 ntp[18510]:  * Stopping NTP server ntpd
Sep 28 13:09:39 ctl02 ntp[18510]:    ...done.
Sep 28 13:09:39 ctl02 systemd[1]: Stopped LSB: Start NTP daemon.
Sep 28 13:09:39 ctl02 systemd[1]: Starting LSB: Start NTP daemon...
Sep 28 13:09:39 ctl02 ntp[18523]:  * Starting NTP server ntpd
Sep 28 13:09:39 ctl02 ntpd[18530]: ntpd 4.2.8p4@1.3265-o Thu Sep  7 20:43:09 UTC 2017 (1): Starting
Sep 28 13:09:39 ctl02 ntpd[18530]: Command line: /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 108:112
Sep 28 13:09:39 ctl02 ntp[18523]:    ...done.
Sep 28 13:09:39 ctl02 systemd[1]: Started LSB: Start NTP daemon.
Sep 28 13:09:39 ctl02 ntpd[18533]: proto: precision = 0.043 usec (-24)
Sep 28 13:09:39 ctl02 ntpd[18533]: switching logging to file /var/log/ntp.log
Sep 28 13:09:39 ctl02 neutron-server[30536]: 2017-09-28 13:09:39.944 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:39 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:39 ctl02 neutron-server[30536]: 2017-09-28 13:09:39.945 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:39 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:39 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:39 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:39 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:39 ctl02 nova-api[18454]: 2017-09-28 13:09:39.986 18454 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:09:39 ctl02 nova-api[18454]: 2017-09-28 13:09:39.988 18454 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:09:39 ctl02 nova-api[18454]: 2017-09-28 13:09:39.988 18454 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:09:39 ctl02 nova-api[18454]: 2017-09-28 13:09:39.988 18454 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:09:39 ctl02 nova-api[18454]: 2017-09-28 13:09:39.988 18454 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:09:39 ctl02 nova-api[18454]: 2017-09-28 13:09:39.988 18454 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:09:39 ctl02 nova-api[18454]: 2017-09-28 13:09:39.988 18454 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:09:39 ctl02 nova-api[18454]: 2017-09-28 13:09:39.988 18454 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:09:39 ctl02 nova-api[18454]: 2017-09-28 13:09:39.988 18454 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:09:39 ctl02 nova-api[18454]: 2017-09-28 13:09:39.988 18454 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:09:39 ctl02 nova-api[18454]: 2017-09-28 13:09:39.988 18454 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:09:39 ctl02 nova-api[18454]: 2017-09-28 13:09:39.988 18454 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:09:39 ctl02 nova-api[18454]: 2017-09-28 13:09:39.988 18454 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:09:39 ctl02 nova-api[18454]: 2017-09-28 13:09:39.988 18454 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:09:39 ctl02 nova-api[18454]: 2017-09-28 13:09:39.988 18454 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:09:39 ctl02 nova-api[18454]: 2017-09-28 13:09:39.988 18454 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:09:39 ctl02 nova-api[18454]: 2017-09-28 13:09:39.988 18454 ERROR nova.wsgi     self.filename))
Sep 28 13:09:39 ctl02 nova-api[18454]: 2017-09-28 13:09:39.988 18454 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:09:39 ctl02 nova-api[18454]: 2017-09-28 13:09:39.988 18454 ERROR nova.wsgi
Sep 28 13:09:39 ctl02 nova-api[18454]: 2017-09-28 13:09:39.989 18454 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:09:40 ctl02 neutron-server[30536]: 2017-09-28 13:09:40.099 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:09:40] "OPTIONS / HTTP/1.0" 200 262 0.000452
Sep 28 13:09:40 ctl02 nova-api[18454]: 2017-09-28 13:09:40.117 18454 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:09:40 ctl02 neutron-server[30536]: 2017-09-28 13:09:40.198 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:40 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:40 ctl02 neutron-server[30536]: 2017-09-28 13:09:40.199 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:40 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:40 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:40 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:40 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:40 ctl02 neutron-server[30536]: 2017-09-28 13:09:40.284 30600 WARNING oslo_messaging._drivers.amqpdriver [req-14cf4ee4-ee0a-45ff-91e3-7afaa53a0d0f - - - - -] reply_692b03e6d8d44d758b6be19b067c3aa3 doesn't exists, drop reply to 5d2087178f1f4a4286f0935c10ddc053
Sep 28 13:09:40 ctl02 neutron-server[30536]: 2017-09-28 13:09:40.285 30600 INFO oslo_messaging._drivers.amqpdriver [req-14cf4ee4-ee0a-45ff-91e3-7afaa53a0d0f - - - - -] The reply 5d2087178f1f4a4286f0935c10ddc053 cannot be sent  reply_692b03e6d8d44d758b6be19b067c3aa3 reply queue don't exist after 60 sec abandoning...
Sep 28 13:09:40 ctl02 nova-api[18454]: 2017-09-28 13:09:40.344 18454 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:09:40 ctl02 nova-api[18454]: 2017-09-28 13:09:40.346 18454 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:09:40 ctl02 nova-api[18454]: 2017-09-28 13:09:40.346 18454 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:09:40 ctl02 nova-api[18454]: 2017-09-28 13:09:40.346 18454 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:09:40 ctl02 neutron-server[30536]: 2017-09-28 13:09:40.452 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:40 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:40 ctl02 neutron-server[30536]: 2017-09-28 13:09:40.452 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:40 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:40 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:40 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:40 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:40 ctl02 glance-api[29183]: 2017-09-28 13:09:40.475 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:09:40] "OPTIONS / HTTP/1.0" 200 134 0.000549
Sep 28 13:09:40 ctl02 nova-api[18454]: 2017-09-28 13:09:40.478 18454 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:09:40 ctl02 nova-api[18454]: 2017-09-28 13:09:40.480 18454 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:09:40 ctl02 nova-api[18454]: 2017-09-28 13:09:40.480 18454 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:09:40 ctl02 nova-api[18454]: 2017-09-28 13:09:40.481 18454 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:09:40 ctl02 nova-api[18454]: 2017-09-28 13:09:40.484 18454 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:09:40 ctl02 nova-api[18454]: 2017-09-28 13:09:40.484 18454 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:09:40 ctl02 nova-api[18454]: 2017-09-28 13:09:40.484 18454 ERROR nova Traceback (most recent call last):
Sep 28 13:09:40 ctl02 nova-api[18454]: 2017-09-28 13:09:40.484 18454 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:09:40 ctl02 nova-api[18454]: 2017-09-28 13:09:40.484 18454 ERROR nova     sys.exit(main())
Sep 28 13:09:40 ctl02 nova-api[18454]: 2017-09-28 13:09:40.484 18454 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:09:40 ctl02 nova-api[18454]: 2017-09-28 13:09:40.484 18454 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:09:40 ctl02 nova-api[18454]: 2017-09-28 13:09:40.484 18454 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:09:40 ctl02 nova-api[18454]: 2017-09-28 13:09:40.484 18454 ERROR nova     max_url_len=max_url_len)
Sep 28 13:09:40 ctl02 nova-api[18454]: 2017-09-28 13:09:40.484 18454 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:09:40 ctl02 nova-api[18454]: 2017-09-28 13:09:40.484 18454 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:09:40 ctl02 nova-api[18454]: 2017-09-28 13:09:40.484 18454 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:09:40 ctl02 nova-api[18454]: 2017-09-28 13:09:40.484 18454 ERROR nova     sock.listen(backlog)
Sep 28 13:09:40 ctl02 nova-api[18454]: 2017-09-28 13:09:40.484 18454 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:09:40 ctl02 nova-api[18454]: 2017-09-28 13:09:40.484 18454 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:09:40 ctl02 nova-api[18454]: 2017-09-28 13:09:40.484 18454 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:09:40 ctl02 nova-api[18454]: 2017-09-28 13:09:40.484 18454 ERROR nova
Sep 28 13:09:40 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:09:40 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:09:40 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:09:40 ctl02 neutron-server[30536]: 2017-09-28 13:09:40.706 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:40 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:40 ctl02 neutron-server[30536]: 2017-09-28 13:09:40.706 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:40 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:40 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:40 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:40 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:40 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:09:40 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:09:40 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:09:40 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:09:40 ctl02 neutron-server[30536]: 2017-09-28 13:09:40.960 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:40 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:40 ctl02 neutron-server[30536]: 2017-09-28 13:09:40.960 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:40 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:40 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:40 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:40 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:41 ctl02 neutron-server[30536]: 2017-09-28 13:09:41.214 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:41 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:41 ctl02 neutron-server[30536]: 2017-09-28 13:09:41.215 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:41 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:41 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:41 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:41 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:41 ctl02 nova-scheduler[5620]: 2017-09-28 13:09:41.433 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:09:41 ctl02 neutron-server[30536]: 2017-09-28 13:09:41.468 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:41 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:41 ctl02 neutron-server[30536]: 2017-09-28 13:09:41.468 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:41 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:41 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:41 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:41 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:41 ctl02 neutron-server[30536]: 2017-09-28 13:09:41.721 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:41 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:41 ctl02 neutron-server[30536]: 2017-09-28 13:09:41.722 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:41 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:41 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:41 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:41 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:41 ctl02 neutron-server[30536]: 2017-09-28 13:09:41.975 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:41 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:41 ctl02 neutron-server[30536]: 2017-09-28 13:09:41.975 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:41 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:41 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:41 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:41 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:42 ctl02 neutron-server[30536]: 2017-09-28 13:09:42.228 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:42 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:42 ctl02 neutron-server[30536]: 2017-09-28 13:09:42.229 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:42 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:42 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:42 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:42 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:42 ctl02 neutron-server[30536]: 2017-09-28 13:09:42.481 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:42 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:42 ctl02 neutron-server[30536]: 2017-09-28 13:09:42.482 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:42 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:42 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:42 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:42 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:42 ctl02 glance-api[29183]: 2017-09-28 13:09:42.557 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:09:42] "OPTIONS / HTTP/1.0" 200 134 0.000569
Sep 28 13:09:42 ctl02 nova-api[18544]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:09:42 ctl02 nova-api[18544]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:09:42 ctl02 neutron-server[30536]: 2017-09-28 13:09:42.743 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:42 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:42 ctl02 neutron-server[30536]: 2017-09-28 13:09:42.744 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:42 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:42 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:42 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:42 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:42 ctl02 nova-api[18544]: 2017-09-28 13:09:42.750 18544 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:09:42 ctl02 nova-api[18544]: 2017-09-28 13:09:42.751 18544 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:09:42 ctl02 nova-api[18544]: 2017-09-28 13:09:42.751 18544 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:09:42 ctl02 nova-api[18544]: 2017-09-28 13:09:42.751 18544 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:09:42 ctl02 nova-api[18544]: 2017-09-28 13:09:42.751 18544 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:09:42 ctl02 nova-api[18544]: 2017-09-28 13:09:42.751 18544 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:09:42 ctl02 nova-api[18544]: 2017-09-28 13:09:42.751 18544 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:09:42 ctl02 nova-api[18544]: 2017-09-28 13:09:42.751 18544 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:09:42 ctl02 nova-api[18544]: 2017-09-28 13:09:42.751 18544 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:09:42 ctl02 nova-api[18544]: 2017-09-28 13:09:42.751 18544 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:09:42 ctl02 nova-api[18544]: 2017-09-28 13:09:42.751 18544 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:09:42 ctl02 nova-api[18544]: 2017-09-28 13:09:42.751 18544 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:09:42 ctl02 nova-api[18544]: 2017-09-28 13:09:42.751 18544 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:09:42 ctl02 nova-api[18544]: 2017-09-28 13:09:42.751 18544 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:09:42 ctl02 nova-api[18544]: 2017-09-28 13:09:42.751 18544 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:09:42 ctl02 nova-api[18544]: 2017-09-28 13:09:42.751 18544 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:09:42 ctl02 nova-api[18544]: 2017-09-28 13:09:42.751 18544 ERROR nova.wsgi     self.filename))
Sep 28 13:09:42 ctl02 nova-api[18544]: 2017-09-28 13:09:42.751 18544 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:09:42 ctl02 nova-api[18544]: 2017-09-28 13:09:42.751 18544 ERROR nova.wsgi
Sep 28 13:09:42 ctl02 nova-api[18544]: 2017-09-28 13:09:42.752 18544 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:09:42 ctl02 nova-api[18544]: 2017-09-28 13:09:42.883 18544 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:09:42 ctl02 neutron-server[30536]: 2017-09-28 13:09:42.997 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:42 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:42 ctl02 neutron-server[30536]: 2017-09-28 13:09:42.998 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:42 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:42 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:42 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:42 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:43 ctl02 nova-api[18544]: 2017-09-28 13:09:43.109 18544 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:09:43 ctl02 nova-api[18544]: 2017-09-28 13:09:43.112 18544 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:09:43 ctl02 nova-api[18544]: 2017-09-28 13:09:43.112 18544 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:09:43 ctl02 nova-api[18544]: 2017-09-28 13:09:43.112 18544 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:09:43 ctl02 nova-api[18544]: 2017-09-28 13:09:43.246 18544 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:09:43 ctl02 nova-api[18544]: 2017-09-28 13:09:43.248 18544 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:09:43 ctl02 nova-api[18544]: 2017-09-28 13:09:43.249 18544 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:09:43 ctl02 nova-api[18544]: 2017-09-28 13:09:43.249 18544 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:09:43 ctl02 neutron-server[30536]: 2017-09-28 13:09:43.251 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:43 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:43 ctl02 neutron-server[30536]: 2017-09-28 13:09:43.251 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:43 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:43 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:43 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:43 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:43 ctl02 nova-api[18544]: 2017-09-28 13:09:43.252 18544 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:09:43 ctl02 nova-api[18544]: 2017-09-28 13:09:43.252 18544 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:09:43 ctl02 nova-api[18544]: 2017-09-28 13:09:43.252 18544 ERROR nova Traceback (most recent call last):
Sep 28 13:09:43 ctl02 nova-api[18544]: 2017-09-28 13:09:43.252 18544 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:09:43 ctl02 nova-api[18544]: 2017-09-28 13:09:43.252 18544 ERROR nova     sys.exit(main())
Sep 28 13:09:43 ctl02 nova-api[18544]: 2017-09-28 13:09:43.252 18544 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:09:43 ctl02 nova-api[18544]: 2017-09-28 13:09:43.252 18544 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:09:43 ctl02 nova-api[18544]: 2017-09-28 13:09:43.252 18544 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:09:43 ctl02 nova-api[18544]: 2017-09-28 13:09:43.252 18544 ERROR nova     max_url_len=max_url_len)
Sep 28 13:09:43 ctl02 nova-api[18544]: 2017-09-28 13:09:43.252 18544 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:09:43 ctl02 nova-api[18544]: 2017-09-28 13:09:43.252 18544 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:09:43 ctl02 nova-api[18544]: 2017-09-28 13:09:43.252 18544 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:09:43 ctl02 nova-api[18544]: 2017-09-28 13:09:43.252 18544 ERROR nova     sock.listen(backlog)
Sep 28 13:09:43 ctl02 nova-api[18544]: 2017-09-28 13:09:43.252 18544 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:09:43 ctl02 nova-api[18544]: 2017-09-28 13:09:43.252 18544 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:09:43 ctl02 nova-api[18544]: 2017-09-28 13:09:43.252 18544 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:09:43 ctl02 nova-api[18544]: 2017-09-28 13:09:43.252 18544 ERROR nova
Sep 28 13:09:43 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:09:43 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:09:43 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:09:43 ctl02 neutron-server[30536]: 2017-09-28 13:09:43.505 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:43 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:43 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:09:43 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:09:43 ctl02 neutron-server[30536]: 2017-09-28 13:09:43.506 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:43 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:43 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:43 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:43 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:43 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:09:43 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:09:43 ctl02 neutron-server[30536]: 2017-09-28 13:09:43.759 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:43 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:43 ctl02 neutron-server[30536]: 2017-09-28 13:09:43.759 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:43 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:43 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:43 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:43 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:43 ctl02 heat-api-cfn[13300]: 2017-09-28 13:09:43.983 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:09:43] "OPTIONS / HTTP/1.0" 200 134 0.000439
Sep 28 13:09:44 ctl02 neutron-server[30536]: 2017-09-28 13:09:44.016 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:44 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:44 ctl02 neutron-server[30536]: 2017-09-28 13:09:44.016 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:44 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:44 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:44 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:44 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:44 ctl02 neutron-server[30536]: 2017-09-28 13:09:44.269 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:44 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:44 ctl02 neutron-server[30536]: 2017-09-28 13:09:44.270 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:44 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:44 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:44 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:44 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:44 ctl02 neutron-server[30536]: 2017-09-28 13:09:44.523 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:44 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:44 ctl02 neutron-server[30536]: 2017-09-28 13:09:44.523 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:44 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:44 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:44 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:44 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:44 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:09:44.745 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:09:44] "OPTIONS / HTTP/1.0" 200 134 0.000377
Sep 28 13:09:44 ctl02 neutron-server[30536]: 2017-09-28 13:09:44.776 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:44 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:44 ctl02 neutron-server[30536]: 2017-09-28 13:09:44.776 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:44 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:44 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:44 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:44 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:45 ctl02 neutron-server[30536]: 2017-09-28 13:09:45.029 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:45 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:45 ctl02 neutron-server[30536]: 2017-09-28 13:09:45.030 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:45 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:45 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:45 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:45 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:45 ctl02 heat-api[13008]: 2017-09-28 13:09:45.057 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:09:45] "OPTIONS / HTTP/1.0" 200 134 0.000531
Sep 28 13:09:45 ctl02 neutron-server[30536]: 2017-09-28 13:09:45.097 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:09:45] "OPTIONS / HTTP/1.0" 200 262 0.000458
Sep 28 13:09:45 ctl02 glance-api[29183]: 2017-09-28 13:09:45.137 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:09:45] "OPTIONS / HTTP/1.0" 200 134 0.000559
Sep 28 13:09:45 ctl02 nova-api[18562]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:09:45 ctl02 nova-api[18562]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:09:45 ctl02 neutron-server[30536]: 2017-09-28 13:09:45.283 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:45 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:45 ctl02 neutron-server[30536]: 2017-09-28 13:09:45.283 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:45 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:45 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:45 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:45 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:45 ctl02 nova-api[18562]: 2017-09-28 13:09:45.340 18562 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:09:45 ctl02 nova-api[18562]: 2017-09-28 13:09:45.342 18562 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:09:45 ctl02 nova-api[18562]: 2017-09-28 13:09:45.342 18562 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:09:45 ctl02 nova-api[18562]: 2017-09-28 13:09:45.342 18562 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:09:45 ctl02 nova-api[18562]: 2017-09-28 13:09:45.342 18562 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:09:45 ctl02 nova-api[18562]: 2017-09-28 13:09:45.342 18562 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:09:45 ctl02 nova-api[18562]: 2017-09-28 13:09:45.342 18562 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:09:45 ctl02 nova-api[18562]: 2017-09-28 13:09:45.342 18562 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:09:45 ctl02 nova-api[18562]: 2017-09-28 13:09:45.342 18562 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:09:45 ctl02 nova-api[18562]: 2017-09-28 13:09:45.342 18562 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:09:45 ctl02 nova-api[18562]: 2017-09-28 13:09:45.342 18562 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:09:45 ctl02 nova-api[18562]: 2017-09-28 13:09:45.342 18562 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:09:45 ctl02 nova-api[18562]: 2017-09-28 13:09:45.342 18562 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:09:45 ctl02 nova-api[18562]: 2017-09-28 13:09:45.342 18562 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:09:45 ctl02 nova-api[18562]: 2017-09-28 13:09:45.342 18562 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:09:45 ctl02 nova-api[18562]: 2017-09-28 13:09:45.342 18562 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:09:45 ctl02 nova-api[18562]: 2017-09-28 13:09:45.342 18562 ERROR nova.wsgi     self.filename))
Sep 28 13:09:45 ctl02 nova-api[18562]: 2017-09-28 13:09:45.342 18562 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:09:45 ctl02 nova-api[18562]: 2017-09-28 13:09:45.342 18562 ERROR nova.wsgi
Sep 28 13:09:45 ctl02 nova-api[18562]: 2017-09-28 13:09:45.343 18562 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:09:45 ctl02 nova-api[18562]: 2017-09-28 13:09:45.468 18562 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:09:45 ctl02 neutron-server[30536]: 2017-09-28 13:09:45.536 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:45 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:45 ctl02 neutron-server[30536]: 2017-09-28 13:09:45.537 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:45 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:45 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:45 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:45 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:45 ctl02 nova-api[18562]: 2017-09-28 13:09:45.687 18562 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:09:45 ctl02 nova-api[18562]: 2017-09-28 13:09:45.689 18562 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:09:45 ctl02 nova-api[18562]: 2017-09-28 13:09:45.690 18562 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:09:45 ctl02 nova-api[18562]: 2017-09-28 13:09:45.690 18562 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:09:45 ctl02 neutron-server[30536]: 2017-09-28 13:09:45.790 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:45 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:45 ctl02 neutron-server[30536]: 2017-09-28 13:09:45.790 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:45 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:45 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:45 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:45 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:45 ctl02 nova-api[18562]: 2017-09-28 13:09:45.819 18562 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:09:45 ctl02 nova-api[18562]: 2017-09-28 13:09:45.821 18562 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:09:45 ctl02 nova-api[18562]: 2017-09-28 13:09:45.821 18562 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:09:45 ctl02 nova-api[18562]: 2017-09-28 13:09:45.822 18562 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:09:45 ctl02 nova-api[18562]: 2017-09-28 13:09:45.825 18562 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:09:45 ctl02 nova-api[18562]: 2017-09-28 13:09:45.825 18562 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:09:45 ctl02 nova-api[18562]: 2017-09-28 13:09:45.825 18562 ERROR nova Traceback (most recent call last):
Sep 28 13:09:45 ctl02 nova-api[18562]: 2017-09-28 13:09:45.825 18562 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:09:45 ctl02 nova-api[18562]: 2017-09-28 13:09:45.825 18562 ERROR nova     sys.exit(main())
Sep 28 13:09:45 ctl02 nova-api[18562]: 2017-09-28 13:09:45.825 18562 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:09:45 ctl02 nova-api[18562]: 2017-09-28 13:09:45.825 18562 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:09:45 ctl02 nova-api[18562]: 2017-09-28 13:09:45.825 18562 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:09:45 ctl02 nova-api[18562]: 2017-09-28 13:09:45.825 18562 ERROR nova     max_url_len=max_url_len)
Sep 28 13:09:45 ctl02 nova-api[18562]: 2017-09-28 13:09:45.825 18562 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:09:45 ctl02 nova-api[18562]: 2017-09-28 13:09:45.825 18562 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:09:45 ctl02 nova-api[18562]: 2017-09-28 13:09:45.825 18562 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:09:45 ctl02 nova-api[18562]: 2017-09-28 13:09:45.825 18562 ERROR nova     sock.listen(backlog)
Sep 28 13:09:45 ctl02 nova-api[18562]: 2017-09-28 13:09:45.825 18562 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:09:45 ctl02 nova-api[18562]: 2017-09-28 13:09:45.825 18562 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:09:45 ctl02 nova-api[18562]: 2017-09-28 13:09:45.825 18562 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:09:45 ctl02 nova-api[18562]: 2017-09-28 13:09:45.825 18562 ERROR nova
Sep 28 13:09:45 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:09:45 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:09:45 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:09:46 ctl02 neutron-server[30536]: 2017-09-28 13:09:46.044 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:46 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:46 ctl02 neutron-server[30536]: 2017-09-28 13:09:46.044 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:46 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:46 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:46 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:46 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:46 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:09:46 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:09:46 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:09:46 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:09:46 ctl02 neutron-server[30536]: 2017-09-28 13:09:46.297 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:46 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:46 ctl02 neutron-server[30536]: 2017-09-28 13:09:46.298 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:46 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:46 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:46 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:46 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:46 ctl02 neutron-server[30536]: 2017-09-28 13:09:46.555 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] Returning exception (pymysql.err.InternalError) (1054, u"Unknown column 'subnets.tenant_id' in 'field list'") [SQL: u'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetpools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipall
Sep 28 13:09:46 ctl02 neutron-server[30536]: ocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDER BY dnsnameservers_1.`order`'] to caller
Sep 28 13:09:46 ctl02 neutron-server[30536]: 2017-09-28 13:09:46.555 30601 ERROR oslo_messaging._drivers.common [req-292a5cd8-3137-4756-82cd-0a922af0a561 - - - - -] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch\n    result = func(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 133, in get_active_networks_info\n    networks = self._get_active_networks(context, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/dhcp_rpc.py", line 74, in _get_active_networks\n    plugin.auto_schedule_networks(context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/agentschedulers_db.py", line 463, in auto_schedule_networks\n    self.network_scheduler.auto_schedule_networks(self, context, host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/scheduler/dhcp_agent_scheduler.py", line 47, in auto_schedule_networks\n    subnets = plugin.get_subnets(context, fields=fields)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_v2.py", line 893, in get_subnets\n    marker, page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/db_base_plugin_common.py", line 268, in _get_subnets\n    page_reverse=page_reverse)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/db/common_db_mixin.py", line 313, in _get_collection\n    items = [dict_func(c, fields) for c in query]\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__\n    return self._execute_and_instances(context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances\n    result = conn.execute(querycont
Sep 28 13:09:46 ctl02 neutron-server[30536]: ext.statement, self._params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute\n    return meth(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection\n    return connection._execute_clauseelement(self, multiparams, params)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement\n    compiled_sql, distilled_params\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception\n    util.raise_from_cause(newraise, exc_info)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause\n    reraise(type(exception), exception, tb=exc_tb)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context\n    context)\n', '  File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute\n    cursor.execute(statement, parameters)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 158, in execute\n    result = self._query(query)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 308, in _query\n    conn.query(q)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 820, in query\n    self._affected_rows = self._read_query_result(unbuffered=unbuffered)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1002, in _read_query_result\n    result.read()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1285, in read\n    first_packet = self.connection._read_packet()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 966, in _read_packet\n    packet.check_error()\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", lin
Sep 28 13:09:46 ctl02 neutron-server[30536]: e 394, in check_error\n    err.raise_mysql_exception(self._data)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 120, in raise_mysql_exception\n    _check_mysql_exception(errinfo)\n', '  File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 115, in _check_mysql_exception\n    raise InternalError(errno, errorvalue)\n', 'DBError: (pymysql.err.InternalError) (1054, u"Unknown column \'subnets.tenant_id\' in \'field list\'") [SQL: u\'SELECT subnets.tenant_id AS subnets_tenant_id, subnets.id AS subnets_id, subnets.name AS subnets_name, subnets.network_id AS subnets_network_id, subnets.subnetpool_id AS subnets_subnetpool_id, subnets.ip_version AS subnets_ip_version, subnets.cidr AS subnets_cidr, subnets.gateway_ip AS subnets_gateway_ip, subnets.enable_dhcp AS subnets_enable_dhcp, subnets.ipv6_ra_mode AS subnets_ipv6_ra_mode, subnets.ipv6_address_mode AS subnets_ipv6_address_mode, subnets.standard_attr_id AS subnets_standard_attr_id, subnetpoolprefixes_1.cidr AS subnetpoolprefixes_1_cidr, subnetpoolprefixes_1.subnetpool_id AS subnetpoolprefixes_1_subnetpool_id, standardattributes_1.created_at AS standardattributes_1_created_at, standardattributes_1.updated_at AS standardattributes_1_updated_at, standardattributes_1.id AS standardattributes_1_id, standardattributes_1.resource_type AS standardattributes_1_resource_type, standardattributes_1.description AS standardattributes_1_description, tags_1.standard_attr_id AS tags_1_standard_attr_id, tags_1.tag AS tags_1_tag, subnetpools_1.tenant_id AS subnetpools_1_tenant_id, subnetpools_1.id AS subnetpools_1_id, subnetpools_1.name AS subnetpools_1_name, subnetpools_1.ip_version AS subnetpools_1_ip_version, subnetpools_1.default_prefixlen AS subnetpools_1_default_prefixlen, subnetpools_1.min_prefixlen AS subnetpools_1_min_prefixlen, subnetpools_1.max_prefixlen AS subnetpools_1_max_prefixlen, subnetpools_1.shared AS subnetpools_1_shared, subnetpools_1.is_default AS subnetpools_1_is_default, subnetpools_1.default_quota AS subnetpools_1_default_quota, subnetp
Sep 28 13:09:46 ctl02 neutron-server[30536]: ools_1.hash AS subnetpools_1_hash, subnetpools_1.address_scope_id AS subnetpools_1_address_scope_id, subnetpools_1.standard_attr_id AS subnetpools_1_standard_attr_id, ipallocationpools_1.id AS ipallocationpools_1_id, ipallocationpools_1.subnet_id AS ipallocationpools_1_subnet_id, ipallocationpools_1.first_ip AS ipallocationpools_1_first_ip, ipallocationpools_1.last_ip AS ipallocationpools_1_last_ip, dnsnameservers_1.address AS dnsnameservers_1_address, dnsnameservers_1.subnet_id AS dnsnameservers_1_subnet_id, dnsnameservers_1.`order` AS dnsnameservers_1_order, subnetroutes_1.destination AS subnetroutes_1_destination, subnetroutes_1.nexthop AS subnetroutes_1_nexthop, subnetroutes_1.subnet_id AS subnetroutes_1_subnet_id, standardattributes_2.created_at AS standardattributes_2_created_at, standardattributes_2.updated_at AS standardattributes_2_updated_at, standardattributes_2.id AS standardattributes_2_id, standardattributes_2.resource_type AS standardattributes_2_resource_type, standardattributes_2.description AS standardattributes_2_description, tags_2.standard_attr_id AS tags_2_standard_attr_id, tags_2.tag AS tags_2_tag \\nFROM subnets LEFT OUTER JOIN subnetpools AS subnetpools_1 ON subnets.subnetpool_id = subnetpools_1.id LEFT OUTER JOIN subnetpoolprefixes AS subnetpoolprefixes_1 ON subnetpools_1.id = subnetpoolprefixes_1.subnetpool_id LEFT OUTER JOIN standardattributes AS standardattributes_1 ON standardattributes_1.id = subnetpools_1.standard_attr_id LEFT OUTER JOIN tags AS tags_1 ON standardattributes_1.id = tags_1.standard_attr_id LEFT OUTER JOIN ipallocationpools AS ipallocationpools_1 ON subnets.id = ipallocationpools_1.subnet_id LEFT OUTER JOIN dnsnameservers AS dnsnameservers_1 ON subnets.id = dnsnameservers_1.subnet_id LEFT OUTER JOIN subnetroutes AS subnetroutes_1 ON subnets.id = subnetroutes_1.subnet_id LEFT OUTER JOIN standardattributes AS standardattributes_2 ON standardattributes_2.id = subnets.standard_attr_id LEFT OUTER JOIN tags AS tags_2 ON standardattributes_2.id = tags_2.standard_attr_id ORDE
Sep 28 13:09:46 ctl02 neutron-server[30536]: R BY dnsnameservers_1.`order`\']\n']
Sep 28 13:09:46 ctl02 heat-api-cfn[13300]: 2017-09-28 13:09:46.712 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:09:46] "OPTIONS / HTTP/1.0" 200 134 0.000431
Sep 28 13:09:46 ctl02 neutron-server[30536]: 2017-09-28 13:09:46.940 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:09:46] "OPTIONS / HTTP/1.0" 200 262 0.000451
Sep 28 13:09:47 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd526f660)
Sep 28 13:09:47 ctl02 nova-api[18579]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:09:47 ctl02 nova-api[18579]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:09:47 ctl02 heat-api-cfn[13300]: 2017-09-28 13:09:47.930 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:09:47] "OPTIONS / HTTP/1.0" 200 134 0.000445
Sep 28 13:09:47 ctl02 nova-api[18579]: 2017-09-28 13:09:47.998 18579 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:09:48 ctl02 nova-api[18579]: 2017-09-28 13:09:48.000 18579 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:09:48 ctl02 nova-api[18579]: 2017-09-28 13:09:48.000 18579 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:09:48 ctl02 nova-api[18579]: 2017-09-28 13:09:48.000 18579 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:09:48 ctl02 nova-api[18579]: 2017-09-28 13:09:48.000 18579 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:09:48 ctl02 nova-api[18579]: 2017-09-28 13:09:48.000 18579 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:09:48 ctl02 nova-api[18579]: 2017-09-28 13:09:48.000 18579 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:09:48 ctl02 nova-api[18579]: 2017-09-28 13:09:48.000 18579 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:09:48 ctl02 nova-api[18579]: 2017-09-28 13:09:48.000 18579 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:09:48 ctl02 nova-api[18579]: 2017-09-28 13:09:48.000 18579 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:09:48 ctl02 nova-api[18579]: 2017-09-28 13:09:48.000 18579 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:09:48 ctl02 nova-api[18579]: 2017-09-28 13:09:48.000 18579 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:09:48 ctl02 nova-api[18579]: 2017-09-28 13:09:48.000 18579 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:09:48 ctl02 nova-api[18579]: 2017-09-28 13:09:48.000 18579 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:09:48 ctl02 nova-api[18579]: 2017-09-28 13:09:48.000 18579 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:09:48 ctl02 nova-api[18579]: 2017-09-28 13:09:48.000 18579 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:09:48 ctl02 nova-api[18579]: 2017-09-28 13:09:48.000 18579 ERROR nova.wsgi     self.filename))
Sep 28 13:09:48 ctl02 nova-api[18579]: 2017-09-28 13:09:48.000 18579 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:09:48 ctl02 nova-api[18579]: 2017-09-28 13:09:48.000 18579 ERROR nova.wsgi
Sep 28 13:09:48 ctl02 nova-api[18579]: 2017-09-28 13:09:48.001 18579 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:09:48 ctl02 nova-api[18579]: 2017-09-28 13:09:48.133 18579 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:09:48 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd526f660)
Sep 28 13:09:48 ctl02 nova-api[18579]: 2017-09-28 13:09:48.358 18579 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:09:48 ctl02 nova-api[18579]: 2017-09-28 13:09:48.360 18579 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:09:48 ctl02 nova-api[18579]: 2017-09-28 13:09:48.360 18579 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:09:48 ctl02 nova-api[18579]: 2017-09-28 13:09:48.361 18579 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:09:48 ctl02 nova-api[18579]: 2017-09-28 13:09:48.496 18579 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:09:48 ctl02 nova-api[18579]: 2017-09-28 13:09:48.498 18579 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:09:48 ctl02 nova-api[18579]: 2017-09-28 13:09:48.498 18579 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:09:48 ctl02 nova-api[18579]: 2017-09-28 13:09:48.498 18579 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:09:48 ctl02 nova-api[18579]: 2017-09-28 13:09:48.502 18579 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:09:48 ctl02 nova-api[18579]: 2017-09-28 13:09:48.502 18579 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:09:48 ctl02 nova-api[18579]: 2017-09-28 13:09:48.502 18579 ERROR nova Traceback (most recent call last):
Sep 28 13:09:48 ctl02 nova-api[18579]: 2017-09-28 13:09:48.502 18579 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:09:48 ctl02 nova-api[18579]: 2017-09-28 13:09:48.502 18579 ERROR nova     sys.exit(main())
Sep 28 13:09:48 ctl02 nova-api[18579]: 2017-09-28 13:09:48.502 18579 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:09:48 ctl02 nova-api[18579]: 2017-09-28 13:09:48.502 18579 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:09:48 ctl02 nova-api[18579]: 2017-09-28 13:09:48.502 18579 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:09:48 ctl02 nova-api[18579]: 2017-09-28 13:09:48.502 18579 ERROR nova     max_url_len=max_url_len)
Sep 28 13:09:48 ctl02 nova-api[18579]: 2017-09-28 13:09:48.502 18579 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:09:48 ctl02 nova-api[18579]: 2017-09-28 13:09:48.502 18579 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:09:48 ctl02 nova-api[18579]: 2017-09-28 13:09:48.502 18579 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:09:48 ctl02 nova-api[18579]: 2017-09-28 13:09:48.502 18579 ERROR nova     sock.listen(backlog)
Sep 28 13:09:48 ctl02 nova-api[18579]: 2017-09-28 13:09:48.502 18579 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:09:48 ctl02 nova-api[18579]: 2017-09-28 13:09:48.502 18579 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:09:48 ctl02 nova-api[18579]: 2017-09-28 13:09:48.502 18579 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:09:48 ctl02 nova-api[18579]: 2017-09-28 13:09:48.502 18579 ERROR nova
Sep 28 13:09:48 ctl02 heat-api[13008]: 2017-09-28 13:09:48.584 13086 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:09:48] "OPTIONS / HTTP/1.0" 200 134 0.000610
Sep 28 13:09:48 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:09:48 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:09:48 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:09:48 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:09:48 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:09:48 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:09:48 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:09:49 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd526f660)
Sep 28 13:09:49 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:09:49.281 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:09:49] "OPTIONS / HTTP/1.0" 200 134 0.000495
Sep 28 13:09:49 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:09:49.383 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:09:49] "OPTIONS / HTTP/1.0" 200 134 0.000330
Sep 28 13:09:48 ctl02 systemd[1]: Time has been changed
Sep 28 13:09:48 ctl02 neutron-server[30536]: 2017-09-28 13:09:48.476 30594 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:09:48] "OPTIONS / HTTP/1.0" 200 262 0.000657
Sep 28 13:09:48 ctl02 heat-api[13008]: 2017-09-28 13:09:48.524 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:09:48] "OPTIONS / HTTP/1.0" 200 134 0.000723
Sep 28 13:09:49 ctl02 nova-api[18598]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:09:49 ctl02 nova-api[18598]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:09:49 ctl02 glance-api[29183]: 2017-09-28 13:09:49.243 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:09:49] "OPTIONS / HTTP/1.0" 200 134 0.000618
Sep 28 13:09:49 ctl02 nova-api[18598]: 2017-09-28 13:09:49.339 18598 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:09:49 ctl02 nova-api[18598]: 2017-09-28 13:09:49.341 18598 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:09:49 ctl02 nova-api[18598]: 2017-09-28 13:09:49.341 18598 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:09:49 ctl02 nova-api[18598]: 2017-09-28 13:09:49.341 18598 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:09:49 ctl02 nova-api[18598]: 2017-09-28 13:09:49.341 18598 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:09:49 ctl02 nova-api[18598]: 2017-09-28 13:09:49.341 18598 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:09:49 ctl02 nova-api[18598]: 2017-09-28 13:09:49.341 18598 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:09:49 ctl02 nova-api[18598]: 2017-09-28 13:09:49.341 18598 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:09:49 ctl02 nova-api[18598]: 2017-09-28 13:09:49.341 18598 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:09:49 ctl02 nova-api[18598]: 2017-09-28 13:09:49.341 18598 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:09:49 ctl02 nova-api[18598]: 2017-09-28 13:09:49.341 18598 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:09:49 ctl02 nova-api[18598]: 2017-09-28 13:09:49.341 18598 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:09:49 ctl02 nova-api[18598]: 2017-09-28 13:09:49.341 18598 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:09:49 ctl02 nova-api[18598]: 2017-09-28 13:09:49.341 18598 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:09:49 ctl02 nova-api[18598]: 2017-09-28 13:09:49.341 18598 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:09:49 ctl02 nova-api[18598]: 2017-09-28 13:09:49.341 18598 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:09:49 ctl02 nova-api[18598]: 2017-09-28 13:09:49.341 18598 ERROR nova.wsgi     self.filename))
Sep 28 13:09:49 ctl02 nova-api[18598]: 2017-09-28 13:09:49.341 18598 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:09:49 ctl02 nova-api[18598]: 2017-09-28 13:09:49.341 18598 ERROR nova.wsgi
Sep 28 13:09:49 ctl02 nova-api[18598]: 2017-09-28 13:09:49.342 18598 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:09:49 ctl02 nova-api[18598]: 2017-09-28 13:09:49.473 18598 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:09:49 ctl02 nova-api[18598]: 2017-09-28 13:09:49.715 18598 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:09:49 ctl02 nova-api[18598]: 2017-09-28 13:09:49.718 18598 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:09:49 ctl02 nova-api[18598]: 2017-09-28 13:09:49.718 18598 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:09:49 ctl02 nova-api[18598]: 2017-09-28 13:09:49.718 18598 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:09:49 ctl02 nova-api[18598]: 2017-09-28 13:09:49.849 18598 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:09:49 ctl02 nova-api[18598]: 2017-09-28 13:09:49.851 18598 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:09:49 ctl02 nova-api[18598]: 2017-09-28 13:09:49.851 18598 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:09:49 ctl02 nova-api[18598]: 2017-09-28 13:09:49.852 18598 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:09:49 ctl02 nova-api[18598]: 2017-09-28 13:09:49.855 18598 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:09:49 ctl02 nova-api[18598]: 2017-09-28 13:09:49.855 18598 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:09:49 ctl02 nova-api[18598]: 2017-09-28 13:09:49.855 18598 ERROR nova Traceback (most recent call last):
Sep 28 13:09:49 ctl02 nova-api[18598]: 2017-09-28 13:09:49.855 18598 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:09:49 ctl02 nova-api[18598]: 2017-09-28 13:09:49.855 18598 ERROR nova     sys.exit(main())
Sep 28 13:09:49 ctl02 nova-api[18598]: 2017-09-28 13:09:49.855 18598 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:09:49 ctl02 nova-api[18598]: 2017-09-28 13:09:49.855 18598 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:09:49 ctl02 nova-api[18598]: 2017-09-28 13:09:49.855 18598 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:09:49 ctl02 nova-api[18598]: 2017-09-28 13:09:49.855 18598 ERROR nova     max_url_len=max_url_len)
Sep 28 13:09:49 ctl02 nova-api[18598]: 2017-09-28 13:09:49.855 18598 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:09:49 ctl02 nova-api[18598]: 2017-09-28 13:09:49.855 18598 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:09:49 ctl02 nova-api[18598]: 2017-09-28 13:09:49.855 18598 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:09:49 ctl02 nova-api[18598]: 2017-09-28 13:09:49.855 18598 ERROR nova     sock.listen(backlog)
Sep 28 13:09:49 ctl02 nova-api[18598]: 2017-09-28 13:09:49.855 18598 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:09:49 ctl02 nova-api[18598]: 2017-09-28 13:09:49.855 18598 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:09:49 ctl02 nova-api[18598]: 2017-09-28 13:09:49.855 18598 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:09:49 ctl02 nova-api[18598]: 2017-09-28 13:09:49.855 18598 ERROR nova
Sep 28 13:09:50 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:09:50 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:09:50 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:09:50 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd526f660)
Sep 28 13:09:50 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:09:50 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:09:50 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:09:50 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:09:50 ctl02 neutron-server[30536]: 2017-09-28 13:09:50.949 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 13:09:50 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 13:09:50 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 13:09:16 cmp002
Sep 28 13:09:50 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 13:09:08 cmp001
Sep 28 13:09:50 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 13:08:40 cmp002
Sep 28 13:09:51 ctl02 glance-api[29183]: 2017-09-28 13:09:51.088 29257 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:09:51] "OPTIONS / HTTP/1.0" 200 134 0.000701
Sep 28 13:09:51 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd526f660)
Sep 28 13:09:51 ctl02 nova-api[18616]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:09:51 ctl02 nova-api[18616]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:09:52 ctl02 nova-api[18616]: 2017-09-28 13:09:52.102 18616 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:09:52 ctl02 nova-api[18616]: 2017-09-28 13:09:52.104 18616 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:09:52 ctl02 nova-api[18616]: 2017-09-28 13:09:52.104 18616 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:09:52 ctl02 nova-api[18616]: 2017-09-28 13:09:52.104 18616 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:09:52 ctl02 nova-api[18616]: 2017-09-28 13:09:52.104 18616 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:09:52 ctl02 nova-api[18616]: 2017-09-28 13:09:52.104 18616 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:09:52 ctl02 nova-api[18616]: 2017-09-28 13:09:52.104 18616 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:09:52 ctl02 nova-api[18616]: 2017-09-28 13:09:52.104 18616 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:09:52 ctl02 nova-api[18616]: 2017-09-28 13:09:52.104 18616 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:09:52 ctl02 nova-api[18616]: 2017-09-28 13:09:52.104 18616 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:09:52 ctl02 nova-api[18616]: 2017-09-28 13:09:52.104 18616 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:09:52 ctl02 nova-api[18616]: 2017-09-28 13:09:52.104 18616 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:09:52 ctl02 nova-api[18616]: 2017-09-28 13:09:52.104 18616 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:09:52 ctl02 nova-api[18616]: 2017-09-28 13:09:52.104 18616 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:09:52 ctl02 nova-api[18616]: 2017-09-28 13:09:52.104 18616 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:09:52 ctl02 nova-api[18616]: 2017-09-28 13:09:52.104 18616 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:09:52 ctl02 nova-api[18616]: 2017-09-28 13:09:52.104 18616 ERROR nova.wsgi     self.filename))
Sep 28 13:09:52 ctl02 nova-api[18616]: 2017-09-28 13:09:52.104 18616 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:09:52 ctl02 nova-api[18616]: 2017-09-28 13:09:52.104 18616 ERROR nova.wsgi
Sep 28 13:09:52 ctl02 nova-api[18616]: 2017-09-28 13:09:52.105 18616 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:09:52 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd526f660)
Sep 28 13:09:52 ctl02 nova-api[18616]: 2017-09-28 13:09:52.236 18616 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:09:52 ctl02 nova-api[18616]: 2017-09-28 13:09:52.479 18616 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:09:52 ctl02 nova-api[18616]: 2017-09-28 13:09:52.481 18616 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:09:52 ctl02 nova-api[18616]: 2017-09-28 13:09:52.481 18616 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:09:52 ctl02 nova-api[18616]: 2017-09-28 13:09:52.481 18616 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:09:52 ctl02 nova-api[18616]: 2017-09-28 13:09:52.613 18616 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:09:52 ctl02 nova-api[18616]: 2017-09-28 13:09:52.615 18616 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:09:52 ctl02 nova-api[18616]: 2017-09-28 13:09:52.615 18616 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:09:52 ctl02 nova-api[18616]: 2017-09-28 13:09:52.615 18616 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:09:52 ctl02 nova-api[18616]: 2017-09-28 13:09:52.618 18616 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:09:52 ctl02 nova-api[18616]: 2017-09-28 13:09:52.619 18616 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:09:52 ctl02 nova-api[18616]: 2017-09-28 13:09:52.619 18616 ERROR nova Traceback (most recent call last):
Sep 28 13:09:52 ctl02 nova-api[18616]: 2017-09-28 13:09:52.619 18616 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:09:52 ctl02 nova-api[18616]: 2017-09-28 13:09:52.619 18616 ERROR nova     sys.exit(main())
Sep 28 13:09:52 ctl02 nova-api[18616]: 2017-09-28 13:09:52.619 18616 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:09:52 ctl02 nova-api[18616]: 2017-09-28 13:09:52.619 18616 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:09:52 ctl02 nova-api[18616]: 2017-09-28 13:09:52.619 18616 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:09:52 ctl02 nova-api[18616]: 2017-09-28 13:09:52.619 18616 ERROR nova     max_url_len=max_url_len)
Sep 28 13:09:52 ctl02 nova-api[18616]: 2017-09-28 13:09:52.619 18616 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:09:52 ctl02 nova-api[18616]: 2017-09-28 13:09:52.619 18616 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:09:52 ctl02 nova-api[18616]: 2017-09-28 13:09:52.619 18616 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:09:52 ctl02 nova-api[18616]: 2017-09-28 13:09:52.619 18616 ERROR nova     sock.listen(backlog)
Sep 28 13:09:52 ctl02 nova-api[18616]: 2017-09-28 13:09:52.619 18616 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:09:52 ctl02 nova-api[18616]: 2017-09-28 13:09:52.619 18616 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:09:52 ctl02 nova-api[18616]: 2017-09-28 13:09:52.619 18616 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:09:52 ctl02 nova-api[18616]: 2017-09-28 13:09:52.619 18616 ERROR nova
Sep 28 13:09:52 ctl02 heat-api-cfn[13300]: 2017-09-28 13:09:52.727 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:09:52] "OPTIONS / HTTP/1.0" 200 134 0.000525
Sep 28 13:09:52 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:09:52 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:09:52 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:09:52 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:09:52 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:09:52 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:09:52 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:09:53 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:09:53.027 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:09:53] "OPTIONS / HTTP/1.0" 200 134 0.000474
Sep 28 13:09:53 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd526f660)
Sep 28 13:09:53 ctl02 heat-api[13008]: 2017-09-28 13:09:53.916 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:09:53] "OPTIONS / HTTP/1.0" 200 134 0.000595
Sep 28 13:09:54 ctl02 neutron-server[30536]: 2017-09-28 13:09:54.025 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:09:54] "OPTIONS / HTTP/1.0" 200 262 0.000464
Sep 28 13:09:54 ctl02 glance-api[29183]: 2017-09-28 13:09:54.096 29254 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:09:54] "OPTIONS / HTTP/1.0" 200 134 0.000574
Sep 28 13:09:54 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd526f660)
Sep 28 13:09:54 ctl02 nova-api[18634]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:09:54 ctl02 nova-api[18634]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:09:54 ctl02 nova-api[18634]: 2017-09-28 13:09:54.816 18634 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:09:54 ctl02 nova-api[18634]: 2017-09-28 13:09:54.817 18634 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:09:54 ctl02 nova-api[18634]: 2017-09-28 13:09:54.817 18634 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:09:54 ctl02 nova-api[18634]: 2017-09-28 13:09:54.817 18634 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:09:54 ctl02 nova-api[18634]: 2017-09-28 13:09:54.817 18634 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:09:54 ctl02 nova-api[18634]: 2017-09-28 13:09:54.817 18634 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:09:54 ctl02 nova-api[18634]: 2017-09-28 13:09:54.817 18634 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:09:54 ctl02 nova-api[18634]: 2017-09-28 13:09:54.817 18634 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:09:54 ctl02 nova-api[18634]: 2017-09-28 13:09:54.817 18634 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:09:54 ctl02 nova-api[18634]: 2017-09-28 13:09:54.817 18634 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:09:54 ctl02 nova-api[18634]: 2017-09-28 13:09:54.817 18634 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:09:54 ctl02 nova-api[18634]: 2017-09-28 13:09:54.817 18634 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:09:54 ctl02 nova-api[18634]: 2017-09-28 13:09:54.817 18634 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:09:54 ctl02 nova-api[18634]: 2017-09-28 13:09:54.817 18634 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:09:54 ctl02 nova-api[18634]: 2017-09-28 13:09:54.817 18634 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:09:54 ctl02 nova-api[18634]: 2017-09-28 13:09:54.817 18634 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:09:54 ctl02 nova-api[18634]: 2017-09-28 13:09:54.817 18634 ERROR nova.wsgi     self.filename))
Sep 28 13:09:54 ctl02 nova-api[18634]: 2017-09-28 13:09:54.817 18634 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:09:54 ctl02 nova-api[18634]: 2017-09-28 13:09:54.817 18634 ERROR nova.wsgi
Sep 28 13:09:54 ctl02 nova-api[18634]: 2017-09-28 13:09:54.818 18634 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:09:54 ctl02 nova-api[18634]: 2017-09-28 13:09:54.946 18634 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:09:55 ctl02 nova-api[18634]: 2017-09-28 13:09:55.166 18634 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:09:55 ctl02 nova-api[18634]: 2017-09-28 13:09:55.168 18634 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:09:55 ctl02 nova-api[18634]: 2017-09-28 13:09:55.169 18634 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:09:55 ctl02 nova-api[18634]: 2017-09-28 13:09:55.169 18634 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:09:55 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd526f660)
Sep 28 13:09:55 ctl02 neutron-server[30536]: 2017-09-28 13:09:55.284 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:09:55] "OPTIONS / HTTP/1.0" 200 262 0.000459
Sep 28 13:09:55 ctl02 nova-api[18634]: 2017-09-28 13:09:55.302 18634 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:09:55 ctl02 nova-api[18634]: 2017-09-28 13:09:55.304 18634 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:09:55 ctl02 nova-api[18634]: 2017-09-28 13:09:55.304 18634 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:09:55 ctl02 nova-api[18634]: 2017-09-28 13:09:55.305 18634 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:09:55 ctl02 nova-api[18634]: 2017-09-28 13:09:55.308 18634 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:09:55 ctl02 nova-api[18634]: 2017-09-28 13:09:55.308 18634 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:09:55 ctl02 nova-api[18634]: 2017-09-28 13:09:55.308 18634 ERROR nova Traceback (most recent call last):
Sep 28 13:09:55 ctl02 nova-api[18634]: 2017-09-28 13:09:55.308 18634 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:09:55 ctl02 nova-api[18634]: 2017-09-28 13:09:55.308 18634 ERROR nova     sys.exit(main())
Sep 28 13:09:55 ctl02 nova-api[18634]: 2017-09-28 13:09:55.308 18634 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:09:55 ctl02 nova-api[18634]: 2017-09-28 13:09:55.308 18634 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:09:55 ctl02 nova-api[18634]: 2017-09-28 13:09:55.308 18634 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:09:55 ctl02 nova-api[18634]: 2017-09-28 13:09:55.308 18634 ERROR nova     max_url_len=max_url_len)
Sep 28 13:09:55 ctl02 nova-api[18634]: 2017-09-28 13:09:55.308 18634 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:09:55 ctl02 nova-api[18634]: 2017-09-28 13:09:55.308 18634 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:09:55 ctl02 nova-api[18634]: 2017-09-28 13:09:55.308 18634 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:09:55 ctl02 nova-api[18634]: 2017-09-28 13:09:55.308 18634 ERROR nova     sock.listen(backlog)
Sep 28 13:09:55 ctl02 nova-api[18634]: 2017-09-28 13:09:55.308 18634 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:09:55 ctl02 nova-api[18634]: 2017-09-28 13:09:55.308 18634 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:09:55 ctl02 nova-api[18634]: 2017-09-28 13:09:55.308 18634 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:09:55 ctl02 nova-api[18634]: 2017-09-28 13:09:55.308 18634 ERROR nova
Sep 28 13:09:55 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:09:55 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:09:55 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:09:55 ctl02 heat-api-cfn[13300]: 2017-09-28 13:09:55.476 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:09:55] "OPTIONS / HTTP/1.0" 200 134 0.000450
Sep 28 13:09:55 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:09:55 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:09:55 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:09:55 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:09:56 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd526f660)
Sep 28 13:09:56 ctl02 heat-api-cfn[13300]: 2017-09-28 13:09:56.207 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:09:56] "OPTIONS / HTTP/1.0" 200 134 0.000642
Sep 28 13:09:57 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0xd526f660)
Sep 28 13:09:57 ctl02 nova-api[18650]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:09:57 ctl02 nova-api[18650]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:09:57 ctl02 heat-api[13008]: 2017-09-28 13:09:57.365 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:09:57] "OPTIONS / HTTP/1.0" 200 134 0.000544
Sep 28 13:09:57 ctl02 nova-api[18650]: 2017-09-28 13:09:57.537 18650 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:09:57 ctl02 nova-api[18650]: 2017-09-28 13:09:57.538 18650 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:09:57 ctl02 nova-api[18650]: 2017-09-28 13:09:57.538 18650 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:09:57 ctl02 nova-api[18650]: 2017-09-28 13:09:57.538 18650 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:09:57 ctl02 nova-api[18650]: 2017-09-28 13:09:57.538 18650 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:09:57 ctl02 nova-api[18650]: 2017-09-28 13:09:57.538 18650 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:09:57 ctl02 nova-api[18650]: 2017-09-28 13:09:57.538 18650 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:09:57 ctl02 nova-api[18650]: 2017-09-28 13:09:57.538 18650 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:09:57 ctl02 nova-api[18650]: 2017-09-28 13:09:57.538 18650 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:09:57 ctl02 nova-api[18650]: 2017-09-28 13:09:57.538 18650 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:09:57 ctl02 nova-api[18650]: 2017-09-28 13:09:57.538 18650 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:09:57 ctl02 nova-api[18650]: 2017-09-28 13:09:57.538 18650 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:09:57 ctl02 nova-api[18650]: 2017-09-28 13:09:57.538 18650 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:09:57 ctl02 nova-api[18650]: 2017-09-28 13:09:57.538 18650 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:09:57 ctl02 nova-api[18650]: 2017-09-28 13:09:57.538 18650 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:09:57 ctl02 nova-api[18650]: 2017-09-28 13:09:57.538 18650 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:09:57 ctl02 nova-api[18650]: 2017-09-28 13:09:57.538 18650 ERROR nova.wsgi     self.filename))
Sep 28 13:09:57 ctl02 nova-api[18650]: 2017-09-28 13:09:57.538 18650 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:09:57 ctl02 nova-api[18650]: 2017-09-28 13:09:57.538 18650 ERROR nova.wsgi
Sep 28 13:09:57 ctl02 nova-api[18650]: 2017-09-28 13:09:57.539 18650 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:09:57 ctl02 nova-api[18650]: 2017-09-28 13:09:57.671 18650 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:09:57 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:09:57.733 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:09:57] "OPTIONS / HTTP/1.0" 200 134 0.000343
Sep 28 13:09:57 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:09:57.863 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:09:57] "OPTIONS / HTTP/1.0" 200 134 0.000354
Sep 28 13:09:57 ctl02 nova-api[18650]: 2017-09-28 13:09:57.885 18650 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:09:57 ctl02 nova-api[18650]: 2017-09-28 13:09:57.887 18650 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:09:57 ctl02 nova-api[18650]: 2017-09-28 13:09:57.887 18650 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:09:57 ctl02 nova-api[18650]: 2017-09-28 13:09:57.887 18650 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:09:58 ctl02 nova-api[18650]: 2017-09-28 13:09:58.017 18650 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:09:58 ctl02 nova-api[18650]: 2017-09-28 13:09:58.019 18650 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:09:58 ctl02 nova-api[18650]: 2017-09-28 13:09:58.019 18650 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:09:58 ctl02 nova-api[18650]: 2017-09-28 13:09:58.019 18650 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:09:58 ctl02 nova-api[18650]: 2017-09-28 13:09:58.022 18650 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:09:58 ctl02 nova-api[18650]: 2017-09-28 13:09:58.023 18650 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:09:58 ctl02 nova-api[18650]: 2017-09-28 13:09:58.023 18650 ERROR nova Traceback (most recent call last):
Sep 28 13:09:58 ctl02 nova-api[18650]: 2017-09-28 13:09:58.023 18650 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:09:58 ctl02 nova-api[18650]: 2017-09-28 13:09:58.023 18650 ERROR nova     sys.exit(main())
Sep 28 13:09:58 ctl02 nova-api[18650]: 2017-09-28 13:09:58.023 18650 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:09:58 ctl02 nova-api[18650]: 2017-09-28 13:09:58.023 18650 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:09:58 ctl02 nova-api[18650]: 2017-09-28 13:09:58.023 18650 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:09:58 ctl02 nova-api[18650]: 2017-09-28 13:09:58.023 18650 ERROR nova     max_url_len=max_url_len)
Sep 28 13:09:58 ctl02 nova-api[18650]: 2017-09-28 13:09:58.023 18650 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:09:58 ctl02 nova-api[18650]: 2017-09-28 13:09:58.023 18650 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:09:58 ctl02 nova-api[18650]: 2017-09-28 13:09:58.023 18650 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:09:58 ctl02 nova-api[18650]: 2017-09-28 13:09:58.023 18650 ERROR nova     sock.listen(backlog)
Sep 28 13:09:58 ctl02 nova-api[18650]: 2017-09-28 13:09:58.023 18650 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:09:58 ctl02 nova-api[18650]: 2017-09-28 13:09:58.023 18650 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:09:58 ctl02 nova-api[18650]: 2017-09-28 13:09:58.023 18650 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:09:58 ctl02 nova-api[18650]: 2017-09-28 13:09:58.023 18650 ERROR nova
Sep 28 13:09:58 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:09:58 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:09:58 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:09:58 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 13:09:58 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 13:09:58 ctl02 heat-api[13008]: 2017-09-28 13:09:58.342 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:09:58] "OPTIONS / HTTP/1.0" 200 134 0.000673
Sep 28 13:09:58 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:09:58 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:09:58 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:09:58 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:09:58 ctl02 neutron-server[30536]: 2017-09-28 13:09:58.846 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:09:58] "OPTIONS / HTTP/1.0" 200 262 0.000468
Sep 28 13:09:59 ctl02 nova-conductor[5056]: 2017-09-28 13:09:59.431 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:09:59 ctl02 nova-conductor[5056]: 2017-09-28 13:09:59.432 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:09:59 ctl02 nova-conductor[5056]: 2017-09-28 13:09:59.439 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:09:59 ctl02 nova-conductor[5056]: 2017-09-28 13:09:59.444 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:09:59 ctl02 glance-api[29183]: 2017-09-28 13:09:59.605 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:09:59] "OPTIONS / HTTP/1.0" 200 134 0.000574
Sep 28 13:10:00 ctl02 nova-api[18674]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:10:00 ctl02 nova-api[18674]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:10:00 ctl02 nova-api[18674]: 2017-09-28 13:10:00.308 18674 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:10:00 ctl02 nova-api[18674]: 2017-09-28 13:10:00.309 18674 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:10:00 ctl02 nova-api[18674]: 2017-09-28 13:10:00.309 18674 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:10:00 ctl02 nova-api[18674]: 2017-09-28 13:10:00.309 18674 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:10:00 ctl02 nova-api[18674]: 2017-09-28 13:10:00.309 18674 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:10:00 ctl02 nova-api[18674]: 2017-09-28 13:10:00.309 18674 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:10:00 ctl02 nova-api[18674]: 2017-09-28 13:10:00.309 18674 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:10:00 ctl02 nova-api[18674]: 2017-09-28 13:10:00.309 18674 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:10:00 ctl02 nova-api[18674]: 2017-09-28 13:10:00.309 18674 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:10:00 ctl02 nova-api[18674]: 2017-09-28 13:10:00.309 18674 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:10:00 ctl02 nova-api[18674]: 2017-09-28 13:10:00.309 18674 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:10:00 ctl02 nova-api[18674]: 2017-09-28 13:10:00.309 18674 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:10:00 ctl02 nova-api[18674]: 2017-09-28 13:10:00.309 18674 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:10:00 ctl02 nova-api[18674]: 2017-09-28 13:10:00.309 18674 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:10:00 ctl02 nova-api[18674]: 2017-09-28 13:10:00.309 18674 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:10:00 ctl02 nova-api[18674]: 2017-09-28 13:10:00.309 18674 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:10:00 ctl02 nova-api[18674]: 2017-09-28 13:10:00.309 18674 ERROR nova.wsgi     self.filename))
Sep 28 13:10:00 ctl02 nova-api[18674]: 2017-09-28 13:10:00.309 18674 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:10:00 ctl02 nova-api[18674]: 2017-09-28 13:10:00.309 18674 ERROR nova.wsgi
Sep 28 13:10:00 ctl02 nova-api[18674]: 2017-09-28 13:10:00.310 18674 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:10:00 ctl02 nova-api[18674]: 2017-09-28 13:10:00.434 18674 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:10:00 ctl02 nova-cert[4860]: 2017-09-28 13:10:00.496 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:10:00 ctl02 nova-api[18674]: 2017-09-28 13:10:00.654 18674 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:10:00 ctl02 nova-api[18674]: 2017-09-28 13:10:00.656 18674 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:10:00 ctl02 nova-api[18674]: 2017-09-28 13:10:00.656 18674 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:10:00 ctl02 nova-api[18674]: 2017-09-28 13:10:00.656 18674 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:10:00 ctl02 glance-api[29183]: 2017-09-28 13:10:00.741 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:10:00] "OPTIONS / HTTP/1.0" 200 134 0.000702
Sep 28 13:10:00 ctl02 nova-api[18674]: 2017-09-28 13:10:00.786 18674 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:10:00 ctl02 nova-api[18674]: 2017-09-28 13:10:00.788 18674 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:10:00 ctl02 nova-api[18674]: 2017-09-28 13:10:00.788 18674 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:10:00 ctl02 nova-api[18674]: 2017-09-28 13:10:00.788 18674 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:10:00 ctl02 nova-api[18674]: 2017-09-28 13:10:00.791 18674 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:10:00 ctl02 nova-api[18674]: 2017-09-28 13:10:00.791 18674 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:10:00 ctl02 nova-api[18674]: 2017-09-28 13:10:00.791 18674 ERROR nova Traceback (most recent call last):
Sep 28 13:10:00 ctl02 nova-api[18674]: 2017-09-28 13:10:00.791 18674 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:10:00 ctl02 nova-api[18674]: 2017-09-28 13:10:00.791 18674 ERROR nova     sys.exit(main())
Sep 28 13:10:00 ctl02 nova-api[18674]: 2017-09-28 13:10:00.791 18674 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:10:00 ctl02 nova-api[18674]: 2017-09-28 13:10:00.791 18674 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:10:00 ctl02 nova-api[18674]: 2017-09-28 13:10:00.791 18674 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:10:00 ctl02 nova-api[18674]: 2017-09-28 13:10:00.791 18674 ERROR nova     max_url_len=max_url_len)
Sep 28 13:10:00 ctl02 nova-api[18674]: 2017-09-28 13:10:00.791 18674 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:10:00 ctl02 nova-api[18674]: 2017-09-28 13:10:00.791 18674 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:10:00 ctl02 nova-api[18674]: 2017-09-28 13:10:00.791 18674 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:10:00 ctl02 nova-api[18674]: 2017-09-28 13:10:00.791 18674 ERROR nova     sock.listen(backlog)
Sep 28 13:10:00 ctl02 nova-api[18674]: 2017-09-28 13:10:00.791 18674 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:10:00 ctl02 nova-api[18674]: 2017-09-28 13:10:00.791 18674 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:10:00 ctl02 nova-api[18674]: 2017-09-28 13:10:00.791 18674 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:10:00 ctl02 nova-api[18674]: 2017-09-28 13:10:00.791 18674 ERROR nova
Sep 28 13:10:00 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:10:00 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:10:00 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:10:01 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:10:01 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:10:01 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:10:01 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:10:02 ctl02 heat-api-cfn[13300]: 2017-09-28 13:10:02.868 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:10:02] "OPTIONS / HTTP/1.0" 200 134 0.000434
Sep 28 13:10:02 ctl02 nova-api[18692]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:10:02 ctl02 nova-api[18692]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:10:03 ctl02 nova-api[18692]: 2017-09-28 13:10:03.066 18692 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:10:03 ctl02 nova-api[18692]: 2017-09-28 13:10:03.068 18692 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:10:03 ctl02 nova-api[18692]: 2017-09-28 13:10:03.068 18692 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:10:03 ctl02 nova-api[18692]: 2017-09-28 13:10:03.068 18692 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:10:03 ctl02 nova-api[18692]: 2017-09-28 13:10:03.068 18692 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:10:03 ctl02 nova-api[18692]: 2017-09-28 13:10:03.068 18692 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:10:03 ctl02 nova-api[18692]: 2017-09-28 13:10:03.068 18692 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:10:03 ctl02 nova-api[18692]: 2017-09-28 13:10:03.068 18692 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:10:03 ctl02 nova-api[18692]: 2017-09-28 13:10:03.068 18692 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:10:03 ctl02 nova-api[18692]: 2017-09-28 13:10:03.068 18692 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:10:03 ctl02 nova-api[18692]: 2017-09-28 13:10:03.068 18692 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:10:03 ctl02 nova-api[18692]: 2017-09-28 13:10:03.068 18692 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:10:03 ctl02 nova-api[18692]: 2017-09-28 13:10:03.068 18692 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:10:03 ctl02 nova-api[18692]: 2017-09-28 13:10:03.068 18692 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:10:03 ctl02 nova-api[18692]: 2017-09-28 13:10:03.068 18692 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:10:03 ctl02 nova-api[18692]: 2017-09-28 13:10:03.068 18692 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:10:03 ctl02 nova-api[18692]: 2017-09-28 13:10:03.068 18692 ERROR nova.wsgi     self.filename))
Sep 28 13:10:03 ctl02 nova-api[18692]: 2017-09-28 13:10:03.068 18692 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:10:03 ctl02 nova-api[18692]: 2017-09-28 13:10:03.068 18692 ERROR nova.wsgi
Sep 28 13:10:03 ctl02 nova-api[18692]: 2017-09-28 13:10:03.069 18692 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:10:03 ctl02 nova-api[18692]: 2017-09-28 13:10:03.195 18692 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:10:03 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:10:03.253 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:10:03] "OPTIONS / HTTP/1.0" 200 134 0.000348
Sep 28 13:10:03 ctl02 nova-api[18692]: 2017-09-28 13:10:03.413 18692 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:10:03 ctl02 nova-api[18692]: 2017-09-28 13:10:03.415 18692 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:10:03 ctl02 nova-api[18692]: 2017-09-28 13:10:03.415 18692 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:10:03 ctl02 nova-api[18692]: 2017-09-28 13:10:03.415 18692 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:10:03 ctl02 nova-api[18692]: 2017-09-28 13:10:03.547 18692 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:10:03 ctl02 nova-api[18692]: 2017-09-28 13:10:03.549 18692 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:10:03 ctl02 nova-api[18692]: 2017-09-28 13:10:03.549 18692 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:10:03 ctl02 nova-api[18692]: 2017-09-28 13:10:03.550 18692 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:10:03 ctl02 nova-api[18692]: 2017-09-28 13:10:03.553 18692 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:10:03 ctl02 nova-api[18692]: 2017-09-28 13:10:03.553 18692 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:10:03 ctl02 nova-api[18692]: 2017-09-28 13:10:03.553 18692 ERROR nova Traceback (most recent call last):
Sep 28 13:10:03 ctl02 nova-api[18692]: 2017-09-28 13:10:03.553 18692 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:10:03 ctl02 nova-api[18692]: 2017-09-28 13:10:03.553 18692 ERROR nova     sys.exit(main())
Sep 28 13:10:03 ctl02 nova-api[18692]: 2017-09-28 13:10:03.553 18692 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:10:03 ctl02 nova-api[18692]: 2017-09-28 13:10:03.553 18692 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:10:03 ctl02 nova-api[18692]: 2017-09-28 13:10:03.553 18692 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:10:03 ctl02 nova-api[18692]: 2017-09-28 13:10:03.553 18692 ERROR nova     max_url_len=max_url_len)
Sep 28 13:10:03 ctl02 nova-api[18692]: 2017-09-28 13:10:03.553 18692 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:10:03 ctl02 nova-api[18692]: 2017-09-28 13:10:03.553 18692 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:10:03 ctl02 nova-api[18692]: 2017-09-28 13:10:03.553 18692 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:10:03 ctl02 nova-api[18692]: 2017-09-28 13:10:03.553 18692 ERROR nova     sock.listen(backlog)
Sep 28 13:10:03 ctl02 nova-api[18692]: 2017-09-28 13:10:03.553 18692 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:10:03 ctl02 nova-api[18692]: 2017-09-28 13:10:03.553 18692 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:10:03 ctl02 nova-api[18692]: 2017-09-28 13:10:03.553 18692 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:10:03 ctl02 nova-api[18692]: 2017-09-28 13:10:03.553 18692 ERROR nova
Sep 28 13:10:03 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:10:03 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:10:03 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:10:03 ctl02 heat-api[13008]: 2017-09-28 13:10:03.706 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:10:03] "OPTIONS / HTTP/1.0" 200 134 0.000676
Sep 28 13:10:03 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:10:03 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:10:03 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:10:03 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:10:04 ctl02 neutron-server[30536]: 2017-09-28 13:10:04.141 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:10:04] "OPTIONS / HTTP/1.0" 200 262 0.000436
Sep 28 13:10:04 ctl02 glance-api[29183]: 2017-09-28 13:10:04.174 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:10:04] "OPTIONS / HTTP/1.0" 200 134 0.000550
Sep 28 13:10:05 ctl02 heat-api-cfn[13300]: 2017-09-28 13:10:05.460 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:10:05] "OPTIONS / HTTP/1.0" 200 134 0.000490
Sep 28 13:10:05 ctl02 neutron-server[30536]: 2017-09-28 13:10:05.543 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:10:05] "OPTIONS / HTTP/1.0" 200 262 0.000475
Sep 28 13:10:05 ctl02 nova-api[18711]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:10:05 ctl02 nova-api[18711]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:10:05 ctl02 nova-api[18711]: 2017-09-28 13:10:05.796 18711 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:10:05 ctl02 nova-api[18711]: 2017-09-28 13:10:05.797 18711 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:10:05 ctl02 nova-api[18711]: 2017-09-28 13:10:05.797 18711 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:10:05 ctl02 nova-api[18711]: 2017-09-28 13:10:05.797 18711 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:10:05 ctl02 nova-api[18711]: 2017-09-28 13:10:05.797 18711 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:10:05 ctl02 nova-api[18711]: 2017-09-28 13:10:05.797 18711 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:10:05 ctl02 nova-api[18711]: 2017-09-28 13:10:05.797 18711 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:10:05 ctl02 nova-api[18711]: 2017-09-28 13:10:05.797 18711 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:10:05 ctl02 nova-api[18711]: 2017-09-28 13:10:05.797 18711 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:10:05 ctl02 nova-api[18711]: 2017-09-28 13:10:05.797 18711 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:10:05 ctl02 nova-api[18711]: 2017-09-28 13:10:05.797 18711 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:10:05 ctl02 nova-api[18711]: 2017-09-28 13:10:05.797 18711 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:10:05 ctl02 nova-api[18711]: 2017-09-28 13:10:05.797 18711 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:10:05 ctl02 nova-api[18711]: 2017-09-28 13:10:05.797 18711 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:10:05 ctl02 nova-api[18711]: 2017-09-28 13:10:05.797 18711 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:10:05 ctl02 nova-api[18711]: 2017-09-28 13:10:05.797 18711 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:10:05 ctl02 nova-api[18711]: 2017-09-28 13:10:05.797 18711 ERROR nova.wsgi     self.filename))
Sep 28 13:10:05 ctl02 nova-api[18711]: 2017-09-28 13:10:05.797 18711 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:10:05 ctl02 nova-api[18711]: 2017-09-28 13:10:05.797 18711 ERROR nova.wsgi
Sep 28 13:10:05 ctl02 nova-api[18711]: 2017-09-28 13:10:05.798 18711 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:10:05 ctl02 nova-api[18711]: 2017-09-28 13:10:05.924 18711 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:10:05 ctl02 neutron-server[30536]: 2017-09-28 13:10:05.944 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 13:10:05 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 13:10:05 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 13:09:16 cmp002
Sep 28 13:10:05 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 13:09:08 cmp001
Sep 28 13:10:05 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 13:08:40 cmp002
Sep 28 13:10:06 ctl02 nova-api[18711]: 2017-09-28 13:10:06.154 18711 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:10:06 ctl02 nova-api[18711]: 2017-09-28 13:10:06.156 18711 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:10:06 ctl02 nova-api[18711]: 2017-09-28 13:10:06.156 18711 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:10:06 ctl02 nova-api[18711]: 2017-09-28 13:10:06.156 18711 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:10:06 ctl02 nova-api[18711]: 2017-09-28 13:10:06.287 18711 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:10:06 ctl02 nova-api[18711]: 2017-09-28 13:10:06.289 18711 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:10:06 ctl02 nova-api[18711]: 2017-09-28 13:10:06.289 18711 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:10:06 ctl02 nova-api[18711]: 2017-09-28 13:10:06.289 18711 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:10:06 ctl02 nova-api[18711]: 2017-09-28 13:10:06.292 18711 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:10:06 ctl02 nova-api[18711]: 2017-09-28 13:10:06.293 18711 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:10:06 ctl02 nova-api[18711]: 2017-09-28 13:10:06.293 18711 ERROR nova Traceback (most recent call last):
Sep 28 13:10:06 ctl02 nova-api[18711]: 2017-09-28 13:10:06.293 18711 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:10:06 ctl02 nova-api[18711]: 2017-09-28 13:10:06.293 18711 ERROR nova     sys.exit(main())
Sep 28 13:10:06 ctl02 nova-api[18711]: 2017-09-28 13:10:06.293 18711 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:10:06 ctl02 nova-api[18711]: 2017-09-28 13:10:06.293 18711 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:10:06 ctl02 nova-api[18711]: 2017-09-28 13:10:06.293 18711 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:10:06 ctl02 nova-api[18711]: 2017-09-28 13:10:06.293 18711 ERROR nova     max_url_len=max_url_len)
Sep 28 13:10:06 ctl02 nova-api[18711]: 2017-09-28 13:10:06.293 18711 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:10:06 ctl02 nova-api[18711]: 2017-09-28 13:10:06.293 18711 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:10:06 ctl02 nova-api[18711]: 2017-09-28 13:10:06.293 18711 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:10:06 ctl02 nova-api[18711]: 2017-09-28 13:10:06.293 18711 ERROR nova     sock.listen(backlog)
Sep 28 13:10:06 ctl02 nova-api[18711]: 2017-09-28 13:10:06.293 18711 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:10:06 ctl02 nova-api[18711]: 2017-09-28 13:10:06.293 18711 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:10:06 ctl02 nova-api[18711]: 2017-09-28 13:10:06.293 18711 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:10:06 ctl02 nova-api[18711]: 2017-09-28 13:10:06.293 18711 ERROR nova
Sep 28 13:10:06 ctl02 heat-api-cfn[13300]: 2017-09-28 13:10:06.380 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:10:06] "OPTIONS / HTTP/1.0" 200 134 0.000431
Sep 28 13:10:06 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:10:06 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:10:06 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:10:06 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:10:06 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:10:06 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:10:06 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:10:06 ctl02 heat-api[13008]: 2017-09-28 13:10:06.977 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:10:06] "OPTIONS / HTTP/1.0" 200 134 0.000511
Sep 28 13:10:07 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:10:07.864 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:10:07] "OPTIONS / HTTP/1.0" 200 134 0.000395
Sep 28 13:10:07 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:10:07.886 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:10:07] "OPTIONS / HTTP/1.0" 200 134 0.000234
Sep 28 13:10:08 ctl02 heat-api[13008]: 2017-09-28 13:10:08.214 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:10:08] "OPTIONS / HTTP/1.0" 200 134 0.000484
Sep 28 13:10:08 ctl02 nova-api[18729]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:10:08 ctl02 nova-api[18729]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:10:08 ctl02 nova-api[18729]: 2017-09-28 13:10:08.539 18729 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:10:08 ctl02 nova-api[18729]: 2017-09-28 13:10:08.541 18729 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:10:08 ctl02 nova-api[18729]: 2017-09-28 13:10:08.541 18729 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:10:08 ctl02 nova-api[18729]: 2017-09-28 13:10:08.541 18729 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:10:08 ctl02 nova-api[18729]: 2017-09-28 13:10:08.541 18729 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:10:08 ctl02 nova-api[18729]: 2017-09-28 13:10:08.541 18729 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:10:08 ctl02 nova-api[18729]: 2017-09-28 13:10:08.541 18729 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:10:08 ctl02 nova-api[18729]: 2017-09-28 13:10:08.541 18729 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:10:08 ctl02 nova-api[18729]: 2017-09-28 13:10:08.541 18729 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:10:08 ctl02 nova-api[18729]: 2017-09-28 13:10:08.541 18729 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:10:08 ctl02 nova-api[18729]: 2017-09-28 13:10:08.541 18729 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:10:08 ctl02 nova-api[18729]: 2017-09-28 13:10:08.541 18729 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:10:08 ctl02 nova-api[18729]: 2017-09-28 13:10:08.541 18729 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:10:08 ctl02 nova-api[18729]: 2017-09-28 13:10:08.541 18729 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:10:08 ctl02 nova-api[18729]: 2017-09-28 13:10:08.541 18729 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:10:08 ctl02 nova-api[18729]: 2017-09-28 13:10:08.541 18729 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:10:08 ctl02 nova-api[18729]: 2017-09-28 13:10:08.541 18729 ERROR nova.wsgi     self.filename))
Sep 28 13:10:08 ctl02 nova-api[18729]: 2017-09-28 13:10:08.541 18729 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:10:08 ctl02 nova-api[18729]: 2017-09-28 13:10:08.541 18729 ERROR nova.wsgi
Sep 28 13:10:08 ctl02 nova-api[18729]: 2017-09-28 13:10:08.541 18729 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:10:08 ctl02 nova-api[18729]: 2017-09-28 13:10:08.666 18729 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:10:08 ctl02 nova-api[18729]: 2017-09-28 13:10:08.891 18729 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:10:08 ctl02 nova-api[18729]: 2017-09-28 13:10:08.893 18729 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:10:08 ctl02 nova-api[18729]: 2017-09-28 13:10:08.894 18729 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:10:08 ctl02 nova-api[18729]: 2017-09-28 13:10:08.894 18729 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:10:08 ctl02 neutron-server[30536]: 2017-09-28 13:10:08.953 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:10:08] "OPTIONS / HTTP/1.0" 200 262 0.000473
Sep 28 13:10:09 ctl02 nova-api[18729]: 2017-09-28 13:10:09.025 18729 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:10:09 ctl02 nova-api[18729]: 2017-09-28 13:10:09.027 18729 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:10:09 ctl02 nova-api[18729]: 2017-09-28 13:10:09.028 18729 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:10:09 ctl02 nova-api[18729]: 2017-09-28 13:10:09.028 18729 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:10:09 ctl02 nova-api[18729]: 2017-09-28 13:10:09.031 18729 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:10:09 ctl02 nova-api[18729]: 2017-09-28 13:10:09.032 18729 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:10:09 ctl02 nova-api[18729]: 2017-09-28 13:10:09.032 18729 ERROR nova Traceback (most recent call last):
Sep 28 13:10:09 ctl02 nova-api[18729]: 2017-09-28 13:10:09.032 18729 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:10:09 ctl02 nova-api[18729]: 2017-09-28 13:10:09.032 18729 ERROR nova     sys.exit(main())
Sep 28 13:10:09 ctl02 nova-api[18729]: 2017-09-28 13:10:09.032 18729 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:10:09 ctl02 nova-api[18729]: 2017-09-28 13:10:09.032 18729 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:10:09 ctl02 nova-api[18729]: 2017-09-28 13:10:09.032 18729 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:10:09 ctl02 nova-api[18729]: 2017-09-28 13:10:09.032 18729 ERROR nova     max_url_len=max_url_len)
Sep 28 13:10:09 ctl02 nova-api[18729]: 2017-09-28 13:10:09.032 18729 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:10:09 ctl02 nova-api[18729]: 2017-09-28 13:10:09.032 18729 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:10:09 ctl02 nova-api[18729]: 2017-09-28 13:10:09.032 18729 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:10:09 ctl02 nova-api[18729]: 2017-09-28 13:10:09.032 18729 ERROR nova     sock.listen(backlog)
Sep 28 13:10:09 ctl02 nova-api[18729]: 2017-09-28 13:10:09.032 18729 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:10:09 ctl02 nova-api[18729]: 2017-09-28 13:10:09.032 18729 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:10:09 ctl02 nova-api[18729]: 2017-09-28 13:10:09.032 18729 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:10:09 ctl02 nova-api[18729]: 2017-09-28 13:10:09.032 18729 ERROR nova
Sep 28 13:10:09 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:10:09 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:10:09 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:10:09 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:10:09 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:10:09 ctl02 glance-api[29183]: 2017-09-28 13:10:09.462 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:10:09] "OPTIONS / HTTP/1.0" 200 134 0.000789
Sep 28 13:10:09 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:10:09 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:10:10 ctl02 nova-consoleauth[5433]: 2017-09-28 13:10:10.351 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:10:10 ctl02 heat-engine[12803]: 2017-09-28 13:10:10.545 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:10:10 ctl02 heat-engine[12803]: 2017-09-28 13:10:10.562 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:10:10 ctl02 heat-engine[12803]: 2017-09-28 13:10:10.571 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:10:10 ctl02 heat-engine[12803]: 2017-09-28 13:10:10.574 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:10:11 ctl02 glance-api[29183]: 2017-09-28 13:10:11.048 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:10:11] "OPTIONS / HTTP/1.0" 200 134 0.000648
Sep 28 13:10:11 ctl02 nova-api[18747]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:10:11 ctl02 nova-api[18747]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:10:11 ctl02 nova-api[18747]: 2017-09-28 13:10:11.368 18747 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:10:11 ctl02 nova-api[18747]: 2017-09-28 13:10:11.369 18747 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:10:11 ctl02 nova-api[18747]: 2017-09-28 13:10:11.369 18747 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:10:11 ctl02 nova-api[18747]: 2017-09-28 13:10:11.369 18747 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:10:11 ctl02 nova-api[18747]: 2017-09-28 13:10:11.369 18747 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:10:11 ctl02 nova-api[18747]: 2017-09-28 13:10:11.369 18747 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:10:11 ctl02 nova-api[18747]: 2017-09-28 13:10:11.369 18747 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:10:11 ctl02 nova-api[18747]: 2017-09-28 13:10:11.369 18747 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:10:11 ctl02 nova-api[18747]: 2017-09-28 13:10:11.369 18747 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:10:11 ctl02 nova-api[18747]: 2017-09-28 13:10:11.369 18747 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:10:11 ctl02 nova-api[18747]: 2017-09-28 13:10:11.369 18747 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:10:11 ctl02 nova-api[18747]: 2017-09-28 13:10:11.369 18747 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:10:11 ctl02 nova-api[18747]: 2017-09-28 13:10:11.369 18747 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:10:11 ctl02 nova-api[18747]: 2017-09-28 13:10:11.369 18747 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:10:11 ctl02 nova-api[18747]: 2017-09-28 13:10:11.369 18747 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:10:11 ctl02 nova-api[18747]: 2017-09-28 13:10:11.369 18747 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:10:11 ctl02 nova-api[18747]: 2017-09-28 13:10:11.369 18747 ERROR nova.wsgi     self.filename))
Sep 28 13:10:11 ctl02 nova-api[18747]: 2017-09-28 13:10:11.369 18747 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:10:11 ctl02 nova-api[18747]: 2017-09-28 13:10:11.369 18747 ERROR nova.wsgi
Sep 28 13:10:11 ctl02 nova-api[18747]: 2017-09-28 13:10:11.371 18747 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:10:11 ctl02 nova-api[18747]: 2017-09-28 13:10:11.505 18747 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:10:11 ctl02 nova-api[18747]: 2017-09-28 13:10:11.754 18747 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:10:11 ctl02 nova-api[18747]: 2017-09-28 13:10:11.757 18747 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:10:11 ctl02 nova-api[18747]: 2017-09-28 13:10:11.757 18747 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:10:11 ctl02 nova-api[18747]: 2017-09-28 13:10:11.757 18747 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:10:11 ctl02 nova-api[18747]: 2017-09-28 13:10:11.891 18747 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:10:11 ctl02 nova-api[18747]: 2017-09-28 13:10:11.893 18747 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:10:11 ctl02 nova-api[18747]: 2017-09-28 13:10:11.893 18747 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:10:11 ctl02 nova-api[18747]: 2017-09-28 13:10:11.893 18747 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:10:11 ctl02 nova-api[18747]: 2017-09-28 13:10:11.897 18747 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:10:11 ctl02 nova-api[18747]: 2017-09-28 13:10:11.897 18747 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:10:11 ctl02 nova-api[18747]: 2017-09-28 13:10:11.897 18747 ERROR nova Traceback (most recent call last):
Sep 28 13:10:11 ctl02 nova-api[18747]: 2017-09-28 13:10:11.897 18747 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:10:11 ctl02 nova-api[18747]: 2017-09-28 13:10:11.897 18747 ERROR nova     sys.exit(main())
Sep 28 13:10:11 ctl02 nova-api[18747]: 2017-09-28 13:10:11.897 18747 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:10:11 ctl02 nova-api[18747]: 2017-09-28 13:10:11.897 18747 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:10:11 ctl02 nova-api[18747]: 2017-09-28 13:10:11.897 18747 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:10:11 ctl02 nova-api[18747]: 2017-09-28 13:10:11.897 18747 ERROR nova     max_url_len=max_url_len)
Sep 28 13:10:11 ctl02 nova-api[18747]: 2017-09-28 13:10:11.897 18747 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:10:11 ctl02 nova-api[18747]: 2017-09-28 13:10:11.897 18747 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:10:11 ctl02 nova-api[18747]: 2017-09-28 13:10:11.897 18747 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:10:11 ctl02 nova-api[18747]: 2017-09-28 13:10:11.897 18747 ERROR nova     sock.listen(backlog)
Sep 28 13:10:11 ctl02 nova-api[18747]: 2017-09-28 13:10:11.897 18747 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:10:11 ctl02 nova-api[18747]: 2017-09-28 13:10:11.897 18747 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:10:11 ctl02 nova-api[18747]: 2017-09-28 13:10:11.897 18747 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:10:11 ctl02 nova-api[18747]: 2017-09-28 13:10:11.897 18747 ERROR nova
Sep 28 13:10:12 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:10:12 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:10:12 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:10:12 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:10:12 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:10:12 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:10:12 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:10:13 ctl02 heat-api-cfn[13300]: 2017-09-28 13:10:13.234 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:10:13] "OPTIONS / HTTP/1.0" 200 134 0.000493
Sep 28 13:10:13 ctl02 nova-scheduler[5620]: 2017-09-28 13:10:13.467 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:10:13 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:10:13.603 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:10:13] "OPTIONS / HTTP/1.0" 200 134 0.000473
Sep 28 13:10:13 ctl02 nova-api[18765]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:10:13 ctl02 nova-api[18765]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:10:14 ctl02 heat-api[13008]: 2017-09-28 13:10:14.087 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:10:14] "OPTIONS / HTTP/1.0" 200 134 0.000613
Sep 28 13:10:14 ctl02 neutron-server[30536]: 2017-09-28 13:10:14.129 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:10:14] "OPTIONS / HTTP/1.0" 200 262 0.000534
Sep 28 13:10:14 ctl02 nova-api[18765]: 2017-09-28 13:10:14.169 18765 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:10:14 ctl02 nova-api[18765]: 2017-09-28 13:10:14.170 18765 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:10:14 ctl02 nova-api[18765]: 2017-09-28 13:10:14.170 18765 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:10:14 ctl02 nova-api[18765]: 2017-09-28 13:10:14.170 18765 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:10:14 ctl02 nova-api[18765]: 2017-09-28 13:10:14.170 18765 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:10:14 ctl02 nova-api[18765]: 2017-09-28 13:10:14.170 18765 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:10:14 ctl02 nova-api[18765]: 2017-09-28 13:10:14.170 18765 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:10:14 ctl02 nova-api[18765]: 2017-09-28 13:10:14.170 18765 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:10:14 ctl02 nova-api[18765]: 2017-09-28 13:10:14.170 18765 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:10:14 ctl02 nova-api[18765]: 2017-09-28 13:10:14.170 18765 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:10:14 ctl02 nova-api[18765]: 2017-09-28 13:10:14.170 18765 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:10:14 ctl02 nova-api[18765]: 2017-09-28 13:10:14.170 18765 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:10:14 ctl02 nova-api[18765]: 2017-09-28 13:10:14.170 18765 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:10:14 ctl02 nova-api[18765]: 2017-09-28 13:10:14.170 18765 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:10:14 ctl02 nova-api[18765]: 2017-09-28 13:10:14.170 18765 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:10:14 ctl02 nova-api[18765]: 2017-09-28 13:10:14.170 18765 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:10:14 ctl02 nova-api[18765]: 2017-09-28 13:10:14.170 18765 ERROR nova.wsgi     self.filename))
Sep 28 13:10:14 ctl02 nova-api[18765]: 2017-09-28 13:10:14.170 18765 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:10:14 ctl02 nova-api[18765]: 2017-09-28 13:10:14.170 18765 ERROR nova.wsgi
Sep 28 13:10:14 ctl02 nova-api[18765]: 2017-09-28 13:10:14.172 18765 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:10:14 ctl02 nova-api[18765]: 2017-09-28 13:10:14.309 18765 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:10:14 ctl02 glance-api[29183]: 2017-09-28 13:10:14.366 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:10:14] "OPTIONS / HTTP/1.0" 200 134 0.001095
Sep 28 13:10:14 ctl02 nova-api[18765]: 2017-09-28 13:10:14.572 18765 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:10:14 ctl02 nova-api[18765]: 2017-09-28 13:10:14.575 18765 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:10:14 ctl02 nova-api[18765]: 2017-09-28 13:10:14.576 18765 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:10:14 ctl02 nova-api[18765]: 2017-09-28 13:10:14.576 18765 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:10:14 ctl02 nova-api[18765]: 2017-09-28 13:10:14.719 18765 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:10:14 ctl02 nova-api[18765]: 2017-09-28 13:10:14.722 18765 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:10:14 ctl02 nova-api[18765]: 2017-09-28 13:10:14.722 18765 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:10:14 ctl02 nova-api[18765]: 2017-09-28 13:10:14.723 18765 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:10:14 ctl02 nova-api[18765]: 2017-09-28 13:10:14.726 18765 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:10:14 ctl02 nova-api[18765]: 2017-09-28 13:10:14.727 18765 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:10:14 ctl02 nova-api[18765]: 2017-09-28 13:10:14.727 18765 ERROR nova Traceback (most recent call last):
Sep 28 13:10:14 ctl02 nova-api[18765]: 2017-09-28 13:10:14.727 18765 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:10:14 ctl02 nova-api[18765]: 2017-09-28 13:10:14.727 18765 ERROR nova     sys.exit(main())
Sep 28 13:10:14 ctl02 nova-api[18765]: 2017-09-28 13:10:14.727 18765 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:10:14 ctl02 nova-api[18765]: 2017-09-28 13:10:14.727 18765 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:10:14 ctl02 nova-api[18765]: 2017-09-28 13:10:14.727 18765 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:10:14 ctl02 nova-api[18765]: 2017-09-28 13:10:14.727 18765 ERROR nova     max_url_len=max_url_len)
Sep 28 13:10:14 ctl02 nova-api[18765]: 2017-09-28 13:10:14.727 18765 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:10:14 ctl02 nova-api[18765]: 2017-09-28 13:10:14.727 18765 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:10:14 ctl02 nova-api[18765]: 2017-09-28 13:10:14.727 18765 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:10:14 ctl02 nova-api[18765]: 2017-09-28 13:10:14.727 18765 ERROR nova     sock.listen(backlog)
Sep 28 13:10:14 ctl02 nova-api[18765]: 2017-09-28 13:10:14.727 18765 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:10:14 ctl02 nova-api[18765]: 2017-09-28 13:10:14.727 18765 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:10:14 ctl02 nova-api[18765]: 2017-09-28 13:10:14.727 18765 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:10:14 ctl02 nova-api[18765]: 2017-09-28 13:10:14.727 18765 ERROR nova
Sep 28 13:10:14 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:10:14 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:10:14 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:10:15 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:10:15 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:10:15 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:10:15 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:10:15 ctl02 neutron-server[30536]: 2017-09-28 13:10:15.258 30596 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:10:15] "OPTIONS / HTTP/1.0" 200 262 0.000534
Sep 28 13:10:15 ctl02 heat-api-cfn[13300]: 2017-09-28 13:10:15.780 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:10:15] "OPTIONS / HTTP/1.0" 200 134 0.000565
Sep 28 13:10:16 ctl02 heat-api-cfn[13300]: 2017-09-28 13:10:16.440 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:10:16] "OPTIONS / HTTP/1.0" 200 134 0.000526
Sep 28 13:10:16 ctl02 heat-api[13008]: 2017-09-28 13:10:16.754 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:10:16] "OPTIONS / HTTP/1.0" 200 134 0.000605
Sep 28 13:10:16 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6b23142e)
Sep 28 13:10:16 ctl02 nova-api[18783]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:10:16 ctl02 nova-api[18783]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:10:17 ctl02 nova-api[18783]: 2017-09-28 13:10:17.107 18783 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:10:17 ctl02 nova-api[18783]: 2017-09-28 13:10:17.109 18783 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:10:17 ctl02 nova-api[18783]: 2017-09-28 13:10:17.109 18783 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:10:17 ctl02 nova-api[18783]: 2017-09-28 13:10:17.109 18783 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:10:17 ctl02 nova-api[18783]: 2017-09-28 13:10:17.109 18783 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:10:17 ctl02 nova-api[18783]: 2017-09-28 13:10:17.109 18783 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:10:17 ctl02 nova-api[18783]: 2017-09-28 13:10:17.109 18783 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:10:17 ctl02 nova-api[18783]: 2017-09-28 13:10:17.109 18783 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:10:17 ctl02 nova-api[18783]: 2017-09-28 13:10:17.109 18783 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:10:17 ctl02 nova-api[18783]: 2017-09-28 13:10:17.109 18783 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:10:17 ctl02 nova-api[18783]: 2017-09-28 13:10:17.109 18783 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:10:17 ctl02 nova-api[18783]: 2017-09-28 13:10:17.109 18783 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:10:17 ctl02 nova-api[18783]: 2017-09-28 13:10:17.109 18783 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:10:17 ctl02 nova-api[18783]: 2017-09-28 13:10:17.109 18783 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:10:17 ctl02 nova-api[18783]: 2017-09-28 13:10:17.109 18783 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:10:17 ctl02 nova-api[18783]: 2017-09-28 13:10:17.109 18783 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:10:17 ctl02 nova-api[18783]: 2017-09-28 13:10:17.109 18783 ERROR nova.wsgi     self.filename))
Sep 28 13:10:17 ctl02 nova-api[18783]: 2017-09-28 13:10:17.109 18783 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:10:17 ctl02 nova-api[18783]: 2017-09-28 13:10:17.109 18783 ERROR nova.wsgi
Sep 28 13:10:17 ctl02 nova-api[18783]: 2017-09-28 13:10:17.111 18783 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:10:17 ctl02 nova-api[18783]: 2017-09-28 13:10:17.247 18783 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:10:17 ctl02 nova-api[18783]: 2017-09-28 13:10:17.497 18783 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:10:17 ctl02 nova-api[18783]: 2017-09-28 13:10:17.500 18783 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:10:17 ctl02 nova-api[18783]: 2017-09-28 13:10:17.501 18783 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:10:17 ctl02 nova-api[18783]: 2017-09-28 13:10:17.501 18783 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:10:17 ctl02 nova-api[18783]: 2017-09-28 13:10:17.638 18783 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:10:17 ctl02 nova-api[18783]: 2017-09-28 13:10:17.641 18783 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:10:17 ctl02 nova-api[18783]: 2017-09-28 13:10:17.642 18783 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:10:17 ctl02 nova-api[18783]: 2017-09-28 13:10:17.642 18783 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:10:17 ctl02 nova-api[18783]: 2017-09-28 13:10:17.645 18783 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:10:17 ctl02 nova-api[18783]: 2017-09-28 13:10:17.646 18783 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:10:17 ctl02 nova-api[18783]: 2017-09-28 13:10:17.646 18783 ERROR nova Traceback (most recent call last):
Sep 28 13:10:17 ctl02 nova-api[18783]: 2017-09-28 13:10:17.646 18783 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:10:17 ctl02 nova-api[18783]: 2017-09-28 13:10:17.646 18783 ERROR nova     sys.exit(main())
Sep 28 13:10:17 ctl02 nova-api[18783]: 2017-09-28 13:10:17.646 18783 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:10:17 ctl02 nova-api[18783]: 2017-09-28 13:10:17.646 18783 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:10:17 ctl02 nova-api[18783]: 2017-09-28 13:10:17.646 18783 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:10:17 ctl02 nova-api[18783]: 2017-09-28 13:10:17.646 18783 ERROR nova     max_url_len=max_url_len)
Sep 28 13:10:17 ctl02 nova-api[18783]: 2017-09-28 13:10:17.646 18783 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:10:17 ctl02 nova-api[18783]: 2017-09-28 13:10:17.646 18783 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:10:17 ctl02 nova-api[18783]: 2017-09-28 13:10:17.646 18783 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:10:17 ctl02 nova-api[18783]: 2017-09-28 13:10:17.646 18783 ERROR nova     sock.listen(backlog)
Sep 28 13:10:17 ctl02 nova-api[18783]: 2017-09-28 13:10:17.646 18783 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:10:17 ctl02 nova-api[18783]: 2017-09-28 13:10:17.646 18783 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:10:17 ctl02 nova-api[18783]: 2017-09-28 13:10:17.646 18783 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:10:17 ctl02 nova-api[18783]: 2017-09-28 13:10:17.646 18783 ERROR nova
Sep 28 13:10:17 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:10:17 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:10:17 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:10:17 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6b23142e)
Sep 28 13:10:17 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:10:17.940 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:10:17] "OPTIONS / HTTP/1.0" 200 134 0.000477
Sep 28 13:10:17 ctl02 heat-api[13008]: 2017-09-28 13:10:17.945 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:10:17] "OPTIONS / HTTP/1.0" 200 134 0.000631
Sep 28 13:10:17 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:10:17 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:10:17 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:10:17 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:10:18 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:10:18.138 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:10:18] "OPTIONS / HTTP/1.0" 200 134 0.000429
Sep 28 13:10:18 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6b23142e)
Sep 28 13:10:19 ctl02 neutron-server[30536]: 2017-09-28 13:10:19.173 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:10:19] "OPTIONS / HTTP/1.0" 200 262 0.000574
Sep 28 13:10:19 ctl02 glance-api[29183]: 2017-09-28 13:10:19.369 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:10:19] "OPTIONS / HTTP/1.0" 200 134 0.001099
Sep 28 13:10:19 ctl02 nova-api[18801]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:10:19 ctl02 nova-api[18801]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:10:19 ctl02 nova-api[18801]: 2017-09-28 13:10:19.892 18801 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:10:19 ctl02 nova-api[18801]: 2017-09-28 13:10:19.894 18801 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:10:19 ctl02 nova-api[18801]: 2017-09-28 13:10:19.894 18801 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:10:19 ctl02 nova-api[18801]: 2017-09-28 13:10:19.894 18801 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:10:19 ctl02 nova-api[18801]: 2017-09-28 13:10:19.894 18801 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:10:19 ctl02 nova-api[18801]: 2017-09-28 13:10:19.894 18801 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:10:19 ctl02 nova-api[18801]: 2017-09-28 13:10:19.894 18801 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:10:19 ctl02 nova-api[18801]: 2017-09-28 13:10:19.894 18801 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:10:19 ctl02 nova-api[18801]: 2017-09-28 13:10:19.894 18801 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:10:19 ctl02 nova-api[18801]: 2017-09-28 13:10:19.894 18801 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:10:19 ctl02 nova-api[18801]: 2017-09-28 13:10:19.894 18801 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:10:19 ctl02 nova-api[18801]: 2017-09-28 13:10:19.894 18801 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:10:19 ctl02 nova-api[18801]: 2017-09-28 13:10:19.894 18801 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:10:19 ctl02 nova-api[18801]: 2017-09-28 13:10:19.894 18801 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:10:19 ctl02 nova-api[18801]: 2017-09-28 13:10:19.894 18801 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:10:19 ctl02 nova-api[18801]: 2017-09-28 13:10:19.894 18801 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:10:19 ctl02 nova-api[18801]: 2017-09-28 13:10:19.894 18801 ERROR nova.wsgi     self.filename))
Sep 28 13:10:19 ctl02 nova-api[18801]: 2017-09-28 13:10:19.894 18801 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:10:19 ctl02 nova-api[18801]: 2017-09-28 13:10:19.894 18801 ERROR nova.wsgi
Sep 28 13:10:19 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6b23142e)
Sep 28 13:10:19 ctl02 nova-api[18801]: 2017-09-28 13:10:19.896 18801 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:10:20 ctl02 nova-api[18801]: 2017-09-28 13:10:20.032 18801 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:10:20 ctl02 nova-api[18801]: 2017-09-28 13:10:20.282 18801 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:10:20 ctl02 nova-api[18801]: 2017-09-28 13:10:20.285 18801 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:10:20 ctl02 nova-api[18801]: 2017-09-28 13:10:20.285 18801 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:10:20 ctl02 nova-api[18801]: 2017-09-28 13:10:20.285 18801 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:10:20 ctl02 nova-api[18801]: 2017-09-28 13:10:20.422 18801 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:10:20 ctl02 nova-api[18801]: 2017-09-28 13:10:20.424 18801 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:10:20 ctl02 nova-api[18801]: 2017-09-28 13:10:20.424 18801 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:10:20 ctl02 nova-api[18801]: 2017-09-28 13:10:20.425 18801 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:10:20 ctl02 nova-api[18801]: 2017-09-28 13:10:20.428 18801 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:10:20 ctl02 nova-api[18801]: 2017-09-28 13:10:20.429 18801 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:10:20 ctl02 nova-api[18801]: 2017-09-28 13:10:20.429 18801 ERROR nova Traceback (most recent call last):
Sep 28 13:10:20 ctl02 nova-api[18801]: 2017-09-28 13:10:20.429 18801 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:10:20 ctl02 nova-api[18801]: 2017-09-28 13:10:20.429 18801 ERROR nova     sys.exit(main())
Sep 28 13:10:20 ctl02 nova-api[18801]: 2017-09-28 13:10:20.429 18801 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:10:20 ctl02 nova-api[18801]: 2017-09-28 13:10:20.429 18801 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:10:20 ctl02 nova-api[18801]: 2017-09-28 13:10:20.429 18801 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:10:20 ctl02 nova-api[18801]: 2017-09-28 13:10:20.429 18801 ERROR nova     max_url_len=max_url_len)
Sep 28 13:10:20 ctl02 nova-api[18801]: 2017-09-28 13:10:20.429 18801 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:10:20 ctl02 nova-api[18801]: 2017-09-28 13:10:20.429 18801 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:10:20 ctl02 nova-api[18801]: 2017-09-28 13:10:20.429 18801 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:10:20 ctl02 nova-api[18801]: 2017-09-28 13:10:20.429 18801 ERROR nova     sock.listen(backlog)
Sep 28 13:10:20 ctl02 nova-api[18801]: 2017-09-28 13:10:20.429 18801 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:10:20 ctl02 nova-api[18801]: 2017-09-28 13:10:20.429 18801 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:10:20 ctl02 nova-api[18801]: 2017-09-28 13:10:20.429 18801 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:10:20 ctl02 nova-api[18801]: 2017-09-28 13:10:20.429 18801 ERROR nova
Sep 28 13:10:20 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:10:20 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:10:20 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:10:20 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:10:20 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:10:20 ctl02 glance-api[29183]: 2017-09-28 13:10:20.708 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:10:20] "OPTIONS / HTTP/1.0" 200 134 0.000576
Sep 28 13:10:20 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:10:20 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:10:20 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6b23142e)
Sep 28 13:10:20 ctl02 neutron-server[30536]: 2017-09-28 13:10:20.940 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 13:10:20 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 13:10:20 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 13:09:16 cmp002
Sep 28 13:10:20 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 13:09:08 cmp001
Sep 28 13:10:20 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 13:08:40 cmp002
Sep 28 13:10:21 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6b23142e)
Sep 28 13:10:22 ctl02 nova-api[18819]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:10:22 ctl02 nova-api[18819]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:10:22 ctl02 nova-api[18819]: 2017-09-28 13:10:22.599 18819 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:10:22 ctl02 nova-api[18819]: 2017-09-28 13:10:22.601 18819 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:10:22 ctl02 nova-api[18819]: 2017-09-28 13:10:22.601 18819 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:10:22 ctl02 nova-api[18819]: 2017-09-28 13:10:22.601 18819 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:10:22 ctl02 nova-api[18819]: 2017-09-28 13:10:22.601 18819 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:10:22 ctl02 nova-api[18819]: 2017-09-28 13:10:22.601 18819 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:10:22 ctl02 nova-api[18819]: 2017-09-28 13:10:22.601 18819 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:10:22 ctl02 nova-api[18819]: 2017-09-28 13:10:22.601 18819 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:10:22 ctl02 nova-api[18819]: 2017-09-28 13:10:22.601 18819 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:10:22 ctl02 nova-api[18819]: 2017-09-28 13:10:22.601 18819 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:10:22 ctl02 nova-api[18819]: 2017-09-28 13:10:22.601 18819 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:10:22 ctl02 nova-api[18819]: 2017-09-28 13:10:22.601 18819 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:10:22 ctl02 nova-api[18819]: 2017-09-28 13:10:22.601 18819 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:10:22 ctl02 nova-api[18819]: 2017-09-28 13:10:22.601 18819 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:10:22 ctl02 nova-api[18819]: 2017-09-28 13:10:22.601 18819 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:10:22 ctl02 nova-api[18819]: 2017-09-28 13:10:22.601 18819 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:10:22 ctl02 nova-api[18819]: 2017-09-28 13:10:22.601 18819 ERROR nova.wsgi     self.filename))
Sep 28 13:10:22 ctl02 nova-api[18819]: 2017-09-28 13:10:22.601 18819 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:10:22 ctl02 nova-api[18819]: 2017-09-28 13:10:22.601 18819 ERROR nova.wsgi
Sep 28 13:10:22 ctl02 nova-api[18819]: 2017-09-28 13:10:22.603 18819 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:10:22 ctl02 nova-api[18819]: 2017-09-28 13:10:22.738 18819 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:10:22 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6b23142e)
Sep 28 13:10:22 ctl02 nova-api[18819]: 2017-09-28 13:10:22.992 18819 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:10:22 ctl02 nova-api[18819]: 2017-09-28 13:10:22.995 18819 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:10:22 ctl02 nova-api[18819]: 2017-09-28 13:10:22.995 18819 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:10:22 ctl02 nova-api[18819]: 2017-09-28 13:10:22.995 18819 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:10:23 ctl02 nova-api[18819]: 2017-09-28 13:10:23.130 18819 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:10:23 ctl02 nova-api[18819]: 2017-09-28 13:10:23.132 18819 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:10:23 ctl02 nova-api[18819]: 2017-09-28 13:10:23.132 18819 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:10:23 ctl02 nova-api[18819]: 2017-09-28 13:10:23.133 18819 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:10:23 ctl02 nova-api[18819]: 2017-09-28 13:10:23.136 18819 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:10:23 ctl02 nova-api[18819]: 2017-09-28 13:10:23.137 18819 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:10:23 ctl02 nova-api[18819]: 2017-09-28 13:10:23.137 18819 ERROR nova Traceback (most recent call last):
Sep 28 13:10:23 ctl02 nova-api[18819]: 2017-09-28 13:10:23.137 18819 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:10:23 ctl02 nova-api[18819]: 2017-09-28 13:10:23.137 18819 ERROR nova     sys.exit(main())
Sep 28 13:10:23 ctl02 nova-api[18819]: 2017-09-28 13:10:23.137 18819 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:10:23 ctl02 nova-api[18819]: 2017-09-28 13:10:23.137 18819 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:10:23 ctl02 nova-api[18819]: 2017-09-28 13:10:23.137 18819 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:10:23 ctl02 nova-api[18819]: 2017-09-28 13:10:23.137 18819 ERROR nova     max_url_len=max_url_len)
Sep 28 13:10:23 ctl02 nova-api[18819]: 2017-09-28 13:10:23.137 18819 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:10:23 ctl02 nova-api[18819]: 2017-09-28 13:10:23.137 18819 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:10:23 ctl02 nova-api[18819]: 2017-09-28 13:10:23.137 18819 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:10:23 ctl02 nova-api[18819]: 2017-09-28 13:10:23.137 18819 ERROR nova     sock.listen(backlog)
Sep 28 13:10:23 ctl02 nova-api[18819]: 2017-09-28 13:10:23.137 18819 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:10:23 ctl02 nova-api[18819]: 2017-09-28 13:10:23.137 18819 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:10:23 ctl02 nova-api[18819]: 2017-09-28 13:10:23.137 18819 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:10:23 ctl02 nova-api[18819]: 2017-09-28 13:10:23.137 18819 ERROR nova
Sep 28 13:10:23 ctl02 heat-api-cfn[13300]: 2017-09-28 13:10:23.238 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:10:23] "OPTIONS / HTTP/1.0" 200 134 0.000499
Sep 28 13:10:23 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:10:23 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:10:23 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:10:23 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:10:23.413 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:10:23] "OPTIONS / HTTP/1.0" 200 134 0.000488
Sep 28 13:10:23 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:10:23 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:10:23 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:10:23 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:10:23 ctl02 heat-api[13008]: 2017-09-28 13:10:23.862 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:10:23] "OPTIONS / HTTP/1.0" 200 134 0.000619
Sep 28 13:10:23 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6b23142e)
Sep 28 13:10:24 ctl02 neutron-server[30536]: 2017-09-28 13:10:24.104 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:10:24] "OPTIONS / HTTP/1.0" 200 262 0.000566
Sep 28 13:10:24 ctl02 glance-api[29183]: 2017-09-28 13:10:24.299 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:10:24] "OPTIONS / HTTP/1.0" 200 134 0.000670
Sep 28 13:10:24 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6b23142e)
Sep 28 13:10:25 ctl02 neutron-server[30536]: 2017-09-28 13:10:25.083 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:10:25] "OPTIONS / HTTP/1.0" 200 262 0.000518
Sep 28 13:10:25 ctl02 nova-api[18837]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:10:25 ctl02 nova-api[18837]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:10:25 ctl02 nova-api[18837]: 2017-09-28 13:10:25.381 18837 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:10:25 ctl02 nova-api[18837]: 2017-09-28 13:10:25.383 18837 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:10:25 ctl02 nova-api[18837]: 2017-09-28 13:10:25.383 18837 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:10:25 ctl02 nova-api[18837]: 2017-09-28 13:10:25.383 18837 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:10:25 ctl02 nova-api[18837]: 2017-09-28 13:10:25.383 18837 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:10:25 ctl02 nova-api[18837]: 2017-09-28 13:10:25.383 18837 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:10:25 ctl02 nova-api[18837]: 2017-09-28 13:10:25.383 18837 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:10:25 ctl02 nova-api[18837]: 2017-09-28 13:10:25.383 18837 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:10:25 ctl02 nova-api[18837]: 2017-09-28 13:10:25.383 18837 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:10:25 ctl02 nova-api[18837]: 2017-09-28 13:10:25.383 18837 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:10:25 ctl02 nova-api[18837]: 2017-09-28 13:10:25.383 18837 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:10:25 ctl02 nova-api[18837]: 2017-09-28 13:10:25.383 18837 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:10:25 ctl02 nova-api[18837]: 2017-09-28 13:10:25.383 18837 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:10:25 ctl02 nova-api[18837]: 2017-09-28 13:10:25.383 18837 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:10:25 ctl02 nova-api[18837]: 2017-09-28 13:10:25.383 18837 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:10:25 ctl02 nova-api[18837]: 2017-09-28 13:10:25.383 18837 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:10:25 ctl02 nova-api[18837]: 2017-09-28 13:10:25.383 18837 ERROR nova.wsgi     self.filename))
Sep 28 13:10:25 ctl02 nova-api[18837]: 2017-09-28 13:10:25.383 18837 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:10:25 ctl02 nova-api[18837]: 2017-09-28 13:10:25.383 18837 ERROR nova.wsgi
Sep 28 13:10:25 ctl02 nova-api[18837]: 2017-09-28 13:10:25.385 18837 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:10:25 ctl02 nova-api[18837]: 2017-09-28 13:10:25.519 18837 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:10:25 ctl02 heat-api-cfn[13300]: 2017-09-28 13:10:25.587 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:10:25] "OPTIONS / HTTP/1.0" 200 134 0.000585
Sep 28 13:10:25 ctl02 nova-api[18837]: 2017-09-28 13:10:25.758 18837 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:10:25 ctl02 nova-api[18837]: 2017-09-28 13:10:25.760 18837 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:10:25 ctl02 nova-api[18837]: 2017-09-28 13:10:25.760 18837 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:10:25 ctl02 nova-api[18837]: 2017-09-28 13:10:25.761 18837 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:10:25 ctl02 nova-api[18837]: 2017-09-28 13:10:25.894 18837 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:10:25 ctl02 nova-api[18837]: 2017-09-28 13:10:25.896 18837 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:10:25 ctl02 nova-api[18837]: 2017-09-28 13:10:25.896 18837 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:10:25 ctl02 nova-api[18837]: 2017-09-28 13:10:25.897 18837 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:10:25 ctl02 nova-api[18837]: 2017-09-28 13:10:25.900 18837 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:10:25 ctl02 nova-api[18837]: 2017-09-28 13:10:25.900 18837 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:10:25 ctl02 nova-api[18837]: 2017-09-28 13:10:25.900 18837 ERROR nova Traceback (most recent call last):
Sep 28 13:10:25 ctl02 nova-api[18837]: 2017-09-28 13:10:25.900 18837 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:10:25 ctl02 nova-api[18837]: 2017-09-28 13:10:25.900 18837 ERROR nova     sys.exit(main())
Sep 28 13:10:25 ctl02 nova-api[18837]: 2017-09-28 13:10:25.900 18837 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:10:25 ctl02 nova-api[18837]: 2017-09-28 13:10:25.900 18837 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:10:25 ctl02 nova-api[18837]: 2017-09-28 13:10:25.900 18837 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:10:25 ctl02 nova-api[18837]: 2017-09-28 13:10:25.900 18837 ERROR nova     max_url_len=max_url_len)
Sep 28 13:10:25 ctl02 nova-api[18837]: 2017-09-28 13:10:25.900 18837 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:10:25 ctl02 nova-api[18837]: 2017-09-28 13:10:25.900 18837 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:10:25 ctl02 nova-api[18837]: 2017-09-28 13:10:25.900 18837 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:10:25 ctl02 nova-api[18837]: 2017-09-28 13:10:25.900 18837 ERROR nova     sock.listen(backlog)
Sep 28 13:10:25 ctl02 nova-api[18837]: 2017-09-28 13:10:25.900 18837 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:10:25 ctl02 nova-api[18837]: 2017-09-28 13:10:25.900 18837 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:10:25 ctl02 nova-api[18837]: 2017-09-28 13:10:25.900 18837 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:10:25 ctl02 nova-api[18837]: 2017-09-28 13:10:25.900 18837 ERROR nova
Sep 28 13:10:25 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6b23142e)
Sep 28 13:10:26 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:10:26 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:10:26 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:10:26 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:10:26 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:10:26 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:10:26 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:10:26 ctl02 heat-api-cfn[13300]: 2017-09-28 13:10:26.372 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:10:26] "OPTIONS / HTTP/1.0" 200 134 0.000504
Sep 28 13:10:26 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x6b23142e)
Sep 28 13:10:27 ctl02 heat-api[13008]: 2017-09-28 13:10:27.133 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:10:27] "OPTIONS / HTTP/1.0" 200 134 0.000618
Sep 28 13:10:27 ctl02 heat-api[13008]: 2017-09-28 13:10:27.667 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:10:27] "OPTIONS / HTTP/1.0" 200 134 0.000514
Sep 28 13:10:27 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:10:27.728 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:10:27] "OPTIONS / HTTP/1.0" 200 134 0.000435
Sep 28 13:10:27 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 13:10:27 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 13:10:27 ctl02 nova-api[18855]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:10:27 ctl02 nova-api[18855]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:10:28 ctl02 nova-api[18855]: 2017-09-28 13:10:28.129 18855 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:10:28 ctl02 nova-api[18855]: 2017-09-28 13:10:28.131 18855 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:10:28 ctl02 nova-api[18855]: 2017-09-28 13:10:28.131 18855 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:10:28 ctl02 nova-api[18855]: 2017-09-28 13:10:28.131 18855 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:10:28 ctl02 nova-api[18855]: 2017-09-28 13:10:28.131 18855 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:10:28 ctl02 nova-api[18855]: 2017-09-28 13:10:28.131 18855 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:10:28 ctl02 nova-api[18855]: 2017-09-28 13:10:28.131 18855 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:10:28 ctl02 nova-api[18855]: 2017-09-28 13:10:28.131 18855 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:10:28 ctl02 nova-api[18855]: 2017-09-28 13:10:28.131 18855 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:10:28 ctl02 nova-api[18855]: 2017-09-28 13:10:28.131 18855 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:10:28 ctl02 nova-api[18855]: 2017-09-28 13:10:28.131 18855 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:10:28 ctl02 nova-api[18855]: 2017-09-28 13:10:28.131 18855 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:10:28 ctl02 nova-api[18855]: 2017-09-28 13:10:28.131 18855 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:10:28 ctl02 nova-api[18855]: 2017-09-28 13:10:28.131 18855 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:10:28 ctl02 nova-api[18855]: 2017-09-28 13:10:28.131 18855 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:10:28 ctl02 nova-api[18855]: 2017-09-28 13:10:28.131 18855 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:10:28 ctl02 nova-api[18855]: 2017-09-28 13:10:28.131 18855 ERROR nova.wsgi     self.filename))
Sep 28 13:10:28 ctl02 nova-api[18855]: 2017-09-28 13:10:28.131 18855 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:10:28 ctl02 nova-api[18855]: 2017-09-28 13:10:28.131 18855 ERROR nova.wsgi
Sep 28 13:10:28 ctl02 nova-api[18855]: 2017-09-28 13:10:28.132 18855 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:10:28 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:10:28.165 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:10:28] "OPTIONS / HTTP/1.0" 200 134 0.000441
Sep 28 13:10:28 ctl02 nova-api[18855]: 2017-09-28 13:10:28.267 18855 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:10:28 ctl02 nova-api[18855]: 2017-09-28 13:10:28.517 18855 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:10:28 ctl02 nova-api[18855]: 2017-09-28 13:10:28.519 18855 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:10:28 ctl02 nova-api[18855]: 2017-09-28 13:10:28.520 18855 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:10:28 ctl02 nova-api[18855]: 2017-09-28 13:10:28.520 18855 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:10:28 ctl02 neutron-server[30536]: 2017-09-28 13:10:28.547 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 13:10:28 ctl02 nova-api[18855]: 2017-09-28 13:10:28.656 18855 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:10:28 ctl02 nova-api[18855]: 2017-09-28 13:10:28.658 18855 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:10:28 ctl02 nova-api[18855]: 2017-09-28 13:10:28.658 18855 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:10:28 ctl02 nova-api[18855]: 2017-09-28 13:10:28.658 18855 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:10:28 ctl02 nova-api[18855]: 2017-09-28 13:10:28.662 18855 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:10:28 ctl02 nova-api[18855]: 2017-09-28 13:10:28.662 18855 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:10:28 ctl02 nova-api[18855]: 2017-09-28 13:10:28.662 18855 ERROR nova Traceback (most recent call last):
Sep 28 13:10:28 ctl02 nova-api[18855]: 2017-09-28 13:10:28.662 18855 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:10:28 ctl02 nova-api[18855]: 2017-09-28 13:10:28.662 18855 ERROR nova     sys.exit(main())
Sep 28 13:10:28 ctl02 nova-api[18855]: 2017-09-28 13:10:28.662 18855 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:10:28 ctl02 nova-api[18855]: 2017-09-28 13:10:28.662 18855 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:10:28 ctl02 nova-api[18855]: 2017-09-28 13:10:28.662 18855 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:10:28 ctl02 nova-api[18855]: 2017-09-28 13:10:28.662 18855 ERROR nova     max_url_len=max_url_len)
Sep 28 13:10:28 ctl02 nova-api[18855]: 2017-09-28 13:10:28.662 18855 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:10:28 ctl02 nova-api[18855]: 2017-09-28 13:10:28.662 18855 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:10:28 ctl02 nova-api[18855]: 2017-09-28 13:10:28.662 18855 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:10:28 ctl02 nova-api[18855]: 2017-09-28 13:10:28.662 18855 ERROR nova     sock.listen(backlog)
Sep 28 13:10:28 ctl02 nova-api[18855]: 2017-09-28 13:10:28.662 18855 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:10:28 ctl02 nova-api[18855]: 2017-09-28 13:10:28.662 18855 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:10:28 ctl02 nova-api[18855]: 2017-09-28 13:10:28.662 18855 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:10:28 ctl02 nova-api[18855]: 2017-09-28 13:10:28.662 18855 ERROR nova
Sep 28 13:10:28 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:10:28 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:10:28 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:10:28 ctl02 neutron-server[30536]: 2017-09-28 13:10:28.841 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:10:28] "OPTIONS / HTTP/1.0" 200 262 0.000505
Sep 28 13:10:28 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:10:28 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:10:28 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:10:28 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:10:29 ctl02 glance-api[29183]: 2017-09-28 13:10:29.174 29256 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:10:29] "OPTIONS / HTTP/1.0" 200 134 0.000662
Sep 28 13:10:30 ctl02 nova-api[18878]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:10:30 ctl02 nova-api[18878]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:10:30 ctl02 nova-api[18878]: 2017-09-28 13:10:30.846 18878 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:10:30 ctl02 nova-api[18878]: 2017-09-28 13:10:30.847 18878 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:10:30 ctl02 nova-api[18878]: 2017-09-28 13:10:30.847 18878 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:10:30 ctl02 nova-api[18878]: 2017-09-28 13:10:30.847 18878 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:10:30 ctl02 nova-api[18878]: 2017-09-28 13:10:30.847 18878 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:10:30 ctl02 nova-api[18878]: 2017-09-28 13:10:30.847 18878 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:10:30 ctl02 nova-api[18878]: 2017-09-28 13:10:30.847 18878 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:10:30 ctl02 nova-api[18878]: 2017-09-28 13:10:30.847 18878 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:10:30 ctl02 nova-api[18878]: 2017-09-28 13:10:30.847 18878 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:10:30 ctl02 nova-api[18878]: 2017-09-28 13:10:30.847 18878 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:10:30 ctl02 nova-api[18878]: 2017-09-28 13:10:30.847 18878 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:10:30 ctl02 nova-api[18878]: 2017-09-28 13:10:30.847 18878 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:10:30 ctl02 nova-api[18878]: 2017-09-28 13:10:30.847 18878 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:10:30 ctl02 nova-api[18878]: 2017-09-28 13:10:30.847 18878 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:10:30 ctl02 nova-api[18878]: 2017-09-28 13:10:30.847 18878 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:10:30 ctl02 nova-api[18878]: 2017-09-28 13:10:30.847 18878 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:10:30 ctl02 nova-api[18878]: 2017-09-28 13:10:30.847 18878 ERROR nova.wsgi     self.filename))
Sep 28 13:10:30 ctl02 nova-api[18878]: 2017-09-28 13:10:30.847 18878 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:10:30 ctl02 nova-api[18878]: 2017-09-28 13:10:30.847 18878 ERROR nova.wsgi
Sep 28 13:10:30 ctl02 nova-api[18878]: 2017-09-28 13:10:30.848 18878 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:10:30 ctl02 glance-api[29183]: 2017-09-28 13:10:30.947 29254 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:10:30] "OPTIONS / HTTP/1.0" 200 134 0.000691
Sep 28 13:10:30 ctl02 nova-api[18878]: 2017-09-28 13:10:30.985 18878 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:10:31 ctl02 nova-api[18878]: 2017-09-28 13:10:31.236 18878 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:10:31 ctl02 nova-api[18878]: 2017-09-28 13:10:31.239 18878 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:10:31 ctl02 nova-api[18878]: 2017-09-28 13:10:31.239 18878 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:10:31 ctl02 nova-api[18878]: 2017-09-28 13:10:31.239 18878 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:10:31 ctl02 nova-api[18878]: 2017-09-28 13:10:31.372 18878 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:10:31 ctl02 nova-api[18878]: 2017-09-28 13:10:31.374 18878 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:10:31 ctl02 nova-api[18878]: 2017-09-28 13:10:31.374 18878 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:10:31 ctl02 nova-api[18878]: 2017-09-28 13:10:31.375 18878 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:10:31 ctl02 nova-api[18878]: 2017-09-28 13:10:31.378 18878 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:10:31 ctl02 nova-api[18878]: 2017-09-28 13:10:31.378 18878 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:10:31 ctl02 nova-api[18878]: 2017-09-28 13:10:31.378 18878 ERROR nova Traceback (most recent call last):
Sep 28 13:10:31 ctl02 nova-api[18878]: 2017-09-28 13:10:31.378 18878 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:10:31 ctl02 nova-api[18878]: 2017-09-28 13:10:31.378 18878 ERROR nova     sys.exit(main())
Sep 28 13:10:31 ctl02 nova-api[18878]: 2017-09-28 13:10:31.378 18878 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:10:31 ctl02 nova-api[18878]: 2017-09-28 13:10:31.378 18878 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:10:31 ctl02 nova-api[18878]: 2017-09-28 13:10:31.378 18878 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:10:31 ctl02 nova-api[18878]: 2017-09-28 13:10:31.378 18878 ERROR nova     max_url_len=max_url_len)
Sep 28 13:10:31 ctl02 nova-api[18878]: 2017-09-28 13:10:31.378 18878 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:10:31 ctl02 nova-api[18878]: 2017-09-28 13:10:31.378 18878 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:10:31 ctl02 nova-api[18878]: 2017-09-28 13:10:31.378 18878 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:10:31 ctl02 nova-api[18878]: 2017-09-28 13:10:31.378 18878 ERROR nova     sock.listen(backlog)
Sep 28 13:10:31 ctl02 nova-api[18878]: 2017-09-28 13:10:31.378 18878 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:10:31 ctl02 nova-api[18878]: 2017-09-28 13:10:31.378 18878 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:10:31 ctl02 nova-api[18878]: 2017-09-28 13:10:31.378 18878 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:10:31 ctl02 nova-api[18878]: 2017-09-28 13:10:31.378 18878 ERROR nova
Sep 28 13:10:31 ctl02 nova-conductor[5056]: 2017-09-28 13:10:31.440 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:10:31 ctl02 nova-conductor[5056]: 2017-09-28 13:10:31.440 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:10:31 ctl02 nova-conductor[5056]: 2017-09-28 13:10:31.447 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:10:31 ctl02 nova-conductor[5056]: 2017-09-28 13:10:31.453 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:10:31 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:10:31 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:10:31 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:10:31 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:10:31 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:10:31 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:10:31 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:10:32 ctl02 nova-cert[4860]: 2017-09-28 13:10:32.530 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:10:33 ctl02 nova-api[18896]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:10:33 ctl02 nova-api[18896]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:10:33 ctl02 heat-api-cfn[13300]: 2017-09-28 13:10:33.424 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:10:33] "OPTIONS / HTTP/1.0" 200 134 0.000457
Sep 28 13:10:33 ctl02 nova-api[18896]: 2017-09-28 13:10:33.570 18896 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:10:33 ctl02 nova-api[18896]: 2017-09-28 13:10:33.572 18896 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:10:33 ctl02 nova-api[18896]: 2017-09-28 13:10:33.572 18896 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:10:33 ctl02 nova-api[18896]: 2017-09-28 13:10:33.572 18896 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:10:33 ctl02 nova-api[18896]: 2017-09-28 13:10:33.572 18896 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:10:33 ctl02 nova-api[18896]: 2017-09-28 13:10:33.572 18896 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:10:33 ctl02 nova-api[18896]: 2017-09-28 13:10:33.572 18896 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:10:33 ctl02 nova-api[18896]: 2017-09-28 13:10:33.572 18896 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:10:33 ctl02 nova-api[18896]: 2017-09-28 13:10:33.572 18896 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:10:33 ctl02 nova-api[18896]: 2017-09-28 13:10:33.572 18896 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:10:33 ctl02 nova-api[18896]: 2017-09-28 13:10:33.572 18896 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:10:33 ctl02 nova-api[18896]: 2017-09-28 13:10:33.572 18896 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:10:33 ctl02 nova-api[18896]: 2017-09-28 13:10:33.572 18896 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:10:33 ctl02 nova-api[18896]: 2017-09-28 13:10:33.572 18896 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:10:33 ctl02 nova-api[18896]: 2017-09-28 13:10:33.572 18896 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:10:33 ctl02 nova-api[18896]: 2017-09-28 13:10:33.572 18896 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:10:33 ctl02 nova-api[18896]: 2017-09-28 13:10:33.572 18896 ERROR nova.wsgi     self.filename))
Sep 28 13:10:33 ctl02 nova-api[18896]: 2017-09-28 13:10:33.572 18896 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:10:33 ctl02 nova-api[18896]: 2017-09-28 13:10:33.572 18896 ERROR nova.wsgi
Sep 28 13:10:33 ctl02 nova-api[18896]: 2017-09-28 13:10:33.573 18896 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:10:33 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:10:33.673 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:10:33] "OPTIONS / HTTP/1.0" 200 134 0.000394
Sep 28 13:10:33 ctl02 nova-api[18896]: 2017-09-28 13:10:33.699 18896 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:10:33 ctl02 glance-api[29183]: 2017-09-28 13:10:33.916 29255 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:10:33] "OPTIONS / HTTP/1.0" 200 134 0.000695
Sep 28 13:10:33 ctl02 heat-api[13008]: 2017-09-28 13:10:33.922 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:10:33] "OPTIONS / HTTP/1.0" 200 134 0.000569
Sep 28 13:10:33 ctl02 nova-api[18896]: 2017-09-28 13:10:33.935 18896 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:10:33 ctl02 nova-api[18896]: 2017-09-28 13:10:33.937 18896 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:10:33 ctl02 nova-api[18896]: 2017-09-28 13:10:33.937 18896 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:10:33 ctl02 nova-api[18896]: 2017-09-28 13:10:33.937 18896 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:10:34 ctl02 nova-api[18896]: 2017-09-28 13:10:34.074 18896 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:10:34 ctl02 nova-api[18896]: 2017-09-28 13:10:34.076 18896 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:10:34 ctl02 nova-api[18896]: 2017-09-28 13:10:34.076 18896 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:10:34 ctl02 nova-api[18896]: 2017-09-28 13:10:34.077 18896 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:10:34 ctl02 nova-api[18896]: 2017-09-28 13:10:34.080 18896 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:10:34 ctl02 nova-api[18896]: 2017-09-28 13:10:34.080 18896 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:10:34 ctl02 nova-api[18896]: 2017-09-28 13:10:34.080 18896 ERROR nova Traceback (most recent call last):
Sep 28 13:10:34 ctl02 nova-api[18896]: 2017-09-28 13:10:34.080 18896 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:10:34 ctl02 nova-api[18896]: 2017-09-28 13:10:34.080 18896 ERROR nova     sys.exit(main())
Sep 28 13:10:34 ctl02 nova-api[18896]: 2017-09-28 13:10:34.080 18896 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:10:34 ctl02 nova-api[18896]: 2017-09-28 13:10:34.080 18896 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:10:34 ctl02 nova-api[18896]: 2017-09-28 13:10:34.080 18896 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:10:34 ctl02 nova-api[18896]: 2017-09-28 13:10:34.080 18896 ERROR nova     max_url_len=max_url_len)
Sep 28 13:10:34 ctl02 nova-api[18896]: 2017-09-28 13:10:34.080 18896 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:10:34 ctl02 nova-api[18896]: 2017-09-28 13:10:34.080 18896 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:10:34 ctl02 nova-api[18896]: 2017-09-28 13:10:34.080 18896 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:10:34 ctl02 nova-api[18896]: 2017-09-28 13:10:34.080 18896 ERROR nova     sock.listen(backlog)
Sep 28 13:10:34 ctl02 nova-api[18896]: 2017-09-28 13:10:34.080 18896 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:10:34 ctl02 nova-api[18896]: 2017-09-28 13:10:34.080 18896 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:10:34 ctl02 nova-api[18896]: 2017-09-28 13:10:34.080 18896 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:10:34 ctl02 nova-api[18896]: 2017-09-28 13:10:34.080 18896 ERROR nova
Sep 28 13:10:34 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:10:34 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:10:34 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:10:34 ctl02 neutron-server[30536]: 2017-09-28 13:10:34.272 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:10:34] "OPTIONS / HTTP/1.0" 200 262 0.000557
Sep 28 13:10:34 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:10:34 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:10:34 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:10:34 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:10:35 ctl02 neutron-server[30536]: 2017-09-28 13:10:35.195 30595 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:10:35] "OPTIONS / HTTP/1.0" 200 262 0.000559
Sep 28 13:10:35 ctl02 heat-api-cfn[13300]: 2017-09-28 13:10:35.896 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:10:35] "OPTIONS / HTTP/1.0" 200 134 0.000546
Sep 28 13:10:35 ctl02 neutron-server[30536]: 2017-09-28 13:10:35.935 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 4 dead agents out of 6:
Sep 28 13:10:35 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 13:10:35 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 13:09:16 cmp002
Sep 28 13:10:35 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 13:09:08 cmp001
Sep 28 13:10:35 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 13:08:40 cmp002
Sep 28 13:10:35 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 13:09:56 cmp002
Sep 28 13:10:36 ctl02 nova-api[18914]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:10:36 ctl02 nova-api[18914]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:10:36 ctl02 nova-api[18914]: 2017-09-28 13:10:36.334 18914 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:10:36 ctl02 nova-api[18914]: 2017-09-28 13:10:36.349 18914 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:10:36 ctl02 nova-api[18914]: 2017-09-28 13:10:36.349 18914 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:10:36 ctl02 nova-api[18914]: 2017-09-28 13:10:36.349 18914 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:10:36 ctl02 nova-api[18914]: 2017-09-28 13:10:36.349 18914 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:10:36 ctl02 nova-api[18914]: 2017-09-28 13:10:36.349 18914 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:10:36 ctl02 nova-api[18914]: 2017-09-28 13:10:36.349 18914 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:10:36 ctl02 nova-api[18914]: 2017-09-28 13:10:36.349 18914 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:10:36 ctl02 nova-api[18914]: 2017-09-28 13:10:36.349 18914 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:10:36 ctl02 nova-api[18914]: 2017-09-28 13:10:36.349 18914 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:10:36 ctl02 nova-api[18914]: 2017-09-28 13:10:36.349 18914 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:10:36 ctl02 nova-api[18914]: 2017-09-28 13:10:36.349 18914 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:10:36 ctl02 nova-api[18914]: 2017-09-28 13:10:36.349 18914 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:10:36 ctl02 nova-api[18914]: 2017-09-28 13:10:36.349 18914 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:10:36 ctl02 nova-api[18914]: 2017-09-28 13:10:36.349 18914 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:10:36 ctl02 nova-api[18914]: 2017-09-28 13:10:36.349 18914 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:10:36 ctl02 nova-api[18914]: 2017-09-28 13:10:36.349 18914 ERROR nova.wsgi     self.filename))
Sep 28 13:10:36 ctl02 nova-api[18914]: 2017-09-28 13:10:36.349 18914 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:10:36 ctl02 nova-api[18914]: 2017-09-28 13:10:36.349 18914 ERROR nova.wsgi
Sep 28 13:10:36 ctl02 nova-api[18914]: 2017-09-28 13:10:36.350 18914 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:10:36 ctl02 nova-api[18914]: 2017-09-28 13:10:36.490 18914 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:10:36 ctl02 heat-api-cfn[13300]: 2017-09-28 13:10:36.669 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:10:36] "OPTIONS / HTTP/1.0" 200 134 0.000484
Sep 28 13:10:36 ctl02 nova-api[18914]: 2017-09-28 13:10:36.717 18914 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:10:36 ctl02 nova-api[18914]: 2017-09-28 13:10:36.719 18914 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:10:36 ctl02 nova-api[18914]: 2017-09-28 13:10:36.719 18914 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:10:36 ctl02 nova-api[18914]: 2017-09-28 13:10:36.719 18914 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:10:36 ctl02 nova-api[18914]: 2017-09-28 13:10:36.849 18914 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:10:36 ctl02 nova-api[18914]: 2017-09-28 13:10:36.851 18914 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:10:36 ctl02 nova-api[18914]: 2017-09-28 13:10:36.851 18914 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:10:36 ctl02 nova-api[18914]: 2017-09-28 13:10:36.851 18914 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:10:36 ctl02 nova-api[18914]: 2017-09-28 13:10:36.854 18914 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:10:36 ctl02 nova-api[18914]: 2017-09-28 13:10:36.855 18914 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:10:36 ctl02 nova-api[18914]: 2017-09-28 13:10:36.855 18914 ERROR nova Traceback (most recent call last):
Sep 28 13:10:36 ctl02 nova-api[18914]: 2017-09-28 13:10:36.855 18914 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:10:36 ctl02 nova-api[18914]: 2017-09-28 13:10:36.855 18914 ERROR nova     sys.exit(main())
Sep 28 13:10:36 ctl02 nova-api[18914]: 2017-09-28 13:10:36.855 18914 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:10:36 ctl02 nova-api[18914]: 2017-09-28 13:10:36.855 18914 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:10:36 ctl02 nova-api[18914]: 2017-09-28 13:10:36.855 18914 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:10:36 ctl02 nova-api[18914]: 2017-09-28 13:10:36.855 18914 ERROR nova     max_url_len=max_url_len)
Sep 28 13:10:36 ctl02 nova-api[18914]: 2017-09-28 13:10:36.855 18914 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:10:36 ctl02 nova-api[18914]: 2017-09-28 13:10:36.855 18914 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:10:36 ctl02 nova-api[18914]: 2017-09-28 13:10:36.855 18914 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:10:36 ctl02 nova-api[18914]: 2017-09-28 13:10:36.855 18914 ERROR nova     sock.listen(backlog)
Sep 28 13:10:36 ctl02 nova-api[18914]: 2017-09-28 13:10:36.855 18914 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:10:36 ctl02 nova-api[18914]: 2017-09-28 13:10:36.855 18914 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:10:36 ctl02 nova-api[18914]: 2017-09-28 13:10:36.855 18914 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:10:36 ctl02 nova-api[18914]: 2017-09-28 13:10:36.855 18914 ERROR nova
Sep 28 13:10:36 ctl02 heat-api[13008]: 2017-09-28 13:10:36.945 13087 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:10:36] "OPTIONS / HTTP/1.0" 200 134 0.000659
Sep 28 13:10:36 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:10:36 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:10:36 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:10:37 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:10:37 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:10:37 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:10:37 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:10:37 ctl02 heat-api[13008]: 2017-09-28 13:10:37.481 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:10:37] "OPTIONS / HTTP/1.0" 200 134 0.000544
Sep 28 13:10:37 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:10:37.554 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:10:37] "OPTIONS / HTTP/1.0" 200 134 0.000386
Sep 28 13:10:38 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:10:38.171 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:10:38] "OPTIONS / HTTP/1.0" 200 134 0.000304
Sep 28 13:10:38 ctl02 neutron-server[30536]: 2017-09-28 13:10:38.626 30595 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:10:38] "OPTIONS / HTTP/1.0" 200 262 0.000464
Sep 28 13:10:38 ctl02 nova-api[18932]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:10:38 ctl02 nova-api[18932]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:10:39 ctl02 nova-api[18932]: 2017-09-28 13:10:39.090 18932 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:10:39 ctl02 nova-api[18932]: 2017-09-28 13:10:39.092 18932 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:10:39 ctl02 nova-api[18932]: 2017-09-28 13:10:39.092 18932 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:10:39 ctl02 nova-api[18932]: 2017-09-28 13:10:39.092 18932 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:10:39 ctl02 nova-api[18932]: 2017-09-28 13:10:39.092 18932 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:10:39 ctl02 nova-api[18932]: 2017-09-28 13:10:39.092 18932 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:10:39 ctl02 nova-api[18932]: 2017-09-28 13:10:39.092 18932 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:10:39 ctl02 nova-api[18932]: 2017-09-28 13:10:39.092 18932 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:10:39 ctl02 nova-api[18932]: 2017-09-28 13:10:39.092 18932 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:10:39 ctl02 nova-api[18932]: 2017-09-28 13:10:39.092 18932 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:10:39 ctl02 nova-api[18932]: 2017-09-28 13:10:39.092 18932 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:10:39 ctl02 nova-api[18932]: 2017-09-28 13:10:39.092 18932 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:10:39 ctl02 nova-api[18932]: 2017-09-28 13:10:39.092 18932 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:10:39 ctl02 nova-api[18932]: 2017-09-28 13:10:39.092 18932 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:10:39 ctl02 nova-api[18932]: 2017-09-28 13:10:39.092 18932 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:10:39 ctl02 nova-api[18932]: 2017-09-28 13:10:39.092 18932 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:10:39 ctl02 nova-api[18932]: 2017-09-28 13:10:39.092 18932 ERROR nova.wsgi     self.filename))
Sep 28 13:10:39 ctl02 nova-api[18932]: 2017-09-28 13:10:39.092 18932 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:10:39 ctl02 nova-api[18932]: 2017-09-28 13:10:39.092 18932 ERROR nova.wsgi
Sep 28 13:10:39 ctl02 nova-api[18932]: 2017-09-28 13:10:39.092 18932 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:10:39 ctl02 glance-api[29183]: 2017-09-28 13:10:39.178 29255 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:10:39] "OPTIONS / HTTP/1.0" 200 134 0.000592
Sep 28 13:10:39 ctl02 nova-api[18932]: 2017-09-28 13:10:39.223 18932 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:10:39 ctl02 nova-api[18932]: 2017-09-28 13:10:39.450 18932 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:10:39 ctl02 nova-api[18932]: 2017-09-28 13:10:39.453 18932 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:10:39 ctl02 nova-api[18932]: 2017-09-28 13:10:39.453 18932 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:10:39 ctl02 nova-api[18932]: 2017-09-28 13:10:39.453 18932 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:10:39 ctl02 nova-api[18932]: 2017-09-28 13:10:39.583 18932 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:10:39 ctl02 nova-api[18932]: 2017-09-28 13:10:39.585 18932 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:10:39 ctl02 nova-api[18932]: 2017-09-28 13:10:39.585 18932 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:10:39 ctl02 nova-api[18932]: 2017-09-28 13:10:39.586 18932 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:10:39 ctl02 nova-api[18932]: 2017-09-28 13:10:39.589 18932 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:10:39 ctl02 nova-api[18932]: 2017-09-28 13:10:39.589 18932 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:10:39 ctl02 nova-api[18932]: 2017-09-28 13:10:39.589 18932 ERROR nova Traceback (most recent call last):
Sep 28 13:10:39 ctl02 nova-api[18932]: 2017-09-28 13:10:39.589 18932 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:10:39 ctl02 nova-api[18932]: 2017-09-28 13:10:39.589 18932 ERROR nova     sys.exit(main())
Sep 28 13:10:39 ctl02 nova-api[18932]: 2017-09-28 13:10:39.589 18932 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:10:39 ctl02 nova-api[18932]: 2017-09-28 13:10:39.589 18932 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:10:39 ctl02 nova-api[18932]: 2017-09-28 13:10:39.589 18932 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:10:39 ctl02 nova-api[18932]: 2017-09-28 13:10:39.589 18932 ERROR nova     max_url_len=max_url_len)
Sep 28 13:10:39 ctl02 nova-api[18932]: 2017-09-28 13:10:39.589 18932 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:10:39 ctl02 nova-api[18932]: 2017-09-28 13:10:39.589 18932 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:10:39 ctl02 nova-api[18932]: 2017-09-28 13:10:39.589 18932 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:10:39 ctl02 nova-api[18932]: 2017-09-28 13:10:39.589 18932 ERROR nova     sock.listen(backlog)
Sep 28 13:10:39 ctl02 nova-api[18932]: 2017-09-28 13:10:39.589 18932 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:10:39 ctl02 nova-api[18932]: 2017-09-28 13:10:39.589 18932 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:10:39 ctl02 nova-api[18932]: 2017-09-28 13:10:39.589 18932 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:10:39 ctl02 nova-api[18932]: 2017-09-28 13:10:39.589 18932 ERROR nova
Sep 28 13:10:39 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:10:39 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:10:39 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:10:39 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:10:39 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:10:39 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:10:39 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:10:40 ctl02 glance-api[29183]: 2017-09-28 13:10:40.850 29255 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:10:40] "OPTIONS / HTTP/1.0" 200 134 0.000635
Sep 28 13:10:41 ctl02 nova-api[18949]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:10:41 ctl02 nova-api[18949]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:10:41 ctl02 nova-api[18949]: 2017-09-28 13:10:41.886 18949 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:10:41 ctl02 nova-api[18949]: 2017-09-28 13:10:41.888 18949 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:10:41 ctl02 nova-api[18949]: 2017-09-28 13:10:41.888 18949 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:10:41 ctl02 nova-api[18949]: 2017-09-28 13:10:41.888 18949 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:10:41 ctl02 nova-api[18949]: 2017-09-28 13:10:41.888 18949 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:10:41 ctl02 nova-api[18949]: 2017-09-28 13:10:41.888 18949 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:10:41 ctl02 nova-api[18949]: 2017-09-28 13:10:41.888 18949 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:10:41 ctl02 nova-api[18949]: 2017-09-28 13:10:41.888 18949 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:10:41 ctl02 nova-api[18949]: 2017-09-28 13:10:41.888 18949 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:10:41 ctl02 nova-api[18949]: 2017-09-28 13:10:41.888 18949 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:10:41 ctl02 nova-api[18949]: 2017-09-28 13:10:41.888 18949 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:10:41 ctl02 nova-api[18949]: 2017-09-28 13:10:41.888 18949 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:10:41 ctl02 nova-api[18949]: 2017-09-28 13:10:41.888 18949 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:10:41 ctl02 nova-api[18949]: 2017-09-28 13:10:41.888 18949 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:10:41 ctl02 nova-api[18949]: 2017-09-28 13:10:41.888 18949 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:10:41 ctl02 nova-api[18949]: 2017-09-28 13:10:41.888 18949 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:10:41 ctl02 nova-api[18949]: 2017-09-28 13:10:41.888 18949 ERROR nova.wsgi     self.filename))
Sep 28 13:10:41 ctl02 nova-api[18949]: 2017-09-28 13:10:41.888 18949 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:10:41 ctl02 nova-api[18949]: 2017-09-28 13:10:41.888 18949 ERROR nova.wsgi
Sep 28 13:10:41 ctl02 nova-api[18949]: 2017-09-28 13:10:41.890 18949 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:10:42 ctl02 nova-api[18949]: 2017-09-28 13:10:42.021 18949 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:10:42 ctl02 nova-api[18949]: 2017-09-28 13:10:42.250 18949 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:10:42 ctl02 nova-api[18949]: 2017-09-28 13:10:42.253 18949 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:10:42 ctl02 nova-api[18949]: 2017-09-28 13:10:42.253 18949 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:10:42 ctl02 nova-api[18949]: 2017-09-28 13:10:42.254 18949 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:10:42 ctl02 nova-consoleauth[5433]: 2017-09-28 13:10:42.389 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:10:42 ctl02 nova-api[18949]: 2017-09-28 13:10:42.389 18949 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:10:42 ctl02 nova-api[18949]: 2017-09-28 13:10:42.392 18949 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:10:42 ctl02 nova-api[18949]: 2017-09-28 13:10:42.392 18949 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:10:42 ctl02 nova-api[18949]: 2017-09-28 13:10:42.393 18949 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:10:42 ctl02 nova-api[18949]: 2017-09-28 13:10:42.397 18949 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:10:42 ctl02 nova-api[18949]: 2017-09-28 13:10:42.397 18949 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:10:42 ctl02 nova-api[18949]: 2017-09-28 13:10:42.397 18949 ERROR nova Traceback (most recent call last):
Sep 28 13:10:42 ctl02 nova-api[18949]: 2017-09-28 13:10:42.397 18949 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:10:42 ctl02 nova-api[18949]: 2017-09-28 13:10:42.397 18949 ERROR nova     sys.exit(main())
Sep 28 13:10:42 ctl02 nova-api[18949]: 2017-09-28 13:10:42.397 18949 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:10:42 ctl02 nova-api[18949]: 2017-09-28 13:10:42.397 18949 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:10:42 ctl02 nova-api[18949]: 2017-09-28 13:10:42.397 18949 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:10:42 ctl02 nova-api[18949]: 2017-09-28 13:10:42.397 18949 ERROR nova     max_url_len=max_url_len)
Sep 28 13:10:42 ctl02 nova-api[18949]: 2017-09-28 13:10:42.397 18949 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:10:42 ctl02 nova-api[18949]: 2017-09-28 13:10:42.397 18949 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:10:42 ctl02 nova-api[18949]: 2017-09-28 13:10:42.397 18949 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:10:42 ctl02 nova-api[18949]: 2017-09-28 13:10:42.397 18949 ERROR nova     sock.listen(backlog)
Sep 28 13:10:42 ctl02 nova-api[18949]: 2017-09-28 13:10:42.397 18949 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:10:42 ctl02 nova-api[18949]: 2017-09-28 13:10:42.397 18949 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:10:42 ctl02 nova-api[18949]: 2017-09-28 13:10:42.397 18949 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:10:42 ctl02 nova-api[18949]: 2017-09-28 13:10:42.397 18949 ERROR nova
Sep 28 13:10:42 ctl02 heat-engine[12803]: 2017-09-28 13:10:42.554 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:10:42 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:10:42 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:10:42 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:10:42 ctl02 heat-engine[12803]: 2017-09-28 13:10:42.571 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:10:42 ctl02 heat-engine[12803]: 2017-09-28 13:10:42.580 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:10:42 ctl02 heat-engine[12803]: 2017-09-28 13:10:42.583 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:10:42 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:10:42 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:10:42 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:10:42 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:10:43 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:10:43.282 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:10:43] "OPTIONS / HTTP/1.0" 200 134 0.000496
Sep 28 13:10:43 ctl02 heat-api-cfn[13300]: 2017-09-28 13:10:43.318 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:10:43] "OPTIONS / HTTP/1.0" 200 134 0.000539
Sep 28 13:10:43 ctl02 neutron-server[30536]: 2017-09-28 13:10:43.553 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 13:10:43 ctl02 glance-api[29183]: 2017-09-28 13:10:43.642 29251 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:10:43] "OPTIONS / HTTP/1.0" 200 134 0.001055
Sep 28 13:10:43 ctl02 heat-api[13008]: 2017-09-28 13:10:43.732 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:10:43] "OPTIONS / HTTP/1.0" 200 134 0.000610
Sep 28 13:10:44 ctl02 neutron-server[30536]: 2017-09-28 13:10:44.185 30595 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:10:44] "OPTIONS / HTTP/1.0" 200 262 0.000560
Sep 28 13:10:44 ctl02 nova-api[18968]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:10:44 ctl02 nova-api[18968]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:10:44 ctl02 nova-api[18968]: 2017-09-28 13:10:44.572 18968 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:10:44 ctl02 nova-api[18968]: 2017-09-28 13:10:44.574 18968 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:10:44 ctl02 nova-api[18968]: 2017-09-28 13:10:44.574 18968 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:10:44 ctl02 nova-api[18968]: 2017-09-28 13:10:44.574 18968 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:10:44 ctl02 nova-api[18968]: 2017-09-28 13:10:44.574 18968 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:10:44 ctl02 nova-api[18968]: 2017-09-28 13:10:44.574 18968 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:10:44 ctl02 nova-api[18968]: 2017-09-28 13:10:44.574 18968 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:10:44 ctl02 nova-api[18968]: 2017-09-28 13:10:44.574 18968 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:10:44 ctl02 nova-api[18968]: 2017-09-28 13:10:44.574 18968 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:10:44 ctl02 nova-api[18968]: 2017-09-28 13:10:44.574 18968 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:10:44 ctl02 nova-api[18968]: 2017-09-28 13:10:44.574 18968 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:10:44 ctl02 nova-api[18968]: 2017-09-28 13:10:44.574 18968 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:10:44 ctl02 nova-api[18968]: 2017-09-28 13:10:44.574 18968 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:10:44 ctl02 nova-api[18968]: 2017-09-28 13:10:44.574 18968 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:10:44 ctl02 nova-api[18968]: 2017-09-28 13:10:44.574 18968 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:10:44 ctl02 nova-api[18968]: 2017-09-28 13:10:44.574 18968 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:10:44 ctl02 nova-api[18968]: 2017-09-28 13:10:44.574 18968 ERROR nova.wsgi     self.filename))
Sep 28 13:10:44 ctl02 nova-api[18968]: 2017-09-28 13:10:44.574 18968 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:10:44 ctl02 nova-api[18968]: 2017-09-28 13:10:44.574 18968 ERROR nova.wsgi
Sep 28 13:10:44 ctl02 nova-api[18968]: 2017-09-28 13:10:44.575 18968 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:10:44 ctl02 nova-api[18968]: 2017-09-28 13:10:44.704 18968 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:10:44 ctl02 nova-api[18968]: 2017-09-28 13:10:44.927 18968 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:10:44 ctl02 neutron-server[30536]: 2017-09-28 13:10:44.929 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:10:44] "OPTIONS / HTTP/1.0" 200 262 0.000604
Sep 28 13:10:44 ctl02 nova-api[18968]: 2017-09-28 13:10:44.929 18968 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:10:44 ctl02 nova-api[18968]: 2017-09-28 13:10:44.929 18968 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:10:44 ctl02 nova-api[18968]: 2017-09-28 13:10:44.930 18968 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:10:45 ctl02 nova-api[18968]: 2017-09-28 13:10:45.062 18968 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:10:45 ctl02 nova-api[18968]: 2017-09-28 13:10:45.063 18968 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:10:45 ctl02 nova-api[18968]: 2017-09-28 13:10:45.064 18968 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:10:45 ctl02 nova-api[18968]: 2017-09-28 13:10:45.064 18968 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:10:45 ctl02 nova-api[18968]: 2017-09-28 13:10:45.067 18968 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:10:45 ctl02 nova-api[18968]: 2017-09-28 13:10:45.067 18968 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:10:45 ctl02 nova-api[18968]: 2017-09-28 13:10:45.067 18968 ERROR nova Traceback (most recent call last):
Sep 28 13:10:45 ctl02 nova-api[18968]: 2017-09-28 13:10:45.067 18968 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:10:45 ctl02 nova-api[18968]: 2017-09-28 13:10:45.067 18968 ERROR nova     sys.exit(main())
Sep 28 13:10:45 ctl02 nova-api[18968]: 2017-09-28 13:10:45.067 18968 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:10:45 ctl02 nova-api[18968]: 2017-09-28 13:10:45.067 18968 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:10:45 ctl02 nova-api[18968]: 2017-09-28 13:10:45.067 18968 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:10:45 ctl02 nova-api[18968]: 2017-09-28 13:10:45.067 18968 ERROR nova     max_url_len=max_url_len)
Sep 28 13:10:45 ctl02 nova-api[18968]: 2017-09-28 13:10:45.067 18968 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:10:45 ctl02 nova-api[18968]: 2017-09-28 13:10:45.067 18968 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:10:45 ctl02 nova-api[18968]: 2017-09-28 13:10:45.067 18968 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:10:45 ctl02 nova-api[18968]: 2017-09-28 13:10:45.067 18968 ERROR nova     sock.listen(backlog)
Sep 28 13:10:45 ctl02 nova-api[18968]: 2017-09-28 13:10:45.067 18968 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:10:45 ctl02 nova-api[18968]: 2017-09-28 13:10:45.067 18968 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:10:45 ctl02 nova-api[18968]: 2017-09-28 13:10:45.067 18968 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:10:45 ctl02 nova-api[18968]: 2017-09-28 13:10:45.067 18968 ERROR nova
Sep 28 13:10:45 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:10:45 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:10:45 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:10:45 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:10:45 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:10:45 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:10:45 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:10:45 ctl02 nova-scheduler[5620]: 2017-09-28 13:10:45.505 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:10:46 ctl02 heat-api-cfn[13300]: 2017-09-28 13:10:46.243 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:10:46] "OPTIONS / HTTP/1.0" 200 134 0.000514
Sep 28 13:10:46 ctl02 heat-api-cfn[13300]: 2017-09-28 13:10:46.862 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:10:46] "OPTIONS / HTTP/1.0" 200 134 0.000533
Sep 28 13:10:47 ctl02 heat-api[13008]: 2017-09-28 13:10:47.150 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:10:47] "OPTIONS / HTTP/1.0" 200 134 0.000655
Sep 28 13:10:47 ctl02 nova-api[18986]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:10:47 ctl02 nova-api[18986]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:10:47 ctl02 heat-api[13008]: 2017-09-28 13:10:47.235 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:10:47] "OPTIONS / HTTP/1.0" 200 134 0.000560
Sep 28 13:10:47 ctl02 nova-api[18986]: 2017-09-28 13:10:47.339 18986 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:10:47 ctl02 nova-api[18986]: 2017-09-28 13:10:47.340 18986 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:10:47 ctl02 nova-api[18986]: 2017-09-28 13:10:47.340 18986 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:10:47 ctl02 nova-api[18986]: 2017-09-28 13:10:47.340 18986 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:10:47 ctl02 nova-api[18986]: 2017-09-28 13:10:47.340 18986 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:10:47 ctl02 nova-api[18986]: 2017-09-28 13:10:47.340 18986 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:10:47 ctl02 nova-api[18986]: 2017-09-28 13:10:47.340 18986 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:10:47 ctl02 nova-api[18986]: 2017-09-28 13:10:47.340 18986 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:10:47 ctl02 nova-api[18986]: 2017-09-28 13:10:47.340 18986 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:10:47 ctl02 nova-api[18986]: 2017-09-28 13:10:47.340 18986 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:10:47 ctl02 nova-api[18986]: 2017-09-28 13:10:47.340 18986 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:10:47 ctl02 nova-api[18986]: 2017-09-28 13:10:47.340 18986 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:10:47 ctl02 nova-api[18986]: 2017-09-28 13:10:47.340 18986 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:10:47 ctl02 nova-api[18986]: 2017-09-28 13:10:47.340 18986 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:10:47 ctl02 nova-api[18986]: 2017-09-28 13:10:47.340 18986 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:10:47 ctl02 nova-api[18986]: 2017-09-28 13:10:47.340 18986 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:10:47 ctl02 nova-api[18986]: 2017-09-28 13:10:47.340 18986 ERROR nova.wsgi     self.filename))
Sep 28 13:10:47 ctl02 nova-api[18986]: 2017-09-28 13:10:47.340 18986 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:10:47 ctl02 nova-api[18986]: 2017-09-28 13:10:47.340 18986 ERROR nova.wsgi
Sep 28 13:10:47 ctl02 nova-api[18986]: 2017-09-28 13:10:47.341 18986 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:10:47 ctl02 nova-api[18986]: 2017-09-28 13:10:47.464 18986 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:10:47 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:10:47.482 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:10:47] "OPTIONS / HTTP/1.0" 200 134 0.000378
Sep 28 13:10:47 ctl02 nova-api[18986]: 2017-09-28 13:10:47.684 18986 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:10:47 ctl02 nova-api[18986]: 2017-09-28 13:10:47.686 18986 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:10:47 ctl02 nova-api[18986]: 2017-09-28 13:10:47.687 18986 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:10:47 ctl02 nova-api[18986]: 2017-09-28 13:10:47.687 18986 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:10:47 ctl02 nova-api[18986]: 2017-09-28 13:10:47.814 18986 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:10:47 ctl02 nova-api[18986]: 2017-09-28 13:10:47.816 18986 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:10:47 ctl02 nova-api[18986]: 2017-09-28 13:10:47.816 18986 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:10:47 ctl02 nova-api[18986]: 2017-09-28 13:10:47.817 18986 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:10:47 ctl02 nova-api[18986]: 2017-09-28 13:10:47.820 18986 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:10:47 ctl02 nova-api[18986]: 2017-09-28 13:10:47.820 18986 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:10:47 ctl02 nova-api[18986]: 2017-09-28 13:10:47.820 18986 ERROR nova Traceback (most recent call last):
Sep 28 13:10:47 ctl02 nova-api[18986]: 2017-09-28 13:10:47.820 18986 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:10:47 ctl02 nova-api[18986]: 2017-09-28 13:10:47.820 18986 ERROR nova     sys.exit(main())
Sep 28 13:10:47 ctl02 nova-api[18986]: 2017-09-28 13:10:47.820 18986 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:10:47 ctl02 nova-api[18986]: 2017-09-28 13:10:47.820 18986 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:10:47 ctl02 nova-api[18986]: 2017-09-28 13:10:47.820 18986 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:10:47 ctl02 nova-api[18986]: 2017-09-28 13:10:47.820 18986 ERROR nova     max_url_len=max_url_len)
Sep 28 13:10:47 ctl02 nova-api[18986]: 2017-09-28 13:10:47.820 18986 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:10:47 ctl02 nova-api[18986]: 2017-09-28 13:10:47.820 18986 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:10:47 ctl02 nova-api[18986]: 2017-09-28 13:10:47.820 18986 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:10:47 ctl02 nova-api[18986]: 2017-09-28 13:10:47.820 18986 ERROR nova     sock.listen(backlog)
Sep 28 13:10:47 ctl02 nova-api[18986]: 2017-09-28 13:10:47.820 18986 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:10:47 ctl02 nova-api[18986]: 2017-09-28 13:10:47.820 18986 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:10:47 ctl02 nova-api[18986]: 2017-09-28 13:10:47.820 18986 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:10:47 ctl02 nova-api[18986]: 2017-09-28 13:10:47.820 18986 ERROR nova
Sep 28 13:10:47 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:10:47 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:10:47 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:10:48 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:10:48.168 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:10:48] "OPTIONS / HTTP/1.0" 200 134 0.000493
Sep 28 13:10:48 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:10:48 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:10:48 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:10:48 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:10:48 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x125ea61e)
Sep 28 13:10:48 ctl02 neutron-server[30536]: 2017-09-28 13:10:48.894 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:10:48] "OPTIONS / HTTP/1.0" 200 262 0.000595
Sep 28 13:10:48 ctl02 glance-api[29183]: 2017-09-28 13:10:48.961 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:10:48] "OPTIONS / HTTP/1.0" 200 134 0.000551
Sep 28 13:10:49 ctl02 nova-api[19004]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:10:49 ctl02 nova-api[19004]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:10:49 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x125ea61e)
Sep 28 13:10:50 ctl02 nova-api[19004]: 2017-09-28 13:10:50.024 19004 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:10:50 ctl02 nova-api[19004]: 2017-09-28 13:10:50.025 19004 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:10:50 ctl02 nova-api[19004]: 2017-09-28 13:10:50.025 19004 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:10:50 ctl02 nova-api[19004]: 2017-09-28 13:10:50.025 19004 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:10:50 ctl02 nova-api[19004]: 2017-09-28 13:10:50.025 19004 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:10:50 ctl02 nova-api[19004]: 2017-09-28 13:10:50.025 19004 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:10:50 ctl02 nova-api[19004]: 2017-09-28 13:10:50.025 19004 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:10:50 ctl02 nova-api[19004]: 2017-09-28 13:10:50.025 19004 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:10:50 ctl02 nova-api[19004]: 2017-09-28 13:10:50.025 19004 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:10:50 ctl02 nova-api[19004]: 2017-09-28 13:10:50.025 19004 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:10:50 ctl02 nova-api[19004]: 2017-09-28 13:10:50.025 19004 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:10:50 ctl02 nova-api[19004]: 2017-09-28 13:10:50.025 19004 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:10:50 ctl02 nova-api[19004]: 2017-09-28 13:10:50.025 19004 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:10:50 ctl02 nova-api[19004]: 2017-09-28 13:10:50.025 19004 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:10:50 ctl02 nova-api[19004]: 2017-09-28 13:10:50.025 19004 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:10:50 ctl02 nova-api[19004]: 2017-09-28 13:10:50.025 19004 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:10:50 ctl02 nova-api[19004]: 2017-09-28 13:10:50.025 19004 ERROR nova.wsgi     self.filename))
Sep 28 13:10:50 ctl02 nova-api[19004]: 2017-09-28 13:10:50.025 19004 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:10:50 ctl02 nova-api[19004]: 2017-09-28 13:10:50.025 19004 ERROR nova.wsgi
Sep 28 13:10:50 ctl02 nova-api[19004]: 2017-09-28 13:10:50.026 19004 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:10:50 ctl02 nova-api[19004]: 2017-09-28 13:10:50.150 19004 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:10:50 ctl02 nova-api[19004]: 2017-09-28 13:10:50.367 19004 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:10:50 ctl02 nova-api[19004]: 2017-09-28 13:10:50.369 19004 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:10:50 ctl02 nova-api[19004]: 2017-09-28 13:10:50.370 19004 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:10:50 ctl02 nova-api[19004]: 2017-09-28 13:10:50.370 19004 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:10:50 ctl02 nova-api[19004]: 2017-09-28 13:10:50.498 19004 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:10:50 ctl02 nova-api[19004]: 2017-09-28 13:10:50.500 19004 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:10:50 ctl02 nova-api[19004]: 2017-09-28 13:10:50.500 19004 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:10:50 ctl02 nova-api[19004]: 2017-09-28 13:10:50.500 19004 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:10:50 ctl02 nova-api[19004]: 2017-09-28 13:10:50.504 19004 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:10:50 ctl02 nova-api[19004]: 2017-09-28 13:10:50.504 19004 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:10:50 ctl02 nova-api[19004]: 2017-09-28 13:10:50.504 19004 ERROR nova Traceback (most recent call last):
Sep 28 13:10:50 ctl02 nova-api[19004]: 2017-09-28 13:10:50.504 19004 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:10:50 ctl02 nova-api[19004]: 2017-09-28 13:10:50.504 19004 ERROR nova     sys.exit(main())
Sep 28 13:10:50 ctl02 nova-api[19004]: 2017-09-28 13:10:50.504 19004 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:10:50 ctl02 nova-api[19004]: 2017-09-28 13:10:50.504 19004 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:10:50 ctl02 nova-api[19004]: 2017-09-28 13:10:50.504 19004 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:10:50 ctl02 nova-api[19004]: 2017-09-28 13:10:50.504 19004 ERROR nova     max_url_len=max_url_len)
Sep 28 13:10:50 ctl02 nova-api[19004]: 2017-09-28 13:10:50.504 19004 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:10:50 ctl02 nova-api[19004]: 2017-09-28 13:10:50.504 19004 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:10:50 ctl02 nova-api[19004]: 2017-09-28 13:10:50.504 19004 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:10:50 ctl02 nova-api[19004]: 2017-09-28 13:10:50.504 19004 ERROR nova     sock.listen(backlog)
Sep 28 13:10:50 ctl02 nova-api[19004]: 2017-09-28 13:10:50.504 19004 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:10:50 ctl02 nova-api[19004]: 2017-09-28 13:10:50.504 19004 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:10:50 ctl02 nova-api[19004]: 2017-09-28 13:10:50.504 19004 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:10:50 ctl02 nova-api[19004]: 2017-09-28 13:10:50.504 19004 ERROR nova
Sep 28 13:10:50 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:10:50 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:10:50 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:10:50 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x125ea61e)
Sep 28 13:10:50 ctl02 neutron-server[30536]: 2017-09-28 13:10:50.943 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 13:10:50 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 13:10:50 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 13:09:16 cmp002
Sep 28 13:10:50 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 13:09:08 cmp001
Sep 28 13:10:50 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 13:09:56 cmp002
Sep 28 13:10:50 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:10:50 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:10:50 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:10:50 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:10:51 ctl02 glance-api[29183]: 2017-09-28 13:10:51.013 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:10:51] "OPTIONS / HTTP/1.0" 200 134 0.000717
Sep 28 13:10:51 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x125ea61e)
Sep 28 13:10:52 ctl02 nova-api[19022]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:10:52 ctl02 nova-api[19022]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:10:52 ctl02 nova-api[19022]: 2017-09-28 13:10:52.788 19022 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:10:52 ctl02 nova-api[19022]: 2017-09-28 13:10:52.789 19022 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:10:52 ctl02 nova-api[19022]: 2017-09-28 13:10:52.789 19022 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:10:52 ctl02 nova-api[19022]: 2017-09-28 13:10:52.789 19022 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:10:52 ctl02 nova-api[19022]: 2017-09-28 13:10:52.789 19022 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:10:52 ctl02 nova-api[19022]: 2017-09-28 13:10:52.789 19022 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:10:52 ctl02 nova-api[19022]: 2017-09-28 13:10:52.789 19022 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:10:52 ctl02 nova-api[19022]: 2017-09-28 13:10:52.789 19022 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:10:52 ctl02 nova-api[19022]: 2017-09-28 13:10:52.789 19022 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:10:52 ctl02 nova-api[19022]: 2017-09-28 13:10:52.789 19022 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:10:52 ctl02 nova-api[19022]: 2017-09-28 13:10:52.789 19022 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:10:52 ctl02 nova-api[19022]: 2017-09-28 13:10:52.789 19022 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:10:52 ctl02 nova-api[19022]: 2017-09-28 13:10:52.789 19022 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:10:52 ctl02 nova-api[19022]: 2017-09-28 13:10:52.789 19022 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:10:52 ctl02 nova-api[19022]: 2017-09-28 13:10:52.789 19022 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:10:52 ctl02 nova-api[19022]: 2017-09-28 13:10:52.789 19022 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:10:52 ctl02 nova-api[19022]: 2017-09-28 13:10:52.789 19022 ERROR nova.wsgi     self.filename))
Sep 28 13:10:52 ctl02 nova-api[19022]: 2017-09-28 13:10:52.789 19022 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:10:52 ctl02 nova-api[19022]: 2017-09-28 13:10:52.789 19022 ERROR nova.wsgi
Sep 28 13:10:52 ctl02 nova-api[19022]: 2017-09-28 13:10:52.790 19022 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:10:52 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x125ea61e)
Sep 28 13:10:52 ctl02 nova-api[19022]: 2017-09-28 13:10:52.919 19022 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:10:53 ctl02 nova-api[19022]: 2017-09-28 13:10:53.142 19022 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:10:53 ctl02 nova-api[19022]: 2017-09-28 13:10:53.144 19022 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:10:53 ctl02 nova-api[19022]: 2017-09-28 13:10:53.144 19022 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:10:53 ctl02 nova-api[19022]: 2017-09-28 13:10:53.144 19022 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:10:53 ctl02 nova-api[19022]: 2017-09-28 13:10:53.275 19022 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:10:53 ctl02 nova-api[19022]: 2017-09-28 13:10:53.277 19022 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:10:53 ctl02 nova-api[19022]: 2017-09-28 13:10:53.277 19022 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:10:53 ctl02 nova-api[19022]: 2017-09-28 13:10:53.277 19022 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:10:53 ctl02 nova-api[19022]: 2017-09-28 13:10:53.280 19022 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:10:53 ctl02 nova-api[19022]: 2017-09-28 13:10:53.281 19022 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:10:53 ctl02 nova-api[19022]: 2017-09-28 13:10:53.281 19022 ERROR nova Traceback (most recent call last):
Sep 28 13:10:53 ctl02 nova-api[19022]: 2017-09-28 13:10:53.281 19022 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:10:53 ctl02 nova-api[19022]: 2017-09-28 13:10:53.281 19022 ERROR nova     sys.exit(main())
Sep 28 13:10:53 ctl02 nova-api[19022]: 2017-09-28 13:10:53.281 19022 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:10:53 ctl02 nova-api[19022]: 2017-09-28 13:10:53.281 19022 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:10:53 ctl02 nova-api[19022]: 2017-09-28 13:10:53.281 19022 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:10:53 ctl02 nova-api[19022]: 2017-09-28 13:10:53.281 19022 ERROR nova     max_url_len=max_url_len)
Sep 28 13:10:53 ctl02 nova-api[19022]: 2017-09-28 13:10:53.281 19022 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:10:53 ctl02 nova-api[19022]: 2017-09-28 13:10:53.281 19022 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:10:53 ctl02 nova-api[19022]: 2017-09-28 13:10:53.281 19022 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:10:53 ctl02 nova-api[19022]: 2017-09-28 13:10:53.281 19022 ERROR nova     sock.listen(backlog)
Sep 28 13:10:53 ctl02 nova-api[19022]: 2017-09-28 13:10:53.281 19022 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:10:53 ctl02 nova-api[19022]: 2017-09-28 13:10:53.281 19022 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:10:53 ctl02 nova-api[19022]: 2017-09-28 13:10:53.281 19022 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:10:53 ctl02 nova-api[19022]: 2017-09-28 13:10:53.281 19022 ERROR nova
Sep 28 13:10:53 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:10:53 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:10:53 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:10:53 ctl02 heat-api[13008]: 2017-09-28 13:10:53.478 13087 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:10:53] "OPTIONS / HTTP/1.0" 200 134 0.000771
Sep 28 13:10:53 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:10:53.551 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:10:53] "OPTIONS / HTTP/1.0" 200 134 0.000547
Sep 28 13:10:53 ctl02 heat-api-cfn[13300]: 2017-09-28 13:10:53.702 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:10:53] "OPTIONS / HTTP/1.0" 200 134 0.000642
Sep 28 13:10:53 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:10:53 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:10:53 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:10:53 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:10:53 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x125ea61e)
Sep 28 13:10:53 ctl02 neutron-server[30536]: 2017-09-28 13:10:53.889 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:10:53] "OPTIONS / HTTP/1.0" 200 262 0.000546
Sep 28 13:10:53 ctl02 glance-api[29183]: 2017-09-28 13:10:53.943 29256 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:10:53] "OPTIONS / HTTP/1.0" 200 134 0.000663
Sep 28 13:10:54 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x125ea61e)
Sep 28 13:10:55 ctl02 neutron-server[30536]: 2017-09-28 13:10:55.186 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:10:55] "OPTIONS / HTTP/1.0" 200 262 0.000602
Sep 28 13:10:55 ctl02 nova-api[19040]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:10:55 ctl02 nova-api[19040]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:10:55 ctl02 nova-api[19040]: 2017-09-28 13:10:55.622 19040 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:10:55 ctl02 nova-api[19040]: 2017-09-28 13:10:55.624 19040 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:10:55 ctl02 nova-api[19040]: 2017-09-28 13:10:55.624 19040 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:10:55 ctl02 nova-api[19040]: 2017-09-28 13:10:55.624 19040 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:10:55 ctl02 nova-api[19040]: 2017-09-28 13:10:55.624 19040 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:10:55 ctl02 nova-api[19040]: 2017-09-28 13:10:55.624 19040 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:10:55 ctl02 nova-api[19040]: 2017-09-28 13:10:55.624 19040 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:10:55 ctl02 nova-api[19040]: 2017-09-28 13:10:55.624 19040 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:10:55 ctl02 nova-api[19040]: 2017-09-28 13:10:55.624 19040 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:10:55 ctl02 nova-api[19040]: 2017-09-28 13:10:55.624 19040 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:10:55 ctl02 nova-api[19040]: 2017-09-28 13:10:55.624 19040 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:10:55 ctl02 nova-api[19040]: 2017-09-28 13:10:55.624 19040 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:10:55 ctl02 nova-api[19040]: 2017-09-28 13:10:55.624 19040 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:10:55 ctl02 nova-api[19040]: 2017-09-28 13:10:55.624 19040 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:10:55 ctl02 nova-api[19040]: 2017-09-28 13:10:55.624 19040 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:10:55 ctl02 nova-api[19040]: 2017-09-28 13:10:55.624 19040 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:10:55 ctl02 nova-api[19040]: 2017-09-28 13:10:55.624 19040 ERROR nova.wsgi     self.filename))
Sep 28 13:10:55 ctl02 nova-api[19040]: 2017-09-28 13:10:55.624 19040 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:10:55 ctl02 nova-api[19040]: 2017-09-28 13:10:55.624 19040 ERROR nova.wsgi
Sep 28 13:10:55 ctl02 nova-api[19040]: 2017-09-28 13:10:55.626 19040 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:10:55 ctl02 nova-api[19040]: 2017-09-28 13:10:55.759 19040 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:10:55 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x125ea61e)
Sep 28 13:10:56 ctl02 nova-api[19040]: 2017-09-28 13:10:56.008 19040 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:10:56 ctl02 nova-api[19040]: 2017-09-28 13:10:56.011 19040 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:10:56 ctl02 nova-api[19040]: 2017-09-28 13:10:56.011 19040 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:10:56 ctl02 nova-api[19040]: 2017-09-28 13:10:56.012 19040 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:10:56 ctl02 heat-api-cfn[13300]: 2017-09-28 13:10:56.043 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:10:56] "OPTIONS / HTTP/1.0" 200 134 0.000476
Sep 28 13:10:56 ctl02 nova-api[19040]: 2017-09-28 13:10:56.147 19040 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:10:56 ctl02 nova-api[19040]: 2017-09-28 13:10:56.149 19040 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:10:56 ctl02 nova-api[19040]: 2017-09-28 13:10:56.150 19040 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:10:56 ctl02 nova-api[19040]: 2017-09-28 13:10:56.150 19040 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:10:56 ctl02 nova-api[19040]: 2017-09-28 13:10:56.153 19040 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:10:56 ctl02 nova-api[19040]: 2017-09-28 13:10:56.154 19040 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:10:56 ctl02 nova-api[19040]: 2017-09-28 13:10:56.154 19040 ERROR nova Traceback (most recent call last):
Sep 28 13:10:56 ctl02 nova-api[19040]: 2017-09-28 13:10:56.154 19040 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:10:56 ctl02 nova-api[19040]: 2017-09-28 13:10:56.154 19040 ERROR nova     sys.exit(main())
Sep 28 13:10:56 ctl02 nova-api[19040]: 2017-09-28 13:10:56.154 19040 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:10:56 ctl02 nova-api[19040]: 2017-09-28 13:10:56.154 19040 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:10:56 ctl02 nova-api[19040]: 2017-09-28 13:10:56.154 19040 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:10:56 ctl02 nova-api[19040]: 2017-09-28 13:10:56.154 19040 ERROR nova     max_url_len=max_url_len)
Sep 28 13:10:56 ctl02 nova-api[19040]: 2017-09-28 13:10:56.154 19040 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:10:56 ctl02 nova-api[19040]: 2017-09-28 13:10:56.154 19040 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:10:56 ctl02 nova-api[19040]: 2017-09-28 13:10:56.154 19040 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:10:56 ctl02 nova-api[19040]: 2017-09-28 13:10:56.154 19040 ERROR nova     sock.listen(backlog)
Sep 28 13:10:56 ctl02 nova-api[19040]: 2017-09-28 13:10:56.154 19040 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:10:56 ctl02 nova-api[19040]: 2017-09-28 13:10:56.154 19040 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:10:56 ctl02 nova-api[19040]: 2017-09-28 13:10:56.154 19040 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:10:56 ctl02 nova-api[19040]: 2017-09-28 13:10:56.154 19040 ERROR nova
Sep 28 13:10:56 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:10:56 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:10:56 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:10:56 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:10:56 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:10:56 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:10:56 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:10:56 ctl02 heat-api-cfn[13300]: 2017-09-28 13:10:56.673 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:10:56] "OPTIONS / HTTP/1.0" 200 134 0.000556
Sep 28 13:10:56 ctl02 heat-api[13008]: 2017-09-28 13:10:56.870 13084 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:10:56] "OPTIONS / HTTP/1.0" 200 134 0.000581
Sep 28 13:10:56 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x125ea61e)
Sep 28 13:10:56 ctl02 heat-api[13008]: 2017-09-28 13:10:56.940 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:10:56] "OPTIONS / HTTP/1.0" 200 134 0.000381
Sep 28 13:10:57 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:10:57.287 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:10:57] "OPTIONS / HTTP/1.0" 200 134 0.000343
Sep 28 13:10:57 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x125ea61e)
Sep 28 13:10:57 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:10:57.932 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:10:57] "OPTIONS / HTTP/1.0" 200 134 0.000287
Sep 28 13:10:58 ctl02 nova-api[19058]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:10:58 ctl02 nova-api[19058]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:10:58 ctl02 nova-api[19058]: 2017-09-28 13:10:58.349 19058 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:10:58 ctl02 nova-api[19058]: 2017-09-28 13:10:58.351 19058 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:10:58 ctl02 nova-api[19058]: 2017-09-28 13:10:58.351 19058 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:10:58 ctl02 nova-api[19058]: 2017-09-28 13:10:58.351 19058 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:10:58 ctl02 nova-api[19058]: 2017-09-28 13:10:58.351 19058 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:10:58 ctl02 nova-api[19058]: 2017-09-28 13:10:58.351 19058 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:10:58 ctl02 nova-api[19058]: 2017-09-28 13:10:58.351 19058 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:10:58 ctl02 nova-api[19058]: 2017-09-28 13:10:58.351 19058 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:10:58 ctl02 nova-api[19058]: 2017-09-28 13:10:58.351 19058 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:10:58 ctl02 nova-api[19058]: 2017-09-28 13:10:58.351 19058 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:10:58 ctl02 nova-api[19058]: 2017-09-28 13:10:58.351 19058 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:10:58 ctl02 nova-api[19058]: 2017-09-28 13:10:58.351 19058 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:10:58 ctl02 nova-api[19058]: 2017-09-28 13:10:58.351 19058 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:10:58 ctl02 nova-api[19058]: 2017-09-28 13:10:58.351 19058 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:10:58 ctl02 nova-api[19058]: 2017-09-28 13:10:58.351 19058 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:10:58 ctl02 nova-api[19058]: 2017-09-28 13:10:58.351 19058 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:10:58 ctl02 nova-api[19058]: 2017-09-28 13:10:58.351 19058 ERROR nova.wsgi     self.filename))
Sep 28 13:10:58 ctl02 nova-api[19058]: 2017-09-28 13:10:58.351 19058 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:10:58 ctl02 nova-api[19058]: 2017-09-28 13:10:58.351 19058 ERROR nova.wsgi
Sep 28 13:10:58 ctl02 nova-api[19058]: 2017-09-28 13:10:58.352 19058 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:10:58 ctl02 nova-api[19058]: 2017-09-28 13:10:58.484 19058 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:10:58 ctl02 neutron-server[30536]: 2017-09-28 13:10:58.548 30536 WARNING neutron.db.agentschedulers_db [req-6b55bf3c-9213-4531-b108-66c17ffac8cb - - - - -] No DHCP agents available, skipping rescheduling
Sep 28 13:10:58 ctl02 glance-api[29183]: 2017-09-28 13:10:58.706 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:10:58] "OPTIONS / HTTP/1.0" 200 134 0.000626
Sep 28 13:10:58 ctl02 nova-api[19058]: 2017-09-28 13:10:58.732 19058 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:10:58 ctl02 nova-api[19058]: 2017-09-28 13:10:58.734 19058 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:10:58 ctl02 nova-api[19058]: 2017-09-28 13:10:58.734 19058 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:10:58 ctl02 nova-api[19058]: 2017-09-28 13:10:58.734 19058 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:10:58 ctl02 nova-api[19058]: 2017-09-28 13:10:58.866 19058 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:10:58 ctl02 nova-api[19058]: 2017-09-28 13:10:58.868 19058 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:10:58 ctl02 nova-api[19058]: 2017-09-28 13:10:58.868 19058 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:10:58 ctl02 nova-api[19058]: 2017-09-28 13:10:58.868 19058 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:10:58 ctl02 nova-api[19058]: 2017-09-28 13:10:58.871 19058 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:10:58 ctl02 nova-api[19058]: 2017-09-28 13:10:58.872 19058 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:10:58 ctl02 nova-api[19058]: 2017-09-28 13:10:58.872 19058 ERROR nova Traceback (most recent call last):
Sep 28 13:10:58 ctl02 nova-api[19058]: 2017-09-28 13:10:58.872 19058 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:10:58 ctl02 nova-api[19058]: 2017-09-28 13:10:58.872 19058 ERROR nova     sys.exit(main())
Sep 28 13:10:58 ctl02 nova-api[19058]: 2017-09-28 13:10:58.872 19058 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:10:58 ctl02 nova-api[19058]: 2017-09-28 13:10:58.872 19058 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:10:58 ctl02 nova-api[19058]: 2017-09-28 13:10:58.872 19058 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:10:58 ctl02 nova-api[19058]: 2017-09-28 13:10:58.872 19058 ERROR nova     max_url_len=max_url_len)
Sep 28 13:10:58 ctl02 nova-api[19058]: 2017-09-28 13:10:58.872 19058 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:10:58 ctl02 nova-api[19058]: 2017-09-28 13:10:58.872 19058 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:10:58 ctl02 nova-api[19058]: 2017-09-28 13:10:58.872 19058 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:10:58 ctl02 nova-api[19058]: 2017-09-28 13:10:58.872 19058 ERROR nova     sock.listen(backlog)
Sep 28 13:10:58 ctl02 nova-api[19058]: 2017-09-28 13:10:58.872 19058 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:10:58 ctl02 nova-api[19058]: 2017-09-28 13:10:58.872 19058 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:10:58 ctl02 nova-api[19058]: 2017-09-28 13:10:58.872 19058 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:10:58 ctl02 nova-api[19058]: 2017-09-28 13:10:58.872 19058 ERROR nova
Sep 28 13:10:58 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x125ea61e)
Sep 28 13:10:58 ctl02 neutron-server[30536]: 2017-09-28 13:10:58.998 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:10:58] "OPTIONS / HTTP/1.0" 200 262 0.000554
Sep 28 13:10:59 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:10:59 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:10:59 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:10:59 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:10:59 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:10:59 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:10:59 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:10:59 ctl02 dhclient[627]: No DHCPOFFERS received.
Sep 28 13:10:59 ctl02 dhclient[627]: No working leases in persistent database - sleeping.
Sep 28 13:11:00 ctl02 glance-api[29183]: 2017-09-28 13:11:00.743 29256 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:11:00] "OPTIONS / HTTP/1.0" 200 134 0.000956
Sep 28 13:11:00 ctl02 nova-api[19076]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:11:00 ctl02 nova-api[19076]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:11:01 ctl02 nova-api[19076]: 2017-09-28 13:11:01.102 19076 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:11:01 ctl02 nova-api[19076]: 2017-09-28 13:11:01.103 19076 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:11:01 ctl02 nova-api[19076]: 2017-09-28 13:11:01.103 19076 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:11:01 ctl02 nova-api[19076]: 2017-09-28 13:11:01.103 19076 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:11:01 ctl02 nova-api[19076]: 2017-09-28 13:11:01.103 19076 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:11:01 ctl02 nova-api[19076]: 2017-09-28 13:11:01.103 19076 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:11:01 ctl02 nova-api[19076]: 2017-09-28 13:11:01.103 19076 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:11:01 ctl02 nova-api[19076]: 2017-09-28 13:11:01.103 19076 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:11:01 ctl02 nova-api[19076]: 2017-09-28 13:11:01.103 19076 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:11:01 ctl02 nova-api[19076]: 2017-09-28 13:11:01.103 19076 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:11:01 ctl02 nova-api[19076]: 2017-09-28 13:11:01.103 19076 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:11:01 ctl02 nova-api[19076]: 2017-09-28 13:11:01.103 19076 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:11:01 ctl02 nova-api[19076]: 2017-09-28 13:11:01.103 19076 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:11:01 ctl02 nova-api[19076]: 2017-09-28 13:11:01.103 19076 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:11:01 ctl02 nova-api[19076]: 2017-09-28 13:11:01.103 19076 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:11:01 ctl02 nova-api[19076]: 2017-09-28 13:11:01.103 19076 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:11:01 ctl02 nova-api[19076]: 2017-09-28 13:11:01.103 19076 ERROR nova.wsgi     self.filename))
Sep 28 13:11:01 ctl02 nova-api[19076]: 2017-09-28 13:11:01.103 19076 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:11:01 ctl02 nova-api[19076]: 2017-09-28 13:11:01.103 19076 ERROR nova.wsgi
Sep 28 13:11:01 ctl02 nova-api[19076]: 2017-09-28 13:11:01.104 19076 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:11:01 ctl02 nova-api[19076]: 2017-09-28 13:11:01.233 19076 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:11:01 ctl02 nova-api[19076]: 2017-09-28 13:11:01.480 19076 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:11:01 ctl02 nova-api[19076]: 2017-09-28 13:11:01.482 19076 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:11:01 ctl02 nova-api[19076]: 2017-09-28 13:11:01.482 19076 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:11:01 ctl02 nova-api[19076]: 2017-09-28 13:11:01.483 19076 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:11:01 ctl02 nova-api[19076]: 2017-09-28 13:11:01.615 19076 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:11:01 ctl02 nova-api[19076]: 2017-09-28 13:11:01.617 19076 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:11:01 ctl02 nova-api[19076]: 2017-09-28 13:11:01.618 19076 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:11:01 ctl02 nova-api[19076]: 2017-09-28 13:11:01.618 19076 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:11:01 ctl02 nova-api[19076]: 2017-09-28 13:11:01.621 19076 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:11:01 ctl02 nova-api[19076]: 2017-09-28 13:11:01.622 19076 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:11:01 ctl02 nova-api[19076]: 2017-09-28 13:11:01.622 19076 ERROR nova Traceback (most recent call last):
Sep 28 13:11:01 ctl02 nova-api[19076]: 2017-09-28 13:11:01.622 19076 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:11:01 ctl02 nova-api[19076]: 2017-09-28 13:11:01.622 19076 ERROR nova     sys.exit(main())
Sep 28 13:11:01 ctl02 nova-api[19076]: 2017-09-28 13:11:01.622 19076 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:11:01 ctl02 nova-api[19076]: 2017-09-28 13:11:01.622 19076 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:11:01 ctl02 nova-api[19076]: 2017-09-28 13:11:01.622 19076 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:11:01 ctl02 nova-api[19076]: 2017-09-28 13:11:01.622 19076 ERROR nova     max_url_len=max_url_len)
Sep 28 13:11:01 ctl02 nova-api[19076]: 2017-09-28 13:11:01.622 19076 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:11:01 ctl02 nova-api[19076]: 2017-09-28 13:11:01.622 19076 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:11:01 ctl02 nova-api[19076]: 2017-09-28 13:11:01.622 19076 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:11:01 ctl02 nova-api[19076]: 2017-09-28 13:11:01.622 19076 ERROR nova     sock.listen(backlog)
Sep 28 13:11:01 ctl02 nova-api[19076]: 2017-09-28 13:11:01.622 19076 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:11:01 ctl02 nova-api[19076]: 2017-09-28 13:11:01.622 19076 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:11:01 ctl02 nova-api[19076]: 2017-09-28 13:11:01.622 19076 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:11:01 ctl02 nova-api[19076]: 2017-09-28 13:11:01.622 19076 ERROR nova
Sep 28 13:11:01 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:11:01 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:11:01 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:11:01 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:11:01 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:11:01 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:11:01 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:11:03 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:11:03.263 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:11:03] "OPTIONS / HTTP/1.0" 200 134 0.000418
Sep 28 13:11:03 ctl02 nova-conductor[5056]: 2017-09-28 13:11:03.448 5213 ERROR oslo.messaging._drivers.impl_rabbit [req-63de7aa2-123a-49d1-8b72-f4795475e071 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:11:03 ctl02 nova-conductor[5056]: 2017-09-28 13:11:03.449 5215 ERROR oslo.messaging._drivers.impl_rabbit [req-01d87a2a-c2fa-47d4-81ac-3cefa50d1721 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:11:03 ctl02 nova-conductor[5056]: 2017-09-28 13:11:03.455 5212 ERROR oslo.messaging._drivers.impl_rabbit [req-d46055e3-1f55-403a-b08d-c427a1454df1 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:11:03 ctl02 nova-conductor[5056]: 2017-09-28 13:11:03.461 5214 ERROR oslo.messaging._drivers.impl_rabbit [req-2e7e5186-9c35-4a20-a8e9-80ba3c35424e - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:11:03 ctl02 nova-api[19098]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:11:03 ctl02 nova-api[19098]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:11:03 ctl02 neutron-server[30536]: 2017-09-28 13:11:03.807 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:11:03] "OPTIONS / HTTP/1.0" 200 262 0.000499
Sep 28 13:11:03 ctl02 nova-api[19098]: 2017-09-28 13:11:03.813 19098 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:11:03 ctl02 nova-api[19098]: 2017-09-28 13:11:03.815 19098 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:11:03 ctl02 nova-api[19098]: 2017-09-28 13:11:03.815 19098 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:11:03 ctl02 nova-api[19098]: 2017-09-28 13:11:03.815 19098 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:11:03 ctl02 nova-api[19098]: 2017-09-28 13:11:03.815 19098 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:11:03 ctl02 nova-api[19098]: 2017-09-28 13:11:03.815 19098 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:11:03 ctl02 nova-api[19098]: 2017-09-28 13:11:03.815 19098 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:11:03 ctl02 nova-api[19098]: 2017-09-28 13:11:03.815 19098 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:11:03 ctl02 nova-api[19098]: 2017-09-28 13:11:03.815 19098 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:11:03 ctl02 nova-api[19098]: 2017-09-28 13:11:03.815 19098 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:11:03 ctl02 nova-api[19098]: 2017-09-28 13:11:03.815 19098 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:11:03 ctl02 nova-api[19098]: 2017-09-28 13:11:03.815 19098 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:11:03 ctl02 nova-api[19098]: 2017-09-28 13:11:03.815 19098 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:11:03 ctl02 nova-api[19098]: 2017-09-28 13:11:03.815 19098 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:11:03 ctl02 nova-api[19098]: 2017-09-28 13:11:03.815 19098 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:11:03 ctl02 nova-api[19098]: 2017-09-28 13:11:03.815 19098 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:11:03 ctl02 nova-api[19098]: 2017-09-28 13:11:03.815 19098 ERROR nova.wsgi     self.filename))
Sep 28 13:11:03 ctl02 nova-api[19098]: 2017-09-28 13:11:03.815 19098 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:11:03 ctl02 nova-api[19098]: 2017-09-28 13:11:03.815 19098 ERROR nova.wsgi
Sep 28 13:11:03 ctl02 nova-api[19098]: 2017-09-28 13:11:03.817 19098 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:11:03 ctl02 heat-api[13008]: 2017-09-28 13:11:03.835 13086 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:11:03] "OPTIONS / HTTP/1.0" 200 134 0.000588
Sep 28 13:11:03 ctl02 nova-api[19098]: 2017-09-28 13:11:03.942 19098 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:11:04 ctl02 glance-api[29183]: 2017-09-28 13:11:04.037 29253 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:11:04] "OPTIONS / HTTP/1.0" 200 134 0.000604
Sep 28 13:11:04 ctl02 heat-api-cfn[13300]: 2017-09-28 13:11:04.060 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:11:04] "OPTIONS / HTTP/1.0" 200 134 0.000473
Sep 28 13:11:04 ctl02 nova-api[19098]: 2017-09-28 13:11:04.171 19098 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:11:04 ctl02 nova-api[19098]: 2017-09-28 13:11:04.173 19098 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:11:04 ctl02 nova-api[19098]: 2017-09-28 13:11:04.173 19098 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:11:04 ctl02 nova-api[19098]: 2017-09-28 13:11:04.174 19098 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:11:04 ctl02 nova-api[19098]: 2017-09-28 13:11:04.305 19098 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:11:04 ctl02 nova-api[19098]: 2017-09-28 13:11:04.307 19098 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:11:04 ctl02 nova-api[19098]: 2017-09-28 13:11:04.307 19098 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:11:04 ctl02 nova-api[19098]: 2017-09-28 13:11:04.307 19098 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:11:04 ctl02 nova-api[19098]: 2017-09-28 13:11:04.311 19098 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:11:04 ctl02 nova-api[19098]: 2017-09-28 13:11:04.311 19098 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:11:04 ctl02 nova-api[19098]: 2017-09-28 13:11:04.311 19098 ERROR nova Traceback (most recent call last):
Sep 28 13:11:04 ctl02 nova-api[19098]: 2017-09-28 13:11:04.311 19098 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:11:04 ctl02 nova-api[19098]: 2017-09-28 13:11:04.311 19098 ERROR nova     sys.exit(main())
Sep 28 13:11:04 ctl02 nova-api[19098]: 2017-09-28 13:11:04.311 19098 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:11:04 ctl02 nova-api[19098]: 2017-09-28 13:11:04.311 19098 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:11:04 ctl02 nova-api[19098]: 2017-09-28 13:11:04.311 19098 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:11:04 ctl02 nova-api[19098]: 2017-09-28 13:11:04.311 19098 ERROR nova     max_url_len=max_url_len)
Sep 28 13:11:04 ctl02 nova-api[19098]: 2017-09-28 13:11:04.311 19098 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:11:04 ctl02 nova-api[19098]: 2017-09-28 13:11:04.311 19098 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:11:04 ctl02 nova-api[19098]: 2017-09-28 13:11:04.311 19098 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:11:04 ctl02 nova-api[19098]: 2017-09-28 13:11:04.311 19098 ERROR nova     sock.listen(backlog)
Sep 28 13:11:04 ctl02 nova-api[19098]: 2017-09-28 13:11:04.311 19098 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:11:04 ctl02 nova-api[19098]: 2017-09-28 13:11:04.311 19098 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:11:04 ctl02 nova-api[19098]: 2017-09-28 13:11:04.311 19098 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:11:04 ctl02 nova-api[19098]: 2017-09-28 13:11:04.311 19098 ERROR nova
Sep 28 13:11:04 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:11:04 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:11:04 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:11:04 ctl02 nova-cert[4860]: 2017-09-28 13:11:04.568 4860 ERROR oslo.messaging._drivers.impl_rabbit [req-a1a4c305-601e-4005-9c48-b7f6b7c26c5f - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:11:04 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:11:04 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:11:04 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:11:04 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:11:05 ctl02 neutron-server[30536]: 2017-09-28 13:11:05.158 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:11:05] "OPTIONS / HTTP/1.0" 200 262 0.000534
Sep 28 13:11:05 ctl02 heat-api-cfn[13300]: 2017-09-28 13:11:05.821 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:11:05] "OPTIONS / HTTP/1.0" 200 134 0.000566
Sep 28 13:11:05 ctl02 neutron-server[30536]: 2017-09-28 13:11:05.940 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 3 dead agents out of 6:
Sep 28 13:11:05 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 13:11:05 ctl02 neutron-server[30536]:   Open vSwitch agent  2017-09-28 13:09:16 cmp002
Sep 28 13:11:05 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 13:09:08 cmp001
Sep 28 13:11:05 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 13:09:56 cmp002
Sep 28 13:11:06 ctl02 nova-api[19118]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:11:06 ctl02 nova-api[19118]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:11:06 ctl02 nova-api[19118]: 2017-09-28 13:11:06.529 19118 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:11:06 ctl02 nova-api[19118]: 2017-09-28 13:11:06.530 19118 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:11:06 ctl02 nova-api[19118]: 2017-09-28 13:11:06.530 19118 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:11:06 ctl02 nova-api[19118]: 2017-09-28 13:11:06.530 19118 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:11:06 ctl02 nova-api[19118]: 2017-09-28 13:11:06.530 19118 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:11:06 ctl02 nova-api[19118]: 2017-09-28 13:11:06.530 19118 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:11:06 ctl02 nova-api[19118]: 2017-09-28 13:11:06.530 19118 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:11:06 ctl02 nova-api[19118]: 2017-09-28 13:11:06.530 19118 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:11:06 ctl02 nova-api[19118]: 2017-09-28 13:11:06.530 19118 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:11:06 ctl02 nova-api[19118]: 2017-09-28 13:11:06.530 19118 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:11:06 ctl02 nova-api[19118]: 2017-09-28 13:11:06.530 19118 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:11:06 ctl02 nova-api[19118]: 2017-09-28 13:11:06.530 19118 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:11:06 ctl02 nova-api[19118]: 2017-09-28 13:11:06.530 19118 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:11:06 ctl02 nova-api[19118]: 2017-09-28 13:11:06.530 19118 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:11:06 ctl02 nova-api[19118]: 2017-09-28 13:11:06.530 19118 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:11:06 ctl02 nova-api[19118]: 2017-09-28 13:11:06.530 19118 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:11:06 ctl02 nova-api[19118]: 2017-09-28 13:11:06.530 19118 ERROR nova.wsgi     self.filename))
Sep 28 13:11:06 ctl02 nova-api[19118]: 2017-09-28 13:11:06.530 19118 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:11:06 ctl02 nova-api[19118]: 2017-09-28 13:11:06.530 19118 ERROR nova.wsgi
Sep 28 13:11:06 ctl02 nova-api[19118]: 2017-09-28 13:11:06.531 19118 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:11:06 ctl02 nova-api[19118]: 2017-09-28 13:11:06.657 19118 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:11:06 ctl02 heat-api[13008]: 2017-09-28 13:11:06.726 13086 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:11:06] "OPTIONS / HTTP/1.0" 200 134 0.000707
Sep 28 13:11:06 ctl02 heat-api-cfn[13300]: 2017-09-28 13:11:06.872 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:11:06] "OPTIONS / HTTP/1.0" 200 134 0.000642
Sep 28 13:11:06 ctl02 nova-api[19118]: 2017-09-28 13:11:06.876 19118 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:11:06 ctl02 nova-api[19118]: 2017-09-28 13:11:06.878 19118 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:11:06 ctl02 nova-api[19118]: 2017-09-28 13:11:06.878 19118 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:11:06 ctl02 nova-api[19118]: 2017-09-28 13:11:06.878 19118 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:11:07 ctl02 nova-api[19118]: 2017-09-28 13:11:07.006 19118 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:11:07 ctl02 nova-api[19118]: 2017-09-28 13:11:07.007 19118 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:11:07 ctl02 nova-api[19118]: 2017-09-28 13:11:07.008 19118 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:11:07 ctl02 nova-api[19118]: 2017-09-28 13:11:07.008 19118 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:11:07 ctl02 nova-api[19118]: 2017-09-28 13:11:07.011 19118 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:11:07 ctl02 nova-api[19118]: 2017-09-28 13:11:07.011 19118 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:11:07 ctl02 nova-api[19118]: 2017-09-28 13:11:07.011 19118 ERROR nova Traceback (most recent call last):
Sep 28 13:11:07 ctl02 nova-api[19118]: 2017-09-28 13:11:07.011 19118 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:11:07 ctl02 nova-api[19118]: 2017-09-28 13:11:07.011 19118 ERROR nova     sys.exit(main())
Sep 28 13:11:07 ctl02 nova-api[19118]: 2017-09-28 13:11:07.011 19118 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:11:07 ctl02 nova-api[19118]: 2017-09-28 13:11:07.011 19118 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:11:07 ctl02 nova-api[19118]: 2017-09-28 13:11:07.011 19118 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:11:07 ctl02 nova-api[19118]: 2017-09-28 13:11:07.011 19118 ERROR nova     max_url_len=max_url_len)
Sep 28 13:11:07 ctl02 nova-api[19118]: 2017-09-28 13:11:07.011 19118 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:11:07 ctl02 nova-api[19118]: 2017-09-28 13:11:07.011 19118 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:11:07 ctl02 nova-api[19118]: 2017-09-28 13:11:07.011 19118 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:11:07 ctl02 nova-api[19118]: 2017-09-28 13:11:07.011 19118 ERROR nova     sock.listen(backlog)
Sep 28 13:11:07 ctl02 nova-api[19118]: 2017-09-28 13:11:07.011 19118 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:11:07 ctl02 nova-api[19118]: 2017-09-28 13:11:07.011 19118 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:11:07 ctl02 nova-api[19118]: 2017-09-28 13:11:07.011 19118 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:11:07 ctl02 nova-api[19118]: 2017-09-28 13:11:07.011 19118 ERROR nova
Sep 28 13:11:07 ctl02 heat-api[13008]: 2017-09-28 13:11:07.077 13085 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:11:07] "OPTIONS / HTTP/1.0" 200 134 0.000684
Sep 28 13:11:07 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:11:07 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:11:07 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:11:07 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:11:07 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:11:07 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:11:07 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:11:07 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:11:07.509 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:11:07] "OPTIONS / HTTP/1.0" 200 134 0.000522
Sep 28 13:11:08 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:11:08.023 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:11:08] "OPTIONS / HTTP/1.0" 200 134 0.000403
Sep 28 13:11:08 ctl02 glance-api[29183]: 2017-09-28 13:11:08.449 29254 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:11:08] "OPTIONS / HTTP/1.0" 200 134 0.000583
Sep 28 13:11:08 ctl02 neutron-server[30536]: 2017-09-28 13:11:08.601 30597 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:11:08] "OPTIONS / HTTP/1.0" 200 262 0.000456
Sep 28 13:11:09 ctl02 nova-api[19136]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:11:09 ctl02 nova-api[19136]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:11:09 ctl02 nova-api[19136]: 2017-09-28 13:11:09.301 19136 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:11:09 ctl02 nova-api[19136]: 2017-09-28 13:11:09.302 19136 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:11:09 ctl02 nova-api[19136]: 2017-09-28 13:11:09.302 19136 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:11:09 ctl02 nova-api[19136]: 2017-09-28 13:11:09.302 19136 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:11:09 ctl02 nova-api[19136]: 2017-09-28 13:11:09.302 19136 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:11:09 ctl02 nova-api[19136]: 2017-09-28 13:11:09.302 19136 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:11:09 ctl02 nova-api[19136]: 2017-09-28 13:11:09.302 19136 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:11:09 ctl02 nova-api[19136]: 2017-09-28 13:11:09.302 19136 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:11:09 ctl02 nova-api[19136]: 2017-09-28 13:11:09.302 19136 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:11:09 ctl02 nova-api[19136]: 2017-09-28 13:11:09.302 19136 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:11:09 ctl02 nova-api[19136]: 2017-09-28 13:11:09.302 19136 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:11:09 ctl02 nova-api[19136]: 2017-09-28 13:11:09.302 19136 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:11:09 ctl02 nova-api[19136]: 2017-09-28 13:11:09.302 19136 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:11:09 ctl02 nova-api[19136]: 2017-09-28 13:11:09.302 19136 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:11:09 ctl02 nova-api[19136]: 2017-09-28 13:11:09.302 19136 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:11:09 ctl02 nova-api[19136]: 2017-09-28 13:11:09.302 19136 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:11:09 ctl02 nova-api[19136]: 2017-09-28 13:11:09.302 19136 ERROR nova.wsgi     self.filename))
Sep 28 13:11:09 ctl02 nova-api[19136]: 2017-09-28 13:11:09.302 19136 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:11:09 ctl02 nova-api[19136]: 2017-09-28 13:11:09.302 19136 ERROR nova.wsgi
Sep 28 13:11:09 ctl02 nova-api[19136]: 2017-09-28 13:11:09.304 19136 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:11:09 ctl02 nova-api[19136]: 2017-09-28 13:11:09.431 19136 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:11:09 ctl02 nova-api[19136]: 2017-09-28 13:11:09.655 19136 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:11:09 ctl02 nova-api[19136]: 2017-09-28 13:11:09.657 19136 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:11:09 ctl02 nova-api[19136]: 2017-09-28 13:11:09.658 19136 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:11:09 ctl02 nova-api[19136]: 2017-09-28 13:11:09.658 19136 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:11:09 ctl02 nova-api[19136]: 2017-09-28 13:11:09.789 19136 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:11:09 ctl02 nova-api[19136]: 2017-09-28 13:11:09.791 19136 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:11:09 ctl02 nova-api[19136]: 2017-09-28 13:11:09.791 19136 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:11:09 ctl02 nova-api[19136]: 2017-09-28 13:11:09.792 19136 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:11:09 ctl02 nova-api[19136]: 2017-09-28 13:11:09.795 19136 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:11:09 ctl02 nova-api[19136]: 2017-09-28 13:11:09.795 19136 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:11:09 ctl02 nova-api[19136]: 2017-09-28 13:11:09.795 19136 ERROR nova Traceback (most recent call last):
Sep 28 13:11:09 ctl02 nova-api[19136]: 2017-09-28 13:11:09.795 19136 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:11:09 ctl02 nova-api[19136]: 2017-09-28 13:11:09.795 19136 ERROR nova     sys.exit(main())
Sep 28 13:11:09 ctl02 nova-api[19136]: 2017-09-28 13:11:09.795 19136 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:11:09 ctl02 nova-api[19136]: 2017-09-28 13:11:09.795 19136 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:11:09 ctl02 nova-api[19136]: 2017-09-28 13:11:09.795 19136 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:11:09 ctl02 nova-api[19136]: 2017-09-28 13:11:09.795 19136 ERROR nova     max_url_len=max_url_len)
Sep 28 13:11:09 ctl02 nova-api[19136]: 2017-09-28 13:11:09.795 19136 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:11:09 ctl02 nova-api[19136]: 2017-09-28 13:11:09.795 19136 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:11:09 ctl02 nova-api[19136]: 2017-09-28 13:11:09.795 19136 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:11:09 ctl02 nova-api[19136]: 2017-09-28 13:11:09.795 19136 ERROR nova     sock.listen(backlog)
Sep 28 13:11:09 ctl02 nova-api[19136]: 2017-09-28 13:11:09.795 19136 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:11:09 ctl02 nova-api[19136]: 2017-09-28 13:11:09.795 19136 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:11:09 ctl02 nova-api[19136]: 2017-09-28 13:11:09.795 19136 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:11:09 ctl02 nova-api[19136]: 2017-09-28 13:11:09.795 19136 ERROR nova
Sep 28 13:11:09 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:11:09 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:11:09 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:11:10 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:11:10 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:11:10 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:11:10 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:11:10 ctl02 glance-api[29183]: 2017-09-28 13:11:10.705 29253 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:11:10] "OPTIONS / HTTP/1.0" 200 134 0.000919
Sep 28 13:11:11 ctl02 nova-api[19155]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:11:11 ctl02 nova-api[19155]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:11:12 ctl02 nova-api[19155]: 2017-09-28 13:11:12.078 19155 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:11:12 ctl02 nova-api[19155]: 2017-09-28 13:11:12.079 19155 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:11:12 ctl02 nova-api[19155]: 2017-09-28 13:11:12.079 19155 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:11:12 ctl02 nova-api[19155]: 2017-09-28 13:11:12.079 19155 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:11:12 ctl02 nova-api[19155]: 2017-09-28 13:11:12.079 19155 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:11:12 ctl02 nova-api[19155]: 2017-09-28 13:11:12.079 19155 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:11:12 ctl02 nova-api[19155]: 2017-09-28 13:11:12.079 19155 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:11:12 ctl02 nova-api[19155]: 2017-09-28 13:11:12.079 19155 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:11:12 ctl02 nova-api[19155]: 2017-09-28 13:11:12.079 19155 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:11:12 ctl02 nova-api[19155]: 2017-09-28 13:11:12.079 19155 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:11:12 ctl02 nova-api[19155]: 2017-09-28 13:11:12.079 19155 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:11:12 ctl02 nova-api[19155]: 2017-09-28 13:11:12.079 19155 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:11:12 ctl02 nova-api[19155]: 2017-09-28 13:11:12.079 19155 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:11:12 ctl02 nova-api[19155]: 2017-09-28 13:11:12.079 19155 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:11:12 ctl02 nova-api[19155]: 2017-09-28 13:11:12.079 19155 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:11:12 ctl02 nova-api[19155]: 2017-09-28 13:11:12.079 19155 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:11:12 ctl02 nova-api[19155]: 2017-09-28 13:11:12.079 19155 ERROR nova.wsgi     self.filename))
Sep 28 13:11:12 ctl02 nova-api[19155]: 2017-09-28 13:11:12.079 19155 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:11:12 ctl02 nova-api[19155]: 2017-09-28 13:11:12.079 19155 ERROR nova.wsgi
Sep 28 13:11:12 ctl02 nova-api[19155]: 2017-09-28 13:11:12.082 19155 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:11:12 ctl02 nova-api[19155]: 2017-09-28 13:11:12.213 19155 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:11:12 ctl02 nova-api[19155]: 2017-09-28 13:11:12.446 19155 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:11:12 ctl02 nova-api[19155]: 2017-09-28 13:11:12.449 19155 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:11:12 ctl02 nova-api[19155]: 2017-09-28 13:11:12.449 19155 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:11:12 ctl02 nova-api[19155]: 2017-09-28 13:11:12.450 19155 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:11:12 ctl02 nova-api[19155]: 2017-09-28 13:11:12.584 19155 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:11:12 ctl02 nova-api[19155]: 2017-09-28 13:11:12.587 19155 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:11:12 ctl02 nova-api[19155]: 2017-09-28 13:11:12.587 19155 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:11:12 ctl02 nova-api[19155]: 2017-09-28 13:11:12.588 19155 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:11:12 ctl02 nova-api[19155]: 2017-09-28 13:11:12.591 19155 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:11:12 ctl02 nova-api[19155]: 2017-09-28 13:11:12.591 19155 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:11:12 ctl02 nova-api[19155]: 2017-09-28 13:11:12.591 19155 ERROR nova Traceback (most recent call last):
Sep 28 13:11:12 ctl02 nova-api[19155]: 2017-09-28 13:11:12.591 19155 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:11:12 ctl02 nova-api[19155]: 2017-09-28 13:11:12.591 19155 ERROR nova     sys.exit(main())
Sep 28 13:11:12 ctl02 nova-api[19155]: 2017-09-28 13:11:12.591 19155 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:11:12 ctl02 nova-api[19155]: 2017-09-28 13:11:12.591 19155 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:11:12 ctl02 nova-api[19155]: 2017-09-28 13:11:12.591 19155 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:11:12 ctl02 nova-api[19155]: 2017-09-28 13:11:12.591 19155 ERROR nova     max_url_len=max_url_len)
Sep 28 13:11:12 ctl02 nova-api[19155]: 2017-09-28 13:11:12.591 19155 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:11:12 ctl02 nova-api[19155]: 2017-09-28 13:11:12.591 19155 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:11:12 ctl02 nova-api[19155]: 2017-09-28 13:11:12.591 19155 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:11:12 ctl02 nova-api[19155]: 2017-09-28 13:11:12.591 19155 ERROR nova     sock.listen(backlog)
Sep 28 13:11:12 ctl02 nova-api[19155]: 2017-09-28 13:11:12.591 19155 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:11:12 ctl02 nova-api[19155]: 2017-09-28 13:11:12.591 19155 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:11:12 ctl02 nova-api[19155]: 2017-09-28 13:11:12.591 19155 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:11:12 ctl02 nova-api[19155]: 2017-09-28 13:11:12.591 19155 ERROR nova
Sep 28 13:11:12 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:11:12 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:11:12 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:11:12 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:11:12 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:11:12 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:11:12 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:11:13 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:11:13.025 13265 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:11:13] "OPTIONS / HTTP/1.0" 200 134 0.000407
Sep 28 13:11:13 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4c052522)
Sep 28 13:11:13 ctl02 glance-api[29183]: 2017-09-28 13:11:13.688 29258 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:11:13] "OPTIONS / HTTP/1.0" 200 134 0.000686
Sep 28 13:11:13 ctl02 heat-api-cfn[13300]: 2017-09-28 13:11:13.830 13300 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:11:13] "OPTIONS / HTTP/1.0" 200 134 0.000542
Sep 28 13:11:13 ctl02 heat-api[13008]: 2017-09-28 13:11:13.957 13084 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:11:13] "OPTIONS / HTTP/1.0" 200 134 0.000594
Sep 28 13:11:14 ctl02 neutron-server[30536]: 2017-09-28 13:11:14.105 30596 INFO neutron.wsgi [-] 10.167.4.12 - - [28/Sep/2017 13:11:14] "OPTIONS / HTTP/1.0" 200 262 0.000538
Sep 28 13:11:14 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4c052522)
Sep 28 13:11:14 ctl02 nova-consoleauth[5433]: 2017-09-28 13:11:14.426 5433 ERROR oslo.messaging._drivers.impl_rabbit [req-be33a116-88af-441a-87a8-f9c414f0417c - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:11:14 ctl02 heat-engine[12803]: 2017-09-28 13:11:14.563 12876 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:11:14 ctl02 heat-engine[12803]: 2017-09-28 13:11:14.580 12878 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:11:14 ctl02 heat-engine[12803]: 2017-09-28 13:11:14.589 12875 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:11:14 ctl02 heat-engine[12803]: 2017-09-28 13:11:14.592 12877 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:11:14 ctl02 nova-api[19173]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:11:14 ctl02 nova-api[19173]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:11:14 ctl02 nova-api[19173]: 2017-09-28 13:11:14.831 19173 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:11:14 ctl02 nova-api[19173]: 2017-09-28 13:11:14.833 19173 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:11:14 ctl02 nova-api[19173]: 2017-09-28 13:11:14.833 19173 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:11:14 ctl02 nova-api[19173]: 2017-09-28 13:11:14.833 19173 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:11:14 ctl02 nova-api[19173]: 2017-09-28 13:11:14.833 19173 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:11:14 ctl02 nova-api[19173]: 2017-09-28 13:11:14.833 19173 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:11:14 ctl02 nova-api[19173]: 2017-09-28 13:11:14.833 19173 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:11:14 ctl02 nova-api[19173]: 2017-09-28 13:11:14.833 19173 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:11:14 ctl02 nova-api[19173]: 2017-09-28 13:11:14.833 19173 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:11:14 ctl02 nova-api[19173]: 2017-09-28 13:11:14.833 19173 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:11:14 ctl02 nova-api[19173]: 2017-09-28 13:11:14.833 19173 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:11:14 ctl02 nova-api[19173]: 2017-09-28 13:11:14.833 19173 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:11:14 ctl02 nova-api[19173]: 2017-09-28 13:11:14.833 19173 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:11:14 ctl02 nova-api[19173]: 2017-09-28 13:11:14.833 19173 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:11:14 ctl02 nova-api[19173]: 2017-09-28 13:11:14.833 19173 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:11:14 ctl02 nova-api[19173]: 2017-09-28 13:11:14.833 19173 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:11:14 ctl02 nova-api[19173]: 2017-09-28 13:11:14.833 19173 ERROR nova.wsgi     self.filename))
Sep 28 13:11:14 ctl02 nova-api[19173]: 2017-09-28 13:11:14.833 19173 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:11:14 ctl02 nova-api[19173]: 2017-09-28 13:11:14.833 19173 ERROR nova.wsgi
Sep 28 13:11:14 ctl02 nova-api[19173]: 2017-09-28 13:11:14.834 19173 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:11:14 ctl02 neutron-server[30536]: 2017-09-28 13:11:14.860 30597 INFO neutron.wsgi [-] 10.167.4.13 - - [28/Sep/2017 13:11:14] "OPTIONS / HTTP/1.0" 200 262 0.000425
Sep 28 13:11:14 ctl02 nova-api[19173]: 2017-09-28 13:11:14.961 19173 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:11:15 ctl02 nova-api[19173]: 2017-09-28 13:11:15.181 19173 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:11:15 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4c052522)
Sep 28 13:11:15 ctl02 nova-api[19173]: 2017-09-28 13:11:15.183 19173 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:11:15 ctl02 nova-api[19173]: 2017-09-28 13:11:15.183 19173 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:11:15 ctl02 nova-api[19173]: 2017-09-28 13:11:15.183 19173 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:11:15 ctl02 nova-api[19173]: 2017-09-28 13:11:15.316 19173 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:11:15 ctl02 nova-api[19173]: 2017-09-28 13:11:15.318 19173 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:11:15 ctl02 nova-api[19173]: 2017-09-28 13:11:15.318 19173 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:11:15 ctl02 nova-api[19173]: 2017-09-28 13:11:15.318 19173 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:11:15 ctl02 nova-api[19173]: 2017-09-28 13:11:15.321 19173 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:11:15 ctl02 nova-api[19173]: 2017-09-28 13:11:15.322 19173 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:11:15 ctl02 nova-api[19173]: 2017-09-28 13:11:15.322 19173 ERROR nova Traceback (most recent call last):
Sep 28 13:11:15 ctl02 nova-api[19173]: 2017-09-28 13:11:15.322 19173 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:11:15 ctl02 nova-api[19173]: 2017-09-28 13:11:15.322 19173 ERROR nova     sys.exit(main())
Sep 28 13:11:15 ctl02 nova-api[19173]: 2017-09-28 13:11:15.322 19173 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:11:15 ctl02 nova-api[19173]: 2017-09-28 13:11:15.322 19173 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:11:15 ctl02 nova-api[19173]: 2017-09-28 13:11:15.322 19173 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:11:15 ctl02 nova-api[19173]: 2017-09-28 13:11:15.322 19173 ERROR nova     max_url_len=max_url_len)
Sep 28 13:11:15 ctl02 nova-api[19173]: 2017-09-28 13:11:15.322 19173 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:11:15 ctl02 nova-api[19173]: 2017-09-28 13:11:15.322 19173 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:11:15 ctl02 nova-api[19173]: 2017-09-28 13:11:15.322 19173 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:11:15 ctl02 nova-api[19173]: 2017-09-28 13:11:15.322 19173 ERROR nova     sock.listen(backlog)
Sep 28 13:11:15 ctl02 nova-api[19173]: 2017-09-28 13:11:15.322 19173 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:11:15 ctl02 nova-api[19173]: 2017-09-28 13:11:15.322 19173 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:11:15 ctl02 nova-api[19173]: 2017-09-28 13:11:15.322 19173 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:11:15 ctl02 nova-api[19173]: 2017-09-28 13:11:15.322 19173 ERROR nova
Sep 28 13:11:15 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:11:15 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:11:15 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:11:15 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:11:15 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:11:15 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:11:15 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:11:16 ctl02 heat-api-cfn[13300]: 2017-09-28 13:11:16.161 13300 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:11:16] "OPTIONS / HTTP/1.0" 200 134 0.000513
Sep 28 13:11:16 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4c052522)
Sep 28 13:11:16 ctl02 heat-api[13008]: 2017-09-28 13:11:16.711 13087 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:11:16] "OPTIONS / HTTP/1.0" 200 134 0.000671
Sep 28 13:11:17 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4c052522)
Sep 28 13:11:17 ctl02 heat-api-cfn[13300]: 2017-09-28 13:11:17.227 13300 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:11:17] "OPTIONS / HTTP/1.0" 200 134 0.000483
Sep 28 13:11:17 ctl02 heat-api[13008]: 2017-09-28 13:11:17.340 13084 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:11:17] "OPTIONS / HTTP/1.0" 200 134 0.000583
Sep 28 13:11:17 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:11:17.394 13265 INFO eventlet.wsgi.server [-] 10.167.4.12 - - [28/Sep/2017 13:11:17] "OPTIONS / HTTP/1.0" 200 134 0.000424
Sep 28 13:11:17 ctl02 nova-api[19191]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:11:17 ctl02 nova-api[19191]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:11:17 ctl02 nova-scheduler[5620]: 2017-09-28 13:11:17.540 5620 ERROR oslo.messaging._drivers.impl_rabbit [req-8db81c65-2e6a-4794-9d71-03acb8380114 - - - - -] AMQP server on 127.0.0.1:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 32 seconds.
Sep 28 13:11:17 ctl02 nova-api[19191]: 2017-09-28 13:11:17.605 19191 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:11:17 ctl02 nova-api[19191]: 2017-09-28 13:11:17.607 19191 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:11:17 ctl02 nova-api[19191]: 2017-09-28 13:11:17.607 19191 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:11:17 ctl02 nova-api[19191]: 2017-09-28 13:11:17.607 19191 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:11:17 ctl02 nova-api[19191]: 2017-09-28 13:11:17.607 19191 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:11:17 ctl02 nova-api[19191]: 2017-09-28 13:11:17.607 19191 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:11:17 ctl02 nova-api[19191]: 2017-09-28 13:11:17.607 19191 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:11:17 ctl02 nova-api[19191]: 2017-09-28 13:11:17.607 19191 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:11:17 ctl02 nova-api[19191]: 2017-09-28 13:11:17.607 19191 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:11:17 ctl02 nova-api[19191]: 2017-09-28 13:11:17.607 19191 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:11:17 ctl02 nova-api[19191]: 2017-09-28 13:11:17.607 19191 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:11:17 ctl02 nova-api[19191]: 2017-09-28 13:11:17.607 19191 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:11:17 ctl02 nova-api[19191]: 2017-09-28 13:11:17.607 19191 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:11:17 ctl02 nova-api[19191]: 2017-09-28 13:11:17.607 19191 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:11:17 ctl02 nova-api[19191]: 2017-09-28 13:11:17.607 19191 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:11:17 ctl02 nova-api[19191]: 2017-09-28 13:11:17.607 19191 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:11:17 ctl02 nova-api[19191]: 2017-09-28 13:11:17.607 19191 ERROR nova.wsgi     self.filename))
Sep 28 13:11:17 ctl02 nova-api[19191]: 2017-09-28 13:11:17.607 19191 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:11:17 ctl02 nova-api[19191]: 2017-09-28 13:11:17.607 19191 ERROR nova.wsgi
Sep 28 13:11:17 ctl02 nova-api[19191]: 2017-09-28 13:11:17.607 19191 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:11:17 ctl02 heat-api-cloudwatch[13265]: 2017-09-28 13:11:17.698 13265 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:11:17] "OPTIONS / HTTP/1.0" 200 134 0.000454
Sep 28 13:11:17 ctl02 nova-api[19191]: 2017-09-28 13:11:17.734 19191 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:11:17 ctl02 nova-api[19191]: 2017-09-28 13:11:17.960 19191 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:11:17 ctl02 nova-api[19191]: 2017-09-28 13:11:17.962 19191 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:11:17 ctl02 nova-api[19191]: 2017-09-28 13:11:17.962 19191 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:11:17 ctl02 nova-api[19191]: 2017-09-28 13:11:17.962 19191 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:11:18 ctl02 nova-api[19191]: 2017-09-28 13:11:18.094 19191 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:11:18 ctl02 nova-api[19191]: 2017-09-28 13:11:18.096 19191 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:11:18 ctl02 nova-api[19191]: 2017-09-28 13:11:18.096 19191 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:11:18 ctl02 nova-api[19191]: 2017-09-28 13:11:18.097 19191 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:11:18 ctl02 nova-api[19191]: 2017-09-28 13:11:18.100 19191 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:11:18 ctl02 nova-api[19191]: 2017-09-28 13:11:18.100 19191 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:11:18 ctl02 nova-api[19191]: 2017-09-28 13:11:18.100 19191 ERROR nova Traceback (most recent call last):
Sep 28 13:11:18 ctl02 nova-api[19191]: 2017-09-28 13:11:18.100 19191 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:11:18 ctl02 nova-api[19191]: 2017-09-28 13:11:18.100 19191 ERROR nova     sys.exit(main())
Sep 28 13:11:18 ctl02 nova-api[19191]: 2017-09-28 13:11:18.100 19191 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:11:18 ctl02 nova-api[19191]: 2017-09-28 13:11:18.100 19191 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:11:18 ctl02 nova-api[19191]: 2017-09-28 13:11:18.100 19191 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:11:18 ctl02 nova-api[19191]: 2017-09-28 13:11:18.100 19191 ERROR nova     max_url_len=max_url_len)
Sep 28 13:11:18 ctl02 nova-api[19191]: 2017-09-28 13:11:18.100 19191 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:11:18 ctl02 nova-api[19191]: 2017-09-28 13:11:18.100 19191 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:11:18 ctl02 nova-api[19191]: 2017-09-28 13:11:18.100 19191 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:11:18 ctl02 nova-api[19191]: 2017-09-28 13:11:18.100 19191 ERROR nova     sock.listen(backlog)
Sep 28 13:11:18 ctl02 nova-api[19191]: 2017-09-28 13:11:18.100 19191 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:11:18 ctl02 nova-api[19191]: 2017-09-28 13:11:18.100 19191 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:11:18 ctl02 nova-api[19191]: 2017-09-28 13:11:18.100 19191 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:11:18 ctl02 nova-api[19191]: 2017-09-28 13:11:18.100 19191 ERROR nova
Sep 28 13:11:18 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4c052522)
Sep 28 13:11:18 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:11:18 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:11:18 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:11:18 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:11:18 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:11:18 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:11:18 ctl02 systemd[1]: Started OpenStack Compute API.
Sep 28 13:11:18 ctl02 glance-api[29183]: 2017-09-28 13:11:18.620 29251 INFO eventlet.wsgi.server [-] 10.167.4.13 - - [28/Sep/2017 13:11:18] "OPTIONS / HTTP/1.0" 200 134 0.000683
Sep 28 13:11:18 ctl02 neutron-server[30536]: 2017-09-28 13:11:18.677 30596 INFO neutron.wsgi [-] 10.167.4.11 - - [28/Sep/2017 13:11:18] "OPTIONS / HTTP/1.0" 200 262 0.000531
Sep 28 13:11:19 ctl02 salt-minion[14967]: [INFO    ] User sudo_ubuntu Executing command cp.push_dir with jid 20170928131120526204
Sep 28 13:11:19 ctl02 salt-minion[14967]: [INFO    ] Starting a new job with PID 19220
Sep 28 13:11:19 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4c052522)
Sep 28 13:11:20 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4c052522)
Sep 28 13:11:20 ctl02 nova-api[19209]: Option "logdir" from group "DEFAULT" is deprecated. Use option "log-dir" from group "DEFAULT".
Sep 28 13:11:20 ctl02 nova-api[19209]: Option "verbose" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
Sep 28 13:11:20 ctl02 nova-api[19209]: 2017-09-28 13:11:20.391 19209 WARNING oslo_reports.guru_meditation_report [-] Guru mediation now registers SIGUSR1 and SIGUSR2 by default for backward compatibility. SIGUSR1 will no longer be registered in a future release, so please use SIGUSR2 to generate reports.
Sep 28 13:11:20 ctl02 nova-api[19209]: 2017-09-28 13:11:20.393 19209 ERROR nova.wsgi [-] Couldn't lookup app: ec2
Sep 28 13:11:20 ctl02 nova-api[19209]: 2017-09-28 13:11:20.393 19209 ERROR nova.wsgi Traceback (most recent call last):
Sep 28 13:11:20 ctl02 nova-api[19209]: 2017-09-28 13:11:20.393 19209 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 497, in load_app
Sep 28 13:11:20 ctl02 nova-api[19209]: 2017-09-28 13:11:20.393 19209 ERROR nova.wsgi     return deploy.loadapp("config:%s" % self.config_path, name=name)
Sep 28 13:11:20 ctl02 nova-api[19209]: 2017-09-28 13:11:20.393 19209 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 247, in loadapp
Sep 28 13:11:20 ctl02 nova-api[19209]: 2017-09-28 13:11:20.393 19209 ERROR nova.wsgi     return loadobj(APP, uri, name=name, **kw)
Sep 28 13:11:20 ctl02 nova-api[19209]: 2017-09-28 13:11:20.393 19209 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 271, in loadobj
Sep 28 13:11:20 ctl02 nova-api[19209]: 2017-09-28 13:11:20.393 19209 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:11:20 ctl02 nova-api[19209]: 2017-09-28 13:11:20.393 19209 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 296, in loadcontext
Sep 28 13:11:20 ctl02 nova-api[19209]: 2017-09-28 13:11:20.393 19209 ERROR nova.wsgi     global_conf=global_conf)
Sep 28 13:11:20 ctl02 nova-api[19209]: 2017-09-28 13:11:20.393 19209 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 320, in _loadconfig
Sep 28 13:11:20 ctl02 nova-api[19209]: 2017-09-28 13:11:20.393 19209 ERROR nova.wsgi     return loader.get_context(object_type, name, global_conf)
Sep 28 13:11:20 ctl02 nova-api[19209]: 2017-09-28 13:11:20.393 19209 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 408, in get_context
Sep 28 13:11:20 ctl02 nova-api[19209]: 2017-09-28 13:11:20.393 19209 ERROR nova.wsgi     object_type, name=name)
Sep 28 13:11:20 ctl02 nova-api[19209]: 2017-09-28 13:11:20.393 19209 ERROR nova.wsgi   File "/usr/lib/python2.7/dist-packages/paste/deploy/loadwsgi.py", line 587, in find_config_section
Sep 28 13:11:20 ctl02 nova-api[19209]: 2017-09-28 13:11:20.393 19209 ERROR nova.wsgi     self.filename))
Sep 28 13:11:20 ctl02 nova-api[19209]: 2017-09-28 13:11:20.393 19209 ERROR nova.wsgi LookupError: No section 'ec2' (prefixed by 'app' or 'application' or 'composite' or 'composit' or 'pipeline' or 'filter-app') found in config /etc/nova/api-paste.ini
Sep 28 13:11:20 ctl02 nova-api[19209]: 2017-09-28 13:11:20.393 19209 ERROR nova.wsgi
Sep 28 13:11:20 ctl02 nova-api[19209]: 2017-09-28 13:11:20.394 19209 WARNING nova.cmd.api [-] Could not load paste app 'ec2' from /etc/nova/api-paste.ini. ``enabled_apis`` includes bad values. Fix to remove this warning.
Sep 28 13:11:20 ctl02 nova-api[19209]: 2017-09-28 13:11:20.526 19209 INFO oslo_service.periodic_task [-] Skipping periodic task _periodic_update_dns because its interval is negative
Sep 28 13:11:20 ctl02 nova-api[19209]: 2017-09-28 13:11:20.762 19209 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:11:20 ctl02 nova-api[19209]: 2017-09-28 13:11:20.764 19209 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:11:20 ctl02 nova-api[19209]: 2017-09-28 13:11:20.764 19209 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:11:20 ctl02 nova-api[19209]: 2017-09-28 13:11:20.765 19209 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:11:20 ctl02 glance-api[29183]: 2017-09-28 13:11:20.888 29251 INFO eventlet.wsgi.server [-] 10.167.4.11 - - [28/Sep/2017 13:11:20] "OPTIONS / HTTP/1.0" 200 134 0.000592
Sep 28 13:11:20 ctl02 nova-api[19209]: 2017-09-28 13:11:20.906 19209 INFO nova.api.openstack [-] Loaded extensions: ['extensions', 'flavors', 'image-metadata', 'image-size', 'images', 'ips', 'limits', 'os-access-ips', 'os-admin-actions', 'os-admin-password', 'os-agents', 'os-aggregates', 'os-assisted-volume-snapshots', 'os-attach-interfaces', 'os-availability-zone', 'os-baremetal-nodes', 'os-block-device-mapping', 'os-cells', 'os-certificates', 'os-cloudpipe', 'os-config-drive', 'os-console-auth-tokens', 'os-console-output', 'os-consoles', 'os-create-backup', 'os-deferred-delete', 'os-disk-config', 'os-evacuate', 'os-extended-availability-zone', 'os-extended-server-attributes', 'os-extended-status', 'os-extended-volumes', 'os-fixed-ips', 'os-flavor-access', 'os-flavor-extra-specs', 'os-flavor-manage', 'os-flavor-rxtx', 'os-floating-ip-dns', 'os-floating-ip-pools', 'os-floating-ips', 'os-floating-ips-bulk', 'os-fping', 'os-hide-server-addresses', 'os-hosts', 'os-hypervisors', 'os-instance-actions', 'os-instance-usage-audit-log', 'os-keypairs', 'os-lock-server', 'os-migrate-server', 'os-migrations', 'os-multinic', 'os-multiple-create', 'os-networks', 'os-networks-associate', 'os-pause-server', 'os-personality', 'os-preserve-ephemeral-rebuild', 'os-quota-class-sets', 'os-quota-sets', 'os-remote-consoles', 'os-rescue', 'os-scheduler-hints', 'os-security-group-default-rules', 'os-security-groups', 'os-server-diagnostics', 'os-server-external-events', 'os-server-groups', 'os-server-password', 'os-server-usage', 'os-services', 'os-shelve', 'os-simple-tenant-usage', 'os-suspend-server', 'os-tenant-networks', 'os-used-limits', 'os-user-data', 'os-virtual-interfaces', 'os-volumes', 'server-metadata', 'server-migrations', 'servers', 'versions']
Sep 28 13:11:20 ctl02 nova-api[19209]: 2017-09-28 13:11:20.908 19209 WARNING keystonemiddleware.auth_token [-] Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release.
Sep 28 13:11:20 ctl02 nova-api[19209]: 2017-09-28 13:11:20.908 19209 WARNING keystonemiddleware.auth_token [-] Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the N release, use 'identity_uri\ instead.
Sep 28 13:11:20 ctl02 nova-api[19209]: 2017-09-28 13:11:20.908 19209 WARNING keystonemiddleware.auth_token [-] Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Sep 28 13:11:20 ctl02 nova-api[19209]: 2017-09-28 13:11:20.912 19209 ERROR nova.wsgi [-] Could not bind to 0.0.0.0:8774
Sep 28 13:11:20 ctl02 nova-api[19209]: 2017-09-28 13:11:20.912 19209 CRITICAL nova [-] error: [Errno 98] Address already in use
Sep 28 13:11:20 ctl02 nova-api[19209]: 2017-09-28 13:11:20.912 19209 ERROR nova Traceback (most recent call last):
Sep 28 13:11:20 ctl02 nova-api[19209]: 2017-09-28 13:11:20.912 19209 ERROR nova   File "/usr/bin/nova-api", line 10, in <module>
Sep 28 13:11:20 ctl02 nova-api[19209]: 2017-09-28 13:11:20.912 19209 ERROR nova     sys.exit(main())
Sep 28 13:11:20 ctl02 nova-api[19209]: 2017-09-28 13:11:20.912 19209 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/cmd/api.py", line 57, in main
Sep 28 13:11:20 ctl02 nova-api[19209]: 2017-09-28 13:11:20.912 19209 ERROR nova     server = service.WSGIService(api, use_ssl=should_use_ssl)
Sep 28 13:11:20 ctl02 nova-api[19209]: 2017-09-28 13:11:20.912 19209 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/service.py", line 383, in __init__
Sep 28 13:11:20 ctl02 nova-api[19209]: 2017-09-28 13:11:20.912 19209 ERROR nova     max_url_len=max_url_len)
Sep 28 13:11:20 ctl02 nova-api[19209]: 2017-09-28 13:11:20.912 19209 ERROR nova   File "/usr/lib/python2.7/dist-packages/nova/wsgi.py", line 101, in __init__
Sep 28 13:11:20 ctl02 nova-api[19209]: 2017-09-28 13:11:20.912 19209 ERROR nova     self._socket = eventlet.listen(bind_addr, family, backlog=backlog)
Sep 28 13:11:20 ctl02 nova-api[19209]: 2017-09-28 13:11:20.912 19209 ERROR nova   File "/usr/lib/python2.7/dist-packages/eventlet/convenience.py", line 44, in listen
Sep 28 13:11:20 ctl02 nova-api[19209]: 2017-09-28 13:11:20.912 19209 ERROR nova     sock.listen(backlog)
Sep 28 13:11:20 ctl02 nova-api[19209]: 2017-09-28 13:11:20.912 19209 ERROR nova   File "/usr/lib/python2.7/socket.py", line 228, in meth
Sep 28 13:11:20 ctl02 nova-api[19209]: 2017-09-28 13:11:20.912 19209 ERROR nova     return getattr(self._sock,name)(*args)
Sep 28 13:11:20 ctl02 nova-api[19209]: 2017-09-28 13:11:20.912 19209 ERROR nova error: [Errno 98] Address already in use
Sep 28 13:11:20 ctl02 nova-api[19209]: 2017-09-28 13:11:20.912 19209 ERROR nova
Sep 28 13:11:20 ctl02 neutron-server[30536]: 2017-09-28 13:11:20.935 30536 WARNING neutron.db.agents_db [req-26786290-57bf-4026-ae7e-38e8edf8d051 - - - - -] Agent healthcheck: found 2 dead agents out of 6:
Sep 28 13:11:20 ctl02 neutron-server[30536]:                 Type       Last heartbeat host
Sep 28 13:11:20 ctl02 neutron-server[30536]:             L3 agent  2017-09-28 13:10:39 cmp002
Sep 28 13:11:20 ctl02 neutron-server[30536]:           DHCP agent  2017-09-28 13:09:56 cmp002
Sep 28 13:11:21 ctl02 systemd[1]: nova-api.service: Main process exited, code=exited, status=1/FAILURE
Sep 28 13:11:21 ctl02 systemd[1]: nova-api.service: Unit entered failed state.
Sep 28 13:11:21 ctl02 systemd[1]: nova-api.service: Failed with result 'exit-code'.
Sep 28 13:11:21 ctl02 dhclient[627]: DHCPDISCOVER on ens3 to 255.255.255.255 port 67 interval 1 (xid=0x4c052522)
Sep 28 13:11:21 ctl02 systemd[1]: nova-api.service: Service hold-off time over, scheduling restart.
Sep 28 13:11:21 ctl02 systemd[1]: Stopped OpenStack Compute API.
Sep 28 13:11:21 ctl02 systemd[1]: Starting OpenStack Compute API...
Sep 28 13:11:21 ctl02 systemd[1]: Started OpenStack Compute API.
